2023-09-30T22:05:53.782 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T22:05:53.783 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_dparmar@teuthology --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} --name dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi --archive /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041 -- /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/orig.config.yaml 2023-09-30T22:05:53.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T22:05:53.923 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} email: null first_in_suite: false job_id: '7408041' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.dir_split install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 owner: scheduled_dparmar@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 2683 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: 6973b24e3d99fd494b753449d2ea12077599cbd6 targets: smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBW66LlovI1TzPaGsRaW2k+nTMa2yNgPF4xgH8hTzArYkmYeZbxnE9xi99jvLgMoLUNO5QW09mOF16xggIrWRrI= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHr/4AXmJTqe+3sgJc74dBzRweecv4/7DLOy74Xb4A2itSotAOtXCHyOch02qq2C4AYYCq4vxqeTm01d9tCmi2I= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - suites/blogbench.sh teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-30_21:53:45 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-30T22:05:53.924 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa; will attempt to use it 2023-09-30T22:05:53.925 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks 2023-09-30T22:05:53.925 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-30T22:05:53.926 INFO:teuthology.task.internal:Checking packages... 2023-09-30T22:05:53.949 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-09-30T22:05:53.950 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:05:53.950 INFO:teuthology.packaging:ref: None 2023-09-30T22:05:53.950 INFO:teuthology.packaging:tag: None 2023-09-30T22:05:53.950 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-09-30T22:05:53.950 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:05:53.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-09-30T22:05:54.090 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-09-30T22:05:54.090 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-30T22:05:54.096 INFO:teuthology.task.internal:no buildpackages task found 2023-09-30T22:05:54.096 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-30T22:05:54.115 INFO:teuthology.task.internal:Saving configuration 2023-09-30T22:05:54.133 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-30T22:05:54.139 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:05:54.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:00:13.339786', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBW66LlovI1TzPaGsRaW2k+nTMa2yNgPF4xgH8hTzArYkmYeZbxnE9xi99jvLgMoLUNO5QW09mOF16xggIrWRrI='} 2023-09-30T22:05:54.187 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:00:13.338352', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHr/4AXmJTqe+3sgJc74dBzRweecv4/7DLOy74Xb4A2itSotAOtXCHyOch02qq2C4AYYCq4vxqeTm01d9tCmi2I='} 2023-09-30T22:05:54.187 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-30T22:05:54.193 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-09-30T22:05:54.193 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['client.0'] 2023-09-30T22:05:54.193 INFO:teuthology.run_tasks:Running task console_log... 2023-09-30T22:05:54.270 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1b33eeef70>, signals=[15]) 2023-09-30T22:05:54.270 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-30T22:05:54.276 INFO:teuthology.task.internal:Opening connections... 2023-09-30T22:05:54.276 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:05:54.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:05:54.350 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2023-09-30T22:05:54.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:05:54.419 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-30T22:05:54.426 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-09-30T22:05:54.449 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-09-30T22:05:54.450 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-09-30T22:05:54.511 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-09-30T22:05:54.511 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8" 2023-09-30T22:05:54.511 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-09-30T22:05:54.511 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:05:54.511 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8" 2023-09-30T22:05:54.511 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:05:54.511 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:05:54.511 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-09-30T22:05:54.512 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:05:54.512 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:05:54.512 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:05:54.512 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:05:54.512 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:05:54.513 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-09-30T22:05:54.536 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-09-30T22:05:54.560 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-09-30T22:05:54.560 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-09-30T22:05:54.620 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2023-09-30T22:05:54.620 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T22:05:54.621 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T22:05:54.622 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-09-30T22:05:54.646 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-30T22:05:54.657 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-30T22:05:54.663 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-30T22:05:54.664 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:05:54.667 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2023-09-30T22:05:54.686 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-30T22:05:54.693 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-30T22:05:54.693 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:05:54.728 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2023-09-30T22:05:54.758 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-30T22:05:54.811 INFO:teuthology.run_tasks:Running task kernel... 2023-09-30T22:05:54.825 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-30T22:05:54.826 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-30T22:05:54.826 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:05:54.826 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T22:05:54.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:05:54.846 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2023-09-30T22:05:54.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:05:54.847 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-09-30T22:05:54.907 INFO:teuthology.orchestra.run.smithi163.stdout:4.18.0-489.el8.x86_64 2023-09-30T22:05:54.908 INFO:teuthology.task.kernel:Running kernel on smithi163: 4.18.0-489.el8.x86_64 2023-09-30T22:05:54.908 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum install -y kernel 2023-09-30T22:05:54.909 INFO:teuthology.orchestra.run.smithi154.stdout:4.18.0-489.el8.x86_64 2023-09-30T22:05:54.909 INFO:teuthology.task.kernel:Running kernel on smithi154: 4.18.0-489.el8.x86_64 2023-09-30T22:05:54.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2023-09-30T22:05:59.561 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - AppStream 17 MB/s | 33 MB 00:02 2023-09-30T22:05:59.562 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 8 - AppStream 16 MB/s | 33 MB 00:02 2023-09-30T22:06:08.261 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - BaseOS 18 MB/s | 48 MB 00:02 2023-09-30T22:06:08.653 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 48 MB 00:02 2023-09-30T22:06:15.285 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - Extras 113 kB/s | 18 kB 00:00 2023-09-30T22:06:15.744 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 8 - Extras 101 kB/s | 18 kB 00:00 2023-09-30T22:06:15.894 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2023-09-30T22:06:16.087 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 8 - Extras common packages 42 kB/s | 6.9 kB 00:00 2023-09-30T22:06:16.237 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-09-30T22:06:16.405 INFO:teuthology.orchestra.run.smithi163.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-09-30T22:06:16.930 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2023-09-30T22:06:17.897 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-09-30T22:06:20.797 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 262 kB/s | 24 kB 00:00 2023-09-30T22:06:21.698 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 378 kB/s | 24 kB 00:00 2023-09-30T22:06:24.288 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-09-30T22:06:24.288 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-09-30T22:06:24.536 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-09-30T22:06:24.536 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-09-30T22:06:24.536 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout:Install 3 Packages 2023-09-30T22:06:24.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:06:24.538 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 88 M 2023-09-30T22:06:24.538 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 96 M 2023-09-30T22:06:24.538 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-09-30T22:06:25.138 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-09-30T22:06:25.138 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-09-30T22:06:25.392 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-09-30T22:06:25.392 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2023-09-30T22:06:25.392 INFO:teuthology.orchestra.run.smithi163.stdout: Package Architecture Version Repository Size 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout:Install 3 Packages 2023-09-30T22:06:25.393 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:06:25.394 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 88 M 2023-09-30T22:06:25.394 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 96 M 2023-09-30T22:06:25.394 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2023-09-30T22:06:25.406 INFO:teuthology.orchestra.run.smithi154.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 15 MB/s | 10 MB 00:00 2023-09-30T22:06:25.644 INFO:teuthology.orchestra.run.smithi163.stdout:[MIRROR] kernel-modules-4.18.0-514.el8.x86_64.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-modules-4.18.0-514.el8.x86_64.rpm (IP: 152.19.134.43) 2023-09-30T22:06:26.290 INFO:teuthology.orchestra.run.smithi163.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 14 MB/s | 10 MB 00:00 2023-09-30T22:06:26.981 INFO:teuthology.orchestra.run.smithi154.stdout:(2/3): kernel-core-4.18.0-514.el8.x86_64.rpm 19 MB/s | 43 MB 00:02 2023-09-30T22:06:27.149 INFO:teuthology.orchestra.run.smithi163.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 23 MB/s | 35 MB 00:01 2023-09-30T22:06:27.340 INFO:teuthology.orchestra.run.smithi154.stdout:(3/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 14 MB/s | 35 MB 00:02 2023-09-30T22:06:27.340 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:06:27.341 INFO:teuthology.orchestra.run.smithi154.stdout:Total 31 MB/s | 88 MB 00:02 2023-09-30T22:06:27.866 INFO:teuthology.orchestra.run.smithi163.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 19 MB/s | 43 MB 00:02 2023-09-30T22:06:27.866 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:06:27.866 INFO:teuthology.orchestra.run.smithi163.stdout:Total 36 MB/s | 88 MB 00:02 2023-09-30T22:06:28.012 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-09-30T22:06:28.437 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-09-30T22:06:28.437 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-09-30T22:06:28.538 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2023-09-30T22:06:28.969 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2023-09-30T22:06:28.970 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2023-09-30T22:06:29.656 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-09-30T22:06:29.681 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-09-30T22:06:30.193 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2023-09-30T22:06:30.217 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2023-09-30T22:06:32.474 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-09-30T22:06:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:06:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2023-09-30T22:06:33.777 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:06:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:06:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:06:37.467 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:06:37.868 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:06:40.351 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:06:40.675 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:06:41.251 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:06:41.573 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:07:02.404 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:07:02.428 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:07:02.783 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:07:02.783 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:07:02.783 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:07:03.294 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:07:03.319 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:07:03.531 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:07:03.531 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:07:03.531 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-09-30T22:07:03.531 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-09-30T22:07:03.531 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-09-30T22:07:03.532 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:07:03.532 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-09-30T22:07:03.673 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:07:03.723 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:07:03.723 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-09-30T22:07:03.723 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-09-30T22:07:03.885 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:07:03.885 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:07:03.885 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-09-30T22:07:03.886 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T22:07:03.886 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T22:07:03.886 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-30T22:07:03.886 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T22:07:03.886 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:07:04.098 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:07:04.098 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:07:04.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -qi grub2-tools 2023-09-30T22:07:04.132 INFO:teuthology.orchestra.run.smithi154.stdout:Name : grub2-tools 2023-09-30T22:07:04.132 INFO:teuthology.orchestra.run.smithi154.stdout:Epoch : 1 2023-09-30T22:07:04.132 INFO:teuthology.orchestra.run.smithi154.stdout:Version : 2.02 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Release : 129.el8 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: x86_64 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Group : System Environment/Base 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Size : 9265586 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:License : GPLv3+ 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-30T22:07:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:Relocations : (not relocatable) 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:Packager : CentOS BuildSystem 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:Vendor : CentOS 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:Summary : Support tools for GRUB. 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:Description : 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:hardware devices. 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:07:04.134 INFO:teuthology.orchestra.run.smithi154.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T22:07:04.135 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T22:07:04.135 INFO:teuthology.task.kernel:Updating grub on smithi154 to boot 4.18.0-514.el8.x86_64 2023-09-30T22:07:04.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T22:07:04.452 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-09-30T22:07:04.452 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:07:04.452 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2023-09-30T22:07:04.452 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-09-30T22:07:04.452 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-09-30T22:07:04.452 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:07:04.452 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-09-30T22:07:04.581 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:07:04.843 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:07:04.844 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:07:04.844 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-09-30T22:07:04.844 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T22:07:04.844 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T22:07:04.844 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-09-30T22:07:04.844 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T22:07:04.844 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T22:07:05.053 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-4.18.0-514.el8.x86_64 2023-09-30T22:07:05.054 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-09-30T22:07:05.054 DEBUG:teuthology.orchestra.run.smithi163:> sudo rpm -qi grub2-tools 2023-09-30T22:07:05.087 INFO:teuthology.orchestra.run.smithi163.stdout:Name : grub2-tools 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:Epoch : 1 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:Version : 2.02 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:Release : 129.el8 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: x86_64 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:Group : System Environment/Base 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:Size : 9265586 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:License : GPLv3+ 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-09-30T22:07:05.088 INFO:teuthology.orchestra.run.smithi163.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:Build Host : kbuilder.bsys.centos.org 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:Relocations : (not relocatable) 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:Packager : CentOS BuildSystem 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:Vendor : CentOS 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:Summary : Support tools for GRUB. 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:Description : 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-30T22:07:05.089 INFO:teuthology.orchestra.run.smithi163.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-30T22:07:05.090 INFO:teuthology.orchestra.run.smithi163.stdout:hardware devices. 2023-09-30T22:07:05.090 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:07:05.090 INFO:teuthology.orchestra.run.smithi163.stdout:This subpackage provides tools for support of all platforms. 2023-09-30T22:07:05.090 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-30T22:07:05.091 INFO:teuthology.task.kernel:Updating grub on smithi163 to boot 4.18.0-514.el8.x86_64 2023-09-30T22:07:05.091 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-30T22:07:05.835 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2023-09-30T22:07:07.017 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2023-09-30T22:07:08.133 INFO:teuthology.orchestra.run.smithi154.stderr:done 2023-09-30T22:07:08.134 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-09-30T22:07:08.171 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.YjfkWZLC28 2023-09-30T22:07:08.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YjfkWZLC28 2023-09-30T22:07:08.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.YjfkWZLC28 2023-09-30T22:07:08.389 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.YjfkWZLC28 is 6KB 2023-09-30T22:07:08.437 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.YjfkWZLC28 2023-09-30T22:07:08.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T22:07:08.523 INFO:teuthology.orchestra.run.smithi154.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-30T22:07:08.523 INFO:teuthology.orchestra.run.smithi154.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-30T22:07:08.523 INFO:teuthology.orchestra.run.smithi154.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-30T22:07:08.523 INFO:teuthology.orchestra.run.smithi154.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-09-30T22:07:08.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-09-30T22:07:08.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2023-09-30T22:07:09.667 INFO:teuthology.orchestra.run.smithi163.stderr:done 2023-09-30T22:07:09.669 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2023-09-30T22:07:09.703 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.D7GL3lhftI 2023-09-30T22:07:09.704 DEBUG:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.D7GL3lhftI 2023-09-30T22:07:09.778 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.D7GL3lhftI 2023-09-30T22:07:09.925 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.D7GL3lhftI is 6KB 2023-09-30T22:07:09.974 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.D7GL3lhftI 2023-09-30T22:07:09.992 DEBUG:teuthology.orchestra.run.smithi163:> sudo /bin/ls /boot/loader/entries || true 2023-09-30T22:07:10.064 INFO:teuthology.orchestra.run.smithi163.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-09-30T22:07:10.064 INFO:teuthology.orchestra.run.smithi163.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-09-30T22:07:10.064 INFO:teuthology.orchestra.run.smithi163.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-09-30T22:07:10.064 INFO:teuthology.orchestra.run.smithi163.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-09-30T22:07:10.065 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-09-30T22:07:10.224 DEBUG:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2023-09-30T22:07:38.718 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-30T22:07:38.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-09-30T22:07:38.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:07:40.228 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-30T22:07:40.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-09-30T22:07:40.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:07:57.050 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-09-30T22:07:58.586 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-09-30T22:08:06.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-09-30T22:08:06.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:08:07.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-09-30T22:08:07.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:08:09.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-09-30T22:08:10.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-09-30T22:08:21.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-09-30T22:08:21.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:08:22.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-09-30T22:08:22.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:08:25.722 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-09-30T22:08:39.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-09-30T22:08:40.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-09-30T22:08:40.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:08:54.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-09-30T22:08:54.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:08:54.946 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-09-30T22:08:55.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-09-30T22:08:55.199 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-09-30T22:08:55.199 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-09-30T22:08:55.217 INFO:teuthology.orchestra.run.smithi154.stdout:4.18.0-514.el8.x86_64 2023-09-30T22:08:55.217 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-09-30T22:08:55.217 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T22:08:55.217 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T22:08:56.218 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-30T22:08:56.219 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T22:08:56.300 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2023-09-30T22:08:56.318 DEBUG:teuthology.parallel:result is None 2023-09-30T22:08:59.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-09-30T22:09:17.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-09-30T22:09:17.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:09:17.962 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-09-30T22:09:18.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-09-30T22:09:18.256 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-514.el8.x86_64"... 2023-09-30T22:09:18.256 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2023-09-30T22:09:18.273 INFO:teuthology.orchestra.run.smithi163.stdout:4.18.0-514.el8.x86_64 2023-09-30T22:09:18.274 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-09-30T22:09:18.274 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T22:09:18.274 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-09-30T22:09:19.274 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-09-30T22:09:19.274 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T22:09:19.345 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2023-09-30T22:09:19.361 DEBUG:teuthology.parallel:result is None 2023-09-30T22:09:19.361 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-30T22:09:19.367 INFO:teuthology.task.internal:Creating test directory... 2023-09-30T22:09:19.368 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:09:19.371 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T22:09:19.393 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-30T22:09:19.414 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-30T22:09:19.424 INFO:teuthology.task.internal:Creating archive directory... 2023-09-30T22:09:19.424 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:09:19.437 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T22:09:19.469 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-30T22:09:19.477 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-30T22:09:19.477 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:09:19.505 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T22:09:19.541 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:09:19.547 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:09:19.552 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:09:19.558 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T22:09:19.560 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-30T22:09:19.567 INFO:teuthology.task.internal:Configuring sudo... 2023-09-30T22:09:19.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:09:19.596 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T22:09:19.630 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-30T22:09:19.640 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-30T22:09:19.641 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:09:19.671 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:09:19.690 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:09:19.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:09:19.836 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:09:19.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:09:19.924 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:09:19.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:09:19.991 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:09:20.036 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T22:09:20.096 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:09:20.184 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T22:09:20.225 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:09:20.225 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T22:09:20.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2023-09-30T22:09:20.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2023-09-30T22:09:20.363 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:09:20.395 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:09:20.810 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-30T22:09:20.819 INFO:teuthology.task.internal:Starting timer... 2023-09-30T22:09:20.819 INFO:teuthology.run_tasks:Running task pcp... 2023-09-30T22:09:20.833 INFO:teuthology.run_tasks:Running task selinux... 2023-09-30T22:09:20.843 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-30T22:09:20.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2023-09-30T22:09:20.923 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2023-09-30T22:09:20.925 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2023-09-30T22:09:21.024 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2023-09-30T22:09:21.026 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-30T22:09:21.026 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2023-09-30T22:09:21.048 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2023-09-30T22:09:21.049 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2023-09-30T22:09:21.105 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2023-09-30T22:09:21.105 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi163.front.sepia.ceph.com': 'permissive'} 2023-09-30T22:09:21.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:09:21.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:09:21.133 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:09:21.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:09:21.162 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-30T22:09:21.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:09:21.206 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2023-09-30T22:09:21.235 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-30T22:09:21.246 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-30T22:09:21.246 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-30T22:09:21.262 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-30T22:09:21.264 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi154.front.sepia.ceph.com,smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-30T22:16:41.719 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2023-09-30T22:16:41.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-09-30T22:16:41.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:16:41.790 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-09-30T22:16:41.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-09-30T22:16:41.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-09-30T22:16:41.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T22:16:41.933 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-09-30T22:16:42.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-09-30T22:16:42.006 INFO:teuthology.run_tasks:Running task clock... 2023-09-30T22:16:42.020 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-30T22:16:42.020 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:16:42.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:16:42.023 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T22:16:42.023 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:16:42.054 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:16:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:16:42.080 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T22:16:42.095 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T22:16:42.142 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2023-09-30T22:16:42.153 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2023-09-30T22:16:42.160 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2023-09-30T22:16:42.167 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:16:42.172 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2023-09-30T22:16:42.181 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:16:42.186 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T22:16:42.200 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T22:16:42.249 INFO:teuthology.orchestra.run.smithi154.stderr:bash: ntpq: command not found 2023-09-30T22:16:42.252 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:16:42.252 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2023-09-30T22:16:42.253 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:16:42.253 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:16:42.253 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:16:42.253 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:16:42.264 INFO:teuthology.orchestra.run.smithi163.stderr:bash: ntpq: command not found 2023-09-30T22:16:42.267 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:16:42.268 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2023-09-30T22:16:42.268 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:16:42.268 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:16:42.268 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:16:42.268 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:16:42.269 INFO:teuthology.run_tasks:Running task install... 2023-09-30T22:16:42.277 DEBUG:teuthology.task.install:project ceph 2023-09-30T22:16:42.277 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-09-30T22:16:42.277 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-09-30T22:16:42.278 INFO:teuthology.task.install:Using flavor: default 2023-09-30T22:16:42.283 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T22:16:42.283 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-09-30T22:16:42.284 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-09-30T22:16:42.284 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:16:42.284 INFO:teuthology.packaging:ref: None 2023-09-30T22:16:42.284 INFO:teuthology.packaging:tag: None 2023-09-30T22:16:42.284 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:16:42.284 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:16:42.285 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:16:42.286 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-09-30T22:16:42.287 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:16:42.287 INFO:teuthology.packaging:ref: None 2023-09-30T22:16:42.287 INFO:teuthology.packaging:tag: None 2023-09-30T22:16:42.287 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:16:42.287 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:16:42.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:16:42.598 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-09-30T22:16:42.598 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-09-30T22:16:42.603 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-09-30T22:16:42.603 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-09-30T22:16:42.712 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:16:42.713 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:16:42.713 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:16:42.743 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-09-30T22:16:42.743 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:16:42.743 INFO:teuthology.packaging:ref: None 2023-09-30T22:16:42.743 INFO:teuthology.packaging:tag: None 2023-09-30T22:16:42.743 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:16:42.743 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:16:42.743 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:16:42.765 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:16:42.765 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:16:42.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:16:42.797 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-09-30T22:16:42.797 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:16:42.797 INFO:teuthology.packaging:ref: None 2023-09-30T22:16:42.797 INFO:teuthology.packaging:tag: None 2023-09-30T22:16:42.797 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:16:42.797 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:16:42.797 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:16:42.812 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:16:42.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:16:42.891 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:16:42.947 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:16:42.958 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2023-09-30T22:16:42.960 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2023-09-30T22:16:43.015 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2023-09-30T22:16:43.016 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2023-09-30T22:16:43.235 INFO:teuthology.orchestra.run.smithi163.stdout:76 files removed 2023-09-30T22:16:43.266 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-09-30T22:16:43.282 INFO:teuthology.orchestra.run.smithi154.stdout:76 files removed 2023-09-30T22:16:43.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-09-30T22:16:44.042 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 210 kB/s | 76 kB 00:00 2023-09-30T22:16:44.071 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 215 kB/s | 76 kB 00:00 2023-09-30T22:16:44.368 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 53 kB/s | 15 kB 00:00 2023-09-30T22:16:44.430 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 48 kB/s | 15 kB 00:00 2023-09-30T22:16:44.719 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 4.4 kB/s | 1.4 kB 00:00 2023-09-30T22:16:44.747 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2023-09-30T22:16:46.714 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - AppStream 17 MB/s | 33 MB 00:01 2023-09-30T22:16:46.944 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 8 - AppStream 15 MB/s | 33 MB 00:02 2023-09-30T22:16:56.872 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 48 MB 00:03 2023-09-30T22:16:56.961 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 48 MB 00:03 2023-09-30T22:17:03.972 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - Extras 105 kB/s | 18 kB 00:00 2023-09-30T22:17:04.054 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 8 - Extras 103 kB/s | 18 kB 00:00 2023-09-30T22:17:04.540 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-09-30T22:17:04.638 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-09-30T22:17:06.366 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - PowerTools 3.9 MB/s | 6.5 MB 00:01 2023-09-30T22:17:07.314 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 8 - PowerTools 2.6 MB/s | 6.5 MB 00:02 2023-09-30T22:17:07.767 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-09-30T22:17:08.715 INFO:teuthology.orchestra.run.smithi163.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-09-30T22:17:10.385 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 16 MB 00:02 2023-09-30T22:17:14.226 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 419 kB/s | 24 kB 00:00 2023-09-30T22:17:14.883 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 2.6 MB/s | 16 MB 00:06 2023-09-30T22:17:18.437 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:17:18.438 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:17:18.463 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:17:18.463 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:17:18.464 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:17:18.465 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:17:18.672 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-09-30T22:17:18.683 INFO:teuthology.orchestra.run.smithi154.stdout:==================================================================================================== 2023-09-30T22:17:18.684 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-09-30T22:17:18.684 INFO:teuthology.orchestra.run.smithi154.stdout:==================================================================================================== 2023-09-30T22:17:18.684 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-09-30T22:17:18.684 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:17:18.684 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-09-30T22:17:18.684 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-09-30T22:17:18.684 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-09-30T22:17:18.684 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-09-30T22:17:18.684 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-09-30T22:17:18.685 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-09-30T22:17:18.685 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-09-30T22:17:18.685 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-09-30T22:17:18.685 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-09-30T22:17:18.685 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:17:18.685 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:17:18.685 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-09-30T22:17:18.685 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-09-30T22:17:18.686 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-09-30T22:17:18.686 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:17:18.686 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-09-30T22:17:18.686 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-09-30T22:17:18.686 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-09-30T22:17:18.686 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-09-30T22:17:18.686 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-09-30T22:17:18.686 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:17:18.687 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-09-30T22:17:18.687 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2023-09-30T22:17:18.687 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:17:18.687 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:17:18.687 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:17:18.687 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:17:18.688 INFO:teuthology.orchestra.run.smithi154.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:17:18.688 INFO:teuthology.orchestra.run.smithi154.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:17:18.688 INFO:teuthology.orchestra.run.smithi154.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:17:18.688 INFO:teuthology.orchestra.run.smithi154.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:17:18.688 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:17:18.688 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-09-30T22:17:18.688 INFO:teuthology.orchestra.run.smithi154.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:17:18.689 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:17:18.689 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:17:18.689 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:17:18.689 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-09-30T22:17:18.689 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-09-30T22:17:18.689 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-09-30T22:17:18.689 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-09-30T22:17:18.689 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-09-30T22:17:18.690 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-09-30T22:17:18.690 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-09-30T22:17:18.690 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-09-30T22:17:18.690 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-09-30T22:17:18.690 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:17:18.690 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:17:18.690 INFO:teuthology.orchestra.run.smithi154.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:17:18.690 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:17:18.690 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:17:18.691 INFO:teuthology.orchestra.run.smithi154.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-09-30T22:17:18.691 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-09-30T22:17:18.691 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:17:18.691 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:17:18.691 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:17:18.691 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:17:18.691 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:17:18.691 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-09-30T22:17:18.691 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:17:18.692 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:17:18.693 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:17:18.694 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:17:18.695 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:17:18.696 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:17:18.696 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:17:18.696 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:17:18.696 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:17:18.696 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:17:18.696 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:17:18.696 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:17:18.696 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:17:18.696 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-09-30T22:17:18.697 INFO:teuthology.orchestra.run.smithi154.stdout:==================================================================================================== 2023-09-30T22:17:18.698 INFO:teuthology.orchestra.run.smithi154.stdout:Install 108 Packages 2023-09-30T22:17:18.698 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 14 Packages 2023-09-30T22:17:18.698 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:17:18.698 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 200 M 2023-09-30T22:17:18.698 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-09-30T22:17:18.857 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 294 kB/s | 24 kB 00:00 2023-09-30T22:17:19.261 INFO:teuthology.orchestra.run.smithi154.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 52 kB/s | 6.4 kB 00:00 2023-09-30T22:17:19.478 INFO:teuthology.orchestra.run.smithi154.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 4.1 MB/s | 910 kB 00:00 2023-09-30T22:17:19.762 INFO:teuthology.orchestra.run.smithi154.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 8.6 MB/s | 2.4 MB 00:00 2023-09-30T22:17:19.954 INFO:teuthology.orchestra.run.smithi154.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 8.4 MB/s | 1.6 MB 00:00 2023-09-30T22:17:20.537 INFO:teuthology.orchestra.run.smithi154.stdout:(5/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 8.6 MB/s | 5.0 MB 00:00 2023-09-30T22:17:20.904 INFO:teuthology.orchestra.run.smithi154.stdout:(6/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 14 MB/s | 24 MB 00:01 2023-09-30T22:17:21.754 INFO:teuthology.orchestra.run.smithi154.stdout:(7/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 14 MB/s | 12 MB 00:00 2023-09-30T22:17:21.846 INFO:teuthology.orchestra.run.smithi154.stdout:(8/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 2.2 MB/s | 6.1 MB 00:02 2023-09-30T22:17:21.863 INFO:teuthology.orchestra.run.smithi154.stdout:(9/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 236 kB/s | 26 kB 00:00 2023-09-30T22:17:21.905 INFO:teuthology.orchestra.run.smithi154.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 613 kB/s | 25 kB 00:00 2023-09-30T22:17:22.005 INFO:teuthology.orchestra.run.smithi154.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 8.1 MB/s | 824 kB 00:00 2023-09-30T22:17:22.072 INFO:teuthology.orchestra.run.smithi154.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 2.6 MB/s | 174 kB 00:00 2023-09-30T22:17:22.275 INFO:teuthology.orchestra.run.smithi154.stdout:(13/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86 11 MB/s | 18 MB 00:01 2023-09-30T22:17:22.298 INFO:teuthology.orchestra.run.smithi154.stdout:(14/122): librados-devel-16.2.14-44.geeb13ac9.e 582 kB/s | 131 kB 00:00 2023-09-30T22:17:22.340 INFO:teuthology.orchestra.run.smithi154.stdout:(15/122): libradosstriper1-16.2.14-44.geeb13ac9 7.2 MB/s | 493 kB 00:00 2023-09-30T22:17:22.415 INFO:teuthology.orchestra.run.smithi154.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 600 kB/s | 45 kB 00:00 2023-09-30T22:17:22.482 INFO:teuthology.orchestra.run.smithi154.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.4 MB/s | 99 kB 00:00 2023-09-30T22:17:22.549 INFO:teuthology.orchestra.run.smithi154.stdout:(18/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 15 MB/s | 3.8 MB 00:00 2023-09-30T22:17:22.574 INFO:teuthology.orchestra.run.smithi154.stdout:(19/122): python3-cephfs-16.2.14-44.geeb13ac9.e 2.3 MB/s | 215 kB 00:00 2023-09-30T22:17:22.600 INFO:teuthology.orchestra.run.smithi154.stdout:(20/122): python3-rados-16.2.14-44.geeb13ac9.el 7.6 MB/s | 390 kB 00:00 2023-09-30T22:17:22.625 INFO:teuthology.orchestra.run.smithi154.stdout:(21/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 7.2 MB/s | 369 kB 00:00 2023-09-30T22:17:22.650 INFO:teuthology.orchestra.run.smithi154.stdout:(22/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 2.2 MB/s | 114 kB 00:00 2023-09-30T22:17:22.675 INFO:teuthology.orchestra.run.smithi154.stdout:(23/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.7 MB/s | 88 kB 00:00 2023-09-30T22:17:22.759 INFO:teuthology.orchestra.run.smithi154.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 2.0 MB/s | 173 kB 00:00 2023-09-30T22:17:22.826 INFO:teuthology.orchestra.run.smithi154.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 365 kB/s | 24 kB 00:00 2023-09-30T22:17:22.876 INFO:teuthology.orchestra.run.smithi154.stdout:(26/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 16 MB/s | 3.7 MB 00:00 2023-09-30T22:17:23.102 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:17:23.103 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T22:17:23.128 INFO:teuthology.orchestra.run.smithi163.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-09-30T22:17:23.128 INFO:teuthology.orchestra.run.smithi163.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-09-30T22:17:23.129 INFO:teuthology.orchestra.run.smithi163.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-09-30T22:17:23.130 INFO:teuthology.orchestra.run.smithi163.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-09-30T22:17:23.152 INFO:teuthology.orchestra.run.smithi154.stdout:(27/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 9.6 MB/s | 3.1 MB 00:00 2023-09-30T22:17:23.235 INFO:teuthology.orchestra.run.smithi154.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 2.9 MB/s | 244 kB 00:00 2023-09-30T22:17:23.311 INFO:teuthology.orchestra.run.smithi154.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 366 kB/s | 27 kB 00:00 2023-09-30T22:17:23.340 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-09-30T22:17:23.352 INFO:teuthology.orchestra.run.smithi163.stdout:==================================================================================================== 2023-09-30T22:17:23.352 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2023-09-30T22:17:23.352 INFO:teuthology.orchestra.run.smithi163.stdout:==================================================================================================== 2023-09-30T22:17:23.352 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2023-09-30T22:17:23.352 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-09-30T22:17:23.352 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-09-30T22:17:23.352 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-09-30T22:17:23.352 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-09-30T22:17:23.353 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-09-30T22:17:23.354 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-09-30T22:17:23.355 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-09-30T22:17:23.356 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-09-30T22:17:23.357 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-09-30T22:17:23.357 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T22:17:23.357 INFO:teuthology.orchestra.run.smithi163.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-09-30T22:17:23.357 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-09-30T22:17:23.357 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-09-30T22:17:23.357 INFO:teuthology.orchestra.run.smithi163.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-09-30T22:17:23.357 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-09-30T22:17:23.357 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-09-30T22:17:23.357 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T22:17:23.358 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T22:17:23.359 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T22:17:23.360 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-09-30T22:17:23.360 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-09-30T22:17:23.360 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T22:17:23.360 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-09-30T22:17:23.360 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T22:17:23.360 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T22:17:23.360 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-09-30T22:17:23.360 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T22:17:23.360 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-09-30T22:17:23.361 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T22:17:23.362 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T22:17:23.363 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout:==================================================================================================== 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout:Install 108 Packages 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 14 Packages 2023-09-30T22:17:23.364 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:17:23.365 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 200 M 2023-09-30T22:17:23.365 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2023-09-30T22:17:23.442 INFO:teuthology.orchestra.run.smithi154.stdout:(30/122): ceph-mgr-diskprediction-local-16.2.14 15 MB/s | 8.6 MB 00:00 2023-09-30T22:17:23.470 INFO:teuthology.orchestra.run.smithi154.stdout:(31/122): ceph-prometheus-alerts-16.2.14-44.gee 94 kB/s | 15 kB 00:00 2023-09-30T22:17:24.013 INFO:teuthology.orchestra.run.smithi163.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 31 kB/s | 6.4 kB 00:00 2023-09-30T22:17:24.028 INFO:teuthology.orchestra.run.smithi154.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 572 kB/s | 320 kB 00:00 2023-09-30T22:17:24.121 INFO:teuthology.orchestra.run.smithi154.stdout:(33/122): bison-3.0.4-10.el8.x86_64.rpm 1.0 MB/s | 688 kB 00:00 2023-09-30T22:17:24.170 INFO:teuthology.orchestra.run.smithi154.stdout:(34/122): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2023-09-30T22:17:24.263 INFO:teuthology.orchestra.run.smithi154.stdout:(35/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2023-09-30T22:17:24.321 INFO:teuthology.orchestra.run.smithi154.stdout:(36/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-09-30T22:17:24.371 INFO:teuthology.orchestra.run.smithi154.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-09-30T22:17:24.418 INFO:teuthology.orchestra.run.smithi163.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 2.2 MB/s | 910 kB 00:00 2023-09-30T22:17:24.726 INFO:teuthology.orchestra.run.smithi163.stdout:(3/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 6.6 MB/s | 6.1 MB 00:00 2023-09-30T22:17:24.772 INFO:teuthology.orchestra.run.smithi154.stdout:(38/122): openblas-threads-0.3.15-4.el8.x86_64. 12 MB/s | 4.9 MB 00:00 2023-09-30T22:17:24.864 INFO:teuthology.orchestra.run.smithi154.stdout:(39/122): openblas-0.3.15-4.el8.x86_64.rpm 8.7 MB/s | 4.7 MB 00:00 2023-09-30T22:17:24.889 INFO:teuthology.orchestra.run.smithi154.stdout:(40/122): python3-jsonpatch-1.21-2.el8.noarch.r 227 kB/s | 27 kB 00:00 2023-09-30T22:17:24.935 INFO:teuthology.orchestra.run.smithi163.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 7.7 MB/s | 1.6 MB 00:00 2023-09-30T22:17:24.956 INFO:teuthology.orchestra.run.smithi154.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 219 kB/s | 20 kB 00:00 2023-09-30T22:17:24.998 INFO:teuthology.orchestra.run.smithi154.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-09-30T22:17:25.081 INFO:teuthology.orchestra.run.smithi154.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 309 kB/s | 39 kB 00:00 2023-09-30T22:17:25.086 INFO:teuthology.orchestra.run.smithi163.stdout:(5/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 3.7 MB/s | 2.4 MB 00:00 2023-09-30T22:17:25.190 INFO:teuthology.orchestra.run.smithi154.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-09-30T22:17:25.257 INFO:teuthology.orchestra.run.smithi154.stdout:(45/122): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-09-30T22:17:25.291 INFO:teuthology.orchestra.run.smithi154.stdout:(46/122): python3-prettytable-0.7.2-14.el8.noar 437 kB/s | 44 kB 00:00 2023-09-30T22:17:25.358 INFO:teuthology.orchestra.run.smithi154.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-09-30T22:17:25.391 INFO:teuthology.orchestra.run.smithi154.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-09-30T22:17:25.466 INFO:teuthology.orchestra.run.smithi154.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-09-30T22:17:25.509 INFO:teuthology.orchestra.run.smithi154.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 486 kB/s | 57 kB 00:00 2023-09-30T22:17:25.527 INFO:teuthology.orchestra.run.smithi163.stdout:(6/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 8.5 MB/s | 5.0 MB 00:00 2023-09-30T22:17:25.642 INFO:teuthology.orchestra.run.smithi154.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-09-30T22:17:25.760 INFO:teuthology.orchestra.run.smithi154.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2023-09-30T22:17:25.860 INFO:teuthology.orchestra.run.smithi154.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 708 kB/s | 71 kB 00:00 2023-09-30T22:17:26.110 INFO:teuthology.orchestra.run.smithi154.stdout:(54/122): python3-scipy-1.0.0-21.module_el8.5.0 21 MB/s | 14 MB 00:00 2023-09-30T22:17:26.135 INFO:teuthology.orchestra.run.smithi154.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 224 kB/s | 62 kB 00:00 2023-09-30T22:17:26.210 INFO:teuthology.orchestra.run.smithi154.stdout:(56/122): fuse-2.9.7-17.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-09-30T22:17:26.219 INFO:teuthology.orchestra.run.smithi163.stdout:(7/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 10 MB/s | 24 MB 00:02 2023-09-30T22:17:26.269 INFO:teuthology.orchestra.run.smithi154.stdout:(57/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 361 kB/s | 48 kB 00:00 2023-09-30T22:17:26.303 INFO:teuthology.orchestra.run.smithi163.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 308 kB/s | 26 kB 00:00 2023-09-30T22:17:26.344 INFO:teuthology.orchestra.run.smithi154.stdout:(58/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 4.1 MB/s | 561 kB 00:00 2023-09-30T22:17:26.369 INFO:teuthology.orchestra.run.smithi154.stdout:(59/122): libcom_err-devel-1.45.6-5.el8.x86_64. 387 kB/s | 39 kB 00:00 2023-09-30T22:17:26.453 INFO:teuthology.orchestra.run.smithi154.stdout:(60/122): libquadmath-8.5.0-20.el8.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2023-09-30T22:17:26.487 INFO:teuthology.orchestra.run.smithi154.stdout:(61/122): libgfortran-8.5.0-20.el8.x86_64.rpm 4.4 MB/s | 645 kB 00:00 2023-09-30T22:17:26.512 INFO:teuthology.orchestra.run.smithi154.stdout:(62/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 803 kB/s | 47 kB 00:00 2023-09-30T22:17:26.537 INFO:teuthology.orchestra.run.smithi154.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-09-30T22:17:26.562 INFO:teuthology.orchestra.run.smithi154.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-30T22:17:26.588 INFO:teuthology.orchestra.run.smithi154.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 360 kB/s | 18 kB 00:00 2023-09-30T22:17:26.613 INFO:teuthology.orchestra.run.smithi154.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 870 kB/s | 44 kB 00:00 2023-09-30T22:17:26.730 INFO:teuthology.orchestra.run.smithi154.stdout:(67/122): pcre2-devel-10.32-3.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2023-09-30T22:17:26.814 INFO:teuthology.orchestra.run.smithi154.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-09-30T22:17:26.872 INFO:teuthology.orchestra.run.smithi154.stdout:(69/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:17:26.956 INFO:teuthology.orchestra.run.smithi154.stdout:(70/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.9 MB/s | 249 kB 00:00 2023-09-30T22:17:27.098 INFO:teuthology.orchestra.run.smithi154.stdout:(71/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.2 MB/s | 3.2 MB 00:00 2023-09-30T22:17:27.123 INFO:teuthology.orchestra.run.smithi154.stdout:(72/122): python3-cryptography-3.2.1-6.el8.x86_ 3.8 MB/s | 641 kB 00:00 2023-09-30T22:17:27.136 INFO:teuthology.orchestra.run.smithi163.stdout:(9/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 7.2 MB/s | 12 MB 00:01 2023-09-30T22:17:27.140 INFO:teuthology.orchestra.run.smithi154.stdout:(73/122): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-09-30T22:17:27.182 INFO:teuthology.orchestra.run.smithi154.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-09-30T22:17:27.199 INFO:teuthology.orchestra.run.smithi154.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-09-30T22:17:27.224 INFO:teuthology.orchestra.run.smithi154.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-09-30T22:17:27.241 INFO:teuthology.orchestra.run.smithi154.stdout:(77/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2023-09-30T22:17:27.253 INFO:teuthology.orchestra.run.smithi163.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 219 kB/s | 25 kB 00:00 2023-09-30T22:17:27.358 INFO:teuthology.orchestra.run.smithi154.stdout:(78/122): gperftools-libs-2.7-9.el8.x86_64.rpm 2.2 MB/s | 306 kB 00:00 2023-09-30T22:17:27.383 INFO:teuthology.orchestra.run.smithi154.stdout:(79/122): leveldb-1.22-1.el8.x86_64.rpm 1.2 MB/s | 181 kB 00:00 2023-09-30T22:17:27.409 INFO:teuthology.orchestra.run.smithi154.stdout:(80/122): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2023-09-30T22:17:27.434 INFO:teuthology.orchestra.run.smithi154.stdout:(81/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.4 MB/s | 75 kB 00:00 2023-09-30T22:17:27.437 INFO:teuthology.orchestra.run.smithi163.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 4.4 MB/s | 824 kB 00:00 2023-09-30T22:17:27.459 INFO:teuthology.orchestra.run.smithi154.stdout:(82/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2023-09-30T22:17:27.485 INFO:teuthology.orchestra.run.smithi154.stdout:(83/122): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-09-30T22:17:27.510 INFO:teuthology.orchestra.run.smithi154.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 658 kB/s | 33 kB 00:00 2023-09-30T22:17:27.535 INFO:teuthology.orchestra.run.smithi154.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 324 kB/s | 16 kB 00:00 2023-09-30T22:17:27.538 INFO:teuthology.orchestra.run.smithi163.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.7 MB/s | 174 kB 00:00 2023-09-30T22:17:27.561 INFO:teuthology.orchestra.run.smithi154.stdout:(86/122): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-09-30T22:17:27.606 INFO:teuthology.orchestra.run.smithi154.stdout:(87/122): python3-cherrypy-18.4.0-1.el8.noarch. 5.6 MB/s | 384 kB 00:00 2023-09-30T22:17:27.628 INFO:teuthology.orchestra.run.smithi154.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-09-30T22:17:27.630 INFO:teuthology.orchestra.run.smithi163.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.4 MB/s | 131 kB 00:00 2023-09-30T22:17:27.653 INFO:teuthology.orchestra.run.smithi154.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-09-30T22:17:27.678 INFO:teuthology.orchestra.run.smithi154.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 349 kB/s | 18 kB 00:00 2023-09-30T22:17:27.754 INFO:teuthology.orchestra.run.smithi154.stdout:(91/122): python3-logutils-0.3.5-11.el8.noarch. 651 kB/s | 49 kB 00:00 2023-09-30T22:17:27.763 INFO:teuthology.orchestra.run.smithi163.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 3.6 MB/s | 493 kB 00:00 2023-09-30T22:17:27.796 INFO:teuthology.orchestra.run.smithi154.stdout:(92/122): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-09-30T22:17:27.846 INFO:teuthology.orchestra.run.smithi154.stdout:(93/122): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2023-09-30T22:17:27.871 INFO:teuthology.orchestra.run.smithi154.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-09-30T22:17:27.896 INFO:teuthology.orchestra.run.smithi154.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-09-30T22:17:27.922 INFO:teuthology.orchestra.run.smithi154.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 672 kB/s | 34 kB 00:00 2023-09-30T22:17:27.955 INFO:teuthology.orchestra.run.smithi154.stdout:(97/122): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-09-30T22:17:27.981 INFO:teuthology.orchestra.run.smithi154.stdout:(98/122): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-09-30T22:17:28.006 INFO:teuthology.orchestra.run.smithi154.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 372 kB/s | 19 kB 00:00 2023-09-30T22:17:28.031 INFO:teuthology.orchestra.run.smithi154.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 476 kB/s | 24 kB 00:00 2023-09-30T22:17:28.057 INFO:teuthology.orchestra.run.smithi154.stdout:(101/122): python3-tempora-1.14.1-5.el8.noarch. 584 kB/s | 29 kB 00:00 2023-09-30T22:17:28.082 INFO:teuthology.orchestra.run.smithi154.stdout:(102/122): python3-trustme-0.6.0-4.el8.noarch.r 549 kB/s | 27 kB 00:00 2023-09-30T22:17:28.124 INFO:teuthology.orchestra.run.smithi154.stdout:(103/122): python3-waitress-1.4.3-1.el8.noarch. 3.7 MB/s | 255 kB 00:00 2023-09-30T22:17:28.149 INFO:teuthology.orchestra.run.smithi154.stdout:(104/122): python3-webob-1.8.5-1.el8.1.noarch.r 3.7 MB/s | 251 kB 00:00 2023-09-30T22:17:28.174 INFO:teuthology.orchestra.run.smithi154.stdout:(105/122): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2023-09-30T22:17:28.200 INFO:teuthology.orchestra.run.smithi154.stdout:(106/122): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2023-09-30T22:17:28.225 INFO:teuthology.orchestra.run.smithi154.stdout:(107/122): python3-zc-lockfile-2.0-2.el8.noarch 458 kB/s | 23 kB 00:00 2023-09-30T22:17:28.314 INFO:teuthology.orchestra.run.smithi163.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 6.9 MB/s | 3.8 MB 00:00 2023-09-30T22:17:28.414 INFO:teuthology.orchestra.run.smithi163.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 450 kB/s | 45 kB 00:00 2023-09-30T22:17:28.539 INFO:teuthology.orchestra.run.smithi163.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 790 kB/s | 99 kB 00:00 2023-09-30T22:17:29.033 INFO:teuthology.orchestra.run.smithi154.stdout:(108/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 5.2 MB/s | 4.2 MB 00:00 2023-09-30T22:17:29.101 INFO:teuthology.orchestra.run.smithi154.stdout:(109/122): librados2-16.2.14-44.geeb13ac9.el8.x 4.2 MB/s | 3.7 MB 00:00 2023-09-30T22:17:29.209 INFO:teuthology.orchestra.run.smithi154.stdout:(110/122): NetworkManager-initscripts-updown-1. 818 kB/s | 143 kB 00:00 2023-09-30T22:17:29.214 INFO:teuthology.orchestra.run.smithi163.stdout:(18/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86 4.4 MB/s | 18 MB 00:04 2023-09-30T22:17:29.237 INFO:teuthology.orchestra.run.smithi154.stdout:(111/122): elfutils-debuginfod-client-0.189-3.e 570 kB/s | 76 kB 00:00 2023-09-30T22:17:29.240 INFO:teuthology.orchestra.run.smithi163.stdout:(19/122): python3-cephfs-16.2.14-44.geeb13ac9.e 307 kB/s | 215 kB 00:00 2023-09-30T22:17:29.293 INFO:teuthology.orchestra.run.smithi154.stdout:(112/122): elfutils-libelf-0.189-3.el8.x86_64.r 2.7 MB/s | 232 kB 00:00 2023-09-30T22:17:29.315 INFO:teuthology.orchestra.run.smithi163.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 4.8 MB/s | 369 kB 00:00 2023-09-30T22:17:29.343 INFO:teuthology.orchestra.run.smithi154.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.7 MB/s | 303 kB 00:00 2023-09-30T22:17:29.349 INFO:teuthology.orchestra.run.smithi163.stdout:(21/122): python3-rados-16.2.14-44.geeb13ac9.el 2.8 MB/s | 390 kB 00:00 2023-09-30T22:17:29.383 INFO:teuthology.orchestra.run.smithi163.stdout:(22/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.7 MB/s | 114 kB 00:00 2023-09-30T22:17:29.402 INFO:teuthology.orchestra.run.smithi154.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:17:29.408 INFO:teuthology.orchestra.run.smithi163.stdout:(23/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.5 MB/s | 88 kB 00:00 2023-09-30T22:17:29.469 INFO:teuthology.orchestra.run.smithi154.stdout:(115/122): iproute-6.2.0-2.el8.x86_64.rpm 4.9 MB/s | 880 kB 00:00 2023-09-30T22:17:29.491 INFO:teuthology.orchestra.run.smithi163.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 2.0 MB/s | 173 kB 00:00 2023-09-30T22:17:29.494 INFO:teuthology.orchestra.run.smithi154.stdout:(116/122): libfdisk-2.32.1-43.el8.x86_64.rpm 2.7 MB/s | 254 kB 00:00 2023-09-30T22:17:29.545 INFO:teuthology.orchestra.run.smithi154.stdout:(117/122): libmount-2.32.1-43.el8.x86_64.rpm 3.1 MB/s | 236 kB 00:00 2023-09-30T22:17:29.567 INFO:teuthology.orchestra.run.smithi163.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 325 kB/s | 24 kB 00:00 2023-09-30T22:17:29.570 INFO:teuthology.orchestra.run.smithi154.stdout:(118/122): libsmartcols-2.32.1-43.el8.x86_64.rp 2.3 MB/s | 179 kB 00:00 2023-09-30T22:17:29.595 INFO:teuthology.orchestra.run.smithi154.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2023-09-30T22:17:29.646 INFO:teuthology.orchestra.run.smithi154.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 2.0 MB/s | 103 kB 00:00 2023-09-30T22:17:29.859 INFO:teuthology.orchestra.run.smithi163.stdout:(26/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 7.7 MB/s | 3.7 MB 00:00 2023-09-30T22:17:29.937 INFO:teuthology.orchestra.run.smithi154.stdout:(121/122): util-linux-2.32.1-43.el8.x86_64.rpm 6.8 MB/s | 2.5 MB 00:00 2023-09-30T22:17:30.268 INFO:teuthology.orchestra.run.smithi163.stdout:(27/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 4.5 MB/s | 3.1 MB 00:00 2023-09-30T22:17:30.351 INFO:teuthology.orchestra.run.smithi163.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 2.9 MB/s | 244 kB 00:00 2023-09-30T22:17:30.426 INFO:teuthology.orchestra.run.smithi163.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 365 kB/s | 27 kB 00:00 2023-09-30T22:17:30.927 INFO:teuthology.orchestra.run.smithi163.stdout:(30/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 11 MB/s | 52 MB 00:04 2023-09-30T22:17:30.952 INFO:teuthology.orchestra.run.smithi163.stdout:(31/122): ceph-prometheus-alerts-16.2.14-44.gee 28 kB/s | 15 kB 00:00 2023-09-30T22:17:31.061 INFO:teuthology.orchestra.run.smithi163.stdout:(32/122): ceph-mgr-diskprediction-local-16.2.14 7.1 MB/s | 8.6 MB 00:01 2023-09-30T22:17:31.536 INFO:teuthology.orchestra.run.smithi163.stdout:(33/122): flex-2.6.1-9.el8.x86_64.rpm 548 kB/s | 320 kB 00:00 2023-09-30T22:17:31.561 INFO:teuthology.orchestra.run.smithi163.stdout:(34/122): jq-1.6-7.el8.x86_64.rpm 405 kB/s | 202 kB 00:00 2023-09-30T22:17:31.637 INFO:teuthology.orchestra.run.smithi163.stdout:(35/122): bison-3.0.4-10.el8.x86_64.rpm 971 kB/s | 688 kB 00:00 2023-09-30T22:17:31.721 INFO:teuthology.orchestra.run.smithi163.stdout:(36/122): librdkafka-0.11.4-3.el8.x86_64.rpm 1.9 MB/s | 354 kB 00:00 2023-09-30T22:17:31.746 INFO:teuthology.orchestra.run.smithi163.stdout:(37/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2023-09-30T22:17:31.771 INFO:teuthology.orchestra.run.smithi163.stdout:(38/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-09-30T22:17:31.880 INFO:teuthology.orchestra.run.smithi163.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 245 kB/s | 27 kB 00:00 2023-09-30T22:17:31.989 INFO:teuthology.orchestra.run.smithi163.stdout:(40/122): python3-jsonpointer-1.10-11.el8.noarc 184 kB/s | 20 kB 00:00 2023-09-30T22:17:32.147 INFO:teuthology.orchestra.run.smithi163.stdout:(41/122): openblas-0.3.15-4.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-09-30T22:17:32.205 INFO:teuthology.orchestra.run.smithi163.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 728 kB/s | 157 kB 00:00 2023-09-30T22:17:32.273 INFO:teuthology.orchestra.run.smithi163.stdout:(43/122): openblas-threads-0.3.15-4.el8.x86_64. 9.2 MB/s | 4.9 MB 00:00 2023-09-30T22:17:32.298 INFO:teuthology.orchestra.run.smithi163.stdout:(44/122): python3-markupsafe-0.23-19.el8.x86_64 258 kB/s | 39 kB 00:00 2023-09-30T22:17:32.373 INFO:teuthology.orchestra.run.smithi163.stdout:(45/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-09-30T22:17:32.399 INFO:teuthology.orchestra.run.smithi163.stdout:(46/122): python3-prettytable-0.7.2-14.el8.noar 437 kB/s | 44 kB 00:00 2023-09-30T22:17:32.474 INFO:teuthology.orchestra.run.smithi163.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-09-30T22:17:32.499 INFO:teuthology.orchestra.run.smithi163.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-09-30T22:17:32.566 INFO:teuthology.orchestra.run.smithi163.stdout:(49/122): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2023-09-30T22:17:32.592 INFO:teuthology.orchestra.run.smithi163.stdout:(50/122): python3-pyasn1-modules-0.3.7-6.el8.no 940 kB/s | 110 kB 00:00 2023-09-30T22:17:32.617 INFO:teuthology.orchestra.run.smithi163.stdout:(51/122): python3-pytz-2017.2-11.el8.noarch.rpm 486 kB/s | 57 kB 00:00 2023-09-30T22:17:32.734 INFO:teuthology.orchestra.run.smithi163.stdout:(52/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.2 MB/s | 457 kB 00:00 2023-09-30T22:17:32.759 INFO:teuthology.orchestra.run.smithi163.stdout:(53/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-09-30T22:17:32.835 INFO:teuthology.orchestra.run.smithi163.stdout:(54/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 705 kB/s | 71 kB 00:00 2023-09-30T22:17:32.893 INFO:teuthology.orchestra.run.smithi163.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 461 kB/s | 62 kB 00:00 2023-09-30T22:17:32.972 INFO:teuthology.orchestra.run.smithi163.stdout:(56/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 613 kB/s | 48 kB 00:00 2023-09-30T22:17:33.002 INFO:teuthology.orchestra.run.smithi163.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 497 kB/s | 83 kB 00:00 2023-09-30T22:17:33.053 INFO:teuthology.orchestra.run.smithi163.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 774 kB/s | 39 kB 00:00 2023-09-30T22:17:33.120 INFO:teuthology.orchestra.run.smithi163.stdout:(59/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.7 MB/s | 561 kB 00:00 2023-09-30T22:17:33.279 INFO:teuthology.orchestra.run.smithi163.stdout:(60/122): python3-scipy-1.0.0-21.module_el8.5.0 19 MB/s | 14 MB 00:00 2023-09-30T22:17:33.295 INFO:teuthology.orchestra.run.smithi163.stdout:(61/122): libquadmath-8.5.0-20.el8.x86_64.rpm 982 kB/s | 172 kB 00:00 2023-09-30T22:17:33.330 INFO:teuthology.orchestra.run.smithi163.stdout:(62/122): libgfortran-8.5.0-20.el8.x86_64.rpm 2.3 MB/s | 645 kB 00:00 2023-09-30T22:17:33.355 INFO:teuthology.orchestra.run.smithi163.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-09-30T22:17:33.371 INFO:teuthology.orchestra.run.smithi163.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-09-30T22:17:33.397 INFO:teuthology.orchestra.run.smithi163.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 432 kB/s | 18 kB 00:00 2023-09-30T22:17:33.422 INFO:teuthology.orchestra.run.smithi163.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 873 kB/s | 44 kB 00:00 2023-09-30T22:17:33.439 INFO:teuthology.orchestra.run.smithi163.stdout:(67/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 293 kB/s | 47 kB 00:00 2023-09-30T22:17:33.540 INFO:teuthology.orchestra.run.smithi163.stdout:(68/122): pcre2-devel-10.32-3.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-09-30T22:17:33.554 INFO:teuthology.orchestra.run.smithi154.stdout:(122/122): ceph-test-16.2.14-44.geeb13ac9.el8.x 4.4 MB/s | 52 MB 00:11 2023-09-30T22:17:33.557 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:17:33.557 INFO:teuthology.orchestra.run.smithi154.stdout:Total 13 MB/s | 200 MB 00:14 2023-09-30T22:17:33.565 INFO:teuthology.orchestra.run.smithi163.stdout:(69/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-09-30T22:17:33.598 INFO:teuthology.orchestra.run.smithi163.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T22:17:33.649 INFO:teuthology.orchestra.run.smithi163.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.9 MB/s | 249 kB 00:00 2023-09-30T22:17:33.699 INFO:teuthology.orchestra.run.smithi163.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 856 kB/s | 43 kB 00:00 2023-09-30T22:17:33.849 INFO:teuthology.orchestra.run.smithi163.stdout:(73/122): python3-cryptography-3.2.1-6.el8.x86_ 2.5 MB/s | 641 kB 00:00 2023-09-30T22:17:34.041 INFO:teuthology.orchestra.run.smithi163.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 453 kB/s | 155 kB 00:00 2023-09-30T22:17:34.066 INFO:teuthology.orchestra.run.smithi163.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 502 kB/s | 109 kB 00:00 2023-09-30T22:17:34.117 INFO:teuthology.orchestra.run.smithi163.stdout:(76/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 4.4 MB/s | 3.2 MB 00:00 2023-09-30T22:17:34.142 INFO:teuthology.orchestra.run.smithi163.stdout:(77/122): python3-requests-oauthlib-1.0.0-1.el8 424 kB/s | 43 kB 00:00 2023-09-30T22:17:34.168 INFO:teuthology.orchestra.run.smithi163.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 577 kB/s | 58 kB 00:00 2023-09-30T22:17:34.270 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-09-30T22:17:34.305 INFO:teuthology.orchestra.run.smithi163.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 430 kB/s | 59 kB 00:00 2023-09-30T22:17:34.335 INFO:teuthology.orchestra.run.smithi163.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 941 kB/s | 181 kB 00:00 2023-09-30T22:17:34.360 INFO:teuthology.orchestra.run.smithi163.stdout:(81/122): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-09-30T22:17:34.385 INFO:teuthology.orchestra.run.smithi163.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 933 kB/s | 75 kB 00:00 2023-09-30T22:17:34.411 INFO:teuthology.orchestra.run.smithi163.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 577 kB/s | 44 kB 00:00 2023-09-30T22:17:34.436 INFO:teuthology.orchestra.run.smithi163.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 658 kB/s | 33 kB 00:00 2023-09-30T22:17:34.461 INFO:teuthology.orchestra.run.smithi163.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-09-30T22:17:34.487 INFO:teuthology.orchestra.run.smithi163.stdout:(86/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-09-30T22:17:34.494 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-09-30T22:17:34.494 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-09-30T22:17:34.512 INFO:teuthology.orchestra.run.smithi163.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-09-30T22:17:34.559 INFO:teuthology.orchestra.run.smithi163.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-09-30T22:17:34.588 INFO:teuthology.orchestra.run.smithi163.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-09-30T22:17:34.613 INFO:teuthology.orchestra.run.smithi163.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 327 kB/s | 18 kB 00:00 2023-09-30T22:17:34.638 INFO:teuthology.orchestra.run.smithi163.stdout:(91/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2023-09-30T22:17:34.664 INFO:teuthology.orchestra.run.smithi163.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 970 kB/s | 49 kB 00:00 2023-09-30T22:17:34.689 INFO:teuthology.orchestra.run.smithi163.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-09-30T22:17:34.723 INFO:teuthology.orchestra.run.smithi163.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-09-30T22:17:34.748 INFO:teuthology.orchestra.run.smithi163.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-09-30T22:17:34.773 INFO:teuthology.orchestra.run.smithi163.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 670 kB/s | 34 kB 00:00 2023-09-30T22:17:34.828 INFO:teuthology.orchestra.run.smithi163.stdout:(97/122): python3-kubernetes-11.0.0-6.el8.noarc 4.9 MB/s | 1.2 MB 00:00 2023-09-30T22:17:34.849 INFO:teuthology.orchestra.run.smithi163.stdout:(98/122): python3-rsa-4.9-2.el8.noarch.rpm 853 kB/s | 64 kB 00:00 2023-09-30T22:17:34.874 INFO:teuthology.orchestra.run.smithi163.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 410 kB/s | 19 kB 00:00 2023-09-30T22:17:34.899 INFO:teuthology.orchestra.run.smithi163.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 477 kB/s | 24 kB 00:00 2023-09-30T22:17:34.925 INFO:teuthology.orchestra.run.smithi163.stdout:(101/122): python3-routes-2.4.1-12.el8.noarch.r 1.1 MB/s | 196 kB 00:00 2023-09-30T22:17:34.950 INFO:teuthology.orchestra.run.smithi163.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2023-09-30T22:17:34.975 INFO:teuthology.orchestra.run.smithi163.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 365 kB/s | 27 kB 00:00 2023-09-30T22:17:35.001 INFO:teuthology.orchestra.run.smithi163.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 5.0 MB/s | 255 kB 00:00 2023-09-30T22:17:35.026 INFO:teuthology.orchestra.run.smithi163.stdout:(105/122): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2023-09-30T22:17:35.051 INFO:teuthology.orchestra.run.smithi163.stdout:(106/122): python3-websocket-client-0.56.0-5.el 809 kB/s | 61 kB 00:00 2023-09-30T22:17:35.110 INFO:teuthology.orchestra.run.smithi163.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 783 kB/s | 85 kB 00:00 2023-09-30T22:17:35.135 INFO:teuthology.orchestra.run.smithi163.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2023-09-30T22:17:35.286 INFO:teuthology.orchestra.run.smithi163.stdout:(109/122): NetworkManager-initscripts-updown-1. 958 kB/s | 143 kB 00:00 2023-09-30T22:17:35.361 INFO:teuthology.orchestra.run.smithi163.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 1.0 MB/s | 76 kB 00:00 2023-09-30T22:17:35.453 INFO:teuthology.orchestra.run.smithi163.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 2.5 MB/s | 232 kB 00:00 2023-09-30T22:17:35.545 INFO:teuthology.orchestra.run.smithi163.stdout:(112/122): elfutils-libs-0.189-3.el8.x86_64.rpm 3.2 MB/s | 303 kB 00:00 2023-09-30T22:17:35.696 INFO:teuthology.orchestra.run.smithi163.stdout:(113/122): iproute-6.2.0-2.el8.x86_64.rpm 5.7 MB/s | 880 kB 00:00 2023-09-30T22:17:35.754 INFO:teuthology.orchestra.run.smithi163.stdout:(114/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 6.5 MB/s | 4.2 MB 00:00 2023-09-30T22:17:35.781 INFO:teuthology.orchestra.run.smithi163.stdout:(115/122): libblkid-2.32.1-43.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2023-09-30T22:17:35.805 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-09-30T22:17:35.808 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-09-30T22:17:35.868 INFO:teuthology.orchestra.run.smithi163.stdout:(116/122): librados2-16.2.14-44.geeb13ac9.el8.x 4.6 MB/s | 3.7 MB 00:00 2023-09-30T22:17:35.905 INFO:teuthology.orchestra.run.smithi163.stdout:(117/122): libmount-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 236 kB 00:00 2023-09-30T22:17:35.972 INFO:teuthology.orchestra.run.smithi163.stdout:(118/122): libfdisk-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 254 kB 00:00 2023-09-30T22:17:35.998 INFO:teuthology.orchestra.run.smithi163.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 99 kB 00:00 2023-09-30T22:17:36.023 INFO:teuthology.orchestra.run.smithi163.stdout:(120/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.1 MB/s | 179 kB 00:00 2023-09-30T22:17:36.048 INFO:teuthology.orchestra.run.smithi163.stdout:(121/122): util-linux-user-2.32.1-43.el8.x86_64 2.0 MB/s | 103 kB 00:00 2023-09-30T22:17:36.385 INFO:teuthology.orchestra.run.smithi163.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 6.0 MB/s | 2.5 MB 00:00 2023-09-30T22:17:36.388 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:17:36.388 INFO:teuthology.orchestra.run.smithi163.stdout:Total 15 MB/s | 200 MB 00:13 2023-09-30T22:17:37.101 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2023-09-30T22:17:37.325 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2023-09-30T22:17:37.326 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2023-09-30T22:17:38.677 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2023-09-30T22:17:38.680 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2023-09-30T22:17:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-09-30T22:17:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-09-30T22:17:40.685 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-09-30T22:17:40.870 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-09-30T22:17:41.017 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:17:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:17:41.293 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:17:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:17:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-09-30T22:17:41.815 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-09-30T22:17:42.001 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:17:42.392 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:17:42.559 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:17:42.969 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:17:43.151 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:17:43.265 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:17:43.467 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:17:43.563 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:17:43.790 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:17:43.836 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2023-09-30T22:17:43.870 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-09-30T22:17:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:17:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-09-30T22:17:44.315 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-09-30T22:17:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:17:44.467 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:17:44.507 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:17:44.540 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:17:44.584 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-09-30T22:17:44.738 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-09-30T22:17:44.766 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:17:44.867 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-09-30T22:17:44.949 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-09-30T22:17:45.067 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:17:45.104 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-09-30T22:17:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:17:45.292 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:17:45.347 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-09-30T22:17:45.406 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:17:45.549 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:17:45.807 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-09-30T22:17:45.923 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-09-30T22:17:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-09-30T22:17:46.075 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:17:46.124 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:17:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:17:46.375 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:17:46.537 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:17:46.716 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:17:46.843 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:17:46.974 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:17:47.007 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:17:47.142 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:17:47.146 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:17:47.388 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:17:47.541 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:17:47.757 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:17:47.917 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:17:47.949 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-09-30T22:17:48.132 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:17:48.203 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:17:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-09-30T22:17:48.609 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:17:48.689 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-09-30T22:17:48.815 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:17:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-09-30T22:17:48.918 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-09-30T22:17:49.057 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:17:49.153 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-09-30T22:17:49.177 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-09-30T22:17:49.363 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-09-30T22:17:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-09-30T22:17:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-09-30T22:17:49.554 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-09-30T22:17:49.796 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-09-30T22:17:49.966 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:17:49.990 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:17:50.118 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-09-30T22:17:50.306 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:17:50.891 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-09-30T22:17:51.107 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:17:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-09-30T22:17:51.760 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:17:51.931 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:17:52.070 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-09-30T22:17:52.242 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-09-30T22:17:52.445 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-09-30T22:17:52.625 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-09-30T22:17:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-09-30T22:17:52.879 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-09-30T22:17:52.990 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-09-30T22:17:53.107 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-09-30T22:17:53.251 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-09-30T22:17:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-09-30T22:17:53.479 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-09-30T22:17:53.499 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-09-30T22:17:53.680 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-09-30T22:17:53.690 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:17:53.769 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:17:53.936 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-09-30T22:17:53.990 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:17:54.066 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:17:54.173 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:17:54.224 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:17:54.772 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:17:55.016 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:17:55.031 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:17:55.210 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-09-30T22:17:55.500 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-09-30T22:17:55.738 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-09-30T22:17:55.920 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-09-30T22:17:55.949 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-09-30T22:17:56.100 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-09-30T22:17:56.290 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-09-30T22:17:56.293 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-09-30T22:17:56.499 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-09-30T22:17:56.506 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-09-30T22:17:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-09-30T22:17:56.759 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-09-30T22:17:56.871 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-09-30T22:17:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-09-30T22:17:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-09-30T22:17:57.196 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-09-30T22:17:57.268 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-09-30T22:17:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-09-30T22:17:57.539 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-09-30T22:17:57.660 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-09-30T22:17:57.686 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-09-30T22:17:57.864 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-09-30T22:17:57.888 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-09-30T22:17:58.090 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-09-30T22:17:58.130 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:17:58.212 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-09-30T22:17:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-09-30T22:17:58.422 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:17:58.484 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-09-30T22:17:58.536 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-09-30T22:17:58.689 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:17:58.759 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-09-30T22:17:59.149 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-09-30T22:17:59.191 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-09-30T22:17:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-09-30T22:17:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:17:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-09-30T22:17:59.625 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-09-30T22:17:59.725 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-09-30T22:17:59.860 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-09-30T22:17:59.980 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-09-30T22:18:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-09-30T22:18:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-09-30T22:18:00.476 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-09-30T22:18:00.682 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-09-30T22:18:00.871 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-09-30T22:18:01.089 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-09-30T22:18:01.139 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-09-30T22:18:01.283 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-09-30T22:18:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-09-30T22:18:01.494 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-09-30T22:18:01.589 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-09-30T22:18:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-09-30T22:18:01.823 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-09-30T22:18:01.880 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-09-30T22:18:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-09-30T22:18:02.105 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-09-30T22:18:02.234 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-09-30T22:18:02.372 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-09-30T22:18:02.545 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-09-30T22:18:02.591 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-09-30T22:18:02.711 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-09-30T22:18:02.823 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-09-30T22:18:02.841 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-09-30T22:18:03.001 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-09-30T22:18:03.007 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-09-30T22:18:03.229 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-09-30T22:18:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-09-30T22:18:03.467 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-09-30T22:18:03.534 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-09-30T22:18:03.684 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-09-30T22:18:04.053 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-09-30T22:18:04.053 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-09-30T22:18:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-09-30T22:18:04.165 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-09-30T22:18:04.332 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-09-30T22:18:04.406 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-09-30T22:18:04.618 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-09-30T22:18:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-09-30T22:18:04.803 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-09-30T22:18:04.859 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-09-30T22:18:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-09-30T22:18:05.169 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-09-30T22:18:05.508 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-09-30T22:18:05.755 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-09-30T22:18:05.961 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-09-30T22:18:05.964 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-09-30T22:18:06.229 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-09-30T22:18:06.454 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-09-30T22:18:06.672 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-09-30T22:18:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-09-30T22:18:07.150 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-09-30T22:18:07.443 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-09-30T22:18:07.642 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-09-30T22:18:07.814 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-09-30T22:18:07.968 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-09-30T22:18:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-09-30T22:18:08.457 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:18:08.532 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-09-30T22:18:08.680 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:18:08.682 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-09-30T22:18:08.915 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-09-30T22:18:09.129 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-09-30T22:18:09.338 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-09-30T22:18:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:18:09.624 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-09-30T22:18:09.706 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:18:09.792 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-09-30T22:18:09.816 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:18:09.971 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:18:09.989 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-09-30T22:18:10.208 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-09-30T22:18:10.513 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-09-30T22:18:10.837 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-09-30T22:18:11.020 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-09-30T22:18:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:18:13.828 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:18:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-09-30T22:18:14.878 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:18:16.635 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-09-30T22:18:16.635 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:18:28.211 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:18:28.211 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2023-09-30T22:18:28.211 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2023-09-30T22:18:28.212 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2023-09-30T22:18:28.212 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /run 2023-09-30T22:18:28.212 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2023-09-30T22:18:28.212 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2023-09-30T22:18:28.212 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2023-09-30T22:18:28.212 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2023-09-30T22:18:28.212 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2023-09-30T22:18:28.212 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:18:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:18:29.115 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:18:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:18:30.801 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:18:31.118 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:18:31.118 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:18:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-09-30T22:18:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-09-30T22:18:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-09-30T22:18:32.067 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-09-30T22:18:32.303 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-09-30T22:18:32.451 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:18:32.535 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:18:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-09-30T22:18:32.849 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-09-30T22:18:33.354 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-09-30T22:18:33.354 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2023-09-30T22:18:33.354 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2023-09-30T22:18:33.354 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-09-30T22:18:33.354 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /run 2023-09-30T22:18:33.354 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2023-09-30T22:18:33.354 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2023-09-30T22:18:33.354 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2023-09-30T22:18:33.355 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2023-09-30T22:18:33.355 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-09-30T22:18:33.355 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:18:33.791 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:18:33.914 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-09-30T22:18:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:18:34.230 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-09-30T22:18:34.433 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:18:35.207 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:18:35.383 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:18:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:18:35.884 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-09-30T22:18:35.918 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-09-30T22:18:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:18:36.128 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:18:36.183 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:18:36.217 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-09-30T22:18:36.300 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:18:36.311 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:18:36.451 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-09-30T22:18:36.799 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-09-30T22:18:37.130 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-09-30T22:18:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-09-30T22:18:37.609 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-09-30T22:18:37.815 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:18:37.896 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-09-30T22:18:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-09-30T22:18:38.238 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-09-30T22:18:39.305 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-09-30T22:18:39.640 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:18:40.682 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-09-30T22:18:40.873 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:18:40.962 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-09-30T22:18:40.978 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-09-30T22:18:41.373 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-09-30T22:18:41.624 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:18:41.650 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-09-30T22:18:41.840 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:18:41.851 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-09-30T22:18:42.214 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:18:42.434 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:18:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:18:43.416 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:18:43.511 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:18:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-09-30T22:18:44.628 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-09-30T22:18:44.856 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-09-30T22:18:45.035 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-09-30T22:18:45.198 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-09-30T22:18:45.406 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-09-30T22:18:45.714 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-09-30T22:18:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-09-30T22:18:46.140 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:18:46.211 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:18:46.448 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:18:46.522 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-09-30T22:18:46.536 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:18:46.723 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:18:46.737 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:18:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-09-30T22:18:47.101 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-09-30T22:18:47.101 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:18:47.317 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:18:47.370 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:18:47.468 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:18:47.469 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:18:47.719 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:18:47.801 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:18:47.925 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-09-30T22:18:48.072 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:18:48.076 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-09-30T22:18:48.291 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:18:48.291 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:18:48.505 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-09-30T22:18:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:18:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:18:48.714 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:18:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:18:48.742 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:18:48.807 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:18:48.959 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:18:48.959 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:18:49.176 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:18:49.176 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:18:49.392 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:18:49.582 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:18:49.697 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-09-30T22:18:50.001 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-09-30T22:18:50.172 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:18:50.173 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-09-30T22:18:50.173 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-09-30T22:18:50.173 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-09-30T22:18:50.173 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-09-30T22:18:50.173 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-09-30T22:18:50.173 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-09-30T22:18:50.173 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-09-30T22:18:50.173 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:18:50.174 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:18:50.174 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:18:50.174 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:18:50.174 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-09-30T22:18:50.174 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:18:50.174 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-09-30T22:18:50.174 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-09-30T22:18:50.174 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-09-30T22:18:50.174 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-09-30T22:18:50.175 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-09-30T22:18:50.176 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-09-30T22:18:50.176 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-09-30T22:18:50.176 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-09-30T22:18:50.176 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-09-30T22:18:50.176 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-09-30T22:18:50.176 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-09-30T22:18:50.176 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-09-30T22:18:50.176 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-09-30T22:18:50.177 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-09-30T22:18:50.177 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-09-30T22:18:50.177 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-09-30T22:18:50.177 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-09-30T22:18:50.177 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-09-30T22:18:50.177 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-09-30T22:18:50.177 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-09-30T22:18:50.177 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-09-30T22:18:50.177 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-09-30T22:18:50.178 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-09-30T22:18:50.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-09-30T22:18:50.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-09-30T22:18:50.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-09-30T22:18:50.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-09-30T22:18:50.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:18:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-09-30T22:18:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-09-30T22:18:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-09-30T22:18:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-09-30T22:18:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-09-30T22:18:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-09-30T22:18:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-09-30T22:18:50.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-09-30T22:18:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-09-30T22:18:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-09-30T22:18:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-09-30T22:18:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-09-30T22:18:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-09-30T22:18:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-09-30T22:18:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-09-30T22:18:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-09-30T22:18:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-09-30T22:18:50.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-09-30T22:18:50.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:18:50.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-09-30T22:18:50.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:18:50.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-09-30T22:18:50.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:18:50.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-09-30T22:18:50.201 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-09-30T22:18:50.408 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-09-30T22:18:50.607 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-09-30T22:18:50.829 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-09-30T22:18:51.146 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-09-30T22:18:51.415 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 119/136 2023-09-30T22:18:51.574 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:18:51.635 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-09-30T22:18:51.880 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:18:51.978 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-09-30T22:18:52.203 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-09-30T22:18:52.203 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:18:52.203 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2023-09-30T22:18:52.203 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:18:52.204 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:18:52.204 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:18:52.204 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:18:52.204 INFO:teuthology.orchestra.run.smithi154.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:18:52.204 INFO:teuthology.orchestra.run.smithi154.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:18:52.205 INFO:teuthology.orchestra.run.smithi154.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:18:52.205 INFO:teuthology.orchestra.run.smithi154.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:18:52.205 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.205 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.205 INFO:teuthology.orchestra.run.smithi154.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:18:52.205 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:18:52.205 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:18:52.205 INFO:teuthology.orchestra.run.smithi154.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:18:52.206 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-09-30T22:18:52.206 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:18:52.206 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.206 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.206 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.206 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.206 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:52.206 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.206 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.207 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:52.207 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:52.207 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:52.207 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:52.207 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.207 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.207 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:52.208 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.208 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.208 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.208 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:18:52.208 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:18:52.208 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:18:52.208 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:18:52.208 INFO:teuthology.orchestra.run.smithi154.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:18:52.209 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:18:52.209 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:18:52.209 INFO:teuthology.orchestra.run.smithi154.stdout: leveldb-1.22-1.el8.x86_64 2023-09-30T22:18:52.209 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.209 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.209 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.209 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:18:52.209 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:18:52.210 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:18:52.210 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:18:52.210 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:18:52.210 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.210 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.211 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:18:52.211 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.211 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:18:52.211 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:18:52.211 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:18:52.211 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:18:52.211 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:18:52.211 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:18:52.212 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:18:52.212 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:18:52.212 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:18:52.212 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:18:52.212 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:18:52.212 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:18:52.212 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:18:52.212 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:18:52.213 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:18:52.213 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:18:52.213 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.213 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.213 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.213 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:18:52.213 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:18:52.214 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:18:52.214 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:18:52.214 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:18:52.214 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:18:52.214 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:18:52.215 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:18:52.215 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:18:52.215 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:18:52.215 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:18:52.215 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:18:52.215 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:18:52.215 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:18:52.216 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:18:52.217 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:18:52.217 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:18:52.217 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:18:52.217 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.217 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.217 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:18:52.217 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:18:52.217 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.217 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:18:52.218 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:18:52.218 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:18:52.218 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:18:52.218 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:18:52.218 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:18:52.218 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:18:52.218 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:18:52.219 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:18:52.219 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:18:52.219 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:18:52.219 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:18:52.219 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:18:52.219 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.219 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.219 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:52.220 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:18:52.220 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:18:52.220 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:18:52.220 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:18:52.221 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-09-30T22:18:52.223 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:18:52.237 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-09-30T22:18:52.387 DEBUG:teuthology.parallel:result is None 2023-09-30T22:18:52.423 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-09-30T22:18:52.623 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-09-30T22:18:52.624 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:18:52.882 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-09-30T22:18:52.887 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:18:53.008 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-09-30T22:18:53.008 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:18:53.261 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-09-30T22:18:53.473 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-09-30T22:18:53.689 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-09-30T22:18:53.931 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:18:53.931 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:18:54.182 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-09-30T22:18:54.182 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:18:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:18:54.382 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:18:54.582 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-09-30T22:18:54.582 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:18:54.798 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:18:54.799 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:18:55.025 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-09-30T22:18:55.256 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:18:55.820 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-09-30T22:18:55.820 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-09-30T22:18:55.820 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-09-30T22:18:55.821 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-09-30T22:18:55.822 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-09-30T22:18:55.823 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-09-30T22:18:55.823 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-09-30T22:18:55.823 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-09-30T22:18:55.823 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-09-30T22:18:55.823 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-09-30T22:18:55.823 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-09-30T22:18:55.823 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-09-30T22:18:55.823 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-09-30T22:18:55.832 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-09-30T22:18:55.832 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-09-30T22:18:55.832 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-09-30T22:18:55.832 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-09-30T22:18:55.832 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-09-30T22:18:55.833 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-09-30T22:18:55.834 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-09-30T22:18:55.835 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-09-30T22:18:55.836 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-09-30T22:18:55.837 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-09-30T22:18:55.838 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-09-30T22:18:55.839 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 121/136 2023-09-30T22:18:55.840 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-09-30T22:18:55.841 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-09-30T22:18:55.842 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-09-30T22:18:55.842 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-09-30T22:18:55.842 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-09-30T22:18:57.909 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-09-30T22:18:57.909 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: iproute-6.2.0-2.el8.x86_64 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: libblkid-2.32.1-43.el8.x86_64 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: libmount-2.32.1-43.el8.x86_64 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.910 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-2.32.1-43.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux-2.32.1-43.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.911 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.912 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.7-17.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: jq-1.6-7.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: leveldb-1.22-1.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.913 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T22:18:57.914 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.15-4.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T22:18:57.915 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T22:18:57.916 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.0.6-14.el8.noarch 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T22:18:57.917 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2017.2-11.el8.noarch 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T22:18:57.918 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T22:18:57.919 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T22:18:57.920 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T22:18:57.920 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T22:18:57.920 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T22:18:57.920 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T22:18:57.920 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.920 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.920 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-09-30T22:18:57.920 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T22:18:57.920 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T22:18:57.921 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-09-30T22:18:57.921 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:18:57.921 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-09-30T22:18:58.129 DEBUG:teuthology.parallel:result is None 2023-09-30T22:18:58.130 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:18:58.130 INFO:teuthology.packaging:ref: None 2023-09-30T22:18:58.130 INFO:teuthology.packaging:tag: None 2023-09-30T22:18:58.130 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:18:58.130 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:18:58.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:18:58.426 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:18:58.455 INFO:teuthology.orchestra.run.smithi154.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:18:58.455 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:18:58.455 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-09-30T22:18:58.456 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T22:18:58.456 INFO:teuthology.packaging:ref: None 2023-09-30T22:18:58.456 INFO:teuthology.packaging:tag: None 2023-09-30T22:18:58.456 INFO:teuthology.packaging:branch: pacific 2023-09-30T22:18:58.456 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-09-30T22:18:58.456 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-09-30T22:18:58.660 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:18:58.684 INFO:teuthology.orchestra.run.smithi163.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:18:58.685 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:18:58.685 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-09-30T22:18:58.685 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-30T22:18:58.685 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:18:58.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:18:58.722 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:18:58.722 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T22:18:58.755 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-30T22:18:58.756 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:18:58.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:18:58.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:18:58.863 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:18:58.863 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T22:18:58.892 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T22:18:58.961 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-30T22:18:58.961 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:18:58.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:18:58.990 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:18:59.059 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:18:59.059 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T22:18:59.088 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T22:18:59.156 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-30T22:18:59.156 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:18:59.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:18:59.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:18:59.252 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:18:59.252 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T22:18:59.279 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T22:18:59.348 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:18:59.356 INFO:teuthology.task.print:**** done installing pacific 2023-09-30T22:18:59.357 INFO:teuthology.run_tasks:Running task ceph... 2023-09-30T22:18:59.427 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-30T22:18:59.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2023-09-30T22:18:59.430 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2023-09-30T22:18:59.457 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-30T22:18:59.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:18:59.498 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T22:18:59.524 INFO:tasks.ceph:Creating extra log directories... 2023-09-30T22:18:59.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:18:59.566 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T22:18:59.601 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-30T22:18:59.601 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-30T22:18:59.602 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}}', 'email': None, 'first_in_suite': False, 'job_id': '7408041', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.dir_split']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 2683, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': '6973b24e3d99fd494b753449d2ea12077599cbd6', 'targets': {'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBW66LlovI1TzPaGsRaW2k+nTMa2yNgPF4xgH8hTzArYkmYeZbxnE9xi99jvLgMoLUNO5QW09mOF16xggIrWRrI=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHr/4AXmJTqe+3sgJc74dBzRweecv4/7DLOy74Xb4A2itSotAOtXCHyOch02qq2C4AYYCq4vxqeTm01d9tCmi2I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['suites/blogbench.sh']}}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-30_21:53:45', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-30T22:18:59.602 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:18:59.636 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T22:18:59.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:18:59.694 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T22:18:59.721 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:18:59.721 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T22:18:59.779 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T22:18:59.779 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2023-09-30T22:18:59.837 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T22:18:59.837 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:18:59.838 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 395346 Links: 1 2023-09-30T22:18:59.838 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:18:59.838 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:18:59.838 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-09-30 22:18:49.809828631 +0000 2023-09-30T22:18:59.838 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-09-30 22:16:04.126546482 +0000 2023-09-30T22:18:59.838 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-09-30 22:16:04.126546482 +0000 2023-09-30T22:18:59.838 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-09-30T22:18:59.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T22:18:59.904 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-09-30T22:18:59.904 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-09-30T22:18:59.904 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000186648 s, 2.7 MB/s 2023-09-30T22:18:59.905 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T22:18:59.964 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2023-09-30T22:19:00.023 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T22:19:00.023 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:19:00.023 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 393130 Links: 1 2023-09-30T22:19:00.023 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:19:00.023 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:19:00.023 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-09-30 22:18:49.809828631 +0000 2023-09-30T22:19:00.023 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-09-30 22:16:04.644533052 +0000 2023-09-30T22:19:00.023 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-09-30 22:16:04.644533052 +0000 2023-09-30T22:19:00.023 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-09-30T22:19:00.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T22:19:00.088 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-09-30T22:19:00.089 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-09-30T22:19:00.089 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000216997 s, 2.4 MB/s 2023-09-30T22:19:00.090 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T22:19:00.148 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2023-09-30T22:19:00.206 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T22:19:00.206 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:19:00.207 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 395548 Links: 1 2023-09-30T22:19:00.207 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:19:00.207 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:19:00.207 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-09-30 22:18:49.809828631 +0000 2023-09-30T22:19:00.207 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-09-30 22:16:05.165519543 +0000 2023-09-30T22:19:00.207 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-09-30 22:16:05.165519543 +0000 2023-09-30T22:19:00.207 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-09-30T22:19:00.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T22:19:00.272 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-09-30T22:19:00.272 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-09-30T22:19:00.273 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000234861 s, 2.2 MB/s 2023-09-30T22:19:00.273 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T22:19:00.332 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2023-09-30T22:19:00.391 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T22:19:00.391 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T22:19:00.391 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 395619 Links: 1 2023-09-30T22:19:00.391 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T22:19:00.391 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T22:19:00.391 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-09-30 22:18:49.810828605 +0000 2023-09-30T22:19:00.391 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-09-30 22:16:05.688505984 +0000 2023-09-30T22:19:00.391 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-09-30 22:16:05.688505984 +0000 2023-09-30T22:19:00.391 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-09-30T22:19:00.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T22:19:00.456 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-09-30T22:19:00.456 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-09-30T22:19:00.457 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000223203 s, 2.3 MB/s 2023-09-30T22:19:00.457 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T22:19:00.516 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:19:00.516 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:19:00.516 INFO:tasks.ceph:Generating config... 2023-09-30T22:19:00.518 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-09-30T22:19:00.518 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-09-30T22:19:00.518 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-09-30T22:19:00.518 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-09-30T22:19:00.518 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-09-30T22:19:00.518 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-30T22:19:00.518 INFO:tasks.ceph:[client] debug client = 20 2023-09-30T22:19:00.518 INFO:tasks.ceph:[client] debug ms = 1 2023-09-30T22:19:00.518 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-30T22:19:00.519 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-30T22:19:00.519 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-30T22:19:00.520 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-30T22:19:00.520 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-30T22:19:00.520 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-30T22:19:00.520 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-30T22:19:00.520 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-30T22:19:00.520 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-09-30T22:19:00.520 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-30T22:19:00.520 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-30T22:19:00.520 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-09-30T22:19:00.520 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-30T22:19:00.520 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-30T22:19:00.520 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-30T22:19:00.521 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-30T22:19:00.521 INFO:tasks.ceph:Setting up mon.a... 2023-09-30T22:19:00.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-30T22:19:00.688 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.keyring 2023-09-30T22:19:00.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-30T22:19:00.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:19:00.797 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.154'), ('mon.b', '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]'), ('mon.c', '[v2:172.21.15.154:3302,v1:172.21.15.154:6791]')] 2023-09-30T22:19:00.798 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790],[v2:172.21.15.154:3302,v1:172.21.15.154:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-30T22:19:00.799 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:00.799 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:19:00.855 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.154 --addv b '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]' --addv c '[v2:172.21.15.154:3302,v1:172.21.15.154:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:19:00.939 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: generated fsid 632db358-b709-49ad-a56a-97cde2869fcf 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:epoch 0 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:fsid 632db358-b709-49ad-a56a-97cde2869fcf 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:last_changed 2023-09-30T22:19:00.940693+0000 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:created 2023-09-30T22:19:00.940693+0000 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:min_mon_release 0 (unknown) 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:election_strategy: 1 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:0: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.a 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:1: [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] mon.b 2023-09-30T22:19:00.940 INFO:teuthology.orchestra.run.smithi154.stdout:2: [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] mon.c 2023-09-30T22:19:00.941 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-30T22:19:00.942 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T22:19:00.959 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 632db358-b709-49ad-a56a-97cde2869fcf... 2023-09-30T22:19:00.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:19:01.002 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T22:19:01.045 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2023-09-30T22:19:01.045 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2023-09-30T22:19:01.045 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:19:01.045 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2023-09-30T22:19:01.045 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.045 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2023-09-30T22:19:01.045 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.045 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2023-09-30T22:19:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2023-09-30T22:19:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2023-09-30T22:19:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2023-09-30T22:19:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2023-09-30T22:19:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:19:01.046 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:19:01.047 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.048 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790],[v2:172.21.15.154:3302,v1:172.21.15.154:6791]" 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on pool no app = False 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: ms bind msgr2 = False 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore warn on legacy statfs = False 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore warn on no per pool omap = False 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn min per osd = 0 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 632db358-b709-49ad-a56a-97cde2869fcf 2023-09-30T22:19:01.049 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.050 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.051 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2023-09-30T22:19:01.052 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2023-09-30T22:19:01.053 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-09-30T22:19:01.054 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.055 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = False 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2023-09-30T22:19:01.056 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-09-30T22:19:01.057 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2023-09-30T22:19:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-09-30T22:19:01.059 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-09-30T22:19:01.059 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-09-30T22:19:01.059 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2023-09-30T22:19:01.059 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2023-09-30T22:19:01.059 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2023-09-30T22:19:01.060 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2023-09-30T22:19:01.061 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.062 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790],[v2:172.21.15.154:3302,v1:172.21.15.154:6791]" 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on pool no app = False 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: ms bind msgr2 = False 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore warn on legacy statfs = False 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore warn on no per pool omap = False 2023-09-30T22:19:01.063 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn min per osd = 0 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = 632db358-b709-49ad-a56a-97cde2869fcf 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.064 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2023-09-30T22:19:01.065 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: bdev async discard = True 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: bdev enable discard = True 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore allocator = bitmap 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2023-09-30T22:19:01.066 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 1/20 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 1/20 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 4/10 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2023-09-30T22:19:01.067 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2023-09-30T22:19:01.068 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T22:19:01.069 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: mon op complaint time = 120 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = False 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-09-30T22:19:01.070 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: client mount timeout = 600 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2023-09-30T22:19:01.071 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout:[mds] 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds = 20 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds balancer = 20 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug frag = True 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug scatterstat = True 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: mds op complaint time = 180 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: mds verify scatter = True 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2023-09-30T22:19:01.072 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2023-09-30T22:19:01.074 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-30T22:19:01.074 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-30T22:19:01.166 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-30T22:19:01.167 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:01.167 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-30T22:19:01.185 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:01.185 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-30T22:19:01.243 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:19:01.243 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:01.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:19:01.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:19:01.320 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:01.321 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:19:01.378 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2023-09-30T22:19:01.379 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:19:01.379 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T22:19:01.379 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T22:19:01.423 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:19:01.423 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:19:01.484 INFO:tasks.ceph:Setting up mon nodes... 2023-09-30T22:19:01.484 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-30T22:19:01.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:19:01.534 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T22:19:01.536 INFO:tasks.ceph:Setting up mds nodes... 2023-09-30T22:19:01.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:19:01.587 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T22:19:01.589 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-30T22:19:01.617 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-30T22:19:01.617 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-30T22:19:01.740 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-30T22:19:01.753 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-30T22:19:01.753 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-09-30T22:19:01.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-30T22:19:01.781 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:19:01.781 INFO:tasks.ceph:role: osd.0 2023-09-30T22:19:01.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:19:01.781 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:19:01.856 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:19:01.857 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:19:02.292 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-09-30T22:19:02.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-09-30T22:19:02.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-30T22:19:02.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-30T22:19:02.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-30T22:19:02.552 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:19:02.552 INFO:tasks.ceph:role: osd.1 2023-09-30T22:19:02.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:19:02.553 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T22:19:02.627 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:19:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:19:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:19:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:19:02.628 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:19:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:19:02.629 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:19:02.629 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:19:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:19:02.629 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:19:03.057 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-09-30T22:19:03.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-09-30T22:19:03.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-30T22:19:03.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-30T22:19:03.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-30T22:19:03.292 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:19:03.292 INFO:tasks.ceph:role: osd.2 2023-09-30T22:19:03.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:19:03.292 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T22:19:03.372 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:19:03.372 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:19:03.372 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:19:03.373 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:19:03.373 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:19:03.373 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:19:03.373 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:19:03.373 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:19:03.373 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:19:03.373 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:19:03.811 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-09-30T22:19:03.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-09-30T22:19:03.812 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-30T22:19:03.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-30T22:19:04.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-30T22:19:04.078 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-30T22:19:04.079 INFO:tasks.ceph:role: osd.3 2023-09-30T22:19:04.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:19:04.079 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-30T22:19:04.153 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T22:19:04.153 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T22:19:04.154 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T22:19:04.154 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T22:19:04.154 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T22:19:04.154 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-09-30T22:19:04.154 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T22:19:04.154 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T22:19:04.155 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T22:19:04.155 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T22:19:04.601 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-09-30T22:19:04.603 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-09-30T22:19:04.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-30T22:19:04.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-30T22:19:04.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:19:05.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:04.999+0000 7f73b26d4200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-30T22:19:05.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:04.999+0000 7f73b26d4200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-30T22:19:05.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:04.999+0000 7f73b26d4200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:19:05.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:05.000+0000 7f73b26d4200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:19:05.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:05.000+0000 7f73b26d4200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T22:19:05.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:05.000+0000 7f73b26d4200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-30T22:19:07.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-30T22:19:07.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:19:07.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:07.966+0000 7f629223d200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-30T22:19:07.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:07.966+0000 7f629223d200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-30T22:19:07.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:07.966+0000 7f629223d200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:19:07.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:07.966+0000 7f629223d200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:19:07.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:07.966+0000 7f629223d200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T22:19:07.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:07.967+0000 7f629223d200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-30T22:19:10.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-30T22:19:10.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:19:10.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:10.936+0000 7fbda1461200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-30T22:19:10.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:10.936+0000 7fbda1461200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-30T22:19:10.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:10.936+0000 7fbda1461200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:19:10.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:10.936+0000 7fbda1461200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:19:10.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:10.936+0000 7fbda1461200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T22:19:10.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:10.936+0000 7fbda1461200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-30T22:19:13.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-30T22:19:13.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:19:13.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:13.893+0000 7fa66125a200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-30T22:19:13.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:13.894+0000 7fa66125a200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-30T22:19:13.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:13.894+0000 7fa66125a200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:19:13.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:13.894+0000 7fa66125a200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:19:13.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:13.894+0000 7fa66125a200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T22:19:13.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:13.894+0000 7fa66125a200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-30T22:19:16.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-30T22:19:16.768 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-30T22:19:16.769 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:16.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-30T22:19:16.839 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:16.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-30T22:19:16.909 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:16.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-30T22:19:16.977 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:16.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-30T22:19:17.046 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:17.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-30T22:19:17.114 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:17.114 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-30T22:19:17.183 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:19:17.183 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-30T22:19:17.206 INFO:tasks.ceph:Adding keys to all mons... 2023-09-30T22:19:17.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDVnhhlAiLlHxAAeZSvd/OoqfCVA1HBtSMCeQ== 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDVnhhlUuUUIxAAmv1IDdd4VP1xak9vaHG2Zw== 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDZnhhl/cgCABAA+vEJjb5VBN8HApoWbAve7w== 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDbnhhlNpigORAAw5B3eyPuJjXx4UjORaJxtQ== 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2023-09-30T22:19:17.251 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDenhhlm3rUNxAATpLobULzPcUXu7TKKtvcTg== 2023-09-30T22:19:17.252 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2023-09-30T22:19:17.252 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDhnhhlVvJPNRAASxa8r0B9QCAFpVvwKwciIA== 2023-09-30T22:19:17.252 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2023-09-30T22:19:17.252 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDVnhhl+P8qLBAAURDnrKmTV+yOPEddOmbV7A== 2023-09-30T22:19:17.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T22:19:17.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T22:19:17.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:19:17.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:19:17.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:19:17.633 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T22:19:17.935 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T22:19:18.001 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-30T22:19:18.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-30T22:19:18.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:19:18.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-30T22:19:18.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-30T22:19:18.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:19:18.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-30T22:19:18.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-30T22:19:18.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T22:19:18.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-30T22:19:18.527 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T22:19:18.588 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-30T22:19:18.589 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T22:19:18.589 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T22:19:18.637 INFO:tasks.ceph.mon.a:Started 2023-09-30T22:19:18.637 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T22:19:18.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T22:19:18.640 INFO:tasks.ceph.mon.b:Started 2023-09-30T22:19:18.641 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T22:19:18.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T22:19:18.644 INFO:tasks.ceph.mon.c:Started 2023-09-30T22:19:18.644 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-30T22:19:18.644 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T22:19:18.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T22:19:18.647 INFO:tasks.ceph.mgr.x:Started 2023-09-30T22:19:18.647 INFO:tasks.ceph:Setting crush tunables to default 2023-09-30T22:19:18.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd crush tunables default 2023-09-30T22:19:18.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.808+0000 7fcd456bb700 1 Processor -- start 2023-09-30T22:19:18.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.808+0000 7fcd456bb700 1 -- start start 2023-09-30T22:19:18.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd456bb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 0x7fcd40096840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:18.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd456bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 0x7fcd40096d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:18.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd456bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 0x7fcd40068300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:18.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd456bb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4005f940 con 0x7fcd4005f560 2023-09-30T22:19:18.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd456bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400933e0 con 0x7fcd40067e90 2023-09-30T22:19:18.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd456bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400921e0 con 0x7fcd40069d90 2023-09-30T22:19:18.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 0x7fcd40096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:18.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 0x7fcd40068300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 0x7fcd40096840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34406/0 (socket says 172.21.15.154:34406) 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3effd700 1 -- 172.21.15.154:0/537297468 learned_addr learned my addr 172.21.15.154:0/537297468 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 0x7fcd40096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3effd700 1 -- 172.21.15.154:0/537297468 >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 msgr2=0x7fcd40096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3effd700 1 -- 172.21.15.154:0/537297468 >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 msgr2=0x7fcd40096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3f7fe700 1 -- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 msgr2=0x7fcd40068300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3effd700 1 --2- 172.21.15.154:0/537297468 >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 0x7fcd40096840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3f7fe700 1 -- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 msgr2=0x7fcd40068300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3f7fe700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 0x7fcd40068300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3e7fc700 1 -- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 msgr2=0x7fcd40096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T22:19:18.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3e7fc700 1 -- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 msgr2=0x7fcd40096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:19:18.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 0x7fcd40096d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T22:19:18.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3effd700 1 --2- 172.21.15.154:0/537297468 >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 0x7fcd40096840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:19:18.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3f7fe700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 0x7fcd40068300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:19:18.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:18.809+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 0x7fcd40096d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:19:19.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3f7fe700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 0x7fcd40068300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 0x7fcd40096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3effd700 1 --2- 172.21.15.154:0/537297468 >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 0x7fcd40096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3e7fc700 1 -- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 msgr2=0x7fcd40068300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 0x7fcd40068300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3e7fc700 1 -- 172.21.15.154:0/537297468 >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 msgr2=0x7fcd40096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/537297468 >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 0x7fcd40096840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3e7fc700 1 -- 172.21.15.154:0/537297468 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40091b90 con 0x7fcd40069d90 2023-09-30T22:19:19.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3f7fe700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 0x7fcd40068300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3effd700 1 --2- 172.21.15.154:0/537297468 >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 0x7fcd40096840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 0x7fcd40096d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fcd40060170 tx=0x7fcd28008040).ready entity=mon.2 client_cookie=4b9a518bd2578a9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3dffb700 1 -- 172.21.15.154:0/537297468 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280104f0 con 0x7fcd40069d90 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3dffb700 1 -- 172.21.15.154:0/537297468 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28010650 con 0x7fcd40069d90 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.010+0000 7fcd3dffb700 1 -- 172.21.15.154:0/537297468 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280109d0 con 0x7fcd40069d90 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.011+0000 7fcd456bb700 1 -- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 msgr2=0x7fcd40096d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.011+0000 7fcd456bb700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 0x7fcd40096d30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fcd40060170 tx=0x7fcd28008040).stop 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.011+0000 7fcd456bb700 1 -- 172.21.15.154:0/537297468 shutdown_connections 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.011+0000 7fcd456bb700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40067e90 0x7fcd40068300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.011+0000 7fcd456bb700 1 --2- 172.21.15.154:0/537297468 >> v2:172.21.15.154:3300/0 conn(0x7fcd4005f560 0x7fcd40096840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.011+0000 7fcd456bb700 1 --2- 172.21.15.154:0/537297468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd40069d90 0x7fcd40096d30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.011+0000 7fcd456bb700 1 -- 172.21.15.154:0/537297468 >> 172.21.15.154:0/537297468 conn(0x7fcd4009a1c0 msgr2=0x7fcd4009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.011+0000 7fcd456bb700 1 -- 172.21.15.154:0/537297468 shutdown_connections 2023-09-30T22:19:19.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.011+0000 7fcd456bb700 1 -- 172.21.15.154:0/537297468 wait complete. 2023-09-30T22:19:19.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.012+0000 7fcd456bb700 1 Processor -- start 2023-09-30T22:19:19.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.012+0000 7fcd456bb700 1 -- start start 2023-09-30T22:19:19.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.012+0000 7fcd456bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd4005f560 0x7fcd40137370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.012+0000 7fcd456bb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd40067e90 0x7fcd40137860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.012+0000 7fcd456bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40137d50 0x7fcd40113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.012+0000 7fcd456bb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd40115190 con 0x7fcd40067e90 2023-09-30T22:19:19.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.012+0000 7fcd456bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4012c130 con 0x7fcd40137d50 2023-09-30T22:19:19.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.012+0000 7fcd456bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd40116370 con 0x7fcd4005f560 2023-09-30T22:19:19.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.012+0000 7fcd3effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd4005f560 0x7fcd40137370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd4005f560 0x7fcd40137370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34494/0 (socket says 172.21.15.154:34494) 2023-09-30T22:19:19.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3effd700 1 -- 172.21.15.154:0/3483793265 learned_addr learned my addr 172.21.15.154:0/3483793265 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:19.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd40067e90 0x7fcd40137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3f7fe700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40137d50 0x7fcd40113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3e7fc700 1 -- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd4005f560 msgr2=0x7fcd40137370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd4005f560 0x7fcd40137370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3e7fc700 1 -- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40137d50 msgr2=0x7fcd40113cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40137d50 0x7fcd40113cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3e7fc700 1 -- 172.21.15.154:0/3483793265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3800e040 con 0x7fcd40067e90 2023-09-30T22:19:19.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3f7fe700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40137d50 0x7fcd40113cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd3e7fc700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd40067e90 0x7fcd40137860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fcd40064ad0 tx=0x7fcd40091d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd36ffd700 1 -- 172.21.15.154:0/3483793265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28010e00 con 0x7fcd40067e90 2023-09-30T22:19:19.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd36ffd700 1 -- 172.21.15.154:0/3483793265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28013bf0 con 0x7fcd40067e90 2023-09-30T22:19:19.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd456bb700 1 -- 172.21.15.154:0/3483793265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd30009a80 con 0x7fcd40067e90 2023-09-30T22:19:19.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd36ffd700 1 -- 172.21.15.154:0/3483793265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2801e420 con 0x7fcd40067e90 2023-09-30T22:19:19.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd456bb700 1 -- 172.21.15.154:0/3483793265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2800e040 con 0x7fcd40067e90 2023-09-30T22:19:19.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd36ffd700 1 -- 172.21.15.154:0/3483793265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fcd2801ea70 con 0x7fcd40067e90 2023-09-30T22:19:19.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.013+0000 7fcd36ffd700 1 -- 172.21.15.154:0/3483793265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcd28028820 con 0x7fcd40067e90 2023-09-30T22:19:19.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.014+0000 7fcd456bb700 1 -- 172.21.15.154:0/3483793265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd40099ba0 con 0x7fcd40067e90 2023-09-30T22:19:19.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.017+0000 7fcd36ffd700 1 -- 172.21.15.154:0/3483793265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fcd2802d060 con 0x7fcd40067e90 2023-09-30T22:19:19.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.111+0000 7fcd456bb700 1 -- 172.21.15.154:0/3483793265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcd4005a260 con 0x7fcd40067e90 2023-09-30T22:19:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.118+0000 7fcd36ffd700 1 -- 172.21.15.154:0/3483793265 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcd28023070 con 0x7fcd40067e90 2023-09-30T22:19:19.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.119+0000 7fcd456bb700 1 -- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd40067e90 msgr2=0x7fcd40137860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.119+0000 7fcd456bb700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd40067e90 0x7fcd40137860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fcd40064ad0 tx=0x7fcd40091d20).stop 2023-09-30T22:19:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.119+0000 7fcd456bb700 1 -- 172.21.15.154:0/3483793265 shutdown_connections 2023-09-30T22:19:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.119+0000 7fcd456bb700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd40137d50 0x7fcd40113cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.119+0000 7fcd456bb700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd4005f560 0x7fcd40137370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.119+0000 7fcd456bb700 1 --2- 172.21.15.154:0/3483793265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd40067e90 0x7fcd40137860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.119+0000 7fcd456bb700 1 -- 172.21.15.154:0/3483793265 >> 172.21.15.154:0/3483793265 conn(0x7fcd4009a1c0 msgr2=0x7fcd4012ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.119+0000 7fcd456bb700 1 -- 172.21.15.154:0/3483793265 shutdown_connections 2023-09-30T22:19:19.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.119+0000 7fcd456bb700 1 -- 172.21.15.154:0/3483793265 wait complete. 2023-09-30T22:19:19.121 INFO:teuthology.orchestra.run.smithi154.stderr:adjusted tunables profile to default 2023-09-30T22:19:19.131 INFO:tasks.ceph:check_enable_crimson: False 2023-09-30T22:19:19.131 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-30T22:19:19.132 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:19.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-30T22:19:19.160 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:19.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-30T22:19:19.168 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:19.169+0000 7f27b5409680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:19:19.196 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:19.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-30T22:19:19.241 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:19.242+0000 7f27b5409680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:19:19.266 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:19.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-30T22:19:19.330 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:19.330+0000 7f27b5409680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:19:19.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 9909cc74-5a3d-4745-a275-eb40291d9c49 0 2023-09-30T22:19:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.494+0000 7fb8fe1c4700 1 Processor -- start 2023-09-30T22:19:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.494+0000 7fb8fe1c4700 1 -- start start 2023-09-30T22:19:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8fe1c4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8f805f560 0x7fb8f8128cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8fe1c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f812dd40 0x7fb8f8130130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8fe1c4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f8093340 con 0x7fb8f8092190 2023-09-30T22:19:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8fe1c4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f805f940 con 0x7fb8f805f560 2023-09-30T22:19:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8fe1c4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8097c30 con 0x7fb8f812dd40 2023-09-30T22:19:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8f805f560 0x7fb8f8128cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f812dd40 0x7fb8f8130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f6ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb8f8092190 0x7fb8f81291a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38804/0 (socket says 172.21.15.154:38804) 2023-09-30T22:19:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8f805f560 0x7fb8f8128cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34454/0 (socket says 172.21.15.154:34454) 2023-09-30T22:19:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f6ffd700 1 -- 172.21.15.154:0/1869290036 learned_addr learned my addr 172.21.15.154:0/1869290036 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f77fe700 1 -- 172.21.15.154:0/1869290036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f812dd40 msgr2=0x7fb8f8130130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f77fe700 1 --2- 172.21.15.154:0/1869290036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f812dd40 0x7fb8f8130130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f77fe700 1 -- 172.21.15.154:0/1869290036 >> v1:172.21.15.154:6789/0 conn(0x7fb8f8092190 legacy=0x7fb8f81291a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f77fe700 1 -- 172.21.15.154:0/1869290036 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80941f0 con 0x7fb8f805f560 2023-09-30T22:19:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f67fc700 1 -- 172.21.15.154:0/1869290036 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964091954 0 0) 0x7fb8f8093340 con 0x7fb8f8092190 2023-09-30T22:19:19.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.495+0000 7fb8f7fff700 1 --2- 172.21.15.154:0/1869290036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f812dd40 0x7fb8f8130130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8f77fe700 1 --2- 172.21.15.154:0/1869290036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f805f560 0x7fb8f8128cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb8e8009760 tx=0x7fb8e8009060).ready entity=mon.0 client_cookie=c89c241de3a128f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8f67fc700 1 -- 172.21.15.154:0/1869290036 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80090d0 con 0x7fb8f805f560 2023-09-30T22:19:19.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8f67fc700 1 -- 172.21.15.154:0/1869290036 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e800f510 con 0x7fb8f805f560 2023-09-30T22:19:19.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8f67fc700 1 -- 172.21.15.154:0/1869290036 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800f890 con 0x7fb8f805f560 2023-09-30T22:19:19.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/1869290036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f805f560 msgr2=0x7fb8f8128cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8fe1c4700 1 --2- 172.21.15.154:0/1869290036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f805f560 0x7fb8f8128cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb8e8009760 tx=0x7fb8e8009060).stop 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/1869290036 shutdown_connections 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8fe1c4700 1 --2- 172.21.15.154:0/1869290036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f812dd40 0x7fb8f8130130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8fe1c4700 1 --2- 172.21.15.154:0/1869290036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f805f560 0x7fb8f8128cb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/1869290036 >> 172.21.15.154:0/1869290036 conn(0x7fb8f809a1c0 msgr2=0x7fb8f809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.496+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/1869290036 shutdown_connections 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.497+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/1869290036 wait complete. 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.497+0000 7fb8fe1c4700 1 Processor -- start 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.497+0000 7fb8fe1c4700 1 -- start start 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8fe1c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f805f560 0x7fb8f8067e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8fe1c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f8092190 0x7fb8f8068380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8fe1c4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f812dd40 0x7fb8f8068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8fe1c4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8068d60 con 0x7fb8f812dd40 2023-09-30T22:19:19.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8fe1c4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80697b0 con 0x7fb8f8092190 2023-09-30T22:19:19.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8fe1c4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8097d80 con 0x7fb8f805f560 2023-09-30T22:19:19.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f8092190 0x7fb8f8068380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f805f560 0x7fb8f8067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f8092190 0x7fb8f8068380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36050/0 (socket says 172.21.15.154:36050) 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f6ffd700 1 -- 172.21.15.154:0/2568495909 learned_addr learned my addr 172.21.15.154:0/2568495909 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f805f560 0x7fb8f8067e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34500/0 (socket says 172.21.15.154:34500) 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f7fff700 1 --2- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f812dd40 0x7fb8f8068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f6ffd700 1 -- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f805f560 msgr2=0x7fb8f8067e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f6ffd700 1 --2- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f805f560 0x7fb8f8067e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f6ffd700 1 -- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f812dd40 msgr2=0x7fb8f8068870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f6ffd700 1 --2- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f812dd40 0x7fb8f8068870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f6ffd700 1 -- 172.21.15.154:0/2568495909 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0009a20 con 0x7fb8f8092190 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f77fe700 1 --2- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f805f560 0x7fb8f8067e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.498+0000 7fb8f6ffd700 1 --2- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f8092190 0x7fb8f8068380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb8ec00c4c0 tx=0x7fb8ec007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.499+0000 7fb8df7fe700 1 -- 172.21.15.154:0/2568495909 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0072e0 con 0x7fb8f8092190 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.499+0000 7fb8df7fe700 1 -- 172.21.15.154:0/2568495909 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec007440 con 0x7fb8f8092190 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.499+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/2568495909 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e80092a0 con 0x7fb8f8092190 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.499+0000 7fb8df7fe700 1 -- 172.21.15.154:0/2568495909 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0057a0 con 0x7fb8f8092190 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.499+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/2568495909 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f8115950 con 0x7fb8f8092190 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.499+0000 7fb8df7fe700 1 -- 172.21.15.154:0/2568495909 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb8ec013450 con 0x7fb8f8092190 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.499+0000 7fb8df7fe700 1 -- 172.21.15.154:0/2568495909 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb8ec01d790 con 0x7fb8f8092190 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.500+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/2568495909 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f8115b70 con 0x7fb8f8092190 2023-09-30T22:19:19.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.502+0000 7fb8df7fe700 1 -- 172.21.15.154:0/2568495909 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb8ec018070 con 0x7fb8f8092190 2023-09-30T22:19:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.582+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/2568495909 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9909cc74-5a3d-4745-a275-eb40291d9c49", "id": 0} v 0) v1 -- 0x7fb8f8093560 con 0x7fb8f8092190 2023-09-30T22:19:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.590+0000 7fb8df7fe700 1 -- 172.21.15.154:0/2568495909 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9909cc74-5a3d-4745-a275-eb40291d9c49", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8ec005df0 con 0x7fb8f8092190 2023-09-30T22:19:19.590 INFO:teuthology.orchestra.run.smithi154.stdout:0 2023-09-30T22:19:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.591+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f8092190 msgr2=0x7fb8f8068380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.591+0000 7fb8fe1c4700 1 --2- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f8092190 0x7fb8f8068380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb8ec00c4c0 tx=0x7fb8ec007c10).stop 2023-09-30T22:19:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.591+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/2568495909 shutdown_connections 2023-09-30T22:19:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.591+0000 7fb8fe1c4700 1 --2- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f812dd40 0x7fb8f8068870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.591+0000 7fb8fe1c4700 1 --2- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f805f560 0x7fb8f8067e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.591+0000 7fb8fe1c4700 1 --2- 172.21.15.154:0/2568495909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f8092190 0x7fb8f8068380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.591+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/2568495909 >> 172.21.15.154:0/2568495909 conn(0x7fb8f809a1c0 msgr2=0x7fb8f8097f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.591+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/2568495909 shutdown_connections 2023-09-30T22:19:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.591+0000 7fb8fe1c4700 1 -- 172.21.15.154:0/2568495909 wait complete. 2023-09-30T22:19:19.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 630d7abe-ba54-47a6-978d-475135a94dea 1 2023-09-30T22:19:19.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.720+0000 7f66b2895700 1 Processor -- start 2023-09-30T22:19:19.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.720+0000 7f66b2895700 1 -- start start 2023-09-30T22:19:19.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66b2895700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66b2895700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac12d250 0x7f66ac12f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66b2895700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ac094ba0 con 0x7f66ac093950 2023-09-30T22:19:19.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66b2895700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac092e90 con 0x7f66ac095e70 2023-09-30T22:19:19.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66b2895700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac096b60 con 0x7f66ac12d250 2023-09-30T22:19:19.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66ab7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66abfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f66ac093950 0x7f66ac095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38816/0 (socket says 172.21.15.154:38816) 2023-09-30T22:19:19.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66abfff700 1 -- 172.21.15.154:0/196501431 learned_addr learned my addr 172.21.15.154:0/196501431 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:19.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66b0e32700 1 --2- 172.21.15.154:0/196501431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac12d250 0x7f66ac12f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66aaffd700 1 -- 172.21.15.154:0/196501431 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723276217 0 0) 0x7f66ac094ba0 con 0x7f66ac093950 2023-09-30T22:19:19.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66ab7fe700 1 -- 172.21.15.154:0/196501431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac12d250 msgr2=0x7f66ac12f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66ab7fe700 1 --2- 172.21.15.154:0/196501431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac12d250 0x7f66ac12f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66ab7fe700 1 -- 172.21.15.154:0/196501431 >> v1:172.21.15.154:6789/0 conn(0x7f66ac093950 legacy=0x7f66ac095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66ab7fe700 1 -- 172.21.15.154:0/196501431 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac093150 con 0x7f66ac095e70 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66b0e32700 1 --2- 172.21.15.154:0/196501431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac12d250 0x7f66ac12f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66ab7fe700 1 --2- 172.21.15.154:0/196501431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac096250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f66a0009790 tx=0x7f66a0009060).ready entity=mon.1 client_cookie=a3497d6ece70821f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.721+0000 7f66aaffd700 1 -- 172.21.15.154:0/196501431 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00090d0 con 0x7f66ac095e70 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66aaffd700 1 -- 172.21.15.154:0/196501431 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a000f510 con 0x7f66ac095e70 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66aaffd700 1 -- 172.21.15.154:0/196501431 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a000f890 con 0x7f66ac095e70 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66b2895700 1 -- 172.21.15.154:0/196501431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 msgr2=0x7f66ac096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66b2895700 1 --2- 172.21.15.154:0/196501431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac096250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f66a0009790 tx=0x7f66a0009060).stop 2023-09-30T22:19:19.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66b2895700 1 -- 172.21.15.154:0/196501431 shutdown_connections 2023-09-30T22:19:19.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66b2895700 1 --2- 172.21.15.154:0/196501431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac12d250 0x7f66ac12f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66b2895700 1 --2- 172.21.15.154:0/196501431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac096250 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66b2895700 1 -- 172.21.15.154:0/196501431 >> 172.21.15.154:0/196501431 conn(0x7f66ac09aa50 msgr2=0x7f66ac09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66b2895700 1 -- 172.21.15.154:0/196501431 shutdown_connections 2023-09-30T22:19:19.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.722+0000 7f66b2895700 1 -- 172.21.15.154:0/196501431 wait complete. 2023-09-30T22:19:19.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.723+0000 7f66b2895700 1 Processor -- start 2023-09-30T22:19:19.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b2895700 1 -- start start 2023-09-30T22:19:19.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b2895700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac093950 0x7f66ac116e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b2895700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac117370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b2895700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ac12d250 0x7f66ac117860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b2895700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac117d50 con 0x7f66ac12d250 2023-09-30T22:19:19.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b2895700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac1182f0 con 0x7f66ac095e70 2023-09-30T22:19:19.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b2895700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac11a410 con 0x7f66ac093950 2023-09-30T22:19:19.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b0e32700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ac12d250 0x7f66ac117860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66ab7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac117370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b0e32700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ac12d250 0x7f66ac117860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34464/0 (socket says 172.21.15.154:34464) 2023-09-30T22:19:19.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66ab7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac117370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36066/0 (socket says 172.21.15.154:36066) 2023-09-30T22:19:19.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66b0e32700 1 -- 172.21.15.154:0/3229956250 learned_addr learned my addr 172.21.15.154:0/3229956250 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:19.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.724+0000 7f66abfff700 1 --2- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac093950 0x7f66ac116e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f66b0e32700 1 -- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac093950 msgr2=0x7f66ac116e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f66b0e32700 1 --2- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac093950 0x7f66ac116e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f66b0e32700 1 -- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 msgr2=0x7f66ac117370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f66b0e32700 1 --2- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac117370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f66b0e32700 1 -- 172.21.15.154:0/3229956250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4009a20 con 0x7f66ac12d250 2023-09-30T22:19:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f66ab7fe700 1 --2- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac117370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f66b0e32700 1 --2- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ac12d250 0x7f66ac117860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f66a4009f90 tx=0x7f66a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f6693fff700 1 -- 172.21.15.154:0/3229956250 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a400cbd0 con 0x7f66ac12d250 2023-09-30T22:19:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f6693fff700 1 -- 172.21.15.154:0/3229956250 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a400f040 con 0x7f66ac12d250 2023-09-30T22:19:19.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f6693fff700 1 -- 172.21.15.154:0/3229956250 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4013400 con 0x7f66ac12d250 2023-09-30T22:19:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f66b2895700 1 -- 172.21.15.154:0/3229956250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a00092a0 con 0x7f66ac12d250 2023-09-30T22:19:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f66b2895700 1 -- 172.21.15.154:0/3229956250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac092410 con 0x7f66ac12d250 2023-09-30T22:19:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f6693fff700 1 -- 172.21.15.154:0/3229956250 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f66a40139d0 con 0x7f66ac12d250 2023-09-30T22:19:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.725+0000 7f6693fff700 1 -- 172.21.15.154:0/3229956250 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f66a401dad0 con 0x7f66ac12d250 2023-09-30T22:19:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.726+0000 7f66b2895700 1 -- 172.21.15.154:0/3229956250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac11a8f0 con 0x7f66ac12d250 2023-09-30T22:19:19.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.728+0000 7f6693fff700 1 -- 172.21.15.154:0/3229956250 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f66ac11a8f0 con 0x7f66ac12d250 2023-09-30T22:19:19.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.807+0000 7f66b2895700 1 -- 172.21.15.154:0/3229956250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "630d7abe-ba54-47a6-978d-475135a94dea", "id": 1} v 0) v1 -- 0x7f66ac11a070 con 0x7f66ac12d250 2023-09-30T22:19:19.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.814+0000 7f6693fff700 1 -- 172.21.15.154:0/3229956250 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "630d7abe-ba54-47a6-978d-475135a94dea", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f66a401dd60 con 0x7f66ac12d250 2023-09-30T22:19:19.815 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-09-30T22:19:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.815+0000 7f66b2895700 1 -- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ac12d250 msgr2=0x7f66ac117860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.815+0000 7f66b2895700 1 --2- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ac12d250 0x7f66ac117860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f66a4009f90 tx=0x7f66a400b040).stop 2023-09-30T22:19:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.815+0000 7f66b2895700 1 -- 172.21.15.154:0/3229956250 shutdown_connections 2023-09-30T22:19:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.815+0000 7f66b2895700 1 --2- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ac12d250 0x7f66ac117860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.816+0000 7f66b2895700 1 --2- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ac093950 0x7f66ac116e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.816+0000 7f66b2895700 1 --2- 172.21.15.154:0/3229956250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ac095e70 0x7f66ac117370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.816+0000 7f66b2895700 1 -- 172.21.15.154:0/3229956250 >> 172.21.15.154:0/3229956250 conn(0x7f66ac09aa50 msgr2=0x7f66ac1110b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.816+0000 7f66b2895700 1 -- 172.21.15.154:0/3229956250 shutdown_connections 2023-09-30T22:19:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.816+0000 7f66b2895700 1 -- 172.21.15.154:0/3229956250 wait complete. 2023-09-30T22:19:19.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new a874650f-eff1-4a01-936f-7d02bdbc96d2 2 2023-09-30T22:19:19.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.945+0000 7f9b9d36c700 1 Processor -- start 2023-09-30T22:19:19.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.945+0000 7f9b9d36c700 1 -- start start 2023-09-30T22:19:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b9d36c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98062b00 0x7f9b98095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b9d36c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b980966b0 0x7f9b98132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b9d36c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b98091980 con 0x7f9b98095b80 2023-09-30T22:19:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b9d36c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b980973f0 con 0x7f9b980966b0 2023-09-30T22:19:19.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b9d36c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b98062ee0 con 0x7f9b98062b00 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b96ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98062b00 0x7f9b98095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b977fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b980966b0 0x7f9b98132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b967fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9b98095b80 0x7f9b98095fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38826/0 (socket says 172.21.15.154:38826) 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b967fc700 1 -- 172.21.15.154:0/429025364 learned_addr learned my addr 172.21.15.154:0/429025364 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b96ffd700 1 -- 172.21.15.154:0/429025364 >> v2:172.21.15.154:3300/0 conn(0x7f9b980966b0 msgr2=0x7f9b98132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b96ffd700 1 --2- 172.21.15.154:0/429025364 >> v2:172.21.15.154:3300/0 conn(0x7f9b980966b0 0x7f9b98132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b96ffd700 1 -- 172.21.15.154:0/429025364 >> v1:172.21.15.154:6789/0 conn(0x7f9b98095b80 legacy=0x7f9b98095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b95ffb700 1 -- 172.21.15.154:0/429025364 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109765316 0 0) 0x7f9b98091980 con 0x7f9b98095b80 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b96ffd700 1 -- 172.21.15.154:0/429025364 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b98092310 con 0x7f9b98062b00 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b977fe700 1 --2- 172.21.15.154:0/429025364 >> v2:172.21.15.154:3300/0 conn(0x7f9b980966b0 0x7f9b98132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b96ffd700 1 --2- 172.21.15.154:0/429025364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98062b00 0x7f9b98095690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9b88009790 tx=0x7f9b88009060).ready entity=mon.1 client_cookie=26fed3efac1d7d07 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b95ffb700 1 -- 172.21.15.154:0/429025364 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800f510 con 0x7f9b98062b00 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b95ffb700 1 -- 172.21.15.154:0/429025364 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8800f670 con 0x7f9b98062b00 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.946+0000 7f9b95ffb700 1 -- 172.21.15.154:0/429025364 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800f9f0 con 0x7f9b98062b00 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.947+0000 7f9b9d36c700 1 -- 172.21.15.154:0/429025364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98062b00 msgr2=0x7f9b98095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.947+0000 7f9b9d36c700 1 --2- 172.21.15.154:0/429025364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98062b00 0x7f9b98095690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9b88009790 tx=0x7f9b88009060).stop 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.947+0000 7f9b9d36c700 1 -- 172.21.15.154:0/429025364 shutdown_connections 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.947+0000 7f9b9d36c700 1 --2- 172.21.15.154:0/429025364 >> v2:172.21.15.154:3300/0 conn(0x7f9b980966b0 0x7f9b98132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.947+0000 7f9b9d36c700 1 --2- 172.21.15.154:0/429025364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98062b00 0x7f9b98095690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.947+0000 7f9b9d36c700 1 -- 172.21.15.154:0/429025364 >> 172.21.15.154:0/429025364 conn(0x7f9b9809aa50 msgr2=0x7f9b9809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.947+0000 7f9b9d36c700 1 -- 172.21.15.154:0/429025364 shutdown_connections 2023-09-30T22:19:19.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.947+0000 7f9b9d36c700 1 -- 172.21.15.154:0/429025364 wait complete. 2023-09-30T22:19:19.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.948+0000 7f9b9d36c700 1 Processor -- start 2023-09-30T22:19:19.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.948+0000 7f9b9d36c700 1 -- start start 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.948+0000 7f9b9d36c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b98062b00 0x7f9b9812d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.948+0000 7f9b9d36c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98095b80 0x7f9b981157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.948+0000 7f9b9d36c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b980966b0 0x7f9b98115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.948+0000 7f9b9d36c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b981178b0 con 0x7f9b980966b0 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.948+0000 7f9b9d36c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b98096da0 con 0x7f9b98095b80 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.948+0000 7f9b9d36c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b98118c30 con 0x7f9b98062b00 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b96ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b98062b00 0x7f9b9812d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b967fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98095b80 0x7f9b981157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b96ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b98062b00 0x7f9b9812d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34520/0 (socket says 172.21.15.154:34520) 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b96ffd700 1 -- 172.21.15.154:0/4045538727 learned_addr learned my addr 172.21.15.154:0/4045538727 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b977fe700 1 --2- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b980966b0 0x7f9b98115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:19.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b967fc700 1 -- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b98062b00 msgr2=0x7f9b9812d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b967fc700 1 --2- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b98062b00 0x7f9b9812d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b967fc700 1 -- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b980966b0 msgr2=0x7f9b98115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b967fc700 1 --2- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b980966b0 0x7f9b98115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b967fc700 1 -- 172.21.15.154:0/4045538727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90009a20 con 0x7f9b98095b80 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b96ffd700 1 --2- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b98062b00 0x7f9b9812d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b967fc700 1 --2- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98095b80 0x7f9b981157c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9b8c000c00 tx=0x7f9b8c007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b7effd700 1 -- 172.21.15.154:0/4045538727 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0070d0 con 0x7f9b98095b80 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b7effd700 1 -- 172.21.15.154:0/4045538727 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c007250 con 0x7f9b98095b80 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b9d36c700 1 -- 172.21.15.154:0/4045538727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b880092a0 con 0x7f9b98095b80 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b7effd700 1 -- 172.21.15.154:0/4045538727 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c007610 con 0x7f9b98095b80 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b9d36c700 1 -- 172.21.15.154:0/4045538727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b98119870 con 0x7f9b98095b80 2023-09-30T22:19:19.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.949+0000 7f9b7effd700 1 -- 172.21.15.154:0/4045538727 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9b8c005c10 con 0x7f9b98095b80 2023-09-30T22:19:19.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.950+0000 7f9b7effd700 1 -- 172.21.15.154:0/4045538727 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f9b8c013bf0 con 0x7f9b98095b80 2023-09-30T22:19:19.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.950+0000 7f9b9d36c700 1 -- 172.21.15.154:0/4045538727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9805a260 con 0x7f9b98095b80 2023-09-30T22:19:19.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:19.952+0000 7f9b7effd700 1 -- 172.21.15.154:0/4045538727 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9b8c018070 con 0x7f9b98095b80 2023-09-30T22:19:20.048 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:20.048+0000 7f27b5409680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:19:20.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.065+0000 7f9b9d36c700 1 -- 172.21.15.154:0/4045538727 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a874650f-eff1-4a01-936f-7d02bdbc96d2", "id": 2} v 0) v1 -- 0x7f9b981165c0 con 0x7f9b98095b80 2023-09-30T22:19:20.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.068+0000 7f9b7effd700 1 -- 172.21.15.154:0/4045538727 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a874650f-eff1-4a01-936f-7d02bdbc96d2", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b8c0137c0 con 0x7f9b98095b80 2023-09-30T22:19:20.068 INFO:teuthology.orchestra.run.smithi154.stdout:2 2023-09-30T22:19:20.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.069+0000 7f9b9d36c700 1 -- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98095b80 msgr2=0x7f9b981157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.069+0000 7f9b9d36c700 1 --2- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98095b80 0x7f9b981157c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9b8c000c00 tx=0x7f9b8c007b90).stop 2023-09-30T22:19:20.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.069+0000 7f9b9d36c700 1 -- 172.21.15.154:0/4045538727 shutdown_connections 2023-09-30T22:19:20.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.069+0000 7f9b9d36c700 1 --2- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b980966b0 0x7f9b98115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.069+0000 7f9b9d36c700 1 --2- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b98062b00 0x7f9b9812d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.069+0000 7f9b9d36c700 1 --2- 172.21.15.154:0/4045538727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b98095b80 0x7f9b981157c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.069+0000 7f9b9d36c700 1 -- 172.21.15.154:0/4045538727 >> 172.21.15.154:0/4045538727 conn(0x7f9b9809aa50 msgr2=0x7f9b98098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.070+0000 7f9b9d36c700 1 -- 172.21.15.154:0/4045538727 shutdown_connections 2023-09-30T22:19:20.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.070+0000 7f9b9d36c700 1 -- 172.21.15.154:0/4045538727 wait complete. 2023-09-30T22:19:20.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 23d7e2dd-76c1-4d97-97fd-7373fa3e719d 3 2023-09-30T22:19:20.161 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:20.161+0000 7f27b5409680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:19:20.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca97f0700 1 Processor -- start 2023-09-30T22:19:20.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca97f0700 1 -- start start 2023-09-30T22:19:20.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca97f0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ca40977b0 0x7f8ca4127c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca97f0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca41280f0 0x7f8ca412aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca97f0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca41279b0 con 0x7f8ca412af40 2023-09-30T22:19:20.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca97f0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca4097b90 con 0x7f8ca40977b0 2023-09-30T22:19:20.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca97f0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca4065d80 con 0x7f8ca41280f0 2023-09-30T22:19:20.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ca40977b0 0x7f8ca4127c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca41280f0 0x7f8ca412aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ca40977b0 0x7f8ca4127c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34502/0 (socket says 172.21.15.154:34502) 2023-09-30T22:19:20.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.200+0000 7f8ca2ffd700 1 -- 172.21.15.154:0/3143015822 learned_addr learned my addr 172.21.15.154:0/3143015822 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:20.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca2ffd700 1 -- 172.21.15.154:0/3143015822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca41280f0 msgr2=0x7f8ca412aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:20.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca2ffd700 1 --2- 172.21.15.154:0/3143015822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca41280f0 0x7f8ca412aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca2ffd700 1 -- 172.21.15.154:0/3143015822 >> v1:172.21.15.154:6789/0 conn(0x7f8ca412af40 legacy=0x7f8ca4131db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca1ffb700 1 -- 172.21.15.154:0/3143015822 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554901712 0 0) 0x7f8ca41279b0 con 0x7f8ca412af40 2023-09-30T22:19:20.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca2ffd700 1 -- 172.21.15.154:0/3143015822 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca406aa60 con 0x7f8ca40977b0 2023-09-30T22:19:20.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca27fc700 1 --2- 172.21.15.154:0/3143015822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca41280f0 0x7f8ca412aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca2ffd700 1 --2- 172.21.15.154:0/3143015822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca40977b0 0x7f8ca4127c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f8c94006fd0 tx=0x7f8c940090f0).ready entity=mon.0 client_cookie=f13e0468f832caf1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca1ffb700 1 -- 172.21.15.154:0/3143015822 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400b580 con 0x7f8ca40977b0 2023-09-30T22:19:20.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca1ffb700 1 -- 172.21.15.154:0/3143015822 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9400b6e0 con 0x7f8ca40977b0 2023-09-30T22:19:20.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca1ffb700 1 -- 172.21.15.154:0/3143015822 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400ba60 con 0x7f8ca40977b0 2023-09-30T22:19:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca97f0700 1 -- 172.21.15.154:0/3143015822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca40977b0 msgr2=0x7f8ca4127c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca97f0700 1 --2- 172.21.15.154:0/3143015822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca40977b0 0x7f8ca4127c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f8c94006fd0 tx=0x7f8c940090f0).stop 2023-09-30T22:19:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca97f0700 1 -- 172.21.15.154:0/3143015822 shutdown_connections 2023-09-30T22:19:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca97f0700 1 --2- 172.21.15.154:0/3143015822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca40977b0 0x7f8ca4127c00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca97f0700 1 --2- 172.21.15.154:0/3143015822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca41280f0 0x7f8ca412aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.201+0000 7f8ca97f0700 1 -- 172.21.15.154:0/3143015822 >> 172.21.15.154:0/3143015822 conn(0x7f8ca409bad0 msgr2=0x7f8ca409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.202+0000 7f8ca97f0700 1 -- 172.21.15.154:0/3143015822 shutdown_connections 2023-09-30T22:19:20.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.202+0000 7f8ca97f0700 1 -- 172.21.15.154:0/3143015822 wait complete. 2023-09-30T22:19:20.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.202+0000 7f8ca97f0700 1 Processor -- start 2023-09-30T22:19:20.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca97f0700 1 -- start start 2023-09-30T22:19:20.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca97f0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca40977b0 0x7f8ca4118990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca97f0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca41280f0 0x7f8ca4114a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca97f0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ca412af40 0x7f8ca4114f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca97f0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca4125ac0 con 0x7f8ca41280f0 2023-09-30T22:19:20.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca97f0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca412a970 con 0x7f8ca412af40 2023-09-30T22:19:20.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca97f0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca4065150 con 0x7f8ca40977b0 2023-09-30T22:19:20.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca40977b0 0x7f8ca4118990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca41280f0 0x7f8ca4114a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca40977b0 0x7f8ca4118990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34540/0 (socket says 172.21.15.154:34540) 2023-09-30T22:19:20.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca41280f0 0x7f8ca4114a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34514/0 (socket says 172.21.15.154:34514) 2023-09-30T22:19:20.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca2ffd700 1 -- 172.21.15.154:0/623508957 learned_addr learned my addr 172.21.15.154:0/623508957 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:20.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca37fe700 1 --2- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ca412af40 0x7f8ca4114f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca2ffd700 1 -- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ca412af40 msgr2=0x7f8ca4114f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca2ffd700 1 --2- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ca412af40 0x7f8ca4114f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca2ffd700 1 -- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca41280f0 msgr2=0x7f8ca4114a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca2ffd700 1 --2- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca41280f0 0x7f8ca4114a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca2ffd700 1 -- 172.21.15.154:0/623508957 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980092a0 con 0x7f8ca40977b0 2023-09-30T22:19:20.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.203+0000 7f8ca27fc700 1 --2- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca41280f0 0x7f8ca4114a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.204+0000 7f8ca2ffd700 1 --2- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca40977b0 0x7f8ca4118990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8c94009fd0 tx=0x7f8c94017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.204+0000 7f8c8affd700 1 -- 172.21.15.154:0/623508957 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94000bc0 con 0x7f8ca40977b0 2023-09-30T22:19:20.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.204+0000 7f8c8affd700 1 -- 172.21.15.154:0/623508957 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9400b850 con 0x7f8ca40977b0 2023-09-30T22:19:20.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.204+0000 7f8c8affd700 1 -- 172.21.15.154:0/623508957 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94000d20 con 0x7f8ca40977b0 2023-09-30T22:19:20.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.204+0000 7f8ca97f0700 1 -- 172.21.15.154:0/623508957 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c94009370 con 0x7f8ca40977b0 2023-09-30T22:19:20.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.204+0000 7f8ca97f0700 1 -- 172.21.15.154:0/623508957 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca4116580 con 0x7f8ca40977b0 2023-09-30T22:19:20.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.204+0000 7f8c8affd700 1 -- 172.21.15.154:0/623508957 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8c9401cb40 con 0x7f8ca40977b0 2023-09-30T22:19:20.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.204+0000 7f8c8affd700 1 -- 172.21.15.154:0/623508957 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f8c94025990 con 0x7f8ca40977b0 2023-09-30T22:19:20.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.205+0000 7f8ca97f0700 1 -- 172.21.15.154:0/623508957 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca4098eb0 con 0x7f8ca40977b0 2023-09-30T22:19:20.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.207+0000 7f8c8affd700 1 -- 172.21.15.154:0/623508957 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8c9402a060 con 0x7f8ca40977b0 2023-09-30T22:19:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.287+0000 7f8ca97f0700 1 -- 172.21.15.154:0/623508957 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd new", "uuid": "23d7e2dd-76c1-4d97-97fd-7373fa3e719d", "id": 3} v 0) v1 -- 0x7f8ca405a260 con 0x7f8ca40977b0 2023-09-30T22:19:20.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.290+0000 7f8c8affd700 1 -- 172.21.15.154:0/623508957 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23d7e2dd-76c1-4d97-97fd-7373fa3e719d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c94020070 con 0x7f8ca40977b0 2023-09-30T22:19:20.290 INFO:teuthology.orchestra.run.smithi154.stdout:3 2023-09-30T22:19:20.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.291+0000 7f8ca97f0700 1 -- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca40977b0 msgr2=0x7f8ca4118990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.291+0000 7f8ca97f0700 1 --2- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca40977b0 0x7f8ca4118990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8c94009fd0 tx=0x7f8c94017000).stop 2023-09-30T22:19:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.291+0000 7f8ca97f0700 1 -- 172.21.15.154:0/623508957 shutdown_connections 2023-09-30T22:19:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.291+0000 7f8ca97f0700 1 --2- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ca412af40 0x7f8ca4114f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.291+0000 7f8ca97f0700 1 --2- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ca40977b0 0x7f8ca4118990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.291+0000 7f8ca97f0700 1 --2- 172.21.15.154:0/623508957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca41280f0 0x7f8ca4114a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.291+0000 7f8ca97f0700 1 -- 172.21.15.154:0/623508957 >> 172.21.15.154:0/623508957 conn(0x7f8ca409bad0 msgr2=0x7f8ca4129e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.291+0000 7f8ca97f0700 1 -- 172.21.15.154:0/623508957 shutdown_connections 2023-09-30T22:19:20.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.291+0000 7f8ca97f0700 1 -- 172.21.15.154:0/623508957 wait complete. 2023-09-30T22:19:20.300 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:20.300+0000 7f27b5409680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:19:20.303 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T22:19:20.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T22:19:20.305 INFO:tasks.ceph.osd.0:Started 2023-09-30T22:19:20.306 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T22:19:20.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T22:19:20.308 INFO:tasks.ceph.osd.1:Started 2023-09-30T22:19:20.308 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T22:19:20.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T22:19:20.311 INFO:tasks.ceph.osd.2:Started 2023-09-30T22:19:20.311 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T22:19:20.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T22:19:20.314 INFO:tasks.ceph.osd.3:Started 2023-09-30T22:19:20.315 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:20.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.466+0000 7f2d84c86700 1 Processor -- start 2023-09-30T22:19:20.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.466+0000 7f2d84c86700 1 -- start start 2023-09-30T22:19:20.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.467+0000 7f2d84c86700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d800972b0 0x7f2d80094750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.467+0000 7f2d84c86700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d80094c40 0x7f2d801303b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.467+0000 7f2d84c86700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d80093180 con 0x7f2d80093980 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.467+0000 7f2d84c86700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d80093d60 con 0x7f2d800972b0 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.467+0000 7f2d84c86700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800977d0 con 0x7f2d80094c40 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.467+0000 7f2d7dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d800972b0 0x7f2d80094750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.467+0000 7f2d7ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d80094c40 0x7f2d801303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.467+0000 7f2d7e59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2d80093980 0x7f2d80094040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38860/0 (socket says 172.21.15.154:38860) 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.467+0000 7f2d7e59c700 1 -- 172.21.15.154:0/415600842 learned_addr learned my addr 172.21.15.154:0/415600842 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7ed9d700 1 -- 172.21.15.154:0/415600842 >> v2:172.21.15.154:3300/0 conn(0x7f2d800972b0 msgr2=0x7f2d80094750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7ed9d700 1 --2- 172.21.15.154:0/415600842 >> v2:172.21.15.154:3300/0 conn(0x7f2d800972b0 0x7f2d80094750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7ed9d700 1 -- 172.21.15.154:0/415600842 >> v1:172.21.15.154:6789/0 conn(0x7f2d80093980 legacy=0x7f2d80094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7ed9d700 1 -- 172.21.15.154:0/415600842 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80098430 con 0x7f2d80094c40 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7d59a700 1 -- 172.21.15.154:0/415600842 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714599712 0 0) 0x7f2d80093180 con 0x7f2d80093980 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7dd9b700 1 --2- 172.21.15.154:0/415600842 >> v2:172.21.15.154:3300/0 conn(0x7f2d800972b0 0x7f2d80094750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7ed9d700 1 --2- 172.21.15.154:0/415600842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d80094c40 0x7f2d801303b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f2d78009e60 tx=0x7f2d78009780).ready entity=mon.1 client_cookie=28b827630163b8af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7d59a700 1 -- 172.21.15.154:0/415600842 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800e070 con 0x7f2d80094c40 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7d59a700 1 -- 172.21.15.154:0/415600842 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7800bb60 con 0x7f2d80094c40 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.468+0000 7f2d7d59a700 1 -- 172.21.15.154:0/415600842 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d78012410 con 0x7f2d80094c40 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.469+0000 7f2d84c86700 1 -- 172.21.15.154:0/415600842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d80094c40 msgr2=0x7f2d801303b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.469+0000 7f2d84c86700 1 --2- 172.21.15.154:0/415600842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d80094c40 0x7f2d801303b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f2d78009e60 tx=0x7f2d78009780).stop 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.469+0000 7f2d84c86700 1 -- 172.21.15.154:0/415600842 shutdown_connections 2023-09-30T22:19:20.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.469+0000 7f2d84c86700 1 --2- 172.21.15.154:0/415600842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d80094c40 0x7f2d801303b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.469+0000 7f2d84c86700 1 --2- 172.21.15.154:0/415600842 >> v2:172.21.15.154:3300/0 conn(0x7f2d800972b0 0x7f2d80094750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.469+0000 7f2d84c86700 1 -- 172.21.15.154:0/415600842 >> 172.21.15.154:0/415600842 conn(0x7f2d8009bba0 msgr2=0x7f2d8009bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.469+0000 7f2d84c86700 1 -- 172.21.15.154:0/415600842 shutdown_connections 2023-09-30T22:19:20.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.469+0000 7f2d84c86700 1 -- 172.21.15.154:0/415600842 wait complete. 2023-09-30T22:19:20.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d84c86700 1 Processor -- start 2023-09-30T22:19:20.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d84c86700 1 -- start start 2023-09-30T22:19:20.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d84c86700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d80093980 0x7f2d8011e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d84c86700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80094c40 0x7f2d8011a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d84c86700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d800972b0 0x7f2d8011a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d84c86700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800663b0 con 0x7f2d80094c40 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d84c86700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8006a6d0 con 0x7f2d800972b0 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d84c86700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8011b620 con 0x7f2d80093980 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d7e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d80093980 0x7f2d8011e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d7dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80094c40 0x7f2d8011a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d7e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d80093980 0x7f2d8011e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34604/0 (socket says 172.21.15.154:34604) 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d7e59c700 1 -- 172.21.15.154:0/3367004994 learned_addr learned my addr 172.21.15.154:0/3367004994 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.470+0000 7f2d7ed9d700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d800972b0 0x7f2d8011a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:20.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d7dd9b700 1 -- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d80093980 msgr2=0x7f2d8011e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d7dd9b700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d80093980 0x7f2d8011e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d7dd9b700 1 -- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d800972b0 msgr2=0x7f2d8011a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d7dd9b700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d800972b0 0x7f2d8011a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d7dd9b700 1 -- 172.21.15.154:0/3367004994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740092a0 con 0x7f2d80094c40 2023-09-30T22:19:20.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d7e59c700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d80093980 0x7f2d8011e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d7ed9d700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d800972b0 0x7f2d8011a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:20.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d7dd9b700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80094c40 0x7f2d8011a220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2d7400e980 tx=0x7f2d74009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:20.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d6e7fc700 1 -- 172.21.15.154:0/3367004994 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74012600 con 0x7f2d80094c40 2023-09-30T22:19:20.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d6e7fc700 1 -- 172.21.15.154:0/3367004994 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74012760 con 0x7f2d80094c40 2023-09-30T22:19:20.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d6e7fc700 1 -- 172.21.15.154:0/3367004994 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74012ae0 con 0x7f2d80094c40 2023-09-30T22:19:20.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d84c86700 1 -- 172.21.15.154:0/3367004994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d78009a20 con 0x7f2d80094c40 2023-09-30T22:19:20.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d84c86700 1 -- 172.21.15.154:0/3367004994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8011d990 con 0x7f2d80094c40 2023-09-30T22:19:20.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d6e7fc700 1 -- 172.21.15.154:0/3367004994 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2d7401b660 con 0x7f2d80094c40 2023-09-30T22:19:20.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.471+0000 7f2d6e7fc700 1 -- 172.21.15.154:0/3367004994 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f2d7401b910 con 0x7f2d80094c40 2023-09-30T22:19:20.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.473+0000 7f2d84c86700 1 -- 172.21.15.154:0/3367004994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8005a260 con 0x7f2d80094c40 2023-09-30T22:19:20.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.475+0000 7f2d6e7fc700 1 -- 172.21.15.154:0/3367004994 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2d7403ae50 con 0x7f2d80094c40 2023-09-30T22:19:20.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.541+0000 7f2d84c86700 1 -- 172.21.15.154:0/3367004994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d8011b020 con 0x7f2d80094c40 2023-09-30T22:19:20.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.542+0000 7f2d6e7fc700 1 -- 172.21.15.154:0/3367004994 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f2d74029030 con 0x7f2d80094c40 2023-09-30T22:19:20.542 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:20.542 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:20.288789+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.543+0000 7f2d84c86700 1 -- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80094c40 msgr2=0x7f2d8011a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.543+0000 7f2d84c86700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80094c40 0x7f2d8011a220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2d7400e980 tx=0x7f2d74009060).stop 2023-09-30T22:19:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.543+0000 7f2d84c86700 1 -- 172.21.15.154:0/3367004994 shutdown_connections 2023-09-30T22:19:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.543+0000 7f2d84c86700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d800972b0 0x7f2d8011a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.543+0000 7f2d84c86700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d80093980 0x7f2d8011e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.543+0000 7f2d84c86700 1 --2- 172.21.15.154:0/3367004994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d80094c40 0x7f2d8011a220 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.543+0000 7f2d84c86700 1 -- 172.21.15.154:0/3367004994 >> 172.21.15.154:0/3367004994 conn(0x7f2d8009bba0 msgr2=0x7f2d800656a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.543+0000 7f2d84c86700 1 -- 172.21.15.154:0/3367004994 shutdown_connections 2023-09-30T22:19:20.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:20.543+0000 7f2d84c86700 1 -- 172.21.15.154:0/3367004994 wait complete. 2023-09-30T22:19:20.558 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-30T22:19:20.558 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-30T22:19:20.662 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-09-30T22:19:20.662+0000 7f68966b9200 -1 Falling back to public interface 2023-09-30T22:19:20.779 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:20.779+0000 7f27b5409680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:19:20.927 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-09-30T22:19:20.927+0000 7f988778f200 -1 Falling back to public interface 2023-09-30T22:19:20.938 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-09-30T22:19:20.937+0000 7f2a99979200 -1 Falling back to public interface 2023-09-30T22:19:20.946 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-09-30T22:19:20.946+0000 7f8c22f15200 -1 Falling back to public interface 2023-09-30T22:19:20.953 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:20.953+0000 7f27b5409680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:19:20.961 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:21.023 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:21.022+0000 7f27b5409680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:19:21.071 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.071+0000 7fecc414a700 1 Processor -- start 2023-09-30T22:19:21.071 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.071+0000 7fecc414a700 1 -- start start 2023-09-30T22:19:21.073 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc414a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc0956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc414a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc091b10 0x7fecbc095be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc414a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecbc096ed0 con 0x7fecbc0960d0 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc414a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0933e0 con 0x7fecbc095310 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc414a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0938d0 con 0x7fecbc091b10 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc16e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc091b10 0x7fecbc095be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc1ee6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc0956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc1ee6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc0956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36124/0 (socket says 172.21.15.154:36124) 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc26e7700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fecbc0960d0 0x7fecbc12e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38872/0 (socket says 172.21.15.154:38872) 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc1ee6700 1 -- 172.21.15.154:0/1643533841 learned_addr learned my addr 172.21.15.154:0/1643533841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:21.074 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.072+0000 7fecc16e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc091b10 0x7fecbc095be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34606/0 (socket says 172.21.15.154:34606) 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc16e5700 1 -- 172.21.15.154:0/1643533841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 msgr2=0x7fecbc0956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc16e5700 1 --2- 172.21.15.154:0/1643533841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc0956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc16e5700 1 -- 172.21.15.154:0/1643533841 >> v1:172.21.15.154:6789/0 conn(0x7fecbc0960d0 legacy=0x7fecbc12e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc0ee4700 1 -- 172.21.15.154:0/1643533841 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607766622 0 0) 0x7fecbc096ed0 con 0x7fecbc0960d0 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc16e5700 1 -- 172.21.15.154:0/1643533841 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc092210 con 0x7fecbc091b10 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc1ee6700 1 --2- 172.21.15.154:0/1643533841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc0956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc16e5700 1 --2- 172.21.15.154:0/1643533841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc091b10 0x7fecbc095be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fecac009790 tx=0x7fecac009060).ready entity=mon.2 client_cookie=4e04a79aef1fa46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc0ee4700 1 -- 172.21.15.154:0/1643533841 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac0090d0 con 0x7fecbc091b10 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc0ee4700 1 -- 172.21.15.154:0/1643533841 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac00f510 con 0x7fecbc091b10 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.073+0000 7fecc0ee4700 1 -- 172.21.15.154:0/1643533841 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00f890 con 0x7fecbc091b10 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.074+0000 7fecc414a700 1 -- 172.21.15.154:0/1643533841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc091b10 msgr2=0x7fecbc095be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.075 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.074+0000 7fecc414a700 1 --2- 172.21.15.154:0/1643533841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc091b10 0x7fecbc095be0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fecac009790 tx=0x7fecac009060).stop 2023-09-30T22:19:21.076 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.074+0000 7fecc414a700 1 -- 172.21.15.154:0/1643533841 shutdown_connections 2023-09-30T22:19:21.076 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.074+0000 7fecc414a700 1 --2- 172.21.15.154:0/1643533841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc0956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:21.076 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.074+0000 7fecc414a700 1 --2- 172.21.15.154:0/1643533841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc091b10 0x7fecbc095be0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:21.076 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.074+0000 7fecc414a700 1 -- 172.21.15.154:0/1643533841 >> 172.21.15.154:0/1643533841 conn(0x7fecbc05ee70 msgr2=0x7fecbc097410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:21.076 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.074+0000 7fecc414a700 1 -- 172.21.15.154:0/1643533841 shutdown_connections 2023-09-30T22:19:21.076 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.074+0000 7fecc414a700 1 -- 172.21.15.154:0/1643533841 wait complete. 2023-09-30T22:19:21.078 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.075+0000 7fecc414a700 1 Processor -- start 2023-09-30T22:19:21.078 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.075+0000 7fecc414a700 1 -- start start 2023-09-30T22:19:21.078 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc414a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc137180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:21.078 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc414a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecbc0960d0 0x7fecbc137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:21.078 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc414a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc137b60 0x7fecbc117920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:21.078 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc414a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc092440 con 0x7fecbc0960d0 2023-09-30T22:19:21.078 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc414a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc066560 con 0x7fecbc095310 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc414a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc137f80 con 0x7fecbc137b60 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc1ee6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc16e5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecbc0960d0 0x7fecbc137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc1ee6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc137180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36134/0 (socket says 172.21.15.154:36134) 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc1ee6700 1 -- 172.21.15.154:0/3675719330 learned_addr learned my addr 172.21.15.154:0/3675719330 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc26e7700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc137b60 0x7fecbc117920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc16e5700 1 -- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc137b60 msgr2=0x7fecbc117920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc16e5700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc137b60 0x7fecbc117920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc16e5700 1 -- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 msgr2=0x7fecbc137180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc16e5700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc137180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:21.079 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc16e5700 1 -- 172.21.15.154:0/3675719330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb8009370 con 0x7fecbc0960d0 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc1ee6700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc137180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc26e7700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc137b60 0x7fecbc117920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc16e5700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecbc0960d0 0x7fecbc137670 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fecac014000 tx=0x7fecac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecb1ffb700 1 -- 172.21.15.154:0/3675719330 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac020070 con 0x7fecbc0960d0 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecb1ffb700 1 -- 172.21.15.154:0/3675719330 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac006910 con 0x7fecbc0960d0 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecc414a700 1 -- 172.21.15.154:0/3675719330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac0092a0 con 0x7fecbc0960d0 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.076+0000 7fecb1ffb700 1 -- 172.21.15.154:0/3675719330 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00fea0 con 0x7fecbc0960d0 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.077+0000 7fecc414a700 1 -- 172.21.15.154:0/3675719330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc11b540 con 0x7fecbc0960d0 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.077+0000 7fecb1ffb700 1 -- 172.21.15.154:0/3675719330 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fecac024880 con 0x7fecbc0960d0 2023-09-30T22:19:21.080 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.077+0000 7fecb1ffb700 1 -- 172.21.15.154:0/3675719330 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fecac011aa0 con 0x7fecbc0960d0 2023-09-30T22:19:21.081 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.080+0000 7fecc414a700 1 -- 172.21.15.154:0/3675719330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc09a040 con 0x7fecbc0960d0 2023-09-30T22:19:21.082 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.083+0000 7fecb1ffb700 1 -- 172.21.15.154:0/3675719330 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fecac024d60 con 0x7fecbc0960d0 2023-09-30T22:19:21.103 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:21.104+0000 7f27b5409680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:19:21.149 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.149+0000 7fecc414a700 1 -- 172.21.15.154:0/3675719330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecbc05a260 con 0x7fecbc0960d0 2023-09-30T22:19:21.149 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.150+0000 7fecb1ffb700 1 -- 172.21.15.154:0/3675719330 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fecac011590 con 0x7fecbc0960d0 2023-09-30T22:19:21.149 INFO:teuthology.misc.health.smithi154.stdout: 2023-09-30T22:19:21.150 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":6,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:20.288789+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:21.151 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.151+0000 7fecc414a700 1 -- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecbc0960d0 msgr2=0x7fecbc137670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:21.151 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.151+0000 7fecc414a700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecbc0960d0 0x7fecbc137670 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fecac014000 tx=0x7fecac017000).stop 2023-09-30T22:19:21.151 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.151+0000 7fecc414a700 1 -- 172.21.15.154:0/3675719330 shutdown_connections 2023-09-30T22:19:21.151 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.151+0000 7fecc414a700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecbc137b60 0x7fecbc117920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:21.151 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.151+0000 7fecc414a700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecbc095310 0x7fecbc137180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:21.151 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.151+0000 7fecc414a700 1 --2- 172.21.15.154:0/3675719330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecbc0960d0 0x7fecbc137670 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:21.151 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.151+0000 7fecc414a700 1 -- 172.21.15.154:0/3675719330 >> 172.21.15.154:0/3675719330 conn(0x7fecbc091b10 msgr2=0x7fecbc098720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:21.151 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.151+0000 7fecc414a700 1 -- 172.21.15.154:0/3675719330 shutdown_connections 2023-09-30T22:19:21.151 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:21.151+0000 7fecc414a700 1 -- 172.21.15.154:0/3675719330 wait complete. 2023-09-30T22:19:21.161 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-09-30T22:19:21.176 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:21.176+0000 7f27b5409680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:19:21.526 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:21.526+0000 7f27b5409680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:19:21.610 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:21.610+0000 7f27b5409680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:19:22.241 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:22.241+0000 7f27b5409680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:19:22.310 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:22.309+0000 7f27b5409680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:19:22.390 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:22.389+0000 7f27b5409680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:19:22.680 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:22.680+0000 7f27b5409680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:19:22.750 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:22.749+0000 7f27b5409680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:19:22.866 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:22.866+0000 7f27b5409680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:19:22.974 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:22.974+0000 7f27b5409680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:19:23.122 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:23.121+0000 7f27b5409680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:19:23.194 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:23.194+0000 7f27b5409680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:19:24.211 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-09-30T22:19:24.209+0000 7f68966b9200 -1 osd.0 0 log_to_monitors {default=true} 2023-09-30T22:19:24.216 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:24.215+0000 7f276be46700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T22:19:24.217 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:19:24.215+0000 7f276be46700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T22:19:24.428 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-09-30T22:19:24.428+0000 7f8c22f15200 -1 osd.2 0 log_to_monitors {default=true} 2023-09-30T22:19:24.473 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-09-30T22:19:24.473+0000 7f988778f200 -1 osd.1 0 log_to_monitors {default=true} 2023-09-30T22:19:24.478 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-09-30T22:19:24.477+0000 7f2a99979200 -1 osd.3 0 log_to_monitors {default=true} 2023-09-30T22:19:26.221 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-09-30T22:19:26.220+0000 7f8c198b6700 -1 osd.2 0 waiting for initial osdmap 2023-09-30T22:19:26.221 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-09-30T22:19:26.220+0000 7f688d05a700 -1 osd.0 0 waiting for initial osdmap 2023-09-30T22:19:26.223 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-09-30T22:19:26.223+0000 7f2a9031a700 -1 osd.3 0 waiting for initial osdmap 2023-09-30T22:19:26.224 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-09-30T22:19:26.224+0000 7f987e130700 -1 osd.1 0 waiting for initial osdmap 2023-09-30T22:19:26.226 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-09-30T22:19:26.225+0000 7f8c16032700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:19:26.228 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-09-30T22:19:26.227+0000 7f68897d6700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:19:26.229 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-09-30T22:19:26.228+0000 7f987a8ac700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:19:26.231 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-09-30T22:19:26.230+0000 7f2a8ca96700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:19:27.565 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:27.684 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.683+0000 7fc9ff12f700 1 Processor -- start 2023-09-30T22:19:27.684 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.683+0000 7fc9ff12f700 1 -- start start 2023-09-30T22:19:27.686 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9ff12f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9f80925c0 0x7fc9f812ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.686 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9ff12f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f812b6f0 0x7fc9f8127c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.686 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9ff12f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f80965d0 con 0x7fc9f812b270 2023-09-30T22:19:27.686 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9ff12f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f8091dc0 con 0x7fc9f80925c0 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9ff12f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f8096a20 con 0x7fc9f812b6f0 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9fd6cc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f812b6f0 0x7fc9f8127c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9fd6cc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f812b6f0 0x7fc9f8127c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36738/0 (socket says 172.21.15.154:36738) 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9fd6cc700 1 -- 172.21.15.154:0/3360338017 learned_addr learned my addr 172.21.15.154:0/3360338017 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9fcecb700 1 --2- 172.21.15.154:0/3360338017 >> v2:172.21.15.154:3300/0 conn(0x7fc9f80925c0 0x7fc9f812ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9fd6cc700 1 -- 172.21.15.154:0/3360338017 >> v2:172.21.15.154:3300/0 conn(0x7fc9f80925c0 msgr2=0x7fc9f812ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9fd6cc700 1 --2- 172.21.15.154:0/3360338017 >> v2:172.21.15.154:3300/0 conn(0x7fc9f80925c0 0x7fc9f812ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9fd6cc700 1 -- 172.21.15.154:0/3360338017 >> v1:172.21.15.154:6789/0 conn(0x7fc9f812b270 legacy=0x7fc9f8127550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.684+0000 7fc9fd6cc700 1 -- 172.21.15.154:0/3360338017 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8091b00 con 0x7fc9f812b6f0 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9fd6cc700 1 --2- 172.21.15.154:0/3360338017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f812b6f0 0x7fc9f8127c60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fc9f0009f20 tx=0x7fc9f0009840).ready entity=mon.1 client_cookie=105990760ed07688 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9f77fe700 1 -- 172.21.15.154:0/3360338017 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f000e070 con 0x7fc9f812b6f0 2023-09-30T22:19:27.687 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9f77fe700 1 -- 172.21.15.154:0/3360338017 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f000b9d0 con 0x7fc9f812b6f0 2023-09-30T22:19:27.688 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9f77fe700 1 -- 172.21.15.154:0/3360338017 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f000bd50 con 0x7fc9f812b6f0 2023-09-30T22:19:27.688 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3360338017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f812b6f0 msgr2=0x7fc9f8127c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.688 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9ff12f700 1 --2- 172.21.15.154:0/3360338017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f812b6f0 0x7fc9f8127c60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fc9f0009f20 tx=0x7fc9f0009840).stop 2023-09-30T22:19:27.688 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3360338017 shutdown_connections 2023-09-30T22:19:27.688 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9ff12f700 1 --2- 172.21.15.154:0/3360338017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f812b6f0 0x7fc9f8127c60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.688 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9ff12f700 1 --2- 172.21.15.154:0/3360338017 >> v2:172.21.15.154:3300/0 conn(0x7fc9f80925c0 0x7fc9f812ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.688 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3360338017 >> 172.21.15.154:0/3360338017 conn(0x7fc9f805ee70 msgr2=0x7fc9f8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.688 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3360338017 shutdown_connections 2023-09-30T22:19:27.688 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.685+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3360338017 wait complete. 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.686+0000 7fc9ff12f700 1 Processor -- start 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.686+0000 7fc9ff12f700 1 -- start start 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9ff12f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f812b270 0x7fc9f8114ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9ff12f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9f812b6f0 0x7fc9f80678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9ff12f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f8067dc0 0x7fc9f8068200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9ff12f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f8069460 con 0x7fc9f812b270 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9ff12f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f8068d30 con 0x7fc9f8067dc0 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9ff12f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f81116f0 con 0x7fc9f812b6f0 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fd6cc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f8067dc0 0x7fc9f8068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fd6cc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f8067dc0 0x7fc9f8068200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36754/0 (socket says 172.21.15.154:36754) 2023-09-30T22:19:27.691 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9f7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9f812b6f0 0x7fc9f80678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.693 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fcecb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f812b270 0x7fc9f8114ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.693 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fd6cc700 1 -- 172.21.15.154:0/3763868982 learned_addr learned my addr 172.21.15.154:0/3763868982 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:27.693 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fd6cc700 1 -- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9f812b6f0 msgr2=0x7fc9f80678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.693 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fd6cc700 1 --2- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9f812b6f0 0x7fc9f80678d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.693 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fd6cc700 1 -- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f812b270 msgr2=0x7fc9f8114ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.693 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fd6cc700 1 --2- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f812b270 0x7fc9f8114ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.693 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fd6cc700 1 -- 172.21.15.154:0/3763868982 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0009ae0 con 0x7fc9f8067dc0 2023-09-30T22:19:27.693 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fcecb700 1 --2- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f812b270 0x7fc9f8114ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9f7fff700 1 --2- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9f812b6f0 0x7fc9f80678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.687+0000 7fc9fd6cc700 1 --2- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f8067dc0 0x7fc9f8068200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fc9f000b610 tx=0x7fc9f0009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.688+0000 7fc9f4ff9700 1 -- 172.21.15.154:0/3763868982 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0007080 con 0x7fc9f8067dc0 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.688+0000 7fc9f4ff9700 1 -- 172.21.15.154:0/3763868982 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f00092e0 con 0x7fc9f8067dc0 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.688+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f80686f0 con 0x7fc9f8067dc0 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.688+0000 7fc9f4ff9700 1 -- 172.21.15.154:0/3763868982 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0007840 con 0x7fc9f8067dc0 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.688+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f8096c50 con 0x7fc9f8067dc0 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.688+0000 7fc9f4ff9700 1 -- 172.21.15.154:0/3763868982 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc9f0003040 con 0x7fc9f8067dc0 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.689+0000 7fc9f4ff9700 1 -- 172.21.15.154:0/3763868982 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7fc9f003c460 con 0x7fc9f8067dc0 2023-09-30T22:19:27.694 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.689+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f8111bd0 con 0x7fc9f8067dc0 2023-09-30T22:19:27.695 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.693+0000 7fc9f4ff9700 1 -- 172.21.15.154:0/3763868982 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc9f8111bd0 con 0x7fc9f8067dc0 2023-09-30T22:19:27.854 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.854+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9f8111bd0 con 0x7fc9f8067dc0 2023-09-30T22:19:27.855 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.854+0000 7fc9f4ff9700 1 -- 172.21.15.154:0/3763868982 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4968 (secure 0 0 0) 0x7fc9f8111bd0 con 0x7fc9f8067dc0 2023-09-30T22:19:27.855 INFO:teuthology.misc.health.smithi154.stdout: 2023-09-30T22:19:27.855 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":9,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:27.225292+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 >> v1:172.21.15.154:6816/118163 conn(0x7fc9dc02bb60 legacy=0x7fc9dc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f8067dc0 msgr2=0x7fc9f8068200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 --2- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f8067dc0 0x7fc9f8068200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fc9f000b610 tx=0x7fc9f0009840).stop 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 shutdown_connections 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 --2- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9f8067dc0 0x7fc9f8068200 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 --2- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f812b270 0x7fc9f8114ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 --2- 172.21.15.154:0/3763868982 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9f812b6f0 0x7fc9f80678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 >> 172.21.15.154:0/3763868982 conn(0x7fc9f80925c0 msgr2=0x7fc9f81288d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 shutdown_connections 2023-09-30T22:19:27.857 INFO:teuthology.misc.health.smithi154.stderr:2023-09-30T22:19:27.856+0000 7fc9ff12f700 1 -- 172.21.15.154:0/3763868982 wait complete. 2023-09-30T22:19:27.867 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-09-30T22:19:27.868 INFO:tasks.ceph:Creating RBD pool 2023-09-30T22:19:27.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-30T22:19:27.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.985+0000 7f285677c700 1 Processor -- start 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.985+0000 7f285677c700 1 -- start start 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.985+0000 7f285677c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2850062b00 0x7f2850095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.985+0000 7f285677c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850095b80 0x7f2850095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f285677c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2850091980 con 0x7f2850096490 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f285677c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28500973f0 con 0x7f2850062b00 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f285677c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2850062ee0 con 0x7f2850095b80 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850095b80 0x7f2850095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850095b80 0x7f2850095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52364/0 (socket says 172.21.15.154:52364) 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284f7fe700 1 -- 172.21.15.154:0/3447138119 learned_addr learned my addr 172.21.15.154:0/3447138119 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:27.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284ffff700 1 --2- 172.21.15.154:0/3447138119 >> v2:172.21.15.154:3300/0 conn(0x7f2850062b00 0x7f2850095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284effd700 1 -- 172.21.15.154:0/3447138119 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312218740 0 0) 0x7f2850091980 con 0x7f2850096490 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284f7fe700 1 -- 172.21.15.154:0/3447138119 >> v2:172.21.15.154:3300/0 conn(0x7f2850062b00 msgr2=0x7f2850095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284f7fe700 1 --2- 172.21.15.154:0/3447138119 >> v2:172.21.15.154:3300/0 conn(0x7f2850062b00 0x7f2850095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284f7fe700 1 -- 172.21.15.154:0/3447138119 >> v1:172.21.15.154:6789/0 conn(0x7f2850096490 legacy=0x7f2850131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284f7fe700 1 -- 172.21.15.154:0/3447138119 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850092310 con 0x7f2850095b80 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284f7fe700 1 --2- 172.21.15.154:0/3447138119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850095b80 0x7f2850095fa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2840009830 tx=0x7f28400090f0).ready entity=mon.2 client_cookie=477ed1950fe92401 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284effd700 1 -- 172.21.15.154:0/3447138119 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000b580 con 0x7f2850095b80 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284effd700 1 -- 172.21.15.154:0/3447138119 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284000b6e0 con 0x7f2850095b80 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.986+0000 7f284effd700 1 -- 172.21.15.154:0/3447138119 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000ba60 con 0x7f2850095b80 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.987+0000 7f285677c700 1 -- 172.21.15.154:0/3447138119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850095b80 msgr2=0x7f2850095fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.987+0000 7f285677c700 1 --2- 172.21.15.154:0/3447138119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850095b80 0x7f2850095fa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2840009830 tx=0x7f28400090f0).stop 2023-09-30T22:19:27.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.987+0000 7f285677c700 1 -- 172.21.15.154:0/3447138119 shutdown_connections 2023-09-30T22:19:27.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.987+0000 7f285677c700 1 --2- 172.21.15.154:0/3447138119 >> v2:172.21.15.154:3300/0 conn(0x7f2850062b00 0x7f2850095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.987+0000 7f285677c700 1 --2- 172.21.15.154:0/3447138119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850095b80 0x7f2850095fa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.987+0000 7f285677c700 1 -- 172.21.15.154:0/3447138119 >> 172.21.15.154:0/3447138119 conn(0x7f285009aa50 msgr2=0x7f285009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:27.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.987+0000 7f285677c700 1 -- 172.21.15.154:0/3447138119 shutdown_connections 2023-09-30T22:19:27.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.987+0000 7f285677c700 1 -- 172.21.15.154:0/3447138119 wait complete. 2023-09-30T22:19:27.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f285677c700 1 Processor -- start 2023-09-30T22:19:27.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f285677c700 1 -- start start 2023-09-30T22:19:27.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f285677c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2850062b00 0x7f2850115700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f285677c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2850095b80 0x7f2850115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f285677c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850096490 0x7f28501160e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:27.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f285677c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285012d7f0 con 0x7f2850062b00 2023-09-30T22:19:27.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f285677c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2850117ce0 con 0x7f2850095b80 2023-09-30T22:19:27.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f285677c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2850096dd0 con 0x7f2850096490 2023-09-30T22:19:27.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2850095b80 0x7f2850115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f284ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2850062b00 0x7f2850115700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f2854d19700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850096490 0x7f28501160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2850095b80 0x7f2850115bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36770/0 (socket says 172.21.15.154:36770) 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.988+0000 7f284f7fe700 1 -- 172.21.15.154:0/3816876937 learned_addr learned my addr 172.21.15.154:0/3816876937 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f284f7fe700 1 -- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850096490 msgr2=0x7f28501160e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f284f7fe700 1 --2- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850096490 0x7f28501160e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f284f7fe700 1 -- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2850062b00 msgr2=0x7f2850115700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f284f7fe700 1 --2- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2850062b00 0x7f2850115700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f284f7fe700 1 -- 172.21.15.154:0/3816876937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840009370 con 0x7f2850095b80 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f284ffff700 1 --2- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2850062b00 0x7f2850115700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f284f7fe700 1 --2- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2850095b80 0x7f2850115bf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f2840011000 tx=0x7f2840017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:27.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f2837fff700 1 -- 172.21.15.154:0/3816876937 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840000bc0 con 0x7f2850095b80 2023-09-30T22:19:27.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f2837fff700 1 -- 172.21.15.154:0/3816876937 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284000b850 con 0x7f2850095b80 2023-09-30T22:19:27.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f2837fff700 1 -- 172.21.15.154:0/3816876937 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840000d20 con 0x7f2850095b80 2023-09-30T22:19:27.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2850119150 con 0x7f2850095b80 2023-09-30T22:19:27.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.989+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28501199f0 con 0x7f2850095b80 2023-09-30T22:19:27.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.990+0000 7f2837fff700 1 -- 172.21.15.154:0/3816876937 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f284001ca90 con 0x7f2850095b80 2023-09-30T22:19:27.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.990+0000 7f2837fff700 1 -- 172.21.15.154:0/3816876937 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f284003c570 con 0x7f2850095b80 2023-09-30T22:19:27.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.990+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28501199f0 con 0x7f2850095b80 2023-09-30T22:19:27.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:27.994+0000 7f2837fff700 1 -- 172.21.15.154:0/3816876937 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f28501199f0 con 0x7f2850095b80 2023-09-30T22:19:28.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.151+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f28501199f0 con 0x7f2850095b80 2023-09-30T22:19:28.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.235+0000 7f2837fff700 1 -- 172.21.15.154:0/3816876937 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7f28501199f0 con 0x7f2850095b80 2023-09-30T22:19:28.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 >> v1:172.21.15.154:6816/118163 conn(0x7f283c02bb90 legacy=0x7f283c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2850095b80 msgr2=0x7f2850115bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 --2- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2850095b80 0x7f2850115bf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f2840011000 tx=0x7f2840017000).stop 2023-09-30T22:19:28.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 shutdown_connections 2023-09-30T22:19:28.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 --2- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2850096490 0x7f28501160e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:28.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 --2- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2850062b00 0x7f2850115700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:28.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 --2- 172.21.15.154:0/3816876937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2850095b80 0x7f2850115bf0 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0x7f2840011000 tx=0x7f2840017000).stop 2023-09-30T22:19:28.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 >> 172.21.15.154:0/3816876937 conn(0x7f285009aa50 msgr2=0x7f2850098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:28.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 shutdown_connections 2023-09-30T22:19:28.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.238+0000 7f285677c700 1 -- 172.21.15.154:0/3816876937 wait complete. 2023-09-30T22:19:28.240 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'rbd' created 2023-09-30T22:19:28.250 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-30T22:19:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc421f88700 1 Processor -- start 2023-09-30T22:19:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc421f88700 1 -- start start 2023-09-30T22:19:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc421f88700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc41c0923d0 0x7fc41c097ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc421f88700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c1276f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc421f88700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c0688f0 con 0x7fc41c123a20 2023-09-30T22:19:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc421f88700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c124a40 con 0x7fc41c0923d0 2023-09-30T22:19:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc421f88700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0919f0 con 0x7fc41c123e90 2023-09-30T22:19:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc41bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c1276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc41b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc41c0923d0 0x7fc41c097ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:28.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc41bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c1276f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36776/0 (socket says 172.21.15.154:36776) 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc41b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc41c0923d0 0x7fc41c097ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54596/0 (socket says 172.21.15.154:54596) 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc41bfff700 1 -- 172.21.15.154:0/2025893790 learned_addr learned my addr 172.21.15.154:0/2025893790 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.367+0000 7fc41affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc41c123a20 0x7fc41c126fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57266/0 (socket says 172.21.15.154:57266) 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc41a7fc700 1 -- 172.21.15.154:0/2025893790 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570753996 0 0) 0x7fc41c0688f0 con 0x7fc41c123a20 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc41bfff700 1 -- 172.21.15.154:0/2025893790 >> v2:172.21.15.154:3300/0 conn(0x7fc41c0923d0 msgr2=0x7fc41c097ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc41bfff700 1 --2- 172.21.15.154:0/2025893790 >> v2:172.21.15.154:3300/0 conn(0x7fc41c0923d0 0x7fc41c097ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc41bfff700 1 -- 172.21.15.154:0/2025893790 >> v1:172.21.15.154:6789/0 conn(0x7fc41c123a20 legacy=0x7fc41c126fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc41bfff700 1 -- 172.21.15.154:0/2025893790 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0927b0 con 0x7fc41c123e90 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc41bfff700 1 --2- 172.21.15.154:0/2025893790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c1276f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc414009f20 tx=0x7fc414009840).ready entity=mon.1 client_cookie=81914cf1ce6222c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc41a7fc700 1 -- 172.21.15.154:0/2025893790 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400e070 con 0x7fc41c123e90 2023-09-30T22:19:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc41a7fc700 1 -- 172.21.15.154:0/2025893790 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41400b9d0 con 0x7fc41c123e90 2023-09-30T22:19:28.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc41a7fc700 1 -- 172.21.15.154:0/2025893790 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400bd50 con 0x7fc41c123e90 2023-09-30T22:19:28.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc421f88700 1 -- 172.21.15.154:0/2025893790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 msgr2=0x7fc41c1276f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.368+0000 7fc421f88700 1 --2- 172.21.15.154:0/2025893790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c1276f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc414009f20 tx=0x7fc414009840).stop 2023-09-30T22:19:28.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.369+0000 7fc421f88700 1 -- 172.21.15.154:0/2025893790 shutdown_connections 2023-09-30T22:19:28.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.369+0000 7fc421f88700 1 --2- 172.21.15.154:0/2025893790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c1276f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:28.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.369+0000 7fc421f88700 1 --2- 172.21.15.154:0/2025893790 >> v2:172.21.15.154:3300/0 conn(0x7fc41c0923d0 0x7fc41c097ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:28.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.369+0000 7fc421f88700 1 -- 172.21.15.154:0/2025893790 >> 172.21.15.154:0/2025893790 conn(0x7fc41c063720 msgr2=0x7fc41c09a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:28.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.369+0000 7fc421f88700 1 -- 172.21.15.154:0/2025893790 shutdown_connections 2023-09-30T22:19:28.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.369+0000 7fc421f88700 1 -- 172.21.15.154:0/2025893790 wait complete. 2023-09-30T22:19:28.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.370+0000 7fc421f88700 1 Processor -- start 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.370+0000 7fc421f88700 1 -- start start 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc421f88700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc41c123a20 0x7fc41c096a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc421f88700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c110820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc421f88700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc41c110d10 0x7fc41c111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc421f88700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c111680 con 0x7fc41c123a20 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc421f88700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c1119c0 con 0x7fc41c123e90 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc421f88700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c112780 con 0x7fc41c110d10 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc41c123a20 0x7fc41c096a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc41c123a20 0x7fc41c096a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54608/0 (socket says 172.21.15.154:54608) 2023-09-30T22:19:28.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41b7fe700 1 -- 172.21.15.154:0/409026020 learned_addr learned my addr 172.21.15.154:0/409026020 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41bfff700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc41c110d10 0x7fc41c111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41affd700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c110820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41b7fe700 1 -- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc41c110d10 msgr2=0x7fc41c111190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41b7fe700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc41c110d10 0x7fc41c111190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41b7fe700 1 -- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 msgr2=0x7fc41c110820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41b7fe700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c110820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41b7fe700 1 -- 172.21.15.154:0/409026020 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc414009ae0 con 0x7fc41c123a20 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41affd700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc41b7fe700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc41c123a20 0x7fc41c096a40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc40c00e930 tx=0x7fc40c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc4037fe700 1 -- 172.21.15.154:0/409026020 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c012600 con 0x7fc41c123a20 2023-09-30T22:19:28.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc4037fe700 1 -- 172.21.15.154:0/409026020 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c012760 con 0x7fc41c123a20 2023-09-30T22:19:28.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c09a0a0 con 0x7fc41c123a20 2023-09-30T22:19:28.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc4037fe700 1 -- 172.21.15.154:0/409026020 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c012ae0 con 0x7fc41c123a20 2023-09-30T22:19:28.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.371+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c097460 con 0x7fc41c123a20 2023-09-30T22:19:28.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.372+0000 7fc4037fe700 1 -- 172.21.15.154:0/409026020 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc40c01b400 con 0x7fc41c123a20 2023-09-30T22:19:28.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.372+0000 7fc4037fe700 1 -- 172.21.15.154:0/409026020 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2803+0+0 (secure 0 0 0) 0x7fc40c03b170 con 0x7fc41c123a20 2023-09-30T22:19:28.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.372+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c05a260 con 0x7fc41c123a20 2023-09-30T22:19:28.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.377+0000 7fc4037fe700 1 -- 172.21.15.154:0/409026020 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc40c019900 con 0x7fc41c123a20 2023-09-30T22:19:28.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:28.537+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc41c046c20 con 0x7fc41c123a20 2023-09-30T22:19:29.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.239+0000 7fc4037fe700 1 -- 172.21.15.154:0/409026020 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc40c023350 con 0x7fc41c123a20 2023-09-30T22:19:29.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.242+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 >> v1:172.21.15.154:6816/118163 conn(0x7fc40802bb90 legacy=0x7fc40802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.242+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc41c123a20 msgr2=0x7fc41c096a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.242+0000 7fc421f88700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc41c123a20 0x7fc41c096a40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc40c00e930 tx=0x7fc40c009060).stop 2023-09-30T22:19:29.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.243+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 shutdown_connections 2023-09-30T22:19:29.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.243+0000 7fc421f88700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc41c110d10 0x7fc41c111190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.243+0000 7fc421f88700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc41c123a20 0x7fc41c096a40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.243+0000 7fc421f88700 1 --2- 172.21.15.154:0/409026020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc41c123e90 0x7fc41c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.243+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 >> 172.21.15.154:0/409026020 conn(0x7fc41c0923d0 msgr2=0x7fc41c1232d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.243+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 shutdown_connections 2023-09-30T22:19:29.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.243+0000 7fc421f88700 1 -- 172.21.15.154:0/409026020 wait complete. 2023-09-30T22:19:29.248 INFO:teuthology.orchestra.run.smithi154.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-30T22:19:29.258 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-30T22:19:29.259 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:19:29.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:19:29.262 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:19:29.262 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-30T22:19:29.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:29.339 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-09-30T22:19:29.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.385+0000 7fd37371d700 1 Processor -- start 2023-09-30T22:19:29.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.385+0000 7fd37371d700 1 -- start start 2023-09-30T22:19:29.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd37371d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c093950 0x7fd36c095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd37371d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd37371d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd36c12c240 0x7fd36c12e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd37371d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c094ba0 con 0x7fd36c12c240 2023-09-30T22:19:29.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd37371d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c092e90 con 0x7fd36c093950 2023-09-30T22:19:29.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd37371d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c096b60 con 0x7fd36c095c50 2023-09-30T22:19:29.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd370cb8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd3714b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c093950 0x7fd36c095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd371cba700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd36c12c240 0x7fd36c12e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd370cb8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52398/0 (socket says 172.21.15.154:52398) 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd3714b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c093950 0x7fd36c095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36802/0 (socket says 172.21.15.154:36802) 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd370cb8700 1 -- 172.21.15.154:0/3270119366 learned_addr learned my addr 172.21.15.154:0/3270119366 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd370cb8700 1 -- 172.21.15.154:0/3270119366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c093950 msgr2=0x7fd36c095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd370cb8700 1 --2- 172.21.15.154:0/3270119366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c093950 0x7fd36c095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd370cb8700 1 -- 172.21.15.154:0/3270119366 >> v2:172.21.15.154:3300/0 conn(0x7fd36c12c240 msgr2=0x7fd36c12e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd370cb8700 1 --2- 172.21.15.154:0/3270119366 >> v2:172.21.15.154:3300/0 conn(0x7fd36c12c240 0x7fd36c12e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd370cb8700 1 -- 172.21.15.154:0/3270119366 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c093150 con 0x7fd36c095c50 2023-09-30T22:19:29.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd371cba700 1 --2- 172.21.15.154:0/3270119366 >> v2:172.21.15.154:3300/0 conn(0x7fd36c12c240 0x7fd36c12e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd370cb8700 1 --2- 172.21.15.154:0/3270119366 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c096030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd368006fd0 tx=0x7fd3680090f0).ready entity=mon.2 client_cookie=212d7bf85d966304 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd363fff700 1 -- 172.21.15.154:0/3270119366 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800f510 con 0x7fd36c095c50 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd363fff700 1 -- 172.21.15.154:0/3270119366 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36800f670 con 0x7fd36c095c50 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.386+0000 7fd363fff700 1 -- 172.21.15.154:0/3270119366 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36800fa10 con 0x7fd36c095c50 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.387+0000 7fd37371d700 1 -- 172.21.15.154:0/3270119366 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 msgr2=0x7fd36c096030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.387+0000 7fd37371d700 1 --2- 172.21.15.154:0/3270119366 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c096030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd368006fd0 tx=0x7fd3680090f0).stop 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.387+0000 7fd37371d700 1 -- 172.21.15.154:0/3270119366 shutdown_connections 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.387+0000 7fd37371d700 1 --2- 172.21.15.154:0/3270119366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c093950 0x7fd36c095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.387+0000 7fd37371d700 1 --2- 172.21.15.154:0/3270119366 >> v2:172.21.15.154:3300/0 conn(0x7fd36c12c240 0x7fd36c12e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.387+0000 7fd37371d700 1 --2- 172.21.15.154:0/3270119366 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c096030 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.387+0000 7fd37371d700 1 -- 172.21.15.154:0/3270119366 >> 172.21.15.154:0/3270119366 conn(0x7fd36c09aa50 msgr2=0x7fd36c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.387+0000 7fd37371d700 1 -- 172.21.15.154:0/3270119366 shutdown_connections 2023-09-30T22:19:29.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.387+0000 7fd37371d700 1 -- 172.21.15.154:0/3270119366 wait complete. 2023-09-30T22:19:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd37371d700 1 Processor -- start 2023-09-30T22:19:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd37371d700 1 -- start start 2023-09-30T22:19:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd37371d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd36c093950 0x7fd36c116e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd37371d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c117370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd37371d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c12c240 0x7fd36c117860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd37371d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c117d50 con 0x7fd36c093950 2023-09-30T22:19:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd37371d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1182f0 con 0x7fd36c12c240 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd37371d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c11a410 con 0x7fd36c095c50 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd370cb8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c117370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.388+0000 7fd371cba700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c12c240 0x7fd36c117860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd371cba700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c12c240 0x7fd36c117860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36808/0 (socket says 172.21.15.154:36808) 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd370cb8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c117370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52404/0 (socket says 172.21.15.154:52404) 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd371cba700 1 -- 172.21.15.154:0/1779336131 learned_addr learned my addr 172.21.15.154:0/1779336131 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd3714b9700 1 --2- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd36c093950 0x7fd36c116e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd371cba700 1 -- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 msgr2=0x7fd36c117370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd371cba700 1 --2- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c117370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd371cba700 1 -- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd36c093950 msgr2=0x7fd36c116e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd371cba700 1 --2- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd36c093950 0x7fd36c116e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd371cba700 1 -- 172.21.15.154:0/1779336131 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364009a20 con 0x7fd36c12c240 2023-09-30T22:19:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd371cba700 1 --2- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c12c240 0x7fd36c117860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd364009fc0 tx=0x7fd36400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd3617fa700 1 -- 172.21.15.154:0/1779336131 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400cbd0 con 0x7fd36c12c240 2023-09-30T22:19:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd3617fa700 1 -- 172.21.15.154:0/1779336131 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36400f040 con 0x7fd36c12c240 2023-09-30T22:19:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd368009370 con 0x7fd36c12c240 2023-09-30T22:19:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd3617fa700 1 -- 172.21.15.154:0/1779336131 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364013400 con 0x7fd36c12c240 2023-09-30T22:19:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.389+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c092410 con 0x7fd36c12c240 2023-09-30T22:19:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.390+0000 7fd3617fa700 1 -- 172.21.15.154:0/1779336131 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd3640137b0 con 0x7fd36c12c240 2023-09-30T22:19:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.390+0000 7fd3617fa700 1 -- 172.21.15.154:0/1779336131 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd36403b570 con 0x7fd36c12c240 2023-09-30T22:19:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.390+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c11a8f0 con 0x7fd36c12c240 2023-09-30T22:19:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.395+0000 7fd3617fa700 1 -- 172.21.15.154:0/1779336131 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd36c11a8f0 con 0x7fd36c12c240 2023-09-30T22:19:29.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.553+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd36c11a8f0 con 0x7fd36c12c240 2023-09-30T22:19:29.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.553+0000 7fd3617fa700 1 -- 172.21.15.154:0/1779336131 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8182 (secure 0 0 0) 0x7fd36c11a8f0 con 0x7fd36c12c240 2023-09-30T22:19:29.554 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:29.554 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":11,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:29.232880+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:29.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 >> v1:172.21.15.154:6816/118163 conn(0x7fd35002bb60 legacy=0x7fd35002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c12c240 msgr2=0x7fd36c117860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 --2- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c12c240 0x7fd36c117860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd364009fc0 tx=0x7fd36400b040).stop 2023-09-30T22:19:29.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 shutdown_connections 2023-09-30T22:19:29.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 --2- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd36c12c240 0x7fd36c117860 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 --2- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd36c093950 0x7fd36c116e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 --2- 172.21.15.154:0/1779336131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd36c095c50 0x7fd36c117370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 >> 172.21.15.154:0/1779336131 conn(0x7fd36c09aa50 msgr2=0x7fd36c1110b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 shutdown_connections 2023-09-30T22:19:29.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.555+0000 7fd37371d700 1 -- 172.21.15.154:0/1779336131 wait complete. 2023-09-30T22:19:29.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:19:27.265135+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:19:28.184247+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:19:29.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:19:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f2879708700 1 Processor -- start 2023-09-30T22:19:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f2879708700 1 -- start start 2023-09-30T22:19:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f2879708700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28740985e0 0x7f28740989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f2879708700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2874098eb0 0x7f287412f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f2879708700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740964f0 con 0x7f287412f980 2023-09-30T22:19:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f2879708700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287409a3f0 con 0x7f2874098eb0 2023-09-30T22:19:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f2879708700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2874095100 con 0x7f28740985e0 2023-09-30T22:19:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f2872ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28740985e0 0x7f28740989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f28727fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2874098eb0 0x7f287412f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f28737fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f287412f980 0x7f2874131d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57282/0 (socket says 172.21.15.154:57282) 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.686+0000 7f28737fe700 1 -- 172.21.15.154:0/720441738 learned_addr learned my addr 172.21.15.154:0/720441738 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2871ffb700 1 -- 172.21.15.154:0/720441738 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254642413 0 0) 0x7f28740964f0 con 0x7f287412f980 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2872ffd700 1 -- 172.21.15.154:0/720441738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2874098eb0 msgr2=0x7f287412f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2872ffd700 1 --2- 172.21.15.154:0/720441738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2874098eb0 0x7f287412f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2872ffd700 1 -- 172.21.15.154:0/720441738 >> v1:172.21.15.154:6789/0 conn(0x7f287412f980 legacy=0x7f2874131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2872ffd700 1 -- 172.21.15.154:0/720441738 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874099e70 con 0x7f28740985e0 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f28727fc700 1 --2- 172.21.15.154:0/720441738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2874098eb0 0x7f287412f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2872ffd700 1 --2- 172.21.15.154:0/720441738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28740985e0 0x7f28740989c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f28680097c0 tx=0x7f2868009060).ready entity=mon.2 client_cookie=4591b2ceaa9ea926 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2871ffb700 1 -- 172.21.15.154:0/720441738 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680090d0 con 0x7f28740985e0 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2871ffb700 1 -- 172.21.15.154:0/720441738 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800f510 con 0x7f28740985e0 2023-09-30T22:19:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2871ffb700 1 -- 172.21.15.154:0/720441738 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800f890 con 0x7f28740985e0 2023-09-30T22:19:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2879708700 1 -- 172.21.15.154:0/720441738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28740985e0 msgr2=0x7f28740989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2879708700 1 --2- 172.21.15.154:0/720441738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28740985e0 0x7f28740989c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f28680097c0 tx=0x7f2868009060).stop 2023-09-30T22:19:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2879708700 1 -- 172.21.15.154:0/720441738 shutdown_connections 2023-09-30T22:19:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2879708700 1 --2- 172.21.15.154:0/720441738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28740985e0 0x7f28740989c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2879708700 1 --2- 172.21.15.154:0/720441738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2874098eb0 0x7f287412f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.687+0000 7f2879708700 1 -- 172.21.15.154:0/720441738 >> 172.21.15.154:0/720441738 conn(0x7f287409dc40 msgr2=0x7f287409e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.688+0000 7f2879708700 1 -- 172.21.15.154:0/720441738 shutdown_connections 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.688+0000 7f2879708700 1 -- 172.21.15.154:0/720441738 wait complete. 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.688+0000 7f2879708700 1 Processor -- start 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.688+0000 7f2879708700 1 -- start start 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f2879708700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28740985e0 0x7f287411e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f2879708700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874098eb0 0x7f287411a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f2879708700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f287412f980 0x7f287411a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f2879708700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287411cb10 con 0x7f2874098eb0 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f2879708700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287409a0f0 con 0x7f28740985e0 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f2879708700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f287411d9e0 con 0x7f287412f980 2023-09-30T22:19:29.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28727fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874098eb0 0x7f287411a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28727fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874098eb0 0x7f287411a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54656/0 (socket says 172.21.15.154:54656) 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28737fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f287412f980 0x7f287411a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28727fc700 1 -- 172.21.15.154:0/17580370 learned_addr learned my addr 172.21.15.154:0/17580370 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f2872ffd700 1 --2- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28740985e0 0x7f287411e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28727fc700 1 -- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f287412f980 msgr2=0x7f287411a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28727fc700 1 --2- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f287412f980 0x7f287411a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28727fc700 1 -- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28740985e0 msgr2=0x7f287411e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28727fc700 1 --2- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28740985e0 0x7f287411e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28727fc700 1 -- 172.21.15.154:0/17580370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640092a0 con 0x7f2874098eb0 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28737fe700 1 --2- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f287412f980 0x7f287411a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.689+0000 7f28727fc700 1 --2- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874098eb0 0x7f287411a450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f286400e9d0 tx=0x7f2864009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.690+0000 7f285affd700 1 -- 172.21.15.154:0/17580370 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400c6a0 con 0x7f2874098eb0 2023-09-30T22:19:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.690+0000 7f285affd700 1 -- 172.21.15.154:0/17580370 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286400c800 con 0x7f2874098eb0 2023-09-30T22:19:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.690+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28680092a0 con 0x7f2874098eb0 2023-09-30T22:19:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.690+0000 7f285affd700 1 -- 172.21.15.154:0/17580370 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400cb80 con 0x7f2874098eb0 2023-09-30T22:19:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.690+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287411b850 con 0x7f2874098eb0 2023-09-30T22:19:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.690+0000 7f285affd700 1 -- 172.21.15.154:0/17580370 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f286401b400 con 0x7f2874098eb0 2023-09-30T22:19:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.691+0000 7f285affd700 1 -- 172.21.15.154:0/17580370 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f286403b180 con 0x7f2874098eb0 2023-09-30T22:19:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.691+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287405a260 con 0x7f2874098eb0 2023-09-30T22:19:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.695+0000 7f285affd700 1 -- 172.21.15.154:0/17580370 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2864016030 con 0x7f2874098eb0 2023-09-30T22:19:29.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.854+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f28740661a0 con 0x7f2874098eb0 2023-09-30T22:19:29.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.854+0000 7f285affd700 1 -- 172.21.15.154:0/17580370 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v11) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2864019900 con 0x7f2874098eb0 2023-09-30T22:19:29.855 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-09-30T22:19:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 >> v1:172.21.15.154:6816/118163 conn(0x7f286002bb60 legacy=0x7f286002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874098eb0 msgr2=0x7f287411a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 --2- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874098eb0 0x7f287411a450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f286400e9d0 tx=0x7f2864009060).stop 2023-09-30T22:19:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 shutdown_connections 2023-09-30T22:19:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 --2- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f287412f980 0x7f287411a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 --2- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28740985e0 0x7f287411e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 --2- 172.21.15.154:0/17580370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874098eb0 0x7f287411a450 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 >> 172.21.15.154:0/17580370 conn(0x7f287409dc40 msgr2=0x7f287409d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 shutdown_connections 2023-09-30T22:19:29.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.856+0000 7f2879708700 1 -- 172.21.15.154:0/17580370 wait complete. 2023-09-30T22:19:29.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:19:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.986+0000 7f952718a700 1 Processor -- start 2023-09-30T22:19:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.986+0000 7f952718a700 1 -- start start 2023-09-30T22:19:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f952718a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520062b00 0x7f95201257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f952718a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9520125330 0x7f9520125cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f952718a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520093b90 0x7f9520094040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f952718a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9520062ee0 con 0x7f9520125330 2023-09-30T22:19:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f952718a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95200969c0 con 0x7f9520062b00 2023-09-30T22:19:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f952718a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9520095950 con 0x7f9520093b90 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f9524f26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520062b00 0x7f95201257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9520125330 0x7f9520125cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f9525727700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520093b90 0x7f9520094040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9520125330 0x7f9520125cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54672/0 (socket says 172.21.15.154:54672) 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f9524f26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520062b00 0x7f95201257c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36834/0 (socket says 172.21.15.154:36834) 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951ffff700 1 -- 172.21.15.154:0/2262161223 learned_addr learned my addr 172.21.15.154:0/2262161223 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f9525727700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520093b90 0x7f9520094040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52428/0 (socket says 172.21.15.154:52428) 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951ffff700 1 -- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520093b90 msgr2=0x7f9520094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951ffff700 1 --2- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520093b90 0x7f9520094040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951ffff700 1 -- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520062b00 msgr2=0x7f95201257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951ffff700 1 --2- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520062b00 0x7f95201257c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951ffff700 1 -- 172.21.15.154:0/2262161223 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95200635f0 con 0x7f9520125330 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f9525727700 1 --2- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520093b90 0x7f9520094040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951ffff700 1 --2- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520125330 0x7f9520125cb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f950c009830 tx=0x7f950c0090f0).ready entity=mon.0 client_cookie=d399396e12b14d55 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951f7fe700 1 -- 172.21.15.154:0/2262161223 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c00f510 con 0x7f9520125330 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951f7fe700 1 -- 172.21.15.154:0/2262161223 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c00f670 con 0x7f9520125330 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.987+0000 7f951f7fe700 1 -- 172.21.15.154:0/2262161223 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c00f9f0 con 0x7f9520125330 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.988+0000 7f952718a700 1 -- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520125330 msgr2=0x7f9520125cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.988+0000 7f952718a700 1 --2- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520125330 0x7f9520125cb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f950c009830 tx=0x7f950c0090f0).stop 2023-09-30T22:19:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.988+0000 7f952718a700 1 -- 172.21.15.154:0/2262161223 shutdown_connections 2023-09-30T22:19:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.988+0000 7f952718a700 1 --2- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520062b00 0x7f95201257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.988+0000 7f952718a700 1 --2- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520093b90 0x7f9520094040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.988+0000 7f952718a700 1 --2- 172.21.15.154:0/2262161223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520125330 0x7f9520125cb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.988+0000 7f952718a700 1 -- 172.21.15.154:0/2262161223 >> 172.21.15.154:0/2262161223 conn(0x7f952009aa50 msgr2=0x7f952009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.988+0000 7f952718a700 1 -- 172.21.15.154:0/2262161223 shutdown_connections 2023-09-30T22:19:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.988+0000 7f952718a700 1 -- 172.21.15.154:0/2262161223 wait complete. 2023-09-30T22:19:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f952718a700 1 Processor -- start 2023-09-30T22:19:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f952718a700 1 -- start start 2023-09-30T22:19:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f952718a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520062b00 0x7f95201382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f952718a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520093b90 0x7f95201387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f952718a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520067a80 0x7f9520067ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f952718a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9520124d00 con 0x7f9520093b90 2023-09-30T22:19:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f952718a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9520095b60 con 0x7f9520067a80 2023-09-30T22:19:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f952718a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952012d070 con 0x7f9520062b00 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f9524f26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520062b00 0x7f95201382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f9524f26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520062b00 0x7f95201382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52438/0 (socket says 172.21.15.154:52438) 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f9524f26700 1 -- 172.21.15.154:0/1063454188 learned_addr learned my addr 172.21.15.154:0/1063454188 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f9525727700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520067a80 0x7f9520067ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.989+0000 7f951ffff700 1 --2- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520093b90 0x7f95201387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f9524f26700 1 -- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520067a80 msgr2=0x7f9520067ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f9524f26700 1 --2- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520067a80 0x7f9520067ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f9524f26700 1 -- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520093b90 msgr2=0x7f95201387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f9524f26700 1 --2- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520093b90 0x7f95201387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f9524f26700 1 -- 172.21.15.154:0/1063454188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009a20 con 0x7f9520062b00 2023-09-30T22:19:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f9525727700 1 --2- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520067a80 0x7f9520067ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:29.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f9524f26700 1 --2- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520062b00 0x7f95201382e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f951400e960 tx=0x7f9514009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:29.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f951cff9700 1 -- 172.21.15.154:0/1063454188 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400c6a0 con 0x7f9520062b00 2023-09-30T22:19:29.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f951cff9700 1 -- 172.21.15.154:0/1063454188 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400c800 con 0x7f9520062b00 2023-09-30T22:19:29.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950c009370 con 0x7f9520062b00 2023-09-30T22:19:29.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f951cff9700 1 -- 172.21.15.154:0/1063454188 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400cb80 con 0x7f9520062b00 2023-09-30T22:19:29.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.990+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95200696a0 con 0x7f9520062b00 2023-09-30T22:19:29.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.991+0000 7f951cff9700 1 -- 172.21.15.154:0/1063454188 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f951401b400 con 0x7f9520062b00 2023-09-30T22:19:29.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.991+0000 7f951cff9700 1 -- 172.21.15.154:0/1063454188 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f951403b160 con 0x7f9520062b00 2023-09-30T22:19:29.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.991+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9520111c80 con 0x7f9520062b00 2023-09-30T22:19:29.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:29.996+0000 7f951cff9700 1 -- 172.21.15.154:0/1063454188 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9514019900 con 0x7f9520062b00 2023-09-30T22:19:30.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.151+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f952005a260 con 0x7f9520062b00 2023-09-30T22:19:30.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.152+0000 7f951cff9700 1 -- 172.21.15.154:0/1063454188 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v11) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9514023350 con 0x7f9520062b00 2023-09-30T22:19:30.153 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 8 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 >> v1:172.21.15.154:6816/118163 conn(0x7f950402bb90 legacy=0x7f950402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520062b00 msgr2=0x7f95201382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 --2- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520062b00 0x7f95201382e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f951400e960 tx=0x7f9514009060).stop 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 shutdown_connections 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 --2- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9520067a80 0x7f9520067ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 --2- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9520062b00 0x7f95201382e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 --2- 172.21.15.154:0/1063454188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9520093b90 0x7f95201387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 >> 172.21.15.154:0/1063454188 conn(0x7f952009aa50 msgr2=0x7f95201232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 shutdown_connections 2023-09-30T22:19:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.154+0000 7f952718a700 1 -- 172.21.15.154:0/1063454188 wait complete. 2023-09-30T22:19:30.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:19:30.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.287+0000 7f3c7f6c0700 1 Processor -- start 2023-09-30T22:19:30.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.287+0000 7f3c7f6c0700 1 -- start start 2023-09-30T22:19:30.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7f6c0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c78095e70 0x7f3c78096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7f6c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c7812d250 0x7f3c7812f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7f6c0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c78094ba0 con 0x7f3c78093950 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7f6c0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78092e90 con 0x7f3c78095e70 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7f6c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78096b60 con 0x7f3c7812d250 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7cc5b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c78095e70 0x7f3c78096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7d45c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3c78093950 0x7f3c78095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57284/0 (socket says 172.21.15.154:57284) 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7d45c700 1 -- 172.21.15.154:0/2685990575 learned_addr learned my addr 172.21.15.154:0/2685990575 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7dc5d700 1 --2- 172.21.15.154:0/2685990575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c7812d250 0x7f3c7812f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c6ffff700 1 -- 172.21.15.154:0/2685990575 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239592488 0 0) 0x7f3c78094ba0 con 0x7f3c78093950 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7dc5d700 1 -- 172.21.15.154:0/2685990575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c78095e70 msgr2=0x7f3c78096250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7dc5d700 1 --2- 172.21.15.154:0/2685990575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c78095e70 0x7f3c78096250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7dc5d700 1 -- 172.21.15.154:0/2685990575 >> v1:172.21.15.154:6789/0 conn(0x7f3c78093950 legacy=0x7f3c78095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7dc5d700 1 -- 172.21.15.154:0/2685990575 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78093150 con 0x7f3c7812d250 2023-09-30T22:19:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7cc5b700 1 --2- 172.21.15.154:0/2685990575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c78095e70 0x7f3c78096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c7dc5d700 1 --2- 172.21.15.154:0/2685990575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c7812d250 0x7f3c7812f640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3c70009e90 tx=0x7f3c70009780).ready entity=mon.2 client_cookie=58fbe5349f1bc232 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c6ffff700 1 -- 172.21.15.154:0/2685990575 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000e070 con 0x7f3c7812d250 2023-09-30T22:19:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c6ffff700 1 -- 172.21.15.154:0/2685990575 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7000bb60 con 0x7f3c7812d250 2023-09-30T22:19:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.288+0000 7f3c6ffff700 1 -- 172.21.15.154:0/2685990575 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70012410 con 0x7f3c7812d250 2023-09-30T22:19:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.289+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2685990575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c7812d250 msgr2=0x7f3c7812f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.289+0000 7f3c7f6c0700 1 --2- 172.21.15.154:0/2685990575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c7812d250 0x7f3c7812f640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3c70009e90 tx=0x7f3c70009780).stop 2023-09-30T22:19:30.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.289+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2685990575 shutdown_connections 2023-09-30T22:19:30.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.289+0000 7f3c7f6c0700 1 --2- 172.21.15.154:0/2685990575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c7812d250 0x7f3c7812f640 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.289+0000 7f3c7f6c0700 1 --2- 172.21.15.154:0/2685990575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c78095e70 0x7f3c78096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.289+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2685990575 >> 172.21.15.154:0/2685990575 conn(0x7f3c7809aa50 msgr2=0x7f3c7809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.289+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2685990575 shutdown_connections 2023-09-30T22:19:30.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.289+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2685990575 wait complete. 2023-09-30T22:19:30.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.290+0000 7f3c7f6c0700 1 Processor -- start 2023-09-30T22:19:30.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.290+0000 7f3c7f6c0700 1 -- start start 2023-09-30T22:19:30.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.290+0000 7f3c7f6c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c78093950 0x7f3c78116d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.290+0000 7f3c7f6c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c78095e70 0x7f3c78117200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7f6c0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c7812d250 0x7f3c781176f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7f6c0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7811a360 con 0x7f3c78093950 2023-09-30T22:19:30.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7f6c0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7812cc20 con 0x7f3c7812d250 2023-09-30T22:19:30.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7f6c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78119e10 con 0x7f3c78095e70 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7cc5b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c78095e70 0x7f3c78117200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7cc5b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c78095e70 0x7f3c78117200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52452/0 (socket says 172.21.15.154:52452) 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7dc5d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c7812d250 0x7f3c781176f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7cc5b700 1 -- 172.21.15.154:0/2796164651 learned_addr learned my addr 172.21.15.154:0/2796164651 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7d45c700 1 --2- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c78093950 0x7f3c78116d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7cc5b700 1 -- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c7812d250 msgr2=0x7f3c781176f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7cc5b700 1 --2- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c7812d250 0x7f3c781176f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7cc5b700 1 -- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c78093950 msgr2=0x7f3c78116d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7cc5b700 1 --2- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c78093950 0x7f3c78116d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7cc5b700 1 -- 172.21.15.154:0/2796164651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c740092a0 con 0x7f3c78095e70 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7dc5d700 1 --2- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c7812d250 0x7f3c781176f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7cc5b700 1 --2- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c78095e70 0x7f3c78117200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3c74010be0 tx=0x7f3c74009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c6d7fa700 1 -- 172.21.15.154:0/2796164651 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400eb30 con 0x7f3c78095e70 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c6d7fa700 1 -- 172.21.15.154:0/2796164651 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7400ec90 con 0x7f3c78095e70 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c70009a20 con 0x7f3c78095e70 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c6d7fa700 1 -- 172.21.15.154:0/2796164651 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7401a680 con 0x7f3c78095e70 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.291+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c78118740 con 0x7f3c78095e70 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.292+0000 7f3c6d7fa700 1 -- 172.21.15.154:0/2796164651 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3c74017070 con 0x7f3c78095e70 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.292+0000 7f3c6d7fa700 1 -- 172.21.15.154:0/2796164651 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f3c7403cf20 con 0x7f3c78095e70 2023-09-30T22:19:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.292+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7811a4a0 con 0x7f3c78095e70 2023-09-30T22:19:30.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.297+0000 7f3c6d7fa700 1 -- 172.21.15.154:0/2796164651 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3c7811a4a0 con 0x7f3c78095e70 2023-09-30T22:19:30.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.492+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c7811a4a0 con 0x7f3c78095e70 2023-09-30T22:19:30.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.492+0000 7f3c6d7fa700 1 -- 172.21.15.154:0/2796164651 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1198 (secure 0 0 0) 0x7f3c7811a4a0 con 0x7f3c78095e70 2023-09-30T22:19:30.493 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:30.493 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-09-30T22:19:30.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 >> v1:172.21.15.154:6816/118163 conn(0x7f3c5c02bb90 legacy=0x7f3c5c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c78095e70 msgr2=0x7f3c78117200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 --2- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c78095e70 0x7f3c78117200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3c74010be0 tx=0x7f3c74009060).stop 2023-09-30T22:19:30.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 shutdown_connections 2023-09-30T22:19:30.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 --2- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c7812d250 0x7f3c781176f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 --2- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c78093950 0x7f3c78116d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 --2- 172.21.15.154:0/2796164651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c78095e70 0x7f3c78117200 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 >> 172.21.15.154:0/2796164651 conn(0x7f3c7809aa50 msgr2=0x7f3c780692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 shutdown_connections 2023-09-30T22:19:30.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.494+0000 7f3c7f6c0700 1 -- 172.21.15.154:0/2796164651 wait complete. 2023-09-30T22:19:30.496 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 2 2023-09-30T22:19:30.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:30.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.621+0000 7fb71a87c700 1 Processor -- start 2023-09-30T22:19:30.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb71a87c700 1 -- start start 2023-09-30T22:19:30.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb71a87c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412a960 0x7fb71412cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb71a87c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb71412d240 0x7fb71412f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb71a87c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb714128510 con 0x7fb714128130 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb71a87c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb714091a80 con 0x7fb71412d240 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb71a87c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb714127f10 con 0x7fb71412a960 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412a960 0x7fb71412cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb718e19700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb71412d240 0x7fb71412f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412a960 0x7fb71412cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36874/0 (socket says 172.21.15.154:36874) 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb7137fe700 1 -- 172.21.15.154:0/2609044211 learned_addr learned my addr 172.21.15.154:0/2609044211 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb713fff700 1 --1- 172.21.15.154:0/2609044211 >> v1:172.21.15.154:6789/0 conn(0x7fb714128130 0x7fb714127500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57300/0 (socket says 172.21.15.154:57300) 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb718e19700 1 -- 172.21.15.154:0/2609044211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412a960 msgr2=0x7fb71412cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb718e19700 1 --2- 172.21.15.154:0/2609044211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412a960 0x7fb71412cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb718e19700 1 -- 172.21.15.154:0/2609044211 >> v1:172.21.15.154:6789/0 conn(0x7fb714128130 legacy=0x7fb714127500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb718e19700 1 -- 172.21.15.154:0/2609044211 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714092c50 con 0x7fb71412d240 2023-09-30T22:19:30.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb712ffd700 1 -- 172.21.15.154:0/2609044211 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665295279 0 0) 0x7fb714128510 con 0x7fb714128130 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.622+0000 7fb7137fe700 1 --2- 172.21.15.154:0/2609044211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412a960 0x7fb71412cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb718e19700 1 --2- 172.21.15.154:0/2609044211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71412d240 0x7fb71412f630 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb70c009e60 tx=0x7fb70c009780).ready entity=mon.0 client_cookie=eefeffa9128d2923 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb712ffd700 1 -- 172.21.15.154:0/2609044211 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00e070 con 0x7fb71412d240 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb712ffd700 1 -- 172.21.15.154:0/2609044211 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c00bb60 con 0x7fb71412d240 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb712ffd700 1 -- 172.21.15.154:0/2609044211 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c012410 con 0x7fb71412d240 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb71a87c700 1 -- 172.21.15.154:0/2609044211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71412d240 msgr2=0x7fb71412f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb71a87c700 1 --2- 172.21.15.154:0/2609044211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71412d240 0x7fb71412f630 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb70c009e60 tx=0x7fb70c009780).stop 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb71a87c700 1 -- 172.21.15.154:0/2609044211 shutdown_connections 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb71a87c700 1 --2- 172.21.15.154:0/2609044211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb71412d240 0x7fb71412f630 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb71a87c700 1 --2- 172.21.15.154:0/2609044211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412a960 0x7fb71412cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb71a87c700 1 -- 172.21.15.154:0/2609044211 >> 172.21.15.154:0/2609044211 conn(0x7fb7140973a0 msgr2=0x7fb7140977b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb71a87c700 1 -- 172.21.15.154:0/2609044211 shutdown_connections 2023-09-30T22:19:30.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.623+0000 7fb71a87c700 1 -- 172.21.15.154:0/2609044211 wait complete. 2023-09-30T22:19:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.624+0000 7fb71a87c700 1 Processor -- start 2023-09-30T22:19:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.624+0000 7fb71a87c700 1 -- start start 2023-09-30T22:19:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb71a87c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb714128130 0x7fb71406a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb71a87c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb71412a960 0x7fb7141229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb71a87c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412d240 0x7fb714122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb71a87c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71412cf20 con 0x7fb714128130 2023-09-30T22:19:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb71a87c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb714069740 con 0x7fb71412d240 2023-09-30T22:19:30.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb71a87c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb714115480 con 0x7fb71412a960 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb713fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb714128130 0x7fb71406a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb71412a960 0x7fb7141229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb71412a960 0x7fb7141229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52460/0 (socket says 172.21.15.154:52460) 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb718e19700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412d240 0x7fb714122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb713fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb714128130 0x7fb71406a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54710/0 (socket says 172.21.15.154:54710) 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb7137fe700 1 -- 172.21.15.154:0/777566713 learned_addr learned my addr 172.21.15.154:0/777566713 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb7137fe700 1 -- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412d240 msgr2=0x7fb714122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb7137fe700 1 --2- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412d240 0x7fb714122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb7137fe700 1 -- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb714128130 msgr2=0x7fb71406a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb7137fe700 1 --2- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb714128130 0x7fb71406a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb7137fe700 1 -- 172.21.15.154:0/777566713 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70400b610 con 0x7fb71412a960 2023-09-30T22:19:30.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb713fff700 1 --2- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb714128130 0x7fb71406a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb718e19700 1 --2- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412d240 0x7fb714122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb7137fe700 1 --2- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb71412a960 0x7fb7141229b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb70400ede0 tx=0x7fb70400b3b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb6fbfff700 1 -- 172.21.15.154:0/777566713 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70400eee0 con 0x7fb71412a960 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb6fbfff700 1 -- 172.21.15.154:0/777566713 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70400be00 con 0x7fb71412a960 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c009a20 con 0x7fb71412a960 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb6fbfff700 1 -- 172.21.15.154:0/777566713 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704010440 con 0x7fb71412a960 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.625+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb714123390 con 0x7fb71412a960 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.626+0000 7fb6fbfff700 1 -- 172.21.15.154:0/777566713 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb704010870 con 0x7fb71412a960 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.626+0000 7fb6fbfff700 1 -- 172.21.15.154:0/777566713 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fb70403af70 con 0x7fb71412a960 2023-09-30T22:19:30.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.627+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb714092e70 con 0x7fb71412a960 2023-09-30T22:19:30.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.631+0000 7fb6fbfff700 1 -- 172.21.15.154:0/777566713 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb70400f3d0 con 0x7fb71412a960 2023-09-30T22:19:30.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.789+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb71405a260 con 0x7fb71412a960 2023-09-30T22:19:30.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.790+0000 7fb6fbfff700 1 -- 172.21.15.154:0/777566713 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8156 (secure 0 0 0) 0x7fb704017e60 con 0x7fb71412a960 2023-09-30T22:19:30.791 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:30.791 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":12,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:30.239303+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:30.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 >> v1:172.21.15.154:6816/118163 conn(0x7fb70002bb60 legacy=0x7fb70002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb71412a960 msgr2=0x7fb7141229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 --2- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb71412a960 0x7fb7141229b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb70400ede0 tx=0x7fb70400b3b0).stop 2023-09-30T22:19:30.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 shutdown_connections 2023-09-30T22:19:30.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 --2- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb71412d240 0x7fb714122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 --2- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb714128130 0x7fb71406a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 --2- 172.21.15.154:0/777566713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb71412a960 0x7fb7141229b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 >> 172.21.15.154:0/777566713 conn(0x7fb7140973a0 msgr2=0x7fb71409a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 shutdown_connections 2023-09-30T22:19:30.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.792+0000 7fb71a87c700 1 -- 172.21.15.154:0/777566713 wait complete. 2023-09-30T22:19:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:19:27.265135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:19:28.184247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T22:19:30.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:19:30.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.922+0000 7fb6da2d3700 1 Processor -- start 2023-09-30T22:19:30.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.922+0000 7fb6da2d3700 1 -- start start 2023-09-30T22:19:30.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.923+0000 7fb6da2d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d4096810 0x7fb6d4096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.923+0000 7fb6da2d3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6d40970e0 0x7fb6d40974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.923+0000 7fb6da2d3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d40982f0 con 0x7fb6d40979b0 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.923+0000 7fb6da2d3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d4068550 con 0x7fb6d40970e0 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.923+0000 7fb6da2d3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4069e20 con 0x7fb6d4096810 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.923+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d4096810 0x7fb6d4096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.923+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d4096810 0x7fb6d4096bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52466/0 (socket says 172.21.15.154:52466) 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.923+0000 7fb6d37fe700 1 --2- 172.21.15.154:0/2846570752 >> v2:172.21.15.154:3300/0 conn(0x7fb6d40970e0 0x7fb6d40974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.923+0000 7fb6d3fff700 1 -- 172.21.15.154:0/2846570752 learned_addr learned my addr 172.21.15.154:0/2846570752 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d37fe700 1 -- 172.21.15.154:0/2846570752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d4096810 msgr2=0x7fb6d4096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d37fe700 1 --2- 172.21.15.154:0/2846570752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d4096810 0x7fb6d4096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d37fe700 1 -- 172.21.15.154:0/2846570752 >> v1:172.21.15.154:6789/0 conn(0x7fb6d40979b0 legacy=0x7fb6d412f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d37fe700 1 -- 172.21.15.154:0/2846570752 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4068f60 con 0x7fb6d40970e0 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d2ffd700 1 -- 172.21.15.154:0/2846570752 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165826635 0 0) 0x7fb6d40982f0 con 0x7fb6d40979b0 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d3fff700 1 --2- 172.21.15.154:0/2846570752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d4096810 0x7fb6d4096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d37fe700 1 --2- 172.21.15.154:0/2846570752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d40970e0 0x7fb6d40974c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb6bc009760 tx=0x7fb6bc009060).ready entity=mon.0 client_cookie=89ebb6607c787269 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d2ffd700 1 -- 172.21.15.154:0/2846570752 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0090d0 con 0x7fb6d40970e0 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d2ffd700 1 -- 172.21.15.154:0/2846570752 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc00f510 con 0x7fb6d40970e0 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6d2ffd700 1 -- 172.21.15.154:0/2846570752 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00f890 con 0x7fb6d40970e0 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6da2d3700 1 -- 172.21.15.154:0/2846570752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d40970e0 msgr2=0x7fb6d40974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.924+0000 7fb6da2d3700 1 --2- 172.21.15.154:0/2846570752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d40970e0 0x7fb6d40974c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb6bc009760 tx=0x7fb6bc009060).stop 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.925+0000 7fb6da2d3700 1 -- 172.21.15.154:0/2846570752 shutdown_connections 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.925+0000 7fb6da2d3700 1 --2- 172.21.15.154:0/2846570752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d4096810 0x7fb6d4096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.925+0000 7fb6da2d3700 1 --2- 172.21.15.154:0/2846570752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d40970e0 0x7fb6d40974c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.925+0000 7fb6da2d3700 1 -- 172.21.15.154:0/2846570752 >> 172.21.15.154:0/2846570752 conn(0x7fb6d409bad0 msgr2=0x7fb6d409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:30.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.925+0000 7fb6da2d3700 1 -- 172.21.15.154:0/2846570752 shutdown_connections 2023-09-30T22:19:30.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.925+0000 7fb6da2d3700 1 -- 172.21.15.154:0/2846570752 wait complete. 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.926+0000 7fb6da2d3700 1 Processor -- start 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.926+0000 7fb6da2d3700 1 -- start start 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.926+0000 7fb6da2d3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d4096810 0x7fb6d4137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.926+0000 7fb6da2d3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6d40970e0 0x7fb6d4138420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6da2d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d40979b0 0x7fb6d4138910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6da2d3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d411bca0 con 0x7fb6d4096810 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6da2d3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d4091ce0 con 0x7fb6d40970e0 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6da2d3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d406a040 con 0x7fb6d40979b0 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d4096810 0x7fb6d4137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d4096810 0x7fb6d4137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54724/0 (socket says 172.21.15.154:54724) 2023-09-30T22:19:30.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d3fff700 1 -- 172.21.15.154:0/3516383175 learned_addr learned my addr 172.21.15.154:0/3516383175 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d8870700 1 --2- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d40979b0 0x7fb6d4138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d37fe700 1 --2- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6d40970e0 0x7fb6d4138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d3fff700 1 -- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d40979b0 msgr2=0x7fb6d4138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d3fff700 1 --2- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d40979b0 0x7fb6d4138910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d3fff700 1 -- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6d40970e0 msgr2=0x7fb6d4138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d3fff700 1 --2- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6d40970e0 0x7fb6d4138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d3fff700 1 -- 172.21.15.154:0/3516383175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009370 con 0x7fb6d4096810 2023-09-30T22:19:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6d3fff700 1 --2- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d4096810 0x7fb6d4137f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb6c400ea50 tx=0x7fb6c40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6cbfff700 1 -- 172.21.15.154:0/3516383175 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400ee90 con 0x7fb6d4096810 2023-09-30T22:19:30.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6cbfff700 1 -- 172.21.15.154:0/3516383175 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400c850 con 0x7fb6d4096810 2023-09-30T22:19:30.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc0092a0 con 0x7fb6d4096810 2023-09-30T22:19:30.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6cbfff700 1 -- 172.21.15.154:0/3516383175 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400cbd0 con 0x7fb6d4096810 2023-09-30T22:19:30.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.927+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d411c4b0 con 0x7fb6d4096810 2023-09-30T22:19:30.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.928+0000 7fb6cbfff700 1 -- 172.21.15.154:0/3516383175 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb6c401b400 con 0x7fb6d4096810 2023-09-30T22:19:30.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.928+0000 7fb6cbfff700 1 -- 172.21.15.154:0/3516383175 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fb6c403afd0 con 0x7fb6d4096810 2023-09-30T22:19:30.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.928+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d411c4b0 con 0x7fb6d4096810 2023-09-30T22:19:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:30.933+0000 7fb6cbfff700 1 -- 172.21.15.154:0/3516383175 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb6d411c4b0 con 0x7fb6d4096810 2023-09-30T22:19:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.090+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb6d411c4b0 con 0x7fb6d4096810 2023-09-30T22:19:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.090+0000 7fb6cbfff700 1 -- 172.21.15.154:0/3516383175 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb6d411c4b0 con 0x7fb6d4096810 2023-09-30T22:19:31.091 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-09-30T22:19:31.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 >> v1:172.21.15.154:6816/118163 conn(0x7fb6b402bb60 legacy=0x7fb6b402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d4096810 msgr2=0x7fb6d4137f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 --2- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d4096810 0x7fb6d4137f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb6c400ea50 tx=0x7fb6c40090f0).stop 2023-09-30T22:19:31.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 shutdown_connections 2023-09-30T22:19:31.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 --2- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6d40979b0 0x7fb6d4138910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 --2- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d4096810 0x7fb6d4137f30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 --2- 172.21.15.154:0/3516383175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6d40970e0 0x7fb6d4138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 >> 172.21.15.154:0/3516383175 conn(0x7fb6d409bad0 msgr2=0x7fb6d4112130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 shutdown_connections 2023-09-30T22:19:31.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.092+0000 7fb6da2d3700 1 -- 172.21.15.154:0/3516383175 wait complete. 2023-09-30T22:19:31.104 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:19:31.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8098f0700 1 Processor -- start 2023-09-30T22:19:31.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8098f0700 1 -- start start 2023-09-30T22:19:31.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8098f0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8040977b0 0x7fd804127c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8098f0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd80412aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8098f0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd80412af40 0x7fd80412b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8098f0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd804097b90 con 0x7fd8040977b0 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8098f0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd804065d80 con 0x7fd8041280f0 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8098f0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd80412b8e0 con 0x7fd80412af40 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd802ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8040977b0 0x7fd804127c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8037fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd80412af40 0x7fd80412b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8027fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd80412aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8037fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd80412af40 0x7fd80412b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52474/0 (socket says 172.21.15.154:52474) 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd802ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8040977b0 0x7fd804127c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54730/0 (socket says 172.21.15.154:54730) 2023-09-30T22:19:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.223+0000 7fd8037fe700 1 -- 172.21.15.154:0/3831516162 learned_addr learned my addr 172.21.15.154:0/3831516162 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8037fe700 1 -- 172.21.15.154:0/3831516162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 msgr2=0x7fd80412aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8037fe700 1 --2- 172.21.15.154:0/3831516162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd80412aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8037fe700 1 -- 172.21.15.154:0/3831516162 >> v2:172.21.15.154:3300/0 conn(0x7fd8040977b0 msgr2=0x7fd804127c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8037fe700 1 --2- 172.21.15.154:0/3831516162 >> v2:172.21.15.154:3300/0 conn(0x7fd8040977b0 0x7fd804127c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8037fe700 1 -- 172.21.15.154:0/3831516162 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8041279b0 con 0x7fd80412af40 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd802ffd700 1 --2- 172.21.15.154:0/3831516162 >> v2:172.21.15.154:3300/0 conn(0x7fd8040977b0 0x7fd804127c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8037fe700 1 --2- 172.21.15.154:0/3831516162 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd80412af40 0x7fd80412b3f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd7fc009f20 tx=0x7fd7fc009840).ready entity=mon.2 client_cookie=3a90d79b0c33632d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd801ffb700 1 -- 172.21.15.154:0/3831516162 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00e070 con 0x7fd80412af40 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd801ffb700 1 -- 172.21.15.154:0/3831516162 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc00b970 con 0x7fd80412af40 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd801ffb700 1 -- 172.21.15.154:0/3831516162 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00bcf0 con 0x7fd80412af40 2023-09-30T22:19:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8098f0700 1 -- 172.21.15.154:0/3831516162 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd80412af40 msgr2=0x7fd80412b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8098f0700 1 --2- 172.21.15.154:0/3831516162 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd80412af40 0x7fd80412b3f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd7fc009f20 tx=0x7fd7fc009840).stop 2023-09-30T22:19:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8098f0700 1 -- 172.21.15.154:0/3831516162 shutdown_connections 2023-09-30T22:19:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8098f0700 1 --2- 172.21.15.154:0/3831516162 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd80412af40 0x7fd80412b3f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8098f0700 1 --2- 172.21.15.154:0/3831516162 >> v2:172.21.15.154:3300/0 conn(0x7fd8040977b0 0x7fd804127c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8098f0700 1 --2- 172.21.15.154:0/3831516162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd80412aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.224+0000 7fd8098f0700 1 -- 172.21.15.154:0/3831516162 >> 172.21.15.154:0/3831516162 conn(0x7fd80409bad0 msgr2=0x7fd80409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.225+0000 7fd8098f0700 1 -- 172.21.15.154:0/3831516162 shutdown_connections 2023-09-30T22:19:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.225+0000 7fd8098f0700 1 -- 172.21.15.154:0/3831516162 wait complete. 2023-09-30T22:19:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.225+0000 7fd8098f0700 1 Processor -- start 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8098f0700 1 -- start start 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8098f0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8040977b0 0x7fd804115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8098f0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd804116190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8098f0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80412af40 0x7fd804116680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8098f0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804065150 con 0x7fd80412af40 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8098f0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd804118db0 con 0x7fd8041280f0 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8098f0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd804118af0 con 0x7fd8040977b0 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd802ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8040977b0 0x7fd804115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8027fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd804116190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd802ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8040977b0 0x7fd804115ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52480/0 (socket says 172.21.15.154:52480) 2023-09-30T22:19:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8037fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80412af40 0x7fd804116680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8027fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd804116190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36908/0 (socket says 172.21.15.154:36908) 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd802ffd700 1 -- 172.21.15.154:0/1657489272 learned_addr learned my addr 172.21.15.154:0/1657489272 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd802ffd700 1 -- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 msgr2=0x7fd804116190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd802ffd700 1 --2- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd804116190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd802ffd700 1 -- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80412af40 msgr2=0x7fd804116680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd802ffd700 1 --2- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80412af40 0x7fd804116680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd802ffd700 1 -- 172.21.15.154:0/1657489272 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f40092a0 con 0x7fd8040977b0 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd8027fc700 1 --2- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd804116190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.226+0000 7fd802ffd700 1 --2- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8040977b0 0x7fd804115ca0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd7f400ea20 tx=0x7fd7f4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.227+0000 7fd7eaffd700 1 -- 172.21.15.154:0/1657489272 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400ee60 con 0x7fd8040977b0 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.227+0000 7fd7eaffd700 1 -- 172.21.15.154:0/1657489272 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f400c850 con 0x7fd8040977b0 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.227+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc009ae0 con 0x7fd8040977b0 2023-09-30T22:19:31.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.227+0000 7fd7eaffd700 1 -- 172.21.15.154:0/1657489272 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400cbd0 con 0x7fd8040977b0 2023-09-30T22:19:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.227+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd804119930 con 0x7fd8040977b0 2023-09-30T22:19:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.227+0000 7fd7eaffd700 1 -- 172.21.15.154:0/1657489272 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd7f401b400 con 0x7fd8040977b0 2023-09-30T22:19:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.227+0000 7fd7eaffd700 1 -- 172.21.15.154:0/1657489272 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd7f403afa0 con 0x7fd8040977b0 2023-09-30T22:19:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.228+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd804119930 con 0x7fd8040977b0 2023-09-30T22:19:31.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.232+0000 7fd7eaffd700 1 -- 172.21.15.154:0/1657489272 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd804119930 con 0x7fd8040977b0 2023-09-30T22:19:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.390+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd804119930 con 0x7fd8040977b0 2023-09-30T22:19:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.390+0000 7fd7eaffd700 1 -- 172.21.15.154:0/1657489272 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd804119930 con 0x7fd8040977b0 2023-09-30T22:19:31.391 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 8 2023-09-30T22:19:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 >> v1:172.21.15.154:6816/118163 conn(0x7fd7f002bb90 legacy=0x7fd7f002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8040977b0 msgr2=0x7fd804115ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 --2- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8040977b0 0x7fd804115ca0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd7f400ea20 tx=0x7fd7f4009060).stop 2023-09-30T22:19:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 shutdown_connections 2023-09-30T22:19:31.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 --2- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80412af40 0x7fd804116680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 --2- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8040977b0 0x7fd804115ca0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 --2- 172.21.15.154:0/1657489272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8041280f0 0x7fd804116190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 >> 172.21.15.154:0/1657489272 conn(0x7fd80409bad0 msgr2=0x7fd804069790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 shutdown_connections 2023-09-30T22:19:31.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.392+0000 7fd8098f0700 1 -- 172.21.15.154:0/1657489272 wait complete. 2023-09-30T22:19:31.404 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T22:19:31.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.519+0000 7f2f01db2700 1 Processor -- start 2023-09-30T22:19:31.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.519+0000 7f2f01db2700 1 -- start start 2023-09-30T22:19:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.519+0000 7f2f01db2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc062b00 0x7f2efc1257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.519+0000 7f2f01db2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2f01db2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc095950 con 0x7f2efc125330 2023-09-30T22:19:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2f01db2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc062ee0 con 0x7f2efc12dc50 2023-09-30T22:19:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2f01db2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0969c0 con 0x7f2efc062b00 2023-09-30T22:19:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc062b00 0x7f2efc1257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efaffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2efc125330 0x7f2efc125cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57330/0 (socket says 172.21.15.154:57330) 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efaffd700 1 -- 172.21.15.154:0/3044301337 learned_addr learned my addr 172.21.15.154:0/3044301337 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efa7fc700 1 -- 172.21.15.154:0/3044301337 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379538228 0 0) 0x7f2efc095950 con 0x7f2efc125330 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efbfff700 1 -- 172.21.15.154:0/3044301337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc062b00 msgr2=0x7f2efc1257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efbfff700 1 --2- 172.21.15.154:0/3044301337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc062b00 0x7f2efc1257c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efbfff700 1 -- 172.21.15.154:0/3044301337 >> v1:172.21.15.154:6789/0 conn(0x7f2efc125330 legacy=0x7f2efc125cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efbfff700 1 -- 172.21.15.154:0/3044301337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0635f0 con 0x7f2efc12dc50 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efb7fe700 1 --2- 172.21.15.154:0/3044301337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc062b00 0x7f2efc1257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efbfff700 1 --2- 172.21.15.154:0/3044301337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc130040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2ef400f330 tx=0x7f2ef400db90).ready entity=mon.1 client_cookie=a69b40b61b008eb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efa7fc700 1 -- 172.21.15.154:0/3044301337 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4012070 con 0x7f2efc12dc50 2023-09-30T22:19:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efa7fc700 1 -- 172.21.15.154:0/3044301337 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400d0d0 con 0x7f2efc12dc50 2023-09-30T22:19:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.520+0000 7f2efa7fc700 1 -- 172.21.15.154:0/3044301337 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400d450 con 0x7f2efc12dc50 2023-09-30T22:19:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.521+0000 7f2f01db2700 1 -- 172.21.15.154:0/3044301337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 msgr2=0x7f2efc130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.521+0000 7f2f01db2700 1 --2- 172.21.15.154:0/3044301337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc130040 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2ef400f330 tx=0x7f2ef400db90).stop 2023-09-30T22:19:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.521+0000 7f2f01db2700 1 -- 172.21.15.154:0/3044301337 shutdown_connections 2023-09-30T22:19:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.521+0000 7f2f01db2700 1 --2- 172.21.15.154:0/3044301337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc130040 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.521+0000 7f2f01db2700 1 --2- 172.21.15.154:0/3044301337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc062b00 0x7f2efc1257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.521+0000 7f2f01db2700 1 -- 172.21.15.154:0/3044301337 >> 172.21.15.154:0/3044301337 conn(0x7f2efc09aa50 msgr2=0x7f2efc09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.521+0000 7f2f01db2700 1 -- 172.21.15.154:0/3044301337 shutdown_connections 2023-09-30T22:19:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.521+0000 7f2f01db2700 1 -- 172.21.15.154:0/3044301337 wait complete. 2023-09-30T22:19:31.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2f01db2700 1 Processor -- start 2023-09-30T22:19:31.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2f01db2700 1 -- start start 2023-09-30T22:19:31.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2f01db2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc062b00 0x7f2efc069070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2f01db2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2f01db2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc069a50 0x7f2efc12c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2f01db2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc12b490 con 0x7f2efc062b00 2023-09-30T22:19:31.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2f01db2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc129e10 con 0x7f2efc12dc50 2023-09-30T22:19:31.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2f01db2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc098880 con 0x7f2efc069a50 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc062b00 0x7f2efc069070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2efaffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2efbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc069a50 0x7f2efc12c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc062b00 0x7f2efc069070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54738/0 (socket says 172.21.15.154:54738) 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.522+0000 7f2efb7fe700 1 -- 172.21.15.154:0/2295710485 learned_addr learned my addr 172.21.15.154:0/2295710485 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2efbfff700 1 -- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 msgr2=0x7f2efc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2efbfff700 1 --2- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2efbfff700 1 -- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc062b00 msgr2=0x7f2efc069070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2efbfff700 1 --2- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc062b00 0x7f2efc069070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2efbfff700 1 -- 172.21.15.154:0/2295710485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00092a0 con 0x7f2efc069a50 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2efb7fe700 1 --2- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc062b00 0x7f2efc069070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2efaffd700 1 --2- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2efbfff700 1 --2- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc069a50 0x7f2efc12c350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2efc096db0 tx=0x7f2ef400db90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2ee37fe700 1 -- 172.21.15.154:0/2295710485 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400be90 con 0x7f2efc069a50 2023-09-30T22:19:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2ee37fe700 1 -- 172.21.15.154:0/2295710485 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400d850 con 0x7f2efc069a50 2023-09-30T22:19:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef400de30 con 0x7f2efc069a50 2023-09-30T22:19:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2ee37fe700 1 -- 172.21.15.154:0/2295710485 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4017d50 con 0x7f2efc069a50 2023-09-30T22:19:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.523+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc12a050 con 0x7f2efc069a50 2023-09-30T22:19:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.524+0000 7f2ee37fe700 1 -- 172.21.15.154:0/2295710485 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2ef4003040 con 0x7f2efc069a50 2023-09-30T22:19:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.524+0000 7f2ee37fe700 1 -- 172.21.15.154:0/2295710485 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f2ef40408e0 con 0x7f2efc069a50 2023-09-30T22:19:31.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.524+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc12b2d0 con 0x7f2efc069a50 2023-09-30T22:19:31.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.528+0000 7f2ee37fe700 1 -- 172.21.15.154:0/2295710485 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2ef4028080 con 0x7f2efc069a50 2023-09-30T22:19:31.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.689+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2efc05a260 con 0x7f2efc069a50 2023-09-30T22:19:31.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.689+0000 7f2ee37fe700 1 -- 172.21.15.154:0/2295710485 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2ef4015db0 con 0x7f2efc069a50 2023-09-30T22:19:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:31.690 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-09-30T22:19:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:19:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-09-30T22:19:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": "device_health_metrics" 2023-09-30T22:19:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:19:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:19:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 2, 2023-09-30T22:19:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": "rbd" 2023-09-30T22:19:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:19:31.691 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-09-30T22:19:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 >> v1:172.21.15.154:6816/118163 conn(0x7f2ee802bb60 legacy=0x7f2ee802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc069a50 msgr2=0x7f2efc12c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 --2- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc069a50 0x7f2efc12c350 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f2efc096db0 tx=0x7f2ef400db90).stop 2023-09-30T22:19:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 shutdown_connections 2023-09-30T22:19:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 --2- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2efc069a50 0x7f2efc12c350 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 --2- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc062b00 0x7f2efc069070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 --2- 172.21.15.154:0/2295710485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2efc12dc50 0x7f2efc069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 >> 172.21.15.154:0/2295710485 conn(0x7f2efc09aa50 msgr2=0x7f2efc1232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 shutdown_connections 2023-09-30T22:19:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.691+0000 7f2f01db2700 1 -- 172.21.15.154:0/2295710485 wait complete. 2023-09-30T22:19:31.703 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T22:19:31.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T22:19:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.823+0000 7f31ad588700 1 Processor -- start 2023-09-30T22:19:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.823+0000 7f31ad588700 1 -- start start 2023-09-30T22:19:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.823+0000 7f31ad588700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31a8065600 0x7f31a80986b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.823+0000 7f31ad588700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8097bb0 0x7f31a8098ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31ad588700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a8099520 con 0x7f31a8099090 2023-09-30T22:19:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31ad588700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a80659e0 con 0x7f31a8065600 2023-09-30T22:19:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31ad588700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a809a4d0 con 0x7f31a8097bb0 2023-09-30T22:19:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8097bb0 0x7f31a8098ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31a8065600 0x7f31a80986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f31a8099090 0x7f31a81314b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57338/0 (socket says 172.21.15.154:57338) 2023-09-30T22:19:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a77fe700 1 -- 172.21.15.154:0/2940357648 learned_addr learned my addr 172.21.15.154:0/2940357648 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a67fc700 1 -- 172.21.15.154:0/2940357648 >> v2:172.21.15.154:3300/0 conn(0x7f31a8065600 msgr2=0x7f31a80986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a67fc700 1 --2- 172.21.15.154:0/2940357648 >> v2:172.21.15.154:3300/0 conn(0x7f31a8065600 0x7f31a80986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a67fc700 1 -- 172.21.15.154:0/2940357648 >> v1:172.21.15.154:6789/0 conn(0x7f31a8099090 legacy=0x7f31a81314b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a5ffb700 1 -- 172.21.15.154:0/2940357648 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163332294 0 0) 0x7f31a0001490 con 0x7f31a8099090 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a67fc700 1 -- 172.21.15.154:0/2940357648 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8066100 con 0x7f31a8097bb0 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a6ffd700 1 --2- 172.21.15.154:0/2940357648 >> v2:172.21.15.154:3300/0 conn(0x7f31a8065600 0x7f31a80986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a67fc700 1 --2- 172.21.15.154:0/2940357648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8097bb0 0x7f31a8098ba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3198009760 tx=0x7f3198009060).ready entity=mon.1 client_cookie=f9126ccaed03254d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a5ffb700 1 -- 172.21.15.154:0/2940357648 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800f510 con 0x7f31a8097bb0 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a5ffb700 1 -- 172.21.15.154:0/2940357648 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319800f670 con 0x7f31a8097bb0 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.824+0000 7f31a5ffb700 1 -- 172.21.15.154:0/2940357648 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800f9f0 con 0x7f31a8097bb0 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.825+0000 7f31ad588700 1 -- 172.21.15.154:0/2940357648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8097bb0 msgr2=0x7f31a8098ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.825+0000 7f31ad588700 1 --2- 172.21.15.154:0/2940357648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8097bb0 0x7f31a8098ba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3198009760 tx=0x7f3198009060).stop 2023-09-30T22:19:31.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.825+0000 7f31ad588700 1 -- 172.21.15.154:0/2940357648 shutdown_connections 2023-09-30T22:19:31.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.825+0000 7f31ad588700 1 --2- 172.21.15.154:0/2940357648 >> v2:172.21.15.154:3300/0 conn(0x7f31a8065600 0x7f31a80986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.825+0000 7f31ad588700 1 --2- 172.21.15.154:0/2940357648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8097bb0 0x7f31a8098ba0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.825+0000 7f31ad588700 1 -- 172.21.15.154:0/2940357648 >> 172.21.15.154:0/2940357648 conn(0x7f31a809dc90 msgr2=0x7f31a809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:31.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.825+0000 7f31ad588700 1 -- 172.21.15.154:0/2940357648 shutdown_connections 2023-09-30T22:19:31.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.825+0000 7f31ad588700 1 -- 172.21.15.154:0/2940357648 wait complete. 2023-09-30T22:19:31.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31ad588700 1 Processor -- start 2023-09-30T22:19:31.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31ad588700 1 -- start start 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31ad588700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8065600 0x7f31a813a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31ad588700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8099090 0x7f31a813ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31ad588700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31a813b020 0x7f31a811ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31ad588700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8099a90 con 0x7f31a8065600 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31ad588700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a809d0b0 con 0x7f31a8099090 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31ad588700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31a813b440 con 0x7f31a813b020 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31a6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8065600 0x7f31a813a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31a6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8065600 0x7f31a813a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54758/0 (socket says 172.21.15.154:54758) 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31a77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31a813b020 0x7f31a811ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31a6ffd700 1 -- 172.21.15.154:0/1399279439 learned_addr learned my addr 172.21.15.154:0/1399279439 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.826+0000 7f31a67fc700 1 --2- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8099090 0x7f31a813ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f31a67fc700 1 -- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31a813b020 msgr2=0x7f31a811ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f31a67fc700 1 --2- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31a813b020 0x7f31a811ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f31a67fc700 1 -- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8065600 msgr2=0x7f31a813a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f31a67fc700 1 --2- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8065600 0x7f31a813a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f31a67fc700 1 -- 172.21.15.154:0/1399279439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0092a0 con 0x7f31a8099090 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f31a6ffd700 1 --2- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8065600 0x7f31a813a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f31a67fc700 1 --2- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8099090 0x7f31a813ab30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3198014000 tx=0x7f3198017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f318effd700 1 -- 172.21.15.154:0/1399279439 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800fe80 con 0x7f31a8099090 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f318effd700 1 -- 172.21.15.154:0/1399279439 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319800f7e0 con 0x7f31a8099090 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31980092a0 con 0x7f31a8099090 2023-09-30T22:19:31.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f318effd700 1 -- 172.21.15.154:0/1399279439 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319801b640 con 0x7f31a8099090 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.827+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a811cef0 con 0x7f31a8099090 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.828+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a805a260 con 0x7f31a8099090 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.828+0000 7f318effd700 1 -- 172.21.15.154:0/1399279439 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f319801ba30 con 0x7f31a8099090 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.828+0000 7f318effd700 1 -- 172.21.15.154:0/1399279439 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f319803c8a0 con 0x7f31a8099090 2023-09-30T22:19:31.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.832+0000 7f318effd700 1 -- 172.21.15.154:0/1399279439 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f319800f950 con 0x7f31a8099090 2023-09-30T22:19:31.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:31.991+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f31a8094810 con 0x7f31a8099090 2023-09-30T22:19:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.260+0000 7f318effd700 1 -- 172.21.15.154:0/1399279439 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3198029070 con 0x7f31a8099090 2023-09-30T22:19:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.262+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 >> v1:172.21.15.154:6816/118163 conn(0x7f319402bb60 legacy=0x7f319402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.262+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8099090 msgr2=0x7f31a813ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.262+0000 7f31ad588700 1 --2- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8099090 0x7f31a813ab30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3198014000 tx=0x7f3198017000).stop 2023-09-30T22:19:32.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.262+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 shutdown_connections 2023-09-30T22:19:32.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.262+0000 7f31ad588700 1 --2- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31a813b020 0x7f31a811ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.262+0000 7f31ad588700 1 --2- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8065600 0x7f31a813a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.263+0000 7f31ad588700 1 --2- 172.21.15.154:0/1399279439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31a8099090 0x7f31a813ab30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.263+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 >> 172.21.15.154:0/1399279439 conn(0x7f31a809dc90 msgr2=0x7f31a8114310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:32.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.263+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 shutdown_connections 2023-09-30T22:19:32.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.263+0000 7f31ad588700 1 -- 172.21.15.154:0/1399279439 wait complete. 2023-09-30T22:19:32.265 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-09-30T22:19:32.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T22:19:32.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.400+0000 7f4bc1b39700 1 Processor -- start 2023-09-30T22:19:32.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.400+0000 7f4bc1b39700 1 -- start start 2023-09-30T22:19:32.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.400+0000 7f4bc1b39700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4bbc062b00 0x7f4bbc1257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:32.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bc1b39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc125330 0x7f4bbc125cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:32.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bc1b39700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc093b90 0x7f4bbc094040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:32.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bc1b39700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc062ee0 con 0x7f4bbc062b00 2023-09-30T22:19:32.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bc1b39700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0969c0 con 0x7f4bbc125330 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bc1b39700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc095950 con 0x7f4bbc093b90 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc093b90 0x7f4bbc094040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4bbc062b00 0x7f4bbc1257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbaffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc125330 0x7f4bbc125cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc093b90 0x7f4bbc094040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52528/0 (socket says 172.21.15.154:52528) 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbbfff700 1 -- 172.21.15.154:0/1620227316 learned_addr learned my addr 172.21.15.154:0/1620227316 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbb7fe700 1 -- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc093b90 msgr2=0x7f4bbc094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbb7fe700 1 --2- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc093b90 0x7f4bbc094040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbb7fe700 1 -- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc125330 msgr2=0x7f4bbc125cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbb7fe700 1 --2- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc125330 0x7f4bbc125cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbb7fe700 1 -- 172.21.15.154:0/1620227316 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc0635f0 con 0x7f4bbc062b00 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbbfff700 1 --2- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc093b90 0x7f4bbc094040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbaffd700 1 --2- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc125330 0x7f4bbc125cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bbb7fe700 1 --2- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bbc062b00 0x7f4bbc1257c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4ba400dbb0 tx=0x7f4ba400d500).ready entity=mon.0 client_cookie=10c6de101d1eb37c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bba7fc700 1 -- 172.21.15.154:0/1620227316 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4012070 con 0x7f4bbc062b00 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bba7fc700 1 -- 172.21.15.154:0/1620227316 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba400d2e0 con 0x7f4bbc062b00 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.401+0000 7f4bba7fc700 1 -- 172.21.15.154:0/1620227316 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400f790 con 0x7f4bbc062b00 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.402+0000 7f4bc1b39700 1 -- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bbc062b00 msgr2=0x7f4bbc1257c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.402+0000 7f4bc1b39700 1 --2- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bbc062b00 0x7f4bbc1257c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4ba400dbb0 tx=0x7f4ba400d500).stop 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.402+0000 7f4bc1b39700 1 -- 172.21.15.154:0/1620227316 shutdown_connections 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.402+0000 7f4bc1b39700 1 --2- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc093b90 0x7f4bbc094040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.402+0000 7f4bc1b39700 1 --2- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bbc062b00 0x7f4bbc1257c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.402+0000 7f4bc1b39700 1 --2- 172.21.15.154:0/1620227316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc125330 0x7f4bbc125cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.402+0000 7f4bc1b39700 1 -- 172.21.15.154:0/1620227316 >> 172.21.15.154:0/1620227316 conn(0x7f4bbc09aa50 msgr2=0x7f4bbc09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.402+0000 7f4bc1b39700 1 -- 172.21.15.154:0/1620227316 shutdown_connections 2023-09-30T22:19:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.402+0000 7f4bc1b39700 1 -- 172.21.15.154:0/1620227316 wait complete. 2023-09-30T22:19:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bc1b39700 1 Processor -- start 2023-09-30T22:19:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bc1b39700 1 -- start start 2023-09-30T22:19:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bc1b39700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc062b00 0x7f4bbc136240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bc1b39700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bbc093b90 0x7f4bbc136730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bc1b39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc067ad0 0x7f4bbc067f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bc1b39700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc111f00 con 0x7f4bbc093b90 2023-09-30T22:19:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bc1b39700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc095b60 con 0x7f4bbc067ad0 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bc1b39700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc098960 con 0x7f4bbc062b00 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bbb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc062b00 0x7f4bbc136240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc067ad0 0x7f4bbc067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bbaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bbc093b90 0x7f4bbc136730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bbb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc062b00 0x7f4bbc136240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52536/0 (socket says 172.21.15.154:52536) 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc067ad0 0x7f4bbc067f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36966/0 (socket says 172.21.15.154:36966) 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.403+0000 7f4bbb7fe700 1 -- 172.21.15.154:0/568254489 learned_addr learned my addr 172.21.15.154:0/568254489 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bbbfff700 1 -- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc062b00 msgr2=0x7f4bbc136240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bbbfff700 1 --2- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc062b00 0x7f4bbc136240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bbbfff700 1 -- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bbc093b90 msgr2=0x7f4bbc136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:32.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bbbfff700 1 --2- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bbc093b90 0x7f4bbc136730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bbbfff700 1 -- 172.21.15.154:0/568254489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb4009ae0 con 0x7f4bbc067ad0 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bbbfff700 1 --2- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc067ad0 0x7f4bbc067f10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4bb4009f40 tx=0x7f4bb400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bb37fe700 1 -- 172.21.15.154:0/568254489 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40092e0 con 0x7f4bbc067ad0 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bb37fe700 1 -- 172.21.15.154:0/568254489 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb400f040 con 0x7f4bbc067ad0 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac0092a0 con 0x7f4bbc067ad0 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bb37fe700 1 -- 172.21.15.154:0/568254489 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400cb70 con 0x7f4bbc067ad0 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.404+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba400d740 con 0x7f4bbc067ad0 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.405+0000 7f4bb37fe700 1 -- 172.21.15.154:0/568254489 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4bb4014460 con 0x7f4bbc067ad0 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.405+0000 7f4bb37fe700 1 -- 172.21.15.154:0/568254489 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3208+0+0 (secure 0 0 0) 0x7f4bb403ad70 con 0x7f4bbc067ad0 2023-09-30T22:19:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.405+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc05a260 con 0x7f4bbc067ad0 2023-09-30T22:19:32.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.409+0000 7f4bb37fe700 1 -- 172.21.15.154:0/568254489 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4bb4012360 con 0x7f4bbc067ad0 2023-09-30T22:19:32.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:32.568+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4bbc046c20 con 0x7f4bbc067ad0 2023-09-30T22:19:33.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.261+0000 7f4bb37fe700 1 -- 172.21.15.154:0/568254489 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4bb401cb50 con 0x7f4bbc067ad0 2023-09-30T22:19:33.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.265+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 >> v1:172.21.15.154:6816/118163 conn(0x7f4b9c02bb60 legacy=0x7f4b9c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.265+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc067ad0 msgr2=0x7f4bbc067f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.265+0000 7f4bc1b39700 1 --2- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc067ad0 0x7f4bbc067f10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4bb4009f40 tx=0x7f4bb400b040).stop 2023-09-30T22:19:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.265+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 shutdown_connections 2023-09-30T22:19:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.265+0000 7f4bc1b39700 1 --2- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bbc067ad0 0x7f4bbc067f10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.265+0000 7f4bc1b39700 1 --2- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bbc062b00 0x7f4bbc136240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.265+0000 7f4bc1b39700 1 --2- 172.21.15.154:0/568254489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bbc093b90 0x7f4bbc136730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.265+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 >> 172.21.15.154:0/568254489 conn(0x7f4bbc09aa50 msgr2=0x7f4bbc1232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.266+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 shutdown_connections 2023-09-30T22:19:33.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.266+0000 7f4bc1b39700 1 -- 172.21.15.154:0/568254489 wait complete. 2023-09-30T22:19:33.275 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-09-30T22:19:33.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1c01148700 1 Processor -- start 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1c01148700 1 -- start start 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1c01148700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc062b00 0x7f1bfc095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1c01148700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc095b80 0x7f1bfc095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1c01148700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bfc096490 0x7f1bfc131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1c01148700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc0973f0 con 0x7f1bfc096490 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1c01148700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc062ee0 con 0x7f1bfc062b00 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1c01148700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc091980 con 0x7f1bfc095b80 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc095b80 0x7f1bfc095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1bfad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc062b00 0x7f1bfc095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1bfb59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bfc096490 0x7f1bfc131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc095b80 0x7f1bfc095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52540/0 (socket says 172.21.15.154:52540) 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1bfad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc062b00 0x7f1bfc095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36974/0 (socket says 172.21.15.154:36974) 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1bfb59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bfc096490 0x7f1bfc131280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54780/0 (socket says 172.21.15.154:54780) 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.413+0000 7f1bfa59c700 1 -- 172.21.15.154:0/3235354411 learned_addr learned my addr 172.21.15.154:0/3235354411 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bfb59e700 1 -- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc095b80 msgr2=0x7f1bfc095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bfb59e700 1 --2- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc095b80 0x7f1bfc095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bfb59e700 1 -- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc062b00 msgr2=0x7f1bfc095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bfb59e700 1 --2- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc062b00 0x7f1bfc095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bfb59e700 1 -- 172.21.15.154:0/3235354411 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc092310 con 0x7f1bfc096490 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bfad9d700 1 --2- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc062b00 0x7f1bfc095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:33.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bfb59e700 1 --2- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc096490 0x7f1bfc131280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1bf4009e90 tx=0x7f1bf4009780).ready entity=mon.0 client_cookie=64e3ff9755b3d661 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bf9d9b700 1 -- 172.21.15.154:0/3235354411 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400e070 con 0x7f1bfc096490 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bf9d9b700 1 -- 172.21.15.154:0/3235354411 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf400ba10 con 0x7f1bfc096490 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1bf9d9b700 1 -- 172.21.15.154:0/3235354411 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400bd90 con 0x7f1bfc096490 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1c01148700 1 -- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc096490 msgr2=0x7f1bfc131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.414+0000 7f1c01148700 1 --2- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc096490 0x7f1bfc131280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1bf4009e90 tx=0x7f1bf4009780).stop 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.415+0000 7f1c01148700 1 -- 172.21.15.154:0/3235354411 shutdown_connections 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.415+0000 7f1c01148700 1 --2- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc062b00 0x7f1bfc095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.415+0000 7f1c01148700 1 --2- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc096490 0x7f1bfc131280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.415+0000 7f1c01148700 1 --2- 172.21.15.154:0/3235354411 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc095b80 0x7f1bfc095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.415+0000 7f1c01148700 1 -- 172.21.15.154:0/3235354411 >> 172.21.15.154:0/3235354411 conn(0x7f1bfc09aa50 msgr2=0x7f1bfc09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.415+0000 7f1c01148700 1 -- 172.21.15.154:0/3235354411 shutdown_connections 2023-09-30T22:19:33.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.415+0000 7f1c01148700 1 -- 172.21.15.154:0/3235354411 wait complete. 2023-09-30T22:19:33.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.415+0000 7f1c01148700 1 Processor -- start 2023-09-30T22:19:33.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1c01148700 1 -- start start 2023-09-30T22:19:33.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1c01148700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc062b00 0x7f1bfc1163c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1c01148700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc095b80 0x7f1bfc1168b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1c01148700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc096490 0x7f1bfc116da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1c01148700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc12d580 con 0x7f1bfc095b80 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1c01148700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc118a80 con 0x7f1bfc096490 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1c01148700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc096da0 con 0x7f1bfc062b00 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc062b00 0x7f1bfc1163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfa59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc095b80 0x7f1bfc1168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc062b00 0x7f1bfc1163c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52556/0 (socket says 172.21.15.154:52556) 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfad9d700 1 -- 172.21.15.154:0/2252907484 learned_addr learned my addr 172.21.15.154:0/2252907484 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfb59e700 1 --2- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc096490 0x7f1bfc116da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfad9d700 1 -- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc096490 msgr2=0x7f1bfc116da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfad9d700 1 --2- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc096490 0x7f1bfc116da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfad9d700 1 -- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc095b80 msgr2=0x7f1bfc1168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfad9d700 1 --2- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc095b80 0x7f1bfc1168b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfad9d700 1 -- 172.21.15.154:0/2252907484 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec0092a0 con 0x7f1bfc062b00 2023-09-30T22:19:33.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfa59c700 1 --2- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc095b80 0x7f1bfc1168b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:33.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.416+0000 7f1bfad9d700 1 --2- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc062b00 0x7f1bfc1163c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1bec00ea20 tx=0x7f1bec009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.417+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2252907484 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00ee60 con 0x7f1bfc062b00 2023-09-30T22:19:33.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.417+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2252907484 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec00c850 con 0x7f1bfc062b00 2023-09-30T22:19:33.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.417+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf4009a20 con 0x7f1bfc062b00 2023-09-30T22:19:33.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.417+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2252907484 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00cbd0 con 0x7f1bfc062b00 2023-09-30T22:19:33.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.417+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc11a790 con 0x7f1bfc062b00 2023-09-30T22:19:33.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.417+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2252907484 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1bec01b400 con 0x7f1bfc062b00 2023-09-30T22:19:33.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.418+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2252907484 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3590+0+0 (secure 0 0 0) 0x7f1bec03b290 con 0x7f1bfc062b00 2023-09-30T22:19:33.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.418+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc11a790 con 0x7f1bfc062b00 2023-09-30T22:19:33.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.422+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2252907484 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1bfc11a790 con 0x7f1bfc062b00 2023-09-30T22:19:33.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.618+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1bfc11a790 con 0x7f1bfc062b00 2023-09-30T22:19:33.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.632+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2252907484 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1bfc11a790 con 0x7f1bfc062b00 2023-09-30T22:19:33.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.636+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 >> v1:172.21.15.154:6816/118163 conn(0x7f1be802bb30 legacy=0x7f1be802dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.636+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc062b00 msgr2=0x7f1bfc1163c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.636+0000 7f1c01148700 1 --2- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc062b00 0x7f1bfc1163c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1bec00ea20 tx=0x7f1bec009060).stop 2023-09-30T22:19:33.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.636+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 shutdown_connections 2023-09-30T22:19:33.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.636+0000 7f1c01148700 1 --2- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bfc096490 0x7f1bfc116da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.636+0000 7f1c01148700 1 --2- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bfc062b00 0x7f1bfc1163c0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0x7f1bec00ea20 tx=0x7f1bec009060).stop 2023-09-30T22:19:33.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.636+0000 7f1c01148700 1 --2- 172.21.15.154:0/2252907484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bfc095b80 0x7f1bfc1168b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.636+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 >> 172.21.15.154:0/2252907484 conn(0x7f1bfc09aa50 msgr2=0x7f1bfc097540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.644+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 shutdown_connections 2023-09-30T22:19:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.646+0000 7f1c01148700 1 -- 172.21.15.154:0/2252907484 wait complete. 2023-09-30T22:19:33.654 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 3 and data pool 4 2023-09-30T22:19:33.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.787+0000 7f5572047700 1 Processor -- start 2023-09-30T22:19:33.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.787+0000 7f5572047700 1 -- start start 2023-09-30T22:19:33.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f5572047700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f5572047700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f5572047700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c094ba0 con 0x7f556c12c240 2023-09-30T22:19:33.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f5572047700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c092e90 con 0x7f556c093950 2023-09-30T22:19:33.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f5572047700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c096b60 con 0x7f556c095c50 2023-09-30T22:19:33.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f556affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f556b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f556bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f556c12c240 0x7f556c12e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57344/0 (socket says 172.21.15.154:57344) 2023-09-30T22:19:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f556affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52572/0 (socket says 172.21.15.154:52572) 2023-09-30T22:19:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f556bfff700 1 -- 172.21.15.154:0/221042125 learned_addr learned my addr 172.21.15.154:0/221042125 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f556a7fc700 1 -- 172.21.15.154:0/221042125 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035904489 0 0) 0x7f556c094ba0 con 0x7f556c12c240 2023-09-30T22:19:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.788+0000 7f556a7fc700 1 -- 172.21.15.154:0/221042125 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55580033f0 con 0x7f556c12c240 2023-09-30T22:19:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f556b7fe700 1 -- 172.21.15.154:0/221042125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 msgr2=0x7f556c096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f556b7fe700 1 --2- 172.21.15.154:0/221042125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f556b7fe700 1 -- 172.21.15.154:0/221042125 >> v1:172.21.15.154:6789/0 conn(0x7f556c12c240 legacy=0x7f556c12e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f556b7fe700 1 -- 172.21.15.154:0/221042125 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c093150 con 0x7f556c093950 2023-09-30T22:19:33.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f556affd700 1 --2- 172.21.15.154:0/221042125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f556b7fe700 1 --2- 172.21.15.154:0/221042125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c095760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f555c009790 tx=0x7f555c009060).ready entity=mon.1 client_cookie=76c48fe0ea737c1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f556a7fc700 1 -- 172.21.15.154:0/221042125 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c0090d0 con 0x7f556c093950 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f556a7fc700 1 -- 172.21.15.154:0/221042125 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c00f510 con 0x7f556c093950 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f556a7fc700 1 -- 172.21.15.154:0/221042125 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00f890 con 0x7f556c093950 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f5572047700 1 -- 172.21.15.154:0/221042125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 msgr2=0x7f556c095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f5572047700 1 --2- 172.21.15.154:0/221042125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c095760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f555c009790 tx=0x7f555c009060).stop 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f5572047700 1 -- 172.21.15.154:0/221042125 shutdown_connections 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f5572047700 1 --2- 172.21.15.154:0/221042125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c095760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f5572047700 1 --2- 172.21.15.154:0/221042125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f5572047700 1 -- 172.21.15.154:0/221042125 >> 172.21.15.154:0/221042125 conn(0x7f556c09aa50 msgr2=0x7f556c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f5572047700 1 -- 172.21.15.154:0/221042125 shutdown_connections 2023-09-30T22:19:33.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.789+0000 7f5572047700 1 -- 172.21.15.154:0/221042125 wait complete. 2023-09-30T22:19:33.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.790+0000 7f5572047700 1 Processor -- start 2023-09-30T22:19:33.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.790+0000 7f5572047700 1 -- start start 2023-09-30T22:19:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f5572047700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f5572047700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c138750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f5572047700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c12c240 0x7f556c111520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f5572047700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c0990a0 con 0x7f556c12c240 2023-09-30T22:19:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f5572047700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c092410 con 0x7f556c093950 2023-09-30T22:19:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f5572047700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c133010 con 0x7f556c095c50 2023-09-30T22:19:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c138750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c138750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52586/0 (socket says 172.21.15.154:52586) 2023-09-30T22:19:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556affd700 1 -- 172.21.15.154:0/3271147138 learned_addr learned my addr 172.21.15.154:0/3271147138 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556bfff700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c12c240 0x7f556c111520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556b7fe700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556affd700 1 -- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 msgr2=0x7f556c138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556affd700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556affd700 1 -- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c12c240 msgr2=0x7f556c111520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556affd700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c12c240 0x7f556c111520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556affd700 1 -- 172.21.15.154:0/3271147138 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55540092a0 con 0x7f556c095c50 2023-09-30T22:19:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556b7fe700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556bfff700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c12c240 0x7f556c111520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.791+0000 7f556affd700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c138750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f555400e9d0 tx=0x7f5554009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.792+0000 7f55637fe700 1 -- 172.21.15.154:0/3271147138 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554009600 con 0x7f556c095c50 2023-09-30T22:19:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.792+0000 7f55637fe700 1 -- 172.21.15.154:0/3271147138 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555400c6a0 con 0x7f556c095c50 2023-09-30T22:19:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.792+0000 7f55637fe700 1 -- 172.21.15.154:0/3271147138 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555400ca20 con 0x7f556c095c50 2023-09-30T22:19:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.792+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c0092a0 con 0x7f556c095c50 2023-09-30T22:19:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.792+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c1149f0 con 0x7f556c095c50 2023-09-30T22:19:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.792+0000 7f55637fe700 1 -- 172.21.15.154:0/3271147138 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f555400cd90 con 0x7f556c095c50 2023-09-30T22:19:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.792+0000 7f55637fe700 1 -- 172.21.15.154:0/3271147138 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f555403b430 con 0x7f556c095c50 2023-09-30T22:19:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.793+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556c114bc0 con 0x7f556c095c50 2023-09-30T22:19:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.797+0000 7f55637fe700 1 -- 172.21.15.154:0/3271147138 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5554016070 con 0x7f556c095c50 2023-09-30T22:19:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.954+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f556c115770 con 0x7f556c095c50 2023-09-30T22:19:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.955+0000 7f55637fe700 1 -- 172.21.15.154:0/3271147138 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11386 (secure 0 0 0) 0x7f5554016020 con 0x7f556c095c50 2023-09-30T22:19:33.956 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:33.956 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":15,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:33.620484+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 >> v1:172.21.15.154:6816/118163 conn(0x7f554c02bb60 legacy=0x7f554c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 msgr2=0x7f556c138750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c138750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f555400e9d0 tx=0x7f5554009060).stop 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 shutdown_connections 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c12c240 0x7f556c111520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c093950 0x7f556c138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 --2- 172.21.15.154:0/3271147138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c095c50 0x7f556c138750 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 >> 172.21.15.154:0/3271147138 conn(0x7f556c09aa50 msgr2=0x7f556c062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 shutdown_connections 2023-09-30T22:19:33.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:33.957+0000 7f5572047700 1 -- 172.21.15.154:0/3271147138 wait complete. 2023-09-30T22:19:33.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd6d39700 1 Processor -- start 2023-09-30T22:19:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd6d39700 1 -- start start 2023-09-30T22:19:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd6d39700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdd012de90 0x7fcdd0130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd6d39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0132b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd6d39700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd0066e30 con 0x7fcdd012afd0 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd6d39700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd012ab10 con 0x7fcdd012de90 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd6d39700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0067500 con 0x7fcdd0130770 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd52d6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0132b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdcffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdd012de90 0x7fcdd0130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd52d6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0132b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37000/0 (socket says 172.21.15.154:37000) 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdcffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdd012de90 0x7fcdd0130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54796/0 (socket says 172.21.15.154:54796) 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd52d6700 1 -- 172.21.15.154:0/877670626 learned_addr learned my addr 172.21.15.154:0/877670626 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.085+0000 7fcdd4ad5700 1 --1- 172.21.15.154:0/877670626 >> v1:172.21.15.154:6789/0 conn(0x7fcdd012afd0 0x7fcdd012b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57354/0 (socket says 172.21.15.154:57354) 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd52d6700 1 -- 172.21.15.154:0/877670626 >> v2:172.21.15.154:3300/0 conn(0x7fcdd012de90 msgr2=0x7fcdd0130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd52d6700 1 --2- 172.21.15.154:0/877670626 >> v2:172.21.15.154:3300/0 conn(0x7fcdd012de90 0x7fcdd0130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd52d6700 1 -- 172.21.15.154:0/877670626 >> v1:172.21.15.154:6789/0 conn(0x7fcdd012afd0 legacy=0x7fcdd012b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd52d6700 1 -- 172.21.15.154:0/877670626 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd012adb0 con 0x7fcdd0130770 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd52d6700 1 --2- 172.21.15.154:0/877670626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0132b60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fcdc8009f20 tx=0x7fcdc8009840).ready entity=mon.1 client_cookie=99e8124fbe76a48a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdcf7fe700 1 -- 172.21.15.154:0/877670626 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800e070 con 0x7fcdd0130770 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdcf7fe700 1 -- 172.21.15.154:0/877670626 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc800b9d0 con 0x7fcdd0130770 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdcf7fe700 1 -- 172.21.15.154:0/877670626 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800bd50 con 0x7fcdd0130770 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd6d39700 1 -- 172.21.15.154:0/877670626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 msgr2=0x7fcdd0132b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd6d39700 1 --2- 172.21.15.154:0/877670626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0132b60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fcdc8009f20 tx=0x7fcdc8009840).stop 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd6d39700 1 -- 172.21.15.154:0/877670626 shutdown_connections 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd6d39700 1 --2- 172.21.15.154:0/877670626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0132b60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd6d39700 1 --2- 172.21.15.154:0/877670626 >> v2:172.21.15.154:3300/0 conn(0x7fcdd012de90 0x7fcdd0130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.086+0000 7fcdd6d39700 1 -- 172.21.15.154:0/877670626 >> 172.21.15.154:0/877670626 conn(0x7fcdd009a230 msgr2=0x7fcdd009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.087+0000 7fcdd6d39700 1 -- 172.21.15.154:0/877670626 shutdown_connections 2023-09-30T22:19:34.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.087+0000 7fcdd6d39700 1 -- 172.21.15.154:0/877670626 wait complete. 2023-09-30T22:19:34.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.087+0000 7fcdd6d39700 1 Processor -- start 2023-09-30T22:19:34.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.087+0000 7fcdd6d39700 1 -- start start 2023-09-30T22:19:34.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd6d39700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd012afd0 0x7fcdd0114350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd6d39700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd012de90 0x7fcdd0114840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd6d39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0114d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd6d39700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd012a420 con 0x7fcdd012afd0 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd6d39700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0116930 con 0x7fcdd0130770 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd6d39700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0067040 con 0x7fcdd012de90 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd4ad5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd012afd0 0x7fcdd0114350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd4ad5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd012afd0 0x7fcdd0114350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54804/0 (socket says 172.21.15.154:54804) 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd4ad5700 1 -- 172.21.15.154:0/1253686538 learned_addr learned my addr 172.21.15.154:0/1253686538 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdcffff700 1 --2- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd012de90 0x7fcdd0114840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd52d6700 1 --2- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0114d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd4ad5700 1 -- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd012de90 msgr2=0x7fcdd0114840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd4ad5700 1 --2- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd012de90 0x7fcdd0114840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd4ad5700 1 -- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 msgr2=0x7fcdd0114d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd4ad5700 1 --2- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0114d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd4ad5700 1 -- 172.21.15.154:0/1253686538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc8009ae0 con 0x7fcdd012afd0 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.088+0000 7fcdd4ad5700 1 --2- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd012afd0 0x7fcdd0114350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fcdc4007fd0 tx=0x7fcdc4007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.089+0000 7fcdccff9700 1 -- 172.21.15.154:0/1253686538 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400ce10 con 0x7fcdd012afd0 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.089+0000 7fcdccff9700 1 -- 172.21.15.154:0/1253686538 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc40072e0 con 0x7fcdd012afd0 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.089+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd0117da0 con 0x7fcdd012afd0 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.089+0000 7fcdccff9700 1 -- 172.21.15.154:0/1253686538 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40056e0 con 0x7fcdd012afd0 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.089+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd0118640 con 0x7fcdd012afd0 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.089+0000 7fcdccff9700 1 -- 172.21.15.154:0/1253686538 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcdc4005b10 con 0x7fcdd012afd0 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.089+0000 7fcdccff9700 1 -- 172.21.15.154:0/1253686538 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcdc403a430 con 0x7fcdd012afd0 2023-09-30T22:19:34.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.090+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd0118640 con 0x7fcdd012afd0 2023-09-30T22:19:34.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.094+0000 7fcdccff9700 1 -- 172.21.15.154:0/1253686538 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcdd0118640 con 0x7fcdd012afd0 2023-09-30T22:19:34.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.254+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdd0118640 con 0x7fcdd012afd0 2023-09-30T22:19:34.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.255+0000 7fcdccff9700 1 -- 172.21.15.154:0/1253686538 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11386 (secure 0 0 0) 0x7fcdd0118640 con 0x7fcdd012afd0 2023-09-30T22:19:34.256 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:34.256 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":15,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:33.620484+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:34.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 >> v1:172.21.15.154:6816/118163 conn(0x7fcdb402bb90 legacy=0x7fcdb402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd012afd0 msgr2=0x7fcdd0114350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 --2- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd012afd0 0x7fcdd0114350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fcdc4007fd0 tx=0x7fcdc4007df0).stop 2023-09-30T22:19:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 shutdown_connections 2023-09-30T22:19:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 --2- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd0130770 0x7fcdd0114d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 --2- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd012afd0 0x7fcdd0114350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 --2- 172.21.15.154:0/1253686538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd012de90 0x7fcdd0114840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 >> 172.21.15.154:0/1253686538 conn(0x7fcdd009a230 msgr2=0x7fcdd00998d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 shutdown_connections 2023-09-30T22:19:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.257+0000 7fcdd6d39700 1 -- 172.21.15.154:0/1253686538 wait complete. 2023-09-30T22:19:34.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T22:19:34.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab8c1d700 1 Processor -- start 2023-09-30T22:19:34.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab8c1d700 1 -- start start 2023-09-30T22:19:34.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab8c1d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ab405f560 0x7f7ab4096840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab8c1d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab412cbd0 0x7f7ab412efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab8c1d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40933e0 con 0x7f7ab4069d90 2023-09-30T22:19:34.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab8c1d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab405f940 con 0x7f7ab405f560 2023-09-30T22:19:34.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab8c1d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4097440 con 0x7f7ab412cbd0 2023-09-30T22:19:34.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab412cbd0 0x7f7ab412efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ab405f560 0x7f7ab4096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab1d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7ab4069d90 0x7f7ab4096d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57368/0 (socket says 172.21.15.154:57368) 2023-09-30T22:19:34.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab1d9b700 1 -- 172.21.15.154:0/1405172473 learned_addr learned my addr 172.21.15.154:0/1405172473 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:34.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.388+0000 7f7ab2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab412cbd0 0x7f7ab412efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37010/0 (socket says 172.21.15.154:37010) 2023-09-30T22:19:34.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab259c700 1 -- 172.21.15.154:0/1405172473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab412cbd0 msgr2=0x7f7ab412efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab259c700 1 --2- 172.21.15.154:0/1405172473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab412cbd0 0x7f7ab412efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab259c700 1 -- 172.21.15.154:0/1405172473 >> v1:172.21.15.154:6789/0 conn(0x7f7ab4069d90 legacy=0x7f7ab4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab259c700 1 -- 172.21.15.154:0/1405172473 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40921e0 con 0x7f7ab405f560 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab159a700 1 -- 172.21.15.154:0/1405172473 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841482476 0 0) 0x7f7ab40933e0 con 0x7f7ab4069d90 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab2d9d700 1 --2- 172.21.15.154:0/1405172473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab412cbd0 0x7f7ab412efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab259c700 1 --2- 172.21.15.154:0/1405172473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ab405f560 0x7f7ab4096840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7aa4009760 tx=0x7f7aa4009060).ready entity=mon.0 client_cookie=536c109e69bf457c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab159a700 1 -- 172.21.15.154:0/1405172473 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400f510 con 0x7f7ab405f560 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab159a700 1 -- 172.21.15.154:0/1405172473 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa400f670 con 0x7f7ab405f560 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.389+0000 7f7ab159a700 1 -- 172.21.15.154:0/1405172473 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400f9f0 con 0x7f7ab405f560 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.390+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1405172473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ab405f560 msgr2=0x7f7ab4096840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.390+0000 7f7ab8c1d700 1 --2- 172.21.15.154:0/1405172473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ab405f560 0x7f7ab4096840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7aa4009760 tx=0x7f7aa4009060).stop 2023-09-30T22:19:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.390+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1405172473 shutdown_connections 2023-09-30T22:19:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.390+0000 7f7ab8c1d700 1 --2- 172.21.15.154:0/1405172473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab412cbd0 0x7f7ab412efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.390+0000 7f7ab8c1d700 1 --2- 172.21.15.154:0/1405172473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ab405f560 0x7f7ab4096840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.390+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1405172473 >> 172.21.15.154:0/1405172473 conn(0x7f7ab409a1c0 msgr2=0x7f7ab409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.390+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1405172473 shutdown_connections 2023-09-30T22:19:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.390+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1405172473 wait complete. 2023-09-30T22:19:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.390+0000 7f7ab8c1d700 1 Processor -- start 2023-09-30T22:19:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab8c1d700 1 -- start start 2023-09-30T22:19:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab8c1d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab405f560 0x7f7ab412cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab8c1d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ab412cbd0 0x7f7ab412d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab8c1d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ab412d990 0x7f7ab412b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab8c1d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab412e480 con 0x7f7ab412cbd0 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab8c1d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40671c0 con 0x7f7ab405f560 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab8c1d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4091dc0 con 0x7f7ab412d990 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab405f560 0x7f7ab412cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab405f560 0x7f7ab412cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37022/0 (socket says 172.21.15.154:37022) 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab259c700 1 -- 172.21.15.154:0/1996159576 learned_addr learned my addr 172.21.15.154:0/1996159576 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab2d9d700 1 --2- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ab412d990 0x7f7ab412b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab1d9b700 1 --2- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ab412cbd0 0x7f7ab412d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab259c700 1 -- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ab412d990 msgr2=0x7f7ab412b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab259c700 1 --2- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ab412d990 0x7f7ab412b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab259c700 1 -- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ab412cbd0 msgr2=0x7f7ab412d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab259c700 1 --2- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ab412cbd0 0x7f7ab412d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab259c700 1 -- 172.21.15.154:0/1996159576 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac009a20 con 0x7f7ab405f560 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.391+0000 7f7ab259c700 1 --2- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab405f560 0x7f7ab412cfb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7aa4009e00 tx=0x7f7aa4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.392+0000 7f7aa27fc700 1 -- 172.21.15.154:0/1996159576 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400f7e0 con 0x7f7ab405f560 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.392+0000 7f7aa27fc700 1 -- 172.21.15.154:0/1996159576 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa400f940 con 0x7f7ab405f560 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.392+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa40092a0 con 0x7f7ab405f560 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.392+0000 7f7aa27fc700 1 -- 172.21.15.154:0/1996159576 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa401b660 con 0x7f7ab405f560 2023-09-30T22:19:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.392+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab412ecb0 con 0x7f7ab405f560 2023-09-30T22:19:34.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.392+0000 7f7aa27fc700 1 -- 172.21.15.154:0/1996159576 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7aa401ba50 con 0x7f7ab405f560 2023-09-30T22:19:34.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.392+0000 7f7aa27fc700 1 -- 172.21.15.154:0/1996159576 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7aa403c840 con 0x7f7ab405f560 2023-09-30T22:19:34.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.393+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab4099b50 con 0x7f7ab405f560 2023-09-30T22:19:34.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.397+0000 7f7aa27fc700 1 -- 172.21.15.154:0/1996159576 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7aa4029080 con 0x7f7ab405f560 2023-09-30T22:19:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.592+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7ab411b2b0 con 0x7f7ab405f560 2023-09-30T22:19:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.625+0000 7f7aa27fc700 1 -- 172.21.15.154:0/1996159576 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7aa401f020 con 0x7f7ab405f560 2023-09-30T22:19:34.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.628+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 >> v1:172.21.15.154:6816/118163 conn(0x7f7a9402bb90 legacy=0x7f7a9402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.628+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab405f560 msgr2=0x7f7ab412cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.628+0000 7f7ab8c1d700 1 --2- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab405f560 0x7f7ab412cfb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7aa4009e00 tx=0x7f7aa4017000).stop 2023-09-30T22:19:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.628+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 shutdown_connections 2023-09-30T22:19:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.628+0000 7f7ab8c1d700 1 --2- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ab412d990 0x7f7ab412b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.629+0000 7f7ab8c1d700 1 --2- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ab405f560 0x7f7ab412cfb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.629+0000 7f7ab8c1d700 1 --2- 172.21.15.154:0/1996159576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ab412cbd0 0x7f7ab412d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.629+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 >> 172.21.15.154:0/1996159576 conn(0x7f7ab409a1c0 msgr2=0x7f7ab40955b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.629+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 shutdown_connections 2023-09-30T22:19:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.629+0000 7f7ab8c1d700 1 -- 172.21.15.154:0/1996159576 wait complete. 2023-09-30T22:19:34.642 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T22:19:34.642 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:19:34.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.763+0000 7f665817b700 1 Processor -- start 2023-09-30T22:19:34.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.763+0000 7f665817b700 1 -- start start 2023-09-30T22:19:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f665817b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f665005f560 0x7f665012ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f665817b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665012b250 0x7f665012b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f665817b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66500961f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f665817b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665005f940 con 0x7f665005f560 2023-09-30T22:19:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f665817b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6650097ac0 con 0x7f665012b250 2023-09-30T22:19:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f665817b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6650066f90 con 0x7f6650095d90 2023-09-30T22:19:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655f17700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f665005f560 0x7f665012ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655716700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665012b250 0x7f665012b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6656718700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66500961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655f17700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f665005f560 0x7f665012ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54832/0 (socket says 172.21.15.154:54832) 2023-09-30T22:19:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6656718700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66500961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52608/0 (socket says 172.21.15.154:52608) 2023-09-30T22:19:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655f17700 1 -- 172.21.15.154:0/3988691570 learned_addr learned my addr 172.21.15.154:0/3988691570 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655716700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665012b250 0x7f665012b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37034/0 (socket says 172.21.15.154:37034) 2023-09-30T22:19:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655f17700 1 -- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 msgr2=0x7f66500961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655f17700 1 --2- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66500961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655f17700 1 -- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665012b250 msgr2=0x7f665012b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655f17700 1 --2- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665012b250 0x7f665012b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655f17700 1 -- 172.21.15.154:0/3988691570 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665012ab20 con 0x7f665005f560 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6655716700 1 --2- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665012b250 0x7f665012b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.764+0000 7f6656718700 1 --2- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66500961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f6655f17700 1 --2- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f665005f560 0x7f665012ad60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6640006fd0 tx=0x7f66400090f0).ready entity=mon.0 client_cookie=7afa7f89bbae4248 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f6654f15700 1 -- 172.21.15.154:0/3988691570 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664000f510 con 0x7f665005f560 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f6654f15700 1 -- 172.21.15.154:0/3988691570 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664000f670 con 0x7f665005f560 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f6654f15700 1 -- 172.21.15.154:0/3988691570 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664000f9f0 con 0x7f665005f560 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f665817b700 1 -- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f665005f560 msgr2=0x7f665012ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f665817b700 1 --2- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f665005f560 0x7f665012ad60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6640006fd0 tx=0x7f66400090f0).stop 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f665817b700 1 -- 172.21.15.154:0/3988691570 shutdown_connections 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f665817b700 1 --2- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66500961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f665817b700 1 --2- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f665005f560 0x7f665012ad60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f665817b700 1 --2- 172.21.15.154:0/3988691570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665012b250 0x7f665012b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f665817b700 1 -- 172.21.15.154:0/3988691570 >> 172.21.15.154:0/3988691570 conn(0x7f665009a1c0 msgr2=0x7f665009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f665817b700 1 -- 172.21.15.154:0/3988691570 shutdown_connections 2023-09-30T22:19:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.765+0000 7f665817b700 1 -- 172.21.15.154:0/3988691570 wait complete. 2023-09-30T22:19:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.766+0000 7f665817b700 1 Processor -- start 2023-09-30T22:19:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.766+0000 7f665817b700 1 -- start start 2023-09-30T22:19:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f665817b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665005f560 0x7f665011b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f665817b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66501172b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f665817b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f665012b250 0x7f66501177a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:34.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f665817b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665011ae00 con 0x7f665012b250 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f665817b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66501294c0 con 0x7f665005f560 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f665817b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66500671c0 con 0x7f6650095d90 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655716700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66501172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655f17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665005f560 0x7f665011b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655716700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66501172b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52610/0 (socket says 172.21.15.154:52610) 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655716700 1 -- 172.21.15.154:0/1807365948 learned_addr learned my addr 172.21.15.154:0/1807365948 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655f17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665005f560 0x7f665011b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37040/0 (socket says 172.21.15.154:37040) 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6656718700 1 --2- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f665012b250 0x7f66501177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655f17700 1 -- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 msgr2=0x7f66501172b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655f17700 1 --2- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66501172b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655f17700 1 -- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f665012b250 msgr2=0x7f66501177a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655f17700 1 --2- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f665012b250 0x7f66501177a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655f17700 1 -- 172.21.15.154:0/1807365948 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648009a20 con 0x7f665005f560 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655716700 1 --2- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66501172b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6655f17700 1 --2- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665005f560 0x7f665011b290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6640006fd0 tx=0x7f6640017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6645ffb700 1 -- 172.21.15.154:0/1807365948 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640006a40 con 0x7f665005f560 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6645ffb700 1 -- 172.21.15.154:0/1807365948 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664000f7e0 con 0x7f665005f560 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f6645ffb700 1 -- 172.21.15.154:0/1807365948 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664001b640 con 0x7f665005f560 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.767+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c0092a0 con 0x7f665005f560 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.768+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6640009370 con 0x7f665005f560 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.768+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665009ab20 con 0x7f665005f560 2023-09-30T22:19:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.769+0000 7f6645ffb700 1 -- 172.21.15.154:0/1807365948 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f664001b9f0 con 0x7f665005f560 2023-09-30T22:19:34.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.769+0000 7f6645ffb700 1 -- 172.21.15.154:0/1807365948 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f664003c880 con 0x7f665005f560 2023-09-30T22:19:34.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.773+0000 7f6645ffb700 1 -- 172.21.15.154:0/1807365948 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f664001bca0 con 0x7f665005f560 2023-09-30T22:19:34.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:34.971+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f665012ab20 con 0x7f665005f560 2023-09-30T22:19:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.632+0000 7f6645ffb700 1 -- 172.21.15.154:0/1807365948 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7f665012ab20 con 0x7f665005f560 2023-09-30T22:19:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 >> v1:172.21.15.154:6816/118163 conn(0x7f663402bb60 legacy=0x7f663402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665005f560 msgr2=0x7f665011b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 --2- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665005f560 0x7f665011b290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6640006fd0 tx=0x7f6640017000).stop 2023-09-30T22:19:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 shutdown_connections 2023-09-30T22:19:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 --2- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f665012b250 0x7f66501177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 --2- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f665005f560 0x7f665011b290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 --2- 172.21.15.154:0/1807365948 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6650095d90 0x7f66501172b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 >> 172.21.15.154:0/1807365948 conn(0x7f665009a1c0 msgr2=0x7f66500987b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 shutdown_connections 2023-09-30T22:19:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.635+0000 7f665817b700 1 -- 172.21.15.154:0/1807365948 wait complete. 2023-09-30T22:19:35.650 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T22:19:35.650 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:19:35.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.771+0000 7f1e86cd5700 1 Processor -- start 2023-09-30T22:19:35.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.771+0000 7f1e86cd5700 1 -- start start 2023-09-30T22:19:35.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e86cd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80097300 0x7f1e800976e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:35.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e86cd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e801306c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e86cd5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e800982f0 con 0x7f1e80096810 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e86cd5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80068550 con 0x7f1e80097300 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e86cd5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80069e20 con 0x7f1e8012e2d0 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80097300 0x7f1e800976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e84a71700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1e80096810 0x7f1e80096bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41592/0 (socket says 172.21.15.154:41592) 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e84a71700 1 -- 172.21.15.154:0/926935224 learned_addr learned my addr 172.21.15.154:0/926935224 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e85272700 1 --2- 172.21.15.154:0/926935224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e801306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e7ffff700 1 -- 172.21.15.154:0/926935224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 msgr2=0x7f1e801306c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e7ffff700 1 --2- 172.21.15.154:0/926935224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e801306c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e7ffff700 1 -- 172.21.15.154:0/926935224 >> v1:172.21.15.154:6789/0 conn(0x7f1e80096810 legacy=0x7f1e80096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e7f7fe700 1 -- 172.21.15.154:0/926935224 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699892659 0 0) 0x7f1e800982f0 con 0x7f1e80096810 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e7ffff700 1 -- 172.21.15.154:0/926935224 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80097bd0 con 0x7f1e80097300 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.772+0000 7f1e85272700 1 --2- 172.21.15.154:0/926935224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e801306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e7ffff700 1 --2- 172.21.15.154:0/926935224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80097300 0x7f1e800976e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1e6c009790 tx=0x7f1e6c009060).ready entity=mon.1 client_cookie=5dfb01409c3406ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e7f7fe700 1 -- 172.21.15.154:0/926935224 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0090d0 con 0x7f1e80097300 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e7f7fe700 1 -- 172.21.15.154:0/926935224 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00f510 con 0x7f1e80097300 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e7f7fe700 1 -- 172.21.15.154:0/926935224 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00f890 con 0x7f1e80097300 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e86cd5700 1 -- 172.21.15.154:0/926935224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80097300 msgr2=0x7f1e800976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e86cd5700 1 --2- 172.21.15.154:0/926935224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80097300 0x7f1e800976e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1e6c009790 tx=0x7f1e6c009060).stop 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e86cd5700 1 -- 172.21.15.154:0/926935224 shutdown_connections 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e86cd5700 1 --2- 172.21.15.154:0/926935224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e801306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e86cd5700 1 --2- 172.21.15.154:0/926935224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80097300 0x7f1e800976e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e86cd5700 1 -- 172.21.15.154:0/926935224 >> 172.21.15.154:0/926935224 conn(0x7f1e8009bad0 msgr2=0x7f1e8009bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e86cd5700 1 -- 172.21.15.154:0/926935224 shutdown_connections 2023-09-30T22:19:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.773+0000 7f1e86cd5700 1 -- 172.21.15.154:0/926935224 wait complete. 2023-09-30T22:19:35.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.774+0000 7f1e86cd5700 1 Processor -- start 2023-09-30T22:19:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.774+0000 7f1e86cd5700 1 -- start start 2023-09-30T22:19:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e86cd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80096810 0x7f1e80117b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e86cd5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e80097300 0x7f1e80118060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e86cd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e80118550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e86cd5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8012dc90 con 0x7f1e80097300 2023-09-30T22:19:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e86cd5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8011a1a0 con 0x7f1e80096810 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e86cd5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8006a040 con 0x7f1e8012e2d0 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e85272700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e80118550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e80097300 0x7f1e80118060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e84a71700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80096810 0x7f1e80117b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e85272700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e80118550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59806/0 (socket says 172.21.15.154:59806) 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e80097300 0x7f1e80118060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36924/0 (socket says 172.21.15.154:36924) 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e85272700 1 -- 172.21.15.154:0/3879254602 learned_addr learned my addr 172.21.15.154:0/3879254602 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e84a71700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80096810 0x7f1e80117b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54104/0 (socket says 172.21.15.154:54104) 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e84a71700 1 -- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 msgr2=0x7f1e80118550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e84a71700 1 --2- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e80118550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e84a71700 1 -- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e80097300 msgr2=0x7f1e80118060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e84a71700 1 --2- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e80097300 0x7f1e80118060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e84a71700 1 -- 172.21.15.154:0/3879254602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78009a20 con 0x7f1e80096810 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e84a71700 1 --2- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80096810 0x7f1e80117b70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1e74000c00 tx=0x7f1e74007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e7cff9700 1 -- 172.21.15.154:0/3879254602 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740070d0 con 0x7f1e80096810 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e7cff9700 1 -- 172.21.15.154:0/3879254602 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74007250 con 0x7f1e80096810 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e7cff9700 1 -- 172.21.15.154:0/3879254602 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74007610 con 0x7f1e80096810 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c0092a0 con 0x7f1e80096810 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.775+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8011bcf0 con 0x7f1e80096810 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.776+0000 7f1e7cff9700 1 -- 172.21.15.154:0/3879254602 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1e740059b0 con 0x7f1e80096810 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.776+0000 7f1e7cff9700 1 -- 172.21.15.154:0/3879254602 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1e7403a530 con 0x7f1e80096810 2023-09-30T22:19:35.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.777+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8005a260 con 0x7f1e80096810 2023-09-30T22:19:35.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.781+0000 7f1e7cff9700 1 -- 172.21.15.154:0/3879254602 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1e74013970 con 0x7f1e80096810 2023-09-30T22:19:35.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.977+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e80067cb0 con 0x7f1e80096810 2023-09-30T22:19:35.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.977+0000 7f1e7cff9700 1 -- 172.21.15.154:0/3879254602 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f1e74010300 con 0x7f1e80096810 2023-09-30T22:19:35.978 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:35.978 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:19:33.620776+0000","modified":"2023-09-30T22:19:35.628146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:19:35.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 >> v1:172.21.15.154:6816/118163 conn(0x7f1e6402bb60 legacy=0x7f1e6402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80096810 msgr2=0x7f1e80117b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:35.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 --2- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80096810 0x7f1e80117b70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1e74000c00 tx=0x7f1e74007b90).stop 2023-09-30T22:19:35.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 shutdown_connections 2023-09-30T22:19:35.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 --2- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e8012e2d0 0x7f1e80118550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 --2- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e80096810 0x7f1e80117b70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 --2- 172.21.15.154:0/3879254602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e80097300 0x7f1e80118060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:35.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 >> 172.21.15.154:0/3879254602 conn(0x7f1e8009bad0 msgr2=0x7f1e800949d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:35.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 shutdown_connections 2023-09-30T22:19:35.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:35.979+0000 7f1e86cd5700 1 -- 172.21.15.154:0/3879254602 wait complete. 2023-09-30T22:19:35.981 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 5 2023-09-30T22:19:35.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:36.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.107+0000 7f4221a7a700 1 Processor -- start 2023-09-30T22:19:36.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.107+0000 7f4221a7a700 1 -- start start 2023-09-30T22:19:36.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.107+0000 7f4221a7a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.107+0000 7f4221a7a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f421c095b80 0x7f421c095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.107+0000 7f4221a7a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421c091980 con 0x7f421c096490 2023-09-30T22:19:36.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.107+0000 7f4221a7a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421c0973f0 con 0x7f421c095b80 2023-09-30T22:19:36.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.107+0000 7f4221a7a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f421c062ee0 con 0x7f421c062b00 2023-09-30T22:19:36.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.107+0000 7f421b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f421c095b80 0x7f421c095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59816/0 (socket says 172.21.15.154:59816) 2023-09-30T22:19:36.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421b7fe700 1 -- 172.21.15.154:0/4082957260 learned_addr learned my addr 172.21.15.154:0/4082957260 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421bfff700 1 --1- 172.21.15.154:0/4082957260 >> v1:172.21.15.154:6789/0 conn(0x7f421c096490 0x7f421c131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41606/0 (socket says 172.21.15.154:41606) 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421b7fe700 1 -- 172.21.15.154:0/4082957260 >> v2:172.21.15.154:3300/0 conn(0x7f421c095b80 msgr2=0x7f421c095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421b7fe700 1 --2- 172.21.15.154:0/4082957260 >> v2:172.21.15.154:3300/0 conn(0x7f421c095b80 0x7f421c095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421b7fe700 1 -- 172.21.15.154:0/4082957260 >> v1:172.21.15.154:6789/0 conn(0x7f421c096490 legacy=0x7f421c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421b7fe700 1 -- 172.21.15.154:0/4082957260 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c092310 con 0x7f421c062b00 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421a7fc700 1 -- 172.21.15.154:0/4082957260 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298555727 0 0) 0x7f421c091980 con 0x7f421c096490 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421affd700 1 --2- 172.21.15.154:0/4082957260 >> v2:172.21.15.154:3300/0 conn(0x7f421c095b80 0x7f421c095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421b7fe700 1 --2- 172.21.15.154:0/4082957260 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c095690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4214009830 tx=0x7f42140090f0).ready entity=mon.2 client_cookie=7c466a02f49bf596 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421a7fc700 1 -- 172.21.15.154:0/4082957260 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421400b580 con 0x7f421c062b00 2023-09-30T22:19:36.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421a7fc700 1 -- 172.21.15.154:0/4082957260 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421400b6e0 con 0x7f421c062b00 2023-09-30T22:19:36.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.108+0000 7f421a7fc700 1 -- 172.21.15.154:0/4082957260 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421400ba60 con 0x7f421c062b00 2023-09-30T22:19:36.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.109+0000 7f4221a7a700 1 -- 172.21.15.154:0/4082957260 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 msgr2=0x7f421c095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.109+0000 7f4221a7a700 1 --2- 172.21.15.154:0/4082957260 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c095690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4214009830 tx=0x7f42140090f0).stop 2023-09-30T22:19:36.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.109+0000 7f4221a7a700 1 -- 172.21.15.154:0/4082957260 shutdown_connections 2023-09-30T22:19:36.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.109+0000 7f4221a7a700 1 --2- 172.21.15.154:0/4082957260 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c095690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.109+0000 7f4221a7a700 1 --2- 172.21.15.154:0/4082957260 >> v2:172.21.15.154:3300/0 conn(0x7f421c095b80 0x7f421c095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.109+0000 7f4221a7a700 1 -- 172.21.15.154:0/4082957260 >> 172.21.15.154:0/4082957260 conn(0x7f421c09aa50 msgr2=0x7f421c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.109+0000 7f4221a7a700 1 -- 172.21.15.154:0/4082957260 shutdown_connections 2023-09-30T22:19:36.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.109+0000 7f4221a7a700 1 -- 172.21.15.154:0/4082957260 wait complete. 2023-09-30T22:19:36.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f4221a7a700 1 Processor -- start 2023-09-30T22:19:36.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f4221a7a700 1 -- start start 2023-09-30T22:19:36.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f4221a7a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c12d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f4221a7a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f421c095b80 0x7f421c1156e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f4221a7a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f421c096490 0x7f421c115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f4221a7a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c096da0 con 0x7f421c096490 2023-09-30T22:19:36.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f4221a7a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c119740 con 0x7f421c095b80 2023-09-30T22:19:36.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f4221a7a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f421c119180 con 0x7f421c062b00 2023-09-30T22:19:36.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f421bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f421c096490 0x7f421c115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f421b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c12d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f421affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f421c095b80 0x7f421c1156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f421affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f421c095b80 0x7f421c1156e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54108/0 (socket says 172.21.15.154:54108) 2023-09-30T22:19:36.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f421bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f421c096490 0x7f421c115bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36940/0 (socket says 172.21.15.154:36940) 2023-09-30T22:19:36.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f421b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c12d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59826/0 (socket says 172.21.15.154:59826) 2023-09-30T22:19:36.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.110+0000 7f421affd700 1 -- 172.21.15.154:0/3471987606 learned_addr learned my addr 172.21.15.154:0/3471987606 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:36.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f421b7fe700 1 -- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f421c095b80 msgr2=0x7f421c1156e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f421b7fe700 1 --2- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f421c095b80 0x7f421c1156e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f421b7fe700 1 -- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f421c096490 msgr2=0x7f421c115bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f421b7fe700 1 --2- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f421c096490 0x7f421c115bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f421b7fe700 1 -- 172.21.15.154:0/3471987606 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204009a20 con 0x7f421c062b00 2023-09-30T22:19:36.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f421bfff700 1 --2- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f421c096490 0x7f421c115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:36.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f421b7fe700 1 --2- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c12d780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4214006fd0 tx=0x7f4214017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:36.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f42137fe700 1 -- 172.21.15.154:0/3471987606 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214000bc0 con 0x7f421c062b00 2023-09-30T22:19:36.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f42137fe700 1 -- 172.21.15.154:0/3471987606 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421400b850 con 0x7f421c062b00 2023-09-30T22:19:36.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4214009370 con 0x7f421c062b00 2023-09-30T22:19:36.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f42137fe700 1 -- 172.21.15.154:0/3471987606 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214000d20 con 0x7f421c062b00 2023-09-30T22:19:36.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.111+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c118be0 con 0x7f421c062b00 2023-09-30T22:19:36.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.112+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c05a260 con 0x7f421c062b00 2023-09-30T22:19:36.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.112+0000 7f42137fe700 1 -- 172.21.15.154:0/3471987606 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f421401ca90 con 0x7f421c062b00 2023-09-30T22:19:36.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.112+0000 7f42137fe700 1 -- 172.21.15.154:0/3471987606 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f421403d1d0 con 0x7f421c062b00 2023-09-30T22:19:36.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.116+0000 7f42137fe700 1 -- 172.21.15.154:0/3471987606 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4214006a40 con 0x7f421c062b00 2023-09-30T22:19:36.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.273+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f421c1164e0 con 0x7f421c062b00 2023-09-30T22:19:36.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.274+0000 7f42137fe700 1 -- 172.21.15.154:0/3471987606 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f421402a030 con 0x7f421c062b00 2023-09-30T22:19:36.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:36.276 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:34.624706+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:36.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 >> v1:172.21.15.154:6816/118163 conn(0x7f420002bb60 legacy=0x7f420002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 msgr2=0x7f421c12d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 --2- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c12d780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4214006fd0 tx=0x7f4214017000).stop 2023-09-30T22:19:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 shutdown_connections 2023-09-30T22:19:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 --2- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f421c096490 0x7f421c115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 --2- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f421c062b00 0x7f421c12d780 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 --2- 172.21.15.154:0/3471987606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f421c095b80 0x7f421c1156e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 >> 172.21.15.154:0/3471987606 conn(0x7f421c09aa50 msgr2=0x7f421c12ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 shutdown_connections 2023-09-30T22:19:36.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.276+0000 7f4221a7a700 1 -- 172.21.15.154:0/3471987606 wait complete. 2023-09-30T22:19:36.289 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T22:19:36.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:19:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.405+0000 7f4686a8e700 1 Processor -- start 2023-09-30T22:19:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.405+0000 7f4686a8e700 1 -- start start 2023-09-30T22:19:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.405+0000 7f4686a8e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680097790 0x7f468012b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.405+0000 7f4686a8e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f468012b540 0x7f4680127560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.405+0000 7f4686a8e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468012ae10 con 0x7f4680127a50 2023-09-30T22:19:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.405+0000 7f4686a8e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468012b940 con 0x7f468012b540 2023-09-30T22:19:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.405+0000 7f4686a8e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4680064b30 con 0x7f4680097790 2023-09-30T22:19:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f468012b540 0x7f4680127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f468502b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4680127a50 0x7f4680127ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41610/0 (socket says 172.21.15.154:41610) 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f468502b700 1 -- 172.21.15.154:0/550674391 learned_addr learned my addr 172.21.15.154:0/550674391 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f468482a700 1 --2- 172.21.15.154:0/550674391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680097790 0x7f468012b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467ffff700 1 -- 172.21.15.154:0/550674391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680097790 msgr2=0x7f468012b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467ffff700 1 --2- 172.21.15.154:0/550674391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680097790 0x7f468012b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467ffff700 1 -- 172.21.15.154:0/550674391 >> v1:172.21.15.154:6789/0 conn(0x7f4680127a50 legacy=0x7f4680127ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467ffff700 1 -- 172.21.15.154:0/550674391 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4680065750 con 0x7f468012b540 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467f7fe700 1 -- 172.21.15.154:0/550674391 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581897644 0 0) 0x7f4678001490 con 0x7f4680127a50 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467ffff700 1 --2- 172.21.15.154:0/550674391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468012b540 0x7f4680127560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f466c009760 tx=0x7f466c009060).ready entity=mon.0 client_cookie=ca29e5fa60cf09c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467f7fe700 1 -- 172.21.15.154:0/550674391 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00f510 con 0x7f468012b540 2023-09-30T22:19:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467f7fe700 1 -- 172.21.15.154:0/550674391 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c00f670 con 0x7f468012b540 2023-09-30T22:19:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.406+0000 7f467f7fe700 1 -- 172.21.15.154:0/550674391 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00f9f0 con 0x7f468012b540 2023-09-30T22:19:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.407+0000 7f4686a8e700 1 -- 172.21.15.154:0/550674391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468012b540 msgr2=0x7f4680127560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.407+0000 7f4686a8e700 1 --2- 172.21.15.154:0/550674391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468012b540 0x7f4680127560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f466c009760 tx=0x7f466c009060).stop 2023-09-30T22:19:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.407+0000 7f4686a8e700 1 -- 172.21.15.154:0/550674391 shutdown_connections 2023-09-30T22:19:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.407+0000 7f4686a8e700 1 --2- 172.21.15.154:0/550674391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680097790 0x7f468012b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.407+0000 7f4686a8e700 1 --2- 172.21.15.154:0/550674391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468012b540 0x7f4680127560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.407+0000 7f4686a8e700 1 -- 172.21.15.154:0/550674391 >> 172.21.15.154:0/550674391 conn(0x7f468009bad0 msgr2=0x7f468009bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.407+0000 7f4686a8e700 1 -- 172.21.15.154:0/550674391 shutdown_connections 2023-09-30T22:19:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.407+0000 7f4686a8e700 1 -- 172.21.15.154:0/550674391 wait complete. 2023-09-30T22:19:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.407+0000 7f4686a8e700 1 Processor -- start 2023-09-30T22:19:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f4686a8e700 1 -- start start 2023-09-30T22:19:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f4686a8e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4680097790 0x7f4680113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f4686a8e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680127a50 0x7f4680113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f4686a8e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f468012b540 0x7f4680114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f4686a8e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680124bc0 con 0x7f4680097790 2023-09-30T22:19:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f4686a8e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4680065130 con 0x7f468012b540 2023-09-30T22:19:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f4686a8e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4680117590 con 0x7f4680127a50 2023-09-30T22:19:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f468482a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4680097790 0x7f4680113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f468482a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4680097790 0x7f4680113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36950/0 (socket says 172.21.15.154:36950) 2023-09-30T22:19:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f468482a700 1 -- 172.21.15.154:0/1794567930 learned_addr learned my addr 172.21.15.154:0/1794567930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f467ffff700 1 --2- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680127a50 0x7f4680113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f468502b700 1 --2- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f468012b540 0x7f4680114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f468482a700 1 -- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680127a50 msgr2=0x7f4680113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f468482a700 1 --2- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680127a50 0x7f4680113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f468482a700 1 -- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f468012b540 msgr2=0x7f4680114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f468482a700 1 --2- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f468012b540 0x7f4680114440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.408+0000 7f468482a700 1 -- 172.21.15.154:0/1794567930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c0092a0 con 0x7f4680097790 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.409+0000 7f468482a700 1 --2- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4680097790 0x7f4680113a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f467400e930 tx=0x7f4674009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.409+0000 7f467cff9700 1 -- 172.21.15.154:0/1794567930 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674012600 con 0x7f4680097790 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.409+0000 7f467cff9700 1 -- 172.21.15.154:0/1794567930 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674012760 con 0x7f4680097790 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.409+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4680116ff0 con 0x7f4680097790 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.409+0000 7f467cff9700 1 -- 172.21.15.154:0/1794567930 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674012ae0 con 0x7f4680097790 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.409+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4680117e30 con 0x7f4680097790 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.409+0000 7f467cff9700 1 -- 172.21.15.154:0/1794567930 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f467401b400 con 0x7f4680097790 2023-09-30T22:19:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.410+0000 7f467cff9700 1 -- 172.21.15.154:0/1794567930 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f467403b2c0 con 0x7f4680097790 2023-09-30T22:19:36.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.410+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4680117e30 con 0x7f4680097790 2023-09-30T22:19:36.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.414+0000 7f467cff9700 1 -- 172.21.15.154:0/1794567930 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4680117e30 con 0x7f4680097790 2023-09-30T22:19:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.567+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 --> v1:172.21.15.154:6816/118163 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f468009a2c0 con 0x7f466402bb60 2023-09-30T22:19:36.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.574+0000 7f467cff9700 1 -- 172.21.15.154:0/1794567930 <== mgr.4101 v1:172.21.15.154:6816/118163 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243831 (unknown 2965378022 0 2327761928) 0x7f468009a2c0 con 0x7f466402bb60 2023-09-30T22:19:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.576+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 >> v1:172.21.15.154:6816/118163 conn(0x7f466402bb60 legacy=0x7f466402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.576+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4680097790 msgr2=0x7f4680113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.576+0000 7f4686a8e700 1 --2- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4680097790 0x7f4680113a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f467400e930 tx=0x7f4674009060).stop 2023-09-30T22:19:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.576+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 shutdown_connections 2023-09-30T22:19:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.576+0000 7f4686a8e700 1 --2- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f468012b540 0x7f4680114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.576+0000 7f4686a8e700 1 --2- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4680097790 0x7f4680113a60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.576+0000 7f4686a8e700 1 --2- 172.21.15.154:0/1794567930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4680127a50 0x7f4680113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.576+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 >> 172.21.15.154:0/1794567930 conn(0x7f468009bad0 msgr2=0x7f468012a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.577+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 shutdown_connections 2023-09-30T22:19:36.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.577+0000 7f4686a8e700 1 -- 172.21.15.154:0/1794567930 wait complete. 2023-09-30T22:19:36.582 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-09-30T22:19:36.589 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-09-30T22:19:35.213681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266986+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265634+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260906+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266242+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261473+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265820+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261590+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.262931+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267510+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.262405+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266259+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265825+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261030+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260833+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265706+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261703+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261198+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260435+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260392+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253388+0000","last_change":"2023-09-30T22:19:30.188504+0000","last_active":"2023-09-30T22:19:30.253388+0000","last_peered":"2023-09-30T22:19:30.253388+0000","last_clean":"2023-09-30T22:19:30.253388+0000","last_became_active":"2023-09-30T22:19:30.188218+0000","last_became_peered":"2023-09-30T22:19:30.188218+0000","last_unstale":"2023-09-30T22:19:30.253388+0000","last_undegraded":"2023-09-30T22:19:30.253388+0000","last_fullsized":"2023-09-30T22:19:30.253388+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260978+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277777+0000","last_change":"2023-09-30T22:19:29.250128+0000","last_active":"2023-09-30T22:19:30.277777+0000","last_peered":"2023-09-30T22:19:30.277777+0000","last_clean":"2023-09-30T22:19:30.277777+0000","last_became_active":"2023-09-30T22:19:29.249745+0000","last_became_peered":"2023-09-30T22:19:29.249745+0000","last_unstale":"2023-09-30T22:19:30.277777+0000","last_undegraded":"2023-09-30T22:19:30.277777+0000","last_fullsized":"2023-09-30T22:19:30.277777+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267257+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.251725+0000","last_change":"2023-09-30T22:19:29.249638+0000","last_active":"2023-09-30T22:19:30.251725+0000","last_peered":"2023-09-30T22:19:30.251725+0000","last_clean":"2023-09-30T22:19:30.251725+0000","last_became_active":"2023-09-30T22:19:29.249366+0000","last_became_peered":"2023-09-30T22:19:29.249366+0000","last_unstale":"2023-09-30T22:19:30.251725+0000","last_undegraded":"2023-09-30T22:19:30.251725+0000","last_fullsized":"2023-09-30T22:19:30.251725+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265911+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277775+0000","last_change":"2023-09-30T22:19:29.249647+0000","last_active":"2023-09-30T22:19:30.277775+0000","last_peered":"2023-09-30T22:19:30.277775+0000","last_clean":"2023-09-30T22:19:30.277775+0000","last_became_active":"2023-09-30T22:19:29.249371+0000","last_became_peered":"2023-09-30T22:19:29.249371+0000","last_unstale":"2023-09-30T22:19:30.277775+0000","last_undegraded":"2023-09-30T22:19:30.277775+0000","last_fullsized":"2023-09-30T22:19:30.277775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253387+0000","last_change":"2023-09-30T22:19:30.188360+0000","last_active":"2023-09-30T22:19:30.253387+0000","last_peered":"2023-09-30T22:19:30.253387+0000","last_clean":"2023-09-30T22:19:30.253387+0000","last_became_active":"2023-09-30T22:19:30.187849+0000","last_became_peered":"2023-09-30T22:19:30.187849+0000","last_unstale":"2023-09-30T22:19:30.253387+0000","last_undegraded":"2023-09-30T22:19:30.253387+0000","last_fullsized":"2023-09-30T22:19:30.253387+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260814+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277786+0000","last_change":"2023-09-30T22:19:29.250622+0000","last_active":"2023-09-30T22:19:30.277786+0000","last_peered":"2023-09-30T22:19:30.277786+0000","last_clean":"2023-09-30T22:19:30.277786+0000","last_became_active":"2023-09-30T22:19:29.250370+0000","last_became_peered":"2023-09-30T22:19:29.250370+0000","last_unstale":"2023-09-30T22:19:30.277786+0000","last_undegraded":"2023-09-30T22:19:30.277786+0000","last_fullsized":"2023-09-30T22:19:30.277786+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265885+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.278117+0000","last_change":"2023-09-30T22:19:30.188159+0000","last_active":"2023-09-30T22:19:30.278117+0000","last_peered":"2023-09-30T22:19:30.278117+0000","last_clean":"2023-09-30T22:19:30.278117+0000","last_became_active":"2023-09-30T22:19:30.187869+0000","last_became_peered":"2023-09-30T22:19:30.187869+0000","last_unstale":"2023-09-30T22:19:30.278117+0000","last_undegraded":"2023-09-30T22:19:30.278117+0000","last_fullsized":"2023-09-30T22:19:30.278117+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267501+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261602+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253402+0000","last_change":"2023-09-30T22:19:30.190576+0000","last_active":"2023-09-30T22:19:30.253402+0000","last_peered":"2023-09-30T22:19:30.253402+0000","last_clean":"2023-09-30T22:19:30.253402+0000","last_became_active":"2023-09-30T22:19:30.190289+0000","last_became_peered":"2023-09-30T22:19:30.190289+0000","last_unstale":"2023-09-30T22:19:30.253402+0000","last_undegraded":"2023-09-30T22:19:30.253402+0000","last_fullsized":"2023-09-30T22:19:30.253402+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277792+0000","last_change":"2023-09-30T22:19:30.188129+0000","last_active":"2023-09-30T22:19:30.277792+0000","last_peered":"2023-09-30T22:19:30.277792+0000","last_clean":"2023-09-30T22:19:30.277792+0000","last_became_active":"2023-09-30T22:19:30.187818+0000","last_became_peered":"2023-09-30T22:19:30.187818+0000","last_unstale":"2023-09-30T22:19:30.277792+0000","last_undegraded":"2023-09-30T22:19:30.277792+0000","last_fullsized":"2023-09-30T22:19:30.277792+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266300+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266691+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267886+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261226+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261315+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266640+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:19:36.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:19:36.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.745+0000 7f36852b6700 1 Processor -- start 2023-09-30T22:19:36.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.745+0000 7f36852b6700 1 -- start start 2023-09-30T22:19:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.745+0000 7f36852b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127420 0x7f368012fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.745+0000 7f36852b6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127860 0x7f3680132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.745+0000 7f36852b6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800657e0 con 0x7f36800662a0 2023-09-30T22:19:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.745+0000 7f36852b6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3680066680 con 0x7f3680127420 2023-09-30T22:19:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.745+0000 7f36852b6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3680065340 con 0x7f3680127860 2023-09-30T22:19:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127860 0x7f3680132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367e7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127420 0x7f368012fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127860 0x7f3680132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59866/0 (socket says 172.21.15.154:59866) 2023-09-30T22:19:36.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367effd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f36800662a0 0x7f3680127d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41616/0 (socket says 172.21.15.154:41616) 2023-09-30T22:19:36.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367e7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127420 0x7f368012fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54138/0 (socket says 172.21.15.154:54138) 2023-09-30T22:19:36.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367f7fe700 1 -- 172.21.15.154:0/4099242643 learned_addr learned my addr 172.21.15.154:0/4099242643 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:36.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367dffb700 1 -- 172.21.15.154:0/4099242643 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203931381 0 0) 0x7f36800657e0 con 0x7f36800662a0 2023-09-30T22:19:36.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367e7fc700 1 -- 172.21.15.154:0/4099242643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127860 msgr2=0x7f3680132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:36.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367e7fc700 1 --2- 172.21.15.154:0/4099242643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127860 0x7f3680132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367e7fc700 1 -- 172.21.15.154:0/4099242643 >> v1:172.21.15.154:6789/0 conn(0x7f36800662a0 legacy=0x7f3680127d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367e7fc700 1 -- 172.21.15.154:0/4099242643 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800981c0 con 0x7f3680127420 2023-09-30T22:19:36.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367f7fe700 1 --2- 172.21.15.154:0/4099242643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127860 0x7f3680132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:36.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367e7fc700 1 --2- 172.21.15.154:0/4099242643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127420 0x7f368012fd10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3670009790 tx=0x7f3670009060).ready entity=mon.1 client_cookie=dcc99497f9522ee6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:36.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367dffb700 1 -- 172.21.15.154:0/4099242643 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700090d0 con 0x7f3680127420 2023-09-30T22:19:36.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367dffb700 1 -- 172.21.15.154:0/4099242643 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367000f510 con 0x7f3680127420 2023-09-30T22:19:36.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.746+0000 7f367dffb700 1 -- 172.21.15.154:0/4099242643 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367000f890 con 0x7f3680127420 2023-09-30T22:19:36.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.747+0000 7f36852b6700 1 -- 172.21.15.154:0/4099242643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127420 msgr2=0x7f368012fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.747+0000 7f36852b6700 1 --2- 172.21.15.154:0/4099242643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127420 0x7f368012fd10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3670009790 tx=0x7f3670009060).stop 2023-09-30T22:19:36.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.747+0000 7f36852b6700 1 -- 172.21.15.154:0/4099242643 shutdown_connections 2023-09-30T22:19:36.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.747+0000 7f36852b6700 1 --2- 172.21.15.154:0/4099242643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127860 0x7f3680132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.747+0000 7f36852b6700 1 --2- 172.21.15.154:0/4099242643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127420 0x7f368012fd10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.747+0000 7f36852b6700 1 -- 172.21.15.154:0/4099242643 >> 172.21.15.154:0/4099242643 conn(0x7f368009ba60 msgr2=0x7f368009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.747+0000 7f36852b6700 1 -- 172.21.15.154:0/4099242643 shutdown_connections 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.747+0000 7f36852b6700 1 -- 172.21.15.154:0/4099242643 wait complete. 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f36852b6700 1 Processor -- start 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f36852b6700 1 -- start start 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f36852b6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800662a0 0x7f3680112130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f36852b6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127420 0x7f368012dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f36852b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127860 0x7f368012e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f36852b6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680065190 con 0x7f36800662a0 2023-09-30T22:19:36.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f36852b6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3680131310 con 0x7f3680127860 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f36852b6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3680130f70 con 0x7f3680127420 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127420 0x7f368012dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127420 0x7f368012dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59878/0 (socket says 172.21.15.154:59878) 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127860 0x7f368012e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367e7fc700 1 -- 172.21.15.154:0/4240833516 learned_addr learned my addr 172.21.15.154:0/4240833516 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367effd700 1 --2- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800662a0 0x7f3680112130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367e7fc700 1 -- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127860 msgr2=0x7f368012e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367e7fc700 1 --2- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127860 0x7f368012e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367e7fc700 1 -- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800662a0 msgr2=0x7f3680112130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367e7fc700 1 --2- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800662a0 0x7f3680112130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.748+0000 7f367e7fc700 1 -- 172.21.15.154:0/4240833516 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3678009ae0 con 0x7f3680127420 2023-09-30T22:19:36.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.749+0000 7f367e7fc700 1 --2- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127420 0x7f368012dd80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3670011000 tx=0x7f3670017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:36.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.749+0000 7f3666ffd700 1 -- 172.21.15.154:0/4240833516 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367000f890 con 0x7f3680127420 2023-09-30T22:19:36.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.749+0000 7f3666ffd700 1 -- 172.21.15.154:0/4240833516 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670000d10 con 0x7f3680127420 2023-09-30T22:19:36.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.749+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36700092a0 con 0x7f3680127420 2023-09-30T22:19:36.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.749+0000 7f3666ffd700 1 -- 172.21.15.154:0/4240833516 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367000fea0 con 0x7f3680127420 2023-09-30T22:19:36.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.749+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368012f9a0 con 0x7f3680127420 2023-09-30T22:19:36.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.750+0000 7f3666ffd700 1 -- 172.21.15.154:0/4240833516 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f367001c630 con 0x7f3680127420 2023-09-30T22:19:36.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.750+0000 7f3666ffd700 1 -- 172.21.15.154:0/4240833516 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f367003c4e0 con 0x7f3680127420 2023-09-30T22:19:36.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.750+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368005a260 con 0x7f3680127420 2023-09-30T22:19:36.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.754+0000 7f3666ffd700 1 -- 172.21.15.154:0/4240833516 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f367001a3d0 con 0x7f3680127420 2023-09-30T22:19:36.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.908+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 --> v1:172.21.15.154:6816/118163 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3680046c20 con 0x7f366c02bb60 2023-09-30T22:19:36.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.914+0000 7f3666ffd700 1 -- 172.21.15.154:0/4240833516 <== mgr.4101 v1:172.21.15.154:6816/118163 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243831 (unknown 2965378022 0 2327761928) 0x7f3680046c20 con 0x7f366c02bb60 2023-09-30T22:19:36.918 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:36.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 >> v1:172.21.15.154:6816/118163 conn(0x7f366c02bb60 legacy=0x7f366c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127420 msgr2=0x7f368012dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:36.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 --2- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127420 0x7f368012dd80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3670011000 tx=0x7f3670017000).stop 2023-09-30T22:19:36.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 shutdown_connections 2023-09-30T22:19:36.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 --2- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680127860 0x7f368012e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 --2- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800662a0 0x7f3680112130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 --2- 172.21.15.154:0/4240833516 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3680127420 0x7f368012dd80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:36.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 >> 172.21.15.154:0/4240833516 conn(0x7f368009ba60 msgr2=0x7f3680069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:36.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 shutdown_connections 2023-09-30T22:19:36.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:36.917+0000 7f36852b6700 1 -- 172.21.15.154:0/4240833516 wait complete. 2023-09-30T22:19:36.921 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-09-30T22:19:36.929 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-09-30T22:19:35.213681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266986+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265634+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260906+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266242+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261473+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265820+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261590+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.262931+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267510+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.262405+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266259+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265825+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261030+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260833+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265706+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261703+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261198+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260435+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260392+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253388+0000","last_change":"2023-09-30T22:19:30.188504+0000","last_active":"2023-09-30T22:19:30.253388+0000","last_peered":"2023-09-30T22:19:30.253388+0000","last_clean":"2023-09-30T22:19:30.253388+0000","last_became_active":"2023-09-30T22:19:30.188218+0000","last_became_peered":"2023-09-30T22:19:30.188218+0000","last_unstale":"2023-09-30T22:19:30.253388+0000","last_undegraded":"2023-09-30T22:19:30.253388+0000","last_fullsized":"2023-09-30T22:19:30.253388+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260978+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277777+0000","last_change":"2023-09-30T22:19:29.250128+0000","last_active":"2023-09-30T22:19:30.277777+0000","last_peered":"2023-09-30T22:19:30.277777+0000","last_clean":"2023-09-30T22:19:30.277777+0000","last_became_active":"2023-09-30T22:19:29.249745+0000","last_became_peered":"2023-09-30T22:19:29.249745+0000","last_unstale":"2023-09-30T22:19:30.277777+0000","last_undegraded":"2023-09-30T22:19:30.277777+0000","last_fullsized":"2023-09-30T22:19:30.277777+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267257+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.251725+0000","last_change":"2023-09-30T22:19:29.249638+0000","last_active":"2023-09-30T22:19:30.251725+0000","last_peered":"2023-09-30T22:19:30.251725+0000","last_clean":"2023-09-30T22:19:30.251725+0000","last_became_active":"2023-09-30T22:19:29.249366+0000","last_became_peered":"2023-09-30T22:19:29.249366+0000","last_unstale":"2023-09-30T22:19:30.251725+0000","last_undegraded":"2023-09-30T22:19:30.251725+0000","last_fullsized":"2023-09-30T22:19:30.251725+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265911+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277775+0000","last_change":"2023-09-30T22:19:29.249647+0000","last_active":"2023-09-30T22:19:30.277775+0000","last_peered":"2023-09-30T22:19:30.277775+0000","last_clean":"2023-09-30T22:19:30.277775+0000","last_became_active":"2023-09-30T22:19:29.249371+0000","last_became_peered":"2023-09-30T22:19:29.249371+0000","last_unstale":"2023-09-30T22:19:30.277775+0000","last_undegraded":"2023-09-30T22:19:30.277775+0000","last_fullsized":"2023-09-30T22:19:30.277775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253387+0000","last_change":"2023-09-30T22:19:30.188360+0000","last_active":"2023-09-30T22:19:30.253387+0000","last_peered":"2023-09-30T22:19:30.253387+0000","last_clean":"2023-09-30T22:19:30.253387+0000","last_became_active":"2023-09-30T22:19:30.187849+0000","last_became_peered":"2023-09-30T22:19:30.187849+0000","last_unstale":"2023-09-30T22:19:30.253387+0000","last_undegraded":"2023-09-30T22:19:30.253387+0000","last_fullsized":"2023-09-30T22:19:30.253387+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260814+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277786+0000","last_change":"2023-09-30T22:19:29.250622+0000","last_active":"2023-09-30T22:19:30.277786+0000","last_peered":"2023-09-30T22:19:30.277786+0000","last_clean":"2023-09-30T22:19:30.277786+0000","last_became_active":"2023-09-30T22:19:29.250370+0000","last_became_peered":"2023-09-30T22:19:29.250370+0000","last_unstale":"2023-09-30T22:19:30.277786+0000","last_undegraded":"2023-09-30T22:19:30.277786+0000","last_fullsized":"2023-09-30T22:19:30.277786+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265885+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.278117+0000","last_change":"2023-09-30T22:19:30.188159+0000","last_active":"2023-09-30T22:19:30.278117+0000","last_peered":"2023-09-30T22:19:30.278117+0000","last_clean":"2023-09-30T22:19:30.278117+0000","last_became_active":"2023-09-30T22:19:30.187869+0000","last_became_peered":"2023-09-30T22:19:30.187869+0000","last_unstale":"2023-09-30T22:19:30.278117+0000","last_undegraded":"2023-09-30T22:19:30.278117+0000","last_fullsized":"2023-09-30T22:19:30.278117+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267501+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261602+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253402+0000","last_change":"2023-09-30T22:19:30.190576+0000","last_active":"2023-09-30T22:19:30.253402+0000","last_peered":"2023-09-30T22:19:30.253402+0000","last_clean":"2023-09-30T22:19:30.253402+0000","last_became_active":"2023-09-30T22:19:30.190289+0000","last_became_peered":"2023-09-30T22:19:30.190289+0000","last_unstale":"2023-09-30T22:19:30.253402+0000","last_undegraded":"2023-09-30T22:19:30.253402+0000","last_fullsized":"2023-09-30T22:19:30.253402+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277792+0000","last_change":"2023-09-30T22:19:30.188129+0000","last_active":"2023-09-30T22:19:30.277792+0000","last_peered":"2023-09-30T22:19:30.277792+0000","last_clean":"2023-09-30T22:19:30.277792+0000","last_became_active":"2023-09-30T22:19:30.187818+0000","last_became_peered":"2023-09-30T22:19:30.187818+0000","last_unstale":"2023-09-30T22:19:30.277792+0000","last_undegraded":"2023-09-30T22:19:30.277792+0000","last_fullsized":"2023-09-30T22:19:30.277792+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266300+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266691+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267886+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261226+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261315+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266640+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:19:36.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:19:37.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.085+0000 7f4b9034f700 1 Processor -- start 2023-09-30T22:19:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.085+0000 7f4b9034f700 1 -- start start 2023-09-30T22:19:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.085+0000 7f4b9034f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b88066e30 0x7f4b88067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.085+0000 7f4b9034f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88068680 0x7f4b88067700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.085+0000 7f4b9034f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88128a10 0x7f4b88128ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.085+0000 7f4b9034f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b88069090 con 0x7f4b88066e30 2023-09-30T22:19:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.085+0000 7f4b9034f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880694e0 con 0x7f4b88128a10 2023-09-30T22:19:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.085+0000 7f4b9034f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88094130 con 0x7f4b88068680 2023-09-30T22:19:37.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e0eb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b88066e30 0x7f4b88067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8d8ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88068680 0x7f4b88067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e8ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88128a10 0x7f4b88128ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e8ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88128a10 0x7f4b88128ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54164/0 (socket says 172.21.15.154:54164) 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e0eb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b88066e30 0x7f4b88067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36974/0 (socket says 172.21.15.154:36974) 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8d8ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88068680 0x7f4b88067700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59882/0 (socket says 172.21.15.154:59882) 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e8ec700 1 -- 172.21.15.154:0/3842117866 learned_addr learned my addr 172.21.15.154:0/3842117866 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e8ec700 1 -- 172.21.15.154:0/3842117866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88068680 msgr2=0x7f4b88067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e8ec700 1 --2- 172.21.15.154:0/3842117866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88068680 0x7f4b88067700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e8ec700 1 -- 172.21.15.154:0/3842117866 >> v2:172.21.15.154:3300/0 conn(0x7f4b88066e30 msgr2=0x7f4b88067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e8ec700 1 --2- 172.21.15.154:0/3842117866 >> v2:172.21.15.154:3300/0 conn(0x7f4b88066e30 0x7f4b88067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e8ec700 1 -- 172.21.15.154:0/3842117866 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88069a10 con 0x7f4b88128a10 2023-09-30T22:19:37.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e0eb700 1 --2- 172.21.15.154:0/3842117866 >> v2:172.21.15.154:3300/0 conn(0x7f4b88066e30 0x7f4b88067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8d8ea700 1 --2- 172.21.15.154:0/3842117866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88068680 0x7f4b88067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8e8ec700 1 --2- 172.21.15.154:0/3842117866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88128a10 0x7f4b88128ea0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4b80009f20 tx=0x7f4b80009840).ready entity=mon.1 client_cookie=fbc41aa8a058043d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8d0e9700 1 -- 172.21.15.154:0/3842117866 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000e070 con 0x7f4b88128a10 2023-09-30T22:19:37.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8d0e9700 1 -- 172.21.15.154:0/3842117866 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8000b910 con 0x7f4b88128a10 2023-09-30T22:19:37.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.086+0000 7f4b8d0e9700 1 -- 172.21.15.154:0/3842117866 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000bc90 con 0x7f4b88128a10 2023-09-30T22:19:37.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.087+0000 7f4b9034f700 1 -- 172.21.15.154:0/3842117866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88128a10 msgr2=0x7f4b88128ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.087+0000 7f4b9034f700 1 --2- 172.21.15.154:0/3842117866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88128a10 0x7f4b88128ea0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4b80009f20 tx=0x7f4b80009840).stop 2023-09-30T22:19:37.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.087+0000 7f4b9034f700 1 -- 172.21.15.154:0/3842117866 shutdown_connections 2023-09-30T22:19:37.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.087+0000 7f4b9034f700 1 --2- 172.21.15.154:0/3842117866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88128a10 0x7f4b88128ea0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.087+0000 7f4b9034f700 1 --2- 172.21.15.154:0/3842117866 >> v2:172.21.15.154:3300/0 conn(0x7f4b88066e30 0x7f4b88067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.087+0000 7f4b9034f700 1 --2- 172.21.15.154:0/3842117866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88068680 0x7f4b88067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.087+0000 7f4b9034f700 1 -- 172.21.15.154:0/3842117866 >> 172.21.15.154:0/3842117866 conn(0x7f4b8809a230 msgr2=0x7f4b8809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.087+0000 7f4b9034f700 1 -- 172.21.15.154:0/3842117866 shutdown_connections 2023-09-30T22:19:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.087+0000 7f4b9034f700 1 -- 172.21.15.154:0/3842117866 wait complete. 2023-09-30T22:19:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b9034f700 1 Processor -- start 2023-09-30T22:19:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b9034f700 1 -- start start 2023-09-30T22:19:37.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b9034f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88066e30 0x7f4b88128250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b9034f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88068680 0x7f4b880919b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b9034f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88128a10 0x7f4b88091ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b9034f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8811ca00 con 0x7f4b88068680 2023-09-30T22:19:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b9034f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8811c4b0 con 0x7f4b88066e30 2023-09-30T22:19:37.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b9034f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880994b0 con 0x7f4b88128a10 2023-09-30T22:19:37.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b8e0eb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88066e30 0x7f4b88128250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b8d8ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88068680 0x7f4b880919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b8e0eb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88066e30 0x7f4b88128250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54170/0 (socket says 172.21.15.154:54170) 2023-09-30T22:19:37.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b8e0eb700 1 -- 172.21.15.154:0/1537906825 learned_addr learned my addr 172.21.15.154:0/1537906825 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:37.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b8e8ec700 1 --2- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88128a10 0x7f4b88091ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b8d8ea700 1 -- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88128a10 msgr2=0x7f4b88091ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.088+0000 7f4b8d8ea700 1 --2- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88128a10 0x7f4b88091ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.089+0000 7f4b8d8ea700 1 -- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88066e30 msgr2=0x7f4b88128250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.089+0000 7f4b8d8ea700 1 --2- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88066e30 0x7f4b88128250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.089+0000 7f4b8d8ea700 1 -- 172.21.15.154:0/1537906825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b840092a0 con 0x7f4b88068680 2023-09-30T22:19:37.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.089+0000 7f4b8d8ea700 1 --2- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88068680 0x7f4b880919b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4b7800e950 tx=0x7f4b78009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.089+0000 7f4b7e7fc700 1 -- 172.21.15.154:0/1537906825 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78009580 con 0x7f4b88068680 2023-09-30T22:19:37.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.089+0000 7f4b7e7fc700 1 -- 172.21.15.154:0/1537906825 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78012600 con 0x7f4b88068680 2023-09-30T22:19:37.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.089+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b780092a0 con 0x7f4b88068680 2023-09-30T22:19:37.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.089+0000 7f4b7e7fc700 1 -- 172.21.15.154:0/1537906825 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78012980 con 0x7f4b88068680 2023-09-30T22:19:37.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.089+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b80009ae0 con 0x7f4b88068680 2023-09-30T22:19:37.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.090+0000 7f4b7e7fc700 1 -- 172.21.15.154:0/1537906825 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4b78012d30 con 0x7f4b88068680 2023-09-30T22:19:37.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.090+0000 7f4b7e7fc700 1 -- 172.21.15.154:0/1537906825 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4b7803b4b0 con 0x7f4b88068680 2023-09-30T22:19:37.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.090+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b88093550 con 0x7f4b88068680 2023-09-30T22:19:37.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.094+0000 7f4b7e7fc700 1 -- 172.21.15.154:0/1537906825 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4b78019310 con 0x7f4b88068680 2023-09-30T22:19:37.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.249+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 --> v1:172.21.15.154:6816/118163 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b8805a260 con 0x7f4b6c02bb60 2023-09-30T22:19:37.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.255+0000 7f4b7e7fc700 1 -- 172.21.15.154:0/1537906825 <== mgr.4101 v1:172.21.15.154:6816/118163 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243831 (unknown 2965378022 0 3935667014) 0x7f4b8805a260 con 0x7f4b6c02bb60 2023-09-30T22:19:37.258 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:37.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 >> v1:172.21.15.154:6816/118163 conn(0x7f4b6c02bb60 legacy=0x7f4b6c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88068680 msgr2=0x7f4b880919b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 --2- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88068680 0x7f4b880919b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4b7800e950 tx=0x7f4b78009060).stop 2023-09-30T22:19:37.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 shutdown_connections 2023-09-30T22:19:37.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 --2- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b88128a10 0x7f4b88091ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 --2- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b88066e30 0x7f4b88128250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 --2- 172.21.15.154:0/1537906825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88068680 0x7f4b880919b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 >> 172.21.15.154:0/1537906825 conn(0x7f4b8809a230 msgr2=0x7f4b88110890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 shutdown_connections 2023-09-30T22:19:37.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.258+0000 7f4b9034f700 1 -- 172.21.15.154:0/1537906825 wait complete. 2023-09-30T22:19:37.261 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-09-30T22:19:37.270 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-09-30T22:19:37.213993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266986+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265634+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260906+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266242+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261473+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265820+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261590+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.262931+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267510+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.262405+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266259+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265825+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261030+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260833+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265706+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261703+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261198+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260435+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260392+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253388+0000","last_change":"2023-09-30T22:19:30.188504+0000","last_active":"2023-09-30T22:19:30.253388+0000","last_peered":"2023-09-30T22:19:30.253388+0000","last_clean":"2023-09-30T22:19:30.253388+0000","last_became_active":"2023-09-30T22:19:30.188218+0000","last_became_peered":"2023-09-30T22:19:30.188218+0000","last_unstale":"2023-09-30T22:19:30.253388+0000","last_undegraded":"2023-09-30T22:19:30.253388+0000","last_fullsized":"2023-09-30T22:19:30.253388+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260978+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277777+0000","last_change":"2023-09-30T22:19:29.250128+0000","last_active":"2023-09-30T22:19:30.277777+0000","last_peered":"2023-09-30T22:19:30.277777+0000","last_clean":"2023-09-30T22:19:30.277777+0000","last_became_active":"2023-09-30T22:19:29.249745+0000","last_became_peered":"2023-09-30T22:19:29.249745+0000","last_unstale":"2023-09-30T22:19:30.277777+0000","last_undegraded":"2023-09-30T22:19:30.277777+0000","last_fullsized":"2023-09-30T22:19:30.277777+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267257+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.251725+0000","last_change":"2023-09-30T22:19:29.249638+0000","last_active":"2023-09-30T22:19:30.251725+0000","last_peered":"2023-09-30T22:19:30.251725+0000","last_clean":"2023-09-30T22:19:30.251725+0000","last_became_active":"2023-09-30T22:19:29.249366+0000","last_became_peered":"2023-09-30T22:19:29.249366+0000","last_unstale":"2023-09-30T22:19:30.251725+0000","last_undegraded":"2023-09-30T22:19:30.251725+0000","last_fullsized":"2023-09-30T22:19:30.251725+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265911+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277775+0000","last_change":"2023-09-30T22:19:29.249647+0000","last_active":"2023-09-30T22:19:30.277775+0000","last_peered":"2023-09-30T22:19:30.277775+0000","last_clean":"2023-09-30T22:19:30.277775+0000","last_became_active":"2023-09-30T22:19:29.249371+0000","last_became_peered":"2023-09-30T22:19:29.249371+0000","last_unstale":"2023-09-30T22:19:30.277775+0000","last_undegraded":"2023-09-30T22:19:30.277775+0000","last_fullsized":"2023-09-30T22:19:30.277775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253387+0000","last_change":"2023-09-30T22:19:30.188360+0000","last_active":"2023-09-30T22:19:30.253387+0000","last_peered":"2023-09-30T22:19:30.253387+0000","last_clean":"2023-09-30T22:19:30.253387+0000","last_became_active":"2023-09-30T22:19:30.187849+0000","last_became_peered":"2023-09-30T22:19:30.187849+0000","last_unstale":"2023-09-30T22:19:30.253387+0000","last_undegraded":"2023-09-30T22:19:30.253387+0000","last_fullsized":"2023-09-30T22:19:30.253387+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260814+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277786+0000","last_change":"2023-09-30T22:19:29.250622+0000","last_active":"2023-09-30T22:19:30.277786+0000","last_peered":"2023-09-30T22:19:30.277786+0000","last_clean":"2023-09-30T22:19:30.277786+0000","last_became_active":"2023-09-30T22:19:29.250370+0000","last_became_peered":"2023-09-30T22:19:29.250370+0000","last_unstale":"2023-09-30T22:19:30.277786+0000","last_undegraded":"2023-09-30T22:19:30.277786+0000","last_fullsized":"2023-09-30T22:19:30.277786+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265885+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.278117+0000","last_change":"2023-09-30T22:19:30.188159+0000","last_active":"2023-09-30T22:19:30.278117+0000","last_peered":"2023-09-30T22:19:30.278117+0000","last_clean":"2023-09-30T22:19:30.278117+0000","last_became_active":"2023-09-30T22:19:30.187869+0000","last_became_peered":"2023-09-30T22:19:30.187869+0000","last_unstale":"2023-09-30T22:19:30.278117+0000","last_undegraded":"2023-09-30T22:19:30.278117+0000","last_fullsized":"2023-09-30T22:19:30.278117+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267501+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261602+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253402+0000","last_change":"2023-09-30T22:19:30.190576+0000","last_active":"2023-09-30T22:19:30.253402+0000","last_peered":"2023-09-30T22:19:30.253402+0000","last_clean":"2023-09-30T22:19:30.253402+0000","last_became_active":"2023-09-30T22:19:30.190289+0000","last_became_peered":"2023-09-30T22:19:30.190289+0000","last_unstale":"2023-09-30T22:19:30.253402+0000","last_undegraded":"2023-09-30T22:19:30.253402+0000","last_fullsized":"2023-09-30T22:19:30.253402+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277792+0000","last_change":"2023-09-30T22:19:30.188129+0000","last_active":"2023-09-30T22:19:30.277792+0000","last_peered":"2023-09-30T22:19:30.277792+0000","last_clean":"2023-09-30T22:19:30.277792+0000","last_became_active":"2023-09-30T22:19:30.187818+0000","last_became_peered":"2023-09-30T22:19:30.187818+0000","last_unstale":"2023-09-30T22:19:30.277792+0000","last_undegraded":"2023-09-30T22:19:30.277792+0000","last_fullsized":"2023-09-30T22:19:30.277792+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266300+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266691+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267886+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261226+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261315+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266640+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:19:37.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-09-30T22:19:37.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-09-30T22:19:37.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-09-30T22:19:37.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-09-30T22:19:37.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-09-30T22:19:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-09-30T22:19:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-09-30T22:19:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-09-30T22:19:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-09-30T22:19:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-09-30T22:19:37.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-09-30T22:19:37.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-09-30T22:19:37.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-09-30T22:19:37.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-09-30T22:19:37.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.266986+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-09-30T22:19:37.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-09-30T22:19:37.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.265634+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T22:19:37.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-09-30T22:19:37.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-09-30T22:19:37.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.260906+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-09-30T22:19:37.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.266242+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.261473+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.265820+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-09-30T22:19:37.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-09-30T22:19:37.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.261590+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-09-30T22:19:37.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-09-30T22:19:37.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.262931+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-09-30T22:19:37.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.267510+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.262405+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-09-30T22:19:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.266259+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.265825+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.261030+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-09-30T22:19:37.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-09-30T22:19:37.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.260833+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-09-30T22:19:37.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-09-30T22:19:37.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.265706+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-09-30T22:19:37.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-09-30T22:19:37.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.261703+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-09-30T22:19:37.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-09-30T22:19:37.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.261198+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-09-30T22:19:37.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-09-30T22:19:37.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.260435+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-09-30T22:19:37.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-09-30T22:19:37.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.260392+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-09-30T22:19:37.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.260978+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.267257+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.265911+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T22:19:37.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-09-30T22:19:37.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-09-30T22:19:37.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.260814+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-09-30T22:19:37.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-09-30T22:19:37.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.265885+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-09-30T22:19:37.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.267501+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.261602+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-09-30T22:19:37.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.266300+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-09-30T22:19:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-09-30T22:19:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.266691+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-09-30T22:19:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-09-30T22:19:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.267886+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T22:19:37.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.261226+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.261315+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-09-30T22:19:37.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T22:19:32.254302+0000', 'last_change': '2023-09-30T22:19:32.266640+0000', 'last_active': '2023-09-30T22:19:32.254302+0000', 'last_peered': '2023-09-30T22:19:32.254302+0000', 'last_clean': '2023-09-30T22:19:32.254302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:32.254302+0000', 'last_undegraded': '2023-09-30T22:19:32.254302+0000', 'last_fullsized': '2023-09-30T22:19:32.254302+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:32.254302+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T22:19:37.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-09-30T22:19:37.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-09-30T22:19:37.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-09-30T22:19:37.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-09-30T22:19:37.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-09-30T22:19:37.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-09-30T22:19:37.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T22:19:33.258412+0000', 'last_change': '2023-09-30T22:19:33.258412+0000', 'last_active': '2023-09-30T22:19:33.258412+0000', 'last_peered': '2023-09-30T22:19:33.258412+0000', 'last_clean': '2023-09-30T22:19:33.258412+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T22:19:33.258412+0000', 'last_undegraded': '2023-09-30T22:19:33.258412+0000', 'last_fullsized': '2023-09-30T22:19:33.258412+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'last_clean_scrub_stamp': '2023-09-30T22:19:33.258412+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T22:19:37.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T22:19:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.423+0000 7fb01ca38700 1 Processor -- start 2023-09-30T22:19:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb01ca38700 1 -- start start 2023-09-30T22:19:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb01ca38700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018067f40 0x7fb018068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb01ca38700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018069790 0x7fb018068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb01ca38700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb018127a00 0x7fb018127eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb01ca38700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb018092820 con 0x7fb018127a00 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb01ca38700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb018069160 con 0x7fb018069790 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb01ca38700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180923b0 con 0x7fb018067f40 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018069790 0x7fb018068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb01659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018067f40 0x7fb018068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb016d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb018127a00 0x7fb018127eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb016d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb018127a00 0x7fb018127eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36994/0 (socket says 172.21.15.154:36994) 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb01659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018067f40 0x7fb018068320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59902/0 (socket says 172.21.15.154:59902) 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018069790 0x7fb018068810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54178/0 (socket says 172.21.15.154:54178) 2023-09-30T22:19:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.424+0000 7fb016d9d700 1 -- 172.21.15.154:0/1228417363 learned_addr learned my addr 172.21.15.154:0/1228417363 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01659c700 1 -- 172.21.15.154:0/1228417363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018069790 msgr2=0x7fb018068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01659c700 1 --2- 172.21.15.154:0/1228417363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018069790 0x7fb018068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01659c700 1 -- 172.21.15.154:0/1228417363 >> v2:172.21.15.154:3300/0 conn(0x7fb018127a00 msgr2=0x7fb018127eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01659c700 1 --2- 172.21.15.154:0/1228417363 >> v2:172.21.15.154:3300/0 conn(0x7fb018127a00 0x7fb018127eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01659c700 1 -- 172.21.15.154:0/1228417363 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018093310 con 0x7fb018067f40 2023-09-30T22:19:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb015d9b700 1 --2- 172.21.15.154:0/1228417363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018069790 0x7fb018068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb016d9d700 1 --2- 172.21.15.154:0/1228417363 >> v2:172.21.15.154:3300/0 conn(0x7fb018127a00 0x7fb018127eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01659c700 1 --2- 172.21.15.154:0/1228417363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018067f40 0x7fb018068320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb00c009760 tx=0x7fb00c009060).ready entity=mon.2 client_cookie=cc24e5fc645e1261 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01559a700 1 -- 172.21.15.154:0/1228417363 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0090d0 con 0x7fb018067f40 2023-09-30T22:19:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01559a700 1 -- 172.21.15.154:0/1228417363 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00d4a0 con 0x7fb018067f40 2023-09-30T22:19:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01559a700 1 -- 172.21.15.154:0/1228417363 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00d820 con 0x7fb018067f40 2023-09-30T22:19:37.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01ca38700 1 -- 172.21.15.154:0/1228417363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018067f40 msgr2=0x7fb018068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.425+0000 7fb01ca38700 1 --2- 172.21.15.154:0/1228417363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018067f40 0x7fb018068320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb00c009760 tx=0x7fb00c009060).stop 2023-09-30T22:19:37.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.426+0000 7fb01ca38700 1 -- 172.21.15.154:0/1228417363 shutdown_connections 2023-09-30T22:19:37.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.426+0000 7fb01ca38700 1 --2- 172.21.15.154:0/1228417363 >> v2:172.21.15.154:3300/0 conn(0x7fb018127a00 0x7fb018127eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.426+0000 7fb01ca38700 1 --2- 172.21.15.154:0/1228417363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018067f40 0x7fb018068320 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.426+0000 7fb01ca38700 1 --2- 172.21.15.154:0/1228417363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018069790 0x7fb018068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.426+0000 7fb01ca38700 1 -- 172.21.15.154:0/1228417363 >> 172.21.15.154:0/1228417363 conn(0x7fb01809a230 msgr2=0x7fb01809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.426+0000 7fb01ca38700 1 -- 172.21.15.154:0/1228417363 shutdown_connections 2023-09-30T22:19:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.426+0000 7fb01ca38700 1 -- 172.21.15.154:0/1228417363 wait complete. 2023-09-30T22:19:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.426+0000 7fb01ca38700 1 Processor -- start 2023-09-30T22:19:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.426+0000 7fb01ca38700 1 -- start start 2023-09-30T22:19:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01ca38700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018067f40 0x7fb0181373a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01ca38700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018069790 0x7fb018137890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01ca38700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb018127a00 0x7fb018113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01ca38700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0181179b0 con 0x7fb018127a00 2023-09-30T22:19:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01ca38700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb018115100 con 0x7fb018067f40 2023-09-30T22:19:37.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01ca38700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb01812b100 con 0x7fb018069790 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018067f40 0x7fb0181373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018069790 0x7fb018137890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018067f40 0x7fb0181373a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54186/0 (socket says 172.21.15.154:54186) 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01659c700 1 -- 172.21.15.154:0/3348228075 learned_addr learned my addr 172.21.15.154:0/3348228075 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb016d9d700 1 --2- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb018127a00 0x7fb018113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb015d9b700 1 -- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018067f40 msgr2=0x7fb0181373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb015d9b700 1 --2- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018067f40 0x7fb0181373a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb015d9b700 1 -- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb018127a00 msgr2=0x7fb018113c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb015d9b700 1 --2- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb018127a00 0x7fb018113c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb015d9b700 1 -- 172.21.15.154:0/3348228075 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080092a0 con 0x7fb018069790 2023-09-30T22:19:37.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb01659c700 1 --2- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018067f40 0x7fb0181373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb015d9b700 1 --2- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018069790 0x7fb018137890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb018065710 tx=0x7fb008009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.427+0000 7fb0067fc700 1 -- 172.21.15.154:0/3348228075 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008009580 con 0x7fb018069790 2023-09-30T22:19:37.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.428+0000 7fb0067fc700 1 -- 172.21.15.154:0/3348228075 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb008012600 con 0x7fb018069790 2023-09-30T22:19:37.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.428+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb010009ae0 con 0x7fb018069790 2023-09-30T22:19:37.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.428+0000 7fb0067fc700 1 -- 172.21.15.154:0/3348228075 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080129a0 con 0x7fb018069790 2023-09-30T22:19:37.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.428+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c0092a0 con 0x7fb018069790 2023-09-30T22:19:37.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.428+0000 7fb0067fc700 1 -- 172.21.15.154:0/3348228075 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb008012d10 con 0x7fb018069790 2023-09-30T22:19:37.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.428+0000 7fb0067fc700 1 -- 172.21.15.154:0/3348228075 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb00803b300 con 0x7fb018069790 2023-09-30T22:19:37.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.429+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01805a260 con 0x7fb018069790 2023-09-30T22:19:37.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.433+0000 7fb0067fc700 1 -- 172.21.15.154:0/3348228075 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb008019310 con 0x7fb018069790 2023-09-30T22:19:37.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.651+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb018097300 con 0x7fb018069790 2023-09-30T22:19:37.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.652+0000 7fb0067fc700 1 -- 172.21.15.154:0/3348228075 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1106 (secure 0 0 0) 0x7fb008029080 con 0x7fb018069790 2023-09-30T22:19:37.653 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:37.653 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":18,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":16,"num_osds":4,"num_up_osds":4,"osd_up_since":1696112367,"num_in_osds":4,"osd_in_since":1696112360,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":1217363968,"bytes_avail":385329692672,"bytes_total":386547056640,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4184}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-09-30T22:19:18.988148+0000","services":{}},"progress_events":{}} 2023-09-30T22:19:37.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 >> v1:172.21.15.154:6816/118163 conn(0x7faff802bb60 legacy=0x7faff802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018069790 msgr2=0x7fb018137890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 --2- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018069790 0x7fb018137890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb018065710 tx=0x7fb008009060).stop 2023-09-30T22:19:37.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 shutdown_connections 2023-09-30T22:19:37.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 --2- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb018127a00 0x7fb018113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 --2- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb018067f40 0x7fb0181373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 --2- 172.21.15.154:0/3348228075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb018069790 0x7fb018137890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 >> 172.21.15.154:0/3348228075 conn(0x7fb01809a230 msgr2=0x7fb0180941d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 shutdown_connections 2023-09-30T22:19:37.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.654+0000 7fb01ca38700 1 -- 172.21.15.154:0/3348228075 wait complete. 2023-09-30T22:19:37.666 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T22:19:37.666 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:19:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ec555e700 1 Processor -- start 2023-09-30T22:19:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ec555e700 1 -- start start 2023-09-30T22:19:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ec555e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ec0092990 0x7f9ec0065a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ec555e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0132e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ec555e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec0097730 con 0x7f9ec0066050 2023-09-30T22:19:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ec555e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec0092d70 con 0x7f9ec0092990 2023-09-30T22:19:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ec555e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00974b0 con 0x7f9ec012b220 2023-09-30T22:19:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ebf7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0132e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ebeffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ec0092990 0x7f9ec0065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ebe7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9ec0066050 0x7f9ec012ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41618/0 (socket says 172.21.15.154:41618) 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.782+0000 7f9ebe7fc700 1 -- 172.21.15.154:0/2288454425 learned_addr learned my addr 172.21.15.154:0/2288454425 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebf7fe700 1 -- 172.21.15.154:0/2288454425 >> v2:172.21.15.154:3300/0 conn(0x7f9ec0092990 msgr2=0x7f9ec0065a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebf7fe700 1 --2- 172.21.15.154:0/2288454425 >> v2:172.21.15.154:3300/0 conn(0x7f9ec0092990 0x7f9ec0065a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebf7fe700 1 -- 172.21.15.154:0/2288454425 >> v1:172.21.15.154:6789/0 conn(0x7f9ec0066050 legacy=0x7f9ec012ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebf7fe700 1 -- 172.21.15.154:0/2288454425 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0064740 con 0x7f9ec012b220 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebdffb700 1 -- 172.21.15.154:0/2288454425 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164987976 0 0) 0x7f9ec0097730 con 0x7f9ec0066050 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebeffd700 1 --2- 172.21.15.154:0/2288454425 >> v2:172.21.15.154:3300/0 conn(0x7f9ec0092990 0x7f9ec0065a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebf7fe700 1 --2- 172.21.15.154:0/2288454425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0132e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9eb8009e60 tx=0x7f9eb8009780).ready entity=mon.1 client_cookie=24b7d3afae76a831 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebdffb700 1 -- 172.21.15.154:0/2288454425 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800e070 con 0x7f9ec012b220 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebdffb700 1 -- 172.21.15.154:0/2288454425 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb800bb60 con 0x7f9ec012b220 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ebdffb700 1 -- 172.21.15.154:0/2288454425 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8012410 con 0x7f9ec012b220 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.783+0000 7f9ec555e700 1 -- 172.21.15.154:0/2288454425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 msgr2=0x7f9ec0132e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.784+0000 7f9ec555e700 1 --2- 172.21.15.154:0/2288454425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0132e80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9eb8009e60 tx=0x7f9eb8009780).stop 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.784+0000 7f9ec555e700 1 -- 172.21.15.154:0/2288454425 shutdown_connections 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.784+0000 7f9ec555e700 1 --2- 172.21.15.154:0/2288454425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0132e80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.784+0000 7f9ec555e700 1 --2- 172.21.15.154:0/2288454425 >> v2:172.21.15.154:3300/0 conn(0x7f9ec0092990 0x7f9ec0065a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.784+0000 7f9ec555e700 1 -- 172.21.15.154:0/2288454425 >> 172.21.15.154:0/2288454425 conn(0x7f9ec009bba0 msgr2=0x7f9ec009bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.784+0000 7f9ec555e700 1 -- 172.21.15.154:0/2288454425 shutdown_connections 2023-09-30T22:19:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.784+0000 7f9ec555e700 1 -- 172.21.15.154:0/2288454425 wait complete. 2023-09-30T22:19:37.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ec555e700 1 Processor -- start 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ec555e700 1 -- start start 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ec555e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ec0066050 0x7f9ec011b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ec555e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec0092990 0x7f9ec0117910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ec555e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0117e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ec555e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec011ae10 con 0x7f9ec0092990 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ec555e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec012af30 con 0x7f9ec012b220 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ec555e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec006a710 con 0x7f9ec0066050 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebeffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ec0066050 0x7f9ec011b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebe7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec0092990 0x7f9ec0117910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebeffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ec0066050 0x7f9ec011b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59922/0 (socket says 172.21.15.154:59922) 2023-09-30T22:19:37.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebf7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0117e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:37.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebeffd700 1 -- 172.21.15.154:0/1330503258 learned_addr learned my addr 172.21.15.154:0/1330503258 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:37.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebe7fc700 1 -- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ec0066050 msgr2=0x7f9ec011b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebe7fc700 1 --2- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ec0066050 0x7f9ec011b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebe7fc700 1 -- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 msgr2=0x7f9ec0117e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebe7fc700 1 --2- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0117e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebe7fc700 1 -- 172.21.15.154:0/1330503258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb00092a0 con 0x7f9ec0092990 2023-09-30T22:19:37.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.785+0000 7f9ebf7fe700 1 --2- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0117e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:37.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.786+0000 7f9ebe7fc700 1 --2- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec0092990 0x7f9ec0117910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9eb4000c00 tx=0x7f9eb4007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:37.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.786+0000 7f9ea6ffd700 1 -- 172.21.15.154:0/1330503258 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40070d0 con 0x7f9ec0092990 2023-09-30T22:19:37.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.786+0000 7f9ea6ffd700 1 -- 172.21.15.154:0/1330503258 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb4007250 con 0x7f9ec0092990 2023-09-30T22:19:37.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.786+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb8009a20 con 0x7f9ec0092990 2023-09-30T22:19:37.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.786+0000 7f9ea6ffd700 1 -- 172.21.15.154:0/1330503258 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4007610 con 0x7f9ec0092990 2023-09-30T22:19:37.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.786+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec01194a0 con 0x7f9ec0092990 2023-09-30T22:19:37.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.786+0000 7f9ea6ffd700 1 -- 172.21.15.154:0/1330503258 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9eb40059b0 con 0x7f9ec0092990 2023-09-30T22:19:37.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.787+0000 7f9ea6ffd700 1 -- 172.21.15.154:0/1330503258 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9eb403a6a0 con 0x7f9ec0092990 2023-09-30T22:19:37.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.787+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec0119630 con 0x7f9ec0092990 2023-09-30T22:19:37.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.791+0000 7f9ea6ffd700 1 -- 172.21.15.154:0/1330503258 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9eb4018030 con 0x7f9ec0092990 2023-09-30T22:19:37.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.947+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 --> v1:172.21.15.154:6816/118163 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ec005a260 con 0x7f9eac02bb60 2023-09-30T22:19:37.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.953+0000 7f9ea6ffd700 1 -- 172.21.15.154:0/1330503258 <== mgr.4101 v1:172.21.15.154:6816/118163 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243831 (unknown 2965378022 0 3935667014) 0x7f9ec005a260 con 0x7f9eac02bb60 2023-09-30T22:19:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:37.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 >> v1:172.21.15.154:6816/118163 conn(0x7f9eac02bb60 legacy=0x7f9eac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec0092990 msgr2=0x7f9ec0117910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:37.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 --2- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec0092990 0x7f9ec0117910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9eb4000c00 tx=0x7f9eb4007b90).stop 2023-09-30T22:19:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 shutdown_connections 2023-09-30T22:19:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 --2- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ec012b220 0x7f9ec0117e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 --2- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ec0066050 0x7f9ec011b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 --2- 172.21.15.154:0/1330503258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec0092990 0x7f9ec0117910 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 >> 172.21.15.154:0/1330503258 conn(0x7f9ec009bba0 msgr2=0x7f9ec00696f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 shutdown_connections 2023-09-30T22:19:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:37.956+0000 7f9ec555e700 1 -- 172.21.15.154:0/1330503258 wait complete. 2023-09-30T22:19:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-09-30T22:19:37.968 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-09-30T22:19:37.213993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266986+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265634+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260906+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266242+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261473+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265820+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261590+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.262931+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267510+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.262405+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266259+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265825+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261030+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260833+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265706+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261703+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261198+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260435+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260392+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253388+0000","last_change":"2023-09-30T22:19:30.188504+0000","last_active":"2023-09-30T22:19:30.253388+0000","last_peered":"2023-09-30T22:19:30.253388+0000","last_clean":"2023-09-30T22:19:30.253388+0000","last_became_active":"2023-09-30T22:19:30.188218+0000","last_became_peered":"2023-09-30T22:19:30.188218+0000","last_unstale":"2023-09-30T22:19:30.253388+0000","last_undegraded":"2023-09-30T22:19:30.253388+0000","last_fullsized":"2023-09-30T22:19:30.253388+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260978+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277777+0000","last_change":"2023-09-30T22:19:29.250128+0000","last_active":"2023-09-30T22:19:30.277777+0000","last_peered":"2023-09-30T22:19:30.277777+0000","last_clean":"2023-09-30T22:19:30.277777+0000","last_became_active":"2023-09-30T22:19:29.249745+0000","last_became_peered":"2023-09-30T22:19:29.249745+0000","last_unstale":"2023-09-30T22:19:30.277777+0000","last_undegraded":"2023-09-30T22:19:30.277777+0000","last_fullsized":"2023-09-30T22:19:30.277777+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267257+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.251725+0000","last_change":"2023-09-30T22:19:29.249638+0000","last_active":"2023-09-30T22:19:30.251725+0000","last_peered":"2023-09-30T22:19:30.251725+0000","last_clean":"2023-09-30T22:19:30.251725+0000","last_became_active":"2023-09-30T22:19:29.249366+0000","last_became_peered":"2023-09-30T22:19:29.249366+0000","last_unstale":"2023-09-30T22:19:30.251725+0000","last_undegraded":"2023-09-30T22:19:30.251725+0000","last_fullsized":"2023-09-30T22:19:30.251725+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265911+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277775+0000","last_change":"2023-09-30T22:19:29.249647+0000","last_active":"2023-09-30T22:19:30.277775+0000","last_peered":"2023-09-30T22:19:30.277775+0000","last_clean":"2023-09-30T22:19:30.277775+0000","last_became_active":"2023-09-30T22:19:29.249371+0000","last_became_peered":"2023-09-30T22:19:29.249371+0000","last_unstale":"2023-09-30T22:19:30.277775+0000","last_undegraded":"2023-09-30T22:19:30.277775+0000","last_fullsized":"2023-09-30T22:19:30.277775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253387+0000","last_change":"2023-09-30T22:19:30.188360+0000","last_active":"2023-09-30T22:19:30.253387+0000","last_peered":"2023-09-30T22:19:30.253387+0000","last_clean":"2023-09-30T22:19:30.253387+0000","last_became_active":"2023-09-30T22:19:30.187849+0000","last_became_peered":"2023-09-30T22:19:30.187849+0000","last_unstale":"2023-09-30T22:19:30.253387+0000","last_undegraded":"2023-09-30T22:19:30.253387+0000","last_fullsized":"2023-09-30T22:19:30.253387+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.260814+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277786+0000","last_change":"2023-09-30T22:19:29.250622+0000","last_active":"2023-09-30T22:19:30.277786+0000","last_peered":"2023-09-30T22:19:30.277786+0000","last_clean":"2023-09-30T22:19:30.277786+0000","last_became_active":"2023-09-30T22:19:29.250370+0000","last_became_peered":"2023-09-30T22:19:29.250370+0000","last_unstale":"2023-09-30T22:19:30.277786+0000","last_undegraded":"2023-09-30T22:19:30.277786+0000","last_fullsized":"2023-09-30T22:19:30.277786+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.265885+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.278117+0000","last_change":"2023-09-30T22:19:30.188159+0000","last_active":"2023-09-30T22:19:30.278117+0000","last_peered":"2023-09-30T22:19:30.278117+0000","last_clean":"2023-09-30T22:19:30.278117+0000","last_became_active":"2023-09-30T22:19:30.187869+0000","last_became_peered":"2023-09-30T22:19:30.187869+0000","last_unstale":"2023-09-30T22:19:30.278117+0000","last_undegraded":"2023-09-30T22:19:30.278117+0000","last_fullsized":"2023-09-30T22:19:30.278117+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267501+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261602+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.253402+0000","last_change":"2023-09-30T22:19:30.190576+0000","last_active":"2023-09-30T22:19:30.253402+0000","last_peered":"2023-09-30T22:19:30.253402+0000","last_clean":"2023-09-30T22:19:30.253402+0000","last_became_active":"2023-09-30T22:19:30.190289+0000","last_became_peered":"2023-09-30T22:19:30.190289+0000","last_unstale":"2023-09-30T22:19:30.253402+0000","last_undegraded":"2023-09-30T22:19:30.253402+0000","last_fullsized":"2023-09-30T22:19:30.253402+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-09-30T22:19:30.277792+0000","last_change":"2023-09-30T22:19:30.188129+0000","last_active":"2023-09-30T22:19:30.277792+0000","last_peered":"2023-09-30T22:19:30.277792+0000","last_clean":"2023-09-30T22:19:30.277792+0000","last_became_active":"2023-09-30T22:19:30.187818+0000","last_became_peered":"2023-09-30T22:19:30.187818+0000","last_unstale":"2023-09-30T22:19:30.277792+0000","last_undegraded":"2023-09-30T22:19:30.277792+0000","last_fullsized":"2023-09-30T22:19:30.277792+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266300+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266691+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.267886+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261226+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.261315+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T22:19:32.254302+0000","last_change":"2023-09-30T22:19:32.266640+0000","last_active":"2023-09-30T22:19:32.254302+0000","last_peered":"2023-09-30T22:19:32.254302+0000","last_clean":"2023-09-30T22:19:32.254302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:32.254302+0000","last_undegraded":"2023-09-30T22:19:32.254302+0000","last_fullsized":"2023-09-30T22:19:32.254302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T22:19:33.258412+0000","last_change":"2023-09-30T22:19:33.258412+0000","last_active":"2023-09-30T22:19:33.258412+0000","last_peered":"2023-09-30T22:19:33.258412+0000","last_clean":"2023-09-30T22:19:33.258412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T22:19:33.258412+0000","last_undegraded":"2023-09-30T22:19:33.258412+0000","last_fullsized":"2023-09-30T22:19:33.258412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.157}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:19:39.359 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-09-30T22:19:39.359+0000 7f5728c29700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T22:19:40.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:19:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.102+0000 7fc483c85700 1 Processor -- start 2023-09-30T22:19:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.102+0000 7fc483c85700 1 -- start start 2023-09-30T22:19:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc483c85700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 0x7fc47c068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc483c85700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc47c069790 0x7fc47c068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc483c85700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c069160 con 0x7fc47c127a00 2023-09-30T22:19:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc483c85700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c092820 con 0x7fc47c069790 2023-09-30T22:19:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc483c85700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0923b0 con 0x7fc47c067f40 2023-09-30T22:19:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc481220700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc47c069790 0x7fc47c068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc482222700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc47c127a00 0x7fc47c127e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41622/0 (socket says 172.21.15.154:41622) 2023-09-30T22:19:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc482222700 1 -- 172.21.15.154:0/1205037998 learned_addr learned my addr 172.21.15.154:0/1205037998 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc481a21700 1 --2- 172.21.15.154:0/1205037998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 0x7fc47c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc481220700 1 -- 172.21.15.154:0/1205037998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 msgr2=0x7fc47c068320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc481220700 1 --2- 172.21.15.154:0/1205037998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 0x7fc47c068320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc481220700 1 -- 172.21.15.154:0/1205037998 >> v1:172.21.15.154:6789/0 conn(0x7fc47c127a00 legacy=0x7fc47c127e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc481220700 1 -- 172.21.15.154:0/1205037998 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c093310 con 0x7fc47c069790 2023-09-30T22:19:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc480a1f700 1 -- 172.21.15.154:0/1205037998 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380285581 0 0) 0x7fc47c069160 con 0x7fc47c127a00 2023-09-30T22:19:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc481a21700 1 --2- 172.21.15.154:0/1205037998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 0x7fc47c068320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc481220700 1 --2- 172.21.15.154:0/1205037998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c069790 0x7fc47c068810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc478009760 tx=0x7fc478009060).ready entity=mon.0 client_cookie=a2db5308cee60e32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc480a1f700 1 -- 172.21.15.154:0/1205037998 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780090d0 con 0x7fc47c069790 2023-09-30T22:19:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc480a1f700 1 -- 172.21.15.154:0/1205037998 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800f510 con 0x7fc47c069790 2023-09-30T22:19:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.103+0000 7fc480a1f700 1 -- 172.21.15.154:0/1205037998 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800f890 con 0x7fc47c069790 2023-09-30T22:19:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.104+0000 7fc483c85700 1 -- 172.21.15.154:0/1205037998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c069790 msgr2=0x7fc47c068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.104+0000 7fc483c85700 1 --2- 172.21.15.154:0/1205037998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c069790 0x7fc47c068810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc478009760 tx=0x7fc478009060).stop 2023-09-30T22:19:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.104+0000 7fc483c85700 1 -- 172.21.15.154:0/1205037998 shutdown_connections 2023-09-30T22:19:41.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.104+0000 7fc483c85700 1 --2- 172.21.15.154:0/1205037998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 0x7fc47c068320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.104+0000 7fc483c85700 1 --2- 172.21.15.154:0/1205037998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c069790 0x7fc47c068810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.104+0000 7fc483c85700 1 -- 172.21.15.154:0/1205037998 >> 172.21.15.154:0/1205037998 conn(0x7fc47c09a230 msgr2=0x7fc47c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.104+0000 7fc483c85700 1 -- 172.21.15.154:0/1205037998 shutdown_connections 2023-09-30T22:19:41.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.104+0000 7fc483c85700 1 -- 172.21.15.154:0/1205037998 wait complete. 2023-09-30T22:19:41.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.105+0000 7fc483c85700 1 Processor -- start 2023-09-30T22:19:41.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.105+0000 7fc483c85700 1 -- start start 2023-09-30T22:19:41.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.105+0000 7fc483c85700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 0x7fc47c13a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.105+0000 7fc483c85700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc47c069790 0x7fc47c13a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.105+0000 7fc483c85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c127a00 0x7fc47c097e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.105+0000 7fc483c85700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c12d120 con 0x7fc47c127a00 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.105+0000 7fc483c85700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0937a0 con 0x7fc47c067f40 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.105+0000 7fc483c85700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c118480 con 0x7fc47c069790 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.105+0000 7fc482222700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c127a00 0x7fc47c097e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc481220700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc47c069790 0x7fc47c13a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc482222700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c127a00 0x7fc47c097e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37034/0 (socket says 172.21.15.154:37034) 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc482222700 1 -- 172.21.15.154:0/667247847 learned_addr learned my addr 172.21.15.154:0/667247847 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc481a21700 1 --2- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 0x7fc47c13a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc482222700 1 -- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc47c069790 msgr2=0x7fc47c13a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc482222700 1 --2- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc47c069790 0x7fc47c13a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc482222700 1 -- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 msgr2=0x7fc47c13a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc482222700 1 --2- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 0x7fc47c13a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc482222700 1 -- 172.21.15.154:0/667247847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c0092a0 con 0x7fc47c127a00 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc481220700 1 --2- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc47c069790 0x7fc47c13a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc482222700 1 --2- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c127a00 0x7fc47c097e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc47400c7e0 tx=0x7fc474007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc471ffb700 1 -- 172.21.15.154:0/667247847 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474005d30 con 0x7fc47c127a00 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc471ffb700 1 -- 172.21.15.154:0/667247847 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc474005e90 con 0x7fc47c127a00 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc471ffb700 1 -- 172.21.15.154:0/667247847 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474007360 con 0x7fc47c127a00 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4780092a0 con 0x7fc47c127a00 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.106+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c119000 con 0x7fc47c127a00 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.107+0000 7fc471ffb700 1 -- 172.21.15.154:0/667247847 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc474007750 con 0x7fc47c127a00 2023-09-30T22:19:41.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.107+0000 7fc471ffb700 1 -- 172.21.15.154:0/667247847 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc47403adc0 con 0x7fc47c127a00 2023-09-30T22:19:41.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.107+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c119000 con 0x7fc47c127a00 2023-09-30T22:19:41.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.112+0000 7fc471ffb700 1 -- 172.21.15.154:0/667247847 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc47c119000 con 0x7fc47c127a00 2023-09-30T22:19:41.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.267+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 --> v1:172.21.15.154:6816/118163 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc47c118120 con 0x7fc46002bb30 2023-09-30T22:19:41.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.273+0000 7fc471ffb700 1 -- 172.21.15.154:0/667247847 <== mgr.4101 v1:172.21.15.154:6816/118163 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250009 (unknown 2965378022 0 1604764580) 0x7fc46c009810 con 0x7fc46002bb30 2023-09-30T22:19:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:41.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 >> v1:172.21.15.154:6816/118163 conn(0x7fc46002bb30 legacy=0x7fc46002dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c127a00 msgr2=0x7fc47c097e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 --2- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c127a00 0x7fc47c097e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc47400c7e0 tx=0x7fc474007f90).stop 2023-09-30T22:19:41.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 shutdown_connections 2023-09-30T22:19:41.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 --2- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c127a00 0x7fc47c097e50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 --2- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c067f40 0x7fc47c13a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 --2- 172.21.15.154:0/667247847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc47c069790 0x7fc47c13a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 >> 172.21.15.154:0/667247847 conn(0x7fc47c09a230 msgr2=0x7fc47c066e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 shutdown_connections 2023-09-30T22:19:41.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.276+0000 7fc483c85700 1 -- 172.21.15.154:0/667247847 wait complete. 2023-09-30T22:19:41.280 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-09-30T22:19:41.289 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-09-30T22:19:41.214876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188992,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298368,"statfs":{"total":386547056640,"available":385329528832,"internally_reserved":0,"allocated":622592,"data_stored":182668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000521"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667917+0000","last_change":"2023-09-30T22:19:33.658237+0000","last_active":"2023-09-30T22:19:33.667917+0000","last_peered":"2023-09-30T22:19:33.667917+0000","last_clean":"2023-09-30T22:19:33.667917+0000","last_became_active":"2023-09-30T22:19:33.657934+0000","last_became_peered":"2023-09-30T22:19:33.657934+0000","last_unstale":"2023-09-30T22:19:33.667917+0000","last_undegraded":"2023-09-30T22:19:33.667917+0000","last_fullsized":"2023-09-30T22:19:33.667917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.648635+0000","last_change":"2023-09-30T22:19:33.644960+0000","last_active":"2023-09-30T22:19:33.648635+0000","last_peered":"2023-09-30T22:19:33.648635+0000","last_clean":"2023-09-30T22:19:33.648635+0000","last_became_active":"2023-09-30T22:19:33.644714+0000","last_became_peered":"2023-09-30T22:19:33.644714+0000","last_unstale":"2023-09-30T22:19:33.648635+0000","last_undegraded":"2023-09-30T22:19:33.648635+0000","last_fullsized":"2023-09-30T22:19:33.648635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658820+0000","last_change":"2023-09-30T22:19:33.647352+0000","last_active":"2023-09-30T22:19:33.658820+0000","last_peered":"2023-09-30T22:19:33.658820+0000","last_clean":"2023-09-30T22:19:33.658820+0000","last_became_active":"2023-09-30T22:19:33.647023+0000","last_became_peered":"2023-09-30T22:19:33.647023+0000","last_unstale":"2023-09-30T22:19:33.658820+0000","last_undegraded":"2023-09-30T22:19:33.658820+0000","last_fullsized":"2023-09-30T22:19:33.658820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657478+0000","last_change":"2023-09-30T22:19:33.645394+0000","last_active":"2023-09-30T22:19:33.657478+0000","last_peered":"2023-09-30T22:19:33.657478+0000","last_clean":"2023-09-30T22:19:33.657478+0000","last_became_active":"2023-09-30T22:19:33.645211+0000","last_became_peered":"2023-09-30T22:19:33.645211+0000","last_unstale":"2023-09-30T22:19:33.657478+0000","last_undegraded":"2023-09-30T22:19:33.657478+0000","last_fullsized":"2023-09-30T22:19:33.657478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658933+0000","last_change":"2023-09-30T22:19:33.651418+0000","last_active":"2023-09-30T22:19:33.658933+0000","last_peered":"2023-09-30T22:19:33.658933+0000","last_clean":"2023-09-30T22:19:33.658933+0000","last_became_active":"2023-09-30T22:19:33.651174+0000","last_became_peered":"2023-09-30T22:19:33.651174+0000","last_unstale":"2023-09-30T22:19:33.658933+0000","last_undegraded":"2023-09-30T22:19:33.658933+0000","last_fullsized":"2023-09-30T22:19:33.658933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677670+0000","last_change":"2023-09-30T22:19:33.671906+0000","last_active":"2023-09-30T22:19:33.677670+0000","last_peered":"2023-09-30T22:19:33.677670+0000","last_clean":"2023-09-30T22:19:33.677670+0000","last_became_active":"2023-09-30T22:19:33.671528+0000","last_became_peered":"2023-09-30T22:19:33.671528+0000","last_unstale":"2023-09-30T22:19:33.677670+0000","last_undegraded":"2023-09-30T22:19:33.677670+0000","last_fullsized":"2023-09-30T22:19:33.677670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677711+0000","last_change":"2023-09-30T22:19:33.670986+0000","last_active":"2023-09-30T22:19:33.677711+0000","last_peered":"2023-09-30T22:19:33.677711+0000","last_clean":"2023-09-30T22:19:33.677711+0000","last_became_active":"2023-09-30T22:19:33.670689+0000","last_became_peered":"2023-09-30T22:19:33.670689+0000","last_unstale":"2023-09-30T22:19:33.677711+0000","last_undegraded":"2023-09-30T22:19:33.677711+0000","last_fullsized":"2023-09-30T22:19:33.677711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666921+0000","last_change":"2023-09-30T22:19:33.654626+0000","last_active":"2023-09-30T22:19:33.666921+0000","last_peered":"2023-09-30T22:19:33.666921+0000","last_clean":"2023-09-30T22:19:33.666921+0000","last_became_active":"2023-09-30T22:19:33.654358+0000","last_became_peered":"2023-09-30T22:19:33.654358+0000","last_unstale":"2023-09-30T22:19:33.666921+0000","last_undegraded":"2023-09-30T22:19:33.666921+0000","last_fullsized":"2023-09-30T22:19:33.666921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660001+0000","last_change":"2023-09-30T22:19:33.648775+0000","last_active":"2023-09-30T22:19:33.660001+0000","last_peered":"2023-09-30T22:19:33.660001+0000","last_clean":"2023-09-30T22:19:33.660001+0000","last_became_active":"2023-09-30T22:19:33.648386+0000","last_became_peered":"2023-09-30T22:19:33.648386+0000","last_unstale":"2023-09-30T22:19:33.660001+0000","last_undegraded":"2023-09-30T22:19:33.660001+0000","last_fullsized":"2023-09-30T22:19:33.660001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.669534+0000","last_change":"2023-09-30T22:19:33.667764+0000","last_active":"2023-09-30T22:19:33.669534+0000","last_peered":"2023-09-30T22:19:33.669534+0000","last_clean":"2023-09-30T22:19:33.669534+0000","last_became_active":"2023-09-30T22:19:33.667514+0000","last_became_peered":"2023-09-30T22:19:33.667514+0000","last_unstale":"2023-09-30T22:19:33.669534+0000","last_undegraded":"2023-09-30T22:19:33.669534+0000","last_fullsized":"2023-09-30T22:19:33.669534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666903+0000","last_change":"2023-09-30T22:19:33.657292+0000","last_active":"2023-09-30T22:19:33.666903+0000","last_peered":"2023-09-30T22:19:33.666903+0000","last_clean":"2023-09-30T22:19:33.666903+0000","last_became_active":"2023-09-30T22:19:33.656706+0000","last_became_peered":"2023-09-30T22:19:33.656706+0000","last_unstale":"2023-09-30T22:19:33.666903+0000","last_undegraded":"2023-09-30T22:19:33.666903+0000","last_fullsized":"2023-09-30T22:19:33.666903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.669940+0000","last_change":"2023-09-30T22:19:33.658823+0000","last_active":"2023-09-30T22:19:33.669940+0000","last_peered":"2023-09-30T22:19:33.669940+0000","last_clean":"2023-09-30T22:19:33.669940+0000","last_became_active":"2023-09-30T22:19:33.658537+0000","last_became_peered":"2023-09-30T22:19:33.658537+0000","last_unstale":"2023-09-30T22:19:33.669940+0000","last_undegraded":"2023-09-30T22:19:33.669940+0000","last_fullsized":"2023-09-30T22:19:33.669940+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670391+0000","last_change":"2023-09-30T22:19:33.665830+0000","last_active":"2023-09-30T22:19:33.670391+0000","last_peered":"2023-09-30T22:19:33.670391+0000","last_clean":"2023-09-30T22:19:33.670391+0000","last_became_active":"2023-09-30T22:19:33.665391+0000","last_became_peered":"2023-09-30T22:19:33.665391+0000","last_unstale":"2023-09-30T22:19:33.670391+0000","last_undegraded":"2023-09-30T22:19:33.670391+0000","last_fullsized":"2023-09-30T22:19:33.670391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657540+0000","last_change":"2023-09-30T22:19:33.652240+0000","last_active":"2023-09-30T22:19:33.657540+0000","last_peered":"2023-09-30T22:19:33.657540+0000","last_clean":"2023-09-30T22:19:33.657540+0000","last_became_active":"2023-09-30T22:19:33.651971+0000","last_became_peered":"2023-09-30T22:19:33.651971+0000","last_unstale":"2023-09-30T22:19:33.657540+0000","last_undegraded":"2023-09-30T22:19:33.657540+0000","last_fullsized":"2023-09-30T22:19:33.657540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658251+0000","last_change":"2023-09-30T22:19:33.645322+0000","last_active":"2023-09-30T22:19:33.658251+0000","last_peered":"2023-09-30T22:19:33.658251+0000","last_clean":"2023-09-30T22:19:33.658251+0000","last_became_active":"2023-09-30T22:19:33.645012+0000","last_became_peered":"2023-09-30T22:19:33.645012+0000","last_unstale":"2023-09-30T22:19:33.658251+0000","last_undegraded":"2023-09-30T22:19:33.658251+0000","last_fullsized":"2023-09-30T22:19:33.658251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672567+0000","last_change":"2023-09-30T22:19:33.662012+0000","last_active":"2023-09-30T22:19:33.672567+0000","last_peered":"2023-09-30T22:19:33.672567+0000","last_clean":"2023-09-30T22:19:33.672567+0000","last_became_active":"2023-09-30T22:19:33.661750+0000","last_became_peered":"2023-09-30T22:19:33.661750+0000","last_unstale":"2023-09-30T22:19:33.672567+0000","last_undegraded":"2023-09-30T22:19:33.672567+0000","last_fullsized":"2023-09-30T22:19:33.672567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.659984+0000","last_change":"2023-09-30T22:19:33.648614+0000","last_active":"2023-09-30T22:19:33.659984+0000","last_peered":"2023-09-30T22:19:33.659984+0000","last_clean":"2023-09-30T22:19:33.659984+0000","last_became_active":"2023-09-30T22:19:33.648081+0000","last_became_peered":"2023-09-30T22:19:33.648081+0000","last_unstale":"2023-09-30T22:19:33.659984+0000","last_undegraded":"2023-09-30T22:19:33.659984+0000","last_fullsized":"2023-09-30T22:19:33.659984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649103+0000","last_change":"2023-09-30T22:19:33.639423+0000","last_active":"2023-09-30T22:19:33.649103+0000","last_peered":"2023-09-30T22:19:33.649103+0000","last_clean":"2023-09-30T22:19:33.649103+0000","last_became_active":"2023-09-30T22:19:33.639112+0000","last_became_peered":"2023-09-30T22:19:33.639112+0000","last_unstale":"2023-09-30T22:19:33.649103+0000","last_undegraded":"2023-09-30T22:19:33.649103+0000","last_fullsized":"2023-09-30T22:19:33.649103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667889+0000","last_change":"2023-09-30T22:19:33.658136+0000","last_active":"2023-09-30T22:19:33.667889+0000","last_peered":"2023-09-30T22:19:33.667889+0000","last_clean":"2023-09-30T22:19:33.667889+0000","last_became_active":"2023-09-30T22:19:33.657838+0000","last_became_peered":"2023-09-30T22:19:33.657838+0000","last_unstale":"2023-09-30T22:19:33.667889+0000","last_undegraded":"2023-09-30T22:19:33.667889+0000","last_fullsized":"2023-09-30T22:19:33.667889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655280+0000","last_change":"2023-09-30T22:19:33.650438+0000","last_active":"2023-09-30T22:19:33.655280+0000","last_peered":"2023-09-30T22:19:33.655280+0000","last_clean":"2023-09-30T22:19:33.655280+0000","last_became_active":"2023-09-30T22:19:33.650186+0000","last_became_peered":"2023-09-30T22:19:33.650186+0000","last_unstale":"2023-09-30T22:19:33.655280+0000","last_undegraded":"2023-09-30T22:19:33.655280+0000","last_fullsized":"2023-09-30T22:19:33.655280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667116+0000","last_change":"2023-09-30T22:19:33.663045+0000","last_active":"2023-09-30T22:19:33.667116+0000","last_peered":"2023-09-30T22:19:33.667116+0000","last_clean":"2023-09-30T22:19:33.667116+0000","last_became_active":"2023-09-30T22:19:33.662782+0000","last_became_peered":"2023-09-30T22:19:33.662782+0000","last_unstale":"2023-09-30T22:19:33.667116+0000","last_undegraded":"2023-09-30T22:19:33.667116+0000","last_fullsized":"2023-09-30T22:19:33.667116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657346+0000","last_change":"2023-09-30T22:19:33.645247+0000","last_active":"2023-09-30T22:19:33.657346+0000","last_peered":"2023-09-30T22:19:33.657346+0000","last_clean":"2023-09-30T22:19:33.657346+0000","last_became_active":"2023-09-30T22:19:33.644963+0000","last_became_peered":"2023-09-30T22:19:33.644963+0000","last_unstale":"2023-09-30T22:19:33.657346+0000","last_undegraded":"2023-09-30T22:19:33.657346+0000","last_fullsized":"2023-09-30T22:19:33.657346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672937+0000","last_change":"2023-09-30T22:19:33.662935+0000","last_active":"2023-09-30T22:19:33.672937+0000","last_peered":"2023-09-30T22:19:33.672937+0000","last_clean":"2023-09-30T22:19:33.672937+0000","last_became_active":"2023-09-30T22:19:33.662255+0000","last_became_peered":"2023-09-30T22:19:33.662255+0000","last_unstale":"2023-09-30T22:19:33.672937+0000","last_undegraded":"2023-09-30T22:19:33.672937+0000","last_fullsized":"2023-09-30T22:19:33.672937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.661530+0000","last_change":"2023-09-30T22:19:33.652392+0000","last_active":"2023-09-30T22:19:33.661530+0000","last_peered":"2023-09-30T22:19:33.661530+0000","last_clean":"2023-09-30T22:19:33.661530+0000","last_became_active":"2023-09-30T22:19:33.652097+0000","last_became_peered":"2023-09-30T22:19:33.652097+0000","last_unstale":"2023-09-30T22:19:33.661530+0000","last_undegraded":"2023-09-30T22:19:33.661530+0000","last_fullsized":"2023-09-30T22:19:33.661530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655129+0000","last_change":"2023-09-30T22:19:33.649799+0000","last_active":"2023-09-30T22:19:33.655129+0000","last_peered":"2023-09-30T22:19:33.655129+0000","last_clean":"2023-09-30T22:19:33.655129+0000","last_became_active":"2023-09-30T22:19:33.649512+0000","last_became_peered":"2023-09-30T22:19:33.649512+0000","last_unstale":"2023-09-30T22:19:33.655129+0000","last_undegraded":"2023-09-30T22:19:33.655129+0000","last_fullsized":"2023-09-30T22:19:33.655129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666815+0000","last_change":"2023-09-30T22:19:33.653148+0000","last_active":"2023-09-30T22:19:33.666815+0000","last_peered":"2023-09-30T22:19:33.666815+0000","last_clean":"2023-09-30T22:19:33.666815+0000","last_became_active":"2023-09-30T22:19:33.652806+0000","last_became_peered":"2023-09-30T22:19:33.652806+0000","last_unstale":"2023-09-30T22:19:33.666815+0000","last_undegraded":"2023-09-30T22:19:33.666815+0000","last_fullsized":"2023-09-30T22:19:33.666815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677757+0000","last_change":"2023-09-30T22:19:33.673663+0000","last_active":"2023-09-30T22:19:33.677757+0000","last_peered":"2023-09-30T22:19:33.677757+0000","last_clean":"2023-09-30T22:19:33.677757+0000","last_became_active":"2023-09-30T22:19:33.673128+0000","last_became_peered":"2023-09-30T22:19:33.673128+0000","last_unstale":"2023-09-30T22:19:33.677757+0000","last_undegraded":"2023-09-30T22:19:33.677757+0000","last_fullsized":"2023-09-30T22:19:33.677757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655301+0000","last_change":"2023-09-30T22:19:33.280425+0000","last_active":"2023-09-30T22:19:33.655301+0000","last_peered":"2023-09-30T22:19:33.655301+0000","last_clean":"2023-09-30T22:19:33.655301+0000","last_became_active":"2023-09-30T22:19:33.280161+0000","last_became_peered":"2023-09-30T22:19:33.280161+0000","last_unstale":"2023-09-30T22:19:33.655301+0000","last_undegraded":"2023-09-30T22:19:33.655301+0000","last_fullsized":"2023-09-30T22:19:33.655301+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677578+0000","last_change":"2023-09-30T22:19:33.670909+0000","last_active":"2023-09-30T22:19:33.677578+0000","last_peered":"2023-09-30T22:19:33.677578+0000","last_clean":"2023-09-30T22:19:33.677578+0000","last_became_active":"2023-09-30T22:19:33.670616+0000","last_became_peered":"2023-09-30T22:19:33.670616+0000","last_unstale":"2023-09-30T22:19:33.677578+0000","last_undegraded":"2023-09-30T22:19:33.677578+0000","last_fullsized":"2023-09-30T22:19:33.677578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.634886+0000","last_change":"2023-09-30T22:19:33.284384+0000","last_active":"2023-09-30T22:19:33.634886+0000","last_peered":"2023-09-30T22:19:33.634886+0000","last_clean":"2023-09-30T22:19:33.634886+0000","last_became_active":"2023-09-30T22:19:33.284138+0000","last_became_peered":"2023-09-30T22:19:33.284138+0000","last_unstale":"2023-09-30T22:19:33.634886+0000","last_undegraded":"2023-09-30T22:19:33.634886+0000","last_fullsized":"2023-09-30T22:19:33.634886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660115+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:19:33.660115+0000","last_peered":"2023-09-30T22:19:33.660115+0000","last_clean":"2023-09-30T22:19:33.660115+0000","last_became_active":"2023-09-30T22:19:33.646355+0000","last_became_peered":"2023-09-30T22:19:33.646355+0000","last_unstale":"2023-09-30T22:19:33.660115+0000","last_undegraded":"2023-09-30T22:19:33.660115+0000","last_fullsized":"2023-09-30T22:19:33.660115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.644148+0000","last_change":"2023-09-30T22:19:33.289402+0000","last_active":"2023-09-30T22:19:33.644148+0000","last_peered":"2023-09-30T22:19:33.644148+0000","last_clean":"2023-09-30T22:19:33.644148+0000","last_became_active":"2023-09-30T22:19:33.288979+0000","last_became_peered":"2023-09-30T22:19:33.288979+0000","last_unstale":"2023-09-30T22:19:33.644148+0000","last_undegraded":"2023-09-30T22:19:33.644148+0000","last_fullsized":"2023-09-30T22:19:33.644148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677702+0000","last_change":"2023-09-30T22:19:33.672854+0000","last_active":"2023-09-30T22:19:33.677702+0000","last_peered":"2023-09-30T22:19:33.677702+0000","last_clean":"2023-09-30T22:19:33.677702+0000","last_became_active":"2023-09-30T22:19:33.672539+0000","last_became_peered":"2023-09-30T22:19:33.672539+0000","last_unstale":"2023-09-30T22:19:33.677702+0000","last_undegraded":"2023-09-30T22:19:33.677702+0000","last_fullsized":"2023-09-30T22:19:33.677702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629757+0000","last_change":"2023-09-30T22:19:33.294805+0000","last_active":"2023-09-30T22:19:33.629757+0000","last_peered":"2023-09-30T22:19:33.629757+0000","last_clean":"2023-09-30T22:19:33.629757+0000","last_became_active":"2023-09-30T22:19:33.294520+0000","last_became_peered":"2023-09-30T22:19:33.294520+0000","last_unstale":"2023-09-30T22:19:33.629757+0000","last_undegraded":"2023-09-30T22:19:33.629757+0000","last_fullsized":"2023-09-30T22:19:33.629757+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.671624+0000","last_change":"2023-09-30T22:19:33.660684+0000","last_active":"2023-09-30T22:19:33.671624+0000","last_peered":"2023-09-30T22:19:33.671624+0000","last_clean":"2023-09-30T22:19:33.671624+0000","last_became_active":"2023-09-30T22:19:33.660143+0000","last_became_peered":"2023-09-30T22:19:33.660143+0000","last_unstale":"2023-09-30T22:19:33.671624+0000","last_undegraded":"2023-09-30T22:19:33.671624+0000","last_fullsized":"2023-09-30T22:19:33.671624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.633284+0000","last_change":"2023-09-30T22:19:33.279060+0000","last_active":"2023-09-30T22:19:33.633284+0000","last_peered":"2023-09-30T22:19:33.633284+0000","last_clean":"2023-09-30T22:19:33.633284+0000","last_became_active":"2023-09-30T22:19:33.278776+0000","last_became_peered":"2023-09-30T22:19:33.278776+0000","last_unstale":"2023-09-30T22:19:33.633284+0000","last_undegraded":"2023-09-30T22:19:33.633284+0000","last_fullsized":"2023-09-30T22:19:33.633284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672955+0000","last_change":"2023-09-30T22:19:33.662982+0000","last_active":"2023-09-30T22:19:33.672955+0000","last_peered":"2023-09-30T22:19:33.672955+0000","last_clean":"2023-09-30T22:19:33.672955+0000","last_became_active":"2023-09-30T22:19:33.662668+0000","last_became_peered":"2023-09-30T22:19:33.662668+0000","last_unstale":"2023-09-30T22:19:33.672955+0000","last_undegraded":"2023-09-30T22:19:33.672955+0000","last_fullsized":"2023-09-30T22:19:33.672955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658775+0000","last_change":"2023-09-30T22:19:33.288428+0000","last_active":"2023-09-30T22:19:33.658775+0000","last_peered":"2023-09-30T22:19:33.658775+0000","last_clean":"2023-09-30T22:19:33.658775+0000","last_became_active":"2023-09-30T22:19:33.287975+0000","last_became_peered":"2023-09-30T22:19:33.287975+0000","last_unstale":"2023-09-30T22:19:33.658775+0000","last_undegraded":"2023-09-30T22:19:33.658775+0000","last_fullsized":"2023-09-30T22:19:33.658775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667104+0000","last_change":"2023-09-30T22:19:33.662645+0000","last_active":"2023-09-30T22:19:33.667104+0000","last_peered":"2023-09-30T22:19:33.667104+0000","last_clean":"2023-09-30T22:19:33.667104+0000","last_became_active":"2023-09-30T22:19:33.662371+0000","last_became_peered":"2023-09-30T22:19:33.662371+0000","last_unstale":"2023-09-30T22:19:33.667104+0000","last_undegraded":"2023-09-30T22:19:33.667104+0000","last_fullsized":"2023-09-30T22:19:33.667104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.680286+0000","last_change":"2023-09-30T22:19:33.289061+0000","last_active":"2023-09-30T22:19:33.680286+0000","last_peered":"2023-09-30T22:19:33.680286+0000","last_clean":"2023-09-30T22:19:33.680286+0000","last_became_active":"2023-09-30T22:19:33.288656+0000","last_became_peered":"2023-09-30T22:19:33.288656+0000","last_unstale":"2023-09-30T22:19:33.680286+0000","last_undegraded":"2023-09-30T22:19:33.680286+0000","last_fullsized":"2023-09-30T22:19:33.680286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670408+0000","last_change":"2023-09-30T22:19:33.665863+0000","last_active":"2023-09-30T22:19:33.670408+0000","last_peered":"2023-09-30T22:19:33.670408+0000","last_clean":"2023-09-30T22:19:33.670408+0000","last_became_active":"2023-09-30T22:19:33.665570+0000","last_became_peered":"2023-09-30T22:19:33.665570+0000","last_unstale":"2023-09-30T22:19:33.670408+0000","last_undegraded":"2023-09-30T22:19:33.670408+0000","last_fullsized":"2023-09-30T22:19:33.670408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.673326+0000","last_change":"2023-09-30T22:19:33.296210+0000","last_active":"2023-09-30T22:19:33.673326+0000","last_peered":"2023-09-30T22:19:33.673326+0000","last_clean":"2023-09-30T22:19:33.673326+0000","last_became_active":"2023-09-30T22:19:33.295952+0000","last_became_peered":"2023-09-30T22:19:33.295952+0000","last_unstale":"2023-09-30T22:19:33.673326+0000","last_undegraded":"2023-09-30T22:19:33.673326+0000","last_fullsized":"2023-09-30T22:19:33.673326+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.674965+0000","last_change":"2023-09-30T22:19:33.670730+0000","last_active":"2023-09-30T22:19:33.674965+0000","last_peered":"2023-09-30T22:19:33.674965+0000","last_clean":"2023-09-30T22:19:33.674965+0000","last_became_active":"2023-09-30T22:19:33.670520+0000","last_became_peered":"2023-09-30T22:19:33.670520+0000","last_unstale":"2023-09-30T22:19:33.674965+0000","last_undegraded":"2023-09-30T22:19:33.674965+0000","last_fullsized":"2023-09-30T22:19:33.674965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629387+0000","last_change":"2023-09-30T22:19:33.293117+0000","last_active":"2023-09-30T22:19:33.629387+0000","last_peered":"2023-09-30T22:19:33.629387+0000","last_clean":"2023-09-30T22:19:33.629387+0000","last_became_active":"2023-09-30T22:19:33.288262+0000","last_became_peered":"2023-09-30T22:19:33.288262+0000","last_unstale":"2023-09-30T22:19:33.629387+0000","last_undegraded":"2023-09-30T22:19:33.629387+0000","last_fullsized":"2023-09-30T22:19:33.629387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677773+0000","last_change":"2023-09-30T22:19:33.673816+0000","last_active":"2023-09-30T22:19:33.677773+0000","last_peered":"2023-09-30T22:19:33.677773+0000","last_clean":"2023-09-30T22:19:33.677773+0000","last_became_active":"2023-09-30T22:19:33.673426+0000","last_became_peered":"2023-09-30T22:19:33.673426+0000","last_unstale":"2023-09-30T22:19:33.677773+0000","last_undegraded":"2023-09-30T22:19:33.677773+0000","last_fullsized":"2023-09-30T22:19:33.677773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646927+0000","last_change":"2023-09-30T22:19:33.288441+0000","last_active":"2023-09-30T22:19:33.646927+0000","last_peered":"2023-09-30T22:19:33.646927+0000","last_clean":"2023-09-30T22:19:33.646927+0000","last_became_active":"2023-09-30T22:19:33.288030+0000","last_became_peered":"2023-09-30T22:19:33.288030+0000","last_unstale":"2023-09-30T22:19:33.646927+0000","last_undegraded":"2023-09-30T22:19:33.646927+0000","last_fullsized":"2023-09-30T22:19:33.646927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660131+0000","last_change":"2023-09-30T22:19:33.649224+0000","last_active":"2023-09-30T22:19:33.660131+0000","last_peered":"2023-09-30T22:19:33.660131+0000","last_clean":"2023-09-30T22:19:33.660131+0000","last_became_active":"2023-09-30T22:19:33.648913+0000","last_became_peered":"2023-09-30T22:19:33.648913+0000","last_unstale":"2023-09-30T22:19:33.660131+0000","last_undegraded":"2023-09-30T22:19:33.660131+0000","last_fullsized":"2023-09-30T22:19:33.660131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670116+0000","last_change":"2023-09-30T22:19:33.283730+0000","last_active":"2023-09-30T22:19:33.670116+0000","last_peered":"2023-09-30T22:19:33.670116+0000","last_clean":"2023-09-30T22:19:33.670116+0000","last_became_active":"2023-09-30T22:19:33.282944+0000","last_became_peered":"2023-09-30T22:19:33.282944+0000","last_unstale":"2023-09-30T22:19:33.670116+0000","last_undegraded":"2023-09-30T22:19:33.670116+0000","last_fullsized":"2023-09-30T22:19:33.670116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677682+0000","last_change":"2023-09-30T22:19:33.672354+0000","last_active":"2023-09-30T22:19:33.677682+0000","last_peered":"2023-09-30T22:19:33.677682+0000","last_clean":"2023-09-30T22:19:33.677682+0000","last_became_active":"2023-09-30T22:19:33.672110+0000","last_became_peered":"2023-09-30T22:19:33.672110+0000","last_unstale":"2023-09-30T22:19:33.677682+0000","last_undegraded":"2023-09-30T22:19:33.677682+0000","last_fullsized":"2023-09-30T22:19:33.677682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.659733+0000","last_change":"2023-09-30T22:19:33.293023+0000","last_active":"2023-09-30T22:19:33.659733+0000","last_peered":"2023-09-30T22:19:33.659733+0000","last_clean":"2023-09-30T22:19:33.659733+0000","last_became_active":"2023-09-30T22:19:33.288365+0000","last_became_peered":"2023-09-30T22:19:33.288365+0000","last_unstale":"2023-09-30T22:19:33.659733+0000","last_undegraded":"2023-09-30T22:19:33.659733+0000","last_fullsized":"2023-09-30T22:19:33.659733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672547+0000","last_change":"2023-09-30T22:19:33.661497+0000","last_active":"2023-09-30T22:19:33.672547+0000","last_peered":"2023-09-30T22:19:33.672547+0000","last_clean":"2023-09-30T22:19:33.672547+0000","last_became_active":"2023-09-30T22:19:33.660436+0000","last_became_peered":"2023-09-30T22:19:33.660436+0000","last_unstale":"2023-09-30T22:19:33.672547+0000","last_undegraded":"2023-09-30T22:19:33.672547+0000","last_fullsized":"2023-09-30T22:19:33.672547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.651255+0000","last_change":"2023-09-30T22:19:33.288413+0000","last_active":"2023-09-30T22:19:33.651255+0000","last_peered":"2023-09-30T22:19:33.651255+0000","last_clean":"2023-09-30T22:19:33.651255+0000","last_became_active":"2023-09-30T22:19:33.288151+0000","last_became_peered":"2023-09-30T22:19:33.288151+0000","last_unstale":"2023-09-30T22:19:33.651255+0000","last_undegraded":"2023-09-30T22:19:33.651255+0000","last_fullsized":"2023-09-30T22:19:33.651255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667065+0000","last_change":"2023-09-30T22:19:33.662546+0000","last_active":"2023-09-30T22:19:33.667065+0000","last_peered":"2023-09-30T22:19:33.667065+0000","last_clean":"2023-09-30T22:19:33.667065+0000","last_became_active":"2023-09-30T22:19:33.662214+0000","last_became_peered":"2023-09-30T22:19:33.662214+0000","last_unstale":"2023-09-30T22:19:33.667065+0000","last_undegraded":"2023-09-30T22:19:33.667065+0000","last_fullsized":"2023-09-30T22:19:33.667065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672306+0000","last_change":"2023-09-30T22:19:33.291431+0000","last_active":"2023-09-30T22:19:33.672306+0000","last_peered":"2023-09-30T22:19:33.672306+0000","last_clean":"2023-09-30T22:19:33.672306+0000","last_became_active":"2023-09-30T22:19:33.290697+0000","last_became_peered":"2023-09-30T22:19:33.290697+0000","last_unstale":"2023-09-30T22:19:33.672306+0000","last_undegraded":"2023-09-30T22:19:33.672306+0000","last_fullsized":"2023-09-30T22:19:33.672306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.669635+0000","last_change":"2023-09-30T22:19:33.658789+0000","last_active":"2023-09-30T22:19:33.669635+0000","last_peered":"2023-09-30T22:19:33.669635+0000","last_clean":"2023-09-30T22:19:33.669635+0000","last_became_active":"2023-09-30T22:19:33.658064+0000","last_became_peered":"2023-09-30T22:19:33.658064+0000","last_unstale":"2023-09-30T22:19:33.669635+0000","last_undegraded":"2023-09-30T22:19:33.669635+0000","last_fullsized":"2023-09-30T22:19:33.669635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629956+0000","last_change":"2023-09-30T22:19:33.286077+0000","last_active":"2023-09-30T22:19:33.629956+0000","last_peered":"2023-09-30T22:19:33.629956+0000","last_clean":"2023-09-30T22:19:33.629956+0000","last_became_active":"2023-09-30T22:19:33.279026+0000","last_became_peered":"2023-09-30T22:19:33.279026+0000","last_unstale":"2023-09-30T22:19:33.629956+0000","last_undegraded":"2023-09-30T22:19:33.629956+0000","last_fullsized":"2023-09-30T22:19:33.629956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658914+0000","last_change":"2023-09-30T22:19:33.647993+0000","last_active":"2023-09-30T22:19:33.658914+0000","last_peered":"2023-09-30T22:19:33.658914+0000","last_clean":"2023-09-30T22:19:33.658914+0000","last_became_active":"2023-09-30T22:19:33.647725+0000","last_became_peered":"2023-09-30T22:19:33.647725+0000","last_unstale":"2023-09-30T22:19:33.658914+0000","last_undegraded":"2023-09-30T22:19:33.658914+0000","last_fullsized":"2023-09-30T22:19:33.658914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.673006+0000","last_change":"2023-09-30T22:19:33.296389+0000","last_active":"2023-09-30T22:19:33.673006+0000","last_peered":"2023-09-30T22:19:33.673006+0000","last_clean":"2023-09-30T22:19:33.673006+0000","last_became_active":"2023-09-30T22:19:33.296134+0000","last_became_peered":"2023-09-30T22:19:33.296134+0000","last_unstale":"2023-09-30T22:19:33.673006+0000","last_undegraded":"2023-09-30T22:19:33.673006+0000","last_fullsized":"2023-09-30T22:19:33.673006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657497+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:19:33.657497+0000","last_peered":"2023-09-30T22:19:33.657497+0000","last_clean":"2023-09-30T22:19:33.657497+0000","last_became_active":"2023-09-30T22:19:33.646503+0000","last_became_peered":"2023-09-30T22:19:33.646503+0000","last_unstale":"2023-09-30T22:19:33.657497+0000","last_undegraded":"2023-09-30T22:19:33.657497+0000","last_fullsized":"2023-09-30T22:19:33.657497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649643+0000","last_change":"2023-09-30T22:19:33.287703+0000","last_active":"2023-09-30T22:19:33.649643+0000","last_peered":"2023-09-30T22:19:33.649643+0000","last_clean":"2023-09-30T22:19:33.649643+0000","last_became_active":"2023-09-30T22:19:33.287403+0000","last_became_peered":"2023-09-30T22:19:33.287403+0000","last_unstale":"2023-09-30T22:19:33.649643+0000","last_undegraded":"2023-09-30T22:19:33.649643+0000","last_fullsized":"2023-09-30T22:19:33.649643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677695+0000","last_change":"2023-09-30T22:19:33.672679+0000","last_active":"2023-09-30T22:19:33.677695+0000","last_peered":"2023-09-30T22:19:33.677695+0000","last_clean":"2023-09-30T22:19:33.677695+0000","last_became_active":"2023-09-30T22:19:33.671069+0000","last_became_peered":"2023-09-30T22:19:33.671069+0000","last_unstale":"2023-09-30T22:19:33.677695+0000","last_undegraded":"2023-09-30T22:19:33.677695+0000","last_fullsized":"2023-09-30T22:19:33.677695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646440+0000","last_change":"2023-09-30T22:19:33.288281+0000","last_active":"2023-09-30T22:19:33.646440+0000","last_peered":"2023-09-30T22:19:33.646440+0000","last_clean":"2023-09-30T22:19:33.646440+0000","last_became_active":"2023-09-30T22:19:33.287697+0000","last_became_peered":"2023-09-30T22:19:33.287697+0000","last_unstale":"2023-09-30T22:19:33.646440+0000","last_undegraded":"2023-09-30T22:19:33.646440+0000","last_fullsized":"2023-09-30T22:19:33.646440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670458+0000","last_change":"2023-09-30T22:19:33.666225+0000","last_active":"2023-09-30T22:19:33.670458+0000","last_peered":"2023-09-30T22:19:33.670458+0000","last_clean":"2023-09-30T22:19:33.670458+0000","last_became_active":"2023-09-30T22:19:33.665223+0000","last_became_peered":"2023-09-30T22:19:33.665223+0000","last_unstale":"2023-09-30T22:19:33.670458+0000","last_undegraded":"2023-09-30T22:19:33.670458+0000","last_fullsized":"2023-09-30T22:19:33.670458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.643940+0000","last_change":"2023-09-30T22:19:33.289238+0000","last_active":"2023-09-30T22:19:33.643940+0000","last_peered":"2023-09-30T22:19:33.643940+0000","last_clean":"2023-09-30T22:19:33.643940+0000","last_became_active":"2023-09-30T22:19:33.288633+0000","last_became_peered":"2023-09-30T22:19:33.288633+0000","last_unstale":"2023-09-30T22:19:33.643940+0000","last_undegraded":"2023-09-30T22:19:33.643940+0000","last_fullsized":"2023-09-30T22:19:33.643940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655152+0000","last_change":"2023-09-30T22:19:33.649869+0000","last_active":"2023-09-30T22:19:33.655152+0000","last_peered":"2023-09-30T22:19:33.655152+0000","last_clean":"2023-09-30T22:19:33.655152+0000","last_became_active":"2023-09-30T22:19:33.649582+0000","last_became_peered":"2023-09-30T22:19:33.649582+0000","last_unstale":"2023-09-30T22:19:33.655152+0000","last_undegraded":"2023-09-30T22:19:33.655152+0000","last_fullsized":"2023-09-30T22:19:33.655152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.638416+0000","last_change":"2023-09-30T22:19:30.188504+0000","last_active":"2023-09-30T22:19:33.638416+0000","last_peered":"2023-09-30T22:19:33.638416+0000","last_clean":"2023-09-30T22:19:33.638416+0000","last_became_active":"2023-09-30T22:19:30.188218+0000","last_became_peered":"2023-09-30T22:19:30.188218+0000","last_unstale":"2023-09-30T22:19:33.638416+0000","last_undegraded":"2023-09-30T22:19:33.638416+0000","last_fullsized":"2023-09-30T22:19:33.638416+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.636797+0000","last_change":"2023-09-30T22:19:33.282597+0000","last_active":"2023-09-30T22:19:33.636797+0000","last_peered":"2023-09-30T22:19:33.636797+0000","last_clean":"2023-09-30T22:19:33.636797+0000","last_became_active":"2023-09-30T22:19:33.280396+0000","last_became_peered":"2023-09-30T22:19:33.280396+0000","last_unstale":"2023-09-30T22:19:33.636797+0000","last_undegraded":"2023-09-30T22:19:33.636797+0000","last_fullsized":"2023-09-30T22:19:33.636797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672752+0000","last_change":"2023-09-30T22:19:33.670732+0000","last_active":"2023-09-30T22:19:33.672752+0000","last_peered":"2023-09-30T22:19:33.672752+0000","last_clean":"2023-09-30T22:19:33.672752+0000","last_became_active":"2023-09-30T22:19:33.670470+0000","last_became_peered":"2023-09-30T22:19:33.670470+0000","last_unstale":"2023-09-30T22:19:33.672752+0000","last_undegraded":"2023-09-30T22:19:33.672752+0000","last_fullsized":"2023-09-30T22:19:33.672752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649555+0000","last_change":"2023-09-30T22:19:29.250128+0000","last_active":"2023-09-30T22:19:33.649555+0000","last_peered":"2023-09-30T22:19:33.649555+0000","last_clean":"2023-09-30T22:19:33.649555+0000","last_became_active":"2023-09-30T22:19:29.249745+0000","last_became_peered":"2023-09-30T22:19:29.249745+0000","last_unstale":"2023-09-30T22:19:33.649555+0000","last_undegraded":"2023-09-30T22:19:33.649555+0000","last_fullsized":"2023-09-30T22:19:33.649555+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.630032+0000","last_change":"2023-09-30T22:19:33.294524+0000","last_active":"2023-09-30T22:19:33.630032+0000","last_peered":"2023-09-30T22:19:33.630032+0000","last_clean":"2023-09-30T22:19:33.630032+0000","last_became_active":"2023-09-30T22:19:33.293937+0000","last_became_peered":"2023-09-30T22:19:33.293937+0000","last_unstale":"2023-09-30T22:19:33.630032+0000","last_undegraded":"2023-09-30T22:19:33.630032+0000","last_fullsized":"2023-09-30T22:19:33.630032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666835+0000","last_change":"2023-09-30T22:19:33.653434+0000","last_active":"2023-09-30T22:19:33.666835+0000","last_peered":"2023-09-30T22:19:33.666835+0000","last_clean":"2023-09-30T22:19:33.666835+0000","last_became_active":"2023-09-30T22:19:33.652629+0000","last_became_peered":"2023-09-30T22:19:33.652629+0000","last_unstale":"2023-09-30T22:19:33.666835+0000","last_undegraded":"2023-09-30T22:19:33.666835+0000","last_fullsized":"2023-09-30T22:19:33.666835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.632600+0000","last_change":"2023-09-30T22:19:29.249638+0000","last_active":"2023-09-30T22:19:33.632600+0000","last_peered":"2023-09-30T22:19:33.632600+0000","last_clean":"2023-09-30T22:19:33.632600+0000","last_became_active":"2023-09-30T22:19:29.249366+0000","last_became_peered":"2023-09-30T22:19:29.249366+0000","last_unstale":"2023-09-30T22:19:33.632600+0000","last_undegraded":"2023-09-30T22:19:33.632600+0000","last_fullsized":"2023-09-30T22:19:33.632600+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.636097+0000","last_change":"2023-09-30T22:19:33.290330+0000","last_active":"2023-09-30T22:19:33.636097+0000","last_peered":"2023-09-30T22:19:33.636097+0000","last_clean":"2023-09-30T22:19:33.636097+0000","last_became_active":"2023-09-30T22:19:33.289841+0000","last_became_peered":"2023-09-30T22:19:33.289841+0000","last_unstale":"2023-09-30T22:19:33.636097+0000","last_undegraded":"2023-09-30T22:19:33.636097+0000","last_fullsized":"2023-09-30T22:19:33.636097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667282+0000","last_change":"2023-09-30T22:19:33.657019+0000","last_active":"2023-09-30T22:19:33.667282+0000","last_peered":"2023-09-30T22:19:33.667282+0000","last_clean":"2023-09-30T22:19:33.667282+0000","last_became_active":"2023-09-30T22:19:33.656759+0000","last_became_peered":"2023-09-30T22:19:33.656759+0000","last_unstale":"2023-09-30T22:19:33.667282+0000","last_undegraded":"2023-09-30T22:19:33.667282+0000","last_fullsized":"2023-09-30T22:19:33.667282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.650158+0000","last_change":"2023-09-30T22:19:29.249647+0000","last_active":"2023-09-30T22:19:33.650158+0000","last_peered":"2023-09-30T22:19:33.650158+0000","last_clean":"2023-09-30T22:19:33.650158+0000","last_became_active":"2023-09-30T22:19:29.249371+0000","last_became_peered":"2023-09-30T22:19:29.249371+0000","last_unstale":"2023-09-30T22:19:33.650158+0000","last_undegraded":"2023-09-30T22:19:33.650158+0000","last_fullsized":"2023-09-30T22:19:33.650158+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.636006+0000","last_change":"2023-09-30T22:19:30.188360+0000","last_active":"2023-09-30T22:19:33.636006+0000","last_peered":"2023-09-30T22:19:33.636006+0000","last_clean":"2023-09-30T22:19:33.636006+0000","last_became_active":"2023-09-30T22:19:30.187849+0000","last_became_peered":"2023-09-30T22:19:30.187849+0000","last_unstale":"2023-09-30T22:19:33.636006+0000","last_undegraded":"2023-09-30T22:19:33.636006+0000","last_fullsized":"2023-09-30T22:19:33.636006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649406+0000","last_change":"2023-09-30T22:19:33.292032+0000","last_active":"2023-09-30T22:19:33.649406+0000","last_peered":"2023-09-30T22:19:33.649406+0000","last_clean":"2023-09-30T22:19:33.649406+0000","last_became_active":"2023-09-30T22:19:33.291755+0000","last_became_peered":"2023-09-30T22:19:33.291755+0000","last_unstale":"2023-09-30T22:19:33.649406+0000","last_undegraded":"2023-09-30T22:19:33.649406+0000","last_fullsized":"2023-09-30T22:19:33.649406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.680227+0000","last_change":"2023-09-30T22:19:33.674909+0000","last_active":"2023-09-30T22:19:33.680227+0000","last_peered":"2023-09-30T22:19:33.680227+0000","last_clean":"2023-09-30T22:19:33.680227+0000","last_became_active":"2023-09-30T22:19:33.674646+0000","last_became_peered":"2023-09-30T22:19:33.674646+0000","last_unstale":"2023-09-30T22:19:33.680227+0000","last_undegraded":"2023-09-30T22:19:33.680227+0000","last_fullsized":"2023-09-30T22:19:33.680227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.644054+0000","last_change":"2023-09-30T22:19:29.250622+0000","last_active":"2023-09-30T22:19:33.644054+0000","last_peered":"2023-09-30T22:19:33.644054+0000","last_clean":"2023-09-30T22:19:33.644054+0000","last_became_active":"2023-09-30T22:19:29.250370+0000","last_became_peered":"2023-09-30T22:19:29.250370+0000","last_unstale":"2023-09-30T22:19:33.644054+0000","last_undegraded":"2023-09-30T22:19:33.644054+0000","last_fullsized":"2023-09-30T22:19:33.644054+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629147+0000","last_change":"2023-09-30T22:19:33.279290+0000","last_active":"2023-09-30T22:19:33.629147+0000","last_peered":"2023-09-30T22:19:33.629147+0000","last_clean":"2023-09-30T22:19:33.629147+0000","last_became_active":"2023-09-30T22:19:33.277328+0000","last_became_peered":"2023-09-30T22:19:33.277328+0000","last_unstale":"2023-09-30T22:19:33.629147+0000","last_undegraded":"2023-09-30T22:19:33.629147+0000","last_fullsized":"2023-09-30T22:19:33.629147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660099+0000","last_change":"2023-09-30T22:19:33.646613+0000","last_active":"2023-09-30T22:19:33.660099+0000","last_peered":"2023-09-30T22:19:33.660099+0000","last_clean":"2023-09-30T22:19:33.660099+0000","last_became_active":"2023-09-30T22:19:33.646057+0000","last_became_peered":"2023-09-30T22:19:33.646057+0000","last_unstale":"2023-09-30T22:19:33.660099+0000","last_undegraded":"2023-09-30T22:19:33.660099+0000","last_fullsized":"2023-09-30T22:19:33.660099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.656110+0000","last_change":"2023-09-30T22:19:30.188159+0000","last_active":"2023-09-30T22:19:33.656110+0000","last_peered":"2023-09-30T22:19:33.656110+0000","last_clean":"2023-09-30T22:19:33.656110+0000","last_became_active":"2023-09-30T22:19:30.187869+0000","last_became_peered":"2023-09-30T22:19:30.187869+0000","last_unstale":"2023-09-30T22:19:33.656110+0000","last_undegraded":"2023-09-30T22:19:33.656110+0000","last_fullsized":"2023-09-30T22:19:33.656110+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.638033+0000","last_change":"2023-09-30T22:19:33.289031+0000","last_active":"2023-09-30T22:19:33.638033+0000","last_peered":"2023-09-30T22:19:33.638033+0000","last_clean":"2023-09-30T22:19:33.638033+0000","last_became_active":"2023-09-30T22:19:33.288758+0000","last_became_peered":"2023-09-30T22:19:33.288758+0000","last_unstale":"2023-09-30T22:19:33.638033+0000","last_undegraded":"2023-09-30T22:19:33.638033+0000","last_fullsized":"2023-09-30T22:19:33.638033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658895+0000","last_change":"2023-09-30T22:19:33.642133+0000","last_active":"2023-09-30T22:19:33.658895+0000","last_peered":"2023-09-30T22:19:33.658895+0000","last_clean":"2023-09-30T22:19:33.658895+0000","last_became_active":"2023-09-30T22:19:33.641852+0000","last_became_peered":"2023-09-30T22:19:33.641852+0000","last_unstale":"2023-09-30T22:19:33.658895+0000","last_undegraded":"2023-09-30T22:19:33.658895+0000","last_fullsized":"2023-09-30T22:19:33.658895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672798+0000","last_change":"2023-09-30T22:19:33.290927+0000","last_active":"2023-09-30T22:19:33.672798+0000","last_peered":"2023-09-30T22:19:33.672798+0000","last_clean":"2023-09-30T22:19:33.672798+0000","last_became_active":"2023-09-30T22:19:33.290662+0000","last_became_peered":"2023-09-30T22:19:33.290662+0000","last_unstale":"2023-09-30T22:19:33.672798+0000","last_undegraded":"2023-09-30T22:19:33.672798+0000","last_fullsized":"2023-09-30T22:19:33.672798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.639243+0000","last_change":"2023-09-30T22:19:30.190576+0000","last_active":"2023-09-30T22:19:33.639243+0000","last_peered":"2023-09-30T22:19:33.639243+0000","last_clean":"2023-09-30T22:19:33.639243+0000","last_became_active":"2023-09-30T22:19:30.190289+0000","last_became_peered":"2023-09-30T22:19:30.190289+0000","last_unstale":"2023-09-30T22:19:33.639243+0000","last_undegraded":"2023-09-30T22:19:33.639243+0000","last_fullsized":"2023-09-30T22:19:33.639243+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.671605+0000","last_change":"2023-09-30T22:19:33.660579+0000","last_active":"2023-09-30T22:19:33.671605+0000","last_peered":"2023-09-30T22:19:33.671605+0000","last_clean":"2023-09-30T22:19:33.671605+0000","last_became_active":"2023-09-30T22:19:33.659849+0000","last_became_peered":"2023-09-30T22:19:33.659849+0000","last_unstale":"2023-09-30T22:19:33.671605+0000","last_undegraded":"2023-09-30T22:19:33.671605+0000","last_fullsized":"2023-09-30T22:19:33.671605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660521+0000","last_change":"2023-09-30T22:19:30.188129+0000","last_active":"2023-09-30T22:19:33.660521+0000","last_peered":"2023-09-30T22:19:33.660521+0000","last_clean":"2023-09-30T22:19:33.660521+0000","last_became_active":"2023-09-30T22:19:30.187818+0000","last_became_peered":"2023-09-30T22:19:30.187818+0000","last_unstale":"2023-09-30T22:19:33.660521+0000","last_undegraded":"2023-09-30T22:19:33.660521+0000","last_fullsized":"2023-09-30T22:19:33.660521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.630331+0000","last_change":"2023-09-30T22:19:33.296579+0000","last_active":"2023-09-30T22:19:33.630331+0000","last_peered":"2023-09-30T22:19:33.630331+0000","last_clean":"2023-09-30T22:19:33.630331+0000","last_became_active":"2023-09-30T22:19:33.295804+0000","last_became_peered":"2023-09-30T22:19:33.295804+0000","last_unstale":"2023-09-30T22:19:33.630331+0000","last_undegraded":"2023-09-30T22:19:33.630331+0000","last_fullsized":"2023-09-30T22:19:33.630331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646166+0000","last_change":"2023-09-30T22:19:33.642976+0000","last_active":"2023-09-30T22:19:33.646166+0000","last_peered":"2023-09-30T22:19:33.646166+0000","last_clean":"2023-09-30T22:19:33.646166+0000","last_became_active":"2023-09-30T22:19:33.642732+0000","last_became_peered":"2023-09-30T22:19:33.642732+0000","last_unstale":"2023-09-30T22:19:33.646166+0000","last_undegraded":"2023-09-30T22:19:33.646166+0000","last_fullsized":"2023-09-30T22:19:33.646166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.648507+0000","last_change":"2023-09-30T22:19:33.293670+0000","last_active":"2023-09-30T22:19:33.648507+0000","last_peered":"2023-09-30T22:19:33.648507+0000","last_clean":"2023-09-30T22:19:33.648507+0000","last_became_active":"2023-09-30T22:19:33.293179+0000","last_became_peered":"2023-09-30T22:19:33.293179+0000","last_unstale":"2023-09-30T22:19:33.648507+0000","last_undegraded":"2023-09-30T22:19:33.648507+0000","last_fullsized":"2023-09-30T22:19:33.648507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.648053+0000","last_change":"2023-09-30T22:19:33.647280+0000","last_active":"2023-09-30T22:19:33.648053+0000","last_peered":"2023-09-30T22:19:33.648053+0000","last_clean":"2023-09-30T22:19:33.648053+0000","last_became_active":"2023-09-30T22:19:33.646935+0000","last_became_peered":"2023-09-30T22:19:33.646935+0000","last_unstale":"2023-09-30T22:19:33.648053+0000","last_undegraded":"2023-09-30T22:19:33.648053+0000","last_fullsized":"2023-09-30T22:19:33.648053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667484+0000","last_change":"2023-09-30T22:19:33.296231+0000","last_active":"2023-09-30T22:19:33.667484+0000","last_peered":"2023-09-30T22:19:33.667484+0000","last_clean":"2023-09-30T22:19:33.667484+0000","last_became_active":"2023-09-30T22:19:33.295946+0000","last_became_peered":"2023-09-30T22:19:33.295946+0000","last_unstale":"2023-09-30T22:19:33.667484+0000","last_undegraded":"2023-09-30T22:19:33.667484+0000","last_fullsized":"2023-09-30T22:19:33.667484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670372+0000","last_change":"2023-09-30T22:19:33.665656+0000","last_active":"2023-09-30T22:19:33.670372+0000","last_peered":"2023-09-30T22:19:33.670372+0000","last_clean":"2023-09-30T22:19:33.670372+0000","last_became_active":"2023-09-30T22:19:33.658850+0000","last_became_peered":"2023-09-30T22:19:33.658850+0000","last_unstale":"2023-09-30T22:19:33.670372+0000","last_undegraded":"2023-09-30T22:19:33.670372+0000","last_fullsized":"2023-09-30T22:19:33.670372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.673945+0000","last_change":"2023-09-30T22:19:33.291605+0000","last_active":"2023-09-30T22:19:33.673945+0000","last_peered":"2023-09-30T22:19:33.673945+0000","last_clean":"2023-09-30T22:19:33.673945+0000","last_became_active":"2023-09-30T22:19:33.291048+0000","last_became_peered":"2023-09-30T22:19:33.291048+0000","last_unstale":"2023-09-30T22:19:33.673945+0000","last_undegraded":"2023-09-30T22:19:33.673945+0000","last_fullsized":"2023-09-30T22:19:33.673945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646181+0000","last_change":"2023-09-30T22:19:33.643062+0000","last_active":"2023-09-30T22:19:33.646181+0000","last_peered":"2023-09-30T22:19:33.646181+0000","last_clean":"2023-09-30T22:19:33.646181+0000","last_became_active":"2023-09-30T22:19:33.642791+0000","last_became_peered":"2023-09-30T22:19:33.642791+0000","last_unstale":"2023-09-30T22:19:33.646181+0000","last_undegraded":"2023-09-30T22:19:33.646181+0000","last_fullsized":"2023-09-30T22:19:33.646181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.671521+0000","last_change":"2023-09-30T22:19:33.287971+0000","last_active":"2023-09-30T22:19:33.671521+0000","last_peered":"2023-09-30T22:19:33.671521+0000","last_clean":"2023-09-30T22:19:33.671521+0000","last_became_active":"2023-09-30T22:19:33.287720+0000","last_became_peered":"2023-09-30T22:19:33.287720+0000","last_unstale":"2023-09-30T22:19:33.671521+0000","last_undegraded":"2023-09-30T22:19:33.671521+0000","last_fullsized":"2023-09-30T22:19:33.671521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.674944+0000","last_change":"2023-09-30T22:19:33.670264+0000","last_active":"2023-09-30T22:19:33.674944+0000","last_peered":"2023-09-30T22:19:33.674944+0000","last_clean":"2023-09-30T22:19:33.674944+0000","last_became_active":"2023-09-30T22:19:33.670020+0000","last_became_peered":"2023-09-30T22:19:33.670020+0000","last_unstale":"2023-09-30T22:19:33.674944+0000","last_undegraded":"2023-09-30T22:19:33.674944+0000","last_fullsized":"2023-09-30T22:19:33.674944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.659924+0000","last_change":"2023-09-30T22:19:33.293238+0000","last_active":"2023-09-30T22:19:33.659924+0000","last_peered":"2023-09-30T22:19:33.659924+0000","last_clean":"2023-09-30T22:19:33.659924+0000","last_became_active":"2023-09-30T22:19:33.292967+0000","last_became_peered":"2023-09-30T22:19:33.292967+0000","last_unstale":"2023-09-30T22:19:33.659924+0000","last_undegraded":"2023-09-30T22:19:33.659924+0000","last_fullsized":"2023-09-30T22:19:33.659924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646415+0000","last_change":"2023-09-30T22:19:33.641684+0000","last_active":"2023-09-30T22:19:33.646415+0000","last_peered":"2023-09-30T22:19:33.646415+0000","last_clean":"2023-09-30T22:19:33.646415+0000","last_became_active":"2023-09-30T22:19:33.641403+0000","last_became_peered":"2023-09-30T22:19:33.641403+0000","last_unstale":"2023-09-30T22:19:33.646415+0000","last_undegraded":"2023-09-30T22:19:33.646415+0000","last_fullsized":"2023-09-30T22:19:33.646415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.654218+0000","last_change":"2023-09-30T22:19:33.644249+0000","last_active":"2023-09-30T22:19:33.654218+0000","last_peered":"2023-09-30T22:19:33.654218+0000","last_clean":"2023-09-30T22:19:33.654218+0000","last_became_active":"2023-09-30T22:19:33.643987+0000","last_became_peered":"2023-09-30T22:19:33.643987+0000","last_unstale":"2023-09-30T22:19:33.654218+0000","last_undegraded":"2023-09-30T22:19:33.654218+0000","last_fullsized":"2023-09-30T22:19:33.654218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672002+0000","last_change":"2023-09-30T22:19:33.659592+0000","last_active":"2023-09-30T22:19:33.672002+0000","last_peered":"2023-09-30T22:19:33.672002+0000","last_clean":"2023-09-30T22:19:33.672002+0000","last_became_active":"2023-09-30T22:19:33.659324+0000","last_became_peered":"2023-09-30T22:19:33.659324+0000","last_unstale":"2023-09-30T22:19:33.672002+0000","last_undegraded":"2023-09-30T22:19:33.672002+0000","last_fullsized":"2023-09-30T22:19:33.672002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658095+0000","last_change":"2023-09-30T22:19:33.651082+0000","last_active":"2023-09-30T22:19:33.658095+0000","last_peered":"2023-09-30T22:19:33.658095+0000","last_clean":"2023-09-30T22:19:33.658095+0000","last_became_active":"2023-09-30T22:19:33.650784+0000","last_became_peered":"2023-09-30T22:19:33.650784+0000","last_unstale":"2023-09-30T22:19:33.658095+0000","last_undegraded":"2023-09-30T22:19:33.658095+0000","last_fullsized":"2023-09-30T22:19:33.658095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677740+0000","last_change":"2023-09-30T22:19:33.673256+0000","last_active":"2023-09-30T22:19:33.677740+0000","last_peered":"2023-09-30T22:19:33.677740+0000","last_clean":"2023-09-30T22:19:33.677740+0000","last_became_active":"2023-09-30T22:19:33.672980+0000","last_became_peered":"2023-09-30T22:19:33.672980+0000","last_unstale":"2023-09-30T22:19:33.677740+0000","last_undegraded":"2023-09-30T22:19:33.677740+0000","last_fullsized":"2023-09-30T22:19:33.677740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666848+0000","last_change":"2023-09-30T22:19:33.653617+0000","last_active":"2023-09-30T22:19:33.666848+0000","last_peered":"2023-09-30T22:19:33.666848+0000","last_clean":"2023-09-30T22:19:33.666848+0000","last_became_active":"2023-09-30T22:19:33.653009+0000","last_became_peered":"2023-09-30T22:19:33.653009+0000","last_unstale":"2023-09-30T22:19:33.666848+0000","last_undegraded":"2023-09-30T22:19:33.666848+0000","last_fullsized":"2023-09-30T22:19:33.666848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":45214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:19:41.294 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T22:19:41.295 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:19:41.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:19:41.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:19:41.295 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-30T22:19:41.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde95bcb700 1 Processor -- start 2023-09-30T22:19:41.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde95bcb700 1 -- start start 2023-09-30T22:19:41.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde95bcb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde90062b00 0x7fde90095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde95bcb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde95bcb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde90091980 con 0x7fde90096490 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde95bcb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde900973f0 con 0x7fde90062b00 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde95bcb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde90062ee0 con 0x7fde90095b80 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde8f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde90062b00 0x7fde90095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde8effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde8ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fde90096490 0x7fde90131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41630/0 (socket says 172.21.15.154:41630) 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.445+0000 7fde8ffff700 1 -- 172.21.15.154:0/1862146626 learned_addr learned my addr 172.21.15.154:0/1862146626 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8e7fc700 1 -- 172.21.15.154:0/1862146626 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963250668 0 0) 0x7fde90091980 con 0x7fde90096490 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8e7fc700 1 -- 172.21.15.154:0/1862146626 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde780033f0 con 0x7fde90096490 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8f7fe700 1 -- 172.21.15.154:0/1862146626 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 msgr2=0x7fde90095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:41.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8f7fe700 1 --2- 172.21.15.154:0/1862146626 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8f7fe700 1 -- 172.21.15.154:0/1862146626 >> v1:172.21.15.154:6789/0 conn(0x7fde90096490 legacy=0x7fde90131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8f7fe700 1 -- 172.21.15.154:0/1862146626 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90092310 con 0x7fde90062b00 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8effd700 1 --2- 172.21.15.154:0/1862146626 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8f7fe700 1 --2- 172.21.15.154:0/1862146626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 0x7fde90095690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fde80009790 tx=0x7fde80009060).ready entity=mon.0 client_cookie=ef7b12dc343dcf60 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8e7fc700 1 -- 172.21.15.154:0/1862146626 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000d4a0 con 0x7fde90062b00 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8e7fc700 1 -- 172.21.15.154:0/1862146626 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8000d600 con 0x7fde90062b00 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.446+0000 7fde8e7fc700 1 -- 172.21.15.154:0/1862146626 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000d980 con 0x7fde90062b00 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.447+0000 7fde95bcb700 1 -- 172.21.15.154:0/1862146626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 msgr2=0x7fde90095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.447+0000 7fde95bcb700 1 --2- 172.21.15.154:0/1862146626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 0x7fde90095690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fde80009790 tx=0x7fde80009060).stop 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.447+0000 7fde95bcb700 1 -- 172.21.15.154:0/1862146626 shutdown_connections 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.447+0000 7fde95bcb700 1 --2- 172.21.15.154:0/1862146626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 0x7fde90095690 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.447+0000 7fde95bcb700 1 --2- 172.21.15.154:0/1862146626 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.447+0000 7fde95bcb700 1 -- 172.21.15.154:0/1862146626 >> 172.21.15.154:0/1862146626 conn(0x7fde9009aa50 msgr2=0x7fde9009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.447+0000 7fde95bcb700 1 -- 172.21.15.154:0/1862146626 shutdown_connections 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.447+0000 7fde95bcb700 1 -- 172.21.15.154:0/1862146626 wait complete. 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde95bcb700 1 Processor -- start 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde95bcb700 1 -- start start 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde95bcb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 0x7fde901195d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde95bcb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90115630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde95bcb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde90096490 0x7fde90115b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde95bcb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90096da0 con 0x7fde90062b00 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde95bcb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9012d770 con 0x7fde90096490 2023-09-30T22:19:41.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde95bcb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde901190d0 con 0x7fde90095b80 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 0x7fde901195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90115630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 0x7fde901195d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37054/0 (socket says 172.21.15.154:37054) 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde90096490 0x7fde90115b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8f7fe700 1 -- 172.21.15.154:0/845697241 learned_addr learned my addr 172.21.15.154:0/845697241 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8effd700 1 -- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde90096490 msgr2=0x7fde90115b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8effd700 1 --2- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde90096490 0x7fde90115b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8effd700 1 -- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 msgr2=0x7fde901195d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8effd700 1 --2- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 0x7fde901195d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8effd700 1 -- 172.21.15.154:0/845697241 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840092a0 con 0x7fde90095b80 2023-09-30T22:19:41.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8f7fe700 1 --2- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 0x7fde901195d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.448+0000 7fde8ffff700 1 --2- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde90096490 0x7fde90115b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.449+0000 7fde8effd700 1 --2- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90115630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fde8400e980 tx=0x7fde84009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.449+0000 7fde777fe700 1 -- 172.21.15.154:0/845697241 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84012600 con 0x7fde90095b80 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.449+0000 7fde777fe700 1 -- 172.21.15.154:0/845697241 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde84012760 con 0x7fde90095b80 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.449+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde800092a0 con 0x7fde90095b80 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.449+0000 7fde777fe700 1 -- 172.21.15.154:0/845697241 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84012b00 con 0x7fde90095b80 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.449+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde90118b30 con 0x7fde90095b80 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.449+0000 7fde777fe700 1 -- 172.21.15.154:0/845697241 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fde8401b400 con 0x7fde90095b80 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.450+0000 7fde777fe700 1 -- 172.21.15.154:0/845697241 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fde8403b3d0 con 0x7fde90095b80 2023-09-30T22:19:41.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.450+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde90118cf0 con 0x7fde90095b80 2023-09-30T22:19:41.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.454+0000 7fde777fe700 1 -- 172.21.15.154:0/845697241 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fde84019900 con 0x7fde90095b80 2023-09-30T22:19:41.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.652+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fde9005a260 con 0x7fde90095b80 2023-09-30T22:19:41.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.654+0000 7fde777fe700 1 -- 172.21.15.154:0/845697241 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64133 (secure 0 0 0) 0x7fde84019310 con 0x7fde90095b80 2023-09-30T22:19:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:41.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.655+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 >> v1:172.21.15.154:6816/118163 conn(0x7fde7c02bb60 legacy=0x7fde7c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.655+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 msgr2=0x7fde90115630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.655+0000 7fde95bcb700 1 --2- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90115630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fde8400e980 tx=0x7fde84009060).stop 2023-09-30T22:19:41.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.656+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 shutdown_connections 2023-09-30T22:19:41.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.656+0000 7fde95bcb700 1 --2- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde90096490 0x7fde90115b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.656+0000 7fde95bcb700 1 --2- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde90062b00 0x7fde901195d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.656+0000 7fde95bcb700 1 --2- 172.21.15.154:0/845697241 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde90095b80 0x7fde90115630 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.656+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 >> 172.21.15.154:0/845697241 conn(0x7fde9009aa50 msgr2=0x7fde9012ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.656+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 shutdown_connections 2023-09-30T22:19:41.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.656+0000 7fde95bcb700 1 -- 172.21.15.154:0/845697241 wait complete. 2023-09-30T22:19:41.669 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6816","nonce":118163}]},"active_addr":"172.21.15.154:6816/118163","active_change":"2023-09-30T22:19:23.208349+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":956756939}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2017971531}]}]} 2023-09-30T22:19:41.670 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:19:41.671 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:19:41.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:41.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.788+0000 7fcd7c5b0700 1 Processor -- start 2023-09-30T22:19:41.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.788+0000 7fcd7c5b0700 1 -- start start 2023-09-30T22:19:41.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7c5b0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd740968b0 0x7fcd74096c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7c5b0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7412fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7c5b0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd740692c0 con 0x7fcd74097180 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7c5b0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd74092540 con 0x7fcd740968b0 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7c5b0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74092210 con 0x7fcd740685a0 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7a34c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd740968b0 0x7fcd74096c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7ab4d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7412fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd79b4b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcd74097180 0x7fcd74067e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41644/0 (socket says 172.21.15.154:41644) 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd79b4b700 1 -- 172.21.15.154:0/3585823668 learned_addr learned my addr 172.21.15.154:0/3585823668 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7a34c700 1 -- 172.21.15.154:0/3585823668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 msgr2=0x7fcd7412fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7a34c700 1 --2- 172.21.15.154:0/3585823668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7412fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7a34c700 1 -- 172.21.15.154:0/3585823668 >> v1:172.21.15.154:6789/0 conn(0x7fcd74097180 legacy=0x7fcd74067e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7a34c700 1 -- 172.21.15.154:0/3585823668 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd74093430 con 0x7fcd740968b0 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7934a700 1 -- 172.21.15.154:0/3585823668 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128633817 0 0) 0x7fcd740692c0 con 0x7fcd74097180 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7ab4d700 1 --2- 172.21.15.154:0/3585823668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.789+0000 7fcd7a34c700 1 --2- 172.21.15.154:0/3585823668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 0x7fcd74096c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fcd64009760 tx=0x7fcd64009060).ready entity=mon.0 client_cookie=f14b428c42d2ebc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7934a700 1 -- 172.21.15.154:0/3585823668 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400f510 con 0x7fcd740968b0 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7934a700 1 -- 172.21.15.154:0/3585823668 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6400f670 con 0x7fcd740968b0 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7934a700 1 -- 172.21.15.154:0/3585823668 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400f9f0 con 0x7fcd740968b0 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/3585823668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 msgr2=0x7fcd74096c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7c5b0700 1 --2- 172.21.15.154:0/3585823668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 0x7fcd74096c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fcd64009760 tx=0x7fcd64009060).stop 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/3585823668 shutdown_connections 2023-09-30T22:19:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7c5b0700 1 --2- 172.21.15.154:0/3585823668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7412fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7c5b0700 1 --2- 172.21.15.154:0/3585823668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 0x7fcd74096c90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/3585823668 >> 172.21.15.154:0/3585823668 conn(0x7fcd7409a1c0 msgr2=0x7fcd7409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/3585823668 shutdown_connections 2023-09-30T22:19:41.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.790+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/3585823668 wait complete. 2023-09-30T22:19:41.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.791+0000 7fcd7c5b0700 1 Processor -- start 2023-09-30T22:19:41.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.791+0000 7fcd7c5b0700 1 -- start start 2023-09-30T22:19:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.791+0000 7fcd7c5b0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7413a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.791+0000 7fcd7c5b0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 0x7fcd7413a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.791+0000 7fcd7c5b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd74097180 0x7fcd7412dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.791+0000 7fcd7c5b0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7412f270 con 0x7fcd740968b0 2023-09-30T22:19:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.791+0000 7fcd7c5b0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74091dc0 con 0x7fcd74097180 2023-09-30T22:19:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.791+0000 7fcd7c5b0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd74131170 con 0x7fcd740685a0 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7a34c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7413a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd79b4b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 0x7fcd7413a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7a34c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7413a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59984/0 (socket says 172.21.15.154:59984) 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7a34c700 1 -- 172.21.15.154:0/4088874813 learned_addr learned my addr 172.21.15.154:0/4088874813 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7ab4d700 1 --2- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd74097180 0x7fcd7412dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7a34c700 1 -- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd74097180 msgr2=0x7fcd7412dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7a34c700 1 --2- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd74097180 0x7fcd7412dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7a34c700 1 -- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 msgr2=0x7fcd7413a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7a34c700 1 --2- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 0x7fcd7413a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7a34c700 1 -- 172.21.15.154:0/4088874813 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c009a20 con 0x7fcd740685a0 2023-09-30T22:19:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd79b4b700 1 --2- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 0x7fcd7413a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7a34c700 1 --2- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7413a400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fcd64006db0 tx=0x7fcd64017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd6a7fc700 1 -- 172.21.15.154:0/4088874813 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400f7e0 con 0x7fcd740685a0 2023-09-30T22:19:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd6a7fc700 1 -- 172.21.15.154:0/4088874813 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6400f940 con 0x7fcd740685a0 2023-09-30T22:19:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd640092a0 con 0x7fcd740685a0 2023-09-30T22:19:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd6a7fc700 1 -- 172.21.15.154:0/4088874813 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6401b660 con 0x7fcd740685a0 2023-09-30T22:19:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.792+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd74130c80 con 0x7fcd740685a0 2023-09-30T22:19:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.793+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd74097680 con 0x7fcd740685a0 2023-09-30T22:19:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.793+0000 7fcd6a7fc700 1 -- 172.21.15.154:0/4088874813 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcd6401ba10 con 0x7fcd740685a0 2023-09-30T22:19:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.794+0000 7fcd6a7fc700 1 -- 172.21.15.154:0/4088874813 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcd6403ce20 con 0x7fcd740685a0 2023-09-30T22:19:41.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.798+0000 7fcd6a7fc700 1 -- 172.21.15.154:0/4088874813 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcd64010990 con 0x7fcd740685a0 2023-09-30T22:19:41.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.957+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd741157d0 con 0x7fcd740685a0 2023-09-30T22:19:41.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.958+0000 7fcd6a7fc700 1 -- 172.21.15.154:0/4088874813 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7fcd6401f030 con 0x7fcd740685a0 2023-09-30T22:19:41.959 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:41.959 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:34.624706+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 >> v1:172.21.15.154:6816/118163 conn(0x7fcd5802bb60 legacy=0x7fcd5802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 msgr2=0x7fcd7413a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 --2- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7413a400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fcd64006db0 tx=0x7fcd64017000).stop 2023-09-30T22:19:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 shutdown_connections 2023-09-30T22:19:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 --2- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd74097180 0x7fcd7412dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 --2- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd740685a0 0x7fcd7413a400 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 --2- 172.21.15.154:0/4088874813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd740968b0 0x7fcd7413a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 >> 172.21.15.154:0/4088874813 conn(0x7fcd7409a1c0 msgr2=0x7fcd74098ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 shutdown_connections 2023-09-30T22:19:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:41.960+0000 7fcd7c5b0700 1 -- 172.21.15.154:0/4088874813 wait complete. 2023-09-30T22:19:41.972 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:19:41.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:42.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.087+0000 7f22cca8c700 1 Processor -- start 2023-09-30T22:19:42.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.087+0000 7f22cca8c700 1 -- start start 2023-09-30T22:19:42.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22cca8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c80976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22cca8c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22c8128230 0x7f22c812b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22cca8c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c80980b0 con 0x7f22c8127df0 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22cca8c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c80666f0 con 0x7f22c8128230 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22cca8c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c8065530 con 0x7f22c8066310 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c80976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c6d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22c8128230 0x7f22c812b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c5d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f22c8127df0 0x7f22c812ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41660/0 (socket says 172.21.15.154:41660) 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c80976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54248/0 (socket says 172.21.15.154:54248) 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c6d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22c8128230 0x7f22c812b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37080/0 (socket says 172.21.15.154:37080) 2023-09-30T22:19:42.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c5d9b700 1 -- 172.21.15.154:0/1208848371 learned_addr learned my addr 172.21.15.154:0/1208848371 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c6d9d700 1 -- 172.21.15.154:0/1208848371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 msgr2=0x7f22c80976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c6d9d700 1 --2- 172.21.15.154:0/1208848371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c80976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c6d9d700 1 -- 172.21.15.154:0/1208848371 >> v1:172.21.15.154:6789/0 conn(0x7f22c8127df0 legacy=0x7f22c812ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c6d9d700 1 -- 172.21.15.154:0/1208848371 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8065850 con 0x7f22c8128230 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c559a700 1 -- 172.21.15.154:0/1208848371 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654871238 0 0) 0x7f22c80980b0 con 0x7f22c8127df0 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.088+0000 7f22c659c700 1 --2- 172.21.15.154:0/1208848371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c80976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22c6d9d700 1 --2- 172.21.15.154:0/1208848371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 0x7f22c812b230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f22c0009e90 tx=0x7f22c0009780).ready entity=mon.0 client_cookie=515a8b00d9519be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22c559a700 1 -- 172.21.15.154:0/1208848371 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000e070 con 0x7f22c8128230 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22c559a700 1 -- 172.21.15.154:0/1208848371 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c000bb20 con 0x7f22c8128230 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22c559a700 1 -- 172.21.15.154:0/1208848371 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000bea0 con 0x7f22c8128230 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22cca8c700 1 -- 172.21.15.154:0/1208848371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 msgr2=0x7f22c812b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22cca8c700 1 --2- 172.21.15.154:0/1208848371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 0x7f22c812b230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f22c0009e90 tx=0x7f22c0009780).stop 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22cca8c700 1 -- 172.21.15.154:0/1208848371 shutdown_connections 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22cca8c700 1 --2- 172.21.15.154:0/1208848371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 0x7f22c812b230 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22cca8c700 1 --2- 172.21.15.154:0/1208848371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c80976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22cca8c700 1 -- 172.21.15.154:0/1208848371 >> 172.21.15.154:0/1208848371 conn(0x7f22c809bad0 msgr2=0x7f22c809bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22cca8c700 1 -- 172.21.15.154:0/1208848371 shutdown_connections 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.089+0000 7f22cca8c700 1 -- 172.21.15.154:0/1208848371 wait complete. 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.090+0000 7f22cca8c700 1 Processor -- start 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.090+0000 7f22cca8c700 1 -- start start 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22cca8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c813a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22cca8c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22c8127df0 0x7f22c813a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22cca8c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 0x7f22c812d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22cca8c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c812e630 con 0x7f22c8128230 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22cca8c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c812f180 con 0x7f22c8066310 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22cca8c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22c8099db0 con 0x7f22c8127df0 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c813a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c813a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54260/0 (socket says 172.21.15.154:54260) 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c659c700 1 -- 172.21.15.154:0/2592939206 learned_addr learned my addr 172.21.15.154:0/2592939206 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c6d9d700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 0x7f22c812d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c5d9b700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22c8127df0 0x7f22c813a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c659c700 1 -- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22c8127df0 msgr2=0x7f22c813a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c659c700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22c8127df0 0x7f22c813a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c659c700 1 -- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 msgr2=0x7f22c812d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c659c700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 0x7f22c812d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c659c700 1 -- 172.21.15.154:0/2592939206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0092a0 con 0x7f22c8066310 2023-09-30T22:19:42.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c6d9d700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 0x7f22c812d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:42.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22c659c700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c813a3f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f22bc00ea20 tx=0x7f22bc009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22b67fc700 1 -- 172.21.15.154:0/2592939206 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00ee60 con 0x7f22c8066310 2023-09-30T22:19:42.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22b67fc700 1 -- 172.21.15.154:0/2592939206 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc00c850 con 0x7f22c8066310 2023-09-30T22:19:42.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22b67fc700 1 -- 172.21.15.154:0/2592939206 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00cbd0 con 0x7f22c8066310 2023-09-30T22:19:42.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c0009a20 con 0x7f22c8066310 2023-09-30T22:19:42.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.091+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c8113c90 con 0x7f22c8066310 2023-09-30T22:19:42.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.092+0000 7f22b67fc700 1 -- 172.21.15.154:0/2592939206 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f22bc01b400 con 0x7f22c8066310 2023-09-30T22:19:42.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.092+0000 7f22b67fc700 1 -- 172.21.15.154:0/2592939206 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f22bc03b4c0 con 0x7f22c8066310 2023-09-30T22:19:42.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.092+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c8097850 con 0x7f22c8066310 2023-09-30T22:19:42.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.097+0000 7f22b67fc700 1 -- 172.21.15.154:0/2592939206 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f22bc019900 con 0x7f22c8066310 2023-09-30T22:19:42.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.255+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22c81138b0 con 0x7f22c8066310 2023-09-30T22:19:42.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.256+0000 7f22b67fc700 1 -- 172.21.15.154:0/2592939206 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f22bc019310 con 0x7f22c8066310 2023-09-30T22:19:42.257 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:42.257 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:34.624706+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:42.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.257+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 >> v1:172.21.15.154:6816/118163 conn(0x7f22a802bb90 legacy=0x7f22a802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.257+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 msgr2=0x7f22c813a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.257+0000 7f22cca8c700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c813a3f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f22bc00ea20 tx=0x7f22bc009060).stop 2023-09-30T22:19:42.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.258+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 shutdown_connections 2023-09-30T22:19:42.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.258+0000 7f22cca8c700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22c8128230 0x7f22c812d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.258+0000 7f22cca8c700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22c8066310 0x7f22c813a3f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.258+0000 7f22cca8c700 1 --2- 172.21.15.154:0/2592939206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22c8127df0 0x7f22c813a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.258+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 >> 172.21.15.154:0/2592939206 conn(0x7f22c809bad0 msgr2=0x7f22c8128950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.258+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 shutdown_connections 2023-09-30T22:19:42.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.258+0000 7f22cca8c700 1 -- 172.21.15.154:0/2592939206 wait complete. 2023-09-30T22:19:42.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:19:42.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:19:42.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:19:42.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:19:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.396+0000 7f245f8b5700 1 Processor -- start 2023-09-30T22:19:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.396+0000 7f64ec817700 1 Processor -- start 2023-09-30T22:19:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.396+0000 7f64ec817700 1 -- start start 2023-09-30T22:19:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.396+0000 7f245f8b5700 1 -- start start 2023-09-30T22:19:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245f8b5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2458095da0 0x7f24580961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245f8b5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24580966b0 0x7f2458132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245f8b5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2458091980 con 0x7f2458062b00 2023-09-30T22:19:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245f8b5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580973f0 con 0x7f2458095da0 2023-09-30T22:19:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245f8b5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2458062ee0 con 0x7f24580966b0 2023-09-30T22:19:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245ce50700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2458095da0 0x7f24580961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64ec817700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e80985e0 0x7f64e80989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64ec817700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64e8098eb0 0x7f64e812f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64ec817700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80964f0 con 0x7f64e812f980 2023-09-30T22:19:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64ec817700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e809a3f0 con 0x7f64e80985e0 2023-09-30T22:19:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64ec817700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64e8095100 con 0x7f64e8098eb0 2023-09-30T22:19:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245d651700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2458062b00 0x7f2458095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41672/0 (socket says 172.21.15.154:41672) 2023-09-30T22:19:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245d651700 1 -- 172.21.15.154:0/991055984 learned_addr learned my addr 172.21.15.154:0/991055984 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64e659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e80985e0 0x7f64e80989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64e659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e80985e0 0x7f64e80989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54268/0 (socket says 172.21.15.154:54268) 2023-09-30T22:19:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64e659c700 1 -- 172.21.15.154:0/1065829542 learned_addr learned my addr 172.21.15.154:0/1065829542 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245ce50700 1 -- 172.21.15.154:0/991055984 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24580966b0 msgr2=0x7f2458132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245ce50700 1 --2- 172.21.15.154:0/991055984 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24580966b0 0x7f2458132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245ce50700 1 -- 172.21.15.154:0/991055984 >> v1:172.21.15.154:6789/0 conn(0x7f2458062b00 legacy=0x7f2458095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f245ce50700 1 -- 172.21.15.154:0/991055984 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458092310 con 0x7f2458095da0 2023-09-30T22:19:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64e659c700 1 -- 172.21.15.154:0/1065829542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64e8098eb0 msgr2=0x7f64e812f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64e659c700 1 --2- 172.21.15.154:0/1065829542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64e8098eb0 0x7f64e812f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.397+0000 7f64e659c700 1 -- 172.21.15.154:0/1065829542 >> v1:172.21.15.154:6789/0 conn(0x7f64e812f980 legacy=0x7f64e8131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f64e659c700 1 -- 172.21.15.154:0/1065829542 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e8099e70 con 0x7f64e80985e0 2023-09-30T22:19:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f245ce50700 1 --2- 172.21.15.154:0/991055984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2458095da0 0x7f24580961c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2448009790 tx=0x7f2448009060).ready entity=mon.0 client_cookie=1d7deeb1778c33b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f64e659c700 1 --2- 172.21.15.154:0/1065829542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e80985e0 0x7f64e80989c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f64d0009830 tx=0x7f64d00090f0).ready entity=mon.1 client_cookie=2c8a8d8f467dc952 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f244ffff700 1 -- 172.21.15.154:0/991055984 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244800b580 con 0x7f2458095da0 2023-09-30T22:19:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f244ffff700 1 -- 172.21.15.154:0/991055984 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244800b6e0 con 0x7f2458095da0 2023-09-30T22:19:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f244ffff700 1 -- 172.21.15.154:0/991055984 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244800ba60 con 0x7f2458095da0 2023-09-30T22:19:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f64e559a700 1 -- 172.21.15.154:0/1065829542 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000b600 con 0x7f64e80985e0 2023-09-30T22:19:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f64e559a700 1 -- 172.21.15.154:0/1065829542 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d000b760 con 0x7f64e80985e0 2023-09-30T22:19:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f64e559a700 1 -- 172.21.15.154:0/1065829542 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000bb00 con 0x7f64e80985e0 2023-09-30T22:19:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f245f8b5700 1 -- 172.21.15.154:0/991055984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2458095da0 msgr2=0x7f24580961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f245f8b5700 1 --2- 172.21.15.154:0/991055984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2458095da0 0x7f24580961c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2448009790 tx=0x7f2448009060).stop 2023-09-30T22:19:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f245f8b5700 1 -- 172.21.15.154:0/991055984 shutdown_connections 2023-09-30T22:19:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f245f8b5700 1 --2- 172.21.15.154:0/991055984 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24580966b0 0x7f2458132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f245f8b5700 1 --2- 172.21.15.154:0/991055984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2458095da0 0x7f24580961c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.398+0000 7f245f8b5700 1 -- 172.21.15.154:0/991055984 >> 172.21.15.154:0/991055984 conn(0x7f245809aa50 msgr2=0x7f245809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.399+0000 7f245f8b5700 1 -- 172.21.15.154:0/991055984 shutdown_connections 2023-09-30T22:19:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.399+0000 7f245f8b5700 1 -- 172.21.15.154:0/991055984 wait complete. 2023-09-30T22:19:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.399+0000 7f64ec817700 1 -- 172.21.15.154:0/1065829542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e80985e0 msgr2=0x7f64e80989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.399+0000 7f64ec817700 1 --2- 172.21.15.154:0/1065829542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e80985e0 0x7f64e80989c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f64d0009830 tx=0x7f64d00090f0).stop 2023-09-30T22:19:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.399+0000 7f64ec817700 1 -- 172.21.15.154:0/1065829542 shutdown_connections 2023-09-30T22:19:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.399+0000 7f64ec817700 1 --2- 172.21.15.154:0/1065829542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e80985e0 0x7f64e80989c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.399+0000 7f64ec817700 1 --2- 172.21.15.154:0/1065829542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64e8098eb0 0x7f64e812f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.399+0000 7f64ec817700 1 -- 172.21.15.154:0/1065829542 >> 172.21.15.154:0/1065829542 conn(0x7f64e809dc40 msgr2=0x7f64e809e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.400+0000 7f64ec817700 1 -- 172.21.15.154:0/1065829542 shutdown_connections 2023-09-30T22:19:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.400+0000 7f64ec817700 1 -- 172.21.15.154:0/1065829542 wait complete. 2023-09-30T22:19:42.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.400+0000 7f245f8b5700 1 Processor -- start 2023-09-30T22:19:42.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.400+0000 7f245f8b5700 1 -- start start 2023-09-30T22:19:42.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.400+0000 7f64ec817700 1 Processor -- start 2023-09-30T22:19:42.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.400+0000 7f64ec817700 1 -- start start 2023-09-30T22:19:42.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f245f8b5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2458062b00 0x7f2458119850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f245f8b5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2458095da0 0x7f2458115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f245f8b5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24580966b0 0x7f2458115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f245f8b5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458099cb0 con 0x7f2458095da0 2023-09-30T22:19:42.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f245f8b5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2458096da0 con 0x7f24580966b0 2023-09-30T22:19:42.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f245f8b5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2458119350 con 0x7f2458062b00 2023-09-30T22:19:42.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f245d651700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2458062b00 0x7f2458119850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f245d651700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2458062b00 0x7f2458119850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60010/0 (socket says 172.21.15.154:60010) 2023-09-30T22:19:42.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f245d651700 1 -- 172.21.15.154:0/3371557407 learned_addr learned my addr 172.21.15.154:0/3371557407 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64ec817700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64e80985e0 0x7f64e81173b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64ec817700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64e8098eb0 0x7f64e81178a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64ec817700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e812f980 0x7f64e8117d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64ec817700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e8118280 con 0x7f64e8098eb0 2023-09-30T22:19:42.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64ec817700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e811a8c0 con 0x7f64e812f980 2023-09-30T22:19:42.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64ec817700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64e811b9b0 con 0x7f64e80985e0 2023-09-30T22:19:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64e659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64e80985e0 0x7f64e81173b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64e659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64e80985e0 0x7f64e81173b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60014/0 (socket says 172.21.15.154:60014) 2023-09-30T22:19:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64e659c700 1 -- 172.21.15.154:0/678487189 learned_addr learned my addr 172.21.15.154:0/678487189 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64e5d9b700 1 --2- 172.21.15.154:0/678487189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64e8098eb0 0x7f64e81178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64e5d9b700 1 -- 172.21.15.154:0/678487189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64e80985e0 msgr2=0x7f64e81173b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64e5d9b700 1 --2- 172.21.15.154:0/678487189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64e80985e0 0x7f64e81173b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.401+0000 7f64e5d9b700 1 -- 172.21.15.154:0/678487189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e812f980 msgr2=0x7f64e8117d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f64e5d9b700 1 --2- 172.21.15.154:0/678487189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64e812f980 0x7f64e8117d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f64e5d9b700 1 -- 172.21.15.154:0/678487189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0009370 con 0x7f64e8098eb0 2023-09-30T22:19:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f64e5d9b700 1 --2- 172.21.15.154:0/678487189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64e8098eb0 0x7f64e81178a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f64d800b4e0 tx=0x7f64d8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245de52700 1 --2- 172.21.15.154:0/3371557407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24580966b0 0x7f2458115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245d651700 1 -- 172.21.15.154:0/3371557407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24580966b0 msgr2=0x7f2458115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245d651700 1 --2- 172.21.15.154:0/3371557407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24580966b0 0x7f2458115d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245d651700 1 -- 172.21.15.154:0/3371557407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2458095da0 msgr2=0x7f2458115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245d651700 1 --2- 172.21.15.154:0/3371557407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2458095da0 0x7f2458115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245d651700 1 -- 172.21.15.154:0/3371557407 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480092a0 con 0x7f2458062b00 2023-09-30T22:19:42.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245de52700 1 --2- 172.21.15.154:0/3371557407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24580966b0 0x7f2458115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:19:42.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245d651700 1 --2- 172.21.15.154:0/3371557407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2458062b00 0x7f2458119850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f245400c490 tx=0x7f2454007df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f244d7fa700 1 -- 172.21.15.154:0/3371557407 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24540072e0 con 0x7f2458062b00 2023-09-30T22:19:42.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f64de7fc700 1 -- 172.21.15.154:0/678487189 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d800bea0 con 0x7f64e8098eb0 2023-09-30T22:19:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f244d7fa700 1 -- 172.21.15.154:0/3371557407 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454007440 con 0x7f2458062b00 2023-09-30T22:19:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f64de7fc700 1 -- 172.21.15.154:0/678487189 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d8002320 con 0x7f64e8098eb0 2023-09-30T22:19:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f244d7fa700 1 -- 172.21.15.154:0/3371557407 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24540057a0 con 0x7f2458062b00 2023-09-30T22:19:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f64de7fc700 1 -- 172.21.15.154:0/678487189 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d80026c0 con 0x7f64e8098eb0 2023-09-30T22:19:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e811aaf0 con 0x7f64e8098eb0 2023-09-30T22:19:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2458118db0 con 0x7f2458062b00 2023-09-30T22:19:42.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2458117600 con 0x7f2458062b00 2023-09-30T22:19:42.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.402+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e811a590 con 0x7f64e8098eb0 2023-09-30T22:19:42.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.403+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f245805a260 con 0x7f2458062b00 2023-09-30T22:19:42.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.404+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64e8119700 con 0x7f64e8098eb0 2023-09-30T22:19:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.404+0000 7f244d7fa700 1 -- 172.21.15.154:0/3371557407 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2454005bd0 con 0x7f2458062b00 2023-09-30T22:19:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.404+0000 7f244d7fa700 1 -- 172.21.15.154:0/3371557407 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f245403a9d0 con 0x7f2458062b00 2023-09-30T22:19:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.404+0000 7f244d7fa700 1 -- 172.21.15.154:0/3371557407 --> v1:172.21.15.154:6808/118792 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f243c0384e0 con 0x7f243c0347f0 2023-09-30T22:19:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.404+0000 7f244d7fa700 1 -- 172.21.15.154:0/3371557407 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f245403add0 con 0x7f2458062b00 2023-09-30T22:19:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.404+0000 7f64de7fc700 1 -- 172.21.15.154:0/678487189 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f64d8002a70 con 0x7f64e8098eb0 2023-09-30T22:19:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.405+0000 7f64de7fc700 1 -- 172.21.15.154:0/678487189 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f64d803b5e0 con 0x7f64e8098eb0 2023-09-30T22:19:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.405+0000 7f64de7fc700 1 -- 172.21.15.154:0/678487189 --> v1:172.21.15.154:6812/118791 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64c8038510 con 0x7f64c8034820 2023-09-30T22:19:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.405+0000 7f64de7fc700 1 -- 172.21.15.154:0/678487189 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64d803b9e0 con 0x7f64e8098eb0 2023-09-30T22:19:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.405+0000 7f244d7fa700 1 -- 172.21.15.154:0/3371557407 <== osd.3 v1:172.21.15.154:6808/118792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f243c0384e0 con 0x7f243c0347f0 2023-09-30T22:19:42.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.406+0000 7f64de7fc700 1 -- 172.21.15.154:0/678487189 <== osd.2 v1:172.21.15.154:6812/118791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f64c8038510 con 0x7f64c8034820 2023-09-30T22:19:42.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.406+0000 7fb35d0dd700 1 Processor -- start 2023-09-30T22:19:42.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.406+0000 7fa0088c3700 1 Processor -- start 2023-09-30T22:19:42.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.406+0000 7fb35d0dd700 1 -- start start 2023-09-30T22:19:42.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.406+0000 7fa0088c3700 1 -- start start 2023-09-30T22:19:42.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb35d0dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb35d0dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb358068680 0x7fb358067700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb35d0dd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb358069a10 con 0x7fb358128a10 2023-09-30T22:19:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb35d0dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb358069090 con 0x7fb358066e30 2023-09-30T22:19:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb35d0dd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580694e0 con 0x7fb358068680 2023-09-30T22:19:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb356d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb356d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54292/0 (socket says 172.21.15.154:54292) 2023-09-30T22:19:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb356d9d700 1 -- 172.21.15.154:0/3501651328 learned_addr learned my addr 172.21.15.154:0/3501651328 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fa0088c3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa004096820 0x7fa004096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fa0088c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 0x7fa00412fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fa0088c3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa004069530 con 0x7fa0040970f0 2023-09-30T22:19:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fa0088c3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0040926d0 con 0x7fa004096820 2023-09-30T22:19:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fa0088c3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa004091980 con 0x7fa004068650 2023-09-30T22:19:42.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fa002d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 0x7fa00412fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fa002d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 0x7fa00412fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60028/0 (socket says 172.21.15.154:60028) 2023-09-30T22:19:42.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fa002d9d700 1 -- 172.21.15.154:0/427104100 learned_addr learned my addr 172.21.15.154:0/427104100 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fa00259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa004096820 0x7fa004096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb35659c700 1 --2- 172.21.15.154:0/3501651328 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb358068680 0x7fb358067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb356d9d700 1 -- 172.21.15.154:0/3501651328 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb358068680 msgr2=0x7fb358067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb356d9d700 1 --2- 172.21.15.154:0/3501651328 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb358068680 0x7fb358067700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb356d9d700 1 -- 172.21.15.154:0/3501651328 >> v1:172.21.15.154:6789/0 conn(0x7fb358128a10 legacy=0x7fb358128ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.407+0000 7fb356d9d700 1 -- 172.21.15.154:0/3501651328 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358068b00 con 0x7fb358066e30 2023-09-30T22:19:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fb356d9d700 1 --2- 172.21.15.154:0/3501651328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358067210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb348009830 tx=0x7fb3480090f0).ready entity=mon.1 client_cookie=906ccb296b6b562f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fa00259c700 1 -- 172.21.15.154:0/427104100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 msgr2=0x7fa00412fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fa00259c700 1 --2- 172.21.15.154:0/427104100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 0x7fa00412fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fa00259c700 1 -- 172.21.15.154:0/427104100 >> v1:172.21.15.154:6789/0 conn(0x7fa0040970f0 legacy=0x7fa004067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fa00259c700 1 -- 172.21.15.154:0/427104100 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040933c0 con 0x7fa004096820 2023-09-30T22:19:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fb355d9b700 1 -- 172.21.15.154:0/3501651328 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480108a0 con 0x7fb358066e30 2023-09-30T22:19:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fb355d9b700 1 -- 172.21.15.154:0/3501651328 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348010a00 con 0x7fb358066e30 2023-09-30T22:19:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fb355d9b700 1 -- 172.21.15.154:0/3501651328 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348010da0 con 0x7fb358066e30 2023-09-30T22:19:42.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fa00259c700 1 --2- 172.21.15.154:0/427104100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa004096820 0x7fa004096c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9ff4009760 tx=0x7f9ff4009060).ready entity=mon.0 client_cookie=6b51fc1679b41855 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fa00159a700 1 -- 172.21.15.154:0/427104100 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40090d0 con 0x7fa004096820 2023-09-30T22:19:42.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fa00159a700 1 -- 172.21.15.154:0/427104100 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff400f510 con 0x7fa004096820 2023-09-30T22:19:42.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.408+0000 7fa00159a700 1 -- 172.21.15.154:0/427104100 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400f890 con 0x7fa004096820 2023-09-30T22:19:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fb35d0dd700 1 -- 172.21.15.154:0/3501651328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 msgr2=0x7fb358067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fb35d0dd700 1 --2- 172.21.15.154:0/3501651328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358067210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb348009830 tx=0x7fb3480090f0).stop 2023-09-30T22:19:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fb35d0dd700 1 -- 172.21.15.154:0/3501651328 shutdown_connections 2023-09-30T22:19:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fb35d0dd700 1 --2- 172.21.15.154:0/3501651328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358067210 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fb35d0dd700 1 --2- 172.21.15.154:0/3501651328 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb358068680 0x7fb358067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fb35d0dd700 1 -- 172.21.15.154:0/3501651328 >> 172.21.15.154:0/3501651328 conn(0x7fb35809a230 msgr2=0x7fb35809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fb35d0dd700 1 -- 172.21.15.154:0/3501651328 shutdown_connections 2023-09-30T22:19:42.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fb35d0dd700 1 -- 172.21.15.154:0/3501651328 wait complete. 2023-09-30T22:19:42.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fa0088c3700 1 -- 172.21.15.154:0/427104100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa004096820 msgr2=0x7fa004096c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fa0088c3700 1 --2- 172.21.15.154:0/427104100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa004096820 0x7fa004096c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9ff4009760 tx=0x7f9ff4009060).stop 2023-09-30T22:19:42.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fa0088c3700 1 -- 172.21.15.154:0/427104100 shutdown_connections 2023-09-30T22:19:42.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fa0088c3700 1 --2- 172.21.15.154:0/427104100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 0x7fa00412fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fa0088c3700 1 --2- 172.21.15.154:0/427104100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa004096820 0x7fa004096c00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fa0088c3700 1 -- 172.21.15.154:0/427104100 >> 172.21.15.154:0/427104100 conn(0x7fa00409a230 msgr2=0x7fa00409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fa0088c3700 1 -- 172.21.15.154:0/427104100 shutdown_connections 2023-09-30T22:19:42.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.409+0000 7fa0088c3700 1 -- 172.21.15.154:0/427104100 wait complete. 2023-09-30T22:19:42.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.410+0000 7fb35d0dd700 1 Processor -- start 2023-09-30T22:19:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fa0088c3700 1 Processor -- start 2023-09-30T22:19:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fa0088c3700 1 -- start start 2023-09-30T22:19:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fa0088c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 0x7fa004127430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fa0088c3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0040970f0 0x7fa004115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fa0088c3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa004116160 0x7fa0041165e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fa0088c3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa004116ad0 con 0x7fa004116160 2023-09-30T22:19:42.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fa0088c3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040670c0 con 0x7fa0040970f0 2023-09-30T22:19:42.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fa0088c3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa004119710 con 0x7fa004068650 2023-09-30T22:19:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.410+0000 7fb35d0dd700 1 -- start start 2023-09-30T22:19:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb35d0dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358120e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb35d0dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb358068680 0x7fb35811d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb35d0dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb358128a10 0x7fb35811d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb35d0dd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35811fea0 con 0x7fb358068680 2023-09-30T22:19:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb35d0dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581203c0 con 0x7fb358066e30 2023-09-30T22:19:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb35d0dd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580998f0 con 0x7fb358128a10 2023-09-30T22:19:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb356d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb356d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358120e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54296/0 (socket says 172.21.15.154:54296) 2023-09-30T22:19:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb356d9d700 1 -- 172.21.15.154:0/2951660540 learned_addr learned my addr 172.21.15.154:0/2951660540 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb35759e700 1 --2- 172.21.15.154:0/2951660540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb358128a10 0x7fb35811d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb356d9d700 1 -- 172.21.15.154:0/2951660540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb358128a10 msgr2=0x7fb35811d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb356d9d700 1 --2- 172.21.15.154:0/2951660540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb358128a10 0x7fb35811d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb356d9d700 1 -- 172.21.15.154:0/2951660540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb358068680 msgr2=0x7fb35811d060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:19:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb356d9d700 1 --2- 172.21.15.154:0/2951660540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb358068680 0x7fb35811d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.411+0000 7fb356d9d700 1 -- 172.21.15.154:0/2951660540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348009370 con 0x7fb358066e30 2023-09-30T22:19:42.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fb356d9d700 1 --2- 172.21.15.154:0/2951660540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358120e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb348009f80 tx=0x7fb348019000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fb33effd700 1 -- 172.21.15.154:0/2951660540 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348018910 con 0x7fb358066e30 2023-09-30T22:19:42.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa001d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0040970f0 0x7fa004115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa001d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0040970f0 0x7fa004115c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54312/0 (socket says 172.21.15.154:54312) 2023-09-30T22:19:42.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa001d9b700 1 -- 172.21.15.154:0/720941124 learned_addr learned my addr 172.21.15.154:0/720941124 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa00259c700 1 --2- 172.21.15.154:0/720941124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 0x7fa004127430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3580691e0 con 0x7fb358066e30 2023-09-30T22:19:42.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fb33effd700 1 -- 172.21.15.154:0/2951660540 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348018a70 con 0x7fb358066e30 2023-09-30T22:19:42.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa002d9d700 1 --2- 172.21.15.154:0/720941124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa004116160 0x7fa0041165e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fb33effd700 1 -- 172.21.15.154:0/2951660540 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348018e30 con 0x7fb358066e30 2023-09-30T22:19:42.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35811ea60 con 0x7fb358066e30 2023-09-30T22:19:42.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa002d9d700 1 -- 172.21.15.154:0/720941124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 msgr2=0x7fa004127430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa002d9d700 1 --2- 172.21.15.154:0/720941124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa004068650 0x7fa004127430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa002d9d700 1 -- 172.21.15.154:0/720941124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0040970f0 msgr2=0x7fa004115c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa002d9d700 1 --2- 172.21.15.154:0/720941124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0040970f0 0x7fa004115c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.412+0000 7fa002d9d700 1 -- 172.21.15.154:0/720941124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40092a0 con 0x7fa004116160 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.413+0000 7fa002d9d700 1 --2- 172.21.15.154:0/720941124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa004116160 0x7fa0041165e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9ffc0094d0 tx=0x7f9ffc00d040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.413+0000 7f9ff27fc700 1 -- 172.21.15.154:0/720941124 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc010040 con 0x7fa004116160 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.413+0000 7f9ff27fc700 1 -- 172.21.15.154:0/720941124 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc00eba0 con 0x7fa004116160 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.413+0000 7f9ff27fc700 1 -- 172.21.15.154:0/720941124 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc00b0d0 con 0x7fa004116160 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.413+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa004117070 con 0x7fa004116160 2023-09-30T22:19:42.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.414+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa004119430 con 0x7fa004116160 2023-09-30T22:19:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.413+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb35805a260 con 0x7fb358066e30 2023-09-30T22:19:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.414+0000 7fb33effd700 1 -- 172.21.15.154:0/2951660540 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb348016070 con 0x7fb358066e30 2023-09-30T22:19:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.414+0000 7fb33effd700 1 -- 172.21.15.154:0/2951660540 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb34804c3f0 con 0x7fb358066e30 2023-09-30T22:19:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.414+0000 7fb33effd700 1 -- 172.21.15.154:0/2951660540 --> v1:172.21.15.154:6800/118761 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3440384e0 con 0x7fb3440347f0 2023-09-30T22:19:42.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.414+0000 7fb33effd700 1 -- 172.21.15.154:0/2951660540 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb348009210 con 0x7fb358066e30 2023-09-30T22:19:42.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.414+0000 7f9ff27fc700 1 -- 172.21.15.154:0/720941124 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9ffc009610 con 0x7fa004116160 2023-09-30T22:19:42.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.414+0000 7f9ff27fc700 1 -- 172.21.15.154:0/720941124 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9ffc03b390 con 0x7fa004116160 2023-09-30T22:19:42.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.416+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 --> v1:172.21.15.154:6804/118762 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0041128b0 con 0x7fa004059070 2023-09-30T22:19:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.418+0000 7f9ff27fc700 1 -- 172.21.15.154:0/720941124 <== osd.1 v1:172.21.15.154:6804/118762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fa0041128b0 con 0x7fa004059070 2023-09-30T22:19:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.418+0000 7fb33effd700 1 -- 172.21.15.154:0/2951660540 <== osd.0 v1:172.21.15.154:6800/118761 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fb3440384e0 con 0x7fb3440347f0 2023-09-30T22:19:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.424+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 --> v1:172.21.15.154:6808/118792 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2458116490 con 0x7f243c0347f0 2023-09-30T22:19:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.424+0000 7f244d7fa700 1 -- 172.21.15.154:0/3371557407 <== osd.3 v1:172.21.15.154:6808/118792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7f2458116490 con 0x7f243c0347f0 2023-09-30T22:19:42.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.424+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 --> v1:172.21.15.154:6812/118791 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64e8097650 con 0x7f64c8034820 2023-09-30T22:19:42.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.424+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 >> v1:172.21.15.154:6808/118792 conn(0x7f243c0347f0 legacy=0x7f243c036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f64de7fc700 1 -- 172.21.15.154:0/678487189 <== osd.2 v1:172.21.15.154:6812/118791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7f64e8097650 con 0x7f64c8034820 2023-09-30T22:19:42.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 >> v1:172.21.15.154:6816/118163 conn(0x7f243c02bb60 legacy=0x7f243c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2458062b00 msgr2=0x7f2458119850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f245f8b5700 1 --2- 172.21.15.154:0/3371557407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2458062b00 0x7f2458119850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f245400c490 tx=0x7f2454007df0).stop 2023-09-30T22:19:42.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f245de52700 1 -- 172.21.15.154:0/3371557407 reap_dead start 2023-09-30T22:19:42.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 shutdown_connections 2023-09-30T22:19:42.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 >> 172.21.15.154:0/3371557407 conn(0x7f245809aa50 msgr2=0x7f245812ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 shutdown_connections 2023-09-30T22:19:42.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f245f8b5700 1 -- 172.21.15.154:0/3371557407 wait complete. 2023-09-30T22:19:42.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 >> v1:172.21.15.154:6812/118791 conn(0x7f64c8034820 legacy=0x7f64c8036ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 >> v1:172.21.15.154:6816/118163 conn(0x7f64c802bb90 legacy=0x7f64c802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64e8098eb0 msgr2=0x7f64e81178a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f64ec817700 1 --2- 172.21.15.154:0/678487189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64e8098eb0 0x7f64e81178a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f64d800b4e0 tx=0x7f64d8009060).stop 2023-09-30T22:19:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.425+0000 7f64e6d9d700 1 -- 172.21.15.154:0/678487189 reap_dead start 2023-09-30T22:19:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.426+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 shutdown_connections 2023-09-30T22:19:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.426+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 >> 172.21.15.154:0/678487189 conn(0x7f64e809dc40 msgr2=0x7f64e8092710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.426+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 shutdown_connections 2023-09-30T22:19:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.426+0000 7f64ec817700 1 -- 172.21.15.154:0/678487189 wait complete. 2023-09-30T22:19:42.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.433+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 --> v1:172.21.15.154:6804/118762 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa004046c20 con 0x7fa004059070 2023-09-30T22:19:42.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.433+0000 7f9ff27fc700 1 -- 172.21.15.154:0/720941124 <== osd.1 v1:172.21.15.154:6804/118762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fa004046c20 con 0x7fa004059070 2023-09-30T22:19:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.434+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 >> v1:172.21.15.154:6804/118762 conn(0x7fa004059070 legacy=0x7fa004059450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.434+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 >> v1:172.21.15.154:6816/118163 conn(0x7f9fe402bb90 legacy=0x7f9fe402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.434+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa004116160 msgr2=0x7fa0041165e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.434+0000 7fa0088c3700 1 --2- 172.21.15.154:0/720941124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa004116160 0x7fa0041165e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9ffc0094d0 tx=0x7f9ffc00d040).stop 2023-09-30T22:19:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.434+0000 7fa002d9d700 1 -- 172.21.15.154:0/720941124 reap_dead start 2023-09-30T22:19:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.434+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 shutdown_connections 2023-09-30T22:19:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.434+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 >> 172.21.15.154:0/720941124 conn(0x7fa00409a230 msgr2=0x7fa004065e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.434+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 shutdown_connections 2023-09-30T22:19:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.434+0000 7fa0088c3700 1 -- 172.21.15.154:0/720941124 wait complete. 2023-09-30T22:19:42.452 INFO:teuthology.orchestra.run.smithi154.stdout:38654705668 2023-09-30T22:19:42.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.439+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 --> v1:172.21.15.154:6800/118761 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb35811dc80 con 0x7fb3440347f0 2023-09-30T22:19:42.454 INFO:teuthology.orchestra.run.smithi154.stdout:38654705668 2023-09-30T22:19:42.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:42.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb33effd700 1 -- 172.21.15.154:0/2951660540 <== osd.0 v1:172.21.15.154:6800/118761 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7fb35811dc80 con 0x7fb3440347f0 2023-09-30T22:19:42.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 >> v1:172.21.15.154:6800/118761 conn(0x7fb3440347f0 legacy=0x7fb344036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 >> v1:172.21.15.154:6816/118163 conn(0x7fb34402bb60 legacy=0x7fb34402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 msgr2=0x7fb358120e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb35d0dd700 1 --2- 172.21.15.154:0/2951660540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb358066e30 0x7fb358120e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb348009f80 tx=0x7fb348019000).stop 2023-09-30T22:19:42.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb35759e700 1 -- 172.21.15.154:0/2951660540 reap_dead start 2023-09-30T22:19:42.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 shutdown_connections 2023-09-30T22:19:42.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 >> 172.21.15.154:0/2951660540 conn(0x7fb35809a230 msgr2=0x7fb358096540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 shutdown_connections 2023-09-30T22:19:42.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.440+0000 7fb35d0dd700 1 -- 172.21.15.154:0/2951660540 wait complete. 2023-09-30T22:19:42.457 INFO:teuthology.orchestra.run.smithi154.stdout:38654705669 2023-09-30T22:19:42.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:42.458 INFO:teuthology.orchestra.run.smithi154.stdout:38654705668 2023-09-30T22:19:42.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:42.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.621+0000 7fa955154700 1 Processor -- start 2023-09-30T22:19:42.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.621+0000 7fa955154700 1 -- start start 2023-09-30T22:19:42.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c1d4de700 1 Processor -- start 2023-09-30T22:19:42.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c1d4de700 1 -- start start 2023-09-30T22:19:42.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7fa955154700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa950062b00 0x7fa950095da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7fa955154700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa950096290 0x7fa950136a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c1d4de700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c18068680 0x7f3c18067920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c1d4de700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c18134650 0x7f3c18136a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c1d4de700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c18069a10 con 0x7f3c18066e30 2023-09-30T22:19:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7fa955154700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9500636a0 con 0x7fa950092aa0 2023-09-30T22:19:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7fa955154700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa950094a40 con 0x7fa950096290 2023-09-30T22:19:42.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7fa955154700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500920e0 con 0x7fa950062b00 2023-09-30T22:19:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c1d4de700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c180694e0 con 0x7f3c18068680 2023-09-30T22:19:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c1d4de700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18091e50 con 0x7f3c18134650 2023-09-30T22:19:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7fa94f59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa950096290 0x7fa950136a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7fa94f59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa950096290 0x7fa950136a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37138/0 (socket says 172.21.15.154:37138) 2023-09-30T22:19:42.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7fa94f59e700 1 -- 172.21.15.154:0/770316599 learned_addr learned my addr 172.21.15.154:0/770316599 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c167fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c18068680 0x7f3c18067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c167fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c18068680 0x7f3c18067920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37154/0 (socket says 172.21.15.154:37154) 2023-09-30T22:19:42.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.622+0000 7f3c167fc700 1 -- 172.21.15.154:0/4232015311 learned_addr learned my addr 172.21.15.154:0/4232015311 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7fa94f59e700 1 -- 172.21.15.154:0/770316599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa950062b00 msgr2=0x7fa950095da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7fa94f59e700 1 --2- 172.21.15.154:0/770316599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa950062b00 0x7fa950095da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7fa94f59e700 1 -- 172.21.15.154:0/770316599 >> v1:172.21.15.154:6789/0 conn(0x7fa950092aa0 legacy=0x7fa950095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7fa94f59e700 1 -- 172.21.15.154:0/770316599 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa950091980 con 0x7fa950096290 2023-09-30T22:19:42.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7f3c167fc700 1 -- 172.21.15.154:0/4232015311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c18134650 msgr2=0x7f3c18136a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7f3c167fc700 1 --2- 172.21.15.154:0/4232015311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c18134650 0x7f3c18136a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7f3c167fc700 1 -- 172.21.15.154:0/4232015311 >> v1:172.21.15.154:6789/0 conn(0x7f3c18066e30 legacy=0x7f3c18067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7f3c167fc700 1 -- 172.21.15.154:0/4232015311 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c180921c0 con 0x7f3c18068680 2023-09-30T22:19:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7fa94f59e700 1 --2- 172.21.15.154:0/770316599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 0x7fa950136a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa948009f50 tx=0x7fa948009840).ready entity=mon.0 client_cookie=134caab1cf82c2e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.623+0000 7f3c167fc700 1 --2- 172.21.15.154:0/4232015311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c18068680 0x7f3c18067920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f3c08006fd0 tx=0x7f3c080090f0).ready entity=mon.0 client_cookie=9036c9c8391a0b48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.624+0000 7fa94dd9b700 1 -- 172.21.15.154:0/770316599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800e070 con 0x7fa950096290 2023-09-30T22:19:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa94dd9b700 1 -- 172.21.15.154:0/770316599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94800ba30 con 0x7fa950096290 2023-09-30T22:19:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa94dd9b700 1 -- 172.21.15.154:0/770316599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800bdb0 con 0x7fa950096290 2023-09-30T22:19:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7f3c15ffb700 1 -- 172.21.15.154:0/4232015311 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800b600 con 0x7f3c18068680 2023-09-30T22:19:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7f3c15ffb700 1 -- 172.21.15.154:0/4232015311 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0800b760 con 0x7f3c18068680 2023-09-30T22:19:42.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7f3c15ffb700 1 -- 172.21.15.154:0/4232015311 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800bb20 con 0x7f3c18068680 2023-09-30T22:19:42.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa955154700 1 -- 172.21.15.154:0/770316599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 msgr2=0x7fa950136a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa955154700 1 --2- 172.21.15.154:0/770316599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 0x7fa950136a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa948009f50 tx=0x7fa948009840).stop 2023-09-30T22:19:42.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa955154700 1 -- 172.21.15.154:0/770316599 shutdown_connections 2023-09-30T22:19:42.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa955154700 1 --2- 172.21.15.154:0/770316599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 0x7fa950136a60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa955154700 1 --2- 172.21.15.154:0/770316599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa950062b00 0x7fa950095da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa955154700 1 -- 172.21.15.154:0/770316599 >> 172.21.15.154:0/770316599 conn(0x7fa95009aa50 msgr2=0x7fa95009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa955154700 1 -- 172.21.15.154:0/770316599 shutdown_connections 2023-09-30T22:19:42.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7fa955154700 1 -- 172.21.15.154:0/770316599 wait complete. 2023-09-30T22:19:42.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7f3c1d4de700 1 -- 172.21.15.154:0/4232015311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c18068680 msgr2=0x7f3c18067920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.625+0000 7f3c1d4de700 1 --2- 172.21.15.154:0/4232015311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c18068680 0x7f3c18067920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f3c08006fd0 tx=0x7f3c080090f0).stop 2023-09-30T22:19:42.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.626+0000 7f3c1d4de700 1 -- 172.21.15.154:0/4232015311 shutdown_connections 2023-09-30T22:19:42.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.626+0000 7f3c1d4de700 1 --2- 172.21.15.154:0/4232015311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c18134650 0x7f3c18136a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:42.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.626+0000 7f3c1d4de700 1 --2- 172.21.15.154:0/4232015311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c18068680 0x7f3c18067920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.626+0000 7f3c1d4de700 1 -- 172.21.15.154:0/4232015311 >> 172.21.15.154:0/4232015311 conn(0x7f3c1809a230 msgr2=0x7f3c1809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.626+0000 7f3c1d4de700 1 -- 172.21.15.154:0/4232015311 shutdown_connections 2023-09-30T22:19:42.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.626+0000 7f3c1d4de700 1 -- 172.21.15.154:0/4232015311 wait complete. 2023-09-30T22:19:42.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.626+0000 7fa955154700 1 Processor -- start 2023-09-30T22:19:42.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.626+0000 7fa955154700 1 -- start start 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa955154700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950062b00 0x7fa95011eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa955154700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 0x7fa95011f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa955154700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa95011f780 0x7fa95013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa955154700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95011fbc0 con 0x7fa950096290 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa955154700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95011eb70 con 0x7fa950062b00 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa955154700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa950091b90 con 0x7fa95011f780 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 0x7fa95011f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950062b00 0x7fa95011eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 0x7fa95011f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37168/0 (socket says 172.21.15.154:37168) 2023-09-30T22:19:42.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94e59c700 1 -- 172.21.15.154:0/2628459617 learned_addr learned my addr 172.21.15.154:0/2628459617 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7f3c1d4de700 1 Processor -- start 2023-09-30T22:19:42.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94f59e700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa95011f780 0x7fa95013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94e59c700 1 -- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa95011f780 msgr2=0x7fa95013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94e59c700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa95011f780 0x7fa95013e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94e59c700 1 -- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950062b00 msgr2=0x7fa95011eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94e59c700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950062b00 0x7fa95011eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94e59c700 1 -- 172.21.15.154:0/2628459617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948009ae0 con 0x7fa950096290 2023-09-30T22:19:42.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94f59e700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa95011f780 0x7fa95013e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:19:42.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7fa94ed9d700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950062b00 0x7fa95011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:42.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.627+0000 7f3c1d4de700 1 -- start start 2023-09-30T22:19:42.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7fa94e59c700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 0x7fa95011f290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa94400b500 tx=0x7fa9440090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7fa936ffd700 1 -- 172.21.15.154:0/2628459617 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944002320 con 0x7fa950096290 2023-09-30T22:19:42.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7fa936ffd700 1 -- 172.21.15.154:0/2628459617 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9440024a0 con 0x7fa950096290 2023-09-30T22:19:42.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95006a7c0 con 0x7fa950096290 2023-09-30T22:19:42.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa950120330 con 0x7fa950096290 2023-09-30T22:19:42.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7fa936ffd700 1 -- 172.21.15.154:0/2628459617 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944002860 con 0x7fa950096290 2023-09-30T22:19:42.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c1d4de700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c18066e30 0x7f3c180966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c1d4de700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c18068680 0x7f3c181190a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c1d4de700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c18134650 0x7f3c18119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c1d4de700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1811a6e0 con 0x7f3c18134650 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c1d4de700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1811bb20 con 0x7f3c18066e30 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c1d4de700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1811b4d0 con 0x7f3c18068680 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c16ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c18066e30 0x7f3c180966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c16ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c18066e30 0x7f3c180966d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54324/0 (socket says 172.21.15.154:54324) 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c16ffd700 1 -- 172.21.15.154:0/2723844451 learned_addr learned my addr 172.21.15.154:0/2723844451 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.628+0000 7f3c167fc700 1 --2- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c18068680 0x7f3c181190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c177fe700 1 --2- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c18134650 0x7f3c18119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c16ffd700 1 -- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c18068680 msgr2=0x7f3c181190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c16ffd700 1 --2- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c18068680 0x7f3c181190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c16ffd700 1 -- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c18134650 msgr2=0x7f3c18119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c16ffd700 1 --2- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c18134650 0x7f3c18119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c16ffd700 1 -- 172.21.15.154:0/2723844451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08009370 con 0x7f3c18066e30 2023-09-30T22:19:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c16ffd700 1 --2- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c18066e30 0x7f3c180966d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3c0000b4c0 tx=0x7f3c00009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c0effd700 1 -- 172.21.15.154:0/2723844451 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00012410 con 0x7f3c18066e30 2023-09-30T22:19:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c0effd700 1 -- 172.21.15.154:0/2723844451 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c000125b0 con 0x7f3c18066e30 2023-09-30T22:19:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c0effd700 1 -- 172.21.15.154:0/2723844451 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00012970 con 0x7f3c18066e30 2023-09-30T22:19:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1811a4a0 con 0x7f3c18066e30 2023-09-30T22:19:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.629+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c18119a80 con 0x7f3c18066e30 2023-09-30T22:19:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.630+0000 7f3c0effd700 1 -- 172.21.15.154:0/2723844451 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3c00012d20 con 0x7f3c18066e30 2023-09-30T22:19:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.630+0000 7f3c0effd700 1 -- 172.21.15.154:0/2723844451 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3c0003ae30 con 0x7f3c18066e30 2023-09-30T22:19:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.630+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa950122160 con 0x7fa950096290 2023-09-30T22:19:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.630+0000 7fa936ffd700 1 -- 172.21.15.154:0/2628459617 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa944002bd0 con 0x7fa950096290 2023-09-30T22:19:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.631+0000 7f0b8dc67700 1 Processor -- start 2023-09-30T22:19:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.631+0000 7f0b8dc67700 1 -- start start 2023-09-30T22:19:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.631+0000 7fa936ffd700 1 -- 172.21.15.154:0/2628459617 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa94403aea0 con 0x7fa950096290 2023-09-30T22:19:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.631+0000 7f3eab7fa700 1 Processor -- start 2023-09-30T22:19:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.631+0000 7f0b8dc67700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b880653b0 0x7f0b88097bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.631+0000 7f0b8dc67700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b880986b0 0x7f0b88098b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.631+0000 7f0b8dc67700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b88096170 con 0x7f0b88099000 2023-09-30T22:19:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.631+0000 7f0b8dc67700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b88065790 con 0x7f0b880653b0 2023-09-30T22:19:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.631+0000 7f0b8dc67700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8809a540 con 0x7f0b880986b0 2023-09-30T22:19:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b87fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0b88099000 0x7f0b881314b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41736/0 (socket says 172.21.15.154:41736) 2023-09-30T22:19:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b87fff700 1 -- 172.21.15.154:0/2767000947 learned_addr learned my addr 172.21.15.154:0/2767000947 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b86ffd700 1 --2- 172.21.15.154:0/2767000947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b880986b0 0x7f0b88098b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3eab7fa700 1 -- start start 2023-09-30T22:19:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b877fe700 1 --2- 172.21.15.154:0/2767000947 >> v2:172.21.15.154:3300/0 conn(0x7f0b880653b0 0x7f0b88097bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b86ffd700 1 -- 172.21.15.154:0/2767000947 >> v2:172.21.15.154:3300/0 conn(0x7f0b880653b0 msgr2=0x7f0b88097bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b86ffd700 1 --2- 172.21.15.154:0/2767000947 >> v2:172.21.15.154:3300/0 conn(0x7f0b880653b0 0x7f0b88097bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b86ffd700 1 -- 172.21.15.154:0/2767000947 >> v1:172.21.15.154:6789/0 conn(0x7f0b88099000 legacy=0x7f0b881314b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b86ffd700 1 -- 172.21.15.154:0/2767000947 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b88066160 con 0x7f0b880986b0 2023-09-30T22:19:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b86ffd700 1 --2- 172.21.15.154:0/2767000947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b880986b0 0x7f0b88098b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0b7c0097c0 tx=0x7f0b7c009060).ready entity=mon.1 client_cookie=d29c8cc87d4eb3fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3eab7fa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea4093730 0x7f3ea412c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b867fc700 1 -- 172.21.15.154:0/2767000947 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c00f510 con 0x7f0b880986b0 2023-09-30T22:19:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b867fc700 1 -- 172.21.15.154:0/2767000947 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c00f670 con 0x7f0b880986b0 2023-09-30T22:19:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f0b867fc700 1 -- 172.21.15.154:0/2767000947 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c00f9f0 con 0x7f0b880986b0 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3eab7fa700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ea412f520 0x7f3ea4137190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3eab7fa700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea4095fa0 con 0x7f3ea412c4f0 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3eab7fa700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea412c8f0 con 0x7f3ea412f520 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3eab7fa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4093350 con 0x7f3ea4093730 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3ea8d95700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3ea412c4f0 0x7f3ea412ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41740/0 (socket says 172.21.15.154:41740) 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3ea8d95700 1 -- 172.21.15.154:0/1889439587 learned_addr learned my addr 172.21.15.154:0/1889439587 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3ea9596700 1 --2- 172.21.15.154:0/1889439587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea4093730 0x7f3ea412c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.632+0000 7f3ea9d97700 1 --2- 172.21.15.154:0/1889439587 >> v2:172.21.15.154:3300/0 conn(0x7f3ea412f520 0x7f3ea4137190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f3ea9d97700 1 -- 172.21.15.154:0/1889439587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea4093730 msgr2=0x7f3ea412c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:42.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f3ea9d97700 1 --2- 172.21.15.154:0/1889439587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea4093730 0x7f3ea412c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f3ea9d97700 1 -- 172.21.15.154:0/1889439587 >> v1:172.21.15.154:6789/0 conn(0x7f3ea412c4f0 legacy=0x7f3ea412ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f3ea9d97700 1 -- 172.21.15.154:0/1889439587 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4093b10 con 0x7f3ea412f520 2023-09-30T22:19:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f3ea9d97700 1 --2- 172.21.15.154:0/1889439587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea412f520 0x7f3ea4137190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f3e9c009e60 tx=0x7f3e9c009780).ready entity=mon.0 client_cookie=1486dd94f25fa2c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f0b8dc67700 1 -- 172.21.15.154:0/2767000947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b880986b0 msgr2=0x7f0b88098b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f0b8dc67700 1 --2- 172.21.15.154:0/2767000947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b880986b0 0x7f0b88098b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0b7c0097c0 tx=0x7f0b7c009060).stop 2023-09-30T22:19:42.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f0b8dc67700 1 -- 172.21.15.154:0/2767000947 shutdown_connections 2023-09-30T22:19:42.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f0b8dc67700 1 --2- 172.21.15.154:0/2767000947 >> v2:172.21.15.154:3300/0 conn(0x7f0b880653b0 0x7f0b88097bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f0b8dc67700 1 --2- 172.21.15.154:0/2767000947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b880986b0 0x7f0b88098b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f0b8dc67700 1 -- 172.21.15.154:0/2767000947 >> 172.21.15.154:0/2767000947 conn(0x7f0b8809dc90 msgr2=0x7f0b8809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f0b8dc67700 1 -- 172.21.15.154:0/2767000947 shutdown_connections 2023-09-30T22:19:42.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f0b8dc67700 1 -- 172.21.15.154:0/2767000947 wait complete. 2023-09-30T22:19:42.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.633+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c18134c60 con 0x7f3c18066e30 2023-09-30T22:19:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.634+0000 7f0b8dc67700 1 Processor -- start 2023-09-30T22:19:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.634+0000 7f0b8dc67700 1 -- start start 2023-09-30T22:19:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b8dc67700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b880653b0 0x7f0b8813a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b8dc67700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b880986b0 0x7f0b8813a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b8dc67700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b88099000 0x7f0b8813adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b8dc67700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8811e180 con 0x7f0b880653b0 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b8dc67700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88099a90 con 0x7f0b88099000 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b8dc67700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8809d330 con 0x7f0b880986b0 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b86ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b880986b0 0x7f0b8813a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b87fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b88099000 0x7f0b8813adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b86ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b880986b0 0x7f0b8813a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60080/0 (socket says 172.21.15.154:60080) 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b86ffd700 1 -- 172.21.15.154:0/3731934081 learned_addr learned my addr 172.21.15.154:0/3731934081 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b877fe700 1 --2- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b880653b0 0x7f0b8813a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b86ffd700 1 -- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b88099000 msgr2=0x7f0b8813adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b86ffd700 1 --2- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b88099000 0x7f0b8813adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b86ffd700 1 -- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b880653b0 msgr2=0x7f0b8813a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b86ffd700 1 --2- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b880653b0 0x7f0b8813a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.635+0000 7f0b86ffd700 1 -- 172.21.15.154:0/3731934081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0092a0 con 0x7f0b880986b0 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.636+0000 7f0b86ffd700 1 --2- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b880986b0 0x7f0b8813a900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0b7c009e60 tx=0x7f0b7c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.636+0000 7f0b6f7fe700 1 -- 172.21.15.154:0/3731934081 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c00f7e0 con 0x7f0b880986b0 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.636+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8811cc10 con 0x7f0b880986b0 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.636+0000 7f0b6f7fe700 1 -- 172.21.15.154:0/3731934081 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c00f940 con 0x7f0b880986b0 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.636+0000 7f0b6f7fe700 1 -- 172.21.15.154:0/3731934081 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c01b660 con 0x7f0b880986b0 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.636+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8811c220 con 0x7f0b880986b0 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.637+0000 7f0b6f7fe700 1 -- 172.21.15.154:0/3731934081 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0b7c01ba10 con 0x7f0b880986b0 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.637+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b88062930 con 0x7f0b880986b0 2023-09-30T22:19:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.637+0000 7f0b6f7fe700 1 -- 172.21.15.154:0/3731934081 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0b7c03c910 con 0x7f0b880986b0 2023-09-30T22:19:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.639+0000 7fa936ffd700 1 -- 172.21.15.154:0/2628459617 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa944012e00 con 0x7fa950096290 2023-09-30T22:19:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.639+0000 7f3e9bfff700 1 -- 172.21.15.154:0/1889439587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00e070 con 0x7f3ea412f520 2023-09-30T22:19:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.639+0000 7f3e9bfff700 1 -- 172.21.15.154:0/1889439587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c00bb60 con 0x7f3ea412f520 2023-09-30T22:19:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.639+0000 7f3e9bfff700 1 -- 172.21.15.154:0/1889439587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c012410 con 0x7f3ea412f520 2023-09-30T22:19:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.639+0000 7f3eab7fa700 1 -- 172.21.15.154:0/1889439587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea412f520 msgr2=0x7f3ea4137190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.639+0000 7f3eab7fa700 1 --2- 172.21.15.154:0/1889439587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea412f520 0x7f3ea4137190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f3e9c009e60 tx=0x7f3e9c009780).stop 2023-09-30T22:19:42.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.640+0000 7f3eab7fa700 1 -- 172.21.15.154:0/1889439587 shutdown_connections 2023-09-30T22:19:42.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.640+0000 7f3eab7fa700 1 --2- 172.21.15.154:0/1889439587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea412f520 0x7f3ea4137190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.640+0000 7f3eab7fa700 1 --2- 172.21.15.154:0/1889439587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea4093730 0x7f3ea412c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.640+0000 7f3eab7fa700 1 -- 172.21.15.154:0/1889439587 >> 172.21.15.154:0/1889439587 conn(0x7f3ea40999d0 msgr2=0x7f3ea4099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.640+0000 7f3eab7fa700 1 -- 172.21.15.154:0/1889439587 shutdown_connections 2023-09-30T22:19:42.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.640+0000 7f3eab7fa700 1 -- 172.21.15.154:0/1889439587 wait complete. 2023-09-30T22:19:42.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.641+0000 7f3eab7fa700 1 Processor -- start 2023-09-30T22:19:42.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3c0effd700 1 -- 172.21.15.154:0/2723844451 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3c0001b3e0 con 0x7f3c18066e30 2023-09-30T22:19:42.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.641+0000 7f3eab7fa700 1 -- start start 2023-09-30T22:19:42.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3eab7fa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea4093730 0x7f3ea4110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3eab7fa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ea412c4f0 0x7f3ea4110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3eab7fa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea412f520 0x7f3ea4110a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3eab7fa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea412ba10 con 0x7f3ea4093730 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3eab7fa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea406a4d0 con 0x7f3ea412f520 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3eab7fa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4117a30 con 0x7f3ea412c4f0 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3ea8d95700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ea412c4f0 0x7f3ea4110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3ea9d97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea412f520 0x7f3ea4110a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3ea9596700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea4093730 0x7f3ea4110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3ea8d95700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ea412c4f0 0x7f3ea4110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60086/0 (socket says 172.21.15.154:60086) 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3ea9d97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea412f520 0x7f3ea4110a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54366/0 (socket says 172.21.15.154:54366) 2023-09-30T22:19:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3ea9596700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea4093730 0x7f3ea4110030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37236/0 (socket says 172.21.15.154:37236) 2023-09-30T22:19:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.642+0000 7f3ea8d95700 1 -- 172.21.15.154:0/697311584 learned_addr learned my addr 172.21.15.154:0/697311584 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3ea8d95700 1 -- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea412f520 msgr2=0x7f3ea4110a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3ea8d95700 1 --2- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea412f520 0x7f3ea4110a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3ea8d95700 1 -- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea4093730 msgr2=0x7f3ea4110030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3ea8d95700 1 --2- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea4093730 0x7f3ea4110030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3ea8d95700 1 -- 172.21.15.154:0/697311584 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c009a20 con 0x7f3ea412c4f0 2023-09-30T22:19:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3ea9d97700 1 --2- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea412f520 0x7f3ea4110a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f0b6f7fe700 1 -- 172.21.15.154:0/3731934081 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0b7c029020 con 0x7f0b880986b0 2023-09-30T22:19:42.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3ea8d95700 1 --2- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ea412c4f0 0x7f3ea4110520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3e9400c4c0 tx=0x7f3e94007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:42.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3e997fa700 1 -- 172.21.15.154:0/697311584 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9400ce10 con 0x7f3ea412c4f0 2023-09-30T22:19:42.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3e997fa700 1 -- 172.21.15.154:0/697311584 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e940072e0 con 0x7f3ea412c4f0 2023-09-30T22:19:42.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.643+0000 7f3e997fa700 1 -- 172.21.15.154:0/697311584 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94007660 con 0x7f3ea412c4f0 2023-09-30T22:19:42.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.644+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea4112f70 con 0x7f3ea412c4f0 2023-09-30T22:19:42.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.644+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea4113d90 con 0x7f3ea412c4f0 2023-09-30T22:19:42.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.645+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea412f230 con 0x7f3ea412c4f0 2023-09-30T22:19:42.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.647+0000 7f3e997fa700 1 -- 172.21.15.154:0/697311584 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3e940059b0 con 0x7f3ea412c4f0 2023-09-30T22:19:42.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.648+0000 7f3e997fa700 1 -- 172.21.15.154:0/697311584 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3e9403a650 con 0x7f3ea412c4f0 2023-09-30T22:19:42.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.651+0000 7f3e997fa700 1 -- 172.21.15.154:0/697311584 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3e9401be00 con 0x7f3ea412c4f0 2023-09-30T22:19:42.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.809+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa95005a260 con 0x7fa950096290 2023-09-30T22:19:42.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.809+0000 7fa936ffd700 1 -- 172.21.15.154:0/2628459617 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa944019300 con 0x7fa950096290 2023-09-30T22:19:42.810 INFO:teuthology.orchestra.run.smithi154.stdout:38654705667 2023-09-30T22:19:42.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 >> v1:172.21.15.154:6816/118163 conn(0x7fa93c02bb90 legacy=0x7fa93c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 msgr2=0x7fa95011f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 0x7fa95011f290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa94400b500 tx=0x7fa9440090f0).stop 2023-09-30T22:19:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 shutdown_connections 2023-09-30T22:19:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa95011f780 0x7fa95013e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950062b00 0x7fa95011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 --2- 172.21.15.154:0/2628459617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950096290 0x7fa95011f290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 >> 172.21.15.154:0/2628459617 conn(0x7fa95009aa50 msgr2=0x7fa950098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 shutdown_connections 2023-09-30T22:19:42.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.811+0000 7fa955154700 1 -- 172.21.15.154:0/2628459617 wait complete. 2023-09-30T22:19:42.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.812+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3c1805a260 con 0x7f3c18066e30 2023-09-30T22:19:42.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.812+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0b8805a260 con 0x7f0b880986b0 2023-09-30T22:19:42.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.812+0000 7f3c0effd700 1 -- 172.21.15.154:0/2723844451 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c00010360 con 0x7f3c18066e30 2023-09-30T22:19:42.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.813+0000 7f0b6f7fe700 1 -- 172.21.15.154:0/3731934081 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b7c033090 con 0x7f0b880986b0 2023-09-30T22:19:42.814 INFO:teuthology.orchestra.run.smithi154.stdout:38654705668 2023-09-30T22:19:42.814 INFO:teuthology.orchestra.run.smithi154.stdout:38654705667 2023-09-30T22:19:42.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 >> v1:172.21.15.154:6816/118163 conn(0x7f3bf802bb60 legacy=0x7f3bf802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c18066e30 msgr2=0x7f3c180966d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 --2- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c18066e30 0x7f3c180966d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3c0000b4c0 tx=0x7f3c00009060).stop 2023-09-30T22:19:42.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 >> v1:172.21.15.154:6816/118163 conn(0x7f0b7402bb60 legacy=0x7f0b7402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b880986b0 msgr2=0x7f0b8813a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 --2- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b880986b0 0x7f0b8813a900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0b7c009e60 tx=0x7f0b7c015000).stop 2023-09-30T22:19:42.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 shutdown_connections 2023-09-30T22:19:42.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 --2- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c18134650 0x7f3c18119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 --2- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c18066e30 0x7f3c180966d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 --2- 172.21.15.154:0/2723844451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c18068680 0x7f3c181190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 >> 172.21.15.154:0/2723844451 conn(0x7f3c1809a230 msgr2=0x7f3c18133ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 shutdown_connections 2023-09-30T22:19:42.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 shutdown_connections 2023-09-30T22:19:42.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 --2- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b88099000 0x7f0b8813adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 --2- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b880653b0 0x7f0b8813a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 --2- 172.21.15.154:0/3731934081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b880986b0 0x7f0b8813a900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 >> 172.21.15.154:0/3731934081 conn(0x7f0b8809dc90 msgr2=0x7f0b88114310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f3c1d4de700 1 -- 172.21.15.154:0/2723844451 wait complete. 2023-09-30T22:19:42.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 shutdown_connections 2023-09-30T22:19:42.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.815+0000 7f0b8dc67700 1 -- 172.21.15.154:0/3731934081 wait complete. 2023-09-30T22:19:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.827+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ea4113d90 con 0x7f3ea412c4f0 2023-09-30T22:19:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.828+0000 7f3e997fa700 1 -- 172.21.15.154:0/697311584 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ea4113d90 con 0x7f3ea412c4f0 2023-09-30T22:19:42.830 INFO:teuthology.orchestra.run.smithi154.stdout:38654705667 2023-09-30T22:19:42.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2023-09-30T22:19:42.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2023-09-30T22:19:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.830+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 >> v1:172.21.15.154:6816/118163 conn(0x7f3e8802bbe0 legacy=0x7f3e8802e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.830+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ea412c4f0 msgr2=0x7f3ea4110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.830+0000 7f3eab7fa700 1 --2- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ea412c4f0 0x7f3ea4110520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3e9400c4c0 tx=0x7f3e94007dc0).stop 2023-09-30T22:19:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.831+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 shutdown_connections 2023-09-30T22:19:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.831+0000 7f3eab7fa700 1 --2- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ea412f520 0x7f3ea4110a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.831+0000 7f3eab7fa700 1 --2- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ea4093730 0x7f3ea4110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.831+0000 7f3eab7fa700 1 --2- 172.21.15.154:0/697311584 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ea412c4f0 0x7f3ea4110520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.831+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 >> 172.21.15.154:0/697311584 conn(0x7f3ea40999d0 msgr2=0x7f3ea40980d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.831+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 shutdown_connections 2023-09-30T22:19:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:42.831+0000 7f3eab7fa700 1 -- 172.21.15.154:0/697311584 wait complete. 2023-09-30T22:19:42.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2023-09-30T22:19:42.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2023-09-30T22:19:43.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:19:43.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:19:43.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:19:43.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:19:43.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.960+0000 7fc5012bb700 1 Processor -- start 2023-09-30T22:19:43.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.960+0000 7fc5012bb700 1 -- start start 2023-09-30T22:19:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.961+0000 7fc5012bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.961+0000 7fc5012bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 0x7fc4fc096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.961+0000 7fc5012bb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc094ba0 con 0x7fc4fc12c240 2023-09-30T22:19:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.961+0000 7fc5012bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc092e90 con 0x7fc4fc093950 2023-09-30T22:19:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.961+0000 7fc5012bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc096b60 con 0x7fc4fc095c50 2023-09-30T22:19:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.961+0000 7fc4fb7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc4fc12c240 0x7fc4fc12e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41748/0 (socket says 172.21.15.154:41748) 2023-09-30T22:19:43.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.961+0000 7fc4fb7fe700 1 -- 172.21.15.154:0/2249568926 learned_addr learned my addr 172.21.15.154:0/2249568926 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.961+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.961+0000 7fc4fa7fc700 1 --2- 172.21.15.154:0/2249568926 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 0x7fc4fc096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4f9ffb700 1 -- 172.21.15.154:0/2249568926 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629350567 0 0) 0x7fc4fc094ba0 con 0x7fc4fc12c240 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4f9ffb700 1 -- 172.21.15.154:0/2249568926 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4e40033f0 con 0x7fc4fc12c240 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4faffd700 1 -- 172.21.15.154:0/2249568926 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 msgr2=0x7fc4fc096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4faffd700 1 --2- 172.21.15.154:0/2249568926 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 0x7fc4fc096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4faffd700 1 -- 172.21.15.154:0/2249568926 >> v1:172.21.15.154:6789/0 conn(0x7fc4fc12c240 legacy=0x7fc4fc12e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4faffd700 1 -- 172.21.15.154:0/2249568926 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc093150 con 0x7fc4fc093950 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4faffd700 1 --2- 172.21.15.154:0/2249568926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc095760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc4ec009790 tx=0x7fc4ec009060).ready entity=mon.1 client_cookie=8b5a08fa5aa12265 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4f9ffb700 1 -- 172.21.15.154:0/2249568926 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0090d0 con 0x7fc4fc093950 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4f9ffb700 1 -- 172.21.15.154:0/2249568926 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec00f6b0 con 0x7fc4fc093950 2023-09-30T22:19:43.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.962+0000 7fc4f9ffb700 1 -- 172.21.15.154:0/2249568926 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00fa30 con 0x7fc4fc093950 2023-09-30T22:19:43.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.963+0000 7fc5012bb700 1 -- 172.21.15.154:0/2249568926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 msgr2=0x7fc4fc095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.963+0000 7fc5012bb700 1 --2- 172.21.15.154:0/2249568926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc095760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc4ec009790 tx=0x7fc4ec009060).stop 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.963+0000 7fc5012bb700 1 -- 172.21.15.154:0/2249568926 shutdown_connections 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.963+0000 7fc5012bb700 1 --2- 172.21.15.154:0/2249568926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc095760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.963+0000 7fc5012bb700 1 --2- 172.21.15.154:0/2249568926 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 0x7fc4fc096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.963+0000 7fc5012bb700 1 -- 172.21.15.154:0/2249568926 >> 172.21.15.154:0/2249568926 conn(0x7fc4fc09aa50 msgr2=0x7fc4fc09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.963+0000 7fc5012bb700 1 -- 172.21.15.154:0/2249568926 shutdown_connections 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.963+0000 7fc5012bb700 1 -- 172.21.15.154:0/2249568926 wait complete. 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.964+0000 7fc5012bb700 1 Processor -- start 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc5012bb700 1 -- start start 2023-09-30T22:19:43.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc5012bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc12bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc5012bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 0x7fc4fc115c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc5012bb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4fc12c240 0x7fc4fc116180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc5012bb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc1197a0 con 0x7fc4fc12c240 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc5012bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc099640 con 0x7fc4fc093950 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc12bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc12bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54378/0 (socket says 172.21.15.154:54378) 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc4faffd700 1 -- 172.21.15.154:0/3467196557 learned_addr learned my addr 172.21.15.154:0/3467196557 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc4fb7fe700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4fc12c240 0x7fc4fc116180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc4fa7fc700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 0x7fc4fc115c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.965+0000 7fc5012bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc092410 con 0x7fc4fc095c50 2023-09-30T22:19:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4fb7fe700 1 -- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 msgr2=0x7fc4fc115c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4fb7fe700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 0x7fc4fc115c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4fb7fe700 1 -- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 msgr2=0x7fc4fc12bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4fb7fe700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc12bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4fb7fe700 1 -- 172.21.15.154:0/3467196557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0092a0 con 0x7fc4fc12c240 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4faffd700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc12bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4fb7fe700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4fc12c240 0x7fc4fc116180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc4f400c7c0 tx=0x7fc4f4007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4e2ffd700 1 -- 172.21.15.154:0/3467196557 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4005d30 con 0x7fc4fc12c240 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4e2ffd700 1 -- 172.21.15.154:0/3467196557 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f4005e90 con 0x7fc4fc12c240 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc4e2ffd700 1 -- 172.21.15.154:0/3467196557 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f40072e0 con 0x7fc4fc12c240 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc119190 con 0x7fc4fc12c240 2023-09-30T22:19:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.966+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc117820 con 0x7fc4fc12c240 2023-09-30T22:19:43.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.967+0000 7fc4e2ffd700 1 -- 172.21.15.154:0/3467196557 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc4f4007710 con 0x7fc4fc12c240 2023-09-30T22:19:43.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.968+0000 7fc4e2ffd700 1 -- 172.21.15.154:0/3467196557 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc4f403a840 con 0x7fc4fc12c240 2023-09-30T22:19:43.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.968+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc062770 con 0x7fc4fc12c240 2023-09-30T22:19:43.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.976+0000 7fc4e2ffd700 1 -- 172.21.15.154:0/3467196557 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc4f4022020 con 0x7fc4fc12c240 2023-09-30T22:19:43.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.976+0000 7f6b3f2f7700 1 Processor -- start 2023-09-30T22:19:43.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.976+0000 7f6b3f2f7700 1 -- start start 2023-09-30T22:19:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3f2f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b38093950 0x7f6b38095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3f2f7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b3812d250 0x7f6b3812f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3f2f7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b38094ba0 con 0x7f6b38095c50 2023-09-30T22:19:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3f2f7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b38092e90 con 0x7f6b3812d250 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3f2f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b38096b60 con 0x7f6b38093950 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3d093700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b38093950 0x7f6b38095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3d093700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b38093950 0x7f6b38095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54392/0 (socket says 172.21.15.154:54392) 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3d093700 1 -- 172.21.15.154:0/1558346065 learned_addr learned my addr 172.21.15.154:0/1558346065 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b2ffff700 1 -- 172.21.15.154:0/1558346065 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372383379 0 0) 0x7f6b38094ba0 con 0x7f6b38095c50 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3d093700 1 -- 172.21.15.154:0/1558346065 >> v2:172.21.15.154:3300/0 conn(0x7f6b3812d250 msgr2=0x7f6b3812f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3d093700 1 --2- 172.21.15.154:0/1558346065 >> v2:172.21.15.154:3300/0 conn(0x7f6b3812d250 0x7f6b3812f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3d093700 1 -- 172.21.15.154:0/1558346065 >> v1:172.21.15.154:6789/0 conn(0x7f6b38095c50 legacy=0x7f6b38096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3d093700 1 -- 172.21.15.154:0/1558346065 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b38093150 con 0x7f6b38093950 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.977+0000 7f6b3d093700 1 --2- 172.21.15.154:0/1558346065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b38093950 0x7f6b38095760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6b34006fd0 tx=0x7f6b3400b3b0).ready entity=mon.1 client_cookie=dd6c1b765353564 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b2ffff700 1 -- 172.21.15.154:0/1558346065 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400db40 con 0x7f6b38093950 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b2ffff700 1 -- 172.21.15.154:0/1558346065 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3400dca0 con 0x7f6b38093950 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b2ffff700 1 -- 172.21.15.154:0/1558346065 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340106a0 con 0x7f6b38093950 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/1558346065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b38093950 msgr2=0x7f6b38095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b3f2f7700 1 --2- 172.21.15.154:0/1558346065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b38093950 0x7f6b38095760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6b34006fd0 tx=0x7f6b3400b3b0).stop 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/1558346065 shutdown_connections 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b3f2f7700 1 --2- 172.21.15.154:0/1558346065 >> v2:172.21.15.154:3300/0 conn(0x7f6b3812d250 0x7f6b3812f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b3f2f7700 1 --2- 172.21.15.154:0/1558346065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b38093950 0x7f6b38095760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/1558346065 >> 172.21.15.154:0/1558346065 conn(0x7f6b3809aa50 msgr2=0x7f6b3809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.978+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/1558346065 shutdown_connections 2023-09-30T22:19:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.979+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/1558346065 wait complete. 2023-09-30T22:19:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.980+0000 7f6b3f2f7700 1 Processor -- start 2023-09-30T22:19:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.980+0000 7f6b3f2f7700 1 -- start start 2023-09-30T22:19:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.980+0000 7f6b3f2f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b38093950 0x7f6b3813e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.980+0000 7f6b3f2f7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b38095c50 0x7f6b3813edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.980+0000 7f6b3f2f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b3812d250 0x7f6b38115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.980+0000 7f6b3f2f7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b38117ec0 con 0x7f6b38095c50 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3f2f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b38118330 con 0x7f6b3812d250 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3f2f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b38092440 con 0x7f6b38093950 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d093700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b38093950 0x7f6b3813e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d093700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b38093950 0x7f6b3813e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60098/0 (socket says 172.21.15.154:60098) 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d093700 1 -- 172.21.15.154:0/3271548252 learned_addr learned my addr 172.21.15.154:0/3271548252 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d894700 1 --2- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b3812d250 0x7f6b38115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d093700 1 -- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b3812d250 msgr2=0x7f6b38115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d093700 1 --2- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b3812d250 0x7f6b38115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d093700 1 -- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b38095c50 msgr2=0x7f6b3813edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:43.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d093700 1 --2- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b38095c50 0x7f6b3813edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:43.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d093700 1 -- 172.21.15.154:0/3271548252 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3400b610 con 0x7f6b38093950 2023-09-30T22:19:43.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3d093700 1 --2- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b38093950 0x7f6b3813e900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6b3400d5d0 tx=0x7f6b3400b3b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:43.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b2d7fa700 1 -- 172.21.15.154:0/3271548252 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34010680 con 0x7f6b38093950 2023-09-30T22:19:43.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b2d7fa700 1 -- 172.21.15.154:0/3271548252 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b34019450 con 0x7f6b38093950 2023-09-30T22:19:43.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b38119ca0 con 0x7f6b38093950 2023-09-30T22:19:43.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.981+0000 7f6b2d7fa700 1 -- 172.21.15.154:0/3271548252 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340197d0 con 0x7f6b38093950 2023-09-30T22:19:43.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.982+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3813f2e0 con 0x7f6b38093950 2023-09-30T22:19:43.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.982+0000 7f6b2d7fa700 1 -- 172.21.15.154:0/3271548252 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6b34019bc0 con 0x7f6b38093950 2023-09-30T22:19:43.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.983+0000 7f6b2d7fa700 1 -- 172.21.15.154:0/3271548252 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6b3403c940 con 0x7f6b38093950 2023-09-30T22:19:43.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.983+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3805a260 con 0x7f6b38093950 2023-09-30T22:19:43.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:43.989+0000 7f6b2d7fa700 1 -- 172.21.15.154:0/3271548252 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6b34028070 con 0x7f6b38093950 2023-09-30T22:19:44.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.004+0000 7f7708316700 1 Processor -- start 2023-09-30T22:19:44.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.005+0000 7f7708316700 1 -- start start 2023-09-30T22:19:44.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.005+0000 7f7708316700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77001245e0 0x7f77000937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.005+0000 7f7708316700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700096400 0x7f7700127df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.005+0000 7f7708316700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7700091d10 con 0x7f7700124200 2023-09-30T22:19:44.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.005+0000 7f7708316700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7700124ba0 con 0x7f7700096400 2023-09-30T22:19:44.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.005+0000 7f7708316700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7700092d00 con 0x7f77001245e0 2023-09-30T22:19:44.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.005+0000 7f77060b2700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7700124200 0x7f77001276e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41764/0 (socket says 172.21.15.154:41764) 2023-09-30T22:19:44.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.005+0000 7f77060b2700 1 -- 172.21.15.154:0/1785390032 learned_addr learned my addr 172.21.15.154:0/1785390032 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.005+0000 7f77068b3700 1 --2- 172.21.15.154:0/1785390032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700096400 0x7f7700127df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77058b1700 1 --2- 172.21.15.154:0/1785390032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77001245e0 0x7f77000937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77068b3700 1 -- 172.21.15.154:0/1785390032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77001245e0 msgr2=0x7f77000937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77068b3700 1 --2- 172.21.15.154:0/1785390032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77001245e0 0x7f77000937a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77068b3700 1 -- 172.21.15.154:0/1785390032 >> v1:172.21.15.154:6789/0 conn(0x7f7700124200 legacy=0x7f77001276e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77050b0700 1 -- 172.21.15.154:0/1785390032 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947266897 0 0) 0x7f7700091d10 con 0x7f7700124200 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77068b3700 1 -- 172.21.15.154:0/1785390032 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700092210 con 0x7f7700096400 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77068b3700 1 --2- 172.21.15.154:0/1785390032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700096400 0x7f7700127df0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f76f8009e90 tx=0x7f76f8009780).ready entity=mon.1 client_cookie=cd6209e289692622 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77050b0700 1 -- 172.21.15.154:0/1785390032 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f800bb60 con 0x7f7700096400 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77050b0700 1 -- 172.21.15.154:0/1785390032 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f800bcc0 con 0x7f7700096400 2023-09-30T22:19:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.006+0000 7f77050b0700 1 -- 172.21.15.154:0/1785390032 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8011690 con 0x7f7700096400 2023-09-30T22:19:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.007+0000 7f7708316700 1 -- 172.21.15.154:0/1785390032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700096400 msgr2=0x7f7700127df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.007+0000 7f7708316700 1 --2- 172.21.15.154:0/1785390032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700096400 0x7f7700127df0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f76f8009e90 tx=0x7f76f8009780).stop 2023-09-30T22:19:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.007+0000 7f7708316700 1 -- 172.21.15.154:0/1785390032 shutdown_connections 2023-09-30T22:19:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.007+0000 7f7708316700 1 --2- 172.21.15.154:0/1785390032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700096400 0x7f7700127df0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.007+0000 7f7708316700 1 --2- 172.21.15.154:0/1785390032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77001245e0 0x7f77000937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.007+0000 7f7708316700 1 -- 172.21.15.154:0/1785390032 >> 172.21.15.154:0/1785390032 conn(0x7f77000974f0 msgr2=0x7f7700097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.007+0000 7f7708316700 1 -- 172.21.15.154:0/1785390032 shutdown_connections 2023-09-30T22:19:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.007+0000 7f7708316700 1 -- 172.21.15.154:0/1785390032 wait complete. 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.008+0000 7f7708316700 1 Processor -- start 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.008+0000 7f7708316700 1 -- start start 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.008+0000 7f7708316700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7700096400 0x7f7700117850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.008+0000 7f7708316700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700124200 0x7f7700123940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.008+0000 7f7708316700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77001245e0 0x7f7700068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.008+0000 7f7708316700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7700117070 con 0x7f77001245e0 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.008+0000 7f7708316700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77001159f0 con 0x7f7700124200 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.008+0000 7f7708316700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7700125930 con 0x7f7700096400 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77068b3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77001245e0 0x7f7700068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77068b3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77001245e0 0x7f7700068bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37260/0 (socket says 172.21.15.154:37260) 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77068b3700 1 -- 172.21.15.154:0/1802874274 learned_addr learned my addr 172.21.15.154:0/1802874274 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77058b1700 1 --2- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700124200 0x7f7700123940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77060b2700 1 --2- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7700096400 0x7f7700117850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77068b3700 1 -- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7700096400 msgr2=0x7f7700117850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77068b3700 1 --2- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7700096400 0x7f7700117850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77068b3700 1 -- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700124200 msgr2=0x7f7700123940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77068b3700 1 --2- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700124200 0x7f7700123940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77068b3700 1 -- 172.21.15.154:0/1802874274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8009a20 con 0x7f77001245e0 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f77068b3700 1 --2- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77001245e0 0x7f7700068bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f76f800b6c0 tx=0x7f76f8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f76f67fc700 1 -- 172.21.15.154:0/1802874274 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f801b810 con 0x7f77001245e0 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f76f67fc700 1 -- 172.21.15.154:0/1802874274 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f801b970 con 0x7f77001245e0 2023-09-30T22:19:44.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7700115c30 con 0x7f77001245e0 2023-09-30T22:19:44.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f76f67fc700 1 -- 172.21.15.154:0/1802874274 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f801bd30 con 0x7f77001245e0 2023-09-30T22:19:44.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.009+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7700123e30 con 0x7f77001245e0 2023-09-30T22:19:44.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.010+0000 7f76f67fc700 1 -- 172.21.15.154:0/1802874274 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f76f8003040 con 0x7f77001245e0 2023-09-30T22:19:44.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.010+0000 7f76f67fc700 1 -- 172.21.15.154:0/1802874274 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f76f803d0e0 con 0x7f77001245e0 2023-09-30T22:19:44.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.011+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770005a260 con 0x7f77001245e0 2023-09-30T22:19:44.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.015+0000 7f76f67fc700 1 -- 172.21.15.154:0/1802874274 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f76f8015070 con 0x7f77001245e0 2023-09-30T22:19:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.025+0000 7f8b2a9f4700 1 Processor -- start 2023-09-30T22:19:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.025+0000 7f8b2a9f4700 1 -- start start 2023-09-30T22:19:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b2a9f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b240972b0 0x7f8b24094750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b2a9f4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b24094c40 0x7f8b241303b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b2a9f4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b24093180 con 0x7f8b24093980 2023-09-30T22:19:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b2a9f4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b24093d60 con 0x7f8b24094c40 2023-09-30T22:19:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b2a9f4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b240977d0 con 0x7f8b240972b0 2023-09-30T22:19:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b237fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b240972b0 0x7f8b24094750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b23fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8b24093980 0x7f8b24094040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41780/0 (socket says 172.21.15.154:41780) 2023-09-30T22:19:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b237fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b240972b0 0x7f8b24094750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54430/0 (socket says 172.21.15.154:54430) 2023-09-30T22:19:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b23fff700 1 -- 172.21.15.154:0/252496392 learned_addr learned my addr 172.21.15.154:0/252496392 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:44.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b28f91700 1 --2- 172.21.15.154:0/252496392 >> v2:172.21.15.154:3300/0 conn(0x7f8b24094c40 0x7f8b241303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b237fe700 1 -- 172.21.15.154:0/252496392 >> v2:172.21.15.154:3300/0 conn(0x7f8b24094c40 msgr2=0x7f8b241303b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b237fe700 1 --2- 172.21.15.154:0/252496392 >> v2:172.21.15.154:3300/0 conn(0x7f8b24094c40 0x7f8b241303b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b237fe700 1 -- 172.21.15.154:0/252496392 >> v1:172.21.15.154:6789/0 conn(0x7f8b24093980 legacy=0x7f8b24094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b237fe700 1 -- 172.21.15.154:0/252496392 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24098430 con 0x7f8b240972b0 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b28f91700 1 --2- 172.21.15.154:0/252496392 >> v2:172.21.15.154:3300/0 conn(0x7f8b24094c40 0x7f8b241303b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.026+0000 7f8b237fe700 1 --2- 172.21.15.154:0/252496392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b240972b0 0x7f8b24094750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8b18009760 tx=0x7f8b18009060).ready entity=mon.1 client_cookie=42ed60df513168b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b22ffd700 1 -- 172.21.15.154:0/252496392 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1800f510 con 0x7f8b240972b0 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b22ffd700 1 -- 172.21.15.154:0/252496392 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1800f670 con 0x7f8b240972b0 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b22ffd700 1 -- 172.21.15.154:0/252496392 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1800f9f0 con 0x7f8b240972b0 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/252496392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b240972b0 msgr2=0x7f8b24094750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b2a9f4700 1 --2- 172.21.15.154:0/252496392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b240972b0 0x7f8b24094750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f8b18009760 tx=0x7f8b18009060).stop 2023-09-30T22:19:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/252496392 shutdown_connections 2023-09-30T22:19:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b2a9f4700 1 --2- 172.21.15.154:0/252496392 >> v2:172.21.15.154:3300/0 conn(0x7f8b24094c40 0x7f8b241303b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b2a9f4700 1 --2- 172.21.15.154:0/252496392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b240972b0 0x7f8b24094750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/252496392 >> 172.21.15.154:0/252496392 conn(0x7f8b2409bba0 msgr2=0x7f8b2409bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/252496392 shutdown_connections 2023-09-30T22:19:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.027+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/252496392 wait complete. 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.028+0000 7f8b2a9f4700 1 Processor -- start 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.029+0000 7f8b2a9f4700 1 -- start start 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.029+0000 7f8b2a9f4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b24093980 0x7f8b240646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.029+0000 7f8b2a9f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b24094c40 0x7f8b24064b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.029+0000 7f8b2a9f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8b240972b0 0x7f8b24065080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.029+0000 7f8b2a9f4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24065570 con 0x7f8b24093980 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.029+0000 7f8b2a9f4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24065b10 con 0x7f8b24094c40 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.029+0000 7f8b2a9f4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2411d720 con 0x7f8b240972b0 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b28f91700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8b240972b0 0x7f8b24065080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b28f91700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8b240972b0 0x7f8b24065080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60114/0 (socket says 172.21.15.154:60114) 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b28f91700 1 -- 172.21.15.154:0/3786213853 learned_addr learned my addr 172.21.15.154:0/3786213853 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b237fe700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b24094c40 0x7f8b24064b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b23fff700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b24093980 0x7f8b240646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b237fe700 1 -- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8b240972b0 msgr2=0x7f8b24065080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b237fe700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8b240972b0 0x7f8b24065080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b237fe700 1 -- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b24093980 msgr2=0x7f8b240646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b237fe700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b24093980 0x7f8b240646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b237fe700 1 -- 172.21.15.154:0/3786213853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c009a20 con 0x7f8b24094c40 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b23fff700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b24093980 0x7f8b240646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b237fe700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b24094c40 0x7f8b24064b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8b18014000 tx=0x7f8b18017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.030+0000 7f8b0bfff700 1 -- 172.21.15.154:0/3786213853 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1800fe80 con 0x7f8b24094c40 2023-09-30T22:19:44.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.031+0000 7f8b0bfff700 1 -- 172.21.15.154:0/3786213853 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1800f7e0 con 0x7f8b24094c40 2023-09-30T22:19:44.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.031+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b180092a0 con 0x7f8b24094c40 2023-09-30T22:19:44.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.031+0000 7f8b0bfff700 1 -- 172.21.15.154:0/3786213853 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1801c630 con 0x7f8b24094c40 2023-09-30T22:19:44.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.031+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2411c960 con 0x7f8b24094c40 2023-09-30T22:19:44.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.032+0000 7f8b0bfff700 1 -- 172.21.15.154:0/3786213853 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8b1801ca20 con 0x7f8b24094c40 2023-09-30T22:19:44.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.032+0000 7f8b0bfff700 1 -- 172.21.15.154:0/3786213853 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8b1803c6b0 con 0x7f8b24094c40 2023-09-30T22:19:44.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.032+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2405a260 con 0x7f8b24094c40 2023-09-30T22:19:44.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.037+0000 7f8b0bfff700 1 -- 172.21.15.154:0/3786213853 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8b18020070 con 0x7f8b24094c40 2023-09-30T22:19:44.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.162+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6b38046c20 con 0x7f6b38093950 2023-09-30T22:19:44.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.162+0000 7f6b2d7fa700 1 -- 172.21.15.154:0/3271548252 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b34028030 con 0x7f6b38093950 2023-09-30T22:19:44.162 INFO:teuthology.orchestra.run.smithi154.stdout:38654705669 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 >> v1:172.21.15.154:6816/118163 conn(0x7f6b1c02bb60 legacy=0x7f6b1c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b38093950 msgr2=0x7f6b3813e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 --2- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b38093950 0x7f6b3813e900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6b3400d5d0 tx=0x7f6b3400b3b0).stop 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 shutdown_connections 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 --2- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b3812d250 0x7f6b38115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 --2- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b38093950 0x7f6b3813e900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 --2- 172.21.15.154:0/3271548252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b38095c50 0x7f6b3813edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 >> 172.21.15.154:0/3271548252 conn(0x7f6b3809aa50 msgr2=0x7f6b38069420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 shutdown_connections 2023-09-30T22:19:44.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.165+0000 7f6b3f2f7700 1 -- 172.21.15.154:0/3271548252 wait complete. 2023-09-30T22:19:44.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2023-09-30T22:19:44.177 DEBUG:teuthology.parallel:result is None 2023-09-30T22:19:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.183+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f77001282e0 con 0x7f77001245e0 2023-09-30T22:19:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.183+0000 7f76f67fc700 1 -- 172.21.15.154:0/1802874274 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76f8015020 con 0x7f77001245e0 2023-09-30T22:19:44.183 INFO:teuthology.orchestra.run.smithi154.stdout:38654705668 2023-09-30T22:19:44.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 >> v1:172.21.15.154:6816/118163 conn(0x7f76e402bb90 legacy=0x7f76e402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77001245e0 msgr2=0x7f7700068bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 --2- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77001245e0 0x7f7700068bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f76f800b6c0 tx=0x7f76f8009780).stop 2023-09-30T22:19:44.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 shutdown_connections 2023-09-30T22:19:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 --2- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77001245e0 0x7f7700068bc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 --2- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7700096400 0x7f7700117850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 --2- 172.21.15.154:0/1802874274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7700124200 0x7f7700123940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 >> 172.21.15.154:0/1802874274 conn(0x7f77000974f0 msgr2=0x7f77001272d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 shutdown_connections 2023-09-30T22:19:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.185+0000 7f7708316700 1 -- 172.21.15.154:0/1802874274 wait complete. 2023-09-30T22:19:44.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.195+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc4fc098dd0 con 0x7fc4fc12c240 2023-09-30T22:19:44.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.196+0000 7fc4e2ffd700 1 -- 172.21.15.154:0/3467196557 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4f401b710 con 0x7fc4fc12c240 2023-09-30T22:19:44.195 INFO:teuthology.orchestra.run.smithi154.stdout:38654705668 2023-09-30T22:19:44.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2023-09-30T22:19:44.198 DEBUG:teuthology.parallel:result is None 2023-09-30T22:19:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 >> v1:172.21.15.154:6816/118163 conn(0x7fc4e802bb60 legacy=0x7fc4e802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4fc12c240 msgr2=0x7fc4fc116180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4fc12c240 0x7fc4fc116180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc4f400c7c0 tx=0x7fc4f4007f10).stop 2023-09-30T22:19:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 shutdown_connections 2023-09-30T22:19:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4fc12c240 0x7fc4fc116180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4fc093950 0x7fc4fc12bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 --2- 172.21.15.154:0/3467196557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4fc095c50 0x7fc4fc115c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 >> 172.21.15.154:0/3467196557 conn(0x7fc4fc09aa50 msgr2=0x7fc4fc0693d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 shutdown_connections 2023-09-30T22:19:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.198+0000 7fc5012bb700 1 -- 172.21.15.154:0/3467196557 wait complete. 2023-09-30T22:19:44.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2023-09-30T22:19:44.209 DEBUG:teuthology.parallel:result is None 2023-09-30T22:19:44.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.234+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b24095ef0 con 0x7f8b24094c40 2023-09-30T22:19:44.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.234+0000 7f8b0bfff700 1 -- 172.21.15.154:0/3786213853 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b18020020 con 0x7f8b24094c40 2023-09-30T22:19:44.234 INFO:teuthology.orchestra.run.smithi154.stdout:38654705668 2023-09-30T22:19:44.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 >> v1:172.21.15.154:6816/118163 conn(0x7f8b1002bb90 legacy=0x7f8b1002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b24094c40 msgr2=0x7f8b24064b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b24094c40 0x7f8b24064b90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8b18014000 tx=0x7f8b18017000).stop 2023-09-30T22:19:44.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 shutdown_connections 2023-09-30T22:19:44.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8b240972b0 0x7f8b24065080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b24093980 0x7f8b240646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 --2- 172.21.15.154:0/3786213853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b24094c40 0x7f8b24064b90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 >> 172.21.15.154:0/3786213853 conn(0x7f8b2409bba0 msgr2=0x7f8b24098680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 shutdown_connections 2023-09-30T22:19:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.236+0000 7f8b2a9f4700 1 -- 172.21.15.154:0/3786213853 wait complete. 2023-09-30T22:19:44.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.3 2023-09-30T22:19:44.248 DEBUG:teuthology.parallel:result is None 2023-09-30T22:19:44.248 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:19:44.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:19:44.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.404+0000 7fa4687d5700 1 Processor -- start 2023-09-30T22:19:44.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.404+0000 7fa4687d5700 1 -- start start 2023-09-30T22:19:44.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa4687d5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460093950 0x7fa460095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa4687d5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa460095c50 0x7fa460096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa4687d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa46012c240 0x7fa46012e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa4687d5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa460094ba0 con 0x7fa460095c50 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa4687d5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa460092e90 con 0x7fa460093950 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa4687d5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa460096b60 con 0x7fa46012c240 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa465d70700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa460095c50 0x7fa460096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466d72700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa46012c240 0x7fa46012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466571700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460093950 0x7fa460095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa465d70700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa460095c50 0x7fa460096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37284/0 (socket says 172.21.15.154:37284) 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466d72700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa46012c240 0x7fa46012e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60120/0 (socket says 172.21.15.154:60120) 2023-09-30T22:19:44.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa465d70700 1 -- 172.21.15.154:0/3249958709 learned_addr learned my addr 172.21.15.154:0/3249958709 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466571700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460093950 0x7fa460095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54446/0 (socket says 172.21.15.154:54446) 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466571700 1 -- 172.21.15.154:0/3249958709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa46012c240 msgr2=0x7fa46012e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466571700 1 --2- 172.21.15.154:0/3249958709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa46012c240 0x7fa46012e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466571700 1 -- 172.21.15.154:0/3249958709 >> v2:172.21.15.154:3300/0 conn(0x7fa460095c50 msgr2=0x7fa460096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466571700 1 --2- 172.21.15.154:0/3249958709 >> v2:172.21.15.154:3300/0 conn(0x7fa460095c50 0x7fa460096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466571700 1 -- 172.21.15.154:0/3249958709 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460093150 con 0x7fa460093950 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa465d70700 1 --2- 172.21.15.154:0/3249958709 >> v2:172.21.15.154:3300/0 conn(0x7fa460095c50 0x7fa460096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa466571700 1 --2- 172.21.15.154:0/3249958709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460093950 0x7fa460095760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa450009760 tx=0x7fa450009060).ready entity=mon.1 client_cookie=6edae2e48d623d81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.405+0000 7fa46556f700 1 -- 172.21.15.154:0/3249958709 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4500090d0 con 0x7fa460093950 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa46556f700 1 -- 172.21.15.154:0/3249958709 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000f6b0 con 0x7fa460093950 2023-09-30T22:19:44.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa46556f700 1 -- 172.21.15.154:0/3249958709 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000fa30 con 0x7fa460093950 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa4687d5700 1 -- 172.21.15.154:0/3249958709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460093950 msgr2=0x7fa460095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa4687d5700 1 --2- 172.21.15.154:0/3249958709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460093950 0x7fa460095760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa450009760 tx=0x7fa450009060).stop 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa4687d5700 1 -- 172.21.15.154:0/3249958709 shutdown_connections 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa4687d5700 1 --2- 172.21.15.154:0/3249958709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460093950 0x7fa460095760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa4687d5700 1 --2- 172.21.15.154:0/3249958709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa46012c240 0x7fa46012e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa4687d5700 1 --2- 172.21.15.154:0/3249958709 >> v2:172.21.15.154:3300/0 conn(0x7fa460095c50 0x7fa460096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa4687d5700 1 -- 172.21.15.154:0/3249958709 >> 172.21.15.154:0/3249958709 conn(0x7fa46009aa50 msgr2=0x7fa46009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa4687d5700 1 -- 172.21.15.154:0/3249958709 shutdown_connections 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.406+0000 7fa4687d5700 1 -- 172.21.15.154:0/3249958709 wait complete. 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.407+0000 7fa4687d5700 1 Processor -- start 2023-09-30T22:19:44.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.407+0000 7fa4687d5700 1 -- start start 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.407+0000 7fa4687d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa460093950 0x7fa46012bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.407+0000 7fa4687d5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460095c50 0x7fa460115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.407+0000 7fa4687d5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa46012c240 0x7fa4601160a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.407+0000 7fa4687d5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa460097ff0 con 0x7fa46012c240 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.407+0000 7fa4687d5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa460092410 con 0x7fa460095c50 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.407+0000 7fa4687d5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa460119c50 con 0x7fa460093950 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466571700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa460093950 0x7fa46012bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466571700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa460093950 0x7fa46012bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60122/0 (socket says 172.21.15.154:60122) 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466571700 1 -- 172.21.15.154:0/2507580722 learned_addr learned my addr 172.21.15.154:0/2507580722 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:44.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa465d70700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460095c50 0x7fa460115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466d72700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa46012c240 0x7fa4601160a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466571700 1 -- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460095c50 msgr2=0x7fa460115bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466571700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460095c50 0x7fa460115bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466571700 1 -- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa46012c240 msgr2=0x7fa4601160a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466571700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa46012c240 0x7fa4601160a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466571700 1 -- 172.21.15.154:0/2507580722 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c009370 con 0x7fa460093950 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa465d70700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460095c50 0x7fa460115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa466571700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa460093950 0x7fa46012bc70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa450010fd0 tx=0x7fa450018000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa4567fc700 1 -- 172.21.15.154:0/2507580722 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450006990 con 0x7fa460093950 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa4567fc700 1 -- 172.21.15.154:0/2507580722 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000f820 con 0x7fa460093950 2023-09-30T22:19:44.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa4567fc700 1 -- 172.21.15.154:0/2507580722 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450019450 con 0x7fa460093950 2023-09-30T22:19:44.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4500092a0 con 0x7fa460093950 2023-09-30T22:19:44.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.408+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa460116fb0 con 0x7fa460093950 2023-09-30T22:19:44.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.409+0000 7fa4567fc700 1 -- 172.21.15.154:0/2507580722 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa450019880 con 0x7fa460093950 2023-09-30T22:19:44.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.409+0000 7fa4567fc700 1 -- 172.21.15.154:0/2507580722 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa45003e3d0 con 0x7fa460093950 2023-09-30T22:19:44.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.409+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46005a260 con 0x7fa460093950 2023-09-30T22:19:44.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.414+0000 7fa4567fc700 1 -- 172.21.15.154:0/2507580722 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa450014080 con 0x7fa460093950 2023-09-30T22:19:44.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.567+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 --> v1:172.21.15.154:6816/118163 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa460119310 con 0x7fa44402bb30 2023-09-30T22:19:44.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.574+0000 7fa4567fc700 1 -- 172.21.15.154:0/2507580722 <== mgr.4101 v1:172.21.15.154:6816/118163 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249918 (unknown 2965378022 0 2531648833) 0x7fa45c009d00 con 0x7fa44402bb30 2023-09-30T22:19:44.576 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:44.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.576+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 >> v1:172.21.15.154:6816/118163 conn(0x7fa44402bb30 legacy=0x7fa44402dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.577+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa460093950 msgr2=0x7fa46012bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.577+0000 7fa4687d5700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa460093950 0x7fa46012bc70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa450010fd0 tx=0x7fa450018000).stop 2023-09-30T22:19:44.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.577+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 shutdown_connections 2023-09-30T22:19:44.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.577+0000 7fa4687d5700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa46012c240 0x7fa4601160a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.577+0000 7fa4687d5700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa460093950 0x7fa46012bc70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.577+0000 7fa4687d5700 1 --2- 172.21.15.154:0/2507580722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa460095c50 0x7fa460115bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.577+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 >> 172.21.15.154:0/2507580722 conn(0x7fa46009aa50 msgr2=0x7fa4600695d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.577+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 shutdown_connections 2023-09-30T22:19:44.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.577+0000 7fa4687d5700 1 -- 172.21.15.154:0/2507580722 wait complete. 2023-09-30T22:19:44.579 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-09-30T22:19:44.588 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-09-30T22:19:43.215232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188992,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298368,"statfs":{"total":386547056640,"available":385329528832,"internally_reserved":0,"allocated":622592,"data_stored":182668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000877"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667917+0000","last_change":"2023-09-30T22:19:33.658237+0000","last_active":"2023-09-30T22:19:33.667917+0000","last_peered":"2023-09-30T22:19:33.667917+0000","last_clean":"2023-09-30T22:19:33.667917+0000","last_became_active":"2023-09-30T22:19:33.657934+0000","last_became_peered":"2023-09-30T22:19:33.657934+0000","last_unstale":"2023-09-30T22:19:33.667917+0000","last_undegraded":"2023-09-30T22:19:33.667917+0000","last_fullsized":"2023-09-30T22:19:33.667917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.648635+0000","last_change":"2023-09-30T22:19:33.644960+0000","last_active":"2023-09-30T22:19:33.648635+0000","last_peered":"2023-09-30T22:19:33.648635+0000","last_clean":"2023-09-30T22:19:33.648635+0000","last_became_active":"2023-09-30T22:19:33.644714+0000","last_became_peered":"2023-09-30T22:19:33.644714+0000","last_unstale":"2023-09-30T22:19:33.648635+0000","last_undegraded":"2023-09-30T22:19:33.648635+0000","last_fullsized":"2023-09-30T22:19:33.648635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658820+0000","last_change":"2023-09-30T22:19:33.647352+0000","last_active":"2023-09-30T22:19:33.658820+0000","last_peered":"2023-09-30T22:19:33.658820+0000","last_clean":"2023-09-30T22:19:33.658820+0000","last_became_active":"2023-09-30T22:19:33.647023+0000","last_became_peered":"2023-09-30T22:19:33.647023+0000","last_unstale":"2023-09-30T22:19:33.658820+0000","last_undegraded":"2023-09-30T22:19:33.658820+0000","last_fullsized":"2023-09-30T22:19:33.658820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657478+0000","last_change":"2023-09-30T22:19:33.645394+0000","last_active":"2023-09-30T22:19:33.657478+0000","last_peered":"2023-09-30T22:19:33.657478+0000","last_clean":"2023-09-30T22:19:33.657478+0000","last_became_active":"2023-09-30T22:19:33.645211+0000","last_became_peered":"2023-09-30T22:19:33.645211+0000","last_unstale":"2023-09-30T22:19:33.657478+0000","last_undegraded":"2023-09-30T22:19:33.657478+0000","last_fullsized":"2023-09-30T22:19:33.657478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658933+0000","last_change":"2023-09-30T22:19:33.651418+0000","last_active":"2023-09-30T22:19:33.658933+0000","last_peered":"2023-09-30T22:19:33.658933+0000","last_clean":"2023-09-30T22:19:33.658933+0000","last_became_active":"2023-09-30T22:19:33.651174+0000","last_became_peered":"2023-09-30T22:19:33.651174+0000","last_unstale":"2023-09-30T22:19:33.658933+0000","last_undegraded":"2023-09-30T22:19:33.658933+0000","last_fullsized":"2023-09-30T22:19:33.658933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677670+0000","last_change":"2023-09-30T22:19:33.671906+0000","last_active":"2023-09-30T22:19:33.677670+0000","last_peered":"2023-09-30T22:19:33.677670+0000","last_clean":"2023-09-30T22:19:33.677670+0000","last_became_active":"2023-09-30T22:19:33.671528+0000","last_became_peered":"2023-09-30T22:19:33.671528+0000","last_unstale":"2023-09-30T22:19:33.677670+0000","last_undegraded":"2023-09-30T22:19:33.677670+0000","last_fullsized":"2023-09-30T22:19:33.677670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677711+0000","last_change":"2023-09-30T22:19:33.670986+0000","last_active":"2023-09-30T22:19:33.677711+0000","last_peered":"2023-09-30T22:19:33.677711+0000","last_clean":"2023-09-30T22:19:33.677711+0000","last_became_active":"2023-09-30T22:19:33.670689+0000","last_became_peered":"2023-09-30T22:19:33.670689+0000","last_unstale":"2023-09-30T22:19:33.677711+0000","last_undegraded":"2023-09-30T22:19:33.677711+0000","last_fullsized":"2023-09-30T22:19:33.677711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666921+0000","last_change":"2023-09-30T22:19:33.654626+0000","last_active":"2023-09-30T22:19:33.666921+0000","last_peered":"2023-09-30T22:19:33.666921+0000","last_clean":"2023-09-30T22:19:33.666921+0000","last_became_active":"2023-09-30T22:19:33.654358+0000","last_became_peered":"2023-09-30T22:19:33.654358+0000","last_unstale":"2023-09-30T22:19:33.666921+0000","last_undegraded":"2023-09-30T22:19:33.666921+0000","last_fullsized":"2023-09-30T22:19:33.666921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660001+0000","last_change":"2023-09-30T22:19:33.648775+0000","last_active":"2023-09-30T22:19:33.660001+0000","last_peered":"2023-09-30T22:19:33.660001+0000","last_clean":"2023-09-30T22:19:33.660001+0000","last_became_active":"2023-09-30T22:19:33.648386+0000","last_became_peered":"2023-09-30T22:19:33.648386+0000","last_unstale":"2023-09-30T22:19:33.660001+0000","last_undegraded":"2023-09-30T22:19:33.660001+0000","last_fullsized":"2023-09-30T22:19:33.660001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.669534+0000","last_change":"2023-09-30T22:19:33.667764+0000","last_active":"2023-09-30T22:19:33.669534+0000","last_peered":"2023-09-30T22:19:33.669534+0000","last_clean":"2023-09-30T22:19:33.669534+0000","last_became_active":"2023-09-30T22:19:33.667514+0000","last_became_peered":"2023-09-30T22:19:33.667514+0000","last_unstale":"2023-09-30T22:19:33.669534+0000","last_undegraded":"2023-09-30T22:19:33.669534+0000","last_fullsized":"2023-09-30T22:19:33.669534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666903+0000","last_change":"2023-09-30T22:19:33.657292+0000","last_active":"2023-09-30T22:19:33.666903+0000","last_peered":"2023-09-30T22:19:33.666903+0000","last_clean":"2023-09-30T22:19:33.666903+0000","last_became_active":"2023-09-30T22:19:33.656706+0000","last_became_peered":"2023-09-30T22:19:33.656706+0000","last_unstale":"2023-09-30T22:19:33.666903+0000","last_undegraded":"2023-09-30T22:19:33.666903+0000","last_fullsized":"2023-09-30T22:19:33.666903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.669940+0000","last_change":"2023-09-30T22:19:33.658823+0000","last_active":"2023-09-30T22:19:33.669940+0000","last_peered":"2023-09-30T22:19:33.669940+0000","last_clean":"2023-09-30T22:19:33.669940+0000","last_became_active":"2023-09-30T22:19:33.658537+0000","last_became_peered":"2023-09-30T22:19:33.658537+0000","last_unstale":"2023-09-30T22:19:33.669940+0000","last_undegraded":"2023-09-30T22:19:33.669940+0000","last_fullsized":"2023-09-30T22:19:33.669940+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670391+0000","last_change":"2023-09-30T22:19:33.665830+0000","last_active":"2023-09-30T22:19:33.670391+0000","last_peered":"2023-09-30T22:19:33.670391+0000","last_clean":"2023-09-30T22:19:33.670391+0000","last_became_active":"2023-09-30T22:19:33.665391+0000","last_became_peered":"2023-09-30T22:19:33.665391+0000","last_unstale":"2023-09-30T22:19:33.670391+0000","last_undegraded":"2023-09-30T22:19:33.670391+0000","last_fullsized":"2023-09-30T22:19:33.670391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657540+0000","last_change":"2023-09-30T22:19:33.652240+0000","last_active":"2023-09-30T22:19:33.657540+0000","last_peered":"2023-09-30T22:19:33.657540+0000","last_clean":"2023-09-30T22:19:33.657540+0000","last_became_active":"2023-09-30T22:19:33.651971+0000","last_became_peered":"2023-09-30T22:19:33.651971+0000","last_unstale":"2023-09-30T22:19:33.657540+0000","last_undegraded":"2023-09-30T22:19:33.657540+0000","last_fullsized":"2023-09-30T22:19:33.657540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658251+0000","last_change":"2023-09-30T22:19:33.645322+0000","last_active":"2023-09-30T22:19:33.658251+0000","last_peered":"2023-09-30T22:19:33.658251+0000","last_clean":"2023-09-30T22:19:33.658251+0000","last_became_active":"2023-09-30T22:19:33.645012+0000","last_became_peered":"2023-09-30T22:19:33.645012+0000","last_unstale":"2023-09-30T22:19:33.658251+0000","last_undegraded":"2023-09-30T22:19:33.658251+0000","last_fullsized":"2023-09-30T22:19:33.658251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672567+0000","last_change":"2023-09-30T22:19:33.662012+0000","last_active":"2023-09-30T22:19:33.672567+0000","last_peered":"2023-09-30T22:19:33.672567+0000","last_clean":"2023-09-30T22:19:33.672567+0000","last_became_active":"2023-09-30T22:19:33.661750+0000","last_became_peered":"2023-09-30T22:19:33.661750+0000","last_unstale":"2023-09-30T22:19:33.672567+0000","last_undegraded":"2023-09-30T22:19:33.672567+0000","last_fullsized":"2023-09-30T22:19:33.672567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.659984+0000","last_change":"2023-09-30T22:19:33.648614+0000","last_active":"2023-09-30T22:19:33.659984+0000","last_peered":"2023-09-30T22:19:33.659984+0000","last_clean":"2023-09-30T22:19:33.659984+0000","last_became_active":"2023-09-30T22:19:33.648081+0000","last_became_peered":"2023-09-30T22:19:33.648081+0000","last_unstale":"2023-09-30T22:19:33.659984+0000","last_undegraded":"2023-09-30T22:19:33.659984+0000","last_fullsized":"2023-09-30T22:19:33.659984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649103+0000","last_change":"2023-09-30T22:19:33.639423+0000","last_active":"2023-09-30T22:19:33.649103+0000","last_peered":"2023-09-30T22:19:33.649103+0000","last_clean":"2023-09-30T22:19:33.649103+0000","last_became_active":"2023-09-30T22:19:33.639112+0000","last_became_peered":"2023-09-30T22:19:33.639112+0000","last_unstale":"2023-09-30T22:19:33.649103+0000","last_undegraded":"2023-09-30T22:19:33.649103+0000","last_fullsized":"2023-09-30T22:19:33.649103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667889+0000","last_change":"2023-09-30T22:19:33.658136+0000","last_active":"2023-09-30T22:19:33.667889+0000","last_peered":"2023-09-30T22:19:33.667889+0000","last_clean":"2023-09-30T22:19:33.667889+0000","last_became_active":"2023-09-30T22:19:33.657838+0000","last_became_peered":"2023-09-30T22:19:33.657838+0000","last_unstale":"2023-09-30T22:19:33.667889+0000","last_undegraded":"2023-09-30T22:19:33.667889+0000","last_fullsized":"2023-09-30T22:19:33.667889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655280+0000","last_change":"2023-09-30T22:19:33.650438+0000","last_active":"2023-09-30T22:19:33.655280+0000","last_peered":"2023-09-30T22:19:33.655280+0000","last_clean":"2023-09-30T22:19:33.655280+0000","last_became_active":"2023-09-30T22:19:33.650186+0000","last_became_peered":"2023-09-30T22:19:33.650186+0000","last_unstale":"2023-09-30T22:19:33.655280+0000","last_undegraded":"2023-09-30T22:19:33.655280+0000","last_fullsized":"2023-09-30T22:19:33.655280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667116+0000","last_change":"2023-09-30T22:19:33.663045+0000","last_active":"2023-09-30T22:19:33.667116+0000","last_peered":"2023-09-30T22:19:33.667116+0000","last_clean":"2023-09-30T22:19:33.667116+0000","last_became_active":"2023-09-30T22:19:33.662782+0000","last_became_peered":"2023-09-30T22:19:33.662782+0000","last_unstale":"2023-09-30T22:19:33.667116+0000","last_undegraded":"2023-09-30T22:19:33.667116+0000","last_fullsized":"2023-09-30T22:19:33.667116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657346+0000","last_change":"2023-09-30T22:19:33.645247+0000","last_active":"2023-09-30T22:19:33.657346+0000","last_peered":"2023-09-30T22:19:33.657346+0000","last_clean":"2023-09-30T22:19:33.657346+0000","last_became_active":"2023-09-30T22:19:33.644963+0000","last_became_peered":"2023-09-30T22:19:33.644963+0000","last_unstale":"2023-09-30T22:19:33.657346+0000","last_undegraded":"2023-09-30T22:19:33.657346+0000","last_fullsized":"2023-09-30T22:19:33.657346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672937+0000","last_change":"2023-09-30T22:19:33.662935+0000","last_active":"2023-09-30T22:19:33.672937+0000","last_peered":"2023-09-30T22:19:33.672937+0000","last_clean":"2023-09-30T22:19:33.672937+0000","last_became_active":"2023-09-30T22:19:33.662255+0000","last_became_peered":"2023-09-30T22:19:33.662255+0000","last_unstale":"2023-09-30T22:19:33.672937+0000","last_undegraded":"2023-09-30T22:19:33.672937+0000","last_fullsized":"2023-09-30T22:19:33.672937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.661530+0000","last_change":"2023-09-30T22:19:33.652392+0000","last_active":"2023-09-30T22:19:33.661530+0000","last_peered":"2023-09-30T22:19:33.661530+0000","last_clean":"2023-09-30T22:19:33.661530+0000","last_became_active":"2023-09-30T22:19:33.652097+0000","last_became_peered":"2023-09-30T22:19:33.652097+0000","last_unstale":"2023-09-30T22:19:33.661530+0000","last_undegraded":"2023-09-30T22:19:33.661530+0000","last_fullsized":"2023-09-30T22:19:33.661530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655129+0000","last_change":"2023-09-30T22:19:33.649799+0000","last_active":"2023-09-30T22:19:33.655129+0000","last_peered":"2023-09-30T22:19:33.655129+0000","last_clean":"2023-09-30T22:19:33.655129+0000","last_became_active":"2023-09-30T22:19:33.649512+0000","last_became_peered":"2023-09-30T22:19:33.649512+0000","last_unstale":"2023-09-30T22:19:33.655129+0000","last_undegraded":"2023-09-30T22:19:33.655129+0000","last_fullsized":"2023-09-30T22:19:33.655129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666815+0000","last_change":"2023-09-30T22:19:33.653148+0000","last_active":"2023-09-30T22:19:33.666815+0000","last_peered":"2023-09-30T22:19:33.666815+0000","last_clean":"2023-09-30T22:19:33.666815+0000","last_became_active":"2023-09-30T22:19:33.652806+0000","last_became_peered":"2023-09-30T22:19:33.652806+0000","last_unstale":"2023-09-30T22:19:33.666815+0000","last_undegraded":"2023-09-30T22:19:33.666815+0000","last_fullsized":"2023-09-30T22:19:33.666815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677757+0000","last_change":"2023-09-30T22:19:33.673663+0000","last_active":"2023-09-30T22:19:33.677757+0000","last_peered":"2023-09-30T22:19:33.677757+0000","last_clean":"2023-09-30T22:19:33.677757+0000","last_became_active":"2023-09-30T22:19:33.673128+0000","last_became_peered":"2023-09-30T22:19:33.673128+0000","last_unstale":"2023-09-30T22:19:33.677757+0000","last_undegraded":"2023-09-30T22:19:33.677757+0000","last_fullsized":"2023-09-30T22:19:33.677757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655301+0000","last_change":"2023-09-30T22:19:33.280425+0000","last_active":"2023-09-30T22:19:33.655301+0000","last_peered":"2023-09-30T22:19:33.655301+0000","last_clean":"2023-09-30T22:19:33.655301+0000","last_became_active":"2023-09-30T22:19:33.280161+0000","last_became_peered":"2023-09-30T22:19:33.280161+0000","last_unstale":"2023-09-30T22:19:33.655301+0000","last_undegraded":"2023-09-30T22:19:33.655301+0000","last_fullsized":"2023-09-30T22:19:33.655301+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677578+0000","last_change":"2023-09-30T22:19:33.670909+0000","last_active":"2023-09-30T22:19:33.677578+0000","last_peered":"2023-09-30T22:19:33.677578+0000","last_clean":"2023-09-30T22:19:33.677578+0000","last_became_active":"2023-09-30T22:19:33.670616+0000","last_became_peered":"2023-09-30T22:19:33.670616+0000","last_unstale":"2023-09-30T22:19:33.677578+0000","last_undegraded":"2023-09-30T22:19:33.677578+0000","last_fullsized":"2023-09-30T22:19:33.677578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.634886+0000","last_change":"2023-09-30T22:19:33.284384+0000","last_active":"2023-09-30T22:19:33.634886+0000","last_peered":"2023-09-30T22:19:33.634886+0000","last_clean":"2023-09-30T22:19:33.634886+0000","last_became_active":"2023-09-30T22:19:33.284138+0000","last_became_peered":"2023-09-30T22:19:33.284138+0000","last_unstale":"2023-09-30T22:19:33.634886+0000","last_undegraded":"2023-09-30T22:19:33.634886+0000","last_fullsized":"2023-09-30T22:19:33.634886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660115+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:19:33.660115+0000","last_peered":"2023-09-30T22:19:33.660115+0000","last_clean":"2023-09-30T22:19:33.660115+0000","last_became_active":"2023-09-30T22:19:33.646355+0000","last_became_peered":"2023-09-30T22:19:33.646355+0000","last_unstale":"2023-09-30T22:19:33.660115+0000","last_undegraded":"2023-09-30T22:19:33.660115+0000","last_fullsized":"2023-09-30T22:19:33.660115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.644148+0000","last_change":"2023-09-30T22:19:33.289402+0000","last_active":"2023-09-30T22:19:33.644148+0000","last_peered":"2023-09-30T22:19:33.644148+0000","last_clean":"2023-09-30T22:19:33.644148+0000","last_became_active":"2023-09-30T22:19:33.288979+0000","last_became_peered":"2023-09-30T22:19:33.288979+0000","last_unstale":"2023-09-30T22:19:33.644148+0000","last_undegraded":"2023-09-30T22:19:33.644148+0000","last_fullsized":"2023-09-30T22:19:33.644148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677702+0000","last_change":"2023-09-30T22:19:33.672854+0000","last_active":"2023-09-30T22:19:33.677702+0000","last_peered":"2023-09-30T22:19:33.677702+0000","last_clean":"2023-09-30T22:19:33.677702+0000","last_became_active":"2023-09-30T22:19:33.672539+0000","last_became_peered":"2023-09-30T22:19:33.672539+0000","last_unstale":"2023-09-30T22:19:33.677702+0000","last_undegraded":"2023-09-30T22:19:33.677702+0000","last_fullsized":"2023-09-30T22:19:33.677702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629757+0000","last_change":"2023-09-30T22:19:33.294805+0000","last_active":"2023-09-30T22:19:33.629757+0000","last_peered":"2023-09-30T22:19:33.629757+0000","last_clean":"2023-09-30T22:19:33.629757+0000","last_became_active":"2023-09-30T22:19:33.294520+0000","last_became_peered":"2023-09-30T22:19:33.294520+0000","last_unstale":"2023-09-30T22:19:33.629757+0000","last_undegraded":"2023-09-30T22:19:33.629757+0000","last_fullsized":"2023-09-30T22:19:33.629757+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.671624+0000","last_change":"2023-09-30T22:19:33.660684+0000","last_active":"2023-09-30T22:19:33.671624+0000","last_peered":"2023-09-30T22:19:33.671624+0000","last_clean":"2023-09-30T22:19:33.671624+0000","last_became_active":"2023-09-30T22:19:33.660143+0000","last_became_peered":"2023-09-30T22:19:33.660143+0000","last_unstale":"2023-09-30T22:19:33.671624+0000","last_undegraded":"2023-09-30T22:19:33.671624+0000","last_fullsized":"2023-09-30T22:19:33.671624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.633284+0000","last_change":"2023-09-30T22:19:33.279060+0000","last_active":"2023-09-30T22:19:33.633284+0000","last_peered":"2023-09-30T22:19:33.633284+0000","last_clean":"2023-09-30T22:19:33.633284+0000","last_became_active":"2023-09-30T22:19:33.278776+0000","last_became_peered":"2023-09-30T22:19:33.278776+0000","last_unstale":"2023-09-30T22:19:33.633284+0000","last_undegraded":"2023-09-30T22:19:33.633284+0000","last_fullsized":"2023-09-30T22:19:33.633284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672955+0000","last_change":"2023-09-30T22:19:33.662982+0000","last_active":"2023-09-30T22:19:33.672955+0000","last_peered":"2023-09-30T22:19:33.672955+0000","last_clean":"2023-09-30T22:19:33.672955+0000","last_became_active":"2023-09-30T22:19:33.662668+0000","last_became_peered":"2023-09-30T22:19:33.662668+0000","last_unstale":"2023-09-30T22:19:33.672955+0000","last_undegraded":"2023-09-30T22:19:33.672955+0000","last_fullsized":"2023-09-30T22:19:33.672955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658775+0000","last_change":"2023-09-30T22:19:33.288428+0000","last_active":"2023-09-30T22:19:33.658775+0000","last_peered":"2023-09-30T22:19:33.658775+0000","last_clean":"2023-09-30T22:19:33.658775+0000","last_became_active":"2023-09-30T22:19:33.287975+0000","last_became_peered":"2023-09-30T22:19:33.287975+0000","last_unstale":"2023-09-30T22:19:33.658775+0000","last_undegraded":"2023-09-30T22:19:33.658775+0000","last_fullsized":"2023-09-30T22:19:33.658775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667104+0000","last_change":"2023-09-30T22:19:33.662645+0000","last_active":"2023-09-30T22:19:33.667104+0000","last_peered":"2023-09-30T22:19:33.667104+0000","last_clean":"2023-09-30T22:19:33.667104+0000","last_became_active":"2023-09-30T22:19:33.662371+0000","last_became_peered":"2023-09-30T22:19:33.662371+0000","last_unstale":"2023-09-30T22:19:33.667104+0000","last_undegraded":"2023-09-30T22:19:33.667104+0000","last_fullsized":"2023-09-30T22:19:33.667104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.680286+0000","last_change":"2023-09-30T22:19:33.289061+0000","last_active":"2023-09-30T22:19:33.680286+0000","last_peered":"2023-09-30T22:19:33.680286+0000","last_clean":"2023-09-30T22:19:33.680286+0000","last_became_active":"2023-09-30T22:19:33.288656+0000","last_became_peered":"2023-09-30T22:19:33.288656+0000","last_unstale":"2023-09-30T22:19:33.680286+0000","last_undegraded":"2023-09-30T22:19:33.680286+0000","last_fullsized":"2023-09-30T22:19:33.680286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670408+0000","last_change":"2023-09-30T22:19:33.665863+0000","last_active":"2023-09-30T22:19:33.670408+0000","last_peered":"2023-09-30T22:19:33.670408+0000","last_clean":"2023-09-30T22:19:33.670408+0000","last_became_active":"2023-09-30T22:19:33.665570+0000","last_became_peered":"2023-09-30T22:19:33.665570+0000","last_unstale":"2023-09-30T22:19:33.670408+0000","last_undegraded":"2023-09-30T22:19:33.670408+0000","last_fullsized":"2023-09-30T22:19:33.670408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.673326+0000","last_change":"2023-09-30T22:19:33.296210+0000","last_active":"2023-09-30T22:19:33.673326+0000","last_peered":"2023-09-30T22:19:33.673326+0000","last_clean":"2023-09-30T22:19:33.673326+0000","last_became_active":"2023-09-30T22:19:33.295952+0000","last_became_peered":"2023-09-30T22:19:33.295952+0000","last_unstale":"2023-09-30T22:19:33.673326+0000","last_undegraded":"2023-09-30T22:19:33.673326+0000","last_fullsized":"2023-09-30T22:19:33.673326+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.674965+0000","last_change":"2023-09-30T22:19:33.670730+0000","last_active":"2023-09-30T22:19:33.674965+0000","last_peered":"2023-09-30T22:19:33.674965+0000","last_clean":"2023-09-30T22:19:33.674965+0000","last_became_active":"2023-09-30T22:19:33.670520+0000","last_became_peered":"2023-09-30T22:19:33.670520+0000","last_unstale":"2023-09-30T22:19:33.674965+0000","last_undegraded":"2023-09-30T22:19:33.674965+0000","last_fullsized":"2023-09-30T22:19:33.674965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629387+0000","last_change":"2023-09-30T22:19:33.293117+0000","last_active":"2023-09-30T22:19:33.629387+0000","last_peered":"2023-09-30T22:19:33.629387+0000","last_clean":"2023-09-30T22:19:33.629387+0000","last_became_active":"2023-09-30T22:19:33.288262+0000","last_became_peered":"2023-09-30T22:19:33.288262+0000","last_unstale":"2023-09-30T22:19:33.629387+0000","last_undegraded":"2023-09-30T22:19:33.629387+0000","last_fullsized":"2023-09-30T22:19:33.629387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677773+0000","last_change":"2023-09-30T22:19:33.673816+0000","last_active":"2023-09-30T22:19:33.677773+0000","last_peered":"2023-09-30T22:19:33.677773+0000","last_clean":"2023-09-30T22:19:33.677773+0000","last_became_active":"2023-09-30T22:19:33.673426+0000","last_became_peered":"2023-09-30T22:19:33.673426+0000","last_unstale":"2023-09-30T22:19:33.677773+0000","last_undegraded":"2023-09-30T22:19:33.677773+0000","last_fullsized":"2023-09-30T22:19:33.677773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646927+0000","last_change":"2023-09-30T22:19:33.288441+0000","last_active":"2023-09-30T22:19:33.646927+0000","last_peered":"2023-09-30T22:19:33.646927+0000","last_clean":"2023-09-30T22:19:33.646927+0000","last_became_active":"2023-09-30T22:19:33.288030+0000","last_became_peered":"2023-09-30T22:19:33.288030+0000","last_unstale":"2023-09-30T22:19:33.646927+0000","last_undegraded":"2023-09-30T22:19:33.646927+0000","last_fullsized":"2023-09-30T22:19:33.646927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660131+0000","last_change":"2023-09-30T22:19:33.649224+0000","last_active":"2023-09-30T22:19:33.660131+0000","last_peered":"2023-09-30T22:19:33.660131+0000","last_clean":"2023-09-30T22:19:33.660131+0000","last_became_active":"2023-09-30T22:19:33.648913+0000","last_became_peered":"2023-09-30T22:19:33.648913+0000","last_unstale":"2023-09-30T22:19:33.660131+0000","last_undegraded":"2023-09-30T22:19:33.660131+0000","last_fullsized":"2023-09-30T22:19:33.660131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670116+0000","last_change":"2023-09-30T22:19:33.283730+0000","last_active":"2023-09-30T22:19:33.670116+0000","last_peered":"2023-09-30T22:19:33.670116+0000","last_clean":"2023-09-30T22:19:33.670116+0000","last_became_active":"2023-09-30T22:19:33.282944+0000","last_became_peered":"2023-09-30T22:19:33.282944+0000","last_unstale":"2023-09-30T22:19:33.670116+0000","last_undegraded":"2023-09-30T22:19:33.670116+0000","last_fullsized":"2023-09-30T22:19:33.670116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677682+0000","last_change":"2023-09-30T22:19:33.672354+0000","last_active":"2023-09-30T22:19:33.677682+0000","last_peered":"2023-09-30T22:19:33.677682+0000","last_clean":"2023-09-30T22:19:33.677682+0000","last_became_active":"2023-09-30T22:19:33.672110+0000","last_became_peered":"2023-09-30T22:19:33.672110+0000","last_unstale":"2023-09-30T22:19:33.677682+0000","last_undegraded":"2023-09-30T22:19:33.677682+0000","last_fullsized":"2023-09-30T22:19:33.677682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.659733+0000","last_change":"2023-09-30T22:19:33.293023+0000","last_active":"2023-09-30T22:19:33.659733+0000","last_peered":"2023-09-30T22:19:33.659733+0000","last_clean":"2023-09-30T22:19:33.659733+0000","last_became_active":"2023-09-30T22:19:33.288365+0000","last_became_peered":"2023-09-30T22:19:33.288365+0000","last_unstale":"2023-09-30T22:19:33.659733+0000","last_undegraded":"2023-09-30T22:19:33.659733+0000","last_fullsized":"2023-09-30T22:19:33.659733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672547+0000","last_change":"2023-09-30T22:19:33.661497+0000","last_active":"2023-09-30T22:19:33.672547+0000","last_peered":"2023-09-30T22:19:33.672547+0000","last_clean":"2023-09-30T22:19:33.672547+0000","last_became_active":"2023-09-30T22:19:33.660436+0000","last_became_peered":"2023-09-30T22:19:33.660436+0000","last_unstale":"2023-09-30T22:19:33.672547+0000","last_undegraded":"2023-09-30T22:19:33.672547+0000","last_fullsized":"2023-09-30T22:19:33.672547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.651255+0000","last_change":"2023-09-30T22:19:33.288413+0000","last_active":"2023-09-30T22:19:33.651255+0000","last_peered":"2023-09-30T22:19:33.651255+0000","last_clean":"2023-09-30T22:19:33.651255+0000","last_became_active":"2023-09-30T22:19:33.288151+0000","last_became_peered":"2023-09-30T22:19:33.288151+0000","last_unstale":"2023-09-30T22:19:33.651255+0000","last_undegraded":"2023-09-30T22:19:33.651255+0000","last_fullsized":"2023-09-30T22:19:33.651255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667065+0000","last_change":"2023-09-30T22:19:33.662546+0000","last_active":"2023-09-30T22:19:33.667065+0000","last_peered":"2023-09-30T22:19:33.667065+0000","last_clean":"2023-09-30T22:19:33.667065+0000","last_became_active":"2023-09-30T22:19:33.662214+0000","last_became_peered":"2023-09-30T22:19:33.662214+0000","last_unstale":"2023-09-30T22:19:33.667065+0000","last_undegraded":"2023-09-30T22:19:33.667065+0000","last_fullsized":"2023-09-30T22:19:33.667065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672306+0000","last_change":"2023-09-30T22:19:33.291431+0000","last_active":"2023-09-30T22:19:33.672306+0000","last_peered":"2023-09-30T22:19:33.672306+0000","last_clean":"2023-09-30T22:19:33.672306+0000","last_became_active":"2023-09-30T22:19:33.290697+0000","last_became_peered":"2023-09-30T22:19:33.290697+0000","last_unstale":"2023-09-30T22:19:33.672306+0000","last_undegraded":"2023-09-30T22:19:33.672306+0000","last_fullsized":"2023-09-30T22:19:33.672306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.669635+0000","last_change":"2023-09-30T22:19:33.658789+0000","last_active":"2023-09-30T22:19:33.669635+0000","last_peered":"2023-09-30T22:19:33.669635+0000","last_clean":"2023-09-30T22:19:33.669635+0000","last_became_active":"2023-09-30T22:19:33.658064+0000","last_became_peered":"2023-09-30T22:19:33.658064+0000","last_unstale":"2023-09-30T22:19:33.669635+0000","last_undegraded":"2023-09-30T22:19:33.669635+0000","last_fullsized":"2023-09-30T22:19:33.669635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629956+0000","last_change":"2023-09-30T22:19:33.286077+0000","last_active":"2023-09-30T22:19:33.629956+0000","last_peered":"2023-09-30T22:19:33.629956+0000","last_clean":"2023-09-30T22:19:33.629956+0000","last_became_active":"2023-09-30T22:19:33.279026+0000","last_became_peered":"2023-09-30T22:19:33.279026+0000","last_unstale":"2023-09-30T22:19:33.629956+0000","last_undegraded":"2023-09-30T22:19:33.629956+0000","last_fullsized":"2023-09-30T22:19:33.629956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658914+0000","last_change":"2023-09-30T22:19:33.647993+0000","last_active":"2023-09-30T22:19:33.658914+0000","last_peered":"2023-09-30T22:19:33.658914+0000","last_clean":"2023-09-30T22:19:33.658914+0000","last_became_active":"2023-09-30T22:19:33.647725+0000","last_became_peered":"2023-09-30T22:19:33.647725+0000","last_unstale":"2023-09-30T22:19:33.658914+0000","last_undegraded":"2023-09-30T22:19:33.658914+0000","last_fullsized":"2023-09-30T22:19:33.658914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.673006+0000","last_change":"2023-09-30T22:19:33.296389+0000","last_active":"2023-09-30T22:19:33.673006+0000","last_peered":"2023-09-30T22:19:33.673006+0000","last_clean":"2023-09-30T22:19:33.673006+0000","last_became_active":"2023-09-30T22:19:33.296134+0000","last_became_peered":"2023-09-30T22:19:33.296134+0000","last_unstale":"2023-09-30T22:19:33.673006+0000","last_undegraded":"2023-09-30T22:19:33.673006+0000","last_fullsized":"2023-09-30T22:19:33.673006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657497+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:19:33.657497+0000","last_peered":"2023-09-30T22:19:33.657497+0000","last_clean":"2023-09-30T22:19:33.657497+0000","last_became_active":"2023-09-30T22:19:33.646503+0000","last_became_peered":"2023-09-30T22:19:33.646503+0000","last_unstale":"2023-09-30T22:19:33.657497+0000","last_undegraded":"2023-09-30T22:19:33.657497+0000","last_fullsized":"2023-09-30T22:19:33.657497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649643+0000","last_change":"2023-09-30T22:19:33.287703+0000","last_active":"2023-09-30T22:19:33.649643+0000","last_peered":"2023-09-30T22:19:33.649643+0000","last_clean":"2023-09-30T22:19:33.649643+0000","last_became_active":"2023-09-30T22:19:33.287403+0000","last_became_peered":"2023-09-30T22:19:33.287403+0000","last_unstale":"2023-09-30T22:19:33.649643+0000","last_undegraded":"2023-09-30T22:19:33.649643+0000","last_fullsized":"2023-09-30T22:19:33.649643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677695+0000","last_change":"2023-09-30T22:19:33.672679+0000","last_active":"2023-09-30T22:19:33.677695+0000","last_peered":"2023-09-30T22:19:33.677695+0000","last_clean":"2023-09-30T22:19:33.677695+0000","last_became_active":"2023-09-30T22:19:33.671069+0000","last_became_peered":"2023-09-30T22:19:33.671069+0000","last_unstale":"2023-09-30T22:19:33.677695+0000","last_undegraded":"2023-09-30T22:19:33.677695+0000","last_fullsized":"2023-09-30T22:19:33.677695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646440+0000","last_change":"2023-09-30T22:19:33.288281+0000","last_active":"2023-09-30T22:19:33.646440+0000","last_peered":"2023-09-30T22:19:33.646440+0000","last_clean":"2023-09-30T22:19:33.646440+0000","last_became_active":"2023-09-30T22:19:33.287697+0000","last_became_peered":"2023-09-30T22:19:33.287697+0000","last_unstale":"2023-09-30T22:19:33.646440+0000","last_undegraded":"2023-09-30T22:19:33.646440+0000","last_fullsized":"2023-09-30T22:19:33.646440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670458+0000","last_change":"2023-09-30T22:19:33.666225+0000","last_active":"2023-09-30T22:19:33.670458+0000","last_peered":"2023-09-30T22:19:33.670458+0000","last_clean":"2023-09-30T22:19:33.670458+0000","last_became_active":"2023-09-30T22:19:33.665223+0000","last_became_peered":"2023-09-30T22:19:33.665223+0000","last_unstale":"2023-09-30T22:19:33.670458+0000","last_undegraded":"2023-09-30T22:19:33.670458+0000","last_fullsized":"2023-09-30T22:19:33.670458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.643940+0000","last_change":"2023-09-30T22:19:33.289238+0000","last_active":"2023-09-30T22:19:33.643940+0000","last_peered":"2023-09-30T22:19:33.643940+0000","last_clean":"2023-09-30T22:19:33.643940+0000","last_became_active":"2023-09-30T22:19:33.288633+0000","last_became_peered":"2023-09-30T22:19:33.288633+0000","last_unstale":"2023-09-30T22:19:33.643940+0000","last_undegraded":"2023-09-30T22:19:33.643940+0000","last_fullsized":"2023-09-30T22:19:33.643940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655152+0000","last_change":"2023-09-30T22:19:33.649869+0000","last_active":"2023-09-30T22:19:33.655152+0000","last_peered":"2023-09-30T22:19:33.655152+0000","last_clean":"2023-09-30T22:19:33.655152+0000","last_became_active":"2023-09-30T22:19:33.649582+0000","last_became_peered":"2023-09-30T22:19:33.649582+0000","last_unstale":"2023-09-30T22:19:33.655152+0000","last_undegraded":"2023-09-30T22:19:33.655152+0000","last_fullsized":"2023-09-30T22:19:33.655152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.638416+0000","last_change":"2023-09-30T22:19:30.188504+0000","last_active":"2023-09-30T22:19:33.638416+0000","last_peered":"2023-09-30T22:19:33.638416+0000","last_clean":"2023-09-30T22:19:33.638416+0000","last_became_active":"2023-09-30T22:19:30.188218+0000","last_became_peered":"2023-09-30T22:19:30.188218+0000","last_unstale":"2023-09-30T22:19:33.638416+0000","last_undegraded":"2023-09-30T22:19:33.638416+0000","last_fullsized":"2023-09-30T22:19:33.638416+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.636797+0000","last_change":"2023-09-30T22:19:33.282597+0000","last_active":"2023-09-30T22:19:33.636797+0000","last_peered":"2023-09-30T22:19:33.636797+0000","last_clean":"2023-09-30T22:19:33.636797+0000","last_became_active":"2023-09-30T22:19:33.280396+0000","last_became_peered":"2023-09-30T22:19:33.280396+0000","last_unstale":"2023-09-30T22:19:33.636797+0000","last_undegraded":"2023-09-30T22:19:33.636797+0000","last_fullsized":"2023-09-30T22:19:33.636797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672752+0000","last_change":"2023-09-30T22:19:33.670732+0000","last_active":"2023-09-30T22:19:33.672752+0000","last_peered":"2023-09-30T22:19:33.672752+0000","last_clean":"2023-09-30T22:19:33.672752+0000","last_became_active":"2023-09-30T22:19:33.670470+0000","last_became_peered":"2023-09-30T22:19:33.670470+0000","last_unstale":"2023-09-30T22:19:33.672752+0000","last_undegraded":"2023-09-30T22:19:33.672752+0000","last_fullsized":"2023-09-30T22:19:33.672752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649555+0000","last_change":"2023-09-30T22:19:29.250128+0000","last_active":"2023-09-30T22:19:33.649555+0000","last_peered":"2023-09-30T22:19:33.649555+0000","last_clean":"2023-09-30T22:19:33.649555+0000","last_became_active":"2023-09-30T22:19:29.249745+0000","last_became_peered":"2023-09-30T22:19:29.249745+0000","last_unstale":"2023-09-30T22:19:33.649555+0000","last_undegraded":"2023-09-30T22:19:33.649555+0000","last_fullsized":"2023-09-30T22:19:33.649555+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.630032+0000","last_change":"2023-09-30T22:19:33.294524+0000","last_active":"2023-09-30T22:19:33.630032+0000","last_peered":"2023-09-30T22:19:33.630032+0000","last_clean":"2023-09-30T22:19:33.630032+0000","last_became_active":"2023-09-30T22:19:33.293937+0000","last_became_peered":"2023-09-30T22:19:33.293937+0000","last_unstale":"2023-09-30T22:19:33.630032+0000","last_undegraded":"2023-09-30T22:19:33.630032+0000","last_fullsized":"2023-09-30T22:19:33.630032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666835+0000","last_change":"2023-09-30T22:19:33.653434+0000","last_active":"2023-09-30T22:19:33.666835+0000","last_peered":"2023-09-30T22:19:33.666835+0000","last_clean":"2023-09-30T22:19:33.666835+0000","last_became_active":"2023-09-30T22:19:33.652629+0000","last_became_peered":"2023-09-30T22:19:33.652629+0000","last_unstale":"2023-09-30T22:19:33.666835+0000","last_undegraded":"2023-09-30T22:19:33.666835+0000","last_fullsized":"2023-09-30T22:19:33.666835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.632600+0000","last_change":"2023-09-30T22:19:29.249638+0000","last_active":"2023-09-30T22:19:33.632600+0000","last_peered":"2023-09-30T22:19:33.632600+0000","last_clean":"2023-09-30T22:19:33.632600+0000","last_became_active":"2023-09-30T22:19:29.249366+0000","last_became_peered":"2023-09-30T22:19:29.249366+0000","last_unstale":"2023-09-30T22:19:33.632600+0000","last_undegraded":"2023-09-30T22:19:33.632600+0000","last_fullsized":"2023-09-30T22:19:33.632600+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.636097+0000","last_change":"2023-09-30T22:19:33.290330+0000","last_active":"2023-09-30T22:19:33.636097+0000","last_peered":"2023-09-30T22:19:33.636097+0000","last_clean":"2023-09-30T22:19:33.636097+0000","last_became_active":"2023-09-30T22:19:33.289841+0000","last_became_peered":"2023-09-30T22:19:33.289841+0000","last_unstale":"2023-09-30T22:19:33.636097+0000","last_undegraded":"2023-09-30T22:19:33.636097+0000","last_fullsized":"2023-09-30T22:19:33.636097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667282+0000","last_change":"2023-09-30T22:19:33.657019+0000","last_active":"2023-09-30T22:19:33.667282+0000","last_peered":"2023-09-30T22:19:33.667282+0000","last_clean":"2023-09-30T22:19:33.667282+0000","last_became_active":"2023-09-30T22:19:33.656759+0000","last_became_peered":"2023-09-30T22:19:33.656759+0000","last_unstale":"2023-09-30T22:19:33.667282+0000","last_undegraded":"2023-09-30T22:19:33.667282+0000","last_fullsized":"2023-09-30T22:19:33.667282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.650158+0000","last_change":"2023-09-30T22:19:29.249647+0000","last_active":"2023-09-30T22:19:33.650158+0000","last_peered":"2023-09-30T22:19:33.650158+0000","last_clean":"2023-09-30T22:19:33.650158+0000","last_became_active":"2023-09-30T22:19:29.249371+0000","last_became_peered":"2023-09-30T22:19:29.249371+0000","last_unstale":"2023-09-30T22:19:33.650158+0000","last_undegraded":"2023-09-30T22:19:33.650158+0000","last_fullsized":"2023-09-30T22:19:33.650158+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.636006+0000","last_change":"2023-09-30T22:19:30.188360+0000","last_active":"2023-09-30T22:19:33.636006+0000","last_peered":"2023-09-30T22:19:33.636006+0000","last_clean":"2023-09-30T22:19:33.636006+0000","last_became_active":"2023-09-30T22:19:30.187849+0000","last_became_peered":"2023-09-30T22:19:30.187849+0000","last_unstale":"2023-09-30T22:19:33.636006+0000","last_undegraded":"2023-09-30T22:19:33.636006+0000","last_fullsized":"2023-09-30T22:19:33.636006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649406+0000","last_change":"2023-09-30T22:19:33.292032+0000","last_active":"2023-09-30T22:19:33.649406+0000","last_peered":"2023-09-30T22:19:33.649406+0000","last_clean":"2023-09-30T22:19:33.649406+0000","last_became_active":"2023-09-30T22:19:33.291755+0000","last_became_peered":"2023-09-30T22:19:33.291755+0000","last_unstale":"2023-09-30T22:19:33.649406+0000","last_undegraded":"2023-09-30T22:19:33.649406+0000","last_fullsized":"2023-09-30T22:19:33.649406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.680227+0000","last_change":"2023-09-30T22:19:33.674909+0000","last_active":"2023-09-30T22:19:33.680227+0000","last_peered":"2023-09-30T22:19:33.680227+0000","last_clean":"2023-09-30T22:19:33.680227+0000","last_became_active":"2023-09-30T22:19:33.674646+0000","last_became_peered":"2023-09-30T22:19:33.674646+0000","last_unstale":"2023-09-30T22:19:33.680227+0000","last_undegraded":"2023-09-30T22:19:33.680227+0000","last_fullsized":"2023-09-30T22:19:33.680227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.644054+0000","last_change":"2023-09-30T22:19:29.250622+0000","last_active":"2023-09-30T22:19:33.644054+0000","last_peered":"2023-09-30T22:19:33.644054+0000","last_clean":"2023-09-30T22:19:33.644054+0000","last_became_active":"2023-09-30T22:19:29.250370+0000","last_became_peered":"2023-09-30T22:19:29.250370+0000","last_unstale":"2023-09-30T22:19:33.644054+0000","last_undegraded":"2023-09-30T22:19:33.644054+0000","last_fullsized":"2023-09-30T22:19:33.644054+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629147+0000","last_change":"2023-09-30T22:19:33.279290+0000","last_active":"2023-09-30T22:19:33.629147+0000","last_peered":"2023-09-30T22:19:33.629147+0000","last_clean":"2023-09-30T22:19:33.629147+0000","last_became_active":"2023-09-30T22:19:33.277328+0000","last_became_peered":"2023-09-30T22:19:33.277328+0000","last_unstale":"2023-09-30T22:19:33.629147+0000","last_undegraded":"2023-09-30T22:19:33.629147+0000","last_fullsized":"2023-09-30T22:19:33.629147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660099+0000","last_change":"2023-09-30T22:19:33.646613+0000","last_active":"2023-09-30T22:19:33.660099+0000","last_peered":"2023-09-30T22:19:33.660099+0000","last_clean":"2023-09-30T22:19:33.660099+0000","last_became_active":"2023-09-30T22:19:33.646057+0000","last_became_peered":"2023-09-30T22:19:33.646057+0000","last_unstale":"2023-09-30T22:19:33.660099+0000","last_undegraded":"2023-09-30T22:19:33.660099+0000","last_fullsized":"2023-09-30T22:19:33.660099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.656110+0000","last_change":"2023-09-30T22:19:30.188159+0000","last_active":"2023-09-30T22:19:33.656110+0000","last_peered":"2023-09-30T22:19:33.656110+0000","last_clean":"2023-09-30T22:19:33.656110+0000","last_became_active":"2023-09-30T22:19:30.187869+0000","last_became_peered":"2023-09-30T22:19:30.187869+0000","last_unstale":"2023-09-30T22:19:33.656110+0000","last_undegraded":"2023-09-30T22:19:33.656110+0000","last_fullsized":"2023-09-30T22:19:33.656110+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.638033+0000","last_change":"2023-09-30T22:19:33.289031+0000","last_active":"2023-09-30T22:19:33.638033+0000","last_peered":"2023-09-30T22:19:33.638033+0000","last_clean":"2023-09-30T22:19:33.638033+0000","last_became_active":"2023-09-30T22:19:33.288758+0000","last_became_peered":"2023-09-30T22:19:33.288758+0000","last_unstale":"2023-09-30T22:19:33.638033+0000","last_undegraded":"2023-09-30T22:19:33.638033+0000","last_fullsized":"2023-09-30T22:19:33.638033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658895+0000","last_change":"2023-09-30T22:19:33.642133+0000","last_active":"2023-09-30T22:19:33.658895+0000","last_peered":"2023-09-30T22:19:33.658895+0000","last_clean":"2023-09-30T22:19:33.658895+0000","last_became_active":"2023-09-30T22:19:33.641852+0000","last_became_peered":"2023-09-30T22:19:33.641852+0000","last_unstale":"2023-09-30T22:19:33.658895+0000","last_undegraded":"2023-09-30T22:19:33.658895+0000","last_fullsized":"2023-09-30T22:19:33.658895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672798+0000","last_change":"2023-09-30T22:19:33.290927+0000","last_active":"2023-09-30T22:19:33.672798+0000","last_peered":"2023-09-30T22:19:33.672798+0000","last_clean":"2023-09-30T22:19:33.672798+0000","last_became_active":"2023-09-30T22:19:33.290662+0000","last_became_peered":"2023-09-30T22:19:33.290662+0000","last_unstale":"2023-09-30T22:19:33.672798+0000","last_undegraded":"2023-09-30T22:19:33.672798+0000","last_fullsized":"2023-09-30T22:19:33.672798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.639243+0000","last_change":"2023-09-30T22:19:30.190576+0000","last_active":"2023-09-30T22:19:33.639243+0000","last_peered":"2023-09-30T22:19:33.639243+0000","last_clean":"2023-09-30T22:19:33.639243+0000","last_became_active":"2023-09-30T22:19:30.190289+0000","last_became_peered":"2023-09-30T22:19:30.190289+0000","last_unstale":"2023-09-30T22:19:33.639243+0000","last_undegraded":"2023-09-30T22:19:33.639243+0000","last_fullsized":"2023-09-30T22:19:33.639243+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.671605+0000","last_change":"2023-09-30T22:19:33.660579+0000","last_active":"2023-09-30T22:19:33.671605+0000","last_peered":"2023-09-30T22:19:33.671605+0000","last_clean":"2023-09-30T22:19:33.671605+0000","last_became_active":"2023-09-30T22:19:33.659849+0000","last_became_peered":"2023-09-30T22:19:33.659849+0000","last_unstale":"2023-09-30T22:19:33.671605+0000","last_undegraded":"2023-09-30T22:19:33.671605+0000","last_fullsized":"2023-09-30T22:19:33.671605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660521+0000","last_change":"2023-09-30T22:19:30.188129+0000","last_active":"2023-09-30T22:19:33.660521+0000","last_peered":"2023-09-30T22:19:33.660521+0000","last_clean":"2023-09-30T22:19:33.660521+0000","last_became_active":"2023-09-30T22:19:30.187818+0000","last_became_peered":"2023-09-30T22:19:30.187818+0000","last_unstale":"2023-09-30T22:19:33.660521+0000","last_undegraded":"2023-09-30T22:19:33.660521+0000","last_fullsized":"2023-09-30T22:19:33.660521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:19:34.629718+0000","last_change":"2023-09-30T22:19:33.296579+0000","last_active":"2023-09-30T22:19:34.629718+0000","last_peered":"2023-09-30T22:19:34.629718+0000","last_clean":"2023-09-30T22:19:34.629718+0000","last_became_active":"2023-09-30T22:19:33.295804+0000","last_became_peered":"2023-09-30T22:19:33.295804+0000","last_unstale":"2023-09-30T22:19:34.629718+0000","last_undegraded":"2023-09-30T22:19:34.629718+0000","last_fullsized":"2023-09-30T22:19:34.629718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646166+0000","last_change":"2023-09-30T22:19:33.642976+0000","last_active":"2023-09-30T22:19:33.646166+0000","last_peered":"2023-09-30T22:19:33.646166+0000","last_clean":"2023-09-30T22:19:33.646166+0000","last_became_active":"2023-09-30T22:19:33.642732+0000","last_became_peered":"2023-09-30T22:19:33.642732+0000","last_unstale":"2023-09-30T22:19:33.646166+0000","last_undegraded":"2023-09-30T22:19:33.646166+0000","last_fullsized":"2023-09-30T22:19:33.646166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.648507+0000","last_change":"2023-09-30T22:19:33.293670+0000","last_active":"2023-09-30T22:19:33.648507+0000","last_peered":"2023-09-30T22:19:33.648507+0000","last_clean":"2023-09-30T22:19:33.648507+0000","last_became_active":"2023-09-30T22:19:33.293179+0000","last_became_peered":"2023-09-30T22:19:33.293179+0000","last_unstale":"2023-09-30T22:19:33.648507+0000","last_undegraded":"2023-09-30T22:19:33.648507+0000","last_fullsized":"2023-09-30T22:19:33.648507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.648053+0000","last_change":"2023-09-30T22:19:33.647280+0000","last_active":"2023-09-30T22:19:33.648053+0000","last_peered":"2023-09-30T22:19:33.648053+0000","last_clean":"2023-09-30T22:19:33.648053+0000","last_became_active":"2023-09-30T22:19:33.646935+0000","last_became_peered":"2023-09-30T22:19:33.646935+0000","last_unstale":"2023-09-30T22:19:33.648053+0000","last_undegraded":"2023-09-30T22:19:33.648053+0000","last_fullsized":"2023-09-30T22:19:33.648053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667484+0000","last_change":"2023-09-30T22:19:33.296231+0000","last_active":"2023-09-30T22:19:33.667484+0000","last_peered":"2023-09-30T22:19:33.667484+0000","last_clean":"2023-09-30T22:19:33.667484+0000","last_became_active":"2023-09-30T22:19:33.295946+0000","last_became_peered":"2023-09-30T22:19:33.295946+0000","last_unstale":"2023-09-30T22:19:33.667484+0000","last_undegraded":"2023-09-30T22:19:33.667484+0000","last_fullsized":"2023-09-30T22:19:33.667484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670372+0000","last_change":"2023-09-30T22:19:33.665656+0000","last_active":"2023-09-30T22:19:33.670372+0000","last_peered":"2023-09-30T22:19:33.670372+0000","last_clean":"2023-09-30T22:19:33.670372+0000","last_became_active":"2023-09-30T22:19:33.658850+0000","last_became_peered":"2023-09-30T22:19:33.658850+0000","last_unstale":"2023-09-30T22:19:33.670372+0000","last_undegraded":"2023-09-30T22:19:33.670372+0000","last_fullsized":"2023-09-30T22:19:33.670372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.673945+0000","last_change":"2023-09-30T22:19:33.291605+0000","last_active":"2023-09-30T22:19:33.673945+0000","last_peered":"2023-09-30T22:19:33.673945+0000","last_clean":"2023-09-30T22:19:33.673945+0000","last_became_active":"2023-09-30T22:19:33.291048+0000","last_became_peered":"2023-09-30T22:19:33.291048+0000","last_unstale":"2023-09-30T22:19:33.673945+0000","last_undegraded":"2023-09-30T22:19:33.673945+0000","last_fullsized":"2023-09-30T22:19:33.673945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646181+0000","last_change":"2023-09-30T22:19:33.643062+0000","last_active":"2023-09-30T22:19:33.646181+0000","last_peered":"2023-09-30T22:19:33.646181+0000","last_clean":"2023-09-30T22:19:33.646181+0000","last_became_active":"2023-09-30T22:19:33.642791+0000","last_became_peered":"2023-09-30T22:19:33.642791+0000","last_unstale":"2023-09-30T22:19:33.646181+0000","last_undegraded":"2023-09-30T22:19:33.646181+0000","last_fullsized":"2023-09-30T22:19:33.646181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.671521+0000","last_change":"2023-09-30T22:19:33.287971+0000","last_active":"2023-09-30T22:19:33.671521+0000","last_peered":"2023-09-30T22:19:33.671521+0000","last_clean":"2023-09-30T22:19:33.671521+0000","last_became_active":"2023-09-30T22:19:33.287720+0000","last_became_peered":"2023-09-30T22:19:33.287720+0000","last_unstale":"2023-09-30T22:19:33.671521+0000","last_undegraded":"2023-09-30T22:19:33.671521+0000","last_fullsized":"2023-09-30T22:19:33.671521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.674944+0000","last_change":"2023-09-30T22:19:33.670264+0000","last_active":"2023-09-30T22:19:33.674944+0000","last_peered":"2023-09-30T22:19:33.674944+0000","last_clean":"2023-09-30T22:19:33.674944+0000","last_became_active":"2023-09-30T22:19:33.670020+0000","last_became_peered":"2023-09-30T22:19:33.670020+0000","last_unstale":"2023-09-30T22:19:33.674944+0000","last_undegraded":"2023-09-30T22:19:33.674944+0000","last_fullsized":"2023-09-30T22:19:33.674944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.659924+0000","last_change":"2023-09-30T22:19:33.293238+0000","last_active":"2023-09-30T22:19:33.659924+0000","last_peered":"2023-09-30T22:19:33.659924+0000","last_clean":"2023-09-30T22:19:33.659924+0000","last_became_active":"2023-09-30T22:19:33.292967+0000","last_became_peered":"2023-09-30T22:19:33.292967+0000","last_unstale":"2023-09-30T22:19:33.659924+0000","last_undegraded":"2023-09-30T22:19:33.659924+0000","last_fullsized":"2023-09-30T22:19:33.659924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646415+0000","last_change":"2023-09-30T22:19:33.641684+0000","last_active":"2023-09-30T22:19:33.646415+0000","last_peered":"2023-09-30T22:19:33.646415+0000","last_clean":"2023-09-30T22:19:33.646415+0000","last_became_active":"2023-09-30T22:19:33.641403+0000","last_became_peered":"2023-09-30T22:19:33.641403+0000","last_unstale":"2023-09-30T22:19:33.646415+0000","last_undegraded":"2023-09-30T22:19:33.646415+0000","last_fullsized":"2023-09-30T22:19:33.646415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.654218+0000","last_change":"2023-09-30T22:19:33.644249+0000","last_active":"2023-09-30T22:19:33.654218+0000","last_peered":"2023-09-30T22:19:33.654218+0000","last_clean":"2023-09-30T22:19:33.654218+0000","last_became_active":"2023-09-30T22:19:33.643987+0000","last_became_peered":"2023-09-30T22:19:33.643987+0000","last_unstale":"2023-09-30T22:19:33.654218+0000","last_undegraded":"2023-09-30T22:19:33.654218+0000","last_fullsized":"2023-09-30T22:19:33.654218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672002+0000","last_change":"2023-09-30T22:19:33.659592+0000","last_active":"2023-09-30T22:19:33.672002+0000","last_peered":"2023-09-30T22:19:33.672002+0000","last_clean":"2023-09-30T22:19:33.672002+0000","last_became_active":"2023-09-30T22:19:33.659324+0000","last_became_peered":"2023-09-30T22:19:33.659324+0000","last_unstale":"2023-09-30T22:19:33.672002+0000","last_undegraded":"2023-09-30T22:19:33.672002+0000","last_fullsized":"2023-09-30T22:19:33.672002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658095+0000","last_change":"2023-09-30T22:19:33.651082+0000","last_active":"2023-09-30T22:19:33.658095+0000","last_peered":"2023-09-30T22:19:33.658095+0000","last_clean":"2023-09-30T22:19:33.658095+0000","last_became_active":"2023-09-30T22:19:33.650784+0000","last_became_peered":"2023-09-30T22:19:33.650784+0000","last_unstale":"2023-09-30T22:19:33.658095+0000","last_undegraded":"2023-09-30T22:19:33.658095+0000","last_fullsized":"2023-09-30T22:19:33.658095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677740+0000","last_change":"2023-09-30T22:19:33.673256+0000","last_active":"2023-09-30T22:19:33.677740+0000","last_peered":"2023-09-30T22:19:33.677740+0000","last_clean":"2023-09-30T22:19:33.677740+0000","last_became_active":"2023-09-30T22:19:33.672980+0000","last_became_peered":"2023-09-30T22:19:33.672980+0000","last_unstale":"2023-09-30T22:19:33.677740+0000","last_undegraded":"2023-09-30T22:19:33.677740+0000","last_fullsized":"2023-09-30T22:19:33.677740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666848+0000","last_change":"2023-09-30T22:19:33.653617+0000","last_active":"2023-09-30T22:19:33.666848+0000","last_peered":"2023-09-30T22:19:33.666848+0000","last_clean":"2023-09-30T22:19:33.666848+0000","last_became_active":"2023-09-30T22:19:33.653009+0000","last_became_peered":"2023-09-30T22:19:33.653009+0000","last_unstale":"2023-09-30T22:19:33.666848+0000","last_undegraded":"2023-09-30T22:19:33.666848+0000","last_fullsized":"2023-09-30T22:19:33.666848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":45214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:19:44.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:19:44.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.745+0000 7f433542d700 1 Processor -- start 2023-09-30T22:19:44.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.745+0000 7f433542d700 1 -- start start 2023-09-30T22:19:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f433542d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f433006a390 0x7f4330127830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f433542d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4330127e10 0x7f4330128210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f433542d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43301241e0 0x7f4330124690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f433542d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4330093d90 con 0x7f4330127e10 2023-09-30T22:19:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f433542d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4330093310 con 0x7f43301241e0 2023-09-30T22:19:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f433542d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4330092e10 con 0x7f433006a390 2023-09-30T22:19:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f433006a390 0x7f4330127830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f433006a390 0x7f4330127830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60130/0 (socket says 172.21.15.154:60130) 2023-09-30T22:19:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432effd700 1 -- 172.21.15.154:0/895070962 learned_addr learned my addr 172.21.15.154:0/895070962 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432e7fc700 1 --2- 172.21.15.154:0/895070962 >> v2:172.21.15.154:3300/0 conn(0x7f4330127e10 0x7f4330128210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432f7fe700 1 --2- 172.21.15.154:0/895070962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43301241e0 0x7f4330124690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432effd700 1 -- 172.21.15.154:0/895070962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43301241e0 msgr2=0x7f4330124690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432effd700 1 --2- 172.21.15.154:0/895070962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43301241e0 0x7f4330124690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432effd700 1 -- 172.21.15.154:0/895070962 >> v2:172.21.15.154:3300/0 conn(0x7f4330127e10 msgr2=0x7f4330128210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432effd700 1 --2- 172.21.15.154:0/895070962 >> v2:172.21.15.154:3300/0 conn(0x7f4330127e10 0x7f4330128210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.746+0000 7f432effd700 1 -- 172.21.15.154:0/895070962 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433006a770 con 0x7f433006a390 2023-09-30T22:19:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.747+0000 7f432e7fc700 1 --2- 172.21.15.154:0/895070962 >> v2:172.21.15.154:3300/0 conn(0x7f4330127e10 0x7f4330128210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.747+0000 7f432effd700 1 --2- 172.21.15.154:0/895070962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f433006a390 0x7f4330127830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f4320006fd0 tx=0x7f43200090f0).ready entity=mon.2 client_cookie=7b85aeeb1d28d986 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f432dffb700 1 -- 172.21.15.154:0/895070962 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000f510 con 0x7f433006a390 2023-09-30T22:19:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f432dffb700 1 -- 172.21.15.154:0/895070962 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432000f670 con 0x7f433006a390 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f432dffb700 1 -- 172.21.15.154:0/895070962 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000fa10 con 0x7f433006a390 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f433542d700 1 -- 172.21.15.154:0/895070962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f433006a390 msgr2=0x7f4330127830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f433542d700 1 --2- 172.21.15.154:0/895070962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f433006a390 0x7f4330127830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f4320006fd0 tx=0x7f43200090f0).stop 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f433542d700 1 -- 172.21.15.154:0/895070962 shutdown_connections 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f433542d700 1 --2- 172.21.15.154:0/895070962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43301241e0 0x7f4330124690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f433542d700 1 --2- 172.21.15.154:0/895070962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f433006a390 0x7f4330127830 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f433542d700 1 --2- 172.21.15.154:0/895070962 >> v2:172.21.15.154:3300/0 conn(0x7f4330127e10 0x7f4330128210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f433542d700 1 -- 172.21.15.154:0/895070962 >> 172.21.15.154:0/895070962 conn(0x7f43300999d0 msgr2=0x7f4330099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f433542d700 1 -- 172.21.15.154:0/895070962 shutdown_connections 2023-09-30T22:19:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.748+0000 7f433542d700 1 -- 172.21.15.154:0/895070962 wait complete. 2023-09-30T22:19:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.750+0000 7f433542d700 1 Processor -- start 2023-09-30T22:19:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.750+0000 7f433542d700 1 -- start start 2023-09-30T22:19:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.750+0000 7f433542d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f433006a390 0x7f4330130640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.750+0000 7f433542d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43301241e0 0x7f433011ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.750+0000 7f433542d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330127e10 0x7f4330120450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.750+0000 7f433542d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4330130b30 con 0x7f43301241e0 2023-09-30T22:19:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.750+0000 7f433542d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4330093540 con 0x7f433006a390 2023-09-30T22:19:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.750+0000 7f433542d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4330123320 con 0x7f4330127e10 2023-09-30T22:19:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f433006a390 0x7f4330130640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43301241e0 0x7f433011ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330127e10 0x7f4330120450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330127e10 0x7f4330120450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60142/0 (socket says 172.21.15.154:60142) 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f433006a390 0x7f4330130640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54476/0 (socket says 172.21.15.154:54476) 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43301241e0 0x7f433011ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37314/0 (socket says 172.21.15.154:37314) 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432f7fe700 1 -- 172.21.15.154:0/3975854946 learned_addr learned my addr 172.21.15.154:0/3975854946 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432effd700 1 -- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330127e10 msgr2=0x7f4330120450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432effd700 1 --2- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330127e10 0x7f4330120450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432effd700 1 -- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43301241e0 msgr2=0x7f433011ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432effd700 1 --2- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43301241e0 0x7f433011ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432effd700 1 -- 172.21.15.154:0/3975854946 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43240092a0 con 0x7f433006a390 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432e7fc700 1 --2- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43301241e0 0x7f433011ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f432effd700 1 --2- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f433006a390 0x7f4330130640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4320014000 tx=0x7f4320017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f4316ffd700 1 -- 172.21.15.154:0/3975854946 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320006d90 con 0x7f433006a390 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f4316ffd700 1 -- 172.21.15.154:0/3975854946 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320000bc0 con 0x7f433006a390 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4320009370 con 0x7f433006a390 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f4316ffd700 1 -- 172.21.15.154:0/3975854946 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000fa10 con 0x7f433006a390 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.751+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4330121e10 con 0x7f433006a390 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.752+0000 7f4316ffd700 1 -- 172.21.15.154:0/3975854946 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4320021070 con 0x7f433006a390 2023-09-30T22:19:44.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.752+0000 7f4316ffd700 1 -- 172.21.15.154:0/3975854946 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f432003c750 con 0x7f433006a390 2023-09-30T22:19:44.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.752+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4330099e60 con 0x7f433006a390 2023-09-30T22:19:44.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.757+0000 7f4316ffd700 1 -- 172.21.15.154:0/3975854946 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f432002d3f0 con 0x7f433006a390 2023-09-30T22:19:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.911+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 --> v1:172.21.15.154:6816/118163 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4330128460 con 0x7f431c02bb90 2023-09-30T22:19:44.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.918+0000 7f4316ffd700 1 -- 172.21.15.154:0/3975854946 <== mgr.4101 v1:172.21.15.154:6816/118163 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249918 (unknown 2965378022 0 2531648833) 0x7f4330128460 con 0x7f431c02bb90 2023-09-30T22:19:44.920 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.920+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 >> v1:172.21.15.154:6816/118163 conn(0x7f431c02bb90 legacy=0x7f431c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.921+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f433006a390 msgr2=0x7f4330130640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.921+0000 7f433542d700 1 --2- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f433006a390 0x7f4330130640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4320014000 tx=0x7f4320017000).stop 2023-09-30T22:19:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.921+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 shutdown_connections 2023-09-30T22:19:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.921+0000 7f433542d700 1 --2- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330127e10 0x7f4330120450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.921+0000 7f433542d700 1 --2- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f433006a390 0x7f4330130640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.921+0000 7f433542d700 1 --2- 172.21.15.154:0/3975854946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43301241e0 0x7f433011ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.921+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 >> 172.21.15.154:0/3975854946 conn(0x7f43300999d0 msgr2=0x7f43300987d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.921+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 shutdown_connections 2023-09-30T22:19:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:44.921+0000 7f433542d700 1 -- 172.21.15.154:0/3975854946 wait complete. 2023-09-30T22:19:44.924 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-09-30T22:19:44.932 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-09-30T22:19:43.215232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188992,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298368,"statfs":{"total":386547056640,"available":385329528832,"internally_reserved":0,"allocated":622592,"data_stored":182668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000877"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667917+0000","last_change":"2023-09-30T22:19:33.658237+0000","last_active":"2023-09-30T22:19:33.667917+0000","last_peered":"2023-09-30T22:19:33.667917+0000","last_clean":"2023-09-30T22:19:33.667917+0000","last_became_active":"2023-09-30T22:19:33.657934+0000","last_became_peered":"2023-09-30T22:19:33.657934+0000","last_unstale":"2023-09-30T22:19:33.667917+0000","last_undegraded":"2023-09-30T22:19:33.667917+0000","last_fullsized":"2023-09-30T22:19:33.667917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.648635+0000","last_change":"2023-09-30T22:19:33.644960+0000","last_active":"2023-09-30T22:19:33.648635+0000","last_peered":"2023-09-30T22:19:33.648635+0000","last_clean":"2023-09-30T22:19:33.648635+0000","last_became_active":"2023-09-30T22:19:33.644714+0000","last_became_peered":"2023-09-30T22:19:33.644714+0000","last_unstale":"2023-09-30T22:19:33.648635+0000","last_undegraded":"2023-09-30T22:19:33.648635+0000","last_fullsized":"2023-09-30T22:19:33.648635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658820+0000","last_change":"2023-09-30T22:19:33.647352+0000","last_active":"2023-09-30T22:19:33.658820+0000","last_peered":"2023-09-30T22:19:33.658820+0000","last_clean":"2023-09-30T22:19:33.658820+0000","last_became_active":"2023-09-30T22:19:33.647023+0000","last_became_peered":"2023-09-30T22:19:33.647023+0000","last_unstale":"2023-09-30T22:19:33.658820+0000","last_undegraded":"2023-09-30T22:19:33.658820+0000","last_fullsized":"2023-09-30T22:19:33.658820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657478+0000","last_change":"2023-09-30T22:19:33.645394+0000","last_active":"2023-09-30T22:19:33.657478+0000","last_peered":"2023-09-30T22:19:33.657478+0000","last_clean":"2023-09-30T22:19:33.657478+0000","last_became_active":"2023-09-30T22:19:33.645211+0000","last_became_peered":"2023-09-30T22:19:33.645211+0000","last_unstale":"2023-09-30T22:19:33.657478+0000","last_undegraded":"2023-09-30T22:19:33.657478+0000","last_fullsized":"2023-09-30T22:19:33.657478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658933+0000","last_change":"2023-09-30T22:19:33.651418+0000","last_active":"2023-09-30T22:19:33.658933+0000","last_peered":"2023-09-30T22:19:33.658933+0000","last_clean":"2023-09-30T22:19:33.658933+0000","last_became_active":"2023-09-30T22:19:33.651174+0000","last_became_peered":"2023-09-30T22:19:33.651174+0000","last_unstale":"2023-09-30T22:19:33.658933+0000","last_undegraded":"2023-09-30T22:19:33.658933+0000","last_fullsized":"2023-09-30T22:19:33.658933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677670+0000","last_change":"2023-09-30T22:19:33.671906+0000","last_active":"2023-09-30T22:19:33.677670+0000","last_peered":"2023-09-30T22:19:33.677670+0000","last_clean":"2023-09-30T22:19:33.677670+0000","last_became_active":"2023-09-30T22:19:33.671528+0000","last_became_peered":"2023-09-30T22:19:33.671528+0000","last_unstale":"2023-09-30T22:19:33.677670+0000","last_undegraded":"2023-09-30T22:19:33.677670+0000","last_fullsized":"2023-09-30T22:19:33.677670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677711+0000","last_change":"2023-09-30T22:19:33.670986+0000","last_active":"2023-09-30T22:19:33.677711+0000","last_peered":"2023-09-30T22:19:33.677711+0000","last_clean":"2023-09-30T22:19:33.677711+0000","last_became_active":"2023-09-30T22:19:33.670689+0000","last_became_peered":"2023-09-30T22:19:33.670689+0000","last_unstale":"2023-09-30T22:19:33.677711+0000","last_undegraded":"2023-09-30T22:19:33.677711+0000","last_fullsized":"2023-09-30T22:19:33.677711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666921+0000","last_change":"2023-09-30T22:19:33.654626+0000","last_active":"2023-09-30T22:19:33.666921+0000","last_peered":"2023-09-30T22:19:33.666921+0000","last_clean":"2023-09-30T22:19:33.666921+0000","last_became_active":"2023-09-30T22:19:33.654358+0000","last_became_peered":"2023-09-30T22:19:33.654358+0000","last_unstale":"2023-09-30T22:19:33.666921+0000","last_undegraded":"2023-09-30T22:19:33.666921+0000","last_fullsized":"2023-09-30T22:19:33.666921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660001+0000","last_change":"2023-09-30T22:19:33.648775+0000","last_active":"2023-09-30T22:19:33.660001+0000","last_peered":"2023-09-30T22:19:33.660001+0000","last_clean":"2023-09-30T22:19:33.660001+0000","last_became_active":"2023-09-30T22:19:33.648386+0000","last_became_peered":"2023-09-30T22:19:33.648386+0000","last_unstale":"2023-09-30T22:19:33.660001+0000","last_undegraded":"2023-09-30T22:19:33.660001+0000","last_fullsized":"2023-09-30T22:19:33.660001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.669534+0000","last_change":"2023-09-30T22:19:33.667764+0000","last_active":"2023-09-30T22:19:33.669534+0000","last_peered":"2023-09-30T22:19:33.669534+0000","last_clean":"2023-09-30T22:19:33.669534+0000","last_became_active":"2023-09-30T22:19:33.667514+0000","last_became_peered":"2023-09-30T22:19:33.667514+0000","last_unstale":"2023-09-30T22:19:33.669534+0000","last_undegraded":"2023-09-30T22:19:33.669534+0000","last_fullsized":"2023-09-30T22:19:33.669534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666903+0000","last_change":"2023-09-30T22:19:33.657292+0000","last_active":"2023-09-30T22:19:33.666903+0000","last_peered":"2023-09-30T22:19:33.666903+0000","last_clean":"2023-09-30T22:19:33.666903+0000","last_became_active":"2023-09-30T22:19:33.656706+0000","last_became_peered":"2023-09-30T22:19:33.656706+0000","last_unstale":"2023-09-30T22:19:33.666903+0000","last_undegraded":"2023-09-30T22:19:33.666903+0000","last_fullsized":"2023-09-30T22:19:33.666903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.669940+0000","last_change":"2023-09-30T22:19:33.658823+0000","last_active":"2023-09-30T22:19:33.669940+0000","last_peered":"2023-09-30T22:19:33.669940+0000","last_clean":"2023-09-30T22:19:33.669940+0000","last_became_active":"2023-09-30T22:19:33.658537+0000","last_became_peered":"2023-09-30T22:19:33.658537+0000","last_unstale":"2023-09-30T22:19:33.669940+0000","last_undegraded":"2023-09-30T22:19:33.669940+0000","last_fullsized":"2023-09-30T22:19:33.669940+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670391+0000","last_change":"2023-09-30T22:19:33.665830+0000","last_active":"2023-09-30T22:19:33.670391+0000","last_peered":"2023-09-30T22:19:33.670391+0000","last_clean":"2023-09-30T22:19:33.670391+0000","last_became_active":"2023-09-30T22:19:33.665391+0000","last_became_peered":"2023-09-30T22:19:33.665391+0000","last_unstale":"2023-09-30T22:19:33.670391+0000","last_undegraded":"2023-09-30T22:19:33.670391+0000","last_fullsized":"2023-09-30T22:19:33.670391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657540+0000","last_change":"2023-09-30T22:19:33.652240+0000","last_active":"2023-09-30T22:19:33.657540+0000","last_peered":"2023-09-30T22:19:33.657540+0000","last_clean":"2023-09-30T22:19:33.657540+0000","last_became_active":"2023-09-30T22:19:33.651971+0000","last_became_peered":"2023-09-30T22:19:33.651971+0000","last_unstale":"2023-09-30T22:19:33.657540+0000","last_undegraded":"2023-09-30T22:19:33.657540+0000","last_fullsized":"2023-09-30T22:19:33.657540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658251+0000","last_change":"2023-09-30T22:19:33.645322+0000","last_active":"2023-09-30T22:19:33.658251+0000","last_peered":"2023-09-30T22:19:33.658251+0000","last_clean":"2023-09-30T22:19:33.658251+0000","last_became_active":"2023-09-30T22:19:33.645012+0000","last_became_peered":"2023-09-30T22:19:33.645012+0000","last_unstale":"2023-09-30T22:19:33.658251+0000","last_undegraded":"2023-09-30T22:19:33.658251+0000","last_fullsized":"2023-09-30T22:19:33.658251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672567+0000","last_change":"2023-09-30T22:19:33.662012+0000","last_active":"2023-09-30T22:19:33.672567+0000","last_peered":"2023-09-30T22:19:33.672567+0000","last_clean":"2023-09-30T22:19:33.672567+0000","last_became_active":"2023-09-30T22:19:33.661750+0000","last_became_peered":"2023-09-30T22:19:33.661750+0000","last_unstale":"2023-09-30T22:19:33.672567+0000","last_undegraded":"2023-09-30T22:19:33.672567+0000","last_fullsized":"2023-09-30T22:19:33.672567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.659984+0000","last_change":"2023-09-30T22:19:33.648614+0000","last_active":"2023-09-30T22:19:33.659984+0000","last_peered":"2023-09-30T22:19:33.659984+0000","last_clean":"2023-09-30T22:19:33.659984+0000","last_became_active":"2023-09-30T22:19:33.648081+0000","last_became_peered":"2023-09-30T22:19:33.648081+0000","last_unstale":"2023-09-30T22:19:33.659984+0000","last_undegraded":"2023-09-30T22:19:33.659984+0000","last_fullsized":"2023-09-30T22:19:33.659984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649103+0000","last_change":"2023-09-30T22:19:33.639423+0000","last_active":"2023-09-30T22:19:33.649103+0000","last_peered":"2023-09-30T22:19:33.649103+0000","last_clean":"2023-09-30T22:19:33.649103+0000","last_became_active":"2023-09-30T22:19:33.639112+0000","last_became_peered":"2023-09-30T22:19:33.639112+0000","last_unstale":"2023-09-30T22:19:33.649103+0000","last_undegraded":"2023-09-30T22:19:33.649103+0000","last_fullsized":"2023-09-30T22:19:33.649103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667889+0000","last_change":"2023-09-30T22:19:33.658136+0000","last_active":"2023-09-30T22:19:33.667889+0000","last_peered":"2023-09-30T22:19:33.667889+0000","last_clean":"2023-09-30T22:19:33.667889+0000","last_became_active":"2023-09-30T22:19:33.657838+0000","last_became_peered":"2023-09-30T22:19:33.657838+0000","last_unstale":"2023-09-30T22:19:33.667889+0000","last_undegraded":"2023-09-30T22:19:33.667889+0000","last_fullsized":"2023-09-30T22:19:33.667889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655280+0000","last_change":"2023-09-30T22:19:33.650438+0000","last_active":"2023-09-30T22:19:33.655280+0000","last_peered":"2023-09-30T22:19:33.655280+0000","last_clean":"2023-09-30T22:19:33.655280+0000","last_became_active":"2023-09-30T22:19:33.650186+0000","last_became_peered":"2023-09-30T22:19:33.650186+0000","last_unstale":"2023-09-30T22:19:33.655280+0000","last_undegraded":"2023-09-30T22:19:33.655280+0000","last_fullsized":"2023-09-30T22:19:33.655280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667116+0000","last_change":"2023-09-30T22:19:33.663045+0000","last_active":"2023-09-30T22:19:33.667116+0000","last_peered":"2023-09-30T22:19:33.667116+0000","last_clean":"2023-09-30T22:19:33.667116+0000","last_became_active":"2023-09-30T22:19:33.662782+0000","last_became_peered":"2023-09-30T22:19:33.662782+0000","last_unstale":"2023-09-30T22:19:33.667116+0000","last_undegraded":"2023-09-30T22:19:33.667116+0000","last_fullsized":"2023-09-30T22:19:33.667116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657346+0000","last_change":"2023-09-30T22:19:33.645247+0000","last_active":"2023-09-30T22:19:33.657346+0000","last_peered":"2023-09-30T22:19:33.657346+0000","last_clean":"2023-09-30T22:19:33.657346+0000","last_became_active":"2023-09-30T22:19:33.644963+0000","last_became_peered":"2023-09-30T22:19:33.644963+0000","last_unstale":"2023-09-30T22:19:33.657346+0000","last_undegraded":"2023-09-30T22:19:33.657346+0000","last_fullsized":"2023-09-30T22:19:33.657346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672937+0000","last_change":"2023-09-30T22:19:33.662935+0000","last_active":"2023-09-30T22:19:33.672937+0000","last_peered":"2023-09-30T22:19:33.672937+0000","last_clean":"2023-09-30T22:19:33.672937+0000","last_became_active":"2023-09-30T22:19:33.662255+0000","last_became_peered":"2023-09-30T22:19:33.662255+0000","last_unstale":"2023-09-30T22:19:33.672937+0000","last_undegraded":"2023-09-30T22:19:33.672937+0000","last_fullsized":"2023-09-30T22:19:33.672937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.661530+0000","last_change":"2023-09-30T22:19:33.652392+0000","last_active":"2023-09-30T22:19:33.661530+0000","last_peered":"2023-09-30T22:19:33.661530+0000","last_clean":"2023-09-30T22:19:33.661530+0000","last_became_active":"2023-09-30T22:19:33.652097+0000","last_became_peered":"2023-09-30T22:19:33.652097+0000","last_unstale":"2023-09-30T22:19:33.661530+0000","last_undegraded":"2023-09-30T22:19:33.661530+0000","last_fullsized":"2023-09-30T22:19:33.661530+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655129+0000","last_change":"2023-09-30T22:19:33.649799+0000","last_active":"2023-09-30T22:19:33.655129+0000","last_peered":"2023-09-30T22:19:33.655129+0000","last_clean":"2023-09-30T22:19:33.655129+0000","last_became_active":"2023-09-30T22:19:33.649512+0000","last_became_peered":"2023-09-30T22:19:33.649512+0000","last_unstale":"2023-09-30T22:19:33.655129+0000","last_undegraded":"2023-09-30T22:19:33.655129+0000","last_fullsized":"2023-09-30T22:19:33.655129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666815+0000","last_change":"2023-09-30T22:19:33.653148+0000","last_active":"2023-09-30T22:19:33.666815+0000","last_peered":"2023-09-30T22:19:33.666815+0000","last_clean":"2023-09-30T22:19:33.666815+0000","last_became_active":"2023-09-30T22:19:33.652806+0000","last_became_peered":"2023-09-30T22:19:33.652806+0000","last_unstale":"2023-09-30T22:19:33.666815+0000","last_undegraded":"2023-09-30T22:19:33.666815+0000","last_fullsized":"2023-09-30T22:19:33.666815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677757+0000","last_change":"2023-09-30T22:19:33.673663+0000","last_active":"2023-09-30T22:19:33.677757+0000","last_peered":"2023-09-30T22:19:33.677757+0000","last_clean":"2023-09-30T22:19:33.677757+0000","last_became_active":"2023-09-30T22:19:33.673128+0000","last_became_peered":"2023-09-30T22:19:33.673128+0000","last_unstale":"2023-09-30T22:19:33.677757+0000","last_undegraded":"2023-09-30T22:19:33.677757+0000","last_fullsized":"2023-09-30T22:19:33.677757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655301+0000","last_change":"2023-09-30T22:19:33.280425+0000","last_active":"2023-09-30T22:19:33.655301+0000","last_peered":"2023-09-30T22:19:33.655301+0000","last_clean":"2023-09-30T22:19:33.655301+0000","last_became_active":"2023-09-30T22:19:33.280161+0000","last_became_peered":"2023-09-30T22:19:33.280161+0000","last_unstale":"2023-09-30T22:19:33.655301+0000","last_undegraded":"2023-09-30T22:19:33.655301+0000","last_fullsized":"2023-09-30T22:19:33.655301+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677578+0000","last_change":"2023-09-30T22:19:33.670909+0000","last_active":"2023-09-30T22:19:33.677578+0000","last_peered":"2023-09-30T22:19:33.677578+0000","last_clean":"2023-09-30T22:19:33.677578+0000","last_became_active":"2023-09-30T22:19:33.670616+0000","last_became_peered":"2023-09-30T22:19:33.670616+0000","last_unstale":"2023-09-30T22:19:33.677578+0000","last_undegraded":"2023-09-30T22:19:33.677578+0000","last_fullsized":"2023-09-30T22:19:33.677578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.634886+0000","last_change":"2023-09-30T22:19:33.284384+0000","last_active":"2023-09-30T22:19:33.634886+0000","last_peered":"2023-09-30T22:19:33.634886+0000","last_clean":"2023-09-30T22:19:33.634886+0000","last_became_active":"2023-09-30T22:19:33.284138+0000","last_became_peered":"2023-09-30T22:19:33.284138+0000","last_unstale":"2023-09-30T22:19:33.634886+0000","last_undegraded":"2023-09-30T22:19:33.634886+0000","last_fullsized":"2023-09-30T22:19:33.634886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660115+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:19:33.660115+0000","last_peered":"2023-09-30T22:19:33.660115+0000","last_clean":"2023-09-30T22:19:33.660115+0000","last_became_active":"2023-09-30T22:19:33.646355+0000","last_became_peered":"2023-09-30T22:19:33.646355+0000","last_unstale":"2023-09-30T22:19:33.660115+0000","last_undegraded":"2023-09-30T22:19:33.660115+0000","last_fullsized":"2023-09-30T22:19:33.660115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.644148+0000","last_change":"2023-09-30T22:19:33.289402+0000","last_active":"2023-09-30T22:19:33.644148+0000","last_peered":"2023-09-30T22:19:33.644148+0000","last_clean":"2023-09-30T22:19:33.644148+0000","last_became_active":"2023-09-30T22:19:33.288979+0000","last_became_peered":"2023-09-30T22:19:33.288979+0000","last_unstale":"2023-09-30T22:19:33.644148+0000","last_undegraded":"2023-09-30T22:19:33.644148+0000","last_fullsized":"2023-09-30T22:19:33.644148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677702+0000","last_change":"2023-09-30T22:19:33.672854+0000","last_active":"2023-09-30T22:19:33.677702+0000","last_peered":"2023-09-30T22:19:33.677702+0000","last_clean":"2023-09-30T22:19:33.677702+0000","last_became_active":"2023-09-30T22:19:33.672539+0000","last_became_peered":"2023-09-30T22:19:33.672539+0000","last_unstale":"2023-09-30T22:19:33.677702+0000","last_undegraded":"2023-09-30T22:19:33.677702+0000","last_fullsized":"2023-09-30T22:19:33.677702+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629757+0000","last_change":"2023-09-30T22:19:33.294805+0000","last_active":"2023-09-30T22:19:33.629757+0000","last_peered":"2023-09-30T22:19:33.629757+0000","last_clean":"2023-09-30T22:19:33.629757+0000","last_became_active":"2023-09-30T22:19:33.294520+0000","last_became_peered":"2023-09-30T22:19:33.294520+0000","last_unstale":"2023-09-30T22:19:33.629757+0000","last_undegraded":"2023-09-30T22:19:33.629757+0000","last_fullsized":"2023-09-30T22:19:33.629757+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.671624+0000","last_change":"2023-09-30T22:19:33.660684+0000","last_active":"2023-09-30T22:19:33.671624+0000","last_peered":"2023-09-30T22:19:33.671624+0000","last_clean":"2023-09-30T22:19:33.671624+0000","last_became_active":"2023-09-30T22:19:33.660143+0000","last_became_peered":"2023-09-30T22:19:33.660143+0000","last_unstale":"2023-09-30T22:19:33.671624+0000","last_undegraded":"2023-09-30T22:19:33.671624+0000","last_fullsized":"2023-09-30T22:19:33.671624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.633284+0000","last_change":"2023-09-30T22:19:33.279060+0000","last_active":"2023-09-30T22:19:33.633284+0000","last_peered":"2023-09-30T22:19:33.633284+0000","last_clean":"2023-09-30T22:19:33.633284+0000","last_became_active":"2023-09-30T22:19:33.278776+0000","last_became_peered":"2023-09-30T22:19:33.278776+0000","last_unstale":"2023-09-30T22:19:33.633284+0000","last_undegraded":"2023-09-30T22:19:33.633284+0000","last_fullsized":"2023-09-30T22:19:33.633284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672955+0000","last_change":"2023-09-30T22:19:33.662982+0000","last_active":"2023-09-30T22:19:33.672955+0000","last_peered":"2023-09-30T22:19:33.672955+0000","last_clean":"2023-09-30T22:19:33.672955+0000","last_became_active":"2023-09-30T22:19:33.662668+0000","last_became_peered":"2023-09-30T22:19:33.662668+0000","last_unstale":"2023-09-30T22:19:33.672955+0000","last_undegraded":"2023-09-30T22:19:33.672955+0000","last_fullsized":"2023-09-30T22:19:33.672955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658775+0000","last_change":"2023-09-30T22:19:33.288428+0000","last_active":"2023-09-30T22:19:33.658775+0000","last_peered":"2023-09-30T22:19:33.658775+0000","last_clean":"2023-09-30T22:19:33.658775+0000","last_became_active":"2023-09-30T22:19:33.287975+0000","last_became_peered":"2023-09-30T22:19:33.287975+0000","last_unstale":"2023-09-30T22:19:33.658775+0000","last_undegraded":"2023-09-30T22:19:33.658775+0000","last_fullsized":"2023-09-30T22:19:33.658775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667104+0000","last_change":"2023-09-30T22:19:33.662645+0000","last_active":"2023-09-30T22:19:33.667104+0000","last_peered":"2023-09-30T22:19:33.667104+0000","last_clean":"2023-09-30T22:19:33.667104+0000","last_became_active":"2023-09-30T22:19:33.662371+0000","last_became_peered":"2023-09-30T22:19:33.662371+0000","last_unstale":"2023-09-30T22:19:33.667104+0000","last_undegraded":"2023-09-30T22:19:33.667104+0000","last_fullsized":"2023-09-30T22:19:33.667104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.680286+0000","last_change":"2023-09-30T22:19:33.289061+0000","last_active":"2023-09-30T22:19:33.680286+0000","last_peered":"2023-09-30T22:19:33.680286+0000","last_clean":"2023-09-30T22:19:33.680286+0000","last_became_active":"2023-09-30T22:19:33.288656+0000","last_became_peered":"2023-09-30T22:19:33.288656+0000","last_unstale":"2023-09-30T22:19:33.680286+0000","last_undegraded":"2023-09-30T22:19:33.680286+0000","last_fullsized":"2023-09-30T22:19:33.680286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670408+0000","last_change":"2023-09-30T22:19:33.665863+0000","last_active":"2023-09-30T22:19:33.670408+0000","last_peered":"2023-09-30T22:19:33.670408+0000","last_clean":"2023-09-30T22:19:33.670408+0000","last_became_active":"2023-09-30T22:19:33.665570+0000","last_became_peered":"2023-09-30T22:19:33.665570+0000","last_unstale":"2023-09-30T22:19:33.670408+0000","last_undegraded":"2023-09-30T22:19:33.670408+0000","last_fullsized":"2023-09-30T22:19:33.670408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.673326+0000","last_change":"2023-09-30T22:19:33.296210+0000","last_active":"2023-09-30T22:19:33.673326+0000","last_peered":"2023-09-30T22:19:33.673326+0000","last_clean":"2023-09-30T22:19:33.673326+0000","last_became_active":"2023-09-30T22:19:33.295952+0000","last_became_peered":"2023-09-30T22:19:33.295952+0000","last_unstale":"2023-09-30T22:19:33.673326+0000","last_undegraded":"2023-09-30T22:19:33.673326+0000","last_fullsized":"2023-09-30T22:19:33.673326+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.674965+0000","last_change":"2023-09-30T22:19:33.670730+0000","last_active":"2023-09-30T22:19:33.674965+0000","last_peered":"2023-09-30T22:19:33.674965+0000","last_clean":"2023-09-30T22:19:33.674965+0000","last_became_active":"2023-09-30T22:19:33.670520+0000","last_became_peered":"2023-09-30T22:19:33.670520+0000","last_unstale":"2023-09-30T22:19:33.674965+0000","last_undegraded":"2023-09-30T22:19:33.674965+0000","last_fullsized":"2023-09-30T22:19:33.674965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629387+0000","last_change":"2023-09-30T22:19:33.293117+0000","last_active":"2023-09-30T22:19:33.629387+0000","last_peered":"2023-09-30T22:19:33.629387+0000","last_clean":"2023-09-30T22:19:33.629387+0000","last_became_active":"2023-09-30T22:19:33.288262+0000","last_became_peered":"2023-09-30T22:19:33.288262+0000","last_unstale":"2023-09-30T22:19:33.629387+0000","last_undegraded":"2023-09-30T22:19:33.629387+0000","last_fullsized":"2023-09-30T22:19:33.629387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677773+0000","last_change":"2023-09-30T22:19:33.673816+0000","last_active":"2023-09-30T22:19:33.677773+0000","last_peered":"2023-09-30T22:19:33.677773+0000","last_clean":"2023-09-30T22:19:33.677773+0000","last_became_active":"2023-09-30T22:19:33.673426+0000","last_became_peered":"2023-09-30T22:19:33.673426+0000","last_unstale":"2023-09-30T22:19:33.677773+0000","last_undegraded":"2023-09-30T22:19:33.677773+0000","last_fullsized":"2023-09-30T22:19:33.677773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646927+0000","last_change":"2023-09-30T22:19:33.288441+0000","last_active":"2023-09-30T22:19:33.646927+0000","last_peered":"2023-09-30T22:19:33.646927+0000","last_clean":"2023-09-30T22:19:33.646927+0000","last_became_active":"2023-09-30T22:19:33.288030+0000","last_became_peered":"2023-09-30T22:19:33.288030+0000","last_unstale":"2023-09-30T22:19:33.646927+0000","last_undegraded":"2023-09-30T22:19:33.646927+0000","last_fullsized":"2023-09-30T22:19:33.646927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660131+0000","last_change":"2023-09-30T22:19:33.649224+0000","last_active":"2023-09-30T22:19:33.660131+0000","last_peered":"2023-09-30T22:19:33.660131+0000","last_clean":"2023-09-30T22:19:33.660131+0000","last_became_active":"2023-09-30T22:19:33.648913+0000","last_became_peered":"2023-09-30T22:19:33.648913+0000","last_unstale":"2023-09-30T22:19:33.660131+0000","last_undegraded":"2023-09-30T22:19:33.660131+0000","last_fullsized":"2023-09-30T22:19:33.660131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670116+0000","last_change":"2023-09-30T22:19:33.283730+0000","last_active":"2023-09-30T22:19:33.670116+0000","last_peered":"2023-09-30T22:19:33.670116+0000","last_clean":"2023-09-30T22:19:33.670116+0000","last_became_active":"2023-09-30T22:19:33.282944+0000","last_became_peered":"2023-09-30T22:19:33.282944+0000","last_unstale":"2023-09-30T22:19:33.670116+0000","last_undegraded":"2023-09-30T22:19:33.670116+0000","last_fullsized":"2023-09-30T22:19:33.670116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677682+0000","last_change":"2023-09-30T22:19:33.672354+0000","last_active":"2023-09-30T22:19:33.677682+0000","last_peered":"2023-09-30T22:19:33.677682+0000","last_clean":"2023-09-30T22:19:33.677682+0000","last_became_active":"2023-09-30T22:19:33.672110+0000","last_became_peered":"2023-09-30T22:19:33.672110+0000","last_unstale":"2023-09-30T22:19:33.677682+0000","last_undegraded":"2023-09-30T22:19:33.677682+0000","last_fullsized":"2023-09-30T22:19:33.677682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.659733+0000","last_change":"2023-09-30T22:19:33.293023+0000","last_active":"2023-09-30T22:19:33.659733+0000","last_peered":"2023-09-30T22:19:33.659733+0000","last_clean":"2023-09-30T22:19:33.659733+0000","last_became_active":"2023-09-30T22:19:33.288365+0000","last_became_peered":"2023-09-30T22:19:33.288365+0000","last_unstale":"2023-09-30T22:19:33.659733+0000","last_undegraded":"2023-09-30T22:19:33.659733+0000","last_fullsized":"2023-09-30T22:19:33.659733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672547+0000","last_change":"2023-09-30T22:19:33.661497+0000","last_active":"2023-09-30T22:19:33.672547+0000","last_peered":"2023-09-30T22:19:33.672547+0000","last_clean":"2023-09-30T22:19:33.672547+0000","last_became_active":"2023-09-30T22:19:33.660436+0000","last_became_peered":"2023-09-30T22:19:33.660436+0000","last_unstale":"2023-09-30T22:19:33.672547+0000","last_undegraded":"2023-09-30T22:19:33.672547+0000","last_fullsized":"2023-09-30T22:19:33.672547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.651255+0000","last_change":"2023-09-30T22:19:33.288413+0000","last_active":"2023-09-30T22:19:33.651255+0000","last_peered":"2023-09-30T22:19:33.651255+0000","last_clean":"2023-09-30T22:19:33.651255+0000","last_became_active":"2023-09-30T22:19:33.288151+0000","last_became_peered":"2023-09-30T22:19:33.288151+0000","last_unstale":"2023-09-30T22:19:33.651255+0000","last_undegraded":"2023-09-30T22:19:33.651255+0000","last_fullsized":"2023-09-30T22:19:33.651255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667065+0000","last_change":"2023-09-30T22:19:33.662546+0000","last_active":"2023-09-30T22:19:33.667065+0000","last_peered":"2023-09-30T22:19:33.667065+0000","last_clean":"2023-09-30T22:19:33.667065+0000","last_became_active":"2023-09-30T22:19:33.662214+0000","last_became_peered":"2023-09-30T22:19:33.662214+0000","last_unstale":"2023-09-30T22:19:33.667065+0000","last_undegraded":"2023-09-30T22:19:33.667065+0000","last_fullsized":"2023-09-30T22:19:33.667065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672306+0000","last_change":"2023-09-30T22:19:33.291431+0000","last_active":"2023-09-30T22:19:33.672306+0000","last_peered":"2023-09-30T22:19:33.672306+0000","last_clean":"2023-09-30T22:19:33.672306+0000","last_became_active":"2023-09-30T22:19:33.290697+0000","last_became_peered":"2023-09-30T22:19:33.290697+0000","last_unstale":"2023-09-30T22:19:33.672306+0000","last_undegraded":"2023-09-30T22:19:33.672306+0000","last_fullsized":"2023-09-30T22:19:33.672306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.669635+0000","last_change":"2023-09-30T22:19:33.658789+0000","last_active":"2023-09-30T22:19:33.669635+0000","last_peered":"2023-09-30T22:19:33.669635+0000","last_clean":"2023-09-30T22:19:33.669635+0000","last_became_active":"2023-09-30T22:19:33.658064+0000","last_became_peered":"2023-09-30T22:19:33.658064+0000","last_unstale":"2023-09-30T22:19:33.669635+0000","last_undegraded":"2023-09-30T22:19:33.669635+0000","last_fullsized":"2023-09-30T22:19:33.669635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629956+0000","last_change":"2023-09-30T22:19:33.286077+0000","last_active":"2023-09-30T22:19:33.629956+0000","last_peered":"2023-09-30T22:19:33.629956+0000","last_clean":"2023-09-30T22:19:33.629956+0000","last_became_active":"2023-09-30T22:19:33.279026+0000","last_became_peered":"2023-09-30T22:19:33.279026+0000","last_unstale":"2023-09-30T22:19:33.629956+0000","last_undegraded":"2023-09-30T22:19:33.629956+0000","last_fullsized":"2023-09-30T22:19:33.629956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658914+0000","last_change":"2023-09-30T22:19:33.647993+0000","last_active":"2023-09-30T22:19:33.658914+0000","last_peered":"2023-09-30T22:19:33.658914+0000","last_clean":"2023-09-30T22:19:33.658914+0000","last_became_active":"2023-09-30T22:19:33.647725+0000","last_became_peered":"2023-09-30T22:19:33.647725+0000","last_unstale":"2023-09-30T22:19:33.658914+0000","last_undegraded":"2023-09-30T22:19:33.658914+0000","last_fullsized":"2023-09-30T22:19:33.658914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.673006+0000","last_change":"2023-09-30T22:19:33.296389+0000","last_active":"2023-09-30T22:19:33.673006+0000","last_peered":"2023-09-30T22:19:33.673006+0000","last_clean":"2023-09-30T22:19:33.673006+0000","last_became_active":"2023-09-30T22:19:33.296134+0000","last_became_peered":"2023-09-30T22:19:33.296134+0000","last_unstale":"2023-09-30T22:19:33.673006+0000","last_undegraded":"2023-09-30T22:19:33.673006+0000","last_fullsized":"2023-09-30T22:19:33.673006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.657497+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:19:33.657497+0000","last_peered":"2023-09-30T22:19:33.657497+0000","last_clean":"2023-09-30T22:19:33.657497+0000","last_became_active":"2023-09-30T22:19:33.646503+0000","last_became_peered":"2023-09-30T22:19:33.646503+0000","last_unstale":"2023-09-30T22:19:33.657497+0000","last_undegraded":"2023-09-30T22:19:33.657497+0000","last_fullsized":"2023-09-30T22:19:33.657497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649643+0000","last_change":"2023-09-30T22:19:33.287703+0000","last_active":"2023-09-30T22:19:33.649643+0000","last_peered":"2023-09-30T22:19:33.649643+0000","last_clean":"2023-09-30T22:19:33.649643+0000","last_became_active":"2023-09-30T22:19:33.287403+0000","last_became_peered":"2023-09-30T22:19:33.287403+0000","last_unstale":"2023-09-30T22:19:33.649643+0000","last_undegraded":"2023-09-30T22:19:33.649643+0000","last_fullsized":"2023-09-30T22:19:33.649643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677695+0000","last_change":"2023-09-30T22:19:33.672679+0000","last_active":"2023-09-30T22:19:33.677695+0000","last_peered":"2023-09-30T22:19:33.677695+0000","last_clean":"2023-09-30T22:19:33.677695+0000","last_became_active":"2023-09-30T22:19:33.671069+0000","last_became_peered":"2023-09-30T22:19:33.671069+0000","last_unstale":"2023-09-30T22:19:33.677695+0000","last_undegraded":"2023-09-30T22:19:33.677695+0000","last_fullsized":"2023-09-30T22:19:33.677695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646440+0000","last_change":"2023-09-30T22:19:33.288281+0000","last_active":"2023-09-30T22:19:33.646440+0000","last_peered":"2023-09-30T22:19:33.646440+0000","last_clean":"2023-09-30T22:19:33.646440+0000","last_became_active":"2023-09-30T22:19:33.287697+0000","last_became_peered":"2023-09-30T22:19:33.287697+0000","last_unstale":"2023-09-30T22:19:33.646440+0000","last_undegraded":"2023-09-30T22:19:33.646440+0000","last_fullsized":"2023-09-30T22:19:33.646440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670458+0000","last_change":"2023-09-30T22:19:33.666225+0000","last_active":"2023-09-30T22:19:33.670458+0000","last_peered":"2023-09-30T22:19:33.670458+0000","last_clean":"2023-09-30T22:19:33.670458+0000","last_became_active":"2023-09-30T22:19:33.665223+0000","last_became_peered":"2023-09-30T22:19:33.665223+0000","last_unstale":"2023-09-30T22:19:33.670458+0000","last_undegraded":"2023-09-30T22:19:33.670458+0000","last_fullsized":"2023-09-30T22:19:33.670458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.643940+0000","last_change":"2023-09-30T22:19:33.289238+0000","last_active":"2023-09-30T22:19:33.643940+0000","last_peered":"2023-09-30T22:19:33.643940+0000","last_clean":"2023-09-30T22:19:33.643940+0000","last_became_active":"2023-09-30T22:19:33.288633+0000","last_became_peered":"2023-09-30T22:19:33.288633+0000","last_unstale":"2023-09-30T22:19:33.643940+0000","last_undegraded":"2023-09-30T22:19:33.643940+0000","last_fullsized":"2023-09-30T22:19:33.643940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.655152+0000","last_change":"2023-09-30T22:19:33.649869+0000","last_active":"2023-09-30T22:19:33.655152+0000","last_peered":"2023-09-30T22:19:33.655152+0000","last_clean":"2023-09-30T22:19:33.655152+0000","last_became_active":"2023-09-30T22:19:33.649582+0000","last_became_peered":"2023-09-30T22:19:33.649582+0000","last_unstale":"2023-09-30T22:19:33.655152+0000","last_undegraded":"2023-09-30T22:19:33.655152+0000","last_fullsized":"2023-09-30T22:19:33.655152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.638416+0000","last_change":"2023-09-30T22:19:30.188504+0000","last_active":"2023-09-30T22:19:33.638416+0000","last_peered":"2023-09-30T22:19:33.638416+0000","last_clean":"2023-09-30T22:19:33.638416+0000","last_became_active":"2023-09-30T22:19:30.188218+0000","last_became_peered":"2023-09-30T22:19:30.188218+0000","last_unstale":"2023-09-30T22:19:33.638416+0000","last_undegraded":"2023-09-30T22:19:33.638416+0000","last_fullsized":"2023-09-30T22:19:33.638416+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.636797+0000","last_change":"2023-09-30T22:19:33.282597+0000","last_active":"2023-09-30T22:19:33.636797+0000","last_peered":"2023-09-30T22:19:33.636797+0000","last_clean":"2023-09-30T22:19:33.636797+0000","last_became_active":"2023-09-30T22:19:33.280396+0000","last_became_peered":"2023-09-30T22:19:33.280396+0000","last_unstale":"2023-09-30T22:19:33.636797+0000","last_undegraded":"2023-09-30T22:19:33.636797+0000","last_fullsized":"2023-09-30T22:19:33.636797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672752+0000","last_change":"2023-09-30T22:19:33.670732+0000","last_active":"2023-09-30T22:19:33.672752+0000","last_peered":"2023-09-30T22:19:33.672752+0000","last_clean":"2023-09-30T22:19:33.672752+0000","last_became_active":"2023-09-30T22:19:33.670470+0000","last_became_peered":"2023-09-30T22:19:33.670470+0000","last_unstale":"2023-09-30T22:19:33.672752+0000","last_undegraded":"2023-09-30T22:19:33.672752+0000","last_fullsized":"2023-09-30T22:19:33.672752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649555+0000","last_change":"2023-09-30T22:19:29.250128+0000","last_active":"2023-09-30T22:19:33.649555+0000","last_peered":"2023-09-30T22:19:33.649555+0000","last_clean":"2023-09-30T22:19:33.649555+0000","last_became_active":"2023-09-30T22:19:29.249745+0000","last_became_peered":"2023-09-30T22:19:29.249745+0000","last_unstale":"2023-09-30T22:19:33.649555+0000","last_undegraded":"2023-09-30T22:19:33.649555+0000","last_fullsized":"2023-09-30T22:19:33.649555+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.630032+0000","last_change":"2023-09-30T22:19:33.294524+0000","last_active":"2023-09-30T22:19:33.630032+0000","last_peered":"2023-09-30T22:19:33.630032+0000","last_clean":"2023-09-30T22:19:33.630032+0000","last_became_active":"2023-09-30T22:19:33.293937+0000","last_became_peered":"2023-09-30T22:19:33.293937+0000","last_unstale":"2023-09-30T22:19:33.630032+0000","last_undegraded":"2023-09-30T22:19:33.630032+0000","last_fullsized":"2023-09-30T22:19:33.630032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666835+0000","last_change":"2023-09-30T22:19:33.653434+0000","last_active":"2023-09-30T22:19:33.666835+0000","last_peered":"2023-09-30T22:19:33.666835+0000","last_clean":"2023-09-30T22:19:33.666835+0000","last_became_active":"2023-09-30T22:19:33.652629+0000","last_became_peered":"2023-09-30T22:19:33.652629+0000","last_unstale":"2023-09-30T22:19:33.666835+0000","last_undegraded":"2023-09-30T22:19:33.666835+0000","last_fullsized":"2023-09-30T22:19:33.666835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.632600+0000","last_change":"2023-09-30T22:19:29.249638+0000","last_active":"2023-09-30T22:19:33.632600+0000","last_peered":"2023-09-30T22:19:33.632600+0000","last_clean":"2023-09-30T22:19:33.632600+0000","last_became_active":"2023-09-30T22:19:29.249366+0000","last_became_peered":"2023-09-30T22:19:29.249366+0000","last_unstale":"2023-09-30T22:19:33.632600+0000","last_undegraded":"2023-09-30T22:19:33.632600+0000","last_fullsized":"2023-09-30T22:19:33.632600+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.636097+0000","last_change":"2023-09-30T22:19:33.290330+0000","last_active":"2023-09-30T22:19:33.636097+0000","last_peered":"2023-09-30T22:19:33.636097+0000","last_clean":"2023-09-30T22:19:33.636097+0000","last_became_active":"2023-09-30T22:19:33.289841+0000","last_became_peered":"2023-09-30T22:19:33.289841+0000","last_unstale":"2023-09-30T22:19:33.636097+0000","last_undegraded":"2023-09-30T22:19:33.636097+0000","last_fullsized":"2023-09-30T22:19:33.636097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667282+0000","last_change":"2023-09-30T22:19:33.657019+0000","last_active":"2023-09-30T22:19:33.667282+0000","last_peered":"2023-09-30T22:19:33.667282+0000","last_clean":"2023-09-30T22:19:33.667282+0000","last_became_active":"2023-09-30T22:19:33.656759+0000","last_became_peered":"2023-09-30T22:19:33.656759+0000","last_unstale":"2023-09-30T22:19:33.667282+0000","last_undegraded":"2023-09-30T22:19:33.667282+0000","last_fullsized":"2023-09-30T22:19:33.667282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.650158+0000","last_change":"2023-09-30T22:19:29.249647+0000","last_active":"2023-09-30T22:19:33.650158+0000","last_peered":"2023-09-30T22:19:33.650158+0000","last_clean":"2023-09-30T22:19:33.650158+0000","last_became_active":"2023-09-30T22:19:29.249371+0000","last_became_peered":"2023-09-30T22:19:29.249371+0000","last_unstale":"2023-09-30T22:19:33.650158+0000","last_undegraded":"2023-09-30T22:19:33.650158+0000","last_fullsized":"2023-09-30T22:19:33.650158+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.636006+0000","last_change":"2023-09-30T22:19:30.188360+0000","last_active":"2023-09-30T22:19:33.636006+0000","last_peered":"2023-09-30T22:19:33.636006+0000","last_clean":"2023-09-30T22:19:33.636006+0000","last_became_active":"2023-09-30T22:19:30.187849+0000","last_became_peered":"2023-09-30T22:19:30.187849+0000","last_unstale":"2023-09-30T22:19:33.636006+0000","last_undegraded":"2023-09-30T22:19:33.636006+0000","last_fullsized":"2023-09-30T22:19:33.636006+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.649406+0000","last_change":"2023-09-30T22:19:33.292032+0000","last_active":"2023-09-30T22:19:33.649406+0000","last_peered":"2023-09-30T22:19:33.649406+0000","last_clean":"2023-09-30T22:19:33.649406+0000","last_became_active":"2023-09-30T22:19:33.291755+0000","last_became_peered":"2023-09-30T22:19:33.291755+0000","last_unstale":"2023-09-30T22:19:33.649406+0000","last_undegraded":"2023-09-30T22:19:33.649406+0000","last_fullsized":"2023-09-30T22:19:33.649406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.680227+0000","last_change":"2023-09-30T22:19:33.674909+0000","last_active":"2023-09-30T22:19:33.680227+0000","last_peered":"2023-09-30T22:19:33.680227+0000","last_clean":"2023-09-30T22:19:33.680227+0000","last_became_active":"2023-09-30T22:19:33.674646+0000","last_became_peered":"2023-09-30T22:19:33.674646+0000","last_unstale":"2023-09-30T22:19:33.680227+0000","last_undegraded":"2023-09-30T22:19:33.680227+0000","last_fullsized":"2023-09-30T22:19:33.680227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.644054+0000","last_change":"2023-09-30T22:19:29.250622+0000","last_active":"2023-09-30T22:19:33.644054+0000","last_peered":"2023-09-30T22:19:33.644054+0000","last_clean":"2023-09-30T22:19:33.644054+0000","last_became_active":"2023-09-30T22:19:29.250370+0000","last_became_peered":"2023-09-30T22:19:29.250370+0000","last_unstale":"2023-09-30T22:19:33.644054+0000","last_undegraded":"2023-09-30T22:19:33.644054+0000","last_fullsized":"2023-09-30T22:19:33.644054+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.629147+0000","last_change":"2023-09-30T22:19:33.279290+0000","last_active":"2023-09-30T22:19:33.629147+0000","last_peered":"2023-09-30T22:19:33.629147+0000","last_clean":"2023-09-30T22:19:33.629147+0000","last_became_active":"2023-09-30T22:19:33.277328+0000","last_became_peered":"2023-09-30T22:19:33.277328+0000","last_unstale":"2023-09-30T22:19:33.629147+0000","last_undegraded":"2023-09-30T22:19:33.629147+0000","last_fullsized":"2023-09-30T22:19:33.629147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660099+0000","last_change":"2023-09-30T22:19:33.646613+0000","last_active":"2023-09-30T22:19:33.660099+0000","last_peered":"2023-09-30T22:19:33.660099+0000","last_clean":"2023-09-30T22:19:33.660099+0000","last_became_active":"2023-09-30T22:19:33.646057+0000","last_became_peered":"2023-09-30T22:19:33.646057+0000","last_unstale":"2023-09-30T22:19:33.660099+0000","last_undegraded":"2023-09-30T22:19:33.660099+0000","last_fullsized":"2023-09-30T22:19:33.660099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.656110+0000","last_change":"2023-09-30T22:19:30.188159+0000","last_active":"2023-09-30T22:19:33.656110+0000","last_peered":"2023-09-30T22:19:33.656110+0000","last_clean":"2023-09-30T22:19:33.656110+0000","last_became_active":"2023-09-30T22:19:30.187869+0000","last_became_peered":"2023-09-30T22:19:30.187869+0000","last_unstale":"2023-09-30T22:19:33.656110+0000","last_undegraded":"2023-09-30T22:19:33.656110+0000","last_fullsized":"2023-09-30T22:19:33.656110+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.638033+0000","last_change":"2023-09-30T22:19:33.289031+0000","last_active":"2023-09-30T22:19:33.638033+0000","last_peered":"2023-09-30T22:19:33.638033+0000","last_clean":"2023-09-30T22:19:33.638033+0000","last_became_active":"2023-09-30T22:19:33.288758+0000","last_became_peered":"2023-09-30T22:19:33.288758+0000","last_unstale":"2023-09-30T22:19:33.638033+0000","last_undegraded":"2023-09-30T22:19:33.638033+0000","last_fullsized":"2023-09-30T22:19:33.638033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658895+0000","last_change":"2023-09-30T22:19:33.642133+0000","last_active":"2023-09-30T22:19:33.658895+0000","last_peered":"2023-09-30T22:19:33.658895+0000","last_clean":"2023-09-30T22:19:33.658895+0000","last_became_active":"2023-09-30T22:19:33.641852+0000","last_became_peered":"2023-09-30T22:19:33.641852+0000","last_unstale":"2023-09-30T22:19:33.658895+0000","last_undegraded":"2023-09-30T22:19:33.658895+0000","last_fullsized":"2023-09-30T22:19:33.658895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672798+0000","last_change":"2023-09-30T22:19:33.290927+0000","last_active":"2023-09-30T22:19:33.672798+0000","last_peered":"2023-09-30T22:19:33.672798+0000","last_clean":"2023-09-30T22:19:33.672798+0000","last_became_active":"2023-09-30T22:19:33.290662+0000","last_became_peered":"2023-09-30T22:19:33.290662+0000","last_unstale":"2023-09-30T22:19:33.672798+0000","last_undegraded":"2023-09-30T22:19:33.672798+0000","last_fullsized":"2023-09-30T22:19:33.672798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.639243+0000","last_change":"2023-09-30T22:19:30.190576+0000","last_active":"2023-09-30T22:19:33.639243+0000","last_peered":"2023-09-30T22:19:33.639243+0000","last_clean":"2023-09-30T22:19:33.639243+0000","last_became_active":"2023-09-30T22:19:30.190289+0000","last_became_peered":"2023-09-30T22:19:30.190289+0000","last_unstale":"2023-09-30T22:19:33.639243+0000","last_undegraded":"2023-09-30T22:19:33.639243+0000","last_fullsized":"2023-09-30T22:19:33.639243+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.671605+0000","last_change":"2023-09-30T22:19:33.660579+0000","last_active":"2023-09-30T22:19:33.671605+0000","last_peered":"2023-09-30T22:19:33.671605+0000","last_clean":"2023-09-30T22:19:33.671605+0000","last_became_active":"2023-09-30T22:19:33.659849+0000","last_became_peered":"2023-09-30T22:19:33.659849+0000","last_unstale":"2023-09-30T22:19:33.671605+0000","last_undegraded":"2023-09-30T22:19:33.671605+0000","last_fullsized":"2023-09-30T22:19:33.671605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.660521+0000","last_change":"2023-09-30T22:19:30.188129+0000","last_active":"2023-09-30T22:19:33.660521+0000","last_peered":"2023-09-30T22:19:33.660521+0000","last_clean":"2023-09-30T22:19:33.660521+0000","last_became_active":"2023-09-30T22:19:30.187818+0000","last_became_peered":"2023-09-30T22:19:30.187818+0000","last_unstale":"2023-09-30T22:19:33.660521+0000","last_undegraded":"2023-09-30T22:19:33.660521+0000","last_fullsized":"2023-09-30T22:19:33.660521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-09-30T22:19:34.629718+0000","last_change":"2023-09-30T22:19:33.296579+0000","last_active":"2023-09-30T22:19:34.629718+0000","last_peered":"2023-09-30T22:19:34.629718+0000","last_clean":"2023-09-30T22:19:34.629718+0000","last_became_active":"2023-09-30T22:19:33.295804+0000","last_became_peered":"2023-09-30T22:19:33.295804+0000","last_unstale":"2023-09-30T22:19:34.629718+0000","last_undegraded":"2023-09-30T22:19:34.629718+0000","last_fullsized":"2023-09-30T22:19:34.629718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646166+0000","last_change":"2023-09-30T22:19:33.642976+0000","last_active":"2023-09-30T22:19:33.646166+0000","last_peered":"2023-09-30T22:19:33.646166+0000","last_clean":"2023-09-30T22:19:33.646166+0000","last_became_active":"2023-09-30T22:19:33.642732+0000","last_became_peered":"2023-09-30T22:19:33.642732+0000","last_unstale":"2023-09-30T22:19:33.646166+0000","last_undegraded":"2023-09-30T22:19:33.646166+0000","last_fullsized":"2023-09-30T22:19:33.646166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.648507+0000","last_change":"2023-09-30T22:19:33.293670+0000","last_active":"2023-09-30T22:19:33.648507+0000","last_peered":"2023-09-30T22:19:33.648507+0000","last_clean":"2023-09-30T22:19:33.648507+0000","last_became_active":"2023-09-30T22:19:33.293179+0000","last_became_peered":"2023-09-30T22:19:33.293179+0000","last_unstale":"2023-09-30T22:19:33.648507+0000","last_undegraded":"2023-09-30T22:19:33.648507+0000","last_fullsized":"2023-09-30T22:19:33.648507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.648053+0000","last_change":"2023-09-30T22:19:33.647280+0000","last_active":"2023-09-30T22:19:33.648053+0000","last_peered":"2023-09-30T22:19:33.648053+0000","last_clean":"2023-09-30T22:19:33.648053+0000","last_became_active":"2023-09-30T22:19:33.646935+0000","last_became_peered":"2023-09-30T22:19:33.646935+0000","last_unstale":"2023-09-30T22:19:33.648053+0000","last_undegraded":"2023-09-30T22:19:33.648053+0000","last_fullsized":"2023-09-30T22:19:33.648053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.667484+0000","last_change":"2023-09-30T22:19:33.296231+0000","last_active":"2023-09-30T22:19:33.667484+0000","last_peered":"2023-09-30T22:19:33.667484+0000","last_clean":"2023-09-30T22:19:33.667484+0000","last_became_active":"2023-09-30T22:19:33.295946+0000","last_became_peered":"2023-09-30T22:19:33.295946+0000","last_unstale":"2023-09-30T22:19:33.667484+0000","last_undegraded":"2023-09-30T22:19:33.667484+0000","last_fullsized":"2023-09-30T22:19:33.667484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.670372+0000","last_change":"2023-09-30T22:19:33.665656+0000","last_active":"2023-09-30T22:19:33.670372+0000","last_peered":"2023-09-30T22:19:33.670372+0000","last_clean":"2023-09-30T22:19:33.670372+0000","last_became_active":"2023-09-30T22:19:33.658850+0000","last_became_peered":"2023-09-30T22:19:33.658850+0000","last_unstale":"2023-09-30T22:19:33.670372+0000","last_undegraded":"2023-09-30T22:19:33.670372+0000","last_fullsized":"2023-09-30T22:19:33.670372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.673945+0000","last_change":"2023-09-30T22:19:33.291605+0000","last_active":"2023-09-30T22:19:33.673945+0000","last_peered":"2023-09-30T22:19:33.673945+0000","last_clean":"2023-09-30T22:19:33.673945+0000","last_became_active":"2023-09-30T22:19:33.291048+0000","last_became_peered":"2023-09-30T22:19:33.291048+0000","last_unstale":"2023-09-30T22:19:33.673945+0000","last_undegraded":"2023-09-30T22:19:33.673945+0000","last_fullsized":"2023-09-30T22:19:33.673945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646181+0000","last_change":"2023-09-30T22:19:33.643062+0000","last_active":"2023-09-30T22:19:33.646181+0000","last_peered":"2023-09-30T22:19:33.646181+0000","last_clean":"2023-09-30T22:19:33.646181+0000","last_became_active":"2023-09-30T22:19:33.642791+0000","last_became_peered":"2023-09-30T22:19:33.642791+0000","last_unstale":"2023-09-30T22:19:33.646181+0000","last_undegraded":"2023-09-30T22:19:33.646181+0000","last_fullsized":"2023-09-30T22:19:33.646181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.671521+0000","last_change":"2023-09-30T22:19:33.287971+0000","last_active":"2023-09-30T22:19:33.671521+0000","last_peered":"2023-09-30T22:19:33.671521+0000","last_clean":"2023-09-30T22:19:33.671521+0000","last_became_active":"2023-09-30T22:19:33.287720+0000","last_became_peered":"2023-09-30T22:19:33.287720+0000","last_unstale":"2023-09-30T22:19:33.671521+0000","last_undegraded":"2023-09-30T22:19:33.671521+0000","last_fullsized":"2023-09-30T22:19:33.671521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.674944+0000","last_change":"2023-09-30T22:19:33.670264+0000","last_active":"2023-09-30T22:19:33.674944+0000","last_peered":"2023-09-30T22:19:33.674944+0000","last_clean":"2023-09-30T22:19:33.674944+0000","last_became_active":"2023-09-30T22:19:33.670020+0000","last_became_peered":"2023-09-30T22:19:33.670020+0000","last_unstale":"2023-09-30T22:19:33.674944+0000","last_undegraded":"2023-09-30T22:19:33.674944+0000","last_fullsized":"2023-09-30T22:19:33.674944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.659924+0000","last_change":"2023-09-30T22:19:33.293238+0000","last_active":"2023-09-30T22:19:33.659924+0000","last_peered":"2023-09-30T22:19:33.659924+0000","last_clean":"2023-09-30T22:19:33.659924+0000","last_became_active":"2023-09-30T22:19:33.292967+0000","last_became_peered":"2023-09-30T22:19:33.292967+0000","last_unstale":"2023-09-30T22:19:33.659924+0000","last_undegraded":"2023-09-30T22:19:33.659924+0000","last_fullsized":"2023-09-30T22:19:33.659924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.646415+0000","last_change":"2023-09-30T22:19:33.641684+0000","last_active":"2023-09-30T22:19:33.646415+0000","last_peered":"2023-09-30T22:19:33.646415+0000","last_clean":"2023-09-30T22:19:33.646415+0000","last_became_active":"2023-09-30T22:19:33.641403+0000","last_became_peered":"2023-09-30T22:19:33.641403+0000","last_unstale":"2023-09-30T22:19:33.646415+0000","last_undegraded":"2023-09-30T22:19:33.646415+0000","last_fullsized":"2023-09-30T22:19:33.646415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.654218+0000","last_change":"2023-09-30T22:19:33.644249+0000","last_active":"2023-09-30T22:19:33.654218+0000","last_peered":"2023-09-30T22:19:33.654218+0000","last_clean":"2023-09-30T22:19:33.654218+0000","last_became_active":"2023-09-30T22:19:33.643987+0000","last_became_peered":"2023-09-30T22:19:33.643987+0000","last_unstale":"2023-09-30T22:19:33.654218+0000","last_undegraded":"2023-09-30T22:19:33.654218+0000","last_fullsized":"2023-09-30T22:19:33.654218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.672002+0000","last_change":"2023-09-30T22:19:33.659592+0000","last_active":"2023-09-30T22:19:33.672002+0000","last_peered":"2023-09-30T22:19:33.672002+0000","last_clean":"2023-09-30T22:19:33.672002+0000","last_became_active":"2023-09-30T22:19:33.659324+0000","last_became_peered":"2023-09-30T22:19:33.659324+0000","last_unstale":"2023-09-30T22:19:33.672002+0000","last_undegraded":"2023-09-30T22:19:33.672002+0000","last_fullsized":"2023-09-30T22:19:33.672002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.658095+0000","last_change":"2023-09-30T22:19:33.651082+0000","last_active":"2023-09-30T22:19:33.658095+0000","last_peered":"2023-09-30T22:19:33.658095+0000","last_clean":"2023-09-30T22:19:33.658095+0000","last_became_active":"2023-09-30T22:19:33.650784+0000","last_became_peered":"2023-09-30T22:19:33.650784+0000","last_unstale":"2023-09-30T22:19:33.658095+0000","last_undegraded":"2023-09-30T22:19:33.658095+0000","last_fullsized":"2023-09-30T22:19:33.658095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.677740+0000","last_change":"2023-09-30T22:19:33.673256+0000","last_active":"2023-09-30T22:19:33.677740+0000","last_peered":"2023-09-30T22:19:33.677740+0000","last_clean":"2023-09-30T22:19:33.677740+0000","last_became_active":"2023-09-30T22:19:33.672980+0000","last_became_peered":"2023-09-30T22:19:33.672980+0000","last_unstale":"2023-09-30T22:19:33.677740+0000","last_undegraded":"2023-09-30T22:19:33.677740+0000","last_fullsized":"2023-09-30T22:19:33.677740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T22:19:33.666848+0000","last_change":"2023-09-30T22:19:33.653617+0000","last_active":"2023-09-30T22:19:33.666848+0000","last_peered":"2023-09-30T22:19:33.666848+0000","last_clean":"2023-09-30T22:19:33.666848+0000","last_became_active":"2023-09-30T22:19:33.653009+0000","last_became_peered":"2023-09-30T22:19:33.653009+0000","last_unstale":"2023-09-30T22:19:33.666848+0000","last_undegraded":"2023-09-30T22:19:33.666848+0000","last_fullsized":"2023-09-30T22:19:33.666848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":45214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:19:44.938 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T22:19:44.938 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T22:19:44.938 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T22:19:44.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T22:19:45.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.088+0000 7fb197188700 1 Processor -- start 2023-09-30T22:19:45.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.088+0000 7fb197188700 1 -- start start 2023-09-30T22:19:45.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb197188700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190066310 0x7fb1900976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb197188700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb190128230 0x7fb19012b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb197188700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1900980b0 con 0x7fb190127df0 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb197188700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1900666f0 con 0x7fb190128230 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb197188700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb190065530 con 0x7fb190066310 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb194f24700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190066310 0x7fb1900976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb195725700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb190128230 0x7fb19012b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb18ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb190127df0 0x7fb19012ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41788/0 (socket says 172.21.15.154:41788) 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb194f24700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190066310 0x7fb1900976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60146/0 (socket says 172.21.15.154:60146) 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb195725700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb190128230 0x7fb19012b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37326/0 (socket says 172.21.15.154:37326) 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb18ffff700 1 -- 172.21.15.154:0/3682191951 learned_addr learned my addr 172.21.15.154:0/3682191951 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb195725700 1 -- 172.21.15.154:0/3682191951 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190066310 msgr2=0x7fb1900976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb195725700 1 --2- 172.21.15.154:0/3682191951 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190066310 0x7fb1900976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb195725700 1 -- 172.21.15.154:0/3682191951 >> v1:172.21.15.154:6789/0 conn(0x7fb190127df0 legacy=0x7fb19012ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb195725700 1 -- 172.21.15.154:0/3682191951 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190065850 con 0x7fb190128230 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb18f7fe700 1 -- 172.21.15.154:0/3682191951 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817680128 0 0) 0x7fb1900980b0 con 0x7fb190127df0 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb194f24700 1 --2- 172.21.15.154:0/3682191951 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190066310 0x7fb1900976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb195725700 1 --2- 172.21.15.154:0/3682191951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 0x7fb19012b230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb188009e90 tx=0x7fb188009780).ready entity=mon.0 client_cookie=fea57fe04c4bb66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb18f7fe700 1 -- 172.21.15.154:0/3682191951 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18800e070 con 0x7fb190128230 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb18f7fe700 1 -- 172.21.15.154:0/3682191951 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18800bb20 con 0x7fb190128230 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.089+0000 7fb18f7fe700 1 -- 172.21.15.154:0/3682191951 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18800bea0 con 0x7fb190128230 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.090+0000 7fb197188700 1 -- 172.21.15.154:0/3682191951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 msgr2=0x7fb19012b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.090+0000 7fb197188700 1 --2- 172.21.15.154:0/3682191951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 0x7fb19012b230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb188009e90 tx=0x7fb188009780).stop 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.090+0000 7fb197188700 1 -- 172.21.15.154:0/3682191951 shutdown_connections 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.090+0000 7fb197188700 1 --2- 172.21.15.154:0/3682191951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 0x7fb19012b230 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.090+0000 7fb197188700 1 --2- 172.21.15.154:0/3682191951 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190066310 0x7fb1900976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.090+0000 7fb197188700 1 -- 172.21.15.154:0/3682191951 >> 172.21.15.154:0/3682191951 conn(0x7fb19009bad0 msgr2=0x7fb19009bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.090+0000 7fb197188700 1 -- 172.21.15.154:0/3682191951 shutdown_connections 2023-09-30T22:19:45.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.090+0000 7fb197188700 1 -- 172.21.15.154:0/3682191951 wait complete. 2023-09-30T22:19:45.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.091+0000 7fb197188700 1 Processor -- start 2023-09-30T22:19:45.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.091+0000 7fb197188700 1 -- start start 2023-09-30T22:19:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.091+0000 7fb197188700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb190066310 0x7fb19013a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.091+0000 7fb197188700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190127df0 0x7fb19013a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.091+0000 7fb197188700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 0x7fb19012d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.091+0000 7fb197188700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb190112440 con 0x7fb190128230 2023-09-30T22:19:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.091+0000 7fb197188700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900651c0 con 0x7fb190066310 2023-09-30T22:19:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.091+0000 7fb197188700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb190113790 con 0x7fb190127df0 2023-09-30T22:19:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb194f24700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb190066310 0x7fb19013a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb18ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190127df0 0x7fb19013a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb194f24700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb190066310 0x7fb19013a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54482/0 (socket says 172.21.15.154:54482) 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb194f24700 1 -- 172.21.15.154:0/2641567564 learned_addr learned my addr 172.21.15.154:0/2641567564 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb195725700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 0x7fb19012d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb195725700 1 -- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190127df0 msgr2=0x7fb19013a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb195725700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190127df0 0x7fb19013a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb195725700 1 -- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb190066310 msgr2=0x7fb19013a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb195725700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb190066310 0x7fb19013a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb195725700 1 -- 172.21.15.154:0/2641567564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840092a0 con 0x7fb190128230 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb194f24700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb190066310 0x7fb19013a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb18ffff700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190127df0 0x7fb19013a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb195725700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 0x7fb19012d000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb188014000 tx=0x7fb188009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb18cff9700 1 -- 172.21.15.154:0/2641567564 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188021070 con 0x7fb190128230 2023-09-30T22:19:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb18cff9700 1 -- 172.21.15.154:0/2641567564 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188007080 con 0x7fb190128230 2023-09-30T22:19:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb188009a20 con 0x7fb190128230 2023-09-30T22:19:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb18cff9700 1 -- 172.21.15.154:0/2641567564 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18801d880 con 0x7fb190128230 2023-09-30T22:19:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.092+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1901133f0 con 0x7fb190128230 2023-09-30T22:19:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.093+0000 7fb18cff9700 1 -- 172.21.15.154:0/2641567564 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb188003040 con 0x7fb190128230 2023-09-30T22:19:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.093+0000 7fb18cff9700 1 -- 172.21.15.154:0/2641567564 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb18803c390 con 0x7fb190128230 2023-09-30T22:19:45.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.093+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1901138d0 con 0x7fb190128230 2023-09-30T22:19:45.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.098+0000 7fb18cff9700 1 -- 172.21.15.154:0/2641567564 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb188010310 con 0x7fb190128230 2023-09-30T22:19:45.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.291+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb19012f070 con 0x7fb190128230 2023-09-30T22:19:45.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.291+0000 7fb18cff9700 1 -- 172.21.15.154:0/2641567564 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fb18801bb00 con 0x7fb190128230 2023-09-30T22:19:45.292 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:45.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 >> v1:172.21.15.154:6816/118163 conn(0x7fb17402bb90 legacy=0x7fb17402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 msgr2=0x7fb19012d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 0x7fb19012d000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb188014000 tx=0x7fb188009780).stop 2023-09-30T22:19:45.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 shutdown_connections 2023-09-30T22:19:45.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb190128230 0x7fb19012d000 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb190066310 0x7fb19013a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 --2- 172.21.15.154:0/2641567564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb190127df0 0x7fb19013a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 >> 172.21.15.154:0/2641567564 conn(0x7fb19009bad0 msgr2=0x7fb190128910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 shutdown_connections 2023-09-30T22:19:45.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.293+0000 7fb197188700 1 -- 172.21.15.154:0/2641567564 wait complete. 2023-09-30T22:19:45.305 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T22:19:45.305 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T22:19:45.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:45.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e9447700 1 Processor -- start 2023-09-30T22:19:45.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e9447700 1 -- start start 2023-09-30T22:19:45.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e9447700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e4127b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e9447700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e412b150 0x7f27e4132d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e9447700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e4065770 con 0x7f27e4128070 2023-09-30T22:19:45.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e9447700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4097ae0 con 0x7f27e412b150 2023-09-30T22:19:45.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e9447700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4097e30 con 0x7f27e4097700 2023-09-30T22:19:45.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e412b150 0x7f27e4132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e4127b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e27fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f27e4128070 0x7f27e412aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51012/0 (socket says 172.21.15.154:51012) 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.428+0000 7f27e27fc700 1 -- 172.21.15.154:0/1524064075 learned_addr learned my addr 172.21.15.154:0/1524064075 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e1ffb700 1 -- 172.21.15.154:0/1524064075 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821349237 0 0) 0x7f27e4065770 con 0x7f27e4128070 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e1ffb700 1 -- 172.21.15.154:0/1524064075 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27cc0033f0 con 0x7f27e4128070 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e37fe700 1 -- 172.21.15.154:0/1524064075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 msgr2=0x7f27e4127b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e37fe700 1 --2- 172.21.15.154:0/1524064075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e4127b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e37fe700 1 -- 172.21.15.154:0/1524064075 >> v1:172.21.15.154:6789/0 conn(0x7f27e4128070 legacy=0x7f27e412aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e37fe700 1 -- 172.21.15.154:0/1524064075 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e406a9b0 con 0x7f27e412b150 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e2ffd700 1 --2- 172.21.15.154:0/1524064075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e4127b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e37fe700 1 --2- 172.21.15.154:0/1524064075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e412b150 0x7f27e4132d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f27dc009e90 tx=0x7f27dc009780).ready entity=mon.1 client_cookie=d9d8808c42607e0f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e1ffb700 1 -- 172.21.15.154:0/1524064075 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00e070 con 0x7f27e412b150 2023-09-30T22:19:45.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e1ffb700 1 -- 172.21.15.154:0/1524064075 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc00bab0 con 0x7f27e412b150 2023-09-30T22:19:45.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.429+0000 7f27e1ffb700 1 -- 172.21.15.154:0/1524064075 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00be30 con 0x7f27e412b150 2023-09-30T22:19:45.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.430+0000 7f27e9447700 1 -- 172.21.15.154:0/1524064075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e412b150 msgr2=0x7f27e4132d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.430+0000 7f27e9447700 1 --2- 172.21.15.154:0/1524064075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e412b150 0x7f27e4132d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f27dc009e90 tx=0x7f27dc009780).stop 2023-09-30T22:19:45.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.430+0000 7f27e9447700 1 -- 172.21.15.154:0/1524064075 shutdown_connections 2023-09-30T22:19:45.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.430+0000 7f27e9447700 1 --2- 172.21.15.154:0/1524064075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e412b150 0x7f27e4132d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.430+0000 7f27e9447700 1 --2- 172.21.15.154:0/1524064075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e4127b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.430+0000 7f27e9447700 1 -- 172.21.15.154:0/1524064075 >> 172.21.15.154:0/1524064075 conn(0x7f27e4098580 msgr2=0x7f27e4098990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.430+0000 7f27e9447700 1 -- 172.21.15.154:0/1524064075 shutdown_connections 2023-09-30T22:19:45.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.430+0000 7f27e9447700 1 -- 172.21.15.154:0/1524064075 wait complete. 2023-09-30T22:19:45.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e9447700 1 Processor -- start 2023-09-30T22:19:45.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e9447700 1 -- start start 2023-09-30T22:19:45.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e9447700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e413a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e9447700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e4128070 0x7f27e413a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e9447700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e412b150 0x7f27e413aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e9447700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e413af80 con 0x7f27e412b150 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e9447700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4113700 con 0x7f27e4128070 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e9447700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4128b70 con 0x7f27e4097700 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e4128070 0x7f27e413a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e413a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e412b150 0x7f27e413aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e413a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34426/0 (socket says 172.21.15.154:34426) 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e4128070 0x7f27e413a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49648/0 (socket says 172.21.15.154:49648) 2023-09-30T22:19:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.431+0000 7f27e2ffd700 1 -- 172.21.15.154:0/267558736 learned_addr learned my addr 172.21.15.154:0/267558736 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27e2ffd700 1 -- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e4128070 msgr2=0x7f27e413a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27e2ffd700 1 --2- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e4128070 0x7f27e413a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27e2ffd700 1 -- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e412b150 msgr2=0x7f27e413aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27e2ffd700 1 --2- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e412b150 0x7f27e413aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27e2ffd700 1 -- 172.21.15.154:0/267558736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40092a0 con 0x7f27e4097700 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27e2ffd700 1 --2- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e413a0b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f27d400ea20 tx=0x7f27d4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27caffd700 1 -- 172.21.15.154:0/267558736 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d400ee60 con 0x7f27e4097700 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27caffd700 1 -- 172.21.15.154:0/267558736 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4009600 con 0x7f27e4097700 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc009a20 con 0x7f27e4097700 2023-09-30T22:19:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27caffd700 1 -- 172.21.15.154:0/267558736 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d400ca60 con 0x7f27e4097700 2023-09-30T22:19:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.432+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e4112cb0 con 0x7f27e4097700 2023-09-30T22:19:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.433+0000 7f27caffd700 1 -- 172.21.15.154:0/267558736 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f27d401b400 con 0x7f27e4097700 2023-09-30T22:19:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.433+0000 7f27caffd700 1 -- 172.21.15.154:0/267558736 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f27d403b410 con 0x7f27e4097700 2023-09-30T22:19:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.433+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e4065990 con 0x7f27e4097700 2023-09-30T22:19:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.437+0000 7f27caffd700 1 -- 172.21.15.154:0/267558736 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f27d4016030 con 0x7f27e4097700 2023-09-30T22:19:45.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.596+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27e405a260 con 0x7f27e4097700 2023-09-30T22:19:45.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.597+0000 7f27caffd700 1 -- 172.21.15.154:0/267558736 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f27d4029090 con 0x7f27e4097700 2023-09-30T22:19:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:45.597 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:34.624706+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:45.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.598+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 >> v1:172.21.15.154:6816/118163 conn(0x7f27d002bb60 legacy=0x7f27d002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.598+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 msgr2=0x7f27e413a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.598+0000 7f27e9447700 1 --2- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e413a0b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f27d400ea20 tx=0x7f27d4009060).stop 2023-09-30T22:19:45.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.598+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 shutdown_connections 2023-09-30T22:19:45.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.598+0000 7f27e9447700 1 --2- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e412b150 0x7f27e413aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.598+0000 7f27e9447700 1 --2- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27e4097700 0x7f27e413a0b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.599+0000 7f27e9447700 1 --2- 172.21.15.154:0/267558736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e4128070 0x7f27e413a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.599+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 >> 172.21.15.154:0/267558736 conn(0x7f27e4098580 msgr2=0x7f27e412a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.599+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 shutdown_connections 2023-09-30T22:19:45.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.599+0000 7f27e9447700 1 -- 172.21.15.154:0/267558736 wait complete. 2023-09-30T22:19:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:19:27.265135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:19:28.184247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:19:32.024148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:19:32.601719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:19:45.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:19:45.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.731+0000 7f9d12e3f700 1 Processor -- start 2023-09-30T22:19:45.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.731+0000 7f9d12e3f700 1 -- start start 2023-09-30T22:19:45.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d12e3f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c095e70 0x7f9d0c096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d12e3f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c12f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d12e3f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c094ba0 con 0x7f9d0c093950 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d12e3f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c092e90 con 0x7f9d0c12d250 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d12e3f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c096b60 con 0x7f9d0c095e70 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d10bdb700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9d0c093950 0x7f9d0c095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51028/0 (socket says 172.21.15.154:51028) 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d10bdb700 1 -- 172.21.15.154:0/3831026743 learned_addr learned my addr 172.21.15.154:0/3831026743 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d113dc700 1 --2- 172.21.15.154:0/3831026743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c12f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d0bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c095e70 0x7f9d0c096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d0b7fe700 1 -- 172.21.15.154:0/3831026743 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859782812 0 0) 0x7f9d0c094ba0 con 0x7f9d0c093950 2023-09-30T22:19:45.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d113dc700 1 -- 172.21.15.154:0/3831026743 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c095e70 msgr2=0x7f9d0c096250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d113dc700 1 --2- 172.21.15.154:0/3831026743 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c095e70 0x7f9d0c096250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d113dc700 1 -- 172.21.15.154:0/3831026743 >> v1:172.21.15.154:6789/0 conn(0x7f9d0c093950 legacy=0x7f9d0c095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.732+0000 7f9d113dc700 1 -- 172.21.15.154:0/3831026743 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c093150 con 0x7f9d0c12d250 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d113dc700 1 --2- 172.21.15.154:0/3831026743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c12f640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9d04009e90 tx=0x7f9d04009780).ready entity=mon.1 client_cookie=3cc54fd508e3d434 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d0b7fe700 1 -- 172.21.15.154:0/3831026743 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0400e070 con 0x7f9d0c12d250 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d0b7fe700 1 -- 172.21.15.154:0/3831026743 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0400bb60 con 0x7f9d0c12d250 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d0b7fe700 1 -- 172.21.15.154:0/3831026743 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04012410 con 0x7f9d0c12d250 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d12e3f700 1 -- 172.21.15.154:0/3831026743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 msgr2=0x7f9d0c12f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d12e3f700 1 --2- 172.21.15.154:0/3831026743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c12f640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9d04009e90 tx=0x7f9d04009780).stop 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d12e3f700 1 -- 172.21.15.154:0/3831026743 shutdown_connections 2023-09-30T22:19:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d12e3f700 1 --2- 172.21.15.154:0/3831026743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c12f640 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d12e3f700 1 --2- 172.21.15.154:0/3831026743 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c095e70 0x7f9d0c096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d12e3f700 1 -- 172.21.15.154:0/3831026743 >> 172.21.15.154:0/3831026743 conn(0x7f9d0c09aa50 msgr2=0x7f9d0c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d12e3f700 1 -- 172.21.15.154:0/3831026743 shutdown_connections 2023-09-30T22:19:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.733+0000 7f9d12e3f700 1 -- 172.21.15.154:0/3831026743 wait complete. 2023-09-30T22:19:45.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.734+0000 7f9d12e3f700 1 Processor -- start 2023-09-30T22:19:45.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.734+0000 7f9d12e3f700 1 -- start start 2023-09-30T22:19:45.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d12e3f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c093950 0x7f9d0c12cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d12e3f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c095e70 0x7f9d0c118de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d12e3f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c1192d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d12e3f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c11bdc0 con 0x7f9d0c095e70 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d12e3f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c09a3e0 con 0x7f9d0c12d250 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d12e3f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c092410 con 0x7f9d0c093950 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d10bdb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c093950 0x7f9d0c12cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d10bdb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c093950 0x7f9d0c12cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34440/0 (socket says 172.21.15.154:34440) 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d113dc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c1192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d10bdb700 1 -- 172.21.15.154:0/978202097 learned_addr learned my addr 172.21.15.154:0/978202097 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d0bfff700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c095e70 0x7f9d0c118de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d113dc700 1 -- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c093950 msgr2=0x7f9d0c12cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d113dc700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c093950 0x7f9d0c12cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d113dc700 1 -- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c095e70 msgr2=0x7f9d0c118de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d113dc700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c095e70 0x7f9d0c118de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d113dc700 1 -- 172.21.15.154:0/978202097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d04009a20 con 0x7f9d0c12d250 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d0bfff700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c095e70 0x7f9d0c118de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d10bdb700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c093950 0x7f9d0c12cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d113dc700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c1192d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9d04014000 tx=0x7f9d04009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d08ff9700 1 -- 172.21.15.154:0/978202097 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04007080 con 0x7f9d0c12d250 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d08ff9700 1 -- 172.21.15.154:0/978202097 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0401d630 con 0x7f9d0c12d250 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0c062f80 con 0x7f9d0c12d250 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d08ff9700 1 -- 172.21.15.154:0/978202097 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0401d9d0 con 0x7f9d0c12d250 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.735+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c063670 con 0x7f9d0c12d250 2023-09-30T22:19:45.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.737+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c063860 con 0x7f9d0c12d250 2023-09-30T22:19:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.737+0000 7f9d08ff9700 1 -- 172.21.15.154:0/978202097 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9d04003040 con 0x7f9d0c12d250 2023-09-30T22:19:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.737+0000 7f9d08ff9700 1 -- 172.21.15.154:0/978202097 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9d0403d820 con 0x7f9d0c12d250 2023-09-30T22:19:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.741+0000 7f9d08ff9700 1 -- 172.21.15.154:0/978202097 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9d04011370 con 0x7f9d0c12d250 2023-09-30T22:19:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.899+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9d0c05a260 con 0x7f9d0c12d250 2023-09-30T22:19:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.899+0000 7f9d08ff9700 1 -- 172.21.15.154:0/978202097 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9d0401cb70 con 0x7f9d0c12d250 2023-09-30T22:19:45.899 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-09-30T22:19:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 >> v1:172.21.15.154:6816/118163 conn(0x7f9cf002bb90 legacy=0x7f9cf002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 msgr2=0x7f9d0c1192d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c1192d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9d04014000 tx=0x7f9d04009780).stop 2023-09-30T22:19:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 shutdown_connections 2023-09-30T22:19:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d0c12d250 0x7f9d0c1192d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d0c093950 0x7f9d0c12cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 --2- 172.21.15.154:0/978202097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c095e70 0x7f9d0c118de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 >> 172.21.15.154:0/978202097 conn(0x7f9d0c09aa50 msgr2=0x7f9d0c0692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 shutdown_connections 2023-09-30T22:19:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:45.901+0000 7f9d12e3f700 1 -- 172.21.15.154:0/978202097 wait complete. 2023-09-30T22:19:45.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:19:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.032+0000 7f4e4f42c700 1 Processor -- start 2023-09-30T22:19:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4f42c700 1 -- start start 2023-09-30T22:19:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4f42c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e4805f560 0x7f4e4812ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4f42c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b790 0x7f4e480964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4f42c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e48066f90 con 0x7f4e4812b370 2023-09-30T22:19:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4f42c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4805f940 con 0x7f4e4805f560 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4f42c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48067650 con 0x7f4e4812b790 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4d9c9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b790 0x7f4e480964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4d1c8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e4805f560 0x7f4e4812ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4c9c7700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4e4812b370 0x7f4e48095d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51040/0 (socket says 172.21.15.154:51040) 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4d9c9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b790 0x7f4e480964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34442/0 (socket says 172.21.15.154:34442) 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4c9c7700 1 -- 172.21.15.154:0/621786641 learned_addr learned my addr 172.21.15.154:0/621786641 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4d1c8700 1 -- 172.21.15.154:0/621786641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b790 msgr2=0x7f4e480964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4d1c8700 1 --2- 172.21.15.154:0/621786641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b790 0x7f4e480964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4d1c8700 1 -- 172.21.15.154:0/621786641 >> v1:172.21.15.154:6789/0 conn(0x7f4e4812b370 legacy=0x7f4e48095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e3ffff700 1 -- 172.21.15.154:0/621786641 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696931837 0 0) 0x7f4e48066f90 con 0x7f4e4812b370 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4d1c8700 1 -- 172.21.15.154:0/621786641 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48067910 con 0x7f4e4805f560 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.033+0000 7f4e4d9c9700 1 --2- 172.21.15.154:0/621786641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b790 0x7f4e480964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e4d1c8700 1 --2- 172.21.15.154:0/621786641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4805f560 0x7f4e4812ae80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4e44009760 tx=0x7f4e44009060).ready entity=mon.0 client_cookie=5ebaa90066718369 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e3ffff700 1 -- 172.21.15.154:0/621786641 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400f510 con 0x7f4e4805f560 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e3ffff700 1 -- 172.21.15.154:0/621786641 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4400f670 con 0x7f4e4805f560 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e3ffff700 1 -- 172.21.15.154:0/621786641 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400f9f0 con 0x7f4e4805f560 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e4f42c700 1 -- 172.21.15.154:0/621786641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4805f560 msgr2=0x7f4e4812ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e4f42c700 1 --2- 172.21.15.154:0/621786641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4805f560 0x7f4e4812ae80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4e44009760 tx=0x7f4e44009060).stop 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e4f42c700 1 -- 172.21.15.154:0/621786641 shutdown_connections 2023-09-30T22:19:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e4f42c700 1 --2- 172.21.15.154:0/621786641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b790 0x7f4e480964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e4f42c700 1 --2- 172.21.15.154:0/621786641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4805f560 0x7f4e4812ae80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e4f42c700 1 -- 172.21.15.154:0/621786641 >> 172.21.15.154:0/621786641 conn(0x7f4e4809a1c0 msgr2=0x7f4e4809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e4f42c700 1 -- 172.21.15.154:0/621786641 shutdown_connections 2023-09-30T22:19:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.034+0000 7f4e4f42c700 1 -- 172.21.15.154:0/621786641 wait complete. 2023-09-30T22:19:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.035+0000 7f4e4f42c700 1 Processor -- start 2023-09-30T22:19:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.035+0000 7f4e4f42c700 1 -- start start 2023-09-30T22:19:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4f42c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e4805f560 0x7f4e4811b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4f42c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b370 0x7f4e481173c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4f42c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4812b790 0x7f4e481178b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4f42c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480671c0 con 0x7f4e4812b790 2023-09-30T22:19:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4f42c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4811a850 con 0x7f4e4805f560 2023-09-30T22:19:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4f42c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4811adf0 con 0x7f4e4812b370 2023-09-30T22:19:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4d1c8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e4805f560 0x7f4e4811b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4c9c7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b370 0x7f4e481173c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4d1c8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e4805f560 0x7f4e4811b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49688/0 (socket says 172.21.15.154:49688) 2023-09-30T22:19:46.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4d1c8700 1 -- 172.21.15.154:0/1354843038 learned_addr learned my addr 172.21.15.154:0/1354843038 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:46.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.036+0000 7f4e4d9c9700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4812b790 0x7f4e481178b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4c9c7700 1 -- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e4805f560 msgr2=0x7f4e4811b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4c9c7700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e4805f560 0x7f4e4811b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4c9c7700 1 -- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4812b790 msgr2=0x7f4e481178b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4c9c7700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4812b790 0x7f4e481178b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4c9c7700 1 -- 172.21.15.154:0/1354843038 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e40009a20 con 0x7f4e4812b370 2023-09-30T22:19:46.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4d9c9700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4812b790 0x7f4e481178b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:46.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4d1c8700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e4805f560 0x7f4e4811b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:46.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4c9c7700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b370 0x7f4e481173c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4e38001eb0 tx=0x7f4e38007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:46.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e3d7fa700 1 -- 172.21.15.154:0/1354843038 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800ce10 con 0x7f4e4812b370 2023-09-30T22:19:46.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e3d7fa700 1 -- 172.21.15.154:0/1354843038 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e380072e0 con 0x7f4e4812b370 2023-09-30T22:19:46.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e440092a0 con 0x7f4e4812b370 2023-09-30T22:19:46.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e3d7fa700 1 -- 172.21.15.154:0/1354843038 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380057a0 con 0x7f4e4812b370 2023-09-30T22:19:46.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.037+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e481187c0 con 0x7f4e4812b370 2023-09-30T22:19:46.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.038+0000 7f4e3d7fa700 1 -- 172.21.15.154:0/1354843038 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4e38005bd0 con 0x7f4e4812b370 2023-09-30T22:19:46.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.038+0000 7f4e3d7fa700 1 -- 172.21.15.154:0/1354843038 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4e3803a650 con 0x7f4e4812b370 2023-09-30T22:19:46.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.038+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4805a260 con 0x7f4e4812b370 2023-09-30T22:19:46.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.042+0000 7f4e3d7fa700 1 -- 172.21.15.154:0/1354843038 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4e38018030 con 0x7f4e4812b370 2023-09-30T22:19:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.200+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4e48128420 con 0x7f4e4812b370 2023-09-30T22:19:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.200+0000 7f4e3d7fa700 1 -- 172.21.15.154:0/1354843038 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4e3801b750 con 0x7f4e4812b370 2023-09-30T22:19:46.200 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 8 2023-09-30T22:19:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 >> v1:172.21.15.154:6816/118163 conn(0x7f4e2c02bb60 legacy=0x7f4e2c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b370 msgr2=0x7f4e481173c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b370 0x7f4e481173c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4e38001eb0 tx=0x7f4e38007b90).stop 2023-09-30T22:19:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 shutdown_connections 2023-09-30T22:19:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e4812b790 0x7f4e481178b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e4805f560 0x7f4e4811b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 --2- 172.21.15.154:0/1354843038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e4812b370 0x7f4e481173c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 >> 172.21.15.154:0/1354843038 conn(0x7f4e4809a1c0 msgr2=0x7f4e480987c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 shutdown_connections 2023-09-30T22:19:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.202+0000 7f4e4f42c700 1 -- 172.21.15.154:0/1354843038 wait complete. 2023-09-30T22:19:46.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:19:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.333+0000 7f35269dd700 1 Processor -- start 2023-09-30T22:19:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.333+0000 7f35269dd700 1 -- start start 2023-09-30T22:19:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.333+0000 7f35269dd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3520095da0 0x7f35200961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.333+0000 7f35269dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35200966b0 0x7f3520132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.333+0000 7f35269dd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3520091980 con 0x7f3520062b00 2023-09-30T22:19:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.333+0000 7f35269dd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35200973f0 con 0x7f3520095da0 2023-09-30T22:19:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.333+0000 7f35269dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3520062ee0 con 0x7f35200966b0 2023-09-30T22:19:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f351f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3520095da0 0x7f35200961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f351ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3520062b00 0x7f3520095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51054/0 (socket says 172.21.15.154:51054) 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f3524f7a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35200966b0 0x7f3520132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f351ffff700 1 -- 172.21.15.154:0/1538859559 learned_addr learned my addr 172.21.15.154:0/1538859559 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f351effd700 1 -- 172.21.15.154:0/1538859559 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063185409 0 0) 0x7f3520091980 con 0x7f3520062b00 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f3524f7a700 1 -- 172.21.15.154:0/1538859559 >> v2:172.21.15.154:3300/0 conn(0x7f3520095da0 msgr2=0x7f35200961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f3524f7a700 1 --2- 172.21.15.154:0/1538859559 >> v2:172.21.15.154:3300/0 conn(0x7f3520095da0 0x7f35200961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f3524f7a700 1 -- 172.21.15.154:0/1538859559 >> v1:172.21.15.154:6789/0 conn(0x7f3520062b00 legacy=0x7f3520095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f3524f7a700 1 -- 172.21.15.154:0/1538859559 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520092310 con 0x7f35200966b0 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f351f7fe700 1 --2- 172.21.15.154:0/1538859559 >> v2:172.21.15.154:3300/0 conn(0x7f3520095da0 0x7f35200961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f3524f7a700 1 --2- 172.21.15.154:0/1538859559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35200966b0 0x7f3520132290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3518009e60 tx=0x7f3518009780).ready entity=mon.1 client_cookie=d2d09279ab41ec5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f351effd700 1 -- 172.21.15.154:0/1538859559 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800e070 con 0x7f35200966b0 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f351effd700 1 -- 172.21.15.154:0/1538859559 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351800bb60 con 0x7f35200966b0 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.334+0000 7f351effd700 1 -- 172.21.15.154:0/1538859559 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518012410 con 0x7f35200966b0 2023-09-30T22:19:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.335+0000 7f35269dd700 1 -- 172.21.15.154:0/1538859559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35200966b0 msgr2=0x7f3520132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.335+0000 7f35269dd700 1 --2- 172.21.15.154:0/1538859559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35200966b0 0x7f3520132290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f3518009e60 tx=0x7f3518009780).stop 2023-09-30T22:19:46.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.335+0000 7f35269dd700 1 -- 172.21.15.154:0/1538859559 shutdown_connections 2023-09-30T22:19:46.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.335+0000 7f35269dd700 1 --2- 172.21.15.154:0/1538859559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35200966b0 0x7f3520132290 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.335+0000 7f35269dd700 1 --2- 172.21.15.154:0/1538859559 >> v2:172.21.15.154:3300/0 conn(0x7f3520095da0 0x7f35200961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.335+0000 7f35269dd700 1 -- 172.21.15.154:0/1538859559 >> 172.21.15.154:0/1538859559 conn(0x7f352009aa50 msgr2=0x7f352009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:46.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.335+0000 7f35269dd700 1 -- 172.21.15.154:0/1538859559 shutdown_connections 2023-09-30T22:19:46.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.335+0000 7f35269dd700 1 -- 172.21.15.154:0/1538859559 wait complete. 2023-09-30T22:19:46.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.335+0000 7f35269dd700 1 Processor -- start 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f35269dd700 1 -- start start 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f35269dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520119390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f35269dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520095da0 0x7f35201153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f35269dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35200966b0 0x7f35201158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f35269dd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3520096da0 con 0x7f3520062b00 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f35269dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352012d530 con 0x7f3520095da0 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f35269dd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3520118e90 con 0x7f35200966b0 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f351f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520095da0 0x7f35201153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f351ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520119390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f351f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520095da0 0x7f35201153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49702/0 (socket says 172.21.15.154:49702) 2023-09-30T22:19:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f351f7fe700 1 -- 172.21.15.154:0/1912768439 learned_addr learned my addr 172.21.15.154:0/1912768439 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f3524f7a700 1 --2- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35200966b0 0x7f35201158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f351ffff700 1 -- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35200966b0 msgr2=0x7f35201158e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f351ffff700 1 --2- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35200966b0 0x7f35201158e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f351ffff700 1 -- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520095da0 msgr2=0x7f35201153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f351ffff700 1 --2- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520095da0 0x7f35201153f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.336+0000 7f351ffff700 1 -- 172.21.15.154:0/1912768439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100092a0 con 0x7f3520062b00 2023-09-30T22:19:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.337+0000 7f351ffff700 1 --2- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520119390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3514000c00 tx=0x7f3514007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.337+0000 7f3507fff700 1 -- 172.21.15.154:0/1912768439 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35140070d0 con 0x7f3520062b00 2023-09-30T22:19:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.337+0000 7f3507fff700 1 -- 172.21.15.154:0/1912768439 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514007250 con 0x7f3520062b00 2023-09-30T22:19:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.337+0000 7f3507fff700 1 -- 172.21.15.154:0/1912768439 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514007610 con 0x7f3520062b00 2023-09-30T22:19:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.337+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3518009a20 con 0x7f3520062b00 2023-09-30T22:19:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.337+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35201188f0 con 0x7f3520062b00 2023-09-30T22:19:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.338+0000 7f3507fff700 1 -- 172.21.15.154:0/1912768439 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f35140059b0 con 0x7f3520062b00 2023-09-30T22:19:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.338+0000 7f3507fff700 1 -- 172.21.15.154:0/1912768439 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f351403a520 con 0x7f3520062b00 2023-09-30T22:19:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.338+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3520118cb0 con 0x7f3520062b00 2023-09-30T22:19:46.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.342+0000 7f3507fff700 1 -- 172.21.15.154:0/1912768439 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3514013970 con 0x7f3520062b00 2023-09-30T22:19:46.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.498+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f352005a260 con 0x7f3520062b00 2023-09-30T22:19:46.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.499+0000 7f3507fff700 1 -- 172.21.15.154:0/1912768439 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3514010300 con 0x7f3520062b00 2023-09-30T22:19:46.499 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-09-30T22:19:46.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.500+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 >> v1:172.21.15.154:6816/118163 conn(0x7f350c02bb30 legacy=0x7f350c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.500+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 msgr2=0x7f3520119390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.500+0000 7f35269dd700 1 --2- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520119390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3514000c00 tx=0x7f3514007b90).stop 2023-09-30T22:19:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.500+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 shutdown_connections 2023-09-30T22:19:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.500+0000 7f35269dd700 1 --2- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35200966b0 0x7f35201158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.500+0000 7f35269dd700 1 --2- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520119390 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.500+0000 7f35269dd700 1 --2- 172.21.15.154:0/1912768439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520095da0 0x7f35201153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.501+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 >> 172.21.15.154:0/1912768439 conn(0x7f352009aa50 msgr2=0x7f352012fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.501+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 shutdown_connections 2023-09-30T22:19:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.501+0000 7f35269dd700 1 -- 172.21.15.154:0/1912768439 wait complete. 2023-09-30T22:19:46.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:19:46.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.632+0000 7f5aae4d4700 1 Processor -- start 2023-09-30T22:19:46.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.632+0000 7f5aae4d4700 1 -- start start 2023-09-30T22:19:46.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aae4d4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa8095da0 0x7f5aa80961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aae4d4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa80966b0 0x7f5aa8132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aae4d4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa8091980 con 0x7f5aa8062b00 2023-09-30T22:19:46.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aae4d4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80973f0 con 0x7f5aa8095da0 2023-09-30T22:19:46.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aae4d4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8062ee0 con 0x7f5aa80966b0 2023-09-30T22:19:46.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aa77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa8095da0 0x7f5aa80961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aaca71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa80966b0 0x7f5aa8132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aa77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa8095da0 0x7f5aa80961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49712/0 (socket says 172.21.15.154:49712) 2023-09-30T22:19:46.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aaca71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa80966b0 0x7f5aa8132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34470/0 (socket says 172.21.15.154:34470) 2023-09-30T22:19:46.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aa77fe700 1 -- 172.21.15.154:0/342350206 learned_addr learned my addr 172.21.15.154:0/342350206 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:46.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aa6ffd700 1 -- 172.21.15.154:0/342350206 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322481830 0 0) 0x7f5aa8091980 con 0x7f5aa8062b00 2023-09-30T22:19:46.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aaca71700 1 -- 172.21.15.154:0/342350206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa8095da0 msgr2=0x7f5aa80961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aaca71700 1 --2- 172.21.15.154:0/342350206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa8095da0 0x7f5aa80961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aaca71700 1 -- 172.21.15.154:0/342350206 >> v1:172.21.15.154:6789/0 conn(0x7f5aa8062b00 legacy=0x7f5aa8095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aaca71700 1 -- 172.21.15.154:0/342350206 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa8092310 con 0x7f5aa80966b0 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aa77fe700 1 --2- 172.21.15.154:0/342350206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa8095da0 0x7f5aa80961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.633+0000 7f5aaca71700 1 --2- 172.21.15.154:0/342350206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa80966b0 0x7f5aa8132290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5aa0009e90 tx=0x7f5aa0009780).ready entity=mon.2 client_cookie=9552310538da60cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aa6ffd700 1 -- 172.21.15.154:0/342350206 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000e070 con 0x7f5aa80966b0 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aa6ffd700 1 -- 172.21.15.154:0/342350206 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa000bb60 con 0x7f5aa80966b0 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aa6ffd700 1 -- 172.21.15.154:0/342350206 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0012410 con 0x7f5aa80966b0 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aae4d4700 1 -- 172.21.15.154:0/342350206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa80966b0 msgr2=0x7f5aa8132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aae4d4700 1 --2- 172.21.15.154:0/342350206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa80966b0 0x7f5aa8132290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5aa0009e90 tx=0x7f5aa0009780).stop 2023-09-30T22:19:46.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aae4d4700 1 -- 172.21.15.154:0/342350206 shutdown_connections 2023-09-30T22:19:46.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aae4d4700 1 --2- 172.21.15.154:0/342350206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa80966b0 0x7f5aa8132290 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aae4d4700 1 --2- 172.21.15.154:0/342350206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa8095da0 0x7f5aa80961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aae4d4700 1 -- 172.21.15.154:0/342350206 >> 172.21.15.154:0/342350206 conn(0x7f5aa809aa50 msgr2=0x7f5aa809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:46.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aae4d4700 1 -- 172.21.15.154:0/342350206 shutdown_connections 2023-09-30T22:19:46.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.634+0000 7f5aae4d4700 1 -- 172.21.15.154:0/342350206 wait complete. 2023-09-30T22:19:46.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.635+0000 7f5aae4d4700 1 Processor -- start 2023-09-30T22:19:46.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aae4d4700 1 -- start start 2023-09-30T22:19:46.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aae4d4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aa8062b00 0x7f5aa812d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aae4d4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa8095da0 0x7f5aa8114f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aae4d4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa80966b0 0x7f5aa8115460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aae4d4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8116430 con 0x7f5aa8062b00 2023-09-30T22:19:46.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aae4d4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa81175a0 con 0x7f5aa80966b0 2023-09-30T22:19:46.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aae4d4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8096dd0 con 0x7f5aa8095da0 2023-09-30T22:19:46.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aa7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aa8062b00 0x7f5aa812d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aaca71700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa80966b0 0x7f5aa8115460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aa7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aa8062b00 0x7f5aa812d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38564/0 (socket says 172.21.15.154:38564) 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aa7fff700 1 -- 172.21.15.154:0/278510358 learned_addr learned my addr 172.21.15.154:0/278510358 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aaca71700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa80966b0 0x7f5aa8115460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49728/0 (socket says 172.21.15.154:49728) 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.636+0000 7f5aa77fe700 1 --2- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa8095da0 0x7f5aa8114f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5aaca71700 1 -- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa8095da0 msgr2=0x7f5aa8114f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5aaca71700 1 --2- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa8095da0 0x7f5aa8114f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5aaca71700 1 -- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aa8062b00 msgr2=0x7f5aa812d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5aaca71700 1 --2- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aa8062b00 0x7f5aa812d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5aaca71700 1 -- 172.21.15.154:0/278510358 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98009370 con 0x7f5aa80966b0 2023-09-30T22:19:46.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5aaca71700 1 --2- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa80966b0 0x7f5aa8115460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5aa0014000 tx=0x7f5aa0009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:46.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5a8ffff700 1 -- 172.21.15.154:0/278510358 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0021070 con 0x7f5aa80966b0 2023-09-30T22:19:46.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5a8ffff700 1 -- 172.21.15.154:0/278510358 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa001c660 con 0x7f5aa80966b0 2023-09-30T22:19:46.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa0009a20 con 0x7f5aa80966b0 2023-09-30T22:19:46.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5a8ffff700 1 -- 172.21.15.154:0/278510358 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa001ca20 con 0x7f5aa80966b0 2023-09-30T22:19:46.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.637+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa81190f0 con 0x7f5aa80966b0 2023-09-30T22:19:46.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.638+0000 7f5a8ffff700 1 -- 172.21.15.154:0/278510358 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5aa0003040 con 0x7f5aa80966b0 2023-09-30T22:19:46.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.638+0000 7f5a8ffff700 1 -- 172.21.15.154:0/278510358 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5aa003c890 con 0x7f5aa80966b0 2023-09-30T22:19:46.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.638+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa805a260 con 0x7f5aa80966b0 2023-09-30T22:19:46.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.642+0000 7f5a8ffff700 1 -- 172.21.15.154:0/278510358 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5aa001d420 con 0x7f5aa80966b0 2023-09-30T22:19:46.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.801+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5aa8115d70 con 0x7f5aa80966b0 2023-09-30T22:19:46.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.802+0000 7f5a8ffff700 1 -- 172.21.15.154:0/278510358 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5aa0011b60 con 0x7f5aa80966b0 2023-09-30T22:19:46.801 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-09-30T22:19:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.803+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 >> v1:172.21.15.154:6816/118163 conn(0x7f5a9402bb60 legacy=0x7f5a9402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.803+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa80966b0 msgr2=0x7f5aa8115460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.803+0000 7f5aae4d4700 1 --2- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa80966b0 0x7f5aa8115460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5aa0014000 tx=0x7f5aa0009780).stop 2023-09-30T22:19:46.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.803+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 shutdown_connections 2023-09-30T22:19:46.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.803+0000 7f5aae4d4700 1 --2- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aa80966b0 0x7f5aa8115460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.803+0000 7f5aae4d4700 1 --2- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aa8062b00 0x7f5aa812d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.803+0000 7f5aae4d4700 1 --2- 172.21.15.154:0/278510358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5aa8095da0 0x7f5aa8114f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.803+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 >> 172.21.15.154:0/278510358 conn(0x7f5aa809aa50 msgr2=0x7f5aa8131f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:46.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.804+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 shutdown_connections 2023-09-30T22:19:46.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.804+0000 7f5aae4d4700 1 -- 172.21.15.154:0/278510358 wait complete. 2023-09-30T22:19:46.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:19:46.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.930+0000 7f71d6eb0700 1 Processor -- start 2023-09-30T22:19:46.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.930+0000 7f71d6eb0700 1 -- start start 2023-09-30T22:19:46.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d6eb0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71d0066e30 0x7f71d0067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d6eb0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d012dee0 0x7f71d01302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d6eb0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d0069a10 con 0x7f71d0068680 2023-09-30T22:19:46.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d6eb0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d0069090 con 0x7f71d0066e30 2023-09-30T22:19:46.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d6eb0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00694e0 con 0x7f71d012dee0 2023-09-30T22:19:46.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d544d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d012dee0 0x7f71d01302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d4c4c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71d0066e30 0x7f71d0067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71cffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f71d0068680 0x7f71d0067700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51082/0 (socket says 172.21.15.154:51082) 2023-09-30T22:19:46.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d544d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d012dee0 0x7f71d01302d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49736/0 (socket says 172.21.15.154:49736) 2023-09-30T22:19:46.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71cffff700 1 -- 172.21.15.154:0/1188754411 learned_addr learned my addr 172.21.15.154:0/1188754411 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:46.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d4c4c700 1 -- 172.21.15.154:0/1188754411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d012dee0 msgr2=0x7f71d01302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:46.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d4c4c700 1 --2- 172.21.15.154:0/1188754411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d012dee0 0x7f71d01302d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d4c4c700 1 -- 172.21.15.154:0/1188754411 >> v1:172.21.15.154:6789/0 conn(0x7f71d0068680 legacy=0x7f71d0067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d4c4c700 1 -- 172.21.15.154:0/1188754411 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0068b00 con 0x7f71d0066e30 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71cf7fe700 1 -- 172.21.15.154:0/1188754411 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395369720 0 0) 0x7f71d0069a10 con 0x7f71d0068680 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d544d700 1 --2- 172.21.15.154:0/1188754411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d012dee0 0x7f71d01302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71d4c4c700 1 --2- 172.21.15.154:0/1188754411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0066e30 0x7f71d0067210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f71c4009760 tx=0x7f71c4009060).ready entity=mon.0 client_cookie=42eb17f4253813c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71cf7fe700 1 -- 172.21.15.154:0/1188754411 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40090d0 con 0x7f71d0066e30 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71cf7fe700 1 -- 172.21.15.154:0/1188754411 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400f510 con 0x7f71d0066e30 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.931+0000 7f71cf7fe700 1 -- 172.21.15.154:0/1188754411 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400f890 con 0x7f71d0066e30 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.932+0000 7f71d6eb0700 1 -- 172.21.15.154:0/1188754411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0066e30 msgr2=0x7f71d0067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.932+0000 7f71d6eb0700 1 --2- 172.21.15.154:0/1188754411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0066e30 0x7f71d0067210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f71c4009760 tx=0x7f71c4009060).stop 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.932+0000 7f71d6eb0700 1 -- 172.21.15.154:0/1188754411 shutdown_connections 2023-09-30T22:19:46.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.932+0000 7f71d6eb0700 1 --2- 172.21.15.154:0/1188754411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d012dee0 0x7f71d01302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.932+0000 7f71d6eb0700 1 --2- 172.21.15.154:0/1188754411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0066e30 0x7f71d0067210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.932+0000 7f71d6eb0700 1 -- 172.21.15.154:0/1188754411 >> 172.21.15.154:0/1188754411 conn(0x7f71d009a230 msgr2=0x7f71d009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:46.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.932+0000 7f71d6eb0700 1 -- 172.21.15.154:0/1188754411 shutdown_connections 2023-09-30T22:19:46.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.932+0000 7f71d6eb0700 1 -- 172.21.15.154:0/1188754411 wait complete. 2023-09-30T22:19:46.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d6eb0700 1 Processor -- start 2023-09-30T22:19:46.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d6eb0700 1 -- start start 2023-09-30T22:19:46.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d6eb0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d0066e30 0x7f71d0119960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d6eb0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0068680 0x7f71d01159c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d6eb0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71d012dee0 0x7f71d0115eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:46.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d6eb0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0116e50 con 0x7f71d0068680 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d6eb0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d012db00 con 0x7f71d0066e30 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d6eb0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0117ff0 con 0x7f71d012dee0 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d4c4c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d0066e30 0x7f71d0119960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71cffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0068680 0x7f71d01159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d4c4c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d0066e30 0x7f71d0119960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49744/0 (socket says 172.21.15.154:49744) 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d4c4c700 1 -- 172.21.15.154:0/2530527582 learned_addr learned my addr 172.21.15.154:0/2530527582 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.933+0000 7f71d544d700 1 --2- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71d012dee0 0x7f71d0115eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71d4c4c700 1 -- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71d012dee0 msgr2=0x7f71d0115eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71d4c4c700 1 --2- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71d012dee0 0x7f71d0115eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71d4c4c700 1 -- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0068680 msgr2=0x7f71d01159c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:46.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71d4c4c700 1 --2- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0068680 0x7f71d01159c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71d4c4c700 1 -- 172.21.15.154:0/2530527582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8009a20 con 0x7f71d0066e30 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71d4c4c700 1 --2- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d0066e30 0x7f71d0119960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f71c4009e00 tx=0x7f71c4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71ccff9700 1 -- 172.21.15.154:0/2530527582 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400f890 con 0x7f71d0066e30 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71ccff9700 1 -- 172.21.15.154:0/2530527582 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c4006910 con 0x7f71d0066e30 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71ccff9700 1 -- 172.21.15.154:0/2530527582 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400fea0 con 0x7f71d0066e30 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c40092a0 con 0x7f71d0066e30 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.934+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d0118ec0 con 0x7f71d0066e30 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.935+0000 7f71ccff9700 1 -- 172.21.15.154:0/2530527582 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f71c401b620 con 0x7f71d0066e30 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.935+0000 7f71ccff9700 1 -- 172.21.15.154:0/2530527582 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f71c403c870 con 0x7f71d0066e30 2023-09-30T22:19:46.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.935+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d012e460 con 0x7f71d0066e30 2023-09-30T22:19:46.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:46.939+0000 7f71ccff9700 1 -- 172.21.15.154:0/2530527582 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f71c4028070 con 0x7f71d0066e30 2023-09-30T22:19:47.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.133+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71d005a260 con 0x7f71d0066e30 2023-09-30T22:19:47.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.133+0000 7f71ccff9700 1 -- 172.21.15.154:0/2530527582 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f71c4028020 con 0x7f71d0066e30 2023-09-30T22:19:47.133 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:47.133 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:19:33.620776+0000","modified":"2023-09-30T22:19:35.628146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:19:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 >> v1:172.21.15.154:6816/118163 conn(0x7f71b402bb60 legacy=0x7f71b402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d0066e30 msgr2=0x7f71d0119960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 --2- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d0066e30 0x7f71d0119960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f71c4009e00 tx=0x7f71c4017000).stop 2023-09-30T22:19:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 shutdown_connections 2023-09-30T22:19:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 --2- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71d012dee0 0x7f71d0115eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 --2- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71d0066e30 0x7f71d0119960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 --2- 172.21.15.154:0/2530527582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0068680 0x7f71d01159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 >> 172.21.15.154:0/2530527582 conn(0x7f71d009a230 msgr2=0x7f71d0098060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 shutdown_connections 2023-09-30T22:19:47.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.135+0000 7f71d6eb0700 1 -- 172.21.15.154:0/2530527582 wait complete. 2023-09-30T22:19:47.136 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 5 2023-09-30T22:19:47.146 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:47.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.263+0000 7f605373c700 1 Processor -- start 2023-09-30T22:19:47.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.263+0000 7f605373c700 1 -- start start 2023-09-30T22:19:47.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.263+0000 7f605373c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f604c05f560 0x7f604c096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.263+0000 7f605373c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c096d00 0x7f604c0970e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f605373c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604c092160 con 0x7f604c067f40 2023-09-30T22:19:47.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f605373c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604c0933f0 con 0x7f604c05f560 2023-09-30T22:19:47.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f605373c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f604c092420 con 0x7f604c096d00 2023-09-30T22:19:47.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f6050cd7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c096d00 0x7f604c0970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f60514d8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f604c05f560 0x7f604c096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f6051cd9700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f604c067f40 0x7f604c0683f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51088/0 (socket says 172.21.15.154:51088) 2023-09-30T22:19:47.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f6050cd7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c096d00 0x7f604c0970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34512/0 (socket says 172.21.15.154:34512) 2023-09-30T22:19:47.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f60514d8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f604c05f560 0x7f604c096810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38582/0 (socket says 172.21.15.154:38582) 2023-09-30T22:19:47.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f6050cd7700 1 -- 172.21.15.154:0/322204991 learned_addr learned my addr 172.21.15.154:0/322204991 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:47.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f60514d8700 1 -- 172.21.15.154:0/322204991 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c096d00 msgr2=0x7f604c0970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:47.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f60514d8700 1 --2- 172.21.15.154:0/322204991 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c096d00 0x7f604c0970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f60514d8700 1 -- 172.21.15.154:0/322204991 >> v1:172.21.15.154:6789/0 conn(0x7f604c067f40 legacy=0x7f604c0683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f6043fff700 1 -- 172.21.15.154:0/322204991 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969297992 0 0) 0x7f604c092160 con 0x7f604c067f40 2023-09-30T22:19:47.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f60514d8700 1 -- 172.21.15.154:0/322204991 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c069bf0 con 0x7f604c05f560 2023-09-30T22:19:47.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f6050cd7700 1 --2- 172.21.15.154:0/322204991 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c096d00 0x7f604c0970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:47.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f60514d8700 1 --2- 172.21.15.154:0/322204991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c05f560 0x7f604c096810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6048009760 tx=0x7f6048009060).ready entity=mon.0 client_cookie=2ffb91889a319f79 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f6043fff700 1 -- 172.21.15.154:0/322204991 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800f510 con 0x7f604c05f560 2023-09-30T22:19:47.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f6043fff700 1 -- 172.21.15.154:0/322204991 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800f670 con 0x7f604c05f560 2023-09-30T22:19:47.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.264+0000 7f6043fff700 1 -- 172.21.15.154:0/322204991 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800f9f0 con 0x7f604c05f560 2023-09-30T22:19:47.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.265+0000 7f605373c700 1 -- 172.21.15.154:0/322204991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c05f560 msgr2=0x7f604c096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.265+0000 7f605373c700 1 --2- 172.21.15.154:0/322204991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c05f560 0x7f604c096810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6048009760 tx=0x7f6048009060).stop 2023-09-30T22:19:47.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.265+0000 7f605373c700 1 -- 172.21.15.154:0/322204991 shutdown_connections 2023-09-30T22:19:47.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.265+0000 7f605373c700 1 --2- 172.21.15.154:0/322204991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c05f560 0x7f604c096810 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.265+0000 7f605373c700 1 --2- 172.21.15.154:0/322204991 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c096d00 0x7f604c0970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.265+0000 7f605373c700 1 -- 172.21.15.154:0/322204991 >> 172.21.15.154:0/322204991 conn(0x7f604c09a230 msgr2=0x7f604c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.265+0000 7f605373c700 1 -- 172.21.15.154:0/322204991 shutdown_connections 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.265+0000 7f605373c700 1 -- 172.21.15.154:0/322204991 wait complete. 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f605373c700 1 Processor -- start 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f605373c700 1 -- start start 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f605373c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604c05f560 0x7f604c117ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f605373c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c067f40 0x7f604c1183d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f605373c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c096d00 0x7f604c1188c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f605373c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c11a340 con 0x7f604c096d00 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f605373c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c11c600 con 0x7f604c05f560 2023-09-30T22:19:47.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f605373c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f604c091b90 con 0x7f604c067f40 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f6051cd9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c096d00 0x7f604c1188c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f60514d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604c05f560 0x7f604c117ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f6051cd9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c096d00 0x7f604c1188c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38588/0 (socket says 172.21.15.154:38588) 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f60514d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604c05f560 0x7f604c117ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49760/0 (socket says 172.21.15.154:49760) 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f6051cd9700 1 -- 172.21.15.154:0/1081839664 learned_addr learned my addr 172.21.15.154:0/1081839664 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.266+0000 7f6050cd7700 1 --2- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c067f40 0x7f604c1183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f6051cd9700 1 -- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c067f40 msgr2=0x7f604c1183d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f6051cd9700 1 --2- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c067f40 0x7f604c1183d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f6051cd9700 1 -- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604c05f560 msgr2=0x7f604c117ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f6051cd9700 1 --2- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604c05f560 0x7f604c117ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f6051cd9700 1 -- 172.21.15.154:0/1081839664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c00b610 con 0x7f604c096d00 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f6051cd9700 1 --2- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c096d00 0x7f604c1188c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f604400c810 tx=0x7f6044007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f60417fa700 1 -- 172.21.15.154:0/1081839664 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044005c70 con 0x7f604c096d00 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f60417fa700 1 -- 172.21.15.154:0/1081839664 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6044005dd0 con 0x7f604c096d00 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f60417fa700 1 -- 172.21.15.154:0/1081839664 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044007360 con 0x7f604c096d00 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60480092a0 con 0x7f604c096d00 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.267+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604c11c060 con 0x7f604c096d00 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.268+0000 7f60417fa700 1 -- 172.21.15.154:0/1081839664 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6044007750 con 0x7f604c096d00 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.268+0000 7f60417fa700 1 -- 172.21.15.154:0/1081839664 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f604403af50 con 0x7f604c096d00 2023-09-30T22:19:47.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.268+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604c05a260 con 0x7f604c096d00 2023-09-30T22:19:47.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.272+0000 7f60417fa700 1 -- 172.21.15.154:0/1081839664 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f604401c3e0 con 0x7f604c096d00 2023-09-30T22:19:47.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.432+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f604c0697e0 con 0x7f604c096d00 2023-09-30T22:19:47.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.433+0000 7f60417fa700 1 -- 172.21.15.154:0/1081839664 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f604401a300 con 0x7f604c096d00 2023-09-30T22:19:47.433 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:47.433 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:34.624706+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:47.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 >> v1:172.21.15.154:6816/118163 conn(0x7f603002bb60 legacy=0x7f603002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c096d00 msgr2=0x7f604c1188c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 --2- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c096d00 0x7f604c1188c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f604400c810 tx=0x7f6044007f60).stop 2023-09-30T22:19:47.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 shutdown_connections 2023-09-30T22:19:47.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 --2- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f604c096d00 0x7f604c1188c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 --2- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604c05f560 0x7f604c117ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 --2- 172.21.15.154:0/1081839664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f604c067f40 0x7f604c1183d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 >> 172.21.15.154:0/1081839664 conn(0x7f604c09a230 msgr2=0x7f604c129e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 shutdown_connections 2023-09-30T22:19:47.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.435+0000 7f605373c700 1 -- 172.21.15.154:0/1081839664 wait complete. 2023-09-30T22:19:47.446 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:19:27.265135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:19:28.184247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:19:32.024148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:19:32.601719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:19:47.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:19:47.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bbdba6700 1 Processor -- start 2023-09-30T22:19:47.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bbdba6700 1 -- start start 2023-09-30T22:19:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bbdba6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5bb8125330 0x7f5bb8125ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bbdba6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812dc50 0x7f5bb8130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bbdba6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb8095950 con 0x7f5bb8062b00 2023-09-30T22:19:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bbdba6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb8062ee0 con 0x7f5bb8125330 2023-09-30T22:19:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bbdba6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80969c0 con 0x7f5bb812dc50 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bb7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812dc50 0x7f5bb8130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bb6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5bb8125330 0x7f5bb8125ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bb7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812dc50 0x7f5bb8130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49776/0 (socket says 172.21.15.154:49776) 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bb7fff700 1 -- 172.21.15.154:0/1141480722 learned_addr learned my addr 172.21.15.154:0/1141480722 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.566+0000 7f5bb77fe700 1 --1- 172.21.15.154:0/1141480722 >> v1:172.21.15.154:6789/0 conn(0x7f5bb8062b00 0x7f5bb81257c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51092/0 (socket says 172.21.15.154:51092) 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb7fff700 1 -- 172.21.15.154:0/1141480722 >> v2:172.21.15.154:3300/0 conn(0x7f5bb8125330 msgr2=0x7f5bb8125ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb7fff700 1 --2- 172.21.15.154:0/1141480722 >> v2:172.21.15.154:3300/0 conn(0x7f5bb8125330 0x7f5bb8125ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb7fff700 1 -- 172.21.15.154:0/1141480722 >> v1:172.21.15.154:6789/0 conn(0x7f5bb8062b00 legacy=0x7f5bb81257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb7fff700 1 -- 172.21.15.154:0/1141480722 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb80635f0 con 0x7f5bb812dc50 2023-09-30T22:19:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb67fc700 1 -- 172.21.15.154:0/1141480722 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713259394 0 0) 0x7f5bb8095950 con 0x7f5bb8062b00 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb6ffd700 1 --2- 172.21.15.154:0/1141480722 >> v2:172.21.15.154:3300/0 conn(0x7f5bb8125330 0x7f5bb8125ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb7fff700 1 --2- 172.21.15.154:0/1141480722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812dc50 0x7f5bb8130040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5bb0009f20 tx=0x7f5bb0009840).ready entity=mon.1 client_cookie=f66c338899aa948 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb67fc700 1 -- 172.21.15.154:0/1141480722 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000e070 con 0x7f5bb812dc50 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb67fc700 1 -- 172.21.15.154:0/1141480722 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb000b9d0 con 0x7f5bb812dc50 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bb67fc700 1 -- 172.21.15.154:0/1141480722 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000bd50 con 0x7f5bb812dc50 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bbdba6700 1 -- 172.21.15.154:0/1141480722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812dc50 msgr2=0x7f5bb8130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bbdba6700 1 --2- 172.21.15.154:0/1141480722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812dc50 0x7f5bb8130040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5bb0009f20 tx=0x7f5bb0009840).stop 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bbdba6700 1 -- 172.21.15.154:0/1141480722 shutdown_connections 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bbdba6700 1 --2- 172.21.15.154:0/1141480722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812dc50 0x7f5bb8130040 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bbdba6700 1 --2- 172.21.15.154:0/1141480722 >> v2:172.21.15.154:3300/0 conn(0x7f5bb8125330 0x7f5bb8125ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.567+0000 7f5bbdba6700 1 -- 172.21.15.154:0/1141480722 >> 172.21.15.154:0/1141480722 conn(0x7f5bb809aa50 msgr2=0x7f5bb809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.568+0000 7f5bbdba6700 1 -- 172.21.15.154:0/1141480722 shutdown_connections 2023-09-30T22:19:47.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.568+0000 7f5bbdba6700 1 -- 172.21.15.154:0/1141480722 wait complete. 2023-09-30T22:19:47.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.568+0000 7f5bbdba6700 1 Processor -- start 2023-09-30T22:19:47.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bbdba6700 1 -- start start 2023-09-30T22:19:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bbdba6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bb8062b00 0x7f5bb812d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bbdba6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5bb812dc50 0x7f5bb812bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bbdba6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812c260 0x7f5bb812c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bbdba6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8069a50 con 0x7f5bb8062b00 2023-09-30T22:19:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bbdba6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8129ba0 con 0x7f5bb812c260 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bbdba6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8068590 con 0x7f5bb812dc50 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5bb812dc50 0x7f5bb812bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bb8062b00 0x7f5bb812d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5bb812dc50 0x7f5bb812bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34526/0 (socket says 172.21.15.154:34526) 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb6ffd700 1 -- 172.21.15.154:0/2989617910 learned_addr learned my addr 172.21.15.154:0/2989617910 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb7fff700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812c260 0x7f5bb812c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb6ffd700 1 -- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812c260 msgr2=0x7f5bb812c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb6ffd700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812c260 0x7f5bb812c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb6ffd700 1 -- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bb8062b00 msgr2=0x7f5bb812d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb6ffd700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bb8062b00 0x7f5bb812d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb6ffd700 1 -- 172.21.15.154:0/2989617910 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac0092a0 con 0x7f5bb812dc50 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb7fff700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812c260 0x7f5bb812c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.569+0000 7f5bb77fe700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bb8062b00 0x7f5bb812d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.570+0000 7f5bb6ffd700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5bb812dc50 0x7f5bb812bd70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5bac00ea50 tx=0x7f5bac009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.570+0000 7f5b9f7fe700 1 -- 172.21.15.154:0/2989617910 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac00ee90 con 0x7f5bb812dc50 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.570+0000 7f5b9f7fe700 1 -- 172.21.15.154:0/2989617910 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac009600 con 0x7f5bb812dc50 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.570+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb0009ae0 con 0x7f5bb812dc50 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.570+0000 7f5b9f7fe700 1 -- 172.21.15.154:0/2989617910 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac00ca60 con 0x7f5bb812dc50 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.570+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb812baa0 con 0x7f5bb812dc50 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.570+0000 7f5b9f7fe700 1 -- 172.21.15.154:0/2989617910 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5bac01b400 con 0x7f5bb812dc50 2023-09-30T22:19:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.571+0000 7f5b9f7fe700 1 -- 172.21.15.154:0/2989617910 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5bac03b4d0 con 0x7f5bb812dc50 2023-09-30T22:19:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.571+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb809a270 con 0x7f5bb812dc50 2023-09-30T22:19:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.575+0000 7f5b9f7fe700 1 -- 172.21.15.154:0/2989617910 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5bac016070 con 0x7f5bb812dc50 2023-09-30T22:19:47.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.731+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5bb805a260 con 0x7f5bb812dc50 2023-09-30T22:19:47.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.731+0000 7f5b9f7fe700 1 -- 172.21.15.154:0/2989617910 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5bac0290b0 con 0x7f5bb812dc50 2023-09-30T22:19:47.732 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-09-30T22:19:47.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 >> v1:172.21.15.154:6816/118163 conn(0x7f5ba402bb30 legacy=0x7f5ba402dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5bb812dc50 msgr2=0x7f5bb812bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5bb812dc50 0x7f5bb812bd70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5bac00ea50 tx=0x7f5bac009060).stop 2023-09-30T22:19:47.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 shutdown_connections 2023-09-30T22:19:47.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5bb812c260 0x7f5bb812c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5bb8062b00 0x7f5bb812d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 --2- 172.21.15.154:0/2989617910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5bb812dc50 0x7f5bb812bd70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 >> 172.21.15.154:0/2989617910 conn(0x7f5bb809aa50 msgr2=0x7f5bb8124910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 shutdown_connections 2023-09-30T22:19:47.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.733+0000 7f5bbdba6700 1 -- 172.21.15.154:0/2989617910 wait complete. 2023-09-30T22:19:47.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:19:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.863+0000 7f7e84fe5700 1 Processor -- start 2023-09-30T22:19:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.863+0000 7f7e84fe5700 1 -- start start 2023-09-30T22:19:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e84fe5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8005f560 0x7f7e8012ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e84fe5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 0x7f7e800964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e84fe5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e80097ac0 con 0x7f7e8012b250 2023-09-30T22:19:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e84fe5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8005f940 con 0x7f7e8005f560 2023-09-30T22:19:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e84fe5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8012bab0 con 0x7f7e8012b650 2023-09-30T22:19:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e7e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8005f560 0x7f7e8012ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e7ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 0x7f7e800964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e7dd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7e8012b250 0x7f7e80095d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51106/0 (socket says 172.21.15.154:51106) 2023-09-30T22:19:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e7dd9b700 1 -- 172.21.15.154:0/2487694410 learned_addr learned my addr 172.21.15.154:0/2487694410 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e7d59a700 1 -- 172.21.15.154:0/2487694410 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070113426 0 0) 0x7f7e80097ac0 con 0x7f7e8012b250 2023-09-30T22:19:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e7e59c700 1 -- 172.21.15.154:0/2487694410 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 msgr2=0x7f7e800964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e7e59c700 1 --2- 172.21.15.154:0/2487694410 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 0x7f7e800964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.864+0000 7f7e7e59c700 1 -- 172.21.15.154:0/2487694410 >> v1:172.21.15.154:6789/0 conn(0x7f7e8012b250 legacy=0x7f7e80095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e7e59c700 1 -- 172.21.15.154:0/2487694410 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e80066f90 con 0x7f7e8005f560 2023-09-30T22:19:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e7ed9d700 1 --2- 172.21.15.154:0/2487694410 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 0x7f7e800964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e7e59c700 1 --2- 172.21.15.154:0/2487694410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8005f560 0x7f7e8012ad60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7e74009790 tx=0x7f7e74009060).ready entity=mon.1 client_cookie=a9eb31d4787ee069 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e7d59a700 1 -- 172.21.15.154:0/2487694410 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400f510 con 0x7f7e8005f560 2023-09-30T22:19:47.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e7d59a700 1 -- 172.21.15.154:0/2487694410 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7400f670 con 0x7f7e8005f560 2023-09-30T22:19:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e7d59a700 1 -- 172.21.15.154:0/2487694410 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400f9f0 con 0x7f7e8005f560 2023-09-30T22:19:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e84fe5700 1 -- 172.21.15.154:0/2487694410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8005f560 msgr2=0x7f7e8012ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e84fe5700 1 --2- 172.21.15.154:0/2487694410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8005f560 0x7f7e8012ad60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7e74009790 tx=0x7f7e74009060).stop 2023-09-30T22:19:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e84fe5700 1 -- 172.21.15.154:0/2487694410 shutdown_connections 2023-09-30T22:19:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e84fe5700 1 --2- 172.21.15.154:0/2487694410 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 0x7f7e800964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e84fe5700 1 --2- 172.21.15.154:0/2487694410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8005f560 0x7f7e8012ad60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e84fe5700 1 -- 172.21.15.154:0/2487694410 >> 172.21.15.154:0/2487694410 conn(0x7f7e8009a1c0 msgr2=0x7f7e8009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e84fe5700 1 -- 172.21.15.154:0/2487694410 shutdown_connections 2023-09-30T22:19:47.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.865+0000 7f7e84fe5700 1 -- 172.21.15.154:0/2487694410 wait complete. 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.866+0000 7f7e84fe5700 1 Processor -- start 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e84fe5700 1 -- start start 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e84fe5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8005f560 0x7f7e80117220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e84fe5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8012b250 0x7f7e80117710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e84fe5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 0x7f7e80117c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e84fe5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e801282f0 con 0x7f7e8005f560 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e84fe5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800671c0 con 0x7f7e8012b250 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e84fe5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8011acc0 con 0x7f7e8012b650 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e7e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8005f560 0x7f7e80117220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e7e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8005f560 0x7f7e80117220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38616/0 (socket says 172.21.15.154:38616) 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e7dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8012b250 0x7f7e80117710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e7e59c700 1 -- 172.21.15.154:0/1315030048 learned_addr learned my addr 172.21.15.154:0/1315030048 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.867+0000 7f7e7ed9d700 1 --2- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 0x7f7e80117c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e7e59c700 1 -- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 msgr2=0x7f7e80117c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e7e59c700 1 --2- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 0x7f7e80117c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e7e59c700 1 -- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8012b250 msgr2=0x7f7e80117710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e7e59c700 1 --2- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8012b250 0x7f7e80117710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e7e59c700 1 -- 172.21.15.154:0/1315030048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78009a20 con 0x7f7e8005f560 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e7e59c700 1 --2- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8005f560 0x7f7e80117220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7e80067e10 tx=0x7f7e74017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e6e7fc700 1 -- 172.21.15.154:0/1315030048 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400f7e0 con 0x7f7e8005f560 2023-09-30T22:19:47.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e6e7fc700 1 -- 172.21.15.154:0/1315030048 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7400f940 con 0x7f7e8005f560 2023-09-30T22:19:47.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740092a0 con 0x7f7e8005f560 2023-09-30T22:19:47.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e6e7fc700 1 -- 172.21.15.154:0/1315030048 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7401b690 con 0x7f7e8005f560 2023-09-30T22:19:47.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.868+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8011b3a0 con 0x7f7e8005f560 2023-09-30T22:19:47.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.869+0000 7f7e6e7fc700 1 -- 172.21.15.154:0/1315030048 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7e7401ba80 con 0x7f7e8005f560 2023-09-30T22:19:47.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.869+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8011b560 con 0x7f7e8005f560 2023-09-30T22:19:47.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.869+0000 7f7e6e7fc700 1 -- 172.21.15.154:0/1315030048 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7e7403c710 con 0x7f7e8005f560 2023-09-30T22:19:47.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:47.873+0000 7f7e6e7fc700 1 -- 172.21.15.154:0/1315030048 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7e8011b560 con 0x7f7e8005f560 2023-09-30T22:19:48.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.029+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e8011b560 con 0x7f7e8005f560 2023-09-30T22:19:48.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.030+0000 7f7e6e7fc700 1 -- 172.21.15.154:0/1315030048 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e8011b560 con 0x7f7e8005f560 2023-09-30T22:19:48.030 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 8 2023-09-30T22:19:48.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 >> v1:172.21.15.154:6816/118163 conn(0x7f7e6002bb60 legacy=0x7f7e6002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8005f560 msgr2=0x7f7e80117220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 --2- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8005f560 0x7f7e80117220 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7e80067e10 tx=0x7f7e74017000).stop 2023-09-30T22:19:48.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 shutdown_connections 2023-09-30T22:19:48.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 --2- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8012b650 0x7f7e80117c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 --2- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8005f560 0x7f7e80117220 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 --2- 172.21.15.154:0/1315030048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8012b250 0x7f7e80117710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 >> 172.21.15.154:0/1315030048 conn(0x7f7e8009a1c0 msgr2=0x7f7e800987b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 shutdown_connections 2023-09-30T22:19:48.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.032+0000 7f7e84fe5700 1 -- 172.21.15.154:0/1315030048 wait complete. 2023-09-30T22:19:48.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:19:48.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.162+0000 7f67939e4700 1 Processor -- start 2023-09-30T22:19:48.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.162+0000 7f67939e4700 1 -- start start 2023-09-30T22:19:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f67939e4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f678c062b00 0x7f678c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f67939e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c095b80 0x7f678c095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f67939e4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c091980 con 0x7f678c096490 2023-09-30T22:19:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f67939e4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678c0973f0 con 0x7f678c062b00 2023-09-30T22:19:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f67939e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c062ee0 con 0x7f678c095b80 2023-09-30T22:19:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6790f7f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c095b80 0x7f678c095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6791780700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f678c062b00 0x7f678c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6790f7f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c095b80 0x7f678c095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49826/0 (socket says 172.21.15.154:49826) 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6791f81700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f678c096490 0x7f678c131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51118/0 (socket says 172.21.15.154:51118) 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6790f7f700 1 -- 172.21.15.154:0/2210071243 learned_addr learned my addr 172.21.15.154:0/2210071243 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6791780700 1 -- 172.21.15.154:0/2210071243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c095b80 msgr2=0x7f678c095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6791780700 1 --2- 172.21.15.154:0/2210071243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c095b80 0x7f678c095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6791780700 1 -- 172.21.15.154:0/2210071243 >> v1:172.21.15.154:6789/0 conn(0x7f678c096490 legacy=0x7f678c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6791780700 1 -- 172.21.15.154:0/2210071243 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c092310 con 0x7f678c062b00 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6783fff700 1 -- 172.21.15.154:0/2210071243 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371454504 0 0) 0x7f678c091980 con 0x7f678c096490 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6790f7f700 1 --2- 172.21.15.154:0/2210071243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c095b80 0x7f678c095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6791780700 1 --2- 172.21.15.154:0/2210071243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c062b00 0x7f678c095690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f677c009790 tx=0x7f677c009060).ready entity=mon.0 client_cookie=66c64de22f2edafe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6783fff700 1 -- 172.21.15.154:0/2210071243 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c00f510 con 0x7f678c062b00 2023-09-30T22:19:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6783fff700 1 -- 172.21.15.154:0/2210071243 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c00f670 con 0x7f678c062b00 2023-09-30T22:19:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.163+0000 7f6783fff700 1 -- 172.21.15.154:0/2210071243 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c00f9f0 con 0x7f678c062b00 2023-09-30T22:19:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.164+0000 7f67939e4700 1 -- 172.21.15.154:0/2210071243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c062b00 msgr2=0x7f678c095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.164+0000 7f67939e4700 1 --2- 172.21.15.154:0/2210071243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c062b00 0x7f678c095690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f677c009790 tx=0x7f677c009060).stop 2023-09-30T22:19:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.164+0000 7f67939e4700 1 -- 172.21.15.154:0/2210071243 shutdown_connections 2023-09-30T22:19:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.164+0000 7f67939e4700 1 --2- 172.21.15.154:0/2210071243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c062b00 0x7f678c095690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.164+0000 7f67939e4700 1 --2- 172.21.15.154:0/2210071243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c095b80 0x7f678c095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.164+0000 7f67939e4700 1 -- 172.21.15.154:0/2210071243 >> 172.21.15.154:0/2210071243 conn(0x7f678c09aa50 msgr2=0x7f678c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.164+0000 7f67939e4700 1 -- 172.21.15.154:0/2210071243 shutdown_connections 2023-09-30T22:19:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.164+0000 7f67939e4700 1 -- 172.21.15.154:0/2210071243 wait complete. 2023-09-30T22:19:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f67939e4700 1 Processor -- start 2023-09-30T22:19:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f67939e4700 1 -- start start 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f67939e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c062b00 0x7f678c12d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f67939e4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c095b80 0x7f678c115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f67939e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f678c096490 0x7f678c115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f67939e4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c119bb0 con 0x7f678c095b80 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f67939e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c119790 con 0x7f678c062b00 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f67939e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f678c096da0 con 0x7f678c096490 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f6790f7f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c095b80 0x7f678c115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f6790f7f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c095b80 0x7f678c115730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38634/0 (socket says 172.21.15.154:38634) 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f6791780700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c062b00 0x7f678c12d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f6791f81700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f678c096490 0x7f678c115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.165+0000 7f6790f7f700 1 -- 172.21.15.154:0/2854723104 learned_addr learned my addr 172.21.15.154:0/2854723104 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f6790f7f700 1 -- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f678c096490 msgr2=0x7f678c115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f6790f7f700 1 --2- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f678c096490 0x7f678c115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f6790f7f700 1 -- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c062b00 msgr2=0x7f678c12d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f6790f7f700 1 --2- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c062b00 0x7f678c12d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f6790f7f700 1 -- 172.21.15.154:0/2854723104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788009370 con 0x7f678c095b80 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f6791780700 1 --2- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c062b00 0x7f678c12d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f6790f7f700 1 --2- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c095b80 0x7f678c115730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f678800ea50 tx=0x7f67880090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f67817fa700 1 -- 172.21.15.154:0/2854723104 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788009650 con 0x7f678c095b80 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f67817fa700 1 -- 172.21.15.154:0/2854723104 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678800ee90 con 0x7f678c095b80 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c0092a0 con 0x7f678c095b80 2023-09-30T22:19:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f67817fa700 1 -- 172.21.15.154:0/2854723104 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800ca00 con 0x7f678c095b80 2023-09-30T22:19:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.166+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c118c30 con 0x7f678c095b80 2023-09-30T22:19:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.167+0000 7f67817fa700 1 -- 172.21.15.154:0/2854723104 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f678801b400 con 0x7f678c095b80 2023-09-30T22:19:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.167+0000 7f67817fa700 1 -- 172.21.15.154:0/2854723104 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f678803b400 con 0x7f678c095b80 2023-09-30T22:19:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.167+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c119010 con 0x7f678c095b80 2023-09-30T22:19:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.171+0000 7f67817fa700 1 -- 172.21.15.154:0/2854723104 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6788019310 con 0x7f678c095b80 2023-09-30T22:19:48.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.330+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f678c05a260 con 0x7f678c095b80 2023-09-30T22:19:48.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.330+0000 7f67817fa700 1 -- 172.21.15.154:0/2854723104 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6788011b40 con 0x7f678c095b80 2023-09-30T22:19:48.330 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-09-30T22:19:48.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 >> v1:172.21.15.154:6816/118163 conn(0x7f677002bb90 legacy=0x7f677002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c095b80 msgr2=0x7f678c115730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 --2- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c095b80 0x7f678c115730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f678800ea50 tx=0x7f67880090f0).stop 2023-09-30T22:19:48.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 shutdown_connections 2023-09-30T22:19:48.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 --2- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f678c096490 0x7f678c115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 --2- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f678c062b00 0x7f678c12d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 --2- 172.21.15.154:0/2854723104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f678c095b80 0x7f678c115730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 >> 172.21.15.154:0/2854723104 conn(0x7f678c09aa50 msgr2=0x7f678c12ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 shutdown_connections 2023-09-30T22:19:48.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.332+0000 7f67939e4700 1 -- 172.21.15.154:0/2854723104 wait complete. 2023-09-30T22:19:48.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:19:48.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a36659700 1 Processor -- start 2023-09-30T22:19:48.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a36659700 1 -- start start 2023-09-30T22:19:48.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a36659700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a300990d0 0x7f5a301304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a36659700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a30130990 0x7f5a30132d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a36659700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300964f0 con 0x7f5a300985e0 2023-09-30T22:19:48.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a36659700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a300994b0 con 0x7f5a30130990 2023-09-30T22:19:48.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a36659700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3009a3f0 con 0x7f5a300990d0 2023-09-30T22:19:48.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a2f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a300990d0 0x7f5a301304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a34bf6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a30130990 0x7f5a30132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a34bf6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a30130990 0x7f5a30132d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38636/0 (socket says 172.21.15.154:38636) 2023-09-30T22:19:48.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a2f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a300990d0 0x7f5a301304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34556/0 (socket says 172.21.15.154:34556) 2023-09-30T22:19:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a34bf6700 1 -- 172.21.15.154:0/378667367 learned_addr learned my addr 172.21.15.154:0/378667367 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.463+0000 7f5a2ffff700 1 --1- 172.21.15.154:0/378667367 >> v1:172.21.15.154:6789/0 conn(0x7f5a300985e0 0x7f5a300989c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51124/0 (socket says 172.21.15.154:51124) 2023-09-30T22:19:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a34bf6700 1 -- 172.21.15.154:0/378667367 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a300990d0 msgr2=0x7f5a301304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a34bf6700 1 --2- 172.21.15.154:0/378667367 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a300990d0 0x7f5a301304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a34bf6700 1 -- 172.21.15.154:0/378667367 >> v1:172.21.15.154:6789/0 conn(0x7f5a300985e0 legacy=0x7f5a300989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a34bf6700 1 -- 172.21.15.154:0/378667367 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30095100 con 0x7f5a30130990 2023-09-30T22:19:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a2effd700 1 -- 172.21.15.154:0/378667367 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340202930 0 0) 0x7f5a300964f0 con 0x7f5a300985e0 2023-09-30T22:19:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a2f7fe700 1 --2- 172.21.15.154:0/378667367 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a300990d0 0x7f5a301304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a34bf6700 1 --2- 172.21.15.154:0/378667367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a30130990 0x7f5a30132d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f5a28009f20 tx=0x7f5a28009840).ready entity=mon.0 client_cookie=31001be7b8503cfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a2effd700 1 -- 172.21.15.154:0/378667367 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800e070 con 0x7f5a30130990 2023-09-30T22:19:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a2effd700 1 -- 172.21.15.154:0/378667367 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800b9d0 con 0x7f5a30130990 2023-09-30T22:19:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.464+0000 7f5a2effd700 1 -- 172.21.15.154:0/378667367 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800bd50 con 0x7f5a30130990 2023-09-30T22:19:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.465+0000 7f5a36659700 1 -- 172.21.15.154:0/378667367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a30130990 msgr2=0x7f5a30132d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.465+0000 7f5a36659700 1 --2- 172.21.15.154:0/378667367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a30130990 0x7f5a30132d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f5a28009f20 tx=0x7f5a28009840).stop 2023-09-30T22:19:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.465+0000 7f5a36659700 1 -- 172.21.15.154:0/378667367 shutdown_connections 2023-09-30T22:19:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.465+0000 7f5a36659700 1 --2- 172.21.15.154:0/378667367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a30130990 0x7f5a30132d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.465+0000 7f5a36659700 1 --2- 172.21.15.154:0/378667367 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a300990d0 0x7f5a301304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.465+0000 7f5a36659700 1 -- 172.21.15.154:0/378667367 >> 172.21.15.154:0/378667367 conn(0x7f5a3009dc40 msgr2=0x7f5a3009e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.465+0000 7f5a36659700 1 -- 172.21.15.154:0/378667367 shutdown_connections 2023-09-30T22:19:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.465+0000 7f5a36659700 1 -- 172.21.15.154:0/378667367 wait complete. 2023-09-30T22:19:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.465+0000 7f5a36659700 1 Processor -- start 2023-09-30T22:19:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a36659700 1 -- start start 2023-09-30T22:19:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a36659700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a300985e0 0x7f5a3011e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a36659700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a300990d0 0x7f5a3011a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a36659700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a30130990 0x7f5a3011aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a36659700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3011b9f0 con 0x7f5a300990d0 2023-09-30T22:19:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a36659700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3011d5d0 con 0x7f5a300985e0 2023-09-30T22:19:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a36659700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3009cb50 con 0x7f5a30130990 2023-09-30T22:19:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a2f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a300990d0 0x7f5a3011a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a300985e0 0x7f5a3011e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a34bf6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a30130990 0x7f5a3011aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a2f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a300990d0 0x7f5a3011a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38640/0 (socket says 172.21.15.154:38640) 2023-09-30T22:19:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.466+0000 7f5a2f7fe700 1 -- 172.21.15.154:0/624330774 learned_addr learned my addr 172.21.15.154:0/624330774 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a34bf6700 1 -- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a300985e0 msgr2=0x7f5a3011e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a34bf6700 1 --2- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a300985e0 0x7f5a3011e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a34bf6700 1 -- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a300990d0 msgr2=0x7f5a3011a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a34bf6700 1 --2- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a300990d0 0x7f5a3011a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a34bf6700 1 -- 172.21.15.154:0/624330774 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240092a0 con 0x7f5a30130990 2023-09-30T22:19:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a2f7fe700 1 --2- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a300990d0 0x7f5a3011a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a34bf6700 1 --2- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a30130990 0x7f5a3011aa40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5a3009b770 tx=0x7f5a30096680).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a17fff700 1 -- 172.21.15.154:0/624330774 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800b640 con 0x7f5a30130990 2023-09-30T22:19:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a17fff700 1 -- 172.21.15.154:0/624330774 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a280092e0 con 0x7f5a30130990 2023-09-30T22:19:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a28009ae0 con 0x7f5a30130990 2023-09-30T22:19:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a17fff700 1 -- 172.21.15.154:0/624330774 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28007840 con 0x7f5a30130990 2023-09-30T22:19:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.467+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3009a150 con 0x7f5a30130990 2023-09-30T22:19:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.468+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a30097150 con 0x7f5a30130990 2023-09-30T22:19:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.468+0000 7f5a17fff700 1 -- 172.21.15.154:0/624330774 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5a28003040 con 0x7f5a30130990 2023-09-30T22:19:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.468+0000 7f5a17fff700 1 -- 172.21.15.154:0/624330774 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5a2803ce50 con 0x7f5a30130990 2023-09-30T22:19:48.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.472+0000 7f5a17fff700 1 -- 172.21.15.154:0/624330774 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5a28027950 con 0x7f5a30130990 2023-09-30T22:19:48.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.629+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a3005a260 con 0x7f5a30130990 2023-09-30T22:19:48.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.630+0000 7f5a17fff700 1 -- 172.21.15.154:0/624330774 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a28027360 con 0x7f5a30130990 2023-09-30T22:19:48.630 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-09-30T22:19:48.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 >> v1:172.21.15.154:6816/118163 conn(0x7f5a1c02bb90 legacy=0x7f5a1c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a30130990 msgr2=0x7f5a3011aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 --2- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a30130990 0x7f5a3011aa40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5a3009b770 tx=0x7f5a30096680).stop 2023-09-30T22:19:48.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 shutdown_connections 2023-09-30T22:19:48.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 --2- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a30130990 0x7f5a3011aa40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 --2- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a300985e0 0x7f5a3011e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 --2- 172.21.15.154:0/624330774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a300990d0 0x7f5a3011a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 >> 172.21.15.154:0/624330774 conn(0x7f5a3009dc40 msgr2=0x7f5a3009bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 shutdown_connections 2023-09-30T22:19:48.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.632+0000 7f5a36659700 1 -- 172.21.15.154:0/624330774 wait complete. 2023-09-30T22:19:48.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:19:48.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.760+0000 7ff1911fe700 1 Processor -- start 2023-09-30T22:19:48.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.760+0000 7ff1911fe700 1 -- start start 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff1911fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff1911fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff1911fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff18c12c240 0x7ff18c12e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff1911fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c094ba0 con 0x7ff18c12c240 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff1911fe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c092e90 con 0x7ff18c095c50 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff1911fe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c096b60 con 0x7ff18c093950 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff18ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff18a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff18a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49842/0 (socket says 172.21.15.154:49842) 2023-09-30T22:19:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff18ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34584/0 (socket says 172.21.15.154:34584) 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.761+0000 7ff18a59c700 1 -- 172.21.15.154:0/1462520154 learned_addr learned my addr 172.21.15.154:0/1462520154 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff18a59c700 1 -- 172.21.15.154:0/1462520154 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 msgr2=0x7ff18c095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff18a59c700 1 --2- 172.21.15.154:0/1462520154 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff18a59c700 1 -- 172.21.15.154:0/1462520154 >> v2:172.21.15.154:3300/0 conn(0x7ff18c12c240 msgr2=0x7ff18c12e630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff18a59c700 1 --2- 172.21.15.154:0/1462520154 >> v2:172.21.15.154:3300/0 conn(0x7ff18c12c240 0x7ff18c12e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff18a59c700 1 -- 172.21.15.154:0/1462520154 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c093150 con 0x7ff18c095c50 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff18ad9d700 1 --2- 172.21.15.154:0/1462520154 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff18a59c700 1 --2- 172.21.15.154:0/1462520154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c096030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff18000b8e0 tx=0x7ff1800090f0).ready entity=mon.1 client_cookie=40a9b9c18b214e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff189d9b700 1 -- 172.21.15.154:0/1462520154 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18000c840 con 0x7ff18c095c50 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff189d9b700 1 -- 172.21.15.154:0/1462520154 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18000c9a0 con 0x7ff18c095c50 2023-09-30T22:19:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.762+0000 7ff189d9b700 1 -- 172.21.15.154:0/1462520154 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18000cd20 con 0x7ff18c095c50 2023-09-30T22:19:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.763+0000 7ff1911fe700 1 -- 172.21.15.154:0/1462520154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 msgr2=0x7ff18c096030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.763+0000 7ff1911fe700 1 --2- 172.21.15.154:0/1462520154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c096030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff18000b8e0 tx=0x7ff1800090f0).stop 2023-09-30T22:19:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.763+0000 7ff1911fe700 1 -- 172.21.15.154:0/1462520154 shutdown_connections 2023-09-30T22:19:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.763+0000 7ff1911fe700 1 --2- 172.21.15.154:0/1462520154 >> v2:172.21.15.154:3300/0 conn(0x7ff18c12c240 0x7ff18c12e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.763+0000 7ff1911fe700 1 --2- 172.21.15.154:0/1462520154 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.763+0000 7ff1911fe700 1 --2- 172.21.15.154:0/1462520154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c096030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.763+0000 7ff1911fe700 1 -- 172.21.15.154:0/1462520154 >> 172.21.15.154:0/1462520154 conn(0x7ff18c09aa50 msgr2=0x7ff18c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.763+0000 7ff1911fe700 1 -- 172.21.15.154:0/1462520154 shutdown_connections 2023-09-30T22:19:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.763+0000 7ff1911fe700 1 -- 172.21.15.154:0/1462520154 wait complete. 2023-09-30T22:19:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.764+0000 7ff1911fe700 1 Processor -- start 2023-09-30T22:19:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.764+0000 7ff1911fe700 1 -- start start 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff1911fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c12bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff1911fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff1911fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c12c240 0x7ff18c116100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff1911fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c119110 con 0x7ff18c12c240 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff1911fe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c119d50 con 0x7ff18c095c50 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff1911fe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c06a2c0 con 0x7ff18c093950 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff18ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c12bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff18b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c12c240 0x7ff18c116100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff18b59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c12c240 0x7ff18c116100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38660/0 (socket says 172.21.15.154:38660) 2023-09-30T22:19:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff18ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c12bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34598/0 (socket says 172.21.15.154:34598) 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff18b59e700 1 -- 172.21.15.154:0/863015703 learned_addr learned my addr 172.21.15.154:0/863015703 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.765+0000 7ff18a59c700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff18b59e700 1 -- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 msgr2=0x7ff18c12bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff18b59e700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c12bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff18b59e700 1 -- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 msgr2=0x7ff18c115c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff18b59e700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c115c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff18b59e700 1 -- 172.21.15.154:0/863015703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c00d740 con 0x7ff18c12c240 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff18ad9d700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c12bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff18a59c700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff18b59e700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c12c240 0x7ff18c116100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff18400bc30 tx=0x7ff184009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff172ffd700 1 -- 172.21.15.154:0/863015703 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18400c630 con 0x7ff18c12c240 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff172ffd700 1 -- 172.21.15.154:0/863015703 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff184010070 con 0x7ff18c12c240 2023-09-30T22:19:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff172ffd700 1 -- 172.21.15.154:0/863015703 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18400c7f0 con 0x7ff18c12c240 2023-09-30T22:19:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18000b420 con 0x7ff18c12c240 2023-09-30T22:19:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.766+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c117010 con 0x7ff18c12c240 2023-09-30T22:19:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.767+0000 7ff172ffd700 1 -- 172.21.15.154:0/863015703 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff18400cba0 con 0x7ff18c12c240 2023-09-30T22:19:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.767+0000 7ff172ffd700 1 -- 172.21.15.154:0/863015703 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff18403a8c0 con 0x7ff18c12c240 2023-09-30T22:19:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.767+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c05a260 con 0x7ff18c12c240 2023-09-30T22:19:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.771+0000 7ff172ffd700 1 -- 172.21.15.154:0/863015703 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff18401cb30 con 0x7ff18c12c240 2023-09-30T22:19:48.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.967+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff18c046c20 con 0x7ff18c12c240 2023-09-30T22:19:48.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.968+0000 7ff172ffd700 1 -- 172.21.15.154:0/863015703 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7ff184023030 con 0x7ff18c12c240 2023-09-30T22:19:48.968 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:48.968 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:19:33.620776+0000","modified":"2023-09-30T22:19:35.628146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:19:48.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.969+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 >> v1:172.21.15.154:6816/118163 conn(0x7ff17802bb60 legacy=0x7ff17802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.969+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c12c240 msgr2=0x7ff18c116100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:48.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.969+0000 7ff1911fe700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c12c240 0x7ff18c116100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff18400bc30 tx=0x7ff184009840).stop 2023-09-30T22:19:48.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.969+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 shutdown_connections 2023-09-30T22:19:48.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.969+0000 7ff1911fe700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c12c240 0x7ff18c116100 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.969+0000 7ff1911fe700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff18c093950 0x7ff18c12bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.969+0000 7ff1911fe700 1 --2- 172.21.15.154:0/863015703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c095c50 0x7ff18c115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:48.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.969+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 >> 172.21.15.154:0/863015703 conn(0x7ff18c09aa50 msgr2=0x7ff18c069570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:48.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.970+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 shutdown_connections 2023-09-30T22:19:48.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:48.970+0000 7ff1911fe700 1 -- 172.21.15.154:0/863015703 wait complete. 2023-09-30T22:19:48.973 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 5 2023-09-30T22:19:48.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed487b9700 1 Processor -- start 2023-09-30T22:19:49.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed487b9700 1 -- start start 2023-09-30T22:19:49.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed487b9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed40096810 0x7fed40096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed487b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4012e2d0 0x7fed401306c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed487b9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed400982f0 con 0x7fed400970e0 2023-09-30T22:19:49.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed487b9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed40068550 con 0x7fed40096810 2023-09-30T22:19:49.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed487b9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed40069e20 con 0x7fed4012e2d0 2023-09-30T22:19:49.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed46d56700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4012e2d0 0x7fed401306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed46555700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed40096810 0x7fed40096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed45d54700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fed400970e0 0x7fed400974c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51136/0 (socket says 172.21.15.154:51136) 2023-09-30T22:19:49.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.098+0000 7fed45d54700 1 -- 172.21.15.154:0/2091124129 learned_addr learned my addr 172.21.15.154:0/2091124129 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed46d56700 1 -- 172.21.15.154:0/2091124129 >> v2:172.21.15.154:3300/0 conn(0x7fed40096810 msgr2=0x7fed40096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed46d56700 1 --2- 172.21.15.154:0/2091124129 >> v2:172.21.15.154:3300/0 conn(0x7fed40096810 0x7fed40096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed46d56700 1 -- 172.21.15.154:0/2091124129 >> v1:172.21.15.154:6789/0 conn(0x7fed400970e0 legacy=0x7fed400974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed46d56700 1 -- 172.21.15.154:0/2091124129 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40097bd0 con 0x7fed4012e2d0 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed46555700 1 --2- 172.21.15.154:0/2091124129 >> v2:172.21.15.154:3300/0 conn(0x7fed40096810 0x7fed40096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed46d56700 1 --2- 172.21.15.154:0/2091124129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4012e2d0 0x7fed401306c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fed38009e60 tx=0x7fed38009780).ready entity=mon.1 client_cookie=d0198e44bb33933f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed45553700 1 -- 172.21.15.154:0/2091124129 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3800e070 con 0x7fed4012e2d0 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed45553700 1 -- 172.21.15.154:0/2091124129 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3800bb60 con 0x7fed4012e2d0 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed45553700 1 -- 172.21.15.154:0/2091124129 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38012410 con 0x7fed4012e2d0 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed487b9700 1 -- 172.21.15.154:0/2091124129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4012e2d0 msgr2=0x7fed401306c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.099+0000 7fed487b9700 1 --2- 172.21.15.154:0/2091124129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4012e2d0 0x7fed401306c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fed38009e60 tx=0x7fed38009780).stop 2023-09-30T22:19:49.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.100+0000 7fed487b9700 1 -- 172.21.15.154:0/2091124129 shutdown_connections 2023-09-30T22:19:49.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.100+0000 7fed487b9700 1 --2- 172.21.15.154:0/2091124129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4012e2d0 0x7fed401306c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.100+0000 7fed487b9700 1 --2- 172.21.15.154:0/2091124129 >> v2:172.21.15.154:3300/0 conn(0x7fed40096810 0x7fed40096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.100+0000 7fed487b9700 1 -- 172.21.15.154:0/2091124129 >> 172.21.15.154:0/2091124129 conn(0x7fed4009bad0 msgr2=0x7fed4009bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.100+0000 7fed487b9700 1 -- 172.21.15.154:0/2091124129 shutdown_connections 2023-09-30T22:19:49.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.100+0000 7fed487b9700 1 -- 172.21.15.154:0/2091124129 wait complete. 2023-09-30T22:19:49.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.100+0000 7fed487b9700 1 Processor -- start 2023-09-30T22:19:49.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.100+0000 7fed487b9700 1 -- start start 2023-09-30T22:19:49.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed487b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed40096810 0x7fed4012dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed487b9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fed400970e0 0x7fed40115b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed487b9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4012e2d0 0x7fed40116020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed487b9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed401191d0 con 0x7fed4012e2d0 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed487b9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed40118c80 con 0x7fed40096810 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed487b9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed40116f70 con 0x7fed400970e0 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46555700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed40096810 0x7fed4012dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46555700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed40096810 0x7fed4012dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49882/0 (socket says 172.21.15.154:49882) 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46555700 1 -- 172.21.15.154:0/2096024067 learned_addr learned my addr 172.21.15.154:0/2096024067 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed45d54700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fed400970e0 0x7fed40115b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46d56700 1 --2- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4012e2d0 0x7fed40116020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46d56700 1 -- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fed400970e0 msgr2=0x7fed40115b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46d56700 1 --2- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fed400970e0 0x7fed40115b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46d56700 1 -- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed40096810 msgr2=0x7fed4012dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46d56700 1 --2- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed40096810 0x7fed4012dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46d56700 1 -- 172.21.15.154:0/2096024067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3400d740 con 0x7fed4012e2d0 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed46d56700 1 --2- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4012e2d0 0x7fed40116020 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fed38014000 tx=0x7fed40069660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.101+0000 7fed327fc700 1 -- 172.21.15.154:0/2096024067 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38012410 con 0x7fed4012e2d0 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.102+0000 7fed327fc700 1 -- 172.21.15.154:0/2096024067 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38007080 con 0x7fed4012e2d0 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.102+0000 7fed327fc700 1 -- 172.21.15.154:0/2096024067 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3801d880 con 0x7fed4012e2d0 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.102+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed38009a20 con 0x7fed4012e2d0 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.102+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed40117530 con 0x7fed4012e2d0 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.102+0000 7fed327fc700 1 -- 172.21.15.154:0/2096024067 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fed38003040 con 0x7fed4012e2d0 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.102+0000 7fed327fc700 1 -- 172.21.15.154:0/2096024067 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fed3803cc60 con 0x7fed4012e2d0 2023-09-30T22:19:49.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.103+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4005a260 con 0x7fed4012e2d0 2023-09-30T22:19:49.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.107+0000 7fed327fc700 1 -- 172.21.15.154:0/2096024067 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fed38025da0 con 0x7fed4012e2d0 2023-09-30T22:19:49.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.266+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed40116930 con 0x7fed4012e2d0 2023-09-30T22:19:49.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.267+0000 7fed327fc700 1 -- 172.21.15.154:0/2096024067 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7fed38025360 con 0x7fed4012e2d0 2023-09-30T22:19:49.266 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:49.267 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:34.624706+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:49.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 >> v1:172.21.15.154:6816/118163 conn(0x7fed2402bb90 legacy=0x7fed2402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4012e2d0 msgr2=0x7fed40116020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 --2- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4012e2d0 0x7fed40116020 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fed38014000 tx=0x7fed40069660).stop 2023-09-30T22:19:49.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 shutdown_connections 2023-09-30T22:19:49.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 --2- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4012e2d0 0x7fed40116020 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 --2- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed40096810 0x7fed4012dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 --2- 172.21.15.154:0/2096024067 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fed400970e0 0x7fed40115b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 >> 172.21.15.154:0/2096024067 conn(0x7fed4009bad0 msgr2=0x7fed40095000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 shutdown_connections 2023-09-30T22:19:49.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.268+0000 7fed487b9700 1 -- 172.21.15.154:0/2096024067 wait complete. 2023-09-30T22:19:49.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:19:49.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.398+0000 7f9b5bdda700 1 Processor -- start 2023-09-30T22:19:49.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b5bdda700 1 -- start start 2023-09-30T22:19:49.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b5bdda700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b540976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b5bdda700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b54127df0 0x7f9b5412ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b5bdda700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b540980b0 con 0x7f9b54128230 2023-09-30T22:19:49.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b5bdda700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540666f0 con 0x7f9b54127df0 2023-09-30T22:19:49.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b5bdda700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54065530 con 0x7f9b54066310 2023-09-30T22:19:49.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b59b76700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b540976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b59375700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b54127df0 0x7f9b5412ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b5a377700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9b54128230 0x7f9b5412b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51150/0 (socket says 172.21.15.154:51150) 2023-09-30T22:19:49.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b5a377700 1 -- 172.21.15.154:0/1527109158 learned_addr learned my addr 172.21.15.154:0/1527109158 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:49.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b59b76700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b540976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49896/0 (socket says 172.21.15.154:49896) 2023-09-30T22:19:49.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.399+0000 7f9b59375700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b54127df0 0x7f9b5412ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38682/0 (socket says 172.21.15.154:38682) 2023-09-30T22:19:49.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b59375700 1 -- 172.21.15.154:0/1527109158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 msgr2=0x7f9b540976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b59375700 1 --2- 172.21.15.154:0/1527109158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b540976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b59375700 1 -- 172.21.15.154:0/1527109158 >> v1:172.21.15.154:6789/0 conn(0x7f9b54128230 legacy=0x7f9b5412b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b58b74700 1 -- 172.21.15.154:0/1527109158 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908177455 0 0) 0x7f9b540980b0 con 0x7f9b54128230 2023-09-30T22:19:49.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b59375700 1 -- 172.21.15.154:0/1527109158 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54065850 con 0x7f9b54127df0 2023-09-30T22:19:49.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b59b76700 1 --2- 172.21.15.154:0/1527109158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b540976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b59375700 1 --2- 172.21.15.154:0/1527109158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 0x7f9b5412ab20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f9b50009790 tx=0x7f9b50009060).ready entity=mon.0 client_cookie=446d76c14b6a6393 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b58b74700 1 -- 172.21.15.154:0/1527109158 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b500090d0 con 0x7f9b54127df0 2023-09-30T22:19:49.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b58b74700 1 -- 172.21.15.154:0/1527109158 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000f510 con 0x7f9b54127df0 2023-09-30T22:19:49.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b58b74700 1 -- 172.21.15.154:0/1527109158 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000f890 con 0x7f9b54127df0 2023-09-30T22:19:49.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b5bdda700 1 -- 172.21.15.154:0/1527109158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 msgr2=0x7f9b5412ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b5bdda700 1 --2- 172.21.15.154:0/1527109158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 0x7f9b5412ab20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f9b50009790 tx=0x7f9b50009060).stop 2023-09-30T22:19:49.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b5bdda700 1 -- 172.21.15.154:0/1527109158 shutdown_connections 2023-09-30T22:19:49.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b5bdda700 1 --2- 172.21.15.154:0/1527109158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b540976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b5bdda700 1 --2- 172.21.15.154:0/1527109158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 0x7f9b5412ab20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b5bdda700 1 -- 172.21.15.154:0/1527109158 >> 172.21.15.154:0/1527109158 conn(0x7f9b5409bad0 msgr2=0x7f9b5409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b5bdda700 1 -- 172.21.15.154:0/1527109158 shutdown_connections 2023-09-30T22:19:49.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.400+0000 7f9b5bdda700 1 -- 172.21.15.154:0/1527109158 wait complete. 2023-09-30T22:19:49.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.401+0000 7f9b5bdda700 1 Processor -- start 2023-09-30T22:19:49.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.401+0000 7f9b5bdda700 1 -- start start 2023-09-30T22:19:49.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b5bdda700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b5413a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b5bdda700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 0x7f9b5413a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b5bdda700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b54128230 0x7f9b5413ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b5bdda700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5412b130 con 0x7f9b54127df0 2023-09-30T22:19:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b5bdda700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5412b980 con 0x7f9b54066310 2023-09-30T22:19:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b5bdda700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54113770 con 0x7f9b54128230 2023-09-30T22:19:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59375700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 0x7f9b5413a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59b76700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b5413a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59375700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 0x7f9b5413a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38690/0 (socket says 172.21.15.154:38690) 2023-09-30T22:19:49.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59375700 1 -- 172.21.15.154:0/3446954299 learned_addr learned my addr 172.21.15.154:0/3446954299 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b5a377700 1 --2- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b54128230 0x7f9b5413ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59b76700 1 -- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b54128230 msgr2=0x7f9b5413ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59b76700 1 --2- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b54128230 0x7f9b5413ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59b76700 1 -- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 msgr2=0x7f9b5413a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59b76700 1 --2- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 0x7f9b5413a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59b76700 1 -- 172.21.15.154:0/3446954299 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440092a0 con 0x7f9b54066310 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59375700 1 --2- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 0x7f9b5413a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b59b76700 1 --2- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b5413a3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9b4400e8b0 tx=0x7f9b44009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b49ffb700 1 -- 172.21.15.154:0/3446954299 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44012600 con 0x7f9b54066310 2023-09-30T22:19:49.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b49ffb700 1 -- 172.21.15.154:0/3446954299 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b44012760 con 0x7f9b54066310 2023-09-30T22:19:49.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b500092a0 con 0x7f9b54066310 2023-09-30T22:19:49.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.402+0000 7f9b49ffb700 1 -- 172.21.15.154:0/3446954299 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44012ae0 con 0x7f9b54066310 2023-09-30T22:19:49.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.403+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b540651c0 con 0x7f9b54066310 2023-09-30T22:19:49.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.403+0000 7f9b49ffb700 1 -- 172.21.15.154:0/3446954299 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9b4401b400 con 0x7f9b54066310 2023-09-30T22:19:49.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.403+0000 7f9b49ffb700 1 -- 172.21.15.154:0/3446954299 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9b4403b3d0 con 0x7f9b54066310 2023-09-30T22:19:49.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.404+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b54113c70 con 0x7f9b54066310 2023-09-30T22:19:49.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.408+0000 7f9b49ffb700 1 -- 172.21.15.154:0/3446954299 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9b44019900 con 0x7f9b54066310 2023-09-30T22:19:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.603+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b5405a260 con 0x7f9b54066310 2023-09-30T22:19:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.603+0000 7f9b49ffb700 1 -- 172.21.15.154:0/3446954299 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f9b44016020 con 0x7f9b54066310 2023-09-30T22:19:49.603 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:49.603 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:19:33.620776+0000","modified":"2023-09-30T22:19:35.628146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:19:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 >> v1:172.21.15.154:6816/118163 conn(0x7f9b3802bb60 legacy=0x7f9b3802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 msgr2=0x7f9b5413a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 --2- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b5413a3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9b4400e8b0 tx=0x7f9b44009060).stop 2023-09-30T22:19:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 shutdown_connections 2023-09-30T22:19:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 --2- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b54128230 0x7f9b5413ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 --2- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b54066310 0x7f9b5413a3a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 --2- 172.21.15.154:0/3446954299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b54127df0 0x7f9b5413a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 >> 172.21.15.154:0/3446954299 conn(0x7f9b5409bad0 msgr2=0x7f9b5412e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 shutdown_connections 2023-09-30T22:19:49.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.605+0000 7f9b5bdda700 1 -- 172.21.15.154:0/3446954299 wait complete. 2023-09-30T22:19:49.606 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 5 2023-09-30T22:19:49.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:19:33.620776+0000', 'modified': '2023-09-30T22:19:35.628146+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6817/2576993373', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.154:6817', 'nonce': 2576993373}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:19:49.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:19:49.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:19:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.837+0000 7f0652a11700 1 Processor -- start 2023-09-30T22:19:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.837+0000 7f0652a11700 1 -- start start 2023-09-30T22:19:49.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f0652a11700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f064c125330 0x7f064c125ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f0652a11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c12dc50 0x7f064c130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f0652a11700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c095950 con 0x7f064c062b00 2023-09-30T22:19:49.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f0652a11700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c062ee0 con 0x7f064c125330 2023-09-30T22:19:49.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f0652a11700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0969c0 con 0x7f064c12dc50 2023-09-30T22:19:49.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f0650fae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c12dc50 0x7f064c130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f064b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f064c125330 0x7f064c125ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f0650fae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c12dc50 0x7f064c130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49908/0 (socket says 172.21.15.154:49908) 2023-09-30T22:19:49.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f0650fae700 1 -- 172.21.15.154:0/1115950167 learned_addr learned my addr 172.21.15.154:0/1115950167 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f064bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f064c062b00 0x7f064c1257c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51166/0 (socket says 172.21.15.154:51166) 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f064b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f064c125330 0x7f064c125ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38706/0 (socket says 172.21.15.154:38706) 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f064b7fe700 1 -- 172.21.15.154:0/1115950167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c12dc50 msgr2=0x7f064c130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f064b7fe700 1 --2- 172.21.15.154:0/1115950167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c12dc50 0x7f064c130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f064b7fe700 1 -- 172.21.15.154:0/1115950167 >> v1:172.21.15.154:6789/0 conn(0x7f064c062b00 legacy=0x7f064c1257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f064affd700 1 -- 172.21.15.154:0/1115950167 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516536634 0 0) 0x7f064c095950 con 0x7f064c062b00 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f064b7fe700 1 -- 172.21.15.154:0/1115950167 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0635f0 con 0x7f064c125330 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f0650fae700 1 --2- 172.21.15.154:0/1115950167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c12dc50 0x7f064c130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.838+0000 7f064b7fe700 1 --2- 172.21.15.154:0/1115950167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f064c125330 0x7f064c125ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0634009760 tx=0x7f0634009060).ready entity=mon.0 client_cookie=9cb5d00956056b89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f064affd700 1 -- 172.21.15.154:0/1115950167 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400f510 con 0x7f064c125330 2023-09-30T22:19:49.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f064affd700 1 -- 172.21.15.154:0/1115950167 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400f670 con 0x7f064c125330 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f064affd700 1 -- 172.21.15.154:0/1115950167 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400f9f0 con 0x7f064c125330 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f0652a11700 1 -- 172.21.15.154:0/1115950167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f064c125330 msgr2=0x7f064c125ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f0652a11700 1 --2- 172.21.15.154:0/1115950167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f064c125330 0x7f064c125ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0634009760 tx=0x7f0634009060).stop 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f0652a11700 1 -- 172.21.15.154:0/1115950167 shutdown_connections 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f0652a11700 1 --2- 172.21.15.154:0/1115950167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c12dc50 0x7f064c130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f0652a11700 1 --2- 172.21.15.154:0/1115950167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f064c125330 0x7f064c125ed0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f0652a11700 1 -- 172.21.15.154:0/1115950167 >> 172.21.15.154:0/1115950167 conn(0x7f064c09aa50 msgr2=0x7f064c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f0652a11700 1 -- 172.21.15.154:0/1115950167 shutdown_connections 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.839+0000 7f0652a11700 1 -- 172.21.15.154:0/1115950167 wait complete. 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.840+0000 7f0652a11700 1 Processor -- start 2023-09-30T22:19:49.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.840+0000 7f0652a11700 1 -- start start 2023-09-30T22:19:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0652a11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c062b00 0x7f064c12b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0652a11700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064c12dc50 0x7f064c12be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0652a11700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f064c12c360 0x7f064c12c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0652a11700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c12d770 con 0x7f064c12c360 2023-09-30T22:19:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0652a11700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c069a40 con 0x7f064c062b00 2023-09-30T22:19:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0652a11700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f064c12acf0 con 0x7f064c12dc50 2023-09-30T22:19:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c062b00 0x7f064c12b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064c12dc50 0x7f064c12be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0650fae700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f064c12c360 0x7f064c12c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c062b00 0x7f064c12b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49924/0 (socket says 172.21.15.154:49924) 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064bfff700 1 -- 172.21.15.154:0/3627504121 learned_addr learned my addr 172.21.15.154:0/3627504121 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064bfff700 1 -- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064c12dc50 msgr2=0x7f064c12be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064bfff700 1 --2- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064c12dc50 0x7f064c12be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064bfff700 1 -- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f064c12c360 msgr2=0x7f064c12c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064bfff700 1 --2- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f064c12c360 0x7f064c12c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064bfff700 1 -- 172.21.15.154:0/3627504121 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644009ae0 con 0x7f064c062b00 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f064bfff700 1 --2- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c062b00 0x7f064c12b790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f063c00c4c0 tx=0x7f063c007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0643fff700 1 -- 172.21.15.154:0/3627504121 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00ce30 con 0x7f064c062b00 2023-09-30T22:19:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0643fff700 1 -- 172.21.15.154:0/3627504121 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c0072e0 con 0x7f064c062b00 2023-09-30T22:19:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0652a11700 1 -- 172.21.15.154:0/3627504121 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06340092a0 con 0x7f064c062b00 2023-09-30T22:19:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0643fff700 1 -- 172.21.15.154:0/3627504121 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c0056e0 con 0x7f064c062b00 2023-09-30T22:19:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.841+0000 7f0652a11700 1 -- 172.21.15.154:0/3627504121 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c129a20 con 0x7f064c062b00 2023-09-30T22:19:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.842+0000 7f0643fff700 1 -- 172.21.15.154:0/3627504121 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f063c005a90 con 0x7f064c062b00 2023-09-30T22:19:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.842+0000 7f0643fff700 1 -- 172.21.15.154:0/3627504121 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f063c03a6c0 con 0x7f064c062b00 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.845+0000 7f06643c4b80 1 Processor -- start 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.845+0000 7f06643c4b80 1 -- start start 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.845+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1170 0x557cb7ab1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.845+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1a40 0x557cb7adb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.845+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7add9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.845+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb7a7b610 con 0x557cb7ab1170 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.845+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cb79f1db0 con 0x557cb7adb5b0 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.845+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x557cb7a07030 con 0x557cb7ab1a40 2023-09-30T22:19:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1a40 0x557cb7adb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f0650fae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7add9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f0650fae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7add9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49934/0 (socket says 172.21.15.154:49934) 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1a40 0x557cb7adb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34616/0 (socket says 172.21.15.154:34616) 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f0650fae700 1 -- 172.21.15.154:0/1228895190 learned_addr learned my addr 172.21.15.154:0/1228895190 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1170 0x557cb7ab1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064b7fe700 1 -- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 msgr2=0x557cb7add9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064b7fe700 1 --2- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7add9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064b7fe700 1 -- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1170 msgr2=0x557cb7ab1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064b7fe700 1 --2- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1170 0x557cb7ab1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064b7fe700 1 -- 172.21.15.154:0/1228895190 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cb78a2710 con 0x557cb7ab1a40 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064bfff700 1 --2- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1170 0x557cb7ab1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f0650fae700 1 --2- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7add9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f064b7fe700 1 --2- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1a40 0x557cb7adb0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0634014000 tx=0x7f0634017000).ready entity=mon.2 client_cookie=2992b93519305643 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f06417fa700 1 -- 172.21.15.154:0/1228895190 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634009e30 con 0x557cb7ab1a40 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f06417fa700 1 -- 172.21.15.154:0/1228895190 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400f8b0 con 0x557cb7ab1a40 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.846+0000 7f06417fa700 1 -- 172.21.15.154:0/1228895190 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063401b650 con 0x557cb7ab1a40 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 -- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1a40 msgr2=0x557cb7adb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 --2- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1a40 0x557cb7adb0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0634014000 tx=0x7f0634017000).stop 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 -- 172.21.15.154:0/1228895190 shutdown_connections 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 --2- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7add9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 --2- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1170 0x557cb7ab1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 --2- 172.21.15.154:0/1228895190 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1a40 0x557cb7adb0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 -- 172.21.15.154:0/1228895190 >> 172.21.15.154:0/1228895190 conn(0x557cb791f940 msgr2=0x557cb7ad1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 -- 172.21.15.154:0/1228895190 shutdown_connections 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 -- 172.21.15.154:0/1228895190 wait complete. 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 -- start start 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.847+0000 7f06643c4b80 1 Processor -- start 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 0x557cb7ae0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1a40 0x557cb7ae1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7adb5b0 0x557cb7ad6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb7a07170 con 0x557cb7adb5b0 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cb7a073f0 con 0x557cb7ab1a40 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x557cb79d2920 con 0x557cb7ab1170 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f06643c4b80 10 client.0 ll_register_callbacks cb 0x557cb79a7ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:19:49.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1a40 0x557cb7ae1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f0650fae700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7adb5b0 0x557cb7ad6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1a40 0x557cb7ae1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49950/0 (socket says 172.21.15.154:49950) 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f064b7fe700 1 -- 172.21.15.154:0/3685150972 learned_addr learned my addr 172.21.15.154:0/3685150972 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f0650fae700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7adb5b0 0x557cb7ad6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38716/0 (socket says 172.21.15.154:38716) 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f064b7fe700 1 -- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 msgr2=0x557cb7ae0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f064b7fe700 1 --2- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 0x557cb7ae0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f064b7fe700 1 -- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7adb5b0 msgr2=0x557cb7ad6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f064b7fe700 1 --2- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7adb5b0 0x557cb7ad6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f064b7fe700 1 -- 172.21.15.154:0/3685150972 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c0635f0 con 0x557cb7ab1a40 2023-09-30T22:19:49.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f064b7fe700 1 --2- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1a40 0x557cb7ae1060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0634011000 tx=0x7f0634020040).ready entity=mon.1 client_cookie=b4b7009de239ce3b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.848+0000 7f062a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.154:3301/0 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f062a7fc700 1 -- 172.21.15.154:0/3685150972 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063402c070 con 0x557cb7ab1a40 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f062a7fc700 1 -- 172.21.15.154:0/3685150972 <== mon.1 v2:172.21.15.154:3301/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f063401bc90 con 0x557cb7ab1a40 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f06643c4b80 1 -- 172.21.15.154:0/3685150972 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557cb7aa9f20 con 0x557cb7ab1a40 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f062a7fc700 1 -- 172.21.15.154:0/3685150972 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f063401be50 con 0x557cb7ab1a40 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f06643c4b80 10 client.4480 fetch_fsmap learned FSMap version 5 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f06643c4b80 1 -- 172.21.15.154:0/3685150972 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x557cb79d9b00 con 0x557cb7ab1a40 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f062a7fc700 1 -- 172.21.15.154:0/3685150972 <== mon.1 v2:172.21.15.154:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634035030 con 0x557cb7ab1a40 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f062a7fc700 1 -- 172.21.15.154:0/3685150972 <== mon.1 v2:172.21.15.154:3301/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f0634009790 con 0x557cb7ab1a40 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f06643c4b80 10 client.4480 fetch_fsmap finished waiting for FSMap version 5 2023-09-30T22:19:49.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f06643c4b80 10 client.4480 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f06643c4b80 20 client.4480 populate_metadata read hostname 'smithi154' 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f06643c4b80 4 client.4480 mds_command: new command op to 4184 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f06643c4b80 1 -- 172.21.15.154:0/3685150972 --> v1:172.21.15.154:6817/2576993373 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557cb7a7f250 con 0x557cb7ad7400 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.849+0000 7f062a7fc700 10 client.4480 ms_handle_connect on v1:172.21.15.154:6817/2576993373 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f062a7fc700 1 -- 172.21.15.154:0/3685150972 <== mds.0 v1:172.21.15.154:6817/2576993373 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x557cb7a7f250 con 0x557cb7ad7400 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f062a7fc700 10 client.4480 handle_command_reply: tid=0 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 client.4480 shutdown 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 -- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1a40 msgr2=0x557cb7ae1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 --2- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1a40 0x557cb7ae1060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0634011000 tx=0x7f0634020040).stop 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 -- 172.21.15.154:0/3685150972 shutdown_connections 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 --2- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7adb5b0 0x557cb7ad6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 --2- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 0x557cb7ae0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:49.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f062a7fc700 0 client.4480 ms_handle_reset on v1:172.21.15.154:6817/2576993373 2023-09-30T22:19:49.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 --2- 172.21.15.154:0/3685150972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1a40 0x557cb7ae1060 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 -- 172.21.15.154:0/3685150972 >> 172.21.15.154:0/3685150972 conn(0x557cb791f940 msgr2=0x557cb7ad1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 -- 172.21.15.154:0/3685150972 shutdown_connections 2023-09-30T22:19:49.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 1 -- 172.21.15.154:0/3685150972 wait complete. 2023-09-30T22:19:49.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.850+0000 7f06643c4b80 20 client.4480 trim_cache size 0 max 16384 2023-09-30T22:19:49.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.866+0000 7f06643c4b80 1 Processor -- start 2023-09-30T22:19:49.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.866+0000 7f06643c4b80 1 -- start start 2023-09-30T22:19:49.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1170 0x557cb7ad9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7aecf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7adb5b0 0x557cb7ab0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb7acc510 con 0x557cb7ab1a40 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cb7acc1a0 con 0x557cb7ab1170 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x557cb7ab4570 con 0x557cb7adb5b0 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7aecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1170 0x557cb7ad9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f0650fae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7adb5b0 0x557cb7ab0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7aecf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38718/0 (socket says 172.21.15.154:38718) 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064b7fe700 1 -- 172.21.15.154:0/3152798076 learned_addr learned my addr 172.21.15.154:0/3152798076 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064bfff700 1 -- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7adb5b0 msgr2=0x557cb7ab0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064bfff700 1 --2- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7adb5b0 0x557cb7ab0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064bfff700 1 -- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 msgr2=0x557cb7aecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064bfff700 1 --2- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7aecf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064bfff700 1 -- 172.21.15.154:0/3152798076 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557cb79fff70 con 0x557cb7ab1170 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064b7fe700 1 --2- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7aecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f0650fae700 1 --2- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7adb5b0 0x557cb7ab0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f064bfff700 1 --2- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1170 0x557cb7ad9f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f063c038e70 tx=0x7f063c013000).ready entity=mon.1 client_cookie=4115625d41854f3d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f0641ffb700 1 -- 172.21.15.154:0/3152798076 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c011350 con 0x557cb7ab1170 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f0641ffb700 1 -- 172.21.15.154:0/3152798076 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c007ca0 con 0x557cb7ab1170 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.867+0000 7f0641ffb700 1 -- 172.21.15.154:0/3152798076 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c039150 con 0x557cb7ab1170 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.868+0000 7f06643c4b80 1 -- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1170 msgr2=0x557cb7ad9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.868+0000 7f06643c4b80 1 --2- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1170 0x557cb7ad9f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f063c038e70 tx=0x7f063c013000).stop 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.868+0000 7f06643c4b80 1 -- 172.21.15.154:0/3152798076 shutdown_connections 2023-09-30T22:19:49.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.868+0000 7f06643c4b80 1 --2- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7adb5b0 0x557cb7ab0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.868+0000 7f06643c4b80 1 --2- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7ab1170 0x557cb7ad9f20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.868+0000 7f06643c4b80 1 --2- 172.21.15.154:0/3152798076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7aecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.868+0000 7f06643c4b80 1 -- 172.21.15.154:0/3152798076 >> 172.21.15.154:0/3152798076 conn(0x557cb791f940 msgr2=0x557cb7aaff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.868+0000 7f06643c4b80 1 -- 172.21.15.154:0/3152798076 shutdown_connections 2023-09-30T22:19:49.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.868+0000 7f06643c4b80 1 -- 172.21.15.154:0/3152798076 wait complete. 2023-09-30T22:19:49.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f06643c4b80 1 -- start start 2023-09-30T22:19:49.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f06643c4b80 1 Processor -- start 2023-09-30T22:19:49.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 0x557cb7b35e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7b36380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f06643c4b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7ade970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:49.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x557cb7b1a470 con 0x557cb7ab1a40 2023-09-30T22:19:49.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x557cb7ae1670 con 0x557cb7adb5b0 2023-09-30T22:19:49.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f06643c4b80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x557cb7ad8820 con 0x557cb7ab1170 2023-09-30T22:19:49.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f06643c4b80 10 client.0 ll_register_callbacks cb 0x557cb79a7ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:19:49.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7b36380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f064bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 0x557cb7b35e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f0650fae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7ade970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:49.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f064bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 0x557cb7b35e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34646/0 (socket says 172.21.15.154:34646) 2023-09-30T22:19:49.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7b36380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38728/0 (socket says 172.21.15.154:38728) 2023-09-30T22:19:49.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f064bfff700 1 -- 172.21.15.154:0/2790656419 learned_addr learned my addr 172.21.15.154:0/2790656419 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:49.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f0650fae700 1 -- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 msgr2=0x557cb7b35e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f0650fae700 1 --2- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 0x557cb7b35e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f0650fae700 1 -- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 msgr2=0x557cb7b36380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:49.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f0650fae700 1 --2- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7b36380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.869+0000 7f0650fae700 1 -- 172.21.15.154:0/2790656419 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557cb79d9b00 con 0x557cb7adb5b0 2023-09-30T22:19:49.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f0650fae700 1 --2- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7ade970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x557cb7ab31b0 tx=0x7f064400b040).ready entity=mon.1 client_cookie=e2806393ac14fd9b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:49.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f062a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.154:3301/0 2023-09-30T22:19:49.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f062a7fc700 1 -- 172.21.15.154:0/2790656419 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064401c070 con 0x557cb7adb5b0 2023-09-30T22:19:49.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f062a7fc700 1 -- 172.21.15.154:0/2790656419 <== mon.1 v2:172.21.15.154:3301/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f06440157b0 con 0x557cb7adb5b0 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f06643c4b80 1 -- 172.21.15.154:0/2790656419 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f063400f8b0 con 0x557cb7adb5b0 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f062a7fc700 1 -- 172.21.15.154:0/2790656419 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7f064400e040 con 0x557cb7adb5b0 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f06643c4b80 10 client.4486 fetch_fsmap learned FSMap version 5 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f06643c4b80 1 -- 172.21.15.154:0/2790656419 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x7f0644011810 con 0x557cb7adb5b0 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f062a7fc700 1 -- 172.21.15.154:0/2790656419 <== mon.1 v2:172.21.15.154:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400f8b0 con 0x557cb7adb5b0 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f062a7fc700 1 -- 172.21.15.154:0/2790656419 <== mon.1 v2:172.21.15.154:3301/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f0644015b80 con 0x557cb7adb5b0 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f06643c4b80 10 client.4486 fetch_fsmap finished waiting for FSMap version 5 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f06643c4b80 10 client.4486 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f06643c4b80 20 client.4486 populate_metadata read hostname 'smithi154' 2023-09-30T22:19:49.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f06643c4b80 4 client.4486 mds_command: new command op to 4184 tid=0[{"prefix": "status"}] 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f06643c4b80 1 -- 172.21.15.154:0/2790656419 --> v1:172.21.15.154:6817/2576993373 -- command(tid 0: {"prefix": "status"}) v1 -- 0x557cb786fef0 con 0x557cb7adf410 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.870+0000 7f062a7fc700 10 client.4486 ms_handle_connect on v1:172.21.15.154:6817/2576993373 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f062a7fc700 1 -- 172.21.15.154:0/2790656419 <== mds.0 v1:172.21.15.154:6817/2576993373 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 3822077656) 0x557cb786fef0 con 0x557cb7adf410 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f062a7fc700 10 client.4486 handle_command_reply: tid=0 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 client.4486 shutdown 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 -- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 msgr2=0x557cb7ade970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 --2- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7ade970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x557cb7ab31b0 tx=0x7f064400b040).stop 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 -- 172.21.15.154:0/2790656419 shutdown_connections 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 --2- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x557cb7adb5b0 0x557cb7ade970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f062a7fc700 0 client.4486 ms_handle_reset on v1:172.21.15.154:6817/2576993373 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 --2- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x557cb7ab1170 0x557cb7b35e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 --2- 172.21.15.154:0/2790656419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557cb7ab1a40 0x557cb7b36380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 -- 172.21.15.154:0/2790656419 >> 172.21.15.154:0/2790656419 conn(0x557cb791f940 msgr2=0x557cb7ab5570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 -- 172.21.15.154:0/2790656419 shutdown_connections 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 1 -- 172.21.15.154:0/2790656419 wait complete. 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f06643c4b80 20 client.4486 trim_cache size 0 max 16384 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "632db358-b709-49ad-a56a-97cde2869fcf", 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4184, 2023-09-30T22:19:49.879 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-09-30T22:19:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-09-30T22:19:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-09-30T22:19:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 16.243795767999998, 2023-09-30T22:19:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 5, 2023-09-30T22:19:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 16, 2023-09-30T22:19:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 16, 2023-09-30T22:19:49.880 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 20.530596908 2023-09-30T22:19:49.880 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-09-30T22:19:49.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f0652a11700 1 -- 172.21.15.154:0/3627504121 >> v1:172.21.15.154:6816/118163 conn(0x7f062c02bb60 legacy=0x7f062c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f0652a11700 1 -- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c062b00 msgr2=0x7f064c12b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:49.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f0652a11700 1 --2- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c062b00 0x7f064c12b790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f063c00c4c0 tx=0x7f063c007c10).stop 2023-09-30T22:19:49.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f0652a11700 1 -- 172.21.15.154:0/3627504121 shutdown_connections 2023-09-30T22:19:49.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f0652a11700 1 --2- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f064c12c360 0x7f064c12c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f0652a11700 1 --2- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064c062b00 0x7f064c12b790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.871+0000 7f0652a11700 1 --2- 172.21.15.154:0/3627504121 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064c12dc50 0x7f064c12be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:49.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.872+0000 7f0652a11700 1 -- 172.21.15.154:0/3627504121 >> 172.21.15.154:0/3627504121 conn(0x7f064c09aa50 msgr2=0x7f064c1232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:49.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.872+0000 7f0652a11700 1 -- 172.21.15.154:0/3627504121 shutdown_connections 2023-09-30T22:19:49.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:49.872+0000 7f0652a11700 1 -- 172.21.15.154:0/3627504121 wait complete. 2023-09-30T22:19:49.883 INFO:teuthology.run_tasks:Running task exec... 2023-09-30T22:19:49.892 INFO:teuthology.task.exec:Executing custom commands... 2023-09-30T22:19:49.892 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:19:49.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-09-30T22:19:50.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.007+0000 7f9f30ffc700 1 Processor -- start 2023-09-30T22:19:50.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f30ffc700 1 -- start start 2023-09-30T22:19:50.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f30ffc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c095b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:50.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f30ffc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9f2c091c60 0x7f9f2c096010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f30ffc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c096500 0x7f9f2c12e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f30ffc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c093f60 con 0x7f9f2c091c60 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f30ffc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0949e0 con 0x7f9f2c095740 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f30ffc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c097180 con 0x7f9f2c096500 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f2ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c096500 0x7f9f2c12e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f2a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c095b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f29d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9f2c091c60 0x7f9f2c096010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f2a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c095b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49980/0 (socket says 172.21.15.154:49980) 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f2ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c096500 0x7f9f2c12e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34658/0 (socket says 172.21.15.154:34658) 2023-09-30T22:19:50.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.008+0000 7f9f2a59c700 1 -- 172.21.15.154:0/4111366483 learned_addr learned my addr 172.21.15.154:0/4111366483 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2a59c700 1 -- 172.21.15.154:0/4111366483 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c096500 msgr2=0x7f9f2c12e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2a59c700 1 --2- 172.21.15.154:0/4111366483 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c096500 0x7f9f2c12e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2a59c700 1 -- 172.21.15.154:0/4111366483 >> v2:172.21.15.154:3300/0 conn(0x7f9f2c091c60 msgr2=0x7f9f2c096010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2a59c700 1 --2- 172.21.15.154:0/4111366483 >> v2:172.21.15.154:3300/0 conn(0x7f9f2c091c60 0x7f9f2c096010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2a59c700 1 -- 172.21.15.154:0/4111366483 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0920e0 con 0x7f9f2c095740 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f29d9b700 1 --2- 172.21.15.154:0/4111366483 >> v2:172.21.15.154:3300/0 conn(0x7f9f2c091c60 0x7f9f2c096010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2ad9d700 1 --2- 172.21.15.154:0/4111366483 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c096500 0x7f9f2c12e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2a59c700 1 --2- 172.21.15.154:0/4111366483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c095b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9f20006fd0 tx=0x7f9f200090f0).ready entity=mon.1 client_cookie=e6cc6afa51d89924 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2959a700 1 -- 172.21.15.154:0/4111366483 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000f510 con 0x7f9f2c095740 2023-09-30T22:19:50.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2959a700 1 -- 172.21.15.154:0/4111366483 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2000f670 con 0x7f9f2c095740 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f2959a700 1 -- 172.21.15.154:0/4111366483 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000f9f0 con 0x7f9f2c095740 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f30ffc700 1 -- 172.21.15.154:0/4111366483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 msgr2=0x7f9f2c095b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f30ffc700 1 --2- 172.21.15.154:0/4111366483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c095b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9f20006fd0 tx=0x7f9f200090f0).stop 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f30ffc700 1 -- 172.21.15.154:0/4111366483 shutdown_connections 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f30ffc700 1 --2- 172.21.15.154:0/4111366483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c095b20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f30ffc700 1 --2- 172.21.15.154:0/4111366483 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c096500 0x7f9f2c12e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f30ffc700 1 --2- 172.21.15.154:0/4111366483 >> v2:172.21.15.154:3300/0 conn(0x7f9f2c091c60 0x7f9f2c096010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.009+0000 7f9f30ffc700 1 -- 172.21.15.154:0/4111366483 >> 172.21.15.154:0/4111366483 conn(0x7f9f2c09a9b0 msgr2=0x7f9f2c09adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.010+0000 7f9f30ffc700 1 -- 172.21.15.154:0/4111366483 shutdown_connections 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.010+0000 7f9f30ffc700 1 -- 172.21.15.154:0/4111366483 wait complete. 2023-09-30T22:19:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.010+0000 7f9f30ffc700 1 Processor -- start 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.010+0000 7f9f30ffc700 1 -- start start 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f30ffc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c091c60 0x7f9f2c136f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f30ffc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f30ffc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f2c096500 0x7f9f2c137960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f30ffc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c11acf0 con 0x7f9f2c096500 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f30ffc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c092360 con 0x7f9f2c095740 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f30ffc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0668c0 con 0x7f9f2c091c60 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c091c60 0x7f9f2c136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f29d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c091c60 0x7f9f2c136f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34668/0 (socket says 172.21.15.154:34668) 2023-09-30T22:19:50.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2a59c700 1 -- 172.21.15.154:0/1679889783 learned_addr learned my addr 172.21.15.154:0/1679889783 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2ad9d700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f2c096500 0x7f9f2c137960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2a59c700 1 -- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 msgr2=0x7f9f2c137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2a59c700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c137470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2a59c700 1 -- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f2c096500 msgr2=0x7f9f2c137960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2a59c700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f2c096500 0x7f9f2c137960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2a59c700 1 -- 172.21.15.154:0/1679889783 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c0092a0 con 0x7f9f2c091c60 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2ad9d700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f2c096500 0x7f9f2c137960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f29d9b700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f2a59c700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c091c60 0x7f9f2c136f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9f2000ff90 tx=0x7f9f20017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f1a7fc700 1 -- 172.21.15.154:0/1679889783 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f20021070 con 0x7f9f2c091c60 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f1a7fc700 1 -- 172.21.15.154:0/1679889783 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f20000c90 con 0x7f9f2c091c60 2023-09-30T22:19:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.011+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f24009a20 con 0x7f9f2c091c60 2023-09-30T22:19:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.012+0000 7f9f1a7fc700 1 -- 172.21.15.154:0/1679889783 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000f9f0 con 0x7f9f2c091c60 2023-09-30T22:19:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.012+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f20009370 con 0x7f9f2c091c60 2023-09-30T22:19:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.012+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c066650 con 0x7f9f2c091c60 2023-09-30T22:19:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.013+0000 7f9f1a7fc700 1 -- 172.21.15.154:0/1679889783 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9f20026900 con 0x7f9f2c091c60 2023-09-30T22:19:50.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.013+0000 7f9f1a7fc700 1 -- 172.21.15.154:0/1679889783 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9f20040630 con 0x7f9f2c091c60 2023-09-30T22:19:50.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.017+0000 7f9f1a7fc700 1 -- 172.21.15.154:0/1679889783 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9f20011400 con 0x7f9f2c091c60 2023-09-30T22:19:50.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.184+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7f9f2c11a8e0 con 0x7f9f2c091c60 2023-09-30T22:19:50.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.774+0000 7f9f1a7fc700 1 -- 172.21.15.154:0/1679889783 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v17) v1 ==== 143+0+0 (secure 0 0 0) 0x7f9f20025830 con 0x7f9f2c091c60 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 >> v1:172.21.15.154:6816/118163 conn(0x7f9f0c02bb60 legacy=0x7f9f0c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c091c60 msgr2=0x7f9f2c136f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c091c60 0x7f9f2c136f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9f2000ff90 tx=0x7f9f20017000).stop 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 shutdown_connections 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f2c096500 0x7f9f2c137960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f2c091c60 0x7f9f2c136f80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 --2- 172.21.15.154:0/1679889783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f2c095740 0x7f9f2c137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 >> 172.21.15.154:0/1679889783 conn(0x7f9f2c09a9b0 msgr2=0x7f9f2c098830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 shutdown_connections 2023-09-30T22:19:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:50.778+0000 7f9f30ffc700 1 -- 172.21.15.154:0/1679889783 wait complete. 2023-09-30T22:19:50.779 INFO:teuthology.orchestra.run.smithi154.stderr:set require_min_compat_client to pacific 2023-09-30T22:19:50.791 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:19:50.799 INFO:teuthology.task.print:**** done ceph 2023-09-30T22:19:50.799 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-09-30T22:19:50.822 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-09-30T22:19:50.822 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-09-30T22:19:50.823 INFO:tasks.ceph_fuse:client.0 config is {} 2023-09-30T22:19:50.823 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T22:19:50.823 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:19:50.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:50.823 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-09-30T22:19:50.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:50.847 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2023-09-30T22:19:50.922 INFO:teuthology.orchestra.run.smithi163.stderr:Cannot find device "ceph-brx" 2023-09-30T22:19:50.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:19:50.924 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-09-30T22:19:50.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T22:19:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.048+0000 7fe90d9ad700 1 Processor -- start 2023-09-30T22:19:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.048+0000 7fe90d9ad700 1 -- start start 2023-09-30T22:19:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe90d9ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908094750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe90d9ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908094c40 0x7fe9081303b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe90d9ad700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe908093180 con 0x7fe908093980 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe90d9ad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe908093d60 con 0x7fe908094c40 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe90d9ad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080977d0 con 0x7fe9080972b0 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9067fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908094750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9077fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908094c40 0x7fe9081303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9067fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908094750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34670/0 (socket says 172.21.15.154:34670) 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe906ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe908093980 0x7fe908094040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51170/0 (socket says 172.21.15.154:51170) 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9077fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908094c40 0x7fe9081303b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49986/0 (socket says 172.21.15.154:49986) 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9067fc700 1 -- 172.21.15.154:0/3499064417 learned_addr learned my addr 172.21.15.154:0/3499064417 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9077fe700 1 -- 172.21.15.154:0/3499064417 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 msgr2=0x7fe908094750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9077fe700 1 --2- 172.21.15.154:0/3499064417 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908094750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9077fe700 1 -- 172.21.15.154:0/3499064417 >> v1:172.21.15.154:6789/0 conn(0x7fe908093980 legacy=0x7fe908094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe905ffb700 1 -- 172.21.15.154:0/3499064417 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991019778 0 0) 0x7fe908093180 con 0x7fe908093980 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9077fe700 1 -- 172.21.15.154:0/3499064417 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe908098430 con 0x7fe908094c40 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9067fc700 1 --2- 172.21.15.154:0/3499064417 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908094750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe9077fe700 1 --2- 172.21.15.154:0/3499064417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908094c40 0x7fe9081303b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe900009e90 tx=0x7fe900009780).ready entity=mon.1 client_cookie=eed2d23fea8b4d9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe905ffb700 1 -- 172.21.15.154:0/3499064417 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000e070 con 0x7fe908094c40 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe905ffb700 1 -- 172.21.15.154:0/3499064417 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000bb60 con 0x7fe908094c40 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.049+0000 7fe905ffb700 1 -- 172.21.15.154:0/3499064417 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900012410 con 0x7fe908094c40 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.050+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3499064417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908094c40 msgr2=0x7fe9081303b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.050+0000 7fe90d9ad700 1 --2- 172.21.15.154:0/3499064417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908094c40 0x7fe9081303b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe900009e90 tx=0x7fe900009780).stop 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.050+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3499064417 shutdown_connections 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.050+0000 7fe90d9ad700 1 --2- 172.21.15.154:0/3499064417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908094c40 0x7fe9081303b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.050+0000 7fe90d9ad700 1 --2- 172.21.15.154:0/3499064417 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908094750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:51.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.050+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3499064417 >> 172.21.15.154:0/3499064417 conn(0x7fe90809bba0 msgr2=0x7fe90809bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.050+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3499064417 shutdown_connections 2023-09-30T22:19:51.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.050+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3499064417 wait complete. 2023-09-30T22:19:51.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.051+0000 7fe90d9ad700 1 Processor -- start 2023-09-30T22:19:51.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.051+0000 7fe90d9ad700 1 -- start start 2023-09-30T22:19:51.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.051+0000 7fe90d9ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908093980 0x7fe9081180a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:51.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.051+0000 7fe90d9ad700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe908094c40 0x7fe908118590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:51.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.051+0000 7fe90d9ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908118a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:51.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.051+0000 7fe90d9ad700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9081301e0 con 0x7fe908094c40 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.051+0000 7fe90d9ad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90811a6d0 con 0x7fe908093980 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.051+0000 7fe90d9ad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe90806a710 con 0x7fe9080972b0 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe906ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908093980 0x7fe9081180a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe906ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908093980 0x7fe9081180a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49998/0 (socket says 172.21.15.154:49998) 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe9077fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908118a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe906ffd700 1 -- 172.21.15.154:0/3553718584 learned_addr learned my addr 172.21.15.154:0/3553718584 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe9067fc700 1 --2- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe908094c40 0x7fe908118590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe906ffd700 1 -- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 msgr2=0x7fe908118a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe906ffd700 1 --2- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908118a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe906ffd700 1 -- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe908094c40 msgr2=0x7fe908118590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe906ffd700 1 --2- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe908094c40 0x7fe908118590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:51.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe906ffd700 1 -- 172.21.15.154:0/3553718584 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8009370 con 0x7fe908093980 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe9077fe700 1 --2- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908118a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe906ffd700 1 --2- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908093980 0x7fe9081180a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe8fc00c4c0 tx=0x7fe8fc007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe8eeffd700 1 -- 172.21.15.154:0/3553718584 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00ce30 con 0x7fe908093980 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe8eeffd700 1 -- 172.21.15.154:0/3553718584 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc0072e0 con 0x7fe908093980 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe900009a20 con 0x7fe908093980 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe8eeffd700 1 -- 172.21.15.154:0/3553718584 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc0056e0 con 0x7fe908093980 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.052+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90811c220 con 0x7fe908093980 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.053+0000 7fe8eeffd700 1 -- 172.21.15.154:0/3553718584 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe8fc005a90 con 0x7fe908093980 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.053+0000 7fe8eeffd700 1 -- 172.21.15.154:0/3553718584 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe8fc03a760 con 0x7fe908093980 2023-09-30T22:19:51.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.053+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90805a260 con 0x7fe908093980 2023-09-30T22:19:51.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.057+0000 7fe8eeffd700 1 -- 172.21.15.154:0/3553718584 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe8fc013970 con 0x7fe908093980 2023-09-30T22:19:51.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.255+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe908095fa0 con 0x7fe908093980 2023-09-30T22:19:51.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.255+0000 7fe8eeffd700 1 -- 172.21.15.154:0/3553718584 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe8fc018020 con 0x7fe908093980 2023-09-30T22:19:51.255 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T22:19:51.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 >> v1:172.21.15.154:6816/118163 conn(0x7fe8f402bb60 legacy=0x7fe8f402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908093980 msgr2=0x7fe9081180a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:51.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 --2- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908093980 0x7fe9081180a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe8fc00c4c0 tx=0x7fe8fc007c10).stop 2023-09-30T22:19:51.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 shutdown_connections 2023-09-30T22:19:51.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 --2- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9080972b0 0x7fe908118a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:51.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 --2- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe908093980 0x7fe9081180a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:51.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 --2- 172.21.15.154:0/3553718584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe908094c40 0x7fe908118590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:51.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 >> 172.21.15.154:0/3553718584 conn(0x7fe90809bba0 msgr2=0x7fe908098680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:51.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 shutdown_connections 2023-09-30T22:19:51.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:51.257+0000 7fe90d9ad700 1 -- 172.21.15.154:0/3553718584 wait complete. 2023-09-30T22:19:51.268 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T22:19:51.268 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T22:19:51.268 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2023-09-30T22:19:51.269 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T22:19:51.269 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T22:19:51.269 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T22:19:51.269 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T22:19:51.269 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T22:19:51.269 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:19:51.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:51.269 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2023-09-30T22:19:51.292 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T22:19:51.292 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T22:19:51.292 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T22:19:51.292 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f0 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout: altname enp7s0f1 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T22:19:51.293 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2023-09-30T22:19:51.294 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T22:19:51.294 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2023-09-30T22:19:51.294 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-30T22:19:51.294 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 42558sec preferred_lft 42558sec 2023-09-30T22:19:51.294 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::ec4:7aff:fe88:7d5b/64 scope link 2023-09-30T22:19:51.294 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-09-30T22:19:51.294 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T22:19:51.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:51.295 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-09-30T22:19:51.295 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-09-30T22:19:51.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add name ceph-brx type bridge 2023-09-30T22:19:51.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr flush dev ceph-brx 2023-09-30T22:19:51.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set ceph-brx up 2023-09-30T22:19:51.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T22:19:51.295 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-09-30T22:19:51.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:51.476 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T22:19:51.508 INFO:teuthology.orchestra.run.smithi163.stdout:1 2023-09-30T22:19:51.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:51.509 DEBUG:teuthology.orchestra.run.smithi163:> route 2023-09-30T22:19:51.595 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2023-09-30T22:19:51.595 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T22:19:51.595 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-30T22:19:51.595 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-30T22:19:51.595 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T22:19:51.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:51.596 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-09-30T22:19:51.596 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-09-30T22:19:51.596 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-30T22:19:51.596 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-30T22:19:51.596 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-30T22:19:51.596 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-09-30T22:19:51.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:51.887 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-09-30T22:19:51.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:51.906 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2023-09-30T22:19:51.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:51.964 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-09-30T22:19:51.964 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-09-30T22:19:51.964 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:19:51.964 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-30T22:19:51.965 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-09-30T22:19:52.060 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-30T22:19:52.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:52.060 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-09-30T22:19:52.060 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-09-30T22:19:52.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-30T22:19:52.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T22:19:52.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-30T22:19:52.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-30T22:19:52.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-30T22:19:52.061 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-09-30T22:19:52.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:52.243 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-09-30T22:19:52.243 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-09-30T22:19:52.243 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.0 up 2023-09-30T22:19:52.243 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T22:19:52.243 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-09-30T22:19:52.341 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T22:19:52.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:19:52.341 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T22:19:52.359 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T22:19:52.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T22:19:52.360 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:19:52.417 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2023-09-30T22:19:52.487 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T22:19:52.546 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2023-09-30T22:19:52.546 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2023-09-30T22:19:52.546 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2023-09-30T22:19:52.546 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2023-09-30T22:19:52.546 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2023-09-30T22:19:52.546 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2023-09-30T22:19:52.546 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2023-09-30T22:19:52.546 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2023-09-30T22:19:52.546 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/systemd 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/cpuset 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/rdma 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/memory 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/freezer 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/perf_event 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/hugetlb 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/blkio 2023-09-30T22:19:52.547 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/pids 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/devices 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T22:19:52.548 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2023-09-30T22:19:52.549 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2023-09-30T22:19:52.549 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2023-09-30T22:19:52.549 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:19:52.549 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:19:52.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:52.549 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2023-09-30T22:19:52.604 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T22:19:52.605 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T22:19:52.647 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2023-09-30T22:19:52.674 DEBUG:teuthology.orchestra.run.smithi163:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T22:19:52.733 INFO:teuthology.orchestra.run.smithi163.stdout:/sys 2023-09-30T22:19:52.733 INFO:teuthology.orchestra.run.smithi163.stdout:/proc 2023-09-30T22:19:52.733 INFO:teuthology.orchestra.run.smithi163.stdout:/dev 2023-09-30T22:19:52.733 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/security 2023-09-30T22:19:52.733 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/shm 2023-09-30T22:19:52.733 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/pts 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/run 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/systemd 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/pstore 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/bpf 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/cpuset 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/rdma 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/memory 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/freezer 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/perf_event 2023-09-30T22:19:52.734 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/hugetlb 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/blkio 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/pids 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/cgroup/devices 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/tracing 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/config 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/ 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/selinux 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/mqueue 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/kernel/debug 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T22:19:52.735 INFO:teuthology.orchestra.run.smithi163.stdout:/dev/hugepages 2023-09-30T22:19:52.736 INFO:teuthology.orchestra.run.smithi163.stdout:/sys/fs/fuse/connections 2023-09-30T22:19:52.736 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T22:19:52.736 INFO:teuthology.orchestra.run.smithi163.stdout:/run/user/1000 2023-09-30T22:19:52.736 INFO:teuthology.orchestra.run.smithi163.stdout:/var/lib/ceph 2023-09-30T22:19:52.736 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns 2023-09-30T22:19:52.736 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:19:52.736 INFO:teuthology.orchestra.run.smithi163.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:19:52.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:52.736 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2023-09-30T22:19:52.739 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:2023-09-30T22:19:52.738+0000 7f4ca585a3c0 -1 init, newargv = 0x55dab239d830 newargc=15 2023-09-30T22:19:52.739 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:ceph-fuse[112279]: starting ceph client 2023-09-30T22:19:52.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:ceph-fuse[112279]: starting fuse 2023-09-30T22:19:52.756 INFO:teuthology.orchestra.run.smithi163.stdout:46 2023-09-30T22:19:52.756 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-09-30T22:19:52.756 DEBUG:teuthology.orchestra.run.smithi163:> sudo stdin-killer -- python3 -c ' 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> import glob 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> import re 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> import os 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> import subprocess 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> def _find_admin_socket(client_name): 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> files = glob.glob(asok_path) 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> # Given a non-glob path, it better be there 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> if "*" not in asok_path: 2023-09-30T22:19:52.757 DEBUG:teuthology.orchestra.run.smithi163:> assert(len(files) == 1) 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> return files[0] 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> for f in files: 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> contents = proc_f.read() 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> if mountpoint in contents: 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> return f 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T22:19:52.758 DEBUG:teuthology.orchestra.run.smithi163:> 2023-09-30T22:19:52.759 DEBUG:teuthology.orchestra.run.smithi163:> print(_find_admin_socket("client.0")) 2023-09-30T22:19:52.759 DEBUG:teuthology.orchestra.run.smithi163:> ' 2023-09-30T22:19:52.880 INFO:teuthology.orchestra.run.smithi163.stdout:/var/run/ceph/ceph-client.0.112279.asok 2023-09-30T22:19:52.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-09-30T22:19:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T22:19:52.889 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112279.asok 2023-09-30T22:19:52.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:52.889 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112279.asok status 2023-09-30T22:19:53.040 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-09-30T22:19:53.040 INFO:teuthology.orchestra.run.smithi163.stdout: "metadata": { 2023-09-30T22:19:53.040 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_sha1": "eeb13ac974775bd0cce96a2c687e8bcc2faca43d", 2023-09-30T22:19:53.040 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 16.2.14-44-geeb13ac9 (eeb13ac974775bd0cce96a2c687e8bcc2faca43d) pacific (stable)", 2023-09-30T22:19:53.040 INFO:teuthology.orchestra.run.smithi163.stdout: "entity_id": "0", 2023-09-30T22:19:53.040 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": "smithi163", 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "pid": "112279", 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "root": "/" 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_count": 0, 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_pinned_count": 0, 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 4644, 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "inst": { 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "name": { 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "client", 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: "num": 4644 2023-09-30T22:19:53.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:0", 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 3177462025 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:0", 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 3177462025 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-09-30T22:19:53.042 INFO:teuthology.orchestra.run.smithi163.stdout: "inst_str": "client.4644 172.21.15.163:0/3177462025", 2023-09-30T22:19:53.043 INFO:teuthology.orchestra.run.smithi163.stdout: "addr_str": "172.21.15.163:0/3177462025", 2023-09-30T22:19:53.043 INFO:teuthology.orchestra.run.smithi163.stdout: "inode_count": 1, 2023-09-30T22:19:53.043 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_epoch": 5, 2023-09-30T22:19:53.043 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch": 17, 2023-09-30T22:19:53.043 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch_barrier": 0, 2023-09-30T22:19:53.043 INFO:teuthology.orchestra.run.smithi163.stdout: "blocklisted": false, 2023-09-30T22:19:53.043 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs" 2023-09-30T22:19:53.043 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-09-30T22:19:53.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:53.050 DEBUG:teuthology.orchestra.run.smithi163:> stat --file-system '--printf=%T 2023-09-30T22:19:53.050 DEBUG:teuthology.orchestra.run.smithi163:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T22:19:53.069 INFO:teuthology.orchestra.run.smithi163.stdout:fuseblk 2023-09-30T22:19:53.069 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T22:19:53.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:19:53.070 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T22:19:53.138 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-09-30T22:19:53.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:53.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.279+0000 7f9ac8a9e700 1 Processor -- start 2023-09-30T22:19:53.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.280+0000 7f9ac8a9e700 1 -- start start 2023-09-30T22:19:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.280+0000 7f9ac8a9e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.280+0000 7f9ac8a9e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac40970e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac8a9e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac4091980 con 0x7f9ac4067f40 2023-09-30T22:19:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac8a9e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40933f0 con 0x7f9ac405f560 2023-09-30T22:19:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac8a9e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4092420 con 0x7f9ac4096d00 2023-09-30T22:19:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac40970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac2d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9ac4067f40 0x7f9ac40683a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51186/0 (socket says 172.21.15.154:51186) 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac2d9d700 1 -- 172.21.15.154:0/1061540918 learned_addr learned my addr 172.21.15.154:0/1061540918 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac259c700 1 -- 172.21.15.154:0/1061540918 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 msgr2=0x7f9ac40970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac259c700 1 --2- 172.21.15.154:0/1061540918 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac40970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac159a700 1 -- 172.21.15.154:0/1061540918 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868551597 0 0) 0x7f9ac4091980 con 0x7f9ac4067f40 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac259c700 1 -- 172.21.15.154:0/1061540918 >> v1:172.21.15.154:6789/0 conn(0x7f9ac4067f40 legacy=0x7f9ac40683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac259c700 1 -- 172.21.15.154:0/1061540918 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4092160 con 0x7f9ac405f560 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac1d9b700 1 --2- 172.21.15.154:0/1061540918 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac40970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac259c700 1 --2- 172.21.15.154:0/1061540918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4096810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9ab8009790 tx=0x7f9ab8009060).ready entity=mon.1 client_cookie=14b3f534127ed3eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac159a700 1 -- 172.21.15.154:0/1061540918 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800f510 con 0x7f9ac405f560 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac159a700 1 -- 172.21.15.154:0/1061540918 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800f670 con 0x7f9ac405f560 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.281+0000 7f9ac159a700 1 -- 172.21.15.154:0/1061540918 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800f9f0 con 0x7f9ac405f560 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.282+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/1061540918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 msgr2=0x7f9ac4096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.282+0000 7f9ac8a9e700 1 --2- 172.21.15.154:0/1061540918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4096810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9ab8009790 tx=0x7f9ab8009060).stop 2023-09-30T22:19:53.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.282+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/1061540918 shutdown_connections 2023-09-30T22:19:53.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.282+0000 7f9ac8a9e700 1 --2- 172.21.15.154:0/1061540918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4096810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.282+0000 7f9ac8a9e700 1 --2- 172.21.15.154:0/1061540918 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac40970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.282+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/1061540918 >> 172.21.15.154:0/1061540918 conn(0x7f9ac409a230 msgr2=0x7f9ac409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:53.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.282+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/1061540918 shutdown_connections 2023-09-30T22:19:53.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.282+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/1061540918 wait complete. 2023-09-30T22:19:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.283+0000 7f9ac8a9e700 1 Processor -- start 2023-09-30T22:19:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.283+0000 7f9ac8a9e700 1 -- start start 2023-09-30T22:19:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac8a9e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac8a9e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac4067f40 0x7f9ac4138660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac8a9e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac4119040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac8a9e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac412aef0 con 0x7f9ac4067f40 2023-09-30T22:19:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac8a9e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac411b700 con 0x7f9ac405f560 2023-09-30T22:19:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac8a9e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40997e0 con 0x7f9ac4096d00 2023-09-30T22:19:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac4067f40 0x7f9ac4138660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4138170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:50022/0 (socket says 172.21.15.154:50022) 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac259c700 1 -- 172.21.15.154:0/2221618040 learned_addr learned my addr 172.21.15.154:0/2221618040 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac2d9d700 1 --2- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac4119040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac259c700 1 -- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 msgr2=0x7f9ac4119040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac259c700 1 --2- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac4119040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac259c700 1 -- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac4067f40 msgr2=0x7f9ac4138660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac259c700 1 --2- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac4067f40 0x7f9ac4138660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac259c700 1 -- 172.21.15.154:0/2221618040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40092a0 con 0x7f9ac405f560 2023-09-30T22:19:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac2d9d700 1 --2- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac4119040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac259c700 1 --2- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4138170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9ac4093580 tx=0x7f9ab8017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ab27fc700 1 -- 172.21.15.154:0/2221618040 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800fe80 con 0x7f9ac405f560 2023-09-30T22:19:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ab27fc700 1 -- 172.21.15.154:0/2221618040 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800f7e0 con 0x7f9ac405f560 2023-09-30T22:19:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab80092a0 con 0x7f9ac405f560 2023-09-30T22:19:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.284+0000 7f9ab27fc700 1 -- 172.21.15.154:0/2221618040 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab801b640 con 0x7f9ac405f560 2023-09-30T22:19:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.285+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac4067020 con 0x7f9ac405f560 2023-09-30T22:19:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.285+0000 7f9ab27fc700 1 -- 172.21.15.154:0/2221618040 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9ab801ba30 con 0x7f9ac405f560 2023-09-30T22:19:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.285+0000 7f9ab27fc700 1 -- 172.21.15.154:0/2221618040 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9ab803c880 con 0x7f9ac405f560 2023-09-30T22:19:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.285+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac405a260 con 0x7f9ac405f560 2023-09-30T22:19:53.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.290+0000 7f9ab27fc700 1 -- 172.21.15.154:0/2221618040 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9ab8029080 con 0x7f9ac405f560 2023-09-30T22:19:53.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.450+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ac40697e0 con 0x7f9ac405f560 2023-09-30T22:19:53.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.451+0000 7f9ab27fc700 1 -- 172.21.15.154:0/2221618040 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11372 (secure 0 0 0) 0x7f9ab801f020 con 0x7f9ac405f560 2023-09-30T22:19:53.451 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:53.451 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:50.770596+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 >> v1:172.21.15.154:6816/118163 conn(0x7f9aa402bb60 legacy=0x7f9aa402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 msgr2=0x7f9ac4138170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 --2- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4138170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9ac4093580 tx=0x7f9ab8017000).stop 2023-09-30T22:19:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 shutdown_connections 2023-09-30T22:19:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 --2- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ac4096d00 0x7f9ac4119040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 --2- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac405f560 0x7f9ac4138170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 --2- 172.21.15.154:0/2221618040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac4067f40 0x7f9ac4138660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 >> 172.21.15.154:0/2221618040 conn(0x7f9ac409a230 msgr2=0x7f9ac4110890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:53.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 shutdown_connections 2023-09-30T22:19:53.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.453+0000 7f9ac8a9e700 1 -- 172.21.15.154:0/2221618040 wait complete. 2023-09-30T22:19:53.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-09-30T22:19:27.265135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:19:28.184247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:19:32.024148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:19:32.601719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-30T22:19:53.465 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-09-30T22:19:53.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cf325700 1 Processor -- start 2023-09-30T22:19:53.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cf325700 1 -- start start 2023-09-30T22:19:53.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cf325700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c805f560 0x7fb7c812ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cf325700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7c812b790 0x7fb7c80964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cf325700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c8066f90 con 0x7fb7c812b370 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cf325700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c805f940 con 0x7fb7c812b790 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cf325700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8067650 con 0x7fb7c805f560 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cd0c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c805f560 0x7fb7c812ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cd8c2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7c812b790 0x7fb7c80964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cd8c2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7c812b790 0x7fb7c80964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38768/0 (socket says 172.21.15.154:38768) 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cd0c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c805f560 0x7fb7c812ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:50036/0 (socket says 172.21.15.154:50036) 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7cd8c2700 1 -- 172.21.15.154:0/2796146183 learned_addr learned my addr 172.21.15.154:0/2796146183 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.585+0000 7fb7cc8c0700 1 --1- 172.21.15.154:0/2796146183 >> v1:172.21.15.154:6789/0 conn(0x7fb7c812b370 0x7fb7c8095d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51196/0 (socket says 172.21.15.154:51196) 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7cd8c2700 1 -- 172.21.15.154:0/2796146183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c805f560 msgr2=0x7fb7c812ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7cd8c2700 1 --2- 172.21.15.154:0/2796146183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c805f560 0x7fb7c812ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7cd8c2700 1 -- 172.21.15.154:0/2796146183 >> v1:172.21.15.154:6789/0 conn(0x7fb7c812b370 legacy=0x7fb7c8095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7cd8c2700 1 -- 172.21.15.154:0/2796146183 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c8067910 con 0x7fb7c812b790 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7cd0c1700 1 --2- 172.21.15.154:0/2796146183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c805f560 0x7fb7c812ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7bffff700 1 -- 172.21.15.154:0/2796146183 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183116196 0 0) 0x7fb7c8066f90 con 0x7fb7c812b370 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7cd8c2700 1 --2- 172.21.15.154:0/2796146183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b790 0x7fb7c80964a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb7c0009f20 tx=0x7fb7c0009840).ready entity=mon.0 client_cookie=e613abe992abec22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7bffff700 1 -- 172.21.15.154:0/2796146183 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000e070 con 0x7fb7c812b790 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7bffff700 1 -- 172.21.15.154:0/2796146183 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c000b9d0 con 0x7fb7c812b790 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.586+0000 7fb7bffff700 1 -- 172.21.15.154:0/2796146183 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000bd50 con 0x7fb7c812b790 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 -- 172.21.15.154:0/2796146183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b790 msgr2=0x7fb7c80964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 --2- 172.21.15.154:0/2796146183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b790 0x7fb7c80964a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb7c0009f20 tx=0x7fb7c0009840).stop 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 -- 172.21.15.154:0/2796146183 shutdown_connections 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 --2- 172.21.15.154:0/2796146183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b790 0x7fb7c80964a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 --2- 172.21.15.154:0/2796146183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c805f560 0x7fb7c812ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 -- 172.21.15.154:0/2796146183 >> 172.21.15.154:0/2796146183 conn(0x7fb7c809a1c0 msgr2=0x7fb7c809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:53.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 -- 172.21.15.154:0/2796146183 shutdown_connections 2023-09-30T22:19:53.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 -- 172.21.15.154:0/2796146183 wait complete. 2023-09-30T22:19:53.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 Processor -- start 2023-09-30T22:19:53.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.587+0000 7fb7cf325700 1 -- start start 2023-09-30T22:19:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cf325700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c805f560 0x7fb7c813a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cf325700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b370 0x7fb7c813a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cf325700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c812b790 0x7fb7c8113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cf325700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8117350 con 0x7fb7c812b370 2023-09-30T22:19:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cf325700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8117530 con 0x7fb7c812b790 2023-09-30T22:19:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cf325700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c812f100 con 0x7fb7c805f560 2023-09-30T22:19:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cc8c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b370 0x7fb7c813a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cd0c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c805f560 0x7fb7c813a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cd8c2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c812b790 0x7fb7c8113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cd0c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c805f560 0x7fb7c813a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34712/0 (socket says 172.21.15.154:34712) 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cc8c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b370 0x7fb7c813a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38772/0 (socket says 172.21.15.154:38772) 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cd0c1700 1 -- 172.21.15.154:0/2847527251 learned_addr learned my addr 172.21.15.154:0/2847527251 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cd8c2700 1 -- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c805f560 msgr2=0x7fb7c813a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cd8c2700 1 --2- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c805f560 0x7fb7c813a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cd8c2700 1 -- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b370 msgr2=0x7fb7c813a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.588+0000 7fb7cd8c2700 1 --2- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b370 0x7fb7c813a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.589+0000 7fb7cd8c2700 1 -- 172.21.15.154:0/2847527251 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40092a0 con 0x7fb7c812b790 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.589+0000 7fb7cc8c0700 1 --2- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b370 0x7fb7c813a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.589+0000 7fb7cd8c2700 1 --2- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c812b790 0x7fb7c8113a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb7c0013000 tx=0x7fb7c0009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.589+0000 7fb7bd7fa700 1 -- 172.21.15.154:0/2847527251 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c00092e0 con 0x7fb7c812b790 2023-09-30T22:19:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.589+0000 7fb7bd7fa700 1 -- 172.21.15.154:0/2847527251 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c0007610 con 0x7fb7c812b790 2023-09-30T22:19:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.589+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c0009ae0 con 0x7fb7c812b790 2023-09-30T22:19:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.589+0000 7fb7bd7fa700 1 -- 172.21.15.154:0/2847527251 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c00079d0 con 0x7fb7c812b790 2023-09-30T22:19:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.589+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c81156a0 con 0x7fb7c812b790 2023-09-30T22:19:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.590+0000 7fb7bd7fa700 1 -- 172.21.15.154:0/2847527251 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb7c0003040 con 0x7fb7c812b790 2023-09-30T22:19:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.590+0000 7fb7bd7fa700 1 -- 172.21.15.154:0/2847527251 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb7c003cb80 con 0x7fb7c812b790 2023-09-30T22:19:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.590+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c81171b0 con 0x7fb7c812b790 2023-09-30T22:19:53.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.594+0000 7fb7bd7fa700 1 -- 172.21.15.154:0/2847527251 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb7c81171b0 con 0x7fb7c812b790 2023-09-30T22:19:53.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.755+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb7c81171b0 con 0x7fb7c812b790 2023-09-30T22:19:53.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.755+0000 7fb7bd7fa700 1 -- 172.21.15.154:0/2847527251 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb7c81171b0 con 0x7fb7c812b790 2023-09-30T22:19:53.755 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-09-30T22:19:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 >> v1:172.21.15.154:6816/118163 conn(0x7fb7ac02bb60 legacy=0x7fb7ac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c812b790 msgr2=0x7fb7c8113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 --2- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c812b790 0x7fb7c8113a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fb7c0013000 tx=0x7fb7c0009840).stop 2023-09-30T22:19:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 shutdown_connections 2023-09-30T22:19:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 --2- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c812b790 0x7fb7c8113a90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 --2- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c805f560 0x7fb7c813a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 --2- 172.21.15.154:0/2847527251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c812b370 0x7fb7c813a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 >> 172.21.15.154:0/2847527251 conn(0x7fb7c809a1c0 msgr2=0x7fb7c812bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 shutdown_connections 2023-09-30T22:19:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.757+0000 7fb7cf325700 1 -- 172.21.15.154:0/2847527251 wait complete. 2023-09-30T22:19:53.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:19:53.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91c6535700 1 Processor -- start 2023-09-30T22:19:53.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91c6535700 1 -- start start 2023-09-30T22:19:53.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91c6535700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0128cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91c6535700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0130130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91c6535700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c0093340 con 0x7f91c0092190 2023-09-30T22:19:53.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91c6535700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c005f940 con 0x7f91c005f560 2023-09-30T22:19:53.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91c6535700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0097c30 con 0x7f91c012dd40 2023-09-30T22:19:53.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91bffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0128cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91bf7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f91c0092190 0x7f91c01291a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51212/0 (socket says 172.21.15.154:51212) 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91bf7fe700 1 -- 172.21.15.154:0/1384051764 learned_addr learned my addr 172.21.15.154:0/1384051764 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91c4ad2700 1 --2- 172.21.15.154:0/1384051764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.889+0000 7f91beffd700 1 -- 172.21.15.154:0/1384051764 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376056077 0 0) 0x7f91c0093340 con 0x7f91c0092190 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91beffd700 1 -- 172.21.15.154:0/1384051764 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91ac0033f0 con 0x7f91c0092190 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c4ad2700 1 -- 172.21.15.154:0/1384051764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 msgr2=0x7f91c0128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c4ad2700 1 --2- 172.21.15.154:0/1384051764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0128cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c4ad2700 1 -- 172.21.15.154:0/1384051764 >> v1:172.21.15.154:6789/0 conn(0x7f91c0092190 legacy=0x7f91c01291a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c4ad2700 1 -- 172.21.15.154:0/1384051764 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00941f0 con 0x7f91c012dd40 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91bffff700 1 --2- 172.21.15.154:0/1384051764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0128cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c4ad2700 1 --2- 172.21.15.154:0/1384051764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0130130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f91b8009e90 tx=0x7f91b8009780).ready entity=mon.2 client_cookie=381682db3b78e2c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91beffd700 1 -- 172.21.15.154:0/1384051764 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800e070 con 0x7f91c012dd40 2023-09-30T22:19:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91beffd700 1 -- 172.21.15.154:0/1384051764 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b800bab0 con 0x7f91c012dd40 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91beffd700 1 -- 172.21.15.154:0/1384051764 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800be30 con 0x7f91c012dd40 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c6535700 1 -- 172.21.15.154:0/1384051764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 msgr2=0x7f91c0130130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c6535700 1 --2- 172.21.15.154:0/1384051764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0130130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f91b8009e90 tx=0x7f91b8009780).stop 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c6535700 1 -- 172.21.15.154:0/1384051764 shutdown_connections 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c6535700 1 --2- 172.21.15.154:0/1384051764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0130130 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c6535700 1 --2- 172.21.15.154:0/1384051764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0128cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c6535700 1 -- 172.21.15.154:0/1384051764 >> 172.21.15.154:0/1384051764 conn(0x7f91c009a1c0 msgr2=0x7f91c009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c6535700 1 -- 172.21.15.154:0/1384051764 shutdown_connections 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.890+0000 7f91c6535700 1 -- 172.21.15.154:0/1384051764 wait complete. 2023-09-30T22:19:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.891+0000 7f91c6535700 1 Processor -- start 2023-09-30T22:19:53.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.891+0000 7f91c6535700 1 -- start start 2023-09-30T22:19:53.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c6535700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0116360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c6535700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0092190 0x7f91c0067e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c6535700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0068380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:53.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c6535700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0069da0 con 0x7f91c0092190 2023-09-30T22:19:53.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c6535700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0097d80 con 0x7f91c005f560 2023-09-30T22:19:53.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c6535700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0069320 con 0x7f91c012dd40 2023-09-30T22:19:53.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91bffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0116360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c4ad2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0068380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c4ad2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0068380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34732/0 (socket says 172.21.15.154:34732) 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c4ad2700 1 -- 172.21.15.154:0/3779926729 learned_addr learned my addr 172.21.15.154:0/3779926729 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91bffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0116360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:50060/0 (socket says 172.21.15.154:50060) 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91bf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0092190 0x7f91c0067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91bffff700 1 -- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 msgr2=0x7f91c0068380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91bffff700 1 --2- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0068380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91bffff700 1 -- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0092190 msgr2=0x7f91c0067e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91bffff700 1 --2- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0092190 0x7f91c0067e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91bffff700 1 -- 172.21.15.154:0/3779926729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b00092a0 con 0x7f91c005f560 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91c4ad2700 1 --2- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0068380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91bffff700 1 --2- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0116360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f91b000e880 tx=0x7f91b0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91b7fff700 1 -- 172.21.15.154:0/3779926729 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b00094e0 con 0x7f91c005f560 2023-09-30T22:19:53.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.892+0000 7f91b7fff700 1 -- 172.21.15.154:0/3779926729 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b0012600 con 0x7f91c005f560 2023-09-30T22:19:53.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.893+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b8009a20 con 0x7f91c005f560 2023-09-30T22:19:53.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.893+0000 7f91b7fff700 1 -- 172.21.15.154:0/3779926729 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0012980 con 0x7f91c005f560 2023-09-30T22:19:53.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.893+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c0115e60 con 0x7f91c005f560 2023-09-30T22:19:53.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.893+0000 7f91b7fff700 1 -- 172.21.15.154:0/3779926729 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f91b0012d30 con 0x7f91c005f560 2023-09-30T22:19:53.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.893+0000 7f91b7fff700 1 -- 172.21.15.154:0/3779926729 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f91b003b370 con 0x7f91c005f560 2023-09-30T22:19:53.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.894+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c005a260 con 0x7f91c005f560 2023-09-30T22:19:53.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:53.898+0000 7f91b7fff700 1 -- 172.21.15.154:0/3779926729 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f91b0011b40 con 0x7f91c005f560 2023-09-30T22:19:54.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.057+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91c0068c90 con 0x7f91c005f560 2023-09-30T22:19:54.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.057+0000 7f91b7fff700 1 -- 172.21.15.154:0/3779926729 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f91b002a0a0 con 0x7f91c005f560 2023-09-30T22:19:54.057 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 8 2023-09-30T22:19:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 >> v1:172.21.15.154:6816/118163 conn(0x7f91a002bb60 legacy=0x7f91a002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 msgr2=0x7f91c0116360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 --2- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0116360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f91b000e880 tx=0x7f91b0009060).stop 2023-09-30T22:19:54.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 shutdown_connections 2023-09-30T22:19:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 --2- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91c012dd40 0x7f91c0068380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 --2- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c005f560 0x7f91c0116360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 --2- 172.21.15.154:0/3779926729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c0092190 0x7f91c0067e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 >> 172.21.15.154:0/3779926729 conn(0x7f91c009a1c0 msgr2=0x7f91c012fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 shutdown_connections 2023-09-30T22:19:54.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.059+0000 7f91c6535700 1 -- 172.21.15.154:0/3779926729 wait complete. 2023-09-30T22:19:54.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:19:54.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3526feb700 1 Processor -- start 2023-09-30T22:19:54.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3526feb700 1 -- start start 2023-09-30T22:19:54.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3526feb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520062b00 0x7f35201254f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3526feb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35201259e0 0x7f3520093b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3526feb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3520125e00 0x7f3520094080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3526feb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3520062ee0 con 0x7f35201259e0 2023-09-30T22:19:54.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3526feb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3520099af0 con 0x7f3520062b00 2023-09-30T22:19:54.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3526feb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3520063600 con 0x7f3520125e00 2023-09-30T22:19:54.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f351ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35201259e0 0x7f3520093b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3525588700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3520125e00 0x7f3520094080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f351ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35201259e0 0x7f3520093b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38788/0 (socket says 172.21.15.154:38788) 2023-09-30T22:19:54.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f351ffff700 1 -- 172.21.15.154:0/2738880369 learned_addr learned my addr 172.21.15.154:0/2738880369 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:54.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3525588700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3520125e00 0x7f3520094080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34740/0 (socket says 172.21.15.154:34740) 2023-09-30T22:19:54.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.190+0000 7f3524d87700 1 --2- 172.21.15.154:0/2738880369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520062b00 0x7f35201254f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3525588700 1 -- 172.21.15.154:0/2738880369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520062b00 msgr2=0x7f35201254f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3525588700 1 --2- 172.21.15.154:0/2738880369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520062b00 0x7f35201254f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3525588700 1 -- 172.21.15.154:0/2738880369 >> v2:172.21.15.154:3300/0 conn(0x7f35201259e0 msgr2=0x7f3520093b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3525588700 1 --2- 172.21.15.154:0/2738880369 >> v2:172.21.15.154:3300/0 conn(0x7f35201259e0 0x7f3520093b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3525588700 1 -- 172.21.15.154:0/2738880369 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35200992b0 con 0x7f3520125e00 2023-09-30T22:19:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f351ffff700 1 --2- 172.21.15.154:0/2738880369 >> v2:172.21.15.154:3300/0 conn(0x7f35201259e0 0x7f3520093b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3524d87700 1 --2- 172.21.15.154:0/2738880369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520062b00 0x7f35201254f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3525588700 1 --2- 172.21.15.154:0/2738880369 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3520125e00 0x7f3520094080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3518009e60 tx=0x7f3518009780).ready entity=mon.2 client_cookie=37d2b11f738b0e2a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f351f7fe700 1 -- 172.21.15.154:0/2738880369 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800e070 con 0x7f3520125e00 2023-09-30T22:19:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f351f7fe700 1 -- 172.21.15.154:0/2738880369 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351800bab0 con 0x7f3520125e00 2023-09-30T22:19:54.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f351f7fe700 1 -- 172.21.15.154:0/2738880369 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800be30 con 0x7f3520125e00 2023-09-30T22:19:54.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3526feb700 1 -- 172.21.15.154:0/2738880369 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3520125e00 msgr2=0x7f3520094080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3526feb700 1 --2- 172.21.15.154:0/2738880369 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3520125e00 0x7f3520094080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3518009e60 tx=0x7f3518009780).stop 2023-09-30T22:19:54.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3526feb700 1 -- 172.21.15.154:0/2738880369 shutdown_connections 2023-09-30T22:19:54.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.191+0000 7f3526feb700 1 --2- 172.21.15.154:0/2738880369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520062b00 0x7f35201254f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.192+0000 7f3526feb700 1 --2- 172.21.15.154:0/2738880369 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3520125e00 0x7f3520094080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.192+0000 7f3526feb700 1 --2- 172.21.15.154:0/2738880369 >> v2:172.21.15.154:3300/0 conn(0x7f35201259e0 0x7f3520093b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.192+0000 7f3526feb700 1 -- 172.21.15.154:0/2738880369 >> 172.21.15.154:0/2738880369 conn(0x7f35200973a0 msgr2=0x7f35200977b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.192+0000 7f3526feb700 1 -- 172.21.15.154:0/2738880369 shutdown_connections 2023-09-30T22:19:54.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.192+0000 7f3526feb700 1 -- 172.21.15.154:0/2738880369 wait complete. 2023-09-30T22:19:54.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.192+0000 7f3526feb700 1 Processor -- start 2023-09-30T22:19:54.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3526feb700 1 -- start start 2023-09-30T22:19:54.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3526feb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3526feb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35201259e0 0x7f3520138360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3526feb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520125e00 0x7f3520067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3526feb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352012cc30 con 0x7f3520062b00 2023-09-30T22:19:54.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3526feb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3520069f00 con 0x7f3520125e00 2023-09-30T22:19:54.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3526feb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3520098d00 con 0x7f35201259e0 2023-09-30T22:19:54.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f351ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35201259e0 0x7f3520138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3524d87700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3525588700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520125e00 0x7f3520067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f351ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35201259e0 0x7f3520138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34752/0 (socket says 172.21.15.154:34752) 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f351ffff700 1 -- 172.21.15.154:0/721149316 learned_addr learned my addr 172.21.15.154:0/721149316 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3524d87700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520137e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38798/0 (socket says 172.21.15.154:38798) 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3525588700 1 -- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35201259e0 msgr2=0x7f3520138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3525588700 1 --2- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35201259e0 0x7f3520138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3525588700 1 -- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 msgr2=0x7f3520137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3525588700 1 --2- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3525588700 1 -- 172.21.15.154:0/721149316 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35140092a0 con 0x7f3520125e00 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f351ffff700 1 --2- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35201259e0 0x7f3520138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3524d87700 1 --2- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.193+0000 7f3525588700 1 --2- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520125e00 0x7f3520067920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3518009e60 tx=0x7f3520063470).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.194+0000 7f351cff9700 1 -- 172.21.15.154:0/721149316 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518013ea0 con 0x7f3520125e00 2023-09-30T22:19:54.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.194+0000 7f351cff9700 1 -- 172.21.15.154:0/721149316 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351801d630 con 0x7f3520125e00 2023-09-30T22:19:54.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.194+0000 7f351cff9700 1 -- 172.21.15.154:0/721149316 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351801d9f0 con 0x7f3520125e00 2023-09-30T22:19:54.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.194+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c009370 con 0x7f3520125e00 2023-09-30T22:19:54.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.194+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3518009a20 con 0x7f3520125e00 2023-09-30T22:19:54.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.194+0000 7f351cff9700 1 -- 172.21.15.154:0/721149316 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3518003040 con 0x7f3520125e00 2023-09-30T22:19:54.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.194+0000 7f351cff9700 1 -- 172.21.15.154:0/721149316 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f351803cba0 con 0x7f3520125e00 2023-09-30T22:19:54.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.195+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3520122f50 con 0x7f3520125e00 2023-09-30T22:19:54.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.199+0000 7f351cff9700 1 -- 172.21.15.154:0/721149316 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3518025da0 con 0x7f3520125e00 2023-09-30T22:19:54.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.358+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f352005a260 con 0x7f3520125e00 2023-09-30T22:19:54.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.358+0000 7f351cff9700 1 -- 172.21.15.154:0/721149316 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3518025360 con 0x7f3520125e00 2023-09-30T22:19:54.358 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-09-30T22:19:54.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 >> v1:172.21.15.154:6816/118163 conn(0x7f350402bb90 legacy=0x7f350402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520125e00 msgr2=0x7f3520067920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 --2- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520125e00 0x7f3520067920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3518009e60 tx=0x7f3520063470).stop 2023-09-30T22:19:54.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 shutdown_connections 2023-09-30T22:19:54.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 --2- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3520125e00 0x7f3520067920 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 --2- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520062b00 0x7f3520137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 --2- 172.21.15.154:0/721149316 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35201259e0 0x7f3520138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 >> 172.21.15.154:0/721149316 conn(0x7f35200973a0 msgr2=0x7f3520123150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 shutdown_connections 2023-09-30T22:19:54.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.360+0000 7f3526feb700 1 -- 172.21.15.154:0/721149316 wait complete. 2023-09-30T22:19:54.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:19:54.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.491+0000 7fa7cb40c700 1 Processor -- start 2023-09-30T22:19:54.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.491+0000 7fa7cb40c700 1 -- start start 2023-09-30T22:19:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7cb40c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c4093950 0x7fa7c4095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7cb40c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4095c50 0x7fa7c4096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7cb40c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c4094ba0 con 0x7fa7c412c240 2023-09-30T22:19:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7cb40c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c4092e90 con 0x7fa7c4095c50 2023-09-30T22:19:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7cb40c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c4096b60 con 0x7fa7c4093950 2023-09-30T22:19:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c91a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c4093950 0x7fa7c4095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c89a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4095c50 0x7fa7c4096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c89a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4095c50 0x7fa7c4096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:50086/0 (socket says 172.21.15.154:50086) 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c91a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c4093950 0x7fa7c4095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34766/0 (socket says 172.21.15.154:34766) 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c89a7700 1 -- 172.21.15.154:0/2570343171 learned_addr learned my addr 172.21.15.154:0/2570343171 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c99a9700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa7c412c240 0x7fa7c412e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51228/0 (socket says 172.21.15.154:51228) 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c89a7700 1 -- 172.21.15.154:0/2570343171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c4093950 msgr2=0x7fa7c4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7bbfff700 1 -- 172.21.15.154:0/2570343171 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520498164 0 0) 0x7fa7c4094ba0 con 0x7fa7c412c240 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c89a7700 1 --2- 172.21.15.154:0/2570343171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c4093950 0x7fa7c4095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c89a7700 1 -- 172.21.15.154:0/2570343171 >> v1:172.21.15.154:6789/0 conn(0x7fa7c412c240 legacy=0x7fa7c412e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c89a7700 1 -- 172.21.15.154:0/2570343171 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c4093150 con 0x7fa7c4095c50 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c91a8700 1 --2- 172.21.15.154:0/2570343171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c4093950 0x7fa7c4095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.492+0000 7fa7c89a7700 1 --2- 172.21.15.154:0/2570343171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4095c50 0x7fa7c4096030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa7c0009830 tx=0x7fa7c00090f0).ready entity=mon.1 client_cookie=4dcb332df7eeabb1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7bbfff700 1 -- 172.21.15.154:0/2570343171 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000b580 con 0x7fa7c4095c50 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7bbfff700 1 -- 172.21.15.154:0/2570343171 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c000b6e0 con 0x7fa7c4095c50 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7bbfff700 1 -- 172.21.15.154:0/2570343171 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000ba80 con 0x7fa7c4095c50 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7cb40c700 1 -- 172.21.15.154:0/2570343171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4095c50 msgr2=0x7fa7c4096030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7cb40c700 1 --2- 172.21.15.154:0/2570343171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4095c50 0x7fa7c4096030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa7c0009830 tx=0x7fa7c00090f0).stop 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7cb40c700 1 -- 172.21.15.154:0/2570343171 shutdown_connections 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7cb40c700 1 --2- 172.21.15.154:0/2570343171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c4093950 0x7fa7c4095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7cb40c700 1 --2- 172.21.15.154:0/2570343171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4095c50 0x7fa7c4096030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7cb40c700 1 -- 172.21.15.154:0/2570343171 >> 172.21.15.154:0/2570343171 conn(0x7fa7c409aa50 msgr2=0x7fa7c409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7cb40c700 1 -- 172.21.15.154:0/2570343171 shutdown_connections 2023-09-30T22:19:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.493+0000 7fa7cb40c700 1 -- 172.21.15.154:0/2570343171 wait complete. 2023-09-30T22:19:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.494+0000 7fa7cb40c700 1 Processor -- start 2023-09-30T22:19:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.494+0000 7fa7cb40c700 1 -- start start 2023-09-30T22:19:54.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7cb40c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4093950 0x7fa7c412a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7cb40c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4095c50 0x7fa7c4126fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7cb40c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c412c240 0x7fa7c41274c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7cb40c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c4129da0 con 0x7fa7c4095c50 2023-09-30T22:19:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7cb40c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c4129ae0 con 0x7fa7c4093950 2023-09-30T22:19:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7cb40c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c4128210 con 0x7fa7c412c240 2023-09-30T22:19:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c89a7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4095c50 0x7fa7c4126fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c99a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c412c240 0x7fa7c41274c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c91a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4093950 0x7fa7c412a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c89a7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4095c50 0x7fa7c4126fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38804/0 (socket says 172.21.15.154:38804) 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c89a7700 1 -- 172.21.15.154:0/781786580 learned_addr learned my addr 172.21.15.154:0/781786580 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c99a9700 1 --2- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c412c240 0x7fa7c41274c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34782/0 (socket says 172.21.15.154:34782) 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c89a7700 1 -- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c412c240 msgr2=0x7fa7c41274c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c89a7700 1 --2- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c412c240 0x7fa7c41274c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c89a7700 1 -- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4093950 msgr2=0x7fa7c412a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c89a7700 1 --2- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4093950 0x7fa7c412a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c89a7700 1 -- 172.21.15.154:0/781786580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40092a0 con 0x7fa7c4095c50 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c91a8700 1 --2- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4093950 0x7fa7c412a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7c89a7700 1 --2- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4095c50 0x7fa7c4126fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa7c0011000 tx=0x7fa7c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7b97fa700 1 -- 172.21.15.154:0/781786580 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0006d90 con 0x7fa7c4095c50 2023-09-30T22:19:54.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7b97fa700 1 -- 172.21.15.154:0/781786580 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c0006950 con 0x7fa7c4095c50 2023-09-30T22:19:54.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c0009370 con 0x7fa7c4095c50 2023-09-30T22:19:54.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7b97fa700 1 -- 172.21.15.154:0/781786580 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000ba80 con 0x7fa7c4095c50 2023-09-30T22:19:54.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.495+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c41279b0 con 0x7fa7c4095c50 2023-09-30T22:19:54.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.496+0000 7fa7b97fa700 1 -- 172.21.15.154:0/781786580 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa7c001c630 con 0x7fa7c4095c50 2023-09-30T22:19:54.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.496+0000 7fa7b97fa700 1 -- 172.21.15.154:0/781786580 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa7c003ca80 con 0x7fa7c4095c50 2023-09-30T22:19:54.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.496+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c4129f50 con 0x7fa7c4095c50 2023-09-30T22:19:54.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.501+0000 7fa7b97fa700 1 -- 172.21.15.154:0/781786580 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa7c4129f50 con 0x7fa7c4095c50 2023-09-30T22:19:54.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.657+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7c4129f50 con 0x7fa7c4095c50 2023-09-30T22:19:54.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.658+0000 7fa7b97fa700 1 -- 172.21.15.154:0/781786580 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa7c4129f50 con 0x7fa7c4095c50 2023-09-30T22:19:54.658 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-09-30T22:19:54.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.659+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 >> v1:172.21.15.154:6816/118163 conn(0x7fa7a802bb60 legacy=0x7fa7a802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.659+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4095c50 msgr2=0x7fa7c4126fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.659+0000 7fa7cb40c700 1 --2- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4095c50 0x7fa7c4126fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa7c0011000 tx=0x7fa7c0017000).stop 2023-09-30T22:19:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.660+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 shutdown_connections 2023-09-30T22:19:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.660+0000 7fa7cb40c700 1 --2- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c412c240 0x7fa7c41274c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.660+0000 7fa7cb40c700 1 --2- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c4093950 0x7fa7c412a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.660+0000 7fa7cb40c700 1 --2- 172.21.15.154:0/781786580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4095c50 0x7fa7c4126fd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.660+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 >> 172.21.15.154:0/781786580 conn(0x7fa7c409aa50 msgr2=0x7fa7c4062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.660+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 shutdown_connections 2023-09-30T22:19:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.660+0000 7fa7cb40c700 1 -- 172.21.15.154:0/781786580 wait complete. 2023-09-30T22:19:54.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:19:54.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.787+0000 7f34f57a3700 1 Processor -- start 2023-09-30T22:19:54.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.787+0000 7f34f57a3700 1 -- start start 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34f57a3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34f012afd0 0x7f34f012b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34f57a3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f00924b0 0x7f34f0132ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34f57a3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f0066e30 con 0x7f34f0091980 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34f57a3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f012ab10 con 0x7f34f012afd0 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34f57a3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0067500 con 0x7f34f00924b0 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34eeffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34f012afd0 0x7f34f012b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34ee7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f34f0091980 0x7f34f0091da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51234/0 (socket says 172.21.15.154:51234) 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34ee7fc700 1 -- 172.21.15.154:0/258239072 learned_addr learned my addr 172.21.15.154:0/258239072 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34eeffd700 1 -- 172.21.15.154:0/258239072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f00924b0 msgr2=0x7f34f0132ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34eeffd700 1 --2- 172.21.15.154:0/258239072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f00924b0 0x7f34f0132ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34eeffd700 1 -- 172.21.15.154:0/258239072 >> v1:172.21.15.154:6789/0 conn(0x7f34f0091980 legacy=0x7f34f0091da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.788+0000 7f34eeffd700 1 -- 172.21.15.154:0/258239072 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f012adb0 con 0x7f34f012afd0 2023-09-30T22:19:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.789+0000 7f34eeffd700 1 --2- 172.21.15.154:0/258239072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f012afd0 0x7f34f012b3b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f34e0009760 tx=0x7f34e0009060).ready entity=mon.0 client_cookie=62b5cb650fa327b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.789+0000 7f34edffb700 1 -- 172.21.15.154:0/258239072 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000b580 con 0x7f34f012afd0 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.790+0000 7f34edffb700 1 -- 172.21.15.154:0/258239072 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e000b6e0 con 0x7f34f012afd0 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.790+0000 7f34edffb700 1 -- 172.21.15.154:0/258239072 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000ba60 con 0x7f34f012afd0 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.791+0000 7f34f57a3700 1 -- 172.21.15.154:0/258239072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f012afd0 msgr2=0x7f34f012b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.791+0000 7f34f57a3700 1 --2- 172.21.15.154:0/258239072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f012afd0 0x7f34f012b3b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f34e0009760 tx=0x7f34e0009060).stop 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.791+0000 7f34f57a3700 1 -- 172.21.15.154:0/258239072 shutdown_connections 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.791+0000 7f34f57a3700 1 --2- 172.21.15.154:0/258239072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f00924b0 0x7f34f0132ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.791+0000 7f34f57a3700 1 --2- 172.21.15.154:0/258239072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f012afd0 0x7f34f012b3b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.791+0000 7f34f57a3700 1 -- 172.21.15.154:0/258239072 >> 172.21.15.154:0/258239072 conn(0x7f34f009a230 msgr2=0x7f34f009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.791+0000 7f34f57a3700 1 -- 172.21.15.154:0/258239072 shutdown_connections 2023-09-30T22:19:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.791+0000 7f34f57a3700 1 -- 172.21.15.154:0/258239072 wait complete. 2023-09-30T22:19:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34f57a3700 1 Processor -- start 2023-09-30T22:19:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34f57a3700 1 -- start start 2023-09-30T22:19:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34f57a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f0091980 0x7f34f0128760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34f57a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f00924b0 0x7f34f01176a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34f57a3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f012afd0 0x7f34f0117b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34f57a3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0119b90 con 0x7f34f00924b0 2023-09-30T22:19:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34f57a3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f011b790 con 0x7f34f0091980 2023-09-30T22:19:54.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34f57a3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0067040 con 0x7f34f012afd0 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34ef7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f012afd0 0x7f34f0117b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f0091980 0x7f34f0128760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34ef7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f012afd0 0x7f34f0117b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34784/0 (socket says 172.21.15.154:34784) 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f0091980 0x7f34f0128760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:50112/0 (socket says 172.21.15.154:50112) 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34ef7fe700 1 -- 172.21.15.154:0/2953220422 learned_addr learned my addr 172.21.15.154:0/2953220422 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.792+0000 7f34ee7fc700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f00924b0 0x7f34f01176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34eeffd700 1 -- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f012afd0 msgr2=0x7f34f0117b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34eeffd700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f012afd0 0x7f34f0117b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34eeffd700 1 -- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f00924b0 msgr2=0x7f34f01176a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34eeffd700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f00924b0 0x7f34f01176a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34eeffd700 1 -- 172.21.15.154:0/2953220422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e00092a0 con 0x7f34f0091980 2023-09-30T22:19:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34ef7fe700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f012afd0 0x7f34f0117b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34ee7fc700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f00924b0 0x7f34f01176a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34eeffd700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f0091980 0x7f34f0128760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f34e0014000 tx=0x7f34e0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34d6ffd700 1 -- 172.21.15.154:0/2953220422 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000b850 con 0x7f34f0091980 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34d6ffd700 1 -- 172.21.15.154:0/2953220422 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e000b9b0 con 0x7f34f0091980 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34d6ffd700 1 -- 172.21.15.154:0/2953220422 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e001b640 con 0x7f34f0091980 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f0098ba0 con 0x7f34f0091980 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f0118af0 con 0x7f34f0091980 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.793+0000 7f34d6ffd700 1 -- 172.21.15.154:0/2953220422 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f34e001b9b0 con 0x7f34f0091980 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.794+0000 7f34d6ffd700 1 -- 172.21.15.154:0/2953220422 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f34e003ca50 con 0x7f34f0091980 2023-09-30T22:19:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.794+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f005a260 con 0x7f34f0091980 2023-09-30T22:19:54.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.798+0000 7f34d6ffd700 1 -- 172.21.15.154:0/2953220422 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f34e0028070 con 0x7f34f0091980 2023-09-30T22:19:54.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.993+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34f0093650 con 0x7f34f0091980 2023-09-30T22:19:54.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.993+0000 7f34d6ffd700 1 -- 172.21.15.154:0/2953220422 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f34e0028030 con 0x7f34f0091980 2023-09-30T22:19:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:54.993 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:19:33.620776+0000","modified":"2023-09-30T22:19:35.628146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:19:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 >> v1:172.21.15.154:6816/118163 conn(0x7f34dc02bb60 legacy=0x7f34dc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f0091980 msgr2=0x7f34f0128760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f0091980 0x7f34f0128760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f34e0014000 tx=0x7f34e0017000).stop 2023-09-30T22:19:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 shutdown_connections 2023-09-30T22:19:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f012afd0 0x7f34f0117b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f0091980 0x7f34f0128760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 --2- 172.21.15.154:0/2953220422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f00924b0 0x7f34f01176a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:54.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 >> 172.21.15.154:0/2953220422 conn(0x7f34f009a230 msgr2=0x7f34f01291d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:54.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 shutdown_connections 2023-09-30T22:19:54.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:54.995+0000 7f34f57a3700 1 -- 172.21.15.154:0/2953220422 wait complete. 2023-09-30T22:19:54.996 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 5 2023-09-30T22:19:55.006 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:19:55.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.122+0000 7f2adf9c8700 1 Processor -- start 2023-09-30T22:19:55.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.122+0000 7f2adf9c8700 1 -- start start 2023-09-30T22:19:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.122+0000 7f2adf9c8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad8097790 0x7f2ad812b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.122+0000 7f2adf9c8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad812b540 0x7f2ad8127560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.122+0000 7f2adf9c8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ad8127a50 0x7f2ad8127f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.122+0000 7f2adf9c8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad812ae10 con 0x7f2ad8127a50 2023-09-30T22:19:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.122+0000 7f2adf9c8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad812b940 con 0x7f2ad8097790 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.122+0000 7f2adf9c8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad8064b30 con 0x7f2ad812b540 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2add764700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad8097790 0x7f2ad812b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2adcf63700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad812b540 0x7f2ad8127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2addf65700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ad8127a50 0x7f2ad8127f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2addf65700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ad8127a50 0x7f2ad8127f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38842/0 (socket says 172.21.15.154:38842) 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2add764700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad8097790 0x7f2ad812b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:50126/0 (socket says 172.21.15.154:50126) 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2addf65700 1 -- 172.21.15.154:0/2049379868 learned_addr learned my addr 172.21.15.154:0/2049379868 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2adcf63700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad812b540 0x7f2ad8127560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34800/0 (socket says 172.21.15.154:34800) 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2adcf63700 1 -- 172.21.15.154:0/2049379868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad8097790 msgr2=0x7f2ad812b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2adcf63700 1 --2- 172.21.15.154:0/2049379868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad8097790 0x7f2ad812b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2adcf63700 1 -- 172.21.15.154:0/2049379868 >> v2:172.21.15.154:3300/0 conn(0x7f2ad8127a50 msgr2=0x7f2ad8127f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2adcf63700 1 --2- 172.21.15.154:0/2049379868 >> v2:172.21.15.154:3300/0 conn(0x7f2ad8127a50 0x7f2ad8127f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2adcf63700 1 -- 172.21.15.154:0/2049379868 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad8065750 con 0x7f2ad812b540 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2add764700 1 --2- 172.21.15.154:0/2049379868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad8097790 0x7f2ad812b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2addf65700 1 --2- 172.21.15.154:0/2049379868 >> v2:172.21.15.154:3300/0 conn(0x7f2ad8127a50 0x7f2ad8127f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2adcf63700 1 --2- 172.21.15.154:0/2049379868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad812b540 0x7f2ad8127560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2ac8009760 tx=0x7f2ac8009060).ready entity=mon.2 client_cookie=cf671cc2b7893cf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2acffff700 1 -- 172.21.15.154:0/2049379868 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800d4a0 con 0x7f2ad812b540 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2acffff700 1 -- 172.21.15.154:0/2049379868 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac800d600 con 0x7f2ad812b540 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.123+0000 7f2acffff700 1 -- 172.21.15.154:0/2049379868 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800d980 con 0x7f2ad812b540 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.124+0000 7f2adf9c8700 1 -- 172.21.15.154:0/2049379868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad812b540 msgr2=0x7f2ad8127560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.124+0000 7f2adf9c8700 1 --2- 172.21.15.154:0/2049379868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad812b540 0x7f2ad8127560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2ac8009760 tx=0x7f2ac8009060).stop 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.124+0000 7f2adf9c8700 1 -- 172.21.15.154:0/2049379868 shutdown_connections 2023-09-30T22:19:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.124+0000 7f2adf9c8700 1 --2- 172.21.15.154:0/2049379868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad8097790 0x7f2ad812b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.124+0000 7f2adf9c8700 1 --2- 172.21.15.154:0/2049379868 >> v2:172.21.15.154:3300/0 conn(0x7f2ad8127a50 0x7f2ad8127f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.124+0000 7f2adf9c8700 1 --2- 172.21.15.154:0/2049379868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad812b540 0x7f2ad8127560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.124+0000 7f2adf9c8700 1 -- 172.21.15.154:0/2049379868 >> 172.21.15.154:0/2049379868 conn(0x7f2ad809bad0 msgr2=0x7f2ad809bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.124+0000 7f2adf9c8700 1 -- 172.21.15.154:0/2049379868 shutdown_connections 2023-09-30T22:19:55.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.124+0000 7f2adf9c8700 1 -- 172.21.15.154:0/2049379868 wait complete. 2023-09-30T22:19:55.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2adf9c8700 1 Processor -- start 2023-09-30T22:19:55.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2adf9c8700 1 -- start start 2023-09-30T22:19:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2adf9c8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8097790 0x7f2ad8124af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2adf9c8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad8127a50 0x7f2ad8113a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2adf9c8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad812b540 0x7f2ad8113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2adf9c8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad8065130 con 0x7f2ad8097790 2023-09-30T22:19:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2adf9c8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad81174c0 con 0x7f2ad812b540 2023-09-30T22:19:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2adf9c8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad809aa60 con 0x7f2ad8127a50 2023-09-30T22:19:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2add764700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8097790 0x7f2ad8124af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2adcf63700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad8127a50 0x7f2ad8113a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2add764700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8097790 0x7f2ad8124af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38856/0 (socket says 172.21.15.154:38856) 2023-09-30T22:19:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2add764700 1 -- 172.21.15.154:0/367042357 learned_addr learned my addr 172.21.15.154:0/367042357 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.125+0000 7f2addf65700 1 --2- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad812b540 0x7f2ad8113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2adcf63700 1 -- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad812b540 msgr2=0x7f2ad8113f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2adcf63700 1 --2- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad812b540 0x7f2ad8113f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2adcf63700 1 -- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8097790 msgr2=0x7f2ad8124af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2adcf63700 1 --2- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8097790 0x7f2ad8124af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2adcf63700 1 -- 172.21.15.154:0/367042357 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40092a0 con 0x7f2ad8127a50 2023-09-30T22:19:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2add764700 1 --2- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8097790 0x7f2ad8124af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2adcf63700 1 --2- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad8127a50 0x7f2ad8113a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2ac8013000 tx=0x7f2ac8016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2acd7fa700 1 -- 172.21.15.154:0/367042357 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8009d80 con 0x7f2ad8127a50 2023-09-30T22:19:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2acd7fa700 1 -- 172.21.15.154:0/367042357 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac800dd30 con 0x7f2ad8127a50 2023-09-30T22:19:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad0009ae0 con 0x7f2ad8127a50 2023-09-30T22:19:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2acd7fa700 1 -- 172.21.15.154:0/367042357 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800d980 con 0x7f2ad8127a50 2023-09-30T22:19:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.126+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac80092a0 con 0x7f2ad8127a50 2023-09-30T22:19:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.127+0000 7f2acd7fa700 1 -- 172.21.15.154:0/367042357 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2ac801d640 con 0x7f2ad8127a50 2023-09-30T22:19:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.127+0000 7f2acd7fa700 1 -- 172.21.15.154:0/367042357 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2ac803c6c0 con 0x7f2ad8127a50 2023-09-30T22:19:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.127+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad812b100 con 0x7f2ad8127a50 2023-09-30T22:19:55.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.131+0000 7f2acd7fa700 1 -- 172.21.15.154:0/367042357 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2ac801d8f0 con 0x7f2ad8127a50 2023-09-30T22:19:55.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.291+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ad805a260 con 0x7f2ad8127a50 2023-09-30T22:19:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.291+0000 7f2acd7fa700 1 -- 172.21.15.154:0/367042357 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11372 (secure 0 0 0) 0x7f2ac8018350 con 0x7f2ad8127a50 2023-09-30T22:19:55.291 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:55.291 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":17,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:19:50.770596+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:19:55.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 >> v1:172.21.15.154:6816/118163 conn(0x7f2abc02bb60 legacy=0x7f2abc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad8127a50 msgr2=0x7f2ad8113a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 --2- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad8127a50 0x7f2ad8113a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2ac8013000 tx=0x7f2ac8016000).stop 2023-09-30T22:19:55.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 shutdown_connections 2023-09-30T22:19:55.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 --2- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad812b540 0x7f2ad8113f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 --2- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad8097790 0x7f2ad8124af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 --2- 172.21.15.154:0/367042357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad8127a50 0x7f2ad8113a20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 >> 172.21.15.154:0/367042357 conn(0x7f2ad809bad0 msgr2=0x7f2ad8129f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 shutdown_connections 2023-09-30T22:19:55.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.293+0000 7f2adf9c8700 1 -- 172.21.15.154:0/367042357 wait complete. 2023-09-30T22:19:55.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T22:19:55.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.424+0000 7f31bfd52700 1 Processor -- start 2023-09-30T22:19:55.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bfd52700 1 -- start start 2023-09-30T22:19:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bfd52700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b8095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bfd52700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b8095c50 0x7f31b8096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bfd52700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b8094ba0 con 0x7f31b812c240 2023-09-30T22:19:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bfd52700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8092e90 con 0x7f31b8095c50 2023-09-30T22:19:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bfd52700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8096b60 con 0x7f31b8093950 2023-09-30T22:19:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bdaee700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b8095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bd2ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b8095c50 0x7f31b8096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31be2ef700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f31b812c240 0x7f31b812e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42964/0 (socket says 172.21.15.154:42964) 2023-09-30T22:19:55.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31be2ef700 1 -- 172.21.15.154:0/1759763368 learned_addr learned my addr 172.21.15.154:0/1759763368 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bdaee700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b8095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36130/0 (socket says 172.21.15.154:36130) 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.425+0000 7f31bcaec700 1 -- 172.21.15.154:0/1759763368 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077950966 0 0) 0x7f31b8094ba0 con 0x7f31b812c240 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bd2ed700 1 -- 172.21.15.154:0/1759763368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 msgr2=0x7f31b8095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bd2ed700 1 --2- 172.21.15.154:0/1759763368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b8095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bd2ed700 1 -- 172.21.15.154:0/1759763368 >> v1:172.21.15.154:6789/0 conn(0x7f31b812c240 legacy=0x7f31b812e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bd2ed700 1 -- 172.21.15.154:0/1759763368 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8093150 con 0x7f31b8095c50 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bdaee700 1 --2- 172.21.15.154:0/1759763368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b8095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bd2ed700 1 --2- 172.21.15.154:0/1759763368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b8095c50 0x7f31b8096030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f31b4009790 tx=0x7f31b4009060).ready entity=mon.1 client_cookie=457928b914ddbe56 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bcaec700 1 -- 172.21.15.154:0/1759763368 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40090d0 con 0x7f31b8095c50 2023-09-30T22:19:55.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bcaec700 1 -- 172.21.15.154:0/1759763368 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b400f510 con 0x7f31b8095c50 2023-09-30T22:19:55.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bcaec700 1 -- 172.21.15.154:0/1759763368 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400f890 con 0x7f31b8095c50 2023-09-30T22:19:55.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bfd52700 1 -- 172.21.15.154:0/1759763368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b8095c50 msgr2=0x7f31b8096030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bfd52700 1 --2- 172.21.15.154:0/1759763368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b8095c50 0x7f31b8096030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f31b4009790 tx=0x7f31b4009060).stop 2023-09-30T22:19:55.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bfd52700 1 -- 172.21.15.154:0/1759763368 shutdown_connections 2023-09-30T22:19:55.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bfd52700 1 --2- 172.21.15.154:0/1759763368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b8095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bfd52700 1 --2- 172.21.15.154:0/1759763368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b8095c50 0x7f31b8096030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bfd52700 1 -- 172.21.15.154:0/1759763368 >> 172.21.15.154:0/1759763368 conn(0x7f31b809aa50 msgr2=0x7f31b809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bfd52700 1 -- 172.21.15.154:0/1759763368 shutdown_connections 2023-09-30T22:19:55.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.426+0000 7f31bfd52700 1 -- 172.21.15.154:0/1759763368 wait complete. 2023-09-30T22:19:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.427+0000 7f31bfd52700 1 Processor -- start 2023-09-30T22:19:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.427+0000 7f31bfd52700 1 -- start start 2023-09-30T22:19:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bfd52700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b812b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bfd52700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31b8095c50 0x7f31b812b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bfd52700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b812c240 0x7f31b812bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bfd52700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8092410 con 0x7f31b8095c50 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bfd52700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8112cc0 con 0x7f31b812c240 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bfd52700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31b8098ff0 con 0x7f31b8093950 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bdaee700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b812b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bdaee700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b812b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36142/0 (socket says 172.21.15.154:36142) 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bdaee700 1 -- 172.21.15.154:0/1904023895 learned_addr learned my addr 172.21.15.154:0/1904023895 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31be2ef700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b812c240 0x7f31b812bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bd2ed700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31b8095c50 0x7f31b812b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bdaee700 1 -- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b812c240 msgr2=0x7f31b812bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bdaee700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b812c240 0x7f31b812bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bdaee700 1 -- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31b8095c50 msgr2=0x7f31b812b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bdaee700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31b8095c50 0x7f31b812b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bdaee700 1 -- 172.21.15.154:0/1904023895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a80092a0 con 0x7f31b8093950 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31be2ef700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b812c240 0x7f31b812bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bdaee700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b812b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f31a800ea20 tx=0x7f31a8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31adffb700 1 -- 172.21.15.154:0/1904023895 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a800ee60 con 0x7f31b8093950 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31adffb700 1 -- 172.21.15.154:0/1904023895 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a800c850 con 0x7f31b8093950 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b40092a0 con 0x7f31b8093950 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.428+0000 7f31adffb700 1 -- 172.21.15.154:0/1904023895 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a800cbd0 con 0x7f31b8093950 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.429+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b8113b00 con 0x7f31b8093950 2023-09-30T22:19:55.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.429+0000 7f31adffb700 1 -- 172.21.15.154:0/1904023895 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f31a801b400 con 0x7f31b8093950 2023-09-30T22:19:55.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.429+0000 7f31adffb700 1 -- 172.21.15.154:0/1904023895 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f31a803b360 con 0x7f31b8093950 2023-09-30T22:19:55.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.430+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b8113b00 con 0x7f31b8093950 2023-09-30T22:19:55.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.434+0000 7f31adffb700 1 -- 172.21.15.154:0/1904023895 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f31b8113b00 con 0x7f31b8093950 2023-09-30T22:19:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.629+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f31b8113b00 con 0x7f31b8093950 2023-09-30T22:19:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.793+0000 7f31adffb700 1 -- 172.21.15.154:0/1904023895 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f31b8113b00 con 0x7f31b8093950 2023-09-30T22:19:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 >> v1:172.21.15.154:6816/118163 conn(0x7f319c02bb60 legacy=0x7f319c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 msgr2=0x7f31b812b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b812b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f31a800ea20 tx=0x7f31a8009060).stop 2023-09-30T22:19:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 shutdown_connections 2023-09-30T22:19:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31b812c240 0x7f31b812bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31b8093950 0x7f31b812b0d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 --2- 172.21.15.154:0/1904023895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31b8095c50 0x7f31b812b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 >> 172.21.15.154:0/1904023895 conn(0x7f31b809aa50 msgr2=0x7f31b8062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 shutdown_connections 2023-09-30T22:19:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.795+0000 7f31bfd52700 1 -- 172.21.15.154:0/1904023895 wait complete. 2023-09-30T22:19:55.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-09-30T22:19:55.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.929+0000 7f38dbdd5700 1 Processor -- start 2023-09-30T22:19:55.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.929+0000 7f38dbdd5700 1 -- start start 2023-09-30T22:19:55.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38dbdd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d4095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38dbdd5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38d4095c50 0x7f38d4096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38dbdd5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d4094ba0 con 0x7f38d412c240 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38dbdd5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d4092e90 con 0x7f38d4095c50 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38dbdd5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4096b60 con 0x7f38d4093950 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d9370700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38d4095c50 0x7f38d4096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d9b71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d4095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38da372700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f38d412c240 0x7f38d412e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42970/0 (socket says 172.21.15.154:42970) 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38da372700 1 -- 172.21.15.154:0/3588419210 learned_addr learned my addr 172.21.15.154:0/3588419210 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d9370700 1 -- 172.21.15.154:0/3588419210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 msgr2=0x7f38d4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d9370700 1 --2- 172.21.15.154:0/3588419210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d4095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d9370700 1 -- 172.21.15.154:0/3588419210 >> v1:172.21.15.154:6789/0 conn(0x7f38d412c240 legacy=0x7f38d412e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d9370700 1 -- 172.21.15.154:0/3588419210 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4093150 con 0x7f38d4095c50 2023-09-30T22:19:55.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d8b6f700 1 -- 172.21.15.154:0/3588419210 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295769692 0 0) 0x7f38d4094ba0 con 0x7f38d412c240 2023-09-30T22:19:55.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d9b71700 1 --2- 172.21.15.154:0/3588419210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d4095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:55.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d9370700 1 --2- 172.21.15.154:0/3588419210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d4095c50 0x7f38d4096030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f38d0009760 tx=0x7f38d0009060).ready entity=mon.0 client_cookie=88a8235b8ab462ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d8b6f700 1 -- 172.21.15.154:0/3588419210 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00090d0 con 0x7f38d4095c50 2023-09-30T22:19:55.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d8b6f700 1 -- 172.21.15.154:0/3588419210 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d000f510 con 0x7f38d4095c50 2023-09-30T22:19:55.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.930+0000 7f38d8b6f700 1 -- 172.21.15.154:0/3588419210 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000f890 con 0x7f38d4095c50 2023-09-30T22:19:55.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.931+0000 7f38dbdd5700 1 -- 172.21.15.154:0/3588419210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d4095c50 msgr2=0x7f38d4096030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.931+0000 7f38dbdd5700 1 --2- 172.21.15.154:0/3588419210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d4095c50 0x7f38d4096030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f38d0009760 tx=0x7f38d0009060).stop 2023-09-30T22:19:55.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.931+0000 7f38dbdd5700 1 -- 172.21.15.154:0/3588419210 shutdown_connections 2023-09-30T22:19:55.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.931+0000 7f38dbdd5700 1 --2- 172.21.15.154:0/3588419210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d4095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.931+0000 7f38dbdd5700 1 --2- 172.21.15.154:0/3588419210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d4095c50 0x7f38d4096030 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.931+0000 7f38dbdd5700 1 -- 172.21.15.154:0/3588419210 >> 172.21.15.154:0/3588419210 conn(0x7f38d409aa50 msgr2=0x7f38d409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.931+0000 7f38dbdd5700 1 -- 172.21.15.154:0/3588419210 shutdown_connections 2023-09-30T22:19:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.931+0000 7f38dbdd5700 1 -- 172.21.15.154:0/3588419210 wait complete. 2023-09-30T22:19:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38dbdd5700 1 Processor -- start 2023-09-30T22:19:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38dbdd5700 1 -- start start 2023-09-30T22:19:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38dbdd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d412ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38dbdd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38d4095c50 0x7f38d412b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38dbdd5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d412c240 0x7f38d412b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38dbdd5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4125b30 con 0x7f38d412c240 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38dbdd5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4092410 con 0x7f38d4095c50 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38dbdd5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38d4126060 con 0x7f38d4093950 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38d9b71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d412ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38d9b71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d412ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36152/0 (socket says 172.21.15.154:36152) 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38da372700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d412c240 0x7f38d412b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38d9b71700 1 -- 172.21.15.154:0/67083226 learned_addr learned my addr 172.21.15.154:0/67083226 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.932+0000 7f38d9370700 1 --2- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38d4095c50 0x7f38d412b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38d9b71700 1 -- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38d4095c50 msgr2=0x7f38d412b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38d9b71700 1 --2- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38d4095c50 0x7f38d412b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38d9b71700 1 -- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d412c240 msgr2=0x7f38d412b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38d9b71700 1 --2- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d412c240 0x7f38d412b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38d9b71700 1 -- 172.21.15.154:0/67083226 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40092a0 con 0x7f38d4093950 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38d9b71700 1 --2- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d412ac20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f38c400ea20 tx=0x7f38c4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38c9ffb700 1 -- 172.21.15.154:0/67083226 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c400ee60 con 0x7f38d4093950 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38c9ffb700 1 -- 172.21.15.154:0/67083226 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4009600 con 0x7f38d4093950 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d00092a0 con 0x7f38d4093950 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38c9ffb700 1 -- 172.21.15.154:0/67083226 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c400ca60 con 0x7f38d4093950 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.933+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d4113b90 con 0x7f38d4093950 2023-09-30T22:19:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.934+0000 7f38c9ffb700 1 -- 172.21.15.154:0/67083226 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f38c401b400 con 0x7f38d4093950 2023-09-30T22:19:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.934+0000 7f38c9ffb700 1 -- 172.21.15.154:0/67083226 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f38c403b4d0 con 0x7f38d4093950 2023-09-30T22:19:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.934+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d4066670 con 0x7f38d4093950 2023-09-30T22:19:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:55.939+0000 7f38c9ffb700 1 -- 172.21.15.154:0/67083226 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f38c4016070 con 0x7f38d4093950 2023-09-30T22:19:56.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.134+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f38d41132d0 con 0x7f38d4093950 2023-09-30T22:19:56.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.798+0000 7f38c9ffb700 1 -- 172.21.15.154:0/67083226 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f38c40290b0 con 0x7f38d4093950 2023-09-30T22:19:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 >> v1:172.21.15.154:6816/118163 conn(0x7f38b802bb60 legacy=0x7f38b802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 msgr2=0x7f38d412ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 --2- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d412ac20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f38c400ea20 tx=0x7f38c4009060).stop 2023-09-30T22:19:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 shutdown_connections 2023-09-30T22:19:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 --2- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d412c240 0x7f38d412b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 --2- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f38d4093950 0x7f38d412ac20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 --2- 172.21.15.154:0/67083226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38d4095c50 0x7f38d412b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 >> 172.21.15.154:0/67083226 conn(0x7f38d409aa50 msgr2=0x7f38d4062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 shutdown_connections 2023-09-30T22:19:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.800+0000 7f38dbdd5700 1 -- 172.21.15.154:0/67083226 wait complete. 2023-09-30T22:19:56.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:19:56.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.931+0000 7f8189dea700 1 Processor -- start 2023-09-30T22:19:56.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8189dea700 1 -- start start 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8189dea700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8184092190 0x7f81841293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8189dea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184130130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8189dea700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8184093340 con 0x7f818405f560 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8189dea700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818405f940 con 0x7f8184092190 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8189dea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8184097c30 con 0x7f818412dd40 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8183fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8182ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8184092190 0x7f81841293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f81837fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f818405f560 0x7f8184128cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42984/0 (socket says 172.21.15.154:42984) 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8183fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184130130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44464/0 (socket says 172.21.15.154:44464) 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8182ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8184092190 0x7f81841293c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41390/0 (socket says 172.21.15.154:41390) 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f81837fe700 1 -- 172.21.15.154:0/425725438 learned_addr learned my addr 172.21.15.154:0/425725438 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:19:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8183fff700 1 -- 172.21.15.154:0/425725438 >> v2:172.21.15.154:3300/0 conn(0x7f8184092190 msgr2=0x7f81841293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8183fff700 1 --2- 172.21.15.154:0/425725438 >> v2:172.21.15.154:3300/0 conn(0x7f8184092190 0x7f81841293c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f8183fff700 1 -- 172.21.15.154:0/425725438 >> v1:172.21.15.154:6789/0 conn(0x7f818405f560 legacy=0x7f8184128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.932+0000 7f81827fc700 1 -- 172.21.15.154:0/425725438 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157761320 0 0) 0x7f8184093340 con 0x7f818405f560 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8183fff700 1 -- 172.21.15.154:0/425725438 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840941f0 con 0x7f818412dd40 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8182ffd700 1 --2- 172.21.15.154:0/425725438 >> v2:172.21.15.154:3300/0 conn(0x7f8184092190 0x7f81841293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8183fff700 1 --2- 172.21.15.154:0/425725438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184130130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f817c009e60 tx=0x7f817c009780).ready entity=mon.1 client_cookie=d1f0455622f274b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f81827fc700 1 -- 172.21.15.154:0/425725438 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c00e070 con 0x7f818412dd40 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f81827fc700 1 -- 172.21.15.154:0/425725438 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c00bb60 con 0x7f818412dd40 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f81827fc700 1 -- 172.21.15.154:0/425725438 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c012410 con 0x7f818412dd40 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8189dea700 1 -- 172.21.15.154:0/425725438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 msgr2=0x7f8184130130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8189dea700 1 --2- 172.21.15.154:0/425725438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184130130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f817c009e60 tx=0x7f817c009780).stop 2023-09-30T22:19:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8189dea700 1 -- 172.21.15.154:0/425725438 shutdown_connections 2023-09-30T22:19:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8189dea700 1 --2- 172.21.15.154:0/425725438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184130130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8189dea700 1 --2- 172.21.15.154:0/425725438 >> v2:172.21.15.154:3300/0 conn(0x7f8184092190 0x7f81841293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8189dea700 1 -- 172.21.15.154:0/425725438 >> 172.21.15.154:0/425725438 conn(0x7f818409a1c0 msgr2=0x7f818409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8189dea700 1 -- 172.21.15.154:0/425725438 shutdown_connections 2023-09-30T22:19:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.933+0000 7f8189dea700 1 -- 172.21.15.154:0/425725438 wait complete. 2023-09-30T22:19:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.934+0000 7f8189dea700 1 Processor -- start 2023-09-30T22:19:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.934+0000 7f8189dea700 1 -- start start 2023-09-30T22:19:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8189dea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f818405f560 0x7f818412d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8189dea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8184092190 0x7f8184110820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8189dea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184110d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8189dea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81841288b0 con 0x7f8184092190 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8189dea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8184097d80 con 0x7f818412dd40 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8189dea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81840990d0 con 0x7f818405f560 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8182ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8184092190 0x7f8184110820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8182ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8184092190 0x7f8184110820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41392/0 (socket says 172.21.15.154:41392) 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8183fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184110d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8182ffd700 1 -- 172.21.15.154:0/2604854095 learned_addr learned my addr 172.21.15.154:0/2604854095 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f81837fe700 1 --2- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f818405f560 0x7f818412d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8182ffd700 1 -- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f818405f560 msgr2=0x7f818412d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8182ffd700 1 --2- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f818405f560 0x7f818412d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8182ffd700 1 -- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 msgr2=0x7f8184110d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8182ffd700 1 --2- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184110d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8182ffd700 1 -- 172.21.15.154:0/2604854095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740092a0 con 0x7f8184092190 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8183fff700 1 --2- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184110d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f8182ffd700 1 --2- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8184092190 0x7f8184110820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f817400ea20 tx=0x7f8174009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.935+0000 7f817b7fe700 1 -- 172.21.15.154:0/2604854095 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817400ee60 con 0x7f8184092190 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.936+0000 7f817b7fe700 1 -- 172.21.15.154:0/2604854095 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817400c850 con 0x7f8184092190 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.936+0000 7f817b7fe700 1 -- 172.21.15.154:0/2604854095 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817400cbd0 con 0x7f8184092190 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.936+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c009a20 con 0x7f8184092190 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.936+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8184114550 con 0x7f8184092190 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.936+0000 7f817b7fe700 1 -- 172.21.15.154:0/2604854095 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f817401b400 con 0x7f8184092190 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.937+0000 7f817b7fe700 1 -- 172.21.15.154:0/2604854095 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f817403b510 con 0x7f8184092190 2023-09-30T22:19:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.937+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8184093560 con 0x7f8184092190 2023-09-30T22:19:56.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:56.941+0000 7f817b7fe700 1 -- 172.21.15.154:0/2604854095 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8174019900 con 0x7f8184092190 2023-09-30T22:19:57.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.135+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81841138c0 con 0x7f8184092190 2023-09-30T22:19:57.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.135+0000 7f817b7fe700 1 -- 172.21.15.154:0/2604854095 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f817402a090 con 0x7f8184092190 2023-09-30T22:19:57.135 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:19:57.135 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:19:33.620776+0000","modified":"2023-09-30T22:19:56.792269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T22:19:57.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 >> v1:172.21.15.154:6816/118163 conn(0x7f816402bb60 legacy=0x7f816402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8184092190 msgr2=0x7f8184110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 --2- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8184092190 0x7f8184110820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f817400ea20 tx=0x7f8174009060).stop 2023-09-30T22:19:57.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 shutdown_connections 2023-09-30T22:19:57.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 --2- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818412dd40 0x7f8184110d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 --2- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f818405f560 0x7f818412d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 --2- 172.21.15.154:0/2604854095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8184092190 0x7f8184110820 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 >> 172.21.15.154:0/2604854095 conn(0x7f818409a1c0 msgr2=0x7f818412fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 shutdown_connections 2023-09-30T22:19:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.137+0000 7f8189dea700 1 -- 172.21.15.154:0/2604854095 wait complete. 2023-09-30T22:19:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-09-30T22:19:57.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:19:33.620776+0000', 'modified': '2023-09-30T22:19:56.792269+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6817/2576993373', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.154:6817', 'nonce': 2576993373}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-30T22:19:57.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:19:57.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:19:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.368+0000 7fd4445da700 1 Processor -- start 2023-09-30T22:19:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.368+0000 7fd4445da700 1 -- start start 2023-09-30T22:19:57.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd4445da700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd4445da700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd43c0966b0 0x7fd43c132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd4445da700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c091980 con 0x7fd43c095b80 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd4445da700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0973f0 con 0x7fd43c0966b0 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd4445da700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c062ee0 con 0x7fd43c062b00 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442b77700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd43c0966b0 0x7fd43c132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44478/0 (socket says 172.21.15.154:44478) 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442b77700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd43c0966b0 0x7fd43c132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41406/0 (socket says 172.21.15.154:41406) 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442376700 1 -- 172.21.15.154:0/1856722531 learned_addr learned my addr 172.21.15.154:0/1856722531 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd441b75700 1 --1- 172.21.15.154:0/1856722531 >> v1:172.21.15.154:6789/0 conn(0x7fd43c095b80 0x7fd43c095fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42994/0 (socket says 172.21.15.154:42994) 2023-09-30T22:19:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442b77700 1 -- 172.21.15.154:0/1856722531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 msgr2=0x7fd43c095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442b77700 1 --2- 172.21.15.154:0/1856722531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442b77700 1 -- 172.21.15.154:0/1856722531 >> v1:172.21.15.154:6789/0 conn(0x7fd43c095b80 legacy=0x7fd43c095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442b77700 1 -- 172.21.15.154:0/1856722531 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c092310 con 0x7fd43c0966b0 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd441374700 1 -- 172.21.15.154:0/1856722531 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346834022 0 0) 0x7fd43c091980 con 0x7fd43c095b80 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442376700 1 --2- 172.21.15.154:0/1856722531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd442b77700 1 --2- 172.21.15.154:0/1856722531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 0x7fd43c132290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd434009e90 tx=0x7fd434009780).ready entity=mon.0 client_cookie=c84a393fe0c3aa70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd441374700 1 -- 172.21.15.154:0/1856722531 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400e070 con 0x7fd43c0966b0 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.369+0000 7fd441374700 1 -- 172.21.15.154:0/1856722531 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43400bb20 con 0x7fd43c0966b0 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.370+0000 7fd441374700 1 -- 172.21.15.154:0/1856722531 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400bea0 con 0x7fd43c0966b0 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.370+0000 7fd4445da700 1 -- 172.21.15.154:0/1856722531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 msgr2=0x7fd43c132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.370+0000 7fd4445da700 1 --2- 172.21.15.154:0/1856722531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 0x7fd43c132290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fd434009e90 tx=0x7fd434009780).stop 2023-09-30T22:19:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.370+0000 7fd4445da700 1 -- 172.21.15.154:0/1856722531 shutdown_connections 2023-09-30T22:19:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.370+0000 7fd4445da700 1 --2- 172.21.15.154:0/1856722531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 0x7fd43c132290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.370+0000 7fd4445da700 1 --2- 172.21.15.154:0/1856722531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.370+0000 7fd4445da700 1 -- 172.21.15.154:0/1856722531 >> 172.21.15.154:0/1856722531 conn(0x7fd43c09aa50 msgr2=0x7fd43c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.370+0000 7fd4445da700 1 -- 172.21.15.154:0/1856722531 shutdown_connections 2023-09-30T22:19:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.370+0000 7fd4445da700 1 -- 172.21.15.154:0/1856722531 wait complete. 2023-09-30T22:19:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd4445da700 1 Processor -- start 2023-09-30T22:19:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd4445da700 1 -- start start 2023-09-30T22:19:57.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd4445da700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c12d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd4445da700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd43c095b80 0x7fd43c1154d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd4445da700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 0x7fd43c1159c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd4445da700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c096da0 con 0x7fd43c0966b0 2023-09-30T22:19:57.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd4445da700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c119910 con 0x7fd43c062b00 2023-09-30T22:19:57.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd4445da700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c119530 con 0x7fd43c095b80 2023-09-30T22:19:57.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c12d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c12d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44492/0 (socket says 172.21.15.154:44492) 2023-09-30T22:19:57.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd441b75700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd43c095b80 0x7fd43c1154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd442376700 1 -- 172.21.15.154:0/1614525295 learned_addr learned my addr 172.21.15.154:0/1614525295 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:57.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.371+0000 7fd442b77700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 0x7fd43c1159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd442376700 1 -- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd43c095b80 msgr2=0x7fd43c1154d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd442376700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd43c095b80 0x7fd43c1154d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd442376700 1 -- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 msgr2=0x7fd43c1159c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd442376700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 0x7fd43c1159c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd442376700 1 -- 172.21.15.154:0/1614525295 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c009370 con 0x7fd43c062b00 2023-09-30T22:19:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd441b75700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd43c095b80 0x7fd43c1154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd442b77700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 0x7fd43c1159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd442376700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c12d570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd42c00ea20 tx=0x7fd42c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd4327fc700 1 -- 172.21.15.154:0/1614525295 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c009650 con 0x7fd43c062b00 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd4327fc700 1 -- 172.21.15.154:0/1614525295 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c00ee60 con 0x7fd43c062b00 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd4445da700 1 -- 172.21.15.154:0/1614525295 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd434009a20 con 0x7fd43c062b00 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd4327fc700 1 -- 172.21.15.154:0/1614525295 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c00ca60 con 0x7fd43c062b00 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.372+0000 7fd4445da700 1 -- 172.21.15.154:0/1614525295 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c1189d0 con 0x7fd43c062b00 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.373+0000 7fd4327fc700 1 -- 172.21.15.154:0/1614525295 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd42c01b400 con 0x7fd43c062b00 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.373+0000 7fd4327fc700 1 -- 172.21.15.154:0/1614525295 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd42c03b550 con 0x7fd43c062b00 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd455f8db80 1 Processor -- start 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd455f8db80 1 -- start start 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 0x55c9830f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c983093610 con 0x55c9830c9a40 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c983009db0 con 0x55c9830f35b0 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c98301f030 con 0x55c9830c9170 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd441b75700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd442b77700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 0x55c9830f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd441b75700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41436/0 (socket says 172.21.15.154:41436) 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36164/0 (socket says 172.21.15.154:36164) 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.376+0000 7fd441b75700 1 -- 172.21.15.154:0/1021729137 learned_addr learned my addr 172.21.15.154:0/1021729137 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd442b77700 1 -- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 msgr2=0x55c9830c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd442b77700 1 --2- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd442b77700 1 -- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 msgr2=0x55c9830f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd442b77700 1 --2- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd442b77700 1 -- 172.21.15.154:0/1021729137 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c982eba710 con 0x55c9830f35b0 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd441b75700 1 --2- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd442b77700 1 --2- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 0x55c9830f59a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd434014000 tx=0x7fd434009780).ready entity=mon.1 client_cookie=abd0be677bc8bdd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd41f7fe700 1 -- 172.21.15.154:0/1021729137 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400be60 con 0x55c9830f35b0 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd41f7fe700 1 -- 172.21.15.154:0/1021729137 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4340139f0 con 0x55c9830f35b0 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd41f7fe700 1 -- 172.21.15.154:0/1021729137 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434013b60 con 0x55c9830f35b0 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd455f8db80 1 -- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 msgr2=0x55c9830f59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd455f8db80 1 --2- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 0x55c9830f59a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd434014000 tx=0x7fd434009780).stop 2023-09-30T22:19:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.377+0000 7fd455f8db80 1 -- 172.21.15.154:0/1021729137 shutdown_connections 2023-09-30T22:19:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.378+0000 7fd455f8db80 1 --2- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 0x55c9830f59a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.378+0000 7fd455f8db80 1 --2- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.378+0000 7fd455f8db80 1 --2- 172.21.15.154:0/1021729137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.378+0000 7fd455f8db80 1 -- 172.21.15.154:0/1021729137 >> 172.21.15.154:0/1021729137 conn(0x55c982f37940 msgr2=0x55c9830e9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.378+0000 7fd455f8db80 1 -- 172.21.15.154:0/1021729137 shutdown_connections 2023-09-30T22:19:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.378+0000 7fd455f8db80 1 -- 172.21.15.154:0/1021729137 wait complete. 2023-09-30T22:19:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.378+0000 7fd455f8db80 1 -- start start 2023-09-30T22:19:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.378+0000 7fd455f8db80 1 Processor -- start 2023-09-30T22:19:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830ee970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830eee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 0x55c9830ef350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98301f170 con 0x55c9830c9a40 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c98301f3f0 con 0x55c9830f35b0 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c982fea920 con 0x55c9830c9170 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd455f8db80 10 client.0 ll_register_callbacks cb 0x55c982fbfce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd441b75700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd441b75700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830eee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41442/0 (socket says 172.21.15.154:41442) 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd441b75700 1 -- 172.21.15.154:0/4157676654 learned_addr learned my addr 172.21.15.154:0/4157676654 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd442376700 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd442b77700 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 0x55c9830ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd442376700 1 -- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 msgr2=0x55c9830ef350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd442376700 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 0x55c9830ef350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd442376700 1 -- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 msgr2=0x55c9830eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd442376700 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd442376700 1 -- 172.21.15.154:0/4157676654 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c092310 con 0x55c9830c9170 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd441b75700 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd442376700 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830ee970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd42c011e50 tx=0x7fd42c01a000).ready entity=mon.2 client_cookie=2eda29ff2e8e542 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd41cff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3302/0 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd41cff9700 1 -- 172.21.15.154:0/4157676654 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c02a070 con 0x55c9830c9170 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd41cff9700 1 -- 172.21.15.154:0/4157676654 <== mon.2 v2:172.21.15.154:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd42c023350 con 0x55c9830c9170 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd455f8db80 1 -- 172.21.15.154:0/4157676654 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9830c1f20 con 0x55c9830c9170 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.379+0000 7fd41cff9700 1 -- 172.21.15.154:0/4157676654 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd42c01cd20 con 0x55c9830c9170 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd455f8db80 10 client.4541 fetch_fsmap learned FSMap version 7 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd455f8db80 1 -- 172.21.15.154:0/4157676654 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c982ff1b00 con 0x55c9830c9170 2023-09-30T22:19:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd41cff9700 1 -- 172.21.15.154:0/4157676654 <== mon.2 v2:172.21.15.154:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c033070 con 0x55c9830c9170 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd41cff9700 1 -- 172.21.15.154:0/4157676654 <== mon.2 v2:172.21.15.154:3302/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fd42c011770 con 0x55c9830c9170 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd455f8db80 10 client.4541 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd455f8db80 10 client.4541 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd455f8db80 20 client.4541 populate_metadata read hostname 'smithi154' 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd455f8db80 4 client.4541 mds_command: new command op to 4184 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd455f8db80 1 -- 172.21.15.154:0/4157676654 --> v1:172.21.15.154:6817/2576993373 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c983097250 con 0x55c9830e3a10 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.380+0000 7fd41cff9700 10 client.4541 ms_handle_connect on v1:172.21.15.154:6817/2576993373 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd41cff9700 1 -- 172.21.15.154:0/4157676654 <== mds.0 v1:172.21.15.154:6817/2576993373 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55c983097250 con 0x55c9830e3a10 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd41cff9700 10 client.4541 handle_command_reply: tid=0 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 client.4541 shutdown 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 -- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 msgr2=0x55c9830ee970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830ee970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd42c011e50 tx=0x7fd42c01a000).stop 2023-09-30T22:19:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 -- 172.21.15.154:0/4157676654 shutdown_connections 2023-09-30T22:19:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830f35b0 0x55c9830ef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830ee970 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd41cff9700 0 client.4541 ms_handle_reset on v1:172.21.15.154:6817/2576993373 2023-09-30T22:19:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 --2- 172.21.15.154:0/4157676654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830c9a40 0x55c9830eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 -- 172.21.15.154:0/4157676654 >> 172.21.15.154:0/4157676654 conn(0x55c982f37940 msgr2=0x55c9830e9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 -- 172.21.15.154:0/4157676654 shutdown_connections 2023-09-30T22:19:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 1 -- 172.21.15.154:0/4157676654 wait complete. 2023-09-30T22:19:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.381+0000 7fd455f8db80 20 client.4541 trim_cache size 0 max 16384 2023-09-30T22:19:57.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.397+0000 7fd455f8db80 1 Processor -- start 2023-09-30T22:19:57.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.397+0000 7fd455f8db80 1 -- start start 2023-09-30T22:19:57.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9170 0x55c9830e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9a40 0x55c983105160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9830e7850 con 0x55c9830e3a10 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9830f18e0 con 0x55c9830c9170 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c9830f1e70 con 0x55c9830c9a40 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd441b75700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9a40 0x55c983105160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442b77700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9170 0x55c9830e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd441b75700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9a40 0x55c983105160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36188/0 (socket says 172.21.15.154:36188) 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9170 0x55c9830e42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44518/0 (socket says 172.21.15.154:44518) 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442b77700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41454/0 (socket says 172.21.15.154:41454) 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd441b75700 1 -- 172.21.15.154:0/3179082286 learned_addr learned my addr 172.21.15.154:0/3179082286 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442376700 1 -- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9a40 msgr2=0x55c983105160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442376700 1 --2- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9a40 0x55c983105160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442376700 1 -- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 msgr2=0x55c9830ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442376700 1 --2- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442376700 1 -- 172.21.15.154:0/3179082286 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c983017f70 con 0x55c9830c9170 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442b77700 1 --2- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd441b75700 1 --2- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9a40 0x55c983105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.398+0000 7fd442376700 1 --2- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9170 0x55c9830e42d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd42c039da0 tx=0x7fd42c02a000).ready entity=mon.1 client_cookie=294117e13c09b7a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd41ffff700 1 -- 172.21.15.154:0/3179082286 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c009160 con 0x55c9830c9170 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd41ffff700 1 -- 172.21.15.154:0/3179082286 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c033070 con 0x55c9830c9170 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd41ffff700 1 -- 172.21.15.154:0/3179082286 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c01cd20 con 0x55c9830c9170 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd455f8db80 1 -- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9170 msgr2=0x55c9830e42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd455f8db80 1 --2- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9170 0x55c9830e42d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd42c039da0 tx=0x7fd42c02a000).stop 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd455f8db80 1 -- 172.21.15.154:0/3179082286 shutdown_connections 2023-09-30T22:19:57.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd455f8db80 1 --2- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd455f8db80 1 --2- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9170 0x55c9830e42d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd455f8db80 1 --2- 172.21.15.154:0/3179082286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9a40 0x55c983105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd455f8db80 1 -- 172.21.15.154:0/3179082286 >> 172.21.15.154:0/3179082286 conn(0x55c982f37940 msgr2=0x55c9830c5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd455f8db80 1 -- 172.21.15.154:0/3179082286 shutdown_connections 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.399+0000 7fd455f8db80 1 -- 172.21.15.154:0/3179082286 wait complete. 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd455f8db80 1 -- start start 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd455f8db80 1 Processor -- start 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830eda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9a40 0x55c9830edf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd455f8db80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ee410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-09-30T22:19:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9830c8980 con 0x55c9830e3a10 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c983131910 con 0x55c9830c9a40 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd455f8db80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c9830e44e0 con 0x55c9830c9170 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd455f8db80 10 client.0 ll_register_callbacks cb 0x55c982fbfce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd442376700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830eda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36202/0 (socket says 172.21.15.154:36202) 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd442376700 1 -- 172.21.15.154:0/3620430295 learned_addr learned my addr 172.21.15.154:0/3620430295 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.400+0000 7fd442b77700 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ee410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd441b75700 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9a40 0x55c9830edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd442376700 1 -- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9a40 msgr2=0x55c9830edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd442376700 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9a40 0x55c9830edf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd442376700 1 -- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 msgr2=0x55c9830ee410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:19:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd442376700 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ee410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd442376700 1 -- 172.21.15.154:0/3620430295 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4380074e0 con 0x55c9830c9170 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd442b77700 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ee410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd442376700 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830eda30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd42c03e010 tx=0x7fd42c03e040).ready entity=mon.2 client_cookie=f9858f5278f6776e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd41cff9700 10 client.0 ms_handle_connect on v2:172.21.15.154:3302/0 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd41cff9700 1 -- 172.21.15.154:0/3620430295 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c02a070 con 0x55c9830c9170 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd41cff9700 1 -- 172.21.15.154:0/3620430295 <== mon.2 v2:172.21.15.154:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd42c023350 con 0x55c9830c9170 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd455f8db80 1 -- 172.21.15.154:0/3620430295 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9830c8c50 con 0x55c9830c9170 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd41cff9700 1 -- 172.21.15.154:0/3620430295 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd42c023570 con 0x55c9830c9170 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd455f8db80 10 client.4547 fetch_fsmap learned FSMap version 7 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd455f8db80 1 -- 172.21.15.154:0/3620430295 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c982eba710 con 0x55c9830c9170 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd41cff9700 1 -- 172.21.15.154:0/3620430295 <== mon.2 v2:172.21.15.154:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9830c8c50 con 0x55c9830c9170 2023-09-30T22:19:57.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd41cff9700 1 -- 172.21.15.154:0/3620430295 <== mon.2 v2:172.21.15.154:3302/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fd42c04d070 con 0x55c9830c9170 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd455f8db80 10 client.4547 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd455f8db80 10 client.4547 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd455f8db80 20 client.4547 populate_metadata read hostname 'smithi154' 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd455f8db80 4 client.4547 mds_command: new command op to 4184 tid=0[{"prefix": "status"}] 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.401+0000 7fd455f8db80 1 -- 172.21.15.154:0/3620430295 --> v1:172.21.15.154:6817/2576993373 -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fd4340139f0 con 0x55c9830f35b0 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd41cff9700 10 client.4547 ms_handle_connect on v1:172.21.15.154:6817/2576993373 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd41cff9700 1 -- 172.21.15.154:0/3620430295 <== mds.0 v1:172.21.15.154:6817/2576993373 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 2379549320) 0x7fd4340139f0 con 0x55c9830f35b0 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd41cff9700 10 client.4547 handle_command_reply: tid=0 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 client.4547 shutdown 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 -- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 msgr2=0x55c9830eda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830eda30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd42c03e010 tx=0x7fd42c03e040).stop 2023-09-30T22:19:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 -- 172.21.15.154:0/3620430295 shutdown_connections 2023-09-30T22:19:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9830e3a10 0x55c9830ee410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55c9830c9170 0x55c9830eda30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd41cff9700 0 client.4547 ms_handle_reset on v1:172.21.15.154:6817/2576993373 2023-09-30T22:19:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 --2- 172.21.15.154:0/3620430295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c9830c9a40 0x55c9830edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 -- 172.21.15.154:0/3620430295 >> 172.21.15.154:0/3620430295 conn(0x55c982f37940 msgr2=0x55c9830ef8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 -- 172.21.15.154:0/3620430295 shutdown_connections 2023-09-30T22:19:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.402+0000 7fd455f8db80 1 -- 172.21.15.154:0/3620430295 wait complete. 2023-09-30T22:19:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd455f8db80 20 client.4547 trim_cache size 0 max 16384 2023-09-30T22:19:57.410 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "632db358-b709-49ad-a56a-97cde2869fcf", 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4184, 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 23.775174308, 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 7, 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 17, 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 17, 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 28.061975368999999 2023-09-30T22:19:57.411 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-09-30T22:19:57.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 -- 172.21.15.154:0/1614525295 >> v1:172.21.15.154:6816/118163 conn(0x7fd42002bb30 legacy=0x7fd42002dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 -- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 msgr2=0x7fd43c12d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:19:57.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c12d570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd42c00ea20 tx=0x7fd42c0090f0).stop 2023-09-30T22:19:57.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 -- 172.21.15.154:0/1614525295 shutdown_connections 2023-09-30T22:19:57.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0966b0 0x7fd43c1159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c062b00 0x7fd43c12d570 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 --2- 172.21.15.154:0/1614525295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd43c095b80 0x7fd43c1154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-09-30T22:19:57.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 -- 172.21.15.154:0/1614525295 >> 172.21.15.154:0/1614525295 conn(0x7fd43c09aa50 msgr2=0x7fd43c098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:19:57.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 -- 172.21.15.154:0/1614525295 shutdown_connections 2023-09-30T22:19:57.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:19:57.403+0000 7fd4445da700 1 -- 172.21.15.154:0/1614525295 wait complete. 2023-09-30T22:19:57.414 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:19:57.423 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-09-30T22:19:57.423 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-09-30T22:19:57.443 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-09-30T22:19:57.443 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-09-30T22:19:57.443 INFO:teuthology.task.install:remote ubuntu@smithi154.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-09-30T22:19:57.443 INFO:teuthology.task.install:extra packages: [] 2023-09-30T22:19:57.449 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T22:19:57.449 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-09-30T22:19:57.449 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:19:57.472 INFO:teuthology.orchestra.run.smithi154.stdout:16.2.14-44.geeb13ac9.el8 2023-09-30T22:19:57.472 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-09-30T22:19:57.472 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:19:57.671 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-501.gfc1e90a3 2023-09-30T22:19:57.672 INFO:teuthology.task.install.rpm:Host smithi154 is: centos 8 x86_64 2023-09-30T22:19:57.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:19:57.877 INFO:teuthology.task.install.rpm:Repo base URL: https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/ 2023-09-30T22:19:57.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-09-30T22:19:58.319 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/fc1e90a395a6a5631142eb70fd9bf3d22740a9da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T22:19:58.319 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-09-30T22:19:58.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T22:19:58.349 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T22:19:58.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T22:19:58.488 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T22:19:58.546 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2023-09-30T22:19:58.558 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2023-09-30T22:19:58.830 INFO:teuthology.orchestra.run.smithi154.stdout:71 files removed 2023-09-30T22:19:58.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-09-30T22:20:00.051 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 104 kB/s | 80 kB 00:00 2023-09-30T22:20:00.785 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 14 kB/s | 9.4 kB 00:00 2023-09-30T22:20:01.503 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2023-09-30T22:20:03.652 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - AppStream 16 MB/s | 33 MB 00:02 2023-09-30T22:20:15.902 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - BaseOS 7.9 MB/s | 48 MB 00:06 2023-09-30T22:20:24.277 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - Extras 13 kB/s | 18 kB 00:01 2023-09-30T22:20:26.027 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - Extras common packages 4.4 kB/s | 6.9 kB 00:01 2023-09-30T22:20:27.137 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 8 - PowerTools 6.8 MB/s | 6.5 MB 00:00 2023-09-30T22:20:28.547 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-09-30T22:20:32.500 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 16 MB 00:03 2023-09-30T22:20:36.331 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 439 kB/s | 24 kB 00:00 2023-09-30T22:20:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:Package cephadm available, but not installed. 2023-09-30T22:20:40.800 INFO:teuthology.orchestra.run.smithi154.stdout:No match for argument: cephadm 2023-09-30T22:20:40.801 INFO:teuthology.orchestra.run.smithi154.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-09-30T22:20:40.801 INFO:teuthology.orchestra.run.smithi154.stdout:No match for argument: ceph-immutable-object-cache 2023-09-30T22:20:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-09-30T22:20:40.814 INFO:teuthology.orchestra.run.smithi154.stdout:No match for argument: ceph-mgr-cephadm 2023-09-30T22:20:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:Package ceph-volume available, but not installed. 2023-09-30T22:20:40.817 INFO:teuthology.orchestra.run.smithi154.stdout:No match for argument: ceph-volume 2023-09-30T22:20:41.094 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-09-30T22:20:41.099 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2023-09-30T22:20:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.4 k 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 5.4 M 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 22 M 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 847 k 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 23 k 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 2.3 M 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 1.5 M 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 1.7 M 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 7.4 M 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 241 k 2023-09-30T22:20:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 47 k 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 4.6 M 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 18 M 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:18.2.0-501.gfc1e90a3.el8 ceph-noarch 15 k 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 13 M 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 24 k 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 47 M 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 30 k 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 769 k 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 137 k 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 139 k 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.7 M 2023-09-30T22:20:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 474 k 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.6 M 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 6.5 M 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 45 k 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 123 k 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 190 k 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 371 k 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 364 k 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 107 k 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 94 k 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 3.4 M 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:18.2.0-501.gfc1e90a3.el8 ceph 179 k 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-09-30T22:20:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T22:20:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:20:41.103 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-09-30T22:20:41.103 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2023-09-30T22:20:41.103 INFO:teuthology.orchestra.run.smithi154.stdout:Install 1 Package 2023-09-30T22:20:41.103 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 34 Packages 2023-09-30T22:20:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:20:41.103 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 145 M 2023-09-30T22:20:41.103 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-09-30T22:20:41.549 INFO:teuthology.orchestra.run.smithi154.stdout:(1/35): ceph-18.2.0-501.gfc1e90a3.el8.x86_64.rp 52 kB/s | 6.4 kB 00:00 2023-09-30T22:20:41.682 INFO:teuthology.orchestra.run.smithi154.stdout:(2/35): thrift-0.13.0-2.el8.x86_64.rpm 6.8 MB/s | 1.7 MB 00:00 2023-09-30T22:20:42.811 INFO:teuthology.orchestra.run.smithi154.stdout:(3/35): ceph-common-18.2.0-501.gfc1e90a3.el8.x8 17 MB/s | 22 MB 00:01 2023-09-30T22:20:42.849 INFO:teuthology.orchestra.run.smithi154.stdout:(4/35): ceph-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 726 kB/s | 847 kB 00:01 2023-09-30T22:20:42.925 INFO:teuthology.orchestra.run.smithi154.stdout:(5/35): ceph-base-18.2.0-501.gfc1e90a3.el8.x86_ 3.6 MB/s | 5.4 MB 00:01 2023-09-30T22:20:43.000 INFO:teuthology.orchestra.run.smithi154.stdout:(6/35): ceph-mds-18.2.0-501.gfc1e90a3.el8.x86_6 12 MB/s | 2.3 MB 00:00 2023-09-30T22:20:43.626 INFO:teuthology.orchestra.run.smithi154.stdout:(7/35): ceph-mon-18.2.0-501.gfc1e90a3.el8.x86_6 6.6 MB/s | 4.6 MB 00:00 2023-09-30T22:20:43.734 INFO:teuthology.orchestra.run.smithi154.stdout:(8/35): ceph-mgr-18.2.0-501.gfc1e90a3.el8.x86_6 1.8 MB/s | 1.5 MB 00:00 2023-09-30T22:20:43.826 INFO:teuthology.orchestra.run.smithi154.stdout:(9/35): ceph-selinux-18.2.0-501.gfc1e90a3.el8.x 265 kB/s | 24 kB 00:00 2023-09-30T22:20:44.043 INFO:teuthology.orchestra.run.smithi154.stdout:(10/35): ceph-osd-18.2.0-501.gfc1e90a3.el8.x86_ 17 MB/s | 18 MB 00:01 2023-09-30T22:20:44.110 INFO:teuthology.orchestra.run.smithi154.stdout:(11/35): libcephfs-devel-18.2.0-501.gfc1e90a3.e 459 kB/s | 30 kB 00:00 2023-09-30T22:20:44.202 INFO:teuthology.orchestra.run.smithi154.stdout:(12/35): libcephfs2-18.2.0-501.gfc1e90a3.el8.x8 8.2 MB/s | 769 kB 00:00 2023-09-30T22:20:44.279 INFO:teuthology.orchestra.run.smithi154.stdout:(13/35): libcephsqlite-18.2.0-501.gfc1e90a3.el8 1.7 MB/s | 137 kB 00:00 2023-09-30T22:20:44.361 INFO:teuthology.orchestra.run.smithi154.stdout:(14/35): librados-devel-18.2.0-501.gfc1e90a3.el 1.7 MB/s | 139 kB 00:00 2023-09-30T22:20:44.770 INFO:teuthology.orchestra.run.smithi154.stdout:(15/35): ceph-radosgw-18.2.0-501.gfc1e90a3.el8. 11 MB/s | 13 MB 00:01 2023-09-30T22:20:44.828 INFO:teuthology.orchestra.run.smithi154.stdout:(16/35): librados2-18.2.0-501.gfc1e90a3.el8.x86 7.8 MB/s | 3.7 MB 00:00 2023-09-30T22:20:44.854 INFO:teuthology.orchestra.run.smithi154.stdout:(17/35): libradosstriper1-18.2.0-501.gfc1e90a3. 5.6 MB/s | 474 kB 00:00 2023-09-30T22:20:45.179 INFO:teuthology.orchestra.run.smithi154.stdout:(18/35): librbd1-18.2.0-501.gfc1e90a3.el8.x86_6 10 MB/s | 3.6 MB 00:00 2023-09-30T22:20:45.254 INFO:teuthology.orchestra.run.smithi154.stdout:(19/35): python3-ceph-argparse-18.2.0-501.gfc1e 596 kB/s | 45 kB 00:00 2023-09-30T22:20:45.346 INFO:teuthology.orchestra.run.smithi154.stdout:(20/35): python3-ceph-common-18.2.0-501.gfc1e90 1.3 MB/s | 123 kB 00:00 2023-09-30T22:20:45.422 INFO:teuthology.orchestra.run.smithi154.stdout:(21/35): python3-cephfs-18.2.0-501.gfc1e90a3.el 2.5 MB/s | 190 kB 00:00 2023-09-30T22:20:45.497 INFO:teuthology.orchestra.run.smithi154.stdout:(22/35): librgw2-18.2.0-501.gfc1e90a3.el8.x86_6 10 MB/s | 6.5 MB 00:00 2023-09-30T22:20:45.522 INFO:teuthology.orchestra.run.smithi154.stdout:(23/35): python3-rados-18.2.0-501.gfc1e90a3.el8 3.6 MB/s | 371 kB 00:00 2023-09-30T22:20:45.572 INFO:teuthology.orchestra.run.smithi154.stdout:(24/35): python3-rbd-18.2.0-501.gfc1e90a3.el8.x 4.7 MB/s | 364 kB 00:00 2023-09-30T22:20:45.589 INFO:teuthology.orchestra.run.smithi154.stdout:(25/35): python3-rgw-18.2.0-501.gfc1e90a3.el8.x 1.6 MB/s | 107 kB 00:00 2023-09-30T22:20:45.640 INFO:teuthology.orchestra.run.smithi154.stdout:(26/35): rbd-fuse-18.2.0-501.gfc1e90a3.el8.x86_ 1.4 MB/s | 94 kB 00:00 2023-09-30T22:20:45.782 INFO:teuthology.orchestra.run.smithi154.stdout:(27/35): rbd-nbd-18.2.0-501.gfc1e90a3.el8.x86_6 1.2 MB/s | 179 kB 00:00 2023-09-30T22:20:45.899 INFO:teuthology.orchestra.run.smithi154.stdout:(28/35): rbd-mirror-18.2.0-501.gfc1e90a3.el8.x8 11 MB/s | 3.4 MB 00:00 2023-09-30T22:20:45.924 INFO:teuthology.orchestra.run.smithi154.stdout:(29/35): ceph-grafana-dashboards-18.2.0-501.gfc 162 kB/s | 23 kB 00:00 2023-09-30T22:20:46.083 INFO:teuthology.orchestra.run.smithi154.stdout:(30/35): ceph-mgr-dashboard-18.2.0-501.gfc1e90a 9.5 MB/s | 1.7 MB 00:00 2023-09-30T22:20:46.158 INFO:teuthology.orchestra.run.smithi154.stdout:(31/35): ceph-mgr-modules-core-18.2.0-501.gfc1e 3.1 MB/s | 241 kB 00:00 2023-09-30T22:20:46.225 INFO:teuthology.orchestra.run.smithi154.stdout:(32/35): ceph-mgr-rook-18.2.0-501.gfc1e90a3.el8 711 kB/s | 47 kB 00:00 2023-09-30T22:20:46.301 INFO:teuthology.orchestra.run.smithi154.stdout:(33/35): ceph-prometheus-alerts-18.2.0-501.gfc1 194 kB/s | 15 kB 00:00 2023-09-30T22:20:46.893 INFO:teuthology.orchestra.run.smithi154.stdout:(34/35): ceph-mgr-diskprediction-local-18.2.0-5 7.6 MB/s | 7.4 MB 00:00 2023-09-30T22:20:47.609 INFO:teuthology.orchestra.run.smithi154.stdout:(35/35): ceph-test-18.2.0-501.gfc1e90a3.el8.x86 12 MB/s | 47 MB 00:03 2023-09-30T22:20:47.613 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-09-30T22:20:47.613 INFO:teuthology.orchestra.run.smithi154.stdout:Total 22 MB/s | 145 MB 00:06 2023-09-30T22:20:47.614 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-09-30T22:20:47.687 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-09-30T22:20:47.687 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-09-30T22:20:48.356 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-09-30T22:20:48.359 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-09-30T22:20:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-09-30T22:20:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-09-30T22:20:51.387 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-09-30T22:20:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:20:52.028 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:20:52.218 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-09-30T22:20:52.345 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 3/69 2023-09-30T22:20:52.534 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:20:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:20:53.551 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-09-30T22:20:53.655 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 5/69 2023-09-30T22:20:53.872 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-09-30T22:20:54.009 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-09-30T22:20:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 7/69 2023-09-30T22:20:54.301 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:20:54.369 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:20:54.520 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 9/69 2023-09-30T22:20:54.745 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-09-30T22:20:55.004 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 11/69 2023-09-30T22:20:55.232 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-09-30T22:20:55.436 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 13/69 2023-09-30T22:20:55.572 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 14/69 2023-09-30T22:20:55.758 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 15/69 2023-09-30T22:20:55.951 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 16/69 2023-09-30T22:20:58.386 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:20:58.667 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:20:59.297 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 17/69 2023-09-30T22:20:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:20:59.652 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:20:59.866 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-09-30T22:21:17.225 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 19/69 2023-09-30T22:21:17.465 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-09-30T22:21:18.666 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 20/69 2023-09-30T22:21:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-09-30T22:21:18.979 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 21/69 2023-09-30T22:21:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 22/69 2023-09-30T22:21:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-09-30T22:21:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 23/69 2023-09-30T22:21:19.788 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-09-30T22:21:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 24/69 2023-09-30T22:21:20.238 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-09-30T22:21:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 25/69 2023-09-30T22:21:21.005 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:21:22.936 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:21:23.164 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-09-30T22:21:23.175 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 27/69 2023-09-30T22:21:24.666 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-09-30T22:21:24.889 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-09-30T22:21:25.297 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 29/69 2023-09-30T22:21:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:21:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:21:30.866 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 31/69 2023-09-30T22:21:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-09-30T22:21:31.270 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 33/69 2023-09-30T22:21:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-09-30T22:21:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 35/69 2023-09-30T22:21:31.930 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-09-30T22:21:32.171 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-09-30T22:21:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:21:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:21:32.472 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-09-30T22:21:32.621 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-09-30T22:21:32.621 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-09-30T22:21:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-09-30T22:21:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:21:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:21:33.051 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-09-30T22:21:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-09-30T22:21:33.437 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-09-30T22:21:33.444 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:21:33.445 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:21:33.662 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-09-30T22:21:33.854 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-09-30T22:21:33.854 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-09-30T22:21:34.046 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-09-30T22:21:34.204 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-09-30T22:21:34.212 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:21:34.212 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:21:34.603 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-09-30T22:21:34.604 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-09-30T22:21:34.838 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-09-30T22:21:34.844 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:21:34.845 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:21:35.054 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-09-30T22:21:35.060 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:21:35.060 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:21:35.229 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:21:35.229 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-09-30T22:21:35.388 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-09-30T22:21:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:21:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:21:35.707 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:21:35.708 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-09-30T22:21:35.937 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-09-30T22:21:35.937 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:21:36.145 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:21:36.320 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-09-30T22:21:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-09-30T22:21:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-09-30T22:21:36.795 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-09-30T22:21:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-09-30T22:21:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-09-30T22:21:37.254 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-09-30T22:21:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-09-30T22:21:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-09-30T22:21:37.688 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-09-30T22:21:37.853 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-09-30T22:21:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-09-30T22:21:38.186 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-09-30T22:21:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-09-30T22:21:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-09-30T22:21:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-09-30T22:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-09-30T22:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-09-30T22:21:39.364 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-09-30T22:21:39.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-09-30T22:21:39.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2/69 2023-09-30T22:21:39.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-09-30T22:21:39.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 4/69 2023-09-30T22:21:39.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-09-30T22:21:39.364 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 6/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 8/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 10/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 12/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 14/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 16/69 2023-09-30T22:21:39.365 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 18/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 20/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 22/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 24/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 26/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 28/69 2023-09-30T22:21:39.366 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 30/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 32/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 34/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 36/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 38/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x 40/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-09-30T22:21:39.367 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86 42/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 44/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 46/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 48/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 50/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 52/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-09-30T22:21:39.368 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 54/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 56/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8 58/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noar 60/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90 62/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.n 64/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 66/69 2023-09-30T22:21:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-09-30T22:21:39.370 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8. 68/69 2023-09-30T22:21:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-09-30T22:21:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:41.284 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2023-09-30T22:21:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.285 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:18.2.0-501.gfc1e90a3.el8.noarch 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.286 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.287 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:18.2.0-501.gfc1e90a3.el8.x86_64 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:41.288 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-09-30T22:21:41.432 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-09-30T22:21:41.633 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T22:21:41.658 INFO:teuthology.orchestra.run.smithi154.stdout:18.2.0-501.gfc1e90a3.el8 2023-09-30T22:21:41.658 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-501.gfc1e90a3.el8 2023-09-30T22:21:41.658 INFO:teuthology.task.install:The correct ceph version 18.2.0-501.gfc1e90a3 is installed. 2023-09-30T22:21:41.659 INFO:teuthology.run_tasks:Running task print... 2023-09-30T22:21:41.671 INFO:teuthology.task.print:**** done install.upgrade the host 2023-09-30T22:21:41.671 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:21:41.686 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T22:21:41.686 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:21:41.709 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T22:21:41.709 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T22:21:41.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T22:21:41.752 INFO:tasks.ceph.mon.a:Started 2023-09-30T22:21:41.752 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T22:21:41.752 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:21:41.762 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T22:21:41.762 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T22:21:41.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T22:21:41.805 INFO:tasks.ceph.mon.b:Started 2023-09-30T22:21:41.805 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T22:21:41.805 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:21:41.817 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T22:21:41.817 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T22:21:41.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T22:21:41.860 INFO:tasks.ceph.mon.c:Started 2023-09-30T22:21:41.860 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T22:21:41.860 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:21:41.885 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T22:21:41.885 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T22:21:41.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T22:21:41.928 INFO:tasks.ceph.mgr.x:Started 2023-09-30T22:21:41.928 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-09-30T22:21:41.938 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:21:41.938 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:21:41.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:21:42.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.066+0000 7fe178ad6700 1 Processor -- start 2023-09-30T22:21:42.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.066+0000 7fe178ad6700 1 -- start start 2023-09-30T22:21:42.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.066+0000 7fe178ad6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe17406cc70 0x7fe1740a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.066+0000 7fe178ad6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1740a13e0 0x7fe17413f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe178ad6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17409df50 con 0x7fe1740a0fb0 2023-09-30T22:21:42.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe178ad6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17409cf30 con 0x7fe1740a13e0 2023-09-30T22:21:42.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe178ad6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740a24a0 con 0x7fe17406cc70 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe17259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe17406cc70 0x7fe1740a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe172d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1740a13e0 0x7fe17413f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe17259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe17406cc70 0x7fe1740a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52828/0 (socket says 172.21.15.154:52828) 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe172d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1740a13e0 0x7fe17413f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36026/0 (socket says 172.21.15.154:36026) 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe17259c700 1 -- 172.21.15.154:0/3486016361 learned_addr learned my addr 172.21.15.154:0/3486016361 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe17259c700 1 -- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe17406cc70 msgr2=0x7fe1740a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe17259c700 1 -- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe17406cc70 msgr2=0x7fe1740a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe17259c700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe17406cc70 0x7fe1740a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe172d9d700 1 -- 172.21.15.154:0/3486016361 >> v2:172.21.15.154:3300/0 conn(0x7fe1740a13e0 msgr2=0x7fe17413f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T22:21:42.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe172d9d700 1 -- 172.21.15.154:0/3486016361 >> v2:172.21.15.154:3300/0 conn(0x7fe1740a13e0 msgr2=0x7fe17413f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T22:21:42.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe172d9d700 1 --2- 172.21.15.154:0/3486016361 >> v2:172.21.15.154:3300/0 conn(0x7fe1740a13e0 0x7fe17413f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-30T22:21:42.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe17259c700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe17406cc70 0x7fe1740a0a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:21:42.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.067+0000 7fe172d9d700 1 --2- 172.21.15.154:0/3486016361 >> v2:172.21.15.154:3300/0 conn(0x7fe1740a13e0 0x7fe17413f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T22:21:42.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.104+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375757549 0 0) 0x7fe17409df50 con 0x7fe1740a0fb0 2023-09-30T22:21:42.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.104+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe15c0035b0 con 0x7fe1740a0fb0 2023-09-30T22:21:42.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4164287782 0 0) 0x7fe15c0035b0 con 0x7fe1740a0fb0 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe17406cc70 msgr2=0x7fe1740a0a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe17406cc70 0x7fe1740a0a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 >> v2:172.21.15.154:3300/0 conn(0x7fe1740a13e0 msgr2=0x7fe17413f930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 --2- 172.21.15.154:0/3486016361 >> v2:172.21.15.154:3300/0 conn(0x7fe1740a13e0 0x7fe17413f930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17409e1a0 con 0x7fe1740a0fb0 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147001391 0 0) 0x7fe168001670 con 0x7fe1740a0fb0 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 >> v1:172.21.15.154:6789/0 conn(0x7fe1740a0fb0 legacy=0x7fe17413c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c003a70 0x7fe15c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c004850 0x7fe15c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c005250 0x7fe15c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17409cf30 con 0x7fe15c005250 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740a24a0 con 0x7fe15c003a70 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c00c1e0 con 0x7fe15c004850 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe171d9b700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c004850 0x7fe15c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe172d9d700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c005250 0x7fe15c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe171d9b700 1 -- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c003a70 msgr2=0x7fe15c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe171d9b700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c003a70 0x7fe15c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe171d9b700 1 -- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c005250 msgr2=0x7fe15c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe171d9b700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c005250 0x7fe15c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe171d9b700 1 -- 172.21.15.154:0/3486016361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0035b0 con 0x7fe15c004850 2023-09-30T22:21:42.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe172d9d700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c005250 0x7fe15c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.107+0000 7fe171d9b700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c004850 0x7fe15c004cc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe168007f90 tx=0x7fe15c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18898362f5fbfe70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.108+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16800cc10 con 0x7fe15c004850 2023-09-30T22:21:42.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.108+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16800cd70 con 0x7fe15c004850 2023-09-30T22:21:42.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.108+0000 7fe17159a700 1 -- 172.21.15.154:0/3486016361 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168012660 con 0x7fe15c004850 2023-09-30T22:21:42.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.108+0000 7fe178ad6700 1 -- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c004850 msgr2=0x7fe15c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.108+0000 7fe178ad6700 1 --2- 172.21.15.154:0/3486016361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c004850 0x7fe15c004cc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe168007f90 tx=0x7fe15c005880 comp rx=0 tx=0).stop 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.108+0000 7fe172d9d700 1 -- 172.21.15.154:0/3486016361 reap_dead start 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.108+0000 7fe178ad6700 1 -- 172.21.15.154:0/3486016361 shutdown_connections 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.108+0000 7fe178ad6700 1 -- 172.21.15.154:0/3486016361 >> 172.21.15.154:0/3486016361 conn(0x7fe1740a6610 msgr2=0x7fe1740a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.109+0000 7fe178ad6700 1 -- 172.21.15.154:0/3486016361 shutdown_connections 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.109+0000 7fe178ad6700 1 -- 172.21.15.154:0/3486016361 wait complete. 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.110+0000 7fe178ad6700 1 Processor -- start 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.110+0000 7fe178ad6700 1 -- start start 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.110+0000 7fe178ad6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c004850 0x7fe1741cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.110+0000 7fe178ad6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1741ccc70 0x7fe1741cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.110+0000 7fe178ad6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1741bcaf0 0x7fe1741bcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe178ad6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740a00b0 con 0x7fe1741ccc70 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe178ad6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1741cd5a0 con 0x7fe15c004850 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe178ad6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1741a9e60 con 0x7fe1741bcaf0 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe171d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1741ccc70 0x7fe1741cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe172d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1741bcaf0 0x7fe1741bcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe171d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1741ccc70 0x7fe1741cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36056/0 (socket says 172.21.15.154:36056) 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe171d9b700 1 -- 172.21.15.154:0/636691180 learned_addr learned my addr 172.21.15.154:0/636691180 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe171d9b700 1 -- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1741bcaf0 msgr2=0x7fe1741bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe171d9b700 1 --2- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1741bcaf0 0x7fe1741bcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe171d9b700 1 -- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c004850 msgr2=0x7fe1741cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe171d9b700 1 --2- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c004850 0x7fe1741cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe171d9b700 1 -- 172.21.15.154:0/636691180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1741bdc40 con 0x7fe1741ccc70 2023-09-30T22:21:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe172d9d700 1 --2- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1741bcaf0 0x7fe1741bcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe171d9b700 1 --2- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1741ccc70 0x7fe1741cd060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c6a0 tx=0x7fe1740a23f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe162ffd700 1 -- 172.21.15.154:0/636691180 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168007a00 con 0x7fe1741ccc70 2023-09-30T22:21:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe162ffd700 1 -- 172.21.15.154:0/636691180 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe168020070 con 0x7fe1741ccc70 2023-09-30T22:21:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1741ac660 con 0x7fe1741ccc70 2023-09-30T22:21:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe162ffd700 1 -- 172.21.15.154:0/636691180 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168005300 con 0x7fe1741ccc70 2023-09-30T22:21:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.111+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1741ab4e0 con 0x7fe1741ccc70 2023-09-30T22:21:42.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.112+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17404f2a0 con 0x7fe1741ccc70 2023-09-30T22:21:42.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.113+0000 7fe162ffd700 1 -- 172.21.15.154:0/636691180 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe168022030 con 0x7fe1741ccc70 2023-09-30T22:21:42.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.114+0000 7fe162ffd700 1 -- 172.21.15.154:0/636691180 <== mon.0 v2:172.21.15.154:3300/0 5 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fe168043310 con 0x7fe1741ccc70 2023-09-30T22:21:42.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.114+0000 7fe17259c700 1 -- 172.21.15.154:0/636691180 >> v1:172.21.15.154:6816/118163 conn(0x7fe15402bdb0 legacy=0x7fe15402e260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:42.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.114+0000 7fe162ffd700 1 -- 172.21.15.154:0/636691180 <== mon.0 v2:172.21.15.154:3300/0 6 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fe1680483b0 con 0x7fe1741ccc70 2023-09-30T22:21:42.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.122+0000 7fe162ffd700 1 -- 172.21.15.154:0/636691180 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe1680247e0 con 0x7fe1741ccc70 2023-09-30T22:21:42.233 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:42.234+0000 7fcc03fd2240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:21:42.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.315+0000 7fe17259c700 1 -- 172.21.15.154:0/636691180 >> v1:172.21.15.154:6816/118163 conn(0x7fe15402bdb0 legacy=0x7fe15402e260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:42.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.346+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe174072980 con 0x7fe1741ccc70 2023-09-30T22:21:42.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.348+0000 7fe162ffd700 1 -- 172.21.15.154:0/636691180 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64285 (secure 0 0 0) 0x7fe168045bc0 con 0x7fe1741ccc70 2023-09-30T22:21:42.350 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:42.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 >> v1:172.21.15.154:6816/118163 conn(0x7fe15402bdb0 legacy=0x7fe15402e260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:42.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1741ccc70 msgr2=0x7fe1741cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 --2- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1741ccc70 0x7fe1741cd060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c6a0 tx=0x7fe1740a23f0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 shutdown_connections 2023-09-30T22:21:42.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 --2- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1741bcaf0 0x7fe1741bcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 --2- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c004850 0x7fe1741cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 --2- 172.21.15.154:0/636691180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1741ccc70 0x7fe1741cd060 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 >> 172.21.15.154:0/636691180 conn(0x7fe1740a6610 msgr2=0x7fe1740a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 shutdown_connections 2023-09-30T22:21:42.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.350+0000 7fe178ad6700 1 -- 172.21.15.154:0/636691180 wait complete. 2023-09-30T22:21:42.369 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6816","nonce":118163}]},"active_addr":"172.21.15.154:6816/118163","active_change":"2023-09-30T22:19:23.208349+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":956756939}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2017971531}]}]} 2023-09-30T22:21:42.372 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:21:42.372 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:21:42.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:21:42.393 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:42.390+0000 7fcc03fd2240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:21:42.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.506+0000 7fe50f71e700 1 Processor -- start 2023-09-30T22:21:42.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.507+0000 7fe50f71e700 1 -- start start 2023-09-30T22:21:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.507+0000 7fe50f71e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe50809d860 0x7fe50809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.507+0000 7fe50f71e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe508130eb0 0x7fe508138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.507+0000 7fe50f71e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50809aaa0 con 0x7fe50809e170 2023-09-30T22:21:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.507+0000 7fe50f71e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50809f870 con 0x7fe508130eb0 2023-09-30T22:21:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.507+0000 7fe50f71e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe50809b360 con 0x7fe50809d860 2023-09-30T22:21:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50dcbb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe508130eb0 0x7fe508138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50dcbb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe508130eb0 0x7fe508138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51206/0 (socket says 172.21.15.154:51206) 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50ccb9700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe50809e170 0x7fe5081307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57530/0 (socket says 172.21.15.154:57530) 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50dcbb700 1 -- 172.21.15.154:0/3832835308 learned_addr learned my addr 172.21.15.154:0/3832835308 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50d4ba700 1 --2- 172.21.15.154:0/3832835308 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe50809d860 0x7fe50809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50dcbb700 1 -- 172.21.15.154:0/3832835308 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe50809d860 msgr2=0x7fe50809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe4fffff700 1 -- 172.21.15.154:0/3832835308 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161295142 0 0) 0x7fe50809aaa0 con 0x7fe50809e170 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50dcbb700 1 --2- 172.21.15.154:0/3832835308 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe50809d860 0x7fe50809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50dcbb700 1 -- 172.21.15.154:0/3832835308 >> v1:172.21.15.154:6789/0 conn(0x7fe50809e170 legacy=0x7fe5081307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50dcbb700 1 -- 172.21.15.154:0/3832835308 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50809b620 con 0x7fe508130eb0 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50d4ba700 1 --2- 172.21.15.154:0/3832835308 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe50809d860 0x7fe50809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe50dcbb700 1 --2- 172.21.15.154:0/3832835308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe508130eb0 0x7fe508138a00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe500009e80 tx=0x7fe50000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd9252e14cf0e61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe4fffff700 1 -- 172.21.15.154:0/3832835308 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000e070 con 0x7fe508130eb0 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe4fffff700 1 -- 172.21.15.154:0/3832835308 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50000b910 con 0x7fe508130eb0 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.508+0000 7fe4fffff700 1 -- 172.21.15.154:0/3832835308 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000bcc0 con 0x7fe508130eb0 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.509+0000 7fe50f71e700 1 -- 172.21.15.154:0/3832835308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe508130eb0 msgr2=0x7fe508138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.509+0000 7fe50f71e700 1 --2- 172.21.15.154:0/3832835308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe508130eb0 0x7fe508138a00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe500009e80 tx=0x7fe50000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.509+0000 7fe50f71e700 1 -- 172.21.15.154:0/3832835308 shutdown_connections 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.509+0000 7fe50f71e700 1 --2- 172.21.15.154:0/3832835308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe508130eb0 0x7fe508138a00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.509+0000 7fe50f71e700 1 --2- 172.21.15.154:0/3832835308 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe50809d860 0x7fe50809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.509+0000 7fe50f71e700 1 -- 172.21.15.154:0/3832835308 >> 172.21.15.154:0/3832835308 conn(0x7fe508099c40 msgr2=0x7fe5080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.509+0000 7fe50f71e700 1 -- 172.21.15.154:0/3832835308 shutdown_connections 2023-09-30T22:21:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.509+0000 7fe50f71e700 1 -- 172.21.15.154:0/3832835308 wait complete. 2023-09-30T22:21:42.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.510+0000 7fe50f71e700 1 Processor -- start 2023-09-30T22:21:42.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.510+0000 7fe50f71e700 1 -- start start 2023-09-30T22:21:42.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50f71e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe50809d860 0x7fe50811f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50f71e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50809e170 0x7fe50811fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50f71e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe508130eb0 0x7fe508120060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50f71e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508121300 con 0x7fe50809d860 2023-09-30T22:21:42.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50f71e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe508122e20 con 0x7fe50809e170 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50f71e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe508121a10 con 0x7fe508130eb0 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50d4ba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe50809d860 0x7fe50811f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50d4ba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe50809d860 0x7fe50811f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36058/0 (socket says 172.21.15.154:36058) 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50d4ba700 1 -- 172.21.15.154:0/2113344011 learned_addr learned my addr 172.21.15.154:0/2113344011 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50dcbb700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe508130eb0 0x7fe508120060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.511+0000 7fe50ccb9700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50809e170 0x7fe50811fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe50d4ba700 1 -- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe508130eb0 msgr2=0x7fe508120060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe50d4ba700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe508130eb0 0x7fe508120060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe50d4ba700 1 -- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50809e170 msgr2=0x7fe50811fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe50d4ba700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50809e170 0x7fe50811fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe50d4ba700 1 -- 172.21.15.154:0/2113344011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5040094a0 con 0x7fe50809d860 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe50dcbb700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe508130eb0 0x7fe508120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe50d4ba700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe50809d860 0x7fe50811f5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe504010df0 tx=0x7fe50400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe4fdffb700 1 -- 172.21.15.154:0/2113344011 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50400cb90 con 0x7fe50809d860 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe4fdffb700 1 -- 172.21.15.154:0/2113344011 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50400ccf0 con 0x7fe50809d860 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe500009b30 con 0x7fe50809d860 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe4fdffb700 1 -- 172.21.15.154:0/2113344011 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504011650 con 0x7fe50809d860 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.512+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe508130100 con 0x7fe50809d860 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.513+0000 7fe4fdffb700 1 -- 172.21.15.154:0/2113344011 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fe5040117b0 con 0x7fe50809d860 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.513+0000 7fe50ccb9700 1 -- 172.21.15.154:0/2113344011 >> v1:172.21.15.154:6816/118163 conn(0x7fe4ec02c1b0 legacy=0x7fe4ec02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.513+0000 7fe4fdffb700 1 -- 172.21.15.154:0/2113344011 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fe50403da80 con 0x7fe50809d860 2023-09-30T22:21:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.513+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50804f2a0 con 0x7fe50809d860 2023-09-30T22:21:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.517+0000 7fe4fdffb700 1 -- 172.21.15.154:0/2113344011 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe50401e080 con 0x7fe50809d860 2023-09-30T22:21:42.658 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:42.658+0000 7fcc03fd2240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:21:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.690+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5080a0850 con 0x7fe50809d860 2023-09-30T22:21:42.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.691+0000 7fe4fdffb700 1 -- 172.21.15.154:0/2113344011 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12720 (secure 0 0 0) 0x7fe504018990 con 0x7fe50809d860 2023-09-30T22:21:42.691 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:42.691 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:20:24.838780+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:21:42.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.693+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 >> v1:172.21.15.154:6816/118163 conn(0x7fe4ec02c1b0 legacy=0x7fe4ec02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:42.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.693+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe50809d860 msgr2=0x7fe50811f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.693+0000 7fe50f71e700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe50809d860 0x7fe50811f5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe504010df0 tx=0x7fe50400c430 comp rx=0 tx=0).stop 2023-09-30T22:21:42.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.693+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 shutdown_connections 2023-09-30T22:21:42.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.693+0000 7fe50f71e700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe508130eb0 0x7fe508120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.693+0000 7fe50f71e700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe50809d860 0x7fe50811f5e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.693+0000 7fe50f71e700 1 --2- 172.21.15.154:0/2113344011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50809e170 0x7fe50811fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.693+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 >> 172.21.15.154:0/2113344011 conn(0x7fe508099c40 msgr2=0x7fe508119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.694+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 shutdown_connections 2023-09-30T22:21:42.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.694+0000 7fe50f71e700 1 -- 172.21.15.154:0/2113344011 wait complete. 2023-09-30T22:21:42.707 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:21:42.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:21:42.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21da797700 1 Processor -- start 2023-09-30T22:21:42.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21da797700 1 -- start start 2023-09-30T22:21:42.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21da797700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d409e870 0x7f21d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21da797700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21da797700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21d4131d70 0x7f21d4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21da797700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d40a0920 con 0x7f21d4131d70 2023-09-30T22:21:42.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21da797700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d409c970 con 0x7f21d409f180 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21da797700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21d409bab0 con 0x7f21d409e870 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d409e870 0x7f21d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21d3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d409e870 0x7f21d409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52898/0 (socket says 172.21.15.154:52898) 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21d8d34700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21d4131d70 0x7f21d4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21d3fff700 1 -- 172.21.15.154:0/1500899013 learned_addr learned my addr 172.21.15.154:0/1500899013 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.875+0000 7f21d37fe700 1 --2- 172.21.15.154:0/1500899013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d37fe700 1 -- 172.21.15.154:0/1500899013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d409e870 msgr2=0x7f21d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d37fe700 1 --2- 172.21.15.154:0/1500899013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d409e870 0x7f21d409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d37fe700 1 -- 172.21.15.154:0/1500899013 >> v2:172.21.15.154:3300/0 conn(0x7f21d4131d70 msgr2=0x7f21d4132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d37fe700 1 --2- 172.21.15.154:0/1500899013 >> v2:172.21.15.154:3300/0 conn(0x7f21d4131d70 0x7f21d4132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d37fe700 1 -- 172.21.15.154:0/1500899013 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d409f9c0 con 0x7f21d409f180 2023-09-30T22:21:42.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d3fff700 1 --2- 172.21.15.154:0/1500899013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d409e870 0x7f21d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d8d34700 1 --2- 172.21.15.154:0/1500899013 >> v2:172.21.15.154:3300/0 conn(0x7f21d4131d70 0x7f21d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d37fe700 1 --2- 172.21.15.154:0/1500899013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d4131830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009840 tx=0x7f21c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36976d3a44ab3db5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d2ffd700 1 -- 172.21.15.154:0/1500899013 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8011830 con 0x7f21d409f180 2023-09-30T22:21:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d2ffd700 1 -- 172.21.15.154:0/1500899013 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c8011990 con 0x7f21d409f180 2023-09-30T22:21:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.876+0000 7f21d2ffd700 1 -- 172.21.15.154:0/1500899013 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8011d20 con 0x7f21d409f180 2023-09-30T22:21:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.877+0000 7f21da797700 1 -- 172.21.15.154:0/1500899013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 msgr2=0x7f21d4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.877+0000 7f21da797700 1 --2- 172.21.15.154:0/1500899013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d4131830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009840 tx=0x7f21c8009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.877+0000 7f21da797700 1 -- 172.21.15.154:0/1500899013 shutdown_connections 2023-09-30T22:21:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.877+0000 7f21da797700 1 --2- 172.21.15.154:0/1500899013 >> v2:172.21.15.154:3300/0 conn(0x7f21d4131d70 0x7f21d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.877+0000 7f21da797700 1 --2- 172.21.15.154:0/1500899013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d409e870 0x7f21d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.877+0000 7f21da797700 1 --2- 172.21.15.154:0/1500899013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d4131830 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.877+0000 7f21da797700 1 -- 172.21.15.154:0/1500899013 >> 172.21.15.154:0/1500899013 conn(0x7f21d40a4430 msgr2=0x7f21d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.877+0000 7f21da797700 1 -- 172.21.15.154:0/1500899013 shutdown_connections 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.877+0000 7f21da797700 1 -- 172.21.15.154:0/1500899013 wait complete. 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21da797700 1 Processor -- start 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21da797700 1 -- start start 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21da797700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d409e870 0x7f21d411d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21da797700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d411d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21da797700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d4131d70 0x7f21d41c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21da797700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4131310 con 0x7f21d409e870 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21da797700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d411ce40 con 0x7f21d409f180 2023-09-30T22:21:42.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21da797700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21d41201c0 con 0x7f21d4131d70 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21d37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d411d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21d8d34700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d4131d70 0x7f21d41c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21d37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d411d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51238/0 (socket says 172.21.15.154:51238) 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21d37fe700 1 -- 172.21.15.154:0/1997636208 learned_addr learned my addr 172.21.15.154:0/1997636208 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.878+0000 7f21d3fff700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d409e870 0x7f21d411d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d37fe700 1 -- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d4131d70 msgr2=0x7f21d41c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d37fe700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d4131d70 0x7f21d41c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d37fe700 1 -- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d409e870 msgr2=0x7f21d411d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d37fe700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d409e870 0x7f21d411d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d37fe700 1 -- 172.21.15.154:0/1997636208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4009550 con 0x7f21d409f180 2023-09-30T22:21:42.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d3fff700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d409e870 0x7f21d411d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:21:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d8d34700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d4131d70 0x7f21d41c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d37fe700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d411d820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21c80090b0 tx=0x7f21c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d0ff9700 1 -- 172.21.15.154:0/1997636208 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80044d0 con 0x7f21d409f180 2023-09-30T22:21:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d0ff9700 1 -- 172.21.15.154:0/1997636208 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c801f070 con 0x7f21d409f180 2023-09-30T22:21:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc009a70 con 0x7f21d409f180 2023-09-30T22:21:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21d0ff9700 1 -- 172.21.15.154:0/1997636208 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80038e0 con 0x7f21d409f180 2023-09-30T22:21:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.879+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c80094a0 con 0x7f21d409f180 2023-09-30T22:21:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.880+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d404f2a0 con 0x7f21d409f180 2023-09-30T22:21:42.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.880+0000 7f21d0ff9700 1 -- 172.21.15.154:0/1997636208 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f21c8003a40 con 0x7f21d409f180 2023-09-30T22:21:42.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.880+0000 7f21d0ff9700 1 -- 172.21.15.154:0/1997636208 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f21c8021070 con 0x7f21d409f180 2023-09-30T22:21:42.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.880+0000 7f21d3fff700 1 -- 172.21.15.154:0/1997636208 >> v1:172.21.15.154:6816/118163 conn(0x7f21c002c1b0 legacy=0x7f21c002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:42.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:42.884+0000 7f21d0ff9700 1 -- 172.21.15.154:0/1997636208 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f21c8026480 con 0x7f21d409f180 2023-09-30T22:21:43.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.054+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21d409f660 con 0x7f21d409f180 2023-09-30T22:21:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.055+0000 7f21d0ff9700 1 -- 172.21.15.154:0/1997636208 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12720 (secure 0 0 0) 0x7f21c802b020 con 0x7f21d409f180 2023-09-30T22:21:43.055 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:43.055 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:20:24.838780+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:21:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 >> v1:172.21.15.154:6816/118163 conn(0x7f21c002c1b0 legacy=0x7f21c002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 msgr2=0x7f21d411d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d411d820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21c80090b0 tx=0x7f21c8004750 comp rx=0 tx=0).stop 2023-09-30T22:21:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 shutdown_connections 2023-09-30T22:21:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21d4131d70 0x7f21d41c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d409e870 0x7f21d411d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 --2- 172.21.15.154:0/1997636208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d409f180 0x7f21d411d820 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 >> 172.21.15.154:0/1997636208 conn(0x7f21d40a4430 msgr2=0x7f21d41b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 shutdown_connections 2023-09-30T22:21:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.057+0000 7f21da797700 1 -- 172.21.15.154:0/1997636208 wait complete. 2023-09-30T22:21:43.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:21:43.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:21:43.072 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:21:43.072 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:21:43.189 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:43.190+0000 7fcc03fd2240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:21:43.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.209+0000 7f0758440700 1 Processor -- start 2023-09-30T22:21:43.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.209+0000 7f0758440700 1 -- start start 2023-09-30T22:21:43.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f0758440700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0750133ad0 0x7f0750133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f0758440700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07501300a0 0x7f07501304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f0758440700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07501309f0 0x7f075013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f0758440700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075006b2d0 con 0x7f07501300a0 2023-09-30T22:21:43.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f0758440700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0750133610 con 0x7f07501309f0 2023-09-30T22:21:43.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f0758440700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f075009a500 con 0x7f0750133ad0 2023-09-30T22:21:43.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f07569dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07501309f0 0x7f075013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f07569dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07501309f0 0x7f075013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51252/0 (socket says 172.21.15.154:51252) 2023-09-30T22:21:43.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f07569dd700 1 -- 172.21.15.154:0/896553645 learned_addr learned my addr 172.21.15.154:0/896553645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f5457154700 1 Processor -- start 2023-09-30T22:21:43.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f5457154700 1 -- start start 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f07569dd700 1 -- 172.21.15.154:0/896553645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0750133ad0 msgr2=0x7f0750133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f07569dd700 1 --2- 172.21.15.154:0/896553645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0750133ad0 0x7f0750133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f07569dd700 1 -- 172.21.15.154:0/896553645 >> v2:172.21.15.154:3300/0 conn(0x7f07501300a0 msgr2=0x7f07501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f07569dd700 1 --2- 172.21.15.154:0/896553645 >> v2:172.21.15.154:3300/0 conn(0x7f07501300a0 0x7f07501304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.210+0000 7f07569dd700 1 -- 172.21.15.154:0/896553645 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07501338b0 con 0x7f07501309f0 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f07569dd700 1 --2- 172.21.15.154:0/896553645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07501309f0 0x7f075013a980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0748009e50 tx=0x7f074800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=340d07a936b0ac30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f07551da700 1 -- 172.21.15.154:0/896553645 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800e070 con 0x7f07501309f0 2023-09-30T22:21:43.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f5457154700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5450133ad0 0x7f5450133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f5457154700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5450130bc0 0x7f545013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f5457154700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545006b2d0 con 0x7f54501300a0 2023-09-30T22:21:43.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f5457154700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5450133610 con 0x7f5450130bc0 2023-09-30T22:21:43.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f5457154700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f545009a500 con 0x7f5450133ad0 2023-09-30T22:21:43.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f54556f1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5450130bc0 0x7f545013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f54556f1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5450130bc0 0x7f545013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36074/0 (socket says 172.21.15.154:36074) 2023-09-30T22:21:43.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f54556f1700 1 -- 172.21.15.154:0/3778631296 learned_addr learned my addr 172.21.15.154:0/3778631296 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f5454ef0700 1 --2- 172.21.15.154:0/3778631296 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5450133ad0 0x7f5450133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f5454ef0700 1 -- 172.21.15.154:0/3778631296 >> v2:172.21.15.154:3300/0 conn(0x7f5450130bc0 msgr2=0x7f545013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f5454ef0700 1 --2- 172.21.15.154:0/3778631296 >> v2:172.21.15.154:3300/0 conn(0x7f5450130bc0 0x7f545013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f5454ef0700 1 -- 172.21.15.154:0/3778631296 >> v1:172.21.15.154:6789/0 conn(0x7f54501300a0 legacy=0x7f54501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f5454ef0700 1 -- 172.21.15.154:0/3778631296 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54501338b0 con 0x7f5450133ad0 2023-09-30T22:21:43.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f5454ef0700 1 --2- 172.21.15.154:0/3778631296 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5450133ad0 0x7f5450133ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5444009840 tx=0x7f5444009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d95e7ce5af3d3bf1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f07551da700 1 -- 172.21.15.154:0/896553645 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074800b9c0 con 0x7f07501309f0 2023-09-30T22:21:43.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.211+0000 7f07551da700 1 -- 172.21.15.154:0/896553645 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800bd70 con 0x7f07501309f0 2023-09-30T22:21:43.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f0758440700 1 -- 172.21.15.154:0/896553645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07501309f0 msgr2=0x7f075013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f0758440700 1 --2- 172.21.15.154:0/896553645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07501309f0 0x7f075013a980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0748009e50 tx=0x7f074800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:43.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f0758440700 1 -- 172.21.15.154:0/896553645 shutdown_connections 2023-09-30T22:21:43.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f0758440700 1 --2- 172.21.15.154:0/896553645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07501309f0 0x7f075013a980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f0758440700 1 --2- 172.21.15.154:0/896553645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0750133ad0 0x7f0750133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f0758440700 1 --2- 172.21.15.154:0/896553645 >> v2:172.21.15.154:3300/0 conn(0x7f07501300a0 0x7f07501304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f0758440700 1 -- 172.21.15.154:0/896553645 >> 172.21.15.154:0/896553645 conn(0x7f0750099c40 msgr2=0x7f07500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f0758440700 1 -- 172.21.15.154:0/896553645 shutdown_connections 2023-09-30T22:21:43.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.212+0000 7f0758440700 1 -- 172.21.15.154:0/896553645 wait complete. 2023-09-30T22:21:43.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.213+0000 7f544f7fe700 1 -- 172.21.15.154:0/3778631296 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444004230 con 0x7f5450133ad0 2023-09-30T22:21:43.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.213+0000 7f0758440700 1 Processor -- start 2023-09-30T22:21:43.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.213+0000 7f544f7fe700 1 -- 172.21.15.154:0/3778631296 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5444004390 con 0x7f5450133ad0 2023-09-30T22:21:43.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.213+0000 7f544f7fe700 1 -- 172.21.15.154:0/3778631296 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54440036a0 con 0x7f5450133ad0 2023-09-30T22:21:43.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.213+0000 7f5457154700 1 -- 172.21.15.154:0/3778631296 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5450133ad0 msgr2=0x7f5450133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.213+0000 7f5457154700 1 --2- 172.21.15.154:0/3778631296 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5450133ad0 0x7f5450133ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5444009840 tx=0x7f5444009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:43.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.213+0000 7f0758440700 1 -- start start 2023-09-30T22:21:43.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f0758440700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07501300a0 0x7f075011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f0758440700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07501309f0 0x7f075011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f0758440700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750133ad0 0x7f075011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f0758440700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075011ed90 con 0x7f07501300a0 2023-09-30T22:21:43.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f0758440700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500724c0 con 0x7f0750133ad0 2023-09-30T22:21:43.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f0758440700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f075012f800 con 0x7f07501309f0 2023-09-30T22:21:43.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f5457154700 1 -- 172.21.15.154:0/3778631296 shutdown_connections 2023-09-30T22:21:43.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f5457154700 1 --2- 172.21.15.154:0/3778631296 >> v2:172.21.15.154:3300/0 conn(0x7f5450130bc0 0x7f545013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f5457154700 1 --2- 172.21.15.154:0/3778631296 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5450133ad0 0x7f5450133ea0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5444009840 tx=0x7f5444009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:43.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f5457154700 1 -- 172.21.15.154:0/3778631296 >> 172.21.15.154:0/3778631296 conn(0x7f5450099c40 msgr2=0x7f54500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07569dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750133ad0 0x7f075011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07569dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750133ad0 0x7f075011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51254/0 (socket says 172.21.15.154:51254) 2023-09-30T22:21:43.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07569dd700 1 -- 172.21.15.154:0/1086882679 learned_addr learned my addr 172.21.15.154:0/1086882679 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07561dc700 1 --2- 172.21.15.154:0/1086882679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07501300a0 0x7f075011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07569dd700 1 -- 172.21.15.154:0/1086882679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07501309f0 msgr2=0x7f075011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07569dd700 1 --2- 172.21.15.154:0/1086882679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07501309f0 0x7f075011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07569dd700 1 -- 172.21.15.154:0/1086882679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07501300a0 msgr2=0x7f075011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07569dd700 1 --2- 172.21.15.154:0/1086882679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07501300a0 0x7f075011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07569dd700 1 -- 172.21.15.154:0/1086882679 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748009b30 con 0x7f0750133ad0 2023-09-30T22:21:43.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.214+0000 7f07569dd700 1 --2- 172.21.15.154:0/1086882679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750133ad0 0x7f075011e4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0750133750 tx=0x7f0748004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.215+0000 7f5457154700 1 -- 172.21.15.154:0/3778631296 shutdown_connections 2023-09-30T22:21:43.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.215+0000 7f0746ffd700 1 -- 172.21.15.154:0/1086882679 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480042d0 con 0x7f0750133ad0 2023-09-30T22:21:43.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.215+0000 7f0746ffd700 1 -- 172.21.15.154:0/1086882679 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748004490 con 0x7f0750133ad0 2023-09-30T22:21:43.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.215+0000 7f0746ffd700 1 -- 172.21.15.154:0/1086882679 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748004840 con 0x7f0750133ad0 2023-09-30T22:21:43.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.215+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075012d890 con 0x7f0750133ad0 2023-09-30T22:21:43.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.215+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0750071910 con 0x7f0750133ad0 2023-09-30T22:21:43.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.215+0000 7f5457154700 1 -- 172.21.15.154:0/3778631296 wait complete. 2023-09-30T22:21:43.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f5457154700 1 Processor -- start 2023-09-30T22:21:43.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f5457154700 1 -- start start 2023-09-30T22:21:43.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f5457154700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54501300a0 0x7f545011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f5457154700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5450130bc0 0x7f545011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f5457154700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f545011e4c0 0x7f54501c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f5457154700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5450120320 con 0x7f5450130bc0 2023-09-30T22:21:43.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f5457154700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5450120e90 con 0x7f54501300a0 2023-09-30T22:21:43.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f5457154700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5450072590 con 0x7f545011e4c0 2023-09-30T22:21:43.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f5454ef0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54501300a0 0x7f545011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f5454ef0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54501300a0 0x7f545011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51270/0 (socket says 172.21.15.154:51270) 2023-09-30T22:21:43.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f5454ef0700 1 -- 172.21.15.154:0/823887399 learned_addr learned my addr 172.21.15.154:0/823887399 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0750130e90 con 0x7f0750133ad0 2023-09-30T22:21:43.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.216+0000 7f0746ffd700 1 -- 172.21.15.154:0/1086882679 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f074801c440 con 0x7f0750133ad0 2023-09-30T22:21:43.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f0746ffd700 1 -- 172.21.15.154:0/1086882679 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f074803ced0 con 0x7f0750133ad0 2023-09-30T22:21:43.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f07561dc700 1 -- 172.21.15.154:0/1086882679 >> v1:172.21.15.154:6816/118163 conn(0x7f073402c1b0 legacy=0x7f073402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f54556f1700 1 --2- 172.21.15.154:0/823887399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f545011e4c0 0x7f54501c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f544ffff700 1 --2- 172.21.15.154:0/823887399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5450130bc0 0x7f545011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f0746ffd700 1 -- 172.21.15.154:0/1086882679 --> v1:172.21.15.154:6800/118761 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0734038e10 con 0x7f0734035110 2023-09-30T22:21:43.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f0746ffd700 1 -- 172.21.15.154:0/1086882679 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f074801c6f0 con 0x7f0750133ad0 2023-09-30T22:21:43.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f5454ef0700 1 -- 172.21.15.154:0/823887399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f545011e4c0 msgr2=0x7f54501c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f5454ef0700 1 --2- 172.21.15.154:0/823887399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f545011e4c0 0x7f54501c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f5454ef0700 1 -- 172.21.15.154:0/823887399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5450130bc0 msgr2=0x7f545011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f5454ef0700 1 --2- 172.21.15.154:0/823887399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5450130bc0 0x7f545011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f5454ef0700 1 -- 172.21.15.154:0/823887399 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54440094a0 con 0x7f54501300a0 2023-09-30T22:21:43.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f5454ef0700 1 --2- 172.21.15.154:0/823887399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54501300a0 0x7f545011da40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f54440090b0 tx=0x7f5444004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.217+0000 7f544d7fa700 1 -- 172.21.15.154:0/823887399 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444003e30 con 0x7f54501300a0 2023-09-30T22:21:43.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.218+0000 7f544d7fa700 1 -- 172.21.15.154:0/823887399 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5444011630 con 0x7f54501300a0 2023-09-30T22:21:43.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.218+0000 7f544d7fa700 1 -- 172.21.15.154:0/823887399 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54440119a0 con 0x7f54501300a0 2023-09-30T22:21:43.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.218+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54500a1850 con 0x7f54501300a0 2023-09-30T22:21:43.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.219+0000 7f0746ffd700 1 -- 172.21.15.154:0/1086882679 <== osd.0 v1:172.21.15.154:6800/118761 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f0734038e10 con 0x7f0734035110 2023-09-30T22:21:43.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.219+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545012d950 con 0x7f54501300a0 2023-09-30T22:21:43.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.220+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f545006a9e0 con 0x7f54501300a0 2023-09-30T22:21:43.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.225+0000 7f544d7fa700 1 -- 172.21.15.154:0/823887399 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f5444018040 con 0x7f54501300a0 2023-09-30T22:21:43.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.225+0000 7f544d7fa700 1 -- 172.21.15.154:0/823887399 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f544403bf80 con 0x7f54501300a0 2023-09-30T22:21:43.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.225+0000 7f544ffff700 1 -- 172.21.15.154:0/823887399 >> v1:172.21.15.154:6816/118163 conn(0x7f543c02c230 legacy=0x7f543c02e6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.225+0000 7f544d7fa700 1 -- 172.21.15.154:0/823887399 --> v1:172.21.15.154:6804/118762 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f543c038f10 con 0x7f543c035210 2023-09-30T22:21:43.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.225+0000 7f544d7fa700 1 -- 172.21.15.154:0/823887399 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f544403e460 con 0x7f54501300a0 2023-09-30T22:21:43.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.230+0000 7f544d7fa700 1 -- 172.21.15.154:0/823887399 <== osd.1 v1:172.21.15.154:6804/118762 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f543c038f10 con 0x7f543c035210 2023-09-30T22:21:43.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.235+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 --> v1:172.21.15.154:6800/118761 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f07501329b0 con 0x7f0734035110 2023-09-30T22:21:43.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.235+0000 7f0746ffd700 1 -- 172.21.15.154:0/1086882679 <== osd.0 v1:172.21.15.154:6800/118761 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2765323947) 0x7f07501329b0 con 0x7f0734035110 2023-09-30T22:21:43.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.235+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 >> v1:172.21.15.154:6800/118761 conn(0x7f0734035110 legacy=0x7f07340375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.235+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 >> v1:172.21.15.154:6816/118163 conn(0x7f073402c1b0 legacy=0x7f073402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:43.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.235+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750133ad0 msgr2=0x7f075011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.235+0000 7f0758440700 1 --2- 172.21.15.154:0/1086882679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750133ad0 0x7f075011e4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0750133750 tx=0x7f0748004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.235+0000 7f07569dd700 1 -- 172.21.15.154:0/1086882679 reap_dead start 2023-09-30T22:21:43.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.236+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 shutdown_connections 2023-09-30T22:21:43.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.236+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 >> 172.21.15.154:0/1086882679 conn(0x7f0750099c40 msgr2=0x7f0750132060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.236+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 shutdown_connections 2023-09-30T22:21:43.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.236+0000 7f0758440700 1 -- 172.21.15.154:0/1086882679 wait complete. 2023-09-30T22:21:43.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.246+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 --> v1:172.21.15.154:6804/118762 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f545009ea90 con 0x7f543c035210 2023-09-30T22:21:43.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.247+0000 7f544d7fa700 1 -- 172.21.15.154:0/823887399 <== osd.1 v1:172.21.15.154:6804/118762 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1880693312) 0x7f5448009e90 con 0x7f543c035210 2023-09-30T22:21:43.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.247+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 >> v1:172.21.15.154:6804/118762 conn(0x7f543c035210 legacy=0x7f543c0376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.247+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 >> v1:172.21.15.154:6816/118163 conn(0x7f543c02c230 legacy=0x7f543c02e6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:43.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.247+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54501300a0 msgr2=0x7f545011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.247+0000 7f5457154700 1 --2- 172.21.15.154:0/823887399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54501300a0 0x7f545011da40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f54440090b0 tx=0x7f5444004750 comp rx=0 tx=0).stop 2023-09-30T22:21:43.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.247+0000 7f54556f1700 1 -- 172.21.15.154:0/823887399 reap_dead start 2023-09-30T22:21:43.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.248+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 shutdown_connections 2023-09-30T22:21:43.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.248+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 >> 172.21.15.154:0/823887399 conn(0x7f5450099c40 msgr2=0x7f5450131740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.248+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 shutdown_connections 2023-09-30T22:21:43.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.248+0000 7f5457154700 1 -- 172.21.15.154:0/823887399 wait complete. 2023-09-30T22:21:43.250 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:43.250 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:43.262 INFO:teuthology.orchestra.run.smithi154.stdout:38654705694 2023-09-30T22:21:43.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:43.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.269+0000 7f6b18ca3700 1 Processor -- start 2023-09-30T22:21:43.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.269+0000 7f6b18ca3700 1 -- start start 2023-09-30T22:21:43.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.269+0000 7f6b18ca3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b14099e20 0x7f6b1409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f200ad56700 1 Processor -- start 2023-09-30T22:21:43.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b18ca3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b14138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b18ca3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b14099a60 con 0x7f6b1409a730 2023-09-30T22:21:43.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b18ca3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1409bf50 con 0x7f6b14099e20 2023-09-30T22:21:43.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b18ca3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1409b230 con 0x7f6b14130a60 2023-09-30T22:21:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b1259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b14099e20 0x7f6b1409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b11d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6b1409a730 0x7f6b14130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57548/0 (socket says 172.21.15.154:57548) 2023-09-30T22:21:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b11d9b700 1 -- 172.21.15.154:0/424367978 learned_addr learned my addr 172.21.15.154:0/424367978 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b12d9d700 1 --2- 172.21.15.154:0/424367978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b14138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b1159a700 1 -- 172.21.15.154:0/424367978 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404391149 0 0) 0x7f6b14099a60 con 0x7f6b1409a730 2023-09-30T22:21:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b1159a700 1 -- 172.21.15.154:0/424367978 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6afc0035b0 con 0x7f6b1409a730 2023-09-30T22:21:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b12d9d700 1 -- 172.21.15.154:0/424367978 >> v2:172.21.15.154:3300/0 conn(0x7f6b14099e20 msgr2=0x7f6b1409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b12d9d700 1 --2- 172.21.15.154:0/424367978 >> v2:172.21.15.154:3300/0 conn(0x7f6b14099e20 0x7f6b1409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b12d9d700 1 -- 172.21.15.154:0/424367978 >> v1:172.21.15.154:6789/0 conn(0x7f6b1409a730 legacy=0x7f6b14130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f6b12d9d700 1 -- 172.21.15.154:0/424367978 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1409bb90 con 0x7f6b14130a60 2023-09-30T22:21:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.270+0000 7f200ad56700 1 -- start start 2023-09-30T22:21:43.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f6b12d9d700 1 --2- 172.21.15.154:0/424367978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b14138690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009d90 tx=0x7f6b0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d12734bb05545615 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f200ad56700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2004138040 0x7f2004138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f200ad56700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20040a1400 0x7f200413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f200ad56700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20041379e0 con 0x7f20040a08e0 2023-09-30T22:21:43.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f200ad56700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20040a2100 con 0x7f20040a1400 2023-09-30T22:21:43.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f200ad56700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2004138950 con 0x7f2004138040 2023-09-30T22:21:43.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f6b1159a700 1 -- 172.21.15.154:0/424367978 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c00e070 con 0x7f6b14130a60 2023-09-30T22:21:43.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f6b1159a700 1 -- 172.21.15.154:0/424367978 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c00bb20 con 0x7f6b14130a60 2023-09-30T22:21:43.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f6b1159a700 1 -- 172.21.15.154:0/424367978 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c012430 con 0x7f6b14130a60 2023-09-30T22:21:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f20092f3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20040a1400 0x7f200413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f2003fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f20040a08e0 0x7f20040a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57558/0 (socket says 172.21.15.154:57558) 2023-09-30T22:21:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f20092f3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20040a1400 0x7f200413fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36120/0 (socket says 172.21.15.154:36120) 2023-09-30T22:21:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f2003fff700 1 -- 172.21.15.154:0/3933843251 learned_addr learned my addr 172.21.15.154:0/3933843251 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.271+0000 7f2008af2700 1 --2- 172.21.15.154:0/3933843251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2004138040 0x7f2004138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.272+0000 7f20092f3700 1 -- 172.21.15.154:0/3933843251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2004138040 msgr2=0x7f2004138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.272+0000 7f20092f3700 1 --2- 172.21.15.154:0/3933843251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2004138040 0x7f2004138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.272+0000 7f20092f3700 1 -- 172.21.15.154:0/3933843251 >> v1:172.21.15.154:6789/0 conn(0x7f20040a08e0 legacy=0x7f20040a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.272+0000 7f20092f3700 1 -- 172.21.15.154:0/3933843251 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200409b9b0 con 0x7f20040a1400 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.272+0000 7f20092f3700 1 --2- 172.21.15.154:0/3933843251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20040a1400 0x7f200413fd20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009dc0 tx=0x7f1ffc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2600e1a76ff0b71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.272+0000 7f20037fe700 1 -- 172.21.15.154:0/3933843251 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00e070 con 0x7f20040a1400 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.272+0000 7f20037fe700 1 -- 172.21.15.154:0/3933843251 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc003a20 con 0x7f20040a1400 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.272+0000 7f20037fe700 1 -- 172.21.15.154:0/3933843251 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc003db0 con 0x7f20040a1400 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f200ad56700 1 -- 172.21.15.154:0/3933843251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20040a1400 msgr2=0x7f200413fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f200ad56700 1 --2- 172.21.15.154:0/3933843251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20040a1400 0x7f200413fd20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009dc0 tx=0x7f1ffc00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f200ad56700 1 -- 172.21.15.154:0/3933843251 shutdown_connections 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f200ad56700 1 --2- 172.21.15.154:0/3933843251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20040a1400 0x7f200413fd20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f200ad56700 1 --2- 172.21.15.154:0/3933843251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2004138040 0x7f2004138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f200ad56700 1 -- 172.21.15.154:0/3933843251 >> 172.21.15.154:0/3933843251 conn(0x7f20040a2980 msgr2=0x7f20040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f200ad56700 1 -- 172.21.15.154:0/3933843251 shutdown_connections 2023-09-30T22:21:43.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f200ad56700 1 -- 172.21.15.154:0/3933843251 wait complete. 2023-09-30T22:21:43.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f6b18ca3700 1 -- 172.21.15.154:0/424367978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 msgr2=0x7f6b14138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.273+0000 7f6b18ca3700 1 --2- 172.21.15.154:0/424367978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b14138690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009d90 tx=0x7f6b0c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:43.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.274+0000 7f6b18ca3700 1 -- 172.21.15.154:0/424367978 shutdown_connections 2023-09-30T22:21:43.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.274+0000 7f6b18ca3700 1 --2- 172.21.15.154:0/424367978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b14138690 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.274+0000 7f6b18ca3700 1 --2- 172.21.15.154:0/424367978 >> v2:172.21.15.154:3300/0 conn(0x7f6b14099e20 0x7f6b1409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.274+0000 7f6b18ca3700 1 -- 172.21.15.154:0/424367978 >> 172.21.15.154:0/424367978 conn(0x7f6b140a2980 msgr2=0x7f6b140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.274+0000 7f200ad56700 1 Processor -- start 2023-09-30T22:21:43.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.274+0000 7f200ad56700 1 -- start start 2023-09-30T22:21:43.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.275+0000 7f200ad56700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20040a08e0 0x7f20041264c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.275+0000 7f200ad56700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20040a1400 0x7f2004126a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.275+0000 7f200ad56700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2004138040 0x7f2004126f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.275+0000 7f200ad56700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2004137030 con 0x7f2004138040 2023-09-30T22:21:43.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.275+0000 7f200ad56700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2004129650 con 0x7f20040a1400 2023-09-30T22:21:43.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.275+0000 7f200ad56700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2004128040 con 0x7f20040a08e0 2023-09-30T22:21:43.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.275+0000 7f20092f3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2004138040 0x7f2004126f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.275+0000 7f20092f3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2004138040 0x7f2004126f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36122/0 (socket says 172.21.15.154:36122) 2023-09-30T22:21:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.275+0000 7f20092f3700 1 -- 172.21.15.154:0/4015356348 learned_addr learned my addr 172.21.15.154:0/4015356348 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.276+0000 7f2008af2700 1 --2- 172.21.15.154:0/4015356348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20040a08e0 0x7f20041264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.276+0000 7f2003fff700 1 --2- 172.21.15.154:0/4015356348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20040a1400 0x7f2004126a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.276+0000 7f20092f3700 1 -- 172.21.15.154:0/4015356348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20040a08e0 msgr2=0x7f20041264c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.276+0000 7f20092f3700 1 --2- 172.21.15.154:0/4015356348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20040a08e0 0x7f20041264c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.276+0000 7f20092f3700 1 -- 172.21.15.154:0/4015356348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20040a1400 msgr2=0x7f2004126a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.276+0000 7f20092f3700 1 --2- 172.21.15.154:0/4015356348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20040a1400 0x7f2004126a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.276+0000 7f20092f3700 1 -- 172.21.15.154:0/4015356348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc009a70 con 0x7f2004138040 2023-09-30T22:21:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.276+0000 7f6b18ca3700 1 -- 172.21.15.154:0/424367978 shutdown_connections 2023-09-30T22:21:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.276+0000 7f20092f3700 1 --2- 172.21.15.154:0/4015356348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2004138040 0x7f2004126f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00b370 tx=0x7f1ffc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.277+0000 7f6b18ca3700 1 -- 172.21.15.154:0/424367978 wait complete. 2023-09-30T22:21:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.277+0000 7f20017fa700 1 -- 172.21.15.154:0/4015356348 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0044c0 con 0x7f2004138040 2023-09-30T22:21:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.277+0000 7f20017fa700 1 -- 172.21.15.154:0/4015356348 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc004620 con 0x7f2004138040 2023-09-30T22:21:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.277+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2004129f50 con 0x7f2004138040 2023-09-30T22:21:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.277+0000 7f20017fa700 1 -- 172.21.15.154:0/4015356348 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc012450 con 0x7f2004138040 2023-09-30T22:21:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.277+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2004129c70 con 0x7f2004138040 2023-09-30T22:21:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.277+0000 7f20017fa700 1 -- 172.21.15.154:0/4015356348 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f1ffc0125b0 con 0x7f2004138040 2023-09-30T22:21:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.278+0000 7f20017fa700 1 -- 172.21.15.154:0/4015356348 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f1ffc03cdb0 con 0x7f2004138040 2023-09-30T22:21:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.278+0000 7f2008af2700 1 -- 172.21.15.154:0/4015356348 >> v1:172.21.15.154:6816/118163 conn(0x7f1fe802c1e0 legacy=0x7f1fe802e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.278+0000 7f6b18ca3700 1 Processor -- start 2023-09-30T22:21:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.279+0000 7f6b18ca3700 1 -- start start 2023-09-30T22:21:43.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.279+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 --> v1:172.21.15.154:6808/118792 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20040621a0 con 0x7f20041ccae0 2023-09-30T22:21:43.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.279+0000 7f6b18ca3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b14099e20 0x7f6b1411b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.279+0000 7f6b18ca3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b1409a730 0x7f6b1411bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.279+0000 7f6b18ca3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b1411c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.279+0000 7f6b18ca3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1409b470 con 0x7f6b1409a730 2023-09-30T22:21:43.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.279+0000 7f6b18ca3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140a15b0 con 0x7f6b14130a60 2023-09-30T22:21:43.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.279+0000 7f6b18ca3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1409d7c0 con 0x7f6b14099e20 2023-09-30T22:21:43.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.280+0000 7f20017fa700 1 -- 172.21.15.154:0/4015356348 <== osd.3 v1:172.21.15.154:6808/118792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f20040621a0 con 0x7f20041ccae0 2023-09-30T22:21:43.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.280+0000 7f6b12d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b1411c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.280+0000 7f6b12d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b1411c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51300/0 (socket says 172.21.15.154:51300) 2023-09-30T22:21:43.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.280+0000 7f6b12d9d700 1 -- 172.21.15.154:0/504087715 learned_addr learned my addr 172.21.15.154:0/504087715 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.280+0000 7f6b11d9b700 1 --2- 172.21.15.154:0/504087715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b1409a730 0x7f6b1411bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.280+0000 7f6b1259c700 1 --2- 172.21.15.154:0/504087715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b14099e20 0x7f6b1411b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b12d9d700 1 -- 172.21.15.154:0/504087715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b14099e20 msgr2=0x7f6b1411b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b12d9d700 1 --2- 172.21.15.154:0/504087715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b14099e20 0x7f6b1411b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b12d9d700 1 -- 172.21.15.154:0/504087715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b1409a730 msgr2=0x7f6b1411bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b12d9d700 1 --2- 172.21.15.154:0/504087715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b1409a730 0x7f6b1411bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b12d9d700 1 -- 172.21.15.154:0/504087715 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c009a70 con 0x7f6b14130a60 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b12d9d700 1 --2- 172.21.15.154:0/504087715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b1411c400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c014040 tx=0x7f6b0c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b02ffd700 1 -- 172.21.15.154:0/504087715 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c012430 con 0x7f6b14130a60 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1411dde0 con 0x7f6b14130a60 2023-09-30T22:21:43.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1411e0a0 con 0x7f6b14130a60 2023-09-30T22:21:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b02ffd700 1 -- 172.21.15.154:0/504087715 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c020070 con 0x7f6b14130a60 2023-09-30T22:21:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.281+0000 7f6b02ffd700 1 -- 172.21.15.154:0/504087715 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c003ea0 con 0x7f6b14130a60 2023-09-30T22:21:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.282+0000 7f6b02ffd700 1 -- 172.21.15.154:0/504087715 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f6b0c004040 con 0x7f6b14130a60 2023-09-30T22:21:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.282+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6af8000fb0 con 0x7f6b14130a60 2023-09-30T22:21:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.282+0000 7f6b1259c700 1 -- 172.21.15.154:0/504087715 >> v1:172.21.15.154:6816/118163 conn(0x7f6af402c1b0 legacy=0x7f6af402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.283+0000 7f6b02ffd700 1 -- 172.21.15.154:0/504087715 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f6b0c022070 con 0x7f6b14130a60 2023-09-30T22:21:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.283+0000 7f6b02ffd700 1 -- 172.21.15.154:0/504087715 --> v1:172.21.15.154:6812/118791 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6af4038d90 con 0x7f6af4035090 2023-09-30T22:21:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.283+0000 7f6b02ffd700 1 -- 172.21.15.154:0/504087715 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b0c011980 con 0x7f6b14130a60 2023-09-30T22:21:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.290+0000 7f6b02ffd700 1 -- 172.21.15.154:0/504087715 <== osd.2 v1:172.21.15.154:6812/118791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f6af4038d90 con 0x7f6af4035090 2023-09-30T22:21:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.310+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 --> v1:172.21.15.154:6808/118792 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2004099ad0 con 0x7f20041ccae0 2023-09-30T22:21:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.310+0000 7f20017fa700 1 -- 172.21.15.154:0/4015356348 <== osd.3 v1:172.21.15.154:6808/118792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2765323947) 0x7f1ff80013b0 con 0x7f20041ccae0 2023-09-30T22:21:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.310+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 >> v1:172.21.15.154:6808/118792 conn(0x7f20041ccae0 legacy=0x7f20041cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.312+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 >> v1:172.21.15.154:6816/118163 conn(0x7f1fe802c1e0 legacy=0x7f1fe802e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:43.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.312+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2004138040 msgr2=0x7f2004126f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.312+0000 7f200ad56700 1 --2- 172.21.15.154:0/4015356348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2004138040 0x7f2004126f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00b370 tx=0x7f1ffc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.312+0000 7f20092f3700 1 -- 172.21.15.154:0/4015356348 reap_dead start 2023-09-30T22:21:43.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.312+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 shutdown_connections 2023-09-30T22:21:43.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.312+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 >> 172.21.15.154:0/4015356348 conn(0x7f20040a2980 msgr2=0x7f200409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.314+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 shutdown_connections 2023-09-30T22:21:43.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.314+0000 7f200ad56700 1 -- 172.21.15.154:0/4015356348 wait complete. 2023-09-30T22:21:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.320+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 --> v1:172.21.15.154:6812/118791 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6af8002d00 con 0x7f6af4035090 2023-09-30T22:21:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.321+0000 7f6b02ffd700 1 -- 172.21.15.154:0/504087715 <== osd.2 v1:172.21.15.154:6812/118791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2765323947) 0x7f6af8002d00 con 0x7f6af4035090 2023-09-30T22:21:43.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.321+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 >> v1:172.21.15.154:6812/118791 conn(0x7f6af4035090 legacy=0x7f6af4037520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.321+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 >> v1:172.21.15.154:6816/118163 conn(0x7f6af402c1b0 legacy=0x7f6af402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:43.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.321+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 msgr2=0x7f6b1411c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.321+0000 7f6b18ca3700 1 --2- 172.21.15.154:0/504087715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b14130a60 0x7f6b1411c400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c014040 tx=0x7f6b0c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.322+0000 7f6b12d9d700 1 -- 172.21.15.154:0/504087715 reap_dead start 2023-09-30T22:21:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.322+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 shutdown_connections 2023-09-30T22:21:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.322+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 >> 172.21.15.154:0/504087715 conn(0x7f6b140a2980 msgr2=0x7f6b1409eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.323+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 shutdown_connections 2023-09-30T22:21:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.323+0000 7f6b18ca3700 1 -- 172.21.15.154:0/504087715 wait complete. 2023-09-30T22:21:43.336 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:43.337 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:43.341 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:43.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:43.346 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:43.347+0000 7fcc03fd2240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T22:21:43.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.415+0000 7f507689d700 1 Processor -- start 2023-09-30T22:21:43.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.415+0000 7f507689d700 1 -- start start 2023-09-30T22:21:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.416+0000 7f507689d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5070138040 0x7f5070138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.416+0000 7f507689d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50700a1400 0x7f507013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.416+0000 7f507689d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50701379e0 con 0x7f50700a08e0 2023-09-30T22:21:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.416+0000 7f507689d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700a2100 con 0x7f5070138040 2023-09-30T22:21:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.416+0000 7f507689d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5070138950 con 0x7f50700a1400 2023-09-30T22:21:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.416+0000 7f506f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f50700a08e0 0x7f50700a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57572/0 (socket says 172.21.15.154:57572) 2023-09-30T22:21:43.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.416+0000 7f506f7fe700 1 -- 172.21.15.154:0/3306980319 learned_addr learned my addr 172.21.15.154:0/3306980319 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:43.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.416+0000 7f506ffff700 1 --2- 172.21.15.154:0/3306980319 >> v2:172.21.15.154:3300/0 conn(0x7f5070138040 0x7f5070138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506effd700 1 -- 172.21.15.154:0/3306980319 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687774471 0 0) 0x7f50701379e0 con 0x7f50700a08e0 2023-09-30T22:21:43.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506effd700 1 -- 172.21.15.154:0/3306980319 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50580035b0 con 0x7f50700a08e0 2023-09-30T22:21:43.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506ffff700 1 -- 172.21.15.154:0/3306980319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50700a1400 msgr2=0x7f507013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506ffff700 1 --2- 172.21.15.154:0/3306980319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50700a1400 0x7f507013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506ffff700 1 -- 172.21.15.154:0/3306980319 >> v1:172.21.15.154:6789/0 conn(0x7f50700a08e0 legacy=0x7f50700a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506ffff700 1 -- 172.21.15.154:0/3306980319 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507009b9b0 con 0x7f5070138040 2023-09-30T22:21:43.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506ffff700 1 --2- 172.21.15.154:0/3306980319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5070138040 0x7f5070138410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5060009850 tx=0x7f5060009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14d495dace5c6c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506effd700 1 -- 172.21.15.154:0/3306980319 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060005e30 con 0x7f5070138040 2023-09-30T22:21:43.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506effd700 1 -- 172.21.15.154:0/3306980319 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5060006030 con 0x7f5070138040 2023-09-30T22:21:43.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.417+0000 7f506effd700 1 -- 172.21.15.154:0/3306980319 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600063c0 con 0x7f5070138040 2023-09-30T22:21:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.418+0000 7f507689d700 1 -- 172.21.15.154:0/3306980319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5070138040 msgr2=0x7f5070138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.418+0000 7f507689d700 1 --2- 172.21.15.154:0/3306980319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5070138040 0x7f5070138410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5060009850 tx=0x7f5060009b60 comp rx=0 tx=0).stop 2023-09-30T22:21:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.418+0000 7f507689d700 1 -- 172.21.15.154:0/3306980319 shutdown_connections 2023-09-30T22:21:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.418+0000 7f507689d700 1 --2- 172.21.15.154:0/3306980319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50700a1400 0x7f507013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.418+0000 7f507689d700 1 --2- 172.21.15.154:0/3306980319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5070138040 0x7f5070138410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.418+0000 7f507689d700 1 -- 172.21.15.154:0/3306980319 >> 172.21.15.154:0/3306980319 conn(0x7f50700a2980 msgr2=0x7f50700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.418+0000 7f507689d700 1 -- 172.21.15.154:0/3306980319 shutdown_connections 2023-09-30T22:21:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.418+0000 7f507689d700 1 -- 172.21.15.154:0/3306980319 wait complete. 2023-09-30T22:21:43.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.420+0000 7f507689d700 1 Processor -- start 2023-09-30T22:21:43.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.420+0000 7f507689d700 1 -- start start 2023-09-30T22:21:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f507689d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50700a08e0 0x7f5070126340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f507689d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50700a1400 0x7f5070126880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f507689d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5070138040 0x7f5070126dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f507689d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070129b80 con 0x7f50700a1400 2023-09-30T22:21:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f507689d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5070127ec0 con 0x7f50700a08e0 2023-09-30T22:21:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f507689d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5070129dd0 con 0x7f5070138040 2023-09-30T22:21:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f5074e3a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5070138040 0x7f5070126dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f5074e3a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5070138040 0x7f5070126dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:53000/0 (socket says 172.21.15.154:53000) 2023-09-30T22:21:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f5074e3a700 1 -- 172.21.15.154:0/4025620325 learned_addr learned my addr 172.21.15.154:0/4025620325 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f5074e3a700 1 -- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50700a08e0 msgr2=0x7f5070126340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f5074e3a700 1 --2- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50700a08e0 0x7f5070126340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f5074e3a700 1 -- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50700a1400 msgr2=0x7f5070126880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f5074e3a700 1 --2- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50700a1400 0x7f5070126880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.421+0000 7f5074e3a700 1 -- 172.21.15.154:0/4025620325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060009430 con 0x7f5070138040 2023-09-30T22:21:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.422+0000 7f5074e3a700 1 --2- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5070138040 0x7f5070126dc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f506800b970 tx=0x7f506800bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.422+0000 7f506cff9700 1 -- 172.21.15.154:0/4025620325 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800c9b0 con 0x7f5070138040 2023-09-30T22:21:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.422+0000 7f506cff9700 1 -- 172.21.15.154:0/4025620325 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506800cb30 con 0x7f5070138040 2023-09-30T22:21:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.422+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50701376b0 con 0x7f5070138040 2023-09-30T22:21:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.422+0000 7f506cff9700 1 -- 172.21.15.154:0/4025620325 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068014440 con 0x7f5070138040 2023-09-30T22:21:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.422+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5070129830 con 0x7f5070138040 2023-09-30T22:21:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.423+0000 7f506cff9700 1 -- 172.21.15.154:0/4025620325 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f506801d3b0 con 0x7f5070138040 2023-09-30T22:21:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.423+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507004f2a0 con 0x7f5070138040 2023-09-30T22:21:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.423+0000 7f506cff9700 1 -- 172.21.15.154:0/4025620325 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f506803b500 con 0x7f5070138040 2023-09-30T22:21:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.424+0000 7f506ffff700 1 -- 172.21.15.154:0/4025620325 >> v1:172.21.15.154:6816/118163 conn(0x7f505c02c1b0 legacy=0x7f505c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.424+0000 7f8ec46aa700 1 Processor -- start 2023-09-30T22:21:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.424+0000 7f8ec46aa700 1 -- start start 2023-09-30T22:21:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.425+0000 7f8ec46aa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1338b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.425+0000 7f8ec46aa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc11d650 0x7f8ebc1341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.425+0000 7f8ec46aa700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ebc06b2d0 con 0x7f8ebc133df0 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.425+0000 7f8ec46aa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc06ab40 con 0x7f8ebc11d650 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.425+0000 7f8ec46aa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc09a500 con 0x7f8ebc06a770 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2446700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2446700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1338b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:53002/0 (socket says 172.21.15.154:53002) 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2446700 1 -- 172.21.15.154:0/2834499314 learned_addr learned my addr 172.21.15.154:0/2834499314 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2c47700 1 --2- 172.21.15.154:0/2834499314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc11d650 0x7f8ebc1341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2c47700 1 -- 172.21.15.154:0/2834499314 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 msgr2=0x7f8ebc1338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2c47700 1 --2- 172.21.15.154:0/2834499314 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1338b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2c47700 1 -- 172.21.15.154:0/2834499314 >> v1:172.21.15.154:6789/0 conn(0x7f8ebc133df0 legacy=0x7f8ebc1300a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2c47700 1 -- 172.21.15.154:0/2834499314 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc09ea90 con 0x7f8ebc11d650 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2446700 1 --2- 172.21.15.154:0/2834499314 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec2c47700 1 --2- 172.21.15.154:0/2834499314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc11d650 0x7f8ebc1341e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009dc0 tx=0x7f8eb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f6a9f9f248331ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec1444700 1 -- 172.21.15.154:0/2834499314 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb400e070 con 0x7f8ebc11d650 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec1444700 1 -- 172.21.15.154:0/2834499314 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb400bae0 con 0x7f8ebc11d650 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.426+0000 7f8ec1444700 1 -- 172.21.15.154:0/2834499314 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb400be90 con 0x7f8ebc11d650 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.427+0000 7f8ec46aa700 1 -- 172.21.15.154:0/2834499314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc11d650 msgr2=0x7f8ebc1341e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.427+0000 7f8ec46aa700 1 --2- 172.21.15.154:0/2834499314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc11d650 0x7f8ebc1341e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009dc0 tx=0x7f8eb400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:43.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.428+0000 7f8ec46aa700 1 -- 172.21.15.154:0/2834499314 shutdown_connections 2023-09-30T22:21:43.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.428+0000 7f8ec46aa700 1 --2- 172.21.15.154:0/2834499314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc11d650 0x7f8ebc1341e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.428+0000 7f8ec46aa700 1 --2- 172.21.15.154:0/2834499314 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.428+0000 7f8ec46aa700 1 -- 172.21.15.154:0/2834499314 >> 172.21.15.154:0/2834499314 conn(0x7f8ebc099c40 msgr2=0x7f8ebc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.428+0000 7f8ec46aa700 1 -- 172.21.15.154:0/2834499314 shutdown_connections 2023-09-30T22:21:43.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.428+0000 7f8ec46aa700 1 -- 172.21.15.154:0/2834499314 wait complete. 2023-09-30T22:21:43.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.429+0000 7f8ec46aa700 1 Processor -- start 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.429+0000 7f8ec46aa700 1 -- start start 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec46aa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec46aa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc11d650 0x7f8ebc1c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec46aa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc133df0 0x7f8ebc1cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec46aa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc11d3e0 con 0x7f8ebc11d650 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec46aa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc070a70 con 0x7f8ebc133df0 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec46aa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ebc06ffb0 con 0x7f8ebc06a770 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2446700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2446700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:53018/0 (socket says 172.21.15.154:53018) 2023-09-30T22:21:43.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2446700 1 -- 172.21.15.154:0/3995430773 learned_addr learned my addr 172.21.15.154:0/3995430773 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2c47700 1 --2- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc133df0 0x7f8ebc1cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2446700 1 -- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc133df0 msgr2=0x7f8ebc1cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2446700 1 --2- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc133df0 0x7f8ebc1cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2446700 1 -- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc11d650 msgr2=0x7f8ebc1c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2446700 1 --2- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc11d650 0x7f8ebc1c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2446700 1 -- 172.21.15.154:0/3995430773 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8009550 con 0x7f8ebc06a770 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.430+0000 7f8ec2446700 1 --2- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1c9510 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800ebe0 tx=0x7f8eb800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.431+0000 7f8eb2ffd700 1 -- 172.21.15.154:0/3995430773 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800c850 con 0x7f8ebc06a770 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.431+0000 7f8eb2ffd700 1 -- 172.21.15.154:0/3995430773 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb800c9b0 con 0x7f8ebc06a770 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.431+0000 7f8eb2ffd700 1 -- 172.21.15.154:0/3995430773 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800cd20 con 0x7f8ebc06a770 2023-09-30T22:21:43.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.431+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb4009a70 con 0x7f8ebc06a770 2023-09-30T22:21:43.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.431+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ebc0a3030 con 0x7f8ebc06a770 2023-09-30T22:21:43.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.431+0000 7f506cff9700 1 -- 172.21.15.154:0/4025620325 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f5068019070 con 0x7f5070138040 2023-09-30T22:21:43.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.433+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ebc04f2a0 con 0x7f8ebc06a770 2023-09-30T22:21:43.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.434+0000 7f8eb2ffd700 1 -- 172.21.15.154:0/3995430773 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f8eb8013470 con 0x7f8ebc06a770 2023-09-30T22:21:43.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.435+0000 7f8eb2ffd700 1 -- 172.21.15.154:0/3995430773 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f8eb803c2b0 con 0x7f8ebc06a770 2023-09-30T22:21:43.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.435+0000 7f8ec1c45700 1 -- 172.21.15.154:0/3995430773 >> v1:172.21.15.154:6816/118163 conn(0x7f8ea002c1b0 legacy=0x7f8ea002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.443+0000 7f8eb2ffd700 1 -- 172.21.15.154:0/3995430773 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f8eb801a770 con 0x7f8ebc06a770 2023-09-30T22:21:43.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.520+0000 7f24e0c1a700 1 Processor -- start 2023-09-30T22:21:43.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.520+0000 7f24e0c1a700 1 -- start start 2023-09-30T22:21:43.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24e0c1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc138040 0x7f24dc138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24e0c1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24dc0a08e0 0x7f24dc0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24e0c1a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24dc0a1230 0x7f24dc13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24e0c1a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24dc0a2100 con 0x7f24dc0a1230 2023-09-30T22:21:43.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24e0c1a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc138950 con 0x7f24dc0a08e0 2023-09-30T22:21:43.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24e0c1a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc1379e0 con 0x7f24dc138040 2023-09-30T22:21:43.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24da59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc138040 0x7f24dc138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24dad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24dc0a1230 0x7f24dc13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24da59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc138040 0x7f24dc138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:53020/0 (socket says 172.21.15.154:53020) 2023-09-30T22:21:43.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24dad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24dc0a1230 0x7f24dc13ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36176/0 (socket says 172.21.15.154:36176) 2023-09-30T22:21:43.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24da59c700 1 -- 172.21.15.154:0/3580511612 learned_addr learned my addr 172.21.15.154:0/3580511612 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24dad9d700 1 -- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc138040 msgr2=0x7f24dc138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24dad9d700 1 --2- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc138040 0x7f24dc138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24dad9d700 1 -- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24dc0a08e0 msgr2=0x7f24dc0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24dad9d700 1 --2- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24dc0a08e0 0x7f24dc0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.521+0000 7f24dad9d700 1 -- 172.21.15.154:0/3580511612 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc09b9b0 con 0x7f24dc0a1230 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.522+0000 7f24dad9d700 1 --2- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 0x7f24dc13ed10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009df0 tx=0x7f24d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939215bd695ca431 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.522+0000 7f24d959a700 1 -- 172.21.15.154:0/3580511612 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400e070 con 0x7f24dc0a1230 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.522+0000 7f24d959a700 1 -- 172.21.15.154:0/3580511612 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d400baa0 con 0x7f24dc0a1230 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.522+0000 7f24d959a700 1 -- 172.21.15.154:0/3580511612 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400be50 con 0x7f24dc0a1230 2023-09-30T22:21:43.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.523+0000 7f24e0c1a700 1 -- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 msgr2=0x7f24dc13ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.523+0000 7f24e0c1a700 1 --2- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 0x7f24dc13ed10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009df0 tx=0x7f24d400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:43.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.523+0000 7f24e0c1a700 1 -- 172.21.15.154:0/3580511612 shutdown_connections 2023-09-30T22:21:43.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.523+0000 7f24e0c1a700 1 --2- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 0x7f24dc13ed10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.523+0000 7f24e0c1a700 1 --2- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc138040 0x7f24dc138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.523+0000 7f24e0c1a700 1 --2- 172.21.15.154:0/3580511612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24dc0a08e0 0x7f24dc0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.523+0000 7f24e0c1a700 1 -- 172.21.15.154:0/3580511612 >> 172.21.15.154:0/3580511612 conn(0x7f24dc0a2980 msgr2=0x7f24dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.523+0000 7f24e0c1a700 1 -- 172.21.15.154:0/3580511612 shutdown_connections 2023-09-30T22:21:43.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.523+0000 7f24e0c1a700 1 -- 172.21.15.154:0/3580511612 wait complete. 2023-09-30T22:21:43.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.524+0000 7f24e0c1a700 1 Processor -- start 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.524+0000 7f24e0c1a700 1 -- start start 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24e0c1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc0a08e0 0x7f24dc1ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24e0c1a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 0x7f24dc1cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24e0c1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24dc138040 0x7f24dc1cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24e0c1a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc09a2b0 con 0x7f24dc0a1230 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24e0c1a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc1284b0 con 0x7f24dc138040 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24e0c1a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc128b90 con 0x7f24dc0a08e0 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24da59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc0a08e0 0x7f24dc1ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24d9d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 0x7f24dc1cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24da59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc0a08e0 0x7f24dc1ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:53032/0 (socket says 172.21.15.154:53032) 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24da59c700 1 -- 172.21.15.154:0/302911022 learned_addr learned my addr 172.21.15.154:0/302911022 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24dad9d700 1 --2- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24dc138040 0x7f24dc1cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24d9d9b700 1 -- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc0a08e0 msgr2=0x7f24dc1ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24d9d9b700 1 --2- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc0a08e0 0x7f24dc1ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24d9d9b700 1 -- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24dc138040 msgr2=0x7f24dc1cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24d9d9b700 1 --2- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24dc138040 0x7f24dc1cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24d9d9b700 1 -- 172.21.15.154:0/302911022 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4009a70 con 0x7f24dc0a1230 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.525+0000 7f24d9d9b700 1 --2- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 0x7f24dc1cd090 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f24d000b410 tx=0x7f24d000b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.526+0000 7f24caffd700 1 -- 172.21.15.154:0/302911022 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0011620 con 0x7f24dc0a1230 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.526+0000 7f24caffd700 1 -- 172.21.15.154:0/302911022 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d00117a0 con 0x7f24dc0a1230 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.526+0000 7f24caffd700 1 -- 172.21.15.154:0/302911022 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0011b50 con 0x7f24dc0a1230 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.526+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc12a240 con 0x7f24dc0a1230 2023-09-30T22:21:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.526+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc09ca30 con 0x7f24dc0a1230 2023-09-30T22:21:43.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.526+0000 7f24caffd700 1 -- 172.21.15.154:0/302911022 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f24d0011cb0 con 0x7f24dc0a1230 2023-09-30T22:21:43.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.527+0000 7f24caffd700 1 -- 172.21.15.154:0/302911022 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f24d003b660 con 0x7f24dc0a1230 2023-09-30T22:21:43.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.527+0000 7f24da59c700 1 -- 172.21.15.154:0/302911022 >> v1:172.21.15.154:6816/118163 conn(0x7f24bc02c1b0 legacy=0x7f24bc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.528+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24dc12a080 con 0x7f24dc0a1230 2023-09-30T22:21:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.531+0000 7fd9ecd6b700 1 Processor -- start 2023-09-30T22:21:43.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.531+0000 7fd9ecd6b700 1 -- start start 2023-09-30T22:21:43.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.532+0000 7fd9ecd6b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9e8138040 0x7fd9e8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.532+0000 7fd9ecd6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e80a08e0 0x7fd9e80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.532+0000 7fd9ecd6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.532+0000 7fd9ecd6b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e80a2100 con 0x7fd9e8138040 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.532+0000 7fd9ecd6b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e8138950 con 0x7fd9e80a08e0 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.532+0000 7fd9ecd6b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e81379e0 con 0x7fd9e80a1230 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e80a08e0 0x7fd9e80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e80a08e0 0x7fd9e80a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51352/0 (socket says 172.21.15.154:51352) 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:53048/0 (socket says 172.21.15.154:53048) 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9e8138040 0x7fd9e8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e5d9b700 1 -- 172.21.15.154:0/962336975 learned_addr learned my addr 172.21.15.154:0/962336975 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7f24caffd700 1 -- 172.21.15.154:0/302911022 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f24d000f2e0 con 0x7f24dc0a1230 2023-09-30T22:21:43.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e6d9d700 1 -- 172.21.15.154:0/962336975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e80a08e0 msgr2=0x7fd9e80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e6d9d700 1 --2- 172.21.15.154:0/962336975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e80a08e0 0x7fd9e80a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e6d9d700 1 -- 172.21.15.154:0/962336975 >> v2:172.21.15.154:3300/0 conn(0x7fd9e8138040 msgr2=0x7fd9e8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:43.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e6d9d700 1 --2- 172.21.15.154:0/962336975 >> v2:172.21.15.154:3300/0 conn(0x7fd9e8138040 0x7fd9e8138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e6d9d700 1 -- 172.21.15.154:0/962336975 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e809b9b0 con 0x7fd9e80a1230 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.533+0000 7fd9e6d9d700 1 --2- 172.21.15.154:0/962336975 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e813ed10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009df0 tx=0x7fd9e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=659dac928ee48a53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.534+0000 7fd9e559a700 1 -- 172.21.15.154:0/962336975 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000e070 con 0x7fd9e80a1230 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.534+0000 7fd9e559a700 1 -- 172.21.15.154:0/962336975 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e000baa0 con 0x7fd9e80a1230 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.534+0000 7fd9e559a700 1 -- 172.21.15.154:0/962336975 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000be50 con 0x7fd9e80a1230 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.535+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/962336975 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 msgr2=0x7fd9e813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.535+0000 7fd9ecd6b700 1 --2- 172.21.15.154:0/962336975 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e813ed10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009df0 tx=0x7fd9e000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.535+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/962336975 shutdown_connections 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.535+0000 7fd9ecd6b700 1 --2- 172.21.15.154:0/962336975 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e813ed10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.535+0000 7fd9ecd6b700 1 --2- 172.21.15.154:0/962336975 >> v2:172.21.15.154:3300/0 conn(0x7fd9e8138040 0x7fd9e8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.535+0000 7fd9ecd6b700 1 --2- 172.21.15.154:0/962336975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e80a08e0 0x7fd9e80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.535+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/962336975 >> 172.21.15.154:0/962336975 conn(0x7fd9e80a2980 msgr2=0x7fd9e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.535+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/962336975 shutdown_connections 2023-09-30T22:21:43.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.535+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/962336975 wait complete. 2023-09-30T22:21:43.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.536+0000 7fd9ecd6b700 1 Processor -- start 2023-09-30T22:21:43.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9ecd6b700 1 -- start start 2023-09-30T22:21:43.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9ecd6b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9e80a08e0 0x7fd9e81d5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9ecd6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e81d5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9ecd6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e8138040 0x7fd9e8118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9ecd6b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e811ae80 con 0x7fd9e80a08e0 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9ecd6b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e81d4f70 con 0x7fd9e8138040 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9ecd6b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e811b0b0 con 0x7fd9e80a1230 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9e6d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e8138040 0x7fd9e8118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9e6d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e8138040 0x7fd9e8118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51368/0 (socket says 172.21.15.154:51368) 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.537+0000 7fd9e6d9d700 1 -- 172.21.15.154:0/643092570 learned_addr learned my addr 172.21.15.154:0/643092570 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9e659c700 1 --2- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9e80a08e0 0x7fd9e81d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9e5d9b700 1 --2- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e81d5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9e659c700 1 -- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 msgr2=0x7fd9e81d5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9e659c700 1 --2- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e81d5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9e659c700 1 -- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e8138040 msgr2=0x7fd9e8118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9e659c700 1 --2- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e8138040 0x7fd9e8118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9e659c700 1 -- 172.21.15.154:0/643092570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0009a70 con 0x7fd9e80a08e0 2023-09-30T22:21:43.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9e659c700 1 --2- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9e80a08e0 0x7fd9e81d5330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800e8d0 tx=0x7fd9d800ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:43.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/643092570 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8013680 con 0x7fd9e80a08e0 2023-09-30T22:21:43.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/643092570 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d80137e0 con 0x7fd9e80a08e0 2023-09-30T22:21:43.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.538+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/643092570 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8013b50 con 0x7fd9e80a08e0 2023-09-30T22:21:43.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.539+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e813e1f0 con 0x7fd9e80a08e0 2023-09-30T22:21:43.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.539+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e809a240 con 0x7fd9e80a08e0 2023-09-30T22:21:43.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.540+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/643092570 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fd9d8013cb0 con 0x7fd9e80a08e0 2023-09-30T22:21:43.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.540+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/643092570 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fd9d803b790 con 0x7fd9e80a08e0 2023-09-30T22:21:43.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.540+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e8119ed0 con 0x7fd9e80a08e0 2023-09-30T22:21:43.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.540+0000 7fd9e5d9b700 1 -- 172.21.15.154:0/643092570 >> v1:172.21.15.154:6816/118163 conn(0x7fd9c802c1b0 legacy=0x7fd9c802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.544+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/643092570 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd9d8021080 con 0x7fd9e80a08e0 2023-09-30T22:21:43.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.625+0000 7f506ffff700 1 -- 172.21.15.154:0/4025620325 >> v1:172.21.15.154:6816/118163 conn(0x7f505c02c1b0 legacy=0x7f505c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.636+0000 7f8ec1c45700 1 -- 172.21.15.154:0/3995430773 >> v1:172.21.15.154:6816/118163 conn(0x7f8ea002c1b0 legacy=0x7f8ea002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.679+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ebc070cd0 con 0x7f8ebc06a770 2023-09-30T22:21:43.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.679+0000 7f8eb2ffd700 1 -- 172.21.15.154:0/3995430773 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8eb8021030 con 0x7f8ebc06a770 2023-09-30T22:21:43.679 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.681+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 >> v1:172.21.15.154:6816/118163 conn(0x7f8ea002c1b0 legacy=0x7f8ea002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.681+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 msgr2=0x7f8ebc1c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.681+0000 7f8ec46aa700 1 --2- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1c9510 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800ebe0 tx=0x7f8eb800eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.682+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 shutdown_connections 2023-09-30T22:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.682+0000 7f8ec46aa700 1 --2- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ebc133df0 0x7f8ebc1cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.682+0000 7f8ec46aa700 1 --2- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ebc06a770 0x7f8ebc1c9510 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.682+0000 7f8ec46aa700 1 --2- 172.21.15.154:0/3995430773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc11d650 0x7f8ebc1c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.682+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 >> 172.21.15.154:0/3995430773 conn(0x7f8ebc099c40 msgr2=0x7f8ebc0a26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.682+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 shutdown_connections 2023-09-30T22:21:43.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.682+0000 7f8ec46aa700 1 -- 172.21.15.154:0/3995430773 wait complete. 2023-09-30T22:21:43.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-09-30T22:21:43.717 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:43.717+0000 7fcc03fd2240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:21:43.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.728+0000 7f24da59c700 1 -- 172.21.15.154:0/302911022 >> v1:172.21.15.154:6816/118163 conn(0x7f24bc02c1b0 legacy=0x7f24bc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.741+0000 7fd9e5d9b700 1 -- 172.21.15.154:0/643092570 >> v1:172.21.15.154:6816/118163 conn(0x7fd9c802c1b0 legacy=0x7fd9c802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:43.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.741+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9e804f2a0 con 0x7fd9e80a08e0 2023-09-30T22:21:43.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.742+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/643092570 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9d8017070 con 0x7fd9e80a08e0 2023-09-30T22:21:43.742 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:43.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.743+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 >> v1:172.21.15.154:6816/118163 conn(0x7fd9c802c1b0 legacy=0x7fd9c802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:43.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.743+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9e80a08e0 msgr2=0x7fd9e81d5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.743+0000 7fd9ecd6b700 1 --2- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9e80a08e0 0x7fd9e81d5330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800e8d0 tx=0x7fd9d800ebe0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.744+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 shutdown_connections 2023-09-30T22:21:43.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.744+0000 7fd9ecd6b700 1 --2- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9e8138040 0x7fd9e8118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.744+0000 7fd9ecd6b700 1 --2- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9e80a08e0 0x7fd9e81d5330 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.744+0000 7fd9ecd6b700 1 --2- 172.21.15.154:0/643092570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9e80a1230 0x7fd9e81d5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.744+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 >> 172.21.15.154:0/643092570 conn(0x7fd9e80a2980 msgr2=0x7fd9e8070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.744+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 shutdown_connections 2023-09-30T22:21:43.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.744+0000 7fd9ecd6b700 1 -- 172.21.15.154:0/643092570 wait complete. 2023-09-30T22:21:43.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.744+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5070137650 con 0x7f5070138040 2023-09-30T22:21:43.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.744+0000 7f506cff9700 1 -- 172.21.15.154:0/4025620325 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5068019030 con 0x7f5070138040 2023-09-30T22:21:43.746 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:43.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 >> v1:172.21.15.154:6816/118163 conn(0x7f505c02c1b0 legacy=0x7f505c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:43.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5070138040 msgr2=0x7f5070126dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 --2- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5070138040 0x7f5070126dc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f506800b970 tx=0x7f506800bd30 comp rx=0 tx=0).stop 2023-09-30T22:21:43.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 shutdown_connections 2023-09-30T22:21:43.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 --2- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5070138040 0x7f5070126dc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 --2- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50700a08e0 0x7f5070126340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 --2- 172.21.15.154:0/4025620325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50700a1400 0x7f5070126880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 >> 172.21.15.154:0/4025620325 conn(0x7f50700a2980 msgr2=0x7f507009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 shutdown_connections 2023-09-30T22:21:43.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.747+0000 7f507689d700 1 -- 172.21.15.154:0/4025620325 wait complete. 2023-09-30T22:21:43.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-09-30T22:21:43.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-09-30T22:21:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.808+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24dc137e40 con 0x7f24dc0a1230 2023-09-30T22:21:43.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.809+0000 7f24caffd700 1 -- 172.21.15.154:0/302911022 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24d0022350 con 0x7f24dc0a1230 2023-09-30T22:21:43.809 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:43.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 >> v1:172.21.15.154:6816/118163 conn(0x7f24bc02c1b0 legacy=0x7f24bc02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:43.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 msgr2=0x7f24dc1cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:43.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 --2- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 0x7f24dc1cd090 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f24d000b410 tx=0x7f24d000b720 comp rx=0 tx=0).stop 2023-09-30T22:21:43.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 shutdown_connections 2023-09-30T22:21:43.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 --2- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24dc138040 0x7f24dc1cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 --2- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24dc0a08e0 0x7f24dc1ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 --2- 172.21.15.154:0/302911022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0a1230 0x7f24dc1cd090 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:43.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 >> 172.21.15.154:0/302911022 conn(0x7f24dc0a2980 msgr2=0x7f24dc09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:43.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 shutdown_connections 2023-09-30T22:21:43.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:43.811+0000 7f24e0c1a700 1 -- 172.21.15.154:0/302911022 wait complete. 2023-09-30T22:21:43.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-09-30T22:21:43.865 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:43.865+0000 7fcc03fd2240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:21:43.938 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:43.939+0000 7fcc03fd2240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:21:44.074 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:44.073+0000 7fcc03fd2240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:21:44.146 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:44.146+0000 7fcc03fd2240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:21:44.305 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:44.305+0000 7fcc03fd2240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:21:44.383 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:44.383+0000 7fcc03fd2240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:21:44.461 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:44.461+0000 7fcc03fd2240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T22:21:44.552 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:44.552+0000 7fcc03fd2240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:21:44.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:44.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:44.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:44.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:44.827 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:44.827+0000 7fcc03fd2240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:21:44.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.831+0000 7f16fdd7e700 1 Processor -- start 2023-09-30T22:21:44.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.831+0000 7f16fdd7e700 1 -- start start 2023-09-30T22:21:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.831+0000 7f16fdd7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f806a770 0x7f16f81349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.831+0000 7f16fdd7e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16f8134f00 0x7f16f809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.831+0000 7f16fdd7e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f809dea0 0x7f16f809e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.831+0000 7f16fdd7e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f806b2e0 con 0x7f16f8134f00 2023-09-30T22:21:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.831+0000 7f16fdd7e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f809eca0 con 0x7f16f809dea0 2023-09-30T22:21:44.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.831+0000 7f16fdd7e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f809f720 con 0x7f16f806a770 2023-09-30T22:21:44.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16f8134f00 0x7f16f809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16f8134f00 0x7f16f809d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36210/0 (socket says 172.21.15.154:36210) 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f6ffd700 1 -- 172.21.15.154:0/3900524080 learned_addr learned my addr 172.21.15.154:0/3900524080 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f77fe700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f806a770 0x7f16f81349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f7fff700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f809dea0 0x7f16f809e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f6ffd700 1 -- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f806a770 msgr2=0x7f16f81349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f6ffd700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f806a770 0x7f16f81349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f6ffd700 1 -- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f809dea0 msgr2=0x7f16f809e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f6ffd700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f809dea0 0x7f16f809e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f6ffd700 1 -- 172.21.15.154:0/3900524080 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f806b480 con 0x7f16f8134f00 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f7fff700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f809dea0 0x7f16f809e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:21:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f6ffd700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f8134f00 0x7f16f809d960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0098f0 tx=0x7f16ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6b1a99fb954bf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f67fc700 1 -- 172.21.15.154:0/3900524080 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00b8a0 con 0x7f16f8134f00 2023-09-30T22:21:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f67fc700 1 -- 172.21.15.154:0/3900524080 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00ba00 con 0x7f16f8134f00 2023-09-30T22:21:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.832+0000 7f16f67fc700 1 -- 172.21.15.154:0/3900524080 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00bd90 con 0x7f16f8134f00 2023-09-30T22:21:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.833+0000 7f16fdd7e700 1 -- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f8134f00 msgr2=0x7f16f809d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.833+0000 7f16fdd7e700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f8134f00 0x7f16f809d960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0098f0 tx=0x7f16ec009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.833+0000 7f16fdd7e700 1 -- 172.21.15.154:0/3900524080 shutdown_connections 2023-09-30T22:21:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.833+0000 7f16fdd7e700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f809dea0 0x7f16f809e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.833+0000 7f16fdd7e700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f806a770 0x7f16f81349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.833+0000 7f16fdd7e700 1 --2- 172.21.15.154:0/3900524080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f8134f00 0x7f16f809d960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.833+0000 7f16fdd7e700 1 -- 172.21.15.154:0/3900524080 >> 172.21.15.154:0/3900524080 conn(0x7f16f8099c40 msgr2=0x7f16f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.834+0000 7f16fdd7e700 1 -- 172.21.15.154:0/3900524080 shutdown_connections 2023-09-30T22:21:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.834+0000 7f16fdd7e700 1 -- 172.21.15.154:0/3900524080 wait complete. 2023-09-30T22:21:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.835+0000 7f16fdd7e700 1 Processor -- start 2023-09-30T22:21:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.835+0000 7f16fdd7e700 1 -- start start 2023-09-30T22:21:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.835+0000 7f16fdd7e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f806a770 0x7f16f81d5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.835+0000 7f16fdd7e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f809dea0 0x7f16f81d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.835+0000 7f16fdd7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f8134f00 0x7f16f81ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.835+0000 7f16fdd7e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f811e1f0 con 0x7f16f809dea0 2023-09-30T22:21:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.835+0000 7f16fdd7e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f80a03d0 con 0x7f16f806a770 2023-09-30T22:21:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.835+0000 7f16fdd7e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f811c940 con 0x7f16f8134f00 2023-09-30T22:21:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.836+0000 7f16f6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f809dea0 0x7f16f81d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.836+0000 7f16f6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f809dea0 0x7f16f81d5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36220/0 (socket says 172.21.15.154:36220) 2023-09-30T22:21:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.836+0000 7f16f6ffd700 1 -- 172.21.15.154:0/1903158028 learned_addr learned my addr 172.21.15.154:0/1903158028 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.836+0000 7f16f77fe700 1 --2- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f806a770 0x7f16f81d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.836+0000 7f16f6ffd700 1 -- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f8134f00 msgr2=0x7f16f81ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.836+0000 7f16f6ffd700 1 --2- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f8134f00 0x7f16f81ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.836+0000 7f16f6ffd700 1 -- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f806a770 msgr2=0x7f16f81d5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.836+0000 7f16f6ffd700 1 --2- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f806a770 0x7f16f81d5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.836+0000 7f16f6ffd700 1 -- 172.21.15.154:0/1903158028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec009550 con 0x7f16f809dea0 2023-09-30T22:21:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.837+0000 7f16f6ffd700 1 --2- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f809dea0 0x7f16f81d5bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009c40 tx=0x7f16ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.837+0000 7f16dffff700 1 -- 172.21.15.154:0/1903158028 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec004590 con 0x7f16f809dea0 2023-09-30T22:21:44.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.837+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f811e540 con 0x7f16f809dea0 2023-09-30T22:21:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.837+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f811c330 con 0x7f16f809dea0 2023-09-30T22:21:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.838+0000 7f16dffff700 1 -- 172.21.15.154:0/1903158028 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec006ce0 con 0x7f16f809dea0 2023-09-30T22:21:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.838+0000 7f16dffff700 1 -- 172.21.15.154:0/1903158028 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec003900 con 0x7f16f809dea0 2023-09-30T22:21:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.839+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f80a3010 con 0x7f16f809dea0 2023-09-30T22:21:44.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.839+0000 7f16dffff700 1 -- 172.21.15.154:0/1903158028 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f16ec003a60 con 0x7f16f809dea0 2023-09-30T22:21:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.839+0000 7f16dffff700 1 -- 172.21.15.154:0/1903158028 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f16ec03cc10 con 0x7f16f809dea0 2023-09-30T22:21:44.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.840+0000 7f16f77fe700 1 -- 172.21.15.154:0/1903158028 >> v1:172.21.15.154:6816/118163 conn(0x7f16e402c1b0 legacy=0x7f16e402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:44.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.848+0000 7f16dffff700 1 -- 172.21.15.154:0/1903158028 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f16ec010380 con 0x7f16f809dea0 2023-09-30T22:21:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.902+0000 7f314ab68700 1 Processor -- start 2023-09-30T22:21:44.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.903+0000 7f314ab68700 1 -- start start 2023-09-30T22:21:44.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.903+0000 7f314ab68700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31440a0a30 0x7f31440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.903+0000 7f314ab68700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31440a1340 0x7f314412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.903+0000 7f314ab68700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31440a1e70 con 0x7f31441304a0 2023-09-30T22:21:44.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.903+0000 7f314ab68700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314409a720 con 0x7f31440a0a30 2023-09-30T22:21:44.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.903+0000 7f314ab68700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f314409b300 con 0x7f31440a1340 2023-09-30T22:21:44.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.903+0000 7f3143fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31440a1340 0x7f314412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.903+0000 7f3143fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31440a1340 0x7f314412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:53078/0 (socket says 172.21.15.154:53078) 2023-09-30T22:21:44.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.903+0000 7f3143fff700 1 -- 172.21.15.154:0/3183240756 learned_addr learned my addr 172.21.15.154:0/3183240756 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:44.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f3148904700 1 --2- 172.21.15.154:0/3183240756 >> v2:172.21.15.154:3300/0 conn(0x7f31440a0a30 0x7f31440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f3143fff700 1 -- 172.21.15.154:0/3183240756 >> v2:172.21.15.154:3300/0 conn(0x7f31440a0a30 msgr2=0x7f31440a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f3143fff700 1 --2- 172.21.15.154:0/3183240756 >> v2:172.21.15.154:3300/0 conn(0x7f31440a0a30 0x7f31440a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f3143fff700 1 -- 172.21.15.154:0/3183240756 >> v1:172.21.15.154:6789/0 conn(0x7f31441304a0 legacy=0x7f31441371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f3143fff700 1 -- 172.21.15.154:0/3183240756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314409abc0 con 0x7f31440a1340 2023-09-30T22:21:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f31437fe700 1 -- 172.21.15.154:0/3183240756 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785194447 0 0) 0x7f31440a1e70 con 0x7f31441304a0 2023-09-30T22:21:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f3148904700 1 --2- 172.21.15.154:0/3183240756 >> v2:172.21.15.154:3300/0 conn(0x7f31440a0a30 0x7f31440a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:21:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f3143fff700 1 --2- 172.21.15.154:0/3183240756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31440a1340 0x7f314412ff60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f313000bb90 tx=0x7f313000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ccc35ea12f1a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f31437fe700 1 -- 172.21.15.154:0/3183240756 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000dc40 con 0x7f31440a1340 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f31437fe700 1 -- 172.21.15.154:0/3183240756 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313000dda0 con 0x7f31440a1340 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.904+0000 7f31437fe700 1 -- 172.21.15.154:0/3183240756 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130017630 con 0x7f31440a1340 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.905+0000 7f314ab68700 1 -- 172.21.15.154:0/3183240756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31440a1340 msgr2=0x7f314412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.905+0000 7f314ab68700 1 --2- 172.21.15.154:0/3183240756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31440a1340 0x7f314412ff60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f313000bb90 tx=0x7f313000bea0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.905+0000 7f314ab68700 1 -- 172.21.15.154:0/3183240756 shutdown_connections 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.905+0000 7f314ab68700 1 --2- 172.21.15.154:0/3183240756 >> v2:172.21.15.154:3300/0 conn(0x7f31440a0a30 0x7f31440a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.905+0000 7f314ab68700 1 --2- 172.21.15.154:0/3183240756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31440a1340 0x7f314412ff60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.905+0000 7f314ab68700 1 -- 172.21.15.154:0/3183240756 >> 172.21.15.154:0/3183240756 conn(0x7f31440a2980 msgr2=0x7f31440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.905+0000 7f314ab68700 1 -- 172.21.15.154:0/3183240756 shutdown_connections 2023-09-30T22:21:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.905+0000 7f314ab68700 1 -- 172.21.15.154:0/3183240756 wait complete. 2023-09-30T22:21:44.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.906+0000 7f314ab68700 1 Processor -- start 2023-09-30T22:21:44.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.906+0000 7f314ab68700 1 -- start start 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f314ab68700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31440a0a30 0x7f314411f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f314ab68700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31440a1340 0x7f314411faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f314ab68700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31441304a0 0x7f3144120030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f314ab68700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3144123a90 con 0x7f31440a1340 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f314ab68700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31441230d0 con 0x7f31440a0a30 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f314ab68700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3144122bc0 con 0x7f31441304a0 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f3143fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31440a1340 0x7f314411faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f3143fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31440a1340 0x7f314411faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36246/0 (socket says 172.21.15.154:36246) 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f3143fff700 1 -- 172.21.15.154:0/3758273778 learned_addr learned my addr 172.21.15.154:0/3758273778 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:44.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f3149105700 1 --2- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31441304a0 0x7f3144120030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f3143fff700 1 -- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31441304a0 msgr2=0x7f3144120030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f3143fff700 1 --2- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31441304a0 0x7f3144120030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f3143fff700 1 -- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31440a0a30 msgr2=0x7f314411f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f3143fff700 1 --2- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31440a0a30 0x7f314411f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.907+0000 7f3143fff700 1 -- 172.21.15.154:0/3758273778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313000b7f0 con 0x7f31440a1340 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.908+0000 7f3143fff700 1 --2- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31440a1340 0x7f314411faf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31440a2000 tx=0x7f3130004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.908+0000 7f31417fa700 1 -- 172.21.15.154:0/3758273778 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130009050 con 0x7f31440a1340 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.908+0000 7f31417fa700 1 -- 172.21.15.154:0/3758273778 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313000a040 con 0x7f31440a1340 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.908+0000 7f31417fa700 1 -- 172.21.15.154:0/3758273778 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130021870 con 0x7f31440a1340 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.908+0000 7f314ab68700 1 -- 172.21.15.154:0/3758273778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314409ae00 con 0x7f31440a1340 2023-09-30T22:21:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.908+0000 7f314ab68700 1 -- 172.21.15.154:0/3758273778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31441211c0 con 0x7f31440a1340 2023-09-30T22:21:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.909+0000 7f31417fa700 1 -- 172.21.15.154:0/3758273778 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f3130015070 con 0x7f31440a1340 2023-09-30T22:21:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.910+0000 7f312effd700 1 -- 172.21.15.154:0/3758273778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311c0052e0 con 0x7f31440a1340 2023-09-30T22:21:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.910+0000 7f31417fa700 1 -- 172.21.15.154:0/3758273778 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f3130006d20 con 0x7f31440a1340 2023-09-30T22:21:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.911+0000 7f3148904700 1 -- 172.21.15.154:0/3758273778 >> v1:172.21.15.154:6816/118163 conn(0x7f312802c1b0 legacy=0x7f312802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.913+0000 7fa4ac341700 1 Processor -- start 2023-09-30T22:21:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.913+0000 7fa4ac341700 1 -- start start 2023-09-30T22:21:44.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.914+0000 7fa4ac341700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4a409e340 0x7fa4a41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.914+0000 7fa4ac341700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a4135f20 0x7fa4a4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.914+0000 7fa4ac341700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a409aaa0 con 0x7fa4a409d860 2023-09-30T22:21:44.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.914+0000 7fa4ac341700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a409e730 con 0x7fa4a409e340 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.914+0000 7fa4ac341700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a409f870 con 0x7fa4a4135f20 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4aa8de700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a4135f20 0x7fa4a4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4aa8de700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a4135f20 0x7fa4a4138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:53082/0 (socket says 172.21.15.154:53082) 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4aa8de700 1 -- 172.21.15.154:0/3249733040 learned_addr learned my addr 172.21.15.154:0/3249733040 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4aa8de700 1 -- 172.21.15.154:0/3249733040 >> v2:172.21.15.154:3300/0 conn(0x7fa4a409e340 msgr2=0x7fa4a41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4aa8de700 1 --2- 172.21.15.154:0/3249733040 >> v2:172.21.15.154:3300/0 conn(0x7fa4a409e340 0x7fa4a41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4aa8de700 1 -- 172.21.15.154:0/3249733040 >> v1:172.21.15.154:6789/0 conn(0x7fa4a409d860 legacy=0x7fa4a409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4aa8de700 1 -- 172.21.15.154:0/3249733040 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a409b360 con 0x7fa4a4135f20 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4aa8de700 1 --2- 172.21.15.154:0/3249733040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a4135f20 0x7fa4a4138300 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009e80 tx=0x7fa49c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3efba21df8b2fa93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4a90db700 1 -- 172.21.15.154:0/3249733040 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00e070 con 0x7fa4a4135f20 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4a90db700 1 -- 172.21.15.154:0/3249733040 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c003a20 con 0x7fa4a4135f20 2023-09-30T22:21:44.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.915+0000 7fa4a90db700 1 -- 172.21.15.154:0/3249733040 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c003dd0 con 0x7fa4a4135f20 2023-09-30T22:21:44.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.916+0000 7fa4ac341700 1 -- 172.21.15.154:0/3249733040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a4135f20 msgr2=0x7fa4a4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.916+0000 7fa4ac341700 1 --2- 172.21.15.154:0/3249733040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a4135f20 0x7fa4a4138300 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009e80 tx=0x7fa49c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:44.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.916+0000 7fa4ac341700 1 -- 172.21.15.154:0/3249733040 shutdown_connections 2023-09-30T22:21:44.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.916+0000 7fa4ac341700 1 --2- 172.21.15.154:0/3249733040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a4135f20 0x7fa4a4138300 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.916+0000 7fa4ac341700 1 --2- 172.21.15.154:0/3249733040 >> v2:172.21.15.154:3300/0 conn(0x7fa4a409e340 0x7fa4a41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.916+0000 7fa4ac341700 1 -- 172.21.15.154:0/3249733040 >> 172.21.15.154:0/3249733040 conn(0x7fa4a4099c40 msgr2=0x7fa4a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:44.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.917+0000 7fa4ac341700 1 -- 172.21.15.154:0/3249733040 shutdown_connections 2023-09-30T22:21:44.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.917+0000 7fa4ac341700 1 -- 172.21.15.154:0/3249733040 wait complete. 2023-09-30T22:21:44.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.918+0000 7f31417fa700 1 -- 172.21.15.154:0/3758273778 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f31300219d0 con 0x7f31440a1340 2023-09-30T22:21:44.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.918+0000 7fa4ac341700 1 Processor -- start 2023-09-30T22:21:44.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.918+0000 7fa4ac341700 1 -- start start 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4ac341700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a409d860 0x7fa4a4132910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4ac341700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a409e340 0x7fa4a4132e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4ac341700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a4135f20 0x7fa4a4133390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4ac341700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4119900 con 0x7fa4a4135f20 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4ac341700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4130480 con 0x7fa4a409e340 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4ac341700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4134b40 con 0x7fa4a409d860 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4a98dc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a409e340 0x7fa4a4132e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4a98dc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a409e340 0x7fa4a4132e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51406/0 (socket says 172.21.15.154:51406) 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4a98dc700 1 -- 172.21.15.154:0/2109507427 learned_addr learned my addr 172.21.15.154:0/2109507427 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4aa8de700 1 --2- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a4135f20 0x7fa4a4133390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.919+0000 7fa4aa0dd700 1 --2- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a409d860 0x7fa4a4132910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:44.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa4a98dc700 1 -- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a409d860 msgr2=0x7fa4a4132910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa4a98dc700 1 --2- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a409d860 0x7fa4a4132910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa4a98dc700 1 -- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a4135f20 msgr2=0x7fa4a4133390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa4a98dc700 1 --2- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a4135f20 0x7fa4a4133390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa4a98dc700 1 -- 172.21.15.154:0/2109507427 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c009b30 con 0x7fa4a409e340 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa4a98dc700 1 --2- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a409e340 0x7fa4a4132e50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000b500 tx=0x7fa4a000b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa49affd700 1 -- 172.21.15.154:0/2109507427 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0011830 con 0x7fa4a409e340 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa49affd700 1 -- 172.21.15.154:0/2109507427 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a00119b0 con 0x7fa4a409e340 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa49affd700 1 -- 172.21.15.154:0/2109507427 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0011d60 con 0x7fa4a409e340 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a40a2400 con 0x7fa4a409e340 2023-09-30T22:21:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.920+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a4134d10 con 0x7fa4a409e340 2023-09-30T22:21:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.922+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a409c8b0 con 0x7fa4a409e340 2023-09-30T22:21:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.922+0000 7fa49affd700 1 -- 172.21.15.154:0/2109507427 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa4a001a400 con 0x7fa4a409e340 2023-09-30T22:21:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.922+0000 7fa49affd700 1 -- 172.21.15.154:0/2109507427 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fa4a003b850 con 0x7fa4a409e340 2023-09-30T22:21:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.924+0000 7fa4aa0dd700 1 -- 172.21.15.154:0/2109507427 >> v1:172.21.15.154:6816/118163 conn(0x7fa48802c1b0 legacy=0x7fa48802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:44.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.930+0000 7fa49affd700 1 -- 172.21.15.154:0/2109507427 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa4a000f8d0 con 0x7fa4a409e340 2023-09-30T22:21:44.950 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:44.950+0000 7fcc03fd2240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:21:44.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.998+0000 7fb910427700 1 Processor -- start 2023-09-30T22:21:44.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.999+0000 7fb910427700 1 -- start start 2023-09-30T22:21:45.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.999+0000 7fb910427700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9081368b0 0x7fb908138c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.999+0000 7fb910427700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 0x7fb90813b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.999+0000 7fb910427700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90809ac40 con 0x7fb90812cef0 2023-09-30T22:21:45.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.999+0000 7fb910427700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90809a740 con 0x7fb9081368b0 2023-09-30T22:21:45.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:44.999+0000 7fb910427700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb90812d9d0 con 0x7fb9081391d0 2023-09-30T22:21:45.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90e1c3700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb90812cef0 0x7fb90812d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57604/0 (socket says 172.21.15.154:57604) 2023-09-30T22:21:45.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90e1c3700 1 -- 172.21.15.154:0/2260261219 learned_addr learned my addr 172.21.15.154:0/2260261219 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:45.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90e9c4700 1 --2- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 0x7fb90813b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90d9c2700 1 --2- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9081368b0 0x7fb908138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90d1c1700 1 -- 172.21.15.154:0/2260261219 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197801089 0 0) 0x7fb90809ac40 con 0x7fb90812cef0 2023-09-30T22:21:45.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90d1c1700 1 -- 172.21.15.154:0/2260261219 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f40035b0 con 0x7fb90812cef0 2023-09-30T22:21:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90d9c2700 1 -- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 msgr2=0x7fb90813b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90d9c2700 1 --2- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 0x7fb90813b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90d9c2700 1 -- 172.21.15.154:0/2260261219 >> v1:172.21.15.154:6789/0 conn(0x7fb90812cef0 legacy=0x7fb90812d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.000+0000 7fb90d9c2700 1 -- 172.21.15.154:0/2260261219 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90809f3a0 con 0x7fb9081368b0 2023-09-30T22:21:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.001+0000 7fb90e9c4700 1 --2- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 0x7fb90813b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.001+0000 7fb90d9c2700 1 --2- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9081368b0 0x7fb908138c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009870 tx=0x7fb8f8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=754cbb992c2f8770 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.001+0000 7fb90d1c1700 1 -- 172.21.15.154:0/2260261219 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8011830 con 0x7fb9081368b0 2023-09-30T22:21:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.001+0000 7fb90d1c1700 1 -- 172.21.15.154:0/2260261219 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f8011990 con 0x7fb9081368b0 2023-09-30T22:21:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.001+0000 7fb90d1c1700 1 -- 172.21.15.154:0/2260261219 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8011d20 con 0x7fb9081368b0 2023-09-30T22:21:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.002+0000 7fb910427700 1 -- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9081368b0 msgr2=0x7fb908138c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.002+0000 7fb910427700 1 --2- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9081368b0 0x7fb908138c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009870 tx=0x7fb8f8009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.002+0000 7fb910427700 1 -- 172.21.15.154:0/2260261219 shutdown_connections 2023-09-30T22:21:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.002+0000 7fb910427700 1 --2- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 0x7fb90813b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.002+0000 7fb910427700 1 --2- 172.21.15.154:0/2260261219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9081368b0 0x7fb908138c90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.002+0000 7fb910427700 1 -- 172.21.15.154:0/2260261219 >> 172.21.15.154:0/2260261219 conn(0x7fb908099c40 msgr2=0x7fb9080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.002+0000 7fb910427700 1 -- 172.21.15.154:0/2260261219 shutdown_connections 2023-09-30T22:21:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.002+0000 7fb910427700 1 -- 172.21.15.154:0/2260261219 wait complete. 2023-09-30T22:21:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.003+0000 7fb910427700 1 Processor -- start 2023-09-30T22:21:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.004+0000 7fb910427700 1 -- start start 2023-09-30T22:21:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.004+0000 7fb910427700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb90812cef0 0x7fb90812c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.004+0000 7fb910427700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9081368b0 0x7fb90812e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.004+0000 7fb910427700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 0x7fb90812e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.004+0000 7fb910427700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb908072750 con 0x7fb9081368b0 2023-09-30T22:21:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.004+0000 7fb910427700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080a2f30 con 0x7fb90812cef0 2023-09-30T22:21:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.004+0000 7fb910427700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb90806f9e0 con 0x7fb9081391d0 2023-09-30T22:21:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.004+0000 7fb90d9c2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9081368b0 0x7fb90812e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90d9c2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9081368b0 0x7fb90812e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36294/0 (socket says 172.21.15.154:36294) 2023-09-30T22:21:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90d9c2700 1 -- 172.21.15.154:0/2300771758 learned_addr learned my addr 172.21.15.154:0/2300771758 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90e9c4700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 0x7fb90812e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90d9c2700 1 -- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 msgr2=0x7fb90812e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90d9c2700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 0x7fb90812e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90d9c2700 1 -- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb90812cef0 msgr2=0x7fb90812c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90e1c3700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb90812cef0 0x7fb90812c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90d9c2700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb90812cef0 0x7fb90812c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90d9c2700 1 -- 172.21.15.154:0/2300771758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb900009a70 con 0x7fb9081368b0 2023-09-30T22:21:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90e1c3700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb90812cef0 0x7fb90812c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:21:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.005+0000 7fb90d9c2700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9081368b0 0x7fb90812e1b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80090b0 tx=0x7fb8f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.009+0000 7fb8feffd700 1 -- 172.21.15.154:0/2300771758 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8004590 con 0x7fb9081368b0 2023-09-30T22:21:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.009+0000 7fb8feffd700 1 -- 172.21.15.154:0/2300771758 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f801f070 con 0x7fb9081368b0 2023-09-30T22:21:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.009+0000 7fb8feffd700 1 -- 172.21.15.154:0/2300771758 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f80038e0 con 0x7fb9081368b0 2023-09-30T22:21:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.009+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f80094a0 con 0x7fb9081368b0 2023-09-30T22:21:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.009+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90806f060 con 0x7fb9081368b0 2023-09-30T22:21:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.010+0000 7fb8feffd700 1 -- 172.21.15.154:0/2300771758 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fb8f8003a40 con 0x7fb9081368b0 2023-09-30T22:21:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.010+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90804f2a0 con 0x7fb9081368b0 2023-09-30T22:21:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.010+0000 7fb8feffd700 1 -- 172.21.15.154:0/2300771758 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fb8f8021070 con 0x7fb9081368b0 2023-09-30T22:21:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.010+0000 7fb90e1c3700 1 -- 172.21.15.154:0/2300771758 >> v1:172.21.15.154:6816/118163 conn(0x7fb8ec02c200 legacy=0x7fb8ec02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.015+0000 7fb8feffd700 1 -- 172.21.15.154:0/2300771758 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb8f80253e0 con 0x7fb9081368b0 2023-09-30T22:21:45.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.041+0000 7f16f77fe700 1 -- 172.21.15.154:0/1903158028 >> v1:172.21.15.154:6816/118163 conn(0x7f16e402c1b0 legacy=0x7f16e402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:45.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.068+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16f811c330 con 0x7f16f809dea0 2023-09-30T22:21:45.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.068+0000 7f16dffff700 1 -- 172.21.15.154:0/1903158028 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16f811c330 con 0x7f16f809dea0 2023-09-30T22:21:45.068 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:45.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.071+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 >> v1:172.21.15.154:6816/118163 conn(0x7f16e402c1b0 legacy=0x7f16e402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:45.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.071+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f809dea0 msgr2=0x7f16f81d5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.071+0000 7f16fdd7e700 1 --2- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f809dea0 0x7f16f81d5bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009c40 tx=0x7f16ec004750 comp rx=0 tx=0).stop 2023-09-30T22:21:45.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.071+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 shutdown_connections 2023-09-30T22:21:45.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.071+0000 7f16fdd7e700 1 --2- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f8134f00 0x7f16f81ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.071+0000 7f16fdd7e700 1 --2- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f806a770 0x7f16f81d5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.071+0000 7f16fdd7e700 1 --2- 172.21.15.154:0/1903158028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f809dea0 0x7f16f81d5bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.071+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 >> 172.21.15.154:0/1903158028 conn(0x7f16f8099c40 msgr2=0x7f16f809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.072+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 shutdown_connections 2023-09-30T22:21:45.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.072+0000 7f16fdd7e700 1 -- 172.21.15.154:0/1903158028 wait complete. 2023-09-30T22:21:45.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-09-30T22:21:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.101+0000 7f312effd700 1 -- 172.21.15.154:0/3758273778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f311c005590 con 0x7f31440a1340 2023-09-30T22:21:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.102+0000 7f31417fa700 1 -- 172.21.15.154:0/3758273778 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f313001eb50 con 0x7f31440a1340 2023-09-30T22:21:45.101 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:45.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.103+0000 7f312effd700 1 -- 172.21.15.154:0/3758273778 >> v1:172.21.15.154:6816/118163 conn(0x7f312802c1b0 legacy=0x7f312802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:45.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.103+0000 7f312effd700 1 -- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31440a1340 msgr2=0x7f314411faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.103+0000 7f312effd700 1 --2- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31440a1340 0x7f314411faf0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31440a2000 tx=0x7f3130004750 comp rx=0 tx=0).stop 2023-09-30T22:21:45.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.103+0000 7f312effd700 1 -- 172.21.15.154:0/3758273778 shutdown_connections 2023-09-30T22:21:45.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.103+0000 7f312effd700 1 --2- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31441304a0 0x7f3144120030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.103+0000 7f312effd700 1 --2- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31440a0a30 0x7f314411f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.104+0000 7f312effd700 1 --2- 172.21.15.154:0/3758273778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31440a1340 0x7f314411faf0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.104+0000 7f312effd700 1 -- 172.21.15.154:0/3758273778 >> 172.21.15.154:0/3758273778 conn(0x7f31440a2980 msgr2=0x7f31441b78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.104+0000 7f312effd700 1 -- 172.21.15.154:0/3758273778 shutdown_connections 2023-09-30T22:21:45.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.104+0000 7f312effd700 1 -- 172.21.15.154:0/3758273778 wait complete. 2023-09-30T22:21:45.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-09-30T22:21:45.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.125+0000 7fa4aa0dd700 1 -- 172.21.15.154:0/2109507427 >> v1:172.21.15.154:6816/118163 conn(0x7fa48802c1b0 legacy=0x7fa48802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:45.130 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:45.130+0000 7fcc03fd2240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:21:45.204 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:45.204+0000 7fcc03fd2240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:21:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.211+0000 7fb90e1c3700 1 -- 172.21.15.154:0/2300771758 >> v1:172.21.15.154:6816/118163 conn(0x7fb8ec02c200 legacy=0x7fb8ec02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.211+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4a40717c0 con 0x7fa4a409e340 2023-09-30T22:21:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.211+0000 7fa49affd700 1 -- 172.21.15.154:0/2109507427 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4a000f2e0 con 0x7fa4a409e340 2023-09-30T22:21:45.211 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 >> v1:172.21.15.154:6816/118163 conn(0x7fa48802c1b0 legacy=0x7fa48802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a409e340 msgr2=0x7fa4a4132e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 --2- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a409e340 0x7fa4a4132e50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000b500 tx=0x7fa4a000b810 comp rx=0 tx=0).stop 2023-09-30T22:21:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 shutdown_connections 2023-09-30T22:21:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 --2- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a4135f20 0x7fa4a4133390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 --2- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a409d860 0x7fa4a4132910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 --2- 172.21.15.154:0/2109507427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a409e340 0x7fa4a4132e50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 >> 172.21.15.154:0/2109507427 conn(0x7fa4a4099c40 msgr2=0x7fa4a406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 shutdown_connections 2023-09-30T22:21:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.213+0000 7fa4ac341700 1 -- 172.21.15.154:0/2109507427 wait complete. 2023-09-30T22:21:45.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-09-30T22:21:45.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.265+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb90806f3d0 con 0x7fb9081368b0 2023-09-30T22:21:45.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.266+0000 7fb8feffd700 1 -- 172.21.15.154:0/2300771758 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8f8015070 con 0x7fb9081368b0 2023-09-30T22:21:45.271 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:45.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 >> v1:172.21.15.154:6816/118163 conn(0x7fb8ec02c200 legacy=0x7fb8ec02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:45.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9081368b0 msgr2=0x7fb90812e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:45.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9081368b0 0x7fb90812e1b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80090b0 tx=0x7fb8f8004750 comp rx=0 tx=0).stop 2023-09-30T22:21:45.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 shutdown_connections 2023-09-30T22:21:45.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9081391d0 0x7fb90812e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb90812cef0 0x7fb90812c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 --2- 172.21.15.154:0/2300771758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9081368b0 0x7fb90812e1b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:45.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 >> 172.21.15.154:0/2300771758 conn(0x7fb908099c40 msgr2=0x7fb90809c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:45.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 shutdown_connections 2023-09-30T22:21:45.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:45.268+0000 7fb910427700 1 -- 172.21.15.154:0/2300771758 wait complete. 2023-09-30T22:21:45.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-09-30T22:21:45.850 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:45.850+0000 7fcc03fd2240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:21:45.972 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:45.972+0000 7fcc03fd2240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:21:46.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:46.086 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:46.086+0000 7fcc03fd2240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:21:46.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:46.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.215+0000 7f116c77b700 1 Processor -- start 2023-09-30T22:21:46.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.215+0000 7f116c77b700 1 -- start start 2023-09-30T22:21:46.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116c77b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f116406a770 0x7f116406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116c77b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406b080 0x7f11641317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116c77b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 0x7f1164132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116c77b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116409f770 con 0x7f116406a770 2023-09-30T22:21:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116c77b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116409dce0 con 0x7f116406b080 2023-09-30T22:21:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116c77b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f116409da80 con 0x7f1164131cf0 2023-09-30T22:21:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f1169d16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406b080 0x7f11641317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116a517700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f116406a770 0x7f116406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f1169d16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406b080 0x7f11641317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49440/0 (socket says 172.21.15.154:49440) 2023-09-30T22:21:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f1169d16700 1 -- 172.21.15.154:0/425867712 learned_addr learned my addr 172.21.15.154:0/425867712 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116ad18700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 0x7f1164132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116a517700 1 -- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 msgr2=0x7f1164132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116a517700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 0x7f1164132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116a517700 1 -- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406b080 msgr2=0x7f11641317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116a517700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406b080 0x7f11641317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116a517700 1 -- 172.21.15.154:0/425867712 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116409eb20 con 0x7f116406a770 2023-09-30T22:21:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f1169d16700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406b080 0x7f11641317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116ad18700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 0x7f1164132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f116a517700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406a770 0x7f116406ab40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1160009840 tx=0x7f1160009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c882b0c7d6408e54 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.216+0000 7f1169515700 1 -- 172.21.15.154:0/425867712 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160011830 con 0x7f116406a770 2023-09-30T22:21:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f1169515700 1 -- 172.21.15.154:0/425867712 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160011990 con 0x7f116406a770 2023-09-30T22:21:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f1169515700 1 -- 172.21.15.154:0/425867712 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160011d20 con 0x7f116406a770 2023-09-30T22:21:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f116c77b700 1 -- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406a770 msgr2=0x7f116406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f116c77b700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406a770 0x7f116406ab40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1160009840 tx=0x7f1160009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f116c77b700 1 -- 172.21.15.154:0/425867712 shutdown_connections 2023-09-30T22:21:46.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f116c77b700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 0x7f1164132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f116c77b700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406a770 0x7f116406ab40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f116c77b700 1 --2- 172.21.15.154:0/425867712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406b080 0x7f11641317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f116c77b700 1 -- 172.21.15.154:0/425867712 >> 172.21.15.154:0/425867712 conn(0x7f1164099c40 msgr2=0x7f11640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f116c77b700 1 -- 172.21.15.154:0/425867712 shutdown_connections 2023-09-30T22:21:46.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.217+0000 7f116c77b700 1 -- 172.21.15.154:0/425867712 wait complete. 2023-09-30T22:21:46.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.218+0000 7f116c77b700 1 Processor -- start 2023-09-30T22:21:46.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.218+0000 7f116c77b700 1 -- start start 2023-09-30T22:21:46.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116c77b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406a770 0x7f11641c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116c77b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406b080 0x7f11641c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116c77b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 0x7f11641c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116c77b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116409b900 con 0x7f116406b080 2023-09-30T22:21:46.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116c77b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1164121820 con 0x7f116406a770 2023-09-30T22:21:46.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116c77b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1164120ad0 con 0x7f1164131cf0 2023-09-30T22:21:46.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116a517700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406a770 0x7f11641c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f1169d16700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406b080 0x7f11641c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116a517700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406a770 0x7f11641c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49442/0 (socket says 172.21.15.154:49442) 2023-09-30T22:21:46.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116a517700 1 -- 172.21.15.154:0/343054315 learned_addr learned my addr 172.21.15.154:0/343054315 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:46.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116ad18700 1 --2- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 0x7f11641c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116a517700 1 -- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 msgr2=0x7f11641c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116a517700 1 --2- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 0x7f11641c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116a517700 1 -- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406b080 msgr2=0x7f11641c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116a517700 1 --2- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406b080 0x7f11641c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116a517700 1 -- 172.21.15.154:0/343054315 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1154009550 con 0x7f116406a770 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f1169d16700 1 --2- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406b080 0x7f11641c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f116a517700 1 --2- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406a770 0x7f11641c86a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11600090b0 tx=0x7f1160004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f115affd700 1 -- 172.21.15.154:0/343054315 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160004450 con 0x7f116406a770 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.219+0000 7f115affd700 1 -- 172.21.15.154:0/343054315 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116001f070 con 0x7f116406a770 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.220+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115c009a70 con 0x7f116406a770 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.220+0000 7f115affd700 1 -- 172.21.15.154:0/343054315 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600038e0 con 0x7f116406a770 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.220+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11600094a0 con 0x7f116406a770 2023-09-30T22:21:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.220+0000 7f115affd700 1 -- 172.21.15.154:0/343054315 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f1160003a40 con 0x7f116406a770 2023-09-30T22:21:46.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.221+0000 7f115affd700 1 -- 172.21.15.154:0/343054315 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f1160021070 con 0x7f116406a770 2023-09-30T22:21:46.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.221+0000 7f1169d16700 1 -- 172.21.15.154:0/343054315 >> v1:172.21.15.154:6816/118163 conn(0x7f114802c1b0 legacy=0x7f114802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:46.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.221+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1164071e70 con 0x7f116406a770 2023-09-30T22:21:46.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.225+0000 7f115affd700 1 -- 172.21.15.154:0/343054315 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f116002b080 con 0x7f116406a770 2023-09-30T22:21:46.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.264+0000 7f37bf5a0700 1 Processor -- start 2023-09-30T22:21:46.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.264+0000 7f37bf5a0700 1 -- start start 2023-09-30T22:21:46.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bf5a0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809d860 0x7f37b809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bf5a0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f37b809e170 0x7f37b81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bf5a0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b809aaa0 con 0x7f37b8130ce0 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bf5a0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b809f870 con 0x7f37b809e170 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bf5a0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b809b360 con 0x7f37b809d860 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bcb3b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f37b809e170 0x7f37b81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bdb3d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f37b8130ce0 0x7f37b81379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57126/0 (socket says 172.21.15.154:57126) 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bdb3d700 1 -- 172.21.15.154:0/2787014616 learned_addr learned my addr 172.21.15.154:0/2787014616 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bd33c700 1 --2- 172.21.15.154:0/2787014616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809d860 0x7f37b809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bcb3b700 1 -- 172.21.15.154:0/2787014616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809d860 msgr2=0x7f37b809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bcb3b700 1 --2- 172.21.15.154:0/2787014616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809d860 0x7f37b809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bcb3b700 1 -- 172.21.15.154:0/2787014616 >> v1:172.21.15.154:6789/0 conn(0x7f37b8130ce0 legacy=0x7f37b81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37affff700 1 -- 172.21.15.154:0/2787014616 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521186461 0 0) 0x7f37b809aaa0 con 0x7f37b8130ce0 2023-09-30T22:21:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bcb3b700 1 -- 172.21.15.154:0/2787014616 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b809b620 con 0x7f37b809e170 2023-09-30T22:21:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bd33c700 1 --2- 172.21.15.154:0/2787014616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809d860 0x7f37b809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:21:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.265+0000 7f37bcb3b700 1 --2- 172.21.15.154:0/2787014616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b809e170 0x7f37b81307a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f37a800bae0 tx=0x7f37a800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af06ac260207f5b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.266+0000 7f37affff700 1 -- 172.21.15.154:0/2787014616 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a800dd30 con 0x7f37b809e170 2023-09-30T22:21:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.266+0000 7f37affff700 1 -- 172.21.15.154:0/2787014616 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a800de90 con 0x7f37b809e170 2023-09-30T22:21:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.266+0000 7f37affff700 1 -- 172.21.15.154:0/2787014616 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8010690 con 0x7f37b809e170 2023-09-30T22:21:46.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.266+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2787014616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b809e170 msgr2=0x7f37b81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.266+0000 7f37bf5a0700 1 --2- 172.21.15.154:0/2787014616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b809e170 0x7f37b81307a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f37a800bae0 tx=0x7f37a800bdf0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.266+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2787014616 shutdown_connections 2023-09-30T22:21:46.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.266+0000 7f37bf5a0700 1 --2- 172.21.15.154:0/2787014616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809d860 0x7f37b809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.266+0000 7f37bf5a0700 1 --2- 172.21.15.154:0/2787014616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b809e170 0x7f37b81307a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.266+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2787014616 >> 172.21.15.154:0/2787014616 conn(0x7f37b8099c40 msgr2=0x7f37b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.267+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2787014616 shutdown_connections 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.267+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2787014616 wait complete. 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.268+0000 7f37bf5a0700 1 Processor -- start 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.268+0000 7f37bf5a0700 1 -- start start 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.268+0000 7f37bf5a0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37b809d860 0x7f37b811e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.268+0000 7f37bf5a0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809e170 0x7f37b811e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.268+0000 7f37bf5a0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b8130ce0 0x7f37b811ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.268+0000 7f37bf5a0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81200b0 con 0x7f37b8130ce0 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.268+0000 7f37bf5a0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81206d0 con 0x7f37b809e170 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bf5a0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37b8130400 con 0x7f37b809d860 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bcb3b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809e170 0x7f37b811e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bcb3b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809e170 0x7f37b811e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49458/0 (socket says 172.21.15.154:49458) 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bcb3b700 1 -- 172.21.15.154:0/2853777249 learned_addr learned my addr 172.21.15.154:0/2853777249 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bdb3d700 1 --2- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b8130ce0 0x7f37b811ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bdb3d700 1 -- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37b809d860 msgr2=0x7f37b811e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bdb3d700 1 --2- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37b809d860 0x7f37b811e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bdb3d700 1 -- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809e170 msgr2=0x7f37b811e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bdb3d700 1 --2- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809e170 0x7f37b811e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bdb3d700 1 -- 172.21.15.154:0/2853777249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a800b740 con 0x7f37b8130ce0 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bcb3b700 1 --2- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809e170 0x7f37b811e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37bdb3d700 1 --2- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b8130ce0 0x7f37b811ef20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37b000cc10 tx=0x7f37b000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.269+0000 7f37adffb700 1 -- 172.21.15.154:0/2853777249 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b000ab10 con 0x7f37b8130ce0 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.270+0000 7f37adffb700 1 -- 172.21.15.154:0/2853777249 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b000ac70 con 0x7f37b8130ce0 2023-09-30T22:21:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.270+0000 7f37adffb700 1 -- 172.21.15.154:0/2853777249 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b00070d0 con 0x7f37b8130ce0 2023-09-30T22:21:46.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.270+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b8121fc0 con 0x7f37b8130ce0 2023-09-30T22:21:46.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.270+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b80a2010 con 0x7f37b8130ce0 2023-09-30T22:21:46.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.270+0000 7f37adffb700 1 -- 172.21.15.154:0/2853777249 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f37b0007230 con 0x7f37b8130ce0 2023-09-30T22:21:46.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.271+0000 7f37bd33c700 1 -- 172.21.15.154:0/2853777249 >> v1:172.21.15.154:6816/118163 conn(0x7f379c02c1e0 legacy=0x7f379c02e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:46.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.271+0000 7f37adffb700 1 -- 172.21.15.154:0/2853777249 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f37b0012400 con 0x7f37b8130ce0 2023-09-30T22:21:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.271+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b804f2a0 con 0x7f37b8130ce0 2023-09-30T22:21:46.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.275+0000 7f37adffb700 1 -- 172.21.15.154:0/2853777249 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f37b0011950 con 0x7f37b8130ce0 2023-09-30T22:21:46.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:46.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.371+0000 7f9357e51700 1 Processor -- start 2023-09-30T22:21:46.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.371+0000 7f9357e51700 1 -- start start 2023-09-30T22:21:46.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.372+0000 7f9357e51700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f935009a130 0x7f935009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.372+0000 7f9357e51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935013fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.372+0000 7f9357e51700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9350072b30 con 0x7f935009edb0 2023-09-30T22:21:46.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.372+0000 7f9357e51700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935009a500 con 0x7f935009a130 2023-09-30T22:21:46.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.372+0000 7f9357e51700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f935009ada0 con 0x7f935009f1e0 2023-09-30T22:21:46.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.372+0000 7f93553ec700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f935009edb0 0x7f935013c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57134/0 (socket says 172.21.15.154:57134) 2023-09-30T22:21:46.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.372+0000 7f93553ec700 1 -- 172.21.15.154:0/2326955438 learned_addr learned my addr 172.21.15.154:0/2326955438 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:46.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.372+0000 7f9355bed700 1 --2- 172.21.15.154:0/2326955438 >> v2:172.21.15.154:3300/0 conn(0x7f935009a130 0x7f935009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.372+0000 7f93563ee700 1 --2- 172.21.15.154:0/2326955438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935013fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.373+0000 7f93563ee700 1 -- 172.21.15.154:0/2326955438 >> v2:172.21.15.154:3300/0 conn(0x7f935009a130 msgr2=0x7f935009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:46.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.373+0000 7f93563ee700 1 --2- 172.21.15.154:0/2326955438 >> v2:172.21.15.154:3300/0 conn(0x7f935009a130 0x7f935009e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.373+0000 7f93563ee700 1 -- 172.21.15.154:0/2326955438 >> v1:172.21.15.154:6789/0 conn(0x7f935009edb0 legacy=0x7f935013c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.373+0000 7f93563ee700 1 -- 172.21.15.154:0/2326955438 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935009fe00 con 0x7f935009f1e0 2023-09-30T22:21:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.373+0000 7f9354beb700 1 -- 172.21.15.154:0/2326955438 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174279486 0 0) 0x7f9350072b30 con 0x7f935009edb0 2023-09-30T22:21:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.373+0000 7f93563ee700 1 --2- 172.21.15.154:0/2326955438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935013fb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9348009d90 tx=0x7f934800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3414d22bb591fd71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.373+0000 7f9354beb700 1 -- 172.21.15.154:0/2326955438 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800e070 con 0x7f935009f1e0 2023-09-30T22:21:46.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.373+0000 7f9354beb700 1 -- 172.21.15.154:0/2326955438 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800bb20 con 0x7f935009f1e0 2023-09-30T22:21:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.373+0000 7f9354beb700 1 -- 172.21.15.154:0/2326955438 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348012430 con 0x7f935009f1e0 2023-09-30T22:21:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.374+0000 7f9357e51700 1 -- 172.21.15.154:0/2326955438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 msgr2=0x7f935013fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.374+0000 7f9357e51700 1 --2- 172.21.15.154:0/2326955438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935013fb40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9348009d90 tx=0x7f934800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.374+0000 7f9357e51700 1 -- 172.21.15.154:0/2326955438 shutdown_connections 2023-09-30T22:21:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.374+0000 7f9357e51700 1 --2- 172.21.15.154:0/2326955438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935013fb40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.374+0000 7f9357e51700 1 --2- 172.21.15.154:0/2326955438 >> v2:172.21.15.154:3300/0 conn(0x7f935009a130 0x7f935009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.374+0000 7f9357e51700 1 -- 172.21.15.154:0/2326955438 >> 172.21.15.154:0/2326955438 conn(0x7f93500a4430 msgr2=0x7f93500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.374+0000 7f9357e51700 1 -- 172.21.15.154:0/2326955438 shutdown_connections 2023-09-30T22:21:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.374+0000 7f9357e51700 1 -- 172.21.15.154:0/2326955438 wait complete. 2023-09-30T22:21:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.375+0000 7f9357e51700 1 Processor -- start 2023-09-30T22:21:46.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.375+0000 7f9357e51700 1 -- start start 2023-09-30T22:21:46.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f9357e51700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935009a130 0x7f935011b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f9357e51700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935009edb0 0x7f935012dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f9357e51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935012e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f9357e51700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935011c620 con 0x7f935009edb0 2023-09-30T22:21:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f9357e51700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935011c430 con 0x7f935009a130 2023-09-30T22:21:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f9357e51700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f935011e340 con 0x7f935009f1e0 2023-09-30T22:21:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f93553ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935009edb0 0x7f935012dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f93563ee700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935012e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f93553ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935009edb0 0x7f935012dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40760/0 (socket says 172.21.15.154:40760) 2023-09-30T22:21:46.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.376+0000 7f93553ec700 1 -- 172.21.15.154:0/422321344 learned_addr learned my addr 172.21.15.154:0/422321344 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93553ec700 1 -- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 msgr2=0x7f935012e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93553ec700 1 --2- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935012e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93553ec700 1 -- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935009a130 msgr2=0x7f935011b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93553ec700 1 --2- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935009a130 0x7f935011b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93553ec700 1 -- 172.21.15.154:0/422321344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9348009a70 con 0x7f935009edb0 2023-09-30T22:21:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93563ee700 1 --2- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935012e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93553ec700 1 --2- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935009edb0 0x7f935012dda0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f934000c520 tx=0x7f934000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93467fc700 1 -- 172.21.15.154:0/422321344 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340004c80 con 0x7f935009edb0 2023-09-30T22:21:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93467fc700 1 -- 172.21.15.154:0/422321344 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340004de0 con 0x7f935009edb0 2023-09-30T22:21:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f93467fc700 1 -- 172.21.15.154:0/422321344 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340007310 con 0x7f935009edb0 2023-09-30T22:21:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93500a00f0 con 0x7f935009edb0 2023-09-30T22:21:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.377+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935011e060 con 0x7f935009edb0 2023-09-30T22:21:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.378+0000 7f93467fc700 1 -- 172.21.15.154:0/422321344 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9340007470 con 0x7f935009edb0 2023-09-30T22:21:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.378+0000 7f93467fc700 1 -- 172.21.15.154:0/422321344 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f934003b4c0 con 0x7f935009edb0 2023-09-30T22:21:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.379+0000 7f9355bed700 1 -- 172.21.15.154:0/422321344 >> v1:172.21.15.154:6816/118163 conn(0x7f933402c1b0 legacy=0x7f933402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:46.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.379+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935011dec0 con 0x7f935009edb0 2023-09-30T22:21:46.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.383+0000 7f93467fc700 1 -- 172.21.15.154:0/422321344 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f935011dec0 con 0x7f935009edb0 2023-09-30T22:21:46.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.414+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f116409d2f0 con 0x7f116406a770 2023-09-30T22:21:46.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.414+0000 7f115affd700 1 -- 172.21.15.154:0/343054315 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1160015020 con 0x7f116406a770 2023-09-30T22:21:46.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.415+0000 7f62a2290700 1 Processor -- start 2023-09-30T22:21:46.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.415+0000 7f62a2290700 1 -- start start 2023-09-30T22:21:46.416 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.415+0000 7f62a2290700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 0x7f629c0a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.415+0000 7f62a2290700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f629c131180 0x7f629c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.415+0000 7f62a2290700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c0a1e70 con 0x7f629c066410 2023-09-30T22:21:46.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.415+0000 7f62a2290700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c09a720 con 0x7f629c131180 2023-09-30T22:21:46.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.415+0000 7f62a2290700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c09b300 con 0x7f629c0667e0 2023-09-30T22:21:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f629bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f629c066410 0x7f629c0a0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57144/0 (socket says 172.21.15.154:57144) 2023-09-30T22:21:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f62937fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 0x7f629c0a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f629bfff700 1 -- 172.21.15.154:0/1476125309 learned_addr learned my addr 172.21.15.154:0/1476125309 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f62a082d700 1 --2- 172.21.15.154:0/1476125309 >> v2:172.21.15.154:3300/0 conn(0x7f629c131180 0x7f629c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f629b7fe700 1 -- 172.21.15.154:0/1476125309 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246463703 0 0) 0x7f629c0a1e70 con 0x7f629c066410 2023-09-30T22:21:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f629b7fe700 1 -- 172.21.15.154:0/1476125309 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62880035b0 con 0x7f629c066410 2023-09-30T22:21:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f62a082d700 1 -- 172.21.15.154:0/1476125309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 msgr2=0x7f629c0a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f62a082d700 1 --2- 172.21.15.154:0/1476125309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 0x7f629c0a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f62a082d700 1 -- 172.21.15.154:0/1476125309 >> v1:172.21.15.154:6789/0 conn(0x7f629c066410 legacy=0x7f629c0a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f62a082d700 1 -- 172.21.15.154:0/1476125309 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c09abc0 con 0x7f629c131180 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.416+0000 7f62a082d700 1 --2- 172.21.15.154:0/1476125309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f629c131180 0x7f629c131600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6294009d90 tx=0x7f629400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec689a5fdd3f8462 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f629b7fe700 1 -- 172.21.15.154:0/1476125309 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629400e070 con 0x7f629c131180 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f629b7fe700 1 -- 172.21.15.154:0/1476125309 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629400bb20 con 0x7f629c131180 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f629b7fe700 1 -- 172.21.15.154:0/1476125309 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294012430 con 0x7f629c131180 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f62a2290700 1 -- 172.21.15.154:0/1476125309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f629c131180 msgr2=0x7f629c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f62a2290700 1 --2- 172.21.15.154:0/1476125309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f629c131180 0x7f629c131600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6294009d90 tx=0x7f629400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f62a2290700 1 -- 172.21.15.154:0/1476125309 shutdown_connections 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f62a2290700 1 --2- 172.21.15.154:0/1476125309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f629c131180 0x7f629c131600 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f62a2290700 1 --2- 172.21.15.154:0/1476125309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 0x7f629c0a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f62a2290700 1 -- 172.21.15.154:0/1476125309 >> 172.21.15.154:0/1476125309 conn(0x7f629c0a2980 msgr2=0x7f629c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f62a2290700 1 -- 172.21.15.154:0/1476125309 shutdown_connections 2023-09-30T22:21:46.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.417+0000 7f62a2290700 1 -- 172.21.15.154:0/1476125309 wait complete. 2023-09-30T22:21:46.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.418+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 >> v1:172.21.15.154:6816/118163 conn(0x7f114802c1b0 legacy=0x7f114802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:46.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.418+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406a770 msgr2=0x7f11641c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.418+0000 7f116c77b700 1 --2- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406a770 0x7f11641c86a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11600090b0 tx=0x7f1160004750 comp rx=0 tx=0).stop 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.418+0000 7f62a2290700 1 Processor -- start 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.418+0000 7f62a2290700 1 -- start start 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62a2290700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f629c066410 0x7f629c136340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62a2290700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 0x7f629c136880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62a2290700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629c131180 0x7f629c136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62a2290700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c1391f0 con 0x7f629c066410 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62a2290700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c13a320 con 0x7f629c0667e0 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62a2290700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f629c09ae00 con 0x7f629c131180 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62a082d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629c131180 0x7f629c136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62a082d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629c131180 0x7f629c136dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59522/0 (socket says 172.21.15.154:59522) 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62a082d700 1 -- 172.21.15.154:0/1055216199 learned_addr learned my addr 172.21.15.154:0/1055216199 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f62937fe700 1 --2- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 0x7f629c136880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.419+0000 7f629bfff700 1 --2- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f629c066410 0x7f629c136340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62a082d700 1 -- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 msgr2=0x7f629c136880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62a082d700 1 --2- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 0x7f629c136880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62a082d700 1 -- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f629c066410 msgr2=0x7f629c136340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62a082d700 1 --2- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f629c066410 0x7f629c136340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62a082d700 1 -- 172.21.15.154:0/1055216199 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6294009a70 con 0x7f629c131180 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62a082d700 1 --2- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629c131180 0x7f629c136dc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f629c0a2000 tx=0x7f6294004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62997fa700 1 -- 172.21.15.154:0/1055216199 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294004780 con 0x7f629c131180 2023-09-30T22:21:46.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62997fa700 1 -- 172.21.15.154:0/1055216199 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6294020070 con 0x7f629c131180 2023-09-30T22:21:46.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62997fa700 1 -- 172.21.15.154:0/1055216199 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62940276c0 con 0x7f629c131180 2023-09-30T22:21:46.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c138770 con 0x7f629c131180 2023-09-30T22:21:46.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.420+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c09fb50 con 0x7f629c131180 2023-09-30T22:21:46.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 shutdown_connections 2023-09-30T22:21:46.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f116c77b700 1 --2- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1164131cf0 0x7f11641c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f116c77b700 1 --2- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f116406a770 0x7f11641c86a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f116c77b700 1 --2- 172.21.15.154:0/343054315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f116406b080 0x7f11641c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 >> 172.21.15.154:0/343054315 conn(0x7f1164099c40 msgr2=0x7f11640a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f62997fa700 1 -- 172.21.15.154:0/1055216199 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f6294027820 con 0x7f629c131180 2023-09-30T22:21:46.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f62997fa700 1 -- 172.21.15.154:0/1055216199 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f6294022070 con 0x7f629c131180 2023-09-30T22:21:46.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f629bfff700 1 -- 172.21.15.154:0/1055216199 >> v1:172.21.15.154:6816/118163 conn(0x7f627c02c1b0 legacy=0x7f627c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:46.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 shutdown_connections 2023-09-30T22:21:46.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.421+0000 7f116c77b700 1 -- 172.21.15.154:0/343054315 wait complete. 2023-09-30T22:21:46.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.422+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c04f2a0 con 0x7f629c131180 2023-09-30T22:21:46.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.426+0000 7f62997fa700 1 -- 172.21.15.154:0/1055216199 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f629402c070 con 0x7f629c131180 2023-09-30T22:21:46.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-09-30T22:21:46.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.472+0000 7f37bd33c700 1 -- 172.21.15.154:0/2853777249 >> v1:172.21.15.154:6816/118163 conn(0x7f379c02c1e0 legacy=0x7f379c02e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/118163 2023-09-30T22:21:46.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.559+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f935011dec0 con 0x7f935009edb0 2023-09-30T22:21:46.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.560+0000 7f93467fc700 1 -- 172.21.15.154:0/422321344 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f935011dec0 con 0x7f935009edb0 2023-09-30T22:21:46.560 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 >> v1:172.21.15.154:6816/118163 conn(0x7f933402c1b0 legacy=0x7f933402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935009edb0 msgr2=0x7f935012dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 --2- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935009edb0 0x7f935012dda0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f934000c520 tx=0x7f934000c830 comp rx=0 tx=0).stop 2023-09-30T22:21:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 shutdown_connections 2023-09-30T22:21:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 --2- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f935009f1e0 0x7f935012e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 --2- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935009a130 0x7f935011b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 --2- 172.21.15.154:0/422321344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f935009edb0 0x7f935012dda0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 >> 172.21.15.154:0/422321344 conn(0x7f93500a4430 msgr2=0x7f93500a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 shutdown_connections 2023-09-30T22:21:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.562+0000 7f9357e51700 1 -- 172.21.15.154:0/422321344 wait complete. 2023-09-30T22:21:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.570+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37b806c3b0 con 0x7f37b8130ce0 2023-09-30T22:21:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.571+0000 7f37adffb700 1 -- 172.21.15.154:0/2853777249 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37b001a310 con 0x7f37b8130ce0 2023-09-30T22:21:46.571 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 >> v1:172.21.15.154:6816/118163 conn(0x7f379c02c1e0 legacy=0x7f379c02e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b8130ce0 msgr2=0x7f37b811ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 --2- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b8130ce0 0x7f37b811ef20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37b000cc10 tx=0x7f37b000cf20 comp rx=0 tx=0).stop 2023-09-30T22:21:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 shutdown_connections 2023-09-30T22:21:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 --2- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b8130ce0 0x7f37b811ef20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 --2- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37b809d860 0x7f37b811e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 --2- 172.21.15.154:0/2853777249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37b809e170 0x7f37b811e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 >> 172.21.15.154:0/2853777249 conn(0x7f37b8099c40 msgr2=0x7f37b80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 shutdown_connections 2023-09-30T22:21:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.573+0000 7f37bf5a0700 1 -- 172.21.15.154:0/2853777249 wait complete. 2023-09-30T22:21:46.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-09-30T22:21:46.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-09-30T22:21:46.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.600+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f629c06bce0 con 0x7f629c131180 2023-09-30T22:21:46.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.600+0000 7f62997fa700 1 -- 172.21.15.154:0/1055216199 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f629402c020 con 0x7f629c131180 2023-09-30T22:21:46.600 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:46.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 >> v1:172.21.15.154:6816/118163 conn(0x7f627c02c1b0 legacy=0x7f627c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:46.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629c131180 msgr2=0x7f629c136dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:46.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 --2- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629c131180 0x7f629c136dc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f629c0a2000 tx=0x7f6294004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 shutdown_connections 2023-09-30T22:21:46.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 --2- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629c131180 0x7f629c136dc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 --2- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f629c066410 0x7f629c136340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 --2- 172.21.15.154:0/1055216199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629c0667e0 0x7f629c136880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:46.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 >> 172.21.15.154:0/1055216199 conn(0x7f629c0a2980 msgr2=0x7f629c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:46.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 shutdown_connections 2023-09-30T22:21:46.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:46.603+0000 7f62a2290700 1 -- 172.21.15.154:0/1055216199 wait complete. 2023-09-30T22:21:46.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-09-30T22:21:46.776 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:46.776+0000 7fcc03fd2240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:21:46.895 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:46.895+0000 7fcc03fd2240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:21:47.047 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:47.047+0000 7fcc03fd2240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T22:21:47.150 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:47.151+0000 7fcc03fd2240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:21:47.300 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:47.301+0000 7fbad83df240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T22:21:47.434 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:47.449 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:47.446+0000 7fbad83df240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T22:21:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b890e700 1 Processor -- start 2023-09-30T22:21:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b890e700 1 -- start start 2023-09-30T22:21:47.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b890e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23b4133ad0 0x7f23b4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b890e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b890e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b406b2d0 con 0x7f23b41309f0 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b890e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b4133610 con 0x7f23b4133ad0 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b890e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b409a500 con 0x7f23b41300a0 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23b4133ad0 0x7f23b4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23b4133ad0 0x7f23b4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40802/0 (socket says 172.21.15.154:40802) 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.569+0000 7f23b259c700 1 -- 172.21.15.154:0/3253836378 learned_addr learned my addr 172.21.15.154:0/3253836378 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.570+0000 7f23b259c700 1 -- 172.21.15.154:0/3253836378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 msgr2=0x7f23b41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.570+0000 7f23b259c700 1 --2- 172.21.15.154:0/3253836378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.570+0000 7f23b259c700 1 -- 172.21.15.154:0/3253836378 >> v1:172.21.15.154:6789/0 conn(0x7f23b41309f0 legacy=0x7f23b413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.570+0000 7f23b259c700 1 -- 172.21.15.154:0/3253836378 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b41338b0 con 0x7f23b4133ad0 2023-09-30T22:21:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.570+0000 7f23b1d9b700 1 --2- 172.21.15.154:0/3253836378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.570+0000 7f23b259c700 1 --2- 172.21.15.154:0/3253836378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 0x7f23b4133ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23a80098f0 tx=0x7f23a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767223f125647867 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.570+0000 7f23b159a700 1 -- 172.21.15.154:0/3253836378 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8011830 con 0x7f23b4133ad0 2023-09-30T22:21:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.570+0000 7f23b159a700 1 -- 172.21.15.154:0/3253836378 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8011990 con 0x7f23b4133ad0 2023-09-30T22:21:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.570+0000 7f23b159a700 1 -- 172.21.15.154:0/3253836378 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8011d20 con 0x7f23b4133ad0 2023-09-30T22:21:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.571+0000 7f23b890e700 1 -- 172.21.15.154:0/3253836378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 msgr2=0x7f23b4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.571+0000 7f23b890e700 1 --2- 172.21.15.154:0/3253836378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 0x7f23b4133ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23a80098f0 tx=0x7f23a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.571+0000 7f23b890e700 1 -- 172.21.15.154:0/3253836378 shutdown_connections 2023-09-30T22:21:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.571+0000 7f23b890e700 1 --2- 172.21.15.154:0/3253836378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 0x7f23b4133ea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.571+0000 7f23b890e700 1 --2- 172.21.15.154:0/3253836378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.571+0000 7f23b890e700 1 -- 172.21.15.154:0/3253836378 >> 172.21.15.154:0/3253836378 conn(0x7f23b4099c40 msgr2=0x7f23b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.571+0000 7f23b890e700 1 -- 172.21.15.154:0/3253836378 shutdown_connections 2023-09-30T22:21:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.571+0000 7f23b890e700 1 -- 172.21.15.154:0/3253836378 wait complete. 2023-09-30T22:21:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b890e700 1 Processor -- start 2023-09-30T22:21:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b890e700 1 -- start start 2023-09-30T22:21:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b890e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b890e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23b41309f0 0x7f23b411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b890e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 0x7f23b411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b890e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b4120b70 con 0x7f23b4133ad0 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b890e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b4072290 con 0x7f23b41300a0 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b890e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23b411ff90 con 0x7f23b41309f0 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 0x7f23b411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49496/0 (socket says 172.21.15.154:49496) 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b259c700 1 -- 172.21.15.154:0/933146279 learned_addr learned my addr 172.21.15.154:0/933146279 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.572+0000 7f23b1d9b700 1 --2- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23b41309f0 0x7f23b411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23b2d9d700 1 -- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23b41309f0 msgr2=0x7f23b411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23b2d9d700 1 --2- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23b41309f0 0x7f23b411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23b2d9d700 1 -- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 msgr2=0x7f23b411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23b2d9d700 1 --2- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23b2d9d700 1 -- 172.21.15.154:0/933146279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40094a0 con 0x7f23b4133ad0 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23b259c700 1 --2- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23b2d9d700 1 --2- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 0x7f23b411e4c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00cae0 tx=0x7f23ac00cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23a2ffd700 1 -- 172.21.15.154:0/933146279 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac003c00 con 0x7f23b4133ad0 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23a2ffd700 1 -- 172.21.15.154:0/933146279 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac003d60 con 0x7f23b4133ad0 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23b890e700 1 -- 172.21.15.154:0/933146279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a8009550 con 0x7f23b4133ad0 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23a2ffd700 1 -- 172.21.15.154:0/933146279 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac00aa20 con 0x7f23b4133ad0 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.573+0000 7f23b890e700 1 -- 172.21.15.154:0/933146279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b4120250 con 0x7f23b4133ad0 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.574+0000 7f23a2ffd700 1 -- 172.21.15.154:0/933146279 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f23ac00ab80 con 0x7f23b4133ad0 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.574+0000 7f23a2ffd700 1 -- 172.21.15.154:0/933146279 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f23ac03f1f0 con 0x7f23b4133ad0 2023-09-30T22:21:47.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.574+0000 7f23b890e700 1 -- 172.21.15.154:0/933146279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b4120250 con 0x7f23b4133ad0 2023-09-30T22:21:47.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:47.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.578+0000 7f23a2ffd700 1 -- 172.21.15.154:0/933146279 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f23b4120250 con 0x7f23b4133ad0 2023-09-30T22:21:47.588 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:47.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:47.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.715+0000 7f34d1d4c700 1 Processor -- start 2023-09-30T22:21:47.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.715+0000 7f34d1d4c700 1 -- start start 2023-09-30T22:21:47.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.715+0000 7f34d1d4c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34cc133ad0 0x7f34cc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.715+0000 7f34d1d4c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc130bc0 0x7f34cc13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34d1d4c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34cc06b2d0 con 0x7f34cc1300a0 2023-09-30T22:21:47.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34d1d4c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34cc133610 con 0x7f34cc133ad0 2023-09-30T22:21:47.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34d1d4c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc09a500 con 0x7f34cc130bc0 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34cb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34cc133ad0 0x7f34cc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34caffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f34cc1300a0 0x7f34cc1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57172/0 (socket says 172.21.15.154:57172) 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34caffd700 1 -- 172.21.15.154:0/3526473460 learned_addr learned my addr 172.21.15.154:0/3526473460 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34cb7fe700 1 -- 172.21.15.154:0/3526473460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc130bc0 msgr2=0x7f34cc13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34cbfff700 1 --2- 172.21.15.154:0/3526473460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc130bc0 0x7f34cc13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34cb7fe700 1 --2- 172.21.15.154:0/3526473460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc130bc0 0x7f34cc13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34cb7fe700 1 -- 172.21.15.154:0/3526473460 >> v1:172.21.15.154:6789/0 conn(0x7f34cc1300a0 legacy=0x7f34cc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34cb7fe700 1 -- 172.21.15.154:0/3526473460 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc1338b0 con 0x7f34cc133ad0 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34cbfff700 1 --2- 172.21.15.154:0/3526473460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc130bc0 0x7f34cc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:21:47.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34cb7fe700 1 --2- 172.21.15.154:0/3526473460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc133ad0 0x7f34cc133ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009840 tx=0x7f34bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b89394dae25d9a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.716+0000 7f34ca7fc700 1 -- 172.21.15.154:0/3526473460 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc011830 con 0x7f34cc133ad0 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34ca7fc700 1 -- 172.21.15.154:0/3526473460 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc011990 con 0x7f34cc133ad0 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34ca7fc700 1 -- 172.21.15.154:0/3526473460 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc011d20 con 0x7f34cc133ad0 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34d1d4c700 1 -- 172.21.15.154:0/3526473460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc133ad0 msgr2=0x7f34cc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34d1d4c700 1 --2- 172.21.15.154:0/3526473460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc133ad0 0x7f34cc133ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009840 tx=0x7f34bc009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34d1d4c700 1 -- 172.21.15.154:0/3526473460 shutdown_connections 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34d1d4c700 1 --2- 172.21.15.154:0/3526473460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc130bc0 0x7f34cc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34d1d4c700 1 --2- 172.21.15.154:0/3526473460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc133ad0 0x7f34cc133ea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34d1d4c700 1 -- 172.21.15.154:0/3526473460 >> 172.21.15.154:0/3526473460 conn(0x7f34cc099c40 msgr2=0x7f34cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34d1d4c700 1 -- 172.21.15.154:0/3526473460 shutdown_connections 2023-09-30T22:21:47.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.717+0000 7f34d1d4c700 1 -- 172.21.15.154:0/3526473460 wait complete. 2023-09-30T22:21:47.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.718+0000 7f34d1d4c700 1 Processor -- start 2023-09-30T22:21:47.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.718+0000 7f34d1d4c700 1 -- start start 2023-09-30T22:21:47.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34d1d4c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc1300a0 0x7f34cc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34d1d4c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc130bc0 0x7f34cc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34d1d4c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34cc133ad0 0x7f34cc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34d1d4c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc120a80 con 0x7f34cc130bc0 2023-09-30T22:21:47.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34d1d4c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc12d9f0 con 0x7f34cc1300a0 2023-09-30T22:21:47.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34d1d4c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34cc11fdc0 con 0x7f34cc133ad0 2023-09-30T22:21:47.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34caffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc130bc0 0x7f34cc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34cb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc1300a0 0x7f34cc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34cb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc1300a0 0x7f34cc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49510/0 (socket says 172.21.15.154:49510) 2023-09-30T22:21:47.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34caffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc130bc0 0x7f34cc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40832/0 (socket says 172.21.15.154:40832) 2023-09-30T22:21:47.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34cb7fe700 1 -- 172.21.15.154:0/1334561850 learned_addr learned my addr 172.21.15.154:0/1334561850 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:47.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34cb7fe700 1 -- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34cc133ad0 msgr2=0x7f34cc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34cb7fe700 1 --2- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34cc133ad0 0x7f34cc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34cb7fe700 1 -- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc130bc0 msgr2=0x7f34cc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34cb7fe700 1 --2- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc130bc0 0x7f34cc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.719+0000 7f34cb7fe700 1 -- 172.21.15.154:0/1334561850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0094a0 con 0x7f34cc1300a0 2023-09-30T22:21:47.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.720+0000 7f34cb7fe700 1 --2- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc1300a0 0x7f34cc11da40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0090b0 tx=0x7f34bc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.720+0000 7f34b3fff700 1 -- 172.21.15.154:0/1334561850 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc004570 con 0x7f34cc1300a0 2023-09-30T22:21:47.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.720+0000 7f34b3fff700 1 -- 172.21.15.154:0/1334561850 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc01f070 con 0x7f34cc1300a0 2023-09-30T22:21:47.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.720+0000 7f34b3fff700 1 -- 172.21.15.154:0/1334561850 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0038e0 con 0x7f34cc1300a0 2023-09-30T22:21:47.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.720+0000 7f34d1d4c700 1 -- 172.21.15.154:0/1334561850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34cc12fe30 con 0x7f34cc1300a0 2023-09-30T22:21:47.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.720+0000 7f34d1d4c700 1 -- 172.21.15.154:0/1334561850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34cc0716f0 con 0x7f34cc1300a0 2023-09-30T22:21:47.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.721+0000 7f34b3fff700 1 -- 172.21.15.154:0/1334561850 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f34bc021030 con 0x7f34cc1300a0 2023-09-30T22:21:47.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.721+0000 7f34b3fff700 1 -- 172.21.15.154:0/1334561850 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f34bc040b60 con 0x7f34cc1300a0 2023-09-30T22:21:47.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.721+0000 7f34d1d4c700 1 -- 172.21.15.154:0/1334561850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34cc04f2a0 con 0x7f34cc1300a0 2023-09-30T22:21:47.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.726+0000 7f34b3fff700 1 -- 172.21.15.154:0/1334561850 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f34bc015080 con 0x7f34cc1300a0 2023-09-30T22:21:47.737 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:47.738+0000 7fbad83df240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T22:21:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.795+0000 7fd9d39e4700 1 Processor -- start 2023-09-30T22:21:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.795+0000 7fd9d39e4700 1 -- start start 2023-09-30T22:21:47.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d39e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc09d860 0x7fd9cc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d39e4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9cc09e170 0x7fd9cc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d39e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc130ce0 0x7fd9cc131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d39e4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc09aaa0 con 0x7fd9cc09e170 2023-09-30T22:21:47.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d39e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc09f870 con 0x7fd9cc130ce0 2023-09-30T22:21:47.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d39e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc09b360 con 0x7fd9cc09d860 2023-09-30T22:21:47.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1f81700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc130ce0 0x7fd9cc131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1f81700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc130ce0 0x7fd9cc131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49514/0 (socket says 172.21.15.154:49514) 2023-09-30T22:21:47.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1f81700 1 -- 172.21.15.154:0/1274723262 learned_addr learned my addr 172.21.15.154:0/1274723262 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:47.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1780700 1 --2- 172.21.15.154:0/1274723262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc09d860 0x7fd9cc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1f81700 1 -- 172.21.15.154:0/1274723262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc09d860 msgr2=0x7fd9cc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1f81700 1 --2- 172.21.15.154:0/1274723262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc09d860 0x7fd9cc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1f81700 1 -- 172.21.15.154:0/1274723262 >> v2:172.21.15.154:3300/0 conn(0x7fd9cc09e170 msgr2=0x7fd9cc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1f81700 1 --2- 172.21.15.154:0/1274723262 >> v2:172.21.15.154:3300/0 conn(0x7fd9cc09e170 0x7fd9cc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1f81700 1 -- 172.21.15.154:0/1274723262 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc09b620 con 0x7fd9cc130ce0 2023-09-30T22:21:47.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.796+0000 7fd9d1f81700 1 --2- 172.21.15.154:0/1274723262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc130ce0 0x7fd9cc131180 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400d180 tx=0x7fd9c400d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c049d59dddaaadc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.797+0000 7fd9c3fff700 1 -- 172.21.15.154:0/1274723262 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4010070 con 0x7fd9cc130ce0 2023-09-30T22:21:47.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.797+0000 7fd9c3fff700 1 -- 172.21.15.154:0/1274723262 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c400dd00 con 0x7fd9cc130ce0 2023-09-30T22:21:47.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.797+0000 7fd9c3fff700 1 -- 172.21.15.154:0/1274723262 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400b310 con 0x7fd9cc130ce0 2023-09-30T22:21:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.797+0000 7fd9d39e4700 1 -- 172.21.15.154:0/1274723262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc130ce0 msgr2=0x7fd9cc131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.797+0000 7fd9d39e4700 1 --2- 172.21.15.154:0/1274723262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc130ce0 0x7fd9cc131180 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400d180 tx=0x7fd9c400d490 comp rx=0 tx=0).stop 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.797+0000 7fd9d39e4700 1 -- 172.21.15.154:0/1274723262 shutdown_connections 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.797+0000 7fd9d39e4700 1 --2- 172.21.15.154:0/1274723262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc130ce0 0x7fd9cc131180 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.797+0000 7fd9d39e4700 1 --2- 172.21.15.154:0/1274723262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc09d860 0x7fd9cc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.798+0000 7fd9d39e4700 1 --2- 172.21.15.154:0/1274723262 >> v2:172.21.15.154:3300/0 conn(0x7fd9cc09e170 0x7fd9cc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.798+0000 7fd9d39e4700 1 -- 172.21.15.154:0/1274723262 >> 172.21.15.154:0/1274723262 conn(0x7fd9cc099c40 msgr2=0x7fd9cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.798+0000 7fd9d39e4700 1 -- 172.21.15.154:0/1274723262 shutdown_connections 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.798+0000 7fd9d39e4700 1 -- 172.21.15.154:0/1274723262 wait complete. 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.799+0000 7fd9d39e4700 1 Processor -- start 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.799+0000 7fd9d39e4700 1 -- start start 2023-09-30T22:21:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d39e4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9cc09d860 0x7fd9cc1cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d39e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc09e170 0x7fd9cc1ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d39e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc130ce0 0x7fd9cc11d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d39e4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc09c8b0 con 0x7fd9cc09d860 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d39e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc120900 con 0x7fd9cc09e170 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d39e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc121000 con 0x7fd9cc130ce0 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d1f81700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc130ce0 0x7fd9cc11d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d0f7f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc09e170 0x7fd9cc1ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d1f81700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc130ce0 0x7fd9cc11d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59586/0 (socket says 172.21.15.154:59586) 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d1f81700 1 -- 172.21.15.154:0/2727614689 learned_addr learned my addr 172.21.15.154:0/2727614689 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d0f7f700 1 -- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc130ce0 msgr2=0x7fd9cc11d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d0f7f700 1 --2- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc130ce0 0x7fd9cc11d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d0f7f700 1 -- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9cc09d860 msgr2=0x7fd9cc1cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d0f7f700 1 --2- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9cc09d860 0x7fd9cc1cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d0f7f700 1 -- 172.21.15.154:0/2727614689 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c400bd40 con 0x7fd9cc09e170 2023-09-30T22:21:47.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d1f81700 1 --2- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc130ce0 0x7fd9cc11d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:47.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.800+0000 7fd9d0f7f700 1 --2- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc09e170 0x7fd9cc1ccdd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc09a100 tx=0x7fd9bc00b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.801+0000 7fd9c1ffb700 1 -- 172.21.15.154:0/2727614689 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc011830 con 0x7fd9cc09e170 2023-09-30T22:21:47.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.801+0000 7fd9c1ffb700 1 -- 172.21.15.154:0/2727614689 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc011990 con 0x7fd9cc09e170 2023-09-30T22:21:47.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.801+0000 7fd9d39e4700 1 -- 172.21.15.154:0/2727614689 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc120270 con 0x7fd9cc09e170 2023-09-30T22:21:47.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.801+0000 7fd9c1ffb700 1 -- 172.21.15.154:0/2727614689 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc011d40 con 0x7fd9cc09e170 2023-09-30T22:21:47.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.801+0000 7fd9d39e4700 1 -- 172.21.15.154:0/2727614689 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc11f320 con 0x7fd9cc09e170 2023-09-30T22:21:47.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.802+0000 7fd9c1ffb700 1 -- 172.21.15.154:0/2727614689 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fd9bc01a400 con 0x7fd9cc09e170 2023-09-30T22:21:47.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.802+0000 7fd9c1ffb700 1 -- 172.21.15.154:0/2727614689 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fd9bc03f560 con 0x7fd9cc09e170 2023-09-30T22:21:47.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.802+0000 7fd9d39e4700 1 -- 172.21.15.154:0/2727614689 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc04f2a0 con 0x7fd9cc09e170 2023-09-30T22:21:47.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.807+0000 7fd9c1ffb700 1 -- 172.21.15.154:0/2727614689 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd9bc009280 con 0x7fd9cc09e170 2023-09-30T22:21:47.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.819+0000 7f5970b6c700 1 Processor -- start 2023-09-30T22:21:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.819+0000 7f5970b6c700 1 -- start start 2023-09-30T22:21:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f5970b6c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c138040 0x7f596c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f5970b6c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c0a08e0 0x7f596c0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f5970b6c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f596c0a1230 0x7f596c13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f5970b6c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596c0a2100 con 0x7f596c0a1230 2023-09-30T22:21:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f5970b6c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c138950 con 0x7f596c138040 2023-09-30T22:21:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f5970b6c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f596c1379e0 con 0x7f596c0a08e0 2023-09-30T22:21:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f596a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c138040 0x7f596c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f596a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c138040 0x7f596c138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49526/0 (socket says 172.21.15.154:49526) 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f596a59c700 1 -- 172.21.15.154:0/2060448992 learned_addr learned my addr 172.21.15.154:0/2060448992 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.820+0000 7f5969d9b700 1 --2- 172.21.15.154:0/2060448992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c0a08e0 0x7f596c0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596ad9d700 1 --2- 172.21.15.154:0/2060448992 >> v2:172.21.15.154:3300/0 conn(0x7f596c0a1230 0x7f596c13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596a59c700 1 -- 172.21.15.154:0/2060448992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c0a08e0 msgr2=0x7f596c0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596a59c700 1 --2- 172.21.15.154:0/2060448992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c0a08e0 0x7f596c0a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596a59c700 1 -- 172.21.15.154:0/2060448992 >> v2:172.21.15.154:3300/0 conn(0x7f596c0a1230 msgr2=0x7f596c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596a59c700 1 --2- 172.21.15.154:0/2060448992 >> v2:172.21.15.154:3300/0 conn(0x7f596c0a1230 0x7f596c13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596a59c700 1 -- 172.21.15.154:0/2060448992 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c09b9b0 con 0x7f596c138040 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596ad9d700 1 --2- 172.21.15.154:0/2060448992 >> v2:172.21.15.154:3300/0 conn(0x7f596c0a1230 0x7f596c13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:21:47.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596a59c700 1 --2- 172.21.15.154:0/2060448992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c138040 0x7f596c138410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f595c009920 tx=0x7f595c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81a19bfaab8a966c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596959a700 1 -- 172.21.15.154:0/2060448992 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c005e30 con 0x7f596c138040 2023-09-30T22:21:47.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596959a700 1 -- 172.21.15.154:0/2060448992 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c009e70 con 0x7f596c138040 2023-09-30T22:21:47.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.821+0000 7f596959a700 1 -- 172.21.15.154:0/2060448992 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c004250 con 0x7f596c138040 2023-09-30T22:21:47.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.822+0000 7f5970b6c700 1 -- 172.21.15.154:0/2060448992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c138040 msgr2=0x7f596c138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.822+0000 7f5970b6c700 1 --2- 172.21.15.154:0/2060448992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c138040 0x7f596c138410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f595c009920 tx=0x7f595c009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.822+0000 7f5970b6c700 1 -- 172.21.15.154:0/2060448992 shutdown_connections 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.822+0000 7f5970b6c700 1 --2- 172.21.15.154:0/2060448992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c138040 0x7f596c138410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.822+0000 7f5970b6c700 1 --2- 172.21.15.154:0/2060448992 >> v2:172.21.15.154:3300/0 conn(0x7f596c0a1230 0x7f596c13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.822+0000 7f5970b6c700 1 --2- 172.21.15.154:0/2060448992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c0a08e0 0x7f596c0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.822+0000 7f5970b6c700 1 -- 172.21.15.154:0/2060448992 >> 172.21.15.154:0/2060448992 conn(0x7f596c0a2980 msgr2=0x7f596c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.822+0000 7f5970b6c700 1 -- 172.21.15.154:0/2060448992 shutdown_connections 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.822+0000 7f5970b6c700 1 -- 172.21.15.154:0/2060448992 wait complete. 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.824+0000 7f5970b6c700 1 Processor -- start 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.824+0000 7f5970b6c700 1 -- start start 2023-09-30T22:21:47.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.824+0000 7f5970b6c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f596c0a08e0 0x7f596c1d5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.824+0000 7f5970b6c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c0a1230 0x7f596c1d5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f5970b6c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c138040 0x7f596c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f5970b6c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c13e870 con 0x7f596c0a08e0 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f5970b6c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c11a080 con 0x7f596c0a1230 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f5970b6c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f596c134210 con 0x7f596c138040 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f596a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f596c0a08e0 0x7f596c1d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f596a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f596c0a08e0 0x7f596c1d5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40850/0 (socket says 172.21.15.154:40850) 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f596a59c700 1 -- 172.21.15.154:0/2480199523 learned_addr learned my addr 172.21.15.154:0/2480199523 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f5969d9b700 1 --2- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c0a1230 0x7f596c1d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f596ad9d700 1 --2- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c138040 0x7f596c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f596a59c700 1 -- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c138040 msgr2=0x7f596c118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f596a59c700 1 --2- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c138040 0x7f596c118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f596a59c700 1 -- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c0a1230 msgr2=0x7f596c1d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f596a59c700 1 --2- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c0a1230 0x7f596c1d5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.825+0000 7f596a59c700 1 -- 172.21.15.154:0/2480199523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c009500 con 0x7f596c0a08e0 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.826+0000 7f596a59c700 1 --2- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f596c0a08e0 0x7f596c1d5310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f595c009c70 tx=0x7f595c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.826+0000 7f595affd700 1 -- 172.21.15.154:0/2480199523 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c003ab0 con 0x7f596c0a08e0 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.826+0000 7f595affd700 1 -- 172.21.15.154:0/2480199523 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c003c10 con 0x7f596c0a08e0 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.826+0000 7f595affd700 1 -- 172.21.15.154:0/2480199523 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c005e60 con 0x7f596c0a08e0 2023-09-30T22:21:47.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.826+0000 7f5970b6c700 1 -- 172.21.15.154:0/2480199523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c11ad80 con 0x7f596c0a08e0 2023-09-30T22:21:47.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.826+0000 7f5970b6c700 1 -- 172.21.15.154:0/2480199523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596c09c760 con 0x7f596c0a08e0 2023-09-30T22:21:47.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.827+0000 7f595affd700 1 -- 172.21.15.154:0/2480199523 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f595c018030 con 0x7f596c0a08e0 2023-09-30T22:21:47.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.827+0000 7f5970b6c700 1 -- 172.21.15.154:0/2480199523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c11af10 con 0x7f596c0a08e0 2023-09-30T22:21:47.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.827+0000 7f595affd700 1 -- 172.21.15.154:0/2480199523 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f595c01ad40 con 0x7f596c0a08e0 2023-09-30T22:21:47.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.835+0000 7f595affd700 1 -- 172.21.15.154:0/2480199523 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f596c11af10 con 0x7f596c0a08e0 2023-09-30T22:21:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.857+0000 7f23b890e700 1 -- 172.21.15.154:0/933146279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f23b4120250 con 0x7f23b4133ad0 2023-09-30T22:21:47.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.858+0000 7f23a2ffd700 1 -- 172.21.15.154:0/933146279 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23b4120250 con 0x7f23b4133ad0 2023-09-30T22:21:47.858 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.861+0000 7f23b890e700 1 -- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 msgr2=0x7f23b411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.861+0000 7f23b890e700 1 --2- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 0x7f23b411e4c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00cae0 tx=0x7f23ac00cdf0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.861+0000 7f23b890e700 1 -- 172.21.15.154:0/933146279 shutdown_connections 2023-09-30T22:21:47.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.861+0000 7f23b890e700 1 --2- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b4133ad0 0x7f23b411e4c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.861+0000 7f23b890e700 1 --2- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b41300a0 0x7f23b411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.861+0000 7f23b890e700 1 --2- 172.21.15.154:0/933146279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23b41309f0 0x7f23b411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.861+0000 7f23b890e700 1 -- 172.21.15.154:0/933146279 >> 172.21.15.154:0/933146279 conn(0x7f23b4099c40 msgr2=0x7f23b40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.862+0000 7f23b890e700 1 -- 172.21.15.154:0/933146279 shutdown_connections 2023-09-30T22:21:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.864+0000 7f23b890e700 1 -- 172.21.15.154:0/933146279 wait complete. 2023-09-30T22:21:47.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-09-30T22:21:47.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.910+0000 7f34d1d4c700 1 -- 172.21.15.154:0/1334561850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34cc06c3b0 con 0x7f34cc1300a0 2023-09-30T22:21:47.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.911+0000 7f34b3fff700 1 -- 172.21.15.154:0/1334561850 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34bc01a450 con 0x7f34cc1300a0 2023-09-30T22:21:47.913 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.914+0000 7f34d1d4c700 1 -- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc1300a0 msgr2=0x7f34cc11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.914+0000 7f34d1d4c700 1 --2- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc1300a0 0x7f34cc11da40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0090b0 tx=0x7f34bc004750 comp rx=0 tx=0).stop 2023-09-30T22:21:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.914+0000 7f34d1d4c700 1 -- 172.21.15.154:0/1334561850 shutdown_connections 2023-09-30T22:21:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.914+0000 7f34d1d4c700 1 --2- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34cc133ad0 0x7f34cc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.914+0000 7f34d1d4c700 1 --2- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34cc1300a0 0x7f34cc11da40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.914+0000 7f34d1d4c700 1 --2- 172.21.15.154:0/1334561850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34cc130bc0 0x7f34cc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.914+0000 7f34d1d4c700 1 -- 172.21.15.154:0/1334561850 >> 172.21.15.154:0/1334561850 conn(0x7f34cc099c40 msgr2=0x7f34cc132190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.914+0000 7f34d1d4c700 1 -- 172.21.15.154:0/1334561850 shutdown_connections 2023-09-30T22:21:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:47.914+0000 7f34d1d4c700 1 -- 172.21.15.154:0/1334561850 wait complete. 2023-09-30T22:21:47.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-09-30T22:21:48.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.008+0000 7f5970b6c700 1 -- 172.21.15.154:0/2480199523 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f596c11af10 con 0x7f596c0a08e0 2023-09-30T22:21:48.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.009+0000 7f595affd700 1 -- 172.21.15.154:0/2480199523 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f595c01f070 con 0x7f596c0a08e0 2023-09-30T22:21:48.009 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:48.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.011+0000 7f5970b6c700 1 -- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f596c0a08e0 msgr2=0x7f596c1d5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.011+0000 7f5970b6c700 1 --2- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f596c0a08e0 0x7f596c1d5310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f595c009c70 tx=0x7f595c004750 comp rx=0 tx=0).stop 2023-09-30T22:21:48.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.011+0000 7f5970b6c700 1 -- 172.21.15.154:0/2480199523 shutdown_connections 2023-09-30T22:21:48.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.011+0000 7f5970b6c700 1 --2- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f596c138040 0x7f596c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.011+0000 7f5970b6c700 1 --2- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f596c0a08e0 0x7f596c1d5310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.011+0000 7f5970b6c700 1 --2- 172.21.15.154:0/2480199523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f596c0a1230 0x7f596c1d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.011+0000 7f5970b6c700 1 -- 172.21.15.154:0/2480199523 >> 172.21.15.154:0/2480199523 conn(0x7f596c0a2980 msgr2=0x7f596c070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.011+0000 7f5970b6c700 1 -- 172.21.15.154:0/2480199523 shutdown_connections 2023-09-30T22:21:48.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.011+0000 7f5970b6c700 1 -- 172.21.15.154:0/2480199523 wait complete. 2023-09-30T22:21:48.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.015+0000 7fd9d39e4700 1 -- 172.21.15.154:0/2727614689 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9cc1206f0 con 0x7fd9cc09e170 2023-09-30T22:21:48.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.015+0000 7fd9c1ffb700 1 -- 172.21.15.154:0/2727614689 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9bc029090 con 0x7fd9cc09e170 2023-09-30T22:21:48.015 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:48.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.017+0000 7fd9d39e4700 1 -- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc09e170 msgr2=0x7fd9cc1ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:48.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.017+0000 7fd9d39e4700 1 --2- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc09e170 0x7fd9cc1ccdd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc09a100 tx=0x7fd9bc00b730 comp rx=0 tx=0).stop 2023-09-30T22:21:48.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.018+0000 7fd9d39e4700 1 -- 172.21.15.154:0/2727614689 shutdown_connections 2023-09-30T22:21:48.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.018+0000 7fd9d39e4700 1 --2- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9cc130ce0 0x7fd9cc11d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.018+0000 7fd9d39e4700 1 --2- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9cc09d860 0x7fd9cc1cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.018+0000 7fd9d39e4700 1 --2- 172.21.15.154:0/2727614689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9cc09e170 0x7fd9cc1ccdd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:48.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.018+0000 7fd9d39e4700 1 -- 172.21.15.154:0/2727614689 >> 172.21.15.154:0/2727614689 conn(0x7fd9cc099c40 msgr2=0x7fd9cc130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:48.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.018+0000 7fd9d39e4700 1 -- 172.21.15.154:0/2727614689 shutdown_connections 2023-09-30T22:21:48.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:48.018+0000 7fd9d39e4700 1 -- 172.21.15.154:0/2727614689 wait complete. 2023-09-30T22:21:48.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-09-30T22:21:48.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-09-30T22:21:48.200 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:48.200+0000 7fbad83df240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T22:21:48.314 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:48.315+0000 7fbad83df240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T22:21:48.628 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:48.629+0000 7fbad83df240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T22:21:48.765 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:48.765+0000 7fbad83df240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T22:21:48.834 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:48.835+0000 7fbad83df240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T22:21:48.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:48.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:48.968 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:48.968+0000 7fbad83df240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T22:21:49.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.012+0000 7f4b1fe0a700 1 Processor -- start 2023-09-30T22:21:49.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.012+0000 7f4b1fe0a700 1 -- start start 2023-09-30T22:21:49.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.012+0000 7f4b1fe0a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b1806a770 0x7f4b1806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.012+0000 7f4b1fe0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b18139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.012+0000 7f4b1fe0a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1809da80 con 0x7f4b1806b080 2023-09-30T22:21:49.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.012+0000 7f4b1fe0a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1809dce0 con 0x7f4b1806a770 2023-09-30T22:21:49.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.012+0000 7f4b1fe0a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1809eb20 con 0x7f4b18131ec0 2023-09-30T22:21:49.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1e3a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b18139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1dba6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b1806a770 0x7f4b1806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1e3a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b18139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49538/0 (socket says 172.21.15.154:49538) 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1d3a5700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4b1806b080 0x7f4b181317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57180/0 (socket says 172.21.15.154:57180) 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1e3a7700 1 -- 172.21.15.154:0/4032444067 learned_addr learned my addr 172.21.15.154:0/4032444067 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1e3a7700 1 -- 172.21.15.154:0/4032444067 >> v2:172.21.15.154:3300/0 conn(0x7f4b1806a770 msgr2=0x7f4b1806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1e3a7700 1 --2- 172.21.15.154:0/4032444067 >> v2:172.21.15.154:3300/0 conn(0x7f4b1806a770 0x7f4b1806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1e3a7700 1 -- 172.21.15.154:0/4032444067 >> v1:172.21.15.154:6789/0 conn(0x7f4b1806b080 legacy=0x7f4b181317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1e3a7700 1 -- 172.21.15.154:0/4032444067 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1809d860 con 0x7f4b18131ec0 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1e3a7700 1 --2- 172.21.15.154:0/4032444067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b18139c20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009e50 tx=0x7f4b1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=befd0e18335f6dae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1cba4700 1 -- 172.21.15.154:0/4032444067 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000e070 con 0x7f4b18131ec0 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1cba4700 1 -- 172.21.15.154:0/4032444067 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1000b910 con 0x7f4b18131ec0 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.013+0000 7f4b1cba4700 1 -- 172.21.15.154:0/4032444067 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000bcc0 con 0x7f4b18131ec0 2023-09-30T22:21:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.014+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/4032444067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 msgr2=0x7f4b18139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.014+0000 7f4b1fe0a700 1 --2- 172.21.15.154:0/4032444067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b18139c20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009e50 tx=0x7f4b1000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.014+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/4032444067 shutdown_connections 2023-09-30T22:21:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.014+0000 7f4b1fe0a700 1 --2- 172.21.15.154:0/4032444067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b18139c20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.014+0000 7f4b1fe0a700 1 --2- 172.21.15.154:0/4032444067 >> v2:172.21.15.154:3300/0 conn(0x7f4b1806a770 0x7f4b1806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.014+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/4032444067 >> 172.21.15.154:0/4032444067 conn(0x7f4b18099c40 msgr2=0x7f4b180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.014+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/4032444067 shutdown_connections 2023-09-30T22:21:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.014+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/4032444067 wait complete. 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.015+0000 7f4b1fe0a700 1 Processor -- start 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.015+0000 7f4b1fe0a700 1 -- start start 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1fe0a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1806a770 0x7f4b181c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1fe0a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b1806b080 0x7f4b181c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1fe0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b181c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1fe0a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b18122250 con 0x7f4b1806a770 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1fe0a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1809b900 con 0x7f4b18131ec0 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1fe0a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181c5cc0 con 0x7f4b1806b080 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1e3a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b181c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1d3a5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b1806b080 0x7f4b181c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1e3a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b181c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49544/0 (socket says 172.21.15.154:49544) 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1e3a7700 1 -- 172.21.15.154:0/2603113521 learned_addr learned my addr 172.21.15.154:0/2603113521 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1dba6700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1806a770 0x7f4b181c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1e3a7700 1 -- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b1806b080 msgr2=0x7f4b181c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1e3a7700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b1806b080 0x7f4b181c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1e3a7700 1 -- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1806a770 msgr2=0x7f4b181c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.016+0000 7f4b1e3a7700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1806a770 0x7f4b181c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.017+0000 7f4b1e3a7700 1 -- 172.21.15.154:0/2603113521 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009b30 con 0x7f4b18131ec0 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.017+0000 7f4b1d3a5700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b1806b080 0x7f4b181c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.017+0000 7f4b1dba6700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1806a770 0x7f4b181c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.017+0000 7f4b1e3a7700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b181c8290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000b680 tx=0x7f4b10004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.017+0000 7f4b0e7fc700 1 -- 172.21.15.154:0/2603113521 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10004830 con 0x7f4b18131ec0 2023-09-30T22:21:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.017+0000 7f4b0e7fc700 1 -- 172.21.15.154:0/2603113521 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b100092e0 con 0x7f4b18131ec0 2023-09-30T22:21:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.017+0000 7f4b0e7fc700 1 -- 172.21.15.154:0/2603113521 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1001c660 con 0x7f4b18131ec0 2023-09-30T22:21:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.017+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/2603113521 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b18071e10 con 0x7f4b18131ec0 2023-09-30T22:21:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.017+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/2603113521 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b18122ef0 con 0x7f4b18131ec0 2023-09-30T22:21:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.018+0000 7f4b0e7fc700 1 -- 172.21.15.154:0/2603113521 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f4b1001c7c0 con 0x7f4b18131ec0 2023-09-30T22:21:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.018+0000 7f4b0e7fc700 1 -- 172.21.15.154:0/2603113521 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f4b100410c0 con 0x7f4b18131ec0 2023-09-30T22:21:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.018+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/2603113521 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b180a3d00 con 0x7f4b18131ec0 2023-09-30T22:21:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.022+0000 7f4b0e7fc700 1 -- 172.21.15.154:0/2603113521 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f4b1002d940 con 0x7f4b18131ec0 2023-09-30T22:21:49.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:49.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:49.046 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:49.046+0000 7fbad83df240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T22:21:49.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.073+0000 7fb51e81f700 1 Processor -- start 2023-09-30T22:21:49.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.073+0000 7fb51e81f700 1 -- start start 2023-09-30T22:21:49.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.073+0000 7fb51e81f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb51809bd20 0x7fb51809c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.073+0000 7fb51e81f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5181337d0 0x7fb518133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.073+0000 7fb51e81f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51809a8e0 con 0x7fb518134160 2023-09-30T22:21:49.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.073+0000 7fb51e81f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb51809ad30 con 0x7fb5181337d0 2023-09-30T22:21:49.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.073+0000 7fb51e81f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb51809a620 con 0x7fb51809bd20 2023-09-30T22:21:49.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb51cdbc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb518134160 0x7fb51813ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57192/0 (socket says 172.21.15.154:57192) 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb51cdbc700 1 -- 172.21.15.154:0/2372675760 learned_addr learned my addr 172.21.15.154:0/2372675760 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb517fff700 1 --2- 172.21.15.154:0/2372675760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb51809bd20 0x7fb51809c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb516ffd700 1 -- 172.21.15.154:0/2372675760 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287513565 0 0) 0x7fb51809a8e0 con 0x7fb518134160 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb516ffd700 1 -- 172.21.15.154:0/2372675760 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5000035b0 con 0x7fb518134160 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb517fff700 1 -- 172.21.15.154:0/2372675760 >> v2:172.21.15.154:3300/0 conn(0x7fb5181337d0 msgr2=0x7fb518133c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb517fff700 1 --2- 172.21.15.154:0/2372675760 >> v2:172.21.15.154:3300/0 conn(0x7fb5181337d0 0x7fb518133c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb517fff700 1 -- 172.21.15.154:0/2372675760 >> v1:172.21.15.154:6789/0 conn(0x7fb518134160 legacy=0x7fb51813ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb517fff700 1 -- 172.21.15.154:0/2372675760 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51809b840 con 0x7fb51809bd20 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb517fff700 1 --2- 172.21.15.154:0/2372675760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb51809bd20 0x7fb51809c0f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb508009820 tx=0x7fb508009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47fc0874472f1df7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb516ffd700 1 -- 172.21.15.154:0/2372675760 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508005e30 con 0x7fb51809bd20 2023-09-30T22:21:49.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.074+0000 7fb516ffd700 1 -- 172.21.15.154:0/2372675760 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb508006030 con 0x7fb51809bd20 2023-09-30T22:21:49.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.075+0000 7fb516ffd700 1 -- 172.21.15.154:0/2372675760 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5080063a0 con 0x7fb51809bd20 2023-09-30T22:21:49.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.075+0000 7fb51e81f700 1 -- 172.21.15.154:0/2372675760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb51809bd20 msgr2=0x7fb51809c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.075+0000 7fb51e81f700 1 --2- 172.21.15.154:0/2372675760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb51809bd20 0x7fb51809c0f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb508009820 tx=0x7fb508009b30 comp rx=0 tx=0).stop 2023-09-30T22:21:49.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.075+0000 7fb51e81f700 1 -- 172.21.15.154:0/2372675760 shutdown_connections 2023-09-30T22:21:49.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.075+0000 7fb51e81f700 1 --2- 172.21.15.154:0/2372675760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb51809bd20 0x7fb51809c0f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.075+0000 7fb51e81f700 1 --2- 172.21.15.154:0/2372675760 >> v2:172.21.15.154:3300/0 conn(0x7fb5181337d0 0x7fb518133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.075+0000 7fb51e81f700 1 -- 172.21.15.154:0/2372675760 >> 172.21.15.154:0/2372675760 conn(0x7fb51809f9f0 msgr2=0x7fb51809fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.075+0000 7fb51e81f700 1 -- 172.21.15.154:0/2372675760 shutdown_connections 2023-09-30T22:21:49.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.075+0000 7fb51e81f700 1 -- 172.21.15.154:0/2372675760 wait complete. 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.077+0000 7fb51e81f700 1 Processor -- start 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.077+0000 7fb51e81f700 1 -- start start 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51e81f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51809bd20 0x7fb518123bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51e81f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5181337d0 0x7fb518124110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51e81f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb518134160 0x7fb518124650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51e81f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5181277f0 con 0x7fb51809bd20 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51e81f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51809cc90 con 0x7fb5181337d0 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51e81f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb518125880 con 0x7fb518134160 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb517fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51809bd20 0x7fb518123bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb517fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51809bd20 0x7fb518123bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40874/0 (socket says 172.21.15.154:40874) 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb517fff700 1 -- 172.21.15.154:0/1118132074 learned_addr learned my addr 172.21.15.154:0/1118132074 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51cdbc700 1 --2- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb518134160 0x7fb518124650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51cdbc700 1 -- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5181337d0 msgr2=0x7fb518124110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51cdbc700 1 --2- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5181337d0 0x7fb518124110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51cdbc700 1 -- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51809bd20 msgr2=0x7fb518123bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51cdbc700 1 --2- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51809bd20 0x7fb518123bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.078+0000 7fb51cdbc700 1 -- 172.21.15.154:0/1118132074 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb508009430 con 0x7fb518134160 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.079+0000 7fb51cdbc700 1 --2- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb518134160 0x7fb518124650 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb51000ca80 tx=0x7fb51000cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.079+0000 7fb514ff9700 1 -- 172.21.15.154:0/1118132074 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000a9e0 con 0x7fb518134160 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.079+0000 7fb514ff9700 1 -- 172.21.15.154:0/1118132074 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51000ab40 con 0x7fb518134160 2023-09-30T22:21:49.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.079+0000 7fb514ff9700 1 -- 172.21.15.154:0/1118132074 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510012400 con 0x7fb518134160 2023-09-30T22:21:49.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.080+0000 7fb51e81f700 1 -- 172.21.15.154:0/1118132074 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb518132b70 con 0x7fb518134160 2023-09-30T22:21:49.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.080+0000 7fb51e81f700 1 -- 172.21.15.154:0/1118132074 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb518127e80 con 0x7fb518134160 2023-09-30T22:21:49.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.081+0000 7fb51e81f700 1 -- 172.21.15.154:0/1118132074 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51804f2a0 con 0x7fb518134160 2023-09-30T22:21:49.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.082+0000 7fb514ff9700 1 -- 172.21.15.154:0/1118132074 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fb51001b3b0 con 0x7fb518134160 2023-09-30T22:21:49.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.082+0000 7fb514ff9700 1 -- 172.21.15.154:0/1118132074 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fb51003f2c0 con 0x7fb518134160 2023-09-30T22:21:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.092+0000 7fb514ff9700 1 -- 172.21.15.154:0/1118132074 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb5100192c0 con 0x7fb518134160 2023-09-30T22:21:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.167+0000 7f22b6910700 1 Processor -- start 2023-09-30T22:21:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.167+0000 7f22b6910700 1 -- start start 2023-09-30T22:21:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22b6910700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22b6910700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22b009e170 0x7f22b01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22b6910700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22b0130ce0 0x7f22b0131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22b6910700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b009aaa0 con 0x7f22b009e170 2023-09-30T22:21:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22b6910700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b009f870 con 0x7f22b009d860 2023-09-30T22:21:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22b6910700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22b009b360 con 0x7f22b0130ce0 2023-09-30T22:21:49.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22af7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22b009e170 0x7f22b01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22af7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22b009e170 0x7f22b01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40882/0 (socket says 172.21.15.154:40882) 2023-09-30T22:21:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22af7fe700 1 -- 172.21.15.154:0/3599301227 learned_addr learned my addr 172.21.15.154:0/3599301227 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22affff700 1 --2- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22af7fe700 1 -- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22b0130ce0 msgr2=0x7f22b0131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22af7fe700 1 --2- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22b0130ce0 0x7f22b0131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22af7fe700 1 -- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 msgr2=0x7f22b009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22af7fe700 1 --2- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22af7fe700 1 -- 172.21.15.154:0/3599301227 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b009b620 con 0x7f22b009e170 2023-09-30T22:21:49.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.168+0000 7f22affff700 1 --2- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:21:49.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22af7fe700 1 --2- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 0x7f22b01307a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f22a40098f0 tx=0x7f22a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d1faaa8dfb0e23 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22aeffd700 1 -- 172.21.15.154:0/3599301227 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400f8a0 con 0x7f22b009e170 2023-09-30T22:21:49.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22aeffd700 1 -- 172.21.15.154:0/3599301227 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a400fa00 con 0x7f22b009e170 2023-09-30T22:21:49.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22aeffd700 1 -- 172.21.15.154:0/3599301227 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400fd90 con 0x7f22b009e170 2023-09-30T22:21:49.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22b6910700 1 -- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 msgr2=0x7f22b01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22b6910700 1 --2- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 0x7f22b01307a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f22a40098f0 tx=0x7f22a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22b6910700 1 -- 172.21.15.154:0/3599301227 shutdown_connections 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22b6910700 1 --2- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22b6910700 1 --2- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22b0130ce0 0x7f22b0131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22b6910700 1 --2- 172.21.15.154:0/3599301227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 0x7f22b01307a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22b6910700 1 -- 172.21.15.154:0/3599301227 >> 172.21.15.154:0/3599301227 conn(0x7f22b0099c40 msgr2=0x7f22b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.169+0000 7f22b6910700 1 -- 172.21.15.154:0/3599301227 shutdown_connections 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.170+0000 7f22b6910700 1 -- 172.21.15.154:0/3599301227 wait complete. 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.170+0000 7f22b6910700 1 Processor -- start 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22b6910700 1 -- start start 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22b6910700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b01212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22b6910700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 0x7f22b0121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22b6910700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22b0130ce0 0x7f22b0121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22b6910700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0124b30 con 0x7f22b009e170 2023-09-30T22:21:49.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22b6910700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0124e10 con 0x7f22b009d860 2023-09-30T22:21:49.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22b6910700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00a22b0 con 0x7f22b0130ce0 2023-09-30T22:21:49.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22affff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b01212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 0x7f22b0121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22affff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b01212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49566/0 (socket says 172.21.15.154:49566) 2023-09-30T22:21:49.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22affff700 1 -- 172.21.15.154:0/3850658912 learned_addr learned my addr 172.21.15.154:0/3850658912 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:49.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.171+0000 7f22b4ead700 1 --2- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22b0130ce0 0x7f22b0121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22af7fe700 1 -- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22b0130ce0 msgr2=0x7f22b0121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22af7fe700 1 --2- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22b0130ce0 0x7f22b0121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22af7fe700 1 -- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 msgr2=0x7f22b01212f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22af7fe700 1 --2- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b01212f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22af7fe700 1 -- 172.21.15.154:0/3850658912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a4009550 con 0x7f22b009e170 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22af7fe700 1 --2- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 0x7f22b0121830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22b009a100 tx=0x7f22a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22acff9700 1 -- 172.21.15.154:0/3850658912 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a401d040 con 0x7f22b009e170 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22acff9700 1 -- 172.21.15.154:0/3850658912 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a40038a0 con 0x7f22b009e170 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22b6910700 1 -- 172.21.15.154:0/3850658912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b009c8b0 con 0x7f22b009e170 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22acff9700 1 -- 172.21.15.154:0/3850658912 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4003c30 con 0x7f22b009e170 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.172+0000 7f22b6910700 1 -- 172.21.15.154:0/3850658912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b01241b0 con 0x7f22b009e170 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.173+0000 7f22b6910700 1 -- 172.21.15.154:0/3850658912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b0124990 con 0x7f22b009e170 2023-09-30T22:21:49.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.174+0000 7f22acff9700 1 -- 172.21.15.154:0/3850658912 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f22a4019400 con 0x7f22b009e170 2023-09-30T22:21:49.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.174+0000 7f22acff9700 1 -- 172.21.15.154:0/3850658912 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f22a4040730 con 0x7f22b009e170 2023-09-30T22:21:49.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.178+0000 7f22acff9700 1 -- 172.21.15.154:0/3850658912 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f22a40196b0 con 0x7f22b009e170 2023-09-30T22:21:49.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.218+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/2603113521 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b18122390 con 0x7f4b18131ec0 2023-09-30T22:21:49.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.218+0000 7f4b0e7fc700 1 -- 172.21.15.154:0/2603113521 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b1002d350 con 0x7f4b18131ec0 2023-09-30T22:21:49.219 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:49.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.222+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 msgr2=0x7f4b181c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.222+0000 7f4b1fe0a700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b181c8290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000b680 tx=0x7f4b10004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.222+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/2603113521 shutdown_connections 2023-09-30T22:21:49.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.222+0000 7f4b1fe0a700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b18131ec0 0x7f4b181c8290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.222+0000 7f4b1fe0a700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b1806a770 0x7f4b181c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.222+0000 7f4b1fe0a700 1 --2- 172.21.15.154:0/2603113521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b1806b080 0x7f4b181c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.222+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/2603113521 >> 172.21.15.154:0/2603113521 conn(0x7f4b18099c40 msgr2=0x7f4b181b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.222+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/2603113521 shutdown_connections 2023-09-30T22:21:49.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.222+0000 7f4b1fe0a700 1 -- 172.21.15.154:0/2603113521 wait complete. 2023-09-30T22:21:49.233 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:49.233+0000 7fbad83df240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T22:21:49.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.239+0000 7f3ed0909700 1 Processor -- start 2023-09-30T22:21:49.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.239+0000 7f3ed0909700 1 -- start start 2023-09-30T22:21:49.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-09-30T22:21:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ed0909700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc09ad40 0x7f3ecc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ed0909700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ecc133f70 0x7f3ecc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ed0909700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc09b110 con 0x7f3ecc0a0a70 2023-09-30T22:21:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ed0909700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc0a3b60 con 0x7f3ecc133f70 2023-09-30T22:21:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ed0909700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1348e0 con 0x7f3ecc09ad40 2023-09-30T22:21:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ec9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ecc133f70 0x7f3ecc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ec9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ecc133f70 0x7f3ecc1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40900/0 (socket says 172.21.15.154:40900) 2023-09-30T22:21:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ec9d9b700 1 -- 172.21.15.154:0/3331365962 learned_addr learned my addr 172.21.15.154:0/3331365962 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3eca59c700 1 --2- 172.21.15.154:0/3331365962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc09ad40 0x7f3ecc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3eca59c700 1 -- 172.21.15.154:0/3331365962 >> v2:172.21.15.154:3300/0 conn(0x7f3ecc133f70 msgr2=0x7f3ecc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3eca59c700 1 --2- 172.21.15.154:0/3331365962 >> v2:172.21.15.154:3300/0 conn(0x7f3ecc133f70 0x7f3ecc1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3eca59c700 1 -- 172.21.15.154:0/3331365962 >> v1:172.21.15.154:6789/0 conn(0x7f3ecc0a0a70 legacy=0x7f3ecc0a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ec959a700 1 -- 172.21.15.154:0/3331365962 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233182939 0 0) 0x7f3ecc09b110 con 0x7f3ecc0a0a70 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3eca59c700 1 -- 172.21.15.154:0/3331365962 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0a2fa0 con 0x7f3ecc09ad40 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.240+0000 7f3ec9d9b700 1 --2- 172.21.15.154:0/3331365962 >> v2:172.21.15.154:3300/0 conn(0x7f3ecc133f70 0x7f3ecc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.241+0000 7f3eca59c700 1 --2- 172.21.15.154:0/3331365962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc09ad40 0x7f3ecc133a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009870 tx=0x7f3ebc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7086a7ad6eed38e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.241+0000 7f3ec959a700 1 -- 172.21.15.154:0/3331365962 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc011830 con 0x7f3ecc09ad40 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.241+0000 7f3ec959a700 1 -- 172.21.15.154:0/3331365962 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc011990 con 0x7f3ecc09ad40 2023-09-30T22:21:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.241+0000 7f3ec959a700 1 -- 172.21.15.154:0/3331365962 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc011d20 con 0x7f3ecc09ad40 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.242+0000 7f3ed0909700 1 -- 172.21.15.154:0/3331365962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc09ad40 msgr2=0x7f3ecc133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.242+0000 7f3ed0909700 1 --2- 172.21.15.154:0/3331365962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc09ad40 0x7f3ecc133a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009870 tx=0x7f3ebc009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.242+0000 7f3ed0909700 1 -- 172.21.15.154:0/3331365962 shutdown_connections 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.242+0000 7f3ed0909700 1 --2- 172.21.15.154:0/3331365962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc09ad40 0x7f3ecc133a30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.242+0000 7f3ed0909700 1 --2- 172.21.15.154:0/3331365962 >> v2:172.21.15.154:3300/0 conn(0x7f3ecc133f70 0x7f3ecc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.242+0000 7f3ed0909700 1 -- 172.21.15.154:0/3331365962 >> 172.21.15.154:0/3331365962 conn(0x7f3ecc099c40 msgr2=0x7f3ecc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.242+0000 7f3ed0909700 1 -- 172.21.15.154:0/3331365962 shutdown_connections 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.242+0000 7f3ed0909700 1 -- 172.21.15.154:0/3331365962 wait complete. 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.243+0000 7f3ed0909700 1 Processor -- start 2023-09-30T22:21:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.243+0000 7f3ed0909700 1 -- start start 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.243+0000 7f3ed0909700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc09ad40 0x7f3ecc1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.243+0000 7f3ed0909700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc0a0a70 0x7f3ecc1c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.243+0000 7f3ed0909700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc133f70 0x7f3ecc1c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.243+0000 7f3ed0909700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc120850 con 0x7f3ecc133f70 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.243+0000 7f3ed0909700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc120660 con 0x7f3ecc09ad40 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.243+0000 7f3ed0909700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0a4110 con 0x7f3ecc0a0a70 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3eca59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc09ad40 0x7f3ecc1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3eca59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc09ad40 0x7f3ecc1c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49576/0 (socket says 172.21.15.154:49576) 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3eca59c700 1 -- 172.21.15.154:0/1621174652 learned_addr learned my addr 172.21.15.154:0/1621174652 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ecad9d700 1 --2- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc133f70 0x7f3ecc1c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ec9d9b700 1 --2- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc0a0a70 0x7f3ecc1c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ecad9d700 1 -- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc0a0a70 msgr2=0x7f3ecc1c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ecad9d700 1 --2- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc0a0a70 0x7f3ecc1c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ecad9d700 1 -- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc09ad40 msgr2=0x7f3ecc1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ecad9d700 1 --2- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc09ad40 0x7f3ecc1c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ecad9d700 1 -- 172.21.15.154:0/1621174652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009550 con 0x7f3ecc133f70 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ecad9d700 1 --2- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc133f70 0x7f3ecc1c8b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400c7f0 tx=0x7f3ec400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ebaffd700 1 -- 172.21.15.154:0/1621174652 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4003e30 con 0x7f3ecc133f70 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.244+0000 7f3ebaffd700 1 -- 172.21.15.154:0/1621174652 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4005070 con 0x7f3ecc133f70 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.245+0000 7f3ed0909700 1 -- 172.21.15.154:0/1621174652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc0094a0 con 0x7f3ecc133f70 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.245+0000 7f3ebaffd700 1 -- 172.21.15.154:0/1621174652 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4005420 con 0x7f3ecc133f70 2023-09-30T22:21:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.245+0000 7f3ed0909700 1 -- 172.21.15.154:0/1621174652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc1225e0 con 0x7f3ecc133f70 2023-09-30T22:21:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.246+0000 7f3ebaffd700 1 -- 172.21.15.154:0/1621174652 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f3ec4005580 con 0x7f3ecc133f70 2023-09-30T22:21:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.246+0000 7f3ed0909700 1 -- 172.21.15.154:0/1621174652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc122440 con 0x7f3ecc133f70 2023-09-30T22:21:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.246+0000 7f3ebaffd700 1 -- 172.21.15.154:0/1621174652 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f3ec403eae0 con 0x7f3ecc133f70 2023-09-30T22:21:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.250+0000 7f3ebaffd700 1 -- 172.21.15.154:0/1621174652 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f3ecc122440 con 0x7f3ecc133f70 2023-09-30T22:21:49.322 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:49.322+0000 7fbad83df240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T22:21:49.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.339+0000 7fb51e81f700 1 -- 172.21.15.154:0/1118132074 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb518072d60 con 0x7fb518134160 2023-09-30T22:21:49.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.339+0000 7fb514ff9700 1 -- 172.21.15.154:0/1118132074 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb510017070 con 0x7fb518134160 2023-09-30T22:21:49.340 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:49.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.341+0000 7fb51e81f700 1 -- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb518134160 msgr2=0x7fb518124650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.341+0000 7fb51e81f700 1 --2- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb518134160 0x7fb518124650 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb51000ca80 tx=0x7fb51000cd90 comp rx=0 tx=0).stop 2023-09-30T22:21:49.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.342+0000 7fb51e81f700 1 -- 172.21.15.154:0/1118132074 shutdown_connections 2023-09-30T22:21:49.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.342+0000 7fb51e81f700 1 --2- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb518134160 0x7fb518124650 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.342+0000 7fb51e81f700 1 --2- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb51809bd20 0x7fb518123bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.342+0000 7fb51e81f700 1 --2- 172.21.15.154:0/1118132074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5181337d0 0x7fb518124110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.342+0000 7fb51e81f700 1 -- 172.21.15.154:0/1118132074 >> 172.21.15.154:0/1118132074 conn(0x7fb51809f9f0 msgr2=0x7fb51806e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.342+0000 7fb51e81f700 1 -- 172.21.15.154:0/1118132074 shutdown_connections 2023-09-30T22:21:49.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.342+0000 7fb51e81f700 1 -- 172.21.15.154:0/1118132074 wait complete. 2023-09-30T22:21:49.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-09-30T22:21:49.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.359+0000 7f22b6910700 1 -- 172.21.15.154:0/3850658912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22b0124990 con 0x7f22b009e170 2023-09-30T22:21:49.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.359+0000 7f22acff9700 1 -- 172.21.15.154:0/3850658912 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22b0124990 con 0x7f22b009e170 2023-09-30T22:21:49.359 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:49.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.361+0000 7f22b6910700 1 -- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 msgr2=0x7f22b0121830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.361+0000 7f22b6910700 1 --2- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 0x7f22b0121830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f22b009a100 tx=0x7f22a4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:49.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.361+0000 7f22b6910700 1 -- 172.21.15.154:0/3850658912 shutdown_connections 2023-09-30T22:21:49.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.361+0000 7f22b6910700 1 --2- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f22b0130ce0 0x7f22b0121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.361+0000 7f22b6910700 1 --2- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b009d860 0x7f22b01212f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.361+0000 7f22b6910700 1 --2- 172.21.15.154:0/3850658912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b009e170 0x7f22b0121830 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.361+0000 7f22b6910700 1 -- 172.21.15.154:0/3850658912 >> 172.21.15.154:0/3850658912 conn(0x7f22b0099c40 msgr2=0x7f22b012ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.361+0000 7f22b6910700 1 -- 172.21.15.154:0/3850658912 shutdown_connections 2023-09-30T22:21:49.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.361+0000 7f22b6910700 1 -- 172.21.15.154:0/3850658912 wait complete. 2023-09-30T22:21:49.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-09-30T22:21:49.405 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:49.405+0000 7fbad83df240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T22:21:49.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.428+0000 7f3ed0909700 1 -- 172.21.15.154:0/1621174652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ecc122440 con 0x7f3ecc133f70 2023-09-30T22:21:49.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.428+0000 7f3ebaffd700 1 -- 172.21.15.154:0/1621174652 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ecc122440 con 0x7f3ecc133f70 2023-09-30T22:21:49.428 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.430+0000 7f3ed0909700 1 -- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc133f70 msgr2=0x7f3ecc1c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.430+0000 7f3ed0909700 1 --2- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc133f70 0x7f3ecc1c8b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400c7f0 tx=0x7f3ec400cb00 comp rx=0 tx=0).stop 2023-09-30T22:21:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.430+0000 7f3ed0909700 1 -- 172.21.15.154:0/1621174652 shutdown_connections 2023-09-30T22:21:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.430+0000 7f3ed0909700 1 --2- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc133f70 0x7f3ecc1c8b80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.430+0000 7f3ed0909700 1 --2- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc09ad40 0x7f3ecc1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.430+0000 7f3ed0909700 1 --2- 172.21.15.154:0/1621174652 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc0a0a70 0x7f3ecc1c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.430+0000 7f3ed0909700 1 -- 172.21.15.154:0/1621174652 >> 172.21.15.154:0/1621174652 conn(0x7f3ecc099c40 msgr2=0x7f3ecc09b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.430+0000 7f3ed0909700 1 -- 172.21.15.154:0/1621174652 shutdown_connections 2023-09-30T22:21:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:49.430+0000 7f3ed0909700 1 -- 172.21.15.154:0/1621174652 wait complete. 2023-09-30T22:21:49.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-09-30T22:21:49.485 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:49.485+0000 7fbad83df240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T22:21:49.612 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:49.612+0000 7fbad83df240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T22:21:49.800 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:49.800+0000 7fbad83df240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T22:21:49.949 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:49.950+0000 7fbad83df240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T22:21:50.021 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:50.021+0000 7fbad83df240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T22:21:50.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:50.354 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:50.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.369+0000 7f33da542700 1 Processor -- start 2023-09-30T22:21:50.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.369+0000 7f33da542700 1 -- start start 2023-09-30T22:21:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33da542700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d4131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33da542700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33d409bc70 0x7f33d409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33da542700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409c5c0 0x7f33d4138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33da542700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d406eb30 con 0x7f33d409bc70 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33da542700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40a1640 con 0x7f33d4131980 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33da542700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40a22d0 con 0x7f33d409c5c0 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d4131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d8adf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409c5c0 0x7f33d4138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d4131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49582/0 (socket says 172.21.15.154:49582) 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d3fff700 1 -- 172.21.15.154:0/2152326232 learned_addr learned my addr 172.21.15.154:0/2152326232 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d8adf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409c5c0 0x7f33d4138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59660/0 (socket says 172.21.15.154:59660) 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d37fe700 1 --2- 172.21.15.154:0/2152326232 >> v2:172.21.15.154:3300/0 conn(0x7f33d409bc70 0x7f33d409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d8adf700 1 -- 172.21.15.154:0/2152326232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 msgr2=0x7f33d4131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d8adf700 1 --2- 172.21.15.154:0/2152326232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d4131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d8adf700 1 -- 172.21.15.154:0/2152326232 >> v2:172.21.15.154:3300/0 conn(0x7f33d409bc70 msgr2=0x7f33d409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d8adf700 1 --2- 172.21.15.154:0/2152326232 >> v2:172.21.15.154:3300/0 conn(0x7f33d409bc70 0x7f33d409c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d8adf700 1 -- 172.21.15.154:0/2152326232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d4131550 con 0x7f33d409c5c0 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d3fff700 1 --2- 172.21.15.154:0/2152326232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d4131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.370+0000 7f33d37fe700 1 --2- 172.21.15.154:0/2152326232 >> v2:172.21.15.154:3300/0 conn(0x7f33d409bc70 0x7f33d409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.371+0000 7f33d8adf700 1 --2- 172.21.15.154:0/2152326232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409c5c0 0x7f33d4138700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00f3a0 tx=0x7f33cc00f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cd1c2fe4b6b08b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.371+0000 7f33d2ffd700 1 -- 172.21.15.154:0/2152326232 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc012070 con 0x7f33d409c5c0 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.371+0000 7f33d2ffd700 1 -- 172.21.15.154:0/2152326232 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc00fe60 con 0x7f33d409c5c0 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.371+0000 7f33d2ffd700 1 -- 172.21.15.154:0/2152326232 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc00d310 con 0x7f33d409c5c0 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.371+0000 7f33da542700 1 -- 172.21.15.154:0/2152326232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409c5c0 msgr2=0x7f33d4138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.371+0000 7f33da542700 1 --2- 172.21.15.154:0/2152326232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409c5c0 0x7f33d4138700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00f3a0 tx=0x7f33cc00f6b0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.372+0000 7f33da542700 1 -- 172.21.15.154:0/2152326232 shutdown_connections 2023-09-30T22:21:50.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.372+0000 7f33da542700 1 --2- 172.21.15.154:0/2152326232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d4131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.372+0000 7f33da542700 1 --2- 172.21.15.154:0/2152326232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409c5c0 0x7f33d4138700 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.372+0000 7f33da542700 1 --2- 172.21.15.154:0/2152326232 >> v2:172.21.15.154:3300/0 conn(0x7f33d409bc70 0x7f33d409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.372+0000 7f33da542700 1 -- 172.21.15.154:0/2152326232 >> 172.21.15.154:0/2152326232 conn(0x7f33d40a2980 msgr2=0x7f33d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.372+0000 7f33da542700 1 -- 172.21.15.154:0/2152326232 shutdown_connections 2023-09-30T22:21:50.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.372+0000 7f33da542700 1 -- 172.21.15.154:0/2152326232 wait complete. 2023-09-30T22:21:50.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:50.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.372+0000 7f33da542700 1 Processor -- start 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33da542700 1 -- start start 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33da542700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409bc70 0x7f33d411b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33da542700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33d409c5c0 0x7f33d411be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33da542700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d411c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33da542700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d411cdd0 con 0x7f33d409c5c0 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33da542700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d412ecf0 con 0x7f33d4131980 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33da542700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33d411e760 con 0x7f33d409bc70 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33d3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409bc70 0x7f33d411b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33d3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409bc70 0x7f33d411b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59676/0 (socket says 172.21.15.154:59676) 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33d3fff700 1 -- 172.21.15.154:0/3083314471 learned_addr learned my addr 172.21.15.154:0/3083314471 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:50.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33d8adf700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d411c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.373+0000 7f33d37fe700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33d409c5c0 0x7f33d411be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d8adf700 1 -- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409bc70 msgr2=0x7f33d411b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d8adf700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409bc70 0x7f33d411b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d8adf700 1 -- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33d409c5c0 msgr2=0x7f33d411be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d8adf700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33d409c5c0 0x7f33d411be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d8adf700 1 -- 172.21.15.154:0/3083314471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80094a0 con 0x7f33d4131980 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d3fff700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409bc70 0x7f33d411b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d8adf700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d411c380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f33cc019000 tx=0x7f33cc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d0ff9700 1 -- 172.21.15.154:0/3083314471 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc003a20 con 0x7f33d4131980 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d0ff9700 1 -- 172.21.15.154:0/3083314471 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc003b80 con 0x7f33d4131980 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33da542700 1 -- 172.21.15.154:0/3083314471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c4009500 con 0x7f33d4131980 2023-09-30T22:21:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33d0ff9700 1 -- 172.21.15.154:0/3083314471 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc004050 con 0x7f33d4131980 2023-09-30T22:21:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.374+0000 7f33da542700 1 -- 172.21.15.154:0/3083314471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33cc00f050 con 0x7f33d4131980 2023-09-30T22:21:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.375+0000 7f33d0ff9700 1 -- 172.21.15.154:0/3083314471 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f33cc0041b0 con 0x7f33d4131980 2023-09-30T22:21:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.375+0000 7f33d0ff9700 1 -- 172.21.15.154:0/3083314471 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f33cc044eb0 con 0x7f33d4131980 2023-09-30T22:21:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.375+0000 7f33da542700 1 -- 172.21.15.154:0/3083314471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d4071640 con 0x7f33d4131980 2023-09-30T22:21:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.380+0000 7f33d0ff9700 1 -- 172.21.15.154:0/3083314471 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f33cc004460 con 0x7f33d4131980 2023-09-30T22:21:50.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:50.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.493+0000 7f9af3135700 1 Processor -- start 2023-09-30T22:21:50.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.494+0000 7f9af3135700 1 -- start start 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.494+0000 7f9af3135700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec09e340 0x7f9aec1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.494+0000 7f9af3135700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9aec135f20 0x7f9aec138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.494+0000 7f9af3135700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aec09aaa0 con 0x7f9aec09d860 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.494+0000 7f9af3135700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aec09e730 con 0x7f9aec135f20 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.494+0000 7f9af3135700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec09f870 con 0x7f9aec09e340 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.494+0000 7f9aebfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec09e340 0x7f9aec1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.494+0000 7f9aebfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec09e340 0x7f9aec1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59690/0 (socket says 172.21.15.154:59690) 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.494+0000 7f9aebfff700 1 -- 172.21.15.154:0/3747645207 learned_addr learned my addr 172.21.15.154:0/3747645207 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.495+0000 7f9af16d2700 1 --2- 172.21.15.154:0/3747645207 >> v2:172.21.15.154:3300/0 conn(0x7f9aec135f20 0x7f9aec138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.495+0000 7f9aebfff700 1 -- 172.21.15.154:0/3747645207 >> v2:172.21.15.154:3300/0 conn(0x7f9aec135f20 msgr2=0x7f9aec138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.495+0000 7f9aebfff700 1 --2- 172.21.15.154:0/3747645207 >> v2:172.21.15.154:3300/0 conn(0x7f9aec135f20 0x7f9aec138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.495+0000 7f9aebfff700 1 -- 172.21.15.154:0/3747645207 >> v1:172.21.15.154:6789/0 conn(0x7f9aec09d860 legacy=0x7f9aec09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.495+0000 7f9aebfff700 1 -- 172.21.15.154:0/3747645207 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec09b360 con 0x7f9aec09e340 2023-09-30T22:21:50.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.495+0000 7f9aebfff700 1 --2- 172.21.15.154:0/3747645207 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec09e340 0x7f9aec1359e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80098f0 tx=0x7f9ad8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b811594595b52896 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.495+0000 7f9aeb7fe700 1 -- 172.21.15.154:0/3747645207 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8004230 con 0x7f9aec09e340 2023-09-30T22:21:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.495+0000 7f9aeb7fe700 1 -- 172.21.15.154:0/3747645207 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8004390 con 0x7f9aec09e340 2023-09-30T22:21:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.495+0000 7f9aeb7fe700 1 -- 172.21.15.154:0/3747645207 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80036a0 con 0x7f9aec09e340 2023-09-30T22:21:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.496+0000 7f9af3135700 1 -- 172.21.15.154:0/3747645207 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec09e340 msgr2=0x7f9aec1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.496+0000 7f9af3135700 1 --2- 172.21.15.154:0/3747645207 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec09e340 0x7f9aec1359e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80098f0 tx=0x7f9ad8009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.496+0000 7f9af3135700 1 -- 172.21.15.154:0/3747645207 shutdown_connections 2023-09-30T22:21:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.496+0000 7f9af3135700 1 --2- 172.21.15.154:0/3747645207 >> v2:172.21.15.154:3300/0 conn(0x7f9aec135f20 0x7f9aec138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.496+0000 7f9af3135700 1 --2- 172.21.15.154:0/3747645207 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec09e340 0x7f9aec1359e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.496+0000 7f9af3135700 1 -- 172.21.15.154:0/3747645207 >> 172.21.15.154:0/3747645207 conn(0x7f9aec099c40 msgr2=0x7f9aec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.496+0000 7f9af3135700 1 -- 172.21.15.154:0/3747645207 shutdown_connections 2023-09-30T22:21:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.496+0000 7f9af3135700 1 -- 172.21.15.154:0/3747645207 wait complete. 2023-09-30T22:21:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.497+0000 7f9af3135700 1 Processor -- start 2023-09-30T22:21:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.497+0000 7f9af3135700 1 -- start start 2023-09-30T22:21:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af3135700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aec09d860 0x7f9aec11b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af3135700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aec09e340 0x7f9aec11b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af3135700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec135f20 0x7f9aec11bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af3135700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec11e2c0 con 0x7f9aec09d860 2023-09-30T22:21:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af3135700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec11d8d0 con 0x7f9aec09e340 2023-09-30T22:21:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af3135700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec0a20c0 con 0x7f9aec135f20 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af16d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec135f20 0x7f9aec11bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af16d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec135f20 0x7f9aec11bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59706/0 (socket says 172.21.15.154:59706) 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af16d2700 1 -- 172.21.15.154:0/2234764111 learned_addr learned my addr 172.21.15.154:0/2234764111 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af0ed1700 1 --2- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aec09d860 0x7f9aec11b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af16d2700 1 -- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aec09e340 msgr2=0x7f9aec11b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af16d2700 1 --2- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aec09e340 0x7f9aec11b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af16d2700 1 -- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aec09d860 msgr2=0x7f9aec11b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af16d2700 1 --2- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aec09d860 0x7f9aec11b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.498+0000 7f9af16d2700 1 -- 172.21.15.154:0/2234764111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009550 con 0x7f9aec135f20 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.499+0000 7f9af16d2700 1 --2- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec135f20 0x7f9aec11bee0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007e70 tx=0x7f9ae400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.499+0000 7f9ae97fa700 1 -- 172.21.15.154:0/2234764111 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400ede0 con 0x7f9aec135f20 2023-09-30T22:21:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.499+0000 7f9ae97fa700 1 -- 172.21.15.154:0/2234764111 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae4014420 con 0x7f9aec135f20 2023-09-30T22:21:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.499+0000 7f9af3135700 1 -- 172.21.15.154:0/2234764111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aec09c8b0 con 0x7f9aec135f20 2023-09-30T22:21:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.499+0000 7f9af3135700 1 -- 172.21.15.154:0/2234764111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aec11e710 con 0x7f9aec135f20 2023-09-30T22:21:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.499+0000 7f9ae97fa700 1 -- 172.21.15.154:0/2234764111 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40147d0 con 0x7f9aec135f20 2023-09-30T22:21:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.500+0000 7f9af3135700 1 -- 172.21.15.154:0/2234764111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc0052e0 con 0x7f9aec135f20 2023-09-30T22:21:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.501+0000 7f9ae97fa700 1 -- 172.21.15.154:0/2234764111 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f9ae4014930 con 0x7f9aec135f20 2023-09-30T22:21:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.501+0000 7f9ae97fa700 1 -- 172.21.15.154:0/2234764111 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f9ae403fc70 con 0x7f9aec135f20 2023-09-30T22:21:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.508+0000 7f9ae97fa700 1 -- 172.21.15.154:0/2234764111 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f9ae401b920 con 0x7f9aec135f20 2023-09-30T22:21:50.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.522+0000 7f16f5d91700 1 Processor -- start 2023-09-30T22:21:50.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.522+0000 7f16f5d91700 1 -- start start 2023-09-30T22:21:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16f5d91700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009e870 0x7f16f009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16f5d91700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f009f180 0x7f16f0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16f5d91700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16f0131d70 0x7f16f0132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16f5d91700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f00a0920 con 0x7f16f0131d70 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16f5d91700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f009c970 con 0x7f16f009e870 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16f5d91700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f009bab0 con 0x7f16f009f180 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16ef7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009e870 0x7f16f009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16ef7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009e870 0x7f16f009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49598/0 (socket says 172.21.15.154:49598) 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16ef7fe700 1 -- 172.21.15.154:0/788875784 learned_addr learned my addr 172.21.15.154:0/788875784 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16effff700 1 --2- 172.21.15.154:0/788875784 >> v2:172.21.15.154:3300/0 conn(0x7f16f0131d70 0x7f16f0132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16ef7fe700 1 -- 172.21.15.154:0/788875784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f009f180 msgr2=0x7f16f0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16ef7fe700 1 --2- 172.21.15.154:0/788875784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f009f180 0x7f16f0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16ef7fe700 1 -- 172.21.15.154:0/788875784 >> v2:172.21.15.154:3300/0 conn(0x7f16f0131d70 msgr2=0x7f16f0132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16ef7fe700 1 --2- 172.21.15.154:0/788875784 >> v2:172.21.15.154:3300/0 conn(0x7f16f0131d70 0x7f16f0132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16ef7fe700 1 -- 172.21.15.154:0/788875784 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f009f9c0 con 0x7f16f009e870 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.523+0000 7f16ef7fe700 1 --2- 172.21.15.154:0/788875784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009e870 0x7f16f009ec40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f16e00098f0 tx=0x7f16e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8874103555da25d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.524+0000 7f16ee7fc700 1 -- 172.21.15.154:0/788875784 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0010a90 con 0x7f16f009e870 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.524+0000 7f16ee7fc700 1 -- 172.21.15.154:0/788875784 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e0010bf0 con 0x7f16f009e870 2023-09-30T22:21:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.524+0000 7f16ee7fc700 1 -- 172.21.15.154:0/788875784 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0018440 con 0x7f16f009e870 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.524+0000 7f16f5d91700 1 -- 172.21.15.154:0/788875784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009e870 msgr2=0x7f16f009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.524+0000 7f16f5d91700 1 --2- 172.21.15.154:0/788875784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009e870 0x7f16f009ec40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f16e00098f0 tx=0x7f16e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.525+0000 7f16f5d91700 1 -- 172.21.15.154:0/788875784 shutdown_connections 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.525+0000 7f16f5d91700 1 --2- 172.21.15.154:0/788875784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009e870 0x7f16f009ec40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.525+0000 7f16f5d91700 1 --2- 172.21.15.154:0/788875784 >> v2:172.21.15.154:3300/0 conn(0x7f16f0131d70 0x7f16f0132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.525+0000 7f16f5d91700 1 --2- 172.21.15.154:0/788875784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f009f180 0x7f16f0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.525+0000 7f16f5d91700 1 -- 172.21.15.154:0/788875784 >> 172.21.15.154:0/788875784 conn(0x7f16f00a4430 msgr2=0x7f16f00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.525+0000 7f16f5d91700 1 -- 172.21.15.154:0/788875784 shutdown_connections 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.525+0000 7f16f5d91700 1 -- 172.21.15.154:0/788875784 wait complete. 2023-09-30T22:21:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.526+0000 7f16f5d91700 1 Processor -- start 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.526+0000 7f16f5d91700 1 -- start start 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.526+0000 7f16f5d91700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f009e870 0x7f16f01bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.526+0000 7f16f5d91700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009f180 0x7f16f01ba890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.526+0000 7f16f5d91700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f0131d70 0x7f16f01badd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.526+0000 7f16f5d91700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f01be120 con 0x7f16f009e870 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.526+0000 7f16f5d91700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f01c1400 con 0x7f16f009f180 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.526+0000 7f16f5d91700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f01bde40 con 0x7f16f0131d70 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009f180 0x7f16f01ba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009f180 0x7f16f01ba890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49600/0 (socket says 172.21.15.154:49600) 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16eeffd700 1 -- 172.21.15.154:0/254069327 learned_addr learned my addr 172.21.15.154:0/254069327 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16effff700 1 --2- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f0131d70 0x7f16f01badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16eeffd700 1 -- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f0131d70 msgr2=0x7f16f01badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16eeffd700 1 --2- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f0131d70 0x7f16f01badd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16eeffd700 1 -- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f009e870 msgr2=0x7f16f01bc3b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16eeffd700 1 --2- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f009e870 0x7f16f01bc3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16eeffd700 1 -- 172.21.15.154:0/254069327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0009550 con 0x7f16f009f180 2023-09-30T22:21:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16eeffd700 1 --2- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009f180 0x7f16f01ba890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f16e400b530 tx=0x7f16e400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.527+0000 7f16d7fff700 1 -- 172.21.15.154:0/254069327 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4011830 con 0x7f16f009f180 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.528+0000 7f16d7fff700 1 -- 172.21.15.154:0/254069327 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e4011990 con 0x7f16f009f180 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.528+0000 7f16d7fff700 1 -- 172.21.15.154:0/254069327 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4011d20 con 0x7f16f009f180 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.528+0000 7f16f5d91700 1 -- 172.21.15.154:0/254069327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f01be8b0 con 0x7f16f009f180 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.528+0000 7f16f5d91700 1 -- 172.21.15.154:0/254069327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f01bb4f0 con 0x7f16f009f180 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.529+0000 7f16d7fff700 1 -- 172.21.15.154:0/254069327 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f16e401a400 con 0x7f16f009f180 2023-09-30T22:21:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.529+0000 7f16f5d91700 1 -- 172.21.15.154:0/254069327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f004f2a0 con 0x7f16f009f180 2023-09-30T22:21:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.529+0000 7f16d7fff700 1 -- 172.21.15.154:0/254069327 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f16e4017c90 con 0x7f16f009f180 2023-09-30T22:21:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.537+0000 7f16d7fff700 1 -- 172.21.15.154:0/254069327 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f16e4015030 con 0x7f16f009f180 2023-09-30T22:21:50.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.574+0000 7f33da542700 1 -- 172.21.15.154:0/3083314471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f33d4072220 con 0x7f33d4131980 2023-09-30T22:21:50.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.574+0000 7f33d0ff9700 1 -- 172.21.15.154:0/3083314471 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33cc037090 con 0x7f33d4131980 2023-09-30T22:21:50.574 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:50.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.576+0000 7f33da542700 1 -- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 msgr2=0x7f33d411c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.576+0000 7f33da542700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d411c380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f33cc019000 tx=0x7f33cc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.577+0000 7f33da542700 1 -- 172.21.15.154:0/3083314471 shutdown_connections 2023-09-30T22:21:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.577+0000 7f33da542700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33d4131980 0x7f33d411c380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.577+0000 7f33da542700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33d409bc70 0x7f33d411b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.577+0000 7f33da542700 1 --2- 172.21.15.154:0/3083314471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33d409c5c0 0x7f33d411be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.577+0000 7f33da542700 1 -- 172.21.15.154:0/3083314471 >> 172.21.15.154:0/3083314471 conn(0x7f33d40a2980 msgr2=0x7f33d409f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.577+0000 7f33da542700 1 -- 172.21.15.154:0/3083314471 shutdown_connections 2023-09-30T22:21:50.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.577+0000 7f33da542700 1 -- 172.21.15.154:0/3083314471 wait complete. 2023-09-30T22:21:50.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-09-30T22:21:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.631+0000 7f7d016f3700 1 Processor -- start 2023-09-30T22:21:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.631+0000 7f7d016f3700 1 -- start start 2023-09-30T22:21:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7d016f3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cfc09e870 0x7f7cfc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7d016f3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7d016f3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cfc09c970 con 0x7f7cfc131d70 2023-09-30T22:21:50.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7d016f3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc0a0920 con 0x7f7cfc09e870 2023-09-30T22:21:50.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7d016f3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc09f9c0 con 0x7f7cfc09f180 2023-09-30T22:21:50.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7cfaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cfc09e870 0x7f7cfc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7cfaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cfc09e870 0x7f7cfc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40958/0 (socket says 172.21.15.154:40958) 2023-09-30T22:21:50.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7cfaffd700 1 -- 172.21.15.154:0/3947920053 learned_addr learned my addr 172.21.15.154:0/3947920053 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7cfb7fe700 1 --1- 172.21.15.154:0/3947920053 >> v1:172.21.15.154:6789/0 conn(0x7f7cfc131d70 0x7f7cfc138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57210/0 (socket says 172.21.15.154:57210) 2023-09-30T22:21:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7cfa7fc700 1 --2- 172.21.15.154:0/3947920053 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7cfa7fc700 1 -- 172.21.15.154:0/3947920053 >> v2:172.21.15.154:3300/0 conn(0x7f7cfc09e870 msgr2=0x7f7cfc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7cfa7fc700 1 --2- 172.21.15.154:0/3947920053 >> v2:172.21.15.154:3300/0 conn(0x7f7cfc09e870 0x7f7cfc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7cfa7fc700 1 -- 172.21.15.154:0/3947920053 >> v1:172.21.15.154:6789/0 conn(0x7f7cfc131d70 legacy=0x7f7cfc138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.632+0000 7f7cfa7fc700 1 -- 172.21.15.154:0/3947920053 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc09bab0 con 0x7f7cfc09f180 2023-09-30T22:21:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.633+0000 7f7cfa7fc700 1 --2- 172.21.15.154:0/3947920053 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc131830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009840 tx=0x7f7cf0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3119214f8d500524 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.633+0000 7f7cf9ffb700 1 -- 172.21.15.154:0/3947920053 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0011830 con 0x7f7cfc09f180 2023-09-30T22:21:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.633+0000 7f7cf9ffb700 1 -- 172.21.15.154:0/3947920053 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf0011990 con 0x7f7cfc09f180 2023-09-30T22:21:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.633+0000 7f7cf9ffb700 1 -- 172.21.15.154:0/3947920053 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0011d20 con 0x7f7cfc09f180 2023-09-30T22:21:50.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.634+0000 7f7d016f3700 1 -- 172.21.15.154:0/3947920053 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 msgr2=0x7f7cfc131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.634+0000 7f7d016f3700 1 --2- 172.21.15.154:0/3947920053 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc131830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009840 tx=0x7f7cf0009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:50.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.634+0000 7f7d016f3700 1 -- 172.21.15.154:0/3947920053 shutdown_connections 2023-09-30T22:21:50.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.634+0000 7f7d016f3700 1 --2- 172.21.15.154:0/3947920053 >> v2:172.21.15.154:3300/0 conn(0x7f7cfc09e870 0x7f7cfc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.634+0000 7f7d016f3700 1 --2- 172.21.15.154:0/3947920053 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc131830 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.634+0000 7f7d016f3700 1 -- 172.21.15.154:0/3947920053 >> 172.21.15.154:0/3947920053 conn(0x7f7cfc0a4430 msgr2=0x7f7cfc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.634+0000 7f7d016f3700 1 -- 172.21.15.154:0/3947920053 shutdown_connections 2023-09-30T22:21:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.634+0000 7f7d016f3700 1 -- 172.21.15.154:0/3947920053 wait complete. 2023-09-30T22:21:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7d016f3700 1 Processor -- start 2023-09-30T22:21:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7d016f3700 1 -- start start 2023-09-30T22:21:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7d016f3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cfc09e870 0x7f7cfc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7d016f3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7d016f3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cfc131d70 0x7f7cfc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7d016f3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc131010 con 0x7f7cfc09e870 2023-09-30T22:21:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7d016f3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc06d550 con 0x7f7cfc131d70 2023-09-30T22:21:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7d016f3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc09dba0 con 0x7f7cfc09f180 2023-09-30T22:21:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7cfaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cfc09e870 0x7f7cfc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7cfaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cfc09e870 0x7f7cfc06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40960/0 (socket says 172.21.15.154:40960) 2023-09-30T22:21:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7cfaffd700 1 -- 172.21.15.154:0/672630160 learned_addr learned my addr 172.21.15.154:0/672630160 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.635+0000 7f7cfb7fe700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cfc131d70 0x7f7cfc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7cfa7fc700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7cfb7fe700 1 -- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 msgr2=0x7f7cfc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7cfb7fe700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7cfb7fe700 1 -- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cfc09e870 msgr2=0x7f7cfc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7cfb7fe700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cfc09e870 0x7f7cfc06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7cfb7fe700 1 -- 172.21.15.154:0/672630160 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf00094a0 con 0x7f7cfc131d70 2023-09-30T22:21:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7cfa7fc700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7cfb7fe700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cfc131d70 0x7f7cfc06c330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400cb10 tx=0x7f7cf400ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7ce37fe700 1 -- 172.21.15.154:0/672630160 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400a9e0 con 0x7f7cfc131d70 2023-09-30T22:21:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7ce37fe700 1 -- 172.21.15.154:0/672630160 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400ab40 con 0x7f7cfc131d70 2023-09-30T22:21:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7d016f3700 1 -- 172.21.15.154:0/672630160 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc125a90 con 0x7f7cfc131d70 2023-09-30T22:21:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7ce37fe700 1 -- 172.21.15.154:0/672630160 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4007070 con 0x7f7cfc131d70 2023-09-30T22:21:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.636+0000 7f7d016f3700 1 -- 172.21.15.154:0/672630160 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc1267a0 con 0x7f7cfc131d70 2023-09-30T22:21:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.637+0000 7f7d016f3700 1 -- 172.21.15.154:0/672630160 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc04f2a0 con 0x7f7cfc131d70 2023-09-30T22:21:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.638+0000 7f7ce37fe700 1 -- 172.21.15.154:0/672630160 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f7cf40071d0 con 0x7f7cfc131d70 2023-09-30T22:21:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.638+0000 7f7ce37fe700 1 -- 172.21.15.154:0/672630160 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f7cf403f170 con 0x7f7cfc131d70 2023-09-30T22:21:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.646+0000 7f7ce37fe700 1 -- 172.21.15.154:0/672630160 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f7cf401b3b0 con 0x7f7cfc131d70 2023-09-30T22:21:50.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.691+0000 7f9af3135700 1 -- 172.21.15.154:0/2234764111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9acc005590 con 0x7f9aec135f20 2023-09-30T22:21:50.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.692+0000 7f9ae97fa700 1 -- 172.21.15.154:0/2234764111 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ae401b920 con 0x7f9aec135f20 2023-09-30T22:21:50.692 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:50.692 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:50.693+0000 7fbad83df240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T22:21:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.694+0000 7f9af3135700 1 -- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec135f20 msgr2=0x7f9aec11bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.694+0000 7f9af3135700 1 --2- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec135f20 0x7f9aec11bee0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007e70 tx=0x7f9ae400e3c0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.694+0000 7f9af3135700 1 -- 172.21.15.154:0/2234764111 shutdown_connections 2023-09-30T22:21:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.694+0000 7f9af3135700 1 --2- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9aec135f20 0x7f9aec11bee0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.694+0000 7f9af3135700 1 --2- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aec09d860 0x7f9aec11b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.694+0000 7f9af3135700 1 --2- 172.21.15.154:0/2234764111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aec09e340 0x7f9aec11b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.694+0000 7f9af3135700 1 -- 172.21.15.154:0/2234764111 >> 172.21.15.154:0/2234764111 conn(0x7f9aec099c40 msgr2=0x7f9aec1328a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.694+0000 7f9af3135700 1 -- 172.21.15.154:0/2234764111 shutdown_connections 2023-09-30T22:21:50.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.694+0000 7f9af3135700 1 -- 172.21.15.154:0/2234764111 wait complete. 2023-09-30T22:21:50.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-09-30T22:21:50.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.713+0000 7f16f5d91700 1 -- 172.21.15.154:0/254069327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f16f006b2a0 con 0x7f16f009f180 2023-09-30T22:21:50.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.713+0000 7f16d7fff700 1 -- 172.21.15.154:0/254069327 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16e4044060 con 0x7f16f009f180 2023-09-30T22:21:50.714 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:50.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.715+0000 7f16f5d91700 1 -- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009f180 msgr2=0x7f16f01ba890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.715+0000 7f16f5d91700 1 --2- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009f180 0x7f16f01ba890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f16e400b530 tx=0x7f16e400b840 comp rx=0 tx=0).stop 2023-09-30T22:21:50.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.715+0000 7f16f5d91700 1 -- 172.21.15.154:0/254069327 shutdown_connections 2023-09-30T22:21:50.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.715+0000 7f16f5d91700 1 --2- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16f0131d70 0x7f16f01badd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.715+0000 7f16f5d91700 1 --2- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16f009e870 0x7f16f01bc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.715+0000 7f16f5d91700 1 --2- 172.21.15.154:0/254069327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16f009f180 0x7f16f01ba890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.716+0000 7f16f5d91700 1 -- 172.21.15.154:0/254069327 >> 172.21.15.154:0/254069327 conn(0x7f16f00a4430 msgr2=0x7f16f009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.716+0000 7f16f5d91700 1 -- 172.21.15.154:0/254069327 shutdown_connections 2023-09-30T22:21:50.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.716+0000 7f16f5d91700 1 -- 172.21.15.154:0/254069327 wait complete. 2023-09-30T22:21:50.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-09-30T22:21:50.831 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:50.831+0000 7fbad83df240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T22:21:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.851+0000 7f7d016f3700 1 -- 172.21.15.154:0/672630160 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7cfc06b2a0 con 0x7f7cfc131d70 2023-09-30T22:21:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.852+0000 7f7ce37fe700 1 -- 172.21.15.154:0/672630160 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cf4017020 con 0x7f7cfc131d70 2023-09-30T22:21:50.852 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.854+0000 7f7d016f3700 1 -- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cfc131d70 msgr2=0x7f7cfc06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.854+0000 7f7d016f3700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cfc131d70 0x7f7cfc06c330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400cb10 tx=0x7f7cf400ce20 comp rx=0 tx=0).stop 2023-09-30T22:21:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.854+0000 7f7d016f3700 1 -- 172.21.15.154:0/672630160 shutdown_connections 2023-09-30T22:21:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.854+0000 7f7d016f3700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cfc131d70 0x7f7cfc06c330 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.854+0000 7f7d016f3700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cfc09e870 0x7f7cfc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.854+0000 7f7d016f3700 1 --2- 172.21.15.154:0/672630160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cfc09f180 0x7f7cfc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.854+0000 7f7d016f3700 1 -- 172.21.15.154:0/672630160 >> 172.21.15.154:0/672630160 conn(0x7f7cfc0a4430 msgr2=0x7f7cfc0a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.854+0000 7f7d016f3700 1 -- 172.21.15.154:0/672630160 shutdown_connections 2023-09-30T22:21:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:50.854+0000 7f7d016f3700 1 -- 172.21.15.154:0/672630160 wait complete. 2023-09-30T22:21:50.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-09-30T22:21:50.950 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:50.951+0000 7fbad83df240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:21:51.490 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:51.490+0000 7fbad83df240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T22:21:51.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:51.613 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:51.613+0000 7fbad83df240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T22:21:51.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:51.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.718+0000 7f791b0ab700 1 Processor -- start 2023-09-30T22:21:51.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.718+0000 7f791b0ab700 1 -- start start 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f791b0ab700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f791409e870 0x7f791409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f791b0ab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409f180 0x7f7914131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f791b0ab700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7914131d70 0x7f79141321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f791b0ab700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79140a0920 con 0x7f791409e870 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f791b0ab700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791409c970 con 0x7f791409f180 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f791b0ab700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f791409bab0 con 0x7f7914131d70 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7919648700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7914131d70 0x7f79141321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7919648700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7914131d70 0x7f79141321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59748/0 (socket says 172.21.15.154:59748) 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7919648700 1 -- 172.21.15.154:0/3385699556 learned_addr learned my addr 172.21.15.154:0/3385699556 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:51.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7913fff700 1 --2- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409f180 0x7f7914131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7918e47700 1 --2- 172.21.15.154:0/3385699556 >> v2:172.21.15.154:3300/0 conn(0x7f791409e870 0x7f791409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7918e47700 1 -- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7914131d70 msgr2=0x7f79141321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7918e47700 1 --2- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7914131d70 0x7f79141321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7918e47700 1 -- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409f180 msgr2=0x7f7914131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7918e47700 1 --2- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409f180 0x7f7914131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7918e47700 1 -- 172.21.15.154:0/3385699556 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791409f9c0 con 0x7f791409e870 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.719+0000 7f7913fff700 1 --2- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409f180 0x7f7914131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.720+0000 7f7918e47700 1 --2- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f791409e870 0x7f791409ec40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7908009870 tx=0x7f7908009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75dfb12f8a8055c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.720+0000 7f79137fe700 1 -- 172.21.15.154:0/3385699556 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908011830 con 0x7f791409e870 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.720+0000 7f79137fe700 1 -- 172.21.15.154:0/3385699556 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908011990 con 0x7f791409e870 2023-09-30T22:21:51.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.720+0000 7f79137fe700 1 -- 172.21.15.154:0/3385699556 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908011d20 con 0x7f791409e870 2023-09-30T22:21:51.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.721+0000 7f791b0ab700 1 -- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f791409e870 msgr2=0x7f791409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.721+0000 7f791b0ab700 1 --2- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f791409e870 0x7f791409ec40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7908009870 tx=0x7f7908009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:51.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.721+0000 7f791b0ab700 1 -- 172.21.15.154:0/3385699556 shutdown_connections 2023-09-30T22:21:51.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.721+0000 7f791b0ab700 1 --2- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7914131d70 0x7f79141321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.721+0000 7f791b0ab700 1 --2- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f791409e870 0x7f791409ec40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.721+0000 7f791b0ab700 1 --2- 172.21.15.154:0/3385699556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409f180 0x7f7914131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.721+0000 7f791b0ab700 1 -- 172.21.15.154:0/3385699556 >> 172.21.15.154:0/3385699556 conn(0x7f79140a4430 msgr2=0x7f79140a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:51.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.721+0000 7f791b0ab700 1 -- 172.21.15.154:0/3385699556 shutdown_connections 2023-09-30T22:21:51.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.721+0000 7f791b0ab700 1 -- 172.21.15.154:0/3385699556 wait complete. 2023-09-30T22:21:51.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.722+0000 7f791b0ab700 1 Processor -- start 2023-09-30T22:21:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.722+0000 7f791b0ab700 1 -- start start 2023-09-30T22:21:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f791b0ab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409e870 0x7f79141202a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f791b0ab700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f791409f180 0x7f79141207e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f791b0ab700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7914131d70 0x7f7914120d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f791b0ab700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7914122cf0 con 0x7f7914131d70 2023-09-30T22:21:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f791b0ab700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791409b160 con 0x7f791409e870 2023-09-30T22:21:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f791b0ab700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7914131620 con 0x7f791409f180 2023-09-30T22:21:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7918e47700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409e870 0x7f79141202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7918e47700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409e870 0x7f79141202a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49636/0 (socket says 172.21.15.154:49636) 2023-09-30T22:21:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7918e47700 1 -- 172.21.15.154:0/2815152899 learned_addr learned my addr 172.21.15.154:0/2815152899 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7919648700 1 --2- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7914131d70 0x7f7914120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7913fff700 1 --2- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f791409f180 0x7f79141207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7918e47700 1 -- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f791409f180 msgr2=0x7f79141207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7918e47700 1 --2- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f791409f180 0x7f79141207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7918e47700 1 -- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7914131d70 msgr2=0x7f7914120d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7918e47700 1 --2- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7914131d70 0x7f7914120d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.723+0000 7f7918e47700 1 -- 172.21.15.154:0/2815152899 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000094a0 con 0x7f791409e870 2023-09-30T22:21:51.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.724+0000 7f7918e47700 1 --2- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409e870 0x7f79141202a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7908000c00 tx=0x7f7908004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.724+0000 7f79117fa700 1 -- 172.21.15.154:0/2815152899 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908004450 con 0x7f791409e870 2023-09-30T22:21:51.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.724+0000 7f79117fa700 1 -- 172.21.15.154:0/2815152899 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908023070 con 0x7f791409e870 2023-09-30T22:21:51.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.724+0000 7f791b0ab700 1 -- 172.21.15.154:0/2815152899 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79080094a0 con 0x7f791409e870 2023-09-30T22:21:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.724+0000 7f79117fa700 1 -- 172.21.15.154:0/2815152899 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790801fa80 con 0x7f791409e870 2023-09-30T22:21:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.724+0000 7f791b0ab700 1 -- 172.21.15.154:0/2815152899 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7914123e10 con 0x7f791409e870 2023-09-30T22:21:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.725+0000 7f79117fa700 1 -- 172.21.15.154:0/2815152899 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f790801fbe0 con 0x7f791409e870 2023-09-30T22:21:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.725+0000 7f79117fa700 1 -- 172.21.15.154:0/2815152899 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f7908025070 con 0x7f791409e870 2023-09-30T22:21:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.725+0000 7f791b0ab700 1 -- 172.21.15.154:0/2815152899 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791404f2a0 con 0x7f791409e870 2023-09-30T22:21:51.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:51.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.729+0000 7f79117fa700 1 -- 172.21.15.154:0/2815152899 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f7908015070 con 0x7f791409e870 2023-09-30T22:21:51.793 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:51.793+0000 7fbad83df240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T22:21:51.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.860+0000 7fae63ce6700 1 Processor -- start 2023-09-30T22:21:51.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.861+0000 7fae63ce6700 1 -- start start 2023-09-30T22:21:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.861+0000 7fae63ce6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c138040 0x7fae5c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.861+0000 7fae63ce6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c0a1400 0x7fae5c13fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.861+0000 7fae63ce6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5c1379e0 con 0x7fae5c0a08e0 2023-09-30T22:21:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.861+0000 7fae63ce6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0a2100 con 0x7fae5c0a1400 2023-09-30T22:21:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.861+0000 7fae63ce6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c138950 con 0x7fae5c138040 2023-09-30T22:21:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae61a82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c138040 0x7fae5c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae61281700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fae5c0a08e0 0x7fae5c0a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57216/0 (socket says 172.21.15.154:57216) 2023-09-30T22:21:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae61a82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c138040 0x7fae5c138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59758/0 (socket says 172.21.15.154:59758) 2023-09-30T22:21:51.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae61281700 1 -- 172.21.15.154:0/2491533469 learned_addr learned my addr 172.21.15.154:0/2491533469 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae62283700 1 --2- 172.21.15.154:0/2491533469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c0a1400 0x7fae5c13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae60a80700 1 -- 172.21.15.154:0/2491533469 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787490053 0 0) 0x7fae5c1379e0 con 0x7fae5c0a08e0 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae60a80700 1 -- 172.21.15.154:0/2491533469 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae480035b0 con 0x7fae5c0a08e0 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae62283700 1 -- 172.21.15.154:0/2491533469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c138040 msgr2=0x7fae5c138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae62283700 1 --2- 172.21.15.154:0/2491533469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c138040 0x7fae5c138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae62283700 1 -- 172.21.15.154:0/2491533469 >> v1:172.21.15.154:6789/0 conn(0x7fae5c0a08e0 legacy=0x7fae5c0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae62283700 1 -- 172.21.15.154:0/2491533469 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c09b9b0 con 0x7fae5c0a1400 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae62283700 1 --2- 172.21.15.154:0/2491533469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c0a1400 0x7fae5c13fd20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae54009df0 tx=0x7fae5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d754a54c8f2c49 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae60a80700 1 -- 172.21.15.154:0/2491533469 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5400e070 con 0x7fae5c0a1400 2023-09-30T22:21:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae60a80700 1 -- 172.21.15.154:0/2491533469 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5400bae0 con 0x7fae5c0a1400 2023-09-30T22:21:51.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.862+0000 7fae60a80700 1 -- 172.21.15.154:0/2491533469 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5400be50 con 0x7fae5c0a1400 2023-09-30T22:21:51.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.863+0000 7fae63ce6700 1 -- 172.21.15.154:0/2491533469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c0a1400 msgr2=0x7fae5c13fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.863+0000 7fae63ce6700 1 --2- 172.21.15.154:0/2491533469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c0a1400 0x7fae5c13fd20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae54009df0 tx=0x7fae5400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.863+0000 7fae63ce6700 1 -- 172.21.15.154:0/2491533469 shutdown_connections 2023-09-30T22:21:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.864+0000 7fae63ce6700 1 --2- 172.21.15.154:0/2491533469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c0a1400 0x7fae5c13fd20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.864+0000 7fae63ce6700 1 --2- 172.21.15.154:0/2491533469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c138040 0x7fae5c138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.864+0000 7fae63ce6700 1 -- 172.21.15.154:0/2491533469 >> 172.21.15.154:0/2491533469 conn(0x7fae5c0a2980 msgr2=0x7fae5c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.865+0000 7fae63ce6700 1 -- 172.21.15.154:0/2491533469 shutdown_connections 2023-09-30T22:21:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.865+0000 7fae63ce6700 1 -- 172.21.15.154:0/2491533469 wait complete. 2023-09-30T22:21:51.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.866+0000 7fae63ce6700 1 Processor -- start 2023-09-30T22:21:51.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:51.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.866+0000 7fae63ce6700 1 -- start start 2023-09-30T22:21:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae63ce6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c0a08e0 0x7fae5c137170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae63ce6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c0a1400 0x7fae5c135a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae63ce6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c138040 0x7fae5c135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae63ce6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c09a2b0 con 0x7fae5c0a1400 2023-09-30T22:21:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae63ce6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c119510 con 0x7fae5c138040 2023-09-30T22:21:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae63ce6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c132300 con 0x7fae5c0a08e0 2023-09-30T22:21:51.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae61a82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c0a08e0 0x7fae5c137170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae61a82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c0a08e0 0x7fae5c137170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59760/0 (socket says 172.21.15.154:59760) 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae62283700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c138040 0x7fae5c135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae61a82700 1 -- 172.21.15.154:0/2249275687 learned_addr learned my addr 172.21.15.154:0/2249275687 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae62283700 1 -- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c0a08e0 msgr2=0x7fae5c137170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae62283700 1 --2- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c0a08e0 0x7fae5c137170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae62283700 1 -- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c0a1400 msgr2=0x7fae5c135a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae62283700 1 --2- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c0a1400 0x7fae5c135a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae62283700 1 -- 172.21.15.154:0/2249275687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54009a70 con 0x7fae5c138040 2023-09-30T22:21:51.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae61a82700 1 --2- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c0a08e0 0x7fae5c137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.867+0000 7fae62283700 1 --2- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c138040 0x7fae5c135fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae54009df0 tx=0x7fae54004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.868+0000 7fae527fc700 1 -- 172.21.15.154:0/2249275687 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54012b10 con 0x7fae5c138040 2023-09-30T22:21:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.868+0000 7fae527fc700 1 -- 172.21.15.154:0/2249275687 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae54012c90 con 0x7fae5c138040 2023-09-30T22:21:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.868+0000 7fae527fc700 1 -- 172.21.15.154:0/2249275687 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54025420 con 0x7fae5c138040 2023-09-30T22:21:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.868+0000 7fae63ce6700 1 -- 172.21.15.154:0/2249275687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c140160 con 0x7fae5c138040 2023-09-30T22:21:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.868+0000 7fae63ce6700 1 -- 172.21.15.154:0/2249275687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c136dc0 con 0x7fae5c138040 2023-09-30T22:21:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.868+0000 7fae527fc700 1 -- 172.21.15.154:0/2249275687 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fae54023070 con 0x7fae5c138040 2023-09-30T22:21:51.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.869+0000 7fae527fc700 1 -- 172.21.15.154:0/2249275687 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fae540405d0 con 0x7fae5c138040 2023-09-30T22:21:51.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.871+0000 7fae63ce6700 1 -- 172.21.15.154:0/2249275687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c04f2a0 con 0x7fae5c138040 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.871+0000 7f384cc4c700 1 Processor -- start 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.872+0000 7f384cc4c700 1 -- start start 2023-09-30T22:21:51.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.872+0000 7f384cc4c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f384809d860 0x7f384809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f384cc4c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3848130eb0 0x7f3848138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f384cc4c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384809aaa0 con 0x7f384809e170 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f384cc4c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384809f870 con 0x7f3848130eb0 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f384cc4c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f384809b360 con 0x7f384809d860 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f3846d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3848130eb0 0x7f3848138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f3846d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3848130eb0 0x7f3848138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40994/0 (socket says 172.21.15.154:40994) 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f3846d9d700 1 -- 172.21.15.154:0/3506391095 learned_addr learned my addr 172.21.15.154:0/3506391095 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f3846d9d700 1 -- 172.21.15.154:0/3506391095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f384809d860 msgr2=0x7f384809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f3846d9d700 1 --2- 172.21.15.154:0/3506391095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f384809d860 0x7f384809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f3846d9d700 1 -- 172.21.15.154:0/3506391095 >> v1:172.21.15.154:6789/0 conn(0x7f384809e170 legacy=0x7f38481307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.873+0000 7f3846d9d700 1 -- 172.21.15.154:0/3506391095 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384809b620 con 0x7f3848130eb0 2023-09-30T22:21:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.874+0000 7f3846d9d700 1 --2- 172.21.15.154:0/3506391095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3848130eb0 0x7f3848138a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f383800bb90 tx=0x7f383800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfc05e0edde312c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.874+0000 7f384559a700 1 -- 172.21.15.154:0/3506391095 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800dd50 con 0x7f3848130eb0 2023-09-30T22:21:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.874+0000 7f384559a700 1 -- 172.21.15.154:0/3506391095 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3838010470 con 0x7f3848130eb0 2023-09-30T22:21:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.874+0000 7f384559a700 1 -- 172.21.15.154:0/3506391095 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838010800 con 0x7f3848130eb0 2023-09-30T22:21:51.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.875+0000 7f384cc4c700 1 -- 172.21.15.154:0/3506391095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3848130eb0 msgr2=0x7f3848138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.875+0000 7f384cc4c700 1 --2- 172.21.15.154:0/3506391095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3848130eb0 0x7f3848138a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f383800bb90 tx=0x7f383800bea0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.875+0000 7f384cc4c700 1 -- 172.21.15.154:0/3506391095 shutdown_connections 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.875+0000 7f384cc4c700 1 --2- 172.21.15.154:0/3506391095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3848130eb0 0x7f3848138a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.875+0000 7f384cc4c700 1 --2- 172.21.15.154:0/3506391095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f384809d860 0x7f384809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.875+0000 7f384cc4c700 1 -- 172.21.15.154:0/3506391095 >> 172.21.15.154:0/3506391095 conn(0x7f3848099c40 msgr2=0x7f38480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.875+0000 7f384cc4c700 1 -- 172.21.15.154:0/3506391095 shutdown_connections 2023-09-30T22:21:51.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.876+0000 7fae527fc700 1 -- 172.21.15.154:0/2249275687 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fae5402a080 con 0x7fae5c138040 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.875+0000 7f384cc4c700 1 -- 172.21.15.154:0/3506391095 wait complete. 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.877+0000 7f384cc4c700 1 Processor -- start 2023-09-30T22:21:51.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.877+0000 7f384cc4c700 1 -- start start 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.877+0000 7f384cc4c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f384809d860 0x7f38481d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.877+0000 7f384cc4c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384809e170 0x7f38481d5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.877+0000 7f384cc4c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3848130eb0 0x7f38481b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.877+0000 7f384cc4c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38481b7c70 con 0x7f384809e170 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.877+0000 7f384cc4c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3848072410 con 0x7f384809d860 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.877+0000 7f384cc4c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38481b8550 con 0x7f3848130eb0 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f384659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f384809d860 0x7f38481d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f384659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f384809d860 0x7f38481d51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49646/0 (socket says 172.21.15.154:49646) 2023-09-30T22:21:51.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f3845d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384809e170 0x7f38481d5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f384659c700 1 -- 172.21.15.154:0/3747768123 learned_addr learned my addr 172.21.15.154:0/3747768123 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f3846d9d700 1 --2- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3848130eb0 0x7f38481b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f3845d9b700 1 -- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3848130eb0 msgr2=0x7f38481b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f3845d9b700 1 --2- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3848130eb0 0x7f38481b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f3845d9b700 1 -- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f384809d860 msgr2=0x7f38481d51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f3845d9b700 1 --2- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f384809d860 0x7f38481d51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f3845d9b700 1 -- 172.21.15.154:0/3747768123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383800b7f0 con 0x7f384809e170 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.878+0000 7f384659c700 1 --2- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f384809d860 0x7f38481d51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.879+0000 7f3845d9b700 1 --2- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384809e170 0x7f38481d5720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f383c000f60 tx=0x7f383c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:51.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.879+0000 7f3836ffd700 1 -- 172.21.15.154:0/3747768123 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c0052d0 con 0x7f384809e170 2023-09-30T22:21:51.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.879+0000 7f3836ffd700 1 -- 172.21.15.154:0/3747768123 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c005430 con 0x7f384809e170 2023-09-30T22:21:51.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.879+0000 7f3836ffd700 1 -- 172.21.15.154:0/3747768123 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c0038c0 con 0x7f384809e170 2023-09-30T22:21:51.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.880+0000 7f384cc4c700 1 -- 172.21.15.154:0/3747768123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38481d4e20 con 0x7f384809e170 2023-09-30T22:21:51.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.880+0000 7f384cc4c700 1 -- 172.21.15.154:0/3747768123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384812f710 con 0x7f384809e170 2023-09-30T22:21:51.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.882+0000 7f384cc4c700 1 -- 172.21.15.154:0/3747768123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384804f2a0 con 0x7f384809e170 2023-09-30T22:21:51.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.882+0000 7f3836ffd700 1 -- 172.21.15.154:0/3747768123 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f383c003a20 con 0x7f384809e170 2023-09-30T22:21:51.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.882+0000 7f3836ffd700 1 -- 172.21.15.154:0/3747768123 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f383c03e9f0 con 0x7f384809e170 2023-09-30T22:21:51.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.890+0000 7f3836ffd700 1 -- 172.21.15.154:0/3747768123 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f383c017020 con 0x7f384809e170 2023-09-30T22:21:51.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.913+0000 7f791b0ab700 1 -- 172.21.15.154:0/2815152899 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7914131b50 con 0x7f791409e870 2023-09-30T22:21:51.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.914+0000 7f79117fa700 1 -- 172.21.15.154:0/2815152899 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f79080045b0 con 0x7f791409e870 2023-09-30T22:21:51.914 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:51.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.916+0000 7f791b0ab700 1 -- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409e870 msgr2=0x7f79141202a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:51.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.916+0000 7f791b0ab700 1 --2- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409e870 0x7f79141202a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7908000c00 tx=0x7f7908004750 comp rx=0 tx=0).stop 2023-09-30T22:21:51.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.917+0000 7f791b0ab700 1 -- 172.21.15.154:0/2815152899 shutdown_connections 2023-09-30T22:21:51.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.917+0000 7f791b0ab700 1 --2- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7914131d70 0x7f7914120d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.917+0000 7f791b0ab700 1 --2- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f791409e870 0x7f79141202a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.917+0000 7f791b0ab700 1 --2- 172.21.15.154:0/2815152899 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f791409f180 0x7f79141207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:51.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.917+0000 7f791b0ab700 1 -- 172.21.15.154:0/2815152899 >> 172.21.15.154:0/2815152899 conn(0x7f79140a4430 msgr2=0x7f791406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:51.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.917+0000 7f791b0ab700 1 -- 172.21.15.154:0/2815152899 shutdown_connections 2023-09-30T22:21:51.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.917+0000 7f791b0ab700 1 -- 172.21.15.154:0/2815152899 wait complete. 2023-09-30T22:21:51.918 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:51.918+0000 7fbad83df240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T22:21:51.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-09-30T22:21:51.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.940+0000 7f3836ffd700 1 -- 172.21.15.154:0/3747768123 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 7) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f383c011ab0 con 0x7f384809e170 2023-09-30T22:21:51.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:51.940+0000 7fae527fc700 1 -- 172.21.15.154:0/2249275687 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mgrmap(e 7) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fae5402e670 con 0x7fae5c138040 2023-09-30T22:21:52.013 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.012+0000 7fba543c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.013 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.012+0000 7fba543c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.013 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.012+0000 7fba543c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.013 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.012+0000 7fba543c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.013 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.012+0000 7fba543c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.013 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.013+0000 7fba573c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.013 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.013+0000 7fba573c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.014 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.013+0000 7fba573c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.014 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.013+0000 7fba573c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.014 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.013+0000 7fba573c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-30T22:21:52.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.024+0000 7fb1b4473700 1 Processor -- start 2023-09-30T22:21:52.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.024+0000 7fb1b4473700 1 -- start start 2023-09-30T22:21:52.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b4473700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138410 0x7fb1ac0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b4473700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1ac13dd10 0x7fb1ac1400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b4473700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac1379e0 con 0x7fb1ac138040 2023-09-30T22:21:52.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b4473700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0a2100 con 0x7fb1ac13dd10 2023-09-30T22:21:52.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b4473700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac09b9b0 con 0x7fb1ac138410 2023-09-30T22:21:52.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b1a0e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138410 0x7fb1ac0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b1a0e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138410 0x7fb1ac0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59874/0 (socket says 172.21.15.154:59874) 2023-09-30T22:21:52.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b1a0e700 1 -- 172.21.15.154:0/462665827 learned_addr learned my addr 172.21.15.154:0/462665827 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:52.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b220f700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb1ac138040 0x7fb1ac0a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57230/0 (socket says 172.21.15.154:57230) 2023-09-30T22:21:52.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.025+0000 7fb1b2a10700 1 --2- 172.21.15.154:0/462665827 >> v2:172.21.15.154:3300/0 conn(0x7fb1ac13dd10 0x7fb1ac1400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.026+0000 7fb1b2a10700 1 -- 172.21.15.154:0/462665827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138410 msgr2=0x7fb1ac0a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:52.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.026+0000 7fb1b2a10700 1 --2- 172.21.15.154:0/462665827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138410 0x7fb1ac0a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.026+0000 7fb1b2a10700 1 -- 172.21.15.154:0/462665827 >> v1:172.21.15.154:6789/0 conn(0x7fb1ac138040 legacy=0x7fb1ac0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.026+0000 7fb1b2a10700 1 -- 172.21.15.154:0/462665827 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac137c10 con 0x7fb1ac13dd10 2023-09-30T22:21:52.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.026+0000 7fb1b1a0e700 1 --2- 172.21.15.154:0/462665827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138410 0x7fb1ac0a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:52.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.026+0000 7fb1b2a10700 1 --2- 172.21.15.154:0/462665827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 0x7fb1ac1400f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009d90 tx=0x7fb1a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d686d0d17fd6fd99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:52.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.026+0000 7fb1b120d700 1 -- 172.21.15.154:0/462665827 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400e070 con 0x7fb1ac13dd10 2023-09-30T22:21:52.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.026+0000 7fb1b120d700 1 -- 172.21.15.154:0/462665827 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a400bb20 con 0x7fb1ac13dd10 2023-09-30T22:21:52.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.026+0000 7fb1b120d700 1 -- 172.21.15.154:0/462665827 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4012430 con 0x7fb1ac13dd10 2023-09-30T22:21:52.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.027+0000 7fb1b4473700 1 -- 172.21.15.154:0/462665827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 msgr2=0x7fb1ac1400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.027+0000 7fb1b4473700 1 --2- 172.21.15.154:0/462665827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 0x7fb1ac1400f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009d90 tx=0x7fb1a400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.027+0000 7fb1b4473700 1 -- 172.21.15.154:0/462665827 shutdown_connections 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.027+0000 7fb1b4473700 1 --2- 172.21.15.154:0/462665827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 0x7fb1ac1400f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.027+0000 7fb1b4473700 1 --2- 172.21.15.154:0/462665827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138410 0x7fb1ac0a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.027+0000 7fb1b4473700 1 -- 172.21.15.154:0/462665827 >> 172.21.15.154:0/462665827 conn(0x7fb1ac0a2980 msgr2=0x7fb1ac0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.027+0000 7fb1b4473700 1 -- 172.21.15.154:0/462665827 shutdown_connections 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.027+0000 7fb1b4473700 1 -- 172.21.15.154:0/462665827 wait complete. 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b4473700 1 Processor -- start 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b4473700 1 -- start start 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b4473700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138040 0x7fb1ac136f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b4473700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac138410 0x7fb1ac1374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b4473700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 0x7fb1ac135740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b4473700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac13c180 con 0x7fb1ac13dd10 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b4473700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac13bf90 con 0x7fb1ac138410 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b4473700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac12fea0 con 0x7fb1ac138040 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b1a0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac138410 0x7fb1ac1374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b1a0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac138410 0x7fb1ac1374a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49740/0 (socket says 172.21.15.154:49740) 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b2a10700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 0x7fb1ac135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.028+0000 7fb1b1a0e700 1 -- 172.21.15.154:0/3554499533 learned_addr learned my addr 172.21.15.154:0/3554499533 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1b2a10700 1 -- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138040 msgr2=0x7fb1ac136f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1b2a10700 1 --2- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138040 0x7fb1ac136f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1b2a10700 1 -- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac138410 msgr2=0x7fb1ac1374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1b2a10700 1 --2- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac138410 0x7fb1ac1374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1b2a10700 1 -- 172.21.15.154:0/3554499533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c009550 con 0x7fb1ac13dd10 2023-09-30T22:21:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1b1a0e700 1 --2- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac138410 0x7fb1ac1374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1b2a10700 1 --2- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 0x7fb1ac135740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4016000 tx=0x7fb1a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1a2ffd700 1 -- 172.21.15.154:0/3554499533 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4012430 con 0x7fb1ac13dd10 2023-09-30T22:21:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1a2ffd700 1 -- 172.21.15.154:0/3554499533 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4020070 con 0x7fb1ac13dd10 2023-09-30T22:21:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1a2ffd700 1 -- 172.21.15.154:0/3554499533 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4004280 con 0x7fb1ac13dd10 2023-09-30T22:21:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1b4473700 1 -- 172.21.15.154:0/3554499533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a4009a70 con 0x7fb1ac13dd10 2023-09-30T22:21:52.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.029+0000 7fb1b4473700 1 -- 172.21.15.154:0/3554499533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac09a240 con 0x7fb1ac13dd10 2023-09-30T22:21:52.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.030+0000 7fb1a2ffd700 1 -- 172.21.15.154:0/3554499533 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 7) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fb1a40043e0 con 0x7fb1ac13dd10 2023-09-30T22:21:52.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.030+0000 7fb1a0ff9700 1 -- 172.21.15.154:0/3554499533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1880052e0 con 0x7fb1ac13dd10 2023-09-30T22:21:52.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.030+0000 7fb1a2ffd700 1 -- 172.21.15.154:0/3554499533 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fb1a4022070 con 0x7fb1ac13dd10 2023-09-30T22:21:52.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.038+0000 7fb1a2ffd700 1 -- 172.21.15.154:0/3554499533 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb1a401b400 con 0x7fb1ac13dd10 2023-09-30T22:21:52.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.080+0000 7fae63ce6700 1 -- 172.21.15.154:0/2249275687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae5c06bce0 con 0x7fae5c138040 2023-09-30T22:21:52.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.080+0000 7fae527fc700 1 -- 172.21.15.154:0/2249275687 <== mon.1 v2:172.21.15.154:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae5403ea60 con 0x7fae5c138040 2023-09-30T22:21:52.080 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:52.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.082+0000 7fae63ce6700 1 -- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c138040 msgr2=0x7fae5c135fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.082+0000 7fae63ce6700 1 --2- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c138040 0x7fae5c135fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae54009df0 tx=0x7fae54004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.082+0000 7fae63ce6700 1 -- 172.21.15.154:0/2249275687 shutdown_connections 2023-09-30T22:21:52.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.082+0000 7fae63ce6700 1 --2- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c138040 0x7fae5c135fc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.082+0000 7fae63ce6700 1 --2- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae5c0a08e0 0x7fae5c137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.082+0000 7fae63ce6700 1 --2- 172.21.15.154:0/2249275687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c0a1400 0x7fae5c135a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.082+0000 7fae63ce6700 1 -- 172.21.15.154:0/2249275687 >> 172.21.15.154:0/2249275687 conn(0x7fae5c0a2980 msgr2=0x7fae5c070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.082+0000 7fae63ce6700 1 -- 172.21.15.154:0/2249275687 shutdown_connections 2023-09-30T22:21:52.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.082+0000 7fae63ce6700 1 -- 172.21.15.154:0/2249275687 wait complete. 2023-09-30T22:21:52.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-09-30T22:21:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.103+0000 7f384cc4c700 1 -- 172.21.15.154:0/3747768123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f38481b8690 con 0x7f384809e170 2023-09-30T22:21:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.104+0000 7f3836ffd700 1 -- 172.21.15.154:0/3747768123 <== mon.0 v2:172.21.15.154:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38481b8690 con 0x7f384809e170 2023-09-30T22:21:52.104 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:52.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.106+0000 7f384cc4c700 1 -- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384809e170 msgr2=0x7f38481d5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.106+0000 7f384cc4c700 1 --2- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384809e170 0x7f38481d5720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f383c000f60 tx=0x7f383c00c730 comp rx=0 tx=0).stop 2023-09-30T22:21:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.106+0000 7f384cc4c700 1 -- 172.21.15.154:0/3747768123 shutdown_connections 2023-09-30T22:21:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.106+0000 7f384cc4c700 1 --2- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3848130eb0 0x7f38481b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.106+0000 7f384cc4c700 1 --2- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f384809d860 0x7f38481d51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.106+0000 7f384cc4c700 1 --2- 172.21.15.154:0/3747768123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384809e170 0x7f38481d5720 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.106+0000 7f384cc4c700 1 -- 172.21.15.154:0/3747768123 >> 172.21.15.154:0/3747768123 conn(0x7f3848099c40 msgr2=0x7f38480a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.106+0000 7f384cc4c700 1 -- 172.21.15.154:0/3747768123 shutdown_connections 2023-09-30T22:21:52.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.106+0000 7f384cc4c700 1 -- 172.21.15.154:0/3747768123 wait complete. 2023-09-30T22:21:52.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-09-30T22:21:52.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.207+0000 7fb1a0ff9700 1 -- 172.21.15.154:0/3554499533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb188005590 con 0x7fb1ac13dd10 2023-09-30T22:21:52.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.207+0000 7fb1a2ffd700 1 -- 172.21.15.154:0/3554499533 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1a402c070 con 0x7fb1ac13dd10 2023-09-30T22:21:52.207 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.209+0000 7fb1a0ff9700 1 -- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 msgr2=0x7fb1ac135740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.209+0000 7fb1a0ff9700 1 --2- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 0x7fb1ac135740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4016000 tx=0x7fb1a4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.209+0000 7fb1a0ff9700 1 -- 172.21.15.154:0/3554499533 shutdown_connections 2023-09-30T22:21:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.209+0000 7fb1a0ff9700 1 --2- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac13dd10 0x7fb1ac135740 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.209+0000 7fb1a0ff9700 1 --2- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1ac138040 0x7fb1ac136f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.209+0000 7fb1a0ff9700 1 --2- 172.21.15.154:0/3554499533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac138410 0x7fb1ac1374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.209+0000 7fb1a0ff9700 1 -- 172.21.15.154:0/3554499533 >> 172.21.15.154:0/3554499533 conn(0x7fb1ac0a2980 msgr2=0x7fb1ac140c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:52.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.209+0000 7fb1a0ff9700 1 -- 172.21.15.154:0/3554499533 shutdown_connections 2023-09-30T22:21:52.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:52.209+0000 7fb1a0ff9700 1 -- 172.21.15.154:0/3554499533 wait complete. 2023-09-30T22:21:52.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-09-30T22:21:52.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:52.948 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.947+0000 7fba998a1700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-09-30T22:21:52.951 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.951+0000 7fba998a1700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T22:21:52.952 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-09-30T22:21:52.952+0000 7fba998a1700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T22:21:53.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe9d3c700 1 Processor -- start 2023-09-30T22:21:53.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe9d3c700 1 -- start start 2023-09-30T22:21:53.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe9d3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe409d860 0x7fbfe409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe9d3c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbfe409e170 0x7fbfe41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe9d3c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe409aaa0 con 0x7fbfe4130ce0 2023-09-30T22:21:53.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe9d3c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe409f870 con 0x7fbfe409e170 2023-09-30T22:21:53.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe9d3c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe409b360 con 0x7fbfe409d860 2023-09-30T22:21:53.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe409d860 0x7fbfe409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbfe409e170 0x7fbfe41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe3fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbfe4130ce0 0x7fbfe41379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57246/0 (socket says 172.21.15.154:57246) 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe3fff700 1 -- 172.21.15.154:0/2094289484 learned_addr learned my addr 172.21.15.154:0/2094289484 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe2ffd700 1 -- 172.21.15.154:0/2094289484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe409d860 msgr2=0x7fbfe409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe2ffd700 1 --2- 172.21.15.154:0/2094289484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe409d860 0x7fbfe409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe2ffd700 1 -- 172.21.15.154:0/2094289484 >> v1:172.21.15.154:6789/0 conn(0x7fbfe4130ce0 legacy=0x7fbfe41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe2ffd700 1 -- 172.21.15.154:0/2094289484 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe409b620 con 0x7fbfe409e170 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.068+0000 7fbfe27fc700 1 -- 172.21.15.154:0/2094289484 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516119912 0 0) 0x7fbfe409aaa0 con 0x7fbfe4130ce0 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe2ffd700 1 --2- 172.21.15.154:0/2094289484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 0x7fbfe41307a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009840 tx=0x7fbfcc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e42cff4afc2aed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe27fc700 1 -- 172.21.15.154:0/2094289484 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc011830 con 0x7fbfe409e170 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe27fc700 1 -- 172.21.15.154:0/2094289484 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc011990 con 0x7fbfe409e170 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe27fc700 1 -- 172.21.15.154:0/2094289484 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc011d20 con 0x7fbfe409e170 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/2094289484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 msgr2=0x7fbfe41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe9d3c700 1 --2- 172.21.15.154:0/2094289484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 0x7fbfe41307a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009840 tx=0x7fbfcc009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:53.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/2094289484 shutdown_connections 2023-09-30T22:21:53.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe9d3c700 1 --2- 172.21.15.154:0/2094289484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe409d860 0x7fbfe409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe9d3c700 1 --2- 172.21.15.154:0/2094289484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 0x7fbfe41307a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/2094289484 >> 172.21.15.154:0/2094289484 conn(0x7fbfe4099c40 msgr2=0x7fbfe40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/2094289484 shutdown_connections 2023-09-30T22:21:53.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.069+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/2094289484 wait complete. 2023-09-30T22:21:53.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.070+0000 7fbfe9d3c700 1 Processor -- start 2023-09-30T22:21:53.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe9d3c700 1 -- start start 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe9d3c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfe409d860 0x7fbfe41c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe9d3c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 0x7fbfe41c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe9d3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe4130ce0 0x7fbfe41c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe9d3c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4070730 con 0x7fbfe409e170 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe9d3c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4070540 con 0x7fbfe409d860 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe9d3c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4125160 con 0x7fbfe4130ce0 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfe409d860 0x7fbfe41c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 0x7fbfe41c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe4130ce0 0x7fbfe41c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfe409d860 0x7fbfe41c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49756/0 (socket says 172.21.15.154:49756) 2023-09-30T22:21:53.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 0x7fbfe41c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41150/0 (socket says 172.21.15.154:41150) 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe37fe700 1 -- 172.21.15.154:0/82146901 learned_addr learned my addr 172.21.15.154:0/82146901 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe3fff700 1 -- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfe409d860 msgr2=0x7fbfe41c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe3fff700 1 --2- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfe409d860 0x7fbfe41c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe3fff700 1 -- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 msgr2=0x7fbfe41c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe3fff700 1 --2- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 0x7fbfe41c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe3fff700 1 -- 172.21.15.154:0/82146901 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc0094a0 con 0x7fbfe4130ce0 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.071+0000 7fbfe2ffd700 1 --2- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 0x7fbfe41c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.072+0000 7fbfe3fff700 1 --2- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe4130ce0 0x7fbfe41c8ae0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00cc10 tx=0x7fbfdc00cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.072+0000 7fbfdbfff700 1 -- 172.21.15.154:0/82146901 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00aa00 con 0x7fbfe4130ce0 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.072+0000 7fbfdbfff700 1 -- 172.21.15.154:0/82146901 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc00ab80 con 0x7fbfe4130ce0 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.072+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe409c8b0 con 0x7fbfe4130ce0 2023-09-30T22:21:53.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.072+0000 7fbfdbfff700 1 -- 172.21.15.154:0/82146901 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0070d0 con 0x7fbfe4130ce0 2023-09-30T22:21:53.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.072+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe4130720 con 0x7fbfe4130ce0 2023-09-30T22:21:53.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.073+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe4125e90 con 0x7fbfe4130ce0 2023-09-30T22:21:53.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.073+0000 7fbfdbfff700 1 -- 172.21.15.154:0/82146901 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fbfdc007230 con 0x7fbfe4130ce0 2023-09-30T22:21:53.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.073+0000 7fbfdbfff700 1 -- 172.21.15.154:0/82146901 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7fbfdc03f700 con 0x7fbfe4130ce0 2023-09-30T22:21:53.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.078+0000 7fbfdbfff700 1 -- 172.21.15.154:0/82146901 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfdc0074e0 con 0x7fbfe4130ce0 2023-09-30T22:21:53.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:53.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:53.221 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.223+0000 7f25c8013700 1 Processor -- start 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.223+0000 7f25c8013700 1 -- start start 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.224+0000 7f25c8013700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25c0131980 0x7f25c0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.224+0000 7f25c8013700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009bc70 0x7f25c009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.224+0000 7f25c8013700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c00a1640 con 0x7f25c009c5c0 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.224+0000 7f25c8013700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c006eb30 con 0x7f25c0131980 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.224+0000 7f25c8013700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00a22d0 con 0x7f25c009bc70 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.224+0000 7f25c65b0700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f25c009c5c0 0x7f25c0138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57258/0 (socket says 172.21.15.154:57258) 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.224+0000 7f25c65b0700 1 -- 172.21.15.154:0/1838543771 learned_addr learned my addr 172.21.15.154:0/1838543771 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.224+0000 7f25c55ae700 1 --2- 172.21.15.154:0/1838543771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009bc70 0x7f25c009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.224+0000 7f25c5daf700 1 --2- 172.21.15.154:0/1838543771 >> v2:172.21.15.154:3300/0 conn(0x7f25c0131980 0x7f25c0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.225+0000 7f25c55ae700 1 -- 172.21.15.154:0/1838543771 >> v2:172.21.15.154:3300/0 conn(0x7f25c0131980 msgr2=0x7f25c0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.225+0000 7f25c55ae700 1 --2- 172.21.15.154:0/1838543771 >> v2:172.21.15.154:3300/0 conn(0x7f25c0131980 0x7f25c0131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.225+0000 7f25c55ae700 1 -- 172.21.15.154:0/1838543771 >> v1:172.21.15.154:6789/0 conn(0x7f25c009c5c0 legacy=0x7f25c0138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.225+0000 7f25c55ae700 1 -- 172.21.15.154:0/1838543771 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0131550 con 0x7f25c009bc70 2023-09-30T22:21:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.225+0000 7f25c55ae700 1 --2- 172.21.15.154:0/1838543771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009bc70 0x7f25c009c080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009840 tx=0x7f25b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16e4328ee3d62378 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.225+0000 7f25c4dad700 1 -- 172.21.15.154:0/1838543771 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4004230 con 0x7f25c009bc70 2023-09-30T22:21:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.225+0000 7f25c4dad700 1 -- 172.21.15.154:0/1838543771 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4004390 con 0x7f25c009bc70 2023-09-30T22:21:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.225+0000 7f25c4dad700 1 -- 172.21.15.154:0/1838543771 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b40036a0 con 0x7f25c009bc70 2023-09-30T22:21:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.226+0000 7f25c8013700 1 -- 172.21.15.154:0/1838543771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009bc70 msgr2=0x7f25c009c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.226+0000 7f25c8013700 1 --2- 172.21.15.154:0/1838543771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009bc70 0x7f25c009c080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009840 tx=0x7f25b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.226+0000 7f25c8013700 1 -- 172.21.15.154:0/1838543771 shutdown_connections 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.226+0000 7f25c8013700 1 --2- 172.21.15.154:0/1838543771 >> v2:172.21.15.154:3300/0 conn(0x7f25c0131980 0x7f25c0131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.226+0000 7f25c8013700 1 --2- 172.21.15.154:0/1838543771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009bc70 0x7f25c009c080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.226+0000 7f25c8013700 1 -- 172.21.15.154:0/1838543771 >> 172.21.15.154:0/1838543771 conn(0x7f25c00a2980 msgr2=0x7f25c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.226+0000 7f25c8013700 1 -- 172.21.15.154:0/1838543771 shutdown_connections 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.226+0000 7f25c8013700 1 -- 172.21.15.154:0/1838543771 wait complete. 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.227+0000 7f25c8013700 1 Processor -- start 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.227+0000 7f25c8013700 1 -- start start 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.227+0000 7f25c8013700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25c009bc70 0x7f25c0118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c8013700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009c5c0 0x7f25c0119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c8013700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0131980 0x7f25c0119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c8013700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c011aba0 con 0x7f25c0131980 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c8013700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0130cd0 con 0x7f25c009bc70 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c8013700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c011bcb0 con 0x7f25c009c5c0 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c55ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009c5c0 0x7f25c0119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c55ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009c5c0 0x7f25c0119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59920/0 (socket says 172.21.15.154:59920) 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c55ae700 1 -- 172.21.15.154:0/1981041764 learned_addr learned my addr 172.21.15.154:0/1981041764 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c65b0700 1 --2- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0131980 0x7f25c0119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c5daf700 1 --2- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25c009bc70 0x7f25c0118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c55ae700 1 -- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25c009bc70 msgr2=0x7f25c0118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c55ae700 1 --2- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25c009bc70 0x7f25c0118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c55ae700 1 -- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0131980 msgr2=0x7f25c0119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c55ae700 1 --2- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0131980 0x7f25c0119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c55ae700 1 -- 172.21.15.154:0/1981041764 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40094a0 con 0x7f25c009c5c0 2023-09-30T22:21:53.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25c55ae700 1 --2- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009c5c0 0x7f25c0119330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25b40090b0 tx=0x7f25b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.228+0000 7f25b27fc700 1 -- 172.21.15.154:0/1981041764 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4003d80 con 0x7f25c009c5c0 2023-09-30T22:21:53.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.229+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c00a1c40 con 0x7f25c009c5c0 2023-09-30T22:21:53.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.229+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c011b080 con 0x7f25c009c5c0 2023-09-30T22:21:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.229+0000 7f25b27fc700 1 -- 172.21.15.154:0/1981041764 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b401f070 con 0x7f25c009c5c0 2023-09-30T22:21:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.229+0000 7f25b27fc700 1 -- 172.21.15.154:0/1981041764 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011830 con 0x7f25c009c5c0 2023-09-30T22:21:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.230+0000 7f25b27fc700 1 -- 172.21.15.154:0/1981041764 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f25b4021030 con 0x7f25c009c5c0 2023-09-30T22:21:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.230+0000 7f25b27fc700 1 -- 172.21.15.154:0/1981041764 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f25b4040c00 con 0x7f25c009c5c0 2023-09-30T22:21:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.230+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a80052e0 con 0x7f25c009c5c0 2023-09-30T22:21:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.235+0000 7f25b27fc700 1 -- 172.21.15.154:0/1981041764 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25b401a460 con 0x7f25c009c5c0 2023-09-30T22:21:53.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.277+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbfe404f2a0 con 0x7fbfe4130ce0 2023-09-30T22:21:53.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.277+0000 7fbfdbfff700 1 -- 172.21.15.154:0/82146901 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbfdc018030 con 0x7fbfe4130ce0 2023-09-30T22:21:53.277 INFO:teuthology.orchestra.run.smithi154.stdout:38654705693 2023-09-30T22:21:53.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 >> v1:172.21.15.154:6816/126757 conn(0x7fbfc402f240 legacy=0x7fbfc40316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe4130ce0 msgr2=0x7fbfe41c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 --2- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe4130ce0 0x7fbfe41c8ae0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00cc10 tx=0x7fbfdc00cf20 comp rx=0 tx=0).stop 2023-09-30T22:21:53.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 shutdown_connections 2023-09-30T22:21:53.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 --2- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfe4130ce0 0x7fbfe41c8ae0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 --2- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfe409d860 0x7fbfe41c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 --2- 172.21.15.154:0/82146901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfe409e170 0x7fbfe41c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 >> 172.21.15.154:0/82146901 conn(0x7fbfe4099c40 msgr2=0x7fbfe406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 shutdown_connections 2023-09-30T22:21:53.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.281+0000 7fbfe9d3c700 1 -- 172.21.15.154:0/82146901 wait complete. 2023-09-30T22:21:53.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.286+0000 7f7e92285700 1 Processor -- start 2023-09-30T22:21:53.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.286+0000 7f7e92285700 1 -- start start 2023-09-30T22:21:53.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.287+0000 7f7e92285700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.287+0000 7f7e92285700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 0x7f7e8c139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.287+0000 7f7e92285700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8c06e900 con 0x7f7e8c09dec0 2023-09-30T22:21:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.287+0000 7f7e92285700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c09d180 con 0x7f7e8c06a770 2023-09-30T22:21:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.287+0000 7f7e92285700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c09e780 con 0x7f7e8c136cb0 2023-09-30T22:21:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.287+0000 7f7e8bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.287+0000 7f7e8bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49788/0 (socket says 172.21.15.154:49788) 2023-09-30T22:21:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.287+0000 7f7e8bfff700 1 -- 172.21.15.154:0/2291377626 learned_addr learned my addr 172.21.15.154:0/2291377626 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:53.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.287+0000 7f7e8b7fe700 1 --1- 172.21.15.154:0/2291377626 >> v1:172.21.15.154:6789/0 conn(0x7f7e8c09dec0 0x7f7e8c06b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57270/0 (socket says 172.21.15.154:57270) 2023-09-30T22:21:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.288+0000 7f7e90822700 1 --2- 172.21.15.154:0/2291377626 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 0x7f7e8c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.288+0000 7f7e8bfff700 1 -- 172.21.15.154:0/2291377626 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 msgr2=0x7f7e8c139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.288+0000 7f7e8bfff700 1 --2- 172.21.15.154:0/2291377626 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 0x7f7e8c139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.288+0000 7f7e8bfff700 1 -- 172.21.15.154:0/2291377626 >> v1:172.21.15.154:6789/0 conn(0x7f7e8c09dec0 legacy=0x7f7e8c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.288+0000 7f7e8bfff700 1 -- 172.21.15.154:0/2291377626 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c09d3c0 con 0x7f7e8c06a770 2023-09-30T22:21:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.288+0000 7f7e8bfff700 1 --2- 172.21.15.154:0/2291377626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c06ab40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009920 tx=0x7f7e7c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33485eed5b7fb10e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.288+0000 7f7e8affd700 1 -- 172.21.15.154:0/2291377626 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c00ba60 con 0x7f7e8c06a770 2023-09-30T22:21:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.288+0000 7f7e8affd700 1 -- 172.21.15.154:0/2291377626 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c00bbc0 con 0x7f7e8c06a770 2023-09-30T22:21:53.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.288+0000 7f7e8affd700 1 -- 172.21.15.154:0/2291377626 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c009e70 con 0x7f7e8c06a770 2023-09-30T22:21:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.289+0000 7f7e92285700 1 -- 172.21.15.154:0/2291377626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 msgr2=0x7f7e8c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.289+0000 7f7e92285700 1 --2- 172.21.15.154:0/2291377626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c06ab40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009920 tx=0x7f7e7c009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.289+0000 7f7e92285700 1 -- 172.21.15.154:0/2291377626 shutdown_connections 2023-09-30T22:21:53.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.289+0000 7f7e92285700 1 --2- 172.21.15.154:0/2291377626 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 0x7f7e8c139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.289+0000 7f7e92285700 1 --2- 172.21.15.154:0/2291377626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c06ab40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.289+0000 7f7e92285700 1 -- 172.21.15.154:0/2291377626 >> 172.21.15.154:0/2291377626 conn(0x7f7e8c099c40 msgr2=0x7f7e8c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.289+0000 7f7e92285700 1 -- 172.21.15.154:0/2291377626 shutdown_connections 2023-09-30T22:21:53.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.289+0000 7f7e92285700 1 -- 172.21.15.154:0/2291377626 wait complete. 2023-09-30T22:21:53.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.290+0000 7f7e92285700 1 Processor -- start 2023-09-30T22:21:53.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e92285700 1 -- start start 2023-09-30T22:21:53.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e92285700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e92285700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8c09dec0 0x7f7e8c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e92285700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 0x7f7e8c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e92285700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c09b8d0 con 0x7f7e8c09dec0 2023-09-30T22:21:53.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e92285700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c135ec0 con 0x7f7e8c06a770 2023-09-30T22:21:53.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e92285700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c131230 con 0x7f7e8c136cb0 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e8b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8c09dec0 0x7f7e8c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e8b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8c09dec0 0x7f7e8c09a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41168/0 (socket says 172.21.15.154:41168) 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e8b7fe700 1 -- 172.21.15.154:0/3883009334 learned_addr learned my addr 172.21.15.154:0/3883009334 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e8bfff700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.291+0000 7f7e90822700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 0x7f7e8c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e8b7fe700 1 -- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 msgr2=0x7f7e8c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e8b7fe700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 0x7f7e8c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e8b7fe700 1 -- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 msgr2=0x7f7e8c09a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e8b7fe700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c09a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e8b7fe700 1 -- 172.21.15.154:0/3883009334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c009550 con 0x7f7e8c09dec0 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e8bfff700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c09a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e8b7fe700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8c09dec0 0x7f7e8c09a9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000c550 tx=0x7f7e8000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e88ff9700 1 -- 172.21.15.154:0/3883009334 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80005cb0 con 0x7f7e8c09dec0 2023-09-30T22:21:53.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e88ff9700 1 -- 172.21.15.154:0/3883009334 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80005e10 con 0x7f7e8c09dec0 2023-09-30T22:21:53.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c135810 con 0x7f7e8c09dec0 2023-09-30T22:21:53.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e88ff9700 1 -- 172.21.15.154:0/3883009334 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800072d0 con 0x7f7e8c09dec0 2023-09-30T22:21:53.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.292+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c136540 con 0x7f7e8c09dec0 2023-09-30T22:21:53.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.293+0000 7f7e88ff9700 1 -- 172.21.15.154:0/3883009334 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f7e80007430 con 0x7f7e8c09dec0 2023-09-30T22:21:53.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.293+0000 7f7e88ff9700 1 -- 172.21.15.154:0/3883009334 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f7e8003ea50 con 0x7f7e8c09dec0 2023-09-30T22:21:53.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.293+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8c071d30 con 0x7f7e8c09dec0 2023-09-30T22:21:53.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.299+0000 7f7e88ff9700 1 -- 172.21.15.154:0/3883009334 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e80017080 con 0x7f7e8c09dec0 2023-09-30T22:21:53.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-09-30T22:21:53.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.359+0000 7f5095b55700 1 Processor -- start 2023-09-30T22:21:53.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.359+0000 7f5095b55700 1 -- start start 2023-09-30T22:21:53.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.359+0000 7f5095b55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f509006a770 0x7f509006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f5095b55700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f50901317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f5095b55700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509009da80 con 0x7f5090131cf0 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f5095b55700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509009dce0 con 0x7f509006b080 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f5095b55700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f509009eb20 con 0x7f509006a770 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5090131cf0 0x7f5090138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57272/0 (socket says 172.21.15.154:57272) 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f50901317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508ffff700 1 -- 172.21.15.154:0/2782136531 learned_addr learned my addr 172.21.15.154:0/2782136531 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508f7fe700 1 --2- 172.21.15.154:0/2782136531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f509006a770 0x7f509006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508e7fc700 1 -- 172.21.15.154:0/2782136531 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468871960 0 0) 0x7f509009da80 con 0x7f5090131cf0 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508e7fc700 1 -- 172.21.15.154:0/2782136531 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50780035b0 con 0x7f5090131cf0 2023-09-30T22:21:53.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508effd700 1 -- 172.21.15.154:0/2782136531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f509006a770 msgr2=0x7f509006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:53.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508effd700 1 --2- 172.21.15.154:0/2782136531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f509006a770 0x7f509006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508effd700 1 -- 172.21.15.154:0/2782136531 >> v1:172.21.15.154:6789/0 conn(0x7f5090131cf0 legacy=0x7f5090138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508effd700 1 -- 172.21.15.154:0/2782136531 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509009d860 con 0x7f509006b080 2023-09-30T22:21:53.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.360+0000 7f508effd700 1 --2- 172.21.15.154:0/2782136531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f50901317b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50840098a0 tx=0x7f5084009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7414f862c92c34ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f508e7fc700 1 -- 172.21.15.154:0/2782136531 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084011830 con 0x7f509006b080 2023-09-30T22:21:53.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f508e7fc700 1 -- 172.21.15.154:0/2782136531 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084011990 con 0x7f509006b080 2023-09-30T22:21:53.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f508e7fc700 1 -- 172.21.15.154:0/2782136531 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084011d20 con 0x7f509006b080 2023-09-30T22:21:53.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f5095b55700 1 -- 172.21.15.154:0/2782136531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 msgr2=0x7f50901317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f5095b55700 1 --2- 172.21.15.154:0/2782136531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f50901317b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50840098a0 tx=0x7f5084009bb0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f5095b55700 1 -- 172.21.15.154:0/2782136531 shutdown_connections 2023-09-30T22:21:53.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f5095b55700 1 --2- 172.21.15.154:0/2782136531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f509006a770 0x7f509006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f5095b55700 1 --2- 172.21.15.154:0/2782136531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f50901317b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f5095b55700 1 -- 172.21.15.154:0/2782136531 >> 172.21.15.154:0/2782136531 conn(0x7f5090099c40 msgr2=0x7f50900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f5095b55700 1 -- 172.21.15.154:0/2782136531 shutdown_connections 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.361+0000 7f5095b55700 1 -- 172.21.15.154:0/2782136531 wait complete. 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.362+0000 7f5095b55700 1 Processor -- start 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.362+0000 7f5095b55700 1 -- start start 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f5095b55700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f509006a770 0x7f509011d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f5095b55700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f509011d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f5095b55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5090131cf0 0x7f50901c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f5095b55700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5090120320 con 0x7f509006a770 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f5095b55700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5090120500 con 0x7f509006b080 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f5095b55700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5090131370 con 0x7f5090131cf0 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f509011d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f509011d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49812/0 (socket says 172.21.15.154:49812) 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508effd700 1 -- 172.21.15.154:0/3404123451 learned_addr learned my addr 172.21.15.154:0/3404123451 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508f7fe700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f509006a770 0x7f509011d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508ffff700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5090131cf0 0x7f50901c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508effd700 1 -- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5090131cf0 msgr2=0x7f50901c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508effd700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5090131cf0 0x7f50901c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508effd700 1 -- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f509006a770 msgr2=0x7f509011d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508effd700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f509006a770 0x7f509011d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508effd700 1 -- 172.21.15.154:0/3404123451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840094a0 con 0x7f509006b080 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508f7fe700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f509006a770 0x7f509011d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.363+0000 7f508effd700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f509011d980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5084009bf0 tx=0x7f5084004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.364+0000 7f5077fff700 1 -- 172.21.15.154:0/3404123451 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084004240 con 0x7f509006b080 2023-09-30T22:21:53.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.364+0000 7f5077fff700 1 -- 172.21.15.154:0/3404123451 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508401f070 con 0x7f509006b080 2023-09-30T22:21:53.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.364+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509011dec0 con 0x7f509006b080 2023-09-30T22:21:53.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.364+0000 7f5077fff700 1 -- 172.21.15.154:0/3404123451 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50840045e0 con 0x7f509006b080 2023-09-30T22:21:53.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.364+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50900a2ea0 con 0x7f509006b080 2023-09-30T22:21:53.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.364+0000 7f5077fff700 1 -- 172.21.15.154:0/3404123451 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f5084021030 con 0x7f509006b080 2023-09-30T22:21:53.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.365+0000 7f5077fff700 1 -- 172.21.15.154:0/3404123451 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f5084040830 con 0x7f509006b080 2023-09-30T22:21:53.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.365+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509004f2a0 con 0x7f509006b080 2023-09-30T22:21:53.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.370+0000 7f5077fff700 1 -- 172.21.15.154:0/3404123451 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5084015080 con 0x7f509006b080 2023-09-30T22:21:53.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.454+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25a8005590 con 0x7f25c009c5c0 2023-09-30T22:21:53.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.455+0000 7f25b27fc700 1 -- 172.21.15.154:0/1981041764 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25b4019b60 con 0x7f25c009c5c0 2023-09-30T22:21:53.455 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:53.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.456+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 >> v1:172.21.15.154:6816/126757 conn(0x7f25a402f240 legacy=0x7f25a40316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.457+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009c5c0 msgr2=0x7f25c0119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.457+0000 7f25c8013700 1 --2- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009c5c0 0x7f25c0119330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25b40090b0 tx=0x7f25b4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:53.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.457+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 shutdown_connections 2023-09-30T22:21:53.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.457+0000 7f25c8013700 1 --2- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0131980 0x7f25c0119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.457+0000 7f25c8013700 1 --2- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25c009bc70 0x7f25c0118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.457+0000 7f25c8013700 1 --2- 172.21.15.154:0/1981041764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25c009c5c0 0x7f25c0119330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.457+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 >> 172.21.15.154:0/1981041764 conn(0x7f25c00a2980 msgr2=0x7f25c012d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.457+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 shutdown_connections 2023-09-30T22:21:53.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.457+0000 7f25c8013700 1 -- 172.21.15.154:0/1981041764 wait complete. 2023-09-30T22:21:53.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-09-30T22:21:53.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.496+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e8c04f2a0 con 0x7f7e8c09dec0 2023-09-30T22:21:53.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.496+0000 7f7e88ff9700 1 -- 172.21.15.154:0/3883009334 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e8001b3b0 con 0x7f7e8c09dec0 2023-09-30T22:21:53.496 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:53.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 >> v1:172.21.15.154:6816/126757 conn(0x7f7e7802f240 legacy=0x7f7e780316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8c09dec0 msgr2=0x7f7e8c09a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8c09dec0 0x7f7e8c09a9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000c550 tx=0x7f7e8000c860 comp rx=0 tx=0).stop 2023-09-30T22:21:53.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 shutdown_connections 2023-09-30T22:21:53.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e8c136cb0 0x7f7e8c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e8c06a770 0x7f7e8c09a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 --2- 172.21.15.154:0/3883009334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e8c09dec0 0x7f7e8c09a9d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 >> 172.21.15.154:0/3883009334 conn(0x7f7e8c099c40 msgr2=0x7f7e8c12f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 shutdown_connections 2023-09-30T22:21:53.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.498+0000 7f7e92285700 1 -- 172.21.15.154:0/3883009334 wait complete. 2023-09-30T22:21:53.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-09-30T22:21:53.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.563+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f509006c3b0 con 0x7f509006b080 2023-09-30T22:21:53.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.564+0000 7f5077fff700 1 -- 172.21.15.154:0/3404123451 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50840197f0 con 0x7f509006b080 2023-09-30T22:21:53.564 INFO:teuthology.orchestra.run.smithi154.stdout:38654705692 2023-09-30T22:21:53.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 >> v1:172.21.15.154:6816/126757 conn(0x7f507c02f240 legacy=0x7f507c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 msgr2=0x7f509011d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:53.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f509011d980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5084009bf0 tx=0x7f5084004750 comp rx=0 tx=0).stop 2023-09-30T22:21:53.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 shutdown_connections 2023-09-30T22:21:53.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5090131cf0 0x7f50901c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f509006a770 0x7f509011d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 --2- 172.21.15.154:0/3404123451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f509006b080 0x7f509011d980 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:53.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 >> 172.21.15.154:0/3404123451 conn(0x7f5090099c40 msgr2=0x7f50901b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:53.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 shutdown_connections 2023-09-30T22:21:53.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:53.566+0000 7f5095b55700 1 -- 172.21.15.154:0/3404123451 wait complete. 2023-09-30T22:21:53.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2023-09-30T22:21:54.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:21:54.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf89c8700 1 Processor -- start 2023-09-30T22:21:54.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf89c8700 1 -- start start 2023-09-30T22:21:54.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf89c8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf4130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf89c8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf41307c0 0x7fbcf40993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf89c8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbcf4099920 0x7fbcf4099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf89c8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf409a540 con 0x7fbcf4099920 2023-09-30T22:21:54.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf89c8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf409ad40 con 0x7fbcf41307c0 2023-09-30T22:21:54.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf89c8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf409e640 con 0x7fbcf412feb0 2023-09-30T22:21:54.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf4130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf41307c0 0x7fbcf40993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf4130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59976/0 (socket says 172.21.15.154:59976) 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf259c700 1 -- 172.21.15.154:0/1200880900 learned_addr learned my addr 172.21.15.154:0/1200880900 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.429+0000 7fbcf2d9d700 1 --2- 172.21.15.154:0/1200880900 >> v2:172.21.15.154:3300/0 conn(0x7fbcf4099920 0x7fbcf4099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.430+0000 7fbcf259c700 1 -- 172.21.15.154:0/1200880900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf41307c0 msgr2=0x7fbcf40993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.430+0000 7fbcf259c700 1 --2- 172.21.15.154:0/1200880900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf41307c0 0x7fbcf40993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.430+0000 7fbcf259c700 1 -- 172.21.15.154:0/1200880900 >> v2:172.21.15.154:3300/0 conn(0x7fbcf4099920 msgr2=0x7fbcf4099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.430+0000 7fbcf259c700 1 --2- 172.21.15.154:0/1200880900 >> v2:172.21.15.154:3300/0 conn(0x7fbcf4099920 0x7fbcf4099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.430+0000 7fbcf259c700 1 -- 172.21.15.154:0/1200880900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf409e3c0 con 0x7fbcf412feb0 2023-09-30T22:21:54.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.430+0000 7fbcf259c700 1 --2- 172.21.15.154:0/1200880900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf4130280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbce4006fd0 tx=0x7fbce4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63abb3efacb74036 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.430+0000 7fbcf159a700 1 -- 172.21.15.154:0/1200880900 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4005e30 con 0x7fbcf412feb0 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.430+0000 7fbcf159a700 1 -- 172.21.15.154:0/1200880900 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce4004030 con 0x7fbcf412feb0 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.430+0000 7fbcf159a700 1 -- 172.21.15.154:0/1200880900 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40043e0 con 0x7fbcf412feb0 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.431+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1200880900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 msgr2=0x7fbcf4130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.431+0000 7fbcf89c8700 1 --2- 172.21.15.154:0/1200880900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf4130280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbce4006fd0 tx=0x7fbce4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.431+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1200880900 shutdown_connections 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.431+0000 7fbcf89c8700 1 --2- 172.21.15.154:0/1200880900 >> v2:172.21.15.154:3300/0 conn(0x7fbcf4099920 0x7fbcf4099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.431+0000 7fbcf89c8700 1 --2- 172.21.15.154:0/1200880900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf4130280 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.431+0000 7fbcf89c8700 1 --2- 172.21.15.154:0/1200880900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf41307c0 0x7fbcf40993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.431+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1200880900 >> 172.21.15.154:0/1200880900 conn(0x7fbcf40a2b30 msgr2=0x7fbcf409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.431+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1200880900 shutdown_connections 2023-09-30T22:21:54.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.431+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1200880900 wait complete. 2023-09-30T22:21:54.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf89c8700 1 Processor -- start 2023-09-30T22:21:54.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf89c8700 1 -- start start 2023-09-30T22:21:54.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf89c8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf4099920 0x7fbcf4129070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf89c8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf41295b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf89c8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf41307c0 0x7fbcf41c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf89c8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf408bd40 con 0x7fbcf41307c0 2023-09-30T22:21:54.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf89c8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4128c20 con 0x7fbcf4099920 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf89c8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf408c900 con 0x7fbcf412feb0 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf4099920 0x7fbcf4129070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf41295b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf4099920 0x7fbcf4129070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49848/0 (socket says 172.21.15.154:49848) 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.432+0000 7fbcf259c700 1 -- 172.21.15.154:0/1302998930 learned_addr learned my addr 172.21.15.154:0/1302998930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf2d9d700 1 --2- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf41307c0 0x7fbcf41c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf259c700 1 -- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 msgr2=0x7fbcf41295b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf259c700 1 --2- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf41295b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf259c700 1 -- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf41307c0 msgr2=0x7fbcf41c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf259c700 1 --2- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf41307c0 0x7fbcf41c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf259c700 1 -- 172.21.15.154:0/1302998930 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4009500 con 0x7fbcf4099920 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf1d9b700 1 --2- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf41295b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf259c700 1 --2- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf4099920 0x7fbcf4129070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbce4000c00 tx=0x7fbce4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbce2ffd700 1 -- 172.21.15.154:0/1302998930 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40043f0 con 0x7fbcf4099920 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbce2ffd700 1 -- 172.21.15.154:0/1302998930 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce401c420 con 0x7fbcf4099920 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf4072470 con 0x7fbcf4099920 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbce2ffd700 1 -- 172.21.15.154:0/1302998930 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce401c7d0 con 0x7fbcf4099920 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.433+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf408b840 con 0x7fbcf4099920 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.434+0000 7fbce2ffd700 1 -- 172.21.15.154:0/1302998930 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fbce401c930 con 0x7fbcf4099920 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.434+0000 7fbce2ffd700 1 -- 172.21.15.154:0/1302998930 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fbce4040160 con 0x7fbcf4099920 2023-09-30T22:21:54.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.434+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf406ad40 con 0x7fbcf4099920 2023-09-30T22:21:54.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.439+0000 7fbce2ffd700 1 -- 172.21.15.154:0/1302998930 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcf406ad40 con 0x7fbcf4099920 2023-09-30T22:21:54.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:21:54.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:21:54.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:21:54.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.606+0000 7f1a51b6a700 1 Processor -- start 2023-09-30T22:21:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.606+0000 7f1a51b6a700 1 -- start start 2023-09-30T22:21:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a51b6a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a4c1350d0 0x7f1a4c13ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a51b6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c13d210 0x7f1a4c13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a51b6a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c09eca0 con 0x7f1a4c06a770 2023-09-30T22:21:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a51b6a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c06b2e0 con 0x7f1a4c1350d0 2023-09-30T22:21:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a51b6a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c09f720 con 0x7f1a4c13d210 2023-09-30T22:21:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a4b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1a4c06a770 0x7f1a4c1349c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57276/0 (socket says 172.21.15.154:57276) 2023-09-30T22:21:54.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a4b7fe700 1 -- 172.21.15.154:0/1750290347 learned_addr learned my addr 172.21.15.154:0/1750290347 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:54.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a4bfff700 1 --2- 172.21.15.154:0/1750290347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c13d210 0x7f1a4c13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a4affd700 1 --2- 172.21.15.154:0/1750290347 >> v2:172.21.15.154:3300/0 conn(0x7f1a4c1350d0 0x7f1a4c13ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a4a7fc700 1 -- 172.21.15.154:0/1750290347 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201369017 0 0) 0x7f1a4c09eca0 con 0x7f1a4c06a770 2023-09-30T22:21:54.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.607+0000 7f1a4a7fc700 1 -- 172.21.15.154:0/1750290347 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a340035b0 con 0x7f1a4c06a770 2023-09-30T22:21:54.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.608+0000 7f1a4bfff700 1 -- 172.21.15.154:0/1750290347 >> v2:172.21.15.154:3300/0 conn(0x7f1a4c1350d0 msgr2=0x7f1a4c13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.608+0000 7f1a4bfff700 1 --2- 172.21.15.154:0/1750290347 >> v2:172.21.15.154:3300/0 conn(0x7f1a4c1350d0 0x7f1a4c13ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.608+0000 7f1a4bfff700 1 -- 172.21.15.154:0/1750290347 >> v1:172.21.15.154:6789/0 conn(0x7f1a4c06a770 legacy=0x7f1a4c1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.608+0000 7f1a4bfff700 1 -- 172.21.15.154:0/1750290347 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c06b480 con 0x7f1a4c13d210 2023-09-30T22:21:54.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.608+0000 7f1a4bfff700 1 --2- 172.21.15.154:0/1750290347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c13d210 0x7f1a4c13f5f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009870 tx=0x7f1a40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a021b6f90a63006c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.613+0000 7f1a4a7fc700 1 -- 172.21.15.154:0/1750290347 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40011830 con 0x7f1a4c13d210 2023-09-30T22:21:54.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.613+0000 7f1a4a7fc700 1 -- 172.21.15.154:0/1750290347 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a40011990 con 0x7f1a4c13d210 2023-09-30T22:21:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.613+0000 7f1a4a7fc700 1 -- 172.21.15.154:0/1750290347 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40011d00 con 0x7f1a4c13d210 2023-09-30T22:21:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.614+0000 7f1a51b6a700 1 -- 172.21.15.154:0/1750290347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c13d210 msgr2=0x7f1a4c13f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.614+0000 7f1a51b6a700 1 --2- 172.21.15.154:0/1750290347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c13d210 0x7f1a4c13f5f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009870 tx=0x7f1a40009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.614+0000 7f1a51b6a700 1 -- 172.21.15.154:0/1750290347 shutdown_connections 2023-09-30T22:21:54.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.614+0000 7f1a51b6a700 1 --2- 172.21.15.154:0/1750290347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c13d210 0x7f1a4c13f5f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.614+0000 7f1a51b6a700 1 --2- 172.21.15.154:0/1750290347 >> v2:172.21.15.154:3300/0 conn(0x7f1a4c1350d0 0x7f1a4c13ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.614+0000 7f1a51b6a700 1 -- 172.21.15.154:0/1750290347 >> 172.21.15.154:0/1750290347 conn(0x7f1a4c099c40 msgr2=0x7f1a4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.615+0000 7f1a51b6a700 1 -- 172.21.15.154:0/1750290347 shutdown_connections 2023-09-30T22:21:54.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.615+0000 7f1a51b6a700 1 -- 172.21.15.154:0/1750290347 wait complete. 2023-09-30T22:21:54.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.617+0000 7f1a51b6a700 1 Processor -- start 2023-09-30T22:21:54.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.617+0000 7f1a51b6a700 1 -- start start 2023-09-30T22:21:54.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a51b6a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a4c06a770 0x7f1a4c13ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a51b6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c1350d0 0x7f1a4c13b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a51b6a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a4c13d210 0x7f1a4c13b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a51b6a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c139fb0 con 0x7f1a4c13d210 2023-09-30T22:21:54.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a51b6a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c138ed0 con 0x7f1a4c06a770 2023-09-30T22:21:54.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a51b6a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c138c70 con 0x7f1a4c1350d0 2023-09-30T22:21:54.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c1350d0 0x7f1a4c13b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c1350d0 0x7f1a4c13b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59998/0 (socket says 172.21.15.154:59998) 2023-09-30T22:21:54.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4affd700 1 -- 172.21.15.154:0/50977585 learned_addr learned my addr 172.21.15.154:0/50977585 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:54.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4b7fe700 1 --2- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a4c06a770 0x7f1a4c13ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4affd700 1 -- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a4c06a770 msgr2=0x7f1a4c13ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4affd700 1 --2- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a4c06a770 0x7f1a4c13ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4affd700 1 -- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a4c13d210 msgr2=0x7f1a4c13b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4affd700 1 --2- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a4c13d210 0x7f1a4c13b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4affd700 1 -- 172.21.15.154:0/50977585 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a400094a0 con 0x7f1a4c1350d0 2023-09-30T22:21:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.618+0000 7f1a4affd700 1 --2- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c1350d0 0x7f1a4c13b2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00e9b0 tx=0x7f1a3c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.619+0000 7f1a33fff700 1 -- 172.21.15.154:0/50977585 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c009710 con 0x7f1a4c1350d0 2023-09-30T22:21:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.619+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c09b0f0 con 0x7f1a4c1350d0 2023-09-30T22:21:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.619+0000 7f1a33fff700 1 -- 172.21.15.154:0/50977585 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c00c850 con 0x7f1a4c1350d0 2023-09-30T22:21:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.619+0000 7f1a33fff700 1 -- 172.21.15.154:0/50977585 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00cbc0 con 0x7f1a4c1350d0 2023-09-30T22:21:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.619+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c072240 con 0x7f1a4c1350d0 2023-09-30T22:21:54.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.620+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c136ff0 con 0x7f1a4c1350d0 2023-09-30T22:21:54.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.620+0000 7f1a33fff700 1 -- 172.21.15.154:0/50977585 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f1a3c00cd20 con 0x7f1a4c1350d0 2023-09-30T22:21:54.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.629+0000 7f1a33fff700 1 -- 172.21.15.154:0/50977585 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f1a3c011e20 con 0x7f1a4c1350d0 2023-09-30T22:21:54.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.629+0000 7f1a33fff700 1 -- 172.21.15.154:0/50977585 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a3c0232f0 con 0x7f1a4c1350d0 2023-09-30T22:21:54.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.657+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcf406ad40 con 0x7fbcf4099920 2023-09-30T22:21:54.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.658+0000 7fbce2ffd700 1 -- 172.21.15.154:0/1302998930 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcf406ad40 con 0x7fbcf4099920 2023-09-30T22:21:54.658 INFO:teuthology.orchestra.run.smithi154.stdout:38654705695 2023-09-30T22:21:54.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.658+0000 7f600a910700 1 Processor -- start 2023-09-30T22:21:54.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.658+0000 7f600a910700 1 -- start start 2023-09-30T22:21:54.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f600a910700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f6004138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f600a910700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6004139280 0x7f600413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f600a910700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600406b2d0 con 0x7f6004133ad0 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f600a910700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60041345b0 con 0x7f6004139280 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f600a910700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6004133610 con 0x7f6004136960 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f60037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f6004138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f60037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f6004138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49868/0 (socket says 172.21.15.154:49868) 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f60037fe700 1 -- 172.21.15.154:0/1982116096 learned_addr learned my addr 172.21.15.154:0/1982116096 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f60037fe700 1 -- 172.21.15.154:0/1982116096 >> v2:172.21.15.154:3300/0 conn(0x7f6004139280 msgr2=0x7f600413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f60037fe700 1 --2- 172.21.15.154:0/1982116096 >> v2:172.21.15.154:3300/0 conn(0x7f6004139280 0x7f600413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f60037fe700 1 -- 172.21.15.154:0/1982116096 >> v1:172.21.15.154:6789/0 conn(0x7f6004133ad0 legacy=0x7f6004133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f60037fe700 1 -- 172.21.15.154:0/1982116096 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600409a500 con 0x7f6004136960 2023-09-30T22:21:54.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.659+0000 7f60037fe700 1 --2- 172.21.15.154:0/1982116096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f6004138d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009920 tx=0x7f5ff8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba3b5e72b680f276 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7f6002ffd700 1 -- 172.21.15.154:0/1982116096 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8004230 con 0x7f6004136960 2023-09-30T22:21:54.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7f6002ffd700 1 -- 172.21.15.154:0/1982116096 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff8004390 con 0x7f6004136960 2023-09-30T22:21:54.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7f6002ffd700 1 -- 172.21.15.154:0/1982116096 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8009e70 con 0x7f6004136960 2023-09-30T22:21:54.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 >> v1:172.21.15.154:6816/126757 conn(0x7fbcd402f240 legacy=0x7fbcd40316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf4099920 msgr2=0x7fbcf4129070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7fbcf89c8700 1 --2- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf4099920 0x7fbcf4129070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbce4000c00 tx=0x7fbce4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:54.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7f600a910700 1 -- 172.21.15.154:0/1982116096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 msgr2=0x7f6004138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7f600a910700 1 --2- 172.21.15.154:0/1982116096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f6004138d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009920 tx=0x7f5ff8009c30 comp rx=0 tx=0).stop 2023-09-30T22:21:54.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7f600a910700 1 -- 172.21.15.154:0/1982116096 shutdown_connections 2023-09-30T22:21:54.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.660+0000 7f600a910700 1 --2- 172.21.15.154:0/1982116096 >> v2:172.21.15.154:3300/0 conn(0x7f6004139280 0x7f600413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7f600a910700 1 --2- 172.21.15.154:0/1982116096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f6004138d40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7f600a910700 1 -- 172.21.15.154:0/1982116096 >> 172.21.15.154:0/1982116096 conn(0x7f6004099c40 msgr2=0x7f60040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 shutdown_connections 2023-09-30T22:21:54.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7fbcf89c8700 1 --2- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcf41307c0 0x7fbcf41c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7fbcf89c8700 1 --2- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcf4099920 0x7fbcf4129070 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7fbcf89c8700 1 --2- 172.21.15.154:0/1302998930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcf412feb0 0x7fbcf41295b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 >> 172.21.15.154:0/1302998930 conn(0x7fbcf40a2b30 msgr2=0x7fbcf412c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7f600a910700 1 -- 172.21.15.154:0/1982116096 shutdown_connections 2023-09-30T22:21:54.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7f600a910700 1 -- 172.21.15.154:0/1982116096 wait complete. 2023-09-30T22:21:54.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 shutdown_connections 2023-09-30T22:21:54.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.661+0000 7fbcf89c8700 1 -- 172.21.15.154:0/1302998930 wait complete. 2023-09-30T22:21:54.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.662+0000 7f600a910700 1 Processor -- start 2023-09-30T22:21:54.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.662+0000 7f600a910700 1 -- start start 2023-09-30T22:21:54.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.662+0000 7f600a910700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6004133ad0 0x7f600412cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.662+0000 7f600a910700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f600412d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.662+0000 7f600a910700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6004139280 0x7f60040711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.662+0000 7f600a910700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600409f390 con 0x7f6004133ad0 2023-09-30T22:21:54.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.662+0000 7f600a910700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60041316a0 con 0x7f6004136960 2023-09-30T22:21:54.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.662+0000 7f600a910700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60040723c0 con 0x7f6004139280 2023-09-30T22:21:54.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f6003fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6004133ad0 0x7f600412cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f6003fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6004133ad0 0x7f600412cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41256/0 (socket says 172.21.15.154:41256) 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f6003fff700 1 -- 172.21.15.154:0/1792785430 learned_addr learned my addr 172.21.15.154:0/1792785430 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f6008ead700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6004139280 0x7f60040711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f60037fe700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f600412d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f60037fe700 1 -- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6004139280 msgr2=0x7f60040711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f60037fe700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6004139280 0x7f60040711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f60037fe700 1 -- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6004133ad0 msgr2=0x7f600412cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f60037fe700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6004133ad0 0x7f600412cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f60037fe700 1 -- 172.21.15.154:0/1792785430 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8009550 con 0x7f6004136960 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f6008ead700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6004139280 0x7f60040711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:54.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f6003fff700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6004133ad0 0x7f600412cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:54.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f60037fe700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f600412d430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8015000 tx=0x7f5ff8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f6000ff9700 1 -- 172.21.15.154:0/1792785430 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff800beb0 con 0x7f6004136960 2023-09-30T22:21:54.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.663+0000 7f6000ff9700 1 -- 172.21.15.154:0/1792785430 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff80036a0 con 0x7f6004136960 2023-09-30T22:21:54.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.664+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600412d970 con 0x7f6004136960 2023-09-30T22:21:54.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.664+0000 7f6000ff9700 1 -- 172.21.15.154:0/1792785430 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8003a50 con 0x7f6004136960 2023-09-30T22:21:54.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.664+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6004070d70 con 0x7f6004136960 2023-09-30T22:21:54.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.664+0000 7f6000ff9700 1 -- 172.21.15.154:0/1792785430 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f5ff8021070 con 0x7f6004136960 2023-09-30T22:21:54.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.665+0000 7f6000ff9700 1 -- 172.21.15.154:0/1792785430 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f5ff8040e50 con 0x7f6004136960 2023-09-30T22:21:54.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.666+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6004070240 con 0x7f6004136960 2023-09-30T22:21:54.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.1 2023-09-30T22:21:54.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.675+0000 7f6000ff9700 1 -- 172.21.15.154:0/1792785430 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6004070240 con 0x7f6004136960 2023-09-30T22:21:54.675 DEBUG:teuthology.parallel:result is None 2023-09-30T22:21:54.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.726+0000 7f545ba1e700 1 Processor -- start 2023-09-30T22:21:54.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f545ba1e700 1 -- start start 2023-09-30T22:21:54.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f545ba1e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5454133ad0 0x7f5454133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f545ba1e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54541300a0 0x7f54541304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f545ba1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 0x7f545413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f545ba1e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545406b2d0 con 0x7f54541300a0 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f545ba1e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5454133610 con 0x7f54541309f0 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f545ba1e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f545409a500 con 0x7f5454133ad0 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f5458fb9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54541300a0 0x7f54541304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f5458fb9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54541300a0 0x7f54541304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41266/0 (socket says 172.21.15.154:41266) 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.727+0000 7f5458fb9700 1 -- 172.21.15.154:0/2854250842 learned_addr learned my addr 172.21.15.154:0/2854250842 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f54597ba700 1 --2- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5454133ad0 0x7f5454133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f5459fbb700 1 --2- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 0x7f545413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f5458fb9700 1 -- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5454133ad0 msgr2=0x7f5454133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f5458fb9700 1 --2- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5454133ad0 0x7f5454133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f5458fb9700 1 -- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 msgr2=0x7f545413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f5458fb9700 1 --2- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 0x7f545413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f5458fb9700 1 -- 172.21.15.154:0/2854250842 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54541338b0 con 0x7f54541300a0 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f5458fb9700 1 --2- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54541300a0 0x7f54541304b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54440098f0 tx=0x7f5444009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec15b8d95bfeb50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f544bfff700 1 -- 172.21.15.154:0/2854250842 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444011830 con 0x7f54541300a0 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f544bfff700 1 -- 172.21.15.154:0/2854250842 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5444011990 con 0x7f54541300a0 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.728+0000 7f544bfff700 1 -- 172.21.15.154:0/2854250842 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444011d20 con 0x7f54541300a0 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.729+0000 7f545ba1e700 1 -- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54541300a0 msgr2=0x7f54541304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.729+0000 7f545ba1e700 1 --2- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54541300a0 0x7f54541304b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54440098f0 tx=0x7f5444009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.729+0000 7f545ba1e700 1 -- 172.21.15.154:0/2854250842 shutdown_connections 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.729+0000 7f545ba1e700 1 --2- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 0x7f545413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.729+0000 7f545ba1e700 1 --2- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5454133ad0 0x7f5454133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.729+0000 7f545ba1e700 1 --2- 172.21.15.154:0/2854250842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54541300a0 0x7f54541304b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.729+0000 7f545ba1e700 1 -- 172.21.15.154:0/2854250842 >> 172.21.15.154:0/2854250842 conn(0x7f5454099c40 msgr2=0x7f54540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.729+0000 7f545ba1e700 1 -- 172.21.15.154:0/2854250842 shutdown_connections 2023-09-30T22:21:54.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.729+0000 7f545ba1e700 1 -- 172.21.15.154:0/2854250842 wait complete. 2023-09-30T22:21:54.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f545ba1e700 1 Processor -- start 2023-09-30T22:21:54.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f545ba1e700 1 -- start start 2023-09-30T22:21:54.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f545ba1e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54541300a0 0x7f545411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f545ba1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 0x7f545411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f545ba1e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5454133ad0 0x7f545411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:54.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f545ba1e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545411fe00 con 0x7f5454133ad0 2023-09-30T22:21:54.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f545ba1e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545411ffe0 con 0x7f54541309f0 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f545ba1e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f545411fa40 con 0x7f54541300a0 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f54597ba700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54541300a0 0x7f545411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f54597ba700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54541300a0 0x7f545411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60020/0 (socket says 172.21.15.154:60020) 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.730+0000 7f54597ba700 1 -- 172.21.15.154:0/1681901319 learned_addr learned my addr 172.21.15.154:0/1681901319 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f5458fb9700 1 --2- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 0x7f545411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f5459fbb700 1 --2- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5454133ad0 0x7f545411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f54597ba700 1 -- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 msgr2=0x7f545411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f54597ba700 1 --2- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 0x7f545411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f54597ba700 1 -- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5454133ad0 msgr2=0x7f545411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f54597ba700 1 --2- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5454133ad0 0x7f545411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f54597ba700 1 -- 172.21.15.154:0/1681901319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444009550 con 0x7f54541300a0 2023-09-30T22:21:54.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f54597ba700 1 --2- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54541300a0 0x7f545411da40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f545000e9b0 tx=0x7f545000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:54.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f5449ffb700 1 -- 172.21.15.154:0/1681901319 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450009710 con 0x7f54541300a0 2023-09-30T22:21:54.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f5449ffb700 1 -- 172.21.15.154:0/1681901319 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545000ee50 con 0x7f54541300a0 2023-09-30T22:21:54.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545412d890 con 0x7f54541300a0 2023-09-30T22:21:54.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f5449ffb700 1 -- 172.21.15.154:0/1681901319 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545000ca50 con 0x7f54541300a0 2023-09-30T22:21:54.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.731+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545411f370 con 0x7f54541300a0 2023-09-30T22:21:54.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.732+0000 7f5449ffb700 1 -- 172.21.15.154:0/1681901319 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 8) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f545000cbb0 con 0x7f54541300a0 2023-09-30T22:21:54.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.732+0000 7f5449ffb700 1 -- 172.21.15.154:0/1681901319 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f545003f6f0 con 0x7f54541300a0 2023-09-30T22:21:54.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.733+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54540a3460 con 0x7f54541300a0 2023-09-30T22:21:54.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.737+0000 7f5449ffb700 1 -- 172.21.15.154:0/1681901319 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5450021070 con 0x7f54541300a0 2023-09-30T22:21:54.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.833+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a4c139920 con 0x7f1a4c1350d0 2023-09-30T22:21:54.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.833+0000 7f1a33fff700 1 -- 172.21.15.154:0/50977585 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a3c021030 con 0x7f1a4c1350d0 2023-09-30T22:21:54.833 INFO:teuthology.orchestra.run.smithi154.stdout:38654705694 2023-09-30T22:21:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.835+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 >> v1:172.21.15.154:6816/126757 conn(0x7f1a3802f240 legacy=0x7f1a380316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.835+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c1350d0 msgr2=0x7f1a4c13b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.835+0000 7f1a51b6a700 1 --2- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c1350d0 0x7f1a4c13b2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00e9b0 tx=0x7f1a3c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.835+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 shutdown_connections 2023-09-30T22:21:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.835+0000 7f1a51b6a700 1 --2- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a4c13d210 0x7f1a4c13b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.835+0000 7f1a51b6a700 1 --2- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a4c06a770 0x7f1a4c13ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.835+0000 7f1a51b6a700 1 --2- 172.21.15.154:0/50977585 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a4c1350d0 0x7f1a4c13b2d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.836+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 >> 172.21.15.154:0/50977585 conn(0x7f1a4c099c40 msgr2=0x7f1a4c0a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.836+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 shutdown_connections 2023-09-30T22:21:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.836+0000 7f1a51b6a700 1 -- 172.21.15.154:0/50977585 wait complete. 2023-09-30T22:21:54.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.3 2023-09-30T22:21:54.848 DEBUG:teuthology.parallel:result is None 2023-09-30T22:21:54.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.895+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6004070240 con 0x7f6004136960 2023-09-30T22:21:54.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.895+0000 7f6000ff9700 1 -- 172.21.15.154:0/1792785430 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6004070240 con 0x7f6004136960 2023-09-30T22:21:54.895 INFO:teuthology.orchestra.run.smithi154.stdout:38654705694 2023-09-30T22:21:54.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 >> v1:172.21.15.154:6816/126757 conn(0x7f5ff002f240 legacy=0x7f5ff00316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 msgr2=0x7f600412d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f600412d430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8015000 tx=0x7f5ff8004750 comp rx=0 tx=0).stop 2023-09-30T22:21:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 shutdown_connections 2023-09-30T22:21:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6004139280 0x7f60040711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6004133ad0 0x7f600412cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 --2- 172.21.15.154:0/1792785430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6004136960 0x7f600412d430 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 >> 172.21.15.154:0/1792785430 conn(0x7f6004099c40 msgr2=0x7f6004134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 shutdown_connections 2023-09-30T22:21:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.897+0000 7f600a910700 1 -- 172.21.15.154:0/1792785430 wait complete. 2023-09-30T22:21:54.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.0 2023-09-30T22:21:54.909 DEBUG:teuthology.parallel:result is None 2023-09-30T22:21:54.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.957+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f545412dd60 con 0x7f54541300a0 2023-09-30T22:21:54.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.957+0000 7f5449ffb700 1 -- 172.21.15.154:0/1681901319 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f545002b090 con 0x7f54541300a0 2023-09-30T22:21:54.957 INFO:teuthology.orchestra.run.smithi154.stdout:38654705694 2023-09-30T22:21:54.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 >> v1:172.21.15.154:6816/126757 conn(0x7f543802f240 legacy=0x7f54380316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54541300a0 msgr2=0x7f545411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:54.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 --2- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54541300a0 0x7f545411da40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f545000e9b0 tx=0x7f545000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 shutdown_connections 2023-09-30T22:21:54.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 --2- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5454133ad0 0x7f545411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 --2- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54541300a0 0x7f545411da40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 --2- 172.21.15.154:0/1681901319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54541309f0 0x7f545411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:54.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 >> 172.21.15.154:0/1681901319 conn(0x7f5454099c40 msgr2=0x7f54541320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:54.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 shutdown_connections 2023-09-30T22:21:54.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:54.960+0000 7f545ba1e700 1 -- 172.21.15.154:0/1681901319 wait complete. 2023-09-30T22:21:54.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.2 2023-09-30T22:21:54.974 DEBUG:teuthology.parallel:result is None 2023-09-30T22:21:54.974 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:21:54.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:21:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.095+0000 7f941c075700 1 Processor -- start 2023-09-30T22:21:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.095+0000 7f941c075700 1 -- start start 2023-09-30T22:21:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941c075700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f941409d860 0x7f941409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941c075700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9414130eb0 0x7f9414138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941c075700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941409aaa0 con 0x7f941409e170 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941c075700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941409f870 con 0x7f941409d860 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941c075700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941409b360 con 0x7f9414130eb0 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941a612700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9414130eb0 0x7f9414138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f9419e11700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f941409d860 0x7f941409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f9419610700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f941409e170 0x7f94141307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57294/0 (socket says 172.21.15.154:57294) 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f9419610700 1 -- 172.21.15.154:0/1142313034 learned_addr learned my addr 172.21.15.154:0/1142313034 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941a612700 1 -- 172.21.15.154:0/1142313034 >> v2:172.21.15.154:3300/0 conn(0x7f941409d860 msgr2=0x7f941409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941a612700 1 --2- 172.21.15.154:0/1142313034 >> v2:172.21.15.154:3300/0 conn(0x7f941409d860 0x7f941409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941a612700 1 -- 172.21.15.154:0/1142313034 >> v1:172.21.15.154:6789/0 conn(0x7f941409e170 legacy=0x7f94141307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f9418e0f700 1 -- 172.21.15.154:0/1142313034 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571037624 0 0) 0x7f941409aaa0 con 0x7f941409e170 2023-09-30T22:21:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941a612700 1 -- 172.21.15.154:0/1142313034 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941409b620 con 0x7f9414130eb0 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f9419e11700 1 --2- 172.21.15.154:0/1142313034 >> v2:172.21.15.154:3300/0 conn(0x7f941409d860 0x7f941409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f941a612700 1 --2- 172.21.15.154:0/1142313034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9414130eb0 0x7f9414138a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f940c009d90 tx=0x7f940c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c0cc7eb2601b830 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.096+0000 7f9418e0f700 1 -- 172.21.15.154:0/1142313034 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c00e070 con 0x7f9414130eb0 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f9418e0f700 1 -- 172.21.15.154:0/1142313034 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c00bb20 con 0x7f9414130eb0 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f9418e0f700 1 -- 172.21.15.154:0/1142313034 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c012430 con 0x7f9414130eb0 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f941c075700 1 -- 172.21.15.154:0/1142313034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9414130eb0 msgr2=0x7f9414138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f941c075700 1 --2- 172.21.15.154:0/1142313034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9414130eb0 0x7f9414138a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f940c009d90 tx=0x7f940c00b330 comp rx=0 tx=0).stop 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f941c075700 1 -- 172.21.15.154:0/1142313034 shutdown_connections 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f941c075700 1 --2- 172.21.15.154:0/1142313034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9414130eb0 0x7f9414138a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f941c075700 1 --2- 172.21.15.154:0/1142313034 >> v2:172.21.15.154:3300/0 conn(0x7f941409d860 0x7f941409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f941c075700 1 -- 172.21.15.154:0/1142313034 >> 172.21.15.154:0/1142313034 conn(0x7f9414099c40 msgr2=0x7f94140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f941c075700 1 -- 172.21.15.154:0/1142313034 shutdown_connections 2023-09-30T22:21:55.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.097+0000 7f941c075700 1 -- 172.21.15.154:0/1142313034 wait complete. 2023-09-30T22:21:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.098+0000 7f941c075700 1 Processor -- start 2023-09-30T22:21:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.098+0000 7f941c075700 1 -- start start 2023-09-30T22:21:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941c075700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f941409d860 0x7f94141c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941c075700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f941409e170 0x7f94141c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941c075700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9414130eb0 0x7f94141c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941c075700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9414125f20 con 0x7f9414130eb0 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941c075700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941411f380 con 0x7f941409d860 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941c075700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94140a0820 con 0x7f941409e170 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f9419e11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f941409d860 0x7f94141c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941a612700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9414130eb0 0x7f94141c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f9419e11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f941409d860 0x7f94141c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:49902/0 (socket says 172.21.15.154:49902) 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f9419610700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f941409e170 0x7f94141c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f9419e11700 1 -- 172.21.15.154:0/1796026433 learned_addr learned my addr 172.21.15.154:0/1796026433 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941a612700 1 -- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f941409e170 msgr2=0x7f94141c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941a612700 1 --2- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f941409e170 0x7f94141c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941a612700 1 -- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f941409d860 msgr2=0x7f94141c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941a612700 1 --2- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f941409d860 0x7f94141c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941a612700 1 -- 172.21.15.154:0/1796026433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040094a0 con 0x7f9414130eb0 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f9419e11700 1 --2- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f941409d860 0x7f94141c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941a612700 1 --2- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9414130eb0 0x7f94141c8bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f940c016000 tx=0x7f940c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f940a7fc700 1 -- 172.21.15.154:0/1796026433 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c012430 con 0x7f9414130eb0 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f940a7fc700 1 -- 172.21.15.154:0/1796026433 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c020070 con 0x7f9414130eb0 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f940a7fc700 1 -- 172.21.15.154:0/1796026433 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c004280 con 0x7f9414130eb0 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c009a70 con 0x7f9414130eb0 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.099+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9414126b70 con 0x7f9414130eb0 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.100+0000 7f940a7fc700 1 -- 172.21.15.154:0/1796026433 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 9) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f940c0043e0 con 0x7f9414130eb0 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.100+0000 7f940a7fc700 1 -- 172.21.15.154:0/1796026433 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f940c022070 con 0x7f9414130eb0 2023-09-30T22:21:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.100+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941404f2a0 con 0x7f9414130eb0 2023-09-30T22:21:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.105+0000 7f940a7fc700 1 -- 172.21.15.154:0/1796026433 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f940c02c080 con 0x7f9414130eb0 2023-09-30T22:21:55.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.283+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 --> v1:172.21.15.154:6816/126757 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9414126090 con 0x7f93f802f480 2023-09-30T22:21:55.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.291+0000 7f940a7fc700 1 -- 172.21.15.154:0/1796026433 <== mgr.14189 v1:172.21.15.154:6816/126757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270284 (unknown 2965378022 0 1992484098) 0x7f9414126090 con 0x7f93f802f480 2023-09-30T22:21:55.293 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 >> v1:172.21.15.154:6816/126757 conn(0x7f93f802f480 legacy=0x7f93f8031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9414130eb0 msgr2=0x7f94141c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 --2- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9414130eb0 0x7f94141c8bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f940c016000 tx=0x7f940c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 shutdown_connections 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 --2- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9414130eb0 0x7f94141c8bd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 --2- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f941409d860 0x7f94141c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 --2- 172.21.15.154:0/1796026433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f941409e170 0x7f94141c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 >> 172.21.15.154:0/1796026433 conn(0x7f9414099c40 msgr2=0x7f94140a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 shutdown_connections 2023-09-30T22:21:55.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.294+0000 7f941c075700 1 -- 172.21.15.154:0/1796026433 wait complete. 2023-09-30T22:21:55.297 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-09-30T22:21:55.305 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-09-30T22:21:53.949251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298240,"statfs":{"total":386547056640,"available":385329397760,"internally_reserved":0,"allocated":753664,"data_stored":267726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.996360"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.396140+0000","last_change":"2023-09-30T22:19:33.658237+0000","last_active":"2023-09-30T22:21:47.396140+0000","last_peered":"2023-09-30T22:21:47.396140+0000","last_clean":"2023-09-30T22:21:47.396140+0000","last_became_active":"2023-09-30T22:19:33.657934+0000","last_became_peered":"2023-09-30T22:19:33.657934+0000","last_unstale":"2023-09-30T22:21:47.396140+0000","last_undegraded":"2023-09-30T22:21:47.396140+0000","last_fullsized":"2023-09-30T22:21:47.396140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395988+0000","last_change":"2023-09-30T22:19:33.644960+0000","last_active":"2023-09-30T22:21:47.395988+0000","last_peered":"2023-09-30T22:21:47.395988+0000","last_clean":"2023-09-30T22:21:47.395988+0000","last_became_active":"2023-09-30T22:19:33.644714+0000","last_became_peered":"2023-09-30T22:19:33.644714+0000","last_unstale":"2023-09-30T22:21:47.395988+0000","last_undegraded":"2023-09-30T22:21:47.395988+0000","last_fullsized":"2023-09-30T22:21:47.395988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395675+0000","last_change":"2023-09-30T22:19:33.647352+0000","last_active":"2023-09-30T22:21:47.395675+0000","last_peered":"2023-09-30T22:21:47.395675+0000","last_clean":"2023-09-30T22:21:47.395675+0000","last_became_active":"2023-09-30T22:19:33.647023+0000","last_became_peered":"2023-09-30T22:19:33.647023+0000","last_unstale":"2023-09-30T22:21:47.395675+0000","last_undegraded":"2023-09-30T22:21:47.395675+0000","last_fullsized":"2023-09-30T22:21:47.395675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395145+0000","last_change":"2023-09-30T22:19:33.645394+0000","last_active":"2023-09-30T22:21:47.395145+0000","last_peered":"2023-09-30T22:21:47.395145+0000","last_clean":"2023-09-30T22:21:47.395145+0000","last_became_active":"2023-09-30T22:19:33.645211+0000","last_became_peered":"2023-09-30T22:19:33.645211+0000","last_unstale":"2023-09-30T22:21:47.395145+0000","last_undegraded":"2023-09-30T22:21:47.395145+0000","last_fullsized":"2023-09-30T22:21:47.395145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394735+0000","last_change":"2023-09-30T22:19:33.651418+0000","last_active":"2023-09-30T22:21:47.394735+0000","last_peered":"2023-09-30T22:21:47.394735+0000","last_clean":"2023-09-30T22:21:47.394735+0000","last_became_active":"2023-09-30T22:19:33.651174+0000","last_became_peered":"2023-09-30T22:19:33.651174+0000","last_unstale":"2023-09-30T22:21:47.394735+0000","last_undegraded":"2023-09-30T22:21:47.394735+0000","last_fullsized":"2023-09-30T22:21:47.394735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178180+0000","last_change":"2023-09-30T22:19:33.671906+0000","last_active":"2023-09-30T22:21:47.178180+0000","last_peered":"2023-09-30T22:21:47.178180+0000","last_clean":"2023-09-30T22:21:47.178180+0000","last_became_active":"2023-09-30T22:19:33.671528+0000","last_became_peered":"2023-09-30T22:19:33.671528+0000","last_unstale":"2023-09-30T22:21:47.178180+0000","last_undegraded":"2023-09-30T22:21:47.178180+0000","last_fullsized":"2023-09-30T22:21:47.178180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177670+0000","last_change":"2023-09-30T22:19:33.670986+0000","last_active":"2023-09-30T22:21:47.177670+0000","last_peered":"2023-09-30T22:21:47.177670+0000","last_clean":"2023-09-30T22:21:47.177670+0000","last_became_active":"2023-09-30T22:19:33.670689+0000","last_became_peered":"2023-09-30T22:19:33.670689+0000","last_unstale":"2023-09-30T22:21:47.177670+0000","last_undegraded":"2023-09-30T22:21:47.177670+0000","last_fullsized":"2023-09-30T22:21:47.177670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175437+0000","last_change":"2023-09-30T22:19:33.654626+0000","last_active":"2023-09-30T22:21:47.175437+0000","last_peered":"2023-09-30T22:21:47.175437+0000","last_clean":"2023-09-30T22:21:47.175437+0000","last_became_active":"2023-09-30T22:19:33.654358+0000","last_became_peered":"2023-09-30T22:19:33.654358+0000","last_unstale":"2023-09-30T22:21:47.175437+0000","last_undegraded":"2023-09-30T22:21:47.175437+0000","last_fullsized":"2023-09-30T22:21:47.175437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398919+0000","last_change":"2023-09-30T22:19:33.648775+0000","last_active":"2023-09-30T22:21:47.398919+0000","last_peered":"2023-09-30T22:21:47.398919+0000","last_clean":"2023-09-30T22:21:47.398919+0000","last_became_active":"2023-09-30T22:19:33.648386+0000","last_became_peered":"2023-09-30T22:19:33.648386+0000","last_unstale":"2023-09-30T22:21:47.398919+0000","last_undegraded":"2023-09-30T22:21:47.398919+0000","last_fullsized":"2023-09-30T22:21:47.398919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176383+0000","last_change":"2023-09-30T22:19:33.667764+0000","last_active":"2023-09-30T22:21:47.176383+0000","last_peered":"2023-09-30T22:21:47.176383+0000","last_clean":"2023-09-30T22:21:47.176383+0000","last_became_active":"2023-09-30T22:19:33.667514+0000","last_became_peered":"2023-09-30T22:19:33.667514+0000","last_unstale":"2023-09-30T22:21:47.176383+0000","last_undegraded":"2023-09-30T22:21:47.176383+0000","last_fullsized":"2023-09-30T22:21:47.176383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176184+0000","last_change":"2023-09-30T22:19:33.657292+0000","last_active":"2023-09-30T22:21:47.176184+0000","last_peered":"2023-09-30T22:21:47.176184+0000","last_clean":"2023-09-30T22:21:47.176184+0000","last_became_active":"2023-09-30T22:19:33.656706+0000","last_became_peered":"2023-09-30T22:19:33.656706+0000","last_unstale":"2023-09-30T22:21:47.176184+0000","last_undegraded":"2023-09-30T22:21:47.176184+0000","last_fullsized":"2023-09-30T22:21:47.176184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395324+0000","last_change":"2023-09-30T22:19:33.658823+0000","last_active":"2023-09-30T22:21:47.395324+0000","last_peered":"2023-09-30T22:21:47.395324+0000","last_clean":"2023-09-30T22:21:47.395324+0000","last_became_active":"2023-09-30T22:19:33.658537+0000","last_became_peered":"2023-09-30T22:19:33.658537+0000","last_unstale":"2023-09-30T22:21:47.395324+0000","last_undegraded":"2023-09-30T22:21:47.395324+0000","last_fullsized":"2023-09-30T22:21:47.395324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394829+0000","last_change":"2023-09-30T22:20:24.853848+0000","last_active":"2023-09-30T22:21:47.394829+0000","last_peered":"2023-09-30T22:21:47.394829+0000","last_clean":"2023-09-30T22:21:47.394829+0000","last_became_active":"2023-09-30T22:20:24.853654+0000","last_became_peered":"2023-09-30T22:20:24.853654+0000","last_unstale":"2023-09-30T22:21:47.394829+0000","last_undegraded":"2023-09-30T22:21:47.394829+0000","last_fullsized":"2023-09-30T22:21:47.394829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176633+0000","last_change":"2023-09-30T22:19:33.652240+0000","last_active":"2023-09-30T22:21:47.176633+0000","last_peered":"2023-09-30T22:21:47.176633+0000","last_clean":"2023-09-30T22:21:47.176633+0000","last_became_active":"2023-09-30T22:19:33.651971+0000","last_became_peered":"2023-09-30T22:19:33.651971+0000","last_unstale":"2023-09-30T22:21:47.176633+0000","last_undegraded":"2023-09-30T22:21:47.176633+0000","last_fullsized":"2023-09-30T22:21:47.176633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394162+0000","last_change":"2023-09-30T22:19:33.645322+0000","last_active":"2023-09-30T22:21:47.394162+0000","last_peered":"2023-09-30T22:21:47.394162+0000","last_clean":"2023-09-30T22:21:47.394162+0000","last_became_active":"2023-09-30T22:19:33.645012+0000","last_became_peered":"2023-09-30T22:19:33.645012+0000","last_unstale":"2023-09-30T22:21:47.394162+0000","last_undegraded":"2023-09-30T22:21:47.394162+0000","last_fullsized":"2023-09-30T22:21:47.394162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.393849+0000","last_change":"2023-09-30T22:20:24.853370+0000","last_active":"2023-09-30T22:21:47.393849+0000","last_peered":"2023-09-30T22:21:47.393849+0000","last_clean":"2023-09-30T22:21:47.393849+0000","last_became_active":"2023-09-30T22:20:24.853088+0000","last_became_peered":"2023-09-30T22:20:24.853088+0000","last_unstale":"2023-09-30T22:21:47.393849+0000","last_undegraded":"2023-09-30T22:21:47.393849+0000","last_fullsized":"2023-09-30T22:21:47.393849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398849+0000","last_change":"2023-09-30T22:19:33.648614+0000","last_active":"2023-09-30T22:21:47.398849+0000","last_peered":"2023-09-30T22:21:47.398849+0000","last_clean":"2023-09-30T22:21:47.398849+0000","last_became_active":"2023-09-30T22:19:33.648081+0000","last_became_peered":"2023-09-30T22:19:33.648081+0000","last_unstale":"2023-09-30T22:21:47.398849+0000","last_undegraded":"2023-09-30T22:21:47.398849+0000","last_fullsized":"2023-09-30T22:21:47.398849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395846+0000","last_change":"2023-09-30T22:19:33.639423+0000","last_active":"2023-09-30T22:21:47.395846+0000","last_peered":"2023-09-30T22:21:47.395846+0000","last_clean":"2023-09-30T22:21:47.395846+0000","last_became_active":"2023-09-30T22:19:33.639112+0000","last_became_peered":"2023-09-30T22:19:33.639112+0000","last_unstale":"2023-09-30T22:21:47.395846+0000","last_undegraded":"2023-09-30T22:21:47.395846+0000","last_fullsized":"2023-09-30T22:21:47.395846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395537+0000","last_change":"2023-09-30T22:19:33.658136+0000","last_active":"2023-09-30T22:21:47.395537+0000","last_peered":"2023-09-30T22:21:47.395537+0000","last_clean":"2023-09-30T22:21:47.395537+0000","last_became_active":"2023-09-30T22:19:33.657838+0000","last_became_peered":"2023-09-30T22:19:33.657838+0000","last_unstale":"2023-09-30T22:21:47.395537+0000","last_undegraded":"2023-09-30T22:21:47.395537+0000","last_fullsized":"2023-09-30T22:21:47.395537+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176273+0000","last_change":"2023-09-30T22:19:33.650438+0000","last_active":"2023-09-30T22:21:47.176273+0000","last_peered":"2023-09-30T22:21:47.176273+0000","last_clean":"2023-09-30T22:21:47.176273+0000","last_became_active":"2023-09-30T22:19:33.650186+0000","last_became_peered":"2023-09-30T22:19:33.650186+0000","last_unstale":"2023-09-30T22:21:47.176273+0000","last_undegraded":"2023-09-30T22:21:47.176273+0000","last_fullsized":"2023-09-30T22:21:47.176273+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175951+0000","last_change":"2023-09-30T22:19:33.663045+0000","last_active":"2023-09-30T22:21:47.175951+0000","last_peered":"2023-09-30T22:21:47.175951+0000","last_clean":"2023-09-30T22:21:47.175951+0000","last_became_active":"2023-09-30T22:19:33.662782+0000","last_became_peered":"2023-09-30T22:19:33.662782+0000","last_unstale":"2023-09-30T22:21:47.175951+0000","last_undegraded":"2023-09-30T22:21:47.175951+0000","last_fullsized":"2023-09-30T22:21:47.175951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394361+0000","last_change":"2023-09-30T22:19:33.645247+0000","last_active":"2023-09-30T22:21:47.394361+0000","last_peered":"2023-09-30T22:21:47.394361+0000","last_clean":"2023-09-30T22:21:47.394361+0000","last_became_active":"2023-09-30T22:19:33.644963+0000","last_became_peered":"2023-09-30T22:19:33.644963+0000","last_unstale":"2023-09-30T22:21:47.394361+0000","last_undegraded":"2023-09-30T22:21:47.394361+0000","last_fullsized":"2023-09-30T22:21:47.394361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177649+0000","last_change":"2023-09-30T22:19:33.662935+0000","last_active":"2023-09-30T22:21:47.177649+0000","last_peered":"2023-09-30T22:21:47.177649+0000","last_clean":"2023-09-30T22:21:47.177649+0000","last_became_active":"2023-09-30T22:19:33.662255+0000","last_became_peered":"2023-09-30T22:19:33.662255+0000","last_unstale":"2023-09-30T22:21:47.177649+0000","last_undegraded":"2023-09-30T22:21:47.177649+0000","last_fullsized":"2023-09-30T22:21:47.177649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175503+0000","last_change":"2023-09-30T22:19:33.652392+0000","last_active":"2023-09-30T22:21:47.175503+0000","last_peered":"2023-09-30T22:21:47.175503+0000","last_clean":"2023-09-30T22:21:47.175503+0000","last_became_active":"2023-09-30T22:19:33.652097+0000","last_became_peered":"2023-09-30T22:19:33.652097+0000","last_unstale":"2023-09-30T22:21:47.175503+0000","last_undegraded":"2023-09-30T22:21:47.175503+0000","last_fullsized":"2023-09-30T22:21:47.175503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176485+0000","last_change":"2023-09-30T22:19:33.649799+0000","last_active":"2023-09-30T22:21:47.176485+0000","last_peered":"2023-09-30T22:21:47.176485+0000","last_clean":"2023-09-30T22:21:47.176485+0000","last_became_active":"2023-09-30T22:19:33.649512+0000","last_became_peered":"2023-09-30T22:19:33.649512+0000","last_unstale":"2023-09-30T22:21:47.176485+0000","last_undegraded":"2023-09-30T22:21:47.176485+0000","last_fullsized":"2023-09-30T22:21:47.176485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176344+0000","last_change":"2023-09-30T22:19:33.653148+0000","last_active":"2023-09-30T22:21:47.176344+0000","last_peered":"2023-09-30T22:21:47.176344+0000","last_clean":"2023-09-30T22:21:47.176344+0000","last_became_active":"2023-09-30T22:19:33.652806+0000","last_became_peered":"2023-09-30T22:19:33.652806+0000","last_unstale":"2023-09-30T22:21:47.176344+0000","last_undegraded":"2023-09-30T22:21:47.176344+0000","last_fullsized":"2023-09-30T22:21:47.176344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177883+0000","last_change":"2023-09-30T22:19:33.673663+0000","last_active":"2023-09-30T22:21:47.177883+0000","last_peered":"2023-09-30T22:21:47.177883+0000","last_clean":"2023-09-30T22:21:47.177883+0000","last_became_active":"2023-09-30T22:19:33.673128+0000","last_became_peered":"2023-09-30T22:19:33.673128+0000","last_unstale":"2023-09-30T22:21:47.177883+0000","last_undegraded":"2023-09-30T22:21:47.177883+0000","last_fullsized":"2023-09-30T22:21:47.177883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175833+0000","last_change":"2023-09-30T22:19:33.280425+0000","last_active":"2023-09-30T22:21:47.175833+0000","last_peered":"2023-09-30T22:21:47.175833+0000","last_clean":"2023-09-30T22:21:47.175833+0000","last_became_active":"2023-09-30T22:19:33.280161+0000","last_became_peered":"2023-09-30T22:19:33.280161+0000","last_unstale":"2023-09-30T22:21:47.175833+0000","last_undegraded":"2023-09-30T22:21:47.175833+0000","last_fullsized":"2023-09-30T22:21:47.175833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177943+0000","last_change":"2023-09-30T22:19:33.670909+0000","last_active":"2023-09-30T22:21:47.177943+0000","last_peered":"2023-09-30T22:21:47.177943+0000","last_clean":"2023-09-30T22:21:47.177943+0000","last_became_active":"2023-09-30T22:19:33.670616+0000","last_became_peered":"2023-09-30T22:19:33.670616+0000","last_unstale":"2023-09-30T22:21:47.177943+0000","last_undegraded":"2023-09-30T22:21:47.177943+0000","last_fullsized":"2023-09-30T22:21:47.177943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175634+0000","last_change":"2023-09-30T22:19:33.284384+0000","last_active":"2023-09-30T22:21:47.175634+0000","last_peered":"2023-09-30T22:21:47.175634+0000","last_clean":"2023-09-30T22:21:47.175634+0000","last_became_active":"2023-09-30T22:19:33.284138+0000","last_became_peered":"2023-09-30T22:19:33.284138+0000","last_unstale":"2023-09-30T22:21:47.175634+0000","last_undegraded":"2023-09-30T22:21:47.175634+0000","last_fullsized":"2023-09-30T22:21:47.175634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395988+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:21:47.395988+0000","last_peered":"2023-09-30T22:21:47.395988+0000","last_clean":"2023-09-30T22:21:47.395988+0000","last_became_active":"2023-09-30T22:19:33.646355+0000","last_became_peered":"2023-09-30T22:19:33.646355+0000","last_unstale":"2023-09-30T22:21:47.395988+0000","last_undegraded":"2023-09-30T22:21:47.395988+0000","last_fullsized":"2023-09-30T22:21:47.395988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177655+0000","last_change":"2023-09-30T22:19:33.289402+0000","last_active":"2023-09-30T22:21:47.177655+0000","last_peered":"2023-09-30T22:21:47.177655+0000","last_clean":"2023-09-30T22:21:47.177655+0000","last_became_active":"2023-09-30T22:19:33.288979+0000","last_became_peered":"2023-09-30T22:19:33.288979+0000","last_unstale":"2023-09-30T22:21:47.177655+0000","last_undegraded":"2023-09-30T22:21:47.177655+0000","last_fullsized":"2023-09-30T22:21:47.177655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178977+0000","last_change":"2023-09-30T22:19:33.672854+0000","last_active":"2023-09-30T22:21:47.178977+0000","last_peered":"2023-09-30T22:21:47.178977+0000","last_clean":"2023-09-30T22:21:47.178977+0000","last_became_active":"2023-09-30T22:19:33.672539+0000","last_became_peered":"2023-09-30T22:19:33.672539+0000","last_unstale":"2023-09-30T22:21:47.178977+0000","last_undegraded":"2023-09-30T22:21:47.178977+0000","last_fullsized":"2023-09-30T22:21:47.178977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398706+0000","last_change":"2023-09-30T22:19:33.294805+0000","last_active":"2023-09-30T22:21:47.398706+0000","last_peered":"2023-09-30T22:21:47.398706+0000","last_clean":"2023-09-30T22:21:47.398706+0000","last_became_active":"2023-09-30T22:19:33.294520+0000","last_became_peered":"2023-09-30T22:19:33.294520+0000","last_unstale":"2023-09-30T22:21:47.398706+0000","last_undegraded":"2023-09-30T22:21:47.398706+0000","last_fullsized":"2023-09-30T22:21:47.398706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177734+0000","last_change":"2023-09-30T22:19:33.660684+0000","last_active":"2023-09-30T22:21:47.177734+0000","last_peered":"2023-09-30T22:21:47.177734+0000","last_clean":"2023-09-30T22:21:47.177734+0000","last_became_active":"2023-09-30T22:19:33.660143+0000","last_became_peered":"2023-09-30T22:19:33.660143+0000","last_unstale":"2023-09-30T22:21:47.177734+0000","last_undegraded":"2023-09-30T22:21:47.177734+0000","last_fullsized":"2023-09-30T22:21:47.177734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395747+0000","last_change":"2023-09-30T22:19:33.279060+0000","last_active":"2023-09-30T22:21:47.395747+0000","last_peered":"2023-09-30T22:21:47.395747+0000","last_clean":"2023-09-30T22:21:47.395747+0000","last_became_active":"2023-09-30T22:19:33.278776+0000","last_became_peered":"2023-09-30T22:19:33.278776+0000","last_unstale":"2023-09-30T22:21:47.395747+0000","last_undegraded":"2023-09-30T22:21:47.395747+0000","last_fullsized":"2023-09-30T22:21:47.395747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177885+0000","last_change":"2023-09-30T22:19:33.662982+0000","last_active":"2023-09-30T22:21:47.177885+0000","last_peered":"2023-09-30T22:21:47.177885+0000","last_clean":"2023-09-30T22:21:47.177885+0000","last_became_active":"2023-09-30T22:19:33.662668+0000","last_became_peered":"2023-09-30T22:19:33.662668+0000","last_unstale":"2023-09-30T22:21:47.177885+0000","last_undegraded":"2023-09-30T22:21:47.177885+0000","last_fullsized":"2023-09-30T22:21:47.177885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395605+0000","last_change":"2023-09-30T22:19:33.288428+0000","last_active":"2023-09-30T22:21:47.395605+0000","last_peered":"2023-09-30T22:21:47.395605+0000","last_clean":"2023-09-30T22:21:47.395605+0000","last_became_active":"2023-09-30T22:19:33.287975+0000","last_became_peered":"2023-09-30T22:19:33.287975+0000","last_unstale":"2023-09-30T22:21:47.395605+0000","last_undegraded":"2023-09-30T22:21:47.395605+0000","last_fullsized":"2023-09-30T22:21:47.395605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175933+0000","last_change":"2023-09-30T22:19:33.662645+0000","last_active":"2023-09-30T22:21:47.175933+0000","last_peered":"2023-09-30T22:21:47.175933+0000","last_clean":"2023-09-30T22:21:47.175933+0000","last_became_active":"2023-09-30T22:19:33.662371+0000","last_became_peered":"2023-09-30T22:19:33.662371+0000","last_unstale":"2023-09-30T22:21:47.175933+0000","last_undegraded":"2023-09-30T22:21:47.175933+0000","last_fullsized":"2023-09-30T22:21:47.175933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:21:52.020617+0000","last_change":"2023-09-30T22:19:33.289061+0000","last_active":"2023-09-30T22:21:52.020617+0000","last_peered":"2023-09-30T22:21:52.020617+0000","last_clean":"2023-09-30T22:21:52.020617+0000","last_became_active":"2023-09-30T22:19:33.288656+0000","last_became_peered":"2023-09-30T22:19:33.288656+0000","last_unstale":"2023-09-30T22:21:52.020617+0000","last_undegraded":"2023-09-30T22:21:52.020617+0000","last_fullsized":"2023-09-30T22:21:52.020617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394998+0000","last_change":"2023-09-30T22:19:33.665863+0000","last_active":"2023-09-30T22:21:47.394998+0000","last_peered":"2023-09-30T22:21:47.394998+0000","last_clean":"2023-09-30T22:21:47.394998+0000","last_became_active":"2023-09-30T22:19:33.665570+0000","last_became_peered":"2023-09-30T22:19:33.665570+0000","last_unstale":"2023-09-30T22:21:47.394998+0000","last_undegraded":"2023-09-30T22:21:47.394998+0000","last_fullsized":"2023-09-30T22:21:47.394998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178430+0000","last_change":"2023-09-30T22:19:33.296210+0000","last_active":"2023-09-30T22:21:47.178430+0000","last_peered":"2023-09-30T22:21:47.178430+0000","last_clean":"2023-09-30T22:21:47.178430+0000","last_became_active":"2023-09-30T22:19:33.295952+0000","last_became_peered":"2023-09-30T22:19:33.295952+0000","last_unstale":"2023-09-30T22:21:47.178430+0000","last_undegraded":"2023-09-30T22:21:47.178430+0000","last_fullsized":"2023-09-30T22:21:47.178430+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178627+0000","last_change":"2023-09-30T22:19:33.670730+0000","last_active":"2023-09-30T22:21:47.178627+0000","last_peered":"2023-09-30T22:21:47.178627+0000","last_clean":"2023-09-30T22:21:47.178627+0000","last_became_active":"2023-09-30T22:19:33.670520+0000","last_became_peered":"2023-09-30T22:19:33.670520+0000","last_unstale":"2023-09-30T22:21:47.178627+0000","last_undegraded":"2023-09-30T22:21:47.178627+0000","last_fullsized":"2023-09-30T22:21:47.178627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394428+0000","last_change":"2023-09-30T22:19:33.293117+0000","last_active":"2023-09-30T22:21:47.394428+0000","last_peered":"2023-09-30T22:21:47.394428+0000","last_clean":"2023-09-30T22:21:47.394428+0000","last_became_active":"2023-09-30T22:19:33.288262+0000","last_became_peered":"2023-09-30T22:19:33.288262+0000","last_unstale":"2023-09-30T22:21:47.394428+0000","last_undegraded":"2023-09-30T22:21:47.394428+0000","last_fullsized":"2023-09-30T22:21:47.394428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395403+0000","last_change":"2023-09-30T22:20:24.853785+0000","last_active":"2023-09-30T22:21:47.395403+0000","last_peered":"2023-09-30T22:21:47.395403+0000","last_clean":"2023-09-30T22:21:47.395403+0000","last_became_active":"2023-09-30T22:20:24.853462+0000","last_became_peered":"2023-09-30T22:20:24.853462+0000","last_unstale":"2023-09-30T22:21:47.395403+0000","last_undegraded":"2023-09-30T22:21:47.395403+0000","last_fullsized":"2023-09-30T22:21:47.395403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177841+0000","last_change":"2023-09-30T22:19:33.288441+0000","last_active":"2023-09-30T22:21:47.177841+0000","last_peered":"2023-09-30T22:21:47.177841+0000","last_clean":"2023-09-30T22:21:47.177841+0000","last_became_active":"2023-09-30T22:19:33.288030+0000","last_became_peered":"2023-09-30T22:19:33.288030+0000","last_unstale":"2023-09-30T22:21:47.177841+0000","last_undegraded":"2023-09-30T22:21:47.177841+0000","last_fullsized":"2023-09-30T22:21:47.177841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.396098+0000","last_change":"2023-09-30T22:20:24.855658+0000","last_active":"2023-09-30T22:21:47.396098+0000","last_peered":"2023-09-30T22:21:47.396098+0000","last_clean":"2023-09-30T22:21:47.396098+0000","last_became_active":"2023-09-30T22:20:24.855380+0000","last_became_peered":"2023-09-30T22:20:24.855380+0000","last_unstale":"2023-09-30T22:21:47.396098+0000","last_undegraded":"2023-09-30T22:21:47.396098+0000","last_fullsized":"2023-09-30T22:21:47.396098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175672+0000","last_change":"2023-09-30T22:19:33.283730+0000","last_active":"2023-09-30T22:21:47.175672+0000","last_peered":"2023-09-30T22:21:47.175672+0000","last_clean":"2023-09-30T22:21:47.175672+0000","last_became_active":"2023-09-30T22:19:33.282944+0000","last_became_peered":"2023-09-30T22:19:33.282944+0000","last_unstale":"2023-09-30T22:21:47.175672+0000","last_undegraded":"2023-09-30T22:21:47.175672+0000","last_fullsized":"2023-09-30T22:21:47.175672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178933+0000","last_change":"2023-09-30T22:19:33.672354+0000","last_active":"2023-09-30T22:21:47.178933+0000","last_peered":"2023-09-30T22:21:47.178933+0000","last_clean":"2023-09-30T22:21:47.178933+0000","last_became_active":"2023-09-30T22:19:33.672110+0000","last_became_peered":"2023-09-30T22:19:33.672110+0000","last_unstale":"2023-09-30T22:21:47.178933+0000","last_undegraded":"2023-09-30T22:21:47.178933+0000","last_fullsized":"2023-09-30T22:21:47.178933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398537+0000","last_change":"2023-09-30T22:19:33.293023+0000","last_active":"2023-09-30T22:21:47.398537+0000","last_peered":"2023-09-30T22:21:47.398537+0000","last_clean":"2023-09-30T22:21:47.398537+0000","last_became_active":"2023-09-30T22:19:33.288365+0000","last_became_peered":"2023-09-30T22:19:33.288365+0000","last_unstale":"2023-09-30T22:21:47.398537+0000","last_undegraded":"2023-09-30T22:21:47.398537+0000","last_fullsized":"2023-09-30T22:21:47.398537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178098+0000","last_change":"2023-09-30T22:19:33.661497+0000","last_active":"2023-09-30T22:21:47.178098+0000","last_peered":"2023-09-30T22:21:47.178098+0000","last_clean":"2023-09-30T22:21:47.178098+0000","last_became_active":"2023-09-30T22:19:33.660436+0000","last_became_peered":"2023-09-30T22:19:33.660436+0000","last_unstale":"2023-09-30T22:21:47.178098+0000","last_undegraded":"2023-09-30T22:21:47.178098+0000","last_fullsized":"2023-09-30T22:21:47.178098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395831+0000","last_change":"2023-09-30T22:19:33.288413+0000","last_active":"2023-09-30T22:21:47.395831+0000","last_peered":"2023-09-30T22:21:47.395831+0000","last_clean":"2023-09-30T22:21:47.395831+0000","last_became_active":"2023-09-30T22:19:33.288151+0000","last_became_peered":"2023-09-30T22:19:33.288151+0000","last_unstale":"2023-09-30T22:21:47.395831+0000","last_undegraded":"2023-09-30T22:21:47.395831+0000","last_fullsized":"2023-09-30T22:21:47.395831+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175715+0000","last_change":"2023-09-30T22:19:33.662546+0000","last_active":"2023-09-30T22:21:47.175715+0000","last_peered":"2023-09-30T22:21:47.175715+0000","last_clean":"2023-09-30T22:21:47.175715+0000","last_became_active":"2023-09-30T22:19:33.662214+0000","last_became_peered":"2023-09-30T22:19:33.662214+0000","last_unstale":"2023-09-30T22:21:47.175715+0000","last_undegraded":"2023-09-30T22:21:47.175715+0000","last_fullsized":"2023-09-30T22:21:47.175715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178063+0000","last_change":"2023-09-30T22:19:33.291431+0000","last_active":"2023-09-30T22:21:47.178063+0000","last_peered":"2023-09-30T22:21:47.178063+0000","last_clean":"2023-09-30T22:21:47.178063+0000","last_became_active":"2023-09-30T22:19:33.290697+0000","last_became_peered":"2023-09-30T22:19:33.290697+0000","last_unstale":"2023-09-30T22:21:47.178063+0000","last_undegraded":"2023-09-30T22:21:47.178063+0000","last_fullsized":"2023-09-30T22:21:47.178063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394474+0000","last_change":"2023-09-30T22:20:24.853738+0000","last_active":"2023-09-30T22:21:47.394474+0000","last_peered":"2023-09-30T22:21:47.394474+0000","last_clean":"2023-09-30T22:21:47.394474+0000","last_became_active":"2023-09-30T22:20:24.853452+0000","last_became_peered":"2023-09-30T22:20:24.853452+0000","last_unstale":"2023-09-30T22:21:47.394474+0000","last_undegraded":"2023-09-30T22:21:47.394474+0000","last_fullsized":"2023-09-30T22:21:47.394474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395325+0000","last_change":"2023-09-30T22:19:33.286077+0000","last_active":"2023-09-30T22:21:47.395325+0000","last_peered":"2023-09-30T22:21:47.395325+0000","last_clean":"2023-09-30T22:21:47.395325+0000","last_became_active":"2023-09-30T22:19:33.279026+0000","last_became_peered":"2023-09-30T22:19:33.279026+0000","last_unstale":"2023-09-30T22:21:47.395325+0000","last_undegraded":"2023-09-30T22:21:47.395325+0000","last_fullsized":"2023-09-30T22:21:47.395325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395009+0000","last_change":"2023-09-30T22:19:33.647993+0000","last_active":"2023-09-30T22:21:47.395009+0000","last_peered":"2023-09-30T22:21:47.395009+0000","last_clean":"2023-09-30T22:21:47.395009+0000","last_became_active":"2023-09-30T22:19:33.647725+0000","last_became_peered":"2023-09-30T22:19:33.647725+0000","last_unstale":"2023-09-30T22:21:47.395009+0000","last_undegraded":"2023-09-30T22:21:47.395009+0000","last_fullsized":"2023-09-30T22:21:47.395009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178283+0000","last_change":"2023-09-30T22:19:33.296389+0000","last_active":"2023-09-30T22:21:47.178283+0000","last_peered":"2023-09-30T22:21:47.178283+0000","last_clean":"2023-09-30T22:21:47.178283+0000","last_became_active":"2023-09-30T22:19:33.296134+0000","last_became_peered":"2023-09-30T22:19:33.296134+0000","last_unstale":"2023-09-30T22:21:47.178283+0000","last_undegraded":"2023-09-30T22:21:47.178283+0000","last_fullsized":"2023-09-30T22:21:47.178283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395258+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:21:47.395258+0000","last_peered":"2023-09-30T22:21:47.395258+0000","last_clean":"2023-09-30T22:21:47.395258+0000","last_became_active":"2023-09-30T22:19:33.646503+0000","last_became_peered":"2023-09-30T22:19:33.646503+0000","last_unstale":"2023-09-30T22:21:47.395258+0000","last_undegraded":"2023-09-30T22:21:47.395258+0000","last_fullsized":"2023-09-30T22:21:47.395258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178101+0000","last_change":"2023-09-30T22:19:33.287703+0000","last_active":"2023-09-30T22:21:47.178101+0000","last_peered":"2023-09-30T22:21:47.178101+0000","last_clean":"2023-09-30T22:21:47.178101+0000","last_became_active":"2023-09-30T22:19:33.287403+0000","last_became_peered":"2023-09-30T22:19:33.287403+0000","last_unstale":"2023-09-30T22:21:47.178101+0000","last_undegraded":"2023-09-30T22:21:47.178101+0000","last_fullsized":"2023-09-30T22:21:47.178101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177963+0000","last_change":"2023-09-30T22:19:33.672679+0000","last_active":"2023-09-30T22:21:47.177963+0000","last_peered":"2023-09-30T22:21:47.177963+0000","last_clean":"2023-09-30T22:21:47.177963+0000","last_became_active":"2023-09-30T22:19:33.671069+0000","last_became_peered":"2023-09-30T22:19:33.671069+0000","last_unstale":"2023-09-30T22:21:47.177963+0000","last_undegraded":"2023-09-30T22:21:47.177963+0000","last_fullsized":"2023-09-30T22:21:47.177963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177735+0000","last_change":"2023-09-30T22:19:33.288281+0000","last_active":"2023-09-30T22:21:47.177735+0000","last_peered":"2023-09-30T22:21:47.177735+0000","last_clean":"2023-09-30T22:21:47.177735+0000","last_became_active":"2023-09-30T22:19:33.287697+0000","last_became_peered":"2023-09-30T22:19:33.287697+0000","last_unstale":"2023-09-30T22:21:47.177735+0000","last_undegraded":"2023-09-30T22:21:47.177735+0000","last_fullsized":"2023-09-30T22:21:47.177735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395908+0000","last_change":"2023-09-30T22:19:33.666225+0000","last_active":"2023-09-30T22:21:47.395908+0000","last_peered":"2023-09-30T22:21:47.395908+0000","last_clean":"2023-09-30T22:21:47.395908+0000","last_became_active":"2023-09-30T22:19:33.665223+0000","last_became_peered":"2023-09-30T22:19:33.665223+0000","last_unstale":"2023-09-30T22:21:47.395908+0000","last_undegraded":"2023-09-30T22:21:47.395908+0000","last_fullsized":"2023-09-30T22:21:47.395908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177493+0000","last_change":"2023-09-30T22:19:33.289238+0000","last_active":"2023-09-30T22:21:47.177493+0000","last_peered":"2023-09-30T22:21:47.177493+0000","last_clean":"2023-09-30T22:21:47.177493+0000","last_became_active":"2023-09-30T22:19:33.288633+0000","last_became_peered":"2023-09-30T22:19:33.288633+0000","last_unstale":"2023-09-30T22:21:47.177493+0000","last_undegraded":"2023-09-30T22:21:47.177493+0000","last_fullsized":"2023-09-30T22:21:47.177493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176523+0000","last_change":"2023-09-30T22:19:33.649869+0000","last_active":"2023-09-30T22:21:47.176523+0000","last_peered":"2023-09-30T22:21:47.176523+0000","last_clean":"2023-09-30T22:21:47.176523+0000","last_became_active":"2023-09-30T22:19:33.649582+0000","last_became_peered":"2023-09-30T22:19:33.649582+0000","last_unstale":"2023-09-30T22:21:47.176523+0000","last_undegraded":"2023-09-30T22:21:47.176523+0000","last_fullsized":"2023-09-30T22:21:47.176523+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176230+0000","last_change":"2023-09-30T22:19:30.188504+0000","last_active":"2023-09-30T22:21:47.176230+0000","last_peered":"2023-09-30T22:21:47.176230+0000","last_clean":"2023-09-30T22:21:47.176230+0000","last_became_active":"2023-09-30T22:19:30.188218+0000","last_became_peered":"2023-09-30T22:19:30.188218+0000","last_unstale":"2023-09-30T22:21:47.176230+0000","last_undegraded":"2023-09-30T22:21:47.176230+0000","last_fullsized":"2023-09-30T22:21:47.176230+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395472+0000","last_change":"2023-09-30T22:19:33.282597+0000","last_active":"2023-09-30T22:21:47.395472+0000","last_peered":"2023-09-30T22:21:47.395472+0000","last_clean":"2023-09-30T22:21:47.395472+0000","last_became_active":"2023-09-30T22:19:33.280396+0000","last_became_peered":"2023-09-30T22:19:33.280396+0000","last_unstale":"2023-09-30T22:21:47.395472+0000","last_undegraded":"2023-09-30T22:21:47.395472+0000","last_fullsized":"2023-09-30T22:21:47.395472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175899+0000","last_change":"2023-09-30T22:20:24.855278+0000","last_active":"2023-09-30T22:21:47.175899+0000","last_peered":"2023-09-30T22:21:47.175899+0000","last_clean":"2023-09-30T22:21:47.175899+0000","last_became_active":"2023-09-30T22:20:24.854973+0000","last_became_peered":"2023-09-30T22:20:24.854973+0000","last_unstale":"2023-09-30T22:21:47.175899+0000","last_undegraded":"2023-09-30T22:21:47.175899+0000","last_fullsized":"2023-09-30T22:21:47.175899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178024+0000","last_change":"2023-09-30T22:19:29.250128+0000","last_active":"2023-09-30T22:21:47.178024+0000","last_peered":"2023-09-30T22:21:47.178024+0000","last_clean":"2023-09-30T22:21:47.178024+0000","last_became_active":"2023-09-30T22:19:29.249745+0000","last_became_peered":"2023-09-30T22:19:29.249745+0000","last_unstale":"2023-09-30T22:21:47.178024+0000","last_undegraded":"2023-09-30T22:21:47.178024+0000","last_fullsized":"2023-09-30T22:21:47.178024+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394802+0000","last_change":"2023-09-30T22:19:33.294524+0000","last_active":"2023-09-30T22:21:47.394802+0000","last_peered":"2023-09-30T22:21:47.394802+0000","last_clean":"2023-09-30T22:21:47.394802+0000","last_became_active":"2023-09-30T22:19:33.293937+0000","last_became_peered":"2023-09-30T22:19:33.293937+0000","last_unstale":"2023-09-30T22:21:47.394802+0000","last_undegraded":"2023-09-30T22:21:47.394802+0000","last_fullsized":"2023-09-30T22:21:47.394802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176113+0000","last_change":"2023-09-30T22:19:33.653434+0000","last_active":"2023-09-30T22:21:47.176113+0000","last_peered":"2023-09-30T22:21:47.176113+0000","last_clean":"2023-09-30T22:21:47.176113+0000","last_became_active":"2023-09-30T22:19:33.652629+0000","last_became_peered":"2023-09-30T22:19:33.652629+0000","last_unstale":"2023-09-30T22:21:47.176113+0000","last_undegraded":"2023-09-30T22:21:47.176113+0000","last_fullsized":"2023-09-30T22:21:47.176113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394285+0000","last_change":"2023-09-30T22:19:29.249638+0000","last_active":"2023-09-30T22:21:47.394285+0000","last_peered":"2023-09-30T22:21:47.394285+0000","last_clean":"2023-09-30T22:21:47.394285+0000","last_became_active":"2023-09-30T22:19:29.249366+0000","last_became_peered":"2023-09-30T22:19:29.249366+0000","last_unstale":"2023-09-30T22:21:47.394285+0000","last_undegraded":"2023-09-30T22:21:47.394285+0000","last_fullsized":"2023-09-30T22:21:47.394285+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175615+0000","last_change":"2023-09-30T22:19:33.290330+0000","last_active":"2023-09-30T22:21:47.175615+0000","last_peered":"2023-09-30T22:21:47.175615+0000","last_clean":"2023-09-30T22:21:47.175615+0000","last_became_active":"2023-09-30T22:19:33.289841+0000","last_became_peered":"2023-09-30T22:19:33.289841+0000","last_unstale":"2023-09-30T22:21:47.175615+0000","last_undegraded":"2023-09-30T22:21:47.175615+0000","last_fullsized":"2023-09-30T22:21:47.175615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176600+0000","last_change":"2023-09-30T22:19:33.657019+0000","last_active":"2023-09-30T22:21:47.176600+0000","last_peered":"2023-09-30T22:21:47.176600+0000","last_clean":"2023-09-30T22:21:47.176600+0000","last_became_active":"2023-09-30T22:19:33.656759+0000","last_became_peered":"2023-09-30T22:19:33.656759+0000","last_unstale":"2023-09-30T22:21:47.176600+0000","last_undegraded":"2023-09-30T22:21:47.176600+0000","last_fullsized":"2023-09-30T22:21:47.176600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178354+0000","last_change":"2023-09-30T22:19:29.249647+0000","last_active":"2023-09-30T22:21:47.178354+0000","last_peered":"2023-09-30T22:21:47.178354+0000","last_clean":"2023-09-30T22:21:47.178354+0000","last_became_active":"2023-09-30T22:19:29.249371+0000","last_became_peered":"2023-09-30T22:19:29.249371+0000","last_unstale":"2023-09-30T22:21:47.178354+0000","last_undegraded":"2023-09-30T22:21:47.178354+0000","last_fullsized":"2023-09-30T22:21:47.178354+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175534+0000","last_change":"2023-09-30T22:19:30.188360+0000","last_active":"2023-09-30T22:21:47.175534+0000","last_peered":"2023-09-30T22:21:47.175534+0000","last_clean":"2023-09-30T22:21:47.175534+0000","last_became_active":"2023-09-30T22:19:30.187849+0000","last_became_peered":"2023-09-30T22:19:30.187849+0000","last_unstale":"2023-09-30T22:21:47.175534+0000","last_undegraded":"2023-09-30T22:21:47.175534+0000","last_fullsized":"2023-09-30T22:21:47.175534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177719+0000","last_change":"2023-09-30T22:19:33.292032+0000","last_active":"2023-09-30T22:21:47.177719+0000","last_peered":"2023-09-30T22:21:47.177719+0000","last_clean":"2023-09-30T22:21:47.177719+0000","last_became_active":"2023-09-30T22:19:33.291755+0000","last_became_peered":"2023-09-30T22:19:33.291755+0000","last_unstale":"2023-09-30T22:21:47.177719+0000","last_undegraded":"2023-09-30T22:21:47.177719+0000","last_fullsized":"2023-09-30T22:21:47.177719+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178802+0000","last_change":"2023-09-30T22:19:33.674909+0000","last_active":"2023-09-30T22:21:47.178802+0000","last_peered":"2023-09-30T22:21:47.178802+0000","last_clean":"2023-09-30T22:21:47.178802+0000","last_became_active":"2023-09-30T22:19:33.674646+0000","last_became_peered":"2023-09-30T22:19:33.674646+0000","last_unstale":"2023-09-30T22:21:47.178802+0000","last_undegraded":"2023-09-30T22:21:47.178802+0000","last_fullsized":"2023-09-30T22:21:47.178802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177568+0000","last_change":"2023-09-30T22:19:29.250622+0000","last_active":"2023-09-30T22:21:47.177568+0000","last_peered":"2023-09-30T22:21:47.177568+0000","last_clean":"2023-09-30T22:21:47.177568+0000","last_became_active":"2023-09-30T22:19:29.250370+0000","last_became_peered":"2023-09-30T22:19:29.250370+0000","last_unstale":"2023-09-30T22:21:47.177568+0000","last_undegraded":"2023-09-30T22:21:47.177568+0000","last_fullsized":"2023-09-30T22:21:47.177568+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394234+0000","last_change":"2023-09-30T22:19:33.279290+0000","last_active":"2023-09-30T22:21:47.394234+0000","last_peered":"2023-09-30T22:21:47.394234+0000","last_clean":"2023-09-30T22:21:47.394234+0000","last_became_active":"2023-09-30T22:19:33.277328+0000","last_became_peered":"2023-09-30T22:19:33.277328+0000","last_unstale":"2023-09-30T22:21:47.394234+0000","last_undegraded":"2023-09-30T22:21:47.394234+0000","last_fullsized":"2023-09-30T22:21:47.394234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.399060+0000","last_change":"2023-09-30T22:19:33.646613+0000","last_active":"2023-09-30T22:21:47.399060+0000","last_peered":"2023-09-30T22:21:47.399060+0000","last_clean":"2023-09-30T22:21:47.399060+0000","last_became_active":"2023-09-30T22:19:33.646057+0000","last_became_peered":"2023-09-30T22:19:33.646057+0000","last_unstale":"2023-09-30T22:21:47.399060+0000","last_undegraded":"2023-09-30T22:21:47.399060+0000","last_fullsized":"2023-09-30T22:21:47.399060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178699+0000","last_change":"2023-09-30T22:19:30.188159+0000","last_active":"2023-09-30T22:21:47.178699+0000","last_peered":"2023-09-30T22:21:47.178699+0000","last_clean":"2023-09-30T22:21:47.178699+0000","last_became_active":"2023-09-30T22:19:30.187869+0000","last_became_peered":"2023-09-30T22:19:30.187869+0000","last_unstale":"2023-09-30T22:21:47.178699+0000","last_undegraded":"2023-09-30T22:21:47.178699+0000","last_fullsized":"2023-09-30T22:21:47.178699+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176060+0000","last_change":"2023-09-30T22:19:33.289031+0000","last_active":"2023-09-30T22:21:47.176060+0000","last_peered":"2023-09-30T22:21:47.176060+0000","last_clean":"2023-09-30T22:21:47.176060+0000","last_became_active":"2023-09-30T22:19:33.288758+0000","last_became_peered":"2023-09-30T22:19:33.288758+0000","last_unstale":"2023-09-30T22:21:47.176060+0000","last_undegraded":"2023-09-30T22:21:47.176060+0000","last_fullsized":"2023-09-30T22:21:47.176060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394943+0000","last_change":"2023-09-30T22:19:33.642133+0000","last_active":"2023-09-30T22:21:47.394943+0000","last_peered":"2023-09-30T22:21:47.394943+0000","last_clean":"2023-09-30T22:21:47.394943+0000","last_became_active":"2023-09-30T22:19:33.641852+0000","last_became_peered":"2023-09-30T22:19:33.641852+0000","last_unstale":"2023-09-30T22:21:47.394943+0000","last_undegraded":"2023-09-30T22:21:47.394943+0000","last_fullsized":"2023-09-30T22:21:47.394943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178887+0000","last_change":"2023-09-30T22:19:33.290927+0000","last_active":"2023-09-30T22:21:47.178887+0000","last_peered":"2023-09-30T22:21:47.178887+0000","last_clean":"2023-09-30T22:21:47.178887+0000","last_became_active":"2023-09-30T22:19:33.290662+0000","last_became_peered":"2023-09-30T22:19:33.290662+0000","last_unstale":"2023-09-30T22:21:47.178887+0000","last_undegraded":"2023-09-30T22:21:47.178887+0000","last_fullsized":"2023-09-30T22:21:47.178887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176287+0000","last_change":"2023-09-30T22:19:30.190576+0000","last_active":"2023-09-30T22:21:47.176287+0000","last_peered":"2023-09-30T22:21:47.176287+0000","last_clean":"2023-09-30T22:21:47.176287+0000","last_became_active":"2023-09-30T22:19:30.190289+0000","last_became_peered":"2023-09-30T22:19:30.190289+0000","last_unstale":"2023-09-30T22:21:47.176287+0000","last_undegraded":"2023-09-30T22:21:47.176287+0000","last_fullsized":"2023-09-30T22:21:47.176287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177525+0000","last_change":"2023-09-30T22:20:24.855407+0000","last_active":"2023-09-30T22:21:47.177525+0000","last_peered":"2023-09-30T22:21:47.177525+0000","last_clean":"2023-09-30T22:21:47.177525+0000","last_became_active":"2023-09-30T22:20:24.855023+0000","last_became_peered":"2023-09-30T22:20:24.855023+0000","last_unstale":"2023-09-30T22:21:47.177525+0000","last_undegraded":"2023-09-30T22:21:47.177525+0000","last_fullsized":"2023-09-30T22:21:47.177525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178947+0000","last_change":"2023-09-30T22:19:30.188129+0000","last_active":"2023-09-30T22:21:47.178947+0000","last_peered":"2023-09-30T22:21:47.178947+0000","last_clean":"2023-09-30T22:21:47.178947+0000","last_became_active":"2023-09-30T22:19:30.187818+0000","last_became_peered":"2023-09-30T22:19:30.187818+0000","last_unstale":"2023-09-30T22:21:47.178947+0000","last_undegraded":"2023-09-30T22:21:47.178947+0000","last_fullsized":"2023-09-30T22:21:47.178947+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395920+0000","last_change":"2023-09-30T22:19:33.296579+0000","last_active":"2023-09-30T22:21:47.395920+0000","last_peered":"2023-09-30T22:21:47.395920+0000","last_clean":"2023-09-30T22:21:47.395920+0000","last_became_active":"2023-09-30T22:19:33.295804+0000","last_became_peered":"2023-09-30T22:19:33.295804+0000","last_unstale":"2023-09-30T22:21:47.395920+0000","last_undegraded":"2023-09-30T22:21:47.395920+0000","last_fullsized":"2023-09-30T22:21:47.395920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394178+0000","last_change":"2023-09-30T22:19:33.642976+0000","last_active":"2023-09-30T22:21:47.394178+0000","last_peered":"2023-09-30T22:21:47.394178+0000","last_clean":"2023-09-30T22:21:47.394178+0000","last_became_active":"2023-09-30T22:19:33.642732+0000","last_became_peered":"2023-09-30T22:19:33.642732+0000","last_unstale":"2023-09-30T22:21:47.394178+0000","last_undegraded":"2023-09-30T22:21:47.394178+0000","last_fullsized":"2023-09-30T22:21:47.394178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394875+0000","last_change":"2023-09-30T22:19:33.293670+0000","last_active":"2023-09-30T22:21:47.394875+0000","last_peered":"2023-09-30T22:21:47.394875+0000","last_clean":"2023-09-30T22:21:47.394875+0000","last_became_active":"2023-09-30T22:19:33.293179+0000","last_became_peered":"2023-09-30T22:19:33.293179+0000","last_unstale":"2023-09-30T22:21:47.394875+0000","last_undegraded":"2023-09-30T22:21:47.394875+0000","last_fullsized":"2023-09-30T22:21:47.394875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395260+0000","last_change":"2023-09-30T22:19:33.647280+0000","last_active":"2023-09-30T22:21:47.395260+0000","last_peered":"2023-09-30T22:21:47.395260+0000","last_clean":"2023-09-30T22:21:47.395260+0000","last_became_active":"2023-09-30T22:19:33.646935+0000","last_became_peered":"2023-09-30T22:19:33.646935+0000","last_unstale":"2023-09-30T22:21:47.395260+0000","last_undegraded":"2023-09-30T22:21:47.395260+0000","last_fullsized":"2023-09-30T22:21:47.395260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176149+0000","last_change":"2023-09-30T22:19:33.296231+0000","last_active":"2023-09-30T22:21:47.176149+0000","last_peered":"2023-09-30T22:21:47.176149+0000","last_clean":"2023-09-30T22:21:47.176149+0000","last_became_active":"2023-09-30T22:19:33.295946+0000","last_became_peered":"2023-09-30T22:19:33.295946+0000","last_unstale":"2023-09-30T22:21:47.176149+0000","last_undegraded":"2023-09-30T22:21:47.176149+0000","last_fullsized":"2023-09-30T22:21:47.176149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394894+0000","last_change":"2023-09-30T22:19:33.665656+0000","last_active":"2023-09-30T22:21:47.394894+0000","last_peered":"2023-09-30T22:21:47.394894+0000","last_clean":"2023-09-30T22:21:47.394894+0000","last_became_active":"2023-09-30T22:19:33.658850+0000","last_became_peered":"2023-09-30T22:19:33.658850+0000","last_unstale":"2023-09-30T22:21:47.394894+0000","last_undegraded":"2023-09-30T22:21:47.394894+0000","last_fullsized":"2023-09-30T22:21:47.394894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178721+0000","last_change":"2023-09-30T22:19:33.291605+0000","last_active":"2023-09-30T22:21:47.178721+0000","last_peered":"2023-09-30T22:21:47.178721+0000","last_clean":"2023-09-30T22:21:47.178721+0000","last_became_active":"2023-09-30T22:19:33.291048+0000","last_became_peered":"2023-09-30T22:19:33.291048+0000","last_unstale":"2023-09-30T22:21:47.178721+0000","last_undegraded":"2023-09-30T22:21:47.178721+0000","last_fullsized":"2023-09-30T22:21:47.178721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394406+0000","last_change":"2023-09-30T22:19:33.643062+0000","last_active":"2023-09-30T22:21:47.394406+0000","last_peered":"2023-09-30T22:21:47.394406+0000","last_clean":"2023-09-30T22:21:47.394406+0000","last_became_active":"2023-09-30T22:19:33.642791+0000","last_became_peered":"2023-09-30T22:19:33.642791+0000","last_unstale":"2023-09-30T22:21:47.394406+0000","last_undegraded":"2023-09-30T22:21:47.394406+0000","last_fullsized":"2023-09-30T22:21:47.394406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178780+0000","last_change":"2023-09-30T22:19:33.287971+0000","last_active":"2023-09-30T22:21:47.178780+0000","last_peered":"2023-09-30T22:21:47.178780+0000","last_clean":"2023-09-30T22:21:47.178780+0000","last_became_active":"2023-09-30T22:19:33.287720+0000","last_became_peered":"2023-09-30T22:19:33.287720+0000","last_unstale":"2023-09-30T22:21:47.178780+0000","last_undegraded":"2023-09-30T22:21:47.178780+0000","last_fullsized":"2023-09-30T22:21:47.178780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177902+0000","last_change":"2023-09-30T22:19:33.670264+0000","last_active":"2023-09-30T22:21:47.177902+0000","last_peered":"2023-09-30T22:21:47.177902+0000","last_clean":"2023-09-30T22:21:47.177902+0000","last_became_active":"2023-09-30T22:19:33.670020+0000","last_became_peered":"2023-09-30T22:19:33.670020+0000","last_unstale":"2023-09-30T22:21:47.177902+0000","last_undegraded":"2023-09-30T22:21:47.177902+0000","last_fullsized":"2023-09-30T22:21:47.177902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398779+0000","last_change":"2023-09-30T22:19:33.293238+0000","last_active":"2023-09-30T22:21:47.398779+0000","last_peered":"2023-09-30T22:21:47.398779+0000","last_clean":"2023-09-30T22:21:47.398779+0000","last_became_active":"2023-09-30T22:19:33.292967+0000","last_became_peered":"2023-09-30T22:19:33.292967+0000","last_unstale":"2023-09-30T22:21:47.398779+0000","last_undegraded":"2023-09-30T22:21:47.398779+0000","last_fullsized":"2023-09-30T22:21:47.398779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.393966+0000","last_change":"2023-09-30T22:19:33.641684+0000","last_active":"2023-09-30T22:21:47.393966+0000","last_peered":"2023-09-30T22:21:47.393966+0000","last_clean":"2023-09-30T22:21:47.393966+0000","last_became_active":"2023-09-30T22:19:33.641403+0000","last_became_peered":"2023-09-30T22:19:33.641403+0000","last_unstale":"2023-09-30T22:21:47.393966+0000","last_undegraded":"2023-09-30T22:21:47.393966+0000","last_fullsized":"2023-09-30T22:21:47.393966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175623+0000","last_change":"2023-09-30T22:19:33.644249+0000","last_active":"2023-09-30T22:21:47.175623+0000","last_peered":"2023-09-30T22:21:47.175623+0000","last_clean":"2023-09-30T22:21:47.175623+0000","last_became_active":"2023-09-30T22:19:33.643987+0000","last_became_peered":"2023-09-30T22:19:33.643987+0000","last_unstale":"2023-09-30T22:21:47.175623+0000","last_undegraded":"2023-09-30T22:21:47.175623+0000","last_fullsized":"2023-09-30T22:21:47.175623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177767+0000","last_change":"2023-09-30T22:19:33.659592+0000","last_active":"2023-09-30T22:21:47.177767+0000","last_peered":"2023-09-30T22:21:47.177767+0000","last_clean":"2023-09-30T22:21:47.177767+0000","last_became_active":"2023-09-30T22:19:33.659324+0000","last_became_peered":"2023-09-30T22:19:33.659324+0000","last_unstale":"2023-09-30T22:21:47.177767+0000","last_undegraded":"2023-09-30T22:21:47.177767+0000","last_fullsized":"2023-09-30T22:21:47.177767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394499+0000","last_change":"2023-09-30T22:19:33.651082+0000","last_active":"2023-09-30T22:21:47.394499+0000","last_peered":"2023-09-30T22:21:47.394499+0000","last_clean":"2023-09-30T22:21:47.394499+0000","last_became_active":"2023-09-30T22:19:33.650784+0000","last_became_peered":"2023-09-30T22:19:33.650784+0000","last_unstale":"2023-09-30T22:21:47.394499+0000","last_undegraded":"2023-09-30T22:21:47.394499+0000","last_fullsized":"2023-09-30T22:21:47.394499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178553+0000","last_change":"2023-09-30T22:19:33.673256+0000","last_active":"2023-09-30T22:21:47.178553+0000","last_peered":"2023-09-30T22:21:47.178553+0000","last_clean":"2023-09-30T22:21:47.178553+0000","last_became_active":"2023-09-30T22:19:33.672980+0000","last_became_peered":"2023-09-30T22:19:33.672980+0000","last_unstale":"2023-09-30T22:21:47.178553+0000","last_undegraded":"2023-09-30T22:21:47.178553+0000","last_fullsized":"2023-09-30T22:21:47.178553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176194+0000","last_change":"2023-09-30T22:19:33.653617+0000","last_active":"2023-09-30T22:21:47.176194+0000","last_peered":"2023-09-30T22:21:47.176194+0000","last_clean":"2023-09-30T22:21:47.176194+0000","last_became_active":"2023-09-30T22:19:33.653009+0000","last_became_peered":"2023-09-30T22:19:33.653009+0000","last_unstale":"2023-09-30T22:21:47.176194+0000","last_undegraded":"2023-09-30T22:21:47.176194+0000","last_fullsized":"2023-09-30T22:21:47.176194+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":68522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.26800000000000002,"5min":0.27200000000000002,"15min":0.27300000000000002},"min":{"1min":0.192,"5min":0.157,"15min":0.157},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":1.643},{"interface":"front","average":{"1min":0.308,"5min":0.316,"15min":0.317},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28699999999999998,"15min":0.28799999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.29999999999999999,"15min":0.30499999999999999},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.20599999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.30199999999999999,"15min":0.30599999999999999},"min":{"1min":0.21299999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":1.6060000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705694,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297276,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074564,"statfs":{"total":96636764160,"available":96332353536,"internally_reserved":0,"allocated":184320,"data_stored":68328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.21299999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.39300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"last":0.221},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28199999999999997,"15min":0.28100000000000003},"min":{"1min":0.23699999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.29499999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.40699999999999997,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.246},{"interface":"front","average":{"1min":0.311,"5min":0.40699999999999997,"15min":0.42299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.42499999999999999,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.308}]},{"osd":3,"last update":"Sat Sep 30 22:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.314,"15min":0.314},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.46999999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.41699999999999998,"5min":0.443,"15min":0.443},"last":0.28599999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":65465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.28499999999999998,"15min":0.28599999999999998},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.39200000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.27700000000000002,"5min":0.30599999999999999,"15min":0.311},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.373,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.28100000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34399999999999997,"15min":0.34899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.41199999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.33900000000000002,"15min":0.34300000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.40100000000000002,"5min":0.5,"15min":0.5},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.32900000000000001,"15min":0.33300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.435,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.32600000000000001,"15min":0.33000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.30399999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705695,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297276,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074564,"statfs":{"total":96636764160,"available":96332353536,"internally_reserved":0,"allocated":184320,"data_stored":65411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28000000000000003,"15min":0.27800000000000002},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.375,"5min":0.375,"15min":0.375},"last":0.252},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29699999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29799999999999999},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.41199999999999998,"5min":0.432,"15min":0.432},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.38300000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Sat Sep 30 22:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.25,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.30099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:21:55.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:21:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.467+0000 7f0a0247d700 1 Processor -- start 2023-09-30T22:21:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.467+0000 7f0a0247d700 1 -- start start 2023-09-30T22:21:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a0247d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09fc136960 0x7f09fc138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a0247d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a0247d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc06b2d0 con 0x7f09fc133ad0 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a0247d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc1345b0 con 0x7f09fc136960 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a0247d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc133610 con 0x7f09fc139280 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a00a1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f09fb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09fc136960 0x7f09fc138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f09fbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f09fc133ad0 0x7f09fc133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38302/0 (socket says 172.21.15.154:38302) 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f09fbfff700 1 -- 172.21.15.154:0/369845225 learned_addr learned my addr 172.21.15.154:0/369845225 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f09fb7fe700 1 --2- 172.21.15.154:0/369845225 >> v2:172.21.15.154:3300/0 conn(0x7f09fc136960 0x7f09fc138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37434/0 (socket says 172.21.15.154:37434) 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a00a1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60638/0 (socket says 172.21.15.154:60638) 2023-09-30T22:21:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a00a1a700 1 -- 172.21.15.154:0/369845225 >> v2:172.21.15.154:3300/0 conn(0x7f09fc136960 msgr2=0x7f09fc138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a00a1a700 1 --2- 172.21.15.154:0/369845225 >> v2:172.21.15.154:3300/0 conn(0x7f09fc136960 0x7f09fc138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a00a1a700 1 -- 172.21.15.154:0/369845225 >> v1:172.21.15.154:6789/0 conn(0x7f09fc133ad0 legacy=0x7f09fc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a00a1a700 1 -- 172.21.15.154:0/369845225 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc09a500 con 0x7f09fc139280 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f09faffd700 1 -- 172.21.15.154:0/369845225 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926820282 0 0) 0x7f09fc06b2d0 con 0x7f09fc133ad0 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f09fb7fe700 1 --2- 172.21.15.154:0/369845225 >> v2:172.21.15.154:3300/0 conn(0x7f09fc136960 0x7f09fc138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f0a00a1a700 1 --2- 172.21.15.154:0/369845225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc13b660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009d90 tx=0x7f09f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32233966848ec1db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f09faffd700 1 -- 172.21.15.154:0/369845225 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400e070 con 0x7f09fc139280 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f09faffd700 1 -- 172.21.15.154:0/369845225 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f400bb20 con 0x7f09fc139280 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.468+0000 7f09faffd700 1 -- 172.21.15.154:0/369845225 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4012430 con 0x7f09fc139280 2023-09-30T22:21:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.469+0000 7f0a0247d700 1 -- 172.21.15.154:0/369845225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 msgr2=0x7f09fc13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.469+0000 7f0a0247d700 1 --2- 172.21.15.154:0/369845225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc13b660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009d90 tx=0x7f09f400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.469+0000 7f0a0247d700 1 -- 172.21.15.154:0/369845225 shutdown_connections 2023-09-30T22:21:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.469+0000 7f0a0247d700 1 --2- 172.21.15.154:0/369845225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc13b660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.469+0000 7f0a0247d700 1 --2- 172.21.15.154:0/369845225 >> v2:172.21.15.154:3300/0 conn(0x7f09fc136960 0x7f09fc138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.469+0000 7f0a0247d700 1 -- 172.21.15.154:0/369845225 >> 172.21.15.154:0/369845225 conn(0x7f09fc099c40 msgr2=0x7f09fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.469+0000 7f0a0247d700 1 -- 172.21.15.154:0/369845225 shutdown_connections 2023-09-30T22:21:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.469+0000 7f0a0247d700 1 -- 172.21.15.154:0/369845225 wait complete. 2023-09-30T22:21:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.470+0000 7f0a0247d700 1 Processor -- start 2023-09-30T22:21:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.470+0000 7f0a0247d700 1 -- start start 2023-09-30T22:21:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a0247d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09fc133ad0 0x7f09fc12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a0247d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc136960 0x7f09fc12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a0247d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a0247d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc130420 con 0x7f09fc136960 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a0247d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc072600 con 0x7f09fc133ad0 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a0247d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc12dd00 con 0x7f09fc139280 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09fc133ad0 0x7f09fc12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a00a1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f09fb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc136960 0x7f09fc12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09fc133ad0 0x7f09fc12cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36842/0 (socket says 172.21.15.154:36842) 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f09fbfff700 1 -- 172.21.15.154:0/1284134360 learned_addr learned my addr 172.21.15.154:0/1284134360 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a00a1a700 1 -- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09fc133ad0 msgr2=0x7f09fc12cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a00a1a700 1 --2- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09fc133ad0 0x7f09fc12cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a00a1a700 1 -- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc136960 msgr2=0x7f09fc12d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a00a1a700 1 --2- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc136960 0x7f09fc12d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a00a1a700 1 -- 172.21.15.154:0/1284134360 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec0094a0 con 0x7f09fc139280 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f09fbfff700 1 --2- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09fc133ad0 0x7f09fc12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a00a1a700 1 --2- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc12d5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f09f4016000 tx=0x7f09f4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f09f8ff9700 1 -- 172.21.15.154:0/1284134360 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4012430 con 0x7f09fc139280 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f09f8ff9700 1 -- 172.21.15.154:0/1284134360 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f4020070 con 0x7f09fc139280 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f4009a70 con 0x7f09fc139280 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f09f8ff9700 1 -- 172.21.15.154:0/1284134360 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4004280 con 0x7f09fc139280 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.471+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc06fa10 con 0x7f09fc139280 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.472+0000 7f09f8ff9700 1 -- 172.21.15.154:0/1284134360 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 9) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f09f40043e0 con 0x7f09fc139280 2023-09-30T22:21:55.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.472+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc04f2a0 con 0x7f09fc139280 2023-09-30T22:21:55.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.472+0000 7f09f8ff9700 1 -- 172.21.15.154:0/1284134360 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f09f4022070 con 0x7f09fc139280 2023-09-30T22:21:55.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.477+0000 7f09f8ff9700 1 -- 172.21.15.154:0/1284134360 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09f4009860 con 0x7f09fc139280 2023-09-30T22:21:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.655+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 --> v1:172.21.15.154:6816/126757 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09fc09ea90 con 0x7f09e802f480 2023-09-30T22:21:55.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.662+0000 7f09f8ff9700 1 -- 172.21.15.154:0/1284134360 <== mgr.14189 v1:172.21.15.154:6816/126757 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270284 (unknown 2965378022 0 1992484098) 0x7f09f00017a0 con 0x7f09e802f480 2023-09-30T22:21:55.664 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:55.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 >> v1:172.21.15.154:6816/126757 conn(0x7f09e802f480 legacy=0x7f09e8031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 msgr2=0x7f09fc12d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 --2- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc12d5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f09f4016000 tx=0x7f09f4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 shutdown_connections 2023-09-30T22:21:55.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 --2- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09fc139280 0x7f09fc12d5b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 --2- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09fc133ad0 0x7f09fc12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 --2- 172.21.15.154:0/1284134360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09fc136960 0x7f09fc12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 >> 172.21.15.154:0/1284134360 conn(0x7f09fc099c40 msgr2=0x7f09fc134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 shutdown_connections 2023-09-30T22:21:55.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.665+0000 7f0a0247d700 1 -- 172.21.15.154:0/1284134360 wait complete. 2023-09-30T22:21:55.668 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-09-30T22:21:55.677 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-09-30T22:21:53.949251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298240,"statfs":{"total":386547056640,"available":385329397760,"internally_reserved":0,"allocated":753664,"data_stored":267726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.996360"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.396140+0000","last_change":"2023-09-30T22:19:33.658237+0000","last_active":"2023-09-30T22:21:47.396140+0000","last_peered":"2023-09-30T22:21:47.396140+0000","last_clean":"2023-09-30T22:21:47.396140+0000","last_became_active":"2023-09-30T22:19:33.657934+0000","last_became_peered":"2023-09-30T22:19:33.657934+0000","last_unstale":"2023-09-30T22:21:47.396140+0000","last_undegraded":"2023-09-30T22:21:47.396140+0000","last_fullsized":"2023-09-30T22:21:47.396140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395988+0000","last_change":"2023-09-30T22:19:33.644960+0000","last_active":"2023-09-30T22:21:47.395988+0000","last_peered":"2023-09-30T22:21:47.395988+0000","last_clean":"2023-09-30T22:21:47.395988+0000","last_became_active":"2023-09-30T22:19:33.644714+0000","last_became_peered":"2023-09-30T22:19:33.644714+0000","last_unstale":"2023-09-30T22:21:47.395988+0000","last_undegraded":"2023-09-30T22:21:47.395988+0000","last_fullsized":"2023-09-30T22:21:47.395988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395675+0000","last_change":"2023-09-30T22:19:33.647352+0000","last_active":"2023-09-30T22:21:47.395675+0000","last_peered":"2023-09-30T22:21:47.395675+0000","last_clean":"2023-09-30T22:21:47.395675+0000","last_became_active":"2023-09-30T22:19:33.647023+0000","last_became_peered":"2023-09-30T22:19:33.647023+0000","last_unstale":"2023-09-30T22:21:47.395675+0000","last_undegraded":"2023-09-30T22:21:47.395675+0000","last_fullsized":"2023-09-30T22:21:47.395675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395145+0000","last_change":"2023-09-30T22:19:33.645394+0000","last_active":"2023-09-30T22:21:47.395145+0000","last_peered":"2023-09-30T22:21:47.395145+0000","last_clean":"2023-09-30T22:21:47.395145+0000","last_became_active":"2023-09-30T22:19:33.645211+0000","last_became_peered":"2023-09-30T22:19:33.645211+0000","last_unstale":"2023-09-30T22:21:47.395145+0000","last_undegraded":"2023-09-30T22:21:47.395145+0000","last_fullsized":"2023-09-30T22:21:47.395145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394735+0000","last_change":"2023-09-30T22:19:33.651418+0000","last_active":"2023-09-30T22:21:47.394735+0000","last_peered":"2023-09-30T22:21:47.394735+0000","last_clean":"2023-09-30T22:21:47.394735+0000","last_became_active":"2023-09-30T22:19:33.651174+0000","last_became_peered":"2023-09-30T22:19:33.651174+0000","last_unstale":"2023-09-30T22:21:47.394735+0000","last_undegraded":"2023-09-30T22:21:47.394735+0000","last_fullsized":"2023-09-30T22:21:47.394735+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178180+0000","last_change":"2023-09-30T22:19:33.671906+0000","last_active":"2023-09-30T22:21:47.178180+0000","last_peered":"2023-09-30T22:21:47.178180+0000","last_clean":"2023-09-30T22:21:47.178180+0000","last_became_active":"2023-09-30T22:19:33.671528+0000","last_became_peered":"2023-09-30T22:19:33.671528+0000","last_unstale":"2023-09-30T22:21:47.178180+0000","last_undegraded":"2023-09-30T22:21:47.178180+0000","last_fullsized":"2023-09-30T22:21:47.178180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177670+0000","last_change":"2023-09-30T22:19:33.670986+0000","last_active":"2023-09-30T22:21:47.177670+0000","last_peered":"2023-09-30T22:21:47.177670+0000","last_clean":"2023-09-30T22:21:47.177670+0000","last_became_active":"2023-09-30T22:19:33.670689+0000","last_became_peered":"2023-09-30T22:19:33.670689+0000","last_unstale":"2023-09-30T22:21:47.177670+0000","last_undegraded":"2023-09-30T22:21:47.177670+0000","last_fullsized":"2023-09-30T22:21:47.177670+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175437+0000","last_change":"2023-09-30T22:19:33.654626+0000","last_active":"2023-09-30T22:21:47.175437+0000","last_peered":"2023-09-30T22:21:47.175437+0000","last_clean":"2023-09-30T22:21:47.175437+0000","last_became_active":"2023-09-30T22:19:33.654358+0000","last_became_peered":"2023-09-30T22:19:33.654358+0000","last_unstale":"2023-09-30T22:21:47.175437+0000","last_undegraded":"2023-09-30T22:21:47.175437+0000","last_fullsized":"2023-09-30T22:21:47.175437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398919+0000","last_change":"2023-09-30T22:19:33.648775+0000","last_active":"2023-09-30T22:21:47.398919+0000","last_peered":"2023-09-30T22:21:47.398919+0000","last_clean":"2023-09-30T22:21:47.398919+0000","last_became_active":"2023-09-30T22:19:33.648386+0000","last_became_peered":"2023-09-30T22:19:33.648386+0000","last_unstale":"2023-09-30T22:21:47.398919+0000","last_undegraded":"2023-09-30T22:21:47.398919+0000","last_fullsized":"2023-09-30T22:21:47.398919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176383+0000","last_change":"2023-09-30T22:19:33.667764+0000","last_active":"2023-09-30T22:21:47.176383+0000","last_peered":"2023-09-30T22:21:47.176383+0000","last_clean":"2023-09-30T22:21:47.176383+0000","last_became_active":"2023-09-30T22:19:33.667514+0000","last_became_peered":"2023-09-30T22:19:33.667514+0000","last_unstale":"2023-09-30T22:21:47.176383+0000","last_undegraded":"2023-09-30T22:21:47.176383+0000","last_fullsized":"2023-09-30T22:21:47.176383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176184+0000","last_change":"2023-09-30T22:19:33.657292+0000","last_active":"2023-09-30T22:21:47.176184+0000","last_peered":"2023-09-30T22:21:47.176184+0000","last_clean":"2023-09-30T22:21:47.176184+0000","last_became_active":"2023-09-30T22:19:33.656706+0000","last_became_peered":"2023-09-30T22:19:33.656706+0000","last_unstale":"2023-09-30T22:21:47.176184+0000","last_undegraded":"2023-09-30T22:21:47.176184+0000","last_fullsized":"2023-09-30T22:21:47.176184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395324+0000","last_change":"2023-09-30T22:19:33.658823+0000","last_active":"2023-09-30T22:21:47.395324+0000","last_peered":"2023-09-30T22:21:47.395324+0000","last_clean":"2023-09-30T22:21:47.395324+0000","last_became_active":"2023-09-30T22:19:33.658537+0000","last_became_peered":"2023-09-30T22:19:33.658537+0000","last_unstale":"2023-09-30T22:21:47.395324+0000","last_undegraded":"2023-09-30T22:21:47.395324+0000","last_fullsized":"2023-09-30T22:21:47.395324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394829+0000","last_change":"2023-09-30T22:20:24.853848+0000","last_active":"2023-09-30T22:21:47.394829+0000","last_peered":"2023-09-30T22:21:47.394829+0000","last_clean":"2023-09-30T22:21:47.394829+0000","last_became_active":"2023-09-30T22:20:24.853654+0000","last_became_peered":"2023-09-30T22:20:24.853654+0000","last_unstale":"2023-09-30T22:21:47.394829+0000","last_undegraded":"2023-09-30T22:21:47.394829+0000","last_fullsized":"2023-09-30T22:21:47.394829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176633+0000","last_change":"2023-09-30T22:19:33.652240+0000","last_active":"2023-09-30T22:21:47.176633+0000","last_peered":"2023-09-30T22:21:47.176633+0000","last_clean":"2023-09-30T22:21:47.176633+0000","last_became_active":"2023-09-30T22:19:33.651971+0000","last_became_peered":"2023-09-30T22:19:33.651971+0000","last_unstale":"2023-09-30T22:21:47.176633+0000","last_undegraded":"2023-09-30T22:21:47.176633+0000","last_fullsized":"2023-09-30T22:21:47.176633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394162+0000","last_change":"2023-09-30T22:19:33.645322+0000","last_active":"2023-09-30T22:21:47.394162+0000","last_peered":"2023-09-30T22:21:47.394162+0000","last_clean":"2023-09-30T22:21:47.394162+0000","last_became_active":"2023-09-30T22:19:33.645012+0000","last_became_peered":"2023-09-30T22:19:33.645012+0000","last_unstale":"2023-09-30T22:21:47.394162+0000","last_undegraded":"2023-09-30T22:21:47.394162+0000","last_fullsized":"2023-09-30T22:21:47.394162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.393849+0000","last_change":"2023-09-30T22:20:24.853370+0000","last_active":"2023-09-30T22:21:47.393849+0000","last_peered":"2023-09-30T22:21:47.393849+0000","last_clean":"2023-09-30T22:21:47.393849+0000","last_became_active":"2023-09-30T22:20:24.853088+0000","last_became_peered":"2023-09-30T22:20:24.853088+0000","last_unstale":"2023-09-30T22:21:47.393849+0000","last_undegraded":"2023-09-30T22:21:47.393849+0000","last_fullsized":"2023-09-30T22:21:47.393849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398849+0000","last_change":"2023-09-30T22:19:33.648614+0000","last_active":"2023-09-30T22:21:47.398849+0000","last_peered":"2023-09-30T22:21:47.398849+0000","last_clean":"2023-09-30T22:21:47.398849+0000","last_became_active":"2023-09-30T22:19:33.648081+0000","last_became_peered":"2023-09-30T22:19:33.648081+0000","last_unstale":"2023-09-30T22:21:47.398849+0000","last_undegraded":"2023-09-30T22:21:47.398849+0000","last_fullsized":"2023-09-30T22:21:47.398849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395846+0000","last_change":"2023-09-30T22:19:33.639423+0000","last_active":"2023-09-30T22:21:47.395846+0000","last_peered":"2023-09-30T22:21:47.395846+0000","last_clean":"2023-09-30T22:21:47.395846+0000","last_became_active":"2023-09-30T22:19:33.639112+0000","last_became_peered":"2023-09-30T22:19:33.639112+0000","last_unstale":"2023-09-30T22:21:47.395846+0000","last_undegraded":"2023-09-30T22:21:47.395846+0000","last_fullsized":"2023-09-30T22:21:47.395846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395537+0000","last_change":"2023-09-30T22:19:33.658136+0000","last_active":"2023-09-30T22:21:47.395537+0000","last_peered":"2023-09-30T22:21:47.395537+0000","last_clean":"2023-09-30T22:21:47.395537+0000","last_became_active":"2023-09-30T22:19:33.657838+0000","last_became_peered":"2023-09-30T22:19:33.657838+0000","last_unstale":"2023-09-30T22:21:47.395537+0000","last_undegraded":"2023-09-30T22:21:47.395537+0000","last_fullsized":"2023-09-30T22:21:47.395537+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176273+0000","last_change":"2023-09-30T22:19:33.650438+0000","last_active":"2023-09-30T22:21:47.176273+0000","last_peered":"2023-09-30T22:21:47.176273+0000","last_clean":"2023-09-30T22:21:47.176273+0000","last_became_active":"2023-09-30T22:19:33.650186+0000","last_became_peered":"2023-09-30T22:19:33.650186+0000","last_unstale":"2023-09-30T22:21:47.176273+0000","last_undegraded":"2023-09-30T22:21:47.176273+0000","last_fullsized":"2023-09-30T22:21:47.176273+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175951+0000","last_change":"2023-09-30T22:19:33.663045+0000","last_active":"2023-09-30T22:21:47.175951+0000","last_peered":"2023-09-30T22:21:47.175951+0000","last_clean":"2023-09-30T22:21:47.175951+0000","last_became_active":"2023-09-30T22:19:33.662782+0000","last_became_peered":"2023-09-30T22:19:33.662782+0000","last_unstale":"2023-09-30T22:21:47.175951+0000","last_undegraded":"2023-09-30T22:21:47.175951+0000","last_fullsized":"2023-09-30T22:21:47.175951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394361+0000","last_change":"2023-09-30T22:19:33.645247+0000","last_active":"2023-09-30T22:21:47.394361+0000","last_peered":"2023-09-30T22:21:47.394361+0000","last_clean":"2023-09-30T22:21:47.394361+0000","last_became_active":"2023-09-30T22:19:33.644963+0000","last_became_peered":"2023-09-30T22:19:33.644963+0000","last_unstale":"2023-09-30T22:21:47.394361+0000","last_undegraded":"2023-09-30T22:21:47.394361+0000","last_fullsized":"2023-09-30T22:21:47.394361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177649+0000","last_change":"2023-09-30T22:19:33.662935+0000","last_active":"2023-09-30T22:21:47.177649+0000","last_peered":"2023-09-30T22:21:47.177649+0000","last_clean":"2023-09-30T22:21:47.177649+0000","last_became_active":"2023-09-30T22:19:33.662255+0000","last_became_peered":"2023-09-30T22:19:33.662255+0000","last_unstale":"2023-09-30T22:21:47.177649+0000","last_undegraded":"2023-09-30T22:21:47.177649+0000","last_fullsized":"2023-09-30T22:21:47.177649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175503+0000","last_change":"2023-09-30T22:19:33.652392+0000","last_active":"2023-09-30T22:21:47.175503+0000","last_peered":"2023-09-30T22:21:47.175503+0000","last_clean":"2023-09-30T22:21:47.175503+0000","last_became_active":"2023-09-30T22:19:33.652097+0000","last_became_peered":"2023-09-30T22:19:33.652097+0000","last_unstale":"2023-09-30T22:21:47.175503+0000","last_undegraded":"2023-09-30T22:21:47.175503+0000","last_fullsized":"2023-09-30T22:21:47.175503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176485+0000","last_change":"2023-09-30T22:19:33.649799+0000","last_active":"2023-09-30T22:21:47.176485+0000","last_peered":"2023-09-30T22:21:47.176485+0000","last_clean":"2023-09-30T22:21:47.176485+0000","last_became_active":"2023-09-30T22:19:33.649512+0000","last_became_peered":"2023-09-30T22:19:33.649512+0000","last_unstale":"2023-09-30T22:21:47.176485+0000","last_undegraded":"2023-09-30T22:21:47.176485+0000","last_fullsized":"2023-09-30T22:21:47.176485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176344+0000","last_change":"2023-09-30T22:19:33.653148+0000","last_active":"2023-09-30T22:21:47.176344+0000","last_peered":"2023-09-30T22:21:47.176344+0000","last_clean":"2023-09-30T22:21:47.176344+0000","last_became_active":"2023-09-30T22:19:33.652806+0000","last_became_peered":"2023-09-30T22:19:33.652806+0000","last_unstale":"2023-09-30T22:21:47.176344+0000","last_undegraded":"2023-09-30T22:21:47.176344+0000","last_fullsized":"2023-09-30T22:21:47.176344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177883+0000","last_change":"2023-09-30T22:19:33.673663+0000","last_active":"2023-09-30T22:21:47.177883+0000","last_peered":"2023-09-30T22:21:47.177883+0000","last_clean":"2023-09-30T22:21:47.177883+0000","last_became_active":"2023-09-30T22:19:33.673128+0000","last_became_peered":"2023-09-30T22:19:33.673128+0000","last_unstale":"2023-09-30T22:21:47.177883+0000","last_undegraded":"2023-09-30T22:21:47.177883+0000","last_fullsized":"2023-09-30T22:21:47.177883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175833+0000","last_change":"2023-09-30T22:19:33.280425+0000","last_active":"2023-09-30T22:21:47.175833+0000","last_peered":"2023-09-30T22:21:47.175833+0000","last_clean":"2023-09-30T22:21:47.175833+0000","last_became_active":"2023-09-30T22:19:33.280161+0000","last_became_peered":"2023-09-30T22:19:33.280161+0000","last_unstale":"2023-09-30T22:21:47.175833+0000","last_undegraded":"2023-09-30T22:21:47.175833+0000","last_fullsized":"2023-09-30T22:21:47.175833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177943+0000","last_change":"2023-09-30T22:19:33.670909+0000","last_active":"2023-09-30T22:21:47.177943+0000","last_peered":"2023-09-30T22:21:47.177943+0000","last_clean":"2023-09-30T22:21:47.177943+0000","last_became_active":"2023-09-30T22:19:33.670616+0000","last_became_peered":"2023-09-30T22:19:33.670616+0000","last_unstale":"2023-09-30T22:21:47.177943+0000","last_undegraded":"2023-09-30T22:21:47.177943+0000","last_fullsized":"2023-09-30T22:21:47.177943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175634+0000","last_change":"2023-09-30T22:19:33.284384+0000","last_active":"2023-09-30T22:21:47.175634+0000","last_peered":"2023-09-30T22:21:47.175634+0000","last_clean":"2023-09-30T22:21:47.175634+0000","last_became_active":"2023-09-30T22:19:33.284138+0000","last_became_peered":"2023-09-30T22:19:33.284138+0000","last_unstale":"2023-09-30T22:21:47.175634+0000","last_undegraded":"2023-09-30T22:21:47.175634+0000","last_fullsized":"2023-09-30T22:21:47.175634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395988+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:21:47.395988+0000","last_peered":"2023-09-30T22:21:47.395988+0000","last_clean":"2023-09-30T22:21:47.395988+0000","last_became_active":"2023-09-30T22:19:33.646355+0000","last_became_peered":"2023-09-30T22:19:33.646355+0000","last_unstale":"2023-09-30T22:21:47.395988+0000","last_undegraded":"2023-09-30T22:21:47.395988+0000","last_fullsized":"2023-09-30T22:21:47.395988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177655+0000","last_change":"2023-09-30T22:19:33.289402+0000","last_active":"2023-09-30T22:21:47.177655+0000","last_peered":"2023-09-30T22:21:47.177655+0000","last_clean":"2023-09-30T22:21:47.177655+0000","last_became_active":"2023-09-30T22:19:33.288979+0000","last_became_peered":"2023-09-30T22:19:33.288979+0000","last_unstale":"2023-09-30T22:21:47.177655+0000","last_undegraded":"2023-09-30T22:21:47.177655+0000","last_fullsized":"2023-09-30T22:21:47.177655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178977+0000","last_change":"2023-09-30T22:19:33.672854+0000","last_active":"2023-09-30T22:21:47.178977+0000","last_peered":"2023-09-30T22:21:47.178977+0000","last_clean":"2023-09-30T22:21:47.178977+0000","last_became_active":"2023-09-30T22:19:33.672539+0000","last_became_peered":"2023-09-30T22:19:33.672539+0000","last_unstale":"2023-09-30T22:21:47.178977+0000","last_undegraded":"2023-09-30T22:21:47.178977+0000","last_fullsized":"2023-09-30T22:21:47.178977+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398706+0000","last_change":"2023-09-30T22:19:33.294805+0000","last_active":"2023-09-30T22:21:47.398706+0000","last_peered":"2023-09-30T22:21:47.398706+0000","last_clean":"2023-09-30T22:21:47.398706+0000","last_became_active":"2023-09-30T22:19:33.294520+0000","last_became_peered":"2023-09-30T22:19:33.294520+0000","last_unstale":"2023-09-30T22:21:47.398706+0000","last_undegraded":"2023-09-30T22:21:47.398706+0000","last_fullsized":"2023-09-30T22:21:47.398706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177734+0000","last_change":"2023-09-30T22:19:33.660684+0000","last_active":"2023-09-30T22:21:47.177734+0000","last_peered":"2023-09-30T22:21:47.177734+0000","last_clean":"2023-09-30T22:21:47.177734+0000","last_became_active":"2023-09-30T22:19:33.660143+0000","last_became_peered":"2023-09-30T22:19:33.660143+0000","last_unstale":"2023-09-30T22:21:47.177734+0000","last_undegraded":"2023-09-30T22:21:47.177734+0000","last_fullsized":"2023-09-30T22:21:47.177734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395747+0000","last_change":"2023-09-30T22:19:33.279060+0000","last_active":"2023-09-30T22:21:47.395747+0000","last_peered":"2023-09-30T22:21:47.395747+0000","last_clean":"2023-09-30T22:21:47.395747+0000","last_became_active":"2023-09-30T22:19:33.278776+0000","last_became_peered":"2023-09-30T22:19:33.278776+0000","last_unstale":"2023-09-30T22:21:47.395747+0000","last_undegraded":"2023-09-30T22:21:47.395747+0000","last_fullsized":"2023-09-30T22:21:47.395747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177885+0000","last_change":"2023-09-30T22:19:33.662982+0000","last_active":"2023-09-30T22:21:47.177885+0000","last_peered":"2023-09-30T22:21:47.177885+0000","last_clean":"2023-09-30T22:21:47.177885+0000","last_became_active":"2023-09-30T22:19:33.662668+0000","last_became_peered":"2023-09-30T22:19:33.662668+0000","last_unstale":"2023-09-30T22:21:47.177885+0000","last_undegraded":"2023-09-30T22:21:47.177885+0000","last_fullsized":"2023-09-30T22:21:47.177885+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395605+0000","last_change":"2023-09-30T22:19:33.288428+0000","last_active":"2023-09-30T22:21:47.395605+0000","last_peered":"2023-09-30T22:21:47.395605+0000","last_clean":"2023-09-30T22:21:47.395605+0000","last_became_active":"2023-09-30T22:19:33.287975+0000","last_became_peered":"2023-09-30T22:19:33.287975+0000","last_unstale":"2023-09-30T22:21:47.395605+0000","last_undegraded":"2023-09-30T22:21:47.395605+0000","last_fullsized":"2023-09-30T22:21:47.395605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175933+0000","last_change":"2023-09-30T22:19:33.662645+0000","last_active":"2023-09-30T22:21:47.175933+0000","last_peered":"2023-09-30T22:21:47.175933+0000","last_clean":"2023-09-30T22:21:47.175933+0000","last_became_active":"2023-09-30T22:19:33.662371+0000","last_became_peered":"2023-09-30T22:19:33.662371+0000","last_unstale":"2023-09-30T22:21:47.175933+0000","last_undegraded":"2023-09-30T22:21:47.175933+0000","last_fullsized":"2023-09-30T22:21:47.175933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":27,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-09-30T22:21:52.020617+0000","last_change":"2023-09-30T22:19:33.289061+0000","last_active":"2023-09-30T22:21:52.020617+0000","last_peered":"2023-09-30T22:21:52.020617+0000","last_clean":"2023-09-30T22:21:52.020617+0000","last_became_active":"2023-09-30T22:19:33.288656+0000","last_became_peered":"2023-09-30T22:19:33.288656+0000","last_unstale":"2023-09-30T22:21:52.020617+0000","last_undegraded":"2023-09-30T22:21:52.020617+0000","last_fullsized":"2023-09-30T22:21:52.020617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394998+0000","last_change":"2023-09-30T22:19:33.665863+0000","last_active":"2023-09-30T22:21:47.394998+0000","last_peered":"2023-09-30T22:21:47.394998+0000","last_clean":"2023-09-30T22:21:47.394998+0000","last_became_active":"2023-09-30T22:19:33.665570+0000","last_became_peered":"2023-09-30T22:19:33.665570+0000","last_unstale":"2023-09-30T22:21:47.394998+0000","last_undegraded":"2023-09-30T22:21:47.394998+0000","last_fullsized":"2023-09-30T22:21:47.394998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178430+0000","last_change":"2023-09-30T22:19:33.296210+0000","last_active":"2023-09-30T22:21:47.178430+0000","last_peered":"2023-09-30T22:21:47.178430+0000","last_clean":"2023-09-30T22:21:47.178430+0000","last_became_active":"2023-09-30T22:19:33.295952+0000","last_became_peered":"2023-09-30T22:19:33.295952+0000","last_unstale":"2023-09-30T22:21:47.178430+0000","last_undegraded":"2023-09-30T22:21:47.178430+0000","last_fullsized":"2023-09-30T22:21:47.178430+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178627+0000","last_change":"2023-09-30T22:19:33.670730+0000","last_active":"2023-09-30T22:21:47.178627+0000","last_peered":"2023-09-30T22:21:47.178627+0000","last_clean":"2023-09-30T22:21:47.178627+0000","last_became_active":"2023-09-30T22:19:33.670520+0000","last_became_peered":"2023-09-30T22:19:33.670520+0000","last_unstale":"2023-09-30T22:21:47.178627+0000","last_undegraded":"2023-09-30T22:21:47.178627+0000","last_fullsized":"2023-09-30T22:21:47.178627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394428+0000","last_change":"2023-09-30T22:19:33.293117+0000","last_active":"2023-09-30T22:21:47.394428+0000","last_peered":"2023-09-30T22:21:47.394428+0000","last_clean":"2023-09-30T22:21:47.394428+0000","last_became_active":"2023-09-30T22:19:33.288262+0000","last_became_peered":"2023-09-30T22:19:33.288262+0000","last_unstale":"2023-09-30T22:21:47.394428+0000","last_undegraded":"2023-09-30T22:21:47.394428+0000","last_fullsized":"2023-09-30T22:21:47.394428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395403+0000","last_change":"2023-09-30T22:20:24.853785+0000","last_active":"2023-09-30T22:21:47.395403+0000","last_peered":"2023-09-30T22:21:47.395403+0000","last_clean":"2023-09-30T22:21:47.395403+0000","last_became_active":"2023-09-30T22:20:24.853462+0000","last_became_peered":"2023-09-30T22:20:24.853462+0000","last_unstale":"2023-09-30T22:21:47.395403+0000","last_undegraded":"2023-09-30T22:21:47.395403+0000","last_fullsized":"2023-09-30T22:21:47.395403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177841+0000","last_change":"2023-09-30T22:19:33.288441+0000","last_active":"2023-09-30T22:21:47.177841+0000","last_peered":"2023-09-30T22:21:47.177841+0000","last_clean":"2023-09-30T22:21:47.177841+0000","last_became_active":"2023-09-30T22:19:33.288030+0000","last_became_peered":"2023-09-30T22:19:33.288030+0000","last_unstale":"2023-09-30T22:21:47.177841+0000","last_undegraded":"2023-09-30T22:21:47.177841+0000","last_fullsized":"2023-09-30T22:21:47.177841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.396098+0000","last_change":"2023-09-30T22:20:24.855658+0000","last_active":"2023-09-30T22:21:47.396098+0000","last_peered":"2023-09-30T22:21:47.396098+0000","last_clean":"2023-09-30T22:21:47.396098+0000","last_became_active":"2023-09-30T22:20:24.855380+0000","last_became_peered":"2023-09-30T22:20:24.855380+0000","last_unstale":"2023-09-30T22:21:47.396098+0000","last_undegraded":"2023-09-30T22:21:47.396098+0000","last_fullsized":"2023-09-30T22:21:47.396098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175672+0000","last_change":"2023-09-30T22:19:33.283730+0000","last_active":"2023-09-30T22:21:47.175672+0000","last_peered":"2023-09-30T22:21:47.175672+0000","last_clean":"2023-09-30T22:21:47.175672+0000","last_became_active":"2023-09-30T22:19:33.282944+0000","last_became_peered":"2023-09-30T22:19:33.282944+0000","last_unstale":"2023-09-30T22:21:47.175672+0000","last_undegraded":"2023-09-30T22:21:47.175672+0000","last_fullsized":"2023-09-30T22:21:47.175672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178933+0000","last_change":"2023-09-30T22:19:33.672354+0000","last_active":"2023-09-30T22:21:47.178933+0000","last_peered":"2023-09-30T22:21:47.178933+0000","last_clean":"2023-09-30T22:21:47.178933+0000","last_became_active":"2023-09-30T22:19:33.672110+0000","last_became_peered":"2023-09-30T22:19:33.672110+0000","last_unstale":"2023-09-30T22:21:47.178933+0000","last_undegraded":"2023-09-30T22:21:47.178933+0000","last_fullsized":"2023-09-30T22:21:47.178933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398537+0000","last_change":"2023-09-30T22:19:33.293023+0000","last_active":"2023-09-30T22:21:47.398537+0000","last_peered":"2023-09-30T22:21:47.398537+0000","last_clean":"2023-09-30T22:21:47.398537+0000","last_became_active":"2023-09-30T22:19:33.288365+0000","last_became_peered":"2023-09-30T22:19:33.288365+0000","last_unstale":"2023-09-30T22:21:47.398537+0000","last_undegraded":"2023-09-30T22:21:47.398537+0000","last_fullsized":"2023-09-30T22:21:47.398537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178098+0000","last_change":"2023-09-30T22:19:33.661497+0000","last_active":"2023-09-30T22:21:47.178098+0000","last_peered":"2023-09-30T22:21:47.178098+0000","last_clean":"2023-09-30T22:21:47.178098+0000","last_became_active":"2023-09-30T22:19:33.660436+0000","last_became_peered":"2023-09-30T22:19:33.660436+0000","last_unstale":"2023-09-30T22:21:47.178098+0000","last_undegraded":"2023-09-30T22:21:47.178098+0000","last_fullsized":"2023-09-30T22:21:47.178098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395831+0000","last_change":"2023-09-30T22:19:33.288413+0000","last_active":"2023-09-30T22:21:47.395831+0000","last_peered":"2023-09-30T22:21:47.395831+0000","last_clean":"2023-09-30T22:21:47.395831+0000","last_became_active":"2023-09-30T22:19:33.288151+0000","last_became_peered":"2023-09-30T22:19:33.288151+0000","last_unstale":"2023-09-30T22:21:47.395831+0000","last_undegraded":"2023-09-30T22:21:47.395831+0000","last_fullsized":"2023-09-30T22:21:47.395831+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175715+0000","last_change":"2023-09-30T22:19:33.662546+0000","last_active":"2023-09-30T22:21:47.175715+0000","last_peered":"2023-09-30T22:21:47.175715+0000","last_clean":"2023-09-30T22:21:47.175715+0000","last_became_active":"2023-09-30T22:19:33.662214+0000","last_became_peered":"2023-09-30T22:19:33.662214+0000","last_unstale":"2023-09-30T22:21:47.175715+0000","last_undegraded":"2023-09-30T22:21:47.175715+0000","last_fullsized":"2023-09-30T22:21:47.175715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178063+0000","last_change":"2023-09-30T22:19:33.291431+0000","last_active":"2023-09-30T22:21:47.178063+0000","last_peered":"2023-09-30T22:21:47.178063+0000","last_clean":"2023-09-30T22:21:47.178063+0000","last_became_active":"2023-09-30T22:19:33.290697+0000","last_became_peered":"2023-09-30T22:19:33.290697+0000","last_unstale":"2023-09-30T22:21:47.178063+0000","last_undegraded":"2023-09-30T22:21:47.178063+0000","last_fullsized":"2023-09-30T22:21:47.178063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394474+0000","last_change":"2023-09-30T22:20:24.853738+0000","last_active":"2023-09-30T22:21:47.394474+0000","last_peered":"2023-09-30T22:21:47.394474+0000","last_clean":"2023-09-30T22:21:47.394474+0000","last_became_active":"2023-09-30T22:20:24.853452+0000","last_became_peered":"2023-09-30T22:20:24.853452+0000","last_unstale":"2023-09-30T22:21:47.394474+0000","last_undegraded":"2023-09-30T22:21:47.394474+0000","last_fullsized":"2023-09-30T22:21:47.394474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395325+0000","last_change":"2023-09-30T22:19:33.286077+0000","last_active":"2023-09-30T22:21:47.395325+0000","last_peered":"2023-09-30T22:21:47.395325+0000","last_clean":"2023-09-30T22:21:47.395325+0000","last_became_active":"2023-09-30T22:19:33.279026+0000","last_became_peered":"2023-09-30T22:19:33.279026+0000","last_unstale":"2023-09-30T22:21:47.395325+0000","last_undegraded":"2023-09-30T22:21:47.395325+0000","last_fullsized":"2023-09-30T22:21:47.395325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395009+0000","last_change":"2023-09-30T22:19:33.647993+0000","last_active":"2023-09-30T22:21:47.395009+0000","last_peered":"2023-09-30T22:21:47.395009+0000","last_clean":"2023-09-30T22:21:47.395009+0000","last_became_active":"2023-09-30T22:19:33.647725+0000","last_became_peered":"2023-09-30T22:19:33.647725+0000","last_unstale":"2023-09-30T22:21:47.395009+0000","last_undegraded":"2023-09-30T22:21:47.395009+0000","last_fullsized":"2023-09-30T22:21:47.395009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178283+0000","last_change":"2023-09-30T22:19:33.296389+0000","last_active":"2023-09-30T22:21:47.178283+0000","last_peered":"2023-09-30T22:21:47.178283+0000","last_clean":"2023-09-30T22:21:47.178283+0000","last_became_active":"2023-09-30T22:19:33.296134+0000","last_became_peered":"2023-09-30T22:19:33.296134+0000","last_unstale":"2023-09-30T22:21:47.178283+0000","last_undegraded":"2023-09-30T22:21:47.178283+0000","last_fullsized":"2023-09-30T22:21:47.178283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395258+0000","last_change":"2023-09-30T22:19:33.646770+0000","last_active":"2023-09-30T22:21:47.395258+0000","last_peered":"2023-09-30T22:21:47.395258+0000","last_clean":"2023-09-30T22:21:47.395258+0000","last_became_active":"2023-09-30T22:19:33.646503+0000","last_became_peered":"2023-09-30T22:19:33.646503+0000","last_unstale":"2023-09-30T22:21:47.395258+0000","last_undegraded":"2023-09-30T22:21:47.395258+0000","last_fullsized":"2023-09-30T22:21:47.395258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178101+0000","last_change":"2023-09-30T22:19:33.287703+0000","last_active":"2023-09-30T22:21:47.178101+0000","last_peered":"2023-09-30T22:21:47.178101+0000","last_clean":"2023-09-30T22:21:47.178101+0000","last_became_active":"2023-09-30T22:19:33.287403+0000","last_became_peered":"2023-09-30T22:19:33.287403+0000","last_unstale":"2023-09-30T22:21:47.178101+0000","last_undegraded":"2023-09-30T22:21:47.178101+0000","last_fullsized":"2023-09-30T22:21:47.178101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177963+0000","last_change":"2023-09-30T22:19:33.672679+0000","last_active":"2023-09-30T22:21:47.177963+0000","last_peered":"2023-09-30T22:21:47.177963+0000","last_clean":"2023-09-30T22:21:47.177963+0000","last_became_active":"2023-09-30T22:19:33.671069+0000","last_became_peered":"2023-09-30T22:19:33.671069+0000","last_unstale":"2023-09-30T22:21:47.177963+0000","last_undegraded":"2023-09-30T22:21:47.177963+0000","last_fullsized":"2023-09-30T22:21:47.177963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177735+0000","last_change":"2023-09-30T22:19:33.288281+0000","last_active":"2023-09-30T22:21:47.177735+0000","last_peered":"2023-09-30T22:21:47.177735+0000","last_clean":"2023-09-30T22:21:47.177735+0000","last_became_active":"2023-09-30T22:19:33.287697+0000","last_became_peered":"2023-09-30T22:19:33.287697+0000","last_unstale":"2023-09-30T22:21:47.177735+0000","last_undegraded":"2023-09-30T22:21:47.177735+0000","last_fullsized":"2023-09-30T22:21:47.177735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395908+0000","last_change":"2023-09-30T22:19:33.666225+0000","last_active":"2023-09-30T22:21:47.395908+0000","last_peered":"2023-09-30T22:21:47.395908+0000","last_clean":"2023-09-30T22:21:47.395908+0000","last_became_active":"2023-09-30T22:19:33.665223+0000","last_became_peered":"2023-09-30T22:19:33.665223+0000","last_unstale":"2023-09-30T22:21:47.395908+0000","last_undegraded":"2023-09-30T22:21:47.395908+0000","last_fullsized":"2023-09-30T22:21:47.395908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177493+0000","last_change":"2023-09-30T22:19:33.289238+0000","last_active":"2023-09-30T22:21:47.177493+0000","last_peered":"2023-09-30T22:21:47.177493+0000","last_clean":"2023-09-30T22:21:47.177493+0000","last_became_active":"2023-09-30T22:19:33.288633+0000","last_became_peered":"2023-09-30T22:19:33.288633+0000","last_unstale":"2023-09-30T22:21:47.177493+0000","last_undegraded":"2023-09-30T22:21:47.177493+0000","last_fullsized":"2023-09-30T22:21:47.177493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176523+0000","last_change":"2023-09-30T22:19:33.649869+0000","last_active":"2023-09-30T22:21:47.176523+0000","last_peered":"2023-09-30T22:21:47.176523+0000","last_clean":"2023-09-30T22:21:47.176523+0000","last_became_active":"2023-09-30T22:19:33.649582+0000","last_became_peered":"2023-09-30T22:19:33.649582+0000","last_unstale":"2023-09-30T22:21:47.176523+0000","last_undegraded":"2023-09-30T22:21:47.176523+0000","last_fullsized":"2023-09-30T22:21:47.176523+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176230+0000","last_change":"2023-09-30T22:19:30.188504+0000","last_active":"2023-09-30T22:21:47.176230+0000","last_peered":"2023-09-30T22:21:47.176230+0000","last_clean":"2023-09-30T22:21:47.176230+0000","last_became_active":"2023-09-30T22:19:30.188218+0000","last_became_peered":"2023-09-30T22:19:30.188218+0000","last_unstale":"2023-09-30T22:21:47.176230+0000","last_undegraded":"2023-09-30T22:21:47.176230+0000","last_fullsized":"2023-09-30T22:21:47.176230+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395472+0000","last_change":"2023-09-30T22:19:33.282597+0000","last_active":"2023-09-30T22:21:47.395472+0000","last_peered":"2023-09-30T22:21:47.395472+0000","last_clean":"2023-09-30T22:21:47.395472+0000","last_became_active":"2023-09-30T22:19:33.280396+0000","last_became_peered":"2023-09-30T22:19:33.280396+0000","last_unstale":"2023-09-30T22:21:47.395472+0000","last_undegraded":"2023-09-30T22:21:47.395472+0000","last_fullsized":"2023-09-30T22:21:47.395472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175899+0000","last_change":"2023-09-30T22:20:24.855278+0000","last_active":"2023-09-30T22:21:47.175899+0000","last_peered":"2023-09-30T22:21:47.175899+0000","last_clean":"2023-09-30T22:21:47.175899+0000","last_became_active":"2023-09-30T22:20:24.854973+0000","last_became_peered":"2023-09-30T22:20:24.854973+0000","last_unstale":"2023-09-30T22:21:47.175899+0000","last_undegraded":"2023-09-30T22:21:47.175899+0000","last_fullsized":"2023-09-30T22:21:47.175899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178024+0000","last_change":"2023-09-30T22:19:29.250128+0000","last_active":"2023-09-30T22:21:47.178024+0000","last_peered":"2023-09-30T22:21:47.178024+0000","last_clean":"2023-09-30T22:21:47.178024+0000","last_became_active":"2023-09-30T22:19:29.249745+0000","last_became_peered":"2023-09-30T22:19:29.249745+0000","last_unstale":"2023-09-30T22:21:47.178024+0000","last_undegraded":"2023-09-30T22:21:47.178024+0000","last_fullsized":"2023-09-30T22:21:47.178024+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394802+0000","last_change":"2023-09-30T22:19:33.294524+0000","last_active":"2023-09-30T22:21:47.394802+0000","last_peered":"2023-09-30T22:21:47.394802+0000","last_clean":"2023-09-30T22:21:47.394802+0000","last_became_active":"2023-09-30T22:19:33.293937+0000","last_became_peered":"2023-09-30T22:19:33.293937+0000","last_unstale":"2023-09-30T22:21:47.394802+0000","last_undegraded":"2023-09-30T22:21:47.394802+0000","last_fullsized":"2023-09-30T22:21:47.394802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176113+0000","last_change":"2023-09-30T22:19:33.653434+0000","last_active":"2023-09-30T22:21:47.176113+0000","last_peered":"2023-09-30T22:21:47.176113+0000","last_clean":"2023-09-30T22:21:47.176113+0000","last_became_active":"2023-09-30T22:19:33.652629+0000","last_became_peered":"2023-09-30T22:19:33.652629+0000","last_unstale":"2023-09-30T22:21:47.176113+0000","last_undegraded":"2023-09-30T22:21:47.176113+0000","last_fullsized":"2023-09-30T22:21:47.176113+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394285+0000","last_change":"2023-09-30T22:19:29.249638+0000","last_active":"2023-09-30T22:21:47.394285+0000","last_peered":"2023-09-30T22:21:47.394285+0000","last_clean":"2023-09-30T22:21:47.394285+0000","last_became_active":"2023-09-30T22:19:29.249366+0000","last_became_peered":"2023-09-30T22:19:29.249366+0000","last_unstale":"2023-09-30T22:21:47.394285+0000","last_undegraded":"2023-09-30T22:21:47.394285+0000","last_fullsized":"2023-09-30T22:21:47.394285+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175615+0000","last_change":"2023-09-30T22:19:33.290330+0000","last_active":"2023-09-30T22:21:47.175615+0000","last_peered":"2023-09-30T22:21:47.175615+0000","last_clean":"2023-09-30T22:21:47.175615+0000","last_became_active":"2023-09-30T22:19:33.289841+0000","last_became_peered":"2023-09-30T22:19:33.289841+0000","last_unstale":"2023-09-30T22:21:47.175615+0000","last_undegraded":"2023-09-30T22:21:47.175615+0000","last_fullsized":"2023-09-30T22:21:47.175615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176600+0000","last_change":"2023-09-30T22:19:33.657019+0000","last_active":"2023-09-30T22:21:47.176600+0000","last_peered":"2023-09-30T22:21:47.176600+0000","last_clean":"2023-09-30T22:21:47.176600+0000","last_became_active":"2023-09-30T22:19:33.656759+0000","last_became_peered":"2023-09-30T22:19:33.656759+0000","last_unstale":"2023-09-30T22:21:47.176600+0000","last_undegraded":"2023-09-30T22:21:47.176600+0000","last_fullsized":"2023-09-30T22:21:47.176600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178354+0000","last_change":"2023-09-30T22:19:29.249647+0000","last_active":"2023-09-30T22:21:47.178354+0000","last_peered":"2023-09-30T22:21:47.178354+0000","last_clean":"2023-09-30T22:21:47.178354+0000","last_became_active":"2023-09-30T22:19:29.249371+0000","last_became_peered":"2023-09-30T22:19:29.249371+0000","last_unstale":"2023-09-30T22:21:47.178354+0000","last_undegraded":"2023-09-30T22:21:47.178354+0000","last_fullsized":"2023-09-30T22:21:47.178354+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175534+0000","last_change":"2023-09-30T22:19:30.188360+0000","last_active":"2023-09-30T22:21:47.175534+0000","last_peered":"2023-09-30T22:21:47.175534+0000","last_clean":"2023-09-30T22:21:47.175534+0000","last_became_active":"2023-09-30T22:19:30.187849+0000","last_became_peered":"2023-09-30T22:19:30.187849+0000","last_unstale":"2023-09-30T22:21:47.175534+0000","last_undegraded":"2023-09-30T22:21:47.175534+0000","last_fullsized":"2023-09-30T22:21:47.175534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177719+0000","last_change":"2023-09-30T22:19:33.292032+0000","last_active":"2023-09-30T22:21:47.177719+0000","last_peered":"2023-09-30T22:21:47.177719+0000","last_clean":"2023-09-30T22:21:47.177719+0000","last_became_active":"2023-09-30T22:19:33.291755+0000","last_became_peered":"2023-09-30T22:19:33.291755+0000","last_unstale":"2023-09-30T22:21:47.177719+0000","last_undegraded":"2023-09-30T22:21:47.177719+0000","last_fullsized":"2023-09-30T22:21:47.177719+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178802+0000","last_change":"2023-09-30T22:19:33.674909+0000","last_active":"2023-09-30T22:21:47.178802+0000","last_peered":"2023-09-30T22:21:47.178802+0000","last_clean":"2023-09-30T22:21:47.178802+0000","last_became_active":"2023-09-30T22:19:33.674646+0000","last_became_peered":"2023-09-30T22:19:33.674646+0000","last_unstale":"2023-09-30T22:21:47.178802+0000","last_undegraded":"2023-09-30T22:21:47.178802+0000","last_fullsized":"2023-09-30T22:21:47.178802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177568+0000","last_change":"2023-09-30T22:19:29.250622+0000","last_active":"2023-09-30T22:21:47.177568+0000","last_peered":"2023-09-30T22:21:47.177568+0000","last_clean":"2023-09-30T22:21:47.177568+0000","last_became_active":"2023-09-30T22:19:29.250370+0000","last_became_peered":"2023-09-30T22:19:29.250370+0000","last_unstale":"2023-09-30T22:21:47.177568+0000","last_undegraded":"2023-09-30T22:21:47.177568+0000","last_fullsized":"2023-09-30T22:21:47.177568+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394234+0000","last_change":"2023-09-30T22:19:33.279290+0000","last_active":"2023-09-30T22:21:47.394234+0000","last_peered":"2023-09-30T22:21:47.394234+0000","last_clean":"2023-09-30T22:21:47.394234+0000","last_became_active":"2023-09-30T22:19:33.277328+0000","last_became_peered":"2023-09-30T22:19:33.277328+0000","last_unstale":"2023-09-30T22:21:47.394234+0000","last_undegraded":"2023-09-30T22:21:47.394234+0000","last_fullsized":"2023-09-30T22:21:47.394234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.399060+0000","last_change":"2023-09-30T22:19:33.646613+0000","last_active":"2023-09-30T22:21:47.399060+0000","last_peered":"2023-09-30T22:21:47.399060+0000","last_clean":"2023-09-30T22:21:47.399060+0000","last_became_active":"2023-09-30T22:19:33.646057+0000","last_became_peered":"2023-09-30T22:19:33.646057+0000","last_unstale":"2023-09-30T22:21:47.399060+0000","last_undegraded":"2023-09-30T22:21:47.399060+0000","last_fullsized":"2023-09-30T22:21:47.399060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178699+0000","last_change":"2023-09-30T22:19:30.188159+0000","last_active":"2023-09-30T22:21:47.178699+0000","last_peered":"2023-09-30T22:21:47.178699+0000","last_clean":"2023-09-30T22:21:47.178699+0000","last_became_active":"2023-09-30T22:19:30.187869+0000","last_became_peered":"2023-09-30T22:19:30.187869+0000","last_unstale":"2023-09-30T22:21:47.178699+0000","last_undegraded":"2023-09-30T22:21:47.178699+0000","last_fullsized":"2023-09-30T22:21:47.178699+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176060+0000","last_change":"2023-09-30T22:19:33.289031+0000","last_active":"2023-09-30T22:21:47.176060+0000","last_peered":"2023-09-30T22:21:47.176060+0000","last_clean":"2023-09-30T22:21:47.176060+0000","last_became_active":"2023-09-30T22:19:33.288758+0000","last_became_peered":"2023-09-30T22:19:33.288758+0000","last_unstale":"2023-09-30T22:21:47.176060+0000","last_undegraded":"2023-09-30T22:21:47.176060+0000","last_fullsized":"2023-09-30T22:21:47.176060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394943+0000","last_change":"2023-09-30T22:19:33.642133+0000","last_active":"2023-09-30T22:21:47.394943+0000","last_peered":"2023-09-30T22:21:47.394943+0000","last_clean":"2023-09-30T22:21:47.394943+0000","last_became_active":"2023-09-30T22:19:33.641852+0000","last_became_peered":"2023-09-30T22:19:33.641852+0000","last_unstale":"2023-09-30T22:21:47.394943+0000","last_undegraded":"2023-09-30T22:21:47.394943+0000","last_fullsized":"2023-09-30T22:21:47.394943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178887+0000","last_change":"2023-09-30T22:19:33.290927+0000","last_active":"2023-09-30T22:21:47.178887+0000","last_peered":"2023-09-30T22:21:47.178887+0000","last_clean":"2023-09-30T22:21:47.178887+0000","last_became_active":"2023-09-30T22:19:33.290662+0000","last_became_peered":"2023-09-30T22:19:33.290662+0000","last_unstale":"2023-09-30T22:21:47.178887+0000","last_undegraded":"2023-09-30T22:21:47.178887+0000","last_fullsized":"2023-09-30T22:21:47.178887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176287+0000","last_change":"2023-09-30T22:19:30.190576+0000","last_active":"2023-09-30T22:21:47.176287+0000","last_peered":"2023-09-30T22:21:47.176287+0000","last_clean":"2023-09-30T22:21:47.176287+0000","last_became_active":"2023-09-30T22:19:30.190289+0000","last_became_peered":"2023-09-30T22:19:30.190289+0000","last_unstale":"2023-09-30T22:21:47.176287+0000","last_undegraded":"2023-09-30T22:21:47.176287+0000","last_fullsized":"2023-09-30T22:21:47.176287+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177525+0000","last_change":"2023-09-30T22:20:24.855407+0000","last_active":"2023-09-30T22:21:47.177525+0000","last_peered":"2023-09-30T22:21:47.177525+0000","last_clean":"2023-09-30T22:21:47.177525+0000","last_became_active":"2023-09-30T22:20:24.855023+0000","last_became_peered":"2023-09-30T22:20:24.855023+0000","last_unstale":"2023-09-30T22:21:47.177525+0000","last_undegraded":"2023-09-30T22:21:47.177525+0000","last_fullsized":"2023-09-30T22:21:47.177525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178947+0000","last_change":"2023-09-30T22:19:30.188129+0000","last_active":"2023-09-30T22:21:47.178947+0000","last_peered":"2023-09-30T22:21:47.178947+0000","last_clean":"2023-09-30T22:21:47.178947+0000","last_became_active":"2023-09-30T22:19:30.187818+0000","last_became_peered":"2023-09-30T22:19:30.187818+0000","last_unstale":"2023-09-30T22:21:47.178947+0000","last_undegraded":"2023-09-30T22:21:47.178947+0000","last_fullsized":"2023-09-30T22:21:47.178947+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:28.227240+0000","last_clean_scrub_stamp":"2023-09-30T22:19:28.227240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395920+0000","last_change":"2023-09-30T22:19:33.296579+0000","last_active":"2023-09-30T22:21:47.395920+0000","last_peered":"2023-09-30T22:21:47.395920+0000","last_clean":"2023-09-30T22:21:47.395920+0000","last_became_active":"2023-09-30T22:19:33.295804+0000","last_became_peered":"2023-09-30T22:19:33.295804+0000","last_unstale":"2023-09-30T22:21:47.395920+0000","last_undegraded":"2023-09-30T22:21:47.395920+0000","last_fullsized":"2023-09-30T22:21:47.395920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394178+0000","last_change":"2023-09-30T22:19:33.642976+0000","last_active":"2023-09-30T22:21:47.394178+0000","last_peered":"2023-09-30T22:21:47.394178+0000","last_clean":"2023-09-30T22:21:47.394178+0000","last_became_active":"2023-09-30T22:19:33.642732+0000","last_became_peered":"2023-09-30T22:19:33.642732+0000","last_unstale":"2023-09-30T22:21:47.394178+0000","last_undegraded":"2023-09-30T22:21:47.394178+0000","last_fullsized":"2023-09-30T22:21:47.394178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394875+0000","last_change":"2023-09-30T22:19:33.293670+0000","last_active":"2023-09-30T22:21:47.394875+0000","last_peered":"2023-09-30T22:21:47.394875+0000","last_clean":"2023-09-30T22:21:47.394875+0000","last_became_active":"2023-09-30T22:19:33.293179+0000","last_became_peered":"2023-09-30T22:19:33.293179+0000","last_unstale":"2023-09-30T22:21:47.394875+0000","last_undegraded":"2023-09-30T22:21:47.394875+0000","last_fullsized":"2023-09-30T22:21:47.394875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.395260+0000","last_change":"2023-09-30T22:19:33.647280+0000","last_active":"2023-09-30T22:21:47.395260+0000","last_peered":"2023-09-30T22:21:47.395260+0000","last_clean":"2023-09-30T22:21:47.395260+0000","last_became_active":"2023-09-30T22:19:33.646935+0000","last_became_peered":"2023-09-30T22:19:33.646935+0000","last_unstale":"2023-09-30T22:21:47.395260+0000","last_undegraded":"2023-09-30T22:21:47.395260+0000","last_fullsized":"2023-09-30T22:21:47.395260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176149+0000","last_change":"2023-09-30T22:19:33.296231+0000","last_active":"2023-09-30T22:21:47.176149+0000","last_peered":"2023-09-30T22:21:47.176149+0000","last_clean":"2023-09-30T22:21:47.176149+0000","last_became_active":"2023-09-30T22:19:33.295946+0000","last_became_peered":"2023-09-30T22:19:33.295946+0000","last_unstale":"2023-09-30T22:21:47.176149+0000","last_undegraded":"2023-09-30T22:21:47.176149+0000","last_fullsized":"2023-09-30T22:21:47.176149+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394894+0000","last_change":"2023-09-30T22:19:33.665656+0000","last_active":"2023-09-30T22:21:47.394894+0000","last_peered":"2023-09-30T22:21:47.394894+0000","last_clean":"2023-09-30T22:21:47.394894+0000","last_became_active":"2023-09-30T22:19:33.658850+0000","last_became_peered":"2023-09-30T22:19:33.658850+0000","last_unstale":"2023-09-30T22:21:47.394894+0000","last_undegraded":"2023-09-30T22:21:47.394894+0000","last_fullsized":"2023-09-30T22:21:47.394894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178721+0000","last_change":"2023-09-30T22:19:33.291605+0000","last_active":"2023-09-30T22:21:47.178721+0000","last_peered":"2023-09-30T22:21:47.178721+0000","last_clean":"2023-09-30T22:21:47.178721+0000","last_became_active":"2023-09-30T22:19:33.291048+0000","last_became_peered":"2023-09-30T22:19:33.291048+0000","last_unstale":"2023-09-30T22:21:47.178721+0000","last_undegraded":"2023-09-30T22:21:47.178721+0000","last_fullsized":"2023-09-30T22:21:47.178721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394406+0000","last_change":"2023-09-30T22:19:33.643062+0000","last_active":"2023-09-30T22:21:47.394406+0000","last_peered":"2023-09-30T22:21:47.394406+0000","last_clean":"2023-09-30T22:21:47.394406+0000","last_became_active":"2023-09-30T22:19:33.642791+0000","last_became_peered":"2023-09-30T22:19:33.642791+0000","last_unstale":"2023-09-30T22:21:47.394406+0000","last_undegraded":"2023-09-30T22:21:47.394406+0000","last_fullsized":"2023-09-30T22:21:47.394406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178780+0000","last_change":"2023-09-30T22:19:33.287971+0000","last_active":"2023-09-30T22:21:47.178780+0000","last_peered":"2023-09-30T22:21:47.178780+0000","last_clean":"2023-09-30T22:21:47.178780+0000","last_became_active":"2023-09-30T22:19:33.287720+0000","last_became_peered":"2023-09-30T22:19:33.287720+0000","last_unstale":"2023-09-30T22:21:47.178780+0000","last_undegraded":"2023-09-30T22:21:47.178780+0000","last_fullsized":"2023-09-30T22:21:47.178780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177902+0000","last_change":"2023-09-30T22:19:33.670264+0000","last_active":"2023-09-30T22:21:47.177902+0000","last_peered":"2023-09-30T22:21:47.177902+0000","last_clean":"2023-09-30T22:21:47.177902+0000","last_became_active":"2023-09-30T22:19:33.670020+0000","last_became_peered":"2023-09-30T22:19:33.670020+0000","last_unstale":"2023-09-30T22:21:47.177902+0000","last_undegraded":"2023-09-30T22:21:47.177902+0000","last_fullsized":"2023-09-30T22:21:47.177902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.398779+0000","last_change":"2023-09-30T22:19:33.293238+0000","last_active":"2023-09-30T22:21:47.398779+0000","last_peered":"2023-09-30T22:21:47.398779+0000","last_clean":"2023-09-30T22:21:47.398779+0000","last_became_active":"2023-09-30T22:19:33.292967+0000","last_became_peered":"2023-09-30T22:19:33.292967+0000","last_unstale":"2023-09-30T22:21:47.398779+0000","last_undegraded":"2023-09-30T22:21:47.398779+0000","last_fullsized":"2023-09-30T22:21:47.398779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:32.254302+0000","last_clean_scrub_stamp":"2023-09-30T22:19:32.254302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.393966+0000","last_change":"2023-09-30T22:19:33.641684+0000","last_active":"2023-09-30T22:21:47.393966+0000","last_peered":"2023-09-30T22:21:47.393966+0000","last_clean":"2023-09-30T22:21:47.393966+0000","last_became_active":"2023-09-30T22:19:33.641403+0000","last_became_peered":"2023-09-30T22:19:33.641403+0000","last_unstale":"2023-09-30T22:21:47.393966+0000","last_undegraded":"2023-09-30T22:21:47.393966+0000","last_fullsized":"2023-09-30T22:21:47.393966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.175623+0000","last_change":"2023-09-30T22:19:33.644249+0000","last_active":"2023-09-30T22:21:47.175623+0000","last_peered":"2023-09-30T22:21:47.175623+0000","last_clean":"2023-09-30T22:21:47.175623+0000","last_became_active":"2023-09-30T22:19:33.643987+0000","last_became_peered":"2023-09-30T22:19:33.643987+0000","last_unstale":"2023-09-30T22:21:47.175623+0000","last_undegraded":"2023-09-30T22:21:47.175623+0000","last_fullsized":"2023-09-30T22:21:47.175623+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.177767+0000","last_change":"2023-09-30T22:19:33.659592+0000","last_active":"2023-09-30T22:21:47.177767+0000","last_peered":"2023-09-30T22:21:47.177767+0000","last_clean":"2023-09-30T22:21:47.177767+0000","last_became_active":"2023-09-30T22:19:33.659324+0000","last_became_peered":"2023-09-30T22:19:33.659324+0000","last_unstale":"2023-09-30T22:21:47.177767+0000","last_undegraded":"2023-09-30T22:21:47.177767+0000","last_fullsized":"2023-09-30T22:21:47.177767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.394499+0000","last_change":"2023-09-30T22:19:33.651082+0000","last_active":"2023-09-30T22:21:47.394499+0000","last_peered":"2023-09-30T22:21:47.394499+0000","last_clean":"2023-09-30T22:21:47.394499+0000","last_became_active":"2023-09-30T22:19:33.650784+0000","last_became_peered":"2023-09-30T22:19:33.650784+0000","last_unstale":"2023-09-30T22:21:47.394499+0000","last_undegraded":"2023-09-30T22:21:47.394499+0000","last_fullsized":"2023-09-30T22:21:47.394499+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.178553+0000","last_change":"2023-09-30T22:19:33.673256+0000","last_active":"2023-09-30T22:21:47.178553+0000","last_peered":"2023-09-30T22:21:47.178553+0000","last_clean":"2023-09-30T22:21:47.178553+0000","last_became_active":"2023-09-30T22:19:33.672980+0000","last_became_peered":"2023-09-30T22:19:33.672980+0000","last_unstale":"2023-09-30T22:21:47.178553+0000","last_undegraded":"2023-09-30T22:21:47.178553+0000","last_fullsized":"2023-09-30T22:21:47.178553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-09-30T22:21:47.176194+0000","last_change":"2023-09-30T22:19:33.653617+0000","last_active":"2023-09-30T22:21:47.176194+0000","last_peered":"2023-09-30T22:21:47.176194+0000","last_clean":"2023-09-30T22:21:47.176194+0000","last_became_active":"2023-09-30T22:19:33.653009+0000","last_became_peered":"2023-09-30T22:19:33.653009+0000","last_unstale":"2023-09-30T22:21:47.176194+0000","last_undegraded":"2023-09-30T22:21:47.176194+0000","last_fullsized":"2023-09-30T22:21:47.176194+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T22:19:33.258412+0000","last_clean_scrub_stamp":"2023-09-30T22:19:33.258412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297288,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074552,"statfs":{"total":96636764160,"available":96332341248,"internally_reserved":0,"allocated":196608,"data_stored":68522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.26800000000000002,"5min":0.27200000000000002,"15min":0.27300000000000002},"min":{"1min":0.192,"5min":0.157,"15min":0.157},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"last":1.643},{"interface":"front","average":{"1min":0.308,"5min":0.316,"15min":0.317},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.28699999999999998,"15min":0.28799999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.29999999999999999,"15min":0.30499999999999999},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.36399999999999999}]},{"osd":2,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.20599999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.30199999999999999,"15min":0.30599999999999999},"min":{"1min":0.21299999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":1.6060000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705694,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297276,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074564,"statfs":{"total":96636764160,"available":96332353536,"internally_reserved":0,"allocated":184320,"data_stored":68328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"min":{"1min":0.21299999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.39300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"last":0.221},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.28199999999999997,"15min":0.28100000000000003},"min":{"1min":0.23699999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.29499999999999998}]},{"osd":1,"last update":"Sat Sep 30 22:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.25700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.40699999999999997,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.246},{"interface":"front","average":{"1min":0.311,"5min":0.40699999999999997,"15min":0.42299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.42499999999999999,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.308}]},{"osd":3,"last update":"Sat Sep 30 22:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.314,"15min":0.314},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.46999999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.41699999999999998,"5min":0.443,"15min":0.443},"last":0.28599999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":65465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.28499999999999998,"15min":0.28599999999999998},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.39200000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.27700000000000002,"5min":0.30599999999999999,"15min":0.311},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.373,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.28100000000000003}]},{"osd":2,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34399999999999997,"15min":0.34899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.41199999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.33900000000000002,"15min":0.34300000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.40100000000000002,"5min":0.5,"15min":0.5},"last":0.34799999999999998}]},{"osd":3,"last update":"Sat Sep 30 22:21:32 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.32900000000000001,"15min":0.33300000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.435,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.32600000000000001,"15min":0.33000000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47099999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.30399999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705695,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297276,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074564,"statfs":{"total":96636764160,"available":96332353536,"internally_reserved":0,"allocated":184320,"data_stored":65411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 22:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28000000000000003,"15min":0.27800000000000002},"min":{"1min":0.22500000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.375,"5min":0.375,"15min":0.375},"last":0.252},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29699999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.28899999999999998}]},{"osd":2,"last update":"Sat Sep 30 22:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29799999999999999},"min":{"1min":0.23200000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.41199999999999998,"5min":0.432,"15min":0.432},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.38300000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Sat Sep 30 22:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"min":{"1min":0.25,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.30099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T22:21:55.684 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T22:21:55.684 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T22:21:55.684 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T22:21:55.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T22:21:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.839+0000 7f2df4d5d700 1 Processor -- start 2023-09-30T22:21:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.839+0000 7f2df4d5d700 1 -- start start 2023-09-30T22:21:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.839+0000 7f2df4d5d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2df0136960 0x7f2df0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.839+0000 7f2df4d5d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0139280 0x7f2df013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.839+0000 7f2df4d5d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df006b2d0 con 0x7f2df0133ad0 2023-09-30T22:21:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.839+0000 7f2df4d5d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df01345b0 con 0x7f2df0136960 2023-09-30T22:21:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.839+0000 7f2df4d5d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2df0133610 con 0x7f2df0139280 2023-09-30T22:21:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.839+0000 7f2deed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0139280 0x7f2df013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2dedd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2df0136960 0x7f2df0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2deed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0139280 0x7f2df013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60656/0 (socket says 172.21.15.154:60656) 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2dee59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2df0133ad0 0x7f2df0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38316/0 (socket says 172.21.15.154:38316) 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2deed9d700 1 -- 172.21.15.154:0/1542246136 learned_addr learned my addr 172.21.15.154:0/1542246136 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2deed9d700 1 -- 172.21.15.154:0/1542246136 >> v2:172.21.15.154:3300/0 conn(0x7f2df0136960 msgr2=0x7f2df0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2deed9d700 1 --2- 172.21.15.154:0/1542246136 >> v2:172.21.15.154:3300/0 conn(0x7f2df0136960 0x7f2df0138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2deed9d700 1 -- 172.21.15.154:0/1542246136 >> v1:172.21.15.154:6789/0 conn(0x7f2df0133ad0 legacy=0x7f2df0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2deed9d700 1 -- 172.21.15.154:0/1542246136 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df009a500 con 0x7f2df0139280 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2dedd9b700 1 --2- 172.21.15.154:0/1542246136 >> v2:172.21.15.154:3300/0 conn(0x7f2df0136960 0x7f2df0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2deed9d700 1 --2- 172.21.15.154:0/1542246136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0139280 0x7f2df013b660 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009e50 tx=0x7f2de800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb11b139a0d1bc70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2ded59a700 1 -- 172.21.15.154:0/1542246136 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800e070 con 0x7f2df0139280 2023-09-30T22:21:55.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2ded59a700 1 -- 172.21.15.154:0/1542246136 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de800b910 con 0x7f2df0139280 2023-09-30T22:21:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.840+0000 7f2ded59a700 1 -- 172.21.15.154:0/1542246136 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800bcc0 con 0x7f2df0139280 2023-09-30T22:21:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.841+0000 7f2df4d5d700 1 -- 172.21.15.154:0/1542246136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0139280 msgr2=0x7f2df013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.841+0000 7f2df4d5d700 1 --2- 172.21.15.154:0/1542246136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0139280 0x7f2df013b660 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009e50 tx=0x7f2de800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.841+0000 7f2df4d5d700 1 -- 172.21.15.154:0/1542246136 shutdown_connections 2023-09-30T22:21:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.841+0000 7f2df4d5d700 1 --2- 172.21.15.154:0/1542246136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0139280 0x7f2df013b660 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.841+0000 7f2df4d5d700 1 --2- 172.21.15.154:0/1542246136 >> v2:172.21.15.154:3300/0 conn(0x7f2df0136960 0x7f2df0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.841+0000 7f2df4d5d700 1 -- 172.21.15.154:0/1542246136 >> 172.21.15.154:0/1542246136 conn(0x7f2df0099c40 msgr2=0x7f2df00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.841+0000 7f2df4d5d700 1 -- 172.21.15.154:0/1542246136 shutdown_connections 2023-09-30T22:21:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.841+0000 7f2df4d5d700 1 -- 172.21.15.154:0/1542246136 wait complete. 2023-09-30T22:21:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2df4d5d700 1 Processor -- start 2023-09-30T22:21:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2df4d5d700 1 -- start start 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2df4d5d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0133ad0 0x7f2df012fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2df4d5d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2df0136960 0x7f2df012ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2df4d5d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2df0139280 0x7f2df01c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2df4d5d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df0070370 con 0x7f2df0139280 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2df4d5d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df01316a0 con 0x7f2df0136960 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2df4d5d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2df006fe40 con 0x7f2df0133ad0 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2deed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2df0139280 0x7f2df01c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2dee59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0133ad0 0x7f2df012fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2deed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2df0139280 0x7f2df01c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37466/0 (socket says 172.21.15.154:37466) 2023-09-30T22:21:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2deed9d700 1 -- 172.21.15.154:0/2067367700 learned_addr learned my addr 172.21.15.154:0/2067367700 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.842+0000 7f2dedd9b700 1 --2- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2df0136960 0x7f2df012ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2dee59c700 1 -- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2df0136960 msgr2=0x7f2df012ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2dee59c700 1 --2- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2df0136960 0x7f2df012ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2dee59c700 1 -- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2df0139280 msgr2=0x7f2df01c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2dee59c700 1 --2- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2df0139280 0x7f2df01c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2dee59c700 1 -- 172.21.15.154:0/2067367700 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40094a0 con 0x7f2df0133ad0 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2deed9d700 1 --2- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2df0139280 0x7f2df01c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2dee59c700 1 --2- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0133ad0 0x7f2df012fa30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2de000c3c0 tx=0x7f2de000c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2ddeffd700 1 -- 172.21.15.154:0/2067367700 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0004a70 con 0x7f2df0133ad0 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2ddeffd700 1 -- 172.21.15.154:0/2067367700 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de0004bd0 con 0x7f2df0133ad0 2023-09-30T22:21:55.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de8009b30 con 0x7f2df0133ad0 2023-09-30T22:21:55.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2ddeffd700 1 -- 172.21.15.154:0/2067367700 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00070d0 con 0x7f2df0133ad0 2023-09-30T22:21:55.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.843+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df012f6d0 con 0x7f2df0133ad0 2023-09-30T22:21:55.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.844+0000 7f2ddeffd700 1 -- 172.21.15.154:0/2067367700 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 9) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f2de0007230 con 0x7f2df0133ad0 2023-09-30T22:21:55.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.844+0000 7f2ddeffd700 1 -- 172.21.15.154:0/2067367700 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f2de003f1d0 con 0x7f2df0133ad0 2023-09-30T22:21:55.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.844+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df004f2a0 con 0x7f2df0133ad0 2023-09-30T22:21:55.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.849+0000 7f2ddeffd700 1 -- 172.21.15.154:0/2067367700 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2de00192c0 con 0x7f2df0133ad0 2023-09-30T22:21:55.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:55.967+0000 7f2ddeffd700 1 -- 172.21.15.154:0/2067367700 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2de0013920 con 0x7f2df0133ad0 2023-09-30T22:21:56.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.076+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2df009f0f0 con 0x7f2df0133ad0 2023-09-30T22:21:56.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.076+0000 7f2ddeffd700 1 -- 172.21.15.154:0/2067367700 <== mon.2 v2:172.21.15.154:3302/0 8 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2de003d230 con 0x7f2df0133ad0 2023-09-30T22:21:56.076 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T22:21:56.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 >> v1:172.21.15.154:6816/126757 conn(0x7f2dd002f480 legacy=0x7f2dd0031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0133ad0 msgr2=0x7f2df012fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 --2- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0133ad0 0x7f2df012fa30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2de000c3c0 tx=0x7f2de000c6d0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 shutdown_connections 2023-09-30T22:21:56.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 --2- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2df0139280 0x7f2df01c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 --2- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2df0133ad0 0x7f2df012fa30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 --2- 172.21.15.154:0/2067367700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2df0136960 0x7f2df012ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 >> 172.21.15.154:0/2067367700 conn(0x7f2df0099c40 msgr2=0x7f2df0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 shutdown_connections 2023-09-30T22:21:56.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.078+0000 7f2df4d5d700 1 -- 172.21.15.154:0/2067367700 wait complete. 2023-09-30T22:21:56.090 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T22:21:56.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:21:56.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb033ece700 1 Processor -- start 2023-09-30T22:21:56.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb033ece700 1 -- start start 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb033ece700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb02c09f350 0x7fb02c138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb033ece700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c13b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb033ece700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c09fa00 con 0x7fb02c09e870 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb033ece700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c0a0370 con 0x7fb02c09f350 2023-09-30T22:21:56.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb033ece700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c06bec0 con 0x7fb02c1393a0 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb03246b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb031469700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb02c09f350 0x7fb02c138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.212+0000 7fb031c6a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb02c09e870 0x7fb02c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38332/0 (socket says 172.21.15.154:38332) 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb031c6a700 1 -- 172.21.15.154:0/2709635341 learned_addr learned my addr 172.21.15.154:0/2709635341 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb030c68700 1 -- 172.21.15.154:0/2709635341 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288145298 0 0) 0x7fb02c09fa00 con 0x7fb02c09e870 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb03246b700 1 -- 172.21.15.154:0/2709635341 >> v2:172.21.15.154:3300/0 conn(0x7fb02c09f350 msgr2=0x7fb02c138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb03246b700 1 --2- 172.21.15.154:0/2709635341 >> v2:172.21.15.154:3300/0 conn(0x7fb02c09f350 0x7fb02c138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb03246b700 1 -- 172.21.15.154:0/2709635341 >> v1:172.21.15.154:6789/0 conn(0x7fb02c09e870 legacy=0x7fb02c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb03246b700 1 -- 172.21.15.154:0/2709635341 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c09ada0 con 0x7fb02c1393a0 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb031469700 1 --2- 172.21.15.154:0/2709635341 >> v2:172.21.15.154:3300/0 conn(0x7fb02c09f350 0x7fb02c138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb03246b700 1 --2- 172.21.15.154:0/2709635341 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c13b780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96c8c37ad212d8c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb030c68700 1 -- 172.21.15.154:0/2709635341 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400e070 con 0x7fb02c1393a0 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb030c68700 1 -- 172.21.15.154:0/2709635341 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02400bb20 con 0x7fb02c1393a0 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.213+0000 7fb030c68700 1 -- 172.21.15.154:0/2709635341 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024012430 con 0x7fb02c1393a0 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.214+0000 7fb033ece700 1 -- 172.21.15.154:0/2709635341 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 msgr2=0x7fb02c13b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.214+0000 7fb033ece700 1 --2- 172.21.15.154:0/2709635341 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c13b780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02400b330 comp rx=0 tx=0).stop 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.214+0000 7fb033ece700 1 -- 172.21.15.154:0/2709635341 shutdown_connections 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.214+0000 7fb033ece700 1 --2- 172.21.15.154:0/2709635341 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c13b780 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.214+0000 7fb033ece700 1 --2- 172.21.15.154:0/2709635341 >> v2:172.21.15.154:3300/0 conn(0x7fb02c09f350 0x7fb02c138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.214+0000 7fb033ece700 1 -- 172.21.15.154:0/2709635341 >> 172.21.15.154:0/2709635341 conn(0x7fb02c0a4430 msgr2=0x7fb02c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.214+0000 7fb033ece700 1 -- 172.21.15.154:0/2709635341 shutdown_connections 2023-09-30T22:21:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.214+0000 7fb033ece700 1 -- 172.21.15.154:0/2709635341 wait complete. 2023-09-30T22:21:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb033ece700 1 Processor -- start 2023-09-30T22:21:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb033ece700 1 -- start start 2023-09-30T22:21:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb033ece700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c09e870 0x7fb02c1219d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb033ece700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02c09f350 0x7fb02c121f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb033ece700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c122450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb033ece700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c06d030 con 0x7fb02c09e870 2023-09-30T22:21:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb033ece700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c123650 con 0x7fb02c09f350 2023-09-30T22:21:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb033ece700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c125170 con 0x7fb02c1393a0 2023-09-30T22:21:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb031c6a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c09e870 0x7fb02c1219d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb03246b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c122450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb031c6a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c09e870 0x7fb02c1219d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37474/0 (socket says 172.21.15.154:37474) 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb03246b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c122450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60690/0 (socket says 172.21.15.154:60690) 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb031c6a700 1 -- 172.21.15.154:0/3292680620 learned_addr learned my addr 172.21.15.154:0/3292680620 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb031469700 1 --2- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02c09f350 0x7fb02c121f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb031c6a700 1 -- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 msgr2=0x7fb02c122450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb031c6a700 1 --2- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c122450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb031c6a700 1 -- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02c09f350 msgr2=0x7fb02c121f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb031c6a700 1 --2- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02c09f350 0x7fb02c121f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb031c6a700 1 -- 172.21.15.154:0/3292680620 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0094a0 con 0x7fb02c09e870 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.215+0000 7fb03246b700 1 --2- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c122450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.216+0000 7fb031c6a700 1 --2- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c09e870 0x7fb02c1219d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c550 tx=0x7fb02800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.216+0000 7fb0227fc700 1 -- 172.21.15.154:0/3292680620 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028004c80 con 0x7fb02c09e870 2023-09-30T22:21:56.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.216+0000 7fb0227fc700 1 -- 172.21.15.154:0/3292680620 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb028004de0 con 0x7fb02c09e870 2023-09-30T22:21:56.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.216+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb024009a70 con 0x7fb02c09e870 2023-09-30T22:21:56.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.216+0000 7fb0227fc700 1 -- 172.21.15.154:0/3292680620 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028007310 con 0x7fb02c09e870 2023-09-30T22:21:56.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.216+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c123d30 con 0x7fb02c09e870 2023-09-30T22:21:56.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.216+0000 7fb0227fc700 1 -- 172.21.15.154:0/3292680620 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb028007470 con 0x7fb02c09e870 2023-09-30T22:21:56.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.217+0000 7fb0227fc700 1 -- 172.21.15.154:0/3292680620 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fb02803f6e0 con 0x7fb02c09e870 2023-09-30T22:21:56.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.217+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c04f2a0 con 0x7fb02c09e870 2023-09-30T22:21:56.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.222+0000 7fb0227fc700 1 -- 172.21.15.154:0/3292680620 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0280123b0 con 0x7fb02c09e870 2023-09-30T22:21:56.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.403+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb02c072d60 con 0x7fb02c09e870 2023-09-30T22:21:56.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.404+0000 7fb0227fc700 1 -- 172.21.15.154:0/3292680620 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12898 (secure 0 0 0) 0x7fb0280102c0 con 0x7fb02c09e870 2023-09-30T22:21:56.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:56.405 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":23,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:21:53.942341+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 >> v1:172.21.15.154:6816/126757 conn(0x7fb01002f510 legacy=0x7fb0100319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c09e870 msgr2=0x7fb02c1219d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 --2- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c09e870 0x7fb02c1219d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c550 tx=0x7fb02800c860 comp rx=0 tx=0).stop 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 shutdown_connections 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 --2- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02c1393a0 0x7fb02c122450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 --2- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02c09e870 0x7fb02c1219d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 --2- 172.21.15.154:0/3292680620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02c09f350 0x7fb02c121f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 >> 172.21.15.154:0/3292680620 conn(0x7fb02c0a4430 msgr2=0x7fb02c09d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 shutdown_connections 2023-09-30T22:21:56.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.407+0000 7fb033ece700 1 -- 172.21.15.154:0/3292680620 wait complete. 2023-09-30T22:21:56.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:19:27.265135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:19:28.184247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:19:32.024148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:19:32.601719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:21:56.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:21:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.543+0000 7f81cc72d700 1 Processor -- start 2023-09-30T22:21:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.543+0000 7f81cc72d700 1 -- start start 2023-09-30T22:21:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81cc72d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 0x7f81c4131ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81cc72d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c4131ff0 0x7f81c4071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81cc72d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c409a5a0 con 0x7f81c409ed90 2023-09-30T22:21:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81cc72d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c409b500 con 0x7f81c4131ff0 2023-09-30T22:21:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81cc72d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c41314c0 con 0x7f81c41316e0 2023-09-30T22:21:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81ca4c9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 0x7f81c4131ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81cacca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c4131ff0 0x7f81c4071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81c9cc8700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f81c409ed90 0x7f81c4071450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38348/0 (socket says 172.21.15.154:38348) 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81c9cc8700 1 -- 172.21.15.154:0/2902885189 learned_addr learned my addr 172.21.15.154:0/2902885189 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81ca4c9700 1 -- 172.21.15.154:0/2902885189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c4131ff0 msgr2=0x7f81c4071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81c94c7700 1 -- 172.21.15.154:0/2902885189 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985968602 0 0) 0x7f81c409a5a0 con 0x7f81c409ed90 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81ca4c9700 1 --2- 172.21.15.154:0/2902885189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c4131ff0 0x7f81c4071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81ca4c9700 1 -- 172.21.15.154:0/2902885189 >> v1:172.21.15.154:6789/0 conn(0x7f81c409ed90 legacy=0x7f81c4071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81ca4c9700 1 -- 172.21.15.154:0/2902885189 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4099d00 con 0x7f81c41316e0 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81cacca700 1 --2- 172.21.15.154:0/2902885189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c4131ff0 0x7f81c4071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81ca4c9700 1 --2- 172.21.15.154:0/2902885189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 0x7f81c4131ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009870 tx=0x7f81b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aa0998940fecfbf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81c94c7700 1 -- 172.21.15.154:0/2902885189 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4011830 con 0x7f81c41316e0 2023-09-30T22:21:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81c94c7700 1 -- 172.21.15.154:0/2902885189 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b4011990 con 0x7f81c41316e0 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.544+0000 7f81c94c7700 1 -- 172.21.15.154:0/2902885189 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4011d20 con 0x7f81c41316e0 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.545+0000 7f81cc72d700 1 -- 172.21.15.154:0/2902885189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 msgr2=0x7f81c4131ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.545+0000 7f81cc72d700 1 --2- 172.21.15.154:0/2902885189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 0x7f81c4131ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009870 tx=0x7f81b4009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.545+0000 7f81cc72d700 1 -- 172.21.15.154:0/2902885189 shutdown_connections 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.545+0000 7f81cc72d700 1 --2- 172.21.15.154:0/2902885189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c4131ff0 0x7f81c4071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.545+0000 7f81cc72d700 1 --2- 172.21.15.154:0/2902885189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 0x7f81c4131ab0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.545+0000 7f81cc72d700 1 -- 172.21.15.154:0/2902885189 >> 172.21.15.154:0/2902885189 conn(0x7f81c409f3f0 msgr2=0x7f81c409f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.545+0000 7f81cc72d700 1 -- 172.21.15.154:0/2902885189 shutdown_connections 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.545+0000 7f81cc72d700 1 -- 172.21.15.154:0/2902885189 wait complete. 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.546+0000 7f81cc72d700 1 Processor -- start 2023-09-30T22:21:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.546+0000 7f81cc72d700 1 -- start start 2023-09-30T22:21:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.546+0000 7f81cc72d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c409ed90 0x7f81c412dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.546+0000 7f81cc72d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 0x7f81c412e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.546+0000 7f81cc72d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c4131ff0 0x7f81c4136390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.546+0000 7f81cc72d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c411d280 con 0x7f81c4131ff0 2023-09-30T22:21:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.546+0000 7f81cc72d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4070d00 con 0x7f81c409ed90 2023-09-30T22:21:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.546+0000 7f81cc72d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4070640 con 0x7f81c41316e0 2023-09-30T22:21:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81ca4c9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c409ed90 0x7f81c412dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81cacca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c4131ff0 0x7f81c4136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81ca4c9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c409ed90 0x7f81c412dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36878/0 (socket says 172.21.15.154:36878) 2023-09-30T22:21:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81ca4c9700 1 -- 172.21.15.154:0/4238019688 learned_addr learned my addr 172.21.15.154:0/4238019688 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81c9cc8700 1 --2- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 0x7f81c412e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81ca4c9700 1 -- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 msgr2=0x7f81c412e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81ca4c9700 1 --2- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 0x7f81c412e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81ca4c9700 1 -- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c4131ff0 msgr2=0x7f81c4136390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81ca4c9700 1 --2- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c4131ff0 0x7f81c4136390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81ca4c9700 1 -- 172.21.15.154:0/4238019688 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc009a70 con 0x7f81c409ed90 2023-09-30T22:21:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81cacca700 1 --2- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c4131ff0 0x7f81c4136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81ca4c9700 1 --2- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c409ed90 0x7f81c412dba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f81b4000c00 tx=0x7f81b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81baffd700 1 -- 172.21.15.154:0/4238019688 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40042c0 con 0x7f81c409ed90 2023-09-30T22:21:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81baffd700 1 -- 172.21.15.154:0/4238019688 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b401f070 con 0x7f81c409ed90 2023-09-30T22:21:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b40094a0 con 0x7f81c409ed90 2023-09-30T22:21:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81baffd700 1 -- 172.21.15.154:0/4238019688 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40036a0 con 0x7f81c409ed90 2023-09-30T22:21:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.547+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c409a8f0 con 0x7f81c409ed90 2023-09-30T22:21:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.548+0000 7f81baffd700 1 -- 172.21.15.154:0/4238019688 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f81b4021030 con 0x7f81c409ed90 2023-09-30T22:21:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.548+0000 7f81baffd700 1 -- 172.21.15.154:0/4238019688 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f81b4040b30 con 0x7f81c409ed90 2023-09-30T22:21:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.548+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c4131e10 con 0x7f81c409ed90 2023-09-30T22:21:56.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.553+0000 7f81baffd700 1 -- 172.21.15.154:0/4238019688 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81b4015070 con 0x7f81c409ed90 2023-09-30T22:21:56.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.736+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81c404f2a0 con 0x7f81c409ed90 2023-09-30T22:21:56.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.736+0000 7f81baffd700 1 -- 172.21.15.154:0/4238019688 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81b401a450 con 0x7f81c409ed90 2023-09-30T22:21:56.737 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-09-30T22:21:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 >> v1:172.21.15.154:6816/126757 conn(0x7f81a802f540 legacy=0x7f81a80319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c409ed90 msgr2=0x7f81c412dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 --2- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c409ed90 0x7f81c412dba0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f81b4000c00 tx=0x7f81b4004750 comp rx=0 tx=0).stop 2023-09-30T22:21:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 shutdown_connections 2023-09-30T22:21:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 --2- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c4131ff0 0x7f81c4136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 --2- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81c409ed90 0x7f81c412dba0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 --2- 172.21.15.154:0/4238019688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81c41316e0 0x7f81c412e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 >> 172.21.15.154:0/4238019688 conn(0x7f81c409f3f0 msgr2=0x7f81c412f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 shutdown_connections 2023-09-30T22:21:56.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.738+0000 7f81cc72d700 1 -- 172.21.15.154:0/4238019688 wait complete. 2023-09-30T22:21:56.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:21:56.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.876+0000 7f244c277700 1 Processor -- start 2023-09-30T22:21:56.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.876+0000 7f244c277700 1 -- start start 2023-09-30T22:21:56.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f244c277700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24440a15c0 0x7f2444138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f244c277700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244413b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f244c277700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244409e740 con 0x7f24440a0ae0 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f244c277700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244409db60 con 0x7f24440a15c0 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f244c277700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f244409d880 con 0x7f2444139210 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f2449812700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24440a15c0 0x7f2444138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f244a814700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244413b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f244a013700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f24440a0ae0 0x7f24440a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38360/0 (socket says 172.21.15.154:38360) 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f244a013700 1 -- 172.21.15.154:0/2376106068 learned_addr learned my addr 172.21.15.154:0/2376106068 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f2449812700 1 -- 172.21.15.154:0/2376106068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 msgr2=0x7f244413b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f2449812700 1 --2- 172.21.15.154:0/2376106068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244413b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f2449812700 1 -- 172.21.15.154:0/2376106068 >> v1:172.21.15.154:6789/0 conn(0x7f24440a0ae0 legacy=0x7f24440a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f2449812700 1 -- 172.21.15.154:0/2376106068 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440a28d0 con 0x7f24440a15c0 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f244a814700 1 --2- 172.21.15.154:0/2376106068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244413b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.877+0000 7f2449812700 1 --2- 172.21.15.154:0/2376106068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a15c0 0x7f2444138cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2440009840 tx=0x7f2440009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38957fe6dbaaeb1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f2449011700 1 -- 172.21.15.154:0/2376106068 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011830 con 0x7f24440a15c0 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f2449011700 1 -- 172.21.15.154:0/2376106068 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440011990 con 0x7f24440a15c0 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f2449011700 1 -- 172.21.15.154:0/2376106068 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440011d20 con 0x7f24440a15c0 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f244c277700 1 -- 172.21.15.154:0/2376106068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a15c0 msgr2=0x7f2444138cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f244c277700 1 --2- 172.21.15.154:0/2376106068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a15c0 0x7f2444138cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2440009840 tx=0x7f2440009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f244c277700 1 -- 172.21.15.154:0/2376106068 shutdown_connections 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f244c277700 1 --2- 172.21.15.154:0/2376106068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244413b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f244c277700 1 --2- 172.21.15.154:0/2376106068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a15c0 0x7f2444138cd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f244c277700 1 -- 172.21.15.154:0/2376106068 >> 172.21.15.154:0/2376106068 conn(0x7f24440a2ec0 msgr2=0x7f24440a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:56.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f244c277700 1 -- 172.21.15.154:0/2376106068 shutdown_connections 2023-09-30T22:21:56.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.878+0000 7f244c277700 1 -- 172.21.15.154:0/2376106068 wait complete. 2023-09-30T22:21:56.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.879+0000 7f244c277700 1 Processor -- start 2023-09-30T22:21:56.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.879+0000 7f244c277700 1 -- start start 2023-09-30T22:21:56.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.879+0000 7f244c277700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a0ae0 0x7f244411e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.879+0000 7f244c277700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24440a15c0 0x7f244411ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.879+0000 7f244c277700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244411f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:56.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.879+0000 7f244c277700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444120420 con 0x7f24440a0ae0 2023-09-30T22:21:56.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.879+0000 7f244c277700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2444120a40 con 0x7f24440a15c0 2023-09-30T22:21:56.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.879+0000 7f244c277700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24441220f0 con 0x7f2444139210 2023-09-30T22:21:56.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a013700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a0ae0 0x7f244411e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a013700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a0ae0 0x7f244411e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37492/0 (socket says 172.21.15.154:37492) 2023-09-30T22:21:56.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f2449812700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24440a15c0 0x7f244411ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a814700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244411f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a013700 1 -- 172.21.15.154:0/1222998137 learned_addr learned my addr 172.21.15.154:0/1222998137 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a013700 1 -- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 msgr2=0x7f244411f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a013700 1 --2- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244411f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a013700 1 -- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24440a15c0 msgr2=0x7f244411ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a013700 1 --2- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24440a15c0 0x7f244411ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a013700 1 -- 172.21.15.154:0/1222998137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c009a70 con 0x7f24440a0ae0 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a814700 1 --2- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244411f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244a013700 1 --2- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a0ae0 0x7f244411e810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f243400c520 tx=0x7f243400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f243affd700 1 -- 172.21.15.154:0/1222998137 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434005d70 con 0x7f24440a0ae0 2023-09-30T22:21:56.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f243affd700 1 -- 172.21.15.154:0/1222998137 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24340070d0 con 0x7f24440a0ae0 2023-09-30T22:21:56.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f243affd700 1 -- 172.21.15.154:0/1222998137 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434007440 con 0x7f24440a0ae0 2023-09-30T22:21:56.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24400094a0 con 0x7f24440a0ae0 2023-09-30T22:21:56.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.880+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2444120c10 con 0x7f24440a0ae0 2023-09-30T22:21:56.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.881+0000 7f243affd700 1 -- 172.21.15.154:0/1222998137 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f24340075a0 con 0x7f24440a0ae0 2023-09-30T22:21:56.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.881+0000 7f243affd700 1 -- 172.21.15.154:0/1222998137 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f243403ef70 con 0x7f24440a0ae0 2023-09-30T22:21:56.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.881+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244404f2a0 con 0x7f24440a0ae0 2023-09-30T22:21:56.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:56.886+0000 7f243affd700 1 -- 172.21.15.154:0/1222998137 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2434017030 con 0x7f24440a0ae0 2023-09-30T22:21:57.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.071+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2444072a30 con 0x7f24440a0ae0 2023-09-30T22:21:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.071+0000 7f243affd700 1 -- 172.21.15.154:0/1222998137 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2434017070 con 0x7f24440a0ae0 2023-09-30T22:21:57.072 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 8 2023-09-30T22:21:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 >> v1:172.21.15.154:6816/126757 conn(0x7f242802f510 legacy=0x7f24280319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a0ae0 msgr2=0x7f244411e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 --2- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a0ae0 0x7f244411e810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f243400c520 tx=0x7f243400c830 comp rx=0 tx=0).stop 2023-09-30T22:21:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 shutdown_connections 2023-09-30T22:21:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 --2- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2444139210 0x7f244411f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 --2- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24440a0ae0 0x7f244411e810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 --2- 172.21.15.154:0/1222998137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24440a15c0 0x7f244411ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 >> 172.21.15.154:0/1222998137 conn(0x7f24440a2ec0 msgr2=0x7f24440a4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 shutdown_connections 2023-09-30T22:21:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.073+0000 7f244c277700 1 -- 172.21.15.154:0/1222998137 wait complete. 2023-09-30T22:21:57.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:21:57.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.209+0000 7f354b0ed700 1 Processor -- start 2023-09-30T22:21:57.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354b0ed700 1 -- start start 2023-09-30T22:21:57.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354b0ed700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f354409d780 0x7f354409db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354b0ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409e090 0x7f3544134190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354b0ed700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354409a590 con 0x7f354409ad70 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354b0ed700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354406b450 con 0x7f354409d780 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354b0ed700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354406a9e0 con 0x7f354409e090 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354968a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409e090 0x7f3544134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f3548e89700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f354409d780 0x7f354409db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354968a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409e090 0x7f3544134190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36898/0 (socket says 172.21.15.154:36898) 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f3548e89700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f354409d780 0x7f354409db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37506/0 (socket says 172.21.15.154:37506) 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f3543fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f354409ad70 0x7f3544133a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38370/0 (socket says 172.21.15.154:38370) 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354968a700 1 -- 172.21.15.154:0/815059992 learned_addr learned my addr 172.21.15.154:0/815059992 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f3548e89700 1 -- 172.21.15.154:0/815059992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409e090 msgr2=0x7f3544134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f3548e89700 1 --2- 172.21.15.154:0/815059992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409e090 0x7f3544134190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f3548e89700 1 -- 172.21.15.154:0/815059992 >> v1:172.21.15.154:6789/0 conn(0x7f354409ad70 legacy=0x7f3544133a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f3548e89700 1 -- 172.21.15.154:0/815059992 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354409e4f0 con 0x7f354409d780 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f35437fe700 1 -- 172.21.15.154:0/815059992 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415861247 0 0) 0x7f354409a590 con 0x7f354409ad70 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.210+0000 7f354968a700 1 --2- 172.21.15.154:0/815059992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409e090 0x7f3544134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f3548e89700 1 --2- 172.21.15.154:0/815059992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 0x7f354409db50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3538009840 tx=0x7f3538009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2833176143bc1192 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f35437fe700 1 -- 172.21.15.154:0/815059992 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011830 con 0x7f354409d780 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f35437fe700 1 -- 172.21.15.154:0/815059992 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538011990 con 0x7f354409d780 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f35437fe700 1 -- 172.21.15.154:0/815059992 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538011d20 con 0x7f354409d780 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f354b0ed700 1 -- 172.21.15.154:0/815059992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 msgr2=0x7f354409db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f354b0ed700 1 --2- 172.21.15.154:0/815059992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 0x7f354409db50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3538009840 tx=0x7f3538009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f354b0ed700 1 -- 172.21.15.154:0/815059992 shutdown_connections 2023-09-30T22:21:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f354b0ed700 1 --2- 172.21.15.154:0/815059992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409e090 0x7f3544134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f354b0ed700 1 --2- 172.21.15.154:0/815059992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 0x7f354409db50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f354b0ed700 1 -- 172.21.15.154:0/815059992 >> 172.21.15.154:0/815059992 conn(0x7f354409f980 msgr2=0x7f354409fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f354b0ed700 1 -- 172.21.15.154:0/815059992 shutdown_connections 2023-09-30T22:21:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.211+0000 7f354b0ed700 1 -- 172.21.15.154:0/815059992 wait complete. 2023-09-30T22:21:57.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.212+0000 7f354b0ed700 1 Processor -- start 2023-09-30T22:21:57.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.212+0000 7f354b0ed700 1 -- start start 2023-09-30T22:21:57.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f354b0ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409ad70 0x7f3544122270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f354b0ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 0x7f35441227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f354b0ed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f354409e090 0x7f3544122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f354b0ed700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544072740 con 0x7f354409d780 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f354b0ed700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354409c710 con 0x7f354409ad70 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f354b0ed700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3544124be0 con 0x7f354409e090 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3548e89700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409ad70 0x7f3544122270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3548e89700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409ad70 0x7f3544122270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36914/0 (socket says 172.21.15.154:36914) 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3548e89700 1 -- 172.21.15.154:0/2008653924 learned_addr learned my addr 172.21.15.154:0/2008653924 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3543fff700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 0x7f35441227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f354968a700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f354409e090 0x7f3544122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3548e89700 1 -- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f354409e090 msgr2=0x7f3544122cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3548e89700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f354409e090 0x7f3544122cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3548e89700 1 -- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 msgr2=0x7f35441227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3548e89700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 0x7f35441227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3548e89700 1 -- 172.21.15.154:0/2008653924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c009b30 con 0x7f354409ad70 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3543fff700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 0x7f35441227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.213+0000 7f3548e89700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409ad70 0x7f3544122270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3538009fd0 tx=0x7f3538004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.214+0000 7f35417fa700 1 -- 172.21.15.154:0/2008653924 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35380036a0 con 0x7f354409ad70 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.214+0000 7f35417fa700 1 -- 172.21.15.154:0/2008653924 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353801f070 con 0x7f354409ad70 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.214+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35380094a0 con 0x7f354409ad70 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.214+0000 7f35417fa700 1 -- 172.21.15.154:0/2008653924 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538003a60 con 0x7f354409ad70 2023-09-30T22:21:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.214+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35441259f0 con 0x7f354409ad70 2023-09-30T22:21:57.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.214+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3544125010 con 0x7f354409ad70 2023-09-30T22:21:57.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.215+0000 7f35417fa700 1 -- 172.21.15.154:0/2008653924 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3538003bc0 con 0x7f354409ad70 2023-09-30T22:21:57.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.215+0000 7f35417fa700 1 -- 172.21.15.154:0/2008653924 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f3538021070 con 0x7f354409ad70 2023-09-30T22:21:57.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.219+0000 7f35417fa700 1 -- 172.21.15.154:0/2008653924 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3538025d70 con 0x7f354409ad70 2023-09-30T22:21:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.406+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f354404f2a0 con 0x7f354409ad70 2023-09-30T22:21:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.406+0000 7f35417fa700 1 -- 172.21.15.154:0/2008653924 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3538015070 con 0x7f354409ad70 2023-09-30T22:21:57.407 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-09-30T22:21:57.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.408+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 >> v1:172.21.15.154:6816/126757 conn(0x7f352802f510 legacy=0x7f35280319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.408+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409ad70 msgr2=0x7f3544122270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.408+0000 7f354b0ed700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409ad70 0x7f3544122270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3538009fd0 tx=0x7f3538004750 comp rx=0 tx=0).stop 2023-09-30T22:21:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.409+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 shutdown_connections 2023-09-30T22:21:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.409+0000 7f354b0ed700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f354409e090 0x7f3544122cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.409+0000 7f354b0ed700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f354409ad70 0x7f3544122270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.409+0000 7f354b0ed700 1 --2- 172.21.15.154:0/2008653924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f354409d780 0x7f35441227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.409+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 >> 172.21.15.154:0/2008653924 conn(0x7f354409f980 msgr2=0x7f35440a0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.409+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 shutdown_connections 2023-09-30T22:21:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.409+0000 7f354b0ed700 1 -- 172.21.15.154:0/2008653924 wait complete. 2023-09-30T22:21:57.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:21:57.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fbdbe4700 1 Processor -- start 2023-09-30T22:21:57.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fbdbe4700 1 -- start start 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fbdbe4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809e870 0x7f9fb809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fbdbe4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809f180 0x7f9fb8133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fbdbe4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb809adb0 con 0x7f9fb81340c0 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fbdbe4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb806cba0 con 0x7f9fb809e870 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fbdbe4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb806b990 con 0x7f9fb809f180 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809f180 0x7f9fb8133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fb77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809e870 0x7f9fb809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fb7fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9fb81340c0 0x7f9fb813add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38376/0 (socket says 172.21.15.154:38376) 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.546+0000 7f9fb7fff700 1 -- 172.21.15.154:0/46433868 learned_addr learned my addr 172.21.15.154:0/46433868 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb67fc700 1 -- 172.21.15.154:0/46433868 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985792948 0 0) 0x7f9fb809adb0 con 0x7f9fb81340c0 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb6ffd700 1 -- 172.21.15.154:0/46433868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809e870 msgr2=0x7f9fb809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb6ffd700 1 --2- 172.21.15.154:0/46433868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809e870 0x7f9fb809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb6ffd700 1 -- 172.21.15.154:0/46433868 >> v1:172.21.15.154:6789/0 conn(0x7f9fb81340c0 legacy=0x7f9fb813add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb6ffd700 1 -- 172.21.15.154:0/46433868 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb806bc20 con 0x7f9fb809f180 2023-09-30T22:21:57.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb77fe700 1 --2- 172.21.15.154:0/46433868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809e870 0x7f9fb809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb6ffd700 1 --2- 172.21.15.154:0/46433868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809f180 0x7f9fb8133b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009870 tx=0x7f9fac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e321059f8d8814b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb67fc700 1 -- 172.21.15.154:0/46433868 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011830 con 0x7f9fb809f180 2023-09-30T22:21:57.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb67fc700 1 -- 172.21.15.154:0/46433868 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac011990 con 0x7f9fb809f180 2023-09-30T22:21:57.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fb67fc700 1 -- 172.21.15.154:0/46433868 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011d20 con 0x7f9fb809f180 2023-09-30T22:21:57.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/46433868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809f180 msgr2=0x7f9fb8133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fbdbe4700 1 --2- 172.21.15.154:0/46433868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809f180 0x7f9fb8133b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009870 tx=0x7f9fac009b80 comp rx=0 tx=0).stop 2023-09-30T22:21:57.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/46433868 shutdown_connections 2023-09-30T22:21:57.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fbdbe4700 1 --2- 172.21.15.154:0/46433868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809e870 0x7f9fb809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.547+0000 7f9fbdbe4700 1 --2- 172.21.15.154:0/46433868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809f180 0x7f9fb8133b80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.548+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/46433868 >> 172.21.15.154:0/46433868 conn(0x7f9fb80a4390 msgr2=0x7f9fb80a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.548+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/46433868 shutdown_connections 2023-09-30T22:21:57.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.548+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/46433868 wait complete. 2023-09-30T22:21:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.548+0000 7f9fbdbe4700 1 Processor -- start 2023-09-30T22:21:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fbdbe4700 1 -- start start 2023-09-30T22:21:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fbdbe4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809e870 0x7f9fb8122a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fbdbe4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809f180 0x7f9fb8122f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fbdbe4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fb81340c0 0x7f9fb81234c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fbdbe4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80a3ad0 con 0x7f9fb81340c0 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fbdbe4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8133560 con 0x7f9fb809f180 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fbdbe4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8124760 con 0x7f9fb809e870 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809e870 0x7f9fb8122a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fb81340c0 0x7f9fb81234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809e870 0x7f9fb8122a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60742/0 (socket says 172.21.15.154:60742) 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809f180 0x7f9fb8122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fb81340c0 0x7f9fb81234c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37524/0 (socket says 172.21.15.154:37524) 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb77fe700 1 -- 172.21.15.154:0/27648926 learned_addr learned my addr 172.21.15.154:0/27648926 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:57.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb77fe700 1 -- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809f180 msgr2=0x7f9fb8122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb77fe700 1 --2- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809f180 0x7f9fb8122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb77fe700 1 -- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fb81340c0 msgr2=0x7f9fb81234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb77fe700 1 --2- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fb81340c0 0x7f9fb81234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb77fe700 1 -- 172.21.15.154:0/27648926 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8009430 con 0x7f9fb809e870 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.549+0000 7f9fb7fff700 1 --2- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fb81340c0 0x7f9fb81234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.550+0000 7f9fb77fe700 1 --2- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809e870 0x7f9fb8122a40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800ebe0 tx=0x7f9fa800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.550+0000 7f9f9ffff700 1 -- 172.21.15.154:0/27648926 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8009740 con 0x7f9fb809e870 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.550+0000 7f9f9ffff700 1 -- 172.21.15.154:0/27648926 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa8005a20 con 0x7f9fb809e870 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.550+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac0094a0 con 0x7f9fb809e870 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.550+0000 7f9f9ffff700 1 -- 172.21.15.154:0/27648926 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8005db0 con 0x7f9fb809e870 2023-09-30T22:21:57.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.550+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb8126280 con 0x7f9fb809e870 2023-09-30T22:21:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.550+0000 7f9f9ffff700 1 -- 172.21.15.154:0/27648926 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9fa800c850 con 0x7f9fb809e870 2023-09-30T22:21:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.551+0000 7f9f9ffff700 1 -- 172.21.15.154:0/27648926 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f9fa803fdd0 con 0x7f9fb809e870 2023-09-30T22:21:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.551+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb804f2a0 con 0x7f9fb809e870 2023-09-30T22:21:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.555+0000 7f9f9ffff700 1 -- 172.21.15.154:0/27648926 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fa8006030 con 0x7f9fb809e870 2023-09-30T22:21:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.743+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fb8072d30 con 0x7f9fb809e870 2023-09-30T22:21:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.744+0000 7f9f9ffff700 1 -- 172.21.15.154:0/27648926 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fa8011350 con 0x7f9fb809e870 2023-09-30T22:21:57.745 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 >> v1:172.21.15.154:6816/126757 conn(0x7f9fa402f510 legacy=0x7f9fa40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809e870 msgr2=0x7f9fb8122a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 --2- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809e870 0x7f9fb8122a40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800ebe0 tx=0x7f9fa800eef0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 shutdown_connections 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 --2- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fb81340c0 0x7f9fb81234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 --2- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fb809e870 0x7f9fb8122a40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 --2- 172.21.15.154:0/27648926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fb809f180 0x7f9fb8122f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 >> 172.21.15.154:0/27648926 conn(0x7f9fb80a4390 msgr2=0x7f9fb8070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 shutdown_connections 2023-09-30T22:21:57.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.746+0000 7f9fbdbe4700 1 -- 172.21.15.154:0/27648926 wait complete. 2023-09-30T22:21:57.759 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:21:57.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.879+0000 7f223f3e0700 1 Processor -- start 2023-09-30T22:21:57.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.879+0000 7f223f3e0700 1 -- start start 2023-09-30T22:21:57.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223f3e0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238136960 0x7f2238138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223f3e0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238139280 0x7f223813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223f3e0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223806b2d0 con 0x7f2238133ad0 2023-09-30T22:21:57.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223f3e0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22381345b0 con 0x7f2238136960 2023-09-30T22:21:57.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223f3e0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2238133610 con 0x7f2238139280 2023-09-30T22:21:57.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223c97b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238136960 0x7f2238138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223d97d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238139280 0x7f223813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223d17c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2238133ad0 0x7f2238133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38388/0 (socket says 172.21.15.154:38388) 2023-09-30T22:21:57.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223d17c700 1 -- 172.21.15.154:0/105618932 learned_addr learned my addr 172.21.15.154:0/105618932 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f222bfff700 1 -- 172.21.15.154:0/105618932 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379502776 0 0) 0x7f223806b2d0 con 0x7f2238133ad0 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f222bfff700 1 -- 172.21.15.154:0/105618932 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22240035b0 con 0x7f2238133ad0 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223d97d700 1 -- 172.21.15.154:0/105618932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238136960 msgr2=0x7f2238138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223d97d700 1 --2- 172.21.15.154:0/105618932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238136960 0x7f2238138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223d97d700 1 -- 172.21.15.154:0/105618932 >> v1:172.21.15.154:6789/0 conn(0x7f2238133ad0 legacy=0x7f2238133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223d97d700 1 -- 172.21.15.154:0/105618932 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223809a500 con 0x7f2238139280 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.880+0000 7f223c97b700 1 --2- 172.21.15.154:0/105618932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238136960 0x7f2238138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f223d97d700 1 --2- 172.21.15.154:0/105618932 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238139280 0x7f223813b660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2230009dc0 tx=0x7f223000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8288ea6ccb8b9a4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f222bfff700 1 -- 172.21.15.154:0/105618932 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000e070 con 0x7f2238139280 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f222bfff700 1 -- 172.21.15.154:0/105618932 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223000bb20 con 0x7f2238139280 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f222bfff700 1 -- 172.21.15.154:0/105618932 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230012430 con 0x7f2238139280 2023-09-30T22:21:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f223f3e0700 1 -- 172.21.15.154:0/105618932 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238139280 msgr2=0x7f223813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f223f3e0700 1 --2- 172.21.15.154:0/105618932 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238139280 0x7f223813b660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2230009dc0 tx=0x7f223000b330 comp rx=0 tx=0).stop 2023-09-30T22:21:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f223f3e0700 1 -- 172.21.15.154:0/105618932 shutdown_connections 2023-09-30T22:21:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f223f3e0700 1 --2- 172.21.15.154:0/105618932 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238139280 0x7f223813b660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f223f3e0700 1 --2- 172.21.15.154:0/105618932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238136960 0x7f2238138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f223f3e0700 1 -- 172.21.15.154:0/105618932 >> 172.21.15.154:0/105618932 conn(0x7f2238099c40 msgr2=0x7f22380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f223f3e0700 1 -- 172.21.15.154:0/105618932 shutdown_connections 2023-09-30T22:21:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.881+0000 7f223f3e0700 1 -- 172.21.15.154:0/105618932 wait complete. 2023-09-30T22:21:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.882+0000 7f223f3e0700 1 Processor -- start 2023-09-30T22:21:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.882+0000 7f223f3e0700 1 -- start start 2023-09-30T22:21:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223f3e0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2238133ad0 0x7f223812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223f3e0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238136960 0x7f223812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223f3e0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238139280 0x7f223812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223f3e0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2238130370 con 0x7f2238133ad0 2023-09-30T22:21:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223f3e0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223806ff00 con 0x7f2238139280 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223f3e0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2238131730 con 0x7f2238136960 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223d17c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2238133ad0 0x7f223812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223c97b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238136960 0x7f223812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223d97d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238139280 0x7f223812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223c97b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238136960 0x7f223812d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60772/0 (socket says 172.21.15.154:60772) 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223d97d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238139280 0x7f223812d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36954/0 (socket says 172.21.15.154:36954) 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223c97b700 1 -- 172.21.15.154:0/3409564263 learned_addr learned my addr 172.21.15.154:0/3409564263 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223d17c700 1 -- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238136960 msgr2=0x7f223812d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223d17c700 1 --2- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238136960 0x7f223812d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223d17c700 1 -- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238139280 msgr2=0x7f223812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223d17c700 1 --2- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238139280 0x7f223812d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223d17c700 1 -- 172.21.15.154:0/3409564263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c0094a0 con 0x7f2238133ad0 2023-09-30T22:21:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223d17c700 1 --2- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2238133ad0 0x7f223812cb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f223400c430 tx=0x7f223400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f2229ffb700 1 -- 172.21.15.154:0/3409564263 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234005d70 con 0x7f2238133ad0 2023-09-30T22:21:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f2229ffb700 1 -- 172.21.15.154:0/3409564263 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22340070d0 con 0x7f2238133ad0 2023-09-30T22:21:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2230009a70 con 0x7f2238133ad0 2023-09-30T22:21:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.883+0000 7f2229ffb700 1 -- 172.21.15.154:0/3409564263 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234007460 con 0x7f2238133ad0 2023-09-30T22:21:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.884+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2238070ba0 con 0x7f2238133ad0 2023-09-30T22:21:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.884+0000 7f2229ffb700 1 -- 172.21.15.154:0/3409564263 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f22340075c0 con 0x7f2238133ad0 2023-09-30T22:21:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.885+0000 7f2229ffb700 1 -- 172.21.15.154:0/3409564263 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f223403ee30 con 0x7f2238133ad0 2023-09-30T22:21:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.885+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223804f2a0 con 0x7f2238133ad0 2023-09-30T22:21:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:57.889+0000 7f2229ffb700 1 -- 172.21.15.154:0/3409564263 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2234017070 con 0x7f2238133ad0 2023-09-30T22:21:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.114+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f223809f0f0 con 0x7f2238133ad0 2023-09-30T22:21:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.115+0000 7f2229ffb700 1 -- 172.21.15.154:0/3409564263 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2317 (secure 0 0 0) 0x7f223401bb10 con 0x7f2238133ad0 2023-09-30T22:21:58.116 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:58.116 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:19:33.620776+0000","modified":"2023-09-30T22:19:56.792269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:21:58.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 >> v1:172.21.15.154:6816/126757 conn(0x7f221c02f510 legacy=0x7f221c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2238133ad0 msgr2=0x7f223812cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 --2- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2238133ad0 0x7f223812cb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f223400c430 tx=0x7f223400c740 comp rx=0 tx=0).stop 2023-09-30T22:21:58.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 shutdown_connections 2023-09-30T22:21:58.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 --2- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2238139280 0x7f223812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 --2- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2238133ad0 0x7f223812cb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 --2- 172.21.15.154:0/3409564263 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2238136960 0x7f223812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 >> 172.21.15.154:0/3409564263 conn(0x7f2238099c40 msgr2=0x7f22381329c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 shutdown_connections 2023-09-30T22:21:58.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.117+0000 7f223f3e0700 1 -- 172.21.15.154:0/3409564263 wait complete. 2023-09-30T22:21:58.119 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-09-30T22:21:58.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:21:58.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.250+0000 7fbe60407700 1 Processor -- start 2023-09-30T22:21:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.250+0000 7fbe60407700 1 -- start start 2023-09-30T22:21:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.250+0000 7fbe60407700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe58133ad0 0x7fbe58133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.250+0000 7fbe60407700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe581300a0 0x7fbe581304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.250+0000 7fbe60407700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581309f0 0x7fbe5813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.250+0000 7fbe60407700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5806b2d0 con 0x7fbe581300a0 2023-09-30T22:21:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.250+0000 7fbe60407700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58133610 con 0x7fbe58133ad0 2023-09-30T22:21:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.250+0000 7fbe60407700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5809a500 con 0x7fbe581309f0 2023-09-30T22:21:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e1a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe58133ad0 0x7fbe58133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e9a4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581309f0 0x7fbe5813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e1a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe58133ad0 0x7fbe58133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36960/0 (socket says 172.21.15.154:36960) 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e9a4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581309f0 0x7fbe5813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60774/0 (socket says 172.21.15.154:60774) 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e1a3700 1 -- 172.21.15.154:0/3728417944 learned_addr learned my addr 172.21.15.154:0/3728417944 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5d9a2700 1 --2- 172.21.15.154:0/3728417944 >> v2:172.21.15.154:3300/0 conn(0x7fbe581300a0 0x7fbe581304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e1a3700 1 -- 172.21.15.154:0/3728417944 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581309f0 msgr2=0x7fbe5813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e1a3700 1 --2- 172.21.15.154:0/3728417944 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581309f0 0x7fbe5813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e1a3700 1 -- 172.21.15.154:0/3728417944 >> v2:172.21.15.154:3300/0 conn(0x7fbe581300a0 msgr2=0x7fbe581304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e1a3700 1 --2- 172.21.15.154:0/3728417944 >> v2:172.21.15.154:3300/0 conn(0x7fbe581300a0 0x7fbe581304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e1a3700 1 -- 172.21.15.154:0/3728417944 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe581338b0 con 0x7fbe58133ad0 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e9a4700 1 --2- 172.21.15.154:0/3728417944 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581309f0 0x7fbe5813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5d9a2700 1 --2- 172.21.15.154:0/3728417944 >> v2:172.21.15.154:3300/0 conn(0x7fbe581300a0 0x7fbe581304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5e1a3700 1 --2- 172.21.15.154:0/3728417944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe58133ad0 0x7fbe58133ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbe540098f0 tx=0x7fbe54009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e8e8afe4665f89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5d1a1700 1 -- 172.21.15.154:0/3728417944 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54011830 con 0x7fbe58133ad0 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5d1a1700 1 -- 172.21.15.154:0/3728417944 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54011990 con 0x7fbe58133ad0 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.251+0000 7fbe5d1a1700 1 -- 172.21.15.154:0/3728417944 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54011d20 con 0x7fbe58133ad0 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.252+0000 7fbe60407700 1 -- 172.21.15.154:0/3728417944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe58133ad0 msgr2=0x7fbe58133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.252+0000 7fbe60407700 1 --2- 172.21.15.154:0/3728417944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe58133ad0 0x7fbe58133ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbe540098f0 tx=0x7fbe54009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.252+0000 7fbe60407700 1 -- 172.21.15.154:0/3728417944 shutdown_connections 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.252+0000 7fbe60407700 1 --2- 172.21.15.154:0/3728417944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe58133ad0 0x7fbe58133ea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.252+0000 7fbe60407700 1 --2- 172.21.15.154:0/3728417944 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581309f0 0x7fbe5813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.252+0000 7fbe60407700 1 --2- 172.21.15.154:0/3728417944 >> v2:172.21.15.154:3300/0 conn(0x7fbe581300a0 0x7fbe581304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.252+0000 7fbe60407700 1 -- 172.21.15.154:0/3728417944 >> 172.21.15.154:0/3728417944 conn(0x7fbe58099c40 msgr2=0x7fbe580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.252+0000 7fbe60407700 1 -- 172.21.15.154:0/3728417944 shutdown_connections 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.252+0000 7fbe60407700 1 -- 172.21.15.154:0/3728417944 wait complete. 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe60407700 1 Processor -- start 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe60407700 1 -- start start 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe60407700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe581300a0 0x7fbe58071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe60407700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe580718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe60407700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe58133ad0 0x7fbe58071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe60407700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5811e010 con 0x7fbe581300a0 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe60407700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5811ee30 con 0x7fbe581309f0 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe60407700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5811fbd0 con 0x7fbe58133ad0 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe5d9a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe580718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe5e1a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe581300a0 0x7fbe58071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe5e9a4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe58133ad0 0x7fbe58071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe5d9a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe580718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36972/0 (socket says 172.21.15.154:36972) 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe5e1a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe581300a0 0x7fbe58071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37542/0 (socket says 172.21.15.154:37542) 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe5d9a2700 1 -- 172.21.15.154:0/3890748383 learned_addr learned my addr 172.21.15.154:0/3890748383 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe5e9a4700 1 -- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 msgr2=0x7fbe580718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.253+0000 7fbe5e9a4700 1 --2- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe580718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe5e9a4700 1 -- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe581300a0 msgr2=0x7fbe58071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe5e9a4700 1 --2- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe581300a0 0x7fbe58071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe5e9a4700 1 -- 172.21.15.154:0/3890748383 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480094a0 con 0x7fbe58133ad0 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe5e9a4700 1 --2- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe58133ad0 0x7fbe58071e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009e50 tx=0x7fbe5000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe4effd700 1 -- 172.21.15.154:0/3890748383 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000ca90 con 0x7fbe58133ad0 2023-09-30T22:21:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe4effd700 1 -- 172.21.15.154:0/3890748383 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5000f040 con 0x7fbe58133ad0 2023-09-30T22:21:58.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe50009a70 con 0x7fbe58133ad0 2023-09-30T22:21:58.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe4effd700 1 -- 172.21.15.154:0/3890748383 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000ce50 con 0x7fbe58133ad0 2023-09-30T22:21:58.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe54009550 con 0x7fbe58133ad0 2023-09-30T22:21:58.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.254+0000 7fbe4effd700 1 -- 172.21.15.154:0/3890748383 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbe50014480 con 0x7fbe58133ad0 2023-09-30T22:21:58.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.255+0000 7fbe4effd700 1 -- 172.21.15.154:0/3890748383 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fbe500401b0 con 0x7fbe58133ad0 2023-09-30T22:21:58.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.255+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe580a2620 con 0x7fbe58133ad0 2023-09-30T22:21:58.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.259+0000 7fbe4effd700 1 -- 172.21.15.154:0/3890748383 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe50012930 con 0x7fbe58133ad0 2023-09-30T22:21:58.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.443+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe5804f2a0 con 0x7fbe58133ad0 2023-09-30T22:21:58.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.444+0000 7fbe4effd700 1 -- 172.21.15.154:0/3890748383 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12898 (secure 0 0 0) 0x7fbe50018020 con 0x7fbe58133ad0 2023-09-30T22:21:58.445 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:21:58.445 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":23,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:21:53.942341+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:21:58.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 >> v1:172.21.15.154:6816/126757 conn(0x7fbe3c02f510 legacy=0x7fbe3c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe58133ad0 msgr2=0x7fbe58071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 --2- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe58133ad0 0x7fbe58071e10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009e50 tx=0x7fbe5000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 shutdown_connections 2023-09-30T22:21:58.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 --2- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe58133ad0 0x7fbe58071e10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 --2- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe581300a0 0x7fbe58071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 --2- 172.21.15.154:0/3890748383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe580718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 >> 172.21.15.154:0/3890748383 conn(0x7fbe58099c40 msgr2=0x7fbe5812f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 shutdown_connections 2023-09-30T22:21:58.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.446+0000 7fbe60407700 1 -- 172.21.15.154:0/3890748383 wait complete. 2023-09-30T22:21:58.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:19:27.265135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:19:28.184247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:19:32.024148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:19:32.601719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:21:58.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:21:58.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.582+0000 7f808f1d7700 1 Processor -- start 2023-09-30T22:21:58.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.582+0000 7f808f1d7700 1 -- start start 2023-09-30T22:21:58.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808f1d7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8088133980 0x7f8088133d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808f1d7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f808809de70 0x7f808809e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808f1d7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8088133540 con 0x7f808809e800 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808f1d7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80880709c0 con 0x7f8088133980 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808f1d7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80881337a0 con 0x7f808809de70 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808cf73700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8088133980 0x7f8088133d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f8087fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f808809de70 0x7f808809e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808d774700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f808809e800 0x7f808813a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38402/0 (socket says 172.21.15.154:38402) 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808d774700 1 -- 172.21.15.154:0/2559163217 learned_addr learned my addr 172.21.15.154:0/2559163217 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f80877fe700 1 -- 172.21.15.154:0/2559163217 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286865299 0 0) 0x7f8088133540 con 0x7f808809e800 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f80877fe700 1 -- 172.21.15.154:0/2559163217 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80780035b0 con 0x7f808809e800 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808cf73700 1 -- 172.21.15.154:0/2559163217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f808809de70 msgr2=0x7f808809e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808cf73700 1 --2- 172.21.15.154:0/2559163217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f808809de70 0x7f808809e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808cf73700 1 -- 172.21.15.154:0/2559163217 >> v1:172.21.15.154:6789/0 conn(0x7f808809e800 legacy=0x7f808813a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f808cf73700 1 -- 172.21.15.154:0/2559163217 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808806fa40 con 0x7f8088133980 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.583+0000 7f8087fff700 1 --2- 172.21.15.154:0/2559163217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f808809de70 0x7f808809e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f808cf73700 1 --2- 172.21.15.154:0/2559163217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088133980 0x7f8088133d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f807c009840 tx=0x7f807c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd340352eefc570 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f80877fe700 1 -- 172.21.15.154:0/2559163217 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c011830 con 0x7f8088133980 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f80877fe700 1 -- 172.21.15.154:0/2559163217 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c011990 con 0x7f8088133980 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f80877fe700 1 -- 172.21.15.154:0/2559163217 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c011d20 con 0x7f8088133980 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f808f1d7700 1 -- 172.21.15.154:0/2559163217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088133980 msgr2=0x7f8088133d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f808f1d7700 1 --2- 172.21.15.154:0/2559163217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088133980 0x7f8088133d50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f807c009840 tx=0x7f807c009b50 comp rx=0 tx=0).stop 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f808f1d7700 1 -- 172.21.15.154:0/2559163217 shutdown_connections 2023-09-30T22:21:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f808f1d7700 1 --2- 172.21.15.154:0/2559163217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088133980 0x7f8088133d50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f808f1d7700 1 --2- 172.21.15.154:0/2559163217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f808809de70 0x7f808809e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f808f1d7700 1 -- 172.21.15.154:0/2559163217 >> 172.21.15.154:0/2559163217 conn(0x7f808809f3f0 msgr2=0x7f808809f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f808f1d7700 1 -- 172.21.15.154:0/2559163217 shutdown_connections 2023-09-30T22:21:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.584+0000 7f808f1d7700 1 -- 172.21.15.154:0/2559163217 wait complete. 2023-09-30T22:21:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.585+0000 7f808f1d7700 1 Processor -- start 2023-09-30T22:21:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.585+0000 7f808f1d7700 1 -- start start 2023-09-30T22:21:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808f1d7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f808809de70 0x7f80881c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808f1d7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f808809e800 0x7f80881c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808f1d7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8088133980 0x7f80881c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808f1d7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808811e370 con 0x7f808809de70 2023-09-30T22:21:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808f1d7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808811ea20 con 0x7f8088133980 2023-09-30T22:21:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808f1d7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f808811deb0 con 0x7f808809e800 2023-09-30T22:21:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808cf73700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f808809de70 0x7f80881c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808d774700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8088133980 0x7f80881c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808cf73700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f808809de70 0x7f80881c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37554/0 (socket says 172.21.15.154:37554) 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808cf73700 1 -- 172.21.15.154:0/2893713025 learned_addr learned my addr 172.21.15.154:0/2893713025 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f8087fff700 1 --2- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f808809e800 0x7f80881c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808d774700 1 -- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f808809e800 msgr2=0x7f80881c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808d774700 1 --2- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f808809e800 0x7f80881c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808d774700 1 -- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f808809de70 msgr2=0x7f80881c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808d774700 1 --2- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f808809de70 0x7f80881c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808d774700 1 -- 172.21.15.154:0/2893713025 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80740094a0 con 0x7f8088133980 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808cf73700 1 --2- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f808809de70 0x7f80881c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808d774700 1 --2- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8088133980 0x7f80881c4910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f808000ca80 tx=0x7f808000cd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f80857fa700 1 -- 172.21.15.154:0/2893713025 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808000a9e0 con 0x7f8088133980 2023-09-30T22:21:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f80857fa700 1 -- 172.21.15.154:0/2893713025 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808000ab40 con 0x7f8088133980 2023-09-30T22:21:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c0094a0 con 0x7f8088133980 2023-09-30T22:21:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f80857fa700 1 -- 172.21.15.154:0/2893713025 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080012400 con 0x7f8088133980 2023-09-30T22:21:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.586+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808811d0b0 con 0x7f8088133980 2023-09-30T22:21:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.587+0000 7f80857fa700 1 -- 172.21.15.154:0/2893713025 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f808001b3b0 con 0x7f8088133980 2023-09-30T22:21:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.587+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808804f2a0 con 0x7f8088133980 2023-09-30T22:21:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.587+0000 7f80857fa700 1 -- 172.21.15.154:0/2893713025 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f808003f700 con 0x7f8088133980 2023-09-30T22:21:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.592+0000 7f80857fa700 1 -- 172.21.15.154:0/2893713025 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8080017080 con 0x7f8088133980 2023-09-30T22:21:58.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.776+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f808806fc60 con 0x7f8088133980 2023-09-30T22:21:58.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.776+0000 7f80857fa700 1 -- 172.21.15.154:0/2893713025 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80800192c0 con 0x7f8088133980 2023-09-30T22:21:58.777 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-09-30T22:21:58.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 >> v1:172.21.15.154:6816/126757 conn(0x7f806c02f510 legacy=0x7f806c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8088133980 msgr2=0x7f80881c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 --2- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8088133980 0x7f80881c4910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f808000ca80 tx=0x7f808000cd90 comp rx=0 tx=0).stop 2023-09-30T22:21:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 shutdown_connections 2023-09-30T22:21:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 --2- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8088133980 0x7f80881c4910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 --2- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f808809de70 0x7f80881c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 --2- 172.21.15.154:0/2893713025 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f808809e800 0x7f80881c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 >> 172.21.15.154:0/2893713025 conn(0x7f808809f3f0 msgr2=0x7f8088130630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 shutdown_connections 2023-09-30T22:21:58.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.778+0000 7f808f1d7700 1 -- 172.21.15.154:0/2893713025 wait complete. 2023-09-30T22:21:58.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:21:58.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.913+0000 7f5987a97700 1 Processor -- start 2023-09-30T22:21:58.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.913+0000 7f5987a97700 1 -- start start 2023-09-30T22:21:58.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5987a97700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598009d780 0x7f598009db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5987a97700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5980130d90 0x7f5980138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5987a97700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598009e910 con 0x7f598009e090 2023-09-30T22:21:58.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5987a97700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598009d430 con 0x7f5980130d90 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5987a97700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f598009b380 con 0x7f598009d780 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5985833700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598009d780 0x7f598009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5986034700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5980130d90 0x7f5980138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5986034700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5980130d90 0x7f5980138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37562/0 (socket says 172.21.15.154:37562) 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5985032700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f598009e090 0x7f5980130680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38408/0 (socket says 172.21.15.154:38408) 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5985833700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598009d780 0x7f598009db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60814/0 (socket says 172.21.15.154:60814) 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5986034700 1 -- 172.21.15.154:0/1511817083 learned_addr learned my addr 172.21.15.154:0/1511817083 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5986034700 1 -- 172.21.15.154:0/1511817083 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598009d780 msgr2=0x7f598009db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5986034700 1 --2- 172.21.15.154:0/1511817083 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598009d780 0x7f598009db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5986034700 1 -- 172.21.15.154:0/1511817083 >> v1:172.21.15.154:6789/0 conn(0x7f598009e090 legacy=0x7f5980130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5986034700 1 -- 172.21.15.154:0/1511817083 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598009f570 con 0x7f5980130d90 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5984831700 1 -- 172.21.15.154:0/1511817083 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199470708 0 0) 0x7f598009e910 con 0x7f598009e090 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5985833700 1 --2- 172.21.15.154:0/1511817083 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598009d780 0x7f598009db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5986034700 1 --2- 172.21.15.154:0/1511817083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5980130d90 0x7f5980138af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5978009e50 tx=0x7f597800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b7952fe46c7c01 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5984831700 1 -- 172.21.15.154:0/1511817083 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597800e070 con 0x7f5980130d90 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5984831700 1 -- 172.21.15.154:0/1511817083 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597800b910 con 0x7f5980130d90 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.914+0000 7f5984831700 1 -- 172.21.15.154:0/1511817083 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597800bcc0 con 0x7f5980130d90 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.915+0000 7f5987a97700 1 -- 172.21.15.154:0/1511817083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5980130d90 msgr2=0x7f5980138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.915+0000 7f5987a97700 1 --2- 172.21.15.154:0/1511817083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5980130d90 0x7f5980138af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5978009e50 tx=0x7f597800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.915+0000 7f5987a97700 1 -- 172.21.15.154:0/1511817083 shutdown_connections 2023-09-30T22:21:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.915+0000 7f5987a97700 1 --2- 172.21.15.154:0/1511817083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5980130d90 0x7f5980138af0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.915+0000 7f5987a97700 1 --2- 172.21.15.154:0/1511817083 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598009d780 0x7f598009db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.915+0000 7f5987a97700 1 -- 172.21.15.154:0/1511817083 >> 172.21.15.154:0/1511817083 conn(0x7f598009f980 msgr2=0x7f598009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.915+0000 7f5987a97700 1 -- 172.21.15.154:0/1511817083 shutdown_connections 2023-09-30T22:21:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.915+0000 7f5987a97700 1 -- 172.21.15.154:0/1511817083 wait complete. 2023-09-30T22:21:58.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.916+0000 7f5987a97700 1 Processor -- start 2023-09-30T22:21:58.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.916+0000 7f5987a97700 1 -- start start 2023-09-30T22:21:58.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.916+0000 7f5987a97700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598009d780 0x7f598011f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.916+0000 7f5987a97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f598009e090 0x7f598011f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.916+0000 7f5987a97700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5980130d90 0x7f598011fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:58.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.916+0000 7f5987a97700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980121470 con 0x7f598009d780 2023-09-30T22:21:58.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5987a97700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598012d330 con 0x7f598009e090 2023-09-30T22:21:58.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5987a97700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5980120480 con 0x7f5980130d90 2023-09-30T22:21:58.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985833700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598009d780 0x7f598011f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985032700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f598009e090 0x7f598011f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5986034700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5980130d90 0x7f598011fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985833700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598009d780 0x7f598011f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37574/0 (socket says 172.21.15.154:37574) 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985833700 1 -- 172.21.15.154:0/3792650380 learned_addr learned my addr 172.21.15.154:0/3792650380 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985833700 1 -- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5980130d90 msgr2=0x7f598011fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985833700 1 --2- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5980130d90 0x7f598011fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985833700 1 -- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f598009e090 msgr2=0x7f598011f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985833700 1 --2- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f598009e090 0x7f598011f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985833700 1 -- 172.21.15.154:0/3792650380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597000b740 con 0x7f598009d780 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5985833700 1 --2- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598009d780 0x7f598011f090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f597000ed70 tx=0x7f597000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:58.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f59767fc700 1 -- 172.21.15.154:0/3792650380 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597000ee60 con 0x7f598009d780 2023-09-30T22:21:58.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f59767fc700 1 -- 172.21.15.154:0/3792650380 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5970010440 con 0x7f598009d780 2023-09-30T22:21:58.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5978009b30 con 0x7f598009d780 2023-09-30T22:21:58.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f59767fc700 1 -- 172.21.15.154:0/3792650380 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59700107b0 con 0x7f598009d780 2023-09-30T22:21:58.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.917+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59800a3b60 con 0x7f598009d780 2023-09-30T22:21:58.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.918+0000 7f59767fc700 1 -- 172.21.15.154:0/3792650380 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5970010910 con 0x7f598009d780 2023-09-30T22:21:58.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.918+0000 7f59767fc700 1 -- 172.21.15.154:0/3792650380 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f59700403c0 con 0x7f598009d780 2023-09-30T22:21:58.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.918+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5980071080 con 0x7f598009d780 2023-09-30T22:21:58.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:58.923+0000 7f59767fc700 1 -- 172.21.15.154:0/3792650380 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f597001d020 con 0x7f598009d780 2023-09-30T22:21:59.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.107+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5980121df0 con 0x7f598009d780 2023-09-30T22:21:59.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.107+0000 7f59767fc700 1 -- 172.21.15.154:0/3792650380 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5970017720 con 0x7f598009d780 2023-09-30T22:21:59.108 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 8 2023-09-30T22:21:59.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.109+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 >> v1:172.21.15.154:6816/126757 conn(0x7f596402f510 legacy=0x7f59640319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.109+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598009d780 msgr2=0x7f598011f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.109+0000 7f5987a97700 1 --2- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598009d780 0x7f598011f090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f597000ed70 tx=0x7f597000d630 comp rx=0 tx=0).stop 2023-09-30T22:21:59.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.110+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 shutdown_connections 2023-09-30T22:21:59.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.110+0000 7f5987a97700 1 --2- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5980130d90 0x7f598011fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.110+0000 7f5987a97700 1 --2- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598009d780 0x7f598011f090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.110+0000 7f5987a97700 1 --2- 172.21.15.154:0/3792650380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f598009e090 0x7f598011f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.110+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 >> 172.21.15.154:0/3792650380 conn(0x7f598009f980 msgr2=0x7f598012ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.110+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 shutdown_connections 2023-09-30T22:21:59.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.110+0000 7f5987a97700 1 -- 172.21.15.154:0/3792650380 wait complete. 2023-09-30T22:21:59.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:21:59.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.246+0000 7fa1987c7700 1 Processor -- start 2023-09-30T22:21:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa1987c7700 1 -- start start 2023-09-30T22:21:59.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa1987c7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa190133a10 0x7fa190133de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa1987c7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19006ea60 0x7fa19009de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa1987c7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa19009e3b0 0x7fa19009e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa1987c7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa190070020 con 0x7fa19009e3b0 2023-09-30T22:21:59.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa1987c7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa190070990 con 0x7fa19006ea60 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa1987c7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1901335e0 con 0x7fa190133a10 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa196d64700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa19009e3b0 0x7fa19009e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa196563700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa190133a10 0x7fa190133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa196d64700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa19009e3b0 0x7fa19009e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37582/0 (socket says 172.21.15.154:37582) 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa196563700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa190133a10 0x7fa190133de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60832/0 (socket says 172.21.15.154:60832) 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa196d64700 1 -- 172.21.15.154:0/3425565836 learned_addr learned my addr 172.21.15.154:0/3425565836 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.247+0000 7fa195d62700 1 --2- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19006ea60 0x7fa19009de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa196d64700 1 -- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa190133a10 msgr2=0x7fa190133de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa196d64700 1 --2- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa190133a10 0x7fa190133de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa196d64700 1 -- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19006ea60 msgr2=0x7fa19009de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa196d64700 1 --2- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19006ea60 0x7fa19009de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa196d64700 1 -- 172.21.15.154:0/3425565836 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19006f430 con 0x7fa19009e3b0 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa195d62700 1 --2- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19006ea60 0x7fa19009de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa196d64700 1 --2- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19009e3b0 0x7fa19009e820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa188009e50 tx=0x7fa18800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fc85885b5776d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa195561700 1 -- 172.21.15.154:0/3425565836 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800e070 con 0x7fa19009e3b0 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa195561700 1 -- 172.21.15.154:0/3425565836 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18800b910 con 0x7fa19009e3b0 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa195561700 1 -- 172.21.15.154:0/3425565836 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800bcc0 con 0x7fa19009e3b0 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa1987c7700 1 -- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19009e3b0 msgr2=0x7fa19009e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa1987c7700 1 --2- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19009e3b0 0x7fa19009e820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa188009e50 tx=0x7fa18800b330 comp rx=0 tx=0).stop 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa1987c7700 1 -- 172.21.15.154:0/3425565836 shutdown_connections 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.248+0000 7fa1987c7700 1 --2- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19009e3b0 0x7fa19009e820 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.249+0000 7fa1987c7700 1 --2- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa190133a10 0x7fa190133de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.249+0000 7fa1987c7700 1 --2- 172.21.15.154:0/3425565836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19006ea60 0x7fa19009de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.249+0000 7fa1987c7700 1 -- 172.21.15.154:0/3425565836 >> 172.21.15.154:0/3425565836 conn(0x7fa19009f3f0 msgr2=0x7fa19009f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.249+0000 7fa1987c7700 1 -- 172.21.15.154:0/3425565836 shutdown_connections 2023-09-30T22:21:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.249+0000 7fa1987c7700 1 -- 172.21.15.154:0/3425565836 wait complete. 2023-09-30T22:21:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.249+0000 7fa1987c7700 1 Processor -- start 2023-09-30T22:21:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa1987c7700 1 -- start start 2023-09-30T22:21:59.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa1987c7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19006ea60 0x7fa19011fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa1987c7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19009e3b0 0x7fa1901200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa1987c7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa190133a10 0x7fa190120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa1987c7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190124130 con 0x7fa19009e3b0 2023-09-30T22:21:59.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa1987c7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa190123270 con 0x7fa190133a10 2023-09-30T22:21:59.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa1987c7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa190071a00 con 0x7fa19006ea60 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196d64700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa190133a10 0x7fa190120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa195d62700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19009e3b0 0x7fa1901200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196d64700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa190133a10 0x7fa190120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37034/0 (socket says 172.21.15.154:37034) 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196d64700 1 -- 172.21.15.154:0/1931489340 learned_addr learned my addr 172.21.15.154:0/1931489340 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196563700 1 --2- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19006ea60 0x7fa19011fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196d64700 1 -- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19006ea60 msgr2=0x7fa19011fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196d64700 1 --2- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19006ea60 0x7fa19011fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196d64700 1 -- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19009e3b0 msgr2=0x7fa1901200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196d64700 1 --2- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19009e3b0 0x7fa1901200e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196d64700 1 -- 172.21.15.154:0/1931489340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0094a0 con 0x7fa190133a10 2023-09-30T22:21:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.250+0000 7fa196d64700 1 --2- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa190133a10 0x7fa190120620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa18800b680 tx=0x7fa188004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.251+0000 7fa186ffd700 1 -- 172.21.15.154:0/1931489340 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880099b0 con 0x7fa190133a10 2023-09-30T22:21:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.251+0000 7fa186ffd700 1 -- 172.21.15.154:0/1931489340 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18800ce80 con 0x7fa190133a10 2023-09-30T22:21:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.251+0000 7fa186ffd700 1 -- 172.21.15.154:0/1931489340 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188004470 con 0x7fa190133a10 2023-09-30T22:21:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.251+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa188009b30 con 0x7fa190133a10 2023-09-30T22:21:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.251+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1901215d0 con 0x7fa190133a10 2023-09-30T22:21:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.251+0000 7fa186ffd700 1 -- 172.21.15.154:0/1931489340 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa1880045d0 con 0x7fa190133a10 2023-09-30T22:21:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.251+0000 7fa186ffd700 1 -- 172.21.15.154:0/1931489340 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fa1880411b0 con 0x7fa190133a10 2023-09-30T22:21:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.252+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19004f2a0 con 0x7fa190133a10 2023-09-30T22:21:59.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.256+0000 7fa186ffd700 1 -- 172.21.15.154:0/1931489340 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa188011390 con 0x7fa190133a10 2023-09-30T22:21:59.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.439+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1901234b0 con 0x7fa190133a10 2023-09-30T22:21:59.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.440+0000 7fa186ffd700 1 -- 172.21.15.154:0/1931489340 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa18801bb90 con 0x7fa190133a10 2023-09-30T22:21:59.441 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-09-30T22:21:59.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 >> v1:172.21.15.154:6816/126757 conn(0x7fa17402f510 legacy=0x7fa1740319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa190133a10 msgr2=0x7fa190120620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 --2- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa190133a10 0x7fa190120620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa18800b680 tx=0x7fa188004ad0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 shutdown_connections 2023-09-30T22:21:59.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 --2- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa190133a10 0x7fa190120620 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 --2- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19006ea60 0x7fa19011fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 --2- 172.21.15.154:0/1931489340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19009e3b0 0x7fa1901200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 >> 172.21.15.154:0/1931489340 conn(0x7fa19009f3f0 msgr2=0x7fa190131550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 shutdown_connections 2023-09-30T22:21:59.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.442+0000 7fa1987c7700 1 -- 172.21.15.154:0/1931489340 wait complete. 2023-09-30T22:21:59.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:21:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.578+0000 7fb63e744700 1 Processor -- start 2023-09-30T22:21:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.578+0000 7fb63e744700 1 -- start start 2023-09-30T22:21:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb63e744700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb638138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb63e744700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb63809e260 0x7fb63813b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb63e744700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63809a590 con 0x7fb63809d780 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb63e744700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63806b450 con 0x7fb63809e260 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb63e744700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63806a9e0 con 0x7fb63809ad70 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb6377fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb638138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb63cce1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb63809e260 0x7fb63813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb6377fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb638138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37036/0 (socket says 172.21.15.154:37036) 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb637fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb63809d780 0x7fb63809db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38420/0 (socket says 172.21.15.154:38420) 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb6377fe700 1 -- 172.21.15.154:0/1780534627 learned_addr learned my addr 172.21.15.154:0/1780534627 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb6377fe700 1 -- 172.21.15.154:0/1780534627 >> v2:172.21.15.154:3300/0 conn(0x7fb63809e260 msgr2=0x7fb63813b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb6377fe700 1 --2- 172.21.15.154:0/1780534627 >> v2:172.21.15.154:3300/0 conn(0x7fb63809e260 0x7fb63813b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb6377fe700 1 -- 172.21.15.154:0/1780534627 >> v1:172.21.15.154:6789/0 conn(0x7fb63809d780 legacy=0x7fb63809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb6377fe700 1 -- 172.21.15.154:0/1780534627 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63809a870 con 0x7fb63809ad70 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb636ffd700 1 -- 172.21.15.154:0/1780534627 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959736261 0 0) 0x7fb63809a590 con 0x7fb63809d780 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb63cce1700 1 --2- 172.21.15.154:0/1780534627 >> v2:172.21.15.154:3300/0 conn(0x7fb63809e260 0x7fb63813b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.579+0000 7fb6377fe700 1 --2- 172.21.15.154:0/1780534627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb638138cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098f0 tx=0x7fb628009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb5227ef3032eda9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb636ffd700 1 -- 172.21.15.154:0/1780534627 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628011830 con 0x7fb63809ad70 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb636ffd700 1 -- 172.21.15.154:0/1780534627 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628011990 con 0x7fb63809ad70 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb636ffd700 1 -- 172.21.15.154:0/1780534627 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628011d20 con 0x7fb63809ad70 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb63e744700 1 -- 172.21.15.154:0/1780534627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 msgr2=0x7fb638138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb63e744700 1 --2- 172.21.15.154:0/1780534627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb638138cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb6280098f0 tx=0x7fb628009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb63e744700 1 -- 172.21.15.154:0/1780534627 shutdown_connections 2023-09-30T22:21:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb63e744700 1 --2- 172.21.15.154:0/1780534627 >> v2:172.21.15.154:3300/0 conn(0x7fb63809e260 0x7fb63813b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb63e744700 1 --2- 172.21.15.154:0/1780534627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb638138cc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb63e744700 1 -- 172.21.15.154:0/1780534627 >> 172.21.15.154:0/1780534627 conn(0x7fb63809f980 msgr2=0x7fb63809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb63e744700 1 -- 172.21.15.154:0/1780534627 shutdown_connections 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.580+0000 7fb63e744700 1 -- 172.21.15.154:0/1780534627 wait complete. 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.581+0000 7fb63e744700 1 Processor -- start 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.581+0000 7fb63e744700 1 -- start start 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63e744700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb63811f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63e744700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb63809d780 0x7fb63811f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63e744700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63809e260 0x7fb63811fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63e744700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb638122650 con 0x7fb63809e260 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63e744700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63809c710 con 0x7fb63809ad70 2023-09-30T22:21:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63e744700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380a2140 con 0x7fb63809d780 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63cce1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63809e260 0x7fb63811fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb6377fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb63809d780 0x7fb63811f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb6377fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb63809d780 0x7fb63811f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60854/0 (socket says 172.21.15.154:60854) 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63cce1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63809e260 0x7fb63811fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37612/0 (socket says 172.21.15.154:37612) 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb6377fe700 1 -- 172.21.15.154:0/168756141 learned_addr learned my addr 172.21.15.154:0/168756141 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb637fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb63811f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63cce1700 1 -- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb63809d780 msgr2=0x7fb63811f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63cce1700 1 --2- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb63809d780 0x7fb63811f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63cce1700 1 -- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 msgr2=0x7fb63811f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63cce1700 1 --2- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb63811f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63cce1700 1 -- 172.21.15.154:0/168756141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630009a70 con 0x7fb63809e260 2023-09-30T22:21:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63cce1700 1 --2- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63809e260 0x7fb63811fe00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb63000efc0 tx=0x7fb63000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb634ff9700 1 -- 172.21.15.154:0/168756141 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000ca90 con 0x7fb63809e260 2023-09-30T22:21:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb634ff9700 1 -- 172.21.15.154:0/168756141 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63000f040 con 0x7fb63809e260 2023-09-30T22:21:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb628009550 con 0x7fb63809e260 2023-09-30T22:21:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb634ff9700 1 -- 172.21.15.154:0/168756141 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000ce30 con 0x7fb63809e260 2023-09-30T22:21:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.582+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb638122140 con 0x7fb63809e260 2023-09-30T22:21:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.583+0000 7fb634ff9700 1 -- 172.21.15.154:0/168756141 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb630014480 con 0x7fb63809e260 2023-09-30T22:21:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.583+0000 7fb634ff9700 1 -- 172.21.15.154:0/168756141 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fb6300401a0 con 0x7fb63809e260 2023-09-30T22:21:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.583+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb638121750 con 0x7fb63809e260 2023-09-30T22:21:59.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.588+0000 7fb634ff9700 1 -- 172.21.15.154:0/168756141 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb630018080 con 0x7fb63809e260 2023-09-30T22:21:59.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.769+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6381229a0 con 0x7fb63809e260 2023-09-30T22:21:59.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.769+0000 7fb634ff9700 1 -- 172.21.15.154:0/168756141 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb630012930 con 0x7fb63809e260 2023-09-30T22:21:59.770 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-09-30T22:21:59.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 >> v1:172.21.15.154:6816/126757 conn(0x7fb62402f510 legacy=0x7fb6240319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63809e260 msgr2=0x7fb63811fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 --2- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63809e260 0x7fb63811fe00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb63000efc0 tx=0x7fb63000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 shutdown_connections 2023-09-30T22:21:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 --2- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63809e260 0x7fb63811fe00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 --2- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb63809ad70 0x7fb63811f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 --2- 172.21.15.154:0/168756141 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb63809d780 0x7fb63811f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 >> 172.21.15.154:0/168756141 conn(0x7fb63809f980 msgr2=0x7fb638070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 shutdown_connections 2023-09-30T22:21:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.771+0000 7fb63e744700 1 -- 172.21.15.154:0/168756141 wait complete. 2023-09-30T22:21:59.784 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:21:59.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.904+0000 7f6a499fe700 1 Processor -- start 2023-09-30T22:21:59.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.904+0000 7f6a499fe700 1 -- start start 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.904+0000 7f6a499fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a4409f430 0x7f6a44138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.904+0000 7f6a499fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a441391f0 0x7f6a4413b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.904+0000 7f6a499fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4409ac20 con 0x7f6a4409e950 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.904+0000 7f6a499fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440a06c0 con 0x7f6a441391f0 2023-09-30T22:21:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.904+0000 7f6a499fe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4409ae90 con 0x7f6a4409f430 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a427fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a4409f430 0x7f6a44138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a437fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a441391f0 0x7f6a4413b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a427fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a4409f430 0x7f6a44138cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60858/0 (socket says 172.21.15.154:60858) 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a427fc700 1 -- 172.21.15.154:0/66932430 learned_addr learned my addr 172.21.15.154:0/66932430 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a42ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6a4409e950 0x7f6a4409ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38424/0 (socket says 172.21.15.154:38424) 2023-09-30T22:21:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a427fc700 1 -- 172.21.15.154:0/66932430 >> v2:172.21.15.154:3300/0 conn(0x7f6a441391f0 msgr2=0x7f6a4413b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a427fc700 1 --2- 172.21.15.154:0/66932430 >> v2:172.21.15.154:3300/0 conn(0x7f6a441391f0 0x7f6a4413b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a427fc700 1 -- 172.21.15.154:0/66932430 >> v1:172.21.15.154:6789/0 conn(0x7f6a4409e950 legacy=0x7f6a4409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a427fc700 1 -- 172.21.15.154:0/66932430 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4406ba00 con 0x7f6a4409f430 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a41ffb700 1 -- 172.21.15.154:0/66932430 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934899795 0 0) 0x7f6a4409ac20 con 0x7f6a4409e950 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a437fe700 1 --2- 172.21.15.154:0/66932430 >> v2:172.21.15.154:3300/0 conn(0x7f6a441391f0 0x7f6a4413b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a427fc700 1 --2- 172.21.15.154:0/66932430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a4409f430 0x7f6a44138cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a340098f0 tx=0x7f6a34009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc4de9904d26a6d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a41ffb700 1 -- 172.21.15.154:0/66932430 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34011830 con 0x7f6a4409f430 2023-09-30T22:21:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a41ffb700 1 -- 172.21.15.154:0/66932430 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a34011990 con 0x7f6a4409f430 2023-09-30T22:21:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.905+0000 7f6a41ffb700 1 -- 172.21.15.154:0/66932430 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34011d20 con 0x7f6a4409f430 2023-09-30T22:21:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.906+0000 7f6a499fe700 1 -- 172.21.15.154:0/66932430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a4409f430 msgr2=0x7f6a44138cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.906+0000 7f6a499fe700 1 --2- 172.21.15.154:0/66932430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a4409f430 0x7f6a44138cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a340098f0 tx=0x7f6a34009c00 comp rx=0 tx=0).stop 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.906+0000 7f6a499fe700 1 -- 172.21.15.154:0/66932430 shutdown_connections 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.906+0000 7f6a499fe700 1 --2- 172.21.15.154:0/66932430 >> v2:172.21.15.154:3300/0 conn(0x7f6a441391f0 0x7f6a4413b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.906+0000 7f6a499fe700 1 --2- 172.21.15.154:0/66932430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a4409f430 0x7f6a44138cb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.906+0000 7f6a499fe700 1 -- 172.21.15.154:0/66932430 >> 172.21.15.154:0/66932430 conn(0x7f6a440a0f70 msgr2=0x7f6a440a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.906+0000 7f6a499fe700 1 -- 172.21.15.154:0/66932430 shutdown_connections 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.906+0000 7f6a499fe700 1 -- 172.21.15.154:0/66932430 wait complete. 2023-09-30T22:21:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a499fe700 1 Processor -- start 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a499fe700 1 -- start start 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a499fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a4409e950 0x7f6a44121930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a499fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a4409f430 0x7f6a44121e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a499fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a441391f0 0x7f6a441223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a499fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44125170 con 0x7f6a4409f430 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a499fe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44124c50 con 0x7f6a4409e950 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a499fe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4409e220 con 0x7f6a441391f0 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a42ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a4409e950 0x7f6a44121930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a437fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a441391f0 0x7f6a441223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a4409f430 0x7f6a44121e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a437fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a441391f0 0x7f6a441223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60866/0 (socket says 172.21.15.154:60866) 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a437fe700 1 -- 172.21.15.154:0/933314315 learned_addr learned my addr 172.21.15.154:0/933314315 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a4409f430 0x7f6a44121e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37622/0 (socket says 172.21.15.154:37622) 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.907+0000 7f6a42ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a4409e950 0x7f6a44121930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37062/0 (socket says 172.21.15.154:37062) 2023-09-30T22:21:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a427fc700 1 -- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a441391f0 msgr2=0x7f6a441223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a427fc700 1 --2- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a441391f0 0x7f6a441223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a427fc700 1 -- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a4409e950 msgr2=0x7f6a44121930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:21:59.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a427fc700 1 --2- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a4409e950 0x7f6a44121930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:21:59.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a427fc700 1 -- 172.21.15.154:0/933314315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c009a70 con 0x7f6a4409f430 2023-09-30T22:21:59.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a437fe700 1 --2- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a441391f0 0x7f6a441223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:21:59.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a427fc700 1 --2- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a4409f430 0x7f6a44121e70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a34016000 tx=0x7f6a34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:21:59.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a2bfff700 1 -- 172.21.15.154:0/933314315 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34004550 con 0x7f6a4409f430 2023-09-30T22:21:59.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a2bfff700 1 -- 172.21.15.154:0/933314315 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3401f070 con 0x7f6a4409f430 2023-09-30T22:21:59.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a34009550 con 0x7f6a4409f430 2023-09-30T22:21:59.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a2bfff700 1 -- 172.21.15.154:0/933314315 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a340038e0 con 0x7f6a4409f430 2023-09-30T22:21:59.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.908+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a44125be0 con 0x7f6a4409f430 2023-09-30T22:21:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.909+0000 7f6a2bfff700 1 -- 172.21.15.154:0/933314315 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6a34003a40 con 0x7f6a4409f430 2023-09-30T22:21:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.909+0000 7f6a2bfff700 1 -- 172.21.15.154:0/933314315 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f6a34021070 con 0x7f6a4409f430 2023-09-30T22:21:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.909+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a440a0160 con 0x7f6a4409f430 2023-09-30T22:21:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:21:59.914+0000 7f6a2bfff700 1 -- 172.21.15.154:0/933314315 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a3401a430 con 0x7f6a4409f430 2023-09-30T22:22:00.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.141+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a4404f2a0 con 0x7f6a4409f430 2023-09-30T22:22:00.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.141+0000 7f6a2bfff700 1 -- 172.21.15.154:0/933314315 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2317 (secure 0 0 0) 0x7f6a34034920 con 0x7f6a4409f430 2023-09-30T22:22:00.142 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:00.142 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:19:33.620776+0000","modified":"2023-09-30T22:19:56.792269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:22:00.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.143+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 >> v1:172.21.15.154:6816/126757 conn(0x7f6a3002f510 legacy=0x7f6a300319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.143+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a4409f430 msgr2=0x7f6a44121e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.143+0000 7f6a499fe700 1 --2- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a4409f430 0x7f6a44121e70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a34016000 tx=0x7f6a34004750 comp rx=0 tx=0).stop 2023-09-30T22:22:00.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.143+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 shutdown_connections 2023-09-30T22:22:00.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.143+0000 7f6a499fe700 1 --2- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a441391f0 0x7f6a441223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.143+0000 7f6a499fe700 1 --2- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a4409e950 0x7f6a44121930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.143+0000 7f6a499fe700 1 --2- 172.21.15.154:0/933314315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a4409f430 0x7f6a44121e70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.143+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 >> 172.21.15.154:0/933314315 conn(0x7f6a440a0f70 msgr2=0x7f6a44070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.143+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 shutdown_connections 2023-09-30T22:22:00.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.144+0000 7f6a499fe700 1 -- 172.21.15.154:0/933314315 wait complete. 2023-09-30T22:22:00.145 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-09-30T22:22:00.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:00.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.276+0000 7fc6d6119700 1 Processor -- start 2023-09-30T22:22:00.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.276+0000 7fc6d6119700 1 -- start start 2023-09-30T22:22:00.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6d6119700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc6d0136960 0x7fc6d0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6d6119700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6d6119700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d006b2d0 con 0x7fc6d0133ad0 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6d6119700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d01345b0 con 0x7fc6d0136960 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6d6119700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d0133610 con 0x7fc6d0139280 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6cffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6ceffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc6d0136960 0x7fc6d0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6cf7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc6d0133ad0 0x7fc6d0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38440/0 (socket says 172.21.15.154:38440) 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6cf7fe700 1 -- 172.21.15.154:0/676125439 learned_addr learned my addr 172.21.15.154:0/676125439 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6cffff700 1 -- 172.21.15.154:0/676125439 >> v2:172.21.15.154:3300/0 conn(0x7fc6d0136960 msgr2=0x7fc6d0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6cffff700 1 --2- 172.21.15.154:0/676125439 >> v2:172.21.15.154:3300/0 conn(0x7fc6d0136960 0x7fc6d0138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6cffff700 1 -- 172.21.15.154:0/676125439 >> v1:172.21.15.154:6789/0 conn(0x7fc6d0133ad0 legacy=0x7fc6d0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6cffff700 1 -- 172.21.15.154:0/676125439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d009a500 con 0x7fc6d0139280 2023-09-30T22:22:00.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6ce7fc700 1 -- 172.21.15.154:0/676125439 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304219907 0 0) 0x7fc6d006b2d0 con 0x7fc6d0133ad0 2023-09-30T22:22:00.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6ceffd700 1 --2- 172.21.15.154:0/676125439 >> v2:172.21.15.154:3300/0 conn(0x7fc6d0136960 0x7fc6d0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.277+0000 7fc6cffff700 1 --2- 172.21.15.154:0/676125439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d013b660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009d90 tx=0x7fc6c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54c6f67f51a7dcea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6ce7fc700 1 -- 172.21.15.154:0/676125439 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800e070 con 0x7fc6d0139280 2023-09-30T22:22:00.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6ce7fc700 1 -- 172.21.15.154:0/676125439 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c800bb20 con 0x7fc6d0139280 2023-09-30T22:22:00.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6ce7fc700 1 -- 172.21.15.154:0/676125439 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8012430 con 0x7fc6d0139280 2023-09-30T22:22:00.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6d6119700 1 -- 172.21.15.154:0/676125439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 msgr2=0x7fc6d013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6d6119700 1 --2- 172.21.15.154:0/676125439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d013b660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009d90 tx=0x7fc6c800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:00.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6d6119700 1 -- 172.21.15.154:0/676125439 shutdown_connections 2023-09-30T22:22:00.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6d6119700 1 --2- 172.21.15.154:0/676125439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d013b660 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6d6119700 1 --2- 172.21.15.154:0/676125439 >> v2:172.21.15.154:3300/0 conn(0x7fc6d0136960 0x7fc6d0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6d6119700 1 -- 172.21.15.154:0/676125439 >> 172.21.15.154:0/676125439 conn(0x7fc6d0099c40 msgr2=0x7fc6d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6d6119700 1 -- 172.21.15.154:0/676125439 shutdown_connections 2023-09-30T22:22:00.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.278+0000 7fc6d6119700 1 -- 172.21.15.154:0/676125439 wait complete. 2023-09-30T22:22:00.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.279+0000 7fc6d6119700 1 Processor -- start 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.279+0000 7fc6d6119700 1 -- start start 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6d6119700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6d0133ad0 0x7fc6d012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6d6119700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6d0136960 0x7fc6d012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6d6119700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6d6119700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d0130420 con 0x7fc6d0133ad0 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6d6119700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d0072600 con 0x7fc6d0136960 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6d6119700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d012dd00 con 0x7fc6d0139280 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6d0133ad0 0x7fc6d012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6d0133ad0 0x7fc6d012cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37642/0 (socket says 172.21.15.154:37642) 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cf7fe700 1 -- 172.21.15.154:0/3470943357 learned_addr learned my addr 172.21.15.154:0/3470943357 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d012d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60878/0 (socket says 172.21.15.154:60878) 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6ceffd700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6d0136960 0x7fc6d012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cf7fe700 1 -- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 msgr2=0x7fc6d012d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cf7fe700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d012d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cf7fe700 1 -- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6d0136960 msgr2=0x7fc6d012d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cf7fe700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6d0136960 0x7fc6d012d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cf7fe700 1 -- 172.21.15.154:0/3470943357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40094a0 con 0x7fc6d0133ad0 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6ceffd700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6d0136960 0x7fc6d012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cffff700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6cf7fe700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6d0133ad0 0x7fc6d012cb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c520 tx=0x7fc6c000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6b7fff700 1 -- 172.21.15.154:0/3470943357 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0004c80 con 0x7fc6d0133ad0 2023-09-30T22:22:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6b7fff700 1 -- 172.21.15.154:0/3470943357 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c0004de0 con 0x7fc6d0133ad0 2023-09-30T22:22:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6b7fff700 1 -- 172.21.15.154:0/3470943357 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0007310 con 0x7fc6d0133ad0 2023-09-30T22:22:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.280+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c8009a70 con 0x7fc6d0133ad0 2023-09-30T22:22:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.281+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d006fa10 con 0x7fc6d0133ad0 2023-09-30T22:22:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.281+0000 7fc6b7fff700 1 -- 172.21.15.154:0/3470943357 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc6c0007470 con 0x7fc6d0133ad0 2023-09-30T22:22:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.281+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d004f2a0 con 0x7fc6d0133ad0 2023-09-30T22:22:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.281+0000 7fc6b7fff700 1 -- 172.21.15.154:0/3470943357 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fc6c003f710 con 0x7fc6d0133ad0 2023-09-30T22:22:00.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.286+0000 7fc6b7fff700 1 -- 172.21.15.154:0/3470943357 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6c00106d0 con 0x7fc6d0133ad0 2023-09-30T22:22:00.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.469+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6d006c3b0 con 0x7fc6d0133ad0 2023-09-30T22:22:00.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.470+0000 7fc6b7fff700 1 -- 172.21.15.154:0/3470943357 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12898 (secure 0 0 0) 0x7fc6c00102c0 con 0x7fc6d0133ad0 2023-09-30T22:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":23,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:21:53.942341+0000","last_up_change":"2023-09-30T22:19:27.225292+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:00.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 >> v1:172.21.15.154:6816/126757 conn(0x7fc6bc02f510 legacy=0x7fc6bc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6d0133ad0 msgr2=0x7fc6d012cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6d0133ad0 0x7fc6d012cb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c520 tx=0x7fc6c000c830 comp rx=0 tx=0).stop 2023-09-30T22:22:00.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 shutdown_connections 2023-09-30T22:22:00.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6d0139280 0x7fc6d012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6d0133ad0 0x7fc6d012cb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 --2- 172.21.15.154:0/3470943357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6d0136960 0x7fc6d012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 >> 172.21.15.154:0/3470943357 conn(0x7fc6d0099c40 msgr2=0x7fc6d0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 shutdown_connections 2023-09-30T22:22:00.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.472+0000 7fc6d6119700 1 -- 172.21.15.154:0/3470943357 wait complete. 2023-09-30T22:22:00.485 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T22:22:00.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.605+0000 7f45e976f700 1 Processor -- start 2023-09-30T22:22:00.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.605+0000 7f45e976f700 1 -- start start 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e976f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45e40a0a90 0x7f45e40a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e976f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a13a0 0x7f45e4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e976f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e41343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e976f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e40a3aa0 con 0x7f45e40a0a90 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e976f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e409a540 con 0x7f45e4133f70 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e976f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40a1fe0 con 0x7f45e40a13a0 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e41343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45e40a0a90 0x7f45e40a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a13a0 0x7f45e4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a13a0 0x7f45e4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60886/0 (socket says 172.21.15.154:60886) 2023-09-30T22:22:00.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45e40a0a90 0x7f45e40a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37656/0 (socket says 172.21.15.154:37656) 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e27fc700 1 -- 172.21.15.154:0/2116172860 learned_addr learned my addr 172.21.15.154:0/2116172860 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e41343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37082/0 (socket says 172.21.15.154:37082) 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e2ffd700 1 -- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a13a0 msgr2=0x7f45e4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e2ffd700 1 --2- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a13a0 0x7f45e4133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e2ffd700 1 -- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 msgr2=0x7f45e41343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e2ffd700 1 --2- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e41343d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e2ffd700 1 -- 172.21.15.154:0/2116172860 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e409a280 con 0x7f45e40a0a90 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e37fe700 1 --2- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e41343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.606+0000 7f45e27fc700 1 --2- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a13a0 0x7f45e4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e2ffd700 1 --2- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a0a90 0x7f45e40a0e60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009870 tx=0x7f45cc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae49efc43728e52 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e1ffb700 1 -- 172.21.15.154:0/2116172860 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011830 con 0x7f45e40a0a90 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e1ffb700 1 -- 172.21.15.154:0/2116172860 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc011990 con 0x7f45e40a0a90 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e1ffb700 1 -- 172.21.15.154:0/2116172860 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011d20 con 0x7f45e40a0a90 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e976f700 1 -- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a0a90 msgr2=0x7f45e40a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e976f700 1 --2- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a0a90 0x7f45e40a0e60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009870 tx=0x7f45cc009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e976f700 1 -- 172.21.15.154:0/2116172860 shutdown_connections 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e976f700 1 --2- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e41343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e976f700 1 --2- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a0a90 0x7f45e40a0e60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e976f700 1 --2- 172.21.15.154:0/2116172860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a13a0 0x7f45e4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e976f700 1 -- 172.21.15.154:0/2116172860 >> 172.21.15.154:0/2116172860 conn(0x7f45e4099c40 msgr2=0x7f45e406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e976f700 1 -- 172.21.15.154:0/2116172860 shutdown_connections 2023-09-30T22:22:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.607+0000 7f45e976f700 1 -- 172.21.15.154:0/2116172860 wait complete. 2023-09-30T22:22:00.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.608+0000 7f45e976f700 1 Processor -- start 2023-09-30T22:22:00.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.608+0000 7f45e976f700 1 -- start start 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e976f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a0a90 0x7f45e411f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e976f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a13a0 0x7f45e411f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e976f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e411fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e976f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4122e10 con 0x7f45e40a13a0 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e976f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4122900 con 0x7f45e4133f70 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e976f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4121da0 con 0x7f45e40a0a90 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a13a0 0x7f45e411f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a0a90 0x7f45e411f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e411fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a13a0 0x7f45e411f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37670/0 (socket says 172.21.15.154:37670) 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e27fc700 1 -- 172.21.15.154:0/835427829 learned_addr learned my addr 172.21.15.154:0/835427829 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:00.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a0a90 0x7f45e411f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60898/0 (socket says 172.21.15.154:60898) 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e37fe700 1 -- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a0a90 msgr2=0x7f45e411f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e37fe700 1 --2- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a0a90 0x7f45e411f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e37fe700 1 -- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a13a0 msgr2=0x7f45e411f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e37fe700 1 --2- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a13a0 0x7f45e411f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e37fe700 1 -- 172.21.15.154:0/835427829 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d4009550 con 0x7f45e4133f70 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e37fe700 1 --2- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e411fd70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009e50 tx=0x7f45dc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45db7fe700 1 -- 172.21.15.154:0/835427829 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc003a20 con 0x7f45e4133f70 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45db7fe700 1 -- 172.21.15.154:0/835427829 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc00f040 con 0x7f45e4133f70 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc009a70 con 0x7f45e4133f70 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.609+0000 7f45db7fe700 1 -- 172.21.15.154:0/835427829 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc003de0 con 0x7f45e4133f70 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.610+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc0094a0 con 0x7f45e4133f70 2023-09-30T22:22:00.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.610+0000 7f45db7fe700 1 -- 172.21.15.154:0/835427829 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f45dc00ca30 con 0x7f45e4133f70 2023-09-30T22:22:00.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.610+0000 7f45db7fe700 1 -- 172.21.15.154:0/835427829 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f45dc0404a0 con 0x7f45e4133f70 2023-09-30T22:22:00.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.611+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e404f2a0 con 0x7f45e4133f70 2023-09-30T22:22:00.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.615+0000 7f45db7fe700 1 -- 172.21.15.154:0/835427829 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45dc018020 con 0x7f45e4133f70 2023-09-30T22:22:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.838+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45e4120f00 con 0x7f45e4133f70 2023-09-30T22:22:00.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.838+0000 7f45db7fe700 1 -- 172.21.15.154:0/835427829 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2317 (secure 0 0 0) 0x7f45dc01b770 con 0x7f45e4133f70 2023-09-30T22:22:00.873 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:00.873 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T22:19:33.620776+0000","modified":"2023-09-30T22:19:56.792269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6817/2576993373","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6817","nonce":2576993373}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T22:22:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 >> v1:172.21.15.154:6816/126757 conn(0x7f45c402f510 legacy=0x7f45c40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 msgr2=0x7f45e411fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 --2- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e411fd70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009e50 tx=0x7f45dc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 shutdown_connections 2023-09-30T22:22:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 --2- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e4133f70 0x7f45e411fd70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 --2- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45e40a0a90 0x7f45e411f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 --2- 172.21.15.154:0/835427829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e40a13a0 0x7f45e411f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 >> 172.21.15.154:0/835427829 conn(0x7f45e4099c40 msgr2=0x7f45e40a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 shutdown_connections 2023-09-30T22:22:00.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:00.840+0000 7f45e976f700 1 -- 172.21.15.154:0/835427829 wait complete. 2023-09-30T22:22:00.876 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 7 2023-09-30T22:22:00.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T22:19:33.620776+0000', 'modified': '2023-09-30T22:19:56.792269+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6817/2576993373', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.154:6817', 'nonce': 2576993373}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T22:22:00.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T22:22:00.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T22:22:01.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f3224323700 1 Processor -- start 2023-09-30T22:22:01.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f3224323700 1 -- start start 2023-09-30T22:22:01.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f3224323700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c09e340 0x7f321c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f3224323700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f321c135f20 0x7f321c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f3224323700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c09aaa0 con 0x7f321c09d860 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f3224323700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c09e730 con 0x7f321c135f20 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f3224323700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f321c09f870 con 0x7f321c09e340 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f32220bf700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f321c09d860 0x7f321c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38444/0 (socket says 172.21.15.154:38444) 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f32218be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c09e340 0x7f321c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f32220bf700 1 -- 172.21.15.154:0/1273321014 learned_addr learned my addr 172.21.15.154:0/1273321014 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.099+0000 7f32228c0700 1 --2- 172.21.15.154:0/1273321014 >> v2:172.21.15.154:3300/0 conn(0x7f321c135f20 0x7f321c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32218be700 1 -- 172.21.15.154:0/1273321014 >> v2:172.21.15.154:3300/0 conn(0x7f321c135f20 msgr2=0x7f321c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32218be700 1 --2- 172.21.15.154:0/1273321014 >> v2:172.21.15.154:3300/0 conn(0x7f321c135f20 0x7f321c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32218be700 1 -- 172.21.15.154:0/1273321014 >> v1:172.21.15.154:6789/0 conn(0x7f321c09d860 legacy=0x7f321c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32218be700 1 -- 172.21.15.154:0/1273321014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c09b360 con 0x7f321c09e340 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32210bd700 1 -- 172.21.15.154:0/1273321014 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009131572 0 0) 0x7f321c09aaa0 con 0x7f321c09d860 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32228c0700 1 --2- 172.21.15.154:0/1273321014 >> v2:172.21.15.154:3300/0 conn(0x7f321c135f20 0x7f321c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32218be700 1 --2- 172.21.15.154:0/1273321014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c09e340 0x7f321c1359e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f320c009840 tx=0x7f320c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe3cc60e16ee829d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32210bd700 1 -- 172.21.15.154:0/1273321014 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c011830 con 0x7f321c09e340 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32210bd700 1 -- 172.21.15.154:0/1273321014 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c011990 con 0x7f321c09e340 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.100+0000 7f32210bd700 1 -- 172.21.15.154:0/1273321014 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c011d20 con 0x7f321c09e340 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.101+0000 7f3224323700 1 -- 172.21.15.154:0/1273321014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c09e340 msgr2=0x7f321c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.101+0000 7f3224323700 1 --2- 172.21.15.154:0/1273321014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c09e340 0x7f321c1359e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f320c009840 tx=0x7f320c009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.101+0000 7f3224323700 1 -- 172.21.15.154:0/1273321014 shutdown_connections 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.101+0000 7f3224323700 1 --2- 172.21.15.154:0/1273321014 >> v2:172.21.15.154:3300/0 conn(0x7f321c135f20 0x7f321c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.101+0000 7f3224323700 1 --2- 172.21.15.154:0/1273321014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c09e340 0x7f321c1359e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.101+0000 7f3224323700 1 -- 172.21.15.154:0/1273321014 >> 172.21.15.154:0/1273321014 conn(0x7f321c099c40 msgr2=0x7f321c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.101+0000 7f3224323700 1 -- 172.21.15.154:0/1273321014 shutdown_connections 2023-09-30T22:22:01.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.101+0000 7f3224323700 1 -- 172.21.15.154:0/1273321014 wait complete. 2023-09-30T22:22:01.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f3224323700 1 Processor -- start 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f3224323700 1 -- start start 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f3224323700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c09d860 0x7f321c11f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f3224323700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c09e340 0x7f321c11fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f3224323700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c135f20 0x7f321c120000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f3224323700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c09c8b0 con 0x7f321c09e340 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f3224323700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c1209d0 con 0x7f321c09d860 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f3224323700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f321c122080 con 0x7f321c135f20 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32218be700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c09e340 0x7f321c11fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32220bf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c09d860 0x7f321c11f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32228c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c135f20 0x7f321c120000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32220bf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c09d860 0x7f321c11f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37086/0 (socket says 172.21.15.154:37086) 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32218be700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c09e340 0x7f321c11fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37686/0 (socket says 172.21.15.154:37686) 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32220bf700 1 -- 172.21.15.154:0/3237427128 learned_addr learned my addr 172.21.15.154:0/3237427128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32220bf700 1 -- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c135f20 msgr2=0x7f321c120000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32220bf700 1 --2- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c135f20 0x7f321c120000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32220bf700 1 -- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c09e340 msgr2=0x7f321c11fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32220bf700 1 --2- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c09e340 0x7f321c11fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32220bf700 1 -- 172.21.15.154:0/3237427128 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3214009a70 con 0x7f321c09d860 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32218be700 1 --2- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c09e340 0x7f321c11fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.102+0000 7f32228c0700 1 --2- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c135f20 0x7f321c120000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.103+0000 7f32220bf700 1 --2- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c09d860 0x7f321c11f580 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f321800c520 tx=0x7f321800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.103+0000 7f3212ffd700 1 -- 172.21.15.154:0/3237427128 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218004c80 con 0x7f321c09d860 2023-09-30T22:22:01.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.103+0000 7f3212ffd700 1 -- 172.21.15.154:0/3237427128 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3218004e00 con 0x7f321c09d860 2023-09-30T22:22:01.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.103+0000 7f3224323700 1 -- 172.21.15.154:0/3237427128 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c0094a0 con 0x7f321c09d860 2023-09-30T22:22:01.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.103+0000 7f3212ffd700 1 -- 172.21.15.154:0/3237427128 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218007310 con 0x7f321c09d860 2023-09-30T22:22:01.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.103+0000 7f3224323700 1 -- 172.21.15.154:0/3237427128 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c06b400 con 0x7f321c09d860 2023-09-30T22:22:01.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.103+0000 7f3212ffd700 1 -- 172.21.15.154:0/3237427128 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3218007470 con 0x7f321c09d860 2023-09-30T22:22:01.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.104+0000 7f3212ffd700 1 -- 172.21.15.154:0/3237427128 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f321803f770 con 0x7f321c09d860 2023-09-30T22:22:01.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.106+0000 7f32304c6b80 1 Processor -- start 2023-09-30T22:22:01.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.106+0000 7f32304c6b80 1 -- start start 2023-09-30T22:22:01.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4e5100 0x55974c4c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4df8f0 0x55974c4dfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c42bc60 con 0x55974c4c8c50 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974c426a10 con 0x55974c4e5100 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x55974c424210 con 0x55974c4df8f0 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32220bf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32220bf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37690/0 (socket says 172.21.15.154:37690) 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32220bf700 1 -- 172.21.15.154:0/1090207189 learned_addr learned my addr 172.21.15.154:0/1090207189 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32228c0700 1 --2- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4df8f0 0x55974c4dfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32218be700 1 --2- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4e5100 0x55974c4c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32220bf700 1 -- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4df8f0 msgr2=0x55974c4dfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32220bf700 1 --2- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4df8f0 0x55974c4dfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32220bf700 1 -- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4e5100 msgr2=0x55974c4c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32220bf700 1 --2- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4e5100 0x55974c4c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32220bf700 1 -- 172.21.15.154:0/1090207189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55974c213790 con 0x55974c4c8c50 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f32220bf700 1 --2- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4c9020 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f321803e290 tx=0x7f3218006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca32ff2a8b897b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f31fffff700 1 -- 172.21.15.154:0/1090207189 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32180104a0 con 0x55974c4c8c50 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.107+0000 7f31fffff700 1 -- 172.21.15.154:0/1090207189 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32180102c0 con 0x55974c4c8c50 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f31fffff700 1 -- 172.21.15.154:0/1090207189 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218011560 con 0x55974c4c8c50 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f32304c6b80 1 -- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 msgr2=0x55974c4c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f32304c6b80 1 --2- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4c9020 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f321803e290 tx=0x7f3218006000 comp rx=0 tx=0).stop 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f32304c6b80 1 -- 172.21.15.154:0/1090207189 shutdown_connections 2023-09-30T22:22:01.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f32304c6b80 1 --2- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4df8f0 0x55974c4dfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f32304c6b80 1 --2- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4c9020 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f32304c6b80 1 --2- 172.21.15.154:0/1090207189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4e5100 0x55974c4c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f32304c6b80 1 -- 172.21.15.154:0/1090207189 >> 172.21.15.154:0/1090207189 conn(0x55974c4cd0f0 msgr2=0x55974c4cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f32304c6b80 1 -- 172.21.15.154:0/1090207189 shutdown_connections 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.108+0000 7f32304c6b80 1 -- 172.21.15.154:0/1090207189 wait complete. 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32304c6b80 1 -- start start 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32304c6b80 1 Processor -- start 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4c8c50 0x55974c4ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4e5100 0x55974c4eec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c41fb00 con 0x55974c4e5100 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974c3bb770 con 0x55974c4df8f0 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x55974c3de6f0 con 0x55974c4c8c50 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32304c6b80 10 client.0 _ll_register_callbacks cb 0x55974c2275a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32220bf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4c8c50 0x55974c4ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32218be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32220bf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4c8c50 0x55974c4ee1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60952/0 (socket says 172.21.15.154:60952) 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.109+0000 7f32220bf700 1 -- 172.21.15.154:0/3753013854 learned_addr learned my addr 172.21.15.154:0/3753013854 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32228c0700 1 --2- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4e5100 0x55974c4eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32220bf700 1 -- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 msgr2=0x55974c4ee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32220bf700 1 --2- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4ee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32220bf700 1 -- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4e5100 msgr2=0x55974c4eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32220bf700 1 --2- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4e5100 0x55974c4eec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32220bf700 1 -- 172.21.15.154:0/3753013854 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c06b400 con 0x55974c4c8c50 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32218be700 1 --2- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32220bf700 1 --2- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4c8c50 0x55974c4ee1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3218010430 tx=0x7f321800f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a5d1fd5a66886f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f31fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.154:3302/0 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f31fd7fa700 1 -- 172.21.15.154:0/3753013854 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321803d3d0 con 0x55974c4c8c50 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f31fd7fa700 1 -- 172.21.15.154:0/3753013854 <== mon.2 v2:172.21.15.154:3302/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f3218011360 con 0x55974c4c8c50 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32304c6b80 1 -- 172.21.15.154:0/3753013854 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55974c4c12b0 con 0x55974c4c8c50 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f31fd7fa700 1 -- 172.21.15.154:0/3753013854 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32180104a0 con 0x55974c4c8c50 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32304c6b80 10 client.14429 fetch_fsmap learned FSMap version 7 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32304c6b80 1 -- 172.21.15.154:0/3753013854 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x55974c3000a0 con 0x55974c4c8c50 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f31fd7fa700 1 -- 172.21.15.154:0/3753013854 <== mon.2 v2:172.21.15.154:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55974c4c12b0 con 0x55974c4c8c50 2023-09-30T22:22:01.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f31fd7fa700 1 -- 172.21.15.154:0/3753013854 <== mon.2 v2:172.21.15.154:3302/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f321801ba70 con 0x55974c4c8c50 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32304c6b80 10 client.14429 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32304c6b80 10 client.14429 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32304c6b80 20 client.14429 populate_metadata read hostname 'smithi154' 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32304c6b80 4 client.14429 mds_command: new command op to 4184 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.110+0000 7f32304c6b80 1 -- 172.21.15.154:0/3753013854 --> v1:172.21.15.154:6817/2576993373 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55974c49df40 con 0x55974c4dedd0 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.111+0000 7f31fd7fa700 10 client.14429 ms_handle_connect on v1:172.21.15.154:6817/2576993373 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.111+0000 7f31fd7fa700 1 -- 172.21.15.154:0/3753013854 <== mds.0 v1:172.21.15.154:6817/2576993373 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55974c49df40 con 0x55974c4dedd0 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.111+0000 7f31fd7fa700 10 client.14429 handle_command_reply: tid=0 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.111+0000 7f32304c6b80 1 client.14429 shutdown 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 1 -- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4c8c50 msgr2=0x55974c4ee1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 1 --2- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4c8c50 0x55974c4ee1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3218010430 tx=0x7f321800f000 comp rx=0 tx=0).stop 2023-09-30T22:22:01.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 1 -- 172.21.15.154:0/3753013854 shutdown_connections 2023-09-30T22:22:01.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 1 --2- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4e5100 0x55974c4eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 1 --2- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4c8c50 0x55974c4ee1a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f31fd7fa700 0 client.14429 ms_handle_reset on v1:172.21.15.154:6817/2576993373 2023-09-30T22:22:01.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 1 --2- 172.21.15.154:0/3753013854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 1 -- 172.21.15.154:0/3753013854 >> 172.21.15.154:0/3753013854 conn(0x55974c4cd0f0 msgr2=0x55974c4c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 1 -- 172.21.15.154:0/3753013854 shutdown_connections 2023-09-30T22:22:01.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 1 -- 172.21.15.154:0/3753013854 wait complete. 2023-09-30T22:22:01.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.112+0000 7f32304c6b80 20 client.14429 trim_cache size 0 max 16384 2023-09-30T22:22:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.128+0000 7f32304c6b80 1 Processor -- start 2023-09-30T22:22:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.128+0000 7f32304c6b80 1 -- start start 2023-09-30T22:22:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4ef130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 0x55974c4cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c214390 con 0x55974c4c8c50 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974c4e9840 con 0x55974c4df8f0 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x55974c4c12b0 con 0x55974c4e5100 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32218be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32220bf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32218be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37122/0 (socket says 172.21.15.154:37122) 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32228c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 0x55974c4cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32218be700 1 -- 172.21.15.154:0/1931970188 learned_addr learned my addr 172.21.15.154:0/1931970188 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32218be700 1 -- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 msgr2=0x55974c4cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32218be700 1 --2- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 0x55974c4cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32218be700 1 -- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 msgr2=0x55974c4ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32218be700 1 --2- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32218be700 1 -- 172.21.15.154:0/1931970188 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55974c3e6010 con 0x55974c4df8f0 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32220bf700 1 --2- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f32218be700 1 --2- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4cb8d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f320c013000 tx=0x7f320c010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f051dadadaab1cf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f3210dad700 1 -- 172.21.15.154:0/1931970188 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c029070 con 0x55974c4df8f0 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f3210dad700 1 -- 172.21.15.154:0/1931970188 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c0040c0 con 0x55974c4df8f0 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.129+0000 7f3210dad700 1 -- 172.21.15.154:0/1931970188 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c004430 con 0x55974c4df8f0 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 -- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 msgr2=0x55974c4cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 --2- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4cb8d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f320c013000 tx=0x7f320c010000 comp rx=0 tx=0).stop 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 -- 172.21.15.154:0/1931970188 shutdown_connections 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 --2- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 0x55974c4cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 --2- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c4ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 --2- 172.21.15.154:0/1931970188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c4cb8d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 -- 172.21.15.154:0/1931970188 >> 172.21.15.154:0/1931970188 conn(0x55974c4cd0f0 msgr2=0x55974c4c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 -- 172.21.15.154:0/1931970188 shutdown_connections 2023-09-30T22:22:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 -- 172.21.15.154:0/1931970188 wait complete. 2023-09-30T22:22:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.130+0000 7f32304c6b80 1 -- start start 2023-09-30T22:22:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32304c6b80 1 Processor -- start 2023-09-30T22:22:01.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c54de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c54e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32304c6b80 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 0x55974c4dd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c4e5b10 con 0x55974c4c8c50 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974c54e8e0 con 0x55974c4df8f0 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32304c6b80 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x55974c54daa0 con 0x55974c4e5100 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32304c6b80 10 client.0 _ll_register_callbacks cb 0x7f32140095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32218be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c54e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32220bf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c54de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32218be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c54e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37136/0 (socket says 172.21.15.154:37136) 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32218be700 1 -- 172.21.15.154:0/87744223 learned_addr learned my addr 172.21.15.154:0/87744223 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.131+0000 7f32228c0700 1 --2- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 0x55974c4dd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32218be700 1 -- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 msgr2=0x55974c4dd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32218be700 1 --2- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 0x55974c4dd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32218be700 1 -- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 msgr2=0x55974c54de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32218be700 1 --2- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c54de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32218be700 1 -- 172.21.15.154:0/87744223 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55974c3000a0 con 0x55974c4df8f0 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32220bf700 1 --2- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c54de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32218be700 1 --2- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c54e3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f320c01d040 tx=0x7f320c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5837f2dba17428af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f31fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.154:3301/0 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f31fd7fa700 1 -- 172.21.15.154:0/87744223 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c029040 con 0x55974c4df8f0 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f31fd7fa700 1 -- 172.21.15.154:0/87744223 <== mon.1 v2:172.21.15.154:3301/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f320c0038a0 con 0x55974c4df8f0 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32304c6b80 1 -- 172.21.15.154:0/87744223 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32180102c0 con 0x55974c4df8f0 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f31fd7fa700 1 -- 172.21.15.154:0/87744223 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f320c003a60 con 0x55974c4df8f0 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32304c6b80 10 client.14413 fetch_fsmap learned FSMap version 7 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32304c6b80 1 -- 172.21.15.154:0/87744223 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x7f321c09b360 con 0x55974c4df8f0 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f31fd7fa700 1 -- 172.21.15.154:0/87744223 <== mon.1 v2:172.21.15.154:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32180102c0 con 0x55974c4df8f0 2023-09-30T22:22:01.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f31fd7fa700 1 -- 172.21.15.154:0/87744223 <== mon.1 v2:172.21.15.154:3301/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f320c03e070 con 0x55974c4df8f0 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32304c6b80 10 client.14413 fetch_fsmap finished waiting for FSMap version 7 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32304c6b80 10 client.14413 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32304c6b80 20 client.14413 populate_metadata read hostname 'smithi154' 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32304c6b80 4 client.14413 mds_command: new command op to 4184 tid=0[{"prefix": "status"}] 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.132+0000 7f32304c6b80 1 -- 172.21.15.154:0/87744223 --> v1:172.21.15.154:6817/2576993373 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55974c418ce0 con 0x55974c4de370 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f31fd7fa700 10 client.14413 ms_handle_connect on v1:172.21.15.154:6817/2576993373 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f31fd7fa700 1 -- 172.21.15.154:0/87744223 <== mds.0 v1:172.21.15.154:6817/2576993373 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 2130325397) 0x55974c418ce0 con 0x55974c4de370 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f31fd7fa700 10 client.14413 handle_command_reply: tid=0 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 client.14413 shutdown 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 -- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 msgr2=0x55974c54e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 --2- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c54e3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f320c01d040 tx=0x7f320c0047c0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 -- 172.21.15.154:0/87744223 shutdown_connections 2023-09-30T22:22:01.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 --2- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x55974c4e5100 0x55974c4dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f31fd7fa700 0 client.14413 ms_handle_reset on v1:172.21.15.154:6817/2576993373 2023-09-30T22:22:01.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 --2- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55974c4c8c50 0x55974c54de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 --2- 172.21.15.154:0/87744223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55974c4df8f0 0x55974c54e3a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 -- 172.21.15.154:0/87744223 >> 172.21.15.154:0/87744223 conn(0x55974c4cd0f0 msgr2=0x55974c4e9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 -- 172.21.15.154:0/87744223 shutdown_connections 2023-09-30T22:22:01.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 1 -- 172.21.15.154:0/87744223 wait complete. 2023-09-30T22:22:01.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.133+0000 7f32304c6b80 20 client.14413 trim_cache size 0 max 16384 2023-09-30T22:22:01.141 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "632db358-b709-49ad-a56a-97cde2869fcf", 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4184, 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 147.50692647400001, 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 7, 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 23, 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 17, 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 151.79372563699999 2023-09-30T22:22:01.142 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-09-30T22:22:01.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 -- 172.21.15.154:0/3237427128 >> v1:172.21.15.154:6816/126757 conn(0x7f320002f510 legacy=0x7f32000319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 -- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c09d860 msgr2=0x7f321c11f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 --2- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c09d860 0x7f321c11f580 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f321800c520 tx=0x7f321800c830 comp rx=0 tx=0).stop 2023-09-30T22:22:01.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 -- 172.21.15.154:0/3237427128 shutdown_connections 2023-09-30T22:22:01.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 --2- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f321c135f20 0x7f321c120000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 --2- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f321c09d860 0x7f321c11f580 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 --2- 172.21.15.154:0/3237427128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f321c09e340 0x7f321c11fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 -- 172.21.15.154:0/3237427128 >> 172.21.15.154:0/3237427128 conn(0x7f321c099c40 msgr2=0x7f321c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 -- 172.21.15.154:0/3237427128 shutdown_connections 2023-09-30T22:22:01.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.134+0000 7f3224323700 1 -- 172.21.15.154:0/3237427128 wait complete. 2023-09-30T22:22:01.146 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:22:01.156 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T22:22:01.156 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:22:01.190 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T22:22:01.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-09-30T22:22:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.351+0000 7fea5fe3c700 1 Processor -- start 2023-09-30T22:22:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.351+0000 7fea5fe3c700 1 -- start start 2023-09-30T22:22:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.351+0000 7fea5fe3c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea58133ad0 0x7fea58133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.351+0000 7fea5fe3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea581304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.351+0000 7fea5fe3c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5806b2d0 con 0x7fea581309f0 2023-09-30T22:22:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.351+0000 7fea5fe3c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea58133610 con 0x7fea58133ad0 2023-09-30T22:22:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.351+0000 7fea5fe3c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea5809a500 con 0x7fea581300a0 2023-09-30T22:22:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5e3d9700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fea581309f0 0x7fea5813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38450/0 (socket says 172.21.15.154:38450) 2023-09-30T22:22:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5e3d9700 1 -- 172.21.15.154:0/1914703770 learned_addr learned my addr 172.21.15.154:0/1914703770 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5dbd8700 1 --2- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea58133ad0 0x7fea58133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5d3d7700 1 --2- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea581304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5cbd6700 1 -- 172.21.15.154:0/1914703770 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660846786 0 0) 0x7fea5806b2d0 con 0x7fea581309f0 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5cbd6700 1 -- 172.21.15.154:0/1914703770 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea440035b0 con 0x7fea581309f0 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5dbd8700 1 -- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 msgr2=0x7fea581304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5dbd8700 1 --2- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea581304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5dbd8700 1 -- 172.21.15.154:0/1914703770 >> v1:172.21.15.154:6789/0 conn(0x7fea581309f0 legacy=0x7fea5813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5dbd8700 1 -- 172.21.15.154:0/1914703770 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea581338b0 con 0x7fea58133ad0 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5d3d7700 1 --2- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea581304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5dbd8700 1 --2- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea58133ad0 0x7fea58133ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea54009870 tx=0x7fea54009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1711f3b2db0fb41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5cbd6700 1 -- 172.21.15.154:0/1914703770 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54011830 con 0x7fea58133ad0 2023-09-30T22:22:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5cbd6700 1 -- 172.21.15.154:0/1914703770 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea54011990 con 0x7fea58133ad0 2023-09-30T22:22:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.352+0000 7fea5cbd6700 1 -- 172.21.15.154:0/1914703770 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54011d20 con 0x7fea58133ad0 2023-09-30T22:22:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.353+0000 7fea5fe3c700 1 -- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea58133ad0 msgr2=0x7fea58133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.353+0000 7fea5fe3c700 1 --2- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea58133ad0 0x7fea58133ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea54009870 tx=0x7fea54009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.353+0000 7fea5fe3c700 1 -- 172.21.15.154:0/1914703770 shutdown_connections 2023-09-30T22:22:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.353+0000 7fea5fe3c700 1 --2- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea58133ad0 0x7fea58133ea0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.353+0000 7fea5fe3c700 1 --2- 172.21.15.154:0/1914703770 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea581304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.353+0000 7fea5fe3c700 1 -- 172.21.15.154:0/1914703770 >> 172.21.15.154:0/1914703770 conn(0x7fea58099c40 msgr2=0x7fea580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.353+0000 7fea5fe3c700 1 -- 172.21.15.154:0/1914703770 shutdown_connections 2023-09-30T22:22:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.353+0000 7fea5fe3c700 1 -- 172.21.15.154:0/1914703770 wait complete. 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5fe3c700 1 Processor -- start 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5fe3c700 1 -- start start 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5fe3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea58071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5fe3c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea581309f0 0x7fea58071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5fe3c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea58133ad0 0x7fea58071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5fe3c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5811ff50 con 0x7fea58133ad0 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5fe3c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea580a3390 con 0x7fea581309f0 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5fe3c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea5811f6e0 con 0x7fea581300a0 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5dbd8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea58071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5d3d7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea581309f0 0x7fea58071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5dbd8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea58071320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60986/0 (socket says 172.21.15.154:60986) 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5dbd8700 1 -- 172.21.15.154:0/2018701154 learned_addr learned my addr 172.21.15.154:0/2018701154 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.354+0000 7fea5e3d9700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea58133ad0 0x7fea58071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5dbd8700 1 -- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea581309f0 msgr2=0x7fea58071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5dbd8700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea581309f0 0x7fea58071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5dbd8700 1 -- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea58133ad0 msgr2=0x7fea58071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5dbd8700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea58133ad0 0x7fea58071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5dbd8700 1 -- 172.21.15.154:0/2018701154 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480094a0 con 0x7fea581300a0 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5d3d7700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea581309f0 0x7fea58071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5e3d9700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea58133ad0 0x7fea58071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5dbd8700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea58071320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea54009bc0 tx=0x7fea54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea4e7fc700 1 -- 172.21.15.154:0/2018701154 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54004450 con 0x7fea581300a0 2023-09-30T22:22:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea4e7fc700 1 -- 172.21.15.154:0/2018701154 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea540045b0 con 0x7fea581300a0 2023-09-30T22:22:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea4e7fc700 1 -- 172.21.15.154:0/2018701154 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540038e0 con 0x7fea581300a0 2023-09-30T22:22:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea540094a0 con 0x7fea581300a0 2023-09-30T22:22:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.355+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5812dd00 con 0x7fea581300a0 2023-09-30T22:22:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.356+0000 7fea4e7fc700 1 -- 172.21.15.154:0/2018701154 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fea54003a40 con 0x7fea581300a0 2023-09-30T22:22:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.356+0000 7fea4e7fc700 1 -- 172.21.15.154:0/2018701154 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fea54040c90 con 0x7fea581300a0 2023-09-30T22:22:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.356+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5811f290 con 0x7fea581300a0 2023-09-30T22:22:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.361+0000 7fea4e7fc700 1 -- 172.21.15.154:0/2018701154 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea54015020 con 0x7fea581300a0 2023-09-30T22:22:01.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.558+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7fea5804f2a0 con 0x7fea581300a0 2023-09-30T22:22:01.559 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-09-30T22:22:01.558+0000 7f3379ce5700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2023-09-30T22:22:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.981+0000 7fea4e7fc700 1 -- 172.21.15.154:0/2018701154 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7fea54010ba0 con 0x7fea581300a0 2023-09-30T22:22:01.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.984+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 >> v1:172.21.15.154:6816/126757 conn(0x7fea3c02f510 legacy=0x7fea3c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.984+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 msgr2=0x7fea58071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:01.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.984+0000 7fea5fe3c700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea58071320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fea54009bc0 tx=0x7fea54004750 comp rx=0 tx=0).stop 2023-09-30T22:22:01.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.985+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 shutdown_connections 2023-09-30T22:22:01.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.985+0000 7fea5fe3c700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea58133ad0 0x7fea58071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.985+0000 7fea5fe3c700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea581300a0 0x7fea58071320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.985+0000 7fea5fe3c700 1 --2- 172.21.15.154:0/2018701154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea581309f0 0x7fea58071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:01.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.985+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 >> 172.21.15.154:0/2018701154 conn(0x7fea58099c40 msgr2=0x7fea5812e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.988+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 shutdown_connections 2023-09-30T22:22:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:01.988+0000 7fea5fe3c700 1 -- 172.21.15.154:0/2018701154 wait complete. 2023-09-30T22:22:01.991 INFO:teuthology.orchestra.run.smithi154.stderr:marked down osd.0. 2023-09-30T22:22:02.003 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T22:22:02.003 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T22:22:02.005 INFO:tasks.ceph.osd.0:Started 2023-09-30T22:22:02.006 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T22:22:02.006 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:22:02.034 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T22:22:02.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.196+0000 7f4f6d72e700 1 Processor -- start 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.196+0000 7f4f6d72e700 1 -- start start 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.196+0000 7f4f6d72e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a1550 0x7f4f68138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.196+0000 7f4f6d72e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f68139200 0x7f4f6813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.196+0000 7f4f6d72e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6809e9d0 con 0x7f4f680a0a70 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.196+0000 7f4f6d72e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6809dc00 con 0x7f4f68139200 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.196+0000 7f4f6d72e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6809dec0 con 0x7f4f680a1550 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.196+0000 7f4f667fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a1550 0x7f4f68138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f677fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f68139200 0x7f4f6813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f667fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a1550 0x7f4f68138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60998/0 (socket says 172.21.15.154:60998) 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f667fc700 1 -- 172.21.15.154:0/3238988448 learned_addr learned my addr 172.21.15.154:0/3238988448 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f677fe700 1 -- 172.21.15.154:0/3238988448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a1550 msgr2=0x7f4f68138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f677fe700 1 --2- 172.21.15.154:0/3238988448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a1550 0x7f4f68138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f677fe700 1 -- 172.21.15.154:0/3238988448 >> v1:172.21.15.154:6789/0 conn(0x7f4f680a0a70 legacy=0x7f4f680a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f677fe700 1 -- 172.21.15.154:0/3238988448 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6809e6a0 con 0x7f4f68139200 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f65ffb700 1 -- 172.21.15.154:0/3238988448 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918125601 0 0) 0x7f4f6809e9d0 con 0x7f4f680a0a70 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f667fc700 1 --2- 172.21.15.154:0/3238988448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a1550 0x7f4f68138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f677fe700 1 --2- 172.21.15.154:0/3238988448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 0x7f4f6813b5e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009d90 tx=0x7f4f6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4e032e4630833c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f65ffb700 1 -- 172.21.15.154:0/3238988448 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000e070 con 0x7f4f68139200 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f65ffb700 1 -- 172.21.15.154:0/3238988448 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6000bb20 con 0x7f4f68139200 2023-09-30T22:22:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.197+0000 7f4f65ffb700 1 -- 172.21.15.154:0/3238988448 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60012430 con 0x7f4f68139200 2023-09-30T22:22:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.198+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3238988448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 msgr2=0x7f4f6813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.198+0000 7f4f6d72e700 1 --2- 172.21.15.154:0/3238988448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 0x7f4f6813b5e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009d90 tx=0x7f4f6000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.198+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3238988448 shutdown_connections 2023-09-30T22:22:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.198+0000 7f4f6d72e700 1 --2- 172.21.15.154:0/3238988448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 0x7f4f6813b5e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.198+0000 7f4f6d72e700 1 --2- 172.21.15.154:0/3238988448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a1550 0x7f4f68138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.198+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3238988448 >> 172.21.15.154:0/3238988448 conn(0x7f4f680a6610 msgr2=0x7f4f680a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.198+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3238988448 shutdown_connections 2023-09-30T22:22:02.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.198+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3238988448 wait complete. 2023-09-30T22:22:02.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.199+0000 7f4f6d72e700 1 Processor -- start 2023-09-30T22:22:02.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.199+0000 7f4f6d72e700 1 -- start start 2023-09-30T22:22:02.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f6d72e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a0a70 0x7f4f68121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f6d72e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f680a1550 0x7f4f68121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f6d72e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 0x7f4f681221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f6d72e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f68125280 con 0x7f4f68139200 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f6d72e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f68123990 con 0x7f4f680a1550 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f6d72e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f680a03e0 con 0x7f4f680a0a70 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f66ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a0a70 0x7f4f68121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f667fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f680a1550 0x7f4f68121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f66ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a0a70 0x7f4f68121760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:32778/0 (socket says 172.21.15.154:32778) 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f677fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 0x7f4f681221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f66ffd700 1 -- 172.21.15.154:0/3227562260 learned_addr learned my addr 172.21.15.154:0/3227562260 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f66ffd700 1 -- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f680a1550 msgr2=0x7f4f68121ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f66ffd700 1 --2- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f680a1550 0x7f4f68121ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f66ffd700 1 -- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 msgr2=0x7f4f681221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f66ffd700 1 --2- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 0x7f4f681221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f66ffd700 1 -- 172.21.15.154:0/3227562260 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f58009550 con 0x7f4f680a0a70 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f677fe700 1 --2- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 0x7f4f681221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f66ffd700 1 --2- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a0a70 0x7f4f68121760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c001eb0 tx=0x7f4f5c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f4f7fe700 1 -- 172.21.15.154:0/3227562260 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0054e0 con 0x7f4f680a0a70 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f4f7fe700 1 -- 172.21.15.154:0/3227562260 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c003680 con 0x7f4f680a0a70 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f60009a70 con 0x7f4f680a0a70 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.200+0000 7f4f4f7fe700 1 -- 172.21.15.154:0/3227562260 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0039f0 con 0x7f4f680a0a70 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.201+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f68124ce0 con 0x7f4f680a0a70 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.201+0000 7f4f4f7fe700 1 -- 172.21.15.154:0/3227562260 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4f5c003b50 con 0x7f4f680a0a70 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.202+0000 7f4f4f7fe700 1 -- 172.21.15.154:0/3227562260 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f4f5c03ef40 con 0x7f4f680a0a70 2023-09-30T22:22:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.202+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6804f2a0 con 0x7f4f680a0a70 2023-09-30T22:22:02.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.206+0000 7f4f4f7fe700 1 -- 172.21.15.154:0/3227562260 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f5c017020 con 0x7f4f680a0a70 2023-09-30T22:22:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.404+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f4f68072980 con 0x7f4f680a0a70 2023-09-30T22:22:02.406 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-09-30T22:22:02.405+0000 7f3379ce5700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-09-30T22:22:02.596 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-09-30T22:22:02.596+0000 7fadbbecd680 -1 Falling back to public interface 2023-09-30T22:22:02.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.986+0000 7f4f4f7fe700 1 -- 172.21.15.154:0/3227562260 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f4f5c01b3b0 con 0x7f4f680a0a70 2023-09-30T22:22:02.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.989+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 >> v1:172.21.15.154:6816/126757 conn(0x7f4f5402f510 legacy=0x7f4f540319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.989+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a0a70 msgr2=0x7f4f68121760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:02.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.989+0000 7f4f6d72e700 1 --2- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a0a70 0x7f4f68121760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c001eb0 tx=0x7f4f5c00c800 comp rx=0 tx=0).stop 2023-09-30T22:22:02.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.990+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 shutdown_connections 2023-09-30T22:22:02.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.990+0000 7f4f6d72e700 1 --2- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f68139200 0x7f4f681221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.990+0000 7f4f6d72e700 1 --2- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f680a0a70 0x7f4f68121760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.990+0000 7f4f6d72e700 1 --2- 172.21.15.154:0/3227562260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f680a1550 0x7f4f68121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:02.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.990+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 >> 172.21.15.154:0/3227562260 conn(0x7f4f680a6610 msgr2=0x7f4f680a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:02.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.992+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 shutdown_connections 2023-09-30T22:22:02.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:02.992+0000 7f4f6d72e700 1 -- 172.21.15.154:0/3227562260 wait complete. 2023-09-30T22:22:02.995 INFO:teuthology.orchestra.run.smithi154.stderr:marked down osd.1. 2023-09-30T22:22:03.009 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T22:22:03.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T22:22:03.011 INFO:tasks.ceph.osd.1:Started 2023-09-30T22:22:03.011 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T22:22:03.011 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:22:03.041 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T22:22:03.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-09-30T22:22:03.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1f7dc700 1 Processor -- start 2023-09-30T22:22:03.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1f7dc700 1 -- start start 2023-09-30T22:22:03.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1f7dc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133660 0x7f2d18135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1f7dc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d18135f80 0x7f2d18138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1f7dc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d18099a60 con 0x7f2d18099e20 2023-09-30T22:22:03.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1f7dc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1809bf50 con 0x7f2d18135f80 2023-09-30T22:22:03.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1f7dc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1809b230 con 0x7f2d18133660 2023-09-30T22:22:03.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1cd77700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133660 0x7f2d18135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1dd79700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d18135f80 0x7f2d18138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1cd77700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133660 0x7f2d18135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37174/0 (socket says 172.21.15.154:37174) 2023-09-30T22:22:03.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1d578700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2d18099e20 0x7f2d1809a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38480/0 (socket says 172.21.15.154:38480) 2023-09-30T22:22:03.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1dd79700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d18135f80 0x7f2d18138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37764/0 (socket says 172.21.15.154:37764) 2023-09-30T22:22:03.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.204+0000 7f2d1cd77700 1 -- 172.21.15.154:0/2053695949 learned_addr learned my addr 172.21.15.154:0/2053695949 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d0ffff700 1 -- 172.21.15.154:0/2053695949 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361888627 0 0) 0x7f2d18099a60 con 0x7f2d18099e20 2023-09-30T22:22:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d0ffff700 1 -- 172.21.15.154:0/2053695949 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d040035b0 con 0x7f2d18099e20 2023-09-30T22:22:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d1cd77700 1 -- 172.21.15.154:0/2053695949 >> v2:172.21.15.154:3300/0 conn(0x7f2d18135f80 msgr2=0x7f2d18138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d1cd77700 1 --2- 172.21.15.154:0/2053695949 >> v2:172.21.15.154:3300/0 conn(0x7f2d18135f80 0x7f2d18138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d1cd77700 1 -- 172.21.15.154:0/2053695949 >> v1:172.21.15.154:6789/0 conn(0x7f2d18099e20 legacy=0x7f2d1809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d1cd77700 1 -- 172.21.15.154:0/2053695949 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1809bb90 con 0x7f2d18133660 2023-09-30T22:22:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d1dd79700 1 --2- 172.21.15.154:0/2053695949 >> v2:172.21.15.154:3300/0 conn(0x7f2d18135f80 0x7f2d18138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:03.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d1cd77700 1 --2- 172.21.15.154:0/2053695949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133660 0x7f2d18135a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800bbc0 tx=0x7f2d0800bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5639c68c7d4ea928 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d0ffff700 1 -- 172.21.15.154:0/2053695949 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800dcf0 con 0x7f2d18133660 2023-09-30T22:22:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d0ffff700 1 -- 172.21.15.154:0/2053695949 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0800de50 con 0x7f2d18133660 2023-09-30T22:22:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.205+0000 7f2d0ffff700 1 -- 172.21.15.154:0/2053695949 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08010690 con 0x7f2d18133660 2023-09-30T22:22:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.206+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/2053695949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133660 msgr2=0x7f2d18135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.206+0000 7f2d1f7dc700 1 --2- 172.21.15.154:0/2053695949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133660 0x7f2d18135a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800bbc0 tx=0x7f2d0800bed0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.206+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/2053695949 shutdown_connections 2023-09-30T22:22:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.206+0000 7f2d1f7dc700 1 --2- 172.21.15.154:0/2053695949 >> v2:172.21.15.154:3300/0 conn(0x7f2d18135f80 0x7f2d18138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.206+0000 7f2d1f7dc700 1 --2- 172.21.15.154:0/2053695949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133660 0x7f2d18135a40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.206+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/2053695949 >> 172.21.15.154:0/2053695949 conn(0x7f2d180a2980 msgr2=0x7f2d180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:03.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.206+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/2053695949 shutdown_connections 2023-09-30T22:22:03.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.206+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/2053695949 wait complete. 2023-09-30T22:22:03.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.207+0000 7f2d1f7dc700 1 Processor -- start 2023-09-30T22:22:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.207+0000 7f2d1f7dc700 1 -- start start 2023-09-30T22:22:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1f7dc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18099e20 0x7f2d1806fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1f7dc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d18133660 0x7f2d18070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1f7dc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18135f80 0x7f2d18070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1f7dc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1812de60 con 0x7f2d18099e20 2023-09-30T22:22:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1f7dc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1809b470 con 0x7f2d18135f80 2023-09-30T22:22:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1f7dc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18119560 con 0x7f2d18133660 2023-09-30T22:22:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1d578700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18099e20 0x7f2d1806fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1d578700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18099e20 0x7f2d1806fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37768/0 (socket says 172.21.15.154:37768) 2023-09-30T22:22:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1d578700 1 -- 172.21.15.154:0/4129870877 learned_addr learned my addr 172.21.15.154:0/4129870877 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1dd79700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18135f80 0x7f2d18070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1cd77700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d18133660 0x7f2d18070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1d578700 1 -- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d18133660 msgr2=0x7f2d18070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1d578700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d18133660 0x7f2d18070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1d578700 1 -- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18135f80 msgr2=0x7f2d18070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1d578700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18135f80 0x7f2d18070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:03.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1d578700 1 -- 172.21.15.154:0/4129870877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10009a70 con 0x7f2d18099e20 2023-09-30T22:22:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1dd79700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18135f80 0x7f2d18070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1d578700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18099e20 0x7f2d1806fd10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c730 tx=0x7f2d1400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d0dffb700 1 -- 172.21.15.154:0/4129870877 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d140074e0 con 0x7f2d18099e20 2023-09-30T22:22:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d0dffb700 1 -- 172.21.15.154:0/4129870877 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14007640 con 0x7f2d18099e20 2023-09-30T22:22:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0800b7f0 con 0x7f2d18099e20 2023-09-30T22:22:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.208+0000 7f2d0dffb700 1 -- 172.21.15.154:0/4129870877 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14005a50 con 0x7f2d18099e20 2023-09-30T22:22:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.209+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d18133a30 con 0x7f2d18099e20 2023-09-30T22:22:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.209+0000 7f2d0dffb700 1 -- 172.21.15.154:0/4129870877 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2d14005bb0 con 0x7f2d18099e20 2023-09-30T22:22:03.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.209+0000 7f2d0dffb700 1 -- 172.21.15.154:0/4129870877 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f2d1403f170 con 0x7f2d18099e20 2023-09-30T22:22:03.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.210+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1804f2a0 con 0x7f2d18099e20 2023-09-30T22:22:03.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.214+0000 7f2d0dffb700 1 -- 172.21.15.154:0/4129870877 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d14017020 con 0x7f2d18099e20 2023-09-30T22:22:03.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.411+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f2d18072480 con 0x7f2d18099e20 2023-09-30T22:22:03.412 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-09-30T22:22:03.411+0000 7f3379ce5700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-09-30T22:22:03.601 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-09-30T22:22:03.600+0000 7fe6aeb2d680 -1 Falling back to public interface 2023-09-30T22:22:03.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.996+0000 7f2d0dffb700 1 -- 172.21.15.154:0/4129870877 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7f2d18072480 con 0x7f2d18099e20 2023-09-30T22:22:04.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.999+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 >> v1:172.21.15.154:6816/126757 conn(0x7f2cfc02f510 legacy=0x7f2cfc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.999+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18099e20 msgr2=0x7f2d1806fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:03.999+0000 7f2d1f7dc700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18099e20 0x7f2d1806fd10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c730 tx=0x7f2d1400ca40 comp rx=0 tx=0).stop 2023-09-30T22:22:04.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.000+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 shutdown_connections 2023-09-30T22:22:04.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.000+0000 7f2d1f7dc700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18135f80 0x7f2d18070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.000+0000 7f2d1f7dc700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18099e20 0x7f2d1806fd10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.000+0000 7f2d1f7dc700 1 --2- 172.21.15.154:0/4129870877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d18133660 0x7f2d18070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.000+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 >> 172.21.15.154:0/4129870877 conn(0x7f2d180a2980 msgr2=0x7f2d181324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.000+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 shutdown_connections 2023-09-30T22:22:04.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.000+0000 7f2d1f7dc700 1 -- 172.21.15.154:0/4129870877 wait complete. 2023-09-30T22:22:04.002 INFO:teuthology.orchestra.run.smithi154.stderr:marked down osd.2. 2023-09-30T22:22:04.017 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T22:22:04.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T22:22:04.019 INFO:tasks.ceph.osd.2:Started 2023-09-30T22:22:04.019 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T22:22:04.019 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:22:04.053 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T22:22:04.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.217+0000 7f72e2de4700 1 Processor -- start 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.217+0000 7f72e2de4700 1 -- start start 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.217+0000 7f72e2de4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a0a70 0x7f72dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.217+0000 7f72e2de4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72dc134120 0x7f72dc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.217+0000 7f72e2de4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc09dc00 con 0x7f72dc0a1380 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.217+0000 7f72e2de4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc09ea60 con 0x7f72dc134120 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.217+0000 7f72e2de4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc09dec0 con 0x7f72dc0a0a70 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72e1381700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72dc134120 0x7f72dc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72e0b80700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a0a70 0x7f72dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72dbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f72dc0a1380 0x7f72dc133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38502/0 (socket says 172.21.15.154:38502) 2023-09-30T22:22:04.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72dbfff700 1 -- 172.21.15.154:0/979834459 learned_addr learned my addr 172.21.15.154:0/979834459 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72db7fe700 1 -- 172.21.15.154:0/979834459 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172927267 0 0) 0x7f72dc09dc00 con 0x7f72dc0a1380 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72db7fe700 1 -- 172.21.15.154:0/979834459 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72cc0035b0 con 0x7f72dc0a1380 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72e0b80700 1 -- 172.21.15.154:0/979834459 >> v2:172.21.15.154:3300/0 conn(0x7f72dc134120 msgr2=0x7f72dc13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72e0b80700 1 --2- 172.21.15.154:0/979834459 >> v2:172.21.15.154:3300/0 conn(0x7f72dc134120 0x7f72dc13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72e0b80700 1 -- 172.21.15.154:0/979834459 >> v1:172.21.15.154:6789/0 conn(0x7f72dc0a1380 legacy=0x7f72dc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72e0b80700 1 -- 172.21.15.154:0/979834459 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc09e6a0 con 0x7f72dc0a0a70 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72e1381700 1 --2- 172.21.15.154:0/979834459 >> v2:172.21.15.154:3300/0 conn(0x7f72dc134120 0x7f72dc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72e0b80700 1 --2- 172.21.15.154:0/979834459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a0a70 0x7f72dc0a0e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009840 tx=0x7f72d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1aba1d7cf7165f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72db7fe700 1 -- 172.21.15.154:0/979834459 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0011830 con 0x7f72dc0a0a70 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72db7fe700 1 -- 172.21.15.154:0/979834459 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d0011990 con 0x7f72dc0a0a70 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.218+0000 7f72db7fe700 1 -- 172.21.15.154:0/979834459 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0011d20 con 0x7f72dc0a0a70 2023-09-30T22:22:04.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.219+0000 7f72e2de4700 1 -- 172.21.15.154:0/979834459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a0a70 msgr2=0x7f72dc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.219+0000 7f72e2de4700 1 --2- 172.21.15.154:0/979834459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a0a70 0x7f72dc0a0e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009840 tx=0x7f72d0009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.219+0000 7f72e2de4700 1 -- 172.21.15.154:0/979834459 shutdown_connections 2023-09-30T22:22:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.219+0000 7f72e2de4700 1 --2- 172.21.15.154:0/979834459 >> v2:172.21.15.154:3300/0 conn(0x7f72dc134120 0x7f72dc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.219+0000 7f72e2de4700 1 --2- 172.21.15.154:0/979834459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a0a70 0x7f72dc0a0e40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.219+0000 7f72e2de4700 1 -- 172.21.15.154:0/979834459 >> 172.21.15.154:0/979834459 conn(0x7f72dc0a6610 msgr2=0x7f72dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.219+0000 7f72e2de4700 1 -- 172.21.15.154:0/979834459 shutdown_connections 2023-09-30T22:22:04.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.219+0000 7f72e2de4700 1 -- 172.21.15.154:0/979834459 wait complete. 2023-09-30T22:22:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e2de4700 1 Processor -- start 2023-09-30T22:22:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e2de4700 1 -- start start 2023-09-30T22:22:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e2de4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc0a0a70 0x7f72dc122740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e2de4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a1380 0x7f72dc122c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e2de4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72dc134120 0x7f72dc1231c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e2de4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc123ba0 con 0x7f72dc0a0a70 2023-09-30T22:22:04.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e2de4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc125c70 con 0x7f72dc134120 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e2de4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc133640 con 0x7f72dc0a1380 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72dbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a1380 0x7f72dc122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e1381700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72dc134120 0x7f72dc1231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72dbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a1380 0x7f72dc122c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:32806/0 (socket says 172.21.15.154:32806) 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e1381700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72dc134120 0x7f72dc1231c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37198/0 (socket says 172.21.15.154:37198) 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72dbfff700 1 -- 172.21.15.154:0/1099547203 learned_addr learned my addr 172.21.15.154:0/1099547203 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.220+0000 7f72e0b80700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc0a0a70 0x7f72dc122740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72dbfff700 1 -- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72dc134120 msgr2=0x7f72dc1231c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72dbfff700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72dc134120 0x7f72dc1231c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72dbfff700 1 -- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc0a0a70 msgr2=0x7f72dc122740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72dbfff700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc0a0a70 0x7f72dc122740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72dbfff700 1 -- 172.21.15.154:0/1099547203 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4009a70 con 0x7f72dc0a1380 2023-09-30T22:22:04.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72e1381700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72dc134120 0x7f72dc1231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72e0b80700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc0a0a70 0x7f72dc122740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72dbfff700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a1380 0x7f72dc122c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72c8005910 tx=0x7f72c800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72d97fa700 1 -- 172.21.15.154:0/1099547203 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8005d70 con 0x7f72dc0a1380 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72d97fa700 1 -- 172.21.15.154:0/1099547203 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c80070d0 con 0x7f72dc0a1380 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d00094a0 con 0x7f72dc0a1380 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72d97fa700 1 -- 172.21.15.154:0/1099547203 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8007460 con 0x7f72dc0a1380 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.221+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc0a0430 con 0x7f72dc0a1380 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.222+0000 7f72d97fa700 1 -- 172.21.15.154:0/1099547203 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f72c80075c0 con 0x7f72dc0a1380 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.222+0000 7f72d97fa700 1 -- 172.21.15.154:0/1099547203 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f72c803ef80 con 0x7f72dc0a1380 2023-09-30T22:22:04.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.222+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc126a60 con 0x7f72dc0a1380 2023-09-30T22:22:04.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.226+0000 7f72d97fa700 1 -- 172.21.15.154:0/1099547203 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72c8017070 con 0x7f72dc0a1380 2023-09-30T22:22:04.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:04.423+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f72dc125e90 con 0x7f72dc0a1380 2023-09-30T22:22:04.424 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-09-30T22:22:04.423+0000 7f3379ce5700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2023-09-30T22:22:04.610 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-09-30T22:22:04.609+0000 7f288806f680 -1 Falling back to public interface 2023-09-30T22:22:05.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.002+0000 7f72d97fa700 1 -- 172.21.15.154:0/1099547203 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7f72c8018260 con 0x7f72dc0a1380 2023-09-30T22:22:05.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.004+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 >> v1:172.21.15.154:6816/126757 conn(0x7f72c002f510 legacy=0x7f72c00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.004+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a1380 msgr2=0x7f72dc122c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.004+0000 7f72e2de4700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a1380 0x7f72dc122c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72c8005910 tx=0x7f72c800c9e0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.004+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 shutdown_connections 2023-09-30T22:22:05.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.004+0000 7f72e2de4700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72dc134120 0x7f72dc1231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.004+0000 7f72e2de4700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72dc0a0a70 0x7f72dc122740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.004+0000 7f72e2de4700 1 --2- 172.21.15.154:0/1099547203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72dc0a1380 0x7f72dc122c80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.004+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 >> 172.21.15.154:0/1099547203 conn(0x7f72dc0a6610 msgr2=0x7f72dc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.005+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 shutdown_connections 2023-09-30T22:22:05.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.005+0000 7f72e2de4700 1 -- 172.21.15.154:0/1099547203 wait complete. 2023-09-30T22:22:05.007 INFO:teuthology.orchestra.run.smithi154.stderr:marked down osd.3. 2023-09-30T22:22:05.018 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T22:22:05.018 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T22:22:05.020 INFO:tasks.ceph.osd.3:Started 2023-09-30T22:22:05.020 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:22:05.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:05.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4ec88700 1 Processor -- start 2023-09-30T22:22:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4ec88700 1 -- start start 2023-09-30T22:22:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4ec88700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa480a0a70 0x7ffa480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4ec88700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa480a1380 0x7ffa48133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4ec88700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4809dc00 con 0x7ffa48133f50 2023-09-30T22:22:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4ec88700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4809ea60 con 0x7ffa480a0a70 2023-09-30T22:22:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4ec88700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4809dec0 con 0x7ffa480a1380 2023-09-30T22:22:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa47fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa480a1380 0x7ffa48133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4ca24700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa480a0a70 0x7ffa480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4d225700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ffa48133f50 0x7ffa4813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38518/0 (socket says 172.21.15.154:38518) 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa47fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa480a1380 0x7ffa48133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37226/0 (socket says 172.21.15.154:37226) 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4d225700 1 -- 172.21.15.154:0/3075206633 learned_addr learned my addr 172.21.15.154:0/3075206633 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.147+0000 7ffa4ca24700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa480a0a70 0x7ffa480a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37814/0 (socket says 172.21.15.154:37814) 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa47fff700 1 -- 172.21.15.154:0/3075206633 >> v2:172.21.15.154:3300/0 conn(0x7ffa480a0a70 msgr2=0x7ffa480a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa47fff700 1 --2- 172.21.15.154:0/3075206633 >> v2:172.21.15.154:3300/0 conn(0x7ffa480a0a70 0x7ffa480a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa47fff700 1 -- 172.21.15.154:0/3075206633 >> v1:172.21.15.154:6789/0 conn(0x7ffa48133f50 legacy=0x7ffa4813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa477fe700 1 -- 172.21.15.154:0/3075206633 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929318148 0 0) 0x7ffa4809dc00 con 0x7ffa48133f50 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa47fff700 1 -- 172.21.15.154:0/3075206633 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4809e6a0 con 0x7ffa480a1380 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa4ca24700 1 --2- 172.21.15.154:0/3075206633 >> v2:172.21.15.154:3300/0 conn(0x7ffa480a0a70 0x7ffa480a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa47fff700 1 --2- 172.21.15.154:0/3075206633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa480a1380 0x7ffa48133a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009840 tx=0x7ffa34009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e688d322279b2c6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa477fe700 1 -- 172.21.15.154:0/3075206633 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34011830 con 0x7ffa480a1380 2023-09-30T22:22:05.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa477fe700 1 -- 172.21.15.154:0/3075206633 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa34011990 con 0x7ffa480a1380 2023-09-30T22:22:05.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.148+0000 7ffa477fe700 1 -- 172.21.15.154:0/3075206633 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34011d20 con 0x7ffa480a1380 2023-09-30T22:22:05.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.149+0000 7ffa4ec88700 1 -- 172.21.15.154:0/3075206633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa480a1380 msgr2=0x7ffa48133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.149+0000 7ffa4ec88700 1 --2- 172.21.15.154:0/3075206633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa480a1380 0x7ffa48133a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009840 tx=0x7ffa34009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:05.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.149+0000 7ffa4ec88700 1 -- 172.21.15.154:0/3075206633 shutdown_connections 2023-09-30T22:22:05.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.149+0000 7ffa4ec88700 1 --2- 172.21.15.154:0/3075206633 >> v2:172.21.15.154:3300/0 conn(0x7ffa480a0a70 0x7ffa480a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.149+0000 7ffa4ec88700 1 --2- 172.21.15.154:0/3075206633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa480a1380 0x7ffa48133a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.149+0000 7ffa4ec88700 1 -- 172.21.15.154:0/3075206633 >> 172.21.15.154:0/3075206633 conn(0x7ffa480a6610 msgr2=0x7ffa480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.149+0000 7ffa4ec88700 1 -- 172.21.15.154:0/3075206633 shutdown_connections 2023-09-30T22:22:05.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.149+0000 7ffa4ec88700 1 -- 172.21.15.154:0/3075206633 wait complete. 2023-09-30T22:22:05.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.149+0000 7ffa4ec88700 1 Processor -- start 2023-09-30T22:22:05.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ec88700 1 -- start start 2023-09-30T22:22:05.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ec88700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa480a0a70 0x7ffa48122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ec88700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa480a1380 0x7ffa48122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ec88700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa48133f50 0x7ffa48123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ec88700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa48133450 con 0x7ffa480a1380 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ec88700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480a03e0 con 0x7ffa48133f50 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ec88700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa48123d00 con 0x7ffa480a0a70 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa47fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa480a1380 0x7ffa48122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ca24700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa480a0a70 0x7ffa48122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4d225700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa48133f50 0x7ffa48123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ca24700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa480a0a70 0x7ffa48122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:32816/0 (socket says 172.21.15.154:32816) 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa47fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa480a1380 0x7ffa48122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37822/0 (socket says 172.21.15.154:37822) 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa4ca24700 1 -- 172.21.15.154:0/2503523104 learned_addr learned my addr 172.21.15.154:0/2503523104 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa47fff700 1 -- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa480a0a70 msgr2=0x7ffa48122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa47fff700 1 --2- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa480a0a70 0x7ffa48122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa47fff700 1 -- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa48133f50 msgr2=0x7ffa48123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.150+0000 7ffa47fff700 1 --2- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa48133f50 0x7ffa48123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.151+0000 7ffa47fff700 1 -- 172.21.15.154:0/2503523104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0094a0 con 0x7ffa480a1380 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.151+0000 7ffa4d225700 1 --2- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa48133f50 0x7ffa48123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.151+0000 7ffa47fff700 1 --2- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa480a1380 0x7ffa48122e50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa34016000 tx=0x7ffa34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.151+0000 7ffa457fa700 1 -- 172.21.15.154:0/2503523104 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34004550 con 0x7ffa480a1380 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.151+0000 7ffa457fa700 1 -- 172.21.15.154:0/2503523104 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3401f070 con 0x7ffa480a1380 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.151+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa340094a0 con 0x7ffa480a1380 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.151+0000 7ffa457fa700 1 -- 172.21.15.154:0/2503523104 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa340038e0 con 0x7ffa480a1380 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.151+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa48133920 con 0x7ffa480a1380 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.152+0000 7ffa457fa700 1 -- 172.21.15.154:0/2503523104 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffa34003a40 con 0x7ffa480a1380 2023-09-30T22:22:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.152+0000 7ffa457fa700 1 -- 172.21.15.154:0/2503523104 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4020+0+0 (secure 0 0 0) 0x7ffa34021070 con 0x7ffa480a1380 2023-09-30T22:22:05.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.152+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4804f2a0 con 0x7ffa480a1380 2023-09-30T22:22:05.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.157+0000 7ffa457fa700 1 -- 172.21.15.154:0/2503523104 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa34003cf0 con 0x7ffa480a1380 2023-09-30T22:22:05.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.349+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa48126b80 con 0x7ffa480a1380 2023-09-30T22:22:05.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.350+0000 7ffa457fa700 1 -- 172.21.15.154:0/2503523104 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11934 (secure 0 0 0) 0x7ffa34019ba0 con 0x7ffa480a1380 2023-09-30T22:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":27,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:22:04.989624+0000","last_up_change":"2023-09-30T22:22:04.989624+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":118761}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":118761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":118761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":118761}]},"public_addr":"172.21.15.154:6800/118761","cluster_addr":"172.21.15.154:6801/118761","heartbeat_back_addr":"172.21.15.154:6803/118761","heartbeat_front_addr":"172.21.15.154:6802/118761","state":["exists"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-09-30T22:22:04.989624+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 >> v1:172.21.15.154:6816/126757 conn(0x7ffa2c02f510 legacy=0x7ffa2c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa480a1380 msgr2=0x7ffa48122e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 --2- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa480a1380 0x7ffa48122e50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffa34016000 tx=0x7ffa34004750 comp rx=0 tx=0).stop 2023-09-30T22:22:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 shutdown_connections 2023-09-30T22:22:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 --2- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa48133f50 0x7ffa48123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 --2- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa480a0a70 0x7ffa48122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 --2- 172.21.15.154:0/2503523104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa480a1380 0x7ffa48122e50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 >> 172.21.15.154:0/2503523104 conn(0x7ffa480a6610 msgr2=0x7ffa480a4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 shutdown_connections 2023-09-30T22:22:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:05.353+0000 7ffa4ec88700 1 -- 172.21.15.154:0/2503523104 wait complete. 2023-09-30T22:22:05.618 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-09-30T22:22:05.617+0000 7f8575282680 -1 Falling back to public interface 2023-09-30T22:22:06.111 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-09-30T22:22:06.111+0000 7fadbbecd680 -1 osd.0 23 log_to_monitors true 2023-09-30T22:22:07.245 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-09-30T22:22:07.245+0000 7fe6aeb2d680 -1 osd.1 23 log_to_monitors true 2023-09-30T22:22:07.892 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-09-30T22:22:07.891+0000 7fada7e48700 -1 osd.0 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:22:08.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:08.434 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-09-30T22:22:08.434+0000 7f288806f680 -1 osd.2 25 log_to_monitors true 2023-09-30T22:22:08.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.517+0000 7f6421844700 1 Processor -- start 2023-09-30T22:22:08.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.517+0000 7f6421844700 1 -- start start 2023-09-30T22:22:08.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f6421844700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c0a1550 0x7f641c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f6421844700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c139200 0x7f641c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f6421844700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641c09e9d0 con 0x7f641c0a0a70 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f6421844700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c09dc00 con 0x7f641c0a1550 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f6421844700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f641c09dec0 con 0x7f641c139200 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f641affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f641c0a0a70 0x7f641c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35128/0 (socket says 172.21.15.154:35128) 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f641affd700 1 -- 172.21.15.154:0/1026057171 learned_addr learned my addr 172.21.15.154:0/1026057171 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f641a7fc700 1 --2- 172.21.15.154:0/1026057171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c0a1550 0x7f641c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f641b7fe700 1 --2- 172.21.15.154:0/1026057171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c139200 0x7f641c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f6419ffb700 1 -- 172.21.15.154:0/1026057171 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186912943 0 0) 0x7f641c09e9d0 con 0x7f641c0a0a70 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f6419ffb700 1 -- 172.21.15.154:0/1026057171 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64040035b0 con 0x7f641c0a0a70 2023-09-30T22:22:08.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f641b7fe700 1 -- 172.21.15.154:0/1026057171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c0a1550 msgr2=0x7f641c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:08.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f641b7fe700 1 --2- 172.21.15.154:0/1026057171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c0a1550 0x7f641c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f6419ffb700 1 -- 172.21.15.154:0/1026057171 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3526708584 0 0) 0x7f64040035b0 con 0x7f641c0a0a70 2023-09-30T22:22:08.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f641b7fe700 1 -- 172.21.15.154:0/1026057171 >> v1:172.21.15.154:6789/0 conn(0x7f641c0a0a70 legacy=0x7f641c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.518+0000 7f641b7fe700 1 -- 172.21.15.154:0/1026057171 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c09e6a0 con 0x7f641c139200 2023-09-30T22:22:08.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.519+0000 7f641b7fe700 1 --2- 172.21.15.154:0/1026057171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c139200 0x7f641c13b5e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6414009dc0 tx=0x7f641400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89b94b57a11fe69b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:08.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.519+0000 7f6419ffb700 1 -- 172.21.15.154:0/1026057171 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641400e070 con 0x7f641c139200 2023-09-30T22:22:08.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.519+0000 7f6419ffb700 1 -- 172.21.15.154:0/1026057171 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6414003a20 con 0x7f641c139200 2023-09-30T22:22:08.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.519+0000 7f6419ffb700 1 -- 172.21.15.154:0/1026057171 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c001670 con 0x7f641c139200 2023-09-30T22:22:08.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.520+0000 7f6421844700 1 -- 172.21.15.154:0/1026057171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c139200 msgr2=0x7f641c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.520+0000 7f6421844700 1 --2- 172.21.15.154:0/1026057171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c139200 0x7f641c13b5e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6414009dc0 tx=0x7f641400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:08.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.520+0000 7f6421844700 1 -- 172.21.15.154:0/1026057171 shutdown_connections 2023-09-30T22:22:08.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.520+0000 7f6421844700 1 --2- 172.21.15.154:0/1026057171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c139200 0x7f641c13b5e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.520+0000 7f6421844700 1 --2- 172.21.15.154:0/1026057171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c0a1550 0x7f641c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.520+0000 7f6421844700 1 -- 172.21.15.154:0/1026057171 >> 172.21.15.154:0/1026057171 conn(0x7f641c0a6610 msgr2=0x7f641c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:08.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.520+0000 7f6421844700 1 -- 172.21.15.154:0/1026057171 shutdown_connections 2023-09-30T22:22:08.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.521+0000 7f6421844700 1 -- 172.21.15.154:0/1026057171 wait complete. 2023-09-30T22:22:08.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.521+0000 7f6421844700 1 Processor -- start 2023-09-30T22:22:08.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f6421844700 1 -- start start 2023-09-30T22:22:08.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f6421844700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c0a0a70 0x7f641c11e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f6421844700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c0a1550 0x7f641c11ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f6421844700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c139200 0x7f641c11f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f6421844700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c121a10 con 0x7f641c0a0a70 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f6421844700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c120b60 con 0x7f641c139200 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f6421844700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0a03e0 con 0x7f641c0a1550 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f641affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c0a0a70 0x7f641c11e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f641a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c0a1550 0x7f641c11ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f641affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c0a0a70 0x7f641c11e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39384/0 (socket says 172.21.15.154:39384) 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f641a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c0a1550 0x7f641c11ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52628/0 (socket says 172.21.15.154:52628) 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f641affd700 1 -- 172.21.15.154:0/1134674499 learned_addr learned my addr 172.21.15.154:0/1134674499 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.522+0000 7f641b7fe700 1 --2- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c139200 0x7f641c11f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f641a7fc700 1 -- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c139200 msgr2=0x7f641c11f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f641a7fc700 1 --2- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c139200 0x7f641c11f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f641a7fc700 1 -- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c0a0a70 msgr2=0x7f641c11e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f641a7fc700 1 --2- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c0a0a70 0x7f641c11e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f641a7fc700 1 -- 172.21.15.154:0/1134674499 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6414009a70 con 0x7f641c0a1550 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f641affd700 1 --2- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c0a0a70 0x7f641c11e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f641a7fc700 1 --2- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c0a1550 0x7f641c11ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f641000e810 tx=0x7f641000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f6403fff700 1 -- 172.21.15.154:0/1134674499 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641000c070 con 0x7f641c0a1550 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f6403fff700 1 -- 172.21.15.154:0/1134674499 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6410013610 con 0x7f641c0a1550 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641c1345b0 con 0x7f641c0a1550 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f6403fff700 1 -- 172.21.15.154:0/1134674499 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6410013980 con 0x7f641c0a1550 2023-09-30T22:22:08.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.523+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641c121f00 con 0x7f641c0a1550 2023-09-30T22:22:08.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.524+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c04f2a0 con 0x7f641c0a1550 2023-09-30T22:22:08.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.524+0000 7f6403fff700 1 -- 172.21.15.154:0/1134674499 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6410013ae0 con 0x7f641c0a1550 2023-09-30T22:22:08.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.525+0000 7f6403fff700 1 -- 172.21.15.154:0/1134674499 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f6410047350 con 0x7f641c0a1550 2023-09-30T22:22:08.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.530+0000 7f6403fff700 1 -- 172.21.15.154:0/1134674499 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6410044060 con 0x7f641c0a1550 2023-09-30T22:22:08.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.752+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f641c121ba0 con 0x7f641c0a1550 2023-09-30T22:22:08.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.753+0000 7f6403fff700 1 -- 172.21.15.154:0/1134674499 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12722 (secure 0 0 0) 0x7f6410044070 con 0x7f641c0a1550 2023-09-30T22:22:08.754 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:08.754 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":29,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:22:08.000604+0000","last_up_change":"2023-09-30T22:22:08.000604+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.0), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":18,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":130130}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":130130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":130130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":130130}]},"public_addr":"172.21.15.154:6800/130130","cluster_addr":"172.21.15.154:6801/130130","heartbeat_back_addr":"172.21.15.154:6803/130130","heartbeat_front_addr":"172.21.15.154:6802/130130","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":118762}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":118762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":118762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":118762}]},"public_addr":"172.21.15.154:6804/118762","cluster_addr":"172.21.15.154:6805/118762","heartbeat_back_addr":"172.21.15.154:6807/118762","heartbeat_front_addr":"172.21.15.154:6806/118762","state":["exists"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":118791}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":118791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":118791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":118791}]},"public_addr":"172.21.15.154:6812/118791","cluster_addr":"172.21.15.154:6813/118791","heartbeat_back_addr":"172.21.15.154:6815/118791","heartbeat_front_addr":"172.21.15.154:6814/118791","state":["exists"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":118792}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":118792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":118792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":118792}]},"public_addr":"172.21.15.154:6808/118792","cluster_addr":"172.21.15.154:6809/118792","heartbeat_back_addr":"172.21.15.154:6811/118792","heartbeat_front_addr":"172.21.15.154:6810/118792","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-09-30T22:22:04.989624+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:08.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.755+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 >> v1:172.21.15.154:6816/126757 conn(0x7f640802f510 legacy=0x7f64080319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.755+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c0a1550 msgr2=0x7f641c11ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.755+0000 7f6421844700 1 --2- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c0a1550 0x7f641c11ec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f641000e810 tx=0x7f641000eb20 comp rx=0 tx=0).stop 2023-09-30T22:22:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.756+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 shutdown_connections 2023-09-30T22:22:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.756+0000 7f6421844700 1 --2- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f641c139200 0x7f641c11f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.756+0000 7f6421844700 1 --2- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f641c0a0a70 0x7f641c11e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.756+0000 7f6421844700 1 --2- 172.21.15.154:0/1134674499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f641c0a1550 0x7f641c11ec40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.756+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 >> 172.21.15.154:0/1134674499 conn(0x7f641c0a6610 msgr2=0x7f641c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.756+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 shutdown_connections 2023-09-30T22:22:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:08.756+0000 7f6421844700 1 -- 172.21.15.154:0/1134674499 wait complete. 2023-09-30T22:22:08.919 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-09-30T22:22:08.918+0000 7fe69aaa8700 -1 osd.1 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:22:09.462 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-09-30T22:22:09.461+0000 7f8575282680 -1 osd.3 26 log_to_monitors true 2023-09-30T22:22:10.409 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-09-30T22:22:10.408+0000 7f2873fea700 -1 osd.2 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:22:11.232 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-09-30T22:22:11.232+0000 7f85611fd700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T22:22:11.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:11.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.893+0000 7fa637573700 1 Processor -- start 2023-09-30T22:22:11.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa637573700 1 -- start start 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa637573700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa630134140 0x7fa630138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa637573700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6301345a0 0x7fa63013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa637573700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63009b110 con 0x7fa63009ad40 2023-09-30T22:22:11.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa637573700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6300a3b60 con 0x7fa630134140 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa637573700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6300a1a80 con 0x7fa6301345a0 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa634b0e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa630134140 0x7fa630138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa635b10700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6301345a0 0x7fa63013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa634b0e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa630134140 0x7fa630138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39396/0 (socket says 172.21.15.154:39396) 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa635b10700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6301345a0 0x7fa63013b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56042/0 (socket says 172.21.15.154:56042) 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa634b0e700 1 -- 172.21.15.154:0/3606307460 learned_addr learned my addr 172.21.15.154:0/3606307460 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa634b0e700 1 -- 172.21.15.154:0/3606307460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6301345a0 msgr2=0x7fa63013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa634b0e700 1 --2- 172.21.15.154:0/3606307460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6301345a0 0x7fa63013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa634b0e700 1 -- 172.21.15.154:0/3606307460 >> v1:172.21.15.154:6789/0 conn(0x7fa63009ad40 legacy=0x7fa630133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa634b0e700 1 -- 172.21.15.154:0/3606307460 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300a2fa0 con 0x7fa630134140 2023-09-30T22:22:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa623fff700 1 -- 172.21.15.154:0/3606307460 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161832648 0 0) 0x7fa63009b110 con 0x7fa63009ad40 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.894+0000 7fa635b10700 1 --2- 172.21.15.154:0/3606307460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6301345a0 0x7fa63013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa634b0e700 1 --2- 172.21.15.154:0/3606307460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa630134140 0x7fa630138e80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0098f0 tx=0x7fa62c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfdac933aa5269e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa623fff700 1 -- 172.21.15.154:0/3606307460 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c011830 con 0x7fa630134140 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa623fff700 1 -- 172.21.15.154:0/3606307460 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c011990 con 0x7fa630134140 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa623fff700 1 -- 172.21.15.154:0/3606307460 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c011d20 con 0x7fa630134140 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa637573700 1 -- 172.21.15.154:0/3606307460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa630134140 msgr2=0x7fa630138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa637573700 1 --2- 172.21.15.154:0/3606307460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa630134140 0x7fa630138e80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0098f0 tx=0x7fa62c009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa637573700 1 -- 172.21.15.154:0/3606307460 shutdown_connections 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa637573700 1 --2- 172.21.15.154:0/3606307460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6301345a0 0x7fa63013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa637573700 1 --2- 172.21.15.154:0/3606307460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa630134140 0x7fa630138e80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa637573700 1 -- 172.21.15.154:0/3606307460 >> 172.21.15.154:0/3606307460 conn(0x7fa630099c40 msgr2=0x7fa63006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:11.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa637573700 1 -- 172.21.15.154:0/3606307460 shutdown_connections 2023-09-30T22:22:11.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.895+0000 7fa637573700 1 -- 172.21.15.154:0/3606307460 wait complete. 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.896+0000 7fa637573700 1 Processor -- start 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.896+0000 7fa637573700 1 -- start start 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa637573700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa63009ad40 0x7fa63011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa637573700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa630134140 0x7fa63011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa637573700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6301345a0 0x7fa63011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa637573700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63011edf0 con 0x7fa63009ad40 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa637573700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63013a980 con 0x7fa630134140 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa637573700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa63011e1c0 con 0x7fa6301345a0 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa634b0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa630134140 0x7fa63011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa63530f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa63009ad40 0x7fa63011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa634b0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa630134140 0x7fa63011ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56044/0 (socket says 172.21.15.154:56044) 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa635b10700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6301345a0 0x7fa63011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa634b0e700 1 -- 172.21.15.154:0/3632680506 learned_addr learned my addr 172.21.15.154:0/3632680506 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa63530f700 1 -- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6301345a0 msgr2=0x7fa63011d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa63530f700 1 --2- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6301345a0 0x7fa63011d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa63530f700 1 -- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa630134140 msgr2=0x7fa63011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa63530f700 1 --2- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa630134140 0x7fa63011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa63530f700 1 -- 172.21.15.154:0/3632680506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628009a70 con 0x7fa63009ad40 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa634b0e700 1 --2- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa630134140 0x7fa63011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa63530f700 1 --2- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa63009ad40 0x7fa63011c8c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa624000f60 tx=0x7fa62400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa621ffb700 1 -- 172.21.15.154:0/3632680506 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240052d0 con 0x7fa63009ad40 2023-09-30T22:22:11.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa621ffb700 1 -- 172.21.15.154:0/3632680506 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa624005450 con 0x7fa63009ad40 2023-09-30T22:22:11.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.897+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c009550 con 0x7fa63009ad40 2023-09-30T22:22:11.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.898+0000 7fa621ffb700 1 -- 172.21.15.154:0/3632680506 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240038c0 con 0x7fa63009ad40 2023-09-30T22:22:11.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.898+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa630133710 con 0x7fa63009ad40 2023-09-30T22:22:11.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.898+0000 7fa621ffb700 1 -- 172.21.15.154:0/3632680506 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa624003a20 con 0x7fa63009ad40 2023-09-30T22:22:11.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.899+0000 7fa621ffb700 1 -- 172.21.15.154:0/3632680506 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fa62403ee40 con 0x7fa63009ad40 2023-09-30T22:22:11.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.899+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63004f2a0 con 0x7fa63009ad40 2023-09-30T22:22:11.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:11.904+0000 7fa621ffb700 1 -- 172.21.15.154:0/3632680506 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa624019d00 con 0x7fa63009ad40 2023-09-30T22:22:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.093+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa63011e8e0 con 0x7fa63009ad40 2023-09-30T22:22:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.094+0000 7fa621ffb700 1 -- 172.21.15.154:0/3632680506 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12936 (secure 0 0 0) 0x7fa6240192c0 con 0x7fa63009ad40 2023-09-30T22:22:12.094 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:12.095 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":32,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:22:11.411450+0000","last_up_change":"2023-09-30T22:22:11.411450+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":130130}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":130130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":130130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":130130}]},"public_addr":"172.21.15.154:6800/130130","cluster_addr":"172.21.15.154:6801/130130","heartbeat_back_addr":"172.21.15.154:6803/130130","heartbeat_front_addr":"172.21.15.154:6802/130130","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":130229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":130229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":130229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":130229}]},"public_addr":"172.21.15.154:6804/130229","cluster_addr":"172.21.15.154:6805/130229","heartbeat_back_addr":"172.21.15.154:6807/130229","heartbeat_front_addr":"172.21.15.154:6806/130229","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":130339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":130339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":130339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":130339}]},"public_addr":"172.21.15.154:6808/130339","cluster_addr":"172.21.15.154:6809/130339","heartbeat_back_addr":"172.21.15.154:6811/130339","heartbeat_front_addr":"172.21.15.154:6810/130339","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":130679}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":130679}]},"public_addr":"172.21.15.154:6812/130679","cluster_addr":"172.21.15.154:6813/130679","heartbeat_back_addr":"172.21.15.154:6815/130679","heartbeat_front_addr":"172.21.15.154:6814/130679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-09-30T22:22:04.989624+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:12.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 >> v1:172.21.15.154:6816/126757 conn(0x7fa61402f510 legacy=0x7fa6140319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa63009ad40 msgr2=0x7fa63011c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:12.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 --2- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa63009ad40 0x7fa63011c8c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa624000f60 tx=0x7fa62400c6a0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 shutdown_connections 2023-09-30T22:22:12.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 --2- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6301345a0 0x7fa63011d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 --2- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa63009ad40 0x7fa63011c8c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 --2- 172.21.15.154:0/3632680506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa630134140 0x7fa63011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:12.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 >> 172.21.15.154:0/3632680506 conn(0x7fa630099c40 msgr2=0x7fa63009b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:12.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 shutdown_connections 2023-09-30T22:22:12.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:12.096+0000 7fa637573700 1 -- 172.21.15.154:0/3632680506 wait complete. 2023-09-30T22:22:12.109 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:22:12.109 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-09-30T22:22:12.120 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:22:12.120 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:22:12.130 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:22:14.774 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-09-30T22:22:14.774 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-09-30T22:22:14.785 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-09-30T22:22:14.785 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T22:22:14.785 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T22:22:14.788 INFO:tasks.ceph.mds.a:Started 2023-09-30T22:22:14.788 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:22:14.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:14.878 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-09-30T22:22:14.893 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-09-30T22:22:14.893+0000 7f3379ce5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-30T22:22:14.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7ac5b14700 1 Processor -- start 2023-09-30T22:22:14.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7ac5b14700 1 -- start start 2023-09-30T22:22:14.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7ac5b14700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ac009d8f0 0x7f7ac012feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7ac5b14700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01303f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7ac5b14700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac009a540 con 0x7f7ac00993e0 2023-09-30T22:22:14.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7ac5b14700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac009ad40 con 0x7f7ac009d8f0 2023-09-30T22:22:14.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7ac5b14700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac009e640 con 0x7f7ac009dcc0 2023-09-30T22:22:14.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7abf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ac009d8f0 0x7f7ac012feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7abeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01303f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7abeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01303f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56050/0 (socket says 172.21.15.154:56050) 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7abffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7ac00993e0 0x7f7ac0099840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35180/0 (socket says 172.21.15.154:35180) 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7abf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ac009d8f0 0x7f7ac012feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39422/0 (socket says 172.21.15.154:39422) 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.931+0000 7f7abeffd700 1 -- 172.21.15.154:0/3168051118 learned_addr learned my addr 172.21.15.154:0/3168051118 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7abeffd700 1 -- 172.21.15.154:0/3168051118 >> v2:172.21.15.154:3300/0 conn(0x7f7ac009d8f0 msgr2=0x7f7ac012feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7abeffd700 1 --2- 172.21.15.154:0/3168051118 >> v2:172.21.15.154:3300/0 conn(0x7f7ac009d8f0 0x7f7ac012feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7abeffd700 1 -- 172.21.15.154:0/3168051118 >> v1:172.21.15.154:6789/0 conn(0x7f7ac00993e0 legacy=0x7f7ac0099840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7abeffd700 1 -- 172.21.15.154:0/3168051118 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac009e3c0 con 0x7f7ac009dcc0 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7abf7fe700 1 --2- 172.21.15.154:0/3168051118 >> v2:172.21.15.154:3300/0 conn(0x7f7ac009d8f0 0x7f7ac012feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7abeffd700 1 --2- 172.21.15.154:0/3168051118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01303f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400bb90 tx=0x7f7ab400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36ab5b2e7d31e251 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:14.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7abe7fc700 1 -- 172.21.15.154:0/3168051118 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400dd30 con 0x7f7ac009dcc0 2023-09-30T22:22:14.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7abe7fc700 1 -- 172.21.15.154:0/3168051118 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab400de90 con 0x7f7ac009dcc0 2023-09-30T22:22:14.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7abe7fc700 1 -- 172.21.15.154:0/3168051118 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4010690 con 0x7f7ac009dcc0 2023-09-30T22:22:14.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3168051118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 msgr2=0x7f7ac01303f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7ac5b14700 1 --2- 172.21.15.154:0/3168051118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01303f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400bb90 tx=0x7f7ab400bea0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3168051118 shutdown_connections 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7ac5b14700 1 --2- 172.21.15.154:0/3168051118 >> v2:172.21.15.154:3300/0 conn(0x7f7ac009d8f0 0x7f7ac012feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7ac5b14700 1 --2- 172.21.15.154:0/3168051118 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01303f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.932+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3168051118 >> 172.21.15.154:0/3168051118 conn(0x7f7ac00a2b30 msgr2=0x7f7ac009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.933+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3168051118 shutdown_connections 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.933+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3168051118 wait complete. 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.933+0000 7f7ac5b14700 1 Processor -- start 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7ac5b14700 1 -- start start 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7ac5b14700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac00993e0 0x7f7ac01c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7ac5b14700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ac009d8f0 0x7f7ac01c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7ac5b14700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7ac5b14700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0128f40 con 0x7f7ac00993e0 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7ac5b14700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0071ba0 con 0x7f7ac009dcc0 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7ac5b14700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac012a1f0 con 0x7f7ac009d8f0 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7abffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7abf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac00993e0 0x7f7ac01c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7abffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01c8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56066/0 (socket says 172.21.15.154:56066) 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7abf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac00993e0 0x7f7ac01c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39432/0 (socket says 172.21.15.154:39432) 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7abffff700 1 -- 172.21.15.154:0/3171173906 learned_addr learned my addr 172.21.15.154:0/3171173906 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7abeffd700 1 --2- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ac009d8f0 0x7f7ac01c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7abffff700 1 -- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ac009d8f0 msgr2=0x7f7ac01c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.934+0000 7f7abffff700 1 --2- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ac009d8f0 0x7f7ac01c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7abffff700 1 -- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac00993e0 msgr2=0x7f7ac01c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7abffff700 1 --2- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac00993e0 0x7f7ac01c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7abffff700 1 -- 172.21.15.154:0/3171173906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0009430 con 0x7f7ac009dcc0 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7abf7fe700 1 --2- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac00993e0 0x7f7ac01c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7abffff700 1 --2- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01c8ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800cbd0 tx=0x7f7ab800cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7aa7fff700 1 -- 172.21.15.154:0/3171173906 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800aaa0 con 0x7f7ac009dcc0 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7aa7fff700 1 -- 172.21.15.154:0/3171173906 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800ac00 con 0x7f7ac009dcc0 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7aa7fff700 1 -- 172.21.15.154:0/3171173906 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8007070 con 0x7f7ac009dcc0 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab400b7f0 con 0x7f7ac009dcc0 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.935+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac01b6570 con 0x7f7ac009dcc0 2023-09-30T22:22:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.936+0000 7f7aa7fff700 1 -- 172.21.15.154:0/3171173906 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7ab80071d0 con 0x7f7ac009dcc0 2023-09-30T22:22:14.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.936+0000 7f7aa7fff700 1 -- 172.21.15.154:0/3171173906 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7ab803f8e0 con 0x7f7ac009dcc0 2023-09-30T22:22:14.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.936+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac01b6340 con 0x7f7ac009dcc0 2023-09-30T22:22:14.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:14.941+0000 7f7aa7fff700 1 -- 172.21.15.154:0/3171173906 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ab8017020 con 0x7f7ac009dcc0 2023-09-30T22:22:15.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.126+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ac004f2a0 con 0x7f7ac009dcc0 2023-09-30T22:22:15.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.127+0000 7f7aa7fff700 1 -- 172.21.15.154:0/3171173906 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13002 (secure 0 0 0) 0x7f7ab801b3b0 con 0x7f7ac009dcc0 2023-09-30T22:22:15.128 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:15.128 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:22:14.893892+0000","last_up_change":"2023-09-30T22:22:11.411450+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":130130}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":130130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":130130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":130130}]},"public_addr":"172.21.15.154:6800/130130","cluster_addr":"172.21.15.154:6801/130130","heartbeat_back_addr":"172.21.15.154:6803/130130","heartbeat_front_addr":"172.21.15.154:6802/130130","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":130229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":130229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":130229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":130229}]},"public_addr":"172.21.15.154:6804/130229","cluster_addr":"172.21.15.154:6805/130229","heartbeat_back_addr":"172.21.15.154:6807/130229","heartbeat_front_addr":"172.21.15.154:6806/130229","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":130339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":130339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":130339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":130339}]},"public_addr":"172.21.15.154:6808/130339","cluster_addr":"172.21.15.154:6809/130339","heartbeat_back_addr":"172.21.15.154:6811/130339","heartbeat_front_addr":"172.21.15.154:6810/130339","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":130679}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":130679}]},"public_addr":"172.21.15.154:6812/130679","cluster_addr":"172.21.15.154:6813/130679","heartbeat_back_addr":"172.21.15.154:6815/130679","heartbeat_front_addr":"172.21.15.154:6814/130679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-09-30T22:22:04.989624+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6817/2576993373":"2023-10-01T22:22:14.893865+0000","172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:15.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.129+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 >> v1:172.21.15.154:6816/126757 conn(0x7f7aac02f510 legacy=0x7f7aac0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.129+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 msgr2=0x7f7ac01c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.129+0000 7f7ac5b14700 1 --2- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01c8ce0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800cbd0 tx=0x7f7ab800cee0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.129+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 shutdown_connections 2023-09-30T22:22:15.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.129+0000 7f7ac5b14700 1 --2- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ac009dcc0 0x7f7ac01c8ce0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.129+0000 7f7ac5b14700 1 --2- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ac00993e0 0x7f7ac01c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.129+0000 7f7ac5b14700 1 --2- 172.21.15.154:0/3171173906 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7ac009d8f0 0x7f7ac01c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.129+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 >> 172.21.15.154:0/3171173906 conn(0x7f7ac00a2b30 msgr2=0x7f7ac012e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.130+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 shutdown_connections 2023-09-30T22:22:15.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.130+0000 7f7ac5b14700 1 -- 172.21.15.154:0/3171173906 wait complete. 2023-09-30T22:22:15.142 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:22:15.142 INFO:teuthology.run_tasks:Running task exec... 2023-09-30T22:22:15.152 INFO:teuthology.task.exec:Executing custom commands... 2023-09-30T22:22:15.152 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:22:15.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-09-30T22:22:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe209a0a700 1 Processor -- start 2023-09-30T22:22:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe209a0a700 1 -- start start 2023-09-30T22:22:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe209a0a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe204130030 0x7fe204130400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe209a0a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe204130940 0x7fe204099580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe209a0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20409aec0 0x7fe204099ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe209a0a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20409b380 con 0x7fe204130940 2023-09-30T22:22:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe209a0a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20412fe10 con 0x7fe20409aec0 2023-09-30T22:22:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe209a0a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe20409b5f0 con 0x7fe204130030 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe2037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20409aec0 0x7fe204099ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe2027fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe204130940 0x7fe204099580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe2027fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe204130940 0x7fe204099580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44038/0 (socket says 172.21.15.154:44038) 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe2037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20409aec0 0x7fe204099ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37088/0 (socket says 172.21.15.154:37088) 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe202ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe204130030 0x7fe204130400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.271+0000 7fe2027fc700 1 -- 172.21.15.154:0/1216235426 learned_addr learned my addr 172.21.15.154:0/1216235426 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe202ffd700 1 -- 172.21.15.154:0/1216235426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20409aec0 msgr2=0x7fe204099ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe202ffd700 1 --2- 172.21.15.154:0/1216235426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20409aec0 0x7fe204099ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe202ffd700 1 -- 172.21.15.154:0/1216235426 >> v2:172.21.15.154:3300/0 conn(0x7fe204130940 msgr2=0x7fe204099580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe202ffd700 1 --2- 172.21.15.154:0/1216235426 >> v2:172.21.15.154:3300/0 conn(0x7fe204130940 0x7fe204099580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe202ffd700 1 -- 172.21.15.154:0/1216235426 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20409b8b0 con 0x7fe204130030 2023-09-30T22:22:15.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe2027fc700 1 --2- 172.21.15.154:0/1216235426 >> v2:172.21.15.154:3300/0 conn(0x7fe204130940 0x7fe204099580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe202ffd700 1 --2- 172.21.15.154:0/1216235426 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe204130030 0x7fe204130400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009840 tx=0x7fe1f8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40b29a2c98869f53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe201ffb700 1 -- 172.21.15.154:0/1216235426 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8011830 con 0x7fe204130030 2023-09-30T22:22:15.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe201ffb700 1 -- 172.21.15.154:0/1216235426 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f8011990 con 0x7fe204130030 2023-09-30T22:22:15.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.272+0000 7fe201ffb700 1 -- 172.21.15.154:0/1216235426 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8011d20 con 0x7fe204130030 2023-09-30T22:22:15.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 -- 172.21.15.154:0/1216235426 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe204130030 msgr2=0x7fe204130400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 --2- 172.21.15.154:0/1216235426 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe204130030 0x7fe204130400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009840 tx=0x7fe1f8009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 -- 172.21.15.154:0/1216235426 shutdown_connections 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 --2- 172.21.15.154:0/1216235426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20409aec0 0x7fe204099ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 --2- 172.21.15.154:0/1216235426 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe204130030 0x7fe204130400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 --2- 172.21.15.154:0/1216235426 >> v2:172.21.15.154:3300/0 conn(0x7fe204130940 0x7fe204099580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 -- 172.21.15.154:0/1216235426 >> 172.21.15.154:0/1216235426 conn(0x7fe2040a2680 msgr2=0x7fe20409eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 -- 172.21.15.154:0/1216235426 shutdown_connections 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 -- 172.21.15.154:0/1216235426 wait complete. 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.273+0000 7fe209a0a700 1 Processor -- start 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe209a0a700 1 -- start start 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe209a0a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe20409aec0 0x7fe2041c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe209a0a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe204130030 0x7fe2041c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe209a0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe204130940 0x7fe2041c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe209a0a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20412f950 con 0x7fe204130030 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe209a0a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20406f120 con 0x7fe204130940 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe209a0a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe20406dd30 con 0x7fe20409aec0 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe202ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe20409aec0 0x7fe2041c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe2037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe204130940 0x7fe2041c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe2027fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe204130030 0x7fe2041c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe202ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe20409aec0 0x7fe2041c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44920/0 (socket says 172.21.15.154:44920) 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe2037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe204130940 0x7fe2041c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37100/0 (socket says 172.21.15.154:37100) 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe2027fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe204130030 0x7fe2041c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44050/0 (socket says 172.21.15.154:44050) 2023-09-30T22:22:15.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe202ffd700 1 -- 172.21.15.154:0/2993831789 learned_addr learned my addr 172.21.15.154:0/2993831789 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.274+0000 7fe2027fc700 1 -- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe20409aec0 msgr2=0x7fe2041c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe2027fc700 1 --2- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe20409aec0 0x7fe2041c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe2027fc700 1 -- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe204130940 msgr2=0x7fe2041c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe2027fc700 1 --2- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe204130940 0x7fe2041c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe2027fc700 1 -- 172.21.15.154:0/2993831789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f400b7f0 con 0x7fe204130030 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe2037fe700 1 --2- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe204130940 0x7fe2041c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe2027fc700 1 --2- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe204130030 0x7fe2041c4620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe20409e590 tx=0x7fe1f400e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe1ebfff700 1 -- 172.21.15.154:0/2993831789 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4004030 con 0x7fe204130030 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe1ebfff700 1 -- 172.21.15.154:0/2993831789 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4004190 con 0x7fe204130030 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f80094a0 con 0x7fe204130030 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe1ebfff700 1 -- 172.21.15.154:0/2993831789 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4004520 con 0x7fe204130030 2023-09-30T22:22:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20406d890 con 0x7fe204130030 2023-09-30T22:22:15.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.275+0000 7fe1ebfff700 1 -- 172.21.15.154:0/2993831789 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe1f40036a0 con 0x7fe204130030 2023-09-30T22:22:15.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.276+0000 7fe1ebfff700 1 -- 172.21.15.154:0/2993831789 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fe1f4042560 con 0x7fe204130030 2023-09-30T22:22:15.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.276+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20406f320 con 0x7fe204130030 2023-09-30T22:22:15.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.281+0000 7fe1ebfff700 1 -- 172.21.15.154:0/2993831789 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe20406f320 con 0x7fe204130030 2023-09-30T22:22:15.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.468+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe20406f320 con 0x7fe204130030 2023-09-30T22:22:15.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.469+0000 7fe1ebfff700 1 -- 172.21.15.154:0/2993831789 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+24192 (secure 0 0 0) 0x7fe20406f320 con 0x7fe204130030 2023-09-30T22:22:15.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:15.470 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-09-30T22:22:15.470 INFO:teuthology.orchestra.run.smithi154.stdout: "epoch": 34, 2023-09-30T22:22:15.470 INFO:teuthology.orchestra.run.smithi154.stdout: "fsid": "632db358-b709-49ad-a56a-97cde2869fcf", 2023-09-30T22:22:15.470 INFO:teuthology.orchestra.run.smithi154.stdout: "created": "2023-09-30T22:19:18.987338+0000", 2023-09-30T22:22:15.470 INFO:teuthology.orchestra.run.smithi154.stdout: "modified": "2023-09-30T22:22:14.893892+0000", 2023-09-30T22:22:15.470 INFO:teuthology.orchestra.run.smithi154.stdout: "last_up_change": "2023-09-30T22:22:11.411450+0000", 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "last_in_change": "2023-09-30T22:19:20.288789+0000", 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "flags_num": 5799936, 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "flags_set": [ 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "pglog_hardlimit", 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "purged_snapdirs", 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_deletes", 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "sortbitwise" 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "crush_version": 8, 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "full_ratio": 0.94999998807907104, 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-09-30T22:22:15.471 INFO:teuthology.orchestra.run.smithi154.stdout: "nearfull_ratio": 0.85000002384185791, 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_snapshot": "", 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "pool_max": 4, 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "max_osd": 4, 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "require_min_compat_client": "pacific", 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "min_compat_client": "luminous", 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "require_osd_release": "pacific", 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "allow_crimson": false, 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "pools": [ 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "pool": 1, 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "pool_name": ".mgr", 2023-09-30T22:22:15.472 INFO:teuthology.orchestra.run.smithi154.stdout: "create_time": "2023-09-30T22:19:27.265135+0000", 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "flags": 1, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "flags_names": "hashpspool", 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "type": 1, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 2, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "min_size": 1, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "crush_rule": 0, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "object_hash": 2, 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:22:15.473 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num": 1, 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_placement_num": 1, 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_placement_num_target": 1, 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_target": 1, 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_pending": 1, 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "last_pg_merge_meta": { 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "source_pgid": "0.0", 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "ready_epoch": 0, 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "last_epoch_started": 0, 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "last_epoch_clean": 0, 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "source_version": "0'0", 2023-09-30T22:22:15.474 INFO:teuthology.orchestra.run.smithi154.stdout: "target_version": "0'0" 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "last_change": "23", 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend": "0", 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "auid": 0, 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_seq": 0, 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_epoch": 0, 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "pool_snaps": [], 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "removed_snaps": "[]", 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "quota_max_bytes": 0, 2023-09-30T22:22:15.475 INFO:teuthology.orchestra.run.smithi154.stdout: "quota_max_objects": 0, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "tiers": [], 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "tier_of": -1, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "read_tier": -1, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "write_tier": -1, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_mode": "none", 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "target_max_bytes": 0, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "target_max_objects": 0, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_min_flush_age": 0, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_min_evict_age": 0, 2023-09-30T22:22:15.476 INFO:teuthology.orchestra.run.smithi154.stdout: "erasure_code_profile": "", 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_params": { 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "none" 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_period": 0, 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_count": 0, 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "use_gmt_hitset": true, 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "grade_table": [], 2023-09-30T22:22:15.477 INFO:teuthology.orchestra.run.smithi154.stdout: "stripe_width": 0, 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "expected_num_objects": 0, 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "fast_read": false, 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "options": { 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_max": 32, 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_min": 1 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "application_metadata": { 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": {}, 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr_devicehealth": {} 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "read_balance": { 2023-09-30T22:22:15.478 INFO:teuthology.orchestra.run.smithi154.stdout: "score_acting": 4, 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "score_stable": 4, 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "optimal_score": 0.5, 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "raw_score_acting": 2, 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "raw_score_stable": 2, 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "average_primary_affinity": 1, 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "pool": 2, 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "pool_name": "rbd", 2023-09-30T22:22:15.479 INFO:teuthology.orchestra.run.smithi154.stdout: "create_time": "2023-09-30T22:19:28.184247+0000", 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "flags": 1, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "flags_names": "hashpspool", 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "type": 1, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 2, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "min_size": 1, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "crush_rule": 0, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "object_hash": 2, 2023-09-30T22:22:15.480 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num": 8, 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_placement_num": 8, 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_placement_num_target": 8, 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_target": 8, 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_pending": 8, 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "last_pg_merge_meta": { 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "source_pgid": "0.0", 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "ready_epoch": 0, 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "last_epoch_started": 0, 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "last_epoch_clean": 0, 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "source_version": "0'0", 2023-09-30T22:22:15.481 INFO:teuthology.orchestra.run.smithi154.stdout: "target_version": "0'0" 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "last_change": "12", 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend": "0", 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "auid": 0, 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_seq": 0, 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_epoch": 0, 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "pool_snaps": [], 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "removed_snaps": "[]", 2023-09-30T22:22:15.482 INFO:teuthology.orchestra.run.smithi154.stdout: "quota_max_bytes": 0, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "quota_max_objects": 0, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "tiers": [], 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "tier_of": -1, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "read_tier": -1, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "write_tier": -1, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_mode": "none", 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "target_max_bytes": 0, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "target_max_objects": 0, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_min_flush_age": 0, 2023-09-30T22:22:15.483 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_min_evict_age": 0, 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "erasure_code_profile": "", 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_params": { 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "none" 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_period": 0, 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_count": 0, 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "use_gmt_hitset": true, 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:22:15.484 INFO:teuthology.orchestra.run.smithi154.stdout: "grade_table": [], 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "stripe_width": 0, 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "expected_num_objects": 0, 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "fast_read": false, 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "options": {}, 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "application_metadata": { 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "rbd": {} 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "read_balance": { 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "score_acting": 2.5, 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "score_stable": 2.5, 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "optimal_score": 1, 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "raw_score_acting": 2.5, 2023-09-30T22:22:15.485 INFO:teuthology.orchestra.run.smithi154.stdout: "raw_score_stable": 2.5, 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: "average_primary_affinity": 1, 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: "pool": 3, 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: "pool_name": "cephfs_metadata", 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: "create_time": "2023-09-30T22:19:32.024148+0000", 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: "flags": 1, 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: "flags_names": "hashpspool", 2023-09-30T22:22:15.486 INFO:teuthology.orchestra.run.smithi154.stdout: "type": 1, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 2, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "min_size": 1, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "crush_rule": 0, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "object_hash": 2, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num": 32, 2023-09-30T22:22:15.487 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_placement_num": 32, 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_placement_num_target": 32, 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_target": 32, 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_pending": 32, 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "last_pg_merge_meta": { 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "source_pgid": "0.0", 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "ready_epoch": 0, 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "last_epoch_started": 0, 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "last_epoch_clean": 0, 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "source_version": "0'0", 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "target_version": "0'0" 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "last_change": "15", 2023-09-30T22:22:15.488 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend": "0", 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "auid": 0, 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_seq": 0, 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_epoch": 0, 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "pool_snaps": [], 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "removed_snaps": "[]", 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "quota_max_bytes": 0, 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "quota_max_objects": 0, 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "tiers": [], 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "tier_of": -1, 2023-09-30T22:22:15.489 INFO:teuthology.orchestra.run.smithi154.stdout: "read_tier": -1, 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "write_tier": -1, 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_mode": "none", 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "target_max_bytes": 0, 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "target_max_objects": 0, 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_min_flush_age": 0, 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_min_evict_age": 0, 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "erasure_code_profile": "", 2023-09-30T22:22:15.490 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_params": { 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "none" 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_period": 0, 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_count": 0, 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "use_gmt_hitset": true, 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "grade_table": [], 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "stripe_width": 0, 2023-09-30T22:22:15.491 INFO:teuthology.orchestra.run.smithi154.stdout: "expected_num_objects": 0, 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "fast_read": false, 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "options": { 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_autoscale_bias": 4, 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_min": 16, 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_priority": 5 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "application_metadata": { 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "cephfs": { 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": "cephfs" 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "read_balance": { 2023-09-30T22:22:15.492 INFO:teuthology.orchestra.run.smithi154.stdout: "score_acting": 1.6299999952316284, 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "score_stable": 1.6299999952316284, 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "optimal_score": 1, 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "raw_score_acting": 1.6299999952316284, 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "raw_score_stable": 1.6299999952316284, 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "average_primary_affinity": 1, 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "pool": 4, 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "pool_name": "cephfs_data", 2023-09-30T22:22:15.493 INFO:teuthology.orchestra.run.smithi154.stdout: "create_time": "2023-09-30T22:19:32.601719+0000", 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "flags": 1, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "flags_names": "hashpspool", 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "type": 1, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 2, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "min_size": 1, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "crush_rule": 0, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_count": 0, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_target": 0, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "object_hash": 2, 2023-09-30T22:22:15.494 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_autoscale_mode": "off", 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num": 64, 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_placement_num": 64, 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_placement_num_target": 64, 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_target": 64, 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_pending": 64, 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "last_pg_merge_meta": { 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "source_pgid": "0.0", 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "ready_epoch": 0, 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "last_epoch_started": 0, 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "last_epoch_clean": 0, 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "source_version": "0'0", 2023-09-30T22:22:15.495 INFO:teuthology.orchestra.run.smithi154.stdout: "target_version": "0'0" 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "last_change": "16", 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend": "0", 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "auid": 0, 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_mode": "selfmanaged", 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_seq": 0, 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_epoch": 0, 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "pool_snaps": [], 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "removed_snaps": "[]", 2023-09-30T22:22:15.496 INFO:teuthology.orchestra.run.smithi154.stdout: "quota_max_bytes": 0, 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "quota_max_objects": 0, 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "tiers": [], 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "tier_of": -1, 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "read_tier": -1, 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "write_tier": -1, 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_mode": "none", 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "target_max_bytes": 0, 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "target_max_objects": 0, 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T22:22:15.497 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_min_flush_age": 0, 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "cache_min_evict_age": 0, 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "erasure_code_profile": "", 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_params": { 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "none" 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_period": 0, 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_count": 0, 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "use_gmt_hitset": true, 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "min_read_recency_for_promote": 0, 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "min_write_recency_for_promote": 0, 2023-09-30T22:22:15.498 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "hit_set_search_last_n": 0, 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "grade_table": [], 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "stripe_width": 0, 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "expected_num_objects": 0, 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "fast_read": false, 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "options": { 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_num_min": 64, 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "application_metadata": { 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "cephfs": { 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: "data": "cephfs" 2023-09-30T22:22:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: "read_balance": { 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: "score_acting": 1.059999942779541, 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: "score_stable": 1.059999942779541, 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: "optimal_score": 1, 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: "raw_score_acting": 1.059999942779541, 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: "raw_score_stable": 1.059999942779541, 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: "primary_affinity_weighted": 1, 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: "average_primary_affinity": 1, 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: "average_primary_affinity_weighted": 1 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.500 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "osds": [ 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": 0, 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "uuid": "9909cc74-5a3d-4745-a275-eb40291d9c49", 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "up": 1, 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "in": 1, 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "weight": 1, 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "primary_affinity": 1, 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "last_clean_begin": 9, 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "last_clean_end": 23, 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "up_from": 29, 2023-09-30T22:22:15.501 INFO:teuthology.orchestra.run.smithi154.stdout: "up_thru": 32, 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: "down_at": 24, 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: "lost_at": 0, 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: "public_addrs": { 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6800", 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130130 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_addrs": { 2023-09-30T22:22:15.502 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6801", 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130130 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_back_addrs": { 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6803", 2023-09-30T22:22:15.503 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130130 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_front_addrs": { 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6802", 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130130 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.504 INFO:teuthology.orchestra.run.smithi154.stdout: "public_addr": "172.21.15.154:6800/130130", 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_addr": "172.21.15.154:6801/130130", 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_back_addr": "172.21.15.154:6803/130130", 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_front_addr": "172.21.15.154:6802/130130", 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "state": [ 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "exists", 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "up" 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": 1, 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "uuid": "630d7abe-ba54-47a6-978d-475135a94dea", 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "up": 1, 2023-09-30T22:22:15.505 INFO:teuthology.orchestra.run.smithi154.stdout: "in": 1, 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "weight": 1, 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "primary_affinity": 1, 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "last_clean_begin": 9, 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "last_clean_end": 23, 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "up_from": 30, 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "up_thru": 32, 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "down_at": 25, 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "lost_at": 0, 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "public_addrs": { 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.506 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6804", 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130229 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_addrs": { 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6805", 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130229 2023-09-30T22:22:15.507 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_back_addrs": { 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6807", 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130229 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_front_addrs": { 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6806", 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130229 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "public_addr": "172.21.15.154:6804/130229", 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_addr": "172.21.15.154:6805/130229", 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_back_addr": "172.21.15.154:6807/130229", 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_front_addr": "172.21.15.154:6806/130229", 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "state": [ 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "exists", 2023-09-30T22:22:15.509 INFO:teuthology.orchestra.run.smithi154.stdout: "up" 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": 2, 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: "uuid": "a874650f-eff1-4a01-936f-7d02bdbc96d2", 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: "up": 1, 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: "in": 1, 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: "weight": 1, 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: "primary_affinity": 1, 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: "last_clean_begin": 9, 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: "last_clean_end": 25, 2023-09-30T22:22:15.510 INFO:teuthology.orchestra.run.smithi154.stdout: "up_from": 32, 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: "up_thru": 32, 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: "down_at": 26, 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: "lost_at": 0, 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: "public_addrs": { 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6808", 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130339 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_addrs": { 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6809", 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130339 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_back_addrs": { 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.512 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6811", 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130339 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_front_addrs": { 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6810", 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130339 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.513 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: "public_addr": "172.21.15.154:6808/130339", 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_addr": "172.21.15.154:6809/130339", 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_back_addr": "172.21.15.154:6811/130339", 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_front_addr": "172.21.15.154:6810/130339", 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: "state": [ 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: "exists", 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: "up" 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": 3, 2023-09-30T22:22:15.514 INFO:teuthology.orchestra.run.smithi154.stdout: "uuid": "23d7e2dd-76c1-4d97-97fd-7373fa3e719d", 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "up": 1, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "in": 1, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "weight": 1, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "primary_affinity": 1, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "last_clean_begin": 9, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "last_clean_end": 26, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "up_from": 32, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "up_thru": 32, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "down_at": 27, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "lost_at": 0, 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "public_addrs": { 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6812", 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130679 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_addrs": { 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6813", 2023-09-30T22:22:15.516 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130679 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_back_addrs": { 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6815", 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130679 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_front_addrs": { 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: "addrvec": [ 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "172.21.15.154:6814", 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 130679 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: "public_addr": "172.21.15.154:6812/130679", 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_addr": "172.21.15.154:6813/130679", 2023-09-30T22:22:15.518 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_back_addr": "172.21.15.154:6815/130679", 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: "heartbeat_front_addr": "172.21.15.154:6814/130679", 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: "state": [ 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: "exists", 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: "up" 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_xinfo": [ 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": 0, 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: "down_stamp": "0.000000", 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: "laggy_probability": 0, 2023-09-30T22:22:15.519 INFO:teuthology.orchestra.run.smithi154.stdout: "laggy_interval": 0, 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "features": 4540138322906710015, 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "old_weight": 0, 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "last_purged_snaps_scrub": "2023-09-30T22:19:25.162523+0000", 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "dead_epoch": 24 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": 1, 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "down_stamp": "0.000000", 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "laggy_probability": 0, 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "laggy_interval": 0, 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "features": 4540138322906710015, 2023-09-30T22:22:15.520 INFO:teuthology.orchestra.run.smithi154.stdout: "old_weight": 0, 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "last_purged_snaps_scrub": "2023-09-30T22:19:25.460402+0000", 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "dead_epoch": 25 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": 2, 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "down_stamp": "0.000000", 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "laggy_probability": 0, 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "laggy_interval": 0, 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "features": 4540138322906710015, 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "old_weight": 0, 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "last_purged_snaps_scrub": "2023-09-30T22:19:25.471551+0000", 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: "dead_epoch": 26 2023-09-30T22:22:15.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": 3, 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: "down_stamp": "2023-09-30T22:22:04.989624+0000", 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: "laggy_probability": 0, 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: "laggy_interval": 0, 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: "features": 4540138322906710015, 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: "old_weight": 0, 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: "last_purged_snaps_scrub": "2023-09-30T22:19:25.496057+0000", 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: "dead_epoch": 0 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.522 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_upmap": [], 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_upmap_items": [ 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: "pgid": "4.0", 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: "mappings": [ 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: "from": 1, 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: "to": 2 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.523 INFO:teuthology.orchestra.run.smithi154.stdout: "pgid": "4.2", 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: "mappings": [ 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: "from": 3, 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: "to": 2 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: "pgid": "4.a", 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: "mappings": [ 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: "from": 3, 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: "to": 0 2023-09-30T22:22:15.524 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: "pgid": "4.15", 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: "mappings": [ 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: "from": 3, 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: "to": 2 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.525 INFO:teuthology.orchestra.run.smithi154.stdout: "pgid": "4.16", 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: "mappings": [ 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: "from": 3, 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: "to": 2 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: "pgid": "4.30", 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: "mappings": [ 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: "from": 3, 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: "to": 2 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: "pgid": "4.33", 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: "mappings": [ 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: "from": 3, 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: "to": 0 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.527 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_upmap_primaries": [], 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "pg_temp": [], 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "primary_temp": [], 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklist": { 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "172.21.15.154:6817/2576993373": "2023-10-01T22:22:14.893865+0000", 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "172.21.15.154:0/956756939": "2023-10-01T22:21:47.164906+0000", 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "172.21.15.154:0/2017971531": "2023-10-01T22:21:47.164906+0000", 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "172.21.15.154:6816/118163": "2023-10-01T22:21:47.164906+0000" 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "range_blocklist": {}, 2023-09-30T22:22:15.528 INFO:teuthology.orchestra.run.smithi154.stdout: "erasure_code_profiles": { 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "default": { 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "crush-failure-domain": "osd", 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "k": "2", 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "m": "1", 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "plugin": "jerasure", 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "technique": "reed_sol_van" 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "removed_snaps_queue": [], 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "new_removed_snaps": [], 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "new_purged_snaps": [], 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "crush_node_flags": {}, 2023-09-30T22:22:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: "device_class_flags": {}, 2023-09-30T22:22:15.530 INFO:teuthology.orchestra.run.smithi154.stdout: "stretch_mode": { 2023-09-30T22:22:15.530 INFO:teuthology.orchestra.run.smithi154.stdout: "stretch_mode_enabled": false, 2023-09-30T22:22:15.530 INFO:teuthology.orchestra.run.smithi154.stdout: "stretch_bucket_count": 0, 2023-09-30T22:22:15.530 INFO:teuthology.orchestra.run.smithi154.stdout: "degraded_stretch_mode": 0, 2023-09-30T22:22:15.530 INFO:teuthology.orchestra.run.smithi154.stdout: "recovering_stretch_mode": 0, 2023-09-30T22:22:15.530 INFO:teuthology.orchestra.run.smithi154.stdout: "stretch_mode_bucket": 0 2023-09-30T22:22:15.530 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.530 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-09-30T22:22:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 >> v1:172.21.15.154:6816/126757 conn(0x7fe1f002f510 legacy=0x7fe1f00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe204130030 msgr2=0x7fe2041c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 --2- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe204130030 0x7fe2041c4620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe20409e590 tx=0x7fe1f400e640 comp rx=0 tx=0).stop 2023-09-30T22:22:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 shutdown_connections 2023-09-30T22:22:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 --2- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe204130940 0x7fe2041c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 --2- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe20409aec0 0x7fe2041c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 --2- 172.21.15.154:0/2993831789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe204130030 0x7fe2041c4620 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 >> 172.21.15.154:0/2993831789 conn(0x7fe2040a2680 msgr2=0x7fe20409ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 shutdown_connections 2023-09-30T22:22:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.471+0000 7fe209a0a700 1 -- 172.21.15.154:0/2993831789 wait complete. 2023-09-30T22:22:15.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-09-30T22:22:15.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7cade9700 1 Processor -- start 2023-09-30T22:22:15.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7cade9700 1 -- start start 2023-09-30T22:22:15.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7cade9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409da00 0x7fc7c409ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7cade9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7c409e310 0x7fc7c4133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7cade9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7cade9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c409ee70 con 0x7fc7c409e310 2023-09-30T22:22:15.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7cade9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c406b140 con 0x7fc7c409da00 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7cade9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c409ab80 con 0x7fc7c409e720 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7c3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7c409e310 0x7fc7c4133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7c9386700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7c8b85700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409da00 0x7fc7c409ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7c3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7c409e310 0x7fc7c4133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44054/0 (socket says 172.21.15.154:44054) 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7c9386700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c4133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44932/0 (socket says 172.21.15.154:44932) 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7c3fff700 1 -- 172.21.15.154:0/3355397565 learned_addr learned my addr 172.21.15.154:0/3355397565 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.650+0000 7fc7c8b85700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409da00 0x7fc7c409ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37110/0 (socket says 172.21.15.154:37110) 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c9386700 1 -- 172.21.15.154:0/3355397565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409da00 msgr2=0x7fc7c409ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c9386700 1 --2- 172.21.15.154:0/3355397565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409da00 0x7fc7c409ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c9386700 1 -- 172.21.15.154:0/3355397565 >> v2:172.21.15.154:3300/0 conn(0x7fc7c409e310 msgr2=0x7fc7c4133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c9386700 1 --2- 172.21.15.154:0/3355397565 >> v2:172.21.15.154:3300/0 conn(0x7fc7c409e310 0x7fc7c4133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c9386700 1 -- 172.21.15.154:0/3355397565 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c409a600 con 0x7fc7c409e720 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c3fff700 1 --2- 172.21.15.154:0/3355397565 >> v2:172.21.15.154:3300/0 conn(0x7fc7c409e310 0x7fc7c4133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c8b85700 1 --2- 172.21.15.154:0/3355397565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409da00 0x7fc7c409ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c9386700 1 --2- 172.21.15.154:0/3355397565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c4133e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009dc0 tx=0x7fc7bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3165f40f735d30f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c37fe700 1 -- 172.21.15.154:0/3355397565 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc00e070 con 0x7fc7c409e720 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c37fe700 1 -- 172.21.15.154:0/3355397565 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc00bae0 con 0x7fc7c409e720 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.651+0000 7fc7c37fe700 1 -- 172.21.15.154:0/3355397565 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc00be90 con 0x7fc7c409e720 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.652+0000 7fc7cade9700 1 -- 172.21.15.154:0/3355397565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 msgr2=0x7fc7c4133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.652+0000 7fc7cade9700 1 --2- 172.21.15.154:0/3355397565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c4133e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009dc0 tx=0x7fc7bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:15.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.652+0000 7fc7cade9700 1 -- 172.21.15.154:0/3355397565 shutdown_connections 2023-09-30T22:22:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.652+0000 7fc7cade9700 1 --2- 172.21.15.154:0/3355397565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409da00 0x7fc7c409ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.652+0000 7fc7cade9700 1 --2- 172.21.15.154:0/3355397565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c4133e50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.652+0000 7fc7cade9700 1 --2- 172.21.15.154:0/3355397565 >> v2:172.21.15.154:3300/0 conn(0x7fc7c409e310 0x7fc7c4133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.652+0000 7fc7cade9700 1 -- 172.21.15.154:0/3355397565 >> 172.21.15.154:0/3355397565 conn(0x7fc7c4099e60 msgr2=0x7fc7c40a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.652+0000 7fc7cade9700 1 -- 172.21.15.154:0/3355397565 shutdown_connections 2023-09-30T22:22:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.652+0000 7fc7cade9700 1 -- 172.21.15.154:0/3355397565 wait complete. 2023-09-30T22:22:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7cade9700 1 Processor -- start 2023-09-30T22:22:15.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7cade9700 1 -- start start 2023-09-30T22:22:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7cade9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7c409da00 0x7fc7c411f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7cade9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409e310 0x7fc7c411fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7cade9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c411ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7cade9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4122820 con 0x7fc7c409da00 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7cade9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4132f90 con 0x7fc7c409e310 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7cade9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c41211b0 con 0x7fc7c409e720 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7c8b85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7c409da00 0x7fc7c411f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7c9386700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c411ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7c8b85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7c409da00 0x7fc7c411f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44058/0 (socket says 172.21.15.154:44058) 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7c8b85700 1 -- 172.21.15.154:0/3994695650 learned_addr learned my addr 172.21.15.154:0/3994695650 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7c9386700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c411ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44940/0 (socket says 172.21.15.154:44940) 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.653+0000 7fc7c3fff700 1 --2- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409e310 0x7fc7c411fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c9386700 1 -- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409e310 msgr2=0x7fc7c411fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c9386700 1 --2- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409e310 0x7fc7c411fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c9386700 1 -- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7c409da00 msgr2=0x7fc7c411f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c9386700 1 --2- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7c409da00 0x7fc7c411f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c9386700 1 -- 172.21.15.154:0/3994695650 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b80094a0 con 0x7fc7c409e720 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c8b85700 1 --2- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7c409da00 0x7fc7c411f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c9386700 1 --2- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c411ff80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc016000 tx=0x7fc7bc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c17fa700 1 -- 172.21.15.154:0/3994695650 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc004550 con 0x7fc7c409e720 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c17fa700 1 -- 172.21.15.154:0/3994695650 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc020070 con 0x7fc7c409e720 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b0009550 con 0x7fc7c409e720 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7c17fa700 1 -- 172.21.15.154:0/3994695650 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc004950 con 0x7fc7c409e720 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.654+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc009a70 con 0x7fc7c409e720 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.655+0000 7fc7c17fa700 1 -- 172.21.15.154:0/3994695650 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc7bc027480 con 0x7fc7c409e720 2023-09-30T22:22:15.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.655+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c409cd50 con 0x7fc7c409e720 2023-09-30T22:22:15.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.655+0000 7fc7c17fa700 1 -- 172.21.15.154:0/3994695650 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc7bc022070 con 0x7fc7c409e720 2023-09-30T22:22:15.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.660+0000 7fc7c17fa700 1 -- 172.21.15.154:0/3994695650 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7bc011750 con 0x7fc7c409e720 2023-09-30T22:22:15.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.922+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc7c409a800 con 0x7fc7c409e720 2023-09-30T22:22:15.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.922+0000 7fc7c17fa700 1 -- 172.21.15.154:0/3994695650 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7fc7bc01b400 con 0x7fc7c409e720 2023-09-30T22:22:15.923 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-09-30T22:22:15.923 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": { 2023-09-30T22:22:15.923 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 3 2023-09-30T22:22:15.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.923 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": { 2023-09-30T22:22:15.923 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-09-30T22:22:15.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": { 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 4 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 1 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout: "overall": { 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph version 18.2.0-501-gfc1e90a3 (fc1e90a395a6a5631142eb70fd9bf3d22740a9da) reef (stable)": 9 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-09-30T22:22:15.924 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-09-30T22:22:15.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 >> v1:172.21.15.154:6816/126757 conn(0x7fc7a802f510 legacy=0x7fc7a80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 msgr2=0x7fc7c411ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:15.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 --2- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c411ff80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc016000 tx=0x7fc7bc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 shutdown_connections 2023-09-30T22:22:15.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 --2- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7c409e720 0x7fc7c411ff80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 --2- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7c409da00 0x7fc7c411f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 --2- 172.21.15.154:0/3994695650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7c409e310 0x7fc7c411fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:15.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 >> 172.21.15.154:0/3994695650 conn(0x7fc7c4099e60 msgr2=0x7fc7c41bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:15.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 shutdown_connections 2023-09-30T22:22:15.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:15.924+0000 7fc7cade9700 1 -- 172.21.15.154:0/3994695650 wait complete. 2023-09-30T22:22:15.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-09-30T22:22:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.056+0000 7fc4e8ee7700 1 Processor -- start 2023-09-30T22:22:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.056+0000 7fc4e8ee7700 1 -- start start 2023-09-30T22:22:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e8ee7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e409da00 0x7fc4e409ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e8ee7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e4134020 0x7fc4e413bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e8ee7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e409f340 con 0x7fc4e409e310 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e8ee7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e406b4b0 con 0x7fc4e4134020 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e8ee7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e409ee00 con 0x7fc4e409da00 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e409da00 0x7fc4e409ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e4134020 0x7fc4e413bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e1d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc4e409e310 0x7fc4e4133910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50240/0 (socket says 172.21.15.154:50240) 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e1d9b700 1 -- 172.21.15.154:0/1437608178 learned_addr learned my addr 172.21.15.154:0/1437608178 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e159a700 1 -- 172.21.15.154:0/1437608178 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740708294 0 0) 0x7fc4e409f340 con 0x7fc4e409e310 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e159a700 1 -- 172.21.15.154:0/1437608178 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4d00035b0 con 0x7fc4e409e310 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e2d9d700 1 -- 172.21.15.154:0/1437608178 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e409da00 msgr2=0x7fc4e409ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e2d9d700 1 --2- 172.21.15.154:0/1437608178 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e409da00 0x7fc4e409ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e2d9d700 1 -- 172.21.15.154:0/1437608178 >> v1:172.21.15.154:6789/0 conn(0x7fc4e409e310 legacy=0x7fc4e4133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e2d9d700 1 -- 172.21.15.154:0/1437608178 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e406b0e0 con 0x7fc4e4134020 2023-09-30T22:22:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e259c700 1 --2- 172.21.15.154:0/1437608178 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e409da00 0x7fc4e409ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e2d9d700 1 --2- 172.21.15.154:0/1437608178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e4134020 0x7fc4e413bb70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009dc0 tx=0x7fc4dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=780176f0704b365c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.057+0000 7fc4e159a700 1 -- 172.21.15.154:0/1437608178 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc00e070 con 0x7fc4e4134020 2023-09-30T22:22:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e159a700 1 -- 172.21.15.154:0/1437608178 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc00bb20 con 0x7fc4e4134020 2023-09-30T22:22:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e159a700 1 -- 172.21.15.154:0/1437608178 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc012430 con 0x7fc4e4134020 2023-09-30T22:22:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/1437608178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e4134020 msgr2=0x7fc4e413bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e8ee7700 1 --2- 172.21.15.154:0/1437608178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e4134020 0x7fc4e413bb70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009dc0 tx=0x7fc4dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/1437608178 shutdown_connections 2023-09-30T22:22:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e8ee7700 1 --2- 172.21.15.154:0/1437608178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e4134020 0x7fc4e413bb70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e8ee7700 1 --2- 172.21.15.154:0/1437608178 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e409da00 0x7fc4e409ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/1437608178 >> 172.21.15.154:0/1437608178 conn(0x7fc4e4099e60 msgr2=0x7fc4e40a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/1437608178 shutdown_connections 2023-09-30T22:22:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.058+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/1437608178 wait complete. 2023-09-30T22:22:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.059+0000 7fc4e8ee7700 1 Processor -- start 2023-09-30T22:22:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.059+0000 7fc4e8ee7700 1 -- start start 2023-09-30T22:22:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e8ee7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4e409da00 0x7fc4e411f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e8ee7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e409e310 0x7fc4e411f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e8ee7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e4134020 0x7fc4e411fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e8ee7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e4120870 con 0x7fc4e409da00 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e8ee7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e41215e0 con 0x7fc4e409e310 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e8ee7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e4122ec0 con 0x7fc4e4134020 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4e409da00 0x7fc4e411f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4e409da00 0x7fc4e411f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44064/0 (socket says 172.21.15.154:44064) 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e409e310 0x7fc4e411f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e259c700 1 -- 172.21.15.154:0/4234518761 learned_addr learned my addr 172.21.15.154:0/4234518761 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e2d9d700 1 --2- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e4134020 0x7fc4e411fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e259c700 1 -- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e4134020 msgr2=0x7fc4e411fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e259c700 1 --2- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e4134020 0x7fc4e411fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e259c700 1 -- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e409e310 msgr2=0x7fc4e411f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e259c700 1 --2- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e409e310 0x7fc4e411f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e259c700 1 -- 172.21.15.154:0/4234518761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0094a0 con 0x7fc4e409da00 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e1d9b700 1 --2- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e409e310 0x7fc4e411f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e259c700 1 --2- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4e409da00 0x7fc4e411f3a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00ec40 tx=0x7fc4cc00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4daffd700 1 -- 172.21.15.154:0/4234518761 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00c850 con 0x7fc4e409da00 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4daffd700 1 -- 172.21.15.154:0/4234518761 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc00c9b0 con 0x7fc4e409da00 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc009a70 con 0x7fc4e409da00 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4daffd700 1 -- 172.21.15.154:0/4234518761 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00cd20 con 0x7fc4e409da00 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.060+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e409cc70 con 0x7fc4e409da00 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.061+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e4122200 con 0x7fc4e409da00 2023-09-30T22:22:16.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.062+0000 7fc4daffd700 1 -- 172.21.15.154:0/4234518761 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc4cc004020 con 0x7fc4e409da00 2023-09-30T22:22:16.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.062+0000 7fc4daffd700 1 -- 172.21.15.154:0/4234518761 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc4cc0400a0 con 0x7fc4e409da00 2023-09-30T22:22:16.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.066+0000 7fc4daffd700 1 -- 172.21.15.154:0/4234518761 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4cc0042d0 con 0x7fc4e409da00 2023-09-30T22:22:16.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.250+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fc4e4122cf0 con 0x7fc4e409da00 2023-09-30T22:22:16.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.251+0000 7fc4daffd700 1 -- 172.21.15.154:0/4234518761 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v34) v1 ==== 59+0+37 (secure 0 0 0) 0x7fc4cc017070 con 0x7fc4e409da00 2023-09-30T22:22:16.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.252+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 >> v1:172.21.15.154:6816/126757 conn(0x7fc4c402f540 legacy=0x7fc4c40319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.252+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4e409da00 msgr2=0x7fc4e411f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.252+0000 7fc4e8ee7700 1 --2- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4e409da00 0x7fc4e411f3a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00ec40 tx=0x7fc4cc00ef50 comp rx=0 tx=0).stop 2023-09-30T22:22:16.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.252+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 shutdown_connections 2023-09-30T22:22:16.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.252+0000 7fc4e8ee7700 1 --2- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4e4134020 0x7fc4e411fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.253+0000 7fc4e8ee7700 1 --2- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4e409da00 0x7fc4e411f3a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.253+0000 7fc4e8ee7700 1 --2- 172.21.15.154:0/4234518761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4e409e310 0x7fc4e411f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.253+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 >> 172.21.15.154:0/4234518761 conn(0x7fc4e4099e60 msgr2=0x7fc4e41bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.253+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 shutdown_connections 2023-09-30T22:22:16.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.253+0000 7fc4e8ee7700 1 -- 172.21.15.154:0/4234518761 wait complete. 2023-09-30T22:22:16.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c6cad3700 1 Processor -- start 2023-09-30T22:22:16.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c6cad3700 1 -- start start 2023-09-30T22:22:16.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c6cad3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c68131b60 0x7f8c68131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c6cad3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c6806fce0 0x7f8c680700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c6cad3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680719b0 con 0x7f8c68070630 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c6cad3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c681316c0 con 0x7f8c6806fce0 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c6cad3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68071430 con 0x7f8c68131b60 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c6659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c68131b60 0x7f8c68131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c65d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c6806fce0 0x7f8c680700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c66d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8c68070630 0x7f8c681389f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50250/0 (socket says 172.21.15.154:50250) 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.360+0000 7f8c66d9d700 1 -- 172.21.15.154:0/609469326 learned_addr learned my addr 172.21.15.154:0/609469326 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6659c700 1 -- 172.21.15.154:0/609469326 >> v2:172.21.15.154:3300/0 conn(0x7f8c6806fce0 msgr2=0x7f8c680700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6659c700 1 --2- 172.21.15.154:0/609469326 >> v2:172.21.15.154:3300/0 conn(0x7f8c6806fce0 0x7f8c680700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6659c700 1 -- 172.21.15.154:0/609469326 >> v1:172.21.15.154:6789/0 conn(0x7f8c68070630 legacy=0x7f8c681389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6559a700 1 -- 172.21.15.154:0/609469326 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569238050 0 0) 0x7f8c680719b0 con 0x7f8c68070630 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6659c700 1 -- 172.21.15.154:0/609469326 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680a0550 con 0x7f8c68131b60 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c65d9b700 1 --2- 172.21.15.154:0/609469326 >> v2:172.21.15.154:3300/0 conn(0x7f8c6806fce0 0x7f8c680700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6659c700 1 --2- 172.21.15.154:0/609469326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c68131b60 0x7f8c68131f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009840 tx=0x7f8c58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24c67795b090babc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6559a700 1 -- 172.21.15.154:0/609469326 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58011830 con 0x7f8c68131b60 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6559a700 1 -- 172.21.15.154:0/609469326 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58011990 con 0x7f8c68131b60 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6559a700 1 -- 172.21.15.154:0/609469326 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58011d20 con 0x7f8c68131b60 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6cad3700 1 -- 172.21.15.154:0/609469326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c68131b60 msgr2=0x7f8c68131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.361+0000 7f8c6cad3700 1 --2- 172.21.15.154:0/609469326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c68131b60 0x7f8c68131f30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009840 tx=0x7f8c58009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.362+0000 7f8c6cad3700 1 -- 172.21.15.154:0/609469326 shutdown_connections 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.362+0000 7f8c6cad3700 1 --2- 172.21.15.154:0/609469326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c68131b60 0x7f8c68131f30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.362+0000 7f8c6cad3700 1 --2- 172.21.15.154:0/609469326 >> v2:172.21.15.154:3300/0 conn(0x7f8c6806fce0 0x7f8c680700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.362+0000 7f8c6cad3700 1 -- 172.21.15.154:0/609469326 >> 172.21.15.154:0/609469326 conn(0x7f8c680a4230 msgr2=0x7f8c680a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:16.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.362+0000 7f8c6cad3700 1 -- 172.21.15.154:0/609469326 shutdown_connections 2023-09-30T22:22:16.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.362+0000 7f8c6cad3700 1 -- 172.21.15.154:0/609469326 wait complete. 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6cad3700 1 Processor -- start 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6cad3700 1 -- start start 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6cad3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c6806fce0 0x7f8c6808afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6cad3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c68070630 0x7f8c6808b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6cad3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c68131b60 0x7f8c6808ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6cad3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6808e0a0 con 0x7f8c68070630 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6cad3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680729e0 con 0x7f8c6806fce0 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6cad3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6809f440 con 0x7f8c68131b60 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c65d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c68070630 0x7f8c6808b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c6806fce0 0x7f8c6808afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c65d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c68070630 0x7f8c6808b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44082/0 (socket says 172.21.15.154:44082) 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c6659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c6806fce0 0x7f8c6808afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37148/0 (socket says 172.21.15.154:37148) 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c65d9b700 1 -- 172.21.15.154:0/3521383222 learned_addr learned my addr 172.21.15.154:0/3521383222 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.363+0000 7f8c66d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c68131b60 0x7f8c6808ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c65d9b700 1 -- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c68131b60 msgr2=0x7f8c6808ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c65d9b700 1 --2- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c68131b60 0x7f8c6808ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c65d9b700 1 -- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c6806fce0 msgr2=0x7f8c6808afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c65d9b700 1 --2- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c6806fce0 0x7f8c6808afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c65d9b700 1 -- 172.21.15.154:0/3521383222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c500094a0 con 0x7f8c68070630 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c6659c700 1 --2- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c6806fce0 0x7f8c6808afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c65d9b700 1 --2- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c68070630 0x7f8c6808b510 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000ebb0 tx=0x7f8c5000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c5effd700 1 -- 172.21.15.154:0/3521383222 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000c850 con 0x7f8c68070630 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c5effd700 1 -- 172.21.15.154:0/3521383222 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5000c9b0 con 0x7f8c68070630 2023-09-30T22:22:16.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c5effd700 1 -- 172.21.15.154:0/3521383222 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000cd40 con 0x7f8c68070630 2023-09-30T22:22:16.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c580094a0 con 0x7f8c68070630 2023-09-30T22:22:16.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.364+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6806aa90 con 0x7f8c68070630 2023-09-30T22:22:16.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.365+0000 7f8c5effd700 1 -- 172.21.15.154:0/3521383222 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8c50013470 con 0x7f8c68070630 2023-09-30T22:22:16.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.365+0000 7f8c5effd700 1 -- 172.21.15.154:0/3521383222 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8c5003fc40 con 0x7f8c68070630 2023-09-30T22:22:16.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.365+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c68075190 con 0x7f8c68070630 2023-09-30T22:22:16.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.370+0000 7f8c5effd700 1 -- 172.21.15.154:0/3521383222 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c50021080 con 0x7f8c68070630 2023-09-30T22:22:16.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:16.554+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f8c68068580 con 0x7f8c68070630 2023-09-30T22:22:16.915 INFO:tasks.ceph.mgr.x.smithi154.stderr:terminate called recursively 2023-09-30T22:22:16.916 INFO:tasks.ceph.mgr.x.smithi154.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-09-30T22:22:16.916 INFO:tasks.ceph.mgr.x.smithi154.stderr: what(): End of buffer [buffer:2] 2023-09-30T22:22:16.916 INFO:tasks.ceph.mgr.x.smithi154.stderr:*** Caught signal (Aborted) ** 2023-09-30T22:22:16.916 INFO:tasks.ceph.mgr.x.smithi154.stderr: in thread 7fba4836b700 thread_name:ms_dispatch 2023-09-30T22:22:17.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.157+0000 7f8c6659c700 1 -- 172.21.15.154:0/3521383222 >> v1:172.21.15.154:6816/126757 conn(0x7f8c4802f510 legacy=0x7f8c480319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2023-09-30T22:22:17.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.157+0000 7f8c6659c700 1 -- 172.21.15.154:0/3521383222 >> v1:172.21.15.154:6816/126757 conn(0x7f8c4802f510 legacy=0x7f8c480319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-30T22:22:17.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.157+0000 7f8c6659c700 1 --1- 172.21.15.154:0/3521383222 >> v1:172.21.15.154:6816/126757 conn(0x7f8c4802f510 0x7f8c480319c0 :-1 s=OPENED pgs=56 cs=1 l=1).handle_message read tag failed 2023-09-30T22:22:17.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.157+0000 7f8c6659c700 1 --1- 172.21.15.154:0/3521383222 >> v1:172.21.15.154:6816/126757 conn(0x7f8c4802f510 0x7f8c480319c0 :-1 s=OPENED pgs=56 cs=1 l=1).fault on lossy channel, failing 2023-09-30T22:22:17.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.157+0000 7f8c5effd700 1 -- 172.21.15.154:0/3521383222 >> v1:172.21.15.154:6816/126757 conn(0x7f8c4802f510 legacy=0x7f8c480319c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-09-30T22:22:17.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.366+0000 7f8c6659c700 1 -- 172.21.15.154:0/3521383222 >> v1:172.21.15.154:6816/126757 conn(0x7f8c4802f510 legacy=0x7f8c400055c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:17.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.430+0000 7f8c5effd700 1 -- 172.21.15.154:0/3521383222 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v35) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8c50017020 con 0x7f8c68070630 2023-09-30T22:22:17.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 >> v1:172.21.15.154:6816/126757 conn(0x7f8c4802f510 legacy=0x7f8c400055c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:17.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c68070630 msgr2=0x7f8c6808b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 --2- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c68070630 0x7f8c6808b510 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000ebb0 tx=0x7f8c5000eec0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 shutdown_connections 2023-09-30T22:22:17.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 --2- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c68131b60 0x7f8c6808ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 --2- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c6806fce0 0x7f8c6808afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 --2- 172.21.15.154:0/3521383222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c68070630 0x7f8c6808b510 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 >> 172.21.15.154:0/3521383222 conn(0x7f8c680a4230 msgr2=0x7f8c680a2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 shutdown_connections 2023-09-30T22:22:17.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.434+0000 7f8c6cad3700 1 -- 172.21.15.154:0/3521383222 wait complete. 2023-09-30T22:22:17.436 INFO:teuthology.orchestra.run.smithi154.stderr:set pool 1 pg_autoscale_mode to off 2023-09-30T22:22:17.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.546+0000 7f4b844f1700 1 Processor -- start 2023-09-30T22:22:17.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b844f1700 1 -- start start 2023-09-30T22:22:17.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b844f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c135a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b844f1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b7c135fb0 0x7f4b7c138390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b844f1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c06bba0 con 0x7f4b7c130950 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b844f1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c09f4d0 con 0x7f4b7c135fb0 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b844f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c09c310 con 0x7f4b7c131430 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b82a8e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b7c135fb0 0x7f4b7c138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b81a8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c135a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b82a8e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b7c135fb0 0x7f4b7c138390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44094/0 (socket says 172.21.15.154:44094) 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b82a8e700 1 -- 172.21.15.154:0/1161574000 learned_addr learned my addr 172.21.15.154:0/1161574000 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.547+0000 7f4b81a8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c135a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37152/0 (socket says 172.21.15.154:37152) 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b81a8c700 1 -- 172.21.15.154:0/1161574000 >> v2:172.21.15.154:3300/0 conn(0x7f4b7c135fb0 msgr2=0x7f4b7c138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:17.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b81a8c700 1 --2- 172.21.15.154:0/1161574000 >> v2:172.21.15.154:3300/0 conn(0x7f4b7c135fb0 0x7f4b7c138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b81a8c700 1 -- 172.21.15.154:0/1161574000 >> v1:172.21.15.154:6789/0 conn(0x7f4b7c130950 legacy=0x7f4b7c130d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b81a8c700 1 -- 172.21.15.154:0/1161574000 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c09c050 con 0x7f4b7c131430 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b8128b700 1 -- 172.21.15.154:0/1161574000 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010363812 0 0) 0x7f4b7c06bba0 con 0x7f4b7c130950 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b81a8c700 1 --2- 172.21.15.154:0/1161574000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c135a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009840 tx=0x7f4b78009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2483d31603476d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b8128b700 1 -- 172.21.15.154:0/1161574000 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78011830 con 0x7f4b7c131430 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b8128b700 1 -- 172.21.15.154:0/1161574000 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78011990 con 0x7f4b7c131430 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b8128b700 1 -- 172.21.15.154:0/1161574000 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78011d20 con 0x7f4b7c131430 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b844f1700 1 -- 172.21.15.154:0/1161574000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 msgr2=0x7f4b7c135a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b844f1700 1 --2- 172.21.15.154:0/1161574000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c135a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009840 tx=0x7f4b78009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b844f1700 1 -- 172.21.15.154:0/1161574000 shutdown_connections 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b844f1700 1 --2- 172.21.15.154:0/1161574000 >> v2:172.21.15.154:3300/0 conn(0x7f4b7c135fb0 0x7f4b7c138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b844f1700 1 --2- 172.21.15.154:0/1161574000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c135a70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.548+0000 7f4b844f1700 1 -- 172.21.15.154:0/1161574000 >> 172.21.15.154:0/1161574000 conn(0x7f4b7c09fc90 msgr2=0x7f4b7c0a0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:17.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.549+0000 7f4b844f1700 1 -- 172.21.15.154:0/1161574000 shutdown_connections 2023-09-30T22:22:17.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.549+0000 7f4b844f1700 1 -- 172.21.15.154:0/1161574000 wait complete. 2023-09-30T22:22:17.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.549+0000 7f4b844f1700 1 Processor -- start 2023-09-30T22:22:17.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.549+0000 7f4b844f1700 1 -- start start 2023-09-30T22:22:17.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b844f1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c130950 0x7f4b7c12d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b844f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c12db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b844f1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b7c135fb0 0x7f4b7c1c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:17.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b844f1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c09e810 con 0x7f4b7c130950 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b844f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c12ada0 con 0x7f4b7c131430 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b844f1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c12aaf0 con 0x7f4b7c135fb0 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b8228d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c130950 0x7f4b7c12d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b8228d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c130950 0x7f4b7c12d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44106/0 (socket says 172.21.15.154:44106) 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b81a8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c12db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b82a8e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b7c135fb0 0x7f4b7c1c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b8228d700 1 -- 172.21.15.154:0/454654463 learned_addr learned my addr 172.21.15.154:0/454654463 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b8228d700 1 -- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b7c135fb0 msgr2=0x7f4b7c1c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b8228d700 1 --2- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b7c135fb0 0x7f4b7c1c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b8228d700 1 -- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 msgr2=0x7f4b7c12db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:17.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b8228d700 1 --2- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c12db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b8228d700 1 -- 172.21.15.154:0/454654463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780094a0 con 0x7f4b7c130950 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b81a8c700 1 --2- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c12db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.550+0000 7f4b8228d700 1 --2- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c130950 0x7f4b7c12d5e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b70001eb0 tx=0x7f4b7000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.551+0000 7f4b6effd700 1 -- 172.21.15.154:0/454654463 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b700054e0 con 0x7f4b7c130950 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.551+0000 7f4b6effd700 1 -- 172.21.15.154:0/454654463 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b70003680 con 0x7f4b7c130950 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.551+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c12c170 con 0x7f4b7c130950 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.551+0000 7f4b6effd700 1 -- 172.21.15.154:0/454654463 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b700039f0 con 0x7f4b7c130950 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.551+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c12e060 con 0x7f4b7c130950 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.551+0000 7f4b6effd700 1 -- 172.21.15.154:0/454654463 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4b70003b50 con 0x7f4b7c130950 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.552+0000 7f4b6effd700 1 -- 172.21.15.154:0/454654463 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4b7003ef20 con 0x7f4b7c130950 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.552+0000 7f4b81a8c700 1 -- 172.21.15.154:0/454654463 >> v1:172.21.15.154:6816/126757 conn(0x7f4b6002f510 legacy=0x7f4b600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:17.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.552+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c09cf30 con 0x7f4b7c130950 2023-09-30T22:22:17.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.557+0000 7f4b6effd700 1 -- 172.21.15.154:0/454654463 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b70017070 con 0x7f4b7c130950 2023-09-30T22:22:17.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.737+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f4b7c068580 con 0x7f4b7c130950 2023-09-30T22:22:17.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:17.753+0000 7f4b81a8c700 1 -- 172.21.15.154:0/454654463 >> v1:172.21.15.154:6816/126757 conn(0x7f4b6002f510 legacy=0x7f4b600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:18.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.154+0000 7f4b81a8c700 1 -- 172.21.15.154:0/454654463 >> v1:172.21.15.154:6816/126757 conn(0x7f4b6002f510 legacy=0x7f4b600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:18.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.439+0000 7f4b6effd700 1 -- 172.21.15.154:0/454654463 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v36) v1 ==== 152+0+0 (secure 0 0 0) 0x7f4b7001b3b0 con 0x7f4b7c130950 2023-09-30T22:22:18.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 >> v1:172.21.15.154:6816/126757 conn(0x7f4b6002f510 legacy=0x7f4b600319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:18.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c130950 msgr2=0x7f4b7c12d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 --2- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c130950 0x7f4b7c12d5e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4b70001eb0 tx=0x7f4b7000c800 comp rx=0 tx=0).stop 2023-09-30T22:22:18.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 shutdown_connections 2023-09-30T22:22:18.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 --2- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b7c135fb0 0x7f4b7c1c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 --2- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c130950 0x7f4b7c12d5e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 --2- 172.21.15.154:0/454654463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7c131430 0x7f4b7c12db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 >> 172.21.15.154:0/454654463 conn(0x7f4b7c09fc90 msgr2=0x7f4b7c12f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 shutdown_connections 2023-09-30T22:22:18.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.442+0000 7f4b844f1700 1 -- 172.21.15.154:0/454654463 wait complete. 2023-09-30T22:22:18.443 INFO:teuthology.orchestra.run.smithi154.stderr:set pool 2 pg_autoscale_mode to off 2023-09-30T22:22:18.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa93bb700 1 Processor -- start 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa93bb700 1 -- start start 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa93bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4360 0x7fdfa40a4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa93bb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfa40a4c70 0x7fdfa4133c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa93bb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa409e9e0 con 0x7fdfa41341c0 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa93bb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa409de00 con 0x7fdfa40a4c70 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa93bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40a53e0 con 0x7fdfa40a4360 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa27fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfa40a4c70 0x7fdfa4133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4360 0x7fdfa40a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa27fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfa40a4c70 0x7fdfa4133c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44116/0 (socket says 172.21.15.154:44116) 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4360 0x7fdfa40a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37172/0 (socket says 172.21.15.154:37172) 2023-09-30T22:22:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa27fc700 1 -- 172.21.15.154:0/3083180510 learned_addr learned my addr 172.21.15.154:0/3083180510 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.557+0000 7fdfa37fe700 1 --1- 172.21.15.154:0/3083180510 >> v1:172.21.15.154:6789/0 conn(0x7fdfa41341c0 0x7fdfa413aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50278/0 (socket says 172.21.15.154:50278) 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa2ffd700 1 -- 172.21.15.154:0/3083180510 >> v2:172.21.15.154:3300/0 conn(0x7fdfa40a4c70 msgr2=0x7fdfa4133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa2ffd700 1 --2- 172.21.15.154:0/3083180510 >> v2:172.21.15.154:3300/0 conn(0x7fdfa40a4c70 0x7fdfa4133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa2ffd700 1 -- 172.21.15.154:0/3083180510 >> v1:172.21.15.154:6789/0 conn(0x7fdfa41341c0 legacy=0x7fdfa413aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa2ffd700 1 -- 172.21.15.154:0/3083180510 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa409db20 con 0x7fdfa40a4360 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa1ffb700 1 -- 172.21.15.154:0/3083180510 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260829423 0 0) 0x7fdfa409e9e0 con 0x7fdfa41341c0 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa27fc700 1 --2- 172.21.15.154:0/3083180510 >> v2:172.21.15.154:3300/0 conn(0x7fdfa40a4c70 0x7fdfa4133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa2ffd700 1 --2- 172.21.15.154:0/3083180510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4360 0x7fdfa40a4730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009840 tx=0x7fdf94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bd37dcdc48532ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa1ffb700 1 -- 172.21.15.154:0/3083180510 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94011830 con 0x7fdfa40a4360 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa1ffb700 1 -- 172.21.15.154:0/3083180510 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf94011990 con 0x7fdfa40a4360 2023-09-30T22:22:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa1ffb700 1 -- 172.21.15.154:0/3083180510 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94011d20 con 0x7fdfa40a4360 2023-09-30T22:22:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa93bb700 1 -- 172.21.15.154:0/3083180510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4360 msgr2=0x7fdfa40a4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.558+0000 7fdfa93bb700 1 --2- 172.21.15.154:0/3083180510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4360 0x7fdfa40a4730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009840 tx=0x7fdf94009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.559+0000 7fdfa93bb700 1 -- 172.21.15.154:0/3083180510 shutdown_connections 2023-09-30T22:22:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.559+0000 7fdfa93bb700 1 --2- 172.21.15.154:0/3083180510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4360 0x7fdfa40a4730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.559+0000 7fdfa93bb700 1 --2- 172.21.15.154:0/3083180510 >> v2:172.21.15.154:3300/0 conn(0x7fdfa40a4c70 0x7fdfa4133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.559+0000 7fdfa93bb700 1 -- 172.21.15.154:0/3083180510 >> 172.21.15.154:0/3083180510 conn(0x7fdfa40a2f40 msgr2=0x7fdfa40a3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.559+0000 7fdfa93bb700 1 -- 172.21.15.154:0/3083180510 shutdown_connections 2023-09-30T22:22:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.559+0000 7fdfa93bb700 1 -- 172.21.15.154:0/3083180510 wait complete. 2023-09-30T22:22:18.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.560+0000 7fdfa93bb700 1 Processor -- start 2023-09-30T22:22:18.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.560+0000 7fdfa93bb700 1 -- start start 2023-09-30T22:22:18.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.560+0000 7fdfa93bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdfa40a4360 0x7fdfa41c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.560+0000 7fdfa93bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4c70 0x7fdfa41c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.560+0000 7fdfa93bb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfa41341c0 0x7fdfa4122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:18.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa93bb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4124810 con 0x7fdfa41341c0 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa93bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40a2300 con 0x7fdfa40a4c70 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa93bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4126940 con 0x7fdfa40a4360 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4c70 0x7fdfa41c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfa41341c0 0x7fdfa4122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdfa40a4360 0x7fdfa41c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4c70 0x7fdfa41c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37182/0 (socket says 172.21.15.154:37182) 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa27fc700 1 -- 172.21.15.154:0/497071988 learned_addr learned my addr 172.21.15.154:0/497071988 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa27fc700 1 -- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdfa40a4360 msgr2=0x7fdfa41c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa27fc700 1 --2- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdfa40a4360 0x7fdfa41c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa27fc700 1 -- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfa41341c0 msgr2=0x7fdfa4122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa27fc700 1 --2- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfa41341c0 0x7fdfa4122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa27fc700 1 -- 172.21.15.154:0/497071988 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98009550 con 0x7fdfa40a4c70 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa37fe700 1 --2- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfa41341c0 0x7fdfa4122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa27fc700 1 --2- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4c70 0x7fdfa41c8d20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800ebe0 tx=0x7fdf9800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdf8b7fe700 1 -- 172.21.15.154:0/497071988 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800c850 con 0x7fdfa40a4c70 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdf8b7fe700 1 -- 172.21.15.154:0/497071988 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9800c9b0 con 0x7fdfa40a4c70 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf940094a0 con 0x7fdfa40a4c70 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdf8b7fe700 1 -- 172.21.15.154:0/497071988 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800cd40 con 0x7fdfa40a4c70 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.561+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa4126180 con 0x7fdfa40a4c70 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.562+0000 7fdf8b7fe700 1 -- 172.21.15.154:0/497071988 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdf98013470 con 0x7fdfa40a4c70 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.562+0000 7fdf8b7fe700 1 -- 172.21.15.154:0/497071988 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fdf98040190 con 0x7fdfa40a4c70 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.562+0000 7fdfa2ffd700 1 -- 172.21.15.154:0/497071988 >> v1:172.21.15.154:6816/126757 conn(0x7fdf9002f510 legacy=0x7fdf900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.562+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa409f870 con 0x7fdfa40a4c70 2023-09-30T22:22:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.567+0000 7fdf8b7fe700 1 -- 172.21.15.154:0/497071988 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf9801b3b0 con 0x7fdfa40a4c70 2023-09-30T22:22:18.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.750+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fdfa4068580 con 0x7fdfa40a4c70 2023-09-30T22:22:18.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:18.763+0000 7fdfa2ffd700 1 -- 172.21.15.154:0/497071988 >> v1:172.21.15.154:6816/126757 conn(0x7fdf9002f510 legacy=0x7fdf900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:19.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.164+0000 7fdfa2ffd700 1 -- 172.21.15.154:0/497071988 >> v1:172.21.15.154:6816/126757 conn(0x7fdf9002f510 legacy=0x7fdf900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:19.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.445+0000 7fdf8b7fe700 1 -- 172.21.15.154:0/497071988 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v37) v1 ==== 164+0+0 (secure 0 0 0) 0x7fdf98024350 con 0x7fdfa40a4c70 2023-09-30T22:22:19.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 >> v1:172.21.15.154:6816/126757 conn(0x7fdf9002f510 legacy=0x7fdf900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:19.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4c70 msgr2=0x7fdfa41c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 --2- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4c70 0x7fdfa41c8d20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800ebe0 tx=0x7fdf9800eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 shutdown_connections 2023-09-30T22:22:19.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 --2- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfa41341c0 0x7fdfa4122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 --2- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdfa40a4360 0x7fdfa41c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 --2- 172.21.15.154:0/497071988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfa40a4c70 0x7fdfa41c8d20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 >> 172.21.15.154:0/497071988 conn(0x7fdfa40a2f40 msgr2=0x7fdfa411cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 shutdown_connections 2023-09-30T22:22:19.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.449+0000 7fdfa93bb700 1 -- 172.21.15.154:0/497071988 wait complete. 2023-09-30T22:22:19.450 INFO:teuthology.orchestra.run.smithi154.stderr:set pool 3 pg_autoscale_mode to off 2023-09-30T22:22:19.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.564+0000 7f58c31ce700 1 Processor -- start 2023-09-30T22:22:19.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.564+0000 7f58c31ce700 1 -- start start 2023-09-30T22:22:19.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c31ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc09fc20 0x7f58bc06b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c31ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc06bdc0 0x7f58bc06c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c31ce700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58bc138420 0x7f58bc13a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c31ce700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58bc09fff0 con 0x7f58bc138420 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c31ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc06e2b0 con 0x7f58bc06bdc0 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c31ce700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc06ddf0 con 0x7f58bc09fc20 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c0f6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc09fc20 0x7f58bc06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc06bdc0 0x7f58bc06c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c176b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58bc138420 0x7f58bc13a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c0f6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc09fc20 0x7f58bc06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44996/0 (socket says 172.21.15.154:44996) 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c0f6a700 1 -- 172.21.15.154:0/280104657 learned_addr learned my addr 172.21.15.154:0/280104657 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58bbfff700 1 -- 172.21.15.154:0/280104657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc09fc20 msgr2=0x7f58bc06b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58bbfff700 1 --2- 172.21.15.154:0/280104657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc09fc20 0x7f58bc06b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58bbfff700 1 -- 172.21.15.154:0/280104657 >> v2:172.21.15.154:3300/0 conn(0x7f58bc138420 msgr2=0x7f58bc13a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58bbfff700 1 --2- 172.21.15.154:0/280104657 >> v2:172.21.15.154:3300/0 conn(0x7f58bc138420 0x7f58bc13a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58bbfff700 1 -- 172.21.15.154:0/280104657 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc06cfd0 con 0x7f58bc06bdc0 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c176b700 1 --2- 172.21.15.154:0/280104657 >> v2:172.21.15.154:3300/0 conn(0x7f58bc138420 0x7f58bc13a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58c0f6a700 1 --2- 172.21.15.154:0/280104657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc09fc20 0x7f58bc06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.565+0000 7f58bbfff700 1 --2- 172.21.15.154:0/280104657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc06bdc0 0x7f58bc06c1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009840 tx=0x7f58a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=115f0dd929905f32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58bb7fe700 1 -- 172.21.15.154:0/280104657 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8011830 con 0x7f58bc06bdc0 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58bb7fe700 1 -- 172.21.15.154:0/280104657 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a8011990 con 0x7f58bc06bdc0 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58bb7fe700 1 -- 172.21.15.154:0/280104657 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8011d20 con 0x7f58bc06bdc0 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58c31ce700 1 -- 172.21.15.154:0/280104657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc06bdc0 msgr2=0x7f58bc06c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58c31ce700 1 --2- 172.21.15.154:0/280104657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc06bdc0 0x7f58bc06c1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009840 tx=0x7f58a8009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58c31ce700 1 -- 172.21.15.154:0/280104657 shutdown_connections 2023-09-30T22:22:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58c31ce700 1 --2- 172.21.15.154:0/280104657 >> v2:172.21.15.154:3300/0 conn(0x7f58bc138420 0x7f58bc13a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58c31ce700 1 --2- 172.21.15.154:0/280104657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc09fc20 0x7f58bc06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58c31ce700 1 --2- 172.21.15.154:0/280104657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc06bdc0 0x7f58bc06c1b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58c31ce700 1 -- 172.21.15.154:0/280104657 >> 172.21.15.154:0/280104657 conn(0x7f58bc0a4230 msgr2=0x7f58bc0a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58c31ce700 1 -- 172.21.15.154:0/280104657 shutdown_connections 2023-09-30T22:22:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.566+0000 7f58c31ce700 1 -- 172.21.15.154:0/280104657 wait complete. 2023-09-30T22:22:19.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.567+0000 7f58c31ce700 1 Processor -- start 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.567+0000 7f58c31ce700 1 -- start start 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c31ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc06bdc0 0x7f58bc137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c31ce700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58bc09fc20 0x7f58bc095ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c31ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc138420 0x7f58bc096420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c31ce700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc0970e0 con 0x7f58bc09fc20 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c31ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc09f780 con 0x7f58bc138420 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c31ce700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58bc095300 con 0x7f58bc06bdc0 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c0f6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc06bdc0 0x7f58bc137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58bc09fc20 0x7f58bc095ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c0f6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc06bdc0 0x7f58bc137cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45000/0 (socket says 172.21.15.154:45000) 2023-09-30T22:22:19.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58bbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58bc09fc20 0x7f58bc095ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44158/0 (socket says 172.21.15.154:44158) 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c0f6a700 1 -- 172.21.15.154:0/2079839747 learned_addr learned my addr 172.21.15.154:0/2079839747 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c176b700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc138420 0x7f58bc096420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58bbfff700 1 -- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc06bdc0 msgr2=0x7f58bc137cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58bbfff700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc06bdc0 0x7f58bc137cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58bbfff700 1 -- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc138420 msgr2=0x7f58bc096420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58bbfff700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc138420 0x7f58bc096420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58bbfff700 1 -- 172.21.15.154:0/2079839747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b0009550 con 0x7f58bc09fc20 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c0f6a700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc06bdc0 0x7f58bc137cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58c176b700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc138420 0x7f58bc096420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.568+0000 7f58bbfff700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58bc09fc20 0x7f58bc095ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f58bc070230 tx=0x7f58a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.569+0000 7f58b97fa700 1 -- 172.21.15.154:0/2079839747 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8004450 con 0x7f58bc09fc20 2023-09-30T22:22:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.569+0000 7f58b97fa700 1 -- 172.21.15.154:0/2079839747 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a801f070 con 0x7f58bc09fc20 2023-09-30T22:22:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.569+0000 7f58b97fa700 1 -- 172.21.15.154:0/2079839747 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a80038e0 con 0x7f58bc09fc20 2023-09-30T22:22:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.569+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b4009a70 con 0x7f58bc09fc20 2023-09-30T22:22:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.569+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a80094a0 con 0x7f58bc09fc20 2023-09-30T22:22:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.569+0000 7f58b97fa700 1 -- 172.21.15.154:0/2079839747 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f58a8003a40 con 0x7f58bc09fc20 2023-09-30T22:22:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.569+0000 7f58b97fa700 1 -- 172.21.15.154:0/2079839747 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f58a8021070 con 0x7f58bc09fc20 2023-09-30T22:22:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.569+0000 7f58c0f6a700 1 -- 172.21.15.154:0/2079839747 >> v1:172.21.15.154:6816/126757 conn(0x7f58a002f510 legacy=0x7f58a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.570+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58bc075190 con 0x7f58bc09fc20 2023-09-30T22:22:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.574+0000 7f58b97fa700 1 -- 172.21.15.154:0/2079839747 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58a806c750 con 0x7f58bc09fc20 2023-09-30T22:22:19.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.755+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f58bc094cc0 con 0x7f58bc09fc20 2023-09-30T22:22:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:19.770+0000 7f58c0f6a700 1 -- 172.21.15.154:0/2079839747 >> v1:172.21.15.154:6816/126757 conn(0x7f58a002f510 legacy=0x7f58a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:20.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.171+0000 7f58c0f6a700 1 -- 172.21.15.154:0/2079839747 >> v1:172.21.15.154:6816/126757 conn(0x7f58a002f510 legacy=0x7f58a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:20.237 INFO:tasks.ceph.mgr.x.smithi154.stderr:daemon-helper: command crashed with signal 6 2023-09-30T22:22:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.445+0000 7f58b97fa700 1 -- 172.21.15.154:0/2079839747 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v38) v1 ==== 160+0+0 (secure 0 0 0) 0x7f58bc094cc0 con 0x7f58bc09fc20 2023-09-30T22:22:20.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.451+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 >> v1:172.21.15.154:6816/126757 conn(0x7f58a002f510 legacy=0x7f58a00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:20.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.451+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58bc09fc20 msgr2=0x7f58bc095ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.451+0000 7f58c31ce700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58bc09fc20 0x7f58bc095ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f58bc070230 tx=0x7f58a8004750 comp rx=0 tx=0).stop 2023-09-30T22:22:20.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.451+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 shutdown_connections 2023-09-30T22:22:20.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.451+0000 7f58c31ce700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58bc138420 0x7f58bc096420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.451+0000 7f58c31ce700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58bc06bdc0 0x7f58bc137cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.451+0000 7f58c31ce700 1 --2- 172.21.15.154:0/2079839747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58bc09fc20 0x7f58bc095ee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.451+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 >> 172.21.15.154:0/2079839747 conn(0x7f58bc0a4230 msgr2=0x7f58bc09d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.451+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 shutdown_connections 2023-09-30T22:22:20.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.453+0000 7f58c31ce700 1 -- 172.21.15.154:0/2079839747 wait complete. 2023-09-30T22:22:20.453 INFO:teuthology.orchestra.run.smithi154.stderr:set pool 4 pg_autoscale_mode to off 2023-09-30T22:22:20.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-09-30T22:22:20.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.595+0000 7f843e8e8700 1 Processor -- start 2023-09-30T22:22:20.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.595+0000 7f843e8e8700 1 -- start start 2023-09-30T22:22:20.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843e8e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809e4e0 0x7f8438135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843e8e8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8438135e50 0x7f8438138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843e8e8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843809bca0 con 0x7f843809da00 2023-09-30T22:22:20.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843e8e8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843809b500 con 0x7f8438135e50 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843e8e8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843809c880 con 0x7f843809e4e0 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843ce85700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8438135e50 0x7f8438138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843ce85700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8438135e50 0x7f8438138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44172/0 (socket says 172.21.15.154:44172) 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f84377fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809e4e0 0x7f8438135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843ce85700 1 -- 172.21.15.154:0/4070898743 learned_addr learned my addr 172.21.15.154:0/4070898743 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843ce85700 1 -- 172.21.15.154:0/4070898743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809e4e0 msgr2=0x7f8438135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843ce85700 1 --2- 172.21.15.154:0/4070898743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809e4e0 0x7f8438135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843ce85700 1 -- 172.21.15.154:0/4070898743 >> v1:172.21.15.154:6789/0 conn(0x7f843809da00 legacy=0x7f843809ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843ce85700 1 -- 172.21.15.154:0/4070898743 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843809ac80 con 0x7f8438135e50 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f84377fe700 1 --2- 172.21.15.154:0/4070898743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809e4e0 0x7f8438135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f843ce85700 1 --2- 172.21.15.154:0/4070898743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8438135e50 0x7f8438138230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8430009e50 tx=0x7f843000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f468b3d23a51a03 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f8436ffd700 1 -- 172.21.15.154:0/4070898743 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843000e070 con 0x7f8438135e50 2023-09-30T22:22:20.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f8436ffd700 1 -- 172.21.15.154:0/4070898743 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843000b910 con 0x7f8438135e50 2023-09-30T22:22:20.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.596+0000 7f8436ffd700 1 -- 172.21.15.154:0/4070898743 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843000bcc0 con 0x7f8438135e50 2023-09-30T22:22:20.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.597+0000 7f843e8e8700 1 -- 172.21.15.154:0/4070898743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8438135e50 msgr2=0x7f8438138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.597+0000 7f843e8e8700 1 --2- 172.21.15.154:0/4070898743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8438135e50 0x7f8438138230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8430009e50 tx=0x7f843000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.597+0000 7f843e8e8700 1 -- 172.21.15.154:0/4070898743 shutdown_connections 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.597+0000 7f843e8e8700 1 --2- 172.21.15.154:0/4070898743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8438135e50 0x7f8438138230 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.597+0000 7f843e8e8700 1 --2- 172.21.15.154:0/4070898743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809e4e0 0x7f8438135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.597+0000 7f843e8e8700 1 -- 172.21.15.154:0/4070898743 >> 172.21.15.154:0/4070898743 conn(0x7f8438099e60 msgr2=0x7f84380a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.597+0000 7f843e8e8700 1 -- 172.21.15.154:0/4070898743 shutdown_connections 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.597+0000 7f843e8e8700 1 -- 172.21.15.154:0/4070898743 wait complete. 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f843e8e8700 1 Processor -- start 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f843e8e8700 1 -- start start 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f843e8e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809da00 0x7f843811c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f843e8e8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843809e4e0 0x7f843811c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f843e8e8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8438135e50 0x7f84381c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f843e8e8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843811f3d0 con 0x7f843809e4e0 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f843e8e8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843809cb30 con 0x7f843809da00 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f843e8e8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f843811f5b0 con 0x7f8438135e50 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f8437fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809da00 0x7f843811c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f84377fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843809e4e0 0x7f843811c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.598+0000 7f843ce85700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8438135e50 0x7f84381c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f84377fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843809e4e0 0x7f843811c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44182/0 (socket says 172.21.15.154:44182) 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f8437fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809da00 0x7f843811c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37212/0 (socket says 172.21.15.154:37212) 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f843ce85700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8438135e50 0x7f84381c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45004/0 (socket says 172.21.15.154:45004) 2023-09-30T22:22:20.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f84377fe700 1 -- 172.21.15.154:0/1657465559 learned_addr learned my addr 172.21.15.154:0/1657465559 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:20.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f84377fe700 1 -- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8438135e50 msgr2=0x7f84381c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f84377fe700 1 --2- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8438135e50 0x7f84381c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f84377fe700 1 -- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809da00 msgr2=0x7f843811c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:20.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f84377fe700 1 --2- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809da00 0x7f843811c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:20.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f84377fe700 1 -- 172.21.15.154:0/1657465559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280094a0 con 0x7f843809e4e0 2023-09-30T22:22:20.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f84377fe700 1 --2- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843809e4e0 0x7f843811c9a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f842800ec10 tx=0x7f842800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:20.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f8434ff9700 1 -- 172.21.15.154:0/1657465559 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842800c850 con 0x7f843809e4e0 2023-09-30T22:22:20.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f8434ff9700 1 -- 172.21.15.154:0/1657465559 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842800c9b0 con 0x7f843809e4e0 2023-09-30T22:22:20.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8430009b30 con 0x7f843809e4e0 2023-09-30T22:22:20.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f8434ff9700 1 -- 172.21.15.154:0/1657465559 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842800cd20 con 0x7f843809e4e0 2023-09-30T22:22:20.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.599+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843811cee0 con 0x7f843809e4e0 2023-09-30T22:22:20.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.600+0000 7f8434ff9700 1 -- 172.21.15.154:0/1657465559 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8428013470 con 0x7f843809e4e0 2023-09-30T22:22:20.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.600+0000 7f8434ff9700 1 -- 172.21.15.154:0/1657465559 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f842803fcb0 con 0x7f843809e4e0 2023-09-30T22:22:20.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.600+0000 7f8437fff700 1 -- 172.21.15.154:0/1657465559 >> v1:172.21.15.154:6816/126757 conn(0x7f842402f540 legacy=0x7f84240319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:20.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.600+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8438068580 con 0x7f843809e4e0 2023-09-30T22:22:20.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.605+0000 7f8434ff9700 1 -- 172.21.15.154:0/1657465559 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8428021080 con 0x7f843809e4e0 2023-09-30T22:22:20.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.795+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7f843811f230 con 0x7f843809e4e0 2023-09-30T22:22:20.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:20.801+0000 7f8437fff700 1 -- 172.21.15.154:0/1657465559 >> v1:172.21.15.154:6816/126757 conn(0x7f842402f540 legacy=0x7f84240319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:21.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.202+0000 7f8437fff700 1 -- 172.21.15.154:0/1657465559 >> v1:172.21.15.154:6816/126757 conn(0x7f842402f540 legacy=0x7f84240319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:21.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.461+0000 7f8434ff9700 1 -- 172.21.15.154:0/1657465559 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v39) v1 ==== 90+0+0 (secure 0 0 0) 0x7f843811f230 con 0x7f843809e4e0 2023-09-30T22:22:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 >> v1:172.21.15.154:6816/126757 conn(0x7f842402f540 legacy=0x7f84240319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843809e4e0 msgr2=0x7f843811c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 --2- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843809e4e0 0x7f843811c9a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f842800ec10 tx=0x7f842800ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 shutdown_connections 2023-09-30T22:22:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 --2- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8438135e50 0x7f84381c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 --2- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843809da00 0x7f843811c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 --2- 172.21.15.154:0/1657465559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843809e4e0 0x7f843811c9a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 >> 172.21.15.154:0/1657465559 conn(0x7f8438099e60 msgr2=0x7f8438134ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:21.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 shutdown_connections 2023-09-30T22:22:21.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.465+0000 7f843e8e8700 1 -- 172.21.15.154:0/1657465559 wait complete. 2023-09-30T22:22:21.479 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-09-30T22:22:21.488 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T22:22:21.488 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T22:22:21.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T22:22:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.611+0000 7f4c2e731700 1 Processor -- start 2023-09-30T22:22:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.611+0000 7f4c2e731700 1 -- start start 2023-09-30T22:22:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c2e731700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c2e731700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c2809f180 0x7f4c28131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c2e731700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c28131d70 0x7f4c28132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c2e731700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c280a0920 con 0x7f4c2809f180 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c2e731700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2809c970 con 0x7f4c28131d70 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c2e731700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2809bab0 con 0x7f4c2809e870 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c277fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c2809f180 0x7f4c28131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c27fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c2ccce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c28131d70 0x7f4c28132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c27fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45006/0 (socket says 172.21.15.154:45006) 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c277fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c2809f180 0x7f4c28131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44190/0 (socket says 172.21.15.154:44190) 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c27fff700 1 -- 172.21.15.154:0/845138727 learned_addr learned my addr 172.21.15.154:0/845138727 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c277fe700 1 -- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 msgr2=0x7f4c2809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c277fe700 1 --2- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c277fe700 1 -- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c28131d70 msgr2=0x7f4c28132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c277fe700 1 --2- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c28131d70 0x7f4c28132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c277fe700 1 -- 172.21.15.154:0/845138727 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2809f9c0 con 0x7f4c2809f180 2023-09-30T22:22:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c27fff700 1 --2- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c2ccce700 1 --2- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c28131d70 0x7f4c28132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c277fe700 1 --2- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c2809f180 0x7f4c28131830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009870 tx=0x7f4c18009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631bc6ec5cd3f21f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c26ffd700 1 -- 172.21.15.154:0/845138727 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18011830 con 0x7f4c2809f180 2023-09-30T22:22:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c26ffd700 1 -- 172.21.15.154:0/845138727 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c18011990 con 0x7f4c2809f180 2023-09-30T22:22:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.612+0000 7f4c26ffd700 1 -- 172.21.15.154:0/845138727 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18011d20 con 0x7f4c2809f180 2023-09-30T22:22:21.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.613+0000 7f4c2e731700 1 -- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c2809f180 msgr2=0x7f4c28131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.613+0000 7f4c2e731700 1 --2- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c2809f180 0x7f4c28131830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009870 tx=0x7f4c18009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.613+0000 7f4c2e731700 1 -- 172.21.15.154:0/845138727 shutdown_connections 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.613+0000 7f4c2e731700 1 --2- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c28131d70 0x7f4c28132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.613+0000 7f4c2e731700 1 --2- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.613+0000 7f4c2e731700 1 --2- 172.21.15.154:0/845138727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c2809f180 0x7f4c28131830 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.613+0000 7f4c2e731700 1 -- 172.21.15.154:0/845138727 >> 172.21.15.154:0/845138727 conn(0x7f4c280a4430 msgr2=0x7f4c280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.613+0000 7f4c2e731700 1 -- 172.21.15.154:0/845138727 shutdown_connections 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.613+0000 7f4c2e731700 1 -- 172.21.15.154:0/845138727 wait complete. 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.614+0000 7f4c2e731700 1 Processor -- start 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.614+0000 7f4c2e731700 1 -- start start 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c2e731700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2811d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c2e731700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c2809f180 0x7f4c2811d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c2e731700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28131d70 0x7f4c2811db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:21.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c2e731700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c281208e0 con 0x7f4c28131d70 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c2e731700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280a2c10 con 0x7f4c2809f180 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c2e731700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2811edc0 con 0x7f4c2809e870 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c27fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2811d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c27fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2811d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45008/0 (socket says 172.21.15.154:45008) 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c27fff700 1 -- 172.21.15.154:0/770366610 learned_addr learned my addr 172.21.15.154:0/770366610 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c2ccce700 1 --2- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28131d70 0x7f4c2811db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c277fe700 1 --2- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c2809f180 0x7f4c2811d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c27fff700 1 -- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c2809f180 msgr2=0x7f4c2811d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c27fff700 1 --2- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c2809f180 0x7f4c2811d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c27fff700 1 -- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28131d70 msgr2=0x7f4c2811db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c27fff700 1 --2- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28131d70 0x7f4c2811db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.615+0000 7f4c27fff700 1 -- 172.21.15.154:0/770366610 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c009550 con 0x7f4c2809e870 2023-09-30T22:22:21.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.616+0000 7f4c27fff700 1 --2- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2811d0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009e50 tx=0x7f4c1c00c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:21.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.616+0000 7f4c24ff9700 1 -- 172.21.15.154:0/770366610 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00cc50 con 0x7f4c2809e870 2023-09-30T22:22:21.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.616+0000 7f4c24ff9700 1 -- 172.21.15.154:0/770366610 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c00cdb0 con 0x7f4c2809e870 2023-09-30T22:22:21.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.616+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c20009a70 con 0x7f4c2809e870 2023-09-30T22:22:21.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.616+0000 7f4c24ff9700 1 -- 172.21.15.154:0/770366610 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c004250 con 0x7f4c2809e870 2023-09-30T22:22:21.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.616+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c180094a0 con 0x7f4c2809e870 2023-09-30T22:22:21.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.616+0000 7f4c24ff9700 1 -- 172.21.15.154:0/770366610 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4c1c0043b0 con 0x7f4c2809e870 2023-09-30T22:22:21.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.617+0000 7f4c24ff9700 1 -- 172.21.15.154:0/770366610 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4c1c043760 con 0x7f4c2809e870 2023-09-30T22:22:21.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.617+0000 7f4c277fe700 1 -- 172.21.15.154:0/770366610 >> v1:172.21.15.154:6816/126757 conn(0x7f4c1402f510 legacy=0x7f4c140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:21.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.617+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2804f2a0 con 0x7f4c2809e870 2023-09-30T22:22:21.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.621+0000 7f4c24ff9700 1 -- 172.21.15.154:0/770366610 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c1c0216d0 con 0x7f4c2809e870 2023-09-30T22:22:21.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.818+0000 7f4c277fe700 1 -- 172.21.15.154:0/770366610 >> v1:172.21.15.154:6816/126757 conn(0x7f4c1402f510 legacy=0x7f4c140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:21.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.857+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4c2809f660 con 0x7f4c2809e870 2023-09-30T22:22:21.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.859+0000 7f4c24ff9700 1 -- 172.21.15.154:0/770366610 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) v1 ==== 74+0+70492 (secure 0 0 0) 0x7f4c1c022360 con 0x7f4c2809e870 2023-09-30T22:22:21.859 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 >> v1:172.21.15.154:6816/126757 conn(0x7f4c1402f510 legacy=0x7f4c140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 msgr2=0x7f4c2811d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 --2- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2811d0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009e50 tx=0x7f4c1c00c430 comp rx=0 tx=0).stop 2023-09-30T22:22:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 shutdown_connections 2023-09-30T22:22:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 --2- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c28131d70 0x7f4c2811db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 --2- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c2809e870 0x7f4c2811d0a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 --2- 172.21.15.154:0/770366610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c2809f180 0x7f4c2811d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 >> 172.21.15.154:0/770366610 conn(0x7f4c280a4430 msgr2=0x7f4c2809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 shutdown_connections 2023-09-30T22:22:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.861+0000 7f4c2e731700 1 -- 172.21.15.154:0/770366610 wait complete. 2023-09-30T22:22:21.874 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":10,"active_gid":14189,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6816","nonce":126757}]},"active_addr":"172.21.15.154:6816/126757","active_change":"2023-09-30T22:21:51.933232+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":21,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2273151012}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2771224894}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3517579577}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3939851609}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2961105614}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":722774886}]}]} 2023-09-30T22:22:21.877 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T22:22:21.877 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T22:22:21.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.998+0000 7f6c5c4bf700 1 Processor -- start 2023-09-30T22:22:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.998+0000 7f6c5c4bf700 1 -- start start 2023-09-30T22:22:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5c4bf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5409e870 0x7f6c5409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5c4bf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6c541343a0 0x7f6c5413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5c4bf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5406bec0 con 0x7f6c5409f180 2023-09-30T22:22:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5c4bf700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5406ce60 con 0x7f6c541343a0 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5c4bf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5409fa00 con 0x7f6c5409e870 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5a25b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5409e870 0x7f6c5409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5aa5c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6c541343a0 0x7f6c5413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5a25b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5409e870 0x7f6c5409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45010/0 (socket says 172.21.15.154:45010) 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5a25b700 1 -- 172.21.15.154:0/1351301726 learned_addr learned my addr 172.21.15.154:0/1351301726 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5a25b700 1 -- 172.21.15.154:0/1351301726 >> v2:172.21.15.154:3300/0 conn(0x7f6c541343a0 msgr2=0x7f6c5413bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5a25b700 1 --2- 172.21.15.154:0/1351301726 >> v2:172.21.15.154:3300/0 conn(0x7f6c541343a0 0x7f6c5413bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5a25b700 1 -- 172.21.15.154:0/1351301726 >> v1:172.21.15.154:6789/0 conn(0x7f6c5409f180 legacy=0x7f6c54133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5a25b700 1 -- 172.21.15.154:0/1351301726 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5409ad80 con 0x7f6c5409e870 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5aa5c700 1 --2- 172.21.15.154:0/1351301726 >> v2:172.21.15.154:3300/0 conn(0x7f6c541343a0 0x7f6c5413bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:21.999+0000 7f6c5a25b700 1 --2- 172.21.15.154:0/1351301726 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5409e870 0x7f6c5409ec40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c440098f0 tx=0x7f6c44009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e04c8582024189 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c59259700 1 -- 172.21.15.154:0/1351301726 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44011830 con 0x7f6c5409e870 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c59259700 1 -- 172.21.15.154:0/1351301726 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c44011990 con 0x7f6c5409e870 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c59259700 1 -- 172.21.15.154:0/1351301726 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44011d20 con 0x7f6c5409e870 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/1351301726 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5409e870 msgr2=0x7f6c5409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c5c4bf700 1 --2- 172.21.15.154:0/1351301726 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5409e870 0x7f6c5409ec40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c440098f0 tx=0x7f6c44009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/1351301726 shutdown_connections 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c5c4bf700 1 --2- 172.21.15.154:0/1351301726 >> v2:172.21.15.154:3300/0 conn(0x7f6c541343a0 0x7f6c5413bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c5c4bf700 1 --2- 172.21.15.154:0/1351301726 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5409e870 0x7f6c5409ec40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/1351301726 >> 172.21.15.154:0/1351301726 conn(0x7f6c540a4430 msgr2=0x7f6c540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/1351301726 shutdown_connections 2023-09-30T22:22:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.000+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/1351301726 wait complete. 2023-09-30T22:22:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.001+0000 7f6c5c4bf700 1 Processor -- start 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.001+0000 7f6c5c4bf700 1 -- start start 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.001+0000 7f6c5c4bf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5409e870 0x7f6c5411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.001+0000 7f6c5c4bf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5409f180 0x7f6c5411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.001+0000 7f6c5c4bf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c541343a0 0x7f6c5411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.001+0000 7f6c5c4bf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54122190 con 0x7f6c5409e870 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.001+0000 7f6c5c4bf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54120b10 con 0x7f6c5409f180 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.001+0000 7f6c5c4bf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5406fca0 con 0x7f6c541343a0 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5a25b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5409e870 0x7f6c5411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5a25b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5409e870 0x7f6c5411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44226/0 (socket says 172.21.15.154:44226) 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5a25b700 1 -- 172.21.15.154:0/3796100959 learned_addr learned my addr 172.21.15.154:0/3796100959 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5aa5c700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c541343a0 0x7f6c5411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c59a5a700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5409f180 0x7f6c5411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5a25b700 1 -- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c541343a0 msgr2=0x7f6c5411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5a25b700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c541343a0 0x7f6c5411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5a25b700 1 -- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5409f180 msgr2=0x7f6c5411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5a25b700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5409f180 0x7f6c5411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5a25b700 1 -- 172.21.15.154:0/3796100959 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009a70 con 0x7f6c5409e870 2023-09-30T22:22:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c59a5a700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5409f180 0x7f6c5411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5aa5c700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c541343a0 0x7f6c5411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5a25b700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5409e870 0x7f6c5411ead0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009c40 tx=0x7f6c44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c4affd700 1 -- 172.21.15.154:0/3796100959 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440045d0 con 0x7f6c5409e870 2023-09-30T22:22:22.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c4affd700 1 -- 172.21.15.154:0/3796100959 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440036a0 con 0x7f6c5409e870 2023-09-30T22:22:22.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c44009550 con 0x7f6c5409e870 2023-09-30T22:22:22.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c4affd700 1 -- 172.21.15.154:0/3796100959 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44003a30 con 0x7f6c5409e870 2023-09-30T22:22:22.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.002+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c54122c00 con 0x7f6c5409e870 2023-09-30T22:22:22.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.003+0000 7f6c4affd700 1 -- 172.21.15.154:0/3796100959 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6c44021070 con 0x7f6c5409e870 2023-09-30T22:22:22.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.003+0000 7f6c4affd700 1 -- 172.21.15.154:0/3796100959 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6c44040fe0 con 0x7f6c5409e870 2023-09-30T22:22:22.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.003+0000 7f6c59a5a700 1 -- 172.21.15.154:0/3796100959 >> v1:172.21.15.154:6816/126757 conn(0x7f6c3802f510 legacy=0x7f6c380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.003+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5404f2a0 con 0x7f6c5409e870 2023-09-30T22:22:22.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.008+0000 7f6c4affd700 1 -- 172.21.15.154:0/3796100959 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c44029070 con 0x7f6c5409e870 2023-09-30T22:22:22.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.194+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c54072d20 con 0x7f6c5409e870 2023-09-30T22:22:22.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.195+0000 7f6c4affd700 1 -- 172.21.15.154:0/3796100959 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12999 (secure 0 0 0) 0x7f6c44015030 con 0x7f6c5409e870 2023-09-30T22:22:22.195 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:22.195 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":39,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:22:21.452052+0000","last_up_change":"2023-09-30T22:22:11.411450+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":130130}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":130130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":130130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":130130}]},"public_addr":"172.21.15.154:6800/130130","cluster_addr":"172.21.15.154:6801/130130","heartbeat_back_addr":"172.21.15.154:6803/130130","heartbeat_front_addr":"172.21.15.154:6802/130130","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":130229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":130229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":130229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":130229}]},"public_addr":"172.21.15.154:6804/130229","cluster_addr":"172.21.15.154:6805/130229","heartbeat_back_addr":"172.21.15.154:6807/130229","heartbeat_front_addr":"172.21.15.154:6806/130229","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":130339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":130339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":130339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":130339}]},"public_addr":"172.21.15.154:6808/130339","cluster_addr":"172.21.15.154:6809/130339","heartbeat_back_addr":"172.21.15.154:6811/130339","heartbeat_front_addr":"172.21.15.154:6810/130339","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":130679}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":130679}]},"public_addr":"172.21.15.154:6812/130679","cluster_addr":"172.21.15.154:6813/130679","heartbeat_back_addr":"172.21.15.154:6815/130679","heartbeat_front_addr":"172.21.15.154:6814/130679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-09-30T22:22:04.989624+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6817/2576993373":"2023-10-01T22:22:14.893865+0000","172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 >> v1:172.21.15.154:6816/126757 conn(0x7f6c3802f510 legacy=0x7f6c380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5409e870 msgr2=0x7f6c5411ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5409e870 0x7f6c5411ead0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009c40 tx=0x7f6c44004750 comp rx=0 tx=0).stop 2023-09-30T22:22:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 shutdown_connections 2023-09-30T22:22:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c541343a0 0x7f6c5411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5409e870 0x7f6c5411ead0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 --2- 172.21.15.154:0/3796100959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5409f180 0x7f6c5411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 >> 172.21.15.154:0/3796100959 conn(0x7f6c540a4430 msgr2=0x7f6c54071040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 shutdown_connections 2023-09-30T22:22:22.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.197+0000 7f6c5c4bf700 1 -- 172.21.15.154:0/3796100959 wait complete. 2023-09-30T22:22:22.209 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T22:22:22.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:22:22.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.330+0000 7f0c1daeb700 1 Processor -- start 2023-09-30T22:22:22.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.330+0000 7f0c1daeb700 1 -- start start 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c1daeb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c18133ad0 0x7f0c18133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c1daeb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181300a0 0x7f0c181304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c1daeb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1806b2d0 con 0x7f0c181309f0 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c1daeb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c18133610 con 0x7f0c18133ad0 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c1daeb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1809a500 con 0x7f0c181300a0 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c177fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c18133ad0 0x7f0c18133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c16ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181300a0 0x7f0c181304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c177fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c18133ad0 0x7f0c18133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37246/0 (socket says 172.21.15.154:37246) 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c177fe700 1 -- 172.21.15.154:0/1069965266 learned_addr learned my addr 172.21.15.154:0/1069965266 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c17fff700 1 --1- 172.21.15.154:0/1069965266 >> v1:172.21.15.154:6789/0 conn(0x7f0c181309f0 0x7f0c1813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50298/0 (socket says 172.21.15.154:50298) 2023-09-30T22:22:22.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c16ffd700 1 -- 172.21.15.154:0/1069965266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c18133ad0 msgr2=0x7f0c18133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c16ffd700 1 --2- 172.21.15.154:0/1069965266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c18133ad0 0x7f0c18133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c16ffd700 1 -- 172.21.15.154:0/1069965266 >> v1:172.21.15.154:6789/0 conn(0x7f0c181309f0 legacy=0x7f0c1813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c167fc700 1 -- 172.21.15.154:0/1069965266 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195084672 0 0) 0x7f0c1806b2d0 con 0x7f0c181309f0 2023-09-30T22:22:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c16ffd700 1 -- 172.21.15.154:0/1069965266 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c181338b0 con 0x7f0c181300a0 2023-09-30T22:22:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.331+0000 7f0c177fe700 1 --2- 172.21.15.154:0/1069965266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c18133ad0 0x7f0c18133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c16ffd700 1 --2- 172.21.15.154:0/1069965266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181300a0 0x7f0c181304b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009870 tx=0x7f0c0c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b1b1513519d8001 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c167fc700 1 -- 172.21.15.154:0/1069965266 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011830 con 0x7f0c181300a0 2023-09-30T22:22:22.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c167fc700 1 -- 172.21.15.154:0/1069965266 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c011990 con 0x7f0c181300a0 2023-09-30T22:22:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c167fc700 1 -- 172.21.15.154:0/1069965266 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011d20 con 0x7f0c181300a0 2023-09-30T22:22:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c1daeb700 1 -- 172.21.15.154:0/1069965266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181300a0 msgr2=0x7f0c181304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c1daeb700 1 --2- 172.21.15.154:0/1069965266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181300a0 0x7f0c181304b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009870 tx=0x7f0c0c009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c1daeb700 1 -- 172.21.15.154:0/1069965266 shutdown_connections 2023-09-30T22:22:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c1daeb700 1 --2- 172.21.15.154:0/1069965266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c18133ad0 0x7f0c18133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c1daeb700 1 --2- 172.21.15.154:0/1069965266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181300a0 0x7f0c181304b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c1daeb700 1 -- 172.21.15.154:0/1069965266 >> 172.21.15.154:0/1069965266 conn(0x7f0c18099c40 msgr2=0x7f0c180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c1daeb700 1 -- 172.21.15.154:0/1069965266 shutdown_connections 2023-09-30T22:22:22.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.332+0000 7f0c1daeb700 1 -- 172.21.15.154:0/1069965266 wait complete. 2023-09-30T22:22:22.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.333+0000 7f0c1daeb700 1 Processor -- start 2023-09-30T22:22:22.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.333+0000 7f0c1daeb700 1 -- start start 2023-09-30T22:22:22.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c1daeb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c181300a0 0x7f0c1811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c1daeb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181309f0 0x7f0c1811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c1daeb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c18133ad0 0x7f0c1811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c1daeb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c18120950 con 0x7f0c18133ad0 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c1daeb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1812d930 con 0x7f0c181300a0 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c1daeb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1811fd00 con 0x7f0c181309f0 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c177fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c181300a0 0x7f0c1811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c16ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181309f0 0x7f0c1811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c177fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c181300a0 0x7f0c1811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37256/0 (socket says 172.21.15.154:37256) 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c177fe700 1 -- 172.21.15.154:0/4241172664 learned_addr learned my addr 172.21.15.154:0/4241172664 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c17fff700 1 --2- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c18133ad0 0x7f0c1811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c16ffd700 1 -- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c181300a0 msgr2=0x7f0c1811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c16ffd700 1 --2- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c181300a0 0x7f0c1811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c16ffd700 1 -- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c18133ad0 msgr2=0x7f0c1811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c16ffd700 1 --2- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c18133ad0 0x7f0c1811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c16ffd700 1 -- 172.21.15.154:0/4241172664 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c08009550 con 0x7f0c181309f0 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c177fe700 1 --2- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c181300a0 0x7f0c1811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0c16ffd700 1 --2- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181309f0 0x7f0c1811df80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c016000 tx=0x7f0c0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.334+0000 7f0bfffff700 1 -- 172.21.15.154:0/4241172664 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c004510 con 0x7f0c181309f0 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.335+0000 7f0bfffff700 1 -- 172.21.15.154:0/4241172664 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c01e070 con 0x7f0c181309f0 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.335+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c0094a0 con 0x7f0c181309f0 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.335+0000 7f0bfffff700 1 -- 172.21.15.154:0/4241172664 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0038c0 con 0x7f0c181309f0 2023-09-30T22:22:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.335+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c180a3400 con 0x7f0c181309f0 2023-09-30T22:22:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.335+0000 7f0bfffff700 1 -- 172.21.15.154:0/4241172664 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0c0c003a20 con 0x7f0c181309f0 2023-09-30T22:22:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.335+0000 7f0bfffff700 1 -- 172.21.15.154:0/4241172664 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0c0c020070 con 0x7f0c181309f0 2023-09-30T22:22:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.335+0000 7f0c177fe700 1 -- 172.21.15.154:0/4241172664 >> v1:172.21.15.154:6816/126757 conn(0x7f0c0402f510 legacy=0x7f0c040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.335+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c1812dd00 con 0x7f0c181309f0 2023-09-30T22:22:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.342+0000 7f0bfffff700 1 -- 172.21.15.154:0/4241172664 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c0c02a080 con 0x7f0c181309f0 2023-09-30T22:22:22.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.526+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c1804f2a0 con 0x7f0c181309f0 2023-09-30T22:22:22.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.527+0000 7f0bfffff700 1 -- 172.21.15.154:0/4241172664 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12999 (secure 0 0 0) 0x7f0c0c015030 con 0x7f0c181309f0 2023-09-30T22:22:22.527 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:22:22.527 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":39,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:22:21.452052+0000","last_up_change":"2023-09-30T22:22:11.411450+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":130130}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":130130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":130130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":130130}]},"public_addr":"172.21.15.154:6800/130130","cluster_addr":"172.21.15.154:6801/130130","heartbeat_back_addr":"172.21.15.154:6803/130130","heartbeat_front_addr":"172.21.15.154:6802/130130","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":130229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":130229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":130229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":130229}]},"public_addr":"172.21.15.154:6804/130229","cluster_addr":"172.21.15.154:6805/130229","heartbeat_back_addr":"172.21.15.154:6807/130229","heartbeat_front_addr":"172.21.15.154:6806/130229","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":130339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":130339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":130339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":130339}]},"public_addr":"172.21.15.154:6808/130339","cluster_addr":"172.21.15.154:6809/130339","heartbeat_back_addr":"172.21.15.154:6811/130339","heartbeat_front_addr":"172.21.15.154:6810/130339","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":130679}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":130679}]},"public_addr":"172.21.15.154:6812/130679","cluster_addr":"172.21.15.154:6813/130679","heartbeat_back_addr":"172.21.15.154:6815/130679","heartbeat_front_addr":"172.21.15.154:6814/130679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-09-30T22:22:04.989624+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6817/2576993373":"2023-10-01T22:22:14.893865+0000","172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:22:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 >> v1:172.21.15.154:6816/126757 conn(0x7f0c0402f510 legacy=0x7f0c040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181309f0 msgr2=0x7f0c1811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 --2- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181309f0 0x7f0c1811df80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c016000 tx=0x7f0c0c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 shutdown_connections 2023-09-30T22:22:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 --2- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c18133ad0 0x7f0c1811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 --2- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c181300a0 0x7f0c1811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 --2- 172.21.15.154:0/4241172664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0c181309f0 0x7f0c1811df80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 >> 172.21.15.154:0/4241172664 conn(0x7f0c18099c40 msgr2=0x7f0c1812e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 shutdown_connections 2023-09-30T22:22:22.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.529+0000 7f0c1daeb700 1 -- 172.21.15.154:0/4241172664 wait complete. 2023-09-30T22:22:22.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T22:22:22.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T22:22:22.543 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T22:22:22.543 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T22:22:22.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.675+0000 7f69acf1a700 1 Processor -- start 2023-09-30T22:22:22.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.675+0000 7f69acf1a700 1 -- start start 2023-09-30T22:22:22.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.675+0000 7f69acf1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a809e870 0x7f69a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.675+0000 7f69acf1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a8131f40 0x7f69a8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.675+0000 7f69acf1a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a809c970 con 0x7f69a809f180 2023-09-30T22:22:22.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.675+0000 7f69acf1a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a80a0920 con 0x7f69a809e870 2023-09-30T22:22:22.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.675+0000 7f69acf1a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69a809f9c0 con 0x7f69a8131f40 2023-09-30T22:22:22.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f0fcbfb1700 1 Processor -- start 2023-09-30T22:22:22.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f69a6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a8131f40 0x7f69a8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f69a6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a8131f40 0x7f69a8139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45040/0 (socket says 172.21.15.154:45040) 2023-09-30T22:22:22.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f69a6d9d700 1 -- 172.21.15.154:0/3613336880 learned_addr learned my addr 172.21.15.154:0/3613336880 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f69a659c700 1 --2- 172.21.15.154:0/3613336880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a809e870 0x7f69a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f0fcbfb1700 1 -- start start 2023-09-30T22:22:22.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f69a6d9d700 1 -- 172.21.15.154:0/3613336880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a809e870 msgr2=0x7f69a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f69a6d9d700 1 --2- 172.21.15.154:0/3613336880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a809e870 0x7f69a809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f69a6d9d700 1 -- 172.21.15.154:0/3613336880 >> v1:172.21.15.154:6789/0 conn(0x7f69a809f180 legacy=0x7f69a8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f69a6d9d700 1 -- 172.21.15.154:0/3613336880 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a809bab0 con 0x7f69a8131f40 2023-09-30T22:22:22.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.676+0000 7f69a6d9d700 1 --2- 172.21.15.154:0/3613336880 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a8131f40 0x7f69a8139ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009e80 tx=0x7f69a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3a878e204914c64 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fcbfb1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fc406a770 0x7f0fc406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fcbfb1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0fc4131ec0 0x7f0fc4139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fcbfb1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc409da80 con 0x7f0fc406b080 2023-09-30T22:22:22.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fcbfb1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc409dce0 con 0x7f0fc4131ec0 2023-09-30T22:22:22.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fcbfb1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc409eb20 con 0x7f0fc406a770 2023-09-30T22:22:22.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fc954c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0fc406b080 0x7f0fc41317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50330/0 (socket says 172.21.15.154:50330) 2023-09-30T22:22:22.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fc954c700 1 -- 172.21.15.154:0/3549769622 learned_addr learned my addr 172.21.15.154:0/3549769622 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:22.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fca54e700 1 --2- 172.21.15.154:0/3549769622 >> v2:172.21.15.154:3300/0 conn(0x7f0fc4131ec0 0x7f0fc4139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f69a559a700 1 -- 172.21.15.154:0/3613336880 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a000e070 con 0x7f69a8131f40 2023-09-30T22:22:22.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f69a559a700 1 -- 172.21.15.154:0/3613336880 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a0003a20 con 0x7f69a8131f40 2023-09-30T22:22:22.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f69a559a700 1 -- 172.21.15.154:0/3613336880 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0003dd0 con 0x7f69a8131f40 2023-09-30T22:22:22.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fca54e700 1 -- 172.21.15.154:0/3549769622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fc406a770 msgr2=0x7f0fc406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fca54e700 1 --2- 172.21.15.154:0/3549769622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fc406a770 0x7f0fc406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fca54e700 1 -- 172.21.15.154:0/3549769622 >> v1:172.21.15.154:6789/0 conn(0x7f0fc406b080 legacy=0x7f0fc41317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fca54e700 1 -- 172.21.15.154:0/3549769622 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc409d860 con 0x7f0fc4131ec0 2023-09-30T22:22:22.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fca54e700 1 --2- 172.21.15.154:0/3549769622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fc4131ec0 0x7f0fc4139c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009840 tx=0x7f0fb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4483ad3eafb85c71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f69acf1a700 1 -- 172.21.15.154:0/3613336880 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a8131f40 msgr2=0x7f69a8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f69acf1a700 1 --2- 172.21.15.154:0/3613336880 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a8131f40 0x7f69a8139ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009e80 tx=0x7f69a000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:22.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.677+0000 7f0fc8d4b700 1 -- 172.21.15.154:0/3549769622 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4011830 con 0x7f0fc4131ec0 2023-09-30T22:22:22.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f0fc8d4b700 1 -- 172.21.15.154:0/3549769622 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb4011990 con 0x7f0fc4131ec0 2023-09-30T22:22:22.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f0fc8d4b700 1 -- 172.21.15.154:0/3549769622 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4011d20 con 0x7f0fc4131ec0 2023-09-30T22:22:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f69acf1a700 1 -- 172.21.15.154:0/3613336880 shutdown_connections 2023-09-30T22:22:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f69acf1a700 1 --2- 172.21.15.154:0/3613336880 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a8131f40 0x7f69a8139ca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f69acf1a700 1 --2- 172.21.15.154:0/3613336880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a809e870 0x7f69a809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f69acf1a700 1 -- 172.21.15.154:0/3613336880 >> 172.21.15.154:0/3613336880 conn(0x7f69a80a4430 msgr2=0x7f69a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/3549769622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fc4131ec0 msgr2=0x7f0fc4139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f0fcbfb1700 1 --2- 172.21.15.154:0/3549769622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fc4131ec0 0x7f0fc4139c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009840 tx=0x7f0fb4009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:22.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f69acf1a700 1 -- 172.21.15.154:0/3613336880 shutdown_connections 2023-09-30T22:22:22.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f69acf1a700 1 -- 172.21.15.154:0/3613336880 wait complete. 2023-09-30T22:22:22.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/3549769622 shutdown_connections 2023-09-30T22:22:22.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f0fcbfb1700 1 --2- 172.21.15.154:0/3549769622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fc4131ec0 0x7f0fc4139c20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f0fcbfb1700 1 --2- 172.21.15.154:0/3549769622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fc406a770 0x7f0fc406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.678+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/3549769622 >> 172.21.15.154:0/3549769622 conn(0x7f0fc4099c40 msgr2=0x7f0fc40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.679+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/3549769622 shutdown_connections 2023-09-30T22:22:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.679+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/3549769622 wait complete. 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.679+0000 7f69acf1a700 1 Processor -- start 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69acf1a700 1 -- start start 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69acf1a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a809e870 0x7f69a811bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69acf1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a809f180 0x7f69a811c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69acf1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a8131f40 0x7f69a811c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69acf1a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a811fa50 con 0x7f69a809e870 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69acf1a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a811e160 con 0x7f69a8131f40 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69acf1a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69a811ee20 con 0x7f69a809f180 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69a5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a809f180 0x7f69a811c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69a5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a809f180 0x7f69a811c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45062/0 (socket says 172.21.15.154:45062) 2023-09-30T22:22:22.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69a5d9b700 1 -- 172.21.15.154:0/1715420878 learned_addr learned my addr 172.21.15.154:0/1715420878 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69a6d9d700 1 --2- 172.21.15.154:0/1715420878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a8131f40 0x7f69a811c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f0fcbfb1700 1 Processor -- start 2023-09-30T22:22:22.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.680+0000 7f69a659c700 1 --2- 172.21.15.154:0/1715420878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a809e870 0x7f69a811bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f69a5d9b700 1 -- 172.21.15.154:0/1715420878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a8131f40 msgr2=0x7f69a811c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f69a5d9b700 1 --2- 172.21.15.154:0/1715420878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a8131f40 0x7f69a811c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f69a5d9b700 1 -- 172.21.15.154:0/1715420878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a809e870 msgr2=0x7f69a811bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f69a5d9b700 1 --2- 172.21.15.154:0/1715420878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a809e870 0x7f69a811bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f69a5d9b700 1 -- 172.21.15.154:0/1715420878 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a0009b30 con 0x7f69a809f180 2023-09-30T22:22:22.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f69a5d9b700 1 --2- 172.21.15.154:0/1715420878 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a809f180 0x7f69a811c470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f699c00c4a0 tx=0x7f699c00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fcbfb1700 1 -- start start 2023-09-30T22:22:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fcbfb1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fc406a770 0x7f0fc411bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fcbfb1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fc406b080 0x7f0fc411c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fcbfb1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fc4131ec0 0x7f0fc411c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fcbfb1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc411f3f0 con 0x7f0fc4131ec0 2023-09-30T22:22:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fcbfb1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40a1080 con 0x7f0fc406a770 2023-09-30T22:22:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fcbfb1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc411ed40 con 0x7f0fc406b080 2023-09-30T22:22:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fc9d4d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fc406a770 0x7f0fc411bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fc9d4d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fc406a770 0x7f0fc411bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37294/0 (socket says 172.21.15.154:37294) 2023-09-30T22:22:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fc9d4d700 1 -- 172.21.15.154:0/1321500192 learned_addr learned my addr 172.21.15.154:0/1321500192 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fc954c700 1 --2- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fc406b080 0x7f0fc411c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f6996ffd700 1 -- 172.21.15.154:0/1715420878 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c0054e0 con 0x7f69a809f180 2023-09-30T22:22:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f6996ffd700 1 -- 172.21.15.154:0/1715420878 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c003680 con 0x7f69a809f180 2023-09-30T22:22:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f6996ffd700 1 -- 172.21.15.154:0/1715420878 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c003a10 con 0x7f69a809f180 2023-09-30T22:22:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.681+0000 7f0fca54e700 1 --2- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fc4131ec0 0x7f0fc411c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fc9d4d700 1 -- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fc406b080 msgr2=0x7f0fc411c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fc9d4d700 1 --2- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fc406b080 0x7f0fc411c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fc9d4d700 1 -- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fc4131ec0 msgr2=0x7f0fc411c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fc9d4d700 1 --2- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fc4131ec0 0x7f0fc411c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fc9d4d700 1 -- 172.21.15.154:0/1321500192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40094a0 con 0x7f0fc406a770 2023-09-30T22:22:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fc954c700 1 --2- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fc406b080 0x7f0fc411c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a80a2db0 con 0x7f69a809f180 2023-09-30T22:22:22.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a811f240 con 0x7f69a809f180 2023-09-30T22:22:22.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fc9d4d700 1 --2- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fc406a770 0x7f0fc411bf50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00ba50 tx=0x7f0fbc00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.683+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69a809b680 con 0x7f69a809f180 2023-09-30T22:22:22.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.683+0000 7f6996ffd700 1 -- 172.21.15.154:0/1715420878 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f699c003b70 con 0x7f69a809f180 2023-09-30T22:22:22.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fba7fc700 1 -- 172.21.15.154:0/1321500192 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc00c9b0 con 0x7f0fc406a770 2023-09-30T22:22:22.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fba7fc700 1 -- 172.21.15.154:0/1321500192 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc00cb30 con 0x7f0fc406a770 2023-09-30T22:22:22.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fba7fc700 1 -- 172.21.15.154:0/1321500192 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc014440 con 0x7f0fc406a770 2023-09-30T22:22:22.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc4071e10 con 0x7f0fc406a770 2023-09-30T22:22:22.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.682+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc411f990 con 0x7f0fc406a770 2023-09-30T22:22:22.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.683+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fc409c8e0 con 0x7f0fc406a770 2023-09-30T22:22:22.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.683+0000 7f6996ffd700 1 -- 172.21.15.154:0/1715420878 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f699c03eac0 con 0x7f69a809f180 2023-09-30T22:22:22.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.683+0000 7f69a659c700 1 -- 172.21.15.154:0/1715420878 >> v1:172.21.15.154:6816/126757 conn(0x7f698802f510 legacy=0x7f69880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.683+0000 7f6996ffd700 1 -- 172.21.15.154:0/1715420878 --> v1:172.21.15.154:6812/130679 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f698803c2e0 con 0x7f69880385e0 2023-09-30T22:22:22.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.683+0000 7f6996ffd700 1 -- 172.21.15.154:0/1715420878 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f699c0432c0 con 0x7f69a809f180 2023-09-30T22:22:22.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.685+0000 7f6996ffd700 1 -- 172.21.15.154:0/1715420878 <== osd.3 v1:172.21.15.154:6812/130679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f698803c2e0 con 0x7f69880385e0 2023-09-30T22:22:22.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.684+0000 7f0fba7fc700 1 -- 172.21.15.154:0/1321500192 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0fbc007370 con 0x7f0fc406a770 2023-09-30T22:22:22.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.685+0000 7f0fba7fc700 1 -- 172.21.15.154:0/1321500192 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0fbc006e40 con 0x7f0fc406a770 2023-09-30T22:22:22.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.685+0000 7f0fba7fc700 1 -- 172.21.15.154:0/1321500192 --> v1:172.21.15.154:6804/130229 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fa803c360 con 0x7f0fa8038660 2023-09-30T22:22:22.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.685+0000 7f0fba7fc700 1 -- 172.21.15.154:0/1321500192 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fbc040300 con 0x7f0fc406a770 2023-09-30T22:22:22.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.685+0000 7f0fc954c700 1 -- 172.21.15.154:0/1321500192 >> v1:172.21.15.154:6816/126757 conn(0x7f0fa802f510 legacy=0x7f0fa80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.686+0000 7fc3341a1700 1 Processor -- start 2023-09-30T22:22:22.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.686+0000 7fc3341a1700 1 -- start start 2023-09-30T22:22:22.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.686+0000 7f0fba7fc700 1 -- 172.21.15.154:0/1321500192 <== osd.1 v1:172.21.15.154:6804/130229 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f0fa803c360 con 0x7f0fa8038660 2023-09-30T22:22:22.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.686+0000 7ffaa8ec2700 1 Processor -- start 2023-09-30T22:22:22.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa8ec2700 1 -- start start 2023-09-30T22:22:22.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.686+0000 7fc3341a1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc32c09d860 0x7fc32c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.686+0000 7fc3341a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09e170 0x7fc32c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7fc3341a1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32c09aaa0 con 0x7fc32c130ce0 2023-09-30T22:22:22.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7fc3341a1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32c09f870 con 0x7fc32c09d860 2023-09-30T22:22:22.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7fc3341a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c09b360 con 0x7fc32c09e170 2023-09-30T22:22:22.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa8ec2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa409da10 0x7ffaa4136760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa8ec2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaa4136ca0 0x7ffaa4139080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa8ec2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa409e780 con 0x7ffaa412e490 2023-09-30T22:22:22.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa8ec2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa409f6e0 con 0x7ffaa409da10 2023-09-30T22:22:22.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa8ec2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa409eb00 con 0x7ffaa4136ca0 2023-09-30T22:22:22.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa409da10 0x7ffaa4136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa409da10 0x7ffaa4136760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37316/0 (socket says 172.21.15.154:37316) 2023-09-30T22:22:22.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa1d9b700 1 -- 172.21.15.154:0/370076249 learned_addr learned my addr 172.21.15.154:0/370076249 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.687+0000 7ffaa2d9d700 1 --2- 172.21.15.154:0/370076249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaa4136ca0 0x7ffaa4139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7ffaa1d9b700 1 -- 172.21.15.154:0/370076249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaa4136ca0 msgr2=0x7ffaa4139080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7ffaa1d9b700 1 --2- 172.21.15.154:0/370076249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaa4136ca0 0x7ffaa4139080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7ffaa1d9b700 1 -- 172.21.15.154:0/370076249 >> v1:172.21.15.154:6789/0 conn(0x7ffaa412e490 legacy=0x7ffaa412e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7ffaa1d9b700 1 -- 172.21.15.154:0/370076249 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa412e040 con 0x7ffaa409da10 2023-09-30T22:22:22.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7ffaa1d9b700 1 --2- 172.21.15.154:0/370076249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa409da10 0x7ffaa4136760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009950 tx=0x7ffa98009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec1de7bf0e3f7e8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7fc331f3d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc32c09d860 0x7fc32c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7fc331f3d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc32c09d860 0x7fc32c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44286/0 (socket says 172.21.15.154:44286) 2023-09-30T22:22:22.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7fc331f3d700 1 -- 172.21.15.154:0/3638135506 learned_addr learned my addr 172.21.15.154:0/3638135506 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7ffaa159a700 1 -- 172.21.15.154:0/370076249 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98004230 con 0x7ffaa409da10 2023-09-30T22:22:22.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7ffaa159a700 1 -- 172.21.15.154:0/370076249 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98004390 con 0x7ffaa409da10 2023-09-30T22:22:22.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7ffaa159a700 1 -- 172.21.15.154:0/370076249 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa980036a0 con 0x7ffaa409da10 2023-09-30T22:22:22.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7fc331f3d700 1 -- 172.21.15.154:0/3638135506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09e170 msgr2=0x7fc32c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7fc331f3d700 1 --2- 172.21.15.154:0/3638135506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09e170 0x7fc32c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7fc331f3d700 1 -- 172.21.15.154:0/3638135506 >> v1:172.21.15.154:6789/0 conn(0x7fc32c130ce0 legacy=0x7fc32c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.688+0000 7fc331f3d700 1 -- 172.21.15.154:0/3638135506 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c1339d0 con 0x7fc32c09d860 2023-09-30T22:22:22.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7fc331f3d700 1 --2- 172.21.15.154:0/3638135506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc32c09d860 0x7fc32c09dc30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc328009920 tx=0x7fc328009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3a58352204b7e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7fc330f3b700 1 -- 172.21.15.154:0/3638135506 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328004230 con 0x7fc32c09d860 2023-09-30T22:22:22.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7fc330f3b700 1 -- 172.21.15.154:0/3638135506 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc328004390 con 0x7fc32c09d860 2023-09-30T22:22:22.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/370076249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa409da10 msgr2=0x7ffaa4136760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7ffaa8ec2700 1 --2- 172.21.15.154:0/370076249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa409da10 0x7ffaa4136760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009950 tx=0x7ffa98009c60 comp rx=0 tx=0).stop 2023-09-30T22:22:22.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7fc330f3b700 1 -- 172.21.15.154:0/3638135506 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328009e70 con 0x7fc32c09d860 2023-09-30T22:22:22.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/370076249 shutdown_connections 2023-09-30T22:22:22.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7ffaa8ec2700 1 --2- 172.21.15.154:0/370076249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaa4136ca0 0x7ffaa4139080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7ffaa8ec2700 1 --2- 172.21.15.154:0/370076249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa409da10 0x7ffaa4136760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/370076249 >> 172.21.15.154:0/370076249 conn(0x7ffaa4099c40 msgr2=0x7ffaa40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/370076249 shutdown_connections 2023-09-30T22:22:22.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.689+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/370076249 wait complete. 2023-09-30T22:22:22.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.690+0000 7fc3341a1700 1 -- 172.21.15.154:0/3638135506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc32c09d860 msgr2=0x7fc32c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.690+0000 7fc3341a1700 1 --2- 172.21.15.154:0/3638135506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc32c09d860 0x7fc32c09dc30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc328009920 tx=0x7fc328009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:22.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.690+0000 7ffaa8ec2700 1 Processor -- start 2023-09-30T22:22:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.690+0000 7ffaa8ec2700 1 -- start start 2023-09-30T22:22:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.690+0000 7fc3341a1700 1 -- 172.21.15.154:0/3638135506 shutdown_connections 2023-09-30T22:22:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.690+0000 7fc3341a1700 1 --2- 172.21.15.154:0/3638135506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc32c09d860 0x7fc32c09dc30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.690+0000 7fc3341a1700 1 --2- 172.21.15.154:0/3638135506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09e170 0x7fc32c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.690+0000 7fc3341a1700 1 -- 172.21.15.154:0/3638135506 >> 172.21.15.154:0/3638135506 conn(0x7fc32c099c40 msgr2=0x7fc32c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa8ec2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaa409da10 0x7ffaa406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa8ec2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa412e490 0x7ffaa406f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa8ec2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa4136ca0 0x7ffaa406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa8ec2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa412b060 con 0x7ffaa4136ca0 2023-09-30T22:22:22.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa8ec2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4070770 con 0x7ffaa412e490 2023-09-30T22:22:22.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa8ec2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa412b620 con 0x7ffaa409da10 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa412e490 0x7ffaa406f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa412e490 0x7ffaa406f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37326/0 (socket says 172.21.15.154:37326) 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa1d9b700 1 -- 172.21.15.154:0/3879045076 learned_addr learned my addr 172.21.15.154:0/3879045076 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa259c700 1 --2- 172.21.15.154:0/3879045076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaa409da10 0x7ffaa406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa2d9d700 1 --2- 172.21.15.154:0/3879045076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa4136ca0 0x7ffaa406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa2d9d700 1 -- 172.21.15.154:0/3879045076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaa409da10 msgr2=0x7ffaa406edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa2d9d700 1 --2- 172.21.15.154:0/3879045076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaa409da10 0x7ffaa406edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa2d9d700 1 -- 172.21.15.154:0/3879045076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa412e490 msgr2=0x7ffaa406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa2d9d700 1 --2- 172.21.15.154:0/3879045076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaa412e490 0x7ffaa406f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7ffaa2d9d700 1 -- 172.21.15.154:0/3879045076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98009550 con 0x7ffaa4136ca0 2023-09-30T22:22:22.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7fc3341a1700 1 -- 172.21.15.154:0/3638135506 shutdown_connections 2023-09-30T22:22:22.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.691+0000 7fc3341a1700 1 -- 172.21.15.154:0/3638135506 wait complete. 2023-09-30T22:22:22.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.693+0000 7fc3341a1700 1 Processor -- start 2023-09-30T22:22:22.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7ffaa2d9d700 1 --2- 172.21.15.154:0/3879045076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa4136ca0 0x7ffaa406f840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00ef90 tx=0x7ffa9c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.693+0000 7fc3341a1700 1 -- start start 2023-09-30T22:22:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.693+0000 7fc3341a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09d860 0x7fc32c13d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.693+0000 7fc3341a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc32c09e170 0x7fc32c126e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.693+0000 7fc3341a1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc32c130ce0 0x7fc32c127380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc3341a1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c0726e0 con 0x7fc32c130ce0 2023-09-30T22:22:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc3341a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c12a430 con 0x7fc32c09d860 2023-09-30T22:22:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc3341a1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c130af0 con 0x7fc32c09e170 2023-09-30T22:22:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc331f3d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09d860 0x7fc32c13d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc331f3d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09d860 0x7fc32c13d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37334/0 (socket says 172.21.15.154:37334) 2023-09-30T22:22:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc331f3d700 1 -- 172.21.15.154:0/1860237125 learned_addr learned my addr 172.21.15.154:0/1860237125 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc33173c700 1 --2- 172.21.15.154:0/1860237125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc32c09e170 0x7fc32c126e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc33273e700 1 --2- 172.21.15.154:0/1860237125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc32c130ce0 0x7fc32c127380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7ffa92ffd700 1 -- 172.21.15.154:0/3879045076 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00cc90 con 0x7ffaa4136ca0 2023-09-30T22:22:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7ffa92ffd700 1 -- 172.21.15.154:0/3879045076 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c00f040 con 0x7ffaa4136ca0 2023-09-30T22:22:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7ffa92ffd700 1 -- 172.21.15.154:0/3879045076 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c009e60 con 0x7ffaa4136ca0 2023-09-30T22:22:22.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc331f3d700 1 -- 172.21.15.154:0/1860237125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc32c09e170 msgr2=0x7fc32c126e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc331f3d700 1 --2- 172.21.15.154:0/1860237125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc32c09e170 0x7fc32c126e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc331f3d700 1 -- 172.21.15.154:0/1860237125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc32c130ce0 msgr2=0x7fc32c127380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc331f3d700 1 --2- 172.21.15.154:0/1860237125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc32c130ce0 0x7fc32c127380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc331f3d700 1 -- 172.21.15.154:0/1860237125 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328009550 con 0x7fc32c09d860 2023-09-30T22:22:22.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7fc331f3d700 1 --2- 172.21.15.154:0/1860237125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09d860 0x7fc32c13d510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc32c09f9b0 tx=0x7fc328004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa412d0f0 con 0x7ffaa4136ca0 2023-09-30T22:22:22.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.694+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa40723a0 con 0x7ffaa4136ca0 2023-09-30T22:22:22.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.695+0000 7fc3227fc700 1 -- 172.21.15.154:0/1860237125 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32800bcf0 con 0x7fc32c09d860 2023-09-30T22:22:22.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.695+0000 7fc3227fc700 1 -- 172.21.15.154:0/1860237125 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32800be50 con 0x7fc32c09d860 2023-09-30T22:22:22.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.695+0000 7fc3227fc700 1 -- 172.21.15.154:0/1860237125 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280038a0 con 0x7fc32c09d860 2023-09-30T22:22:22.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.695+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffaa409c8e0 con 0x7ffaa4136ca0 2023-09-30T22:22:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.695+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32c129520 con 0x7fc32c09d860 2023-09-30T22:22:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.695+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32c1297e0 con 0x7fc32c09d860 2023-09-30T22:22:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.696+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc32c09c4e0 con 0x7fc32c09d860 2023-09-30T22:22:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.696+0000 7fc3227fc700 1 -- 172.21.15.154:0/1860237125 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc328022020 con 0x7fc32c09d860 2023-09-30T22:22:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.697+0000 7fc3227fc700 1 -- 172.21.15.154:0/1860237125 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc328041710 con 0x7fc32c09d860 2023-09-30T22:22:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.696+0000 7ffa92ffd700 1 -- 172.21.15.154:0/3879045076 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffa9c014480 con 0x7ffaa4136ca0 2023-09-30T22:22:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.696+0000 7ffa92ffd700 1 -- 172.21.15.154:0/3879045076 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ffa9c040560 con 0x7ffaa4136ca0 2023-09-30T22:22:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.696+0000 7ffaa259c700 1 -- 172.21.15.154:0/3879045076 >> v1:172.21.15.154:6816/126757 conn(0x7ffa8402f590 legacy=0x7ffa84031a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.696+0000 7ffa92ffd700 1 -- 172.21.15.154:0/3879045076 --> v1:172.21.15.154:6800/130130 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa8403c460 con 0x7ffa84038760 2023-09-30T22:22:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.696+0000 7ffa92ffd700 1 -- 172.21.15.154:0/3879045076 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa9c042b00 con 0x7ffaa4136ca0 2023-09-30T22:22:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.697+0000 7fc3227fc700 1 -- 172.21.15.154:0/1860237125 --> v1:172.21.15.154:6808/130339 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc31003c310 con 0x7fc310038610 2023-09-30T22:22:22.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.697+0000 7fc3227fc700 1 -- 172.21.15.154:0/1860237125 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc328041b10 con 0x7fc32c09d860 2023-09-30T22:22:22.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.697+0000 7fc33173c700 1 -- 172.21.15.154:0/1860237125 >> v1:172.21.15.154:6816/126757 conn(0x7fc31002f540 legacy=0x7fc3100319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.697+0000 7ffa92ffd700 1 -- 172.21.15.154:0/3879045076 <== osd.0 v1:172.21.15.154:6800/130130 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7ffa8403c460 con 0x7ffa84038760 2023-09-30T22:22:22.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.698+0000 7fc3227fc700 1 -- 172.21.15.154:0/1860237125 <== osd.2 v1:172.21.15.154:6808/130339 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fc31003c310 con 0x7fc310038610 2023-09-30T22:22:22.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.703+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 --> v1:172.21.15.154:6812/130679 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69a8120190 con 0x7f69880385e0 2023-09-30T22:22:22.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f6996ffd700 1 -- 172.21.15.154:0/1715420878 <== osd.3 v1:172.21.15.154:6812/130679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3191560019) 0x7f69a8120190 con 0x7f69880385e0 2023-09-30T22:22:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 >> v1:172.21.15.154:6812/130679 conn(0x7f69880385e0 legacy=0x7f698803aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 >> v1:172.21.15.154:6816/126757 conn(0x7f698802f510 legacy=0x7f69880319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a809f180 msgr2=0x7f69a811c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f69acf1a700 1 --2- 172.21.15.154:0/1715420878 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a809f180 0x7f69a811c470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f699c00c4a0 tx=0x7f699c00c7b0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f69a6d9d700 1 -- 172.21.15.154:0/1715420878 reap_dead start 2023-09-30T22:22:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 shutdown_connections 2023-09-30T22:22:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 >> 172.21.15.154:0/1715420878 conn(0x7f69a80a4430 msgr2=0x7f69a8130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 shutdown_connections 2023-09-30T22:22:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.704+0000 7f69acf1a700 1 -- 172.21.15.154:0/1715420878 wait complete. 2023-09-30T22:22:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.713+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 --> v1:172.21.15.154:6800/130130 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffaa409d390 con 0x7ffa84038760 2023-09-30T22:22:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.714+0000 7ffa92ffd700 1 -- 172.21.15.154:0/3879045076 <== osd.0 v1:172.21.15.154:6800/130130 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 277563570) 0x7ffa98004500 con 0x7ffa84038760 2023-09-30T22:22:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.714+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 >> v1:172.21.15.154:6800/130130 conn(0x7ffa84038760 legacy=0x7ffa8403abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.714+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 >> v1:172.21.15.154:6816/126757 conn(0x7ffa8402f590 legacy=0x7ffa84031a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.715+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa4136ca0 msgr2=0x7ffaa406f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.715+0000 7ffaa8ec2700 1 --2- 172.21.15.154:0/3879045076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa4136ca0 0x7ffaa406f840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00ef90 tx=0x7ffa9c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.715+0000 7ffaa2d9d700 1 -- 172.21.15.154:0/3879045076 reap_dead start 2023-09-30T22:22:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.715+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 shutdown_connections 2023-09-30T22:22:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.715+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 >> 172.21.15.154:0/3879045076 conn(0x7ffaa4099c40 msgr2=0x7ffaa409b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.715+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 shutdown_connections 2023-09-30T22:22:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.715+0000 7ffaa8ec2700 1 -- 172.21.15.154:0/3879045076 wait complete. 2023-09-30T22:22:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.715+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 --> v1:172.21.15.154:6804/130229 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0fc412f4c0 con 0x7f0fa8038660 2023-09-30T22:22:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.715+0000 7f0fba7fc700 1 -- 172.21.15.154:0/1321500192 <== osd.1 v1:172.21.15.154:6804/130229 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2085588430) 0x7f0fc412f4c0 con 0x7f0fa8038660 2023-09-30T22:22:22.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.716+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 >> v1:172.21.15.154:6804/130229 conn(0x7f0fa8038660 legacy=0x7f0fa803aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.716+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 >> v1:172.21.15.154:6816/126757 conn(0x7f0fa802f510 legacy=0x7f0fa80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.716+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fc406a770 msgr2=0x7f0fc411bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.716+0000 7f0fcbfb1700 1 --2- 172.21.15.154:0/1321500192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fc406a770 0x7f0fc411bf50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00ba50 tx=0x7f0fbc00bd60 comp rx=0 tx=0).stop 2023-09-30T22:22:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.716+0000 7f0fca54e700 1 -- 172.21.15.154:0/1321500192 reap_dead start 2023-09-30T22:22:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.716+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 shutdown_connections 2023-09-30T22:22:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.716+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 >> 172.21.15.154:0/1321500192 conn(0x7f0fc4099c40 msgr2=0x7f0fc4130e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.716+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 shutdown_connections 2023-09-30T22:22:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.716+0000 7f0fcbfb1700 1 -- 172.21.15.154:0/1321500192 wait complete. 2023-09-30T22:22:22.728 INFO:teuthology.orchestra.run.smithi154.stdout:137438953475 2023-09-30T22:22:22.729 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.723+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 --> v1:172.21.15.154:6808/130339 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc32c09c090 con 0x7fc310038610 2023-09-30T22:22:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc3227fc700 1 -- 172.21.15.154:0/1860237125 <== osd.2 v1:172.21.15.154:6808/130339 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3191560019) 0x7fc324001af0 con 0x7fc310038610 2023-09-30T22:22:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 >> v1:172.21.15.154:6808/130339 conn(0x7fc310038610 legacy=0x7fc31003aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 >> v1:172.21.15.154:6816/126757 conn(0x7fc31002f540 legacy=0x7fc3100319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09d860 msgr2=0x7fc32c13d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc3341a1700 1 --2- 172.21.15.154:0/1860237125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc32c09d860 0x7fc32c13d510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc32c09f9b0 tx=0x7fc328004750 comp rx=0 tx=0).stop 2023-09-30T22:22:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc33273e700 1 -- 172.21.15.154:0/1860237125 reap_dead start 2023-09-30T22:22:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 shutdown_connections 2023-09-30T22:22:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 >> 172.21.15.154:0/1860237125 conn(0x7fc32c099c40 msgr2=0x7fc32c0a22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 shutdown_connections 2023-09-30T22:22:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.724+0000 7fc3341a1700 1 -- 172.21.15.154:0/1860237125 wait complete. 2023-09-30T22:22:22.732 INFO:teuthology.orchestra.run.smithi154.stdout:124554051588 2023-09-30T22:22:22.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:22.733 INFO:teuthology.orchestra.run.smithi154.stdout:128849018883 2023-09-30T22:22:22.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:22.737 INFO:teuthology.orchestra.run.smithi154.stdout:137438953475 2023-09-30T22:22:22.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:22.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.876+0000 7ff043563700 1 Processor -- start 2023-09-30T22:22:22.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.877+0000 7ff043563700 1 -- start start 2023-09-30T22:22:22.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.877+0000 7ff043563700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 0x7ff03c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.877+0000 7ff043563700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c139200 0x7ff03c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.877+0000 7ff043563700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c09e9d0 con 0x7ff03c0a0a70 2023-09-30T22:22:22.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.877+0000 7ff043563700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c09dc00 con 0x7ff03c139200 2023-09-30T22:22:22.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.877+0000 7ff043563700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c09dec0 con 0x7ff03c0a1550 2023-09-30T22:22:22.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.877+0000 7ff040afe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 0x7ff03c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff0412ff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff03c0a0a70 0x7ff03c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50368/0 (socket says 172.21.15.154:50368) 2023-09-30T22:22:22.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff041b00700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c139200 0x7ff03c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff0412ff700 1 -- 172.21.15.154:0/1802500197 learned_addr learned my addr 172.21.15.154:0/1802500197 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:22.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff041b00700 1 -- 172.21.15.154:0/1802500197 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 msgr2=0x7ff03c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff041b00700 1 --2- 172.21.15.154:0/1802500197 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 0x7ff03c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff041b00700 1 -- 172.21.15.154:0/1802500197 >> v1:172.21.15.154:6789/0 conn(0x7ff03c0a0a70 legacy=0x7ff03c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff033fff700 1 -- 172.21.15.154:0/1802500197 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979745967 0 0) 0x7ff03c09e9d0 con 0x7ff03c0a0a70 2023-09-30T22:22:22.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff041b00700 1 -- 172.21.15.154:0/1802500197 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c09e6a0 con 0x7ff03c139200 2023-09-30T22:22:22.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff040afe700 1 --2- 172.21.15.154:0/1802500197 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 0x7ff03c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff041b00700 1 --2- 172.21.15.154:0/1802500197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c139200 0x7ff03c13b5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff034009dc0 tx=0x7ff03400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c212edc34926daed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff033fff700 1 -- 172.21.15.154:0/1802500197 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03400e070 con 0x7ff03c139200 2023-09-30T22:22:22.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff033fff700 1 -- 172.21.15.154:0/1802500197 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03400bb20 con 0x7ff03c139200 2023-09-30T22:22:22.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.878+0000 7ff033fff700 1 -- 172.21.15.154:0/1802500197 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff034012430 con 0x7ff03c139200 2023-09-30T22:22:22.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.879+0000 7ff043563700 1 -- 172.21.15.154:0/1802500197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c139200 msgr2=0x7ff03c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.879+0000 7ff043563700 1 --2- 172.21.15.154:0/1802500197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c139200 0x7ff03c13b5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff034009dc0 tx=0x7ff03400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:22.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.879+0000 7ff043563700 1 -- 172.21.15.154:0/1802500197 shutdown_connections 2023-09-30T22:22:22.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.879+0000 7ff043563700 1 --2- 172.21.15.154:0/1802500197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c139200 0x7ff03c13b5e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.879+0000 7ff043563700 1 --2- 172.21.15.154:0/1802500197 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 0x7ff03c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.879+0000 7ff043563700 1 -- 172.21.15.154:0/1802500197 >> 172.21.15.154:0/1802500197 conn(0x7ff03c0a6610 msgr2=0x7ff03c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.879+0000 7ff043563700 1 -- 172.21.15.154:0/1802500197 shutdown_connections 2023-09-30T22:22:22.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.879+0000 7ff043563700 1 -- 172.21.15.154:0/1802500197 wait complete. 2023-09-30T22:22:22.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.881+0000 7ff043563700 1 Processor -- start 2023-09-30T22:22:22.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.881+0000 7ff043563700 1 -- start start 2023-09-30T22:22:22.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.881+0000 7ff043563700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c0a0a70 0x7ff03c1206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.881+0000 7ff043563700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 0x7ff03c120bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.881+0000 7ff043563700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff03c139200 0x7ff03c121130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.881+0000 7ff043563700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c135fc0 con 0x7ff03c139200 2023-09-30T22:22:22.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.881+0000 7ff043563700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c123ef0 con 0x7ff03c0a0a70 2023-09-30T22:22:22.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.881+0000 7ff043563700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c0a5100 con 0x7ff03c0a1550 2023-09-30T22:22:22.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.881+0000 7ff0412ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c0a0a70 0x7ff03c1206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff0412ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c0a0a70 0x7ff03c1206b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37350/0 (socket says 172.21.15.154:37350) 2023-09-30T22:22:22.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff0412ff700 1 -- 172.21.15.154:0/3815468633 learned_addr learned my addr 172.21.15.154:0/3815468633 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff041b00700 1 --2- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff03c139200 0x7ff03c121130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff040afe700 1 --2- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 0x7ff03c120bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff0412ff700 1 -- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 msgr2=0x7ff03c120bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff0412ff700 1 --2- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 0x7ff03c120bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff0412ff700 1 -- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff03c139200 msgr2=0x7ff03c121130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff0412ff700 1 --2- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff03c139200 0x7ff03c121130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff0412ff700 1 -- 172.21.15.154:0/3815468633 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0094a0 con 0x7ff03c0a0a70 2023-09-30T22:22:22.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff0412ff700 1 --2- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c0a0a70 0x7ff03c1206b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c520 tx=0x7ff03800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff031ffb700 1 -- 172.21.15.154:0/3815468633 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038004c80 con 0x7ff03c0a0a70 2023-09-30T22:22:22.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff031ffb700 1 -- 172.21.15.154:0/3815468633 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038004e00 con 0x7ff03c0a0a70 2023-09-30T22:22:22.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff031ffb700 1 -- 172.21.15.154:0/3815468633 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038007310 con 0x7ff03c0a0a70 2023-09-30T22:22:22.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.882+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff034009a70 con 0x7ff03c0a0a70 2023-09-30T22:22:22.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.883+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c122a70 con 0x7ff03c0a0a70 2023-09-30T22:22:22.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.883+0000 7ff031ffb700 1 -- 172.21.15.154:0/3815468633 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff038007470 con 0x7ff03c0a0a70 2023-09-30T22:22:22.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.884+0000 7ff031ffb700 1 -- 172.21.15.154:0/3815468633 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff03803f7b0 con 0x7ff03c0a0a70 2023-09-30T22:22:22.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.884+0000 7ff040afe700 1 -- 172.21.15.154:0/3815468633 >> v1:172.21.15.154:6816/126757 conn(0x7ff02002f510 legacy=0x7ff0200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.884+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03c04f2a0 con 0x7ff03c0a0a70 2023-09-30T22:22:22.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.889+0000 7ff031ffb700 1 -- 172.21.15.154:0/3815468633 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0380123b0 con 0x7ff03c0a0a70 2023-09-30T22:22:22.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7fe75b94c700 1 Processor -- start 2023-09-30T22:22:22.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7facf61d2700 1 Processor -- start 2023-09-30T22:22:22.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7facf61d2700 1 -- start start 2023-09-30T22:22:22.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7facf61d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf009f350 0x7facf0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7facf61d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf01393a0 0x7facf013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7facf61d2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf009fa00 con 0x7facf009e870 2023-09-30T22:22:22.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7facf61d2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf00a0370 con 0x7facf01393a0 2023-09-30T22:22:22.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7facf61d2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facf006bec0 con 0x7facf009f350 2023-09-30T22:22:22.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7fe75b94c700 1 -- start start 2023-09-30T22:22:22.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7fe75b94c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 0x7fe7540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7fe75b94c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7fe75b94c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe754133f50 0x7fe7541343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7fe75b94c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75409e9d0 con 0x7fe754133f50 2023-09-30T22:22:22.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7fe75b94c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75409dc00 con 0x7fe7540a1380 2023-09-30T22:22:22.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.909+0000 7fe75b94c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe75409dec0 con 0x7fe7540a0a70 2023-09-30T22:22:22.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7faceeffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf009f350 0x7facf0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe758ee7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe758ee7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37368/0 (socket says 172.21.15.154:37368) 2023-09-30T22:22:22.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe758ee7700 1 -- 172.21.15.154:0/1934033664 learned_addr learned my addr 172.21.15.154:0/1934033664 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7faceeffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf009f350 0x7facf0138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45128/0 (socket says 172.21.15.154:45128) 2023-09-30T22:22:22.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7faceeffd700 1 -- 172.21.15.154:0/782177051 learned_addr learned my addr 172.21.15.154:0/782177051 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7faceffff700 1 --2- 172.21.15.154:0/782177051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf01393a0 0x7facf013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe7596e8700 1 --2- 172.21.15.154:0/1934033664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 0x7fe7540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7faceeffd700 1 -- 172.21.15.154:0/782177051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf01393a0 msgr2=0x7facf013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7faceeffd700 1 --2- 172.21.15.154:0/782177051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf01393a0 0x7facf013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7faceeffd700 1 -- 172.21.15.154:0/782177051 >> v1:172.21.15.154:6789/0 conn(0x7facf009e870 legacy=0x7facf009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7faceeffd700 1 -- 172.21.15.154:0/782177051 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf009ada0 con 0x7facf009f350 2023-09-30T22:22:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe7596e8700 1 -- 172.21.15.154:0/1934033664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 msgr2=0x7fe754133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe7596e8700 1 --2- 172.21.15.154:0/1934033664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe7596e8700 1 -- 172.21.15.154:0/1934033664 >> v2:172.21.15.154:3300/0 conn(0x7fe754133f50 msgr2=0x7fe7541343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe7596e8700 1 --2- 172.21.15.154:0/1934033664 >> v2:172.21.15.154:3300/0 conn(0x7fe754133f50 0x7fe7541343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe7596e8700 1 -- 172.21.15.154:0/1934033664 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75409e6a0 con 0x7fe7540a0a70 2023-09-30T22:22:22.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe758ee7700 1 --2- 172.21.15.154:0/1934033664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7faceeffd700 1 --2- 172.21.15.154:0/782177051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf009f350 0x7facf0138e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7face4009920 tx=0x7face4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c6e0fcaea14adc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7fe7596e8700 1 --2- 172.21.15.154:0/1934033664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 0x7fe7540a0e40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe750009840 tx=0x7fe750009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44678af8c25b5d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.910+0000 7facee7fc700 1 -- 172.21.15.154:0/782177051 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4004230 con 0x7facf009f350 2023-09-30T22:22:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7facee7fc700 1 -- 172.21.15.154:0/782177051 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face4004390 con 0x7facf009f350 2023-09-30T22:22:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7facee7fc700 1 -- 172.21.15.154:0/782177051 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face40036a0 con 0x7facf009f350 2023-09-30T22:22:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe74bfff700 1 -- 172.21.15.154:0/1934033664 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750011830 con 0x7fe7540a0a70 2023-09-30T22:22:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe74bfff700 1 -- 172.21.15.154:0/1934033664 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe750011990 con 0x7fe7540a0a70 2023-09-30T22:22:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe74bfff700 1 -- 172.21.15.154:0/1934033664 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750011d20 con 0x7fe7540a0a70 2023-09-30T22:22:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7facf61d2700 1 -- 172.21.15.154:0/782177051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf009f350 msgr2=0x7facf0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7facf61d2700 1 --2- 172.21.15.154:0/782177051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf009f350 0x7facf0138e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7face4009920 tx=0x7face4009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:22.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe75b94c700 1 -- 172.21.15.154:0/1934033664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 msgr2=0x7fe7540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe75b94c700 1 --2- 172.21.15.154:0/1934033664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 0x7fe7540a0e40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe750009840 tx=0x7fe750009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:22.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe75b94c700 1 -- 172.21.15.154:0/1934033664 shutdown_connections 2023-09-30T22:22:22.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe75b94c700 1 --2- 172.21.15.154:0/1934033664 >> v2:172.21.15.154:3300/0 conn(0x7fe754133f50 0x7fe7541343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe75b94c700 1 --2- 172.21.15.154:0/1934033664 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 0x7fe7540a0e40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe75b94c700 1 --2- 172.21.15.154:0/1934033664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.911+0000 7fe75b94c700 1 -- 172.21.15.154:0/1934033664 >> 172.21.15.154:0/1934033664 conn(0x7fe7540a6610 msgr2=0x7fe7540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.912+0000 7fe75b94c700 1 -- 172.21.15.154:0/1934033664 shutdown_connections 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.912+0000 7fe75b94c700 1 -- 172.21.15.154:0/1934033664 wait complete. 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.912+0000 7fe75b94c700 1 Processor -- start 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.912+0000 7fe75b94c700 1 -- start start 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe75b94c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 0x7fe754122300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe75b94c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754122840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe75b94c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe754133f50 0x7fe754122d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe75b94c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe754125910 con 0x7fe754133f50 2023-09-30T22:22:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe75b94c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe754124da0 con 0x7fe7540a1380 2023-09-30T22:22:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe75b94c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540a03e0 con 0x7fe7540a0a70 2023-09-30T22:22:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe758ee7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754122840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe758ee7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754122840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37370/0 (socket says 172.21.15.154:37370) 2023-09-30T22:22:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe758ee7700 1 -- 172.21.15.154:0/1049434041 learned_addr learned my addr 172.21.15.154:0/1049434041 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe759ee9700 1 --2- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe754133f50 0x7fe754122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe7596e8700 1 --2- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 0x7fe754122300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe758ee7700 1 -- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 msgr2=0x7fe754122300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe758ee7700 1 --2- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 0x7fe754122300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe758ee7700 1 -- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe754133f50 msgr2=0x7fe754122d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe758ee7700 1 --2- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe754133f50 0x7fe754122d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.913+0000 7fe758ee7700 1 -- 172.21.15.154:0/1049434041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744009550 con 0x7fe7540a1380 2023-09-30T22:22:22.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7facf61d2700 1 -- 172.21.15.154:0/782177051 shutdown_connections 2023-09-30T22:22:22.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7facf61d2700 1 --2- 172.21.15.154:0/782177051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf01393a0 0x7facf013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7facf61d2700 1 --2- 172.21.15.154:0/782177051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf009f350 0x7facf0138e60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7facf61d2700 1 -- 172.21.15.154:0/782177051 >> 172.21.15.154:0/782177051 conn(0x7facf00a4430 msgr2=0x7facf00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7facf61d2700 1 -- 172.21.15.154:0/782177051 shutdown_connections 2023-09-30T22:22:22.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7fe758ee7700 1 --2- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754122840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe74400ec10 tx=0x7fe74400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7facf61d2700 1 -- 172.21.15.154:0/782177051 wait complete. 2023-09-30T22:22:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7fe749ffb700 1 -- 172.21.15.154:0/1049434041 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74400c850 con 0x7fe7540a1380 2023-09-30T22:22:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7500094a0 con 0x7fe7540a1380 2023-09-30T22:22:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7fe749ffb700 1 -- 172.21.15.154:0/1049434041 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74400c9b0 con 0x7fe7540a1380 2023-09-30T22:22:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7fe749ffb700 1 -- 172.21.15.154:0/1049434041 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74400cd60 con 0x7fe7540a1380 2023-09-30T22:22:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.914+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7541336d0 con 0x7fe7540a1380 2023-09-30T22:22:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.915+0000 7facf61d2700 1 Processor -- start 2023-09-30T22:22:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.915+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75411f050 con 0x7fe7540a1380 2023-09-30T22:22:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.915+0000 7facf61d2700 1 -- start start 2023-09-30T22:22:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7facf61d2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf009e870 0x7facf01c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7facf61d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf009f350 0x7facf01c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7facf61d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf01393a0 0x7facf0135010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7facf61d2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf011a7d0 con 0x7facf009e870 2023-09-30T22:22:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7facf61d2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf0138850 con 0x7facf009f350 2023-09-30T22:22:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7facf61d2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facf01374a0 con 0x7facf01393a0 2023-09-30T22:22:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf009f350 0x7facf01c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf009f350 0x7facf01c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37380/0 (socket says 172.21.15.154:37380) 2023-09-30T22:22:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf01393a0 0x7facf0135010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceeffd700 1 -- 172.21.15.154:0/1742783376 learned_addr learned my addr 172.21.15.154:0/1742783376 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7facef7fe700 1 --2- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf009e870 0x7facf01c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceeffd700 1 -- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf01393a0 msgr2=0x7facf0135010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceeffd700 1 --2- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf01393a0 0x7facf0135010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceeffd700 1 -- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf009e870 msgr2=0x7facf01c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceeffd700 1 --2- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf009e870 0x7facf01c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceeffd700 1 -- 172.21.15.154:0/1742783376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face4009550 con 0x7facf009f350 2023-09-30T22:22:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceffff700 1 --2- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf01393a0 0x7facf0135010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7faceeffd700 1 --2- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf009f350 0x7facf01c4c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7face40098f0 tx=0x7face4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.916+0000 7facd7fff700 1 -- 172.21.15.154:0/1742783376 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4003db0 con 0x7facf009f350 2023-09-30T22:22:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.917+0000 7facd7fff700 1 -- 172.21.15.154:0/1742783376 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face4011630 con 0x7facf009f350 2023-09-30T22:22:22.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.917+0000 7facd7fff700 1 -- 172.21.15.154:0/1742783376 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face40119e0 con 0x7facf009f350 2023-09-30T22:22:22.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.917+0000 7fe749ffb700 1 -- 172.21.15.154:0/1049434041 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe744013470 con 0x7fe7540a1380 2023-09-30T22:22:22.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.917+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf006cfa0 con 0x7facf009f350 2023-09-30T22:22:22.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.917+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf0138b30 con 0x7facf009f350 2023-09-30T22:22:22.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.917+0000 7fe749ffb700 1 -- 172.21.15.154:0/1049434041 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fe744040150 con 0x7fe7540a1380 2023-09-30T22:22:22.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.917+0000 7facd7fff700 1 -- 172.21.15.154:0/1742783376 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7face4021070 con 0x7facf009f350 2023-09-30T22:22:22.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.918+0000 7facd7fff700 1 -- 172.21.15.154:0/1742783376 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7face4041610 con 0x7facf009f350 2023-09-30T22:22:22.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.918+0000 7facef7fe700 1 -- 172.21.15.154:0/1742783376 >> v1:172.21.15.154:6816/126757 conn(0x7facdc02f510 legacy=0x7facdc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.918+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf0138990 con 0x7facf009f350 2023-09-30T22:22:22.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.918+0000 7fe7596e8700 1 -- 172.21.15.154:0/1049434041 >> v1:172.21.15.154:6816/126757 conn(0x7fe73802f510 legacy=0x7fe7380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.922+0000 7fe749ffb700 1 -- 172.21.15.154:0/1049434041 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe74401b3b0 con 0x7fe7540a1380 2023-09-30T22:22:22.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.929+0000 7facd7fff700 1 -- 172.21.15.154:0/1742783376 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facf0138990 con 0x7facf009f350 2023-09-30T22:22:22.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.931+0000 7ffbae913700 1 Processor -- start 2023-09-30T22:22:22.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.931+0000 7ffbae913700 1 -- start start 2023-09-30T22:22:22.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.932+0000 7ffbae913700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a0a70 0x7ffba80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.932+0000 7ffbae913700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffba8134120 0x7ffba813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.932+0000 7ffbae913700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba809dc00 con 0x7ffba80a1380 2023-09-30T22:22:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.932+0000 7ffbae913700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba809ea60 con 0x7ffba8134120 2023-09-30T22:22:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.932+0000 7ffbae913700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba809dec0 con 0x7ffba80a0a70 2023-09-30T22:22:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.932+0000 7ffba7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a0a70 0x7ffba80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.932+0000 7ffba7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a0a70 0x7ffba80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37392/0 (socket says 172.21.15.154:37392) 2023-09-30T22:22:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.932+0000 7ffba7fff700 1 -- 172.21.15.154:0/3565571194 learned_addr learned my addr 172.21.15.154:0/3565571194 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.932+0000 7ffbaceb0700 1 --2- 172.21.15.154:0/3565571194 >> v2:172.21.15.154:3300/0 conn(0x7ffba8134120 0x7ffba813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.933+0000 7ffbaceb0700 1 -- 172.21.15.154:0/3565571194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a0a70 msgr2=0x7ffba80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.933+0000 7ffbaceb0700 1 --2- 172.21.15.154:0/3565571194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a0a70 0x7ffba80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.933+0000 7ffbaceb0700 1 -- 172.21.15.154:0/3565571194 >> v1:172.21.15.154:6789/0 conn(0x7ffba80a1380 legacy=0x7ffba8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.933+0000 7ffbaceb0700 1 -- 172.21.15.154:0/3565571194 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba809e6a0 con 0x7ffba8134120 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.933+0000 7ffbaceb0700 1 --2- 172.21.15.154:0/3565571194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8134120 0x7ffba813bce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009d90 tx=0x7ffba000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1f85626060c735 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.933+0000 7ffba6ffd700 1 -- 172.21.15.154:0/3565571194 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba000e070 con 0x7ffba8134120 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.933+0000 7ffba6ffd700 1 -- 172.21.15.154:0/3565571194 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba000bae0 con 0x7ffba8134120 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.933+0000 7ffba6ffd700 1 -- 172.21.15.154:0/3565571194 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba000be90 con 0x7ffba8134120 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.934+0000 7ffbae913700 1 -- 172.21.15.154:0/3565571194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8134120 msgr2=0x7ffba813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.934+0000 7ffbae913700 1 --2- 172.21.15.154:0/3565571194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8134120 0x7ffba813bce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009d90 tx=0x7ffba000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.934+0000 7ffbae913700 1 -- 172.21.15.154:0/3565571194 shutdown_connections 2023-09-30T22:22:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.934+0000 7ffbae913700 1 --2- 172.21.15.154:0/3565571194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8134120 0x7ffba813bce0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.934+0000 7ffbae913700 1 --2- 172.21.15.154:0/3565571194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a0a70 0x7ffba80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.934+0000 7ffbae913700 1 -- 172.21.15.154:0/3565571194 >> 172.21.15.154:0/3565571194 conn(0x7ffba80a6610 msgr2=0x7ffba80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.934+0000 7ffbae913700 1 -- 172.21.15.154:0/3565571194 shutdown_connections 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.934+0000 7ffbae913700 1 -- 172.21.15.154:0/3565571194 wait complete. 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.936+0000 7ffbae913700 1 Processor -- start 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.936+0000 7ffbae913700 1 -- start start 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.936+0000 7ffbae913700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba80a0a70 0x7ffba8122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffbae913700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a1380 0x7ffba8122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffbae913700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffba8134120 0x7ffba81233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:22.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffbae913700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba8133ad0 con 0x7ffba80a0a70 2023-09-30T22:22:22.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffbae913700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba8124510 con 0x7ffba80a1380 2023-09-30T22:22:22.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffbae913700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffba81260a0 con 0x7ffba8134120 2023-09-30T22:22:22.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba80a0a70 0x7ffba8122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffbaceb0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffba8134120 0x7ffba81233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba80a0a70 0x7ffba8122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44346/0 (socket says 172.21.15.154:44346) 2023-09-30T22:22:22.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba7fff700 1 -- 172.21.15.154:0/3635090087 learned_addr learned my addr 172.21.15.154:0/3635090087 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:22.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba77fe700 1 --2- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a1380 0x7ffba8122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:22.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba7fff700 1 -- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffba8134120 msgr2=0x7ffba81233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba7fff700 1 --2- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffba8134120 0x7ffba81233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba7fff700 1 -- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a1380 msgr2=0x7ffba8122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba7fff700 1 --2- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a1380 0x7ffba8122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba7fff700 1 -- 172.21.15.154:0/3635090087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0009a70 con 0x7ffba80a0a70 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.937+0000 7ffba7fff700 1 --2- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba80a0a70 0x7ffba8122940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800e910 tx=0x7ffb9800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.938+0000 7ffba4ff9700 1 -- 172.21.15.154:0/3635090087 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980096a0 con 0x7ffba80a0a70 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.938+0000 7ffba4ff9700 1 -- 172.21.15.154:0/3635090087 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9800ee60 con 0x7ffba80a0a70 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.938+0000 7ffba4ff9700 1 -- 172.21.15.154:0/3635090087 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9800ca50 con 0x7ffba80a0a70 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.938+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba80a03e0 con 0x7ffba80a0a70 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.938+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba81333e0 con 0x7ffba80a0a70 2023-09-30T22:22:22.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.939+0000 7ffba4ff9700 1 -- 172.21.15.154:0/3635090087 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffb9800cbb0 con 0x7ffba80a0a70 2023-09-30T22:22:22.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.939+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba804f2a0 con 0x7ffba80a0a70 2023-09-30T22:22:22.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.939+0000 7ffba4ff9700 1 -- 172.21.15.154:0/3635090087 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ffb9803fcb0 con 0x7ffba80a0a70 2023-09-30T22:22:22.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.940+0000 7ffba77fe700 1 -- 172.21.15.154:0/3635090087 >> v1:172.21.15.154:6816/126757 conn(0x7ffb9402f510 legacy=0x7ffb940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:22.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:22.948+0000 7ffba4ff9700 1 -- 172.21.15.154:0/3635090087 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb980232f0 con 0x7ffba80a0a70 2023-09-30T22:22:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.085+0000 7ff040afe700 1 -- 172.21.15.154:0/3815468633 >> v1:172.21.15.154:6816/126757 conn(0x7ff02002f510 legacy=0x7ff0200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:23.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.119+0000 7fe7596e8700 1 -- 172.21.15.154:0/1049434041 >> v1:172.21.15.154:6816/126757 conn(0x7fe73802f510 legacy=0x7fe7380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:23.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.119+0000 7facef7fe700 1 -- 172.21.15.154:0/1742783376 >> v1:172.21.15.154:6816/126757 conn(0x7facdc02f510 legacy=0x7facdc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:23.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.120+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe75404f2a0 con 0x7fe7540a1380 2023-09-30T22:22:23.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.120+0000 7fe749ffb700 1 -- 172.21.15.154:0/1049434041 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe744011b40 con 0x7fe7540a1380 2023-09-30T22:22:23.120 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:23.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.122+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 >> v1:172.21.15.154:6816/126757 conn(0x7fe73802f510 legacy=0x7fe7380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.122+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 msgr2=0x7fe754122840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.122+0000 7fe75b94c700 1 --2- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754122840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe74400ec10 tx=0x7fe74400ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.123+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 shutdown_connections 2023-09-30T22:22:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.123+0000 7fe75b94c700 1 --2- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe754133f50 0x7fe754122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.123+0000 7fe75b94c700 1 --2- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7540a0a70 0x7fe754122300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.123+0000 7fe75b94c700 1 --2- 172.21.15.154:0/1049434041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7540a1380 0x7fe754122840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.123+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 >> 172.21.15.154:0/1049434041 conn(0x7fe7540a6610 msgr2=0x7fe75409c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.123+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 shutdown_connections 2023-09-30T22:22:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.123+0000 7fe75b94c700 1 -- 172.21.15.154:0/1049434041 wait complete. 2023-09-30T22:22:23.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.132+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7facf0138990 con 0x7facf009f350 2023-09-30T22:22:23.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.133+0000 7facd7fff700 1 -- 172.21.15.154:0/1742783376 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facf0138990 con 0x7facf009f350 2023-09-30T22:22:23.132 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:23.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 >> v1:172.21.15.154:6816/126757 conn(0x7facdc02f510 legacy=0x7facdc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:23.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf009f350 msgr2=0x7facf01c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 --2- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf009f350 0x7facf01c4c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7face40098f0 tx=0x7face4004750 comp rx=0 tx=0).stop 2023-09-30T22:22:23.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:23.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 shutdown_connections 2023-09-30T22:22:23.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 --2- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facf01393a0 0x7facf0135010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 --2- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facf009e870 0x7facf01c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 --2- 172.21.15.154:0/1742783376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facf009f350 0x7facf01c4c90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 >> 172.21.15.154:0/1742783376 conn(0x7facf00a4430 msgr2=0x7facf0132b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 shutdown_connections 2023-09-30T22:22:23.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.135+0000 7facf61d2700 1 -- 172.21.15.154:0/1742783376 wait complete. 2023-09-30T22:22:23.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.141+0000 7ffba77fe700 1 -- 172.21.15.154:0/3635090087 >> v1:172.21.15.154:6816/126757 conn(0x7ffb9402f510 legacy=0x7ffb940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:23.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.156+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff03c072980 con 0x7ff03c0a0a70 2023-09-30T22:22:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.156+0000 7ff031ffb700 1 -- 172.21.15.154:0/3815468633 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0380102c0 con 0x7ff03c0a0a70 2023-09-30T22:22:23.156 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 >> v1:172.21.15.154:6816/126757 conn(0x7ff02002f510 legacy=0x7ff0200319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c0a0a70 msgr2=0x7ff03c1206b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 --2- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c0a0a70 0x7ff03c1206b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c520 tx=0x7ff03800c830 comp rx=0 tx=0).stop 2023-09-30T22:22:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 shutdown_connections 2023-09-30T22:22:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 --2- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff03c139200 0x7ff03c121130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 --2- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff03c0a0a70 0x7ff03c1206b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 --2- 172.21.15.154:0/3815468633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff03c0a1550 0x7ff03c120bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 >> 172.21.15.154:0/3815468633 conn(0x7ff03c0a6610 msgr2=0x7ff03c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 shutdown_connections 2023-09-30T22:22:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.158+0000 7ff043563700 1 -- 172.21.15.154:0/3815468633 wait complete. 2023-09-30T22:22:23.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:23.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.197+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffba8072980 con 0x7ffba80a0a70 2023-09-30T22:22:23.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.197+0000 7ffba4ff9700 1 -- 172.21.15.154:0/3635090087 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb98021030 con 0x7ffba80a0a70 2023-09-30T22:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:23.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 >> v1:172.21.15.154:6816/126757 conn(0x7ffb9402f510 legacy=0x7ffb940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:23.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba80a0a70 msgr2=0x7ffba8122940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 --2- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba80a0a70 0x7ffba8122940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800e910 tx=0x7ffb9800ec20 comp rx=0 tx=0).stop 2023-09-30T22:22:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 shutdown_connections 2023-09-30T22:22:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 --2- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffba8134120 0x7ffba81233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 --2- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba80a0a70 0x7ffba8122940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 --2- 172.21.15.154:0/3635090087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba80a1380 0x7ffba8122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 >> 172.21.15.154:0/3635090087 conn(0x7ffba80a6610 msgr2=0x7ffba80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 shutdown_connections 2023-09-30T22:22:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:23.199+0000 7ffbae913700 1 -- 172.21.15.154:0/3635090087 wait complete. 2023-09-30T22:22:23.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:24.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:24.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:24.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:24.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.280+0000 7faba917d700 1 Processor -- start 2023-09-30T22:22:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.280+0000 7faba917d700 1 -- start start 2023-09-30T22:22:24.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba917d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba917d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faba40a10b0 0x7faba413b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba917d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba409a760 con 0x7faba4134210 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba917d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba41336e0 con 0x7faba40a10b0 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba917d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faba409a080 con 0x7faba4133900 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba4133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45166/0 (socket says 172.21.15.154:45166) 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba2d9d700 1 -- 172.21.15.154:0/3829207895 learned_addr learned my addr 172.21.15.154:0/3829207895 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba359e700 1 --2- 172.21.15.154:0/3829207895 >> v2:172.21.15.154:3300/0 conn(0x7faba40a10b0 0x7faba413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba2d9d700 1 -- 172.21.15.154:0/3829207895 >> v2:172.21.15.154:3300/0 conn(0x7faba40a10b0 msgr2=0x7faba413b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba2d9d700 1 --2- 172.21.15.154:0/3829207895 >> v2:172.21.15.154:3300/0 conn(0x7faba40a10b0 0x7faba413b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba2d9d700 1 -- 172.21.15.154:0/3829207895 >> v1:172.21.15.154:6789/0 conn(0x7faba4134210 legacy=0x7faba40a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.281+0000 7faba2d9d700 1 -- 172.21.15.154:0/3829207895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40a23e0 con 0x7faba4133900 2023-09-30T22:22:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.282+0000 7faba2d9d700 1 --2- 172.21.15.154:0/3829207895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba4133cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab94006fd0 tx=0x7fab94009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d897f38bdd907921 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.282+0000 7faba1d9b700 1 -- 172.21.15.154:0/3829207895 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94005e30 con 0x7faba4133900 2023-09-30T22:22:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.282+0000 7faba1d9b700 1 -- 172.21.15.154:0/3829207895 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab94004030 con 0x7faba4133900 2023-09-30T22:22:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.282+0000 7faba1d9b700 1 -- 172.21.15.154:0/3829207895 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940043e0 con 0x7faba4133900 2023-09-30T22:22:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.283+0000 7faba917d700 1 -- 172.21.15.154:0/3829207895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 msgr2=0x7faba4133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.283+0000 7faba917d700 1 --2- 172.21.15.154:0/3829207895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba4133cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab94006fd0 tx=0x7fab94009bd0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.283+0000 7faba917d700 1 -- 172.21.15.154:0/3829207895 shutdown_connections 2023-09-30T22:22:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.283+0000 7faba917d700 1 --2- 172.21.15.154:0/3829207895 >> v2:172.21.15.154:3300/0 conn(0x7faba40a10b0 0x7faba413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.283+0000 7faba917d700 1 --2- 172.21.15.154:0/3829207895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba4133cd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.283+0000 7faba917d700 1 -- 172.21.15.154:0/3829207895 >> 172.21.15.154:0/3829207895 conn(0x7faba40a2980 msgr2=0x7faba40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.283+0000 7faba917d700 1 -- 172.21.15.154:0/3829207895 shutdown_connections 2023-09-30T22:22:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.283+0000 7faba917d700 1 -- 172.21.15.154:0/3829207895 wait complete. 2023-09-30T22:22:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.284+0000 7faba917d700 1 Processor -- start 2023-09-30T22:22:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.284+0000 7faba917d700 1 -- start start 2023-09-30T22:22:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba917d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba40a10b0 0x7faba411c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba917d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba411cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba917d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4134210 0x7faba411d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba917d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba41200d0 con 0x7faba4134210 2023-09-30T22:22:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba917d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba412fbe0 con 0x7faba40a10b0 2023-09-30T22:22:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba917d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faba411f650 con 0x7faba4133900 2023-09-30T22:22:24.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba40a10b0 0x7faba411c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba411cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba40a10b0 0x7faba411c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37422/0 (socket says 172.21.15.154:37422) 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba2d9d700 1 -- 172.21.15.154:0/2075858818 learned_addr learned my addr 172.21.15.154:0/2075858818 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba411cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45178/0 (socket says 172.21.15.154:45178) 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.285+0000 7faba359e700 1 --2- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4134210 0x7faba411d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7faba359e700 1 -- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 msgr2=0x7faba411cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7faba359e700 1 --2- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba411cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7faba359e700 1 -- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba40a10b0 msgr2=0x7faba411c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7faba359e700 1 --2- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba40a10b0 0x7faba411c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7faba359e700 1 -- 172.21.15.154:0/2075858818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94009500 con 0x7faba4134210 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7faba2d9d700 1 --2- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba40a10b0 0x7faba411c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7faba359e700 1 --2- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4134210 0x7faba411d2c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00b700 tx=0x7fab9c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7fab8b7fe700 1 -- 172.21.15.154:0/2075858818 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c019070 con 0x7faba4134210 2023-09-30T22:22:24.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7fab8b7fe700 1 -- 172.21.15.154:0/2075858818 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c00be70 con 0x7faba4134210 2023-09-30T22:22:24.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba411e9e0 con 0x7faba4134210 2023-09-30T22:22:24.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7fab8b7fe700 1 -- 172.21.15.154:0/2075858818 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c007740 con 0x7faba4134210 2023-09-30T22:22:24.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.286+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba409a2c0 con 0x7faba4134210 2023-09-30T22:22:24.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.287+0000 7fab8b7fe700 1 -- 172.21.15.154:0/2075858818 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fab9c0078a0 con 0x7faba4134210 2023-09-30T22:22:24.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.287+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba404f2a0 con 0x7faba4134210 2023-09-30T22:22:24.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.288+0000 7faba2d9d700 1 -- 172.21.15.154:0/2075858818 >> v1:172.21.15.154:6816/126757 conn(0x7fab9002f510 legacy=0x7fab900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:24.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.288+0000 7fab8b7fe700 1 -- 172.21.15.154:0/2075858818 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fab9c047ea0 con 0x7faba4134210 2023-09-30T22:22:24.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.296+0000 7fab8b7fe700 1 -- 172.21.15.154:0/2075858818 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab9c0246d0 con 0x7faba4134210 2023-09-30T22:22:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.321+0000 7f2e6338d700 1 Processor -- start 2023-09-30T22:22:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.321+0000 7f2e6338d700 1 -- start start 2023-09-30T22:22:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e6338d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e6338d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e5c130bc0 0x7f2e5c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e6338d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c06b2d0 con 0x7f2e5c1300a0 2023-09-30T22:22:24.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e6338d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c133610 con 0x7f2e5c130bc0 2023-09-30T22:22:24.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e6338d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c09a500 con 0x7f2e5c133ad0 2023-09-30T22:22:24.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f1c0b927700 1 Processor -- start 2023-09-30T22:22:24.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e6192a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e5c130bc0 0x7f2e5c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e6192a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e5c130bc0 0x7f2e5c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44390/0 (socket says 172.21.15.154:44390) 2023-09-30T22:22:24.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e60928700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2e5c1300a0 0x7f2e5c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50396/0 (socket says 172.21.15.154:50396) 2023-09-30T22:22:24.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e6192a700 1 -- 172.21.15.154:0/3645259917 learned_addr learned my addr 172.21.15.154:0/3645259917 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:24.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e61129700 1 --2- 172.21.15.154:0/3645259917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f1c0b927700 1 -- start start 2023-09-30T22:22:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e61129700 1 -- 172.21.15.154:0/3645259917 >> v2:172.21.15.154:3300/0 conn(0x7f2e5c130bc0 msgr2=0x7f2e5c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e61129700 1 --2- 172.21.15.154:0/3645259917 >> v2:172.21.15.154:3300/0 conn(0x7f2e5c130bc0 0x7f2e5c13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e61129700 1 -- 172.21.15.154:0/3645259917 >> v1:172.21.15.154:6789/0 conn(0x7f2e5c1300a0 legacy=0x7f2e5c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e61129700 1 -- 172.21.15.154:0/3645259917 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c1338b0 con 0x7f2e5c133ad0 2023-09-30T22:22:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e6192a700 1 --2- 172.21.15.154:0/3645259917 >> v2:172.21.15.154:3300/0 conn(0x7f2e5c130bc0 0x7f2e5c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.322+0000 7f2e61129700 1 --2- 172.21.15.154:0/3645259917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c133ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009840 tx=0x7f2e58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92d748ae9c6eb01b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f2e53fff700 1 -- 172.21.15.154:0/3645259917 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58011830 con 0x7f2e5c133ad0 2023-09-30T22:22:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f2e53fff700 1 -- 172.21.15.154:0/3645259917 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58011990 con 0x7f2e5c133ad0 2023-09-30T22:22:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f2e53fff700 1 -- 172.21.15.154:0/3645259917 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58011d20 con 0x7f2e5c133ad0 2023-09-30T22:22:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c0b927700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c04131980 0x7f1c04131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c0b927700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c0409bc70 0x7f1c0409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c0b927700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 0x7f1c04138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c0b927700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0406eb30 con 0x7f1c0409bc70 2023-09-30T22:22:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c0b927700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040a1640 con 0x7f1c0409c5c0 2023-09-30T22:22:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c0b927700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040a22d0 con 0x7f1c04131980 2023-09-30T22:22:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c096c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c04131980 0x7f1c04131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c096c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c04131980 0x7f1c04131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45180/0 (socket says 172.21.15.154:45180) 2023-09-30T22:22:24.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c096c3700 1 -- 172.21.15.154:0/979110633 learned_addr learned my addr 172.21.15.154:0/979110633 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:24.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c08ec2700 1 --2- 172.21.15.154:0/979110633 >> v2:172.21.15.154:3300/0 conn(0x7f1c0409bc70 0x7f1c0409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c09ec4700 1 --2- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 0x7f1c04138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c08ec2700 1 -- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c04131980 msgr2=0x7f1c04131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:24.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c08ec2700 1 --2- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c04131980 0x7f1c04131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c08ec2700 1 -- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 msgr2=0x7f1c04138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:24.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c08ec2700 1 --2- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 0x7f1c04138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.323+0000 7f1c08ec2700 1 -- 172.21.15.154:0/979110633 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c04131550 con 0x7f1c0409bc70 2023-09-30T22:22:24.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f2e6338d700 1 -- 172.21.15.154:0/3645259917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 msgr2=0x7f2e5c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f2e6338d700 1 --2- 172.21.15.154:0/3645259917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c133ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009840 tx=0x7f2e58009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:24.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f2e6338d700 1 -- 172.21.15.154:0/3645259917 shutdown_connections 2023-09-30T22:22:24.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f2e6338d700 1 --2- 172.21.15.154:0/3645259917 >> v2:172.21.15.154:3300/0 conn(0x7f2e5c130bc0 0x7f2e5c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f2e6338d700 1 --2- 172.21.15.154:0/3645259917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c133ea0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f2e6338d700 1 -- 172.21.15.154:0/3645259917 >> 172.21.15.154:0/3645259917 conn(0x7f2e5c099c40 msgr2=0x7f2e5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f1c08ec2700 1 --2- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0409bc70 0x7f1c0409c080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009870 tx=0x7f1c00009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac183d6a27c76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f2e6338d700 1 -- 172.21.15.154:0/3645259917 shutdown_connections 2023-09-30T22:22:24.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f2e6338d700 1 -- 172.21.15.154:0/3645259917 wait complete. 2023-09-30T22:22:24.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f1bfbfff700 1 -- 172.21.15.154:0/979110633 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011830 con 0x7f1c0409bc70 2023-09-30T22:22:24.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f1bfbfff700 1 -- 172.21.15.154:0/979110633 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c00011990 con 0x7f1c0409bc70 2023-09-30T22:22:24.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.324+0000 7f1bfbfff700 1 -- 172.21.15.154:0/979110633 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011d20 con 0x7f1c0409bc70 2023-09-30T22:22:24.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.325+0000 7f1c0b927700 1 -- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0409bc70 msgr2=0x7f1c0409c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.325+0000 7f1c0b927700 1 --2- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0409bc70 0x7f1c0409c080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009870 tx=0x7f1c00009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:24.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.325+0000 7f1c0b927700 1 -- 172.21.15.154:0/979110633 shutdown_connections 2023-09-30T22:22:24.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.325+0000 7f1c0b927700 1 --2- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 0x7f1c04138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.325+0000 7f1c0b927700 1 --2- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c04131980 0x7f1c04131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.325+0000 7f1c0b927700 1 --2- 172.21.15.154:0/979110633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0409bc70 0x7f1c0409c080 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.325+0000 7f1c0b927700 1 -- 172.21.15.154:0/979110633 >> 172.21.15.154:0/979110633 conn(0x7f1c040a2980 msgr2=0x7f1c040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.325+0000 7f2e6338d700 1 Processor -- start 2023-09-30T22:22:24.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.325+0000 7f2e6338d700 1 -- start start 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6338d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c1300a0 0x7f2e5c1c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6338d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130bc0 0x7f2e5c1c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6338d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c1c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6338d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c120bb0 con 0x7f2e5c130bc0 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6338d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c1201b0 con 0x7f2e5c133ad0 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6338d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c072160 con 0x7f2e5c1300a0 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e61129700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c1300a0 0x7f2e5c1c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e61129700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c1300a0 0x7f2e5c1c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45190/0 (socket says 172.21.15.154:45190) 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e61129700 1 -- 172.21.15.154:0/1102457671 learned_addr learned my addr 172.21.15.154:0/1102457671 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e60928700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130bc0 0x7f2e5c1c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6192a700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c1c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f1c0b927700 1 -- 172.21.15.154:0/979110633 shutdown_connections 2023-09-30T22:22:24.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6192a700 1 -- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c1300a0 msgr2=0x7f2e5c1c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6192a700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c1300a0 0x7f2e5c1c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6192a700 1 -- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130bc0 msgr2=0x7f2e5c1c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6192a700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130bc0 0x7f2e5c1c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6192a700 1 -- 172.21.15.154:0/1102457671 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54009b30 con 0x7f2e5c133ad0 2023-09-30T22:22:24.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e60928700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130bc0 0x7f2e5c1c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:24.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f2e6192a700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c1c91d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009e50 tx=0x7f2e5400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.326+0000 7f1c0b927700 1 -- 172.21.15.154:0/979110633 wait complete. 2023-09-30T22:22:24.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.328+0000 7f1c0b927700 1 Processor -- start 2023-09-30T22:22:24.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.328+0000 7f1c0b927700 1 -- start start 2023-09-30T22:22:24.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c0b927700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0409bc70 0x7f1c04099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c0b927700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 0x7f1c04099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c0b927700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c04131980 0x7f1c0409a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c0b927700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0409b890 con 0x7f1c04131980 2023-09-30T22:22:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c0b927700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0409b6a0 con 0x7f1c0409c5c0 2023-09-30T22:22:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c0b927700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c041222d0 con 0x7f1c0409bc70 2023-09-30T22:22:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c08ec2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 0x7f1c04099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c096c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0409bc70 0x7f1c04099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c08ec2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 0x7f1c04099fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37462/0 (socket says 172.21.15.154:37462) 2023-09-30T22:22:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c096c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0409bc70 0x7f1c04099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45204/0 (socket says 172.21.15.154:45204) 2023-09-30T22:22:24.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c08ec2700 1 -- 172.21.15.154:0/3772043674 learned_addr learned my addr 172.21.15.154:0/3772043674 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:24.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f2e51ffb700 1 -- 172.21.15.154:0/1102457671 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54018070 con 0x7f2e5c133ad0 2023-09-30T22:22:24.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f2e51ffb700 1 -- 172.21.15.154:0/1102457671 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400f040 con 0x7f2e5c133ad0 2023-09-30T22:22:24.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f2e51ffb700 1 -- 172.21.15.154:0/1102457671 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54003c60 con 0x7f2e5c133ad0 2023-09-30T22:22:24.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c09ec4700 1 --2- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c04131980 0x7f1c0409a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c096c3700 1 -- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 msgr2=0x7f1c04099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c096c3700 1 --2- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 0x7f1c04099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c096c3700 1 -- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c04131980 msgr2=0x7f1c0409a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c096c3700 1 --2- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c04131980 0x7f1c0409a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c096c3700 1 -- 172.21.15.154:0/3772043674 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c000094a0 con 0x7f1c0409bc70 2023-09-30T22:22:24.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c09ec4700 1 --2- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c04131980 0x7f1c0409a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:24.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1c096c3700 1 --2- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0409bc70 0x7f1c04099a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006fd0 tx=0x7f1bf400eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f1bf9ffb700 1 -- 172.21.15.154:0/3772043674 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4013680 con 0x7f1c0409bc70 2023-09-30T22:22:24.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.329+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e580094a0 con 0x7f2e5c133ad0 2023-09-30T22:22:24.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.330+0000 7f1bf9ffb700 1 -- 172.21.15.154:0/3772043674 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf40137e0 con 0x7f1c0409bc70 2023-09-30T22:22:24.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.330+0000 7f1bf9ffb700 1 -- 172.21.15.154:0/3772043674 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4013b50 con 0x7f1c0409bc70 2023-09-30T22:22:24.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.330+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c11fed0 con 0x7f2e5c133ad0 2023-09-30T22:22:24.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.330+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c04130f80 con 0x7f1c0409bc70 2023-09-30T22:22:24.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.330+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c04123630 con 0x7f1c0409bc70 2023-09-30T22:22:24.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.331+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c04f2a0 con 0x7f2e5c133ad0 2023-09-30T22:22:24.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.331+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0404f2a0 con 0x7f1c0409bc70 2023-09-30T22:22:24.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.331+0000 7f1bf9ffb700 1 -- 172.21.15.154:0/3772043674 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1bf4013cb0 con 0x7f1c0409bc70 2023-09-30T22:22:24.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.332+0000 7f1bf9ffb700 1 -- 172.21.15.154:0/3772043674 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1bf403ffa0 con 0x7f1c0409bc70 2023-09-30T22:22:24.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.332+0000 7f1c08ec2700 1 -- 172.21.15.154:0/3772043674 >> v1:172.21.15.154:6816/126757 conn(0x7f1be802f510 legacy=0x7f1be80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.332+0000 7f2e51ffb700 1 -- 172.21.15.154:0/1102457671 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2e5400c880 con 0x7f2e5c133ad0 2023-09-30T22:22:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.332+0000 7f2e51ffb700 1 -- 172.21.15.154:0/1102457671 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2e5403fe40 con 0x7f2e5c133ad0 2023-09-30T22:22:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.333+0000 7f2e61129700 1 -- 172.21.15.154:0/1102457671 >> v1:172.21.15.154:6816/126757 conn(0x7f2e4002f560 legacy=0x7f2e40031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.337+0000 7f1bf9ffb700 1 -- 172.21.15.154:0/3772043674 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bf4011bd0 con 0x7f1c0409bc70 2023-09-30T22:22:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.337+0000 7f2e51ffb700 1 -- 172.21.15.154:0/1102457671 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e5401cd50 con 0x7f2e5c133ad0 2023-09-30T22:22:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa9498f5700 1 Processor -- start 2023-09-30T22:22:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa9498f5700 1 -- start start 2023-09-30T22:22:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa9498f5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa94406a770 0x7fa94406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa9498f5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa94406b080 0x7fa9441317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa9498f5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94409da80 con 0x7fa944131cf0 2023-09-30T22:22:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa9498f5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94409dce0 con 0x7fa94406a770 2023-09-30T22:22:24.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa9498f5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94409eb20 con 0x7fa94406b080 2023-09-30T22:22:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa942ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa94406a770 0x7fa94406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa9437fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa944131cf0 0x7fa944138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50406/0 (socket says 172.21.15.154:50406) 2023-09-30T22:22:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.380+0000 7fa9437fe700 1 -- 172.21.15.154:0/2975320708 learned_addr learned my addr 172.21.15.154:0/2975320708 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.381+0000 7fa942ffd700 1 -- 172.21.15.154:0/2975320708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa94406b080 msgr2=0x7fa9441317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.381+0000 7fa942ffd700 1 --2- 172.21.15.154:0/2975320708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa94406b080 0x7fa9441317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.381+0000 7fa942ffd700 1 -- 172.21.15.154:0/2975320708 >> v1:172.21.15.154:6789/0 conn(0x7fa944131cf0 legacy=0x7fa944138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.381+0000 7fa942ffd700 1 -- 172.21.15.154:0/2975320708 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94409d860 con 0x7fa94406a770 2023-09-30T22:22:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.381+0000 7fa942ffd700 1 --2- 172.21.15.154:0/2975320708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406a770 0x7fa94406ab40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa934009840 tx=0x7fa934009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558b3770f79e3802 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.381+0000 7fa941ffb700 1 -- 172.21.15.154:0/2975320708 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934004230 con 0x7fa94406a770 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.381+0000 7fa941ffb700 1 -- 172.21.15.154:0/2975320708 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934004390 con 0x7fa94406a770 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.381+0000 7fa941ffb700 1 -- 172.21.15.154:0/2975320708 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340036a0 con 0x7fa94406a770 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.382+0000 7fa9498f5700 1 -- 172.21.15.154:0/2975320708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406a770 msgr2=0x7fa94406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.382+0000 7fa9498f5700 1 --2- 172.21.15.154:0/2975320708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406a770 0x7fa94406ab40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa934009840 tx=0x7fa934009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.382+0000 7fa9498f5700 1 -- 172.21.15.154:0/2975320708 shutdown_connections 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.382+0000 7fa9498f5700 1 --2- 172.21.15.154:0/2975320708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406a770 0x7fa94406ab40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.382+0000 7fa9498f5700 1 --2- 172.21.15.154:0/2975320708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa94406b080 0x7fa9441317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.382+0000 7fa9498f5700 1 -- 172.21.15.154:0/2975320708 >> 172.21.15.154:0/2975320708 conn(0x7fa944099c40 msgr2=0x7fa9440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.382+0000 7fa9498f5700 1 -- 172.21.15.154:0/2975320708 shutdown_connections 2023-09-30T22:22:24.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.382+0000 7fa9498f5700 1 -- 172.21.15.154:0/2975320708 wait complete. 2023-09-30T22:22:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.383+0000 7fa9498f5700 1 Processor -- start 2023-09-30T22:22:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.383+0000 7fa9498f5700 1 -- start start 2023-09-30T22:22:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9498f5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa94406a770 0x7fa9441c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9498f5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406b080 0x7fa9441c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9498f5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa944131cf0 0x7fa9441c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9498f5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94409c2e0 con 0x7fa94406b080 2023-09-30T22:22:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9498f5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9441205b0 con 0x7fa94406a770 2023-09-30T22:22:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9498f5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa944120fa0 con 0x7fa944131cf0 2023-09-30T22:22:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406b080 0x7fa9441c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9437fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa944131cf0 0x7fa9441c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406b080 0x7fa9441c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44422/0 (socket says 172.21.15.154:44422) 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.384+0000 7fa9427fc700 1 -- 172.21.15.154:0/4011101198 learned_addr learned my addr 172.21.15.154:0/4011101198 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa942ffd700 1 --2- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa94406a770 0x7fa9441c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa9437fe700 1 -- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa94406a770 msgr2=0x7fa9441c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa9437fe700 1 --2- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa94406a770 0x7fa9441c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa9437fe700 1 -- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406b080 msgr2=0x7fa9441c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa9437fe700 1 --2- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406b080 0x7fa9441c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa9437fe700 1 -- 172.21.15.154:0/4011101198 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340094a0 con 0x7fa944131cf0 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa942ffd700 1 --2- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa94406a770 0x7fa9441c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa9437fe700 1 --2- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa944131cf0 0x7fa9441c8d30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0146a0 tx=0x7fa93c0149b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa92bfff700 1 -- 172.21.15.154:0/4011101198 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c017070 con 0x7fa944131cf0 2023-09-30T22:22:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa92bfff700 1 -- 172.21.15.154:0/4011101198 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c012320 con 0x7fa944131cf0 2023-09-30T22:22:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa944071e10 con 0x7fa944131cf0 2023-09-30T22:22:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa92bfff700 1 -- 172.21.15.154:0/4011101198 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c0126d0 con 0x7fa944131cf0 2023-09-30T22:22:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.385+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9441215b0 con 0x7fa944131cf0 2023-09-30T22:22:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.386+0000 7fa92bfff700 1 -- 172.21.15.154:0/4011101198 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa93c010850 con 0x7fa944131cf0 2023-09-30T22:22:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.386+0000 7fa92bfff700 1 -- 172.21.15.154:0/4011101198 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa93c048760 con 0x7fa944131cf0 2023-09-30T22:22:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.386+0000 7fa942ffd700 1 -- 172.21.15.154:0/4011101198 >> v1:172.21.15.154:6816/126757 conn(0x7fa93002f510 legacy=0x7fa9300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.387+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94404f2a0 con 0x7fa944131cf0 2023-09-30T22:22:24.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.396+0000 7fa92bfff700 1 -- 172.21.15.154:0/4011101198 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa93c01b330 con 0x7fa944131cf0 2023-09-30T22:22:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.489+0000 7faba2d9d700 1 -- 172.21.15.154:0/2075858818 >> v1:172.21.15.154:6816/126757 conn(0x7fab9002f510 legacy=0x7fab900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:24.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.500+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faba406bce0 con 0x7faba4134210 2023-09-30T22:22:24.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.500+0000 7fab8b7fe700 1 -- 172.21.15.154:0/2075858818 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab9c022030 con 0x7faba4134210 2023-09-30T22:22:24.500 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:24.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 >> v1:172.21.15.154:6816/126757 conn(0x7fab9002f510 legacy=0x7fab900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:24.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4134210 msgr2=0x7faba411d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 --2- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4134210 0x7faba411d2c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00b700 tx=0x7fab9c00ba10 comp rx=0 tx=0).stop 2023-09-30T22:22:24.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 shutdown_connections 2023-09-30T22:22:24.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 --2- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faba4134210 0x7faba411d2c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 --2- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba40a10b0 0x7faba411c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 --2- 172.21.15.154:0/2075858818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faba4133900 0x7faba411cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 >> 172.21.15.154:0/2075858818 conn(0x7faba40a2980 msgr2=0x7faba41baf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 shutdown_connections 2023-09-30T22:22:24.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.502+0000 7faba917d700 1 -- 172.21.15.154:0/2075858818 wait complete. 2023-09-30T22:22:24.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.533+0000 7f1c08ec2700 1 -- 172.21.15.154:0/3772043674 >> v1:172.21.15.154:6816/126757 conn(0x7f1be802f510 legacy=0x7f1be80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:24.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.534+0000 7f2e61129700 1 -- 172.21.15.154:0/1102457671 >> v1:172.21.15.154:6816/126757 conn(0x7f2e4002f560 legacy=0x7f2e40031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:24.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.537+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e5c06c3b0 con 0x7f2e5c133ad0 2023-09-30T22:22:24.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.537+0000 7f2e51ffb700 1 -- 172.21.15.154:0/1102457671 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e5401cb70 con 0x7f2e5c133ad0 2023-09-30T22:22:24.537 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:24.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 >> v1:172.21.15.154:6816/126757 conn(0x7f2e4002f560 legacy=0x7f2e40031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:24.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 msgr2=0x7f2e5c1c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c1c91d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009e50 tx=0x7f2e5400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 shutdown_connections 2023-09-30T22:22:24.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c133ad0 0x7f2e5c1c91d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c1300a0 0x7f2e5c1c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 --2- 172.21.15.154:0/1102457671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130bc0 0x7f2e5c1c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 >> 172.21.15.154:0/1102457671 conn(0x7f2e5c099c40 msgr2=0x7f2e5c12e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 shutdown_connections 2023-09-30T22:22:24.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.539+0000 7f2e6338d700 1 -- 172.21.15.154:0/1102457671 wait complete. 2023-09-30T22:22:24.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:24.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.559+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c04123820 con 0x7f1c0409bc70 2023-09-30T22:22:24.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.559+0000 7f1bf9ffb700 1 -- 172.21.15.154:0/3772043674 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bf4021020 con 0x7f1c0409bc70 2023-09-30T22:22:24.560 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:24.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 >> v1:172.21.15.154:6816/126757 conn(0x7f1be802f510 legacy=0x7f1be80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:24.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0409bc70 msgr2=0x7f1c04099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 --2- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0409bc70 0x7f1c04099a90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006fd0 tx=0x7f1bf400eb00 comp rx=0 tx=0).stop 2023-09-30T22:22:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 shutdown_connections 2023-09-30T22:22:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 --2- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c04131980 0x7f1c0409a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 --2- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0409bc70 0x7f1c04099a90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 --2- 172.21.15.154:0/3772043674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0409c5c0 0x7f1c04099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 >> 172.21.15.154:0/3772043674 conn(0x7f1c040a2980 msgr2=0x7f1c0406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 shutdown_connections 2023-09-30T22:22:24.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.562+0000 7f1c0b927700 1 -- 172.21.15.154:0/3772043674 wait complete. 2023-09-30T22:22:24.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:24.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.587+0000 7fa942ffd700 1 -- 172.21.15.154:0/4011101198 >> v1:172.21.15.154:6816/126757 conn(0x7fa93002f510 legacy=0x7fa9300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.595+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa94406c3b0 con 0x7fa944131cf0 2023-09-30T22:22:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.595+0000 7fa92bfff700 1 -- 172.21.15.154:0/4011101198 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa93c02c030 con 0x7fa944131cf0 2023-09-30T22:22:24.595 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 >> v1:172.21.15.154:6816/126757 conn(0x7fa93002f510 legacy=0x7fa9300319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa944131cf0 msgr2=0x7fa9441c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 --2- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa944131cf0 0x7fa9441c8d30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0146a0 tx=0x7fa93c0149b0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 shutdown_connections 2023-09-30T22:22:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 --2- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa944131cf0 0x7fa9441c8d30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 --2- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa94406a770 0x7fa9441c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 --2- 172.21.15.154:0/4011101198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa94406b080 0x7fa9441c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 >> 172.21.15.154:0/4011101198 conn(0x7fa944099c40 msgr2=0x7fa9440a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 shutdown_connections 2023-09-30T22:22:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:24.597+0000 7fa9498f5700 1 -- 172.21.15.154:0/4011101198 wait complete. 2023-09-30T22:22:24.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:25.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:25.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:25.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:25.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:25.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.659+0000 7f8d568cb700 1 Processor -- start 2023-09-30T22:22:25.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.659+0000 7f8d568cb700 1 -- start start 2023-09-30T22:22:25.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.659+0000 7f8d568cb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d50138040 0x7f8d50138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.659+0000 7f8d568cb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d500a08e0 0x7f8d500a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.659+0000 7f8d568cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d5013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.659+0000 7f8d568cb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d500a2100 con 0x7f8d500a08e0 2023-09-30T22:22:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.659+0000 7f8d568cb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50138950 con 0x7f8d50138040 2023-09-30T22:22:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.659+0000 7f8d568cb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d501379e0 con 0x7f8d500a1230 2023-09-30T22:22:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d54e68700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d5013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d54e68700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d5013ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40714/0 (socket says 172.21.15.154:40714) 2023-09-30T22:22:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d50138040 0x7f8d50138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d54e68700 1 -- 172.21.15.154:0/3210155831 learned_addr learned my addr 172.21.15.154:0/3210155831 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4f7fe700 1 --2- 172.21.15.154:0/3210155831 >> v2:172.21.15.154:3300/0 conn(0x7f8d500a08e0 0x7f8d500a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4f7fe700 1 -- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 msgr2=0x7f8d5013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4f7fe700 1 --2- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d5013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4f7fe700 1 -- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d50138040 msgr2=0x7f8d50138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4f7fe700 1 --2- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d50138040 0x7f8d50138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4f7fe700 1 -- 172.21.15.154:0/3210155831 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5009b9b0 con 0x7f8d500a08e0 2023-09-30T22:22:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d54e68700 1 --2- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d5013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4ffff700 1 --2- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d50138040 0x7f8d50138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4f7fe700 1 --2- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d500a08e0 0x7f8d500a0cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009870 tx=0x7f8d44009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75b064bf48b6ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.660+0000 7f8d4effd700 1 -- 172.21.15.154:0/3210155831 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44011830 con 0x7f8d500a08e0 2023-09-30T22:22:25.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.661+0000 7f8d4effd700 1 -- 172.21.15.154:0/3210155831 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d44011990 con 0x7f8d500a08e0 2023-09-30T22:22:25.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.661+0000 7f8d4effd700 1 -- 172.21.15.154:0/3210155831 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44011d20 con 0x7f8d500a08e0 2023-09-30T22:22:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.661+0000 7f8d568cb700 1 -- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d500a08e0 msgr2=0x7f8d500a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.661+0000 7f8d568cb700 1 --2- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d500a08e0 0x7f8d500a0cf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009870 tx=0x7f8d44009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.662+0000 7f8d568cb700 1 -- 172.21.15.154:0/3210155831 shutdown_connections 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.662+0000 7f8d568cb700 1 --2- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d50138040 0x7f8d50138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.662+0000 7f8d568cb700 1 --2- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d5013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.662+0000 7f8d568cb700 1 --2- 172.21.15.154:0/3210155831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d500a08e0 0x7f8d500a0cf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.662+0000 7f8d568cb700 1 -- 172.21.15.154:0/3210155831 >> 172.21.15.154:0/3210155831 conn(0x7f8d500a2980 msgr2=0x7f8d500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.662+0000 7f8d568cb700 1 -- 172.21.15.154:0/3210155831 shutdown_connections 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.662+0000 7f8d568cb700 1 -- 172.21.15.154:0/3210155831 wait complete. 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.663+0000 7f8d568cb700 1 Processor -- start 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.663+0000 7f8d568cb700 1 -- start start 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.663+0000 7f8d568cb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d500a08e0 0x7f8d50118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.663+0000 7f8d568cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d50119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.663+0000 7f8d568cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d50138040 0x7f8d50119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d568cb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5011a260 con 0x7f8d50138040 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d568cb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5011b0b0 con 0x7f8d500a08e0 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d568cb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5013e2d0 con 0x7f8d500a1230 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d50119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d54e68700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d50138040 0x7f8d50119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d50119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40730/0 (socket says 172.21.15.154:40730) 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4f7fe700 1 -- 172.21.15.154:0/1433147032 learned_addr learned my addr 172.21.15.154:0/1433147032 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4ffff700 1 --2- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d500a08e0 0x7f8d50118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4f7fe700 1 -- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d500a08e0 msgr2=0x7f8d50118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4f7fe700 1 --2- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d500a08e0 0x7f8d50118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4f7fe700 1 -- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d50138040 msgr2=0x7f8d50119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4f7fe700 1 --2- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d50138040 0x7f8d50119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4f7fe700 1 -- 172.21.15.154:0/1433147032 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d48009b30 con 0x7f8d500a1230 2023-09-30T22:22:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4ffff700 1 --2- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d500a08e0 0x7f8d50118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4f7fe700 1 --2- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d50119330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d44014040 tx=0x7f8d44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.664+0000 7f8d4cff9700 1 -- 172.21.15.154:0/1433147032 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44004510 con 0x7f8d500a1230 2023-09-30T22:22:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.665+0000 7f8d4cff9700 1 -- 172.21.15.154:0/1433147032 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4401e070 con 0x7f8d500a1230 2023-09-30T22:22:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.665+0000 7f8d4cff9700 1 -- 172.21.15.154:0/1433147032 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440038c0 con 0x7f8d500a1230 2023-09-30T22:22:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.665+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d40009430 con 0x7f8d500a1230 2023-09-30T22:22:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.665+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d440094a0 con 0x7f8d500a1230 2023-09-30T22:22:25.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.666+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5004f2a0 con 0x7f8d500a1230 2023-09-30T22:22:25.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.666+0000 7f8d4cff9700 1 -- 172.21.15.154:0/1433147032 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8d44003a20 con 0x7f8d500a1230 2023-09-30T22:22:25.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.666+0000 7f8d4cff9700 1 -- 172.21.15.154:0/1433147032 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8d44020070 con 0x7f8d500a1230 2023-09-30T22:22:25.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.666+0000 7f8d4ffff700 1 -- 172.21.15.154:0/1433147032 >> v1:172.21.15.154:6816/126757 conn(0x7f8d3c02f510 legacy=0x7f8d3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.675+0000 7f8d4cff9700 1 -- 172.21.15.154:0/1433147032 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d4401a420 con 0x7f8d500a1230 2023-09-30T22:22:25.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.696+0000 7f1bbd015700 1 Processor -- start 2023-09-30T22:22:25.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.696+0000 7f1bbd015700 1 -- start start 2023-09-30T22:22:25.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.696+0000 7f1bbd015700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb80a1510 0x7f1bb81351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.696+0000 7f1bbd015700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bb81356e0 0x7f1bb8137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.696+0000 7f1bbd015700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb80a1e70 con 0x7f1bb80a0a30 2023-09-30T22:22:25.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.696+0000 7f1bbd015700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb809a720 con 0x7f1bb81356e0 2023-09-30T22:22:25.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.696+0000 7f1bbd015700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb809b300 con 0x7f1bb80a1510 2023-09-30T22:22:25.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb80a1510 0x7f1bb81351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb80a1510 0x7f1bb81351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43600/0 (socket says 172.21.15.154:43600) 2023-09-30T22:22:25.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb759e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bb81356e0 0x7f1bb8137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb659c700 1 -- 172.21.15.154:0/1994583171 learned_addr learned my addr 172.21.15.154:0/1994583171 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:25.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb659c700 1 -- 172.21.15.154:0/1994583171 >> v2:172.21.15.154:3300/0 conn(0x7f1bb81356e0 msgr2=0x7f1bb8137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb659c700 1 --2- 172.21.15.154:0/1994583171 >> v2:172.21.15.154:3300/0 conn(0x7f1bb81356e0 0x7f1bb8137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb659c700 1 -- 172.21.15.154:0/1994583171 >> v1:172.21.15.154:6789/0 conn(0x7f1bb80a0a30 legacy=0x7f1bb80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb5d9b700 1 -- 172.21.15.154:0/1994583171 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202474620 0 0) 0x7f1bb80a1e70 con 0x7f1bb80a0a30 2023-09-30T22:22:25.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb659c700 1 -- 172.21.15.154:0/1994583171 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb809abc0 con 0x7f1bb80a1510 2023-09-30T22:22:25.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb659c700 1 --2- 172.21.15.154:0/1994583171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb80a1510 0x7f1bb81351a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00aa90 tx=0x7f1bac00ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b72abbabd07c9de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb5d9b700 1 -- 172.21.15.154:0/1994583171 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00cb70 con 0x7f1bb80a1510 2023-09-30T22:22:25.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb5d9b700 1 -- 172.21.15.154:0/1994583171 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac00ccd0 con 0x7f1bb80a1510 2023-09-30T22:22:25.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.697+0000 7f1bb5d9b700 1 -- 172.21.15.154:0/1994583171 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac018620 con 0x7f1bb80a1510 2023-09-30T22:22:25.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.698+0000 7f1bbd015700 1 -- 172.21.15.154:0/1994583171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb80a1510 msgr2=0x7f1bb81351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.698+0000 7f1bbd015700 1 --2- 172.21.15.154:0/1994583171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb80a1510 0x7f1bb81351a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00aa90 tx=0x7f1bac00ada0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.698+0000 7f1bbd015700 1 -- 172.21.15.154:0/1994583171 shutdown_connections 2023-09-30T22:22:25.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.698+0000 7f1bbd015700 1 --2- 172.21.15.154:0/1994583171 >> v2:172.21.15.154:3300/0 conn(0x7f1bb81356e0 0x7f1bb8137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.698+0000 7f1bbd015700 1 --2- 172.21.15.154:0/1994583171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb80a1510 0x7f1bb81351a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.698+0000 7f1bbd015700 1 -- 172.21.15.154:0/1994583171 >> 172.21.15.154:0/1994583171 conn(0x7f1bb80a2980 msgr2=0x7f1bb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.698+0000 7f1bbd015700 1 -- 172.21.15.154:0/1994583171 shutdown_connections 2023-09-30T22:22:25.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.698+0000 7f1bbd015700 1 -- 172.21.15.154:0/1994583171 wait complete. 2023-09-30T22:22:25.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.700+0000 7f1bbd015700 1 Processor -- start 2023-09-30T22:22:25.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.700+0000 7f1bbd015700 1 -- start start 2023-09-30T22:22:25.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bbd015700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb80a0a30 0x7f1bb806f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bbd015700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bb80a1510 0x7f1bb806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bbd015700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb81356e0 0x7f1bb806ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bbd015700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb8071060 con 0x7f1bb80a0a30 2023-09-30T22:22:25.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bbd015700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb8132ae0 con 0x7f1bb81356e0 2023-09-30T22:22:25.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bbd015700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb809ae00 con 0x7f1bb80a1510 2023-09-30T22:22:25.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bb759e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb81356e0 0x7f1bb806ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bb759e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb81356e0 0x7f1bb806ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43610/0 (socket says 172.21.15.154:43610) 2023-09-30T22:22:25.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bb759e700 1 -- 172.21.15.154:0/3892616339 learned_addr learned my addr 172.21.15.154:0/3892616339 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bb659c700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bb80a1510 0x7f1bb806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.701+0000 7f1bb6d9d700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb80a0a30 0x7f1bb806f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1bb659c700 1 -- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb81356e0 msgr2=0x7f1bb806ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1bb659c700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb81356e0 0x7f1bb806ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1bb659c700 1 -- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb80a0a30 msgr2=0x7f1bb806f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1bb659c700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb80a0a30 0x7f1bb806f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1bb659c700 1 -- 172.21.15.154:0/3892616339 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac00a6f0 con 0x7f1bb80a1510 2023-09-30T22:22:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1bb6d9d700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb80a0a30 0x7f1bb806f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1bb659c700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bb80a1510 0x7f1bb806f9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1bac017000 tx=0x7f1bac0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1b9f7fe700 1 -- 172.21.15.154:0/3892616339 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac003ab0 con 0x7f1bb80a1510 2023-09-30T22:22:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1b9f7fe700 1 -- 172.21.15.154:0/3892616339 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac003c10 con 0x7f1bb80a1510 2023-09-30T22:22:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb8132ea0 con 0x7f1bb80a1510 2023-09-30T22:22:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1b9f7fe700 1 -- 172.21.15.154:0/3892616339 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac028400 con 0x7f1bb80a1510 2023-09-30T22:22:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.702+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb8129cb0 con 0x7f1bb80a1510 2023-09-30T22:22:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.703+0000 7f1b9f7fe700 1 -- 172.21.15.154:0/3892616339 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1bac0103f0 con 0x7f1bb80a1510 2023-09-30T22:22:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.703+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb81330d0 con 0x7f1bb80a1510 2023-09-30T22:22:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.703+0000 7f1bb6d9d700 1 -- 172.21.15.154:0/3892616339 >> v1:172.21.15.154:6816/126757 conn(0x7f1ba402f510 legacy=0x7f1ba40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.703+0000 7f1b9f7fe700 1 -- 172.21.15.154:0/3892616339 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1bac0498a0 con 0x7f1bb80a1510 2023-09-30T22:22:25.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.712+0000 7f1b9f7fe700 1 -- 172.21.15.154:0/3892616339 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bb81330d0 con 0x7f1bb80a1510 2023-09-30T22:22:25.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.744+0000 7fd3dfd12700 1 Processor -- start 2023-09-30T22:22:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3dfd12700 1 -- start start 2023-09-30T22:22:25.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3dfd12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8136960 0x7fd3d8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3dfd12700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3d8139280 0x7fd3d813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3dfd12700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d806b2d0 con 0x7fd3d8133ad0 2023-09-30T22:22:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3dfd12700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d81345b0 con 0x7fd3d8139280 2023-09-30T22:22:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3dfd12700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d8133610 con 0x7fd3d8136960 2023-09-30T22:22:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3ddaae700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3d8133ad0 0x7fd3d8133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35044/0 (socket says 172.21.15.154:35044) 2023-09-30T22:22:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3ddaae700 1 -- 172.21.15.154:0/3660089738 learned_addr learned my addr 172.21.15.154:0/3660089738 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3dd2ad700 1 --2- 172.21.15.154:0/3660089738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8136960 0x7fd3d8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.745+0000 7fd3de2af700 1 --2- 172.21.15.154:0/3660089738 >> v2:172.21.15.154:3300/0 conn(0x7fd3d8139280 0x7fd3d813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.746+0000 7fd3de2af700 1 -- 172.21.15.154:0/3660089738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8136960 msgr2=0x7fd3d8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.746+0000 7fd3de2af700 1 --2- 172.21.15.154:0/3660089738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8136960 0x7fd3d8138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.746+0000 7fd3de2af700 1 -- 172.21.15.154:0/3660089738 >> v1:172.21.15.154:6789/0 conn(0x7fd3d8133ad0 legacy=0x7fd3d8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.746+0000 7fd3de2af700 1 -- 172.21.15.154:0/3660089738 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d809a500 con 0x7fd3d8139280 2023-09-30T22:22:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.746+0000 7fd3de2af700 1 --2- 172.21.15.154:0/3660089738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 0x7fd3d813b660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009dc0 tx=0x7fd3d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b5c64b7906e81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.746+0000 7fd3dcaac700 1 -- 172.21.15.154:0/3660089738 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d000e070 con 0x7fd3d8139280 2023-09-30T22:22:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.746+0000 7fd3dcaac700 1 -- 172.21.15.154:0/3660089738 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d000bb90 con 0x7fd3d8139280 2023-09-30T22:22:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.746+0000 7fd3dcaac700 1 -- 172.21.15.154:0/3660089738 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0012430 con 0x7fd3d8139280 2023-09-30T22:22:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.747+0000 7fd3dfd12700 1 -- 172.21.15.154:0/3660089738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 msgr2=0x7fd3d813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.747+0000 7fd3dfd12700 1 --2- 172.21.15.154:0/3660089738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 0x7fd3d813b660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009dc0 tx=0x7fd3d000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.747+0000 7fd3dfd12700 1 -- 172.21.15.154:0/3660089738 shutdown_connections 2023-09-30T22:22:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.747+0000 7fd3dfd12700 1 --2- 172.21.15.154:0/3660089738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 0x7fd3d813b660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.747+0000 7fd3dfd12700 1 --2- 172.21.15.154:0/3660089738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8136960 0x7fd3d8138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.747+0000 7fd3dfd12700 1 -- 172.21.15.154:0/3660089738 >> 172.21.15.154:0/3660089738 conn(0x7fd3d8099c40 msgr2=0x7fd3d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.747+0000 7fd3dfd12700 1 -- 172.21.15.154:0/3660089738 shutdown_connections 2023-09-30T22:22:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.747+0000 7fd3dfd12700 1 -- 172.21.15.154:0/3660089738 wait complete. 2023-09-30T22:22:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.748+0000 7fd3dfd12700 1 Processor -- start 2023-09-30T22:22:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.748+0000 7fd3dfd12700 1 -- start start 2023-09-30T22:22:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.748+0000 7fd3dfd12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8133ad0 0x7fd3d80715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.748+0000 7fd3dfd12700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3d8136960 0x7fd3d8071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.748+0000 7fd3dfd12700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 0x7fd3d81c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.748+0000 7fd3dfd12700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d809f390 con 0x7fd3d8139280 2023-09-30T22:22:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.748+0000 7fd3dfd12700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d806ff90 con 0x7fd3d8136960 2023-09-30T22:22:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.748+0000 7fd3dfd12700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d806e900 con 0x7fd3d8133ad0 2023-09-30T22:22:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3dd2ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3d8136960 0x7fd3d8071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3dd2ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3d8136960 0x7fd3d8071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43612/0 (socket says 172.21.15.154:43612) 2023-09-30T22:22:25.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3dd2ad700 1 -- 172.21.15.154:0/1453762437 learned_addr learned my addr 172.21.15.154:0/1453762437 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:25.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3de2af700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 0x7fd3d81c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3ddaae700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8133ad0 0x7fd3d80715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3de2af700 1 -- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8133ad0 msgr2=0x7fd3d80715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3de2af700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8133ad0 0x7fd3d80715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3de2af700 1 -- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3d8136960 msgr2=0x7fd3d8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3de2af700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3d8136960 0x7fd3d8071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3de2af700 1 -- 172.21.15.154:0/1453762437 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009a70 con 0x7fd3d8139280 2023-09-30T22:22:25.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3dd2ad700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3d8136960 0x7fd3d8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:25.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3de2af700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 0x7fd3d81c8470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0016000 tx=0x7fd3d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3ce7fc700 1 -- 172.21.15.154:0/1453762437 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0012430 con 0x7fd3d8139280 2023-09-30T22:22:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3ce7fc700 1 -- 172.21.15.154:0/1453762437 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d0020070 con 0x7fd3d8139280 2023-09-30T22:22:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.749+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d8072460 con 0x7fd3d8139280 2023-09-30T22:22:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.750+0000 7fd3ce7fc700 1 -- 172.21.15.154:0/1453762437 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0004280 con 0x7fd3d8139280 2023-09-30T22:22:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.750+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d8070530 con 0x7fd3d8139280 2023-09-30T22:22:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.750+0000 7fd3ce7fc700 1 -- 172.21.15.154:0/1453762437 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd3d00043e0 con 0x7fd3d8139280 2023-09-30T22:22:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.750+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d804f2a0 con 0x7fd3d8139280 2023-09-30T22:22:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.751+0000 7fd3ce7fc700 1 -- 172.21.15.154:0/1453762437 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd3d0022070 con 0x7fd3d8139280 2023-09-30T22:22:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.751+0000 7fd3ddaae700 1 -- 172.21.15.154:0/1453762437 >> v1:172.21.15.154:6816/126757 conn(0x7fd3bc02f510 legacy=0x7fd3bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.755+0000 7fd3ce7fc700 1 -- 172.21.15.154:0/1453762437 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3d0004690 con 0x7fd3d8139280 2023-09-30T22:22:25.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.789+0000 7f23366dd700 1 Processor -- start 2023-09-30T22:22:25.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.789+0000 7f23366dd700 1 -- start start 2023-09-30T22:22:25.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.789+0000 7f23366dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 0x7f2330138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.789+0000 7f23366dd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2330139200 0x7f233013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.789+0000 7f23366dd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233009e9d0 con 0x7f23300a0a70 2023-09-30T22:22:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.789+0000 7f23366dd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233009dc00 con 0x7f2330139200 2023-09-30T22:22:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.789+0000 7f23366dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233009dec0 con 0x7f23300a1550 2023-09-30T22:22:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f232ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f23300a0a70 0x7f23300a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35060/0 (socket says 172.21.15.154:35060) 2023-09-30T22:22:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f232ffff700 1 -- 172.21.15.154:0/3260370878 learned_addr learned my addr 172.21.15.154:0/3260370878 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f2334c7a700 1 --2- 172.21.15.154:0/3260370878 >> v2:172.21.15.154:3300/0 conn(0x7f2330139200 0x7f233013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f232f7fe700 1 --2- 172.21.15.154:0/3260370878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 0x7f2330138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f2334c7a700 1 -- 172.21.15.154:0/3260370878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 msgr2=0x7f2330138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f2334c7a700 1 --2- 172.21.15.154:0/3260370878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 0x7f2330138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f2334c7a700 1 -- 172.21.15.154:0/3260370878 >> v1:172.21.15.154:6789/0 conn(0x7f23300a0a70 legacy=0x7f23300a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f2334c7a700 1 -- 172.21.15.154:0/3260370878 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233009e6a0 con 0x7f2330139200 2023-09-30T22:22:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f2334c7a700 1 --2- 172.21.15.154:0/3260370878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2330139200 0x7f233013b5e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2328009d90 tx=0x7f232800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98da0dbac4111163 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f232effd700 1 -- 172.21.15.154:0/3260370878 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232800e070 con 0x7f2330139200 2023-09-30T22:22:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f232effd700 1 -- 172.21.15.154:0/3260370878 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232800bb20 con 0x7f2330139200 2023-09-30T22:22:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.790+0000 7f232effd700 1 -- 172.21.15.154:0/3260370878 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328012430 con 0x7f2330139200 2023-09-30T22:22:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.791+0000 7f23366dd700 1 -- 172.21.15.154:0/3260370878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2330139200 msgr2=0x7f233013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.791+0000 7f23366dd700 1 --2- 172.21.15.154:0/3260370878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2330139200 0x7f233013b5e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2328009d90 tx=0x7f232800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.791+0000 7f23366dd700 1 -- 172.21.15.154:0/3260370878 shutdown_connections 2023-09-30T22:22:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.791+0000 7f23366dd700 1 --2- 172.21.15.154:0/3260370878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2330139200 0x7f233013b5e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.791+0000 7f23366dd700 1 --2- 172.21.15.154:0/3260370878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 0x7f2330138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.791+0000 7f23366dd700 1 -- 172.21.15.154:0/3260370878 >> 172.21.15.154:0/3260370878 conn(0x7f23300a6610 msgr2=0x7f23300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.791+0000 7f23366dd700 1 -- 172.21.15.154:0/3260370878 shutdown_connections 2023-09-30T22:22:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.791+0000 7f23366dd700 1 -- 172.21.15.154:0/3260370878 wait complete. 2023-09-30T22:22:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.792+0000 7f23366dd700 1 Processor -- start 2023-09-30T22:22:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f23366dd700 1 -- start start 2023-09-30T22:22:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f23366dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23300a0a70 0x7f233011e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f23366dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 0x7f233011edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f232ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23300a0a70 0x7f233011e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f23366dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330139200 0x7f233011f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f23366dd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23300a03e0 con 0x7f23300a0a70 2023-09-30T22:22:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f23366dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2330122020 con 0x7f23300a1550 2023-09-30T22:22:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f232ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23300a0a70 0x7f233011e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45782/0 (socket says 172.21.15.154:45782) 2023-09-30T22:22:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f232ffff700 1 -- 172.21.15.154:0/3177583038 learned_addr learned my addr 172.21.15.154:0/3177583038 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2330120500 con 0x7f2330139200 2023-09-30T22:22:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.793+0000 7f232f7fe700 1 --2- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 0x7f233011edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f2334c7a700 1 --2- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330139200 0x7f233011f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f232f7fe700 1 -- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330139200 msgr2=0x7f233011f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f232f7fe700 1 --2- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330139200 0x7f233011f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f232f7fe700 1 -- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23300a0a70 msgr2=0x7f233011e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f232f7fe700 1 --2- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23300a0a70 0x7f233011e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f232f7fe700 1 -- 172.21.15.154:0/3177583038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328009a70 con 0x7f23300a1550 2023-09-30T22:22:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f232f7fe700 1 --2- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 0x7f233011edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f232400e900 tx=0x7f232400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f232cff9700 1 -- 172.21.15.154:0/3177583038 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400ee50 con 0x7f23300a1550 2023-09-30T22:22:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23300a5100 con 0x7f23300a1550 2023-09-30T22:22:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f232cff9700 1 -- 172.21.15.154:0/3177583038 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232400c850 con 0x7f23300a1550 2023-09-30T22:22:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2330122a90 con 0x7f23300a1550 2023-09-30T22:22:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.794+0000 7f232cff9700 1 -- 172.21.15.154:0/3177583038 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400cbc0 con 0x7f23300a1550 2023-09-30T22:22:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.795+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23100052e0 con 0x7f23300a1550 2023-09-30T22:22:25.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.796+0000 7f232cff9700 1 -- 172.21.15.154:0/3177583038 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f232400cd20 con 0x7f23300a1550 2023-09-30T22:22:25.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.796+0000 7f232ffff700 1 -- 172.21.15.154:0/3177583038 >> v1:172.21.15.154:6816/126757 conn(0x7f231c02f510 legacy=0x7f231c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:25.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.800+0000 7f232cff9700 1 -- 172.21.15.154:0/3177583038 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f232401ad50 con 0x7f23300a1550 2023-09-30T22:22:25.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.804+0000 7f232cff9700 1 -- 172.21.15.154:0/3177583038 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2324045060 con 0x7f23300a1550 2023-09-30T22:22:25.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.867+0000 7f8d4ffff700 1 -- 172.21.15.154:0/1433147032 >> v1:172.21.15.154:6816/126757 conn(0x7f8d3c02f510 legacy=0x7f8d3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.875+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d5006bce0 con 0x7f8d500a1230 2023-09-30T22:22:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.875+0000 7f8d4cff9700 1 -- 172.21.15.154:0/1433147032 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d44015020 con 0x7f8d500a1230 2023-09-30T22:22:25.875 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.878+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 >> v1:172.21.15.154:6816/126757 conn(0x7f8d3c02f510 legacy=0x7f8d3c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.879+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 msgr2=0x7f8d50119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.879+0000 7f8d568cb700 1 --2- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d50119330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d44014040 tx=0x7f8d44004750 comp rx=0 tx=0).stop 2023-09-30T22:22:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.879+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 shutdown_connections 2023-09-30T22:22:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.879+0000 7f8d568cb700 1 --2- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d50138040 0x7f8d50119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.879+0000 7f8d568cb700 1 --2- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d500a08e0 0x7f8d50118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.879+0000 7f8d568cb700 1 --2- 172.21.15.154:0/1433147032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d500a1230 0x7f8d50119330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.879+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 >> 172.21.15.154:0/1433147032 conn(0x7f8d500a2980 msgr2=0x7f8d5009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.879+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 shutdown_connections 2023-09-30T22:22:25.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.879+0000 7f8d568cb700 1 -- 172.21.15.154:0/1433147032 wait complete. 2023-09-30T22:22:25.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:25.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.904+0000 7f1bb6d9d700 1 -- 172.21.15.154:0/3892616339 >> v1:172.21.15.154:6816/126757 conn(0x7f1ba402f510 legacy=0x7f1ba40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.915+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1bb81330d0 con 0x7f1bb80a1510 2023-09-30T22:22:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.915+0000 7f1b9f7fe700 1 -- 172.21.15.154:0/3892616339 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bb81330d0 con 0x7f1bb80a1510 2023-09-30T22:22:25.915 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 >> v1:172.21.15.154:6816/126757 conn(0x7f1ba402f510 legacy=0x7f1ba40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bb80a1510 msgr2=0x7f1bb806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bb80a1510 0x7f1bb806f9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1bac017000 tx=0x7f1bac0047c0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 shutdown_connections 2023-09-30T22:22:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bb81356e0 0x7f1bb806ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb80a0a30 0x7f1bb806f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 --2- 172.21.15.154:0/3892616339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bb80a1510 0x7f1bb806f9d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 >> 172.21.15.154:0/3892616339 conn(0x7f1bb80a2980 msgr2=0x7f1bb8131150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 shutdown_connections 2023-09-30T22:22:25.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.917+0000 7f1bbd015700 1 -- 172.21.15.154:0/3892616339 wait complete. 2023-09-30T22:22:25.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:25.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.952+0000 7fd3ddaae700 1 -- 172.21.15.154:0/1453762437 >> v1:172.21.15.154:6816/126757 conn(0x7fd3bc02f510 legacy=0x7fd3bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.971+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd3d809f0f0 con 0x7fd3d8139280 2023-09-30T22:22:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.971+0000 7fd3ce7fc700 1 -- 172.21.15.154:0/1453762437 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3d0011ce0 con 0x7fd3d8139280 2023-09-30T22:22:25.971 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 >> v1:172.21.15.154:6816/126757 conn(0x7fd3bc02f510 legacy=0x7fd3bc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 msgr2=0x7fd3d81c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 0x7fd3d81c8470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0016000 tx=0x7fd3d0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 shutdown_connections 2023-09-30T22:22:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8139280 0x7fd3d81c8470 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3d8133ad0 0x7fd3d80715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 --2- 172.21.15.154:0/1453762437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3d8136960 0x7fd3d8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:25.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 >> 172.21.15.154:0/1453762437 conn(0x7fd3d8099c40 msgr2=0x7fd3d80a3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:25.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 shutdown_connections 2023-09-30T22:22:25.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.974+0000 7fd3dfd12700 1 -- 172.21.15.154:0/1453762437 wait complete. 2023-09-30T22:22:25.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:25.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:25.997+0000 7f232ffff700 1 -- 172.21.15.154:0/3177583038 >> v1:172.21.15.154:6816/126757 conn(0x7f231c02f510 legacy=0x7f231c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.013+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2310005860 con 0x7f23300a1550 2023-09-30T22:22:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.014+0000 7f232cff9700 1 -- 172.21.15.154:0/3177583038 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2324045020 con 0x7f23300a1550 2023-09-30T22:22:26.013 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 >> v1:172.21.15.154:6816/126757 conn(0x7f231c02f510 legacy=0x7f231c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 msgr2=0x7f233011edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 --2- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 0x7f233011edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f232400e900 tx=0x7f232400ec10 comp rx=0 tx=0).stop 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 shutdown_connections 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 --2- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330139200 0x7f233011f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 --2- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23300a0a70 0x7f233011e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 --2- 172.21.15.154:0/3177583038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23300a1550 0x7f233011edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 >> 172.21.15.154:0/3177583038 conn(0x7f23300a6610 msgr2=0x7f2330138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 shutdown_connections 2023-09-30T22:22:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:26.016+0000 7f23366dd700 1 -- 172.21.15.154:0/3177583038 wait complete. 2023-09-30T22:22:26.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:26.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:26.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:26.991 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:27.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:27.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f79354d3700 1 Processor -- start 2023-09-30T22:22:27.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f79354d3700 1 -- start start 2023-09-30T22:22:27.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f79354d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7930131980 0x7f7930131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f79354d3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f793009bc70 0x7f793009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f79354d3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79300a1640 con 0x7f793009c5c0 2023-09-30T22:22:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f79354d3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793006eb30 con 0x7f793009bc70 2023-09-30T22:22:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f79354d3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79300a22d0 con 0x7f7930131980 2023-09-30T22:22:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f792effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7930131980 0x7f7930131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f792e7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f793009bc70 0x7f793009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f792effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7930131980 0x7f7930131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40786/0 (socket says 172.21.15.154:40786) 2023-09-30T22:22:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f792e7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f793009bc70 0x7f793009c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45796/0 (socket says 172.21.15.154:45796) 2023-09-30T22:22:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.033+0000 7f792effd700 1 -- 172.21.15.154:0/3866940400 learned_addr learned my addr 172.21.15.154:0/3866940400 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.034+0000 7f792e7fc700 1 -- 172.21.15.154:0/3866940400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7930131980 msgr2=0x7f7930131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.034+0000 7f792e7fc700 1 --2- 172.21.15.154:0/3866940400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7930131980 0x7f7930131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.034+0000 7f792e7fc700 1 -- 172.21.15.154:0/3866940400 >> v1:172.21.15.154:6789/0 conn(0x7f793009c5c0 legacy=0x7f7930138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.034+0000 7f792e7fc700 1 -- 172.21.15.154:0/3866940400 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7930131550 con 0x7f793009bc70 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.034+0000 7f792e7fc700 1 --2- 172.21.15.154:0/3866940400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f793009bc70 0x7f793009c080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7924009840 tx=0x7f7924009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bf28e25330ce8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.034+0000 7f792dffb700 1 -- 172.21.15.154:0/3866940400 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924011830 con 0x7f793009bc70 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.034+0000 7f792dffb700 1 -- 172.21.15.154:0/3866940400 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7924011990 con 0x7f793009bc70 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.034+0000 7f792dffb700 1 -- 172.21.15.154:0/3866940400 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924011d20 con 0x7f793009bc70 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.035+0000 7f79354d3700 1 -- 172.21.15.154:0/3866940400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f793009bc70 msgr2=0x7f793009c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.035+0000 7f79354d3700 1 --2- 172.21.15.154:0/3866940400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f793009bc70 0x7f793009c080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7924009840 tx=0x7f7924009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:27.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.035+0000 7f79354d3700 1 -- 172.21.15.154:0/3866940400 shutdown_connections 2023-09-30T22:22:27.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.035+0000 7f79354d3700 1 --2- 172.21.15.154:0/3866940400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7930131980 0x7f7930131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.035+0000 7f79354d3700 1 --2- 172.21.15.154:0/3866940400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f793009bc70 0x7f793009c080 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.035+0000 7f79354d3700 1 -- 172.21.15.154:0/3866940400 >> 172.21.15.154:0/3866940400 conn(0x7f79300a2980 msgr2=0x7f79300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.035+0000 7f79354d3700 1 -- 172.21.15.154:0/3866940400 shutdown_connections 2023-09-30T22:22:27.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.035+0000 7f79354d3700 1 -- 172.21.15.154:0/3866940400 wait complete. 2023-09-30T22:22:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.036+0000 7f79354d3700 1 Processor -- start 2023-09-30T22:22:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f79354d3700 1 -- start start 2023-09-30T22:22:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f79354d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f793009bc70 0x7f793011db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f79354d3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f793009c5c0 0x7f793011e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f79354d3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7930131980 0x7f793011e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f79354d3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79301215f0 con 0x7f793009c5c0 2023-09-30T22:22:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f79354d3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79300a1c40 con 0x7f7930131980 2023-09-30T22:22:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f79354d3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f793011f6e0 con 0x7f793009bc70 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f792effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f793009bc70 0x7f793011db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f792effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f793009bc70 0x7f793011db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40792/0 (socket says 172.21.15.154:40792) 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f792effd700 1 -- 172.21.15.154:0/2478196238 learned_addr learned my addr 172.21.15.154:0/2478196238 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f792e7fc700 1 --2- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f793009c5c0 0x7f793011e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.037+0000 7f792f7fe700 1 --2- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7930131980 0x7f793011e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f792effd700 1 -- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7930131980 msgr2=0x7f793011e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f792effd700 1 --2- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7930131980 0x7f793011e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f792effd700 1 -- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f793009c5c0 msgr2=0x7f793011e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f792effd700 1 --2- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f793009c5c0 0x7f793011e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f792effd700 1 -- 172.21.15.154:0/2478196238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79240094a0 con 0x7f793009bc70 2023-09-30T22:22:27.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f792effd700 1 --2- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f793009bc70 0x7f793011db20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f792000e8c0 tx=0x7f792000ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f79177fe700 1 -- 172.21.15.154:0/2478196238 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920013680 con 0x7f793009bc70 2023-09-30T22:22:27.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f79177fe700 1 -- 172.21.15.154:0/2478196238 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79200137e0 con 0x7f793009bc70 2023-09-30T22:22:27.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f79177fe700 1 -- 172.21.15.154:0/2478196238 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920013b90 con 0x7f793009bc70 2023-09-30T22:22:27.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793011ff00 con 0x7f793009bc70 2023-09-30T22:22:27.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.038+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7930130e70 con 0x7f793009bc70 2023-09-30T22:22:27.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.039+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793004f2a0 con 0x7f793009bc70 2023-09-30T22:22:27.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.040+0000 7f79177fe700 1 -- 172.21.15.154:0/2478196238 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7920013cf0 con 0x7f793009bc70 2023-09-30T22:22:27.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.041+0000 7f79177fe700 1 -- 172.21.15.154:0/2478196238 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f79200404d0 con 0x7f793009bc70 2023-09-30T22:22:27.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.041+0000 7f792e7fc700 1 -- 172.21.15.154:0/2478196238 >> v1:172.21.15.154:6816/126757 conn(0x7f791c02f560 legacy=0x7f791c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:27.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.045+0000 7f79177fe700 1 -- 172.21.15.154:0/2478196238 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f792001ab50 con 0x7f793009bc70 2023-09-30T22:22:27.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.078+0000 7f3fe9d96700 1 Processor -- start 2023-09-30T22:22:27.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.078+0000 7f3fe9d96700 1 -- start start 2023-09-30T22:22:27.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.078+0000 7f3fe9d96700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fe4133ad0 0x7f3fe4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.078+0000 7f3fe9d96700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe41300a0 0x7f3fe41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.078+0000 7f3fe9d96700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe406b2d0 con 0x7f3fe41309f0 2023-09-30T22:22:27.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.078+0000 7f3fe9d96700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe4133610 con 0x7f3fe4133ad0 2023-09-30T22:22:27.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.078+0000 7f3fe9d96700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe409a500 con 0x7f3fe41300a0 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fe4133ad0 0x7f3fe4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fe4133ad0 0x7f3fe4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45814/0 (socket says 172.21.15.154:45814) 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe41300a0 0x7f3fe41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe37fe700 1 -- 172.21.15.154:0/2120926189 learned_addr learned my addr 172.21.15.154:0/2120926189 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe2ffd700 1 -- 172.21.15.154:0/2120926189 >> v2:172.21.15.154:3300/0 conn(0x7f3fe4133ad0 msgr2=0x7f3fe4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe2ffd700 1 --2- 172.21.15.154:0/2120926189 >> v2:172.21.15.154:3300/0 conn(0x7f3fe4133ad0 0x7f3fe4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe2ffd700 1 -- 172.21.15.154:0/2120926189 >> v1:172.21.15.154:6789/0 conn(0x7f3fe41309f0 legacy=0x7f3fe413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe2ffd700 1 -- 172.21.15.154:0/2120926189 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe41338b0 con 0x7f3fe41300a0 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe2ffd700 1 --2- 172.21.15.154:0/2120926189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe41300a0 0x7f3fe41304b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009840 tx=0x7f3fd8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4310cdbe7c253ff5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe27fc700 1 -- 172.21.15.154:0/2120926189 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8011830 con 0x7f3fe41300a0 2023-09-30T22:22:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe27fc700 1 -- 172.21.15.154:0/2120926189 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd8011990 con 0x7f3fe41300a0 2023-09-30T22:22:27.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.079+0000 7f3fe27fc700 1 -- 172.21.15.154:0/2120926189 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8011d20 con 0x7f3fe41300a0 2023-09-30T22:22:27.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.080+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2120926189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe41300a0 msgr2=0x7f3fe41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.080+0000 7f3fe9d96700 1 --2- 172.21.15.154:0/2120926189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe41300a0 0x7f3fe41304b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009840 tx=0x7f3fd8009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.080+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2120926189 shutdown_connections 2023-09-30T22:22:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.080+0000 7f3fe9d96700 1 --2- 172.21.15.154:0/2120926189 >> v2:172.21.15.154:3300/0 conn(0x7f3fe4133ad0 0x7f3fe4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.080+0000 7f3fe9d96700 1 --2- 172.21.15.154:0/2120926189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe41300a0 0x7f3fe41304b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.080+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2120926189 >> 172.21.15.154:0/2120926189 conn(0x7f3fe4099c40 msgr2=0x7f3fe40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.080+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2120926189 shutdown_connections 2023-09-30T22:22:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.080+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2120926189 wait complete. 2023-09-30T22:22:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.082+0000 7f3fe9d96700 1 Processor -- start 2023-09-30T22:22:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.082+0000 7f3fe9d96700 1 -- start start 2023-09-30T22:22:27.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe9d96700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe41300a0 0x7f3fe411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe9d96700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fe41309f0 0x7f3fe411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe9d96700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe4133ad0 0x7f3fe411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe9d96700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe411fd60 con 0x7f3fe41300a0 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe9d96700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40724c0 con 0x7f3fe4133ad0 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe9d96700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe412fe10 con 0x7f3fe41309f0 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe4133ad0 0x7f3fe411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe41300a0 0x7f3fe411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe4133ad0 0x7f3fe411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43652/0 (socket says 172.21.15.154:43652) 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe3fff700 1 -- 172.21.15.154:0/2318359767 learned_addr learned my addr 172.21.15.154:0/2318359767 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe37fe700 1 -- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fe41309f0 msgr2=0x7f3fe411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe37fe700 1 --2- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fe41309f0 0x7f3fe411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe37fe700 1 -- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe4133ad0 msgr2=0x7f3fe411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe37fe700 1 --2- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe4133ad0 0x7f3fe411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe37fe700 1 -- 172.21.15.154:0/2318359767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd80094a0 con 0x7f3fe41300a0 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe3fff700 1 --2- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe4133ad0 0x7f3fe411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fe37fe700 1 --2- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe41300a0 0x7f3fe411da40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400e8e0 tx=0x7f3fd400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.083+0000 7f3fcbfff700 1 -- 172.21.15.154:0/2318359767 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400c690 con 0x7f3fe41300a0 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.084+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe4120300 con 0x7f3fe41300a0 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.084+0000 7f3fcbfff700 1 -- 172.21.15.154:0/2318359767 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd400c7f0 con 0x7f3fe41300a0 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.084+0000 7f3fcbfff700 1 -- 172.21.15.154:0/2318359767 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400cb80 con 0x7f3fe41300a0 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.084+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe412d380 con 0x7f3fe41300a0 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.085+0000 7f3fcbfff700 1 -- 172.21.15.154:0/2318359767 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3fd400cce0 con 0x7f3fe41300a0 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.085+0000 7f3fcbfff700 1 -- 172.21.15.154:0/2318359767 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3fd403fd80 con 0x7f3fe41300a0 2023-09-30T22:22:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.085+0000 7f3fe2ffd700 1 -- 172.21.15.154:0/2318359767 >> v1:172.21.15.154:6816/126757 conn(0x7f3fd002f540 legacy=0x7f3fd00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:27.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.085+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe412d380 con 0x7f3fe41300a0 2023-09-30T22:22:27.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.092+0000 7f3fcbfff700 1 -- 172.21.15.154:0/2318359767 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fe412d380 con 0x7f3fe41300a0 2023-09-30T22:22:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.134+0000 7fbe61bda700 1 Processor -- start 2023-09-30T22:22:27.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.134+0000 7fbe61bda700 1 -- start start 2023-09-30T22:22:27.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.134+0000 7fbe61bda700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe5c133ad0 0x7fbe5c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe61bda700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe61bda700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c06b2d0 con 0x7fbe5c1300a0 2023-09-30T22:22:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe61bda700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c133610 con 0x7fbe5c133ad0 2023-09-30T22:22:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe61bda700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c09a500 con 0x7fbe5c130bc0 2023-09-30T22:22:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe5c133ad0 0x7fbe5c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbe5c1300a0 0x7fbe5c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35092/0 (socket says 172.21.15.154:35092) 2023-09-30T22:22:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5affd700 1 -- 172.21.15.154:0/4154320520 learned_addr learned my addr 172.21.15.154:0/4154320520 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5bfff700 1 --2- 172.21.15.154:0/4154320520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5bfff700 1 -- 172.21.15.154:0/4154320520 >> v2:172.21.15.154:3300/0 conn(0x7fbe5c133ad0 msgr2=0x7fbe5c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5bfff700 1 --2- 172.21.15.154:0/4154320520 >> v2:172.21.15.154:3300/0 conn(0x7fbe5c133ad0 0x7fbe5c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5bfff700 1 -- 172.21.15.154:0/4154320520 >> v1:172.21.15.154:6789/0 conn(0x7fbe5c1300a0 legacy=0x7fbe5c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5bfff700 1 -- 172.21.15.154:0/4154320520 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c1338b0 con 0x7fbe5c130bc0 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5bfff700 1 --2- 172.21.15.154:0/4154320520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c13b990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009d90 tx=0x7fbe5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6444af45a18ce9af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.135+0000 7fbe5a7fc700 1 -- 172.21.15.154:0/4154320520 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400e070 con 0x7fbe5c130bc0 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe5a7fc700 1 -- 172.21.15.154:0/4154320520 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5400bb20 con 0x7fbe5c130bc0 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe5a7fc700 1 -- 172.21.15.154:0/4154320520 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54012430 con 0x7fbe5c130bc0 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe61bda700 1 -- 172.21.15.154:0/4154320520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 msgr2=0x7fbe5c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe61bda700 1 --2- 172.21.15.154:0/4154320520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c13b990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009d90 tx=0x7fbe5400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe61bda700 1 -- 172.21.15.154:0/4154320520 shutdown_connections 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe61bda700 1 --2- 172.21.15.154:0/4154320520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c13b990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe61bda700 1 --2- 172.21.15.154:0/4154320520 >> v2:172.21.15.154:3300/0 conn(0x7fbe5c133ad0 0x7fbe5c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe61bda700 1 -- 172.21.15.154:0/4154320520 >> 172.21.15.154:0/4154320520 conn(0x7fbe5c099c40 msgr2=0x7fbe5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe61bda700 1 -- 172.21.15.154:0/4154320520 shutdown_connections 2023-09-30T22:22:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.136+0000 7fbe61bda700 1 -- 172.21.15.154:0/4154320520 wait complete. 2023-09-30T22:22:27.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.137+0000 7fbe61bda700 1 Processor -- start 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe61bda700 1 -- start start 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe61bda700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe5c1300a0 0x7fbe5c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe61bda700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe61bda700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe5c133ad0 0x7fbe5c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe61bda700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c12da10 con 0x7fbe5c1300a0 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe61bda700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c120a30 con 0x7fbe5c130bc0 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe61bda700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c12dd00 con 0x7fbe5c133ad0 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe5b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe5c1300a0 0x7fbe5c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe5b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe5c1300a0 0x7fbe5c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45844/0 (socket says 172.21.15.154:45844) 2023-09-30T22:22:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.138+0000 7fbe5b7fe700 1 -- 172.21.15.154:0/2085626243 learned_addr learned my addr 172.21.15.154:0/2085626243 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5affd700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5b7fe700 1 -- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe5c133ad0 msgr2=0x7fbe5c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5bfff700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe5c133ad0 0x7fbe5c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5b7fe700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe5c133ad0 0x7fbe5c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5b7fe700 1 -- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 msgr2=0x7fbe5c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5b7fe700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5b7fe700 1 -- 172.21.15.154:0/2085626243 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54009a70 con 0x7fbe5c1300a0 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5affd700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5bfff700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe5c133ad0 0x7fbe5c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe5b7fe700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe5c1300a0 0x7fbe5c11da40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00e9b0 tx=0x7fbe4c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe43fff700 1 -- 172.21.15.154:0/2085626243 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c009710 con 0x7fbe5c1300a0 2023-09-30T22:22:27.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe43fff700 1 -- 172.21.15.154:0/2085626243 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00c850 con 0x7fbe5c1300a0 2023-09-30T22:22:27.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c12fc20 con 0x7fbe5c1300a0 2023-09-30T22:22:27.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe43fff700 1 -- 172.21.15.154:0/2085626243 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00cbc0 con 0x7fbe5c1300a0 2023-09-30T22:22:27.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.139+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c071840 con 0x7fbe5c1300a0 2023-09-30T22:22:27.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.141+0000 7fbe43fff700 1 -- 172.21.15.154:0/2085626243 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbe4c00cd20 con 0x7fbe5c1300a0 2023-09-30T22:22:27.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.141+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c04f2a0 con 0x7fbe5c1300a0 2023-09-30T22:22:27.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.141+0000 7fbe43fff700 1 -- 172.21.15.154:0/2085626243 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fbe4c0400e0 con 0x7fbe5c1300a0 2023-09-30T22:22:27.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.141+0000 7fbe5affd700 1 -- 172.21.15.154:0/2085626243 >> v1:172.21.15.154:6816/126757 conn(0x7fbe4802f510 legacy=0x7fbe480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.150+0000 7fbe43fff700 1 -- 172.21.15.154:0/2085626243 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe4c01b3b0 con 0x7fbe5c1300a0 2023-09-30T22:22:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.173+0000 7fa3c7df0700 1 Processor -- start 2023-09-30T22:22:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c7df0700 1 -- start start 2023-09-30T22:22:27.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c7df0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c009ad40 0x7fa3c0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c7df0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa3c0133f70 0x7fa3c01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c7df0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c009b110 con 0x7fa3c00a0a70 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c7df0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c00a3b60 con 0x7fa3c0133f70 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c7df0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01348e0 con 0x7fa3c009ad40 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c538b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa3c0133f70 0x7fa3c01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c5b8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c009ad40 0x7fa3c0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c538b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa3c0133f70 0x7fa3c01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45854/0 (socket says 172.21.15.154:45854) 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c5b8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c009ad40 0x7fa3c0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43686/0 (socket says 172.21.15.154:43686) 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.174+0000 7fa3c538b700 1 -- 172.21.15.154:0/3004032507 learned_addr learned my addr 172.21.15.154:0/3004032507 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.175+0000 7fa3c5b8c700 1 -- 172.21.15.154:0/3004032507 >> v2:172.21.15.154:3300/0 conn(0x7fa3c0133f70 msgr2=0x7fa3c01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.175+0000 7fa3c5b8c700 1 --2- 172.21.15.154:0/3004032507 >> v2:172.21.15.154:3300/0 conn(0x7fa3c0133f70 0x7fa3c01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.175+0000 7fa3c5b8c700 1 -- 172.21.15.154:0/3004032507 >> v1:172.21.15.154:6789/0 conn(0x7fa3c00a0a70 legacy=0x7fa3c00a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.175+0000 7fa3c5b8c700 1 -- 172.21.15.154:0/3004032507 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00a2fa0 con 0x7fa3c009ad40 2023-09-30T22:22:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.175+0000 7fa3c5b8c700 1 --2- 172.21.15.154:0/3004032507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c009ad40 0x7fa3c0133a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009870 tx=0x7fa3bc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=687bc0ec87807d48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.175+0000 7fa3c4b8a700 1 -- 172.21.15.154:0/3004032507 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc011830 con 0x7fa3c009ad40 2023-09-30T22:22:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.175+0000 7fa3c4b8a700 1 -- 172.21.15.154:0/3004032507 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc011990 con 0x7fa3c009ad40 2023-09-30T22:22:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.175+0000 7fa3c4b8a700 1 -- 172.21.15.154:0/3004032507 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc011d20 con 0x7fa3c009ad40 2023-09-30T22:22:27.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.176+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3004032507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c009ad40 msgr2=0x7fa3c0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.176+0000 7fa3c7df0700 1 --2- 172.21.15.154:0/3004032507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c009ad40 0x7fa3c0133a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009870 tx=0x7fa3bc009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:27.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.176+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3004032507 shutdown_connections 2023-09-30T22:22:27.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.176+0000 7fa3c7df0700 1 --2- 172.21.15.154:0/3004032507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c009ad40 0x7fa3c0133a30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.176+0000 7fa3c7df0700 1 --2- 172.21.15.154:0/3004032507 >> v2:172.21.15.154:3300/0 conn(0x7fa3c0133f70 0x7fa3c01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.176+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3004032507 >> 172.21.15.154:0/3004032507 conn(0x7fa3c0099c40 msgr2=0x7fa3c006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.176+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3004032507 shutdown_connections 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.176+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3004032507 wait complete. 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.177+0000 7fa3c7df0700 1 Processor -- start 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.177+0000 7fa3c7df0700 1 -- start start 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.177+0000 7fa3c7df0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c009ad40 0x7fa3c011e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.177+0000 7fa3c7df0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3c00a0a70 0x7fa3c011e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.177+0000 7fa3c7df0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c0133f70 0x7fa3c011eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.177+0000 7fa3c7df0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0122500 con 0x7fa3c009ad40 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.177+0000 7fa3c7df0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c011fc30 con 0x7fa3c0133f70 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.177+0000 7fa3c7df0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0120250 con 0x7fa3c00a0a70 2023-09-30T22:22:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c538b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3c00a0a70 0x7fa3c011e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c538b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3c00a0a70 0x7fa3c011e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40812/0 (socket says 172.21.15.154:40812) 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c538b700 1 -- 172.21.15.154:0/3822596470 learned_addr learned my addr 172.21.15.154:0/3822596470 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c638d700 1 --2- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c0133f70 0x7fa3c011eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c5b8c700 1 --2- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c009ad40 0x7fa3c011e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c538b700 1 -- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c0133f70 msgr2=0x7fa3c011eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c538b700 1 --2- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c0133f70 0x7fa3c011eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c538b700 1 -- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c009ad40 msgr2=0x7fa3c011e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c538b700 1 --2- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c009ad40 0x7fa3c011e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c538b700 1 -- 172.21.15.154:0/3822596470 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc0094a0 con 0x7fa3c00a0a70 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c538b700 1 --2- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3c00a0a70 0x7fa3c011e560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000e910 tx=0x7fa3b000ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3b67fc700 1 -- 172.21.15.154:0/3822596470 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0013680 con 0x7fa3c00a0a70 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3b67fc700 1 -- 172.21.15.154:0/3822596470 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b00137e0 con 0x7fa3c00a0a70 2023-09-30T22:22:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c011f460 con 0x7fa3c00a0a70 2023-09-30T22:22:27.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3b67fc700 1 -- 172.21.15.154:0/3822596470 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0013b50 con 0x7fa3c00a0a70 2023-09-30T22:22:27.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.178+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c00a0eb0 con 0x7fa3c00a0a70 2023-09-30T22:22:27.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.179+0000 7fa3b67fc700 1 -- 172.21.15.154:0/3822596470 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa3b0013cb0 con 0x7fa3c00a0a70 2023-09-30T22:22:27.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.179+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c009ed10 con 0x7fa3c00a0a70 2023-09-30T22:22:27.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.179+0000 7fa3c5b8c700 1 -- 172.21.15.154:0/3822596470 >> v1:172.21.15.154:6816/126757 conn(0x7fa3a402f510 legacy=0x7fa3a40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:27.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.180+0000 7fa3b67fc700 1 -- 172.21.15.154:0/3822596470 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa3b003fae0 con 0x7fa3c00a0a70 2023-09-30T22:22:27.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.184+0000 7fa3b67fc700 1 -- 172.21.15.154:0/3822596470 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3b001bbe0 con 0x7fa3c00a0a70 2023-09-30T22:22:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.242+0000 7f792e7fc700 1 -- 172.21.15.154:0/2478196238 >> v1:172.21.15.154:6816/126757 conn(0x7f791c02f560 legacy=0x7f791c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:27.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.286+0000 7f3fe2ffd700 1 -- 172.21.15.154:0/2318359767 >> v1:172.21.15.154:6816/126757 conn(0x7f3fd002f540 legacy=0x7f3fd00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:27.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.296+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7930120fb0 con 0x7f793009bc70 2023-09-30T22:22:27.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.297+0000 7f79177fe700 1 -- 172.21.15.154:0/2478196238 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7930120fb0 con 0x7f793009bc70 2023-09-30T22:22:27.297 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.299+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 >> v1:172.21.15.154:6816/126757 conn(0x7f791c02f560 legacy=0x7f791c031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:27.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.299+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f793009bc70 msgr2=0x7f793011db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.299+0000 7f79354d3700 1 --2- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f793009bc70 0x7f793011db20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f792000e8c0 tx=0x7f792000ebd0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.300+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 shutdown_connections 2023-09-30T22:22:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.300+0000 7f79354d3700 1 --2- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7930131980 0x7f793011e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.300+0000 7f79354d3700 1 --2- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f793009bc70 0x7f793011db20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.300+0000 7f79354d3700 1 --2- 172.21.15.154:0/2478196238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f793009c5c0 0x7f793011e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.300+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 >> 172.21.15.154:0/2478196238 conn(0x7f79300a2980 msgr2=0x7f793009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.300+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 shutdown_connections 2023-09-30T22:22:27.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.300+0000 7f79354d3700 1 -- 172.21.15.154:0/2478196238 wait complete. 2023-09-30T22:22:27.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.308+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3fe412d380 con 0x7f3fe41300a0 2023-09-30T22:22:27.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.308+0000 7f3fcbfff700 1 -- 172.21.15.154:0/2318359767 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fe412d380 con 0x7f3fe41300a0 2023-09-30T22:22:27.308 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.311+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 >> v1:172.21.15.154:6816/126757 conn(0x7f3fd002f540 legacy=0x7f3fd00319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.312+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe41300a0 msgr2=0x7f3fe411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.312+0000 7f3fe9d96700 1 --2- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe41300a0 0x7f3fe411da40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400e8e0 tx=0x7f3fd400ebf0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.312+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 shutdown_connections 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.312+0000 7f3fe9d96700 1 --2- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fe4133ad0 0x7f3fe411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.312+0000 7f3fe9d96700 1 --2- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fe41300a0 0x7f3fe411da40 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400e8e0 tx=0x7f3fd400ebf0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.312+0000 7f3fe9d96700 1 --2- 172.21.15.154:0/2318359767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fe41309f0 0x7f3fe411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.312+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 >> 172.21.15.154:0/2318359767 conn(0x7f3fe4099c40 msgr2=0x7f3fe4131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.312+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 shutdown_connections 2023-09-30T22:22:27.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.312+0000 7f3fe9d96700 1 -- 172.21.15.154:0/2318359767 wait complete. 2023-09-30T22:22:27.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:27.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.342+0000 7fbe5affd700 1 -- 172.21.15.154:0/2085626243 >> v1:172.21.15.154:6816/126757 conn(0x7fbe4802f510 legacy=0x7fbe480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:27.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.378+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3c009c7e0 con 0x7fa3c00a0a70 2023-09-30T22:22:27.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.378+0000 7fa3b67fc700 1 -- 172.21.15.154:0/3822596470 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3b0021070 con 0x7fa3c00a0a70 2023-09-30T22:22:27.378 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:27.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 >> v1:172.21.15.154:6816/126757 conn(0x7fa3a402f510 legacy=0x7fa3a40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:27.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3c00a0a70 msgr2=0x7fa3c011e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 --2- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3c00a0a70 0x7fa3c011e560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000e910 tx=0x7fa3b000ec20 comp rx=0 tx=0).stop 2023-09-30T22:22:27.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 shutdown_connections 2023-09-30T22:22:27.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 --2- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c0133f70 0x7fa3c011eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 --2- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c009ad40 0x7fa3c011e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 --2- 172.21.15.154:0/3822596470 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3c00a0a70 0x7fa3c011e560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 >> 172.21.15.154:0/3822596470 conn(0x7fa3c0099c40 msgr2=0x7fa3c01330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 shutdown_connections 2023-09-30T22:22:27.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.380+0000 7fa3c7df0700 1 -- 172.21.15.154:0/3822596470 wait complete. 2023-09-30T22:22:27.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:27.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.393+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe5c06c3b0 con 0x7fbe5c1300a0 2023-09-30T22:22:27.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.393+0000 7fbe43fff700 1 -- 172.21.15.154:0/2085626243 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe4c021070 con 0x7fbe5c1300a0 2023-09-30T22:22:27.393 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:27.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 >> v1:172.21.15.154:6816/126757 conn(0x7fbe4802f510 legacy=0x7fbe480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:27.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe5c1300a0 msgr2=0x7fbe5c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:27.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe5c1300a0 0x7fbe5c11da40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00e9b0 tx=0x7fbe4c00ed70 comp rx=0 tx=0).stop 2023-09-30T22:22:27.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 shutdown_connections 2023-09-30T22:22:27.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe5c133ad0 0x7fbe5c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe5c1300a0 0x7fbe5c11da40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 --2- 172.21.15.154:0/2085626243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe5c130bc0 0x7fbe5c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:27.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 >> 172.21.15.154:0/2085626243 conn(0x7fbe5c099c40 msgr2=0x7fbe5c131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:27.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 shutdown_connections 2023-09-30T22:22:27.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:27.395+0000 7fbe61bda700 1 -- 172.21.15.154:0/2085626243 wait complete. 2023-09-30T22:22:27.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:28.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:28.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:28.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:28.408 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.460+0000 7f3b8831b700 1 Processor -- start 2023-09-30T22:22:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.461+0000 7f3b8831b700 1 -- start start 2023-09-30T22:22:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.461+0000 7f3b8831b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b801368b0 0x7f3b80138c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.461+0000 7f3b8831b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b801391d0 0x7f3b8013b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.461+0000 7f3b8831b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8009ac40 con 0x7f3b8012cef0 2023-09-30T22:22:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.461+0000 7f3b8831b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8009a740 con 0x7f3b801368b0 2023-09-30T22:22:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.461+0000 7f3b8831b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8012d9d0 con 0x7f3b801391d0 2023-09-30T22:22:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.461+0000 7f3b858b6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b801368b0 0x7f3b80138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.461+0000 7f3b858b6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b801368b0 0x7f3b80138c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45872/0 (socket says 172.21.15.154:45872) 2023-09-30T22:22:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.461+0000 7f3b858b6700 1 -- 172.21.15.154:0/4063364633 learned_addr learned my addr 172.21.15.154:0/4063364633 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b868b8700 1 --2- 172.21.15.154:0/4063364633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b801391d0 0x7f3b8013b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b858b6700 1 -- 172.21.15.154:0/4063364633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b801391d0 msgr2=0x7f3b8013b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b858b6700 1 --2- 172.21.15.154:0/4063364633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b801391d0 0x7f3b8013b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b858b6700 1 -- 172.21.15.154:0/4063364633 >> v1:172.21.15.154:6789/0 conn(0x7f3b8012cef0 legacy=0x7f3b8012d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b858b6700 1 -- 172.21.15.154:0/4063364633 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8009f3a0 con 0x7f3b801368b0 2023-09-30T22:22:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b868b8700 1 --2- 172.21.15.154:0/4063364633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b801391d0 0x7f3b8013b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b858b6700 1 --2- 172.21.15.154:0/4063364633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b801368b0 0x7f3b80138c90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3b700098f0 tx=0x7f3b70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c850c5ca3c92e85a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b850b5700 1 -- 172.21.15.154:0/4063364633 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000b8a0 con 0x7f3b801368b0 2023-09-30T22:22:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b850b5700 1 -- 172.21.15.154:0/4063364633 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7000ba00 con 0x7f3b801368b0 2023-09-30T22:22:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.462+0000 7f3b850b5700 1 -- 172.21.15.154:0/4063364633 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000bd90 con 0x7f3b801368b0 2023-09-30T22:22:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.463+0000 7f3b8831b700 1 -- 172.21.15.154:0/4063364633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b801368b0 msgr2=0x7f3b80138c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.463+0000 7f3b8831b700 1 --2- 172.21.15.154:0/4063364633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b801368b0 0x7f3b80138c90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3b700098f0 tx=0x7f3b70009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.463+0000 7f3b8831b700 1 -- 172.21.15.154:0/4063364633 shutdown_connections 2023-09-30T22:22:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.463+0000 7f3b8831b700 1 --2- 172.21.15.154:0/4063364633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b801391d0 0x7f3b8013b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.463+0000 7f3b8831b700 1 --2- 172.21.15.154:0/4063364633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b801368b0 0x7f3b80138c90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.463+0000 7f3b8831b700 1 -- 172.21.15.154:0/4063364633 >> 172.21.15.154:0/4063364633 conn(0x7f3b80099c40 msgr2=0x7f3b800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.463+0000 7f3b8831b700 1 -- 172.21.15.154:0/4063364633 shutdown_connections 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.463+0000 7f3b8831b700 1 -- 172.21.15.154:0/4063364633 wait complete. 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.464+0000 7f3b8831b700 1 Processor -- start 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.464+0000 7f3b8831b700 1 -- start start 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.464+0000 7f3b8831b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8012cef0 0x7f3b8012e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.464+0000 7f3b8831b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b801368b0 0x7f3b8012e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.464+0000 7f3b8831b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b801391d0 0x7f3b8012ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b8831b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80138ca0 con 0x7f3b801368b0 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b8831b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8012fca0 con 0x7f3b8012cef0 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b8831b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8006f1e0 con 0x7f3b801391d0 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b860b7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8012cef0 0x7f3b8012e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b860b7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8012cef0 0x7f3b8012e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43714/0 (socket says 172.21.15.154:43714) 2023-09-30T22:22:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b860b7700 1 -- 172.21.15.154:0/960036813 learned_addr learned my addr 172.21.15.154:0/960036813 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b858b6700 1 --2- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b801368b0 0x7f3b8012e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b860b7700 1 -- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b801391d0 msgr2=0x7f3b8012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b860b7700 1 --2- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b801391d0 0x7f3b8012ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b860b7700 1 -- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b801368b0 msgr2=0x7f3b8012e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b860b7700 1 --2- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b801368b0 0x7f3b8012e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b860b7700 1 -- 172.21.15.154:0/960036813 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b70009550 con 0x7f3b8012cef0 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b860b7700 1 --2- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8012cef0 0x7f3b8012e200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c4e0 tx=0x7f3b7c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b76ffd700 1 -- 172.21.15.154:0/960036813 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0052d0 con 0x7f3b8012cef0 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b76ffd700 1 -- 172.21.15.154:0/960036813 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c005430 con 0x7f3b8012cef0 2023-09-30T22:22:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.465+0000 7f3b76ffd700 1 -- 172.21.15.154:0/960036813 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0038c0 con 0x7f3b8012cef0 2023-09-30T22:22:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.466+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8012dbb0 con 0x7f3b8012cef0 2023-09-30T22:22:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.466+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8006fc30 con 0x7f3b8012cef0 2023-09-30T22:22:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.467+0000 7f3b76ffd700 1 -- 172.21.15.154:0/960036813 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3b7c003a20 con 0x7f3b8012cef0 2023-09-30T22:22:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.467+0000 7f3b76ffd700 1 -- 172.21.15.154:0/960036813 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3b7c03f100 con 0x7f3b8012cef0 2023-09-30T22:22:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.467+0000 7f3b858b6700 1 -- 172.21.15.154:0/960036813 >> v1:172.21.15.154:6816/126757 conn(0x7f3b6402f510 legacy=0x7f3b640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.470+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8004f2a0 con 0x7f3b8012cef0 2023-09-30T22:22:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.476+0000 7f3b76ffd700 1 -- 172.21.15.154:0/960036813 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b7c019910 con 0x7f3b8012cef0 2023-09-30T22:22:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.500+0000 7f757bc76700 1 Processor -- start 2023-09-30T22:22:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.500+0000 7f757bc76700 1 -- start start 2023-09-30T22:22:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f757bc76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7574133ad0 0x7f7574133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f757bc76700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75741300a0 0x7f75741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f757bc76700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75741309f0 0x7f757413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f757bc76700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757406b2d0 con 0x7f75741300a0 2023-09-30T22:22:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f757bc76700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7574133610 con 0x7f75741309f0 2023-09-30T22:22:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f757bc76700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f757409a500 con 0x7f7574133ad0 2023-09-30T22:22:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f7579a12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7574133ad0 0x7f7574133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f7579a12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7574133ad0 0x7f7574133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40836/0 (socket says 172.21.15.154:40836) 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f7579a12700 1 -- 172.21.15.154:0/2139788348 learned_addr learned my addr 172.21.15.154:0/2139788348 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.501+0000 7f7579211700 1 --2- 172.21.15.154:0/2139788348 >> v2:172.21.15.154:3300/0 conn(0x7f75741300a0 0x7f75741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f757a213700 1 --2- 172.21.15.154:0/2139788348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75741309f0 0x7f757413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f7579a12700 1 -- 172.21.15.154:0/2139788348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75741309f0 msgr2=0x7f757413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f7579a12700 1 --2- 172.21.15.154:0/2139788348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75741309f0 0x7f757413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f7579a12700 1 -- 172.21.15.154:0/2139788348 >> v2:172.21.15.154:3300/0 conn(0x7f75741300a0 msgr2=0x7f75741304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f7579a12700 1 --2- 172.21.15.154:0/2139788348 >> v2:172.21.15.154:3300/0 conn(0x7f75741300a0 0x7f75741304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f7579a12700 1 -- 172.21.15.154:0/2139788348 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75741338b0 con 0x7f7574133ad0 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f7579a12700 1 --2- 172.21.15.154:0/2139788348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7574133ad0 0x7f7574133ea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75700098f0 tx=0x7f7570009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=369d90deeaaeb8c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f7578a10700 1 -- 172.21.15.154:0/2139788348 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570011830 con 0x7f7574133ad0 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f7578a10700 1 -- 172.21.15.154:0/2139788348 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7570011990 con 0x7f7574133ad0 2023-09-30T22:22:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.502+0000 7f7578a10700 1 -- 172.21.15.154:0/2139788348 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570011d20 con 0x7f7574133ad0 2023-09-30T22:22:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.503+0000 7f757bc76700 1 -- 172.21.15.154:0/2139788348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7574133ad0 msgr2=0x7f7574133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.503+0000 7f757bc76700 1 --2- 172.21.15.154:0/2139788348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7574133ad0 0x7f7574133ea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75700098f0 tx=0x7f7570009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.503+0000 7f757bc76700 1 -- 172.21.15.154:0/2139788348 shutdown_connections 2023-09-30T22:22:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.503+0000 7f757bc76700 1 --2- 172.21.15.154:0/2139788348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75741309f0 0x7f757413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.503+0000 7f757bc76700 1 --2- 172.21.15.154:0/2139788348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7574133ad0 0x7f7574133ea0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.503+0000 7f757bc76700 1 --2- 172.21.15.154:0/2139788348 >> v2:172.21.15.154:3300/0 conn(0x7f75741300a0 0x7f75741304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.503+0000 7f757bc76700 1 -- 172.21.15.154:0/2139788348 >> 172.21.15.154:0/2139788348 conn(0x7f7574099c40 msgr2=0x7f75740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.503+0000 7f757bc76700 1 -- 172.21.15.154:0/2139788348 shutdown_connections 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.503+0000 7f757bc76700 1 -- 172.21.15.154:0/2139788348 wait complete. 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.504+0000 7f757bc76700 1 Processor -- start 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.504+0000 7f757bc76700 1 -- start start 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.504+0000 7f757bc76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75741300a0 0x7f757411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.504+0000 7f757bc76700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75741309f0 0x7f757411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.504+0000 7f757bc76700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7574133ad0 0x7f757411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.504+0000 7f757bc76700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757411ef00 con 0x7f75741309f0 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.504+0000 7f757bc76700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757411ff10 con 0x7f7574133ad0 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.504+0000 7f757bc76700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75740a33e0 con 0x7f75741300a0 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f7579211700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75741309f0 0x7f757411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f7579211700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75741309f0 0x7f757411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45896/0 (socket says 172.21.15.154:45896) 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f7579211700 1 -- 172.21.15.154:0/3834628518 learned_addr learned my addr 172.21.15.154:0/3834628518 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f757a213700 1 --2- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7574133ad0 0x7f757411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f7579a12700 1 --2- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75741300a0 0x7f757411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f757a213700 1 -- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75741300a0 msgr2=0x7f757411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f757a213700 1 --2- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75741300a0 0x7f757411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f757a213700 1 -- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75741309f0 msgr2=0x7f757411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f757a213700 1 --2- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75741309f0 0x7f757411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f757a213700 1 -- 172.21.15.154:0/3834628518 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570009550 con 0x7f7574133ad0 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f757a213700 1 --2- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7574133ad0 0x7f757411e4c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f756c009d90 tx=0x7f756c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.505+0000 7f756a7fc700 1 -- 172.21.15.154:0/3834628518 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c009c00 con 0x7f7574133ad0 2023-09-30T22:22:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.506+0000 7f756a7fc700 1 -- 172.21.15.154:0/3834628518 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c00f040 con 0x7f7574133ad0 2023-09-30T22:22:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.506+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757411f6a0 con 0x7f7574133ad0 2023-09-30T22:22:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.506+0000 7f756a7fc700 1 -- 172.21.15.154:0/3834628518 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c014480 con 0x7f7574133ad0 2023-09-30T22:22:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.506+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757412dd00 con 0x7f7574133ad0 2023-09-30T22:22:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.507+0000 7f756a7fc700 1 -- 172.21.15.154:0/3834628518 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f756c0145e0 con 0x7f7574133ad0 2023-09-30T22:22:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.507+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75740a2620 con 0x7f7574133ad0 2023-09-30T22:22:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.507+0000 7f756a7fc700 1 -- 172.21.15.154:0/3834628518 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f756c040830 con 0x7f7574133ad0 2023-09-30T22:22:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.507+0000 7f7579a12700 1 -- 172.21.15.154:0/3834628518 >> v1:172.21.15.154:6816/126757 conn(0x7f755802f510 legacy=0x7f75580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.515+0000 7f756a7fc700 1 -- 172.21.15.154:0/3834628518 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f756c012520 con 0x7f7574133ad0 2023-09-30T22:22:28.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.547+0000 7fc846e43700 1 Processor -- start 2023-09-30T22:22:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.547+0000 7fc846e43700 1 -- start start 2023-09-30T22:22:28.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.547+0000 7fc846e43700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc8400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.547+0000 7fc846e43700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8400a1380 0x7fc840133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.547+0000 7fc846e43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc840133f50 0x7fc840134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.547+0000 7fc846e43700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84009e9d0 con 0x7fc8400a1380 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.547+0000 7fc846e43700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84009dc00 con 0x7fc8400a0a70 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.547+0000 7fc846e43700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc84009dec0 con 0x7fc840133f50 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc8453e0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc840133f50 0x7fc840134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc83ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8400a1380 0x7fc840133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc844bdf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc8400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc8453e0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc840133f50 0x7fc840134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40856/0 (socket says 172.21.15.154:40856) 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc8453e0700 1 -- 172.21.15.154:0/1473619447 learned_addr learned my addr 172.21.15.154:0/1473619447 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc8453e0700 1 -- 172.21.15.154:0/1473619447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 msgr2=0x7fc8400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc8453e0700 1 --2- 172.21.15.154:0/1473619447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc8400a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc8453e0700 1 -- 172.21.15.154:0/1473619447 >> v2:172.21.15.154:3300/0 conn(0x7fc8400a1380 msgr2=0x7fc840133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc8453e0700 1 --2- 172.21.15.154:0/1473619447 >> v2:172.21.15.154:3300/0 conn(0x7fc8400a1380 0x7fc840133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc8453e0700 1 -- 172.21.15.154:0/1473619447 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84009e6a0 con 0x7fc840133f50 2023-09-30T22:22:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc844bdf700 1 --2- 172.21.15.154:0/1473619447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc8400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.548+0000 7fc8453e0700 1 --2- 172.21.15.154:0/1473619447 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc840133f50 0x7fc840134380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc838009e50 tx=0x7fc83800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9e87fb0968ffc96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc83f7fe700 1 -- 172.21.15.154:0/1473619447 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800e070 con 0x7fc840133f50 2023-09-30T22:22:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc83f7fe700 1 -- 172.21.15.154:0/1473619447 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800b910 con 0x7fc840133f50 2023-09-30T22:22:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc83f7fe700 1 -- 172.21.15.154:0/1473619447 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800bcc0 con 0x7fc840133f50 2023-09-30T22:22:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc846e43700 1 -- 172.21.15.154:0/1473619447 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc840133f50 msgr2=0x7fc840134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc846e43700 1 --2- 172.21.15.154:0/1473619447 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc840133f50 0x7fc840134380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc838009e50 tx=0x7fc83800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc846e43700 1 -- 172.21.15.154:0/1473619447 shutdown_connections 2023-09-30T22:22:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc846e43700 1 --2- 172.21.15.154:0/1473619447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc8400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc846e43700 1 --2- 172.21.15.154:0/1473619447 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc840133f50 0x7fc840134380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc846e43700 1 --2- 172.21.15.154:0/1473619447 >> v2:172.21.15.154:3300/0 conn(0x7fc8400a1380 0x7fc840133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc846e43700 1 -- 172.21.15.154:0/1473619447 >> 172.21.15.154:0/1473619447 conn(0x7fc8400a6610 msgr2=0x7fc8400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc846e43700 1 -- 172.21.15.154:0/1473619447 shutdown_connections 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.549+0000 7fc846e43700 1 -- 172.21.15.154:0/1473619447 wait complete. 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.551+0000 7fc846e43700 1 Processor -- start 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.551+0000 7fc846e43700 1 -- start start 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc846e43700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc840121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc846e43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8400a1380 0x7fc8401218d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc846e43700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc840133f50 0x7fc840121e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc846e43700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840123e70 con 0x7fc840133f50 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc846e43700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc840124eb0 con 0x7fc8400a0a70 2023-09-30T22:22:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc846e43700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401249a0 con 0x7fc8400a1380 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc844bdf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc840121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc83ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8400a1380 0x7fc8401218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc844bdf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc840121390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43756/0 (socket says 172.21.15.154:43756) 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc844bdf700 1 -- 172.21.15.154:0/3766824706 learned_addr learned my addr 172.21.15.154:0/3766824706 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc8453e0700 1 --2- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc840133f50 0x7fc840121e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc844bdf700 1 -- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8400a1380 msgr2=0x7fc8401218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc844bdf700 1 --2- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8400a1380 0x7fc8401218d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc844bdf700 1 -- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc840133f50 msgr2=0x7fc840121e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc844bdf700 1 --2- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc840133f50 0x7fc840121e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc844bdf700 1 -- 172.21.15.154:0/3766824706 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340094a0 con 0x7fc8400a0a70 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.552+0000 7fc8453e0700 1 --2- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc840133f50 0x7fc840121e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.553+0000 7fc844bdf700 1 --2- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc840121390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc83400e9b0 tx=0x7fc83400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.553+0000 7fc83d7fa700 1 -- 172.21.15.154:0/3766824706 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340096e0 con 0x7fc8400a0a70 2023-09-30T22:22:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.553+0000 7fc83d7fa700 1 -- 172.21.15.154:0/3766824706 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400ee50 con 0x7fc8400a0a70 2023-09-30T22:22:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.553+0000 7fc83d7fa700 1 -- 172.21.15.154:0/3766824706 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400ca70 con 0x7fc8400a0a70 2023-09-30T22:22:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.554+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc838009b30 con 0x7fc8400a0a70 2023-09-30T22:22:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.554+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8400a50f0 con 0x7fc8400a0a70 2023-09-30T22:22:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.555+0000 7fc83d7fa700 1 -- 172.21.15.154:0/3766824706 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc83400cbd0 con 0x7fc8400a0a70 2023-09-30T22:22:28.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.555+0000 7fc83d7fa700 1 -- 172.21.15.154:0/3766824706 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc83403ffe0 con 0x7fc8400a0a70 2023-09-30T22:22:28.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.555+0000 7fc83ffff700 1 -- 172.21.15.154:0/3766824706 >> v1:172.21.15.154:6816/126757 conn(0x7fc82402f510 legacy=0x7fc8240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:28.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.556+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8400a0440 con 0x7fc8400a0a70 2023-09-30T22:22:28.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.565+0000 7fc83d7fa700 1 -- 172.21.15.154:0/3766824706 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc83401b3b0 con 0x7fc8400a0a70 2023-09-30T22:22:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.593+0000 7f6d388c3700 1 Processor -- start 2023-09-30T22:22:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.593+0000 7f6d388c3700 1 -- start start 2023-09-30T22:22:28.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d388c3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d340a0a70 0x7f6d340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d388c3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a1380 0x7f6d34133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d388c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d34133f50 0x7f6d341343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d388c3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3409e9d0 con 0x7f6d340a0a70 2023-09-30T22:22:28.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d388c3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3409dc00 con 0x7f6d340a1380 2023-09-30T22:22:28.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d388c3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3409dec0 con 0x7f6d34133f50 2023-09-30T22:22:28.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d32d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d34133f50 0x7f6d341343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d31d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a1380 0x7f6d34133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d32d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d34133f50 0x7f6d341343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40882/0 (socket says 172.21.15.154:40882) 2023-09-30T22:22:28.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d32d9d700 1 -- 172.21.15.154:0/2374474598 learned_addr learned my addr 172.21.15.154:0/2374474598 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d31d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a1380 0x7f6d34133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43764/0 (socket says 172.21.15.154:43764) 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d3259c700 1 --2- 172.21.15.154:0/2374474598 >> v2:172.21.15.154:3300/0 conn(0x7f6d340a0a70 0x7f6d340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d32d9d700 1 -- 172.21.15.154:0/2374474598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a1380 msgr2=0x7f6d34133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d32d9d700 1 --2- 172.21.15.154:0/2374474598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a1380 0x7f6d34133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d32d9d700 1 -- 172.21.15.154:0/2374474598 >> v2:172.21.15.154:3300/0 conn(0x7f6d340a0a70 msgr2=0x7f6d340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d32d9d700 1 --2- 172.21.15.154:0/2374474598 >> v2:172.21.15.154:3300/0 conn(0x7f6d340a0a70 0x7f6d340a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.594+0000 7f6d32d9d700 1 -- 172.21.15.154:0/2374474598 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3409e6a0 con 0x7f6d34133f50 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d32d9d700 1 --2- 172.21.15.154:0/2374474598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d34133f50 0x7f6d341343b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009e50 tx=0x7f6d2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd9392225072b51f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d3159a700 1 -- 172.21.15.154:0/2374474598 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00e070 con 0x7f6d34133f50 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d3159a700 1 -- 172.21.15.154:0/2374474598 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c00b910 con 0x7f6d34133f50 2023-09-30T22:22:28.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d3159a700 1 -- 172.21.15.154:0/2374474598 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00bcc0 con 0x7f6d34133f50 2023-09-30T22:22:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d388c3700 1 -- 172.21.15.154:0/2374474598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d34133f50 msgr2=0x7f6d341343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d388c3700 1 --2- 172.21.15.154:0/2374474598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d34133f50 0x7f6d341343b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009e50 tx=0x7f6d2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d388c3700 1 -- 172.21.15.154:0/2374474598 shutdown_connections 2023-09-30T22:22:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d388c3700 1 --2- 172.21.15.154:0/2374474598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d34133f50 0x7f6d341343b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d388c3700 1 --2- 172.21.15.154:0/2374474598 >> v2:172.21.15.154:3300/0 conn(0x7f6d340a0a70 0x7f6d340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d388c3700 1 --2- 172.21.15.154:0/2374474598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a1380 0x7f6d34133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d388c3700 1 -- 172.21.15.154:0/2374474598 >> 172.21.15.154:0/2374474598 conn(0x7f6d340a6610 msgr2=0x7f6d340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.595+0000 7f6d388c3700 1 -- 172.21.15.154:0/2374474598 shutdown_connections 2023-09-30T22:22:28.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.596+0000 7f6d388c3700 1 -- 172.21.15.154:0/2374474598 wait complete. 2023-09-30T22:22:28.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d388c3700 1 Processor -- start 2023-09-30T22:22:28.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d388c3700 1 -- start start 2023-09-30T22:22:28.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d388c3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a0a70 0x7f6d34121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d388c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d340a1380 0x7f6d34121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d388c3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d34133f50 0x7f6d34121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:28.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d388c3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d34124e50 con 0x7f6d34133f50 2023-09-30T22:22:28.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d388c3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d34123dd0 con 0x7f6d340a0a70 2023-09-30T22:22:28.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d388c3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d340a03e0 con 0x7f6d340a1380 2023-09-30T22:22:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d3259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a0a70 0x7f6d34121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d3259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a0a70 0x7f6d34121330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43774/0 (socket says 172.21.15.154:43774) 2023-09-30T22:22:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d3259c700 1 -- 172.21.15.154:0/283639793 learned_addr learned my addr 172.21.15.154:0/283639793 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d31d9b700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d340a1380 0x7f6d34121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.597+0000 7f6d32d9d700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d34133f50 0x7f6d34121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d3259c700 1 -- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d340a1380 msgr2=0x7f6d34121870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d3259c700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d340a1380 0x7f6d34121870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d3259c700 1 -- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d34133f50 msgr2=0x7f6d34121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d3259c700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d34133f50 0x7f6d34121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d3259c700 1 -- 172.21.15.154:0/283639793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c009b30 con 0x7f6d340a0a70 2023-09-30T22:22:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d32d9d700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d34133f50 0x7f6d34121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d3259c700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a0a70 0x7f6d34121330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400e840 tx=0x7f6d2400eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d22ffd700 1 -- 172.21.15.154:0/283639793 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24013610 con 0x7f6d340a0a70 2023-09-30T22:22:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d22ffd700 1 -- 172.21.15.154:0/283639793 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d24013770 con 0x7f6d340a0a70 2023-09-30T22:22:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d341245e0 con 0x7f6d340a0a70 2023-09-30T22:22:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d22ffd700 1 -- 172.21.15.154:0/283639793 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24013b00 con 0x7f6d340a0a70 2023-09-30T22:22:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.598+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d341248b0 con 0x7f6d340a0a70 2023-09-30T22:22:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.599+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3411e040 con 0x7f6d340a0a70 2023-09-30T22:22:28.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.600+0000 7f6d22ffd700 1 -- 172.21.15.154:0/283639793 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6d24013c60 con 0x7f6d340a0a70 2023-09-30T22:22:28.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.600+0000 7f6d22ffd700 1 -- 172.21.15.154:0/283639793 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6d2403fd50 con 0x7f6d340a0a70 2023-09-30T22:22:28.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.600+0000 7f6d31d9b700 1 -- 172.21.15.154:0/283639793 >> v1:172.21.15.154:6816/126757 conn(0x7f6d1402f510 legacy=0x7f6d140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:28.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.604+0000 7f6d22ffd700 1 -- 172.21.15.154:0/283639793 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d24026480 con 0x7f6d340a0a70 2023-09-30T22:22:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.668+0000 7f3b858b6700 1 -- 172.21.15.154:0/960036813 >> v1:172.21.15.154:6816/126757 conn(0x7f3b6402f510 legacy=0x7f3b640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.687+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b8006c3b0 con 0x7f3b8012cef0 2023-09-30T22:22:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.688+0000 7f3b76ffd700 1 -- 172.21.15.154:0/960036813 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b7c017020 con 0x7f3b8012cef0 2023-09-30T22:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 >> v1:172.21.15.154:6816/126757 conn(0x7f3b6402f510 legacy=0x7f3b640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8012cef0 msgr2=0x7f3b8012e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 --2- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8012cef0 0x7f3b8012e200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c4e0 tx=0x7f3b7c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 shutdown_connections 2023-09-30T22:22:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 --2- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b801391d0 0x7f3b8012ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 --2- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8012cef0 0x7f3b8012e200 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 --2- 172.21.15.154:0/960036813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b801368b0 0x7f3b8012e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 >> 172.21.15.154:0/960036813 conn(0x7f3b80099c40 msgr2=0x7f3b80134690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 shutdown_connections 2023-09-30T22:22:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.691+0000 7f3b8831b700 1 -- 172.21.15.154:0/960036813 wait complete. 2023-09-30T22:22:28.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.708+0000 7f7579a12700 1 -- 172.21.15.154:0/3834628518 >> v1:172.21.15.154:6816/126757 conn(0x7f755802f510 legacy=0x7f75580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:28.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.756+0000 7fc83ffff700 1 -- 172.21.15.154:0/3766824706 >> v1:172.21.15.154:6816/126757 conn(0x7fc82402f510 legacy=0x7fc8240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.759+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f757404f2a0 con 0x7f7574133ad0 2023-09-30T22:22:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.759+0000 7f756a7fc700 1 -- 172.21.15.154:0/3834628518 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f756c012340 con 0x7f7574133ad0 2023-09-30T22:22:28.759 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.761+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 >> v1:172.21.15.154:6816/126757 conn(0x7f755802f510 legacy=0x7f75580319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.761+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7574133ad0 msgr2=0x7f757411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.761+0000 7f757bc76700 1 --2- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7574133ad0 0x7f757411e4c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f756c009d90 tx=0x7f756c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.761+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 shutdown_connections 2023-09-30T22:22:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.761+0000 7f757bc76700 1 --2- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7574133ad0 0x7f757411e4c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.761+0000 7f757bc76700 1 --2- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75741300a0 0x7f757411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.761+0000 7f757bc76700 1 --2- 172.21.15.154:0/3834628518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75741309f0 0x7f757411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.761+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 >> 172.21.15.154:0/3834628518 conn(0x7f7574099c40 msgr2=0x7f757412f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.761+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 shutdown_connections 2023-09-30T22:22:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.762+0000 7f757bc76700 1 -- 172.21.15.154:0/3834628518 wait complete. 2023-09-30T22:22:28.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:28.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.801+0000 7f6d31d9b700 1 -- 172.21.15.154:0/283639793 >> v1:172.21.15.154:6816/126757 conn(0x7f6d1402f510 legacy=0x7f6d140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:28.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.804+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc84004f2a0 con 0x7fc8400a0a70 2023-09-30T22:22:28.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.804+0000 7fc83d7fa700 1 -- 172.21.15.154:0/3766824706 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc834011b00 con 0x7fc8400a0a70 2023-09-30T22:22:28.804 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:28.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 >> v1:172.21.15.154:6816/126757 conn(0x7fc82402f510 legacy=0x7fc8240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:28.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 msgr2=0x7fc840121390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 --2- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc840121390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc83400e9b0 tx=0x7fc83400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 shutdown_connections 2023-09-30T22:22:28.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 --2- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc840133f50 0x7fc840121e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 --2- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8400a0a70 0x7fc840121390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 --2- 172.21.15.154:0/3766824706 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8400a1380 0x7fc8401218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 >> 172.21.15.154:0/3766824706 conn(0x7fc8400a6610 msgr2=0x7fc84009bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 shutdown_connections 2023-09-30T22:22:28.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.806+0000 7fc846e43700 1 -- 172.21.15.154:0/3766824706 wait complete. 2023-09-30T22:22:28.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:28.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.822+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6d3404f2a0 con 0x7f6d340a0a70 2023-09-30T22:22:28.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.822+0000 7f6d22ffd700 1 -- 172.21.15.154:0/283639793 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d24024b40 con 0x7f6d340a0a70 2023-09-30T22:22:28.822 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 >> v1:172.21.15.154:6816/126757 conn(0x7f6d1402f510 legacy=0x7f6d140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a0a70 msgr2=0x7f6d34121330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a0a70 0x7f6d34121330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d2400e840 tx=0x7f6d2400eb50 comp rx=0 tx=0).stop 2023-09-30T22:22:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 shutdown_connections 2023-09-30T22:22:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d34133f50 0x7f6d34121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d340a0a70 0x7f6d34121330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 --2- 172.21.15.154:0/283639793 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d340a1380 0x7f6d34121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 >> 172.21.15.154:0/283639793 conn(0x7f6d340a6610 msgr2=0x7f6d34133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 shutdown_connections 2023-09-30T22:22:28.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:28.825+0000 7f6d388c3700 1 -- 172.21.15.154:0/283639793 wait complete. 2023-09-30T22:22:28.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:29.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:29.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:29.820 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:29.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:29.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.853+0000 7f13a4a59700 1 Processor -- start 2023-09-30T22:22:29.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.853+0000 7f13a4a59700 1 -- start start 2023-09-30T22:22:29.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f13a4a59700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a009d860 0x7f13a009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f13a4a59700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a0130eb0 0x7f13a0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f13a4a59700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a009aaa0 con 0x7f13a009e170 2023-09-30T22:22:29.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f13a4a59700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a009f870 con 0x7f13a0130eb0 2023-09-30T22:22:29.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f13a4a59700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13a009b360 con 0x7f13a009d860 2023-09-30T22:22:29.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a009d860 0x7f13a009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a009d860 0x7f13a009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40894/0 (socket says 172.21.15.154:40894) 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139e59c700 1 -- 172.21.15.154:0/709752849 learned_addr learned my addr 172.21.15.154:0/709752849 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139ed9d700 1 --2- 172.21.15.154:0/709752849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a0130eb0 0x7f13a0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139e59c700 1 -- 172.21.15.154:0/709752849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a0130eb0 msgr2=0x7f13a0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139e59c700 1 --2- 172.21.15.154:0/709752849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a0130eb0 0x7f13a0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139e59c700 1 -- 172.21.15.154:0/709752849 >> v1:172.21.15.154:6789/0 conn(0x7f13a009e170 legacy=0x7f13a01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139e59c700 1 -- 172.21.15.154:0/709752849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a009b620 con 0x7f13a009d860 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139e59c700 1 --2- 172.21.15.154:0/709752849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a009d860 0x7f13a009dc30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1390009920 tx=0x7f1390009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf3f2bd9bbb65e71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.854+0000 7f139d59a700 1 -- 172.21.15.154:0/709752849 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000f8a0 con 0x7f13a009d860 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.855+0000 7f139d59a700 1 -- 172.21.15.154:0/709752849 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000fa00 con 0x7f13a009d860 2023-09-30T22:22:29.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.855+0000 7f139d59a700 1 -- 172.21.15.154:0/709752849 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000fd90 con 0x7f13a009d860 2023-09-30T22:22:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.855+0000 7f13a4a59700 1 -- 172.21.15.154:0/709752849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a009d860 msgr2=0x7f13a009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.855+0000 7f13a4a59700 1 --2- 172.21.15.154:0/709752849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a009d860 0x7f13a009dc30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1390009920 tx=0x7f1390009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.855+0000 7f13a4a59700 1 -- 172.21.15.154:0/709752849 shutdown_connections 2023-09-30T22:22:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.855+0000 7f13a4a59700 1 --2- 172.21.15.154:0/709752849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a0130eb0 0x7f13a0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.855+0000 7f13a4a59700 1 --2- 172.21.15.154:0/709752849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a009d860 0x7f13a009dc30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.855+0000 7f13a4a59700 1 -- 172.21.15.154:0/709752849 >> 172.21.15.154:0/709752849 conn(0x7f13a0099c40 msgr2=0x7f13a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.855+0000 7f13a4a59700 1 -- 172.21.15.154:0/709752849 shutdown_connections 2023-09-30T22:22:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.856+0000 7f13a4a59700 1 -- 172.21.15.154:0/709752849 wait complete. 2023-09-30T22:22:29.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f13a4a59700 1 Processor -- start 2023-09-30T22:22:29.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f13a4a59700 1 -- start start 2023-09-30T22:22:29.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f13a4a59700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a009d860 0x7f13a011e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f13a4a59700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a009e170 0x7f13a011e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f13a4a59700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a0130eb0 0x7f13a011ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f13a4a59700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a009c8b0 con 0x7f13a009d860 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f13a4a59700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a0121cc0 con 0x7f13a009e170 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f13a4a59700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13a01201a0 con 0x7f13a0130eb0 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f139e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a009d860 0x7f13a011e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f139e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a009d860 0x7f13a011e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45938/0 (socket says 172.21.15.154:45938) 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f139e59c700 1 -- 172.21.15.154:0/1746780238 learned_addr learned my addr 172.21.15.154:0/1746780238 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f139ed9d700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a0130eb0 0x7f13a011ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.857+0000 7f139dd9b700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a009e170 0x7f13a011e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f139ed9d700 1 -- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a009e170 msgr2=0x7f13a011e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f139ed9d700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a009e170 0x7f13a011e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f139ed9d700 1 -- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a009d860 msgr2=0x7f13a011e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f139ed9d700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a009d860 0x7f13a011e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f139ed9d700 1 -- 172.21.15.154:0/1746780238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390009550 con 0x7f13a0130eb0 2023-09-30T22:22:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f139e59c700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a009d860 0x7f13a011e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f139ed9d700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a0130eb0 0x7f13a011ef00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f139800b390 tx=0x7f139800b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f138effd700 1 -- 172.21.15.154:0/1746780238 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398015070 con 0x7f13a0130eb0 2023-09-30T22:22:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f138effd700 1 -- 172.21.15.154:0/1746780238 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139800bd10 con 0x7f13a0130eb0 2023-09-30T22:22:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a0120640 con 0x7f13a0130eb0 2023-09-30T22:22:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f138effd700 1 -- 172.21.15.154:0/1746780238 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398019650 con 0x7f13a0130eb0 2023-09-30T22:22:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.858+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a00a23b0 con 0x7f13a0130eb0 2023-09-30T22:22:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.859+0000 7f138effd700 1 -- 172.21.15.154:0/1746780238 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f13980223b0 con 0x7f13a0130eb0 2023-09-30T22:22:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.859+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a004f2a0 con 0x7f13a0130eb0 2023-09-30T22:22:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.859+0000 7f139e59c700 1 -- 172.21.15.154:0/1746780238 >> v1:172.21.15.154:6816/126757 conn(0x7f138002f510 legacy=0x7f13800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.859+0000 7f138effd700 1 -- 172.21.15.154:0/1746780238 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1398043b00 con 0x7f13a0130eb0 2023-09-30T22:22:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.868+0000 7f138effd700 1 -- 172.21.15.154:0/1746780238 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13980206d0 con 0x7f13a0130eb0 2023-09-30T22:22:29.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.923+0000 7fa689157700 1 Processor -- start 2023-09-30T22:22:29.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.923+0000 7fa689157700 1 -- start start 2023-09-30T22:22:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa689157700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6840a0a70 0x7fa6840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa689157700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 0x7fa684133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa689157700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68409dc00 con 0x7fa684133f50 2023-09-30T22:22:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa689157700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68409ea60 con 0x7fa6840a0a70 2023-09-30T22:22:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa689157700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa68409dec0 con 0x7fa6840a1380 2023-09-30T22:22:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa682d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6840a0a70 0x7fa6840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa682d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6840a0a70 0x7fa6840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45952/0 (socket says 172.21.15.154:45952) 2023-09-30T22:22:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa682d9d700 1 -- 172.21.15.154:0/4237569385 learned_addr learned my addr 172.21.15.154:0/4237569385 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa68259c700 1 --2- 172.21.15.154:0/4237569385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 0x7fa684133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa682d9d700 1 -- 172.21.15.154:0/4237569385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 msgr2=0x7fa684133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa682d9d700 1 --2- 172.21.15.154:0/4237569385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 0x7fa684133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa682d9d700 1 -- 172.21.15.154:0/4237569385 >> v1:172.21.15.154:6789/0 conn(0x7fa684133f50 legacy=0x7fa68413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.924+0000 7fa682d9d700 1 -- 172.21.15.154:0/4237569385 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68409e6a0 con 0x7fa6840a0a70 2023-09-30T22:22:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.925+0000 7fa682d9d700 1 --2- 172.21.15.154:0/4237569385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 0x7fa6840a0e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa6740098f0 tx=0x7fa674009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1645d8e02e66e61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.925+0000 7fa681d9b700 1 -- 172.21.15.154:0/4237569385 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674011830 con 0x7fa6840a0a70 2023-09-30T22:22:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.925+0000 7fa681d9b700 1 -- 172.21.15.154:0/4237569385 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674011990 con 0x7fa6840a0a70 2023-09-30T22:22:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.925+0000 7fa681d9b700 1 -- 172.21.15.154:0/4237569385 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674011d20 con 0x7fa6840a0a70 2023-09-30T22:22:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.926+0000 7fa689157700 1 -- 172.21.15.154:0/4237569385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 msgr2=0x7fa6840a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.926+0000 7fa689157700 1 --2- 172.21.15.154:0/4237569385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 0x7fa6840a0e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa6740098f0 tx=0x7fa674009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.926+0000 7fa689157700 1 -- 172.21.15.154:0/4237569385 shutdown_connections 2023-09-30T22:22:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.926+0000 7fa689157700 1 --2- 172.21.15.154:0/4237569385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 0x7fa6840a0e40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.926+0000 7fa689157700 1 --2- 172.21.15.154:0/4237569385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 0x7fa684133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.926+0000 7fa689157700 1 -- 172.21.15.154:0/4237569385 >> 172.21.15.154:0/4237569385 conn(0x7fa6840a6610 msgr2=0x7fa6840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.926+0000 7fa689157700 1 -- 172.21.15.154:0/4237569385 shutdown_connections 2023-09-30T22:22:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.926+0000 7fa689157700 1 -- 172.21.15.154:0/4237569385 wait complete. 2023-09-30T22:22:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.927+0000 7fa689157700 1 Processor -- start 2023-09-30T22:22:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.927+0000 7fa689157700 1 -- start start 2023-09-30T22:22:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa689157700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 0x7fa6841c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa689157700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 0x7fa6841c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa689157700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa684133f50 0x7fa6841c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa689157700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6841251f0 con 0x7fa6840a0a70 2023-09-30T22:22:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa689157700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa684124950 con 0x7fa684133f50 2023-09-30T22:22:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa689157700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa684123250 con 0x7fa6840a1380 2023-09-30T22:22:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa68259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 0x7fa6841c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa68359e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa684133f50 0x7fa6841c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa68259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 0x7fa6841c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40926/0 (socket says 172.21.15.154:40926) 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa68359e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa684133f50 0x7fa6841c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43800/0 (socket says 172.21.15.154:43800) 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa68259c700 1 -- 172.21.15.154:0/3711700662 learned_addr learned my addr 172.21.15.154:0/3711700662 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.928+0000 7fa682d9d700 1 --2- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 0x7fa6841c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa68359e700 1 -- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 msgr2=0x7fa6841c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa68359e700 1 --2- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 0x7fa6841c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa68359e700 1 -- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 msgr2=0x7fa6841c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa68359e700 1 --2- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 0x7fa6841c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa68359e700 1 -- 172.21.15.154:0/3711700662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009550 con 0x7fa684133f50 2023-09-30T22:22:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa682d9d700 1 --2- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 0x7fa6841c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa68359e700 1 --2- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa684133f50 0x7fa6841c8ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00cb90 tx=0x7fa67c00cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa66b7fe700 1 -- 172.21.15.154:0/3711700662 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c003c00 con 0x7fa684133f50 2023-09-30T22:22:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa66b7fe700 1 -- 172.21.15.154:0/3711700662 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c003d60 con 0x7fa684133f50 2023-09-30T22:22:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa684124ed0 con 0x7fa684133f50 2023-09-30T22:22:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa66b7fe700 1 -- 172.21.15.154:0/3711700662 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00aa80 con 0x7fa684133f50 2023-09-30T22:22:29.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.929+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa684126290 con 0x7fa684133f50 2023-09-30T22:22:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.931+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68404f2a0 con 0x7fa684133f50 2023-09-30T22:22:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.931+0000 7fa66b7fe700 1 -- 172.21.15.154:0/3711700662 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa67c00abe0 con 0x7fa684133f50 2023-09-30T22:22:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.931+0000 7fa66b7fe700 1 -- 172.21.15.154:0/3711700662 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa67c03fae0 con 0x7fa684133f50 2023-09-30T22:22:29.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.931+0000 7fa682d9d700 1 -- 172.21.15.154:0/3711700662 >> v1:172.21.15.154:6816/126757 conn(0x7fa67002f540 legacy=0x7fa6700319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.940+0000 7fa66b7fe700 1 -- 172.21.15.154:0/3711700662 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa67c0198f0 con 0x7fa684133f50 2023-09-30T22:22:29.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.953+0000 7f8004d70700 1 Processor -- start 2023-09-30T22:22:29.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f8004d70700 1 -- start start 2023-09-30T22:22:29.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f8004d70700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80000a1550 0x7f8000138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f8004d70700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f8004d70700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800009e9d0 con 0x7f80000a0a70 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f8004d70700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800009dc00 con 0x7f80000a1550 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f8004d70700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800009dec0 con 0x7f8000139200 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f7ffed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f7ffed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43816/0 (socket says 172.21.15.154:43816) 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f7ffed9d700 1 -- 172.21.15.154:0/3148662244 learned_addr learned my addr 172.21.15.154:0/3148662244 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.954+0000 7f7ffdd9b700 1 --2- 172.21.15.154:0/3148662244 >> v2:172.21.15.154:3300/0 conn(0x7f80000a1550 0x7f8000138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.955+0000 7f7ffed9d700 1 -- 172.21.15.154:0/3148662244 >> v2:172.21.15.154:3300/0 conn(0x7f80000a1550 msgr2=0x7f8000138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.955+0000 7f7ffed9d700 1 --2- 172.21.15.154:0/3148662244 >> v2:172.21.15.154:3300/0 conn(0x7f80000a1550 0x7f8000138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.955+0000 7f7ffed9d700 1 -- 172.21.15.154:0/3148662244 >> v1:172.21.15.154:6789/0 conn(0x7f80000a0a70 legacy=0x7f80000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.955+0000 7f7ffed9d700 1 -- 172.21.15.154:0/3148662244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800009e6a0 con 0x7f8000139200 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.955+0000 7f7ffdd9b700 1 --2- 172.21.15.154:0/3148662244 >> v2:172.21.15.154:3300/0 conn(0x7f80000a1550 0x7f8000138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.955+0000 7f7ffed9d700 1 --2- 172.21.15.154:0/3148662244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800013b5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009e50 tx=0x7f7ff800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7617354982fbc51f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.955+0000 7f7ffd59a700 1 -- 172.21.15.154:0/3148662244 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800e070 con 0x7f8000139200 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.955+0000 7f7ffd59a700 1 -- 172.21.15.154:0/3148662244 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800b910 con 0x7f8000139200 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.955+0000 7f7ffd59a700 1 -- 172.21.15.154:0/3148662244 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800bcc0 con 0x7f8000139200 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.956+0000 7f8004d70700 1 -- 172.21.15.154:0/3148662244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 msgr2=0x7f800013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.956+0000 7f8004d70700 1 --2- 172.21.15.154:0/3148662244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800013b5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009e50 tx=0x7f7ff800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.956+0000 7f8004d70700 1 -- 172.21.15.154:0/3148662244 shutdown_connections 2023-09-30T22:22:29.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.956+0000 7f8004d70700 1 --2- 172.21.15.154:0/3148662244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800013b5e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.956+0000 7f8004d70700 1 --2- 172.21.15.154:0/3148662244 >> v2:172.21.15.154:3300/0 conn(0x7f80000a1550 0x7f8000138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.956+0000 7f8004d70700 1 -- 172.21.15.154:0/3148662244 >> 172.21.15.154:0/3148662244 conn(0x7f80000a6610 msgr2=0x7f80000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.956+0000 7f8004d70700 1 -- 172.21.15.154:0/3148662244 shutdown_connections 2023-09-30T22:22:29.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.956+0000 7f8004d70700 1 -- 172.21.15.154:0/3148662244 wait complete. 2023-09-30T22:22:29.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.957+0000 7f8004d70700 1 Processor -- start 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.957+0000 7f8004d70700 1 -- start start 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.957+0000 7f8004d70700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80000a0a70 0x7f800011e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.957+0000 7f8004d70700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f80000a1550 0x7f800011ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.957+0000 7f8004d70700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800011f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.957+0000 7f8004d70700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000a0470 con 0x7f80000a0a70 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.957+0000 7f8004d70700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8000122050 con 0x7f8000139200 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.957+0000 7f8004d70700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8000121aa0 con 0x7f80000a1550 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800011f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800011f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43822/0 (socket says 172.21.15.154:43822) 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffed9d700 1 -- 172.21.15.154:0/2826332769 learned_addr learned my addr 172.21.15.154:0/2826332769 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:29.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffe59c700 1 --2- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80000a0a70 0x7f800011e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffe59c700 1 -- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f80000a1550 msgr2=0x7f800011ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffe59c700 1 --2- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f80000a1550 0x7f800011ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffe59c700 1 -- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 msgr2=0x7f800011f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffe59c700 1 --2- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800011f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffe59c700 1 -- 172.21.15.154:0/2826332769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff40094a0 con 0x7f80000a0a70 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffed9d700 1 --2- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800011f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7ffe59c700 1 --2- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80000a0a70 0x7f800011e8a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0000f60 tx=0x7f7ff000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7feeffd700 1 -- 172.21.15.154:0/2826332769 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00052d0 con 0x7f80000a0a70 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7feeffd700 1 -- 172.21.15.154:0/2826332769 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff0005430 con 0x7f80000a0a70 2023-09-30T22:22:29.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff8009b30 con 0x7f80000a0a70 2023-09-30T22:22:29.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f7feeffd700 1 -- 172.21.15.154:0/2826332769 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00038c0 con 0x7f80000a0a70 2023-09-30T22:22:29.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.958+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8000120530 con 0x7f80000a0a70 2023-09-30T22:22:29.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.959+0000 7f7feeffd700 1 -- 172.21.15.154:0/2826332769 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7ff0003a20 con 0x7f80000a0a70 2023-09-30T22:22:29.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.960+0000 7f7feeffd700 1 -- 172.21.15.154:0/2826332769 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7ff003ef10 con 0x7f80000a0a70 2023-09-30T22:22:29.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.960+0000 7f7ffdd9b700 1 -- 172.21.15.154:0/2826332769 >> v1:172.21.15.154:6816/126757 conn(0x7f7fe002f510 legacy=0x7f7fe00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:29.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.960+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800004f2a0 con 0x7f80000a0a70 2023-09-30T22:22:29.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.968+0000 7f7feeffd700 1 -- 172.21.15.154:0/2826332769 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ff0019910 con 0x7f80000a0a70 2023-09-30T22:22:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.987+0000 7f6c8d58a700 1 Processor -- start 2023-09-30T22:22:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.987+0000 7f6c8d58a700 1 -- start start 2023-09-30T22:22:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c8d58a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134140 0x7f6c88138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c8d58a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c88134570 0x7f6c8813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c8d58a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8809b110 con 0x7f6c8809ad40 2023-09-30T22:22:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c8d58a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880a3b60 con 0x7f6c88134140 2023-09-30T22:22:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c8d58a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880a1a80 con 0x7f6c88134570 2023-09-30T22:22:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c867fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134140 0x7f6c88138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c88134570 0x7f6c8813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c86ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6c8809ad40 0x7f6c88133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35142/0 (socket says 172.21.15.154:35142) 2023-09-30T22:22:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c867fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134140 0x7f6c88138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43826/0 (socket says 172.21.15.154:43826) 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c86ffd700 1 -- 172.21.15.154:0/3705035888 learned_addr learned my addr 172.21.15.154:0/3705035888 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c867fc700 1 -- 172.21.15.154:0/3705035888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c88134570 msgr2=0x7f6c8813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c867fc700 1 --2- 172.21.15.154:0/3705035888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c88134570 0x7f6c8813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c867fc700 1 -- 172.21.15.154:0/3705035888 >> v1:172.21.15.154:6789/0 conn(0x7f6c8809ad40 legacy=0x7f6c88133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.988+0000 7f6c867fc700 1 -- 172.21.15.154:0/3705035888 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880a2fa0 con 0x7f6c88134140 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c867fc700 1 --2- 172.21.15.154:0/3705035888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134140 0x7f6c88138e80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0098a0 tx=0x7f6c7c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ee0494af2575479 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c85ffb700 1 -- 172.21.15.154:0/3705035888 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c011830 con 0x7f6c88134140 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c85ffb700 1 -- 172.21.15.154:0/3705035888 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c011990 con 0x7f6c88134140 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c85ffb700 1 -- 172.21.15.154:0/3705035888 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c011d20 con 0x7f6c88134140 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3705035888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134140 msgr2=0x7f6c88138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c8d58a700 1 --2- 172.21.15.154:0/3705035888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134140 0x7f6c88138e80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0098a0 tx=0x7f6c7c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3705035888 shutdown_connections 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c8d58a700 1 --2- 172.21.15.154:0/3705035888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c88134570 0x7f6c8813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c8d58a700 1 --2- 172.21.15.154:0/3705035888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134140 0x7f6c88138e80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.989+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3705035888 >> 172.21.15.154:0/3705035888 conn(0x7f6c88099c40 msgr2=0x7f6c8806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.990+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3705035888 shutdown_connections 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.990+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3705035888 wait complete. 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c8d58a700 1 Processor -- start 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c8d58a700 1 -- start start 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c8d58a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c8809ad40 0x7f6c8811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c8d58a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c88134140 0x7f6c8811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c8d58a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134570 0x7f6c8811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c8d58a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8811ed10 con 0x7f6c88134140 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c8d58a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8811dba0 con 0x7f6c88134570 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c8d58a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8809e910 con 0x7f6c8809ad40 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c867fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c88134140 0x7f6c8811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134570 0x7f6c8811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c867fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c88134140 0x7f6c8811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45998/0 (socket says 172.21.15.154:45998) 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c867fc700 1 -- 172.21.15.154:0/3928042181 learned_addr learned my addr 172.21.15.154:0/3928042181 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.991+0000 7f6c86ffd700 1 --2- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c8809ad40 0x7f6c8811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c867fc700 1 -- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c8809ad40 msgr2=0x7f6c8811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c867fc700 1 --2- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c8809ad40 0x7f6c8811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c867fc700 1 -- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134570 msgr2=0x7f6c8811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c867fc700 1 --2- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134570 0x7f6c8811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c867fc700 1 -- 172.21.15.154:0/3928042181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0094a0 con 0x7f6c88134140 2023-09-30T22:22:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c867fc700 1 --2- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c88134140 0x7f6c8811ce00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0090b0 tx=0x7f6c7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c6f7fe700 1 -- 172.21.15.154:0/3928042181 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c004550 con 0x7f6c88134140 2023-09-30T22:22:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c6f7fe700 1 -- 172.21.15.154:0/3928042181 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c01f070 con 0x7f6c88134140 2023-09-30T22:22:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c6f7fe700 1 -- 172.21.15.154:0/3928042181 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0038e0 con 0x7f6c88134140 2023-09-30T22:22:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8809c7e0 con 0x7f6c88134140 2023-09-30T22:22:29.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.992+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8811e960 con 0x7f6c88134140 2023-09-30T22:22:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.993+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c880a3290 con 0x7f6c88134140 2023-09-30T22:22:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.993+0000 7f6c6f7fe700 1 -- 172.21.15.154:0/3928042181 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6c7c003a40 con 0x7f6c88134140 2023-09-30T22:22:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.994+0000 7f6c86ffd700 1 -- 172.21.15.154:0/3928042181 >> v1:172.21.15.154:6816/126757 conn(0x7f6c7402f510 legacy=0x7f6c740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.994+0000 7f6c6f7fe700 1 -- 172.21.15.154:0/3928042181 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6c7c021070 con 0x7f6c88134140 2023-09-30T22:22:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:29.998+0000 7f6c6f7fe700 1 -- 172.21.15.154:0/3928042181 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c7c010380 con 0x7f6c88134140 2023-09-30T22:22:30.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.060+0000 7f139e59c700 1 -- 172.21.15.154:0/1746780238 >> v1:172.21.15.154:6816/126757 conn(0x7f138002f510 legacy=0x7f13800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:30.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.132+0000 7fa682d9d700 1 -- 172.21.15.154:0/3711700662 >> v1:172.21.15.154:6816/126757 conn(0x7fa67002f540 legacy=0x7fa6700319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:30.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.139+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13a0121e00 con 0x7f13a0130eb0 2023-09-30T22:22:30.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.139+0000 7f138effd700 1 -- 172.21.15.154:0/1746780238 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13a0121e00 con 0x7f13a0130eb0 2023-09-30T22:22:30.139 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:30.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.142+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 >> v1:172.21.15.154:6816/126757 conn(0x7f138002f510 legacy=0x7f13800319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:30.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.142+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a0130eb0 msgr2=0x7f13a011ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.142+0000 7f13a4a59700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a0130eb0 0x7f13a011ef00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f139800b390 tx=0x7f139800b6a0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.142+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 shutdown_connections 2023-09-30T22:22:30.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.142+0000 7f13a4a59700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13a0130eb0 0x7f13a011ef00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.142+0000 7f13a4a59700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13a009d860 0x7f13a011e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.142+0000 7f13a4a59700 1 --2- 172.21.15.154:0/1746780238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13a009e170 0x7f13a011e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.142+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 >> 172.21.15.154:0/1746780238 conn(0x7f13a0099c40 msgr2=0x7f13a0070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.143+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 shutdown_connections 2023-09-30T22:22:30.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.143+0000 7f13a4a59700 1 -- 172.21.15.154:0/1746780238 wait complete. 2023-09-30T22:22:30.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:30.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.161+0000 7f7ffdd9b700 1 -- 172.21.15.154:0/2826332769 >> v1:172.21.15.154:6816/126757 conn(0x7f7fe002f510 legacy=0x7f7fe00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:30.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.163+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8000120c10 con 0x7f80000a0a70 2023-09-30T22:22:30.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.164+0000 7f7feeffd700 1 -- 172.21.15.154:0/2826332769 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ff0017020 con 0x7f80000a0a70 2023-09-30T22:22:30.164 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:30.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 >> v1:172.21.15.154:6816/126757 conn(0x7f7fe002f510 legacy=0x7f7fe00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:30.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80000a0a70 msgr2=0x7f800011e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 --2- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80000a0a70 0x7f800011e8a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0000f60 tx=0x7f7ff000c730 comp rx=0 tx=0).stop 2023-09-30T22:22:30.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 shutdown_connections 2023-09-30T22:22:30.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 --2- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8000139200 0x7f800011f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 --2- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80000a0a70 0x7f800011e8a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 --2- 172.21.15.154:0/2826332769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f80000a1550 0x7f800011ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 >> 172.21.15.154:0/2826332769 conn(0x7f80000a6610 msgr2=0x7f8000138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 shutdown_connections 2023-09-30T22:22:30.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.166+0000 7f8004d70700 1 -- 172.21.15.154:0/2826332769 wait complete. 2023-09-30T22:22:30.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:30.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.193+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa68409c6b0 con 0x7fa684133f50 2023-09-30T22:22:30.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.194+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c8804f2a0 con 0x7f6c88134140 2023-09-30T22:22:30.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.195+0000 7f6c86ffd700 1 -- 172.21.15.154:0/3928042181 >> v1:172.21.15.154:6816/126757 conn(0x7f6c7402f510 legacy=0x7f6c740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:30.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.195+0000 7f6c6f7fe700 1 -- 172.21.15.154:0/3928042181 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c7c015030 con 0x7f6c88134140 2023-09-30T22:22:30.195 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:30.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.195+0000 7fa66b7fe700 1 -- 172.21.15.154:0/3711700662 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa67c019300 con 0x7fa684133f50 2023-09-30T22:22:30.195 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:30.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 >> v1:172.21.15.154:6816/126757 conn(0x7f6c7402f510 legacy=0x7f6c740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:30.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c88134140 msgr2=0x7f6c8811ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7f6c8d58a700 1 --2- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c88134140 0x7f6c8811ce00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0090b0 tx=0x7f6c7c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:30.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 shutdown_connections 2023-09-30T22:22:30.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7f6c8d58a700 1 --2- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c88134570 0x7f6c8811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7f6c8d58a700 1 --2- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c8809ad40 0x7f6c8811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 >> v1:172.21.15.154:6816/126757 conn(0x7fa67002f540 legacy=0x7fa6700319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7f6c8d58a700 1 --2- 172.21.15.154:0/3928042181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c88134140 0x7f6c8811ce00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 >> 172.21.15.154:0/3928042181 conn(0x7f6c88099c40 msgr2=0x7f6c880a6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa684133f50 msgr2=0x7fa6841c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:30.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.197+0000 7fa689157700 1 --2- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa684133f50 0x7fa6841c8ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00cb90 tx=0x7fa67c00cea0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.198+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 shutdown_connections 2023-09-30T22:22:30.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.198+0000 7fa689157700 1 --2- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa684133f50 0x7fa6841c8ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.198+0000 7fa689157700 1 --2- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6840a0a70 0x7fa6841c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.198+0000 7fa689157700 1 --2- 172.21.15.154:0/3711700662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6840a1380 0x7fa6841c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:30.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.198+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 >> 172.21.15.154:0/3711700662 conn(0x7fa6840a6610 msgr2=0x7fa6840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:30.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.198+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 shutdown_connections 2023-09-30T22:22:30.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.198+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 shutdown_connections 2023-09-30T22:22:30.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.198+0000 7fa689157700 1 -- 172.21.15.154:0/3711700662 wait complete. 2023-09-30T22:22:30.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:30.198+0000 7f6c8d58a700 1 -- 172.21.15.154:0/3928042181 wait complete. 2023-09-30T22:22:30.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:30.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:31.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:31.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:31.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:31.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.309+0000 7fbd933bb700 1 Processor -- start 2023-09-30T22:22:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.310+0000 7fbd933bb700 1 -- start start 2023-09-30T22:22:31.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.310+0000 7fbd933bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8c133ad0 0x7fbd8c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.310+0000 7fbd933bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.310+0000 7fbd933bb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8c06b2d0 con 0x7fbd8c1300a0 2023-09-30T22:22:31.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.310+0000 7fbd933bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c133610 con 0x7fbd8c133ad0 2023-09-30T22:22:31.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.310+0000 7fbd933bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c09a500 con 0x7fbd8c130bc0 2023-09-30T22:22:31.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd90956700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbd8c1300a0 0x7fbd8c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35148/0 (socket says 172.21.15.154:35148) 2023-09-30T22:22:31.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd90956700 1 -- 172.21.15.154:0/389153543 learned_addr learned my addr 172.21.15.154:0/389153543 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:31.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd91958700 1 --2- 172.21.15.154:0/389153543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd83fff700 1 -- 172.21.15.154:0/389153543 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979822621 0 0) 0x7fbd8c06b2d0 con 0x7fbd8c1300a0 2023-09-30T22:22:31.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd83fff700 1 -- 172.21.15.154:0/389153543 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd780035b0 con 0x7fbd8c1300a0 2023-09-30T22:22:31.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd91958700 1 -- 172.21.15.154:0/389153543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8c133ad0 msgr2=0x7fbd8c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd91958700 1 --2- 172.21.15.154:0/389153543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8c133ad0 0x7fbd8c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd91958700 1 -- 172.21.15.154:0/389153543 >> v1:172.21.15.154:6789/0 conn(0x7fbd8c1300a0 legacy=0x7fbd8c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd91958700 1 -- 172.21.15.154:0/389153543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c1338b0 con 0x7fbd8c130bc0 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd91958700 1 --2- 172.21.15.154:0/389153543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c13b990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009dc0 tx=0x7fbd8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b06d5c84f5fc2d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.311+0000 7fbd83fff700 1 -- 172.21.15.154:0/389153543 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400e070 con 0x7fbd8c130bc0 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.312+0000 7fbd83fff700 1 -- 172.21.15.154:0/389153543 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8400bb20 con 0x7fbd8c130bc0 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.312+0000 7fbd83fff700 1 -- 172.21.15.154:0/389153543 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84012430 con 0x7fbd8c130bc0 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.312+0000 7fbd933bb700 1 -- 172.21.15.154:0/389153543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 msgr2=0x7fbd8c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.312+0000 7fbd933bb700 1 --2- 172.21.15.154:0/389153543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c13b990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009dc0 tx=0x7fbd8400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.312+0000 7fbd933bb700 1 -- 172.21.15.154:0/389153543 shutdown_connections 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.312+0000 7fbd933bb700 1 --2- 172.21.15.154:0/389153543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c13b990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.312+0000 7fbd933bb700 1 --2- 172.21.15.154:0/389153543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8c133ad0 0x7fbd8c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.312+0000 7fbd933bb700 1 -- 172.21.15.154:0/389153543 >> 172.21.15.154:0/389153543 conn(0x7fbd8c099c40 msgr2=0x7fbd8c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.312+0000 7fbd933bb700 1 -- 172.21.15.154:0/389153543 shutdown_connections 2023-09-30T22:22:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.313+0000 7fbd933bb700 1 -- 172.21.15.154:0/389153543 wait complete. 2023-09-30T22:22:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.314+0000 7fbd933bb700 1 Processor -- start 2023-09-30T22:22:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.314+0000 7fbd933bb700 1 -- start start 2023-09-30T22:22:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.314+0000 7fbd933bb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd8c1300a0 0x7fbd8c1cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.314+0000 7fbd933bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c1cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.314+0000 7fbd933bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8c133ad0 0x7fbd8c1cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.314+0000 7fbd933bb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c06fee0 con 0x7fbd8c1300a0 2023-09-30T22:22:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.314+0000 7fbd933bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c06efa0 con 0x7fbd8c133ad0 2023-09-30T22:22:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.314+0000 7fbd933bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c12f760 con 0x7fbd8c130bc0 2023-09-30T22:22:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd90956700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c1cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd91157700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd8c1300a0 0x7fbd8c1cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd90956700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c1cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40974/0 (socket says 172.21.15.154:40974) 2023-09-30T22:22:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd90956700 1 -- 172.21.15.154:0/3191694132 learned_addr learned my addr 172.21.15.154:0/3191694132 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd90956700 1 -- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8c133ad0 msgr2=0x7fbd8c1cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd90956700 1 --2- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8c133ad0 0x7fbd8c1cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd90956700 1 -- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd8c1300a0 msgr2=0x7fbd8c1cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd90956700 1 --2- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd8c1300a0 0x7fbd8c1cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd90956700 1 -- 172.21.15.154:0/3191694132 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84009a70 con 0x7fbd8c130bc0 2023-09-30T22:22:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd91157700 1 --2- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd8c1300a0 0x7fbd8c1cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd90956700 1 --2- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c1cccd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c005910 tx=0x7fbd7c00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd81ffb700 1 -- 172.21.15.154:0/3191694132 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c005d70 con 0x7fbd8c130bc0 2023-09-30T22:22:31.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c12dd00 con 0x7fbd8c130bc0 2023-09-30T22:22:31.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd81ffb700 1 -- 172.21.15.154:0/3191694132 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c0070d0 con 0x7fbd8c130bc0 2023-09-30T22:22:31.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.315+0000 7fbd81ffb700 1 -- 172.21.15.154:0/3191694132 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c007460 con 0x7fbd8c130bc0 2023-09-30T22:22:31.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.316+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c070ba0 con 0x7fbd8c130bc0 2023-09-30T22:22:31.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.316+0000 7fbd81ffb700 1 -- 172.21.15.154:0/3191694132 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbd7c0075c0 con 0x7fbd8c130bc0 2023-09-30T22:22:31.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.317+0000 7fbd81ffb700 1 -- 172.21.15.154:0/3191694132 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fbd7c03f000 con 0x7fbd8c130bc0 2023-09-30T22:22:31.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.317+0000 7fbd91157700 1 -- 172.21.15.154:0/3191694132 >> v1:172.21.15.154:6816/126757 conn(0x7fbd7002f510 legacy=0x7fbd700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:31.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.317+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c06fd50 con 0x7fbd8c130bc0 2023-09-30T22:22:31.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.322+0000 7fbd81ffb700 1 -- 172.21.15.154:0/3191694132 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd7c017020 con 0x7fbd8c130bc0 2023-09-30T22:22:31.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.350+0000 7ff9825e3700 1 Processor -- start 2023-09-30T22:22:31.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.351+0000 7ff9825e3700 1 -- start start 2023-09-30T22:22:31.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.351+0000 7ff9825e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.351+0000 7ff9825e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c134120 0x7ff97c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.351+0000 7ff9825e3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c09dc00 con 0x7ff97c0a1380 2023-09-30T22:22:31.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.351+0000 7ff9825e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c09ea90 con 0x7ff97c0a0a70 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.351+0000 7ff9825e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c09dec0 con 0x7ff97c134120 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff980b80700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c134120 0x7ff97c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff97bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff980b80700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c134120 0x7ff97c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40978/0 (socket says 172.21.15.154:40978) 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff97bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43870/0 (socket says 172.21.15.154:43870) 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff980b80700 1 -- 172.21.15.154:0/46459213 learned_addr learned my addr 172.21.15.154:0/46459213 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff980b80700 1 -- 172.21.15.154:0/46459213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 msgr2=0x7ff97c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff980b80700 1 --2- 172.21.15.154:0/46459213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff980b80700 1 -- 172.21.15.154:0/46459213 >> v1:172.21.15.154:6789/0 conn(0x7ff97c0a1380 legacy=0x7ff97c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff980b80700 1 -- 172.21.15.154:0/46459213 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c09e6a0 con 0x7ff97c134120 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff97affd700 1 -- 172.21.15.154:0/46459213 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963818913 0 0) 0x7ff97c09dc00 con 0x7ff97c0a1380 2023-09-30T22:22:31.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff980b80700 1 --2- 172.21.15.154:0/46459213 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c134120 0x7ff97c13bce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff974009e80 tx=0x7ff97400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a95d6bddc3364171 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff97affd700 1 -- 172.21.15.154:0/46459213 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400e070 con 0x7ff97c134120 2023-09-30T22:22:31.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff97affd700 1 -- 172.21.15.154:0/46459213 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97400b910 con 0x7ff97c134120 2023-09-30T22:22:31.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.352+0000 7ff97affd700 1 -- 172.21.15.154:0/46459213 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400bcc0 con 0x7ff97c134120 2023-09-30T22:22:31.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.353+0000 7ff9825e3700 1 -- 172.21.15.154:0/46459213 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c134120 msgr2=0x7ff97c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.353+0000 7ff9825e3700 1 --2- 172.21.15.154:0/46459213 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c134120 0x7ff97c13bce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff974009e80 tx=0x7ff97400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:31.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.353+0000 7ff9825e3700 1 -- 172.21.15.154:0/46459213 shutdown_connections 2023-09-30T22:22:31.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.353+0000 7ff9825e3700 1 --2- 172.21.15.154:0/46459213 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c134120 0x7ff97c13bce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.353+0000 7ff9825e3700 1 --2- 172.21.15.154:0/46459213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.353+0000 7ff9825e3700 1 -- 172.21.15.154:0/46459213 >> 172.21.15.154:0/46459213 conn(0x7ff97c0a6610 msgr2=0x7ff97c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.353+0000 7ff9825e3700 1 -- 172.21.15.154:0/46459213 shutdown_connections 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.353+0000 7ff9825e3700 1 -- 172.21.15.154:0/46459213 wait complete. 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.354+0000 7ff9825e3700 1 Processor -- start 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.355+0000 7ff9825e3700 1 -- start start 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.355+0000 7ff9825e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.355+0000 7ff9825e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c0a1380 0x7ff97c122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.355+0000 7ff9825e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c134120 0x7ff97c123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.355+0000 7ff9825e3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c1258f0 con 0x7ff97c134120 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.355+0000 7ff9825e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c133640 con 0x7ff97c0a0a70 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.355+0000 7ff9825e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c1262f0 con 0x7ff97c0a1380 2023-09-30T22:22:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.355+0000 7ff980b80700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c134120 0x7ff97c123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.355+0000 7ff97bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff980b80700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c134120 0x7ff97c123310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46020/0 (socket says 172.21.15.154:46020) 2023-09-30T22:22:31.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff97bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43884/0 (socket says 172.21.15.154:43884) 2023-09-30T22:22:31.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff980b80700 1 -- 172.21.15.154:0/3977542056 learned_addr learned my addr 172.21.15.154:0/3977542056 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:31.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff97b7fe700 1 --2- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c0a1380 0x7ff97c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff980b80700 1 -- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c0a1380 msgr2=0x7ff97c122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff980b80700 1 --2- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c0a1380 0x7ff97c122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff980b80700 1 -- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 msgr2=0x7ff97c122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff980b80700 1 --2- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff980b80700 1 -- 172.21.15.154:0/3977542056 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974009b30 con 0x7ff97c134120 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff97bfff700 1 --2- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff980b80700 1 --2- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c134120 0x7ff97c123310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff97400b680 tx=0x7ff974004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff978ff9700 1 -- 172.21.15.154:0/3977542056 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974004450 con 0x7ff97c134120 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff978ff9700 1 -- 172.21.15.154:0/3977542056 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9740045b0 con 0x7ff97c134120 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c0a03e0 con 0x7ff97c134120 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.356+0000 7ff978ff9700 1 -- 172.21.15.154:0/3977542056 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974004940 con 0x7ff97c134120 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.357+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c1269a0 con 0x7ff97c134120 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.357+0000 7ff978ff9700 1 -- 172.21.15.154:0/3977542056 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff974025460 con 0x7ff97c134120 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.357+0000 7ff978ff9700 1 -- 172.21.15.154:0/3977542056 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff974041890 con 0x7ff97c134120 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.358+0000 7ff97bfff700 1 -- 172.21.15.154:0/3977542056 >> v1:172.21.15.154:6816/126757 conn(0x7ff96802f510 legacy=0x7ff9680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.358+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c04f2a0 con 0x7ff97c134120 2023-09-30T22:22:31.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.363+0000 7ff978ff9700 1 -- 172.21.15.154:0/3977542056 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff97402a020 con 0x7ff97c134120 2023-09-30T22:22:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.386+0000 7fc99de77700 1 Processor -- start 2023-09-30T22:22:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.386+0000 7fc99de77700 1 -- start start 2023-09-30T22:22:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.386+0000 7fc99de77700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc9980a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.386+0000 7fc99de77700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc99813dd10 0x7fc9981400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.386+0000 7fc99de77700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9981379e0 con 0x7fc998138040 2023-09-30T22:22:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.386+0000 7fc99de77700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9980a2100 con 0x7fc99813dd10 2023-09-30T22:22:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.386+0000 7fc99de77700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc99809b9b0 con 0x7fc998138410 2023-09-30T22:22:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc997fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc99813dd10 0x7fc9981400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc996ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc9980a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc997fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc99813dd10 0x7fc9981400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43896/0 (socket says 172.21.15.154:43896) 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc997fff700 1 -- 172.21.15.154:0/1756866227 learned_addr learned my addr 172.21.15.154:0/1756866227 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc996ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc9980a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41006/0 (socket says 172.21.15.154:41006) 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc996ffd700 1 -- 172.21.15.154:0/1756866227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc99813dd10 msgr2=0x7fc9981400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc996ffd700 1 --2- 172.21.15.154:0/1756866227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc99813dd10 0x7fc9981400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc996ffd700 1 -- 172.21.15.154:0/1756866227 >> v1:172.21.15.154:6789/0 conn(0x7fc998138040 legacy=0x7fc9980a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc996ffd700 1 -- 172.21.15.154:0/1756866227 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998137c10 con 0x7fc998138410 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc997fff700 1 --2- 172.21.15.154:0/1756866227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc99813dd10 0x7fc9981400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc996ffd700 1 --2- 172.21.15.154:0/1756866227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc9980a0ff0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098a0 tx=0x7fc98c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93027fd4c62554e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc9967fc700 1 -- 172.21.15.154:0/1756866227 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c011830 con 0x7fc998138410 2023-09-30T22:22:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc9967fc700 1 -- 172.21.15.154:0/1756866227 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c011990 con 0x7fc998138410 2023-09-30T22:22:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.387+0000 7fc9967fc700 1 -- 172.21.15.154:0/1756866227 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c011d20 con 0x7fc998138410 2023-09-30T22:22:31.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.388+0000 7fc99de77700 1 -- 172.21.15.154:0/1756866227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 msgr2=0x7fc9980a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.388+0000 7fc99de77700 1 --2- 172.21.15.154:0/1756866227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc9980a0ff0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098a0 tx=0x7fc98c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.388+0000 7fc99de77700 1 -- 172.21.15.154:0/1756866227 shutdown_connections 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.388+0000 7fc99de77700 1 --2- 172.21.15.154:0/1756866227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc99813dd10 0x7fc9981400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.388+0000 7fc99de77700 1 --2- 172.21.15.154:0/1756866227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc9980a0ff0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.388+0000 7fc99de77700 1 -- 172.21.15.154:0/1756866227 >> 172.21.15.154:0/1756866227 conn(0x7fc9980a2980 msgr2=0x7fc9980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.388+0000 7fc99de77700 1 -- 172.21.15.154:0/1756866227 shutdown_connections 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.388+0000 7fc99de77700 1 -- 172.21.15.154:0/1756866227 wait complete. 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.389+0000 7fc99de77700 1 Processor -- start 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.389+0000 7fc99de77700 1 -- start start 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc99de77700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc998138040 0x7fc998121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc99de77700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc998121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc99de77700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99813dd10 0x7fc998122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc99de77700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc998123840 con 0x7fc99813dd10 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc99de77700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9981377b0 con 0x7fc998138040 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc99de77700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc99809f050 con 0x7fc998138410 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc997fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99813dd10 0x7fc998122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc997fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99813dd10 0x7fc998122080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46022/0 (socket says 172.21.15.154:46022) 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc997fff700 1 -- 172.21.15.154:0/4139130583 learned_addr learned my addr 172.21.15.154:0/4139130583 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc9977fe700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc998138040 0x7fc998121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc996ffd700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc998121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc997fff700 1 -- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 msgr2=0x7fc998121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc997fff700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc998121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc997fff700 1 -- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc998138040 msgr2=0x7fc998121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc997fff700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc998138040 0x7fc998121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc997fff700 1 -- 172.21.15.154:0/4139130583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc990009b30 con 0x7fc99813dd10 2023-09-30T22:22:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc9977fe700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc998138040 0x7fc998121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.390+0000 7fc997fff700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99813dd10 0x7fc998122080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc9900070b0 tx=0x7fc99000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.391+0000 7fc97ffff700 1 -- 172.21.15.154:0/4139130583 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990003c20 con 0x7fc99813dd10 2023-09-30T22:22:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.391+0000 7fc97ffff700 1 -- 172.21.15.154:0/4139130583 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99000f040 con 0x7fc99813dd10 2023-09-30T22:22:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.391+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c0094a0 con 0x7fc99813dd10 2023-09-30T22:22:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.391+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9981241f0 con 0x7fc99813dd10 2023-09-30T22:22:31.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.391+0000 7fc97ffff700 1 -- 172.21.15.154:0/4139130583 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99000c900 con 0x7fc99813dd10 2023-09-30T22:22:31.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.392+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9780052e0 con 0x7fc99813dd10 2023-09-30T22:22:31.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.396+0000 7fc97ffff700 1 -- 172.21.15.154:0/4139130583 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc99000ca60 con 0x7fc99813dd10 2023-09-30T22:22:31.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.397+0000 7fc97ffff700 1 -- 172.21.15.154:0/4139130583 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc9900410f0 con 0x7fc99813dd10 2023-09-30T22:22:31.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.397+0000 7fc9977fe700 1 -- 172.21.15.154:0/4139130583 >> v1:172.21.15.154:6816/126757 conn(0x7fc98402f560 legacy=0x7fc984031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:31.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.397+0000 7fc97ffff700 1 -- 172.21.15.154:0/4139130583 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc990013da0 con 0x7fc99813dd10 2023-09-30T22:22:31.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.406+0000 7f9b89c4b700 1 Processor -- start 2023-09-30T22:22:31.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.406+0000 7f9b89c4b700 1 -- start start 2023-09-30T22:22:31.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.407+0000 7f9b89c4b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841347b0 0x7f9b84136b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.407+0000 7f9b89c4b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9b841370d0 0x7f9b841394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.407+0000 7f9b89c4b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8406f970 con 0x7f9b84098410 2023-09-30T22:22:31.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.407+0000 7f9b89c4b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b840720a0 con 0x7f9b841370d0 2023-09-30T22:22:31.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.407+0000 7f9b89c4b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84098ef0 con 0x7f9b841347b0 2023-09-30T22:22:31.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.407+0000 7f9b82ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841347b0 0x7f9b84136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.407+0000 7f9b82ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841347b0 0x7f9b84136b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43912/0 (socket says 172.21.15.154:43912) 2023-09-30T22:22:31.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.407+0000 7f9b82ffd700 1 -- 172.21.15.154:0/3919313888 learned_addr learned my addr 172.21.15.154:0/3919313888 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:31.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.407+0000 7f9b83fff700 1 --2- 172.21.15.154:0/3919313888 >> v2:172.21.15.154:3300/0 conn(0x7f9b841370d0 0x7f9b841394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.408+0000 7f9b82ffd700 1 -- 172.21.15.154:0/3919313888 >> v2:172.21.15.154:3300/0 conn(0x7f9b841370d0 msgr2=0x7f9b841394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.408+0000 7f9b82ffd700 1 --2- 172.21.15.154:0/3919313888 >> v2:172.21.15.154:3300/0 conn(0x7f9b841370d0 0x7f9b841394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.408+0000 7f9b82ffd700 1 -- 172.21.15.154:0/3919313888 >> v1:172.21.15.154:6789/0 conn(0x7f9b84098410 legacy=0x7f9b840987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.408+0000 7f9b82ffd700 1 -- 172.21.15.154:0/3919313888 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84072290 con 0x7f9b841347b0 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.408+0000 7f9b82ffd700 1 --2- 172.21.15.154:0/3919313888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841347b0 0x7f9b84136b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800dd10 tx=0x7f9b7800f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=625f59243a2edd8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.408+0000 7f9b827fc700 1 -- 172.21.15.154:0/3919313888 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78012070 con 0x7f9b841347b0 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.408+0000 7f9b827fc700 1 -- 172.21.15.154:0/3919313888 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7800d2e0 con 0x7f9b841347b0 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.408+0000 7f9b827fc700 1 -- 172.21.15.154:0/3919313888 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78004230 con 0x7f9b841347b0 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.409+0000 7f9b89c4b700 1 -- 172.21.15.154:0/3919313888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841347b0 msgr2=0x7f9b84136b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.409+0000 7f9b89c4b700 1 --2- 172.21.15.154:0/3919313888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841347b0 0x7f9b84136b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800dd10 tx=0x7f9b7800f330 comp rx=0 tx=0).stop 2023-09-30T22:22:31.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.409+0000 7f9b89c4b700 1 -- 172.21.15.154:0/3919313888 shutdown_connections 2023-09-30T22:22:31.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.409+0000 7f9b89c4b700 1 --2- 172.21.15.154:0/3919313888 >> v2:172.21.15.154:3300/0 conn(0x7f9b841370d0 0x7f9b841394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.409+0000 7f9b89c4b700 1 --2- 172.21.15.154:0/3919313888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841347b0 0x7f9b84136b90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.409+0000 7f9b89c4b700 1 -- 172.21.15.154:0/3919313888 >> 172.21.15.154:0/3919313888 conn(0x7f9b840a2b30 msgr2=0x7f9b8409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.409+0000 7f9b89c4b700 1 -- 172.21.15.154:0/3919313888 shutdown_connections 2023-09-30T22:22:31.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.409+0000 7f9b89c4b700 1 -- 172.21.15.154:0/3919313888 wait complete. 2023-09-30T22:22:31.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.410+0000 7f9b89c4b700 1 Processor -- start 2023-09-30T22:22:31.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.410+0000 7f9b89c4b700 1 -- start start 2023-09-30T22:22:31.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.410+0000 7f9b89c4b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b84098410 0x7f9b841c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.410+0000 7f9b89c4b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b841347b0 0x7f9b841c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.410+0000 7f9b89c4b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841370d0 0x7f9b84099720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:31.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.410+0000 7f9b89c4b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84127480 con 0x7f9b841347b0 2023-09-30T22:22:31.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.410+0000 7f9b89c4b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8409bc00 con 0x7f9b841370d0 2023-09-30T22:22:31.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.410+0000 7f9b89c4b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84134200 con 0x7f9b84098410 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b82ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b841347b0 0x7f9b841c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b82ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b841347b0 0x7f9b841c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46040/0 (socket says 172.21.15.154:46040) 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b82ffd700 1 -- 172.21.15.154:0/2369290979 learned_addr learned my addr 172.21.15.154:0/2369290979 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b837fe700 1 --2- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b84098410 0x7f9b841c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b83fff700 1 --2- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841370d0 0x7f9b84099720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b83fff700 1 -- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b84098410 msgr2=0x7f9b841c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b83fff700 1 --2- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b84098410 0x7f9b841c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b83fff700 1 -- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b841347b0 msgr2=0x7f9b841c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b83fff700 1 --2- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b841347b0 0x7f9b841c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b83fff700 1 -- 172.21.15.154:0/2369290979 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7800d9f0 con 0x7f9b841370d0 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.411+0000 7f9b83fff700 1 --2- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841370d0 0x7f9b84099720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009d90 tx=0x7f9b7c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:31.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.412+0000 7f9b6bfff700 1 -- 172.21.15.154:0/2369290979 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c009c00 con 0x7f9b841370d0 2023-09-30T22:22:31.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.412+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b84128080 con 0x7f9b841370d0 2023-09-30T22:22:31.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.412+0000 7f9b6bfff700 1 -- 172.21.15.154:0/2369290979 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00f040 con 0x7f9b841370d0 2023-09-30T22:22:31.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.412+0000 7f9b6bfff700 1 -- 172.21.15.154:0/2369290979 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c014480 con 0x7f9b841370d0 2023-09-30T22:22:31.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.412+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b84127a50 con 0x7f9b841370d0 2023-09-30T22:22:31.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.413+0000 7f9b6bfff700 1 -- 172.21.15.154:0/2369290979 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9b7c0145e0 con 0x7f9b841370d0 2023-09-30T22:22:31.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.413+0000 7f9b837fe700 1 -- 172.21.15.154:0/2369290979 >> v1:172.21.15.154:6816/126757 conn(0x7f9b7002f510 legacy=0x7f9b700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:31.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.414+0000 7f9b6bfff700 1 -- 172.21.15.154:0/2369290979 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9b7c02db80 con 0x7f9b841370d0 2023-09-30T22:22:31.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.414+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8406ff50 con 0x7f9b841370d0 2023-09-30T22:22:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.423+0000 7f9b6bfff700 1 -- 172.21.15.154:0/2369290979 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b8406ff50 con 0x7f9b841370d0 2023-09-30T22:22:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.518+0000 7fbd91157700 1 -- 172.21.15.154:0/3191694132 >> v1:172.21.15.154:6816/126757 conn(0x7fbd7002f510 legacy=0x7fbd700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:31.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.521+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd8c070020 con 0x7fbd8c130bc0 2023-09-30T22:22:31.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.522+0000 7fbd81ffb700 1 -- 172.21.15.154:0/3191694132 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd8c070020 con 0x7fbd8c130bc0 2023-09-30T22:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 >> v1:172.21.15.154:6816/126757 conn(0x7fbd7002f510 legacy=0x7fbd700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 msgr2=0x7fbd8c1cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 --2- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c1cccd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c005910 tx=0x7fbd7c00c7b0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 shutdown_connections 2023-09-30T22:22:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 --2- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8c133ad0 0x7fbd8c1cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 --2- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd8c1300a0 0x7fbd8c1cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 --2- 172.21.15.154:0/3191694132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8c130bc0 0x7fbd8c1cccd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 >> 172.21.15.154:0/3191694132 conn(0x7fbd8c099c40 msgr2=0x7fbd8c1324f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 shutdown_connections 2023-09-30T22:22:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.524+0000 7fbd933bb700 1 -- 172.21.15.154:0/3191694132 wait complete. 2023-09-30T22:22:31.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:31.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.559+0000 7ff97bfff700 1 -- 172.21.15.154:0/3977542056 >> v1:172.21.15.154:6816/126757 conn(0x7ff96802f510 legacy=0x7ff9680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:31.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.592+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc978005860 con 0x7fc99813dd10 2023-09-30T22:22:31.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.593+0000 7fc97ffff700 1 -- 172.21.15.154:0/4139130583 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc990025390 con 0x7fc99813dd10 2023-09-30T22:22:31.629 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:31.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 >> v1:172.21.15.154:6816/126757 conn(0x7fc98402f560 legacy=0x7fc984031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:31.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99813dd10 msgr2=0x7fc998122080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99813dd10 0x7fc998122080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc9900070b0 tx=0x7fc99000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 shutdown_connections 2023-09-30T22:22:31.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99813dd10 0x7fc998122080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc998138040 0x7fc998121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 --2- 172.21.15.154:0/4139130583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc998138410 0x7fc998121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 >> 172.21.15.154:0/4139130583 conn(0x7fc9980a2980 msgr2=0x7fc99809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 shutdown_connections 2023-09-30T22:22:31.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.595+0000 7fc99de77700 1 -- 172.21.15.154:0/4139130583 wait complete. 2023-09-30T22:22:31.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.612+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff97c125e50 con 0x7ff97c134120 2023-09-30T22:22:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.613+0000 7ff978ff9700 1 -- 172.21.15.154:0/3977542056 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff97401b7b0 con 0x7ff97c134120 2023-09-30T22:22:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:31.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.614+0000 7f9b837fe700 1 -- 172.21.15.154:0/2369290979 >> v1:172.21.15.154:6816/126757 conn(0x7f9b7002f510 legacy=0x7f9b700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 >> v1:172.21.15.154:6816/126757 conn(0x7ff96802f510 legacy=0x7ff9680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c134120 msgr2=0x7ff97c123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 --2- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c134120 0x7ff97c123310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff97400b680 tx=0x7ff974004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 shutdown_connections 2023-09-30T22:22:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 --2- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff97c134120 0x7ff97c123310 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 --2- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff97c0a0a70 0x7ff97c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 --2- 172.21.15.154:0/3977542056 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff97c0a1380 0x7ff97c122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 >> 172.21.15.154:0/3977542056 conn(0x7ff97c0a6610 msgr2=0x7ff97c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 shutdown_connections 2023-09-30T22:22:31.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.615+0000 7ff9825e3700 1 -- 172.21.15.154:0/3977542056 wait complete. 2023-09-30T22:22:31.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:31.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.650+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9b8406ff50 con 0x7f9b841370d0 2023-09-30T22:22:31.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.651+0000 7f9b6bfff700 1 -- 172.21.15.154:0/2369290979 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b8406ff50 con 0x7f9b841370d0 2023-09-30T22:22:31.651 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:31.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 >> v1:172.21.15.154:6816/126757 conn(0x7f9b7002f510 legacy=0x7f9b700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:31.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841370d0 msgr2=0x7f9b84099720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:31.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 --2- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841370d0 0x7f9b84099720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009d90 tx=0x7f9b7c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 shutdown_connections 2023-09-30T22:22:31.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 --2- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b841370d0 0x7f9b84099720 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 --2- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9b84098410 0x7f9b841c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 --2- 172.21.15.154:0/2369290979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b841347b0 0x7f9b841c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:31.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 >> 172.21.15.154:0/2369290979 conn(0x7f9b840a2b30 msgr2=0x7f9b8409c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:31.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 shutdown_connections 2023-09-30T22:22:31.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:31.653+0000 7f9b89c4b700 1 -- 172.21.15.154:0/2369290979 wait complete. 2023-09-30T22:22:31.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:32.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:32.633 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:32.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:32.666 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.670+0000 7f54c39b7700 1 Processor -- start 2023-09-30T22:22:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.670+0000 7f54c39b7700 1 -- start start 2023-09-30T22:22:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c39b7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54bc09d860 0x7f54bc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c39b7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c39b7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc09aaa0 con 0x7f54bc09e170 2023-09-30T22:22:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c39b7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc09f870 con 0x7f54bc09d860 2023-09-30T22:22:32.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c39b7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc09b360 con 0x7f54bc130eb0 2023-09-30T22:22:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c1f54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c1f54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43930/0 (socket says 172.21.15.154:43930) 2023-09-30T22:22:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c1753700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54bc09d860 0x7f54bc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c0f52700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f54bc09e170 0x7f54bc1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35198/0 (socket says 172.21.15.154:35198) 2023-09-30T22:22:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c1f54700 1 -- 172.21.15.154:0/1148226102 learned_addr learned my addr 172.21.15.154:0/1148226102 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:32.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c1f54700 1 -- 172.21.15.154:0/1148226102 >> v2:172.21.15.154:3300/0 conn(0x7f54bc09d860 msgr2=0x7f54bc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c1f54700 1 --2- 172.21.15.154:0/1148226102 >> v2:172.21.15.154:3300/0 conn(0x7f54bc09d860 0x7f54bc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c1f54700 1 -- 172.21.15.154:0/1148226102 >> v1:172.21.15.154:6789/0 conn(0x7f54bc09e170 legacy=0x7f54bc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c1f54700 1 -- 172.21.15.154:0/1148226102 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc09b620 con 0x7f54bc130eb0 2023-09-30T22:22:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.671+0000 7f54c1f54700 1 --2- 172.21.15.154:0/1148226102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc138a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d150 tx=0x7f54b400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffd2d052d38e898a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.672+0000 7f54b3fff700 1 -- 172.21.15.154:0/1148226102 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4010070 con 0x7f54bc130eb0 2023-09-30T22:22:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.672+0000 7f54b3fff700 1 -- 172.21.15.154:0/1148226102 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b400dd10 con 0x7f54bc130eb0 2023-09-30T22:22:32.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.672+0000 7f54b3fff700 1 -- 172.21.15.154:0/1148226102 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b400b310 con 0x7f54bc130eb0 2023-09-30T22:22:32.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.672+0000 7f54c39b7700 1 -- 172.21.15.154:0/1148226102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 msgr2=0x7f54bc138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.672+0000 7f54c39b7700 1 --2- 172.21.15.154:0/1148226102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc138a00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d150 tx=0x7f54b400d460 comp rx=0 tx=0).stop 2023-09-30T22:22:32.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.672+0000 7f54c39b7700 1 -- 172.21.15.154:0/1148226102 shutdown_connections 2023-09-30T22:22:32.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.672+0000 7f54c39b7700 1 --2- 172.21.15.154:0/1148226102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc138a00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.672+0000 7f54c39b7700 1 --2- 172.21.15.154:0/1148226102 >> v2:172.21.15.154:3300/0 conn(0x7f54bc09d860 0x7f54bc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.672+0000 7f54c39b7700 1 -- 172.21.15.154:0/1148226102 >> 172.21.15.154:0/1148226102 conn(0x7f54bc099c40 msgr2=0x7f54bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:32.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.673+0000 7f54c39b7700 1 -- 172.21.15.154:0/1148226102 shutdown_connections 2023-09-30T22:22:32.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.673+0000 7f54c39b7700 1 -- 172.21.15.154:0/1148226102 wait complete. 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.673+0000 7f54c39b7700 1 Processor -- start 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c39b7700 1 -- start start 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c39b7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54bc09d860 0x7f54bc1228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c39b7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54bc09e170 0x7f54bc122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c39b7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c39b7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc124400 con 0x7f54bc09e170 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c39b7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc1260a0 con 0x7f54bc130eb0 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c39b7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc126310 con 0x7f54bc09d860 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c1753700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54bc09d860 0x7f54bc1228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c0f52700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54bc09e170 0x7f54bc122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c1753700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54bc09d860 0x7f54bc1228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41040/0 (socket says 172.21.15.154:41040) 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c1f54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.674+0000 7f54c1753700 1 -- 172.21.15.154:0/2623256853 learned_addr learned my addr 172.21.15.154:0/2623256853 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54c1f54700 1 -- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54bc09d860 msgr2=0x7f54bc1228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54c1f54700 1 --2- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54bc09d860 0x7f54bc1228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54c1f54700 1 -- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54bc09e170 msgr2=0x7f54bc122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54c1f54700 1 --2- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54bc09e170 0x7f54bc122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54c1f54700 1 -- 172.21.15.154:0/2623256853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b400bd40 con 0x7f54bc130eb0 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54c1753700 1 --2- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54bc09d860 0x7f54bc1228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54c1f54700 1 --2- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc123330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54b4017000 tx=0x7f54b4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54b1ffb700 1 -- 172.21.15.154:0/2623256853 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b400b4c0 con 0x7f54bc130eb0 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54b1ffb700 1 -- 172.21.15.154:0/2623256853 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b4009810 con 0x7f54bc130eb0 2023-09-30T22:22:32.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc0a21b0 con 0x7f54bc130eb0 2023-09-30T22:22:32.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54b1ffb700 1 -- 172.21.15.154:0/2623256853 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4009ba0 con 0x7f54bc130eb0 2023-09-30T22:22:32.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.675+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc126aa0 con 0x7f54bc130eb0 2023-09-30T22:22:32.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.676+0000 7f54b1ffb700 1 -- 172.21.15.154:0/2623256853 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f54b4009d00 con 0x7f54bc130eb0 2023-09-30T22:22:32.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.676+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc04f2a0 con 0x7f54bc130eb0 2023-09-30T22:22:32.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.677+0000 7f54b1ffb700 1 -- 172.21.15.154:0/2623256853 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f54b40410b0 con 0x7f54bc130eb0 2023-09-30T22:22:32.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.677+0000 7f54c1753700 1 -- 172.21.15.154:0/2623256853 >> v1:172.21.15.154:6816/126757 conn(0x7f54a002f510 legacy=0x7f54a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:32.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.683+0000 7f54b1ffb700 1 -- 172.21.15.154:0/2623256853 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54b40137a0 con 0x7f54bc130eb0 2023-09-30T22:22:32.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.768+0000 7fb0932e5700 1 Processor -- start 2023-09-30T22:22:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.768+0000 7fb0932e5700 1 -- start start 2023-09-30T22:22:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.768+0000 7fb0932e5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c138040 0x7fb08c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.768+0000 7fb0932e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a08e0 0x7fb08c0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.768+0000 7fb0932e5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c1379e0 con 0x7fb08c0a1230 2023-09-30T22:22:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.768+0000 7fb0932e5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0a2100 con 0x7fb08c138040 2023-09-30T22:22:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.768+0000 7fb0932e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c138950 con 0x7fb08c0a08e0 2023-09-30T22:22:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb090880700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a08e0 0x7fb08c0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb091882700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb08c0a1230 0x7fb08c13ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35206/0 (socket says 172.21.15.154:35206) 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb090880700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a08e0 0x7fb08c0a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41044/0 (socket says 172.21.15.154:41044) 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb091882700 1 -- 172.21.15.154:0/3561709538 learned_addr learned my addr 172.21.15.154:0/3561709538 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb091081700 1 --2- 172.21.15.154:0/3561709538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c138040 0x7fb08c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb090880700 1 -- 172.21.15.154:0/3561709538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c138040 msgr2=0x7fb08c138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb090880700 1 --2- 172.21.15.154:0/3561709538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c138040 0x7fb08c138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb090880700 1 -- 172.21.15.154:0/3561709538 >> v1:172.21.15.154:6789/0 conn(0x7fb08c0a1230 legacy=0x7fb08c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb083fff700 1 -- 172.21.15.154:0/3561709538 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292026737 0 0) 0x7fb08c1379e0 con 0x7fb08c0a1230 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb090880700 1 -- 172.21.15.154:0/3561709538 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c09b9b0 con 0x7fb08c0a08e0 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb090880700 1 --2- 172.21.15.154:0/3561709538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a08e0 0x7fb08c0a0cf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0098a0 tx=0x7fb07c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5732a794a066ce77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb083fff700 1 -- 172.21.15.154:0/3561709538 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c011830 con 0x7fb08c0a08e0 2023-09-30T22:22:32.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb083fff700 1 -- 172.21.15.154:0/3561709538 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c011990 con 0x7fb08c0a08e0 2023-09-30T22:22:32.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.769+0000 7fb083fff700 1 -- 172.21.15.154:0/3561709538 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c011d40 con 0x7fb08c0a08e0 2023-09-30T22:22:32.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.770+0000 7fb0932e5700 1 -- 172.21.15.154:0/3561709538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a08e0 msgr2=0x7fb08c0a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.770+0000 7fb0932e5700 1 --2- 172.21.15.154:0/3561709538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a08e0 0x7fb08c0a0cf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0098a0 tx=0x7fb07c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.770+0000 7fb0932e5700 1 -- 172.21.15.154:0/3561709538 shutdown_connections 2023-09-30T22:22:32.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.770+0000 7fb0932e5700 1 --2- 172.21.15.154:0/3561709538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c138040 0x7fb08c138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.770+0000 7fb0932e5700 1 --2- 172.21.15.154:0/3561709538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a08e0 0x7fb08c0a0cf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.770+0000 7fb0932e5700 1 -- 172.21.15.154:0/3561709538 >> 172.21.15.154:0/3561709538 conn(0x7fb08c0a2980 msgr2=0x7fb08c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:32.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.770+0000 7fb0932e5700 1 -- 172.21.15.154:0/3561709538 shutdown_connections 2023-09-30T22:22:32.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.770+0000 7fb0932e5700 1 -- 172.21.15.154:0/3561709538 wait complete. 2023-09-30T22:22:32.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.771+0000 7fb0932e5700 1 Processor -- start 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.771+0000 7fb0932e5700 1 -- start start 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.771+0000 7fb0932e5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c0a08e0 0x7fb08c132810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb0932e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a1230 0x7fb08c132d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb0932e5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c138040 0x7fb08c136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb0932e5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c13ffe0 con 0x7fb08c138040 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb0932e5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c118e90 con 0x7fb08c0a08e0 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb0932e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c09ece0 con 0x7fb08c0a1230 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb091081700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c0a08e0 0x7fb08c132810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb091081700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c0a08e0 0x7fb08c132810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43954/0 (socket says 172.21.15.154:43954) 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb091081700 1 -- 172.21.15.154:0/915970149 learned_addr learned my addr 172.21.15.154:0/915970149 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb090880700 1 --2- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a1230 0x7fb08c132d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb091081700 1 -- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a1230 msgr2=0x7fb08c132d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb091081700 1 --2- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a1230 0x7fb08c132d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb091081700 1 -- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c138040 msgr2=0x7fb08c136ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb091081700 1 --2- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c138040 0x7fb08c136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb091081700 1 -- 172.21.15.154:0/915970149 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0094a0 con 0x7fb08c0a08e0 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb091081700 1 --2- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c0a08e0 0x7fb08c132810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb08800e730 tx=0x7fb08800ea40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb081ffb700 1 -- 172.21.15.154:0/915970149 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088013610 con 0x7fb08c0a08e0 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb081ffb700 1 -- 172.21.15.154:0/915970149 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb088013770 con 0x7fb08c0a08e0 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb081ffb700 1 -- 172.21.15.154:0/915970149 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088013b20 con 0x7fb08c0a08e0 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.772+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c09a240 con 0x7fb08c0a08e0 2023-09-30T22:22:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.773+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c13f300 con 0x7fb08c0a08e0 2023-09-30T22:22:32.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.774+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c04f2a0 con 0x7fb08c0a08e0 2023-09-30T22:22:32.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.775+0000 7fb081ffb700 1 -- 172.21.15.154:0/915970149 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb088013c80 con 0x7fb08c0a08e0 2023-09-30T22:22:32.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.775+0000 7fb081ffb700 1 -- 172.21.15.154:0/915970149 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fb08803f9e0 con 0x7fb08c0a08e0 2023-09-30T22:22:32.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.775+0000 7fb090880700 1 -- 172.21.15.154:0/915970149 >> v1:172.21.15.154:6816/126757 conn(0x7fb07002f510 legacy=0x7fb0700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:32.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.779+0000 7fb081ffb700 1 -- 172.21.15.154:0/915970149 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb08801b7c0 con 0x7fb08c0a08e0 2023-09-30T22:22:32.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe9a5f0f700 1 Processor -- start 2023-09-30T22:22:32.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe9a5f0f700 1 -- start start 2023-09-30T22:22:32.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7f6f96051700 1 Processor -- start 2023-09-30T22:22:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe9a5f0f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009f350 0x7fe9a0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe9a5f0f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9a01371c0 0x7fe9a01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe9a5f0f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a009c970 con 0x7fe9a009e870 2023-09-30T22:22:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe9a5f0f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a00a0920 con 0x7fe9a01371c0 2023-09-30T22:22:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe9a5f0f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a009f9c0 con 0x7fe9a009f350 2023-09-30T22:22:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7f6f96051700 1 -- start start 2023-09-30T22:22:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe99effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009f350 0x7fe9a0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe99effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009f350 0x7fe9a0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43966/0 (socket says 172.21.15.154:43966) 2023-09-30T22:22:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.802+0000 7fe99effd700 1 -- 172.21.15.154:0/3592253592 learned_addr learned my addr 172.21.15.154:0/3592253592 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7fe99effd700 1 -- 172.21.15.154:0/3592253592 >> v2:172.21.15.154:3300/0 conn(0x7fe9a01371c0 msgr2=0x7fe9a01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7fe99effd700 1 --2- 172.21.15.154:0/3592253592 >> v2:172.21.15.154:3300/0 conn(0x7fe9a01371c0 0x7fe9a01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7fe99effd700 1 -- 172.21.15.154:0/3592253592 >> v1:172.21.15.154:6789/0 conn(0x7fe9a009e870 legacy=0x7fe9a009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f96051700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f9012d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f96051700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90134020 0x7f6f9013b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f96051700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9009ac40 con 0x7f6f90133540 2023-09-30T22:22:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7fe99effd700 1 -- 172.21.15.154:0/3592253592 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a009bab0 con 0x7fe9a009f350 2023-09-30T22:22:32.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f96051700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9009a740 con 0x7f6f9012cef0 2023-09-30T22:22:32.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f96051700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9009f3a0 con 0x7f6f90134020 2023-09-30T22:22:32.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90134020 0x7f6f9013b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90134020 0x7f6f9013b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41070/0 (socket says 172.21.15.154:41070) 2023-09-30T22:22:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f8ffff700 1 -- 172.21.15.154:0/3444040615 learned_addr learned my addr 172.21.15.154:0/3444040615 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/3444040615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f9012d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/3444040615 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90134020 msgr2=0x7f6f9013b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/3444040615 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90134020 0x7f6f9013b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/3444040615 >> v1:172.21.15.154:6789/0 conn(0x7f6f90133540 legacy=0x7f6f90133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/3444040615 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9009b010 con 0x7f6f9012cef0 2023-09-30T22:22:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7fe99effd700 1 --2- 172.21.15.154:0/3592253592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009f350 0x7fe9a0136c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe9940098f0 tx=0x7fe994009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69d77d275d5718bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.803+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/3444040615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f9012d2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6f80013180 tx=0x7f6f80013490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ffd53f481325f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7fe99e7fc700 1 -- 172.21.15.154:0/3592253592 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994004230 con 0x7fe9a009f350 2023-09-30T22:22:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7fe99e7fc700 1 -- 172.21.15.154:0/3592253592 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe994004390 con 0x7fe9a009f350 2023-09-30T22:22:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7fe99e7fc700 1 -- 172.21.15.154:0/3592253592 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9940036a0 con 0x7fe9a009f350 2023-09-30T22:22:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7f6f8e7fc700 1 -- 172.21.15.154:0/3444040615 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80016070 con 0x7f6f9012cef0 2023-09-30T22:22:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7f6f8e7fc700 1 -- 172.21.15.154:0/3444040615 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f80013d00 con 0x7f6f9012cef0 2023-09-30T22:22:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7f6f8e7fc700 1 -- 172.21.15.154:0/3444040615 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80004250 con 0x7f6f9012cef0 2023-09-30T22:22:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/3592253592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009f350 msgr2=0x7fe9a0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7fe9a5f0f700 1 --2- 172.21.15.154:0/3592253592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009f350 0x7fe9a0136c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe9940098f0 tx=0x7fe994009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/3592253592 shutdown_connections 2023-09-30T22:22:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7fe9a5f0f700 1 --2- 172.21.15.154:0/3592253592 >> v2:172.21.15.154:3300/0 conn(0x7fe9a01371c0 0x7fe9a01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7fe9a5f0f700 1 --2- 172.21.15.154:0/3592253592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009f350 0x7fe9a0136c80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/3592253592 >> 172.21.15.154:0/3592253592 conn(0x7fe9a00a4430 msgr2=0x7fe9a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:32.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7f6f96051700 1 -- 172.21.15.154:0/3444040615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 msgr2=0x7f6f9012d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.804+0000 7f6f96051700 1 --2- 172.21.15.154:0/3444040615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f9012d2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6f80013180 tx=0x7f6f80013490 comp rx=0 tx=0).stop 2023-09-30T22:22:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.805+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/3592253592 shutdown_connections 2023-09-30T22:22:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.805+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/3592253592 wait complete. 2023-09-30T22:22:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.805+0000 7f6f96051700 1 -- 172.21.15.154:0/3444040615 shutdown_connections 2023-09-30T22:22:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.805+0000 7f6f96051700 1 --2- 172.21.15.154:0/3444040615 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90134020 0x7f6f9013b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.805+0000 7f6f96051700 1 --2- 172.21.15.154:0/3444040615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f9012d2c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.805+0000 7f6f96051700 1 -- 172.21.15.154:0/3444040615 >> 172.21.15.154:0/3444040615 conn(0x7f6f90099c40 msgr2=0x7f6f900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:32.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.805+0000 7f6f96051700 1 -- 172.21.15.154:0/3444040615 shutdown_connections 2023-09-30T22:22:32.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.805+0000 7f6f96051700 1 -- 172.21.15.154:0/3444040615 wait complete. 2023-09-30T22:22:32.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.806+0000 7fe9a5f0f700 1 Processor -- start 2023-09-30T22:22:32.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.806+0000 7f6f96051700 1 Processor -- start 2023-09-30T22:22:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.806+0000 7f6f96051700 1 -- start start 2023-09-30T22:22:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f96051700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f90070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f96051700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90133540 0x7f6f900707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f96051700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f90134020 0x7f6f90070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f96051700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90071720 con 0x7f6f90134020 2023-09-30T22:22:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f96051700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9011aad0 con 0x7f6f9012cef0 2023-09-30T22:22:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f96051700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90071e80 con 0x7f6f90133540 2023-09-30T22:22:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f90070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f90070270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43988/0 (socket says 172.21.15.154:43988) 2023-09-30T22:22:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/559673186 learned_addr learned my addr 172.21.15.154:0/559673186 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8ffff700 1 --2- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f90134020 0x7f6f90070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8ffff700 1 -- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90133540 msgr2=0x7f6f900707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8ffff700 1 --2- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90133540 0x7f6f900707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8ffff700 1 -- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 msgr2=0x7f6f90070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8ffff700 1 --2- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f90070270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8ffff700 1 -- 172.21.15.154:0/559673186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80011d40 con 0x7f6f90134020 2023-09-30T22:22:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8f7fe700 1 --2- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f90070270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f8ffff700 1 --2- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f90134020 0x7f6f90070cf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009d90 tx=0x7f6f8800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7fe9a5f0f700 1 -- start start 2023-09-30T22:22:32.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f77fff700 1 -- 172.21.15.154:0/559673186 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88003c20 con 0x7f6f90134020 2023-09-30T22:22:32.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f90072490 con 0x7f6f90134020 2023-09-30T22:22:32.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.807+0000 7f6f77fff700 1 -- 172.21.15.154:0/559673186 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800f040 con 0x7f6f90134020 2023-09-30T22:22:32.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7f6f77fff700 1 -- 172.21.15.154:0/559673186 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800c930 con 0x7f6f90134020 2023-09-30T22:22:32.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9011a530 con 0x7f6f90134020 2023-09-30T22:22:32.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe9a5f0f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009e870 0x7fe9a01c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe9a5f0f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9a009f350 0x7fe9a01c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe9a5f0f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a01371c0 0x7fe9a01c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:32.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe9a5f0f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a0136eb0 con 0x7fe9a01371c0 2023-09-30T22:22:32.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe9a5f0f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a006d440 con 0x7fe9a009e870 2023-09-30T22:22:32.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe9a5f0f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a011ba50 con 0x7fe9a009f350 2023-09-30T22:22:32.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe99effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9a009f350 0x7fe9a01c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe99effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9a009f350 0x7fe9a01c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41090/0 (socket says 172.21.15.154:41090) 2023-09-30T22:22:32.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe99effd700 1 -- 172.21.15.154:0/501163013 learned_addr learned my addr 172.21.15.154:0/501163013 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:32.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.808+0000 7fe99ffff700 1 --2- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a01371c0 0x7fe9a01c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:32.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe99effd700 1 -- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009e870 msgr2=0x7fe9a01c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe99effd700 1 --2- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009e870 0x7fe9a01c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe99effd700 1 -- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a01371c0 msgr2=0x7fe9a01c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe99effd700 1 --2- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a01371c0 0x7fe9a01c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe99effd700 1 -- 172.21.15.154:0/501163013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994009550 con 0x7fe9a009f350 2023-09-30T22:22:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9012f530 con 0x7f6f90134020 2023-09-30T22:22:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7f6f77fff700 1 -- 172.21.15.154:0/559673186 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6f8800ca90 con 0x7f6f90134020 2023-09-30T22:22:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe99effd700 1 --2- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9a009f350 0x7fe9a01c48d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe994009130 tx=0x7fe994004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7f6f77fff700 1 -- 172.21.15.154:0/559673186 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6f8803fea0 con 0x7f6f90134020 2023-09-30T22:22:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/559673186 >> v1:172.21.15.154:6816/126757 conn(0x7f6f7c02f510 legacy=0x7f6f7c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:32.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe987fff700 1 -- 172.21.15.154:0/501163013 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994003dc0 con 0x7fe9a009f350 2023-09-30T22:22:32.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe987fff700 1 -- 172.21.15.154:0/501163013 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99401f070 con 0x7fe9a009f350 2023-09-30T22:22:32.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe987fff700 1 -- 172.21.15.154:0/501163013 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99400b8a0 con 0x7fe9a009f350 2023-09-30T22:22:32.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a009dba0 con 0x7fe9a009f350 2023-09-30T22:22:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.809+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a011c2a0 con 0x7fe9a009f350 2023-09-30T22:22:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.810+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a009fd80 con 0x7fe9a009f350 2023-09-30T22:22:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.816+0000 7fe987fff700 1 -- 172.21.15.154:0/501163013 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe994021030 con 0x7fe9a009f350 2023-09-30T22:22:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.816+0000 7fe987fff700 1 -- 172.21.15.154:0/501163013 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fe994041770 con 0x7fe9a009f350 2023-09-30T22:22:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.816+0000 7fe99f7fe700 1 -- 172.21.15.154:0/501163013 >> v1:172.21.15.154:6816/126757 conn(0x7fe98c02f510 legacy=0x7fe98c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.816+0000 7fe987fff700 1 -- 172.21.15.154:0/501163013 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe994041b30 con 0x7fe9a009f350 2023-09-30T22:22:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.818+0000 7f6f77fff700 1 -- 172.21.15.154:0/559673186 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f8801c360 con 0x7f6f90134020 2023-09-30T22:22:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.878+0000 7f54c1753700 1 -- 172.21.15.154:0/2623256853 >> v1:172.21.15.154:6816/126757 conn(0x7f54a002f510 legacy=0x7f54a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:32.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.886+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f54bc125f00 con 0x7f54bc130eb0 2023-09-30T22:22:32.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.887+0000 7f54b1ffb700 1 -- 172.21.15.154:0/2623256853 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54bc125f00 con 0x7f54bc130eb0 2023-09-30T22:22:32.887 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:32.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 >> v1:172.21.15.154:6816/126757 conn(0x7f54a002f510 legacy=0x7f54a00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:32.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 msgr2=0x7f54bc123330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 --2- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc123330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54b4017000 tx=0x7f54b4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 shutdown_connections 2023-09-30T22:22:32.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 --2- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54bc130eb0 0x7f54bc123330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 --2- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54bc09d860 0x7f54bc1228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 --2- 172.21.15.154:0/2623256853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54bc09e170 0x7f54bc122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 >> 172.21.15.154:0/2623256853 conn(0x7f54bc099c40 msgr2=0x7f54bc0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 shutdown_connections 2023-09-30T22:22:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.889+0000 7f54c39b7700 1 -- 172.21.15.154:0/2623256853 wait complete. 2023-09-30T22:22:32.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:32.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.976+0000 7fb090880700 1 -- 172.21.15.154:0/915970149 >> v1:172.21.15.154:6816/126757 conn(0x7fb07002f510 legacy=0x7fb0700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:32.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.983+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb08c13f300 con 0x7fb08c0a08e0 2023-09-30T22:22:32.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.983+0000 7fb081ffb700 1 -- 172.21.15.154:0/915970149 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb08c13f300 con 0x7fb08c0a08e0 2023-09-30T22:22:32.983 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:32.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.985+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 >> v1:172.21.15.154:6816/126757 conn(0x7fb07002f510 legacy=0x7fb0700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.985+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c0a08e0 msgr2=0x7fb08c132810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.985+0000 7fb0932e5700 1 --2- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c0a08e0 0x7fb08c132810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb08800e730 tx=0x7fb08800ea40 comp rx=0 tx=0).stop 2023-09-30T22:22:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.985+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 shutdown_connections 2023-09-30T22:22:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.985+0000 7fb0932e5700 1 --2- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb08c138040 0x7fb08c136ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.985+0000 7fb0932e5700 1 --2- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb08c0a08e0 0x7fb08c132810 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.985+0000 7fb0932e5700 1 --2- 172.21.15.154:0/915970149 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb08c0a1230 0x7fb08c132d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.985+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 >> 172.21.15.154:0/915970149 conn(0x7fb08c0a2980 msgr2=0x7fb08c071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.986+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 shutdown_connections 2023-09-30T22:22:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:32.986+0000 7fb0932e5700 1 -- 172.21.15.154:0/915970149 wait complete. 2023-09-30T22:22:32.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:33.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.010+0000 7f6f8f7fe700 1 -- 172.21.15.154:0/559673186 >> v1:172.21.15.154:6816/126757 conn(0x7f6f7c02f510 legacy=0x7f6f7c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:33.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.011+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f90072490 con 0x7f6f90134020 2023-09-30T22:22:33.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.011+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9a009fd80 con 0x7fe9a009f350 2023-09-30T22:22:33.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.011+0000 7f6f77fff700 1 -- 172.21.15.154:0/559673186 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f90072490 con 0x7f6f90134020 2023-09-30T22:22:33.012 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:33.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.011+0000 7fe987fff700 1 -- 172.21.15.154:0/501163013 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe99401a440 con 0x7fe9a009f350 2023-09-30T22:22:33.012 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 >> v1:172.21.15.154:6816/126757 conn(0x7f6f7c02f510 legacy=0x7f6f7c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f90134020 msgr2=0x7f6f90070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 --2- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f90134020 0x7f6f90070cf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009d90 tx=0x7f6f8800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 shutdown_connections 2023-09-30T22:22:33.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 --2- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f90134020 0x7f6f90070cf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 --2- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9012cef0 0x7f6f90070270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 --2- 172.21.15.154:0/559673186 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f90133540 0x7f6f900707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 >> 172.21.15.154:0/559673186 conn(0x7f6f90099c40 msgr2=0x7f6f9009cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:33.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 shutdown_connections 2023-09-30T22:22:33.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.013+0000 7f6f96051700 1 -- 172.21.15.154:0/559673186 wait complete. 2023-09-30T22:22:33.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 >> v1:172.21.15.154:6816/126757 conn(0x7fe98c02f510 legacy=0x7fe98c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:33.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9a009f350 msgr2=0x7fe9a01c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:33.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 --2- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9a009f350 0x7fe9a01c48d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe994009130 tx=0x7fe994004750 comp rx=0 tx=0).stop 2023-09-30T22:22:33.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 shutdown_connections 2023-09-30T22:22:33.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 --2- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a01371c0 0x7fe9a01c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 --2- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a009e870 0x7fe9a01c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 --2- 172.21.15.154:0/501163013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9a009f350 0x7fe9a01c48d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 >> 172.21.15.154:0/501163013 conn(0x7fe9a00a4430 msgr2=0x7fe9a00a2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 shutdown_connections 2023-09-30T22:22:33.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:33.014+0000 7fe9a5f0f700 1 -- 172.21.15.154:0/501163013 wait complete. 2023-09-30T22:22:33.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:33.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:33.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:33.998 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:34.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:34.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:34.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.041+0000 7f3fb2b90700 1 Processor -- start 2023-09-30T22:22:34.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.041+0000 7f3fb2b90700 1 -- start start 2023-09-30T22:22:34.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fb2b90700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fac136960 0x7f3fac138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fb2b90700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac139280 0x7f3fac13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fb2b90700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fac06b2d0 con 0x7f3fac133ad0 2023-09-30T22:22:34.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fb2b90700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fac1345b0 con 0x7f3fac136960 2023-09-30T22:22:34.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fb2b90700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac133610 con 0x7f3fac139280 2023-09-30T22:22:34.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fabfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fac136960 0x7f3fac138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fabfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fac136960 0x7f3fac138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46106/0 (socket says 172.21.15.154:46106) 2023-09-30T22:22:34.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fabfff700 1 -- 172.21.15.154:0/1869809157 learned_addr learned my addr 172.21.15.154:0/1869809157 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:34.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fb112d700 1 --2- 172.21.15.154:0/1869809157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac139280 0x7f3fac13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.042+0000 7f3fb112d700 1 -- 172.21.15.154:0/1869809157 >> v2:172.21.15.154:3300/0 conn(0x7f3fac136960 msgr2=0x7f3fac138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:34.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.043+0000 7f3fb112d700 1 --2- 172.21.15.154:0/1869809157 >> v2:172.21.15.154:3300/0 conn(0x7f3fac136960 0x7f3fac138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.043+0000 7f3fb112d700 1 -- 172.21.15.154:0/1869809157 >> v1:172.21.15.154:6789/0 conn(0x7f3fac133ad0 legacy=0x7f3fac133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.043+0000 7f3fb112d700 1 -- 172.21.15.154:0/1869809157 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac09a500 con 0x7f3fac139280 2023-09-30T22:22:34.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.043+0000 7f3fabfff700 1 --2- 172.21.15.154:0/1869809157 >> v2:172.21.15.154:3300/0 conn(0x7f3fac136960 0x7f3fac138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.043+0000 7f3fb112d700 1 --2- 172.21.15.154:0/1869809157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac139280 0x7f3fac13b660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009d90 tx=0x7f3fa400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=596c79995b961532 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.043+0000 7f3fab7fe700 1 -- 172.21.15.154:0/1869809157 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400e070 con 0x7f3fac139280 2023-09-30T22:22:34.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.043+0000 7f3fab7fe700 1 -- 172.21.15.154:0/1869809157 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa400bb20 con 0x7f3fac139280 2023-09-30T22:22:34.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.043+0000 7f3fab7fe700 1 -- 172.21.15.154:0/1869809157 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4012430 con 0x7f3fac139280 2023-09-30T22:22:34.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.044+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1869809157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac139280 msgr2=0x7f3fac13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.044+0000 7f3fb2b90700 1 --2- 172.21.15.154:0/1869809157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac139280 0x7f3fac13b660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009d90 tx=0x7f3fa400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:34.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.044+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1869809157 shutdown_connections 2023-09-30T22:22:34.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.044+0000 7f3fb2b90700 1 --2- 172.21.15.154:0/1869809157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac139280 0x7f3fac13b660 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.044+0000 7f3fb2b90700 1 --2- 172.21.15.154:0/1869809157 >> v2:172.21.15.154:3300/0 conn(0x7f3fac136960 0x7f3fac138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.044+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1869809157 >> 172.21.15.154:0/1869809157 conn(0x7f3fac099c40 msgr2=0x7f3fac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.044+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1869809157 shutdown_connections 2023-09-30T22:22:34.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.044+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1869809157 wait complete. 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.045+0000 7f3fb2b90700 1 Processor -- start 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.045+0000 7f3fb2b90700 1 -- start start 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb2b90700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fac133ad0 0x7f3fac12ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb2b90700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac136960 0x7f3fac12f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb2b90700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fac139280 0x7f3fac1cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb2b90700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac1316a0 con 0x7f3fac133ad0 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb2b90700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac11a610 con 0x7f3fac136960 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb2b90700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac12e850 con 0x7f3fac139280 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb092c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fac133ad0 0x7f3fac12ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb092c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fac133ad0 0x7f3fac12ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46110/0 (socket says 172.21.15.154:46110) 2023-09-30T22:22:34.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb092c700 1 -- 172.21.15.154:0/1971498083 learned_addr learned my addr 172.21.15.154:0/1971498083 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:34.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb112d700 1 --2- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fac139280 0x7f3fac1cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fabfff700 1 --2- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac136960 0x7f3fac12f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb112d700 1 -- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac136960 msgr2=0x7f3fac12f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb112d700 1 --2- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac136960 0x7f3fac12f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb112d700 1 -- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fac133ad0 msgr2=0x7f3fac12ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb112d700 1 --2- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fac133ad0 0x7f3fac12ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.046+0000 7f3fb112d700 1 -- 172.21.15.154:0/1971498083 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98009550 con 0x7f3fac139280 2023-09-30T22:22:34.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.047+0000 7f3fb112d700 1 --2- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fac139280 0x7f3fac1cc7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4016000 tx=0x7f3fa4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.047+0000 7f3fa97fa700 1 -- 172.21.15.154:0/1971498083 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4012430 con 0x7f3fac139280 2023-09-30T22:22:34.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.047+0000 7f3fa97fa700 1 -- 172.21.15.154:0/1971498083 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa4020070 con 0x7f3fac139280 2023-09-30T22:22:34.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.047+0000 7f3fa97fa700 1 -- 172.21.15.154:0/1971498083 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4004280 con 0x7f3fac139280 2023-09-30T22:22:34.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.047+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa4009a70 con 0x7f3fac139280 2023-09-30T22:22:34.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.047+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac11a0e0 con 0x7f3fac139280 2023-09-30T22:22:34.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.048+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac11a270 con 0x7f3fac139280 2023-09-30T22:22:34.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.049+0000 7f3fa97fa700 1 -- 172.21.15.154:0/1971498083 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3fa40043e0 con 0x7f3fac139280 2023-09-30T22:22:34.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.049+0000 7f3fa97fa700 1 -- 172.21.15.154:0/1971498083 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3fa4022070 con 0x7f3fac139280 2023-09-30T22:22:34.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.049+0000 7f3fb092c700 1 -- 172.21.15.154:0/1971498083 >> v1:172.21.15.154:6816/126757 conn(0x7f3f9002f540 legacy=0x7f3f900319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:34.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.054+0000 7f3fa97fa700 1 -- 172.21.15.154:0/1971498083 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fa4004690 con 0x7f3fac139280 2023-09-30T22:22:34.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.134+0000 7f48af15b700 1 Processor -- start 2023-09-30T22:22:34.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.134+0000 7f48af15b700 1 -- start start 2023-09-30T22:22:34.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.134+0000 7f48af15b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a8133900 0x7f48a8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.134+0000 7f48af15b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8134210 0x7f48a80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.134+0000 7f48af15b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48a80a0ee0 0x7f48a80a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.134+0000 7f48af15b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a809a760 con 0x7f48a80a0ee0 2023-09-30T22:22:34.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.134+0000 7f48af15b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a81336e0 con 0x7f48a8134210 2023-09-30T22:22:34.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.134+0000 7f48af15b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a809a080 con 0x7f48a8133900 2023-09-30T22:22:34.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8134210 0x7f48a80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8134210 0x7f48a80a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44038/0 (socket says 172.21.15.154:44038) 2023-09-30T22:22:34.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48ad6f8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48a80a0ee0 0x7f48a80a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a7fff700 1 -- 172.21.15.154:0/4071052168 learned_addr learned my addr 172.21.15.154:0/4071052168 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48acef7700 1 --2- 172.21.15.154:0/4071052168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a8133900 0x7f48a8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a7fff700 1 -- 172.21.15.154:0/4071052168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a8133900 msgr2=0x7f48a8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a7fff700 1 --2- 172.21.15.154:0/4071052168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a8133900 0x7f48a8133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a7fff700 1 -- 172.21.15.154:0/4071052168 >> v2:172.21.15.154:3300/0 conn(0x7f48a80a0ee0 msgr2=0x7f48a80a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a7fff700 1 --2- 172.21.15.154:0/4071052168 >> v2:172.21.15.154:3300/0 conn(0x7f48a80a0ee0 0x7f48a80a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a7fff700 1 -- 172.21.15.154:0/4071052168 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a80a23e0 con 0x7f48a8134210 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48ad6f8700 1 --2- 172.21.15.154:0/4071052168 >> v2:172.21.15.154:3300/0 conn(0x7f48a80a0ee0 0x7f48a80a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a7fff700 1 --2- 172.21.15.154:0/4071052168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8134210 0x7f48a80a09a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48940098f0 tx=0x7f4894009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98f87ecce0b9f6b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a77fe700 1 -- 172.21.15.154:0/4071052168 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894011830 con 0x7f48a8134210 2023-09-30T22:22:34.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a77fe700 1 -- 172.21.15.154:0/4071052168 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894011990 con 0x7f48a8134210 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.135+0000 7f48a77fe700 1 -- 172.21.15.154:0/4071052168 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894011d20 con 0x7f48a8134210 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.136+0000 7f48af15b700 1 -- 172.21.15.154:0/4071052168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8134210 msgr2=0x7f48a80a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.136+0000 7f48af15b700 1 --2- 172.21.15.154:0/4071052168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8134210 0x7f48a80a09a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48940098f0 tx=0x7f4894009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.136+0000 7f48af15b700 1 -- 172.21.15.154:0/4071052168 shutdown_connections 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.136+0000 7f48af15b700 1 --2- 172.21.15.154:0/4071052168 >> v2:172.21.15.154:3300/0 conn(0x7f48a80a0ee0 0x7f48a80a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.136+0000 7f48af15b700 1 --2- 172.21.15.154:0/4071052168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a8133900 0x7f48a8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.136+0000 7f48af15b700 1 --2- 172.21.15.154:0/4071052168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8134210 0x7f48a80a09a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.136+0000 7f48af15b700 1 -- 172.21.15.154:0/4071052168 >> 172.21.15.154:0/4071052168 conn(0x7f48a80a2980 msgr2=0x7f48a80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.136+0000 7f48af15b700 1 -- 172.21.15.154:0/4071052168 shutdown_connections 2023-09-30T22:22:34.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.136+0000 7f48af15b700 1 -- 172.21.15.154:0/4071052168 wait complete. 2023-09-30T22:22:34.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.137+0000 7f48af15b700 1 Processor -- start 2023-09-30T22:22:34.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.137+0000 7f48af15b700 1 -- start start 2023-09-30T22:22:34.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48af15b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a80a0ee0 0x7f48a811da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48af15b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8133900 0x7f48a811df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48af15b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a8134210 0x7f48a811e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48af15b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8121610 con 0x7f48a8134210 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48af15b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a8132fe0 con 0x7f48a8133900 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48af15b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a809a2c0 con 0x7f48a80a0ee0 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48ad6f8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a8134210 0x7f48a811e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48ad6f8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a8134210 0x7f48a811e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46128/0 (socket says 172.21.15.154:46128) 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48ad6f8700 1 -- 172.21.15.154:0/3785519752 learned_addr learned my addr 172.21.15.154:0/3785519752 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48acef7700 1 --2- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a80a0ee0 0x7f48a811da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48a7fff700 1 --2- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8133900 0x7f48a811df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48ad6f8700 1 -- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a80a0ee0 msgr2=0x7f48a811da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48ad6f8700 1 --2- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a80a0ee0 0x7f48a811da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48ad6f8700 1 -- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8133900 msgr2=0x7f48a811df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48ad6f8700 1 --2- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8133900 0x7f48a811df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.138+0000 7f48ad6f8700 1 -- 172.21.15.154:0/3785519752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0009a70 con 0x7f48a8134210 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.139+0000 7f48ad6f8700 1 --2- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a8134210 0x7f48a811e4d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f48a000efc0 tx=0x7f48a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.139+0000 7f48a57fa700 1 -- 172.21.15.154:0/3785519752 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a000ca90 con 0x7f48a8134210 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.139+0000 7f48a57fa700 1 -- 172.21.15.154:0/3785519752 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a000f040 con 0x7f48a8134210 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.139+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4894009550 con 0x7f48a8134210 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.139+0000 7f48a57fa700 1 -- 172.21.15.154:0/3785519752 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a000ce10 con 0x7f48a8134210 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.139+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a8120d00 con 0x7f48a8134210 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.140+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a81346c0 con 0x7f48a8134210 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.140+0000 7f48a57fa700 1 -- 172.21.15.154:0/3785519752 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f48a0014480 con 0x7f48a8134210 2023-09-30T22:22:34.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.141+0000 7f48a57fa700 1 -- 172.21.15.154:0/3785519752 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f48a0040300 con 0x7f48a8134210 2023-09-30T22:22:34.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.141+0000 7f48acef7700 1 -- 172.21.15.154:0/3785519752 >> v1:172.21.15.154:6816/126757 conn(0x7f488c02f510 legacy=0x7f488c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:34.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.149+0000 7f48a57fa700 1 -- 172.21.15.154:0/3785519752 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48a0012930 con 0x7f48a8134210 2023-09-30T22:22:34.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.175+0000 7f8ce0be9700 1 Processor -- start 2023-09-30T22:22:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.175+0000 7f8ce0be9700 1 -- start start 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8ce0be9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8ce0be9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc13d210 0x7f8cdc13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8ce0be9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc09eca0 con 0x7f8cdc06a770 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8ce0be9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc06b2e0 con 0x7f8cdc13d210 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8ce0be9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc09f720 con 0x7f8cdc1350d0 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cda59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8cdc06a770 0x7f8cdc1349c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35242/0 (socket says 172.21.15.154:35242) 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cda59c700 1 -- 172.21.15.154:0/2792749618 learned_addr learned my addr 172.21.15.154:0/2792749618 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cdad9d700 1 --2- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc13d210 0x7f8cdc13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cd9d9b700 1 --2- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cd959a700 1 -- 172.21.15.154:0/2792749618 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839995537 0 0) 0x7f8cdc09eca0 con 0x7f8cdc06a770 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cd959a700 1 -- 172.21.15.154:0/2792749618 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc40035b0 con 0x7f8cdc06a770 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cdad9d700 1 -- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 msgr2=0x7f8cdc13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cdad9d700 1 --2- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cdad9d700 1 -- 172.21.15.154:0/2792749618 >> v1:172.21.15.154:6789/0 conn(0x7f8cdc06a770 legacy=0x7f8cdc1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.176+0000 7f8cdad9d700 1 -- 172.21.15.154:0/2792749618 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc06b480 con 0x7f8cdc13d210 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.177+0000 7f8cd9d9b700 1 --2- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.177+0000 7f8cdad9d700 1 --2- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc13d210 0x7f8cdc13f5f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009dc0 tx=0x7f8cd400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dde7dadeca08d592 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.177+0000 7f8cd959a700 1 -- 172.21.15.154:0/2792749618 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd400e070 con 0x7f8cdc13d210 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.177+0000 7f8cd959a700 1 -- 172.21.15.154:0/2792749618 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd400bb20 con 0x7f8cdc13d210 2023-09-30T22:22:34.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.177+0000 7f8cd959a700 1 -- 172.21.15.154:0/2792749618 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4012430 con 0x7f8cdc13d210 2023-09-30T22:22:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.177+0000 7f8ce0be9700 1 -- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc13d210 msgr2=0x7f8cdc13f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.177+0000 7f8ce0be9700 1 --2- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc13d210 0x7f8cdc13f5f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009dc0 tx=0x7f8cd400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.178+0000 7f8ce0be9700 1 -- 172.21.15.154:0/2792749618 shutdown_connections 2023-09-30T22:22:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.178+0000 7f8ce0be9700 1 --2- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc13d210 0x7f8cdc13f5f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.178+0000 7f8ce0be9700 1 --2- 172.21.15.154:0/2792749618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.178+0000 7f8ce0be9700 1 -- 172.21.15.154:0/2792749618 >> 172.21.15.154:0/2792749618 conn(0x7f8cdc099c40 msgr2=0x7f8cdc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.178+0000 7f8ce0be9700 1 -- 172.21.15.154:0/2792749618 shutdown_connections 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.178+0000 7f8ce0be9700 1 -- 172.21.15.154:0/2792749618 wait complete. 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8ce0be9700 1 Processor -- start 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8ce0be9700 1 -- start start 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8ce0be9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc06a770 0x7f8cdc13aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8ce0be9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8ce0be9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cdc13d210 0x7f8cdc13b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8ce0be9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc072280 con 0x7f8cdc13d210 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8ce0be9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc138e50 con 0x7f8cdc06a770 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8ce0be9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc1393a0 con 0x7f8cdc1350d0 2023-09-30T22:22:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8cd9d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8cdad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cdc13d210 0x7f8cdc13b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8cd9d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41134/0 (socket says 172.21.15.154:41134) 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.179+0000 7f8cd9d9b700 1 -- 172.21.15.154:0/3499772819 learned_addr learned my addr 172.21.15.154:0/3499772819 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8cda59c700 1 --2- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc06a770 0x7f8cdc13aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8cd9d9b700 1 -- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc06a770 msgr2=0x7f8cdc13aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8cd9d9b700 1 --2- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc06a770 0x7f8cdc13aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8cd9d9b700 1 -- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cdc13d210 msgr2=0x7f8cdc13b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8cd9d9b700 1 --2- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cdc13d210 0x7f8cdc13b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8cd9d9b700 1 -- 172.21.15.154:0/3499772819 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd4009a70 con 0x7f8cdc1350d0 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8cdad9d700 1 --2- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cdc13d210 0x7f8cdc13b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8cd9d9b700 1 --2- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13b3e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000e810 tx=0x7f8cd000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8ccaffd700 1 -- 172.21.15.154:0/3499772819 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0013610 con 0x7f8cdc1350d0 2023-09-30T22:22:34.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f4c07cef700 1 Processor -- start 2023-09-30T22:22:34.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8ccaffd700 1 -- 172.21.15.154:0/3499772819 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0013770 con 0x7f8cdc1350d0 2023-09-30T22:22:34.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8ccaffd700 1 -- 172.21.15.154:0/3499772819 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0013b20 con 0x7f8cdc1350d0 2023-09-30T22:22:34.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.181+0000 7f4c07cef700 1 -- start start 2023-09-30T22:22:34.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.181+0000 7f4c07cef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c00138040 0x7f4c00138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc139fe0 con 0x7f8cdc1350d0 2023-09-30T22:22:34.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.180+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc13be60 con 0x7f8cdc1350d0 2023-09-30T22:22:34.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.181+0000 7f4c07cef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c000a08e0 0x7f4c000a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.181+0000 7f4c07cef700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c001379e0 con 0x7f4c000a1230 2023-09-30T22:22:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.181+0000 7f4c07cef700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000a2100 con 0x7f4c00138040 2023-09-30T22:22:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.181+0000 7f4c07cef700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00138950 con 0x7f4c000a08e0 2023-09-30T22:22:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.181+0000 7f4c05a8b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c00138040 0x7f4c00138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c0628c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4c000a1230 0x7f4c0013ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35246/0 (socket says 172.21.15.154:35246) 2023-09-30T22:22:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c0628c700 1 -- 172.21.15.154:0/1101636442 learned_addr learned my addr 172.21.15.154:0/1101636442 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c0528a700 1 --2- 172.21.15.154:0/1101636442 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c000a08e0 0x7f4c000a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.181+0000 7f8ccaffd700 1 -- 172.21.15.154:0/3499772819 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8cd0013c80 con 0x7f8cdc1350d0 2023-09-30T22:22:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc136ff0 con 0x7f8cdc1350d0 2023-09-30T22:22:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c04a89700 1 -- 172.21.15.154:0/1101636442 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569473527 0 0) 0x7f4c001379e0 con 0x7f4c000a1230 2023-09-30T22:22:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c05a8b700 1 -- 172.21.15.154:0/1101636442 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c000a08e0 msgr2=0x7f4c000a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c05a8b700 1 --2- 172.21.15.154:0/1101636442 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c000a08e0 0x7f4c000a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c05a8b700 1 -- 172.21.15.154:0/1101636442 >> v1:172.21.15.154:6789/0 conn(0x7f4c000a1230 legacy=0x7f4c0013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c05a8b700 1 -- 172.21.15.154:0/1101636442 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0009b9b0 con 0x7f4c00138040 2023-09-30T22:22:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c05a8b700 1 --2- 172.21.15.154:0/1101636442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c00138040 0x7f4c00138410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009880 tx=0x7f4bfc009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4edfe11ddceac42d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c04a89700 1 -- 172.21.15.154:0/1101636442 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc005e30 con 0x7f4c00138040 2023-09-30T22:22:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c04a89700 1 -- 172.21.15.154:0/1101636442 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc006030 con 0x7f4c00138040 2023-09-30T22:22:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f4c04a89700 1 -- 172.21.15.154:0/1101636442 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0063c0 con 0x7f4c00138040 2023-09-30T22:22:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f8ccaffd700 1 -- 172.21.15.154:0/3499772819 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8cd003f8d0 con 0x7f8cdc1350d0 2023-09-30T22:22:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.182+0000 7f8cda59c700 1 -- 172.21.15.154:0/3499772819 >> v1:172.21.15.154:6816/126757 conn(0x7f8cbc02f540 legacy=0x7f8cbc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:34.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.183+0000 7f4c07cef700 1 -- 172.21.15.154:0/1101636442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c00138040 msgr2=0x7f4c00138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.183+0000 7f4c07cef700 1 --2- 172.21.15.154:0/1101636442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c00138040 0x7f4c00138410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009880 tx=0x7f4bfc009b90 comp rx=0 tx=0).stop 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.183+0000 7f4c07cef700 1 -- 172.21.15.154:0/1101636442 shutdown_connections 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.183+0000 7f4c07cef700 1 --2- 172.21.15.154:0/1101636442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c00138040 0x7f4c00138410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.183+0000 7f4c07cef700 1 --2- 172.21.15.154:0/1101636442 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c000a08e0 0x7f4c000a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.183+0000 7f4c07cef700 1 -- 172.21.15.154:0/1101636442 >> 172.21.15.154:0/1101636442 conn(0x7f4c000a2980 msgr2=0x7f4c000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.183+0000 7f4c07cef700 1 -- 172.21.15.154:0/1101636442 shutdown_connections 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.183+0000 7f4c07cef700 1 -- 172.21.15.154:0/1101636442 wait complete. 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.184+0000 7f4c07cef700 1 Processor -- start 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.184+0000 7f4c07cef700 1 -- start start 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c07cef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c000a08e0 0x7f4c00126200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c07cef700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c000a1230 0x7f4c00126740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c07cef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c00138040 0x7f4c00126c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c05a8b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c000a08e0 0x7f4c00126200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c07cef700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00129060 con 0x7f4c000a1230 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c07cef700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00127f90 con 0x7f4c000a08e0 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c05a8b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c000a08e0 0x7f4c00126200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44078/0 (socket says 172.21.15.154:44078) 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c05a8b700 1 -- 172.21.15.154:0/4173837873 learned_addr learned my addr 172.21.15.154:0/4173837873 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c07cef700 1 -- 172.21.15.154:0/4173837873 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00128ca0 con 0x7f4c00138040 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c0628c700 1 --2- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c00138040 0x7f4c00126c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c0528a700 1 --2- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c000a1230 0x7f4c00126740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c05a8b700 1 -- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c00138040 msgr2=0x7f4c00126c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c05a8b700 1 --2- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c00138040 0x7f4c00126c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c05a8b700 1 -- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c000a1230 msgr2=0x7f4c00126740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c05a8b700 1 --2- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c000a1230 0x7f4c00126740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c05a8b700 1 -- 172.21.15.154:0/4173837873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc009430 con 0x7f4c000a08e0 2023-09-30T22:22:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4c05a8b700 1 --2- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c000a08e0 0x7f4c00126200 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc013040 tx=0x7f4bfc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.185+0000 7f4bf67fc700 1 -- 172.21.15.154:0/4173837873 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc025430 con 0x7f4c000a08e0 2023-09-30T22:22:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.186+0000 7f4bf67fc700 1 -- 172.21.15.154:0/4173837873 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc020070 con 0x7f4c000a08e0 2023-09-30T22:22:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.186+0000 7f4c07cef700 1 -- 172.21.15.154:0/4173837873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0009a240 con 0x7f4c000a08e0 2023-09-30T22:22:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.186+0000 7f4bf67fc700 1 -- 172.21.15.154:0/4173837873 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0257b0 con 0x7f4c000a08e0 2023-09-30T22:22:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.186+0000 7f4c07cef700 1 -- 172.21.15.154:0/4173837873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c00129a40 con 0x7f4c000a08e0 2023-09-30T22:22:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.187+0000 7f4be3fff700 1 -- 172.21.15.154:0/4173837873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0004f2a0 con 0x7f4c000a08e0 2023-09-30T22:22:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.187+0000 7f8ccaffd700 1 -- 172.21.15.154:0/3499772819 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cd0012370 con 0x7f8cdc1350d0 2023-09-30T22:22:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.187+0000 7f4bf67fc700 1 -- 172.21.15.154:0/4173837873 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4bfc022030 con 0x7f4c000a08e0 2023-09-30T22:22:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.188+0000 7f4bf67fc700 1 -- 172.21.15.154:0/4173837873 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4bfc0411f0 con 0x7f4c000a08e0 2023-09-30T22:22:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.188+0000 7f4c0528a700 1 -- 172.21.15.154:0/4173837873 >> v1:172.21.15.154:6816/126757 conn(0x7f4be402f510 legacy=0x7f4be40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.196+0000 7f4bf67fc700 1 -- 172.21.15.154:0/4173837873 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bfc0197c0 con 0x7f4c000a08e0 2023-09-30T22:22:34.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.250+0000 7f3fb092c700 1 -- 172.21.15.154:0/1971498083 >> v1:172.21.15.154:6816/126757 conn(0x7f3f9002f540 legacy=0x7f3f900319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:34.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.261+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3fac09f390 con 0x7f3fac139280 2023-09-30T22:22:34.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.262+0000 7f3fa97fa700 1 -- 172.21.15.154:0/1971498083 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fa4035090 con 0x7f3fac139280 2023-09-30T22:22:34.263 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:34.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 >> v1:172.21.15.154:6816/126757 conn(0x7f3f9002f540 legacy=0x7f3f900319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:34.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fac139280 msgr2=0x7f3fac1cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 --2- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fac139280 0x7f3fac1cc7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4016000 tx=0x7f3fa4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 shutdown_connections 2023-09-30T22:22:34.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 --2- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fac139280 0x7f3fac1cc7c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 --2- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fac133ad0 0x7f3fac12ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 --2- 172.21.15.154:0/1971498083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fac136960 0x7f3fac12f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 >> 172.21.15.154:0/1971498083 conn(0x7f3fac099c40 msgr2=0x7f3fac134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 shutdown_connections 2023-09-30T22:22:34.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.264+0000 7f3fb2b90700 1 -- 172.21.15.154:0/1971498083 wait complete. 2023-09-30T22:22:34.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:34.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.342+0000 7f48acef7700 1 -- 172.21.15.154:0/3785519752 >> v1:172.21.15.154:6816/126757 conn(0x7f488c02f510 legacy=0x7f488c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:34.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.348+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f48a804f2a0 con 0x7f48a8134210 2023-09-30T22:22:34.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.348+0000 7f48a57fa700 1 -- 172.21.15.154:0/3785519752 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48a0018020 con 0x7f48a8134210 2023-09-30T22:22:34.348 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 >> v1:172.21.15.154:6816/126757 conn(0x7f488c02f510 legacy=0x7f488c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a8134210 msgr2=0x7f48a811e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 --2- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a8134210 0x7f48a811e4d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f48a000efc0 tx=0x7f48a000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 shutdown_connections 2023-09-30T22:22:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 --2- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48a8134210 0x7f48a811e4d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 --2- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48a80a0ee0 0x7f48a811da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 --2- 172.21.15.154:0/3785519752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48a8133900 0x7f48a811df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 >> 172.21.15.154:0/3785519752 conn(0x7f48a80a2980 msgr2=0x7f48a81bacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 shutdown_connections 2023-09-30T22:22:34.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.350+0000 7f48af15b700 1 -- 172.21.15.154:0/3785519752 wait complete. 2023-09-30T22:22:34.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:34.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.383+0000 7f8cda59c700 1 -- 172.21.15.154:0/3499772819 >> v1:172.21.15.154:6816/126757 conn(0x7f8cbc02f540 legacy=0x7f8cbc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:34.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.389+0000 7f4c0528a700 1 -- 172.21.15.154:0/4173837873 >> v1:172.21.15.154:6816/126757 conn(0x7f4be402f510 legacy=0x7f4be40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.393+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8cdc04f2a0 con 0x7f8cdc1350d0 2023-09-30T22:22:34.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.393+0000 7f8ccaffd700 1 -- 172.21.15.154:0/3499772819 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cd0010310 con 0x7f8cdc1350d0 2023-09-30T22:22:34.393 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.394+0000 7f4be3fff700 1 -- 172.21.15.154:0/4173837873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4c0012a510 con 0x7f4c000a08e0 2023-09-30T22:22:34.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.394+0000 7f4bf67fc700 1 -- 172.21.15.154:0/4173837873 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bfc0193b0 con 0x7f4c000a08e0 2023-09-30T22:22:34.394 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 >> v1:172.21.15.154:6816/126757 conn(0x7f8cbc02f540 legacy=0x7f8cbc0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 msgr2=0x7f8cdc13b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 --2- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13b3e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000e810 tx=0x7f8cd000eb20 comp rx=0 tx=0).stop 2023-09-30T22:22:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 shutdown_connections 2023-09-30T22:22:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 --2- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cdc13d210 0x7f8cdc13b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 --2- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cdc06a770 0x7f8cdc13aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 --2- 172.21.15.154:0/3499772819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cdc1350d0 0x7f8cdc13b3e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 >> 172.21.15.154:0/3499772819 conn(0x7f8cdc099c40 msgr2=0x7f8cdc09cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 shutdown_connections 2023-09-30T22:22:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f8ce0be9700 1 -- 172.21.15.154:0/3499772819 wait complete. 2023-09-30T22:22:34.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 -- 172.21.15.154:0/4173837873 >> v1:172.21.15.154:6816/126757 conn(0x7f4be402f510 legacy=0x7f4be40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 -- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c000a08e0 msgr2=0x7f4c00126200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 --2- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c000a08e0 0x7f4c00126200 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc013040 tx=0x7f4bfc004750 comp rx=0 tx=0).stop 2023-09-30T22:22:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 -- 172.21.15.154:0/4173837873 shutdown_connections 2023-09-30T22:22:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 --2- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c00138040 0x7f4c00126c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 --2- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c000a08e0 0x7f4c00126200 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 --2- 172.21.15.154:0/4173837873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c000a1230 0x7f4c00126740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 -- 172.21.15.154:0/4173837873 >> 172.21.15.154:0/4173837873 conn(0x7f4c000a2980 msgr2=0x7f4c0009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 -- 172.21.15.154:0/4173837873 shutdown_connections 2023-09-30T22:22:34.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:34.396+0000 7f4be3fff700 1 -- 172.21.15.154:0/4173837873 wait complete. 2023-09-30T22:22:34.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:34.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:35.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:35.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:35.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:35.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:35.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.421+0000 7f1493ed4700 1 Processor -- start 2023-09-30T22:22:35.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.421+0000 7f1493ed4700 1 -- start start 2023-09-30T22:22:35.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.421+0000 7f1493ed4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c133900 0x7f148c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.421+0000 7f1493ed4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c134210 0x7f148c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.421+0000 7f1493ed4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f148c0a0ee0 0x7f148c0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.421+0000 7f1493ed4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c09a760 con 0x7f148c0a0ee0 2023-09-30T22:22:35.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.421+0000 7f1493ed4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c1336e0 con 0x7f148c134210 2023-09-30T22:22:35.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.421+0000 7f1493ed4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148c09a080 con 0x7f148c133900 2023-09-30T22:22:35.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f149146f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c134210 0x7f148c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1491c70700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c133900 0x7f148c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f149146f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c134210 0x7f148c0a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41696/0 (socket says 172.21.15.154:41696) 2023-09-30T22:22:35.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f149146f700 1 -- 172.21.15.154:0/3463604406 learned_addr learned my addr 172.21.15.154:0/3463604406 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:35.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1491c70700 1 --2- 172.21.15.154:0/3463604406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c133900 0x7f148c133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36698/0 (socket says 172.21.15.154:36698) 2023-09-30T22:22:35.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1491c70700 1 -- 172.21.15.154:0/3463604406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c134210 msgr2=0x7f148c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1491c70700 1 --2- 172.21.15.154:0/3463604406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c134210 0x7f148c0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1491c70700 1 -- 172.21.15.154:0/3463604406 >> v2:172.21.15.154:3300/0 conn(0x7f148c0a0ee0 msgr2=0x7f148c0a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1491c70700 1 --2- 172.21.15.154:0/3463604406 >> v2:172.21.15.154:3300/0 conn(0x7f148c0a0ee0 0x7f148c0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1491c70700 1 -- 172.21.15.154:0/3463604406 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0a23e0 con 0x7f148c133900 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f149146f700 1 --2- 172.21.15.154:0/3463604406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c134210 0x7f148c0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1491c70700 1 --2- 172.21.15.154:0/3463604406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c133900 0x7f148c133cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1488009820 tx=0x7f1488009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a240d674148955b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1490c6e700 1 -- 172.21.15.154:0/3463604406 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488005e30 con 0x7f148c133900 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1490c6e700 1 -- 172.21.15.154:0/3463604406 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488006030 con 0x7f148c133900 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.422+0000 7f1490c6e700 1 -- 172.21.15.154:0/3463604406 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880063c0 con 0x7f148c133900 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.423+0000 7f1493ed4700 1 -- 172.21.15.154:0/3463604406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c133900 msgr2=0x7f148c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.423+0000 7f1493ed4700 1 --2- 172.21.15.154:0/3463604406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c133900 0x7f148c133cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1488009820 tx=0x7f1488009b30 comp rx=0 tx=0).stop 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.423+0000 7f1493ed4700 1 -- 172.21.15.154:0/3463604406 shutdown_connections 2023-09-30T22:22:35.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.423+0000 7f1493ed4700 1 --2- 172.21.15.154:0/3463604406 >> v2:172.21.15.154:3300/0 conn(0x7f148c0a0ee0 0x7f148c0a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.423+0000 7f1493ed4700 1 --2- 172.21.15.154:0/3463604406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c133900 0x7f148c133cd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.423+0000 7f1493ed4700 1 --2- 172.21.15.154:0/3463604406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c134210 0x7f148c0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.423+0000 7f1493ed4700 1 -- 172.21.15.154:0/3463604406 >> 172.21.15.154:0/3463604406 conn(0x7f148c0a2980 msgr2=0x7f148c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.423+0000 7f1493ed4700 1 -- 172.21.15.154:0/3463604406 shutdown_connections 2023-09-30T22:22:35.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.423+0000 7f1493ed4700 1 -- 172.21.15.154:0/3463604406 wait complete. 2023-09-30T22:22:35.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.424+0000 7f1493ed4700 1 Processor -- start 2023-09-30T22:22:35.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.424+0000 7f1493ed4700 1 -- start start 2023-09-30T22:22:35.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f1493ed4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c0a0ee0 0x7f148c11d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f1493ed4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c133900 0x7f148c11def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f1493ed4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f148c134210 0x7f148c11e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f1493ed4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c121230 con 0x7f148c134210 2023-09-30T22:22:35.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f1493ed4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c1203c0 con 0x7f148c133900 2023-09-30T22:22:35.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f1493ed4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148c121430 con 0x7f148c0a0ee0 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f149146f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c133900 0x7f148c11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f149146f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c133900 0x7f148c11def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41700/0 (socket says 172.21.15.154:41700) 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f149146f700 1 -- 172.21.15.154:0/133319058 learned_addr learned my addr 172.21.15.154:0/133319058 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f1492471700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f148c134210 0x7f148c11e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.425+0000 7f1491c70700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c0a0ee0 0x7f148c11d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f149146f700 1 -- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c0a0ee0 msgr2=0x7f148c11d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f149146f700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c0a0ee0 0x7f148c11d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f149146f700 1 -- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f148c134210 msgr2=0x7f148c11e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f149146f700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f148c134210 0x7f148c11e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f149146f700 1 -- 172.21.15.154:0/133319058 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c009550 con 0x7f148c133900 2023-09-30T22:22:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f1491c70700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c0a0ee0 0x7f148c11d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f149146f700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c133900 0x7f148c11def0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f147c00ebe0 tx=0x7f147c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f14827fc700 1 -- 172.21.15.154:0/133319058 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00c850 con 0x7f148c133900 2023-09-30T22:22:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f14827fc700 1 -- 172.21.15.154:0/133319058 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00c9b0 con 0x7f148c133900 2023-09-30T22:22:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1488009430 con 0x7f148c133900 2023-09-30T22:22:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c09a2c0 con 0x7f148c133900 2023-09-30T22:22:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.426+0000 7f14827fc700 1 -- 172.21.15.154:0/133319058 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00cd60 con 0x7f148c133900 2023-09-30T22:22:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.427+0000 7f14827fc700 1 -- 172.21.15.154:0/133319058 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f147c013470 con 0x7f148c133900 2023-09-30T22:22:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.427+0000 7f14827fc700 1 -- 172.21.15.154:0/133319058 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f147c040080 con 0x7f148c133900 2023-09-30T22:22:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.427+0000 7f1491c70700 1 -- 172.21.15.154:0/133319058 >> v1:172.21.15.154:6816/126757 conn(0x7f147002f510 legacy=0x7f14700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:35.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.428+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14740052e0 con 0x7f148c133900 2023-09-30T22:22:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.434+0000 7f14827fc700 1 -- 172.21.15.154:0/133319058 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f147c021080 con 0x7f148c133900 2023-09-30T22:22:35.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.500+0000 7f1ac468b700 1 Processor -- start 2023-09-30T22:22:35.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.500+0000 7f1ac468b700 1 -- start start 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac468b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1abc09e870 0x7f1abc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac468b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc09f180 0x7f1abc133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac468b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1abc09fa00 con 0x7f1abc134160 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac468b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1abc0a0370 con 0x7f1abc09e870 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac468b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc06bec0 con 0x7f1abc09f180 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac2427700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1abc09e870 0x7f1abc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac2427700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1abc09e870 0x7f1abc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52854/0 (socket says 172.21.15.154:52854) 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac2427700 1 -- 172.21.15.154:0/872387047 learned_addr learned my addr 172.21.15.154:0/872387047 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac1c26700 1 --2- 172.21.15.154:0/872387047 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc09f180 0x7f1abc133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac2427700 1 -- 172.21.15.154:0/872387047 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc09f180 msgr2=0x7f1abc133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac2427700 1 --2- 172.21.15.154:0/872387047 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc09f180 0x7f1abc133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac2427700 1 -- 172.21.15.154:0/872387047 >> v1:172.21.15.154:6789/0 conn(0x7f1abc134160 legacy=0x7f1abc13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac2427700 1 -- 172.21.15.154:0/872387047 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc09ada0 con 0x7f1abc09e870 2023-09-30T22:22:35.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.501+0000 7f1ac2427700 1 --2- 172.21.15.154:0/872387047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 0x7f1abc09ec40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80098f0 tx=0x7f1ab8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4b0a6e8a0a5cbf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.502+0000 7f1ac1425700 1 -- 172.21.15.154:0/872387047 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8011830 con 0x7f1abc09e870 2023-09-30T22:22:35.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.502+0000 7f1ac1425700 1 -- 172.21.15.154:0/872387047 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab8011990 con 0x7f1abc09e870 2023-09-30T22:22:35.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.502+0000 7f1ac1425700 1 -- 172.21.15.154:0/872387047 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8011d20 con 0x7f1abc09e870 2023-09-30T22:22:35.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.502+0000 7f1ac468b700 1 -- 172.21.15.154:0/872387047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 msgr2=0x7f1abc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.502+0000 7f1ac468b700 1 --2- 172.21.15.154:0/872387047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 0x7f1abc09ec40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80098f0 tx=0x7f1ab8009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:35.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.502+0000 7f1ac468b700 1 -- 172.21.15.154:0/872387047 shutdown_connections 2023-09-30T22:22:35.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.502+0000 7f1ac468b700 1 --2- 172.21.15.154:0/872387047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 0x7f1abc09ec40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.502+0000 7f1ac468b700 1 --2- 172.21.15.154:0/872387047 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc09f180 0x7f1abc133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.502+0000 7f1ac468b700 1 -- 172.21.15.154:0/872387047 >> 172.21.15.154:0/872387047 conn(0x7f1abc0a4430 msgr2=0x7f1abc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.503+0000 7f1ac468b700 1 -- 172.21.15.154:0/872387047 shutdown_connections 2023-09-30T22:22:35.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.503+0000 7f1ac468b700 1 -- 172.21.15.154:0/872387047 wait complete. 2023-09-30T22:22:35.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.503+0000 7f1ac468b700 1 Processor -- start 2023-09-30T22:22:35.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.503+0000 7f1ac468b700 1 -- start start 2023-09-30T22:22:35.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac468b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 0x7f1abc11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac468b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1abc09f180 0x7f1abc11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac468b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc134160 0x7f1abc11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac468b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc122480 con 0x7f1abc09e870 2023-09-30T22:22:35.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac468b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc121af0 con 0x7f1abc09f180 2023-09-30T22:22:35.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac468b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc1204e0 con 0x7f1abc134160 2023-09-30T22:22:35.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2c28700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc134160 0x7f1abc11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2c28700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc134160 0x7f1abc11f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36732/0 (socket says 172.21.15.154:36732) 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2c28700 1 -- 172.21.15.154:0/2991721242 learned_addr learned my addr 172.21.15.154:0/2991721242 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2427700 1 --2- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 0x7f1abc11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2c28700 1 -- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1abc09f180 msgr2=0x7f1abc11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2c28700 1 --2- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1abc09f180 0x7f1abc11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2c28700 1 -- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 msgr2=0x7f1abc11ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2c28700 1 --2- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 0x7f1abc11ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2c28700 1 -- 172.21.15.154:0/2991721242 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8009550 con 0x7f1abc134160 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.504+0000 7f1ac2427700 1 --2- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 0x7f1abc11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.505+0000 7f1ac2c28700 1 --2- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc134160 0x7f1abc11f550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400cc80 tx=0x7f1ab400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.505+0000 7f1ab2ffd700 1 -- 172.21.15.154:0/2991721242 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4003c00 con 0x7f1abc134160 2023-09-30T22:22:35.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.505+0000 7f1ab2ffd700 1 -- 172.21.15.154:0/2991721242 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4003d60 con 0x7f1abc134160 2023-09-30T22:22:35.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.505+0000 7f1ab2ffd700 1 -- 172.21.15.154:0/2991721242 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab400ab50 con 0x7f1abc134160 2023-09-30T22:22:35.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.505+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc06cfa0 con 0x7f1abc134160 2023-09-30T22:22:35.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.505+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc133ba0 con 0x7f1abc134160 2023-09-30T22:22:35.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.506+0000 7f1ab2ffd700 1 -- 172.21.15.154:0/2991721242 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1ab400acb0 con 0x7f1abc134160 2023-09-30T22:22:35.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.506+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc121f80 con 0x7f1abc134160 2023-09-30T22:22:35.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.506+0000 7f1ac2427700 1 -- 172.21.15.154:0/2991721242 >> v1:172.21.15.154:6816/126757 conn(0x7f1aa002f510 legacy=0x7f1aa00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:35.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.506+0000 7f1ab2ffd700 1 -- 172.21.15.154:0/2991721242 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1ab403fba0 con 0x7f1abc134160 2023-09-30T22:22:35.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.515+0000 7f1ab2ffd700 1 -- 172.21.15.154:0/2991721242 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ab40198f0 con 0x7f1abc134160 2023-09-30T22:22:35.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.547+0000 7f05c9a0b700 1 Processor -- start 2023-09-30T22:22:35.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.547+0000 7f05c9a0b700 1 -- start start 2023-09-30T22:22:35.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c9a0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409e340 0x7f05c41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c9a0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c4135f20 0x7f05c4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c9a0b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c409aaa0 con 0x7f05c409d860 2023-09-30T22:22:35.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c9a0b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c409e730 con 0x7f05c409e340 2023-09-30T22:22:35.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c9a0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05c409f870 con 0x7f05c4135f20 2023-09-30T22:22:35.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c4135f20 0x7f05c4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c4135f20 0x7f05c4138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36748/0 (socket says 172.21.15.154:36748) 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c37fe700 1 -- 172.21.15.154:0/4195595269 learned_addr learned my addr 172.21.15.154:0/4195595269 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c1ffb700 1 -- 172.21.15.154:0/4195595269 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883097002 0 0) 0x7f05c409aaa0 con 0x7f05c409d860 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c27fc700 1 --2- 172.21.15.154:0/4195595269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409e340 0x7f05c41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c37fe700 1 -- 172.21.15.154:0/4195595269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409e340 msgr2=0x7f05c41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c37fe700 1 --2- 172.21.15.154:0/4195595269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409e340 0x7f05c41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c37fe700 1 -- 172.21.15.154:0/4195595269 >> v1:172.21.15.154:6789/0 conn(0x7f05c409d860 legacy=0x7f05c409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c37fe700 1 -- 172.21.15.154:0/4195595269 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c409b360 con 0x7f05c4135f20 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c27fc700 1 --2- 172.21.15.154:0/4195595269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409e340 0x7f05c41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.548+0000 7f05c37fe700 1 --2- 172.21.15.154:0/4195595269 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c4135f20 0x7f05c4138300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00d1b0 tx=0x7f05bc00d4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2163d6793d9c8f86 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c1ffb700 1 -- 172.21.15.154:0/4195595269 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc010070 con 0x7f05c4135f20 2023-09-30T22:22:35.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c1ffb700 1 -- 172.21.15.154:0/4195595269 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc00dde0 con 0x7f05c4135f20 2023-09-30T22:22:35.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c1ffb700 1 -- 172.21.15.154:0/4195595269 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00b310 con 0x7f05c4135f20 2023-09-30T22:22:35.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c9a0b700 1 -- 172.21.15.154:0/4195595269 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c4135f20 msgr2=0x7f05c4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c9a0b700 1 --2- 172.21.15.154:0/4195595269 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c4135f20 0x7f05c4138300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05bc00d1b0 tx=0x7f05bc00d4c0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c9a0b700 1 -- 172.21.15.154:0/4195595269 shutdown_connections 2023-09-30T22:22:35.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c9a0b700 1 --2- 172.21.15.154:0/4195595269 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c4135f20 0x7f05c4138300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c9a0b700 1 --2- 172.21.15.154:0/4195595269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409e340 0x7f05c41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c9a0b700 1 -- 172.21.15.154:0/4195595269 >> 172.21.15.154:0/4195595269 conn(0x7f05c4099c40 msgr2=0x7f05c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c9a0b700 1 -- 172.21.15.154:0/4195595269 shutdown_connections 2023-09-30T22:22:35.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.549+0000 7f05c9a0b700 1 -- 172.21.15.154:0/4195595269 wait complete. 2023-09-30T22:22:35.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.550+0000 7f05c9a0b700 1 Processor -- start 2023-09-30T22:22:35.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.550+0000 7f05c9a0b700 1 -- start start 2023-09-30T22:22:35.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c9a0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409d860 0x7f05c411c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c9a0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c409e340 0x7f05c411c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c9a0b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05c4135f20 0x7f05c411cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c9a0b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c411fc40 con 0x7f05c4135f20 2023-09-30T22:22:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c9a0b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c411f3d0 con 0x7f05c409d860 2023-09-30T22:22:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c9a0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05c411e560 con 0x7f05c409e340 2023-09-30T22:22:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c409e340 0x7f05c411c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c409e340 0x7f05c411c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36752/0 (socket says 172.21.15.154:36752) 2023-09-30T22:22:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c27fc700 1 -- 172.21.15.154:0/1500279911 learned_addr learned my addr 172.21.15.154:0/1500279911 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c2ffd700 1 --2- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409d860 0x7f05c411c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c37fe700 1 --2- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05c4135f20 0x7f05c411cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c27fc700 1 -- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409d860 msgr2=0x7f05c411c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c27fc700 1 --2- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409d860 0x7f05c411c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c27fc700 1 -- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05c4135f20 msgr2=0x7f05c411cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c27fc700 1 --2- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05c4135f20 0x7f05c411cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.551+0000 7f05c27fc700 1 -- 172.21.15.154:0/1500279911 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc00bd40 con 0x7f05c409e340 2023-09-30T22:22:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.552+0000 7f05c27fc700 1 --2- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c409e340 0x7f05c411c660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c750 tx=0x7f05b800ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.552+0000 7f05abfff700 1 -- 172.21.15.154:0/1500279911 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8011800 con 0x7f05c409e340 2023-09-30T22:22:35.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.552+0000 7f05abfff700 1 -- 172.21.15.154:0/1500279911 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8011960 con 0x7f05c409e340 2023-09-30T22:22:35.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.552+0000 7f05abfff700 1 -- 172.21.15.154:0/1500279911 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8011cd0 con 0x7f05c409e340 2023-09-30T22:22:35.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.552+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c409c8b0 con 0x7f05c409e340 2023-09-30T22:22:35.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.552+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c4133550 con 0x7f05c409e340 2023-09-30T22:22:35.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.553+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c411f600 con 0x7f05c409e340 2023-09-30T22:22:35.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.553+0000 7f05abfff700 1 -- 172.21.15.154:0/1500279911 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f05b8021350 con 0x7f05c409e340 2023-09-30T22:22:35.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.553+0000 7f05c2ffd700 1 -- 172.21.15.154:0/1500279911 >> v1:172.21.15.154:6816/126757 conn(0x7f05b002f510 legacy=0x7f05b00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:35.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.553+0000 7f05abfff700 1 -- 172.21.15.154:0/1500279911 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f05b803fbc0 con 0x7f05c409e340 2023-09-30T22:22:35.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.557+0000 7f05abfff700 1 -- 172.21.15.154:0/1500279911 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05c411f600 con 0x7f05c409e340 2023-09-30T22:22:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.565+0000 7f0a77788700 1 Processor -- start 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.565+0000 7f0a77788700 1 -- start start 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a77788700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a70133ad0 0x7f0a70133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a77788700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a77788700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a701309f0 0x7f0a7013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a77788700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7006b2d0 con 0x7f0a70133ad0 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a77788700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70133610 con 0x7f0a701309f0 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a77788700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7009a500 con 0x7f0a701300a0 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75d25700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a701309f0 0x7f0a7013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75d25700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a701309f0 0x7f0a7013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41746/0 (socket says 172.21.15.154:41746) 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75d25700 1 -- 172.21.15.154:0/2307580206 learned_addr learned my addr 172.21.15.154:0/2307580206 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75524700 1 --2- 172.21.15.154:0/2307580206 >> v2:172.21.15.154:3300/0 conn(0x7f0a70133ad0 0x7f0a70133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a74d23700 1 --2- 172.21.15.154:0/2307580206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75d25700 1 -- 172.21.15.154:0/2307580206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 msgr2=0x7f0a701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75d25700 1 --2- 172.21.15.154:0/2307580206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a701304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75d25700 1 -- 172.21.15.154:0/2307580206 >> v2:172.21.15.154:3300/0 conn(0x7f0a70133ad0 msgr2=0x7f0a70133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75d25700 1 --2- 172.21.15.154:0/2307580206 >> v2:172.21.15.154:3300/0 conn(0x7f0a70133ad0 0x7f0a70133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75d25700 1 -- 172.21.15.154:0/2307580206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a701338b0 con 0x7f0a701309f0 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75524700 1 --2- 172.21.15.154:0/2307580206 >> v2:172.21.15.154:3300/0 conn(0x7f0a70133ad0 0x7f0a70133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.566+0000 7f0a75d25700 1 --2- 172.21.15.154:0/2307580206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a701309f0 0x7f0a7013a980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009e50 tx=0x7f0a6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a3172c5602edcf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.567+0000 7f0a67fff700 1 -- 172.21.15.154:0/2307580206 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800e070 con 0x7f0a701309f0 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.567+0000 7f0a67fff700 1 -- 172.21.15.154:0/2307580206 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6800b910 con 0x7f0a701309f0 2023-09-30T22:22:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.567+0000 7f0a67fff700 1 -- 172.21.15.154:0/2307580206 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800bcc0 con 0x7f0a701309f0 2023-09-30T22:22:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.568+0000 7f0a77788700 1 -- 172.21.15.154:0/2307580206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a701309f0 msgr2=0x7f0a7013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.568+0000 7f0a77788700 1 --2- 172.21.15.154:0/2307580206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a701309f0 0x7f0a7013a980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009e50 tx=0x7f0a6800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.568+0000 7f0a77788700 1 -- 172.21.15.154:0/2307580206 shutdown_connections 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.568+0000 7f0a77788700 1 --2- 172.21.15.154:0/2307580206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a701309f0 0x7f0a7013a980 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.568+0000 7f0a77788700 1 --2- 172.21.15.154:0/2307580206 >> v2:172.21.15.154:3300/0 conn(0x7f0a70133ad0 0x7f0a70133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.568+0000 7f0a77788700 1 --2- 172.21.15.154:0/2307580206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.568+0000 7f0a77788700 1 -- 172.21.15.154:0/2307580206 >> 172.21.15.154:0/2307580206 conn(0x7f0a70099c40 msgr2=0x7f0a700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.568+0000 7f0a77788700 1 -- 172.21.15.154:0/2307580206 shutdown_connections 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.568+0000 7f0a77788700 1 -- 172.21.15.154:0/2307580206 wait complete. 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a77788700 1 Processor -- start 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a77788700 1 -- start start 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a77788700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a700713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a77788700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a701309f0 0x7f0a70071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a77788700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a70133ad0 0x7f0a70071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a77788700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7011fec0 con 0x7f0a701309f0 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a77788700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7011ee60 con 0x7f0a70133ad0 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a77788700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70072840 con 0x7f0a701300a0 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a75524700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a700713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a75524700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a700713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36766/0 (socket says 172.21.15.154:36766) 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a75524700 1 -- 172.21.15.154:0/3150437196 learned_addr learned my addr 172.21.15.154:0/3150437196 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a75d25700 1 --2- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a70133ad0 0x7f0a70071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.569+0000 7f0a74d23700 1 --2- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a701309f0 0x7f0a70071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a75524700 1 -- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a70133ad0 msgr2=0x7f0a70071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a75524700 1 --2- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a70133ad0 0x7f0a70071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a75524700 1 -- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a701309f0 msgr2=0x7f0a70071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a75524700 1 --2- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a701309f0 0x7f0a70071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a75524700 1 -- 172.21.15.154:0/3150437196 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c0094a0 con 0x7f0a701300a0 2023-09-30T22:22:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a75524700 1 --2- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a700713e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c014fd0 tx=0x7f0a6c00b750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a65ffb700 1 -- 172.21.15.154:0/3150437196 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c014320 con 0x7f0a701300a0 2023-09-30T22:22:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a65ffb700 1 -- 172.21.15.154:0/3150437196 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c014480 con 0x7f0a701300a0 2023-09-30T22:22:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a68009b30 con 0x7f0a701300a0 2023-09-30T22:22:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a65ffb700 1 -- 172.21.15.154:0/3150437196 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0147f0 con 0x7f0a701300a0 2023-09-30T22:22:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.570+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7011f920 con 0x7f0a701300a0 2023-09-30T22:22:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.571+0000 7f0a65ffb700 1 -- 172.21.15.154:0/3150437196 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0a6c00f510 con 0x7f0a701300a0 2023-09-30T22:22:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.571+0000 7f0a65ffb700 1 -- 172.21.15.154:0/3150437196 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0a6c050360 con 0x7f0a701300a0 2023-09-30T22:22:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.571+0000 7f0a74d23700 1 -- 172.21.15.154:0/3150437196 >> v1:172.21.15.154:6816/126757 conn(0x7f0a5402f540 legacy=0x7f0a540319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.572+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7012dd60 con 0x7f0a701300a0 2023-09-30T22:22:35.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.580+0000 7f0a65ffb700 1 -- 172.21.15.154:0/3150437196 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a6c00e670 con 0x7f0a701300a0 2023-09-30T22:22:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.628+0000 7f1491c70700 1 -- 172.21.15.154:0/133319058 >> v1:172.21.15.154:6816/126757 conn(0x7f147002f510 legacy=0x7f14700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.638+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1474005860 con 0x7f148c133900 2023-09-30T22:22:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.639+0000 7f14827fc700 1 -- 172.21.15.154:0/133319058 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f147c01b3b0 con 0x7f148c133900 2023-09-30T22:22:35.640 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 >> v1:172.21.15.154:6816/126757 conn(0x7f147002f510 legacy=0x7f14700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c133900 msgr2=0x7f148c11def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c133900 0x7f148c11def0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f147c00ebe0 tx=0x7f147c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 shutdown_connections 2023-09-30T22:22:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f148c134210 0x7f148c11e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f148c0a0ee0 0x7f148c11d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 --2- 172.21.15.154:0/133319058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f148c133900 0x7f148c11def0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 >> 172.21.15.154:0/133319058 conn(0x7f148c0a2980 msgr2=0x7f148c1bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 shutdown_connections 2023-09-30T22:22:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.641+0000 7f1493ed4700 1 -- 172.21.15.154:0/133319058 wait complete. 2023-09-30T22:22:35.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:35.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.707+0000 7f1ac2427700 1 -- 172.21.15.154:0/2991721242 >> v1:172.21.15.154:6816/126757 conn(0x7f1aa002f510 legacy=0x7f1aa00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:35.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.754+0000 7f05c2ffd700 1 -- 172.21.15.154:0/1500279911 >> v1:172.21.15.154:6816/126757 conn(0x7f05b002f510 legacy=0x7f05b00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.758+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f05c411f600 con 0x7f05c409e340 2023-09-30T22:22:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.759+0000 7f05abfff700 1 -- 172.21.15.154:0/1500279911 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05c411f600 con 0x7f05c409e340 2023-09-30T22:22:35.760 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:35.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 >> v1:172.21.15.154:6816/126757 conn(0x7f05b002f510 legacy=0x7f05b00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:35.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c409e340 msgr2=0x7f05c411c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 --2- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c409e340 0x7f05c411c660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05b800c750 tx=0x7f05b800ca60 comp rx=0 tx=0).stop 2023-09-30T22:22:35.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 shutdown_connections 2023-09-30T22:22:35.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 --2- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05c4135f20 0x7f05c411cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 --2- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05c409d860 0x7f05c411c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 --2- 172.21.15.154:0/1500279911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f05c409e340 0x7f05c411c660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 >> 172.21.15.154:0/1500279911 conn(0x7f05c4099c40 msgr2=0x7f05c40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 shutdown_connections 2023-09-30T22:22:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.761+0000 7f05c9a0b700 1 -- 172.21.15.154:0/1500279911 wait complete. 2023-09-30T22:22:35.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.773+0000 7f0a74d23700 1 -- 172.21.15.154:0/3150437196 >> v1:172.21.15.154:6816/126757 conn(0x7f0a5402f540 legacy=0x7f0a540319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:35.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:35.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.787+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1abc1222c0 con 0x7f1abc134160 2023-09-30T22:22:35.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.787+0000 7f1ab2ffd700 1 -- 172.21.15.154:0/2991721242 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1abc1222c0 con 0x7f1abc134160 2023-09-30T22:22:35.788 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:35.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 >> v1:172.21.15.154:6816/126757 conn(0x7f1aa002f510 legacy=0x7f1aa00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:35.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc134160 msgr2=0x7f1abc11f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 --2- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc134160 0x7f1abc11f550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400cc80 tx=0x7f1ab400cf90 comp rx=0 tx=0).stop 2023-09-30T22:22:35.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 shutdown_connections 2023-09-30T22:22:35.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 --2- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1abc134160 0x7f1abc11f550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 --2- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1abc09e870 0x7f1abc11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 --2- 172.21.15.154:0/2991721242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1abc09f180 0x7f1abc11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 >> 172.21.15.154:0/2991721242 conn(0x7f1abc0a4430 msgr2=0x7f1abc0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 shutdown_connections 2023-09-30T22:22:35.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.789+0000 7f1ac468b700 1 -- 172.21.15.154:0/2991721242 wait complete. 2023-09-30T22:22:35.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:35.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.832+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a700a2620 con 0x7f0a701300a0 2023-09-30T22:22:35.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.832+0000 7f0a65ffb700 1 -- 172.21.15.154:0/3150437196 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a6c00e260 con 0x7f0a701300a0 2023-09-30T22:22:35.833 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:35.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 >> v1:172.21.15.154:6816/126757 conn(0x7f0a5402f540 legacy=0x7f0a540319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:35.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 msgr2=0x7f0a700713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:35.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 --2- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a700713e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c014fd0 tx=0x7f0a6c00b750 comp rx=0 tx=0).stop 2023-09-30T22:22:35.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 shutdown_connections 2023-09-30T22:22:35.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 --2- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a70133ad0 0x7f0a70071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 --2- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a701300a0 0x7f0a700713e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 --2- 172.21.15.154:0/3150437196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a701309f0 0x7f0a70071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:35.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 >> 172.21.15.154:0/3150437196 conn(0x7f0a70099c40 msgr2=0x7f0a70132c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:35.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 shutdown_connections 2023-09-30T22:22:35.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:35.834+0000 7f0a77788700 1 -- 172.21.15.154:0/3150437196 wait complete. 2023-09-30T22:22:35.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:36.655 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:36.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde9beb5700 1 Processor -- start 2023-09-30T22:22:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde9beb5700 1 -- start start 2023-09-30T22:22:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde9beb5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a0a70 0x7fde940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde9beb5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde940a1380 0x7fde94133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde9beb5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9409dc00 con 0x7fde94133f50 2023-09-30T22:22:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde9beb5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9409ea60 con 0x7fde940a1380 2023-09-30T22:22:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde9beb5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde9409dec0 con 0x7fde940a0a70 2023-09-30T22:22:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde99c51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a0a70 0x7fde940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde99450700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde940a1380 0x7fde94133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.781+0000 7fde99c51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a0a70 0x7fde940a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36774/0 (socket says 172.21.15.154:36774) 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde99450700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde940a1380 0x7fde94133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52890/0 (socket says 172.21.15.154:52890) 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde99c51700 1 -- 172.21.15.154:0/56701269 learned_addr learned my addr 172.21.15.154:0/56701269 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde99c51700 1 -- 172.21.15.154:0/56701269 >> v2:172.21.15.154:3300/0 conn(0x7fde940a1380 msgr2=0x7fde94133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde99c51700 1 --2- 172.21.15.154:0/56701269 >> v2:172.21.15.154:3300/0 conn(0x7fde940a1380 0x7fde94133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde99c51700 1 -- 172.21.15.154:0/56701269 >> v1:172.21.15.154:6789/0 conn(0x7fde94133f50 legacy=0x7fde9413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde99c51700 1 -- 172.21.15.154:0/56701269 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9409e6a0 con 0x7fde940a0a70 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde99450700 1 --2- 172.21.15.154:0/56701269 >> v2:172.21.15.154:3300/0 conn(0x7fde940a1380 0x7fde94133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde99c51700 1 --2- 172.21.15.154:0/56701269 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a0a70 0x7fde940a0e40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde900098f0 tx=0x7fde90009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff6263cf2b87e094 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde98c4f700 1 -- 172.21.15.154:0/56701269 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90011830 con 0x7fde940a0a70 2023-09-30T22:22:36.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde98c4f700 1 -- 172.21.15.154:0/56701269 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90011990 con 0x7fde940a0a70 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.782+0000 7fde98c4f700 1 -- 172.21.15.154:0/56701269 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90011d20 con 0x7fde940a0a70 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.783+0000 7fde9beb5700 1 -- 172.21.15.154:0/56701269 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a0a70 msgr2=0x7fde940a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.783+0000 7fde9beb5700 1 --2- 172.21.15.154:0/56701269 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a0a70 0x7fde940a0e40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde900098f0 tx=0x7fde90009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.783+0000 7fde9beb5700 1 -- 172.21.15.154:0/56701269 shutdown_connections 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.783+0000 7fde9beb5700 1 --2- 172.21.15.154:0/56701269 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a0a70 0x7fde940a0e40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.783+0000 7fde9beb5700 1 --2- 172.21.15.154:0/56701269 >> v2:172.21.15.154:3300/0 conn(0x7fde940a1380 0x7fde94133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.783+0000 7fde9beb5700 1 -- 172.21.15.154:0/56701269 >> 172.21.15.154:0/56701269 conn(0x7fde940a6610 msgr2=0x7fde940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.783+0000 7fde9beb5700 1 -- 172.21.15.154:0/56701269 shutdown_connections 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.783+0000 7fde9beb5700 1 -- 172.21.15.154:0/56701269 wait complete. 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde9beb5700 1 Processor -- start 2023-09-30T22:22:36.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde9beb5700 1 -- start start 2023-09-30T22:22:36.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde9beb5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde940a0a70 0x7fde941c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde9beb5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a1380 0x7fde941c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde9beb5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde94133f50 0x7fde941c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde9beb5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde941247f0 con 0x7fde94133f50 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde9beb5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde94124600 con 0x7fde940a0a70 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde9beb5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde941252e0 con 0x7fde940a1380 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde99450700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a1380 0x7fde941c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.784+0000 7fde99c51700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde940a0a70 0x7fde941c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde9a452700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde94133f50 0x7fde941c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde99450700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a1380 0x7fde941c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36780/0 (socket says 172.21.15.154:36780) 2023-09-30T22:22:36.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde99450700 1 -- 172.21.15.154:0/2261596086 learned_addr learned my addr 172.21.15.154:0/2261596086 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde99c51700 1 -- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a1380 msgr2=0x7fde941c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde99c51700 1 --2- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a1380 0x7fde941c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde99c51700 1 -- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde94133f50 msgr2=0x7fde941c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde99c51700 1 --2- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde94133f50 0x7fde941c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde99c51700 1 -- 172.21.15.154:0/2261596086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840094a0 con 0x7fde940a0a70 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde9a452700 1 --2- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde94133f50 0x7fde941c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde99450700 1 --2- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a1380 0x7fde941c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde99c51700 1 --2- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde940a0a70 0x7fde941c8200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde90016000 tx=0x7fde90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde8a7fc700 1 -- 172.21.15.154:0/2261596086 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90004400 con 0x7fde940a0a70 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde8a7fc700 1 -- 172.21.15.154:0/2261596086 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9001f070 con 0x7fde940a0a70 2023-09-30T22:22:36.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde90009550 con 0x7fde940a0a70 2023-09-30T22:22:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde8a7fc700 1 -- 172.21.15.154:0/2261596086 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde900038e0 con 0x7fde940a0a70 2023-09-30T22:22:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.785+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde94126230 con 0x7fde940a0a70 2023-09-30T22:22:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.786+0000 7fde8a7fc700 1 -- 172.21.15.154:0/2261596086 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fde90021030 con 0x7fde940a0a70 2023-09-30T22:22:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.786+0000 7fde8a7fc700 1 -- 172.21.15.154:0/2261596086 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fde90040dc0 con 0x7fde940a0a70 2023-09-30T22:22:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.786+0000 7fde99450700 1 -- 172.21.15.154:0/2261596086 >> v1:172.21.15.154:6816/126757 conn(0x7fde7802f510 legacy=0x7fde780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.786+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9404f2a0 con 0x7fde940a0a70 2023-09-30T22:22:36.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.792+0000 7fde8a7fc700 1 -- 172.21.15.154:0/2261596086 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde90015080 con 0x7fde940a0a70 2023-09-30T22:22:36.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:36.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:36.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb485cb0700 1 Processor -- start 2023-09-30T22:22:36.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb485cb0700 1 -- start start 2023-09-30T22:22:36.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb485cb0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb480133ad0 0x7fb480133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb485cb0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4801300a0 0x7fb4801304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb485cb0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 0x7fb48013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb485cb0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48006b2d0 con 0x7fb4801300a0 2023-09-30T22:22:36.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb485cb0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480133610 con 0x7fb4801309f0 2023-09-30T22:22:36.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb485cb0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb48009a500 con 0x7fb480133ad0 2023-09-30T22:22:36.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb47effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4801300a0 0x7fb4801304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb47effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4801300a0 0x7fb4801304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52912/0 (socket says 172.21.15.154:52912) 2023-09-30T22:22:36.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb47effd700 1 -- 172.21.15.154:0/2762794580 learned_addr learned my addr 172.21.15.154:0/2762794580 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:36.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb47f7fe700 1 --2- 172.21.15.154:0/2762794580 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb480133ad0 0x7fb480133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.905+0000 7fb47ffff700 1 --2- 172.21.15.154:0/2762794580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 0x7fb48013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47f7fe700 1 -- 172.21.15.154:0/2762794580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 msgr2=0x7fb48013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:36.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47f7fe700 1 --2- 172.21.15.154:0/2762794580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 0x7fb48013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47f7fe700 1 -- 172.21.15.154:0/2762794580 >> v2:172.21.15.154:3300/0 conn(0x7fb4801300a0 msgr2=0x7fb4801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47f7fe700 1 --2- 172.21.15.154:0/2762794580 >> v2:172.21.15.154:3300/0 conn(0x7fb4801300a0 0x7fb4801304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47f7fe700 1 -- 172.21.15.154:0/2762794580 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4801338b0 con 0x7fb480133ad0 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47effd700 1 --2- 172.21.15.154:0/2762794580 >> v2:172.21.15.154:3300/0 conn(0x7fb4801300a0 0x7fb4801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47f7fe700 1 --2- 172.21.15.154:0/2762794580 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb480133ad0 0x7fb480133ea0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb470009840 tx=0x7fb470009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4e4a9026c987cad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47e7fc700 1 -- 172.21.15.154:0/2762794580 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470011830 con 0x7fb480133ad0 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47e7fc700 1 -- 172.21.15.154:0/2762794580 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470011990 con 0x7fb480133ad0 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.906+0000 7fb47e7fc700 1 -- 172.21.15.154:0/2762794580 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470011d20 con 0x7fb480133ad0 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.907+0000 7fb485cb0700 1 -- 172.21.15.154:0/2762794580 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb480133ad0 msgr2=0x7fb480133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.907+0000 7fb485cb0700 1 --2- 172.21.15.154:0/2762794580 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb480133ad0 0x7fb480133ea0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb470009840 tx=0x7fb470009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:36.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.907+0000 7fb485cb0700 1 -- 172.21.15.154:0/2762794580 shutdown_connections 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.907+0000 7fb485cb0700 1 --2- 172.21.15.154:0/2762794580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 0x7fb48013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.907+0000 7fb485cb0700 1 --2- 172.21.15.154:0/2762794580 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb480133ad0 0x7fb480133ea0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.907+0000 7fb485cb0700 1 --2- 172.21.15.154:0/2762794580 >> v2:172.21.15.154:3300/0 conn(0x7fb4801300a0 0x7fb4801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.907+0000 7fb485cb0700 1 -- 172.21.15.154:0/2762794580 >> 172.21.15.154:0/2762794580 conn(0x7fb480099c40 msgr2=0x7fb4800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.907+0000 7fb485cb0700 1 -- 172.21.15.154:0/2762794580 shutdown_connections 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.907+0000 7fb485cb0700 1 -- 172.21.15.154:0/2762794580 wait complete. 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.908+0000 7fb485cb0700 1 Processor -- start 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.908+0000 7fb485cb0700 1 -- start start 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.908+0000 7fb485cb0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4801300a0 0x7fb48011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.908+0000 7fb485cb0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 0x7fb48011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.908+0000 7fb485cb0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb480133ad0 0x7fb48011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.908+0000 7fb485cb0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48011fde0 con 0x7fb480133ad0 2023-09-30T22:22:36.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.908+0000 7fb485cb0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800a3350 con 0x7fb4801309f0 2023-09-30T22:22:36.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.908+0000 7fb485cb0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb48012dd00 con 0x7fb4801300a0 2023-09-30T22:22:36.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4801300a0 0x7fb48011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4801300a0 0x7fb48011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36804/0 (socket says 172.21.15.154:36804) 2023-09-30T22:22:36.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47f7fe700 1 -- 172.21.15.154:0/1053027737 learned_addr learned my addr 172.21.15.154:0/1053027737 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:36.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47ffff700 1 --2- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb480133ad0 0x7fb48011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47effd700 1 --2- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 0x7fb48011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47f7fe700 1 -- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 msgr2=0x7fb48011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47f7fe700 1 --2- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 0x7fb48011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47f7fe700 1 -- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb480133ad0 msgr2=0x7fb48011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47f7fe700 1 --2- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb480133ad0 0x7fb48011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47f7fe700 1 -- 172.21.15.154:0/1053027737 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474009550 con 0x7fb4801300a0 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb47f7fe700 1 --2- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4801300a0 0x7fb48011da40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb470009b90 tx=0x7fb470004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb467fff700 1 -- 172.21.15.154:0/1053027737 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470004450 con 0x7fb4801300a0 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb467fff700 1 -- 172.21.15.154:0/1053027737 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4700045b0 con 0x7fb4801300a0 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.909+0000 7fb467fff700 1 -- 172.21.15.154:0/1053027737 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700038a0 con 0x7fb4801300a0 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.910+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4700094a0 con 0x7fb4801300a0 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.910+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48011fb20 con 0x7fb4801300a0 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.911+0000 7fb467fff700 1 -- 172.21.15.154:0/1053027737 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb470003a00 con 0x7fb4801300a0 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.911+0000 7fb467fff700 1 -- 172.21.15.154:0/1053027737 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fb470040ce0 con 0x7fb4801300a0 2023-09-30T22:22:36.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.911+0000 7fb47effd700 1 -- 172.21.15.154:0/1053027737 >> v1:172.21.15.154:6816/126757 conn(0x7fb46c02f510 legacy=0x7fb46c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:36.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.911+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48004f2a0 con 0x7fb4801300a0 2023-09-30T22:22:36.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.920+0000 7fb467fff700 1 -- 172.21.15.154:0/1053027737 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb470015020 con 0x7fb4801300a0 2023-09-30T22:22:36.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.942+0000 7fa307aa3700 1 Processor -- start 2023-09-30T22:22:36.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.942+0000 7fa307aa3700 1 -- start start 2023-09-30T22:22:36.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.943+0000 7fa307aa3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa300131980 0x7fa300131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.943+0000 7fa307aa3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009c790 0x7fa300139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.943+0000 7fa307aa3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000a1640 con 0x7fa30009bc70 2023-09-30T22:22:36.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.943+0000 7fa307aa3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30006eb30 con 0x7fa300131980 2023-09-30T22:22:36.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.943+0000 7fa307aa3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000a22d0 con 0x7fa30009c790 2023-09-30T22:22:36.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.943+0000 7fa306040700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009c790 0x7fa300139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.943+0000 7fa30583f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa300131980 0x7fa300131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa306040700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009c790 0x7fa300139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36816/0 (socket says 172.21.15.154:36816) 2023-09-30T22:22:36.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa30583f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa300131980 0x7fa300131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41782/0 (socket says 172.21.15.154:41782) 2023-09-30T22:22:36.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa306040700 1 -- 172.21.15.154:0/2137437176 learned_addr learned my addr 172.21.15.154:0/2137437176 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:36.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa306040700 1 -- 172.21.15.154:0/2137437176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa300131980 msgr2=0x7fa300131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:36.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa306040700 1 --2- 172.21.15.154:0/2137437176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa300131980 0x7fa300131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa306040700 1 -- 172.21.15.154:0/2137437176 >> v1:172.21.15.154:6789/0 conn(0x7fa30009bc70 legacy=0x7fa30009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa306040700 1 -- 172.21.15.154:0/2137437176 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300131550 con 0x7fa30009c790 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa30583f700 1 --2- 172.21.15.154:0/2137437176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa300131980 0x7fa300131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa306040700 1 --2- 172.21.15.154:0/2137437176 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009c790 0x7fa300139710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009e80 tx=0x7fa2f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac86691d26a6f78a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa30483d700 1 -- 172.21.15.154:0/2137437176 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800e070 con 0x7fa30009c790 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa30483d700 1 -- 172.21.15.154:0/2137437176 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f8003a20 con 0x7fa30009c790 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.944+0000 7fa30483d700 1 -- 172.21.15.154:0/2137437176 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8003dd0 con 0x7fa30009c790 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.945+0000 7fa307aa3700 1 -- 172.21.15.154:0/2137437176 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009c790 msgr2=0x7fa300139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.945+0000 7fa307aa3700 1 --2- 172.21.15.154:0/2137437176 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009c790 0x7fa300139710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009e80 tx=0x7fa2f800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.945+0000 7fa307aa3700 1 -- 172.21.15.154:0/2137437176 shutdown_connections 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.945+0000 7fa307aa3700 1 --2- 172.21.15.154:0/2137437176 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009c790 0x7fa300139710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.945+0000 7fa307aa3700 1 --2- 172.21.15.154:0/2137437176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa300131980 0x7fa300131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.945+0000 7fa307aa3700 1 -- 172.21.15.154:0/2137437176 >> 172.21.15.154:0/2137437176 conn(0x7fa3000a2980 msgr2=0x7fa3000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:36.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.945+0000 7fa307aa3700 1 -- 172.21.15.154:0/2137437176 shutdown_connections 2023-09-30T22:22:36.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.945+0000 7fa307aa3700 1 -- 172.21.15.154:0/2137437176 wait complete. 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.947+0000 7fa307aa3700 1 Processor -- start 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.947+0000 7fa307aa3700 1 -- start start 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.947+0000 7fa307aa3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009bc70 0x7fa30011baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.947+0000 7fa307aa3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30009c790 0x7fa30011c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.947+0000 7fa307aa3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa300131980 0x7fa30011c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.947+0000 7fa307aa3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30011df80 con 0x7fa300131980 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.947+0000 7fa307aa3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa300130dd0 con 0x7fa30009c790 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.947+0000 7fa307aa3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa30011f5c0 con 0x7fa30009bc70 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30583f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009bc70 0x7fa30011baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30583f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009bc70 0x7fa30011baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36830/0 (socket says 172.21.15.154:36830) 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30583f700 1 -- 172.21.15.154:0/1667104399 learned_addr learned my addr 172.21.15.154:0/1667104399 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30503e700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30009c790 0x7fa30011c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa306040700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa300131980 0x7fa30011c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30583f700 1 -- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30009c790 msgr2=0x7fa30011c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30583f700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30009c790 0x7fa30011c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30583f700 1 -- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa300131980 msgr2=0x7fa30011c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30583f700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa300131980 0x7fa30011c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30583f700 1 -- 172.21.15.154:0/1667104399 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc009430 con 0x7fa30009bc70 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30503e700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30009c790 0x7fa30011c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa306040700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa300131980 0x7fa30011c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:36.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa30583f700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009bc70 0x7fa30011baf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009ed0 tx=0x7fa2fc00c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:36.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa2f67fc700 1 -- 172.21.15.154:0/1667104399 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc012440 con 0x7fa30009bc70 2023-09-30T22:22:36.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa2f67fc700 1 -- 172.21.15.154:0/1667104399 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc005a20 con 0x7fa30009bc70 2023-09-30T22:22:36.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.948+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f8009b30 con 0x7fa30009bc70 2023-09-30T22:22:36.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.949+0000 7fa2f67fc700 1 -- 172.21.15.154:0/1667104399 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc005d90 con 0x7fa30009bc70 2023-09-30T22:22:36.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.949+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30011f020 con 0x7fa30009bc70 2023-09-30T22:22:36.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.950+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa300132240 con 0x7fa30009bc70 2023-09-30T22:22:36.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.950+0000 7fa2f67fc700 1 -- 172.21.15.154:0/1667104399 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa2fc00ca50 con 0x7fa30009bc70 2023-09-30T22:22:36.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.950+0000 7fa2f67fc700 1 -- 172.21.15.154:0/1667104399 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa2fc048f20 con 0x7fa30009bc70 2023-09-30T22:22:36.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.950+0000 7fa30503e700 1 -- 172.21.15.154:0/1667104399 >> v1:172.21.15.154:6816/126757 conn(0x7fa2e402f510 legacy=0x7fa2e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:36.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.959+0000 7fa2f67fc700 1 -- 172.21.15.154:0/1667104399 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2fc023970 con 0x7fa30009bc70 2023-09-30T22:22:36.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.987+0000 7fde99450700 1 -- 172.21.15.154:0/2261596086 >> v1:172.21.15.154:6816/126757 conn(0x7fde7802f510 legacy=0x7fde780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:36.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.989+0000 7f3ed0d0d700 1 Processor -- start 2023-09-30T22:22:36.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.989+0000 7f3ed0d0d700 1 -- start start 2023-09-30T22:22:36.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.990+0000 7f3ed0d0d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc133660 0x7f3ecc135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.990+0000 7f3ed0d0d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc135f80 0x7f3ecc138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.990+0000 7f3ed0d0d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc09ae40 con 0x7f3ecc12d280 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.990+0000 7f3ed0d0d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc09b9a0 con 0x7f3ecc135f80 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.990+0000 7f3ed0d0d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc12dd60 con 0x7f3ecc133660 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.990+0000 7f3eca59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3ecc12d280 0x7f3ecc12d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35484/0 (socket says 172.21.15.154:35484) 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.990+0000 7f3eca59c700 1 -- 172.21.15.154:0/3636268234 learned_addr learned my addr 172.21.15.154:0/3636268234 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ecad9d700 1 --2- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc135f80 0x7f3ecc138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec9d9b700 1 --2- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc133660 0x7f3ecc135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec959a700 1 -- 172.21.15.154:0/3636268234 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872654539 0 0) 0x7f3ecc09ae40 con 0x7f3ecc12d280 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec959a700 1 -- 172.21.15.154:0/3636268234 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb40035b0 con 0x7f3ecc12d280 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec9d9b700 1 -- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc135f80 msgr2=0x7f3ecc138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:36.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec9d9b700 1 --2- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc135f80 0x7f3ecc138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec9d9b700 1 -- 172.21.15.154:0/3636268234 >> v1:172.21.15.154:6789/0 conn(0x7f3ecc12d280 legacy=0x7f3ecc12d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec9d9b700 1 -- 172.21.15.154:0/3636268234 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc09bbb0 con 0x7f3ecc133660 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec9d9b700 1 --2- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc133660 0x7f3ecc135a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009870 tx=0x7f3ec0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5a6e00846e3916b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ecad9d700 1 --2- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc135f80 0x7f3ecc138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec959a700 1 -- 172.21.15.154:0/3636268234 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0011830 con 0x7f3ecc133660 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec959a700 1 -- 172.21.15.154:0/3636268234 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0011990 con 0x7f3ecc133660 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.991+0000 7f3ec959a700 1 -- 172.21.15.154:0/3636268234 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0011d00 con 0x7f3ecc133660 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.992+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc133660 msgr2=0x7f3ecc135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.992+0000 7f3ed0d0d700 1 --2- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc133660 0x7f3ecc135a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009870 tx=0x7f3ec0009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.992+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/3636268234 shutdown_connections 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.992+0000 7f3ed0d0d700 1 --2- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc135f80 0x7f3ecc138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.992+0000 7f3ed0d0d700 1 --2- 172.21.15.154:0/3636268234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc133660 0x7f3ecc135a40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.992+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/3636268234 >> 172.21.15.154:0/3636268234 conn(0x7f3ecc0a2980 msgr2=0x7f3ecc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:36.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.993+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/3636268234 shutdown_connections 2023-09-30T22:22:36.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.993+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/3636268234 wait complete. 2023-09-30T22:22:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.994+0000 7f3ed0d0d700 1 Processor -- start 2023-09-30T22:22:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.994+0000 7f3ed0d0d700 1 -- start start 2023-09-30T22:22:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ed0d0d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc12d280 0x7f3ecc12c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ed0d0d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc133660 0x7f3ecc12c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ed0d0d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc135f80 0x7f3ecc1398e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ed0d0d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc071e70 con 0x7f3ecc135f80 2023-09-30T22:22:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ed0d0d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc137140 con 0x7f3ecc133660 2023-09-30T22:22:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ed0d0d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc137d70 con 0x7f3ecc12d280 2023-09-30T22:22:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3eca59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc12d280 0x7f3ecc12c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3eca59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc12d280 0x7f3ecc12c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36848/0 (socket says 172.21.15.154:36848) 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3eca59c700 1 -- 172.21.15.154:0/584799557 learned_addr learned my addr 172.21.15.154:0/584799557 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ecad9d700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc135f80 0x7f3ecc1398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ec9d9b700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc133660 0x7f3ecc12c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ec9d9b700 1 -- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc12d280 msgr2=0x7f3ecc12c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ec9d9b700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc12d280 0x7f3ecc12c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ec9d9b700 1 -- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc135f80 msgr2=0x7f3ecc1398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ec9d9b700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc135f80 0x7f3ecc1398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ec9d9b700 1 -- 172.21.15.154:0/584799557 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4009a70 con 0x7f3ecc133660 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.995+0000 7f3ecad9d700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc135f80 0x7f3ecc1398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.996+0000 7f3ec9d9b700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc133660 0x7f3ecc12c830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc09d0e0 tx=0x7f3ec0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.996+0000 7f3ebaffd700 1 -- 172.21.15.154:0/584799557 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0011d00 con 0x7f3ecc133660 2023-09-30T22:22:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.996+0000 7f3ebaffd700 1 -- 172.21.15.154:0/584799557 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0011e60 con 0x7f3ecc133660 2023-09-30T22:22:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.996+0000 7f3ebaffd700 1 -- 172.21.15.154:0/584799557 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0004280 con 0x7f3ecc133660 2023-09-30T22:22:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.996+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec00094a0 con 0x7f3ecc133660 2023-09-30T22:22:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.996+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc138750 con 0x7f3ecc133660 2023-09-30T22:22:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.997+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc137370 con 0x7f3ecc133660 2023-09-30T22:22:37.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.998+0000 7f3ebaffd700 1 -- 172.21.15.154:0/584799557 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3ec002a070 con 0x7f3ecc133660 2023-09-30T22:22:37.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.998+0000 7f3ebaffd700 1 -- 172.21.15.154:0/584799557 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3ec0048af0 con 0x7f3ecc133660 2023-09-30T22:22:37.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:36.998+0000 7f3eca59c700 1 -- 172.21.15.154:0/584799557 >> v1:172.21.15.154:6816/126757 conn(0x7f3eac02f510 legacy=0x7f3eac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.003+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fde940a2710 con 0x7fde940a0a70 2023-09-30T22:22:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.007+0000 7fde8a7fc700 1 -- 172.21.15.154:0/2261596086 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde90004560 con 0x7fde940a0a70 2023-09-30T22:22:37.007 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.007+0000 7f3ebaffd700 1 -- 172.21.15.154:0/584799557 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ec000b950 con 0x7f3ecc133660 2023-09-30T22:22:37.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.009+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 >> v1:172.21.15.154:6816/126757 conn(0x7fde7802f510 legacy=0x7fde780319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.009+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde940a0a70 msgr2=0x7fde941c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.009+0000 7fde9beb5700 1 --2- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde940a0a70 0x7fde941c8200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde90016000 tx=0x7fde90004750 comp rx=0 tx=0).stop 2023-09-30T22:22:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.010+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 shutdown_connections 2023-09-30T22:22:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.010+0000 7fde9beb5700 1 --2- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde94133f50 0x7fde941c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.010+0000 7fde9beb5700 1 --2- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde940a0a70 0x7fde941c8200 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.010+0000 7fde9beb5700 1 --2- 172.21.15.154:0/2261596086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde940a1380 0x7fde941c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.010+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 >> 172.21.15.154:0/2261596086 conn(0x7fde940a6610 msgr2=0x7fde940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.010+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 shutdown_connections 2023-09-30T22:22:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.010+0000 7fde9beb5700 1 -- 172.21.15.154:0/2261596086 wait complete. 2023-09-30T22:22:37.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.112+0000 7fb47effd700 1 -- 172.21.15.154:0/1053027737 >> v1:172.21.15.154:6816/126757 conn(0x7fb46c02f510 legacy=0x7fb46c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.130+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb48011f400 con 0x7fb4801300a0 2023-09-30T22:22:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.130+0000 7fb467fff700 1 -- 172.21.15.154:0/1053027737 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb470003cb0 con 0x7fb4801300a0 2023-09-30T22:22:37.131 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 >> v1:172.21.15.154:6816/126757 conn(0x7fb46c02f510 legacy=0x7fb46c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4801300a0 msgr2=0x7fb48011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 --2- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4801300a0 0x7fb48011da40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb470009b90 tx=0x7fb470004750 comp rx=0 tx=0).stop 2023-09-30T22:22:37.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 shutdown_connections 2023-09-30T22:22:37.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 --2- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb480133ad0 0x7fb48011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 --2- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4801300a0 0x7fb48011da40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 --2- 172.21.15.154:0/1053027737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4801309f0 0x7fb48011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 >> 172.21.15.154:0/1053027737 conn(0x7fb480099c40 msgr2=0x7fb48012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 shutdown_connections 2023-09-30T22:22:37.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.132+0000 7fb485cb0700 1 -- 172.21.15.154:0/1053027737 wait complete. 2023-09-30T22:22:37.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.151+0000 7fa30503e700 1 -- 172.21.15.154:0/1667104399 >> v1:172.21.15.154:6816/126757 conn(0x7fa2e402f510 legacy=0x7fa2e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:37.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.172+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa30009e600 con 0x7fa30009bc70 2023-09-30T22:22:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.173+0000 7fa2f67fc700 1 -- 172.21.15.154:0/1667104399 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2fc0233a0 con 0x7fa30009bc70 2023-09-30T22:22:37.174 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 >> v1:172.21.15.154:6816/126757 conn(0x7fa2e402f510 legacy=0x7fa2e40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009bc70 msgr2=0x7fa30011baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009bc70 0x7fa30011baf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009ed0 tx=0x7fa2fc00c430 comp rx=0 tx=0).stop 2023-09-30T22:22:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 shutdown_connections 2023-09-30T22:22:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa300131980 0x7fa30011c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa30009bc70 0x7fa30011baf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 --2- 172.21.15.154:0/1667104399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa30009c790 0x7fa30011c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 >> 172.21.15.154:0/1667104399 conn(0x7fa3000a2980 msgr2=0x7fa30009faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 shutdown_connections 2023-09-30T22:22:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.175+0000 7fa307aa3700 1 -- 172.21.15.154:0/1667104399 wait complete. 2023-09-30T22:22:37.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:37.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.199+0000 7f3eca59c700 1 -- 172.21.15.154:0/584799557 >> v1:172.21.15.154:6816/126757 conn(0x7f3eac02f510 legacy=0x7f3eac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.203+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ecc04f2a0 con 0x7f3ecc133660 2023-09-30T22:22:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.204+0000 7f3ebaffd700 1 -- 172.21.15.154:0/584799557 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ec0015070 con 0x7f3ecc133660 2023-09-30T22:22:37.204 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 >> v1:172.21.15.154:6816/126757 conn(0x7f3eac02f510 legacy=0x7f3eac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc133660 msgr2=0x7f3ecc12c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc133660 0x7f3ecc12c830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc09d0e0 tx=0x7f3ec0004750 comp rx=0 tx=0).stop 2023-09-30T22:22:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 shutdown_connections 2023-09-30T22:22:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ecc135f80 0x7f3ecc1398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ecc12d280 0x7f3ecc12c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 --2- 172.21.15.154:0/584799557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ecc133660 0x7f3ecc12c830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 >> 172.21.15.154:0/584799557 conn(0x7f3ecc0a2980 msgr2=0x7f3ecc133c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 shutdown_connections 2023-09-30T22:22:37.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:37.206+0000 7f3ed0d0d700 1 -- 172.21.15.154:0/584799557 wait complete. 2023-09-30T22:22:37.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:38.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:38.146 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:38.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.160+0000 7f102abc8700 1 Processor -- start 2023-09-30T22:22:38.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.160+0000 7f102abc8700 1 -- start start 2023-09-30T22:22:38.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.160+0000 7f102abc8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024136960 0x7f1024138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.160+0000 7f102abc8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1024139280 0x7f102413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.160+0000 7f102abc8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102406b2d0 con 0x7f1024133ad0 2023-09-30T22:22:38.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.160+0000 7f102abc8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10241345b0 con 0x7f1024139280 2023-09-30T22:22:38.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.160+0000 7f102abc8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1024133610 con 0x7f1024136960 2023-09-30T22:22:38.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1023fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024136960 0x7f1024138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1029165700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1024139280 0x7f102413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1023fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024136960 0x7f1024138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41828/0 (socket says 172.21.15.154:41828) 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1023fff700 1 -- 172.21.15.154:0/390957157 learned_addr learned my addr 172.21.15.154:0/390957157 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1029165700 1 -- 172.21.15.154:0/390957157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024136960 msgr2=0x7f1024138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1029165700 1 --2- 172.21.15.154:0/390957157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024136960 0x7f1024138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1029165700 1 -- 172.21.15.154:0/390957157 >> v1:172.21.15.154:6789/0 conn(0x7f1024133ad0 legacy=0x7f1024133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1029165700 1 -- 172.21.15.154:0/390957157 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102409a500 con 0x7f1024139280 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1023fff700 1 --2- 172.21.15.154:0/390957157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024136960 0x7f1024138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f1029165700 1 --2- 172.21.15.154:0/390957157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024139280 0x7f102413b660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f101c009dc0 tx=0x7f101c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695b2ee29d5b2949 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f10237fe700 1 -- 172.21.15.154:0/390957157 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00e070 con 0x7f1024139280 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f10237fe700 1 -- 172.21.15.154:0/390957157 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c00bae0 con 0x7f1024139280 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.161+0000 7f10237fe700 1 -- 172.21.15.154:0/390957157 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00be90 con 0x7f1024139280 2023-09-30T22:22:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.162+0000 7f102abc8700 1 -- 172.21.15.154:0/390957157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024139280 msgr2=0x7f102413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.162+0000 7f102abc8700 1 --2- 172.21.15.154:0/390957157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024139280 0x7f102413b660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f101c009dc0 tx=0x7f101c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.162+0000 7f102abc8700 1 -- 172.21.15.154:0/390957157 shutdown_connections 2023-09-30T22:22:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.162+0000 7f102abc8700 1 --2- 172.21.15.154:0/390957157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024139280 0x7f102413b660 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.162+0000 7f102abc8700 1 --2- 172.21.15.154:0/390957157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024136960 0x7f1024138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.162+0000 7f102abc8700 1 -- 172.21.15.154:0/390957157 >> 172.21.15.154:0/390957157 conn(0x7f1024099c40 msgr2=0x7f10240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.162+0000 7f102abc8700 1 -- 172.21.15.154:0/390957157 shutdown_connections 2023-09-30T22:22:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.162+0000 7f102abc8700 1 -- 172.21.15.154:0/390957157 wait complete. 2023-09-30T22:22:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.163+0000 7f102abc8700 1 Processor -- start 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.163+0000 7f102abc8700 1 -- start start 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f102abc8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024133ad0 0x7f10240715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f102abc8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024136960 0x7f1024071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f102abc8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1024139280 0x7f10241c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f102abc8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102409f390 con 0x7f1024136960 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f102abc8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102406ff90 con 0x7f1024133ad0 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f102abc8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f102406e900 con 0x7f1024139280 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1023fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024136960 0x7f1024071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1023fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024136960 0x7f1024071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52968/0 (socket says 172.21.15.154:52968) 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1023fff700 1 -- 172.21.15.154:0/1672871068 learned_addr learned my addr 172.21.15.154:0/1672871068 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1029165700 1 --2- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1024139280 0x7f10241c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1028964700 1 --2- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024133ad0 0x7f10240715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1023fff700 1 -- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1024139280 msgr2=0x7f10241c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1023fff700 1 --2- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1024139280 0x7f10241c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1023fff700 1 -- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024133ad0 msgr2=0x7f10240715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1023fff700 1 --2- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024133ad0 0x7f10240715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1023fff700 1 -- 172.21.15.154:0/1672871068 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010009550 con 0x7f1024136960 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f1023fff700 1 --2- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024136960 0x7f1024071b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f101000e9b0 tx=0x7f101000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.164+0000 7f10217fa700 1 -- 172.21.15.154:0/1672871068 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101000ee50 con 0x7f1024136960 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.165+0000 7f10217fa700 1 -- 172.21.15.154:0/1672871068 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101000c850 con 0x7f1024136960 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.165+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c009a70 con 0x7f1024136960 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.165+0000 7f10217fa700 1 -- 172.21.15.154:0/1672871068 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101000cbc0 con 0x7f1024136960 2023-09-30T22:22:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.165+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1024070cc0 con 0x7f1024136960 2023-09-30T22:22:38.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.165+0000 7f10217fa700 1 -- 172.21.15.154:0/1672871068 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f101000cd20 con 0x7f1024136960 2023-09-30T22:22:38.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.165+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102404f2a0 con 0x7f1024136960 2023-09-30T22:22:38.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.166+0000 7f10217fa700 1 -- 172.21.15.154:0/1672871068 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f101003ff00 con 0x7f1024136960 2023-09-30T22:22:38.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.166+0000 7f1028964700 1 -- 172.21.15.154:0/1672871068 >> v1:172.21.15.154:6816/126757 conn(0x7f100802f510 legacy=0x7f10080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.170+0000 7f10217fa700 1 -- 172.21.15.154:0/1672871068 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f101001b3b0 con 0x7f1024136960 2023-09-30T22:22:38.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:38.219 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:38.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16af1ce700 1 Processor -- start 2023-09-30T22:22:38.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16af1ce700 1 -- start start 2023-09-30T22:22:38.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16af1ce700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16a8133ad0 0x7f16a8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16af1ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a81300a0 0x7f16a81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16af1ce700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a806b2d0 con 0x7f16a81309f0 2023-09-30T22:22:38.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16af1ce700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a8133610 con 0x7f16a8133ad0 2023-09-30T22:22:38.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16af1ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a809a500 con 0x7f16a81300a0 2023-09-30T22:22:38.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16ad76b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f16a81309f0 0x7f16a813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35504/0 (socket says 172.21.15.154:35504) 2023-09-30T22:22:38.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16ad76b700 1 -- 172.21.15.154:0/3174545849 learned_addr learned my addr 172.21.15.154:0/3174545849 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:38.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.283+0000 7f16acf6a700 1 --2- 172.21.15.154:0/3174545849 >> v2:172.21.15.154:3300/0 conn(0x7f16a8133ad0 0x7f16a8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.284+0000 7f16acf6a700 1 -- 172.21.15.154:0/3174545849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a81300a0 msgr2=0x7f16a81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.284+0000 7f16acf6a700 1 --2- 172.21.15.154:0/3174545849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a81300a0 0x7f16a81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.284+0000 7f16acf6a700 1 -- 172.21.15.154:0/3174545849 >> v1:172.21.15.154:6789/0 conn(0x7f16a81309f0 legacy=0x7f16a813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.284+0000 7f16acf6a700 1 -- 172.21.15.154:0/3174545849 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a81338b0 con 0x7f16a8133ad0 2023-09-30T22:22:38.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.284+0000 7f16acf6a700 1 --2- 172.21.15.154:0/3174545849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a8133ad0 0x7f16a8133ea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f169c009840 tx=0x7f169c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d4ea780d8a9b8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.284+0000 7f16a77fe700 1 -- 172.21.15.154:0/3174545849 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c011830 con 0x7f16a8133ad0 2023-09-30T22:22:38.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.284+0000 7f16a77fe700 1 -- 172.21.15.154:0/3174545849 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c011990 con 0x7f16a8133ad0 2023-09-30T22:22:38.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.284+0000 7f16a77fe700 1 -- 172.21.15.154:0/3174545849 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c011d20 con 0x7f16a8133ad0 2023-09-30T22:22:38.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.285+0000 7f16af1ce700 1 -- 172.21.15.154:0/3174545849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a8133ad0 msgr2=0x7f16a8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.285+0000 7f16af1ce700 1 --2- 172.21.15.154:0/3174545849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a8133ad0 0x7f16a8133ea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f169c009840 tx=0x7f169c009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:38.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.285+0000 7f16af1ce700 1 -- 172.21.15.154:0/3174545849 shutdown_connections 2023-09-30T22:22:38.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.285+0000 7f16af1ce700 1 --2- 172.21.15.154:0/3174545849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a8133ad0 0x7f16a8133ea0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.285+0000 7f16af1ce700 1 --2- 172.21.15.154:0/3174545849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a81300a0 0x7f16a81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.285+0000 7f16af1ce700 1 -- 172.21.15.154:0/3174545849 >> 172.21.15.154:0/3174545849 conn(0x7f16a8099c40 msgr2=0x7f16a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.285+0000 7f16af1ce700 1 -- 172.21.15.154:0/3174545849 shutdown_connections 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.285+0000 7f16af1ce700 1 -- 172.21.15.154:0/3174545849 wait complete. 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.286+0000 7f16af1ce700 1 Processor -- start 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.286+0000 7f16af1ce700 1 -- start start 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16af1ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16a81300a0 0x7f16a811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16af1ce700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a81309f0 0x7f16a811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16af1ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a8133ad0 0x7f16a811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16af1ce700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a811f970 con 0x7f16a81309f0 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16af1ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80722f0 con 0x7f16a8133ad0 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16af1ce700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8120b90 con 0x7f16a81300a0 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16acf6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16a81300a0 0x7f16a811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16acf6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16a81300a0 0x7f16a811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36874/0 (socket says 172.21.15.154:36874) 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16acf6a700 1 -- 172.21.15.154:0/2076327102 learned_addr learned my addr 172.21.15.154:0/2076327102 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16a7fff700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a81309f0 0x7f16a811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.287+0000 7f16ad76b700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a8133ad0 0x7f16a811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16a7fff700 1 -- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16a81300a0 msgr2=0x7f16a811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16a7fff700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16a81300a0 0x7f16a811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16a7fff700 1 -- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a8133ad0 msgr2=0x7f16a811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16a7fff700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a8133ad0 0x7f16a811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16a7fff700 1 -- 172.21.15.154:0/2076327102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0094a0 con 0x7f16a81309f0 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16acf6a700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16a81300a0 0x7f16a811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16a7fff700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a81309f0 0x7f16a811df80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f169400b410 tx=0x7f169400b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16a57fa700 1 -- 172.21.15.154:0/2076327102 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694011620 con 0x7f16a81309f0 2023-09-30T22:22:38.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16a57fa700 1 -- 172.21.15.154:0/2076327102 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694011780 con 0x7f16a81309f0 2023-09-30T22:22:38.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16a57fa700 1 -- 172.21.15.154:0/2076327102 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694011b30 con 0x7f16a81309f0 2023-09-30T22:22:38.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a811fc80 con 0x7f16a81309f0 2023-09-30T22:22:38.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.288+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a812dd00 con 0x7f16a81309f0 2023-09-30T22:22:38.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.289+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a804f2a0 con 0x7f16a81309f0 2023-09-30T22:22:38.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.290+0000 7f16a57fa700 1 -- 172.21.15.154:0/2076327102 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1694011c90 con 0x7f16a81309f0 2023-09-30T22:22:38.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.290+0000 7f16a57fa700 1 -- 172.21.15.154:0/2076327102 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f169403ffe0 con 0x7f16a81309f0 2023-09-30T22:22:38.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.290+0000 7f16acf6a700 1 -- 172.21.15.154:0/2076327102 >> v1:172.21.15.154:6816/126757 conn(0x7f168c02f510 legacy=0x7f168c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:38.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.294+0000 7f16a57fa700 1 -- 172.21.15.154:0/2076327102 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1694021300 con 0x7f16a81309f0 2023-09-30T22:22:38.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.339+0000 7fc3234ad700 1 Processor -- start 2023-09-30T22:22:38.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.339+0000 7fc3234ad700 1 -- start start 2023-09-30T22:22:38.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc3234ad700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc31c133ad0 0x7fc31c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc3234ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1300a0 0x7fc31c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc3234ad700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c06b2d0 con 0x7fc31c1309f0 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc3234ad700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c133610 con 0x7fc31c133ad0 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc3234ad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c09a500 con 0x7fc31c1300a0 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc321249700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc31c133ad0 0x7fc31c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc320a48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1300a0 0x7fc31c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc321249700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc31c133ad0 0x7fc31c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52990/0 (socket says 172.21.15.154:52990) 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc320a48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1300a0 0x7fc31c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41854/0 (socket says 172.21.15.154:41854) 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc321249700 1 -- 172.21.15.154:0/3220185312 learned_addr learned my addr 172.21.15.154:0/3220185312 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc321249700 1 -- 172.21.15.154:0/3220185312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1300a0 msgr2=0x7fc31c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc321249700 1 --2- 172.21.15.154:0/3220185312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1300a0 0x7fc31c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc321249700 1 -- 172.21.15.154:0/3220185312 >> v1:172.21.15.154:6789/0 conn(0x7fc31c1309f0 legacy=0x7fc31c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc321249700 1 -- 172.21.15.154:0/3220185312 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c1338b0 con 0x7fc31c133ad0 2023-09-30T22:22:38.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.340+0000 7fc320a48700 1 --2- 172.21.15.154:0/3220185312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1300a0 0x7fc31c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:38.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc321249700 1 --2- 172.21.15.154:0/3220185312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c133ad0 0x7fc31c133ea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc3180098f0 tx=0x7fc318009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45e8ef7c681a604 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc313fff700 1 -- 172.21.15.154:0/3220185312 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011830 con 0x7fc31c133ad0 2023-09-30T22:22:38.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc313fff700 1 -- 172.21.15.154:0/3220185312 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318011990 con 0x7fc31c133ad0 2023-09-30T22:22:38.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc313fff700 1 -- 172.21.15.154:0/3220185312 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011d20 con 0x7fc31c133ad0 2023-09-30T22:22:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc3234ad700 1 -- 172.21.15.154:0/3220185312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c133ad0 msgr2=0x7fc31c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc3234ad700 1 --2- 172.21.15.154:0/3220185312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c133ad0 0x7fc31c133ea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc3180098f0 tx=0x7fc318009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc3234ad700 1 -- 172.21.15.154:0/3220185312 shutdown_connections 2023-09-30T22:22:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc3234ad700 1 --2- 172.21.15.154:0/3220185312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c133ad0 0x7fc31c133ea0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc3234ad700 1 --2- 172.21.15.154:0/3220185312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1300a0 0x7fc31c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.341+0000 7fc3234ad700 1 -- 172.21.15.154:0/3220185312 >> 172.21.15.154:0/3220185312 conn(0x7fc31c099c40 msgr2=0x7fc31c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.342+0000 7fc3234ad700 1 -- 172.21.15.154:0/3220185312 shutdown_connections 2023-09-30T22:22:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.342+0000 7fc3234ad700 1 -- 172.21.15.154:0/3220185312 wait complete. 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.342+0000 7fc3234ad700 1 Processor -- start 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc3234ad700 1 -- start start 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc3234ad700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c1300a0 0x7fc31c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc3234ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1309f0 0x7fc31c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc3234ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31c133ad0 0x7fc31c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc3234ad700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c120b70 con 0x7fc31c1300a0 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc3234ad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c072290 con 0x7fc31c1309f0 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc3234ad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c11ff90 con 0x7fc31c133ad0 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc321249700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c1300a0 0x7fc31c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc321249700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c1300a0 0x7fc31c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53004/0 (socket says 172.21.15.154:53004) 2023-09-30T22:22:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc321249700 1 -- 172.21.15.154:0/1910863290 learned_addr learned my addr 172.21.15.154:0/1910863290 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc320a48700 1 --2- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1309f0 0x7fc31c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc321249700 1 -- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31c133ad0 msgr2=0x7fc31c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc321249700 1 --2- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31c133ad0 0x7fc31c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc321249700 1 -- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1309f0 msgr2=0x7fc31c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc321249700 1 --2- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1309f0 0x7fc31c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc321249700 1 -- 172.21.15.154:0/1910863290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0094a0 con 0x7fc31c1300a0 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.343+0000 7fc320a48700 1 --2- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1309f0 0x7fc31c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.344+0000 7fc321249700 1 --2- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c1300a0 0x7fc31c11da40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc318000c00 tx=0x7fc318004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.344+0000 7fc311ffb700 1 -- 172.21.15.154:0/1910863290 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318004570 con 0x7fc31c1300a0 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.344+0000 7fc311ffb700 1 -- 172.21.15.154:0/1910863290 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31801f070 con 0x7fc31c1300a0 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.344+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc318009550 con 0x7fc31c1300a0 2023-09-30T22:22:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.344+0000 7fc311ffb700 1 -- 172.21.15.154:0/1910863290 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3180038c0 con 0x7fc31c1300a0 2023-09-30T22:22:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.344+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c120250 con 0x7fc31c1300a0 2023-09-30T22:22:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.345+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c12d630 con 0x7fc31c1300a0 2023-09-30T22:22:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.345+0000 7fc311ffb700 1 -- 172.21.15.154:0/1910863290 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc318021030 con 0x7fc31c1300a0 2023-09-30T22:22:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.345+0000 7fc311ffb700 1 -- 172.21.15.154:0/1910863290 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc318040db0 con 0x7fc31c1300a0 2023-09-30T22:22:38.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.345+0000 7fc320a48700 1 -- 172.21.15.154:0/1910863290 >> v1:172.21.15.154:6816/126757 conn(0x7fc30002f540 legacy=0x7fc3000319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:38.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.354+0000 7fc311ffb700 1 -- 172.21.15.154:0/1910863290 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc318019770 con 0x7fc31c1300a0 2023-09-30T22:22:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.361+0000 7f5e78d89700 1 Processor -- start 2023-09-30T22:22:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.361+0000 7f5e78d89700 1 -- start start 2023-09-30T22:22:38.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e78d89700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 0x7f5e74131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e78d89700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5e7409bc70 0x7f5e7409c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e78d89700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e740a2590 con 0x7f5e7409c5e0 2023-09-30T22:22:38.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e78d89700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7406eaa0 con 0x7f5e7409bc70 2023-09-30T22:22:38.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e78d89700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741315c0 con 0x7f5e741319f0 2023-09-30T22:22:38.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e71d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5e7409bc70 0x7f5e7409c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e71d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5e7409bc70 0x7f5e7409c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53006/0 (socket says 172.21.15.154:53006) 2023-09-30T22:22:38.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e71d9b700 1 -- 172.21.15.154:0/981376166 learned_addr learned my addr 172.21.15.154:0/981376166 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:38.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e7259c700 1 --2- 172.21.15.154:0/981376166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 0x7f5e74131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e71d9b700 1 -- 172.21.15.154:0/981376166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 msgr2=0x7f5e74131dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e71d9b700 1 --2- 172.21.15.154:0/981376166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 0x7f5e74131dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e71d9b700 1 -- 172.21.15.154:0/981376166 >> v1:172.21.15.154:6789/0 conn(0x7f5e7409c5e0 legacy=0x7f5e74138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e71d9b700 1 -- 172.21.15.154:0/981376166 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e740a1640 con 0x7f5e7409bc70 2023-09-30T22:22:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.362+0000 7f5e71d9b700 1 --2- 172.21.15.154:0/981376166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409bc70 0x7f5e7409c0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e680098f0 tx=0x7f5e68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cbbb639bc86824 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e7159a700 1 -- 172.21.15.154:0/981376166 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68011830 con 0x7f5e7409bc70 2023-09-30T22:22:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e7159a700 1 -- 172.21.15.154:0/981376166 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68011990 con 0x7f5e7409bc70 2023-09-30T22:22:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e7159a700 1 -- 172.21.15.154:0/981376166 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68011d20 con 0x7f5e7409bc70 2023-09-30T22:22:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e78d89700 1 -- 172.21.15.154:0/981376166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409bc70 msgr2=0x7f5e7409c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e78d89700 1 --2- 172.21.15.154:0/981376166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409bc70 0x7f5e7409c0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e680098f0 tx=0x7f5e68009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e78d89700 1 -- 172.21.15.154:0/981376166 shutdown_connections 2023-09-30T22:22:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e78d89700 1 --2- 172.21.15.154:0/981376166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 0x7f5e74131dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e78d89700 1 --2- 172.21.15.154:0/981376166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409bc70 0x7f5e7409c0a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e78d89700 1 -- 172.21.15.154:0/981376166 >> 172.21.15.154:0/981376166 conn(0x7f5e740a2980 msgr2=0x7f5e740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e78d89700 1 -- 172.21.15.154:0/981376166 shutdown_connections 2023-09-30T22:22:38.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.363+0000 7f5e78d89700 1 -- 172.21.15.154:0/981376166 wait complete. 2023-09-30T22:22:38.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e78d89700 1 Processor -- start 2023-09-30T22:22:38.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e78d89700 1 -- start start 2023-09-30T22:22:38.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e78d89700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e7409bc70 0x7f5e7411ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e78d89700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409c5e0 0x7f5e7411cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e78d89700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 0x7f5e7411d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e78d89700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74120250 con 0x7f5e7409c5e0 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e78d89700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74120530 con 0x7f5e7409bc70 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e78d89700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74130d80 con 0x7f5e741319f0 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e71d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409c5e0 0x7f5e7411cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e71d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409c5e0 0x7f5e7411cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53020/0 (socket says 172.21.15.154:53020) 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e71d9b700 1 -- 172.21.15.154:0/2753261351 learned_addr learned my addr 172.21.15.154:0/2753261351 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e72d9d700 1 --2- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 0x7f5e7411d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.365+0000 7f5e7259c700 1 --2- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e7409bc70 0x7f5e7411ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e72d9d700 1 -- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e7409bc70 msgr2=0x7f5e7411ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e72d9d700 1 --2- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e7409bc70 0x7f5e7411ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e72d9d700 1 -- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409c5e0 msgr2=0x7f5e7411cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e72d9d700 1 --2- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409c5e0 0x7f5e7411cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e72d9d700 1 -- 172.21.15.154:0/2753261351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e68009550 con 0x7f5e741319f0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e72d9d700 1 --2- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 0x7f5e7411d490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00ef30 tx=0x7f5e6c010330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e62ffd700 1 -- 172.21.15.154:0/2753261351 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c013070 con 0x7f5e741319f0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e62ffd700 1 -- 172.21.15.154:0/2753261351 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c00e2e0 con 0x7f5e741319f0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e62ffd700 1 -- 172.21.15.154:0/2753261351 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c003c20 con 0x7f5e741319f0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e740a1cb0 con 0x7f5e741319f0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.366+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7411fcc0 con 0x7f5e741319f0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.367+0000 7f5e62ffd700 1 -- 172.21.15.154:0/2753261351 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5e6c010970 con 0x7f5e741319f0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.367+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7404f2a0 con 0x7f5e741319f0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.367+0000 7f5e62ffd700 1 -- 172.21.15.154:0/2753261351 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5e6c043940 con 0x7f5e741319f0 2023-09-30T22:22:38.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.367+0000 7f5e7259c700 1 -- 172.21.15.154:0/2753261351 >> v1:172.21.15.154:6816/126757 conn(0x7f5e5402f510 legacy=0x7f5e540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:38.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.367+0000 7f1028964700 1 -- 172.21.15.154:0/1672871068 >> v1:172.21.15.154:6816/126757 conn(0x7f100802f510 legacy=0x7f10080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:38.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.372+0000 7f5e62ffd700 1 -- 172.21.15.154:0/2753261351 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e6c010e60 con 0x7f5e741319f0 2023-09-30T22:22:38.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.377+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f102409f0f0 con 0x7f1024136960 2023-09-30T22:22:38.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.377+0000 7f10217fa700 1 -- 172.21.15.154:0/1672871068 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1010017020 con 0x7f1024136960 2023-09-30T22:22:38.378 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:38.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.380+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 >> v1:172.21.15.154:6816/126757 conn(0x7f100802f510 legacy=0x7f10080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:38.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.380+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024136960 msgr2=0x7f1024071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.380+0000 7f102abc8700 1 --2- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024136960 0x7f1024071b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f101000e9b0 tx=0x7f101000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.381+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 shutdown_connections 2023-09-30T22:22:38.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.381+0000 7f102abc8700 1 --2- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1024139280 0x7f10241c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.381+0000 7f102abc8700 1 --2- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1024133ad0 0x7f10240715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.381+0000 7f102abc8700 1 --2- 172.21.15.154:0/1672871068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1024136960 0x7f1024071b00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.381+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 >> 172.21.15.154:0/1672871068 conn(0x7f1024099c40 msgr2=0x7f10240a3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.381+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 shutdown_connections 2023-09-30T22:22:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.381+0000 7f102abc8700 1 -- 172.21.15.154:0/1672871068 wait complete. 2023-09-30T22:22:38.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:38.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.491+0000 7f16acf6a700 1 -- 172.21.15.154:0/2076327102 >> v1:172.21.15.154:6816/126757 conn(0x7f168c02f510 legacy=0x7f168c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.511+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f16a8120000 con 0x7f16a81309f0 2023-09-30T22:22:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.511+0000 7f16a57fa700 1 -- 172.21.15.154:0/2076327102 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1694028020 con 0x7f16a81309f0 2023-09-30T22:22:38.512 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.513+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 >> v1:172.21.15.154:6816/126757 conn(0x7f168c02f510 legacy=0x7f168c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.513+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a81309f0 msgr2=0x7f16a811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.513+0000 7f16af1ce700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a81309f0 0x7f16a811df80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f169400b410 tx=0x7f169400b720 comp rx=0 tx=0).stop 2023-09-30T22:22:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.513+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 shutdown_connections 2023-09-30T22:22:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.513+0000 7f16af1ce700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16a8133ad0 0x7f16a811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.513+0000 7f16af1ce700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16a81300a0 0x7f16a811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.513+0000 7f16af1ce700 1 --2- 172.21.15.154:0/2076327102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16a81309f0 0x7f16a811df80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.513+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 >> 172.21.15.154:0/2076327102 conn(0x7f16a8099c40 msgr2=0x7f16a80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.513+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 shutdown_connections 2023-09-30T22:22:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.514+0000 7f16af1ce700 1 -- 172.21.15.154:0/2076327102 wait complete. 2023-09-30T22:22:38.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:38.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.546+0000 7fc320a48700 1 -- 172.21.15.154:0/1910863290 >> v1:172.21.15.154:6816/126757 conn(0x7fc30002f540 legacy=0x7fc3000319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:38.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.551+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc31c120250 con 0x7fc31c1300a0 2023-09-30T22:22:38.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.552+0000 7fc311ffb700 1 -- 172.21.15.154:0/1910863290 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc31c120250 con 0x7fc31c1300a0 2023-09-30T22:22:38.552 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 >> v1:172.21.15.154:6816/126757 conn(0x7fc30002f540 legacy=0x7fc3000319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c1300a0 msgr2=0x7fc31c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 --2- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c1300a0 0x7fc31c11da40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc318000c00 tx=0x7fc318004750 comp rx=0 tx=0).stop 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 shutdown_connections 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 --2- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31c133ad0 0x7fc31c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 --2- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc31c1300a0 0x7fc31c11da40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 --2- 172.21.15.154:0/1910863290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc31c1309f0 0x7fc31c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 >> 172.21.15.154:0/1910863290 conn(0x7fc31c099c40 msgr2=0x7fc31c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 shutdown_connections 2023-09-30T22:22:38.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.554+0000 7fc3234ad700 1 -- 172.21.15.154:0/1910863290 wait complete. 2023-09-30T22:22:38.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:38.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.568+0000 7f5e7259c700 1 -- 172.21.15.154:0/2753261351 >> v1:172.21.15.154:6816/126757 conn(0x7f5e5402f510 legacy=0x7f5e540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:38.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.576+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e7406bce0 con 0x7f5e741319f0 2023-09-30T22:22:38.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.576+0000 7f5e62ffd700 1 -- 172.21.15.154:0/2753261351 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e6c00ce40 con 0x7f5e741319f0 2023-09-30T22:22:38.577 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:38.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 >> v1:172.21.15.154:6816/126757 conn(0x7f5e5402f510 legacy=0x7f5e540319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:38.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 msgr2=0x7f5e7411d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:38.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 --2- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 0x7f5e7411d490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00ef30 tx=0x7f5e6c010330 comp rx=0 tx=0).stop 2023-09-30T22:22:38.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 shutdown_connections 2023-09-30T22:22:38.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 --2- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5e741319f0 0x7f5e7411d490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 --2- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e7409bc70 0x7f5e7411ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 --2- 172.21.15.154:0/2753261351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e7409c5e0 0x7f5e7411cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:38.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 >> 172.21.15.154:0/2753261351 conn(0x7f5e740a2980 msgr2=0x7f5e7409f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:38.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 shutdown_connections 2023-09-30T22:22:38.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:38.578+0000 7f5e78d89700 1 -- 172.21.15.154:0/2753261351 wait complete. 2023-09-30T22:22:38.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:39.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:39.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa864a700 1 Processor -- start 2023-09-30T22:22:39.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa864a700 1 -- start start 2023-09-30T22:22:39.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:39.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa864a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 0x7f9fa0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa864a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fa0130bc0 0x7f9fa013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa864a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa006b2d0 con 0x7f9fa01300a0 2023-09-30T22:22:39.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa864a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa0133610 con 0x7f9fa0130bc0 2023-09-30T22:22:39.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa864a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa009a500 con 0x7f9fa0133ad0 2023-09-30T22:22:39.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa5be5700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9fa01300a0 0x7f9fa01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35524/0 (socket says 172.21.15.154:35524) 2023-09-30T22:22:39.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa6be7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fa0130bc0 0x7f9fa013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa5be5700 1 -- 172.21.15.154:0/2588846975 learned_addr learned my addr 172.21.15.154:0/2588846975 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.526+0000 7f9fa63e6700 1 --2- 172.21.15.154:0/2588846975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 0x7f9fa0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.527+0000 7f9fa6be7700 1 -- 172.21.15.154:0/2588846975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 msgr2=0x7f9fa0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.527+0000 7f9fa6be7700 1 --2- 172.21.15.154:0/2588846975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 0x7f9fa0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.527+0000 7f9fa6be7700 1 -- 172.21.15.154:0/2588846975 >> v1:172.21.15.154:6789/0 conn(0x7f9fa01300a0 legacy=0x7f9fa01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.527+0000 7f9fa6be7700 1 -- 172.21.15.154:0/2588846975 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa01338b0 con 0x7f9fa0130bc0 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.527+0000 7f9fa63e6700 1 --2- 172.21.15.154:0/2588846975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 0x7f9fa0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.527+0000 7f9fa6be7700 1 --2- 172.21.15.154:0/2588846975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0130bc0 0x7f9fa013b990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009d90 tx=0x7f9f9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a968b3cb8c5da27 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.527+0000 7f9fa53e4700 1 -- 172.21.15.154:0/2588846975 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800e070 con 0x7f9fa0130bc0 2023-09-30T22:22:39.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.527+0000 7f9fa53e4700 1 -- 172.21.15.154:0/2588846975 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9800bb20 con 0x7f9fa0130bc0 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.527+0000 7f9fa53e4700 1 -- 172.21.15.154:0/2588846975 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98012430 con 0x7f9fa0130bc0 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.528+0000 7f9fa864a700 1 -- 172.21.15.154:0/2588846975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0130bc0 msgr2=0x7f9fa013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.528+0000 7f9fa864a700 1 --2- 172.21.15.154:0/2588846975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0130bc0 0x7f9fa013b990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009d90 tx=0x7f9f9800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.528+0000 7f9fa864a700 1 -- 172.21.15.154:0/2588846975 shutdown_connections 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.528+0000 7f9fa864a700 1 --2- 172.21.15.154:0/2588846975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0130bc0 0x7f9fa013b990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.528+0000 7f9fa864a700 1 --2- 172.21.15.154:0/2588846975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 0x7f9fa0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.528+0000 7f9fa864a700 1 -- 172.21.15.154:0/2588846975 >> 172.21.15.154:0/2588846975 conn(0x7f9fa0099c40 msgr2=0x7f9fa00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.528+0000 7f9fa864a700 1 -- 172.21.15.154:0/2588846975 shutdown_connections 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.528+0000 7f9fa864a700 1 -- 172.21.15.154:0/2588846975 wait complete. 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa864a700 1 Processor -- start 2023-09-30T22:22:39.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa864a700 1 -- start start 2023-09-30T22:22:39.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa864a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa01300a0 0x7f9fa011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa864a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0130bc0 0x7f9fa011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa864a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0133ad0 0x7f9fa011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa864a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa012da10 con 0x7f9fa0133ad0 2023-09-30T22:22:39.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa864a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa011fe50 con 0x7f9fa0130bc0 2023-09-30T22:22:39.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa864a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0120a30 con 0x7f9fa01300a0 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa5be5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0130bc0 0x7f9fa011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa6be7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0133ad0 0x7f9fa011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa5be5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0130bc0 0x7f9fa011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41882/0 (socket says 172.21.15.154:41882) 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa5be5700 1 -- 172.21.15.154:0/3773123823 learned_addr learned my addr 172.21.15.154:0/3773123823 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa5be5700 1 -- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa01300a0 msgr2=0x7f9fa011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa5be5700 1 --2- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa01300a0 0x7f9fa011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa5be5700 1 -- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0133ad0 msgr2=0x7f9fa011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa5be5700 1 --2- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0133ad0 0x7f9fa011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.529+0000 7f9fa5be5700 1 -- 172.21.15.154:0/3773123823 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0094a0 con 0x7f9fa0130bc0 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.530+0000 7f9fa5be5700 1 --2- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0130bc0 0x7f9fa011df80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c450 tx=0x7f9f9000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.530+0000 7f9f96ffd700 1 -- 172.21.15.154:0/3773123823 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90005d70 con 0x7f9fa0130bc0 2023-09-30T22:22:39.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.530+0000 7f9f96ffd700 1 -- 172.21.15.154:0/3773123823 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f900070d0 con 0x7f9fa0130bc0 2023-09-30T22:22:39.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.530+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f98009a70 con 0x7f9fa0130bc0 2023-09-30T22:22:39.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.530+0000 7f9f96ffd700 1 -- 172.21.15.154:0/3773123823 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90007440 con 0x7f9fa0130bc0 2023-09-30T22:22:39.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.530+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa012dd00 con 0x7f9fa0130bc0 2023-09-30T22:22:39.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.531+0000 7f9f96ffd700 1 -- 172.21.15.154:0/3773123823 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9f900075a0 con 0x7f9fa0130bc0 2023-09-30T22:22:39.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.531+0000 7f9f96ffd700 1 -- 172.21.15.154:0/3773123823 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9f9003ef20 con 0x7f9fa0130bc0 2023-09-30T22:22:39.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.531+0000 7f9fa63e6700 1 -- 172.21.15.154:0/3773123823 >> v1:172.21.15.154:6816/126757 conn(0x7f9f8402f510 legacy=0x7f9f840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:39.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.531+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa011eff0 con 0x7f9fa0130bc0 2023-09-30T22:22:39.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.536+0000 7f9f96ffd700 1 -- 172.21.15.154:0/3773123823 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f90017070 con 0x7f9fa0130bc0 2023-09-30T22:22:39.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:39.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:39.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8eba3700 1 Processor -- start 2023-09-30T22:22:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8eba3700 1 -- start start 2023-09-30T22:22:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8eba3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8806a770 0x7f2e881349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8eba3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e88134f00 0x7f2e8809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8eba3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8809dea0 0x7f2e8809e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8eba3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8806b2e0 con 0x7f2e88134f00 2023-09-30T22:22:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8eba3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8809eca0 con 0x7f2e8806a770 2023-09-30T22:22:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8eba3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8809f720 con 0x7f2e8809dea0 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8c93f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8806a770 0x7f2e881349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8d140700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8809dea0 0x7f2e8809e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8c93f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8806a770 0x7f2e881349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41884/0 (socket says 172.21.15.154:41884) 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.655+0000 7f2e8c93f700 1 -- 172.21.15.154:0/4043026284 learned_addr learned my addr 172.21.15.154:0/4043026284 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e87fff700 1 --2- 172.21.15.154:0/4043026284 >> v2:172.21.15.154:3300/0 conn(0x7f2e88134f00 0x7f2e8809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e8d140700 1 -- 172.21.15.154:0/4043026284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8806a770 msgr2=0x7f2e881349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e8d140700 1 --2- 172.21.15.154:0/4043026284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8806a770 0x7f2e881349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e8d140700 1 -- 172.21.15.154:0/4043026284 >> v2:172.21.15.154:3300/0 conn(0x7f2e88134f00 msgr2=0x7f2e8809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e8d140700 1 --2- 172.21.15.154:0/4043026284 >> v2:172.21.15.154:3300/0 conn(0x7f2e88134f00 0x7f2e8809d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e8d140700 1 -- 172.21.15.154:0/4043026284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8806b480 con 0x7f2e8809dea0 2023-09-30T22:22:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e8d140700 1 --2- 172.21.15.154:0/4043026284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8809dea0 0x7f2e8809e340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009d90 tx=0x7f2e8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3017952af826d40f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e877fe700 1 -- 172.21.15.154:0/4043026284 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000e070 con 0x7f2e8809dea0 2023-09-30T22:22:39.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e877fe700 1 -- 172.21.15.154:0/4043026284 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8000bb20 con 0x7f2e8809dea0 2023-09-30T22:22:39.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.656+0000 7f2e877fe700 1 -- 172.21.15.154:0/4043026284 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80012430 con 0x7f2e8809dea0 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.657+0000 7f2e8eba3700 1 -- 172.21.15.154:0/4043026284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8809dea0 msgr2=0x7f2e8809e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.657+0000 7f2e8eba3700 1 --2- 172.21.15.154:0/4043026284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8809dea0 0x7f2e8809e340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009d90 tx=0x7f2e8000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.657+0000 7f2e8eba3700 1 -- 172.21.15.154:0/4043026284 shutdown_connections 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.657+0000 7f2e8eba3700 1 --2- 172.21.15.154:0/4043026284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8806a770 0x7f2e881349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.657+0000 7f2e8eba3700 1 --2- 172.21.15.154:0/4043026284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8809dea0 0x7f2e8809e340 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.657+0000 7f2e8eba3700 1 --2- 172.21.15.154:0/4043026284 >> v2:172.21.15.154:3300/0 conn(0x7f2e88134f00 0x7f2e8809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.657+0000 7f2e8eba3700 1 -- 172.21.15.154:0/4043026284 >> 172.21.15.154:0/4043026284 conn(0x7f2e88099c40 msgr2=0x7f2e880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.657+0000 7f2e8eba3700 1 -- 172.21.15.154:0/4043026284 shutdown_connections 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.657+0000 7f2e8eba3700 1 -- 172.21.15.154:0/4043026284 wait complete. 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.658+0000 7f2e8eba3700 1 Processor -- start 2023-09-30T22:22:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.658+0000 7f2e8eba3700 1 -- start start 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e8eba3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8806a770 0x7f2e8806f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e8eba3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8809dea0 0x7f2e8806fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e8eba3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e88134f00 0x7f2e88070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e8eba3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88070d60 con 0x7f2e88134f00 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e8eba3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88071c40 con 0x7f2e8809dea0 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e8eba3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88139030 con 0x7f2e8806a770 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e87fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8809dea0 0x7f2e8806fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e87fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8809dea0 0x7f2e8806fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41894/0 (socket says 172.21.15.154:41894) 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e87fff700 1 -- 172.21.15.154:0/1927461167 learned_addr learned my addr 172.21.15.154:0/1927461167 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e8d140700 1 --2- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e88134f00 0x7f2e88070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e8c93f700 1 --2- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8806a770 0x7f2e8806f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e87fff700 1 -- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8806a770 msgr2=0x7f2e8806f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e87fff700 1 --2- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8806a770 0x7f2e8806f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e87fff700 1 -- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e88134f00 msgr2=0x7f2e88070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e87fff700 1 --2- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e88134f00 0x7f2e88070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.659+0000 7f2e87fff700 1 -- 172.21.15.154:0/1927461167 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e80009a70 con 0x7f2e8809dea0 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.660+0000 7f2e87fff700 1 --2- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8809dea0 0x7f2e8806fdd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400e840 tx=0x7f2e7400eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.660+0000 7f2e857fa700 1 -- 172.21.15.154:0/1927461167 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74013610 con 0x7f2e8809dea0 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.660+0000 7f2e857fa700 1 -- 172.21.15.154:0/1927461167 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e74013770 con 0x7f2e8809dea0 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.660+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e880717e0 con 0x7f2e8809dea0 2023-09-30T22:22:39.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.660+0000 7f2e857fa700 1 -- 172.21.15.154:0/1927461167 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74013ae0 con 0x7f2e8809dea0 2023-09-30T22:22:39.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.660+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e88134200 con 0x7f2e8809dea0 2023-09-30T22:22:39.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.661+0000 7f2e857fa700 1 -- 172.21.15.154:0/1927461167 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2e74013c40 con 0x7f2e8809dea0 2023-09-30T22:22:39.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.661+0000 7f2e857fa700 1 -- 172.21.15.154:0/1927461167 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2e7403f730 con 0x7f2e8809dea0 2023-09-30T22:22:39.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.661+0000 7f2e8c93f700 1 -- 172.21.15.154:0/1927461167 >> v1:172.21.15.154:6816/126757 conn(0x7f2e6c02f510 legacy=0x7f2e6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:39.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.661+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e88134200 con 0x7f2e8809dea0 2023-09-30T22:22:39.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.666+0000 7f2e857fa700 1 -- 172.21.15.154:0/1927461167 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e88134200 con 0x7f2e8809dea0 2023-09-30T22:22:39.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.697+0000 7fae741b9700 1 Processor -- start 2023-09-30T22:22:39.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.697+0000 7fae741b9700 1 -- start start 2023-09-30T22:22:39.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae741b9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae6c0a0a70 0x7fae6c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae741b9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c134120 0x7fae6c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae741b9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c09dc00 con 0x7fae6c0a1380 2023-09-30T22:22:39.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae741b9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c09ea90 con 0x7fae6c0a0a70 2023-09-30T22:22:39.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae741b9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c09dec0 con 0x7fae6c134120 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae71f55700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae6c0a0a70 0x7fae6c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae71f55700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae6c0a0a70 0x7fae6c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53052/0 (socket says 172.21.15.154:53052) 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae71f55700 1 -- 172.21.15.154:0/813704642 learned_addr learned my addr 172.21.15.154:0/813704642 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae72756700 1 --2- 172.21.15.154:0/813704642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c134120 0x7fae6c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae71f55700 1 -- 172.21.15.154:0/813704642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c134120 msgr2=0x7fae6c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae71f55700 1 --2- 172.21.15.154:0/813704642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c134120 0x7fae6c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae71f55700 1 -- 172.21.15.154:0/813704642 >> v1:172.21.15.154:6789/0 conn(0x7fae6c0a1380 legacy=0x7fae6c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae71f55700 1 -- 172.21.15.154:0/813704642 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c09e6a0 con 0x7fae6c0a0a70 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae70f53700 1 -- 172.21.15.154:0/813704642 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163282842 0 0) 0x7fae6c09dc00 con 0x7fae6c0a1380 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae72756700 1 --2- 172.21.15.154:0/813704642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c134120 0x7fae6c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.698+0000 7fae71f55700 1 --2- 172.21.15.154:0/813704642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0a0a70 0x7fae6c0a0e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae680098f0 tx=0x7fae68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8830c752d41b2c96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae70f53700 1 -- 172.21.15.154:0/813704642 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68011830 con 0x7fae6c0a0a70 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae70f53700 1 -- 172.21.15.154:0/813704642 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae68011990 con 0x7fae6c0a0a70 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae70f53700 1 -- 172.21.15.154:0/813704642 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68011d20 con 0x7fae6c0a0a70 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae741b9700 1 -- 172.21.15.154:0/813704642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0a0a70 msgr2=0x7fae6c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae741b9700 1 --2- 172.21.15.154:0/813704642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0a0a70 0x7fae6c0a0e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae680098f0 tx=0x7fae68009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae741b9700 1 -- 172.21.15.154:0/813704642 shutdown_connections 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae741b9700 1 --2- 172.21.15.154:0/813704642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c134120 0x7fae6c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae741b9700 1 --2- 172.21.15.154:0/813704642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0a0a70 0x7fae6c0a0e40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae741b9700 1 -- 172.21.15.154:0/813704642 >> 172.21.15.154:0/813704642 conn(0x7fae6c0a6610 msgr2=0x7fae6c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.699+0000 7fae741b9700 1 -- 172.21.15.154:0/813704642 shutdown_connections 2023-09-30T22:22:39.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.700+0000 7fae741b9700 1 -- 172.21.15.154:0/813704642 wait complete. 2023-09-30T22:22:39.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.700+0000 7fae741b9700 1 Processor -- start 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.700+0000 7fae741b9700 1 -- start start 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae741b9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c0a0a70 0x7fae6c1c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae741b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0a1380 0x7fae6c1c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae741b9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c134120 0x7fae6c122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae741b9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c125f80 con 0x7fae6c134120 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae741b9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c127070 con 0x7fae6c0a1380 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae741b9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c133aa0 con 0x7fae6c0a0a70 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae71f55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c0a0a70 0x7fae6c1c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae72756700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c134120 0x7fae6c122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae71f55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c0a0a70 0x7fae6c1c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36964/0 (socket says 172.21.15.154:36964) 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae72756700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c134120 0x7fae6c122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53062/0 (socket says 172.21.15.154:53062) 2023-09-30T22:22:39.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae71f55700 1 -- 172.21.15.154:0/3080348063 learned_addr learned my addr 172.21.15.154:0/3080348063 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.701+0000 7fae71754700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0a1380 0x7fae6c1c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae72756700 1 -- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c0a0a70 msgr2=0x7fae6c1c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae72756700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c0a0a70 0x7fae6c1c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae72756700 1 -- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0a1380 msgr2=0x7fae6c1c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae72756700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0a1380 0x7fae6c1c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae72756700 1 -- 172.21.15.154:0/3080348063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64009a70 con 0x7fae6c134120 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae71754700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0a1380 0x7fae6c1c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae71f55700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c0a0a70 0x7fae6c1c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae72756700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c134120 0x7fae6c122970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fae64009e50 tx=0x7fae6400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae627fc700 1 -- 172.21.15.154:0/3080348063 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6400ca90 con 0x7fae6c134120 2023-09-30T22:22:39.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae627fc700 1 -- 172.21.15.154:0/3080348063 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6400f040 con 0x7fae6c134120 2023-09-30T22:22:39.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae68009550 con 0x7fae6c134120 2023-09-30T22:22:39.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae627fc700 1 -- 172.21.15.154:0/3080348063 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6400ce50 con 0x7fae6c134120 2023-09-30T22:22:39.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.702+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c126200 con 0x7fae6c134120 2023-09-30T22:22:39.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.703+0000 7fae627fc700 1 -- 172.21.15.154:0/3080348063 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fae64014480 con 0x7fae6c134120 2023-09-30T22:22:39.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.703+0000 7fae627fc700 1 -- 172.21.15.154:0/3080348063 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fae640400e0 con 0x7fae6c134120 2023-09-30T22:22:39.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.703+0000 7fae71f55700 1 -- 172.21.15.154:0/3080348063 >> v1:172.21.15.154:6816/126757 conn(0x7fae5002f510 legacy=0x7fae500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:39.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.704+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c126200 con 0x7fae6c134120 2023-09-30T22:22:39.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.708+0000 7fae627fc700 1 -- 172.21.15.154:0/3080348063 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae6c126200 con 0x7fae6c134120 2023-09-30T22:22:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.732+0000 7f9fa63e6700 1 -- 172.21.15.154:0/3773123823 >> v1:172.21.15.154:6816/126757 conn(0x7f9f8402f510 legacy=0x7f9f840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:39.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.739+0000 7f5756fdb700 1 Processor -- start 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.739+0000 7f5756fdb700 1 -- start start 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f5756fdb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 0x7f575009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f5756fdb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f57501307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f5756fdb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5750130ce0 0x7f5750131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f5756fdb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575009aaa0 con 0x7f5750130ce0 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f5756fdb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575009f870 con 0x7f575009d860 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f5756fdb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f575009b360 con 0x7f575009e170 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f574ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f57501307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f5755578700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5750130ce0 0x7f5750131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f574ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f57501307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36970/0 (socket says 172.21.15.154:36970) 2023-09-30T22:22:39.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f574ffff700 1 -- 172.21.15.154:0/841735307 learned_addr learned my addr 172.21.15.154:0/841735307 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f574ffff700 1 -- 172.21.15.154:0/841735307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 msgr2=0x7f575009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f574ffff700 1 --2- 172.21.15.154:0/841735307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 0x7f575009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f574ffff700 1 -- 172.21.15.154:0/841735307 >> v2:172.21.15.154:3300/0 conn(0x7f5750130ce0 msgr2=0x7f5750131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f574ffff700 1 --2- 172.21.15.154:0/841735307 >> v2:172.21.15.154:3300/0 conn(0x7f5750130ce0 0x7f5750131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f574ffff700 1 -- 172.21.15.154:0/841735307 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575009b620 con 0x7f575009e170 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.740+0000 7f5755578700 1 --2- 172.21.15.154:0/841735307 >> v2:172.21.15.154:3300/0 conn(0x7f5750130ce0 0x7f5750131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.741+0000 7f574ffff700 1 --2- 172.21.15.154:0/841735307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f57501307a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f573c0098f0 tx=0x7f573c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b62df48cad6f9fd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.741+0000 7f574f7fe700 1 -- 172.21.15.154:0/841735307 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c011830 con 0x7f575009e170 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.741+0000 7f574f7fe700 1 -- 172.21.15.154:0/841735307 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c011990 con 0x7f575009e170 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.741+0000 7f574f7fe700 1 -- 172.21.15.154:0/841735307 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c011d20 con 0x7f575009e170 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.741+0000 7f5756fdb700 1 -- 172.21.15.154:0/841735307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 msgr2=0x7f57501307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.741+0000 7f5756fdb700 1 --2- 172.21.15.154:0/841735307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f57501307a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f573c0098f0 tx=0x7f573c009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.742+0000 7f5756fdb700 1 -- 172.21.15.154:0/841735307 shutdown_connections 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.742+0000 7f5756fdb700 1 --2- 172.21.15.154:0/841735307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 0x7f575009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.742+0000 7f5756fdb700 1 --2- 172.21.15.154:0/841735307 >> v2:172.21.15.154:3300/0 conn(0x7f5750130ce0 0x7f5750131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.742+0000 7f5756fdb700 1 --2- 172.21.15.154:0/841735307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f57501307a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.742+0000 7f5756fdb700 1 -- 172.21.15.154:0/841735307 >> 172.21.15.154:0/841735307 conn(0x7f5750099c40 msgr2=0x7f57500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.742+0000 7f5756fdb700 1 -- 172.21.15.154:0/841735307 shutdown_connections 2023-09-30T22:22:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.742+0000 7f5756fdb700 1 -- 172.21.15.154:0/841735307 wait complete. 2023-09-30T22:22:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f5756fdb700 1 Processor -- start 2023-09-30T22:22:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f5756fdb700 1 -- start start 2023-09-30T22:22:39.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f5756fdb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 0x7f5750119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f5756fdb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f5750119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f5756fdb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5750130ce0 0x7f575011a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f5756fdb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575011bb80 con 0x7f5750130ce0 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f5756fdb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5750137230 con 0x7f575009d860 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f5756fdb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f575009c8b0 con 0x7f575009e170 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f574ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f5750119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f574ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f5750119b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36978/0 (socket says 172.21.15.154:36978) 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f574ffff700 1 -- 172.21.15.154:0/199855325 learned_addr learned my addr 172.21.15.154:0/199855325 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.743+0000 7f5755578700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5750130ce0 0x7f575011a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f5754d77700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 0x7f5750119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f574ffff700 1 -- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 msgr2=0x7f5750119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f574ffff700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 0x7f5750119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f574ffff700 1 -- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5750130ce0 msgr2=0x7f575011a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f574ffff700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5750130ce0 0x7f575011a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f574ffff700 1 -- 172.21.15.154:0/199855325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748009a70 con 0x7f575009e170 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f5754d77700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 0x7f5750119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f574ffff700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f5750119b70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f573c009c40 tx=0x7f573c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f574d7fa700 1 -- 172.21.15.154:0/199855325 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0042c0 con 0x7f575009e170 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f574d7fa700 1 -- 172.21.15.154:0/199855325 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c01f070 con 0x7f575009e170 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c009550 con 0x7f575009e170 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f574d7fa700 1 -- 172.21.15.154:0/199855325 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0036a0 con 0x7f575009e170 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.744+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575011b830 con 0x7f575009e170 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.745+0000 7f574d7fa700 1 -- 172.21.15.154:0/199855325 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f573c021030 con 0x7f575009e170 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.745+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575004f2a0 con 0x7f575009e170 2023-09-30T22:22:39.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.745+0000 7f5754d77700 1 -- 172.21.15.154:0/199855325 >> v1:172.21.15.154:6816/126757 conn(0x7f573402f510 legacy=0x7f57340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:39.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.745+0000 7f574d7fa700 1 -- 172.21.15.154:0/199855325 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f573c040c20 con 0x7f575009e170 2023-09-30T22:22:39.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.746+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9fa004f2a0 con 0x7f9fa0130bc0 2023-09-30T22:22:39.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.746+0000 7f9f96ffd700 1 -- 172.21.15.154:0/3773123823 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f90019d20 con 0x7f9fa0130bc0 2023-09-30T22:22:39.749 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:39.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.748+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 >> v1:172.21.15.154:6816/126757 conn(0x7f9f8402f510 legacy=0x7f9f840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:39.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.748+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0130bc0 msgr2=0x7f9fa011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.748+0000 7f9fa864a700 1 --2- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0130bc0 0x7f9fa011df80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c450 tx=0x7f9f9000c760 comp rx=0 tx=0).stop 2023-09-30T22:22:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.749+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 shutdown_connections 2023-09-30T22:22:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.749+0000 7f9fa864a700 1 --2- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0133ad0 0x7f9fa011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.749+0000 7f9fa864a700 1 --2- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa01300a0 0x7f9fa011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.749+0000 7f9fa864a700 1 --2- 172.21.15.154:0/3773123823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0130bc0 0x7f9fa011df80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.749+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 >> 172.21.15.154:0/3773123823 conn(0x7f9fa0099c40 msgr2=0x7f9fa0132d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.749+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 shutdown_connections 2023-09-30T22:22:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.749+0000 7f9fa864a700 1 -- 172.21.15.154:0/3773123823 wait complete. 2023-09-30T22:22:39.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.754+0000 7f574d7fa700 1 -- 172.21.15.154:0/199855325 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f573c0199a0 con 0x7f575009e170 2023-09-30T22:22:39.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:39.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.862+0000 7f2e8c93f700 1 -- 172.21.15.154:0/1927461167 >> v1:172.21.15.154:6816/126757 conn(0x7f2e6c02f510 legacy=0x7f2e6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.868+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e88134200 con 0x7f2e8809dea0 2023-09-30T22:22:39.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.868+0000 7f2e857fa700 1 -- 172.21.15.154:0/1927461167 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e88134200 con 0x7f2e8809dea0 2023-09-30T22:22:39.869 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.870+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 >> v1:172.21.15.154:6816/126757 conn(0x7f2e6c02f510 legacy=0x7f2e6c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.870+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8809dea0 msgr2=0x7f2e8806fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.870+0000 7f2e8eba3700 1 --2- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8809dea0 0x7f2e8806fdd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400e840 tx=0x7f2e7400eb50 comp rx=0 tx=0).stop 2023-09-30T22:22:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.870+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 shutdown_connections 2023-09-30T22:22:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.870+0000 7f2e8eba3700 1 --2- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e88134f00 0x7f2e88070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.870+0000 7f2e8eba3700 1 --2- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e8806a770 0x7f2e8806f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.870+0000 7f2e8eba3700 1 --2- 172.21.15.154:0/1927461167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e8809dea0 0x7f2e8806fdd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.870+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 >> 172.21.15.154:0/1927461167 conn(0x7f2e88099c40 msgr2=0x7f2e8809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.870+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 shutdown_connections 2023-09-30T22:22:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.871+0000 7f2e8eba3700 1 -- 172.21.15.154:0/1927461167 wait complete. 2023-09-30T22:22:39.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:39.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.904+0000 7fae71f55700 1 -- 172.21.15.154:0/3080348063 >> v1:172.21.15.154:6816/126757 conn(0x7fae5002f510 legacy=0x7fae500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:39.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.904+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fae6c126200 con 0x7fae6c134120 2023-09-30T22:22:39.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.905+0000 7fae627fc700 1 -- 172.21.15.154:0/3080348063 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae6c126200 con 0x7fae6c134120 2023-09-30T22:22:39.905 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:39.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 >> v1:172.21.15.154:6816/126757 conn(0x7fae5002f510 legacy=0x7fae500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:39.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c134120 msgr2=0x7fae6c122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c134120 0x7fae6c122970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fae64009e50 tx=0x7fae6400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 shutdown_connections 2023-09-30T22:22:39.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c134120 0x7fae6c122970 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fae6c0a0a70 0x7fae6c1c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 --2- 172.21.15.154:0/3080348063 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0a1380 0x7fae6c1c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 >> 172.21.15.154:0/3080348063 conn(0x7fae6c0a6610 msgr2=0x7fae6c0a5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 shutdown_connections 2023-09-30T22:22:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.907+0000 7fae741b9700 1 -- 172.21.15.154:0/3080348063 wait complete. 2023-09-30T22:22:39.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:39.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.948+0000 7f5754d77700 1 -- 172.21.15.154:0/199855325 >> v1:172.21.15.154:6816/126757 conn(0x7f573402f510 legacy=0x7f57340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:39.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.950+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f575006c3b0 con 0x7f575009e170 2023-09-30T22:22:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.950+0000 7f574d7fa700 1 -- 172.21.15.154:0/199855325 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f573c015070 con 0x7f575009e170 2023-09-30T22:22:39.951 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:39.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 >> v1:172.21.15.154:6816/126757 conn(0x7f573402f510 legacy=0x7f57340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:39.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 msgr2=0x7f5750119b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:39.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f5750119b70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f573c009c40 tx=0x7f573c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:39.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 shutdown_connections 2023-09-30T22:22:39.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5750130ce0 0x7f575011a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f575009d860 0x7f5750119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 --2- 172.21.15.154:0/199855325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f575009e170 0x7f5750119b70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:39.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 >> 172.21.15.154:0/199855325 conn(0x7f5750099c40 msgr2=0x7f57500a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:39.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 shutdown_connections 2023-09-30T22:22:39.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:39.952+0000 7f5756fdb700 1 -- 172.21.15.154:0/199855325 wait complete. 2023-09-30T22:22:39.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:40.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:40.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:40.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.893+0000 7f78392ec700 1 Processor -- start 2023-09-30T22:22:40.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.893+0000 7f78392ec700 1 -- start start 2023-09-30T22:22:40.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78392ec700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78340a1550 0x7f7834138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78392ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7834139200 0x7f783413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78392ec700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783409e9d0 con 0x7f78340a0a70 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78392ec700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783409dc00 con 0x7f78340a1550 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78392ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783409dec0 con 0x7f7834139200 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78337fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7834139200 0x7f783413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78327fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78340a1550 0x7f7834138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78337fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7834139200 0x7f783413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41922/0 (socket says 172.21.15.154:41922) 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78337fe700 1 -- 172.21.15.154:0/3773305638 learned_addr learned my addr 172.21.15.154:0/3773305638 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78337fe700 1 -- 172.21.15.154:0/3773305638 >> v2:172.21.15.154:3300/0 conn(0x7f78340a1550 msgr2=0x7f7834138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:40.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78337fe700 1 --2- 172.21.15.154:0/3773305638 >> v2:172.21.15.154:3300/0 conn(0x7f78340a1550 0x7f7834138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78337fe700 1 -- 172.21.15.154:0/3773305638 >> v1:172.21.15.154:6789/0 conn(0x7f78340a0a70 legacy=0x7f78340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:40.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78337fe700 1 -- 172.21.15.154:0/3773305638 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783409e6a0 con 0x7f7834139200 2023-09-30T22:22:40.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.894+0000 7f78327fc700 1 --2- 172.21.15.154:0/3773305638 >> v2:172.21.15.154:3300/0 conn(0x7f78340a1550 0x7f7834138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:40.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f78337fe700 1 --2- 172.21.15.154:0/3773305638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7834139200 0x7f783413b5e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f782c009e50 tx=0x7f782c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71d7cb4d556b29ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:40.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f7831ffb700 1 -- 172.21.15.154:0/3773305638 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c00e070 con 0x7f7834139200 2023-09-30T22:22:40.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f7831ffb700 1 -- 172.21.15.154:0/3773305638 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c00b910 con 0x7f7834139200 2023-09-30T22:22:40.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f7831ffb700 1 -- 172.21.15.154:0/3773305638 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c00bcc0 con 0x7f7834139200 2023-09-30T22:22:40.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f78392ec700 1 -- 172.21.15.154:0/3773305638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7834139200 msgr2=0x7f783413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:40.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f78392ec700 1 --2- 172.21.15.154:0/3773305638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7834139200 0x7f783413b5e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f782c009e50 tx=0x7f782c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:40.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f78392ec700 1 -- 172.21.15.154:0/3773305638 shutdown_connections 2023-09-30T22:22:40.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f78392ec700 1 --2- 172.21.15.154:0/3773305638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7834139200 0x7f783413b5e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f78392ec700 1 --2- 172.21.15.154:0/3773305638 >> v2:172.21.15.154:3300/0 conn(0x7f78340a1550 0x7f7834138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f78392ec700 1 -- 172.21.15.154:0/3773305638 >> 172.21.15.154:0/3773305638 conn(0x7f78340a6610 msgr2=0x7f78340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:40.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.895+0000 7f78392ec700 1 -- 172.21.15.154:0/3773305638 shutdown_connections 2023-09-30T22:22:40.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.896+0000 7f78392ec700 1 -- 172.21.15.154:0/3773305638 wait complete. 2023-09-30T22:22:40.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78392ec700 1 Processor -- start 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78392ec700 1 -- start start 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78392ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78340a0a70 0x7f783411e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78392ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78340a1550 0x7f783411ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78392ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7834139200 0x7f783411f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78392ec700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340a0470 con 0x7f7834139200 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78392ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7834122050 con 0x7f78340a1550 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78392ec700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7834121aa0 con 0x7f78340a0a70 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78337fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7834139200 0x7f783411f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78337fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7834139200 0x7f783411f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53086/0 (socket says 172.21.15.154:53086) 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78327fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78340a1550 0x7f783411ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f78337fe700 1 -- 172.21.15.154:0/3881992188 learned_addr learned my addr 172.21.15.154:0/3881992188 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:40.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.897+0000 7f7832ffd700 1 --2- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78340a0a70 0x7f783411e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f78337fe700 1 -- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78340a0a70 msgr2=0x7f783411e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f78337fe700 1 --2- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78340a0a70 0x7f783411e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f78337fe700 1 -- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78340a1550 msgr2=0x7f783411ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f78337fe700 1 --2- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78340a1550 0x7f783411ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f78337fe700 1 -- 172.21.15.154:0/3881992188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280094a0 con 0x7f7834139200 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f78337fe700 1 --2- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7834139200 0x7f783411f320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f782c012000 tx=0x7f782c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f781b7fe700 1 -- 172.21.15.154:0/3881992188 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c004800 con 0x7f7834139200 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f781b7fe700 1 -- 172.21.15.154:0/3881992188 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c004960 con 0x7f7834139200 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f781b7fe700 1 -- 172.21.15.154:0/3881992188 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c01c680 con 0x7f7834139200 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c009b30 con 0x7f7834139200 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.898+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7834120530 con 0x7f7834139200 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.899+0000 7f781b7fe700 1 -- 172.21.15.154:0/3881992188 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f782c01c7e0 con 0x7f7834139200 2023-09-30T22:22:40.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.899+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7834121e90 con 0x7f7834139200 2023-09-30T22:22:40.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.899+0000 7f7832ffd700 1 -- 172.21.15.154:0/3881992188 >> v1:172.21.15.154:6816/126757 conn(0x7f782002f510 legacy=0x7f78200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:40.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.899+0000 7f781b7fe700 1 -- 172.21.15.154:0/3881992188 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f782c0418c0 con 0x7f7834139200 2023-09-30T22:22:40.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:40.904+0000 7f781b7fe700 1 -- 172.21.15.154:0/3881992188 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f782c025450 con 0x7f7834139200 2023-09-30T22:22:40.921 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:40.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.025+0000 7f8fa9fa8700 1 Processor -- start 2023-09-30T22:22:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.025+0000 7f8fa9fa8700 1 -- start start 2023-09-30T22:22:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.026+0000 7f8fa9fa8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.026+0000 7f8fa9fa8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa409e070 0x7f8fa413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.026+0000 7f8fa9fa8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa409eca0 con 0x7f8fa4134f00 2023-09-30T22:22:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.026+0000 7f8fa9fa8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa406b2e0 con 0x7f8fa406a770 2023-09-30T22:22:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.026+0000 7f8fa9fa8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa409f720 con 0x7f8fa409e070 2023-09-30T22:22:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.026+0000 7f8fa2ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8fa4134f00 0x7f8fa409d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35554/0 (socket says 172.21.15.154:35554) 2023-09-30T22:22:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.026+0000 7f8fa2ffd700 1 -- 172.21.15.154:0/698866133 learned_addr learned my addr 172.21.15.154:0/698866133 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:41.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.026+0000 7f8fa37fe700 1 --2- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa3fff700 1 --2- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa409e070 0x7f8fa413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa27fc700 1 -- 172.21.15.154:0/698866133 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774240062 0 0) 0x7f8fa409eca0 con 0x7f8fa4134f00 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa27fc700 1 -- 172.21.15.154:0/698866133 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f900035b0 con 0x7f8fa4134f00 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa3fff700 1 -- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 msgr2=0x7f8fa41349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa3fff700 1 --2- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa41349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa3fff700 1 -- 172.21.15.154:0/698866133 >> v1:172.21.15.154:6789/0 conn(0x7f8fa4134f00 legacy=0x7f8fa409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa3fff700 1 -- 172.21.15.154:0/698866133 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa406b480 con 0x7f8fa409e070 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa37fe700 1 --2- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa41349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa3fff700 1 --2- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa409e070 0x7f8fa413fcf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009870 tx=0x7f8f9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a802bc33f71bbc8f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa27fc700 1 -- 172.21.15.154:0/698866133 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011830 con 0x7f8fa409e070 2023-09-30T22:22:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa27fc700 1 -- 172.21.15.154:0/698866133 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c011990 con 0x7f8fa409e070 2023-09-30T22:22:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.027+0000 7f8fa27fc700 1 -- 172.21.15.154:0/698866133 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011d20 con 0x7f8fa409e070 2023-09-30T22:22:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.028+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa409e070 msgr2=0x7f8fa413fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.028+0000 7f8fa9fa8700 1 --2- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa409e070 0x7f8fa413fcf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009870 tx=0x7f8f9c009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.028+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/698866133 shutdown_connections 2023-09-30T22:22:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.028+0000 7f8fa9fa8700 1 --2- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa409e070 0x7f8fa413fcf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.028+0000 7f8fa9fa8700 1 --2- 172.21.15.154:0/698866133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa41349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.028+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/698866133 >> 172.21.15.154:0/698866133 conn(0x7f8fa4099c40 msgr2=0x7f8fa40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.028+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/698866133 shutdown_connections 2023-09-30T22:22:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.029+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/698866133 wait complete. 2023-09-30T22:22:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.030+0000 7f8fa9fa8700 1 Processor -- start 2023-09-30T22:22:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.030+0000 7f8fa9fa8700 1 -- start start 2023-09-30T22:22:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa9fa8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa411a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa9fa8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa409e070 0x7f8fa411ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa9fa8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa4134f00 0x7f8fa411b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa9fa8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa411bdb0 con 0x7f8fa409e070 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa9fa8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa411c100 con 0x7f8fa406a770 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa9fa8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa4133ac0 con 0x7f8fa4134f00 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa409e070 0x7f8fa411ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa411a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa409e070 0x7f8fa411ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53092/0 (socket says 172.21.15.154:53092) 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa2ffd700 1 -- 172.21.15.154:0/1661707297 learned_addr learned my addr 172.21.15.154:0/1661707297 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa3fff700 1 --2- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa4134f00 0x7f8fa411b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa37fe700 1 -- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa4134f00 msgr2=0x7f8fa411b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.031+0000 7f8fa37fe700 1 --2- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa4134f00 0x7f8fa411b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8fa37fe700 1 -- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa409e070 msgr2=0x7f8fa411ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8fa37fe700 1 --2- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa409e070 0x7f8fa411ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8fa37fe700 1 -- 172.21.15.154:0/1661707297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94009a70 con 0x7f8fa406a770 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8fa3fff700 1 --2- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa4134f00 0x7f8fa411b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8fa37fe700 1 --2- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa411a8e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009dc0 tx=0x7f8f9400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8f9bfff700 1 -- 172.21.15.154:0/1661707297 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400cd10 con 0x7f8fa406a770 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8f9bfff700 1 -- 172.21.15.154:0/1661707297 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9400f040 con 0x7f8fa406a770 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c0094a0 con 0x7f8fa406a770 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8f9bfff700 1 -- 172.21.15.154:0/1661707297 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940146c0 con 0x7f8fa406a770 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.032+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa40a01f0 con 0x7f8fa406a770 2023-09-30T22:22:41.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.033+0000 7f8f9bfff700 1 -- 172.21.15.154:0/1661707297 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8f94014820 con 0x7f8fa406a770 2023-09-30T22:22:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.033+0000 7f8f9bfff700 1 -- 172.21.15.154:0/1661707297 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8f94040850 con 0x7f8fa406a770 2023-09-30T22:22:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.033+0000 7f8fa2ffd700 1 -- 172.21.15.154:0/1661707297 >> v1:172.21.15.154:6816/126757 conn(0x7f8f8402f510 legacy=0x7f8f840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:41.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.033+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa409f220 con 0x7f8fa406a770 2023-09-30T22:22:41.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.038+0000 7f8f9bfff700 1 -- 172.21.15.154:0/1661707297 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f94007920 con 0x7f8fa406a770 2023-09-30T22:22:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.060+0000 7f9fa736b700 1 Processor -- start 2023-09-30T22:22:41.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.060+0000 7f9fa736b700 1 -- start start 2023-09-30T22:22:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.061+0000 7f9fa736b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.061+0000 7f9fa736b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0139280 0x7f9fa013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.061+0000 7f9fa736b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa006b2d0 con 0x7f9fa0133ad0 2023-09-30T22:22:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.061+0000 7f9fa736b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa01345b0 con 0x7f9fa0139280 2023-09-30T22:22:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.061+0000 7f9fa736b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0133610 con 0x7f9fa0136960 2023-09-30T22:22:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.061+0000 7f9fa5107700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9fa0133ad0 0x7f9fa0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35564/0 (socket says 172.21.15.154:35564) 2023-09-30T22:22:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.061+0000 7f9fa5107700 1 -- 172.21.15.154:0/2501461425 learned_addr learned my addr 172.21.15.154:0/2501461425 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.061+0000 7f9fa5908700 1 --2- 172.21.15.154:0/2501461425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0139280 0x7f9fa013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.061+0000 7f9fa4906700 1 --2- 172.21.15.154:0/2501461425 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.062+0000 7f9f97fff700 1 -- 172.21.15.154:0/2501461425 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970915388 0 0) 0x7f9fa006b2d0 con 0x7f9fa0133ad0 2023-09-30T22:22:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.062+0000 7f9fa5908700 1 -- 172.21.15.154:0/2501461425 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 msgr2=0x7f9fa0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.062+0000 7f9fa5908700 1 --2- 172.21.15.154:0/2501461425 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa0138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.062+0000 7f9fa5908700 1 -- 172.21.15.154:0/2501461425 >> v1:172.21.15.154:6789/0 conn(0x7f9fa0133ad0 legacy=0x7f9fa0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.062+0000 7f9fa5908700 1 -- 172.21.15.154:0/2501461425 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa009a500 con 0x7f9fa0139280 2023-09-30T22:22:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.062+0000 7f9fa5908700 1 --2- 172.21.15.154:0/2501461425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0139280 0x7f9fa013b660 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009dc0 tx=0x7f9f9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25443c58309b22f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.062+0000 7f9f97fff700 1 -- 172.21.15.154:0/2501461425 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800e070 con 0x7f9fa0139280 2023-09-30T22:22:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.062+0000 7f9f97fff700 1 -- 172.21.15.154:0/2501461425 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9800bb20 con 0x7f9fa0139280 2023-09-30T22:22:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.062+0000 7f9f97fff700 1 -- 172.21.15.154:0/2501461425 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98012430 con 0x7f9fa0139280 2023-09-30T22:22:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.063+0000 7f9fa736b700 1 -- 172.21.15.154:0/2501461425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0139280 msgr2=0x7f9fa013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.063+0000 7f9fa736b700 1 --2- 172.21.15.154:0/2501461425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0139280 0x7f9fa013b660 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009dc0 tx=0x7f9f9800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.063+0000 7f9fa736b700 1 -- 172.21.15.154:0/2501461425 shutdown_connections 2023-09-30T22:22:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.063+0000 7f9fa736b700 1 --2- 172.21.15.154:0/2501461425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0139280 0x7f9fa013b660 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.063+0000 7f9fa736b700 1 --2- 172.21.15.154:0/2501461425 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.063+0000 7f9fa736b700 1 -- 172.21.15.154:0/2501461425 >> 172.21.15.154:0/2501461425 conn(0x7f9fa0099c40 msgr2=0x7f9fa00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.063+0000 7f9fa736b700 1 -- 172.21.15.154:0/2501461425 shutdown_connections 2023-09-30T22:22:41.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.063+0000 7f9fa736b700 1 -- 172.21.15.154:0/2501461425 wait complete. 2023-09-30T22:22:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa736b700 1 Processor -- start 2023-09-30T22:22:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa736b700 1 -- start start 2023-09-30T22:22:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa736b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 0x7f9fa012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa736b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa736b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0139280 0x7f9fa012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa736b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0070320 con 0x7f9fa0139280 2023-09-30T22:22:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa736b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa009f390 con 0x7f9fa0133ad0 2023-09-30T22:22:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa736b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa01316a0 con 0x7f9fa0136960 2023-09-30T22:22:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa4906700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa5107700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 0x7f9fa012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa4906700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa012d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37000/0 (socket says 172.21.15.154:37000) 2023-09-30T22:22:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.065+0000 7f9fa4906700 1 -- 172.21.15.154:0/1468692849 learned_addr learned my addr 172.21.15.154:0/1468692849 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9fa5908700 1 --2- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0139280 0x7f9fa012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9fa4906700 1 -- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 msgr2=0x7f9fa012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9fa4906700 1 --2- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 0x7f9fa012cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9fa4906700 1 -- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0139280 msgr2=0x7f9fa012d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9fa4906700 1 --2- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0139280 0x7f9fa012d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9fa4906700 1 -- 172.21.15.154:0/1468692849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98009a70 con 0x7f9fa0136960 2023-09-30T22:22:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9fa4906700 1 --2- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa012d070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000e9b0 tx=0x7f9f9000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9f95ffb700 1 -- 172.21.15.154:0/1468692849 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9000ee50 con 0x7f9fa0136960 2023-09-30T22:22:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9f95ffb700 1 -- 172.21.15.154:0/1468692849 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9000c850 con 0x7f9fa0136960 2023-09-30T22:22:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa0072320 con 0x7f9fa0136960 2023-09-30T22:22:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9f95ffb700 1 -- 172.21.15.154:0/1468692849 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9000cbc0 con 0x7f9fa0136960 2023-09-30T22:22:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.066+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa0130a30 con 0x7f9fa0136960 2023-09-30T22:22:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.068+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa004f2a0 con 0x7f9fa0136960 2023-09-30T22:22:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.068+0000 7f9f95ffb700 1 -- 172.21.15.154:0/1468692849 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9f9000cd20 con 0x7f9fa0136960 2023-09-30T22:22:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.068+0000 7f9f95ffb700 1 -- 172.21.15.154:0/1468692849 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9f9003fbc0 con 0x7f9fa0136960 2023-09-30T22:22:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.068+0000 7f9fa5107700 1 -- 172.21.15.154:0/1468692849 >> v1:172.21.15.154:6816/126757 conn(0x7f9f8402f510 legacy=0x7f9f840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:41.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.077+0000 7f9f95ffb700 1 -- 172.21.15.154:0/1468692849 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f900232f0 con 0x7f9fa0136960 2023-09-30T22:22:41.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.100+0000 7f7832ffd700 1 -- 172.21.15.154:0/3881992188 >> v1:172.21.15.154:6816/126757 conn(0x7f782002f510 legacy=0x7f78200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:41.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.100+0000 7fdea6c23700 1 Processor -- start 2023-09-30T22:22:41.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fdea6c23700 1 -- start start 2023-09-30T22:22:41.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fdea6c23700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdea006a770 0x7fdea006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fdea6c23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 0x7fdea0139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fdea6c23700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea006e900 con 0x7fdea009dec0 2023-09-30T22:22:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fdea6c23700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea009d180 con 0x7fdea006a770 2023-09-30T22:22:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fdea6c23700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea009e780 con 0x7fdea0136cb0 2023-09-30T22:22:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fdea49bf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdea006a770 0x7fdea006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fde9ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdea009dec0 0x7fdea006b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35570/0 (socket says 172.21.15.154:35570) 2023-09-30T22:22:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fde9ffff700 1 -- 172.21.15.154:0/602692930 learned_addr learned my addr 172.21.15.154:0/602692930 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.101+0000 7fdea49bf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdea006a770 0x7fdea006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53112/0 (socket says 172.21.15.154:53112) 2023-09-30T22:22:41.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fde9f7fe700 1 -- 172.21.15.154:0/602692930 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671451139 0 0) 0x7fdea006e900 con 0x7fdea009dec0 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fdea51c0700 1 --2- 172.21.15.154:0/602692930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 0x7fdea0139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fde9f7fe700 1 -- 172.21.15.154:0/602692930 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde900035b0 con 0x7fdea009dec0 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fdea49bf700 1 -- 172.21.15.154:0/602692930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 msgr2=0x7fdea0139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fdea49bf700 1 --2- 172.21.15.154:0/602692930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 0x7fdea0139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fdea49bf700 1 -- 172.21.15.154:0/602692930 >> v1:172.21.15.154:6789/0 conn(0x7fdea009dec0 legacy=0x7fdea006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fdea49bf700 1 -- 172.21.15.154:0/602692930 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea009d3c0 con 0x7fdea006a770 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fdea49bf700 1 --2- 172.21.15.154:0/602692930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea006a770 0x7fdea006ab40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fde94009840 tx=0x7fde94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae2f31c08024962 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fde9f7fe700 1 -- 172.21.15.154:0/602692930 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011830 con 0x7fdea006a770 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fde9f7fe700 1 -- 172.21.15.154:0/602692930 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94011990 con 0x7fdea006a770 2023-09-30T22:22:41.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.102+0000 7fde9f7fe700 1 -- 172.21.15.154:0/602692930 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011d00 con 0x7fdea006a770 2023-09-30T22:22:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.103+0000 7fdea6c23700 1 -- 172.21.15.154:0/602692930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea006a770 msgr2=0x7fdea006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.103+0000 7fdea6c23700 1 --2- 172.21.15.154:0/602692930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea006a770 0x7fdea006ab40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fde94009840 tx=0x7fde94009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.103+0000 7fdea6c23700 1 -- 172.21.15.154:0/602692930 shutdown_connections 2023-09-30T22:22:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.103+0000 7fdea6c23700 1 --2- 172.21.15.154:0/602692930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 0x7fdea0139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.103+0000 7fdea6c23700 1 --2- 172.21.15.154:0/602692930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea006a770 0x7fdea006ab40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.103+0000 7fdea6c23700 1 -- 172.21.15.154:0/602692930 >> 172.21.15.154:0/602692930 conn(0x7fdea0099c40 msgr2=0x7fdea00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.103+0000 7fdea6c23700 1 -- 172.21.15.154:0/602692930 shutdown_connections 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.103+0000 7fdea6c23700 1 -- 172.21.15.154:0/602692930 wait complete. 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.104+0000 7fdea6c23700 1 Processor -- start 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.104+0000 7fdea6c23700 1 -- start start 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fdea6c23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea006a770 0x7fdea009a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fdea6c23700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009dec0 0x7fdea009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fde9ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009dec0 0x7fdea009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fdea49bf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea006a770 0x7fdea009a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fdea49bf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea006a770 0x7fdea009a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:41998/0 (socket says 172.21.15.154:41998) 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fdea6c23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 0x7fdea009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:41.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fdea6c23700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea012ebe0 con 0x7fdea009dec0 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fde9ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009dec0 0x7fdea009a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53114/0 (socket says 172.21.15.154:53114) 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fdea6c23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0134ac0 con 0x7fdea006a770 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0134380 con 0x7fdea0136cb0 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fde9ffff700 1 -- 172.21.15.154:0/1625367478 learned_addr learned my addr 172.21.15.154:0/1625367478 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fdea51c0700 1 --2- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 0x7fdea009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fde9ffff700 1 -- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 msgr2=0x7fdea009af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fde9ffff700 1 --2- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 0x7fdea009af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fde9ffff700 1 -- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea006a770 msgr2=0x7fdea009a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fde9ffff700 1 --2- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea006a770 0x7fdea009a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.105+0000 7fde9ffff700 1 -- 172.21.15.154:0/1625367478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940094a0 con 0x7fdea009dec0 2023-09-30T22:22:41.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.106+0000 7fde9ffff700 1 --2- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009dec0 0x7fdea009a9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c700 tx=0x7fde8c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:41.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.106+0000 7fde9d7fa700 1 -- 172.21.15.154:0/1625367478 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c005d70 con 0x7fdea009dec0 2023-09-30T22:22:41.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.106+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea012f670 con 0x7fdea009dec0 2023-09-30T22:22:41.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.106+0000 7fde9d7fa700 1 -- 172.21.15.154:0/1625367478 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c0070d0 con 0x7fdea009dec0 2023-09-30T22:22:41.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.106+0000 7fde9d7fa700 1 -- 172.21.15.154:0/1625367478 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c007460 con 0x7fdea009dec0 2023-09-30T22:22:41.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.106+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea0135130 con 0x7fdea009dec0 2023-09-30T22:22:41.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.107+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea0135cc0 con 0x7fdea009dec0 2023-09-30T22:22:41.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.108+0000 7fde9d7fa700 1 -- 172.21.15.154:0/1625367478 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fde8c0075c0 con 0x7fdea009dec0 2023-09-30T22:22:41.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.108+0000 7fde9d7fa700 1 -- 172.21.15.154:0/1625367478 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fde8c03f300 con 0x7fdea009dec0 2023-09-30T22:22:41.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.108+0000 7fdea49bf700 1 -- 172.21.15.154:0/1625367478 >> v1:172.21.15.154:6816/126757 conn(0x7fde8402f510 legacy=0x7fde840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:41.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.112+0000 7fde9d7fa700 1 -- 172.21.15.154:0/1625367478 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde8c019b20 con 0x7fdea009dec0 2023-09-30T22:22:41.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.160+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7834121cf0 con 0x7f7834139200 2023-09-30T22:22:41.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.160+0000 7f781b7fe700 1 -- 172.21.15.154:0/3881992188 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7834121cf0 con 0x7f7834139200 2023-09-30T22:22:41.161 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:41.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 >> v1:172.21.15.154:6816/126757 conn(0x7f782002f510 legacy=0x7f78200319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:41.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7834139200 msgr2=0x7f783411f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 --2- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7834139200 0x7f783411f320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f782c012000 tx=0x7f782c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 shutdown_connections 2023-09-30T22:22:41.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 --2- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7834139200 0x7f783411f320 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 --2- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78340a0a70 0x7f783411e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 --2- 172.21.15.154:0/3881992188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78340a1550 0x7f783411ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 >> 172.21.15.154:0/3881992188 conn(0x7f78340a6610 msgr2=0x7f7834138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 shutdown_connections 2023-09-30T22:22:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.163+0000 7f78392ec700 1 -- 172.21.15.154:0/3881992188 wait complete. 2023-09-30T22:22:41.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.234+0000 7f8fa2ffd700 1 -- 172.21.15.154:0/1661707297 >> v1:172.21.15.154:6816/126757 conn(0x7f8f8402f510 legacy=0x7f8f840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.238+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8fa404f2a0 con 0x7f8fa406a770 2023-09-30T22:22:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.238+0000 7f8f9bfff700 1 -- 172.21.15.154:0/1661707297 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f9402c090 con 0x7f8fa406a770 2023-09-30T22:22:41.239 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 >> v1:172.21.15.154:6816/126757 conn(0x7f8f8402f510 legacy=0x7f8f840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 msgr2=0x7f8fa411a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 --2- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa411a8e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009dc0 tx=0x7f8f9400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 shutdown_connections 2023-09-30T22:22:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 --2- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fa4134f00 0x7f8fa411b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 --2- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa406a770 0x7f8fa411a8e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 --2- 172.21.15.154:0/1661707297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa409e070 0x7f8fa411ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 >> 172.21.15.154:0/1661707297 conn(0x7f8fa4099c40 msgr2=0x7f8fa40a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 shutdown_connections 2023-09-30T22:22:41.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.240+0000 7f8fa9fa8700 1 -- 172.21.15.154:0/1661707297 wait complete. 2023-09-30T22:22:41.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:41.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.269+0000 7f9fa5107700 1 -- 172.21.15.154:0/1468692849 >> v1:172.21.15.154:6816/126757 conn(0x7f9f8402f510 legacy=0x7f9f840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:41.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.309+0000 7fdea49bf700 1 -- 172.21.15.154:0/1625367478 >> v1:172.21.15.154:6816/126757 conn(0x7fde8402f510 legacy=0x7fde840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:41.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.314+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdea012f610 con 0x7fdea009dec0 2023-09-30T22:22:41.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.314+0000 7fde9d7fa700 1 -- 172.21.15.154:0/1625367478 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde8c017030 con 0x7fdea009dec0 2023-09-30T22:22:41.315 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:41.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.314+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9fa009f0f0 con 0x7f9fa0136960 2023-09-30T22:22:41.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.315+0000 7f9f95ffb700 1 -- 172.21.15.154:0/1468692849 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f90021070 con 0x7f9fa0136960 2023-09-30T22:22:41.316 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:41.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 >> v1:172.21.15.154:6816/126757 conn(0x7fde8402f510 legacy=0x7fde840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:41.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009dec0 msgr2=0x7fdea009a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 --2- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009dec0 0x7fdea009a9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c700 tx=0x7fde8c00ca10 comp rx=0 tx=0).stop 2023-09-30T22:22:41.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 shutdown_connections 2023-09-30T22:22:41.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 --2- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0136cb0 0x7fdea009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 --2- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea006a770 0x7fdea009a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 --2- 172.21.15.154:0/1625367478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009dec0 0x7fdea009a9d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 >> 172.21.15.154:0/1625367478 conn(0x7fdea0099c40 msgr2=0x7fdea01388f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 shutdown_connections 2023-09-30T22:22:41.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7fdea6c23700 1 -- 172.21.15.154:0/1625367478 wait complete. 2023-09-30T22:22:41.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 >> v1:172.21.15.154:6816/126757 conn(0x7f9f8402f510 legacy=0x7f9f840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:41.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 msgr2=0x7f9fa012d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:41.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 --2- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa012d070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000e9b0 tx=0x7f9f9000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 shutdown_connections 2023-09-30T22:22:41.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 --2- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa0139280 0x7f9fa012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 --2- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa0133ad0 0x7f9fa012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 --2- 172.21.15.154:0/1468692849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9fa0136960 0x7f9fa012d070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:41.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 >> 172.21.15.154:0/1468692849 conn(0x7f9fa0099c40 msgr2=0x7f9fa0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:41.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 shutdown_connections 2023-09-30T22:22:41.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:41.317+0000 7f9fa736b700 1 -- 172.21.15.154:0/1468692849 wait complete. 2023-09-30T22:22:41.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:41.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:42.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:42.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:42.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.313+0000 7f0ed6d4d700 1 Processor -- start 2023-09-30T22:22:42.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.313+0000 7f0ed6d4d700 1 -- start start 2023-09-30T22:22:42.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed6d4d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed009ad40 0x7f0ed0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed6d4d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ed0133f70 0x7f0ed01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed6d4d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed00a0a70 0x7f0ed00a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed6d4d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed00a3b60 con 0x7f0ed0133f70 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed6d4d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed01348e0 con 0x7f0ed00a0a70 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed6d4d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed009b110 con 0x7f0ed009ad40 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed52ea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed00a0a70 0x7f0ed00a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed4ae9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed009ad40 0x7f0ed0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ecffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ed0133f70 0x7f0ed01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed52ea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed00a0a70 0x7f0ed00a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:42008/0 (socket says 172.21.15.154:42008) 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed4ae9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed009ad40 0x7f0ed0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37034/0 (socket says 172.21.15.154:37034) 2023-09-30T22:22:42.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed52ea700 1 -- 172.21.15.154:0/4147157586 learned_addr learned my addr 172.21.15.154:0/4147157586 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed52ea700 1 -- 172.21.15.154:0/4147157586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed009ad40 msgr2=0x7f0ed0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed52ea700 1 --2- 172.21.15.154:0/4147157586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed009ad40 0x7f0ed0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed52ea700 1 -- 172.21.15.154:0/4147157586 >> v2:172.21.15.154:3300/0 conn(0x7f0ed0133f70 msgr2=0x7f0ed01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed52ea700 1 --2- 172.21.15.154:0/4147157586 >> v2:172.21.15.154:3300/0 conn(0x7f0ed0133f70 0x7f0ed01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed52ea700 1 -- 172.21.15.154:0/4147157586 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00a2fa0 con 0x7f0ed00a0a70 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ecffff700 1 --2- 172.21.15.154:0/4147157586 >> v2:172.21.15.154:3300/0 conn(0x7f0ed0133f70 0x7f0ed01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ed52ea700 1 --2- 172.21.15.154:0/4147157586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed00a0a70 0x7f0ed00a0ed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009e50 tx=0x7f0ec800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3acc0271646e9e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ecf7fe700 1 -- 172.21.15.154:0/4147157586 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800e070 con 0x7f0ed00a0a70 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ecf7fe700 1 -- 172.21.15.154:0/4147157586 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec800b910 con 0x7f0ed00a0a70 2023-09-30T22:22:42.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.314+0000 7f0ecf7fe700 1 -- 172.21.15.154:0/4147157586 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800bcc0 con 0x7f0ed00a0a70 2023-09-30T22:22:42.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.315+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4147157586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed00a0a70 msgr2=0x7f0ed00a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.315+0000 7f0ed6d4d700 1 --2- 172.21.15.154:0/4147157586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed00a0a70 0x7f0ed00a0ed0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009e50 tx=0x7f0ec800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:42.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.315+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4147157586 shutdown_connections 2023-09-30T22:22:42.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.315+0000 7f0ed6d4d700 1 --2- 172.21.15.154:0/4147157586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed00a0a70 0x7f0ed00a0ed0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.315+0000 7f0ed6d4d700 1 --2- 172.21.15.154:0/4147157586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed009ad40 0x7f0ed0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.315+0000 7f0ed6d4d700 1 --2- 172.21.15.154:0/4147157586 >> v2:172.21.15.154:3300/0 conn(0x7f0ed0133f70 0x7f0ed01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.315+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4147157586 >> 172.21.15.154:0/4147157586 conn(0x7f0ed0099c40 msgr2=0x7f0ed006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.315+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4147157586 shutdown_connections 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.315+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4147157586 wait complete. 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.316+0000 7f0ed6d4d700 1 Processor -- start 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.316+0000 7f0ed6d4d700 1 -- start start 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ed6d4d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed009ad40 0x7f0ed01213b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ed6d4d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed00a0a70 0x7f0ed01218f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ed6d4d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed0133f70 0x7f0ed0121e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ed6d4d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0122880 con 0x7f0ed00a0a70 2023-09-30T22:22:42.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ed6d4d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0132780 con 0x7f0ed009ad40 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ed6d4d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0123e50 con 0x7f0ed0133f70 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ecffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed00a0a70 0x7f0ed01218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ed52ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed0133f70 0x7f0ed0121e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ecffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed00a0a70 0x7f0ed01218f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53124/0 (socket says 172.21.15.154:53124) 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ecffff700 1 -- 172.21.15.154:0/4167589169 learned_addr learned my addr 172.21.15.154:0/4167589169 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.317+0000 7f0ed4ae9700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed009ad40 0x7f0ed01213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ecffff700 1 -- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed0133f70 msgr2=0x7f0ed0121e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ecffff700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed0133f70 0x7f0ed0121e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ecffff700 1 -- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed009ad40 msgr2=0x7f0ed01213b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ecffff700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed009ad40 0x7f0ed01213b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ecffff700 1 -- 172.21.15.154:0/4167589169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0094a0 con 0x7f0ed00a0a70 2023-09-30T22:22:42.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ed4ae9700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed009ad40 0x7f0ed01213b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ed52ea700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed0133f70 0x7f0ed0121e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ecffff700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed00a0a70 0x7f0ed01218f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00ebb0 tx=0x7f0ebc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ecd7fa700 1 -- 172.21.15.154:0/4167589169 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc00c850 con 0x7f0ed00a0a70 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ecd7fa700 1 -- 172.21.15.154:0/4167589169 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc00c9b0 con 0x7f0ed00a0a70 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec8009b30 con 0x7f0ed00a0a70 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ecd7fa700 1 -- 172.21.15.154:0/4167589169 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc00cd40 con 0x7f0ed00a0a70 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.318+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed0124660 con 0x7f0ed00a0a70 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.319+0000 7f0ecd7fa700 1 -- 172.21.15.154:0/4167589169 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0ebc013470 con 0x7f0ed00a0a70 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.319+0000 7f0ecd7fa700 1 -- 172.21.15.154:0/4167589169 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0ebc03fc30 con 0x7f0ed00a0a70 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.319+0000 7f0ed4ae9700 1 -- 172.21.15.154:0/4167589169 >> v1:172.21.15.154:6816/126757 conn(0x7f0eb402f510 legacy=0x7f0eb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:42.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.319+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed009c7e0 con 0x7f0ed00a0a70 2023-09-30T22:22:42.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.324+0000 7f0ecd7fa700 1 -- 172.21.15.154:0/4167589169 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ebc017080 con 0x7f0ed00a0a70 2023-09-30T22:22:42.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:42.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.396+0000 7f09b5e58700 1 Processor -- start 2023-09-30T22:22:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.396+0000 7f09b5e58700 1 -- start start 2023-09-30T22:22:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09b5e58700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b009ad40 0x7f09b0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09b5e58700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09b01343a0 0x7f09b00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09b5e58700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b009b110 con 0x7f09b0133f70 2023-09-30T22:22:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09b5e58700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b00a3b60 con 0x7f09b01343a0 2023-09-30T22:22:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09b5e58700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00a2fa0 con 0x7f09b009ad40 2023-09-30T22:22:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b009ad40 0x7f09b0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b009ad40 0x7f09b0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:42022/0 (socket says 172.21.15.154:42022) 2023-09-30T22:22:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09af7fe700 1 -- 172.21.15.154:0/1095605917 learned_addr learned my addr 172.21.15.154:0/1095605917 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09affff700 1 --2- 172.21.15.154:0/1095605917 >> v2:172.21.15.154:3300/0 conn(0x7f09b01343a0 0x7f09b00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09af7fe700 1 -- 172.21.15.154:0/1095605917 >> v2:172.21.15.154:3300/0 conn(0x7f09b01343a0 msgr2=0x7f09b00a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09af7fe700 1 --2- 172.21.15.154:0/1095605917 >> v2:172.21.15.154:3300/0 conn(0x7f09b01343a0 0x7f09b00a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09af7fe700 1 -- 172.21.15.154:0/1095605917 >> v1:172.21.15.154:6789/0 conn(0x7f09b0133f70 legacy=0x7f09b00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09af7fe700 1 -- 172.21.15.154:0/1095605917 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b009a280 con 0x7f09b009ad40 2023-09-30T22:22:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.397+0000 7f09af7fe700 1 --2- 172.21.15.154:0/1095605917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b009ad40 0x7f09b0133a30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009920 tx=0x7f09a0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f97b67f246f8d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.398+0000 7f09ae7fc700 1 -- 172.21.15.154:0/1095605917 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0011830 con 0x7f09b009ad40 2023-09-30T22:22:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.398+0000 7f09ae7fc700 1 -- 172.21.15.154:0/1095605917 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0011990 con 0x7f09b009ad40 2023-09-30T22:22:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.398+0000 7f09ae7fc700 1 -- 172.21.15.154:0/1095605917 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0011d20 con 0x7f09b009ad40 2023-09-30T22:22:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.399+0000 7f09b5e58700 1 -- 172.21.15.154:0/1095605917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b009ad40 msgr2=0x7f09b0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.399+0000 7f09b5e58700 1 --2- 172.21.15.154:0/1095605917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b009ad40 0x7f09b0133a30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009920 tx=0x7f09a0009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.399+0000 7f09b5e58700 1 -- 172.21.15.154:0/1095605917 shutdown_connections 2023-09-30T22:22:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.399+0000 7f09b5e58700 1 --2- 172.21.15.154:0/1095605917 >> v2:172.21.15.154:3300/0 conn(0x7f09b01343a0 0x7f09b00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.399+0000 7f09b5e58700 1 --2- 172.21.15.154:0/1095605917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b009ad40 0x7f09b0133a30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.399+0000 7f09b5e58700 1 -- 172.21.15.154:0/1095605917 >> 172.21.15.154:0/1095605917 conn(0x7f09b0099c40 msgr2=0x7f09b006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.399+0000 7f09b5e58700 1 -- 172.21.15.154:0/1095605917 shutdown_connections 2023-09-30T22:22:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.399+0000 7f09b5e58700 1 -- 172.21.15.154:0/1095605917 wait complete. 2023-09-30T22:22:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.400+0000 7f09b5e58700 1 Processor -- start 2023-09-30T22:22:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.400+0000 7f09b5e58700 1 -- start start 2023-09-30T22:22:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09b5e58700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b009ad40 0x7f09b0120240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09b5e58700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09b0133f70 0x7f09b0120780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09b5e58700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b01343a0 0x7f09b0120cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09b5e58700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0123950 con 0x7f09b009ad40 2023-09-30T22:22:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09b5e58700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b0121e30 con 0x7f09b01343a0 2023-09-30T22:22:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09b5e58700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b00a45e0 con 0x7f09b0133f70 2023-09-30T22:22:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b009ad40 0x7f09b0120240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09af7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b009ad40 0x7f09b0120240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53142/0 (socket says 172.21.15.154:53142) 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09af7fe700 1 -- 172.21.15.154:0/2915244731 learned_addr learned my addr 172.21.15.154:0/2915244731 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09aeffd700 1 --2- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09b0133f70 0x7f09b0120780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.401+0000 7f09affff700 1 --2- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b01343a0 0x7f09b0120cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f09affff700 1 -- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09b0133f70 msgr2=0x7f09b0120780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f09affff700 1 --2- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09b0133f70 0x7f09b0120780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f09affff700 1 -- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b009ad40 msgr2=0x7f09b0120240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f09affff700 1 --2- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b009ad40 0x7f09b0120240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f09affff700 1 -- 172.21.15.154:0/2915244731 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0009550 con 0x7f09b01343a0 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f09affff700 1 --2- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b01343a0 0x7f09b0120cc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f09a800efc0 tx=0x7f09a800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f0997fff700 1 -- 172.21.15.154:0/2915244731 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a800cc90 con 0x7f09b01343a0 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f0997fff700 1 -- 172.21.15.154:0/2915244731 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a800f040 con 0x7f09b01343a0 2023-09-30T22:22:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b009c7e0 con 0x7f09b01343a0 2023-09-30T22:22:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b0123c30 con 0x7f09b01343a0 2023-09-30T22:22:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.402+0000 7f0997fff700 1 -- 172.21.15.154:0/2915244731 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a80146c0 con 0x7f09b01343a0 2023-09-30T22:22:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.403+0000 7f0997fff700 1 -- 172.21.15.154:0/2915244731 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f09a8014820 con 0x7f09b01343a0 2023-09-30T22:22:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.403+0000 7f09af7fe700 1 -- 172.21.15.154:0/2915244731 >> v1:172.21.15.154:6816/126757 conn(0x7f099c02f560 legacy=0x7f099c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.403+0000 7f0997fff700 1 -- 172.21.15.154:0/2915244731 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f09a8040780 con 0x7f09b01343a0 2023-09-30T22:22:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.404+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09900052e0 con 0x7f09b01343a0 2023-09-30T22:22:42.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.409+0000 7f0997fff700 1 -- 172.21.15.154:0/2915244731 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09a801d400 con 0x7f09b01343a0 2023-09-30T22:22:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.467+0000 7f459ce16700 1 Processor -- start 2023-09-30T22:22:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.467+0000 7f459ce16700 1 -- start start 2023-09-30T22:22:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.468+0000 7f459ce16700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4598132100 0x7f45981367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.468+0000 7f459ce16700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45981314b0 0x7f4598138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.468+0000 7f459ce16700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45980a0f20 con 0x7f4598066410 2023-09-30T22:22:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.468+0000 7f459ce16700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45980667e0 con 0x7f45981314b0 2023-09-30T22:22:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.468+0000 7f459ce16700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45980a23c0 con 0x7f4598132100 2023-09-30T22:22:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f459659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4598066410 0x7f45981319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35574/0 (socket says 172.21.15.154:35574) 2023-09-30T22:22:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f4595d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4598132100 0x7f45981367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f459659c700 1 -- 172.21.15.154:0/4208604692 learned_addr learned my addr 172.21.15.154:0/4208604692 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f4596d9d700 1 --2- 172.21.15.154:0/4208604692 >> v2:172.21.15.154:3300/0 conn(0x7f45981314b0 0x7f4598138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f459559a700 1 -- 172.21.15.154:0/4208604692 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957819059 0 0) 0x7f45980a0f20 con 0x7f4598066410 2023-09-30T22:22:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f4595d9b700 1 -- 172.21.15.154:0/4208604692 >> v2:172.21.15.154:3300/0 conn(0x7f45981314b0 msgr2=0x7f4598138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f4595d9b700 1 --2- 172.21.15.154:0/4208604692 >> v2:172.21.15.154:3300/0 conn(0x7f45981314b0 0x7f4598138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f4595d9b700 1 -- 172.21.15.154:0/4208604692 >> v1:172.21.15.154:6789/0 conn(0x7f4598066410 legacy=0x7f45981319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f4595d9b700 1 -- 172.21.15.154:0/4208604692 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45980a16e0 con 0x7f4598132100 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f4595d9b700 1 --2- 172.21.15.154:0/4208604692 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4598132100 0x7f45981367d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f458c009870 tx=0x7f458c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4c059642d5c11be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f459559a700 1 -- 172.21.15.154:0/4208604692 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c010a90 con 0x7f4598132100 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f459559a700 1 -- 172.21.15.154:0/4208604692 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c010bf0 con 0x7f4598132100 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.469+0000 7f459559a700 1 -- 172.21.15.154:0/4208604692 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c018440 con 0x7f4598132100 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.470+0000 7f459ce16700 1 -- 172.21.15.154:0/4208604692 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4598132100 msgr2=0x7f45981367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.470+0000 7f459ce16700 1 --2- 172.21.15.154:0/4208604692 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4598132100 0x7f45981367d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f458c009870 tx=0x7f458c009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.470+0000 7f459ce16700 1 -- 172.21.15.154:0/4208604692 shutdown_connections 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.470+0000 7f459ce16700 1 --2- 172.21.15.154:0/4208604692 >> v2:172.21.15.154:3300/0 conn(0x7f45981314b0 0x7f4598138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.470+0000 7f459ce16700 1 --2- 172.21.15.154:0/4208604692 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4598132100 0x7f45981367d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.470+0000 7f459ce16700 1 -- 172.21.15.154:0/4208604692 >> 172.21.15.154:0/4208604692 conn(0x7f45980a2980 msgr2=0x7f45980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.470+0000 7f459ce16700 1 -- 172.21.15.154:0/4208604692 shutdown_connections 2023-09-30T22:22:42.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.470+0000 7f459ce16700 1 -- 172.21.15.154:0/4208604692 wait complete. 2023-09-30T22:22:42.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.472+0000 7f459ce16700 1 Processor -- start 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.472+0000 7f459ce16700 1 -- start start 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.472+0000 7f459ce16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4598066410 0x7f45981c0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.472+0000 7f459ce16700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45981314b0 0x7f45981c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459ce16700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598132100 0x7f45981c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459ce16700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459811c410 con 0x7f4598132100 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459ce16700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459811cb30 con 0x7f4598066410 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459ce16700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f459811b2d0 con 0x7f45981314b0 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4598066410 0x7f45981c0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f4596d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598132100 0x7f45981c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4598066410 0x7f45981c0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:42036/0 (socket says 172.21.15.154:42036) 2023-09-30T22:22:42.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f4596d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598132100 0x7f45981c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53158/0 (socket says 172.21.15.154:53158) 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459659c700 1 -- 172.21.15.154:0/2101377250 learned_addr learned my addr 172.21.15.154:0/2101377250 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f4595d9b700 1 --2- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45981314b0 0x7f45981c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459659c700 1 -- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45981314b0 msgr2=0x7f45981c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459659c700 1 --2- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45981314b0 0x7f45981c13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459659c700 1 -- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598132100 msgr2=0x7f45981c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459659c700 1 --2- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598132100 0x7f45981c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459659c700 1 -- 172.21.15.154:0/2101377250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c0094a0 con 0x7f4598066410 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f4595d9b700 1 --2- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45981314b0 0x7f45981c13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f459659c700 1 --2- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4598066410 0x7f45981c0e80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f458800c6d0 tx=0x7f458800c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f4586ffd700 1 -- 172.21.15.154:0/2101377250 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880074e0 con 0x7f4598066410 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.473+0000 7f4586ffd700 1 -- 172.21.15.154:0/2101377250 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4588007640 con 0x7f4598066410 2023-09-30T22:22:42.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.474+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459811d0d0 con 0x7f4598066410 2023-09-30T22:22:42.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.474+0000 7f4586ffd700 1 -- 172.21.15.154:0/2101377250 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4588005a70 con 0x7f4598066410 2023-09-30T22:22:42.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.474+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459811aa60 con 0x7f4598066410 2023-09-30T22:22:42.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.474+0000 7f4586ffd700 1 -- 172.21.15.154:0/2101377250 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4588005bd0 con 0x7f4598066410 2023-09-30T22:22:42.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.474+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459811cd50 con 0x7f4598066410 2023-09-30T22:22:42.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.475+0000 7f4586ffd700 1 -- 172.21.15.154:0/2101377250 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f458803f060 con 0x7f4598066410 2023-09-30T22:22:42.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.475+0000 7f4595d9b700 1 -- 172.21.15.154:0/2101377250 >> v1:172.21.15.154:6816/126757 conn(0x7f457802f510 legacy=0x7f45780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:42.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.483+0000 7f4586ffd700 1 -- 172.21.15.154:0/2101377250 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f459811cd50 con 0x7f4598066410 2023-09-30T22:22:42.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.487+0000 7f87f835f700 1 Processor -- start 2023-09-30T22:22:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.487+0000 7f87f835f700 1 -- start start 2023-09-30T22:22:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f835f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87f009e870 0x7f87f009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f835f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f009f180 0x7f87f0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f835f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f0131d70 0x7f87f01321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f835f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f00a0920 con 0x7f87f009e870 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f835f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f009c970 con 0x7f87f009f180 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f835f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87f009bab0 con 0x7f87f0131d70 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f60fb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87f009e870 0x7f87f009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f60fb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87f009e870 0x7f87f009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53168/0 (socket says 172.21.15.154:53168) 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f60fb700 1 -- 172.21.15.154:0/4044469135 learned_addr learned my addr 172.21.15.154:0/4044469135 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f58fa700 1 --2- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f009f180 0x7f87f0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f68fc700 1 --2- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f0131d70 0x7f87f01321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f60fb700 1 -- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f0131d70 msgr2=0x7f87f01321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f60fb700 1 --2- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f0131d70 0x7f87f01321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f60fb700 1 -- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f009f180 msgr2=0x7f87f0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f60fb700 1 --2- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f009f180 0x7f87f0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f60fb700 1 -- 172.21.15.154:0/4044469135 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f009f9c0 con 0x7f87f009e870 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.488+0000 7f87f60fb700 1 --2- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 0x7f87f009ec40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009920 tx=0x7f87ec009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0b0185e6f85ef4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.489+0000 7f87f50f9700 1 -- 172.21.15.154:0/4044469135 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec011830 con 0x7f87f009e870 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.489+0000 7f87f50f9700 1 -- 172.21.15.154:0/4044469135 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec011990 con 0x7f87f009e870 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.489+0000 7f87f50f9700 1 -- 172.21.15.154:0/4044469135 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec011d20 con 0x7f87f009e870 2023-09-30T22:22:42.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.490+0000 7f87f835f700 1 -- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 msgr2=0x7f87f009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.490+0000 7f87f835f700 1 --2- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 0x7f87f009ec40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009920 tx=0x7f87ec009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.490+0000 7f87f835f700 1 -- 172.21.15.154:0/4044469135 shutdown_connections 2023-09-30T22:22:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.490+0000 7f87f835f700 1 --2- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f0131d70 0x7f87f01321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.490+0000 7f87f835f700 1 --2- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 0x7f87f009ec40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.490+0000 7f87f835f700 1 --2- 172.21.15.154:0/4044469135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f009f180 0x7f87f0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.490+0000 7f87f835f700 1 -- 172.21.15.154:0/4044469135 >> 172.21.15.154:0/4044469135 conn(0x7f87f00a4430 msgr2=0x7f87f00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.490+0000 7f87f835f700 1 -- 172.21.15.154:0/4044469135 shutdown_connections 2023-09-30T22:22:42.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.490+0000 7f87f835f700 1 -- 172.21.15.154:0/4044469135 wait complete. 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.491+0000 7f87f835f700 1 Processor -- start 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.491+0000 7f87f835f700 1 -- start start 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.491+0000 7f87f835f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 0x7f87f0123bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.491+0000 7f87f835f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f009f180 0x7f87f0124100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.491+0000 7f87f835f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f0131d70 0x7f87f0122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.491+0000 7f87f835f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f009dc50 con 0x7f87f009e870 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.491+0000 7f87f835f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f01204a0 con 0x7f87f0131d70 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.491+0000 7f87f835f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87f01314c0 con 0x7f87f009f180 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f58fa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f009f180 0x7f87f0124100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f60fb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 0x7f87f0123bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f58fa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f009f180 0x7f87f0124100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37072/0 (socket says 172.21.15.154:37072) 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f58fa700 1 -- 172.21.15.154:0/3945187421 learned_addr learned my addr 172.21.15.154:0/3945187421 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f68fc700 1 --2- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f0131d70 0x7f87f0122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f58fa700 1 -- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f0131d70 msgr2=0x7f87f0122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f58fa700 1 --2- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f0131d70 0x7f87f0122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f58fa700 1 -- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 msgr2=0x7f87f0123bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f58fa700 1 --2- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 0x7f87f0123bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f58fa700 1 -- 172.21.15.154:0/3945187421 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec009550 con 0x7f87f009f180 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f60fb700 1 --2- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 0x7f87f0123bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f58fa700 1 --2- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f009f180 0x7f87f0124100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e960 tx=0x7f87e000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87e6ffd700 1 -- 172.21.15.154:0/3945187421 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000eeb0 con 0x7f87f009f180 2023-09-30T22:22:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87e6ffd700 1 -- 172.21.15.154:0/3945187421 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000c850 con 0x7f87f009f180 2023-09-30T22:22:42.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f0121660 con 0x7f87f009f180 2023-09-30T22:22:42.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.492+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f0121ba0 con 0x7f87f009f180 2023-09-30T22:22:42.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.494+0000 7f87e6ffd700 1 -- 172.21.15.154:0/3945187421 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000cbe0 con 0x7f87f009f180 2023-09-30T22:22:42.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.494+0000 7f87e6ffd700 1 -- 172.21.15.154:0/3945187421 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f87e000cd80 con 0x7f87f009f180 2023-09-30T22:22:42.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.494+0000 7f87e6ffd700 1 -- 172.21.15.154:0/3945187421 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f87e0040520 con 0x7f87f009f180 2023-09-30T22:22:42.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.494+0000 7f87f60fb700 1 -- 172.21.15.154:0/3945187421 >> v1:172.21.15.154:6816/126757 conn(0x7f87d402f510 legacy=0x7f87d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:42.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.494+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f004f2a0 con 0x7f87f009f180 2023-09-30T22:22:42.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.499+0000 7f87e6ffd700 1 -- 172.21.15.154:0/3945187421 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87e0017080 con 0x7f87f009f180 2023-09-30T22:22:42.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.520+0000 7f0ed4ae9700 1 -- 172.21.15.154:0/4167589169 >> v1:172.21.15.154:6816/126757 conn(0x7f0eb402f510 legacy=0x7f0eb40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:42.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.531+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0ed004f2a0 con 0x7f0ed00a0a70 2023-09-30T22:22:42.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.531+0000 7f0ecd7fa700 1 -- 172.21.15.154:0/4167589169 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ebc021030 con 0x7f0ed00a0a70 2023-09-30T22:22:42.532 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:42.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 >> v1:172.21.15.154:6816/126757 conn(0x7f0eb402f510 legacy=0x7f0eb40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:42.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed00a0a70 msgr2=0x7f0ed01218f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed00a0a70 0x7f0ed01218f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00ebb0 tx=0x7f0ebc00eec0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 shutdown_connections 2023-09-30T22:22:42.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ed0133f70 0x7f0ed0121e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ed009ad40 0x7f0ed01213b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 --2- 172.21.15.154:0/4167589169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ed00a0a70 0x7f0ed01218f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 >> 172.21.15.154:0/4167589169 conn(0x7f0ed0099c40 msgr2=0x7f0ed0132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 shutdown_connections 2023-09-30T22:22:42.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.534+0000 7f0ed6d4d700 1 -- 172.21.15.154:0/4167589169 wait complete. 2023-09-30T22:22:42.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:42.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.604+0000 7f09af7fe700 1 -- 172.21.15.154:0/2915244731 >> v1:172.21.15.154:6816/126757 conn(0x7f099c02f560 legacy=0x7f099c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.641+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0990005860 con 0x7f09b01343a0 2023-09-30T22:22:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.642+0000 7f0997fff700 1 -- 172.21.15.154:0/2915244731 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09a802c090 con 0x7f09b01343a0 2023-09-30T22:22:42.643 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 >> v1:172.21.15.154:6816/126757 conn(0x7f099c02f560 legacy=0x7f099c031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b01343a0 msgr2=0x7f09b0120cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 --2- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b01343a0 0x7f09b0120cc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f09a800efc0 tx=0x7f09a800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 shutdown_connections 2023-09-30T22:22:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 --2- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09b01343a0 0x7f09b0120cc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 --2- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09b009ad40 0x7f09b0120240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 --2- 172.21.15.154:0/2915244731 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09b0133f70 0x7f09b0120780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 >> 172.21.15.154:0/2915244731 conn(0x7f09b0099c40 msgr2=0x7f09b01bb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 shutdown_connections 2023-09-30T22:22:42.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.644+0000 7f09b5e58700 1 -- 172.21.15.154:0/2915244731 wait complete. 2023-09-30T22:22:42.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:42.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.676+0000 7f4595d9b700 1 -- 172.21.15.154:0/2101377250 >> v1:172.21.15.154:6816/126757 conn(0x7f457802f510 legacy=0x7f45780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:42.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.681+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f459811cd50 con 0x7f4598066410 2023-09-30T22:22:42.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.681+0000 7f4586ffd700 1 -- 172.21.15.154:0/2101377250 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4588017020 con 0x7f4598066410 2023-09-30T22:22:42.682 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 >> v1:172.21.15.154:6816/126757 conn(0x7f457802f510 legacy=0x7f45780319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4598066410 msgr2=0x7f45981c0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 --2- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4598066410 0x7f45981c0e80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f458800c6d0 tx=0x7f458800c9e0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 shutdown_connections 2023-09-30T22:22:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 --2- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4598132100 0x7f45981c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 --2- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4598066410 0x7f45981c0e80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 --2- 172.21.15.154:0/2101377250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45981314b0 0x7f45981c13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 >> 172.21.15.154:0/2101377250 conn(0x7f45980a2980 msgr2=0x7f459812e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 shutdown_connections 2023-09-30T22:22:42.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.683+0000 7f459ce16700 1 -- 172.21.15.154:0/2101377250 wait complete. 2023-09-30T22:22:42.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.695+0000 7f87f60fb700 1 -- 172.21.15.154:0/3945187421 >> v1:172.21.15.154:6816/126757 conn(0x7f87d402f510 legacy=0x7f87d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:42.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:42.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.704+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f87f0131b50 con 0x7f87f009f180 2023-09-30T22:22:42.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.705+0000 7f87e6ffd700 1 -- 172.21.15.154:0/3945187421 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87e0021030 con 0x7f87f009f180 2023-09-30T22:22:42.706 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:42.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 >> v1:172.21.15.154:6816/126757 conn(0x7f87d402f510 legacy=0x7f87d40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:42.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f009f180 msgr2=0x7f87f0124100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:42.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 --2- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f009f180 0x7f87f0124100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e960 tx=0x7f87e000ec70 comp rx=0 tx=0).stop 2023-09-30T22:22:42.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 shutdown_connections 2023-09-30T22:22:42.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 --2- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87f0131d70 0x7f87f0122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 --2- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87f009e870 0x7f87f0123bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 --2- 172.21.15.154:0/3945187421 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87f009f180 0x7f87f0124100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:42.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 >> 172.21.15.154:0/3945187421 conn(0x7f87f00a4430 msgr2=0x7f87f006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:42.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 shutdown_connections 2023-09-30T22:22:42.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:42.707+0000 7f87f835f700 1 -- 172.21.15.154:0/3945187421 wait complete. 2023-09-30T22:22:42.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:43.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:43.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:43.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f1372591700 1 Processor -- start 2023-09-30T22:22:43.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f1372591700 1 -- start start 2023-09-30T22:22:43.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f1372591700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c09e870 0x7f136c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f1372591700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f136c09f180 0x7f136c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f1372591700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c09c970 con 0x7f136c131d70 2023-09-30T22:22:43.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f1372591700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0a0920 con 0x7f136c09f180 2023-09-30T22:22:43.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f1372591700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f136c09f9c0 con 0x7f136c09e870 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f136bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c09e870 0x7f136c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f136b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f136c09f180 0x7f136c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f136b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f136c09f180 0x7f136c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53198/0 (socket says 172.21.15.154:53198) 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.691+0000 7f136bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c09e870 0x7f136c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37086/0 (socket says 172.21.15.154:37086) 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f136b7fe700 1 -- 172.21.15.154:0/1020469520 learned_addr learned my addr 172.21.15.154:0/1020469520 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f1370b2e700 1 --1- 172.21.15.154:0/1020469520 >> v1:172.21.15.154:6789/0 conn(0x7f136c131d70 0x7f136c138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35582/0 (socket says 172.21.15.154:35582) 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f136b7fe700 1 -- 172.21.15.154:0/1020469520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c09e870 msgr2=0x7f136c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f136b7fe700 1 --2- 172.21.15.154:0/1020469520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c09e870 0x7f136c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f136b7fe700 1 -- 172.21.15.154:0/1020469520 >> v1:172.21.15.154:6789/0 conn(0x7f136c131d70 legacy=0x7f136c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f136b7fe700 1 -- 172.21.15.154:0/1020469520 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c09bab0 con 0x7f136c09f180 2023-09-30T22:22:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f136b7fe700 1 --2- 172.21.15.154:0/1020469520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 0x7f136c131830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13600098f0 tx=0x7f1360009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5336975cfd3e373 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f136affd700 1 -- 172.21.15.154:0/1020469520 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360011830 con 0x7f136c09f180 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f136affd700 1 -- 172.21.15.154:0/1020469520 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360011990 con 0x7f136c09f180 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.692+0000 7f136affd700 1 -- 172.21.15.154:0/1020469520 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360011d20 con 0x7f136c09f180 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.693+0000 7f1372591700 1 -- 172.21.15.154:0/1020469520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 msgr2=0x7f136c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.693+0000 7f1372591700 1 --2- 172.21.15.154:0/1020469520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 0x7f136c131830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13600098f0 tx=0x7f1360009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.693+0000 7f1372591700 1 -- 172.21.15.154:0/1020469520 shutdown_connections 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.693+0000 7f1372591700 1 --2- 172.21.15.154:0/1020469520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c09e870 0x7f136c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.693+0000 7f1372591700 1 --2- 172.21.15.154:0/1020469520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 0x7f136c131830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.693+0000 7f1372591700 1 -- 172.21.15.154:0/1020469520 >> 172.21.15.154:0/1020469520 conn(0x7f136c0a4430 msgr2=0x7f136c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.693+0000 7f1372591700 1 -- 172.21.15.154:0/1020469520 shutdown_connections 2023-09-30T22:22:43.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.693+0000 7f1372591700 1 -- 172.21.15.154:0/1020469520 wait complete. 2023-09-30T22:22:43.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.694+0000 7f1372591700 1 Processor -- start 2023-09-30T22:22:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.694+0000 7f1372591700 1 -- start start 2023-09-30T22:22:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.694+0000 7f1372591700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f136c09e870 0x7f136c1201f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.694+0000 7f1372591700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 0x7f136c120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.694+0000 7f1372591700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c131d70 0x7f136c120c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.694+0000 7f1372591700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1315c0 con 0x7f136c09f180 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.694+0000 7f1372591700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c122c90 con 0x7f136c09e870 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.694+0000 7f1372591700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f136c123770 con 0x7f136c131d70 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 0x7f136c120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f1370b2e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c131d70 0x7f136c120c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 0x7f136c120730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53202/0 (socket says 172.21.15.154:53202) 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136b7fe700 1 -- 172.21.15.154:0/4018664314 learned_addr learned my addr 172.21.15.154:0/4018664314 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136bfff700 1 --2- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f136c09e870 0x7f136c1201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136b7fe700 1 -- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c131d70 msgr2=0x7f136c120c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136b7fe700 1 --2- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c131d70 0x7f136c120c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136b7fe700 1 -- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f136c09e870 msgr2=0x7f136c1201f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136b7fe700 1 --2- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f136c09e870 0x7f136c1201f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136b7fe700 1 -- 172.21.15.154:0/4018664314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360009550 con 0x7f136c09f180 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f136b7fe700 1 --2- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 0x7f136c120730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1360009c40 tx=0x7f1360004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f1368ff9700 1 -- 172.21.15.154:0/4018664314 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360004400 con 0x7f136c09f180 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f1368ff9700 1 -- 172.21.15.154:0/4018664314 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136001f070 con 0x7f136c09f180 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c123a30 con 0x7f136c09f180 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f1368ff9700 1 -- 172.21.15.154:0/4018664314 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600038e0 con 0x7f136c09f180 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.695+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c0a2df0 con 0x7f136c09f180 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.696+0000 7f1368ff9700 1 -- 172.21.15.154:0/4018664314 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1360021030 con 0x7f136c09f180 2023-09-30T22:22:43.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.696+0000 7f1368ff9700 1 -- 172.21.15.154:0/4018664314 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1360040ee0 con 0x7f136c09f180 2023-09-30T22:22:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.696+0000 7f136bfff700 1 -- 172.21.15.154:0/4018664314 >> v1:172.21.15.154:6816/126757 conn(0x7f135802f510 legacy=0x7f13580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.696+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c123050 con 0x7f136c09f180 2023-09-30T22:22:43.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.701+0000 7f1368ff9700 1 -- 172.21.15.154:0/4018664314 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1360015020 con 0x7f136c09f180 2023-09-30T22:22:43.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.799+0000 7f3c5a37b700 1 Processor -- start 2023-09-30T22:22:43.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.799+0000 7f3c5a37b700 1 -- start start 2023-09-30T22:22:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c5a37b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409e870 0x7f3c5409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c5a37b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c5409f180 0x7f3c54131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c5a37b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c54132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c5a37b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540a0920 con 0x7f3c5409f180 2023-09-30T22:22:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c5a37b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5409c970 con 0x7f3c54131d70 2023-09-30T22:22:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c5a37b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5409bab0 con 0x7f3c5409e870 2023-09-30T22:22:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c58918700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c54132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c58918700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c54132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:42078/0 (socket says 172.21.15.154:42078) 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c58918700 1 -- 172.21.15.154:0/1411211460 learned_addr learned my addr 172.21.15.154:0/1411211460 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c537fe700 1 --2- 172.21.15.154:0/1411211460 >> v2:172.21.15.154:3300/0 conn(0x7f3c5409f180 0x7f3c54131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c53fff700 1 --2- 172.21.15.154:0/1411211460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409e870 0x7f3c5409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c58918700 1 -- 172.21.15.154:0/1411211460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409e870 msgr2=0x7f3c5409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c58918700 1 --2- 172.21.15.154:0/1411211460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409e870 0x7f3c5409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c58918700 1 -- 172.21.15.154:0/1411211460 >> v2:172.21.15.154:3300/0 conn(0x7f3c5409f180 msgr2=0x7f3c54131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c58918700 1 --2- 172.21.15.154:0/1411211460 >> v2:172.21.15.154:3300/0 conn(0x7f3c5409f180 0x7f3c54131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.800+0000 7f3c58918700 1 -- 172.21.15.154:0/1411211460 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5409f9c0 con 0x7f3c54131d70 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.801+0000 7f3c58918700 1 --2- 172.21.15.154:0/1411211460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c54132210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009e80 tx=0x7f3c4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47677d8299255f10 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.801+0000 7f3c52ffd700 1 -- 172.21.15.154:0/1411211460 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00e070 con 0x7f3c54131d70 2023-09-30T22:22:43.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.801+0000 7f3c52ffd700 1 -- 172.21.15.154:0/1411211460 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00b8d0 con 0x7f3c54131d70 2023-09-30T22:22:43.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.801+0000 7f3c52ffd700 1 -- 172.21.15.154:0/1411211460 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00bc80 con 0x7f3c54131d70 2023-09-30T22:22:43.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.802+0000 7f3c5a37b700 1 -- 172.21.15.154:0/1411211460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 msgr2=0x7f3c54132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.802+0000 7f3c5a37b700 1 --2- 172.21.15.154:0/1411211460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c54132210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009e80 tx=0x7f3c4c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:43.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.802+0000 7f3c5a37b700 1 -- 172.21.15.154:0/1411211460 shutdown_connections 2023-09-30T22:22:43.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.802+0000 7f3c5a37b700 1 --2- 172.21.15.154:0/1411211460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c54132210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.802+0000 7f3c5a37b700 1 --2- 172.21.15.154:0/1411211460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409e870 0x7f3c5409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.802+0000 7f3c5a37b700 1 --2- 172.21.15.154:0/1411211460 >> v2:172.21.15.154:3300/0 conn(0x7f3c5409f180 0x7f3c54131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.802+0000 7f3c5a37b700 1 -- 172.21.15.154:0/1411211460 >> 172.21.15.154:0/1411211460 conn(0x7f3c540a4430 msgr2=0x7f3c540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.802+0000 7f3c5a37b700 1 -- 172.21.15.154:0/1411211460 shutdown_connections 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.802+0000 7f3c5a37b700 1 -- 172.21.15.154:0/1411211460 wait complete. 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.803+0000 7f3c5a37b700 1 Processor -- start 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.803+0000 7f3c5a37b700 1 -- start start 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c5a37b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5409e870 0x7f3c541c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c5a37b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409f180 0x7f3c541c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c5a37b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c541c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c5a37b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5411e6c0 con 0x7f3c5409e870 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c5a37b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5411e4d0 con 0x7f3c54131d70 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c5a37b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c541203e0 con 0x7f3c5409f180 2023-09-30T22:22:43.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c58918700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c541c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c58918700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c541c6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:42082/0 (socket says 172.21.15.154:42082) 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c58918700 1 -- 172.21.15.154:0/3499079776 learned_addr learned my addr 172.21.15.154:0/3499079776 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c537fe700 1 --2- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409f180 0x7f3c541c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.804+0000 7f3c53fff700 1 --2- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5409e870 0x7f3c541c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c58918700 1 -- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409f180 msgr2=0x7f3c541c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c58918700 1 --2- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409f180 0x7f3c541c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c58918700 1 -- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5409e870 msgr2=0x7f3c541c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c58918700 1 --2- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5409e870 0x7f3c541c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c58918700 1 -- 172.21.15.154:0/3499079776 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c009b30 con 0x7f3c54131d70 2023-09-30T22:22:43.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c58918700 1 --2- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c541c6d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c5409bf00 tx=0x7f3c4c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c50ff9700 1 -- 172.21.15.154:0/3499079776 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c004450 con 0x7f3c54131d70 2023-09-30T22:22:43.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c50ff9700 1 -- 172.21.15.154:0/3499079776 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0045b0 con 0x7f3c54131d70 2023-09-30T22:22:43.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c540a2bc0 con 0x7f3c54131d70 2023-09-30T22:22:43.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c50ff9700 1 -- 172.21.15.154:0/3499079776 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c004960 con 0x7f3c54131d70 2023-09-30T22:22:43.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.805+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5411ecc0 con 0x7f3c54131d70 2023-09-30T22:22:43.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.806+0000 7f3c50ff9700 1 -- 172.21.15.154:0/3499079776 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3c4c01c410 con 0x7f3c54131d70 2023-09-30T22:22:43.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.806+0000 7f3c53fff700 1 -- 172.21.15.154:0/3499079776 >> v1:172.21.15.154:6816/126757 conn(0x7f3c4002f560 legacy=0x7f3c40031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:43.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.806+0000 7f3c50ff9700 1 -- 172.21.15.154:0/3499079776 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3c4c0412d0 con 0x7f3c54131d70 2023-09-30T22:22:43.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.806+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5411ff60 con 0x7f3c54131d70 2023-09-30T22:22:43.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.811+0000 7f3c50ff9700 1 -- 172.21.15.154:0/3499079776 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c5411ff60 con 0x7f3c54131d70 2023-09-30T22:22:43.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6d1e7d700 1 Processor -- start 2023-09-30T22:22:43.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6d1e7d700 1 -- start start 2023-09-30T22:22:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6d1e7d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc0a0a70 0x7fa6cc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6d1e7d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6cc0a1380 0x7fa6cc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6d1e7d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc133f50 0x7fa6cc134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6d1e7d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6cc09e9d0 con 0x7fa6cc0a1380 2023-09-30T22:22:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6d1e7d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc09dc00 con 0x7fa6cc0a0a70 2023-09-30T22:22:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6d1e7d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc09dec0 con 0x7fa6cc133f50 2023-09-30T22:22:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6cbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc133f50 0x7fa6cc134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6caffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6cc0a1380 0x7fa6cc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6cbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc133f50 0x7fa6cc134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37122/0 (socket says 172.21.15.154:37122) 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.832+0000 7fa6cbfff700 1 -- 172.21.15.154:0/1928727598 learned_addr learned my addr 172.21.15.154:0/1928727598 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6cbfff700 1 -- 172.21.15.154:0/1928727598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc0a0a70 msgr2=0x7fa6cc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6cbfff700 1 --2- 172.21.15.154:0/1928727598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc0a0a70 0x7fa6cc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6cbfff700 1 -- 172.21.15.154:0/1928727598 >> v2:172.21.15.154:3300/0 conn(0x7fa6cc0a1380 msgr2=0x7fa6cc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6cbfff700 1 --2- 172.21.15.154:0/1928727598 >> v2:172.21.15.154:3300/0 conn(0x7fa6cc0a1380 0x7fa6cc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6cbfff700 1 -- 172.21.15.154:0/1928727598 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc09e6a0 con 0x7fa6cc133f50 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6caffd700 1 --2- 172.21.15.154:0/1928727598 >> v2:172.21.15.154:3300/0 conn(0x7fa6cc0a1380 0x7fa6cc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6cbfff700 1 --2- 172.21.15.154:0/1928727598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc133f50 0x7fa6cc134380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009e50 tx=0x7fa6c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=375b1db8a08cbce9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/1928727598 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c400e070 con 0x7fa6cc133f50 2023-09-30T22:22:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/1928727598 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c400b910 con 0x7fa6cc133f50 2023-09-30T22:22:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.833+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/1928727598 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c400bcc0 con 0x7fa6cc133f50 2023-09-30T22:22:43.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.834+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1928727598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc133f50 msgr2=0x7fa6cc134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.834+0000 7fa6d1e7d700 1 --2- 172.21.15.154:0/1928727598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc133f50 0x7fa6cc134380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009e50 tx=0x7fa6c400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.834+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1928727598 shutdown_connections 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.834+0000 7fa6d1e7d700 1 --2- 172.21.15.154:0/1928727598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc0a0a70 0x7fa6cc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.834+0000 7fa6d1e7d700 1 --2- 172.21.15.154:0/1928727598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc133f50 0x7fa6cc134380 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.834+0000 7fa6d1e7d700 1 --2- 172.21.15.154:0/1928727598 >> v2:172.21.15.154:3300/0 conn(0x7fa6cc0a1380 0x7fa6cc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.834+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1928727598 >> 172.21.15.154:0/1928727598 conn(0x7fa6cc0a6610 msgr2=0x7fa6cc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.834+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1928727598 shutdown_connections 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.834+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1928727598 wait complete. 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.835+0000 7fa6d1e7d700 1 Processor -- start 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.835+0000 7fa6d1e7d700 1 -- start start 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6d1e7d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc0a0a70 0x7fa6cc126100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6d1e7d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc0a1380 0x7fa6cc126640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6d1e7d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc133f50 0x7fa6cc126b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6d1e7d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc127ce0 con 0x7fa6cc133f50 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6d1e7d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc132c60 con 0x7fa6cc0a0a70 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6d1e7d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc128290 con 0x7fa6cc0a1380 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6caffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc0a1380 0x7fa6cc126640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6cb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc0a0a70 0x7fa6cc126100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6caffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc0a1380 0x7fa6cc126640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37126/0 (socket says 172.21.15.154:37126) 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6caffd700 1 -- 172.21.15.154:0/1721388491 learned_addr learned my addr 172.21.15.154:0/1721388491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6cbfff700 1 --2- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc133f50 0x7fa6cc126b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6caffd700 1 -- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc0a0a70 msgr2=0x7fa6cc126100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6caffd700 1 --2- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc0a0a70 0x7fa6cc126100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6caffd700 1 -- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc133f50 msgr2=0x7fa6cc126b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6caffd700 1 --2- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc133f50 0x7fa6cc126b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.836+0000 7fa6caffd700 1 -- 172.21.15.154:0/1721388491 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00094a0 con 0x7fa6cc0a1380 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.837+0000 7fa6caffd700 1 --2- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc0a1380 0x7fa6cc126640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000ebe0 tx=0x7fa6c000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.837+0000 7fa6b3fff700 1 -- 172.21.15.154:0/1721388491 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000c850 con 0x7fa6cc0a1380 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.837+0000 7fa6b3fff700 1 -- 172.21.15.154:0/1721388491 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c000c9b0 con 0x7fa6cc0a1380 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.837+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c4009b30 con 0x7fa6cc0a1380 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.837+0000 7fa6b3fff700 1 -- 172.21.15.154:0/1721388491 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000cd40 con 0x7fa6cc0a1380 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.837+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc1284d0 con 0x7fa6cc0a1380 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.837+0000 7fa6b3fff700 1 -- 172.21.15.154:0/1721388491 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa6c0013470 con 0x7fa6cc0a1380 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.838+0000 7fa6b3fff700 1 -- 172.21.15.154:0/1721388491 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa6c003fc80 con 0x7fa6cc0a1380 2023-09-30T22:22:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.838+0000 7fa6cb7fe700 1 -- 172.21.15.154:0/1721388491 >> v1:172.21.15.154:6816/126757 conn(0x7fa6b802f510 legacy=0x7fa6b80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.838+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc1295b0 con 0x7fa6cc0a1380 2023-09-30T22:22:43.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.843+0000 7fa6b3fff700 1 -- 172.21.15.154:0/1721388491 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6cc1295b0 con 0x7fa6cc0a1380 2023-09-30T22:22:43.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.897+0000 7f136bfff700 1 -- 172.21.15.154:0/4018664314 >> v1:172.21.15.154:6816/126757 conn(0x7f135802f510 legacy=0x7f13580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:43.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.901+0000 7f7d3e4a3700 1 Processor -- start 2023-09-30T22:22:43.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.901+0000 7f7d3e4a3700 1 -- start start 2023-09-30T22:22:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d3e4a3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d38133b80 0x7f7d38133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d3e4a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d38099a60 0x7f7d380a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d3e4a3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d380a0e20 0x7f7d380a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d3e4a3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3809aa00 con 0x7f7d38133b80 2023-09-30T22:22:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d3e4a3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3809a080 con 0x7f7d38099a60 2023-09-30T22:22:43.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d3e4a3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38133750 con 0x7f7d380a0e20 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d37fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d38133b80 0x7f7d38133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d37fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d38133b80 0x7f7d38133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53244/0 (socket says 172.21.15.154:53244) 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d37fff700 1 -- 172.21.15.154:0/1005901104 learned_addr learned my addr 172.21.15.154:0/1005901104 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d377fe700 1 --2- 172.21.15.154:0/1005901104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d38099a60 0x7f7d380a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d3ca40700 1 --2- 172.21.15.154:0/1005901104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d380a0e20 0x7f7d380a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d377fe700 1 -- 172.21.15.154:0/1005901104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d380a0e20 msgr2=0x7f7d380a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d377fe700 1 --2- 172.21.15.154:0/1005901104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d380a0e20 0x7f7d380a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d377fe700 1 -- 172.21.15.154:0/1005901104 >> v2:172.21.15.154:3300/0 conn(0x7f7d38133b80 msgr2=0x7f7d38133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d377fe700 1 --2- 172.21.15.154:0/1005901104 >> v2:172.21.15.154:3300/0 conn(0x7f7d38133b80 0x7f7d38133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d377fe700 1 -- 172.21.15.154:0/1005901104 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3809a760 con 0x7f7d38099a60 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.902+0000 7f7d377fe700 1 --2- 172.21.15.154:0/1005901104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d38099a60 0x7f7d380a08e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009840 tx=0x7f7d2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c20f8dde0e3e574 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.903+0000 7f7d36ffd700 1 -- 172.21.15.154:0/1005901104 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c011830 con 0x7f7d38099a60 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.903+0000 7f7d36ffd700 1 -- 172.21.15.154:0/1005901104 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c011990 con 0x7f7d38099a60 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.903+0000 7f7d36ffd700 1 -- 172.21.15.154:0/1005901104 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c011d20 con 0x7f7d38099a60 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.903+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/1005901104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d38099a60 msgr2=0x7f7d380a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.903+0000 7f7d3e4a3700 1 --2- 172.21.15.154:0/1005901104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d38099a60 0x7f7d380a08e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009840 tx=0x7f7d2c009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.904+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/1005901104 shutdown_connections 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.904+0000 7f7d3e4a3700 1 --2- 172.21.15.154:0/1005901104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d380a0e20 0x7f7d380a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.904+0000 7f7d3e4a3700 1 --2- 172.21.15.154:0/1005901104 >> v2:172.21.15.154:3300/0 conn(0x7f7d38133b80 0x7f7d38133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.904+0000 7f7d3e4a3700 1 --2- 172.21.15.154:0/1005901104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d38099a60 0x7f7d380a08e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.904+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/1005901104 >> 172.21.15.154:0/1005901104 conn(0x7f7d380a2980 msgr2=0x7f7d380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.904+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/1005901104 shutdown_connections 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.904+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/1005901104 wait complete. 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.904+0000 7f7d3e4a3700 1 Processor -- start 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d3e4a3700 1 -- start start 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d3e4a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d38099a60 0x7f7d3811c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d3e4a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d380a0e20 0x7f7d3811cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d3e4a3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d38133b80 0x7f7d3811d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d3e4a3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3811de80 con 0x7f7d38099a60 2023-09-30T22:22:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d3e4a3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3812fd00 con 0x7f7d380a0e20 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d3e4a3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3811eb40 con 0x7f7d38133b80 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d377fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d380a0e20 0x7f7d3811cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d377fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d380a0e20 0x7f7d3811cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:42140/0 (socket says 172.21.15.154:42140) 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d377fe700 1 -- 172.21.15.154:0/3210536109 learned_addr learned my addr 172.21.15.154:0/3210536109 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d37fff700 1 --2- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d38099a60 0x7f7d3811c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.905+0000 7f7d3ca40700 1 --2- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d38133b80 0x7f7d3811d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d377fe700 1 -- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d38133b80 msgr2=0x7f7d3811d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d377fe700 1 --2- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d38133b80 0x7f7d3811d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d377fe700 1 -- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d38099a60 msgr2=0x7f7d3811c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d377fe700 1 --2- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d38099a60 0x7f7d3811c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d377fe700 1 -- 172.21.15.154:0/3210536109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c0094a0 con 0x7f7d380a0e20 2023-09-30T22:22:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d377fe700 1 --2- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d380a0e20 0x7f7d3811cef0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009fd0 tx=0x7f7d2c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d34ff9700 1 -- 172.21.15.154:0/3210536109 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c004450 con 0x7f7d380a0e20 2023-09-30T22:22:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d34ff9700 1 -- 172.21.15.154:0/3210536109 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c01f070 con 0x7f7d380a0e20 2023-09-30T22:22:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d34ff9700 1 -- 172.21.15.154:0/3210536109 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0038e0 con 0x7f7d380a0e20 2023-09-30T22:22:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3811f770 con 0x7f7d380a0e20 2023-09-30T22:22:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.906+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3809a2c0 con 0x7f7d380a0e20 2023-09-30T22:22:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.907+0000 7f7d34ff9700 1 -- 172.21.15.154:0/3210536109 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7d2c003a40 con 0x7f7d380a0e20 2023-09-30T22:22:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.907+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d380a2f50 con 0x7f7d380a0e20 2023-09-30T22:22:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.908+0000 7f7d37fff700 1 -- 172.21.15.154:0/3210536109 >> v1:172.21.15.154:6816/126757 conn(0x7f7d2402f510 legacy=0x7f7d240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.908+0000 7f7d34ff9700 1 -- 172.21.15.154:0/3210536109 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7d2c021070 con 0x7f7d380a0e20 2023-09-30T22:22:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.912+0000 7f7d34ff9700 1 -- 172.21.15.154:0/3210536109 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d2c0045b0 con 0x7f7d380a0e20 2023-09-30T22:22:43.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.912+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f136c11d580 con 0x7f136c09f180 2023-09-30T22:22:43.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.912+0000 7f1368ff9700 1 -- 172.21.15.154:0/4018664314 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1360004560 con 0x7f136c09f180 2023-09-30T22:22:43.914 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:43.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 >> v1:172.21.15.154:6816/126757 conn(0x7f135802f510 legacy=0x7f13580319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:43.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 msgr2=0x7f136c120730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:43.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 --2- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 0x7f136c120730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1360009c40 tx=0x7f1360004750 comp rx=0 tx=0).stop 2023-09-30T22:22:43.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 shutdown_connections 2023-09-30T22:22:43.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 --2- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f136c131d70 0x7f136c120c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 --2- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f136c09e870 0x7f136c1201f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 --2- 172.21.15.154:0/4018664314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c09f180 0x7f136c120730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:43.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 >> 172.21.15.154:0/4018664314 conn(0x7f136c0a4430 msgr2=0x7f136c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:43.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 shutdown_connections 2023-09-30T22:22:43.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:43.916+0000 7f1372591700 1 -- 172.21.15.154:0/4018664314 wait complete. 2023-09-30T22:22:43.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.007+0000 7f3c53fff700 1 -- 172.21.15.154:0/3499079776 >> v1:172.21.15.154:6816/126757 conn(0x7f3c4002f560 legacy=0x7f3c40031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:44.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.039+0000 7fa6cb7fe700 1 -- 172.21.15.154:0/1721388491 >> v1:172.21.15.154:6816/126757 conn(0x7fa6b802f510 legacy=0x7fa6b80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.042+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c5411ff60 con 0x7f3c54131d70 2023-09-30T22:22:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.042+0000 7f3c50ff9700 1 -- 172.21.15.154:0/3499079776 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c5411ff60 con 0x7f3c54131d70 2023-09-30T22:22:44.043 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 >> v1:172.21.15.154:6816/126757 conn(0x7f3c4002f560 legacy=0x7f3c40031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 msgr2=0x7f3c541c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 --2- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c541c6d20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c5409bf00 tx=0x7f3c4c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 shutdown_connections 2023-09-30T22:22:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 --2- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c54131d70 0x7f3c541c6d20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 --2- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5409e870 0x7f3c541c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 --2- 172.21.15.154:0/3499079776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c5409f180 0x7f3c541c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 >> 172.21.15.154:0/3499079776 conn(0x7f3c540a4430 msgr2=0x7f3c541b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 shutdown_connections 2023-09-30T22:22:44.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.045+0000 7f3c5a37b700 1 -- 172.21.15.154:0/3499079776 wait complete. 2023-09-30T22:22:44.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.051+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6cc1295b0 con 0x7fa6cc0a1380 2023-09-30T22:22:44.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.051+0000 7fa6b3fff700 1 -- 172.21.15.154:0/1721388491 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6cc1295b0 con 0x7fa6cc0a1380 2023-09-30T22:22:44.052 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:44.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.053+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 >> v1:172.21.15.154:6816/126757 conn(0x7fa6b802f510 legacy=0x7fa6b80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:44.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.053+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc0a1380 msgr2=0x7fa6cc126640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.053+0000 7fa6d1e7d700 1 --2- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc0a1380 0x7fa6cc126640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000ebe0 tx=0x7fa6c000eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.053+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 shutdown_connections 2023-09-30T22:22:44.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.053+0000 7fa6d1e7d700 1 --2- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc133f50 0x7fa6cc126b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.053+0000 7fa6d1e7d700 1 --2- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc0a0a70 0x7fa6cc126100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.053+0000 7fa6d1e7d700 1 --2- 172.21.15.154:0/1721388491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc0a1380 0x7fa6cc126640 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.053+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 >> 172.21.15.154:0/1721388491 conn(0x7fa6cc0a6610 msgr2=0x7fa6cc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.054+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 shutdown_connections 2023-09-30T22:22:44.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.054+0000 7fa6d1e7d700 1 -- 172.21.15.154:0/1721388491 wait complete. 2023-09-30T22:22:44.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:44.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:44.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.107+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d3804f2a0 con 0x7f7d380a0e20 2023-09-30T22:22:44.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.107+0000 7f7d34ff9700 1 -- 172.21.15.154:0/3210536109 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d2c02b090 con 0x7f7d380a0e20 2023-09-30T22:22:44.108 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:44.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d37fff700 1 -- 172.21.15.154:0/3210536109 >> v1:172.21.15.154:6816/126757 conn(0x7f7d2402f510 legacy=0x7f7d240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:44.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 >> v1:172.21.15.154:6816/126757 conn(0x7f7d2402f510 legacy=0x7f7d240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:44.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d380a0e20 msgr2=0x7f7d3811cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 --2- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d380a0e20 0x7f7d3811cef0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009fd0 tx=0x7f7d2c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 shutdown_connections 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 --2- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d38133b80 0x7f7d3811d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 --2- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d38099a60 0x7f7d3811c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 --2- 172.21.15.154:0/3210536109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d380a0e20 0x7f7d3811cef0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 >> 172.21.15.154:0/3210536109 conn(0x7f7d380a2980 msgr2=0x7f7d381baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 shutdown_connections 2023-09-30T22:22:44.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:44.109+0000 7f7d3e4a3700 1 -- 172.21.15.154:0/3210536109 wait complete. 2023-09-30T22:22:44.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:44.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:45.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:45.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:45.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.070+0000 7f895a386700 1 Processor -- start 2023-09-30T22:22:45.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.070+0000 7f895a386700 1 -- start start 2023-09-30T22:22:45.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f895a386700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89540a0a70 0x7f89540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f895a386700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a1380 0x7f8954133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f895a386700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f895a386700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895409e9d0 con 0x7f89540a0a70 2023-09-30T22:22:45.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f895a386700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895409dc00 con 0x7f89540a1380 2023-09-30T22:22:45.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f895a386700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f895409dec0 con 0x7f8954133f50 2023-09-30T22:22:45.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f8953fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89540a0a70 0x7f89540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f8953fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89540a0a70 0x7f89540a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53266/0 (socket says 172.21.15.154:53266) 2023-09-30T22:22:45.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f8953fff700 1 -- 172.21.15.154:0/235261177 learned_addr learned my addr 172.21.15.154:0/235261177 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f8958923700 1 --2- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f89537fe700 1 --2- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a1380 0x7f8954133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f8953fff700 1 -- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 msgr2=0x7f89541343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f8953fff700 1 --2- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f8953fff700 1 -- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a1380 msgr2=0x7f8954133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f8953fff700 1 --2- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a1380 0x7f8954133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.071+0000 7f8953fff700 1 -- 172.21.15.154:0/235261177 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895409e6a0 con 0x7f89540a0a70 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.072+0000 7f8953fff700 1 --2- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a0a70 0x7f89540a0e40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f89440098f0 tx=0x7f8944009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe07773c403043b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.072+0000 7f8952ffd700 1 -- 172.21.15.154:0/235261177 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944011830 con 0x7f89540a0a70 2023-09-30T22:22:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.072+0000 7f8952ffd700 1 -- 172.21.15.154:0/235261177 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944011990 con 0x7f89540a0a70 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.072+0000 7f8952ffd700 1 -- 172.21.15.154:0/235261177 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944011d20 con 0x7f89540a0a70 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.073+0000 7f895a386700 1 -- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a0a70 msgr2=0x7f89540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.073+0000 7f895a386700 1 --2- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a0a70 0x7f89540a0e40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f89440098f0 tx=0x7f8944009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.073+0000 7f895a386700 1 -- 172.21.15.154:0/235261177 shutdown_connections 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.073+0000 7f895a386700 1 --2- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.073+0000 7f895a386700 1 --2- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a0a70 0x7f89540a0e40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.073+0000 7f895a386700 1 --2- 172.21.15.154:0/235261177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a1380 0x7f8954133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.073+0000 7f895a386700 1 -- 172.21.15.154:0/235261177 >> 172.21.15.154:0/235261177 conn(0x7f89540a6610 msgr2=0x7f89540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.073+0000 7f895a386700 1 -- 172.21.15.154:0/235261177 shutdown_connections 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.073+0000 7f895a386700 1 -- 172.21.15.154:0/235261177 wait complete. 2023-09-30T22:22:45.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.074+0000 7f895a386700 1 Processor -- start 2023-09-30T22:22:45.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.074+0000 7f895a386700 1 -- start start 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.074+0000 7f895a386700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a0a70 0x7f895411f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.074+0000 7f895a386700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a1380 0x7f895411fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.074+0000 7f895a386700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.074+0000 7f895a386700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89541337c0 con 0x7f89540a1380 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.074+0000 7f895a386700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895411f310 con 0x7f89540a0a70 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.074+0000 7f895a386700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8954122950 con 0x7f8954133f50 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f89537fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a1380 0x7f895411fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f8958923700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f89537fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a1380 0x7f895411fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53268/0 (socket says 172.21.15.154:53268) 2023-09-30T22:22:45.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f8958923700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37168/0 (socket says 172.21.15.154:37168) 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f89537fe700 1 -- 172.21.15.154:0/1865289766 learned_addr learned my addr 172.21.15.154:0/1865289766 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f8953fff700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a0a70 0x7f895411f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f89537fe700 1 -- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 msgr2=0x7f89541c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f89537fe700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f89537fe700 1 -- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a0a70 msgr2=0x7f895411f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f89537fe700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a0a70 0x7f895411f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f89537fe700 1 -- 172.21.15.154:0/1865289766 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944009550 con 0x7f89540a1380 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f8958923700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f8953fff700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a0a70 0x7f895411f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f89537fe700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a1380 0x7f895411fc40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f894800e930 tx=0x7f894800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f8950ff9700 1 -- 172.21.15.154:0/1865289766 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948013680 con 0x7f89540a1380 2023-09-30T22:22:45.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.075+0000 7f8950ff9700 1 -- 172.21.15.154:0/1865289766 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89480137e0 con 0x7f89540a1380 2023-09-30T22:22:45.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.076+0000 7f8950ff9700 1 -- 172.21.15.154:0/1865289766 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948013b70 con 0x7f89540a1380 2023-09-30T22:22:45.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.076+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89540a50e0 con 0x7f89540a1380 2023-09-30T22:22:45.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.076+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89540a0440 con 0x7f89540a1380 2023-09-30T22:22:45.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.077+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89541225d0 con 0x7f89540a1380 2023-09-30T22:22:45.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.077+0000 7f8950ff9700 1 -- 172.21.15.154:0/1865289766 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8948013cd0 con 0x7f89540a1380 2023-09-30T22:22:45.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.077+0000 7f8950ff9700 1 -- 172.21.15.154:0/1865289766 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f894803fb80 con 0x7f89540a1380 2023-09-30T22:22:45.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.077+0000 7f8953fff700 1 -- 172.21.15.154:0/1865289766 >> v1:172.21.15.154:6816/126757 conn(0x7f894002f510 legacy=0x7f89400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:45.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.083+0000 7f8950ff9700 1 -- 172.21.15.154:0/1865289766 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f894800c970 con 0x7f89540a1380 2023-09-30T22:22:45.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:45.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.190+0000 7f1717a47700 1 Processor -- start 2023-09-30T22:22:45.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.190+0000 7f1717a47700 1 -- start start 2023-09-30T22:22:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1717a47700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1710066410 0x7f17101319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1717a47700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17101314b0 0x7f1710131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1717a47700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 0x7f171009c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1717a47700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17100667e0 con 0x7f1710066410 2023-09-30T22:22:45.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1717a47700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17100a23c0 con 0x7f171009bc70 2023-09-30T22:22:45.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1717a47700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17100a0f20 con 0x7f17101314b0 2023-09-30T22:22:45.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1714fe2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17101314b0 0x7f1710131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1714fe2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17101314b0 0x7f1710131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37176/0 (socket says 172.21.15.154:37176) 2023-09-30T22:22:45.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1714fe2700 1 -- 172.21.15.154:0/538644164 learned_addr learned my addr 172.21.15.154:0/538644164 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:45.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f1715fe4700 1 --2- 172.21.15.154:0/538644164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 0x7f171009c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.191+0000 7f17157e3700 1 --2- 172.21.15.154:0/538644164 >> v2:172.21.15.154:3300/0 conn(0x7f1710066410 0x7f17101319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1715fe4700 1 -- 172.21.15.154:0/538644164 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17101314b0 msgr2=0x7f1710131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1715fe4700 1 --2- 172.21.15.154:0/538644164 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17101314b0 0x7f1710131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1715fe4700 1 -- 172.21.15.154:0/538644164 >> v2:172.21.15.154:3300/0 conn(0x7f1710066410 msgr2=0x7f17101319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1715fe4700 1 --2- 172.21.15.154:0/538644164 >> v2:172.21.15.154:3300/0 conn(0x7f1710066410 0x7f17101319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1715fe4700 1 -- 172.21.15.154:0/538644164 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17100a16e0 con 0x7f171009bc70 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f17157e3700 1 --2- 172.21.15.154:0/538644164 >> v2:172.21.15.154:3300/0 conn(0x7f1710066410 0x7f17101319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1714fe2700 1 --2- 172.21.15.154:0/538644164 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17101314b0 0x7f1710131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1715fe4700 1 --2- 172.21.15.154:0/538644164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 0x7f171009c0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1708009df0 tx=0x7f170800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbe11955ff0b22c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1707fff700 1 -- 172.21.15.154:0/538644164 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800e070 con 0x7f171009bc70 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1707fff700 1 -- 172.21.15.154:0/538644164 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170800baa0 con 0x7f171009bc70 2023-09-30T22:22:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.192+0000 7f1707fff700 1 -- 172.21.15.154:0/538644164 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800be50 con 0x7f171009bc70 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.193+0000 7f1717a47700 1 -- 172.21.15.154:0/538644164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 msgr2=0x7f171009c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.193+0000 7f1717a47700 1 --2- 172.21.15.154:0/538644164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 0x7f171009c0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1708009df0 tx=0x7f170800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.193+0000 7f1717a47700 1 -- 172.21.15.154:0/538644164 shutdown_connections 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.193+0000 7f1717a47700 1 --2- 172.21.15.154:0/538644164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 0x7f171009c0d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.193+0000 7f1717a47700 1 --2- 172.21.15.154:0/538644164 >> v2:172.21.15.154:3300/0 conn(0x7f1710066410 0x7f17101319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.193+0000 7f1717a47700 1 --2- 172.21.15.154:0/538644164 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17101314b0 0x7f1710131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.193+0000 7f1717a47700 1 -- 172.21.15.154:0/538644164 >> 172.21.15.154:0/538644164 conn(0x7f17100a2980 msgr2=0x7f17100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.193+0000 7f1717a47700 1 -- 172.21.15.154:0/538644164 shutdown_connections 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.193+0000 7f1717a47700 1 -- 172.21.15.154:0/538644164 wait complete. 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f1717a47700 1 Processor -- start 2023-09-30T22:22:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f1717a47700 1 -- start start 2023-09-30T22:22:45.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f1717a47700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1710066410 0x7f1710134360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f1717a47700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 0x7f17101348a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f1717a47700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17101314b0 0x7f1710134de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f1717a47700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17101357a0 con 0x7f17101314b0 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f1717a47700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1710135e60 con 0x7f171009bc70 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f1717a47700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1710119180 con 0x7f1710066410 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f17157e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1710066410 0x7f1710134360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f17157e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1710066410 0x7f1710134360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37188/0 (socket says 172.21.15.154:37188) 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.194+0000 7f17157e3700 1 -- 172.21.15.154:0/2812489998 learned_addr learned my addr 172.21.15.154:0/2812489998 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f1715fe4700 1 --2- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17101314b0 0x7f1710134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f1714fe2700 1 --2- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 0x7f17101348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f17157e3700 1 -- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 msgr2=0x7f17101348a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f17157e3700 1 --2- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 0x7f17101348a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f17157e3700 1 -- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17101314b0 msgr2=0x7f1710134de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f17157e3700 1 --2- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17101314b0 0x7f1710134de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f17157e3700 1 -- 172.21.15.154:0/2812489998 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c009430 con 0x7f1710066410 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f17157e3700 1 --2- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1710066410 0x7f1710134360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f170c00ebe0 tx=0x7f170c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f1705ffb700 1 -- 172.21.15.154:0/2812489998 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c005a20 con 0x7f1710066410 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f1705ffb700 1 -- 172.21.15.154:0/2812489998 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c005b80 con 0x7f1710066410 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f1705ffb700 1 -- 172.21.15.154:0/2812489998 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00c850 con 0x7f1710066410 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1700009550 con 0x7f1710066410 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.195+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1708009a70 con 0x7f1710066410 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.196+0000 7f1705ffb700 1 -- 172.21.15.154:0/2812489998 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f170c00c9b0 con 0x7f1710066410 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.196+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171004f2a0 con 0x7f1710066410 2023-09-30T22:22:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.196+0000 7f1705ffb700 1 -- 172.21.15.154:0/2812489998 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f170c0415c0 con 0x7f1710066410 2023-09-30T22:22:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.197+0000 7f1714fe2700 1 -- 172.21.15.154:0/2812489998 >> v1:172.21.15.154:6816/126757 conn(0x7f16f402f510 legacy=0x7f16f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.202+0000 7f1705ffb700 1 -- 172.21.15.154:0/2812489998 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f170c045060 con 0x7f1710066410 2023-09-30T22:22:45.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.205+0000 7f1f983a0700 1 Processor -- start 2023-09-30T22:22:45.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.205+0000 7f1f983a0700 1 -- start start 2023-09-30T22:22:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.206+0000 7f1f983a0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f90133ad0 0x7f1f90133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.206+0000 7f1f983a0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f901300a0 0x7f1f901304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.206+0000 7f1f983a0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9006b2d0 con 0x7f1f901309f0 2023-09-30T22:22:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.206+0000 7f1f983a0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f90133610 con 0x7f1f901300a0 2023-09-30T22:22:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.206+0000 7f1f983a0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9009a500 con 0x7f1f90133ad0 2023-09-30T22:22:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.206+0000 7f1f9613c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f90133ad0 0x7f1f90133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.206+0000 7f1f9613c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f90133ad0 0x7f1f90133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37192/0 (socket says 172.21.15.154:37192) 2023-09-30T22:22:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.206+0000 7f1f9613c700 1 -- 172.21.15.154:0/2806697854 learned_addr learned my addr 172.21.15.154:0/2806697854 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9593b700 1 --2- 172.21.15.154:0/2806697854 >> v2:172.21.15.154:3300/0 conn(0x7f1f901300a0 0x7f1f901304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9613c700 1 -- 172.21.15.154:0/2806697854 >> v2:172.21.15.154:3300/0 conn(0x7f1f901300a0 msgr2=0x7f1f901304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9613c700 1 --2- 172.21.15.154:0/2806697854 >> v2:172.21.15.154:3300/0 conn(0x7f1f901300a0 0x7f1f901304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9613c700 1 -- 172.21.15.154:0/2806697854 >> v1:172.21.15.154:6789/0 conn(0x7f1f901309f0 legacy=0x7f1f9013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9513a700 1 -- 172.21.15.154:0/2806697854 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249811207 0 0) 0x7f1f9006b2d0 con 0x7f1f901309f0 2023-09-30T22:22:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9613c700 1 -- 172.21.15.154:0/2806697854 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f901338b0 con 0x7f1f90133ad0 2023-09-30T22:22:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9613c700 1 --2- 172.21.15.154:0/2806697854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f90133ad0 0x7f1f90133ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c013db0 tx=0x7f1f8c009710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceeccb2bfc6da376 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9513a700 1 -- 172.21.15.154:0/2806697854 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0128e0 con 0x7f1f90133ad0 2023-09-30T22:22:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9513a700 1 -- 172.21.15.154:0/2806697854 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c012a40 con 0x7f1f90133ad0 2023-09-30T22:22:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.207+0000 7f1f9513a700 1 -- 172.21.15.154:0/2806697854 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c012dd0 con 0x7f1f90133ad0 2023-09-30T22:22:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.208+0000 7f1f983a0700 1 -- 172.21.15.154:0/2806697854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f90133ad0 msgr2=0x7f1f90133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.208+0000 7f1f983a0700 1 --2- 172.21.15.154:0/2806697854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f90133ad0 0x7f1f90133ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c013db0 tx=0x7f1f8c009710 comp rx=0 tx=0).stop 2023-09-30T22:22:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.208+0000 7f1f983a0700 1 -- 172.21.15.154:0/2806697854 shutdown_connections 2023-09-30T22:22:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.208+0000 7f1f983a0700 1 --2- 172.21.15.154:0/2806697854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f90133ad0 0x7f1f90133ea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.208+0000 7f1f983a0700 1 --2- 172.21.15.154:0/2806697854 >> v2:172.21.15.154:3300/0 conn(0x7f1f901300a0 0x7f1f901304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.208+0000 7f1f983a0700 1 -- 172.21.15.154:0/2806697854 >> 172.21.15.154:0/2806697854 conn(0x7f1f90099c40 msgr2=0x7f1f900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.208+0000 7f1f983a0700 1 -- 172.21.15.154:0/2806697854 shutdown_connections 2023-09-30T22:22:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.208+0000 7f1f983a0700 1 -- 172.21.15.154:0/2806697854 wait complete. 2023-09-30T22:22:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.209+0000 7f1f983a0700 1 Processor -- start 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.209+0000 7f1f983a0700 1 -- start start 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.209+0000 7f1f983a0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f901300a0 0x7f1f901c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.209+0000 7f1f983a0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f901309f0 0x7f1f901c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.209+0000 7f1f983a0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f90133ad0 0x7f1f901c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.209+0000 7f1f983a0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9011aae0 con 0x7f1f90133ad0 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.209+0000 7f1f983a0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9012dd00 con 0x7f1f901300a0 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.209+0000 7f1f983a0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9011b290 con 0x7f1f901309f0 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.209+0000 7f1f9593b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f901309f0 0x7f1f901c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f9593b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f901309f0 0x7f1f901c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:37194/0 (socket says 172.21.15.154:37194) 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f9693d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f90133ad0 0x7f1f901c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f9593b700 1 -- 172.21.15.154:0/4266064483 learned_addr learned my addr 172.21.15.154:0/4266064483 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f9593b700 1 -- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f901300a0 msgr2=0x7f1f901c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f9593b700 1 --2- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f901300a0 0x7f1f901c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f9593b700 1 -- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f90133ad0 msgr2=0x7f1f901c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f9593b700 1 --2- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f90133ad0 0x7f1f901c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f9593b700 1 -- 172.21.15.154:0/4266064483 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c013a10 con 0x7f1f901309f0 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f9593b700 1 --2- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f901309f0 0x7f1f901c4730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000e810 tx=0x7f1f8000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f86ffd700 1 -- 172.21.15.154:0/4266064483 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80013610 con 0x7f1f901309f0 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f86ffd700 1 -- 172.21.15.154:0/4266064483 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f80013770 con 0x7f1f901309f0 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9011a690 con 0x7f1f901309f0 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f90119b00 con 0x7f1f901309f0 2023-09-30T22:22:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.210+0000 7f1f86ffd700 1 -- 172.21.15.154:0/4266064483 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80013ae0 con 0x7f1f901309f0 2023-09-30T22:22:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.211+0000 7f1f86ffd700 1 -- 172.21.15.154:0/4266064483 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1f80013c40 con 0x7f1f901309f0 2023-09-30T22:22:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.211+0000 7f1f86ffd700 1 -- 172.21.15.154:0/4266064483 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1f8003f8b0 con 0x7f1f901309f0 2023-09-30T22:22:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.211+0000 7f1f9613c700 1 -- 172.21.15.154:0/4266064483 >> v1:172.21.15.154:6816/126757 conn(0x7f1f7402f510 legacy=0x7f1f740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:45.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.211+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f780052e0 con 0x7f1f901309f0 2023-09-30T22:22:45.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.216+0000 7f1f86ffd700 1 -- 172.21.15.154:0/4266064483 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f800106d0 con 0x7f1f901309f0 2023-09-30T22:22:45.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.255+0000 7f7b2ca8b700 1 Processor -- start 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.255+0000 7f7b2ca8b700 1 -- start start 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b2ca8b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809e870 0x7f7b2809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b2ca8b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809f180 0x7f7b28131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b2ca8b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2809c970 con 0x7f7b28131d70 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b2ca8b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280a0920 con 0x7f7b2809f180 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b2ca8b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2809f9c0 con 0x7f7b2809e870 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b25d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809f180 0x7f7b28131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b25d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809f180 0x7f7b28131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:42182/0 (socket says 172.21.15.154:42182) 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b25d9b700 1 -- 172.21.15.154:0/2276241620 learned_addr learned my addr 172.21.15.154:0/2276241620 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:45.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b2659c700 1 --2- 172.21.15.154:0/2276241620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809e870 0x7f7b2809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b25d9b700 1 -- 172.21.15.154:0/2276241620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809e870 msgr2=0x7f7b2809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b25d9b700 1 --2- 172.21.15.154:0/2276241620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809e870 0x7f7b2809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b25d9b700 1 -- 172.21.15.154:0/2276241620 >> v1:172.21.15.154:6789/0 conn(0x7f7b28131d70 legacy=0x7f7b28138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b25d9b700 1 -- 172.21.15.154:0/2276241620 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2809bab0 con 0x7f7b2809f180 2023-09-30T22:22:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.256+0000 7f7b2659c700 1 --2- 172.21.15.154:0/2276241620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809e870 0x7f7b2809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b25d9b700 1 --2- 172.21.15.154:0/2276241620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809f180 0x7f7b28131830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009920 tx=0x7f7b1c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de33d948c337ccb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b2559a700 1 -- 172.21.15.154:0/2276241620 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c011830 con 0x7f7b2809f180 2023-09-30T22:22:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b2559a700 1 -- 172.21.15.154:0/2276241620 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c011990 con 0x7f7b2809f180 2023-09-30T22:22:45.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b2559a700 1 -- 172.21.15.154:0/2276241620 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c011d00 con 0x7f7b2809f180 2023-09-30T22:22:45.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/2276241620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809f180 msgr2=0x7f7b28131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b2ca8b700 1 --2- 172.21.15.154:0/2276241620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809f180 0x7f7b28131830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009920 tx=0x7f7b1c009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/2276241620 shutdown_connections 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b2ca8b700 1 --2- 172.21.15.154:0/2276241620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809e870 0x7f7b2809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b2ca8b700 1 --2- 172.21.15.154:0/2276241620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809f180 0x7f7b28131830 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.257+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/2276241620 >> 172.21.15.154:0/2276241620 conn(0x7f7b280a4430 msgr2=0x7f7b280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.258+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/2276241620 shutdown_connections 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.258+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/2276241620 wait complete. 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2ca8b700 1 Processor -- start 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2ca8b700 1 -- start start 2023-09-30T22:22:45.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2ca8b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809e870 0x7f7b281228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2ca8b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809f180 0x7f7b28122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2ca8b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28131d70 0x7f7b28123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2ca8b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28123d40 con 0x7f7b28131d70 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2ca8b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280a2c00 con 0x7f7b2809e870 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2ca8b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b281245b0 con 0x7f7b2809f180 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809e870 0x7f7b281228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809e870 0x7f7b281228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:42184/0 (socket says 172.21.15.154:42184) 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b2659c700 1 -- 172.21.15.154:0/3021570542 learned_addr learned my addr 172.21.15.154:0/3021570542 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b26d9d700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28131d70 0x7f7b28123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.259+0000 7f7b25d9b700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809f180 0x7f7b28122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:45.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b2659c700 1 -- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809f180 msgr2=0x7f7b28122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b2659c700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809f180 0x7f7b28122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b2659c700 1 -- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28131d70 msgr2=0x7f7b28123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b2659c700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28131d70 0x7f7b28123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b2659c700 1 -- 172.21.15.154:0/3021570542 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180094a0 con 0x7f7b2809e870 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b26d9d700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28131d70 0x7f7b28123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b2659c700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809e870 0x7f7b281228e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800ec10 tx=0x7f7b1800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b16ffd700 1 -- 172.21.15.154:0/3021570542 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18009760 con 0x7f7b2809e870 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b16ffd700 1 -- 172.21.15.154:0/3021570542 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1800c850 con 0x7f7b2809e870 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.260+0000 7f7b16ffd700 1 -- 172.21.15.154:0/3021570542 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800cbe0 con 0x7f7b2809e870 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.261+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c009550 con 0x7f7b2809e870 2023-09-30T22:22:45.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.261+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b28124c60 con 0x7f7b2809e870 2023-09-30T22:22:45.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.262+0000 7f7b16ffd700 1 -- 172.21.15.154:0/3021570542 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7b1800cd40 con 0x7f7b2809e870 2023-09-30T22:22:45.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.262+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2804f2a0 con 0x7f7b2809e870 2023-09-30T22:22:45.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.262+0000 7f7b16ffd700 1 -- 172.21.15.154:0/3021570542 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7b1803ffa0 con 0x7f7b2809e870 2023-09-30T22:22:45.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.262+0000 7f7b25d9b700 1 -- 172.21.15.154:0/3021570542 >> v1:172.21.15.154:6816/126757 conn(0x7f7b0802f510 legacy=0x7f7b080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:45.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.271+0000 7f7b16ffd700 1 -- 172.21.15.154:0/3021570542 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b18071750 con 0x7f7b2809e870 2023-09-30T22:22:45.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.278+0000 7f8953fff700 1 -- 172.21.15.154:0/1865289766 >> v1:172.21.15.154:6816/126757 conn(0x7f894002f510 legacy=0x7f89400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:45.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.309+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f89540a2710 con 0x7f89540a1380 2023-09-30T22:22:45.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.309+0000 7f8950ff9700 1 -- 172.21.15.154:0/1865289766 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f894801b3b0 con 0x7f89540a1380 2023-09-30T22:22:45.311 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 >> v1:172.21.15.154:6816/126757 conn(0x7f894002f510 legacy=0x7f89400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a1380 msgr2=0x7f895411fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a1380 0x7f895411fc40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f894800e930 tx=0x7f894800ec40 comp rx=0 tx=0).stop 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 shutdown_connections 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8954133f50 0x7f89541c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89540a0a70 0x7f895411f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 --2- 172.21.15.154:0/1865289766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89540a1380 0x7f895411fc40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 >> 172.21.15.154:0/1865289766 conn(0x7f89540a6610 msgr2=0x7f89541bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 shutdown_connections 2023-09-30T22:22:45.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.312+0000 7f895a386700 1 -- 172.21.15.154:0/1865289766 wait complete. 2023-09-30T22:22:45.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.398+0000 7f1714fe2700 1 -- 172.21.15.154:0/2812489998 >> v1:172.21.15.154:6816/126757 conn(0x7f16f402f510 legacy=0x7f16f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:45.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.412+0000 7f1f9613c700 1 -- 172.21.15.154:0/4266064483 >> v1:172.21.15.154:6816/126757 conn(0x7f1f7402f510 legacy=0x7f1f740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:45.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.413+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f78005860 con 0x7f1f901309f0 2023-09-30T22:22:45.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.413+0000 7f1f86ffd700 1 -- 172.21.15.154:0/4266064483 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f80010310 con 0x7f1f901309f0 2023-09-30T22:22:45.414 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 >> v1:172.21.15.154:6816/126757 conn(0x7f1f7402f510 legacy=0x7f1f740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f901309f0 msgr2=0x7f1f901c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 --2- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f901309f0 0x7f1f901c4730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000e810 tx=0x7f1f8000eb20 comp rx=0 tx=0).stop 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 shutdown_connections 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 --2- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f90133ad0 0x7f1f901c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 --2- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f901300a0 0x7f1f901c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 --2- 172.21.15.154:0/4266064483 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f901309f0 0x7f1f901c4730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 >> 172.21.15.154:0/4266064483 conn(0x7f1f90099c40 msgr2=0x7f1f90132920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 shutdown_connections 2023-09-30T22:22:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.416+0000 7f1f983a0700 1 -- 172.21.15.154:0/4266064483 wait complete. 2023-09-30T22:22:45.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.424+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f17100a1160 con 0x7f1710066410 2023-09-30T22:22:45.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.425+0000 7f1705ffb700 1 -- 172.21.15.154:0/2812489998 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f170c045030 con 0x7f1710066410 2023-09-30T22:22:45.425 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:45.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 >> v1:172.21.15.154:6816/126757 conn(0x7f16f402f510 legacy=0x7f16f40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:45.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1710066410 msgr2=0x7f1710134360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 --2- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1710066410 0x7f1710134360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f170c00ebe0 tx=0x7f170c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 shutdown_connections 2023-09-30T22:22:45.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 --2- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17101314b0 0x7f1710134de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 --2- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1710066410 0x7f1710134360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 --2- 172.21.15.154:0/2812489998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f171009bc70 0x7f17101348a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 >> 172.21.15.154:0/2812489998 conn(0x7f17100a2980 msgr2=0x7f1710130240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 shutdown_connections 2023-09-30T22:22:45.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.427+0000 7f1717a47700 1 -- 172.21.15.154:0/2812489998 wait complete. 2023-09-30T22:22:45.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:45.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.463+0000 7f7b25d9b700 1 -- 172.21.15.154:0/3021570542 >> v1:172.21.15.154:6816/126757 conn(0x7f7b0802f510 legacy=0x7f7b080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:45.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.472+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7b2806b2a0 con 0x7f7b2809e870 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.472+0000 7f7b16ffd700 1 -- 172.21.15.154:0/3021570542 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b1801b3b0 con 0x7f7b2809e870 2023-09-30T22:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:45.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 >> v1:172.21.15.154:6816/126757 conn(0x7f7b0802f510 legacy=0x7f7b080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:45.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809e870 msgr2=0x7f7b281228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:45.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809e870 0x7f7b281228e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800ec10 tx=0x7f7b1800ef20 comp rx=0 tx=0).stop 2023-09-30T22:22:45.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 shutdown_connections 2023-09-30T22:22:45.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b28131d70 0x7f7b28123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2809e870 0x7f7b281228e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 --2- 172.21.15.154:0/3021570542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b2809f180 0x7f7b28122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:45.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 >> 172.21.15.154:0/3021570542 conn(0x7f7b280a4430 msgr2=0x7f7b2809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:45.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 shutdown_connections 2023-09-30T22:22:45.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:45.474+0000 7f7b2ca8b700 1 -- 172.21.15.154:0/3021570542 wait complete. 2023-09-30T22:22:45.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:46.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:46.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:46.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.465+0000 7f8db60de700 1 Processor -- start 2023-09-30T22:22:46.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.465+0000 7f8db60de700 1 -- start start 2023-09-30T22:22:46.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8db60de700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8db60de700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8db0139280 0x7f8db013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8db60de700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db006b2d0 con 0x7f8db0133ad0 2023-09-30T22:22:46.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8db60de700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db01345b0 con 0x7f8db0139280 2023-09-30T22:22:46.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8db60de700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0133610 con 0x7f8db0136960 2023-09-30T22:22:46.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47578/0 (socket says 172.21.15.154:47578) 2023-09-30T22:22:46.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daeffd700 1 -- 172.21.15.154:0/2456284298 learned_addr learned my addr 172.21.15.154:0/2456284298 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:46.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daffff700 1 --2- 172.21.15.154:0/2456284298 >> v2:172.21.15.154:3300/0 conn(0x7f8db0139280 0x7f8db013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daeffd700 1 -- 172.21.15.154:0/2456284298 >> v2:172.21.15.154:3300/0 conn(0x7f8db0139280 msgr2=0x7f8db013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daeffd700 1 --2- 172.21.15.154:0/2456284298 >> v2:172.21.15.154:3300/0 conn(0x7f8db0139280 0x7f8db013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daeffd700 1 -- 172.21.15.154:0/2456284298 >> v1:172.21.15.154:6789/0 conn(0x7f8db0133ad0 legacy=0x7f8db0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daeffd700 1 -- 172.21.15.154:0/2456284298 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db009a500 con 0x7f8db0136960 2023-09-30T22:22:46.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daffff700 1 --2- 172.21.15.154:0/2456284298 >> v2:172.21.15.154:3300/0 conn(0x7f8db0139280 0x7f8db013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8daeffd700 1 --2- 172.21.15.154:0/2456284298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0138d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009920 tx=0x7f8da4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=502f49d56074f110 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8dae7fc700 1 -- 172.21.15.154:0/2456284298 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4011830 con 0x7f8db0136960 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8dae7fc700 1 -- 172.21.15.154:0/2456284298 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da4011990 con 0x7f8db0136960 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.466+0000 7f8dae7fc700 1 -- 172.21.15.154:0/2456284298 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4011d20 con 0x7f8db0136960 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.467+0000 7f8db60de700 1 -- 172.21.15.154:0/2456284298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 msgr2=0x7f8db0138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.467+0000 7f8db60de700 1 --2- 172.21.15.154:0/2456284298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0138d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009920 tx=0x7f8da4009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.467+0000 7f8db60de700 1 -- 172.21.15.154:0/2456284298 shutdown_connections 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.467+0000 7f8db60de700 1 --2- 172.21.15.154:0/2456284298 >> v2:172.21.15.154:3300/0 conn(0x7f8db0139280 0x7f8db013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.467+0000 7f8db60de700 1 --2- 172.21.15.154:0/2456284298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0138d40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.467+0000 7f8db60de700 1 -- 172.21.15.154:0/2456284298 >> 172.21.15.154:0/2456284298 conn(0x7f8db0099c40 msgr2=0x7f8db00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.467+0000 7f8db60de700 1 -- 172.21.15.154:0/2456284298 shutdown_connections 2023-09-30T22:22:46.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.467+0000 7f8db60de700 1 -- 172.21.15.154:0/2456284298 wait complete. 2023-09-30T22:22:46.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.469+0000 7f8db60de700 1 Processor -- start 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.469+0000 7f8db60de700 1 -- start start 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8db60de700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8db0133ad0 0x7f8db012fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8db60de700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0130080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8db60de700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db0139280 0x7f8db01c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8db60de700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0070430 con 0x7f8db0139280 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8db60de700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db009f390 con 0x7f8db0136960 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8db60de700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8db006e970 con 0x7f8db0133ad0 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0130080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8db0133ad0 0x7f8db012fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0130080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47586/0 (socket says 172.21.15.154:47586) 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daeffd700 1 -- 172.21.15.154:0/2321929048 learned_addr learned my addr 172.21.15.154:0/2321929048 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daffff700 1 --2- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db0139280 0x7f8db01c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daeffd700 1 -- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8db0133ad0 msgr2=0x7f8db012fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daeffd700 1 --2- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8db0133ad0 0x7f8db012fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daeffd700 1 -- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db0139280 msgr2=0x7f8db01c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daeffd700 1 --2- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db0139280 0x7f8db01c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daeffd700 1 -- 172.21.15.154:0/2321929048 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da8009a70 con 0x7f8db0136960 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.470+0000 7f8daf7fe700 1 --2- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8db0133ad0 0x7f8db012fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.471+0000 7f8daeffd700 1 --2- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0130080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009c70 tx=0x7f8da4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.471+0000 7f8d97fff700 1 -- 172.21.15.154:0/2321929048 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4004240 con 0x7f8db0136960 2023-09-30T22:22:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.471+0000 7f8d97fff700 1 -- 172.21.15.154:0/2321929048 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da4030070 con 0x7f8db0136960 2023-09-30T22:22:46.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.471+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da4009550 con 0x7f8db0136960 2023-09-30T22:22:46.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.471+0000 7f8d97fff700 1 -- 172.21.15.154:0/2321929048 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40045e0 con 0x7f8db0136960 2023-09-30T22:22:46.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.471+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db0070ea0 con 0x7f8db0136960 2023-09-30T22:22:46.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.472+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db004f2a0 con 0x7f8db0136960 2023-09-30T22:22:46.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.472+0000 7f8d97fff700 1 -- 172.21.15.154:0/2321929048 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8da4032030 con 0x7f8db0136960 2023-09-30T22:22:46.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.472+0000 7f8d97fff700 1 -- 172.21.15.154:0/2321929048 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8da40521a0 con 0x7f8db0136960 2023-09-30T22:22:46.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.472+0000 7f8daf7fe700 1 -- 172.21.15.154:0/2321929048 >> v1:172.21.15.154:6816/126757 conn(0x7f8d9c02f510 legacy=0x7f8d9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:46.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.477+0000 7f8d97fff700 1 -- 172.21.15.154:0/2321929048 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8da4003e00 con 0x7f8db0136960 2023-09-30T22:22:46.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.570+0000 7f4449792700 1 Processor -- start 2023-09-30T22:22:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.570+0000 7f4449792700 1 -- start start 2023-09-30T22:22:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.570+0000 7f4449792700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f444406a770 0x7f444406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4449792700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444409dec0 0x7f444406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4449792700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 0x7f4444131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4449792700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444406b5c0 con 0x7f444406a770 2023-09-30T22:22:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4449792700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444406e900 con 0x7f4444131a00 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4449792700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f444409d180 con 0x7f444409dec0 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4442ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f444406a770 0x7f444406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4442ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f444406a770 0x7f444406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47466/0 (socket says 172.21.15.154:47466) 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4442ffd700 1 -- 172.21.15.154:0/1703797602 learned_addr learned my addr 172.21.15.154:0/1703797602 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f44427fc700 1 --2- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444409dec0 0x7f444406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f44437fe700 1 --2- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 0x7f4444131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4442ffd700 1 -- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444409dec0 msgr2=0x7f444406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4442ffd700 1 --2- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444409dec0 0x7f444406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4442ffd700 1 -- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 msgr2=0x7f4444131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4442ffd700 1 --2- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 0x7f4444131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4442ffd700 1 -- 172.21.15.154:0/1703797602 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444409e780 con 0x7f444406a770 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.571+0000 7f4442ffd700 1 --2- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444406a770 0x7f444406ab40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f44340098f0 tx=0x7f4434009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8687906bc219171c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4441ffb700 1 -- 172.21.15.154:0/1703797602 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434011830 con 0x7f444406a770 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4441ffb700 1 -- 172.21.15.154:0/1703797602 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4434011990 con 0x7f444406a770 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4441ffb700 1 -- 172.21.15.154:0/1703797602 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434011d20 con 0x7f444406a770 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4449792700 1 -- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444406a770 msgr2=0x7f444406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4449792700 1 --2- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444406a770 0x7f444406ab40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f44340098f0 tx=0x7f4434009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4449792700 1 -- 172.21.15.154:0/1703797602 shutdown_connections 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4449792700 1 --2- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 0x7f4444131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4449792700 1 --2- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444406a770 0x7f444406ab40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4449792700 1 --2- 172.21.15.154:0/1703797602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444409dec0 0x7f444406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4449792700 1 -- 172.21.15.154:0/1703797602 >> 172.21.15.154:0/1703797602 conn(0x7f4444099c40 msgr2=0x7f44440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4449792700 1 -- 172.21.15.154:0/1703797602 shutdown_connections 2023-09-30T22:22:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.572+0000 7f4449792700 1 -- 172.21.15.154:0/1703797602 wait complete. 2023-09-30T22:22:46.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.574+0000 7f4449792700 1 Processor -- start 2023-09-30T22:22:46.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.574+0000 7f4449792700 1 -- start start 2023-09-30T22:22:46.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f4449792700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444406a770 0x7f444409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f4449792700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444409dec0 0x7f444409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f4449792700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 0x7f444409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f4449792700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444411fd50 con 0x7f444409dec0 2023-09-30T22:22:46.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f4449792700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444411ecf0 con 0x7f4444131a00 2023-09-30T22:22:46.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f4449792700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f444409b8f0 con 0x7f444406a770 2023-09-30T22:22:46.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f44427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444409dec0 0x7f444409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f44427fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444409dec0 0x7f444409a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47468/0 (socket says 172.21.15.154:47468) 2023-09-30T22:22:46.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f44427fc700 1 -- 172.21.15.154:0/3083486911 learned_addr learned my addr 172.21.15.154:0/3083486911 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:46.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f4442ffd700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444406a770 0x7f444409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f44437fe700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 0x7f444409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f44427fc700 1 -- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444406a770 msgr2=0x7f444409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f44427fc700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444406a770 0x7f444409a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f44427fc700 1 -- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 msgr2=0x7f444409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f44427fc700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 0x7f444409af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f44427fc700 1 -- 172.21.15.154:0/3083486911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4434009550 con 0x7f444409dec0 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.575+0000 7f4442ffd700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444406a770 0x7f444409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.576+0000 7f44427fc700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444409dec0 0x7f444409a9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f443800e960 tx=0x7f443800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.576+0000 7f442b7fe700 1 -- 172.21.15.154:0/3083486911 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800eeb0 con 0x7f444409dec0 2023-09-30T22:22:46.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.576+0000 7f442b7fe700 1 -- 172.21.15.154:0/3083486911 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443800c850 con 0x7f444409dec0 2023-09-30T22:22:46.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.576+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444411f4e0 con 0x7f444409dec0 2023-09-30T22:22:46.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.576+0000 7f442b7fe700 1 -- 172.21.15.154:0/3083486911 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800cbc0 con 0x7f444409dec0 2023-09-30T22:22:46.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.576+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4444071ce0 con 0x7f444409dec0 2023-09-30T22:22:46.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.577+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444404f2a0 con 0x7f444409dec0 2023-09-30T22:22:46.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.578+0000 7f442b7fe700 1 -- 172.21.15.154:0/3083486911 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f443800cd20 con 0x7f444409dec0 2023-09-30T22:22:46.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.578+0000 7f442b7fe700 1 -- 172.21.15.154:0/3083486911 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4438040510 con 0x7f444409dec0 2023-09-30T22:22:46.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.578+0000 7f4442ffd700 1 -- 172.21.15.154:0/3083486911 >> v1:172.21.15.154:6816/126757 conn(0x7f443002f510 legacy=0x7f44300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:46.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.586+0000 7f442b7fe700 1 -- 172.21.15.154:0/3083486911 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4438024350 con 0x7f444409dec0 2023-09-30T22:22:46.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.604+0000 7fcae6bfc700 1 Processor -- start 2023-09-30T22:22:46.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.604+0000 7fcae6bfc700 1 -- start start 2023-09-30T22:22:46.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.605+0000 7fcae6bfc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcae009d860 0x7fcae009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.605+0000 7fcae6bfc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 0x7fcae0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.605+0000 7fcae6bfc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae009aaa0 con 0x7fcae009e170 2023-09-30T22:22:46.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.605+0000 7fcae6bfc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae009f870 con 0x7fcae009d860 2023-09-30T22:22:46.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.605+0000 7fcae6bfc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae009b360 con 0x7fcae0130eb0 2023-09-30T22:22:46.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.605+0000 7fcae4998700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcae009d860 0x7fcae009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.605+0000 7fcadffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcae009e170 0x7fcae01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41142/0 (socket says 172.21.15.154:41142) 2023-09-30T22:22:46.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.605+0000 7fcadffff700 1 -- 172.21.15.154:0/3070420297 learned_addr learned my addr 172.21.15.154:0/3070420297 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:46.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.605+0000 7fcae5199700 1 --2- 172.21.15.154:0/3070420297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 0x7fcae0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.606+0000 7fcae4998700 1 -- 172.21.15.154:0/3070420297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 msgr2=0x7fcae0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.606+0000 7fcae4998700 1 --2- 172.21.15.154:0/3070420297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 0x7fcae0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.606+0000 7fcae4998700 1 -- 172.21.15.154:0/3070420297 >> v1:172.21.15.154:6789/0 conn(0x7fcae009e170 legacy=0x7fcae01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.606+0000 7fcae4998700 1 -- 172.21.15.154:0/3070420297 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae009b620 con 0x7fcae009d860 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.606+0000 7fcae4998700 1 --2- 172.21.15.154:0/3070420297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 0x7fcae009dc30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009840 tx=0x7fcad4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d73057e7f110a94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.606+0000 7fcadf7fe700 1 -- 172.21.15.154:0/3070420297 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4011830 con 0x7fcae009d860 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.606+0000 7fcadf7fe700 1 -- 172.21.15.154:0/3070420297 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4011990 con 0x7fcae009d860 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.606+0000 7fcadf7fe700 1 -- 172.21.15.154:0/3070420297 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4011d20 con 0x7fcae009d860 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.607+0000 7fcae6bfc700 1 -- 172.21.15.154:0/3070420297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 msgr2=0x7fcae009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.607+0000 7fcae6bfc700 1 --2- 172.21.15.154:0/3070420297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 0x7fcae009dc30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009840 tx=0x7fcad4009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.607+0000 7fcae6bfc700 1 -- 172.21.15.154:0/3070420297 shutdown_connections 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.607+0000 7fcae6bfc700 1 --2- 172.21.15.154:0/3070420297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 0x7fcae0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.607+0000 7fcae6bfc700 1 --2- 172.21.15.154:0/3070420297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 0x7fcae009dc30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.607+0000 7fcae6bfc700 1 -- 172.21.15.154:0/3070420297 >> 172.21.15.154:0/3070420297 conn(0x7fcae0099c40 msgr2=0x7fcae00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.607+0000 7fcae6bfc700 1 -- 172.21.15.154:0/3070420297 shutdown_connections 2023-09-30T22:22:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.607+0000 7fcae6bfc700 1 -- 172.21.15.154:0/3070420297 wait complete. 2023-09-30T22:22:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.608+0000 7fcae6bfc700 1 Processor -- start 2023-09-30T22:22:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.608+0000 7fcae6bfc700 1 -- start start 2023-09-30T22:22:46.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.608+0000 7fcae6bfc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 0x7fcae013aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.608+0000 7fcae6bfc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcae009e170 0x7fcae0135c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.608+0000 7fcae6bfc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 0x7fcae0136180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.608+0000 7fcae6bfc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae0138aa0 con 0x7fcae009d860 2023-09-30T22:22:46.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.608+0000 7fcae6bfc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae0138070 con 0x7fcae0130eb0 2023-09-30T22:22:46.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.608+0000 7fcae6bfc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcae0072150 con 0x7fcae009e170 2023-09-30T22:22:46.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae4998700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 0x7fcae013aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae4998700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 0x7fcae013aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47488/0 (socket says 172.21.15.154:47488) 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae4998700 1 -- 172.21.15.154:0/4293399122 learned_addr learned my addr 172.21.15.154:0/4293399122 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcadffff700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcae009e170 0x7fcae0135c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae5199700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 0x7fcae0136180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae4998700 1 -- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcae009e170 msgr2=0x7fcae0135c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae4998700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcae009e170 0x7fcae0135c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae4998700 1 -- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 msgr2=0x7fcae0136180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae4998700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 0x7fcae0136180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae4998700 1 -- 172.21.15.154:0/4293399122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40094a0 con 0x7fcae009d860 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae5199700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 0x7fcae0136180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:46.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcadffff700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcae009e170 0x7fcae0135c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae4998700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 0x7fcae013aaa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009fd0 tx=0x7fcad4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcadd7fa700 1 -- 172.21.15.154:0/4293399122 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad40036a0 con 0x7fcae009d860 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcadd7fa700 1 -- 172.21.15.154:0/4293399122 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad401f070 con 0x7fcae009d860 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae009c8b0 con 0x7fcae009d860 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.609+0000 7fcadd7fa700 1 -- 172.21.15.154:0/4293399122 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4003a60 con 0x7fcae009d860 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.610+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae0138ef0 con 0x7fcae009d860 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.610+0000 7fcadd7fa700 1 -- 172.21.15.154:0/4293399122 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcad4003bc0 con 0x7fcae009d860 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.610+0000 7fcadd7fa700 1 -- 172.21.15.154:0/4293399122 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fcad4021070 con 0x7fcae009d860 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.610+0000 7fcadffff700 1 -- 172.21.15.154:0/4293399122 >> v1:172.21.15.154:6816/126757 conn(0x7fcac402f510 legacy=0x7fcac40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:46.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.611+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae0132af0 con 0x7fcae009d860 2023-09-30T22:22:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.620+0000 7fcadd7fa700 1 -- 172.21.15.154:0/4293399122 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcad402b080 con 0x7fcae009d860 2023-09-30T22:22:46.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.621+0000 7f418538f700 1 Processor -- start 2023-09-30T22:22:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.621+0000 7f418538f700 1 -- start start 2023-09-30T22:22:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f418538f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f41801349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f418538f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f418009e070 0x7f418013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f418538f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418009eca0 con 0x7f4180134f00 2023-09-30T22:22:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f418538f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418009f720 con 0x7f418009e070 2023-09-30T22:22:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f418538f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418006b480 con 0x7f418006a770 2023-09-30T22:22:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f417e7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4180134f00 0x7f418009d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41148/0 (socket says 172.21.15.154:41148) 2023-09-30T22:22:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f417e7fc700 1 -- 172.21.15.154:0/236289306 learned_addr learned my addr 172.21.15.154:0/236289306 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f417effd700 1 --2- 172.21.15.154:0/236289306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f41801349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f417f7fe700 1 --2- 172.21.15.154:0/236289306 >> v2:172.21.15.154:3300/0 conn(0x7f418009e070 0x7f418013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f417effd700 1 -- 172.21.15.154:0/236289306 >> v2:172.21.15.154:3300/0 conn(0x7f418009e070 msgr2=0x7f418013fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f417effd700 1 --2- 172.21.15.154:0/236289306 >> v2:172.21.15.154:3300/0 conn(0x7f418009e070 0x7f418013fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f417dffb700 1 -- 172.21.15.154:0/236289306 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009612017 0 0) 0x7f418009eca0 con 0x7f4180134f00 2023-09-30T22:22:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f417effd700 1 -- 172.21.15.154:0/236289306 >> v1:172.21.15.154:6789/0 conn(0x7f4180134f00 legacy=0x7f418009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.622+0000 7f417effd700 1 -- 172.21.15.154:0/236289306 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41801352d0 con 0x7f418006a770 2023-09-30T22:22:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f417effd700 1 --2- 172.21.15.154:0/236289306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f41801349c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4170009840 tx=0x7f4170009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52613a89111061b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f417dffb700 1 -- 172.21.15.154:0/236289306 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170011830 con 0x7f418006a770 2023-09-30T22:22:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f417dffb700 1 -- 172.21.15.154:0/236289306 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170011990 con 0x7f418006a770 2023-09-30T22:22:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f417dffb700 1 -- 172.21.15.154:0/236289306 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170011d20 con 0x7f418006a770 2023-09-30T22:22:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f418538f700 1 -- 172.21.15.154:0/236289306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 msgr2=0x7f41801349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f418538f700 1 --2- 172.21.15.154:0/236289306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f41801349c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4170009840 tx=0x7f4170009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f418538f700 1 -- 172.21.15.154:0/236289306 shutdown_connections 2023-09-30T22:22:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f418538f700 1 --2- 172.21.15.154:0/236289306 >> v2:172.21.15.154:3300/0 conn(0x7f418009e070 0x7f418013fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f418538f700 1 --2- 172.21.15.154:0/236289306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f41801349c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f418538f700 1 -- 172.21.15.154:0/236289306 >> 172.21.15.154:0/236289306 conn(0x7f4180099c40 msgr2=0x7f41800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.623+0000 7f418538f700 1 -- 172.21.15.154:0/236289306 shutdown_connections 2023-09-30T22:22:46.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.624+0000 7f418538f700 1 -- 172.21.15.154:0/236289306 wait complete. 2023-09-30T22:22:46.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.625+0000 7f418538f700 1 Processor -- start 2023-09-30T22:22:46.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.625+0000 7f418538f700 1 -- start start 2023-09-30T22:22:46.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f418538f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f4180133d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f418538f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f418009e070 0x7f418011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f418538f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4180134f00 0x7f418011ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:46.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f418538f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418011c980 con 0x7f418009e070 2023-09-30T22:22:46.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f418538f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4180138fe0 con 0x7f418006a770 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f418538f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f418011d5f0 con 0x7f4180134f00 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f4180133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f4180133d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47650/0 (socket says 172.21.15.154:47650) 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417effd700 1 -- 172.21.15.154:0/3698233618 learned_addr learned my addr 172.21.15.154:0/3698233618 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417e7fc700 1 --2- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f418009e070 0x7f418011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417effd700 1 -- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4180134f00 msgr2=0x7f418011ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417effd700 1 --2- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4180134f00 0x7f418011ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417effd700 1 -- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f418009e070 msgr2=0x7f418011a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417effd700 1 --2- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f418009e070 0x7f418011a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417effd700 1 -- 172.21.15.154:0/3698233618 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41700094a0 con 0x7f418006a770 2023-09-30T22:22:46.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f417effd700 1 --2- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f4180133d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4170009b90 tx=0x7f4170004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:46.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f41677fe700 1 -- 172.21.15.154:0/3698233618 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700036a0 con 0x7f418006a770 2023-09-30T22:22:46.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f41677fe700 1 -- 172.21.15.154:0/3698233618 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417001e070 con 0x7f418006a770 2023-09-30T22:22:46.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180139a50 con 0x7f418006a770 2023-09-30T22:22:46.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.626+0000 7f41677fe700 1 -- 172.21.15.154:0/3698233618 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170003a40 con 0x7f418006a770 2023-09-30T22:22:46.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.627+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180138bd0 con 0x7f418006a770 2023-09-30T22:22:46.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.627+0000 7f41677fe700 1 -- 172.21.15.154:0/3698233618 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 10) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4170003ba0 con 0x7f418006a770 2023-09-30T22:22:46.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.627+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4180139120 con 0x7f418006a770 2023-09-30T22:22:46.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.628+0000 7f417e7fc700 1 -- 172.21.15.154:0/3698233618 >> v1:172.21.15.154:6816/126757 conn(0x7f416c02f510 legacy=0x7f416c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:46.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.628+0000 7f41677fe700 1 -- 172.21.15.154:0/3698233618 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4170020070 con 0x7f418006a770 2023-09-30T22:22:46.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.632+0000 7f41677fe700 1 -- 172.21.15.154:0/3698233618 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4180139120 con 0x7f418006a770 2023-09-30T22:22:46.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.673+0000 7f8daf7fe700 1 -- 172.21.15.154:0/2321929048 >> v1:172.21.15.154:6816/126757 conn(0x7f8d9c02f510 legacy=0x7f8d9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:46.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.690+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8db009f0f0 con 0x7f8db0136960 2023-09-30T22:22:46.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.691+0000 7f8d97fff700 1 -- 172.21.15.154:0/2321929048 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8da4015070 con 0x7f8db0136960 2023-09-30T22:22:46.692 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 >> v1:172.21.15.154:6816/126757 conn(0x7f8d9c02f510 legacy=0x7f8d9c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 msgr2=0x7f8db0130080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 --2- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0130080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009c70 tx=0x7f8da4004750 comp rx=0 tx=0).stop 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 shutdown_connections 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 --2- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db0139280 0x7f8db01c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 --2- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8db0133ad0 0x7f8db012fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 --2- 172.21.15.154:0/2321929048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8db0136960 0x7f8db0130080 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 >> 172.21.15.154:0/2321929048 conn(0x7f8db0099c40 msgr2=0x7f8db01371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 shutdown_connections 2023-09-30T22:22:46.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.693+0000 7f8db60de700 1 -- 172.21.15.154:0/2321929048 wait complete. 2023-09-30T22:22:46.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:46.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.779+0000 7f4442ffd700 1 -- 172.21.15.154:0/3083486911 >> v1:172.21.15.154:6816/126757 conn(0x7f443002f510 legacy=0x7f44300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:46.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.804+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f444409e380 con 0x7f444409dec0 2023-09-30T22:22:46.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.804+0000 7f442b7fe700 1 -- 172.21.15.154:0/3083486911 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f443801ab50 con 0x7f444409dec0 2023-09-30T22:22:46.805 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:46.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 >> v1:172.21.15.154:6816/126757 conn(0x7f443002f510 legacy=0x7f44300319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:46.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444409dec0 msgr2=0x7f444409a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444409dec0 0x7f444409a9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f443800e960 tx=0x7f443800ec70 comp rx=0 tx=0).stop 2023-09-30T22:22:46.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 shutdown_connections 2023-09-30T22:22:46.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4444131a00 0x7f444409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f444406a770 0x7f444409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 --2- 172.21.15.154:0/3083486911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f444409dec0 0x7f444409a9d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 >> 172.21.15.154:0/3083486911 conn(0x7f4444099c40 msgr2=0x7f444412f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 shutdown_connections 2023-09-30T22:22:46.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.806+0000 7f4449792700 1 -- 172.21.15.154:0/3083486911 wait complete. 2023-09-30T22:22:46.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.811+0000 7fcadffff700 1 -- 172.21.15.154:0/4293399122 >> v1:172.21.15.154:6816/126757 conn(0x7fcac402f510 legacy=0x7fcac40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.154:6816/126757 2023-09-30T22:22:46.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:46.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.826+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4180139120 con 0x7f418006a770 2023-09-30T22:22:46.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.826+0000 7f41677fe700 1 -- 172.21.15.154:0/3698233618 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4180139120 con 0x7f418006a770 2023-09-30T22:22:46.827 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:46.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 >> v1:172.21.15.154:6816/126757 conn(0x7f416c02f510 legacy=0x7f416c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:46.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 msgr2=0x7f4180133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 --2- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f4180133d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4170009b90 tx=0x7f4170004750 comp rx=0 tx=0).stop 2023-09-30T22:22:46.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 shutdown_connections 2023-09-30T22:22:46.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 --2- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4180134f00 0x7f418011ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 --2- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f418006a770 0x7f4180133d10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 --2- 172.21.15.154:0/3698233618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f418009e070 0x7f418011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 >> 172.21.15.154:0/3698233618 conn(0x7f4180099c40 msgr2=0x7f4180138260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 shutdown_connections 2023-09-30T22:22:46.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.828+0000 7f418538f700 1 -- 172.21.15.154:0/3698233618 wait complete. 2023-09-30T22:22:46.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.834+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcae004f2a0 con 0x7fcae009d860 2023-09-30T22:22:46.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.835+0000 7fcadd7fa700 1 -- 172.21.15.154:0/4293399122 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcad4015030 con 0x7fcae009d860 2023-09-30T22:22:46.835 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:46.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 >> v1:172.21.15.154:6816/126757 conn(0x7fcac402f510 legacy=0x7fcac40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:46.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 msgr2=0x7fcae013aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:46.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 0x7fcae013aaa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009fd0 tx=0x7fcad4004750 comp rx=0 tx=0).stop 2023-09-30T22:22:46.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 shutdown_connections 2023-09-30T22:22:46.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcae0130eb0 0x7fcae0136180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae009d860 0x7fcae013aaa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 --2- 172.21.15.154:0/4293399122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcae009e170 0x7fcae0135c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:46.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 >> 172.21.15.154:0/4293399122 conn(0x7fcae0099c40 msgr2=0x7fcae013b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:46.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 shutdown_connections 2023-09-30T22:22:46.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:46.837+0000 7fcae6bfc700 1 -- 172.21.15.154:0/4293399122 wait complete. 2023-09-30T22:22:46.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:46.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:47.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:47.821 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30ecaca700 1 Processor -- start 2023-09-30T22:22:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30ecaca700 1 -- start start 2023-09-30T22:22:47.843 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30ecaca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e809f350 0x7f30e8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30ecaca700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e81371c0 0x7f30e81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30ecaca700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e809c970 con 0x7f30e809e870 2023-09-30T22:22:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30ecaca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e80a0920 con 0x7f30e809f350 2023-09-30T22:22:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30ecaca700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30e809f9c0 con 0x7f30e81371c0 2023-09-30T22:22:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30e5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e809f350 0x7f30e8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30e659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f30e809e870 0x7f30e809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41152/0 (socket says 172.21.15.154:41152) 2023-09-30T22:22:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.842+0000 7f30e6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e81371c0 0x7f30e81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e659c700 1 -- 172.21.15.154:0/3022779114 learned_addr learned my addr 172.21.15.154:0/3022779114 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e559a700 1 -- 172.21.15.154:0/3022779114 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161870802 0 0) 0x7f30e809c970 con 0x7f30e809e870 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e5d9b700 1 -- 172.21.15.154:0/3022779114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e81371c0 msgr2=0x7f30e81395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e5d9b700 1 --2- 172.21.15.154:0/3022779114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e81371c0 0x7f30e81395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e5d9b700 1 -- 172.21.15.154:0/3022779114 >> v1:172.21.15.154:6789/0 conn(0x7f30e809e870 legacy=0x7f30e809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e5d9b700 1 -- 172.21.15.154:0/3022779114 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e809bab0 con 0x7f30e809f350 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e5d9b700 1 --2- 172.21.15.154:0/3022779114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e809f350 0x7f30e8136c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009870 tx=0x7f30dc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7db68f4842194da7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e559a700 1 -- 172.21.15.154:0/3022779114 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc011830 con 0x7f30e809f350 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e559a700 1 -- 172.21.15.154:0/3022779114 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc011990 con 0x7f30e809f350 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.843+0000 7f30e559a700 1 -- 172.21.15.154:0/3022779114 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc011d20 con 0x7f30e809f350 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.844+0000 7f30ecaca700 1 -- 172.21.15.154:0/3022779114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e809f350 msgr2=0x7f30e8136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.844+0000 7f30ecaca700 1 --2- 172.21.15.154:0/3022779114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e809f350 0x7f30e8136c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009870 tx=0x7f30dc009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.844+0000 7f30ecaca700 1 -- 172.21.15.154:0/3022779114 shutdown_connections 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.844+0000 7f30ecaca700 1 --2- 172.21.15.154:0/3022779114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e81371c0 0x7f30e81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.844+0000 7f30ecaca700 1 --2- 172.21.15.154:0/3022779114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e809f350 0x7f30e8136c80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.844+0000 7f30ecaca700 1 -- 172.21.15.154:0/3022779114 >> 172.21.15.154:0/3022779114 conn(0x7f30e80a4430 msgr2=0x7f30e80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.844+0000 7f30ecaca700 1 -- 172.21.15.154:0/3022779114 shutdown_connections 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.844+0000 7f30ecaca700 1 -- 172.21.15.154:0/3022779114 wait complete. 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.845+0000 7f30ecaca700 1 Processor -- start 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.845+0000 7f30ecaca700 1 -- start start 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.845+0000 7f30ecaca700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e809e870 0x7f30e8120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.845+0000 7f30ecaca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e809f350 0x7f30e8120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.845+0000 7f30ecaca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e81371c0 0x7f30e81212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.845+0000 7f30ecaca700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8136150 con 0x7f30e809f350 2023-09-30T22:22:47.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.845+0000 7f30ecaca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8136730 con 0x7f30e81371c0 2023-09-30T22:22:47.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.845+0000 7f30ecaca700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8122cb0 con 0x7f30e809e870 2023-09-30T22:22:47.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e809f350 0x7f30e8120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e809f350 0x7f30e8120d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47528/0 (socket says 172.21.15.154:47528) 2023-09-30T22:22:47.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e5d9b700 1 -- 172.21.15.154:0/196647469 learned_addr learned my addr 172.21.15.154:0/196647469 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:47.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:47.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e659c700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e809e870 0x7f30e8120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e6d9d700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e81371c0 0x7f30e81212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e5d9b700 1 -- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e809e870 msgr2=0x7f30e8120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e5d9b700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e809e870 0x7f30e8120840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e5d9b700 1 -- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e81371c0 msgr2=0x7f30e81212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e5d9b700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e81371c0 0x7f30e81212c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e5d9b700 1 -- 172.21.15.154:0/196647469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc0094a0 con 0x7f30e809f350 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e6d9d700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e81371c0 0x7f30e81212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30e5d9b700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e809f350 0x7f30e8120d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009840 tx=0x7f30dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30d6ffd700 1 -- 172.21.15.154:0/196647469 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0036a0 con 0x7f30e809f350 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30d6ffd700 1 -- 172.21.15.154:0/196647469 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc01f070 con 0x7f30e809f350 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30d6ffd700 1 -- 172.21.15.154:0/196647469 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc003a60 con 0x7f30e809f350 2023-09-30T22:22:47.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30ecaca700 1 -- 172.21.15.154:0/196647469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e8124360 con 0x7f30e809f350 2023-09-30T22:22:47.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.846+0000 7f30ecaca700 1 -- 172.21.15.154:0/196647469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e809dba0 con 0x7f30e809f350 2023-09-30T22:22:47.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.847+0000 7f30d6ffd700 1 -- 172.21.15.154:0/196647469 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30dc003bc0 con 0x7f30e809f350 2023-09-30T22:22:47.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.848+0000 7f30d6ffd700 1 -- 172.21.15.154:0/196647469 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f30dc021070 con 0x7f30e809f350 2023-09-30T22:22:47.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.848+0000 7f30d4ff9700 1 -- 172.21.15.154:0/196647469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c00052e0 con 0x7f30e809f350 2023-09-30T22:22:47.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.852+0000 7f30d6ffd700 1 -- 172.21.15.154:0/196647469 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30dc015070 con 0x7f30e809f350 2023-09-30T22:22:47.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.952+0000 7f2bd66e6700 1 Processor -- start 2023-09-30T22:22:47.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bd66e6700 1 -- start start 2023-09-30T22:22:47.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bd66e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a0a30 0x7f2bd00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bd66e6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2bd00a1340 0x7f2bd012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bd66e6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd00a1e70 con 0x7f2bd01304a0 2023-09-30T22:22:47.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bd66e6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd009a720 con 0x7f2bd00a1340 2023-09-30T22:22:47.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bd66e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd009b300 con 0x7f2bd00a0a30 2023-09-30T22:22:47.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bcf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2bd00a1340 0x7f2bd012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bcf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2bd00a1340 0x7f2bd012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47536/0 (socket says 172.21.15.154:47536) 2023-09-30T22:22:47.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bcf7fe700 1 -- 172.21.15.154:0/756991780 learned_addr learned my addr 172.21.15.154:0/756991780 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.953+0000 7f2bcffff700 1 --2- 172.21.15.154:0/756991780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a0a30 0x7f2bd00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.954+0000 7f2bcf7fe700 1 -- 172.21.15.154:0/756991780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a0a30 msgr2=0x7f2bd00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.954+0000 7f2bcf7fe700 1 --2- 172.21.15.154:0/756991780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a0a30 0x7f2bd00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.954+0000 7f2bcf7fe700 1 -- 172.21.15.154:0/756991780 >> v1:172.21.15.154:6789/0 conn(0x7f2bd01304a0 legacy=0x7f2bd01371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.954+0000 7f2bcf7fe700 1 -- 172.21.15.154:0/756991780 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd009abc0 con 0x7f2bd00a1340 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.954+0000 7f2bcffff700 1 --2- 172.21.15.154:0/756991780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a0a30 0x7f2bd00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.954+0000 7f2bcf7fe700 1 --2- 172.21.15.154:0/756991780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a1340 0x7f2bd012ff60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40098f0 tx=0x7f2bc4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4a22b1b12f7e2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.954+0000 7f2bceffd700 1 -- 172.21.15.154:0/756991780 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4011830 con 0x7f2bd00a1340 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.954+0000 7f2bceffd700 1 -- 172.21.15.154:0/756991780 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc4011990 con 0x7f2bd00a1340 2023-09-30T22:22:47.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.954+0000 7f2bceffd700 1 -- 172.21.15.154:0/756991780 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4011d20 con 0x7f2bd00a1340 2023-09-30T22:22:47.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.955+0000 7f2bd66e6700 1 -- 172.21.15.154:0/756991780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a1340 msgr2=0x7f2bd012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.955+0000 7f2bd66e6700 1 --2- 172.21.15.154:0/756991780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a1340 0x7f2bd012ff60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40098f0 tx=0x7f2bc4009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.955+0000 7f2bd66e6700 1 -- 172.21.15.154:0/756991780 shutdown_connections 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.955+0000 7f2bd66e6700 1 --2- 172.21.15.154:0/756991780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a0a30 0x7f2bd00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.955+0000 7f2bd66e6700 1 --2- 172.21.15.154:0/756991780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a1340 0x7f2bd012ff60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.955+0000 7f2bd66e6700 1 -- 172.21.15.154:0/756991780 >> 172.21.15.154:0/756991780 conn(0x7f2bd00a2980 msgr2=0x7f2bd00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.955+0000 7f2bd66e6700 1 -- 172.21.15.154:0/756991780 shutdown_connections 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.955+0000 7f2bd66e6700 1 -- 172.21.15.154:0/756991780 wait complete. 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.956+0000 7f2bd66e6700 1 Processor -- start 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.956+0000 7f2bd66e6700 1 -- start start 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bd66e6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a0a30 0x7f2bd01c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bd66e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a1340 0x7f2bd01c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bd66e6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bd01304a0 0x7f2bd01c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bd66e6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd011ce30 con 0x7f2bd00a0a30 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bd66e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd011cc40 con 0x7f2bd00a1340 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bd66e6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd011d510 con 0x7f2bd01304a0 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a0a30 0x7f2bd01c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a0a30 0x7f2bd01c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47552/0 (socket says 172.21.15.154:47552) 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcffff700 1 -- 172.21.15.154:0/3673237248 learned_addr learned my addr 172.21.15.154:0/3673237248 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bd4c83700 1 --2- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bd01304a0 0x7f2bd01c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcf7fe700 1 --2- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a1340 0x7f2bd01c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcffff700 1 -- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bd01304a0 msgr2=0x7f2bd01c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcffff700 1 --2- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bd01304a0 0x7f2bd01c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcffff700 1 -- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a1340 msgr2=0x7f2bd01c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcffff700 1 --2- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a1340 0x7f2bd01c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcffff700 1 -- 172.21.15.154:0/3673237248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0009430 con 0x7f2bd00a0a30 2023-09-30T22:22:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.957+0000 7f2bcffff700 1 --2- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a0a30 0x7f2bd01c6080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000ebe0 tx=0x7f2bc000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.958+0000 7f2bccff9700 1 -- 172.21.15.154:0/3673237248 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0005a20 con 0x7f2bd00a0a30 2023-09-30T22:22:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.958+0000 7f2bccff9700 1 -- 172.21.15.154:0/3673237248 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc0005b80 con 0x7f2bd00a0a30 2023-09-30T22:22:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.958+0000 7f2bd66e6700 1 -- 172.21.15.154:0/3673237248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc4009550 con 0x7f2bd00a0a30 2023-09-30T22:22:47.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.958+0000 7f2bd66e6700 1 -- 172.21.15.154:0/3673237248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd009ae00 con 0x7f2bd00a0a30 2023-09-30T22:22:47.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.959+0000 7f2bccff9700 1 -- 172.21.15.154:0/3673237248 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc000c850 con 0x7f2bd00a0a30 2023-09-30T22:22:47.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.959+0000 7f2bccff9700 1 -- 172.21.15.154:0/3673237248 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bc000ca30 con 0x7f2bd00a0a30 2023-09-30T22:22:47.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.959+0000 7f2bccff9700 1 -- 172.21.15.154:0/3673237248 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2bc003fa90 con 0x7f2bd00a0a30 2023-09-30T22:22:47.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.960+0000 7f2bd66e6700 1 -- 172.21.15.154:0/3673237248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd004f2a0 con 0x7f2bd00a0a30 2023-09-30T22:22:47.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.964+0000 7f2bccff9700 1 -- 172.21.15.154:0/3673237248 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bc0020080 con 0x7f2bd00a0a30 2023-09-30T22:22:47.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.976+0000 7f3b919af700 1 Processor -- start 2023-09-30T22:22:47.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.976+0000 7f3b919af700 1 -- start start 2023-09-30T22:22:47.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.976+0000 7f3b919af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133ad0 0x7f3b8c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.976+0000 7f3b919af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c130bc0 0x7f3b8c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.976+0000 7f3b919af700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8c06b2d0 con 0x7f3b8c1300a0 2023-09-30T22:22:47.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.976+0000 7f3b919af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c133610 con 0x7f3b8c130bc0 2023-09-30T22:22:47.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.976+0000 7f3b919af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c09a500 con 0x7f3b8c133ad0 2023-09-30T22:22:47.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b8a7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3b8c1300a0 0x7f3b8c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41166/0 (socket says 172.21.15.154:41166) 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b8affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133ad0 0x7f3b8c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b8a7fc700 1 -- 172.21.15.154:0/630266058 learned_addr learned my addr 172.21.15.154:0/630266058 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b89ffb700 1 -- 172.21.15.154:0/630266058 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348121456 0 0) 0x7f3b8c06b2d0 con 0x7f3b8c1300a0 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b89ffb700 1 -- 172.21.15.154:0/630266058 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b740035b0 con 0x7f3b8c1300a0 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b8affd700 1 -- 172.21.15.154:0/630266058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c130bc0 msgr2=0x7f3b8c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b8affd700 1 --2- 172.21.15.154:0/630266058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c130bc0 0x7f3b8c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b8affd700 1 -- 172.21.15.154:0/630266058 >> v1:172.21.15.154:6789/0 conn(0x7f3b8c1300a0 legacy=0x7f3b8c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b8affd700 1 -- 172.21.15.154:0/630266058 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c1338b0 con 0x7f3b8c133ad0 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b8affd700 1 --2- 172.21.15.154:0/630266058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133ad0 0x7f3b8c133ea0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009870 tx=0x7f3b7c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b87fb46a2e3f70ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b89ffb700 1 -- 172.21.15.154:0/630266058 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c011830 con 0x7f3b8c133ad0 2023-09-30T22:22:47.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b89ffb700 1 -- 172.21.15.154:0/630266058 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c011990 con 0x7f3b8c133ad0 2023-09-30T22:22:47.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.977+0000 7f3b89ffb700 1 -- 172.21.15.154:0/630266058 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c011d20 con 0x7f3b8c133ad0 2023-09-30T22:22:47.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.978+0000 7f3b919af700 1 -- 172.21.15.154:0/630266058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133ad0 msgr2=0x7f3b8c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.978+0000 7f3b919af700 1 --2- 172.21.15.154:0/630266058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133ad0 0x7f3b8c133ea0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009870 tx=0x7f3b7c009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:47.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.978+0000 7f3b919af700 1 -- 172.21.15.154:0/630266058 shutdown_connections 2023-09-30T22:22:47.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.978+0000 7f3b919af700 1 --2- 172.21.15.154:0/630266058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c130bc0 0x7f3b8c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.978+0000 7f3b919af700 1 --2- 172.21.15.154:0/630266058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133ad0 0x7f3b8c133ea0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.978+0000 7f3b919af700 1 -- 172.21.15.154:0/630266058 >> 172.21.15.154:0/630266058 conn(0x7f3b8c099c40 msgr2=0x7f3b8c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:47.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.978+0000 7f3b919af700 1 -- 172.21.15.154:0/630266058 shutdown_connections 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.978+0000 7f3b919af700 1 -- 172.21.15.154:0/630266058 wait complete. 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.979+0000 7f3b919af700 1 Processor -- start 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.979+0000 7f3b919af700 1 -- start start 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b919af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c1300a0 0x7f3b8c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b919af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c130bc0 0x7f3b8c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b919af700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133ad0 0x7f3b8c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b919af700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c11f9e0 con 0x7f3b8c133ad0 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b919af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c072300 con 0x7f3b8c1300a0 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b919af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c120c50 con 0x7f3b8c130bc0 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c130bc0 0x7f3b8c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c130bc0 0x7f3b8c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43426/0 (socket says 172.21.15.154:43426) 2023-09-30T22:22:47.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8a7fc700 1 -- 172.21.15.154:0/2770364657 learned_addr learned my addr 172.21.15.154:0/2770364657 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8b7fe700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133ad0 0x7f3b8c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8affd700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c1300a0 0x7f3b8c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8a7fc700 1 -- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c1300a0 msgr2=0x7f3b8c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8a7fc700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c1300a0 0x7f3b8c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8a7fc700 1 -- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133ad0 msgr2=0x7f3b8c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8a7fc700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133ad0 0x7f3b8c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8a7fc700 1 -- 172.21.15.154:0/2770364657 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0094a0 con 0x7f3b8c130bc0 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8b7fe700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133ad0 0x7f3b8c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.980+0000 7f3b8a7fc700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c130bc0 0x7f3b8c11df80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b80001eb0 tx=0x7f3b8000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.981+0000 7f3b73fff700 1 -- 172.21.15.154:0/2770364657 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80005d70 con 0x7f3b8c130bc0 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.981+0000 7f3b73fff700 1 -- 172.21.15.154:0/2770364657 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000ce70 con 0x7f3b8c130bc0 2023-09-30T22:22:47.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.981+0000 7f3b73fff700 1 -- 172.21.15.154:0/2770364657 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800072d0 con 0x7f3b8c130bc0 2023-09-30T22:22:47.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.981+0000 7f3b919af700 1 -- 172.21.15.154:0/2770364657 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c120340 con 0x7f3b8c130bc0 2023-09-30T22:22:47.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.981+0000 7f3b919af700 1 -- 172.21.15.154:0/2770364657 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c12dd00 con 0x7f3b8c130bc0 2023-09-30T22:22:47.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.981+0000 7f3b73fff700 1 -- 172.21.15.154:0/2770364657 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b80007430 con 0x7f3b8c130bc0 2023-09-30T22:22:47.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.982+0000 7f3b73fff700 1 -- 172.21.15.154:0/2770364657 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b8003eb80 con 0x7f3b8c130bc0 2023-09-30T22:22:47.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.982+0000 7f3b919af700 1 -- 172.21.15.154:0/2770364657 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8c04f2a0 con 0x7f3b8c130bc0 2023-09-30T22:22:47.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.984+0000 7f81bb4e1700 1 Processor -- start 2023-09-30T22:22:47.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.984+0000 7f81bb4e1700 1 -- start start 2023-09-30T22:22:47.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81bb4e1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b40a0a30 0x7f81b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81bb4e1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81b40a1340 0x7f81b412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81bb4e1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b40a1e70 con 0x7f81b41304a0 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81bb4e1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b409a720 con 0x7f81b40a1340 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81bb4e1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b409b300 con 0x7f81b40a0a30 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81b8a7c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81b40a1340 0x7f81b412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81b8a7c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81b40a1340 0x7f81b412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47570/0 (socket says 172.21.15.154:47570) 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81b8a7c700 1 -- 172.21.15.154:0/3683055954 learned_addr learned my addr 172.21.15.154:0/3683055954 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81b927d700 1 --2- 172.21.15.154:0/3683055954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b40a0a30 0x7f81b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81b8a7c700 1 -- 172.21.15.154:0/3683055954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b40a0a30 msgr2=0x7f81b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81b8a7c700 1 --2- 172.21.15.154:0/3683055954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b40a0a30 0x7f81b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81b8a7c700 1 -- 172.21.15.154:0/3683055954 >> v1:172.21.15.154:6789/0 conn(0x7f81b41304a0 legacy=0x7f81b41371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.985+0000 7f81b8a7c700 1 -- 172.21.15.154:0/3683055954 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b409abc0 con 0x7f81b40a1340 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81b8a7c700 1 --2- 172.21.15.154:0/3683055954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 0x7f81b412ff60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f81a400bb90 tx=0x7f81a400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d89f238c0fadd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81abfff700 1 -- 172.21.15.154:0/3683055954 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a400dc20 con 0x7f81b40a1340 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81abfff700 1 -- 172.21.15.154:0/3683055954 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a400dd80 con 0x7f81b40a1340 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81abfff700 1 -- 172.21.15.154:0/3683055954 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4017630 con 0x7f81b40a1340 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81bb4e1700 1 -- 172.21.15.154:0/3683055954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 msgr2=0x7f81b412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81bb4e1700 1 --2- 172.21.15.154:0/3683055954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 0x7f81b412ff60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f81a400bb90 tx=0x7f81a400bea0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81bb4e1700 1 -- 172.21.15.154:0/3683055954 shutdown_connections 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81bb4e1700 1 --2- 172.21.15.154:0/3683055954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b40a0a30 0x7f81b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81bb4e1700 1 --2- 172.21.15.154:0/3683055954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 0x7f81b412ff60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.986+0000 7f81bb4e1700 1 -- 172.21.15.154:0/3683055954 >> 172.21.15.154:0/3683055954 conn(0x7f81b40a2980 msgr2=0x7f81b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:47.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.987+0000 7f81bb4e1700 1 -- 172.21.15.154:0/3683055954 shutdown_connections 2023-09-30T22:22:47.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.987+0000 7f81bb4e1700 1 -- 172.21.15.154:0/3683055954 wait complete. 2023-09-30T22:22:47.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.987+0000 7f3b73fff700 1 -- 172.21.15.154:0/2770364657 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b80017020 con 0x7f3b8c130bc0 2023-09-30T22:22:47.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.987+0000 7f81bb4e1700 1 Processor -- start 2023-09-30T22:22:47.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81bb4e1700 1 -- start start 2023-09-30T22:22:47.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81bb4e1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b40a0a30 0x7f81b411d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81bb4e1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 0x7f81b411ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81bb4e1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b41304a0 0x7f81b411e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81bb4e1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b412cbd0 con 0x7f81b40a1340 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81bb4e1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b4120da0 con 0x7f81b41304a0 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81bb4e1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b411fc90 con 0x7f81b40a0a30 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81b927d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b40a0a30 0x7f81b411d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81b927d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b40a0a30 0x7f81b411d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43430/0 (socket says 172.21.15.154:43430) 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81b927d700 1 -- 172.21.15.154:0/1492115291 learned_addr learned my addr 172.21.15.154:0/1492115291 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81b8a7c700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 0x7f81b411ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81b9a7e700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b41304a0 0x7f81b411e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:47.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81b927d700 1 -- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b41304a0 msgr2=0x7f81b411e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81b927d700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b41304a0 0x7f81b411e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81b927d700 1 -- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 msgr2=0x7f81b411ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.988+0000 7f81b927d700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 0x7f81b411ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.989+0000 7f81b927d700 1 -- 172.21.15.154:0/1492115291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a400b7f0 con 0x7f81b40a0a30 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.989+0000 7f81b8a7c700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 0x7f81b411ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.989+0000 7f81b9a7e700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b41304a0 0x7f81b411e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.989+0000 7f81b927d700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b40a0a30 0x7f81b411d870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f81b000e990 tx=0x7f81b000ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.989+0000 7f81a9ffb700 1 -- 172.21.15.154:0/1492115291 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b00096f0 con 0x7f81b40a0a30 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.989+0000 7f81a9ffb700 1 -- 172.21.15.154:0/1492115291 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000c850 con 0x7f81b40a0a30 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.989+0000 7f81a9ffb700 1 -- 172.21.15.154:0/1492115291 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000cbc0 con 0x7f81b40a0a30 2023-09-30T22:22:47.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.989+0000 7f81bb4e1700 1 -- 172.21.15.154:0/1492115291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b4121060 con 0x7f81b40a0a30 2023-09-30T22:22:47.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.989+0000 7f81bb4e1700 1 -- 172.21.15.154:0/1492115291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b409ae00 con 0x7f81b40a0a30 2023-09-30T22:22:47.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.990+0000 7f81a9ffb700 1 -- 172.21.15.154:0/1492115291 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81b000cd20 con 0x7f81b40a0a30 2023-09-30T22:22:47.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.990+0000 7f81a9ffb700 1 -- 172.21.15.154:0/1492115291 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81b003fb90 con 0x7f81b40a0a30 2023-09-30T22:22:47.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.990+0000 7f81bb4e1700 1 -- 172.21.15.154:0/1492115291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b404f2a0 con 0x7f81b40a0a30 2023-09-30T22:22:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:47.999+0000 7f81a9ffb700 1 -- 172.21.15.154:0/1492115291 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81b0017020 con 0x7f81b40a0a30 2023-09-30T22:22:48.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.086+0000 7f30d4ff9700 1 -- 172.21.15.154:0/196647469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f30c0005590 con 0x7f30e809f350 2023-09-30T22:22:48.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.087+0000 7f30d6ffd700 1 -- 172.21.15.154:0/196647469 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30dc02f3a0 con 0x7f30e809f350 2023-09-30T22:22:48.088 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:48.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.089+0000 7f30d4ff9700 1 -- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e809f350 msgr2=0x7f30e8120d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.089+0000 7f30d4ff9700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e809f350 0x7f30e8120d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009840 tx=0x7f30dc004750 comp rx=0 tx=0).stop 2023-09-30T22:22:48.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.089+0000 7f30d4ff9700 1 -- 172.21.15.154:0/196647469 shutdown_connections 2023-09-30T22:22:48.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.089+0000 7f30d4ff9700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e81371c0 0x7f30e81212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.089+0000 7f30d4ff9700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30e809e870 0x7f30e8120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.089+0000 7f30d4ff9700 1 --2- 172.21.15.154:0/196647469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30e809f350 0x7f30e8120d80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.089+0000 7f30d4ff9700 1 -- 172.21.15.154:0/196647469 >> 172.21.15.154:0/196647469 conn(0x7f30e80a4430 msgr2=0x7f30e809c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.089+0000 7f30d4ff9700 1 -- 172.21.15.154:0/196647469 shutdown_connections 2023-09-30T22:22:48.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.089+0000 7f30d4ff9700 1 -- 172.21.15.154:0/196647469 wait complete. 2023-09-30T22:22:48.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:48.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.188+0000 7f3b919af700 1 -- 172.21.15.154:0/2770364657 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b8c130760 con 0x7f3b8c130bc0 2023-09-30T22:22:48.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.189+0000 7f3b73fff700 1 -- 172.21.15.154:0/2770364657 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b80019730 con 0x7f3b8c130bc0 2023-09-30T22:22:48.190 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:48.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.191+0000 7f3b919af700 1 -- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c130bc0 msgr2=0x7f3b8c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.191+0000 7f3b919af700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c130bc0 0x7f3b8c11df80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b80001eb0 tx=0x7f3b8000c7b0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.191+0000 7f3b919af700 1 -- 172.21.15.154:0/2770364657 shutdown_connections 2023-09-30T22:22:48.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.191+0000 7f3b919af700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133ad0 0x7f3b8c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.191+0000 7f3b919af700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c1300a0 0x7f3b8c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.191+0000 7f3b919af700 1 --2- 172.21.15.154:0/2770364657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c130bc0 0x7f3b8c11df80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.191+0000 7f3b919af700 1 -- 172.21.15.154:0/2770364657 >> 172.21.15.154:0/2770364657 conn(0x7f3b8c099c40 msgr2=0x7f3b8c12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.191+0000 7f3b919af700 1 -- 172.21.15.154:0/2770364657 shutdown_connections 2023-09-30T22:22:48.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.191+0000 7f3b919af700 1 -- 172.21.15.154:0/2770364657 wait complete. 2023-09-30T22:22:48.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.196+0000 7f81bb4e1700 1 -- 172.21.15.154:0/1492115291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f81b406bce0 con 0x7f81b40a0a30 2023-09-30T22:22:48.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.196+0000 7f81a9ffb700 1 -- 172.21.15.154:0/1492115291 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81b002b090 con 0x7f81b40a0a30 2023-09-30T22:22:48.197 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:48.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f2bd66e6700 1 -- 172.21.15.154:0/3673237248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2bd006bce0 con 0x7f2bd00a0a30 2023-09-30T22:22:48.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f81bb4e1700 1 -- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b40a0a30 msgr2=0x7f81b411d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f81bb4e1700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b40a0a30 0x7f81b411d870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f81b000e990 tx=0x7f81b000ed50 comp rx=0 tx=0).stop 2023-09-30T22:22:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f81bb4e1700 1 -- 172.21.15.154:0/1492115291 shutdown_connections 2023-09-30T22:22:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f81bb4e1700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b41304a0 0x7f81b411e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f81bb4e1700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b40a0a30 0x7f81b411d870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f81bb4e1700 1 --2- 172.21.15.154:0/1492115291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b40a1340 0x7f81b411ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f81bb4e1700 1 -- 172.21.15.154:0/1492115291 >> 172.21.15.154:0/1492115291 conn(0x7f81b40a2980 msgr2=0x7f81b412e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f2bccff9700 1 -- 172.21.15.154:0/3673237248 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bc0022300 con 0x7f2bd00a0a30 2023-09-30T22:22:48.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.200+0000 7f81bb4e1700 1 -- 172.21.15.154:0/1492115291 shutdown_connections 2023-09-30T22:22:48.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.201+0000 7f81bb4e1700 1 -- 172.21.15.154:0/1492115291 wait complete. 2023-09-30T22:22:48.203 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:48.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.203+0000 7f2bd66e6700 1 -- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a0a30 msgr2=0x7f2bd01c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:48.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.203+0000 7f2bd66e6700 1 --2- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a0a30 0x7f2bd01c6080 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000ebe0 tx=0x7f2bc000eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.203+0000 7f2bd66e6700 1 -- 172.21.15.154:0/3673237248 shutdown_connections 2023-09-30T22:22:48.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.203+0000 7f2bd66e6700 1 --2- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bd01304a0 0x7f2bd01c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.203+0000 7f2bd66e6700 1 --2- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd00a0a30 0x7f2bd01c6080 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.203+0000 7f2bd66e6700 1 --2- 172.21.15.154:0/3673237248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bd00a1340 0x7f2bd01c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:48.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.203+0000 7f2bd66e6700 1 -- 172.21.15.154:0/3673237248 >> 172.21.15.154:0/3673237248 conn(0x7f2bd00a2980 msgr2=0x7f2bd01b9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:48.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.203+0000 7f2bd66e6700 1 -- 172.21.15.154:0/3673237248 shutdown_connections 2023-09-30T22:22:48.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:48.203+0000 7f2bd66e6700 1 -- 172.21.15.154:0/3673237248 wait complete. 2023-09-30T22:22:48.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:48.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:48.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:49.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:49.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:49.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:49.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.240+0000 7f621c40b700 1 Processor -- start 2023-09-30T22:22:49.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.240+0000 7f621c40b700 1 -- start start 2023-09-30T22:22:49.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621c40b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f621406a770 0x7f621406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621c40b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f621409dec0 0x7f621406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621c40b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6214131a00 0x7f6214131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621c40b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621406b5c0 con 0x7f621409dec0 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621c40b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621406e900 con 0x7f6214131a00 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621c40b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f621409d180 con 0x7f621406a770 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f62199a6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f621409dec0 0x7f621406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621a1a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f621406a770 0x7f621406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621a9a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6214131a00 0x7f6214131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621a1a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f621406a770 0x7f621406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43434/0 (socket says 172.21.15.154:43434) 2023-09-30T22:22:49.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f62199a6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f621409dec0 0x7f621406b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47586/0 (socket says 172.21.15.154:47586) 2023-09-30T22:22:49.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621a1a7700 1 -- 172.21.15.154:0/3819330798 learned_addr learned my addr 172.21.15.154:0/3819330798 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:49.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f62199a6700 1 -- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f621406a770 msgr2=0x7f621406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f62199a6700 1 --2- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f621406a770 0x7f621406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f62199a6700 1 -- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6214131a00 msgr2=0x7f6214131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f62199a6700 1 --2- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6214131a00 0x7f6214131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f62199a6700 1 -- 172.21.15.154:0/3819330798 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621409e780 con 0x7f621409dec0 2023-09-30T22:22:49.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621a9a8700 1 --2- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6214131a00 0x7f6214131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:49.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.241+0000 7f621a1a7700 1 --2- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f621406a770 0x7f621406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.242+0000 7f62199a6700 1 --2- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 0x7f621406b080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6204009840 tx=0x7f6204009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32d7ff913a62df5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.242+0000 7f62191a5700 1 -- 172.21.15.154:0/3819330798 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204011830 con 0x7f621409dec0 2023-09-30T22:22:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.242+0000 7f62191a5700 1 -- 172.21.15.154:0/3819330798 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6204011990 con 0x7f621409dec0 2023-09-30T22:22:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.242+0000 7f62191a5700 1 -- 172.21.15.154:0/3819330798 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204011d20 con 0x7f621409dec0 2023-09-30T22:22:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.242+0000 7f621c40b700 1 -- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 msgr2=0x7f621406b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.242+0000 7f621c40b700 1 --2- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 0x7f621406b080 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6204009840 tx=0x7f6204009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.242+0000 7f621c40b700 1 -- 172.21.15.154:0/3819330798 shutdown_connections 2023-09-30T22:22:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.242+0000 7f621c40b700 1 --2- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6214131a00 0x7f6214131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.242+0000 7f621c40b700 1 --2- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f621406a770 0x7f621406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.243+0000 7f621c40b700 1 --2- 172.21.15.154:0/3819330798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 0x7f621406b080 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.243+0000 7f621c40b700 1 -- 172.21.15.154:0/3819330798 >> 172.21.15.154:0/3819330798 conn(0x7f6214099c40 msgr2=0x7f62140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.243+0000 7f621c40b700 1 -- 172.21.15.154:0/3819330798 shutdown_connections 2023-09-30T22:22:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.243+0000 7f621c40b700 1 -- 172.21.15.154:0/3819330798 wait complete. 2023-09-30T22:22:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.244+0000 7f621c40b700 1 Processor -- start 2023-09-30T22:22:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.244+0000 7f621c40b700 1 -- start start 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f621c40b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621406a770 0x7f621411a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f621c40b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 0x7f621411a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f621c40b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6214131a00 0x7f621411ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f621c40b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6214071ce0 con 0x7f621409dec0 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f621c40b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621411c440 con 0x7f621406a770 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f621c40b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6214130ec0 con 0x7f6214131a00 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f62199a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 0x7f621411a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f62199a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 0x7f621411a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47592/0 (socket says 172.21.15.154:47592) 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f62199a6700 1 -- 172.21.15.154:0/1895383630 learned_addr learned my addr 172.21.15.154:0/1895383630 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f621a9a8700 1 --2- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6214131a00 0x7f621411ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f62199a6700 1 -- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6214131a00 msgr2=0x7f621411ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f621a1a7700 1 --2- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621406a770 0x7f621411a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f62199a6700 1 --2- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6214131a00 0x7f621411ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f62199a6700 1 -- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621406a770 msgr2=0x7f621411a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f62199a6700 1 --2- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621406a770 0x7f621411a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.245+0000 7f62199a6700 1 -- 172.21.15.154:0/1895383630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210009550 con 0x7f621409dec0 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.246+0000 7f62199a6700 1 --2- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 0x7f621411a7c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f62040090b0 tx=0x7f6204004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.246+0000 7f620affd700 1 -- 172.21.15.154:0/1895383630 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62040044d0 con 0x7f621409dec0 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.246+0000 7f620affd700 1 -- 172.21.15.154:0/1895383630 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6204023070 con 0x7f621409dec0 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.246+0000 7f621c40b700 1 -- 172.21.15.154:0/1895383630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620c009a70 con 0x7f621409dec0 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.246+0000 7f620affd700 1 -- 172.21.15.154:0/1895383630 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620401fa80 con 0x7f621409dec0 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.246+0000 7f621c40b700 1 -- 172.21.15.154:0/1895383630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62040094a0 con 0x7f621409dec0 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.247+0000 7f620affd700 1 -- 172.21.15.154:0/1895383630 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f620401fbe0 con 0x7f621409dec0 2023-09-30T22:22:49.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.247+0000 7f620affd700 1 -- 172.21.15.154:0/1895383630 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6204025070 con 0x7f621409dec0 2023-09-30T22:22:49.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.247+0000 7f621c40b700 1 -- 172.21.15.154:0/1895383630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621411d710 con 0x7f621409dec0 2023-09-30T22:22:49.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.254+0000 7f620affd700 1 -- 172.21.15.154:0/1895383630 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62040293e0 con 0x7f621409dec0 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.341+0000 7f417a5d3700 1 Processor -- start 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.341+0000 7f417a5d3700 1 -- start start 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f417a5d3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4174134140 0x7f4174138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f417a5d3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41741345a0 0x7f417413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f417a5d3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417409b110 con 0x7f417409ad40 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f417a5d3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41740a3b60 con 0x7f4174134140 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f417a5d3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41740a1a80 con 0x7f41741345a0 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f41737fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4174134140 0x7f4174138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f41737fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4174134140 0x7f4174138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47594/0 (socket says 172.21.15.154:47594) 2023-09-30T22:22:49.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f41737fe700 1 -- 172.21.15.154:0/3140991595 learned_addr learned my addr 172.21.15.154:0/3140991595 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f4178b70700 1 --2- 172.21.15.154:0/3140991595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41741345a0 0x7f417413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f41737fe700 1 -- 172.21.15.154:0/3140991595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41741345a0 msgr2=0x7f417413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f41737fe700 1 --2- 172.21.15.154:0/3140991595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41741345a0 0x7f417413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f41737fe700 1 -- 172.21.15.154:0/3140991595 >> v1:172.21.15.154:6789/0 conn(0x7f417409ad40 legacy=0x7f4174133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f41737fe700 1 -- 172.21.15.154:0/3140991595 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41740a2fa0 con 0x7f4174134140 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.342+0000 7f4178b70700 1 --2- 172.21.15.154:0/3140991595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41741345a0 0x7f417413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.343+0000 7f41737fe700 1 --2- 172.21.15.154:0/3140991595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4174134140 0x7f4174138e80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f41680098f0 tx=0x7f4168009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32cf0caca394741 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.343+0000 7f4172ffd700 1 -- 172.21.15.154:0/3140991595 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168004230 con 0x7f4174134140 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.343+0000 7f4172ffd700 1 -- 172.21.15.154:0/3140991595 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4168004390 con 0x7f4174134140 2023-09-30T22:22:49.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.343+0000 7f4172ffd700 1 -- 172.21.15.154:0/3140991595 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680036a0 con 0x7f4174134140 2023-09-30T22:22:49.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.344+0000 7f417a5d3700 1 -- 172.21.15.154:0/3140991595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4174134140 msgr2=0x7f4174138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.344+0000 7f417a5d3700 1 --2- 172.21.15.154:0/3140991595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4174134140 0x7f4174138e80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f41680098f0 tx=0x7f4168009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.344+0000 7f417a5d3700 1 -- 172.21.15.154:0/3140991595 shutdown_connections 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.344+0000 7f417a5d3700 1 --2- 172.21.15.154:0/3140991595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41741345a0 0x7f417413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.344+0000 7f417a5d3700 1 --2- 172.21.15.154:0/3140991595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4174134140 0x7f4174138e80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.344+0000 7f417a5d3700 1 -- 172.21.15.154:0/3140991595 >> 172.21.15.154:0/3140991595 conn(0x7f4174099c40 msgr2=0x7f417406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.344+0000 7f417a5d3700 1 -- 172.21.15.154:0/3140991595 shutdown_connections 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.344+0000 7f417a5d3700 1 -- 172.21.15.154:0/3140991595 wait complete. 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.345+0000 7f417a5d3700 1 Processor -- start 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.345+0000 7f417a5d3700 1 -- start start 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.345+0000 7f417a5d3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417409ad40 0x7f417411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.345+0000 7f417a5d3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4174134140 0x7f417411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.345+0000 7f417a5d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41741345a0 0x7f417411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.345+0000 7f417a5d3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417411f010 con 0x7f417409ad40 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.345+0000 7f417a5d3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417411e7e0 con 0x7f4174134140 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.345+0000 7f417a5d3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41740a4110 con 0x7f41741345a0 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f41737fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4174134140 0x7f417411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4178b70700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41741345a0 0x7f417411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4173fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417409ad40 0x7f417411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f41737fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4174134140 0x7f417411ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47740/0 (socket says 172.21.15.154:47740) 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4178b70700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41741345a0 0x7f417411d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43452/0 (socket says 172.21.15.154:43452) 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f41737fe700 1 -- 172.21.15.154:0/1596320616 learned_addr learned my addr 172.21.15.154:0/1596320616 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4173fff700 1 -- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41741345a0 msgr2=0x7f417411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4173fff700 1 --2- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41741345a0 0x7f417411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4173fff700 1 -- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4174134140 msgr2=0x7f417411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4173fff700 1 --2- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4174134140 0x7f417411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4173fff700 1 -- 172.21.15.154:0/1596320616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c009a70 con 0x7f417409ad40 2023-09-30T22:22:49.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4173fff700 1 --2- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417409ad40 0x7f417411c8c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f416400b3c0 tx=0x7f416400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4170ff9700 1 -- 172.21.15.154:0/1596320616 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164011620 con 0x7f417409ad40 2023-09-30T22:22:49.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f417a5d3700 1 -- 172.21.15.154:0/1596320616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4168009550 con 0x7f417409ad40 2023-09-30T22:22:49.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4170ff9700 1 -- 172.21.15.154:0/1596320616 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41640117c0 con 0x7f417409ad40 2023-09-30T22:22:49.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f4170ff9700 1 -- 172.21.15.154:0/1596320616 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164011b70 con 0x7f417409ad40 2023-09-30T22:22:49.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.346+0000 7f417a5d3700 1 -- 172.21.15.154:0/1596320616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417411ec90 con 0x7f417409ad40 2023-09-30T22:22:49.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.347+0000 7f4170ff9700 1 -- 172.21.15.154:0/1596320616 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4164011cd0 con 0x7f417409ad40 2023-09-30T22:22:49.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.347+0000 7f417a5d3700 1 -- 172.21.15.154:0/1596320616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41741361a0 con 0x7f417409ad40 2023-09-30T22:22:49.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.348+0000 7f4170ff9700 1 -- 172.21.15.154:0/1596320616 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f416403f4b0 con 0x7f417409ad40 2023-09-30T22:22:49.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.352+0000 7f4170ff9700 1 -- 172.21.15.154:0/1596320616 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f416400f2e0 con 0x7f417409ad40 2023-09-30T22:22:49.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.371+0000 7f5bad12c700 1 Processor -- start 2023-09-30T22:22:49.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.371+0000 7f5bad12c700 1 -- start start 2023-09-30T22:22:49.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5bad12c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba8133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5bad12c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ba8099a60 0x7f5ba80a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5bad12c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 0x7f5ba80a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5bad12c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba809aa00 con 0x7f5ba8099a60 2023-09-30T22:22:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5bad12c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba809a080 con 0x7f5ba80a0e20 2023-09-30T22:22:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5bad12c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8133750 con 0x7f5ba8133b80 2023-09-30T22:22:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5ba6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba8133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5ba6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba8133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43466/0 (socket says 172.21.15.154:43466) 2023-09-30T22:22:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5ba6d9d700 1 -- 172.21.15.154:0/2239058849 learned_addr learned my addr 172.21.15.154:0/2239058849 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:49.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5ba659c700 1 --2- 172.21.15.154:0/2239058849 >> v2:172.21.15.154:3300/0 conn(0x7f5ba8099a60 0x7f5ba80a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5ba759e700 1 --2- 172.21.15.154:0/2239058849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 0x7f5ba80a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.372+0000 7f5ba6d9d700 1 -- 172.21.15.154:0/2239058849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 msgr2=0x7f5ba80a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5ba6d9d700 1 --2- 172.21.15.154:0/2239058849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 0x7f5ba80a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5ba6d9d700 1 -- 172.21.15.154:0/2239058849 >> v2:172.21.15.154:3300/0 conn(0x7f5ba8099a60 msgr2=0x7f5ba80a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5ba6d9d700 1 --2- 172.21.15.154:0/2239058849 >> v2:172.21.15.154:3300/0 conn(0x7f5ba8099a60 0x7f5ba80a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5ba6d9d700 1 -- 172.21.15.154:0/2239058849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba809a760 con 0x7f5ba8133b80 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5ba659c700 1 --2- 172.21.15.154:0/2239058849 >> v2:172.21.15.154:3300/0 conn(0x7f5ba8099a60 0x7f5ba80a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5ba6d9d700 1 --2- 172.21.15.154:0/2239058849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba8133f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b98006fd0 tx=0x7f5b98009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aee65ba66f98d57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5ba5d9b700 1 -- 172.21.15.154:0/2239058849 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98005e30 con 0x7f5ba8133b80 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5ba5d9b700 1 -- 172.21.15.154:0/2239058849 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98004030 con 0x7f5ba8133b80 2023-09-30T22:22:49.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5ba5d9b700 1 -- 172.21.15.154:0/2239058849 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980043e0 con 0x7f5ba8133b80 2023-09-30T22:22:49.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5bad12c700 1 -- 172.21.15.154:0/2239058849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 msgr2=0x7f5ba8133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5bad12c700 1 --2- 172.21.15.154:0/2239058849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba8133f50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b98006fd0 tx=0x7f5b98009bd0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5bad12c700 1 -- 172.21.15.154:0/2239058849 shutdown_connections 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5bad12c700 1 --2- 172.21.15.154:0/2239058849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 0x7f5ba80a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5bad12c700 1 --2- 172.21.15.154:0/2239058849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba8133f50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.373+0000 7f5bad12c700 1 --2- 172.21.15.154:0/2239058849 >> v2:172.21.15.154:3300/0 conn(0x7f5ba8099a60 0x7f5ba80a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.374+0000 7f5bad12c700 1 -- 172.21.15.154:0/2239058849 >> 172.21.15.154:0/2239058849 conn(0x7f5ba80a2980 msgr2=0x7f5ba80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.374+0000 7f5bad12c700 1 -- 172.21.15.154:0/2239058849 shutdown_connections 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.374+0000 7f5bad12c700 1 -- 172.21.15.154:0/2239058849 wait complete. 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.375+0000 7f5bad12c700 1 Processor -- start 2023-09-30T22:22:49.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.375+0000 7f5bad12c700 1 -- start start 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.375+0000 7f5bad12c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8099a60 0x7f5ba811c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.375+0000 7f5bad12c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 0x7f5ba811cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.375+0000 7f5bad12c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba811d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.375+0000 7f5bad12c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba811e5f0 con 0x7f5ba8099a60 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.375+0000 7f5bad12c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8120160 con 0x7f5ba80a0e20 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.375+0000 7f5bad12c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8130bd0 con 0x7f5ba8133b80 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba759e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba811d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba759e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba811d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43476/0 (socket says 172.21.15.154:43476) 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba759e700 1 -- 172.21.15.154:0/1076049531 learned_addr learned my addr 172.21.15.154:0/1076049531 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba659c700 1 --2- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 0x7f5ba811cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba6d9d700 1 --2- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8099a60 0x7f5ba811c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba6d9d700 1 -- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 msgr2=0x7f5ba811d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba6d9d700 1 --2- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba811d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba6d9d700 1 -- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 msgr2=0x7f5ba811cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba6d9d700 1 --2- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 0x7f5ba811cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba6d9d700 1 -- 172.21.15.154:0/1076049531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98009500 con 0x7f5ba8099a60 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5ba6d9d700 1 --2- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8099a60 0x7f5ba811c9a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5b98013000 tx=0x7f5b98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.376+0000 7f5b8f7fe700 1 -- 172.21.15.154:0/1076049531 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98003ab0 con 0x7f5ba8099a60 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.377+0000 7f5b8f7fe700 1 -- 172.21.15.154:0/1076049531 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98003c30 con 0x7f5ba8099a60 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.377+0000 7f5bad12c700 1 -- 172.21.15.154:0/1076049531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba809a2c0 con 0x7f5ba8099a60 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.377+0000 7f5b8f7fe700 1 -- 172.21.15.154:0/1076049531 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980045d0 con 0x7f5ba8099a60 2023-09-30T22:22:49.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.377+0000 7f5bad12c700 1 -- 172.21.15.154:0/1076049531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba811ec70 con 0x7f5ba8099a60 2023-09-30T22:22:49.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.377+0000 7f5b8f7fe700 1 -- 172.21.15.154:0/1076049531 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b98006030 con 0x7f5ba8099a60 2023-09-30T22:22:49.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.377+0000 7f5b8f7fe700 1 -- 172.21.15.154:0/1076049531 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b980406b0 con 0x7f5ba8099a60 2023-09-30T22:22:49.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.378+0000 7f5bad12c700 1 -- 172.21.15.154:0/1076049531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba811f330 con 0x7f5ba8099a60 2023-09-30T22:22:49.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.385+0000 7f8879851700 1 Processor -- start 2023-09-30T22:22:49.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.385+0000 7f8879851700 1 -- start start 2023-09-30T22:22:49.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.385+0000 7f8879851700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a0a30 0x7f88740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.385+0000 7f8879851700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 0x7f88741381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.385+0000 7f8879851700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88740a1e70 con 0x7f88740a1340 2023-09-30T22:22:49.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.385+0000 7f8879851700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887409a720 con 0x7f8874130670 2023-09-30T22:22:49.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.385+0000 7f8879851700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f887409b300 con 0x7f88740a0a30 2023-09-30T22:22:49.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f8872ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a0a30 0x7f88740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f8872ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a0a30 0x7f88740a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43478/0 (socket says 172.21.15.154:43478) 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f8872ffd700 1 -- 172.21.15.154:0/1484426572 learned_addr learned my addr 172.21.15.154:0/1484426572 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f88737fe700 1 --2- 172.21.15.154:0/1484426572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 0x7f88741381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f88737fe700 1 -- 172.21.15.154:0/1484426572 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a0a30 msgr2=0x7f88740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f88737fe700 1 --2- 172.21.15.154:0/1484426572 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a0a30 0x7f88740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f88737fe700 1 -- 172.21.15.154:0/1484426572 >> v1:172.21.15.154:6789/0 conn(0x7f88740a1340 legacy=0x7f887412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f88737fe700 1 -- 172.21.15.154:0/1484426572 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887409abc0 con 0x7f8874130670 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f8872ffd700 1 --2- 172.21.15.154:0/1484426572 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a0a30 0x7f88740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f88737fe700 1 --2- 172.21.15.154:0/1484426572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 0x7f88741381c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f886c009dc0 tx=0x7f886c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7af8c9aedb5c601 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f8871ffb700 1 -- 172.21.15.154:0/1484426572 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c00e070 con 0x7f8874130670 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f8871ffb700 1 -- 172.21.15.154:0/1484426572 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c00bae0 con 0x7f8874130670 2023-09-30T22:22:49.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.386+0000 7f8871ffb700 1 -- 172.21.15.154:0/1484426572 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c00be90 con 0x7f8874130670 2023-09-30T22:22:49.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.387+0000 7f5b8f7fe700 1 -- 172.21.15.154:0/1076049531 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b98016020 con 0x7f5ba8099a60 2023-09-30T22:22:49.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.387+0000 7f8879851700 1 -- 172.21.15.154:0/1484426572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 msgr2=0x7f88741381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.387+0000 7f8879851700 1 --2- 172.21.15.154:0/1484426572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 0x7f88741381c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f886c009dc0 tx=0x7f886c00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:49.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.387+0000 7f8879851700 1 -- 172.21.15.154:0/1484426572 shutdown_connections 2023-09-30T22:22:49.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.387+0000 7f8879851700 1 --2- 172.21.15.154:0/1484426572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 0x7f88741381c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.387+0000 7f8879851700 1 --2- 172.21.15.154:0/1484426572 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a0a30 0x7f88740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.387+0000 7f8879851700 1 -- 172.21.15.154:0/1484426572 >> 172.21.15.154:0/1484426572 conn(0x7f88740a2980 msgr2=0x7f88740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.387+0000 7f8879851700 1 -- 172.21.15.154:0/1484426572 shutdown_connections 2023-09-30T22:22:49.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.387+0000 7f8879851700 1 -- 172.21.15.154:0/1484426572 wait complete. 2023-09-30T22:22:49.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.388+0000 7f8879851700 1 Processor -- start 2023-09-30T22:22:49.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.389+0000 7f8879851700 1 -- start start 2023-09-30T22:22:49.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.389+0000 7f8879851700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88740a0a30 0x7f887411ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.389+0000 7f8879851700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a1340 0x7f887411b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.389+0000 7f8879851700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 0x7f88741c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.389+0000 7f8879851700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887412eb40 con 0x7f88740a0a30 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.389+0000 7f8879851700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887411a7a0 con 0x7f8874130670 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.389+0000 7f8879851700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f887411b710 con 0x7f88740a1340 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8872ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88740a0a30 0x7f887411ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8872ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88740a0a30 0x7f887411ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47630/0 (socket says 172.21.15.154:47630) 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8872ffd700 1 -- 172.21.15.154:0/4126800940 learned_addr learned my addr 172.21.15.154:0/4126800940 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f88737fe700 1 --2- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 0x7f88741c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f88727fc700 1 --2- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a1340 0x7f887411b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:49.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8872ffd700 1 -- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a1340 msgr2=0x7f887411b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8872ffd700 1 --2- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a1340 0x7f887411b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8872ffd700 1 -- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 msgr2=0x7f88741c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8872ffd700 1 --2- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 0x7f88741c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8872ffd700 1 -- 172.21.15.154:0/4126800940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886400b7a0 con 0x7f88740a0a30 2023-09-30T22:22:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8872ffd700 1 --2- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88740a0a30 0x7f887411ac90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f886400dec0 tx=0x7f88640103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f885bfff700 1 -- 172.21.15.154:0/4126800940 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864012040 con 0x7f88740a0a30 2023-09-30T22:22:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.390+0000 7f8879851700 1 -- 172.21.15.154:0/4126800940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c009a70 con 0x7f88740a0a30 2023-09-30T22:22:49.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.391+0000 7f8879851700 1 -- 172.21.15.154:0/4126800940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887411c370 con 0x7f88740a0a30 2023-09-30T22:22:49.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.391+0000 7f885bfff700 1 -- 172.21.15.154:0/4126800940 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8864010e80 con 0x7f88740a0a30 2023-09-30T22:22:49.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.391+0000 7f885bfff700 1 -- 172.21.15.154:0/4126800940 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864004230 con 0x7f88740a0a30 2023-09-30T22:22:49.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.392+0000 7f885bfff700 1 -- 172.21.15.154:0/4126800940 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8864004390 con 0x7f88740a0a30 2023-09-30T22:22:49.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.392+0000 7f8879851700 1 -- 172.21.15.154:0/4126800940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88540052e0 con 0x7f88740a0a30 2023-09-30T22:22:49.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.392+0000 7f885bfff700 1 -- 172.21.15.154:0/4126800940 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8864041d30 con 0x7f88740a0a30 2023-09-30T22:22:49.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.401+0000 7f885bfff700 1 -- 172.21.15.154:0/4126800940 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8864015930 con 0x7f88740a0a30 2023-09-30T22:22:49.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.468+0000 7f621c40b700 1 -- 172.21.15.154:0/1895383630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f621412f5b0 con 0x7f621409dec0 2023-09-30T22:22:49.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.469+0000 7f620affd700 1 -- 172.21.15.154:0/1895383630 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6204015020 con 0x7f621409dec0 2023-09-30T22:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:49.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.472+0000 7f621c40b700 1 -- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 msgr2=0x7f621411a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.472+0000 7f621c40b700 1 --2- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 0x7f621411a7c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f62040090b0 tx=0x7f6204004750 comp rx=0 tx=0).stop 2023-09-30T22:22:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.472+0000 7f621c40b700 1 -- 172.21.15.154:0/1895383630 shutdown_connections 2023-09-30T22:22:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.472+0000 7f621c40b700 1 --2- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6214131a00 0x7f621411ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.472+0000 7f621c40b700 1 --2- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621406a770 0x7f621411a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.472+0000 7f621c40b700 1 --2- 172.21.15.154:0/1895383630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621409dec0 0x7f621411a7c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.472+0000 7f621c40b700 1 -- 172.21.15.154:0/1895383630 >> 172.21.15.154:0/1895383630 conn(0x7f6214099c40 msgr2=0x7f621412eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.472+0000 7f621c40b700 1 -- 172.21.15.154:0/1895383630 shutdown_connections 2023-09-30T22:22:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.472+0000 7f621c40b700 1 -- 172.21.15.154:0/1895383630 wait complete. 2023-09-30T22:22:49.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.562+0000 7f417a5d3700 1 -- 172.21.15.154:0/1596320616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f417404f2a0 con 0x7f417409ad40 2023-09-30T22:22:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.562+0000 7f4170ff9700 1 -- 172.21.15.154:0/1596320616 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4164021af0 con 0x7f417409ad40 2023-09-30T22:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.564+0000 7f417a5d3700 1 -- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417409ad40 msgr2=0x7f417411c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.564+0000 7f417a5d3700 1 --2- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417409ad40 0x7f417411c8c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f416400b3c0 tx=0x7f416400b6d0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.564+0000 7f417a5d3700 1 -- 172.21.15.154:0/1596320616 shutdown_connections 2023-09-30T22:22:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.564+0000 7f417a5d3700 1 --2- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41741345a0 0x7f417411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.564+0000 7f417a5d3700 1 --2- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417409ad40 0x7f417411c8c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.564+0000 7f417a5d3700 1 --2- 172.21.15.154:0/1596320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4174134140 0x7f417411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.564+0000 7f417a5d3700 1 -- 172.21.15.154:0/1596320616 >> 172.21.15.154:0/1596320616 conn(0x7f4174099c40 msgr2=0x7f417409b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.565+0000 7f417a5d3700 1 -- 172.21.15.154:0/1596320616 shutdown_connections 2023-09-30T22:22:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.565+0000 7f417a5d3700 1 -- 172.21.15.154:0/1596320616 wait complete. 2023-09-30T22:22:49.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:49.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.586+0000 7f5bad12c700 1 -- 172.21.15.154:0/1076049531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5ba804f2a0 con 0x7f5ba8099a60 2023-09-30T22:22:49.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.587+0000 7f5b8f7fe700 1 -- 172.21.15.154:0/1076049531 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b98033090 con 0x7f5ba8099a60 2023-09-30T22:22:49.588 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.589+0000 7f5bad12c700 1 -- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8099a60 msgr2=0x7f5ba811c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.589+0000 7f5bad12c700 1 --2- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8099a60 0x7f5ba811c9a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5b98013000 tx=0x7f5b98004750 comp rx=0 tx=0).stop 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.589+0000 7f5bad12c700 1 -- 172.21.15.154:0/1076049531 shutdown_connections 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.589+0000 7f5bad12c700 1 --2- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ba8133b80 0x7f5ba811d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.589+0000 7f5bad12c700 1 --2- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8099a60 0x7f5ba811c9a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.589+0000 7f5bad12c700 1 --2- 172.21.15.154:0/1076049531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80a0e20 0x7f5ba811cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.589+0000 7f5bad12c700 1 -- 172.21.15.154:0/1076049531 >> 172.21.15.154:0/1076049531 conn(0x7f5ba80a2980 msgr2=0x7f5ba81baf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.589+0000 7f5bad12c700 1 -- 172.21.15.154:0/1076049531 shutdown_connections 2023-09-30T22:22:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.589+0000 7f5bad12c700 1 -- 172.21.15.154:0/1076049531 wait complete. 2023-09-30T22:22:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.595+0000 7f8879851700 1 -- 172.21.15.154:0/4126800940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8854005590 con 0x7f88740a0a30 2023-09-30T22:22:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.595+0000 7f885bfff700 1 -- 172.21.15.154:0/4126800940 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8864017370 con 0x7f88740a0a30 2023-09-30T22:22:49.596 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.597+0000 7f8879851700 1 -- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88740a0a30 msgr2=0x7f887411ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.597+0000 7f8879851700 1 --2- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88740a0a30 0x7f887411ac90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f886400dec0 tx=0x7f88640103a0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.597+0000 7f8879851700 1 -- 172.21.15.154:0/4126800940 shutdown_connections 2023-09-30T22:22:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.597+0000 7f8879851700 1 --2- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8874130670 0x7f88741c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.597+0000 7f8879851700 1 --2- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88740a0a30 0x7f887411ac90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.597+0000 7f8879851700 1 --2- 172.21.15.154:0/4126800940 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88740a1340 0x7f887411b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.598+0000 7f8879851700 1 -- 172.21.15.154:0/4126800940 >> 172.21.15.154:0/4126800940 conn(0x7f88740a2980 msgr2=0x7f887412f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.598+0000 7f8879851700 1 -- 172.21.15.154:0/4126800940 shutdown_connections 2023-09-30T22:22:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:49.598+0000 7f8879851700 1 -- 172.21.15.154:0/4126800940 wait complete. 2023-09-30T22:22:49.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:49.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:50.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:50.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:50.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:50.612 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:50.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.627+0000 7f192ddfc700 1 Processor -- start 2023-09-30T22:22:50.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.627+0000 7f192ddfc700 1 -- start start 2023-09-30T22:22:50.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f192ddfc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f192806a770 0x7f192806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f192ddfc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 0x7f192806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f192ddfc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 0x7f1928131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f192ddfc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192806b5c0 con 0x7f192806a770 2023-09-30T22:22:50.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f192ddfc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192806e900 con 0x7f192809dec0 2023-09-30T22:22:50.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f192ddfc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f192809d180 con 0x7f1928131a00 2023-09-30T22:22:50.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f19277fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f192806a770 0x7f192806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f19277fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f192806a770 0x7f192806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47636/0 (socket says 172.21.15.154:47636) 2023-09-30T22:22:50.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f1926ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 0x7f192806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f19277fe700 1 -- 172.21.15.154:0/2990840566 learned_addr learned my addr 172.21.15.154:0/2990840566 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f1927fff700 1 --2- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 0x7f1928131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f19277fe700 1 -- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 msgr2=0x7f1928131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.628+0000 7f19277fe700 1 --2- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 0x7f1928131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.629+0000 7f19277fe700 1 -- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 msgr2=0x7f192806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.629+0000 7f19277fe700 1 --2- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 0x7f192806b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.629+0000 7f19277fe700 1 -- 172.21.15.154:0/2990840566 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192809e780 con 0x7f192806a770 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.629+0000 7f19277fe700 1 --2- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 0x7f192806ab40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f19180098f0 tx=0x7f1918009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514d9c44376751a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.629+0000 7f19267fc700 1 -- 172.21.15.154:0/2990840566 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918011830 con 0x7f192806a770 2023-09-30T22:22:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.629+0000 7f19267fc700 1 -- 172.21.15.154:0/2990840566 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1918011990 con 0x7f192806a770 2023-09-30T22:22:50.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.629+0000 7f19267fc700 1 -- 172.21.15.154:0/2990840566 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918011d20 con 0x7f192806a770 2023-09-30T22:22:50.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.630+0000 7f192ddfc700 1 -- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 msgr2=0x7f192806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.630+0000 7f192ddfc700 1 --2- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 0x7f192806ab40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f19180098f0 tx=0x7f1918009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.630+0000 7f192ddfc700 1 -- 172.21.15.154:0/2990840566 shutdown_connections 2023-09-30T22:22:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.630+0000 7f192ddfc700 1 --2- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 0x7f1928131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.630+0000 7f192ddfc700 1 --2- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 0x7f192806ab40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.630+0000 7f192ddfc700 1 --2- 172.21.15.154:0/2990840566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 0x7f192806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.630+0000 7f192ddfc700 1 -- 172.21.15.154:0/2990840566 >> 172.21.15.154:0/2990840566 conn(0x7f1928099c40 msgr2=0x7f19280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.630+0000 7f192ddfc700 1 -- 172.21.15.154:0/2990840566 shutdown_connections 2023-09-30T22:22:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.631+0000 7f192ddfc700 1 -- 172.21.15.154:0/2990840566 wait complete. 2023-09-30T22:22:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.632+0000 7f192ddfc700 1 Processor -- start 2023-09-30T22:22:50.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.632+0000 7f192ddfc700 1 -- start start 2023-09-30T22:22:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f192ddfc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 0x7f1928119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f192ddfc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 0x7f1928119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f192ddfc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 0x7f192811a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f192ddfc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192811c240 con 0x7f192806a770 2023-09-30T22:22:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f192ddfc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192811ab60 con 0x7f192809dec0 2023-09-30T22:22:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f192ddfc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f192811c6f0 con 0x7f1928131a00 2023-09-30T22:22:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f19277fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 0x7f1928119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f19277fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 0x7f1928119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47648/0 (socket says 172.21.15.154:47648) 2023-09-30T22:22:50.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f19277fe700 1 -- 172.21.15.154:0/4188349720 learned_addr learned my addr 172.21.15.154:0/4188349720 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f1926ffd700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 0x7f1928119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f1927fff700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 0x7f192811a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.633+0000 7f19277fe700 1 -- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 msgr2=0x7f192811a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f19277fe700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 0x7f192811a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f19277fe700 1 -- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 msgr2=0x7f1928119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f19277fe700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 0x7f1928119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f19277fe700 1 -- 172.21.15.154:0/4188349720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1918009550 con 0x7f192806a770 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f1926ffd700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 0x7f1928119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f19277fe700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 0x7f1928119630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1918000c00 tx=0x7f1918004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f190ffff700 1 -- 172.21.15.154:0/4188349720 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918004240 con 0x7f192806a770 2023-09-30T22:22:50.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f190ffff700 1 -- 172.21.15.154:0/4188349720 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191801f070 con 0x7f192806a770 2023-09-30T22:22:50.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f192ddfc700 1 -- 172.21.15.154:0/4188349720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1928130f90 con 0x7f192806a770 2023-09-30T22:22:50.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f190ffff700 1 -- 172.21.15.154:0/4188349720 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19180045e0 con 0x7f192806a770 2023-09-30T22:22:50.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.634+0000 7f192ddfc700 1 -- 172.21.15.154:0/4188349720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192811c9d0 con 0x7f192806a770 2023-09-30T22:22:50.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.635+0000 7f190ffff700 1 -- 172.21.15.154:0/4188349720 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1918021030 con 0x7f192806a770 2023-09-30T22:22:50.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.635+0000 7f190ffff700 1 -- 172.21.15.154:0/4188349720 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1918040840 con 0x7f192806a770 2023-09-30T22:22:50.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.635+0000 7f192ddfc700 1 -- 172.21.15.154:0/4188349720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19080052e0 con 0x7f192806a770 2023-09-30T22:22:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.641+0000 7f190ffff700 1 -- 172.21.15.154:0/4188349720 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19180093b0 con 0x7f192806a770 2023-09-30T22:22:50.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c81276700 1 Processor -- start 2023-09-30T22:22:50.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c81276700 1 -- start start 2023-09-30T22:22:50.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c81276700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c7c09d860 0x7f5c7c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c81276700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c130eb0 0x7f5c7c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c81276700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c09aaa0 con 0x7f5c7c09e170 2023-09-30T22:22:50.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c81276700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c09f870 con 0x7f5c7c09d860 2023-09-30T22:22:50.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c81276700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c09b360 con 0x7f5c7c130eb0 2023-09-30T22:22:50.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c7affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c7c09d860 0x7f5c7c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c7affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c7c09d860 0x7f5c7c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47662/0 (socket says 172.21.15.154:47662) 2023-09-30T22:22:50.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c7affd700 1 -- 172.21.15.154:0/121508553 learned_addr learned my addr 172.21.15.154:0/121508553 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:50.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.751+0000 7f5c7b7fe700 1 --2- 172.21.15.154:0/121508553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c130eb0 0x7f5c7c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f5c7affd700 1 -- 172.21.15.154:0/121508553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c130eb0 msgr2=0x7f5c7c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:50.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f5c7affd700 1 --2- 172.21.15.154:0/121508553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c130eb0 0x7f5c7c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f5c7affd700 1 -- 172.21.15.154:0/121508553 >> v1:172.21.15.154:6789/0 conn(0x7f5c7c09e170 legacy=0x7f5c7c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f5c7affd700 1 -- 172.21.15.154:0/121508553 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c09b620 con 0x7f5c7c09d860 2023-09-30T22:22:50.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f5c7affd700 1 --2- 172.21.15.154:0/121508553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c09d860 0x7f5c7c09dc30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00bb90 tx=0x7f5c6c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f7c2dc8458f499 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f305b471700 1 Processor -- start 2023-09-30T22:22:50.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f5c79ffb700 1 -- 172.21.15.154:0/121508553 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00dd30 con 0x7f5c7c09d860 2023-09-30T22:22:50.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f5c79ffb700 1 -- 172.21.15.154:0/121508553 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c00de90 con 0x7f5c7c09d860 2023-09-30T22:22:50.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f5c79ffb700 1 -- 172.21.15.154:0/121508553 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c010690 con 0x7f5c7c09d860 2023-09-30T22:22:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.752+0000 7f305b471700 1 -- start start 2023-09-30T22:22:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f305b471700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3054132dc0 0x7f30541351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f305b471700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30541356e0 0x7f3054137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f305b471700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305409b700 con 0x7f305412cb80 2023-09-30T22:22:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f305b471700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305409c350 con 0x7f3054132dc0 2023-09-30T22:22:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f305b471700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f305409abf0 con 0x7f30541356e0 2023-09-30T22:22:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f305920d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f305412cb80 0x7f305412cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41210/0 (socket says 172.21.15.154:41210) 2023-09-30T22:22:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f305920d700 1 -- 172.21.15.154:0/2687679018 learned_addr learned my addr 172.21.15.154:0/2687679018 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:50.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f3059a0e700 1 --2- 172.21.15.154:0/2687679018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30541356e0 0x7f3054137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f5c81276700 1 -- 172.21.15.154:0/121508553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c09d860 msgr2=0x7f5c7c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f5c81276700 1 --2- 172.21.15.154:0/121508553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c09d860 0x7f5c7c09dc30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00bb90 tx=0x7f5c6c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f3059a0e700 1 -- 172.21.15.154:0/2687679018 >> v2:172.21.15.154:3300/0 conn(0x7f3054132dc0 msgr2=0x7f30541351a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:22:50.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f3059a0e700 1 --2- 172.21.15.154:0/2687679018 >> v2:172.21.15.154:3300/0 conn(0x7f3054132dc0 0x7f30541351a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f3059a0e700 1 -- 172.21.15.154:0/2687679018 >> v1:172.21.15.154:6789/0 conn(0x7f305412cb80 legacy=0x7f305412cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f3059a0e700 1 -- 172.21.15.154:0/2687679018 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305412c730 con 0x7f30541356e0 2023-09-30T22:22:50.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f5c81276700 1 -- 172.21.15.154:0/121508553 shutdown_connections 2023-09-30T22:22:50.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f5c81276700 1 --2- 172.21.15.154:0/121508553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c130eb0 0x7f5c7c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f5c81276700 1 --2- 172.21.15.154:0/121508553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c09d860 0x7f5c7c09dc30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f5c81276700 1 -- 172.21.15.154:0/121508553 >> 172.21.15.154:0/121508553 conn(0x7f5c7c099c40 msgr2=0x7f5c7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:50.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f5c81276700 1 -- 172.21.15.154:0/121508553 shutdown_connections 2023-09-30T22:22:50.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f3059a0e700 1 --2- 172.21.15.154:0/2687679018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30541356e0 0x7f3054137ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f304c00aea0 tx=0x7f304c00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de215b82477baf90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.753+0000 7f5c81276700 1 -- 172.21.15.154:0/121508553 wait complete. 2023-09-30T22:22:50.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.754+0000 7f304bfff700 1 -- 172.21.15.154:0/2687679018 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00f070 con 0x7f30541356e0 2023-09-30T22:22:50.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.754+0000 7f304bfff700 1 -- 172.21.15.154:0/2687679018 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c00a2e0 con 0x7f30541356e0 2023-09-30T22:22:50.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.754+0000 7f304bfff700 1 -- 172.21.15.154:0/2687679018 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00cc00 con 0x7f30541356e0 2023-09-30T22:22:50.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f88706ab700 1 Processor -- start 2023-09-30T22:22:50.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c81276700 1 Processor -- start 2023-09-30T22:22:50.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c81276700 1 -- start start 2023-09-30T22:22:50.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f88706ab700 1 -- start start 2023-09-30T22:22:50.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f305b471700 1 -- 172.21.15.154:0/2687679018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30541356e0 msgr2=0x7f3054137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f305b471700 1 --2- 172.21.15.154:0/2687679018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30541356e0 0x7f3054137ac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f304c00aea0 tx=0x7f304c00c330 comp rx=0 tx=0).stop 2023-09-30T22:22:50.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f305b471700 1 -- 172.21.15.154:0/2687679018 shutdown_connections 2023-09-30T22:22:50.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f305b471700 1 --2- 172.21.15.154:0/2687679018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30541356e0 0x7f3054137ac0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f305b471700 1 --2- 172.21.15.154:0/2687679018 >> v2:172.21.15.154:3300/0 conn(0x7f3054132dc0 0x7f30541351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f305b471700 1 -- 172.21.15.154:0/2687679018 >> 172.21.15.154:0/2687679018 conn(0x7f30540a2eb0 msgr2=0x7f305409eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:50.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f305b471700 1 -- 172.21.15.154:0/2687679018 shutdown_connections 2023-09-30T22:22:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c81276700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c09d860 0x7f5c7c11e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c81276700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c7c09e170 0x7f5c7c11e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c81276700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c130eb0 0x7f5c7c11eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c81276700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c1219d0 con 0x7f5c7c130eb0 2023-09-30T22:22:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c81276700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c120090 con 0x7f5c7c09d860 2023-09-30T22:22:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c81276700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c121c20 con 0x7f5c7c09e170 2023-09-30T22:22:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c7b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c130eb0 0x7f5c7c11eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c7affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c09d860 0x7f5c7c11e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c7b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c130eb0 0x7f5c7c11eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47664/0 (socket says 172.21.15.154:47664) 2023-09-30T22:22:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c7b7fe700 1 -- 172.21.15.154:0/1777701208 learned_addr learned my addr 172.21.15.154:0/1777701208 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f5c7affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c09d860 0x7f5c7c11e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47802/0 (socket says 172.21.15.154:47802) 2023-09-30T22:22:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f88706ab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8868131980 0x7f8868131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f88706ab700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f886809c790 0x7f8868139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f88706ab700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88680a1640 con 0x7f886809bc70 2023-09-30T22:22:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f88706ab700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886806eb30 con 0x7f886809c790 2023-09-30T22:22:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f88706ab700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88680a22d0 con 0x7f8868131980 2023-09-30T22:22:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f886e447700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8868131980 0x7f8868131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f886e447700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8868131980 0x7f8868131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47804/0 (socket says 172.21.15.154:47804) 2023-09-30T22:22:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f886e447700 1 -- 172.21.15.154:0/2624728683 learned_addr learned my addr 172.21.15.154:0/2624728683 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f5c7a7fc700 1 --2- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c7c09e170 0x7f5c7c11e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f886ec48700 1 --2- 172.21.15.154:0/2624728683 >> v2:172.21.15.154:3300/0 conn(0x7f886809c790 0x7f8868139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f886e447700 1 -- 172.21.15.154:0/2624728683 >> v2:172.21.15.154:3300/0 conn(0x7f886809c790 msgr2=0x7f8868139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f886e447700 1 --2- 172.21.15.154:0/2624728683 >> v2:172.21.15.154:3300/0 conn(0x7f886809c790 0x7f8868139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f886e447700 1 -- 172.21.15.154:0/2624728683 >> v1:172.21.15.154:6789/0 conn(0x7f886809bc70 legacy=0x7f886809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f886e447700 1 -- 172.21.15.154:0/2624728683 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868131550 con 0x7f8868131980 2023-09-30T22:22:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f5c7b7fe700 1 -- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c7c09e170 msgr2=0x7f5c7c11e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f5c7b7fe700 1 --2- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c7c09e170 0x7f5c7c11e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f5c7b7fe700 1 -- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c09d860 msgr2=0x7f5c7c11e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f5c7b7fe700 1 --2- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c09d860 0x7f5c7c11e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f5c7b7fe700 1 -- 172.21.15.154:0/1777701208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c00b7f0 con 0x7f5c7c130eb0 2023-09-30T22:22:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f5c7b7fe700 1 --2- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c130eb0 0x7f5c7c11eea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400b390 tx=0x7f5c7400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.755+0000 7f305b471700 1 -- 172.21.15.154:0/2687679018 wait complete. 2023-09-30T22:22:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f886e447700 1 --2- 172.21.15.154:0/2624728683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8868131980 0x7f8868131d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8864006fd0 tx=0x7f8864009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce36295052cf86c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.756+0000 7f305b471700 1 Processor -- start 2023-09-30T22:22:50.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f305b471700 1 -- start start 2023-09-30T22:22:50.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f5c637fe700 1 -- 172.21.15.154:0/1777701208 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74015070 con 0x7f5c7c130eb0 2023-09-30T22:22:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f5c637fe700 1 -- 172.21.15.154:0/1777701208 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7400bd10 con 0x7f5c7c130eb0 2023-09-30T22:22:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f5c637fe700 1 -- 172.21.15.154:0/1777701208 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74019630 con 0x7f5c7c130eb0 2023-09-30T22:22:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f886d445700 1 -- 172.21.15.154:0/2624728683 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864005e30 con 0x7f8868131980 2023-09-30T22:22:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f5c81276700 1 -- 172.21.15.154:0/1777701208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c0a2140 con 0x7f5c7c130eb0 2023-09-30T22:22:50.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f886d445700 1 -- 172.21.15.154:0/2624728683 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8864006030 con 0x7f8868131980 2023-09-30T22:22:50.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f886d445700 1 -- 172.21.15.154:0/2624728683 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640063c0 con 0x7f8868131980 2023-09-30T22:22:50.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f5c81276700 1 -- 172.21.15.154:0/1777701208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c122690 con 0x7f5c7c130eb0 2023-09-30T22:22:50.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f305b471700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f305412cb80 0x7f3054070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f305b471700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3054132dc0 0x7f30541c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f305b471700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30541356e0 0x7f305406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f305b471700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054071700 con 0x7f30541356e0 2023-09-30T22:22:50.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f305b471700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305406fde0 con 0x7f3054132dc0 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f305b471700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30540719c0 con 0x7f305412cb80 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f3059a0e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30541356e0 0x7f305406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f3059a0e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30541356e0 0x7f305406e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47676/0 (socket says 172.21.15.154:47676) 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f3059a0e700 1 -- 172.21.15.154:0/1758979336 learned_addr learned my addr 172.21.15.154:0/1758979336 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.757+0000 7f305920d700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f305412cb80 0x7f3054070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f3059a0e700 1 -- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f305412cb80 msgr2=0x7f3054070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f3059a0e700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f305412cb80 0x7f3054070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f3059a0e700 1 -- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3054132dc0 msgr2=0x7f30541c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f3058a0c700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3054132dc0 0x7f30541c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f3059a0e700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3054132dc0 0x7f30541c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f3059a0e700 1 -- 172.21.15.154:0/1758979336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c00ab80 con 0x7f30541356e0 2023-09-30T22:22:50.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f3058a0c700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3054132dc0 0x7f30541c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:50.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f3059a0e700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30541356e0 0x7f305406e4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f304c013000 tx=0x7f304c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f5c81276700 1 -- 172.21.15.154:0/1777701208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c04f2a0 con 0x7f5c7c130eb0 2023-09-30T22:22:50.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f88706ab700 1 -- 172.21.15.154:0/2624728683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8868131980 msgr2=0x7f8868131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f88706ab700 1 --2- 172.21.15.154:0/2624728683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8868131980 0x7f8868131d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8864006fd0 tx=0x7f8864009bd0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f88706ab700 1 -- 172.21.15.154:0/2624728683 shutdown_connections 2023-09-30T22:22:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f88706ab700 1 --2- 172.21.15.154:0/2624728683 >> v2:172.21.15.154:3300/0 conn(0x7f886809c790 0x7f8868139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f88706ab700 1 --2- 172.21.15.154:0/2624728683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8868131980 0x7f8868131d50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f88706ab700 1 -- 172.21.15.154:0/2624728683 >> 172.21.15.154:0/2624728683 conn(0x7f88680a2980 msgr2=0x7f88680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f3049ffb700 1 -- 172.21.15.154:0/1758979336 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c004410 con 0x7f30541356e0 2023-09-30T22:22:50.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f88706ab700 1 -- 172.21.15.154:0/2624728683 shutdown_connections 2023-09-30T22:22:50.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f88706ab700 1 -- 172.21.15.154:0/2624728683 wait complete. 2023-09-30T22:22:50.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.758+0000 7f305b471700 1 -- 172.21.15.154:0/1758979336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30541c3c30 con 0x7f30541356e0 2023-09-30T22:22:50.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.759+0000 7f305b471700 1 -- 172.21.15.154:0/1758979336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30541279d0 con 0x7f30541356e0 2023-09-30T22:22:50.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.759+0000 7f5c637fe700 1 -- 172.21.15.154:0/1777701208 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c74023440 con 0x7f5c7c130eb0 2023-09-30T22:22:50.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.759+0000 7f5c637fe700 1 -- 172.21.15.154:0/1777701208 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c74043aa0 con 0x7f5c7c130eb0 2023-09-30T22:22:50.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.760+0000 7f305b471700 1 -- 172.21.15.154:0/1758979336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305409b440 con 0x7f30541356e0 2023-09-30T22:22:50.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.760+0000 7f88706ab700 1 Processor -- start 2023-09-30T22:22:50.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.760+0000 7f88706ab700 1 -- start start 2023-09-30T22:22:50.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.760+0000 7f88706ab700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f886809bc70 0x7f886813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.760+0000 7f88706ab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f886809c790 0x7f886813b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.760+0000 7f88706ab700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8868131980 0x7f886813b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:50.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f88706ab700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8868139570 con 0x7f8868131980 2023-09-30T22:22:50.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f88706ab700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88680a1c40 con 0x7f886809c790 2023-09-30T22:22:50.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f88706ab700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88681329b0 con 0x7f886809bc70 2023-09-30T22:22:50.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886ec48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8868131980 0x7f886813b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886ec48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8868131980 0x7f886813b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47686/0 (socket says 172.21.15.154:47686) 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886ec48700 1 -- 172.21.15.154:0/1844002117 learned_addr learned my addr 172.21.15.154:0/1844002117 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886e447700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f886809bc70 0x7f886813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886dc46700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f886809c790 0x7f886813b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886ec48700 1 -- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f886809bc70 msgr2=0x7f886813ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886ec48700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f886809bc70 0x7f886813ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886ec48700 1 -- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f886809c790 msgr2=0x7f886813b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886ec48700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f886809c790 0x7f886813b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886ec48700 1 -- 172.21.15.154:0/1844002117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864009500 con 0x7f8868131980 2023-09-30T22:22:50.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886dc46700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f886809c790 0x7f886813b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:50.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886e447700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f886809bc70 0x7f886813ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:50.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.761+0000 7f886ec48700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8868131980 0x7f886813b690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8860007e70 tx=0x7f886000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:50.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.763+0000 7f3049ffb700 1 -- 172.21.15.154:0/1758979336 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c004570 con 0x7f30541356e0 2023-09-30T22:22:50.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.763+0000 7f3049ffb700 1 -- 172.21.15.154:0/1758979336 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0048e0 con 0x7f30541356e0 2023-09-30T22:22:50.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.763+0000 7f885effd700 1 -- 172.21.15.154:0/1844002117 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000ee50 con 0x7f8868131980 2023-09-30T22:22:50.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.763+0000 7f88706ab700 1 -- 172.21.15.154:0/1844002117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88681399b0 con 0x7f8868131980 2023-09-30T22:22:50.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.763+0000 7f88706ab700 1 -- 172.21.15.154:0/1844002117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8868133420 con 0x7f8868131980 2023-09-30T22:22:50.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.763+0000 7f5c637fe700 1 -- 172.21.15.154:0/1777701208 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c74017900 con 0x7f5c7c130eb0 2023-09-30T22:22:50.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.767+0000 7f885effd700 1 -- 172.21.15.154:0/1844002117 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886001e460 con 0x7f8868131980 2023-09-30T22:22:50.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.767+0000 7f885effd700 1 -- 172.21.15.154:0/1844002117 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886001e7d0 con 0x7f8868131980 2023-09-30T22:22:50.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.767+0000 7f3049ffb700 1 -- 172.21.15.154:0/1758979336 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f304c01d440 con 0x7f30541356e0 2023-09-30T22:22:50.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.767+0000 7f3049ffb700 1 -- 172.21.15.154:0/1758979336 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f304c041630 con 0x7f30541356e0 2023-09-30T22:22:50.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.768+0000 7f88706ab700 1 -- 172.21.15.154:0/1844002117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88500052e0 con 0x7f8868131980 2023-09-30T22:22:50.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.768+0000 7f3049ffb700 1 -- 172.21.15.154:0/1758979336 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f304c01c990 con 0x7f30541356e0 2023-09-30T22:22:50.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.769+0000 7f885effd700 1 -- 172.21.15.154:0/1844002117 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f886001e930 con 0x7f8868131980 2023-09-30T22:22:50.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.769+0000 7f885effd700 1 -- 172.21.15.154:0/1844002117 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8860040ea0 con 0x7f8868131980 2023-09-30T22:22:50.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.773+0000 7f885effd700 1 -- 172.21.15.154:0/1844002117 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8860008d70 con 0x7f8868131980 2023-09-30T22:22:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.933+0000 7f192ddfc700 1 -- 172.21.15.154:0/4188349720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1908005590 con 0x7f192806a770 2023-09-30T22:22:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.934+0000 7f190ffff700 1 -- 172.21.15.154:0/4188349720 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19180233d0 con 0x7f192806a770 2023-09-30T22:22:50.935 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.936+0000 7f192ddfc700 1 -- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 msgr2=0x7f1928119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.936+0000 7f192ddfc700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 0x7f1928119630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1918000c00 tx=0x7f1918004750 comp rx=0 tx=0).stop 2023-09-30T22:22:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.936+0000 7f192ddfc700 1 -- 172.21.15.154:0/4188349720 shutdown_connections 2023-09-30T22:22:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.936+0000 7f192ddfc700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1928131a00 0x7f192811a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.936+0000 7f192ddfc700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192806a770 0x7f1928119630 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.936+0000 7f192ddfc700 1 --2- 172.21.15.154:0/4188349720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f192809dec0 0x7f1928119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.936+0000 7f192ddfc700 1 -- 172.21.15.154:0/4188349720 >> 172.21.15.154:0/4188349720 conn(0x7f1928099c40 msgr2=0x7f192812f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.936+0000 7f192ddfc700 1 -- 172.21.15.154:0/4188349720 shutdown_connections 2023-09-30T22:22:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.936+0000 7f192ddfc700 1 -- 172.21.15.154:0/4188349720 wait complete. 2023-09-30T22:22:50.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.959+0000 7f5c81276700 1 -- 172.21.15.154:0/1777701208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5c7c09c8b0 con 0x7f5c7c130eb0 2023-09-30T22:22:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.960+0000 7f5c637fe700 1 -- 172.21.15.154:0/1777701208 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c7401e020 con 0x7f5c7c130eb0 2023-09-30T22:22:50.961 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.962+0000 7f5c81276700 1 -- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c130eb0 msgr2=0x7f5c7c11eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.962+0000 7f5c81276700 1 --2- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c130eb0 0x7f5c7c11eea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400b390 tx=0x7f5c7400b6a0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.962+0000 7f5c81276700 1 -- 172.21.15.154:0/1777701208 shutdown_connections 2023-09-30T22:22:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.962+0000 7f5c81276700 1 --2- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c7c130eb0 0x7f5c7c11eea0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.962+0000 7f5c81276700 1 --2- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c7c09d860 0x7f5c7c11e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.962+0000 7f5c81276700 1 --2- 172.21.15.154:0/1777701208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c7c09e170 0x7f5c7c11e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.962+0000 7f5c81276700 1 -- 172.21.15.154:0/1777701208 >> 172.21.15.154:0/1777701208 conn(0x7f5c7c099c40 msgr2=0x7f5c7c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.962+0000 7f5c81276700 1 -- 172.21.15.154:0/1777701208 shutdown_connections 2023-09-30T22:22:50.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.962+0000 7f5c81276700 1 -- 172.21.15.154:0/1777701208 wait complete. 2023-09-30T22:22:50.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.963+0000 7f305b471700 1 -- 172.21.15.154:0/1758979336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f305404f2a0 con 0x7f30541356e0 2023-09-30T22:22:50.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.963+0000 7f3049ffb700 1 -- 172.21.15.154:0/1758979336 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f304c02e3e0 con 0x7f30541356e0 2023-09-30T22:22:50.964 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.965+0000 7f305b471700 1 -- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30541356e0 msgr2=0x7f305406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.965+0000 7f305b471700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30541356e0 0x7f305406e4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f304c013000 tx=0x7f304c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.965+0000 7f305b471700 1 -- 172.21.15.154:0/1758979336 shutdown_connections 2023-09-30T22:22:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.965+0000 7f305b471700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30541356e0 0x7f305406e4a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.965+0000 7f305b471700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f305412cb80 0x7f3054070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.965+0000 7f305b471700 1 --2- 172.21.15.154:0/1758979336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3054132dc0 0x7f30541c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:50.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.965+0000 7f305b471700 1 -- 172.21.15.154:0/1758979336 >> 172.21.15.154:0/1758979336 conn(0x7f30540a2eb0 msgr2=0x7f30541310c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:50.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.966+0000 7f305b471700 1 -- 172.21.15.154:0/1758979336 shutdown_connections 2023-09-30T22:22:50.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:50.966+0000 7f305b471700 1 -- 172.21.15.154:0/1758979336 wait complete. 2023-09-30T22:22:50.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:50.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:51.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.010+0000 7f88706ab700 1 -- 172.21.15.154:0/1844002117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8850005860 con 0x7f8868131980 2023-09-30T22:22:51.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.010+0000 7f885effd700 1 -- 172.21.15.154:0/1844002117 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f886002d090 con 0x7f8868131980 2023-09-30T22:22:51.011 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:51.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.012+0000 7f88706ab700 1 -- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8868131980 msgr2=0x7f886813b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:51.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.012+0000 7f88706ab700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8868131980 0x7f886813b690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8860007e70 tx=0x7f886000e3c0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.012+0000 7f88706ab700 1 -- 172.21.15.154:0/1844002117 shutdown_connections 2023-09-30T22:22:51.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.012+0000 7f88706ab700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8868131980 0x7f886813b690 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.012+0000 7f88706ab700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f886809bc70 0x7f886813ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.012+0000 7f88706ab700 1 --2- 172.21.15.154:0/1844002117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f886809c790 0x7f886813b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:51.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.012+0000 7f88706ab700 1 -- 172.21.15.154:0/1844002117 >> 172.21.15.154:0/1844002117 conn(0x7f88680a2980 msgr2=0x7f8868070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:51.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.012+0000 7f88706ab700 1 -- 172.21.15.154:0/1844002117 shutdown_connections 2023-09-30T22:22:51.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:51.012+0000 7f88706ab700 1 -- 172.21.15.154:0/1844002117 wait complete. 2023-09-30T22:22:51.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:51.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:51.978 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:51.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:52.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:52.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.088+0000 7fd3cef4e700 1 Processor -- start 2023-09-30T22:22:52.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.088+0000 7fd3cef4e700 1 -- start start 2023-09-30T22:22:52.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cef4e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3c8137dd0 0x7fd3c81381a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cef4e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806fd80 0x7fd3c813fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cef4e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c8072200 con 0x7fd3c806f1d0 2023-09-30T22:22:52.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cef4e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c809a340 con 0x7fd3c8137dd0 2023-09-30T22:22:52.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cef4e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c80707b0 con 0x7fd3c806fd80 2023-09-30T22:22:52.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cccea700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3c8137dd0 0x7fd3c81381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cccea700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3c8137dd0 0x7fd3c81381a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47688/0 (socket says 172.21.15.154:47688) 2023-09-30T22:22:52.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cccea700 1 -- 172.21.15.154:0/3174743441 learned_addr learned my addr 172.21.15.154:0/3174743441 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:52.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cd4eb700 1 --2- 172.21.15.154:0/3174743441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806fd80 0x7fd3c813fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cccea700 1 -- 172.21.15.154:0/3174743441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806fd80 msgr2=0x7fd3c813fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cccea700 1 --2- 172.21.15.154:0/3174743441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806fd80 0x7fd3c813fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cccea700 1 -- 172.21.15.154:0/3174743441 >> v1:172.21.15.154:6789/0 conn(0x7fd3c806f1d0 legacy=0x7fd3c806f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cccea700 1 -- 172.21.15.154:0/3174743441 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c8137980 con 0x7fd3c8137dd0 2023-09-30T22:22:52.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cd4eb700 1 --2- 172.21.15.154:0/3174743441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806fd80 0x7fd3c813fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:52.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.089+0000 7fd3cccea700 1 --2- 172.21.15.154:0/3174743441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 0x7fd3c81381a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0098f0 tx=0x7fd3bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f516876f5fee23d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.090+0000 7fd3c77fe700 1 -- 172.21.15.154:0/3174743441 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc011830 con 0x7fd3c8137dd0 2023-09-30T22:22:52.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.090+0000 7fd3c77fe700 1 -- 172.21.15.154:0/3174743441 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc011990 con 0x7fd3c8137dd0 2023-09-30T22:22:52.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.090+0000 7fd3c77fe700 1 -- 172.21.15.154:0/3174743441 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc011d20 con 0x7fd3c8137dd0 2023-09-30T22:22:52.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.090+0000 7fd3cef4e700 1 -- 172.21.15.154:0/3174743441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 msgr2=0x7fd3c81381a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.090+0000 7fd3cef4e700 1 --2- 172.21.15.154:0/3174743441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 0x7fd3c81381a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0098f0 tx=0x7fd3bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:52.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.091+0000 7fd3cef4e700 1 -- 172.21.15.154:0/3174743441 shutdown_connections 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.091+0000 7fd3cef4e700 1 --2- 172.21.15.154:0/3174743441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806fd80 0x7fd3c813fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.091+0000 7fd3cef4e700 1 --2- 172.21.15.154:0/3174743441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 0x7fd3c81381a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.091+0000 7fd3cef4e700 1 -- 172.21.15.154:0/3174743441 >> 172.21.15.154:0/3174743441 conn(0x7fd3c80a2810 msgr2=0x7fd3c80a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.091+0000 7fd3cef4e700 1 -- 172.21.15.154:0/3174743441 shutdown_connections 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.091+0000 7fd3cef4e700 1 -- 172.21.15.154:0/3174743441 wait complete. 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cef4e700 1 Processor -- start 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cef4e700 1 -- start start 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cef4e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806f1d0 0x7fd3c81cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cef4e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3c806fd80 0x7fd3c81cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cef4e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 0x7fd3c8126550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cef4e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c812a260 con 0x7fd3c8137dd0 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cef4e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8071700 con 0x7fd3c806f1d0 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cef4e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8129a80 con 0x7fd3c806fd80 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cccea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806f1d0 0x7fd3c81cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3c7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3c806fd80 0x7fd3c81cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cccea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806f1d0 0x7fd3c81cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47846/0 (socket says 172.21.15.154:47846) 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.092+0000 7fd3cccea700 1 -- 172.21.15.154:0/96419775 learned_addr learned my addr 172.21.15.154:0/96419775 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3cd4eb700 1 --2- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 0x7fd3c8126550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3c7fff700 1 -- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806f1d0 msgr2=0x7fd3c81cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3c7fff700 1 --2- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806f1d0 0x7fd3c81cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3c7fff700 1 -- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 msgr2=0x7fd3c8126550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3c7fff700 1 --2- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 0x7fd3c8126550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3c7fff700 1 -- 172.21.15.154:0/96419775 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009a70 con 0x7fd3c806fd80 2023-09-30T22:22:52.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3cd4eb700 1 --2- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 0x7fd3c8126550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:52.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3c7fff700 1 --2- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3c806fd80 0x7fd3c81cd350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4000f60 tx=0x7fd3b400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3c57fa700 1 -- 172.21.15.154:0/96419775 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40052d0 con 0x7fd3c806fd80 2023-09-30T22:22:52.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3c57fa700 1 -- 172.21.15.154:0/96419775 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400ce90 con 0x7fd3c806fd80 2023-09-30T22:22:52.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3c57fa700 1 -- 172.21.15.154:0/96419775 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4003680 con 0x7fd3c806fd80 2023-09-30T22:22:52.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3cef4e700 1 -- 172.21.15.154:0/96419775 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc009550 con 0x7fd3c806fd80 2023-09-30T22:22:52.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.093+0000 7fd3cef4e700 1 -- 172.21.15.154:0/96419775 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c81cd890 con 0x7fd3c806fd80 2023-09-30T22:22:52.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.095+0000 7fd3cef4e700 1 -- 172.21.15.154:0/96419775 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c8137ba0 con 0x7fd3c806fd80 2023-09-30T22:22:52.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.095+0000 7fd3c57fa700 1 -- 172.21.15.154:0/96419775 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3b40037e0 con 0x7fd3c806fd80 2023-09-30T22:22:52.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.095+0000 7fd3c57fa700 1 -- 172.21.15.154:0/96419775 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3b4003a90 con 0x7fd3c806fd80 2023-09-30T22:22:52.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.104+0000 7fd3c57fa700 1 -- 172.21.15.154:0/96419775 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3b4044060 con 0x7fd3c806fd80 2023-09-30T22:22:52.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.127+0000 7f4805a69700 1 Processor -- start 2023-09-30T22:22:52.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.127+0000 7f4805a69700 1 -- start start 2023-09-30T22:22:52.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f4805a69700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f480012cb80 0x7f480012cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f4805a69700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f480012fab0 0x7f480012ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f4805a69700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480009b700 con 0x7f4800130460 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f4805a69700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4800130900 con 0x7f480012fab0 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f4805a69700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f480009c350 con 0x7f480012cb80 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f47ff7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f480012cb80 0x7f480012cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f47ff7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f480012cb80 0x7f480012cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43560/0 (socket says 172.21.15.154:43560) 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f47ff7fe700 1 -- 172.21.15.154:0/1203876861 learned_addr learned my addr 172.21.15.154:0/1203876861 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f47feffd700 1 --2- 172.21.15.154:0/1203876861 >> v2:172.21.15.154:3300/0 conn(0x7f480012fab0 0x7f480012ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f47ff7fe700 1 -- 172.21.15.154:0/1203876861 >> v2:172.21.15.154:3300/0 conn(0x7f480012fab0 msgr2=0x7f480012ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f47ff7fe700 1 --2- 172.21.15.154:0/1203876861 >> v2:172.21.15.154:3300/0 conn(0x7f480012fab0 0x7f480012ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f47ff7fe700 1 -- 172.21.15.154:0/1203876861 >> v1:172.21.15.154:6789/0 conn(0x7f4800130460 legacy=0x7f4800136de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f47ff7fe700 1 -- 172.21.15.154:0/1203876861 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480009abf0 con 0x7f480012cb80 2023-09-30T22:22:52.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.128+0000 7f47ff7fe700 1 --2- 172.21.15.154:0/1203876861 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f480012cb80 0x7f480012cf50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47f00098f0 tx=0x7f47f0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b592ccc51b3ac762 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f47fe7fc700 1 -- 172.21.15.154:0/1203876861 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0011830 con 0x7f480012cb80 2023-09-30T22:22:52.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f47fe7fc700 1 -- 172.21.15.154:0/1203876861 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f0011990 con 0x7f480012cb80 2023-09-30T22:22:52.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f47fe7fc700 1 -- 172.21.15.154:0/1203876861 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0011d20 con 0x7f480012cb80 2023-09-30T22:22:52.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f4805a69700 1 -- 172.21.15.154:0/1203876861 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f480012cb80 msgr2=0x7f480012cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f4805a69700 1 --2- 172.21.15.154:0/1203876861 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f480012cb80 0x7f480012cf50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47f00098f0 tx=0x7f47f0009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:52.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f4805a69700 1 -- 172.21.15.154:0/1203876861 shutdown_connections 2023-09-30T22:22:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f4805a69700 1 --2- 172.21.15.154:0/1203876861 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f480012cb80 0x7f480012cf50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f4805a69700 1 --2- 172.21.15.154:0/1203876861 >> v2:172.21.15.154:3300/0 conn(0x7f480012fab0 0x7f480012ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f4805a69700 1 -- 172.21.15.154:0/1203876861 >> 172.21.15.154:0/1203876861 conn(0x7f48000a2eb0 msgr2=0x7f480009eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f4805a69700 1 -- 172.21.15.154:0/1203876861 shutdown_connections 2023-09-30T22:22:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.129+0000 7f4805a69700 1 -- 172.21.15.154:0/1203876861 wait complete. 2023-09-30T22:22:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.130+0000 7f4805a69700 1 Processor -- start 2023-09-30T22:22:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f4805a69700 1 -- start start 2023-09-30T22:22:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f4805a69700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f480012cb80 0x7f4800138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f4805a69700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f480012fab0 0x7f4800139510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f4805a69700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4800130460 0x7f480012a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f4805a69700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480012c210 con 0x7f480012cb80 2023-09-30T22:22:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f4805a69700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480009da30 con 0x7f480012fab0 2023-09-30T22:22:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f4805a69700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4800139a50 con 0x7f4800130460 2023-09-30T22:22:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f47ff7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f480012cb80 0x7f4800138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f47ff7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f480012cb80 0x7f4800138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47706/0 (socket says 172.21.15.154:47706) 2023-09-30T22:22:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f47ff7fe700 1 -- 172.21.15.154:0/4091854651 learned_addr learned my addr 172.21.15.154:0/4091854651 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:52.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f47ff7fe700 1 -- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4800130460 msgr2=0x7f480012a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.131+0000 7f47ff7fe700 1 --2- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4800130460 0x7f480012a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.132+0000 7f47ff7fe700 1 -- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f480012fab0 msgr2=0x7f4800139510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.132+0000 7f47ff7fe700 1 --2- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f480012fab0 0x7f4800139510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.132+0000 7f47ff7fe700 1 -- 172.21.15.154:0/4091854651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0009550 con 0x7f480012cb80 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.132+0000 7f47ff7fe700 1 --2- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f480012cb80 0x7f4800138fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009c40 tx=0x7f47f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.132+0000 7f47e7fff700 1 -- 172.21.15.154:0/4091854651 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f00036a0 con 0x7f480012cb80 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.132+0000 7f47e7fff700 1 -- 172.21.15.154:0/4091854651 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f001e070 con 0x7f480012cb80 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.132+0000 7f4805a69700 1 -- 172.21.15.154:0/4091854651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480009b050 con 0x7f480012cb80 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.132+0000 7f47e7fff700 1 -- 172.21.15.154:0/4091854651 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0003a40 con 0x7f480012cb80 2023-09-30T22:22:52.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.132+0000 7f4805a69700 1 -- 172.21.15.154:0/4091854651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4800129c10 con 0x7f480012cb80 2023-09-30T22:22:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.133+0000 7f47e7fff700 1 -- 172.21.15.154:0/4091854651 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47f0003ba0 con 0x7f480012cb80 2023-09-30T22:22:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.133+0000 7f47e7fff700 1 -- 172.21.15.154:0/4091854651 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f47f00405f0 con 0x7f480012cb80 2023-09-30T22:22:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.133+0000 7f4805a69700 1 -- 172.21.15.154:0/4091854651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4800129a40 con 0x7f480012cb80 2023-09-30T22:22:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.138+0000 7f47e7fff700 1 -- 172.21.15.154:0/4091854651 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47f002d7d0 con 0x7f480012cb80 2023-09-30T22:22:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.142+0000 7fdeecd71700 1 Processor -- start 2023-09-30T22:22:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.142+0000 7fdeecd71700 1 -- start start 2023-09-30T22:22:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.143+0000 7fdeecd71700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdee8133900 0x7fdee8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.143+0000 7fdeecd71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee8134210 0x7fdee80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.143+0000 7fdeecd71700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee809a760 con 0x7fdee80a0ee0 2023-09-30T22:22:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.143+0000 7fdeecd71700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee81336e0 con 0x7fdee8133900 2023-09-30T22:22:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.143+0000 7fdeecd71700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdee809a080 con 0x7fdee8134210 2023-09-30T22:22:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdee8133900 0x7fdee8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdee8133900 0x7fdee8133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47722/0 (socket says 172.21.15.154:47722) 2023-09-30T22:22:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee659c700 1 -- 172.21.15.154:0/406763680 learned_addr learned my addr 172.21.15.154:0/406763680 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee659c700 1 -- 172.21.15.154:0/406763680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee8134210 msgr2=0x7fdee80a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee659c700 1 --2- 172.21.15.154:0/406763680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee8134210 0x7fdee80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee659c700 1 -- 172.21.15.154:0/406763680 >> v1:172.21.15.154:6789/0 conn(0x7fdee80a0ee0 legacy=0x7fdee813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee659c700 1 -- 172.21.15.154:0/406763680 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee80a23e0 con 0x7fdee8133900 2023-09-30T22:22:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee659c700 1 --2- 172.21.15.154:0/406763680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee8133900 0x7fdee8133cd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fded8006fd0 tx=0x7fded8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a0266127f2184b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee559a700 1 -- 172.21.15.154:0/406763680 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8005e30 con 0x7fdee8133900 2023-09-30T22:22:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee559a700 1 -- 172.21.15.154:0/406763680 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8004030 con 0x7fdee8133900 2023-09-30T22:22:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.144+0000 7fdee559a700 1 -- 172.21.15.154:0/406763680 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80043e0 con 0x7fdee8133900 2023-09-30T22:22:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.145+0000 7fdeecd71700 1 -- 172.21.15.154:0/406763680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee8133900 msgr2=0x7fdee8133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.145+0000 7fdeecd71700 1 --2- 172.21.15.154:0/406763680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee8133900 0x7fdee8133cd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fded8006fd0 tx=0x7fded8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.145+0000 7fdeecd71700 1 -- 172.21.15.154:0/406763680 shutdown_connections 2023-09-30T22:22:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.145+0000 7fdeecd71700 1 --2- 172.21.15.154:0/406763680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee8133900 0x7fdee8133cd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.145+0000 7fdeecd71700 1 --2- 172.21.15.154:0/406763680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee8134210 0x7fdee80a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.145+0000 7fdeecd71700 1 -- 172.21.15.154:0/406763680 >> 172.21.15.154:0/406763680 conn(0x7fdee80a2980 msgr2=0x7fdee80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.145+0000 7fdeecd71700 1 -- 172.21.15.154:0/406763680 shutdown_connections 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.145+0000 7fdeecd71700 1 -- 172.21.15.154:0/406763680 wait complete. 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.147+0000 7fdeecd71700 1 Processor -- start 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.147+0000 7fdeecd71700 1 -- start start 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.147+0000 7fdeecd71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee80a0ee0 0x7fdee811d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.147+0000 7fdeecd71700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee8133900 0x7fdee811dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.147+0000 7fdeecd71700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee8134210 0x7fdee811e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.147+0000 7fdeecd71700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee811ee50 con 0x7fdee8134210 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.147+0000 7fdeecd71700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8130d70 con 0x7fdee8133900 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.147+0000 7fdeecd71700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdee811fbb0 con 0x7fdee80a0ee0 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee80a0ee0 0x7fdee811d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee80a0ee0 0x7fdee811d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43572/0 (socket says 172.21.15.154:43572) 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee659c700 1 -- 172.21.15.154:0/1991971849 learned_addr learned my addr 172.21.15.154:0/1991971849 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee6d9d700 1 --2- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee8134210 0x7fdee811e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee5d9b700 1 --2- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee8133900 0x7fdee811dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee659c700 1 -- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee8133900 msgr2=0x7fdee811dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee659c700 1 --2- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee8133900 0x7fdee811dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee659c700 1 -- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee8134210 msgr2=0x7fdee811e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee659c700 1 --2- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee8134210 0x7fdee811e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee659c700 1 -- 172.21.15.154:0/1991971849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded8009500 con 0x7fdee80a0ee0 2023-09-30T22:22:52.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fdee659c700 1 --2- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee80a0ee0 0x7fdee811d980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdee8133820 tx=0x7fded8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.148+0000 7fded6ffd700 1 -- 172.21.15.154:0/1991971849 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8024070 con 0x7fdee80a0ee0 2023-09-30T22:22:52.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.149+0000 7fded6ffd700 1 -- 172.21.15.154:0/1991971849 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8004560 con 0x7fdee80a0ee0 2023-09-30T22:22:52.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.149+0000 7fdeecd71700 1 -- 172.21.15.154:0/1991971849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee81207e0 con 0x7fdee80a0ee0 2023-09-30T22:22:52.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.149+0000 7fded6ffd700 1 -- 172.21.15.154:0/1991971849 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8003af0 con 0x7fdee80a0ee0 2023-09-30T22:22:52.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.149+0000 7fdeecd71700 1 -- 172.21.15.154:0/1991971849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee8133050 con 0x7fdee80a0ee0 2023-09-30T22:22:52.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.150+0000 7fded6ffd700 1 -- 172.21.15.154:0/1991971849 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fded8003c50 con 0x7fdee80a0ee0 2023-09-30T22:22:52.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.150+0000 7fded6ffd700 1 -- 172.21.15.154:0/1991971849 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fded80483e0 con 0x7fdee80a0ee0 2023-09-30T22:22:52.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.150+0000 7fdeecd71700 1 -- 172.21.15.154:0/1991971849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee809a320 con 0x7fdee80a0ee0 2023-09-30T22:22:52.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.159+0000 7fded6ffd700 1 -- 172.21.15.154:0/1991971849 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fded8016030 con 0x7fdee80a0ee0 2023-09-30T22:22:52.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.172+0000 7fef74f9f700 1 Processor -- start 2023-09-30T22:22:52.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.172+0000 7fef74f9f700 1 -- start start 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.173+0000 7fef74f9f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.173+0000 7fef74f9f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a1380 0x7fef70133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.173+0000 7fef74f9f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7009dc00 con 0x7fef70133f50 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.173+0000 7fef74f9f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7009ea60 con 0x7fef700a1380 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.173+0000 7fef74f9f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7009dec0 con 0x7fef700a0a70 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.173+0000 7fef6e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.173+0000 7fef6e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef700a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43582/0 (socket says 172.21.15.154:43582) 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.173+0000 7fef6e59c700 1 -- 172.21.15.154:0/1572138785 learned_addr learned my addr 172.21.15.154:0/1572138785 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.174+0000 7fef6e59c700 1 -- 172.21.15.154:0/1572138785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a1380 msgr2=0x7fef70133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:52.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.174+0000 7fef6e59c700 1 --2- 172.21.15.154:0/1572138785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a1380 0x7fef70133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.174+0000 7fef6e59c700 1 -- 172.21.15.154:0/1572138785 >> v1:172.21.15.154:6789/0 conn(0x7fef70133f50 legacy=0x7fef7013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.174+0000 7fef6e59c700 1 -- 172.21.15.154:0/1572138785 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7009e6a0 con 0x7fef700a0a70 2023-09-30T22:22:52.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.174+0000 7fef6e59c700 1 --2- 172.21.15.154:0/1572138785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef700a0e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef60009920 tx=0x7fef60009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b7cd7f754b55f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.174+0000 7fef6d59a700 1 -- 172.21.15.154:0/1572138785 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6000ba60 con 0x7fef700a0a70 2023-09-30T22:22:52.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.174+0000 7fef6d59a700 1 -- 172.21.15.154:0/1572138785 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6000bbc0 con 0x7fef700a0a70 2023-09-30T22:22:52.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.174+0000 7fef6d59a700 1 -- 172.21.15.154:0/1572138785 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60009e70 con 0x7fef700a0a70 2023-09-30T22:22:52.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.175+0000 7fef74f9f700 1 -- 172.21.15.154:0/1572138785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 msgr2=0x7fef700a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.175+0000 7fef74f9f700 1 --2- 172.21.15.154:0/1572138785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef700a0e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef60009920 tx=0x7fef60009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:52.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.175+0000 7fef74f9f700 1 -- 172.21.15.154:0/1572138785 shutdown_connections 2023-09-30T22:22:52.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.175+0000 7fef74f9f700 1 --2- 172.21.15.154:0/1572138785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef700a0e40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.175+0000 7fef74f9f700 1 --2- 172.21.15.154:0/1572138785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a1380 0x7fef70133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.175+0000 7fef74f9f700 1 -- 172.21.15.154:0/1572138785 >> 172.21.15.154:0/1572138785 conn(0x7fef700a6610 msgr2=0x7fef700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.175+0000 7fef74f9f700 1 -- 172.21.15.154:0/1572138785 shutdown_connections 2023-09-30T22:22:52.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.175+0000 7fef74f9f700 1 -- 172.21.15.154:0/1572138785 wait complete. 2023-09-30T22:22:52.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.176+0000 7fef74f9f700 1 Processor -- start 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.176+0000 7fef74f9f700 1 -- start start 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef74f9f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef7011e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef74f9f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef700a1380 0x7fef7011ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef74f9f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef70133f50 0x7fef7011f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef74f9f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef70120650 con 0x7fef700a1380 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef74f9f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef70120ab0 con 0x7fef70133f50 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef74f9f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef70122100 con 0x7fef700a0a70 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef700a1380 0x7fef7011ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef700a1380 0x7fef7011ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47742/0 (socket says 172.21.15.154:47742) 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6dd9b700 1 -- 172.21.15.154:0/1377827956 learned_addr learned my addr 172.21.15.154:0/1377827956 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6e59c700 1 --2- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef7011e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6ed9d700 1 --2- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef70133f50 0x7fef7011f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6dd9b700 1 -- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 msgr2=0x7fef7011e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6dd9b700 1 --2- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef7011e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6dd9b700 1 -- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef70133f50 msgr2=0x7fef7011f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6dd9b700 1 --2- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef70133f50 0x7fef7011f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.177+0000 7fef6dd9b700 1 -- 172.21.15.154:0/1377827956 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60009550 con 0x7fef700a1380 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.178+0000 7fef6dd9b700 1 --2- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef700a1380 0x7fef7011ee00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fef6400b530 tx=0x7fef6400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.178+0000 7fef5effd700 1 -- 172.21.15.154:0/1377827956 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64011830 con 0x7fef700a1380 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.178+0000 7fef5effd700 1 -- 172.21.15.154:0/1377827956 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef640119b0 con 0x7fef700a1380 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.178+0000 7fef5effd700 1 -- 172.21.15.154:0/1377827956 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64011d60 con 0x7fef700a1380 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.178+0000 7fef74f9f700 1 -- 172.21.15.154:0/1377827956 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef70133850 con 0x7fef700a1380 2023-09-30T22:22:52.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.178+0000 7fef74f9f700 1 -- 172.21.15.154:0/1377827956 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef70120cc0 con 0x7fef700a1380 2023-09-30T22:22:52.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.179+0000 7fef74f9f700 1 -- 172.21.15.154:0/1377827956 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7004f2a0 con 0x7fef700a1380 2023-09-30T22:22:52.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.179+0000 7fef5effd700 1 -- 172.21.15.154:0/1377827956 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef6401a400 con 0x7fef700a1380 2023-09-30T22:22:52.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.179+0000 7fef5effd700 1 -- 172.21.15.154:0/1377827956 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef6403f740 con 0x7fef700a1380 2023-09-30T22:22:52.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.184+0000 7fef5effd700 1 -- 172.21.15.154:0/1377827956 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef6400f8d0 con 0x7fef700a1380 2023-09-30T22:22:52.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.388+0000 7f4805a69700 1 -- 172.21.15.154:0/4091854651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f480004f2a0 con 0x7f480012cb80 2023-09-30T22:22:52.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.388+0000 7f47e7fff700 1 -- 172.21.15.154:0/4091854651 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47f0023ba0 con 0x7f480012cb80 2023-09-30T22:22:52.389 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:52.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.390+0000 7f4805a69700 1 -- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f480012cb80 msgr2=0x7f4800138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.390+0000 7f4805a69700 1 --2- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f480012cb80 0x7f4800138fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009c40 tx=0x7f47f0004750 comp rx=0 tx=0).stop 2023-09-30T22:22:52.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.390+0000 7f4805a69700 1 -- 172.21.15.154:0/4091854651 shutdown_connections 2023-09-30T22:22:52.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.390+0000 7f4805a69700 1 --2- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4800130460 0x7f480012a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.390+0000 7f4805a69700 1 --2- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f480012cb80 0x7f4800138fd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.390+0000 7f4805a69700 1 --2- 172.21.15.154:0/4091854651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f480012fab0 0x7f4800139510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.391+0000 7f4805a69700 1 -- 172.21.15.154:0/4091854651 >> 172.21.15.154:0/4091854651 conn(0x7f48000a2eb0 msgr2=0x7f480012d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.391+0000 7f4805a69700 1 -- 172.21.15.154:0/4091854651 shutdown_connections 2023-09-30T22:22:52.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.391+0000 7f4805a69700 1 -- 172.21.15.154:0/4091854651 wait complete. 2023-09-30T22:22:52.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.394+0000 7fd3cef4e700 1 -- 172.21.15.154:0/96419775 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd3c804f2a0 con 0x7fd3c806fd80 2023-09-30T22:22:52.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.395+0000 7fd3c57fa700 1 -- 172.21.15.154:0/96419775 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3b4017020 con 0x7fd3c806fd80 2023-09-30T22:22:52.396 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:52.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.397+0000 7fd3cef4e700 1 -- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3c806fd80 msgr2=0x7fd3c81cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.397+0000 7fd3cef4e700 1 --2- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3c806fd80 0x7fd3c81cd350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4000f60 tx=0x7fd3b400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.398+0000 7fd3cef4e700 1 -- 172.21.15.154:0/96419775 shutdown_connections 2023-09-30T22:22:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.398+0000 7fd3cef4e700 1 --2- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c8137dd0 0x7fd3c8126550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.398+0000 7fd3cef4e700 1 --2- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3c806f1d0 0x7fd3c81cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.398+0000 7fd3cef4e700 1 --2- 172.21.15.154:0/96419775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3c806fd80 0x7fd3c81cd350 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.398+0000 7fd3cef4e700 1 -- 172.21.15.154:0/96419775 >> 172.21.15.154:0/96419775 conn(0x7fd3c80a2810 msgr2=0x7fd3c80a0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.398+0000 7fd3cef4e700 1 -- 172.21.15.154:0/96419775 shutdown_connections 2023-09-30T22:22:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.398+0000 7fd3cef4e700 1 -- 172.21.15.154:0/96419775 wait complete. 2023-09-30T22:22:52.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:52.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:52.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.424+0000 7fef74f9f700 1 -- 172.21.15.154:0/1377827956 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef70121ef0 con 0x7fef700a1380 2023-09-30T22:22:52.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.425+0000 7fef5effd700 1 -- 172.21.15.154:0/1377827956 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef64015070 con 0x7fef700a1380 2023-09-30T22:22:52.426 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.427+0000 7fef74f9f700 1 -- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef700a1380 msgr2=0x7fef7011ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.427+0000 7fef74f9f700 1 --2- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef700a1380 0x7fef7011ee00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fef6400b530 tx=0x7fef6400b840 comp rx=0 tx=0).stop 2023-09-30T22:22:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.427+0000 7fef74f9f700 1 -- 172.21.15.154:0/1377827956 shutdown_connections 2023-09-30T22:22:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.427+0000 7fef74f9f700 1 --2- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef70133f50 0x7fef7011f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.427+0000 7fef74f9f700 1 --2- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef700a0a70 0x7fef7011e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.427+0000 7fef74f9f700 1 --2- 172.21.15.154:0/1377827956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef700a1380 0x7fef7011ee00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.427+0000 7fef74f9f700 1 -- 172.21.15.154:0/1377827956 >> 172.21.15.154:0/1377827956 conn(0x7fef700a6610 msgr2=0x7fef700a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.427+0000 7fef74f9f700 1 -- 172.21.15.154:0/1377827956 shutdown_connections 2023-09-30T22:22:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.427+0000 7fef74f9f700 1 -- 172.21.15.154:0/1377827956 wait complete. 2023-09-30T22:22:52.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.439+0000 7fdeecd71700 1 -- 172.21.15.154:0/1991971849 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdee811a590 con 0x7fdee80a0ee0 2023-09-30T22:22:52.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.440+0000 7fded6ffd700 1 -- 172.21.15.154:0/1991971849 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fded80283d0 con 0x7fdee80a0ee0 2023-09-30T22:22:52.442 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:52.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.442+0000 7fdeecd71700 1 -- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee80a0ee0 msgr2=0x7fdee811d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.442+0000 7fdeecd71700 1 --2- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee80a0ee0 0x7fdee811d980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdee8133820 tx=0x7fded8004750 comp rx=0 tx=0).stop 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.442+0000 7fdeecd71700 1 -- 172.21.15.154:0/1991971849 shutdown_connections 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.442+0000 7fdeecd71700 1 --2- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee8134210 0x7fdee811e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.442+0000 7fdeecd71700 1 --2- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdee80a0ee0 0x7fdee811d980 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.442+0000 7fdeecd71700 1 --2- 172.21.15.154:0/1991971849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee8133900 0x7fdee811dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.442+0000 7fdeecd71700 1 -- 172.21.15.154:0/1991971849 >> 172.21.15.154:0/1991971849 conn(0x7fdee80a2980 msgr2=0x7fdee81baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:52.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.442+0000 7fdeecd71700 1 -- 172.21.15.154:0/1991971849 shutdown_connections 2023-09-30T22:22:52.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:52.442+0000 7fdeecd71700 1 -- 172.21.15.154:0/1991971849 wait complete. 2023-09-30T22:22:52.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:53.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:53.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:53.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:53.456 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:53.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.549+0000 7fd1384a6700 1 Processor -- start 2023-09-30T22:22:53.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.549+0000 7fd1384a6700 1 -- start start 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.550+0000 7fd1384a6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.550+0000 7fd1384a6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd13009e170 0x7fd1301307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.550+0000 7fd1384a6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13009aaa0 con 0x7fd130130ce0 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.550+0000 7fd1384a6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13009f870 con 0x7fd13009e170 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.550+0000 7fd1384a6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13009b360 con 0x7fd13009d860 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.550+0000 7fd136242700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.550+0000 7fd136242700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43598/0 (socket says 172.21.15.154:43598) 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.550+0000 7fd136242700 1 -- 172.21.15.154:0/2408860018 learned_addr learned my addr 172.21.15.154:0/2408860018 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.550+0000 7fd135a41700 1 --2- 172.21.15.154:0/2408860018 >> v2:172.21.15.154:3300/0 conn(0x7fd13009e170 0x7fd1301307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.551+0000 7fd136242700 1 -- 172.21.15.154:0/2408860018 >> v2:172.21.15.154:3300/0 conn(0x7fd13009e170 msgr2=0x7fd1301307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.551+0000 7fd136242700 1 --2- 172.21.15.154:0/2408860018 >> v2:172.21.15.154:3300/0 conn(0x7fd13009e170 0x7fd1301307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.551+0000 7fd136242700 1 -- 172.21.15.154:0/2408860018 >> v1:172.21.15.154:6789/0 conn(0x7fd130130ce0 legacy=0x7fd1301379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.551+0000 7fd136242700 1 -- 172.21.15.154:0/2408860018 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13009b620 con 0x7fd13009d860 2023-09-30T22:22:53.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.551+0000 7fd136242700 1 --2- 172.21.15.154:0/2408860018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13009dc30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0098f0 tx=0x7fd12c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cd86a4634f13b88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.551+0000 7fd135240700 1 -- 172.21.15.154:0/2408860018 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c011830 con 0x7fd13009d860 2023-09-30T22:22:53.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.551+0000 7fd135240700 1 -- 172.21.15.154:0/2408860018 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c011990 con 0x7fd13009d860 2023-09-30T22:22:53.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.551+0000 7fd135240700 1 -- 172.21.15.154:0/2408860018 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c011d20 con 0x7fd13009d860 2023-09-30T22:22:53.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.552+0000 7fd1384a6700 1 -- 172.21.15.154:0/2408860018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 msgr2=0x7fd13009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.552+0000 7fd1384a6700 1 --2- 172.21.15.154:0/2408860018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13009dc30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0098f0 tx=0x7fd12c009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:53.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.552+0000 7fd1384a6700 1 -- 172.21.15.154:0/2408860018 shutdown_connections 2023-09-30T22:22:53.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.552+0000 7fd1384a6700 1 --2- 172.21.15.154:0/2408860018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13009dc30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.552+0000 7fd1384a6700 1 --2- 172.21.15.154:0/2408860018 >> v2:172.21.15.154:3300/0 conn(0x7fd13009e170 0x7fd1301307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.552+0000 7fd1384a6700 1 -- 172.21.15.154:0/2408860018 >> 172.21.15.154:0/2408860018 conn(0x7fd130099c40 msgr2=0x7fd1300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.552+0000 7fd1384a6700 1 -- 172.21.15.154:0/2408860018 shutdown_connections 2023-09-30T22:22:53.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.552+0000 7fd1384a6700 1 -- 172.21.15.154:0/2408860018 wait complete. 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.554+0000 7fd1384a6700 1 Processor -- start 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.554+0000 7fd1384a6700 1 -- start start 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.554+0000 7fd1384a6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13011f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.554+0000 7fd1384a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13009e170 0x7fd13011f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.554+0000 7fd1384a6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd130130ce0 0x7fd1301c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.554+0000 7fd1384a6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130121220 con 0x7fd13009e170 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.554+0000 7fd1384a6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd130121e40 con 0x7fd130130ce0 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.554+0000 7fd1384a6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13011eee0 con 0x7fd13009d860 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd135a41700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13009e170 0x7fd13011f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd135a41700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13009e170 0x7fd13011f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47770/0 (socket says 172.21.15.154:47770) 2023-09-30T22:22:53.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd135a41700 1 -- 172.21.15.154:0/955950270 learned_addr learned my addr 172.21.15.154:0/955950270 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:53.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd136242700 1 --2- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13011f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd136a43700 1 --2- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd130130ce0 0x7fd1301c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd136242700 1 -- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd130130ce0 msgr2=0x7fd1301c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd136242700 1 --2- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd130130ce0 0x7fd1301c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd136242700 1 -- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13009e170 msgr2=0x7fd13011f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd136242700 1 --2- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13009e170 0x7fd13011f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd136242700 1 -- 172.21.15.154:0/955950270 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c009550 con 0x7fd13009d860 2023-09-30T22:22:53.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd136242700 1 --2- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13011f310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd12c016000 tx=0x7fd12c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.555+0000 7fd126ffd700 1 -- 172.21.15.154:0/955950270 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0036a0 con 0x7fd13009d860 2023-09-30T22:22:53.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.556+0000 7fd126ffd700 1 -- 172.21.15.154:0/955950270 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c003800 con 0x7fd13009d860 2023-09-30T22:22:53.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.556+0000 7fd1384a6700 1 -- 172.21.15.154:0/955950270 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13009c910 con 0x7fd13009d860 2023-09-30T22:22:53.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.556+0000 7fd126ffd700 1 -- 172.21.15.154:0/955950270 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c003b90 con 0x7fd13009d860 2023-09-30T22:22:53.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.556+0000 7fd1384a6700 1 -- 172.21.15.154:0/955950270 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd130122b70 con 0x7fd13009d860 2023-09-30T22:22:53.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.556+0000 7fd126ffd700 1 -- 172.21.15.154:0/955950270 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd12c021070 con 0x7fd13009d860 2023-09-30T22:22:53.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.557+0000 7fd126ffd700 1 -- 172.21.15.154:0/955950270 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd12c040a90 con 0x7fd13009d860 2023-09-30T22:22:53.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.557+0000 7fd124ff9700 1 -- 172.21.15.154:0/955950270 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c0052e0 con 0x7fd13009d860 2023-09-30T22:22:53.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.566+0000 7fd126ffd700 1 -- 172.21.15.154:0/955950270 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd12c015080 con 0x7fd13009d860 2023-09-30T22:22:53.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.589+0000 7f3170c36700 1 Processor -- start 2023-09-30T22:22:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.589+0000 7f3170c36700 1 -- start start 2023-09-30T22:22:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.589+0000 7f3170c36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f316c093d60 0x7f316c094130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.589+0000 7f3170c36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c138200 0x7f316c13fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f3170c36700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c0741b0 con 0x7f316c094670 2023-09-30T22:22:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f3170c36700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c094fa0 con 0x7f316c093d60 2023-09-30T22:22:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f3170c36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c09ebb0 con 0x7f316c138200 2023-09-30T22:22:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f316a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f316c093d60 0x7f316c094130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f316ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c138200 0x7f316c13fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f3169d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f316c094670 0x7f316c137af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41278/0 (socket says 172.21.15.154:41278) 2023-09-30T22:22:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f3169d9b700 1 -- 172.21.15.154:0/3862786753 learned_addr learned my addr 172.21.15.154:0/3862786753 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f316a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f316c093d60 0x7f316c094130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47772/0 (socket says 172.21.15.154:47772) 2023-09-30T22:22:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f316a59c700 1 -- 172.21.15.154:0/3862786753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c138200 msgr2=0x7f316c13fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f316a59c700 1 --2- 172.21.15.154:0/3862786753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c138200 0x7f316c13fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f316a59c700 1 -- 172.21.15.154:0/3862786753 >> v1:172.21.15.154:6789/0 conn(0x7f316c094670 legacy=0x7f316c137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f316a59c700 1 -- 172.21.15.154:0/3862786753 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c094c50 con 0x7f316c093d60 2023-09-30T22:22:53.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f1b55849700 1 Processor -- start 2023-09-30T22:22:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f316a59c700 1 --2- 172.21.15.154:0/3862786753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c093d60 0x7f316c094130 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f315c009840 tx=0x7f315c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb67935e4c5d144d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.590+0000 7f1b55849700 1 -- start start 2023-09-30T22:22:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b55849700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b5009c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b55849700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b50134330 0x7f1b5013bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f316959a700 1 -- 172.21.15.154:0/3862786753 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c011830 con 0x7f316c093d60 2023-09-30T22:22:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b55849700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5009a8e0 con 0x7f1b501337d0 2023-09-30T22:22:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b55849700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5009ad30 con 0x7f1b50134330 2023-09-30T22:22:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b55849700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5009a620 con 0x7f1b5009bd20 2023-09-30T22:22:53.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b4effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b5009c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b4effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b5009c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47922/0 (socket says 172.21.15.154:47922) 2023-09-30T22:22:53.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b4effd700 1 -- 172.21.15.154:0/3566612185 learned_addr learned my addr 172.21.15.154:0/3566612185 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:53.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b4f7fe700 1 --2- 172.21.15.154:0/3566612185 >> v2:172.21.15.154:3300/0 conn(0x7f1b50134330 0x7f1b5013bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f316959a700 1 -- 172.21.15.154:0/3862786753 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c011990 con 0x7f316c093d60 2023-09-30T22:22:53.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f316959a700 1 -- 172.21.15.154:0/3862786753 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c011d20 con 0x7f316c093d60 2023-09-30T22:22:53.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b4effd700 1 -- 172.21.15.154:0/3566612185 >> v2:172.21.15.154:3300/0 conn(0x7f1b50134330 msgr2=0x7f1b5013bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b4effd700 1 --2- 172.21.15.154:0/3566612185 >> v2:172.21.15.154:3300/0 conn(0x7f1b50134330 0x7f1b5013bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b4effd700 1 -- 172.21.15.154:0/3566612185 >> v1:172.21.15.154:6789/0 conn(0x7f1b501337d0 legacy=0x7f1b50133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.591+0000 7f1b4effd700 1 -- 172.21.15.154:0/3566612185 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5009b840 con 0x7f1b5009bd20 2023-09-30T22:22:53.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f1b4effd700 1 --2- 172.21.15.154:0/3566612185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b5009c0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b44006fd0 tx=0x7f1b44009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80a923783e0cf834 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f1b4dffb700 1 -- 172.21.15.154:0/3566612185 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44005e30 con 0x7f1b5009bd20 2023-09-30T22:22:53.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f1b4dffb700 1 -- 172.21.15.154:0/3566612185 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44004030 con 0x7f1b5009bd20 2023-09-30T22:22:53.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f1b4dffb700 1 -- 172.21.15.154:0/3566612185 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b440043e0 con 0x7f1b5009bd20 2023-09-30T22:22:53.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f3170c36700 1 -- 172.21.15.154:0/3862786753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c093d60 msgr2=0x7f316c094130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f3170c36700 1 --2- 172.21.15.154:0/3862786753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c093d60 0x7f316c094130 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f315c009840 tx=0x7f315c009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:53.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f3170c36700 1 -- 172.21.15.154:0/3862786753 shutdown_connections 2023-09-30T22:22:53.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f3170c36700 1 --2- 172.21.15.154:0/3862786753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c138200 0x7f316c13fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f3170c36700 1 --2- 172.21.15.154:0/3862786753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c093d60 0x7f316c094130 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f3170c36700 1 -- 172.21.15.154:0/3862786753 >> 172.21.15.154:0/3862786753 conn(0x7f316c0a2eb0 msgr2=0x7f316c09eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f3170c36700 1 -- 172.21.15.154:0/3862786753 shutdown_connections 2023-09-30T22:22:53.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.592+0000 7f3170c36700 1 -- 172.21.15.154:0/3862786753 wait complete. 2023-09-30T22:22:53.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f1b55849700 1 -- 172.21.15.154:0/3566612185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 msgr2=0x7f1b5009c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f1b55849700 1 --2- 172.21.15.154:0/3566612185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b5009c0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b44006fd0 tx=0x7f1b44009bd0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f1b55849700 1 -- 172.21.15.154:0/3566612185 shutdown_connections 2023-09-30T22:22:53.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f1b55849700 1 --2- 172.21.15.154:0/3566612185 >> v2:172.21.15.154:3300/0 conn(0x7f1b50134330 0x7f1b5013bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f1b55849700 1 --2- 172.21.15.154:0/3566612185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b5009c0f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f1b55849700 1 -- 172.21.15.154:0/3566612185 >> 172.21.15.154:0/3566612185 conn(0x7f1b5009f9f0 msgr2=0x7f1b5009fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f1b55849700 1 -- 172.21.15.154:0/3566612185 shutdown_connections 2023-09-30T22:22:53.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f1b55849700 1 -- 172.21.15.154:0/3566612185 wait complete. 2023-09-30T22:22:53.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f3170c36700 1 Processor -- start 2023-09-30T22:22:53.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.593+0000 7f3170c36700 1 -- start start 2023-09-30T22:22:53.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f1b55849700 1 Processor -- start 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f3170c36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f316c093d60 0x7f316c072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f3170c36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c094670 0x7f316c0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f3170c36700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c138200 0x7f316c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f3170c36700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c070a60 con 0x7f316c138200 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f3170c36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0986a0 con 0x7f316c094670 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f3170c36700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f316c06fba0 con 0x7f316c093d60 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f316ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c138200 0x7f316c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f316ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c138200 0x7f316c06dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47798/0 (socket says 172.21.15.154:47798) 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f316ad9d700 1 -- 172.21.15.154:0/2156089407 learned_addr learned my addr 172.21.15.154:0/2156089407 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:53.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f3169d9b700 1 --2- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c094670 0x7f316c0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f1b55849700 1 -- start start 2023-09-30T22:22:53.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f1b55849700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b501ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f1b55849700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b501337d0 0x7f1b501cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f1b55849700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b50134330 0x7f1b5006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f1b55849700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5009cd20 con 0x7f1b50134330 2023-09-30T22:22:53.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f1b55849700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50070530 con 0x7f1b5009bd20 2023-09-30T22:22:53.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.594+0000 7f1b55849700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500a27c0 con 0x7f1b501337d0 2023-09-30T22:22:53.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f316ad9d700 1 -- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f316c093d60 msgr2=0x7f316c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f316ad9d700 1 --2- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f316c093d60 0x7f316c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f316ad9d700 1 -- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c094670 msgr2=0x7f316c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f316ad9d700 1 --2- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c094670 0x7f316c0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f316ad9d700 1 -- 172.21.15.154:0/2156089407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0094a0 con 0x7f316c138200 2023-09-30T22:22:53.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f1b4f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b50134330 0x7f1b5006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f1b4f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b50134330 0x7f1b5006e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47814/0 (socket says 172.21.15.154:47814) 2023-09-30T22:22:53.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f1b4f7fe700 1 -- 172.21.15.154:0/2414614699 learned_addr learned my addr 172.21.15.154:0/2414614699 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:53.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f316ad9d700 1 --2- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c138200 0x7f316c06dc70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f316400efc0 tx=0x7f316400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f1b4effd700 1 --2- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b501ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f315affd700 1 -- 172.21.15.154:0/2156089407 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316400cd40 con 0x7f316c138200 2023-09-30T22:22:53.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f1b4f7fe700 1 -- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b501337d0 msgr2=0x7f1b501cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f1b4f7fe700 1 --2- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b501337d0 0x7f1b501cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f1b4f7fe700 1 -- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 msgr2=0x7f1b501ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f1b4f7fe700 1 --2- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b501ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f1b4f7fe700 1 -- 172.21.15.154:0/2414614699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b44009500 con 0x7f1b50134330 2023-09-30T22:22:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f1b4f7fe700 1 --2- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b50134330 0x7f1b5006e950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800efc0 tx=0x7f1b4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f1b37fff700 1 -- 172.21.15.154:0/2414614699 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48009ea0 con 0x7f1b50134330 2023-09-30T22:22:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f1b37fff700 1 -- 172.21.15.154:0/2414614699 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4800f040 con 0x7f1b50134330 2023-09-30T22:22:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f1b37fff700 1 -- 172.21.15.154:0/2414614699 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48014480 con 0x7f1b50134330 2023-09-30T22:22:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f1b55849700 1 -- 172.21.15.154:0/2414614699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b500720c0 con 0x7f1b50134330 2023-09-30T22:22:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f1b55849700 1 -- 172.21.15.154:0/2414614699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b500723a0 con 0x7f1b50134330 2023-09-30T22:22:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f315affd700 1 -- 172.21.15.154:0/2156089407 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316400f040 con 0x7f316c138200 2023-09-30T22:22:53.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f3170c36700 1 -- 172.21.15.154:0/2156089407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c093430 con 0x7f316c138200 2023-09-30T22:22:53.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f315affd700 1 -- 172.21.15.154:0/2156089407 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31640146c0 con 0x7f316c138200 2023-09-30T22:22:53.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.595+0000 7f3170c36700 1 -- 172.21.15.154:0/2156089407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c06fe60 con 0x7f316c138200 2023-09-30T22:22:53.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.596+0000 7f3170c36700 1 -- 172.21.15.154:0/2156089407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c097f30 con 0x7f316c138200 2023-09-30T22:22:53.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.597+0000 7f1b37fff700 1 -- 172.21.15.154:0/2414614699 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b480145e0 con 0x7f1b50134330 2023-09-30T22:22:53.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.597+0000 7f1b37fff700 1 -- 172.21.15.154:0/2414614699 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b480403c0 con 0x7f1b50134330 2023-09-30T22:22:53.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.598+0000 7f315affd700 1 -- 172.21.15.154:0/2156089407 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3164014820 con 0x7f316c138200 2023-09-30T22:22:53.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.598+0000 7f315affd700 1 -- 172.21.15.154:0/2156089407 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f31640408f0 con 0x7f316c138200 2023-09-30T22:22:53.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.599+0000 7f1b55849700 1 -- 172.21.15.154:0/2414614699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5004f2a0 con 0x7f1b50134330 2023-09-30T22:22:53.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.602+0000 7f315affd700 1 -- 172.21.15.154:0/2156089407 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3164012910 con 0x7f316c138200 2023-09-30T22:22:53.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.607+0000 7f1b37fff700 1 -- 172.21.15.154:0/2414614699 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b48018070 con 0x7f1b50134330 2023-09-30T22:22:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.667+0000 7fa8b5c3a700 1 Processor -- start 2023-09-30T22:22:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.667+0000 7fa8b5c3a700 1 -- start start 2023-09-30T22:22:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8b5c3a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8b5c3a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8b5c3a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0133f50 0x7fa8b0134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8b5c3a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b009e9d0 con 0x7fa8b00a1380 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8b5c3a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b009dc00 con 0x7fa8b0133f50 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8b5c3a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b009dec0 con 0x7fa8b00a0a70 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8af7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8affff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0133f50 0x7fa8b0134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8af7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43624/0 (socket says 172.21.15.154:43624) 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8af7fe700 1 -- 172.21.15.154:0/766337910 learned_addr learned my addr 172.21.15.154:0/766337910 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8aeffd700 1 --2- 172.21.15.154:0/766337910 >> v2:172.21.15.154:3300/0 conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8affff700 1 -- 172.21.15.154:0/766337910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 msgr2=0x7fa8b00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8affff700 1 --2- 172.21.15.154:0/766337910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8affff700 1 -- 172.21.15.154:0/766337910 >> v2:172.21.15.154:3300/0 conn(0x7fa8b00a1380 msgr2=0x7fa8b0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8affff700 1 --2- 172.21.15.154:0/766337910 >> v2:172.21.15.154:3300/0 conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8affff700 1 -- 172.21.15.154:0/766337910 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b009e6a0 con 0x7fa8b0133f50 2023-09-30T22:22:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.668+0000 7fa8aeffd700 1 --2- 172.21.15.154:0/766337910 >> v2:172.21.15.154:3300/0 conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.669+0000 7fa8affff700 1 --2- 172.21.15.154:0/766337910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0133f50 0x7fa8b0134380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009d90 tx=0x7fa8a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b083d0f37a09c323 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.669+0000 7fa8ae7fc700 1 -- 172.21.15.154:0/766337910 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a800e070 con 0x7fa8b0133f50 2023-09-30T22:22:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.669+0000 7fa8ae7fc700 1 -- 172.21.15.154:0/766337910 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a800bb20 con 0x7fa8b0133f50 2023-09-30T22:22:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.669+0000 7fa8ae7fc700 1 -- 172.21.15.154:0/766337910 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8012430 con 0x7fa8b0133f50 2023-09-30T22:22:53.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.670+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/766337910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0133f50 msgr2=0x7fa8b0134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.670+0000 7fa8b5c3a700 1 --2- 172.21.15.154:0/766337910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0133f50 0x7fa8b0134380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009d90 tx=0x7fa8a800b330 comp rx=0 tx=0).stop 2023-09-30T22:22:53.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.670+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/766337910 shutdown_connections 2023-09-30T22:22:53.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.670+0000 7fa8b5c3a700 1 --2- 172.21.15.154:0/766337910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0133f50 0x7fa8b0134380 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.670+0000 7fa8b5c3a700 1 --2- 172.21.15.154:0/766337910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.670+0000 7fa8b5c3a700 1 --2- 172.21.15.154:0/766337910 >> v2:172.21.15.154:3300/0 conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.670+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/766337910 >> 172.21.15.154:0/766337910 conn(0x7fa8b00a6610 msgr2=0x7fa8b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.670+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/766337910 shutdown_connections 2023-09-30T22:22:53.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.670+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/766337910 wait complete. 2023-09-30T22:22:53.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.671+0000 7fa8b5c3a700 1 Processor -- start 2023-09-30T22:22:53.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.671+0000 7fa8b5c3a700 1 -- start start 2023-09-30T22:22:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.671+0000 7fa8b5c3a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 0x7fa8b0122330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.671+0000 7fa8b5c3a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b00a1380 0x7fa8b0122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.671+0000 7fa8b5c3a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b0133f50 0x7fa8b0122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.671+0000 7fa8b5c3a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0123800 con 0x7fa8b0133f50 2023-09-30T22:22:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.671+0000 7fa8b5c3a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0125bb0 con 0x7fa8b00a1380 2023-09-30T22:22:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.671+0000 7fa8b5c3a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0126300 con 0x7fa8b00a0a70 2023-09-30T22:22:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8affff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b0133f50 0x7fa8b0122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8affff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b0133f50 0x7fa8b0122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47828/0 (socket says 172.21.15.154:47828) 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8affff700 1 -- 172.21.15.154:0/2810930432 learned_addr learned my addr 172.21.15.154:0/2810930432 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8aeffd700 1 --2- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b00a1380 0x7fa8b0122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8af7fe700 1 --2- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 0x7fa8b0122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8affff700 1 -- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 msgr2=0x7fa8b0122330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8affff700 1 --2- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 0x7fa8b0122330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8affff700 1 -- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b00a1380 msgr2=0x7fa8b0122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8affff700 1 --2- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b00a1380 0x7fa8b0122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8affff700 1 -- 172.21.15.154:0/2810930432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a40094a0 con 0x7fa8b0133f50 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8affff700 1 --2- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b0133f50 0x7fa8b0122db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa8b009dd40 tx=0x7fa8a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa897fff700 1 -- 172.21.15.154:0/2810930432 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8004450 con 0x7fa8b0133f50 2023-09-30T22:22:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa897fff700 1 -- 172.21.15.154:0/2810930432 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8020070 con 0x7fa8b0133f50 2023-09-30T22:22:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/2810930432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a8009a70 con 0x7fa8b0133f50 2023-09-30T22:22:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa897fff700 1 -- 172.21.15.154:0/2810930432 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8004810 con 0x7fa8b0133f50 2023-09-30T22:22:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.672+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/2810930432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b00a03e0 con 0x7fa8b0133f50 2023-09-30T22:22:53.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.674+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/2810930432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0123ef0 con 0x7fa8b0133f50 2023-09-30T22:22:53.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.674+0000 7fa897fff700 1 -- 172.21.15.154:0/2810930432 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8a8031430 con 0x7fa8b0133f50 2023-09-30T22:22:53.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.675+0000 7fa897fff700 1 -- 172.21.15.154:0/2810930432 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa8a8022070 con 0x7fa8b0133f50 2023-09-30T22:22:53.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.683+0000 7fa897fff700 1 -- 172.21.15.154:0/2810930432 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8a8012430 con 0x7fa8b0133f50 2023-09-30T22:22:53.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.804+0000 7f1b55849700 1 -- 172.21.15.154:0/2414614699 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1b50072d60 con 0x7f1b50134330 2023-09-30T22:22:53.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.805+0000 7f1b37fff700 1 -- 172.21.15.154:0/2414614699 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b4802c090 con 0x7f1b50134330 2023-09-30T22:22:53.806 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:53.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.808+0000 7f1b55849700 1 -- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b50134330 msgr2=0x7f1b5006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.808+0000 7f1b55849700 1 --2- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b50134330 0x7f1b5006e950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800efc0 tx=0x7f1b4800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.808+0000 7f1b55849700 1 -- 172.21.15.154:0/2414614699 shutdown_connections 2023-09-30T22:22:53.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.808+0000 7f1b55849700 1 --2- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b50134330 0x7f1b5006e950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.808+0000 7f1b55849700 1 --2- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5009bd20 0x7f1b501ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.808+0000 7f1b55849700 1 --2- 172.21.15.154:0/2414614699 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b501337d0 0x7f1b501cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.808+0000 7f1b55849700 1 -- 172.21.15.154:0/2414614699 >> 172.21.15.154:0/2414614699 conn(0x7f1b5009f9f0 msgr2=0x7f1b501bb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.809+0000 7f1b55849700 1 -- 172.21.15.154:0/2414614699 shutdown_connections 2023-09-30T22:22:53.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.809+0000 7f1b55849700 1 -- 172.21.15.154:0/2414614699 wait complete. 2023-09-30T22:22:53.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.822+0000 7fd124ff9700 1 -- 172.21.15.154:0/955950270 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd10c005590 con 0x7fd13009d860 2023-09-30T22:22:53.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.823+0000 7fd126ffd700 1 -- 172.21.15.154:0/955950270 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd12c00b3e0 con 0x7fd13009d860 2023-09-30T22:22:53.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.823+0000 7f3170c36700 1 -- 172.21.15.154:0/2156089407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f316c137fb0 con 0x7f316c138200 2023-09-30T22:22:53.824 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:53.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.823+0000 7f315affd700 1 -- 172.21.15.154:0/2156089407 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f316402a090 con 0x7f316c138200 2023-09-30T22:22:53.825 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:53.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:53.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7f3170c36700 1 -- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c138200 msgr2=0x7f316c06dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7f3170c36700 1 --2- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c138200 0x7f316c06dc70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f316400efc0 tx=0x7f316400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7f3170c36700 1 -- 172.21.15.154:0/2156089407 shutdown_connections 2023-09-30T22:22:53.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7f3170c36700 1 --2- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c138200 0x7f316c06dc70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7f3170c36700 1 --2- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f316c093d60 0x7f316c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7f3170c36700 1 --2- 172.21.15.154:0/2156089407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c094670 0x7f316c0726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7f3170c36700 1 -- 172.21.15.154:0/2156089407 >> 172.21.15.154:0/2156089407 conn(0x7f316c0a2eb0 msgr2=0x7f316c09be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7f3170c36700 1 -- 172.21.15.154:0/2156089407 shutdown_connections 2023-09-30T22:22:53.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7f3170c36700 1 -- 172.21.15.154:0/2156089407 wait complete. 2023-09-30T22:22:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7fd124ff9700 1 -- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 msgr2=0x7fd13011f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.826+0000 7fd124ff9700 1 --2- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13011f310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd12c016000 tx=0x7fd12c004750 comp rx=0 tx=0).stop 2023-09-30T22:22:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.827+0000 7fd124ff9700 1 -- 172.21.15.154:0/955950270 shutdown_connections 2023-09-30T22:22:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.827+0000 7fd124ff9700 1 --2- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd130130ce0 0x7fd1301c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.827+0000 7fd124ff9700 1 --2- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13009d860 0x7fd13011f310 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.827+0000 7fd124ff9700 1 --2- 172.21.15.154:0/955950270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13009e170 0x7fd13011f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.827+0000 7fd124ff9700 1 -- 172.21.15.154:0/955950270 >> 172.21.15.154:0/955950270 conn(0x7fd130099c40 msgr2=0x7fd130070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.827+0000 7fd124ff9700 1 -- 172.21.15.154:0/955950270 shutdown_connections 2023-09-30T22:22:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.827+0000 7fd124ff9700 1 -- 172.21.15.154:0/955950270 wait complete. 2023-09-30T22:22:53.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:53.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.908+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/2810930432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa8b004f2a0 con 0x7fa8b0133f50 2023-09-30T22:22:53.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.909+0000 7fa897fff700 1 -- 172.21.15.154:0/2810930432 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8a8011390 con 0x7fa8b0133f50 2023-09-30T22:22:53.910 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:53.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.911+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b0133f50 msgr2=0x7fa8b0122db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:53.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.911+0000 7fa8b5c3a700 1 --2- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b0133f50 0x7fa8b0122db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa8b009dd40 tx=0x7fa8a8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.911+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/2810930432 shutdown_connections 2023-09-30T22:22:53.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.911+0000 7fa8b5c3a700 1 --2- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b0133f50 0x7fa8b0122db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.911+0000 7fa8b5c3a700 1 --2- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b00a0a70 0x7fa8b0122330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.911+0000 7fa8b5c3a700 1 --2- 172.21.15.154:0/2810930432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b00a1380 0x7fa8b0122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:53.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.911+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/2810930432 >> 172.21.15.154:0/2810930432 conn(0x7fa8b00a6610 msgr2=0x7fa8b009b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:53.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.911+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/2810930432 shutdown_connections 2023-09-30T22:22:53.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:53.911+0000 7fa8b5c3a700 1 -- 172.21.15.154:0/2810930432 wait complete. 2023-09-30T22:22:53.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:54.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:54.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:54.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:54.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:54.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.981+0000 7f1943dbd700 1 Processor -- start 2023-09-30T22:22:54.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.981+0000 7f1943dbd700 1 -- start start 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1943dbd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1943dbd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1943dbd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f193c1304a0 0x7f193c1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1943dbd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c130e30 con 0x7f193c1304a0 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1943dbd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0a1e70 con 0x7f193c0a1340 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1943dbd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193c09a720 con 0x7f193c0a0a30 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1941358700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f194235a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f193c1304a0 0x7f193c1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1941358700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c12ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47970/0 (socket says 172.21.15.154:47970) 2023-09-30T22:22:54.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1941b59700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:54.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f194235a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f193c1304a0 0x7f193c1308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47844/0 (socket says 172.21.15.154:47844) 2023-09-30T22:22:54.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1941358700 1 -- 172.21.15.154:0/1268239491 learned_addr learned my addr 172.21.15.154:0/1268239491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:54.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1941b59700 1 -- 172.21.15.154:0/1268239491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 msgr2=0x7f193c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:54.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1941b59700 1 --2- 172.21.15.154:0/1268239491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1941b59700 1 -- 172.21.15.154:0/1268239491 >> v2:172.21.15.154:3300/0 conn(0x7f193c1304a0 msgr2=0x7f193c1308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:54.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1941b59700 1 --2- 172.21.15.154:0/1268239491 >> v2:172.21.15.154:3300/0 conn(0x7f193c1304a0 0x7f193c1308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.982+0000 7f1941b59700 1 -- 172.21.15.154:0/1268239491 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c09b300 con 0x7f193c0a0a30 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.983+0000 7f1941358700 1 --2- 172.21.15.154:0/1268239491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.983+0000 7f1941b59700 1 --2- 172.21.15.154:0/1268239491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c0a0e00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1938009820 tx=0x7f1938009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33bd4c2052ad5b44 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.983+0000 7f1940b57700 1 -- 172.21.15.154:0/1268239491 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938005e30 con 0x7f193c0a0a30 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.983+0000 7f1940b57700 1 -- 172.21.15.154:0/1268239491 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938006030 con 0x7f193c0a0a30 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.983+0000 7f1940b57700 1 -- 172.21.15.154:0/1268239491 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380063c0 con 0x7f193c0a0a30 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.984+0000 7f1943dbd700 1 -- 172.21.15.154:0/1268239491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 msgr2=0x7f193c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.984+0000 7f1943dbd700 1 --2- 172.21.15.154:0/1268239491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c0a0e00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1938009820 tx=0x7f1938009b30 comp rx=0 tx=0).stop 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.984+0000 7f1943dbd700 1 -- 172.21.15.154:0/1268239491 shutdown_connections 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.984+0000 7f1943dbd700 1 --2- 172.21.15.154:0/1268239491 >> v2:172.21.15.154:3300/0 conn(0x7f193c1304a0 0x7f193c1308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.984+0000 7f1943dbd700 1 --2- 172.21.15.154:0/1268239491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c0a0e00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.984+0000 7f1943dbd700 1 --2- 172.21.15.154:0/1268239491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.984+0000 7f1943dbd700 1 -- 172.21.15.154:0/1268239491 >> 172.21.15.154:0/1268239491 conn(0x7f193c0a2980 msgr2=0x7f193c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:54.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.984+0000 7f1943dbd700 1 -- 172.21.15.154:0/1268239491 shutdown_connections 2023-09-30T22:22:54.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.984+0000 7f1943dbd700 1 -- 172.21.15.154:0/1268239491 wait complete. 2023-09-30T22:22:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.985+0000 7f1943dbd700 1 Processor -- start 2023-09-30T22:22:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.985+0000 7f1943dbd700 1 -- start start 2023-09-30T22:22:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f1943dbd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c11af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f1943dbd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c11b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f1943dbd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c1304a0 0x7f193c11b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f1943dbd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c11cd20 con 0x7f193c1304a0 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f1943dbd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c11cb30 con 0x7f193c0a1340 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f1943dbd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193c11ea40 con 0x7f193c0a0a30 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f194235a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c1304a0 0x7f193c11b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f1941358700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c11b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f194235a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c1304a0 0x7f193c11b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47854/0 (socket says 172.21.15.154:47854) 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f194235a700 1 -- 172.21.15.154:0/3519823276 learned_addr learned my addr 172.21.15.154:0/3519823276 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f1941358700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c11b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47974/0 (socket says 172.21.15.154:47974) 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f1941b59700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c11af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f194235a700 1 -- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 msgr2=0x7f193c11af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f194235a700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c11af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f194235a700 1 -- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 msgr2=0x7f193c11b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f194235a700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c11b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.986+0000 7f194235a700 1 -- 172.21.15.154:0/3519823276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c00a6f0 con 0x7f193c1304a0 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.987+0000 7f1941358700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c11b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.987+0000 7f1941b59700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c11af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.987+0000 7f194235a700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c1304a0 0x7f193c11b9a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1934007e70 tx=0x7f193400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.987+0000 7f19327fc700 1 -- 172.21.15.154:0/3519823276 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400ede0 con 0x7f193c1304a0 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.987+0000 7f19327fc700 1 -- 172.21.15.154:0/3519823276 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1934014420 con 0x7f193c1304a0 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.987+0000 7f1943dbd700 1 -- 172.21.15.154:0/3519823276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1938009430 con 0x7f193c1304a0 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.987+0000 7f19327fc700 1 -- 172.21.15.154:0/3519823276 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340147d0 con 0x7f193c1304a0 2023-09-30T22:22:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.987+0000 7f1943dbd700 1 -- 172.21.15.154:0/3519823276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c11e760 con 0x7f193c1304a0 2023-09-30T22:22:54.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.988+0000 7f19327fc700 1 -- 172.21.15.154:0/3519823276 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1934014930 con 0x7f193c1304a0 2023-09-30T22:22:54.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.988+0000 7f1943dbd700 1 -- 172.21.15.154:0/3519823276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c11e5c0 con 0x7f193c1304a0 2023-09-30T22:22:54.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.988+0000 7f19327fc700 1 -- 172.21.15.154:0/3519823276 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f193403fe00 con 0x7f193c1304a0 2023-09-30T22:22:54.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:54.996+0000 7f19327fc700 1 -- 172.21.15.154:0/3519823276 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f193c11e5c0 con 0x7f193c1304a0 2023-09-30T22:22:55.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.010+0000 7fa5ffa54700 1 Processor -- start 2023-09-30T22:22:55.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.011+0000 7fa5ffa54700 1 -- start start 2023-09-30T22:22:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.011+0000 7fa5ffa54700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa5f80a0a70 0x7fa5f80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.011+0000 7fa5ffa54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.011+0000 7fa5ffa54700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f809dc00 con 0x7fa5f8133f50 2023-09-30T22:22:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.011+0000 7fa5ffa54700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f809ea60 con 0x7fa5f80a0a70 2023-09-30T22:22:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.011+0000 7fa5ffa54700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f809dec0 con 0x7fa5f80a1380 2023-09-30T22:22:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.011+0000 7fa5fcfef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.011+0000 7fa5fcfef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47978/0 (socket says 172.21.15.154:47978) 2023-09-30T22:22:55.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.011+0000 7fa5fcfef700 1 -- 172.21.15.154:0/101137054 learned_addr learned my addr 172.21.15.154:0/101137054 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.012+0000 7fa5fcfef700 1 -- 172.21.15.154:0/101137054 >> v2:172.21.15.154:3300/0 conn(0x7fa5f80a0a70 msgr2=0x7fa5f80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.012+0000 7fa5fcfef700 1 --2- 172.21.15.154:0/101137054 >> v2:172.21.15.154:3300/0 conn(0x7fa5f80a0a70 0x7fa5f80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.012+0000 7fa5fcfef700 1 -- 172.21.15.154:0/101137054 >> v1:172.21.15.154:6789/0 conn(0x7fa5f8133f50 legacy=0x7fa5f813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.012+0000 7fa5fcfef700 1 -- 172.21.15.154:0/101137054 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f809e6a0 con 0x7fa5f80a1380 2023-09-30T22:22:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.012+0000 7fa5fcfef700 1 --2- 172.21.15.154:0/101137054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8133a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80098f0 tx=0x7fa5e8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=209e34316270cdeb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.012+0000 7fa5effff700 1 -- 172.21.15.154:0/101137054 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8004230 con 0x7fa5f80a1380 2023-09-30T22:22:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.012+0000 7fa5effff700 1 -- 172.21.15.154:0/101137054 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8004390 con 0x7fa5f80a1380 2023-09-30T22:22:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.012+0000 7fa5effff700 1 -- 172.21.15.154:0/101137054 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80036a0 con 0x7fa5f80a1380 2023-09-30T22:22:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.013+0000 7fa5ffa54700 1 -- 172.21.15.154:0/101137054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 msgr2=0x7fa5f8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.013+0000 7fa5ffa54700 1 --2- 172.21.15.154:0/101137054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8133a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80098f0 tx=0x7fa5e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.013+0000 7fa5ffa54700 1 -- 172.21.15.154:0/101137054 shutdown_connections 2023-09-30T22:22:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.013+0000 7fa5ffa54700 1 --2- 172.21.15.154:0/101137054 >> v2:172.21.15.154:3300/0 conn(0x7fa5f80a0a70 0x7fa5f80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.013+0000 7fa5ffa54700 1 --2- 172.21.15.154:0/101137054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8133a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.013+0000 7fa5ffa54700 1 -- 172.21.15.154:0/101137054 >> 172.21.15.154:0/101137054 conn(0x7fa5f80a6610 msgr2=0x7fa5f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.013+0000 7fa5ffa54700 1 -- 172.21.15.154:0/101137054 shutdown_connections 2023-09-30T22:22:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.013+0000 7fa5ffa54700 1 -- 172.21.15.154:0/101137054 wait complete. 2023-09-30T22:22:55.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.014+0000 7fa5ffa54700 1 Processor -- start 2023-09-30T22:22:55.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.014+0000 7fa5ffa54700 1 -- start start 2023-09-30T22:22:55.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5ffa54700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f80a0a70 0x7fa5f8127710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5ffa54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8127c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fe4da17a700 1 Processor -- start 2023-09-30T22:22:55.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5ffa54700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8133f50 0x7fa5f8128190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5ffa54700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8129c90 con 0x7fa5f8133f50 2023-09-30T22:22:55.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5ffa54700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f80a03e0 con 0x7fa5f80a1380 2023-09-30T22:22:55.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5ffa54700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81297f0 con 0x7fa5f80a0a70 2023-09-30T22:22:55.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fe4da17a700 1 -- start start 2023-09-30T22:22:55.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5fdff1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8133f50 0x7fa5f8128190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5fdff1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8133f50 0x7fa5f8128190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47874/0 (socket says 172.21.15.154:47874) 2023-09-30T22:22:55.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5fdff1700 1 -- 172.21.15.154:0/3163412157 learned_addr learned my addr 172.21.15.154:0/3163412157 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:55.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.015+0000 7fa5fcfef700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8127c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4da17a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406b250 0x7fe4d4136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4da17a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d4137140 0x7fe4d4139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4da17a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d409da80 con 0x7fe4d406a770 2023-09-30T22:22:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4da17a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d409dce0 con 0x7fe4d4137140 2023-09-30T22:22:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4da17a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d406b620 con 0x7fe4d406b250 2023-09-30T22:22:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fa5fd7f0700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f80a0a70 0x7fa5f8127710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fa5fdff1700 1 -- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f80a0a70 msgr2=0x7fa5f8127710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4d2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406b250 0x7fe4d4136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4d2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406b250 0x7fe4d4136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:43680/0 (socket says 172.21.15.154:43680) 2023-09-30T22:22:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4d3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d4137140 0x7fe4d4139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4d2ffd700 1 -- 172.21.15.154:0/1590889009 learned_addr learned my addr 172.21.15.154:0/1590889009 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:55.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fa5fdff1700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f80a0a70 0x7fa5f8127710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fa5fdff1700 1 -- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 msgr2=0x7fa5f8127c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fa5fdff1700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8127c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fa5fdff1700 1 -- 172.21.15.154:0/3163412157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009550 con 0x7fa5f8133f50 2023-09-30T22:22:55.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fa5fd7f0700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f80a0a70 0x7fa5f8127710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:55.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4d3fff700 1 -- 172.21.15.154:0/1590889009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406b250 msgr2=0x7fe4d4136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4d3fff700 1 --2- 172.21.15.154:0/1590889009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406b250 0x7fe4d4136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4d3fff700 1 -- 172.21.15.154:0/1590889009 >> v1:172.21.15.154:6789/0 conn(0x7fe4d406a770 legacy=0x7fe4d406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.016+0000 7fe4d3fff700 1 -- 172.21.15.154:0/1590889009 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d409eb20 con 0x7fe4d4137140 2023-09-30T22:22:55.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fe4d3fff700 1 --2- 172.21.15.154:0/1590889009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d4137140 0x7fe4d4139520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009dc0 tx=0x7fe4cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e5e4516849be366 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fa5fdff1700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8133f50 0x7fa5f8128190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000c7a0 tx=0x7fa5f000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fe4d27fc700 1 -- 172.21.15.154:0/1590889009 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00e070 con 0x7fe4d4137140 2023-09-30T22:22:55.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fe4d27fc700 1 -- 172.21.15.154:0/1590889009 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc00bae0 con 0x7fe4d4137140 2023-09-30T22:22:55.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fe4d27fc700 1 -- 172.21.15.154:0/1590889009 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00be90 con 0x7fe4d4137140 2023-09-30T22:22:55.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fe4da17a700 1 -- 172.21.15.154:0/1590889009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d4137140 msgr2=0x7fe4d4139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fe4da17a700 1 --2- 172.21.15.154:0/1590889009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d4137140 0x7fe4d4139520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009dc0 tx=0x7fe4cc00b330 comp rx=0 tx=0).stop 2023-09-30T22:22:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fa5edffb700 1 -- 172.21.15.154:0/3163412157 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0003e10 con 0x7fa5f8133f50 2023-09-30T22:22:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fa5edffb700 1 -- 172.21.15.154:0/3163412157 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f0005070 con 0x7fa5f8133f50 2023-09-30T22:22:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.017+0000 7fa5ffa54700 1 -- 172.21.15.154:0/3163412157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f812a4f0 con 0x7fa5f8133f50 2023-09-30T22:22:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.018+0000 7fa5edffb700 1 -- 172.21.15.154:0/3163412157 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0005420 con 0x7fa5f8133f50 2023-09-30T22:22:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.018+0000 7fa5ffa54700 1 -- 172.21.15.154:0/3163412157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f8128b80 con 0x7fa5f8133f50 2023-09-30T22:22:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.018+0000 7fe4da17a700 1 -- 172.21.15.154:0/1590889009 shutdown_connections 2023-09-30T22:22:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.018+0000 7fe4da17a700 1 --2- 172.21.15.154:0/1590889009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d4137140 0x7fe4d4139520 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.018+0000 7fe4da17a700 1 --2- 172.21.15.154:0/1590889009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406b250 0x7fe4d4136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.018+0000 7fe4da17a700 1 -- 172.21.15.154:0/1590889009 >> 172.21.15.154:0/1590889009 conn(0x7fe4d4099c40 msgr2=0x7fe4d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.018+0000 7fe4da17a700 1 -- 172.21.15.154:0/1590889009 shutdown_connections 2023-09-30T22:22:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.018+0000 7fe4da17a700 1 -- 172.21.15.154:0/1590889009 wait complete. 2023-09-30T22:22:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fe4da17a700 1 Processor -- start 2023-09-30T22:22:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fa5edffb700 1 -- 172.21.15.154:0/3163412157 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5f0005580 con 0x7fa5f8133f50 2023-09-30T22:22:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fe4da17a700 1 -- start start 2023-09-30T22:22:55.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fa5edffb700 1 -- 172.21.15.154:0/3163412157 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa5f003ec80 con 0x7fa5f8133f50 2023-09-30T22:22:55.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fe4da17a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406a770 0x7fe4d411a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fe4da17a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d406b250 0x7fe4d411a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fe4da17a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4d4137140 0x7fe4d411ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fe4da17a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d41213f0 con 0x7fe4d4137140 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fe4da17a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d411dbc0 con 0x7fe4d406b250 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.019+0000 7fe4da17a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d411d620 con 0x7fe4d406a770 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d406b250 0x7fe4d411a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d406b250 0x7fe4d411a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47998/0 (socket says 172.21.15.154:47998) 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d2ffd700 1 -- 172.21.15.154:0/905237850 learned_addr learned my addr 172.21.15.154:0/905237850 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d37fe700 1 --2- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406a770 0x7fe4d411a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d2ffd700 1 -- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406a770 msgr2=0x7fe4d411a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d2ffd700 1 --2- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406a770 0x7fe4d411a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d2ffd700 1 -- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4d4137140 msgr2=0x7fe4d411ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d2ffd700 1 --2- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4d4137140 0x7fe4d411ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d2ffd700 1 -- 172.21.15.154:0/905237850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc009a70 con 0x7fe4d406b250 2023-09-30T22:22:55.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4d2ffd700 1 --2- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d406b250 0x7fe4d411a5e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e910 tx=0x7fe4c800ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4bbfff700 1 -- 172.21.15.154:0/905237850 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80096a0 con 0x7fe4d406b250 2023-09-30T22:22:55.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4da17a700 1 -- 172.21.15.154:0/905237850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d40a05e0 con 0x7fe4d406b250 2023-09-30T22:22:55.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fa5ffa54700 1 -- 172.21.15.154:0/3163412157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f804f2a0 con 0x7fa5f8133f50 2023-09-30T22:22:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4bbfff700 1 -- 172.21.15.154:0/905237850 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c800ee60 con 0x7fe4d406b250 2023-09-30T22:22:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.020+0000 7fe4da17a700 1 -- 172.21.15.154:0/905237850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d411d8e0 con 0x7fe4d406b250 2023-09-30T22:22:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.021+0000 7fe4bbfff700 1 -- 172.21.15.154:0/905237850 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800ca90 con 0x7fe4d406b250 2023-09-30T22:22:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.021+0000 7fe4bbfff700 1 -- 172.21.15.154:0/905237850 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4c800cbf0 con 0x7fe4d406b250 2023-09-30T22:22:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.022+0000 7fe4da17a700 1 -- 172.21.15.154:0/905237850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b40052e0 con 0x7fe4d406b250 2023-09-30T22:22:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.022+0000 7fe4bbfff700 1 -- 172.21.15.154:0/905237850 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe4c803fb30 con 0x7fe4d406b250 2023-09-30T22:22:55.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.026+0000 7fe4bbfff700 1 -- 172.21.15.154:0/905237850 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4c8021080 con 0x7fe4d406b250 2023-09-30T22:22:55.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.029+0000 7fa5edffb700 1 -- 172.21.15.154:0/3163412157 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5f0017020 con 0x7fa5f8133f50 2023-09-30T22:22:55.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.074+0000 7f0cf5063700 1 Processor -- start 2023-09-30T22:22:55.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.074+0000 7f0cf5063700 1 -- start start 2023-09-30T22:22:55.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0cf5063700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf00a0a70 0x7f0cf00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0cf5063700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0cf00a1380 0x7f0cf0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0cf5063700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf0133f50 0x7f0cf0134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0cf5063700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf009e9d0 con 0x7f0cf00a1380 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0cf5063700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf009dc00 con 0x7f0cf00a0a70 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0cf5063700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf009dec0 con 0x7f0cf0133f50 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0ceed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf00a0a70 0x7f0cf00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0ceed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf00a0a70 0x7f0cf00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48002/0 (socket says 172.21.15.154:48002) 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0ceed9d700 1 -- 172.21.15.154:0/1059918967 learned_addr learned my addr 172.21.15.154:0/1059918967 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0cef59e700 1 --2- 172.21.15.154:0/1059918967 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf0133f50 0x7f0cf0134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0cee59c700 1 --2- 172.21.15.154:0/1059918967 >> v2:172.21.15.154:3300/0 conn(0x7f0cf00a1380 0x7f0cf0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0ceed9d700 1 -- 172.21.15.154:0/1059918967 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf0133f50 msgr2=0x7f0cf0134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0ceed9d700 1 --2- 172.21.15.154:0/1059918967 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf0133f50 0x7f0cf0134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0ceed9d700 1 -- 172.21.15.154:0/1059918967 >> v2:172.21.15.154:3300/0 conn(0x7f0cf00a1380 msgr2=0x7f0cf0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:55.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0ceed9d700 1 --2- 172.21.15.154:0/1059918967 >> v2:172.21.15.154:3300/0 conn(0x7f0cf00a1380 0x7f0cf0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0ceed9d700 1 -- 172.21.15.154:0/1059918967 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf009e6a0 con 0x7f0cf00a0a70 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.075+0000 7f0cee59c700 1 --2- 172.21.15.154:0/1059918967 >> v2:172.21.15.154:3300/0 conn(0x7f0cf00a1380 0x7f0cf0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.076+0000 7f0ceed9d700 1 --2- 172.21.15.154:0/1059918967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf00a0a70 0x7f0cf00a0e40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00098f0 tx=0x7f0ce0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d3cf322640ab82e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.076+0000 7f0cedd9b700 1 -- 172.21.15.154:0/1059918967 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0011830 con 0x7f0cf00a0a70 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.076+0000 7f0cedd9b700 1 -- 172.21.15.154:0/1059918967 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce0011990 con 0x7f0cf00a0a70 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.076+0000 7f0cedd9b700 1 -- 172.21.15.154:0/1059918967 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0011d20 con 0x7f0cf00a0a70 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.076+0000 7f0cf5063700 1 -- 172.21.15.154:0/1059918967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf00a0a70 msgr2=0x7f0cf00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.076+0000 7f0cf5063700 1 --2- 172.21.15.154:0/1059918967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf00a0a70 0x7f0cf00a0e40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00098f0 tx=0x7f0ce0009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.077+0000 7f0cf5063700 1 -- 172.21.15.154:0/1059918967 shutdown_connections 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.077+0000 7f0cf5063700 1 --2- 172.21.15.154:0/1059918967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf00a0a70 0x7f0cf00a0e40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.077+0000 7f0cf5063700 1 --2- 172.21.15.154:0/1059918967 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf0133f50 0x7f0cf0134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.077+0000 7f0cf5063700 1 --2- 172.21.15.154:0/1059918967 >> v2:172.21.15.154:3300/0 conn(0x7f0cf00a1380 0x7f0cf0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.077+0000 7f0cf5063700 1 -- 172.21.15.154:0/1059918967 >> 172.21.15.154:0/1059918967 conn(0x7f0cf00a6610 msgr2=0x7f0cf00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.077+0000 7f0cf5063700 1 -- 172.21.15.154:0/1059918967 shutdown_connections 2023-09-30T22:22:55.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.077+0000 7f0cf5063700 1 -- 172.21.15.154:0/1059918967 wait complete. 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.078+0000 7f0cf5063700 1 Processor -- start 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.078+0000 7f0cf5063700 1 -- start start 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.078+0000 7f0cf5063700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf00a0a70 0x7f0cf0122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.078+0000 7f0cf5063700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf00a1380 0x7f0cf0122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.078+0000 7f0cf5063700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf0133f50 0x7f0cf0123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.078+0000 7f0cf5063700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0124190 con 0x7f0cf00a0a70 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.078+0000 7f0cf5063700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00a0450 con 0x7f0cf0133f50 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.078+0000 7f0cf5063700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf01239c0 con 0x7f0cf00a1380 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.078+0000 7f0ceed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf00a0a70 0x7f0cf0122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0ceed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf00a0a70 0x7f0cf0122580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47896/0 (socket says 172.21.15.154:47896) 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0ceed9d700 1 -- 172.21.15.154:0/3780030562 learned_addr learned my addr 172.21.15.154:0/3780030562 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0cef59e700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf0133f50 0x7f0cf0123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0cee59c700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf00a1380 0x7f0cf0122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0ceed9d700 1 -- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf00a1380 msgr2=0x7f0cf0122ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0ceed9d700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf00a1380 0x7f0cf0122ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0ceed9d700 1 -- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf0133f50 msgr2=0x7f0cf0123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0ceed9d700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf0133f50 0x7f0cf0123000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0ceed9d700 1 -- 172.21.15.154:0/3780030562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0009550 con 0x7f0cf00a0a70 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0cef59e700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf0133f50 0x7f0cf0123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0ceed9d700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf00a0a70 0x7f0cf0122580 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0014040 tx=0x7f0ce0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:55.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0cd77fe700 1 -- 172.21.15.154:0/3780030562 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0004510 con 0x7f0cf00a0a70 2023-09-30T22:22:55.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0cf5063700 1 -- 172.21.15.154:0/3780030562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf0125dc0 con 0x7f0cf00a0a70 2023-09-30T22:22:55.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.079+0000 7f0cf5063700 1 -- 172.21.15.154:0/3780030562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf01334d0 con 0x7f0cf00a0a70 2023-09-30T22:22:55.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.080+0000 7f0cd77fe700 1 -- 172.21.15.154:0/3780030562 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce001e070 con 0x7f0cf00a0a70 2023-09-30T22:22:55.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.080+0000 7f0cd77fe700 1 -- 172.21.15.154:0/3780030562 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00038e0 con 0x7f0cf00a0a70 2023-09-30T22:22:55.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.080+0000 7f0cd77fe700 1 -- 172.21.15.154:0/3780030562 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ce0003a40 con 0x7f0cf00a0a70 2023-09-30T22:22:55.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.080+0000 7f0cd77fe700 1 -- 172.21.15.154:0/3780030562 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ce0040610 con 0x7f0cf00a0a70 2023-09-30T22:22:55.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.081+0000 7f0cf5063700 1 -- 172.21.15.154:0/3780030562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd00052e0 con 0x7f0cf00a0a70 2023-09-30T22:22:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.090+0000 7f0cd77fe700 1 -- 172.21.15.154:0/3780030562 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ce0003cf0 con 0x7f0cf00a0a70 2023-09-30T22:22:55.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.225+0000 7fa5ffa54700 1 -- 172.21.15.154:0/3163412157 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa5f8072980 con 0x7fa5f8133f50 2023-09-30T22:22:55.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.226+0000 7fa5edffb700 1 -- 172.21.15.154:0/3163412157 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5f0005830 con 0x7fa5f8133f50 2023-09-30T22:22:55.227 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:55.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.227+0000 7fe4da17a700 1 -- 172.21.15.154:0/905237850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4b4005590 con 0x7fe4d406b250 2023-09-30T22:22:55.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.227+0000 7fe4bbfff700 1 -- 172.21.15.154:0/905237850 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4c801b3b0 con 0x7fe4d406b250 2023-09-30T22:22:55.228 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.228+0000 7fa5ffa54700 1 -- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8133f50 msgr2=0x7fa5f8128190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.228+0000 7fa5ffa54700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8133f50 0x7fa5f8128190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000c7a0 tx=0x7fa5f000cab0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.228+0000 7fa5ffa54700 1 -- 172.21.15.154:0/3163412157 shutdown_connections 2023-09-30T22:22:55.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.228+0000 7fa5ffa54700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f8133f50 0x7fa5f8128190 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.228+0000 7fa5ffa54700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f80a0a70 0x7fa5f8127710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.228+0000 7fa5ffa54700 1 --2- 172.21.15.154:0/3163412157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f80a1380 0x7fa5f8127c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.228+0000 7fa5ffa54700 1 -- 172.21.15.154:0/3163412157 >> 172.21.15.154:0/3163412157 conn(0x7fa5f80a6610 msgr2=0x7fa5f80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.229+0000 7fa5ffa54700 1 -- 172.21.15.154:0/3163412157 shutdown_connections 2023-09-30T22:22:55.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.229+0000 7fa5ffa54700 1 -- 172.21.15.154:0/3163412157 wait complete. 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.230+0000 7fe4da17a700 1 -- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d406b250 msgr2=0x7fe4d411a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.230+0000 7fe4da17a700 1 --2- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d406b250 0x7fe4d411a5e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e910 tx=0x7fe4c800ec20 comp rx=0 tx=0).stop 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.230+0000 7fe4da17a700 1 -- 172.21.15.154:0/905237850 shutdown_connections 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.230+0000 7fe4da17a700 1 --2- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4d4137140 0x7fe4d411ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.230+0000 7fe4da17a700 1 --2- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe4d406a770 0x7fe4d411a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.230+0000 7fe4da17a700 1 --2- 172.21.15.154:0/905237850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4d406b250 0x7fe4d411a5e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.230+0000 7fe4da17a700 1 -- 172.21.15.154:0/905237850 >> 172.21.15.154:0/905237850 conn(0x7fe4d4099c40 msgr2=0x7fe4d4136090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.230+0000 7fe4da17a700 1 -- 172.21.15.154:0/905237850 shutdown_connections 2023-09-30T22:22:55.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.230+0000 7fe4da17a700 1 -- 172.21.15.154:0/905237850 wait complete. 2023-09-30T22:22:55.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.232+0000 7f1943dbd700 1 -- 172.21.15.154:0/3519823276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f193c11e5c0 con 0x7f193c1304a0 2023-09-30T22:22:55.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.232+0000 7f19327fc700 1 -- 172.21.15.154:0/3519823276 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f193c11e5c0 con 0x7f193c1304a0 2023-09-30T22:22:55.233 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:55.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.235+0000 7f1943dbd700 1 -- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c1304a0 msgr2=0x7f193c11b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.235+0000 7f1943dbd700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c1304a0 0x7f193c11b9a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1934007e70 tx=0x7f193400e3c0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.236+0000 7f1943dbd700 1 -- 172.21.15.154:0/3519823276 shutdown_connections 2023-09-30T22:22:55.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.236+0000 7f1943dbd700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c1304a0 0x7f193c11b9a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.236+0000 7f1943dbd700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c0a0a30 0x7f193c11af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.236+0000 7f1943dbd700 1 --2- 172.21.15.154:0/3519823276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c0a1340 0x7f193c11b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.236+0000 7f1943dbd700 1 -- 172.21.15.154:0/3519823276 >> 172.21.15.154:0/3519823276 conn(0x7f193c0a2980 msgr2=0x7f193c09deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.236+0000 7f1943dbd700 1 -- 172.21.15.154:0/3519823276 shutdown_connections 2023-09-30T22:22:55.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.236+0000 7f1943dbd700 1 -- 172.21.15.154:0/3519823276 wait complete. 2023-09-30T22:22:55.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:55.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:55.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:55.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.318+0000 7f0cf5063700 1 -- 172.21.15.154:0/3780030562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0cd0005590 con 0x7f0cf00a0a70 2023-09-30T22:22:55.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.319+0000 7f0cd77fe700 1 -- 172.21.15.154:0/3780030562 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ce0015020 con 0x7f0cf00a0a70 2023-09-30T22:22:55.320 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.321+0000 7f0cf5063700 1 -- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf00a0a70 msgr2=0x7f0cf0122580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.321+0000 7f0cf5063700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf00a0a70 0x7f0cf0122580 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0014040 tx=0x7f0ce0004750 comp rx=0 tx=0).stop 2023-09-30T22:22:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.321+0000 7f0cf5063700 1 -- 172.21.15.154:0/3780030562 shutdown_connections 2023-09-30T22:22:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.321+0000 7f0cf5063700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf0133f50 0x7f0cf0123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.321+0000 7f0cf5063700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf00a0a70 0x7f0cf0122580 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.321+0000 7f0cf5063700 1 --2- 172.21.15.154:0/3780030562 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf00a1380 0x7f0cf0122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.321+0000 7f0cf5063700 1 -- 172.21.15.154:0/3780030562 >> 172.21.15.154:0/3780030562 conn(0x7f0cf00a6610 msgr2=0x7f0cf009f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.321+0000 7f0cf5063700 1 -- 172.21.15.154:0/3780030562 shutdown_connections 2023-09-30T22:22:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:55.321+0000 7f0cf5063700 1 -- 172.21.15.154:0/3780030562 wait complete. 2023-09-30T22:22:55.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:56.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:56.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:56.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:56.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:56.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.386+0000 7fa6ddec7700 1 Processor -- start 2023-09-30T22:22:56.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6ddec7700 1 -- start start 2023-09-30T22:22:56.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6ddec7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d80a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6ddec7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6d813dd10 0x7fa6d81400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6ddec7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d81379e0 con 0x7fa6d8138040 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6ddec7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d80a2100 con 0x7fa6d813dd10 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6ddec7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d809b9b0 con 0x7fa6d8138410 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6d6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d80a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6d6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d80a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59560/0 (socket says 172.21.15.154:59560) 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6d6ffd700 1 -- 172.21.15.154:0/487196538 learned_addr learned my addr 172.21.15.154:0/487196538 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.387+0000 7fa6d7fff700 1 --2- 172.21.15.154:0/487196538 >> v2:172.21.15.154:3300/0 conn(0x7fa6d813dd10 0x7fa6d81400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.388+0000 7fa6d6ffd700 1 -- 172.21.15.154:0/487196538 >> v2:172.21.15.154:3300/0 conn(0x7fa6d813dd10 msgr2=0x7fa6d81400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.388+0000 7fa6d6ffd700 1 --2- 172.21.15.154:0/487196538 >> v2:172.21.15.154:3300/0 conn(0x7fa6d813dd10 0x7fa6d81400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.388+0000 7fa6d6ffd700 1 -- 172.21.15.154:0/487196538 >> v1:172.21.15.154:6789/0 conn(0x7fa6d8138040 legacy=0x7fa6d80a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.388+0000 7fa6d6ffd700 1 -- 172.21.15.154:0/487196538 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8137c10 con 0x7fa6d8138410 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.388+0000 7fa6d6ffd700 1 --2- 172.21.15.154:0/487196538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d80a0ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009920 tx=0x7fa6cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ee1407b71248d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.388+0000 7fa6d67fc700 1 -- 172.21.15.154:0/487196538 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc011830 con 0x7fa6d8138410 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.388+0000 7fa6d67fc700 1 -- 172.21.15.154:0/487196538 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc011990 con 0x7fa6d8138410 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.388+0000 7fa6d67fc700 1 -- 172.21.15.154:0/487196538 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc011d20 con 0x7fa6d8138410 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.389+0000 7fa6ddec7700 1 -- 172.21.15.154:0/487196538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 msgr2=0x7fa6d80a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.389+0000 7fa6ddec7700 1 --2- 172.21.15.154:0/487196538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d80a0ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009920 tx=0x7fa6cc009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.389+0000 7fa6ddec7700 1 -- 172.21.15.154:0/487196538 shutdown_connections 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.389+0000 7fa6ddec7700 1 --2- 172.21.15.154:0/487196538 >> v2:172.21.15.154:3300/0 conn(0x7fa6d813dd10 0x7fa6d81400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.389+0000 7fa6ddec7700 1 --2- 172.21.15.154:0/487196538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d80a0ff0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.389+0000 7fa6ddec7700 1 -- 172.21.15.154:0/487196538 >> 172.21.15.154:0/487196538 conn(0x7fa6d80a2980 msgr2=0x7fa6d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.389+0000 7fa6ddec7700 1 -- 172.21.15.154:0/487196538 shutdown_connections 2023-09-30T22:22:56.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.389+0000 7fa6ddec7700 1 -- 172.21.15.154:0/487196538 wait complete. 2023-09-30T22:22:56.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.390+0000 7fa6ddec7700 1 Processor -- start 2023-09-30T22:22:56.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.390+0000 7fa6ddec7700 1 -- start start 2023-09-30T22:22:56.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6ddec7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6d8138040 0x7fa6d8136f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6ddec7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d81374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6ddec7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d813dd10 0x7fa6d8135740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6ddec7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d812fea0 con 0x7fa6d813dd10 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6ddec7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d813c190 con 0x7fa6d8138040 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6ddec7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d813d260 con 0x7fa6d8138410 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6d8138040 0x7fa6d8136f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6d8138040 0x7fa6d8136f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35710/0 (socket says 172.21.15.154:35710) 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d77fe700 1 -- 172.21.15.154:0/3246440224 learned_addr learned my addr 172.21.15.154:0/3246440224 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d7fff700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d813dd10 0x7fa6d8135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d6ffd700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d81374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d77fe700 1 -- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 msgr2=0x7fa6d81374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d77fe700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d81374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d77fe700 1 -- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d813dd10 msgr2=0x7fa6d8135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d77fe700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d813dd10 0x7fa6d8135740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d77fe700 1 -- 172.21.15.154:0/3246440224 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc009550 con 0x7fa6d8138040 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.391+0000 7fa6d7fff700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d813dd10 0x7fa6d8135740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.392+0000 7fa6d77fe700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6d8138040 0x7fa6d8136f60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c430 tx=0x7fa6c800c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.392+0000 7fa6bffff700 1 -- 172.21.15.154:0/3246440224 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80054e0 con 0x7fa6d8138040 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.392+0000 7fa6bffff700 1 -- 172.21.15.154:0/3246440224 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c800ce40 con 0x7fa6d8138040 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.392+0000 7fa6ddec7700 1 -- 172.21.15.154:0/3246440224 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d809a240 con 0x7fa6d8138040 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.392+0000 7fa6ddec7700 1 -- 172.21.15.154:0/3246440224 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d8119120 con 0x7fa6d8138040 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.393+0000 7fa6bffff700 1 -- 172.21.15.154:0/3246440224 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80038c0 con 0x7fa6d8138040 2023-09-30T22:22:56.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.393+0000 7fa6bffff700 1 -- 172.21.15.154:0/3246440224 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6c8003a20 con 0x7fa6d8138040 2023-09-30T22:22:56.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.393+0000 7fa6bffff700 1 -- 172.21.15.154:0/3246440224 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa6c80409b0 con 0x7fa6d8138040 2023-09-30T22:22:56.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.394+0000 7fa6ddec7700 1 -- 172.21.15.154:0/3246440224 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b80052e0 con 0x7fa6d8138040 2023-09-30T22:22:56.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.398+0000 7fa6bffff700 1 -- 172.21.15.154:0/3246440224 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6d8119120 con 0x7fa6d8138040 2023-09-30T22:22:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.427+0000 7fcbf419a700 1 Processor -- start 2023-09-30T22:22:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.428+0000 7fcbf419a700 1 -- start start 2023-09-30T22:22:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.428+0000 7fcbf419a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcbec09a150 0x7fcbec09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.428+0000 7fcbf419a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09f1a0 0x7fcbec134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.428+0000 7fcbf419a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec09af80 con 0x7fcbec09edb0 2023-09-30T22:22:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.428+0000 7fcbf419a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec09a520 con 0x7fcbec09a150 2023-09-30T22:22:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.428+0000 7fcbf419a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec09fe00 con 0x7fcbec09f1a0 2023-09-30T22:22:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.428+0000 7fcbf1f36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcbec09a150 0x7fcbec09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.428+0000 7fcbf1f36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcbec09a150 0x7fcbec09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38950/0 (socket says 172.21.15.154:38950) 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.428+0000 7fcbf1f36700 1 -- 172.21.15.154:0/1733152491 learned_addr learned my addr 172.21.15.154:0/1733152491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf2737700 1 --2- 172.21.15.154:0/1733152491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09f1a0 0x7fcbec134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf1f36700 1 -- 172.21.15.154:0/1733152491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09f1a0 msgr2=0x7fcbec134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf1f36700 1 --2- 172.21.15.154:0/1733152491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09f1a0 0x7fcbec134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf0f34700 1 -- 172.21.15.154:0/1733152491 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202720547 0 0) 0x7fcbec09af80 con 0x7fcbec09edb0 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf1f36700 1 -- 172.21.15.154:0/1733152491 >> v1:172.21.15.154:6789/0 conn(0x7fcbec09edb0 legacy=0x7fcbec133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf1f36700 1 -- 172.21.15.154:0/1733152491 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec06bc20 con 0x7fcbec09a150 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf1f36700 1 --2- 172.21.15.154:0/1733152491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09a150 0x7fcbec09e870 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80098f0 tx=0x7fcbe8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e6d6b6829acdd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf0f34700 1 -- 172.21.15.154:0/1733152491 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011830 con 0x7fcbec09a150 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf0f34700 1 -- 172.21.15.154:0/1733152491 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011990 con 0x7fcbec09a150 2023-09-30T22:22:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.429+0000 7fcbf0f34700 1 -- 172.21.15.154:0/1733152491 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011d20 con 0x7fcbec09a150 2023-09-30T22:22:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.430+0000 7fcbf419a700 1 -- 172.21.15.154:0/1733152491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09a150 msgr2=0x7fcbec09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.430+0000 7fcbf419a700 1 --2- 172.21.15.154:0/1733152491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09a150 0x7fcbec09e870 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80098f0 tx=0x7fcbe8009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.430+0000 7fcbf419a700 1 -- 172.21.15.154:0/1733152491 shutdown_connections 2023-09-30T22:22:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.430+0000 7fcbf419a700 1 --2- 172.21.15.154:0/1733152491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09f1a0 0x7fcbec134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.430+0000 7fcbf419a700 1 --2- 172.21.15.154:0/1733152491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09a150 0x7fcbec09e870 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.430+0000 7fcbf419a700 1 -- 172.21.15.154:0/1733152491 >> 172.21.15.154:0/1733152491 conn(0x7fcbec0a4430 msgr2=0x7fcbec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.430+0000 7fcbf419a700 1 -- 172.21.15.154:0/1733152491 shutdown_connections 2023-09-30T22:22:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.430+0000 7fcbf419a700 1 -- 172.21.15.154:0/1733152491 wait complete. 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.431+0000 7fcbf419a700 1 Processor -- start 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.431+0000 7fcbf419a700 1 -- start start 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf419a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcbec09a150 0x7fcbec1a5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf419a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09edb0 0x7fcbec1a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf419a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09f1a0 0x7fcbec1a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf419a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec1aa460 con 0x7fcbec09f1a0 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf419a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec1a7b90 con 0x7fcbec09edb0 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf419a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec1a81b0 con 0x7fcbec09a150 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf1735700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09edb0 0x7fcbec1a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf2737700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09f1a0 0x7fcbec1a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf1735700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09edb0 0x7fcbec1a64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35728/0 (socket says 172.21.15.154:35728) 2023-09-30T22:22:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf1735700 1 -- 172.21.15.154:0/564326150 learned_addr learned my addr 172.21.15.154:0/564326150 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf1f36700 1 --2- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcbec09a150 0x7fcbec1a5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf2737700 1 -- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcbec09a150 msgr2=0x7fcbec1a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf2737700 1 --2- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcbec09a150 0x7fcbec1a5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf2737700 1 -- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09edb0 msgr2=0x7fcbec1a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf2737700 1 --2- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09edb0 0x7fcbec1a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.432+0000 7fcbf2737700 1 -- 172.21.15.154:0/564326150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8009550 con 0x7fcbec09f1a0 2023-09-30T22:22:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.433+0000 7fcbf2737700 1 --2- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09f1a0 0x7fcbec1a6a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009d90 tx=0x7fcbe400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.433+0000 7fcbe27fc700 1 -- 172.21.15.154:0/564326150 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4009c00 con 0x7fcbec09f1a0 2023-09-30T22:22:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.433+0000 7fcbf419a700 1 -- 172.21.15.154:0/564326150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec1a8de0 con 0x7fcbec09f1a0 2023-09-30T22:22:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.433+0000 7fcbf419a700 1 -- 172.21.15.154:0/564326150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec0a0440 con 0x7fcbec09f1a0 2023-09-30T22:22:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.433+0000 7fcbe27fc700 1 -- 172.21.15.154:0/564326150 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe400f040 con 0x7fcbec09f1a0 2023-09-30T22:22:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.433+0000 7fcbe27fc700 1 -- 172.21.15.154:0/564326150 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4014480 con 0x7fcbec09f1a0 2023-09-30T22:22:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.434+0000 7fcbe27fc700 1 -- 172.21.15.154:0/564326150 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbe40145e0 con 0x7fcbec09f1a0 2023-09-30T22:22:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.434+0000 7fcbe27fc700 1 -- 172.21.15.154:0/564326150 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcbe40401b0 con 0x7fcbec09f1a0 2023-09-30T22:22:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.434+0000 7fcbf419a700 1 -- 172.21.15.154:0/564326150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd40052e0 con 0x7fcbec09f1a0 2023-09-30T22:22:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.440+0000 7fcbe27fc700 1 -- 172.21.15.154:0/564326150 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbe4018030 con 0x7fcbec09f1a0 2023-09-30T22:22:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.441+0000 7f5a78af4700 1 Processor -- start 2023-09-30T22:22:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.441+0000 7f5a78af4700 1 -- start start 2023-09-30T22:22:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a78af4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a74133ad0 0x7f5a74133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a78af4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a78af4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 0x7f5a7413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a78af4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7406b2d0 con 0x7f5a74133ad0 2023-09-30T22:22:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a78af4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a74133610 con 0x7f5a741309f0 2023-09-30T22:22:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a78af4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7409a500 con 0x7f5a741300a0 2023-09-30T22:22:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a71d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a72d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 0x7f5a7413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a71d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59574/0 (socket says 172.21.15.154:59574) 2023-09-30T22:22:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a71d9b700 1 -- 172.21.15.154:0/4279859215 learned_addr learned my addr 172.21.15.154:0/4279859215 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a7259c700 1 --2- 172.21.15.154:0/4279859215 >> v2:172.21.15.154:3300/0 conn(0x7f5a74133ad0 0x7f5a74133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a71d9b700 1 -- 172.21.15.154:0/4279859215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 msgr2=0x7f5a7413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a71d9b700 1 --2- 172.21.15.154:0/4279859215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 0x7f5a7413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a71d9b700 1 -- 172.21.15.154:0/4279859215 >> v2:172.21.15.154:3300/0 conn(0x7f5a74133ad0 msgr2=0x7f5a74133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a71d9b700 1 --2- 172.21.15.154:0/4279859215 >> v2:172.21.15.154:3300/0 conn(0x7f5a74133ad0 0x7f5a74133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a71d9b700 1 -- 172.21.15.154:0/4279859215 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a741338b0 con 0x7f5a741300a0 2023-09-30T22:22:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.442+0000 7f5a71d9b700 1 --2- 172.21.15.154:0/4279859215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741304b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a680098f0 tx=0x7f5a68009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2698226901c16d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a7159a700 1 -- 172.21.15.154:0/4279859215 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68011830 con 0x7f5a741300a0 2023-09-30T22:22:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a7159a700 1 -- 172.21.15.154:0/4279859215 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a68011990 con 0x7f5a741300a0 2023-09-30T22:22:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a7159a700 1 -- 172.21.15.154:0/4279859215 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68011d20 con 0x7f5a741300a0 2023-09-30T22:22:56.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a78af4700 1 -- 172.21.15.154:0/4279859215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 msgr2=0x7f5a741304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a78af4700 1 --2- 172.21.15.154:0/4279859215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741304b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5a680098f0 tx=0x7f5a68009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a78af4700 1 -- 172.21.15.154:0/4279859215 shutdown_connections 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a78af4700 1 --2- 172.21.15.154:0/4279859215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 0x7f5a7413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a78af4700 1 --2- 172.21.15.154:0/4279859215 >> v2:172.21.15.154:3300/0 conn(0x7f5a74133ad0 0x7f5a74133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a78af4700 1 --2- 172.21.15.154:0/4279859215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741304b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.443+0000 7f5a78af4700 1 -- 172.21.15.154:0/4279859215 >> 172.21.15.154:0/4279859215 conn(0x7f5a74099c40 msgr2=0x7f5a740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.444+0000 7f5a78af4700 1 -- 172.21.15.154:0/4279859215 shutdown_connections 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.444+0000 7f5a78af4700 1 -- 172.21.15.154:0/4279859215 wait complete. 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a78af4700 1 Processor -- start 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a78af4700 1 -- start start 2023-09-30T22:22:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a78af4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a78af4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 0x7f5a741c1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a78af4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a74133ad0 0x7f5a741c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a78af4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7411b6e0 con 0x7f5a74133ad0 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a78af4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7411ac00 con 0x7f5a741309f0 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a78af4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a741c1780 con 0x7f5a741300a0 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a71d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 0x7f5a741c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a71d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 0x7f5a741c1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35740/0 (socket says 172.21.15.154:35740) 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a71d9b700 1 -- 172.21.15.154:0/2168468497 learned_addr learned my addr 172.21.15.154:0/2168468497 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a7259c700 1 --2- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.445+0000 7f5a72d9d700 1 --2- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a74133ad0 0x7f5a741c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a7259c700 1 -- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 msgr2=0x7f5a741c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a7259c700 1 --2- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 0x7f5a741c1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a7259c700 1 -- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a74133ad0 msgr2=0x7f5a741c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a7259c700 1 --2- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a74133ad0 0x7f5a741c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a7259c700 1 -- 172.21.15.154:0/2168468497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68009550 con 0x7f5a741300a0 2023-09-30T22:22:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a7259c700 1 --2- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741c0d00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5a640140f0 tx=0x7f5a64014400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a62ffd700 1 -- 172.21.15.154:0/2168468497 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64014e90 con 0x7f5a741300a0 2023-09-30T22:22:56.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a62ffd700 1 -- 172.21.15.154:0/2168468497 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64016030 con 0x7f5a741300a0 2023-09-30T22:22:56.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a62ffd700 1 -- 172.21.15.154:0/2168468497 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64011310 con 0x7f5a741300a0 2023-09-30T22:22:56.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a78af4700 1 -- 172.21.15.154:0/2168468497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a74072640 con 0x7f5a741300a0 2023-09-30T22:22:56.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.446+0000 7f5a78af4700 1 -- 172.21.15.154:0/2168468497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a740a3400 con 0x7f5a741300a0 2023-09-30T22:22:56.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.447+0000 7f5a62ffd700 1 -- 172.21.15.154:0/2168468497 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a64011470 con 0x7f5a741300a0 2023-09-30T22:22:56.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.448+0000 7f5a62ffd700 1 -- 172.21.15.154:0/2168468497 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a64047d00 con 0x7f5a741300a0 2023-09-30T22:22:56.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.448+0000 7f5a78af4700 1 -- 172.21.15.154:0/2168468497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7411b280 con 0x7f5a741300a0 2023-09-30T22:22:56.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.457+0000 7f5a62ffd700 1 -- 172.21.15.154:0/2168468497 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a6401a930 con 0x7f5a741300a0 2023-09-30T22:22:56.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.471+0000 7f2bc2cc9700 1 Processor -- start 2023-09-30T22:22:56.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.472+0000 7f2bc2cc9700 1 -- start start 2023-09-30T22:22:56.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.472+0000 7f2bc2cc9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2bbc09f430 0x7f2bbc136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.472+0000 7f2bc2cc9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc1393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.472+0000 7f2bc2cc9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc09b6d0 con 0x7f2bbc09e950 2023-09-30T22:22:56.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.472+0000 7f2bc2cc9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc09afb0 con 0x7f2bbc09f430 2023-09-30T22:22:56.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.472+0000 7f2bc2cc9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc0a0970 con 0x7f2bbc137010 2023-09-30T22:22:56.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.472+0000 7f2bbbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2bbc09f430 0x7f2bbc136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bbbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2bbc09f430 0x7f2bbc136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38972/0 (socket says 172.21.15.154:38972) 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bbbfff700 1 -- 172.21.15.154:0/1349664116 learned_addr learned my addr 172.21.15.154:0/1349664116 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bc1266700 1 --2- 172.21.15.154:0/1349664116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc1393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bc1266700 1 -- 172.21.15.154:0/1349664116 >> v2:172.21.15.154:3300/0 conn(0x7f2bbc09f430 msgr2=0x7f2bbc136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bc1266700 1 --2- 172.21.15.154:0/1349664116 >> v2:172.21.15.154:3300/0 conn(0x7f2bbc09f430 0x7f2bbc136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bc1266700 1 -- 172.21.15.154:0/1349664116 >> v1:172.21.15.154:6789/0 conn(0x7f2bbc09e950 legacy=0x7f2bbc09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bc1266700 1 -- 172.21.15.154:0/1349664116 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc0a0320 con 0x7f2bbc137010 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bc1266700 1 --2- 172.21.15.154:0/1349664116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc1393f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009d90 tx=0x7f2bb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c641c61ef77bfb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bbb7fe700 1 -- 172.21.15.154:0/1349664116 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400e070 con 0x7f2bbc137010 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bbb7fe700 1 -- 172.21.15.154:0/1349664116 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb400bb20 con 0x7f2bbc137010 2023-09-30T22:22:56.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.473+0000 7f2bbb7fe700 1 -- 172.21.15.154:0/1349664116 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4012430 con 0x7f2bbc137010 2023-09-30T22:22:56.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.474+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/1349664116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 msgr2=0x7f2bbc1393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.474+0000 7f2bc2cc9700 1 --2- 172.21.15.154:0/1349664116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc1393f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009d90 tx=0x7f2bb400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:56.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.474+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/1349664116 shutdown_connections 2023-09-30T22:22:56.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.474+0000 7f2bc2cc9700 1 --2- 172.21.15.154:0/1349664116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc1393f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.474+0000 7f2bc2cc9700 1 --2- 172.21.15.154:0/1349664116 >> v2:172.21.15.154:3300/0 conn(0x7f2bbc09f430 0x7f2bbc136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.474+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/1349664116 >> 172.21.15.154:0/1349664116 conn(0x7f2bbc0a0f70 msgr2=0x7f2bbc0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.474+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/1349664116 shutdown_connections 2023-09-30T22:22:56.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.474+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/1349664116 wait complete. 2023-09-30T22:22:56.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.475+0000 7f2bc2cc9700 1 Processor -- start 2023-09-30T22:22:56.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.475+0000 7f2bc2cc9700 1 -- start start 2023-09-30T22:22:56.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.476+0000 7f2bc2cc9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bbc09e950 0x7f2bbc11c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.476+0000 7f2bc2cc9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bbc09f430 0x7f2bbc11cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.476+0000 7f2bc2cc9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc11d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:56.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.476+0000 7f2bc2cc9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc11f970 con 0x7f2bbc09e950 2023-09-30T22:22:56.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.476+0000 7f2bc2cc9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc11ff20 con 0x7f2bbc09f430 2023-09-30T22:22:56.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.476+0000 7f2bc2cc9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc11e2f0 con 0x7f2bbc137010 2023-09-30T22:22:56.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.476+0000 7f2bc0a65700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bbc09e950 0x7f2bbc11c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc0a65700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bbc09e950 0x7f2bbc11c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38988/0 (socket says 172.21.15.154:38988) 2023-09-30T22:22:56.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc0a65700 1 -- 172.21.15.154:0/4205715170 learned_addr learned my addr 172.21.15.154:0/4205715170 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:56.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bbbfff700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bbc09f430 0x7f2bbc11cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc0a65700 1 -- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 msgr2=0x7f2bbc11d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc1266700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc11d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:56.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc0a65700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc11d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc0a65700 1 -- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bbc09f430 msgr2=0x7f2bbc11cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc0a65700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bbc09f430 0x7f2bbc11cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc0a65700 1 -- 172.21.15.154:0/4205715170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4009a70 con 0x7f2bbc09e950 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bbbfff700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bbc09f430 0x7f2bbc11cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc1266700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc11d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc0a65700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bbc09e950 0x7f2bbc11c6e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c4d0 tx=0x7f2bb000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bb97fa700 1 -- 172.21.15.154:0/4205715170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00054e0 con 0x7f2bbc09e950 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bb97fa700 1 -- 172.21.15.154:0/4205715170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0003680 con 0x7f2bbc09e950 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/4205715170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc072330 con 0x7f2bbc09e950 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.477+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/4205715170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc11eaa0 con 0x7f2bbc09e950 2023-09-30T22:22:56.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.478+0000 7f2bb97fa700 1 -- 172.21.15.154:0/4205715170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0003a30 con 0x7f2bbc09e950 2023-09-30T22:22:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.480+0000 7f2bb97fa700 1 -- 172.21.15.154:0/4205715170 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bb0003b90 con 0x7f2bbc09e950 2023-09-30T22:22:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.480+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/4205715170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9c0052e0 con 0x7f2bbc09e950 2023-09-30T22:22:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.480+0000 7f2bb97fa700 1 -- 172.21.15.154:0/4205715170 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2bb003ecf0 con 0x7f2bbc09e950 2023-09-30T22:22:56.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.484+0000 7f2bb97fa700 1 -- 172.21.15.154:0/4205715170 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bb0003e40 con 0x7f2bbc09e950 2023-09-30T22:22:56.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.618+0000 7fa6ddec7700 1 -- 172.21.15.154:0/3246440224 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6b8005590 con 0x7fa6d8138040 2023-09-30T22:22:56.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.619+0000 7fa6bffff700 1 -- 172.21.15.154:0/3246440224 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6c8017030 con 0x7fa6d8138040 2023-09-30T22:22:56.619 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.621+0000 7fa6ddec7700 1 -- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6d8138040 msgr2=0x7fa6d8136f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.621+0000 7fa6ddec7700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6d8138040 0x7fa6d8136f60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c430 tx=0x7fa6c800c740 comp rx=0 tx=0).stop 2023-09-30T22:22:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.621+0000 7fa6ddec7700 1 -- 172.21.15.154:0/3246440224 shutdown_connections 2023-09-30T22:22:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.621+0000 7fa6ddec7700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6d813dd10 0x7fa6d8135740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.621+0000 7fa6ddec7700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6d8138040 0x7fa6d8136f60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.621+0000 7fa6ddec7700 1 --2- 172.21.15.154:0/3246440224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6d8138410 0x7fa6d81374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.621+0000 7fa6ddec7700 1 -- 172.21.15.154:0/3246440224 >> 172.21.15.154:0/3246440224 conn(0x7fa6d80a2980 msgr2=0x7fa6d8140ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.621+0000 7fa6ddec7700 1 -- 172.21.15.154:0/3246440224 shutdown_connections 2023-09-30T22:22:56.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.621+0000 7fa6ddec7700 1 -- 172.21.15.154:0/3246440224 wait complete. 2023-09-30T22:22:56.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:56.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.642+0000 7fcbf419a700 1 -- 172.21.15.154:0/564326150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcbd4005590 con 0x7fcbec09f1a0 2023-09-30T22:22:56.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.642+0000 7fcbe27fc700 1 -- 172.21.15.154:0/564326150 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcbe402b090 con 0x7fcbec09f1a0 2023-09-30T22:22:56.642 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.644+0000 7fcbf419a700 1 -- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09f1a0 msgr2=0x7fcbec1a6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.644+0000 7fcbf419a700 1 --2- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09f1a0 0x7fcbec1a6a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009d90 tx=0x7fcbe400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.644+0000 7fcbf419a700 1 -- 172.21.15.154:0/564326150 shutdown_connections 2023-09-30T22:22:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.644+0000 7fcbf419a700 1 --2- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbec09f1a0 0x7fcbec1a6a00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.644+0000 7fcbf419a700 1 --2- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcbec09a150 0x7fcbec1a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.644+0000 7fcbf419a700 1 --2- 172.21.15.154:0/564326150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbec09edb0 0x7fcbec1a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.644+0000 7fcbf419a700 1 -- 172.21.15.154:0/564326150 >> 172.21.15.154:0/564326150 conn(0x7fcbec0a4430 msgr2=0x7fcbec1baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.644+0000 7fcbf419a700 1 -- 172.21.15.154:0/564326150 shutdown_connections 2023-09-30T22:22:56.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.644+0000 7fcbf419a700 1 -- 172.21.15.154:0/564326150 wait complete. 2023-09-30T22:22:56.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:56.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.675+0000 7f5a78af4700 1 -- 172.21.15.154:0/2168468497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a7411b540 con 0x7f5a741300a0 2023-09-30T22:22:56.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.676+0000 7f5a62ffd700 1 -- 172.21.15.154:0/2168468497 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a7411b540 con 0x7f5a741300a0 2023-09-30T22:22:56.676 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:56.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.678+0000 7f5a78af4700 1 -- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 msgr2=0x7f5a741c0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.678+0000 7f5a78af4700 1 --2- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741c0d00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5a640140f0 tx=0x7f5a64014400 comp rx=0 tx=0).stop 2023-09-30T22:22:56.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.678+0000 7f5a78af4700 1 -- 172.21.15.154:0/2168468497 shutdown_connections 2023-09-30T22:22:56.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.678+0000 7f5a78af4700 1 --2- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a74133ad0 0x7f5a741c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.678+0000 7f5a78af4700 1 --2- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a741300a0 0x7f5a741c0d00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.678+0000 7f5a78af4700 1 --2- 172.21.15.154:0/2168468497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a741309f0 0x7f5a741c1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.678+0000 7f5a78af4700 1 -- 172.21.15.154:0/2168468497 >> 172.21.15.154:0/2168468497 conn(0x7f5a74099c40 msgr2=0x7f5a74132ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.678+0000 7f5a78af4700 1 -- 172.21.15.154:0/2168468497 shutdown_connections 2023-09-30T22:22:56.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.678+0000 7f5a78af4700 1 -- 172.21.15.154:0/2168468497 wait complete. 2023-09-30T22:22:56.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:56.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.695+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/4205715170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b9c005590 con 0x7f2bbc09e950 2023-09-30T22:22:56.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.695+0000 7f2bb97fa700 1 -- 172.21.15.154:0/4205715170 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bb0017020 con 0x7f2bbc09e950 2023-09-30T22:22:56.695 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:56.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.697+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bbc09e950 msgr2=0x7f2bbc11c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:56.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.697+0000 7f2bc2cc9700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bbc09e950 0x7f2bbc11c6e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c4d0 tx=0x7f2bb000c890 comp rx=0 tx=0).stop 2023-09-30T22:22:56.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.697+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/4205715170 shutdown_connections 2023-09-30T22:22:56.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.697+0000 7f2bc2cc9700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bbc137010 0x7f2bbc11d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.697+0000 7f2bc2cc9700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bbc09e950 0x7f2bbc11c6e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.697+0000 7f2bc2cc9700 1 --2- 172.21.15.154:0/4205715170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bbc09f430 0x7f2bbc11cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:56.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.697+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/4205715170 >> 172.21.15.154:0/4205715170 conn(0x7f2bbc0a0f70 msgr2=0x7f2bbc135fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:56.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.697+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/4205715170 shutdown_connections 2023-09-30T22:22:56.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:56.697+0000 7f2bc2cc9700 1 -- 172.21.15.154:0/4205715170 wait complete. 2023-09-30T22:22:56.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:57.636 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:57.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:57.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:57.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:57.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.775+0000 7f049bba3700 1 Processor -- start 2023-09-30T22:22:57.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.775+0000 7f049bba3700 1 -- start start 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.775+0000 7f049bba3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a0a30 0x7f04940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049bba3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a1340 0x7f049412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049993f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a0a30 0x7f04940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049bba3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04940a1e70 con 0x7f04941304a0 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049913e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a1340 0x7f049412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049a140700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f04941304a0 0x7f04941371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35668/0 (socket says 172.21.15.154:35668) 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049993f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a0a30 0x7f04940a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35762/0 (socket says 172.21.15.154:35762) 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049a140700 1 -- 172.21.15.154:0/3959083953 learned_addr learned my addr 172.21.15.154:0/3959083953 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049bba3700 1 -- 172.21.15.154:0/3959083953 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049409a720 con 0x7f04940a0a30 2023-09-30T22:22:57.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049bba3700 1 -- 172.21.15.154:0/3959083953 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f049409b300 con 0x7f04940a1340 2023-09-30T22:22:57.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049893d700 1 -- 172.21.15.154:0/3959083953 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282090459 0 0) 0x7f04940a1e70 con 0x7f04941304a0 2023-09-30T22:22:57.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049893d700 1 -- 172.21.15.154:0/3959083953 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04800035b0 con 0x7f04941304a0 2023-09-30T22:22:57.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049913e700 1 -- 172.21.15.154:0/3959083953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a0a30 msgr2=0x7f04940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:57.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049913e700 1 --2- 172.21.15.154:0/3959083953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a0a30 0x7f04940a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049913e700 1 -- 172.21.15.154:0/3959083953 >> v1:172.21.15.154:6789/0 conn(0x7f04941304a0 legacy=0x7f04941371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049913e700 1 -- 172.21.15.154:0/3959083953 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049409abc0 con 0x7f04940a1340 2023-09-30T22:22:57.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.776+0000 7f049993f700 1 --2- 172.21.15.154:0/3959083953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a0a30 0x7f04940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:57.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.777+0000 7f049913e700 1 --2- 172.21.15.154:0/3959083953 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a1340 0x7f049412ff60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0484009870 tx=0x7f0484009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7c431d26438de38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.777+0000 7f049893d700 1 -- 172.21.15.154:0/3959083953 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484011830 con 0x7f04940a1340 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.777+0000 7f049893d700 1 -- 172.21.15.154:0/3959083953 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484011990 con 0x7f04940a1340 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.777+0000 7f049893d700 1 -- 172.21.15.154:0/3959083953 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484011d20 con 0x7f04940a1340 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.777+0000 7f049bba3700 1 -- 172.21.15.154:0/3959083953 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a1340 msgr2=0x7f049412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.777+0000 7f049bba3700 1 --2- 172.21.15.154:0/3959083953 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a1340 0x7f049412ff60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0484009870 tx=0x7f0484009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.778+0000 7f049bba3700 1 -- 172.21.15.154:0/3959083953 shutdown_connections 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.778+0000 7f049bba3700 1 --2- 172.21.15.154:0/3959083953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a0a30 0x7f04940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.778+0000 7f049bba3700 1 --2- 172.21.15.154:0/3959083953 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a1340 0x7f049412ff60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.778+0000 7f049bba3700 1 -- 172.21.15.154:0/3959083953 >> 172.21.15.154:0/3959083953 conn(0x7f04940a2980 msgr2=0x7f04940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.778+0000 7f049bba3700 1 -- 172.21.15.154:0/3959083953 shutdown_connections 2023-09-30T22:22:57.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.778+0000 7f049bba3700 1 -- 172.21.15.154:0/3959083953 wait complete. 2023-09-30T22:22:57.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.779+0000 7f049bba3700 1 Processor -- start 2023-09-30T22:22:57.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.779+0000 7f049bba3700 1 -- start start 2023-09-30T22:22:57.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049bba3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a0a30 0x7f049411bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049bba3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a1340 0x7f049411c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049bba3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04941304a0 0x7f04941c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049bba3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049411ea30 con 0x7f04941304a0 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049bba3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049411ec10 con 0x7f04940a1340 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049bba3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f049412fa80 con 0x7f04940a0a30 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049993f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a0a30 0x7f049411bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049913e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a1340 0x7f049411c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049993f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a0a30 0x7f049411bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59614/0 (socket says 172.21.15.154:59614) 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049913e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a1340 0x7f049411c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35776/0 (socket says 172.21.15.154:35776) 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049993f700 1 -- 172.21.15.154:0/1748192644 learned_addr learned my addr 172.21.15.154:0/1748192644 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049a140700 1 --2- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04941304a0 0x7f04941c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049993f700 1 -- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a1340 msgr2=0x7f049411c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049993f700 1 --2- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a1340 0x7f049411c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049993f700 1 -- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04941304a0 msgr2=0x7f04941c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049993f700 1 --2- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04941304a0 0x7f04941c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049993f700 1 -- 172.21.15.154:0/1748192644 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049000d8e0 con 0x7f04940a0a30 2023-09-30T22:22:57.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.780+0000 7f049a140700 1 --2- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04941304a0 0x7f04941c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:57.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.781+0000 7f049993f700 1 --2- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a0a30 0x7f049411bac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0490010d60 tx=0x7f049000f390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.781+0000 7f048a7fc700 1 -- 172.21.15.154:0/1748192644 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490012070 con 0x7f04940a0a30 2023-09-30T22:22:57.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.781+0000 7f048a7fc700 1 -- 172.21.15.154:0/1748192644 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0490010eb0 con 0x7f04940a0a30 2023-09-30T22:22:57.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.781+0000 7f048a7fc700 1 -- 172.21.15.154:0/1748192644 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049000b070 con 0x7f04940a0a30 2023-09-30T22:22:57.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.781+0000 7f049bba3700 1 -- 172.21.15.154:0/1748192644 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04840094a0 con 0x7f04940a0a30 2023-09-30T22:22:57.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.781+0000 7f049bba3700 1 -- 172.21.15.154:0/1748192644 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049409ae00 con 0x7f04940a0a30 2023-09-30T22:22:57.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.782+0000 7f048a7fc700 1 -- 172.21.15.154:0/1748192644 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f049000fa80 con 0x7f04940a0a30 2023-09-30T22:22:57.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.782+0000 7f048a7fc700 1 -- 172.21.15.154:0/1748192644 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f049003efe0 con 0x7f04940a0a30 2023-09-30T22:22:57.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.782+0000 7f049bba3700 1 -- 172.21.15.154:0/1748192644 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049404f2a0 con 0x7f04940a0a30 2023-09-30T22:22:57.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.787+0000 7f048a7fc700 1 -- 172.21.15.154:0/1748192644 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f049000d2d0 con 0x7f04940a0a30 2023-09-30T22:22:57.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.824+0000 7fc285bb3700 1 Processor -- start 2023-09-30T22:22:57.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.824+0000 7fc285bb3700 1 -- start start 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc285bb3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2800a0a70 0x7fc2800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc285bb3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc285bb3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28009dc00 con 0x7fc280133f50 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc285bb3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28009ea60 con 0x7fc2800a0a70 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc285bb3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28009dec0 con 0x7fc2800a1380 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc27f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2800a0a70 0x7fc2800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc27f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2800a0a70 0x7fc2800a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39014/0 (socket says 172.21.15.154:39014) 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc27f7fe700 1 -- 172.21.15.154:0/266371344 learned_addr learned my addr 172.21.15.154:0/266371344 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc27effd700 1 --2- 172.21.15.154:0/266371344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc27f7fe700 1 -- 172.21.15.154:0/266371344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 msgr2=0x7fc280133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc27f7fe700 1 --2- 172.21.15.154:0/266371344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc27f7fe700 1 -- 172.21.15.154:0/266371344 >> v1:172.21.15.154:6789/0 conn(0x7fc280133f50 legacy=0x7fc28013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc27f7fe700 1 -- 172.21.15.154:0/266371344 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28009e6a0 con 0x7fc2800a0a70 2023-09-30T22:22:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.825+0000 7fc27e7fc700 1 -- 172.21.15.154:0/266371344 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168578557 0 0) 0x7fc28009dc00 con 0x7fc280133f50 2023-09-30T22:22:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.826+0000 7fc27effd700 1 --2- 172.21.15.154:0/266371344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.826+0000 7fc27f7fe700 1 --2- 172.21.15.154:0/266371344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 0x7fc2800a0e40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc2700098f0 tx=0x7fc270009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c628633bf55fef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.826+0000 7fc27e7fc700 1 -- 172.21.15.154:0/266371344 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270011830 con 0x7fc2800a0a70 2023-09-30T22:22:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.826+0000 7fc27e7fc700 1 -- 172.21.15.154:0/266371344 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc270011990 con 0x7fc2800a0a70 2023-09-30T22:22:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.826+0000 7fc27e7fc700 1 -- 172.21.15.154:0/266371344 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270011d20 con 0x7fc2800a0a70 2023-09-30T22:22:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.827+0000 7fc285bb3700 1 -- 172.21.15.154:0/266371344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 msgr2=0x7fc2800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.827+0000 7fc285bb3700 1 --2- 172.21.15.154:0/266371344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 0x7fc2800a0e40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc2700098f0 tx=0x7fc270009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.827+0000 7fc285bb3700 1 -- 172.21.15.154:0/266371344 shutdown_connections 2023-09-30T22:22:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.827+0000 7fc285bb3700 1 --2- 172.21.15.154:0/266371344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 0x7fc2800a0e40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.827+0000 7fc285bb3700 1 --2- 172.21.15.154:0/266371344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.827+0000 7fc285bb3700 1 -- 172.21.15.154:0/266371344 >> 172.21.15.154:0/266371344 conn(0x7fc2800a6610 msgr2=0x7fc2800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.827+0000 7fc285bb3700 1 -- 172.21.15.154:0/266371344 shutdown_connections 2023-09-30T22:22:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.827+0000 7fc285bb3700 1 -- 172.21.15.154:0/266371344 wait complete. 2023-09-30T22:22:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.828+0000 7fc285bb3700 1 Processor -- start 2023-09-30T22:22:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc285bb3700 1 -- start start 2023-09-30T22:22:57.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc285bb3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 0x7fc280122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc285bb3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc285bb3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc280133f50 0x7fc2801232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc285bb3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc280133ad0 con 0x7fc2800a0a70 2023-09-30T22:22:57.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc285bb3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc280125de0 con 0x7fc2800a1380 2023-09-30T22:22:57.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc285bb3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc280124510 con 0x7fc280133f50 2023-09-30T22:22:57.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc27f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 0x7fc280122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc27f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 0x7fc280122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39024/0 (socket says 172.21.15.154:39024) 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc27f7fe700 1 -- 172.21.15.154:0/1348983785 learned_addr learned my addr 172.21.15.154:0/1348983785 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.829+0000 7fc27ffff700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc280133f50 0x7fc2801232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc27effd700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc27f7fe700 1 -- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc280133f50 msgr2=0x7fc2801232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc27f7fe700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc280133f50 0x7fc2801232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc27f7fe700 1 -- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 msgr2=0x7fc280122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc27f7fe700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc27f7fe700 1 -- 172.21.15.154:0/1348983785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2740094a0 con 0x7fc2800a0a70 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc27effd700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc27f7fe700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 0x7fc280122860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc270009c40 tx=0x7fc270004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc267fff700 1 -- 172.21.15.154:0/1348983785 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270004510 con 0x7fc2800a0a70 2023-09-30T22:22:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc267fff700 1 -- 172.21.15.154:0/1348983785 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2700036a0 con 0x7fc2800a0a70 2023-09-30T22:22:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc285bb3700 1 -- 172.21.15.154:0/1348983785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc270009550 con 0x7fc2800a0a70 2023-09-30T22:22:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc267fff700 1 -- 172.21.15.154:0/1348983785 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270003a50 con 0x7fc2800a0a70 2023-09-30T22:22:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.830+0000 7fc285bb3700 1 -- 172.21.15.154:0/1348983785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc280133380 con 0x7fc2800a0a70 2023-09-30T22:22:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.831+0000 7fc267fff700 1 -- 172.21.15.154:0/1348983785 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc270021070 con 0x7fc2800a0a70 2023-09-30T22:22:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.831+0000 7fc267fff700 1 -- 172.21.15.154:0/1348983785 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc270040b50 con 0x7fc2800a0a70 2023-09-30T22:22:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.832+0000 7fc285bb3700 1 -- 172.21.15.154:0/1348983785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28004f2a0 con 0x7fc2800a0a70 2023-09-30T22:22:57.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.837+0000 7fc267fff700 1 -- 172.21.15.154:0/1348983785 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc270029080 con 0x7fc2800a0a70 2023-09-30T22:22:57.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.859+0000 7f65e88f6700 1 Processor -- start 2023-09-30T22:22:57.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.859+0000 7f65e88f6700 1 -- start start 2023-09-30T22:22:57.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e88f6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e88f6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e88f6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e409aaa0 con 0x7f65e4130ce0 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e88f6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e409f870 con 0x7f65e409d860 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e88f6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65e409b360 con 0x7f65e409e170 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35786/0 (socket says 172.21.15.154:35786) 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e259c700 1 -- 172.21.15.154:0/1491666766 learned_addr learned my addr 172.21.15.154:0/1491666766 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e1d9b700 1 -- 172.21.15.154:0/1491666766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 msgr2=0x7f65e409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e1d9b700 1 --2- 172.21.15.154:0/1491666766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e1d9b700 1 -- 172.21.15.154:0/1491666766 >> v1:172.21.15.154:6789/0 conn(0x7f65e4130ce0 legacy=0x7f65e41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.860+0000 7f65e1d9b700 1 -- 172.21.15.154:0/1491666766 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e409b620 con 0x7f65e409e170 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.861+0000 7f65e259c700 1 --2- 172.21.15.154:0/1491666766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:57.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.861+0000 7f65e1d9b700 1 --2- 172.21.15.154:0/1491666766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41307a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009870 tx=0x7f65d8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ca0a3d31a577bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.861+0000 7f65e159a700 1 -- 172.21.15.154:0/1491666766 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8011830 con 0x7f65e409e170 2023-09-30T22:22:57.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.861+0000 7f65e159a700 1 -- 172.21.15.154:0/1491666766 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8011990 con 0x7f65e409e170 2023-09-30T22:22:57.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.861+0000 7f65e159a700 1 -- 172.21.15.154:0/1491666766 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8011d20 con 0x7f65e409e170 2023-09-30T22:22:57.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.861+0000 7f65e88f6700 1 -- 172.21.15.154:0/1491666766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 msgr2=0x7f65e41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.861+0000 7f65e88f6700 1 --2- 172.21.15.154:0/1491666766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41307a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009870 tx=0x7f65d8009b80 comp rx=0 tx=0).stop 2023-09-30T22:22:57.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.862+0000 7f65e88f6700 1 -- 172.21.15.154:0/1491666766 shutdown_connections 2023-09-30T22:22:57.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.862+0000 7f65e88f6700 1 --2- 172.21.15.154:0/1491666766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.862+0000 7f65e88f6700 1 --2- 172.21.15.154:0/1491666766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41307a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.862+0000 7f65e88f6700 1 -- 172.21.15.154:0/1491666766 >> 172.21.15.154:0/1491666766 conn(0x7f65e4099c40 msgr2=0x7f65e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.862+0000 7f65e88f6700 1 -- 172.21.15.154:0/1491666766 shutdown_connections 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.862+0000 7f65e88f6700 1 -- 172.21.15.154:0/1491666766 wait complete. 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e88f6700 1 Processor -- start 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e88f6700 1 -- start start 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e88f6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e4138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e88f6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e88f6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4130ce0 0x7f65e41c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e88f6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4135660 con 0x7f65e4130ce0 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e88f6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e41369d0 con 0x7f65e409d860 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e88f6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65e409c8b0 con 0x7f65e409e170 2023-09-30T22:22:57.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e4138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.863+0000 7f65e1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e4138170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35790/0 (socket says 172.21.15.154:35790) 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e259c700 1 -- 172.21.15.154:0/1712449208 learned_addr learned my addr 172.21.15.154:0/1712449208 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41386b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59650/0 (socket says 172.21.15.154:59650) 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e2d9d700 1 --2- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4130ce0 0x7f65e41c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e1d9b700 1 -- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 msgr2=0x7f65e4138170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e1d9b700 1 --2- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e4138170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e1d9b700 1 -- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4130ce0 msgr2=0x7f65e41c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e1d9b700 1 --2- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4130ce0 0x7f65e41c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e1d9b700 1 -- 172.21.15.154:0/1712449208 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4009550 con 0x7f65e409e170 2023-09-30T22:22:57.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e1d9b700 1 --2- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41386b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f65d8016000 tx=0x7f65d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65d2ffd700 1 -- 172.21.15.154:0/1712449208 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d80045d0 con 0x7f65e409e170 2023-09-30T22:22:57.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65d2ffd700 1 -- 172.21.15.154:0/1712449208 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d801f070 con 0x7f65e409e170 2023-09-30T22:22:57.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e88f6700 1 -- 172.21.15.154:0/1712449208 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d80094a0 con 0x7f65e409e170 2023-09-30T22:22:57.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65d2ffd700 1 -- 172.21.15.154:0/1712449208 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d80038c0 con 0x7f65e409e170 2023-09-30T22:22:57.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.864+0000 7f65e88f6700 1 -- 172.21.15.154:0/1712449208 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e4137700 con 0x7f65e409e170 2023-09-30T22:22:57.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.866+0000 7f65d2ffd700 1 -- 172.21.15.154:0/1712449208 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65d8003a20 con 0x7f65e409e170 2023-09-30T22:22:57.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.866+0000 7f65e88f6700 1 -- 172.21.15.154:0/1712449208 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e404f2a0 con 0x7f65e409e170 2023-09-30T22:22:57.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.866+0000 7f65d2ffd700 1 -- 172.21.15.154:0/1712449208 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65d8021070 con 0x7f65e409e170 2023-09-30T22:22:57.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.870+0000 7f65d2ffd700 1 -- 172.21.15.154:0/1712449208 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65d8015030 con 0x7f65e409e170 2023-09-30T22:22:57.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.879+0000 7f7759323700 1 Processor -- start 2023-09-30T22:22:57.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.879+0000 7f7759323700 1 -- start start 2023-09-30T22:22:57.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f7759323700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77540a0a70 0x7f77540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f7759323700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a1380 0x7f7754133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f7759323700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775409dc00 con 0x7f7754133f50 2023-09-30T22:22:57.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f7759323700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775409ea60 con 0x7f77540a0a70 2023-09-30T22:22:57.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f7759323700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f775409dec0 con 0x7f77540a1380 2023-09-30T22:22:57.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f77527fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a1380 0x7f7754133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f77527fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a1380 0x7f7754133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59664/0 (socket says 172.21.15.154:59664) 2023-09-30T22:22:57.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f77527fc700 1 -- 172.21.15.154:0/1441407613 learned_addr learned my addr 172.21.15.154:0/1441407613 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:57.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f7752ffd700 1 --2- 172.21.15.154:0/1441407613 >> v2:172.21.15.154:3300/0 conn(0x7f77540a0a70 0x7f77540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f77527fc700 1 -- 172.21.15.154:0/1441407613 >> v2:172.21.15.154:3300/0 conn(0x7f77540a0a70 msgr2=0x7f77540a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:57.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f77527fc700 1 --2- 172.21.15.154:0/1441407613 >> v2:172.21.15.154:3300/0 conn(0x7f77540a0a70 0x7f77540a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f77527fc700 1 -- 172.21.15.154:0/1441407613 >> v1:172.21.15.154:6789/0 conn(0x7f7754133f50 legacy=0x7f775413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:57.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f77527fc700 1 -- 172.21.15.154:0/1441407613 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775409e6a0 con 0x7f77540a1380 2023-09-30T22:22:57.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f77527fc700 1 --2- 172.21.15.154:0/1441407613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a1380 0x7f7754133a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77480098f0 tx=0x7f7748009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac7ec3cebada0351 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.880+0000 7f7751ffb700 1 -- 172.21.15.154:0/1441407613 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7748004230 con 0x7f77540a1380 2023-09-30T22:22:57.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7751ffb700 1 -- 172.21.15.154:0/1441407613 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7748004390 con 0x7f77540a1380 2023-09-30T22:22:57.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7751ffb700 1 -- 172.21.15.154:0/1441407613 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77480036a0 con 0x7f77540a1380 2023-09-30T22:22:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7759323700 1 -- 172.21.15.154:0/1441407613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a1380 msgr2=0x7f7754133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7759323700 1 --2- 172.21.15.154:0/1441407613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a1380 0x7f7754133a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77480098f0 tx=0x7f7748009c00 comp rx=0 tx=0).stop 2023-09-30T22:22:57.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7759323700 1 -- 172.21.15.154:0/1441407613 shutdown_connections 2023-09-30T22:22:57.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7759323700 1 --2- 172.21.15.154:0/1441407613 >> v2:172.21.15.154:3300/0 conn(0x7f77540a0a70 0x7f77540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7759323700 1 --2- 172.21.15.154:0/1441407613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a1380 0x7f7754133a10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7759323700 1 -- 172.21.15.154:0/1441407613 >> 172.21.15.154:0/1441407613 conn(0x7f77540a6610 msgr2=0x7f77540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:57.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7759323700 1 -- 172.21.15.154:0/1441407613 shutdown_connections 2023-09-30T22:22:57.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.881+0000 7f7759323700 1 -- 172.21.15.154:0/1441407613 wait complete. 2023-09-30T22:22:57.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f7759323700 1 Processor -- start 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f7759323700 1 -- start start 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f7759323700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a0a70 0x7f77541d4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f7759323700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77540a1380 0x7f77541d54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f7759323700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7754133f50 0x7f77541d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f7759323700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77541321d0 con 0x7f77540a1380 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f7759323700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77541b91e0 con 0x7f7754133f50 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f7759323700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77540a03e0 con 0x7f77540a0a70 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f77527fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77540a1380 0x7f77541d54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f77527fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77540a1380 0x7f77541d54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39050/0 (socket says 172.21.15.154:39050) 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f77527fc700 1 -- 172.21.15.154:0/3230111365 learned_addr learned my addr 172.21.15.154:0/3230111365 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f7752ffd700 1 --2- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a0a70 0x7f77541d4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.883+0000 7f77537fe700 1 --2- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7754133f50 0x7f77541d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f7752ffd700 1 -- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7754133f50 msgr2=0x7f77541d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f7752ffd700 1 --2- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7754133f50 0x7f77541d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f7752ffd700 1 -- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77540a1380 msgr2=0x7f77541d54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f7752ffd700 1 --2- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77540a1380 0x7f77541d54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f7752ffd700 1 -- 172.21.15.154:0/3230111365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7748009550 con 0x7f77540a0a70 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f7752ffd700 1 --2- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a0a70 0x7f77541d4f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f774400e900 tx=0x7f774400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f773b7fe700 1 -- 172.21.15.154:0/3230111365 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744013680 con 0x7f77540a0a70 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f773b7fe700 1 -- 172.21.15.154:0/3230111365 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440137e0 con 0x7f77540a0a70 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f7759323700 1 -- 172.21.15.154:0/3230111365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7754132c60 con 0x7f77540a0a70 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f773b7fe700 1 -- 172.21.15.154:0/3230111365 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744013b50 con 0x7f77540a0a70 2023-09-30T22:22:57.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.884+0000 7f7759323700 1 -- 172.21.15.154:0/3230111365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77541d5a10 con 0x7f77540a0a70 2023-09-30T22:22:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.885+0000 7f7759323700 1 -- 172.21.15.154:0/3230111365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77541332e0 con 0x7f77540a0a70 2023-09-30T22:22:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.886+0000 7f773b7fe700 1 -- 172.21.15.154:0/3230111365 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7744013cb0 con 0x7f77540a0a70 2023-09-30T22:22:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.886+0000 7f773b7fe700 1 -- 172.21.15.154:0/3230111365 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f774403fd00 con 0x7f77540a0a70 2023-09-30T22:22:57.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:57.890+0000 7f773b7fe700 1 -- 172.21.15.154:0/3230111365 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f774401a770 con 0x7f77540a0a70 2023-09-30T22:22:58.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.012+0000 7f049bba3700 1 -- 172.21.15.154:0/1748192644 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f049411d4f0 con 0x7f04940a0a30 2023-09-30T22:22:58.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.013+0000 7f048a7fc700 1 -- 172.21.15.154:0/1748192644 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f049001e340 con 0x7f04940a0a30 2023-09-30T22:22:58.013 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:58.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.016+0000 7f049bba3700 1 -- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a0a30 msgr2=0x7f049411bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.016+0000 7f049bba3700 1 --2- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a0a30 0x7f049411bac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0490010d60 tx=0x7f049000f390 comp rx=0 tx=0).stop 2023-09-30T22:22:58.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.016+0000 7f049bba3700 1 -- 172.21.15.154:0/1748192644 shutdown_connections 2023-09-30T22:22:58.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.016+0000 7f049bba3700 1 --2- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04941304a0 0x7f04941c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.016+0000 7f049bba3700 1 --2- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04940a0a30 0x7f049411bac0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.016+0000 7f049bba3700 1 --2- 172.21.15.154:0/1748192644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04940a1340 0x7f049411c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.016+0000 7f049bba3700 1 -- 172.21.15.154:0/1748192644 >> 172.21.15.154:0/1748192644 conn(0x7f04940a2980 msgr2=0x7f04941b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.016+0000 7f049bba3700 1 -- 172.21.15.154:0/1748192644 shutdown_connections 2023-09-30T22:22:58.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.016+0000 7f049bba3700 1 -- 172.21.15.154:0/1748192644 wait complete. 2023-09-30T22:22:58.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.050+0000 7fc285bb3700 1 -- 172.21.15.154:0/1348983785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc280072980 con 0x7fc2800a0a70 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.050+0000 7fc267fff700 1 -- 172.21.15.154:0/1348983785 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc270015020 con 0x7fc2800a0a70 2023-09-30T22:22:58.050 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.052+0000 7fc285bb3700 1 -- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 msgr2=0x7fc280122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.052+0000 7fc285bb3700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 0x7fc280122860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc270009c40 tx=0x7fc270004750 comp rx=0 tx=0).stop 2023-09-30T22:22:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.052+0000 7fc285bb3700 1 -- 172.21.15.154:0/1348983785 shutdown_connections 2023-09-30T22:22:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.052+0000 7fc285bb3700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc280133f50 0x7fc2801232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.052+0000 7fc285bb3700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2800a0a70 0x7fc280122860 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.052+0000 7fc285bb3700 1 --2- 172.21.15.154:0/1348983785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2800a1380 0x7fc280122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.052+0000 7fc285bb3700 1 -- 172.21.15.154:0/1348983785 >> 172.21.15.154:0/1348983785 conn(0x7fc2800a6610 msgr2=0x7fc28009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.053+0000 7fc285bb3700 1 -- 172.21.15.154:0/1348983785 shutdown_connections 2023-09-30T22:22:58.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.053+0000 7fc285bb3700 1 -- 172.21.15.154:0/1348983785 wait complete. 2023-09-30T22:22:58.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:58.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.089+0000 7f7759323700 1 -- 172.21.15.154:0/3230111365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f775404f2a0 con 0x7f77540a0a70 2023-09-30T22:22:58.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.089+0000 7f773b7fe700 1 -- 172.21.15.154:0/3230111365 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7744017020 con 0x7f77540a0a70 2023-09-30T22:22:58.089 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:58.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.091+0000 7f7759323700 1 -- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a0a70 msgr2=0x7f77541d4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.091+0000 7f7759323700 1 --2- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a0a70 0x7f77541d4f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f774400e900 tx=0x7f774400ec10 comp rx=0 tx=0).stop 2023-09-30T22:22:58.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.091+0000 7f7759323700 1 -- 172.21.15.154:0/3230111365 shutdown_connections 2023-09-30T22:22:58.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.091+0000 7f7759323700 1 --2- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7754133f50 0x7f77541d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.091+0000 7f7759323700 1 --2- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77540a0a70 0x7f77541d4f90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.091+0000 7f7759323700 1 --2- 172.21.15.154:0/3230111365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77540a1380 0x7f77541d54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.091+0000 7f7759323700 1 -- 172.21.15.154:0/3230111365 >> 172.21.15.154:0/3230111365 conn(0x7f77540a6610 msgr2=0x7f77540a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.091+0000 7f7759323700 1 -- 172.21.15.154:0/3230111365 shutdown_connections 2023-09-30T22:22:58.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.091+0000 7f7759323700 1 -- 172.21.15.154:0/3230111365 wait complete. 2023-09-30T22:22:58.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.102+0000 7f65e88f6700 1 -- 172.21.15.154:0/1712449208 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65e406c3b0 con 0x7f65e409e170 2023-09-30T22:22:58.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.103+0000 7f65d2ffd700 1 -- 172.21.15.154:0/1712449208 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65d8019ba0 con 0x7f65e409e170 2023-09-30T22:22:58.103 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:58.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.105+0000 7f65e88f6700 1 -- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 msgr2=0x7f65e41386b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.105+0000 7f65e88f6700 1 --2- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41386b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f65d8016000 tx=0x7f65d8004750 comp rx=0 tx=0).stop 2023-09-30T22:22:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.105+0000 7f65e88f6700 1 -- 172.21.15.154:0/1712449208 shutdown_connections 2023-09-30T22:22:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.105+0000 7f65e88f6700 1 --2- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65e4130ce0 0x7f65e41c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.105+0000 7f65e88f6700 1 --2- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65e409d860 0x7f65e4138170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.105+0000 7f65e88f6700 1 --2- 172.21.15.154:0/1712449208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65e409e170 0x7f65e41386b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.105+0000 7f65e88f6700 1 -- 172.21.15.154:0/1712449208 >> 172.21.15.154:0/1712449208 conn(0x7f65e4099c40 msgr2=0x7f65e4139550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.105+0000 7f65e88f6700 1 -- 172.21.15.154:0/1712449208 shutdown_connections 2023-09-30T22:22:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:58.105+0000 7f65e88f6700 1 -- 172.21.15.154:0/1712449208 wait complete. 2023-09-30T22:22:58.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:22:59.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:22:59.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:22:59.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:22:59.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:22:59.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.180+0000 7f01b2f45700 1 Processor -- start 2023-09-30T22:22:59.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.180+0000 7f01b2f45700 1 -- start start 2023-09-30T22:22:59.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b2f45700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 0x7f01ac133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b2f45700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac134210 0x7f01ac0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b2f45700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f01ac0a0ee0 0x7f01ac0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b2f45700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac09a760 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b2f45700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac1336e0 con 0x7f01ac133900 2023-09-30T22:22:59.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b2f45700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac09a080 con 0x7f01ac134210 2023-09-30T22:22:59.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01abfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac134210 0x7f01ac0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b0ce1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 0x7f01ac133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01abfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac134210 0x7f01ac0a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59688/0 (socket says 172.21.15.154:59688) 2023-09-30T22:22:59.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01abfff700 1 -- 172.21.15.154:0/3385106390 learned_addr learned my addr 172.21.15.154:0/3385106390 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:59.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b0ce1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 0x7f01ac133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35820/0 (socket says 172.21.15.154:35820) 2023-09-30T22:22:59.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b14e2700 1 --2- 172.21.15.154:0/3385106390 >> v2:172.21.15.154:3300/0 conn(0x7f01ac0a0ee0 0x7f01ac0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b14e2700 1 -- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac134210 msgr2=0x7f01ac0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b14e2700 1 --2- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac134210 0x7f01ac0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b14e2700 1 -- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 msgr2=0x7f01ac133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b14e2700 1 --2- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 0x7f01ac133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.181+0000 7f01b14e2700 1 -- 172.21.15.154:0/3385106390 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac0a23e0 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.182+0000 7f01b14e2700 1 --2- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01ac0a0ee0 0x7f01ac0a1360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009d90 tx=0x7f01a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872c8222d978a25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.182+0000 7f01ab7fe700 1 -- 172.21.15.154:0/3385106390 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400e070 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.182+0000 7f01ab7fe700 1 -- 172.21.15.154:0/3385106390 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a400bb20 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.182+0000 7f01ab7fe700 1 -- 172.21.15.154:0/3385106390 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4012430 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.183+0000 7f01b2f45700 1 -- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01ac0a0ee0 msgr2=0x7f01ac0a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.183+0000 7f01b2f45700 1 --2- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01ac0a0ee0 0x7f01ac0a1360 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009d90 tx=0x7f01a400b330 comp rx=0 tx=0).stop 2023-09-30T22:22:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.183+0000 7f01b2f45700 1 -- 172.21.15.154:0/3385106390 shutdown_connections 2023-09-30T22:22:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.183+0000 7f01b2f45700 1 --2- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 0x7f01ac133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.183+0000 7f01b2f45700 1 --2- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01ac0a0ee0 0x7f01ac0a1360 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.183+0000 7f01b2f45700 1 --2- 172.21.15.154:0/3385106390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac134210 0x7f01ac0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.183+0000 7f01b2f45700 1 -- 172.21.15.154:0/3385106390 >> 172.21.15.154:0/3385106390 conn(0x7f01ac0a2980 msgr2=0x7f01ac0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.183+0000 7f01b2f45700 1 -- 172.21.15.154:0/3385106390 shutdown_connections 2023-09-30T22:22:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.183+0000 7f01b2f45700 1 -- 172.21.15.154:0/3385106390 wait complete. 2023-09-30T22:22:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.184+0000 7f01b2f45700 1 Processor -- start 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.184+0000 7f01b2f45700 1 -- start start 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b2f45700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac0a0ee0 0x7f01ac11d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b2f45700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 0x7f01ac11dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b2f45700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01ac134210 0x7f01ac11e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b2f45700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac11f3e0 con 0x7f01ac134210 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b2f45700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac11fa00 con 0x7f01ac133900 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b2f45700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac120630 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b0ce1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac0a0ee0 0x7f01ac11d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b0ce1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac0a0ee0 0x7f01ac11d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59704/0 (socket says 172.21.15.154:59704) 2023-09-30T22:22:59.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b0ce1700 1 -- 172.21.15.154:0/2606185810 learned_addr learned my addr 172.21.15.154:0/2606185810 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01abfff700 1 --2- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 0x7f01ac11dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.185+0000 7f01b14e2700 1 --2- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01ac134210 0x7f01ac11e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01b0ce1700 1 -- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 msgr2=0x7f01ac11dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01b0ce1700 1 --2- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 0x7f01ac11dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01b0ce1700 1 -- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01ac134210 msgr2=0x7f01ac11e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01b0ce1700 1 --2- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01ac134210 0x7f01ac11e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01b0ce1700 1 -- 172.21.15.154:0/2606185810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a4009a70 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01b0ce1700 1 --2- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac0a0ee0 0x7f01ac11d7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01a000e990 tx=0x7f01a000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01a97fa700 1 -- 172.21.15.154:0/2606185810 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a00096f0 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01a97fa700 1 -- 172.21.15.154:0/2606185810 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000c690 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01b2f45700 1 -- 172.21.15.154:0/2606185810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac121010 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01a97fa700 1 -- 172.21.15.154:0/2606185810 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000ca00 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.186+0000 7f01b2f45700 1 -- 172.21.15.154:0/2606185810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac09a2c0 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.187+0000 7f01a97fa700 1 -- 172.21.15.154:0/2606185810 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01a000cb60 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.187+0000 7f01b2f45700 1 -- 172.21.15.154:0/2606185810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac11a590 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.187+0000 7f01a97fa700 1 -- 172.21.15.154:0/2606185810 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f01a00431f0 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.196+0000 7f01a97fa700 1 -- 172.21.15.154:0/2606185810 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01a0017070 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.221+0000 7f7b93171700 1 Processor -- start 2023-09-30T22:22:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.221+0000 7f7b93171700 1 -- start start 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b93171700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b93171700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b8c0a08e0 0x7f7b8c0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b93171700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c1379e0 con 0x7f7b8c0a1230 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b93171700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8c0a2100 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b93171700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c138950 con 0x7f7b8c138040 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b90f0d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b8bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b8c0a08e0 0x7f7b8c0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b8bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b8c0a08e0 0x7f7b8c0a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39078/0 (socket says 172.21.15.154:39078) 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b8bfff700 1 -- 172.21.15.154:0/3665186087 learned_addr learned my addr 172.21.15.154:0/3665186087 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b90f0d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35838/0 (socket says 172.21.15.154:35838) 2023-09-30T22:22:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b8bfff700 1 -- 172.21.15.154:0/3665186087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 msgr2=0x7f7b8c138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b8bfff700 1 --2- 172.21.15.154:0/3665186087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b8bfff700 1 -- 172.21.15.154:0/3665186087 >> v1:172.21.15.154:6789/0 conn(0x7f7b8c0a1230 legacy=0x7f7b8c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.222+0000 7f7b8bfff700 1 -- 172.21.15.154:0/3665186087 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c09b9b0 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.223+0000 7f7b90f0d700 1 --2- 172.21.15.154:0/3665186087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:22:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.223+0000 7f7b8bfff700 1 --2- 172.21.15.154:0/3665186087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8c0a08e0 0x7f7b8c0a0cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009920 tx=0x7f7b78009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a68e37b0eba71c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.223+0000 7f7b8b7fe700 1 -- 172.21.15.154:0/3665186087 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78011830 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.223+0000 7f7b8b7fe700 1 -- 172.21.15.154:0/3665186087 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78011990 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.223+0000 7f7b8b7fe700 1 -- 172.21.15.154:0/3665186087 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78011d20 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.224+0000 7f7b93171700 1 -- 172.21.15.154:0/3665186087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8c0a08e0 msgr2=0x7f7b8c0a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.224+0000 7f7b93171700 1 --2- 172.21.15.154:0/3665186087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8c0a08e0 0x7f7b8c0a0cf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009920 tx=0x7f7b78009c30 comp rx=0 tx=0).stop 2023-09-30T22:22:59.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.224+0000 7f7b93171700 1 -- 172.21.15.154:0/3665186087 shutdown_connections 2023-09-30T22:22:59.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.224+0000 7f7b93171700 1 --2- 172.21.15.154:0/3665186087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.224+0000 7f7b93171700 1 --2- 172.21.15.154:0/3665186087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8c0a08e0 0x7f7b8c0a0cf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.224+0000 7f7b93171700 1 -- 172.21.15.154:0/3665186087 >> 172.21.15.154:0/3665186087 conn(0x7f7b8c0a2980 msgr2=0x7f7b8c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.224+0000 7f7b93171700 1 -- 172.21.15.154:0/3665186087 shutdown_connections 2023-09-30T22:22:59.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.224+0000 7f7b93171700 1 -- 172.21.15.154:0/3665186087 wait complete. 2023-09-30T22:22:59.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.225+0000 7f7b93171700 1 Processor -- start 2023-09-30T22:22:59.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.225+0000 7f7b93171700 1 -- start start 2023-09-30T22:22:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b93171700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8c0a08e0 0x7f7b8c1263c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b93171700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8c0a1230 0x7f7b8c126900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b93171700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c126e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b93171700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c129c00 con 0x7f7b8c0a1230 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b93171700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c1280e0 con 0x7f7b8c138040 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b93171700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c09a240 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b90f0d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8c0a08e0 0x7f7b8c1263c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b90f0d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8c0a08e0 0x7f7b8c1263c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59710/0 (socket says 172.21.15.154:59710) 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b90f0d700 1 -- 172.21.15.154:0/3471052690 learned_addr learned my addr 172.21.15.154:0/3471052690 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b8bfff700 1 --2- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8c0a1230 0x7f7b8c126900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.226+0000 7f7b9170e700 1 --2- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c126e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b90f0d700 1 -- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 msgr2=0x7f7b8c126e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b90f0d700 1 --2- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c126e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b90f0d700 1 -- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8c0a1230 msgr2=0x7f7b8c126900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b90f0d700 1 --2- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8c0a1230 0x7f7b8c126900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b90f0d700 1 -- 172.21.15.154:0/3471052690 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b80009430 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b90f0d700 1 --2- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8c0a08e0 0x7f7b8c1263c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000ebe0 tx=0x7f7b8000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b897fa700 1 -- 172.21.15.154:0/3471052690 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80005a20 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b897fa700 1 -- 172.21.15.154:0/3471052690 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80005b80 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b93171700 1 -- 172.21.15.154:0/3471052690 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b78009550 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b897fa700 1 -- 172.21.15.154:0/3471052690 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8000c850 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.227+0000 7f7b93171700 1 -- 172.21.15.154:0/3471052690 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c1377b0 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.228+0000 7f7b897fa700 1 -- 172.21.15.154:0/3471052690 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b8000c9b0 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.228+0000 7f7b93171700 1 -- 172.21.15.154:0/3471052690 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c04f2a0 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.228+0000 7f7b897fa700 1 -- 172.21.15.154:0/3471052690 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b8003f9e0 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.237+0000 7f7b897fa700 1 -- 172.21.15.154:0/3471052690 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b80022300 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.261+0000 7f741394f700 1 Processor -- start 2023-09-30T22:22:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.261+0000 7f741394f700 1 -- start start 2023-09-30T22:22:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.261+0000 7f00806f1700 1 Processor -- start 2023-09-30T22:22:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.261+0000 7f00806f1700 1 -- start start 2023-09-30T22:22:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.261+0000 7f741394f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f740c09a130 0x7f740c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.261+0000 7f741394f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09edb0 0x7f740c09f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.261+0000 7f741394f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c072b30 con 0x7f740c13c410 2023-09-30T22:22:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.261+0000 7f741394f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c09a500 con 0x7f740c09a130 2023-09-30T22:22:59.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.261+0000 7f741394f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f740c09f720 con 0x7f740c09edb0 2023-09-30T22:22:59.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f7410eea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09edb0 0x7f740c09f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f7410eea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09edb0 0x7f740c09f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59726/0 (socket says 172.21.15.154:59726) 2023-09-30T22:22:59.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f7410eea700 1 -- 172.21.15.154:0/1448912827 learned_addr learned my addr 172.21.15.154:0/1448912827 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:59.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f74116eb700 1 --2- 172.21.15.154:0/1448912827 >> v2:172.21.15.154:3300/0 conn(0x7f740c09a130 0x7f740c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f00806f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0078133ad0 0x7f0078133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f00806f1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00781300a0 0x7f00781304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f00806f1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00781309f0 0x7f007813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f00806f1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007806b2d0 con 0x7f00781300a0 2023-09-30T22:22:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f00806f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0078133610 con 0x7f0078133ad0 2023-09-30T22:22:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f00806f1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f007809a500 con 0x7f00781309f0 2023-09-30T22:22:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f007ec8e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00781309f0 0x7f007813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f007ec8e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00781309f0 0x7f007813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59742/0 (socket says 172.21.15.154:59742) 2023-09-30T22:22:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f007ec8e700 1 -- 172.21.15.154:0/3583736816 learned_addr learned my addr 172.21.15.154:0/3583736816 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f74116eb700 1 -- 172.21.15.154:0/1448912827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09edb0 msgr2=0x7f740c09f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f74116eb700 1 --2- 172.21.15.154:0/1448912827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09edb0 0x7f740c09f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f74116eb700 1 -- 172.21.15.154:0/1448912827 >> v1:172.21.15.154:6789/0 conn(0x7f740c13c410 legacy=0x7f740c13e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f74116eb700 1 -- 172.21.15.154:0/1448912827 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c09fe00 con 0x7f740c09a130 2023-09-30T22:22:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f007dc8c700 1 --2- 172.21.15.154:0/3583736816 >> v2:172.21.15.154:3300/0 conn(0x7f00781300a0 0x7f00781304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f007ec8e700 1 -- 172.21.15.154:0/3583736816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0078133ad0 msgr2=0x7f0078133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f007ec8e700 1 --2- 172.21.15.154:0/3583736816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0078133ad0 0x7f0078133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f007ec8e700 1 -- 172.21.15.154:0/3583736816 >> v2:172.21.15.154:3300/0 conn(0x7f00781300a0 msgr2=0x7f00781304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:22:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f007ec8e700 1 --2- 172.21.15.154:0/3583736816 >> v2:172.21.15.154:3300/0 conn(0x7f00781300a0 0x7f00781304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.262+0000 7f007ec8e700 1 -- 172.21.15.154:0/3583736816 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00781338b0 con 0x7f00781309f0 2023-09-30T22:22:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.263+0000 7f74116eb700 1 --2- 172.21.15.154:0/1448912827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f740c09a130 0x7f740c09e870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7408009840 tx=0x7f7408009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50b7dc0b6aee3b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.263+0000 7f007ec8e700 1 --2- 172.21.15.154:0/3583736816 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00781309f0 0x7f007813a980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0070009e50 tx=0x7f007000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2abc98815c8f0912 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.263+0000 7f7403fff700 1 -- 172.21.15.154:0/1448912827 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408004230 con 0x7f740c09a130 2023-09-30T22:22:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.263+0000 7f007d48b700 1 -- 172.21.15.154:0/3583736816 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007000e070 con 0x7f00781309f0 2023-09-30T22:22:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.263+0000 7f7403fff700 1 -- 172.21.15.154:0/1448912827 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7408004390 con 0x7f740c09a130 2023-09-30T22:22:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.263+0000 7f7403fff700 1 -- 172.21.15.154:0/1448912827 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080036a0 con 0x7f740c09a130 2023-09-30T22:22:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.263+0000 7f007d48b700 1 -- 172.21.15.154:0/3583736816 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007000b9c0 con 0x7f00781309f0 2023-09-30T22:22:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.263+0000 7f007d48b700 1 -- 172.21.15.154:0/3583736816 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007000bd70 con 0x7f00781309f0 2023-09-30T22:22:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f741394f700 1 -- 172.21.15.154:0/1448912827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f740c09a130 msgr2=0x7f740c09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f741394f700 1 --2- 172.21.15.154:0/1448912827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f740c09a130 0x7f740c09e870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7408009840 tx=0x7f7408009b50 comp rx=0 tx=0).stop 2023-09-30T22:22:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f00806f1700 1 -- 172.21.15.154:0/3583736816 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00781309f0 msgr2=0x7f007813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f00806f1700 1 --2- 172.21.15.154:0/3583736816 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00781309f0 0x7f007813a980 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0070009e50 tx=0x7f007000b330 comp rx=0 tx=0).stop 2023-09-30T22:22:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f741394f700 1 -- 172.21.15.154:0/1448912827 shutdown_connections 2023-09-30T22:22:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f741394f700 1 --2- 172.21.15.154:0/1448912827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f740c09a130 0x7f740c09e870 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f741394f700 1 --2- 172.21.15.154:0/1448912827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09edb0 0x7f740c09f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f741394f700 1 -- 172.21.15.154:0/1448912827 >> 172.21.15.154:0/1448912827 conn(0x7f740c0a4430 msgr2=0x7f740c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f00806f1700 1 -- 172.21.15.154:0/3583736816 shutdown_connections 2023-09-30T22:22:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f00806f1700 1 --2- 172.21.15.154:0/3583736816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0078133ad0 0x7f0078133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f00806f1700 1 --2- 172.21.15.154:0/3583736816 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00781309f0 0x7f007813a980 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f00806f1700 1 --2- 172.21.15.154:0/3583736816 >> v2:172.21.15.154:3300/0 conn(0x7f00781300a0 0x7f00781304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f00806f1700 1 -- 172.21.15.154:0/3583736816 >> 172.21.15.154:0/3583736816 conn(0x7f0078099c40 msgr2=0x7f00780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f741394f700 1 -- 172.21.15.154:0/1448912827 shutdown_connections 2023-09-30T22:22:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f741394f700 1 -- 172.21.15.154:0/1448912827 wait complete. 2023-09-30T22:22:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f00806f1700 1 -- 172.21.15.154:0/3583736816 shutdown_connections 2023-09-30T22:22:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.264+0000 7f00806f1700 1 -- 172.21.15.154:0/3583736816 wait complete. 2023-09-30T22:22:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f741394f700 1 Processor -- start 2023-09-30T22:22:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f741394f700 1 -- start start 2023-09-30T22:22:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f00806f1700 1 Processor -- start 2023-09-30T22:22:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f741394f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09a130 0x7f740c11b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f741394f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f740c09edb0 0x7f740c11b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f741394f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f740c13c410 0x7f740c11bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f741394f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c127840 con 0x7f740c09edb0 2023-09-30T22:22:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f741394f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0a1600 con 0x7f740c13c410 2023-09-30T22:22:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f741394f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f740c11d330 con 0x7f740c09a130 2023-09-30T22:22:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f74116eb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09a130 0x7f740c11b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f7410eea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f740c09edb0 0x7f740c11b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f74116eb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09a130 0x7f740c11b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59750/0 (socket says 172.21.15.154:59750) 2023-09-30T22:22:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f74116eb700 1 -- 172.21.15.154:0/2600678887 learned_addr learned my addr 172.21.15.154:0/2600678887 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f7411eec700 1 --2- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f740c13c410 0x7f740c11bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f74116eb700 1 -- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f740c13c410 msgr2=0x7f740c11bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f74116eb700 1 --2- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f740c13c410 0x7f740c11bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f74116eb700 1 -- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f740c09edb0 msgr2=0x7f740c11b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f74116eb700 1 --2- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f740c09edb0 0x7f740c11b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f74116eb700 1 -- 172.21.15.154:0/2600678887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080094a0 con 0x7f740c09a130 2023-09-30T22:22:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.265+0000 7f00806f1700 1 -- start start 2023-09-30T22:22:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f00806f1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00781300a0 0x7f0078119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f00806f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00781309f0 0x7f0078119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f00806f1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0078133ad0 0x7f007811a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:22:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f00806f1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007811b260 con 0x7f00781300a0 2023-09-30T22:22:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f00806f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007811bbd0 con 0x7f00781309f0 2023-09-30T22:22:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f00806f1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0078071850 con 0x7f0078133ad0 2023-09-30T22:22:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f007e48d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00781300a0 0x7f0078119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f007e48d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00781300a0 0x7f0078119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39140/0 (socket says 172.21.15.154:39140) 2023-09-30T22:22:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f007e48d700 1 -- 172.21.15.154:0/534866327 learned_addr learned my addr 172.21.15.154:0/534866327 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:22:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.266+0000 7f007ec8e700 1 --2- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0078133ad0 0x7f007811a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f007dc8c700 1 --2- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00781309f0 0x7f0078119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:22:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f007ec8e700 1 -- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00781309f0 msgr2=0x7f0078119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f007ec8e700 1 --2- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00781309f0 0x7f0078119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f007ec8e700 1 -- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00781300a0 msgr2=0x7f0078119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f007ec8e700 1 --2- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00781300a0 0x7f0078119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f007ec8e700 1 -- 172.21.15.154:0/534866327 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070009b30 con 0x7f0078133ad0 2023-09-30T22:22:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f74116eb700 1 --2- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09a130 0x7f740c11b140 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f74080090b0 tx=0x7f7408004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f7401ffb700 1 -- 172.21.15.154:0/2600678887 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408003c70 con 0x7f740c09a130 2023-09-30T22:22:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f7401ffb700 1 -- 172.21.15.154:0/2600678887 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7408003df0 con 0x7f740c09a130 2023-09-30T22:22:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f741394f700 1 -- 172.21.15.154:0/2600678887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c11e3f0 con 0x7f740c09a130 2023-09-30T22:22:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f7401ffb700 1 -- 172.21.15.154:0/2600678887 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408011870 con 0x7f740c09a130 2023-09-30T22:22:59.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f007ec8e700 1 --2- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0078133ad0 0x7f007811a0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f007806e4e0 tx=0x7f0070004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:22:59.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f006effd700 1 -- 172.21.15.154:0/534866327 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700092e0 con 0x7f0078133ad0 2023-09-30T22:22:59.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f006effd700 1 -- 172.21.15.154:0/534866327 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0070004250 con 0x7f0078133ad0 2023-09-30T22:22:59.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f006effd700 1 -- 172.21.15.154:0/534866327 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070004620 con 0x7f0078133ad0 2023-09-30T22:22:59.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f741394f700 1 -- 172.21.15.154:0/2600678887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c11d540 con 0x7f740c09a130 2023-09-30T22:22:59.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.268+0000 7f7401ffb700 1 -- 172.21.15.154:0/2600678887 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7408018040 con 0x7f740c09a130 2023-09-30T22:22:59.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.267+0000 7f00806f1700 1 -- 172.21.15.154:0/534866327 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00780a3400 con 0x7f0078133ad0 2023-09-30T22:22:59.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.268+0000 7f00806f1700 1 -- 172.21.15.154:0/534866327 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007811b630 con 0x7f0078133ad0 2023-09-30T22:22:59.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.268+0000 7f741394f700 1 -- 172.21.15.154:0/2600678887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c04f2a0 con 0x7f740c09a130 2023-09-30T22:22:59.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.269+0000 7f7401ffb700 1 -- 172.21.15.154:0/2600678887 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f740803fec0 con 0x7f740c09a130 2023-09-30T22:22:59.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.269+0000 7f00806f1700 1 -- 172.21.15.154:0/534866327 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007811b480 con 0x7f0078133ad0 2023-09-30T22:22:59.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.269+0000 7f006effd700 1 -- 172.21.15.154:0/534866327 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0070004780 con 0x7f0078133ad0 2023-09-30T22:22:59.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.273+0000 7f006effd700 1 -- 172.21.15.154:0/534866327 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f007001c440 con 0x7f0078133ad0 2023-09-30T22:22:59.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.273+0000 7f7401ffb700 1 -- 172.21.15.154:0/2600678887 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f740801a400 con 0x7f740c09a130 2023-09-30T22:22:59.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.278+0000 7f006effd700 1 -- 172.21.15.154:0/534866327 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f007001a330 con 0x7f0078133ad0 2023-09-30T22:22:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.395+0000 7f01b2f45700 1 -- 172.21.15.154:0/2606185810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f01ac04f2a0 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.396+0000 7f01a97fa700 1 -- 172.21.15.154:0/2606185810 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01a0017020 con 0x7f01ac0a0ee0 2023-09-30T22:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.398+0000 7f01b2f45700 1 -- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac0a0ee0 msgr2=0x7f01ac11d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.398+0000 7f01b2f45700 1 --2- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac0a0ee0 0x7f01ac11d7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01a000e990 tx=0x7f01a000eca0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.398+0000 7f01b2f45700 1 -- 172.21.15.154:0/2606185810 shutdown_connections 2023-09-30T22:22:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.398+0000 7f01b2f45700 1 --2- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01ac134210 0x7f01ac11e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.398+0000 7f01b2f45700 1 --2- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01ac0a0ee0 0x7f01ac11d7d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.398+0000 7f01b2f45700 1 --2- 172.21.15.154:0/2606185810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01ac133900 0x7f01ac11dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.398+0000 7f01b2f45700 1 -- 172.21.15.154:0/2606185810 >> 172.21.15.154:0/2606185810 conn(0x7f01ac0a2980 msgr2=0x7f01ac1baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.398+0000 7f01b2f45700 1 -- 172.21.15.154:0/2606185810 shutdown_connections 2023-09-30T22:22:59.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.398+0000 7f01b2f45700 1 -- 172.21.15.154:0/2606185810 wait complete. 2023-09-30T22:22:59.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:22:59.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.447+0000 7f7b93171700 1 -- 172.21.15.154:0/3471052690 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7b8c06bce0 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.448+0000 7f7b897fa700 1 -- 172.21.15.154:0/3471052690 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b80011b40 con 0x7f7b8c0a08e0 2023-09-30T22:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.450+0000 7f7b93171700 1 -- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8c0a08e0 msgr2=0x7f7b8c1263c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.450+0000 7f7b93171700 1 --2- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8c0a08e0 0x7f7b8c1263c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000ebe0 tx=0x7f7b8000eef0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.450+0000 7f7b93171700 1 -- 172.21.15.154:0/3471052690 shutdown_connections 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.450+0000 7f7b93171700 1 --2- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8c138040 0x7f7b8c126e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.450+0000 7f7b93171700 1 --2- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8c0a08e0 0x7f7b8c1263c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.450+0000 7f7b93171700 1 --2- 172.21.15.154:0/3471052690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8c0a1230 0x7f7b8c126900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.450+0000 7f7b93171700 1 -- 172.21.15.154:0/3471052690 >> 172.21.15.154:0/3471052690 conn(0x7f7b8c0a2980 msgr2=0x7f7b8c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.450+0000 7f7b93171700 1 -- 172.21.15.154:0/3471052690 shutdown_connections 2023-09-30T22:22:59.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.450+0000 7f7b93171700 1 -- 172.21.15.154:0/3471052690 wait complete. 2023-09-30T22:22:59.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:22:59.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.467+0000 7f741394f700 1 -- 172.21.15.154:0/2600678887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f740c06be20 con 0x7f740c09a130 2023-09-30T22:22:59.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.467+0000 7f7401ffb700 1 -- 172.21.15.154:0/2600678887 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f740802b070 con 0x7f740c09a130 2023-09-30T22:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:22:59.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.469+0000 7f741394f700 1 -- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09a130 msgr2=0x7f740c11b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.469+0000 7f741394f700 1 --2- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09a130 0x7f740c11b140 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f74080090b0 tx=0x7f7408004750 comp rx=0 tx=0).stop 2023-09-30T22:22:59.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.469+0000 7f741394f700 1 -- 172.21.15.154:0/2600678887 shutdown_connections 2023-09-30T22:22:59.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.469+0000 7f741394f700 1 --2- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f740c13c410 0x7f740c11bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.469+0000 7f741394f700 1 --2- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f740c09a130 0x7f740c11b140 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.469+0000 7f741394f700 1 --2- 172.21.15.154:0/2600678887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f740c09edb0 0x7f740c11b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.469+0000 7f741394f700 1 -- 172.21.15.154:0/2600678887 >> 172.21.15.154:0/2600678887 conn(0x7f740c0a4430 msgr2=0x7f740c0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.469+0000 7f741394f700 1 -- 172.21.15.154:0/2600678887 shutdown_connections 2023-09-30T22:22:59.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.469+0000 7f741394f700 1 -- 172.21.15.154:0/2600678887 wait complete. 2023-09-30T22:22:59.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:22:59.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.484+0000 7f00806f1700 1 -- 172.21.15.154:0/534866327 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f007804f2a0 con 0x7f0078133ad0 2023-09-30T22:22:59.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.484+0000 7f006effd700 1 -- 172.21.15.154:0/534866327 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f007001b3a0 con 0x7f0078133ad0 2023-09-30T22:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:22:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.487+0000 7f00806f1700 1 -- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0078133ad0 msgr2=0x7f007811a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:22:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.487+0000 7f00806f1700 1 --2- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0078133ad0 0x7f007811a0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f007806e4e0 tx=0x7f0070004ad0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.487+0000 7f00806f1700 1 -- 172.21.15.154:0/534866327 shutdown_connections 2023-09-30T22:22:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.487+0000 7f00806f1700 1 --2- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0078133ad0 0x7f007811a0b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.487+0000 7f00806f1700 1 --2- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00781300a0 0x7f0078119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.487+0000 7f00806f1700 1 --2- 172.21.15.154:0/534866327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00781309f0 0x7f0078119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:22:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.487+0000 7f00806f1700 1 -- 172.21.15.154:0/534866327 >> 172.21.15.154:0/534866327 conn(0x7f0078099c40 msgr2=0x7f0078132c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:22:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.487+0000 7f00806f1700 1 -- 172.21.15.154:0/534866327 shutdown_connections 2023-09-30T22:22:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:22:59.487+0000 7f00806f1700 1 -- 172.21.15.154:0/534866327 wait complete. 2023-09-30T22:22:59.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:00.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:00.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:00.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:00.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.561+0000 7fe9ba791700 1 Processor -- start 2023-09-30T22:23:00.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.561+0000 7fe9ba791700 1 -- start start 2023-09-30T22:23:00.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.561+0000 7fe9ba791700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9b406a770 0x7fe9b41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.561+0000 7fe9ba791700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b4134f00 0x7fe9b409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.561+0000 7fe9ba791700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b409eca0 con 0x7fe9b409dea0 2023-09-30T22:23:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.561+0000 7fe9ba791700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b409f720 con 0x7fe9b406a770 2023-09-30T22:23:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.561+0000 7fe9ba791700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b406b480 con 0x7fe9b4134f00 2023-09-30T22:23:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9b406a770 0x7fe9b41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9b406a770 0x7fe9b41349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39148/0 (socket says 172.21.15.154:39148) 2023-09-30T22:23:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b3fff700 1 -- 172.21.15.154:0/2550336355 learned_addr learned my addr 172.21.15.154:0/2550336355 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b37fe700 1 --2- 172.21.15.154:0/2550336355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b4134f00 0x7fe9b409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b3fff700 1 -- 172.21.15.154:0/2550336355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b4134f00 msgr2=0x7fe9b409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b3fff700 1 --2- 172.21.15.154:0/2550336355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b4134f00 0x7fe9b409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b3fff700 1 -- 172.21.15.154:0/2550336355 >> v1:172.21.15.154:6789/0 conn(0x7fe9b409dea0 legacy=0x7fe9b413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b3fff700 1 -- 172.21.15.154:0/2550336355 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b41352d0 con 0x7fe9b406a770 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b3fff700 1 --2- 172.21.15.154:0/2550336355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 0x7fe9b41349c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40098f0 tx=0x7fe9a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1badb7a1e563679 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b2ffd700 1 -- 172.21.15.154:0/2550336355 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4004230 con 0x7fe9b406a770 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b2ffd700 1 -- 172.21.15.154:0/2550336355 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a4004390 con 0x7fe9b406a770 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.562+0000 7fe9b2ffd700 1 -- 172.21.15.154:0/2550336355 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40036a0 con 0x7fe9b406a770 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.563+0000 7fe9ba791700 1 -- 172.21.15.154:0/2550336355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 msgr2=0x7fe9b41349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.563+0000 7fe9ba791700 1 --2- 172.21.15.154:0/2550336355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 0x7fe9b41349c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40098f0 tx=0x7fe9a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.563+0000 7fe9ba791700 1 -- 172.21.15.154:0/2550336355 shutdown_connections 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.563+0000 7fe9ba791700 1 --2- 172.21.15.154:0/2550336355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 0x7fe9b41349c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.563+0000 7fe9ba791700 1 --2- 172.21.15.154:0/2550336355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b4134f00 0x7fe9b409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.563+0000 7fe9ba791700 1 -- 172.21.15.154:0/2550336355 >> 172.21.15.154:0/2550336355 conn(0x7fe9b4099c40 msgr2=0x7fe9b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.564+0000 7fe9ba791700 1 -- 172.21.15.154:0/2550336355 shutdown_connections 2023-09-30T22:23:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.564+0000 7fe9ba791700 1 -- 172.21.15.154:0/2550336355 wait complete. 2023-09-30T22:23:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.565+0000 7fe9ba791700 1 Processor -- start 2023-09-30T22:23:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.565+0000 7fe9ba791700 1 -- start start 2023-09-30T22:23:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9ba791700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 0x7fe9b4133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9ba791700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b409dea0 0x7fe9b411a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9ba791700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9b4134f00 0x7fe9b411ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9ba791700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b411c960 con 0x7fe9b406a770 2023-09-30T22:23:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9ba791700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b4139270 con 0x7fe9b4134f00 2023-09-30T22:23:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9ba791700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b409f220 con 0x7fe9b409dea0 2023-09-30T22:23:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 0x7fe9b4133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 0x7fe9b4133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39162/0 (socket says 172.21.15.154:39162) 2023-09-30T22:23:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b3fff700 1 -- 172.21.15.154:0/4008127831 learned_addr learned my addr 172.21.15.154:0/4008127831 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b37fe700 1 --2- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b409dea0 0x7fe9b411a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b3fff700 1 -- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b409dea0 msgr2=0x7fe9b411a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b3fff700 1 --2- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b409dea0 0x7fe9b411a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b3fff700 1 -- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9b4134f00 msgr2=0x7fe9b411ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b3fff700 1 --2- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9b4134f00 0x7fe9b411ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b3fff700 1 -- 172.21.15.154:0/4008127831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4009550 con 0x7fe9b406a770 2023-09-30T22:23:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.566+0000 7fe9b37fe700 1 --2- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b409dea0 0x7fe9b411a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.567+0000 7fe9b3fff700 1 --2- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 0x7fe9b4133d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9b409f860 tx=0x7fe9a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.567+0000 7fe9b0ff9700 1 -- 172.21.15.154:0/4008127831 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4003d60 con 0x7fe9b406a770 2023-09-30T22:23:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.567+0000 7fe9b0ff9700 1 -- 172.21.15.154:0/4008127831 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a4011630 con 0x7fe9b406a770 2023-09-30T22:23:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.567+0000 7fe9ba791700 1 -- 172.21.15.154:0/4008127831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b4140ea0 con 0x7fe9b406a770 2023-09-30T22:23:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.567+0000 7fe9b0ff9700 1 -- 172.21.15.154:0/4008127831 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40119e0 con 0x7fe9b406a770 2023-09-30T22:23:00.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.567+0000 7fe9ba791700 1 -- 172.21.15.154:0/4008127831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b411ce00 con 0x7fe9b406a770 2023-09-30T22:23:00.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.568+0000 7fe99a7fc700 1 -- 172.21.15.154:0/4008127831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c0052e0 con 0x7fe9b406a770 2023-09-30T22:23:00.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.568+0000 7fe9b0ff9700 1 -- 172.21.15.154:0/4008127831 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9a4011b40 con 0x7fe9b406a770 2023-09-30T22:23:00.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.569+0000 7fe9b0ff9700 1 -- 172.21.15.154:0/4008127831 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe9a4040bf0 con 0x7fe9b406a770 2023-09-30T22:23:00.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.577+0000 7fe9b0ff9700 1 -- 172.21.15.154:0/4008127831 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9a402ce00 con 0x7fe9b406a770 2023-09-30T22:23:00.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.601+0000 7fa8b7a2a700 1 Processor -- start 2023-09-30T22:23:00.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b7a2a700 1 -- start start 2023-09-30T22:23:00.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b7a2a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b006a770 0x7fa8b006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b7a2a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8b006b080 0x7fa8b01317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b7a2a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b0131cf0 0x7fa8b0132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b7a2a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b009f770 con 0x7fa8b006b080 2023-09-30T22:23:00.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b7a2a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b009dce0 con 0x7fa8b006a770 2023-09-30T22:23:00.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b7a2a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b009da80 con 0x7fa8b0131cf0 2023-09-30T22:23:00.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b57c6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b006a770 0x7fa8b006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b5fc7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b0131cf0 0x7fa8b0132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b57c6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b006a770 0x7fa8b006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35898/0 (socket says 172.21.15.154:35898) 2023-09-30T22:23:00.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b5fc7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b0131cf0 0x7fa8b0132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59786/0 (socket says 172.21.15.154:59786) 2023-09-30T22:23:00.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b57c6700 1 -- 172.21.15.154:0/2187584630 learned_addr learned my addr 172.21.15.154:0/2187584630 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:00.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.602+0000 7fa8b4fc5700 1 --2- 172.21.15.154:0/2187584630 >> v2:172.21.15.154:3300/0 conn(0x7fa8b006b080 0x7fa8b01317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8b4fc5700 1 -- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b0131cf0 msgr2=0x7fa8b0132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8b4fc5700 1 --2- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b0131cf0 0x7fa8b0132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8b4fc5700 1 -- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b006a770 msgr2=0x7fa8b006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8b4fc5700 1 --2- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b006a770 0x7fa8b006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8b4fc5700 1 -- 172.21.15.154:0/2187584630 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b009eb20 con 0x7fa8b006b080 2023-09-30T22:23:00.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8b57c6700 1 --2- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b006a770 0x7fa8b006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:00.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8b4fc5700 1 --2- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006b080 0x7fa8b01317b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009840 tx=0x7fa8a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa54346c53531b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8a7fff700 1 -- 172.21.15.154:0/2187584630 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0011830 con 0x7fa8b006b080 2023-09-30T22:23:00.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8a7fff700 1 -- 172.21.15.154:0/2187584630 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0011990 con 0x7fa8b006b080 2023-09-30T22:23:00.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.603+0000 7fa8a7fff700 1 -- 172.21.15.154:0/2187584630 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0011d20 con 0x7fa8b006b080 2023-09-30T22:23:00.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.604+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006b080 msgr2=0x7fa8b01317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.604+0000 7fa8b7a2a700 1 --2- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006b080 0x7fa8b01317b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009840 tx=0x7fa8a0009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:00.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.604+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/2187584630 shutdown_connections 2023-09-30T22:23:00.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.604+0000 7fa8b7a2a700 1 --2- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b006a770 0x7fa8b006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.604+0000 7fa8b7a2a700 1 --2- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b0131cf0 0x7fa8b0132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.604+0000 7fa8b7a2a700 1 --2- 172.21.15.154:0/2187584630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006b080 0x7fa8b01317b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.604+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/2187584630 >> 172.21.15.154:0/2187584630 conn(0x7fa8b0099c40 msgr2=0x7fa8b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.604+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/2187584630 shutdown_connections 2023-09-30T22:23:00.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.604+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/2187584630 wait complete. 2023-09-30T22:23:00.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.605+0000 7fa8b7a2a700 1 Processor -- start 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.605+0000 7fa8b7a2a700 1 -- start start 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b7a2a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006a770 0x7fa8b011d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b7a2a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b006b080 0x7fa8b011d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b7a2a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0131cf0 0x7fa8b01c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b7a2a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b01202f0 con 0x7fa8b006a770 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b7a2a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b01204d0 con 0x7fa8b0131cf0 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b7a2a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0131340 con 0x7fa8b006b080 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b5fc7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0131cf0 0x7fa8b01c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b4fc5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b006b080 0x7fa8b011d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b5fc7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0131cf0 0x7fa8b01c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35912/0 (socket says 172.21.15.154:35912) 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b5fc7700 1 -- 172.21.15.154:0/1864861934 learned_addr learned my addr 172.21.15.154:0/1864861934 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b57c6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006a770 0x7fa8b011d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b57c6700 1 -- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b006b080 msgr2=0x7fa8b011d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b57c6700 1 --2- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b006b080 0x7fa8b011d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b57c6700 1 -- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0131cf0 msgr2=0x7fa8b01c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b57c6700 1 --2- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0131cf0 0x7fa8b01c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b57c6700 1 -- 172.21.15.154:0/1864861934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac009550 con 0x7fa8b006a770 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b4fc5700 1 --2- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b006b080 0x7fa8b011d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b5fc7700 1 --2- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0131cf0 0x7fa8b01c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.606+0000 7fa8b57c6700 1 --2- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006a770 0x7fa8b011d380 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00e9d0 tx=0x7fa8ac00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.607+0000 7fa8a5ffb700 1 -- 172.21.15.154:0/1864861934 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00ee70 con 0x7fa8b006a770 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.607+0000 7fa8a5ffb700 1 -- 172.21.15.154:0/1864861934 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac004030 con 0x7fa8b006a770 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.607+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/1864861934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a00094a0 con 0x7fa8b006a770 2023-09-30T22:23:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.607+0000 7fa8a5ffb700 1 -- 172.21.15.154:0/1864861934 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0043c0 con 0x7fa8b006a770 2023-09-30T22:23:00.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.607+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/1864861934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b0071e10 con 0x7fa8b006a770 2023-09-30T22:23:00.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.608+0000 7fa8a5ffb700 1 -- 172.21.15.154:0/1864861934 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8ac00c850 con 0x7fa8b006a770 2023-09-30T22:23:00.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.608+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/1864861934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b009d2f0 con 0x7fa8b006a770 2023-09-30T22:23:00.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.608+0000 7fa8a5ffb700 1 -- 172.21.15.154:0/1864861934 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa8ac00cb00 con 0x7fa8b006a770 2023-09-30T22:23:00.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.613+0000 7fa8a5ffb700 1 -- 172.21.15.154:0/1864861934 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8ac004520 con 0x7fa8b006a770 2023-09-30T22:23:00.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.640+0000 7f519d775700 1 Processor -- start 2023-09-30T22:23:00.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f519d775700 1 -- start start 2023-09-30T22:23:00.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f519d775700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f519809d860 0x7f519809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f519d775700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5198130eb0 0x7f5198138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f519d775700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519809aaa0 con 0x7f519809e170 2023-09-30T22:23:00.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f519d775700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519809f870 con 0x7f519809d860 2023-09-30T22:23:00.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f519d775700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f519809b360 con 0x7f5198130eb0 2023-09-30T22:23:00.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f51977fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5198130eb0 0x7f5198138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f51977fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5198130eb0 0x7f5198138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59798/0 (socket says 172.21.15.154:59798) 2023-09-30T22:23:00.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f51977fe700 1 -- 172.21.15.154:0/395508680 learned_addr learned my addr 172.21.15.154:0/395508680 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:00.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f51977fe700 1 -- 172.21.15.154:0/395508680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f519809d860 msgr2=0x7f519809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f51977fe700 1 --2- 172.21.15.154:0/395508680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f519809d860 0x7f519809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.641+0000 7f51977fe700 1 -- 172.21.15.154:0/395508680 >> v1:172.21.15.154:6789/0 conn(0x7f519809e170 legacy=0x7f51981307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.642+0000 7f51977fe700 1 -- 172.21.15.154:0/395508680 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519809b620 con 0x7f5198130eb0 2023-09-30T22:23:00.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.642+0000 7f51977fe700 1 --2- 172.21.15.154:0/395508680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5198130eb0 0x7f5198138a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f519000d180 tx=0x7f519000d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f34ebd959fe4419 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.642+0000 7f5195ffb700 1 -- 172.21.15.154:0/395508680 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5190010070 con 0x7f5198130eb0 2023-09-30T22:23:00.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.642+0000 7f5195ffb700 1 -- 172.21.15.154:0/395508680 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519000ddb0 con 0x7f5198130eb0 2023-09-30T22:23:00.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.642+0000 7f5195ffb700 1 -- 172.21.15.154:0/395508680 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519000b310 con 0x7f5198130eb0 2023-09-30T22:23:00.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.642+0000 7f519d775700 1 -- 172.21.15.154:0/395508680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5198130eb0 msgr2=0x7f5198138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.642+0000 7f519d775700 1 --2- 172.21.15.154:0/395508680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5198130eb0 0x7f5198138a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f519000d180 tx=0x7f519000d490 comp rx=0 tx=0).stop 2023-09-30T22:23:00.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.643+0000 7f519d775700 1 -- 172.21.15.154:0/395508680 shutdown_connections 2023-09-30T22:23:00.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.643+0000 7f519d775700 1 --2- 172.21.15.154:0/395508680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5198130eb0 0x7f5198138a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.643+0000 7f519d775700 1 --2- 172.21.15.154:0/395508680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f519809d860 0x7f519809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.643+0000 7f519d775700 1 -- 172.21.15.154:0/395508680 >> 172.21.15.154:0/395508680 conn(0x7f5198099c40 msgr2=0x7f51980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.643+0000 7f519d775700 1 -- 172.21.15.154:0/395508680 shutdown_connections 2023-09-30T22:23:00.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.643+0000 7f519d775700 1 -- 172.21.15.154:0/395508680 wait complete. 2023-09-30T22:23:00.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f519d775700 1 Processor -- start 2023-09-30T22:23:00.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f519d775700 1 -- start start 2023-09-30T22:23:00.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f519d775700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f519809d860 0x7f519811b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f519d775700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f519809e170 0x7f519811b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f519d775700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5198130eb0 0x7f519811be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f519d775700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519811d520 con 0x7f519809d860 2023-09-30T22:23:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f519d775700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519811ede0 con 0x7f5198130eb0 2023-09-30T22:23:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f519d775700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5198072210 con 0x7f519809e170 2023-09-30T22:23:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f51967fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f519809e170 0x7f519811b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f51967fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f519809e170 0x7f519811b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59810/0 (socket says 172.21.15.154:59810) 2023-09-30T22:23:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f51967fc700 1 -- 172.21.15.154:0/1630934605 learned_addr learned my addr 172.21.15.154:0/1630934605 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.644+0000 7f51977fe700 1 --2- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5198130eb0 0x7f519811be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f5196ffd700 1 --2- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f519809d860 0x7f519811b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f51967fc700 1 -- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5198130eb0 msgr2=0x7f519811be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f51967fc700 1 --2- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5198130eb0 0x7f519811be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f51967fc700 1 -- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f519809d860 msgr2=0x7f519811b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f51967fc700 1 --2- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f519809d860 0x7f519811b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f51967fc700 1 -- 172.21.15.154:0/1630934605 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519000bd40 con 0x7f519809e170 2023-09-30T22:23:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f51967fc700 1 --2- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f519809e170 0x7f519811b8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c4d0 tx=0x7f518c00c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f517f7fe700 1 -- 172.21.15.154:0/1630934605 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c00cea0 con 0x7f519809e170 2023-09-30T22:23:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f517f7fe700 1 -- 172.21.15.154:0/1630934605 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c0054e0 con 0x7f519809e170 2023-09-30T22:23:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f517f7fe700 1 -- 172.21.15.154:0/1630934605 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c0038c0 con 0x7f519809e170 2023-09-30T22:23:00.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f519d775700 1 -- 172.21.15.154:0/1630934605 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519811ced0 con 0x7f519809e170 2023-09-30T22:23:00.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.645+0000 7f519d775700 1 -- 172.21.15.154:0/1630934605 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519811e840 con 0x7f519809e170 2023-09-30T22:23:00.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.646+0000 7f517f7fe700 1 -- 172.21.15.154:0/1630934605 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f518c003a20 con 0x7f519809e170 2023-09-30T22:23:00.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.646+0000 7f517f7fe700 1 -- 172.21.15.154:0/1630934605 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f518c03e840 con 0x7f519809e170 2023-09-30T22:23:00.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.646+0000 7f519d775700 1 -- 172.21.15.154:0/1630934605 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519811d720 con 0x7f519809e170 2023-09-30T22:23:00.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.651+0000 7f517f7fe700 1 -- 172.21.15.154:0/1630934605 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f518c017030 con 0x7f519809e170 2023-09-30T22:23:00.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.680+0000 7f04db9c2700 1 Processor -- start 2023-09-30T22:23:00.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.680+0000 7f04db9c2700 1 -- start start 2023-09-30T22:23:00.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04db9c2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04d409f430 0x7f04d4136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04db9c2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d4137010 0x7f04d41393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04db9c2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d409b6d0 con 0x7f04d409e950 2023-09-30T22:23:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04db9c2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d409afb0 con 0x7f04d409f430 2023-09-30T22:23:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04db9c2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40a0970 con 0x7f04d4137010 2023-09-30T22:23:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d8f5d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04d409f430 0x7f04d4136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d8f5d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04d409f430 0x7f04d4136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39192/0 (socket says 172.21.15.154:39192) 2023-09-30T22:23:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d8f5d700 1 -- 172.21.15.154:0/303682554 learned_addr learned my addr 172.21.15.154:0/303682554 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d9f5f700 1 --2- 172.21.15.154:0/303682554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d4137010 0x7f04d41393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d8f5d700 1 -- 172.21.15.154:0/303682554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d4137010 msgr2=0x7f04d41393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d8f5d700 1 --2- 172.21.15.154:0/303682554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d4137010 0x7f04d41393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d8f5d700 1 -- 172.21.15.154:0/303682554 >> v1:172.21.15.154:6789/0 conn(0x7f04d409e950 legacy=0x7f04d409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04cbfff700 1 -- 172.21.15.154:0/303682554 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553338433 0 0) 0x7f04d409b6d0 con 0x7f04d409e950 2023-09-30T22:23:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d8f5d700 1 -- 172.21.15.154:0/303682554 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40a0320 con 0x7f04d409f430 2023-09-30T22:23:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d9f5f700 1 --2- 172.21.15.154:0/303682554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d4137010 0x7f04d41393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.681+0000 7f04d8f5d700 1 --2- 172.21.15.154:0/303682554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d409f430 0x7f04d4136ad0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f04c40098f0 tx=0x7f04c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c5f351c0be6670 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.682+0000 7f04cbfff700 1 -- 172.21.15.154:0/303682554 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400b8a0 con 0x7f04d409f430 2023-09-30T22:23:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.682+0000 7f04cbfff700 1 -- 172.21.15.154:0/303682554 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400ba00 con 0x7f04d409f430 2023-09-30T22:23:00.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.682+0000 7f04cbfff700 1 -- 172.21.15.154:0/303682554 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400bd90 con 0x7f04d409f430 2023-09-30T22:23:00.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.682+0000 7f04db9c2700 1 -- 172.21.15.154:0/303682554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d409f430 msgr2=0x7f04d4136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.682+0000 7f04db9c2700 1 --2- 172.21.15.154:0/303682554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d409f430 0x7f04d4136ad0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f04c40098f0 tx=0x7f04c4009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.682+0000 7f04db9c2700 1 -- 172.21.15.154:0/303682554 shutdown_connections 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.682+0000 7f04db9c2700 1 --2- 172.21.15.154:0/303682554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d4137010 0x7f04d41393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.682+0000 7f04db9c2700 1 --2- 172.21.15.154:0/303682554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d409f430 0x7f04d4136ad0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.682+0000 7f04db9c2700 1 -- 172.21.15.154:0/303682554 >> 172.21.15.154:0/303682554 conn(0x7f04d40a0f70 msgr2=0x7f04d40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.683+0000 7f04db9c2700 1 -- 172.21.15.154:0/303682554 shutdown_connections 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.683+0000 7f04db9c2700 1 -- 172.21.15.154:0/303682554 wait complete. 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.684+0000 7f04db9c2700 1 Processor -- start 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.684+0000 7f04db9c2700 1 -- start start 2023-09-30T22:23:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04db9c2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d409e950 0x7f04d411f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04db9c2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d409f430 0x7f04d411f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04db9c2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04d4137010 0x7f04d411ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04db9c2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4122fc0 con 0x7f04d409f430 2023-09-30T22:23:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04db9c2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d41216d0 con 0x7f04d409e950 2023-09-30T22:23:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04db9c2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04d409da40 con 0x7f04d4137010 2023-09-30T22:23:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d9f5f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04d4137010 0x7f04d411ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d9f5f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04d4137010 0x7f04d411ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59824/0 (socket says 172.21.15.154:59824) 2023-09-30T22:23:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d9f5f700 1 -- 172.21.15.154:0/2945712900 learned_addr learned my addr 172.21.15.154:0/2945712900 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d8f5d700 1 --2- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d409f430 0x7f04d411f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d975e700 1 --2- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d409e950 0x7f04d411f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d9f5f700 1 -- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d409e950 msgr2=0x7f04d411f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d9f5f700 1 --2- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d409e950 0x7f04d411f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d9f5f700 1 -- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d409f430 msgr2=0x7f04d411f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d9f5f700 1 --2- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d409f430 0x7f04d411f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d9f5f700 1 -- 172.21.15.154:0/2945712900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4009550 con 0x7f04d4137010 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.685+0000 7f04d9f5f700 1 --2- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04d4137010 0x7f04d411ff20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009f70 tx=0x7f04cc00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.686+0000 7f04c9ffb700 1 -- 172.21.15.154:0/2945712900 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00dd80 con 0x7f04d4137010 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.686+0000 7f04db9c2700 1 -- 172.21.15.154:0/2945712900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d41210b0 con 0x7f04d4137010 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.686+0000 7f04c9ffb700 1 -- 172.21.15.154:0/2945712900 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc00f040 con 0x7f04d4137010 2023-09-30T22:23:00.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.686+0000 7f04c9ffb700 1 -- 172.21.15.154:0/2945712900 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc003c60 con 0x7f04d4137010 2023-09-30T22:23:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.686+0000 7f04db9c2700 1 -- 172.21.15.154:0/2945712900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d41218a0 con 0x7f04d4137010 2023-09-30T22:23:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.687+0000 7f04c9ffb700 1 -- 172.21.15.154:0/2945712900 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04cc004030 con 0x7f04d4137010 2023-09-30T22:23:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.687+0000 7f04c9ffb700 1 -- 172.21.15.154:0/2945712900 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f04cc03f7b0 con 0x7f04d4137010 2023-09-30T22:23:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.688+0000 7f04db9c2700 1 -- 172.21.15.154:0/2945712900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d404f2a0 con 0x7f04d4137010 2023-09-30T22:23:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.693+0000 7f04c9ffb700 1 -- 172.21.15.154:0/2945712900 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04cc01e3b0 con 0x7f04d4137010 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.812+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/1864861934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa8b004f2a0 con 0x7fa8b006a770 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.812+0000 7fa8a5ffb700 1 -- 172.21.15.154:0/1864861934 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8ac019300 con 0x7fa8b006a770 2023-09-30T22:23:00.812 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.815+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006a770 msgr2=0x7fa8b011d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.815+0000 7fa8b7a2a700 1 --2- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006a770 0x7fa8b011d380 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00e9d0 tx=0x7fa8ac00ece0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.815+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/1864861934 shutdown_connections 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.815+0000 7fa8b7a2a700 1 --2- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8b0131cf0 0x7fa8b01c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.815+0000 7fa8b7a2a700 1 --2- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b006a770 0x7fa8b011d380 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.815+0000 7fa8b7a2a700 1 --2- 172.21.15.154:0/1864861934 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8b006b080 0x7fa8b011d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.815+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/1864861934 >> 172.21.15.154:0/1864861934 conn(0x7fa8b0099c40 msgr2=0x7fa8b01b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.815+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/1864861934 shutdown_connections 2023-09-30T22:23:00.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.815+0000 7fa8b7a2a700 1 -- 172.21.15.154:0/1864861934 wait complete. 2023-09-30T22:23:00.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:00.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.845+0000 7fe99a7fc700 1 -- 172.21.15.154:0/4008127831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe98c005590 con 0x7fe9b406a770 2023-09-30T22:23:00.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.845+0000 7fe9b0ff9700 1 -- 172.21.15.154:0/4008127831 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9a4028020 con 0x7fe9b406a770 2023-09-30T22:23:00.845 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:00.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.847+0000 7fe99a7fc700 1 -- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 msgr2=0x7fe9b4133d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.847+0000 7fe99a7fc700 1 --2- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 0x7fe9b4133d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9b409f860 tx=0x7fe9a4004750 comp rx=0 tx=0).stop 2023-09-30T22:23:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.847+0000 7fe99a7fc700 1 -- 172.21.15.154:0/4008127831 shutdown_connections 2023-09-30T22:23:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.847+0000 7fe99a7fc700 1 --2- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9b4134f00 0x7fe9b411ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.847+0000 7fe99a7fc700 1 --2- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9b406a770 0x7fe9b4133d30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.847+0000 7fe99a7fc700 1 --2- 172.21.15.154:0/4008127831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe9b409dea0 0x7fe9b411a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.847+0000 7fe99a7fc700 1 -- 172.21.15.154:0/4008127831 >> 172.21.15.154:0/4008127831 conn(0x7fe9b4099c40 msgr2=0x7fe9b40a3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.848+0000 7fe99a7fc700 1 -- 172.21.15.154:0/4008127831 shutdown_connections 2023-09-30T22:23:00.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.848+0000 7fe99a7fc700 1 -- 172.21.15.154:0/4008127831 wait complete. 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.849+0000 7f519d775700 1 -- 172.21.15.154:0/1630934605 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f519804f2a0 con 0x7f519809e170 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.849+0000 7f517f7fe700 1 -- 172.21.15.154:0/1630934605 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f518c011be0 con 0x7f519809e170 2023-09-30T22:23:00.849 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.852+0000 7f519d775700 1 -- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f519809e170 msgr2=0x7f519811b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.852+0000 7f519d775700 1 --2- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f519809e170 0x7f519811b8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c4d0 tx=0x7f518c00c7e0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.852+0000 7f519d775700 1 -- 172.21.15.154:0/1630934605 shutdown_connections 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.852+0000 7f519d775700 1 --2- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5198130eb0 0x7f519811be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.852+0000 7f519d775700 1 --2- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f519809d860 0x7f519811b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.852+0000 7f519d775700 1 --2- 172.21.15.154:0/1630934605 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f519809e170 0x7f519811b8c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.852+0000 7f519d775700 1 -- 172.21.15.154:0/1630934605 >> 172.21.15.154:0/1630934605 conn(0x7f5198099c40 msgr2=0x7f51981b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.852+0000 7f519d775700 1 -- 172.21.15.154:0/1630934605 shutdown_connections 2023-09-30T22:23:00.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.852+0000 7f519d775700 1 -- 172.21.15.154:0/1630934605 wait complete. 2023-09-30T22:23:00.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:00.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:00.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.909+0000 7f04db9c2700 1 -- 172.21.15.154:0/2945712900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f04d409b8b0 con 0x7f04d4137010 2023-09-30T22:23:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.910+0000 7f04c9ffb700 1 -- 172.21.15.154:0/2945712900 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04cc01a020 con 0x7f04d4137010 2023-09-30T22:23:00.910 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:00.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.912+0000 7f04db9c2700 1 -- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04d4137010 msgr2=0x7f04d411ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:00.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.912+0000 7f04db9c2700 1 --2- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04d4137010 0x7f04d411ff20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009f70 tx=0x7f04cc00d3b0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.912+0000 7f04db9c2700 1 -- 172.21.15.154:0/2945712900 shutdown_connections 2023-09-30T22:23:00.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.912+0000 7f04db9c2700 1 --2- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f04d4137010 0x7f04d411ff20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.912+0000 7f04db9c2700 1 --2- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04d409e950 0x7f04d411f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.912+0000 7f04db9c2700 1 --2- 172.21.15.154:0/2945712900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04d409f430 0x7f04d411f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:00.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.912+0000 7f04db9c2700 1 -- 172.21.15.154:0/2945712900 >> 172.21.15.154:0/2945712900 conn(0x7f04d40a0f70 msgr2=0x7f04d4135ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:00.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.912+0000 7f04db9c2700 1 -- 172.21.15.154:0/2945712900 shutdown_connections 2023-09-30T22:23:00.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:00.912+0000 7f04db9c2700 1 -- 172.21.15.154:0/2945712900 wait complete. 2023-09-30T22:23:00.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:01.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:01.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:01.865 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:01.925 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:01.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.975+0000 7f9db23aa700 1 Processor -- start 2023-09-30T22:23:01.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.975+0000 7f9db23aa700 1 -- start start 2023-09-30T22:23:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9db23aa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac12ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9db23aa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1305d0 0x7f9dac130a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9db23aa700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9dac1334b0 0x7f9dac133950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9db23aa700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac06ab40 con 0x7f9dac1334b0 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9db23aa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac130f60 con 0x7f9dac1305d0 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9db23aa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac09b000 con 0x7f9dac06a770 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9db0947700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9dac1334b0 0x7f9dac133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9db0947700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9dac1334b0 0x7f9dac133950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39206/0 (socket says 172.21.15.154:39206) 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9db0947700 1 -- 172.21.15.154:0/4110935754 learned_addr learned my addr 172.21.15.154:0/4110935754 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9dabfff700 1 --2- 172.21.15.154:0/4110935754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac12ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9dab7fe700 1 --2- 172.21.15.154:0/4110935754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1305d0 0x7f9dac130a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9dabfff700 1 -- 172.21.15.154:0/4110935754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1305d0 msgr2=0x7f9dac130a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9dabfff700 1 --2- 172.21.15.154:0/4110935754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1305d0 0x7f9dac130a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9dabfff700 1 -- 172.21.15.154:0/4110935754 >> v2:172.21.15.154:3300/0 conn(0x7f9dac1334b0 msgr2=0x7f9dac133950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:01.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9dabfff700 1 --2- 172.21.15.154:0/4110935754 >> v2:172.21.15.154:3300/0 conn(0x7f9dac1334b0 0x7f9dac133950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9dabfff700 1 -- 172.21.15.154:0/4110935754 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac06b0a0 con 0x7f9dac06a770 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.976+0000 7f9dabfff700 1 --2- 172.21.15.154:0/4110935754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac12ff10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009840 tx=0x7f9d9c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=356a3146c7ea4d9d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9daaffd700 1 -- 172.21.15.154:0/4110935754 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c014e90 con 0x7f9dac06a770 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9daaffd700 1 -- 172.21.15.154:0/4110935754 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c01c440 con 0x7f9dac06a770 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9daaffd700 1 -- 172.21.15.154:0/4110935754 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c01c7d0 con 0x7f9dac06a770 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9db23aa700 1 -- 172.21.15.154:0/4110935754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 msgr2=0x7f9dac12ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9db23aa700 1 --2- 172.21.15.154:0/4110935754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac12ff10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009840 tx=0x7f9d9c009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9db23aa700 1 -- 172.21.15.154:0/4110935754 shutdown_connections 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9db23aa700 1 --2- 172.21.15.154:0/4110935754 >> v2:172.21.15.154:3300/0 conn(0x7f9dac1334b0 0x7f9dac133950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9db23aa700 1 --2- 172.21.15.154:0/4110935754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac12ff10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9db23aa700 1 --2- 172.21.15.154:0/4110935754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1305d0 0x7f9dac130a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.977+0000 7f9db23aa700 1 -- 172.21.15.154:0/4110935754 >> 172.21.15.154:0/4110935754 conn(0x7f9dac0a2ef0 msgr2=0x7f9dac0a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.978+0000 7f9db23aa700 1 -- 172.21.15.154:0/4110935754 shutdown_connections 2023-09-30T22:23:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.978+0000 7f9db23aa700 1 -- 172.21.15.154:0/4110935754 wait complete. 2023-09-30T22:23:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.979+0000 7f9db23aa700 1 Processor -- start 2023-09-30T22:23:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.979+0000 7f9db23aa700 1 -- start start 2023-09-30T22:23:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9db23aa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9db23aa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dac1305d0 0x7f9dac0717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9db23aa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1334b0 0x7f9dac071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9db23aa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac11b380 con 0x7f9dac1305d0 2023-09-30T22:23:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9db23aa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac12db30 con 0x7f9dac1334b0 2023-09-30T22:23:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9db23aa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac11acd0 con 0x7f9dac06a770 2023-09-30T22:23:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9dabfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9dab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dac1305d0 0x7f9dac0717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9dabfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59840/0 (socket says 172.21.15.154:59840) 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9dabfff700 1 -- 172.21.15.154:0/3987851345 learned_addr learned my addr 172.21.15.154:0/3987851345 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9db0947700 1 --2- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1334b0 0x7f9dac071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9dab7fe700 1 -- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 msgr2=0x7f9dac071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9dab7fe700 1 --2- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9dab7fe700 1 -- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1334b0 msgr2=0x7f9dac071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.980+0000 7f9dab7fe700 1 --2- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1334b0 0x7f9dac071d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.981+0000 7f9dab7fe700 1 -- 172.21.15.154:0/3987851345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c0094a0 con 0x7f9dac1305d0 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.981+0000 7f9dab7fe700 1 --2- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dac1305d0 0x7f9dac0717d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9da000e8d0 tx=0x7f9da000ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.981+0000 7f9da8ff9700 1 -- 172.21.15.154:0/3987851345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0013680 con 0x7f9dac1305d0 2023-09-30T22:23:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.981+0000 7f9da8ff9700 1 -- 172.21.15.154:0/3987851345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da00137e0 con 0x7f9dac1305d0 2023-09-30T22:23:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.981+0000 7f9da8ff9700 1 -- 172.21.15.154:0/3987851345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0013b50 con 0x7f9dac1305d0 2023-09-30T22:23:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.981+0000 7f9db23aa700 1 -- 172.21.15.154:0/3987851345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac072660 con 0x7f9dac1305d0 2023-09-30T22:23:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.981+0000 7f9db23aa700 1 -- 172.21.15.154:0/3987851345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac119b90 con 0x7f9dac1305d0 2023-09-30T22:23:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.982+0000 7f9da8ff9700 1 -- 172.21.15.154:0/3987851345 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9da0013cb0 con 0x7f9dac1305d0 2023-09-30T22:23:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.982+0000 7f9da8ff9700 1 -- 172.21.15.154:0/3987851345 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9da003f980 con 0x7f9dac1305d0 2023-09-30T22:23:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.982+0000 7f9db23aa700 1 -- 172.21.15.154:0/3987851345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac12f4e0 con 0x7f9dac1305d0 2023-09-30T22:23:01.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:01.987+0000 7f9da8ff9700 1 -- 172.21.15.154:0/3987851345 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9da0017080 con 0x7f9dac1305d0 2023-09-30T22:23:02.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.013+0000 7f3b2fba0700 1 Processor -- start 2023-09-30T22:23:02.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.014+0000 7f3b2fba0700 1 -- start start 2023-09-30T22:23:02.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.014+0000 7f3b2fba0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b2809e870 0x7f3b2809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.014+0000 7f3b2fba0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b28131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.014+0000 7f3b2fba0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2809c970 con 0x7f3b28131d70 2023-09-30T22:23:02.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.014+0000 7f3b2fba0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b280a0920 con 0x7f3b2809e870 2023-09-30T22:23:02.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.014+0000 7f3b2fba0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2809f9c0 con 0x7f3b2809f180 2023-09-30T22:23:02.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.014+0000 7f3b2d93c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b2809e870 0x7f3b2809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.014+0000 7f3b2d93c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b2809e870 0x7f3b2809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39224/0 (socket says 172.21.15.154:39224) 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.014+0000 7f3b2d93c700 1 -- 172.21.15.154:0/3222429374 learned_addr learned my addr 172.21.15.154:0/3222429374 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f3b2d13b700 1 --2- 172.21.15.154:0/3222429374 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b28131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f3b2d93c700 1 -- 172.21.15.154:0/3222429374 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 msgr2=0x7f3b28131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f3b2d93c700 1 --2- 172.21.15.154:0/3222429374 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b28131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f3b2d93c700 1 -- 172.21.15.154:0/3222429374 >> v1:172.21.15.154:6789/0 conn(0x7f3b28131d70 legacy=0x7f3b28138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f3b2d93c700 1 -- 172.21.15.154:0/3222429374 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2809bab0 con 0x7f3b2809e870 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f3b2d93c700 1 --2- 172.21.15.154:0/3222429374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b2809e870 0x7f3b2809ec40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3b240098f0 tx=0x7f3b24009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e54ce9d6a5b8c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f3b2c93a700 1 -- 172.21.15.154:0/3222429374 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24011830 con 0x7f3b2809e870 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f3b2c93a700 1 -- 172.21.15.154:0/3222429374 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24011990 con 0x7f3b2809e870 2023-09-30T22:23:02.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f3b2c93a700 1 -- 172.21.15.154:0/3222429374 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24011d20 con 0x7f3b2809e870 2023-09-30T22:23:02.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.015+0000 7f176be26700 1 Processor -- start 2023-09-30T22:23:02.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f176be26700 1 -- start start 2023-09-30T22:23:02.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f3b2fba0700 1 -- 172.21.15.154:0/3222429374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b2809e870 msgr2=0x7f3b2809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f3b2fba0700 1 --2- 172.21.15.154:0/3222429374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b2809e870 0x7f3b2809ec40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3b240098f0 tx=0x7f3b24009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:02.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f3b2fba0700 1 -- 172.21.15.154:0/3222429374 shutdown_connections 2023-09-30T22:23:02.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f3b2fba0700 1 --2- 172.21.15.154:0/3222429374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b2809e870 0x7f3b2809ec40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f3b2fba0700 1 --2- 172.21.15.154:0/3222429374 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b28131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f3b2fba0700 1 -- 172.21.15.154:0/3222429374 >> 172.21.15.154:0/3222429374 conn(0x7f3b280a4430 msgr2=0x7f3b280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f3b2fba0700 1 -- 172.21.15.154:0/3222429374 shutdown_connections 2023-09-30T22:23:02.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f3b2fba0700 1 -- 172.21.15.154:0/3222429374 wait complete. 2023-09-30T22:23:02.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f176be26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a0a70 0x7f17640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f176be26700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1764134120 0x7f176413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f176be26700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176409dc00 con 0x7f17640a1380 2023-09-30T22:23:02.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f176be26700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176409ea60 con 0x7f1764134120 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.016+0000 7f176be26700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f176409dec0 con 0x7f17640a0a70 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f17693c1700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f17640a1380 0x7f1764133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35764/0 (socket says 172.21.15.154:35764) 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f17693c1700 1 -- 172.21.15.154:0/2511311084 learned_addr learned my addr 172.21.15.154:0/2511311084 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f176a3c3700 1 --2- 172.21.15.154:0/2511311084 >> v2:172.21.15.154:3300/0 conn(0x7f1764134120 0x7f176413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f1768bc0700 1 -- 172.21.15.154:0/2511311084 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771757313 0 0) 0x7f176409dc00 con 0x7f17640a1380 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f1768bc0700 1 -- 172.21.15.154:0/2511311084 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17500035b0 con 0x7f17640a1380 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f176a3c3700 1 -- 172.21.15.154:0/2511311084 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a0a70 msgr2=0x7f17640a0e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f176a3c3700 1 --2- 172.21.15.154:0/2511311084 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a0a70 0x7f17640a0e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f176a3c3700 1 -- 172.21.15.154:0/2511311084 >> v1:172.21.15.154:6789/0 conn(0x7f17640a1380 legacy=0x7f1764133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f176a3c3700 1 -- 172.21.15.154:0/2511311084 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176409e6a0 con 0x7f1764134120 2023-09-30T22:23:02.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f176a3c3700 1 --2- 172.21.15.154:0/2511311084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1764134120 0x7f176413bce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f175c009d90 tx=0x7f175c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7198dcd60f6a371 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f3b2fba0700 1 Processor -- start 2023-09-30T22:23:02.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.017+0000 7f1768bc0700 1 -- 172.21.15.154:0/2511311084 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c00e070 con 0x7f1764134120 2023-09-30T22:23:02.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f1768bc0700 1 -- 172.21.15.154:0/2511311084 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c00bb20 con 0x7f1764134120 2023-09-30T22:23:02.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f1768bc0700 1 -- 172.21.15.154:0/2511311084 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c00be90 con 0x7f1764134120 2023-09-30T22:23:02.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2fba0700 1 -- start start 2023-09-30T22:23:02.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2fba0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b2809e870 0x7f3b281cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2fba0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b281cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2fba0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b28131d70 0x7f3b281cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2fba0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2809dc10 con 0x7f3b28131d70 2023-09-30T22:23:02.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2fba0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28129fc0 con 0x7f3b2809f180 2023-09-30T22:23:02.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f176be26700 1 -- 172.21.15.154:0/2511311084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1764134120 msgr2=0x7f176413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f176be26700 1 --2- 172.21.15.154:0/2511311084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1764134120 0x7f176413bce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f175c009d90 tx=0x7f175c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:02.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2fba0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28131340 con 0x7f3b2809e870 2023-09-30T22:23:02.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f176be26700 1 -- 172.21.15.154:0/2511311084 shutdown_connections 2023-09-30T22:23:02.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f176be26700 1 --2- 172.21.15.154:0/2511311084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1764134120 0x7f176413bce0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f176be26700 1 --2- 172.21.15.154:0/2511311084 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a0a70 0x7f17640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f176be26700 1 -- 172.21.15.154:0/2511311084 >> 172.21.15.154:0/2511311084 conn(0x7f17640a6610 msgr2=0x7f17640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2d13b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b281cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2e13d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b28131d70 0x7f3b281cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2d13b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b281cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35954/0 (socket says 172.21.15.154:35954) 2023-09-30T22:23:02.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2e13d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b28131d70 0x7f3b281cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39254/0 (socket says 172.21.15.154:39254) 2023-09-30T22:23:02.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2d13b700 1 -- 172.21.15.154:0/2844869005 learned_addr learned my addr 172.21.15.154:0/2844869005 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:02.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.018+0000 7f3b2d93c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b2809e870 0x7f3b281cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.019+0000 7f176be26700 1 -- 172.21.15.154:0/2511311084 shutdown_connections 2023-09-30T22:23:02.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.019+0000 7f176be26700 1 -- 172.21.15.154:0/2511311084 wait complete. 2023-09-30T22:23:02.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.019+0000 7f3b2d13b700 1 -- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b2809e870 msgr2=0x7f3b281cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.019+0000 7f3b2d13b700 1 --2- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b2809e870 0x7f3b281cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.019+0000 7f3b2d13b700 1 -- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b28131d70 msgr2=0x7f3b281cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.019+0000 7f3b2d13b700 1 --2- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b28131d70 0x7f3b281cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.019+0000 7f3b2d13b700 1 -- 172.21.15.154:0/2844869005 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24009550 con 0x7f3b2809f180 2023-09-30T22:23:02.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.019+0000 7f3b2d13b700 1 --2- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b281cced0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800e9b0 tx=0x7f3b1800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.019+0000 7f176be26700 1 Processor -- start 2023-09-30T22:23:02.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f176be26700 1 -- start start 2023-09-30T22:23:02.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f3b1e7fc700 1 -- 172.21.15.154:0/2844869005 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18009710 con 0x7f3b2809f180 2023-09-30T22:23:02.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f3b1e7fc700 1 -- 172.21.15.154:0/2844869005 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1800ee50 con 0x7f3b2809f180 2023-09-30T22:23:02.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f3b1e7fc700 1 -- 172.21.15.154:0/2844869005 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1800ca50 con 0x7f3b2809f180 2023-09-30T22:23:02.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f3b2fba0700 1 -- 172.21.15.154:0/2844869005 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b28129a20 con 0x7f3b2809f180 2023-09-30T22:23:02.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f176be26700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640a0a70 0x7f17641227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f176be26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a1380 0x7f1764122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f176be26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1764134120 0x7f1764123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f176be26700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17641262e0 con 0x7f17640a0a70 2023-09-30T22:23:02.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f176be26700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17641243d0 con 0x7f1764134120 2023-09-30T22:23:02.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f176be26700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1764133aa0 con 0x7f17640a1380 2023-09-30T22:23:02.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f17693c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a1380 0x7f1764122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f17693c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a1380 0x7f1764122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59844/0 (socket says 172.21.15.154:59844) 2023-09-30T22:23:02.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f17693c1700 1 -- 172.21.15.154:0/1434718802 learned_addr learned my addr 172.21.15.154:0/1434718802 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:02.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f1769bc2700 1 --2- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640a0a70 0x7f17641227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f17693c1700 1 -- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1764134120 msgr2=0x7f1764123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f17693c1700 1 --2- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1764134120 0x7f1764123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f17693c1700 1 -- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640a0a70 msgr2=0x7f17641227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f17693c1700 1 --2- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640a0a70 0x7f17641227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f17693c1700 1 -- 172.21.15.154:0/1434718802 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009a70 con 0x7f17640a1380 2023-09-30T22:23:02.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.020+0000 7f3b2fba0700 1 -- 172.21.15.154:0/2844869005 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2811deb0 con 0x7f3b2809f180 2023-09-30T22:23:02.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f17693c1700 1 --2- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a1380 0x7f1764122d00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1754005910 tx=0x7f175400ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f175a7fc700 1 -- 172.21.15.154:0/1434718802 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754005d70 con 0x7f17640a1380 2023-09-30T22:23:02.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f175a7fc700 1 -- 172.21.15.154:0/1434718802 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17540070d0 con 0x7f17640a1380 2023-09-30T22:23:02.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f176be26700 1 -- 172.21.15.154:0/1434718802 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17640a03e0 con 0x7f17640a1380 2023-09-30T22:23:02.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f175a7fc700 1 -- 172.21.15.154:0/1434718802 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754007460 con 0x7f17640a1380 2023-09-30T22:23:02.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f176be26700 1 -- 172.21.15.154:0/1434718802 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1764133770 con 0x7f17640a1380 2023-09-30T22:23:02.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.021+0000 7f3b2fba0700 1 -- 172.21.15.154:0/2844869005 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2806ba80 con 0x7f3b2809f180 2023-09-30T22:23:02.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.022+0000 7f175a7fc700 1 -- 172.21.15.154:0/1434718802 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17540075c0 con 0x7f17640a1380 2023-09-30T22:23:02.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.022+0000 7f176be26700 1 -- 172.21.15.154:0/1434718802 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176404f2a0 con 0x7f17640a1380 2023-09-30T22:23:02.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.022+0000 7f175a7fc700 1 -- 172.21.15.154:0/1434718802 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f175403edc0 con 0x7f17640a1380 2023-09-30T22:23:02.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.024+0000 7f3b1e7fc700 1 -- 172.21.15.154:0/2844869005 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b1800cbb0 con 0x7f3b2809f180 2023-09-30T22:23:02.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.024+0000 7f3b1e7fc700 1 -- 172.21.15.154:0/2844869005 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b180473b0 con 0x7f3b2809f180 2023-09-30T22:23:02.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.027+0000 7f3b1e7fc700 1 -- 172.21.15.154:0/2844869005 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b180102b0 con 0x7f3b2809f180 2023-09-30T22:23:02.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.027+0000 7f175a7fc700 1 -- 172.21.15.154:0/1434718802 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1754017080 con 0x7f17640a1380 2023-09-30T22:23:02.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.078+0000 7f4176727700 1 Processor -- start 2023-09-30T22:23:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.078+0000 7f4176727700 1 -- start start 2023-09-30T22:23:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.078+0000 7f4176727700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009b400 0x7f417009b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.078+0000 7f4176727700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f417013d940 0x7f417013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.078+0000 7f4176727700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41700a0a70 con 0x7f417009bd10 2023-09-30T22:23:02.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.078+0000 7f4176727700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417009b190 con 0x7f417013d940 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.078+0000 7f4176727700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f417009a820 con 0x7f417009b400 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009b400 0x7f417009b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009b400 0x7f417009b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59848/0 (socket says 172.21.15.154:59848) 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416ffff700 1 -- 172.21.15.154:0/4046200566 learned_addr learned my addr 172.21.15.154:0/4046200566 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f4174cc4700 1 --2- 172.21.15.154:0/4046200566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f417013d940 0x7f417013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416ffff700 1 -- 172.21.15.154:0/4046200566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f417013d940 msgr2=0x7f417013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416ffff700 1 --2- 172.21.15.154:0/4046200566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f417013d940 0x7f417013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416ffff700 1 -- 172.21.15.154:0/4046200566 >> v1:172.21.15.154:6789/0 conn(0x7f417009bd10 legacy=0x7f417013c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416ffff700 1 -- 172.21.15.154:0/4046200566 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417009a280 con 0x7f417009b400 2023-09-30T22:23:02.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416ffff700 1 --2- 172.21.15.154:0/4046200566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009b400 0x7f417009b7d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4160009920 tx=0x7f4160009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af0945d0d76ae226 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416effd700 1 -- 172.21.15.154:0/4046200566 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160011830 con 0x7f417009b400 2023-09-30T22:23:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416effd700 1 -- 172.21.15.154:0/4046200566 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160011990 con 0x7f417009b400 2023-09-30T22:23:02.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.079+0000 7f416effd700 1 -- 172.21.15.154:0/4046200566 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160011d20 con 0x7f417009b400 2023-09-30T22:23:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.080+0000 7f4176727700 1 -- 172.21.15.154:0/4046200566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009b400 msgr2=0x7f417009b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.080+0000 7f4176727700 1 --2- 172.21.15.154:0/4046200566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009b400 0x7f417009b7d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4160009920 tx=0x7f4160009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.080+0000 7f4176727700 1 -- 172.21.15.154:0/4046200566 shutdown_connections 2023-09-30T22:23:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.080+0000 7f4176727700 1 --2- 172.21.15.154:0/4046200566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f417013d940 0x7f417013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.080+0000 7f4176727700 1 --2- 172.21.15.154:0/4046200566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009b400 0x7f417009b7d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.080+0000 7f4176727700 1 -- 172.21.15.154:0/4046200566 >> 172.21.15.154:0/4046200566 conn(0x7f4170099c40 msgr2=0x7f417006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.080+0000 7f4176727700 1 -- 172.21.15.154:0/4046200566 shutdown_connections 2023-09-30T22:23:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.080+0000 7f4176727700 1 -- 172.21.15.154:0/4046200566 wait complete. 2023-09-30T22:23:02.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.081+0000 7f4176727700 1 Processor -- start 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.081+0000 7f4176727700 1 -- start start 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f4176727700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f417009b400 0x7f417006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f4176727700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009bd10 0x7f417006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f4176727700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417013d940 0x7f4170070530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f4176727700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4170138e50 con 0x7f417013d940 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f4176727700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4170071670 con 0x7f417009b400 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f4176727700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f417009f510 con 0x7f417009bd10 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009bd10 0x7f417006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009bd10 0x7f417006fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59856/0 (socket says 172.21.15.154:59856) 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416f7fe700 1 -- 172.21.15.154:0/2156236735 learned_addr learned my addr 172.21.15.154:0/2156236735 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:02.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f4174cc4700 1 --2- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417013d940 0x7f4170070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416f7fe700 1 -- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f417009b400 msgr2=0x7f417006fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416f7fe700 1 --2- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f417009b400 0x7f417006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416f7fe700 1 -- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417013d940 msgr2=0x7f4170070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416f7fe700 1 --2- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417013d940 0x7f4170070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416f7fe700 1 -- 172.21.15.154:0/2156236735 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160009550 con 0x7f417009bd10 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416f7fe700 1 --2- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009bd10 0x7f417006fff0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f416400c4e0 tx=0x7f416400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416cff9700 1 -- 172.21.15.154:0/2156236735 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41640052d0 con 0x7f417009bd10 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416cff9700 1 -- 172.21.15.154:0/2156236735 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164005430 con 0x7f417009bd10 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f4176727700 1 -- 172.21.15.154:0/2156236735 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4170126730 con 0x7f417009bd10 2023-09-30T22:23:02.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.082+0000 7f416cff9700 1 -- 172.21.15.154:0/2156236735 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41640038c0 con 0x7f417009bd10 2023-09-30T22:23:02.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.083+0000 7f4176727700 1 -- 172.21.15.154:0/2156236735 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4170125320 con 0x7f417009bd10 2023-09-30T22:23:02.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.084+0000 7f416cff9700 1 -- 172.21.15.154:0/2156236735 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4164003a20 con 0x7f417009bd10 2023-09-30T22:23:02.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.084+0000 7f4176727700 1 -- 172.21.15.154:0/2156236735 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417004f2a0 con 0x7f417009bd10 2023-09-30T22:23:02.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.084+0000 7f416cff9700 1 -- 172.21.15.154:0/2156236735 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f416403ead0 con 0x7f417009bd10 2023-09-30T22:23:02.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.089+0000 7f416cff9700 1 -- 172.21.15.154:0/2156236735 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4164011ab0 con 0x7f417009bd10 2023-09-30T22:23:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.186+0000 7f9db23aa700 1 -- 172.21.15.154:0/3987851345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9dac04f2a0 con 0x7f9dac1305d0 2023-09-30T22:23:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.187+0000 7f9da8ff9700 1 -- 172.21.15.154:0/3987851345 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9da0021020 con 0x7f9dac1305d0 2023-09-30T22:23:02.187 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:02.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.188+0000 7f9db23aa700 1 -- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dac1305d0 msgr2=0x7f9dac0717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.188+0000 7f9db23aa700 1 --2- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dac1305d0 0x7f9dac0717d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9da000e8d0 tx=0x7f9da000ebe0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.189+0000 7f9db23aa700 1 -- 172.21.15.154:0/3987851345 shutdown_connections 2023-09-30T22:23:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.189+0000 7f9db23aa700 1 --2- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dac1334b0 0x7f9dac071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.189+0000 7f9db23aa700 1 --2- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9dac06a770 0x7f9dac071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.189+0000 7f9db23aa700 1 --2- 172.21.15.154:0/3987851345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dac1305d0 0x7f9dac0717d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.189+0000 7f9db23aa700 1 -- 172.21.15.154:0/3987851345 >> 172.21.15.154:0/3987851345 conn(0x7f9dac0a2ef0 msgr2=0x7f9dac132c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.189+0000 7f9db23aa700 1 -- 172.21.15.154:0/3987851345 shutdown_connections 2023-09-30T22:23:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.189+0000 7f9db23aa700 1 -- 172.21.15.154:0/3987851345 wait complete. 2023-09-30T22:23:02.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:02.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.223+0000 7f176be26700 1 -- 172.21.15.154:0/1434718802 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1764072980 con 0x7f17640a1380 2023-09-30T22:23:02.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.223+0000 7f175a7fc700 1 -- 172.21.15.154:0/1434718802 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f175400e280 con 0x7f17640a1380 2023-09-30T22:23:02.223 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:02.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.225+0000 7f176be26700 1 -- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a1380 msgr2=0x7f1764122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.225+0000 7f176be26700 1 --2- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a1380 0x7f1764122d00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1754005910 tx=0x7f175400ca90 comp rx=0 tx=0).stop 2023-09-30T22:23:02.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.225+0000 7f176be26700 1 -- 172.21.15.154:0/1434718802 shutdown_connections 2023-09-30T22:23:02.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.225+0000 7f176be26700 1 --2- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1764134120 0x7f1764123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.225+0000 7f176be26700 1 --2- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640a0a70 0x7f17641227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.225+0000 7f176be26700 1 --2- 172.21.15.154:0/1434718802 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17640a1380 0x7f1764122d00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.225+0000 7f176be26700 1 -- 172.21.15.154:0/1434718802 >> 172.21.15.154:0/1434718802 conn(0x7f17640a6610 msgr2=0x7f176409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.225+0000 7f176be26700 1 -- 172.21.15.154:0/1434718802 shutdown_connections 2023-09-30T22:23:02.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.225+0000 7f176be26700 1 -- 172.21.15.154:0/1434718802 wait complete. 2023-09-30T22:23:02.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:02.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.246+0000 7f3b2fba0700 1 -- 172.21.15.154:0/2844869005 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b2804f2a0 con 0x7f3b2809f180 2023-09-30T22:23:02.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.246+0000 7f3b1e7fc700 1 -- 172.21.15.154:0/2844869005 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b18017070 con 0x7f3b2809f180 2023-09-30T22:23:02.246 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:02.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.248+0000 7f3b2fba0700 1 -- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 msgr2=0x7f3b281cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.248+0000 7f3b2fba0700 1 --2- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b281cced0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800e9b0 tx=0x7f3b1800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.248+0000 7f3b2fba0700 1 -- 172.21.15.154:0/2844869005 shutdown_connections 2023-09-30T22:23:02.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.248+0000 7f3b2fba0700 1 --2- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b28131d70 0x7f3b281cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.248+0000 7f3b2fba0700 1 --2- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b2809e870 0x7f3b281cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.248+0000 7f3b2fba0700 1 --2- 172.21.15.154:0/2844869005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b2809f180 0x7f3b281cced0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.248+0000 7f3b2fba0700 1 -- 172.21.15.154:0/2844869005 >> 172.21.15.154:0/2844869005 conn(0x7f3b280a4430 msgr2=0x7f3b2809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.248+0000 7f3b2fba0700 1 -- 172.21.15.154:0/2844869005 shutdown_connections 2023-09-30T22:23:02.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.248+0000 7f3b2fba0700 1 -- 172.21.15.154:0/2844869005 wait complete. 2023-09-30T22:23:02.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:02.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.283+0000 7f4176727700 1 -- 172.21.15.154:0/2156236735 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f41700729d0 con 0x7f417009bd10 2023-09-30T22:23:02.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.283+0000 7f416cff9700 1 -- 172.21.15.154:0/2156236735 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4164017070 con 0x7f417009bd10 2023-09-30T22:23:02.309 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.286+0000 7f4176727700 1 -- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009bd10 msgr2=0x7f417006fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.286+0000 7f4176727700 1 --2- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009bd10 0x7f417006fff0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f416400c4e0 tx=0x7f416400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.286+0000 7f4176727700 1 -- 172.21.15.154:0/2156236735 shutdown_connections 2023-09-30T22:23:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.286+0000 7f4176727700 1 --2- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f417013d940 0x7f4170070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.286+0000 7f4176727700 1 --2- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f417009b400 0x7f417006fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.286+0000 7f4176727700 1 --2- 172.21.15.154:0/2156236735 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f417009bd10 0x7f417006fff0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:02.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.286+0000 7f4176727700 1 -- 172.21.15.154:0/2156236735 >> 172.21.15.154:0/2156236735 conn(0x7f4170099c40 msgr2=0x7f417009e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:02.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.286+0000 7f4176727700 1 -- 172.21.15.154:0/2156236735 shutdown_connections 2023-09-30T22:23:02.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:02.286+0000 7f4176727700 1 -- 172.21.15.154:0/2156236735 wait complete. 2023-09-30T22:23:02.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:03.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:03.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:03.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:03.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:03.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.349+0000 7f89deb63700 1 Processor -- start 2023-09-30T22:23:03.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.350+0000 7f89deb63700 1 -- start start 2023-09-30T22:23:03.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.350+0000 7f89deb63700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89d80a0a30 0x7f89d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.350+0000 7f89deb63700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.350+0000 7f89deb63700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 0x7f89d81308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.350+0000 7f89deb63700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d8130e30 con 0x7f89d80a0a30 2023-09-30T22:23:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.350+0000 7f89deb63700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80a1e70 con 0x7f89d80a1340 2023-09-30T22:23:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.350+0000 7f89deb63700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89d809a720 con 0x7f89d81304a0 2023-09-30T22:23:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dc8ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89d80a0a30 0x7f89d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dc8ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89d80a0a30 0x7f89d80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39288/0 (socket says 172.21.15.154:39288) 2023-09-30T22:23:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dc8ff700 1 -- 172.21.15.154:0/40596407 learned_addr learned my addr 172.21.15.154:0/40596407 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89d7fff700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dd100700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 0x7f89d81308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dc8ff700 1 -- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 msgr2=0x7f89d81308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dc8ff700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 0x7f89d81308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dc8ff700 1 -- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 msgr2=0x7f89d812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dc8ff700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dc8ff700 1 -- 172.21.15.154:0/40596407 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d809b300 con 0x7f89d80a0a30 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89d7fff700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89dc8ff700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 0x7f89d80a0e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f89cc006fd0 tx=0x7f89cc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7e5cee44175796 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89d77fe700 1 -- 172.21.15.154:0/40596407 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc005e30 con 0x7f89d80a0a30 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89d77fe700 1 -- 172.21.15.154:0/40596407 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc004030 con 0x7f89d80a0a30 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.351+0000 7f89d77fe700 1 -- 172.21.15.154:0/40596407 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0043e0 con 0x7f89d80a0a30 2023-09-30T22:23:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.352+0000 7f89deb63700 1 -- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 msgr2=0x7f89d80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.352+0000 7f89deb63700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 0x7f89d80a0e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f89cc006fd0 tx=0x7f89cc00bc80 comp rx=0 tx=0).stop 2023-09-30T22:23:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.352+0000 7f89deb63700 1 -- 172.21.15.154:0/40596407 shutdown_connections 2023-09-30T22:23:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.352+0000 7f89deb63700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 0x7f89d81308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.352+0000 7f89deb63700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 0x7f89d80a0e00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.352+0000 7f89deb63700 1 --2- 172.21.15.154:0/40596407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.352+0000 7f89deb63700 1 -- 172.21.15.154:0/40596407 >> 172.21.15.154:0/40596407 conn(0x7f89d80a2980 msgr2=0x7f89d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.352+0000 7f89deb63700 1 -- 172.21.15.154:0/40596407 shutdown_connections 2023-09-30T22:23:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.352+0000 7f89deb63700 1 -- 172.21.15.154:0/40596407 wait complete. 2023-09-30T22:23:03.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.354+0000 7f89deb63700 1 Processor -- start 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.354+0000 7f89deb63700 1 -- start start 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.354+0000 7f89deb63700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 0x7f89d81c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89deb63700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d81c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89deb63700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 0x7f89d811ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89deb63700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d811e6f0 con 0x7f89d80a0a30 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89deb63700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d812f9b0 con 0x7f89d80a1340 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89deb63700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89d811c970 con 0x7f89d81304a0 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89dc8ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 0x7f89d81c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d81c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d81c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35996/0 (socket says 172.21.15.154:35996) 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89dc8ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 0x7f89d81c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39290/0 (socket says 172.21.15.154:39290) 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89d7fff700 1 -- 172.21.15.154:0/1315808750 learned_addr learned my addr 172.21.15.154:0/1315808750 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89dd100700 1 --2- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 0x7f89d811ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89d7fff700 1 -- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 msgr2=0x7f89d811ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89d7fff700 1 --2- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 0x7f89d811ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89d7fff700 1 -- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 msgr2=0x7f89d81c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89d7fff700 1 --2- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 0x7f89d81c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89d7fff700 1 -- 172.21.15.154:0/1315808750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c40094a0 con 0x7f89d80a1340 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.355+0000 7f89d7fff700 1 --2- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d81c47c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f89c400ebe0 tx=0x7f89c400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.356+0000 7f89d57fa700 1 -- 172.21.15.154:0/1315808750 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4009780 con 0x7f89d80a1340 2023-09-30T22:23:03.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.356+0000 7f89d57fa700 1 -- 172.21.15.154:0/1315808750 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c400c850 con 0x7f89d80a1340 2023-09-30T22:23:03.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.356+0000 7f89d57fa700 1 -- 172.21.15.154:0/1315808750 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c400cbe0 con 0x7f89d80a1340 2023-09-30T22:23:03.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.356+0000 7f89deb63700 1 -- 172.21.15.154:0/1315808750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc00b5b0 con 0x7f89d80a1340 2023-09-30T22:23:03.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.356+0000 7f89deb63700 1 -- 172.21.15.154:0/1315808750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d811d120 con 0x7f89d80a1340 2023-09-30T22:23:03.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.357+0000 7f89deb63700 1 -- 172.21.15.154:0/1315808750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d804f2a0 con 0x7f89d80a1340 2023-09-30T22:23:03.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.357+0000 7f89d57fa700 1 -- 172.21.15.154:0/1315808750 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89c400cd40 con 0x7f89d80a1340 2023-09-30T22:23:03.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.358+0000 7f89d57fa700 1 -- 172.21.15.154:0/1315808750 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89c403f890 con 0x7f89d80a1340 2023-09-30T22:23:03.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.362+0000 7f89d57fa700 1 -- 172.21.15.154:0/1315808750 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89c40232f0 con 0x7f89d80a1340 2023-09-30T22:23:03.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.387+0000 7ff9a4a23700 1 Processor -- start 2023-09-30T22:23:03.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.387+0000 7ff9a4a23700 1 -- start start 2023-09-30T22:23:03.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.387+0000 7ff9a4a23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 0x7ff9a009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.387+0000 7ff9a4a23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.387+0000 7ff9a4a23700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9a0130ce0 0x7ff9a0131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.387+0000 7ff9a4a23700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a009aaa0 con 0x7ff9a0130ce0 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.387+0000 7ff9a4a23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a009f870 con 0x7ff9a009d860 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.387+0000 7ff9a4a23700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a009b360 con 0x7ff9a009e170 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 0x7ff9a009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 0x7ff9a009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36004/0 (socket says 172.21.15.154:36004) 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99e59c700 1 -- 172.21.15.154:0/3155408977 learned_addr learned my addr 172.21.15.154:0/3155408977 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99ed9d700 1 --2- 172.21.15.154:0/3155408977 >> v2:172.21.15.154:3300/0 conn(0x7ff9a0130ce0 0x7ff9a0131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99dd9b700 1 -- 172.21.15.154:0/3155408977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 msgr2=0x7ff9a009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99dd9b700 1 --2- 172.21.15.154:0/3155408977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 0x7ff9a009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99dd9b700 1 -- 172.21.15.154:0/3155408977 >> v2:172.21.15.154:3300/0 conn(0x7ff9a0130ce0 msgr2=0x7ff9a0131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99dd9b700 1 --2- 172.21.15.154:0/3155408977 >> v2:172.21.15.154:3300/0 conn(0x7ff9a0130ce0 0x7ff9a0131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99dd9b700 1 -- 172.21.15.154:0/3155408977 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a009b620 con 0x7ff9a009e170 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99dd9b700 1 --2- 172.21.15.154:0/3155408977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01307a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff994009840 tx=0x7ff994009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8656219e681c28a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99d59a700 1 -- 172.21.15.154:0/3155408977 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994011830 con 0x7ff9a009e170 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99d59a700 1 -- 172.21.15.154:0/3155408977 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994011990 con 0x7ff9a009e170 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.388+0000 7ff99d59a700 1 -- 172.21.15.154:0/3155408977 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994011d20 con 0x7ff9a009e170 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.389+0000 7ff9a4a23700 1 -- 172.21.15.154:0/3155408977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 msgr2=0x7ff9a01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.389+0000 7ff9a4a23700 1 --2- 172.21.15.154:0/3155408977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01307a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff994009840 tx=0x7ff994009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.389+0000 7ff9a4a23700 1 -- 172.21.15.154:0/3155408977 shutdown_connections 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.389+0000 7ff9a4a23700 1 --2- 172.21.15.154:0/3155408977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 0x7ff9a009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.389+0000 7ff9a4a23700 1 --2- 172.21.15.154:0/3155408977 >> v2:172.21.15.154:3300/0 conn(0x7ff9a0130ce0 0x7ff9a0131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.389+0000 7ff9a4a23700 1 --2- 172.21.15.154:0/3155408977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01307a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.389+0000 7ff9a4a23700 1 -- 172.21.15.154:0/3155408977 >> 172.21.15.154:0/3155408977 conn(0x7ff9a0099c40 msgr2=0x7ff9a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.389+0000 7ff9a4a23700 1 -- 172.21.15.154:0/3155408977 shutdown_connections 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.389+0000 7ff9a4a23700 1 -- 172.21.15.154:0/3155408977 wait complete. 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.390+0000 7ff9a4a23700 1 Processor -- start 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff9a4a23700 1 -- start start 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff9a4a23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 0x7ff9a01cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff9a4a23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff9a4a23700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9a0130ce0 0x7ff9a01cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff9a4a23700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0127340 con 0x7ff9a0130ce0 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff9a4a23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00a2360 con 0x7ff9a009d860 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff9a4a23700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0129d90 con 0x7ff9a009e170 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff99ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9a0130ce0 0x7ff9a01cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff99ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9a0130ce0 0x7ff9a01cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39302/0 (socket says 172.21.15.154:39302) 2023-09-30T22:23:03.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff99ed9d700 1 -- 172.21.15.154:0/883746744 learned_addr learned my addr 172.21.15.154:0/883746744 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:03.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff99e59c700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 0x7ff9a01cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.391+0000 7ff99dd9b700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff99ed9d700 1 -- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 msgr2=0x7ff9a01ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff99ed9d700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff99ed9d700 1 -- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 msgr2=0x7ff9a01cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff99ed9d700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 0x7ff9a01cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff99ed9d700 1 -- 172.21.15.154:0/883746744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940094a0 con 0x7ff9a0130ce0 2023-09-30T22:23:03.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff99dd9b700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:03.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff99ed9d700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9a0130ce0 0x7ff9a01cd2d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff998007e40 tx=0x7ff99800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff98effd700 1 -- 172.21.15.154:0/883746744 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800ede0 con 0x7ff9a0130ce0 2023-09-30T22:23:03.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff9a4a23700 1 -- 172.21.15.154:0/883746744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a011ce10 con 0x7ff9a0130ce0 2023-09-30T22:23:03.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff98effd700 1 -- 172.21.15.154:0/883746744 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998014420 con 0x7ff9a0130ce0 2023-09-30T22:23:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff98effd700 1 -- 172.21.15.154:0/883746744 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980147d0 con 0x7ff9a0130ce0 2023-09-30T22:23:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.392+0000 7ff9a4a23700 1 -- 172.21.15.154:0/883746744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a0128950 con 0x7ff9a0130ce0 2023-09-30T22:23:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.393+0000 7ff98effd700 1 -- 172.21.15.154:0/883746744 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff998014930 con 0x7ff9a0130ce0 2023-09-30T22:23:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.393+0000 7ff9a4a23700 1 -- 172.21.15.154:0/883746744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0128c00 con 0x7ff9a0130ce0 2023-09-30T22:23:03.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.393+0000 7ff98effd700 1 -- 172.21.15.154:0/883746744 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff99803fec0 con 0x7ff9a0130ce0 2023-09-30T22:23:03.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.402+0000 7ff98effd700 1 -- 172.21.15.154:0/883746744 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff99801bce0 con 0x7ff9a0130ce0 2023-09-30T22:23:03.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.439+0000 7f68e1a29700 1 Processor -- start 2023-09-30T22:23:03.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.439+0000 7f68e1a29700 1 -- start start 2023-09-30T22:23:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.439+0000 7f68e1a29700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc0a0a70 0x7f68dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.439+0000 7f68e1a29700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a1380 0x7f68dc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.439+0000 7f68e1a29700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68dc09dc00 con 0x7f68dc133f50 2023-09-30T22:23:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.439+0000 7f68e1a29700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc09ea60 con 0x7f68dc0a0a70 2023-09-30T22:23:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.439+0000 7f68e1a29700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc09dec0 con 0x7f68dc0a1380 2023-09-30T22:23:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68daffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc0a0a70 0x7f68dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68daffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc0a0a70 0x7f68dc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36020/0 (socket says 172.21.15.154:36020) 2023-09-30T22:23:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68daffd700 1 -- 172.21.15.154:0/528605583 learned_addr learned my addr 172.21.15.154:0/528605583 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68daffd700 1 -- 172.21.15.154:0/528605583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a1380 msgr2=0x7f68dc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68daffd700 1 --2- 172.21.15.154:0/528605583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a1380 0x7f68dc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68d9ffb700 1 -- 172.21.15.154:0/528605583 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888064727 0 0) 0x7f68dc09dc00 con 0x7f68dc133f50 2023-09-30T22:23:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68daffd700 1 -- 172.21.15.154:0/528605583 >> v1:172.21.15.154:6789/0 conn(0x7f68dc133f50 legacy=0x7f68dc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68daffd700 1 -- 172.21.15.154:0/528605583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc09e6a0 con 0x7f68dc0a0a70 2023-09-30T22:23:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68daffd700 1 --2- 172.21.15.154:0/528605583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc0a0a70 0x7f68dc0a0e40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009920 tx=0x7f68cc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f1167c8e32649cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68d9ffb700 1 -- 172.21.15.154:0/528605583 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc00ba60 con 0x7f68dc0a0a70 2023-09-30T22:23:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68d9ffb700 1 -- 172.21.15.154:0/528605583 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc00bbc0 con 0x7f68dc0a0a70 2023-09-30T22:23:03.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.440+0000 7f68d9ffb700 1 -- 172.21.15.154:0/528605583 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc009e70 con 0x7f68dc0a0a70 2023-09-30T22:23:03.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.441+0000 7f68e1a29700 1 -- 172.21.15.154:0/528605583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc0a0a70 msgr2=0x7f68dc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.441+0000 7f68e1a29700 1 --2- 172.21.15.154:0/528605583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc0a0a70 0x7f68dc0a0e40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009920 tx=0x7f68cc009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:03.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.441+0000 7f68e1a29700 1 -- 172.21.15.154:0/528605583 shutdown_connections 2023-09-30T22:23:03.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.441+0000 7f68e1a29700 1 --2- 172.21.15.154:0/528605583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc0a0a70 0x7f68dc0a0e40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.441+0000 7f68e1a29700 1 --2- 172.21.15.154:0/528605583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a1380 0x7f68dc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.441+0000 7f68e1a29700 1 -- 172.21.15.154:0/528605583 >> 172.21.15.154:0/528605583 conn(0x7f68dc0a6610 msgr2=0x7f68dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.441+0000 7f68e1a29700 1 -- 172.21.15.154:0/528605583 shutdown_connections 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.441+0000 7f68e1a29700 1 -- 172.21.15.154:0/528605583 wait complete. 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.442+0000 7f68e1a29700 1 Processor -- start 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68e1a29700 1 -- start start 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68e1a29700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a0a70 0x7f68dc1228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68e1a29700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68dc0a1380 0x7f68dc122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68e1a29700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc133f50 0x7f68dc123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68e1a29700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc124670 con 0x7f68dc0a1380 2023-09-30T22:23:03.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68e1a29700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc133aa0 con 0x7f68dc133f50 2023-09-30T22:23:03.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68e1a29700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc123d20 con 0x7f68dc0a0a70 2023-09-30T22:23:03.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68db7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc133f50 0x7f68dc123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68db7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc133f50 0x7f68dc123360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36026/0 (socket says 172.21.15.154:36026) 2023-09-30T22:23:03.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68db7fe700 1 -- 172.21.15.154:0/1294485724 learned_addr learned my addr 172.21.15.154:0/1294485724 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:03.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68daffd700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a0a70 0x7f68dc1228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.443+0000 7f68da7fc700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68dc0a1380 0x7f68dc122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68daffd700 1 -- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc133f50 msgr2=0x7f68dc123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68daffd700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc133f50 0x7f68dc123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68daffd700 1 -- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68dc0a1380 msgr2=0x7f68dc122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68daffd700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68dc0a1380 0x7f68dc122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68daffd700 1 -- 172.21.15.154:0/1294485724 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc009550 con 0x7f68dc0a0a70 2023-09-30T22:23:03.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68da7fc700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68dc0a1380 0x7f68dc122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:03.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68daffd700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a0a70 0x7f68dc1228e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f68cc016000 tx=0x7f68cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68c3fff700 1 -- 172.21.15.154:0/1294485724 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc004380 con 0x7f68dc0a0a70 2023-09-30T22:23:03.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68c3fff700 1 -- 172.21.15.154:0/1294485724 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc01f070 con 0x7f68dc0a0a70 2023-09-30T22:23:03.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68c3fff700 1 -- 172.21.15.154:0/1294485724 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc0036a0 con 0x7f68dc0a0a70 2023-09-30T22:23:03.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68e1a29700 1 -- 172.21.15.154:0/1294485724 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc133830 con 0x7f68dc0a0a70 2023-09-30T22:23:03.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.444+0000 7f68e1a29700 1 -- 172.21.15.154:0/1294485724 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68dc124d00 con 0x7f68dc0a0a70 2023-09-30T22:23:03.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.445+0000 7f68c3fff700 1 -- 172.21.15.154:0/1294485724 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68cc021030 con 0x7f68dc0a0a70 2023-09-30T22:23:03.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.445+0000 7f68c3fff700 1 -- 172.21.15.154:0/1294485724 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68cc040cd0 con 0x7f68dc0a0a70 2023-09-30T22:23:03.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.445+0000 7f68e1a29700 1 -- 172.21.15.154:0/1294485724 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc04f2a0 con 0x7f68dc0a0a70 2023-09-30T22:23:03.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.450+0000 7f68c3fff700 1 -- 172.21.15.154:0/1294485724 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68cc0199a0 con 0x7f68dc0a0a70 2023-09-30T22:23:03.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.481+0000 7f6bda747700 1 Processor -- start 2023-09-30T22:23:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.481+0000 7f6bda747700 1 -- start start 2023-09-30T22:23:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.481+0000 7f6bda747700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.481+0000 7f6bda747700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bd40a1340 0x7f6bd412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.481+0000 7f6bda747700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd41304a0 0x7f6bd4130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.481+0000 7f6bda747700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd40a1e70 con 0x7f6bd40a1340 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.481+0000 7f6bda747700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd409a720 con 0x7f6bd40a0a30 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.481+0000 7f6bda747700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd409b300 con 0x7f6bd41304a0 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bd40a1340 0x7f6bd412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36032/0 (socket says 172.21.15.154:36032) 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd3fff700 1 -- 172.21.15.154:0/1338511897 learned_addr learned my addr 172.21.15.154:0/1338511897 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd8ce4700 1 --2- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd41304a0 0x7f6bd4130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd37fe700 1 -- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd41304a0 msgr2=0x7f6bd4130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd37fe700 1 --2- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd41304a0 0x7f6bd4130940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd37fe700 1 -- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 msgr2=0x7f6bd40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd37fe700 1 --2- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd37fe700 1 -- 172.21.15.154:0/1338511897 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd409abc0 con 0x7f6bd40a1340 2023-09-30T22:23:03.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd3fff700 1 --2- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:03.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd37fe700 1 --2- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd40a1340 0x7f6bd412ff60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009840 tx=0x7f6bc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f9d5e686b098a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd2ffd700 1 -- 172.21.15.154:0/1338511897 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8013c90 con 0x7f6bd40a1340 2023-09-30T22:23:03.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.482+0000 7f6bd2ffd700 1 -- 172.21.15.154:0/1338511897 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc8013df0 con 0x7f6bd40a1340 2023-09-30T22:23:03.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bd2ffd700 1 -- 172.21.15.154:0/1338511897 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc801b620 con 0x7f6bd40a1340 2023-09-30T22:23:03.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bda747700 1 -- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd40a1340 msgr2=0x7f6bd412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bda747700 1 --2- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd40a1340 0x7f6bd412ff60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009840 tx=0x7f6bc8009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bda747700 1 -- 172.21.15.154:0/1338511897 shutdown_connections 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bda747700 1 --2- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bda747700 1 --2- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd41304a0 0x7f6bd4130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bda747700 1 --2- 172.21.15.154:0/1338511897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd40a1340 0x7f6bd412ff60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bda747700 1 -- 172.21.15.154:0/1338511897 >> 172.21.15.154:0/1338511897 conn(0x7f6bd40a2980 msgr2=0x7f6bd40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bda747700 1 -- 172.21.15.154:0/1338511897 shutdown_connections 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.483+0000 7f6bda747700 1 -- 172.21.15.154:0/1338511897 wait complete. 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.485+0000 7f6bda747700 1 Processor -- start 2023-09-30T22:23:03.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.485+0000 7f6bda747700 1 -- start start 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bda747700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd411ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bda747700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd40a1340 0x7f6bd41c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bda747700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd41304a0 0x7f6bd41c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bda747700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd411d860 con 0x7f6bd41304a0 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bda747700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd409ae00 con 0x7f6bd40a0a30 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bda747700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd411a8c0 con 0x7f6bd40a1340 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd8ce4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd41304a0 0x7f6bd41c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd8ce4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd41304a0 0x7f6bd41c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39322/0 (socket says 172.21.15.154:39322) 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd8ce4700 1 -- 172.21.15.154:0/1847888841 learned_addr learned my addr 172.21.15.154:0/1847888841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd37fe700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd40a1340 0x7f6bd41c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd3fff700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd411ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:03.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd8ce4700 1 -- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd40a1340 msgr2=0x7f6bd41c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd8ce4700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd40a1340 0x7f6bd41c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd8ce4700 1 -- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 msgr2=0x7f6bd411ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd8ce4700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd411ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd8ce4700 1 -- 172.21.15.154:0/1847888841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4009500 con 0x7f6bd41304a0 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.486+0000 7f6bd37fe700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd40a1340 0x7f6bd41c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.487+0000 7f6bd8ce4700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd41304a0 0x7f6bd41c4350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00efc0 tx=0x7f6bcc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.487+0000 7f6bd0ff9700 1 -- 172.21.15.154:0/1847888841 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc009ea0 con 0x7f6bd41304a0 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.487+0000 7f6bd0ff9700 1 -- 172.21.15.154:0/1847888841 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc00f040 con 0x7f6bd41304a0 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.487+0000 7f6bda747700 1 -- 172.21.15.154:0/1847888841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc80094a0 con 0x7f6bd41304a0 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.487+0000 7f6bd0ff9700 1 -- 172.21.15.154:0/1847888841 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc014480 con 0x7f6bd41304a0 2023-09-30T22:23:03.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.487+0000 7f6bda747700 1 -- 172.21.15.154:0/1847888841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd411a560 con 0x7f6bd41304a0 2023-09-30T22:23:03.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.488+0000 7f6bd0ff9700 1 -- 172.21.15.154:0/1847888841 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bcc0145e0 con 0x7f6bd41304a0 2023-09-30T22:23:03.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.488+0000 7f6bda747700 1 -- 172.21.15.154:0/1847888841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd404f2a0 con 0x7f6bd41304a0 2023-09-30T22:23:03.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.488+0000 7f6bd0ff9700 1 -- 172.21.15.154:0/1847888841 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bcc03ff70 con 0x7f6bd41304a0 2023-09-30T22:23:03.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.493+0000 7f6bd0ff9700 1 -- 172.21.15.154:0/1847888841 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bcc01a8b0 con 0x7f6bd41304a0 2023-09-30T22:23:03.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.564+0000 7f89deb63700 1 -- 172.21.15.154:0/1315808750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f89d81c4d00 con 0x7f89d80a1340 2023-09-30T22:23:03.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.565+0000 7f89d57fa700 1 -- 172.21.15.154:0/1315808750 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89c4011350 con 0x7f89d80a1340 2023-09-30T22:23:03.565 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:03.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.568+0000 7f89deb63700 1 -- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 msgr2=0x7f89d81c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.568+0000 7f89deb63700 1 --2- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d81c47c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f89c400ebe0 tx=0x7f89c400eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.568+0000 7f89deb63700 1 -- 172.21.15.154:0/1315808750 shutdown_connections 2023-09-30T22:23:03.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.568+0000 7f89deb63700 1 --2- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81304a0 0x7f89d811ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.568+0000 7f89deb63700 1 --2- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d80a0a30 0x7f89d81c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.568+0000 7f89deb63700 1 --2- 172.21.15.154:0/1315808750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d80a1340 0x7f89d81c47c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.568+0000 7f89deb63700 1 -- 172.21.15.154:0/1315808750 >> 172.21.15.154:0/1315808750 conn(0x7f89d80a2980 msgr2=0x7f89d806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.568+0000 7f89deb63700 1 -- 172.21.15.154:0/1315808750 shutdown_connections 2023-09-30T22:23:03.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.568+0000 7f89deb63700 1 -- 172.21.15.154:0/1315808750 wait complete. 2023-09-30T22:23:03.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:03.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.609+0000 7ff9a4a23700 1 -- 172.21.15.154:0/883746744 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff9a004f2a0 con 0x7ff9a0130ce0 2023-09-30T22:23:03.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.609+0000 7ff98effd700 1 -- 172.21.15.154:0/883746744 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff99801bb00 con 0x7ff9a0130ce0 2023-09-30T22:23:03.609 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:03.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.612+0000 7ff9a4a23700 1 -- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9a0130ce0 msgr2=0x7ff9a01cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.612+0000 7ff9a4a23700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9a0130ce0 0x7ff9a01cd2d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff998007e40 tx=0x7ff99800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.612+0000 7ff9a4a23700 1 -- 172.21.15.154:0/883746744 shutdown_connections 2023-09-30T22:23:03.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.612+0000 7ff9a4a23700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9a0130ce0 0x7ff9a01cd2d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.612+0000 7ff9a4a23700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff9a009d860 0x7ff9a01cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.612+0000 7ff9a4a23700 1 --2- 172.21.15.154:0/883746744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9a009e170 0x7ff9a01ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.612+0000 7ff9a4a23700 1 -- 172.21.15.154:0/883746744 >> 172.21.15.154:0/883746744 conn(0x7ff9a0099c40 msgr2=0x7ff9a00709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.612+0000 7ff9a4a23700 1 -- 172.21.15.154:0/883746744 shutdown_connections 2023-09-30T22:23:03.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.612+0000 7ff9a4a23700 1 -- 172.21.15.154:0/883746744 wait complete. 2023-09-30T22:23:03.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:03.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.657+0000 7f68e1a29700 1 -- 172.21.15.154:0/1294485724 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68dc1261e0 con 0x7f68dc0a0a70 2023-09-30T22:23:03.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.657+0000 7f68c3fff700 1 -- 172.21.15.154:0/1294485724 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68cc01b430 con 0x7f68dc0a0a70 2023-09-30T22:23:03.657 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.660+0000 7f68e1a29700 1 -- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a0a70 msgr2=0x7f68dc1228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.660+0000 7f68e1a29700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a0a70 0x7f68dc1228e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f68cc016000 tx=0x7f68cc004750 comp rx=0 tx=0).stop 2023-09-30T22:23:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.660+0000 7f68e1a29700 1 -- 172.21.15.154:0/1294485724 shutdown_connections 2023-09-30T22:23:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.660+0000 7f68e1a29700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68dc133f50 0x7f68dc123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.660+0000 7f68e1a29700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68dc0a0a70 0x7f68dc1228e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.660+0000 7f68e1a29700 1 --2- 172.21.15.154:0/1294485724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68dc0a1380 0x7f68dc122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.660+0000 7f68e1a29700 1 -- 172.21.15.154:0/1294485724 >> 172.21.15.154:0/1294485724 conn(0x7f68dc0a6610 msgr2=0x7f68dc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.660+0000 7f68e1a29700 1 -- 172.21.15.154:0/1294485724 shutdown_connections 2023-09-30T22:23:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.660+0000 7f68e1a29700 1 -- 172.21.15.154:0/1294485724 wait complete. 2023-09-30T22:23:03.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:03.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.686+0000 7f6bda747700 1 -- 172.21.15.154:0/1847888841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6bd406bce0 con 0x7f6bd41304a0 2023-09-30T22:23:03.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.686+0000 7f6bd0ff9700 1 -- 172.21.15.154:0/1847888841 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bcc018020 con 0x7f6bd41304a0 2023-09-30T22:23:03.686 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:03.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.688+0000 7f6bda747700 1 -- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd41304a0 msgr2=0x7f6bd41c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:03.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.688+0000 7f6bda747700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd41304a0 0x7f6bd41c4350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00efc0 tx=0x7f6bcc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.688+0000 7f6bda747700 1 -- 172.21.15.154:0/1847888841 shutdown_connections 2023-09-30T22:23:03.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.688+0000 7f6bda747700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd41304a0 0x7f6bd41c4350 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.688+0000 7f6bda747700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd40a0a30 0x7f6bd411ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.688+0000 7f6bda747700 1 --2- 172.21.15.154:0/1847888841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bd40a1340 0x7f6bd41c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:03.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.688+0000 7f6bda747700 1 -- 172.21.15.154:0/1847888841 >> 172.21.15.154:0/1847888841 conn(0x7f6bd40a2980 msgr2=0x7f6bd409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:03.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.688+0000 7f6bda747700 1 -- 172.21.15.154:0/1847888841 shutdown_connections 2023-09-30T22:23:03.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:03.688+0000 7f6bda747700 1 -- 172.21.15.154:0/1847888841 wait complete. 2023-09-30T22:23:03.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:04.586 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:04.630 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:04.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:04.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:04.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.717+0000 7f3887ecc700 1 Processor -- start 2023-09-30T22:23:04.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3887ecc700 1 -- start start 2023-09-30T22:23:04.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3887ecc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006a770 0x7f388006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3887ecc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3880131ec0 0x7f3880139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3887ecc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388009da80 con 0x7f388006b080 2023-09-30T22:23:04.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3887ecc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388009dce0 con 0x7f3880131ec0 2023-09-30T22:23:04.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3887ecc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f388009eb20 con 0x7f388006a770 2023-09-30T22:23:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3885c68700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006a770 0x7f388006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3886469700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3880131ec0 0x7f3880139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3885c68700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006a770 0x7f388006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59928/0 (socket says 172.21.15.154:59928) 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.718+0000 7f3885c68700 1 -- 172.21.15.154:0/1185220334 learned_addr learned my addr 172.21.15.154:0/1185220334 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.719+0000 7f3886469700 1 -- 172.21.15.154:0/1185220334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006a770 msgr2=0x7f388006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.719+0000 7f3886469700 1 --2- 172.21.15.154:0/1185220334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006a770 0x7f388006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.719+0000 7f3886469700 1 -- 172.21.15.154:0/1185220334 >> v1:172.21.15.154:6789/0 conn(0x7f388006b080 legacy=0x7f38801317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.719+0000 7f3886469700 1 -- 172.21.15.154:0/1185220334 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388009d860 con 0x7f3880131ec0 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.719+0000 7f3885c68700 1 --2- 172.21.15.154:0/1185220334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006a770 0x7f388006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.719+0000 7f3886469700 1 --2- 172.21.15.154:0/1185220334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3880131ec0 0x7f3880139c20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3878009d90 tx=0x7f387800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2cce8d68a8da2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.719+0000 7f3884c66700 1 -- 172.21.15.154:0/1185220334 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387800e070 con 0x7f3880131ec0 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.719+0000 7f3884c66700 1 -- 172.21.15.154:0/1185220334 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387800bb20 con 0x7f3880131ec0 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.719+0000 7f3884c66700 1 -- 172.21.15.154:0/1185220334 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878012430 con 0x7f3880131ec0 2023-09-30T22:23:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.720+0000 7f3887ecc700 1 -- 172.21.15.154:0/1185220334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3880131ec0 msgr2=0x7f3880139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.720+0000 7f3887ecc700 1 --2- 172.21.15.154:0/1185220334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3880131ec0 0x7f3880139c20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3878009d90 tx=0x7f387800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:04.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.720+0000 7f3887ecc700 1 -- 172.21.15.154:0/1185220334 shutdown_connections 2023-09-30T22:23:04.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.720+0000 7f3887ecc700 1 --2- 172.21.15.154:0/1185220334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3880131ec0 0x7f3880139c20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.720+0000 7f3887ecc700 1 --2- 172.21.15.154:0/1185220334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006a770 0x7f388006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.720+0000 7f3887ecc700 1 -- 172.21.15.154:0/1185220334 >> 172.21.15.154:0/1185220334 conn(0x7f3880099c40 msgr2=0x7f38800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:04.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.720+0000 7f3887ecc700 1 -- 172.21.15.154:0/1185220334 shutdown_connections 2023-09-30T22:23:04.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.720+0000 7f3887ecc700 1 -- 172.21.15.154:0/1185220334 wait complete. 2023-09-30T22:23:04.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.722+0000 7f3887ecc700 1 Processor -- start 2023-09-30T22:23:04.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.722+0000 7f3887ecc700 1 -- start start 2023-09-30T22:23:04.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3887ecc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388006a770 0x7f388011d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3887ecc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006b080 0x7f388011d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3887ecc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3880131ec0 0x7f388011dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3887ecc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38801207f0 con 0x7f388006a770 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3887ecc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3880071e10 con 0x7f3880131ec0 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3887ecc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f388011ecd0 con 0x7f388006b080 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3886469700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3880131ec0 0x7f388011dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3885467700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006b080 0x7f388011d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3886469700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3880131ec0 0x7f388011dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36052/0 (socket says 172.21.15.154:36052) 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3886469700 1 -- 172.21.15.154:0/3839962066 learned_addr learned my addr 172.21.15.154:0/3839962066 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3885c68700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388006a770 0x7f388011d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3886469700 1 -- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006b080 msgr2=0x7f388011d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3886469700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006b080 0x7f388011d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3886469700 1 -- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388006a770 msgr2=0x7f388011d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3886469700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388006a770 0x7f388011d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3886469700 1 -- 172.21.15.154:0/3839962066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c009550 con 0x7f3880131ec0 2023-09-30T22:23:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3885467700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006b080 0x7f388011d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3885c68700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388006a770 0x7f388011d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.723+0000 7f3886469700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3880131ec0 0x7f388011dac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f388009dc10 tx=0x7f3878004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.724+0000 7f38767fc700 1 -- 172.21.15.154:0/3839962066 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878012430 con 0x7f3880131ec0 2023-09-30T22:23:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.724+0000 7f38767fc700 1 -- 172.21.15.154:0/3839962066 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3878020070 con 0x7f3880131ec0 2023-09-30T22:23:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.724+0000 7f3887ecc700 1 -- 172.21.15.154:0/3839962066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3878009a70 con 0x7f3880131ec0 2023-09-30T22:23:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.724+0000 7f38767fc700 1 -- 172.21.15.154:0/3839962066 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878003ea0 con 0x7f3880131ec0 2023-09-30T22:23:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.724+0000 7f3887ecc700 1 -- 172.21.15.154:0/3839962066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38800a3480 con 0x7f3880131ec0 2023-09-30T22:23:04.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.725+0000 7f38767fc700 1 -- 172.21.15.154:0/3839962066 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3878004280 con 0x7f3880131ec0 2023-09-30T22:23:04.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.725+0000 7f38767fc700 1 -- 172.21.15.154:0/3839962066 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3878022070 con 0x7f3880131ec0 2023-09-30T22:23:04.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.725+0000 7f3887ecc700 1 -- 172.21.15.154:0/3839962066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388004f2a0 con 0x7f3880131ec0 2023-09-30T22:23:04.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.731+0000 7f38767fc700 1 -- 172.21.15.154:0/3839962066 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3878012e60 con 0x7f3880131ec0 2023-09-30T22:23:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.761+0000 7f08d709b700 1 Processor -- start 2023-09-30T22:23:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.761+0000 7f08d709b700 1 -- start start 2023-09-30T22:23:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.762+0000 7f08d709b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.762+0000 7f08d709b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d00a1340 0x7f08d012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.762+0000 7f08d709b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d00a1e70 con 0x7f08d01304a0 2023-09-30T22:23:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.762+0000 7f08d709b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d009a720 con 0x7f08d00a0a30 2023-09-30T22:23:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.762+0000 7f08d709b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08d009b300 con 0x7f08d00a1340 2023-09-30T22:23:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.762+0000 7f08d4e37700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.762+0000 7f08d5638700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f08d01304a0 0x7f08d01371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35798/0 (socket says 172.21.15.154:35798) 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.762+0000 7f08d5638700 1 -- 172.21.15.154:0/145532138 learned_addr learned my addr 172.21.15.154:0/145532138 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.762+0000 7f08cffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d00a1340 0x7f08d012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.763+0000 7f08d4e37700 1 -- 172.21.15.154:0/145532138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d00a1340 msgr2=0x7f08d012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.763+0000 7f08cf7fe700 1 -- 172.21.15.154:0/145532138 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502779104 0 0) 0x7f08d00a1e70 con 0x7f08d01304a0 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.763+0000 7f08d4e37700 1 --2- 172.21.15.154:0/145532138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d00a1340 0x7f08d012ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.763+0000 7f08d4e37700 1 -- 172.21.15.154:0/145532138 >> v1:172.21.15.154:6789/0 conn(0x7f08d01304a0 legacy=0x7f08d01371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.763+0000 7f08d4e37700 1 -- 172.21.15.154:0/145532138 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d009abc0 con 0x7f08d00a0a30 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.763+0000 7f08d4e37700 1 --2- 172.21.15.154:0/145532138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d00a0e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009850 tx=0x7f08c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92a5d80741b37e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.763+0000 7f08cf7fe700 1 -- 172.21.15.154:0/145532138 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4005e30 con 0x7f08d00a0a30 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.763+0000 7f08cf7fe700 1 -- 172.21.15.154:0/145532138 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c4006030 con 0x7f08d00a0a30 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.763+0000 7f08cf7fe700 1 -- 172.21.15.154:0/145532138 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40063e0 con 0x7f08d00a0a30 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.764+0000 7f08d709b700 1 -- 172.21.15.154:0/145532138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 msgr2=0x7f08d00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.764+0000 7f08d709b700 1 --2- 172.21.15.154:0/145532138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d00a0e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009850 tx=0x7f08c4009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.764+0000 7f08d709b700 1 -- 172.21.15.154:0/145532138 shutdown_connections 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.764+0000 7f08d709b700 1 --2- 172.21.15.154:0/145532138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d00a0e00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.764+0000 7f08d709b700 1 --2- 172.21.15.154:0/145532138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d00a1340 0x7f08d012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.764+0000 7f08d709b700 1 -- 172.21.15.154:0/145532138 >> 172.21.15.154:0/145532138 conn(0x7f08d00a2980 msgr2=0x7f08d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.764+0000 7f08d709b700 1 -- 172.21.15.154:0/145532138 shutdown_connections 2023-09-30T22:23:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.764+0000 7f08d709b700 1 -- 172.21.15.154:0/145532138 wait complete. 2023-09-30T22:23:04.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.765+0000 7f08d709b700 1 Processor -- start 2023-09-30T22:23:04.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.765+0000 7f08d709b700 1 -- start start 2023-09-30T22:23:04.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.765+0000 7f08d709b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d011f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.765+0000 7f08d709b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d00a1340 0x7f08d011fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.765+0000 7f08d709b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d01304a0 0x7f08d01200f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.765+0000 7f08d709b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0123190 con 0x7f08d00a1340 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.765+0000 7f08d709b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0122c80 con 0x7f08d00a0a30 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.765+0000 7f08d709b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0121af0 con 0x7f08d01304a0 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d00a1340 0x7f08d011fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08d5638700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d01304a0 0x7f08d01200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d00a1340 0x7f08d011fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39352/0 (socket says 172.21.15.154:39352) 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cffff700 1 -- 172.21.15.154:0/3198870396 learned_addr learned my addr 172.21.15.154:0/3198870396 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08d4e37700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d011f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cffff700 1 -- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d01304a0 msgr2=0x7f08d01200f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cffff700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d01304a0 0x7f08d01200f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cffff700 1 -- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 msgr2=0x7f08d011f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cffff700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d011f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cffff700 1 -- 172.21.15.154:0/3198870396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4009430 con 0x7f08d00a1340 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08d5638700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d01304a0 0x7f08d01200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08d4e37700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d011f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cffff700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d00a1340 0x7f08d011fbb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00e980 tx=0x7f08bc00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cd7fa700 1 -- 172.21.15.154:0/3198870396 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc009710 con 0x7f08d00a1340 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cd7fa700 1 -- 172.21.15.154:0/3198870396 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc00eed0 con 0x7f08d00a1340 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08d709b700 1 -- 172.21.15.154:0/3198870396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d0122920 con 0x7f08d00a1340 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.766+0000 7f08cd7fa700 1 -- 172.21.15.154:0/3198870396 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc00ca70 con 0x7f08d00a1340 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.767+0000 7f08d709b700 1 -- 172.21.15.154:0/3198870396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d009ae00 con 0x7f08d00a1340 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.767+0000 7f08cd7fa700 1 -- 172.21.15.154:0/3198870396 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08bc00cbd0 con 0x7f08d00a1340 2023-09-30T22:23:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.768+0000 7f08d709b700 1 -- 172.21.15.154:0/3198870396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d004f2a0 con 0x7f08d00a1340 2023-09-30T22:23:04.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.768+0000 7f08cd7fa700 1 -- 172.21.15.154:0/3198870396 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f08bc0421c0 con 0x7f08d00a1340 2023-09-30T22:23:04.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.776+0000 7f08cd7fa700 1 -- 172.21.15.154:0/3198870396 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08bc017020 con 0x7f08d00a1340 2023-09-30T22:23:04.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.819+0000 7f804e548700 1 Processor -- start 2023-09-30T22:23:04.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.819+0000 7f804e548700 1 -- start start 2023-09-30T22:23:04.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804e548700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f804809e870 0x7f804809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804e548700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8048131f40 0x7f8048139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804e548700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804809c970 con 0x7f804809f180 2023-09-30T22:23:04.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804e548700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80480a0920 con 0x7f804809e870 2023-09-30T22:23:04.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804e548700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f804809f9c0 con 0x7f8048131f40 2023-09-30T22:23:04.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804cae5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8048131f40 0x7f8048139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f8047fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f804809e870 0x7f804809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804cae5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8048131f40 0x7f8048139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59962/0 (socket says 172.21.15.154:59962) 2023-09-30T22:23:04.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f8047fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f804809e870 0x7f804809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39354/0 (socket says 172.21.15.154:39354) 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804cae5700 1 -- 172.21.15.154:0/2314692765 learned_addr learned my addr 172.21.15.154:0/2314692765 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804cae5700 1 -- 172.21.15.154:0/2314692765 >> v2:172.21.15.154:3300/0 conn(0x7f804809e870 msgr2=0x7f804809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804cae5700 1 --2- 172.21.15.154:0/2314692765 >> v2:172.21.15.154:3300/0 conn(0x7f804809e870 0x7f804809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804cae5700 1 -- 172.21.15.154:0/2314692765 >> v1:172.21.15.154:6789/0 conn(0x7f804809f180 legacy=0x7f8048131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.820+0000 7f804cae5700 1 -- 172.21.15.154:0/2314692765 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804809bab0 con 0x7f8048131f40 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.821+0000 7f8047fff700 1 --2- 172.21.15.154:0/2314692765 >> v2:172.21.15.154:3300/0 conn(0x7f804809e870 0x7f804809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.821+0000 7f804cae5700 1 --2- 172.21.15.154:0/2314692765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8048131f40 0x7f8048139ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8040009e50 tx=0x7f804000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99b1b6985dd13ac7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.821+0000 7f8046ffd700 1 -- 172.21.15.154:0/2314692765 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804000e070 con 0x7f8048131f40 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.821+0000 7f8046ffd700 1 -- 172.21.15.154:0/2314692765 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804000b910 con 0x7f8048131f40 2023-09-30T22:23:04.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.821+0000 7f8046ffd700 1 -- 172.21.15.154:0/2314692765 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804000bcc0 con 0x7f8048131f40 2023-09-30T22:23:04.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.822+0000 7f804e548700 1 -- 172.21.15.154:0/2314692765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8048131f40 msgr2=0x7f8048139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.822+0000 7f804e548700 1 --2- 172.21.15.154:0/2314692765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8048131f40 0x7f8048139ca0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8040009e50 tx=0x7f804000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:04.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.822+0000 7f804e548700 1 -- 172.21.15.154:0/2314692765 shutdown_connections 2023-09-30T22:23:04.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.822+0000 7f804e548700 1 --2- 172.21.15.154:0/2314692765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8048131f40 0x7f8048139ca0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.822+0000 7f804e548700 1 --2- 172.21.15.154:0/2314692765 >> v2:172.21.15.154:3300/0 conn(0x7f804809e870 0x7f804809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.822+0000 7f804e548700 1 -- 172.21.15.154:0/2314692765 >> 172.21.15.154:0/2314692765 conn(0x7f80480a4430 msgr2=0x7f80480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:04.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.822+0000 7f804e548700 1 -- 172.21.15.154:0/2314692765 shutdown_connections 2023-09-30T22:23:04.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.822+0000 7f804e548700 1 -- 172.21.15.154:0/2314692765 wait complete. 2023-09-30T22:23:04.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.823+0000 7f804e548700 1 Processor -- start 2023-09-30T22:23:04.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.824+0000 7f804e548700 1 -- start start 2023-09-30T22:23:04.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.824+0000 7f804e548700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804809e870 0x7f804812f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.824+0000 7f804e548700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804809f180 0x7f804812fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.824+0000 7f804e548700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8048131f40 0x7f8048130290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.824+0000 7f804e548700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8048137230 con 0x7f8048131f40 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.824+0000 7f804e548700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8048139570 con 0x7f804809e870 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.824+0000 7f804e548700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8048137a50 con 0x7f804809f180 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.824+0000 7f8047fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804809e870 0x7f804812f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.824+0000 7f80477fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804809f180 0x7f804812fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8047fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804809e870 0x7f804812f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36090/0 (socket says 172.21.15.154:36090) 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8047fff700 1 -- 172.21.15.154:0/4180518012 learned_addr learned my addr 172.21.15.154:0/4180518012 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f80477fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804809f180 0x7f804812fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59966/0 (socket says 172.21.15.154:59966) 2023-09-30T22:23:04.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f804cae5700 1 --2- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8048131f40 0x7f8048130290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8047fff700 1 -- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804809f180 msgr2=0x7f804812fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8047fff700 1 --2- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804809f180 0x7f804812fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8047fff700 1 -- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8048131f40 msgr2=0x7f8048130290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8047fff700 1 --2- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8048131f40 0x7f8048130290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8047fff700 1 -- 172.21.15.154:0/4180518012 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380094a0 con 0x7f804809e870 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f80477fe700 1 --2- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804809f180 0x7f804812fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8047fff700 1 --2- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804809e870 0x7f804812f810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f803800ec10 tx=0x7f803800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8044ff9700 1 -- 172.21.15.154:0/4180518012 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8038009760 con 0x7f804809e870 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8044ff9700 1 -- 172.21.15.154:0/4180518012 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803800c850 con 0x7f804809e870 2023-09-30T22:23:04.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f804e548700 1 -- 172.21.15.154:0/4180518012 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8040009b30 con 0x7f804809e870 2023-09-30T22:23:04.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f8044ff9700 1 -- 172.21.15.154:0/4180518012 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803800cbc0 con 0x7f804809e870 2023-09-30T22:23:04.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.825+0000 7f804e548700 1 -- 172.21.15.154:0/4180518012 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8048139fe0 con 0x7f804809e870 2023-09-30T22:23:04.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.827+0000 7f8044ff9700 1 -- 172.21.15.154:0/4180518012 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f803800cd20 con 0x7f804809e870 2023-09-30T22:23:04.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.827+0000 7f804e548700 1 -- 172.21.15.154:0/4180518012 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804804f2a0 con 0x7f804809e870 2023-09-30T22:23:04.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.827+0000 7f8044ff9700 1 -- 172.21.15.154:0/4180518012 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f803803f800 con 0x7f804809e870 2023-09-30T22:23:04.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.832+0000 7f8044ff9700 1 -- 172.21.15.154:0/4180518012 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80380232f0 con 0x7f804809e870 2023-09-30T22:23:04.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.870+0000 7f6b10392700 1 Processor -- start 2023-09-30T22:23:04.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.870+0000 7f6b10392700 1 -- start start 2023-09-30T22:23:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b10392700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b080a0a70 0x7f6b080a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b10392700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b0813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b10392700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0809dc00 con 0x7f6b080a1380 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b10392700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0809ea90 con 0x7f6b080a0a70 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b10392700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0809dec0 con 0x7f6b08134120 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b0e12e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b080a0a70 0x7f6b080a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b0e12e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b080a0a70 0x7f6b080a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39380/0 (socket says 172.21.15.154:39380) 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b0e12e700 1 -- 172.21.15.154:0/3035863769 learned_addr learned my addr 172.21.15.154:0/3035863769 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b0e92f700 1 --2- 172.21.15.154:0/3035863769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b0813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b0e92f700 1 -- 172.21.15.154:0/3035863769 >> v2:172.21.15.154:3300/0 conn(0x7f6b080a0a70 msgr2=0x7f6b080a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b0e92f700 1 --2- 172.21.15.154:0/3035863769 >> v2:172.21.15.154:3300/0 conn(0x7f6b080a0a70 0x7f6b080a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b0e92f700 1 -- 172.21.15.154:0/3035863769 >> v1:172.21.15.154:6789/0 conn(0x7f6b080a1380 legacy=0x7f6b08133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.871+0000 7f6b0e92f700 1 -- 172.21.15.154:0/3035863769 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0809e6a0 con 0x7f6b08134120 2023-09-30T22:23:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.872+0000 7f6b0e92f700 1 --2- 172.21.15.154:0/3035863769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b0813bce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009d90 tx=0x7f6b0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fca8f77b7f7f0e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.872+0000 7f6b0d12c700 1 -- 172.21.15.154:0/3035863769 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000e070 con 0x7f6b08134120 2023-09-30T22:23:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.872+0000 7f6b0d12c700 1 -- 172.21.15.154:0/3035863769 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0000bb20 con 0x7f6b08134120 2023-09-30T22:23:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.872+0000 7f6b0d12c700 1 -- 172.21.15.154:0/3035863769 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00012430 con 0x7f6b08134120 2023-09-30T22:23:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.873+0000 7f6b10392700 1 -- 172.21.15.154:0/3035863769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 msgr2=0x7f6b0813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.873+0000 7f6b10392700 1 --2- 172.21.15.154:0/3035863769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b0813bce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009d90 tx=0x7f6b0000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.873+0000 7f6b10392700 1 -- 172.21.15.154:0/3035863769 shutdown_connections 2023-09-30T22:23:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.873+0000 7f6b10392700 1 --2- 172.21.15.154:0/3035863769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b0813bce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.873+0000 7f6b10392700 1 --2- 172.21.15.154:0/3035863769 >> v2:172.21.15.154:3300/0 conn(0x7f6b080a0a70 0x7f6b080a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.873+0000 7f6b10392700 1 -- 172.21.15.154:0/3035863769 >> 172.21.15.154:0/3035863769 conn(0x7f6b080a6610 msgr2=0x7f6b080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.873+0000 7f6b10392700 1 -- 172.21.15.154:0/3035863769 shutdown_connections 2023-09-30T22:23:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.873+0000 7f6b10392700 1 -- 172.21.15.154:0/3035863769 wait complete. 2023-09-30T22:23:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.874+0000 7f6b10392700 1 Processor -- start 2023-09-30T22:23:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.874+0000 7f6b10392700 1 -- start start 2023-09-30T22:23:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b10392700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b080a0a70 0x7f6b081229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b10392700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b080a1380 0x7f6b08122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b10392700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b08123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b10392700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081260a0 con 0x7f6b080a1380 2023-09-30T22:23:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b10392700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080a03e0 con 0x7f6b08134120 2023-09-30T22:23:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b10392700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08124a40 con 0x7f6b080a0a70 2023-09-30T22:23:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b0d92d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b080a1380 0x7f6b08122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b0e92f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b08123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b0e92f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b08123440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36112/0 (socket says 172.21.15.154:36112) 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b0d92d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b080a1380 0x7f6b08122f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39384/0 (socket says 172.21.15.154:39384) 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b0e92f700 1 -- 172.21.15.154:0/2680508555 learned_addr learned my addr 172.21.15.154:0/2680508555 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b0d92d700 1 -- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b080a0a70 msgr2=0x7f6b081229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b0d92d700 1 --2- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b080a0a70 0x7f6b081229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b0d92d700 1 -- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 msgr2=0x7f6b08123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.875+0000 7f6b0d92d700 1 --2- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b08123440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.876+0000 7f6b0d92d700 1 -- 172.21.15.154:0/2680508555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00009a70 con 0x7f6b080a1380 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.876+0000 7f6b0e92f700 1 --2- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b08123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.876+0000 7f6b0d92d700 1 --2- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b080a1380 0x7f6b08122f00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6af8000f60 tx=0x7f6af800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.876+0000 7f6afeffd700 1 -- 172.21.15.154:0/2680508555 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af80052d0 con 0x7f6b080a1380 2023-09-30T22:23:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.876+0000 7f6afeffd700 1 -- 172.21.15.154:0/2680508555 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8005430 con 0x7f6b080a1380 2023-09-30T22:23:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.876+0000 7f6afeffd700 1 -- 172.21.15.154:0/2680508555 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af80038c0 con 0x7f6b080a1380 2023-09-30T22:23:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.876+0000 7f6b10392700 1 -- 172.21.15.154:0/2680508555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b081245e0 con 0x7f6b080a1380 2023-09-30T22:23:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.876+0000 7f6b10392700 1 -- 172.21.15.154:0/2680508555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b08126b10 con 0x7f6b080a1380 2023-09-30T22:23:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.877+0000 7f6b10392700 1 -- 172.21.15.154:0/2680508555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0804f2a0 con 0x7f6b080a1380 2023-09-30T22:23:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.878+0000 7f6afeffd700 1 -- 172.21.15.154:0/2680508555 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6af8003a20 con 0x7f6b080a1380 2023-09-30T22:23:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.878+0000 7f6afeffd700 1 -- 172.21.15.154:0/2680508555 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6af803ea60 con 0x7f6b080a1380 2023-09-30T22:23:04.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.887+0000 7f6afeffd700 1 -- 172.21.15.154:0/2680508555 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6af8019e60 con 0x7f6b080a1380 2023-09-30T22:23:04.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.936+0000 7f3887ecc700 1 -- 172.21.15.154:0/3839962066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f388009e530 con 0x7f3880131ec0 2023-09-30T22:23:04.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.937+0000 7f38767fc700 1 -- 172.21.15.154:0/3839962066 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f388009e530 con 0x7f3880131ec0 2023-09-30T22:23:04.937 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.939+0000 7f3887ecc700 1 -- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3880131ec0 msgr2=0x7f388011dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.939+0000 7f3887ecc700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3880131ec0 0x7f388011dac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f388009dc10 tx=0x7f3878004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.939+0000 7f3887ecc700 1 -- 172.21.15.154:0/3839962066 shutdown_connections 2023-09-30T22:23:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.939+0000 7f3887ecc700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3880131ec0 0x7f388011dac0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.939+0000 7f3887ecc700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388006a770 0x7f388011d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.939+0000 7f3887ecc700 1 --2- 172.21.15.154:0/3839962066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f388006b080 0x7f388011d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.939+0000 7f3887ecc700 1 -- 172.21.15.154:0/3839962066 >> 172.21.15.154:0/3839962066 conn(0x7f3880099c40 msgr2=0x7f388006fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:04.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.939+0000 7f3887ecc700 1 -- 172.21.15.154:0/3839962066 shutdown_connections 2023-09-30T22:23:04.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.939+0000 7f3887ecc700 1 -- 172.21.15.154:0/3839962066 wait complete. 2023-09-30T22:23:04.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.978+0000 7f08d709b700 1 -- 172.21.15.154:0/3198870396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f08d006e020 con 0x7f08d00a1340 2023-09-30T22:23:04.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.979+0000 7f08cd7fa700 1 -- 172.21.15.154:0/3198870396 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08bc044060 con 0x7f08d00a1340 2023-09-30T22:23:04.979 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.981+0000 7f08d709b700 1 -- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d00a1340 msgr2=0x7f08d011fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.981+0000 7f08d709b700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d00a1340 0x7f08d011fbb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00e980 tx=0x7f08bc00ec90 comp rx=0 tx=0).stop 2023-09-30T22:23:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.981+0000 7f08d709b700 1 -- 172.21.15.154:0/3198870396 shutdown_connections 2023-09-30T22:23:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.981+0000 7f08d709b700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08d01304a0 0x7f08d01200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.981+0000 7f08d709b700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08d00a0a30 0x7f08d011f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.981+0000 7f08d709b700 1 --2- 172.21.15.154:0/3198870396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d00a1340 0x7f08d011fbb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.981+0000 7f08d709b700 1 -- 172.21.15.154:0/3198870396 >> 172.21.15.154:0/3198870396 conn(0x7f08d00a2980 msgr2=0x7f08d01b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.981+0000 7f08d709b700 1 -- 172.21.15.154:0/3198870396 shutdown_connections 2023-09-30T22:23:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:04.981+0000 7f08d709b700 1 -- 172.21.15.154:0/3198870396 wait complete. 2023-09-30T22:23:04.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:05.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.055+0000 7f804e548700 1 -- 172.21.15.154:0/4180518012 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f80480a2770 con 0x7f804809e870 2023-09-30T22:23:05.056 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:05.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.056+0000 7f8044ff9700 1 -- 172.21.15.154:0/4180518012 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8038021090 con 0x7f804809e870 2023-09-30T22:23:05.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.058+0000 7f804e548700 1 -- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804809e870 msgr2=0x7f804812f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.058+0000 7f804e548700 1 --2- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804809e870 0x7f804812f810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f803800ec10 tx=0x7f803800ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:05.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.058+0000 7f804e548700 1 -- 172.21.15.154:0/4180518012 shutdown_connections 2023-09-30T22:23:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.058+0000 7f804e548700 1 --2- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8048131f40 0x7f8048130290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.058+0000 7f804e548700 1 --2- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804809e870 0x7f804812f810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.058+0000 7f804e548700 1 --2- 172.21.15.154:0/4180518012 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804809f180 0x7f804812fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.058+0000 7f804e548700 1 -- 172.21.15.154:0/4180518012 >> 172.21.15.154:0/4180518012 conn(0x7f80480a4430 msgr2=0x7f804806d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.058+0000 7f804e548700 1 -- 172.21.15.154:0/4180518012 shutdown_connections 2023-09-30T22:23:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.058+0000 7f804e548700 1 -- 172.21.15.154:0/4180518012 wait complete. 2023-09-30T22:23:05.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:05.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.096+0000 7f6b10392700 1 -- 172.21.15.154:0/2680508555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6b08072980 con 0x7f6b080a1380 2023-09-30T22:23:05.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.097+0000 7f6afeffd700 1 -- 172.21.15.154:0/2680508555 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6af8017030 con 0x7f6b080a1380 2023-09-30T22:23:05.097 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:05.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.099+0000 7f6b10392700 1 -- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b080a1380 msgr2=0x7f6b08122f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:05.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.099+0000 7f6b10392700 1 --2- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b080a1380 0x7f6b08122f00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6af8000f60 tx=0x7f6af800c730 comp rx=0 tx=0).stop 2023-09-30T22:23:05.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.099+0000 7f6b10392700 1 -- 172.21.15.154:0/2680508555 shutdown_connections 2023-09-30T22:23:05.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.099+0000 7f6b10392700 1 --2- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b08134120 0x7f6b08123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.099+0000 7f6b10392700 1 --2- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b080a0a70 0x7f6b081229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.099+0000 7f6b10392700 1 --2- 172.21.15.154:0/2680508555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b080a1380 0x7f6b08122f00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:05.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.099+0000 7f6b10392700 1 -- 172.21.15.154:0/2680508555 >> 172.21.15.154:0/2680508555 conn(0x7f6b080a6610 msgr2=0x7f6b080a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:05.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.099+0000 7f6b10392700 1 -- 172.21.15.154:0/2680508555 shutdown_connections 2023-09-30T22:23:05.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:05.099+0000 7f6b10392700 1 -- 172.21.15.154:0/2680508555 wait complete. 2023-09-30T22:23:05.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:05.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:05.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:06.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.096+0000 7fdbf1867700 1 Processor -- start 2023-09-30T22:23:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.096+0000 7fdbf1867700 1 -- start start 2023-09-30T22:23:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbf1867700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdbec133a70 0x7fdbec133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbf1867700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a08e0 0x7fdbec0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbf1867700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec0a1290 0x7fdbec13a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbf1867700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbec133640 con 0x7fdbec133a70 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbf1867700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0a1d50 con 0x7fdbec0a1290 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbf1867700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0a1710 con 0x7fdbec0a08e0 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdbec133a70 0x7fdbec133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec0a1290 0x7fdbec13a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdbec133a70 0x7fdbec133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46740/0 (socket says 172.21.15.154:46740) 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeaffd700 1 -- 172.21.15.154:0/3211032104 learned_addr learned my addr 172.21.15.154:0/3211032104 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbea7fc700 1 --2- 172.21.15.154:0/3211032104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a08e0 0x7fdbec0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeb7fe700 1 -- 172.21.15.154:0/3211032104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a08e0 msgr2=0x7fdbec0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeb7fe700 1 --2- 172.21.15.154:0/3211032104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a08e0 0x7fdbec0a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeb7fe700 1 -- 172.21.15.154:0/3211032104 >> v2:172.21.15.154:3300/0 conn(0x7fdbec133a70 msgr2=0x7fdbec133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeb7fe700 1 --2- 172.21.15.154:0/3211032104 >> v2:172.21.15.154:3300/0 conn(0x7fdbec133a70 0x7fdbec133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeb7fe700 1 -- 172.21.15.154:0/3211032104 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec09b620 con 0x7fdbec0a1290 2023-09-30T22:23:06.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.097+0000 7fdbeb7fe700 1 --2- 172.21.15.154:0/3211032104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec0a1290 0x7fdbec13a970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009d90 tx=0x7fdbe400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e6ec8399c7d06a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbe9ffb700 1 -- 172.21.15.154:0/3211032104 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe400e070 con 0x7fdbec0a1290 2023-09-30T22:23:06.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbe9ffb700 1 -- 172.21.15.154:0/3211032104 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe400bb20 con 0x7fdbec0a1290 2023-09-30T22:23:06.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbe9ffb700 1 -- 172.21.15.154:0/3211032104 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4012430 con 0x7fdbec0a1290 2023-09-30T22:23:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbf1867700 1 -- 172.21.15.154:0/3211032104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec0a1290 msgr2=0x7fdbec13a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbf1867700 1 --2- 172.21.15.154:0/3211032104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec0a1290 0x7fdbec13a970 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009d90 tx=0x7fdbe400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbf1867700 1 -- 172.21.15.154:0/3211032104 shutdown_connections 2023-09-30T22:23:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbf1867700 1 --2- 172.21.15.154:0/3211032104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec0a1290 0x7fdbec13a970 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbf1867700 1 --2- 172.21.15.154:0/3211032104 >> v2:172.21.15.154:3300/0 conn(0x7fdbec133a70 0x7fdbec133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbf1867700 1 --2- 172.21.15.154:0/3211032104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a08e0 0x7fdbec0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbf1867700 1 -- 172.21.15.154:0/3211032104 >> 172.21.15.154:0/3211032104 conn(0x7fdbec0a2980 msgr2=0x7fdbec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbf1867700 1 -- 172.21.15.154:0/3211032104 shutdown_connections 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.098+0000 7fdbf1867700 1 -- 172.21.15.154:0/3211032104 wait complete. 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.099+0000 7fdbf1867700 1 Processor -- start 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbf1867700 1 -- start start 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbf1867700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0a08e0 0x7fdbec1c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbf1867700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a1290 0x7fdbec1c1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbf1867700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec133a70 0x7fdbec1c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbf1867700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec09a3c0 con 0x7fdbec0a08e0 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbf1867700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec11ece0 con 0x7fdbec133a70 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbf1867700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec1c1670 con 0x7fdbec0a1290 2023-09-30T22:23:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0a08e0 0x7fdbec1c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbea7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a1290 0x7fdbec1c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0a08e0 0x7fdbec1c0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46752/0 (socket says 172.21.15.154:46752) 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbea7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a1290 0x7fdbec1c1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34562/0 (socket says 172.21.15.154:34562) 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbeaffd700 1 -- 172.21.15.154:0/2646297265 learned_addr learned my addr 172.21.15.154:0/2646297265 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbeaffd700 1 -- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a1290 msgr2=0x7fdbec1c1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbeaffd700 1 --2- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a1290 0x7fdbec1c1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbeaffd700 1 -- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec133a70 msgr2=0x7fdbec1c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbeaffd700 1 --2- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec133a70 0x7fdbec1c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbeaffd700 1 -- 172.21.15.154:0/2646297265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4009a70 con 0x7fdbec0a08e0 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.100+0000 7fdbea7fc700 1 --2- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a1290 0x7fdbec1c1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.101+0000 7fdbeaffd700 1 --2- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0a08e0 0x7fdbec1c0bf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00e8c0 tx=0x7fdbdc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.101+0000 7fdbd3fff700 1 -- 172.21.15.154:0/2646297265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc013680 con 0x7fdbec0a08e0 2023-09-30T22:23:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.101+0000 7fdbd3fff700 1 -- 172.21.15.154:0/2646297265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc0137e0 con 0x7fdbec0a08e0 2023-09-30T22:23:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.101+0000 7fdbd3fff700 1 -- 172.21.15.154:0/2646297265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc013b90 con 0x7fdbec0a08e0 2023-09-30T22:23:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.101+0000 7fdbf1867700 1 -- 172.21.15.154:0/2646297265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec11dd80 con 0x7fdbec0a08e0 2023-09-30T22:23:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.101+0000 7fdbf1867700 1 -- 172.21.15.154:0/2646297265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec11d0b0 con 0x7fdbec0a08e0 2023-09-30T22:23:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.102+0000 7fdbd3fff700 1 -- 172.21.15.154:0/2646297265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbdc013cf0 con 0x7fdbec0a08e0 2023-09-30T22:23:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.102+0000 7fdbd3fff700 1 -- 172.21.15.154:0/2646297265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdbdc03f880 con 0x7fdbec0a08e0 2023-09-30T22:23:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.102+0000 7fdbf1867700 1 -- 172.21.15.154:0/2646297265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec11e260 con 0x7fdbec0a08e0 2023-09-30T22:23:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.107+0000 7fdbd3fff700 1 -- 172.21.15.154:0/2646297265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbdc017080 con 0x7fdbec0a08e0 2023-09-30T22:23:06.112 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:06.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.132+0000 7fb4271c2700 1 Processor -- start 2023-09-30T22:23:06.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.132+0000 7fb4271c2700 1 -- start start 2023-09-30T22:23:06.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.132+0000 7fb4271c2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb42009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb4271c2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb420131f40 0x7fb420139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb4271c2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42009c970 con 0x7fb42009f180 2023-09-30T22:23:06.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb4271c2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4200a0920 con 0x7fb420131f40 2023-09-30T22:23:06.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb4271c2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb42009f9c0 con 0x7fb42009e870 2023-09-30T22:23:06.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb41ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb42009f180 0x7fb420131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41982/0 (socket says 172.21.15.154:41982) 2023-09-30T22:23:06.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb41ffff700 1 -- 172.21.15.154:0/1018336655 learned_addr learned my addr 172.21.15.154:0/1018336655 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:06.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb424f5e700 1 --2- 172.21.15.154:0/1018336655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb42009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb41f7fe700 1 -- 172.21.15.154:0/1018336655 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216714533 0 0) 0x7fb42009c970 con 0x7fb42009f180 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb41f7fe700 1 -- 172.21.15.154:0/1018336655 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4100035b0 con 0x7fb42009f180 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb424f5e700 1 -- 172.21.15.154:0/1018336655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb420131f40 msgr2=0x7fb420139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb424f5e700 1 --2- 172.21.15.154:0/1018336655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb420131f40 0x7fb420139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb424f5e700 1 -- 172.21.15.154:0/1018336655 >> v1:172.21.15.154:6789/0 conn(0x7fb42009f180 legacy=0x7fb420131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb424f5e700 1 -- 172.21.15.154:0/1018336655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42009bab0 con 0x7fb42009e870 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.133+0000 7fb424f5e700 1 --2- 172.21.15.154:0/1018336655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb42009ec40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb414009870 tx=0x7fb414009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97822c2f683f7b2f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.134+0000 7fb41f7fe700 1 -- 172.21.15.154:0/1018336655 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414011830 con 0x7fb42009e870 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.134+0000 7fb41f7fe700 1 -- 172.21.15.154:0/1018336655 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414011990 con 0x7fb42009e870 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.134+0000 7fb41f7fe700 1 -- 172.21.15.154:0/1018336655 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414011d20 con 0x7fb42009e870 2023-09-30T22:23:06.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.134+0000 7fb4271c2700 1 -- 172.21.15.154:0/1018336655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 msgr2=0x7fb42009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.134+0000 7fb4271c2700 1 --2- 172.21.15.154:0/1018336655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb42009ec40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb414009870 tx=0x7fb414009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.134+0000 7fb4271c2700 1 -- 172.21.15.154:0/1018336655 shutdown_connections 2023-09-30T22:23:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.134+0000 7fb4271c2700 1 --2- 172.21.15.154:0/1018336655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb420131f40 0x7fb420139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.134+0000 7fb4271c2700 1 --2- 172.21.15.154:0/1018336655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb42009ec40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.134+0000 7fb4271c2700 1 -- 172.21.15.154:0/1018336655 >> 172.21.15.154:0/1018336655 conn(0x7fb4200a4430 msgr2=0x7fb4200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.136+0000 7fb4271c2700 1 -- 172.21.15.154:0/1018336655 shutdown_connections 2023-09-30T22:23:06.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.136+0000 7fb4271c2700 1 -- 172.21.15.154:0/1018336655 wait complete. 2023-09-30T22:23:06.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.138+0000 7fb4271c2700 1 Processor -- start 2023-09-30T22:23:06.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.138+0000 7fb4271c2700 1 -- start start 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.138+0000 7fb4271c2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb420135fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.138+0000 7fb4271c2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42009f180 0x7fb4201364e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.138+0000 7fb4271c2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb420131f40 0x7fb420136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.138+0000 7fb4271c2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb420131630 con 0x7fb42009f180 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.138+0000 7fb4271c2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4200a2550 con 0x7fb420131f40 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.138+0000 7fb4271c2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb420139520 con 0x7fb42009e870 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb41ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42009f180 0x7fb4201364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb41ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42009f180 0x7fb4201364e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46766/0 (socket says 172.21.15.154:46766) 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb41ffff700 1 -- 172.21.15.154:0/4254504275 learned_addr learned my addr 172.21.15.154:0/4254504275 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:06.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb42575f700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb420131f40 0x7fb420136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb424f5e700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb420135fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb41ffff700 1 -- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 msgr2=0x7fb420135fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb41ffff700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb420135fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb41ffff700 1 -- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb420131f40 msgr2=0x7fb420136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb41ffff700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb420131f40 0x7fb420136a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb41ffff700 1 -- 172.21.15.154:0/4254504275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140094a0 con 0x7fb42009f180 2023-09-30T22:23:06.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb424f5e700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb420135fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:06.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.139+0000 7fb41ffff700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42009f180 0x7fb4201364e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005910 tx=0x7fb40c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.140+0000 7fb41d7fa700 1 -- 172.21.15.154:0/4254504275 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c005d70 con 0x7fb42009f180 2023-09-30T22:23:06.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.140+0000 7fb41d7fa700 1 -- 172.21.15.154:0/4254504275 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c0070d0 con 0x7fb42009f180 2023-09-30T22:23:06.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.140+0000 7fb41d7fa700 1 -- 172.21.15.154:0/4254504275 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c007460 con 0x7fb42009f180 2023-09-30T22:23:06.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.140+0000 7fb4271c2700 1 -- 172.21.15.154:0/4254504275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb420138160 con 0x7fb42009f180 2023-09-30T22:23:06.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.140+0000 7fb4271c2700 1 -- 172.21.15.154:0/4254504275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb420139250 con 0x7fb42009f180 2023-09-30T22:23:06.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.141+0000 7fb41d7fa700 1 -- 172.21.15.154:0/4254504275 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb40c0075c0 con 0x7fb42009f180 2023-09-30T22:23:06.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.141+0000 7fb41d7fa700 1 -- 172.21.15.154:0/4254504275 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb40c03eaf0 con 0x7fb42009f180 2023-09-30T22:23:06.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.141+0000 7fb4271c2700 1 -- 172.21.15.154:0/4254504275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb420138400 con 0x7fb42009f180 2023-09-30T22:23:06.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.146+0000 7fb41d7fa700 1 -- 172.21.15.154:0/4254504275 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb40c017080 con 0x7fb42009f180 2023-09-30T22:23:06.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.234+0000 7f29d5e0e700 1 Processor -- start 2023-09-30T22:23:06.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.234+0000 7f29d5e0e700 1 -- start start 2023-09-30T22:23:06.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.234+0000 7f29d5e0e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29d009dec0 0x7f29d006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.234+0000 7f29d5e0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d0136cb0 0x7f29d0139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.234+0000 7f29d5e0e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d006e900 con 0x7f29d006a770 2023-09-30T22:23:06.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.234+0000 7f29d5e0e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d009d180 con 0x7f29d009dec0 2023-09-30T22:23:06.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.234+0000 7f29d5e0e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d009e780 con 0x7f29d0136cb0 2023-09-30T22:23:06.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ceffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29d009dec0 0x7f29d006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29cf7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f29d006a770 0x7f29d006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41994/0 (socket says 172.21.15.154:41994) 2023-09-30T22:23:06.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ceffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29d009dec0 0x7f29d006b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46778/0 (socket says 172.21.15.154:46778) 2023-09-30T22:23:06.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29cf7fe700 1 -- 172.21.15.154:0/1587576204 learned_addr learned my addr 172.21.15.154:0/1587576204 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:06.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ceffd700 1 -- 172.21.15.154:0/1587576204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d0136cb0 msgr2=0x7f29d0139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ceffd700 1 --2- 172.21.15.154:0/1587576204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d0136cb0 0x7f29d0139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ceffd700 1 -- 172.21.15.154:0/1587576204 >> v1:172.21.15.154:6789/0 conn(0x7f29d006a770 legacy=0x7f29d006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ceffd700 1 -- 172.21.15.154:0/1587576204 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d009d3c0 con 0x7f29d009dec0 2023-09-30T22:23:06.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ceffd700 1 --2- 172.21.15.154:0/1587576204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d009dec0 0x7f29d006b250 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009840 tx=0x7f29c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28072f1b3f5822f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ce7fc700 1 -- 172.21.15.154:0/1587576204 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4011830 con 0x7f29d009dec0 2023-09-30T22:23:06.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ce7fc700 1 -- 172.21.15.154:0/1587576204 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4011990 con 0x7f29d009dec0 2023-09-30T22:23:06.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.235+0000 7f29ce7fc700 1 -- 172.21.15.154:0/1587576204 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4011d20 con 0x7f29d009dec0 2023-09-30T22:23:06.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.236+0000 7f29d5e0e700 1 -- 172.21.15.154:0/1587576204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d009dec0 msgr2=0x7f29d006b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.236+0000 7f29d5e0e700 1 --2- 172.21.15.154:0/1587576204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d009dec0 0x7f29d006b250 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009840 tx=0x7f29c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:06.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.236+0000 7f29d5e0e700 1 -- 172.21.15.154:0/1587576204 shutdown_connections 2023-09-30T22:23:06.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.236+0000 7f29d5e0e700 1 --2- 172.21.15.154:0/1587576204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d0136cb0 0x7f29d0139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.236+0000 7f29d5e0e700 1 --2- 172.21.15.154:0/1587576204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d009dec0 0x7f29d006b250 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.236+0000 7f29d5e0e700 1 -- 172.21.15.154:0/1587576204 >> 172.21.15.154:0/1587576204 conn(0x7f29d0099c40 msgr2=0x7f29d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.236+0000 7f29d5e0e700 1 -- 172.21.15.154:0/1587576204 shutdown_connections 2023-09-30T22:23:06.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.236+0000 7f29d5e0e700 1 -- 172.21.15.154:0/1587576204 wait complete. 2023-09-30T22:23:06.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.237+0000 7f29d5e0e700 1 Processor -- start 2023-09-30T22:23:06.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29d5e0e700 1 -- start start 2023-09-30T22:23:06.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29d5e0e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29d006a770 0x7f29d009a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29d5e0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d009dec0 0x7f29d009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29d5e0e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d0136cb0 0x7f29d009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29d5e0e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0071d50 con 0x7f29d0136cb0 2023-09-30T22:23:06.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29d5e0e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d0131310 con 0x7f29d009dec0 2023-09-30T22:23:06.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29d5e0e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d01358c0 con 0x7f29d006a770 2023-09-30T22:23:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29cf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29d006a770 0x7f29d009a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29cffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d0136cb0 0x7f29d009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29cf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29d006a770 0x7f29d009a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34590/0 (socket says 172.21.15.154:34590) 2023-09-30T22:23:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29cf7fe700 1 -- 172.21.15.154:0/3558397024 learned_addr learned my addr 172.21.15.154:0/3558397024 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29ceffd700 1 --2- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d009dec0 0x7f29d009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29cffff700 1 -- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29d006a770 msgr2=0x7f29d009a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.238+0000 7f29cffff700 1 --2- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29d006a770 0x7f29d009a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29cffff700 1 -- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d009dec0 msgr2=0x7f29d009a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29cffff700 1 --2- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d009dec0 0x7f29d009a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29cffff700 1 -- 172.21.15.154:0/3558397024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40094a0 con 0x7f29d0136cb0 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29ceffd700 1 --2- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d009dec0 0x7f29d009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29cffff700 1 --2- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d0136cb0 0x7f29d009af10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f29c800be20 tx=0x7f29c8009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29b7fff700 1 -- 172.21.15.154:0/3558397024 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c800cb90 con 0x7f29d0136cb0 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29b7fff700 1 -- 172.21.15.154:0/3558397024 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c800cd10 con 0x7f29d0136cb0 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29d5e0e700 1 -- 172.21.15.154:0/3558397024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d0135b80 con 0x7f29d0136cb0 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29b7fff700 1 -- 172.21.15.154:0/3558397024 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8014680 con 0x7f29d0136cb0 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.239+0000 7f29d5e0e700 1 -- 172.21.15.154:0/3558397024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d01365f0 con 0x7f29d0136cb0 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.240+0000 7f29b7fff700 1 -- 172.21.15.154:0/3558397024 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29c801d3b0 con 0x7f29d0136cb0 2023-09-30T22:23:06.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.240+0000 7f29b7fff700 1 -- 172.21.15.154:0/3558397024 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29c8006e40 con 0x7f29d0136cb0 2023-09-30T22:23:06.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.241+0000 7f29d5e0e700 1 -- 172.21.15.154:0/3558397024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d004f2a0 con 0x7f29d0136cb0 2023-09-30T22:23:06.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.246+0000 7f9d1fc20700 1 Processor -- start 2023-09-30T22:23:06.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.246+0000 7f9d1fc20700 1 -- start start 2023-09-30T22:23:06.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1fc20700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18133660 0x7f9d18135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1fc20700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d18135f80 0x7f9d18138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1fc20700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d18099a60 con 0x7f9d18099e20 2023-09-30T22:23:06.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1fc20700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1809bf50 con 0x7f9d18135f80 2023-09-30T22:23:06.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1fc20700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1809b230 con 0x7f9d18133660 2023-09-30T22:23:06.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1d1bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18133660 0x7f9d18135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1d9bc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9d18099e20 0x7f9d1809a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42010/0 (socket says 172.21.15.154:42010) 2023-09-30T22:23:06.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1d1bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18133660 0x7f9d18135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34594/0 (socket says 172.21.15.154:34594) 2023-09-30T22:23:06.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1d9bc700 1 -- 172.21.15.154:0/2271528616 learned_addr learned my addr 172.21.15.154:0/2271528616 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:06.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1d1bb700 1 -- 172.21.15.154:0/2271528616 >> v2:172.21.15.154:3300/0 conn(0x7f9d18135f80 msgr2=0x7f9d18138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:06.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1d1bb700 1 --2- 172.21.15.154:0/2271528616 >> v2:172.21.15.154:3300/0 conn(0x7f9d18135f80 0x7f9d18138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1d1bb700 1 -- 172.21.15.154:0/2271528616 >> v1:172.21.15.154:6789/0 conn(0x7f9d18099e20 legacy=0x7f9d1809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1d1bb700 1 -- 172.21.15.154:0/2271528616 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1809bb90 con 0x7f9d18133660 2023-09-30T22:23:06.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.247+0000 7f9d1d1bb700 1 --2- 172.21.15.154:0/2271528616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18133660 0x7f9d18135a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009870 tx=0x7f9d08009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3c3404e605c8e5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f9d1c9ba700 1 -- 172.21.15.154:0/2271528616 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08011830 con 0x7f9d18133660 2023-09-30T22:23:06.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f9d1c9ba700 1 -- 172.21.15.154:0/2271528616 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08011990 con 0x7f9d18133660 2023-09-30T22:23:06.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f9d1c9ba700 1 -- 172.21.15.154:0/2271528616 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08011d20 con 0x7f9d18133660 2023-09-30T22:23:06.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f29b7fff700 1 -- 172.21.15.154:0/3558397024 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29c8019080 con 0x7f29d0136cb0 2023-09-30T22:23:06.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f9d1fc20700 1 -- 172.21.15.154:0/2271528616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18133660 msgr2=0x7f9d18135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f9d1fc20700 1 --2- 172.21.15.154:0/2271528616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18133660 0x7f9d18135a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009870 tx=0x7f9d08009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:06.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f9d1fc20700 1 -- 172.21.15.154:0/2271528616 shutdown_connections 2023-09-30T22:23:06.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f9d1fc20700 1 --2- 172.21.15.154:0/2271528616 >> v2:172.21.15.154:3300/0 conn(0x7f9d18135f80 0x7f9d18138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f9d1fc20700 1 --2- 172.21.15.154:0/2271528616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18133660 0x7f9d18135a40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.248+0000 7f9d1fc20700 1 -- 172.21.15.154:0/2271528616 >> 172.21.15.154:0/2271528616 conn(0x7f9d180a2980 msgr2=0x7f9d180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.250+0000 7f9d1fc20700 1 -- 172.21.15.154:0/2271528616 shutdown_connections 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.250+0000 7f9d1fc20700 1 -- 172.21.15.154:0/2271528616 wait complete. 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1fc20700 1 Processor -- start 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1fc20700 1 -- start start 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1fc20700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18099e20 0x7f9d180700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1fc20700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d18133660 0x7f9d18070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1fc20700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d18135f80 0x7f9d18070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1fc20700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1809b470 con 0x7f9d18135f80 2023-09-30T22:23:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1fc20700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d18119c50 con 0x7f9d18133660 2023-09-30T22:23:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1fc20700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1811a300 con 0x7f9d18099e20 2023-09-30T22:23:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1e1bd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d18135f80 0x7f9d18070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1e1bd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d18135f80 0x7f9d18070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46800/0 (socket says 172.21.15.154:46800) 2023-09-30T22:23:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.251+0000 7f9d1e1bd700 1 -- 172.21.15.154:0/979809538 learned_addr learned my addr 172.21.15.154:0/979809538 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d1e1bd700 1 -- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18099e20 msgr2=0x7f9d180700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d1e1bd700 1 --2- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18099e20 0x7f9d180700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d1e1bd700 1 -- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d18133660 msgr2=0x7f9d18070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d1e1bd700 1 --2- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d18133660 0x7f9d18070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d1e1bd700 1 -- 172.21.15.154:0/979809538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d080094a0 con 0x7f9d18135f80 2023-09-30T22:23:06.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d1e1bd700 1 --2- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d18135f80 0x7f9d18070b70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b9e0 tx=0x7f9d1000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:06.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d0e7fc700 1 -- 172.21.15.154:0/979809538 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000c9b0 con 0x7f9d18135f80 2023-09-30T22:23:06.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d0e7fc700 1 -- 172.21.15.154:0/979809538 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1000cb30 con 0x7f9d18135f80 2023-09-30T22:23:06.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d0e7fc700 1 -- 172.21.15.154:0/979809538 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d10014440 con 0x7f9d18135f80 2023-09-30T22:23:06.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d1fc20700 1 -- 172.21.15.154:0/979809538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d18119790 con 0x7f9d18135f80 2023-09-30T22:23:06.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.252+0000 7f9d1fc20700 1 -- 172.21.15.154:0/979809538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1811a8a0 con 0x7f9d18135f80 2023-09-30T22:23:06.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.253+0000 7f9d0e7fc700 1 -- 172.21.15.154:0/979809538 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d1001d3b0 con 0x7f9d18135f80 2023-09-30T22:23:06.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.253+0000 7f9d1fc20700 1 -- 172.21.15.154:0/979809538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1804f2a0 con 0x7f9d18135f80 2023-09-30T22:23:06.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.254+0000 7f9d0e7fc700 1 -- 172.21.15.154:0/979809538 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d10006e40 con 0x7f9d18135f80 2023-09-30T22:23:06.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.262+0000 7f9d0e7fc700 1 -- 172.21.15.154:0/979809538 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d10019030 con 0x7f9d18135f80 2023-09-30T22:23:06.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.314+0000 7fdbf1867700 1 -- 172.21.15.154:0/2646297265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdbec04f2a0 con 0x7fdbec0a08e0 2023-09-30T22:23:06.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.314+0000 7fdbd3fff700 1 -- 172.21.15.154:0/2646297265 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbdc021020 con 0x7fdbec0a08e0 2023-09-30T22:23:06.314 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.316+0000 7fdbf1867700 1 -- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0a08e0 msgr2=0x7fdbec1c0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.316+0000 7fdbf1867700 1 --2- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0a08e0 0x7fdbec1c0bf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00e8c0 tx=0x7fdbdc00ebd0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.316+0000 7fdbf1867700 1 -- 172.21.15.154:0/2646297265 shutdown_connections 2023-09-30T22:23:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.316+0000 7fdbf1867700 1 --2- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbec133a70 0x7fdbec1c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.316+0000 7fdbf1867700 1 --2- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbec0a08e0 0x7fdbec1c0bf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.316+0000 7fdbf1867700 1 --2- 172.21.15.154:0/2646297265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdbec0a1290 0x7fdbec1c1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.316+0000 7fdbf1867700 1 -- 172.21.15.154:0/2646297265 >> 172.21.15.154:0/2646297265 conn(0x7fdbec0a2980 msgr2=0x7fdbec131540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.316+0000 7fdbf1867700 1 -- 172.21.15.154:0/2646297265 shutdown_connections 2023-09-30T22:23:06.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.316+0000 7fdbf1867700 1 -- 172.21.15.154:0/2646297265 wait complete. 2023-09-30T22:23:06.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:06.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.393+0000 7fb4271c2700 1 -- 172.21.15.154:0/4254504275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb42004f2a0 con 0x7fb42009f180 2023-09-30T22:23:06.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.394+0000 7fb41d7fa700 1 -- 172.21.15.154:0/4254504275 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb40c00f260 con 0x7fb42009f180 2023-09-30T22:23:06.394 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:06.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.396+0000 7fb4271c2700 1 -- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42009f180 msgr2=0x7fb4201364e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.396+0000 7fb4271c2700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42009f180 0x7fb4201364e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005910 tx=0x7fb40c00c9e0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.396+0000 7fb4271c2700 1 -- 172.21.15.154:0/4254504275 shutdown_connections 2023-09-30T22:23:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.396+0000 7fb4271c2700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb420131f40 0x7fb420136a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.396+0000 7fb4271c2700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb42009e870 0x7fb420135fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.396+0000 7fb4271c2700 1 --2- 172.21.15.154:0/4254504275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42009f180 0x7fb4201364e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.396+0000 7fb4271c2700 1 -- 172.21.15.154:0/4254504275 >> 172.21.15.154:0/4254504275 conn(0x7fb4200a4430 msgr2=0x7fb4200677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.396+0000 7fb4271c2700 1 -- 172.21.15.154:0/4254504275 shutdown_connections 2023-09-30T22:23:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.396+0000 7fb4271c2700 1 -- 172.21.15.154:0/4254504275 wait complete. 2023-09-30T22:23:06.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.456+0000 7f29d5e0e700 1 -- 172.21.15.154:0/3558397024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f29d009e3a0 con 0x7f29d0136cb0 2023-09-30T22:23:06.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.457+0000 7f29b7fff700 1 -- 172.21.15.154:0/3558397024 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29c801c360 con 0x7f29d0136cb0 2023-09-30T22:23:06.457 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.459+0000 7f29d5e0e700 1 -- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d0136cb0 msgr2=0x7f29d009af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.459+0000 7f29d5e0e700 1 --2- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d0136cb0 0x7f29d009af10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f29c800be20 tx=0x7f29c8009ed0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.459+0000 7f29d5e0e700 1 -- 172.21.15.154:0/3558397024 shutdown_connections 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.459+0000 7f29d5e0e700 1 --2- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29d0136cb0 0x7f29d009af10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.459+0000 7f29d5e0e700 1 --2- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29d006a770 0x7f29d009a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.459+0000 7f29d5e0e700 1 --2- 172.21.15.154:0/3558397024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29d009dec0 0x7f29d009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.459+0000 7f29d5e0e700 1 -- 172.21.15.154:0/3558397024 >> 172.21.15.154:0/3558397024 conn(0x7f29d0099c40 msgr2=0x7f29d00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.459+0000 7f29d5e0e700 1 -- 172.21.15.154:0/3558397024 shutdown_connections 2023-09-30T22:23:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.459+0000 7f29d5e0e700 1 -- 172.21.15.154:0/3558397024 wait complete. 2023-09-30T22:23:06.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:06.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.471+0000 7f9d1fc20700 1 -- 172.21.15.154:0/979809538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d1811a4c0 con 0x7f9d18135f80 2023-09-30T22:23:06.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.472+0000 7f9d0e7fc700 1 -- 172.21.15.154:0/979809538 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d1001c360 con 0x7f9d18135f80 2023-09-30T22:23:06.472 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:06.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.474+0000 7f9d1fc20700 1 -- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d18135f80 msgr2=0x7f9d18070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:06.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.474+0000 7f9d1fc20700 1 --2- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d18135f80 0x7f9d18070b70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000b9e0 tx=0x7f9d1000bda0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.474+0000 7f9d1fc20700 1 -- 172.21.15.154:0/979809538 shutdown_connections 2023-09-30T22:23:06.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.474+0000 7f9d1fc20700 1 --2- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d18135f80 0x7f9d18070b70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.474+0000 7f9d1fc20700 1 --2- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d18099e20 0x7f9d180700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.474+0000 7f9d1fc20700 1 --2- 172.21.15.154:0/979809538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d18133660 0x7f9d18070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:06.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.474+0000 7f9d1fc20700 1 -- 172.21.15.154:0/979809538 >> 172.21.15.154:0/979809538 conn(0x7f9d180a2980 msgr2=0x7f9d181324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:06.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.474+0000 7f9d1fc20700 1 -- 172.21.15.154:0/979809538 shutdown_connections 2023-09-30T22:23:06.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:06.474+0000 7f9d1fc20700 1 -- 172.21.15.154:0/979809538 wait complete. 2023-09-30T22:23:06.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:07.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:07.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:07.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.468+0000 7f865461e700 1 Processor -- start 2023-09-30T22:23:07.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.468+0000 7f865461e700 1 -- start start 2023-09-30T22:23:07.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f865461e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f865461e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f864c0a1380 0x7f864c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f865461e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 0x7f864c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f865461e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c09e9d0 con 0x7f864c0a1380 2023-09-30T22:23:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f865461e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c09dc00 con 0x7f864c0a0a70 2023-09-30T22:23:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f865461e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864c09dec0 con 0x7f864c133f50 2023-09-30T22:23:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8651bb9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f864c0a1380 0x7f864c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f86523ba700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8651bb9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f864c0a1380 0x7f864c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46810/0 (socket says 172.21.15.154:46810) 2023-09-30T22:23:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8651bb9700 1 -- 172.21.15.154:0/151669797 learned_addr learned my addr 172.21.15.154:0/151669797 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f86523ba700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58014/0 (socket says 172.21.15.154:58014) 2023-09-30T22:23:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8652bbb700 1 --2- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 0x7f864c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8651bb9700 1 -- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 msgr2=0x7f864c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8651bb9700 1 --2- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 0x7f864c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8651bb9700 1 -- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 msgr2=0x7f864c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8651bb9700 1 --2- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8651bb9700 1 -- 172.21.15.154:0/151669797 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c09e6a0 con 0x7f864c0a1380 2023-09-30T22:23:07.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f86523ba700 1 --2- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:07.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f8651bb9700 1 --2- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 0x7f864c133a10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f863c0098f0 tx=0x7f863c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c389094da58137 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f86513b8700 1 -- 172.21.15.154:0/151669797 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c011830 con 0x7f864c0a1380 2023-09-30T22:23:07.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f86513b8700 1 -- 172.21.15.154:0/151669797 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c011990 con 0x7f864c0a1380 2023-09-30T22:23:07.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.469+0000 7f86513b8700 1 -- 172.21.15.154:0/151669797 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c011d20 con 0x7f864c0a1380 2023-09-30T22:23:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.470+0000 7f865461e700 1 -- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 msgr2=0x7f864c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.470+0000 7f865461e700 1 --2- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 0x7f864c133a10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f863c0098f0 tx=0x7f863c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.470+0000 7f865461e700 1 -- 172.21.15.154:0/151669797 shutdown_connections 2023-09-30T22:23:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.470+0000 7f865461e700 1 --2- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.470+0000 7f865461e700 1 --2- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 0x7f864c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.470+0000 7f865461e700 1 --2- 172.21.15.154:0/151669797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 0x7f864c133a10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.470+0000 7f865461e700 1 -- 172.21.15.154:0/151669797 >> 172.21.15.154:0/151669797 conn(0x7f864c0a6610 msgr2=0x7f864c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.470+0000 7f865461e700 1 -- 172.21.15.154:0/151669797 shutdown_connections 2023-09-30T22:23:07.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.471+0000 7f865461e700 1 -- 172.21.15.154:0/151669797 wait complete. 2023-09-30T22:23:07.476 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:07.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.472+0000 7f865461e700 1 Processor -- start 2023-09-30T22:23:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.472+0000 7f865461e700 1 -- start start 2023-09-30T22:23:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f865461e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c11f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f865461e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 0x7f864c11f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f865461e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 0x7f864c11ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f865461e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1214e0 con 0x7f864c0a1380 2023-09-30T22:23:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f865461e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c122780 con 0x7f864c0a0a70 2023-09-30T22:23:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f865461e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0a03e0 con 0x7f864c133f50 2023-09-30T22:23:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8651bb9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 0x7f864c11f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f86523ba700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c11f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8651bb9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 0x7f864c11f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46818/0 (socket says 172.21.15.154:46818) 2023-09-30T22:23:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8651bb9700 1 -- 172.21.15.154:0/2306043027 learned_addr learned my addr 172.21.15.154:0/2306043027 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8652bbb700 1 --2- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 0x7f864c11ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8651bb9700 1 -- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 msgr2=0x7f864c11ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8651bb9700 1 --2- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 0x7f864c11ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8651bb9700 1 -- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 msgr2=0x7f864c11f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8651bb9700 1 --2- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c11f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8651bb9700 1 -- 172.21.15.154:0/2306043027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86480094a0 con 0x7f864c0a1380 2023-09-30T22:23:07.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f86523ba700 1 --2- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c11f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:07.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8651bb9700 1 --2- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 0x7f864c11f9c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f863c000c00 tx=0x7f863c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8642ffd700 1 -- 172.21.15.154:0/2306043027 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c004240 con 0x7f864c0a1380 2023-09-30T22:23:07.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8642ffd700 1 -- 172.21.15.154:0/2306043027 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c01f070 con 0x7f864c0a1380 2023-09-30T22:23:07.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f865461e700 1 -- 172.21.15.154:0/2306043027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c009550 con 0x7f864c0a1380 2023-09-30T22:23:07.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f8642ffd700 1 -- 172.21.15.154:0/2306043027 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0045e0 con 0x7f864c0a1380 2023-09-30T22:23:07.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.473+0000 7f865461e700 1 -- 172.21.15.154:0/2306043027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c122970 con 0x7f864c0a1380 2023-09-30T22:23:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.474+0000 7f8642ffd700 1 -- 172.21.15.154:0/2306043027 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f863c021030 con 0x7f864c0a1380 2023-09-30T22:23:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.474+0000 7f8642ffd700 1 -- 172.21.15.154:0/2306043027 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f863c040850 con 0x7f864c0a1380 2023-09-30T22:23:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.474+0000 7f865461e700 1 -- 172.21.15.154:0/2306043027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c132280 con 0x7f864c0a1380 2023-09-30T22:23:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.479+0000 7f8642ffd700 1 -- 172.21.15.154:0/2306043027 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f863c015030 con 0x7f864c0a1380 2023-09-30T22:23:07.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:07.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.541+0000 7fd8611d9700 1 Processor -- start 2023-09-30T22:23:07.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd8611d9700 1 -- start start 2023-09-30T22:23:07.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd8611d9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 0x7fd85c130b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd8611d9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c1310b0 0x7fd85c12f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd8611d9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd85c06d7f0 0x7fd85c12f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd8611d9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c130630 con 0x7fd85c06d7f0 2023-09-30T22:23:07.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd8611d9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c06dcd0 con 0x7fd85c1307a0 2023-09-30T22:23:07.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd8611d9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c06eb40 con 0x7fd85c1310b0 2023-09-30T22:23:07.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd85a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c1310b0 0x7fd85c12f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd85a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c1310b0 0x7fd85c12f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34638/0 (socket says 172.21.15.154:34638) 2023-09-30T22:23:07.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd85a59c700 1 -- 172.21.15.154:0/781746530 learned_addr learned my addr 172.21.15.154:0/781746530 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:07.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.542+0000 7fd85b59e700 1 --2- 172.21.15.154:0/781746530 >> v2:172.21.15.154:3300/0 conn(0x7fd85c06d7f0 0x7fd85c12f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd85ad9d700 1 --2- 172.21.15.154:0/781746530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 0x7fd85c130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd85a59c700 1 -- 172.21.15.154:0/781746530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 msgr2=0x7fd85c130b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd85a59c700 1 --2- 172.21.15.154:0/781746530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 0x7fd85c130b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd85a59c700 1 -- 172.21.15.154:0/781746530 >> v2:172.21.15.154:3300/0 conn(0x7fd85c06d7f0 msgr2=0x7fd85c12f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd85a59c700 1 --2- 172.21.15.154:0/781746530 >> v2:172.21.15.154:3300/0 conn(0x7fd85c06d7f0 0x7fd85c12f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd85a59c700 1 -- 172.21.15.154:0/781746530 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c06df80 con 0x7fd85c1310b0 2023-09-30T22:23:07.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd85a59c700 1 --2- 172.21.15.154:0/781746530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c1310b0 0x7fd85c12f410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd8500098f0 tx=0x7fd850009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=330c3c1b044be877 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd859d9b700 1 -- 172.21.15.154:0/781746530 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850011830 con 0x7fd85c1310b0 2023-09-30T22:23:07.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd859d9b700 1 -- 172.21.15.154:0/781746530 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd850011990 con 0x7fd85c1310b0 2023-09-30T22:23:07.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.543+0000 7fd859d9b700 1 -- 172.21.15.154:0/781746530 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd850011d20 con 0x7fd85c1310b0 2023-09-30T22:23:07.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.544+0000 7fd8611d9700 1 -- 172.21.15.154:0/781746530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c1310b0 msgr2=0x7fd85c12f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.544+0000 7fd8611d9700 1 --2- 172.21.15.154:0/781746530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c1310b0 0x7fd85c12f410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd8500098f0 tx=0x7fd850009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:07.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.544+0000 7fd8611d9700 1 -- 172.21.15.154:0/781746530 shutdown_connections 2023-09-30T22:23:07.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.544+0000 7fd8611d9700 1 --2- 172.21.15.154:0/781746530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 0x7fd85c130b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.544+0000 7fd8611d9700 1 --2- 172.21.15.154:0/781746530 >> v2:172.21.15.154:3300/0 conn(0x7fd85c06d7f0 0x7fd85c12f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.544+0000 7fd8611d9700 1 --2- 172.21.15.154:0/781746530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c1310b0 0x7fd85c12f410 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.544+0000 7fd8611d9700 1 -- 172.21.15.154:0/781746530 >> 172.21.15.154:0/781746530 conn(0x7fd85c0a1ee0 msgr2=0x7fd85c0a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.544+0000 7fd8611d9700 1 -- 172.21.15.154:0/781746530 shutdown_connections 2023-09-30T22:23:07.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.544+0000 7fd8611d9700 1 -- 172.21.15.154:0/781746530 wait complete. 2023-09-30T22:23:07.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.545+0000 7fd8611d9700 1 Processor -- start 2023-09-30T22:23:07.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.545+0000 7fd8611d9700 1 -- start start 2023-09-30T22:23:07.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd8611d9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c06d7f0 0x7fd85c12b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd8611d9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 0x7fd85c12bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd8611d9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1310b0 0x7fd85c12c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd8611d9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c12ddf0 con 0x7fd85c1310b0 2023-09-30T22:23:07.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd8611d9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c12ec30 con 0x7fd85c1307a0 2023-09-30T22:23:07.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd8611d9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c09d100 con 0x7fd85c06d7f0 2023-09-30T22:23:07.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c06d7f0 0x7fd85c12b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c06d7f0 0x7fd85c12b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34652/0 (socket says 172.21.15.154:34652) 2023-09-30T22:23:07.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85ad9d700 1 -- 172.21.15.154:0/2500290662 learned_addr learned my addr 172.21.15.154:0/2500290662 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:07.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85a59c700 1 --2- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 0x7fd85c12bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85b59e700 1 --2- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1310b0 0x7fd85c12c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85ad9d700 1 -- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 msgr2=0x7fd85c12bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85ad9d700 1 --2- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 0x7fd85c12bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85ad9d700 1 -- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1310b0 msgr2=0x7fd85c12c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85ad9d700 1 --2- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1310b0 0x7fd85c12c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.546+0000 7fd85ad9d700 1 -- 172.21.15.154:0/2500290662 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850009550 con 0x7fd85c06d7f0 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.547+0000 7fd85ad9d700 1 --2- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c06d7f0 0x7fd85c12b980 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009f70 tx=0x7fd84c00eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.547+0000 7fd8437fe700 1 -- 172.21.15.154:0/2500290662 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00c070 con 0x7fd85c06d7f0 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.547+0000 7fd8437fe700 1 -- 172.21.15.154:0/2500290662 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c013b20 con 0x7fd85c06d7f0 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.547+0000 7fd8611d9700 1 -- 172.21.15.154:0/2500290662 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c12d590 con 0x7fd85c06d7f0 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.547+0000 7fd8437fe700 1 -- 172.21.15.154:0/2500290662 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c01b3f0 con 0x7fd85c06d7f0 2023-09-30T22:23:07.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.547+0000 7fd8611d9700 1 -- 172.21.15.154:0/2500290662 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c08b970 con 0x7fd85c06d7f0 2023-09-30T22:23:07.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.548+0000 7fd8437fe700 1 -- 172.21.15.154:0/2500290662 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd84c01b550 con 0x7fd85c06d7f0 2023-09-30T22:23:07.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.549+0000 7fd8611d9700 1 -- 172.21.15.154:0/2500290662 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c12e870 con 0x7fd85c06d7f0 2023-09-30T22:23:07.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.549+0000 7fd8437fe700 1 -- 172.21.15.154:0/2500290662 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd84c043130 con 0x7fd85c06d7f0 2023-09-30T22:23:07.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.554+0000 7fd8437fe700 1 -- 172.21.15.154:0/2500290662 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd84c01a3a0 con 0x7fd85c06d7f0 2023-09-30T22:23:07.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.610+0000 7fa4a6bf6700 1 Processor -- start 2023-09-30T22:23:07.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.610+0000 7fa4a6bf6700 1 -- start start 2023-09-30T22:23:07.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.610+0000 7fa4a6bf6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4a009a130 0x7fa4a009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.610+0000 7fa4a6bf6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009edb0 0x7fa4a009f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.610+0000 7fa4a6bf6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a0072b30 con 0x7fa4a013c410 2023-09-30T22:23:07.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.610+0000 7fa4a6bf6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a009a500 con 0x7fa4a009a130 2023-09-30T22:23:07.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.610+0000 7fa4a6bf6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a009f720 con 0x7fa4a009edb0 2023-09-30T22:23:07.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa4a4992700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4a009a130 0x7fa4a009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa49ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009edb0 0x7fa4a009f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa4a4992700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4a009a130 0x7fa4a009e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46848/0 (socket says 172.21.15.154:46848) 2023-09-30T22:23:07.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa4a4992700 1 -- 172.21.15.154:0/2798337543 learned_addr learned my addr 172.21.15.154:0/2798337543 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:07.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa49ffff700 1 -- 172.21.15.154:0/2798337543 >> v2:172.21.15.154:3300/0 conn(0x7fa4a009a130 msgr2=0x7fa4a009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa49ffff700 1 --2- 172.21.15.154:0/2798337543 >> v2:172.21.15.154:3300/0 conn(0x7fa4a009a130 0x7fa4a009e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa49ffff700 1 -- 172.21.15.154:0/2798337543 >> v1:172.21.15.154:6789/0 conn(0x7fa4a013c410 legacy=0x7fa4a013e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa49ffff700 1 -- 172.21.15.154:0/2798337543 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a009fe00 con 0x7fa4a009edb0 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa49ffff700 1 --2- 172.21.15.154:0/2798337543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009edb0 0x7fa4a009f1e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009840 tx=0x7fa48c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=908092078fe66c6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa49f7fe700 1 -- 172.21.15.154:0/2798337543 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c011830 con 0x7fa4a009edb0 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa49f7fe700 1 -- 172.21.15.154:0/2798337543 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c011990 con 0x7fa4a009edb0 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.611+0000 7fa49f7fe700 1 -- 172.21.15.154:0/2798337543 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c011d20 con 0x7fa4a009edb0 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.612+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/2798337543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009edb0 msgr2=0x7fa4a009f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.612+0000 7fa4a6bf6700 1 --2- 172.21.15.154:0/2798337543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009edb0 0x7fa4a009f1e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009840 tx=0x7fa48c009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.612+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/2798337543 shutdown_connections 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.612+0000 7fa4a6bf6700 1 --2- 172.21.15.154:0/2798337543 >> v2:172.21.15.154:3300/0 conn(0x7fa4a009a130 0x7fa4a009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.612+0000 7fa4a6bf6700 1 --2- 172.21.15.154:0/2798337543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009edb0 0x7fa4a009f1e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.612+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/2798337543 >> 172.21.15.154:0/2798337543 conn(0x7fa4a00a4430 msgr2=0x7fa4a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.612+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/2798337543 shutdown_connections 2023-09-30T22:23:07.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.612+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/2798337543 wait complete. 2023-09-30T22:23:07.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.613+0000 7fa4a6bf6700 1 Processor -- start 2023-09-30T22:23:07.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.613+0000 7fa4a6bf6700 1 -- start start 2023-09-30T22:23:07.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a6bf6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009a130 0x7fa4a011b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a6bf6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a009edb0 0x7fa4a011b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a6bf6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a013c410 0x7fa4a011bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a6bf6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a011e580 con 0x7fa4a013c410 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a6bf6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a011d500 con 0x7fa4a009a130 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a6bf6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00a0160 con 0x7fa4a009edb0 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a4992700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009a130 0x7fa4a011b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a4992700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009a130 0x7fa4a011b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58040/0 (socket says 172.21.15.154:58040) 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a4992700 1 -- 172.21.15.154:0/3124358535 learned_addr learned my addr 172.21.15.154:0/3124358535 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.614+0000 7fa4a5193700 1 --2- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a013c410 0x7fa4a011bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa4a4992700 1 -- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a009edb0 msgr2=0x7fa4a011b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa4a4992700 1 --2- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a009edb0 0x7fa4a011b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa4a4992700 1 -- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a013c410 msgr2=0x7fa4a011bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa4a4992700 1 --2- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a013c410 0x7fa4a011bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa4a4992700 1 -- 172.21.15.154:0/3124358535 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0094a0 con 0x7fa4a009a130 2023-09-30T22:23:07.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa4a5193700 1 --2- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a013c410 0x7fa4a011bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:07.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa4a4992700 1 --2- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009a130 0x7fa4a011b370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa49400e8e0 tx=0x7fa49400ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa49d7fa700 1 -- 172.21.15.154:0/3124358535 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494009600 con 0x7fa4a009a130 2023-09-30T22:23:07.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa49d7fa700 1 -- 172.21.15.154:0/3124358535 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa494013680 con 0x7fa4a009a130 2023-09-30T22:23:07.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/3124358535 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a0127640 con 0x7fa4a009a130 2023-09-30T22:23:07.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa49d7fa700 1 -- 172.21.15.154:0/3124358535 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494013a30 con 0x7fa4a009a130 2023-09-30T22:23:07.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.615+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/3124358535 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a00a1700 con 0x7fa4a009a130 2023-09-30T22:23:07.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.616+0000 7fa49d7fa700 1 -- 172.21.15.154:0/3124358535 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa494013b90 con 0x7fa4a009a130 2023-09-30T22:23:07.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.616+0000 7fa49d7fa700 1 -- 172.21.15.154:0/3124358535 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa49403f9d0 con 0x7fa4a009a130 2023-09-30T22:23:07.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.616+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/3124358535 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a004f2a0 con 0x7fa4a009a130 2023-09-30T22:23:07.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.625+0000 7fa49d7fa700 1 -- 172.21.15.154:0/3124358535 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa494017020 con 0x7fa4a009a130 2023-09-30T22:23:07.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.668+0000 7fbb7c7e9700 1 Processor -- start 2023-09-30T22:23:07.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.669+0000 7fbb7c7e9700 1 -- start start 2023-09-30T22:23:07.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.669+0000 7fbb7c7e9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74133900 0x7fbb74133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.669+0000 7fbb7c7e9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74134210 0x7fbb740a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.669+0000 7fbb7c7e9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7409a760 con 0x7fbb740a0ee0 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.669+0000 7fbb7c7e9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb741336e0 con 0x7fbb74133900 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.669+0000 7fbb7c7e9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7409a080 con 0x7fbb74134210 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.669+0000 7fbb7ad86700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbb740a0ee0 0x7fbb7413a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42020/0 (socket says 172.21.15.154:42020) 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.669+0000 7fbb7ad86700 1 -- 172.21.15.154:0/3852228757 learned_addr learned my addr 172.21.15.154:0/3852228757 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.669+0000 7fbb7a585700 1 --2- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74133900 0x7fbb74133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb79d84700 1 --2- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74134210 0x7fbb740a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb7a585700 1 -- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74134210 msgr2=0x7fbb740a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb7a585700 1 --2- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74134210 0x7fbb740a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb7a585700 1 -- 172.21.15.154:0/3852228757 >> v1:172.21.15.154:6789/0 conn(0x7fbb740a0ee0 legacy=0x7fbb7413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb7a585700 1 -- 172.21.15.154:0/3852228757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb740a23e0 con 0x7fbb74133900 2023-09-30T22:23:07.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb79583700 1 -- 172.21.15.154:0/3852228757 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421247358 0 0) 0x7fbb7409a760 con 0x7fbb740a0ee0 2023-09-30T22:23:07.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb79d84700 1 --2- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74134210 0x7fbb740a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb7a585700 1 --2- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74133900 0x7fbb74133cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009850 tx=0x7fbb70009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c38d9e11fed6c3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb79583700 1 -- 172.21.15.154:0/3852228757 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70005e30 con 0x7fbb74133900 2023-09-30T22:23:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb79583700 1 -- 172.21.15.154:0/3852228757 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb70006030 con 0x7fbb74133900 2023-09-30T22:23:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.670+0000 7fbb79583700 1 -- 172.21.15.154:0/3852228757 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700063e0 con 0x7fbb74133900 2023-09-30T22:23:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.671+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74133900 msgr2=0x7fbb74133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.671+0000 7fbb7c7e9700 1 --2- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74133900 0x7fbb74133cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009850 tx=0x7fbb70009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:07.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.671+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3852228757 shutdown_connections 2023-09-30T22:23:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.671+0000 7fbb7c7e9700 1 --2- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74133900 0x7fbb74133cd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.671+0000 7fbb7c7e9700 1 --2- 172.21.15.154:0/3852228757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74134210 0x7fbb740a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.671+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3852228757 >> 172.21.15.154:0/3852228757 conn(0x7fbb740a2980 msgr2=0x7fbb740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.671+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3852228757 shutdown_connections 2023-09-30T22:23:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.671+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3852228757 wait complete. 2023-09-30T22:23:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.672+0000 7fbb7c7e9700 1 Processor -- start 2023-09-30T22:23:07.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.672+0000 7fbb7c7e9700 1 -- start start 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb7c7e9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb740a0ee0 0x7fbb7411d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb7c7e9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74133900 0x7fbb7411dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb7c7e9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74134210 0x7fbb7411e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb7c7e9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb74120a80 con 0x7fbb740a0ee0 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb7c7e9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7411f3a0 con 0x7fbb74134210 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb7c7e9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb74120f30 con 0x7fbb74133900 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb7a585700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb740a0ee0 0x7fbb7411d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb7a585700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb740a0ee0 0x7fbb7411d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46858/0 (socket says 172.21.15.154:46858) 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb7a585700 1 -- 172.21.15.154:0/3796488088 learned_addr learned my addr 172.21.15.154:0/3796488088 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:07.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.673+0000 7fbb79d84700 1 --2- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74133900 0x7fbb7411dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb7ad86700 1 --2- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74134210 0x7fbb7411e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb7a585700 1 -- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74133900 msgr2=0x7fbb7411dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb7a585700 1 --2- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74133900 0x7fbb7411dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb7a585700 1 -- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74134210 msgr2=0x7fbb7411e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb7a585700 1 --2- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74134210 0x7fbb7411e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb7a585700 1 -- 172.21.15.154:0/3796488088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb640094a0 con 0x7fbb740a0ee0 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb7a585700 1 --2- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb740a0ee0 0x7fbb7411d6f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb70013040 tx=0x7fbb70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb6affd700 1 -- 172.21.15.154:0/3796488088 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70006890 con 0x7fbb740a0ee0 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb6affd700 1 -- 172.21.15.154:0/3796488088 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb70020070 con 0x7fbb740a0ee0 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.674+0000 7fbb6affd700 1 -- 172.21.15.154:0/3796488088 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70025650 con 0x7fbb740a0ee0 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.675+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3796488088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb70009430 con 0x7fbb740a0ee0 2023-09-30T22:23:07.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.675+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3796488088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb74132c30 con 0x7fbb740a0ee0 2023-09-30T22:23:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.676+0000 7fbb6affd700 1 -- 172.21.15.154:0/3796488088 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb70022030 con 0x7fbb740a0ee0 2023-09-30T22:23:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.676+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3796488088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7411a590 con 0x7fbb740a0ee0 2023-09-30T22:23:07.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.676+0000 7fbb6affd700 1 -- 172.21.15.154:0/3796488088 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb70040a50 con 0x7fbb740a0ee0 2023-09-30T22:23:07.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.684+0000 7f865461e700 1 -- 172.21.15.154:0/2306043027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f864c04f2a0 con 0x7f864c0a1380 2023-09-30T22:23:07.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.685+0000 7f8642ffd700 1 -- 172.21.15.154:0/2306043027 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f863c01a450 con 0x7f864c0a1380 2023-09-30T22:23:07.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.685+0000 7fbb6affd700 1 -- 172.21.15.154:0/3796488088 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb700247e0 con 0x7fbb740a0ee0 2023-09-30T22:23:07.685 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:07.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.687+0000 7f865461e700 1 -- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 msgr2=0x7f864c11f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.687+0000 7f865461e700 1 --2- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 0x7f864c11f9c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f863c000c00 tx=0x7f863c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:07.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.687+0000 7f865461e700 1 -- 172.21.15.154:0/2306043027 shutdown_connections 2023-09-30T22:23:07.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.687+0000 7f865461e700 1 --2- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f50 0x7f864c11ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.687+0000 7f865461e700 1 --2- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c11f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.687+0000 7f865461e700 1 --2- 172.21.15.154:0/2306043027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c0a1380 0x7f864c11f9c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.687+0000 7f865461e700 1 -- 172.21.15.154:0/2306043027 >> 172.21.15.154:0/2306043027 conn(0x7f864c0a6610 msgr2=0x7f864c0a5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.687+0000 7f865461e700 1 -- 172.21.15.154:0/2306043027 shutdown_connections 2023-09-30T22:23:07.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.687+0000 7f865461e700 1 -- 172.21.15.154:0/2306043027 wait complete. 2023-09-30T22:23:07.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:07.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.757+0000 7fd8611d9700 1 -- 172.21.15.154:0/2500290662 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd85c128740 con 0x7fd85c06d7f0 2023-09-30T22:23:07.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.757+0000 7fd8437fe700 1 -- 172.21.15.154:0/2500290662 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd84c022310 con 0x7fd85c06d7f0 2023-09-30T22:23:07.757 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:07.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.759+0000 7fd8611d9700 1 -- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c06d7f0 msgr2=0x7fd85c12b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.759+0000 7fd8611d9700 1 --2- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c06d7f0 0x7fd85c12b980 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009f70 tx=0x7fd84c00eaf0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.759+0000 7fd8611d9700 1 -- 172.21.15.154:0/2500290662 shutdown_connections 2023-09-30T22:23:07.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.759+0000 7fd8611d9700 1 --2- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1310b0 0x7fd85c12c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.759+0000 7fd8611d9700 1 --2- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd85c06d7f0 0x7fd85c12b980 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.759+0000 7fd8611d9700 1 --2- 172.21.15.154:0/2500290662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd85c1307a0 0x7fd85c12bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.759+0000 7fd8611d9700 1 -- 172.21.15.154:0/2500290662 >> 172.21.15.154:0/2500290662 conn(0x7fd85c0a1ee0 msgr2=0x7fd85c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.759+0000 7fd8611d9700 1 -- 172.21.15.154:0/2500290662 shutdown_connections 2023-09-30T22:23:07.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.760+0000 7fd8611d9700 1 -- 172.21.15.154:0/2500290662 wait complete. 2023-09-30T22:23:07.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:07.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.824+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/3124358535 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa4a006be20 con 0x7fa4a009a130 2023-09-30T22:23:07.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.824+0000 7fa49d7fa700 1 -- 172.21.15.154:0/3124358535 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4940119a0 con 0x7fa4a009a130 2023-09-30T22:23:07.825 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.827+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009a130 msgr2=0x7fa4a011b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.827+0000 7fa4a6bf6700 1 --2- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009a130 0x7fa4a011b370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa49400e8e0 tx=0x7fa49400ebf0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.827+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/3124358535 shutdown_connections 2023-09-30T22:23:07.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.827+0000 7fa4a6bf6700 1 --2- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4a013c410 0x7fa4a011bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.827+0000 7fa4a6bf6700 1 --2- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4a009a130 0x7fa4a011b370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.827+0000 7fa4a6bf6700 1 --2- 172.21.15.154:0/3124358535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4a009edb0 0x7fa4a011b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.827+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/3124358535 >> 172.21.15.154:0/3124358535 conn(0x7fa4a00a4430 msgr2=0x7fa4a013e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.827+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/3124358535 shutdown_connections 2023-09-30T22:23:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.827+0000 7fa4a6bf6700 1 -- 172.21.15.154:0/3124358535 wait complete. 2023-09-30T22:23:07.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:07.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.880+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3796488088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb7404f2a0 con 0x7fbb740a0ee0 2023-09-30T22:23:07.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.880+0000 7fbb6affd700 1 -- 172.21.15.154:0/3796488088 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb7001c410 con 0x7fbb740a0ee0 2023-09-30T22:23:07.880 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.882+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb740a0ee0 msgr2=0x7fbb7411d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.882+0000 7fbb7c7e9700 1 --2- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb740a0ee0 0x7fbb7411d6f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb70013040 tx=0x7fbb70004750 comp rx=0 tx=0).stop 2023-09-30T22:23:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.882+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3796488088 shutdown_connections 2023-09-30T22:23:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.882+0000 7fbb7c7e9700 1 --2- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb74134210 0x7fbb7411e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.882+0000 7fbb7c7e9700 1 --2- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb740a0ee0 0x7fbb7411d6f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.882+0000 7fbb7c7e9700 1 --2- 172.21.15.154:0/3796488088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb74133900 0x7fbb7411dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.882+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3796488088 >> 172.21.15.154:0/3796488088 conn(0x7fbb740a2980 msgr2=0x7fbb741bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.883+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3796488088 shutdown_connections 2023-09-30T22:23:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:07.883+0000 7fbb7c7e9700 1 -- 172.21.15.154:0/3796488088 wait complete. 2023-09-30T22:23:07.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:08.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:08.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:08.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.835+0000 7f4281e64700 1 Processor -- start 2023-09-30T22:23:08.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.835+0000 7f4281e64700 1 -- start start 2023-09-30T22:23:08.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f4281e64700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c0a0a70 0x7f427c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f4281e64700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f427c0a1380 0x7f427c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f4281e64700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c133f50 0x7f427c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f4281e64700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c09e9d0 con 0x7f427c0a1380 2023-09-30T22:23:08.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f4281e64700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c09dc00 con 0x7f427c0a0a70 2023-09-30T22:23:08.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f4281e64700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f427c09dec0 con 0x7f427c133f50 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c133f50 0x7f427c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c0a0a70 0x7f427c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f427c0a1380 0x7f427c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c133f50 0x7f427c134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34702/0 (socket says 172.21.15.154:34702) 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c0a0a70 0x7f427c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58060/0 (socket says 172.21.15.154:58060) 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427bfff700 1 -- 172.21.15.154:0/1970861589 learned_addr learned my addr 172.21.15.154:0/1970861589 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427affd700 1 -- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c133f50 msgr2=0x7f427c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427affd700 1 --2- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c133f50 0x7f427c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427affd700 1 -- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c0a0a70 msgr2=0x7f427c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427affd700 1 --2- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c0a0a70 0x7f427c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427affd700 1 -- 172.21.15.154:0/1970861589 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c09e6a0 con 0x7f427c0a1380 2023-09-30T22:23:08.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.836+0000 7f427b7fe700 1 --2- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c0a0a70 0x7f427c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:08.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f427affd700 1 --2- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f427c0a1380 0x7f427c133a10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4270009840 tx=0x7f4270009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1947d21913501a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:08.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f427a7fc700 1 -- 172.21.15.154:0/1970861589 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270011830 con 0x7f427c0a1380 2023-09-30T22:23:08.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f427a7fc700 1 -- 172.21.15.154:0/1970861589 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4270011990 con 0x7f427c0a1380 2023-09-30T22:23:08.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f427a7fc700 1 -- 172.21.15.154:0/1970861589 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270011d20 con 0x7f427c0a1380 2023-09-30T22:23:08.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f4281e64700 1 -- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f427c0a1380 msgr2=0x7f427c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f4281e64700 1 --2- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f427c0a1380 0x7f427c133a10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4270009840 tx=0x7f4270009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f4281e64700 1 -- 172.21.15.154:0/1970861589 shutdown_connections 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f4281e64700 1 --2- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c0a0a70 0x7f427c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f4281e64700 1 --2- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c133f50 0x7f427c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f4281e64700 1 --2- 172.21.15.154:0/1970861589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f427c0a1380 0x7f427c133a10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f4281e64700 1 -- 172.21.15.154:0/1970861589 >> 172.21.15.154:0/1970861589 conn(0x7f427c0a6610 msgr2=0x7f427c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f4281e64700 1 -- 172.21.15.154:0/1970861589 shutdown_connections 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.837+0000 7f4281e64700 1 -- 172.21.15.154:0/1970861589 wait complete. 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.839+0000 7f4281e64700 1 Processor -- start 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.839+0000 7f4281e64700 1 -- start start 2023-09-30T22:23:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.839+0000 7f4281e64700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f427c0a0a70 0x7f427c11f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4281e64700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c0a1380 0x7f427c11f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4281e64700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c133f50 0x7f427c11ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4281e64700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1214e0 con 0x7f427c0a0a70 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4281e64700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c122780 con 0x7f427c133f50 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4281e64700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0a03e0 con 0x7f427c0a1380 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c133f50 0x7f427c11ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c133f50 0x7f427c11ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58068/0 (socket says 172.21.15.154:58068) 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427bfff700 1 -- 172.21.15.154:0/3535835286 learned_addr learned my addr 172.21.15.154:0/3535835286 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427affd700 1 --2- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c0a1380 0x7f427c11f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427b7fe700 1 --2- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f427c0a0a70 0x7f427c11f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427bfff700 1 -- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c0a1380 msgr2=0x7f427c11f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427bfff700 1 --2- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c0a1380 0x7f427c11f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427bfff700 1 -- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f427c0a0a70 msgr2=0x7f427c11f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427bfff700 1 --2- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f427c0a0a70 0x7f427c11f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427bfff700 1 -- 172.21.15.154:0/3535835286 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0094a0 con 0x7f427c133f50 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f427bfff700 1 --2- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c133f50 0x7f427c11ff00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4274009d90 tx=0x7f427400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4263fff700 1 -- 172.21.15.154:0/3535835286 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274003c20 con 0x7f427c133f50 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4263fff700 1 -- 172.21.15.154:0/3535835286 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427400f040 con 0x7f427c133f50 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4281e64700 1 -- 172.21.15.154:0/3535835286 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42700094a0 con 0x7f427c133f50 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4263fff700 1 -- 172.21.15.154:0/3535835286 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400c880 con 0x7f427c133f50 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.840+0000 7f4281e64700 1 -- 172.21.15.154:0/3535835286 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c122970 con 0x7f427c133f50 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.841+0000 7f4263fff700 1 -- 172.21.15.154:0/3535835286 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f427400c9e0 con 0x7f427c133f50 2023-09-30T22:23:08.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.841+0000 7f4281e64700 1 -- 172.21.15.154:0/3535835286 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c132280 con 0x7f427c133f50 2023-09-30T22:23:08.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.841+0000 7f4263fff700 1 -- 172.21.15.154:0/3535835286 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f427403f8b0 con 0x7f427c133f50 2023-09-30T22:23:08.845 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:08.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.846+0000 7f4263fff700 1 -- 172.21.15.154:0/3535835286 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f427400cc90 con 0x7f427c133f50 2023-09-30T22:23:08.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:08.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.913+0000 7f3670b43700 1 Processor -- start 2023-09-30T22:23:08.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.913+0000 7f3670b43700 1 -- start start 2023-09-30T22:23:08.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.914+0000 7f3670b43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.914+0000 7f3670b43700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f366c130bc0 0x7f366c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.914+0000 7f3670b43700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c06b2d0 con 0x7f366c1300a0 2023-09-30T22:23:08.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.914+0000 7f3670b43700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c133610 con 0x7f366c130bc0 2023-09-30T22:23:08.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.914+0000 7f3670b43700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f366c09a500 con 0x7f366c133ad0 2023-09-30T22:23:08.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.914+0000 7f366a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.914+0000 7f366a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34718/0 (socket says 172.21.15.154:34718) 2023-09-30T22:23:08.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.914+0000 7f366a59c700 1 -- 172.21.15.154:0/2152589938 learned_addr learned my addr 172.21.15.154:0/2152589938 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:08.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.915+0000 7f366a59c700 1 -- 172.21.15.154:0/2152589938 >> v2:172.21.15.154:3300/0 conn(0x7f366c130bc0 msgr2=0x7f366c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:08.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.915+0000 7f366a59c700 1 --2- 172.21.15.154:0/2152589938 >> v2:172.21.15.154:3300/0 conn(0x7f366c130bc0 0x7f366c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.915+0000 7f366a59c700 1 -- 172.21.15.154:0/2152589938 >> v1:172.21.15.154:6789/0 conn(0x7f366c1300a0 legacy=0x7f366c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:08.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.915+0000 7f366a59c700 1 -- 172.21.15.154:0/2152589938 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c1338b0 con 0x7f366c133ad0 2023-09-30T22:23:08.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.915+0000 7f366a59c700 1 --2- 172.21.15.154:0/2152589938 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c133ea0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f365c0098f0 tx=0x7f365c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=992bfc1848b9d13e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:08.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.915+0000 7f366959a700 1 -- 172.21.15.154:0/2152589938 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c004230 con 0x7f366c133ad0 2023-09-30T22:23:08.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.915+0000 7f366959a700 1 -- 172.21.15.154:0/2152589938 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c004390 con 0x7f366c133ad0 2023-09-30T22:23:08.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.915+0000 7f366959a700 1 -- 172.21.15.154:0/2152589938 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0036a0 con 0x7f366c133ad0 2023-09-30T22:23:08.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.916+0000 7f3670b43700 1 -- 172.21.15.154:0/2152589938 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 msgr2=0x7f366c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.916+0000 7f3670b43700 1 --2- 172.21.15.154:0/2152589938 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c133ea0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f365c0098f0 tx=0x7f365c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:08.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.916+0000 7f3670b43700 1 -- 172.21.15.154:0/2152589938 shutdown_connections 2023-09-30T22:23:08.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.916+0000 7f3670b43700 1 --2- 172.21.15.154:0/2152589938 >> v2:172.21.15.154:3300/0 conn(0x7f366c130bc0 0x7f366c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.916+0000 7f3670b43700 1 --2- 172.21.15.154:0/2152589938 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c133ea0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.916+0000 7f3670b43700 1 -- 172.21.15.154:0/2152589938 >> 172.21.15.154:0/2152589938 conn(0x7f366c099c40 msgr2=0x7f366c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:08.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.916+0000 7f3670b43700 1 -- 172.21.15.154:0/2152589938 shutdown_connections 2023-09-30T22:23:08.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.916+0000 7f3670b43700 1 -- 172.21.15.154:0/2152589938 wait complete. 2023-09-30T22:23:08.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.917+0000 7f3670b43700 1 Processor -- start 2023-09-30T22:23:08.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.917+0000 7f3670b43700 1 -- start start 2023-09-30T22:23:08.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3670b43700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f366c1300a0 0x7f366c1cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3670b43700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366c130bc0 0x7f366c1ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3670b43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c1cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3670b43700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c070040 con 0x7f366c130bc0 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3670b43700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c070220 con 0x7f366c1300a0 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3670b43700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f366c12fc60 con 0x7f366c133ad0 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3669d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366c130bc0 0x7f366c1ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3669d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366c130bc0 0x7f366c1ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46868/0 (socket says 172.21.15.154:46868) 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3669d9b700 1 -- 172.21.15.154:0/311526765 learned_addr learned my addr 172.21.15.154:0/311526765 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f366ad9d700 1 --2- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c1cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f366a59c700 1 --2- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f366c1300a0 0x7f366c1cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3669d9b700 1 -- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 msgr2=0x7f366c1cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3669d9b700 1 --2- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c1cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3669d9b700 1 -- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f366c1300a0 msgr2=0x7f366c1cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3669d9b700 1 --2- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f366c1300a0 0x7f366c1cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3669d9b700 1 -- 172.21.15.154:0/311526765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c009550 con 0x7f366c130bc0 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.918+0000 7f3669d9b700 1 --2- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366c130bc0 0x7f366c1ccd40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f366000b450 tx=0x7f366000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.919+0000 7f365affd700 1 -- 172.21.15.154:0/311526765 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660011830 con 0x7f366c130bc0 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.919+0000 7f365affd700 1 -- 172.21.15.154:0/311526765 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3660011990 con 0x7f366c130bc0 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.919+0000 7f3670b43700 1 -- 172.21.15.154:0/311526765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c06fce0 con 0x7f366c130bc0 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.919+0000 7f365affd700 1 -- 172.21.15.154:0/311526765 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660011d20 con 0x7f366c130bc0 2023-09-30T22:23:08.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.919+0000 7f3670b43700 1 -- 172.21.15.154:0/311526765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c070c90 con 0x7f366c130bc0 2023-09-30T22:23:08.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.920+0000 7f3670b43700 1 -- 172.21.15.154:0/311526765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c06ee70 con 0x7f366c130bc0 2023-09-30T22:23:08.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.920+0000 7f365affd700 1 -- 172.21.15.154:0/311526765 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f366001a400 con 0x7f366c130bc0 2023-09-30T22:23:08.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.920+0000 7f365affd700 1 -- 172.21.15.154:0/311526765 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f366003f5c0 con 0x7f366c130bc0 2023-09-30T22:23:08.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.926+0000 7f365affd700 1 -- 172.21.15.154:0/311526765 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f366000f8d0 con 0x7f366c130bc0 2023-09-30T22:23:08.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.997+0000 7fea53280700 1 Processor -- start 2023-09-30T22:23:08.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.997+0000 7fea53280700 1 -- start start 2023-09-30T22:23:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea53280700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c136960 0x7fea4c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea53280700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 0x7fea4c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea53280700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4c06b2d0 con 0x7fea4c133ad0 2023-09-30T22:23:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea53280700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1345b0 con 0x7fea4c136960 2023-09-30T22:23:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea53280700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c133610 con 0x7fea4c139280 2023-09-30T22:23:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea5081b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c136960 0x7fea4c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea5081b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c136960 0x7fea4c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58084/0 (socket says 172.21.15.154:58084) 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea5081b700 1 -- 172.21.15.154:0/3410303488 learned_addr learned my addr 172.21.15.154:0/3410303488 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea5181d700 1 --2- 172.21.15.154:0/3410303488 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 0x7fea4c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea5081b700 1 -- 172.21.15.154:0/3410303488 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 msgr2=0x7fea4c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea5081b700 1 --2- 172.21.15.154:0/3410303488 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 0x7fea4c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea5081b700 1 -- 172.21.15.154:0/3410303488 >> v1:172.21.15.154:6789/0 conn(0x7fea4c133ad0 legacy=0x7fea4c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea5081b700 1 -- 172.21.15.154:0/3410303488 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c09a500 con 0x7fea4c136960 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.998+0000 7fea5081b700 1 --2- 172.21.15.154:0/3410303488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c136960 0x7fea4c138d40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009920 tx=0x7fea3c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab9d4dcd1a80fbb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea43fff700 1 -- 172.21.15.154:0/3410303488 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c011830 con 0x7fea4c136960 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea43fff700 1 -- 172.21.15.154:0/3410303488 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c011990 con 0x7fea4c136960 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea43fff700 1 -- 172.21.15.154:0/3410303488 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c011d20 con 0x7fea4c136960 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea53280700 1 -- 172.21.15.154:0/3410303488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c136960 msgr2=0x7fea4c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea53280700 1 --2- 172.21.15.154:0/3410303488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c136960 0x7fea4c138d40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009920 tx=0x7fea3c009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea53280700 1 -- 172.21.15.154:0/3410303488 shutdown_connections 2023-09-30T22:23:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea53280700 1 --2- 172.21.15.154:0/3410303488 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 0x7fea4c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea53280700 1 --2- 172.21.15.154:0/3410303488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c136960 0x7fea4c138d40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea53280700 1 -- 172.21.15.154:0/3410303488 >> 172.21.15.154:0/3410303488 conn(0x7fea4c099c40 msgr2=0x7fea4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea53280700 1 -- 172.21.15.154:0/3410303488 shutdown_connections 2023-09-30T22:23:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:08.999+0000 7fea53280700 1 -- 172.21.15.154:0/3410303488 wait complete. 2023-09-30T22:23:09.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.000+0000 7fea53280700 1 Processor -- start 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.000+0000 7fea53280700 1 -- start start 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea53280700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c133ad0 0x7fea4c071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea53280700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea4c136960 0x7fea4c071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea53280700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 0x7fea4c1c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea53280700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c06e900 con 0x7fea4c136960 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea53280700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c06f490 con 0x7fea4c133ad0 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea53280700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c1316a0 con 0x7fea4c139280 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5101c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c133ad0 0x7fea4c071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5101c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c133ad0 0x7fea4c071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58098/0 (socket says 172.21.15.154:58098) 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5101c700 1 -- 172.21.15.154:0/594922570 learned_addr learned my addr 172.21.15.154:0/594922570 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5181d700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 0x7fea4c1c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5081b700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea4c136960 0x7fea4c071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5181d700 1 -- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c133ad0 msgr2=0x7fea4c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5181d700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c133ad0 0x7fea4c071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5181d700 1 -- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea4c136960 msgr2=0x7fea4c071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5181d700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea4c136960 0x7fea4c071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5181d700 1 -- 172.21.15.154:0/594922570 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c009550 con 0x7fea4c139280 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.001+0000 7fea5101c700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c133ad0 0x7fea4c071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.002+0000 7fea5181d700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 0x7fea4c1c84e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fea4400c6e0 tx=0x7fea4400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.002+0000 7fea41ffb700 1 -- 172.21.15.154:0/594922570 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44007740 con 0x7fea4c139280 2023-09-30T22:23:09.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.002+0000 7fea41ffb700 1 -- 172.21.15.154:0/594922570 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea440078c0 con 0x7fea4c139280 2023-09-30T22:23:09.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.002+0000 7fea53280700 1 -- 172.21.15.154:0/594922570 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4c06f010 con 0x7fea4c139280 2023-09-30T22:23:09.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.002+0000 7fea41ffb700 1 -- 172.21.15.154:0/594922570 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44007c70 con 0x7fea4c139280 2023-09-30T22:23:09.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.002+0000 7fea53280700 1 -- 172.21.15.154:0/594922570 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c0722d0 con 0x7fea4c139280 2023-09-30T22:23:09.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.003+0000 7fea41ffb700 1 -- 172.21.15.154:0/594922570 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea440273b0 con 0x7fea4c139280 2023-09-30T22:23:09.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.003+0000 7fea53280700 1 -- 172.21.15.154:0/594922570 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4c070280 con 0x7fea4c139280 2023-09-30T22:23:09.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.003+0000 7fea41ffb700 1 -- 172.21.15.154:0/594922570 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea44047fc0 con 0x7fea4c139280 2023-09-30T22:23:09.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.011+0000 7fea41ffb700 1 -- 172.21.15.154:0/594922570 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea44023020 con 0x7fea4c139280 2023-09-30T22:23:09.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.027+0000 7fe848da8700 1 Processor -- start 2023-09-30T22:23:09.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.027+0000 7fe848da8700 1 -- start start 2023-09-30T22:23:09.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.028+0000 7fe848da8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8441368e0 0x7fe844138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.028+0000 7fe848da8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844139200 0x7fe84413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.028+0000 7fe848da8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84409a760 con 0x7fe844133900 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.028+0000 7fe848da8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8441336e0 con 0x7fe8441368e0 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.028+0000 7fe848da8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe84409a080 con 0x7fe844139200 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.028+0000 7fe842d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844139200 0x7fe84413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.028+0000 7fe842d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844139200 0x7fe84413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34776/0 (socket says 172.21.15.154:34776) 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.028+0000 7fe842d9d700 1 -- 172.21.15.154:0/48072111 learned_addr learned my addr 172.21.15.154:0/48072111 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.028+0000 7fe841d9b700 1 --2- 172.21.15.154:0/48072111 >> v2:172.21.15.154:3300/0 conn(0x7fe8441368e0 0x7fe844138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe842d9d700 1 -- 172.21.15.154:0/48072111 >> v2:172.21.15.154:3300/0 conn(0x7fe8441368e0 msgr2=0x7fe844138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe842d9d700 1 --2- 172.21.15.154:0/48072111 >> v2:172.21.15.154:3300/0 conn(0x7fe8441368e0 0x7fe844138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe842d9d700 1 -- 172.21.15.154:0/48072111 >> v1:172.21.15.154:6789/0 conn(0x7fe844133900 legacy=0x7fe844133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe842d9d700 1 -- 172.21.15.154:0/48072111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440a23e0 con 0x7fe844139200 2023-09-30T22:23:09.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe842d9d700 1 --2- 172.21.15.154:0/48072111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844139200 0x7fe84413b5e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e50 tx=0x7fe83c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ec021d495025a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe84159a700 1 -- 172.21.15.154:0/48072111 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00e070 con 0x7fe844139200 2023-09-30T22:23:09.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe84159a700 1 -- 172.21.15.154:0/48072111 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00b9c0 con 0x7fe844139200 2023-09-30T22:23:09.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe84159a700 1 -- 172.21.15.154:0/48072111 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00bd70 con 0x7fe844139200 2023-09-30T22:23:09.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe848da8700 1 -- 172.21.15.154:0/48072111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844139200 msgr2=0x7fe84413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.029+0000 7fe848da8700 1 --2- 172.21.15.154:0/48072111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844139200 0x7fe84413b5e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e50 tx=0x7fe83c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:09.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.030+0000 7fe848da8700 1 -- 172.21.15.154:0/48072111 shutdown_connections 2023-09-30T22:23:09.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.030+0000 7fe848da8700 1 --2- 172.21.15.154:0/48072111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844139200 0x7fe84413b5e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.030+0000 7fe848da8700 1 --2- 172.21.15.154:0/48072111 >> v2:172.21.15.154:3300/0 conn(0x7fe8441368e0 0x7fe844138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.030+0000 7fe848da8700 1 -- 172.21.15.154:0/48072111 >> 172.21.15.154:0/48072111 conn(0x7fe8440a2980 msgr2=0x7fe8440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.030+0000 7fe848da8700 1 -- 172.21.15.154:0/48072111 shutdown_connections 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.030+0000 7fe848da8700 1 -- 172.21.15.154:0/48072111 wait complete. 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe848da8700 1 Processor -- start 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe848da8700 1 -- start start 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe848da8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844133900 0x7fe84411ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe848da8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8441368e0 0x7fe84411b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe848da8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe844139200 0x7fe84411b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe848da8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84411ca60 con 0x7fe8441368e0 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe848da8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe844130d40 con 0x7fe844139200 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe848da8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe84411d2a0 con 0x7fe844133900 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe84259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844133900 0x7fe84411ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe84259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844133900 0x7fe84411ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34778/0 (socket says 172.21.15.154:34778) 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.031+0000 7fe84259c700 1 -- 172.21.15.154:0/879479936 learned_addr learned my addr 172.21.15.154:0/879479936 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe841d9b700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8441368e0 0x7fe84411b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe842d9d700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe844139200 0x7fe84411b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe84259c700 1 -- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe844139200 msgr2=0x7fe84411b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe84259c700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe844139200 0x7fe84411b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe84259c700 1 -- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8441368e0 msgr2=0x7fe84411b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe84259c700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8441368e0 0x7fe84411b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe84259c700 1 -- 172.21.15.154:0/879479936 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009b30 con 0x7fe844133900 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe842d9d700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe844139200 0x7fe84411b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe84259c700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844133900 0x7fe84411ae50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c500 tx=0x7fe83400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:09.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe832ffd700 1 -- 172.21.15.154:0/879479936 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340054e0 con 0x7fe844133900 2023-09-30T22:23:09.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe832ffd700 1 -- 172.21.15.154:0/879479936 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834003680 con 0x7fe844133900 2023-09-30T22:23:09.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe832ffd700 1 -- 172.21.15.154:0/879479936 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834003a30 con 0x7fe844133900 2023-09-30T22:23:09.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe848da8700 1 -- 172.21.15.154:0/879479936 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84411e100 con 0x7fe844133900 2023-09-30T22:23:09.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.032+0000 7fe848da8700 1 -- 172.21.15.154:0/879479936 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84409a2c0 con 0x7fe844133900 2023-09-30T22:23:09.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.033+0000 7fe848da8700 1 -- 172.21.15.154:0/879479936 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84404f2a0 con 0x7fe844133900 2023-09-30T22:23:09.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.034+0000 7fe832ffd700 1 -- 172.21.15.154:0/879479936 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe834003b90 con 0x7fe844133900 2023-09-30T22:23:09.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.034+0000 7fe832ffd700 1 -- 172.21.15.154:0/879479936 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe83403ec60 con 0x7fe844133900 2023-09-30T22:23:09.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.038+0000 7fe832ffd700 1 -- 172.21.15.154:0/879479936 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe834003e40 con 0x7fe844133900 2023-09-30T22:23:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.049+0000 7f4281e64700 1 -- 172.21.15.154:0/3535835286 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f427c04f2a0 con 0x7f427c133f50 2023-09-30T22:23:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.050+0000 7f4263fff700 1 -- 172.21.15.154:0/3535835286 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4274014e00 con 0x7f427c133f50 2023-09-30T22:23:09.050 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:09.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.052+0000 7f4281e64700 1 -- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c133f50 msgr2=0x7f427c11ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.052+0000 7f4281e64700 1 --2- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c133f50 0x7f427c11ff00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4274009d90 tx=0x7f427400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.052+0000 7f4281e64700 1 -- 172.21.15.154:0/3535835286 shutdown_connections 2023-09-30T22:23:09.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.052+0000 7f4281e64700 1 --2- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427c133f50 0x7f427c11ff00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.052+0000 7f4281e64700 1 --2- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f427c0a0a70 0x7f427c11f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.052+0000 7f4281e64700 1 --2- 172.21.15.154:0/3535835286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f427c0a1380 0x7f427c11f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.052+0000 7f4281e64700 1 -- 172.21.15.154:0/3535835286 >> 172.21.15.154:0/3535835286 conn(0x7f427c0a6610 msgr2=0x7f427c0a5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.052+0000 7f4281e64700 1 -- 172.21.15.154:0/3535835286 shutdown_connections 2023-09-30T22:23:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.052+0000 7f4281e64700 1 -- 172.21.15.154:0/3535835286 wait complete. 2023-09-30T22:23:09.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:09.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.167+0000 7f3670b43700 1 -- 172.21.15.154:0/311526765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f366c06fe70 con 0x7f366c130bc0 2023-09-30T22:23:09.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.167+0000 7f365affd700 1 -- 172.21.15.154:0/311526765 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f366000f2e0 con 0x7f366c130bc0 2023-09-30T22:23:09.168 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:09.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.169+0000 7f3670b43700 1 -- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366c130bc0 msgr2=0x7f366c1ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.169+0000 7f3670b43700 1 --2- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366c130bc0 0x7f366c1ccd40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f366000b450 tx=0x7f366000b760 comp rx=0 tx=0).stop 2023-09-30T22:23:09.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.169+0000 7f3670b43700 1 -- 172.21.15.154:0/311526765 shutdown_connections 2023-09-30T22:23:09.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.169+0000 7f3670b43700 1 --2- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366c133ad0 0x7f366c1cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.169+0000 7f3670b43700 1 --2- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f366c1300a0 0x7f366c1cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.169+0000 7f3670b43700 1 --2- 172.21.15.154:0/311526765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366c130bc0 0x7f366c1ccd40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.169+0000 7f3670b43700 1 -- 172.21.15.154:0/311526765 >> 172.21.15.154:0/311526765 conn(0x7f366c099c40 msgr2=0x7f366c132890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.170+0000 7f3670b43700 1 -- 172.21.15.154:0/311526765 shutdown_connections 2023-09-30T22:23:09.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.170+0000 7f3670b43700 1 -- 172.21.15.154:0/311526765 wait complete. 2023-09-30T22:23:09.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.209+0000 7fea53280700 1 -- 172.21.15.154:0/594922570 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea4c070080 con 0x7fea4c139280 2023-09-30T22:23:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.209+0000 7fea41ffb700 1 -- 172.21.15.154:0/594922570 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea4401b290 con 0x7fea4c139280 2023-09-30T22:23:09.209 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:09.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.211+0000 7fea53280700 1 -- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 msgr2=0x7fea4c1c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.211+0000 7fea53280700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 0x7fea4c1c84e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fea4400c6e0 tx=0x7fea4400c9f0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.211+0000 7fea53280700 1 -- 172.21.15.154:0/594922570 shutdown_connections 2023-09-30T22:23:09.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.211+0000 7fea53280700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea4c139280 0x7fea4c1c84e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.211+0000 7fea53280700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea4c133ad0 0x7fea4c071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.211+0000 7fea53280700 1 --2- 172.21.15.154:0/594922570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea4c136960 0x7fea4c071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.211+0000 7fea53280700 1 -- 172.21.15.154:0/594922570 >> 172.21.15.154:0/594922570 conn(0x7fea4c099c40 msgr2=0x7fea4c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.211+0000 7fea53280700 1 -- 172.21.15.154:0/594922570 shutdown_connections 2023-09-30T22:23:09.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.211+0000 7fea53280700 1 -- 172.21.15.154:0/594922570 wait complete. 2023-09-30T22:23:09.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:09.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.257+0000 7fe848da8700 1 -- 172.21.15.154:0/879479936 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe8441343b0 con 0x7fe844133900 2023-09-30T22:23:09.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.257+0000 7fe832ffd700 1 -- 172.21.15.154:0/879479936 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe834017030 con 0x7fe844133900 2023-09-30T22:23:09.257 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:09.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.259+0000 7fe848da8700 1 -- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844133900 msgr2=0x7fe84411ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:09.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.259+0000 7fe848da8700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844133900 0x7fe84411ae50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c500 tx=0x7fe83400c8c0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.259+0000 7fe848da8700 1 -- 172.21.15.154:0/879479936 shutdown_connections 2023-09-30T22:23:09.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.259+0000 7fe848da8700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe844139200 0x7fe84411b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.259+0000 7fe848da8700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe844133900 0x7fe84411ae50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.259+0000 7fe848da8700 1 --2- 172.21.15.154:0/879479936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8441368e0 0x7fe84411b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:09.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.259+0000 7fe848da8700 1 -- 172.21.15.154:0/879479936 >> 172.21.15.154:0/879479936 conn(0x7fe8440a2980 msgr2=0x7fe844135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:09.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.259+0000 7fe848da8700 1 -- 172.21.15.154:0/879479936 shutdown_connections 2023-09-30T22:23:09.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:09.259+0000 7fe848da8700 1 -- 172.21.15.154:0/879479936 wait complete. 2023-09-30T22:23:09.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:10.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:10.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:10.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.195+0000 7f3ec5f86700 1 Processor -- start 2023-09-30T22:23:10.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.195+0000 7f3ec5f86700 1 -- start start 2023-09-30T22:23:10.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.195+0000 7f3ec5f86700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ec5f86700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ec0130bc0 0x7f3ec013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ec5f86700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec006b2d0 con 0x7f3ec01300a0 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ec5f86700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec0133610 con 0x7f3ec0130bc0 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ec5f86700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec009a500 con 0x7f3ec0133ad0 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ec0130bc0 0x7f3ec013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34792/0 (socket says 172.21.15.154:34792) 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebf7fe700 1 -- 172.21.15.154:0/1036945834 learned_addr learned my addr 172.21.15.154:0/1036945834 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ec0130bc0 0x7f3ec013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46926/0 (socket says 172.21.15.154:46926) 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebf7fe700 1 -- 172.21.15.154:0/1036945834 >> v2:172.21.15.154:3300/0 conn(0x7f3ec0130bc0 msgr2=0x7f3ec013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebf7fe700 1 --2- 172.21.15.154:0/1036945834 >> v2:172.21.15.154:3300/0 conn(0x7f3ec0130bc0 0x7f3ec013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebf7fe700 1 -- 172.21.15.154:0/1036945834 >> v1:172.21.15.154:6789/0 conn(0x7f3ec01300a0 legacy=0x7f3ec01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebf7fe700 1 -- 172.21.15.154:0/1036945834 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec01338b0 con 0x7f3ec0133ad0 2023-09-30T22:23:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebffff700 1 --2- 172.21.15.154:0/1036945834 >> v2:172.21.15.154:3300/0 conn(0x7f3ec0130bc0 0x7f3ec013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebf7fe700 1 --2- 172.21.15.154:0/1036945834 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0133ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00098f0 tx=0x7f3eb0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12a3040c4e31e5e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebe7fc700 1 -- 172.21.15.154:0/1036945834 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0011830 con 0x7f3ec0133ad0 2023-09-30T22:23:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebe7fc700 1 -- 172.21.15.154:0/1036945834 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb0011990 con 0x7f3ec0133ad0 2023-09-30T22:23:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.196+0000 7f3ebe7fc700 1 -- 172.21.15.154:0/1036945834 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0011d20 con 0x7f3ec0133ad0 2023-09-30T22:23:10.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.197+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1036945834 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 msgr2=0x7f3ec0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.197+0000 7f3ec5f86700 1 --2- 172.21.15.154:0/1036945834 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0133ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00098f0 tx=0x7f3eb0009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.197+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1036945834 shutdown_connections 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.197+0000 7f3ec5f86700 1 --2- 172.21.15.154:0/1036945834 >> v2:172.21.15.154:3300/0 conn(0x7f3ec0130bc0 0x7f3ec013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.197+0000 7f3ec5f86700 1 --2- 172.21.15.154:0/1036945834 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec0133ea0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.197+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1036945834 >> 172.21.15.154:0/1036945834 conn(0x7f3ec0099c40 msgr2=0x7f3ec00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.197+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1036945834 shutdown_connections 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.197+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1036945834 wait complete. 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.198+0000 7f3ec5f86700 1 Processor -- start 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.198+0000 7f3ec5f86700 1 -- start start 2023-09-30T22:23:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ec5f86700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec01300a0 0x7f3ec01c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ec5f86700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec0130bc0 0x7f3ec01c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ec5f86700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec01c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ec5f86700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0120bb0 con 0x7f3ec01300a0 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ec5f86700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec01201b0 con 0x7f3ec0130bc0 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ec5f86700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0072160 con 0x7f3ec0133ad0 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec01300a0 0x7f3ec01c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec01c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec01300a0 0x7f3ec01c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46940/0 (socket says 172.21.15.154:46940) 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec01c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34804/0 (socket says 172.21.15.154:34804) 2023-09-30T22:23:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebf7fe700 1 -- 172.21.15.154:0/1570994829 learned_addr learned my addr 172.21.15.154:0/1570994829 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebeffd700 1 --2- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec0130bc0 0x7f3ec01c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebf7fe700 1 -- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 msgr2=0x7f3ec01c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebf7fe700 1 --2- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec01c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebf7fe700 1 -- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec0130bc0 msgr2=0x7f3ec01c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebf7fe700 1 --2- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec0130bc0 0x7f3ec01c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebf7fe700 1 -- 172.21.15.154:0/1570994829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb8009a70 con 0x7f3ec01300a0 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebffff700 1 --2- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec01c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ebf7fe700 1 --2- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec01300a0 0x7f3ec01c8750 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009c40 tx=0x7f3eb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.199+0000 7f3ea7fff700 1 -- 172.21.15.154:0/1570994829 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00045d0 con 0x7f3ec01300a0 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.200+0000 7f3ea7fff700 1 -- 172.21.15.154:0/1570994829 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb00036a0 con 0x7f3ec01300a0 2023-09-30T22:23:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.200+0000 7f3ea7fff700 1 -- 172.21.15.154:0/1570994829 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0003a10 con 0x7f3ec01300a0 2023-09-30T22:23:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.200+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1570994829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb0009550 con 0x7f3ec01300a0 2023-09-30T22:23:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.200+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1570994829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec011fed0 con 0x7f3ec01300a0 2023-09-30T22:23:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.200+0000 7f3ea7fff700 1 -- 172.21.15.154:0/1570994829 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3eb0021070 con 0x7f3ec01300a0 2023-09-30T22:23:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.200+0000 7f3ea7fff700 1 -- 172.21.15.154:0/1570994829 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3eb0040a20 con 0x7f3ec01300a0 2023-09-30T22:23:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.201+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1570994829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec00726d0 con 0x7f3ec01300a0 2023-09-30T22:23:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.206+0000 7f3ea7fff700 1 -- 172.21.15.154:0/1570994829 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3eb0015080 con 0x7f3ec01300a0 2023-09-30T22:23:10.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:10.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:10.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.319+0000 7f30f8730700 1 Processor -- start 2023-09-30T22:23:10.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.319+0000 7f30f8730700 1 -- start start 2023-09-30T22:23:10.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f8730700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f30f0138410 0x7f30f00a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f8730700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f8730700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f01379e0 con 0x7f30f0138040 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f8730700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00a2100 con 0x7f30f0138410 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f8730700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30f009b9b0 con 0x7f30f013dd10 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f5ccb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f30f0138410 0x7f30f00a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f5ccb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f30f0138410 0x7f30f00a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46946/0 (socket says 172.21.15.154:46946) 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f5ccb700 1 -- 172.21.15.154:0/1803841833 learned_addr learned my addr 172.21.15.154:0/1803841833 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f6ccd700 1 --2- 172.21.15.154:0/1803841833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f5ccb700 1 -- 172.21.15.154:0/1803841833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 msgr2=0x7f30f01400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f5ccb700 1 --2- 172.21.15.154:0/1803841833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f01400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f5ccb700 1 -- 172.21.15.154:0/1803841833 >> v1:172.21.15.154:6789/0 conn(0x7f30f0138040 legacy=0x7f30f00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f5ccb700 1 -- 172.21.15.154:0/1803841833 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0137c10 con 0x7f30f0138410 2023-09-30T22:23:10.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.320+0000 7f30f5ccb700 1 --2- 172.21.15.154:0/1803841833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f0138410 0x7f30f00a0ff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f30e00098f0 tx=0x7f30e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a184863f81761e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.321+0000 7f30f54ca700 1 -- 172.21.15.154:0/1803841833 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0011830 con 0x7f30f0138410 2023-09-30T22:23:10.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.321+0000 7f30f54ca700 1 -- 172.21.15.154:0/1803841833 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0011990 con 0x7f30f0138410 2023-09-30T22:23:10.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.321+0000 7f30f54ca700 1 -- 172.21.15.154:0/1803841833 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0011d20 con 0x7f30f0138410 2023-09-30T22:23:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.321+0000 7f30f8730700 1 -- 172.21.15.154:0/1803841833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f0138410 msgr2=0x7f30f00a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.321+0000 7f30f8730700 1 --2- 172.21.15.154:0/1803841833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f0138410 0x7f30f00a0ff0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f30e00098f0 tx=0x7f30e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.321+0000 7f30f8730700 1 -- 172.21.15.154:0/1803841833 shutdown_connections 2023-09-30T22:23:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.321+0000 7f30f8730700 1 --2- 172.21.15.154:0/1803841833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f01400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.321+0000 7f30f8730700 1 --2- 172.21.15.154:0/1803841833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f0138410 0x7f30f00a0ff0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.321+0000 7f30f8730700 1 -- 172.21.15.154:0/1803841833 >> 172.21.15.154:0/1803841833 conn(0x7f30f00a2980 msgr2=0x7f30f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.322+0000 7f30f8730700 1 -- 172.21.15.154:0/1803841833 shutdown_connections 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.322+0000 7f30f8730700 1 -- 172.21.15.154:0/1803841833 wait complete. 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.323+0000 7f30f8730700 1 Processor -- start 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.323+0000 7f30f8730700 1 -- start start 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f8730700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f0138040 0x7f30f0121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f8730700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30f0138410 0x7f30f0121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f8730700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f0122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f8730700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0137700 con 0x7f30f0138040 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f8730700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0124140 con 0x7f30f0138410 2023-09-30T22:23:10.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f8730700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0123750 con 0x7f30f013dd10 2023-09-30T22:23:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f6ccd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f0122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f6ccd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f0122080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34826/0 (socket says 172.21.15.154:34826) 2023-09-30T22:23:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f6ccd700 1 -- 172.21.15.154:0/3987428527 learned_addr learned my addr 172.21.15.154:0/3987428527 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f5ccb700 1 --2- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30f0138410 0x7f30f0121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f64cc700 1 --2- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f0138040 0x7f30f0121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f6ccd700 1 -- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30f0138410 msgr2=0x7f30f0121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f6ccd700 1 --2- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30f0138410 0x7f30f0121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f6ccd700 1 -- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f0138040 msgr2=0x7f30f0121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f6ccd700 1 --2- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f0138040 0x7f30f0121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f6ccd700 1 -- 172.21.15.154:0/3987428527 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0009550 con 0x7f30f013dd10 2023-09-30T22:23:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30f6ccd700 1 --2- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f0122080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f30e800ef90 tx=0x7f30e800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.324+0000 7f30e6ffd700 1 -- 172.21.15.154:0/3987428527 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800cc90 con 0x7f30f013dd10 2023-09-30T22:23:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.325+0000 7f30e6ffd700 1 -- 172.21.15.154:0/3987428527 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800f040 con 0x7f30f013dd10 2023-09-30T22:23:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.325+0000 7f30f8730700 1 -- 172.21.15.154:0/3987428527 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f0124b80 con 0x7f30f013dd10 2023-09-30T22:23:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.325+0000 7f30e6ffd700 1 -- 172.21.15.154:0/3987428527 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8014480 con 0x7f30f013dd10 2023-09-30T22:23:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.325+0000 7f30f8730700 1 -- 172.21.15.154:0/3987428527 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f009a240 con 0x7f30f013dd10 2023-09-30T22:23:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.325+0000 7f30e6ffd700 1 -- 172.21.15.154:0/3987428527 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30e80145e0 con 0x7f30f013dd10 2023-09-30T22:23:10.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.326+0000 7f30e6ffd700 1 -- 172.21.15.154:0/3987428527 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f30e8040200 con 0x7f30f013dd10 2023-09-30T22:23:10.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.326+0000 7f30f8730700 1 -- 172.21.15.154:0/3987428527 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f004f2a0 con 0x7f30f013dd10 2023-09-30T22:23:10.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.335+0000 7f30e6ffd700 1 -- 172.21.15.154:0/3987428527 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30e8018020 con 0x7f30f013dd10 2023-09-30T22:23:10.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f99935fc700 1 Processor -- start 2023-09-30T22:23:10.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f99935fc700 1 -- start start 2023-09-30T22:23:10.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f99935fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 0x7f998c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f99935fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f998c1300a0 0x7f998c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f99935fc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c06b2d0 con 0x7f998c1309f0 2023-09-30T22:23:10.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f99935fc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c133610 con 0x7f998c1300a0 2023-09-30T22:23:10.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f99935fc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998c09a500 con 0x7f998c133ad0 2023-09-30T22:23:10.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f9991398700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 0x7f998c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f9990b97700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f998c1300a0 0x7f998c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f9991398700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 0x7f998c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34840/0 (socket says 172.21.15.154:34840) 2023-09-30T22:23:10.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.361+0000 7f9991398700 1 -- 172.21.15.154:0/3501181224 learned_addr learned my addr 172.21.15.154:0/3501181224 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.362+0000 7f9990b97700 1 -- 172.21.15.154:0/3501181224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 msgr2=0x7f998c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.362+0000 7f9990b97700 1 --2- 172.21.15.154:0/3501181224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 0x7f998c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.362+0000 7f9990b97700 1 -- 172.21.15.154:0/3501181224 >> v1:172.21.15.154:6789/0 conn(0x7f998c1309f0 legacy=0x7f998c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.362+0000 7f9990b97700 1 -- 172.21.15.154:0/3501181224 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c1338b0 con 0x7f998c1300a0 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.362+0000 7f9990b97700 1 --2- 172.21.15.154:0/3501181224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 0x7f998c1304b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f997c009840 tx=0x7f997c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfec57e8ab57422 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.362+0000 7f9983fff700 1 -- 172.21.15.154:0/3501181224 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c011830 con 0x7f998c1300a0 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.362+0000 7f9983fff700 1 -- 172.21.15.154:0/3501181224 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c011990 con 0x7f998c1300a0 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.362+0000 7f9983fff700 1 -- 172.21.15.154:0/3501181224 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c011d20 con 0x7f998c1300a0 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.363+0000 7f99935fc700 1 -- 172.21.15.154:0/3501181224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 msgr2=0x7f998c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.363+0000 7f99935fc700 1 --2- 172.21.15.154:0/3501181224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 0x7f998c1304b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f997c009840 tx=0x7f997c009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.363+0000 7f99935fc700 1 -- 172.21.15.154:0/3501181224 shutdown_connections 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.363+0000 7f99935fc700 1 --2- 172.21.15.154:0/3501181224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 0x7f998c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.363+0000 7f99935fc700 1 --2- 172.21.15.154:0/3501181224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 0x7f998c1304b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.363+0000 7f99935fc700 1 -- 172.21.15.154:0/3501181224 >> 172.21.15.154:0/3501181224 conn(0x7f998c099c40 msgr2=0x7f998c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.363+0000 7f99935fc700 1 -- 172.21.15.154:0/3501181224 shutdown_connections 2023-09-30T22:23:10.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.363+0000 7f99935fc700 1 -- 172.21.15.154:0/3501181224 wait complete. 2023-09-30T22:23:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.364+0000 7f99935fc700 1 Processor -- start 2023-09-30T22:23:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f99935fc700 1 -- start start 2023-09-30T22:23:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f99935fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 0x7f998c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f99935fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f998c1309f0 0x7f998c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f99935fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 0x7f998c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f99935fc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c072070 con 0x7f998c1300a0 2023-09-30T22:23:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f99935fc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c11fa40 con 0x7f998c1309f0 2023-09-30T22:23:10.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f99935fc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998c11f250 con 0x7f998c133ad0 2023-09-30T22:23:10.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f9991398700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 0x7f998c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f9991398700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 0x7f998c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46974/0 (socket says 172.21.15.154:46974) 2023-09-30T22:23:10.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.365+0000 7f9991398700 1 -- 172.21.15.154:0/1051495973 learned_addr learned my addr 172.21.15.154:0/1051495973 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:10.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9991b99700 1 --2- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 0x7f998c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9990b97700 1 --2- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f998c1309f0 0x7f998c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9991398700 1 -- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 msgr2=0x7f998c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9991398700 1 --2- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 0x7f998c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9991398700 1 -- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f998c1309f0 msgr2=0x7f998c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9991398700 1 --2- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f998c1309f0 0x7f998c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9991398700 1 -- 172.21.15.154:0/1051495973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c0094a0 con 0x7f998c1300a0 2023-09-30T22:23:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9991398700 1 --2- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 0x7f998c11da40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f998800e910 tx=0x7f998800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9981ffb700 1 -- 172.21.15.154:0/1051495973 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99880096a0 con 0x7f998c1300a0 2023-09-30T22:23:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9981ffb700 1 -- 172.21.15.154:0/1051495973 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998800c850 con 0x7f998c1300a0 2023-09-30T22:23:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f99935fc700 1 -- 172.21.15.154:0/1051495973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c12dd00 con 0x7f998c1300a0 2023-09-30T22:23:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f9981ffb700 1 -- 172.21.15.154:0/1051495973 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998800cc00 con 0x7f998c1300a0 2023-09-30T22:23:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.366+0000 7f99935fc700 1 -- 172.21.15.154:0/1051495973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c11ffe0 con 0x7f998c1300a0 2023-09-30T22:23:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.367+0000 7f9981ffb700 1 -- 172.21.15.154:0/1051495973 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f998800cd60 con 0x7f998c1300a0 2023-09-30T22:23:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.367+0000 7f9981ffb700 1 -- 172.21.15.154:0/1051495973 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f998803fb10 con 0x7f998c1300a0 2023-09-30T22:23:10.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.367+0000 7f99935fc700 1 -- 172.21.15.154:0/1051495973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c09cb20 con 0x7f998c1300a0 2023-09-30T22:23:10.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.372+0000 7f9981ffb700 1 -- 172.21.15.154:0/1051495973 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9988017080 con 0x7f998c1300a0 2023-09-30T22:23:10.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.419+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1570994829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ec004f2a0 con 0x7f3ec01300a0 2023-09-30T22:23:10.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.419+0000 7f3ea7fff700 1 -- 172.21.15.154:0/1570994829 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3eb0029020 con 0x7f3ec01300a0 2023-09-30T22:23:10.419 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:10.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.421+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec01300a0 msgr2=0x7f3ec01c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.421+0000 7f3ec5f86700 1 --2- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec01300a0 0x7f3ec01c8750 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009c40 tx=0x7f3eb0004750 comp rx=0 tx=0).stop 2023-09-30T22:23:10.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.421+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1570994829 shutdown_connections 2023-09-30T22:23:10.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.421+0000 7f3ec5f86700 1 --2- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ec0133ad0 0x7f3ec01c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.421+0000 7f3ec5f86700 1 --2- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec01300a0 0x7f3ec01c8750 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.421+0000 7f3ec5f86700 1 --2- 172.21.15.154:0/1570994829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec0130bc0 0x7f3ec01c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.421+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1570994829 >> 172.21.15.154:0/1570994829 conn(0x7f3ec0099c40 msgr2=0x7f3ec012e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.422+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1570994829 shutdown_connections 2023-09-30T22:23:10.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.422+0000 7f3ec5f86700 1 -- 172.21.15.154:0/1570994829 wait complete. 2023-09-30T22:23:10.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.435+0000 7f5a53a8e700 1 Processor -- start 2023-09-30T22:23:10.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:10.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.435+0000 7f5a53a8e700 1 -- start start 2023-09-30T22:23:10.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a53a8e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c131980 0x7f5a4c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a53a8e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a4c09c790 0x7f5a4c139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a53a8e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0a1640 con 0x7f5a4c09bc70 2023-09-30T22:23:10.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a53a8e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c06eb30 con 0x7f5a4c09c790 2023-09-30T22:23:10.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a53a8e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0a22d0 con 0x7f5a4c131980 2023-09-30T22:23:10.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a5182a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c131980 0x7f5a4c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a5182a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c131980 0x7f5a4c131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34854/0 (socket says 172.21.15.154:34854) 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a5182a700 1 -- 172.21.15.154:0/1431432376 learned_addr learned my addr 172.21.15.154:0/1431432376 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a5202b700 1 --2- 172.21.15.154:0/1431432376 >> v2:172.21.15.154:3300/0 conn(0x7f5a4c09c790 0x7f5a4c139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a5182a700 1 -- 172.21.15.154:0/1431432376 >> v2:172.21.15.154:3300/0 conn(0x7f5a4c09c790 msgr2=0x7f5a4c139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a5182a700 1 --2- 172.21.15.154:0/1431432376 >> v2:172.21.15.154:3300/0 conn(0x7f5a4c09c790 0x7f5a4c139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a5182a700 1 -- 172.21.15.154:0/1431432376 >> v1:172.21.15.154:6789/0 conn(0x7f5a4c09bc70 legacy=0x7f5a4c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a5182a700 1 -- 172.21.15.154:0/1431432376 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c131550 con 0x7f5a4c131980 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.436+0000 7f5a5182a700 1 --2- 172.21.15.154:0/1431432376 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c131980 0x7f5a4c131d50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5a48006fd0 tx=0x7f5a48009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76f64b436bb70e48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a50828700 1 -- 172.21.15.154:0/1431432376 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a48005e30 con 0x7f5a4c131980 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a50828700 1 -- 172.21.15.154:0/1431432376 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a48004030 con 0x7f5a4c131980 2023-09-30T22:23:10.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a50828700 1 -- 172.21.15.154:0/1431432376 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a480043e0 con 0x7f5a4c131980 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a53a8e700 1 -- 172.21.15.154:0/1431432376 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c131980 msgr2=0x7f5a4c131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a53a8e700 1 --2- 172.21.15.154:0/1431432376 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c131980 0x7f5a4c131d50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5a48006fd0 tx=0x7f5a48009bd0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a53a8e700 1 -- 172.21.15.154:0/1431432376 shutdown_connections 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a53a8e700 1 --2- 172.21.15.154:0/1431432376 >> v2:172.21.15.154:3300/0 conn(0x7f5a4c09c790 0x7f5a4c139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a53a8e700 1 --2- 172.21.15.154:0/1431432376 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c131980 0x7f5a4c131d50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a53a8e700 1 -- 172.21.15.154:0/1431432376 >> 172.21.15.154:0/1431432376 conn(0x7f5a4c0a2980 msgr2=0x7f5a4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a53a8e700 1 -- 172.21.15.154:0/1431432376 shutdown_connections 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.437+0000 7f5a53a8e700 1 -- 172.21.15.154:0/1431432376 wait complete. 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.438+0000 7f5a53a8e700 1 Processor -- start 2023-09-30T22:23:10.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.438+0000 7f5a53a8e700 1 -- start start 2023-09-30T22:23:10.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a53a8e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c09bc70 0x7f5a4c11da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a53a8e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a4c09c790 0x7f5a4c11dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a53a8e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c131980 0x7f5a4c11e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:10.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a53a8e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c130f50 con 0x7f5a4c131980 2023-09-30T22:23:10.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a53a8e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0a1c40 con 0x7f5a4c09c790 2023-09-30T22:23:10.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a53a8e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c120470 con 0x7f5a4c09bc70 2023-09-30T22:23:10.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5182a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c09bc70 0x7f5a4c11da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5182a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c09bc70 0x7f5a4c11da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34858/0 (socket says 172.21.15.154:34858) 2023-09-30T22:23:10.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5182a700 1 -- 172.21.15.154:0/3008766286 learned_addr learned my addr 172.21.15.154:0/3008766286 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:10.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5202b700 1 --2- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c131980 0x7f5a4c11e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:10.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5182a700 1 -- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a4c09c790 msgr2=0x7f5a4c11dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5182a700 1 --2- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a4c09c790 0x7f5a4c11dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5182a700 1 -- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c131980 msgr2=0x7f5a4c11e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5182a700 1 --2- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c131980 0x7f5a4c11e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5182a700 1 -- 172.21.15.154:0/3008766286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a48009500 con 0x7f5a4c09bc70 2023-09-30T22:23:10.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a5182a700 1 --2- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c09bc70 0x7f5a4c11da90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5a48000c00 tx=0x7f5a48004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:10.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a427fc700 1 -- 172.21.15.154:0/3008766286 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4801c420 con 0x7f5a4c09bc70 2023-09-30T22:23:10.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.439+0000 7f5a427fc700 1 -- 172.21.15.154:0/3008766286 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4801c5a0 con 0x7f5a4c09bc70 2023-09-30T22:23:10.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.440+0000 7f5a427fc700 1 -- 172.21.15.154:0/3008766286 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4801c950 con 0x7f5a4c09bc70 2023-09-30T22:23:10.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.440+0000 7f5a53a8e700 1 -- 172.21.15.154:0/3008766286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c120cf0 con 0x7f5a4c09bc70 2023-09-30T22:23:10.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.440+0000 7f5a53a8e700 1 -- 172.21.15.154:0/3008766286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c121cf0 con 0x7f5a4c09bc70 2023-09-30T22:23:10.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.440+0000 7f5a427fc700 1 -- 172.21.15.154:0/3008766286 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a4801cab0 con 0x7f5a4c09bc70 2023-09-30T22:23:10.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.440+0000 7f5a427fc700 1 -- 172.21.15.154:0/3008766286 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a48040af0 con 0x7f5a4c09bc70 2023-09-30T22:23:10.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.441+0000 7f5a53a8e700 1 -- 172.21.15.154:0/3008766286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c04f2a0 con 0x7f5a4c09bc70 2023-09-30T22:23:10.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.446+0000 7f5a427fc700 1 -- 172.21.15.154:0/3008766286 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a48016080 con 0x7f5a4c09bc70 2023-09-30T22:23:10.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.569+0000 7f99935fc700 1 -- 172.21.15.154:0/1051495973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f998c04f2a0 con 0x7f998c1300a0 2023-09-30T22:23:10.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.569+0000 7f9981ffb700 1 -- 172.21.15.154:0/1051495973 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9988021020 con 0x7f998c1300a0 2023-09-30T22:23:10.569 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:10.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.571+0000 7f30f8730700 1 -- 172.21.15.154:0/3987428527 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30f006bce0 con 0x7f30f013dd10 2023-09-30T22:23:10.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.571+0000 7f30e6ffd700 1 -- 172.21.15.154:0/3987428527 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30e802b090 con 0x7f30f013dd10 2023-09-30T22:23:10.571 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:10.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.572+0000 7f99935fc700 1 -- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 msgr2=0x7f998c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.572+0000 7f99935fc700 1 --2- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 0x7f998c11da40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f998800e910 tx=0x7f998800ecd0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.572+0000 7f99935fc700 1 -- 172.21.15.154:0/1051495973 shutdown_connections 2023-09-30T22:23:10.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.572+0000 7f99935fc700 1 --2- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998c133ad0 0x7f998c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.572+0000 7f99935fc700 1 --2- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998c1300a0 0x7f998c11da40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.572+0000 7f99935fc700 1 --2- 172.21.15.154:0/1051495973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f998c1309f0 0x7f998c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.572+0000 7f99935fc700 1 -- 172.21.15.154:0/1051495973 >> 172.21.15.154:0/1051495973 conn(0x7f998c099c40 msgr2=0x7f998c0a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.572+0000 7f99935fc700 1 -- 172.21.15.154:0/1051495973 shutdown_connections 2023-09-30T22:23:10.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.572+0000 7f99935fc700 1 -- 172.21.15.154:0/1051495973 wait complete. 2023-09-30T22:23:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.574+0000 7f30f8730700 1 -- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 msgr2=0x7f30f0122080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.574+0000 7f30f8730700 1 --2- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f0122080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f30e800ef90 tx=0x7f30e800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.574+0000 7f30f8730700 1 -- 172.21.15.154:0/3987428527 shutdown_connections 2023-09-30T22:23:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.574+0000 7f30f8730700 1 --2- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30f013dd10 0x7f30f0122080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.574+0000 7f30f8730700 1 --2- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f0138040 0x7f30f0121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.574+0000 7f30f8730700 1 --2- 172.21.15.154:0/3987428527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30f0138410 0x7f30f0121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.574+0000 7f30f8730700 1 -- 172.21.15.154:0/3987428527 >> 172.21.15.154:0/3987428527 conn(0x7f30f00a2980 msgr2=0x7f30f009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.574+0000 7f30f8730700 1 -- 172.21.15.154:0/3987428527 shutdown_connections 2023-09-30T22:23:10.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.574+0000 7f30f8730700 1 -- 172.21.15.154:0/3987428527 wait complete. 2023-09-30T22:23:10.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:10.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:10.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.638+0000 7f5a53a8e700 1 -- 172.21.15.154:0/3008766286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a4c120f20 con 0x7f5a4c09bc70 2023-09-30T22:23:10.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.638+0000 7f5a427fc700 1 -- 172.21.15.154:0/3008766286 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a4802a020 con 0x7f5a4c09bc70 2023-09-30T22:23:10.639 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.641+0000 7f5a53a8e700 1 -- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c09bc70 msgr2=0x7f5a4c11da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.641+0000 7f5a53a8e700 1 --2- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c09bc70 0x7f5a4c11da90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5a48000c00 tx=0x7f5a48004750 comp rx=0 tx=0).stop 2023-09-30T22:23:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.641+0000 7f5a53a8e700 1 -- 172.21.15.154:0/3008766286 shutdown_connections 2023-09-30T22:23:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.641+0000 7f5a53a8e700 1 --2- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a4c131980 0x7f5a4c11e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.641+0000 7f5a53a8e700 1 --2- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a4c09bc70 0x7f5a4c11da90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.641+0000 7f5a53a8e700 1 --2- 172.21.15.154:0/3008766286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a4c09c790 0x7f5a4c11dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.641+0000 7f5a53a8e700 1 -- 172.21.15.154:0/3008766286 >> 172.21.15.154:0/3008766286 conn(0x7f5a4c0a2980 msgr2=0x7f5a4c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.641+0000 7f5a53a8e700 1 -- 172.21.15.154:0/3008766286 shutdown_connections 2023-09-30T22:23:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:10.641+0000 7f5a53a8e700 1 -- 172.21.15.154:0/3008766286 wait complete. 2023-09-30T22:23:10.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:11.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:11.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.573+0000 7fb55885a700 1 Processor -- start 2023-09-30T22:23:11.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.573+0000 7fb55885a700 1 -- start start 2023-09-30T22:23:11.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.573+0000 7fb55885a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb554133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.573+0000 7fb55885a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb554130bc0 0x7fb55413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.573+0000 7fb55885a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55406b2d0 con 0x7fb5541300a0 2023-09-30T22:23:11.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.573+0000 7fb55885a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb554133610 con 0x7fb554130bc0 2023-09-30T22:23:11.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.573+0000 7fb55885a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55409a500 con 0x7fb554133ad0 2023-09-30T22:23:11.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb55259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb554133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb552d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb554130bc0 0x7fb55413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb552d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb554130bc0 0x7fb55413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46998/0 (socket says 172.21.15.154:46998) 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb55259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb554133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58170/0 (socket says 172.21.15.154:58170) 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb552d9d700 1 -- 172.21.15.154:0/3663169387 learned_addr learned my addr 172.21.15.154:0/3663169387 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb552d9d700 1 -- 172.21.15.154:0/3663169387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 msgr2=0x7fb554133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb552d9d700 1 --2- 172.21.15.154:0/3663169387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb554133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb552d9d700 1 -- 172.21.15.154:0/3663169387 >> v1:172.21.15.154:6789/0 conn(0x7fb5541300a0 legacy=0x7fb5541304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb552d9d700 1 -- 172.21.15.154:0/3663169387 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5541338b0 con 0x7fb554130bc0 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb55259c700 1 --2- 172.21.15.154:0/3663169387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb554133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:11.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb552d9d700 1 --2- 172.21.15.154:0/3663169387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb554130bc0 0x7fb55413b990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009e50 tx=0x7fb54c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12389d50bcde40c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb55159a700 1 -- 172.21.15.154:0/3663169387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00e070 con 0x7fb554130bc0 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb55159a700 1 -- 172.21.15.154:0/3663169387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00b910 con 0x7fb554130bc0 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.574+0000 7fb55159a700 1 -- 172.21.15.154:0/3663169387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00bcc0 con 0x7fb554130bc0 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.575+0000 7fb55885a700 1 -- 172.21.15.154:0/3663169387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb554130bc0 msgr2=0x7fb55413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.575+0000 7fb55885a700 1 --2- 172.21.15.154:0/3663169387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb554130bc0 0x7fb55413b990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009e50 tx=0x7fb54c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.575+0000 7fb55885a700 1 -- 172.21.15.154:0/3663169387 shutdown_connections 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.575+0000 7fb55885a700 1 --2- 172.21.15.154:0/3663169387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb554130bc0 0x7fb55413b990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.575+0000 7fb55885a700 1 --2- 172.21.15.154:0/3663169387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb554133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.575+0000 7fb55885a700 1 -- 172.21.15.154:0/3663169387 >> 172.21.15.154:0/3663169387 conn(0x7fb554099c40 msgr2=0x7fb5540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.575+0000 7fb55885a700 1 -- 172.21.15.154:0/3663169387 shutdown_connections 2023-09-30T22:23:11.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.575+0000 7fb55885a700 1 -- 172.21.15.154:0/3663169387 wait complete. 2023-09-30T22:23:11.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.576+0000 7fb55885a700 1 Processor -- start 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.576+0000 7fb55885a700 1 -- start start 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.576+0000 7fb55885a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5541300a0 0x7fb55411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.576+0000 7fb55885a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb554130bc0 0x7fb55411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.576+0000 7fb55885a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb55411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.576+0000 7fb55885a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55411fde0 con 0x7fb5541300a0 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.576+0000 7fb55885a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540a3450 con 0x7fb554133ad0 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.576+0000 7fb55885a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb55412dd00 con 0x7fb554130bc0 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5541300a0 0x7fb55411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb552d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb55411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb551d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb554130bc0 0x7fb55411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5541300a0 0x7fb55411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47004/0 (socket says 172.21.15.154:47004) 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55259c700 1 -- 172.21.15.154:0/1781192109 learned_addr learned my addr 172.21.15.154:0/1781192109 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55259c700 1 -- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb554130bc0 msgr2=0x7fb55411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55259c700 1 --2- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb554130bc0 0x7fb55411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55259c700 1 -- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 msgr2=0x7fb55411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55259c700 1 --2- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb55411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55259c700 1 -- 172.21.15.154:0/1781192109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440094a0 con 0x7fb5541300a0 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb552d9d700 1 --2- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb55411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55259c700 1 --2- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5541300a0 0x7fb55411da40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb54400ebe0 tx=0x7fb54400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb542ffd700 1 -- 172.21.15.154:0/1781192109 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400c850 con 0x7fb5541300a0 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb542ffd700 1 -- 172.21.15.154:0/1781192109 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400c9b0 con 0x7fb5541300a0 2023-09-30T22:23:11.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55885a700 1 -- 172.21.15.154:0/1781192109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c009b30 con 0x7fb5541300a0 2023-09-30T22:23:11.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb542ffd700 1 -- 172.21.15.154:0/1781192109 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400cd40 con 0x7fb5541300a0 2023-09-30T22:23:11.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.577+0000 7fb55885a700 1 -- 172.21.15.154:0/1781192109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55411fb20 con 0x7fb5541300a0 2023-09-30T22:23:11.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.578+0000 7fb542ffd700 1 -- 172.21.15.154:0/1781192109 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb544013470 con 0x7fb5541300a0 2023-09-30T22:23:11.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.578+0000 7fb542ffd700 1 -- 172.21.15.154:0/1781192109 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb54403f7e0 con 0x7fb5541300a0 2023-09-30T22:23:11.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.578+0000 7fb55885a700 1 -- 172.21.15.154:0/1781192109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55411f490 con 0x7fb5541300a0 2023-09-30T22:23:11.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.583+0000 7fb542ffd700 1 -- 172.21.15.154:0/1781192109 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb544013720 con 0x7fb5541300a0 2023-09-30T22:23:11.586 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:11.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:11.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.714+0000 7f19b8345700 1 Processor -- start 2023-09-30T22:23:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.714+0000 7f19b8345700 1 -- start start 2023-09-30T22:23:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b8345700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19b009f350 0x7f19b0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b8345700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19b01371c0 0x7f19b01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b8345700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b009c970 con 0x7f19b009e870 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b8345700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b00a0920 con 0x7f19b009f350 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b8345700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b009f9c0 con 0x7f19b01371c0 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b58e0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19b009f350 0x7f19b0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b58e0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19b009f350 0x7f19b0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47006/0 (socket says 172.21.15.154:47006) 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b58e0700 1 -- 172.21.15.154:0/3088542874 learned_addr learned my addr 172.21.15.154:0/3088542874 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b68e2700 1 --2- 172.21.15.154:0/3088542874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19b01371c0 0x7f19b01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b58e0700 1 -- 172.21.15.154:0/3088542874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19b01371c0 msgr2=0x7f19b01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b58e0700 1 --2- 172.21.15.154:0/3088542874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19b01371c0 0x7f19b01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b58e0700 1 -- 172.21.15.154:0/3088542874 >> v1:172.21.15.154:6789/0 conn(0x7f19b009e870 legacy=0x7f19b009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.715+0000 7f19b58e0700 1 -- 172.21.15.154:0/3088542874 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b009bab0 con 0x7f19b009f350 2023-09-30T22:23:11.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.716+0000 7f19b58e0700 1 --2- 172.21.15.154:0/3088542874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 0x7f19b0136c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f19a00098f0 tx=0x7f19a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2a1f00880dfb00 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:11.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.716+0000 7f19b50df700 1 -- 172.21.15.154:0/3088542874 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0011830 con 0x7f19b009f350 2023-09-30T22:23:11.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.716+0000 7f19b50df700 1 -- 172.21.15.154:0/3088542874 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0011990 con 0x7f19b009f350 2023-09-30T22:23:11.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.716+0000 7f19b50df700 1 -- 172.21.15.154:0/3088542874 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0011d20 con 0x7f19b009f350 2023-09-30T22:23:11.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.716+0000 7f19b8345700 1 -- 172.21.15.154:0/3088542874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 msgr2=0x7f19b0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.716+0000 7f19b8345700 1 --2- 172.21.15.154:0/3088542874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 0x7f19b0136c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f19a00098f0 tx=0x7f19a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.717+0000 7f19b8345700 1 -- 172.21.15.154:0/3088542874 shutdown_connections 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.717+0000 7f19b8345700 1 --2- 172.21.15.154:0/3088542874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19b01371c0 0x7f19b01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.717+0000 7f19b8345700 1 --2- 172.21.15.154:0/3088542874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 0x7f19b0136c80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.717+0000 7f19b8345700 1 -- 172.21.15.154:0/3088542874 >> 172.21.15.154:0/3088542874 conn(0x7f19b00a4430 msgr2=0x7f19b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.717+0000 7f19b8345700 1 -- 172.21.15.154:0/3088542874 shutdown_connections 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.717+0000 7f19b8345700 1 -- 172.21.15.154:0/3088542874 wait complete. 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b8345700 1 Processor -- start 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b8345700 1 -- start start 2023-09-30T22:23:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b8345700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19b009e870 0x7f19b0120960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b8345700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 0x7f19b0120ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b8345700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19b01371c0 0x7f19b01213e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b8345700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0124480 con 0x7f19b009f350 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b8345700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b01368e0 con 0x7f19b01371c0 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b8345700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0136b90 con 0x7f19b009e870 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b58e0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 0x7f19b0120ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b58e0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 0x7f19b0120ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47018/0 (socket says 172.21.15.154:47018) 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.718+0000 7f19b58e0700 1 -- 172.21.15.154:0/2480618387 learned_addr learned my addr 172.21.15.154:0/2480618387 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19b58e0700 1 -- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19b009e870 msgr2=0x7f19b0120960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19b58e0700 1 --2- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19b009e870 0x7f19b0120960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19b58e0700 1 -- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19b01371c0 msgr2=0x7f19b01213e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19b58e0700 1 --2- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19b01371c0 0x7f19b01213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19b58e0700 1 -- 172.21.15.154:0/2480618387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0009550 con 0x7f19b009f350 2023-09-30T22:23:11.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19b58e0700 1 --2- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 0x7f19b0120ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000c00 tx=0x7f19a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:11.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19a6ffd700 1 -- 172.21.15.154:0/2480618387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00044f0 con 0x7f19b009f350 2023-09-30T22:23:11.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19a6ffd700 1 -- 172.21.15.154:0/2480618387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a001f070 con 0x7f19b009f350 2023-09-30T22:23:11.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19a6ffd700 1 -- 172.21.15.154:0/2480618387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00038c0 con 0x7f19b009f350 2023-09-30T22:23:11.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19b8345700 1 -- 172.21.15.154:0/2480618387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b009dba0 con 0x7f19b009f350 2023-09-30T22:23:11.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.719+0000 7f19b8345700 1 -- 172.21.15.154:0/2480618387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b0122d60 con 0x7f19b009f350 2023-09-30T22:23:11.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.720+0000 7f19a6ffd700 1 -- 172.21.15.154:0/2480618387 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19a0021030 con 0x7f19b009f350 2023-09-30T22:23:11.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.720+0000 7f19a6ffd700 1 -- 172.21.15.154:0/2480618387 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f19a0040a30 con 0x7f19b009f350 2023-09-30T22:23:11.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.720+0000 7f19b8345700 1 -- 172.21.15.154:0/2480618387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b004f2a0 con 0x7f19b009f350 2023-09-30T22:23:11.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.727+0000 7f2bfb99c700 1 Processor -- start 2023-09-30T22:23:11.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.728+0000 7f2bfb99c700 1 -- start start 2023-09-30T22:23:11.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.728+0000 7f19a6ffd700 1 -- 172.21.15.154:0/2480618387 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19a0015080 con 0x7f19b009f350 2023-09-30T22:23:11.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.728+0000 7f2bfb99c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 0x7f2bf412d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.728+0000 7f2bfb99c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 0x7f2bf4138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.728+0000 7f2bfb99c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf409bb90 con 0x7f2bf4099a60 2023-09-30T22:23:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bfb99c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf409c210 con 0x7f2bf409a5a0 2023-09-30T22:23:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bfb99c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf409ced0 con 0x7f2bf412d380 2023-09-30T22:23:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bf9738700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 0x7f2bf412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bf8f37700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2bf4099a60 0x7f2bf4099e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42110/0 (socket says 172.21.15.154:42110) 2023-09-30T22:23:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bf8f37700 1 -- 172.21.15.154:0/2642563582 learned_addr learned my addr 172.21.15.154:0/2642563582 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:11.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bf9f39700 1 --2- 172.21.15.154:0/2642563582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 0x7f2bf4138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bebfff700 1 -- 172.21.15.154:0/2642563582 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189676039 0 0) 0x7f2bf409bb90 con 0x7f2bf4099a60 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bebfff700 1 -- 172.21.15.154:0/2642563582 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2be00034b0 con 0x7f2bf4099a60 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bf9738700 1 -- 172.21.15.154:0/2642563582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 msgr2=0x7f2bf4138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bf9738700 1 --2- 172.21.15.154:0/2642563582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 0x7f2bf4138620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bf9738700 1 -- 172.21.15.154:0/2642563582 >> v1:172.21.15.154:6789/0 conn(0x7f2bf4099a60 legacy=0x7f2bf4099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bf9738700 1 -- 172.21.15.154:0/2642563582 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf409ac30 con 0x7f2bf412d380 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.729+0000 7f2bf9738700 1 --2- 172.21.15.154:0/2642563582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 0x7f2bf412d750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009850 tx=0x7f2bf0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb1c86262ee747c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.730+0000 7f2bebfff700 1 -- 172.21.15.154:0/2642563582 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4001670 con 0x7f2bf412d380 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.730+0000 7f2bebfff700 1 -- 172.21.15.154:0/2642563582 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0005c30 con 0x7f2bf412d380 2023-09-30T22:23:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.730+0000 7f2bebfff700 1 -- 172.21.15.154:0/2642563582 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0006030 con 0x7f2bf412d380 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.730+0000 7f2bfb99c700 1 -- 172.21.15.154:0/2642563582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 msgr2=0x7f2bf412d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.731+0000 7f2bfb99c700 1 --2- 172.21.15.154:0/2642563582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 0x7f2bf412d750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009850 tx=0x7f2bf0009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.731+0000 7f2bfb99c700 1 -- 172.21.15.154:0/2642563582 shutdown_connections 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.731+0000 7f2bfb99c700 1 --2- 172.21.15.154:0/2642563582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 0x7f2bf4138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.731+0000 7f2bfb99c700 1 --2- 172.21.15.154:0/2642563582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 0x7f2bf412d750 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.731+0000 7f2bfb99c700 1 -- 172.21.15.154:0/2642563582 >> 172.21.15.154:0/2642563582 conn(0x7f2bf40a2980 msgr2=0x7f2bf40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.731+0000 7f2bfb99c700 1 -- 172.21.15.154:0/2642563582 shutdown_connections 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.731+0000 7f2bfb99c700 1 -- 172.21.15.154:0/2642563582 wait complete. 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.732+0000 7f2bfb99c700 1 Processor -- start 2023-09-30T22:23:11.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.732+0000 7f2bfb99c700 1 -- start start 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bfb99c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf4099a60 0x7f2bf4070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bfb99c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 0x7f2bf4070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bfb99c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 0x7f2bf40713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bfb99c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf4071de0 con 0x7f2bf4099a60 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bfb99c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf41192f0 con 0x7f2bf409a5a0 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bfb99c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf4119910 con 0x7f2bf412d380 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9738700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf4099a60 0x7f2bf4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9738700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf4099a60 0x7f2bf4070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47034/0 (socket says 172.21.15.154:47034) 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9738700 1 -- 172.21.15.154:0/1738183977 learned_addr learned my addr 172.21.15.154:0/1738183977 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9f39700 1 --2- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 0x7f2bf40713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf8f37700 1 --2- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 0x7f2bf4070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9738700 1 -- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 msgr2=0x7f2bf40713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9738700 1 --2- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 0x7f2bf40713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9738700 1 -- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 msgr2=0x7f2bf4070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9738700 1 --2- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 0x7f2bf4070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9738700 1 -- 172.21.15.154:0/1738183977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0009430 con 0x7f2bf4099a60 2023-09-30T22:23:11.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.733+0000 7f2bf9738700 1 --2- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf4099a60 0x7f2bf4070950 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009eb0 tx=0x7f2bf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:11.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.734+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1738183977 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf00038a0 con 0x7f2bf4099a60 2023-09-30T22:23:11.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.734+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1738183977 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0003a00 con 0x7f2bf4099a60 2023-09-30T22:23:11.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.734+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1738183977 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0003db0 con 0x7f2bf4099a60 2023-09-30T22:23:11.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.734+0000 7f2bfb99c700 1 -- 172.21.15.154:0/1738183977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf411af20 con 0x7f2bf4099a60 2023-09-30T22:23:11.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.735+0000 7f2bfb99c700 1 -- 172.21.15.154:0/1738183977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf40a1680 con 0x7f2bf4099a60 2023-09-30T22:23:11.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.735+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1738183977 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bf0006030 con 0x7f2bf4099a60 2023-09-30T22:23:11.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.735+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1738183977 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2bf00407d0 con 0x7f2bf4099a60 2023-09-30T22:23:11.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.737+0000 7f2bfb99c700 1 -- 172.21.15.154:0/1738183977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf406b730 con 0x7f2bf4099a60 2023-09-30T22:23:11.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.742+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1738183977 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bf406b730 con 0x7f2bf4099a60 2023-09-30T22:23:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.789+0000 7fb55885a700 1 -- 172.21.15.154:0/1781192109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb55411f910 con 0x7fb5541300a0 2023-09-30T22:23:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.789+0000 7fb542ffd700 1 -- 172.21.15.154:0/1781192109 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb54401b9c0 con 0x7fb5541300a0 2023-09-30T22:23:11.790 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:11.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.791+0000 7fb55885a700 1 -- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5541300a0 msgr2=0x7fb55411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.791+0000 7fb55885a700 1 --2- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5541300a0 0x7fb55411da40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb54400ebe0 tx=0x7fb54400eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.791+0000 7fb55885a700 1 -- 172.21.15.154:0/1781192109 shutdown_connections 2023-09-30T22:23:11.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.791+0000 7fb55885a700 1 --2- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb554133ad0 0x7fb55411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.791+0000 7fb55885a700 1 --2- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5541300a0 0x7fb55411da40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.791+0000 7fb55885a700 1 --2- 172.21.15.154:0/1781192109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb554130bc0 0x7fb55411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.791+0000 7fb55885a700 1 -- 172.21.15.154:0/1781192109 >> 172.21.15.154:0/1781192109 conn(0x7fb554099c40 msgr2=0x7fb55412e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.791+0000 7fb55885a700 1 -- 172.21.15.154:0/1781192109 shutdown_connections 2023-09-30T22:23:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.791+0000 7fb55885a700 1 -- 172.21.15.154:0/1781192109 wait complete. 2023-09-30T22:23:11.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.804+0000 7fb52f6de700 1 Processor -- start 2023-09-30T22:23:11.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.804+0000 7fb52f6de700 1 -- start start 2023-09-30T22:23:11.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:11.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.805+0000 7fb52f6de700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb528066410 0x7fb5281319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.805+0000 7fb52f6de700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5281314b0 0x7fb528131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.805+0000 7fb52f6de700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5280a0f20 con 0x7fb52809bc70 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.805+0000 7fb52f6de700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5280667e0 con 0x7fb5281314b0 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.805+0000 7fb52f6de700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280a23c0 con 0x7fb528066410 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.805+0000 7fb52d47a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb528066410 0x7fb5281319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.805+0000 7fb52dc7b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb52809bc70 0x7fb52809c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42122/0 (socket says 172.21.15.154:42122) 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.805+0000 7fb52dc7b700 1 -- 172.21.15.154:0/1841954825 learned_addr learned my addr 172.21.15.154:0/1841954825 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb52cc79700 1 --2- 172.21.15.154:0/1841954825 >> v2:172.21.15.154:3300/0 conn(0x7fb5281314b0 0x7fb528131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb51ffff700 1 -- 172.21.15.154:0/1841954825 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529330298 0 0) 0x7fb5280a0f20 con 0x7fb52809bc70 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb51ffff700 1 -- 172.21.15.154:0/1841954825 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5140035b0 con 0x7fb52809bc70 2023-09-30T22:23:11.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb52d47a700 1 -- 172.21.15.154:0/1841954825 >> v2:172.21.15.154:3300/0 conn(0x7fb5281314b0 msgr2=0x7fb528131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb52d47a700 1 --2- 172.21.15.154:0/1841954825 >> v2:172.21.15.154:3300/0 conn(0x7fb5281314b0 0x7fb528131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb52d47a700 1 -- 172.21.15.154:0/1841954825 >> v1:172.21.15.154:6789/0 conn(0x7fb52809bc70 legacy=0x7fb52809c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb52d47a700 1 -- 172.21.15.154:0/1841954825 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280a16e0 con 0x7fb528066410 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb52d47a700 1 --2- 172.21.15.154:0/1841954825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb528066410 0x7fb5281319f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb524009850 tx=0x7fb524009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b71eba67a847e317 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb51ffff700 1 -- 172.21.15.154:0/1841954825 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524005e30 con 0x7fb528066410 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb51ffff700 1 -- 172.21.15.154:0/1841954825 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb524006030 con 0x7fb528066410 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.806+0000 7fb51ffff700 1 -- 172.21.15.154:0/1841954825 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5240063a0 con 0x7fb528066410 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.807+0000 7fb52f6de700 1 -- 172.21.15.154:0/1841954825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb528066410 msgr2=0x7fb5281319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.807+0000 7fb52f6de700 1 --2- 172.21.15.154:0/1841954825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb528066410 0x7fb5281319f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb524009850 tx=0x7fb524009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.807+0000 7fb52f6de700 1 -- 172.21.15.154:0/1841954825 shutdown_connections 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.807+0000 7fb52f6de700 1 --2- 172.21.15.154:0/1841954825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb528066410 0x7fb5281319f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.807+0000 7fb52f6de700 1 --2- 172.21.15.154:0/1841954825 >> v2:172.21.15.154:3300/0 conn(0x7fb5281314b0 0x7fb528131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.807+0000 7fb52f6de700 1 -- 172.21.15.154:0/1841954825 >> 172.21.15.154:0/1841954825 conn(0x7fb5280a2980 msgr2=0x7fb5280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:11.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.807+0000 7fb52f6de700 1 -- 172.21.15.154:0/1841954825 shutdown_connections 2023-09-30T22:23:11.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.807+0000 7fb52f6de700 1 -- 172.21.15.154:0/1841954825 wait complete. 2023-09-30T22:23:11.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52f6de700 1 Processor -- start 2023-09-30T22:23:11.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52f6de700 1 -- start start 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52f6de700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb528066410 0x7fb528118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52f6de700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb52809bc70 0x7fb528119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52f6de700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5281314b0 0x7fb528119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52f6de700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52811a2b0 con 0x7fb528066410 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52f6de700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb528130570 con 0x7fb5281314b0 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52f6de700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280a1d50 con 0x7fb52809bc70 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52d47a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb528066410 0x7fb528118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52cc79700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb52809bc70 0x7fb528119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.808+0000 7fb52d47a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb528066410 0x7fb528118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47052/0 (socket says 172.21.15.154:47052) 2023-09-30T22:23:11.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52d47a700 1 -- 172.21.15.154:0/3353847733 learned_addr learned my addr 172.21.15.154:0/3353847733 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52dc7b700 1 --2- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5281314b0 0x7fb528119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52cc79700 1 -- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5281314b0 msgr2=0x7fb528119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52cc79700 1 --2- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5281314b0 0x7fb528119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52cc79700 1 -- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb528066410 msgr2=0x7fb528118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52cc79700 1 --2- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb528066410 0x7fb528118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52cc79700 1 -- 172.21.15.154:0/3353847733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb524009430 con 0x7fb52809bc70 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52d47a700 1 --2- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb528066410 0x7fb528118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52cc79700 1 --2- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb52809bc70 0x7fb528119330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb51800e8d0 tx=0x7fb51800ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb51dffb700 1 -- 172.21.15.154:0/3353847733 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518013680 con 0x7fb52809bc70 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb51dffb700 1 -- 172.21.15.154:0/3353847733 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5180137e0 con 0x7fb52809bc70 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52f6de700 1 -- 172.21.15.154:0/3353847733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52811aed0 con 0x7fb52809bc70 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb51dffb700 1 -- 172.21.15.154:0/3353847733 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518013b50 con 0x7fb52809bc70 2023-09-30T22:23:11.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.809+0000 7fb52f6de700 1 -- 172.21.15.154:0/3353847733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52811b190 con 0x7fb52809bc70 2023-09-30T22:23:11.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.810+0000 7fb51dffb700 1 -- 172.21.15.154:0/3353847733 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb518013cb0 con 0x7fb52809bc70 2023-09-30T22:23:11.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.811+0000 7fb52f6de700 1 -- 172.21.15.154:0/3353847733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52804f2a0 con 0x7fb52809bc70 2023-09-30T22:23:11.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.811+0000 7fb51dffb700 1 -- 172.21.15.154:0/3353847733 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb51803f640 con 0x7fb52809bc70 2023-09-30T22:23:11.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.815+0000 7fb51dffb700 1 -- 172.21.15.154:0/3353847733 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb518021080 con 0x7fb52809bc70 2023-09-30T22:23:11.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.940+0000 7f2bfb99c700 1 -- 172.21.15.154:0/1738183977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2bf406b730 con 0x7f2bf4099a60 2023-09-30T22:23:11.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.941+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1738183977 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bf406b730 con 0x7f2bf4099a60 2023-09-30T22:23:11.941 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:11.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.942+0000 7f19b8345700 1 -- 172.21.15.154:0/2480618387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f19b006b2a0 con 0x7f19b009f350 2023-09-30T22:23:11.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.942+0000 7f19a6ffd700 1 -- 172.21.15.154:0/2480618387 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19a0003a20 con 0x7f19b009f350 2023-09-30T22:23:11.942 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:11.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.943+0000 7f2bfb99c700 1 -- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf4099a60 msgr2=0x7f2bf4070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.943+0000 7f2bfb99c700 1 --2- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf4099a60 0x7f2bf4070950 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009eb0 tx=0x7f2bf0004750 comp rx=0 tx=0).stop 2023-09-30T22:23:11.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.943+0000 7f2bfb99c700 1 -- 172.21.15.154:0/1738183977 shutdown_connections 2023-09-30T22:23:11.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.943+0000 7f2bfb99c700 1 --2- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf412d380 0x7f2bf40713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.943+0000 7f2bfb99c700 1 --2- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf4099a60 0x7f2bf4070950 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.943+0000 7f2bfb99c700 1 --2- 172.21.15.154:0/1738183977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409a5a0 0x7f2bf4070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.943+0000 7f2bfb99c700 1 -- 172.21.15.154:0/1738183977 >> 172.21.15.154:0/1738183977 conn(0x7f2bf40a2980 msgr2=0x7f2bf412c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:11.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.943+0000 7f2bfb99c700 1 -- 172.21.15.154:0/1738183977 shutdown_connections 2023-09-30T22:23:11.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.943+0000 7f2bfb99c700 1 -- 172.21.15.154:0/1738183977 wait complete. 2023-09-30T22:23:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.945+0000 7f19b8345700 1 -- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 msgr2=0x7f19b0120ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.945+0000 7f19b8345700 1 --2- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 0x7f19b0120ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000c00 tx=0x7f19a0004750 comp rx=0 tx=0).stop 2023-09-30T22:23:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.945+0000 7f19b8345700 1 -- 172.21.15.154:0/2480618387 shutdown_connections 2023-09-30T22:23:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.945+0000 7f19b8345700 1 --2- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19b01371c0 0x7f19b01213e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.945+0000 7f19b8345700 1 --2- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19b009e870 0x7f19b0120960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.945+0000 7f19b8345700 1 --2- 172.21.15.154:0/2480618387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19b009f350 0x7f19b0120ea0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.945+0000 7f19b8345700 1 -- 172.21.15.154:0/2480618387 >> 172.21.15.154:0/2480618387 conn(0x7f19b00a4430 msgr2=0x7f19b00a2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.945+0000 7f19b8345700 1 -- 172.21.15.154:0/2480618387 shutdown_connections 2023-09-30T22:23:11.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:11.945+0000 7f19b8345700 1 -- 172.21.15.154:0/2480618387 wait complete. 2023-09-30T22:23:11.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:11.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:12.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.011+0000 7fb52f6de700 1 -- 172.21.15.154:0/3353847733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb528119f50 con 0x7fb52809bc70 2023-09-30T22:23:12.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.011+0000 7fb51dffb700 1 -- 172.21.15.154:0/3353847733 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb518017020 con 0x7fb52809bc70 2023-09-30T22:23:12.011 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.013+0000 7fb52f6de700 1 -- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb52809bc70 msgr2=0x7fb528119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.013+0000 7fb52f6de700 1 --2- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb52809bc70 0x7fb528119330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb51800e8d0 tx=0x7fb51800ebe0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.013+0000 7fb52f6de700 1 -- 172.21.15.154:0/3353847733 shutdown_connections 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.013+0000 7fb52f6de700 1 --2- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5281314b0 0x7fb528119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.013+0000 7fb52f6de700 1 --2- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb528066410 0x7fb528118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.013+0000 7fb52f6de700 1 --2- 172.21.15.154:0/3353847733 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb52809bc70 0x7fb528119330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.013+0000 7fb52f6de700 1 -- 172.21.15.154:0/3353847733 >> 172.21.15.154:0/3353847733 conn(0x7fb5280a2980 msgr2=0x7fb528139060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.013+0000 7fb52f6de700 1 -- 172.21.15.154:0/3353847733 shutdown_connections 2023-09-30T22:23:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.013+0000 7fb52f6de700 1 -- 172.21.15.154:0/3353847733 wait complete. 2023-09-30T22:23:12.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:12.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff7719e8700 1 Processor -- start 2023-09-30T22:23:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff7719e8700 1 -- start start 2023-09-30T22:23:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff7719e8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a0a90 0x7ff76c0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff7719e8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff76c0a13a0 0x7ff76c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff7719e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c133f70 0x7ff76c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff7719e8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c0a3aa0 con 0x7ff76c0a13a0 2023-09-30T22:23:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff7719e8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c09a540 con 0x7ff76c133f70 2023-09-30T22:23:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff7719e8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0a1fe0 con 0x7ff76c0a0a90 2023-09-30T22:23:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff76affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a0a90 0x7ff76c0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff76b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c133f70 0x7ff76c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff76a7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff76c0a13a0 0x7ff76c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff76affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a0a90 0x7ff76c0a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34894/0 (socket says 172.21.15.154:34894) 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff76b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c133f70 0x7ff76c1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58226/0 (socket says 172.21.15.154:58226) 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.932+0000 7ff76affd700 1 -- 172.21.15.154:0/2064845655 learned_addr learned my addr 172.21.15.154:0/2064845655 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff76a7fc700 1 -- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a0a90 msgr2=0x7ff76c0a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff76a7fc700 1 --2- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a0a90 0x7ff76c0a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff76a7fc700 1 -- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c133f70 msgr2=0x7ff76c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff76a7fc700 1 --2- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c133f70 0x7ff76c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff76a7fc700 1 -- 172.21.15.154:0/2064845655 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c09a280 con 0x7ff76c0a13a0 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff76affd700 1 --2- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a0a90 0x7ff76c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff76b7fe700 1 --2- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c133f70 0x7ff76c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff76a7fc700 1 --2- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c0a13a0 0x7ff76c133a30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff760009870 tx=0x7ff760009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1884c33f08d8b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff769ffb700 1 -- 172.21.15.154:0/2064845655 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760011830 con 0x7ff76c0a13a0 2023-09-30T22:23:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff769ffb700 1 -- 172.21.15.154:0/2064845655 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff760011990 con 0x7ff76c0a13a0 2023-09-30T22:23:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff769ffb700 1 -- 172.21.15.154:0/2064845655 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760011d20 con 0x7ff76c0a13a0 2023-09-30T22:23:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff7719e8700 1 -- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c0a13a0 msgr2=0x7ff76c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.933+0000 7ff7719e8700 1 --2- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c0a13a0 0x7ff76c133a30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff760009870 tx=0x7ff760009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.934+0000 7ff7719e8700 1 -- 172.21.15.154:0/2064845655 shutdown_connections 2023-09-30T22:23:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.934+0000 7ff7719e8700 1 --2- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c133f70 0x7ff76c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.934+0000 7ff7719e8700 1 --2- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a0a90 0x7ff76c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.934+0000 7ff7719e8700 1 --2- 172.21.15.154:0/2064845655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c0a13a0 0x7ff76c133a30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.934+0000 7ff7719e8700 1 -- 172.21.15.154:0/2064845655 >> 172.21.15.154:0/2064845655 conn(0x7ff76c099c40 msgr2=0x7ff76c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:12.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.934+0000 7ff7719e8700 1 -- 172.21.15.154:0/2064845655 shutdown_connections 2023-09-30T22:23:12.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.934+0000 7ff7719e8700 1 -- 172.21.15.154:0/2064845655 wait complete. 2023-09-30T22:23:12.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.934+0000 7ff7719e8700 1 Processor -- start 2023-09-30T22:23:12.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff7719e8700 1 -- start start 2023-09-30T22:23:12.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff7719e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c0a0a90 0x7ff76c122300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff7719e8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a13a0 0x7ff76c122840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff7719e8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c133f70 0x7ff76c122d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:12.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff7719e8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c124e10 con 0x7ff76c133f70 2023-09-30T22:23:12.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff7719e8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c125240 con 0x7ff76c0a0a90 2023-09-30T22:23:12.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff7719e8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c124100 con 0x7ff76c0a13a0 2023-09-30T22:23:12.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a13a0 0x7ff76c122840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c0a0a90 0x7ff76c122300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c133f70 0x7ff76c122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a13a0 0x7ff76c122840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34904/0 (socket says 172.21.15.154:34904) 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76a7fc700 1 -- 172.21.15.154:0/215323120 learned_addr learned my addr 172.21.15.154:0/215323120 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c0a0a90 0x7ff76c122300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58240/0 (socket says 172.21.15.154:58240) 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76b7fe700 1 -- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a13a0 msgr2=0x7ff76c122840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76b7fe700 1 --2- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a13a0 0x7ff76c122840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76b7fe700 1 -- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c0a0a90 msgr2=0x7ff76c122300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76b7fe700 1 --2- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c0a0a90 0x7ff76c122300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76b7fe700 1 -- 172.21.15.154:0/215323120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c009550 con 0x7ff76c133f70 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76a7fc700 1 --2- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a13a0 0x7ff76c122840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:12.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.935+0000 7ff76affd700 1 --2- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c0a0a90 0x7ff76c122300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:12.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.936+0000 7ff76b7fe700 1 --2- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c133f70 0x7ff76c122d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff764009e50 tx=0x7ff76400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:12.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.936+0000 7ff753fff700 1 -- 172.21.15.154:0/215323120 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764009cc0 con 0x7ff76c133f70 2023-09-30T22:23:12.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.936+0000 7ff753fff700 1 -- 172.21.15.154:0/215323120 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76400f040 con 0x7ff76c133f70 2023-09-30T22:23:12.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.936+0000 7ff753fff700 1 -- 172.21.15.154:0/215323120 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400cd60 con 0x7ff76c133f70 2023-09-30T22:23:12.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.936+0000 7ff7719e8700 1 -- 172.21.15.154:0/215323120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff764009a70 con 0x7ff76c133f70 2023-09-30T22:23:12.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.936+0000 7ff7719e8700 1 -- 172.21.15.154:0/215323120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7600094a0 con 0x7ff76c133f70 2023-09-30T22:23:12.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.936+0000 7ff753fff700 1 -- 172.21.15.154:0/215323120 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff764014480 con 0x7ff76c133f70 2023-09-30T22:23:12.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.937+0000 7ff7719e8700 1 -- 172.21.15.154:0/215323120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76c09c840 con 0x7ff76c133f70 2023-09-30T22:23:12.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.937+0000 7ff753fff700 1 -- 172.21.15.154:0/215323120 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff76403fd30 con 0x7ff76c133f70 2023-09-30T22:23:12.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:12.941+0000 7ff753fff700 1 -- 172.21.15.154:0/215323120 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff764012930 con 0x7ff76c133f70 2023-09-30T22:23:12.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:12.962 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:13.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:13.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.090+0000 7f4bf1fa0700 1 Processor -- start 2023-09-30T22:23:13.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.090+0000 7f4bf1fa0700 1 -- start start 2023-09-30T22:23:13.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.090+0000 7f4bf1fa0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4bec09bb60 0x7f4bec09e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.090+0000 7f4bf1fa0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec12cf70 0x7f4bec130010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.090+0000 7f4bf1fa0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec09aaa0 con 0x7f4bec130550 2023-09-30T22:23:13.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.090+0000 7f4bf1fa0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec09bf30 con 0x7f4bec09bb60 2023-09-30T22:23:13.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.090+0000 7f4bf1fa0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec09a8e0 con 0x7f4bec12cf70 2023-09-30T22:23:13.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bf0f9e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4bec09bb60 0x7f4bec09e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bf0f9e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4bec09bb60 0x7f4bec09e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47078/0 (socket says 172.21.15.154:47078) 2023-09-30T22:23:13.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bf0f9e700 1 -- 172.21.15.154:0/253217233 learned_addr learned my addr 172.21.15.154:0/253217233 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:13.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bf179f700 1 --1- 172.21.15.154:0/253217233 >> v1:172.21.15.154:6789/0 conn(0x7f4bec130550 0x7f4bec1373a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42124/0 (socket says 172.21.15.154:42124) 2023-09-30T22:23:13.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bebfff700 1 --2- 172.21.15.154:0/253217233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec12cf70 0x7f4bec130010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bebfff700 1 -- 172.21.15.154:0/253217233 >> v2:172.21.15.154:3300/0 conn(0x7f4bec09bb60 msgr2=0x7f4bec09e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bebfff700 1 --2- 172.21.15.154:0/253217233 >> v2:172.21.15.154:3300/0 conn(0x7f4bec09bb60 0x7f4bec09e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bebfff700 1 -- 172.21.15.154:0/253217233 >> v1:172.21.15.154:6789/0 conn(0x7f4bec130550 legacy=0x7f4bec1373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bebfff700 1 -- 172.21.15.154:0/253217233 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec12d450 con 0x7f4bec12cf70 2023-09-30T22:23:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bf0f9e700 1 --2- 172.21.15.154:0/253217233 >> v2:172.21.15.154:3300/0 conn(0x7f4bec09bb60 0x7f4bec09e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4bebfff700 1 --2- 172.21.15.154:0/253217233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec12cf70 0x7f4bec130010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800ddc0 tx=0x7f4bd800f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d7945f1b3da84d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4beb7fe700 1 -- 172.21.15.154:0/253217233 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8012070 con 0x7f4bec12cf70 2023-09-30T22:23:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4beb7fe700 1 -- 172.21.15.154:0/253217233 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd800fae0 con 0x7f4bec12cf70 2023-09-30T22:23:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.091+0000 7f4beb7fe700 1 -- 172.21.15.154:0/253217233 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd800fe90 con 0x7f4bec12cf70 2023-09-30T22:23:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.092+0000 7f522cdab700 1 Processor -- start 2023-09-30T22:23:13.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.092+0000 7f522cdab700 1 -- start start 2023-09-30T22:23:13.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.092+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/253217233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec12cf70 msgr2=0x7f4bec130010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.092+0000 7f4bf1fa0700 1 --2- 172.21.15.154:0/253217233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec12cf70 0x7f4bec130010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800ddc0 tx=0x7f4bd800f330 comp rx=0 tx=0).stop 2023-09-30T22:23:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522cdab700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52280a0a90 0x7f52280a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522cdab700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52280a13a0 0x7f5228133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522cdab700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52280a1fe0 con 0x7f5228133f70 2023-09-30T22:23:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522cdab700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52280a3aa0 con 0x7f52280a0a90 2023-09-30T22:23:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522cdab700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522809a540 con 0x7f52280a13a0 2023-09-30T22:23:13.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/253217233 shutdown_connections 2023-09-30T22:23:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f4bf1fa0700 1 --2- 172.21.15.154:0/253217233 >> v2:172.21.15.154:3300/0 conn(0x7f4bec09bb60 0x7f4bec09e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f4bf1fa0700 1 --2- 172.21.15.154:0/253217233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec12cf70 0x7f4bec130010 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/253217233 >> 172.21.15.154:0/253217233 conn(0x7f4bec0a2d80 msgr2=0x7f4bec0a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52280a0a90 0x7f52280a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52280a0a90 0x7f52280a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47088/0 (socket says 172.21.15.154:47088) 2023-09-30T22:23:13.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522659c700 1 -- 172.21.15.154:0/1389678256 learned_addr learned my addr 172.21.15.154:0/1389678256 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:13.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/253217233 shutdown_connections 2023-09-30T22:23:13.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/253217233 wait complete. 2023-09-30T22:23:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522659c700 1 -- 172.21.15.154:0/1389678256 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52280a13a0 msgr2=0x7f5228133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522659c700 1 --2- 172.21.15.154:0/1389678256 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52280a13a0 0x7f5228133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522659c700 1 -- 172.21.15.154:0/1389678256 >> v1:172.21.15.154:6789/0 conn(0x7f5228133f70 legacy=0x7f522813ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522659c700 1 -- 172.21.15.154:0/1389678256 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522809a280 con 0x7f52280a0a90 2023-09-30T22:23:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.093+0000 7f522659c700 1 --2- 172.21.15.154:0/1389678256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52280a0a90 0x7f52280a0e60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5220009e50 tx=0x7f522000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86e5f9c2ad7310d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.094+0000 7f522559a700 1 -- 172.21.15.154:0/1389678256 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000e070 con 0x7f52280a0a90 2023-09-30T22:23:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.094+0000 7f522559a700 1 -- 172.21.15.154:0/1389678256 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220003a20 con 0x7f52280a0a90 2023-09-30T22:23:13.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.094+0000 7f522559a700 1 -- 172.21.15.154:0/1389678256 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220003dd0 con 0x7f52280a0a90 2023-09-30T22:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.094+0000 7f4bf1fa0700 1 Processor -- start 2023-09-30T22:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.094+0000 7f522cdab700 1 -- 172.21.15.154:0/1389678256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52280a0a90 msgr2=0x7f52280a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.094+0000 7f522cdab700 1 --2- 172.21.15.154:0/1389678256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52280a0a90 0x7f52280a0e60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5220009e50 tx=0x7f522000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f522cdab700 1 -- 172.21.15.154:0/1389678256 shutdown_connections 2023-09-30T22:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f522cdab700 1 --2- 172.21.15.154:0/1389678256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52280a0a90 0x7f52280a0e60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f522cdab700 1 --2- 172.21.15.154:0/1389678256 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52280a13a0 0x7f5228133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f522cdab700 1 -- 172.21.15.154:0/1389678256 >> 172.21.15.154:0/1389678256 conn(0x7f5228099c40 msgr2=0x7f522806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f522cdab700 1 -- 172.21.15.154:0/1389678256 shutdown_connections 2023-09-30T22:23:13.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f522cdab700 1 -- 172.21.15.154:0/1389678256 wait complete. 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bf1fa0700 1 -- start start 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bf1fa0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bec09bb60 0x7f4bec071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bf1fa0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec12cf70 0x7f4bec071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bf1fa0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec130550 0x7f4bec1cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bf1fa0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec072210 con 0x7f4bec12cf70 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bf1fa0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec071380 con 0x7f4bec130550 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bf1fa0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec1229f0 con 0x7f4bec09bb60 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec12cf70 0x7f4bec071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec12cf70 0x7f4bec071cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47098/0 (socket says 172.21.15.154:47098) 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bebfff700 1 -- 172.21.15.154:0/366563602 learned_addr learned my addr 172.21.15.154:0/366563602 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:13.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.095+0000 7f4bf179f700 1 --2- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec130550 0x7f4bec1cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4bebfff700 1 -- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bec09bb60 msgr2=0x7f4bec071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4bebfff700 1 --2- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bec09bb60 0x7f4bec071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4bebfff700 1 -- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec130550 msgr2=0x7f4bec1cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4bebfff700 1 --2- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec130550 0x7f4bec1cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4bebfff700 1 -- 172.21.15.154:0/366563602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be000b600 con 0x7f4bec12cf70 2023-09-30T22:23:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4bebfff700 1 --2- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec12cf70 0x7f4bec071cd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800dfd0 tx=0x7f4bd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f522cdab700 1 Processor -- start 2023-09-30T22:23:13.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4be97fa700 1 -- 172.21.15.154:0/366563602 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80036a0 con 0x7f4bec12cf70 2023-09-30T22:23:13.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4be97fa700 1 -- 172.21.15.154:0/366563602 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd8003820 con 0x7f4bec12cf70 2023-09-30T22:23:13.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/366563602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd800da70 con 0x7f4bec12cf70 2023-09-30T22:23:13.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f522cdab700 1 -- start start 2023-09-30T22:23:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.096+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/366563602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec12a6a0 con 0x7f4bec12cf70 2023-09-30T22:23:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.097+0000 7f522cdab700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52280a0a90 0x7f52281223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.097+0000 7f522cdab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52280a13a0 0x7f5228122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.097+0000 7f522cdab700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5228133f70 0x7f5228122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.097+0000 7f522cdab700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5228125250 con 0x7f52280a0a90 2023-09-30T22:23:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.097+0000 7f522cdab700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5228124180 con 0x7f52280a13a0 2023-09-30T22:23:13.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.097+0000 7f522cdab700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5228124e90 con 0x7f5228133f70 2023-09-30T22:23:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.097+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/366563602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec04f2a0 con 0x7f4bec12cf70 2023-09-30T22:23:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.097+0000 7f5226d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5228133f70 0x7f5228122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f5226d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5228133f70 0x7f5228122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34928/0 (socket says 172.21.15.154:34928) 2023-09-30T22:23:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f5226d9d700 1 -- 172.21.15.154:0/3948535093 learned_addr learned my addr 172.21.15.154:0/3948535093 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:13.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f522659c700 1 --2- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52280a0a90 0x7f52281223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f4be97fa700 1 -- 172.21.15.154:0/366563602 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8003bd0 con 0x7f4bec12cf70 2023-09-30T22:23:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f5225d9b700 1 --2- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52280a13a0 0x7f5228122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f5226d9d700 1 -- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52280a13a0 msgr2=0x7f5228122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f5226d9d700 1 --2- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52280a13a0 0x7f5228122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f5226d9d700 1 -- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52280a0a90 msgr2=0x7f52281223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f5226d9d700 1 --2- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52280a0a90 0x7f52281223f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f5226d9d700 1 -- 172.21.15.154:0/3948535093 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220009b30 con 0x7f5228133f70 2023-09-30T22:23:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f5226d9d700 1 --2- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5228133f70 0x7f5228122e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f521c00c450 tx=0x7f521c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.098+0000 7f4be97fa700 1 -- 172.21.15.154:0/366563602 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bd8003d30 con 0x7f4bec12cf70 2023-09-30T22:23:13.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.099+0000 7f4be97fa700 1 -- 172.21.15.154:0/366563602 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4bd8041070 con 0x7f4bec12cf70 2023-09-30T22:23:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.099+0000 7f5216ffd700 1 -- 172.21.15.154:0/3948535093 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c011790 con 0x7f5228133f70 2023-09-30T22:23:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.099+0000 7f5216ffd700 1 -- 172.21.15.154:0/3948535093 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c011910 con 0x7f5228133f70 2023-09-30T22:23:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.099+0000 7f5216ffd700 1 -- 172.21.15.154:0/3948535093 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c011cc0 con 0x7f5228133f70 2023-09-30T22:23:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.099+0000 7f522cdab700 1 -- 172.21.15.154:0/3948535093 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522809c7e0 con 0x7f5228133f70 2023-09-30T22:23:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.099+0000 7f522cdab700 1 -- 172.21.15.154:0/3948535093 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5228125970 con 0x7f5228133f70 2023-09-30T22:23:13.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.100+0000 7f5216ffd700 1 -- 172.21.15.154:0/3948535093 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f521c01c460 con 0x7f5228133f70 2023-09-30T22:23:13.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.100+0000 7f522cdab700 1 -- 172.21.15.154:0/3948535093 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522804f2a0 con 0x7f5228133f70 2023-09-30T22:23:13.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.100+0000 7f5216ffd700 1 -- 172.21.15.154:0/3948535093 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f521c011e20 con 0x7f5228133f70 2023-09-30T22:23:13.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.104+0000 7f4be97fa700 1 -- 172.21.15.154:0/366563602 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bd8026770 con 0x7f4bec12cf70 2023-09-30T22:23:13.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.109+0000 7f5216ffd700 1 -- 172.21.15.154:0/3948535093 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f521c044060 con 0x7f5228133f70 2023-09-30T22:23:13.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.147+0000 7ff7719e8700 1 -- 172.21.15.154:0/215323120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff76c04f2a0 con 0x7ff76c133f70 2023-09-30T22:23:13.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.148+0000 7ff753fff700 1 -- 172.21.15.154:0/215323120 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff764012340 con 0x7ff76c133f70 2023-09-30T22:23:13.148 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:13.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.152+0000 7ff7719e8700 1 -- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c133f70 msgr2=0x7ff76c122d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.152+0000 7ff7719e8700 1 --2- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c133f70 0x7ff76c122d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff764009e50 tx=0x7ff76400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.152+0000 7ff7719e8700 1 -- 172.21.15.154:0/215323120 shutdown_connections 2023-09-30T22:23:13.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.152+0000 7ff7719e8700 1 --2- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff76c133f70 0x7ff76c122d80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.152+0000 7ff7719e8700 1 --2- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76c0a0a90 0x7ff76c122300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.152+0000 7ff7719e8700 1 --2- 172.21.15.154:0/215323120 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff76c0a13a0 0x7ff76c122840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.152+0000 7ff7719e8700 1 -- 172.21.15.154:0/215323120 >> 172.21.15.154:0/215323120 conn(0x7ff76c099c40 msgr2=0x7ff76c0a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.152+0000 7ff7719e8700 1 -- 172.21.15.154:0/215323120 shutdown_connections 2023-09-30T22:23:13.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.152+0000 7ff7719e8700 1 -- 172.21.15.154:0/215323120 wait complete. 2023-09-30T22:23:13.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:13.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e9de5700 1 Processor -- start 2023-09-30T22:23:13.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e9de5700 1 -- start start 2023-09-30T22:23:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e9de5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63e4133ad0 0x7f63e4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e9de5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41300a0 0x7f63e41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e9de5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e406b2d0 con 0x7f63e41309f0 2023-09-30T22:23:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e9de5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e4133610 con 0x7f63e4133ad0 2023-09-30T22:23:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e9de5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e409a500 con 0x7f63e41300a0 2023-09-30T22:23:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63e4133ad0 0x7f63e4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63e4133ad0 0x7f63e4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47108/0 (socket says 172.21.15.154:47108) 2023-09-30T22:23:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41300a0 0x7f63e41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.168+0000 7f63e37fe700 1 -- 172.21.15.154:0/3975551951 learned_addr learned my addr 172.21.15.154:0/3975551951 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.169+0000 7f63e37fe700 1 -- 172.21.15.154:0/3975551951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41300a0 msgr2=0x7f63e41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.169+0000 7f63e37fe700 1 --2- 172.21.15.154:0/3975551951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41300a0 0x7f63e41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.169+0000 7f63e37fe700 1 -- 172.21.15.154:0/3975551951 >> v1:172.21.15.154:6789/0 conn(0x7f63e41309f0 legacy=0x7f63e413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.169+0000 7f63e37fe700 1 -- 172.21.15.154:0/3975551951 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e41338b0 con 0x7f63e4133ad0 2023-09-30T22:23:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.169+0000 7f63e2ffd700 1 --2- 172.21.15.154:0/3975551951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41300a0 0x7f63e41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.169+0000 7f63e37fe700 1 --2- 172.21.15.154:0/3975551951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 0x7f63e4133ea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f63d40098f0 tx=0x7f63d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6c7a9c901c43c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.169+0000 7f63e27fc700 1 -- 172.21.15.154:0/3975551951 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4011830 con 0x7f63e4133ad0 2023-09-30T22:23:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.169+0000 7f63e27fc700 1 -- 172.21.15.154:0/3975551951 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d4011990 con 0x7f63e4133ad0 2023-09-30T22:23:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.169+0000 7f63e27fc700 1 -- 172.21.15.154:0/3975551951 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4011d20 con 0x7f63e4133ad0 2023-09-30T22:23:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.170+0000 7f63e9de5700 1 -- 172.21.15.154:0/3975551951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 msgr2=0x7f63e4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.170+0000 7f63e9de5700 1 --2- 172.21.15.154:0/3975551951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 0x7f63e4133ea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f63d40098f0 tx=0x7f63d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.170+0000 7f63e9de5700 1 -- 172.21.15.154:0/3975551951 shutdown_connections 2023-09-30T22:23:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.170+0000 7f63e9de5700 1 --2- 172.21.15.154:0/3975551951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 0x7f63e4133ea0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.170+0000 7f63e9de5700 1 --2- 172.21.15.154:0/3975551951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41300a0 0x7f63e41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.170+0000 7f63e9de5700 1 -- 172.21.15.154:0/3975551951 >> 172.21.15.154:0/3975551951 conn(0x7f63e4099c40 msgr2=0x7f63e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.170+0000 7f63e9de5700 1 -- 172.21.15.154:0/3975551951 shutdown_connections 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.170+0000 7f63e9de5700 1 -- 172.21.15.154:0/3975551951 wait complete. 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.171+0000 7f63e9de5700 1 Processor -- start 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.171+0000 7f63e9de5700 1 -- start start 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e9de5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63e41300a0 0x7f63e411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e9de5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41309f0 0x7f63e411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e9de5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 0x7f63e411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e9de5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e411f040 con 0x7f63e4133ad0 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e9de5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e4072130 con 0x7f63e41309f0 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e9de5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63e4120150 con 0x7f63e41300a0 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 0x7f63e411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41309f0 0x7f63e411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63e41300a0 0x7f63e411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:13.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 0x7f63e411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47114/0 (socket says 172.21.15.154:47114) 2023-09-30T22:23:13.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.172+0000 7f63e3fff700 1 -- 172.21.15.154:0/1607955865 learned_addr learned my addr 172.21.15.154:0/1607955865 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63e2ffd700 1 -- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63e41300a0 msgr2=0x7f63e411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63e2ffd700 1 --2- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63e41300a0 0x7f63e411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63e2ffd700 1 -- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 msgr2=0x7f63e411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63e2ffd700 1 --2- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 0x7f63e411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63e2ffd700 1 -- 172.21.15.154:0/1607955865 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d80094a0 con 0x7f63e41309f0 2023-09-30T22:23:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63e3fff700 1 --2- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 0x7f63e411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63e2ffd700 1 --2- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41309f0 0x7f63e411df80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f63d800e900 tx=0x7f63d800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63cbfff700 1 -- 172.21.15.154:0/1607955865 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8013680 con 0x7f63e41309f0 2023-09-30T22:23:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63cbfff700 1 -- 172.21.15.154:0/1607955865 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d80137e0 con 0x7f63e41309f0 2023-09-30T22:23:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63e9de5700 1 -- 172.21.15.154:0/1607955865 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d4009550 con 0x7f63e41309f0 2023-09-30T22:23:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63cbfff700 1 -- 172.21.15.154:0/1607955865 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8013b70 con 0x7f63e41309f0 2023-09-30T22:23:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.173+0000 7f63e9de5700 1 -- 172.21.15.154:0/1607955865 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e40a2ea0 con 0x7f63e41309f0 2023-09-30T22:23:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.174+0000 7f63cbfff700 1 -- 172.21.15.154:0/1607955865 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63d8013cd0 con 0x7f63e41309f0 2023-09-30T22:23:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.174+0000 7f63e9de5700 1 -- 172.21.15.154:0/1607955865 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e404f2a0 con 0x7f63e41309f0 2023-09-30T22:23:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.174+0000 7f63cbfff700 1 -- 172.21.15.154:0/1607955865 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63d803fa60 con 0x7f63e41309f0 2023-09-30T22:23:13.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.183+0000 7f63cbfff700 1 -- 172.21.15.154:0/1607955865 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63d8021080 con 0x7f63e41309f0 2023-09-30T22:23:13.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.306+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/366563602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4bec09acc0 con 0x7f4bec12cf70 2023-09-30T22:23:13.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.306+0000 7f522cdab700 1 -- 172.21.15.154:0/3948535093 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5228125c90 con 0x7f5228133f70 2023-09-30T22:23:13.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.306+0000 7f4be97fa700 1 -- 172.21.15.154:0/366563602 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bd8036090 con 0x7f4bec12cf70 2023-09-30T22:23:13.306 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:13.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.306+0000 7f5216ffd700 1 -- 172.21.15.154:0/3948535093 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f521c00ce60 con 0x7f5228133f70 2023-09-30T22:23:13.307 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:13.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.308+0000 7f522cdab700 1 -- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5228133f70 msgr2=0x7f5228122e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.308+0000 7f522cdab700 1 --2- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5228133f70 0x7f5228122e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f521c00c450 tx=0x7f521c00c760 comp rx=0 tx=0).stop 2023-09-30T22:23:13.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.308+0000 7f522cdab700 1 -- 172.21.15.154:0/3948535093 shutdown_connections 2023-09-30T22:23:13.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.308+0000 7f522cdab700 1 --2- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5228133f70 0x7f5228122e70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.308+0000 7f522cdab700 1 --2- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52280a0a90 0x7f52281223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.308+0000 7f522cdab700 1 --2- 172.21.15.154:0/3948535093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52280a13a0 0x7f5228122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.308+0000 7f522cdab700 1 -- 172.21.15.154:0/3948535093 >> 172.21.15.154:0/3948535093 conn(0x7f5228099c40 msgr2=0x7f52280a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f522cdab700 1 -- 172.21.15.154:0/3948535093 shutdown_connections 2023-09-30T22:23:13.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f522cdab700 1 -- 172.21.15.154:0/3948535093 wait complete. 2023-09-30T22:23:13.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec12cf70 msgr2=0x7f4bec071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f4bf1fa0700 1 --2- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec12cf70 0x7f4bec071cd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800dfd0 tx=0x7f4bd8004750 comp rx=0 tx=0).stop 2023-09-30T22:23:13.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/366563602 shutdown_connections 2023-09-30T22:23:13.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f4bf1fa0700 1 --2- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bec130550 0x7f4bec1cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f4bf1fa0700 1 --2- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4bec09bb60 0x7f4bec071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f4bf1fa0700 1 --2- 172.21.15.154:0/366563602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec12cf70 0x7f4bec071cd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/366563602 >> 172.21.15.154:0/366563602 conn(0x7f4bec0a2d80 msgr2=0x7f4bec0a1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/366563602 shutdown_connections 2023-09-30T22:23:13.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.309+0000 7f4bf1fa0700 1 -- 172.21.15.154:0/366563602 wait complete. 2023-09-30T22:23:13.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:13.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:13.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.386+0000 7f63e9de5700 1 -- 172.21.15.154:0/1607955865 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63e406c3b0 con 0x7f63e41309f0 2023-09-30T22:23:13.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.387+0000 7f63cbfff700 1 -- 172.21.15.154:0/1607955865 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63d8017020 con 0x7f63e41309f0 2023-09-30T22:23:13.387 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.389+0000 7f63e9de5700 1 -- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41309f0 msgr2=0x7f63e411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.389+0000 7f63e9de5700 1 --2- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41309f0 0x7f63e411df80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f63d800e900 tx=0x7f63d800ec10 comp rx=0 tx=0).stop 2023-09-30T22:23:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.389+0000 7f63e9de5700 1 -- 172.21.15.154:0/1607955865 shutdown_connections 2023-09-30T22:23:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.389+0000 7f63e9de5700 1 --2- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4133ad0 0x7f63e411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.389+0000 7f63e9de5700 1 --2- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63e41300a0 0x7f63e411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.389+0000 7f63e9de5700 1 --2- 172.21.15.154:0/1607955865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63e41309f0 0x7f63e411df80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.389+0000 7f63e9de5700 1 -- 172.21.15.154:0/1607955865 >> 172.21.15.154:0/1607955865 conn(0x7f63e4099c40 msgr2=0x7f63e4131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.389+0000 7f63e9de5700 1 -- 172.21.15.154:0/1607955865 shutdown_connections 2023-09-30T22:23:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:13.389+0000 7f63e9de5700 1 -- 172.21.15.154:0/1607955865 wait complete. 2023-09-30T22:23:13.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:14.167 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:14.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.290+0000 7f105dd53700 1 Processor -- start 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.290+0000 7f105dd53700 1 -- start start 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f105dd53700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f105dd53700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f10581343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f105dd53700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10580a0a70 0x7f10580a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f105dd53700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580a3b60 con 0x7f10580a0a70 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f105dd53700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10581348e0 con 0x7f105809ad40 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f105dd53700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f105809b110 con 0x7f1058133f70 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f1056ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f10581343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f10577fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f1056ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f10581343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34958/0 (socket says 172.21.15.154:34958) 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f10577fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58296/0 (socket says 172.21.15.154:58296) 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f1056ffd700 1 -- 172.21.15.154:0/3409793188 learned_addr learned my addr 172.21.15.154:0/3409793188 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f1057fff700 1 --2- 172.21.15.154:0/3409793188 >> v2:172.21.15.154:3300/0 conn(0x7f10580a0a70 0x7f10580a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f10577fe700 1 -- 172.21.15.154:0/3409793188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 msgr2=0x7f10581343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f10577fe700 1 --2- 172.21.15.154:0/3409793188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f10581343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f10577fe700 1 -- 172.21.15.154:0/3409793188 >> v2:172.21.15.154:3300/0 conn(0x7f10580a0a70 msgr2=0x7f10580a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f10577fe700 1 --2- 172.21.15.154:0/3409793188 >> v2:172.21.15.154:3300/0 conn(0x7f10580a0a70 0x7f10580a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f10577fe700 1 -- 172.21.15.154:0/3409793188 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10580a2fa0 con 0x7f105809ad40 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f1057fff700 1 --2- 172.21.15.154:0/3409793188 >> v2:172.21.15.154:3300/0 conn(0x7f10580a0a70 0x7f10580a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.291+0000 7f1056ffd700 1 --2- 172.21.15.154:0/3409793188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f10581343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:14.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f10577fe700 1 --2- 172.21.15.154:0/3409793188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058133a30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1048009870 tx=0x7f1048009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=508602fbda452a0a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f10567fc700 1 -- 172.21.15.154:0/3409793188 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048011830 con 0x7f105809ad40 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f10567fc700 1 -- 172.21.15.154:0/3409793188 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1048011990 con 0x7f105809ad40 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f10567fc700 1 -- 172.21.15.154:0/3409793188 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048011d20 con 0x7f105809ad40 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f105dd53700 1 -- 172.21.15.154:0/3409793188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 msgr2=0x7f1058133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f105dd53700 1 --2- 172.21.15.154:0/3409793188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058133a30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1048009870 tx=0x7f1048009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f105dd53700 1 -- 172.21.15.154:0/3409793188 shutdown_connections 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f105dd53700 1 --2- 172.21.15.154:0/3409793188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058133a30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f105dd53700 1 --2- 172.21.15.154:0/3409793188 >> v2:172.21.15.154:3300/0 conn(0x7f10580a0a70 0x7f10580a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f105dd53700 1 --2- 172.21.15.154:0/3409793188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f10581343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f105dd53700 1 -- 172.21.15.154:0/3409793188 >> 172.21.15.154:0/3409793188 conn(0x7f1058099c40 msgr2=0x7f105806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f105dd53700 1 -- 172.21.15.154:0/3409793188 shutdown_connections 2023-09-30T22:23:14.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.292+0000 7f105dd53700 1 -- 172.21.15.154:0/3409793188 wait complete. 2023-09-30T22:23:14.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.293+0000 7f105dd53700 1 Processor -- start 2023-09-30T22:23:14.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.293+0000 7f105dd53700 1 -- start start 2023-09-30T22:23:14.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f105dd53700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058121210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f105dd53700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10580a0a70 0x7f1058121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f105dd53700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f1058121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f105dd53700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1058124d30 con 0x7f10580a0a70 2023-09-30T22:23:14.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f105dd53700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1058123cd0 con 0x7f105809ad40 2023-09-30T22:23:14.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f105dd53700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1058122670 con 0x7f1058133f70 2023-09-30T22:23:14.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f10577fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058121210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f10577fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058121210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58306/0 (socket says 172.21.15.154:58306) 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f10577fe700 1 -- 172.21.15.154:0/2368867040 learned_addr learned my addr 172.21.15.154:0/2368867040 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f1056ffd700 1 --2- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10580a0a70 0x7f1058121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f1057fff700 1 --2- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f1058121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f10577fe700 1 -- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 msgr2=0x7f1058121c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f10577fe700 1 --2- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f1058121c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f10577fe700 1 -- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10580a0a70 msgr2=0x7f1058121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f10577fe700 1 --2- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10580a0a70 0x7f1058121750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f10577fe700 1 -- 172.21.15.154:0/2368867040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1050009a70 con 0x7f105809ad40 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.294+0000 7f10577fe700 1 --2- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058121210 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f10480090b0 tx=0x7f1048004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.295+0000 7f104ffff700 1 -- 172.21.15.154:0/2368867040 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048004450 con 0x7f105809ad40 2023-09-30T22:23:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.295+0000 7f104ffff700 1 -- 172.21.15.154:0/2368867040 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104801e070 con 0x7f105809ad40 2023-09-30T22:23:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.295+0000 7f105dd53700 1 -- 172.21.15.154:0/2368867040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1040009550 con 0x7f105809ad40 2023-09-30T22:23:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.295+0000 7f104ffff700 1 -- 172.21.15.154:0/2368867040 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480038c0 con 0x7f105809ad40 2023-09-30T22:23:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.295+0000 7f105dd53700 1 -- 172.21.15.154:0/2368867040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10480094a0 con 0x7f105809ad40 2023-09-30T22:23:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.295+0000 7f104ffff700 1 -- 172.21.15.154:0/2368867040 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1048003a20 con 0x7f105809ad40 2023-09-30T22:23:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.295+0000 7f104ffff700 1 -- 172.21.15.154:0/2368867040 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10480403c0 con 0x7f105809ad40 2023-09-30T22:23:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.296+0000 7f105dd53700 1 -- 172.21.15.154:0/2368867040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105811e060 con 0x7f105809ad40 2023-09-30T22:23:14.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.300+0000 7f104ffff700 1 -- 172.21.15.154:0/2368867040 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1048015080 con 0x7f105809ad40 2023-09-30T22:23:14.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:14.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:14.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:14.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.458+0000 7fb575a85700 1 Processor -- start 2023-09-30T22:23:14.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.458+0000 7fb575a85700 1 -- start start 2023-09-30T22:23:14.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.459+0000 7fb575a85700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57006a770 0x7fb57006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.459+0000 7fb575a85700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb57009dec0 0x7fb57006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.459+0000 7fb575a85700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57006b5c0 con 0x7fb570131a00 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.459+0000 7fb575a85700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57006e900 con 0x7fb57009dec0 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.459+0000 7fb575a85700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb57009d180 con 0x7fb57006a770 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.459+0000 7fb56f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57006a770 0x7fb57006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.459+0000 7fb56f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57006a770 0x7fb57006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34974/0 (socket says 172.21.15.154:34974) 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.459+0000 7fb56f7fe700 1 -- 172.21.15.154:0/1753629895 learned_addr learned my addr 172.21.15.154:0/1753629895 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.459+0000 7fb56effd700 1 --2- 172.21.15.154:0/1753629895 >> v2:172.21.15.154:3300/0 conn(0x7fb57009dec0 0x7fb57006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.460+0000 7fb56effd700 1 -- 172.21.15.154:0/1753629895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57006a770 msgr2=0x7fb57006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.460+0000 7fb56effd700 1 --2- 172.21.15.154:0/1753629895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57006a770 0x7fb57006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.460+0000 7fb56effd700 1 -- 172.21.15.154:0/1753629895 >> v1:172.21.15.154:6789/0 conn(0x7fb570131a00 legacy=0x7fb570131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.460+0000 7fb56effd700 1 -- 172.21.15.154:0/1753629895 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57009e780 con 0x7fb57009dec0 2023-09-30T22:23:14.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.460+0000 7fb56effd700 1 --2- 172.21.15.154:0/1753629895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57009dec0 0x7fb57006b080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb564009840 tx=0x7fb564009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf103ee68ae8cc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.460+0000 7fb56e7fc700 1 -- 172.21.15.154:0/1753629895 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564011830 con 0x7fb57009dec0 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.460+0000 7fb56e7fc700 1 -- 172.21.15.154:0/1753629895 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564011990 con 0x7fb57009dec0 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.460+0000 7fb56e7fc700 1 -- 172.21.15.154:0/1753629895 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564011d20 con 0x7fb57009dec0 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.461+0000 7fb575a85700 1 -- 172.21.15.154:0/1753629895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57009dec0 msgr2=0x7fb57006b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.461+0000 7fb575a85700 1 --2- 172.21.15.154:0/1753629895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57009dec0 0x7fb57006b080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb564009840 tx=0x7fb564009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.461+0000 7fb575a85700 1 -- 172.21.15.154:0/1753629895 shutdown_connections 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.461+0000 7fb575a85700 1 --2- 172.21.15.154:0/1753629895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57006a770 0x7fb57006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.461+0000 7fb575a85700 1 --2- 172.21.15.154:0/1753629895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57009dec0 0x7fb57006b080 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.461+0000 7fb575a85700 1 -- 172.21.15.154:0/1753629895 >> 172.21.15.154:0/1753629895 conn(0x7fb570099c40 msgr2=0x7fb5700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.461+0000 7fb575a85700 1 -- 172.21.15.154:0/1753629895 shutdown_connections 2023-09-30T22:23:14.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.461+0000 7fb575a85700 1 -- 172.21.15.154:0/1753629895 wait complete. 2023-09-30T22:23:14.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.462+0000 7fb575a85700 1 Processor -- start 2023-09-30T22:23:14.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.463+0000 7fb575a85700 1 -- start start 2023-09-30T22:23:14.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.463+0000 7fb575a85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57006a770 0x7fb57009a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.463+0000 7fb575a85700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57009dec0 0x7fb57009a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.463+0000 7fb575a85700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb570131a00 0x7fb57009aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.463+0000 7fb575a85700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57012f680 con 0x7fb57006a770 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.463+0000 7fb575a85700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb570121a50 con 0x7fb570131a00 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.463+0000 7fb575a85700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb570131180 con 0x7fb57009dec0 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb570131a00 0x7fb57009aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57006a770 0x7fb57009a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb570131a00 0x7fb57009aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58312/0 (socket says 172.21.15.154:58312) 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56ffff700 1 -- 172.21.15.154:0/2671132027 learned_addr learned my addr 172.21.15.154:0/2671132027 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56effd700 1 --2- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57009dec0 0x7fb57009a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56ffff700 1 -- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57009dec0 msgr2=0x7fb57009a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56ffff700 1 --2- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57009dec0 0x7fb57009a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56ffff700 1 -- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57006a770 msgr2=0x7fb57009a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56ffff700 1 --2- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57006a770 0x7fb57009a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56ffff700 1 -- 172.21.15.154:0/2671132027 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640094a0 con 0x7fb570131a00 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56f7fe700 1 --2- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57006a770 0x7fb57009a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb56ffff700 1 --2- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb570131a00 0x7fb57009aee0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb56800cc50 tx=0x7fb56800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb557fff700 1 -- 172.21.15.154:0/2671132027 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568003c00 con 0x7fb570131a00 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb557fff700 1 -- 172.21.15.154:0/2671132027 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb568003d60 con 0x7fb570131a00 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb575a85700 1 -- 172.21.15.154:0/2671132027 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb570071ce0 con 0x7fb570131a00 2023-09-30T22:23:14.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb557fff700 1 -- 172.21.15.154:0/2671132027 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800aab0 con 0x7fb570131a00 2023-09-30T22:23:14.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.464+0000 7fb575a85700 1 -- 172.21.15.154:0/2671132027 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb570121d30 con 0x7fb570131a00 2023-09-30T22:23:14.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.465+0000 7fb557fff700 1 -- 172.21.15.154:0/2671132027 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb56800ac10 con 0x7fb570131a00 2023-09-30T22:23:14.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.465+0000 7fb557fff700 1 -- 172.21.15.154:0/2671132027 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb56803f660 con 0x7fb570131a00 2023-09-30T22:23:14.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.467+0000 7fb575a85700 1 -- 172.21.15.154:0/2671132027 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57004f2a0 con 0x7fb570131a00 2023-09-30T22:23:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.475+0000 7fb557fff700 1 -- 172.21.15.154:0/2671132027 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5680198f0 con 0x7fb570131a00 2023-09-30T22:23:14.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.498+0000 7f3ffa087700 1 Processor -- start 2023-09-30T22:23:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.498+0000 7f3ffa087700 1 -- start start 2023-09-30T22:23:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ffa087700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409d860 0x7f3ff409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ffa087700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409e170 0x7f3ff41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ffa087700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ff4130ce0 0x7f3ff4131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ffa087700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff409aaa0 con 0x7f3ff4130ce0 2023-09-30T22:23:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ffa087700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff409f870 con 0x7f3ff409e170 2023-09-30T22:23:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ffa087700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff409b360 con 0x7f3ff409d860 2023-09-30T22:23:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409e170 0x7f3ff41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409e170 0x7f3ff41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58320/0 (socket says 172.21.15.154:58320) 2023-09-30T22:23:14.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409d860 0x7f3ff409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff2ffd700 1 -- 172.21.15.154:0/511998785 learned_addr learned my addr 172.21.15.154:0/511998785 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:14.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff3fff700 1 --2- 172.21.15.154:0/511998785 >> v2:172.21.15.154:3300/0 conn(0x7f3ff4130ce0 0x7f3ff4131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff2ffd700 1 -- 172.21.15.154:0/511998785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409d860 msgr2=0x7f3ff409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff2ffd700 1 --2- 172.21.15.154:0/511998785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409d860 0x7f3ff409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff2ffd700 1 -- 172.21.15.154:0/511998785 >> v2:172.21.15.154:3300/0 conn(0x7f3ff4130ce0 msgr2=0x7f3ff4131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff2ffd700 1 --2- 172.21.15.154:0/511998785 >> v2:172.21.15.154:3300/0 conn(0x7f3ff4130ce0 0x7f3ff4131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.499+0000 7f3ff2ffd700 1 -- 172.21.15.154:0/511998785 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff409b620 con 0x7f3ff409e170 2023-09-30T22:23:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.500+0000 7f3ff2ffd700 1 --2- 172.21.15.154:0/511998785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409e170 0x7f3ff41307a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800bb90 tx=0x7f3fe800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6bfc6e1d63799ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.500+0000 7f3ff27fc700 1 -- 172.21.15.154:0/511998785 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe800dd30 con 0x7f3ff409e170 2023-09-30T22:23:14.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.500+0000 7f3ff27fc700 1 -- 172.21.15.154:0/511998785 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe800de90 con 0x7f3ff409e170 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.500+0000 7f3ff27fc700 1 -- 172.21.15.154:0/511998785 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8010690 con 0x7f3ff409e170 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.501+0000 7f3ffa087700 1 -- 172.21.15.154:0/511998785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409e170 msgr2=0x7f3ff41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.501+0000 7f3ffa087700 1 --2- 172.21.15.154:0/511998785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409e170 0x7f3ff41307a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800bb90 tx=0x7f3fe800bea0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.501+0000 7f3ffa087700 1 -- 172.21.15.154:0/511998785 shutdown_connections 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.501+0000 7f3ffa087700 1 --2- 172.21.15.154:0/511998785 >> v2:172.21.15.154:3300/0 conn(0x7f3ff4130ce0 0x7f3ff4131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.501+0000 7f3ffa087700 1 --2- 172.21.15.154:0/511998785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409d860 0x7f3ff409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.501+0000 7f3ffa087700 1 --2- 172.21.15.154:0/511998785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409e170 0x7f3ff41307a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.501+0000 7f3ffa087700 1 -- 172.21.15.154:0/511998785 >> 172.21.15.154:0/511998785 conn(0x7f3ff4099c40 msgr2=0x7f3ff40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.501+0000 7f3ffa087700 1 -- 172.21.15.154:0/511998785 shutdown_connections 2023-09-30T22:23:14.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.501+0000 7f3ffa087700 1 -- 172.21.15.154:0/511998785 wait complete. 2023-09-30T22:23:14.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ffa087700 1 Processor -- start 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ffa087700 1 -- start start 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ffa087700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409d860 0x7f3ff4122620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ffa087700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409e170 0x7f3ff4122b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ffa087700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff4130ce0 0x7f3ff41230a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ffa087700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4126140 con 0x7f3ff4130ce0 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ffa087700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4124230 con 0x7f3ff409d860 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ffa087700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff409a150 con 0x7f3ff409e170 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff4130ce0 0x7f3ff41230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ff3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff4130ce0 0x7f3ff41230a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47178/0 (socket says 172.21.15.154:47178) 2023-09-30T22:23:14.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ff3fff700 1 -- 172.21.15.154:0/1318884148 learned_addr learned my addr 172.21.15.154:0/1318884148 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.502+0000 7f3ff37fe700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409d860 0x7f3ff4122620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ff2ffd700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409e170 0x7f3ff4122b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ff37fe700 1 -- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409e170 msgr2=0x7f3ff4122b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ff37fe700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409e170 0x7f3ff4122b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ff37fe700 1 -- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff4130ce0 msgr2=0x7f3ff41230a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ff37fe700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff4130ce0 0x7f3ff41230a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ff37fe700 1 -- 172.21.15.154:0/1318884148 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe800b7f0 con 0x7f3ff409d860 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ff3fff700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff4130ce0 0x7f3ff41230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ff37fe700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409d860 0x7f3ff4122620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400e870 tx=0x7f3fe400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3fdbfff700 1 -- 172.21.15.154:0/1318884148 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4013680 con 0x7f3ff409d860 2023-09-30T22:23:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3fdbfff700 1 -- 172.21.15.154:0/1318884148 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe40137e0 con 0x7f3ff409d860 2023-09-30T22:23:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3fdbfff700 1 -- 172.21.15.154:0/1318884148 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4013b50 con 0x7f3ff409d860 2023-09-30T22:23:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ffa087700 1 -- 172.21.15.154:0/1318884148 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff409c8b0 con 0x7f3ff409d860 2023-09-30T22:23:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.503+0000 7f3ffa087700 1 -- 172.21.15.154:0/1318884148 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff4124a00 con 0x7f3ff409d860 2023-09-30T22:23:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.504+0000 7f3fdbfff700 1 -- 172.21.15.154:0/1318884148 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fe4013cb0 con 0x7f3ff409d860 2023-09-30T22:23:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.504+0000 7f3fdbfff700 1 -- 172.21.15.154:0/1318884148 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3fe403f610 con 0x7f3ff409d860 2023-09-30T22:23:14.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.504+0000 7f3ffa087700 1 -- 172.21.15.154:0/1318884148 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff4125ae0 con 0x7f3ff409d860 2023-09-30T22:23:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.509+0000 7f3fdbfff700 1 -- 172.21.15.154:0/1318884148 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ff4125ae0 con 0x7f3ff409d860 2023-09-30T22:23:14.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff35a7f2700 1 Processor -- start 2023-09-30T22:23:14.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff35a7f2700 1 -- start start 2023-09-30T22:23:14.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff35a7f2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3540a0a70 0x7ff3540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff35a7f2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff354134120 0x7ff35413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff35a7f2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35409dc00 con 0x7ff3540a1380 2023-09-30T22:23:14.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff35a7f2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35409ea60 con 0x7ff354134120 2023-09-30T22:23:14.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff35a7f2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff35409dec0 con 0x7ff3540a0a70 2023-09-30T22:23:14.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff358d8f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff354134120 0x7ff35413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff353fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3540a0a70 0x7ff3540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff353fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3540a0a70 0x7ff3540a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35004/0 (socket says 172.21.15.154:35004) 2023-09-30T22:23:14.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff358d8f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff354134120 0x7ff35413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47194/0 (socket says 172.21.15.154:47194) 2023-09-30T22:23:14.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.537+0000 7ff353fff700 1 -- 172.21.15.154:0/422662290 learned_addr learned my addr 172.21.15.154:0/422662290 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:14.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff353fff700 1 -- 172.21.15.154:0/422662290 >> v2:172.21.15.154:3300/0 conn(0x7ff354134120 msgr2=0x7ff35413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:14.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff353fff700 1 --2- 172.21.15.154:0/422662290 >> v2:172.21.15.154:3300/0 conn(0x7ff354134120 0x7ff35413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff353fff700 1 -- 172.21.15.154:0/422662290 >> v1:172.21.15.154:6789/0 conn(0x7ff3540a1380 legacy=0x7ff354133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff352ffd700 1 -- 172.21.15.154:0/422662290 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423059798 0 0) 0x7ff35409dc00 con 0x7ff3540a1380 2023-09-30T22:23:14.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff353fff700 1 -- 172.21.15.154:0/422662290 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35409e6a0 con 0x7ff3540a0a70 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff358d8f700 1 --2- 172.21.15.154:0/422662290 >> v2:172.21.15.154:3300/0 conn(0x7ff354134120 0x7ff35413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff353fff700 1 --2- 172.21.15.154:0/422662290 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3540a0a70 0x7ff3540a0e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3440098f0 tx=0x7ff344009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1985f264ebc21c07 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff352ffd700 1 -- 172.21.15.154:0/422662290 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344011830 con 0x7ff3540a0a70 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff352ffd700 1 -- 172.21.15.154:0/422662290 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344011990 con 0x7ff3540a0a70 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.538+0000 7ff352ffd700 1 -- 172.21.15.154:0/422662290 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344011d20 con 0x7ff3540a0a70 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.539+0000 7ff35a7f2700 1 -- 172.21.15.154:0/422662290 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3540a0a70 msgr2=0x7ff3540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.539+0000 7ff35a7f2700 1 --2- 172.21.15.154:0/422662290 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3540a0a70 0x7ff3540a0e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3440098f0 tx=0x7ff344009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.539+0000 7ff35a7f2700 1 -- 172.21.15.154:0/422662290 shutdown_connections 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.539+0000 7ff35a7f2700 1 --2- 172.21.15.154:0/422662290 >> v2:172.21.15.154:3300/0 conn(0x7ff354134120 0x7ff35413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.539+0000 7ff35a7f2700 1 --2- 172.21.15.154:0/422662290 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3540a0a70 0x7ff3540a0e40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.539+0000 7ff35a7f2700 1 -- 172.21.15.154:0/422662290 >> 172.21.15.154:0/422662290 conn(0x7ff3540a6610 msgr2=0x7ff3540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.539+0000 7ff35a7f2700 1 -- 172.21.15.154:0/422662290 shutdown_connections 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.539+0000 7ff35a7f2700 1 -- 172.21.15.154:0/422662290 wait complete. 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.540+0000 7ff35a7f2700 1 Processor -- start 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.540+0000 7ff35a7f2700 1 -- start start 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.540+0000 7ff35a7f2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3540a0a70 0x7ff354122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.540+0000 7ff35a7f2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3540a1380 0x7ff354122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff35a7f2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff354134120 0x7ff354123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff35a7f2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff354133300 con 0x7ff3540a0a70 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff35a7f2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff354125aa0 con 0x7ff3540a1380 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff35a7f2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff354133650 con 0x7ff354134120 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff358d8f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff354134120 0x7ff354123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff358d8f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff354134120 0x7ff354123210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35008/0 (socket says 172.21.15.154:35008) 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff358d8f700 1 -- 172.21.15.154:0/2655720147 learned_addr learned my addr 172.21.15.154:0/2655720147 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff353fff700 1 --2- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3540a0a70 0x7ff354122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff358d8f700 1 -- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3540a1380 msgr2=0x7ff354122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff358d8f700 1 --2- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3540a1380 0x7ff354122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff358d8f700 1 -- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3540a0a70 msgr2=0x7ff354122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff358d8f700 1 --2- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3540a0a70 0x7ff354122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff358d8f700 1 -- 172.21.15.154:0/2655720147 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c009a70 con 0x7ff354134120 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff358d8f700 1 --2- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff354134120 0x7ff354123210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00efc0 tx=0x7ff34c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff350ff9700 1 -- 172.21.15.154:0/2655720147 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c00cb40 con 0x7ff354134120 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff350ff9700 1 -- 172.21.15.154:0/2655720147 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c00f040 con 0x7ff354134120 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff35a7f2700 1 -- 172.21.15.154:0/2655720147 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff344009550 con 0x7ff354134120 2023-09-30T22:23:14.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.541+0000 7ff350ff9700 1 -- 172.21.15.154:0/2655720147 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c003a20 con 0x7ff354134120 2023-09-30T22:23:14.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.542+0000 7ff35a7f2700 1 -- 172.21.15.154:0/2655720147 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff354125cd0 con 0x7ff354134120 2023-09-30T22:23:14.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.542+0000 7ff350ff9700 1 -- 172.21.15.154:0/2655720147 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff34c014480 con 0x7ff354134120 2023-09-30T22:23:14.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.543+0000 7ff35a7f2700 1 -- 172.21.15.154:0/2655720147 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff354125e60 con 0x7ff354134120 2023-09-30T22:23:14.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.543+0000 7ff350ff9700 1 -- 172.21.15.154:0/2655720147 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff34c01c570 con 0x7ff354134120 2023-09-30T22:23:14.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.548+0000 7ff350ff9700 1 -- 172.21.15.154:0/2655720147 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff34c045060 con 0x7ff354134120 2023-09-30T22:23:14.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.551+0000 7f105dd53700 1 -- 172.21.15.154:0/2368867040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f105809c7e0 con 0x7f105809ad40 2023-09-30T22:23:14.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.551+0000 7f104ffff700 1 -- 172.21.15.154:0/2368867040 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f104801a420 con 0x7f105809ad40 2023-09-30T22:23:14.554 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.554+0000 7f105dd53700 1 -- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 msgr2=0x7f1058121210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.554+0000 7f105dd53700 1 --2- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058121210 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f10480090b0 tx=0x7f1048004750 comp rx=0 tx=0).stop 2023-09-30T22:23:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.554+0000 7f105dd53700 1 -- 172.21.15.154:0/2368867040 shutdown_connections 2023-09-30T22:23:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.554+0000 7f105dd53700 1 --2- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1058133f70 0x7f1058121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.554+0000 7f105dd53700 1 --2- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f105809ad40 0x7f1058121210 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.554+0000 7f105dd53700 1 --2- 172.21.15.154:0/2368867040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10580a0a70 0x7f1058121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.554+0000 7f105dd53700 1 -- 172.21.15.154:0/2368867040 >> 172.21.15.154:0/2368867040 conn(0x7f1058099c40 msgr2=0x7f1058133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.554+0000 7f105dd53700 1 -- 172.21.15.154:0/2368867040 shutdown_connections 2023-09-30T22:23:14.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.554+0000 7f105dd53700 1 -- 172.21.15.154:0/2368867040 wait complete. 2023-09-30T22:23:14.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:14.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.714+0000 7fb575a85700 1 -- 172.21.15.154:0/2671132027 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb57009e3a0 con 0x7fb570131a00 2023-09-30T22:23:14.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.714+0000 7fb557fff700 1 -- 172.21.15.154:0/2671132027 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb568019300 con 0x7fb570131a00 2023-09-30T22:23:14.715 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:14.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.716+0000 7fb575a85700 1 -- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb570131a00 msgr2=0x7fb57009aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.716+0000 7fb575a85700 1 --2- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb570131a00 0x7fb57009aee0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb56800cc50 tx=0x7fb56800cf60 comp rx=0 tx=0).stop 2023-09-30T22:23:14.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.717+0000 7fb575a85700 1 -- 172.21.15.154:0/2671132027 shutdown_connections 2023-09-30T22:23:14.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.717+0000 7fb575a85700 1 --2- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb570131a00 0x7fb57009aee0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.717+0000 7fb575a85700 1 --2- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57006a770 0x7fb57009a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.717+0000 7fb575a85700 1 --2- 172.21.15.154:0/2671132027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb57009dec0 0x7fb57009a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.717+0000 7fb575a85700 1 -- 172.21.15.154:0/2671132027 >> 172.21.15.154:0/2671132027 conn(0x7fb570099c40 msgr2=0x7fb5701b8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.717+0000 7fb575a85700 1 -- 172.21.15.154:0/2671132027 shutdown_connections 2023-09-30T22:23:14.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.717+0000 7fb575a85700 1 -- 172.21.15.154:0/2671132027 wait complete. 2023-09-30T22:23:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.727+0000 7f3ffa087700 1 -- 172.21.15.154:0/1318884148 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ff4125ae0 con 0x7f3ff409d860 2023-09-30T22:23:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.727+0000 7f3fdbfff700 1 -- 172.21.15.154:0/1318884148 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ff4125ae0 con 0x7f3ff409d860 2023-09-30T22:23:14.728 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:14.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.729+0000 7f3ffa087700 1 -- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409d860 msgr2=0x7f3ff4122620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.729+0000 7f3ffa087700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409d860 0x7f3ff4122620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400e870 tx=0x7f3fe400eb80 comp rx=0 tx=0).stop 2023-09-30T22:23:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.729+0000 7f3ffa087700 1 -- 172.21.15.154:0/1318884148 shutdown_connections 2023-09-30T22:23:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.729+0000 7f3ffa087700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff4130ce0 0x7f3ff41230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.729+0000 7f3ffa087700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ff409d860 0x7f3ff4122620 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.729+0000 7f3ffa087700 1 --2- 172.21.15.154:0/1318884148 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ff409e170 0x7f3ff4122b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.729+0000 7f3ffa087700 1 -- 172.21.15.154:0/1318884148 >> 172.21.15.154:0/1318884148 conn(0x7f3ff4099c40 msgr2=0x7f3ff40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.729+0000 7f3ffa087700 1 -- 172.21.15.154:0/1318884148 shutdown_connections 2023-09-30T22:23:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.730+0000 7f3ffa087700 1 -- 172.21.15.154:0/1318884148 wait complete. 2023-09-30T22:23:14.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:14.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.771+0000 7ff35a7f2700 1 -- 172.21.15.154:0/2655720147 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff354126a70 con 0x7ff354134120 2023-09-30T22:23:14.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.771+0000 7ff350ff9700 1 -- 172.21.15.154:0/2655720147 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff34c012930 con 0x7ff354134120 2023-09-30T22:23:14.772 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:14.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.773+0000 7ff35a7f2700 1 -- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff354134120 msgr2=0x7ff354123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.773+0000 7ff35a7f2700 1 --2- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff354134120 0x7ff354123210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00efc0 tx=0x7ff34c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.773+0000 7ff35a7f2700 1 -- 172.21.15.154:0/2655720147 shutdown_connections 2023-09-30T22:23:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.774+0000 7ff35a7f2700 1 --2- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff354134120 0x7ff354123210 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.774+0000 7ff35a7f2700 1 --2- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3540a0a70 0x7ff354122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.774+0000 7ff35a7f2700 1 --2- 172.21.15.154:0/2655720147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3540a1380 0x7ff354122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.774+0000 7ff35a7f2700 1 -- 172.21.15.154:0/2655720147 >> 172.21.15.154:0/2655720147 conn(0x7ff3540a6610 msgr2=0x7ff3540a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.774+0000 7ff35a7f2700 1 -- 172.21.15.154:0/2655720147 shutdown_connections 2023-09-30T22:23:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:14.774+0000 7ff35a7f2700 1 -- 172.21.15.154:0/2655720147 wait complete. 2023-09-30T22:23:14.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:15.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.697+0000 7f62f5a57700 1 Processor -- start 2023-09-30T22:23:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.697+0000 7f62f5a57700 1 -- start start 2023-09-30T22:23:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62f5a57700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62f5a57700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62f0133f70 0x7f62f01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62f5a57700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f009b110 con 0x7f62f00a0a70 2023-09-30T22:23:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62f5a57700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f00a3b60 con 0x7f62f0133f70 2023-09-30T22:23:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62f5a57700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f01348e0 con 0x7f62f009ad40 2023-09-30T22:23:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62ee7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62f0133f70 0x7f62f01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62ef7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f62f00a0a70 0x7f62f00a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39804/0 (socket says 172.21.15.154:39804) 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39524/0 (socket says 172.21.15.154:39524) 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62ee7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62f0133f70 0x7f62f01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46576/0 (socket says 172.21.15.154:46576) 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62ef7fe700 1 -- 172.21.15.154:0/1465950844 learned_addr learned my addr 172.21.15.154:0/1465950844 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62ee7fc700 1 -- 172.21.15.154:0/1465950844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 msgr2=0x7f62f0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62ee7fc700 1 --2- 172.21.15.154:0/1465950844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62ee7fc700 1 -- 172.21.15.154:0/1465950844 >> v1:172.21.15.154:6789/0 conn(0x7f62f00a0a70 legacy=0x7f62f00a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62ee7fc700 1 -- 172.21.15.154:0/1465950844 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00a2fa0 con 0x7f62f0133f70 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62eeffd700 1 --2- 172.21.15.154:0/1465950844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62ee7fc700 1 --2- 172.21.15.154:0/1465950844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 0x7f62f01343a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009840 tx=0x7f62e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115b7156cf6e9b9b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62edffb700 1 -- 172.21.15.154:0/1465950844 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0011830 con 0x7f62f0133f70 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62edffb700 1 -- 172.21.15.154:0/1465950844 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e0011990 con 0x7f62f0133f70 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.698+0000 7f62edffb700 1 -- 172.21.15.154:0/1465950844 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0011d20 con 0x7f62f0133f70 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.699+0000 7f62f5a57700 1 -- 172.21.15.154:0/1465950844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 msgr2=0x7f62f01343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.699+0000 7f62f5a57700 1 --2- 172.21.15.154:0/1465950844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 0x7f62f01343a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009840 tx=0x7f62e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.699+0000 7f62f5a57700 1 -- 172.21.15.154:0/1465950844 shutdown_connections 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.699+0000 7f62f5a57700 1 --2- 172.21.15.154:0/1465950844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.699+0000 7f62f5a57700 1 --2- 172.21.15.154:0/1465950844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 0x7f62f01343a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.699+0000 7f62f5a57700 1 -- 172.21.15.154:0/1465950844 >> 172.21.15.154:0/1465950844 conn(0x7f62f0099c40 msgr2=0x7f62f006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.699+0000 7f62f5a57700 1 -- 172.21.15.154:0/1465950844 shutdown_connections 2023-09-30T22:23:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.699+0000 7f62f5a57700 1 -- 172.21.15.154:0/1465950844 wait complete. 2023-09-30T22:23:15.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.700+0000 7f62f5a57700 1 Processor -- start 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.700+0000 7f62f5a57700 1 -- start start 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.700+0000 7f62f5a57700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f011e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.700+0000 7f62f5a57700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62f00a0a70 0x7f62f011e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62f5a57700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 0x7f62f011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62f5a57700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0122530 con 0x7f62f0133f70 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62f5a57700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f011fc60 con 0x7f62f009ad40 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62f5a57700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0120280 con 0x7f62f00a0a70 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62ef7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 0x7f62f011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f011e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62ee7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62f00a0a70 0x7f62f011e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62ef7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 0x7f62f011ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46586/0 (socket says 172.21.15.154:46586) 2023-09-30T22:23:15.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f011e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39540/0 (socket says 172.21.15.154:39540) 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62ef7fe700 1 -- 172.21.15.154:0/3760657893 learned_addr learned my addr 172.21.15.154:0/3760657893 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62eeffd700 1 -- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62f00a0a70 msgr2=0x7f62f011e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62eeffd700 1 --2- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62f00a0a70 0x7f62f011e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62eeffd700 1 -- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 msgr2=0x7f62f011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62eeffd700 1 --2- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 0x7f62f011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62eeffd700 1 -- 172.21.15.154:0/3760657893 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e40094a0 con 0x7f62f009ad40 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62ef7fe700 1 --2- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 0x7f62f011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62eeffd700 1 --2- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f011e050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62e400e930 tx=0x7f62e400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62d7fff700 1 -- 172.21.15.154:0/3760657893 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4013680 con 0x7f62f009ad40 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62d7fff700 1 -- 172.21.15.154:0/3760657893 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40137e0 con 0x7f62f009ad40 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62d7fff700 1 -- 172.21.15.154:0/3760657893 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4013b90 con 0x7f62f009ad40 2023-09-30T22:23:15.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62f5a57700 1 -- 172.21.15.154:0/3760657893 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e00094a0 con 0x7f62f009ad40 2023-09-30T22:23:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.701+0000 7f62f5a57700 1 -- 172.21.15.154:0/3760657893 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f00a0eb0 con 0x7f62f009ad40 2023-09-30T22:23:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.702+0000 7f62d7fff700 1 -- 172.21.15.154:0/3760657893 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62e4013cf0 con 0x7f62f009ad40 2023-09-30T22:23:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.702+0000 7f62d7fff700 1 -- 172.21.15.154:0/3760657893 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f62e403f980 con 0x7f62f009ad40 2023-09-30T22:23:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.702+0000 7f62f5a57700 1 -- 172.21.15.154:0/3760657893 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f009ed10 con 0x7f62f009ad40 2023-09-30T22:23:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.707+0000 7f62d7fff700 1 -- 172.21.15.154:0/3760657893 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62e4017080 con 0x7f62f009ad40 2023-09-30T22:23:15.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:15.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:15.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.857+0000 7f716b2a6700 1 Processor -- start 2023-09-30T22:23:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.857+0000 7f716b2a6700 1 -- start start 2023-09-30T22:23:15.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f716b2a6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7164133b80 0x7f7164133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f716b2a6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f71640a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f716b2a6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71640a0e20 0x7f71640a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f716b2a6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716409aa00 con 0x7f7164133b80 2023-09-30T22:23:15.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f716b2a6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716409a080 con 0x7f7164099a60 2023-09-30T22:23:15.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f716b2a6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7164133750 con 0x7f71640a0e20 2023-09-30T22:23:15.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f7169843700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71640a0e20 0x7f71640a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f7168841700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f71640a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f7169843700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71640a0e20 0x7f71640a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34518/0 (socket says 172.21.15.154:34518) 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f7169843700 1 -- 172.21.15.154:0/3891438930 learned_addr learned my addr 172.21.15.154:0/3891438930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.858+0000 7f7169042700 1 --2- 172.21.15.154:0/3891438930 >> v2:172.21.15.154:3300/0 conn(0x7f7164133b80 0x7f7164133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f7168841700 1 -- 172.21.15.154:0/3891438930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71640a0e20 msgr2=0x7f71640a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f7168841700 1 --2- 172.21.15.154:0/3891438930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71640a0e20 0x7f71640a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f7168841700 1 -- 172.21.15.154:0/3891438930 >> v2:172.21.15.154:3300/0 conn(0x7f7164133b80 msgr2=0x7f7164133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f7168841700 1 --2- 172.21.15.154:0/3891438930 >> v2:172.21.15.154:3300/0 conn(0x7f7164133b80 0x7f7164133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f7168841700 1 -- 172.21.15.154:0/3891438930 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716409a760 con 0x7f7164099a60 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f7169843700 1 --2- 172.21.15.154:0/3891438930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71640a0e20 0x7f71640a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f7168841700 1 --2- 172.21.15.154:0/3891438930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f71640a08e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7154009840 tx=0x7f7154009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aaf3a55c182f703 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f715bfff700 1 -- 172.21.15.154:0/3891438930 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154011830 con 0x7f7164099a60 2023-09-30T22:23:15.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f715bfff700 1 -- 172.21.15.154:0/3891438930 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154011990 con 0x7f7164099a60 2023-09-30T22:23:15.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.859+0000 7f715bfff700 1 -- 172.21.15.154:0/3891438930 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154011d20 con 0x7f7164099a60 2023-09-30T22:23:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.860+0000 7f716b2a6700 1 -- 172.21.15.154:0/3891438930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 msgr2=0x7f71640a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.860+0000 7f716b2a6700 1 --2- 172.21.15.154:0/3891438930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f71640a08e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7154009840 tx=0x7f7154009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.860+0000 7f716b2a6700 1 -- 172.21.15.154:0/3891438930 shutdown_connections 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.860+0000 7f716b2a6700 1 --2- 172.21.15.154:0/3891438930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71640a0e20 0x7f71640a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.860+0000 7f716b2a6700 1 --2- 172.21.15.154:0/3891438930 >> v2:172.21.15.154:3300/0 conn(0x7f7164133b80 0x7f7164133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.860+0000 7f716b2a6700 1 --2- 172.21.15.154:0/3891438930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f71640a08e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.860+0000 7f716b2a6700 1 -- 172.21.15.154:0/3891438930 >> 172.21.15.154:0/3891438930 conn(0x7f71640a2980 msgr2=0x7f71640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.860+0000 7f716b2a6700 1 -- 172.21.15.154:0/3891438930 shutdown_connections 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.860+0000 7f716b2a6700 1 -- 172.21.15.154:0/3891438930 wait complete. 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f716b2a6700 1 Processor -- start 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f716b2a6700 1 -- start start 2023-09-30T22:23:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f716b2a6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f716411b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f716b2a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71640a0e20 0x7f716411bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f716b2a6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7164133b80 0x7f716411c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f716b2a6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716411e8e0 con 0x7f71640a0e20 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f716b2a6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716411faa0 con 0x7f7164099a60 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f716b2a6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f716409a2c0 con 0x7f7164133b80 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f7169042700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f716411b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f7169042700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f716411b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39566/0 (socket says 172.21.15.154:39566) 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.861+0000 7f7169042700 1 -- 172.21.15.154:0/1213107289 learned_addr learned my addr 172.21.15.154:0/1213107289 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7168841700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71640a0e20 0x7f716411bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7169843700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7164133b80 0x7f716411c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7169042700 1 -- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7164133b80 msgr2=0x7f716411c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7169042700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7164133b80 0x7f716411c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7169042700 1 -- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71640a0e20 msgr2=0x7f716411bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7169042700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71640a0e20 0x7f716411bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7169042700 1 -- 172.21.15.154:0/1213107289 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c009b30 con 0x7f7164099a60 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7169843700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7164133b80 0x7f716411c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7168841700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71640a0e20 0x7f716411bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7169042700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f716411b6c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f716000e730 tx=0x7f716000eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7159ffb700 1 -- 172.21.15.154:0/1213107289 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160013610 con 0x7f7164099a60 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7159ffb700 1 -- 172.21.15.154:0/1213107289 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7160013770 con 0x7f7164099a60 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f716b2a6700 1 -- 172.21.15.154:0/1213107289 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71540094a0 con 0x7f7164099a60 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f7159ffb700 1 -- 172.21.15.154:0/1213107289 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160013b20 con 0x7f7164099a60 2023-09-30T22:23:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.862+0000 7f716b2a6700 1 -- 172.21.15.154:0/1213107289 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716411e420 con 0x7f7164099a60 2023-09-30T22:23:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.863+0000 7f7159ffb700 1 -- 172.21.15.154:0/1213107289 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7160013c80 con 0x7f7164099a60 2023-09-30T22:23:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.864+0000 7f7159ffb700 1 -- 172.21.15.154:0/1213107289 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7160010c00 con 0x7f7164099a60 2023-09-30T22:23:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.865+0000 7f716b2a6700 1 -- 172.21.15.154:0/1213107289 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716404f2a0 con 0x7f7164099a60 2023-09-30T22:23:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.873+0000 7f7159ffb700 1 -- 172.21.15.154:0/1213107289 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7160044060 con 0x7f7164099a60 2023-09-30T22:23:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.902+0000 7ffa16e4f700 1 Processor -- start 2023-09-30T22:23:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.902+0000 7ffa16e4f700 1 -- start start 2023-09-30T22:23:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa16e4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a0a70 0x7ffa100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa16e4f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa100a1380 0x7ffa10133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa16e4f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1009dc00 con 0x7ffa10133f50 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa16e4f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1009ea60 con 0x7ffa100a1380 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa16e4f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1009dec0 con 0x7ffa100a0a70 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa14beb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a0a70 0x7ffa100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa14beb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a0a70 0x7ffa100a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34526/0 (socket says 172.21.15.154:34526) 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa14beb700 1 -- 172.21.15.154:0/1247557319 learned_addr learned my addr 172.21.15.154:0/1247557319 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa14beb700 1 -- 172.21.15.154:0/1247557319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa100a1380 msgr2=0x7ffa10133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa14beb700 1 --2- 172.21.15.154:0/1247557319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa100a1380 0x7ffa10133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa14beb700 1 -- 172.21.15.154:0/1247557319 >> v1:172.21.15.154:6789/0 conn(0x7ffa10133f50 legacy=0x7ffa1013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa14beb700 1 -- 172.21.15.154:0/1247557319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1009e6a0 con 0x7ffa100a0a70 2023-09-30T22:23:15.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa14beb700 1 --2- 172.21.15.154:0/1247557319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a0a70 0x7ffa100a0e40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009920 tx=0x7ffa04009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1891ad25a5ef02e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:15.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa0f7fe700 1 -- 172.21.15.154:0/1247557319 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04004230 con 0x7ffa100a0a70 2023-09-30T22:23:15.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.903+0000 7ffa0f7fe700 1 -- 172.21.15.154:0/1247557319 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04004390 con 0x7ffa100a0a70 2023-09-30T22:23:15.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.904+0000 7ffa0f7fe700 1 -- 172.21.15.154:0/1247557319 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04009e70 con 0x7ffa100a0a70 2023-09-30T22:23:15.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.904+0000 7ffa16e4f700 1 -- 172.21.15.154:0/1247557319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a0a70 msgr2=0x7ffa100a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.904+0000 7ffa16e4f700 1 --2- 172.21.15.154:0/1247557319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a0a70 0x7ffa100a0e40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009920 tx=0x7ffa04009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:15.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.904+0000 7ffa16e4f700 1 -- 172.21.15.154:0/1247557319 shutdown_connections 2023-09-30T22:23:15.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.904+0000 7ffa16e4f700 1 --2- 172.21.15.154:0/1247557319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a0a70 0x7ffa100a0e40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.904+0000 7ffa16e4f700 1 --2- 172.21.15.154:0/1247557319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa100a1380 0x7ffa10133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.904+0000 7ffa16e4f700 1 -- 172.21.15.154:0/1247557319 >> 172.21.15.154:0/1247557319 conn(0x7ffa100a6610 msgr2=0x7ffa100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.904+0000 7ffa16e4f700 1 -- 172.21.15.154:0/1247557319 shutdown_connections 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.904+0000 7ffa16e4f700 1 -- 172.21.15.154:0/1247557319 wait complete. 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.905+0000 7ffa16e4f700 1 Processor -- start 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.905+0000 7ffa16e4f700 1 -- start start 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa16e4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a1380 0x7ffa101c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa16e4f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa10133f50 0x7ffa101c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa16e4f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa101c8fd0 0x7ffa10132510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa16e4f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa10120920 con 0x7ffa101c8fd0 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa16e4f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa101c9420 con 0x7ffa10133f50 2023-09-30T22:23:15.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa16e4f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa10120730 con 0x7ffa100a1380 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa14beb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a1380 0x7ffa101c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa14beb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a1380 0x7ffa101c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34540/0 (socket says 172.21.15.154:34540) 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa14beb700 1 -- 172.21.15.154:0/861768739 learned_addr learned my addr 172.21.15.154:0/861768739 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa153ec700 1 --2- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa101c8fd0 0x7ffa10132510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa0ffff700 1 --2- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa10133f50 0x7ffa101c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa14beb700 1 -- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa10133f50 msgr2=0x7ffa101c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa14beb700 1 --2- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa10133f50 0x7ffa101c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa14beb700 1 -- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa101c8fd0 msgr2=0x7ffa10132510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa14beb700 1 --2- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa101c8fd0 0x7ffa10132510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa14beb700 1 -- 172.21.15.154:0/861768739 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04009550 con 0x7ffa100a1380 2023-09-30T22:23:15.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.906+0000 7ffa14beb700 1 --2- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a1380 0x7ffa101c8550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffa04000c00 tx=0x7ffa04004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:15.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.907+0000 7ffa0d7fa700 1 -- 172.21.15.154:0/861768739 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0400bd80 con 0x7ffa100a1380 2023-09-30T22:23:15.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.907+0000 7ffa0d7fa700 1 -- 172.21.15.154:0/861768739 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0401f070 con 0x7ffa100a1380 2023-09-30T22:23:15.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.907+0000 7ffa0d7fa700 1 -- 172.21.15.154:0/861768739 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040038e0 con 0x7ffa100a1380 2023-09-30T22:23:15.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.907+0000 7ffa16e4f700 1 -- 172.21.15.154:0/861768739 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa10122640 con 0x7ffa100a1380 2023-09-30T22:23:15.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.907+0000 7ffa16e4f700 1 -- 172.21.15.154:0/861768739 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa10133b00 con 0x7ffa100a1380 2023-09-30T22:23:15.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.907+0000 7ffa0d7fa700 1 -- 172.21.15.154:0/861768739 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa04021030 con 0x7ffa100a1380 2023-09-30T22:23:15.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.908+0000 7ffa0d7fa700 1 -- 172.21.15.154:0/861768739 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa04040ce0 con 0x7ffa100a1380 2023-09-30T22:23:15.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.908+0000 7ffa16e4f700 1 -- 172.21.15.154:0/861768739 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa10072420 con 0x7ffa100a1380 2023-09-30T22:23:15.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.912+0000 7ffa0d7fa700 1 -- 172.21.15.154:0/861768739 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa10072420 con 0x7ffa100a1380 2023-09-30T22:23:15.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.917+0000 7f62f5a57700 1 -- 172.21.15.154:0/3760657893 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62f009c7e0 con 0x7f62f009ad40 2023-09-30T22:23:15.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.917+0000 7f62d7fff700 1 -- 172.21.15.154:0/3760657893 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62e40119a0 con 0x7f62f009ad40 2023-09-30T22:23:15.920 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:15.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.922+0000 7f62f5a57700 1 -- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 msgr2=0x7f62f011e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.922+0000 7f62f5a57700 1 --2- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f011e050 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62e400e930 tx=0x7f62e400ec40 comp rx=0 tx=0).stop 2023-09-30T22:23:15.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.922+0000 7f62f5a57700 1 -- 172.21.15.154:0/3760657893 shutdown_connections 2023-09-30T22:23:15.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.922+0000 7f62f5a57700 1 --2- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f0133f70 0x7f62f011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.922+0000 7f62f5a57700 1 --2- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f009ad40 0x7f62f011e050 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.922+0000 7f62f5a57700 1 --2- 172.21.15.154:0/3760657893 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62f00a0a70 0x7f62f011e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.922+0000 7f62f5a57700 1 -- 172.21.15.154:0/3760657893 >> 172.21.15.154:0/3760657893 conn(0x7f62f0099c40 msgr2=0x7f62f01330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:15.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.922+0000 7f62f5a57700 1 -- 172.21.15.154:0/3760657893 shutdown_connections 2023-09-30T22:23:15.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.922+0000 7f62f5a57700 1 -- 172.21.15.154:0/3760657893 wait complete. 2023-09-30T22:23:15.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.980+0000 7f46a439c700 1 Processor -- start 2023-09-30T22:23:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.980+0000 7f46a439c700 1 -- start start 2023-09-30T22:23:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a439c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f469c09f350 0x7f469c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a439c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a439c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c09c970 con 0x7f469c09e870 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a439c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0a0920 con 0x7f469c09f350 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a439c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f469c09f9c0 con 0x7f469c1371c0 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a2939700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a1937700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f469c09f350 0x7f469c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a1937700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f469c09f350 0x7f469c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46620/0 (socket says 172.21.15.154:46620) 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a2939700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34548/0 (socket says 172.21.15.154:34548) 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a1937700 1 -- 172.21.15.154:0/1298999065 learned_addr learned my addr 172.21.15.154:0/1298999065 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a1937700 1 -- 172.21.15.154:0/1298999065 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 msgr2=0x7f469c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a1937700 1 --2- 172.21.15.154:0/1298999065 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a1937700 1 -- 172.21.15.154:0/1298999065 >> v1:172.21.15.154:6789/0 conn(0x7f469c09e870 legacy=0x7f469c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a1937700 1 -- 172.21.15.154:0/1298999065 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c09bab0 con 0x7f469c09f350 2023-09-30T22:23:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.981+0000 7f46a2939700 1 --2- 172.21.15.154:0/1298999065 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a1937700 1 --2- 172.21.15.154:0/1298999065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 0x7f469c136c80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f468c0098f0 tx=0x7f468c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c89de50acc26f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a1136700 1 -- 172.21.15.154:0/1298999065 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c011830 con 0x7f469c09f350 2023-09-30T22:23:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a1136700 1 -- 172.21.15.154:0/1298999065 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c011990 con 0x7f469c09f350 2023-09-30T22:23:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a1136700 1 -- 172.21.15.154:0/1298999065 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c011d20 con 0x7f469c09f350 2023-09-30T22:23:15.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a439c700 1 -- 172.21.15.154:0/1298999065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 msgr2=0x7f469c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a439c700 1 --2- 172.21.15.154:0/1298999065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 0x7f469c136c80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f468c0098f0 tx=0x7f468c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:15.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a439c700 1 -- 172.21.15.154:0/1298999065 shutdown_connections 2023-09-30T22:23:15.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a439c700 1 --2- 172.21.15.154:0/1298999065 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a439c700 1 --2- 172.21.15.154:0/1298999065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 0x7f469c136c80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.982+0000 7f46a439c700 1 -- 172.21.15.154:0/1298999065 >> 172.21.15.154:0/1298999065 conn(0x7f469c0a4430 msgr2=0x7f469c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.983+0000 7f46a439c700 1 -- 172.21.15.154:0/1298999065 shutdown_connections 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.983+0000 7f46a439c700 1 -- 172.21.15.154:0/1298999065 wait complete. 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.984+0000 7f46a439c700 1 Processor -- start 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.984+0000 7f46a439c700 1 -- start start 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a439c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469c09e870 0x7f469c11f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a439c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 0x7f469c11fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a439c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1200c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a439c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1218b0 con 0x7f469c09f350 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a439c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c134f50 con 0x7f469c09e870 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a439c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f469c123160 con 0x7f469c1371c0 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a1937700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 0x7f469c11fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a1937700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 0x7f469c11fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46626/0 (socket says 172.21.15.154:46626) 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a1937700 1 -- 172.21.15.154:0/3235699462 learned_addr learned my addr 172.21.15.154:0/3235699462 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a2138700 1 --2- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469c09e870 0x7f469c11f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a2939700 1 --2- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a1937700 1 -- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 msgr2=0x7f469c1200c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a1937700 1 --2- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1200c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a1937700 1 -- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469c09e870 msgr2=0x7f469c11f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a1937700 1 --2- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469c09e870 0x7f469c11f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a1937700 1 -- 172.21.15.154:0/3235699462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009a70 con 0x7f469c09f350 2023-09-30T22:23:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a1937700 1 --2- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 0x7f469c11fb80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f468c009c40 tx=0x7f468c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f4692ffd700 1 -- 172.21.15.154:0/3235699462 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c004480 con 0x7f469c09f350 2023-09-30T22:23:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f4692ffd700 1 -- 172.21.15.154:0/3235699462 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c01f070 con 0x7f469c09f350 2023-09-30T22:23:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f46a439c700 1 -- 172.21.15.154:0/3235699462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c009550 con 0x7f469c09f350 2023-09-30T22:23:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.985+0000 7f4692ffd700 1 -- 172.21.15.154:0/3235699462 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0038c0 con 0x7f469c09f350 2023-09-30T22:23:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.986+0000 7f46a439c700 1 -- 172.21.15.154:0/3235699462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c122bc0 con 0x7f469c09f350 2023-09-30T22:23:15.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.986+0000 7f4692ffd700 1 -- 172.21.15.154:0/3235699462 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f468c021030 con 0x7f469c09f350 2023-09-30T22:23:15.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.986+0000 7f4692ffd700 1 -- 172.21.15.154:0/3235699462 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f468c0409f0 con 0x7f469c09f350 2023-09-30T22:23:15.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.987+0000 7f46a439c700 1 -- 172.21.15.154:0/3235699462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c04f2a0 con 0x7f469c09f350 2023-09-30T22:23:15.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:15.991+0000 7f4692ffd700 1 -- 172.21.15.154:0/3235699462 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f468c015080 con 0x7f469c09f350 2023-09-30T22:23:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.108+0000 7f716b2a6700 1 -- 172.21.15.154:0/1213107289 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f716406bce0 con 0x7f7164099a60 2023-09-30T22:23:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.108+0000 7f7159ffb700 1 -- 172.21.15.154:0/1213107289 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7160012370 con 0x7f7164099a60 2023-09-30T22:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.111+0000 7f716b2a6700 1 -- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 msgr2=0x7f716411b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.111+0000 7f716b2a6700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f716411b6c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f716000e730 tx=0x7f716000eaf0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.111+0000 7f716b2a6700 1 -- 172.21.15.154:0/1213107289 shutdown_connections 2023-09-30T22:23:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.111+0000 7f716b2a6700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7164133b80 0x7f716411c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.111+0000 7f716b2a6700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7164099a60 0x7f716411b6c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.111+0000 7f716b2a6700 1 --2- 172.21.15.154:0/1213107289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71640a0e20 0x7f716411bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.111+0000 7f716b2a6700 1 -- 172.21.15.154:0/1213107289 >> 172.21.15.154:0/1213107289 conn(0x7f71640a2980 msgr2=0x7f71641bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.111+0000 7f716b2a6700 1 -- 172.21.15.154:0/1213107289 shutdown_connections 2023-09-30T22:23:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.111+0000 7f716b2a6700 1 -- 172.21.15.154:0/1213107289 wait complete. 2023-09-30T22:23:16.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:16.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.134+0000 7ffa16e4f700 1 -- 172.21.15.154:0/861768739 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffa10072420 con 0x7ffa100a1380 2023-09-30T22:23:16.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.135+0000 7ffa0d7fa700 1 -- 172.21.15.154:0/861768739 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa10072420 con 0x7ffa100a1380 2023-09-30T22:23:16.136 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:16.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.138+0000 7ffa16e4f700 1 -- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a1380 msgr2=0x7ffa101c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.138+0000 7ffa16e4f700 1 --2- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a1380 0x7ffa101c8550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffa04000c00 tx=0x7ffa04004750 comp rx=0 tx=0).stop 2023-09-30T22:23:16.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.138+0000 7ffa16e4f700 1 -- 172.21.15.154:0/861768739 shutdown_connections 2023-09-30T22:23:16.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.138+0000 7ffa16e4f700 1 --2- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa101c8fd0 0x7ffa10132510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.138+0000 7ffa16e4f700 1 --2- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa100a1380 0x7ffa101c8550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.138+0000 7ffa16e4f700 1 --2- 172.21.15.154:0/861768739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa10133f50 0x7ffa101c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.138+0000 7ffa16e4f700 1 -- 172.21.15.154:0/861768739 >> 172.21.15.154:0/861768739 conn(0x7ffa100a6610 msgr2=0x7ffa100a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.138+0000 7ffa16e4f700 1 -- 172.21.15.154:0/861768739 shutdown_connections 2023-09-30T22:23:16.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.138+0000 7ffa16e4f700 1 -- 172.21.15.154:0/861768739 wait complete. 2023-09-30T22:23:16.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:16.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.217+0000 7f46a439c700 1 -- 172.21.15.154:0/3235699462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f469c121a40 con 0x7f469c09f350 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.218+0000 7f4692ffd700 1 -- 172.21.15.154:0/3235699462 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f468c003cb0 con 0x7f469c09f350 2023-09-30T22:23:16.219 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:16.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.220+0000 7f46a439c700 1 -- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 msgr2=0x7f469c11fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:16.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.220+0000 7f46a439c700 1 --2- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 0x7f469c11fb80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f468c009c40 tx=0x7f468c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:16.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.220+0000 7f46a439c700 1 -- 172.21.15.154:0/3235699462 shutdown_connections 2023-09-30T22:23:16.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.220+0000 7f46a439c700 1 --2- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469c1371c0 0x7f469c1200c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.220+0000 7f46a439c700 1 --2- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469c09e870 0x7f469c11f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.220+0000 7f46a439c700 1 --2- 172.21.15.154:0/3235699462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f469c09f350 0x7f469c11fb80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:16.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.220+0000 7f46a439c700 1 -- 172.21.15.154:0/3235699462 >> 172.21.15.154:0/3235699462 conn(0x7f469c0a4430 msgr2=0x7f469c09cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:16.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.220+0000 7f46a439c700 1 -- 172.21.15.154:0/3235699462 shutdown_connections 2023-09-30T22:23:16.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:16.220+0000 7f46a439c700 1 -- 172.21.15.154:0/3235699462 wait complete. 2023-09-30T22:23:16.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:16.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1f02b700 1 Processor -- start 2023-09-30T22:23:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1f02b700 1 -- start start 2023-09-30T22:23:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1f02b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf18133ad0 0x7fbf18133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1f02b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf181304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1f02b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf181309f0 0x7fbf1813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1f02b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1806b2d0 con 0x7fbf181309f0 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1f02b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf18133610 con 0x7fbf181300a0 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1f02b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1809a500 con 0x7fbf18133ad0 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1d5c8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf181309f0 0x7fbf1813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf17fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf181304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1cdc7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf18133ad0 0x7fbf18133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1d5c8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf181309f0 0x7fbf1813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46638/0 (socket says 172.21.15.154:46638) 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf17fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf181304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39596/0 (socket says 172.21.15.154:39596) 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1cdc7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf18133ad0 0x7fbf18133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34558/0 (socket says 172.21.15.154:34558) 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.060+0000 7fbf1d5c8700 1 -- 172.21.15.154:0/906461226 learned_addr learned my addr 172.21.15.154:0/906461226 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf1d5c8700 1 -- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf18133ad0 msgr2=0x7fbf18133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf1d5c8700 1 --2- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf18133ad0 0x7fbf18133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf1d5c8700 1 -- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 msgr2=0x7fbf181304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf1d5c8700 1 --2- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf181304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf1d5c8700 1 -- 172.21.15.154:0/906461226 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf181338b0 con 0x7fbf181309f0 2023-09-30T22:23:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf17fff700 1 --2- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf181304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf1d5c8700 1 --2- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf181309f0 0x7fbf1813a980 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009e50 tx=0x7fbf1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0a75d00b52dee2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf177fe700 1 -- 172.21.15.154:0/906461226 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000e070 con 0x7fbf181309f0 2023-09-30T22:23:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf177fe700 1 -- 172.21.15.154:0/906461226 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1000b910 con 0x7fbf181309f0 2023-09-30T22:23:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf177fe700 1 -- 172.21.15.154:0/906461226 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000bcc0 con 0x7fbf181309f0 2023-09-30T22:23:17.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf1f02b700 1 -- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf181309f0 msgr2=0x7fbf1813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.061+0000 7fbf1f02b700 1 --2- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf181309f0 0x7fbf1813a980 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009e50 tx=0x7fbf1000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:17.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.062+0000 7fbf1f02b700 1 -- 172.21.15.154:0/906461226 shutdown_connections 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.062+0000 7fbf1f02b700 1 --2- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf181309f0 0x7fbf1813a980 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.062+0000 7fbf1f02b700 1 --2- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf18133ad0 0x7fbf18133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.062+0000 7fbf1f02b700 1 --2- 172.21.15.154:0/906461226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf181304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.062+0000 7fbf1f02b700 1 -- 172.21.15.154:0/906461226 >> 172.21.15.154:0/906461226 conn(0x7fbf18099c40 msgr2=0x7fbf180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.062+0000 7fbf1f02b700 1 -- 172.21.15.154:0/906461226 shutdown_connections 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.062+0000 7fbf1f02b700 1 -- 172.21.15.154:0/906461226 wait complete. 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.062+0000 7fbf1f02b700 1 Processor -- start 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.062+0000 7fbf1f02b700 1 -- start start 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1f02b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf1811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1f02b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf181309f0 0x7fbf1811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1f02b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf18133ad0 0x7fbf1811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1f02b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf181200c0 con 0x7fbf18133ad0 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1f02b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1811f040 con 0x7fbf181300a0 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1f02b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1811fb20 con 0x7fbf181309f0 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1d5c8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf18133ad0 0x7fbf1811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1cdc7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf1811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1d5c8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf18133ad0 0x7fbf1811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46646/0 (socket says 172.21.15.154:46646) 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1d5c8700 1 -- 172.21.15.154:0/2518958825 learned_addr learned my addr 172.21.15.154:0/2518958825 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf17fff700 1 --2- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf181309f0 0x7fbf1811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1cdc7700 1 -- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf181309f0 msgr2=0x7fbf1811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.063+0000 7fbf1cdc7700 1 --2- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf181309f0 0x7fbf1811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf1cdc7700 1 -- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf18133ad0 msgr2=0x7fbf1811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf1cdc7700 1 --2- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf18133ad0 0x7fbf1811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf1cdc7700 1 -- 172.21.15.154:0/2518958825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf040094a0 con 0x7fbf181300a0 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf1d5c8700 1 --2- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf18133ad0 0x7fbf1811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf1cdc7700 1 --2- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf1811da40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e930 tx=0x7fbf0c00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf157fa700 1 -- 172.21.15.154:0/2518958825 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c013680 con 0x7fbf181300a0 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf157fa700 1 -- 172.21.15.154:0/2518958825 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0137e0 con 0x7fbf181300a0 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf1f02b700 1 -- 172.21.15.154:0/2518958825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf10009b30 con 0x7fbf181300a0 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf157fa700 1 -- 172.21.15.154:0/2518958825 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c013b50 con 0x7fbf181300a0 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf1f02b700 1 -- 172.21.15.154:0/2518958825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1812dd00 con 0x7fbf181300a0 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.064+0000 7fbf157fa700 1 -- 172.21.15.154:0/2518958825 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf0c013cb0 con 0x7fbf181300a0 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.065+0000 7fbf157fa700 1 -- 172.21.15.154:0/2518958825 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf0c03f600 con 0x7fbf181300a0 2023-09-30T22:23:17.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.065+0000 7fbf1f02b700 1 -- 172.21.15.154:0/2518958825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1804f2a0 con 0x7fbf181300a0 2023-09-30T22:23:17.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.069+0000 7fbf157fa700 1 -- 172.21.15.154:0/2518958825 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf0c01bbf0 con 0x7fbf181300a0 2023-09-30T22:23:17.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:17.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:17.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:17.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.265+0000 7f2889032700 1 Processor -- start 2023-09-30T22:23:17.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.265+0000 7f2889032700 1 -- start start 2023-09-30T22:23:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f2889032700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a0a70 0x7f28840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f2889032700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28840a1380 0x7f2884133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f2889032700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f2889032700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288409e9d0 con 0x7f28840a1380 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f2889032700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288409dc00 con 0x7f28840a0a70 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f2889032700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f288409dec0 con 0x7f2884133f50 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f288359e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f288359e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34574/0 (socket says 172.21.15.154:34574) 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f288359e700 1 -- 172.21.15.154:0/2943753070 learned_addr learned my addr 172.21.15.154:0/2943753070 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f288259c700 1 --2- 172.21.15.154:0/2943753070 >> v2:172.21.15.154:3300/0 conn(0x7f28840a1380 0x7f2884133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.266+0000 7f2882d9d700 1 --2- 172.21.15.154:0/2943753070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a0a70 0x7f28840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7f288359e700 1 -- 172.21.15.154:0/2943753070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a0a70 msgr2=0x7f28840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7f288359e700 1 --2- 172.21.15.154:0/2943753070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a0a70 0x7f28840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7f288359e700 1 -- 172.21.15.154:0/2943753070 >> v2:172.21.15.154:3300/0 conn(0x7f28840a1380 msgr2=0x7f2884133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7f288359e700 1 --2- 172.21.15.154:0/2943753070 >> v2:172.21.15.154:3300/0 conn(0x7f28840a1380 0x7f2884133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7f288359e700 1 -- 172.21.15.154:0/2943753070 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288409e6a0 con 0x7f2884133f50 2023-09-30T22:23:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7f288359e700 1 --2- 172.21.15.154:0/2943753070 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884134380 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f287c009e50 tx=0x7f287c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db1f458757a1e0ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7fbf1f02b700 1 -- 172.21.15.154:0/2518958825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbf1812d970 con 0x7fbf181300a0 2023-09-30T22:23:17.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7f2881d9b700 1 -- 172.21.15.154:0/2943753070 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00e070 con 0x7f2884133f50 2023-09-30T22:23:17.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7f2881d9b700 1 -- 172.21.15.154:0/2943753070 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c00b910 con 0x7f2884133f50 2023-09-30T22:23:17.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7f2881d9b700 1 -- 172.21.15.154:0/2943753070 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00bcc0 con 0x7f2884133f50 2023-09-30T22:23:17.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.267+0000 7fbf157fa700 1 -- 172.21.15.154:0/2518958825 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf0c021030 con 0x7fbf181300a0 2023-09-30T22:23:17.270 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:17.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.268+0000 7f2889032700 1 -- 172.21.15.154:0/2943753070 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 msgr2=0x7f2884134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.268+0000 7f2889032700 1 --2- 172.21.15.154:0/2943753070 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884134380 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f287c009e50 tx=0x7f287c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:17.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.268+0000 7f2889032700 1 -- 172.21.15.154:0/2943753070 shutdown_connections 2023-09-30T22:23:17.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.268+0000 7f2889032700 1 --2- 172.21.15.154:0/2943753070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a0a70 0x7f28840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.268+0000 7f2889032700 1 --2- 172.21.15.154:0/2943753070 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884134380 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.268+0000 7f2889032700 1 --2- 172.21.15.154:0/2943753070 >> v2:172.21.15.154:3300/0 conn(0x7f28840a1380 0x7f2884133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.268+0000 7f2889032700 1 -- 172.21.15.154:0/2943753070 >> 172.21.15.154:0/2943753070 conn(0x7f28840a6610 msgr2=0x7f28840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.269+0000 7f2889032700 1 -- 172.21.15.154:0/2943753070 shutdown_connections 2023-09-30T22:23:17.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.269+0000 7f2889032700 1 -- 172.21.15.154:0/2943753070 wait complete. 2023-09-30T22:23:17.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.269+0000 7fbf1f02b700 1 -- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 msgr2=0x7fbf1811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.269+0000 7fbf1f02b700 1 --2- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf1811da40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e930 tx=0x7fbf0c00ec40 comp rx=0 tx=0).stop 2023-09-30T22:23:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.269+0000 7fbf1f02b700 1 -- 172.21.15.154:0/2518958825 shutdown_connections 2023-09-30T22:23:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.269+0000 7fbf1f02b700 1 --2- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf18133ad0 0x7fbf1811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.269+0000 7fbf1f02b700 1 --2- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf181300a0 0x7fbf1811da40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.269+0000 7fbf1f02b700 1 --2- 172.21.15.154:0/2518958825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbf181309f0 0x7fbf1811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.269+0000 7fbf1f02b700 1 -- 172.21.15.154:0/2518958825 >> 172.21.15.154:0/2518958825 conn(0x7fbf18099c40 msgr2=0x7fbf18131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.270+0000 7fbf1f02b700 1 -- 172.21.15.154:0/2518958825 shutdown_connections 2023-09-30T22:23:17.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.270+0000 7fbf1f02b700 1 -- 172.21.15.154:0/2518958825 wait complete. 2023-09-30T22:23:17.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.271+0000 7f2889032700 1 Processor -- start 2023-09-30T22:23:17.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.271+0000 7f2889032700 1 -- start start 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2889032700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28840a0a70 0x7f2884122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2889032700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a1380 0x7f2884122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2889032700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2889032700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884125930 con 0x7f28840a0a70 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2889032700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2884124320 con 0x7f28840a1380 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2889032700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28841332e0 con 0x7f2884133f50 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2882d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28840a0a70 0x7f2884122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2882d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28840a0a70 0x7f2884122710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46656/0 (socket says 172.21.15.154:46656) 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2882d9d700 1 -- 172.21.15.154:0/3501968051 learned_addr learned my addr 172.21.15.154:0/3501968051 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f288259c700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a1380 0x7f2884122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f288359e700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f288259c700 1 -- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 msgr2=0x7f2884123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f288259c700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f288259c700 1 -- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28840a0a70 msgr2=0x7f2884122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f288259c700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28840a0a70 0x7f2884122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f288259c700 1 -- 172.21.15.154:0/3501968051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c009b30 con 0x7f28840a1380 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f2882d9d700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28840a0a70 0x7f2884122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.272+0000 7f288359e700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.273+0000 7f288259c700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a1380 0x7f2884122c50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f287800e8d0 tx=0x7f287800ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.273+0000 7f286b7fe700 1 -- 172.21.15.154:0/3501968051 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878013680 con 0x7f28840a1380 2023-09-30T22:23:17.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.273+0000 7f286b7fe700 1 -- 172.21.15.154:0/3501968051 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28780137e0 con 0x7f28840a1380 2023-09-30T22:23:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.273+0000 7f286b7fe700 1 -- 172.21.15.154:0/3501968051 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878013b50 con 0x7f28840a1380 2023-09-30T22:23:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.273+0000 7f2889032700 1 -- 172.21.15.154:0/3501968051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2884126230 con 0x7f28840a1380 2023-09-30T22:23:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.273+0000 7f2889032700 1 -- 172.21.15.154:0/3501968051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288409d3a0 con 0x7f28840a1380 2023-09-30T22:23:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.274+0000 7f286b7fe700 1 -- 172.21.15.154:0/3501968051 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2878013cb0 con 0x7f28840a1380 2023-09-30T22:23:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.274+0000 7f286b7fe700 1 -- 172.21.15.154:0/3501968051 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f287803f630 con 0x7f28840a1380 2023-09-30T22:23:17.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.274+0000 7f2889032700 1 -- 172.21.15.154:0/3501968051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2884126070 con 0x7f28840a1380 2023-09-30T22:23:17.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.283+0000 7f286b7fe700 1 -- 172.21.15.154:0/3501968051 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2878021020 con 0x7f28840a1380 2023-09-30T22:23:17.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:17.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d68fa700 1 Processor -- start 2023-09-30T22:23:17.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d68fa700 1 -- start start 2023-09-30T22:23:17.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d68fa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009e870 0x7f68d009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d68fa700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68d009f180 0x7f68d0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d68fa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d0132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d68fa700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d00a0920 con 0x7f68d009f180 2023-09-30T22:23:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d68fa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d009c970 con 0x7f68d0131d70 2023-09-30T22:23:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d68fa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68d009bab0 con 0x7f68d009e870 2023-09-30T22:23:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d4e97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d0132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68cffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009e870 0x7f68d009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d4e97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d0132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39634/0 (socket says 172.21.15.154:39634) 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68d4e97700 1 -- 172.21.15.154:0/1737240029 learned_addr learned my addr 172.21.15.154:0/1737240029 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.320+0000 7f68cf7fe700 1 --2- 172.21.15.154:0/1737240029 >> v2:172.21.15.154:3300/0 conn(0x7f68d009f180 0x7f68d0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68cf7fe700 1 -- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009e870 msgr2=0x7f68d009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68cf7fe700 1 --2- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009e870 0x7f68d009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68cf7fe700 1 -- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 msgr2=0x7f68d0132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68cf7fe700 1 --2- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d0132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68cf7fe700 1 -- 172.21.15.154:0/1737240029 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d009f9c0 con 0x7f68d009f180 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68d4e97700 1 --2- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d0132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68cffff700 1 --2- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009e870 0x7f68d009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68cf7fe700 1 --2- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009f180 0x7f68d0131830 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009870 tx=0x7f68c4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a580a5e32c15d392 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68ceffd700 1 -- 172.21.15.154:0/1737240029 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4011830 con 0x7f68d009f180 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68ceffd700 1 -- 172.21.15.154:0/1737240029 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c4011990 con 0x7f68d009f180 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.321+0000 7f68ceffd700 1 -- 172.21.15.154:0/1737240029 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4011d20 con 0x7f68d009f180 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.322+0000 7f68d68fa700 1 -- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009f180 msgr2=0x7f68d0131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.322+0000 7f68d68fa700 1 --2- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009f180 0x7f68d0131830 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009870 tx=0x7f68c4009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.322+0000 7f68d68fa700 1 -- 172.21.15.154:0/1737240029 shutdown_connections 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.322+0000 7f68d68fa700 1 --2- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d0132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.322+0000 7f68d68fa700 1 --2- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009e870 0x7f68d009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.322+0000 7f68d68fa700 1 --2- 172.21.15.154:0/1737240029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009f180 0x7f68d0131830 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.322+0000 7f68d68fa700 1 -- 172.21.15.154:0/1737240029 >> 172.21.15.154:0/1737240029 conn(0x7f68d00a4430 msgr2=0x7f68d00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.322+0000 7f68d68fa700 1 -- 172.21.15.154:0/1737240029 shutdown_connections 2023-09-30T22:23:17.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.322+0000 7f68d68fa700 1 -- 172.21.15.154:0/1737240029 wait complete. 2023-09-30T22:23:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68d68fa700 1 Processor -- start 2023-09-30T22:23:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68d68fa700 1 -- start start 2023-09-30T22:23:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68d68fa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009e870 0x7f68d006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68d68fa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009f180 0x7f68d006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68d68fa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68d68fa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d012e630 con 0x7f68d009e870 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68d68fa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0122800 con 0x7f68d0131d70 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68d68fa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68d006ccf0 con 0x7f68d009f180 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68cf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009f180 0x7f68d006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.323+0000 7f68cf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009f180 0x7f68d006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34584/0 (socket says 172.21.15.154:34584) 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68cf7fe700 1 -- 172.21.15.154:0/3335936783 learned_addr learned my addr 172.21.15.154:0/3335936783 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68cffff700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009e870 0x7f68d006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68d4e97700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68d4e97700 1 -- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009f180 msgr2=0x7f68d006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68d4e97700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009f180 0x7f68d006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68d4e97700 1 -- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009e870 msgr2=0x7f68d006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68d4e97700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009e870 0x7f68d006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68d4e97700 1 -- 172.21.15.154:0/3335936783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00094a0 con 0x7f68d0131d70 2023-09-30T22:23:17.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68cffff700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009e870 0x7f68d006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68cf7fe700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009f180 0x7f68d006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68d4e97700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d006c330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009e50 tx=0x7f68c800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68ccff9700 1 -- 172.21.15.154:0/3335936783 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8018070 con 0x7f68d0131d70 2023-09-30T22:23:17.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68ccff9700 1 -- 172.21.15.154:0/3335936783 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c800f040 con 0x7f68d0131d70 2023-09-30T22:23:17.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68d68fa700 1 -- 172.21.15.154:0/3335936783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c8009b30 con 0x7f68d0131d70 2023-09-30T22:23:17.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68ccff9700 1 -- 172.21.15.154:0/3335936783 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8003c40 con 0x7f68d0131d70 2023-09-30T22:23:17.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.324+0000 7f68d68fa700 1 -- 172.21.15.154:0/3335936783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c40094a0 con 0x7f68d0131d70 2023-09-30T22:23:17.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.325+0000 7f68ccff9700 1 -- 172.21.15.154:0/3335936783 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68c800c880 con 0x7f68d0131d70 2023-09-30T22:23:17.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.325+0000 7f68ccff9700 1 -- 172.21.15.154:0/3335936783 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68c803f740 con 0x7f68d0131d70 2023-09-30T22:23:17.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.326+0000 7f68d68fa700 1 -- 172.21.15.154:0/3335936783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d0122590 con 0x7f68d0131d70 2023-09-30T22:23:17.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.330+0000 7f68ccff9700 1 -- 172.21.15.154:0/3335936783 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68d0122590 con 0x7f68d0131d70 2023-09-30T22:23:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.384+0000 7f10779b4700 1 Processor -- start 2023-09-30T22:23:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.385+0000 7f10779b4700 1 -- start start 2023-09-30T22:23:17.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.385+0000 7f10779b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f107009e950 0x7f107009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.385+0000 7f10779b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009f260 0x7f1070131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.385+0000 7f10779b4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107009afb0 con 0x7f1070131dd0 2023-09-30T22:23:17.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.385+0000 7f10779b4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10700a0970 con 0x7f107009e950 2023-09-30T22:23:17.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.385+0000 7f10779b4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10700a0320 con 0x7f107009f260 2023-09-30T22:23:17.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1075f51700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1070131dd0 0x7f1070138ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39842/0 (socket says 172.21.15.154:39842) 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1075750700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f107009e950 0x7f107009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1075f51700 1 -- 172.21.15.154:0/2630869455 learned_addr learned my addr 172.21.15.154:0/2630869455 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1074f4f700 1 --2- 172.21.15.154:0/2630869455 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009f260 0x7f1070131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1067fff700 1 -- 172.21.15.154:0/2630869455 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085649406 0 0) 0x7f107009afb0 con 0x7f1070131dd0 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1067fff700 1 -- 172.21.15.154:0/2630869455 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f105c0035b0 con 0x7f1070131dd0 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1075750700 1 -- 172.21.15.154:0/2630869455 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009f260 msgr2=0x7f1070131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1075750700 1 --2- 172.21.15.154:0/2630869455 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009f260 0x7f1070131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1075750700 1 -- 172.21.15.154:0/2630869455 >> v1:172.21.15.154:6789/0 conn(0x7f1070131dd0 legacy=0x7f1070138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1075750700 1 -- 172.21.15.154:0/2630869455 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700a0750 con 0x7f107009e950 2023-09-30T22:23:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1074f4f700 1 --2- 172.21.15.154:0/2630869455 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009f260 0x7f1070131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1075750700 1 --2- 172.21.15.154:0/2630869455 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f107009e950 0x7f107009ed20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f106c009850 tx=0x7f106c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1850675e2c239769 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1067fff700 1 -- 172.21.15.154:0/2630869455 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c005e30 con 0x7f107009e950 2023-09-30T22:23:17.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1067fff700 1 -- 172.21.15.154:0/2630869455 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106c006030 con 0x7f107009e950 2023-09-30T22:23:17.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.386+0000 7f1067fff700 1 -- 172.21.15.154:0/2630869455 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106c0063e0 con 0x7f107009e950 2023-09-30T22:23:17.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.387+0000 7f10779b4700 1 -- 172.21.15.154:0/2630869455 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f107009e950 msgr2=0x7f107009ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.387+0000 7f10779b4700 1 --2- 172.21.15.154:0/2630869455 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f107009e950 0x7f107009ed20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f106c009850 tx=0x7f106c009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.387+0000 7f10779b4700 1 -- 172.21.15.154:0/2630869455 shutdown_connections 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.387+0000 7f10779b4700 1 --2- 172.21.15.154:0/2630869455 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f107009e950 0x7f107009ed20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.387+0000 7f10779b4700 1 --2- 172.21.15.154:0/2630869455 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009f260 0x7f1070131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.387+0000 7f10779b4700 1 -- 172.21.15.154:0/2630869455 >> 172.21.15.154:0/2630869455 conn(0x7f10700a0f70 msgr2=0x7f10700a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.387+0000 7f10779b4700 1 -- 172.21.15.154:0/2630869455 shutdown_connections 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.387+0000 7f10779b4700 1 -- 172.21.15.154:0/2630869455 wait complete. 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.388+0000 7f10779b4700 1 Processor -- start 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.388+0000 7f10779b4700 1 -- start start 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f10779b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009e950 0x7f10701205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f10779b4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f107009f260 0x7f1070120af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f10779b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1070131dd0 0x7f1070121030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f10779b4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10701221c0 con 0x7f107009f260 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f10779b4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107009da40 con 0x7f1070131dd0 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f10779b4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1070123b30 con 0x7f107009e950 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1075f51700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1070131dd0 0x7f1070121030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1075750700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009e950 0x7f10701205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1075f51700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1070131dd0 0x7f1070121030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39664/0 (socket says 172.21.15.154:39664) 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1075f51700 1 -- 172.21.15.154:0/4003482124 learned_addr learned my addr 172.21.15.154:0/4003482124 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1074f4f700 1 --2- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f107009f260 0x7f1070120af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1075f51700 1 -- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009e950 msgr2=0x7f10701205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1075f51700 1 --2- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009e950 0x7f10701205b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1075f51700 1 -- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f107009f260 msgr2=0x7f1070120af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1075f51700 1 --2- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f107009f260 0x7f1070120af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.389+0000 7f1075f51700 1 -- 172.21.15.154:0/4003482124 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600094a0 con 0x7f1070131dd0 2023-09-30T22:23:17.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.390+0000 7f1074f4f700 1 --2- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f107009f260 0x7f1070120af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:17.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.390+0000 7f1075f51700 1 --2- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1070131dd0 0x7f1070121030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f106800cb40 tx=0x7f106800ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:17.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.390+0000 7f1065ffb700 1 -- 172.21.15.154:0/4003482124 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106800a9e0 con 0x7f1070131dd0 2023-09-30T22:23:17.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.390+0000 7f1065ffb700 1 -- 172.21.15.154:0/4003482124 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106800ab40 con 0x7f1070131dd0 2023-09-30T22:23:17.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.390+0000 7f10779b4700 1 -- 172.21.15.154:0/4003482124 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c009430 con 0x7f1070131dd0 2023-09-30T22:23:17.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.390+0000 7f1065ffb700 1 -- 172.21.15.154:0/4003482124 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1068012400 con 0x7f1070131dd0 2023-09-30T22:23:17.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.390+0000 7f10779b4700 1 -- 172.21.15.154:0/4003482124 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10701310d0 con 0x7f1070131dd0 2023-09-30T22:23:17.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.391+0000 7f1065ffb700 1 -- 172.21.15.154:0/4003482124 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f106801b3b0 con 0x7f1070131dd0 2023-09-30T22:23:17.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.391+0000 7f1065ffb700 1 -- 172.21.15.154:0/4003482124 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f106803f2b0 con 0x7f1070131dd0 2023-09-30T22:23:17.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.391+0000 7f10779b4700 1 -- 172.21.15.154:0/4003482124 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107004f2a0 con 0x7f1070131dd0 2023-09-30T22:23:17.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.396+0000 7f1065ffb700 1 -- 172.21.15.154:0/4003482124 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1068017020 con 0x7f1070131dd0 2023-09-30T22:23:17.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.494+0000 7f2889032700 1 -- 172.21.15.154:0/3501968051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28840a4970 con 0x7f28840a1380 2023-09-30T22:23:17.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.494+0000 7f286b7fe700 1 -- 172.21.15.154:0/3501968051 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f287801be10 con 0x7f28840a1380 2023-09-30T22:23:17.495 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:17.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.496+0000 7f2889032700 1 -- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a1380 msgr2=0x7f2884122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.496+0000 7f2889032700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a1380 0x7f2884122c50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f287800e8d0 tx=0x7f287800ebe0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.496+0000 7f2889032700 1 -- 172.21.15.154:0/3501968051 shutdown_connections 2023-09-30T22:23:17.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.496+0000 7f2889032700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2884133f50 0x7f2884123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.496+0000 7f2889032700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28840a0a70 0x7f2884122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.496+0000 7f2889032700 1 --2- 172.21.15.154:0/3501968051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28840a1380 0x7f2884122c50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.496+0000 7f2889032700 1 -- 172.21.15.154:0/3501968051 >> 172.21.15.154:0/3501968051 conn(0x7f28840a6610 msgr2=0x7f288411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.497+0000 7f2889032700 1 -- 172.21.15.154:0/3501968051 shutdown_connections 2023-09-30T22:23:17.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.497+0000 7f2889032700 1 -- 172.21.15.154:0/3501968051 wait complete. 2023-09-30T22:23:17.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.561+0000 7f68d68fa700 1 -- 172.21.15.154:0/3335936783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68d0122590 con 0x7f68d0131d70 2023-09-30T22:23:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.562+0000 7f68ccff9700 1 -- 172.21.15.154:0/3335936783 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68d0122590 con 0x7f68d0131d70 2023-09-30T22:23:17.563 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.565+0000 7f68d68fa700 1 -- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 msgr2=0x7f68d006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.565+0000 7f68d68fa700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d006c330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009e50 tx=0x7f68c800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.565+0000 7f68d68fa700 1 -- 172.21.15.154:0/3335936783 shutdown_connections 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.565+0000 7f68d68fa700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d0131d70 0x7f68d006c330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.565+0000 7f68d68fa700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d009e870 0x7f68d006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.565+0000 7f68d68fa700 1 --2- 172.21.15.154:0/3335936783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68d009f180 0x7f68d006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.565+0000 7f68d68fa700 1 -- 172.21.15.154:0/3335936783 >> 172.21.15.154:0/3335936783 conn(0x7f68d00a4430 msgr2=0x7f68d009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.565+0000 7f68d68fa700 1 -- 172.21.15.154:0/3335936783 shutdown_connections 2023-09-30T22:23:17.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.565+0000 7f68d68fa700 1 -- 172.21.15.154:0/3335936783 wait complete. 2023-09-30T22:23:17.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:17.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.610+0000 7f10779b4700 1 -- 172.21.15.154:0/4003482124 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1070123eb0 con 0x7f1070131dd0 2023-09-30T22:23:17.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.610+0000 7f1065ffb700 1 -- 172.21.15.154:0/4003482124 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10680192c0 con 0x7f1070131dd0 2023-09-30T22:23:17.611 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.612+0000 7f10779b4700 1 -- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1070131dd0 msgr2=0x7f1070121030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.612+0000 7f10779b4700 1 --2- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1070131dd0 0x7f1070121030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f106800cb40 tx=0x7f106800ce50 comp rx=0 tx=0).stop 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.612+0000 7f10779b4700 1 -- 172.21.15.154:0/4003482124 shutdown_connections 2023-09-30T22:23:17.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.612+0000 7f10779b4700 1 --2- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1070131dd0 0x7f1070121030 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.612+0000 7f10779b4700 1 --2- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f107009e950 0x7f10701205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.612+0000 7f10779b4700 1 --2- 172.21.15.154:0/4003482124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f107009f260 0x7f1070120af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.612+0000 7f10779b4700 1 -- 172.21.15.154:0/4003482124 >> 172.21.15.154:0/4003482124 conn(0x7f10700a0f70 msgr2=0x7f1070071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.612+0000 7f10779b4700 1 -- 172.21.15.154:0/4003482124 shutdown_connections 2023-09-30T22:23:17.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:17.612+0000 7f10779b4700 1 -- 172.21.15.154:0/4003482124 wait complete. 2023-09-30T22:23:17.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:18.285 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:18.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.410+0000 7f385616e700 1 Processor -- start 2023-09-30T22:23:18.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.410+0000 7f385616e700 1 -- start start 2023-09-30T22:23:18.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f385616e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f385009d860 0x7f385009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f385616e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f385009e170 0x7f38501307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f385616e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3850130ce0 0x7f3850131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f385616e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3850131670 con 0x7f385009d860 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f385616e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385009aaa0 con 0x7f385009e170 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f385616e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f385009f870 con 0x7f3850130ce0 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f385009e170 0x7f38501307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f385009d860 0x7f385009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f385009e170 0x7f38501307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39666/0 (socket says 172.21.15.154:39666) 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f385009d860 0x7f385009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46700/0 (socket says 172.21.15.154:46700) 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384effd700 1 -- 172.21.15.154:0/3593265966 learned_addr learned my addr 172.21.15.154:0/3593265966 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384ffff700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3850130ce0 0x7f3850131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384f7fe700 1 -- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3850130ce0 msgr2=0x7f3850131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384f7fe700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3850130ce0 0x7f3850131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384f7fe700 1 -- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f385009e170 msgr2=0x7f38501307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384f7fe700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f385009e170 0x7f38501307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384f7fe700 1 -- 172.21.15.154:0/3593265966 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385009b360 con 0x7f385009d860 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384effd700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f385009e170 0x7f38501307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.411+0000 7f384ffff700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3850130ce0 0x7f3850131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f384f7fe700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009d860 0x7f385009dc30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3840009870 tx=0x7f3840009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847cd24fabb5ccec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f384e7fc700 1 -- 172.21.15.154:0/3593265966 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840011830 con 0x7f385009d860 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f384e7fc700 1 -- 172.21.15.154:0/3593265966 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840011990 con 0x7f385009d860 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f384e7fc700 1 -- 172.21.15.154:0/3593265966 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840011d20 con 0x7f385009d860 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f385616e700 1 -- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009d860 msgr2=0x7f385009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f385616e700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009d860 0x7f385009dc30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3840009870 tx=0x7f3840009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f385616e700 1 -- 172.21.15.154:0/3593265966 shutdown_connections 2023-09-30T22:23:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f385616e700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3850130ce0 0x7f3850131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f385616e700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009d860 0x7f385009dc30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f385616e700 1 --2- 172.21.15.154:0/3593265966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f385009e170 0x7f38501307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f385616e700 1 -- 172.21.15.154:0/3593265966 >> 172.21.15.154:0/3593265966 conn(0x7f3850099c40 msgr2=0x7f38500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f385616e700 1 -- 172.21.15.154:0/3593265966 shutdown_connections 2023-09-30T22:23:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.412+0000 7f385616e700 1 -- 172.21.15.154:0/3593265966 wait complete. 2023-09-30T22:23:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.413+0000 7f385616e700 1 Processor -- start 2023-09-30T22:23:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.413+0000 7f385616e700 1 -- start start 2023-09-30T22:23:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f385616e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f385009d860 0x7f3850120530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f385616e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009e170 0x7f3850120a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f385616e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3850130ce0 0x7f3850120fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f385616e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3850122140 con 0x7f385009e170 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f385616e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385009a150 con 0x7f3850130ce0 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f385616e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3850124050 con 0x7f385009d860 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009e170 0x7f3850120a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f385009d860 0x7f3850120530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009e170 0x7f3850120a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46710/0 (socket says 172.21.15.154:46710) 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384effd700 1 -- 172.21.15.154:0/1850960454 learned_addr learned my addr 172.21.15.154:0/1850960454 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3850130ce0 0x7f3850120fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384effd700 1 -- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f385009d860 msgr2=0x7f3850120530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384effd700 1 --2- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f385009d860 0x7f3850120530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384effd700 1 -- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3850130ce0 msgr2=0x7f3850120fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384effd700 1 --2- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3850130ce0 0x7f3850120fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384effd700 1 -- 172.21.15.154:0/1850960454 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844009550 con 0x7f385009e170 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384ffff700 1 --2- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3850130ce0 0x7f3850120fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384f7fe700 1 --2- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f385009d860 0x7f3850120530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f384effd700 1 --2- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009e170 0x7f3850120a70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f384400ebb0 tx=0x7f384400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.414+0000 7f3837fff700 1 -- 172.21.15.154:0/1850960454 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844009e80 con 0x7f385009e170 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.415+0000 7f3837fff700 1 -- 172.21.15.154:0/1850960454 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844004030 con 0x7f385009e170 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.415+0000 7f385616e700 1 -- 172.21.15.154:0/1850960454 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3848009a70 con 0x7f385009e170 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.415+0000 7f3837fff700 1 -- 172.21.15.154:0/1850960454 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38440043a0 con 0x7f385009e170 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.415+0000 7f385616e700 1 -- 172.21.15.154:0/1850960454 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38400094a0 con 0x7f385009e170 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.415+0000 7f3837fff700 1 -- 172.21.15.154:0/1850960454 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f384400c850 con 0x7f385009e170 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.415+0000 7f3837fff700 1 -- 172.21.15.154:0/1850960454 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f384403f8c0 con 0x7f385009e170 2023-09-30T22:23:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.415+0000 7f385616e700 1 -- 172.21.15.154:0/1850960454 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385004f2a0 con 0x7f385009e170 2023-09-30T22:23:18.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.420+0000 7f3837fff700 1 -- 172.21.15.154:0/1850960454 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3844020080 con 0x7f385009e170 2023-09-30T22:23:18.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:18.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:18.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.610+0000 7f385616e700 1 -- 172.21.15.154:0/1850960454 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f38501239d0 con 0x7f385009e170 2023-09-30T22:23:18.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.610+0000 7f3837fff700 1 -- 172.21.15.154:0/1850960454 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3844011d90 con 0x7f385009e170 2023-09-30T22:23:18.611 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.612+0000 7f385616e700 1 -- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009e170 msgr2=0x7f3850120a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.612+0000 7f385616e700 1 --2- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009e170 0x7f3850120a70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f384400ebb0 tx=0x7f384400eec0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.612+0000 7f385616e700 1 -- 172.21.15.154:0/1850960454 shutdown_connections 2023-09-30T22:23:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.612+0000 7f385616e700 1 --2- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3850130ce0 0x7f3850120fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.612+0000 7f385616e700 1 --2- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f385009d860 0x7f3850120530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.612+0000 7f385616e700 1 --2- 172.21.15.154:0/1850960454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f385009e170 0x7f3850120a70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.612+0000 7f385616e700 1 -- 172.21.15.154:0/1850960454 >> 172.21.15.154:0/1850960454 conn(0x7f3850099c40 msgr2=0x7f3850130070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.613+0000 7f385616e700 1 -- 172.21.15.154:0/1850960454 shutdown_connections 2023-09-30T22:23:18.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.613+0000 7f385616e700 1 -- 172.21.15.154:0/1850960454 wait complete. 2023-09-30T22:23:18.626 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:18.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:18.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.643+0000 7f901e94b700 1 Processor -- start 2023-09-30T22:23:18.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.643+0000 7f901e94b700 1 -- start start 2023-09-30T22:23:18.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.643+0000 7f901e94b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9018133900 0x7f9018133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.643+0000 7f901e94b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9018134210 0x7f90180a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.643+0000 7f901e94b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90180a0ee0 0x7f90180a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.643+0000 7f901e94b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901809a760 con 0x7f9018133900 2023-09-30T22:23:18.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.643+0000 7f901e94b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90181336e0 con 0x7f9018134210 2023-09-30T22:23:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.643+0000 7f901e94b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f901809a080 con 0x7f90180a0ee0 2023-09-30T22:23:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f90177fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9018134210 0x7f90180a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f90177fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9018134210 0x7f90180a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39680/0 (socket says 172.21.15.154:39680) 2023-09-30T22:23:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f90177fe700 1 -- 172.21.15.154:0/2855860927 learned_addr learned my addr 172.21.15.154:0/2855860927 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f901cee8700 1 --2- 172.21.15.154:0/2855860927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90180a0ee0 0x7f90180a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f9017fff700 1 --2- 172.21.15.154:0/2855860927 >> v2:172.21.15.154:3300/0 conn(0x7f9018133900 0x7f9018133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f90177fe700 1 -- 172.21.15.154:0/2855860927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90180a0ee0 msgr2=0x7f90180a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f90177fe700 1 --2- 172.21.15.154:0/2855860927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90180a0ee0 0x7f90180a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f90177fe700 1 -- 172.21.15.154:0/2855860927 >> v2:172.21.15.154:3300/0 conn(0x7f9018133900 msgr2=0x7f9018133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f90177fe700 1 --2- 172.21.15.154:0/2855860927 >> v2:172.21.15.154:3300/0 conn(0x7f9018133900 0x7f9018133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f90177fe700 1 -- 172.21.15.154:0/2855860927 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90180a23e0 con 0x7f9018134210 2023-09-30T22:23:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f901cee8700 1 --2- 172.21.15.154:0/2855860927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90180a0ee0 0x7f90180a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f90177fe700 1 --2- 172.21.15.154:0/2855860927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9018134210 0x7f90180a09a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f900c0098f0 tx=0x7f900c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=869a53c06179cb1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f9016ffd700 1 -- 172.21.15.154:0/2855860927 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c011830 con 0x7f9018134210 2023-09-30T22:23:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f9016ffd700 1 -- 172.21.15.154:0/2855860927 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c011990 con 0x7f9018134210 2023-09-30T22:23:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.644+0000 7f9016ffd700 1 -- 172.21.15.154:0/2855860927 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c011d20 con 0x7f9018134210 2023-09-30T22:23:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.645+0000 7f901e94b700 1 -- 172.21.15.154:0/2855860927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9018134210 msgr2=0x7f90180a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.645+0000 7f901e94b700 1 --2- 172.21.15.154:0/2855860927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9018134210 0x7f90180a09a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f900c0098f0 tx=0x7f900c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.645+0000 7f901e94b700 1 -- 172.21.15.154:0/2855860927 shutdown_connections 2023-09-30T22:23:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.645+0000 7f901e94b700 1 --2- 172.21.15.154:0/2855860927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90180a0ee0 0x7f90180a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.645+0000 7f901e94b700 1 --2- 172.21.15.154:0/2855860927 >> v2:172.21.15.154:3300/0 conn(0x7f9018133900 0x7f9018133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.645+0000 7f901e94b700 1 --2- 172.21.15.154:0/2855860927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9018134210 0x7f90180a09a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.645+0000 7f901e94b700 1 -- 172.21.15.154:0/2855860927 >> 172.21.15.154:0/2855860927 conn(0x7f90180a2980 msgr2=0x7f90180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.645+0000 7f901e94b700 1 -- 172.21.15.154:0/2855860927 shutdown_connections 2023-09-30T22:23:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.645+0000 7f901e94b700 1 -- 172.21.15.154:0/2855860927 wait complete. 2023-09-30T22:23:18.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.646+0000 7f901e94b700 1 Processor -- start 2023-09-30T22:23:18.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.646+0000 7f901e94b700 1 -- start start 2023-09-30T22:23:18.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f901e94b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90180a0ee0 0x7f901811d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f901e94b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9018133900 0x7f901811dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f901e94b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9018134210 0x7f901811e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f901e94b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9018120580 con 0x7f9018134210 2023-09-30T22:23:18.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f901e94b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901811ebb0 con 0x7f90180a0ee0 2023-09-30T22:23:18.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f901e94b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9018120fd0 con 0x7f9018133900 2023-09-30T22:23:18.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f9017fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90180a0ee0 0x7f901811d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f9017fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90180a0ee0 0x7f901811d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39692/0 (socket says 172.21.15.154:39692) 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f9017fff700 1 -- 172.21.15.154:0/675476485 learned_addr learned my addr 172.21.15.154:0/675476485 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f90177fe700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9018133900 0x7f901811dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f901cee8700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9018134210 0x7f901811e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f90177fe700 1 -- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90180a0ee0 msgr2=0x7f901811d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f90177fe700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90180a0ee0 0x7f901811d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f90177fe700 1 -- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9018134210 msgr2=0x7f901811e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f90177fe700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9018134210 0x7f901811e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f90177fe700 1 -- 172.21.15.154:0/675476485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9010009a70 con 0x7f9018133900 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f9017fff700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90180a0ee0 0x7f901811d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f901cee8700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9018134210 0x7f901811e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.647+0000 7f90177fe700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9018133900 0x7f901811dc40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f900c016000 tx=0x7f900c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.648+0000 7f9014ff9700 1 -- 172.21.15.154:0/675476485 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c004450 con 0x7f9018133900 2023-09-30T22:23:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.648+0000 7f9014ff9700 1 -- 172.21.15.154:0/675476485 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c0045b0 con 0x7f9018133900 2023-09-30T22:23:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.648+0000 7f901e94b700 1 -- 172.21.15.154:0/675476485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c009550 con 0x7f9018133900 2023-09-30T22:23:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.648+0000 7f9014ff9700 1 -- 172.21.15.154:0/675476485 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0038c0 con 0x7f9018133900 2023-09-30T22:23:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.648+0000 7f901e94b700 1 -- 172.21.15.154:0/675476485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9018120110 con 0x7f9018133900 2023-09-30T22:23:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.649+0000 7f9014ff9700 1 -- 172.21.15.154:0/675476485 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f900c003a20 con 0x7f9018133900 2023-09-30T22:23:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.649+0000 7f901e94b700 1 -- 172.21.15.154:0/675476485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9018132e00 con 0x7f9018133900 2023-09-30T22:23:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.649+0000 7f9014ff9700 1 -- 172.21.15.154:0/675476485 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f900c040650 con 0x7f9018133900 2023-09-30T22:23:18.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.654+0000 7f9014ff9700 1 -- 172.21.15.154:0/675476485 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f900c028080 con 0x7f9018133900 2023-09-30T22:23:18.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.712+0000 7ff052ff6700 1 Processor -- start 2023-09-30T22:23:18.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.712+0000 7ff052ff6700 1 -- start start 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.712+0000 7ff052ff6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c09e870 0x7ff04c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.712+0000 7ff052ff6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09f180 0x7ff04c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.712+0000 7ff052ff6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff04c131d70 0x7ff04c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.712+0000 7ff052ff6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c0a0920 con 0x7ff04c131d70 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.712+0000 7ff052ff6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c09c970 con 0x7ff04c09f180 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.712+0000 7ff052ff6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c09bab0 con 0x7ff04c09e870 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff04bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09f180 0x7ff04c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff050d92700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c09e870 0x7ff04c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff04bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09f180 0x7ff04c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39706/0 (socket says 172.21.15.154:39706) 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff04bfff700 1 -- 172.21.15.154:0/1662376559 learned_addr learned my addr 172.21.15.154:0/1662376559 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff051593700 1 --2- 172.21.15.154:0/1662376559 >> v2:172.21.15.154:3300/0 conn(0x7ff04c131d70 0x7ff04c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff050d92700 1 -- 172.21.15.154:0/1662376559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09f180 msgr2=0x7ff04c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:18.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff050d92700 1 --2- 172.21.15.154:0/1662376559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09f180 0x7ff04c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff050d92700 1 -- 172.21.15.154:0/1662376559 >> v2:172.21.15.154:3300/0 conn(0x7ff04c131d70 msgr2=0x7ff04c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:18.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff050d92700 1 --2- 172.21.15.154:0/1662376559 >> v2:172.21.15.154:3300/0 conn(0x7ff04c131d70 0x7ff04c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff050d92700 1 -- 172.21.15.154:0/1662376559 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c09f9c0 con 0x7ff04c09e870 2023-09-30T22:23:18.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff051593700 1 --2- 172.21.15.154:0/1662376559 >> v2:172.21.15.154:3300/0 conn(0x7ff04c131d70 0x7ff04c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff050d92700 1 --2- 172.21.15.154:0/1662376559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c09e870 0x7ff04c09ec40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff040009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=133d211bd79d3b7b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff04b7fe700 1 -- 172.21.15.154:0/1662376559 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040011830 con 0x7ff04c09e870 2023-09-30T22:23:18.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff04b7fe700 1 -- 172.21.15.154:0/1662376559 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040011990 con 0x7ff04c09e870 2023-09-30T22:23:18.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.713+0000 7ff04b7fe700 1 -- 172.21.15.154:0/1662376559 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040011d20 con 0x7ff04c09e870 2023-09-30T22:23:18.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.714+0000 7ff052ff6700 1 -- 172.21.15.154:0/1662376559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c09e870 msgr2=0x7ff04c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.714+0000 7ff052ff6700 1 --2- 172.21.15.154:0/1662376559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c09e870 0x7ff04c09ec40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff040009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:18.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.714+0000 7ff052ff6700 1 -- 172.21.15.154:0/1662376559 shutdown_connections 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.714+0000 7ff052ff6700 1 --2- 172.21.15.154:0/1662376559 >> v2:172.21.15.154:3300/0 conn(0x7ff04c131d70 0x7ff04c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.714+0000 7ff052ff6700 1 --2- 172.21.15.154:0/1662376559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c09e870 0x7ff04c09ec40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.714+0000 7ff052ff6700 1 --2- 172.21.15.154:0/1662376559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09f180 0x7ff04c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.714+0000 7ff052ff6700 1 -- 172.21.15.154:0/1662376559 >> 172.21.15.154:0/1662376559 conn(0x7ff04c0a4430 msgr2=0x7ff04c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.714+0000 7ff052ff6700 1 -- 172.21.15.154:0/1662376559 shutdown_connections 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.714+0000 7ff052ff6700 1 -- 172.21.15.154:0/1662376559 wait complete. 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.715+0000 7ff052ff6700 1 Processor -- start 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.715+0000 7ff052ff6700 1 -- start start 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff052ff6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09e870 0x7ff04c11aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff052ff6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04c09f180 0x7ff04c11b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff052ff6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c131d70 0x7ff04c11b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff052ff6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c11f3a0 con 0x7ff04c09f180 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff052ff6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c11cad0 con 0x7ff04c09e870 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff052ff6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c11d0f0 con 0x7ff04c131d70 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff050d92700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09e870 0x7ff04c11aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff050d92700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09e870 0x7ff04c11aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39720/0 (socket says 172.21.15.154:39720) 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff050d92700 1 -- 172.21.15.154:0/4115893891 learned_addr learned my addr 172.21.15.154:0/4115893891 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff04bfff700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04c09f180 0x7ff04c11b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff051593700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c131d70 0x7ff04c11b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff050d92700 1 -- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c131d70 msgr2=0x7ff04c11b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff050d92700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c131d70 0x7ff04c11b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff050d92700 1 -- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04c09f180 msgr2=0x7ff04c11b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff050d92700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04c09f180 0x7ff04c11b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff050d92700 1 -- 172.21.15.154:0/4115893891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff044009a70 con 0x7ff04c09e870 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff04bfff700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04c09f180 0x7ff04c11b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.716+0000 7ff050d92700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09e870 0x7ff04c11aec0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff040000c00 tx=0x7ff040004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.717+0000 7ff0497fa700 1 -- 172.21.15.154:0/4115893891 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040004450 con 0x7ff04c09e870 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.717+0000 7ff0497fa700 1 -- 172.21.15.154:0/4115893891 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04001f070 con 0x7ff04c09e870 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.717+0000 7ff052ff6700 1 -- 172.21.15.154:0/4115893891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0400094a0 con 0x7ff04c09e870 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.717+0000 7ff0497fa700 1 -- 172.21.15.154:0/4115893891 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400038c0 con 0x7ff04c09e870 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.717+0000 7ff052ff6700 1 -- 172.21.15.154:0/4115893891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c0a2b60 con 0x7ff04c09e870 2023-09-30T22:23:18.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.718+0000 7ff052ff6700 1 -- 172.21.15.154:0/4115893891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c04f2a0 con 0x7ff04c09e870 2023-09-30T22:23:18.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.718+0000 7ff0497fa700 1 -- 172.21.15.154:0/4115893891 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff040003a20 con 0x7ff04c09e870 2023-09-30T22:23:18.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.718+0000 7ff0497fa700 1 -- 172.21.15.154:0/4115893891 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff040021070 con 0x7ff04c09e870 2023-09-30T22:23:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.727+0000 7ff0497fa700 1 -- 172.21.15.154:0/4115893891 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0400045b0 con 0x7ff04c09e870 2023-09-30T22:23:18.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.754+0000 7f7816c63700 1 Processor -- start 2023-09-30T22:23:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.754+0000 7f7816c63700 1 -- start start 2023-09-30T22:23:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7816c63700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78100a0a70 0x7f78100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7816c63700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7810134120 0x7f781013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7816c63700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781009dc00 con 0x7f78100a1380 2023-09-30T22:23:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7816c63700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781009ea90 con 0x7f78100a0a70 2023-09-30T22:23:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7816c63700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f781009dec0 con 0x7f7810134120 2023-09-30T22:23:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f78149ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78100a0a70 0x7f78100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f78149ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78100a0a70 0x7f78100a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46764/0 (socket says 172.21.15.154:46764) 2023-09-30T22:23:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f78149ff700 1 -- 172.21.15.154:0/2942362332 learned_addr learned my addr 172.21.15.154:0/2942362332 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:18.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7815200700 1 --2- 172.21.15.154:0/2942362332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7810134120 0x7f781013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7815200700 1 -- 172.21.15.154:0/2942362332 >> v2:172.21.15.154:3300/0 conn(0x7f78100a0a70 msgr2=0x7f78100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:18.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7815200700 1 --2- 172.21.15.154:0/2942362332 >> v2:172.21.15.154:3300/0 conn(0x7f78100a0a70 0x7f78100a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7815200700 1 -- 172.21.15.154:0/2942362332 >> v1:172.21.15.154:6789/0 conn(0x7f78100a1380 legacy=0x7f7810133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f7815200700 1 -- 172.21.15.154:0/2942362332 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781009e6a0 con 0x7f7810134120 2023-09-30T22:23:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.755+0000 7f78149ff700 1 --2- 172.21.15.154:0/2942362332 >> v2:172.21.15.154:3300/0 conn(0x7f78100a0a70 0x7f78100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.756+0000 7f7815200700 1 --2- 172.21.15.154:0/2942362332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7810134120 0x7f781013bce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7808009d90 tx=0x7f780800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc28abc273af02b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.756+0000 7f780f7fe700 1 -- 172.21.15.154:0/2942362332 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800e070 con 0x7f7810134120 2023-09-30T22:23:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.756+0000 7f780f7fe700 1 -- 172.21.15.154:0/2942362332 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800bb20 con 0x7f7810134120 2023-09-30T22:23:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.756+0000 7f780f7fe700 1 -- 172.21.15.154:0/2942362332 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808012430 con 0x7f7810134120 2023-09-30T22:23:18.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.756+0000 7f7816c63700 1 -- 172.21.15.154:0/2942362332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7810134120 msgr2=0x7f781013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.756+0000 7f7816c63700 1 --2- 172.21.15.154:0/2942362332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7810134120 0x7f781013bce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7808009d90 tx=0x7f780800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:18.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.757+0000 7f7816c63700 1 -- 172.21.15.154:0/2942362332 shutdown_connections 2023-09-30T22:23:18.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.757+0000 7f7816c63700 1 --2- 172.21.15.154:0/2942362332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7810134120 0x7f781013bce0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.757+0000 7f7816c63700 1 --2- 172.21.15.154:0/2942362332 >> v2:172.21.15.154:3300/0 conn(0x7f78100a0a70 0x7f78100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.757+0000 7f7816c63700 1 -- 172.21.15.154:0/2942362332 >> 172.21.15.154:0/2942362332 conn(0x7f78100a6610 msgr2=0x7f78100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.757+0000 7f7816c63700 1 -- 172.21.15.154:0/2942362332 shutdown_connections 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.757+0000 7f7816c63700 1 -- 172.21.15.154:0/2942362332 wait complete. 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.757+0000 7f7816c63700 1 Processor -- start 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f7816c63700 1 -- start start 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f7816c63700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78100a0a70 0x7f7810122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f7816c63700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78100a1380 0x7f7810122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f7816c63700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7810134120 0x7f7810123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f7816c63700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810133850 con 0x7f78100a0a70 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f7816c63700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7810133a80 con 0x7f7810134120 2023-09-30T22:23:18.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f7816c63700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78101260d0 con 0x7f78100a1380 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f78149ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78100a0a70 0x7f7810122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f780ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78100a1380 0x7f7810122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f78149ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78100a0a70 0x7f7810122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46768/0 (socket says 172.21.15.154:46768) 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f78149ff700 1 -- 172.21.15.154:0/2630298673 learned_addr learned my addr 172.21.15.154:0/2630298673 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.758+0000 7f7815200700 1 --2- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7810134120 0x7f7810123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f780ffff700 1 -- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7810134120 msgr2=0x7f7810123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f780ffff700 1 --2- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7810134120 0x7f7810123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f780ffff700 1 -- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78100a0a70 msgr2=0x7f7810122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f780ffff700 1 --2- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78100a0a70 0x7f7810122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f780ffff700 1 -- 172.21.15.154:0/2630298673 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804009550 con 0x7f78100a1380 2023-09-30T22:23:18.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f78149ff700 1 --2- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78100a0a70 0x7f7810122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f780ffff700 1 --2- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78100a1380 0x7f7810122e50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77fc000f60 tx=0x7f77fc00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f780d7fa700 1 -- 172.21.15.154:0/2630298673 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0052d0 con 0x7f78100a1380 2023-09-30T22:23:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f780d7fa700 1 -- 172.21.15.154:0/2630298673 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc005430 con 0x7f78100a1380 2023-09-30T22:23:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f780d7fa700 1 -- 172.21.15.154:0/2630298673 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0038a0 con 0x7f78100a1380 2023-09-30T22:23:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f7816c63700 1 -- 172.21.15.154:0/2630298673 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7808009a70 con 0x7f78100a1380 2023-09-30T22:23:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.759+0000 7f7816c63700 1 -- 172.21.15.154:0/2630298673 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7810125e10 con 0x7f78100a1380 2023-09-30T22:23:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.760+0000 7f780d7fa700 1 -- 172.21.15.154:0/2630298673 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77fc003a00 con 0x7f78100a1380 2023-09-30T22:23:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.760+0000 7f780d7fa700 1 -- 172.21.15.154:0/2630298673 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f77fc03e970 con 0x7f78100a1380 2023-09-30T22:23:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.760+0000 7f7816c63700 1 -- 172.21.15.154:0/2630298673 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781004f2a0 con 0x7f78100a1380 2023-09-30T22:23:18.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.765+0000 7f780d7fa700 1 -- 172.21.15.154:0/2630298673 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77fc019d20 con 0x7f78100a1380 2023-09-30T22:23:18.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.857+0000 7f901e94b700 1 -- 172.21.15.154:0/675476485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f901811a590 con 0x7f9018133900 2023-09-30T22:23:18.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.857+0000 7f9014ff9700 1 -- 172.21.15.154:0/675476485 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f900c015020 con 0x7f9018133900 2023-09-30T22:23:18.858 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:18.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.860+0000 7f901e94b700 1 -- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9018133900 msgr2=0x7f901811dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.860+0000 7f901e94b700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9018133900 0x7f901811dc40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f900c016000 tx=0x7f900c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:18.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.860+0000 7f901e94b700 1 -- 172.21.15.154:0/675476485 shutdown_connections 2023-09-30T22:23:18.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.860+0000 7f901e94b700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9018134210 0x7f901811e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.860+0000 7f901e94b700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90180a0ee0 0x7f901811d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.860+0000 7f901e94b700 1 --2- 172.21.15.154:0/675476485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9018133900 0x7f901811dc40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.860+0000 7f901e94b700 1 -- 172.21.15.154:0/675476485 >> 172.21.15.154:0/675476485 conn(0x7f90180a2980 msgr2=0x7f90181baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:18.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.860+0000 7f901e94b700 1 -- 172.21.15.154:0/675476485 shutdown_connections 2023-09-30T22:23:18.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.860+0000 7f901e94b700 1 -- 172.21.15.154:0/675476485 wait complete. 2023-09-30T22:23:18.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.920+0000 7ff052ff6700 1 -- 172.21.15.154:0/4115893891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff04c09f660 con 0x7ff04c09e870 2023-09-30T22:23:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.920+0000 7ff0497fa700 1 -- 172.21.15.154:0/4115893891 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff040034090 con 0x7ff04c09e870 2023-09-30T22:23:18.922 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:18.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.923+0000 7ff052ff6700 1 -- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09e870 msgr2=0x7ff04c11aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.923+0000 7ff052ff6700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09e870 0x7ff04c11aec0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff040000c00 tx=0x7ff040004750 comp rx=0 tx=0).stop 2023-09-30T22:23:18.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.923+0000 7ff052ff6700 1 -- 172.21.15.154:0/4115893891 shutdown_connections 2023-09-30T22:23:18.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.923+0000 7ff052ff6700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04c131d70 0x7ff04c11b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.923+0000 7ff052ff6700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff04c09e870 0x7ff04c11aec0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.923+0000 7ff052ff6700 1 --2- 172.21.15.154:0/4115893891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04c09f180 0x7ff04c11b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.923+0000 7ff052ff6700 1 -- 172.21.15.154:0/4115893891 >> 172.21.15.154:0/4115893891 conn(0x7ff04c0a4430 msgr2=0x7ff04c130000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:18.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.923+0000 7ff052ff6700 1 -- 172.21.15.154:0/4115893891 shutdown_connections 2023-09-30T22:23:18.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.923+0000 7ff052ff6700 1 -- 172.21.15.154:0/4115893891 wait complete. 2023-09-30T22:23:18.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:18.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.958+0000 7f7816c63700 1 -- 172.21.15.154:0/2630298673 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7810126ba0 con 0x7f78100a1380 2023-09-30T22:23:18.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.959+0000 7f780d7fa700 1 -- 172.21.15.154:0/2630298673 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77fc017020 con 0x7f78100a1380 2023-09-30T22:23:18.960 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:18.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.961+0000 7f7816c63700 1 -- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78100a1380 msgr2=0x7f7810122e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:18.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.961+0000 7f7816c63700 1 --2- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78100a1380 0x7f7810122e50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77fc000f60 tx=0x7f77fc00c730 comp rx=0 tx=0).stop 2023-09-30T22:23:18.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.961+0000 7f7816c63700 1 -- 172.21.15.154:0/2630298673 shutdown_connections 2023-09-30T22:23:18.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.961+0000 7f7816c63700 1 --2- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7810134120 0x7f7810123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.961+0000 7f7816c63700 1 --2- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78100a0a70 0x7f7810122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.961+0000 7f7816c63700 1 --2- 172.21.15.154:0/2630298673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78100a1380 0x7f7810122e50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:18.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.961+0000 7f7816c63700 1 -- 172.21.15.154:0/2630298673 >> 172.21.15.154:0/2630298673 conn(0x7f78100a6610 msgr2=0x7f781009ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:18.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.961+0000 7f7816c63700 1 -- 172.21.15.154:0/2630298673 shutdown_connections 2023-09-30T22:23:18.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:18.961+0000 7f7816c63700 1 -- 172.21.15.154:0/2630298673 wait complete. 2023-09-30T22:23:18.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:19.631 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:19.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.756+0000 7fa570bdd700 1 Processor -- start 2023-09-30T22:23:19.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.756+0000 7fa570bdd700 1 -- start start 2023-09-30T22:23:19.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa570bdd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c133ad0 0x7fa56c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa570bdd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa56c1300a0 0x7fa56c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa570bdd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c1309f0 0x7fa56c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa570bdd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c06b2d0 con 0x7fa56c1300a0 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa570bdd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c133610 con 0x7fa56c133ad0 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa570bdd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c09a500 con 0x7fa56c1309f0 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa569d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa56c1300a0 0x7fa56c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa56a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c133ad0 0x7fa56c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa56ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c1309f0 0x7fa56c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa569d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa56c1300a0 0x7fa56c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46784/0 (socket says 172.21.15.154:46784) 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa569d9b700 1 -- 172.21.15.154:0/770890618 learned_addr learned my addr 172.21.15.154:0/770890618 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa56a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c133ad0 0x7fa56c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39732/0 (socket says 172.21.15.154:39732) 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa56ad9d700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c1309f0 0x7fa56c13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34694/0 (socket says 172.21.15.154:34694) 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa569d9b700 1 -- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c1309f0 msgr2=0x7fa56c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa569d9b700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c1309f0 0x7fa56c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa569d9b700 1 -- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c133ad0 msgr2=0x7fa56c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa569d9b700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c133ad0 0x7fa56c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa569d9b700 1 -- 172.21.15.154:0/770890618 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c1338b0 con 0x7fa56c1300a0 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa56a59c700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c133ad0 0x7fa56c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.757+0000 7fa56ad9d700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c1309f0 0x7fa56c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa569d9b700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 0x7fa56c1304b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0098f0 tx=0x7fa55c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7460e8fd3b6aecf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa56959a700 1 -- 172.21.15.154:0/770890618 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c011830 con 0x7fa56c1300a0 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa56959a700 1 -- 172.21.15.154:0/770890618 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c011990 con 0x7fa56c1300a0 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa56959a700 1 -- 172.21.15.154:0/770890618 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c011d20 con 0x7fa56c1300a0 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa570bdd700 1 -- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 msgr2=0x7fa56c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa570bdd700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 0x7fa56c1304b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0098f0 tx=0x7fa55c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa570bdd700 1 -- 172.21.15.154:0/770890618 shutdown_connections 2023-09-30T22:23:19.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa570bdd700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c133ad0 0x7fa56c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa570bdd700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c1309f0 0x7fa56c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa570bdd700 1 --2- 172.21.15.154:0/770890618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 0x7fa56c1304b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa570bdd700 1 -- 172.21.15.154:0/770890618 >> 172.21.15.154:0/770890618 conn(0x7fa56c099c40 msgr2=0x7fa56c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:19.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa570bdd700 1 -- 172.21.15.154:0/770890618 shutdown_connections 2023-09-30T22:23:19.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.758+0000 7fa570bdd700 1 -- 172.21.15.154:0/770890618 wait complete. 2023-09-30T22:23:19.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.759+0000 7fa570bdd700 1 Processor -- start 2023-09-30T22:23:19.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.759+0000 7fa570bdd700 1 -- start start 2023-09-30T22:23:19.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa570bdd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 0x7fa56c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa570bdd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c1309f0 0x7fa56c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa570bdd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c133ad0 0x7fa56c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa570bdd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c120950 con 0x7fa56c1300a0 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa570bdd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c072110 con 0x7fa56c1309f0 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa570bdd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0a33e0 con 0x7fa56c133ad0 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa569d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c1309f0 0x7fa56c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa569d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c1309f0 0x7fa56c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39748/0 (socket says 172.21.15.154:39748) 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa569d9b700 1 -- 172.21.15.154:0/600882329 learned_addr learned my addr 172.21.15.154:0/600882329 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa56a59c700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 0x7fa56c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa56ad9d700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c133ad0 0x7fa56c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa569d9b700 1 -- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c133ad0 msgr2=0x7fa56c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa569d9b700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c133ad0 0x7fa56c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa569d9b700 1 -- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 msgr2=0x7fa56c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa569d9b700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 0x7fa56c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa569d9b700 1 -- 172.21.15.154:0/600882329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564009a70 con 0x7fa56c1309f0 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa56a59c700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 0x7fa56c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.760+0000 7fa569d9b700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c1309f0 0x7fa56c11df80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa55c000c00 tx=0x7fa55c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.761+0000 7fa55affd700 1 -- 172.21.15.154:0/600882329 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c004450 con 0x7fa56c1309f0 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.761+0000 7fa55affd700 1 -- 172.21.15.154:0/600882329 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c0045b0 con 0x7fa56c1309f0 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.761+0000 7fa570bdd700 1 -- 172.21.15.154:0/600882329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5600094a0 con 0x7fa56c1309f0 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.761+0000 7fa55affd700 1 -- 172.21.15.154:0/600882329 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0038c0 con 0x7fa56c1309f0 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.761+0000 7fa570bdd700 1 -- 172.21.15.154:0/600882329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c009550 con 0x7fa56c1309f0 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.761+0000 7fa55affd700 1 -- 172.21.15.154:0/600882329 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa55c021070 con 0x7fa56c1309f0 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.762+0000 7fa55affd700 1 -- 172.21.15.154:0/600882329 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa55c040840 con 0x7fa56c1309f0 2023-09-30T22:23:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.762+0000 7fa570bdd700 1 -- 172.21.15.154:0/600882329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c04f2a0 con 0x7fa56c1309f0 2023-09-30T22:23:19.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.766+0000 7fa55affd700 1 -- 172.21.15.154:0/600882329 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa55c015020 con 0x7fa56c1309f0 2023-09-30T22:23:19.874 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:19.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:19.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.957+0000 7fa570bdd700 1 -- 172.21.15.154:0/600882329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa56c06c3b0 con 0x7fa56c1309f0 2023-09-30T22:23:19.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.958+0000 7fa55affd700 1 -- 172.21.15.154:0/600882329 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa55c003a20 con 0x7fa56c1309f0 2023-09-30T22:23:19.959 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.961+0000 7fa570bdd700 1 -- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c1309f0 msgr2=0x7fa56c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.961+0000 7fa570bdd700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c1309f0 0x7fa56c11df80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa55c000c00 tx=0x7fa55c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.961+0000 7fa570bdd700 1 -- 172.21.15.154:0/600882329 shutdown_connections 2023-09-30T22:23:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.961+0000 7fa570bdd700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa56c133ad0 0x7fa56c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.961+0000 7fa570bdd700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa56c1300a0 0x7fa56c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.961+0000 7fa570bdd700 1 --2- 172.21.15.154:0/600882329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa56c1309f0 0x7fa56c11df80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.961+0000 7fa570bdd700 1 -- 172.21.15.154:0/600882329 >> 172.21.15.154:0/600882329 conn(0x7fa56c099c40 msgr2=0x7fa56c12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.961+0000 7fa570bdd700 1 -- 172.21.15.154:0/600882329 shutdown_connections 2023-09-30T22:23:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:19.961+0000 7fa570bdd700 1 -- 172.21.15.154:0/600882329 wait complete. 2023-09-30T22:23:19.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:19.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:20.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc0a20e8700 1 Processor -- start 2023-09-30T22:23:20.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc0a20e8700 1 -- start start 2023-09-30T22:23:20.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc0a20e8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c133b80 0x7fc09c133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc0a20e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c0a0ff0 0x7fc09c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc0a20e8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c09aa00 con 0x7fc09c099a60 2023-09-30T22:23:20.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc0a20e8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c09a080 con 0x7fc09c0a0ff0 2023-09-30T22:23:20.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc0a20e8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c133750 con 0x7fc09c133b80 2023-09-30T22:23:20.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc09affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc09c099a60 0x7fc09c0a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39848/0 (socket says 172.21.15.154:39848) 2023-09-30T22:23:20.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc09bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c0a0ff0 0x7fc09c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc09affd700 1 -- 172.21.15.154:0/3227376785 learned_addr learned my addr 172.21.15.154:0/3227376785 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.011+0000 7fc09b7fe700 1 --2- 172.21.15.154:0/3227376785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c133b80 0x7fc09c133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.012+0000 7fc09bfff700 1 -- 172.21.15.154:0/3227376785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c133b80 msgr2=0x7fc09c133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.012+0000 7fc09bfff700 1 --2- 172.21.15.154:0/3227376785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c133b80 0x7fc09c133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.012+0000 7fc09bfff700 1 -- 172.21.15.154:0/3227376785 >> v1:172.21.15.154:6789/0 conn(0x7fc09c099a60 legacy=0x7fc09c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.012+0000 7fc09bfff700 1 -- 172.21.15.154:0/3227376785 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c09a760 con 0x7fc09c0a0ff0 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.012+0000 7fc09bfff700 1 --2- 172.21.15.154:0/3227376785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c0a0ff0 0x7fc09c13b910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc094009dc0 tx=0x7fc09400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c80c631c2a65659 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.012+0000 7fc09a7fc700 1 -- 172.21.15.154:0/3227376785 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400e070 con 0x7fc09c0a0ff0 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.012+0000 7fc09a7fc700 1 -- 172.21.15.154:0/3227376785 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09400bb20 con 0x7fc09c0a0ff0 2023-09-30T22:23:20.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.012+0000 7fc09a7fc700 1 -- 172.21.15.154:0/3227376785 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094012430 con 0x7fc09c0a0ff0 2023-09-30T22:23:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.013+0000 7fc0a20e8700 1 -- 172.21.15.154:0/3227376785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c0a0ff0 msgr2=0x7fc09c13b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.013+0000 7fc0a20e8700 1 --2- 172.21.15.154:0/3227376785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c0a0ff0 0x7fc09c13b910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc094009dc0 tx=0x7fc09400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.013+0000 7fc0a20e8700 1 -- 172.21.15.154:0/3227376785 shutdown_connections 2023-09-30T22:23:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.013+0000 7fc0a20e8700 1 --2- 172.21.15.154:0/3227376785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c0a0ff0 0x7fc09c13b910 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.013+0000 7fc0a20e8700 1 --2- 172.21.15.154:0/3227376785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c133b80 0x7fc09c133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.013+0000 7fc0a20e8700 1 -- 172.21.15.154:0/3227376785 >> 172.21.15.154:0/3227376785 conn(0x7fc09c0a2980 msgr2=0x7fc09c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.013+0000 7fc0a20e8700 1 -- 172.21.15.154:0/3227376785 shutdown_connections 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.013+0000 7fc0a20e8700 1 -- 172.21.15.154:0/3227376785 wait complete. 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc0a20e8700 1 Processor -- start 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc0a20e8700 1 -- start start 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc0a20e8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c099a60 0x7fc09c11b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc0a20e8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc09c0a0ff0 0x7fc09c11bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc0a20e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c133b80 0x7fc09c11c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc0a20e8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c11d3e0 con 0x7fc09c0a0ff0 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc0a20e8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c11da00 con 0x7fc09c133b80 2023-09-30T22:23:20.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc0a20e8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c11e630 con 0x7fc09c099a60 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc09b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c099a60 0x7fc09c11b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc09b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c099a60 0x7fc09c11b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34740/0 (socket says 172.21.15.154:34740) 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc09b7fe700 1 -- 172.21.15.154:0/2650674950 learned_addr learned my addr 172.21.15.154:0/2650674950 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.014+0000 7fc09affd700 1 --2- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc09c0a0ff0 0x7fc09c11bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc09bfff700 1 --2- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c133b80 0x7fc09c11c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc09b7fe700 1 -- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c133b80 msgr2=0x7fc09c11c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc09b7fe700 1 --2- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c133b80 0x7fc09c11c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc09b7fe700 1 -- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc09c0a0ff0 msgr2=0x7fc09c11bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc09b7fe700 1 --2- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc09c0a0ff0 0x7fc09c11bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc09b7fe700 1 -- 172.21.15.154:0/2650674950 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094009a70 con 0x7fc09c099a60 2023-09-30T22:23:20.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc09b7fe700 1 --2- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c099a60 0x7fc09c11b7d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00e990 tx=0x7fc08c00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc083fff700 1 -- 172.21.15.154:0/2650674950 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0096f0 con 0x7fc09c099a60 2023-09-30T22:23:20.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc083fff700 1 -- 172.21.15.154:0/2650674950 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00c690 con 0x7fc09c099a60 2023-09-30T22:23:20.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc0a20e8700 1 -- 172.21.15.154:0/2650674950 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c11f010 con 0x7fc09c099a60 2023-09-30T22:23:20.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc083fff700 1 -- 172.21.15.154:0/2650674950 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00ca00 con 0x7fc09c099a60 2023-09-30T22:23:20.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.015+0000 7fc0a20e8700 1 -- 172.21.15.154:0/2650674950 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c09a2c0 con 0x7fc09c099a60 2023-09-30T22:23:20.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.016+0000 7fc083fff700 1 -- 172.21.15.154:0/2650674950 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc08c00cb60 con 0x7fc09c099a60 2023-09-30T22:23:20.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.016+0000 7fc0a20e8700 1 -- 172.21.15.154:0/2650674950 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c04f2a0 con 0x7fc09c099a60 2023-09-30T22:23:20.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.016+0000 7fc083fff700 1 -- 172.21.15.154:0/2650674950 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc08c03fa70 con 0x7fc09c099a60 2023-09-30T22:23:20.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.021+0000 7fc083fff700 1 -- 172.21.15.154:0/2650674950 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc08c017070 con 0x7fc09c099a60 2023-09-30T22:23:20.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.070+0000 7f5a92edc700 1 Processor -- start 2023-09-30T22:23:20.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.070+0000 7f5a92edc700 1 -- start start 2023-09-30T22:23:20.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a92edc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c06a770 0x7f5a8c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a92edc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c1317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a92edc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a8c131cf0 0x7f5a8c132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a92edc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c09f770 con 0x7f5a8c131cf0 2023-09-30T22:23:20.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a92edc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c09dce0 con 0x7f5a8c06a770 2023-09-30T22:23:20.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a92edc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c09da80 con 0x7f5a8c06b080 2023-09-30T22:23:20.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c1317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a8bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c1317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34742/0 (socket says 172.21.15.154:34742) 2023-09-30T22:23:20.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a8bfff700 1 -- 172.21.15.154:0/3042781271 learned_addr learned my addr 172.21.15.154:0/3042781271 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:20.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a91479700 1 --2- 172.21.15.154:0/3042781271 >> v2:172.21.15.154:3300/0 conn(0x7f5a8c131cf0 0x7f5a8c132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a90c78700 1 --2- 172.21.15.154:0/3042781271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c06a770 0x7f5a8c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a8bfff700 1 -- 172.21.15.154:0/3042781271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c06a770 msgr2=0x7f5a8c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a8bfff700 1 --2- 172.21.15.154:0/3042781271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c06a770 0x7f5a8c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a8bfff700 1 -- 172.21.15.154:0/3042781271 >> v2:172.21.15.154:3300/0 conn(0x7f5a8c131cf0 msgr2=0x7f5a8c132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a8bfff700 1 --2- 172.21.15.154:0/3042781271 >> v2:172.21.15.154:3300/0 conn(0x7f5a8c131cf0 0x7f5a8c132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a8bfff700 1 -- 172.21.15.154:0/3042781271 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c09eb20 con 0x7f5a8c06b080 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.071+0000 7f5a91479700 1 --2- 172.21.15.154:0/3042781271 >> v2:172.21.15.154:3300/0 conn(0x7f5a8c131cf0 0x7f5a8c132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a8bfff700 1 --2- 172.21.15.154:0/3042781271 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c1317b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009920 tx=0x7f5a78009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e57e198cdd8a05a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a8b7fe700 1 -- 172.21.15.154:0/3042781271 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78011830 con 0x7f5a8c06b080 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a8b7fe700 1 -- 172.21.15.154:0/3042781271 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a78011990 con 0x7f5a8c06b080 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a8b7fe700 1 -- 172.21.15.154:0/3042781271 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78011d20 con 0x7f5a8c06b080 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a92edc700 1 -- 172.21.15.154:0/3042781271 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 msgr2=0x7f5a8c1317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a92edc700 1 --2- 172.21.15.154:0/3042781271 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c1317b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009920 tx=0x7f5a78009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a92edc700 1 -- 172.21.15.154:0/3042781271 shutdown_connections 2023-09-30T22:23:20.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a92edc700 1 --2- 172.21.15.154:0/3042781271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c06a770 0x7f5a8c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a92edc700 1 --2- 172.21.15.154:0/3042781271 >> v2:172.21.15.154:3300/0 conn(0x7f5a8c131cf0 0x7f5a8c132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a92edc700 1 --2- 172.21.15.154:0/3042781271 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c1317b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.072+0000 7f5a92edc700 1 -- 172.21.15.154:0/3042781271 >> 172.21.15.154:0/3042781271 conn(0x7f5a8c099c40 msgr2=0x7f5a8c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.073+0000 7f5a92edc700 1 -- 172.21.15.154:0/3042781271 shutdown_connections 2023-09-30T22:23:20.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.073+0000 7f5a92edc700 1 -- 172.21.15.154:0/3042781271 wait complete. 2023-09-30T22:23:20.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.074+0000 7f5a92edc700 1 Processor -- start 2023-09-30T22:23:20.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.074+0000 7f5a92edc700 1 -- start start 2023-09-30T22:23:20.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a92edc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a8c06a770 0x7f5a8c11d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a92edc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c11d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a92edc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c131cf0 0x7f5a8c1c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a92edc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1313a0 con 0x7f5a8c06a770 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a92edc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c11cef0 con 0x7f5a8c131cf0 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a92edc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c11de60 con 0x7f5a8c06b080 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a91479700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c131cf0 0x7f5a8c1c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a91479700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c131cf0 0x7f5a8c1c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39776/0 (socket says 172.21.15.154:39776) 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a91479700 1 -- 172.21.15.154:0/2430429808 learned_addr learned my addr 172.21.15.154:0/2430429808 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a90c78700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a8c06a770 0x7f5a8c11d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a8bfff700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c11d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a8bfff700 1 -- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c131cf0 msgr2=0x7f5a8c1c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a8bfff700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c131cf0 0x7f5a8c1c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a8bfff700 1 -- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a8c06a770 msgr2=0x7f5a8c11d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a8bfff700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a8c06a770 0x7f5a8c11d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a8bfff700 1 -- 172.21.15.154:0/2430429808 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a84009a70 con 0x7f5a8c06b080 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a91479700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c131cf0 0x7f5a8c1c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a90c78700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a8c06a770 0x7f5a8c11d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a8bfff700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c11d920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5a78016000 tx=0x7f5a78004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a897fa700 1 -- 172.21.15.154:0/2430429808 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78004450 con 0x7f5a8c06b080 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a897fa700 1 -- 172.21.15.154:0/2430429808 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7801f070 con 0x7f5a8c06b080 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a897fa700 1 -- 172.21.15.154:0/2430429808 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a780038e0 con 0x7f5a8c06b080 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.075+0000 7f5a92edc700 1 -- 172.21.15.154:0/2430429808 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a78009550 con 0x7f5a8c06b080 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.076+0000 7f5a92edc700 1 -- 172.21.15.154:0/2430429808 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c11ebd0 con 0x7f5a8c06b080 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.077+0000 7f5a92edc700 1 -- 172.21.15.154:0/2430429808 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c120090 con 0x7f5a8c06b080 2023-09-30T22:23:20.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.077+0000 7f5a897fa700 1 -- 172.21.15.154:0/2430429808 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a78003a40 con 0x7f5a8c06b080 2023-09-30T22:23:20.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.077+0000 7f5a897fa700 1 -- 172.21.15.154:0/2430429808 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a78021070 con 0x7f5a8c06b080 2023-09-30T22:23:20.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.086+0000 7f5a897fa700 1 -- 172.21.15.154:0/2430429808 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a780045b0 con 0x7f5a8c06b080 2023-09-30T22:23:20.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.106+0000 7f42878d0700 1 Processor -- start 2023-09-30T22:23:20.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f42878d0700 1 -- start start 2023-09-30T22:23:20.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f42878d0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42800a0a70 0x7f42800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f42878d0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4280134120 0x7f428013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f42878d0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428009dc00 con 0x7f42800a1380 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f42878d0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428009ea90 con 0x7f42800a0a70 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f42878d0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f428009dec0 con 0x7f4280134120 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f428566c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42800a0a70 0x7f42800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f4284e6b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f42800a1380 0x7f4280133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39860/0 (socket says 172.21.15.154:39860) 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f4284e6b700 1 -- 172.21.15.154:0/2707224914 learned_addr learned my addr 172.21.15.154:0/2707224914 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f4285e6d700 1 --2- 172.21.15.154:0/2707224914 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4280134120 0x7f428013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f428566c700 1 -- 172.21.15.154:0/2707224914 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4280134120 msgr2=0x7f428013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:20.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f428566c700 1 --2- 172.21.15.154:0/2707224914 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4280134120 0x7f428013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f4277fff700 1 -- 172.21.15.154:0/2707224914 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417156746 0 0) 0x7f428009dc00 con 0x7f42800a1380 2023-09-30T22:23:20.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.107+0000 7f428566c700 1 -- 172.21.15.154:0/2707224914 >> v1:172.21.15.154:6789/0 conn(0x7f42800a1380 legacy=0x7f4280133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.108+0000 7f428566c700 1 -- 172.21.15.154:0/2707224914 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428009e6a0 con 0x7f42800a0a70 2023-09-30T22:23:20.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.108+0000 7f4285e6d700 1 --2- 172.21.15.154:0/2707224914 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4280134120 0x7f428013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:20.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.108+0000 7f428566c700 1 --2- 172.21.15.154:0/2707224914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42800a0a70 0x7f42800a0e40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f427c009870 tx=0x7f427c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b404ca4c7cea6575 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.108+0000 7f4277fff700 1 -- 172.21.15.154:0/2707224914 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c011830 con 0x7f42800a0a70 2023-09-30T22:23:20.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.108+0000 7f4277fff700 1 -- 172.21.15.154:0/2707224914 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c011990 con 0x7f42800a0a70 2023-09-30T22:23:20.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.108+0000 7f4277fff700 1 -- 172.21.15.154:0/2707224914 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c011d20 con 0x7f42800a0a70 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.108+0000 7f42878d0700 1 -- 172.21.15.154:0/2707224914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42800a0a70 msgr2=0x7f42800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.109+0000 7f42878d0700 1 --2- 172.21.15.154:0/2707224914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42800a0a70 0x7f42800a0e40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f427c009870 tx=0x7f427c009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.109+0000 7f42878d0700 1 -- 172.21.15.154:0/2707224914 shutdown_connections 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.109+0000 7f42878d0700 1 --2- 172.21.15.154:0/2707224914 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4280134120 0x7f428013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.109+0000 7f42878d0700 1 --2- 172.21.15.154:0/2707224914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42800a0a70 0x7f42800a0e40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.109+0000 7f42878d0700 1 -- 172.21.15.154:0/2707224914 >> 172.21.15.154:0/2707224914 conn(0x7f42800a6610 msgr2=0x7f42800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.109+0000 7f42878d0700 1 -- 172.21.15.154:0/2707224914 shutdown_connections 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.109+0000 7f42878d0700 1 -- 172.21.15.154:0/2707224914 wait complete. 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f42878d0700 1 Processor -- start 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f42878d0700 1 -- start start 2023-09-30T22:23:20.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f42878d0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42800a0a70 0x7f4280122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f42878d0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f42800a1380 0x7f4280122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f42878d0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4280134120 0x7f42801233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f42878d0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42801270d0 con 0x7f42800a0a70 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f42878d0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800a03e0 con 0x7f4280134120 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f42878d0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4280125eb0 con 0x7f42800a1380 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f4284e6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f42800a1380 0x7f4280122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f4284e6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f42800a1380 0x7f4280122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34762/0 (socket says 172.21.15.154:34762) 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f4284e6b700 1 -- 172.21.15.154:0/1903058090 learned_addr learned my addr 172.21.15.154:0/1903058090 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f4285e6d700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4280134120 0x7f42801233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.110+0000 7f428566c700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42800a0a70 0x7f4280122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:20.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4285e6d700 1 -- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f42800a1380 msgr2=0x7f4280122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4285e6d700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f42800a1380 0x7f4280122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4285e6d700 1 -- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42800a0a70 msgr2=0x7f4280122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4285e6d700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42800a0a70 0x7f4280122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4285e6d700 1 -- 172.21.15.154:0/1903058090 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009a70 con 0x7f4280134120 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4284e6b700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f42800a1380 0x7f4280122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4285e6d700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4280134120 0x7f42801233b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f427800efc0 tx=0x7f427800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4275ffb700 1 -- 172.21.15.154:0/1903058090 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800ca90 con 0x7f4280134120 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4275ffb700 1 -- 172.21.15.154:0/1903058090 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800f040 con 0x7f4280134120 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f42878d0700 1 -- 172.21.15.154:0/1903058090 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c0094a0 con 0x7f4280134120 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f4275ffb700 1 -- 172.21.15.154:0/1903058090 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800ce30 con 0x7f4280134120 2023-09-30T22:23:20.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.111+0000 7f42878d0700 1 -- 172.21.15.154:0/1903058090 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4280126450 con 0x7f4280134120 2023-09-30T22:23:20.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.112+0000 7f4275ffb700 1 -- 172.21.15.154:0/1903058090 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4278014480 con 0x7f4280134120 2023-09-30T22:23:20.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.112+0000 7f42878d0700 1 -- 172.21.15.154:0/1903058090 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428009a020 con 0x7f4280134120 2023-09-30T22:23:20.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.112+0000 7f4275ffb700 1 -- 172.21.15.154:0/1903058090 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f427803fc00 con 0x7f4280134120 2023-09-30T22:23:20.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.117+0000 7f4275ffb700 1 -- 172.21.15.154:0/1903058090 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4278012930 con 0x7f4280134120 2023-09-30T22:23:20.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.223+0000 7fc0a20e8700 1 -- 172.21.15.154:0/2650674950 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc09c06bce0 con 0x7fc09c099a60 2023-09-30T22:23:20.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.223+0000 7fc083fff700 1 -- 172.21.15.154:0/2650674950 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc08c01b3b0 con 0x7fc09c099a60 2023-09-30T22:23:20.225 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:20.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.226+0000 7fc0a20e8700 1 -- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c099a60 msgr2=0x7fc09c11b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.226+0000 7fc0a20e8700 1 --2- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c099a60 0x7fc09c11b7d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00e990 tx=0x7fc08c00eca0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.226+0000 7fc0a20e8700 1 -- 172.21.15.154:0/2650674950 shutdown_connections 2023-09-30T22:23:20.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.226+0000 7fc0a20e8700 1 --2- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc09c133b80 0x7fc09c11c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.226+0000 7fc0a20e8700 1 --2- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc09c099a60 0x7fc09c11b7d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.226+0000 7fc0a20e8700 1 --2- 172.21.15.154:0/2650674950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc09c0a0ff0 0x7fc09c11bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.226+0000 7fc0a20e8700 1 -- 172.21.15.154:0/2650674950 >> 172.21.15.154:0/2650674950 conn(0x7fc09c0a2980 msgr2=0x7fc09c1b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.226+0000 7fc0a20e8700 1 -- 172.21.15.154:0/2650674950 shutdown_connections 2023-09-30T22:23:20.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.226+0000 7fc0a20e8700 1 -- 172.21.15.154:0/2650674950 wait complete. 2023-09-30T22:23:20.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:20.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.283+0000 7f5a92edc700 1 -- 172.21.15.154:0/2430429808 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a8c09f210 con 0x7f5a8c06b080 2023-09-30T22:23:20.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.283+0000 7f5a897fa700 1 -- 172.21.15.154:0/2430429808 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a7802b030 con 0x7f5a8c06b080 2023-09-30T22:23:20.284 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.285+0000 7f5a92edc700 1 -- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 msgr2=0x7f5a8c11d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.285+0000 7f5a92edc700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c11d920 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5a78016000 tx=0x7f5a78004750 comp rx=0 tx=0).stop 2023-09-30T22:23:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.286+0000 7f5a92edc700 1 -- 172.21.15.154:0/2430429808 shutdown_connections 2023-09-30T22:23:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.286+0000 7f5a92edc700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a8c131cf0 0x7f5a8c1c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.286+0000 7f5a92edc700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a8c06a770 0x7f5a8c11d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.286+0000 7f5a92edc700 1 --2- 172.21.15.154:0/2430429808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a8c06b080 0x7f5a8c11d920 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.286+0000 7f5a92edc700 1 -- 172.21.15.154:0/2430429808 >> 172.21.15.154:0/2430429808 conn(0x7f5a8c099c40 msgr2=0x7f5a8c1b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.286+0000 7f5a92edc700 1 -- 172.21.15.154:0/2430429808 shutdown_connections 2023-09-30T22:23:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.286+0000 7f5a92edc700 1 -- 172.21.15.154:0/2430429808 wait complete. 2023-09-30T22:23:20.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:20.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.312+0000 7f42878d0700 1 -- 172.21.15.154:0/1903058090 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4280126080 con 0x7f4280134120 2023-09-30T22:23:20.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.312+0000 7f4275ffb700 1 -- 172.21.15.154:0/1903058090 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4278012340 con 0x7f4280134120 2023-09-30T22:23:20.313 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:20.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.314+0000 7f42878d0700 1 -- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4280134120 msgr2=0x7f42801233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:20.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.314+0000 7f42878d0700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4280134120 0x7f42801233b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f427800efc0 tx=0x7f427800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.315+0000 7f42878d0700 1 -- 172.21.15.154:0/1903058090 shutdown_connections 2023-09-30T22:23:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.315+0000 7f42878d0700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4280134120 0x7f42801233b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.315+0000 7f42878d0700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42800a0a70 0x7f4280122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.315+0000 7f42878d0700 1 --2- 172.21.15.154:0/1903058090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f42800a1380 0x7f4280122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.315+0000 7f42878d0700 1 -- 172.21.15.154:0/1903058090 >> 172.21.15.154:0/1903058090 conn(0x7f42800a6610 msgr2=0x7f42800a5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.315+0000 7f42878d0700 1 -- 172.21.15.154:0/1903058090 shutdown_connections 2023-09-30T22:23:20.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:20.315+0000 7f42878d0700 1 -- 172.21.15.154:0/1903058090 wait complete. 2023-09-30T22:23:20.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:20.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:21.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.111+0000 7f0f6e55b700 1 Processor -- start 2023-09-30T22:23:21.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.111+0000 7f0f6e55b700 1 -- start start 2023-09-30T22:23:21.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.111+0000 7f0f6e55b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f6809f350 0x7f0f68136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.111+0000 7f0f6e55b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f681371c0 0x7f0f681395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.111+0000 7f0f6e55b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6809c970 con 0x7f0f6809e870 2023-09-30T22:23:21.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.111+0000 7f0f6e55b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f680a0920 con 0x7f0f681371c0 2023-09-30T22:23:21.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.111+0000 7f0f6e55b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6809f9c0 con 0x7f0f6809f350 2023-09-30T22:23:21.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.111+0000 7f0f677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f6809f350 0x7f0f68136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.111+0000 7f0f6caf8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f681371c0 0x7f0f681395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f6809f350 0x7f0f68136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34770/0 (socket says 172.21.15.154:34770) 2023-09-30T22:23:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f6caf8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f681371c0 0x7f0f681395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46824/0 (socket says 172.21.15.154:46824) 2023-09-30T22:23:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f677fe700 1 -- 172.21.15.154:0/20753827 learned_addr learned my addr 172.21.15.154:0/20753827 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f677fe700 1 -- 172.21.15.154:0/20753827 >> v2:172.21.15.154:3300/0 conn(0x7f0f681371c0 msgr2=0x7f0f681395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f677fe700 1 --2- 172.21.15.154:0/20753827 >> v2:172.21.15.154:3300/0 conn(0x7f0f681371c0 0x7f0f681395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f677fe700 1 -- 172.21.15.154:0/20753827 >> v1:172.21.15.154:6789/0 conn(0x7f0f6809e870 legacy=0x7f0f6809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f677fe700 1 -- 172.21.15.154:0/20753827 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6809bab0 con 0x7f0f6809f350 2023-09-30T22:23:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f6caf8700 1 --2- 172.21.15.154:0/20753827 >> v2:172.21.15.154:3300/0 conn(0x7f0f681371c0 0x7f0f681395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f677fe700 1 --2- 172.21.15.154:0/20753827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f6809f350 0x7f0f68136c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f580098f0 tx=0x7f0f58009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37dd4293df07b762 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f66ffd700 1 -- 172.21.15.154:0/20753827 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58011830 con 0x7f0f6809f350 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f66ffd700 1 -- 172.21.15.154:0/20753827 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58011990 con 0x7f0f6809f350 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.112+0000 7f0f66ffd700 1 -- 172.21.15.154:0/20753827 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58011d20 con 0x7f0f6809f350 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.113+0000 7f0f6e55b700 1 -- 172.21.15.154:0/20753827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f6809f350 msgr2=0x7f0f68136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.113+0000 7f0f6e55b700 1 --2- 172.21.15.154:0/20753827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f6809f350 0x7f0f68136c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f580098f0 tx=0x7f0f58009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.113+0000 7f0f6e55b700 1 -- 172.21.15.154:0/20753827 shutdown_connections 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.113+0000 7f0f6e55b700 1 --2- 172.21.15.154:0/20753827 >> v2:172.21.15.154:3300/0 conn(0x7f0f681371c0 0x7f0f681395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.113+0000 7f0f6e55b700 1 --2- 172.21.15.154:0/20753827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f6809f350 0x7f0f68136c80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.113+0000 7f0f6e55b700 1 -- 172.21.15.154:0/20753827 >> 172.21.15.154:0/20753827 conn(0x7f0f680a4430 msgr2=0x7f0f680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.113+0000 7f0f6e55b700 1 -- 172.21.15.154:0/20753827 shutdown_connections 2023-09-30T22:23:21.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.113+0000 7f0f6e55b700 1 -- 172.21.15.154:0/20753827 wait complete. 2023-09-30T22:23:21.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6e55b700 1 Processor -- start 2023-09-30T22:23:21.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6e55b700 1 -- start start 2023-09-30T22:23:21.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6e55b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6809e870 0x7f0f681209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6e55b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6809f350 0x7f0f68120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6e55b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f681371c0 0x7f0f68121460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6e55b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68122550 con 0x7f0f6809e870 2023-09-30T22:23:21.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6e55b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68122b70 con 0x7f0f6809f350 2023-09-30T22:23:21.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6e55b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6809dc10 con 0x7f0f681371c0 2023-09-30T22:23:21.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6caf8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f681371c0 0x7f0f68121460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f677fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6809f350 0x7f0f68120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f67fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6809e870 0x7f0f681209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6caf8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f681371c0 0x7f0f68121460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34782/0 (socket says 172.21.15.154:34782) 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.114+0000 7f0f6caf8700 1 -- 172.21.15.154:0/819285756 learned_addr learned my addr 172.21.15.154:0/819285756 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f677fe700 1 -- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f681371c0 msgr2=0x7f0f68121460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f677fe700 1 --2- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f681371c0 0x7f0f68121460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f677fe700 1 -- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6809e870 msgr2=0x7f0f681209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f677fe700 1 --2- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6809e870 0x7f0f681209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f677fe700 1 -- 172.21.15.154:0/819285756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60009a70 con 0x7f0f6809f350 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f6caf8700 1 --2- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f681371c0 0x7f0f68121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f67fff700 1 --2- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6809e870 0x7f0f681209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f677fe700 1 --2- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6809f350 0x7f0f68120f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f58016000 tx=0x7f0f58004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f64ff9700 1 -- 172.21.15.154:0/819285756 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58004400 con 0x7f0f6809f350 2023-09-30T22:23:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f64ff9700 1 -- 172.21.15.154:0/819285756 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5801f070 con 0x7f0f6809f350 2023-09-30T22:23:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f64ff9700 1 -- 172.21.15.154:0/819285756 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580038e0 con 0x7f0f6809f350 2023-09-30T22:23:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f6e55b700 1 -- 172.21.15.154:0/819285756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f58009550 con 0x7f0f6809f350 2023-09-30T22:23:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.115+0000 7f0f6e55b700 1 -- 172.21.15.154:0/819285756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f681241d0 con 0x7f0f6809f350 2023-09-30T22:23:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.116+0000 7f0f64ff9700 1 -- 172.21.15.154:0/819285756 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f58021030 con 0x7f0f6809f350 2023-09-30T22:23:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.116+0000 7f0f64ff9700 1 -- 172.21.15.154:0/819285756 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f58040870 con 0x7f0f6809f350 2023-09-30T22:23:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.116+0000 7f0f6e55b700 1 -- 172.21.15.154:0/819285756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f681241d0 con 0x7f0f6809f350 2023-09-30T22:23:21.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.120+0000 7f0f64ff9700 1 -- 172.21.15.154:0/819285756 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f681241d0 con 0x7f0f6809f350 2023-09-30T22:23:21.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:21.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:21.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.317+0000 7f0f6e55b700 1 -- 172.21.15.154:0/819285756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f681241d0 con 0x7f0f6809f350 2023-09-30T22:23:21.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.317+0000 7f0f64ff9700 1 -- 172.21.15.154:0/819285756 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f681241d0 con 0x7f0f6809f350 2023-09-30T22:23:21.318 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.319+0000 7f0f6e55b700 1 -- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6809f350 msgr2=0x7f0f68120f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.319+0000 7f0f6e55b700 1 --2- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6809f350 0x7f0f68120f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f58016000 tx=0x7f0f58004750 comp rx=0 tx=0).stop 2023-09-30T22:23:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.319+0000 7f0f6e55b700 1 -- 172.21.15.154:0/819285756 shutdown_connections 2023-09-30T22:23:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.319+0000 7f0f6e55b700 1 --2- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f681371c0 0x7f0f68121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.319+0000 7f0f6e55b700 1 --2- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6809e870 0x7f0f681209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.319+0000 7f0f6e55b700 1 --2- 172.21.15.154:0/819285756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6809f350 0x7f0f68120f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.319+0000 7f0f6e55b700 1 -- 172.21.15.154:0/819285756 >> 172.21.15.154:0/819285756 conn(0x7f0f680a4430 msgr2=0x7f0f680a2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.319+0000 7f0f6e55b700 1 -- 172.21.15.154:0/819285756 shutdown_connections 2023-09-30T22:23:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.319+0000 7f0f6e55b700 1 -- 172.21.15.154:0/819285756 wait complete. 2023-09-30T22:23:21.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:21.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:21.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.368+0000 7fab204b1700 1 Processor -- start 2023-09-30T22:23:21.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab204b1700 1 -- start start 2023-09-30T22:23:21.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab204b1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab18135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab204b1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 0x7fab18138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab204b1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab18099a60 con 0x7fab18099e20 2023-09-30T22:23:21.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab204b1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1809bf50 con 0x7fab18133660 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab204b1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab1809b230 con 0x7fab18135f80 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab1da4c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab18135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab1da4c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab18135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39804/0 (socket says 172.21.15.154:39804) 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab1da4c700 1 -- 172.21.15.154:0/4284288751 learned_addr learned my addr 172.21.15.154:0/4284288751 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.369+0000 7fab1ea4e700 1 --2- 172.21.15.154:0/4284288751 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 0x7fab18138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1ea4e700 1 -- 172.21.15.154:0/4284288751 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 msgr2=0x7fab18135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1ea4e700 1 --2- 172.21.15.154:0/4284288751 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab18135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1ea4e700 1 -- 172.21.15.154:0/4284288751 >> v1:172.21.15.154:6789/0 conn(0x7fab18099e20 legacy=0x7fab1809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1ea4e700 1 -- 172.21.15.154:0/4284288751 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1809bb90 con 0x7fab18135f80 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1d24b700 1 -- 172.21.15.154:0/4284288751 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538824310 0 0) 0x7fab18099a60 con 0x7fab18099e20 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1da4c700 1 --2- 172.21.15.154:0/4284288751 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab18135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1ea4e700 1 --2- 172.21.15.154:0/4284288751 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 0x7fab18138360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab10009dc0 tx=0x7fab1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1244f2580ff169d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1d24b700 1 -- 172.21.15.154:0/4284288751 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000e070 con 0x7fab18135f80 2023-09-30T22:23:21.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1d24b700 1 -- 172.21.15.154:0/4284288751 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1000bb20 con 0x7fab18135f80 2023-09-30T22:23:21.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.370+0000 7fab1d24b700 1 -- 172.21.15.154:0/4284288751 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10012430 con 0x7fab18135f80 2023-09-30T22:23:21.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.371+0000 7fab204b1700 1 -- 172.21.15.154:0/4284288751 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 msgr2=0x7fab18138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.371+0000 7fab204b1700 1 --2- 172.21.15.154:0/4284288751 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 0x7fab18138360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab10009dc0 tx=0x7fab1000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.371+0000 7fab204b1700 1 -- 172.21.15.154:0/4284288751 shutdown_connections 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.371+0000 7fab204b1700 1 --2- 172.21.15.154:0/4284288751 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 0x7fab18138360 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.371+0000 7fab204b1700 1 --2- 172.21.15.154:0/4284288751 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab18135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.371+0000 7fab204b1700 1 -- 172.21.15.154:0/4284288751 >> 172.21.15.154:0/4284288751 conn(0x7fab180a2980 msgr2=0x7fab180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.371+0000 7fab204b1700 1 -- 172.21.15.154:0/4284288751 shutdown_connections 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.371+0000 7fab204b1700 1 -- 172.21.15.154:0/4284288751 wait complete. 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.372+0000 7fab204b1700 1 Processor -- start 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.372+0000 7fab204b1700 1 -- start start 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab204b1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18099e20 0x7fab18070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab204b1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab180710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab204b1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 0x7fab181c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab204b1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1811eb50 con 0x7fab18099e20 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab204b1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1809b500 con 0x7fab18133660 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab204b1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab1811ed30 con 0x7fab18135f80 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab1da4c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab180710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab1e24d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18099e20 0x7fab18070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab1da4c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab180710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39818/0 (socket says 172.21.15.154:39818) 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab1da4c700 1 -- 172.21.15.154:0/4265388575 learned_addr learned my addr 172.21.15.154:0/4265388575 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.373+0000 7fab1ea4e700 1 --2- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 0x7fab181c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab1da4c700 1 -- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 msgr2=0x7fab181c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab1da4c700 1 --2- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 0x7fab181c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab1da4c700 1 -- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18099e20 msgr2=0x7fab18070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab1da4c700 1 --2- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18099e20 0x7fab18070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab1da4c700 1 -- 172.21.15.154:0/4265388575 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0800b7f0 con 0x7fab18133660 2023-09-30T22:23:21.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab1e24d700 1 --2- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18099e20 0x7fab18070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab1da4c700 1 --2- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab180710f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab0800eda0 tx=0x7fab0800d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab0effd700 1 -- 172.21.15.154:0/4265388575 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0800ee90 con 0x7fab18133660 2023-09-30T22:23:21.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab0effd700 1 -- 172.21.15.154:0/4265388575 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab08010440 con 0x7fab18133660 2023-09-30T22:23:21.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab204b1700 1 -- 172.21.15.154:0/4265388575 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab10009a70 con 0x7fab18133660 2023-09-30T22:23:21.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab0effd700 1 -- 172.21.15.154:0/4265388575 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080107b0 con 0x7fab18133660 2023-09-30T22:23:21.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.374+0000 7fab204b1700 1 -- 172.21.15.154:0/4265388575 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1811d3d0 con 0x7fab18133660 2023-09-30T22:23:21.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.375+0000 7fab0effd700 1 -- 172.21.15.154:0/4265388575 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab08010910 con 0x7fab18133660 2023-09-30T22:23:21.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.375+0000 7fab0effd700 1 -- 172.21.15.154:0/4265388575 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab0803f9b0 con 0x7fab18133660 2023-09-30T22:23:21.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.375+0000 7fab204b1700 1 -- 172.21.15.154:0/4265388575 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1811ee70 con 0x7fab18133660 2023-09-30T22:23:21.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.380+0000 7fab0effd700 1 -- 172.21.15.154:0/4265388575 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab1811ee70 con 0x7fab18133660 2023-09-30T22:23:21.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.428+0000 7f3b5ddde700 1 Processor -- start 2023-09-30T22:23:21.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.428+0000 7f3b5ddde700 1 -- start start 2023-09-30T22:23:21.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.429+0000 7f3b5ddde700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b580a0a70 0x7f3b580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.429+0000 7f3b5ddde700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b58133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.429+0000 7f3b5ddde700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5809dc00 con 0x7f3b58133f50 2023-09-30T22:23:21.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.429+0000 7f3b5ddde700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5809ea60 con 0x7f3b580a0a70 2023-09-30T22:23:21.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.429+0000 7f3b5ddde700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5809dec0 con 0x7f3b580a1380 2023-09-30T22:23:21.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.429+0000 7f3b56ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b58133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.429+0000 7f3b56ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b58133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39832/0 (socket says 172.21.15.154:39832) 2023-09-30T22:23:21.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.429+0000 7f3b56ffd700 1 -- 172.21.15.154:0/101321979 learned_addr learned my addr 172.21.15.154:0/101321979 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:21.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.429+0000 7f3b577fe700 1 --2- 172.21.15.154:0/101321979 >> v2:172.21.15.154:3300/0 conn(0x7f3b580a0a70 0x7f3b580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.430+0000 7f3b56ffd700 1 -- 172.21.15.154:0/101321979 >> v2:172.21.15.154:3300/0 conn(0x7f3b580a0a70 msgr2=0x7f3b580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.430+0000 7f3b56ffd700 1 --2- 172.21.15.154:0/101321979 >> v2:172.21.15.154:3300/0 conn(0x7f3b580a0a70 0x7f3b580a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.430+0000 7f3b56ffd700 1 -- 172.21.15.154:0/101321979 >> v1:172.21.15.154:6789/0 conn(0x7f3b58133f50 legacy=0x7f3b5813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.430+0000 7f3b56ffd700 1 -- 172.21.15.154:0/101321979 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5809e6a0 con 0x7f3b580a1380 2023-09-30T22:23:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.430+0000 7f3b56ffd700 1 --2- 172.21.15.154:0/101321979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b58133a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0098f0 tx=0x7f3b4c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f1e395996171a98 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.430+0000 7f3b567fc700 1 -- 172.21.15.154:0/101321979 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011830 con 0x7f3b580a1380 2023-09-30T22:23:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.430+0000 7f3b567fc700 1 -- 172.21.15.154:0/101321979 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c011990 con 0x7f3b580a1380 2023-09-30T22:23:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.430+0000 7f3b567fc700 1 -- 172.21.15.154:0/101321979 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011d20 con 0x7f3b580a1380 2023-09-30T22:23:21.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.431+0000 7f3b5ddde700 1 -- 172.21.15.154:0/101321979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 msgr2=0x7f3b58133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.431+0000 7f3b5ddde700 1 --2- 172.21.15.154:0/101321979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b58133a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0098f0 tx=0x7f3b4c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:21.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.431+0000 7f3b5ddde700 1 -- 172.21.15.154:0/101321979 shutdown_connections 2023-09-30T22:23:21.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.431+0000 7f3b5ddde700 1 --2- 172.21.15.154:0/101321979 >> v2:172.21.15.154:3300/0 conn(0x7f3b580a0a70 0x7f3b580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.431+0000 7f3b5ddde700 1 --2- 172.21.15.154:0/101321979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b58133a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.431+0000 7f3b5ddde700 1 -- 172.21.15.154:0/101321979 >> 172.21.15.154:0/101321979 conn(0x7f3b580a6610 msgr2=0x7f3b580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.431+0000 7f3b5ddde700 1 -- 172.21.15.154:0/101321979 shutdown_connections 2023-09-30T22:23:21.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.431+0000 7f3b5ddde700 1 -- 172.21.15.154:0/101321979 wait complete. 2023-09-30T22:23:21.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.432+0000 7f3b5ddde700 1 Processor -- start 2023-09-30T22:23:21.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.432+0000 7f3b5ddde700 1 -- start start 2023-09-30T22:23:21.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b5ddde700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b580a0a70 0x7f3b581c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b5ddde700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b581c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b5ddde700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b58133f50 0x7f3b581c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b5ddde700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58124870 con 0x7f3b58133f50 2023-09-30T22:23:21.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b5ddde700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58124680 con 0x7f3b580a1380 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b5ddde700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58133a50 con 0x7f3b580a0a70 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b56ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b581c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b56ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b581c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39840/0 (socket says 172.21.15.154:39840) 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b56ffd700 1 -- 172.21.15.154:0/2167366955 learned_addr learned my addr 172.21.15.154:0/2167366955 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b577fe700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b580a0a70 0x7f3b581c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b57fff700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b58133f50 0x7f3b581c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.433+0000 7f3b577fe700 1 -- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 msgr2=0x7f3b581c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b577fe700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b581c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b577fe700 1 -- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b58133f50 msgr2=0x7f3b581c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b577fe700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b58133f50 0x7f3b581c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b577fe700 1 -- 172.21.15.154:0/2167366955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c009550 con 0x7f3b580a0a70 2023-09-30T22:23:21.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b56ffd700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b581c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b577fe700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b580a0a70 0x7f3b581c8230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800e930 tx=0x7f3b4800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b3ffff700 1 -- 172.21.15.154:0/2167366955 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800ee80 con 0x7f3b580a0a70 2023-09-30T22:23:21.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b3ffff700 1 -- 172.21.15.154:0/2167366955 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4800c850 con 0x7f3b580a0a70 2023-09-30T22:23:21.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b3ffff700 1 -- 172.21.15.154:0/2167366955 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800cbc0 con 0x7f3b580a0a70 2023-09-30T22:23:21.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b5ddde700 1 -- 172.21.15.154:0/2167366955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b58125ff0 con 0x7f3b580a0a70 2023-09-30T22:23:21.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.434+0000 7f3b5ddde700 1 -- 172.21.15.154:0/2167366955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b581252f0 con 0x7f3b580a0a70 2023-09-30T22:23:21.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.435+0000 7f3b3ffff700 1 -- 172.21.15.154:0/2167366955 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b4800cd20 con 0x7f3b580a0a70 2023-09-30T22:23:21.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.435+0000 7f3b3ffff700 1 -- 172.21.15.154:0/2167366955 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b4803f700 con 0x7f3b580a0a70 2023-09-30T22:23:21.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.435+0000 7f3b5ddde700 1 -- 172.21.15.154:0/2167366955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5804f2a0 con 0x7f3b580a0a70 2023-09-30T22:23:21.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.443+0000 7f3b3ffff700 1 -- 172.21.15.154:0/2167366955 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b480232f0 con 0x7f3b580a0a70 2023-09-30T22:23:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.461+0000 7fdccb678700 1 Processor -- start 2023-09-30T22:23:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.461+0000 7fdccb678700 1 -- start start 2023-09-30T22:23:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdccb678700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc406a770 0x7fdcc41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdccb678700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc4134f00 0x7fdcc409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdccb678700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdcc409dea0 0x7fdcc409e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdccb678700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc406b2e0 con 0x7fdcc409dea0 2023-09-30T22:23:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdccb678700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc409eca0 con 0x7fdcc4134f00 2023-09-30T22:23:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdccb678700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc409f720 con 0x7fdcc406a770 2023-09-30T22:23:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc9414700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc406a770 0x7fdcc41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc9c15700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdcc409dea0 0x7fdcc409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc8c13700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc4134f00 0x7fdcc409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc9c15700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdcc409dea0 0x7fdcc409e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46884/0 (socket says 172.21.15.154:46884) 2023-09-30T22:23:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc9414700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc406a770 0x7fdcc41349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34828/0 (socket says 172.21.15.154:34828) 2023-09-30T22:23:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc9c15700 1 -- 172.21.15.154:0/3247060848 learned_addr learned my addr 172.21.15.154:0/3247060848 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc8c13700 1 -- 172.21.15.154:0/3247060848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc406a770 msgr2=0x7fdcc41349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc8c13700 1 --2- 172.21.15.154:0/3247060848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc406a770 0x7fdcc41349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc8c13700 1 -- 172.21.15.154:0/3247060848 >> v2:172.21.15.154:3300/0 conn(0x7fdcc409dea0 msgr2=0x7fdcc409e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc8c13700 1 --2- 172.21.15.154:0/3247060848 >> v2:172.21.15.154:3300/0 conn(0x7fdcc409dea0 0x7fdcc409e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc8c13700 1 -- 172.21.15.154:0/3247060848 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc406b480 con 0x7fdcc4134f00 2023-09-30T22:23:21.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.462+0000 7fdcc9c15700 1 --2- 172.21.15.154:0/3247060848 >> v2:172.21.15.154:3300/0 conn(0x7fdcc409dea0 0x7fdcc409e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdcc8c13700 1 --2- 172.21.15.154:0/3247060848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc4134f00 0x7fdcc409d960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009840 tx=0x7fdcb4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ca56010c7f78b7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdcbbfff700 1 -- 172.21.15.154:0/3247060848 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4011830 con 0x7fdcc4134f00 2023-09-30T22:23:21.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdcbbfff700 1 -- 172.21.15.154:0/3247060848 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb4011990 con 0x7fdcc4134f00 2023-09-30T22:23:21.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdcbbfff700 1 -- 172.21.15.154:0/3247060848 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4011d20 con 0x7fdcc4134f00 2023-09-30T22:23:21.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdccb678700 1 -- 172.21.15.154:0/3247060848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc4134f00 msgr2=0x7fdcc409d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdccb678700 1 --2- 172.21.15.154:0/3247060848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc4134f00 0x7fdcc409d960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009840 tx=0x7fdcb4009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:21.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdccb678700 1 -- 172.21.15.154:0/3247060848 shutdown_connections 2023-09-30T22:23:21.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdccb678700 1 --2- 172.21.15.154:0/3247060848 >> v2:172.21.15.154:3300/0 conn(0x7fdcc409dea0 0x7fdcc409e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdccb678700 1 --2- 172.21.15.154:0/3247060848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc406a770 0x7fdcc41349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdccb678700 1 --2- 172.21.15.154:0/3247060848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc4134f00 0x7fdcc409d960 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdccb678700 1 -- 172.21.15.154:0/3247060848 >> 172.21.15.154:0/3247060848 conn(0x7fdcc4099c40 msgr2=0x7fdcc40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.463+0000 7fdccb678700 1 -- 172.21.15.154:0/3247060848 shutdown_connections 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.464+0000 7fdccb678700 1 -- 172.21.15.154:0/3247060848 wait complete. 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.464+0000 7fdccb678700 1 Processor -- start 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.464+0000 7fdccb678700 1 -- start start 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdccb678700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc406a770 0x7fdcc406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdccb678700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc409dea0 0x7fdcc406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdccb678700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc4134f00 0x7fdcc40703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdccb678700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4071510 con 0x7fdcc406a770 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdccb678700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4071320 con 0x7fdcc409dea0 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdccb678700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4071bc0 con 0x7fdcc4134f00 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9414700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc406a770 0x7fdcc406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc8c13700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc409dea0 0x7fdcc406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9414700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc406a770 0x7fdcc406f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46888/0 (socket says 172.21.15.154:46888) 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9414700 1 -- 172.21.15.154:0/4140905261 learned_addr learned my addr 172.21.15.154:0/4140905261 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9c15700 1 --2- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc4134f00 0x7fdcc40703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9414700 1 -- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc4134f00 msgr2=0x7fdcc40703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9414700 1 --2- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc4134f00 0x7fdcc40703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9414700 1 -- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc409dea0 msgr2=0x7fdcc406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9414700 1 --2- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc409dea0 0x7fdcc406fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9414700 1 -- 172.21.15.154:0/4140905261 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc009b30 con 0x7fdcc406a770 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc8c13700 1 --2- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc409dea0 0x7fdcc406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:21.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.465+0000 7fdcc9414700 1 --2- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc406a770 0x7fdcc406f950 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000e8a0 tx=0x7fdcc000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:21.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.466+0000 7fdcb9ffb700 1 -- 172.21.15.154:0/4140905261 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0009590 con 0x7fdcc406a770 2023-09-30T22:23:21.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.466+0000 7fdcb9ffb700 1 -- 172.21.15.154:0/4140905261 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc0013680 con 0x7fdcc406a770 2023-09-30T22:23:21.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.466+0000 7fdccb678700 1 -- 172.21.15.154:0/4140905261 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb40094a0 con 0x7fdcc406a770 2023-09-30T22:23:21.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.466+0000 7fdcb9ffb700 1 -- 172.21.15.154:0/4140905261 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00139f0 con 0x7fdcc406a770 2023-09-30T22:23:21.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.466+0000 7fdccb678700 1 -- 172.21.15.154:0/4140905261 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc4126740 con 0x7fdcc406a770 2023-09-30T22:23:21.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.467+0000 7fdcb9ffb700 1 -- 172.21.15.154:0/4140905261 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcc0013b50 con 0x7fdcc406a770 2023-09-30T22:23:21.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.467+0000 7fdcb9ffb700 1 -- 172.21.15.154:0/4140905261 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdcc003f690 con 0x7fdcc406a770 2023-09-30T22:23:21.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.467+0000 7fdccb678700 1 -- 172.21.15.154:0/4140905261 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc404f2a0 con 0x7fdcc406a770 2023-09-30T22:23:21.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.472+0000 7fdcb9ffb700 1 -- 172.21.15.154:0/4140905261 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcc0021080 con 0x7fdcc406a770 2023-09-30T22:23:21.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.576+0000 7fab204b1700 1 -- 172.21.15.154:0/4265388575 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab1811ee70 con 0x7fab18133660 2023-09-30T22:23:21.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.577+0000 7fab0effd700 1 -- 172.21.15.154:0/4265388575 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab1811ee70 con 0x7fab18133660 2023-09-30T22:23:21.578 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:21.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.579+0000 7fab204b1700 1 -- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 msgr2=0x7fab180710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.579+0000 7fab204b1700 1 --2- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab180710f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab0800eda0 tx=0x7fab0800d630 comp rx=0 tx=0).stop 2023-09-30T22:23:21.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.579+0000 7fab204b1700 1 -- 172.21.15.154:0/4265388575 shutdown_connections 2023-09-30T22:23:21.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.579+0000 7fab204b1700 1 --2- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18135f80 0x7fab181c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.579+0000 7fab204b1700 1 --2- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18099e20 0x7fab18070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.579+0000 7fab204b1700 1 --2- 172.21.15.154:0/4265388575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab18133660 0x7fab180710f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.579+0000 7fab204b1700 1 -- 172.21.15.154:0/4265388575 >> 172.21.15.154:0/4265388575 conn(0x7fab180a2980 msgr2=0x7fab181324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.579+0000 7fab204b1700 1 -- 172.21.15.154:0/4265388575 shutdown_connections 2023-09-30T22:23:21.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.579+0000 7fab204b1700 1 -- 172.21.15.154:0/4265388575 wait complete. 2023-09-30T22:23:21.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:21.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.636+0000 7f3b5ddde700 1 -- 172.21.15.154:0/2167366955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b58072980 con 0x7f3b580a0a70 2023-09-30T22:23:21.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.636+0000 7f3b3ffff700 1 -- 172.21.15.154:0/2167366955 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b4801ae80 con 0x7f3b580a0a70 2023-09-30T22:23:21.637 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:21.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.638+0000 7f3b5ddde700 1 -- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b580a0a70 msgr2=0x7f3b581c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.638+0000 7f3b5ddde700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b580a0a70 0x7f3b581c8230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800e930 tx=0x7f3b4800ec40 comp rx=0 tx=0).stop 2023-09-30T22:23:21.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.638+0000 7f3b5ddde700 1 -- 172.21.15.154:0/2167366955 shutdown_connections 2023-09-30T22:23:21.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.638+0000 7f3b5ddde700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b58133f50 0x7f3b581c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.638+0000 7f3b5ddde700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b580a0a70 0x7f3b581c8230 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.638+0000 7f3b5ddde700 1 --2- 172.21.15.154:0/2167366955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b580a1380 0x7f3b581c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.638+0000 7f3b5ddde700 1 -- 172.21.15.154:0/2167366955 >> 172.21.15.154:0/2167366955 conn(0x7f3b580a6610 msgr2=0x7f3b580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.638+0000 7f3b5ddde700 1 -- 172.21.15.154:0/2167366955 shutdown_connections 2023-09-30T22:23:21.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.638+0000 7f3b5ddde700 1 -- 172.21.15.154:0/2167366955 wait complete. 2023-09-30T22:23:21.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.667+0000 7fdccb678700 1 -- 172.21.15.154:0/4140905261 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdcc406c3b0 con 0x7fdcc406a770 2023-09-30T22:23:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.667+0000 7fdcb9ffb700 1 -- 172.21.15.154:0/4140905261 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcc0017020 con 0x7fdcc406a770 2023-09-30T22:23:21.668 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:21.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.669+0000 7fdccb678700 1 -- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc406a770 msgr2=0x7fdcc406f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:21.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.669+0000 7fdccb678700 1 --2- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc406a770 0x7fdcc406f950 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000e8a0 tx=0x7fdcc000ebb0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.669+0000 7fdccb678700 1 -- 172.21.15.154:0/4140905261 shutdown_connections 2023-09-30T22:23:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.669+0000 7fdccb678700 1 --2- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdcc4134f00 0x7fdcc40703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.669+0000 7fdccb678700 1 --2- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc406a770 0x7fdcc406f950 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.669+0000 7fdccb678700 1 --2- 172.21.15.154:0/4140905261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc409dea0 0x7fdcc406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.669+0000 7fdccb678700 1 -- 172.21.15.154:0/4140905261 >> 172.21.15.154:0/4140905261 conn(0x7fdcc4099c40 msgr2=0x7fdcc409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.669+0000 7fdccb678700 1 -- 172.21.15.154:0/4140905261 shutdown_connections 2023-09-30T22:23:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:21.669+0000 7fdccb678700 1 -- 172.21.15.154:0/4140905261 wait complete. 2023-09-30T22:23:21.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:22.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:22.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6119aaa700 1 Processor -- start 2023-09-30T22:23:22.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6119aaa700 1 -- start start 2023-09-30T22:23:22.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6119aaa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6114133ad0 0x7f6114133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6119aaa700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61141300a0 0x7f61141304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6119aaa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141309f0 0x7f611413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6119aaa700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611406b2d0 con 0x7f61141300a0 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6119aaa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6114133610 con 0x7f6114133ad0 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6119aaa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f611409a500 con 0x7f61141309f0 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6112ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61141300a0 0x7f61141304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f61137fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6114133ad0 0x7f6114133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6113fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141309f0 0x7f611413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6112ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61141300a0 0x7f61141304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46894/0 (socket says 172.21.15.154:46894) 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.460+0000 7f6112ffd700 1 -- 172.21.15.154:0/272964170 learned_addr learned my addr 172.21.15.154:0/272964170 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f6112ffd700 1 -- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141309f0 msgr2=0x7f611413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f6112ffd700 1 --2- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141309f0 0x7f611413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f6112ffd700 1 -- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6114133ad0 msgr2=0x7f6114133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:22.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f6112ffd700 1 --2- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6114133ad0 0x7f6114133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f6112ffd700 1 -- 172.21.15.154:0/272964170 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61141338b0 con 0x7f61141300a0 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f61137fe700 1 --2- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6114133ad0 0x7f6114133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f6113fff700 1 --2- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141309f0 0x7f611413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f6112ffd700 1 --2- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61141300a0 0x7f61141304b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f61080098f0 tx=0x7f6108009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb86b7d0050455da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f61127fc700 1 -- 172.21.15.154:0/272964170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108011830 con 0x7f61141300a0 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f61127fc700 1 -- 172.21.15.154:0/272964170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6108011990 con 0x7f61141300a0 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.461+0000 7f61127fc700 1 -- 172.21.15.154:0/272964170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108011d20 con 0x7f61141300a0 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.462+0000 7f6119aaa700 1 -- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61141300a0 msgr2=0x7f61141304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.462+0000 7f6119aaa700 1 --2- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61141300a0 0x7f61141304b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f61080098f0 tx=0x7f6108009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.462+0000 7f6119aaa700 1 -- 172.21.15.154:0/272964170 shutdown_connections 2023-09-30T22:23:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.462+0000 7f6119aaa700 1 --2- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6114133ad0 0x7f6114133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.462+0000 7f6119aaa700 1 --2- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141309f0 0x7f611413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.462+0000 7f6119aaa700 1 --2- 172.21.15.154:0/272964170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61141300a0 0x7f61141304b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.462+0000 7f6119aaa700 1 -- 172.21.15.154:0/272964170 >> 172.21.15.154:0/272964170 conn(0x7f6114099c40 msgr2=0x7f61140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.462+0000 7f6119aaa700 1 -- 172.21.15.154:0/272964170 shutdown_connections 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.462+0000 7f6119aaa700 1 -- 172.21.15.154:0/272964170 wait complete. 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6119aaa700 1 Processor -- start 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6119aaa700 1 -- start start 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6119aaa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141300a0 0x7f611411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6119aaa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61141309f0 0x7f611411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6119aaa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6114133ad0 0x7f611411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6119aaa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611411fda0 con 0x7f6114133ad0 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6119aaa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611412d8f0 con 0x7f61141309f0 2023-09-30T22:23:22.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6119aaa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f611411ffa0 con 0x7f61141300a0 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6112ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61141309f0 0x7f611411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6113fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6114133ad0 0x7f611411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6112ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61141309f0 0x7f611411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39884/0 (socket says 172.21.15.154:39884) 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f6112ffd700 1 -- 172.21.15.154:0/2237839702 learned_addr learned my addr 172.21.15.154:0/2237839702 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.463+0000 7f61137fe700 1 --2- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141300a0 0x7f611411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f6112ffd700 1 -- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141300a0 msgr2=0x7f611411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f6112ffd700 1 --2- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141300a0 0x7f611411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f6112ffd700 1 -- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6114133ad0 msgr2=0x7f611411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f6112ffd700 1 --2- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6114133ad0 0x7f611411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f6112ffd700 1 -- 172.21.15.154:0/2237839702 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c009a70 con 0x7f61141309f0 2023-09-30T22:23:22.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f6113fff700 1 --2- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6114133ad0 0x7f611411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:22.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f6112ffd700 1 --2- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61141309f0 0x7f611411df80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6108000c00 tx=0x7f6108004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:22.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f60fbfff700 1 -- 172.21.15.154:0/2237839702 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108004240 con 0x7f61141309f0 2023-09-30T22:23:22.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f60fbfff700 1 -- 172.21.15.154:0/2237839702 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610801f070 con 0x7f61141309f0 2023-09-30T22:23:22.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f6119aaa700 1 -- 172.21.15.154:0/2237839702 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61040094a0 con 0x7f61141309f0 2023-09-30T22:23:22.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f60fbfff700 1 -- 172.21.15.154:0/2237839702 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080045c0 con 0x7f61141309f0 2023-09-30T22:23:22.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.464+0000 7f6119aaa700 1 -- 172.21.15.154:0/2237839702 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6108009550 con 0x7f61141309f0 2023-09-30T22:23:22.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.465+0000 7f60fbfff700 1 -- 172.21.15.154:0/2237839702 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6108021030 con 0x7f61141309f0 2023-09-30T22:23:22.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.465+0000 7f60fbfff700 1 -- 172.21.15.154:0/2237839702 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6108040610 con 0x7f61141309f0 2023-09-30T22:23:22.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.465+0000 7f6119aaa700 1 -- 172.21.15.154:0/2237839702 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611404f2a0 con 0x7f61141309f0 2023-09-30T22:23:22.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.469+0000 7f60fbfff700 1 -- 172.21.15.154:0/2237839702 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6108015070 con 0x7f61141309f0 2023-09-30T22:23:22.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:22.652 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:22.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.659+0000 7f6119aaa700 1 -- 172.21.15.154:0/2237839702 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6114120880 con 0x7f61141309f0 2023-09-30T22:23:22.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.659+0000 7f60fbfff700 1 -- 172.21.15.154:0/2237839702 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f610801a450 con 0x7f61141309f0 2023-09-30T22:23:22.660 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:22.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.662+0000 7f6119aaa700 1 -- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61141309f0 msgr2=0x7f611411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.662+0000 7f6119aaa700 1 --2- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61141309f0 0x7f611411df80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6108000c00 tx=0x7f6108004750 comp rx=0 tx=0).stop 2023-09-30T22:23:22.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.662+0000 7f6119aaa700 1 -- 172.21.15.154:0/2237839702 shutdown_connections 2023-09-30T22:23:22.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.662+0000 7f6119aaa700 1 --2- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6114133ad0 0x7f611411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.662+0000 7f6119aaa700 1 --2- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61141300a0 0x7f611411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.662+0000 7f6119aaa700 1 --2- 172.21.15.154:0/2237839702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61141309f0 0x7f611411df80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.662+0000 7f6119aaa700 1 -- 172.21.15.154:0/2237839702 >> 172.21.15.154:0/2237839702 conn(0x7f6114099c40 msgr2=0x7f611412e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.662+0000 7f6119aaa700 1 -- 172.21.15.154:0/2237839702 shutdown_connections 2023-09-30T22:23:22.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.662+0000 7f6119aaa700 1 -- 172.21.15.154:0/2237839702 wait complete. 2023-09-30T22:23:22.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:22.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.718+0000 7f7c5cf22700 1 Processor -- start 2023-09-30T22:23:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.719+0000 7f7c5cf22700 1 -- start start 2023-09-30T22:23:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.719+0000 7f7c5cf22700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c580a1550 0x7f7c58138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.719+0000 7f7c5cf22700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c58139200 0x7f7c5813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.719+0000 7f7c5cf22700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5809e9d0 con 0x7f7c580a0a70 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.719+0000 7f7c5cf22700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5809dc00 con 0x7f7c580a1550 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.719+0000 7f7c5cf22700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5809dec0 con 0x7f7c58139200 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.719+0000 7f7c5659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7c580a0a70 0x7f7c580a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39890/0 (socket says 172.21.15.154:39890) 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.719+0000 7f7c5659c700 1 -- 172.21.15.154:0/2690652406 learned_addr learned my addr 172.21.15.154:0/2690652406 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.719+0000 7f7c55d9b700 1 --2- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c580a1550 0x7f7c58138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c56d9d700 1 --2- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c58139200 0x7f7c5813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c5559a700 1 -- 172.21.15.154:0/2690652406 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508866052 0 0) 0x7f7c5809e9d0 con 0x7f7c580a0a70 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c55d9b700 1 -- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c58139200 msgr2=0x7f7c5813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c55d9b700 1 --2- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c58139200 0x7f7c5813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c55d9b700 1 -- 172.21.15.154:0/2690652406 >> v1:172.21.15.154:6789/0 conn(0x7f7c580a0a70 legacy=0x7f7c580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c55d9b700 1 -- 172.21.15.154:0/2690652406 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5809e6a0 con 0x7f7c580a1550 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c56d9d700 1 --2- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c58139200 0x7f7c5813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c55d9b700 1 --2- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c580a1550 0x7f7c58138cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009870 tx=0x7f7c4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5df0f332f41accb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c5559a700 1 -- 172.21.15.154:0/2690652406 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c011830 con 0x7f7c580a1550 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c5559a700 1 -- 172.21.15.154:0/2690652406 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c011990 con 0x7f7c580a1550 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.720+0000 7f7c5559a700 1 -- 172.21.15.154:0/2690652406 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c011d20 con 0x7f7c580a1550 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.721+0000 7f7c5cf22700 1 -- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c580a1550 msgr2=0x7f7c58138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.721+0000 7f7c5cf22700 1 --2- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c580a1550 0x7f7c58138cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009870 tx=0x7f7c4c009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.721+0000 7f7c5cf22700 1 -- 172.21.15.154:0/2690652406 shutdown_connections 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.721+0000 7f7c5cf22700 1 --2- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c58139200 0x7f7c5813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.721+0000 7f7c5cf22700 1 --2- 172.21.15.154:0/2690652406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c580a1550 0x7f7c58138cc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.721+0000 7f7c5cf22700 1 -- 172.21.15.154:0/2690652406 >> 172.21.15.154:0/2690652406 conn(0x7f7c580a6610 msgr2=0x7f7c580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.721+0000 7f7c5cf22700 1 -- 172.21.15.154:0/2690652406 shutdown_connections 2023-09-30T22:23:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.721+0000 7f7c5cf22700 1 -- 172.21.15.154:0/2690652406 wait complete. 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.722+0000 7f7c5cf22700 1 Processor -- start 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.722+0000 7f7c5cf22700 1 -- start start 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5cf22700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c580a0a70 0x7f7c58120850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5cf22700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c580a1550 0x7f7c58120d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5cf22700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c58139200 0x7f7c581212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5cf22700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58123e10 con 0x7f7c580a0a70 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5cf22700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580a5100 con 0x7f7c58139200 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5cf22700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580a03e0 con 0x7f7c580a1550 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c580a0a70 0x7f7c58120850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c55d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c580a1550 0x7f7c58120d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c580a0a70 0x7f7c58120850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46916/0 (socket says 172.21.15.154:46916) 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5659c700 1 -- 172.21.15.154:0/4045119145 learned_addr learned my addr 172.21.15.154:0/4045119145 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c56d9d700 1 --2- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c58139200 0x7f7c581212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5659c700 1 -- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c580a1550 msgr2=0x7f7c58120d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5659c700 1 --2- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c580a1550 0x7f7c58120d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5659c700 1 -- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c58139200 msgr2=0x7f7c581212d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5659c700 1 --2- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c58139200 0x7f7c581212d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c5659c700 1 -- 172.21.15.154:0/4045119145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50009a70 con 0x7f7c580a0a70 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.723+0000 7f7c55d9b700 1 --2- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c580a1550 0x7f7c58120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.724+0000 7f7c5659c700 1 --2- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c580a0a70 0x7f7c58120850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c520 tx=0x7f7c4800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.724+0000 7f7c46ffd700 1 -- 172.21.15.154:0/4045119145 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48004c80 con 0x7f7c580a0a70 2023-09-30T22:23:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.724+0000 7f7c46ffd700 1 -- 172.21.15.154:0/4045119145 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c48004e00 con 0x7f7c580a0a70 2023-09-30T22:23:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.724+0000 7f7c5cf22700 1 -- 172.21.15.154:0/4045119145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c0094a0 con 0x7f7c580a0a70 2023-09-30T22:23:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.724+0000 7f7c46ffd700 1 -- 172.21.15.154:0/4045119145 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48007310 con 0x7f7c580a0a70 2023-09-30T22:23:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.724+0000 7f7c5cf22700 1 -- 172.21.15.154:0/4045119145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c58123ac0 con 0x7f7c580a0a70 2023-09-30T22:23:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.725+0000 7f7c46ffd700 1 -- 172.21.15.154:0/4045119145 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c48007470 con 0x7f7c580a0a70 2023-09-30T22:23:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.725+0000 7f7c46ffd700 1 -- 172.21.15.154:0/4045119145 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c4803f240 con 0x7f7c580a0a70 2023-09-30T22:23:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.725+0000 7f7c5cf22700 1 -- 172.21.15.154:0/4045119145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c58123c50 con 0x7f7c580a0a70 2023-09-30T22:23:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.730+0000 7f7c46ffd700 1 -- 172.21.15.154:0/4045119145 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c480123b0 con 0x7f7c580a0a70 2023-09-30T22:23:22.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.791+0000 7f98d71da700 1 Processor -- start 2023-09-30T22:23:22.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.791+0000 7f98d71da700 1 -- start start 2023-09-30T22:23:22.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d71da700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d00a0a70 0x7f98d00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d71da700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98d0134120 0x7f98d013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d71da700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d009dc00 con 0x7f98d00a1380 2023-09-30T22:23:22.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d71da700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d009ea60 con 0x7f98d0134120 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d71da700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98d009dec0 con 0x7f98d00a0a70 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d4f76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d00a0a70 0x7f98d00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98cffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f98d00a1380 0x7f98d0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39902/0 (socket says 172.21.15.154:39902) 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98cffff700 1 -- 172.21.15.154:0/776744452 learned_addr learned my addr 172.21.15.154:0/776744452 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d5777700 1 --2- 172.21.15.154:0/776744452 >> v2:172.21.15.154:3300/0 conn(0x7f98d0134120 0x7f98d013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d5777700 1 -- 172.21.15.154:0/776744452 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d00a0a70 msgr2=0x7f98d00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98cf7fe700 1 -- 172.21.15.154:0/776744452 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115411164 0 0) 0x7f98d009dc00 con 0x7f98d00a1380 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d5777700 1 --2- 172.21.15.154:0/776744452 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d00a0a70 0x7f98d00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d5777700 1 -- 172.21.15.154:0/776744452 >> v1:172.21.15.154:6789/0 conn(0x7f98d00a1380 legacy=0x7f98d0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.792+0000 7f98d5777700 1 -- 172.21.15.154:0/776744452 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d009e6a0 con 0x7f98d0134120 2023-09-30T22:23:22.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98d5777700 1 --2- 172.21.15.154:0/776744452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d0134120 0x7f98d013bce0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009d90 tx=0x7f98c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b1bc05d09b35ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:22.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98cf7fe700 1 -- 172.21.15.154:0/776744452 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c800e070 con 0x7f98d0134120 2023-09-30T22:23:22.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98cf7fe700 1 -- 172.21.15.154:0/776744452 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c800bb20 con 0x7f98d0134120 2023-09-30T22:23:22.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98cf7fe700 1 -- 172.21.15.154:0/776744452 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8012430 con 0x7f98d0134120 2023-09-30T22:23:22.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98d71da700 1 -- 172.21.15.154:0/776744452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d0134120 msgr2=0x7f98d013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98d71da700 1 --2- 172.21.15.154:0/776744452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d0134120 0x7f98d013bce0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009d90 tx=0x7f98c800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:22.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98d71da700 1 -- 172.21.15.154:0/776744452 shutdown_connections 2023-09-30T22:23:22.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98d71da700 1 --2- 172.21.15.154:0/776744452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d0134120 0x7f98d013bce0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98d71da700 1 --2- 172.21.15.154:0/776744452 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d00a0a70 0x7f98d00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.793+0000 7f98d71da700 1 -- 172.21.15.154:0/776744452 >> 172.21.15.154:0/776744452 conn(0x7f98d00a6610 msgr2=0x7f98d00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.794+0000 7f98d71da700 1 -- 172.21.15.154:0/776744452 shutdown_connections 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.794+0000 7f98d71da700 1 -- 172.21.15.154:0/776744452 wait complete. 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.794+0000 7f98d71da700 1 Processor -- start 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.794+0000 7f98d71da700 1 -- start start 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d71da700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d00a0a70 0x7f98d0122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d71da700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00a1380 0x7f98d0122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d71da700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0134120 0x7f98d0123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d71da700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d0125ab0 con 0x7f98d00a0a70 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d71da700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d01332b0 con 0x7f98d00a1380 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d71da700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98d0123b70 con 0x7f98d0134120 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d4f76700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d00a0a70 0x7f98d0122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98cffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00a1380 0x7f98d0122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d4f76700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d00a0a70 0x7f98d0122710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46932/0 (socket says 172.21.15.154:46932) 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98cffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00a1380 0x7f98d0122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39906/0 (socket says 172.21.15.154:39906) 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d4f76700 1 -- 172.21.15.154:0/822556234 learned_addr learned my addr 172.21.15.154:0/822556234 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.795+0000 7f98d5777700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0134120 0x7f98d0123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98cffff700 1 -- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0134120 msgr2=0x7f98d0123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98cffff700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0134120 0x7f98d0123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98cffff700 1 -- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d00a0a70 msgr2=0x7f98d0122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98cffff700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d00a0a70 0x7f98d0122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98cffff700 1 -- 172.21.15.154:0/822556234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8009a70 con 0x7f98d00a1380 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98d4f76700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d00a0a70 0x7f98d0122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:22.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98d5777700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0134120 0x7f98d0123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:22.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98cffff700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00a1380 0x7f98d0122c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98d00a2b70 tx=0x7f98bc00c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:22.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98cd7fa700 1 -- 172.21.15.154:0/822556234 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc004c80 con 0x7f98d00a1380 2023-09-30T22:23:22.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98cd7fa700 1 -- 172.21.15.154:0/822556234 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc004de0 con 0x7f98d00a1380 2023-09-30T22:23:22.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98d71da700 1 -- 172.21.15.154:0/822556234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d01336c0 con 0x7f98d00a1380 2023-09-30T22:23:22.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98cd7fa700 1 -- 172.21.15.154:0/822556234 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc007310 con 0x7f98d00a1380 2023-09-30T22:23:22.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.796+0000 7f98d71da700 1 -- 172.21.15.154:0/822556234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d01339a0 con 0x7f98d00a1380 2023-09-30T22:23:22.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.797+0000 7f98cd7fa700 1 -- 172.21.15.154:0/822556234 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98bc007470 con 0x7f98d00a1380 2023-09-30T22:23:22.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.797+0000 7f98cd7fa700 1 -- 172.21.15.154:0/822556234 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f98bc03f0f0 con 0x7f98d00a1380 2023-09-30T22:23:22.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.797+0000 7f98d71da700 1 -- 172.21.15.154:0/822556234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d01336c0 con 0x7f98d00a1380 2023-09-30T22:23:22.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.802+0000 7f98cd7fa700 1 -- 172.21.15.154:0/822556234 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98d01336c0 con 0x7f98d00a1380 2023-09-30T22:23:22.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.845+0000 7f8f80e16700 1 Processor -- start 2023-09-30T22:23:22.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.845+0000 7f8f80e16700 1 -- start start 2023-09-30T22:23:22.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f80e16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f80e16700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c09f180 0x7f8f7c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f80e16700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7c09c970 con 0x7f8f7c131d70 2023-09-30T22:23:22.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f80e16700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0a0920 con 0x7f8f7c09e870 2023-09-30T22:23:22.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f80e16700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c09f9c0 con 0x7f8f7c09f180 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f79d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c09f180 0x7f8f7c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f7a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f79d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c09f180 0x7f8f7c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34894/0 (socket says 172.21.15.154:34894) 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f79d9b700 1 -- 172.21.15.154:0/3107137769 learned_addr learned my addr 172.21.15.154:0/3107137769 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f7959a700 1 -- 172.21.15.154:0/3107137769 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666142620 0 0) 0x7f8f7c09c970 con 0x7f8f7c131d70 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f79d9b700 1 -- 172.21.15.154:0/3107137769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 msgr2=0x7f8f7c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f79d9b700 1 --2- 172.21.15.154:0/3107137769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f79d9b700 1 -- 172.21.15.154:0/3107137769 >> v1:172.21.15.154:6789/0 conn(0x7f8f7c131d70 legacy=0x7f8f7c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f79d9b700 1 -- 172.21.15.154:0/3107137769 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c09bab0 con 0x7f8f7c09f180 2023-09-30T22:23:22.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f7a59c700 1 --2- 172.21.15.154:0/3107137769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f79d9b700 1 --2- 172.21.15.154:0/3107137769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c09f180 0x7f8f7c131830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009920 tx=0x7f8f70009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a67775313f82ab1b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f7959a700 1 -- 172.21.15.154:0/3107137769 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70011830 con 0x7f8f7c09f180 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.846+0000 7f8f7959a700 1 -- 172.21.15.154:0/3107137769 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f70011990 con 0x7f8f7c09f180 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.847+0000 7f8f7959a700 1 -- 172.21.15.154:0/3107137769 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f70011d20 con 0x7f8f7c09f180 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.847+0000 7f8f80e16700 1 -- 172.21.15.154:0/3107137769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c09f180 msgr2=0x7f8f7c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.847+0000 7f8f80e16700 1 --2- 172.21.15.154:0/3107137769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c09f180 0x7f8f7c131830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009920 tx=0x7f8f70009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.847+0000 7f8f80e16700 1 -- 172.21.15.154:0/3107137769 shutdown_connections 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.847+0000 7f8f80e16700 1 --2- 172.21.15.154:0/3107137769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.847+0000 7f8f80e16700 1 --2- 172.21.15.154:0/3107137769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c09f180 0x7f8f7c131830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.847+0000 7f8f80e16700 1 -- 172.21.15.154:0/3107137769 >> 172.21.15.154:0/3107137769 conn(0x7f8f7c0a4430 msgr2=0x7f8f7c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.847+0000 7f8f80e16700 1 -- 172.21.15.154:0/3107137769 shutdown_connections 2023-09-30T22:23:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.847+0000 7f8f80e16700 1 -- 172.21.15.154:0/3107137769 wait complete. 2023-09-30T22:23:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.848+0000 7f8f80e16700 1 Processor -- start 2023-09-30T22:23:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.848+0000 7f8f80e16700 1 -- start start 2023-09-30T22:23:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f80e16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f80e16700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f7c09f180 0x7f8f7c11d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f80e16700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c131d70 0x7f8f7c1c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f80e16700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c120170 con 0x7f8f7c09f180 2023-09-30T22:23:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f80e16700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c11dd40 con 0x7f8f7c09e870 2023-09-30T22:23:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f80e16700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c1311c0 con 0x7f8f7c131d70 2023-09-30T22:23:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c131d70 0x7f8f7c1c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c131d70 0x7f8f7c1c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34896/0 (socket says 172.21.15.154:34896) 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39914/0 (socket says 172.21.15.154:39914) 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7ad9d700 1 -- 172.21.15.154:0/3411709841 learned_addr learned my addr 172.21.15.154:0/3411709841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f79d9b700 1 --2- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f7c09f180 0x7f8f7c11d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7a59c700 1 -- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c131d70 msgr2=0x7f8f7c1c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7a59c700 1 --2- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c131d70 0x7f8f7c1c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7a59c700 1 -- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f7c09f180 msgr2=0x7f8f7c11d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7a59c700 1 --2- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f7c09f180 0x7f8f7c11d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7a59c700 1 -- 172.21.15.154:0/3411709841 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c0094a0 con 0x7f8f7c09e870 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.849+0000 7f8f7ad9d700 1 --2- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c131d70 0x7f8f7c1c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.850+0000 7f8f7a59c700 1 --2- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11d2c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00e900 tx=0x7f8f6c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.850+0000 7f8f6affd700 1 -- 172.21.15.154:0/3411709841 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c013680 con 0x7f8f7c09e870 2023-09-30T22:23:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.850+0000 7f8f6affd700 1 -- 172.21.15.154:0/3411709841 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c0137e0 con 0x7f8f7c09e870 2023-09-30T22:23:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.850+0000 7f8f80e16700 1 -- 172.21.15.154:0/3411709841 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f70009550 con 0x7f8f7c09e870 2023-09-30T22:23:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.850+0000 7f8f6affd700 1 -- 172.21.15.154:0/3411709841 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c013b70 con 0x7f8f7c09e870 2023-09-30T22:23:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.850+0000 7f8f80e16700 1 -- 172.21.15.154:0/3411709841 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c11e4b0 con 0x7f8f7c09e870 2023-09-30T22:23:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.851+0000 7f8f6affd700 1 -- 172.21.15.154:0/3411709841 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f6c013cd0 con 0x7f8f7c09e870 2023-09-30T22:23:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.851+0000 7f8f6affd700 1 -- 172.21.15.154:0/3411709841 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8f6c03f690 con 0x7f8f7c09e870 2023-09-30T22:23:22.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.851+0000 7f8f80e16700 1 -- 172.21.15.154:0/3411709841 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c04f2a0 con 0x7f8f7c09e870 2023-09-30T22:23:22.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.855+0000 7f8f6affd700 1 -- 172.21.15.154:0/3411709841 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f6c01be10 con 0x7f8f7c09e870 2023-09-30T22:23:22.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.945+0000 7f7c5cf22700 1 -- 172.21.15.154:0/4045119145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7c58122c10 con 0x7f7c580a0a70 2023-09-30T22:23:22.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.945+0000 7f7c46ffd700 1 -- 172.21.15.154:0/4045119145 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c4800ce60 con 0x7f7c580a0a70 2023-09-30T22:23:22.946 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:22.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.948+0000 7f7c5cf22700 1 -- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c580a0a70 msgr2=0x7f7c58120850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.948+0000 7f7c5cf22700 1 --2- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c580a0a70 0x7f7c58120850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c520 tx=0x7f7c4800c830 comp rx=0 tx=0).stop 2023-09-30T22:23:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.948+0000 7f7c5cf22700 1 -- 172.21.15.154:0/4045119145 shutdown_connections 2023-09-30T22:23:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.948+0000 7f7c5cf22700 1 --2- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c58139200 0x7f7c581212d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.948+0000 7f7c5cf22700 1 --2- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c580a0a70 0x7f7c58120850 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.948+0000 7f7c5cf22700 1 --2- 172.21.15.154:0/4045119145 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c580a1550 0x7f7c58120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.948+0000 7f7c5cf22700 1 -- 172.21.15.154:0/4045119145 >> 172.21.15.154:0/4045119145 conn(0x7f7c580a6610 msgr2=0x7f7c580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.948+0000 7f7c5cf22700 1 -- 172.21.15.154:0/4045119145 shutdown_connections 2023-09-30T22:23:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.948+0000 7f7c5cf22700 1 -- 172.21.15.154:0/4045119145 wait complete. 2023-09-30T22:23:22.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:22.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.997+0000 7f98d71da700 1 -- 172.21.15.154:0/822556234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98d01336c0 con 0x7f98d00a1380 2023-09-30T22:23:22.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.998+0000 7f98cd7fa700 1 -- 172.21.15.154:0/822556234 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98d01336c0 con 0x7f98d00a1380 2023-09-30T22:23:22.998 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.999+0000 7f98d71da700 1 -- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00a1380 msgr2=0x7f98d0122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:22.999+0000 7f98d71da700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00a1380 0x7f98d0122c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98d00a2b70 tx=0x7f98bc00c750 comp rx=0 tx=0).stop 2023-09-30T22:23:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.000+0000 7f98d71da700 1 -- 172.21.15.154:0/822556234 shutdown_connections 2023-09-30T22:23:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.000+0000 7f98d71da700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0134120 0x7f98d0123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.000+0000 7f98d71da700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d00a0a70 0x7f98d0122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.000+0000 7f98d71da700 1 --2- 172.21.15.154:0/822556234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00a1380 0x7f98d0122c50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.000+0000 7f98d71da700 1 -- 172.21.15.154:0/822556234 >> 172.21.15.154:0/822556234 conn(0x7f98d00a6610 msgr2=0x7f98d00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.000+0000 7f98d71da700 1 -- 172.21.15.154:0/822556234 shutdown_connections 2023-09-30T22:23:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.000+0000 7f98d71da700 1 -- 172.21.15.154:0/822556234 wait complete. 2023-09-30T22:23:23.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.049+0000 7f8f80e16700 1 -- 172.21.15.154:0/3411709841 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8f7c11ec30 con 0x7f8f7c09e870 2023-09-30T22:23:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.050+0000 7f8f6affd700 1 -- 172.21.15.154:0/3411709841 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f6c01b3b0 con 0x7f8f7c09e870 2023-09-30T22:23:23.050 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.051+0000 7f8f80e16700 1 -- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 msgr2=0x7f8f7c11d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.051+0000 7f8f80e16700 1 --2- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11d2c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00e900 tx=0x7f8f6c00ec10 comp rx=0 tx=0).stop 2023-09-30T22:23:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.052+0000 7f8f80e16700 1 -- 172.21.15.154:0/3411709841 shutdown_connections 2023-09-30T22:23:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.052+0000 7f8f80e16700 1 --2- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f7c131d70 0x7f8f7c1c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.052+0000 7f8f80e16700 1 --2- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f7c09e870 0x7f8f7c11d2c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.052+0000 7f8f80e16700 1 --2- 172.21.15.154:0/3411709841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f7c09f180 0x7f8f7c11d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.052+0000 7f8f80e16700 1 -- 172.21.15.154:0/3411709841 >> 172.21.15.154:0/3411709841 conn(0x7f8f7c0a4430 msgr2=0x7f8f7c1b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.052+0000 7f8f80e16700 1 -- 172.21.15.154:0/3411709841 shutdown_connections 2023-09-30T22:23:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.052+0000 7f8f80e16700 1 -- 172.21.15.154:0/3411709841 wait complete. 2023-09-30T22:23:23.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:23.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:23.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec778e5700 1 Processor -- start 2023-09-30T22:23:23.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec778e5700 1 -- start start 2023-09-30T22:23:23.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec778e5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec70133ad0 0x7fec70133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec778e5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec778e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec701309f0 0x7fec7013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec778e5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7006b2d0 con 0x7fec70133ad0 2023-09-30T22:23:23.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec778e5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec70133610 con 0x7fec701300a0 2023-09-30T22:23:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec778e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec7009a500 con 0x7fec701309f0 2023-09-30T22:23:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec74e80700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec75e82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec701309f0 0x7fec7013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec75681700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec70133ad0 0x7fec70133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec75681700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec70133ad0 0x7fec70133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46952/0 (socket says 172.21.15.154:46952) 2023-09-30T22:23:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec75e82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec701309f0 0x7fec7013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34904/0 (socket says 172.21.15.154:34904) 2023-09-30T22:23:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec74e80700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39920/0 (socket says 172.21.15.154:39920) 2023-09-30T22:23:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.805+0000 7fec75681700 1 -- 172.21.15.154:0/519478692 learned_addr learned my addr 172.21.15.154:0/519478692 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:23.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec74e80700 1 -- 172.21.15.154:0/519478692 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec701309f0 msgr2=0x7fec7013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:23.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec74e80700 1 --2- 172.21.15.154:0/519478692 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec701309f0 0x7fec7013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec74e80700 1 -- 172.21.15.154:0/519478692 >> v2:172.21.15.154:3300/0 conn(0x7fec70133ad0 msgr2=0x7fec70133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:23.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec74e80700 1 --2- 172.21.15.154:0/519478692 >> v2:172.21.15.154:3300/0 conn(0x7fec70133ad0 0x7fec70133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec74e80700 1 -- 172.21.15.154:0/519478692 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec701338b0 con 0x7fec701300a0 2023-09-30T22:23:23.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec75e82700 1 --2- 172.21.15.154:0/519478692 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec701309f0 0x7fec7013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:23.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec75681700 1 --2- 172.21.15.154:0/519478692 >> v2:172.21.15.154:3300/0 conn(0x7fec70133ad0 0x7fec70133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec74e80700 1 --2- 172.21.15.154:0/519478692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec701304b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009840 tx=0x7fec6c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d77932cc4e0ac220 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec67fff700 1 -- 172.21.15.154:0/519478692 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c011830 con 0x7fec701300a0 2023-09-30T22:23:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec67fff700 1 -- 172.21.15.154:0/519478692 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c011990 con 0x7fec701300a0 2023-09-30T22:23:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec67fff700 1 -- 172.21.15.154:0/519478692 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c011d20 con 0x7fec701300a0 2023-09-30T22:23:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec778e5700 1 -- 172.21.15.154:0/519478692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 msgr2=0x7fec701304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.806+0000 7fec778e5700 1 --2- 172.21.15.154:0/519478692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec701304b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009840 tx=0x7fec6c009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.807+0000 7fec778e5700 1 -- 172.21.15.154:0/519478692 shutdown_connections 2023-09-30T22:23:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.807+0000 7fec778e5700 1 --2- 172.21.15.154:0/519478692 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec701309f0 0x7fec7013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.807+0000 7fec778e5700 1 --2- 172.21.15.154:0/519478692 >> v2:172.21.15.154:3300/0 conn(0x7fec70133ad0 0x7fec70133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.807+0000 7fec778e5700 1 --2- 172.21.15.154:0/519478692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec701304b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.807+0000 7fec778e5700 1 -- 172.21.15.154:0/519478692 >> 172.21.15.154:0/519478692 conn(0x7fec70099c40 msgr2=0x7fec700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.807+0000 7fec778e5700 1 -- 172.21.15.154:0/519478692 shutdown_connections 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.807+0000 7fec778e5700 1 -- 172.21.15.154:0/519478692 wait complete. 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.807+0000 7fec778e5700 1 Processor -- start 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec778e5700 1 -- start start 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec778e5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec7011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec778e5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec701309f0 0x7fec7011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec778e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec70133ad0 0x7fec7011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec778e5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec700720e0 con 0x7fec701309f0 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec778e5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7011fa40 con 0x7fec701300a0 2023-09-30T22:23:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec778e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec7012dd00 con 0x7fec70133ad0 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75681700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec7011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75681700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec7011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39936/0 (socket says 172.21.15.154:39936) 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75681700 1 -- 172.21.15.154:0/1329819035 learned_addr learned my addr 172.21.15.154:0/1329819035 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75e82700 1 --2- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec70133ad0 0x7fec7011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec74e80700 1 --2- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec701309f0 0x7fec7011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75681700 1 -- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec70133ad0 msgr2=0x7fec7011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75681700 1 --2- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec70133ad0 0x7fec7011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75681700 1 -- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec701309f0 msgr2=0x7fec7011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75681700 1 --2- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec701309f0 0x7fec7011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75681700 1 -- 172.21.15.154:0/1329819035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68009a70 con 0x7fec701300a0 2023-09-30T22:23:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.808+0000 7fec75681700 1 --2- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec7011da40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fec6000ebe0 tx=0x7fec6000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:23.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.809+0000 7fec65ffb700 1 -- 172.21.15.154:0/1329819035 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6000c850 con 0x7fec701300a0 2023-09-30T22:23:23.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.809+0000 7fec65ffb700 1 -- 172.21.15.154:0/1329819035 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6000c9b0 con 0x7fec701300a0 2023-09-30T22:23:23.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.809+0000 7fec778e5700 1 -- 172.21.15.154:0/1329819035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec60009550 con 0x7fec701300a0 2023-09-30T22:23:23.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.809+0000 7fec65ffb700 1 -- 172.21.15.154:0/1329819035 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6000cd20 con 0x7fec701300a0 2023-09-30T22:23:23.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.809+0000 7fec778e5700 1 -- 172.21.15.154:0/1329819035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c0094a0 con 0x7fec701300a0 2023-09-30T22:23:23.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.809+0000 7fec65ffb700 1 -- 172.21.15.154:0/1329819035 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec60013470 con 0x7fec701300a0 2023-09-30T22:23:23.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.810+0000 7fec65ffb700 1 -- 172.21.15.154:0/1329819035 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec6003fac0 con 0x7fec701300a0 2023-09-30T22:23:23.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.810+0000 7fec778e5700 1 -- 172.21.15.154:0/1329819035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7004f2a0 con 0x7fec701300a0 2023-09-30T22:23:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:23.814+0000 7fec65ffb700 1 -- 172.21.15.154:0/1329819035 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec6001b3b0 con 0x7fec701300a0 2023-09-30T22:23:23.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:24.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.004+0000 7fec778e5700 1 -- 172.21.15.154:0/1329819035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec7006c3b0 con 0x7fec701300a0 2023-09-30T22:23:24.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.005+0000 7fec65ffb700 1 -- 172.21.15.154:0/1329819035 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec60017020 con 0x7fec701300a0 2023-09-30T22:23:24.006 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:24.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.007+0000 7fec778e5700 1 -- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 msgr2=0x7fec7011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.007+0000 7fec778e5700 1 --2- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec7011da40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fec6000ebe0 tx=0x7fec6000eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.007+0000 7fec778e5700 1 -- 172.21.15.154:0/1329819035 shutdown_connections 2023-09-30T22:23:24.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.007+0000 7fec778e5700 1 --2- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec70133ad0 0x7fec7011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.007+0000 7fec778e5700 1 --2- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec701300a0 0x7fec7011da40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.007+0000 7fec778e5700 1 --2- 172.21.15.154:0/1329819035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec701309f0 0x7fec7011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.007+0000 7fec778e5700 1 -- 172.21.15.154:0/1329819035 >> 172.21.15.154:0/1329819035 conn(0x7fec70099c40 msgr2=0x7fec7012e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.007+0000 7fec778e5700 1 -- 172.21.15.154:0/1329819035 shutdown_connections 2023-09-30T22:23:24.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.007+0000 7fec778e5700 1 -- 172.21.15.154:0/1329819035 wait complete. 2023-09-30T22:23:24.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:24.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:24.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.092+0000 7f17ef318700 1 Processor -- start 2023-09-30T22:23:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.092+0000 7f17ef318700 1 -- start start 2023-09-30T22:23:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.093+0000 7f17ef318700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 0x7f17e8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.093+0000 7f17ef318700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17e80a08e0 0x7f17e80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.093+0000 7f17ef318700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e81379e0 con 0x7f17e80a1230 2023-09-30T22:23:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.093+0000 7f17ef318700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e80a2100 con 0x7f17e80a08e0 2023-09-30T22:23:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.093+0000 7f17ef318700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8138950 con 0x7f17e8138040 2023-09-30T22:23:24.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.093+0000 7f17ec8b3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17e80a08e0 0x7f17e80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.093+0000 7f17ec8b3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17e80a08e0 0x7f17e80a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46962/0 (socket says 172.21.15.154:46962) 2023-09-30T22:23:24.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.093+0000 7f17ec8b3700 1 -- 172.21.15.154:0/1284718620 learned_addr learned my addr 172.21.15.154:0/1284718620 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:24.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.093+0000 7f17ed0b4700 1 --2- 172.21.15.154:0/1284718620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 0x7f17e8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.094+0000 7f17ed0b4700 1 -- 172.21.15.154:0/1284718620 >> v2:172.21.15.154:3300/0 conn(0x7f17e80a08e0 msgr2=0x7f17e80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.094+0000 7f17ed0b4700 1 --2- 172.21.15.154:0/1284718620 >> v2:172.21.15.154:3300/0 conn(0x7f17e80a08e0 0x7f17e80a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.094+0000 7f17ed0b4700 1 -- 172.21.15.154:0/1284718620 >> v1:172.21.15.154:6789/0 conn(0x7f17e80a1230 legacy=0x7f17e813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.094+0000 7f17ed0b4700 1 -- 172.21.15.154:0/1284718620 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e809b9b0 con 0x7f17e8138040 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.094+0000 7f17ec8b3700 1 --2- 172.21.15.154:0/1284718620 >> v2:172.21.15.154:3300/0 conn(0x7f17e80a08e0 0x7f17e80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.094+0000 7f17ed0b4700 1 --2- 172.21.15.154:0/1284718620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 0x7f17e8138410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009850 tx=0x7f17e4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2efee7c306487adf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.094+0000 7f17dffff700 1 -- 172.21.15.154:0/1284718620 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4005e30 con 0x7f17e8138040 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.094+0000 7f17dffff700 1 -- 172.21.15.154:0/1284718620 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e4006030 con 0x7f17e8138040 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.094+0000 7f17dffff700 1 -- 172.21.15.154:0/1284718620 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e40063c0 con 0x7f17e8138040 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.095+0000 7f17ef318700 1 -- 172.21.15.154:0/1284718620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 msgr2=0x7f17e8138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.095+0000 7f17ef318700 1 --2- 172.21.15.154:0/1284718620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 0x7f17e8138410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009850 tx=0x7f17e4009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.095+0000 7f17ef318700 1 -- 172.21.15.154:0/1284718620 shutdown_connections 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.095+0000 7f17ef318700 1 --2- 172.21.15.154:0/1284718620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 0x7f17e8138410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.095+0000 7f17ef318700 1 --2- 172.21.15.154:0/1284718620 >> v2:172.21.15.154:3300/0 conn(0x7f17e80a08e0 0x7f17e80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.095+0000 7f17ef318700 1 -- 172.21.15.154:0/1284718620 >> 172.21.15.154:0/1284718620 conn(0x7f17e80a2980 msgr2=0x7f17e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.095+0000 7f17ef318700 1 -- 172.21.15.154:0/1284718620 shutdown_connections 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.095+0000 7f17ef318700 1 -- 172.21.15.154:0/1284718620 wait complete. 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ef318700 1 Processor -- start 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ef318700 1 -- start start 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ef318700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17e80a08e0 0x7f17e81265c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ef318700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e80a1230 0x7f17e8126b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ef318700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 0x7f17e8127040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ef318700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e81374d0 con 0x7f17e80a08e0 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ef318700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8137110 con 0x7f17e80a1230 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ef318700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17e809a240 con 0x7f17e8138040 2023-09-30T22:23:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ec8b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e80a1230 0x7f17e8126b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ec8b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e80a1230 0x7f17e8126b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39938/0 (socket says 172.21.15.154:39938) 2023-09-30T22:23:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ec8b3700 1 -- 172.21.15.154:0/2612594135 learned_addr learned my addr 172.21.15.154:0/2612594135 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.096+0000 7f17ed8b5700 1 --2- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 0x7f17e8127040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ec8b3700 1 -- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 msgr2=0x7f17e8127040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ec8b3700 1 --2- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 0x7f17e8127040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ec8b3700 1 -- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17e80a08e0 msgr2=0x7f17e81265c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ec8b3700 1 --2- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17e80a08e0 0x7f17e81265c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ec8b3700 1 -- 172.21.15.154:0/2612594135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8009550 con 0x7f17e80a1230 2023-09-30T22:23:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ec8b3700 1 --2- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e80a1230 0x7f17e8126b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e990 tx=0x7f17d800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ddffb700 1 -- 172.21.15.154:0/2612594135 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800eee0 con 0x7f17e80a1230 2023-09-30T22:23:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ddffb700 1 -- 172.21.15.154:0/2612594135 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d800c850 con 0x7f17e80a1230 2023-09-30T22:23:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ddffb700 1 -- 172.21.15.154:0/2612594135 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800cc00 con 0x7f17e80a1230 2023-09-30T22:23:24.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.097+0000 7f17ef318700 1 -- 172.21.15.154:0/2612594135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e4009430 con 0x7f17e80a1230 2023-09-30T22:23:24.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.098+0000 7f17ef318700 1 -- 172.21.15.154:0/2612594135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e809ca90 con 0x7f17e80a1230 2023-09-30T22:23:24.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.098+0000 7f17ddffb700 1 -- 172.21.15.154:0/2612594135 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17d8013470 con 0x7f17e80a1230 2023-09-30T22:23:24.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.098+0000 7f17ddffb700 1 -- 172.21.15.154:0/2612594135 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f17d803f7e0 con 0x7f17e80a1230 2023-09-30T22:23:24.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.100+0000 7f17ef318700 1 -- 172.21.15.154:0/2612594135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e804f2a0 con 0x7f17e80a1230 2023-09-30T22:23:24.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.104+0000 7f17ddffb700 1 -- 172.21.15.154:0/2612594135 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17d8013720 con 0x7f17e80a1230 2023-09-30T22:23:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.143+0000 7f25bb6cc700 1 Processor -- start 2023-09-30T22:23:24.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.143+0000 7f25bb6cc700 1 -- start start 2023-09-30T22:23:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.143+0000 7f25bb6cc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25bb6cc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b4131ec0 0x7f25b4139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25bb6cc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b409da80 con 0x7f25b406b080 2023-09-30T22:23:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25bb6cc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b409dce0 con 0x7f25b406a770 2023-09-30T22:23:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25bb6cc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25b409eb20 con 0x7f25b4131ec0 2023-09-30T22:23:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25b9468700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25b8c67700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f25b406b080 0x7f25b41317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39946/0 (socket says 172.21.15.154:39946) 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25b8c67700 1 -- 172.21.15.154:0/1805108093 learned_addr learned my addr 172.21.15.154:0/1805108093 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25b9c69700 1 --2- 172.21.15.154:0/1805108093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b4131ec0 0x7f25b4139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25b9468700 1 -- 172.21.15.154:0/1805108093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b4131ec0 msgr2=0x7f25b4139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25abfff700 1 -- 172.21.15.154:0/1805108093 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769483406 0 0) 0x7f25b409da80 con 0x7f25b406b080 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25b9468700 1 --2- 172.21.15.154:0/1805108093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b4131ec0 0x7f25b4139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25b9468700 1 -- 172.21.15.154:0/1805108093 >> v1:172.21.15.154:6789/0 conn(0x7f25b406b080 legacy=0x7f25b41317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25b9468700 1 -- 172.21.15.154:0/1805108093 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b409d860 con 0x7f25b406a770 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25b9468700 1 --2- 172.21.15.154:0/1805108093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b406ab40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009870 tx=0x7f25b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a13ed415c2b3014d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25abfff700 1 -- 172.21.15.154:0/1805108093 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0011830 con 0x7f25b406a770 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25abfff700 1 -- 172.21.15.154:0/1805108093 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0011990 con 0x7f25b406a770 2023-09-30T22:23:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.144+0000 7f25abfff700 1 -- 172.21.15.154:0/1805108093 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0011d20 con 0x7f25b406a770 2023-09-30T22:23:24.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.145+0000 7f25bb6cc700 1 -- 172.21.15.154:0/1805108093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 msgr2=0x7f25b406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.145+0000 7f25bb6cc700 1 --2- 172.21.15.154:0/1805108093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b406ab40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009870 tx=0x7f25b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:24.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.145+0000 7f25bb6cc700 1 -- 172.21.15.154:0/1805108093 shutdown_connections 2023-09-30T22:23:24.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.145+0000 7f25bb6cc700 1 --2- 172.21.15.154:0/1805108093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b4131ec0 0x7f25b4139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.145+0000 7f25bb6cc700 1 --2- 172.21.15.154:0/1805108093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b406ab40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.145+0000 7f25bb6cc700 1 -- 172.21.15.154:0/1805108093 >> 172.21.15.154:0/1805108093 conn(0x7f25b4099c40 msgr2=0x7f25b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.145+0000 7f25bb6cc700 1 -- 172.21.15.154:0/1805108093 shutdown_connections 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.145+0000 7f25bb6cc700 1 -- 172.21.15.154:0/1805108093 wait complete. 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.146+0000 7f25bb6cc700 1 Processor -- start 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.146+0000 7f25bb6cc700 1 -- start start 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25bb6cc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b409ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25bb6cc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b406b080 0x7f25b409b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25bb6cc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b4131ec0 0x7f25b41c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25bb6cc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4131880 con 0x7f25b4131ec0 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25bb6cc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4071ec0 con 0x7f25b406a770 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25bb6cc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4131450 con 0x7f25b406b080 2023-09-30T22:23:24.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9468700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b409ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b8c67700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b406b080 0x7f25b409b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9468700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b409ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39956/0 (socket says 172.21.15.154:39956) 2023-09-30T22:23:24.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9468700 1 -- 172.21.15.154:0/166471711 learned_addr learned my addr 172.21.15.154:0/166471711 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:24.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9c69700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b4131ec0 0x7f25b41c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9c69700 1 -- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b406b080 msgr2=0x7f25b409b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9c69700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b406b080 0x7f25b409b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9c69700 1 -- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 msgr2=0x7f25b409ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9c69700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b409ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9c69700 1 -- 172.21.15.154:0/166471711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b00094a0 con 0x7f25b4131ec0 2023-09-30T22:23:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b9468700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b409ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.147+0000 7f25b8c67700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b406b080 0x7f25b409b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.148+0000 7f25b9c69700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b4131ec0 0x7f25b41c82b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009d90 tx=0x7f25ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.148+0000 7f25a9ffb700 1 -- 172.21.15.154:0/166471711 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac009c00 con 0x7f25b4131ec0 2023-09-30T22:23:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.148+0000 7f25a9ffb700 1 -- 172.21.15.154:0/166471711 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac00f040 con 0x7f25b4131ec0 2023-09-30T22:23:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.148+0000 7f25bb6cc700 1 -- 172.21.15.154:0/166471711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b4131620 con 0x7f25b4131ec0 2023-09-30T22:23:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.148+0000 7f25a9ffb700 1 -- 172.21.15.154:0/166471711 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac014480 con 0x7f25b4131ec0 2023-09-30T22:23:24.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.148+0000 7f25bb6cc700 1 -- 172.21.15.154:0/166471711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b4122320 con 0x7f25b4131ec0 2023-09-30T22:23:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.149+0000 7f25a9ffb700 1 -- 172.21.15.154:0/166471711 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25ac0145e0 con 0x7f25b4131ec0 2023-09-30T22:23:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.149+0000 7f25bb6cc700 1 -- 172.21.15.154:0/166471711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b40a2220 con 0x7f25b4131ec0 2023-09-30T22:23:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.149+0000 7f25a9ffb700 1 -- 172.21.15.154:0/166471711 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25ac0402b0 con 0x7f25b4131ec0 2023-09-30T22:23:24.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.158+0000 7f25a9ffb700 1 -- 172.21.15.154:0/166471711 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25ac007510 con 0x7f25b4131ec0 2023-09-30T22:23:24.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.208+0000 7fcd848a9700 1 Processor -- start 2023-09-30T22:23:24.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.208+0000 7fcd848a9700 1 -- start start 2023-09-30T22:23:24.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd848a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd848a9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd848a9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8009dc00 con 0x7fcd80133f50 2023-09-30T22:23:24.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd848a9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8009ea60 con 0x7fcd800a1380 2023-09-30T22:23:24.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd848a9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8009dec0 con 0x7fcd800a0a70 2023-09-30T22:23:24.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd7e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd7e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd800a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34942/0 (socket says 172.21.15.154:34942) 2023-09-30T22:23:24.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd7e59c700 1 -- 172.21.15.154:0/1069594853 learned_addr learned my addr 172.21.15.154:0/1069594853 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:24.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd7dd9b700 1 --2- 172.21.15.154:0/1069594853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd7dd9b700 1 -- 172.21.15.154:0/1069594853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 msgr2=0x7fcd800a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:24.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd7dd9b700 1 --2- 172.21.15.154:0/1069594853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd800a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd7dd9b700 1 -- 172.21.15.154:0/1069594853 >> v1:172.21.15.154:6789/0 conn(0x7fcd80133f50 legacy=0x7fcd8013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd7dd9b700 1 -- 172.21.15.154:0/1069594853 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8009e6a0 con 0x7fcd800a1380 2023-09-30T22:23:24.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.209+0000 7fcd7dd9b700 1 --2- 172.21.15.154:0/1069594853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80133a10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009870 tx=0x7fcd74009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=739af338b542384e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.212+0000 7fcd7d59a700 1 -- 172.21.15.154:0/1069594853 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74011830 con 0x7fcd800a1380 2023-09-30T22:23:24.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.212+0000 7fcd7d59a700 1 -- 172.21.15.154:0/1069594853 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd74011990 con 0x7fcd800a1380 2023-09-30T22:23:24.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.212+0000 7fcd7d59a700 1 -- 172.21.15.154:0/1069594853 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74011d20 con 0x7fcd800a1380 2023-09-30T22:23:24.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.212+0000 7fcd848a9700 1 -- 172.21.15.154:0/1069594853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 msgr2=0x7fcd80133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.212+0000 7fcd848a9700 1 --2- 172.21.15.154:0/1069594853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80133a10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009870 tx=0x7fcd74009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:24.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.213+0000 7fcd848a9700 1 -- 172.21.15.154:0/1069594853 shutdown_connections 2023-09-30T22:23:24.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.213+0000 7fcd848a9700 1 --2- 172.21.15.154:0/1069594853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd800a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.213+0000 7fcd848a9700 1 --2- 172.21.15.154:0/1069594853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80133a10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.213+0000 7fcd848a9700 1 -- 172.21.15.154:0/1069594853 >> 172.21.15.154:0/1069594853 conn(0x7fcd800a6610 msgr2=0x7fcd800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.213+0000 7fcd848a9700 1 -- 172.21.15.154:0/1069594853 shutdown_connections 2023-09-30T22:23:24.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.213+0000 7fcd848a9700 1 -- 172.21.15.154:0/1069594853 wait complete. 2023-09-30T22:23:24.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd848a9700 1 Processor -- start 2023-09-30T22:23:24.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd848a9700 1 -- start start 2023-09-30T22:23:24.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd848a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd801233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd848a9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80123910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd848a9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd80133f50 0x7fcd801c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd848a9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd80124670 con 0x7fcd80133f50 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd848a9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd80125fe0 con 0x7fcd800a1380 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd848a9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd80133aa0 con 0x7fcd800a0a70 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd7e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd801233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd7dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80123910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd7dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80123910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:39980/0 (socket says 172.21.15.154:39980) 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd7e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd801233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34950/0 (socket says 172.21.15.154:34950) 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd7dd9b700 1 -- 172.21.15.154:0/3836440492 learned_addr learned my addr 172.21.15.154:0/3836440492 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.214+0000 7fcd7ed9d700 1 --2- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd80133f50 0x7fcd801c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd7e59c700 1 -- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 msgr2=0x7fcd80123910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd7e59c700 1 --2- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80123910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd7e59c700 1 -- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd80133f50 msgr2=0x7fcd801c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd7e59c700 1 --2- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd80133f50 0x7fcd801c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd7e59c700 1 -- 172.21.15.154:0/3836440492 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd740094a0 con 0x7fcd800a0a70 2023-09-30T22:23:24.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd7ed9d700 1 --2- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd80133f50 0x7fcd801c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:24.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd7e59c700 1 --2- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd801233d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000e8e0 tx=0x7fcd7000ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:24.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd6effd700 1 -- 172.21.15.154:0/3836440492 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70013680 con 0x7fcd800a0a70 2023-09-30T22:23:24.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd6effd700 1 -- 172.21.15.154:0/3836440492 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd700137e0 con 0x7fcd800a0a70 2023-09-30T22:23:24.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd6effd700 1 -- 172.21.15.154:0/3836440492 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70013b70 con 0x7fcd800a0a70 2023-09-30T22:23:24.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd848a9700 1 -- 172.21.15.154:0/3836440492 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd800a03e0 con 0x7fcd800a0a70 2023-09-30T22:23:24.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.215+0000 7fcd848a9700 1 -- 172.21.15.154:0/3836440492 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd80122fd0 con 0x7fcd800a0a70 2023-09-30T22:23:24.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.216+0000 7fcd6effd700 1 -- 172.21.15.154:0/3836440492 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd70013cd0 con 0x7fcd800a0a70 2023-09-30T22:23:24.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.216+0000 7fcd6effd700 1 -- 172.21.15.154:0/3836440492 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd7003f610 con 0x7fcd800a0a70 2023-09-30T22:23:24.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.216+0000 7fcd848a9700 1 -- 172.21.15.154:0/3836440492 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd801253a0 con 0x7fcd800a0a70 2023-09-30T22:23:24.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.226+0000 7fcd6effd700 1 -- 172.21.15.154:0/3836440492 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd70017080 con 0x7fcd800a0a70 2023-09-30T22:23:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.320+0000 7f17ef318700 1 -- 172.21.15.154:0/2612594135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f17e809f140 con 0x7f17e80a1230 2023-09-30T22:23:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.320+0000 7f17ddffb700 1 -- 172.21.15.154:0/2612594135 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17d8021030 con 0x7f17e80a1230 2023-09-30T22:23:24.321 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.323+0000 7f17ef318700 1 -- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e80a1230 msgr2=0x7f17e8126b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.323+0000 7f17ef318700 1 --2- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e80a1230 0x7f17e8126b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e990 tx=0x7f17d800eca0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.323+0000 7f17ef318700 1 -- 172.21.15.154:0/2612594135 shutdown_connections 2023-09-30T22:23:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.323+0000 7f17ef318700 1 --2- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f17e8138040 0x7f17e8127040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.323+0000 7f17ef318700 1 --2- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17e80a08e0 0x7f17e81265c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.323+0000 7f17ef318700 1 --2- 172.21.15.154:0/2612594135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e80a1230 0x7f17e8126b00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.323+0000 7f17ef318700 1 -- 172.21.15.154:0/2612594135 >> 172.21.15.154:0/2612594135 conn(0x7f17e80a2980 msgr2=0x7f17e809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.323+0000 7f17ef318700 1 -- 172.21.15.154:0/2612594135 shutdown_connections 2023-09-30T22:23:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.323+0000 7f17ef318700 1 -- 172.21.15.154:0/2612594135 wait complete. 2023-09-30T22:23:24.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:24.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.359+0000 7f25bb6cc700 1 -- 172.21.15.154:0/166471711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25b404f2a0 con 0x7f25b4131ec0 2023-09-30T22:23:24.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.359+0000 7f25a9ffb700 1 -- 172.21.15.154:0/166471711 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25ac007330 con 0x7f25b4131ec0 2023-09-30T22:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:24.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.362+0000 7f25bb6cc700 1 -- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b4131ec0 msgr2=0x7f25b41c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.362+0000 7f25bb6cc700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b4131ec0 0x7f25b41c82b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009d90 tx=0x7f25ac00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.362+0000 7f25bb6cc700 1 -- 172.21.15.154:0/166471711 shutdown_connections 2023-09-30T22:23:24.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.362+0000 7f25bb6cc700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b4131ec0 0x7f25b41c82b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.362+0000 7f25bb6cc700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25b406a770 0x7f25b409ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.362+0000 7f25bb6cc700 1 --2- 172.21.15.154:0/166471711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25b406b080 0x7f25b409b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.362+0000 7f25bb6cc700 1 -- 172.21.15.154:0/166471711 >> 172.21.15.154:0/166471711 conn(0x7f25b4099c40 msgr2=0x7f25b41b9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.362+0000 7f25bb6cc700 1 -- 172.21.15.154:0/166471711 shutdown_connections 2023-09-30T22:23:24.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.363+0000 7f25bb6cc700 1 -- 172.21.15.154:0/166471711 wait complete. 2023-09-30T22:23:24.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:24.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.425+0000 7fcd848a9700 1 -- 172.21.15.154:0/3836440492 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd80126450 con 0x7fcd800a0a70 2023-09-30T22:23:24.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.425+0000 7fcd6effd700 1 -- 172.21.15.154:0/3836440492 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd80126450 con 0x7fcd800a0a70 2023-09-30T22:23:24.426 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:24.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.427+0000 7fcd848a9700 1 -- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 msgr2=0x7fcd801233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:24.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.427+0000 7fcd848a9700 1 --2- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd801233d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000e8e0 tx=0x7fcd7000ebf0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.427+0000 7fcd848a9700 1 -- 172.21.15.154:0/3836440492 shutdown_connections 2023-09-30T22:23:24.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.427+0000 7fcd848a9700 1 --2- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd80133f50 0x7fcd801c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.427+0000 7fcd848a9700 1 --2- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd800a0a70 0x7fcd801233d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.427+0000 7fcd848a9700 1 --2- 172.21.15.154:0/3836440492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd800a1380 0x7fcd80123910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.427+0000 7fcd848a9700 1 -- 172.21.15.154:0/3836440492 >> 172.21.15.154:0/3836440492 conn(0x7fcd800a6610 msgr2=0x7fcd800a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.427+0000 7fcd848a9700 1 -- 172.21.15.154:0/3836440492 shutdown_connections 2023-09-30T22:23:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:24.427+0000 7fcd848a9700 1 -- 172.21.15.154:0/3836440492 wait complete. 2023-09-30T22:23:24.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:25.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:25.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.153+0000 7fb4175ad700 1 Processor -- start 2023-09-30T22:23:25.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.153+0000 7fb4175ad700 1 -- start start 2023-09-30T22:23:25.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.153+0000 7fb4175ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb410133900 0x7fb410133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.153+0000 7fb4175ad700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb410134210 0x7fb4100a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.153+0000 7fb4175ad700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41009a760 con 0x7fb4100a0ee0 2023-09-30T22:23:25.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.153+0000 7fb4175ad700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4101336e0 con 0x7fb410134210 2023-09-30T22:23:25.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.153+0000 7fb4175ad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb41009a080 con 0x7fb410133900 2023-09-30T22:23:25.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb415349700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb410133900 0x7fb410133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb414b48700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb410134210 0x7fb4100a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb415349700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb410133900 0x7fb410133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34960/0 (socket says 172.21.15.154:34960) 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb414b48700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb410134210 0x7fb4100a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46988/0 (socket says 172.21.15.154:46988) 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb415349700 1 -- 172.21.15.154:0/472456080 learned_addr learned my addr 172.21.15.154:0/472456080 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb414b48700 1 -- 172.21.15.154:0/472456080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb410133900 msgr2=0x7fb410133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb414b48700 1 --2- 172.21.15.154:0/472456080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb410133900 0x7fb410133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb414b48700 1 -- 172.21.15.154:0/472456080 >> v1:172.21.15.154:6789/0 conn(0x7fb4100a0ee0 legacy=0x7fb41013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb414b48700 1 -- 172.21.15.154:0/472456080 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4100a23e0 con 0x7fb410134210 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb415349700 1 --2- 172.21.15.154:0/472456080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb410133900 0x7fb410133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb414b48700 1 --2- 172.21.15.154:0/472456080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 0x7fb4100a09a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb400009840 tx=0x7fb400009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8f6392c1687772 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb407fff700 1 -- 172.21.15.154:0/472456080 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400011830 con 0x7fb410134210 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb407fff700 1 -- 172.21.15.154:0/472456080 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400011990 con 0x7fb410134210 2023-09-30T22:23:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.154+0000 7fb407fff700 1 -- 172.21.15.154:0/472456080 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400011d20 con 0x7fb410134210 2023-09-30T22:23:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.155+0000 7fb4175ad700 1 -- 172.21.15.154:0/472456080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 msgr2=0x7fb4100a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.155+0000 7fb4175ad700 1 --2- 172.21.15.154:0/472456080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 0x7fb4100a09a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb400009840 tx=0x7fb400009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.155+0000 7fb4175ad700 1 -- 172.21.15.154:0/472456080 shutdown_connections 2023-09-30T22:23:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.155+0000 7fb4175ad700 1 --2- 172.21.15.154:0/472456080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb410133900 0x7fb410133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.155+0000 7fb4175ad700 1 --2- 172.21.15.154:0/472456080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 0x7fb4100a09a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.155+0000 7fb4175ad700 1 -- 172.21.15.154:0/472456080 >> 172.21.15.154:0/472456080 conn(0x7fb4100a2980 msgr2=0x7fb4100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.155+0000 7fb4175ad700 1 -- 172.21.15.154:0/472456080 shutdown_connections 2023-09-30T22:23:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.155+0000 7fb4175ad700 1 -- 172.21.15.154:0/472456080 wait complete. 2023-09-30T22:23:25.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb4175ad700 1 Processor -- start 2023-09-30T22:23:25.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb4175ad700 1 -- start start 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb4175ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4100a0ee0 0x7fb41011d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb4175ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb410133900 0x7fb41011dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb4175ad700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 0x7fb41011e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb4175ad700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4101212e0 con 0x7fb410134210 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb4175ad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41011f9f0 con 0x7fb410133900 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb4175ad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4101206b0 con 0x7fb4100a0ee0 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb415349700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4100a0ee0 0x7fb41011d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb415349700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4100a0ee0 0x7fb41011d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34970/0 (socket says 172.21.15.154:34970) 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb414b48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb410133900 0x7fb41011dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb415349700 1 -- 172.21.15.154:0/3808295506 learned_addr learned my addr 172.21.15.154:0/3808295506 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.156+0000 7fb415b4a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 0x7fb41011e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb415b4a700 1 -- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4100a0ee0 msgr2=0x7fb41011d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb415b4a700 1 --2- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4100a0ee0 0x7fb41011d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb415b4a700 1 -- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb410133900 msgr2=0x7fb41011dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb415b4a700 1 --2- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb410133900 0x7fb41011dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb415b4a700 1 -- 172.21.15.154:0/3808295506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c009500 con 0x7fb410134210 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb415349700 1 --2- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4100a0ee0 0x7fb41011d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb415b4a700 1 --2- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 0x7fb41011e240 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb40800cbc0 tx=0x7fb40800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb405ffb700 1 -- 172.21.15.154:0/3808295506 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408003c00 con 0x7fb410134210 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb405ffb700 1 -- 172.21.15.154:0/3808295506 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408003d60 con 0x7fb410134210 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb405ffb700 1 -- 172.21.15.154:0/3808295506 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40800aa40 con 0x7fb410134210 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb4175ad700 1 -- 172.21.15.154:0/3808295506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4000094a0 con 0x7fb410134210 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.157+0000 7fb4175ad700 1 -- 172.21.15.154:0/3808295506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb410132ee0 con 0x7fb410134210 2023-09-30T22:23:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.158+0000 7fb405ffb700 1 -- 172.21.15.154:0/3808295506 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb40800aba0 con 0x7fb410134210 2023-09-30T22:23:25.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.158+0000 7fb405ffb700 1 -- 172.21.15.154:0/3808295506 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb40803f600 con 0x7fb410134210 2023-09-30T22:23:25.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.158+0000 7fb4175ad700 1 -- 172.21.15.154:0/3808295506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41011a590 con 0x7fb410134210 2023-09-30T22:23:25.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.163+0000 7fb405ffb700 1 -- 172.21.15.154:0/3808295506 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb408012420 con 0x7fb410134210 2023-09-30T22:23:25.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:25.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.352+0000 7fb4175ad700 1 -- 172.21.15.154:0/3808295506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb41004f2a0 con 0x7fb410134210 2023-09-30T22:23:25.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.353+0000 7fb405ffb700 1 -- 172.21.15.154:0/3808295506 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb408011380 con 0x7fb410134210 2023-09-30T22:23:25.354 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:25.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.355+0000 7fb4175ad700 1 -- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 msgr2=0x7fb41011e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.355+0000 7fb4175ad700 1 --2- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 0x7fb41011e240 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb40800cbc0 tx=0x7fb40800ced0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.355+0000 7fb4175ad700 1 -- 172.21.15.154:0/3808295506 shutdown_connections 2023-09-30T22:23:25.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.355+0000 7fb4175ad700 1 --2- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb410134210 0x7fb41011e240 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.355+0000 7fb4175ad700 1 --2- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4100a0ee0 0x7fb41011d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.355+0000 7fb4175ad700 1 --2- 172.21.15.154:0/3808295506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb410133900 0x7fb41011dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.355+0000 7fb4175ad700 1 -- 172.21.15.154:0/3808295506 >> 172.21.15.154:0/3808295506 conn(0x7fb4100a2980 msgr2=0x7fb4101bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:25.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.355+0000 7fb4175ad700 1 -- 172.21.15.154:0/3808295506 shutdown_connections 2023-09-30T22:23:25.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.355+0000 7fb4175ad700 1 -- 172.21.15.154:0/3808295506 wait complete. 2023-09-30T22:23:25.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:25.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:25.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:25.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.464+0000 7fe1ce530700 1 Processor -- start 2023-09-30T22:23:25.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.464+0000 7fe1ce530700 1 -- start start 2023-09-30T22:23:25.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1ce530700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1ce530700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1c806b080 0x7fe1c81317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1ce530700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c8131cf0 0x7fe1c8132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1ce530700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c809f770 con 0x7fe1c806b080 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1ce530700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c809dce0 con 0x7fe1c806a770 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1ce530700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c809da80 con 0x7fe1c8131cf0 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1c806b080 0x7fe1c81317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1c806b080 0x7fe1c81317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35938/0 (socket says 172.21.15.154:35938) 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c77fe700 1 -- 172.21.15.154:0/1232588297 learned_addr learned my addr 172.21.15.154:0/1232588297 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1ccacd700 1 --2- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c8131cf0 0x7fe1c8132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c77fe700 1 -- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c8131cf0 msgr2=0x7fe1c8132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c77fe700 1 --2- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c8131cf0 0x7fe1c8132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c77fe700 1 -- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 msgr2=0x7fe1c806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c77fe700 1 --2- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c77fe700 1 -- 172.21.15.154:0/1232588297 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c809eb20 con 0x7fe1c806b080 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.465+0000 7fe1c7fff700 1 --2- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1c77fe700 1 --2- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c806b080 0x7fe1c81317b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0098f0 tx=0x7fe1bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7052b2c0c99ce3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1c6ffd700 1 -- 172.21.15.154:0/1232588297 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc011830 con 0x7fe1c806b080 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1c6ffd700 1 -- 172.21.15.154:0/1232588297 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc011990 con 0x7fe1c806b080 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1c6ffd700 1 -- 172.21.15.154:0/1232588297 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc011d20 con 0x7fe1c806b080 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1ce530700 1 -- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c806b080 msgr2=0x7fe1c81317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1ce530700 1 --2- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c806b080 0x7fe1c81317b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0098f0 tx=0x7fe1bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1ce530700 1 -- 172.21.15.154:0/1232588297 shutdown_connections 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1ce530700 1 --2- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1ce530700 1 --2- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c8131cf0 0x7fe1c8132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.466+0000 7fe1ce530700 1 --2- 172.21.15.154:0/1232588297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c806b080 0x7fe1c81317b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.467+0000 7fe1ce530700 1 -- 172.21.15.154:0/1232588297 >> 172.21.15.154:0/1232588297 conn(0x7fe1c8099c40 msgr2=0x7fe1c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:25.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.467+0000 7fe1ce530700 1 -- 172.21.15.154:0/1232588297 shutdown_connections 2023-09-30T22:23:25.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.467+0000 7fe1ce530700 1 -- 172.21.15.154:0/1232588297 wait complete. 2023-09-30T22:23:25.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.467+0000 7fe1ce530700 1 Processor -- start 2023-09-30T22:23:25.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1ce530700 1 -- start start 2023-09-30T22:23:25.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1ce530700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c809aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1ce530700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c806b080 0x7fe1c809b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1ce530700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c8131cf0 0x7fe1c81c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1ce530700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8121280 con 0x7fe1c8131cf0 2023-09-30T22:23:25.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1ce530700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8071e10 con 0x7fe1c806a770 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1ce530700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8121460 con 0x7fe1c806b080 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1c7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c809aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1c7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c809aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34124/0 (socket says 172.21.15.154:34124) 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1c7fff700 1 -- 172.21.15.154:0/1621093264 learned_addr learned my addr 172.21.15.154:0/1621093264 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1c77fe700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c806b080 0x7fe1c809b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.468+0000 7fe1ccacd700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c8131cf0 0x7fe1c81c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1ccacd700 1 -- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c806b080 msgr2=0x7fe1c809b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1ccacd700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c806b080 0x7fe1c809b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1ccacd700 1 -- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 msgr2=0x7fe1c809aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1ccacd700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c809aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1ccacd700 1 -- 172.21.15.154:0/1621093264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc009550 con 0x7fe1c8131cf0 2023-09-30T22:23:25.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1c77fe700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c806b080 0x7fe1c809b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:25.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1ccacd700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c8131cf0 0x7fe1c81c80a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009d90 tx=0x7fe1c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:25.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1c4ff9700 1 -- 172.21.15.154:0/1621093264 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0009c00 con 0x7fe1c8131cf0 2023-09-30T22:23:25.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1c4ff9700 1 -- 172.21.15.154:0/1621093264 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c000f040 con 0x7fe1c8131cf0 2023-09-30T22:23:25.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1ce530700 1 -- 172.21.15.154:0/1621093264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c81302b0 con 0x7fe1c8131cf0 2023-09-30T22:23:25.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1c4ff9700 1 -- 172.21.15.154:0/1621093264 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0014480 con 0x7fe1c8131cf0 2023-09-30T22:23:25.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.469+0000 7fe1ce530700 1 -- 172.21.15.154:0/1621093264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c809a9a0 con 0x7fe1c8131cf0 2023-09-30T22:23:25.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.470+0000 7fe1c4ff9700 1 -- 172.21.15.154:0/1621093264 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1c00145e0 con 0x7fe1c8131cf0 2023-09-30T22:23:25.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.470+0000 7fe1c4ff9700 1 -- 172.21.15.154:0/1621093264 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe1c0040190 con 0x7fe1c8131cf0 2023-09-30T22:23:25.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.470+0000 7fe1ce530700 1 -- 172.21.15.154:0/1621093264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c8120e20 con 0x7fe1c8131cf0 2023-09-30T22:23:25.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.479+0000 7fe1c4ff9700 1 -- 172.21.15.154:0/1621093264 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1c0007920 con 0x7fe1c8131cf0 2023-09-30T22:23:25.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.571+0000 7f2f17cd4700 1 Processor -- start 2023-09-30T22:23:25.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f17cd4700 1 -- start start 2023-09-30T22:23:25.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f17cd4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2f1006a770 0x7f2f1006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f17cd4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f10131ec0 0x7f2f10139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f17cd4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1009da80 con 0x7f2f1006b080 2023-09-30T22:23:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f17cd4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1009dce0 con 0x7f2f1006a770 2023-09-30T22:23:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f17cd4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1009eb20 con 0x7f2f10131ec0 2023-09-30T22:23:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f15a70700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2f1006a770 0x7f2f1006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f15a70700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2f1006a770 0x7f2f1006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35956/0 (socket says 172.21.15.154:35956) 2023-09-30T22:23:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f15a70700 1 -- 172.21.15.154:0/2790349279 learned_addr learned my addr 172.21.15.154:0/2790349279 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f1526f700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2f1006b080 0x7f2f101317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52070/0 (socket says 172.21.15.154:52070) 2023-09-30T22:23:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.572+0000 7f2f16271700 1 --2- 172.21.15.154:0/2790349279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f10131ec0 0x7f2f10139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.573+0000 7f2f15a70700 1 -- 172.21.15.154:0/2790349279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f10131ec0 msgr2=0x7f2f10139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.573+0000 7f2f15a70700 1 --2- 172.21.15.154:0/2790349279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f10131ec0 0x7f2f10139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.573+0000 7f2f15a70700 1 -- 172.21.15.154:0/2790349279 >> v1:172.21.15.154:6789/0 conn(0x7f2f1006b080 legacy=0x7f2f101317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.573+0000 7f2f15a70700 1 -- 172.21.15.154:0/2790349279 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1009d860 con 0x7f2f1006a770 2023-09-30T22:23:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.573+0000 7f2f15a70700 1 --2- 172.21.15.154:0/2790349279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1006a770 0x7f2f1006ab40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0098f0 tx=0x7f2f0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e5a9979a2c46e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.573+0000 7f2f14a6e700 1 -- 172.21.15.154:0/2790349279 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c011830 con 0x7f2f1006a770 2023-09-30T22:23:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.573+0000 7f2f14a6e700 1 -- 172.21.15.154:0/2790349279 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c011990 con 0x7f2f1006a770 2023-09-30T22:23:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.573+0000 7f2f14a6e700 1 -- 172.21.15.154:0/2790349279 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c011d20 con 0x7f2f1006a770 2023-09-30T22:23:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.574+0000 7f2f17cd4700 1 -- 172.21.15.154:0/2790349279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1006a770 msgr2=0x7f2f1006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.574+0000 7f2f17cd4700 1 --2- 172.21.15.154:0/2790349279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1006a770 0x7f2f1006ab40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0098f0 tx=0x7f2f0c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.574+0000 7f2f17cd4700 1 -- 172.21.15.154:0/2790349279 shutdown_connections 2023-09-30T22:23:25.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.574+0000 7f2f17cd4700 1 --2- 172.21.15.154:0/2790349279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f10131ec0 0x7f2f10139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.574+0000 7f2f17cd4700 1 --2- 172.21.15.154:0/2790349279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f1006a770 0x7f2f1006ab40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.574+0000 7f2f17cd4700 1 -- 172.21.15.154:0/2790349279 >> 172.21.15.154:0/2790349279 conn(0x7f2f10099c40 msgr2=0x7f2f100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:25.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.574+0000 7f2f17cd4700 1 -- 172.21.15.154:0/2790349279 shutdown_connections 2023-09-30T22:23:25.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.574+0000 7f2f17cd4700 1 -- 172.21.15.154:0/2790349279 wait complete. 2023-09-30T22:23:25.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f17cd4700 1 Processor -- start 2023-09-30T22:23:25.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f17cd4700 1 -- start start 2023-09-30T22:23:25.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f17cd4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f1006a770 0x7f2f1011f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f17cd4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f1006b080 0x7f2f1011f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f17cd4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10131ec0 0x7f2f1011fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f17cd4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10120c20 con 0x7f2f10131ec0 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f17cd4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10121ab0 con 0x7f2f1006b080 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f17cd4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10122590 con 0x7f2f1006a770 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f15a70700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f1006a770 0x7f2f1011f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f15a70700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f1006a770 0x7f2f1011f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50908/0 (socket says 172.21.15.154:50908) 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f15a70700 1 -- 172.21.15.154:0/1269731465 learned_addr learned my addr 172.21.15.154:0/1269731465 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.575+0000 7f2f16271700 1 --2- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10131ec0 0x7f2f1011fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f15a70700 1 -- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f1006b080 msgr2=0x7f2f1011f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f15a70700 1 --2- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f1006b080 0x7f2f1011f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f15a70700 1 -- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10131ec0 msgr2=0x7f2f1011fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f15a70700 1 --2- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10131ec0 0x7f2f1011fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f15a70700 1 -- 172.21.15.154:0/1269731465 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c009550 con 0x7f2f1006a770 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f15a70700 1 --2- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f1006a770 0x7f2f1011f060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009c40 tx=0x7f2f0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f067fc700 1 -- 172.21.15.154:0/1269731465 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0045d0 con 0x7f2f1006a770 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f067fc700 1 -- 172.21.15.154:0/1269731465 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c0036a0 con 0x7f2f1006a770 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f067fc700 1 -- 172.21.15.154:0/1269731465 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c003a30 con 0x7f2f1006a770 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f17cd4700 1 -- 172.21.15.154:0/1269731465 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f10122850 con 0x7f2f1006a770 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.576+0000 7f2f17cd4700 1 -- 172.21.15.154:0/1269731465 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f10071e10 con 0x7f2f1006a770 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.577+0000 7f2f067fc700 1 -- 172.21.15.154:0/1269731465 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f0c021070 con 0x7f2f1006a770 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.577+0000 7f2f067fc700 1 -- 172.21.15.154:0/1269731465 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f0c040c40 con 0x7f2f1006a770 2023-09-30T22:23:25.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.577+0000 7f2f17cd4700 1 -- 172.21.15.154:0/1269731465 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1006be10 con 0x7f2f1006a770 2023-09-30T22:23:25.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.582+0000 7f2f067fc700 1 -- 172.21.15.154:0/1269731465 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f0c029020 con 0x7f2f1006a770 2023-09-30T22:23:25.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.584+0000 7ff3ae1bd700 1 Processor -- start 2023-09-30T22:23:25.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3ae1bd700 1 -- start start 2023-09-30T22:23:25.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3ae1bd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809d860 0x7ff3a809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3ae1bd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3ae1bd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a809aaa0 con 0x7ff3a809e170 2023-09-30T22:23:25.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3ae1bd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a809f870 con 0x7ff3a809d860 2023-09-30T22:23:25.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3ae1bd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a809b360 con 0x7ff3a8130eb0 2023-09-30T22:23:25.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3a7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3a7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a8138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50916/0 (socket says 172.21.15.154:50916) 2023-09-30T22:23:25.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3a7fff700 1 -- 172.21.15.154:0/2070136299 learned_addr learned my addr 172.21.15.154:0/2070136299 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:25.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3a77fe700 1 --2- 172.21.15.154:0/2070136299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809d860 0x7ff3a809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3a7fff700 1 -- 172.21.15.154:0/2070136299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809d860 msgr2=0x7ff3a809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:25.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3a7fff700 1 --2- 172.21.15.154:0/2070136299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809d860 0x7ff3a809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3a7fff700 1 -- 172.21.15.154:0/2070136299 >> v1:172.21.15.154:6789/0 conn(0x7ff3a809e170 legacy=0x7ff3a81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.585+0000 7ff3a7fff700 1 -- 172.21.15.154:0/2070136299 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a809b620 con 0x7ff3a8130eb0 2023-09-30T22:23:25.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3a7fff700 1 --2- 172.21.15.154:0/2070136299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a8138a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009e80 tx=0x7ff3a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d51b37408740452 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:25.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3a67fc700 1 -- 172.21.15.154:0/2070136299 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000e070 con 0x7ff3a8130eb0 2023-09-30T22:23:25.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3a67fc700 1 -- 172.21.15.154:0/2070136299 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a000b910 con 0x7ff3a8130eb0 2023-09-30T22:23:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3a67fc700 1 -- 172.21.15.154:0/2070136299 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000bcc0 con 0x7ff3a8130eb0 2023-09-30T22:23:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/2070136299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 msgr2=0x7ff3a8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3ae1bd700 1 --2- 172.21.15.154:0/2070136299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a8138a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009e80 tx=0x7ff3a000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/2070136299 shutdown_connections 2023-09-30T22:23:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3ae1bd700 1 --2- 172.21.15.154:0/2070136299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a8138a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3ae1bd700 1 --2- 172.21.15.154:0/2070136299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809d860 0x7ff3a809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.586+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/2070136299 >> 172.21.15.154:0/2070136299 conn(0x7ff3a8099c40 msgr2=0x7ff3a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.587+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/2070136299 shutdown_connections 2023-09-30T22:23:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.587+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/2070136299 wait complete. 2023-09-30T22:23:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.588+0000 7ff3ae1bd700 1 Processor -- start 2023-09-30T22:23:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.588+0000 7ff3ae1bd700 1 -- start start 2023-09-30T22:23:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.588+0000 7ff3ae1bd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a809d860 0x7ff3a81c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.588+0000 7ff3ae1bd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809e170 0x7ff3a81c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.588+0000 7ff3ae1bd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a81c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.588+0000 7ff3ae1bd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a8137990 con 0x7ff3a809d860 2023-09-30T22:23:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.588+0000 7ff3ae1bd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80a22b0 con 0x7ff3a809e170 2023-09-30T22:23:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.588+0000 7ff3ae1bd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a809c8b0 con 0x7ff3a8130eb0 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809e170 0x7ff3a81c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809e170 0x7ff3a81c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34156/0 (socket says 172.21.15.154:34156) 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a6ffd700 1 -- 172.21.15.154:0/3993135916 learned_addr learned my addr 172.21.15.154:0/3993135916 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a7fff700 1 --2- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a81c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a77fe700 1 --2- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a809d860 0x7ff3a81c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a6ffd700 1 -- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 msgr2=0x7ff3a81c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a6ffd700 1 --2- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a81c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a6ffd700 1 -- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a809d860 msgr2=0x7ff3a81c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a6ffd700 1 --2- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a809d860 0x7ff3a81c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a6ffd700 1 -- 172.21.15.154:0/3993135916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0009b30 con 0x7ff3a809e170 2023-09-30T22:23:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3a6ffd700 1 --2- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809e170 0x7ff3a81c65e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00c4b0 tx=0x7ff39c00c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff38ffff700 1 -- 172.21.15.154:0/3993135916 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0052d0 con 0x7ff3a809e170 2023-09-30T22:23:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/3993135916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a8138030 con 0x7ff3a809e170 2023-09-30T22:23:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff38ffff700 1 -- 172.21.15.154:0/3993135916 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c005430 con 0x7ff3a809e170 2023-09-30T22:23:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff38ffff700 1 -- 172.21.15.154:0/3993135916 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0038a0 con 0x7ff3a809e170 2023-09-30T22:23:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.589+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/3993135916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a8119a90 con 0x7ff3a809e170 2023-09-30T22:23:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.590+0000 7ff38ffff700 1 -- 172.21.15.154:0/3993135916 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff39c003a00 con 0x7ff3a809e170 2023-09-30T22:23:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.590+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/3993135916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a804f2a0 con 0x7ff3a809e170 2023-09-30T22:23:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.591+0000 7ff38ffff700 1 -- 172.21.15.154:0/3993135916 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff39c03ebb0 con 0x7ff3a809e170 2023-09-30T22:23:25.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.595+0000 7ff38ffff700 1 -- 172.21.15.154:0/3993135916 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff39c018260 con 0x7ff3a809e170 2023-09-30T22:23:25.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.722+0000 7fe1ce530700 1 -- 172.21.15.154:0/1621093264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe1c81210e0 con 0x7fe1c8131cf0 2023-09-30T22:23:25.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.722+0000 7fe1c4ff9700 1 -- 172.21.15.154:0/1621093264 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1c81210e0 con 0x7fe1c8131cf0 2023-09-30T22:23:25.723 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.724+0000 7fe1ce530700 1 -- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c8131cf0 msgr2=0x7fe1c81c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.724+0000 7fe1ce530700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c8131cf0 0x7fe1c81c80a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009d90 tx=0x7fe1c000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.724+0000 7fe1ce530700 1 -- 172.21.15.154:0/1621093264 shutdown_connections 2023-09-30T22:23:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.724+0000 7fe1ce530700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1c8131cf0 0x7fe1c81c80a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.724+0000 7fe1ce530700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1c806a770 0x7fe1c809aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.724+0000 7fe1ce530700 1 --2- 172.21.15.154:0/1621093264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1c806b080 0x7fe1c809b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.724+0000 7fe1ce530700 1 -- 172.21.15.154:0/1621093264 >> 172.21.15.154:0/1621093264 conn(0x7fe1c8099c40 msgr2=0x7fe1c80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.724+0000 7fe1ce530700 1 -- 172.21.15.154:0/1621093264 shutdown_connections 2023-09-30T22:23:25.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.724+0000 7fe1ce530700 1 -- 172.21.15.154:0/1621093264 wait complete. 2023-09-30T22:23:25.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:25.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.783+0000 7f2f17cd4700 1 -- 172.21.15.154:0/1269731465 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f101223e0 con 0x7f2f1006a770 2023-09-30T22:23:25.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.784+0000 7f2f067fc700 1 -- 172.21.15.154:0/1269731465 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f0c015070 con 0x7f2f1006a770 2023-09-30T22:23:25.785 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:25.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.786+0000 7f2f17cd4700 1 -- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f1006a770 msgr2=0x7f2f1011f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.786+0000 7f2f17cd4700 1 --2- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f1006a770 0x7f2f1011f060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009c40 tx=0x7f2f0c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:25.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.786+0000 7f2f17cd4700 1 -- 172.21.15.154:0/1269731465 shutdown_connections 2023-09-30T22:23:25.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.786+0000 7f2f17cd4700 1 --2- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f10131ec0 0x7f2f1011fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.786+0000 7f2f17cd4700 1 --2- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f1006a770 0x7f2f1011f060 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.786+0000 7f2f17cd4700 1 --2- 172.21.15.154:0/1269731465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f1006b080 0x7f2f1011f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.786+0000 7f2f17cd4700 1 -- 172.21.15.154:0/1269731465 >> 172.21.15.154:0/1269731465 conn(0x7f2f10099c40 msgr2=0x7f2f10130fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:25.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.786+0000 7f2f17cd4700 1 -- 172.21.15.154:0/1269731465 shutdown_connections 2023-09-30T22:23:25.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.786+0000 7f2f17cd4700 1 -- 172.21.15.154:0/1269731465 wait complete. 2023-09-30T22:23:25.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.789+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/3993135916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff3a8119870 con 0x7ff3a809e170 2023-09-30T22:23:25.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.789+0000 7ff38ffff700 1 -- 172.21.15.154:0/3993135916 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff39c017020 con 0x7ff3a809e170 2023-09-30T22:23:25.790 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:25.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.791+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809e170 msgr2=0x7ff3a81c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.791+0000 7ff3ae1bd700 1 --2- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809e170 0x7ff3a81c65e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00c4b0 tx=0x7ff39c00c7c0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.791+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/3993135916 shutdown_connections 2023-09-30T22:23:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.791+0000 7ff3ae1bd700 1 --2- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3a8130eb0 0x7ff3a81c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.791+0000 7ff3ae1bd700 1 --2- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3a809d860 0x7ff3a81c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.791+0000 7ff3ae1bd700 1 --2- 172.21.15.154:0/3993135916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3a809e170 0x7ff3a81c65e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.791+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/3993135916 >> 172.21.15.154:0/3993135916 conn(0x7ff3a8099c40 msgr2=0x7ff3a81396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.791+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/3993135916 shutdown_connections 2023-09-30T22:23:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:25.791+0000 7ff3ae1bd700 1 -- 172.21.15.154:0/3993135916 wait complete. 2023-09-30T22:23:25.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:25.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:26.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:26.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.495+0000 7f326269e700 1 Processor -- start 2023-09-30T22:23:26.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.495+0000 7f326269e700 1 -- start start 2023-09-30T22:23:26.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f326269e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c133ad0 0x7f325c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f326269e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f325c130bc0 0x7f325c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f326269e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c06b2d0 con 0x7f325c1300a0 2023-09-30T22:23:26.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f326269e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325c133610 con 0x7f325c130bc0 2023-09-30T22:23:26.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f326269e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c09a500 con 0x7f325c133ad0 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f325bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c133ad0 0x7f325c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f3260c3b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f325c130bc0 0x7f325c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f325bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c133ad0 0x7f325c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50934/0 (socket says 172.21.15.154:50934) 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f3260c3b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f325c130bc0 0x7f325c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35980/0 (socket says 172.21.15.154:35980) 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f325bfff700 1 -- 172.21.15.154:0/3836107797 learned_addr learned my addr 172.21.15.154:0/3836107797 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f3260c3b700 1 -- 172.21.15.154:0/3836107797 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c133ad0 msgr2=0x7f325c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f3260c3b700 1 --2- 172.21.15.154:0/3836107797 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c133ad0 0x7f325c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f3260c3b700 1 -- 172.21.15.154:0/3836107797 >> v1:172.21.15.154:6789/0 conn(0x7f325c1300a0 legacy=0x7f325c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f3260c3b700 1 -- 172.21.15.154:0/3836107797 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c1338b0 con 0x7f325c130bc0 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f325affd700 1 -- 172.21.15.154:0/3836107797 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708191998 0 0) 0x7f325c06b2d0 con 0x7f325c1300a0 2023-09-30T22:23:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f325bfff700 1 --2- 172.21.15.154:0/3836107797 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c133ad0 0x7f325c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f3260c3b700 1 --2- 172.21.15.154:0/3836107797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c130bc0 0x7f325c13b990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3254009d90 tx=0x7f325400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7834722095916270 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f325affd700 1 -- 172.21.15.154:0/3836107797 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400e070 con 0x7f325c130bc0 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f325affd700 1 -- 172.21.15.154:0/3836107797 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325400bb20 con 0x7f325c130bc0 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.496+0000 7f325affd700 1 -- 172.21.15.154:0/3836107797 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254012430 con 0x7f325c130bc0 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.497+0000 7f326269e700 1 -- 172.21.15.154:0/3836107797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c130bc0 msgr2=0x7f325c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.497+0000 7f326269e700 1 --2- 172.21.15.154:0/3836107797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c130bc0 0x7f325c13b990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3254009d90 tx=0x7f325400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.497+0000 7f326269e700 1 -- 172.21.15.154:0/3836107797 shutdown_connections 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.497+0000 7f326269e700 1 --2- 172.21.15.154:0/3836107797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c130bc0 0x7f325c13b990 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.497+0000 7f326269e700 1 --2- 172.21.15.154:0/3836107797 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c133ad0 0x7f325c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.497+0000 7f326269e700 1 -- 172.21.15.154:0/3836107797 >> 172.21.15.154:0/3836107797 conn(0x7f325c099c40 msgr2=0x7f325c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.497+0000 7f326269e700 1 -- 172.21.15.154:0/3836107797 shutdown_connections 2023-09-30T22:23:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.497+0000 7f326269e700 1 -- 172.21.15.154:0/3836107797 wait complete. 2023-09-30T22:23:26.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.498+0000 7f326269e700 1 Processor -- start 2023-09-30T22:23:26.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.498+0000 7f326269e700 1 -- start start 2023-09-30T22:23:26.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f326269e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c1300a0 0x7f325c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f326269e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c130bc0 0x7f325c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f326269e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f325c133ad0 0x7f325c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f326269e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c1208e0 con 0x7f325c1300a0 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f326269e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c11f9d0 con 0x7f325c133ad0 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f326269e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c120070 con 0x7f325c130bc0 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f325bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c1300a0 0x7f325c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f325b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c130bc0 0x7f325c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f325bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c1300a0 0x7f325c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35988/0 (socket says 172.21.15.154:35988) 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f325bfff700 1 -- 172.21.15.154:0/3420907708 learned_addr learned my addr 172.21.15.154:0/3420907708 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f3260c3b700 1 --2- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f325c133ad0 0x7f325c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f325b7fe700 1 -- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f325c133ad0 msgr2=0x7f325c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f325b7fe700 1 --2- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f325c133ad0 0x7f325c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f325b7fe700 1 -- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c1300a0 msgr2=0x7f325c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f325b7fe700 1 --2- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c1300a0 0x7f325c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.499+0000 7f325b7fe700 1 -- 172.21.15.154:0/3420907708 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3250009550 con 0x7f325c130bc0 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.500+0000 7f325b7fe700 1 --2- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c130bc0 0x7f325c11df80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f324c000f60 tx=0x7f324c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.500+0000 7f3258ff9700 1 -- 172.21.15.154:0/3420907708 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c0052d0 con 0x7f325c130bc0 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.500+0000 7f3258ff9700 1 -- 172.21.15.154:0/3420907708 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c005450 con 0x7f325c130bc0 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.500+0000 7f326269e700 1 -- 172.21.15.154:0/3420907708 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3254009a70 con 0x7f325c130bc0 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.500+0000 7f3258ff9700 1 -- 172.21.15.154:0/3420907708 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c0038c0 con 0x7f325c130bc0 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.500+0000 7f326269e700 1 -- 172.21.15.154:0/3420907708 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c12dd00 con 0x7f325c130bc0 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.501+0000 7f3258ff9700 1 -- 172.21.15.154:0/3420907708 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f324c003a20 con 0x7f325c130bc0 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.501+0000 7f3258ff9700 1 -- 172.21.15.154:0/3420907708 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f324c03e950 con 0x7f325c130bc0 2023-09-30T22:23:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.501+0000 7f326269e700 1 -- 172.21.15.154:0/3420907708 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c09cb20 con 0x7f325c130bc0 2023-09-30T22:23:26.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.505+0000 7f3258ff9700 1 -- 172.21.15.154:0/3420907708 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f324c017080 con 0x7f325c130bc0 2023-09-30T22:23:26.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.690+0000 7f326269e700 1 -- 172.21.15.154:0/3420907708 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f325c04f2a0 con 0x7f325c130bc0 2023-09-30T22:23:26.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.691+0000 7f3258ff9700 1 -- 172.21.15.154:0/3420907708 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f324c019d20 con 0x7f325c130bc0 2023-09-30T22:23:26.692 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:26.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.693+0000 7f326269e700 1 -- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c130bc0 msgr2=0x7f325c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.693+0000 7f326269e700 1 --2- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c130bc0 0x7f325c11df80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f324c000f60 tx=0x7f324c00c6a0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.693+0000 7f326269e700 1 -- 172.21.15.154:0/3420907708 shutdown_connections 2023-09-30T22:23:26.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.693+0000 7f326269e700 1 --2- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f325c133ad0 0x7f325c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.693+0000 7f326269e700 1 --2- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f325c1300a0 0x7f325c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.693+0000 7f326269e700 1 --2- 172.21.15.154:0/3420907708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f325c130bc0 0x7f325c11df80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.693+0000 7f326269e700 1 -- 172.21.15.154:0/3420907708 >> 172.21.15.154:0/3420907708 conn(0x7f325c099c40 msgr2=0x7f325c132950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.693+0000 7f326269e700 1 -- 172.21.15.154:0/3420907708 shutdown_connections 2023-09-30T22:23:26.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.693+0000 7f326269e700 1 -- 172.21.15.154:0/3420907708 wait complete. 2023-09-30T22:23:26.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:26.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:26.801 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:26.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:26.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.865+0000 7f6be3d8c700 1 Processor -- start 2023-09-30T22:23:26.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.865+0000 7f6be3d8c700 1 -- start start 2023-09-30T22:23:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.865+0000 7f6be3d8c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bdc09f350 0x7f6bdc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.865+0000 7f6be3d8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc1371c0 0x7f6bdc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.865+0000 7f6be3d8c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc09c970 con 0x7f6bdc09e870 2023-09-30T22:23:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.865+0000 7f6be3d8c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc0a0920 con 0x7f6bdc09f350 2023-09-30T22:23:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.865+0000 7f6be3d8c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc09f9c0 con 0x7f6bdc1371c0 2023-09-30T22:23:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be1b28700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6bdc09e870 0x7f6bdc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52092/0 (socket says 172.21.15.154:52092) 2023-09-30T22:23:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be1b28700 1 -- 172.21.15.154:0/3954650943 learned_addr learned my addr 172.21.15.154:0/3954650943 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be1327700 1 --2- 172.21.15.154:0/3954650943 >> v2:172.21.15.154:3300/0 conn(0x7f6bdc09f350 0x7f6bdc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be2329700 1 --2- 172.21.15.154:0/3954650943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc1371c0 0x7f6bdc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be0b26700 1 -- 172.21.15.154:0/3954650943 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235811801 0 0) 0x7f6bdc09c970 con 0x7f6bdc09e870 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be0b26700 1 -- 172.21.15.154:0/3954650943 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc80035b0 con 0x7f6bdc09e870 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be1327700 1 -- 172.21.15.154:0/3954650943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc1371c0 msgr2=0x7f6bdc1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be1327700 1 --2- 172.21.15.154:0/3954650943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc1371c0 0x7f6bdc1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be1327700 1 -- 172.21.15.154:0/3954650943 >> v1:172.21.15.154:6789/0 conn(0x7f6bdc09e870 legacy=0x7f6bdc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be1327700 1 -- 172.21.15.154:0/3954650943 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc09bab0 con 0x7f6bdc09f350 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be2329700 1 --2- 172.21.15.154:0/3954650943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc1371c0 0x7f6bdc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be1327700 1 --2- 172.21.15.154:0/3954650943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09f350 0x7f6bdc136c80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009840 tx=0x7f6bcc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5060046cde06678d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be0b26700 1 -- 172.21.15.154:0/3954650943 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc011830 con 0x7f6bdc09f350 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be0b26700 1 -- 172.21.15.154:0/3954650943 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc011990 con 0x7f6bdc09f350 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.866+0000 7f6be0b26700 1 -- 172.21.15.154:0/3954650943 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc011d20 con 0x7f6bdc09f350 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.867+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3954650943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09f350 msgr2=0x7f6bdc136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.867+0000 7f6be3d8c700 1 --2- 172.21.15.154:0/3954650943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09f350 0x7f6bdc136c80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009840 tx=0x7f6bcc009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.867+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3954650943 shutdown_connections 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.867+0000 7f6be3d8c700 1 --2- 172.21.15.154:0/3954650943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc1371c0 0x7f6bdc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.867+0000 7f6be3d8c700 1 --2- 172.21.15.154:0/3954650943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09f350 0x7f6bdc136c80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.867+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3954650943 >> 172.21.15.154:0/3954650943 conn(0x7f6bdc0a4430 msgr2=0x7f6bdc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.867+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3954650943 shutdown_connections 2023-09-30T22:23:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.867+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3954650943 wait complete. 2023-09-30T22:23:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.868+0000 7f6be3d8c700 1 Processor -- start 2023-09-30T22:23:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.868+0000 7f6be3d8c700 1 -- start start 2023-09-30T22:23:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.868+0000 7f6be3d8c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09e870 0x7f6bdc11e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.868+0000 7f6be3d8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc09f350 0x7f6bdc11eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.868+0000 7f6be3d8c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bdc1371c0 0x7f6bdc11f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.868+0000 7f6be3d8c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc121e60 con 0x7f6bdc09e870 2023-09-30T22:23:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.868+0000 7f6be3d8c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc120340 con 0x7f6bdc09f350 2023-09-30T22:23:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be3d8c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0a2e10 con 0x7f6bdc1371c0 2023-09-30T22:23:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1b28700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09e870 0x7f6bdc11e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1b28700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09e870 0x7f6bdc11e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36006/0 (socket says 172.21.15.154:36006) 2023-09-30T22:23:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1b28700 1 -- 172.21.15.154:0/3624074111 learned_addr learned my addr 172.21.15.154:0/3624074111 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be2329700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bdc1371c0 0x7f6bdc11f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1327700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc09f350 0x7f6bdc11eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1327700 1 -- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bdc1371c0 msgr2=0x7f6bdc11f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1327700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bdc1371c0 0x7f6bdc11f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1327700 1 -- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09e870 msgr2=0x7f6bdc11e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1327700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09e870 0x7f6bdc11e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1327700 1 -- 172.21.15.154:0/3624074111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009a70 con 0x7f6bdc09f350 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be2329700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bdc1371c0 0x7f6bdc11f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be1327700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc09f350 0x7f6bdc11eb60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc067370 tx=0x7f6bcc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6bd27fc700 1 -- 172.21.15.154:0/3624074111 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc004550 con 0x7f6bdc09f350 2023-09-30T22:23:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6bd27fc700 1 -- 172.21.15.154:0/3624074111 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc01f070 con 0x7f6bdc09f350 2023-09-30T22:23:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.869+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3624074111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc0094a0 con 0x7f6bdc09f350 2023-09-30T22:23:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.870+0000 7f6bd27fc700 1 -- 172.21.15.154:0/3624074111 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc0038e0 con 0x7f6bdc09f350 2023-09-30T22:23:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.870+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3624074111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc122140 con 0x7f6bdc09f350 2023-09-30T22:23:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.870+0000 7f6bd27fc700 1 -- 172.21.15.154:0/3624074111 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bcc003a40 con 0x7f6bdc09f350 2023-09-30T22:23:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.871+0000 7f6bd27fc700 1 -- 172.21.15.154:0/3624074111 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bcc021070 con 0x7f6bdc09f350 2023-09-30T22:23:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.871+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3624074111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc04f2a0 con 0x7f6bdc09f350 2023-09-30T22:23:26.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.877+0000 7f6bd27fc700 1 -- 172.21.15.154:0/3624074111 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bcc02b080 con 0x7f6bdc09f350 2023-09-30T22:23:26.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.937+0000 7f8303fbc700 1 Processor -- start 2023-09-30T22:23:26.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8303fbc700 1 -- start start 2023-09-30T22:23:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8303fbc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8303fbc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8303fbc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82fc06b2d0 con 0x7f82fc133ad0 2023-09-30T22:23:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8303fbc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc1345b0 con 0x7f82fc136960 2023-09-30T22:23:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8303fbc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc133610 con 0x7f82fc139280 2023-09-30T22:23:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8301d58700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f82fc133ad0 0x7f82fc133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52094/0 (socket says 172.21.15.154:52094) 2023-09-30T22:23:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8301d58700 1 -- 172.21.15.154:0/3740302133 learned_addr learned my addr 172.21.15.154:0/3740302133 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8301557700 1 --2- 172.21.15.154:0/3740302133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.938+0000 7f8302559700 1 --2- 172.21.15.154:0/3740302133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8300d56700 1 -- 172.21.15.154:0/3740302133 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251651481 0 0) 0x7f82fc06b2d0 con 0x7f82fc133ad0 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8300d56700 1 -- 172.21.15.154:0/3740302133 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e80035b0 con 0x7f82fc133ad0 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8301557700 1 -- 172.21.15.154:0/3740302133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 msgr2=0x7f82fc13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8301557700 1 --2- 172.21.15.154:0/3740302133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8301557700 1 -- 172.21.15.154:0/3740302133 >> v1:172.21.15.154:6789/0 conn(0x7f82fc133ad0 legacy=0x7f82fc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8301557700 1 -- 172.21.15.154:0/3740302133 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc09a500 con 0x7f82fc136960 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8301557700 1 --2- 172.21.15.154:0/3740302133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc138d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009870 tx=0x7f82ec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0923b989ec7aa03 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8300d56700 1 -- 172.21.15.154:0/3740302133 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec004230 con 0x7f82fc136960 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8300d56700 1 -- 172.21.15.154:0/3740302133 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec004390 con 0x7f82fc136960 2023-09-30T22:23:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.939+0000 7f8300d56700 1 -- 172.21.15.154:0/3740302133 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0036a0 con 0x7f82fc136960 2023-09-30T22:23:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.940+0000 7f8303fbc700 1 -- 172.21.15.154:0/3740302133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 msgr2=0x7f82fc138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.940+0000 7f8303fbc700 1 --2- 172.21.15.154:0/3740302133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc138d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009870 tx=0x7f82ec009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.940+0000 7f8303fbc700 1 -- 172.21.15.154:0/3740302133 shutdown_connections 2023-09-30T22:23:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.940+0000 7f8303fbc700 1 --2- 172.21.15.154:0/3740302133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.940+0000 7f8303fbc700 1 --2- 172.21.15.154:0/3740302133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc138d40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.940+0000 7f8303fbc700 1 -- 172.21.15.154:0/3740302133 >> 172.21.15.154:0/3740302133 conn(0x7f82fc099c40 msgr2=0x7f82fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.940+0000 7f8303fbc700 1 -- 172.21.15.154:0/3740302133 shutdown_connections 2023-09-30T22:23:26.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.940+0000 7f8303fbc700 1 -- 172.21.15.154:0/3740302133 wait complete. 2023-09-30T22:23:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8303fbc700 1 Processor -- start 2023-09-30T22:23:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8303fbc700 1 -- start start 2023-09-30T22:23:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8303fbc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82fc133ad0 0x7f82fc070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8303fbc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8303fbc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc071a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8303fbc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc072820 con 0x7f82fc133ad0 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8303fbc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc12ed90 con 0x7f82fc136960 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8303fbc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc1316a0 con 0x7f82fc139280 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8301557700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8302559700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8301d58700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82fc133ad0 0x7f82fc070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8302559700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50982/0 (socket says 172.21.15.154:50982) 2023-09-30T22:23:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8301557700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34216/0 (socket says 172.21.15.154:34216) 2023-09-30T22:23:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.941+0000 7f8302559700 1 -- 172.21.15.154:0/94267087 learned_addr learned my addr 172.21.15.154:0/94267087 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8301557700 1 -- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 msgr2=0x7f82fc071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8301557700 1 --2- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8301557700 1 -- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82fc133ad0 msgr2=0x7f82fc070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8301557700 1 --2- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82fc133ad0 0x7f82fc070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8301557700 1 -- 172.21.15.154:0/94267087 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0094a0 con 0x7f82fc136960 2023-09-30T22:23:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8301d58700 1 --2- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82fc133ad0 0x7f82fc070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8302559700 1 --2- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8301557700 1 --2- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc071530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f82ec015000 tx=0x7f82ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f82f27fc700 1 -- 172.21.15.154:0/94267087 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec003c70 con 0x7f82fc136960 2023-09-30T22:23:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f82f27fc700 1 -- 172.21.15.154:0/94267087 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec01e070 con 0x7f82fc136960 2023-09-30T22:23:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f82f27fc700 1 -- 172.21.15.154:0/94267087 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec011630 con 0x7f82fc136960 2023-09-30T22:23:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8303fbc700 1 -- 172.21.15.154:0/94267087 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82fc09f390 con 0x7f82fc136960 2023-09-30T22:23:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.942+0000 7f8303fbc700 1 -- 172.21.15.154:0/94267087 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82fc070ba0 con 0x7f82fc136960 2023-09-30T22:23:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.943+0000 7f82f27fc700 1 -- 172.21.15.154:0/94267087 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82ec011790 con 0x7f82fc136960 2023-09-30T22:23:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.943+0000 7f82f27fc700 1 -- 172.21.15.154:0/94267087 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82ec0404e0 con 0x7f82fc136960 2023-09-30T22:23:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.943+0000 7f8303fbc700 1 -- 172.21.15.154:0/94267087 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82fc06fdd0 con 0x7f82fc136960 2023-09-30T22:23:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.948+0000 7f82f27fc700 1 -- 172.21.15.154:0/94267087 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82fc06fdd0 con 0x7f82fc136960 2023-09-30T22:23:26.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.981+0000 7f6cbfc32700 1 Processor -- start 2023-09-30T22:23:26.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbfc32700 1 -- start start 2023-09-30T22:23:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbfc32700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6cb80a0a90 0x7f6cb80a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbfc32700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb80a13a0 0x7f6cb8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbfc32700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb80a1fe0 con 0x7f6cb8133f70 2023-09-30T22:23:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbfc32700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb80a3aa0 con 0x7f6cb80a0a90 2023-09-30T22:23:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbfc32700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb809a540 con 0x7f6cb80a13a0 2023-09-30T22:23:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbd9ce700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6cb80a0a90 0x7f6cb80a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbd1cd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb80a13a0 0x7f6cb8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbd9ce700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6cb80a0a90 0x7f6cb80a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36030/0 (socket says 172.21.15.154:36030) 2023-09-30T22:23:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbd1cd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb80a13a0 0x7f6cb8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34230/0 (socket says 172.21.15.154:34230) 2023-09-30T22:23:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.982+0000 7f6cbd9ce700 1 -- 172.21.15.154:0/2827864621 learned_addr learned my addr 172.21.15.154:0/2827864621 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.983+0000 7f6cbd1cd700 1 -- 172.21.15.154:0/2827864621 >> v2:172.21.15.154:3300/0 conn(0x7f6cb80a0a90 msgr2=0x7f6cb80a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.983+0000 7f6cbd1cd700 1 --2- 172.21.15.154:0/2827864621 >> v2:172.21.15.154:3300/0 conn(0x7f6cb80a0a90 0x7f6cb80a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.983+0000 7f6cbd1cd700 1 -- 172.21.15.154:0/2827864621 >> v1:172.21.15.154:6789/0 conn(0x7f6cb8133f70 legacy=0x7f6cb813ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.983+0000 7f6cbd1cd700 1 -- 172.21.15.154:0/2827864621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb809a280 con 0x7f6cb80a13a0 2023-09-30T22:23:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.983+0000 7f6cbd1cd700 1 --2- 172.21.15.154:0/2827864621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb80a13a0 0x7f6cb8133a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009840 tx=0x7f6ca8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48d47d5cc993e38a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.983+0000 7f6cbc9cc700 1 -- 172.21.15.154:0/2827864621 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8011830 con 0x7f6cb80a13a0 2023-09-30T22:23:26.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.983+0000 7f6cbc9cc700 1 -- 172.21.15.154:0/2827864621 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8011990 con 0x7f6cb80a13a0 2023-09-30T22:23:26.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.983+0000 7f6cbc9cc700 1 -- 172.21.15.154:0/2827864621 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8011d20 con 0x7f6cb80a13a0 2023-09-30T22:23:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.984+0000 7f6cbfc32700 1 -- 172.21.15.154:0/2827864621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb80a13a0 msgr2=0x7f6cb8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.984+0000 7f6cbfc32700 1 --2- 172.21.15.154:0/2827864621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb80a13a0 0x7f6cb8133a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009840 tx=0x7f6ca8009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.984+0000 7f6cbfc32700 1 -- 172.21.15.154:0/2827864621 shutdown_connections 2023-09-30T22:23:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.984+0000 7f6cbfc32700 1 --2- 172.21.15.154:0/2827864621 >> v2:172.21.15.154:3300/0 conn(0x7f6cb80a0a90 0x7f6cb80a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.984+0000 7f6cbfc32700 1 --2- 172.21.15.154:0/2827864621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb80a13a0 0x7f6cb8133a30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.984+0000 7f6cbfc32700 1 -- 172.21.15.154:0/2827864621 >> 172.21.15.154:0/2827864621 conn(0x7f6cb8099c40 msgr2=0x7f6cb806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.984+0000 7f6cbfc32700 1 -- 172.21.15.154:0/2827864621 shutdown_connections 2023-09-30T22:23:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.984+0000 7f6cbfc32700 1 -- 172.21.15.154:0/2827864621 wait complete. 2023-09-30T22:23:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbfc32700 1 Processor -- start 2023-09-30T22:23:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbfc32700 1 -- start start 2023-09-30T22:23:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbfc32700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cb80a0a90 0x7f6cb81213a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbfc32700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb80a13a0 0x7f6cb81218e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbfc32700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb8133f70 0x7f6cb8121e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbfc32700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8123e70 con 0x7f6cb80a13a0 2023-09-30T22:23:26.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbfc32700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8122f70 con 0x7f6cb8133f70 2023-09-30T22:23:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbfc32700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb809c7e0 con 0x7f6cb80a0a90 2023-09-30T22:23:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbd9ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cb80a0a90 0x7f6cb81213a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbd9ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cb80a0a90 0x7f6cb81213a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50984/0 (socket says 172.21.15.154:50984) 2023-09-30T22:23:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbd9ce700 1 -- 172.21.15.154:0/1065508417 learned_addr learned my addr 172.21.15.154:0/1065508417 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.985+0000 7f6cbe1cf700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb8133f70 0x7f6cb8121e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbd1cd700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb80a13a0 0x7f6cb81218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbd9ce700 1 -- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb8133f70 msgr2=0x7f6cb8121e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbd9ce700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb8133f70 0x7f6cb8121e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbd9ce700 1 -- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb80a13a0 msgr2=0x7f6cb81218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbd9ce700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb80a13a0 0x7f6cb81218e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbd9ce700 1 -- 172.21.15.154:0/1065508417 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80094a0 con 0x7f6cb80a0a90 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbd1cd700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb80a13a0 0x7f6cb81218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbe1cf700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb8133f70 0x7f6cb8121e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbd9ce700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cb80a0a90 0x7f6cb81213a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e910 tx=0x7f6cb400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cae7fc700 1 -- 172.21.15.154:0/1065508417 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40096a0 con 0x7f6cb80a0a90 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cae7fc700 1 -- 172.21.15.154:0/1065508417 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb400c850 con 0x7f6cb80a0a90 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbfc32700 1 -- 172.21.15.154:0/1065508417 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb8124ba0 con 0x7f6cb80a0a90 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cae7fc700 1 -- 172.21.15.154:0/1065508417 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400cc00 con 0x7f6cb80a0a90 2023-09-30T22:23:26.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.986+0000 7f6cbfc32700 1 -- 172.21.15.154:0/1065508417 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb8124610 con 0x7f6cb80a0a90 2023-09-30T22:23:26.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.987+0000 7f6cae7fc700 1 -- 172.21.15.154:0/1065508417 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6cb400cd60 con 0x7f6cb80a0a90 2023-09-30T22:23:26.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.987+0000 7f6cae7fc700 1 -- 172.21.15.154:0/1065508417 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6cb403f760 con 0x7f6cb80a0a90 2023-09-30T22:23:26.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.987+0000 7f6cbfc32700 1 -- 172.21.15.154:0/1065508417 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb8124250 con 0x7f6cb80a0a90 2023-09-30T22:23:26.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:26.992+0000 7f6cae7fc700 1 -- 172.21.15.154:0/1065508417 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6cb40232f0 con 0x7f6cb80a0a90 2023-09-30T22:23:27.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.076+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3624074111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6bdc121fa0 con 0x7f6bdc09f350 2023-09-30T22:23:27.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.076+0000 7f6bd27fc700 1 -- 172.21.15.154:0/3624074111 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bdc121fa0 con 0x7f6bdc09f350 2023-09-30T22:23:27.077 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:27.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.078+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc09f350 msgr2=0x7f6bdc11eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.078+0000 7f6be3d8c700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc09f350 0x7f6bdc11eb60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc067370 tx=0x7f6bcc004750 comp rx=0 tx=0).stop 2023-09-30T22:23:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.078+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3624074111 shutdown_connections 2023-09-30T22:23:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.078+0000 7f6be3d8c700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bdc1371c0 0x7f6bdc11f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.078+0000 7f6be3d8c700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bdc09e870 0x7f6bdc11e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.079+0000 7f6be3d8c700 1 --2- 172.21.15.154:0/3624074111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bdc09f350 0x7f6bdc11eb60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.079+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3624074111 >> 172.21.15.154:0/3624074111 conn(0x7f6bdc0a4430 msgr2=0x7f6bdc09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.079+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3624074111 shutdown_connections 2023-09-30T22:23:27.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.079+0000 7f6be3d8c700 1 -- 172.21.15.154:0/3624074111 wait complete. 2023-09-30T22:23:27.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:27.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.146+0000 7f8303fbc700 1 -- 172.21.15.154:0/94267087 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f82fc06fdd0 con 0x7f82fc136960 2023-09-30T22:23:27.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.146+0000 7f82f27fc700 1 -- 172.21.15.154:0/94267087 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82fc06fdd0 con 0x7f82fc136960 2023-09-30T22:23:27.147 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.148+0000 7f8303fbc700 1 -- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 msgr2=0x7f82fc071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.148+0000 7f8303fbc700 1 --2- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc071530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f82ec015000 tx=0x7f82ec004750 comp rx=0 tx=0).stop 2023-09-30T22:23:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.148+0000 7f8303fbc700 1 -- 172.21.15.154:0/94267087 shutdown_connections 2023-09-30T22:23:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.148+0000 7f8303fbc700 1 --2- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82fc139280 0x7f82fc071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.148+0000 7f8303fbc700 1 --2- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82fc133ad0 0x7f82fc070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.148+0000 7f8303fbc700 1 --2- 172.21.15.154:0/94267087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82fc136960 0x7f82fc071530 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.148+0000 7f8303fbc700 1 -- 172.21.15.154:0/94267087 >> 172.21.15.154:0/94267087 conn(0x7f82fc099c40 msgr2=0x7f82fc0a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.148+0000 7f8303fbc700 1 -- 172.21.15.154:0/94267087 shutdown_connections 2023-09-30T22:23:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.148+0000 7f8303fbc700 1 -- 172.21.15.154:0/94267087 wait complete. 2023-09-30T22:23:27.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:27.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.187+0000 7f6cbfc32700 1 -- 172.21.15.154:0/1065508417 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6cb811e060 con 0x7f6cb80a0a90 2023-09-30T22:23:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.187+0000 7f6cae7fc700 1 -- 172.21.15.154:0/1065508417 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6cb4021020 con 0x7f6cb80a0a90 2023-09-30T22:23:27.188 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:27.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.189+0000 7f6cbfc32700 1 -- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cb80a0a90 msgr2=0x7f6cb81213a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.189+0000 7f6cbfc32700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cb80a0a90 0x7f6cb81213a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e910 tx=0x7f6cb400ecd0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.189+0000 7f6cbfc32700 1 -- 172.21.15.154:0/1065508417 shutdown_connections 2023-09-30T22:23:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.189+0000 7f6cbfc32700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cb8133f70 0x7f6cb8121e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.189+0000 7f6cbfc32700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cb80a0a90 0x7f6cb81213a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.189+0000 7f6cbfc32700 1 --2- 172.21.15.154:0/1065508417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb80a13a0 0x7f6cb81218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.189+0000 7f6cbfc32700 1 -- 172.21.15.154:0/1065508417 >> 172.21.15.154:0/1065508417 conn(0x7f6cb8099c40 msgr2=0x7f6cb8133220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.189+0000 7f6cbfc32700 1 -- 172.21.15.154:0/1065508417 shutdown_connections 2023-09-30T22:23:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.189+0000 7f6cbfc32700 1 -- 172.21.15.154:0/1065508417 wait complete. 2023-09-30T22:23:27.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:27.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.832+0000 7f2e56a1c700 1 Processor -- start 2023-09-30T22:23:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.832+0000 7f2e56a1c700 1 -- start start 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e56a1c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e5009d860 0x7f2e5009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e56a1c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e50130eb0 0x7f2e50138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e56a1c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5009aaa0 con 0x7f2e5009e170 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e56a1c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5009f870 con 0x7f2e5009d860 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e56a1c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5009b360 con 0x7f2e50130eb0 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e4ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e5009d860 0x7f2e5009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e54fb9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e50130eb0 0x7f2e50138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e4ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e5009d860 0x7f2e5009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36048/0 (socket says 172.21.15.154:36048) 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e54fb9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e50130eb0 0x7f2e50138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34234/0 (socket says 172.21.15.154:34234) 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e4ffff700 1 -- 172.21.15.154:0/3273420817 learned_addr learned my addr 172.21.15.154:0/3273420817 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e54fb9700 1 -- 172.21.15.154:0/3273420817 >> v2:172.21.15.154:3300/0 conn(0x7f2e5009d860 msgr2=0x7f2e5009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e54fb9700 1 --2- 172.21.15.154:0/3273420817 >> v2:172.21.15.154:3300/0 conn(0x7f2e5009d860 0x7f2e5009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e54fb9700 1 -- 172.21.15.154:0/3273420817 >> v1:172.21.15.154:6789/0 conn(0x7f2e5009e170 legacy=0x7f2e501307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e54fb9700 1 -- 172.21.15.154:0/3273420817 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5009b620 con 0x7f2e50130eb0 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e4ffff700 1 --2- 172.21.15.154:0/3273420817 >> v2:172.21.15.154:3300/0 conn(0x7f2e5009d860 0x7f2e5009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.833+0000 7f2e54fb9700 1 --2- 172.21.15.154:0/3273420817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e50130eb0 0x7f2e50138a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009d90 tx=0x7f2e4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf3156df03ba4c6a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e4effd700 1 -- 172.21.15.154:0/3273420817 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800e070 con 0x7f2e50130eb0 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e4effd700 1 -- 172.21.15.154:0/3273420817 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4800bb20 con 0x7f2e50130eb0 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e4effd700 1 -- 172.21.15.154:0/3273420817 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e48012430 con 0x7f2e50130eb0 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3273420817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e50130eb0 msgr2=0x7f2e50138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e56a1c700 1 --2- 172.21.15.154:0/3273420817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e50130eb0 0x7f2e50138a00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009d90 tx=0x7f2e4800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3273420817 shutdown_connections 2023-09-30T22:23:27.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e56a1c700 1 --2- 172.21.15.154:0/3273420817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e50130eb0 0x7f2e50138a00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e56a1c700 1 --2- 172.21.15.154:0/3273420817 >> v2:172.21.15.154:3300/0 conn(0x7f2e5009d860 0x7f2e5009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3273420817 >> 172.21.15.154:0/3273420817 conn(0x7f2e50099c40 msgr2=0x7f2e500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3273420817 shutdown_connections 2023-09-30T22:23:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.834+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3273420817 wait complete. 2023-09-30T22:23:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.835+0000 7f2e56a1c700 1 Processor -- start 2023-09-30T22:23:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.835+0000 7f2e56a1c700 1 -- start start 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e56a1c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5009d860 0x7f2e501c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e56a1c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5009e170 0x7f2e501c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e56a1c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e50130eb0 0x7f2e501c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e56a1c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5009c8b0 con 0x7f2e50130eb0 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e56a1c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5011a710 con 0x7f2e5009e170 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e56a1c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50137880 con 0x7f2e5009d860 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e54fb9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e50130eb0 0x7f2e501c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5009d860 0x7f2e501c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5009e170 0x7f2e501c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e54fb9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e50130eb0 0x7f2e501c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36056/0 (socket says 172.21.15.154:36056) 2023-09-30T22:23:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5009d860 0x7f2e501c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50988/0 (socket says 172.21.15.154:50988) 2023-09-30T22:23:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e54fb9700 1 -- 172.21.15.154:0/3908370092 learned_addr learned my addr 172.21.15.154:0/3908370092 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4f7fe700 1 -- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5009d860 msgr2=0x7f2e501c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4f7fe700 1 --2- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5009d860 0x7f2e501c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4f7fe700 1 -- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e50130eb0 msgr2=0x7f2e501c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4f7fe700 1 --2- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e50130eb0 0x7f2e501c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4f7fe700 1 -- 172.21.15.154:0/3908370092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40009550 con 0x7f2e5009e170 2023-09-30T22:23:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e54fb9700 1 --2- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e50130eb0 0x7f2e501c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4f7fe700 1 --2- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5009e170 0x7f2e501c6470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e5009ee50 tx=0x7f2e4400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4cff9700 1 -- 172.21.15.154:0/3908370092 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440052d0 con 0x7f2e5009e170 2023-09-30T22:23:27.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4cff9700 1 -- 172.21.15.154:0/3908370092 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44005430 con 0x7f2e5009e170 2023-09-30T22:23:27.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3908370092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e48009a70 con 0x7f2e5009e170 2023-09-30T22:23:27.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.836+0000 7f2e4cff9700 1 -- 172.21.15.154:0/3908370092 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440038c0 con 0x7f2e5009e170 2023-09-30T22:23:27.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.837+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3908370092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e50137d80 con 0x7f2e5009e170 2023-09-30T22:23:27.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.837+0000 7f2e4cff9700 1 -- 172.21.15.154:0/3908370092 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e44003a20 con 0x7f2e5009e170 2023-09-30T22:23:27.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.837+0000 7f2e4cff9700 1 -- 172.21.15.154:0/3908370092 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e4403e7c0 con 0x7f2e5009e170 2023-09-30T22:23:27.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.837+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3908370092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5006be10 con 0x7f2e5009e170 2023-09-30T22:23:27.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:27.842+0000 7f2e4cff9700 1 -- 172.21.15.154:0/3908370092 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e4401b3b0 con 0x7f2e5009e170 2023-09-30T22:23:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.027+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3908370092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e50137d20 con 0x7f2e5009e170 2023-09-30T22:23:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.028+0000 7f2e4cff9700 1 -- 172.21.15.154:0/3908370092 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e44017020 con 0x7f2e5009e170 2023-09-30T22:23:28.029 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:28.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.030+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5009e170 msgr2=0x7f2e501c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.030+0000 7f2e56a1c700 1 --2- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5009e170 0x7f2e501c6470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2e5009ee50 tx=0x7f2e4400c730 comp rx=0 tx=0).stop 2023-09-30T22:23:28.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.030+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3908370092 shutdown_connections 2023-09-30T22:23:28.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.030+0000 7f2e56a1c700 1 --2- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e50130eb0 0x7f2e501c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.030+0000 7f2e56a1c700 1 --2- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5009d860 0x7f2e501c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.030+0000 7f2e56a1c700 1 --2- 172.21.15.154:0/3908370092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5009e170 0x7f2e501c6470 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.030+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3908370092 >> 172.21.15.154:0/3908370092 conn(0x7f2e50099c40 msgr2=0x7f2e501387c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.030+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3908370092 shutdown_connections 2023-09-30T22:23:28.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.030+0000 7f2e56a1c700 1 -- 172.21.15.154:0/3908370092 wait complete. 2023-09-30T22:23:28.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:28.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:28.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:28.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:28.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.219+0000 7fc0b60b6700 1 Processor -- start 2023-09-30T22:23:28.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.219+0000 7fc0b60b6700 1 -- start start 2023-09-30T22:23:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0b60b6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0b0066410 0x7fc0b00a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0b60b6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0131180 0x7fc0b0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0b60b6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b00a1e70 con 0x7fc0b00667e0 2023-09-30T22:23:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0b60b6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b009a720 con 0x7fc0b0066410 2023-09-30T22:23:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0b60b6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b009b300 con 0x7fc0b0131180 2023-09-30T22:23:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0affff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0131180 0x7fc0b0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0af7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0b0066410 0x7fc0b00a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0affff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0131180 0x7fc0b0131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50990/0 (socket says 172.21.15.154:50990) 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0af7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0b0066410 0x7fc0b00a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36072/0 (socket says 172.21.15.154:36072) 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.220+0000 7fc0affff700 1 -- 172.21.15.154:0/71515050 learned_addr learned my addr 172.21.15.154:0/71515050 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.221+0000 7fc0affff700 1 -- 172.21.15.154:0/71515050 >> v2:172.21.15.154:3300/0 conn(0x7fc0b0066410 msgr2=0x7fc0b00a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.221+0000 7fc0affff700 1 --2- 172.21.15.154:0/71515050 >> v2:172.21.15.154:3300/0 conn(0x7fc0b0066410 0x7fc0b00a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.221+0000 7fc0affff700 1 -- 172.21.15.154:0/71515050 >> v1:172.21.15.154:6789/0 conn(0x7fc0b00667e0 legacy=0x7fc0b00a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.221+0000 7fc0affff700 1 -- 172.21.15.154:0/71515050 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b009abc0 con 0x7fc0b0131180 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.221+0000 7fc0af7fe700 1 --2- 172.21.15.154:0/71515050 >> v2:172.21.15.154:3300/0 conn(0x7fc0b0066410 0x7fc0b00a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.221+0000 7fc0affff700 1 --2- 172.21.15.154:0/71515050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0131180 0x7fc0b0131600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009e50 tx=0x7fc0a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=574df1b59f391f1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.221+0000 7fc0ae7fc700 1 -- 172.21.15.154:0/71515050 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800e070 con 0x7fc0b0131180 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.221+0000 7fc0ae7fc700 1 -- 172.21.15.154:0/71515050 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a8003a20 con 0x7fc0b0131180 2023-09-30T22:23:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.221+0000 7fc0ae7fc700 1 -- 172.21.15.154:0/71515050 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8003dd0 con 0x7fc0b0131180 2023-09-30T22:23:28.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.222+0000 7fc0b60b6700 1 -- 172.21.15.154:0/71515050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0131180 msgr2=0x7fc0b0131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.222+0000 7fc0b60b6700 1 --2- 172.21.15.154:0/71515050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0131180 0x7fc0b0131600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009e50 tx=0x7fc0a800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:28.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.222+0000 7fc0b60b6700 1 -- 172.21.15.154:0/71515050 shutdown_connections 2023-09-30T22:23:28.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.222+0000 7fc0b60b6700 1 --2- 172.21.15.154:0/71515050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0131180 0x7fc0b0131600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.222+0000 7fc0b60b6700 1 --2- 172.21.15.154:0/71515050 >> v2:172.21.15.154:3300/0 conn(0x7fc0b0066410 0x7fc0b00a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.222+0000 7fc0b60b6700 1 -- 172.21.15.154:0/71515050 >> 172.21.15.154:0/71515050 conn(0x7fc0b00a2980 msgr2=0x7fc0b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.222+0000 7fc0b60b6700 1 -- 172.21.15.154:0/71515050 shutdown_connections 2023-09-30T22:23:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.222+0000 7fc0b60b6700 1 -- 172.21.15.154:0/71515050 wait complete. 2023-09-30T22:23:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.223+0000 7fc0b60b6700 1 Processor -- start 2023-09-30T22:23:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.223+0000 7fc0b60b6700 1 -- start start 2023-09-30T22:23:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.223+0000 7fc0b60b6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0066410 0x7fc0b01371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.223+0000 7fc0b60b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0b00667e0 0x7fc0b01376e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.223+0000 7fc0b60b6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b0131180 0x7fc0b0137c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.223+0000 7fc0b60b6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b013a950 con 0x7fc0b0131180 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0b60b6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b009ae00 con 0x7fc0b00667e0 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0b60b6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0138e30 con 0x7fc0b0066410 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0af7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0066410 0x7fc0b01371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0af7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0066410 0x7fc0b01371a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51000/0 (socket says 172.21.15.154:51000) 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0af7fe700 1 -- 172.21.15.154:0/3380514481 learned_addr learned my addr 172.21.15.154:0/3380514481 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0aeffd700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0b00667e0 0x7fc0b01376e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0affff700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b0131180 0x7fc0b0137c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0aeffd700 1 -- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0066410 msgr2=0x7fc0b01371a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0aeffd700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0066410 0x7fc0b01371a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0aeffd700 1 -- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b0131180 msgr2=0x7fc0b0137c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0aeffd700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b0131180 0x7fc0b0137c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0aeffd700 1 -- 172.21.15.154:0/3380514481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a8009b30 con 0x7fc0b00667e0 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0af7fe700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0066410 0x7fc0b01371a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0affff700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b0131180 0x7fc0b0137c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0aeffd700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0b00667e0 0x7fc0b01376e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c430 tx=0x7fc0a000c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0a7fff700 1 -- 172.21.15.154:0/3380514481 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0011590 con 0x7fc0b00667e0 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0a7fff700 1 -- 172.21.15.154:0/3380514481 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a00116f0 con 0x7fc0b00667e0 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0b60b6700 1 -- 172.21.15.154:0/3380514481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b009fb10 con 0x7fc0b00667e0 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0a7fff700 1 -- 172.21.15.154:0/3380514481 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0011aa0 con 0x7fc0b00667e0 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.224+0000 7fc0b60b6700 1 -- 172.21.15.154:0/3380514481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b013ac30 con 0x7fc0b00667e0 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.225+0000 7fc0a7fff700 1 -- 172.21.15.154:0/3380514481 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0a0011c00 con 0x7fc0b00667e0 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.225+0000 7fc0a7fff700 1 -- 172.21.15.154:0/3380514481 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc0a003f2c0 con 0x7fc0b00667e0 2023-09-30T22:23:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.226+0000 7fc0b60b6700 1 -- 172.21.15.154:0/3380514481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b013aa90 con 0x7fc0b00667e0 2023-09-30T22:23:28.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.231+0000 7fc0a7fff700 1 -- 172.21.15.154:0/3380514481 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0b013aa90 con 0x7fc0b00667e0 2023-09-30T22:23:28.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.291+0000 7fceef941700 1 Processor -- start 2023-09-30T22:23:28.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.291+0000 7fceef941700 1 -- start start 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.292+0000 7fceef941700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcee806a770 0x7fcee806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.292+0000 7fceef941700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee8136cb0 0x7fcee8139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.292+0000 7fceef941700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee806e900 con 0x7fcee809dec0 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.292+0000 7fceef941700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee809d180 con 0x7fcee806a770 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.292+0000 7fceef941700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcee809e780 con 0x7fcee8136cb0 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.292+0000 7fceedede700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee8136cb0 0x7fcee8139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.292+0000 7fceedede700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee8136cb0 0x7fcee8139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51014/0 (socket says 172.21.15.154:51014) 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.292+0000 7fceedede700 1 -- 172.21.15.154:0/3143586418 learned_addr learned my addr 172.21.15.154:0/3143586418 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.292+0000 7fceed6dd700 1 --2- 172.21.15.154:0/3143586418 >> v2:172.21.15.154:3300/0 conn(0x7fcee806a770 0x7fcee806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.293+0000 7fceedede700 1 -- 172.21.15.154:0/3143586418 >> v2:172.21.15.154:3300/0 conn(0x7fcee806a770 msgr2=0x7fcee806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.293+0000 7fceedede700 1 --2- 172.21.15.154:0/3143586418 >> v2:172.21.15.154:3300/0 conn(0x7fcee806a770 0x7fcee806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.293+0000 7fceedede700 1 -- 172.21.15.154:0/3143586418 >> v1:172.21.15.154:6789/0 conn(0x7fcee809dec0 legacy=0x7fcee806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.293+0000 7fceedede700 1 -- 172.21.15.154:0/3143586418 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee809d3c0 con 0x7fcee8136cb0 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.293+0000 7fceed6dd700 1 --2- 172.21.15.154:0/3143586418 >> v2:172.21.15.154:3300/0 conn(0x7fcee806a770 0x7fcee806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.293+0000 7fceedede700 1 --2- 172.21.15.154:0/3143586418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee8136cb0 0x7fcee8139090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009e50 tx=0x7fcee000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33cadbabc735c0a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.293+0000 7fcedffff700 1 -- 172.21.15.154:0/3143586418 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee000e070 con 0x7fcee8136cb0 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.293+0000 7fcedffff700 1 -- 172.21.15.154:0/3143586418 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee000b910 con 0x7fcee8136cb0 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.293+0000 7fcedffff700 1 -- 172.21.15.154:0/3143586418 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee000bcc0 con 0x7fcee8136cb0 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.294+0000 7fceef941700 1 -- 172.21.15.154:0/3143586418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee8136cb0 msgr2=0x7fcee8139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.294+0000 7fceef941700 1 --2- 172.21.15.154:0/3143586418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee8136cb0 0x7fcee8139090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009e50 tx=0x7fcee000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:28.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.294+0000 7fceef941700 1 -- 172.21.15.154:0/3143586418 shutdown_connections 2023-09-30T22:23:28.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.294+0000 7fceef941700 1 --2- 172.21.15.154:0/3143586418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee8136cb0 0x7fcee8139090 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.294+0000 7fceef941700 1 --2- 172.21.15.154:0/3143586418 >> v2:172.21.15.154:3300/0 conn(0x7fcee806a770 0x7fcee806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.294+0000 7fceef941700 1 -- 172.21.15.154:0/3143586418 >> 172.21.15.154:0/3143586418 conn(0x7fcee8099c40 msgr2=0x7fcee80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.294+0000 7fceef941700 1 -- 172.21.15.154:0/3143586418 shutdown_connections 2023-09-30T22:23:28.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.294+0000 7fceef941700 1 -- 172.21.15.154:0/3143586418 wait complete. 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.295+0000 7fceef941700 1 Processor -- start 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.295+0000 7fceef941700 1 -- start start 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceef941700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee806a770 0x7fcee8134680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceef941700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee809dec0 0x7fcee8134bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceef941700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee8136cb0 0x7fcee8135100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceef941700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80a2f10 con 0x7fcee8136cb0 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceef941700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee811a990 con 0x7fcee806a770 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceef941700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcee8071ce0 con 0x7fcee809dec0 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceedede700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee8136cb0 0x7fcee8135100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceecedc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee809dec0 0x7fcee8134bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceedede700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee8136cb0 0x7fcee8135100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36104/0 (socket says 172.21.15.154:36104) 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceedede700 1 -- 172.21.15.154:0/2477243803 learned_addr learned my addr 172.21.15.154:0/2477243803 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceecedc700 1 -- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee806a770 msgr2=0x7fcee8134680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceecedc700 1 --2- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee806a770 0x7fcee8134680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceecedc700 1 -- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee8136cb0 msgr2=0x7fcee8135100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceecedc700 1 --2- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee8136cb0 0x7fcee8135100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.296+0000 7fceecedc700 1 -- 172.21.15.154:0/2477243803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40094a0 con 0x7fcee809dec0 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.297+0000 7fceedede700 1 --2- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee8136cb0 0x7fcee8135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.297+0000 7fceecedc700 1 --2- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee809dec0 0x7fcee8134bc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fced8000f60 tx=0x7fced800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.297+0000 7fceddffb700 1 -- 172.21.15.154:0/2477243803 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80052d0 con 0x7fcee809dec0 2023-09-30T22:23:28.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.297+0000 7fceddffb700 1 -- 172.21.15.154:0/2477243803 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced8005430 con 0x7fcee809dec0 2023-09-30T22:23:28.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.297+0000 7fceef941700 1 -- 172.21.15.154:0/2477243803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee0009b30 con 0x7fcee809dec0 2023-09-30T22:23:28.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.297+0000 7fceddffb700 1 -- 172.21.15.154:0/2477243803 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80038c0 con 0x7fcee809dec0 2023-09-30T22:23:28.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.297+0000 7fceef941700 1 -- 172.21.15.154:0/2477243803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee811b6c0 con 0x7fcee809dec0 2023-09-30T22:23:28.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.298+0000 7fceef941700 1 -- 172.21.15.154:0/2477243803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee804f2a0 con 0x7fcee809dec0 2023-09-30T22:23:28.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.298+0000 7fceddffb700 1 -- 172.21.15.154:0/2477243803 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fced8003a20 con 0x7fcee809dec0 2023-09-30T22:23:28.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.298+0000 7fceddffb700 1 -- 172.21.15.154:0/2477243803 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fced803ea60 con 0x7fcee809dec0 2023-09-30T22:23:28.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.303+0000 7fceddffb700 1 -- 172.21.15.154:0/2477243803 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fced8018260 con 0x7fcee809dec0 2023-09-30T22:23:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.334+0000 7f2150750700 1 Processor -- start 2023-09-30T22:23:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.334+0000 7f2150750700 1 -- start start 2023-09-30T22:23:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f2150750700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148136960 0x7f2148138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f2150750700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2148139280 0x7f214813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f2150750700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214806b2d0 con 0x7f2148133ad0 2023-09-30T22:23:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f2150750700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21481345b0 con 0x7f2148139280 2023-09-30T22:23:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f2150750700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2148133610 con 0x7f2148136960 2023-09-30T22:23:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f214dceb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148136960 0x7f2148138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f214dceb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148136960 0x7f2148138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34286/0 (socket says 172.21.15.154:34286) 2023-09-30T22:23:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f214dceb700 1 -- 172.21.15.154:0/3703864700 learned_addr learned my addr 172.21.15.154:0/3703864700 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:28.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f214eced700 1 --2- 172.21.15.154:0/3703864700 >> v2:172.21.15.154:3300/0 conn(0x7f2148139280 0x7f214813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f214dceb700 1 -- 172.21.15.154:0/3703864700 >> v2:172.21.15.154:3300/0 conn(0x7f2148139280 msgr2=0x7f214813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f214dceb700 1 --2- 172.21.15.154:0/3703864700 >> v2:172.21.15.154:3300/0 conn(0x7f2148139280 0x7f214813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f214dceb700 1 -- 172.21.15.154:0/3703864700 >> v1:172.21.15.154:6789/0 conn(0x7f2148133ad0 legacy=0x7f2148133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.335+0000 7f214dceb700 1 -- 172.21.15.154:0/3703864700 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214809a500 con 0x7f2148136960 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f214dceb700 1 --2- 172.21.15.154:0/3703864700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148136960 0x7f2148138d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2138009920 tx=0x7f2138009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=895227e43c2b8c4e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f214d4ea700 1 -- 172.21.15.154:0/3703864700 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138011830 con 0x7f2148136960 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f214d4ea700 1 -- 172.21.15.154:0/3703864700 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2138011990 con 0x7f2148136960 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f214d4ea700 1 -- 172.21.15.154:0/3703864700 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138011d20 con 0x7f2148136960 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f2150750700 1 -- 172.21.15.154:0/3703864700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148136960 msgr2=0x7f2148138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f2150750700 1 --2- 172.21.15.154:0/3703864700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148136960 0x7f2148138d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2138009920 tx=0x7f2138009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f2150750700 1 -- 172.21.15.154:0/3703864700 shutdown_connections 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f2150750700 1 --2- 172.21.15.154:0/3703864700 >> v2:172.21.15.154:3300/0 conn(0x7f2148139280 0x7f214813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f2150750700 1 --2- 172.21.15.154:0/3703864700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148136960 0x7f2148138d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.336+0000 7f2150750700 1 -- 172.21.15.154:0/3703864700 >> 172.21.15.154:0/3703864700 conn(0x7f2148099c40 msgr2=0x7f21480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.337+0000 7f2150750700 1 -- 172.21.15.154:0/3703864700 shutdown_connections 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.337+0000 7f2150750700 1 -- 172.21.15.154:0/3703864700 wait complete. 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.337+0000 7f2150750700 1 Processor -- start 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.337+0000 7f2150750700 1 -- start start 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f2150750700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148133ad0 0x7f21481c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f2150750700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2148136960 0x7f21481c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f2150750700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2148139280 0x7f21481c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f2150750700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214806e900 con 0x7f2148139280 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f2150750700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2148138ee0 con 0x7f2148133ad0 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f2150750700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f214809f390 con 0x7f2148136960 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214dceb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2148136960 0x7f21481c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214dceb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2148136960 0x7f21481c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51040/0 (socket says 172.21.15.154:51040) 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214e4ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148133ad0 0x7f21481c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214dceb700 1 -- 172.21.15.154:0/1796120916 learned_addr learned my addr 172.21.15.154:0/1796120916 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214eced700 1 --2- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2148139280 0x7f21481c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214e4ec700 1 -- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2148136960 msgr2=0x7f21481c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214e4ec700 1 --2- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2148136960 0x7f21481c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214e4ec700 1 -- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2148139280 msgr2=0x7f21481c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214e4ec700 1 --2- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2148139280 0x7f21481c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214e4ec700 1 -- 172.21.15.154:0/1796120916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138009550 con 0x7f2148133ad0 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.338+0000 7f214dceb700 1 --2- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2148136960 0x7f21481c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.339+0000 7f214e4ec700 1 --2- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148133ad0 0x7f21481c8570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2144000f60 tx=0x7f214400c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.339+0000 7f213effd700 1 -- 172.21.15.154:0/1796120916 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21440052d0 con 0x7f2148133ad0 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.339+0000 7f213effd700 1 -- 172.21.15.154:0/1796120916 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144005430 con 0x7f2148133ad0 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.339+0000 7f2150750700 1 -- 172.21.15.154:0/1796120916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214806f010 con 0x7f2148133ad0 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.339+0000 7f213effd700 1 -- 172.21.15.154:0/1796120916 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21440038c0 con 0x7f2148133ad0 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.339+0000 7f2150750700 1 -- 172.21.15.154:0/1796120916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2148070730 con 0x7f2148133ad0 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.340+0000 7f213effd700 1 -- 172.21.15.154:0/1796120916 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2144003c30 con 0x7f2148133ad0 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.340+0000 7f213effd700 1 -- 172.21.15.154:0/1796120916 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f214403eb50 con 0x7f2148133ad0 2023-09-30T22:23:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.340+0000 7f2150750700 1 -- 172.21.15.154:0/1796120916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214804f2a0 con 0x7f2148133ad0 2023-09-30T22:23:28.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.344+0000 7f213effd700 1 -- 172.21.15.154:0/1796120916 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f214401bb10 con 0x7f2148133ad0 2023-09-30T22:23:28.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.439+0000 7fc0b60b6700 1 -- 172.21.15.154:0/3380514481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc0b013aa90 con 0x7fc0b00667e0 2023-09-30T22:23:28.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.439+0000 7fc0a7fff700 1 -- 172.21.15.154:0/3380514481 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0b013aa90 con 0x7fc0b00667e0 2023-09-30T22:23:28.440 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.441+0000 7fc0b60b6700 1 -- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0b00667e0 msgr2=0x7fc0b01376e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.441+0000 7fc0b60b6700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0b00667e0 0x7fc0b01376e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000c430 tx=0x7fc0a000c740 comp rx=0 tx=0).stop 2023-09-30T22:23:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.441+0000 7fc0b60b6700 1 -- 172.21.15.154:0/3380514481 shutdown_connections 2023-09-30T22:23:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.441+0000 7fc0b60b6700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b0131180 0x7fc0b0137c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.441+0000 7fc0b60b6700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc0b0066410 0x7fc0b01371a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.441+0000 7fc0b60b6700 1 --2- 172.21.15.154:0/3380514481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0b00667e0 0x7fc0b01376e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.441+0000 7fc0b60b6700 1 -- 172.21.15.154:0/3380514481 >> 172.21.15.154:0/3380514481 conn(0x7fc0b00a2980 msgr2=0x7fc0b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.441+0000 7fc0b60b6700 1 -- 172.21.15.154:0/3380514481 shutdown_connections 2023-09-30T22:23:28.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.441+0000 7fc0b60b6700 1 -- 172.21.15.154:0/3380514481 wait complete. 2023-09-30T22:23:28.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:28.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.497+0000 7fceef941700 1 -- 172.21.15.154:0/2477243803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcee80a3470 con 0x7fcee809dec0 2023-09-30T22:23:28.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.497+0000 7fceddffb700 1 -- 172.21.15.154:0/2477243803 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fced8017070 con 0x7fcee809dec0 2023-09-30T22:23:28.498 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.499+0000 7fceef941700 1 -- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee809dec0 msgr2=0x7fcee8134bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.499+0000 7fceef941700 1 --2- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee809dec0 0x7fcee8134bc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fced8000f60 tx=0x7fced800c730 comp rx=0 tx=0).stop 2023-09-30T22:23:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.499+0000 7fceef941700 1 -- 172.21.15.154:0/2477243803 shutdown_connections 2023-09-30T22:23:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.499+0000 7fceef941700 1 --2- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee8136cb0 0x7fcee8135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.499+0000 7fceef941700 1 --2- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee806a770 0x7fcee8134680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.499+0000 7fceef941700 1 --2- 172.21.15.154:0/2477243803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcee809dec0 0x7fcee8134bc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.499+0000 7fceef941700 1 -- 172.21.15.154:0/2477243803 >> 172.21.15.154:0/2477243803 conn(0x7fcee8099c40 msgr2=0x7fcee80a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.499+0000 7fceef941700 1 -- 172.21.15.154:0/2477243803 shutdown_connections 2023-09-30T22:23:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.499+0000 7fceef941700 1 -- 172.21.15.154:0/2477243803 wait complete. 2023-09-30T22:23:28.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:28.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.545+0000 7f2150750700 1 -- 172.21.15.154:0/1796120916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f214809f0f0 con 0x7f2148133ad0 2023-09-30T22:23:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.546+0000 7f213effd700 1 -- 172.21.15.154:0/1796120916 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2144017020 con 0x7f2148133ad0 2023-09-30T22:23:28.547 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.548+0000 7f2150750700 1 -- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148133ad0 msgr2=0x7f21481c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.548+0000 7f2150750700 1 --2- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148133ad0 0x7f21481c8570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2144000f60 tx=0x7f214400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.548+0000 7f2150750700 1 -- 172.21.15.154:0/1796120916 shutdown_connections 2023-09-30T22:23:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.548+0000 7f2150750700 1 --2- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2148139280 0x7f21481c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.548+0000 7f2150750700 1 --2- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2148133ad0 0x7f21481c8570 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.548+0000 7f2150750700 1 --2- 172.21.15.154:0/1796120916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2148136960 0x7f21481c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.548+0000 7f2150750700 1 -- 172.21.15.154:0/1796120916 >> 172.21.15.154:0/1796120916 conn(0x7f2148099c40 msgr2=0x7f2148131550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.548+0000 7f2150750700 1 -- 172.21.15.154:0/1796120916 shutdown_connections 2023-09-30T22:23:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:28.548+0000 7f2150750700 1 -- 172.21.15.154:0/1796120916 wait complete. 2023-09-30T22:23:28.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:29.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.169+0000 7fc08a227700 1 Processor -- start 2023-09-30T22:23:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.169+0000 7fc08a227700 1 -- start start 2023-09-30T22:23:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.169+0000 7fc08a227700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406a770 0x7fc08406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.169+0000 7fc08a227700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc08406b080 0x7fc0841317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.169+0000 7fc08a227700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08409da80 con 0x7fc084131cf0 2023-09-30T22:23:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.169+0000 7fc08a227700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08409dce0 con 0x7fc08406b080 2023-09-30T22:23:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.169+0000 7fc08a227700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc08409eb20 con 0x7fc08406a770 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0837fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406a770 0x7fc08406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc082ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc08406b080 0x7fc0841317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc082ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc08406b080 0x7fc0841317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36130/0 (socket says 172.21.15.154:36130) 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0837fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406a770 0x7fc08406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51044/0 (socket says 172.21.15.154:51044) 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc082ffd700 1 -- 172.21.15.154:0/2026884053 learned_addr learned my addr 172.21.15.154:0/2026884053 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0837fe700 1 -- 172.21.15.154:0/2026884053 >> v2:172.21.15.154:3300/0 conn(0x7fc08406b080 msgr2=0x7fc0841317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0837fe700 1 --2- 172.21.15.154:0/2026884053 >> v2:172.21.15.154:3300/0 conn(0x7fc08406b080 0x7fc0841317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0837fe700 1 -- 172.21.15.154:0/2026884053 >> v1:172.21.15.154:6789/0 conn(0x7fc084131cf0 legacy=0x7fc084138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0837fe700 1 -- 172.21.15.154:0/2026884053 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08409d860 con 0x7fc08406a770 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc082ffd700 1 --2- 172.21.15.154:0/2026884053 >> v2:172.21.15.154:3300/0 conn(0x7fc08406b080 0x7fc0841317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0837fe700 1 --2- 172.21.15.154:0/2026884053 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406a770 0x7fc08406ab40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc078009840 tx=0x7fc078009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f940ba782c256224 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0827fc700 1 -- 172.21.15.154:0/2026884053 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078011830 con 0x7fc08406a770 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0827fc700 1 -- 172.21.15.154:0/2026884053 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078011990 con 0x7fc08406a770 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.170+0000 7fc0827fc700 1 -- 172.21.15.154:0/2026884053 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078011d20 con 0x7fc08406a770 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.171+0000 7fc08a227700 1 -- 172.21.15.154:0/2026884053 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406a770 msgr2=0x7fc08406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.171+0000 7fc08a227700 1 --2- 172.21.15.154:0/2026884053 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406a770 0x7fc08406ab40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc078009840 tx=0x7fc078009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.171+0000 7fc08a227700 1 -- 172.21.15.154:0/2026884053 shutdown_connections 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.171+0000 7fc08a227700 1 --2- 172.21.15.154:0/2026884053 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406a770 0x7fc08406ab40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.171+0000 7fc08a227700 1 --2- 172.21.15.154:0/2026884053 >> v2:172.21.15.154:3300/0 conn(0x7fc08406b080 0x7fc0841317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.171+0000 7fc08a227700 1 -- 172.21.15.154:0/2026884053 >> 172.21.15.154:0/2026884053 conn(0x7fc084099c40 msgr2=0x7fc0840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.171+0000 7fc08a227700 1 -- 172.21.15.154:0/2026884053 shutdown_connections 2023-09-30T22:23:29.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.171+0000 7fc08a227700 1 -- 172.21.15.154:0/2026884053 wait complete. 2023-09-30T22:23:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.172+0000 7fc08a227700 1 Processor -- start 2023-09-30T22:23:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.172+0000 7fc08a227700 1 -- start start 2023-09-30T22:23:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc08a227700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08406a770 0x7fc08411c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc08a227700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406b080 0x7fc08411c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc08a227700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc084131cf0 0x7fc0841c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc08a227700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08411d3a0 con 0x7fc084131cf0 2023-09-30T22:23:29.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc08a227700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc084130120 con 0x7fc08406a770 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc08a227700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840a2a30 con 0x7fc08406b080 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc0837fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08406a770 0x7fc08411c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc082ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406b080 0x7fc08411c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc0837fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08406a770 0x7fc08411c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34306/0 (socket says 172.21.15.154:34306) 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc082ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406b080 0x7fc08411c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51056/0 (socket says 172.21.15.154:51056) 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc0837fe700 1 -- 172.21.15.154:0/3548123679 learned_addr learned my addr 172.21.15.154:0/3548123679 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc083fff700 1 --2- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc084131cf0 0x7fc0841c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc082ffd700 1 -- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08406a770 msgr2=0x7fc08411c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc082ffd700 1 --2- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08406a770 0x7fc08411c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc082ffd700 1 -- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc084131cf0 msgr2=0x7fc0841c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc082ffd700 1 --2- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc084131cf0 0x7fc0841c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc082ffd700 1 -- 172.21.15.154:0/3548123679 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074009550 con 0x7fc08406b080 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc0837fe700 1 --2- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08406a770 0x7fc08411c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc082ffd700 1 --2- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406b080 0x7fc08411c630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc07400e9a0 tx=0x7fc07400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.173+0000 7fc06bfff700 1 -- 172.21.15.154:0/3548123679 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074004240 con 0x7fc08406b080 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.174+0000 7fc06bfff700 1 -- 172.21.15.154:0/3548123679 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0740043a0 con 0x7fc08406b080 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.174+0000 7fc08a227700 1 -- 172.21.15.154:0/3548123679 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0780094a0 con 0x7fc08406b080 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.174+0000 7fc06bfff700 1 -- 172.21.15.154:0/3548123679 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0740036a0 con 0x7fc08406b080 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.174+0000 7fc08a227700 1 -- 172.21.15.154:0/3548123679 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08411cb70 con 0x7fc08406b080 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.174+0000 7fc06bfff700 1 -- 172.21.15.154:0/3548123679 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc074003800 con 0x7fc08406b080 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.174+0000 7fc06bfff700 1 -- 172.21.15.154:0/3548123679 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc07403fc20 con 0x7fc08406b080 2023-09-30T22:23:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.175+0000 7fc08a227700 1 -- 172.21.15.154:0/3548123679 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08411eef0 con 0x7fc08406b080 2023-09-30T22:23:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.179+0000 7fc06bfff700 1 -- 172.21.15.154:0/3548123679 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc074013470 con 0x7fc08406b080 2023-09-30T22:23:29.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.364+0000 7fc08a227700 1 -- 172.21.15.154:0/3548123679 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc08404f2a0 con 0x7fc08406b080 2023-09-30T22:23:29.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.365+0000 7fc06bfff700 1 -- 172.21.15.154:0/3548123679 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc07401bb60 con 0x7fc08406b080 2023-09-30T22:23:29.366 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:29.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.367+0000 7fc08a227700 1 -- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406b080 msgr2=0x7fc08411c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.367+0000 7fc08a227700 1 --2- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406b080 0x7fc08411c630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc07400e9a0 tx=0x7fc07400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.367+0000 7fc08a227700 1 -- 172.21.15.154:0/3548123679 shutdown_connections 2023-09-30T22:23:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.367+0000 7fc08a227700 1 --2- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc084131cf0 0x7fc0841c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.367+0000 7fc08a227700 1 --2- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08406a770 0x7fc08411c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.367+0000 7fc08a227700 1 --2- 172.21.15.154:0/3548123679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08406b080 0x7fc08411c630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.367+0000 7fc08a227700 1 -- 172.21.15.154:0/3548123679 >> 172.21.15.154:0/3548123679 conn(0x7fc084099c40 msgr2=0x7fc0840a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.367+0000 7fc08a227700 1 -- 172.21.15.154:0/3548123679 shutdown_connections 2023-09-30T22:23:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.367+0000 7fc08a227700 1 -- 172.21.15.154:0/3548123679 wait complete. 2023-09-30T22:23:29.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:29.456 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:29.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:29.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:29.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.583+0000 7fcd9ad77700 1 Processor -- start 2023-09-30T22:23:29.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.583+0000 7fcd9ad77700 1 -- start start 2023-09-30T22:23:29.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd9ad77700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd94131980 0x7fcd94131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd9ad77700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd9409bc70 0x7fcd9409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd9ad77700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd9ad77700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9406eb30 con 0x7fcd9409bc70 2023-09-30T22:23:29.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd9ad77700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940a1640 con 0x7fcd94131980 2023-09-30T22:23:29.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd9ad77700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940a22d0 con 0x7fcd9409c5c0 2023-09-30T22:23:29.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd93fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd9409bc70 0x7fcd9409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd93fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd9409bc70 0x7fcd9409c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36154/0 (socket says 172.21.15.154:36154) 2023-09-30T22:23:29.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd93fff700 1 -- 172.21.15.154:0/2941239721 learned_addr learned my addr 172.21.15.154:0/2941239721 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:29.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd98b13700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd94131980 0x7fcd94131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.584+0000 7fcd99314700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd93fff700 1 -- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 msgr2=0x7fcd94138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:29.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd93fff700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd93fff700 1 -- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd94131980 msgr2=0x7fcd94131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:29.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd93fff700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd94131980 0x7fcd94131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd93fff700 1 -- 172.21.15.154:0/2941239721 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94131550 con 0x7fcd9409bc70 2023-09-30T22:23:29.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd98b13700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd94131980 0x7fcd94131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:29.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd99314700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:29.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd93fff700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9409bc70 0x7fcd9409c080 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009920 tx=0x7fcd80009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482c9deeb1b80312 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:29.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd937fe700 1 -- 172.21.15.154:0/2941239721 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd80011830 con 0x7fcd9409bc70 2023-09-30T22:23:29.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd937fe700 1 -- 172.21.15.154:0/2941239721 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd80011990 con 0x7fcd9409bc70 2023-09-30T22:23:29.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.585+0000 7fcd937fe700 1 -- 172.21.15.154:0/2941239721 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd80011d20 con 0x7fcd9409bc70 2023-09-30T22:23:29.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.586+0000 7fcd9ad77700 1 -- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9409bc70 msgr2=0x7fcd9409c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.586+0000 7fcd9ad77700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9409bc70 0x7fcd9409c080 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009920 tx=0x7fcd80009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:29.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.587+0000 7fcd9ad77700 1 -- 172.21.15.154:0/2941239721 shutdown_connections 2023-09-30T22:23:29.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.587+0000 7fcd9ad77700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd94131980 0x7fcd94131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.587+0000 7fcd9ad77700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.587+0000 7fcd9ad77700 1 --2- 172.21.15.154:0/2941239721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9409bc70 0x7fcd9409c080 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.587+0000 7fcd9ad77700 1 -- 172.21.15.154:0/2941239721 >> 172.21.15.154:0/2941239721 conn(0x7fcd940a2980 msgr2=0x7fcd940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.587+0000 7fcd9ad77700 1 -- 172.21.15.154:0/2941239721 shutdown_connections 2023-09-30T22:23:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.587+0000 7fcd9ad77700 1 -- 172.21.15.154:0/2941239721 wait complete. 2023-09-30T22:23:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.588+0000 7fcd9ad77700 1 Processor -- start 2023-09-30T22:23:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.588+0000 7fcd9ad77700 1 -- start start 2023-09-30T22:23:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd9ad77700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9409bc70 0x7fcd94099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd9ad77700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd9ad77700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd94131980 0x7fcd9409a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd9ad77700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94122e10 con 0x7fcd94131980 2023-09-30T22:23:29.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd9ad77700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94123190 con 0x7fcd9409bc70 2023-09-30T22:23:29.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd9ad77700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94130f10 con 0x7fcd9409c5c0 2023-09-30T22:23:29.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd93fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd98b13700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9409bc70 0x7fcd94099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd93fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94099fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51078/0 (socket says 172.21.15.154:51078) 2023-09-30T22:23:29.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd98b13700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9409bc70 0x7fcd94099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34332/0 (socket says 172.21.15.154:34332) 2023-09-30T22:23:29.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.589+0000 7fcd93fff700 1 -- 172.21.15.154:0/1658326980 learned_addr learned my addr 172.21.15.154:0/1658326980 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:29.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd99314700 1 --2- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd94131980 0x7fcd9409a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd98b13700 1 -- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 msgr2=0x7fcd94099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd98b13700 1 --2- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd98b13700 1 -- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd94131980 msgr2=0x7fcd9409a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd98b13700 1 --2- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd94131980 0x7fcd9409a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd98b13700 1 -- 172.21.15.154:0/1658326980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c009a70 con 0x7fcd9409bc70 2023-09-30T22:23:29.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd98b13700 1 --2- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9409bc70 0x7fcd94099a90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800e810 tx=0x7fcd8800eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:29.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd917fa700 1 -- 172.21.15.154:0/1658326980 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8800c070 con 0x7fcd9409bc70 2023-09-30T22:23:29.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd9ad77700 1 -- 172.21.15.154:0/1658326980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd80009550 con 0x7fcd9409bc70 2023-09-30T22:23:29.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd9ad77700 1 -- 172.21.15.154:0/1658326980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd94123450 con 0x7fcd9409bc70 2023-09-30T22:23:29.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd917fa700 1 -- 172.21.15.154:0/1658326980 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd88005c20 con 0x7fcd9409bc70 2023-09-30T22:23:29.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.590+0000 7fcd917fa700 1 -- 172.21.15.154:0/1658326980 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88006030 con 0x7fcd9409bc70 2023-09-30T22:23:29.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.591+0000 7fcd917fa700 1 -- 172.21.15.154:0/1658326980 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd88006190 con 0x7fcd9409bc70 2023-09-30T22:23:29.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.591+0000 7fcd917fa700 1 -- 172.21.15.154:0/1658326980 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd8803f0a0 con 0x7fcd9409bc70 2023-09-30T22:23:29.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.592+0000 7fcd9ad77700 1 -- 172.21.15.154:0/1658326980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd740052e0 con 0x7fcd9409bc70 2023-09-30T22:23:29.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.597+0000 7fcd917fa700 1 -- 172.21.15.154:0/1658326980 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd8800f040 con 0x7fcd9409bc70 2023-09-30T22:23:29.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.643+0000 7feb05384700 1 Processor -- start 2023-09-30T22:23:29.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.643+0000 7feb05384700 1 -- start start 2023-09-30T22:23:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.643+0000 7feb05384700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb000a1550 0x7feb00138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.643+0000 7feb05384700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb00139200 0x7feb0013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.643+0000 7feb05384700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0009e9d0 con 0x7feb000a0a70 2023-09-30T22:23:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.643+0000 7feb05384700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0009dc00 con 0x7feb000a1550 2023-09-30T22:23:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.643+0000 7feb05384700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0009dec0 con 0x7feb00139200 2023-09-30T22:23:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafe7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb000a1550 0x7feb00138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafe7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb000a1550 0x7feb00138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36186/0 (socket says 172.21.15.154:36186) 2023-09-30T22:23:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafe7fc700 1 -- 172.21.15.154:0/3395433853 learned_addr learned my addr 172.21.15.154:0/3395433853 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feaff7fe700 1 --2- 172.21.15.154:0/3395433853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb00139200 0x7feb0013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafe7fc700 1 -- 172.21.15.154:0/3395433853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb00139200 msgr2=0x7feb0013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafe7fc700 1 --2- 172.21.15.154:0/3395433853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb00139200 0x7feb0013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafe7fc700 1 -- 172.21.15.154:0/3395433853 >> v1:172.21.15.154:6789/0 conn(0x7feb000a0a70 legacy=0x7feb000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafe7fc700 1 -- 172.21.15.154:0/3395433853 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0009e6a0 con 0x7feb000a1550 2023-09-30T22:23:29.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafe7fc700 1 --2- 172.21.15.154:0/3395433853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb000a1550 0x7feb00138cc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7feaf40098f0 tx=0x7feaf4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a1777a76d185e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:29.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafdffb700 1 -- 172.21.15.154:0/3395433853 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4011830 con 0x7feb000a1550 2023-09-30T22:23:29.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafdffb700 1 -- 172.21.15.154:0/3395433853 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4011990 con 0x7feb000a1550 2023-09-30T22:23:29.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.644+0000 7feafdffb700 1 -- 172.21.15.154:0/3395433853 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4011d20 con 0x7feb000a1550 2023-09-30T22:23:29.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.645+0000 7feb05384700 1 -- 172.21.15.154:0/3395433853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb000a1550 msgr2=0x7feb00138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.645+0000 7feb05384700 1 --2- 172.21.15.154:0/3395433853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb000a1550 0x7feb00138cc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7feaf40098f0 tx=0x7feaf4009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.645+0000 7feb05384700 1 -- 172.21.15.154:0/3395433853 shutdown_connections 2023-09-30T22:23:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.645+0000 7feb05384700 1 --2- 172.21.15.154:0/3395433853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb00139200 0x7feb0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.645+0000 7feb05384700 1 --2- 172.21.15.154:0/3395433853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb000a1550 0x7feb00138cc0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.645+0000 7feb05384700 1 -- 172.21.15.154:0/3395433853 >> 172.21.15.154:0/3395433853 conn(0x7feb000a6610 msgr2=0x7feb000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.645+0000 7feb05384700 1 -- 172.21.15.154:0/3395433853 shutdown_connections 2023-09-30T22:23:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.645+0000 7feb05384700 1 -- 172.21.15.154:0/3395433853 wait complete. 2023-09-30T22:23:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.646+0000 7feb05384700 1 Processor -- start 2023-09-30T22:23:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.646+0000 7feb05384700 1 -- start start 2023-09-30T22:23:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feb05384700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb000a0a70 0x7feb0011e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feb05384700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb000a1550 0x7feb0011eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feb05384700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00139200 0x7feb0011f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feb05384700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00120540 con 0x7feb00139200 2023-09-30T22:23:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feb05384700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb000a03e0 con 0x7feb000a1550 2023-09-30T22:23:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feb05384700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb00122690 con 0x7feb000a0a70 2023-09-30T22:23:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feafe7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb000a1550 0x7feb0011eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feaff7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00139200 0x7feb0011f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feafe7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb000a1550 0x7feb0011eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34352/0 (socket says 172.21.15.154:34352) 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feafe7fc700 1 -- 172.21.15.154:0/1953165536 learned_addr learned my addr 172.21.15.154:0/1953165536 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feafeffd700 1 --2- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb000a0a70 0x7feb0011e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feaff7fe700 1 -- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb000a0a70 msgr2=0x7feb0011e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feaff7fe700 1 --2- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb000a0a70 0x7feb0011e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feaff7fe700 1 -- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb000a1550 msgr2=0x7feb0011eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feaff7fe700 1 --2- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb000a1550 0x7feb0011eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feaff7fe700 1 -- 172.21.15.154:0/1953165536 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf4009550 con 0x7feb00139200 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feafe7fc700 1 --2- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb000a1550 0x7feb0011eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feaff7fe700 1 --2- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00139200 0x7feb0011f400 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feaf800ef90 tx=0x7feaf800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feae77fe700 1 -- 172.21.15.154:0/1953165536 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800cc30 con 0x7feb00139200 2023-09-30T22:23:29.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feae77fe700 1 -- 172.21.15.154:0/1953165536 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf800f040 con 0x7feb00139200 2023-09-30T22:23:29.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.647+0000 7feb05384700 1 -- 172.21.15.154:0/1953165536 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb00122170 con 0x7feb00139200 2023-09-30T22:23:29.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.648+0000 7feae77fe700 1 -- 172.21.15.154:0/1953165536 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8009e60 con 0x7feb00139200 2023-09-30T22:23:29.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.648+0000 7feb05384700 1 -- 172.21.15.154:0/1953165536 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb00121c30 con 0x7feb00139200 2023-09-30T22:23:29.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.648+0000 7feae77fe700 1 -- 172.21.15.154:0/1953165536 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feaf8014480 con 0x7feb00139200 2023-09-30T22:23:29.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.649+0000 7feae77fe700 1 -- 172.21.15.154:0/1953165536 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feaf8040190 con 0x7feb00139200 2023-09-30T22:23:29.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.649+0000 7feb05384700 1 -- 172.21.15.154:0/1953165536 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb00121e10 con 0x7feb00139200 2023-09-30T22:23:29.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.654+0000 7feae77fe700 1 -- 172.21.15.154:0/1953165536 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb00121e10 con 0x7feb00139200 2023-09-30T22:23:29.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.703+0000 7f4895d83700 1 Processor -- start 2023-09-30T22:23:29.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.703+0000 7f4895d83700 1 -- start start 2023-09-30T22:23:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.703+0000 7f4895d83700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4890098410 0x7f48900987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.703+0000 7f4895d83700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f489009d8f0 0x7f489009dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.703+0000 7f4895d83700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489006f970 con 0x7f489009e240 2023-09-30T22:23:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.703+0000 7f4895d83700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48900720a0 con 0x7f489009d8f0 2023-09-30T22:23:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.703+0000 7f4895d83700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4890072290 con 0x7f4890098410 2023-09-30T22:23:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f489009d8f0 0x7f489009dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f489009d8f0 0x7f489009dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36206/0 (socket says 172.21.15.154:36206) 2023-09-30T22:23:29.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488effd700 1 -- 172.21.15.154:0/63116282 learned_addr learned my addr 172.21.15.154:0/63116282 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:29.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488f7fe700 1 --2- 172.21.15.154:0/63116282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4890098410 0x7f48900987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488effd700 1 -- 172.21.15.154:0/63116282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4890098410 msgr2=0x7f48900987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:29.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488effd700 1 --2- 172.21.15.154:0/63116282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4890098410 0x7f48900987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488effd700 1 -- 172.21.15.154:0/63116282 >> v1:172.21.15.154:6789/0 conn(0x7f489009e240 legacy=0x7f48901387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488effd700 1 -- 172.21.15.154:0/63116282 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489009e6a0 con 0x7f489009d8f0 2023-09-30T22:23:29.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488effd700 1 --2- 172.21.15.154:0/63116282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f489009d8f0 0x7f489009dd00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f48840098f0 tx=0x7f4884009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563e1703b3bb1238 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:29.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488e7fc700 1 -- 172.21.15.154:0/63116282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884011830 con 0x7f489009d8f0 2023-09-30T22:23:29.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488e7fc700 1 -- 172.21.15.154:0/63116282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4884011990 con 0x7f489009d8f0 2023-09-30T22:23:29.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.704+0000 7f488e7fc700 1 -- 172.21.15.154:0/63116282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884011d20 con 0x7f489009d8f0 2023-09-30T22:23:29.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.705+0000 7f4895d83700 1 -- 172.21.15.154:0/63116282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f489009d8f0 msgr2=0x7f489009dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.705+0000 7f4895d83700 1 --2- 172.21.15.154:0/63116282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f489009d8f0 0x7f489009dd00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f48840098f0 tx=0x7f4884009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.705+0000 7f4895d83700 1 -- 172.21.15.154:0/63116282 shutdown_connections 2023-09-30T22:23:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.705+0000 7f4895d83700 1 --2- 172.21.15.154:0/63116282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4890098410 0x7f48900987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.705+0000 7f4895d83700 1 --2- 172.21.15.154:0/63116282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f489009d8f0 0x7f489009dd00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.705+0000 7f4895d83700 1 -- 172.21.15.154:0/63116282 >> 172.21.15.154:0/63116282 conn(0x7f48900a2b30 msgr2=0x7f489009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.705+0000 7f4895d83700 1 -- 172.21.15.154:0/63116282 shutdown_connections 2023-09-30T22:23:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.705+0000 7f4895d83700 1 -- 172.21.15.154:0/63116282 wait complete. 2023-09-30T22:23:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.706+0000 7f4895d83700 1 Processor -- start 2023-09-30T22:23:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.706+0000 7f4895d83700 1 -- start start 2023-09-30T22:23:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4895d83700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4890098410 0x7f48901303f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4895d83700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f489009d8f0 0x7f4890130930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4895d83700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f489009e240 0x7f4890130e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4895d83700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48901317e0 con 0x7f489009e240 2023-09-30T22:23:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4895d83700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4890131e50 con 0x7f489009d8f0 2023-09-30T22:23:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4895d83700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48900a1820 con 0x7f4890098410 2023-09-30T22:23:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f489009d8f0 0x7f4890130930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f489009d8f0 0x7f4890130930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34366/0 (socket says 172.21.15.154:34366) 2023-09-30T22:23:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488effd700 1 -- 172.21.15.154:0/182862387 learned_addr learned my addr 172.21.15.154:0/182862387 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488f7fe700 1 --2- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4890098410 0x7f48901303f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488ffff700 1 --2- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f489009e240 0x7f4890130e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488effd700 1 -- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4890098410 msgr2=0x7f48901303f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488effd700 1 --2- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4890098410 0x7f48901303f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488effd700 1 -- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f489009e240 msgr2=0x7f4890130e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488effd700 1 --2- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f489009e240 0x7f4890130e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488effd700 1 -- 172.21.15.154:0/182862387 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884009550 con 0x7f489009d8f0 2023-09-30T22:23:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f488effd700 1 --2- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f489009d8f0 0x7f4890130930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f4884004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4877fff700 1 -- 172.21.15.154:0/182862387 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884004400 con 0x7f489009d8f0 2023-09-30T22:23:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4877fff700 1 -- 172.21.15.154:0/182862387 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488401f070 con 0x7f489009d8f0 2023-09-30T22:23:29.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4895d83700 1 -- 172.21.15.154:0/182862387 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489008c5c0 con 0x7f489009d8f0 2023-09-30T22:23:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.707+0000 7f4877fff700 1 -- 172.21.15.154:0/182862387 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48840038c0 con 0x7f489009d8f0 2023-09-30T22:23:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.708+0000 7f4895d83700 1 -- 172.21.15.154:0/182862387 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489008cfc0 con 0x7f489009d8f0 2023-09-30T22:23:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.708+0000 7f4877fff700 1 -- 172.21.15.154:0/182862387 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4884021030 con 0x7f489009d8f0 2023-09-30T22:23:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.708+0000 7f4895d83700 1 -- 172.21.15.154:0/182862387 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489008c750 con 0x7f489009d8f0 2023-09-30T22:23:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.709+0000 7f4877fff700 1 -- 172.21.15.154:0/182862387 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4884040a00 con 0x7f489009d8f0 2023-09-30T22:23:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.717+0000 7f4877fff700 1 -- 172.21.15.154:0/182862387 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f489008c750 con 0x7f489009d8f0 2023-09-30T22:23:29.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.796+0000 7fcd9ad77700 1 -- 172.21.15.154:0/1658326980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd74005590 con 0x7fcd9409bc70 2023-09-30T22:23:29.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.797+0000 7fcd917fa700 1 -- 172.21.15.154:0/1658326980 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd8802a090 con 0x7fcd9409bc70 2023-09-30T22:23:29.798 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:29.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.799+0000 7fcd9ad77700 1 -- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9409bc70 msgr2=0x7fcd94099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.799+0000 7fcd9ad77700 1 --2- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9409bc70 0x7fcd94099a90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800e810 tx=0x7fcd8800eb20 comp rx=0 tx=0).stop 2023-09-30T22:23:29.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.799+0000 7fcd9ad77700 1 -- 172.21.15.154:0/1658326980 shutdown_connections 2023-09-30T22:23:29.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.799+0000 7fcd9ad77700 1 --2- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd94131980 0x7fcd9409a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.799+0000 7fcd9ad77700 1 --2- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9409bc70 0x7fcd94099a90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.799+0000 7fcd9ad77700 1 --2- 172.21.15.154:0/1658326980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9409c5c0 0x7fcd94099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.799+0000 7fcd9ad77700 1 -- 172.21.15.154:0/1658326980 >> 172.21.15.154:0/1658326980 conn(0x7fcd940a2980 msgr2=0x7fcd9406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.799+0000 7fcd9ad77700 1 -- 172.21.15.154:0/1658326980 shutdown_connections 2023-09-30T22:23:29.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.799+0000 7fcd9ad77700 1 -- 172.21.15.154:0/1658326980 wait complete. 2023-09-30T22:23:29.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.867+0000 7feb05384700 1 -- 172.21.15.154:0/1953165536 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feb00121e10 con 0x7feb00139200 2023-09-30T22:23:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.867+0000 7feae77fe700 1 -- 172.21.15.154:0/1953165536 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb00121e10 con 0x7feb00139200 2023-09-30T22:23:29.868 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:29.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.869+0000 7feb05384700 1 -- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00139200 msgr2=0x7feb0011f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.869+0000 7feb05384700 1 --2- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00139200 0x7feb0011f400 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feaf800ef90 tx=0x7feaf800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.869+0000 7feb05384700 1 -- 172.21.15.154:0/1953165536 shutdown_connections 2023-09-30T22:23:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.869+0000 7feb05384700 1 --2- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb00139200 0x7feb0011f400 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.869+0000 7feb05384700 1 --2- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb000a0a70 0x7feb0011e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.869+0000 7feb05384700 1 --2- 172.21.15.154:0/1953165536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb000a1550 0x7feb0011eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.869+0000 7feb05384700 1 -- 172.21.15.154:0/1953165536 >> 172.21.15.154:0/1953165536 conn(0x7feb000a6610 msgr2=0x7feb00136d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.869+0000 7feb05384700 1 -- 172.21.15.154:0/1953165536 shutdown_connections 2023-09-30T22:23:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.869+0000 7feb05384700 1 -- 172.21.15.154:0/1953165536 wait complete. 2023-09-30T22:23:29.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.912+0000 7f4895d83700 1 -- 172.21.15.154:0/182862387 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f489008c750 con 0x7f489009d8f0 2023-09-30T22:23:29.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.912+0000 7f4877fff700 1 -- 172.21.15.154:0/182862387 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f489008c750 con 0x7f489009d8f0 2023-09-30T22:23:29.913 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:29.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.914+0000 7f4895d83700 1 -- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f489009d8f0 msgr2=0x7f4890130930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:29.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.914+0000 7f4895d83700 1 --2- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f489009d8f0 0x7f4890130930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4884000c00 tx=0x7f4884004750 comp rx=0 tx=0).stop 2023-09-30T22:23:29.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.914+0000 7f4895d83700 1 -- 172.21.15.154:0/182862387 shutdown_connections 2023-09-30T22:23:29.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.914+0000 7f4895d83700 1 --2- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f489009e240 0x7f4890130e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.914+0000 7f4895d83700 1 --2- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4890098410 0x7f48901303f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.914+0000 7f4895d83700 1 --2- 172.21.15.154:0/182862387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f489009d8f0 0x7f4890130930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.914+0000 7f4895d83700 1 -- 172.21.15.154:0/182862387 >> 172.21.15.154:0/182862387 conn(0x7f48900a2b30 msgr2=0x7f489012d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.914+0000 7f4895d83700 1 -- 172.21.15.154:0/182862387 shutdown_connections 2023-09-30T22:23:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:29.914+0000 7f4895d83700 1 -- 172.21.15.154:0/182862387 wait complete. 2023-09-30T22:23:29.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:30.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:30.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.504+0000 7f4ae4e22700 1 Processor -- start 2023-09-30T22:23:30.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.504+0000 7f4ae4e22700 1 -- start start 2023-09-30T22:23:30.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4ae4e22700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012e260 0x7f4ae012e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4ae4e22700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae012eb70 0x7f4ae006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4ae4e22700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ae009f3d0 0x7f4ae006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4ae4e22700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae012de50 con 0x7f4ae009f3d0 2023-09-30T22:23:30.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4ae4e22700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae009d470 con 0x7f4ae012e260 2023-09-30T22:23:30.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4ae4e22700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae009e010 con 0x7f4ae012eb70 2023-09-30T22:23:30.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4addd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae012eb70 0x7f4ae006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4ade59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012e260 0x7f4ae012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4aded9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ae009f3d0 0x7f4ae006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4addd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae012eb70 0x7f4ae006a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51094/0 (socket says 172.21.15.154:51094) 2023-09-30T22:23:30.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4ade59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012e260 0x7f4ae012e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34378/0 (socket says 172.21.15.154:34378) 2023-09-30T22:23:30.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4addd9b700 1 -- 172.21.15.154:0/3273579740 learned_addr learned my addr 172.21.15.154:0/3273579740 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:30.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4aded9d700 1 -- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae012eb70 msgr2=0x7f4ae006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:30.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4aded9d700 1 --2- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae012eb70 0x7f4ae006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4aded9d700 1 -- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012e260 msgr2=0x7f4ae012e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:30.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4aded9d700 1 --2- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012e260 0x7f4ae012e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4aded9d700 1 -- 172.21.15.154:0/3273579740 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae012e040 con 0x7f4ae009f3d0 2023-09-30T22:23:30.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4ade59c700 1 --2- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012e260 0x7f4ae012e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:30.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4addd9b700 1 --2- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae012eb70 0x7f4ae006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:30.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.505+0000 7f4aded9d700 1 --2- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae009f3d0 0x7f4ae006acb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009dc0 tx=0x7f4ad800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709f00edeb71ca90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4add59a700 1 -- 172.21.15.154:0/3273579740 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800e070 con 0x7f4ae009f3d0 2023-09-30T22:23:30.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4add59a700 1 -- 172.21.15.154:0/3273579740 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad800bae0 con 0x7f4ae009f3d0 2023-09-30T22:23:30.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4add59a700 1 -- 172.21.15.154:0/3273579740 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800be90 con 0x7f4ae009f3d0 2023-09-30T22:23:30.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae009f3d0 msgr2=0x7f4ae006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4ae4e22700 1 --2- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae009f3d0 0x7f4ae006acb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009dc0 tx=0x7f4ad800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:30.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3273579740 shutdown_connections 2023-09-30T22:23:30.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4ae4e22700 1 --2- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012e260 0x7f4ae012e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4ae4e22700 1 --2- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae009f3d0 0x7f4ae006acb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4ae4e22700 1 --2- 172.21.15.154:0/3273579740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae012eb70 0x7f4ae006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3273579740 >> 172.21.15.154:0/3273579740 conn(0x7f4ae0099c40 msgr2=0x7f4ae00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3273579740 shutdown_connections 2023-09-30T22:23:30.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.506+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3273579740 wait complete. 2023-09-30T22:23:30.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.507+0000 7f4ae4e22700 1 Processor -- start 2023-09-30T22:23:30.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.507+0000 7f4ae4e22700 1 -- start start 2023-09-30T22:23:30.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ae4e22700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae009f3d0 0x7f4ae0070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ae4e22700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae012e260 0x7f4ae0071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ae4e22700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012eb70 0x7f4ae00715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ae4e22700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae011bc50 con 0x7f4ae012e260 2023-09-30T22:23:30.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ae4e22700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae011b1c0 con 0x7f4ae012eb70 2023-09-30T22:23:30.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ae4e22700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae011aad0 con 0x7f4ae009f3d0 2023-09-30T22:23:30.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ade59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae009f3d0 0x7f4ae0070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4aded9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012eb70 0x7f4ae00715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ade59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae009f3d0 0x7f4ae0070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51104/0 (socket says 172.21.15.154:51104) 2023-09-30T22:23:30.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ade59c700 1 -- 172.21.15.154:0/3522305192 learned_addr learned my addr 172.21.15.154:0/3522305192 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:30.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4addd9b700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae012e260 0x7f4ae0071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ade59c700 1 -- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012eb70 msgr2=0x7f4ae00715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ade59c700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012eb70 0x7f4ae00715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ade59c700 1 -- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae012e260 msgr2=0x7f4ae0071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ade59c700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae012e260 0x7f4ae0071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ade59c700 1 -- 172.21.15.154:0/3522305192 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40094a0 con 0x7f4ae009f3d0 2023-09-30T22:23:30.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4aded9d700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012eb70 0x7f4ae00715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:30.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4addd9b700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae012e260 0x7f4ae0071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:30.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ade59c700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae009f3d0 0x7f4ae0070b50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400ebe0 tx=0x7f4ad400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4aceffd700 1 -- 172.21.15.154:0/3522305192 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4009780 con 0x7f4ae009f3d0 2023-09-30T22:23:30.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4aceffd700 1 -- 172.21.15.154:0/3522305192 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad400c850 con 0x7f4ae009f3d0 2023-09-30T22:23:30.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.508+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3522305192 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0009550 con 0x7f4ae009f3d0 2023-09-30T22:23:30.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.509+0000 7f4aceffd700 1 -- 172.21.15.154:0/3522305192 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400cbe0 con 0x7f4ae009f3d0 2023-09-30T22:23:30.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.509+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3522305192 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad8009a70 con 0x7f4ae009f3d0 2023-09-30T22:23:30.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.509+0000 7f4aceffd700 1 -- 172.21.15.154:0/3522305192 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ad400cd40 con 0x7f4ae009f3d0 2023-09-30T22:23:30.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.509+0000 7f4aceffd700 1 -- 172.21.15.154:0/3522305192 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4ad403f760 con 0x7f4ae009f3d0 2023-09-30T22:23:30.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.509+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3522305192 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae004f2a0 con 0x7f4ae009f3d0 2023-09-30T22:23:30.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.514+0000 7f4aceffd700 1 -- 172.21.15.154:0/3522305192 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ad40232f0 con 0x7f4ae009f3d0 2023-09-30T22:23:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.696+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3522305192 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ae009e980 con 0x7f4ae009f3d0 2023-09-30T22:23:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.697+0000 7f4aceffd700 1 -- 172.21.15.154:0/3522305192 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ad4021020 con 0x7f4ae009f3d0 2023-09-30T22:23:30.698 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.698+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae009f3d0 msgr2=0x7f4ae0070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.698+0000 7f4ae4e22700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae009f3d0 0x7f4ae0070b50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400ebe0 tx=0x7f4ad400eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.699+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3522305192 shutdown_connections 2023-09-30T22:23:30.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.699+0000 7f4ae4e22700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ae012eb70 0x7f4ae00715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.699+0000 7f4ae4e22700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ae009f3d0 0x7f4ae0070b50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.699+0000 7f4ae4e22700 1 --2- 172.21.15.154:0/3522305192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ae012e260 0x7f4ae0071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.699+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3522305192 >> 172.21.15.154:0/3522305192 conn(0x7f4ae0099c40 msgr2=0x7f4ae012b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.699+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3522305192 shutdown_connections 2023-09-30T22:23:30.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.699+0000 7f4ae4e22700 1 -- 172.21.15.154:0/3522305192 wait complete. 2023-09-30T22:23:30.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:30.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:30.883 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:30.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:30.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.939+0000 7f1a1b13b700 1 Processor -- start 2023-09-30T22:23:30.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.939+0000 7f1a1b13b700 1 -- start start 2023-09-30T22:23:30.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a1b13b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a1409d860 0x7f1a1409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a1b13b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a1409e170 0x7f1a141307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a1b13b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1409aaa0 con 0x7f1a14130ce0 2023-09-30T22:23:30.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a1b13b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1409f870 con 0x7f1a1409e170 2023-09-30T22:23:30.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a1b13b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1409b360 con 0x7f1a1409d860 2023-09-30T22:23:30.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a13fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a1409e170 0x7f1a141307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a18ed7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a1409d860 0x7f1a1409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a196d8700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1a14130ce0 0x7f1a141379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52188/0 (socket says 172.21.15.154:52188) 2023-09-30T22:23:30.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a196d8700 1 -- 172.21.15.154:0/4000473492 learned_addr learned my addr 172.21.15.154:0/4000473492 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:30.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a13fff700 1 -- 172.21.15.154:0/4000473492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a1409d860 msgr2=0x7f1a1409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:30.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a13fff700 1 --2- 172.21.15.154:0/4000473492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a1409d860 0x7f1a1409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a13fff700 1 -- 172.21.15.154:0/4000473492 >> v1:172.21.15.154:6789/0 conn(0x7f1a14130ce0 legacy=0x7f1a141379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a13fff700 1 -- 172.21.15.154:0/4000473492 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1409b620 con 0x7f1a1409e170 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.940+0000 7f1a18ed7700 1 --2- 172.21.15.154:0/4000473492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a1409d860 0x7f1a1409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a13fff700 1 --2- 172.21.15.154:0/4000473492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 0x7f1a141307a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009840 tx=0x7f1a00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a4b5fc92bf2938 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a137fe700 1 -- 172.21.15.154:0/4000473492 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00011830 con 0x7f1a1409e170 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a137fe700 1 -- 172.21.15.154:0/4000473492 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a00011990 con 0x7f1a1409e170 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a137fe700 1 -- 172.21.15.154:0/4000473492 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00011d20 con 0x7f1a1409e170 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a1b13b700 1 -- 172.21.15.154:0/4000473492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 msgr2=0x7f1a141307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a1b13b700 1 --2- 172.21.15.154:0/4000473492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 0x7f1a141307a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009840 tx=0x7f1a00009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a1b13b700 1 -- 172.21.15.154:0/4000473492 shutdown_connections 2023-09-30T22:23:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a1b13b700 1 --2- 172.21.15.154:0/4000473492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a1409d860 0x7f1a1409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a1b13b700 1 --2- 172.21.15.154:0/4000473492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 0x7f1a141307a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.941+0000 7f1a1b13b700 1 -- 172.21.15.154:0/4000473492 >> 172.21.15.154:0/4000473492 conn(0x7f1a14099c40 msgr2=0x7f1a140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.942+0000 7f1a1b13b700 1 -- 172.21.15.154:0/4000473492 shutdown_connections 2023-09-30T22:23:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.942+0000 7f1a1b13b700 1 -- 172.21.15.154:0/4000473492 wait complete. 2023-09-30T22:23:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a1b13b700 1 Processor -- start 2023-09-30T22:23:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a1b13b700 1 -- start start 2023-09-30T22:23:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a1b13b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a1409d860 0x7f1a14138140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a1b13b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 0x7f1a14138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a1b13b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a14130ce0 0x7f1a141c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:30.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a1b13b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1413b5c0 con 0x7f1a1409e170 2023-09-30T22:23:30.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a1b13b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1413bd60 con 0x7f1a1409d860 2023-09-30T22:23:30.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a1b13b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14136b10 con 0x7f1a14130ce0 2023-09-30T22:23:30.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a13fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 0x7f1a14138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a18ed7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a1409d860 0x7f1a14138140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a18ed7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a1409d860 0x7f1a14138140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34394/0 (socket says 172.21.15.154:34394) 2023-09-30T22:23:30.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a18ed7700 1 -- 172.21.15.154:0/3363200824 learned_addr learned my addr 172.21.15.154:0/3363200824 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:30.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a196d8700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a14130ce0 0x7f1a141c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:30.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.943+0000 7f1a13fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 0x7f1a14138680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36250/0 (socket says 172.21.15.154:36250) 2023-09-30T22:23:30.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a18ed7700 1 -- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a14130ce0 msgr2=0x7f1a141c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a18ed7700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a14130ce0 0x7f1a141c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a18ed7700 1 -- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 msgr2=0x7f1a14138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:30.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a18ed7700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 0x7f1a14138680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:30.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a18ed7700 1 -- 172.21.15.154:0/3363200824 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080094a0 con 0x7f1a1409d860 2023-09-30T22:23:30.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a196d8700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a14130ce0 0x7f1a141c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:30.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a13fff700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 0x7f1a14138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:30.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a18ed7700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a1409d860 0x7f1a14138140 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800ebe0 tx=0x7f1a0800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:30.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a117fa700 1 -- 172.21.15.154:0/3363200824 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08009800 con 0x7f1a1409d860 2023-09-30T22:23:30.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a117fa700 1 -- 172.21.15.154:0/3363200824 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0800c910 con 0x7f1a1409d860 2023-09-30T22:23:30.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a117fa700 1 -- 172.21.15.154:0/3363200824 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800cc80 con 0x7f1a1409d860 2023-09-30T22:23:30.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a1b13b700 1 -- 172.21.15.154:0/3363200824 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a000094a0 con 0x7f1a1409d860 2023-09-30T22:23:30.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.944+0000 7f1a1b13b700 1 -- 172.21.15.154:0/3363200824 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1409c8b0 con 0x7f1a1409d860 2023-09-30T22:23:30.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.945+0000 7f1a117fa700 1 -- 172.21.15.154:0/3363200824 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a08013470 con 0x7f1a1409d860 2023-09-30T22:23:30.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.945+0000 7f1a1b13b700 1 -- 172.21.15.154:0/3363200824 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1404f2a0 con 0x7f1a1409d860 2023-09-30T22:23:30.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.946+0000 7f1a117fa700 1 -- 172.21.15.154:0/3363200824 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a0803fd10 con 0x7f1a1409d860 2023-09-30T22:23:30.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:30.950+0000 7f1a117fa700 1 -- 172.21.15.154:0/3363200824 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a08013720 con 0x7f1a1409d860 2023-09-30T22:23:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.013+0000 7f18cf447700 1 Processor -- start 2023-09-30T22:23:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.013+0000 7f18cf447700 1 -- start start 2023-09-30T22:23:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.013+0000 7f18cf447700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18c806a770 0x7f18c806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.013+0000 7f18cf447700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c806b080 0x7f18c81317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.013+0000 7f18cf447700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c8131cf0 0x7f18c8132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cf447700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c809f770 con 0x7f18c806a770 2023-09-30T22:23:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cf447700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c809dce0 con 0x7f18c8131cf0 2023-09-30T22:23:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cf447700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18c809da80 con 0x7f18c806b080 2023-09-30T22:23:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd1e3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18c806a770 0x7f18c806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cc9e2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c806b080 0x7f18c81317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd1e3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18c806a770 0x7f18c806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36264/0 (socket says 172.21.15.154:36264) 2023-09-30T22:23:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd1e3700 1 -- 172.21.15.154:0/721097377 learned_addr learned my addr 172.21.15.154:0/721097377 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd9e4700 1 --2- 172.21.15.154:0/721097377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c8131cf0 0x7f18c8132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd9e4700 1 -- 172.21.15.154:0/721097377 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c806b080 msgr2=0x7f18c81317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd9e4700 1 --2- 172.21.15.154:0/721097377 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c806b080 0x7f18c81317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd9e4700 1 -- 172.21.15.154:0/721097377 >> v2:172.21.15.154:3300/0 conn(0x7f18c806a770 msgr2=0x7f18c806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd9e4700 1 --2- 172.21.15.154:0/721097377 >> v2:172.21.15.154:3300/0 conn(0x7f18c806a770 0x7f18c806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd9e4700 1 -- 172.21.15.154:0/721097377 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c809eb20 con 0x7f18c8131cf0 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd1e3700 1 --2- 172.21.15.154:0/721097377 >> v2:172.21.15.154:3300/0 conn(0x7f18c806a770 0x7f18c806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18cd9e4700 1 --2- 172.21.15.154:0/721097377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c8131cf0 0x7f18c8132170 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009d90 tx=0x7f18c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dda380a7bc1c9c66 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18bffff700 1 -- 172.21.15.154:0/721097377 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c000e070 con 0x7f18c8131cf0 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.014+0000 7f18bffff700 1 -- 172.21.15.154:0/721097377 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c000bb20 con 0x7f18c8131cf0 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18bffff700 1 -- 172.21.15.154:0/721097377 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0012430 con 0x7f18c8131cf0 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18cf447700 1 -- 172.21.15.154:0/721097377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c8131cf0 msgr2=0x7f18c8132170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18cf447700 1 --2- 172.21.15.154:0/721097377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c8131cf0 0x7f18c8132170 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009d90 tx=0x7f18c000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18cf447700 1 -- 172.21.15.154:0/721097377 shutdown_connections 2023-09-30T22:23:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18cf447700 1 --2- 172.21.15.154:0/721097377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c8131cf0 0x7f18c8132170 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18cf447700 1 --2- 172.21.15.154:0/721097377 >> v2:172.21.15.154:3300/0 conn(0x7f18c806a770 0x7f18c806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18cf447700 1 --2- 172.21.15.154:0/721097377 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c806b080 0x7f18c81317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18cf447700 1 -- 172.21.15.154:0/721097377 >> 172.21.15.154:0/721097377 conn(0x7f18c8099c40 msgr2=0x7f18c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18cf447700 1 -- 172.21.15.154:0/721097377 shutdown_connections 2023-09-30T22:23:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.015+0000 7f18cf447700 1 -- 172.21.15.154:0/721097377 wait complete. 2023-09-30T22:23:31.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cf447700 1 Processor -- start 2023-09-30T22:23:31.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cf447700 1 -- start start 2023-09-30T22:23:31.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cf447700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c806a770 0x7f18c809ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cf447700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c806b080 0x7f18c809b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cf447700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c8131cf0 0x7f18c81c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cf447700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8122310 con 0x7f18c806b080 2023-09-30T22:23:31.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cf447700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c809b8e0 con 0x7f18c806a770 2023-09-30T22:23:31.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cf447700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8131360 con 0x7f18c8131cf0 2023-09-30T22:23:31.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cd9e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c8131cf0 0x7f18c81c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cd9e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c8131cf0 0x7f18c81c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51144/0 (socket says 172.21.15.154:51144) 2023-09-30T22:23:31.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cd9e4700 1 -- 172.21.15.154:0/2895766621 learned_addr learned my addr 172.21.15.154:0/2895766621 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:31.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cd1e3700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c806a770 0x7f18c809ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.017+0000 7f18cc9e2700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c806b080 0x7f18c809b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18cd1e3700 1 -- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c8131cf0 msgr2=0x7f18c81c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18cd1e3700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c8131cf0 0x7f18c81c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18cd1e3700 1 -- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c806b080 msgr2=0x7f18c809b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18cd1e3700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c806b080 0x7f18c809b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18cd1e3700 1 -- 172.21.15.154:0/2895766621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4009550 con 0x7f18c806a770 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18cd9e4700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c8131cf0 0x7f18c81c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18cd1e3700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c806a770 0x7f18c809ae60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f18c400e9a0 tx=0x7f18c400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18bdffb700 1 -- 172.21.15.154:0/2895766621 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4004030 con 0x7f18c806a770 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18bdffb700 1 -- 172.21.15.154:0/2895766621 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c4004190 con 0x7f18c806a770 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18cf447700 1 -- 172.21.15.154:0/2895766621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c0009a70 con 0x7f18c806a770 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18bdffb700 1 -- 172.21.15.154:0/2895766621 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4004520 con 0x7f18c806a770 2023-09-30T22:23:31.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.018+0000 7f18cf447700 1 -- 172.21.15.154:0/2895766621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c809a970 con 0x7f18c806a770 2023-09-30T22:23:31.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.019+0000 7f18bdffb700 1 -- 172.21.15.154:0/2895766621 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18c400c850 con 0x7f18c806a770 2023-09-30T22:23:31.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.019+0000 7f18bdffb700 1 -- 172.21.15.154:0/2895766621 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f18c403f5a0 con 0x7f18c806a770 2023-09-30T22:23:31.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.020+0000 7f18cf447700 1 -- 172.21.15.154:0/2895766621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c80a27c0 con 0x7f18c806a770 2023-09-30T22:23:31.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.024+0000 7f18bdffb700 1 -- 172.21.15.154:0/2895766621 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18c40036a0 con 0x7f18c806a770 2023-09-30T22:23:31.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.056+0000 7fc65094c700 1 Processor -- start 2023-09-30T22:23:31.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.056+0000 7fc65094c700 1 -- start start 2023-09-30T22:23:31.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc65094c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c0a1550 0x7fc64c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc65094c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc64c139200 0x7fc64c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc65094c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c09e9d0 con 0x7fc64c0a0a70 2023-09-30T22:23:31.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc65094c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c09dc00 con 0x7fc64c139200 2023-09-30T22:23:31.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc65094c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c09dec0 con 0x7fc64c0a1550 2023-09-30T22:23:31.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc649d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c0a1550 0x7fc64c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc64ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc64c139200 0x7fc64c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc649d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c0a1550 0x7fc64c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51146/0 (socket says 172.21.15.154:51146) 2023-09-30T22:23:31.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc649d9b700 1 -- 172.21.15.154:0/2904661831 learned_addr learned my addr 172.21.15.154:0/2904661831 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc64ad9d700 1 -- 172.21.15.154:0/2904661831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c0a1550 msgr2=0x7fc64c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc64ad9d700 1 --2- 172.21.15.154:0/2904661831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c0a1550 0x7fc64c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc64ad9d700 1 -- 172.21.15.154:0/2904661831 >> v1:172.21.15.154:6789/0 conn(0x7fc64c0a0a70 legacy=0x7fc64c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.057+0000 7fc64ad9d700 1 -- 172.21.15.154:0/2904661831 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c09e6a0 con 0x7fc64c139200 2023-09-30T22:23:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc64ad9d700 1 --2- 172.21.15.154:0/2904661831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c139200 0x7fc64c13b5e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc644009d90 tx=0x7fc64400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efa92bc6d86ec3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc64959a700 1 -- 172.21.15.154:0/2904661831 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64400e070 con 0x7fc64c139200 2023-09-30T22:23:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc64959a700 1 -- 172.21.15.154:0/2904661831 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64400bb20 con 0x7fc64c139200 2023-09-30T22:23:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc64959a700 1 -- 172.21.15.154:0/2904661831 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644012430 con 0x7fc64c139200 2023-09-30T22:23:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc65094c700 1 -- 172.21.15.154:0/2904661831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c139200 msgr2=0x7fc64c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc65094c700 1 --2- 172.21.15.154:0/2904661831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c139200 0x7fc64c13b5e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc644009d90 tx=0x7fc64400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc65094c700 1 -- 172.21.15.154:0/2904661831 shutdown_connections 2023-09-30T22:23:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc65094c700 1 --2- 172.21.15.154:0/2904661831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c139200 0x7fc64c13b5e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc65094c700 1 --2- 172.21.15.154:0/2904661831 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c0a1550 0x7fc64c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.058+0000 7fc65094c700 1 -- 172.21.15.154:0/2904661831 >> 172.21.15.154:0/2904661831 conn(0x7fc64c0a6610 msgr2=0x7fc64c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.059+0000 7fc65094c700 1 -- 172.21.15.154:0/2904661831 shutdown_connections 2023-09-30T22:23:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.059+0000 7fc65094c700 1 -- 172.21.15.154:0/2904661831 wait complete. 2023-09-30T22:23:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc65094c700 1 Processor -- start 2023-09-30T22:23:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc65094c700 1 -- start start 2023-09-30T22:23:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc65094c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc64c0a0a70 0x7fc64c11e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc65094c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c0a1550 0x7fc64c11ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc65094c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c139200 0x7fc64c11f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc65094c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c134150 con 0x7fc64c0a1550 2023-09-30T22:23:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc65094c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c134730 con 0x7fc64c0a0a70 2023-09-30T22:23:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc65094c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1204f0 con 0x7fc64c139200 2023-09-30T22:23:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc649d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c0a1550 0x7fc64c11ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc64a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc64c0a0a70 0x7fc64c11e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc64ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c139200 0x7fc64c11f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc649d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c0a1550 0x7fc64c11ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36296/0 (socket says 172.21.15.154:36296) 2023-09-30T22:23:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc64a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc64c0a0a70 0x7fc64c11e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34412/0 (socket says 172.21.15.154:34412) 2023-09-30T22:23:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.060+0000 7fc649d9b700 1 -- 172.21.15.154:0/1846195616 learned_addr learned my addr 172.21.15.154:0/1846195616 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc649d9b700 1 -- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c139200 msgr2=0x7fc64c11f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc649d9b700 1 --2- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c139200 0x7fc64c11f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc649d9b700 1 -- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc64c0a0a70 msgr2=0x7fc64c11e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc649d9b700 1 --2- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc64c0a0a70 0x7fc64c11e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc649d9b700 1 -- 172.21.15.154:0/1846195616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc644009a70 con 0x7fc64c0a1550 2023-09-30T22:23:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc64a59c700 1 --2- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc64c0a0a70 0x7fc64c11e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:31.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc649d9b700 1 --2- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c0a1550 0x7fc64c11ee10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc64000e940 tx=0x7fc64000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc63affd700 1 -- 172.21.15.154:0/1846195616 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6400096a0 con 0x7fc64c0a1550 2023-09-30T22:23:31.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc63affd700 1 -- 172.21.15.154:0/1846195616 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc640013680 con 0x7fc64c0a1550 2023-09-30T22:23:31.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc63affd700 1 -- 172.21.15.154:0/1846195616 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640013a30 con 0x7fc64c0a1550 2023-09-30T22:23:31.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc65094c700 1 -- 172.21.15.154:0/1846195616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c122080 con 0x7fc64c0a1550 2023-09-30T22:23:31.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.061+0000 7fc65094c700 1 -- 172.21.15.154:0/1846195616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c122360 con 0x7fc64c0a1550 2023-09-30T22:23:31.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.062+0000 7fc63affd700 1 -- 172.21.15.154:0/1846195616 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc640013b90 con 0x7fc64c0a1550 2023-09-30T22:23:31.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.062+0000 7fc65094c700 1 -- 172.21.15.154:0/1846195616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c04f2a0 con 0x7fc64c0a1550 2023-09-30T22:23:31.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.062+0000 7fc63affd700 1 -- 172.21.15.154:0/1846195616 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc64003f690 con 0x7fc64c0a1550 2023-09-30T22:23:31.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.067+0000 7fc63affd700 1 -- 172.21.15.154:0/1846195616 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc640017020 con 0x7fc64c0a1550 2023-09-30T22:23:31.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.149+0000 7f1a1b13b700 1 -- 172.21.15.154:0/3363200824 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a14135710 con 0x7f1a1409d860 2023-09-30T22:23:31.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.149+0000 7f1a117fa700 1 -- 172.21.15.154:0/3363200824 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a08021070 con 0x7f1a1409d860 2023-09-30T22:23:31.150 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:31.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.151+0000 7f1a1b13b700 1 -- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a1409d860 msgr2=0x7f1a14138140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.151+0000 7f1a1b13b700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a1409d860 0x7f1a14138140 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800ebe0 tx=0x7f1a0800eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.151+0000 7f1a1b13b700 1 -- 172.21.15.154:0/3363200824 shutdown_connections 2023-09-30T22:23:31.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.151+0000 7f1a1b13b700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a14130ce0 0x7f1a141c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.151+0000 7f1a1b13b700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a1409d860 0x7f1a14138140 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.151+0000 7f1a1b13b700 1 --2- 172.21.15.154:0/3363200824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a1409e170 0x7f1a14138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.151+0000 7f1a1b13b700 1 -- 172.21.15.154:0/3363200824 >> 172.21.15.154:0/3363200824 conn(0x7f1a14099c40 msgr2=0x7f1a14139500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.151+0000 7f1a1b13b700 1 -- 172.21.15.154:0/3363200824 shutdown_connections 2023-09-30T22:23:31.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.151+0000 7f1a1b13b700 1 -- 172.21.15.154:0/3363200824 wait complete. 2023-09-30T22:23:31.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:31.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.222+0000 7f18cf447700 1 -- 172.21.15.154:0/2895766621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f18c8122170 con 0x7f18c806a770 2023-09-30T22:23:31.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.222+0000 7f18bdffb700 1 -- 172.21.15.154:0/2895766621 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18c8122170 con 0x7f18c806a770 2023-09-30T22:23:31.223 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.226+0000 7f18cf447700 1 -- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c806a770 msgr2=0x7f18c809ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.226+0000 7f18cf447700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c806a770 0x7f18c809ae60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f18c400e9a0 tx=0x7f18c400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.226+0000 7f18cf447700 1 -- 172.21.15.154:0/2895766621 shutdown_connections 2023-09-30T22:23:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.226+0000 7f18cf447700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18c8131cf0 0x7f18c81c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.226+0000 7f18cf447700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18c806a770 0x7f18c809ae60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.226+0000 7f18cf447700 1 --2- 172.21.15.154:0/2895766621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18c806b080 0x7f18c809b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.226+0000 7f18cf447700 1 -- 172.21.15.154:0/2895766621 >> 172.21.15.154:0/2895766621 conn(0x7f18c8099c40 msgr2=0x7f18c81b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.226+0000 7f18cf447700 1 -- 172.21.15.154:0/2895766621 shutdown_connections 2023-09-30T22:23:31.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.226+0000 7f18cf447700 1 -- 172.21.15.154:0/2895766621 wait complete. 2023-09-30T22:23:31.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:31.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.270+0000 7fc65094c700 1 -- 172.21.15.154:0/1846195616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc64c072980 con 0x7fc64c0a1550 2023-09-30T22:23:31.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.271+0000 7fc63affd700 1 -- 172.21.15.154:0/1846195616 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc64001ba00 con 0x7fc64c0a1550 2023-09-30T22:23:31.272 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.273+0000 7fc65094c700 1 -- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c0a1550 msgr2=0x7fc64c11ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.273+0000 7fc65094c700 1 --2- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c0a1550 0x7fc64c11ee10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc64000e940 tx=0x7fc64000ec50 comp rx=0 tx=0).stop 2023-09-30T22:23:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.273+0000 7fc65094c700 1 -- 172.21.15.154:0/1846195616 shutdown_connections 2023-09-30T22:23:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.273+0000 7fc65094c700 1 --2- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc64c139200 0x7fc64c11f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.273+0000 7fc65094c700 1 --2- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc64c0a0a70 0x7fc64c11e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.273+0000 7fc65094c700 1 --2- 172.21.15.154:0/1846195616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c0a1550 0x7fc64c11ee10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.273+0000 7fc65094c700 1 -- 172.21.15.154:0/1846195616 >> 172.21.15.154:0/1846195616 conn(0x7fc64c0a6610 msgr2=0x7fc64c138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.273+0000 7fc65094c700 1 -- 172.21.15.154:0/1846195616 shutdown_connections 2023-09-30T22:23:31.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.273+0000 7fc65094c700 1 -- 172.21.15.154:0/1846195616 wait complete. 2023-09-30T22:23:31.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:31.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:31.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.837+0000 7f40e64ec700 1 Processor -- start 2023-09-30T22:23:31.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.837+0000 7f40e64ec700 1 -- start start 2023-09-30T22:23:31.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.837+0000 7f40e64ec700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40e009e340 0x7f40e01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.837+0000 7f40e64ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e0135f20 0x7f40e0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.837+0000 7f40e64ec700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e009aaa0 con 0x7f40e009d860 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.837+0000 7f40e64ec700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e009e730 con 0x7f40e009e340 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.837+0000 7f40e64ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e009f870 con 0x7f40e0135f20 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40e4a89700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e0135f20 0x7f40e0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40df7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40e009e340 0x7f40e01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40e4a89700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e0135f20 0x7f40e0138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34424/0 (socket says 172.21.15.154:34424) 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40df7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40e009e340 0x7f40e01359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36300/0 (socket says 172.21.15.154:36300) 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40e4a89700 1 -- 172.21.15.154:0/2431241809 learned_addr learned my addr 172.21.15.154:0/2431241809 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40e4a89700 1 -- 172.21.15.154:0/2431241809 >> v2:172.21.15.154:3300/0 conn(0x7f40e009e340 msgr2=0x7f40e01359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:31.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40e4a89700 1 --2- 172.21.15.154:0/2431241809 >> v2:172.21.15.154:3300/0 conn(0x7f40e009e340 0x7f40e01359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40e4a89700 1 -- 172.21.15.154:0/2431241809 >> v1:172.21.15.154:6789/0 conn(0x7f40e009d860 legacy=0x7f40e009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40e4a89700 1 -- 172.21.15.154:0/2431241809 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e009b360 con 0x7f40e0135f20 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40e4a89700 1 --2- 172.21.15.154:0/2431241809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e0135f20 0x7f40e0138300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f40d800d180 tx=0x7f40d800d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41983551d94967f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40deffd700 1 -- 172.21.15.154:0/2431241809 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8010070 con 0x7f40e0135f20 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40deffd700 1 -- 172.21.15.154:0/2431241809 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d800dd00 con 0x7f40e0135f20 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.838+0000 7f40deffd700 1 -- 172.21.15.154:0/2431241809 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800b310 con 0x7f40e0135f20 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.839+0000 7f40e64ec700 1 -- 172.21.15.154:0/2431241809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e0135f20 msgr2=0x7f40e0138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.839+0000 7f40e64ec700 1 --2- 172.21.15.154:0/2431241809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e0135f20 0x7f40e0138300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f40d800d180 tx=0x7f40d800d490 comp rx=0 tx=0).stop 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.839+0000 7f40e64ec700 1 -- 172.21.15.154:0/2431241809 shutdown_connections 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.839+0000 7f40e64ec700 1 --2- 172.21.15.154:0/2431241809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e0135f20 0x7f40e0138300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.839+0000 7f40e64ec700 1 --2- 172.21.15.154:0/2431241809 >> v2:172.21.15.154:3300/0 conn(0x7f40e009e340 0x7f40e01359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.839+0000 7f40e64ec700 1 -- 172.21.15.154:0/2431241809 >> 172.21.15.154:0/2431241809 conn(0x7f40e0099c40 msgr2=0x7f40e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:31.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.839+0000 7f40e64ec700 1 -- 172.21.15.154:0/2431241809 shutdown_connections 2023-09-30T22:23:31.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.839+0000 7f40e64ec700 1 -- 172.21.15.154:0/2431241809 wait complete. 2023-09-30T22:23:31.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40e64ec700 1 Processor -- start 2023-09-30T22:23:31.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40e64ec700 1 -- start start 2023-09-30T22:23:31.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40e64ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e009d860 0x7f40e011b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40e64ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e009e340 0x7f40e011b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40e64ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40e0135f20 0x7f40e011be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:31.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40e64ec700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e011cf80 con 0x7f40e009d860 2023-09-30T22:23:31.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40e64ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e011ebb0 con 0x7f40e009e340 2023-09-30T22:23:31.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40e64ec700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40e011e620 con 0x7f40e0135f20 2023-09-30T22:23:31.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40dffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e009d860 0x7f40e011b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40df7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e009e340 0x7f40e011b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40dffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e009d860 0x7f40e011b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36314/0 (socket says 172.21.15.154:36314) 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40dffff700 1 -- 172.21.15.154:0/2483918035 learned_addr learned my addr 172.21.15.154:0/2483918035 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.840+0000 7f40e4a89700 1 --2- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40e0135f20 0x7f40e011be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40df7fe700 1 -- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40e0135f20 msgr2=0x7f40e011be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40df7fe700 1 --2- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40e0135f20 0x7f40e011be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40df7fe700 1 -- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e009d860 msgr2=0x7f40e011b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40df7fe700 1 --2- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e009d860 0x7f40e011b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40df7fe700 1 -- 172.21.15.154:0/2483918035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d800bd40 con 0x7f40e009e340 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40dffff700 1 --2- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e009d860 0x7f40e011b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40df7fe700 1 --2- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e009e340 0x7f40e011b950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e8d0 tx=0x7f40d000ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40dcff9700 1 -- 172.21.15.154:0/2483918035 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0013680 con 0x7f40e009e340 2023-09-30T22:23:31.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40dcff9700 1 -- 172.21.15.154:0/2483918035 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d00137e0 con 0x7f40e009e340 2023-09-30T22:23:31.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40e64ec700 1 -- 172.21.15.154:0/2483918035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e00a0840 con 0x7f40e009e340 2023-09-30T22:23:31.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40dcff9700 1 -- 172.21.15.154:0/2483918035 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0013b50 con 0x7f40e009e340 2023-09-30T22:23:31.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.841+0000 7f40e64ec700 1 -- 172.21.15.154:0/2483918035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e011d760 con 0x7f40e009e340 2023-09-30T22:23:31.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.842+0000 7f40dcff9700 1 -- 172.21.15.154:0/2483918035 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40d0013cb0 con 0x7f40e009e340 2023-09-30T22:23:31.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.842+0000 7f40e64ec700 1 -- 172.21.15.154:0/2483918035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e011e1d0 con 0x7f40e009e340 2023-09-30T22:23:31.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.842+0000 7f40dcff9700 1 -- 172.21.15.154:0/2483918035 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40d003f980 con 0x7f40e009e340 2023-09-30T22:23:31.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:31.846+0000 7f40dcff9700 1 -- 172.21.15.154:0/2483918035 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40d0017070 con 0x7f40e009e340 2023-09-30T22:23:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.034+0000 7f40e64ec700 1 -- 172.21.15.154:0/2483918035 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f40e004f2a0 con 0x7f40e009e340 2023-09-30T22:23:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.034+0000 7f40dcff9700 1 -- 172.21.15.154:0/2483918035 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40d0021020 con 0x7f40e009e340 2023-09-30T22:23:32.035 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.036+0000 7f40e64ec700 1 -- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e009e340 msgr2=0x7f40e011b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.036+0000 7f40e64ec700 1 --2- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e009e340 0x7f40e011b950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e8d0 tx=0x7f40d000ebe0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.036+0000 7f40e64ec700 1 -- 172.21.15.154:0/2483918035 shutdown_connections 2023-09-30T22:23:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.036+0000 7f40e64ec700 1 --2- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40e0135f20 0x7f40e011be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.036+0000 7f40e64ec700 1 --2- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40e009d860 0x7f40e011b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.036+0000 7f40e64ec700 1 --2- 172.21.15.154:0/2483918035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40e009e340 0x7f40e011b950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.036+0000 7f40e64ec700 1 -- 172.21.15.154:0/2483918035 >> 172.21.15.154:0/2483918035 conn(0x7f40e0099c40 msgr2=0x7f40e0132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.036+0000 7f40e64ec700 1 -- 172.21.15.154:0/2483918035 shutdown_connections 2023-09-30T22:23:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.036+0000 7f40e64ec700 1 -- 172.21.15.154:0/2483918035 wait complete. 2023-09-30T22:23:32.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:32.168 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:32.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:32.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:32.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.295+0000 7fa50fc67700 1 Processor -- start 2023-09-30T22:23:32.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.295+0000 7fa50fc67700 1 -- start start 2023-09-30T22:23:32.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.296+0000 7fa50fc67700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa508133ad0 0x7fa508133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.296+0000 7fa50fc67700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.296+0000 7fa50fc67700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50806b2d0 con 0x7fa5081300a0 2023-09-30T22:23:32.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.296+0000 7fa50fc67700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa508133610 con 0x7fa508133ad0 2023-09-30T22:23:32.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.296+0000 7fa50fc67700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50809a500 con 0x7fa508130bc0 2023-09-30T22:23:32.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.296+0000 7fa50d202700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa5081300a0 0x7fa5081304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52218/0 (socket says 172.21.15.154:52218) 2023-09-30T22:23:32.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.296+0000 7fa50d202700 1 -- 172.21.15.154:0/2364817394 learned_addr learned my addr 172.21.15.154:0/2364817394 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:32.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.296+0000 7fa50e204700 1 --2- 172.21.15.154:0/2364817394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.297+0000 7fa50da03700 1 --2- 172.21.15.154:0/2364817394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa508133ad0 0x7fa508133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.297+0000 7fa50e204700 1 -- 172.21.15.154:0/2364817394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa508133ad0 msgr2=0x7fa508133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:32.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.297+0000 7fa50e204700 1 --2- 172.21.15.154:0/2364817394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa508133ad0 0x7fa508133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.296+0000 7fa50ca01700 1 -- 172.21.15.154:0/2364817394 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968077565 0 0) 0x7fa50806b2d0 con 0x7fa5081300a0 2023-09-30T22:23:32.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.297+0000 7fa50e204700 1 -- 172.21.15.154:0/2364817394 >> v1:172.21.15.154:6789/0 conn(0x7fa5081300a0 legacy=0x7fa5081304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.297+0000 7fa50e204700 1 -- 172.21.15.154:0/2364817394 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5081338b0 con 0x7fa508130bc0 2023-09-30T22:23:32.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.297+0000 7fa50e204700 1 --2- 172.21.15.154:0/2364817394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50813b990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa500009dc0 tx=0x7fa50000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f25d560bd5b5bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.297+0000 7fa50ca01700 1 -- 172.21.15.154:0/2364817394 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000e070 con 0x7fa508130bc0 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.297+0000 7fa50ca01700 1 -- 172.21.15.154:0/2364817394 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50000bbd0 con 0x7fa508130bc0 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.297+0000 7fa50ca01700 1 -- 172.21.15.154:0/2364817394 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500012430 con 0x7fa508130bc0 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.298+0000 7fa50fc67700 1 -- 172.21.15.154:0/2364817394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 msgr2=0x7fa50813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.298+0000 7fa50fc67700 1 --2- 172.21.15.154:0/2364817394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50813b990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa500009dc0 tx=0x7fa50000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.298+0000 7fa50fc67700 1 -- 172.21.15.154:0/2364817394 shutdown_connections 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.298+0000 7fa50fc67700 1 --2- 172.21.15.154:0/2364817394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50813b990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.298+0000 7fa50fc67700 1 --2- 172.21.15.154:0/2364817394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa508133ad0 0x7fa508133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.298+0000 7fa50fc67700 1 -- 172.21.15.154:0/2364817394 >> 172.21.15.154:0/2364817394 conn(0x7fa508099c40 msgr2=0x7fa5080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.298+0000 7fa50fc67700 1 -- 172.21.15.154:0/2364817394 shutdown_connections 2023-09-30T22:23:32.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.298+0000 7fa50fc67700 1 -- 172.21.15.154:0/2364817394 wait complete. 2023-09-30T22:23:32.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.299+0000 7fa50fc67700 1 Processor -- start 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.299+0000 7fa50fc67700 1 -- start start 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50fc67700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081300a0 0x7fa50811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50fc67700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50fc67700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa508133ad0 0x7fa50811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50fc67700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50811f080 con 0x7fa508133ad0 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50fc67700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa508120030 con 0x7fa5081300a0 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50fc67700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50811ed90 con 0x7fa508130bc0 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50da03700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081300a0 0x7fa50811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50da03700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081300a0 0x7fa50811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34456/0 (socket says 172.21.15.154:34456) 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50da03700 1 -- 172.21.15.154:0/1366984124 learned_addr learned my addr 172.21.15.154:0/1366984124 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50e204700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa508133ad0 0x7fa50811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50d202700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50e204700 1 -- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 msgr2=0x7fa50811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50e204700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50e204700 1 -- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081300a0 msgr2=0x7fa50811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50e204700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081300a0 0x7fa50811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50e204700 1 -- 172.21.15.154:0/1366984124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500009a70 con 0x7fa508133ad0 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50d202700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50da03700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081300a0 0x7fa50811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.300+0000 7fa50e204700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa508133ad0 0x7fa50811e4c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa500016000 tx=0x7fa500004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.301+0000 7fa4fe7fc700 1 -- 172.21.15.154:0/1366984124 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500012430 con 0x7fa508133ad0 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.301+0000 7fa4fe7fc700 1 -- 172.21.15.154:0/1366984124 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa500020070 con 0x7fa508133ad0 2023-09-30T22:23:32.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.301+0000 7fa50fc67700 1 -- 172.21.15.154:0/1366984124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50812f800 con 0x7fa508133ad0 2023-09-30T22:23:32.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.301+0000 7fa4fe7fc700 1 -- 172.21.15.154:0/1366984124 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500004280 con 0x7fa508133ad0 2023-09-30T22:23:32.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.301+0000 7fa50fc67700 1 -- 172.21.15.154:0/1366984124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50812dd50 con 0x7fa508133ad0 2023-09-30T22:23:32.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.301+0000 7fa4fe7fc700 1 -- 172.21.15.154:0/1366984124 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5000043e0 con 0x7fa508133ad0 2023-09-30T22:23:32.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.302+0000 7fa50fc67700 1 -- 172.21.15.154:0/1366984124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50806be10 con 0x7fa508133ad0 2023-09-30T22:23:32.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.302+0000 7fa4fe7fc700 1 -- 172.21.15.154:0/1366984124 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa500022070 con 0x7fa508133ad0 2023-09-30T22:23:32.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.310+0000 7fa4fe7fc700 1 -- 172.21.15.154:0/1366984124 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa500012e60 con 0x7fa508133ad0 2023-09-30T22:23:32.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5653a9c700 1 Processor -- start 2023-09-30T22:23:32.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5653a9c700 1 -- start start 2023-09-30T22:23:32.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5653a9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f564c0a0a70 0x7f564c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5653a9c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c0a1380 0x7f564c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5653a9c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c133f50 0x7f564c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5653a9c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564c09e9d0 con 0x7f564c0a0a70 2023-09-30T22:23:32.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5653a9c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c09dc00 con 0x7f564c0a1380 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5653a9c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f564c09dec0 con 0x7f564c133f50 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5651037700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c0a1380 0x7f564c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5651037700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c0a1380 0x7f564c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34458/0 (socket says 172.21.15.154:34458) 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5651037700 1 -- 172.21.15.154:0/1314520489 learned_addr learned my addr 172.21.15.154:0/1314520489 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.377+0000 7f5651838700 1 --2- 172.21.15.154:0/1314520489 >> v2:172.21.15.154:3300/0 conn(0x7f564c0a0a70 0x7f564c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5652039700 1 --2- 172.21.15.154:0/1314520489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c133f50 0x7f564c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5651037700 1 -- 172.21.15.154:0/1314520489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c133f50 msgr2=0x7f564c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5651037700 1 --2- 172.21.15.154:0/1314520489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c133f50 0x7f564c1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5651037700 1 -- 172.21.15.154:0/1314520489 >> v2:172.21.15.154:3300/0 conn(0x7f564c0a0a70 msgr2=0x7f564c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:32.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5651037700 1 --2- 172.21.15.154:0/1314520489 >> v2:172.21.15.154:3300/0 conn(0x7f564c0a0a70 0x7f564c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5651037700 1 -- 172.21.15.154:0/1314520489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c09e6a0 con 0x7f564c0a1380 2023-09-30T22:23:32.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5651838700 1 --2- 172.21.15.154:0/1314520489 >> v2:172.21.15.154:3300/0 conn(0x7f564c0a0a70 0x7f564c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:32.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5651037700 1 --2- 172.21.15.154:0/1314520489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c0a1380 0x7f564c133a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f563c0098f0 tx=0x7f563c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfd49e94009f08dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:32.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5650836700 1 -- 172.21.15.154:0/1314520489 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c011830 con 0x7f564c0a1380 2023-09-30T22:23:32.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5650836700 1 -- 172.21.15.154:0/1314520489 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c011990 con 0x7f564c0a1380 2023-09-30T22:23:32.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.378+0000 7f5650836700 1 -- 172.21.15.154:0/1314520489 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c011d20 con 0x7f564c0a1380 2023-09-30T22:23:32.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.379+0000 7f5653a9c700 1 -- 172.21.15.154:0/1314520489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c0a1380 msgr2=0x7f564c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.379+0000 7f5653a9c700 1 --2- 172.21.15.154:0/1314520489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c0a1380 0x7f564c133a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f563c0098f0 tx=0x7f563c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:32.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.379+0000 7f5653a9c700 1 -- 172.21.15.154:0/1314520489 shutdown_connections 2023-09-30T22:23:32.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.379+0000 7f5653a9c700 1 --2- 172.21.15.154:0/1314520489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c133f50 0x7f564c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.379+0000 7f5653a9c700 1 --2- 172.21.15.154:0/1314520489 >> v2:172.21.15.154:3300/0 conn(0x7f564c0a0a70 0x7f564c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.379+0000 7f5653a9c700 1 --2- 172.21.15.154:0/1314520489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c0a1380 0x7f564c133a10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.379+0000 7f5653a9c700 1 -- 172.21.15.154:0/1314520489 >> 172.21.15.154:0/1314520489 conn(0x7f564c0a6610 msgr2=0x7f564c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.379+0000 7f5653a9c700 1 -- 172.21.15.154:0/1314520489 shutdown_connections 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.379+0000 7f5653a9c700 1 -- 172.21.15.154:0/1314520489 wait complete. 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5653a9c700 1 Processor -- start 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5653a9c700 1 -- start start 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5653a9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f564c0a0a70 0x7f564c1223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5653a9c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c0a1380 0x7f564c1228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5653a9c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c133f50 0x7f564c122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5653a9c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c125180 con 0x7f564c0a0a70 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5653a9c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c124dc0 con 0x7f564c133f50 2023-09-30T22:23:32.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5653a9c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0a03e0 con 0x7f564c0a1380 2023-09-30T22:23:32.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5651838700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f564c0a0a70 0x7f564c1223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5651838700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f564c0a0a70 0x7f564c1223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36346/0 (socket says 172.21.15.154:36346) 2023-09-30T22:23:32.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.380+0000 7f5651838700 1 -- 172.21.15.154:0/668209060 learned_addr learned my addr 172.21.15.154:0/668209060 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:32.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5652039700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c133f50 0x7f564c122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5651037700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c0a1380 0x7f564c1228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5651838700 1 -- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c0a1380 msgr2=0x7f564c1228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5651838700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c0a1380 0x7f564c1228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5651838700 1 -- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c133f50 msgr2=0x7f564c122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5651838700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c133f50 0x7f564c122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5651838700 1 -- 172.21.15.154:0/668209060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480094a0 con 0x7f564c0a0a70 2023-09-30T22:23:32.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5651037700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c0a1380 0x7f564c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:32.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5651838700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f564c0a0a70 0x7f564c1223b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f564800ebe0 tx=0x7f564800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:32.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f56427fc700 1 -- 172.21.15.154:0/668209060 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648009780 con 0x7f564c0a0a70 2023-09-30T22:23:32.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5653a9c700 1 -- 172.21.15.154:0/668209060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c009550 con 0x7f564c0a0a70 2023-09-30T22:23:32.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f56427fc700 1 -- 172.21.15.154:0/668209060 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564800c850 con 0x7f564c0a0a70 2023-09-30T22:23:32.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f56427fc700 1 -- 172.21.15.154:0/668209060 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800cbe0 con 0x7f564c0a0a70 2023-09-30T22:23:32.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.381+0000 7f5653a9c700 1 -- 172.21.15.154:0/668209060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564c125e40 con 0x7f564c0a0a70 2023-09-30T22:23:32.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.382+0000 7f56427fc700 1 -- 172.21.15.154:0/668209060 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f564800cd40 con 0x7f564c0a0a70 2023-09-30T22:23:32.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.382+0000 7f56427fc700 1 -- 172.21.15.154:0/668209060 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f564803f840 con 0x7f564c0a0a70 2023-09-30T22:23:32.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.383+0000 7f5653a9c700 1 -- 172.21.15.154:0/668209060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564c11f760 con 0x7f564c0a0a70 2023-09-30T22:23:32.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.387+0000 7f56427fc700 1 -- 172.21.15.154:0/668209060 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f564801be10 con 0x7f564c0a0a70 2023-09-30T22:23:32.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.415+0000 7fc619ba2700 1 Processor -- start 2023-09-30T22:23:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.415+0000 7fc619ba2700 1 -- start start 2023-09-30T22:23:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.415+0000 7fc619ba2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409e340 0x7fc6141359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.415+0000 7fc619ba2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc614135f20 0x7fc614138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.415+0000 7fc619ba2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61409aaa0 con 0x7fc61409d860 2023-09-30T22:23:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.415+0000 7fc619ba2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61409e730 con 0x7fc614135f20 2023-09-30T22:23:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.415+0000 7fc619ba2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc61409f870 con 0x7fc61409e340 2023-09-30T22:23:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.415+0000 7fc612ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409e340 0x7fc6141359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc612ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409e340 0x7fc6141359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51204/0 (socket says 172.21.15.154:51204) 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc612ffd700 1 -- 172.21.15.154:0/767100575 learned_addr learned my addr 172.21.15.154:0/767100575 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc613fff700 1 --2- 172.21.15.154:0/767100575 >> v2:172.21.15.154:3300/0 conn(0x7fc614135f20 0x7fc614138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc6127fc700 1 -- 172.21.15.154:0/767100575 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641683174 0 0) 0x7fc61409aaa0 con 0x7fc61409d860 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc612ffd700 1 -- 172.21.15.154:0/767100575 >> v2:172.21.15.154:3300/0 conn(0x7fc614135f20 msgr2=0x7fc614138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc612ffd700 1 --2- 172.21.15.154:0/767100575 >> v2:172.21.15.154:3300/0 conn(0x7fc614135f20 0x7fc614138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc612ffd700 1 -- 172.21.15.154:0/767100575 >> v1:172.21.15.154:6789/0 conn(0x7fc61409d860 legacy=0x7fc61409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc612ffd700 1 -- 172.21.15.154:0/767100575 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61409b360 con 0x7fc61409e340 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc613fff700 1 --2- 172.21.15.154:0/767100575 >> v2:172.21.15.154:3300/0 conn(0x7fc614135f20 0x7fc614138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc612ffd700 1 --2- 172.21.15.154:0/767100575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409e340 0x7fc6141359e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc60800bb90 tx=0x7fc60800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf2adb57b0a440b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc6127fc700 1 -- 172.21.15.154:0/767100575 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800dd30 con 0x7fc61409e340 2023-09-30T22:23:32.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc6127fc700 1 -- 172.21.15.154:0/767100575 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60800de90 con 0x7fc61409e340 2023-09-30T22:23:32.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.416+0000 7fc6127fc700 1 -- 172.21.15.154:0/767100575 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608010690 con 0x7fc61409e340 2023-09-30T22:23:32.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.417+0000 7fc619ba2700 1 -- 172.21.15.154:0/767100575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409e340 msgr2=0x7fc6141359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.417+0000 7fc619ba2700 1 --2- 172.21.15.154:0/767100575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409e340 0x7fc6141359e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc60800bb90 tx=0x7fc60800bea0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.417+0000 7fc619ba2700 1 -- 172.21.15.154:0/767100575 shutdown_connections 2023-09-30T22:23:32.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.417+0000 7fc619ba2700 1 --2- 172.21.15.154:0/767100575 >> v2:172.21.15.154:3300/0 conn(0x7fc614135f20 0x7fc614138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.417+0000 7fc619ba2700 1 --2- 172.21.15.154:0/767100575 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409e340 0x7fc6141359e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.417+0000 7fc619ba2700 1 -- 172.21.15.154:0/767100575 >> 172.21.15.154:0/767100575 conn(0x7fc614099c40 msgr2=0x7fc6140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:32.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.417+0000 7fc619ba2700 1 -- 172.21.15.154:0/767100575 shutdown_connections 2023-09-30T22:23:32.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.417+0000 7fc619ba2700 1 -- 172.21.15.154:0/767100575 wait complete. 2023-09-30T22:23:32.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.418+0000 7fc619ba2700 1 Processor -- start 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.418+0000 7fc619ba2700 1 -- start start 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.418+0000 7fc619ba2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409d860 0x7fc61411b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.418+0000 7fc619ba2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61409e340 0x7fc61411b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.418+0000 7fc619ba2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc614135f20 0x7fc61411bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.418+0000 7fc619ba2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61411e170 con 0x7fc61409e340 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.418+0000 7fc619ba2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61411c790 con 0x7fc614135f20 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.418+0000 7fc619ba2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc61409c8b0 con 0x7fc61409d860 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.418+0000 7fc6137fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409d860 0x7fc61411b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc6137fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409d860 0x7fc61411b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51214/0 (socket says 172.21.15.154:51214) 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc6137fe700 1 -- 172.21.15.154:0/1230115204 learned_addr learned my addr 172.21.15.154:0/1230115204 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:32.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc612ffd700 1 --2- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61409e340 0x7fc61411b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc613fff700 1 --2- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc614135f20 0x7fc61411bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc6137fe700 1 -- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc614135f20 msgr2=0x7fc61411bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc6137fe700 1 --2- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc614135f20 0x7fc61411bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc6137fe700 1 -- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61409e340 msgr2=0x7fc61411b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc6137fe700 1 --2- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61409e340 0x7fc61411b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc6137fe700 1 -- 172.21.15.154:0/1230115204 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c009a70 con 0x7fc61409d860 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc6137fe700 1 --2- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409d860 0x7fc61411b350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c480 tx=0x7fc60400c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc5fbfff700 1 -- 172.21.15.154:0/1230115204 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040054e0 con 0x7fc61409d860 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc5fbfff700 1 -- 172.21.15.154:0/1230115204 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60400ce40 con 0x7fc61409d860 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc619ba2700 1 -- 172.21.15.154:0/1230115204 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60800b7f0 con 0x7fc61409d860 2023-09-30T22:23:32.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc5fbfff700 1 -- 172.21.15.154:0/1230115204 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040038c0 con 0x7fc61409d860 2023-09-30T22:23:32.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.419+0000 7fc619ba2700 1 -- 172.21.15.154:0/1230115204 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61411e5c0 con 0x7fc61409d860 2023-09-30T22:23:32.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.420+0000 7fc5fbfff700 1 -- 172.21.15.154:0/1230115204 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc604003a20 con 0x7fc61409d860 2023-09-30T22:23:32.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.420+0000 7fc5fbfff700 1 -- 172.21.15.154:0/1230115204 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc60403ea30 con 0x7fc61409d860 2023-09-30T22:23:32.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.421+0000 7fc619ba2700 1 -- 172.21.15.154:0/1230115204 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61404f2a0 con 0x7fc61409d860 2023-09-30T22:23:32.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.425+0000 7fc5fbfff700 1 -- 172.21.15.154:0/1230115204 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc604017030 con 0x7fc61409d860 2023-09-30T22:23:32.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.514+0000 7fa50fc67700 1 -- 172.21.15.154:0/1366984124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa5080a2620 con 0x7fa508133ad0 2023-09-30T22:23:32.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.514+0000 7fa4fe7fc700 1 -- 172.21.15.154:0/1366984124 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5000263e0 con 0x7fa508133ad0 2023-09-30T22:23:32.515 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.517+0000 7fa50fc67700 1 -- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa508133ad0 msgr2=0x7fa50811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.517+0000 7fa50fc67700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa508133ad0 0x7fa50811e4c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa500016000 tx=0x7fa500004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.517+0000 7fa50fc67700 1 -- 172.21.15.154:0/1366984124 shutdown_connections 2023-09-30T22:23:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.517+0000 7fa50fc67700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa508133ad0 0x7fa50811e4c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.517+0000 7fa50fc67700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081300a0 0x7fa50811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.517+0000 7fa50fc67700 1 --2- 172.21.15.154:0/1366984124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa508130bc0 0x7fa50811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.517+0000 7fa50fc67700 1 -- 172.21.15.154:0/1366984124 >> 172.21.15.154:0/1366984124 conn(0x7fa508099c40 msgr2=0x7fa508132bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.517+0000 7fa50fc67700 1 -- 172.21.15.154:0/1366984124 shutdown_connections 2023-09-30T22:23:32.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.517+0000 7fa50fc67700 1 -- 172.21.15.154:0/1366984124 wait complete. 2023-09-30T22:23:32.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:32.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.587+0000 7f5653a9c700 1 -- 172.21.15.154:0/668209060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f564c04f2a0 con 0x7f564c0a0a70 2023-09-30T22:23:32.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.587+0000 7f56427fc700 1 -- 172.21.15.154:0/668209060 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5648021020 con 0x7f564c0a0a70 2023-09-30T22:23:32.588 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:32.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.590+0000 7f5653a9c700 1 -- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f564c0a0a70 msgr2=0x7f564c1223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.590+0000 7f5653a9c700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f564c0a0a70 0x7f564c1223b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f564800ebe0 tx=0x7f564800eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.590+0000 7f5653a9c700 1 -- 172.21.15.154:0/668209060 shutdown_connections 2023-09-30T22:23:32.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.590+0000 7f5653a9c700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f564c133f50 0x7f564c122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.590+0000 7f5653a9c700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f564c0a0a70 0x7f564c1223b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.590+0000 7f5653a9c700 1 --2- 172.21.15.154:0/668209060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f564c0a1380 0x7f564c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.590+0000 7f5653a9c700 1 -- 172.21.15.154:0/668209060 >> 172.21.15.154:0/668209060 conn(0x7f564c0a6610 msgr2=0x7f564c11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:32.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.590+0000 7f5653a9c700 1 -- 172.21.15.154:0/668209060 shutdown_connections 2023-09-30T22:23:32.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.590+0000 7f5653a9c700 1 -- 172.21.15.154:0/668209060 wait complete. 2023-09-30T22:23:32.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:32.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.623+0000 7fc619ba2700 1 -- 172.21.15.154:0/1230115204 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc61411e7b0 con 0x7fc61409d860 2023-09-30T22:23:32.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.623+0000 7fc5fbfff700 1 -- 172.21.15.154:0/1230115204 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc604019cd0 con 0x7fc61409d860 2023-09-30T22:23:32.624 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:32.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.625+0000 7fc619ba2700 1 -- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409d860 msgr2=0x7fc61411b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:32.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.625+0000 7fc619ba2700 1 --2- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409d860 0x7fc61411b350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c480 tx=0x7fc60400c790 comp rx=0 tx=0).stop 2023-09-30T22:23:32.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.625+0000 7fc619ba2700 1 -- 172.21.15.154:0/1230115204 shutdown_connections 2023-09-30T22:23:32.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.625+0000 7fc619ba2700 1 --2- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc614135f20 0x7fc61411bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.625+0000 7fc619ba2700 1 --2- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61409d860 0x7fc61411b350 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.625+0000 7fc619ba2700 1 --2- 172.21.15.154:0/1230115204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61409e340 0x7fc61411b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:32.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.625+0000 7fc619ba2700 1 -- 172.21.15.154:0/1230115204 >> 172.21.15.154:0/1230115204 conn(0x7fc614099c40 msgr2=0x7fc6140a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:32.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.625+0000 7fc619ba2700 1 -- 172.21.15.154:0/1230115204 shutdown_connections 2023-09-30T22:23:32.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:32.625+0000 7fc619ba2700 1 -- 172.21.15.154:0/1230115204 wait complete. 2023-09-30T22:23:32.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:33.050 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:33.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.178+0000 7fbb6e20d700 1 Processor -- start 2023-09-30T22:23:33.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.178+0000 7fbb6e20d700 1 -- start start 2023-09-30T22:23:33.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb6e20d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809d860 0x7fbb6809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb6e20d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb6809e170 0x7fbb681307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb6e20d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6809aaa0 con 0x7fbb68130ce0 2023-09-30T22:23:33.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb6e20d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6809f870 con 0x7fbb6809e170 2023-09-30T22:23:33.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb6e20d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6809b360 con 0x7fbb6809d860 2023-09-30T22:23:33.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809d860 0x7fbb6809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb66ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb6809e170 0x7fbb681307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809d860 0x7fbb6809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51230/0 (socket says 172.21.15.154:51230) 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb677fe700 1 -- 172.21.15.154:0/614042236 learned_addr learned my addr 172.21.15.154:0/614042236 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb66ffd700 1 -- 172.21.15.154:0/614042236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809d860 msgr2=0x7fbb6809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb66ffd700 1 --2- 172.21.15.154:0/614042236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809d860 0x7fbb6809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb66ffd700 1 -- 172.21.15.154:0/614042236 >> v1:172.21.15.154:6789/0 conn(0x7fbb68130ce0 legacy=0x7fbb681379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb66ffd700 1 -- 172.21.15.154:0/614042236 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6809b620 con 0x7fbb6809e170 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb677fe700 1 --2- 172.21.15.154:0/614042236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809d860 0x7fbb6809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb66ffd700 1 --2- 172.21.15.154:0/614042236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb6809e170 0x7fbb681307a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009840 tx=0x7fbb58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2f5fab81a72e2f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb667fc700 1 -- 172.21.15.154:0/614042236 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58011830 con 0x7fbb6809e170 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb667fc700 1 -- 172.21.15.154:0/614042236 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58011990 con 0x7fbb6809e170 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.179+0000 7fbb667fc700 1 -- 172.21.15.154:0/614042236 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58011d20 con 0x7fbb6809e170 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.180+0000 7fbb6e20d700 1 -- 172.21.15.154:0/614042236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb6809e170 msgr2=0x7fbb681307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.180+0000 7fbb6e20d700 1 --2- 172.21.15.154:0/614042236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb6809e170 0x7fbb681307a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009840 tx=0x7fbb58009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.180+0000 7fbb6e20d700 1 -- 172.21.15.154:0/614042236 shutdown_connections 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.180+0000 7fbb6e20d700 1 --2- 172.21.15.154:0/614042236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809d860 0x7fbb6809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.180+0000 7fbb6e20d700 1 --2- 172.21.15.154:0/614042236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb6809e170 0x7fbb681307a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.180+0000 7fbb6e20d700 1 -- 172.21.15.154:0/614042236 >> 172.21.15.154:0/614042236 conn(0x7fbb68099c40 msgr2=0x7fbb680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.180+0000 7fbb6e20d700 1 -- 172.21.15.154:0/614042236 shutdown_connections 2023-09-30T22:23:33.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.180+0000 7fbb6e20d700 1 -- 172.21.15.154:0/614042236 wait complete. 2023-09-30T22:23:33.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.181+0000 7fbb6e20d700 1 Processor -- start 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.181+0000 7fbb6e20d700 1 -- start start 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.181+0000 7fbb6e20d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb6809d860 0x7fbb68135730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.181+0000 7fbb6e20d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809e170 0x7fbb68135c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.181+0000 7fbb6e20d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb68130ce0 0x7fbb681361b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.181+0000 7fbb6e20d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680a2290 con 0x7fbb68130ce0 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.181+0000 7fbb6e20d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb68130420 con 0x7fbb6809d860 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.181+0000 7fbb6e20d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb68137450 con 0x7fbb6809e170 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb677fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb6809d860 0x7fbb68135730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb66ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809e170 0x7fbb68135c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb677fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb6809d860 0x7fbb68135730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34486/0 (socket says 172.21.15.154:34486) 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb67fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb68130ce0 0x7fbb681361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb677fe700 1 -- 172.21.15.154:0/3857121206 learned_addr learned my addr 172.21.15.154:0/3857121206 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb66ffd700 1 -- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb6809d860 msgr2=0x7fbb68135730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb66ffd700 1 --2- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb6809d860 0x7fbb68135730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb66ffd700 1 -- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb68130ce0 msgr2=0x7fbb681361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb66ffd700 1 --2- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb68130ce0 0x7fbb681361b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb66ffd700 1 -- 172.21.15.154:0/3857121206 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50009550 con 0x7fbb6809e170 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb67fff700 1 --2- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb68130ce0 0x7fbb681361b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb66ffd700 1 --2- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809e170 0x7fbb68135c70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbb58016000 tx=0x7fbb58004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb5ffff700 1 -- 172.21.15.154:0/3857121206 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580036a0 con 0x7fbb6809e170 2023-09-30T22:23:33.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb5ffff700 1 -- 172.21.15.154:0/3857121206 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5801f070 con 0x7fbb6809e170 2023-09-30T22:23:33.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb6e20d700 1 -- 172.21.15.154:0/3857121206 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb580094a0 con 0x7fbb6809e170 2023-09-30T22:23:33.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb5ffff700 1 -- 172.21.15.154:0/3857121206 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58003a60 con 0x7fbb6809e170 2023-09-30T22:23:33.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.182+0000 7fbb6e20d700 1 -- 172.21.15.154:0/3857121206 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6811a380 con 0x7fbb6809e170 2023-09-30T22:23:33.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.183+0000 7fbb5ffff700 1 -- 172.21.15.154:0/3857121206 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb58003bc0 con 0x7fbb6809e170 2023-09-30T22:23:33.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.183+0000 7fbb5ffff700 1 -- 172.21.15.154:0/3857121206 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb58021070 con 0x7fbb6809e170 2023-09-30T22:23:33.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.183+0000 7fbb6e20d700 1 -- 172.21.15.154:0/3857121206 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6804f2a0 con 0x7fbb6809e170 2023-09-30T22:23:33.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.188+0000 7fbb5ffff700 1 -- 172.21.15.154:0/3857121206 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb5802b020 con 0x7fbb6809e170 2023-09-30T22:23:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.372+0000 7fbb6e20d700 1 -- 172.21.15.154:0/3857121206 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb68137b30 con 0x7fbb6809e170 2023-09-30T22:23:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.373+0000 7fbb5ffff700 1 -- 172.21.15.154:0/3857121206 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb58034070 con 0x7fbb6809e170 2023-09-30T22:23:33.374 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:33.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.375+0000 7fbb6e20d700 1 -- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809e170 msgr2=0x7fbb68135c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.375+0000 7fbb6e20d700 1 --2- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809e170 0x7fbb68135c70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbb58016000 tx=0x7fbb58004750 comp rx=0 tx=0).stop 2023-09-30T22:23:33.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.375+0000 7fbb6e20d700 1 -- 172.21.15.154:0/3857121206 shutdown_connections 2023-09-30T22:23:33.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.375+0000 7fbb6e20d700 1 --2- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb68130ce0 0x7fbb681361b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.375+0000 7fbb6e20d700 1 --2- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb6809d860 0x7fbb68135730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.375+0000 7fbb6e20d700 1 --2- 172.21.15.154:0/3857121206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb6809e170 0x7fbb68135c70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.375+0000 7fbb6e20d700 1 -- 172.21.15.154:0/3857121206 >> 172.21.15.154:0/3857121206 conn(0x7fbb68099c40 msgr2=0x7fbb6806f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.375+0000 7fbb6e20d700 1 -- 172.21.15.154:0/3857121206 shutdown_connections 2023-09-30T22:23:33.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.375+0000 7fbb6e20d700 1 -- 172.21.15.154:0/3857121206 wait complete. 2023-09-30T22:23:33.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:33.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:33.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:33.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:33.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.657+0000 7f78b92d8700 1 Processor -- start 2023-09-30T22:23:33.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.657+0000 7f78b92d8700 1 -- start start 2023-09-30T22:23:33.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b92d8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78b4133ad0 0x7f78b4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b92d8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b92d8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b406b2d0 con 0x7f78b41309f0 2023-09-30T22:23:33.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b92d8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b4133610 con 0x7f78b4133ad0 2023-09-30T22:23:33.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b92d8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78b409a500 con 0x7f78b41300a0 2023-09-30T22:23:33.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78b4133ad0 0x7f78b4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51250/0 (socket says 172.21.15.154:51250) 2023-09-30T22:23:33.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78b4133ad0 0x7f78b4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36386/0 (socket says 172.21.15.154:36386) 2023-09-30T22:23:33.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b27fc700 1 -- 172.21.15.154:0/985607435 learned_addr learned my addr 172.21.15.154:0/985607435 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:33.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b27fc700 1 -- 172.21.15.154:0/985607435 >> v2:172.21.15.154:3300/0 conn(0x7f78b4133ad0 msgr2=0x7f78b4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:33.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b27fc700 1 --2- 172.21.15.154:0/985607435 >> v2:172.21.15.154:3300/0 conn(0x7f78b4133ad0 0x7f78b4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b27fc700 1 -- 172.21.15.154:0/985607435 >> v1:172.21.15.154:6789/0 conn(0x7f78b41309f0 legacy=0x7f78b413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.659+0000 7f78b27fc700 1 -- 172.21.15.154:0/985607435 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b41338b0 con 0x7f78b41300a0 2023-09-30T22:23:33.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.658+0000 7f78b1ffb700 1 -- 172.21.15.154:0/985607435 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335809257 0 0) 0x7f78b406b2d0 con 0x7f78b41309f0 2023-09-30T22:23:33.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.659+0000 7f78b2ffd700 1 --2- 172.21.15.154:0/985607435 >> v2:172.21.15.154:3300/0 conn(0x7f78b4133ad0 0x7f78b4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:33.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.659+0000 7f78b27fc700 1 --2- 172.21.15.154:0/985607435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b41304b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f78a80098f0 tx=0x7f78a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9f2cd12df22bc02 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.659+0000 7f78b1ffb700 1 -- 172.21.15.154:0/985607435 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8011830 con 0x7f78b41300a0 2023-09-30T22:23:33.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.659+0000 7f78b1ffb700 1 -- 172.21.15.154:0/985607435 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a8011990 con 0x7f78b41300a0 2023-09-30T22:23:33.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.659+0000 7f78b1ffb700 1 -- 172.21.15.154:0/985607435 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8011d20 con 0x7f78b41300a0 2023-09-30T22:23:33.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.659+0000 7f78b92d8700 1 -- 172.21.15.154:0/985607435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 msgr2=0x7f78b41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.659+0000 7f78b92d8700 1 --2- 172.21.15.154:0/985607435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b41304b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f78a80098f0 tx=0x7f78a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:33.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.660+0000 7f78b92d8700 1 -- 172.21.15.154:0/985607435 shutdown_connections 2023-09-30T22:23:33.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.660+0000 7f78b92d8700 1 --2- 172.21.15.154:0/985607435 >> v2:172.21.15.154:3300/0 conn(0x7f78b4133ad0 0x7f78b4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.660+0000 7f78b92d8700 1 --2- 172.21.15.154:0/985607435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b41304b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.660+0000 7f78b92d8700 1 -- 172.21.15.154:0/985607435 >> 172.21.15.154:0/985607435 conn(0x7f78b4099c40 msgr2=0x7f78b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.660+0000 7f78b92d8700 1 -- 172.21.15.154:0/985607435 shutdown_connections 2023-09-30T22:23:33.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.660+0000 7f78b92d8700 1 -- 172.21.15.154:0/985607435 wait complete. 2023-09-30T22:23:33.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b92d8700 1 Processor -- start 2023-09-30T22:23:33.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b92d8700 1 -- start start 2023-09-30T22:23:33.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b92d8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b92d8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41309f0 0x7f78b411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b92d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b4133ad0 0x7f78b411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b92d8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b411ed40 con 0x7f78b41309f0 2023-09-30T22:23:33.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b92d8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4071ff0 con 0x7f78b4133ad0 2023-09-30T22:23:33.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b92d8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78b412dd00 con 0x7f78b41300a0 2023-09-30T22:23:33.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b4133ad0 0x7f78b411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51262/0 (socket says 172.21.15.154:51262) 2023-09-30T22:23:33.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.661+0000 7f78b2ffd700 1 -- 172.21.15.154:0/4133781569 learned_addr learned my addr 172.21.15.154:0/4133781569 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:33.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f78b27fc700 1 --2- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41309f0 0x7f78b411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f78b37fe700 1 -- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 msgr2=0x7f78b411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f78b37fe700 1 --2- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f78b37fe700 1 -- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41309f0 msgr2=0x7f78b411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f78b37fe700 1 --2- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41309f0 0x7f78b411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f78b37fe700 1 -- 172.21.15.154:0/4133781569 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40094a0 con 0x7f78b4133ad0 2023-09-30T22:23:33.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f78b37fe700 1 --2- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b4133ad0 0x7f78b411e4c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c7c0 tx=0x7f78ac00cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f789b7fe700 1 -- 172.21.15.154:0/4133781569 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac003e30 con 0x7f78b4133ad0 2023-09-30T22:23:33.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f789b7fe700 1 -- 172.21.15.154:0/4133781569 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac005070 con 0x7f78b4133ad0 2023-09-30T22:23:33.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f78b92d8700 1 -- 172.21.15.154:0/4133781569 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a8009550 con 0x7f78b4133ad0 2023-09-30T22:23:33.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f789b7fe700 1 -- 172.21.15.154:0/4133781569 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac005420 con 0x7f78b4133ad0 2023-09-30T22:23:33.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.662+0000 7f78b92d8700 1 -- 172.21.15.154:0/4133781569 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b411fa40 con 0x7f78b4133ad0 2023-09-30T22:23:33.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.663+0000 7f78b92d8700 1 -- 172.21.15.154:0/4133781569 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b40a2620 con 0x7f78b4133ad0 2023-09-30T22:23:33.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.664+0000 7f789b7fe700 1 -- 172.21.15.154:0/4133781569 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78ac005580 con 0x7f78b4133ad0 2023-09-30T22:23:33.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.664+0000 7f789b7fe700 1 -- 172.21.15.154:0/4133781569 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78ac03ee30 con 0x7f78b4133ad0 2023-09-30T22:23:33.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.672+0000 7f789b7fe700 1 -- 172.21.15.154:0/4133781569 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78ac042030 con 0x7f78b4133ad0 2023-09-30T22:23:33.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.735+0000 7fd845026700 1 Processor -- start 2023-09-30T22:23:33.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.735+0000 7fd845026700 1 -- start start 2023-09-30T22:23:33.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd845026700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd84009e870 0x7fd84009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd845026700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd84009f180 0x7fd840131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd845026700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd840131d70 0x7fd8401321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd845026700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8400a0920 con 0x7fd84009e870 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd845026700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84009c970 con 0x7fd84009f180 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd845026700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd84009bab0 con 0x7fd840131d70 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd84009f180 0x7fd840131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd84009e870 0x7fd84009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd84009e870 0x7fd84009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36402/0 (socket says 172.21.15.154:36402) 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd84009f180 0x7fd840131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34508/0 (socket says 172.21.15.154:34508) 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83ed9d700 1 -- 172.21.15.154:0/3257796934 learned_addr learned my addr 172.21.15.154:0/3257796934 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83f59e700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd840131d70 0x7fd8401321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83ed9d700 1 -- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd840131d70 msgr2=0x7fd8401321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83ed9d700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd840131d70 0x7fd8401321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83ed9d700 1 -- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd84009f180 msgr2=0x7fd840131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83ed9d700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd84009f180 0x7fd840131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83ed9d700 1 -- 172.21.15.154:0/3257796934 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84009f9c0 con 0x7fd84009e870 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83e59c700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd84009f180 0x7fd840131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83f59e700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd840131d70 0x7fd8401321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.736+0000 7fd83ed9d700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd84009e870 0x7fd84009ec40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd830009920 tx=0x7fd830009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad6d22b2fa666da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd83dd9b700 1 -- 172.21.15.154:0/3257796934 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830011830 con 0x7fd84009e870 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd83dd9b700 1 -- 172.21.15.154:0/3257796934 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830011990 con 0x7fd84009e870 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd83dd9b700 1 -- 172.21.15.154:0/3257796934 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830011d20 con 0x7fd84009e870 2023-09-30T22:23:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd845026700 1 -- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd84009e870 msgr2=0x7fd84009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd845026700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd84009e870 0x7fd84009ec40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd830009920 tx=0x7fd830009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd845026700 1 -- 172.21.15.154:0/3257796934 shutdown_connections 2023-09-30T22:23:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd845026700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd840131d70 0x7fd8401321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd845026700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd84009e870 0x7fd84009ec40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd845026700 1 --2- 172.21.15.154:0/3257796934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd84009f180 0x7fd840131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd845026700 1 -- 172.21.15.154:0/3257796934 >> 172.21.15.154:0/3257796934 conn(0x7fd8400a4430 msgr2=0x7fd8400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd845026700 1 -- 172.21.15.154:0/3257796934 shutdown_connections 2023-09-30T22:23:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.737+0000 7fd845026700 1 -- 172.21.15.154:0/3257796934 wait complete. 2023-09-30T22:23:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.739+0000 7fd845026700 1 Processor -- start 2023-09-30T22:23:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.739+0000 7fd845026700 1 -- start start 2023-09-30T22:23:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd845026700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd84009e870 0x7fd84006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd845026700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd84009f180 0x7fd84006c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd845026700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd840131d70 0x7fd8401c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd845026700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84006bd90 con 0x7fd84009f180 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd845026700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd840121f90 con 0x7fd840131d70 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd845026700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd840122280 con 0x7fd84009e870 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd84009e870 0x7fd84006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd84009e870 0x7fd84006bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51278/0 (socket says 172.21.15.154:51278) 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83ed9d700 1 -- 172.21.15.154:0/2964411251 learned_addr learned my addr 172.21.15.154:0/2964411251 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83f59e700 1 --2- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd840131d70 0x7fd8401c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83e59c700 1 --2- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd84009f180 0x7fd84006c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83ed9d700 1 -- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd840131d70 msgr2=0x7fd8401c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83ed9d700 1 --2- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd840131d70 0x7fd8401c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83ed9d700 1 -- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd84009f180 msgr2=0x7fd84006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83ed9d700 1 --2- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd84009f180 0x7fd84006c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.740+0000 7fd83ed9d700 1 -- 172.21.15.154:0/2964411251 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340094a0 con 0x7fd84009e870 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.741+0000 7fd83ed9d700 1 --2- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd84009e870 0x7fd84006bff0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd830000c00 tx=0x7fd830004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.741+0000 7fd8277fe700 1 -- 172.21.15.154:0/2964411251 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830004450 con 0x7fd84009e870 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.741+0000 7fd8277fe700 1 -- 172.21.15.154:0/2964411251 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8300045b0 con 0x7fd84009e870 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.741+0000 7fd845026700 1 -- 172.21.15.154:0/2964411251 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd838009a70 con 0x7fd84009e870 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.741+0000 7fd8277fe700 1 -- 172.21.15.154:0/2964411251 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8300038c0 con 0x7fd84009e870 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.741+0000 7fd845026700 1 -- 172.21.15.154:0/2964411251 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd830009550 con 0x7fd84009e870 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.742+0000 7fd8277fe700 1 -- 172.21.15.154:0/2964411251 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd830021070 con 0x7fd84009e870 2023-09-30T22:23:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.742+0000 7fd8277fe700 1 -- 172.21.15.154:0/2964411251 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd8300408c0 con 0x7fd84009e870 2023-09-30T22:23:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.742+0000 7fd845026700 1 -- 172.21.15.154:0/2964411251 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd840123070 con 0x7fd84009e870 2023-09-30T22:23:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.747+0000 7fd8277fe700 1 -- 172.21.15.154:0/2964411251 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd830015080 con 0x7fd84009e870 2023-09-30T22:23:33.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.774+0000 7f241cac2700 1 Processor -- start 2023-09-30T22:23:33.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.774+0000 7f241cac2700 1 -- start start 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f241cac2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a0a70 0x7f24180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f241cac2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2418134120 0x7f241813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f241cac2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241809dc00 con 0x7f24180a1380 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f241cac2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241809ea60 con 0x7f2418134120 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f241cac2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f241809dec0 con 0x7f24180a0a70 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f2416d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2418134120 0x7f241813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f2416d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2418134120 0x7f241813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36420/0 (socket says 172.21.15.154:36420) 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f2416d9d700 1 -- 172.21.15.154:0/3805582230 learned_addr learned my addr 172.21.15.154:0/3805582230 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f2415d9b700 1 --1- 172.21.15.154:0/3805582230 >> v1:172.21.15.154:6789/0 conn(0x7f24180a1380 0x7f2418133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52236/0 (socket says 172.21.15.154:52236) 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.775+0000 7f241659c700 1 --2- 172.21.15.154:0/3805582230 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a0a70 0x7f24180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f2416d9d700 1 -- 172.21.15.154:0/3805582230 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a0a70 msgr2=0x7f24180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f2416d9d700 1 --2- 172.21.15.154:0/3805582230 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a0a70 0x7f24180a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f2416d9d700 1 -- 172.21.15.154:0/3805582230 >> v1:172.21.15.154:6789/0 conn(0x7f24180a1380 legacy=0x7f2418133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f2416d9d700 1 -- 172.21.15.154:0/3805582230 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241809e6a0 con 0x7f2418134120 2023-09-30T22:23:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f241559a700 1 -- 172.21.15.154:0/3805582230 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933634466 0 0) 0x7f241809dc00 con 0x7f24180a1380 2023-09-30T22:23:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f241659c700 1 --2- 172.21.15.154:0/3805582230 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a0a70 0x7f24180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f2416d9d700 1 --2- 172.21.15.154:0/3805582230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418134120 0x7f241813bce0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2410009e50 tx=0x7f241000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5afd198bd3e478 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f241559a700 1 -- 172.21.15.154:0/3805582230 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000e070 con 0x7f2418134120 2023-09-30T22:23:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f241559a700 1 -- 172.21.15.154:0/3805582230 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241000b910 con 0x7f2418134120 2023-09-30T22:23:33.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f241559a700 1 -- 172.21.15.154:0/3805582230 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241000bcc0 con 0x7f2418134120 2023-09-30T22:23:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f241cac2700 1 -- 172.21.15.154:0/3805582230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418134120 msgr2=0x7f241813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.776+0000 7f241cac2700 1 --2- 172.21.15.154:0/3805582230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418134120 0x7f241813bce0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2410009e50 tx=0x7f241000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.777+0000 7f241cac2700 1 -- 172.21.15.154:0/3805582230 shutdown_connections 2023-09-30T22:23:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.777+0000 7f241cac2700 1 --2- 172.21.15.154:0/3805582230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2418134120 0x7f241813bce0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.777+0000 7f241cac2700 1 --2- 172.21.15.154:0/3805582230 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a0a70 0x7f24180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.777+0000 7f241cac2700 1 -- 172.21.15.154:0/3805582230 >> 172.21.15.154:0/3805582230 conn(0x7f24180a6610 msgr2=0x7f24180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.777+0000 7f241cac2700 1 -- 172.21.15.154:0/3805582230 shutdown_connections 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.777+0000 7f241cac2700 1 -- 172.21.15.154:0/3805582230 wait complete. 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241cac2700 1 Processor -- start 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241cac2700 1 -- start start 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241cac2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24180a0a70 0x7f2418122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241cac2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a1380 0x7f2418122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241cac2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2418134120 0x7f24181231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241cac2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24181332b0 con 0x7f24180a0a70 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241cac2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24181258b0 con 0x7f2418134120 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241cac2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24181242c0 con 0x7f24180a1380 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24180a0a70 0x7f2418122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24180a0a70 0x7f2418122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36428/0 (socket says 172.21.15.154:36428) 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f241659c700 1 -- 172.21.15.154:0/924349583 learned_addr learned my addr 172.21.15.154:0/924349583 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f2415d9b700 1 --2- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a1380 0x7f2418122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.778+0000 7f2416d9d700 1 --2- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2418134120 0x7f24181231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f241659c700 1 -- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a1380 msgr2=0x7f2418122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f241659c700 1 --2- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a1380 0x7f2418122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f241659c700 1 -- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2418134120 msgr2=0x7f24181231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f241659c700 1 --2- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2418134120 0x7f24181231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f241659c700 1 -- 172.21.15.154:0/924349583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24080094a0 con 0x7f24180a0a70 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f241659c700 1 --2- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24180a0a70 0x7f2418122750 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f240800ec10 tx=0x7f240800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f2406ffd700 1 -- 172.21.15.154:0/924349583 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800c850 con 0x7f24180a0a70 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f2406ffd700 1 -- 172.21.15.154:0/924349583 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240800c9b0 con 0x7f24180a0a70 2023-09-30T22:23:33.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f2406ffd700 1 -- 172.21.15.154:0/924349583 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240800cd20 con 0x7f24180a0a70 2023-09-30T22:23:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f241cac2700 1 -- 172.21.15.154:0/924349583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2410009b30 con 0x7f24180a0a70 2023-09-30T22:23:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.779+0000 7f241cac2700 1 -- 172.21.15.154:0/924349583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2418125c30 con 0x7f24180a0a70 2023-09-30T22:23:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.780+0000 7f241cac2700 1 -- 172.21.15.154:0/924349583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241804f2a0 con 0x7f24180a0a70 2023-09-30T22:23:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.780+0000 7f2406ffd700 1 -- 172.21.15.154:0/924349583 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2408013470 con 0x7f24180a0a70 2023-09-30T22:23:33.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.780+0000 7f2406ffd700 1 -- 172.21.15.154:0/924349583 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f240803f7f0 con 0x7f24180a0a70 2023-09-30T22:23:33.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.785+0000 7f2406ffd700 1 -- 172.21.15.154:0/924349583 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2408013720 con 0x7f24180a0a70 2023-09-30T22:23:33.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.873+0000 7f78b92d8700 1 -- 172.21.15.154:0/4133781569 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f78b404f2a0 con 0x7f78b4133ad0 2023-09-30T22:23:33.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.873+0000 7f789b7fe700 1 -- 172.21.15.154:0/4133781569 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78ac00acf0 con 0x7f78b4133ad0 2023-09-30T22:23:33.874 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:33.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.876+0000 7f78b92d8700 1 -- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b4133ad0 msgr2=0x7f78b411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.876+0000 7f78b92d8700 1 --2- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b4133ad0 0x7f78b411e4c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c7c0 tx=0x7f78ac00cad0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.876+0000 7f78b92d8700 1 -- 172.21.15.154:0/4133781569 shutdown_connections 2023-09-30T22:23:33.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.876+0000 7f78b92d8700 1 --2- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b4133ad0 0x7f78b411e4c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.876+0000 7f78b92d8700 1 --2- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b41300a0 0x7f78b411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.876+0000 7f78b92d8700 1 --2- 172.21.15.154:0/4133781569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41309f0 0x7f78b411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.876+0000 7f78b92d8700 1 -- 172.21.15.154:0/4133781569 >> 172.21.15.154:0/4133781569 conn(0x7f78b4099c40 msgr2=0x7f78b4132b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.876+0000 7f78b92d8700 1 -- 172.21.15.154:0/4133781569 shutdown_connections 2023-09-30T22:23:33.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.876+0000 7f78b92d8700 1 -- 172.21.15.154:0/4133781569 wait complete. 2023-09-30T22:23:33.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:33.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.951+0000 7fd845026700 1 -- 172.21.15.154:0/2964411251 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd84004f2a0 con 0x7fd84009e870 2023-09-30T22:23:33.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.951+0000 7fd8277fe700 1 -- 172.21.15.154:0/2964411251 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd83000b9d0 con 0x7fd84009e870 2023-09-30T22:23:33.952 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.954+0000 7fd845026700 1 -- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd84009e870 msgr2=0x7fd84006bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.954+0000 7fd845026700 1 --2- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd84009e870 0x7fd84006bff0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd830000c00 tx=0x7fd830004750 comp rx=0 tx=0).stop 2023-09-30T22:23:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.954+0000 7fd845026700 1 -- 172.21.15.154:0/2964411251 shutdown_connections 2023-09-30T22:23:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.954+0000 7fd845026700 1 --2- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd840131d70 0x7fd8401c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.954+0000 7fd845026700 1 --2- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd84009e870 0x7fd84006bff0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.954+0000 7fd845026700 1 --2- 172.21.15.154:0/2964411251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd84009f180 0x7fd84006c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.954+0000 7fd845026700 1 -- 172.21.15.154:0/2964411251 >> 172.21.15.154:0/2964411251 conn(0x7fd8400a4430 msgr2=0x7fd84009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.954+0000 7fd845026700 1 -- 172.21.15.154:0/2964411251 shutdown_connections 2023-09-30T22:23:33.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.954+0000 7fd845026700 1 -- 172.21.15.154:0/2964411251 wait complete. 2023-09-30T22:23:33.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:33.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.978+0000 7f241cac2700 1 -- 172.21.15.154:0/924349583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2418072980 con 0x7f24180a0a70 2023-09-30T22:23:33.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.979+0000 7f2406ffd700 1 -- 172.21.15.154:0/924349583 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2408021070 con 0x7f24180a0a70 2023-09-30T22:23:33.980 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:33.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.981+0000 7f241cac2700 1 -- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24180a0a70 msgr2=0x7f2418122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:33.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.981+0000 7f241cac2700 1 --2- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24180a0a70 0x7f2418122750 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f240800ec10 tx=0x7f240800ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:33.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.981+0000 7f241cac2700 1 -- 172.21.15.154:0/924349583 shutdown_connections 2023-09-30T22:23:33.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.981+0000 7f241cac2700 1 --2- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2418134120 0x7f24181231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.981+0000 7f241cac2700 1 --2- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24180a0a70 0x7f2418122750 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.981+0000 7f241cac2700 1 --2- 172.21.15.154:0/924349583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24180a1380 0x7f2418122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:33.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.981+0000 7f241cac2700 1 -- 172.21.15.154:0/924349583 >> 172.21.15.154:0/924349583 conn(0x7f24180a6610 msgr2=0x7f241811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:33.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.981+0000 7f241cac2700 1 -- 172.21.15.154:0/924349583 shutdown_connections 2023-09-30T22:23:33.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:33.981+0000 7f241cac2700 1 -- 172.21.15.154:0/924349583 wait complete. 2023-09-30T22:23:33.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:34.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:34.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.513+0000 7f43bd43f700 1 Processor -- start 2023-09-30T22:23:34.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.513+0000 7f43bd43f700 1 -- start start 2023-09-30T22:23:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43bd43f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8136960 0x7f43b8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43bd43f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43b8139280 0x7f43b813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43bd43f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b806b2d0 con 0x7f43b8133ad0 2023-09-30T22:23:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43bd43f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b81345b0 con 0x7f43b8139280 2023-09-30T22:23:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43bd43f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b8133610 con 0x7f43b8136960 2023-09-30T22:23:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43b8139280 0x7f43b813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8136960 0x7f43b8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43b8139280 0x7f43b813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36442/0 (socket says 172.21.15.154:36442) 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8136960 0x7f43b8138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34536/0 (socket says 172.21.15.154:34536) 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b77fe700 1 -- 172.21.15.154:0/768103869 learned_addr learned my addr 172.21.15.154:0/768103869 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b67fc700 1 -- 172.21.15.154:0/768103869 >> v2:172.21.15.154:3300/0 conn(0x7f43b8139280 msgr2=0x7f43b813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b67fc700 1 --2- 172.21.15.154:0/768103869 >> v2:172.21.15.154:3300/0 conn(0x7f43b8139280 0x7f43b813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b67fc700 1 -- 172.21.15.154:0/768103869 >> v1:172.21.15.154:6789/0 conn(0x7f43b8133ad0 legacy=0x7f43b8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b67fc700 1 -- 172.21.15.154:0/768103869 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b809a500 con 0x7f43b8136960 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b77fe700 1 --2- 172.21.15.154:0/768103869 >> v2:172.21.15.154:3300/0 conn(0x7f43b8139280 0x7f43b813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b67fc700 1 --2- 172.21.15.154:0/768103869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8136960 0x7f43b8138d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009870 tx=0x7f43a8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d98893d1c522a054 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b5ffb700 1 -- 172.21.15.154:0/768103869 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8011830 con 0x7f43b8136960 2023-09-30T22:23:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b5ffb700 1 -- 172.21.15.154:0/768103869 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a8011990 con 0x7f43b8136960 2023-09-30T22:23:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.514+0000 7f43b5ffb700 1 -- 172.21.15.154:0/768103869 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8011d20 con 0x7f43b8136960 2023-09-30T22:23:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.515+0000 7f43bd43f700 1 -- 172.21.15.154:0/768103869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8136960 msgr2=0x7f43b8138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.515+0000 7f43bd43f700 1 --2- 172.21.15.154:0/768103869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8136960 0x7f43b8138d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009870 tx=0x7f43a8009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.515+0000 7f43bd43f700 1 -- 172.21.15.154:0/768103869 shutdown_connections 2023-09-30T22:23:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.515+0000 7f43bd43f700 1 --2- 172.21.15.154:0/768103869 >> v2:172.21.15.154:3300/0 conn(0x7f43b8139280 0x7f43b813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.515+0000 7f43bd43f700 1 --2- 172.21.15.154:0/768103869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8136960 0x7f43b8138d40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.515+0000 7f43bd43f700 1 -- 172.21.15.154:0/768103869 >> 172.21.15.154:0/768103869 conn(0x7f43b8099c40 msgr2=0x7f43b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.515+0000 7f43bd43f700 1 -- 172.21.15.154:0/768103869 shutdown_connections 2023-09-30T22:23:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.515+0000 7f43bd43f700 1 -- 172.21.15.154:0/768103869 wait complete. 2023-09-30T22:23:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.516+0000 7f43bd43f700 1 Processor -- start 2023-09-30T22:23:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.516+0000 7f43bd43f700 1 -- start start 2023-09-30T22:23:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.516+0000 7f43bd43f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8133ad0 0x7f43b8071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43bd43f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8136960 0x7f43b8071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43bd43f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f43b8139280 0x7f43b81c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43bd43f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b8070450 con 0x7f43b8136960 2023-09-30T22:23:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43bd43f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b809f390 con 0x7f43b8133ad0 2023-09-30T22:23:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43bd43f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43b8138f50 con 0x7f43b8139280 2023-09-30T22:23:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8133ad0 0x7f43b8071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8136960 0x7f43b8071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8136960 0x7f43b8071e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36456/0 (socket says 172.21.15.154:36456) 2023-09-30T22:23:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b67fc700 1 -- 172.21.15.154:0/1416031980 learned_addr learned my addr 172.21.15.154:0/1416031980 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8133ad0 0x7f43b8071930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34550/0 (socket says 172.21.15.154:34550) 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b77fe700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f43b8139280 0x7f43b81c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b6ffd700 1 -- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f43b8139280 msgr2=0x7f43b81c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b6ffd700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f43b8139280 0x7f43b81c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b6ffd700 1 -- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8136960 msgr2=0x7f43b8071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b6ffd700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8136960 0x7f43b8071e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b6ffd700 1 -- 172.21.15.154:0/1416031980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b0009b30 con 0x7f43b8133ad0 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b77fe700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f43b8139280 0x7f43b81c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b67fc700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8136960 0x7f43b8071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43b6ffd700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8133ad0 0x7f43b8071930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43ac000f60 tx=0x7f43ac00c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f439f7fe700 1 -- 172.21.15.154:0/1416031980 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0052d0 con 0x7f43b8133ad0 2023-09-30T22:23:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f439f7fe700 1 -- 172.21.15.154:0/1416031980 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac005430 con 0x7f43b8133ad0 2023-09-30T22:23:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f439f7fe700 1 -- 172.21.15.154:0/1416031980 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0038c0 con 0x7f43b8133ad0 2023-09-30T22:23:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43bd43f700 1 -- 172.21.15.154:0/1416031980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a80094a0 con 0x7f43b8133ad0 2023-09-30T22:23:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.517+0000 7f43bd43f700 1 -- 172.21.15.154:0/1416031980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b806f0c0 con 0x7f43b8133ad0 2023-09-30T22:23:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.518+0000 7f439f7fe700 1 -- 172.21.15.154:0/1416031980 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43ac003c30 con 0x7f43b8133ad0 2023-09-30T22:23:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.518+0000 7f43bd43f700 1 -- 172.21.15.154:0/1416031980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b804f2a0 con 0x7f43b8133ad0 2023-09-30T22:23:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.518+0000 7f439f7fe700 1 -- 172.21.15.154:0/1416031980 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f43ac03ec60 con 0x7f43b8133ad0 2023-09-30T22:23:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.523+0000 7f439f7fe700 1 -- 172.21.15.154:0/1416031980 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43ac017020 con 0x7f43b8133ad0 2023-09-30T22:23:34.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.707+0000 7f43bd43f700 1 -- 172.21.15.154:0/1416031980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f43b809f0f0 con 0x7f43b8133ad0 2023-09-30T22:23:34.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.707+0000 7f439f7fe700 1 -- 172.21.15.154:0/1416031980 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43ac01bb10 con 0x7f43b8133ad0 2023-09-30T22:23:34.708 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.709+0000 7f43bd43f700 1 -- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8133ad0 msgr2=0x7f43b8071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.709+0000 7f43bd43f700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8133ad0 0x7f43b8071930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f43ac000f60 tx=0x7f43ac00c6e0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.709+0000 7f43bd43f700 1 -- 172.21.15.154:0/1416031980 shutdown_connections 2023-09-30T22:23:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.709+0000 7f43bd43f700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f43b8139280 0x7f43b81c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.709+0000 7f43bd43f700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43b8133ad0 0x7f43b8071930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.709+0000 7f43bd43f700 1 --2- 172.21.15.154:0/1416031980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8136960 0x7f43b8071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.709+0000 7f43bd43f700 1 -- 172.21.15.154:0/1416031980 >> 172.21.15.154:0/1416031980 conn(0x7f43b8099c40 msgr2=0x7f43b8134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.709+0000 7f43bd43f700 1 -- 172.21.15.154:0/1416031980 shutdown_connections 2023-09-30T22:23:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:34.709+0000 7f43bd43f700 1 -- 172.21.15.154:0/1416031980 wait complete. 2023-09-30T22:23:34.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:34.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:34.967 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:34.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.022+0000 7fd037685700 1 Processor -- start 2023-09-30T22:23:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.022+0000 7fd037685700 1 -- start start 2023-09-30T22:23:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.022+0000 7fd037685700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd030133b80 0x7fd030133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd037685700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030099a60 0x7fd0300a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd037685700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd0300a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd037685700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03009aa00 con 0x7fd030133b80 2023-09-30T22:23:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd037685700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03009a080 con 0x7fd0300a0e20 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd037685700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd030133750 con 0x7fd030099a60 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd034c20700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030099a60 0x7fd0300a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd034c20700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030099a60 0x7fd0300a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51314/0 (socket says 172.21.15.154:51314) 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd034c20700 1 -- 172.21.15.154:0/3803692022 learned_addr learned my addr 172.21.15.154:0/3803692022 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd035c22700 1 --2- 172.21.15.154:0/3803692022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd0300a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd035421700 1 --2- 172.21.15.154:0/3803692022 >> v2:172.21.15.154:3300/0 conn(0x7fd030133b80 0x7fd030133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd034c20700 1 -- 172.21.15.154:0/3803692022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 msgr2=0x7fd0300a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd034c20700 1 --2- 172.21.15.154:0/3803692022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd0300a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd034c20700 1 -- 172.21.15.154:0/3803692022 >> v2:172.21.15.154:3300/0 conn(0x7fd030133b80 msgr2=0x7fd030133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd034c20700 1 --2- 172.21.15.154:0/3803692022 >> v2:172.21.15.154:3300/0 conn(0x7fd030133b80 0x7fd030133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd034c20700 1 -- 172.21.15.154:0/3803692022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03009a760 con 0x7fd030099a60 2023-09-30T22:23:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd035421700 1 --2- 172.21.15.154:0/3803692022 >> v2:172.21.15.154:3300/0 conn(0x7fd030133b80 0x7fd030133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd034c20700 1 --2- 172.21.15.154:0/3803692022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030099a60 0x7fd0300a08e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0200098f0 tx=0x7fd020009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2900ebdf52f7f8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd027fff700 1 -- 172.21.15.154:0/3803692022 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020011830 con 0x7fd030099a60 2023-09-30T22:23:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd027fff700 1 -- 172.21.15.154:0/3803692022 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd020011990 con 0x7fd030099a60 2023-09-30T22:23:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.023+0000 7fd027fff700 1 -- 172.21.15.154:0/3803692022 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020011d20 con 0x7fd030099a60 2023-09-30T22:23:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.024+0000 7fd037685700 1 -- 172.21.15.154:0/3803692022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030099a60 msgr2=0x7fd0300a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.024+0000 7fd037685700 1 --2- 172.21.15.154:0/3803692022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030099a60 0x7fd0300a08e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0200098f0 tx=0x7fd020009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.024+0000 7fd037685700 1 -- 172.21.15.154:0/3803692022 shutdown_connections 2023-09-30T22:23:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.024+0000 7fd037685700 1 --2- 172.21.15.154:0/3803692022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd0300a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.024+0000 7fd037685700 1 --2- 172.21.15.154:0/3803692022 >> v2:172.21.15.154:3300/0 conn(0x7fd030133b80 0x7fd030133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.024+0000 7fd037685700 1 --2- 172.21.15.154:0/3803692022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030099a60 0x7fd0300a08e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.024+0000 7fd037685700 1 -- 172.21.15.154:0/3803692022 >> 172.21.15.154:0/3803692022 conn(0x7fd0300a2980 msgr2=0x7fd0300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.024+0000 7fd037685700 1 -- 172.21.15.154:0/3803692022 shutdown_connections 2023-09-30T22:23:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.024+0000 7fd037685700 1 -- 172.21.15.154:0/3803692022 wait complete. 2023-09-30T22:23:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.025+0000 7fd037685700 1 Processor -- start 2023-09-30T22:23:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.025+0000 7fd037685700 1 -- start start 2023-09-30T22:23:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd037685700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd030099a60 0x7fd03011abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd037685700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd03011b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd037685700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030133b80 0x7fd03011b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd037685700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03011e390 con 0x7fd030099a60 2023-09-30T22:23:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd037685700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03011c870 con 0x7fd0300a0e20 2023-09-30T22:23:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd037685700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd03011cd10 con 0x7fd030133b80 2023-09-30T22:23:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd034c20700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd03011b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd035c22700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030133b80 0x7fd03011b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd035c22700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030133b80 0x7fd03011b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51326/0 (socket says 172.21.15.154:51326) 2023-09-30T22:23:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd034c20700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd03011b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34564/0 (socket says 172.21.15.154:34564) 2023-09-30T22:23:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd035c22700 1 -- 172.21.15.154:0/3322525395 learned_addr learned my addr 172.21.15.154:0/3322525395 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd035421700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd030099a60 0x7fd03011abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd034c20700 1 -- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030133b80 msgr2=0x7fd03011b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd034c20700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030133b80 0x7fd03011b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd034c20700 1 -- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd030099a60 msgr2=0x7fd03011abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd034c20700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd030099a60 0x7fd03011abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd034c20700 1 -- 172.21.15.154:0/3322525395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd020009550 con 0x7fd0300a0e20 2023-09-30T22:23:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd035c22700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030133b80 0x7fd03011b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd035421700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd030099a60 0x7fd03011abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.026+0000 7fd034c20700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd03011b120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd020016000 tx=0x7fd020004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.027+0000 7fd025ffb700 1 -- 172.21.15.154:0/3322525395 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020004450 con 0x7fd0300a0e20 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.027+0000 7fd025ffb700 1 -- 172.21.15.154:0/3322525395 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0200045b0 con 0x7fd0300a0e20 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.027+0000 7fd037685700 1 -- 172.21.15.154:0/3322525395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd030130ab0 con 0x7fd0300a0e20 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.027+0000 7fd025ffb700 1 -- 172.21.15.154:0/3322525395 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0200038c0 con 0x7fd0300a0e20 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.027+0000 7fd037685700 1 -- 172.21.15.154:0/3322525395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03011eb70 con 0x7fd0300a0e20 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.028+0000 7fd025ffb700 1 -- 172.21.15.154:0/3322525395 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd020021070 con 0x7fd0300a0e20 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.028+0000 7fd025ffb700 1 -- 172.21.15.154:0/3322525395 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0200409f0 con 0x7fd0300a0e20 2023-09-30T22:23:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.028+0000 7fd037685700 1 -- 172.21.15.154:0/3322525395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0300a2f50 con 0x7fd0300a0e20 2023-09-30T22:23:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.034+0000 7fd025ffb700 1 -- 172.21.15.154:0/3322525395 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd020015080 con 0x7fd0300a0e20 2023-09-30T22:23:35.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.104+0000 7f105c07c700 1 Processor -- start 2023-09-30T22:23:35.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f105c07c700 1 -- start start 2023-09-30T22:23:35.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f105c07c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1054133ad0 0x7f1054133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f105c07c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10541300a0 0x7f10541304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f105c07c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10541309f0 0x7f105413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f105c07c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105406b2d0 con 0x7f10541309f0 2023-09-30T22:23:35.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f105c07c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1054133610 con 0x7f1054133ad0 2023-09-30T22:23:35.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f105c07c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f105409a500 con 0x7f10541300a0 2023-09-30T22:23:35.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f1059e18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1054133ad0 0x7f1054133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f105a619700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10541309f0 0x7f105413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f1059e18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1054133ad0 0x7f1054133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34566/0 (socket says 172.21.15.154:34566) 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f105a619700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10541309f0 0x7f105413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36488/0 (socket says 172.21.15.154:36488) 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f1059e18700 1 -- 172.21.15.154:0/2589232622 learned_addr learned my addr 172.21.15.154:0/2589232622 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.106+0000 7f1059617700 1 --2- 172.21.15.154:0/2589232622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10541300a0 0x7f10541304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f1059e18700 1 -- 172.21.15.154:0/2589232622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10541300a0 msgr2=0x7f10541304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f1059e18700 1 --2- 172.21.15.154:0/2589232622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10541300a0 0x7f10541304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f1059e18700 1 -- 172.21.15.154:0/2589232622 >> v2:172.21.15.154:3300/0 conn(0x7f10541309f0 msgr2=0x7f105413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f1059e18700 1 --2- 172.21.15.154:0/2589232622 >> v2:172.21.15.154:3300/0 conn(0x7f10541309f0 0x7f105413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f1059e18700 1 -- 172.21.15.154:0/2589232622 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10541338b0 con 0x7f1054133ad0 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f105a619700 1 --2- 172.21.15.154:0/2589232622 >> v2:172.21.15.154:3300/0 conn(0x7f10541309f0 0x7f105413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f1059e18700 1 --2- 172.21.15.154:0/2589232622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1054133ad0 0x7f1054133ea0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10500098f0 tx=0x7f1050009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5ba1b07c3a4b681 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f1058e16700 1 -- 172.21.15.154:0/2589232622 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011830 con 0x7f1054133ad0 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f1058e16700 1 -- 172.21.15.154:0/2589232622 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1050011990 con 0x7f1054133ad0 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.107+0000 7f1058e16700 1 -- 172.21.15.154:0/2589232622 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011d20 con 0x7f1054133ad0 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.108+0000 7f105c07c700 1 -- 172.21.15.154:0/2589232622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1054133ad0 msgr2=0x7f1054133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.108+0000 7f105c07c700 1 --2- 172.21.15.154:0/2589232622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1054133ad0 0x7f1054133ea0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10500098f0 tx=0x7f1050009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.108+0000 7f105c07c700 1 -- 172.21.15.154:0/2589232622 shutdown_connections 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.108+0000 7f105c07c700 1 --2- 172.21.15.154:0/2589232622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1054133ad0 0x7f1054133ea0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.108+0000 7f105c07c700 1 --2- 172.21.15.154:0/2589232622 >> v2:172.21.15.154:3300/0 conn(0x7f10541309f0 0x7f105413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.108+0000 7f105c07c700 1 --2- 172.21.15.154:0/2589232622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10541300a0 0x7f10541304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.108+0000 7f105c07c700 1 -- 172.21.15.154:0/2589232622 >> 172.21.15.154:0/2589232622 conn(0x7f1054099c40 msgr2=0x7f10540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.108+0000 7f105c07c700 1 -- 172.21.15.154:0/2589232622 shutdown_connections 2023-09-30T22:23:35.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.108+0000 7f105c07c700 1 -- 172.21.15.154:0/2589232622 wait complete. 2023-09-30T22:23:35.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f105c07c700 1 Processor -- start 2023-09-30T22:23:35.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f105c07c700 1 -- start start 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f105c07c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10541300a0 0x7f105411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f105c07c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10541309f0 0x7f105411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f105c07c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1054133ad0 0x7f105411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f105c07c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054120e70 con 0x7f10541309f0 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f105c07c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105412fd60 con 0x7f10541300a0 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f105c07c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f105412dd00 con 0x7f1054133ad0 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f1059e18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10541300a0 0x7f105411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f1059e18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10541300a0 0x7f105411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34580/0 (socket says 172.21.15.154:34580) 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f1059e18700 1 -- 172.21.15.154:0/2256079203 learned_addr learned my addr 172.21.15.154:0/2256079203 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f1059617700 1 --2- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10541309f0 0x7f105411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.109+0000 7f105a619700 1 --2- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1054133ad0 0x7f105411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f1059e18700 1 -- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1054133ad0 msgr2=0x7f105411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f1059e18700 1 --2- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1054133ad0 0x7f105411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f1059e18700 1 -- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10541309f0 msgr2=0x7f105411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f1059e18700 1 --2- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10541309f0 0x7f105411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f1059e18700 1 -- 172.21.15.154:0/2256079203 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c009a70 con 0x7f10541300a0 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f1059e18700 1 --2- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10541300a0 0x7f105411da40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1050009c40 tx=0x7f1050004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f104a7fc700 1 -- 172.21.15.154:0/2256079203 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050004450 con 0x7f10541300a0 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f104a7fc700 1 -- 172.21.15.154:0/2256079203 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10500045d0 con 0x7f10541300a0 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f105c07c700 1 -- 172.21.15.154:0/2256079203 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1050009550 con 0x7f10541300a0 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f104a7fc700 1 -- 172.21.15.154:0/2256079203 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10500038e0 con 0x7f10541300a0 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.110+0000 7f105c07c700 1 -- 172.21.15.154:0/2256079203 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1054071880 con 0x7f10541300a0 2023-09-30T22:23:35.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.111+0000 7f104a7fc700 1 -- 172.21.15.154:0/2256079203 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1050003a40 con 0x7f10541300a0 2023-09-30T22:23:35.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.111+0000 7f104a7fc700 1 -- 172.21.15.154:0/2256079203 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1050040b60 con 0x7f10541300a0 2023-09-30T22:23:35.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.112+0000 7f105c07c700 1 -- 172.21.15.154:0/2256079203 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105404f2a0 con 0x7f10541300a0 2023-09-30T22:23:35.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.121+0000 7f104a7fc700 1 -- 172.21.15.154:0/2256079203 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1050015080 con 0x7f10541300a0 2023-09-30T22:23:35.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.139+0000 7f2a97528700 1 Processor -- start 2023-09-30T22:23:35.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.139+0000 7f2a97528700 1 -- start start 2023-09-30T22:23:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.139+0000 7f2a97528700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a901346e0 0x7f2a90136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.139+0000 7f2a97528700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a90137000 0x7f2a901393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.139+0000 7f2a97528700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a900a1640 con 0x7f2a90131980 2023-09-30T22:23:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.139+0000 7f2a97528700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9006eb30 con 0x7f2a901346e0 2023-09-30T22:23:35.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.139+0000 7f2a97528700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900a22d0 con 0x7f2a90137000 2023-09-30T22:23:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a94ac3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a901346e0 0x7f2a90136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a952c4700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2a90131980 0x7f2a90131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52240/0 (socket says 172.21.15.154:52240) 2023-09-30T22:23:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a94ac3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a901346e0 0x7f2a90136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34596/0 (socket says 172.21.15.154:34596) 2023-09-30T22:23:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a952c4700 1 -- 172.21.15.154:0/2176751461 learned_addr learned my addr 172.21.15.154:0/2176751461 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a95ac5700 1 --2- 172.21.15.154:0/2176751461 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a90137000 0x7f2a901393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a94ac3700 1 -- 172.21.15.154:0/2176751461 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a90137000 msgr2=0x7f2a901393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a94ac3700 1 --2- 172.21.15.154:0/2176751461 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a90137000 0x7f2a901393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a94ac3700 1 -- 172.21.15.154:0/2176751461 >> v1:172.21.15.154:6789/0 conn(0x7f2a90131980 legacy=0x7f2a90131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a87fff700 1 -- 172.21.15.154:0/2176751461 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131003718 0 0) 0x7f2a900a1640 con 0x7f2a90131980 2023-09-30T22:23:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a94ac3700 1 -- 172.21.15.154:0/2176751461 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a90131550 con 0x7f2a901346e0 2023-09-30T22:23:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a95ac5700 1 --2- 172.21.15.154:0/2176751461 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a90137000 0x7f2a901393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a94ac3700 1 --2- 172.21.15.154:0/2176751461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a901346e0 0x7f2a90136ac0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009870 tx=0x7f2a80009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b53442921f35e97 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a87fff700 1 -- 172.21.15.154:0/2176751461 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80011830 con 0x7f2a901346e0 2023-09-30T22:23:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a87fff700 1 -- 172.21.15.154:0/2176751461 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a80011990 con 0x7f2a901346e0 2023-09-30T22:23:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.140+0000 7f2a87fff700 1 -- 172.21.15.154:0/2176751461 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80011d20 con 0x7f2a901346e0 2023-09-30T22:23:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.141+0000 7f2a97528700 1 -- 172.21.15.154:0/2176751461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a901346e0 msgr2=0x7f2a90136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.141+0000 7f2a97528700 1 --2- 172.21.15.154:0/2176751461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a901346e0 0x7f2a90136ac0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009870 tx=0x7f2a80009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.141+0000 7f2a97528700 1 -- 172.21.15.154:0/2176751461 shutdown_connections 2023-09-30T22:23:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.141+0000 7f2a97528700 1 --2- 172.21.15.154:0/2176751461 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a90137000 0x7f2a901393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.141+0000 7f2a97528700 1 --2- 172.21.15.154:0/2176751461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a901346e0 0x7f2a90136ac0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.141+0000 7f2a97528700 1 -- 172.21.15.154:0/2176751461 >> 172.21.15.154:0/2176751461 conn(0x7f2a900a2980 msgr2=0x7f2a900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.141+0000 7f2a97528700 1 -- 172.21.15.154:0/2176751461 shutdown_connections 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.141+0000 7f2a97528700 1 -- 172.21.15.154:0/2176751461 wait complete. 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.142+0000 7f2a97528700 1 Processor -- start 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.142+0000 7f2a97528700 1 -- start start 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a97528700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a90131980 0x7f2a901c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a97528700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a901346e0 0x7f2a901c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a97528700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a90137000 0x7f2a901c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a97528700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9009cce0 con 0x7f2a90137000 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a97528700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a900a1c40 con 0x7f2a90131980 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a97528700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9011b440 con 0x7f2a901346e0 2023-09-30T22:23:35.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a94ac3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a901346e0 0x7f2a901c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a94ac3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a901346e0 0x7f2a901c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51352/0 (socket says 172.21.15.154:51352) 2023-09-30T22:23:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a94ac3700 1 -- 172.21.15.154:0/3159723874 learned_addr learned my addr 172.21.15.154:0/3159723874 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a952c4700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a90131980 0x7f2a901c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a95ac5700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a90137000 0x7f2a901c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a952c4700 1 -- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a901346e0 msgr2=0x7f2a901c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a952c4700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a901346e0 0x7f2a901c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a952c4700 1 -- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a90137000 msgr2=0x7f2a901c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a952c4700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a90137000 0x7f2a901c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a952c4700 1 -- 172.21.15.154:0/3159723874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a88009a70 con 0x7f2a90131980 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.143+0000 7f2a94ac3700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a901346e0 0x7f2a901c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.144+0000 7f2a952c4700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a90131980 0x7f2a901c6180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c750 tx=0x7f2a8c00ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.144+0000 7f2a85ffb700 1 -- 172.21.15.154:0/3159723874 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0074e0 con 0x7f2a90131980 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.144+0000 7f2a85ffb700 1 -- 172.21.15.154:0/3159723874 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c007640 con 0x7f2a90131980 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.144+0000 7f2a97528700 1 -- 172.21.15.154:0/3159723874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a800094a0 con 0x7f2a90131980 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.144+0000 7f2a85ffb700 1 -- 172.21.15.154:0/3159723874 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c005a70 con 0x7f2a90131980 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.144+0000 7f2a97528700 1 -- 172.21.15.154:0/3159723874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a90070f40 con 0x7f2a90131980 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.145+0000 7f2a85ffb700 1 -- 172.21.15.154:0/3159723874 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a8c005bd0 con 0x7f2a90131980 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.145+0000 7f2a85ffb700 1 -- 172.21.15.154:0/3159723874 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a8c03ea60 con 0x7f2a90131980 2023-09-30T22:23:35.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.145+0000 7f2a97528700 1 -- 172.21.15.154:0/3159723874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9004f2a0 con 0x7f2a90131980 2023-09-30T22:23:35.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.150+0000 7f2a85ffb700 1 -- 172.21.15.154:0/3159723874 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a8c017080 con 0x7f2a90131980 2023-09-30T22:23:35.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.249+0000 7fd037685700 1 -- 172.21.15.154:0/3322525395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd03004f2a0 con 0x7fd0300a0e20 2023-09-30T22:23:35.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.249+0000 7fd025ffb700 1 -- 172.21.15.154:0/3322525395 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0200199a0 con 0x7fd0300a0e20 2023-09-30T22:23:35.249 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:35.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.252+0000 7fd037685700 1 -- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 msgr2=0x7fd03011b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.252+0000 7fd037685700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd03011b120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd020016000 tx=0x7fd020004750 comp rx=0 tx=0).stop 2023-09-30T22:23:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.252+0000 7fd037685700 1 -- 172.21.15.154:0/3322525395 shutdown_connections 2023-09-30T22:23:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.252+0000 7fd037685700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd030133b80 0x7fd03011b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.252+0000 7fd037685700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd030099a60 0x7fd03011abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.252+0000 7fd037685700 1 --2- 172.21.15.154:0/3322525395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0300a0e20 0x7fd03011b120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.252+0000 7fd037685700 1 -- 172.21.15.154:0/3322525395 >> 172.21.15.154:0/3322525395 conn(0x7fd0300a2980 msgr2=0x7fd03012f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.252+0000 7fd037685700 1 -- 172.21.15.154:0/3322525395 shutdown_connections 2023-09-30T22:23:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.252+0000 7fd037685700 1 -- 172.21.15.154:0/3322525395 wait complete. 2023-09-30T22:23:35.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.320+0000 7f105c07c700 1 -- 172.21.15.154:0/2256079203 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f105411ff10 con 0x7f10541300a0 2023-09-30T22:23:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.320+0000 7f104a7fc700 1 -- 172.21.15.154:0/2256079203 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1050010380 con 0x7f10541300a0 2023-09-30T22:23:35.320 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:35.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.322+0000 7f105c07c700 1 -- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10541300a0 msgr2=0x7f105411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.322+0000 7f105c07c700 1 --2- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10541300a0 0x7f105411da40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1050009c40 tx=0x7f1050004750 comp rx=0 tx=0).stop 2023-09-30T22:23:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.323+0000 7f105c07c700 1 -- 172.21.15.154:0/2256079203 shutdown_connections 2023-09-30T22:23:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.323+0000 7f105c07c700 1 --2- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1054133ad0 0x7f105411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.323+0000 7f105c07c700 1 --2- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10541300a0 0x7f105411da40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.323+0000 7f105c07c700 1 --2- 172.21.15.154:0/2256079203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10541309f0 0x7f105411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.323+0000 7f105c07c700 1 -- 172.21.15.154:0/2256079203 >> 172.21.15.154:0/2256079203 conn(0x7f1054099c40 msgr2=0x7f105409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.323+0000 7f105c07c700 1 -- 172.21.15.154:0/2256079203 shutdown_connections 2023-09-30T22:23:35.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.323+0000 7f105c07c700 1 -- 172.21.15.154:0/2256079203 wait complete. 2023-09-30T22:23:35.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.344+0000 7f2a97528700 1 -- 172.21.15.154:0/3159723874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2a9006bce0 con 0x7f2a90131980 2023-09-30T22:23:35.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.344+0000 7f2a85ffb700 1 -- 172.21.15.154:0/3159723874 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a8c019cd0 con 0x7f2a90131980 2023-09-30T22:23:35.347 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.347+0000 7f2a97528700 1 -- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a90131980 msgr2=0x7f2a901c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.347+0000 7f2a97528700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a90131980 0x7f2a901c6180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c750 tx=0x7f2a8c00ca60 comp rx=0 tx=0).stop 2023-09-30T22:23:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.347+0000 7f2a97528700 1 -- 172.21.15.154:0/3159723874 shutdown_connections 2023-09-30T22:23:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.347+0000 7f2a97528700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a90137000 0x7f2a901c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.347+0000 7f2a97528700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a90131980 0x7f2a901c6180 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.347+0000 7f2a97528700 1 --2- 172.21.15.154:0/3159723874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a901346e0 0x7f2a901c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.347+0000 7f2a97528700 1 -- 172.21.15.154:0/3159723874 >> 172.21.15.154:0/3159723874 conn(0x7f2a900a2980 msgr2=0x7f2a90133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.347+0000 7f2a97528700 1 -- 172.21.15.154:0/3159723874 shutdown_connections 2023-09-30T22:23:35.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.347+0000 7f2a97528700 1 -- 172.21.15.154:0/3159723874 wait complete. 2023-09-30T22:23:35.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:35.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:35.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.846+0000 7fd146357700 1 Processor -- start 2023-09-30T22:23:35.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.846+0000 7fd146357700 1 -- start start 2023-09-30T22:23:35.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd146357700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd140133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd146357700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a0980 0x7fd1400a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd146357700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1400a1310 0x7fd14013a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd146357700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14009a080 con 0x7fd1400a1310 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd146357700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401336e0 con 0x7fd140133b10 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd146357700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd14009a760 con 0x7fd1400a0980 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd13ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd140133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a0980 0x7fd1400a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd1448f4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1400a1310 0x7fd14013a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd1448f4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1400a1310 0x7fd14013a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47858/0 (socket says 172.21.15.154:47858) 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a0980 0x7fd1400a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52154/0 (socket says 172.21.15.154:52154) 2023-09-30T22:23:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd1448f4700 1 -- 172.21.15.154:0/2467916017 learned_addr learned my addr 172.21.15.154:0/2467916017 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd13ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd140133ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59256/0 (socket says 172.21.15.154:59256) 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd1448f4700 1 -- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a0980 msgr2=0x7fd1400a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd1448f4700 1 --2- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a0980 0x7fd1400a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd1448f4700 1 -- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 msgr2=0x7fd140133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd1448f4700 1 --2- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd140133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd1448f4700 1 -- 172.21.15.154:0/2467916017 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400a1780 con 0x7fd1400a1310 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd13ffff700 1 --2- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd140133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd13f7fe700 1 --2- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a0980 0x7fd1400a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd1448f4700 1 --2- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a1310 0x7fd14013a900 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd138009e50 tx=0x7fd13800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4775f2fb036ffd74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd13effd700 1 -- 172.21.15.154:0/2467916017 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800e070 con 0x7fd1400a1310 2023-09-30T22:23:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd13effd700 1 -- 172.21.15.154:0/2467916017 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13800b910 con 0x7fd1400a1310 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.847+0000 7fd13effd700 1 -- 172.21.15.154:0/2467916017 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800bcc0 con 0x7fd1400a1310 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.848+0000 7fd146357700 1 -- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a1310 msgr2=0x7fd14013a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.848+0000 7fd146357700 1 --2- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a1310 0x7fd14013a900 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd138009e50 tx=0x7fd13800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.848+0000 7fd146357700 1 -- 172.21.15.154:0/2467916017 shutdown_connections 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.848+0000 7fd146357700 1 --2- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd140133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.848+0000 7fd146357700 1 --2- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a1310 0x7fd14013a900 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.848+0000 7fd146357700 1 --2- 172.21.15.154:0/2467916017 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a0980 0x7fd1400a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.848+0000 7fd146357700 1 -- 172.21.15.154:0/2467916017 >> 172.21.15.154:0/2467916017 conn(0x7fd1400a2980 msgr2=0x7fd1400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.848+0000 7fd146357700 1 -- 172.21.15.154:0/2467916017 shutdown_connections 2023-09-30T22:23:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.848+0000 7fd146357700 1 -- 172.21.15.154:0/2467916017 wait complete. 2023-09-30T22:23:35.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.849+0000 7fd146357700 1 Processor -- start 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.849+0000 7fd146357700 1 -- start start 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd146357700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a0980 0x7fd14011cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd146357700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a1310 0x7fd14011d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd146357700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd1401c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd146357700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140130b60 con 0x7fd1400a0980 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd146357700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14011c690 con 0x7fd140133b10 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd146357700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd14011fa10 con 0x7fd1400a1310 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a1310 0x7fd14011d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd1448f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd1401c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd13ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a0980 0x7fd14011cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd1448f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd1401c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59258/0 (socket says 172.21.15.154:59258) 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd1448f4700 1 -- 172.21.15.154:0/1464357159 learned_addr learned my addr 172.21.15.154:0/1464357159 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a1310 0x7fd14011d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52164/0 (socket says 172.21.15.154:52164) 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd1448f4700 1 -- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a1310 msgr2=0x7fd14011d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd1448f4700 1 --2- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a1310 0x7fd14011d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd1448f4700 1 -- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a0980 msgr2=0x7fd14011cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd1448f4700 1 --2- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a0980 0x7fd14011cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd1448f4700 1 -- 172.21.15.154:0/1464357159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300094a0 con 0x7fd140133b10 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd13ffff700 1 --2- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a0980 0x7fd14011cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd1448f4700 1 --2- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd1401c8100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd1401335d0 tx=0x7fd138004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd13cff9700 1 -- 172.21.15.154:0/1464357159 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380092e0 con 0x7fd140133b10 2023-09-30T22:23:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd13cff9700 1 -- 172.21.15.154:0/1464357159 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13800ce80 con 0x7fd140133b10 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd146357700 1 -- 172.21.15.154:0/1464357159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd134009430 con 0x7fd140133b10 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd13cff9700 1 -- 172.21.15.154:0/1464357159 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380044b0 con 0x7fd140133b10 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.850+0000 7fd146357700 1 -- 172.21.15.154:0/1464357159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd138009b30 con 0x7fd140133b10 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.851+0000 7fd13cff9700 1 -- 172.21.15.154:0/1464357159 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd138004610 con 0x7fd140133b10 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.851+0000 7fd13cff9700 1 -- 172.21.15.154:0/1464357159 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd138040a20 con 0x7fd140133b10 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.851+0000 7fd146357700 1 -- 172.21.15.154:0/1464357159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14006b700 con 0x7fd140133b10 2023-09-30T22:23:35.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:35.856+0000 7fd13cff9700 1 -- 172.21.15.154:0/1464357159 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd13801c440 con 0x7fd140133b10 2023-09-30T22:23:36.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.039+0000 7fd146357700 1 -- 172.21.15.154:0/1464357159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd14004f2a0 con 0x7fd140133b10 2023-09-30T22:23:36.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.039+0000 7fd13cff9700 1 -- 172.21.15.154:0/1464357159 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd13802a030 con 0x7fd140133b10 2023-09-30T22:23:36.039 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:36.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.041+0000 7fd146357700 1 -- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 msgr2=0x7fd1401c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.041+0000 7fd146357700 1 --2- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd1401c8100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd1401335d0 tx=0x7fd138004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.041+0000 7fd146357700 1 -- 172.21.15.154:0/1464357159 shutdown_connections 2023-09-30T22:23:36.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.041+0000 7fd146357700 1 --2- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd140133b10 0x7fd1401c8100 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.041+0000 7fd146357700 1 --2- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1400a0980 0x7fd14011cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.041+0000 7fd146357700 1 --2- 172.21.15.154:0/1464357159 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1400a1310 0x7fd14011d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.041+0000 7fd146357700 1 -- 172.21.15.154:0/1464357159 >> 172.21.15.154:0/1464357159 conn(0x7fd1400a2980 msgr2=0x7fd1401314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.042+0000 7fd146357700 1 -- 172.21.15.154:0/1464357159 shutdown_connections 2023-09-30T22:23:36.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.042+0000 7fd146357700 1 -- 172.21.15.154:0/1464357159 wait complete. 2023-09-30T22:23:36.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:36.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:36.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:36.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:36.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.390+0000 7f8651c5b700 1 Processor -- start 2023-09-30T22:23:36.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.390+0000 7f8651c5b700 1 -- start start 2023-09-30T22:23:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.390+0000 7f8651c5b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c09ad40 0x7f864c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.390+0000 7f8651c5b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f864c133f70 0x7f864c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.390+0000 7f8651c5b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c0a0a70 0x7f864c0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.390+0000 7f8651c5b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0a3b60 con 0x7f864c133f70 2023-09-30T22:23:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.390+0000 7f8651c5b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1348e0 con 0x7f864c09ad40 2023-09-30T22:23:36.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.390+0000 7f8651c5b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864c09b110 con 0x7f864c0a0a70 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f864c133f70 0x7f864c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f864c133f70 0x7f864c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47882/0 (socket says 172.21.15.154:47882) 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864affd700 1 -- 172.21.15.154:0/1312262847 learned_addr learned my addr 172.21.15.154:0/1312262847 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864bfff700 1 --2- 172.21.15.154:0/1312262847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c0a0a70 0x7f864c0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864b7fe700 1 --2- 172.21.15.154:0/1312262847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c09ad40 0x7f864c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864bfff700 1 -- 172.21.15.154:0/1312262847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c09ad40 msgr2=0x7f864c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864bfff700 1 --2- 172.21.15.154:0/1312262847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c09ad40 0x7f864c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864bfff700 1 -- 172.21.15.154:0/1312262847 >> v2:172.21.15.154:3300/0 conn(0x7f864c133f70 msgr2=0x7f864c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864bfff700 1 --2- 172.21.15.154:0/1312262847 >> v2:172.21.15.154:3300/0 conn(0x7f864c133f70 0x7f864c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864bfff700 1 -- 172.21.15.154:0/1312262847 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0a2fa0 con 0x7f864c0a0a70 2023-09-30T22:23:36.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864affd700 1 --2- 172.21.15.154:0/1312262847 >> v2:172.21.15.154:3300/0 conn(0x7f864c133f70 0x7f864c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:36.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864bfff700 1 --2- 172.21.15.154:0/1312262847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c0a0a70 0x7f864c0a0ed0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8644009dc0 tx=0x7f864400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb9395a35e3f4d12 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:36.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864a7fc700 1 -- 172.21.15.154:0/1312262847 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864400e070 con 0x7f864c0a0a70 2023-09-30T22:23:36.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864a7fc700 1 -- 172.21.15.154:0/1312262847 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864400bae0 con 0x7f864c0a0a70 2023-09-30T22:23:36.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.391+0000 7f864a7fc700 1 -- 172.21.15.154:0/1312262847 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864400be90 con 0x7f864c0a0a70 2023-09-30T22:23:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.392+0000 7f8651c5b700 1 -- 172.21.15.154:0/1312262847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c0a0a70 msgr2=0x7f864c0a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.392+0000 7f8651c5b700 1 --2- 172.21.15.154:0/1312262847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c0a0a70 0x7f864c0a0ed0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8644009dc0 tx=0x7f864400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.392+0000 7f8651c5b700 1 -- 172.21.15.154:0/1312262847 shutdown_connections 2023-09-30T22:23:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.392+0000 7f8651c5b700 1 --2- 172.21.15.154:0/1312262847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c09ad40 0x7f864c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.392+0000 7f8651c5b700 1 --2- 172.21.15.154:0/1312262847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c0a0a70 0x7f864c0a0ed0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.392+0000 7f8651c5b700 1 --2- 172.21.15.154:0/1312262847 >> v2:172.21.15.154:3300/0 conn(0x7f864c133f70 0x7f864c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.392+0000 7f8651c5b700 1 -- 172.21.15.154:0/1312262847 >> 172.21.15.154:0/1312262847 conn(0x7f864c099c40 msgr2=0x7f864c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.392+0000 7f8651c5b700 1 -- 172.21.15.154:0/1312262847 shutdown_connections 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.392+0000 7f8651c5b700 1 -- 172.21.15.154:0/1312262847 wait complete. 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.393+0000 7f8651c5b700 1 Processor -- start 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.393+0000 7f8651c5b700 1 -- start start 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f8651c5b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c09ad40 0x7f864c1c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f8651c5b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c1c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f8651c5b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f70 0x7f864c1c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f8651c5b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1208d0 con 0x7f864c09ad40 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f8651c5b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1206e0 con 0x7f864c0a0a70 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f8651c5b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864c1225f0 con 0x7f864c133f70 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f70 0x7f864c1c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c09ad40 0x7f864c1c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f70 0x7f864c1c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52184/0 (socket says 172.21.15.154:52184) 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c09ad40 0x7f864c1c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47886/0 (socket says 172.21.15.154:47886) 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864bfff700 1 -- 172.21.15.154:0/2061397384 learned_addr learned my addr 172.21.15.154:0/2061397384 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864affd700 1 --2- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c1c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864b7fe700 1 -- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f70 msgr2=0x7f864c1c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864b7fe700 1 --2- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f70 0x7f864c1c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864b7fe700 1 -- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 msgr2=0x7f864c1c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864b7fe700 1 --2- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c1c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.394+0000 7f864b7fe700 1 -- 172.21.15.154:0/2061397384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8640009550 con 0x7f864c09ad40 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.395+0000 7f864b7fe700 1 --2- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c09ad40 0x7f864c1c8290 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e870 tx=0x7f863c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.395+0000 7f8633fff700 1 -- 172.21.15.154:0/2061397384 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c013680 con 0x7f864c09ad40 2023-09-30T22:23:36.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.395+0000 7f8633fff700 1 -- 172.21.15.154:0/2061397384 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c0137e0 con 0x7f864c09ad40 2023-09-30T22:23:36.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.395+0000 7f8651c5b700 1 -- 172.21.15.154:0/2061397384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8644009a70 con 0x7f864c09ad40 2023-09-30T22:23:36.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.395+0000 7f8633fff700 1 -- 172.21.15.154:0/2061397384 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c013b50 con 0x7f864c09ad40 2023-09-30T22:23:36.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.395+0000 7f8651c5b700 1 -- 172.21.15.154:0/2061397384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c122310 con 0x7f864c09ad40 2023-09-30T22:23:36.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.396+0000 7f8651c5b700 1 -- 172.21.15.154:0/2061397384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c04f2a0 con 0x7f864c09ad40 2023-09-30T22:23:36.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.396+0000 7f8633fff700 1 -- 172.21.15.154:0/2061397384 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f863c013cb0 con 0x7f864c09ad40 2023-09-30T22:23:36.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.396+0000 7f8633fff700 1 -- 172.21.15.154:0/2061397384 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f863c03f460 con 0x7f864c09ad40 2023-09-30T22:23:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.401+0000 7f8633fff700 1 -- 172.21.15.154:0/2061397384 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f863c01be10 con 0x7f864c09ad40 2023-09-30T22:23:36.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5446fda700 1 Processor -- start 2023-09-30T22:23:36.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5446fda700 1 -- start start 2023-09-30T22:23:36.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5446fda700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f5440133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5446fda700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f54401304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5446fda700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544006b2d0 con 0x7f54401309f0 2023-09-30T22:23:36.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5446fda700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5440133610 con 0x7f5440133ad0 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5446fda700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f544009a500 con 0x7f54401300a0 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5444d76700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f5440133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5445577700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f54401309f0 0x7f544013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37304/0 (socket says 172.21.15.154:37304) 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.463+0000 7f5445577700 1 -- 172.21.15.154:0/3583839718 learned_addr learned my addr 172.21.15.154:0/3583839718 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f543ffff700 1 --2- 172.21.15.154:0/3583839718 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f54401304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f543ffff700 1 -- 172.21.15.154:0/3583839718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 msgr2=0x7f5440133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f543ffff700 1 --2- 172.21.15.154:0/3583839718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f5440133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f543ffff700 1 -- 172.21.15.154:0/3583839718 >> v1:172.21.15.154:6789/0 conn(0x7f54401309f0 legacy=0x7f544013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f543ffff700 1 -- 172.21.15.154:0/3583839718 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54401338b0 con 0x7f54401300a0 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f5444d76700 1 --2- 172.21.15.154:0/3583839718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f5440133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f543ffff700 1 --2- 172.21.15.154:0/3583839718 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f54401304b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f542c009870 tx=0x7f542c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5736cf7842040264 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f543f7fe700 1 -- 172.21.15.154:0/3583839718 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c011830 con 0x7f54401300a0 2023-09-30T22:23:36.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f543f7fe700 1 -- 172.21.15.154:0/3583839718 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c011990 con 0x7f54401300a0 2023-09-30T22:23:36.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.464+0000 7f543f7fe700 1 -- 172.21.15.154:0/3583839718 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c011d20 con 0x7f54401300a0 2023-09-30T22:23:36.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.465+0000 7f5446fda700 1 -- 172.21.15.154:0/3583839718 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 msgr2=0x7f54401304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.465+0000 7f5446fda700 1 --2- 172.21.15.154:0/3583839718 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f54401304b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f542c009870 tx=0x7f542c009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.465+0000 7f5446fda700 1 -- 172.21.15.154:0/3583839718 shutdown_connections 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.465+0000 7f5446fda700 1 --2- 172.21.15.154:0/3583839718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f5440133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.465+0000 7f5446fda700 1 --2- 172.21.15.154:0/3583839718 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f54401304b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.465+0000 7f5446fda700 1 -- 172.21.15.154:0/3583839718 >> 172.21.15.154:0/3583839718 conn(0x7f5440099c40 msgr2=0x7f54400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.465+0000 7f5446fda700 1 -- 172.21.15.154:0/3583839718 shutdown_connections 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.465+0000 7f5446fda700 1 -- 172.21.15.154:0/3583839718 wait complete. 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.467+0000 7f5446fda700 1 Processor -- start 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.467+0000 7f5446fda700 1 -- start start 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.467+0000 7f5446fda700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f544011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.467+0000 7f5446fda700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401309f0 0x7f544011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5446fda700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f544011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5446fda700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54400a2ea0 con 0x7f54401309f0 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5446fda700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544012dd00 con 0x7f5440133ad0 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5446fda700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5440072330 con 0x7f54401300a0 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5444d76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f544011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5444d76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f544011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52206/0 (socket says 172.21.15.154:52206) 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5444d76700 1 -- 172.21.15.154:0/1176672987 learned_addr learned my addr 172.21.15.154:0/1176672987 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5445577700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f544011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f543ffff700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401309f0 0x7f544011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5444d76700 1 -- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 msgr2=0x7f544011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5444d76700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f544011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5444d76700 1 -- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401309f0 msgr2=0x7f544011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5444d76700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401309f0 0x7f544011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5444d76700 1 -- 172.21.15.154:0/1176672987 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54340094a0 con 0x7f54401300a0 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5445577700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f544011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f543ffff700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401309f0 0x7f544011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5444d76700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f544011da40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f543400ebe0 tx=0x7f543400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f543d7fa700 1 -- 172.21.15.154:0/1176672987 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400c850 con 0x7f54401300a0 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f543d7fa700 1 -- 172.21.15.154:0/1176672987 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543400c9b0 con 0x7f54401300a0 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f5446fda700 1 -- 172.21.15.154:0/1176672987 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c0094a0 con 0x7f54401300a0 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.468+0000 7f543d7fa700 1 -- 172.21.15.154:0/1176672987 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400cd40 con 0x7f54401300a0 2023-09-30T22:23:36.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.469+0000 7f5446fda700 1 -- 172.21.15.154:0/1176672987 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544012d290 con 0x7f54401300a0 2023-09-30T22:23:36.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.469+0000 7f543d7fa700 1 -- 172.21.15.154:0/1176672987 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5434013470 con 0x7f54401300a0 2023-09-30T22:23:36.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.470+0000 7f5446fda700 1 -- 172.21.15.154:0/1176672987 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544004f2a0 con 0x7f54401300a0 2023-09-30T22:23:36.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.470+0000 7f543d7fa700 1 -- 172.21.15.154:0/1176672987 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f543403f770 con 0x7f54401300a0 2023-09-30T22:23:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.474+0000 7f543d7fa700 1 -- 172.21.15.154:0/1176672987 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5434013aa0 con 0x7f54401300a0 2023-09-30T22:23:36.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.506+0000 7fc2e3d40700 1 Processor -- start 2023-09-30T22:23:36.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.506+0000 7fc2e3d40700 1 -- start start 2023-09-30T22:23:36.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e3d40700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2dc0a0a70 0x7fc2dc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e3d40700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc0a1380 0x7fc2dc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e3d40700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2dc09dc00 con 0x7fc2dc133f50 2023-09-30T22:23:36.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e3d40700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2dc09ea60 con 0x7fc2dc0a0a70 2023-09-30T22:23:36.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e3d40700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc09dec0 con 0x7fc2dc0a1380 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e1adc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2dc0a0a70 0x7fc2dc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e12db700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc0a1380 0x7fc2dc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e12db700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc0a1380 0x7fc2dc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59290/0 (socket says 172.21.15.154:59290) 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e1adc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2dc0a0a70 0x7fc2dc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47906/0 (socket says 172.21.15.154:47906) 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e12db700 1 -- 172.21.15.154:0/2101677092 learned_addr learned my addr 172.21.15.154:0/2101677092 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e22dd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc2dc133f50 0x7fc2dc13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37316/0 (socket says 172.21.15.154:37316) 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e12db700 1 -- 172.21.15.154:0/2101677092 >> v2:172.21.15.154:3300/0 conn(0x7fc2dc0a0a70 msgr2=0x7fc2dc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e12db700 1 --2- 172.21.15.154:0/2101677092 >> v2:172.21.15.154:3300/0 conn(0x7fc2dc0a0a70 0x7fc2dc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e12db700 1 -- 172.21.15.154:0/2101677092 >> v1:172.21.15.154:6789/0 conn(0x7fc2dc133f50 legacy=0x7fc2dc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e12db700 1 -- 172.21.15.154:0/2101677092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc09e6a0 con 0x7fc2dc0a1380 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e1adc700 1 --2- 172.21.15.154:0/2101677092 >> v2:172.21.15.154:3300/0 conn(0x7fc2dc0a0a70 0x7fc2dc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:36.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.507+0000 7fc2e12db700 1 --2- 172.21.15.154:0/2101677092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc0a1380 0x7fc2dc133a10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0098f0 tx=0x7fc2cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef6cf942f9111e18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e0ada700 1 -- 172.21.15.154:0/2101677092 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc011830 con 0x7fc2dc0a1380 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e0ada700 1 -- 172.21.15.154:0/2101677092 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc011990 con 0x7fc2dc0a1380 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e0ada700 1 -- 172.21.15.154:0/2101677092 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc011d20 con 0x7fc2dc0a1380 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e3d40700 1 -- 172.21.15.154:0/2101677092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc0a1380 msgr2=0x7fc2dc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e3d40700 1 --2- 172.21.15.154:0/2101677092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc0a1380 0x7fc2dc133a10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0098f0 tx=0x7fc2cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e3d40700 1 -- 172.21.15.154:0/2101677092 shutdown_connections 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e3d40700 1 --2- 172.21.15.154:0/2101677092 >> v2:172.21.15.154:3300/0 conn(0x7fc2dc0a0a70 0x7fc2dc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e3d40700 1 --2- 172.21.15.154:0/2101677092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc0a1380 0x7fc2dc133a10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e3d40700 1 -- 172.21.15.154:0/2101677092 >> 172.21.15.154:0/2101677092 conn(0x7fc2dc0a6610 msgr2=0x7fc2dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e3d40700 1 -- 172.21.15.154:0/2101677092 shutdown_connections 2023-09-30T22:23:36.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.508+0000 7fc2e3d40700 1 -- 172.21.15.154:0/2101677092 wait complete. 2023-09-30T22:23:36.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.509+0000 7fc2e3d40700 1 Processor -- start 2023-09-30T22:23:36.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.509+0000 7fc2e3d40700 1 -- start start 2023-09-30T22:23:36.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e3d40700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc0a0a70 0x7fc2dc1c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e3d40700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2dc0a1380 0x7fc2dc1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e3d40700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc133f50 0x7fc2dc1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e3d40700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc122e90 con 0x7fc2dc0a0a70 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e3d40700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc133a10 con 0x7fc2dc133f50 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e3d40700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc0a03e0 con 0x7fc2dc0a1380 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e12db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2dc0a1380 0x7fc2dc1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e12db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2dc0a1380 0x7fc2dc1c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52210/0 (socket says 172.21.15.154:52210) 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e12db700 1 -- 172.21.15.154:0/1953370537 learned_addr learned my addr 172.21.15.154:0/1953370537 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e1adc700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc0a0a70 0x7fc2dc1c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e22dd700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc133f50 0x7fc2dc1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e12db700 1 -- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc133f50 msgr2=0x7fc2dc1c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e12db700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc133f50 0x7fc2dc1c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e12db700 1 -- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc0a0a70 msgr2=0x7fc2dc1c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e12db700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc0a0a70 0x7fc2dc1c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e12db700 1 -- 172.21.15.154:0/1953370537 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80094a0 con 0x7fc2dc0a1380 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e1adc700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc0a0a70 0x7fc2dc1c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e12db700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2dc0a1380 0x7fc2dc1c8790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc000c00 tx=0x7fc2cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2d27fc700 1 -- 172.21.15.154:0/1953370537 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0036a0 con 0x7fc2dc0a1380 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2d27fc700 1 -- 172.21.15.154:0/1953370537 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc003800 con 0x7fc2dc0a1380 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2d27fc700 1 -- 172.21.15.154:0/1953370537 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc003bb0 con 0x7fc2dc0a1380 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e3d40700 1 -- 172.21.15.154:0/1953370537 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc009550 con 0x7fc2dc0a1380 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.510+0000 7fc2e3d40700 1 -- 172.21.15.154:0/1953370537 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2dc1252e0 con 0x7fc2dc0a1380 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.511+0000 7fc2d27fc700 1 -- 172.21.15.154:0/1953370537 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2cc021070 con 0x7fc2dc0a1380 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.511+0000 7fc2d27fc700 1 -- 172.21.15.154:0/1953370537 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2cc040be0 con 0x7fc2dc0a1380 2023-09-30T22:23:36.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.511+0000 7fc2e3d40700 1 -- 172.21.15.154:0/1953370537 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2dc126330 con 0x7fc2dc0a1380 2023-09-30T22:23:36.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.516+0000 7fc2d27fc700 1 -- 172.21.15.154:0/1953370537 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2cc029080 con 0x7fc2dc0a1380 2023-09-30T22:23:36.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.648+0000 7f8651c5b700 1 -- 172.21.15.154:0/2061397384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f864c122170 con 0x7f864c09ad40 2023-09-30T22:23:36.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.648+0000 7f8633fff700 1 -- 172.21.15.154:0/2061397384 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f864c122170 con 0x7f864c09ad40 2023-09-30T22:23:36.648 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:36.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.650+0000 7f8651c5b700 1 -- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c09ad40 msgr2=0x7f864c1c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.650+0000 7f8651c5b700 1 --2- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c09ad40 0x7f864c1c8290 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e870 tx=0x7f863c00eb80 comp rx=0 tx=0).stop 2023-09-30T22:23:36.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.650+0000 7f8651c5b700 1 -- 172.21.15.154:0/2061397384 shutdown_connections 2023-09-30T22:23:36.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.650+0000 7f8651c5b700 1 --2- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f864c133f70 0x7f864c1c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.650+0000 7f8651c5b700 1 --2- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f864c09ad40 0x7f864c1c8290 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.650+0000 7f8651c5b700 1 --2- 172.21.15.154:0/2061397384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f864c0a0a70 0x7f864c1c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.650+0000 7f8651c5b700 1 -- 172.21.15.154:0/2061397384 >> 172.21.15.154:0/2061397384 conn(0x7f864c099c40 msgr2=0x7f864c1bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.650+0000 7f8651c5b700 1 -- 172.21.15.154:0/2061397384 shutdown_connections 2023-09-30T22:23:36.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.650+0000 7f8651c5b700 1 -- 172.21.15.154:0/2061397384 wait complete. 2023-09-30T22:23:36.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:36.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.709+0000 7fc2e3d40700 1 -- 172.21.15.154:0/1953370537 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc2dc04f2a0 con 0x7fc2dc0a1380 2023-09-30T22:23:36.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.710+0000 7fc2d27fc700 1 -- 172.21.15.154:0/1953370537 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2cc015020 con 0x7fc2dc0a1380 2023-09-30T22:23:36.710 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:36.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.712+0000 7fc2e3d40700 1 -- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2dc0a1380 msgr2=0x7fc2dc1c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.712+0000 7fc2e3d40700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2dc0a1380 0x7fc2dc1c8790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc000c00 tx=0x7fc2cc004750 comp rx=0 tx=0).stop 2023-09-30T22:23:36.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.712+0000 7fc2e3d40700 1 -- 172.21.15.154:0/1953370537 shutdown_connections 2023-09-30T22:23:36.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.712+0000 7fc2e3d40700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2dc133f50 0x7fc2dc1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.712+0000 7fc2e3d40700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2dc0a0a70 0x7fc2dc1c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.712+0000 7fc2e3d40700 1 --2- 172.21.15.154:0/1953370537 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2dc0a1380 0x7fc2dc1c8790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.712+0000 7fc2e3d40700 1 -- 172.21.15.154:0/1953370537 >> 172.21.15.154:0/1953370537 conn(0x7fc2dc0a6610 msgr2=0x7fc2dc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.712+0000 7fc2e3d40700 1 -- 172.21.15.154:0/1953370537 shutdown_connections 2023-09-30T22:23:36.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.712+0000 7fc2e3d40700 1 -- 172.21.15.154:0/1953370537 wait complete. 2023-09-30T22:23:36.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.715+0000 7f5446fda700 1 -- 172.21.15.154:0/1176672987 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5440071890 con 0x7f54401300a0 2023-09-30T22:23:36.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.715+0000 7f543d7fa700 1 -- 172.21.15.154:0/1176672987 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5434021070 con 0x7f54401300a0 2023-09-30T22:23:36.715 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.717+0000 7f5446fda700 1 -- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 msgr2=0x7f544011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.717+0000 7f5446fda700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f544011da40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f543400ebe0 tx=0x7f543400eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.718+0000 7f5446fda700 1 -- 172.21.15.154:0/1176672987 shutdown_connections 2023-09-30T22:23:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.718+0000 7f5446fda700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133ad0 0x7f544011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.718+0000 7f5446fda700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401300a0 0x7f544011da40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.718+0000 7f5446fda700 1 --2- 172.21.15.154:0/1176672987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54401309f0 0x7f544011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.718+0000 7f5446fda700 1 -- 172.21.15.154:0/1176672987 >> 172.21.15.154:0/1176672987 conn(0x7f5440099c40 msgr2=0x7f54401321d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.718+0000 7f5446fda700 1 -- 172.21.15.154:0/1176672987 shutdown_connections 2023-09-30T22:23:36.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:36.718+0000 7f5446fda700 1 -- 172.21.15.154:0/1176672987 wait complete. 2023-09-30T22:23:36.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:36.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:37.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.178+0000 7fd531d58700 1 Processor -- start 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.178+0000 7fd531d58700 1 -- start start 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.178+0000 7fd531d58700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd52c06a770 0x7fd52c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.178+0000 7fd531d58700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c06b080 0x7fd52c1317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.178+0000 7fd531d58700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52c09da80 con 0x7fd52c131cf0 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.178+0000 7fd531d58700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52c09dce0 con 0x7fd52c06a770 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.178+0000 7fd531d58700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c09eb20 con 0x7fd52c06b080 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.178+0000 7fd52b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd52c06a770 0x7fd52c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.178+0000 7fd52affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c06b080 0x7fd52c1317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd52c06a770 0x7fd52c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47924/0 (socket says 172.21.15.154:47924) 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c06b080 0x7fd52c1317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59316/0 (socket says 172.21.15.154:59316) 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52b7fe700 1 -- 172.21.15.154:0/2315867230 learned_addr learned my addr 172.21.15.154:0/2315867230 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52b7fe700 1 -- 172.21.15.154:0/2315867230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c06b080 msgr2=0x7fd52c1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52b7fe700 1 --2- 172.21.15.154:0/2315867230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c06b080 0x7fd52c1317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52b7fe700 1 -- 172.21.15.154:0/2315867230 >> v1:172.21.15.154:6789/0 conn(0x7fd52c131cf0 legacy=0x7fd52c138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52b7fe700 1 -- 172.21.15.154:0/2315867230 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c09d860 con 0x7fd52c06a770 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52affd700 1 --2- 172.21.15.154:0/2315867230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c06b080 0x7fd52c1317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52b7fe700 1 --2- 172.21.15.154:0/2315867230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 0x7fd52c06ab40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0098f0 tx=0x7fd51c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4662df6e70eb703d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52a7fc700 1 -- 172.21.15.154:0/2315867230 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011830 con 0x7fd52c06a770 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52a7fc700 1 -- 172.21.15.154:0/2315867230 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c011990 con 0x7fd52c06a770 2023-09-30T22:23:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.179+0000 7fd52a7fc700 1 -- 172.21.15.154:0/2315867230 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c011d20 con 0x7fd52c06a770 2023-09-30T22:23:37.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.180+0000 7fd531d58700 1 -- 172.21.15.154:0/2315867230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 msgr2=0x7fd52c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.180+0000 7fd531d58700 1 --2- 172.21.15.154:0/2315867230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 0x7fd52c06ab40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0098f0 tx=0x7fd51c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:37.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.180+0000 7fd531d58700 1 -- 172.21.15.154:0/2315867230 shutdown_connections 2023-09-30T22:23:37.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.180+0000 7fd531d58700 1 --2- 172.21.15.154:0/2315867230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 0x7fd52c06ab40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.180+0000 7fd531d58700 1 --2- 172.21.15.154:0/2315867230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c06b080 0x7fd52c1317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.180+0000 7fd531d58700 1 -- 172.21.15.154:0/2315867230 >> 172.21.15.154:0/2315867230 conn(0x7fd52c099c40 msgr2=0x7fd52c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.180+0000 7fd531d58700 1 -- 172.21.15.154:0/2315867230 shutdown_connections 2023-09-30T22:23:37.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.180+0000 7fd531d58700 1 -- 172.21.15.154:0/2315867230 wait complete. 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd531d58700 1 Processor -- start 2023-09-30T22:23:37.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd531d58700 1 -- start start 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd531d58700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 0x7fd52c11e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd531d58700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd52c06b080 0x7fd52c11e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd531d58700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c131cf0 0x7fd52c11ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd531d58700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c121c70 con 0x7fd52c06a770 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd531d58700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c11f610 con 0x7fd52c131cf0 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd531d58700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c11fe00 con 0x7fd52c06b080 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd52b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 0x7fd52c11e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd52b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 0x7fd52c11e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47936/0 (socket says 172.21.15.154:47936) 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd52b7fe700 1 -- 172.21.15.154:0/4094380760 learned_addr learned my addr 172.21.15.154:0/4094380760 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd52affd700 1 --2- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd52c06b080 0x7fd52c11e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd52bfff700 1 --2- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c131cf0 0x7fd52c11ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.181+0000 7fd52b7fe700 1 -- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd52c06b080 msgr2=0x7fd52c11e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd52b7fe700 1 --2- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd52c06b080 0x7fd52c11e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd52b7fe700 1 -- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c131cf0 msgr2=0x7fd52c11ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd52b7fe700 1 --2- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c131cf0 0x7fd52c11ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd52b7fe700 1 -- 172.21.15.154:0/4094380760 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200094a0 con 0x7fd52c06a770 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd52b7fe700 1 --2- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 0x7fd52c11e1d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd52c09dc10 tx=0x7fd51c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd513fff700 1 -- 172.21.15.154:0/4094380760 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c004550 con 0x7fd52c06a770 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd513fff700 1 -- 172.21.15.154:0/4094380760 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0036a0 con 0x7fd52c06a770 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd531d58700 1 -- 172.21.15.154:0/4094380760 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c009550 con 0x7fd52c06a770 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd513fff700 1 -- 172.21.15.154:0/4094380760 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c003a30 con 0x7fd52c06a770 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.182+0000 7fd531d58700 1 -- 172.21.15.154:0/4094380760 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c120270 con 0x7fd52c06a770 2023-09-30T22:23:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.183+0000 7fd513fff700 1 -- 172.21.15.154:0/4094380760 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd51c021070 con 0x7fd52c06a770 2023-09-30T22:23:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.183+0000 7fd513fff700 1 -- 172.21.15.154:0/4094380760 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd51c040a80 con 0x7fd52c06a770 2023-09-30T22:23:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.183+0000 7fd531d58700 1 -- 172.21.15.154:0/4094380760 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c04f2a0 con 0x7fd52c06a770 2023-09-30T22:23:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.188+0000 7fd513fff700 1 -- 172.21.15.154:0/4094380760 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd51c029020 con 0x7fd52c06a770 2023-09-30T22:23:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.370+0000 7fd531d58700 1 -- 172.21.15.154:0/4094380760 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd52c131ad0 con 0x7fd52c06a770 2023-09-30T22:23:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.370+0000 7fd513fff700 1 -- 172.21.15.154:0/4094380760 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd51c015070 con 0x7fd52c06a770 2023-09-30T22:23:37.371 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.372+0000 7fd531d58700 1 -- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 msgr2=0x7fd52c11e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.372+0000 7fd531d58700 1 --2- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 0x7fd52c11e1d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd52c09dc10 tx=0x7fd51c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.372+0000 7fd531d58700 1 -- 172.21.15.154:0/4094380760 shutdown_connections 2023-09-30T22:23:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.372+0000 7fd531d58700 1 --2- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd52c131cf0 0x7fd52c11ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.372+0000 7fd531d58700 1 --2- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd52c06a770 0x7fd52c11e1d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.372+0000 7fd531d58700 1 --2- 172.21.15.154:0/4094380760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd52c06b080 0x7fd52c11e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.372+0000 7fd531d58700 1 -- 172.21.15.154:0/4094380760 >> 172.21.15.154:0/4094380760 conn(0x7fd52c099c40 msgr2=0x7fd52c1308a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.372+0000 7fd531d58700 1 -- 172.21.15.154:0/4094380760 shutdown_connections 2023-09-30T22:23:37.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.372+0000 7fd531d58700 1 -- 172.21.15.154:0/4094380760 wait complete. 2023-09-30T22:23:37.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:37.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:37.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:37.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:37.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.790+0000 7fe5f1e6b700 1 Processor -- start 2023-09-30T22:23:37.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.790+0000 7fe5f1e6b700 1 -- start start 2023-09-30T22:23:37.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5f1e6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5f1e6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09c790 0x7fe5ec139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5f1e6b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec0a1640 con 0x7fe5ec09bc70 2023-09-30T22:23:37.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5f1e6b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec06eb30 con 0x7fe5ec09c790 2023-09-30T22:23:37.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5f1e6b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0a22d0 con 0x7fe5ec131980 2023-09-30T22:23:37.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5eaffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe5ec09bc70 0x7fe5ec09c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37342/0 (socket says 172.21.15.154:37342) 2023-09-30T22:23:37.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5eaffd700 1 -- 172.21.15.154:0/1408200309 learned_addr learned my addr 172.21.15.154:0/1408200309 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:37.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5eb7fe700 1 --2- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5ebfff700 1 --2- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09c790 0x7fe5ec139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5ea7fc700 1 -- 172.21.15.154:0/1408200309 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227402239 0 0) 0x7fe5ec0a1640 con 0x7fe5ec09bc70 2023-09-30T22:23:37.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5ea7fc700 1 -- 172.21.15.154:0/1408200309 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d40035b0 con 0x7fe5ec09bc70 2023-09-30T22:23:37.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5eb7fe700 1 -- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09c790 msgr2=0x7fe5ec139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5eb7fe700 1 --2- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09c790 0x7fe5ec139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5eb7fe700 1 -- 172.21.15.154:0/1408200309 >> v1:172.21.15.154:6789/0 conn(0x7fe5ec09bc70 legacy=0x7fe5ec09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5eb7fe700 1 -- 172.21.15.154:0/1408200309 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec131550 con 0x7fe5ec131980 2023-09-30T22:23:37.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.791+0000 7fe5ebfff700 1 --2- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09c790 0x7fe5ec139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:37.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.792+0000 7fe5eb7fe700 1 --2- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec131d50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009850 tx=0x7fe5dc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fad9c9bdf557804 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.792+0000 7fe5ea7fc700 1 -- 172.21.15.154:0/1408200309 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc005e30 con 0x7fe5ec131980 2023-09-30T22:23:37.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.792+0000 7fe5ea7fc700 1 -- 172.21.15.154:0/1408200309 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc006030 con 0x7fe5ec131980 2023-09-30T22:23:37.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.792+0000 7fe5ea7fc700 1 -- 172.21.15.154:0/1408200309 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc0063e0 con 0x7fe5ec131980 2023-09-30T22:23:37.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.793+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 msgr2=0x7fe5ec131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.793+0000 7fe5f1e6b700 1 --2- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec131d50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009850 tx=0x7fe5dc009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:37.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.793+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/1408200309 shutdown_connections 2023-09-30T22:23:37.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.793+0000 7fe5f1e6b700 1 --2- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09c790 0x7fe5ec139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.793+0000 7fe5f1e6b700 1 --2- 172.21.15.154:0/1408200309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec131d50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.793+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/1408200309 >> 172.21.15.154:0/1408200309 conn(0x7fe5ec0a2980 msgr2=0x7fe5ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.793+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/1408200309 shutdown_connections 2023-09-30T22:23:37.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.793+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/1408200309 wait complete. 2023-09-30T22:23:37.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5f1e6b700 1 Processor -- start 2023-09-30T22:23:37.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5f1e6b700 1 -- start start 2023-09-30T22:23:37.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5f1e6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09bc70 0x7fe5ec09d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5f1e6b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5ec09c790 0x7fe5ec09df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5f1e6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec09e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5f1e6b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0a1cb0 con 0x7fe5ec09c790 2023-09-30T22:23:37.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5f1e6b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec09f680 con 0x7fe5ec09bc70 2023-09-30T22:23:37.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5f1e6b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec119370 con 0x7fe5ec131980 2023-09-30T22:23:37.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5eb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09bc70 0x7fe5ec09d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5eaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5ec09c790 0x7fe5ec09df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5eaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5ec09c790 0x7fe5ec09df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47938/0 (socket says 172.21.15.154:47938) 2023-09-30T22:23:37.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5eb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09bc70 0x7fe5ec09d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59338/0 (socket says 172.21.15.154:59338) 2023-09-30T22:23:37.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5eaffd700 1 -- 172.21.15.154:0/803633824 learned_addr learned my addr 172.21.15.154:0/803633824 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:37.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.794+0000 7fe5ebfff700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec09e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5eaffd700 1 -- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 msgr2=0x7fe5ec09e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5eaffd700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec09e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5eaffd700 1 -- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09bc70 msgr2=0x7fe5ec09d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5eaffd700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09bc70 0x7fe5ec09d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5eaffd700 1 -- 172.21.15.154:0/803633824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4009a70 con 0x7fe5ec09c790 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5eb7fe700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09bc70 0x7fe5ec09d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5ebfff700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec09e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5eaffd700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5ec09c790 0x7fe5ec09df10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0005910 tx=0x7fe5e0001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5d3fff700 1 -- 172.21.15.154:0/803633824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0013070 con 0x7fe5ec09c790 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5d3fff700 1 -- 172.21.15.154:0/803633824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e000e2e0 con 0x7fe5ec09c790 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5d3fff700 1 -- 172.21.15.154:0/803633824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0005b60 con 0x7fe5ec09c790 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/803633824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc009430 con 0x7fe5ec09c790 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.795+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/803633824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec119820 con 0x7fe5ec09c790 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.796+0000 7fe5d3fff700 1 -- 172.21.15.154:0/803633824 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5e0005cc0 con 0x7fe5ec09c790 2023-09-30T22:23:37.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.796+0000 7fe5d3fff700 1 -- 172.21.15.154:0/803633824 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe5e0042cd0 con 0x7fe5ec09c790 2023-09-30T22:23:37.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.797+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/803633824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec118f40 con 0x7fe5ec09c790 2023-09-30T22:23:37.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.802+0000 7fe5d3fff700 1 -- 172.21.15.154:0/803633824 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5e0016dd0 con 0x7fe5ec09c790 2023-09-30T22:23:37.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f6301d700 1 Processor -- start 2023-09-30T22:23:37.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f6301d700 1 -- start start 2023-09-30T22:23:37.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f6301d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2f5c12cef0 0x7f2f5c12d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f6301d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c134020 0x7f2f5c13b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f6301d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c09ac40 con 0x7f2f5c133540 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f6301d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5c09a740 con 0x7f2f5c12cef0 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f6301d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c09f3a0 con 0x7f2f5c134020 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f60db9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2f5c12cef0 0x7f2f5c12d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f60db9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2f5c12cef0 0x7f2f5c12d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47946/0 (socket says 172.21.15.154:47946) 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f60db9700 1 -- 172.21.15.154:0/1236844359 learned_addr learned my addr 172.21.15.154:0/1236844359 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.855+0000 7f2f615ba700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c134020 0x7f2f5c13b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.856+0000 7f2f60db9700 1 -- 172.21.15.154:0/1236844359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c134020 msgr2=0x7f2f5c13b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.856+0000 7f2f60db9700 1 --2- 172.21.15.154:0/1236844359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c134020 0x7f2f5c13b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.856+0000 7f2f60db9700 1 -- 172.21.15.154:0/1236844359 >> v1:172.21.15.154:6789/0 conn(0x7f2f5c133540 legacy=0x7f2f5c133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.856+0000 7f2f60db9700 1 -- 172.21.15.154:0/1236844359 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c09b010 con 0x7f2f5c12cef0 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.856+0000 7f2f615ba700 1 --2- 172.21.15.154:0/1236844359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c134020 0x7f2f5c13b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.856+0000 7f2f60db9700 1 --2- 172.21.15.154:0/1236844359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c12cef0 0x7f2f5c12d2c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2f500098f0 tx=0x7f2f50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec358575aac778e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.856+0000 7f2f5b7fe700 1 -- 172.21.15.154:0/1236844359 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50011830 con 0x7f2f5c12cef0 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.856+0000 7f2f5b7fe700 1 -- 172.21.15.154:0/1236844359 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f50011990 con 0x7f2f5c12cef0 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.856+0000 7f2f5b7fe700 1 -- 172.21.15.154:0/1236844359 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f50011d20 con 0x7f2f5c12cef0 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.857+0000 7f2f6301d700 1 -- 172.21.15.154:0/1236844359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c12cef0 msgr2=0x7f2f5c12d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.857+0000 7f2f6301d700 1 --2- 172.21.15.154:0/1236844359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c12cef0 0x7f2f5c12d2c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2f500098f0 tx=0x7f2f50009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.857+0000 7f2f6301d700 1 -- 172.21.15.154:0/1236844359 shutdown_connections 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.857+0000 7f2f6301d700 1 --2- 172.21.15.154:0/1236844359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c134020 0x7f2f5c13b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.857+0000 7f2f6301d700 1 --2- 172.21.15.154:0/1236844359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c12cef0 0x7f2f5c12d2c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.857+0000 7f2f6301d700 1 -- 172.21.15.154:0/1236844359 >> 172.21.15.154:0/1236844359 conn(0x7f2f5c099c40 msgr2=0x7f2f5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.857+0000 7f2f6301d700 1 -- 172.21.15.154:0/1236844359 shutdown_connections 2023-09-30T22:23:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.857+0000 7f2f6301d700 1 -- 172.21.15.154:0/1236844359 wait complete. 2023-09-30T22:23:37.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f6301d700 1 Processor -- start 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f6301d700 1 -- start start 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f6301d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f5c12cef0 0x7f2f5c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f6301d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c133540 0x7f2f5c070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f6301d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c134020 0x7f2f5c0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f6301d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0721e0 con 0x7f2f5c134020 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f6301d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c072750 con 0x7f2f5c133540 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f6301d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c11f180 con 0x7f2f5c12cef0 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f615ba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c134020 0x7f2f5c0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f615ba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c134020 0x7f2f5c0711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47960/0 (socket says 172.21.15.154:47960) 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f615ba700 1 -- 172.21.15.154:0/258746833 learned_addr learned my addr 172.21.15.154:0/258746833 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f60db9700 1 --2- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f5c12cef0 0x7f2f5c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.858+0000 7f2f5bfff700 1 --2- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c133540 0x7f2f5c070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f615ba700 1 -- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f5c12cef0 msgr2=0x7f2f5c070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f615ba700 1 --2- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f5c12cef0 0x7f2f5c070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f615ba700 1 -- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c133540 msgr2=0x7f2f5c070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f615ba700 1 --2- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c133540 0x7f2f5c070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f615ba700 1 -- 172.21.15.154:0/258746833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009a70 con 0x7f2f5c134020 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f615ba700 1 --2- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c134020 0x7f2f5c0711f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400efc0 tx=0x7f2f5400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f597fa700 1 -- 172.21.15.154:0/258746833 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400ca90 con 0x7f2f5c134020 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f597fa700 1 -- 172.21.15.154:0/258746833 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400f040 con 0x7f2f5c134020 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f6301d700 1 -- 172.21.15.154:0/258746833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f50009550 con 0x7f2f5c134020 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f597fa700 1 -- 172.21.15.154:0/258746833 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400ce10 con 0x7f2f5c134020 2023-09-30T22:23:37.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.859+0000 7f2f6301d700 1 -- 172.21.15.154:0/258746833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c133030 con 0x7f2f5c134020 2023-09-30T22:23:37.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.860+0000 7f2f597fa700 1 -- 172.21.15.154:0/258746833 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f54014480 con 0x7f2f5c134020 2023-09-30T22:23:37.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.860+0000 7f2f597fa700 1 -- 172.21.15.154:0/258746833 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f5403fd00 con 0x7f2f5c134020 2023-09-30T22:23:37.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.861+0000 7f2f6301d700 1 -- 172.21.15.154:0/258746833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c04f2a0 con 0x7f2f5c134020 2023-09-30T22:23:37.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.865+0000 7f2f597fa700 1 -- 172.21.15.154:0/258746833 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f54012700 con 0x7f2f5c134020 2023-09-30T22:23:37.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.908+0000 7f8031ae7700 1 Processor -- start 2023-09-30T22:23:37.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.908+0000 7f8031ae7700 1 -- start start 2023-09-30T22:23:37.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f8031ae7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f802c0a1550 0x7f802c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f8031ae7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 0x7f802c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f8031ae7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c09e9d0 con 0x7f802c0a0a70 2023-09-30T22:23:37.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f8031ae7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c09dc00 con 0x7f802c0a1550 2023-09-30T22:23:37.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f8031ae7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f802c09dec0 con 0x7f802c139200 2023-09-30T22:23:37.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f802affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f802c0a1550 0x7f802c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f802b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f802c0a0a70 0x7f802c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37362/0 (socket says 172.21.15.154:37362) 2023-09-30T22:23:37.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f802b7fe700 1 -- 172.21.15.154:0/1402995856 learned_addr learned my addr 172.21.15.154:0/1402995856 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:37.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f802bfff700 1 --2- 172.21.15.154:0/1402995856 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 0x7f802c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f802affd700 1 -- 172.21.15.154:0/1402995856 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 msgr2=0x7f802c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:37.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f802affd700 1 --2- 172.21.15.154:0/1402995856 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 0x7f802c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f802affd700 1 -- 172.21.15.154:0/1402995856 >> v1:172.21.15.154:6789/0 conn(0x7f802c0a0a70 legacy=0x7f802c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.909+0000 7f802affd700 1 -- 172.21.15.154:0/1402995856 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c09e6a0 con 0x7f802c0a1550 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f802affd700 1 --2- 172.21.15.154:0/1402995856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 0x7f802c138cc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8014009840 tx=0x7f8014009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3767a69610d91c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f802a7fc700 1 -- 172.21.15.154:0/1402995856 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014011830 con 0x7f802c0a1550 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f802a7fc700 1 -- 172.21.15.154:0/1402995856 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8014011990 con 0x7f802c0a1550 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f802a7fc700 1 -- 172.21.15.154:0/1402995856 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014011d20 con 0x7f802c0a1550 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f8031ae7700 1 -- 172.21.15.154:0/1402995856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 msgr2=0x7f802c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f8031ae7700 1 --2- 172.21.15.154:0/1402995856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 0x7f802c138cc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8014009840 tx=0x7f8014009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f8031ae7700 1 -- 172.21.15.154:0/1402995856 shutdown_connections 2023-09-30T22:23:37.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f8031ae7700 1 --2- 172.21.15.154:0/1402995856 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 0x7f802c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f8031ae7700 1 --2- 172.21.15.154:0/1402995856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 0x7f802c138cc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f8031ae7700 1 -- 172.21.15.154:0/1402995856 >> 172.21.15.154:0/1402995856 conn(0x7f802c0a6610 msgr2=0x7f802c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f8031ae7700 1 -- 172.21.15.154:0/1402995856 shutdown_connections 2023-09-30T22:23:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.910+0000 7f8031ae7700 1 -- 172.21.15.154:0/1402995856 wait complete. 2023-09-30T22:23:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.911+0000 7f8031ae7700 1 Processor -- start 2023-09-30T22:23:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.911+0000 7f8031ae7700 1 -- start start 2023-09-30T22:23:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f8031ae7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f802c0a0a70 0x7f802c11e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f8031ae7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 0x7f802c11edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f8031ae7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 0x7f802c11f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f8031ae7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0a52b0 con 0x7f802c0a1550 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f8031ae7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1205b0 con 0x7f802c0a0a70 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f8031ae7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0a03e0 con 0x7f802c139200 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 0x7f802c11edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 0x7f802c11edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47988/0 (socket says 172.21.15.154:47988) 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802affd700 1 -- 172.21.15.154:0/119338076 learned_addr learned my addr 172.21.15.154:0/119338076 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802b7fe700 1 --2- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f802c0a0a70 0x7f802c11e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802bfff700 1 --2- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 0x7f802c11f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802affd700 1 -- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 msgr2=0x7f802c11f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802affd700 1 --2- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 0x7f802c11f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802affd700 1 -- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f802c0a0a70 msgr2=0x7f802c11e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802affd700 1 --2- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f802c0a0a70 0x7f802c11e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.912+0000 7f802affd700 1 -- 172.21.15.154:0/119338076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140094a0 con 0x7f802c0a1550 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.913+0000 7f802affd700 1 --2- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 0x7f802c11edd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8014009fd0 tx=0x7f8014004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.913+0000 7f8023fff700 1 -- 172.21.15.154:0/119338076 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140036a0 con 0x7f802c0a1550 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.913+0000 7f8023fff700 1 -- 172.21.15.154:0/119338076 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801401f070 con 0x7f802c0a1550 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.913+0000 7f8031ae7700 1 -- 172.21.15.154:0/119338076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c1220d0 con 0x7f802c0a1550 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.913+0000 7f8023fff700 1 -- 172.21.15.154:0/119338076 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014003a60 con 0x7f802c0a1550 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.913+0000 7f8031ae7700 1 -- 172.21.15.154:0/119338076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c122b40 con 0x7f802c0a1550 2023-09-30T22:23:37.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.914+0000 7f8023fff700 1 -- 172.21.15.154:0/119338076 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8014003bc0 con 0x7f802c0a1550 2023-09-30T22:23:37.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.914+0000 7f8023fff700 1 -- 172.21.15.154:0/119338076 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8014021070 con 0x7f802c0a1550 2023-09-30T22:23:37.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.914+0000 7f8031ae7700 1 -- 172.21.15.154:0/119338076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c121f10 con 0x7f802c0a1550 2023-09-30T22:23:37.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:37.919+0000 7f8023fff700 1 -- 172.21.15.154:0/119338076 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8014015020 con 0x7f802c0a1550 2023-09-30T22:23:38.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.011+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/803633824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5ec1197c0 con 0x7fe5ec09c790 2023-09-30T22:23:38.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.011+0000 7fe5d3fff700 1 -- 172.21.15.154:0/803633824 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5e0016370 con 0x7fe5ec09c790 2023-09-30T22:23:38.011 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:38.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.013+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5ec09c790 msgr2=0x7fe5ec09df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.013+0000 7fe5f1e6b700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5ec09c790 0x7fe5ec09df10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0005910 tx=0x7fe5e0001b50 comp rx=0 tx=0).stop 2023-09-30T22:23:38.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.013+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/803633824 shutdown_connections 2023-09-30T22:23:38.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.013+0000 7fe5f1e6b700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5ec131980 0x7fe5ec09e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.013+0000 7fe5f1e6b700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec09bc70 0x7fe5ec09d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.013+0000 7fe5f1e6b700 1 --2- 172.21.15.154:0/803633824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5ec09c790 0x7fe5ec09df10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.013+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/803633824 >> 172.21.15.154:0/803633824 conn(0x7fe5ec0a2980 msgr2=0x7fe5ec12e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.013+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/803633824 shutdown_connections 2023-09-30T22:23:38.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.013+0000 7fe5f1e6b700 1 -- 172.21.15.154:0/803633824 wait complete. 2023-09-30T22:23:38.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:38.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.064+0000 7f2f6301d700 1 -- 172.21.15.154:0/258746833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f5c06c3b0 con 0x7f2f5c134020 2023-09-30T22:23:38.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.064+0000 7f2f597fa700 1 -- 172.21.15.154:0/258746833 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f54009d70 con 0x7f2f5c134020 2023-09-30T22:23:38.065 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:38.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.067+0000 7f2f6301d700 1 -- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c134020 msgr2=0x7f2f5c0711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.067+0000 7f2f6301d700 1 --2- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c134020 0x7f2f5c0711f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400efc0 tx=0x7f2f5400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.067+0000 7f2f6301d700 1 -- 172.21.15.154:0/258746833 shutdown_connections 2023-09-30T22:23:38.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.067+0000 7f2f6301d700 1 --2- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f5c134020 0x7f2f5c0711f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.067+0000 7f2f6301d700 1 --2- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f5c12cef0 0x7f2f5c070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.067+0000 7f2f6301d700 1 --2- 172.21.15.154:0/258746833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f5c133540 0x7f2f5c070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.067+0000 7f2f6301d700 1 -- 172.21.15.154:0/258746833 >> 172.21.15.154:0/258746833 conn(0x7f2f5c099c40 msgr2=0x7f2f5c09b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.067+0000 7f2f6301d700 1 -- 172.21.15.154:0/258746833 shutdown_connections 2023-09-30T22:23:38.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.067+0000 7f2f6301d700 1 -- 172.21.15.154:0/258746833 wait complete. 2023-09-30T22:23:38.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.115+0000 7f8031ae7700 1 -- 172.21.15.154:0/119338076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f802c04f2a0 con 0x7f802c0a1550 2023-09-30T22:23:38.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.115+0000 7f8023fff700 1 -- 172.21.15.154:0/119338076 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f801401a430 con 0x7f802c0a1550 2023-09-30T22:23:38.115 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:38.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.117+0000 7f8031ae7700 1 -- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 msgr2=0x7f802c11edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.117+0000 7f8031ae7700 1 --2- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 0x7f802c11edd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8014009fd0 tx=0x7f8014004750 comp rx=0 tx=0).stop 2023-09-30T22:23:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.117+0000 7f8031ae7700 1 -- 172.21.15.154:0/119338076 shutdown_connections 2023-09-30T22:23:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.117+0000 7f8031ae7700 1 --2- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f802c139200 0x7f802c11f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.117+0000 7f8031ae7700 1 --2- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f802c0a0a70 0x7f802c11e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.117+0000 7f8031ae7700 1 --2- 172.21.15.154:0/119338076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f802c0a1550 0x7f802c11edd0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.117+0000 7f8031ae7700 1 -- 172.21.15.154:0/119338076 >> 172.21.15.154:0/119338076 conn(0x7f802c0a6610 msgr2=0x7f802c136d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.118+0000 7f8031ae7700 1 -- 172.21.15.154:0/119338076 shutdown_connections 2023-09-30T22:23:38.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.118+0000 7f8031ae7700 1 -- 172.21.15.154:0/119338076 wait complete. 2023-09-30T22:23:38.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:38.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:38.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.508+0000 7f517a723700 1 Processor -- start 2023-09-30T22:23:38.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.508+0000 7f517a723700 1 -- start start 2023-09-30T22:23:38.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f517a723700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5174133ad0 0x7f5174133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f517a723700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51741300a0 0x7f51741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f517a723700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51741309f0 0x7f517413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f517a723700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517406b2d0 con 0x7f51741300a0 2023-09-30T22:23:38.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f517a723700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5174133610 con 0x7f51741309f0 2023-09-30T22:23:38.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f517a723700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f517409a500 con 0x7f5174133ad0 2023-09-30T22:23:38.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5178cc0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51741309f0 0x7f517413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f51737fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51741300a0 0x7f51741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5173fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5174133ad0 0x7f5174133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f51737fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51741300a0 0x7f51741304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48000/0 (socket says 172.21.15.154:48000) 2023-09-30T22:23:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5178cc0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51741309f0 0x7f517413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59376/0 (socket says 172.21.15.154:59376) 2023-09-30T22:23:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f51737fe700 1 -- 172.21.15.154:0/3777109284 learned_addr learned my addr 172.21.15.154:0/3777109284 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5178cc0700 1 -- 172.21.15.154:0/3777109284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5174133ad0 msgr2=0x7f5174133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5178cc0700 1 --2- 172.21.15.154:0/3777109284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5174133ad0 0x7f5174133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5178cc0700 1 -- 172.21.15.154:0/3777109284 >> v2:172.21.15.154:3300/0 conn(0x7f51741300a0 msgr2=0x7f51741304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5178cc0700 1 --2- 172.21.15.154:0/3777109284 >> v2:172.21.15.154:3300/0 conn(0x7f51741300a0 0x7f51741304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5178cc0700 1 -- 172.21.15.154:0/3777109284 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51741338b0 con 0x7f51741309f0 2023-09-30T22:23:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f51737fe700 1 --2- 172.21.15.154:0/3777109284 >> v2:172.21.15.154:3300/0 conn(0x7f51741300a0 0x7f51741304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5173fff700 1 --2- 172.21.15.154:0/3777109284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5174133ad0 0x7f5174133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5178cc0700 1 --2- 172.21.15.154:0/3777109284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51741309f0 0x7f517413a980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f516c009d90 tx=0x7f516c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4992513124036ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5172ffd700 1 -- 172.21.15.154:0/3777109284 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c00e070 con 0x7f51741309f0 2023-09-30T22:23:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5172ffd700 1 -- 172.21.15.154:0/3777109284 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c00bb20 con 0x7f51741309f0 2023-09-30T22:23:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.509+0000 7f5172ffd700 1 -- 172.21.15.154:0/3777109284 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c012430 con 0x7f51741309f0 2023-09-30T22:23:38.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.510+0000 7f517a723700 1 -- 172.21.15.154:0/3777109284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51741309f0 msgr2=0x7f517413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.510+0000 7f517a723700 1 --2- 172.21.15.154:0/3777109284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51741309f0 0x7f517413a980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f516c009d90 tx=0x7f516c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.510+0000 7f517a723700 1 -- 172.21.15.154:0/3777109284 shutdown_connections 2023-09-30T22:23:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.510+0000 7f517a723700 1 --2- 172.21.15.154:0/3777109284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51741309f0 0x7f517413a980 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.510+0000 7f517a723700 1 --2- 172.21.15.154:0/3777109284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5174133ad0 0x7f5174133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.510+0000 7f517a723700 1 --2- 172.21.15.154:0/3777109284 >> v2:172.21.15.154:3300/0 conn(0x7f51741300a0 0x7f51741304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.510+0000 7f517a723700 1 -- 172.21.15.154:0/3777109284 >> 172.21.15.154:0/3777109284 conn(0x7f5174099c40 msgr2=0x7f51740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.510+0000 7f517a723700 1 -- 172.21.15.154:0/3777109284 shutdown_connections 2023-09-30T22:23:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.510+0000 7f517a723700 1 -- 172.21.15.154:0/3777109284 wait complete. 2023-09-30T22:23:38.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.511+0000 7f517a723700 1 Processor -- start 2023-09-30T22:23:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.511+0000 7f517a723700 1 -- start start 2023-09-30T22:23:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.511+0000 7f517a723700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51741300a0 0x7f51740712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.511+0000 7f517a723700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51741309f0 0x7f5174071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.511+0000 7f517a723700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5174133ad0 0x7f5174071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.511+0000 7f517a723700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517411dfe0 con 0x7f51741309f0 2023-09-30T22:23:38.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.511+0000 7f517a723700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5174072730 con 0x7f5174133ad0 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.511+0000 7f517a723700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f517411ee70 con 0x7f51741300a0 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5173fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51741300a0 0x7f51740712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5173fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51741300a0 0x7f51740712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52296/0 (socket says 172.21.15.154:52296) 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5178cc0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5174133ad0 0x7f5174071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5173fff700 1 -- 172.21.15.154:0/362047345 learned_addr learned my addr 172.21.15.154:0/362047345 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f51737fe700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51741309f0 0x7f5174071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5178cc0700 1 -- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51741300a0 msgr2=0x7f51740712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5178cc0700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51741300a0 0x7f51740712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5178cc0700 1 -- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51741309f0 msgr2=0x7f5174071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5178cc0700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51741309f0 0x7f5174071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5178cc0700 1 -- 172.21.15.154:0/362047345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5164009550 con 0x7f5174133ad0 2023-09-30T22:23:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5173fff700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51741300a0 0x7f51740712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f51737fe700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51741309f0 0x7f5174071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5178cc0700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5174133ad0 0x7f5174071d50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f516c016000 tx=0x7f516c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5170ff9700 1 -- 172.21.15.154:0/362047345 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c012430 con 0x7f5174133ad0 2023-09-30T22:23:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5170ff9700 1 -- 172.21.15.154:0/362047345 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c020070 con 0x7f5174133ad0 2023-09-30T22:23:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f517a723700 1 -- 172.21.15.154:0/362047345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51680094a0 con 0x7f5174133ad0 2023-09-30T22:23:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f5170ff9700 1 -- 172.21.15.154:0/362047345 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c004280 con 0x7f5174133ad0 2023-09-30T22:23:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.512+0000 7f517a723700 1 -- 172.21.15.154:0/362047345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c009a70 con 0x7f5174133ad0 2023-09-30T22:23:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.513+0000 7f5170ff9700 1 -- 172.21.15.154:0/362047345 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f516c0043e0 con 0x7f5174133ad0 2023-09-30T22:23:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.513+0000 7f5170ff9700 1 -- 172.21.15.154:0/362047345 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f516c022070 con 0x7f5174133ad0 2023-09-30T22:23:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.513+0000 7f517a723700 1 -- 172.21.15.154:0/362047345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517411f8b0 con 0x7f5174133ad0 2023-09-30T22:23:38.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.518+0000 7f5170ff9700 1 -- 172.21.15.154:0/362047345 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f516c004690 con 0x7f5174133ad0 2023-09-30T22:23:38.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.702+0000 7f517a723700 1 -- 172.21.15.154:0/362047345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f517411f230 con 0x7f5174133ad0 2023-09-30T22:23:38.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.702+0000 7f5170ff9700 1 -- 172.21.15.154:0/362047345 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f516c02c020 con 0x7f5174133ad0 2023-09-30T22:23:38.702 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:38.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.704+0000 7f517a723700 1 -- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5174133ad0 msgr2=0x7f5174071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:38.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.704+0000 7f517a723700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5174133ad0 0x7f5174071d50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f516c016000 tx=0x7f516c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.704+0000 7f517a723700 1 -- 172.21.15.154:0/362047345 shutdown_connections 2023-09-30T22:23:38.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.704+0000 7f517a723700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5174133ad0 0x7f5174071d50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.704+0000 7f517a723700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51741300a0 0x7f51740712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.704+0000 7f517a723700 1 --2- 172.21.15.154:0/362047345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51741309f0 0x7f5174071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:38.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.704+0000 7f517a723700 1 -- 172.21.15.154:0/362047345 >> 172.21.15.154:0/362047345 conn(0x7f5174099c40 msgr2=0x7f5174132b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:38.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.704+0000 7f517a723700 1 -- 172.21.15.154:0/362047345 shutdown_connections 2023-09-30T22:23:38.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:38.704+0000 7f517a723700 1 -- 172.21.15.154:0/362047345 wait complete. 2023-09-30T22:23:38.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:39.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:39.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:39.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:39.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.159+0000 7f8126cd3700 1 Processor -- start 2023-09-30T22:23:39.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.159+0000 7f8126cd3700 1 -- start start 2023-09-30T22:23:39.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.159+0000 7f8126cd3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81200a0a30 0x7f81200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.159+0000 7f8126cd3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a1340 0x7f812012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.159+0000 7f8126cd3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81201304a0 0x7f81201308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.159+0000 7f8126cd3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8120130e30 con 0x7f81200a0a30 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.159+0000 7f8126cd3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200a1e70 con 0x7f81201304a0 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.159+0000 7f8126cd3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f812009a720 con 0x7f81200a1340 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f8124a6f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81200a0a30 0x7f81200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a1340 0x7f812012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f8124a6f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81200a0a30 0x7f81200a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48008/0 (socket says 172.21.15.154:48008) 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a1340 0x7f812012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52306/0 (socket says 172.21.15.154:52306) 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f8124a6f700 1 -- 172.21.15.154:0/2660351322 learned_addr learned my addr 172.21.15.154:0/2660351322 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f8125270700 1 --2- 172.21.15.154:0/2660351322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81201304a0 0x7f81201308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811ffff700 1 -- 172.21.15.154:0/2660351322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81201304a0 msgr2=0x7f81201308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811ffff700 1 --2- 172.21.15.154:0/2660351322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81201304a0 0x7f81201308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811ffff700 1 -- 172.21.15.154:0/2660351322 >> v2:172.21.15.154:3300/0 conn(0x7f81200a0a30 msgr2=0x7f81200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:39.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811ffff700 1 --2- 172.21.15.154:0/2660351322 >> v2:172.21.15.154:3300/0 conn(0x7f81200a0a30 0x7f81200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811ffff700 1 -- 172.21.15.154:0/2660351322 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812009b300 con 0x7f81200a1340 2023-09-30T22:23:39.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f8124a6f700 1 --2- 172.21.15.154:0/2660351322 >> v2:172.21.15.154:3300/0 conn(0x7f81200a0a30 0x7f81200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f8125270700 1 --2- 172.21.15.154:0/2660351322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81201304a0 0x7f81201308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811ffff700 1 --2- 172.21.15.154:0/2660351322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a1340 0x7f812012ff60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f810c009870 tx=0x7f810c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9041fc78774703d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811f7fe700 1 -- 172.21.15.154:0/2660351322 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c011830 con 0x7f81200a1340 2023-09-30T22:23:39.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811f7fe700 1 -- 172.21.15.154:0/2660351322 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c011990 con 0x7f81200a1340 2023-09-30T22:23:39.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.160+0000 7f811f7fe700 1 -- 172.21.15.154:0/2660351322 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c011d20 con 0x7f81200a1340 2023-09-30T22:23:39.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.161+0000 7f8126cd3700 1 -- 172.21.15.154:0/2660351322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a1340 msgr2=0x7f812012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.161+0000 7f8126cd3700 1 --2- 172.21.15.154:0/2660351322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a1340 0x7f812012ff60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f810c009870 tx=0x7f810c009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.161+0000 7f8126cd3700 1 -- 172.21.15.154:0/2660351322 shutdown_connections 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.161+0000 7f8126cd3700 1 --2- 172.21.15.154:0/2660351322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81201304a0 0x7f81201308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.161+0000 7f8126cd3700 1 --2- 172.21.15.154:0/2660351322 >> v2:172.21.15.154:3300/0 conn(0x7f81200a0a30 0x7f81200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.161+0000 7f8126cd3700 1 --2- 172.21.15.154:0/2660351322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a1340 0x7f812012ff60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.161+0000 7f8126cd3700 1 -- 172.21.15.154:0/2660351322 >> 172.21.15.154:0/2660351322 conn(0x7f81200a2980 msgr2=0x7f81200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.161+0000 7f8126cd3700 1 -- 172.21.15.154:0/2660351322 shutdown_connections 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.161+0000 7f8126cd3700 1 -- 172.21.15.154:0/2660351322 wait complete. 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.162+0000 7f8126cd3700 1 Processor -- start 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.162+0000 7f8126cd3700 1 -- start start 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8126cd3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a0a30 0x7f812011ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8126cd3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81200a1340 0x7f812011b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8126cd3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81201304a0 0x7f812011b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8126cd3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812011e2d0 con 0x7f81201304a0 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8126cd3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812011c990 con 0x7f81200a1340 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8126cd3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f812009f0b0 con 0x7f81200a0a30 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8124a6f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a0a30 0x7f812011ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8124a6f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a0a30 0x7f812011ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52312/0 (socket says 172.21.15.154:52312) 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8124a6f700 1 -- 172.21.15.154:0/2696679760 learned_addr learned my addr 172.21.15.154:0/2696679760 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f811ffff700 1 --2- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81200a1340 0x7f812011b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8125270700 1 --2- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81201304a0 0x7f812011b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8124a6f700 1 -- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81200a1340 msgr2=0x7f812011b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8124a6f700 1 --2- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81200a1340 0x7f812011b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8124a6f700 1 -- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81201304a0 msgr2=0x7f812011b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8124a6f700 1 --2- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81201304a0 0x7f812011b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8124a6f700 1 -- 172.21.15.154:0/2696679760 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811400b7a0 con 0x7f81200a0a30 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f8124a6f700 1 --2- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a0a30 0x7f812011ad60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f811400de30 tx=0x7f81140103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.163+0000 7f811d7fa700 1 -- 172.21.15.154:0/2696679760 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114012040 con 0x7f81200a0a30 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.164+0000 7f811d7fa700 1 -- 172.21.15.154:0/2696679760 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114010dc0 con 0x7f81200a0a30 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.164+0000 7f8126cd3700 1 -- 172.21.15.154:0/2696679760 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8118009a70 con 0x7f81200a0a30 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.164+0000 7f811d7fa700 1 -- 172.21.15.154:0/2696679760 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114005c40 con 0x7f81200a0a30 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.164+0000 7f8126cd3700 1 -- 172.21.15.154:0/2696679760 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c0094a0 con 0x7f81200a0a30 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.164+0000 7f811d7fa700 1 -- 172.21.15.154:0/2696679760 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8114004020 con 0x7f81200a0a30 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.164+0000 7f811d7fa700 1 -- 172.21.15.154:0/2696679760 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8114041ae0 con 0x7f81200a0a30 2023-09-30T22:23:39.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.165+0000 7f8126cd3700 1 -- 172.21.15.154:0/2696679760 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812009ae00 con 0x7f81200a0a30 2023-09-30T22:23:39.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.173+0000 7f811d7fa700 1 -- 172.21.15.154:0/2696679760 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8114017370 con 0x7f81200a0a30 2023-09-30T22:23:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.214+0000 7f2664222700 1 Processor -- start 2023-09-30T22:23:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.214+0000 7f2664222700 1 -- start start 2023-09-30T22:23:39.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f2664222700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f2664222700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f265c139200 0x7f265c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f2664222700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265c09e9d0 con 0x7f265c0a0a70 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f2664222700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c09dc00 con 0x7f265c139200 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f2664222700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f265c09dec0 con 0x7f265c0a1550 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f26617bd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f26627bf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f265c139200 0x7f265c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f2661fbe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f265c0a0a70 0x7f265c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37368/0 (socket says 172.21.15.154:37368) 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f2661fbe700 1 -- 172.21.15.154:0/2582676672 learned_addr learned my addr 172.21.15.154:0/2582676672 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f26627bf700 1 -- 172.21.15.154:0/2582676672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 msgr2=0x7f265c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f26627bf700 1 --2- 172.21.15.154:0/2582676672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f26627bf700 1 -- 172.21.15.154:0/2582676672 >> v1:172.21.15.154:6789/0 conn(0x7f265c0a0a70 legacy=0x7f265c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f26627bf700 1 -- 172.21.15.154:0/2582676672 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c09e6a0 con 0x7f265c139200 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f26617bd700 1 --2- 172.21.15.154:0/2582676672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f2660fbc700 1 -- 172.21.15.154:0/2582676672 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774841186 0 0) 0x7f265c09e9d0 con 0x7f265c0a0a70 2023-09-30T22:23:39.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f26627bf700 1 --2- 172.21.15.154:0/2582676672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c139200 0x7f265c13b5e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2654009d90 tx=0x7f265400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9975f581b8ea4a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.215+0000 7f2660fbc700 1 -- 172.21.15.154:0/2582676672 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400e070 con 0x7f265c139200 2023-09-30T22:23:39.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2660fbc700 1 -- 172.21.15.154:0/2582676672 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265400bb20 con 0x7f265c139200 2023-09-30T22:23:39.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2660fbc700 1 -- 172.21.15.154:0/2582676672 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654012430 con 0x7f265c139200 2023-09-30T22:23:39.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2664222700 1 -- 172.21.15.154:0/2582676672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c139200 msgr2=0x7f265c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2664222700 1 --2- 172.21.15.154:0/2582676672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c139200 0x7f265c13b5e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2654009d90 tx=0x7f265400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2664222700 1 -- 172.21.15.154:0/2582676672 shutdown_connections 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2664222700 1 --2- 172.21.15.154:0/2582676672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c139200 0x7f265c13b5e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2664222700 1 --2- 172.21.15.154:0/2582676672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2664222700 1 -- 172.21.15.154:0/2582676672 >> 172.21.15.154:0/2582676672 conn(0x7f265c0a6610 msgr2=0x7f265c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2664222700 1 -- 172.21.15.154:0/2582676672 shutdown_connections 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.216+0000 7f2664222700 1 -- 172.21.15.154:0/2582676672 wait complete. 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.217+0000 7f2664222700 1 Processor -- start 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.217+0000 7f2664222700 1 -- start start 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2664222700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c0a0a70 0x7f265c121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2664222700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2664222700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c139200 0x7f265c1221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2664222700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c125280 con 0x7f265c0a0a70 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2664222700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c123990 con 0x7f265c139200 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2664222700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0a03e0 con 0x7f265c0a1550 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f26617bd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f26617bd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c121ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52336/0 (socket says 172.21.15.154:52336) 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f26617bd700 1 -- 172.21.15.154:0/726975222 learned_addr learned my addr 172.21.15.154:0/726975222 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2661fbe700 1 --2- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c0a0a70 0x7f265c121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2661fbe700 1 -- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 msgr2=0x7f265c121ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2661fbe700 1 --2- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c121ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2661fbe700 1 -- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c139200 msgr2=0x7f265c1221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2661fbe700 1 --2- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c139200 0x7f265c1221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2661fbe700 1 -- 172.21.15.154:0/726975222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0094a0 con 0x7f265c0a0a70 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f26617bd700 1 --2- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f2661fbe700 1 --2- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c0a0a70 0x7f265c121760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f265800c4a0 tx=0x7f265800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.218+0000 7f26527fc700 1 -- 172.21.15.154:0/726975222 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658004c80 con 0x7f265c0a0a70 2023-09-30T22:23:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.219+0000 7f26527fc700 1 -- 172.21.15.154:0/726975222 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2658004de0 con 0x7f265c0a0a70 2023-09-30T22:23:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.219+0000 7f2664222700 1 -- 172.21.15.154:0/726975222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2654009a70 con 0x7f265c0a0a70 2023-09-30T22:23:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.219+0000 7f26527fc700 1 -- 172.21.15.154:0/726975222 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658007310 con 0x7f265c0a0a70 2023-09-30T22:23:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.219+0000 7f2664222700 1 -- 172.21.15.154:0/726975222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c124ce0 con 0x7f265c0a0a70 2023-09-30T22:23:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.220+0000 7f26527fc700 1 -- 172.21.15.154:0/726975222 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2658007470 con 0x7f265c0a0a70 2023-09-30T22:23:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.220+0000 7f26527fc700 1 -- 172.21.15.154:0/726975222 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2658013c10 con 0x7f265c0a0a70 2023-09-30T22:23:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.220+0000 7f2664222700 1 -- 172.21.15.154:0/726975222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c04f2a0 con 0x7f265c0a0a70 2023-09-30T22:23:39.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.228+0000 7f26527fc700 1 -- 172.21.15.154:0/726975222 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2658044060 con 0x7f265c0a0a70 2023-09-30T22:23:39.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.265+0000 7fba695fd700 1 Processor -- start 2023-09-30T22:23:39.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.265+0000 7fba695fd700 1 -- start start 2023-09-30T22:23:39.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.265+0000 7fba695fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 0x7fba6409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.265+0000 7fba695fd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba6409edb0 0x7fba6409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.265+0000 7fba695fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba64133c20 0x7fba641340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.265+0000 7fba695fd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6409a520 con 0x7fba6409edb0 2023-09-30T22:23:39.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.265+0000 7fba695fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6409fe00 con 0x7fba6409a150 2023-09-30T22:23:39.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.265+0000 7fba695fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba6406bec0 con 0x7fba64133c20 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba62ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 0x7fba6409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba637fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba64133c20 0x7fba641340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba62ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 0x7fba6409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59420/0 (socket says 172.21.15.154:59420) 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba62ffd700 1 -- 172.21.15.154:0/2855954245 learned_addr learned my addr 172.21.15.154:0/2855954245 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba627fc700 1 --2- 172.21.15.154:0/2855954245 >> v2:172.21.15.154:3300/0 conn(0x7fba6409edb0 0x7fba6409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba637fe700 1 -- 172.21.15.154:0/2855954245 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 msgr2=0x7fba6409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba637fe700 1 --2- 172.21.15.154:0/2855954245 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 0x7fba6409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba637fe700 1 -- 172.21.15.154:0/2855954245 >> v2:172.21.15.154:3300/0 conn(0x7fba6409edb0 msgr2=0x7fba6409f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba637fe700 1 --2- 172.21.15.154:0/2855954245 >> v2:172.21.15.154:3300/0 conn(0x7fba6409edb0 0x7fba6409f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba637fe700 1 -- 172.21.15.154:0/2855954245 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6409af80 con 0x7fba64133c20 2023-09-30T22:23:39.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba627fc700 1 --2- 172.21.15.154:0/2855954245 >> v2:172.21.15.154:3300/0 conn(0x7fba6409edb0 0x7fba6409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba637fe700 1 --2- 172.21.15.154:0/2855954245 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba64133c20 0x7fba641340a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009dc0 tx=0x7fba5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c325af0931798c43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba61ffb700 1 -- 172.21.15.154:0/2855954245 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00e070 con 0x7fba64133c20 2023-09-30T22:23:39.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba61ffb700 1 -- 172.21.15.154:0/2855954245 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c00bae0 con 0x7fba64133c20 2023-09-30T22:23:39.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.266+0000 7fba61ffb700 1 -- 172.21.15.154:0/2855954245 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00be90 con 0x7fba64133c20 2023-09-30T22:23:39.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.267+0000 7fba695fd700 1 -- 172.21.15.154:0/2855954245 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba64133c20 msgr2=0x7fba641340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.267+0000 7fba695fd700 1 --2- 172.21.15.154:0/2855954245 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba64133c20 0x7fba641340a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009dc0 tx=0x7fba5c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.267+0000 7fba695fd700 1 -- 172.21.15.154:0/2855954245 shutdown_connections 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.267+0000 7fba695fd700 1 --2- 172.21.15.154:0/2855954245 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 0x7fba6409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.267+0000 7fba695fd700 1 --2- 172.21.15.154:0/2855954245 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba64133c20 0x7fba641340a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.267+0000 7fba695fd700 1 --2- 172.21.15.154:0/2855954245 >> v2:172.21.15.154:3300/0 conn(0x7fba6409edb0 0x7fba6409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.267+0000 7fba695fd700 1 -- 172.21.15.154:0/2855954245 >> 172.21.15.154:0/2855954245 conn(0x7fba640a4430 msgr2=0x7fba640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.267+0000 7fba695fd700 1 -- 172.21.15.154:0/2855954245 shutdown_connections 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.267+0000 7fba695fd700 1 -- 172.21.15.154:0/2855954245 wait complete. 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.268+0000 7fba695fd700 1 Processor -- start 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.268+0000 7fba695fd700 1 -- start start 2023-09-30T22:23:39.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.268+0000 7fba695fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 0x7fba6411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.268+0000 7fba695fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409edb0 0x7fba6411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba695fd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64133c20 0x7fba6411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba695fd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba64120cb0 con 0x7fba64133c20 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba695fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba641207e0 con 0x7fba6409a150 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba695fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba64120ec0 con 0x7fba6409edb0 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba627fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409edb0 0x7fba6411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba627fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409edb0 0x7fba6411f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52360/0 (socket says 172.21.15.154:52360) 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba627fc700 1 -- 172.21.15.154:0/334662400 learned_addr learned my addr 172.21.15.154:0/334662400 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba637fe700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64133c20 0x7fba6411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba62ffd700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 0x7fba6411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba637fe700 1 -- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409edb0 msgr2=0x7fba6411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba637fe700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409edb0 0x7fba6411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba637fe700 1 -- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 msgr2=0x7fba6411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba637fe700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 0x7fba6411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba637fe700 1 -- 172.21.15.154:0/334662400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba580094a0 con 0x7fba64133c20 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba627fc700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409edb0 0x7fba6411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba637fe700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64133c20 0x7fba6411f550 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009dc0 tx=0x7fba5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba4b7fe700 1 -- 172.21.15.154:0/334662400 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0045d0 con 0x7fba64133c20 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba4b7fe700 1 -- 172.21.15.154:0/334662400 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c020070 con 0x7fba64133c20 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba695fd700 1 -- 172.21.15.154:0/334662400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c009a70 con 0x7fba64133c20 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba4b7fe700 1 -- 172.21.15.154:0/334662400 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c027480 con 0x7fba64133c20 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.269+0000 7fba695fd700 1 -- 172.21.15.154:0/334662400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba641225e0 con 0x7fba64133c20 2023-09-30T22:23:39.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.270+0000 7fba4b7fe700 1 -- 172.21.15.154:0/334662400 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba5c012430 con 0x7fba64133c20 2023-09-30T22:23:39.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.270+0000 7fba4b7fe700 1 -- 172.21.15.154:0/334662400 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba5c022070 con 0x7fba64133c20 2023-09-30T22:23:39.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.270+0000 7fba695fd700 1 -- 172.21.15.154:0/334662400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6409fa30 con 0x7fba64133c20 2023-09-30T22:23:39.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.279+0000 7fba4b7fe700 1 -- 172.21.15.154:0/334662400 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba5c011960 con 0x7fba64133c20 2023-09-30T22:23:39.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.401+0000 7f8126cd3700 1 -- 172.21.15.154:0/2696679760 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f812004f2a0 con 0x7f81200a0a30 2023-09-30T22:23:39.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.401+0000 7f811d7fa700 1 -- 172.21.15.154:0/2696679760 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8114020ba0 con 0x7f81200a0a30 2023-09-30T22:23:39.401 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:39.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.403+0000 7f8126cd3700 1 -- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a0a30 msgr2=0x7f812011ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.403+0000 7f8126cd3700 1 --2- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a0a30 0x7f812011ad60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f811400de30 tx=0x7f81140103a0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.404+0000 7f8126cd3700 1 -- 172.21.15.154:0/2696679760 shutdown_connections 2023-09-30T22:23:39.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.404+0000 7f8126cd3700 1 --2- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81201304a0 0x7f812011b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.404+0000 7f8126cd3700 1 --2- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81200a0a30 0x7f812011ad60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.404+0000 7f8126cd3700 1 --2- 172.21.15.154:0/2696679760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81200a1340 0x7f812011b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.404+0000 7f8126cd3700 1 -- 172.21.15.154:0/2696679760 >> 172.21.15.154:0/2696679760 conn(0x7f81200a2980 msgr2=0x7f812009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:39.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.404+0000 7f8126cd3700 1 -- 172.21.15.154:0/2696679760 shutdown_connections 2023-09-30T22:23:39.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.404+0000 7f8126cd3700 1 -- 172.21.15.154:0/2696679760 wait complete. 2023-09-30T22:23:39.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:39.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.427+0000 7f2664222700 1 -- 172.21.15.154:0/726975222 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f265c072980 con 0x7f265c0a0a70 2023-09-30T22:23:39.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.427+0000 7f26527fc700 1 -- 172.21.15.154:0/726975222 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2658007720 con 0x7f265c0a0a70 2023-09-30T22:23:39.427 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:39.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.429+0000 7f2664222700 1 -- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c0a0a70 msgr2=0x7f265c121760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.429+0000 7f2664222700 1 --2- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c0a0a70 0x7f265c121760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f265800c4a0 tx=0x7f265800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.429+0000 7f2664222700 1 -- 172.21.15.154:0/726975222 shutdown_connections 2023-09-30T22:23:39.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.429+0000 7f2664222700 1 --2- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c139200 0x7f265c1221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.429+0000 7f2664222700 1 --2- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c0a0a70 0x7f265c121760 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.429+0000 7f2664222700 1 --2- 172.21.15.154:0/726975222 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f265c0a1550 0x7f265c121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.429+0000 7f2664222700 1 -- 172.21.15.154:0/726975222 >> 172.21.15.154:0/726975222 conn(0x7f265c0a6610 msgr2=0x7f265c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:39.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.429+0000 7f2664222700 1 -- 172.21.15.154:0/726975222 shutdown_connections 2023-09-30T22:23:39.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.429+0000 7f2664222700 1 -- 172.21.15.154:0/726975222 wait complete. 2023-09-30T22:23:39.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:39.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.507+0000 7fba695fd700 1 -- 172.21.15.154:0/334662400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba6409f500 con 0x7fba64133c20 2023-09-30T22:23:39.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.507+0000 7fba4b7fe700 1 -- 172.21.15.154:0/334662400 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba5c0303e0 con 0x7fba64133c20 2023-09-30T22:23:39.507 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:39.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.509+0000 7fba695fd700 1 -- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64133c20 msgr2=0x7fba6411f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.509+0000 7fba695fd700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64133c20 0x7fba6411f550 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009dc0 tx=0x7fba5c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.509+0000 7fba695fd700 1 -- 172.21.15.154:0/334662400 shutdown_connections 2023-09-30T22:23:39.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.509+0000 7fba695fd700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64133c20 0x7fba6411f550 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.509+0000 7fba695fd700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409a150 0x7fba6411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.509+0000 7fba695fd700 1 --2- 172.21.15.154:0/334662400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409edb0 0x7fba6411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.509+0000 7fba695fd700 1 -- 172.21.15.154:0/334662400 >> 172.21.15.154:0/334662400 conn(0x7fba640a4430 msgr2=0x7fba64071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:39.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.509+0000 7fba695fd700 1 -- 172.21.15.154:0/334662400 shutdown_connections 2023-09-30T22:23:39.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.509+0000 7fba695fd700 1 -- 172.21.15.154:0/334662400 wait complete. 2023-09-30T22:23:39.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:39.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:39.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.841+0000 7f2dcdba9700 1 Processor -- start 2023-09-30T22:23:39.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.841+0000 7f2dcdba9700 1 -- start start 2023-09-30T22:23:39.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dcdba9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2dc8133900 0x7f2dc8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dcdba9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc80a10b0 0x7f2dc813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dcdba9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc809a760 con 0x7f2dc8134210 2023-09-30T22:23:39.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dcdba9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc81336e0 con 0x7f2dc8133900 2023-09-30T22:23:39.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dcdba9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc809a080 con 0x7f2dc80a10b0 2023-09-30T22:23:39.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc80a10b0 0x7f2dc813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2dc8133900 0x7f2dc8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc80a10b0 0x7f2dc813b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59442/0 (socket says 172.21.15.154:59442) 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2dc8133900 0x7f2dc8133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48068/0 (socket says 172.21.15.154:48068) 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc7fff700 1 -- 172.21.15.154:0/3677212950 learned_addr learned my addr 172.21.15.154:0/3677212950 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc7fff700 1 -- 172.21.15.154:0/3677212950 >> v2:172.21.15.154:3300/0 conn(0x7f2dc8133900 msgr2=0x7f2dc8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc7fff700 1 --2- 172.21.15.154:0/3677212950 >> v2:172.21.15.154:3300/0 conn(0x7f2dc8133900 0x7f2dc8133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc7fff700 1 -- 172.21.15.154:0/3677212950 >> v1:172.21.15.154:6789/0 conn(0x7f2dc8134210 legacy=0x7f2dc80a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc7fff700 1 -- 172.21.15.154:0/3677212950 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80a23e0 con 0x7f2dc80a10b0 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc77fe700 1 --2- 172.21.15.154:0/3677212950 >> v2:172.21.15.154:3300/0 conn(0x7f2dc8133900 0x7f2dc8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc7fff700 1 --2- 172.21.15.154:0/3677212950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc80a10b0 0x7f2dc813b910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009e50 tx=0x7f2dc000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db75db2a3f3b8b63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc67fc700 1 -- 172.21.15.154:0/3677212950 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000e070 con 0x7f2dc80a10b0 2023-09-30T22:23:39.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc67fc700 1 -- 172.21.15.154:0/3677212950 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc000b910 con 0x7f2dc80a10b0 2023-09-30T22:23:39.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.842+0000 7f2dc67fc700 1 -- 172.21.15.154:0/3677212950 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000bcc0 con 0x7f2dc80a10b0 2023-09-30T22:23:39.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.843+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3677212950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc80a10b0 msgr2=0x7f2dc813b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.843+0000 7f2dcdba9700 1 --2- 172.21.15.154:0/3677212950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc80a10b0 0x7f2dc813b910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009e50 tx=0x7f2dc000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:39.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.843+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3677212950 shutdown_connections 2023-09-30T22:23:39.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.843+0000 7f2dcdba9700 1 --2- 172.21.15.154:0/3677212950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc80a10b0 0x7f2dc813b910 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.843+0000 7f2dcdba9700 1 --2- 172.21.15.154:0/3677212950 >> v2:172.21.15.154:3300/0 conn(0x7f2dc8133900 0x7f2dc8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.843+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3677212950 >> 172.21.15.154:0/3677212950 conn(0x7f2dc80a2980 msgr2=0x7f2dc80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:39.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.843+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3677212950 shutdown_connections 2023-09-30T22:23:39.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.843+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3677212950 wait complete. 2023-09-30T22:23:39.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.844+0000 7f2dcdba9700 1 Processor -- start 2023-09-30T22:23:39.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.844+0000 7f2dcdba9700 1 -- start start 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.844+0000 7f2dcdba9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dc80a10b0 0x7f2dc811d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.844+0000 7f2dcdba9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc8133900 0x7f2dc811de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.844+0000 7f2dcdba9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dc8134210 0x7f2dc811e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.844+0000 7f2dcdba9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc811f430 con 0x7f2dc8134210 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.844+0000 7f2dcdba9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc811fa50 con 0x7f2dc8133900 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.844+0000 7f2dcdba9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc8120680 con 0x7f2dc80a10b0 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.844+0000 7f2dc6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc8133900 0x7f2dc811de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dc8134210 0x7f2dc811e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dc80a10b0 0x7f2dc811d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc8133900 0x7f2dc811de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59450/0 (socket says 172.21.15.154:59450) 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc6ffd700 1 -- 172.21.15.154:0/3430997358 learned_addr learned my addr 172.21.15.154:0/3430997358 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dc8134210 0x7f2dc811e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48076/0 (socket says 172.21.15.154:48076) 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc7fff700 1 -- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dc80a10b0 msgr2=0x7f2dc811d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc7fff700 1 --2- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dc80a10b0 0x7f2dc811d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc7fff700 1 -- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc8133900 msgr2=0x7f2dc811de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc7fff700 1 --2- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc8133900 0x7f2dc811de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc7fff700 1 -- 172.21.15.154:0/3430997358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0009430 con 0x7f2dc8134210 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc6ffd700 1 --2- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc8133900 0x7f2dc811de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dc7fff700 1 --2- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dc8134210 0x7f2dc811e340 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0015000 tx=0x7f2dc0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dbffff700 1 -- 172.21.15.154:0/3430997358 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0004800 con 0x7f2dc8134210 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dbffff700 1 -- 172.21.15.154:0/3430997358 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0004960 con 0x7f2dc8134210 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3430997358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc0009b30 con 0x7f2dc8134210 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dbffff700 1 -- 172.21.15.154:0/3430997358 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc001c680 con 0x7f2dc8134210 2023-09-30T22:23:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.845+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3430997358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc8132e10 con 0x7f2dc8134210 2023-09-30T22:23:39.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.846+0000 7f2dbffff700 1 -- 172.21.15.154:0/3430997358 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dc001c7e0 con 0x7f2dc8134210 2023-09-30T22:23:39.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.846+0000 7f2dbffff700 1 -- 172.21.15.154:0/3430997358 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2dc0040e20 con 0x7f2dc8134210 2023-09-30T22:23:39.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.846+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3430997358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc811a590 con 0x7f2dc8134210 2023-09-30T22:23:39.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:39.851+0000 7f2dbffff700 1 -- 172.21.15.154:0/3430997358 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dc00123f0 con 0x7f2dc8134210 2023-09-30T22:23:40.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.034+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3430997358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2dc809a2c0 con 0x7f2dc8134210 2023-09-30T22:23:40.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.035+0000 7f2dbffff700 1 -- 172.21.15.154:0/3430997358 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2dc0034090 con 0x7f2dc8134210 2023-09-30T22:23:40.034 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:40.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.036+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dc8134210 msgr2=0x7f2dc811e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.036+0000 7f2dcdba9700 1 --2- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dc8134210 0x7f2dc811e340 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0015000 tx=0x7f2dc0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.036+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3430997358 shutdown_connections 2023-09-30T22:23:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.036+0000 7f2dcdba9700 1 --2- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dc8134210 0x7f2dc811e340 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.036+0000 7f2dcdba9700 1 --2- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dc80a10b0 0x7f2dc811d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.036+0000 7f2dcdba9700 1 --2- 172.21.15.154:0/3430997358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dc8133900 0x7f2dc811de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.036+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3430997358 >> 172.21.15.154:0/3430997358 conn(0x7f2dc80a2980 msgr2=0x7f2dc81bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.037+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3430997358 shutdown_connections 2023-09-30T22:23:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.037+0000 7f2dcdba9700 1 -- 172.21.15.154:0/3430997358 wait complete. 2023-09-30T22:23:40.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:40.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:40.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:40.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:40.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.560+0000 7f0e203b7700 1 Processor -- start 2023-09-30T22:23:40.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.560+0000 7f0e203b7700 1 -- start start 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e203b7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e1809e340 0x7f0e181359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e203b7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e18135f20 0x7f0e18138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e203b7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1809aaa0 con 0x7f0e1809d860 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e203b7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1809e730 con 0x7f0e1809e340 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e203b7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1809f870 con 0x7f0e18135f20 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1d952700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e1809e340 0x7f0e181359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1e954700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e18135f20 0x7f0e18138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1e153700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0e1809d860 0x7f0e1809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37400/0 (socket says 172.21.15.154:37400) 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1e954700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e18135f20 0x7f0e18138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52368/0 (socket says 172.21.15.154:52368) 2023-09-30T22:23:40.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1d952700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e1809e340 0x7f0e181359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59464/0 (socket says 172.21.15.154:59464) 2023-09-30T22:23:40.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1e153700 1 -- 172.21.15.154:0/1402129951 learned_addr learned my addr 172.21.15.154:0/1402129951 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:40.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1d151700 1 -- 172.21.15.154:0/1402129951 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185700652 0 0) 0x7f0e1809aaa0 con 0x7f0e1809d860 2023-09-30T22:23:40.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1e954700 1 -- 172.21.15.154:0/1402129951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e1809e340 msgr2=0x7f0e181359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1e954700 1 --2- 172.21.15.154:0/1402129951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e1809e340 0x7f0e181359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1e954700 1 -- 172.21.15.154:0/1402129951 >> v1:172.21.15.154:6789/0 conn(0x7f0e1809d860 legacy=0x7f0e1809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.561+0000 7f0e1e954700 1 -- 172.21.15.154:0/1402129951 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1809b360 con 0x7f0e18135f20 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.562+0000 7f0e1e954700 1 --2- 172.21.15.154:0/1402129951 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e18135f20 0x7f0e18138300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009df0 tx=0x7f0e1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=399fe4c47a496cb5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.562+0000 7f0e1d151700 1 -- 172.21.15.154:0/1402129951 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000e070 con 0x7f0e18135f20 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.562+0000 7f0e1d151700 1 -- 172.21.15.154:0/1402129951 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1000bae0 con 0x7f0e18135f20 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.562+0000 7f0e1d151700 1 -- 172.21.15.154:0/1402129951 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000be90 con 0x7f0e18135f20 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.563+0000 7f0e203b7700 1 -- 172.21.15.154:0/1402129951 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e18135f20 msgr2=0x7f0e18138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.563+0000 7f0e203b7700 1 --2- 172.21.15.154:0/1402129951 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e18135f20 0x7f0e18138300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009df0 tx=0x7f0e1000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.563+0000 7f0e203b7700 1 -- 172.21.15.154:0/1402129951 shutdown_connections 2023-09-30T22:23:40.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.563+0000 7f0e203b7700 1 --2- 172.21.15.154:0/1402129951 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e18135f20 0x7f0e18138300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.563+0000 7f0e203b7700 1 --2- 172.21.15.154:0/1402129951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e1809e340 0x7f0e181359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.563+0000 7f0e203b7700 1 -- 172.21.15.154:0/1402129951 >> 172.21.15.154:0/1402129951 conn(0x7f0e18099c40 msgr2=0x7f0e180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.563+0000 7f0e203b7700 1 -- 172.21.15.154:0/1402129951 shutdown_connections 2023-09-30T22:23:40.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.563+0000 7f0e203b7700 1 -- 172.21.15.154:0/1402129951 wait complete. 2023-09-30T22:23:40.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e203b7700 1 Processor -- start 2023-09-30T22:23:40.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e203b7700 1 -- start start 2023-09-30T22:23:40.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e203b7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e1809d860 0x7f0e181c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e203b7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e1809e340 0x7f0e181c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e203b7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e18135f20 0x7f0e18120720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e203b7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18123f60 con 0x7f0e1809e340 2023-09-30T22:23:40.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e203b7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e181bb000 con 0x7f0e18135f20 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e203b7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e181332c0 con 0x7f0e1809d860 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e1e153700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e1809d860 0x7f0e181c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e1d952700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e1809e340 0x7f0e181c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e1e153700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e1809d860 0x7f0e181c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52376/0 (socket says 172.21.15.154:52376) 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e1e954700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e18135f20 0x7f0e18120720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.564+0000 7f0e1e153700 1 -- 172.21.15.154:0/1731272630 learned_addr learned my addr 172.21.15.154:0/1731272630 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e1e153700 1 -- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e18135f20 msgr2=0x7f0e18120720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e1e153700 1 --2- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e18135f20 0x7f0e18120720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e1e153700 1 -- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e1809e340 msgr2=0x7f0e181c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e1e153700 1 --2- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e1809e340 0x7f0e181c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e1e153700 1 -- 172.21.15.154:0/1731272630 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10009a70 con 0x7f0e1809d860 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e1e954700 1 --2- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e18135f20 0x7f0e18120720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e1e153700 1 --2- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e1809d860 0x7f0e181c83f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c520 tx=0x7f0e1400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e0effd700 1 -- 172.21.15.154:0/1731272630 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14004c80 con 0x7f0e1809d860 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e0effd700 1 -- 172.21.15.154:0/1731272630 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e14004de0 con 0x7f0e1809d860 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e0effd700 1 -- 172.21.15.154:0/1731272630 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14007310 con 0x7f0e1809d860 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e203b7700 1 -- 172.21.15.154:0/1731272630 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e181228e0 con 0x7f0e1809d860 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.565+0000 7f0e203b7700 1 -- 172.21.15.154:0/1731272630 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e18122330 con 0x7f0e1809d860 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.566+0000 7f0e0effd700 1 -- 172.21.15.154:0/1731272630 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e14007470 con 0x7f0e1809d860 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.566+0000 7f0e0effd700 1 -- 172.21.15.154:0/1731272630 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0e1403f2b0 con 0x7f0e1809d860 2023-09-30T22:23:40.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.566+0000 7f0e203b7700 1 -- 172.21.15.154:0/1731272630 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1804f2a0 con 0x7f0e1809d860 2023-09-30T22:23:40.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.571+0000 7f0e0effd700 1 -- 172.21.15.154:0/1731272630 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e140123b0 con 0x7f0e1809d860 2023-09-30T22:23:40.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.596+0000 7f8fbf67f700 1 Processor -- start 2023-09-30T22:23:40.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.596+0000 7f8fbf67f700 1 -- start start 2023-09-30T22:23:40.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.596+0000 7f8fbf67f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.596+0000 7f8fbf67f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8fb8138e30 0x7f8fb813b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.596+0000 7f8fbf67f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb809aa00 con 0x7f8fb8133b80 2023-09-30T22:23:40.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.596+0000 7f8fbf67f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb809a080 con 0x7f8fb8138e30 2023-09-30T22:23:40.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.596+0000 7f8fbf67f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb8133750 con 0x7f8fb8099a60 2023-09-30T22:23:40.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbcc1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbd41b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8fb8133b80 0x7f8fb8133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37416/0 (socket says 172.21.15.154:37416) 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbd41b700 1 -- 172.21.15.154:0/3442990547 learned_addr learned my addr 172.21.15.154:0/3442990547 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbdc1c700 1 --2- 172.21.15.154:0/3442990547 >> v2:172.21.15.154:3300/0 conn(0x7f8fb8138e30 0x7f8fb813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbdc1c700 1 -- 172.21.15.154:0/3442990547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 msgr2=0x7f8fb81388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbdc1c700 1 --2- 172.21.15.154:0/3442990547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbdc1c700 1 -- 172.21.15.154:0/3442990547 >> v1:172.21.15.154:6789/0 conn(0x7f8fb8133b80 legacy=0x7f8fb8133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbdc1c700 1 -- 172.21.15.154:0/3442990547 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb809a760 con 0x7f8fb8138e30 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbcc1a700 1 --2- 172.21.15.154:0/3442990547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8fbdc1c700 1 --2- 172.21.15.154:0/3442990547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8138e30 0x7f8fb813b210 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009d90 tx=0x7f8fb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f1432c0d20bd21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8faffff700 1 -- 172.21.15.154:0/3442990547 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb000e070 con 0x7f8fb8138e30 2023-09-30T22:23:40.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8faffff700 1 -- 172.21.15.154:0/3442990547 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb000bb20 con 0x7f8fb8138e30 2023-09-30T22:23:40.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.597+0000 7f8faffff700 1 -- 172.21.15.154:0/3442990547 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0012430 con 0x7f8fb8138e30 2023-09-30T22:23:40.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.598+0000 7f8fbf67f700 1 -- 172.21.15.154:0/3442990547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8138e30 msgr2=0x7f8fb813b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.598+0000 7f8fbf67f700 1 --2- 172.21.15.154:0/3442990547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8138e30 0x7f8fb813b210 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009d90 tx=0x7f8fb000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:40.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.598+0000 7f8fbf67f700 1 -- 172.21.15.154:0/3442990547 shutdown_connections 2023-09-30T22:23:40.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.598+0000 7f8fbf67f700 1 --2- 172.21.15.154:0/3442990547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8138e30 0x7f8fb813b210 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.598+0000 7f8fbf67f700 1 --2- 172.21.15.154:0/3442990547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.598+0000 7f8fbf67f700 1 -- 172.21.15.154:0/3442990547 >> 172.21.15.154:0/3442990547 conn(0x7f8fb80a2980 msgr2=0x7f8fb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.598+0000 7f8fbf67f700 1 -- 172.21.15.154:0/3442990547 shutdown_connections 2023-09-30T22:23:40.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.598+0000 7f8fbf67f700 1 -- 172.21.15.154:0/3442990547 wait complete. 2023-09-30T22:23:40.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.599+0000 7f8fbf67f700 1 Processor -- start 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.599+0000 7f8fbf67f700 1 -- start start 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.599+0000 7f8fbf67f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81354c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.599+0000 7f8fbf67f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8133b80 0x7f8fb8135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.599+0000 7f8fbf67f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fb8138e30 0x7f8fb8135f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.599+0000 7f8fbf67f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb8137ef0 con 0x7f8fb8133b80 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.599+0000 7f8fbf67f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81378c0 con 0x7f8fb8099a60 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.599+0000 7f8fbf67f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81191a0 con 0x7f8fb8138e30 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbd41b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbcc1a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8133b80 0x7f8fb8135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbcc1a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8133b80 0x7f8fb8135a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48100/0 (socket says 172.21.15.154:48100) 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbcc1a700 1 -- 172.21.15.154:0/1198225886 learned_addr learned my addr 172.21.15.154:0/1198225886 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbdc1c700 1 --2- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fb8138e30 0x7f8fb8135f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbd41b700 1 -- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fb8138e30 msgr2=0x7f8fb8135f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbd41b700 1 --2- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fb8138e30 0x7f8fb8135f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbd41b700 1 -- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8133b80 msgr2=0x7f8fb8135a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbd41b700 1 --2- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8133b80 0x7f8fb8135a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbd41b700 1 -- 172.21.15.154:0/1198225886 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80094a0 con 0x7f8fb8099a60 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbcc1a700 1 --2- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8133b80 0x7f8fb8135a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbd41b700 1 --2- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81354c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400c560 tx=0x7f8fb400c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fadffb700 1 -- 172.21.15.154:0/1198225886 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40074e0 con 0x7f8fb8099a60 2023-09-30T22:23:40.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fadffb700 1 -- 172.21.15.154:0/1198225886 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb400ce90 con 0x7f8fb8099a60 2023-09-30T22:23:40.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fbf67f700 1 -- 172.21.15.154:0/1198225886 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb0009a70 con 0x7f8fb8099a60 2023-09-30T22:23:40.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.600+0000 7f8fadffb700 1 -- 172.21.15.154:0/1198225886 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4005830 con 0x7f8fb8099a60 2023-09-30T22:23:40.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.601+0000 7f8fbf67f700 1 -- 172.21.15.154:0/1198225886 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb809a2c0 con 0x7f8fb8099a60 2023-09-30T22:23:40.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.601+0000 7f8fbf67f700 1 -- 172.21.15.154:0/1198225886 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb804f2a0 con 0x7f8fb8099a60 2023-09-30T22:23:40.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.602+0000 7f8fadffb700 1 -- 172.21.15.154:0/1198225886 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fb4005990 con 0x7f8fb8099a60 2023-09-30T22:23:40.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.602+0000 7f8fadffb700 1 -- 172.21.15.154:0/1198225886 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8fb403ec80 con 0x7f8fb8099a60 2023-09-30T22:23:40.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.610+0000 7f8fadffb700 1 -- 172.21.15.154:0/1198225886 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fb4019b40 con 0x7f8fb8099a60 2023-09-30T22:23:40.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.654+0000 7fe2b34e7700 1 Processor -- start 2023-09-30T22:23:40.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.654+0000 7fe2b34e7700 1 -- start start 2023-09-30T22:23:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b34e7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac133ad0 0x7fe2ac133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b34e7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2ac1300a0 0x7fe2ac1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b34e7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac1309f0 0x7fe2ac13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b34e7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ac06b2d0 con 0x7fe2ac1300a0 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b34e7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac133610 con 0x7fe2ac133ad0 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b34e7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac09a500 con 0x7fe2ac1309f0 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1283700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac133ad0 0x7fe2ac133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1283700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac133ad0 0x7fe2ac133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59500/0 (socket says 172.21.15.154:59500) 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1283700 1 -- 172.21.15.154:0/3376676392 learned_addr learned my addr 172.21.15.154:0/3376676392 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b0a82700 1 --2- 172.21.15.154:0/3376676392 >> v2:172.21.15.154:3300/0 conn(0x7fe2ac1300a0 0x7fe2ac1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1a84700 1 --2- 172.21.15.154:0/3376676392 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac1309f0 0x7fe2ac13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1283700 1 -- 172.21.15.154:0/3376676392 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac1309f0 msgr2=0x7fe2ac13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1283700 1 --2- 172.21.15.154:0/3376676392 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac1309f0 0x7fe2ac13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1283700 1 -- 172.21.15.154:0/3376676392 >> v2:172.21.15.154:3300/0 conn(0x7fe2ac1300a0 msgr2=0x7fe2ac1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1283700 1 --2- 172.21.15.154:0/3376676392 >> v2:172.21.15.154:3300/0 conn(0x7fe2ac1300a0 0x7fe2ac1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1283700 1 -- 172.21.15.154:0/3376676392 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac1338b0 con 0x7fe2ac133ad0 2023-09-30T22:23:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b0a82700 1 --2- 172.21.15.154:0/3376676392 >> v2:172.21.15.154:3300/0 conn(0x7fe2ac1300a0 0x7fe2ac1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.655+0000 7fe2b1283700 1 --2- 172.21.15.154:0/3376676392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac133ad0 0x7fe2ac133ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80098f0 tx=0x7fe2a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12fdea656c590da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2a3fff700 1 -- 172.21.15.154:0/3376676392 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8011830 con 0x7fe2ac133ad0 2023-09-30T22:23:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2a3fff700 1 -- 172.21.15.154:0/3376676392 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a8011990 con 0x7fe2ac133ad0 2023-09-30T22:23:40.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2a3fff700 1 -- 172.21.15.154:0/3376676392 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8011d20 con 0x7fe2ac133ad0 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3376676392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac133ad0 msgr2=0x7fe2ac133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2b34e7700 1 --2- 172.21.15.154:0/3376676392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac133ad0 0x7fe2ac133ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80098f0 tx=0x7fe2a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3376676392 shutdown_connections 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2b34e7700 1 --2- 172.21.15.154:0/3376676392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac133ad0 0x7fe2ac133ea0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2b34e7700 1 --2- 172.21.15.154:0/3376676392 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac1309f0 0x7fe2ac13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2b34e7700 1 --2- 172.21.15.154:0/3376676392 >> v2:172.21.15.154:3300/0 conn(0x7fe2ac1300a0 0x7fe2ac1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3376676392 >> 172.21.15.154:0/3376676392 conn(0x7fe2ac099c40 msgr2=0x7fe2ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3376676392 shutdown_connections 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.656+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3376676392 wait complete. 2023-09-30T22:23:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.657+0000 7fe2b34e7700 1 Processor -- start 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.657+0000 7fe2b34e7700 1 -- start start 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b34e7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2ac1300a0 0x7fe2ac11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b34e7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac1309f0 0x7fe2ac11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b34e7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac133ad0 0x7fe2ac11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b34e7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac11fcd0 con 0x7fe2ac1300a0 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b34e7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac120070 con 0x7fe2ac1309f0 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b34e7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac120270 con 0x7fe2ac133ad0 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b0a82700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac1309f0 0x7fe2ac11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1a84700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac133ad0 0x7fe2ac11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b0a82700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac1309f0 0x7fe2ac11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59510/0 (socket says 172.21.15.154:59510) 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1a84700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac133ad0 0x7fe2ac11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52398/0 (socket says 172.21.15.154:52398) 2023-09-30T22:23:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b0a82700 1 -- 172.21.15.154:0/3943392158 learned_addr learned my addr 172.21.15.154:0/3943392158 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1283700 1 --2- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2ac1300a0 0x7fe2ac11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1a84700 1 -- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac1309f0 msgr2=0x7fe2ac11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1a84700 1 --2- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac1309f0 0x7fe2ac11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1a84700 1 -- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2ac1300a0 msgr2=0x7fe2ac11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1a84700 1 --2- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2ac1300a0 0x7fe2ac11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1a84700 1 -- 172.21.15.154:0/3943392158 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0094a0 con 0x7fe2ac133ad0 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1283700 1 --2- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2ac1300a0 0x7fe2ac11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2b1a84700 1 --2- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac133ad0 0x7fe2ac11e4c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400efc0 tx=0x7fe2a400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.658+0000 7fe2a1ffb700 1 -- 172.21.15.154:0/3943392158 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a400cc90 con 0x7fe2ac133ad0 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.659+0000 7fe2a1ffb700 1 -- 172.21.15.154:0/3943392158 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a400f040 con 0x7fe2ac133ad0 2023-09-30T22:23:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.659+0000 7fe2a1ffb700 1 -- 172.21.15.154:0/3943392158 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40146c0 con 0x7fe2ac133ad0 2023-09-30T22:23:40.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.659+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3943392158 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a8009550 con 0x7fe2ac133ad0 2023-09-30T22:23:40.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.659+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3943392158 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac12dd00 con 0x7fe2ac133ad0 2023-09-30T22:23:40.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.660+0000 7fe2a1ffb700 1 -- 172.21.15.154:0/3943392158 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2a4014820 con 0x7fe2ac133ad0 2023-09-30T22:23:40.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.660+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3943392158 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac04f2a0 con 0x7fe2ac133ad0 2023-09-30T22:23:40.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.660+0000 7fe2a1ffb700 1 -- 172.21.15.154:0/3943392158 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe2a4040180 con 0x7fe2ac133ad0 2023-09-30T22:23:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.664+0000 7fe2a1ffb700 1 -- 172.21.15.154:0/3943392158 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2a4014ad0 con 0x7fe2ac133ad0 2023-09-30T22:23:40.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.772+0000 7f0e203b7700 1 -- 172.21.15.154:0/1731272630 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e1809c8b0 con 0x7f0e1809d860 2023-09-30T22:23:40.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.772+0000 7f0e0effd700 1 -- 172.21.15.154:0/1731272630 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e14011360 con 0x7f0e1809d860 2023-09-30T22:23:40.772 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:40.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.774+0000 7f0e203b7700 1 -- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e1809d860 msgr2=0x7f0e181c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.774+0000 7f0e203b7700 1 --2- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e1809d860 0x7f0e181c83f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c520 tx=0x7f0e1400c830 comp rx=0 tx=0).stop 2023-09-30T22:23:40.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.774+0000 7f0e203b7700 1 -- 172.21.15.154:0/1731272630 shutdown_connections 2023-09-30T22:23:40.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.774+0000 7f0e203b7700 1 --2- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e18135f20 0x7f0e18120720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.774+0000 7f0e203b7700 1 --2- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e1809d860 0x7f0e181c83f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.774+0000 7f0e203b7700 1 --2- 172.21.15.154:0/1731272630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e1809e340 0x7f0e181c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.774+0000 7f0e203b7700 1 -- 172.21.15.154:0/1731272630 >> 172.21.15.154:0/1731272630 conn(0x7f0e18099c40 msgr2=0x7f0e180a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.774+0000 7f0e203b7700 1 -- 172.21.15.154:0/1731272630 shutdown_connections 2023-09-30T22:23:40.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.774+0000 7f0e203b7700 1 -- 172.21.15.154:0/1731272630 wait complete. 2023-09-30T22:23:40.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.807+0000 7f8fbf67f700 1 -- 172.21.15.154:0/1198225886 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fb806bce0 con 0x7f8fb8099a60 2023-09-30T22:23:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.807+0000 7f8fadffb700 1 -- 172.21.15.154:0/1198225886 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fb4017030 con 0x7f8fb8099a60 2023-09-30T22:23:40.807 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.809+0000 7f8fbf67f700 1 -- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 msgr2=0x7f8fb81354c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.809+0000 7f8fbf67f700 1 --2- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81354c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400c560 tx=0x7f8fb400c870 comp rx=0 tx=0).stop 2023-09-30T22:23:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.809+0000 7f8fbf67f700 1 -- 172.21.15.154:0/1198225886 shutdown_connections 2023-09-30T22:23:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.809+0000 7f8fbf67f700 1 --2- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fb8138e30 0x7f8fb8135f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.809+0000 7f8fbf67f700 1 --2- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fb8099a60 0x7f8fb81354c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.809+0000 7f8fbf67f700 1 --2- 172.21.15.154:0/1198225886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fb8133b80 0x7f8fb8135a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.809+0000 7f8fbf67f700 1 -- 172.21.15.154:0/1198225886 >> 172.21.15.154:0/1198225886 conn(0x7f8fb80a2980 msgr2=0x7f8fb81314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.809+0000 7f8fbf67f700 1 -- 172.21.15.154:0/1198225886 shutdown_connections 2023-09-30T22:23:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.809+0000 7f8fbf67f700 1 -- 172.21.15.154:0/1198225886 wait complete. 2023-09-30T22:23:40.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.862+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3943392158 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe2ac0a2f30 con 0x7fe2ac133ad0 2023-09-30T22:23:40.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.863+0000 7fe2a1ffb700 1 -- 172.21.15.154:0/3943392158 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2a4007330 con 0x7fe2ac133ad0 2023-09-30T22:23:40.862 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.865+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac133ad0 msgr2=0x7fe2ac11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.865+0000 7fe2b34e7700 1 --2- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac133ad0 0x7fe2ac11e4c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400efc0 tx=0x7fe2a400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.865+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3943392158 shutdown_connections 2023-09-30T22:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.865+0000 7fe2b34e7700 1 --2- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2ac133ad0 0x7fe2ac11e4c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.865+0000 7fe2b34e7700 1 --2- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2ac1300a0 0x7fe2ac11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.865+0000 7fe2b34e7700 1 --2- 172.21.15.154:0/3943392158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2ac1309f0 0x7fe2ac11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.865+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3943392158 >> 172.21.15.154:0/3943392158 conn(0x7fe2ac099c40 msgr2=0x7fe2ac12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.865+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3943392158 shutdown_connections 2023-09-30T22:23:40.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:40.865+0000 7fe2b34e7700 1 -- 172.21.15.154:0/3943392158 wait complete. 2023-09-30T22:23:40.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:41.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:41.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.172+0000 7fc4d964f700 1 Processor -- start 2023-09-30T22:23:41.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.172+0000 7fc4d964f700 1 -- start start 2023-09-30T22:23:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d964f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d4136a80 0x7fc4d4138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d964f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d41393a0 0x7fc4d413b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d964f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d4133a60 con 0x7fc4d4133c80 2023-09-30T22:23:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d964f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d409a360 con 0x7fc4d4136a80 2023-09-30T22:23:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d964f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d409a880 con 0x7fc4d41393a0 2023-09-30T22:23:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d4136a80 0x7fc4d4138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d2ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc4d4133c80 0x7fc4d4134050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37428/0 (socket says 172.21.15.154:37428) 2023-09-30T22:23:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d2ffd700 1 -- 172.21.15.154:0/796806866 learned_addr learned my addr 172.21.15.154:0/796806866 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d37fe700 1 --2- 172.21.15.154:0/796806866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d41393a0 0x7fc4d413b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d1ffb700 1 -- 172.21.15.154:0/796806866 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251673062 0 0) 0x7fc4d4133a60 con 0x7fc4d4133c80 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d37fe700 1 -- 172.21.15.154:0/796806866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d4136a80 msgr2=0x7fc4d4138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d37fe700 1 --2- 172.21.15.154:0/796806866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d4136a80 0x7fc4d4138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d37fe700 1 -- 172.21.15.154:0/796806866 >> v1:172.21.15.154:6789/0 conn(0x7fc4d4133c80 legacy=0x7fc4d4134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d37fe700 1 -- 172.21.15.154:0/796806866 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d409ab40 con 0x7fc4d41393a0 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.173+0000 7fc4d27fc700 1 --2- 172.21.15.154:0/796806866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d4136a80 0x7fc4d4138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d37fe700 1 --2- 172.21.15.154:0/796806866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d41393a0 0x7fc4d413b780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009dc0 tx=0x7fc4cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839fe211dce8a01d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d1ffb700 1 -- 172.21.15.154:0/796806866 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00e070 con 0x7fc4d41393a0 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d1ffb700 1 -- 172.21.15.154:0/796806866 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc00bb20 con 0x7fc4d41393a0 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d1ffb700 1 -- 172.21.15.154:0/796806866 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc012430 con 0x7fc4d41393a0 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d964f700 1 -- 172.21.15.154:0/796806866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d41393a0 msgr2=0x7fc4d413b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d964f700 1 --2- 172.21.15.154:0/796806866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d41393a0 0x7fc4d413b780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009dc0 tx=0x7fc4cc00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d964f700 1 -- 172.21.15.154:0/796806866 shutdown_connections 2023-09-30T22:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d964f700 1 --2- 172.21.15.154:0/796806866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d41393a0 0x7fc4d413b780 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d964f700 1 --2- 172.21.15.154:0/796806866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d4136a80 0x7fc4d4138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d964f700 1 -- 172.21.15.154:0/796806866 >> 172.21.15.154:0/796806866 conn(0x7fc4d40a2980 msgr2=0x7fc4d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d964f700 1 -- 172.21.15.154:0/796806866 shutdown_connections 2023-09-30T22:23:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.174+0000 7fc4d964f700 1 -- 172.21.15.154:0/796806866 wait complete. 2023-09-30T22:23:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.175+0000 7fc4d964f700 1 Processor -- start 2023-09-30T22:23:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d964f700 1 -- start start 2023-09-30T22:23:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d964f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4d4133c80 0x7fc4d4118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d964f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d4136a80 0x7fc4d4119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d964f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d41393a0 0x7fc4d4119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d964f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d412dfe0 con 0x7fc4d4133c80 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d964f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d411bf40 con 0x7fc4d41393a0 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d964f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d411afc0 con 0x7fc4d4136a80 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d4136a80 0x7fc4d4119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d41393a0 0x7fc4d4119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d4136a80 0x7fc4d4119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52408/0 (socket says 172.21.15.154:52408) 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d27fc700 1 -- 172.21.15.154:0/4236586659 learned_addr learned my addr 172.21.15.154:0/4236586659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d2ffd700 1 --2- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4d4133c80 0x7fc4d4118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d27fc700 1 -- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d41393a0 msgr2=0x7fc4d4119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d27fc700 1 --2- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d41393a0 0x7fc4d4119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d27fc700 1 -- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4d4133c80 msgr2=0x7fc4d4118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d27fc700 1 --2- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4d4133c80 0x7fc4d4118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d27fc700 1 -- 172.21.15.154:0/4236586659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40094a0 con 0x7fc4d4136a80 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d37fe700 1 --2- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d41393a0 0x7fc4d4119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.176+0000 7fc4d27fc700 1 --2- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d4136a80 0x7fc4d4119330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400ec10 tx=0x7fc4c400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.177+0000 7fc4bb7fe700 1 -- 172.21.15.154:0/4236586659 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400c850 con 0x7fc4d4136a80 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.177+0000 7fc4bb7fe700 1 -- 172.21.15.154:0/4236586659 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c400c9b0 con 0x7fc4d4136a80 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.177+0000 7fc4d964f700 1 -- 172.21.15.154:0/4236586659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4cc009a70 con 0x7fc4d4136a80 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.177+0000 7fc4bb7fe700 1 -- 172.21.15.154:0/4236586659 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400cd40 con 0x7fc4d4136a80 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.177+0000 7fc4d964f700 1 -- 172.21.15.154:0/4236586659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d411b5b0 con 0x7fc4d4136a80 2023-09-30T22:23:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.177+0000 7fc4bb7fe700 1 -- 172.21.15.154:0/4236586659 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4c4013470 con 0x7fc4d4136a80 2023-09-30T22:23:41.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.177+0000 7fc4bb7fe700 1 -- 172.21.15.154:0/4236586659 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc4c403f590 con 0x7fc4d4136a80 2023-09-30T22:23:41.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.178+0000 7fc4d964f700 1 -- 172.21.15.154:0/4236586659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d411b5b0 con 0x7fc4d4136a80 2023-09-30T22:23:41.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.182+0000 7fc4bb7fe700 1 -- 172.21.15.154:0/4236586659 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4d411b5b0 con 0x7fc4d4136a80 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.368+0000 7fc4d964f700 1 -- 172.21.15.154:0/4236586659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4d411b5b0 con 0x7fc4d4136a80 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.368+0000 7fc4bb7fe700 1 -- 172.21.15.154:0/4236586659 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4d411b5b0 con 0x7fc4d4136a80 2023-09-30T22:23:41.368 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.370+0000 7fc4d964f700 1 -- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d4136a80 msgr2=0x7fc4d4119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.370+0000 7fc4d964f700 1 --2- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d4136a80 0x7fc4d4119330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400ec10 tx=0x7fc4c400ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.370+0000 7fc4d964f700 1 -- 172.21.15.154:0/4236586659 shutdown_connections 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.370+0000 7fc4d964f700 1 --2- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc4d41393a0 0x7fc4d4119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.370+0000 7fc4d964f700 1 --2- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4d4133c80 0x7fc4d4118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.370+0000 7fc4d964f700 1 --2- 172.21.15.154:0/4236586659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc4d4136a80 0x7fc4d4119330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.371+0000 7fc4d964f700 1 -- 172.21.15.154:0/4236586659 >> 172.21.15.154:0/4236586659 conn(0x7fc4d40a2980 msgr2=0x7fc4d4134860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.371+0000 7fc4d964f700 1 -- 172.21.15.154:0/4236586659 shutdown_connections 2023-09-30T22:23:41.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.371+0000 7fc4d964f700 1 -- 172.21.15.154:0/4236586659 wait complete. 2023-09-30T22:23:41.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:41.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:41.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:41.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:41.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.916+0000 7f53cdb25700 1 Processor -- start 2023-09-30T22:23:41.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.916+0000 7f53cdb25700 1 -- start start 2023-09-30T22:23:41.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.916+0000 7f53cdb25700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53c809f350 0x7f53c8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.916+0000 7f53cdb25700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c81371c0 0x7f53c81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.916+0000 7f53cdb25700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c809c970 con 0x7f53c809e870 2023-09-30T22:23:41.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.916+0000 7f53cdb25700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c80a0920 con 0x7f53c809f350 2023-09-30T22:23:41.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.916+0000 7f53cdb25700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c809f9c0 con 0x7f53c81371c0 2023-09-30T22:23:41.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53c809f350 0x7f53c8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c81371c0 0x7f53c81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53c809f350 0x7f53c8136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48140/0 (socket says 172.21.15.154:48140) 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c6ffd700 1 -- 172.21.15.154:0/1039108633 learned_addr learned my addr 172.21.15.154:0/1039108633 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c81371c0 0x7f53c81395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59540/0 (socket says 172.21.15.154:59540) 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c7fff700 1 -- 172.21.15.154:0/1039108633 >> v2:172.21.15.154:3300/0 conn(0x7f53c809f350 msgr2=0x7f53c8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c7fff700 1 --2- 172.21.15.154:0/1039108633 >> v2:172.21.15.154:3300/0 conn(0x7f53c809f350 0x7f53c8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c7fff700 1 -- 172.21.15.154:0/1039108633 >> v1:172.21.15.154:6789/0 conn(0x7f53c809e870 legacy=0x7f53c809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c7fff700 1 -- 172.21.15.154:0/1039108633 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c809bab0 con 0x7f53c81371c0 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c7fff700 1 --2- 172.21.15.154:0/1039108633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c81371c0 0x7f53c81395a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009840 tx=0x7f53c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f1e9873a6dddc4b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c67fc700 1 -- 172.21.15.154:0/1039108633 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011830 con 0x7f53c81371c0 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c67fc700 1 -- 172.21.15.154:0/1039108633 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0011990 con 0x7f53c81371c0 2023-09-30T22:23:41.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.917+0000 7f53c67fc700 1 -- 172.21.15.154:0/1039108633 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011d20 con 0x7f53c81371c0 2023-09-30T22:23:41.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.918+0000 7f53cdb25700 1 -- 172.21.15.154:0/1039108633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c81371c0 msgr2=0x7f53c81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.918+0000 7f53cdb25700 1 --2- 172.21.15.154:0/1039108633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c81371c0 0x7f53c81395a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009840 tx=0x7f53c0009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:41.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.918+0000 7f53cdb25700 1 -- 172.21.15.154:0/1039108633 shutdown_connections 2023-09-30T22:23:41.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.918+0000 7f53cdb25700 1 --2- 172.21.15.154:0/1039108633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c81371c0 0x7f53c81395a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.918+0000 7f53cdb25700 1 --2- 172.21.15.154:0/1039108633 >> v2:172.21.15.154:3300/0 conn(0x7f53c809f350 0x7f53c8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.918+0000 7f53cdb25700 1 -- 172.21.15.154:0/1039108633 >> 172.21.15.154:0/1039108633 conn(0x7f53c80a4430 msgr2=0x7f53c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.918+0000 7f53cdb25700 1 -- 172.21.15.154:0/1039108633 shutdown_connections 2023-09-30T22:23:41.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.918+0000 7f53cdb25700 1 -- 172.21.15.154:0/1039108633 wait complete. 2023-09-30T22:23:41.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.919+0000 7f53cdb25700 1 Processor -- start 2023-09-30T22:23:41.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.919+0000 7f53cdb25700 1 -- start start 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53cdb25700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c809e870 0x7f53c806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53cdb25700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53c809f350 0x7f53c806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53cdb25700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53c81371c0 0x7f53c806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53cdb25700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c806d3f0 con 0x7f53c81371c0 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53cdb25700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c8072320 con 0x7f53c809e870 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53cdb25700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53c809dba0 con 0x7f53c809f350 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53c809f350 0x7f53c806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53c81371c0 0x7f53c806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c809e870 0x7f53c806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53c81371c0 0x7f53c806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48150/0 (socket says 172.21.15.154:48150) 2023-09-30T22:23:41.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53c809f350 0x7f53c806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52416/0 (socket says 172.21.15.154:52416) 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c7fff700 1 -- 172.21.15.154:0/2409362830 learned_addr learned my addr 172.21.15.154:0/2409362830 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c7fff700 1 -- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53c809f350 msgr2=0x7f53c806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c7fff700 1 --2- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53c809f350 0x7f53c806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c7fff700 1 -- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c809e870 msgr2=0x7f53c806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c7fff700 1 --2- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c809e870 0x7f53c806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c7fff700 1 -- 172.21.15.154:0/2409362830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00094a0 con 0x7f53c81371c0 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c6ffd700 1 --2- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53c809f350 0x7f53c806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c77fe700 1 --2- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c809e870 0x7f53c806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53c7fff700 1 --2- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53c81371c0 0x7f53c806c330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009b90 tx=0x7f53c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.920+0000 7f53bffff700 1 -- 172.21.15.154:0/2409362830 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c00036a0 con 0x7f53c81371c0 2023-09-30T22:23:41.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.921+0000 7f53bffff700 1 -- 172.21.15.154:0/2409362830 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c001f070 con 0x7f53c81371c0 2023-09-30T22:23:41.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.921+0000 7f53cdb25700 1 -- 172.21.15.154:0/2409362830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c81262d0 con 0x7f53c81371c0 2023-09-30T22:23:41.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.921+0000 7f53bffff700 1 -- 172.21.15.154:0/2409362830 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0003a60 con 0x7f53c81371c0 2023-09-30T22:23:41.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.921+0000 7f53cdb25700 1 -- 172.21.15.154:0/2409362830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c8126cd0 con 0x7f53c81371c0 2023-09-30T22:23:41.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.921+0000 7f53cdb25700 1 -- 172.21.15.154:0/2409362830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c809fbc0 con 0x7f53c81371c0 2023-09-30T22:23:41.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.922+0000 7f53bffff700 1 -- 172.21.15.154:0/2409362830 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53c0003bc0 con 0x7f53c81371c0 2023-09-30T22:23:41.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.922+0000 7f53bffff700 1 -- 172.21.15.154:0/2409362830 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f53c0021070 con 0x7f53c81371c0 2023-09-30T22:23:41.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.926+0000 7f53bffff700 1 -- 172.21.15.154:0/2409362830 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53c0010380 con 0x7f53c81371c0 2023-09-30T22:23:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.961+0000 7fa8a5979700 1 Processor -- start 2023-09-30T22:23:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.961+0000 7fa8a5979700 1 -- start start 2023-09-30T22:23:41.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.961+0000 7fa8a5979700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8a009f350 0x7fa8a0138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.961+0000 7fa8a5979700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a0139480 0x7fa8a013b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.961+0000 7fa8a5979700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a006bec0 con 0x7fa8a009e870 2023-09-30T22:23:41.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.961+0000 7fa8a5979700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a006ce60 con 0x7fa8a009f350 2023-09-30T22:23:41.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.961+0000 7fa8a5979700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a009fa00 con 0x7fa8a0139480 2023-09-30T22:23:41.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89e7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8a009f350 0x7fa8a0138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a0139480 0x7fa8a013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a0139480 0x7fa8a013b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52432/0 (socket says 172.21.15.154:52432) 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89e7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8a009f350 0x7fa8a0138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48164/0 (socket says 172.21.15.154:48164) 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89f7fe700 1 -- 172.21.15.154:0/2676368914 learned_addr learned my addr 172.21.15.154:0/2676368914 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89f7fe700 1 -- 172.21.15.154:0/2676368914 >> v2:172.21.15.154:3300/0 conn(0x7fa8a009f350 msgr2=0x7fa8a0138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89f7fe700 1 --2- 172.21.15.154:0/2676368914 >> v2:172.21.15.154:3300/0 conn(0x7fa8a009f350 0x7fa8a0138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89f7fe700 1 -- 172.21.15.154:0/2676368914 >> v1:172.21.15.154:6789/0 conn(0x7fa8a009e870 legacy=0x7fa8a009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89f7fe700 1 -- 172.21.15.154:0/2676368914 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a009ad80 con 0x7fa8a0139480 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89e7fc700 1 --2- 172.21.15.154:0/2676368914 >> v2:172.21.15.154:3300/0 conn(0x7fa8a009f350 0x7fa8a0138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89f7fe700 1 --2- 172.21.15.154:0/2676368914 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a0139480 0x7fa8a013b860 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa898009e50 tx=0x7fa89800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db7290f30f4db0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89dffb700 1 -- 172.21.15.154:0/2676368914 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800e070 con 0x7fa8a0139480 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89dffb700 1 -- 172.21.15.154:0/2676368914 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89800b910 con 0x7fa8a0139480 2023-09-30T22:23:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.962+0000 7fa89dffb700 1 -- 172.21.15.154:0/2676368914 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800bcc0 con 0x7fa8a0139480 2023-09-30T22:23:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.963+0000 7fa8a5979700 1 -- 172.21.15.154:0/2676368914 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a0139480 msgr2=0x7fa8a013b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.963+0000 7fa8a5979700 1 --2- 172.21.15.154:0/2676368914 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a0139480 0x7fa8a013b860 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa898009e50 tx=0x7fa89800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.963+0000 7fa8a5979700 1 -- 172.21.15.154:0/2676368914 shutdown_connections 2023-09-30T22:23:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.963+0000 7fa8a5979700 1 --2- 172.21.15.154:0/2676368914 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a0139480 0x7fa8a013b860 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.963+0000 7fa8a5979700 1 --2- 172.21.15.154:0/2676368914 >> v2:172.21.15.154:3300/0 conn(0x7fa8a009f350 0x7fa8a0138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.963+0000 7fa8a5979700 1 -- 172.21.15.154:0/2676368914 >> 172.21.15.154:0/2676368914 conn(0x7fa8a00a4430 msgr2=0x7fa8a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.963+0000 7fa8a5979700 1 -- 172.21.15.154:0/2676368914 shutdown_connections 2023-09-30T22:23:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.963+0000 7fa8a5979700 1 -- 172.21.15.154:0/2676368914 wait complete. 2023-09-30T22:23:41.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.964+0000 7fa8a5979700 1 Processor -- start 2023-09-30T22:23:41.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.964+0000 7fa8a5979700 1 -- start start 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa8a5979700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a009e870 0x7fa8a011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa8a5979700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a009f350 0x7fa8a011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa8a5979700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8a0139480 0x7fa8a011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa8a5979700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0072670 con 0x7fa8a009f350 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa8a5979700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a006cfa0 con 0x7fa8a0139480 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa8a5979700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0120670 con 0x7fa8a009e870 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a009e870 0x7fa8a011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a009e870 0x7fa8a011ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52438/0 (socket says 172.21.15.154:52438) 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89effd700 1 -- 172.21.15.154:0/518963785 learned_addr learned my addr 172.21.15.154:0/518963785 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89e7fc700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a009f350 0x7fa8a011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89f7fe700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8a0139480 0x7fa8a011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89effd700 1 -- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8a0139480 msgr2=0x7fa8a011f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89effd700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8a0139480 0x7fa8a011f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89effd700 1 -- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a009f350 msgr2=0x7fa8a011f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89effd700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a009f350 0x7fa8a011f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89effd700 1 -- 172.21.15.154:0/518963785 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940094a0 con 0x7fa8a009e870 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89e7fc700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a009f350 0x7fa8a011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa89effd700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a009e870 0x7fa8a011ead0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c4e0 tx=0x7fa89000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa887fff700 1 -- 172.21.15.154:0/518963785 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900052d0 con 0x7fa8a009e870 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa887fff700 1 -- 172.21.15.154:0/518963785 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa890005430 con 0x7fa8a009e870 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa8a5979700 1 -- 172.21.15.154:0/518963785 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa898009b30 con 0x7fa8a009e870 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.965+0000 7fa887fff700 1 -- 172.21.15.154:0/518963785 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900038c0 con 0x7fa8a009e870 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.966+0000 7fa8a5979700 1 -- 172.21.15.154:0/518963785 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a0122c00 con 0x7fa8a009e870 2023-09-30T22:23:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.966+0000 7fa887fff700 1 -- 172.21.15.154:0/518963785 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa890003a20 con 0x7fa8a009e870 2023-09-30T22:23:41.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.967+0000 7fa8a5979700 1 -- 172.21.15.154:0/518963785 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a004f2a0 con 0x7fa8a009e870 2023-09-30T22:23:41.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.967+0000 7fa887fff700 1 -- 172.21.15.154:0/518963785 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa89003ea70 con 0x7fa8a009e870 2023-09-30T22:23:41.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:41.975+0000 7fa887fff700 1 -- 172.21.15.154:0/518963785 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa890017020 con 0x7fa8a009e870 2023-09-30T22:23:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72d1f0700 1 Processor -- start 2023-09-30T22:23:42.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72d1f0700 1 -- start start 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72d1f0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe72809f350 0x7fe728138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72d1f0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728139480 0x7fe72813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72d1f0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72806bec0 con 0x7fe72809e870 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72d1f0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72806ce60 con 0x7fe72809f350 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72d1f0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72809fa00 con 0x7fe728139480 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe72809f350 0x7fe728138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe72809f350 0x7fe728138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48186/0 (socket says 172.21.15.154:48186) 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.010+0000 7fe72659c700 1 -- 172.21.15.154:0/3848586548 learned_addr learned my addr 172.21.15.154:0/3848586548 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.011+0000 7fe72759e700 1 --2- 172.21.15.154:0/3848586548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728139480 0x7fe72813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.011+0000 7fe72659c700 1 -- 172.21.15.154:0/3848586548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728139480 msgr2=0x7fe72813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.011+0000 7fe72659c700 1 --2- 172.21.15.154:0/3848586548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728139480 0x7fe72813b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.011+0000 7fe72659c700 1 -- 172.21.15.154:0/3848586548 >> v1:172.21.15.154:6789/0 conn(0x7fe72809e870 legacy=0x7fe72809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.011+0000 7fe72659c700 1 -- 172.21.15.154:0/3848586548 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72809ad80 con 0x7fe72809f350 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.011+0000 7fe72659c700 1 --2- 172.21.15.154:0/3848586548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe72809f350 0x7fe728138f40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0098f0 tx=0x7fe71c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59da9cc4d76b82b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.011+0000 7fe725d9b700 1 -- 172.21.15.154:0/3848586548 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c011830 con 0x7fe72809f350 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.011+0000 7fe725d9b700 1 -- 172.21.15.154:0/3848586548 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c011990 con 0x7fe72809f350 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.011+0000 7fe725d9b700 1 -- 172.21.15.154:0/3848586548 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c011d20 con 0x7fe72809f350 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.012+0000 7fe72d1f0700 1 -- 172.21.15.154:0/3848586548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe72809f350 msgr2=0x7fe728138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.012+0000 7fe72d1f0700 1 --2- 172.21.15.154:0/3848586548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe72809f350 0x7fe728138f40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0098f0 tx=0x7fe71c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.012+0000 7fe72d1f0700 1 -- 172.21.15.154:0/3848586548 shutdown_connections 2023-09-30T22:23:42.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.012+0000 7fe72d1f0700 1 --2- 172.21.15.154:0/3848586548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe728139480 0x7fe72813b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.012+0000 7fe72d1f0700 1 --2- 172.21.15.154:0/3848586548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe72809f350 0x7fe728138f40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.012+0000 7fe72d1f0700 1 -- 172.21.15.154:0/3848586548 >> 172.21.15.154:0/3848586548 conn(0x7fe7280a4430 msgr2=0x7fe7280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.012+0000 7fe72d1f0700 1 -- 172.21.15.154:0/3848586548 shutdown_connections 2023-09-30T22:23:42.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.012+0000 7fe72d1f0700 1 -- 172.21.15.154:0/3848586548 wait complete. 2023-09-30T22:23:42.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.013+0000 7fe72d1f0700 1 Processor -- start 2023-09-30T22:23:42.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.013+0000 7fe72d1f0700 1 -- start start 2023-09-30T22:23:42.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe72d1f0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe72809e870 0x7fe72811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe72d1f0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe72809f350 0x7fe72811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe72d1f0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe728139480 0x7fe72811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe72d1f0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe728134350 con 0x7fe728139480 2023-09-30T22:23:42.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe72d1f0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72806cfa0 con 0x7fe72809f350 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe72d1f0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe728122280 con 0x7fe72809e870 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe726d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe72809e870 0x7fe72811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe72659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe72809f350 0x7fe72811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe726d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe72809e870 0x7fe72811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52450/0 (socket says 172.21.15.154:52450) 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe726d9d700 1 -- 172.21.15.154:0/2712123414 learned_addr learned my addr 172.21.15.154:0/2712123414 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe72759e700 1 --2- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe728139480 0x7fe72811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe726d9d700 1 -- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe72809f350 msgr2=0x7fe72811f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe726d9d700 1 --2- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe72809f350 0x7fe72811f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe726d9d700 1 -- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe728139480 msgr2=0x7fe72811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe726d9d700 1 --2- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe728139480 0x7fe72811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe726d9d700 1 -- 172.21.15.154:0/2712123414 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c009550 con 0x7fe72809e870 2023-09-30T22:23:42.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.014+0000 7fe726d9d700 1 --2- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe72809e870 0x7fe72811ead0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c4e0 tx=0x7fe71800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.015+0000 7fe70f7fe700 1 -- 172.21.15.154:0/2712123414 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180052d0 con 0x7fe72809e870 2023-09-30T22:23:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.015+0000 7fe70f7fe700 1 -- 172.21.15.154:0/2712123414 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718005430 con 0x7fe72809e870 2023-09-30T22:23:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.015+0000 7fe70f7fe700 1 -- 172.21.15.154:0/2712123414 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180038c0 con 0x7fe72809e870 2023-09-30T22:23:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.015+0000 7fe72d1f0700 1 -- 172.21.15.154:0/2712123414 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7280a3870 con 0x7fe72809e870 2023-09-30T22:23:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.015+0000 7fe72d1f0700 1 -- 172.21.15.154:0/2712123414 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe728121cd0 con 0x7fe72809e870 2023-09-30T22:23:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.016+0000 7fe72d1f0700 1 -- 172.21.15.154:0/2712123414 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72804f2a0 con 0x7fe72809e870 2023-09-30T22:23:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.016+0000 7fe70f7fe700 1 -- 172.21.15.154:0/2712123414 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe718003a20 con 0x7fe72809e870 2023-09-30T22:23:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.016+0000 7fe70f7fe700 1 -- 172.21.15.154:0/2712123414 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe71803eed0 con 0x7fe72809e870 2023-09-30T22:23:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.020+0000 7fe70f7fe700 1 -- 172.21.15.154:0/2712123414 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe718018260 con 0x7fe72809e870 2023-09-30T22:23:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.121+0000 7f53cdb25700 1 -- 172.21.15.154:0/2409362830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f53c8125f00 con 0x7f53c81371c0 2023-09-30T22:23:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.122+0000 7f53bffff700 1 -- 172.21.15.154:0/2409362830 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53c0015030 con 0x7f53c81371c0 2023-09-30T22:23:42.122 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.123+0000 7f53cdb25700 1 -- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53c81371c0 msgr2=0x7f53c806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.123+0000 7f53cdb25700 1 --2- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53c81371c0 0x7f53c806c330 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009b90 tx=0x7f53c0004750 comp rx=0 tx=0).stop 2023-09-30T22:23:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.124+0000 7f53cdb25700 1 -- 172.21.15.154:0/2409362830 shutdown_connections 2023-09-30T22:23:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.124+0000 7f53cdb25700 1 --2- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53c81371c0 0x7f53c806c330 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.124+0000 7f53cdb25700 1 --2- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53c809e870 0x7f53c806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.124+0000 7f53cdb25700 1 --2- 172.21.15.154:0/2409362830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53c809f350 0x7f53c806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.124+0000 7f53cdb25700 1 -- 172.21.15.154:0/2409362830 >> 172.21.15.154:0/2409362830 conn(0x7f53c80a4430 msgr2=0x7f53c80a2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.124+0000 7f53cdb25700 1 -- 172.21.15.154:0/2409362830 shutdown_connections 2023-09-30T22:23:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.124+0000 7f53cdb25700 1 -- 172.21.15.154:0/2409362830 wait complete. 2023-09-30T22:23:42.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:42.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.169+0000 7fa8a5979700 1 -- 172.21.15.154:0/518963785 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8a0072d60 con 0x7fa8a009e870 2023-09-30T22:23:42.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.170+0000 7fa887fff700 1 -- 172.21.15.154:0/518963785 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa890018260 con 0x7fa8a009e870 2023-09-30T22:23:42.169 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:42.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.172+0000 7fa8a5979700 1 -- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a009e870 msgr2=0x7fa8a011ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.172+0000 7fa8a5979700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a009e870 0x7fa8a011ead0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c4e0 tx=0x7fa89000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.172+0000 7fa8a5979700 1 -- 172.21.15.154:0/518963785 shutdown_connections 2023-09-30T22:23:42.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.172+0000 7fa8a5979700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8a0139480 0x7fa8a011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.172+0000 7fa8a5979700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8a009e870 0x7fa8a011ead0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.172+0000 7fa8a5979700 1 --2- 172.21.15.154:0/518963785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8a009f350 0x7fa8a011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.172+0000 7fa8a5979700 1 -- 172.21.15.154:0/518963785 >> 172.21.15.154:0/518963785 conn(0x7fa8a00a4430 msgr2=0x7fa8a00a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.172+0000 7fa8a5979700 1 -- 172.21.15.154:0/518963785 shutdown_connections 2023-09-30T22:23:42.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.172+0000 7fa8a5979700 1 -- 172.21.15.154:0/518963785 wait complete. 2023-09-30T22:23:42.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:42.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.215+0000 7fe72d1f0700 1 -- 172.21.15.154:0/2712123414 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe728121f20 con 0x7fe72809e870 2023-09-30T22:23:42.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.215+0000 7fe70f7fe700 1 -- 172.21.15.154:0/2712123414 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe728121f20 con 0x7fe72809e870 2023-09-30T22:23:42.215 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:42.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.217+0000 7fe72d1f0700 1 -- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe72809e870 msgr2=0x7fe72811ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.217+0000 7fe72d1f0700 1 --2- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe72809e870 0x7fe72811ead0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe71800c4e0 tx=0x7fe71800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.217+0000 7fe72d1f0700 1 -- 172.21.15.154:0/2712123414 shutdown_connections 2023-09-30T22:23:42.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.217+0000 7fe72d1f0700 1 --2- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe728139480 0x7fe72811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.217+0000 7fe72d1f0700 1 --2- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe72809e870 0x7fe72811ead0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.217+0000 7fe72d1f0700 1 --2- 172.21.15.154:0/2712123414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe72809f350 0x7fe72811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.217+0000 7fe72d1f0700 1 -- 172.21.15.154:0/2712123414 >> 172.21.15.154:0/2712123414 conn(0x7fe7280a4430 msgr2=0x7fe7280a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.217+0000 7fe72d1f0700 1 -- 172.21.15.154:0/2712123414 shutdown_connections 2023-09-30T22:23:42.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.217+0000 7fe72d1f0700 1 -- 172.21.15.154:0/2712123414 wait complete. 2023-09-30T22:23:42.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:42.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.507+0000 7ffae18ed700 1 Processor -- start 2023-09-30T22:23:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.507+0000 7ffae18ed700 1 -- start start 2023-09-30T22:23:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffae18ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc133ad0 0x7ffadc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffae18ed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 0x7ffadc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffae18ed700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffadc06b2d0 con 0x7ffadc1309f0 2023-09-30T22:23:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffae18ed700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc133610 con 0x7ffadc133ad0 2023-09-30T22:23:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffae18ed700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc09a500 con 0x7ffadc1300a0 2023-09-30T22:23:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffada7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 0x7ffadc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffadb7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ffadc1309f0 0x7ffadc13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37470/0 (socket says 172.21.15.154:37470) 2023-09-30T22:23:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffadb7fe700 1 -- 172.21.15.154:0/1076084332 learned_addr learned my addr 172.21.15.154:0/1076084332 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffadaffd700 1 --2- 172.21.15.154:0/1076084332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc133ad0 0x7ffadc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffadaffd700 1 -- 172.21.15.154:0/1076084332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 msgr2=0x7ffadc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffadaffd700 1 --2- 172.21.15.154:0/1076084332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 0x7ffadc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffadaffd700 1 -- 172.21.15.154:0/1076084332 >> v1:172.21.15.154:6789/0 conn(0x7ffadc1309f0 legacy=0x7ffadc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffad9ffb700 1 -- 172.21.15.154:0/1076084332 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197734415 0 0) 0x7ffadc06b2d0 con 0x7ffadc1309f0 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffadaffd700 1 -- 172.21.15.154:0/1076084332 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc1338b0 con 0x7ffadc133ad0 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffadaffd700 1 --2- 172.21.15.154:0/1076084332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc133ad0 0x7ffadc133ea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009870 tx=0x7ffad0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bf901c3a1e34402 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffad9ffb700 1 -- 172.21.15.154:0/1076084332 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0011830 con 0x7ffadc133ad0 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffad9ffb700 1 -- 172.21.15.154:0/1076084332 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad0011990 con 0x7ffadc133ad0 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.508+0000 7ffad9ffb700 1 -- 172.21.15.154:0/1076084332 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0011d20 con 0x7ffadc133ad0 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.509+0000 7ffae18ed700 1 -- 172.21.15.154:0/1076084332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc133ad0 msgr2=0x7ffadc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.509+0000 7ffae18ed700 1 --2- 172.21.15.154:0/1076084332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc133ad0 0x7ffadc133ea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009870 tx=0x7ffad0009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:42.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.509+0000 7ffae18ed700 1 -- 172.21.15.154:0/1076084332 shutdown_connections 2023-09-30T22:23:42.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.509+0000 7ffae18ed700 1 --2- 172.21.15.154:0/1076084332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc133ad0 0x7ffadc133ea0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.509+0000 7ffae18ed700 1 --2- 172.21.15.154:0/1076084332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 0x7ffadc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.509+0000 7ffae18ed700 1 -- 172.21.15.154:0/1076084332 >> 172.21.15.154:0/1076084332 conn(0x7ffadc099c40 msgr2=0x7ffadc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.509+0000 7ffae18ed700 1 -- 172.21.15.154:0/1076084332 shutdown_connections 2023-09-30T22:23:42.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.509+0000 7ffae18ed700 1 -- 172.21.15.154:0/1076084332 wait complete. 2023-09-30T22:23:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.510+0000 7ffae18ed700 1 Processor -- start 2023-09-30T22:23:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.510+0000 7ffae18ed700 1 -- start start 2023-09-30T22:23:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffae18ed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 0x7ffadc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffae18ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc1309f0 0x7ffadc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffae18ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffadc133ad0 0x7ffadc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffae18ed700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc120ad0 con 0x7ffadc133ad0 2023-09-30T22:23:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffae18ed700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc11fbe0 con 0x7ffadc1309f0 2023-09-30T22:23:42.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffae18ed700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc11f880 con 0x7ffadc1300a0 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffada7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc1309f0 0x7ffadc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffadb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffadc133ad0 0x7ffadc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffada7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc1309f0 0x7ffadc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59604/0 (socket says 172.21.15.154:59604) 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffada7fc700 1 -- 172.21.15.154:0/4126862099 learned_addr learned my addr 172.21.15.154:0/4126862099 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffadaffd700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 0x7ffadc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffadb7fe700 1 -- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 msgr2=0x7ffadc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffadb7fe700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 0x7ffadc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffadb7fe700 1 -- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc1309f0 msgr2=0x7ffadc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffadb7fe700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc1309f0 0x7ffadc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffadb7fe700 1 -- 172.21.15.154:0/4126862099 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00094a0 con 0x7ffadc133ad0 2023-09-30T22:23:42.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffadaffd700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 0x7ffadc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffada7fc700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc1309f0 0x7ffadc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffadb7fe700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffadc133ad0 0x7ffadc11e4c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ffad400cc10 tx=0x7ffad400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffac3fff700 1 -- 172.21.15.154:0/4126862099 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad400aa00 con 0x7ffadc133ad0 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffac3fff700 1 -- 172.21.15.154:0/4126862099 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad400ab80 con 0x7ffadc133ad0 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffae18ed700 1 -- 172.21.15.154:0/4126862099 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc0a3350 con 0x7ffadc133ad0 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffac3fff700 1 -- 172.21.15.154:0/4126862099 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad40070d0 con 0x7ffadc133ad0 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.511+0000 7ffae18ed700 1 -- 172.21.15.154:0/4126862099 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc11eb70 con 0x7ffadc133ad0 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.512+0000 7ffac3fff700 1 -- 172.21.15.154:0/4126862099 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffad4007230 con 0x7ffadc133ad0 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.512+0000 7ffac3fff700 1 -- 172.21.15.154:0/4126862099 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffad403f0c0 con 0x7ffadc133ad0 2023-09-30T22:23:42.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.512+0000 7ffae18ed700 1 -- 172.21.15.154:0/4126862099 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffadc04f2a0 con 0x7ffadc133ad0 2023-09-30T22:23:42.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.517+0000 7ffac3fff700 1 -- 172.21.15.154:0/4126862099 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffad4018020 con 0x7ffadc133ad0 2023-09-30T22:23:42.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.699+0000 7ffae18ed700 1 -- 172.21.15.154:0/4126862099 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffadc06c3b0 con 0x7ffadc133ad0 2023-09-30T22:23:42.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.699+0000 7ffac3fff700 1 -- 172.21.15.154:0/4126862099 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffad4019860 con 0x7ffadc133ad0 2023-09-30T22:23:42.699 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:42.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.701+0000 7ffae18ed700 1 -- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffadc133ad0 msgr2=0x7ffadc11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:42.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.701+0000 7ffae18ed700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffadc133ad0 0x7ffadc11e4c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ffad400cc10 tx=0x7ffad400cf20 comp rx=0 tx=0).stop 2023-09-30T22:23:42.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.701+0000 7ffae18ed700 1 -- 172.21.15.154:0/4126862099 shutdown_connections 2023-09-30T22:23:42.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.701+0000 7ffae18ed700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffadc133ad0 0x7ffadc11e4c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.701+0000 7ffae18ed700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffadc1300a0 0x7ffadc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.701+0000 7ffae18ed700 1 --2- 172.21.15.154:0/4126862099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffadc1309f0 0x7ffadc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:42.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.701+0000 7ffae18ed700 1 -- 172.21.15.154:0/4126862099 >> 172.21.15.154:0/4126862099 conn(0x7ffadc099c40 msgr2=0x7ffadc12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:42.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.701+0000 7ffae18ed700 1 -- 172.21.15.154:0/4126862099 shutdown_connections 2023-09-30T22:23:42.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:42.701+0000 7ffae18ed700 1 -- 172.21.15.154:0/4126862099 wait complete. 2023-09-30T22:23:42.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:43.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:43.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:43.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:43.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.269+0000 7f4d4b821700 1 Processor -- start 2023-09-30T22:23:43.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.269+0000 7f4d4b821700 1 -- start start 2023-09-30T22:23:43.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.269+0000 7f4d4b821700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d4409d860 0x7f4d4409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.269+0000 7f4d4b821700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d4409e170 0x7f4d441307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.269+0000 7f4d4b821700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4409aaa0 con 0x7f4d44130ce0 2023-09-30T22:23:43.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d4b821700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4409f870 con 0x7f4d4409d860 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d4b821700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4409b360 con 0x7f4d4409e170 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d48dbc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d4409e170 0x7f4d441307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d495bd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d4409d860 0x7f4d4409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d48dbc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d4409e170 0x7f4d441307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52492/0 (socket says 172.21.15.154:52492) 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d495bd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d4409d860 0x7f4d4409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48214/0 (socket says 172.21.15.154:48214) 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d48dbc700 1 -- 172.21.15.154:0/3437660041 learned_addr learned my addr 172.21.15.154:0/3437660041 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d495bd700 1 -- 172.21.15.154:0/3437660041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d4409e170 msgr2=0x7f4d441307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d495bd700 1 --2- 172.21.15.154:0/3437660041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d4409e170 0x7f4d441307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d495bd700 1 -- 172.21.15.154:0/3437660041 >> v1:172.21.15.154:6789/0 conn(0x7f4d44130ce0 legacy=0x7f4d441379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d495bd700 1 -- 172.21.15.154:0/3437660041 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4409b620 con 0x7f4d4409d860 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d48dbc700 1 --2- 172.21.15.154:0/3437660041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d4409e170 0x7f4d441307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:43.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d495bd700 1 --2- 172.21.15.154:0/3437660041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409d860 0x7f4d4409dc30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009840 tx=0x7f4d40009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c532cd7c0399d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d3bfff700 1 -- 172.21.15.154:0/3437660041 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000f8a0 con 0x7f4d4409d860 2023-09-30T22:23:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d3bfff700 1 -- 172.21.15.154:0/3437660041 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4000fa00 con 0x7f4d4409d860 2023-09-30T22:23:43.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.270+0000 7f4d3bfff700 1 -- 172.21.15.154:0/3437660041 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000fd90 con 0x7f4d4409d860 2023-09-30T22:23:43.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.271+0000 7f4d4b821700 1 -- 172.21.15.154:0/3437660041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409d860 msgr2=0x7f4d4409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.271+0000 7f4d4b821700 1 --2- 172.21.15.154:0/3437660041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409d860 0x7f4d4409dc30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009840 tx=0x7f4d40009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.271+0000 7f4d4b821700 1 -- 172.21.15.154:0/3437660041 shutdown_connections 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.271+0000 7f4d4b821700 1 --2- 172.21.15.154:0/3437660041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409d860 0x7f4d4409dc30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.271+0000 7f4d4b821700 1 --2- 172.21.15.154:0/3437660041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d4409e170 0x7f4d441307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.271+0000 7f4d4b821700 1 -- 172.21.15.154:0/3437660041 >> 172.21.15.154:0/3437660041 conn(0x7f4d44099c40 msgr2=0x7f4d440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.271+0000 7f4d4b821700 1 -- 172.21.15.154:0/3437660041 shutdown_connections 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.271+0000 7f4d4b821700 1 -- 172.21.15.154:0/3437660041 wait complete. 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.272+0000 7f4d4b821700 1 Processor -- start 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.272+0000 7f4d4b821700 1 -- start start 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d4b821700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4409d860 0x7f4d4411e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d4b821700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409e170 0x7f4d4411eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d4b821700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d44130ce0 0x7f4d4411f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d4b821700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44120260 con 0x7f4d4409e170 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d4b821700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44121df0 con 0x7f4d4409d860 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d4b821700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44120770 con 0x7f4d44130ce0 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d495bd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4409d860 0x7f4d4411e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d495bd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4409d860 0x7f4d4411e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59616/0 (socket says 172.21.15.154:59616) 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d495bd700 1 -- 172.21.15.154:0/1261773093 learned_addr learned my addr 172.21.15.154:0/1261773093 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d48dbc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409e170 0x7f4d4411eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d49dbe700 1 --2- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d44130ce0 0x7f4d4411f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d48dbc700 1 -- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d44130ce0 msgr2=0x7f4d4411f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d48dbc700 1 --2- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d44130ce0 0x7f4d4411f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d48dbc700 1 -- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4409d860 msgr2=0x7f4d4411e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d48dbc700 1 --2- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4409d860 0x7f4d4411e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d48dbc700 1 -- 172.21.15.154:0/1261773093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d34009550 con 0x7f4d4409e170 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d495bd700 1 --2- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4409d860 0x7f4d4411e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d48dbc700 1 --2- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409e170 0x7f4d4411eaf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400e9a0 tx=0x7f4d3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d39ffb700 1 -- 172.21.15.154:0/1261773093 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34004030 con 0x7f4d4409e170 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d39ffb700 1 -- 172.21.15.154:0/1261773093 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34004190 con 0x7f4d4409e170 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d39ffb700 1 -- 172.21.15.154:0/1261773093 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34004520 con 0x7f4d4409e170 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.273+0000 7f4d4b821700 1 -- 172.21.15.154:0/1261773093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d400094a0 con 0x7f4d4409e170 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.274+0000 7f4d4b821700 1 -- 172.21.15.154:0/1261773093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4409c8b0 con 0x7f4d4409e170 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.274+0000 7f4d39ffb700 1 -- 172.21.15.154:0/1261773093 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d340036a0 con 0x7f4d4409e170 2023-09-30T22:23:43.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.275+0000 7f4d39ffb700 1 -- 172.21.15.154:0/1261773093 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d340421c0 con 0x7f4d4409e170 2023-09-30T22:23:43.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.275+0000 7f4d4b821700 1 -- 172.21.15.154:0/1261773093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4404f2a0 con 0x7f4d4409e170 2023-09-30T22:23:43.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.279+0000 7f4d39ffb700 1 -- 172.21.15.154:0/1261773093 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d34044060 con 0x7f4d4409e170 2023-09-30T22:23:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.317+0000 7f7dddf07700 1 Processor -- start 2023-09-30T22:23:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dddf07700 1 -- start start 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dddf07700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8133900 0x7f7dd8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dddf07700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dd8134210 0x7f7dd80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dddf07700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd809a760 con 0x7f7dd80a0ee0 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dddf07700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd81336e0 con 0x7f7dd8134210 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dddf07700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd809a080 con 0x7f7dd8133900 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dd6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dd8134210 0x7f7dd80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dd6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dd8134210 0x7f7dd80a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48234/0 (socket says 172.21.15.154:48234) 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dd6ffd700 1 -- 172.21.15.154:0/456098514 learned_addr learned my addr 172.21.15.154:0/456098514 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.318+0000 7f7dd77fe700 1 --2- 172.21.15.154:0/456098514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8133900 0x7f7dd8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd77fe700 1 -- 172.21.15.154:0/456098514 >> v2:172.21.15.154:3300/0 conn(0x7f7dd8134210 msgr2=0x7f7dd80a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd77fe700 1 --2- 172.21.15.154:0/456098514 >> v2:172.21.15.154:3300/0 conn(0x7f7dd8134210 0x7f7dd80a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd77fe700 1 -- 172.21.15.154:0/456098514 >> v1:172.21.15.154:6789/0 conn(0x7f7dd80a0ee0 legacy=0x7f7dd813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd67fc700 1 -- 172.21.15.154:0/456098514 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117861445 0 0) 0x7f7dd809a760 con 0x7f7dd80a0ee0 2023-09-30T22:23:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd77fe700 1 -- 172.21.15.154:0/456098514 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80a23e0 con 0x7f7dd8133900 2023-09-30T22:23:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd6ffd700 1 --2- 172.21.15.154:0/456098514 >> v2:172.21.15.154:3300/0 conn(0x7f7dd8134210 0x7f7dd80a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd77fe700 1 --2- 172.21.15.154:0/456098514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8133900 0x7f7dd8133cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009820 tx=0x7f7dc8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb6e67548ccddf8e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd67fc700 1 -- 172.21.15.154:0/456098514 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8005e30 con 0x7f7dd8133900 2023-09-30T22:23:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd67fc700 1 -- 172.21.15.154:0/456098514 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8006030 con 0x7f7dd8133900 2023-09-30T22:23:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dd67fc700 1 -- 172.21.15.154:0/456098514 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80063c0 con 0x7f7dd8133900 2023-09-30T22:23:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dddf07700 1 -- 172.21.15.154:0/456098514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8133900 msgr2=0x7f7dd8133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.319+0000 7f7dddf07700 1 --2- 172.21.15.154:0/456098514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8133900 0x7f7dd8133cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009820 tx=0x7f7dc8009b30 comp rx=0 tx=0).stop 2023-09-30T22:23:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.320+0000 7f7dddf07700 1 -- 172.21.15.154:0/456098514 shutdown_connections 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.320+0000 7f7dddf07700 1 --2- 172.21.15.154:0/456098514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8133900 0x7f7dd8133cd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.320+0000 7f7dddf07700 1 --2- 172.21.15.154:0/456098514 >> v2:172.21.15.154:3300/0 conn(0x7f7dd8134210 0x7f7dd80a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.320+0000 7f7dddf07700 1 -- 172.21.15.154:0/456098514 >> 172.21.15.154:0/456098514 conn(0x7f7dd80a2980 msgr2=0x7f7dd80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.320+0000 7f7dddf07700 1 -- 172.21.15.154:0/456098514 shutdown_connections 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.320+0000 7f7dddf07700 1 -- 172.21.15.154:0/456098514 wait complete. 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.321+0000 7f7dddf07700 1 Processor -- start 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.321+0000 7f7dddf07700 1 -- start start 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dddf07700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd80a0ee0 0x7f7dd811d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dddf07700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd8133900 0x7f7dd811dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dddf07700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8134210 0x7f7dd811e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dddf07700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd811ecc0 con 0x7f7dd80a0ee0 2023-09-30T22:23:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dddf07700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd811f380 con 0x7f7dd8134210 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dddf07700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd811f9a0 con 0x7f7dd8133900 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd80a0ee0 0x7f7dd811d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8134210 0x7f7dd811e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd80a0ee0 0x7f7dd811d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48240/0 (socket says 172.21.15.154:48240) 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd77fe700 1 -- 172.21.15.154:0/1066591680 learned_addr learned my addr 172.21.15.154:0/1066591680 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd7fff700 1 -- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd8133900 msgr2=0x7f7dd811dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd7fff700 1 --2- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd8133900 0x7f7dd811dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd7fff700 1 -- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd80a0ee0 msgr2=0x7f7dd811d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd7fff700 1 --2- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd80a0ee0 0x7f7dd811d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd7fff700 1 -- 172.21.15.154:0/1066591680 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc009550 con 0x7f7dd8134210 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd77fe700 1 --2- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd80a0ee0 0x7f7dd811d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dd7fff700 1 --2- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8134210 0x7f7dd811e290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000c7c0 tx=0x7f7dd000cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:43.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.322+0000 7f7dbffff700 1 -- 172.21.15.154:0/1066591680 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0003e30 con 0x7f7dd8134210 2023-09-30T22:23:43.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.323+0000 7f7dbffff700 1 -- 172.21.15.154:0/1066591680 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0005070 con 0x7f7dd8134210 2023-09-30T22:23:43.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.323+0000 7f7dbffff700 1 -- 172.21.15.154:0/1066591680 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0005420 con 0x7f7dd8134210 2023-09-30T22:23:43.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.323+0000 7f7dddf07700 1 -- 172.21.15.154:0/1066591680 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc8009430 con 0x7f7dd8134210 2023-09-30T22:23:43.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.323+0000 7f7dddf07700 1 -- 172.21.15.154:0/1066591680 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd8132a70 con 0x7f7dd8134210 2023-09-30T22:23:43.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.324+0000 7f7dbffff700 1 -- 172.21.15.154:0/1066591680 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dd0005580 con 0x7f7dd8134210 2023-09-30T22:23:43.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.324+0000 7f7dbffff700 1 -- 172.21.15.154:0/1066591680 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7dd003ed00 con 0x7f7dd8134210 2023-09-30T22:23:43.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.324+0000 7f7dddf07700 1 -- 172.21.15.154:0/1066591680 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd811a590 con 0x7f7dd8134210 2023-09-30T22:23:43.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.332+0000 7f7dbffff700 1 -- 172.21.15.154:0/1066591680 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dd0017070 con 0x7f7dd8134210 2023-09-30T22:23:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.364+0000 7fecdef69700 1 Processor -- start 2023-09-30T22:23:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.364+0000 7fecdef69700 1 -- start start 2023-09-30T22:23:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecdef69700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecd80a1550 0x7fecd8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecdef69700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 0x7fecd813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecdef69700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd809e9d0 con 0x7fecd80a0a70 2023-09-30T22:23:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecdef69700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd809dc00 con 0x7fecd80a1550 2023-09-30T22:23:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecdef69700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd809dec0 con 0x7fecd8139200 2023-09-30T22:23:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecd7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecd80a1550 0x7fecd8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecdd506700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 0x7fecd813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecd7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecd80a1550 0x7fecd8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48244/0 (socket says 172.21.15.154:48244) 2023-09-30T22:23:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecdd506700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 0x7fecd813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52532/0 (socket says 172.21.15.154:52532) 2023-09-30T22:23:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecd7fff700 1 -- 172.21.15.154:0/1007549477 learned_addr learned my addr 172.21.15.154:0/1007549477 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:43.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecd7fff700 1 -- 172.21.15.154:0/1007549477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 msgr2=0x7fecd813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:43.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecd7fff700 1 --2- 172.21.15.154:0/1007549477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 0x7fecd813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecd7fff700 1 -- 172.21.15.154:0/1007549477 >> v1:172.21.15.154:6789/0 conn(0x7fecd80a0a70 legacy=0x7fecd80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecd7fff700 1 -- 172.21.15.154:0/1007549477 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd809e6a0 con 0x7fecd80a1550 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecd7fff700 1 --2- 172.21.15.154:0/1007549477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a1550 0x7fecd8138cc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fecc40098f0 tx=0x7fecc4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ee8725ee1ee29b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.365+0000 7fecd77fe700 1 -- 172.21.15.154:0/1007549477 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4011830 con 0x7fecd80a1550 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecd77fe700 1 -- 172.21.15.154:0/1007549477 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4011990 con 0x7fecd80a1550 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecd77fe700 1 -- 172.21.15.154:0/1007549477 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4011d20 con 0x7fecd80a1550 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecdef69700 1 -- 172.21.15.154:0/1007549477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a1550 msgr2=0x7fecd8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecdef69700 1 --2- 172.21.15.154:0/1007549477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a1550 0x7fecd8138cc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fecc40098f0 tx=0x7fecc4009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecdef69700 1 -- 172.21.15.154:0/1007549477 shutdown_connections 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecdef69700 1 --2- 172.21.15.154:0/1007549477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 0x7fecd813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecdef69700 1 --2- 172.21.15.154:0/1007549477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a1550 0x7fecd8138cc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecdef69700 1 -- 172.21.15.154:0/1007549477 >> 172.21.15.154:0/1007549477 conn(0x7fecd80a6610 msgr2=0x7fecd80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecdef69700 1 -- 172.21.15.154:0/1007549477 shutdown_connections 2023-09-30T22:23:43.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.366+0000 7fecdef69700 1 -- 172.21.15.154:0/1007549477 wait complete. 2023-09-30T22:23:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.367+0000 7fecdef69700 1 Processor -- start 2023-09-30T22:23:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.367+0000 7fecdef69700 1 -- start start 2023-09-30T22:23:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdef69700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a0a70 0x7fecd811e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdef69700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecd80a1550 0x7fecd811edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdef69700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 0x7fecd811f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdef69700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80a52b0 con 0x7fecd80a0a70 2023-09-30T22:23:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdef69700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd81205b0 con 0x7fecd80a1550 2023-09-30T22:23:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdef69700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80a03e0 con 0x7fecd8139200 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdcd05700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a0a70 0x7fecd811e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdcd05700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a0a70 0x7fecd811e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48250/0 (socket says 172.21.15.154:48250) 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdcd05700 1 -- 172.21.15.154:0/1470621665 learned_addr learned my addr 172.21.15.154:0/1470621665 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecd7fff700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecd80a1550 0x7fecd811edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdd506700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 0x7fecd811f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdcd05700 1 -- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 msgr2=0x7fecd811f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdcd05700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 0x7fecd811f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdcd05700 1 -- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecd80a1550 msgr2=0x7fecd811edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdcd05700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecd80a1550 0x7fecd811edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdcd05700 1 -- 172.21.15.154:0/1470621665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4009550 con 0x7fecd80a0a70 2023-09-30T22:23:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecd7fff700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecd80a1550 0x7fecd811edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.368+0000 7fecdcd05700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a0a70 0x7fecd811e890 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c4e0 tx=0x7feccc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.369+0000 7fecd57fa700 1 -- 172.21.15.154:0/1470621665 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0052d0 con 0x7fecd80a0a70 2023-09-30T22:23:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.369+0000 7fecd57fa700 1 -- 172.21.15.154:0/1470621665 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc005430 con 0x7fecd80a0a70 2023-09-30T22:23:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.369+0000 7fecdef69700 1 -- 172.21.15.154:0/1470621665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd81220d0 con 0x7fecd80a0a70 2023-09-30T22:23:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.369+0000 7fecd57fa700 1 -- 172.21.15.154:0/1470621665 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0038c0 con 0x7fecd80a0a70 2023-09-30T22:23:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.369+0000 7fecdef69700 1 -- 172.21.15.154:0/1470621665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd8122b40 con 0x7fecd80a0a70 2023-09-30T22:23:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.370+0000 7fecd57fa700 1 -- 172.21.15.154:0/1470621665 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feccc003a20 con 0x7fecd80a0a70 2023-09-30T22:23:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.370+0000 7fecdef69700 1 -- 172.21.15.154:0/1470621665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd8121f10 con 0x7fecd80a0a70 2023-09-30T22:23:43.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.370+0000 7fecd57fa700 1 -- 172.21.15.154:0/1470621665 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feccc03eb50 con 0x7fecd80a0a70 2023-09-30T22:23:43.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.378+0000 7fecd57fa700 1 -- 172.21.15.154:0/1470621665 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feccc018260 con 0x7fecd80a0a70 2023-09-30T22:23:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.480+0000 7f4d4b821700 1 -- 172.21.15.154:0/1261773093 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4d4406c3b0 con 0x7f4d4409e170 2023-09-30T22:23:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.480+0000 7f4d39ffb700 1 -- 172.21.15.154:0/1261773093 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d34019d60 con 0x7f4d4409e170 2023-09-30T22:23:43.480 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.482+0000 7f4d4b821700 1 -- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409e170 msgr2=0x7f4d4411eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.482+0000 7f4d4b821700 1 --2- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409e170 0x7f4d4411eaf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400e9a0 tx=0x7f4d3400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.482+0000 7f4d4b821700 1 -- 172.21.15.154:0/1261773093 shutdown_connections 2023-09-30T22:23:43.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.482+0000 7f4d4b821700 1 --2- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d44130ce0 0x7f4d4411f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.482+0000 7f4d4b821700 1 --2- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4409d860 0x7f4d4411e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.482+0000 7f4d4b821700 1 --2- 172.21.15.154:0/1261773093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4409e170 0x7f4d4411eaf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.482+0000 7f4d4b821700 1 -- 172.21.15.154:0/1261773093 >> 172.21.15.154:0/1261773093 conn(0x7f4d44099c40 msgr2=0x7f4d44070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:43.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.482+0000 7f4d4b821700 1 -- 172.21.15.154:0/1261773093 shutdown_connections 2023-09-30T22:23:43.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.482+0000 7f4d4b821700 1 -- 172.21.15.154:0/1261773093 wait complete. 2023-09-30T22:23:43.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:43.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.527+0000 7f7dddf07700 1 -- 172.21.15.154:0/1066591680 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7dd809a2c0 con 0x7f7dd8134210 2023-09-30T22:23:43.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.527+0000 7f7dbffff700 1 -- 172.21.15.154:0/1066591680 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7dd000ad40 con 0x7f7dd8134210 2023-09-30T22:23:43.527 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.529+0000 7f7dddf07700 1 -- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8134210 msgr2=0x7f7dd811e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.529+0000 7f7dddf07700 1 --2- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8134210 0x7f7dd811e290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000c7c0 tx=0x7f7dd000cad0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.529+0000 7f7dddf07700 1 -- 172.21.15.154:0/1066591680 shutdown_connections 2023-09-30T22:23:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.529+0000 7f7dddf07700 1 --2- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd8134210 0x7f7dd811e290 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.529+0000 7f7dddf07700 1 --2- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd80a0ee0 0x7f7dd811d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.529+0000 7f7dddf07700 1 --2- 172.21.15.154:0/1066591680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd8133900 0x7f7dd811dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.529+0000 7f7dddf07700 1 -- 172.21.15.154:0/1066591680 >> 172.21.15.154:0/1066591680 conn(0x7f7dd80a2980 msgr2=0x7f7dd81bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.529+0000 7f7dddf07700 1 -- 172.21.15.154:0/1066591680 shutdown_connections 2023-09-30T22:23:43.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.529+0000 7f7dddf07700 1 -- 172.21.15.154:0/1066591680 wait complete. 2023-09-30T22:23:43.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:43.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.573+0000 7fecdef69700 1 -- 172.21.15.154:0/1470621665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fecd8121d70 con 0x7fecd80a0a70 2023-09-30T22:23:43.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.573+0000 7fecd57fa700 1 -- 172.21.15.154:0/1470621665 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecd8121d70 con 0x7fecd80a0a70 2023-09-30T22:23:43.573 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.575+0000 7fecdef69700 1 -- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a0a70 msgr2=0x7fecd811e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.575+0000 7fecdef69700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a0a70 0x7fecd811e890 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c4e0 tx=0x7feccc00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.576+0000 7fecdef69700 1 -- 172.21.15.154:0/1470621665 shutdown_connections 2023-09-30T22:23:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.576+0000 7fecdef69700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecd8139200 0x7fecd811f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.576+0000 7fecdef69700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80a0a70 0x7fecd811e890 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.576+0000 7fecdef69700 1 --2- 172.21.15.154:0/1470621665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecd80a1550 0x7fecd811edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.576+0000 7fecdef69700 1 -- 172.21.15.154:0/1470621665 >> 172.21.15.154:0/1470621665 conn(0x7fecd80a6610 msgr2=0x7fecd8136d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.576+0000 7fecdef69700 1 -- 172.21.15.154:0/1470621665 shutdown_connections 2023-09-30T22:23:43.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.576+0000 7fecdef69700 1 -- 172.21.15.154:0/1470621665 wait complete. 2023-09-30T22:23:43.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:43.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:43.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd68911700 1 Processor -- start 2023-09-30T22:23:43.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd68911700 1 -- start start 2023-09-30T22:23:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd68911700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd68911700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd64139280 0x7fdd6413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd68911700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6406b2d0 con 0x7fdd64133ad0 2023-09-30T22:23:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd68911700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd641345b0 con 0x7fdd64139280 2023-09-30T22:23:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd68911700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64133610 con 0x7fdd64136960 2023-09-30T22:23:43.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd62d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd64139280 0x7fdd6413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd61d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd62d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd64139280 0x7fdd6413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48266/0 (socket says 172.21.15.154:48266) 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd61d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59662/0 (socket says 172.21.15.154:59662) 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.837+0000 7fdd62d9d700 1 -- 172.21.15.154:0/1050168826 learned_addr learned my addr 172.21.15.154:0/1050168826 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd61d9b700 1 -- 172.21.15.154:0/1050168826 >> v2:172.21.15.154:3300/0 conn(0x7fdd64139280 msgr2=0x7fdd6413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd61d9b700 1 --2- 172.21.15.154:0/1050168826 >> v2:172.21.15.154:3300/0 conn(0x7fdd64139280 0x7fdd6413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd61d9b700 1 -- 172.21.15.154:0/1050168826 >> v1:172.21.15.154:6789/0 conn(0x7fdd64133ad0 legacy=0x7fdd64133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd61d9b700 1 -- 172.21.15.154:0/1050168826 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6409a500 con 0x7fdd64136960 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd6159a700 1 -- 172.21.15.154:0/1050168826 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61236416 0 0) 0x7fdd6406b2d0 con 0x7fdd64133ad0 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd62d9d700 1 --2- 172.21.15.154:0/1050168826 >> v2:172.21.15.154:3300/0 conn(0x7fdd64139280 0x7fdd6413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd61d9b700 1 --2- 172.21.15.154:0/1050168826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64138d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009870 tx=0x7fdd58009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1f054b62ad50671 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd6159a700 1 -- 172.21.15.154:0/1050168826 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58011830 con 0x7fdd64136960 2023-09-30T22:23:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd6159a700 1 -- 172.21.15.154:0/1050168826 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58011990 con 0x7fdd64136960 2023-09-30T22:23:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.838+0000 7fdd6159a700 1 -- 172.21.15.154:0/1050168826 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58011d20 con 0x7fdd64136960 2023-09-30T22:23:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.839+0000 7fdd68911700 1 -- 172.21.15.154:0/1050168826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 msgr2=0x7fdd64138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.839+0000 7fdd68911700 1 --2- 172.21.15.154:0/1050168826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64138d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009870 tx=0x7fdd58009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.839+0000 7fdd68911700 1 -- 172.21.15.154:0/1050168826 shutdown_connections 2023-09-30T22:23:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.839+0000 7fdd68911700 1 --2- 172.21.15.154:0/1050168826 >> v2:172.21.15.154:3300/0 conn(0x7fdd64139280 0x7fdd6413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.839+0000 7fdd68911700 1 --2- 172.21.15.154:0/1050168826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64138d40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.839+0000 7fdd68911700 1 -- 172.21.15.154:0/1050168826 >> 172.21.15.154:0/1050168826 conn(0x7fdd64099c40 msgr2=0x7fdd640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.839+0000 7fdd68911700 1 -- 172.21.15.154:0/1050168826 shutdown_connections 2023-09-30T22:23:43.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.839+0000 7fdd68911700 1 -- 172.21.15.154:0/1050168826 wait complete. 2023-09-30T22:23:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd68911700 1 Processor -- start 2023-09-30T22:23:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd68911700 1 -- start start 2023-09-30T22:23:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd68911700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd64133ad0 0x7fdd64071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd68911700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd68911700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd64139280 0x7fdd641c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd68911700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64070040 con 0x7fdd64133ad0 2023-09-30T22:23:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd68911700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64130b10 con 0x7fdd64136960 2023-09-30T22:23:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd68911700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6409f390 con 0x7fdd64139280 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd62d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd64139280 0x7fdd641c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd6259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd64133ad0 0x7fdd64071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd61d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd62d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd64139280 0x7fdd641c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52546/0 (socket says 172.21.15.154:52546) 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd62d9d700 1 -- 172.21.15.154:0/3902517338 learned_addr learned my addr 172.21.15.154:0/3902517338 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.840+0000 7fdd6259c700 1 --2- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd64133ad0 0x7fdd64071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48278/0 (socket says 172.21.15.154:48278) 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd6259c700 1 -- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd64139280 msgr2=0x7fdd641c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd6259c700 1 --2- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd64139280 0x7fdd641c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd6259c700 1 -- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 msgr2=0x7fdd64071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd6259c700 1 --2- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd6259c700 1 -- 172.21.15.154:0/3902517338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c009b30 con 0x7fdd64133ad0 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd61d9b700 1 --2- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd6259c700 1 --2- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd64133ad0 0x7fdd64071770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdd54000f60 tx=0x7fdd5400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3902517338 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540052d0 con 0x7fdd64133ad0 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3902517338 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd54005450 con 0x7fdd64133ad0 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd68911700 1 -- 172.21.15.154:0/3902517338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd580094a0 con 0x7fdd64133ad0 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3902517338 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540038c0 con 0x7fdd64133ad0 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.841+0000 7fdd68911700 1 -- 172.21.15.154:0/3902517338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd640721f0 con 0x7fdd64133ad0 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.842+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3902517338 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd54003a20 con 0x7fdd64133ad0 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.842+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3902517338 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdd5403e990 con 0x7fdd64133ad0 2023-09-30T22:23:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.842+0000 7fdd68911700 1 -- 172.21.15.154:0/3902517338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6404f2a0 con 0x7fdd64133ad0 2023-09-30T22:23:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:43.847+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3902517338 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd54017070 con 0x7fdd64133ad0 2023-09-30T22:23:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.031+0000 7fdd68911700 1 -- 172.21.15.154:0/3902517338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdd6409f0f0 con 0x7fdd64133ad0 2023-09-30T22:23:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.031+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3902517338 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd54019cd0 con 0x7fdd64133ad0 2023-09-30T22:23:44.031 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:44.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.033+0000 7fdd68911700 1 -- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd64133ad0 msgr2=0x7fdd64071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.033+0000 7fdd68911700 1 --2- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd64133ad0 0x7fdd64071770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdd54000f60 tx=0x7fdd5400c6a0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.033+0000 7fdd68911700 1 -- 172.21.15.154:0/3902517338 shutdown_connections 2023-09-30T22:23:44.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.033+0000 7fdd68911700 1 --2- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd64139280 0x7fdd641c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.033+0000 7fdd68911700 1 --2- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd64133ad0 0x7fdd64071770 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.033+0000 7fdd68911700 1 --2- 172.21.15.154:0/3902517338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd64136960 0x7fdd64071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.033+0000 7fdd68911700 1 -- 172.21.15.154:0/3902517338 >> 172.21.15.154:0/3902517338 conn(0x7fdd64099c40 msgr2=0x7fdd641371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.034+0000 7fdd68911700 1 -- 172.21.15.154:0/3902517338 shutdown_connections 2023-09-30T22:23:44.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.034+0000 7fdd68911700 1 -- 172.21.15.154:0/3902517338 wait complete. 2023-09-30T22:23:44.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:44.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:44.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:44.589 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:44.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.625+0000 7fe5f7822700 1 Processor -- start 2023-09-30T22:23:44.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.625+0000 7fe5f7822700 1 -- start start 2023-09-30T22:23:44.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.625+0000 7fe5f7822700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0133660 0x7fe5f0135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.625+0000 7fe5f7822700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5f0135f80 0x7fe5f0138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.625+0000 7fe5f7822700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f0099a60 con 0x7fe5f0099e20 2023-09-30T22:23:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.625+0000 7fe5f7822700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f009bf50 con 0x7fe5f0135f80 2023-09-30T22:23:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.625+0000 7fe5f7822700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f009b230 con 0x7fe5f0133660 2023-09-30T22:23:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f4dbd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0133660 0x7fe5f0135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f55be700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe5f0099e20 0x7fe5f009a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37510/0 (socket says 172.21.15.154:37510) 2023-09-30T22:23:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f55be700 1 -- 172.21.15.154:0/3604474226 learned_addr learned my addr 172.21.15.154:0/3604474226 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f5dbf700 1 --2- 172.21.15.154:0/3604474226 >> v2:172.21.15.154:3300/0 conn(0x7fe5f0135f80 0x7fe5f0138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5e7fff700 1 -- 172.21.15.154:0/3604474226 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474344168 0 0) 0x7fe5f0099a60 con 0x7fe5f0099e20 2023-09-30T22:23:44.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5e7fff700 1 -- 172.21.15.154:0/3604474226 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5dc0035b0 con 0x7fe5f0099e20 2023-09-30T22:23:44.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f4dbd700 1 -- 172.21.15.154:0/3604474226 >> v2:172.21.15.154:3300/0 conn(0x7fe5f0135f80 msgr2=0x7fe5f0138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:44.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f4dbd700 1 --2- 172.21.15.154:0/3604474226 >> v2:172.21.15.154:3300/0 conn(0x7fe5f0135f80 0x7fe5f0138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f4dbd700 1 -- 172.21.15.154:0/3604474226 >> v1:172.21.15.154:6789/0 conn(0x7fe5f0099e20 legacy=0x7fe5f009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f4dbd700 1 -- 172.21.15.154:0/3604474226 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f009bb90 con 0x7fe5f0133660 2023-09-30T22:23:44.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f5dbf700 1 --2- 172.21.15.154:0/3604474226 >> v2:172.21.15.154:3300/0 conn(0x7fe5f0135f80 0x7fe5f0138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5f4dbd700 1 --2- 172.21.15.154:0/3604474226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0133660 0x7fe5f0135a40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009870 tx=0x7fe5e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c35d3b932e98be6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5e7fff700 1 -- 172.21.15.154:0/3604474226 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0010880 con 0x7fe5f0133660 2023-09-30T22:23:44.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5e7fff700 1 -- 172.21.15.154:0/3604474226 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e00109e0 con 0x7fe5f0133660 2023-09-30T22:23:44.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.626+0000 7fe5e7fff700 1 -- 172.21.15.154:0/3604474226 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0010d70 con 0x7fe5f0133660 2023-09-30T22:23:44.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.627+0000 7fe5f7822700 1 -- 172.21.15.154:0/3604474226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0133660 msgr2=0x7fe5f0135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.627+0000 7fe5f7822700 1 --2- 172.21.15.154:0/3604474226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0133660 0x7fe5f0135a40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009870 tx=0x7fe5e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:44.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.627+0000 7fe5f7822700 1 -- 172.21.15.154:0/3604474226 shutdown_connections 2023-09-30T22:23:44.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.627+0000 7fe5f7822700 1 --2- 172.21.15.154:0/3604474226 >> v2:172.21.15.154:3300/0 conn(0x7fe5f0135f80 0x7fe5f0138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.627+0000 7fe5f7822700 1 --2- 172.21.15.154:0/3604474226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0133660 0x7fe5f0135a40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.627+0000 7fe5f7822700 1 -- 172.21.15.154:0/3604474226 >> 172.21.15.154:0/3604474226 conn(0x7fe5f00a2980 msgr2=0x7fe5f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.627+0000 7fe5f7822700 1 -- 172.21.15.154:0/3604474226 shutdown_connections 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.627+0000 7fe5f7822700 1 -- 172.21.15.154:0/3604474226 wait complete. 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.628+0000 7fe5f7822700 1 Processor -- start 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.628+0000 7fe5f7822700 1 -- start start 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f7822700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0099e20 0x7fe5f0070230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f7822700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f0133660 0x7fe5f0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f7822700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f0135f80 0x7fe5f0070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f7822700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0119cb0 con 0x7fe5f0135f80 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f7822700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0119230 con 0x7fe5f0133660 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f7822700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0133ac0 con 0x7fe5f0099e20 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f55be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0099e20 0x7fe5f0070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f55be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0099e20 0x7fe5f0070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52578/0 (socket says 172.21.15.154:52578) 2023-09-30T22:23:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f55be700 1 -- 172.21.15.154:0/3368896049 learned_addr learned my addr 172.21.15.154:0/3368896049 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f4dbd700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f0133660 0x7fe5f0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f5dbf700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f0135f80 0x7fe5f0070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f55be700 1 -- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f0133660 msgr2=0x7fe5f0070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f55be700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f0133660 0x7fe5f0070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f55be700 1 -- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f0135f80 msgr2=0x7fe5f0070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f55be700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f0135f80 0x7fe5f0070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f55be700 1 -- 172.21.15.154:0/3368896049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8009a70 con 0x7fe5f0099e20 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f4dbd700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f0133660 0x7fe5f0070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f55be700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0099e20 0x7fe5f0070230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec001260 tx=0x7fe5ec00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5e5ffb700 1 -- 172.21.15.154:0/3368896049 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0074e0 con 0x7fe5f0099e20 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5e5ffb700 1 -- 172.21.15.154:0/3368896049 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec007640 con 0x7fe5f0099e20 2023-09-30T22:23:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5e5ffb700 1 -- 172.21.15.154:0/3368896049 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec005a50 con 0x7fe5f0099e20 2023-09-30T22:23:44.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.629+0000 7fe5f7822700 1 -- 172.21.15.154:0/3368896049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e00094a0 con 0x7fe5f0099e20 2023-09-30T22:23:44.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.630+0000 7fe5f7822700 1 -- 172.21.15.154:0/3368896049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f011a620 con 0x7fe5f0099e20 2023-09-30T22:23:44.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.631+0000 7fe5e5ffb700 1 -- 172.21.15.154:0/3368896049 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5ec005bb0 con 0x7fe5f0099e20 2023-09-30T22:23:44.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.631+0000 7fe5f7822700 1 -- 172.21.15.154:0/3368896049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f0131440 con 0x7fe5f0099e20 2023-09-30T22:23:44.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.631+0000 7fe5e5ffb700 1 -- 172.21.15.154:0/3368896049 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe5ec03ea40 con 0x7fe5f0099e20 2023-09-30T22:23:44.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.635+0000 7fe5e5ffb700 1 -- 172.21.15.154:0/3368896049 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5ec01b3b0 con 0x7fe5f0099e20 2023-09-30T22:23:44.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.670+0000 7f91b8873700 1 Processor -- start 2023-09-30T22:23:44.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.670+0000 7f91b8873700 1 -- start start 2023-09-30T22:23:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b8873700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91b409f350 0x7f91b4136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b8873700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b41371c0 0x7f91b41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b8873700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b409c970 con 0x7f91b409e870 2023-09-30T22:23:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b8873700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b40a0920 con 0x7f91b409f350 2023-09-30T22:23:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b8873700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b409f9c0 con 0x7f91b41371c0 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91b409f350 0x7f91b4136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91b409f350 0x7f91b4136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48310/0 (socket says 172.21.15.154:48310) 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b1d9b700 1 -- 172.21.15.154:0/2752750161 learned_addr learned my addr 172.21.15.154:0/2752750161 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b2d9d700 1 --2- 172.21.15.154:0/2752750161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b41371c0 0x7f91b41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b2d9d700 1 -- 172.21.15.154:0/2752750161 >> v2:172.21.15.154:3300/0 conn(0x7f91b409f350 msgr2=0x7f91b4136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b2d9d700 1 --2- 172.21.15.154:0/2752750161 >> v2:172.21.15.154:3300/0 conn(0x7f91b409f350 0x7f91b4136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b2d9d700 1 -- 172.21.15.154:0/2752750161 >> v1:172.21.15.154:6789/0 conn(0x7f91b409e870 legacy=0x7f91b409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b159a700 1 -- 172.21.15.154:0/2752750161 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423757949 0 0) 0x7f91b409c970 con 0x7f91b409e870 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b2d9d700 1 -- 172.21.15.154:0/2752750161 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b409bab0 con 0x7f91b41371c0 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b1d9b700 1 --2- 172.21.15.154:0/2752750161 >> v2:172.21.15.154:3300/0 conn(0x7f91b409f350 0x7f91b4136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b2d9d700 1 --2- 172.21.15.154:0/2752750161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b41371c0 0x7f91b41395a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009d90 tx=0x7f91ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4f85920e5686d5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b159a700 1 -- 172.21.15.154:0/2752750161 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00e070 con 0x7f91b41371c0 2023-09-30T22:23:44.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.671+0000 7f91b159a700 1 -- 172.21.15.154:0/2752750161 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00bb20 con 0x7f91b41371c0 2023-09-30T22:23:44.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.672+0000 7f91b159a700 1 -- 172.21.15.154:0/2752750161 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac012430 con 0x7f91b41371c0 2023-09-30T22:23:44.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.672+0000 7f91b8873700 1 -- 172.21.15.154:0/2752750161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b41371c0 msgr2=0x7f91b41395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.672+0000 7f91b8873700 1 --2- 172.21.15.154:0/2752750161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b41371c0 0x7f91b41395a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009d90 tx=0x7f91ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:44.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.672+0000 7f91b8873700 1 -- 172.21.15.154:0/2752750161 shutdown_connections 2023-09-30T22:23:44.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.672+0000 7f91b8873700 1 --2- 172.21.15.154:0/2752750161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b41371c0 0x7f91b41395a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.672+0000 7f91b8873700 1 --2- 172.21.15.154:0/2752750161 >> v2:172.21.15.154:3300/0 conn(0x7f91b409f350 0x7f91b4136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.672+0000 7f91b8873700 1 -- 172.21.15.154:0/2752750161 >> 172.21.15.154:0/2752750161 conn(0x7f91b40a4430 msgr2=0x7f91b40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.672+0000 7f91b8873700 1 -- 172.21.15.154:0/2752750161 shutdown_connections 2023-09-30T22:23:44.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.672+0000 7f91b8873700 1 -- 172.21.15.154:0/2752750161 wait complete. 2023-09-30T22:23:44.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.674+0000 7f91b8873700 1 Processor -- start 2023-09-30T22:23:44.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.674+0000 7f91b8873700 1 -- start start 2023-09-30T22:23:44.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.674+0000 7f91b8873700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b409e870 0x7f91b41207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.674+0000 7f91b8873700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b409f350 0x7f91b4120ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.674+0000 7f91b8873700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91b41371c0 0x7f91b4121220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.674+0000 7f91b8873700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4124230 con 0x7f91b409f350 2023-09-30T22:23:44.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.674+0000 7f91b8873700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4122940 con 0x7f91b409e870 2023-09-30T22:23:44.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.674+0000 7f91b8873700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91b409dba0 con 0x7f91b41371c0 2023-09-30T22:23:44.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.674+0000 7f91b259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b409e870 0x7f91b41207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91b41371c0 0x7f91b4121220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b409e870 0x7f91b41207a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59696/0 (socket says 172.21.15.154:59696) 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b259c700 1 -- 172.21.15.154:0/2127629641 learned_addr learned my addr 172.21.15.154:0/2127629641 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b1d9b700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b409f350 0x7f91b4120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b259c700 1 -- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91b41371c0 msgr2=0x7f91b4121220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b259c700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91b41371c0 0x7f91b4121220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b259c700 1 -- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b409f350 msgr2=0x7f91b4120ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b259c700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b409f350 0x7f91b4120ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b259c700 1 -- 172.21.15.154:0/2127629641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009550 con 0x7f91b409e870 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b1d9b700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b409f350 0x7f91b4120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b2d9d700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91b41371c0 0x7f91b4121220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b259c700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b409e870 0x7f91b41207a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c520 tx=0x7f91a400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91a2ffd700 1 -- 172.21.15.154:0/2127629641 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40054e0 con 0x7f91b409e870 2023-09-30T22:23:44.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91a2ffd700 1 -- 172.21.15.154:0/2127629641 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4003680 con 0x7f91b409e870 2023-09-30T22:23:44.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b8873700 1 -- 172.21.15.154:0/2127629641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac009a70 con 0x7f91b409e870 2023-09-30T22:23:44.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91a2ffd700 1 -- 172.21.15.154:0/2127629641 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40039f0 con 0x7f91b409e870 2023-09-30T22:23:44.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.675+0000 7f91b8873700 1 -- 172.21.15.154:0/2127629641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b4123c90 con 0x7f91b409e870 2023-09-30T22:23:44.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.676+0000 7f91a2ffd700 1 -- 172.21.15.154:0/2127629641 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91a4003b50 con 0x7f91b409e870 2023-09-30T22:23:44.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.676+0000 7f91b8873700 1 -- 172.21.15.154:0/2127629641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b404f2a0 con 0x7f91b409e870 2023-09-30T22:23:44.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.676+0000 7f91a2ffd700 1 -- 172.21.15.154:0/2127629641 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f91a403eaa0 con 0x7f91b409e870 2023-09-30T22:23:44.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.685+0000 7f91a2ffd700 1 -- 172.21.15.154:0/2127629641 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91a401b3b0 con 0x7f91b409e870 2023-09-30T22:23:44.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.720+0000 7f119fc5c700 1 Processor -- start 2023-09-30T22:23:44.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.720+0000 7f119fc5c700 1 -- start start 2023-09-30T22:23:44.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119fc5c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f119809ad40 0x7f1198133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119fc5c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11981343a0 0x7f11980a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119fc5c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119809b110 con 0x7f1198133f70 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119fc5c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980a3b60 con 0x7f119809ad40 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119fc5c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11980a2fa0 con 0x7f11981343a0 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119e1f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11981343a0 0x7f11980a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119d1f7700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1198133f70 0x7f11980a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37516/0 (socket says 172.21.15.154:37516) 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119d1f7700 1 -- 172.21.15.154:0/331179855 learned_addr learned my addr 172.21.15.154:0/331179855 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119d9f8700 1 --2- 172.21.15.154:0/331179855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f119809ad40 0x7f1198133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119e1f9700 1 -- 172.21.15.154:0/331179855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f119809ad40 msgr2=0x7f1198133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119e1f9700 1 --2- 172.21.15.154:0/331179855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f119809ad40 0x7f1198133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119e1f9700 1 -- 172.21.15.154:0/331179855 >> v1:172.21.15.154:6789/0 conn(0x7f1198133f70 legacy=0x7f11980a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119e1f9700 1 -- 172.21.15.154:0/331179855 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119809a280 con 0x7f11981343a0 2023-09-30T22:23:44.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119c9f6700 1 -- 172.21.15.154:0/331179855 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549100745 0 0) 0x7f119809b110 con 0x7f1198133f70 2023-09-30T22:23:44.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119d9f8700 1 --2- 172.21.15.154:0/331179855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f119809ad40 0x7f1198133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:44.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.721+0000 7f119e1f9700 1 --2- 172.21.15.154:0/331179855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11981343a0 0x7f11980a1180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1190009dc0 tx=0x7f119000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53ecd30172701f9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.722+0000 7f119c9f6700 1 -- 172.21.15.154:0/331179855 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119000e070 con 0x7f11981343a0 2023-09-30T22:23:44.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.722+0000 7f119c9f6700 1 -- 172.21.15.154:0/331179855 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119000bb20 con 0x7f11981343a0 2023-09-30T22:23:44.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.722+0000 7f119c9f6700 1 -- 172.21.15.154:0/331179855 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190012430 con 0x7f11981343a0 2023-09-30T22:23:44.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.722+0000 7f119fc5c700 1 -- 172.21.15.154:0/331179855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11981343a0 msgr2=0x7f11980a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.722+0000 7f119fc5c700 1 --2- 172.21.15.154:0/331179855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11981343a0 0x7f11980a1180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1190009dc0 tx=0x7f119000b330 comp rx=0 tx=0).stop 2023-09-30T22:23:44.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.723+0000 7f119fc5c700 1 -- 172.21.15.154:0/331179855 shutdown_connections 2023-09-30T22:23:44.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.723+0000 7f119fc5c700 1 --2- 172.21.15.154:0/331179855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11981343a0 0x7f11980a1180 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.723+0000 7f119fc5c700 1 --2- 172.21.15.154:0/331179855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f119809ad40 0x7f1198133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.723+0000 7f119fc5c700 1 -- 172.21.15.154:0/331179855 >> 172.21.15.154:0/331179855 conn(0x7f1198099c40 msgr2=0x7f119806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.723+0000 7f119fc5c700 1 -- 172.21.15.154:0/331179855 shutdown_connections 2023-09-30T22:23:44.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.723+0000 7f119fc5c700 1 -- 172.21.15.154:0/331179855 wait complete. 2023-09-30T22:23:44.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.724+0000 7f119fc5c700 1 Processor -- start 2023-09-30T22:23:44.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.724+0000 7f119fc5c700 1 -- start start 2023-09-30T22:23:44.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119fc5c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f119809ad40 0x7f11981c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119fc5c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1198133f70 0x7f11981c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119fc5c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11981343a0 0x7f11981c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:44.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119fc5c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198122580 con 0x7f11981343a0 2023-09-30T22:23:44.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119fc5c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11981208c0 con 0x7f1198133f70 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119fc5c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f119809e7a0 con 0x7f119809ad40 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119d9f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f119809ad40 0x7f11981c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119d9f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f119809ad40 0x7f11981c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52616/0 (socket says 172.21.15.154:52616) 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119d9f8700 1 -- 172.21.15.154:0/2762037772 learned_addr learned my addr 172.21.15.154:0/2762037772 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119e1f9700 1 --2- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11981343a0 0x7f11981c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119d1f7700 1 --2- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1198133f70 0x7f11981c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119e1f9700 1 -- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f119809ad40 msgr2=0x7f11981c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119e1f9700 1 --2- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f119809ad40 0x7f11981c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119e1f9700 1 -- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1198133f70 msgr2=0x7f11981c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119e1f9700 1 --2- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1198133f70 0x7f11981c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119e1f9700 1 -- 172.21.15.154:0/2762037772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940094a0 con 0x7f11981343a0 2023-09-30T22:23:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.725+0000 7f119e1f9700 1 --2- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11981343a0 0x7f11981c8d90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1190016000 tx=0x7f1190004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.726+0000 7f118e7fc700 1 -- 172.21.15.154:0/2762037772 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190012430 con 0x7f11981343a0 2023-09-30T22:23:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.726+0000 7f118e7fc700 1 -- 172.21.15.154:0/2762037772 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1190020070 con 0x7f11981343a0 2023-09-30T22:23:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.726+0000 7f119fc5c700 1 -- 172.21.15.154:0/2762037772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1190009a70 con 0x7f11981343a0 2023-09-30T22:23:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.726+0000 7f118e7fc700 1 -- 172.21.15.154:0/2762037772 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190004280 con 0x7f11981343a0 2023-09-30T22:23:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.726+0000 7f119fc5c700 1 -- 172.21.15.154:0/2762037772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11981217b0 con 0x7f11981343a0 2023-09-30T22:23:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.727+0000 7f118e7fc700 1 -- 172.21.15.154:0/2762037772 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11900043e0 con 0x7f11981343a0 2023-09-30T22:23:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.727+0000 7f119fc5c700 1 -- 172.21.15.154:0/2762037772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1198123020 con 0x7f11981343a0 2023-09-30T22:23:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.727+0000 7f118e7fc700 1 -- 172.21.15.154:0/2762037772 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1190022070 con 0x7f11981343a0 2023-09-30T22:23:44.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.732+0000 7f118e7fc700 1 -- 172.21.15.154:0/2762037772 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1190046060 con 0x7f11981343a0 2023-09-30T22:23:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.833+0000 7fe5f7822700 1 -- 172.21.15.154:0/3368896049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5f0072480 con 0x7fe5f0099e20 2023-09-30T22:23:44.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.833+0000 7fe5e5ffb700 1 -- 172.21.15.154:0/3368896049 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5f0072480 con 0x7fe5f0099e20 2023-09-30T22:23:44.833 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.835+0000 7fe5f7822700 1 -- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0099e20 msgr2=0x7fe5f0070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.835+0000 7fe5f7822700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0099e20 0x7fe5f0070230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec001260 tx=0x7fe5ec00c7b0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.835+0000 7fe5f7822700 1 -- 172.21.15.154:0/3368896049 shutdown_connections 2023-09-30T22:23:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.835+0000 7fe5f7822700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f0135f80 0x7fe5f0070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.835+0000 7fe5f7822700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5f0099e20 0x7fe5f0070230 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.835+0000 7fe5f7822700 1 --2- 172.21.15.154:0/3368896049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f0133660 0x7fe5f0070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.835+0000 7fe5f7822700 1 -- 172.21.15.154:0/3368896049 >> 172.21.15.154:0/3368896049 conn(0x7fe5f00a2980 msgr2=0x7fe5f01324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.835+0000 7fe5f7822700 1 -- 172.21.15.154:0/3368896049 shutdown_connections 2023-09-30T22:23:44.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.835+0000 7fe5f7822700 1 -- 172.21.15.154:0/3368896049 wait complete. 2023-09-30T22:23:44.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:44.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.881+0000 7f91b8873700 1 -- 172.21.15.154:0/2127629641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91b41222e0 con 0x7f91b409e870 2023-09-30T22:23:44.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.881+0000 7f91a2ffd700 1 -- 172.21.15.154:0/2127629641 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91a4017030 con 0x7f91b409e870 2023-09-30T22:23:44.881 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:44.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.883+0000 7f91b8873700 1 -- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b409e870 msgr2=0x7f91b41207a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.883+0000 7f91b8873700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b409e870 0x7f91b41207a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c520 tx=0x7f91a400c830 comp rx=0 tx=0).stop 2023-09-30T22:23:44.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.883+0000 7f91b8873700 1 -- 172.21.15.154:0/2127629641 shutdown_connections 2023-09-30T22:23:44.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.883+0000 7f91b8873700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91b41371c0 0x7f91b4121220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.883+0000 7f91b8873700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91b409e870 0x7f91b41207a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.883+0000 7f91b8873700 1 --2- 172.21.15.154:0/2127629641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b409f350 0x7f91b4120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.883+0000 7f91b8873700 1 -- 172.21.15.154:0/2127629641 >> 172.21.15.154:0/2127629641 conn(0x7f91b40a4430 msgr2=0x7f91b4070530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.883+0000 7f91b8873700 1 -- 172.21.15.154:0/2127629641 shutdown_connections 2023-09-30T22:23:44.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.883+0000 7f91b8873700 1 -- 172.21.15.154:0/2127629641 wait complete. 2023-09-30T22:23:44.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:44.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.924+0000 7f119fc5c700 1 -- 172.21.15.154:0/2762037772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f119804f2a0 con 0x7f11981343a0 2023-09-30T22:23:44.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.924+0000 7f118e7fc700 1 -- 172.21.15.154:0/2762037772 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1190046070 con 0x7f11981343a0 2023-09-30T22:23:44.924 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:44.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.926+0000 7f119fc5c700 1 -- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11981343a0 msgr2=0x7f11981c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.926+0000 7f119fc5c700 1 --2- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11981343a0 0x7f11981c8d90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1190016000 tx=0x7f1190004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.926+0000 7f119fc5c700 1 -- 172.21.15.154:0/2762037772 shutdown_connections 2023-09-30T22:23:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.926+0000 7f119fc5c700 1 --2- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11981343a0 0x7f11981c8d90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.926+0000 7f119fc5c700 1 --2- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f119809ad40 0x7f11981c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.926+0000 7f119fc5c700 1 --2- 172.21.15.154:0/2762037772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1198133f70 0x7f11981c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.926+0000 7f119fc5c700 1 -- 172.21.15.154:0/2762037772 >> 172.21.15.154:0/2762037772 conn(0x7f1198099c40 msgr2=0x7f11981bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.927+0000 7f119fc5c700 1 -- 172.21.15.154:0/2762037772 shutdown_connections 2023-09-30T22:23:44.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:44.927+0000 7f119fc5c700 1 -- 172.21.15.154:0/2762037772 wait complete. 2023-09-30T22:23:44.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:45.046 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:45.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1c3f2700 1 Processor -- start 2023-09-30T22:23:45.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1c3f2700 1 -- start start 2023-09-30T22:23:45.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1c3f2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c1406a770 0x7f8c1406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1c3f2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1409dec0 0x7f8c1406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1c3f2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c14131a00 0x7f8c14131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1c3f2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1406b5c0 con 0x7f8c1406a770 2023-09-30T22:23:45.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1c3f2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1406e900 con 0x7f8c14131a00 2023-09-30T22:23:45.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1c3f2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1409d180 con 0x7f8c1409dec0 2023-09-30T22:23:45.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1a18e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c1406a770 0x7f8c1406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1a98f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c14131a00 0x7f8c14131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1998d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1409dec0 0x7f8c1406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1a98f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c14131a00 0x7f8c14131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59728/0 (socket says 172.21.15.154:59728) 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1a18e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c1406a770 0x7f8c1406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48336/0 (socket says 172.21.15.154:48336) 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.170+0000 7f8c1a98f700 1 -- 172.21.15.154:0/1250940662 learned_addr learned my addr 172.21.15.154:0/1250940662 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1a98f700 1 -- 172.21.15.154:0/1250940662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1409dec0 msgr2=0x7f8c1406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1a98f700 1 --2- 172.21.15.154:0/1250940662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1409dec0 0x7f8c1406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1a98f700 1 -- 172.21.15.154:0/1250940662 >> v2:172.21.15.154:3300/0 conn(0x7f8c1406a770 msgr2=0x7f8c1406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1a98f700 1 --2- 172.21.15.154:0/1250940662 >> v2:172.21.15.154:3300/0 conn(0x7f8c1406a770 0x7f8c1406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1a98f700 1 -- 172.21.15.154:0/1250940662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1409e780 con 0x7f8c14131a00 2023-09-30T22:23:45.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1998d700 1 --2- 172.21.15.154:0/1250940662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1409dec0 0x7f8c1406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:45.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1a18e700 1 --2- 172.21.15.154:0/1250940662 >> v2:172.21.15.154:3300/0 conn(0x7f8c1406a770 0x7f8c1406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:45.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1a98f700 1 --2- 172.21.15.154:0/1250940662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c14131a00 0x7f8c14131e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009e50 tx=0x7f8c0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8deb53e2722ce83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1918c700 1 -- 172.21.15.154:0/1250940662 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c00e070 con 0x7f8c14131a00 2023-09-30T22:23:45.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1918c700 1 -- 172.21.15.154:0/1250940662 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00b910 con 0x7f8c14131a00 2023-09-30T22:23:45.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.171+0000 7f8c1918c700 1 -- 172.21.15.154:0/1250940662 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c00bcc0 con 0x7f8c14131a00 2023-09-30T22:23:45.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.172+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/1250940662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c14131a00 msgr2=0x7f8c14131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.172+0000 7f8c1c3f2700 1 --2- 172.21.15.154:0/1250940662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c14131a00 0x7f8c14131e60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009e50 tx=0x7f8c0c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:45.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.172+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/1250940662 shutdown_connections 2023-09-30T22:23:45.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.172+0000 7f8c1c3f2700 1 --2- 172.21.15.154:0/1250940662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c14131a00 0x7f8c14131e60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.172+0000 7f8c1c3f2700 1 --2- 172.21.15.154:0/1250940662 >> v2:172.21.15.154:3300/0 conn(0x7f8c1406a770 0x7f8c1406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.172+0000 7f8c1c3f2700 1 --2- 172.21.15.154:0/1250940662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1409dec0 0x7f8c1406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.172+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/1250940662 >> 172.21.15.154:0/1250940662 conn(0x7f8c14099c40 msgr2=0x7f8c140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.172+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/1250940662 shutdown_connections 2023-09-30T22:23:45.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.172+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/1250940662 wait complete. 2023-09-30T22:23:45.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1c3f2700 1 Processor -- start 2023-09-30T22:23:45.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1c3f2700 1 -- start start 2023-09-30T22:23:45.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1c3f2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1406a770 0x7f8c14119e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1c3f2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1409dec0 0x7f8c1411a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1c3f2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14131a00 0x7f8c1411a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1c3f2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1411d930 con 0x7f8c14131a00 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1c3f2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1411d0c0 con 0x7f8c1409dec0 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1c3f2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14130e10 con 0x7f8c1406a770 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1a18e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1406a770 0x7f8c14119e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1998d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1409dec0 0x7f8c1411a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1a18e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1406a770 0x7f8c14119e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52636/0 (socket says 172.21.15.154:52636) 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1998d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1409dec0 0x7f8c1411a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59732/0 (socket says 172.21.15.154:59732) 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1a18e700 1 -- 172.21.15.154:0/861838740 learned_addr learned my addr 172.21.15.154:0/861838740 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:45.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1a98f700 1 --2- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14131a00 0x7f8c1411a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1998d700 1 -- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1406a770 msgr2=0x7f8c14119e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1998d700 1 --2- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1406a770 0x7f8c14119e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1998d700 1 -- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14131a00 msgr2=0x7f8c1411a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1998d700 1 --2- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14131a00 0x7f8c1411a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.173+0000 7f8c1998d700 1 -- 172.21.15.154:0/861838740 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100094a0 con 0x7f8c1409dec0 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.174+0000 7f8c1998d700 1 --2- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1409dec0 0x7f8c1411a350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400e9b0 tx=0x7f8c0400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.174+0000 7f8c0affd700 1 -- 172.21.15.154:0/861838740 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400ee50 con 0x7f8c1409dec0 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.174+0000 7f8c0affd700 1 -- 172.21.15.154:0/861838740 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0400c850 con 0x7f8c1409dec0 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.174+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/861838740 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040094a0 con 0x7f8c1409dec0 2023-09-30T22:23:45.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.174+0000 7f8c0affd700 1 -- 172.21.15.154:0/861838740 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0400cc00 con 0x7f8c1409dec0 2023-09-30T22:23:45.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.174+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/861838740 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c009b30 con 0x7f8c1409dec0 2023-09-30T22:23:45.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.174+0000 7f8c0affd700 1 -- 172.21.15.154:0/861838740 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c04013470 con 0x7f8c1409dec0 2023-09-30T22:23:45.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.175+0000 7f8c0affd700 1 -- 172.21.15.154:0/861838740 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c0403fa70 con 0x7f8c1409dec0 2023-09-30T22:23:45.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.175+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/861838740 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1404f2a0 con 0x7f8c1409dec0 2023-09-30T22:23:45.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.179+0000 7f8c0affd700 1 -- 172.21.15.154:0/861838740 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c04017020 con 0x7f8c1409dec0 2023-09-30T22:23:45.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.368+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/861838740 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c1411d4b0 con 0x7f8c1409dec0 2023-09-30T22:23:45.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.368+0000 7f8c0affd700 1 -- 172.21.15.154:0/861838740 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c1411d4b0 con 0x7f8c1409dec0 2023-09-30T22:23:45.368 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:45.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.370+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1409dec0 msgr2=0x7f8c1411a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.370+0000 7f8c1c3f2700 1 --2- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1409dec0 0x7f8c1411a350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400e9b0 tx=0x7f8c0400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.370+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/861838740 shutdown_connections 2023-09-30T22:23:45.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.370+0000 7f8c1c3f2700 1 --2- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14131a00 0x7f8c1411a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.370+0000 7f8c1c3f2700 1 --2- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c1406a770 0x7f8c14119e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.370+0000 7f8c1c3f2700 1 --2- 172.21.15.154:0/861838740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c1409dec0 0x7f8c1411a350 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.370+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/861838740 >> 172.21.15.154:0/861838740 conn(0x7f8c14099c40 msgr2=0x7f8c1412edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.370+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/861838740 shutdown_connections 2023-09-30T22:23:45.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.370+0000 7f8c1c3f2700 1 -- 172.21.15.154:0/861838740 wait complete. 2023-09-30T22:23:45.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:45.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:45.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:45.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:45.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.978+0000 7ffa6493b700 1 Processor -- start 2023-09-30T22:23:45.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.978+0000 7ffa6493b700 1 -- start start 2023-09-30T22:23:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.979+0000 7ffa6493b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa6009ad40 0x7ffa60133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.979+0000 7ffa6493b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa601343a0 0x7ffa600a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.979+0000 7ffa6493b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6009b110 con 0x7ffa60133f70 2023-09-30T22:23:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.979+0000 7ffa6493b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa600a3b60 con 0x7ffa601343a0 2023-09-30T22:23:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.979+0000 7ffa6493b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600a2fa0 con 0x7ffa6009ad40 2023-09-30T22:23:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.979+0000 7ffa5ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa601343a0 0x7ffa600a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.979+0000 7ffa5e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa6009ad40 0x7ffa60133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.979+0000 7ffa5ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa601343a0 0x7ffa600a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44448/0 (socket says 172.21.15.154:44448) 2023-09-30T22:23:45.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.979+0000 7ffa5ed9d700 1 -- 172.21.15.154:0/835218790 learned_addr learned my addr 172.21.15.154:0/835218790 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:45.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5ed9d700 1 -- 172.21.15.154:0/835218790 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa6009ad40 msgr2=0x7ffa60133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:45.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5ed9d700 1 --2- 172.21.15.154:0/835218790 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa6009ad40 0x7ffa60133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5ed9d700 1 -- 172.21.15.154:0/835218790 >> v1:172.21.15.154:6789/0 conn(0x7ffa60133f70 legacy=0x7ffa600a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5d59a700 1 -- 172.21.15.154:0/835218790 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043643198 0 0) 0x7ffa6009b110 con 0x7ffa60133f70 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5ed9d700 1 -- 172.21.15.154:0/835218790 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6009a280 con 0x7ffa601343a0 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5e59c700 1 --2- 172.21.15.154:0/835218790 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa6009ad40 0x7ffa60133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5ed9d700 1 --2- 172.21.15.154:0/835218790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa601343a0 0x7ffa600a1180 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009e50 tx=0x7ffa5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790d258a38047df3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5d59a700 1 -- 172.21.15.154:0/835218790 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800e070 con 0x7ffa601343a0 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5d59a700 1 -- 172.21.15.154:0/835218790 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5800b910 con 0x7ffa601343a0 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.980+0000 7ffa5d59a700 1 -- 172.21.15.154:0/835218790 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800bcc0 con 0x7ffa601343a0 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.981+0000 7ffa6493b700 1 -- 172.21.15.154:0/835218790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa601343a0 msgr2=0x7ffa600a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.981+0000 7ffa6493b700 1 --2- 172.21.15.154:0/835218790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa601343a0 0x7ffa600a1180 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009e50 tx=0x7ffa5800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:45.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.981+0000 7ffa6493b700 1 -- 172.21.15.154:0/835218790 shutdown_connections 2023-09-30T22:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.981+0000 7ffa6493b700 1 --2- 172.21.15.154:0/835218790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa601343a0 0x7ffa600a1180 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.981+0000 7ffa6493b700 1 --2- 172.21.15.154:0/835218790 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa6009ad40 0x7ffa60133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.981+0000 7ffa6493b700 1 -- 172.21.15.154:0/835218790 >> 172.21.15.154:0/835218790 conn(0x7ffa60099c40 msgr2=0x7ffa6006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.981+0000 7ffa6493b700 1 -- 172.21.15.154:0/835218790 shutdown_connections 2023-09-30T22:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.981+0000 7ffa6493b700 1 -- 172.21.15.154:0/835218790 wait complete. 2023-09-30T22:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa6493b700 1 Processor -- start 2023-09-30T22:23:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa6493b700 1 -- start start 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa6493b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6009ad40 0x7ffa601c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa6493b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa60133f70 0x7ffa601c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa6493b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa601343a0 0x7ffa601c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa6493b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6011efd0 con 0x7ffa60133f70 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa6493b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60120730 con 0x7ffa6009ad40 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa6493b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60122740 con 0x7ffa601343a0 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa5e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6009ad40 0x7ffa601c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.982+0000 7ffa5dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa60133f70 0x7ffa601c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6009ad40 0x7ffa601c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58570/0 (socket says 172.21.15.154:58570) 2023-09-30T22:23:45.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5e59c700 1 -- 172.21.15.154:0/2931836109 learned_addr learned my addr 172.21.15.154:0/2931836109 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5ed9d700 1 --2- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa601343a0 0x7ffa601c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5e59c700 1 -- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa601343a0 msgr2=0x7ffa601c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5e59c700 1 --2- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa601343a0 0x7ffa601c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5e59c700 1 -- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa60133f70 msgr2=0x7ffa601c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5e59c700 1 --2- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa60133f70 0x7ffa601c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5e59c700 1 -- 172.21.15.154:0/2931836109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500094a0 con 0x7ffa6009ad40 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5dd9b700 1 --2- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa60133f70 0x7ffa601c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa5e59c700 1 --2- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6009ad40 0x7ffa601c8120 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000ebe0 tx=0x7ffa5000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa4effd700 1 -- 172.21.15.154:0/2931836109 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50009760 con 0x7ffa6009ad40 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa6493b700 1 -- 172.21.15.154:0/2931836109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa58009b30 con 0x7ffa6009ad40 2023-09-30T22:23:45.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa4effd700 1 -- 172.21.15.154:0/2931836109 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000c850 con 0x7ffa6009ad40 2023-09-30T22:23:45.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa4effd700 1 -- 172.21.15.154:0/2931836109 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000cbe0 con 0x7ffa6009ad40 2023-09-30T22:23:45.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.983+0000 7ffa6493b700 1 -- 172.21.15.154:0/2931836109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa60120f20 con 0x7ffa6009ad40 2023-09-30T22:23:45.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.984+0000 7ffa4effd700 1 -- 172.21.15.154:0/2931836109 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa5000cd40 con 0x7ffa6009ad40 2023-09-30T22:23:45.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.984+0000 7ffa4effd700 1 -- 172.21.15.154:0/2931836109 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa5003f840 con 0x7ffa6009ad40 2023-09-30T22:23:45.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.984+0000 7ffa6493b700 1 -- 172.21.15.154:0/2931836109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6004f2a0 con 0x7ffa6009ad40 2023-09-30T22:23:45.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:45.989+0000 7ffa4effd700 1 -- 172.21.15.154:0/2931836109 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa50021080 con 0x7ffa6009ad40 2023-09-30T22:23:46.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.023+0000 7f348706e700 1 Processor -- start 2023-09-30T22:23:46.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f348706e700 1 -- start start 2023-09-30T22:23:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f348706e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a0a70 0x7f34800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f348706e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34800a1380 0x7f3480133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f348706e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348009dc00 con 0x7f3480133f50 2023-09-30T22:23:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f348706e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348009ea60 con 0x7f34800a1380 2023-09-30T22:23:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f348706e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348009dec0 con 0x7f34800a0a70 2023-09-30T22:23:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f3484e0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a0a70 0x7f34800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f3484e0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a0a70 0x7f34800a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58578/0 (socket says 172.21.15.154:58578) 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f3484e0a700 1 -- 172.21.15.154:0/1552956392 learned_addr learned my addr 172.21.15.154:0/1552956392 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.024+0000 7f347ffff700 1 --2- 172.21.15.154:0/1552956392 >> v2:172.21.15.154:3300/0 conn(0x7f34800a1380 0x7f3480133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.025+0000 7f3484e0a700 1 -- 172.21.15.154:0/1552956392 >> v2:172.21.15.154:3300/0 conn(0x7f34800a1380 msgr2=0x7f3480133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.025+0000 7f3484e0a700 1 --2- 172.21.15.154:0/1552956392 >> v2:172.21.15.154:3300/0 conn(0x7f34800a1380 0x7f3480133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.025+0000 7f3484e0a700 1 -- 172.21.15.154:0/1552956392 >> v1:172.21.15.154:6789/0 conn(0x7f3480133f50 legacy=0x7f348013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.025+0000 7f3484e0a700 1 -- 172.21.15.154:0/1552956392 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348009e6a0 con 0x7f34800a0a70 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.025+0000 7f347ffff700 1 --2- 172.21.15.154:0/1552956392 >> v2:172.21.15.154:3300/0 conn(0x7f34800a1380 0x7f3480133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.025+0000 7f3484e0a700 1 --2- 172.21.15.154:0/1552956392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a0a70 0x7f34800a0e40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f34740098f0 tx=0x7f3474009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a84d01a211d50d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.025+0000 7f347f7fe700 1 -- 172.21.15.154:0/1552956392 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474011830 con 0x7f34800a0a70 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.025+0000 7f347f7fe700 1 -- 172.21.15.154:0/1552956392 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3474011990 con 0x7f34800a0a70 2023-09-30T22:23:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.025+0000 7f347f7fe700 1 -- 172.21.15.154:0/1552956392 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474011d20 con 0x7f34800a0a70 2023-09-30T22:23:46.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.026+0000 7f348706e700 1 -- 172.21.15.154:0/1552956392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a0a70 msgr2=0x7f34800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.026+0000 7f348706e700 1 --2- 172.21.15.154:0/1552956392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a0a70 0x7f34800a0e40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f34740098f0 tx=0x7f3474009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:46.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.026+0000 7f348706e700 1 -- 172.21.15.154:0/1552956392 shutdown_connections 2023-09-30T22:23:46.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.026+0000 7f348706e700 1 --2- 172.21.15.154:0/1552956392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a0a70 0x7f34800a0e40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.026+0000 7f348706e700 1 --2- 172.21.15.154:0/1552956392 >> v2:172.21.15.154:3300/0 conn(0x7f34800a1380 0x7f3480133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.026+0000 7f348706e700 1 -- 172.21.15.154:0/1552956392 >> 172.21.15.154:0/1552956392 conn(0x7f34800a6610 msgr2=0x7f34800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.026+0000 7f348706e700 1 -- 172.21.15.154:0/1552956392 shutdown_connections 2023-09-30T22:23:46.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.026+0000 7f348706e700 1 -- 172.21.15.154:0/1552956392 wait complete. 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.027+0000 7f348706e700 1 Processor -- start 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.027+0000 7f348706e700 1 -- start start 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.027+0000 7f348706e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34800a0a70 0x7f348011e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.027+0000 7f348706e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a1380 0x7f348011ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f348706e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3480133f50 0x7f348011f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f348706e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34801222e0 con 0x7f34800a0a70 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f348706e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3480133990 con 0x7f34800a1380 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f348706e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3480120470 con 0x7f3480133f50 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f347ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a1380 0x7f348011ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f347ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a1380 0x7f348011ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58588/0 (socket says 172.21.15.154:58588) 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f347ffff700 1 -- 172.21.15.154:0/378796798 learned_addr learned my addr 172.21.15.154:0/378796798 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:46.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f3484e0a700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34800a0a70 0x7f348011e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f348560b700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3480133f50 0x7f348011f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f3484e0a700 1 -- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3480133f50 msgr2=0x7f348011f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f3484e0a700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3480133f50 0x7f348011f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f3484e0a700 1 -- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a1380 msgr2=0x7f348011ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f3484e0a700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a1380 0x7f348011ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f3484e0a700 1 -- 172.21.15.154:0/378796798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c0094a0 con 0x7f34800a0a70 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f347ffff700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a1380 0x7f348011ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f3484e0a700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34800a0a70 0x7f348011e7c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3474016000 tx=0x7f3474004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f347d7fa700 1 -- 172.21.15.154:0/378796798 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474004400 con 0x7f34800a0a70 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f347d7fa700 1 -- 172.21.15.154:0/378796798 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347401f070 con 0x7f34800a0a70 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f348706e700 1 -- 172.21.15.154:0/378796798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3474009550 con 0x7f34800a0a70 2023-09-30T22:23:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.028+0000 7f347d7fa700 1 -- 172.21.15.154:0/378796798 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34740038e0 con 0x7f34800a0a70 2023-09-30T22:23:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.029+0000 7f348706e700 1 -- 172.21.15.154:0/378796798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3480120bc0 con 0x7f34800a0a70 2023-09-30T22:23:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.030+0000 7f348706e700 1 -- 172.21.15.154:0/378796798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348004f2a0 con 0x7f34800a0a70 2023-09-30T22:23:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.030+0000 7f347d7fa700 1 -- 172.21.15.154:0/378796798 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3474021030 con 0x7f34800a0a70 2023-09-30T22:23:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.030+0000 7f347d7fa700 1 -- 172.21.15.154:0/378796798 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3474040df0 con 0x7f34800a0a70 2023-09-30T22:23:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.039+0000 7f347d7fa700 1 -- 172.21.15.154:0/378796798 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f347400b9d0 con 0x7f34800a0a70 2023-09-30T22:23:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.069+0000 7fcab665f700 1 Processor -- start 2023-09-30T22:23:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcab665f700 1 -- start start 2023-09-30T22:23:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcab665f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a0a70 0x7fcab00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcab665f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcab00a1380 0x7fcab0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcab665f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab009dc00 con 0x7fcab0133f50 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcab665f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab009ea60 con 0x7fcab00a1380 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcab665f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcab009dec0 con 0x7fcab00a0a70 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcaaf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcab00a1380 0x7fcab0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcaaffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a0a70 0x7fcab00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcaaf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcab00a1380 0x7fcab0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44490/0 (socket says 172.21.15.154:44490) 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcaaffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a0a70 0x7fcab00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58698/0 (socket says 172.21.15.154:58698) 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.070+0000 7fcaaf7fe700 1 -- 172.21.15.154:0/244553673 learned_addr learned my addr 172.21.15.154:0/244553673 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.071+0000 7fcaaffff700 1 -- 172.21.15.154:0/244553673 >> v2:172.21.15.154:3300/0 conn(0x7fcab00a1380 msgr2=0x7fcab0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.071+0000 7fcaaffff700 1 --2- 172.21.15.154:0/244553673 >> v2:172.21.15.154:3300/0 conn(0x7fcab00a1380 0x7fcab0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.071+0000 7fcaaffff700 1 -- 172.21.15.154:0/244553673 >> v1:172.21.15.154:6789/0 conn(0x7fcab0133f50 legacy=0x7fcab013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.071+0000 7fcaaffff700 1 -- 172.21.15.154:0/244553673 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab009e6a0 con 0x7fcab00a0a70 2023-09-30T22:23:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.071+0000 7fcaaf7fe700 1 --2- 172.21.15.154:0/244553673 >> v2:172.21.15.154:3300/0 conn(0x7fcab00a1380 0x7fcab0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.071+0000 7fcaaffff700 1 --2- 172.21.15.154:0/244553673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a0a70 0x7fcab00a0e40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009840 tx=0x7fcaa0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad4c647a2fa932d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.071+0000 7fcaaeffd700 1 -- 172.21.15.154:0/244553673 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0011830 con 0x7fcab00a0a70 2023-09-30T22:23:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.071+0000 7fcaaeffd700 1 -- 172.21.15.154:0/244553673 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa0011990 con 0x7fcab00a0a70 2023-09-30T22:23:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.071+0000 7fcaaeffd700 1 -- 172.21.15.154:0/244553673 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0011d20 con 0x7fcab00a0a70 2023-09-30T22:23:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.072+0000 7fcab665f700 1 -- 172.21.15.154:0/244553673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a0a70 msgr2=0x7fcab00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.072+0000 7fcab665f700 1 --2- 172.21.15.154:0/244553673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a0a70 0x7fcab00a0e40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009840 tx=0x7fcaa0009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.072+0000 7fcab665f700 1 -- 172.21.15.154:0/244553673 shutdown_connections 2023-09-30T22:23:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.072+0000 7fcab665f700 1 --2- 172.21.15.154:0/244553673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a0a70 0x7fcab00a0e40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.072+0000 7fcab665f700 1 --2- 172.21.15.154:0/244553673 >> v2:172.21.15.154:3300/0 conn(0x7fcab00a1380 0x7fcab0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.072+0000 7fcab665f700 1 -- 172.21.15.154:0/244553673 >> 172.21.15.154:0/244553673 conn(0x7fcab00a6610 msgr2=0x7fcab00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.072+0000 7fcab665f700 1 -- 172.21.15.154:0/244553673 shutdown_connections 2023-09-30T22:23:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.072+0000 7fcab665f700 1 -- 172.21.15.154:0/244553673 wait complete. 2023-09-30T22:23:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.073+0000 7fcab665f700 1 Processor -- start 2023-09-30T22:23:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.073+0000 7fcab665f700 1 -- start start 2023-09-30T22:23:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcab665f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab00a0a70 0x7fcab006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcab665f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a1380 0x7fcab006e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcab665f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcab0133f50 0x7fcab006e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcab665f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00a0450 con 0x7fcab00a0a70 2023-09-30T22:23:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcab665f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0071300 con 0x7fcab0133f50 2023-09-30T22:23:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcab665f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcab006f6d0 con 0x7fcab00a1380 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcaaffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab00a0a70 0x7fcab006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcaaffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab00a0a70 0x7fcab006dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44492/0 (socket says 172.21.15.154:44492) 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcaaffff700 1 -- 172.21.15.154:0/173293128 learned_addr learned my addr 172.21.15.154:0/173293128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcaaf7fe700 1 --2- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a1380 0x7fcab006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcab4bfc700 1 --2- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcab0133f50 0x7fcab006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcaaf7fe700 1 -- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcab0133f50 msgr2=0x7fcab006e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcaaf7fe700 1 --2- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcab0133f50 0x7fcab006e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcaaf7fe700 1 -- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab00a0a70 msgr2=0x7fcab006dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcaaf7fe700 1 --2- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab00a0a70 0x7fcab006dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.074+0000 7fcaaf7fe700 1 -- 172.21.15.154:0/173293128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa4009550 con 0x7fcab00a1380 2023-09-30T22:23:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.075+0000 7fcaaf7fe700 1 --2- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a1380 0x7fcab006e000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400e9a0 tx=0x7fcaa400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.075+0000 7fcaacff9700 1 -- 172.21.15.154:0/173293128 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4004240 con 0x7fcab00a1380 2023-09-30T22:23:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.075+0000 7fcaacff9700 1 -- 172.21.15.154:0/173293128 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa40043a0 con 0x7fcab00a1380 2023-09-30T22:23:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.075+0000 7fcab665f700 1 -- 172.21.15.154:0/173293128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa00094a0 con 0x7fcab00a1380 2023-09-30T22:23:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.075+0000 7fcaacff9700 1 -- 172.21.15.154:0/173293128 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40036a0 con 0x7fcab00a1380 2023-09-30T22:23:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.075+0000 7fcab665f700 1 -- 172.21.15.154:0/173293128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab0070730 con 0x7fcab00a1380 2023-09-30T22:23:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.076+0000 7fcaacff9700 1 -- 172.21.15.154:0/173293128 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcaa4003800 con 0x7fcab00a1380 2023-09-30T22:23:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.076+0000 7fcaacff9700 1 -- 172.21.15.154:0/173293128 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcaa403f7f0 con 0x7fcab00a1380 2023-09-30T22:23:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.076+0000 7fcab665f700 1 -- 172.21.15.154:0/173293128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab0070ce0 con 0x7fcab00a1380 2023-09-30T22:23:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.081+0000 7fcaacff9700 1 -- 172.21.15.154:0/173293128 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcaa4013470 con 0x7fcab00a1380 2023-09-30T22:23:46.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.205+0000 7ffa6493b700 1 -- 172.21.15.154:0/2931836109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa60122280 con 0x7ffa6009ad40 2023-09-30T22:23:46.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.205+0000 7ffa4effd700 1 -- 172.21.15.154:0/2931836109 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa500232f0 con 0x7ffa6009ad40 2023-09-30T22:23:46.205 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.207+0000 7ffa6493b700 1 -- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6009ad40 msgr2=0x7ffa601c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.207+0000 7ffa6493b700 1 --2- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6009ad40 0x7ffa601c8120 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000ebe0 tx=0x7ffa5000eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.208+0000 7ffa6493b700 1 -- 172.21.15.154:0/2931836109 shutdown_connections 2023-09-30T22:23:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.208+0000 7ffa6493b700 1 --2- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa601343a0 0x7ffa601c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.208+0000 7ffa6493b700 1 --2- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa6009ad40 0x7ffa601c8120 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.208+0000 7ffa6493b700 1 --2- 172.21.15.154:0/2931836109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa60133f70 0x7ffa601c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.208+0000 7ffa6493b700 1 -- 172.21.15.154:0/2931836109 >> 172.21.15.154:0/2931836109 conn(0x7ffa60099c40 msgr2=0x7ffa601bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.208+0000 7ffa6493b700 1 -- 172.21.15.154:0/2931836109 shutdown_connections 2023-09-30T22:23:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.208+0000 7ffa6493b700 1 -- 172.21.15.154:0/2931836109 wait complete. 2023-09-30T22:23:46.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:46.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.235+0000 7f348706e700 1 -- 172.21.15.154:0/378796798 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3480072980 con 0x7f34800a0a70 2023-09-30T22:23:46.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.236+0000 7f347d7fa700 1 -- 172.21.15.154:0/378796798 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3474015070 con 0x7f34800a0a70 2023-09-30T22:23:46.235 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:46.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.238+0000 7f348706e700 1 -- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34800a0a70 msgr2=0x7f348011e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.238+0000 7f348706e700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34800a0a70 0x7f348011e7c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3474016000 tx=0x7f3474004750 comp rx=0 tx=0).stop 2023-09-30T22:23:46.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.238+0000 7f348706e700 1 -- 172.21.15.154:0/378796798 shutdown_connections 2023-09-30T22:23:46.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.238+0000 7f348706e700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3480133f50 0x7f348011f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.238+0000 7f348706e700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34800a0a70 0x7f348011e7c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.238+0000 7f348706e700 1 --2- 172.21.15.154:0/378796798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34800a1380 0x7f348011ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.238+0000 7f348706e700 1 -- 172.21.15.154:0/378796798 >> 172.21.15.154:0/378796798 conn(0x7f34800a6610 msgr2=0x7f34800a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.238+0000 7f348706e700 1 -- 172.21.15.154:0/378796798 shutdown_connections 2023-09-30T22:23:46.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.238+0000 7f348706e700 1 -- 172.21.15.154:0/378796798 wait complete. 2023-09-30T22:23:46.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:46.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.286+0000 7fcab665f700 1 -- 172.21.15.154:0/173293128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcab012b230 con 0x7fcab00a1380 2023-09-30T22:23:46.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.286+0000 7fcaacff9700 1 -- 172.21.15.154:0/173293128 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcaa401bba0 con 0x7fcab00a1380 2023-09-30T22:23:46.286 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:46.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.288+0000 7fcab665f700 1 -- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a1380 msgr2=0x7fcab006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.288+0000 7fcab665f700 1 --2- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a1380 0x7fcab006e000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400e9a0 tx=0x7fcaa400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.288+0000 7fcab665f700 1 -- 172.21.15.154:0/173293128 shutdown_connections 2023-09-30T22:23:46.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.288+0000 7fcab665f700 1 --2- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcab0133f50 0x7fcab006e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.288+0000 7fcab665f700 1 --2- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcab00a0a70 0x7fcab006dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.288+0000 7fcab665f700 1 --2- 172.21.15.154:0/173293128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcab00a1380 0x7fcab006e000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.288+0000 7fcab665f700 1 -- 172.21.15.154:0/173293128 >> 172.21.15.154:0/173293128 conn(0x7fcab00a6610 msgr2=0x7fcab00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.288+0000 7fcab665f700 1 -- 172.21.15.154:0/173293128 shutdown_connections 2023-09-30T22:23:46.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.288+0000 7fcab665f700 1 -- 172.21.15.154:0/173293128 wait complete. 2023-09-30T22:23:46.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:46.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:46.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.506+0000 7fb282f6c700 1 Processor -- start 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb282f6c700 1 -- start start 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb282f6c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb282f6c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb282f6c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c09aaa0 con 0x7fb27c130ce0 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb282f6c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c09f870 con 0x7fb27c09e170 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb282f6c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c09b360 con 0x7fb27c09d860 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb280d08700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb27bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb280d08700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58718/0 (socket says 172.21.15.154:58718) 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb281509700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb27c130ce0 0x7fb27c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41040/0 (socket says 172.21.15.154:41040) 2023-09-30T22:23:46.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb280d08700 1 -- 172.21.15.154:0/3177273992 learned_addr learned my addr 172.21.15.154:0/3177273992 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb27b7fe700 1 -- 172.21.15.154:0/3177273992 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649439329 0 0) 0x7fb27c09aaa0 con 0x7fb27c130ce0 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb27bfff700 1 -- 172.21.15.154:0/3177273992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 msgr2=0x7fb27c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb27bfff700 1 --2- 172.21.15.154:0/3177273992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb27bfff700 1 -- 172.21.15.154:0/3177273992 >> v1:172.21.15.154:6789/0 conn(0x7fb27c130ce0 legacy=0x7fb27c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb27bfff700 1 -- 172.21.15.154:0/3177273992 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c09b620 con 0x7fb27c09e170 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.507+0000 7fb280d08700 1 --2- 172.21.15.154:0/3177273992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb27bfff700 1 --2- 172.21.15.154:0/3177273992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c1307a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb268009870 tx=0x7fb268009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7479fd7397f71d9b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb27b7fe700 1 -- 172.21.15.154:0/3177273992 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268011830 con 0x7fb27c09e170 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb27b7fe700 1 -- 172.21.15.154:0/3177273992 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb268011990 con 0x7fb27c09e170 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb27b7fe700 1 -- 172.21.15.154:0/3177273992 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268011d20 con 0x7fb27c09e170 2023-09-30T22:23:46.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb282f6c700 1 -- 172.21.15.154:0/3177273992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 msgr2=0x7fb27c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb282f6c700 1 --2- 172.21.15.154:0/3177273992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c1307a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb268009870 tx=0x7fb268009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:46.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb282f6c700 1 -- 172.21.15.154:0/3177273992 shutdown_connections 2023-09-30T22:23:46.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb282f6c700 1 --2- 172.21.15.154:0/3177273992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb282f6c700 1 --2- 172.21.15.154:0/3177273992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c1307a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb282f6c700 1 -- 172.21.15.154:0/3177273992 >> 172.21.15.154:0/3177273992 conn(0x7fb27c099c40 msgr2=0x7fb27c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb282f6c700 1 -- 172.21.15.154:0/3177273992 shutdown_connections 2023-09-30T22:23:46.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.508+0000 7fb282f6c700 1 -- 172.21.15.154:0/3177273992 wait complete. 2023-09-30T22:23:46.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.509+0000 7fb282f6c700 1 Processor -- start 2023-09-30T22:23:46.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.509+0000 7fb282f6c700 1 -- start start 2023-09-30T22:23:46.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb282f6c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c123120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb282f6c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c123660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb282f6c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb27c130ce0 0x7fb27c1c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb282f6c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c125e10 con 0x7fb27c130ce0 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb282f6c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c122ce0 con 0x7fb27c09e170 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb282f6c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0a2790 con 0x7fb27c09d860 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb27bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c123660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb27bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c123660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58606/0 (socket says 172.21.15.154:58606) 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb27bfff700 1 -- 172.21.15.154:0/1822322235 learned_addr learned my addr 172.21.15.154:0/1822322235 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb281509700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb27c130ce0 0x7fb27c1c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb280d08700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c123120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb27bfff700 1 -- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 msgr2=0x7fb27c123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb27bfff700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c123120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb27bfff700 1 -- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb27c130ce0 msgr2=0x7fb27c1c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb27bfff700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb27c130ce0 0x7fb27c1c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb27bfff700 1 -- 172.21.15.154:0/1822322235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27000b7f0 con 0x7fb27c09e170 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb280d08700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c123120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb281509700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb27c130ce0 0x7fb27c1c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.510+0000 7fb27bfff700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c123660 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb2680090b0 tx=0x7fb268004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.511+0000 7fb2797fa700 1 -- 172.21.15.154:0/1822322235 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268004300 con 0x7fb27c09e170 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.511+0000 7fb2797fa700 1 -- 172.21.15.154:0/1822322235 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26801f070 con 0x7fb27c09e170 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.511+0000 7fb2797fa700 1 -- 172.21.15.154:0/1822322235 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2680036a0 con 0x7fb27c09e170 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.511+0000 7fb282f6c700 1 -- 172.21.15.154:0/1822322235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2680094a0 con 0x7fb27c09e170 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.511+0000 7fb282f6c700 1 -- 172.21.15.154:0/1822322235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c1244a0 con 0x7fb27c09e170 2023-09-30T22:23:46.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.512+0000 7fb282f6c700 1 -- 172.21.15.154:0/1822322235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c04f2a0 con 0x7fb27c09e170 2023-09-30T22:23:46.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.512+0000 7fb2797fa700 1 -- 172.21.15.154:0/1822322235 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb268021030 con 0x7fb27c09e170 2023-09-30T22:23:46.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.512+0000 7fb2797fa700 1 -- 172.21.15.154:0/1822322235 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb268040620 con 0x7fb27c09e170 2023-09-30T22:23:46.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.517+0000 7fb2797fa700 1 -- 172.21.15.154:0/1822322235 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2680239c0 con 0x7fb27c09e170 2023-09-30T22:23:46.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.699+0000 7fb282f6c700 1 -- 172.21.15.154:0/1822322235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb27c125110 con 0x7fb27c09e170 2023-09-30T22:23:46.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.699+0000 7fb2797fa700 1 -- 172.21.15.154:0/1822322235 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb268015070 con 0x7fb27c09e170 2023-09-30T22:23:46.699 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:46.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.701+0000 7fb282f6c700 1 -- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 msgr2=0x7fb27c123660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:46.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.701+0000 7fb282f6c700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c123660 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb2680090b0 tx=0x7fb268004750 comp rx=0 tx=0).stop 2023-09-30T22:23:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.701+0000 7fb282f6c700 1 -- 172.21.15.154:0/1822322235 shutdown_connections 2023-09-30T22:23:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.701+0000 7fb282f6c700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb27c130ce0 0x7fb27c1c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.701+0000 7fb282f6c700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb27c09d860 0x7fb27c123120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.701+0000 7fb282f6c700 1 --2- 172.21.15.154:0/1822322235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb27c09e170 0x7fb27c123660 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.701+0000 7fb282f6c700 1 -- 172.21.15.154:0/1822322235 >> 172.21.15.154:0/1822322235 conn(0x7fb27c099c40 msgr2=0x7fb27c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.701+0000 7fb282f6c700 1 -- 172.21.15.154:0/1822322235 shutdown_connections 2023-09-30T22:23:46.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:46.701+0000 7fb282f6c700 1 -- 172.21.15.154:0/1822322235 wait complete. 2023-09-30T22:23:46.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:47.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:47.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:47.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:47.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.357+0000 7ff6bb496700 1 Processor -- start 2023-09-30T22:23:47.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.357+0000 7ff6bb496700 1 -- start start 2023-09-30T22:23:47.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6bb496700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6b412d280 0x7ff6b412d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6bb496700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b4130ec0 0x7ff6b4138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6bb496700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b409ae40 con 0x7ff6b4130350 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6bb496700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b409b9a0 con 0x7ff6b412d280 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6bb496700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b409bbb0 con 0x7ff6b4130ec0 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6b9a33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b4130ec0 0x7ff6b4138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6b8a31700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff6b4130350 0x7ff6b41307b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41054/0 (socket says 172.21.15.154:41054) 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6b9232700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6b412d280 0x7ff6b412d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6b9a33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b4130ec0 0x7ff6b4138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58742/0 (socket says 172.21.15.154:58742) 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6b8a31700 1 -- 172.21.15.154:0/3379605964 learned_addr learned my addr 172.21.15.154:0/3379605964 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:47.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6b9232700 1 -- 172.21.15.154:0/3379605964 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b4130ec0 msgr2=0x7ff6b4138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6b9232700 1 --2- 172.21.15.154:0/3379605964 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b4130ec0 0x7ff6b4138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6b9232700 1 -- 172.21.15.154:0/3379605964 >> v1:172.21.15.154:6789/0 conn(0x7ff6b4130350 legacy=0x7ff6b41307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.358+0000 7ff6b9232700 1 -- 172.21.15.154:0/3379605964 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b409b250 con 0x7ff6b412d280 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.359+0000 7ff6b9a33700 1 --2- 172.21.15.154:0/3379605964 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b4130ec0 0x7ff6b4138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.359+0000 7ff6b9232700 1 --2- 172.21.15.154:0/3379605964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b412d280 0x7ff6b412d650 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009820 tx=0x7ff6b0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9af2e34314bb8de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.359+0000 7ff6abfff700 1 -- 172.21.15.154:0/3379605964 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0005e30 con 0x7ff6b412d280 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.359+0000 7ff6abfff700 1 -- 172.21.15.154:0/3379605964 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b0006030 con 0x7ff6b412d280 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.359+0000 7ff6abfff700 1 -- 172.21.15.154:0/3379605964 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00063c0 con 0x7ff6b412d280 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.360+0000 7ff6bb496700 1 -- 172.21.15.154:0/3379605964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b412d280 msgr2=0x7ff6b412d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.360+0000 7ff6bb496700 1 --2- 172.21.15.154:0/3379605964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b412d280 0x7ff6b412d650 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009820 tx=0x7ff6b0009b30 comp rx=0 tx=0).stop 2023-09-30T22:23:47.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.360+0000 7ff6bb496700 1 -- 172.21.15.154:0/3379605964 shutdown_connections 2023-09-30T22:23:47.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.360+0000 7ff6bb496700 1 --2- 172.21.15.154:0/3379605964 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b4130ec0 0x7ff6b4138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.360+0000 7ff6bb496700 1 --2- 172.21.15.154:0/3379605964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b412d280 0x7ff6b412d650 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.360+0000 7ff6bb496700 1 -- 172.21.15.154:0/3379605964 >> 172.21.15.154:0/3379605964 conn(0x7ff6b40a2980 msgr2=0x7ff6b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.360+0000 7ff6bb496700 1 -- 172.21.15.154:0/3379605964 shutdown_connections 2023-09-30T22:23:47.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.360+0000 7ff6bb496700 1 -- 172.21.15.154:0/3379605964 wait complete. 2023-09-30T22:23:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6bb496700 1 Processor -- start 2023-09-30T22:23:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6bb496700 1 -- start start 2023-09-30T22:23:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6bb496700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b412d280 0x7ff6b411e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6bb496700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b4130350 0x7ff6b411e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6bb496700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4130ec0 0x7ff6b411ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6bb496700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4121ce0 con 0x7ff6b4130ec0 2023-09-30T22:23:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6bb496700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b411fdd0 con 0x7ff6b4130350 2023-09-30T22:23:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6bb496700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b412ef80 con 0x7ff6b412d280 2023-09-30T22:23:47.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6b9232700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b412d280 0x7ff6b411e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6b8a31700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b4130350 0x7ff6b411e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6b9232700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b412d280 0x7ff6b411e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58756/0 (socket says 172.21.15.154:58756) 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.361+0000 7ff6b9232700 1 -- 172.21.15.154:0/4265753008 learned_addr learned my addr 172.21.15.154:0/4265753008 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6b9a33700 1 --2- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4130ec0 0x7ff6b411ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6b9232700 1 -- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b4130350 msgr2=0x7ff6b411e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6b9232700 1 --2- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b4130350 0x7ff6b411e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6b9232700 1 -- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4130ec0 msgr2=0x7ff6b411ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6b9232700 1 --2- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4130ec0 0x7ff6b411ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6b9232700 1 -- 172.21.15.154:0/4265753008 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac00bc80 con 0x7ff6b412d280 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6b9232700 1 --2- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b412d280 0x7ff6b411e250 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0000c00 tx=0x7ff6b0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6a9ffb700 1 -- 172.21.15.154:0/4265753008 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0004040 con 0x7ff6b412d280 2023-09-30T22:23:47.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6a9ffb700 1 -- 172.21.15.154:0/4265753008 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b00041a0 con 0x7ff6b412d280 2023-09-30T22:23:47.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6a9ffb700 1 -- 172.21.15.154:0/4265753008 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0004510 con 0x7ff6b412d280 2023-09-30T22:23:47.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6bb496700 1 -- 172.21.15.154:0/4265753008 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b0009430 con 0x7ff6b412d280 2023-09-30T22:23:47.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.362+0000 7ff6bb496700 1 -- 172.21.15.154:0/4265753008 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b41205c0 con 0x7ff6b412d280 2023-09-30T22:23:47.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.363+0000 7ff6a9ffb700 1 -- 172.21.15.154:0/4265753008 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6b0022070 con 0x7ff6b412d280 2023-09-30T22:23:47.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.363+0000 7ff6bb496700 1 -- 172.21.15.154:0/4265753008 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b404f2a0 con 0x7ff6b412d280 2023-09-30T22:23:47.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.363+0000 7ff6a9ffb700 1 -- 172.21.15.154:0/4265753008 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff6b0040c90 con 0x7ff6b412d280 2023-09-30T22:23:47.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.368+0000 7ff6a9ffb700 1 -- 172.21.15.154:0/4265753008 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6b002a070 con 0x7ff6b412d280 2023-09-30T22:23:47.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.395+0000 7f94e8d35700 1 Processor -- start 2023-09-30T22:23:47.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.395+0000 7f94e8d35700 1 -- start start 2023-09-30T22:23:47.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e8d35700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f94e4136960 0x7f94e4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e8d35700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4139280 0x7f94e413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e8d35700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e406b2d0 con 0x7f94e4133ad0 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e8d35700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e41345b0 con 0x7f94e4136960 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e8d35700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4133610 con 0x7f94e4139280 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f94e4136960 0x7f94e4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4139280 0x7f94e413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f94e4136960 0x7f94e4138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44526/0 (socket says 172.21.15.154:44526) 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e1d9b700 1 -- 172.21.15.154:0/3800156694 learned_addr learned my addr 172.21.15.154:0/3800156694 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4139280 0x7f94e413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58616/0 (socket says 172.21.15.154:58616) 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e1d9b700 1 -- 172.21.15.154:0/3800156694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4139280 msgr2=0x7f94e413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:47.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e1d9b700 1 --2- 172.21.15.154:0/3800156694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4139280 0x7f94e413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e1d9b700 1 -- 172.21.15.154:0/3800156694 >> v1:172.21.15.154:6789/0 conn(0x7f94e4133ad0 legacy=0x7f94e4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e1d9b700 1 -- 172.21.15.154:0/3800156694 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e409a500 con 0x7f94e4136960 2023-09-30T22:23:47.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.396+0000 7f94e2d9d700 1 --2- 172.21.15.154:0/3800156694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4139280 0x7f94e413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:47.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.397+0000 7f94e1d9b700 1 --2- 172.21.15.154:0/3800156694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 0x7f94e4138d40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f94d80098f0 tx=0x7f94d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8330f5cbfc7325 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:47.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.397+0000 7f94e159a700 1 -- 172.21.15.154:0/3800156694 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011830 con 0x7f94e4136960 2023-09-30T22:23:47.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.397+0000 7f94e159a700 1 -- 172.21.15.154:0/3800156694 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d8011990 con 0x7f94e4136960 2023-09-30T22:23:47.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.397+0000 7f94e159a700 1 -- 172.21.15.154:0/3800156694 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011d20 con 0x7f94e4136960 2023-09-30T22:23:47.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.397+0000 7f94e8d35700 1 -- 172.21.15.154:0/3800156694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 msgr2=0x7f94e4138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.397+0000 7f94e8d35700 1 --2- 172.21.15.154:0/3800156694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 0x7f94e4138d40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f94d80098f0 tx=0x7f94d8009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.398+0000 7f94e8d35700 1 -- 172.21.15.154:0/3800156694 shutdown_connections 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.398+0000 7f94e8d35700 1 --2- 172.21.15.154:0/3800156694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4139280 0x7f94e413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.398+0000 7f94e8d35700 1 --2- 172.21.15.154:0/3800156694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 0x7f94e4138d40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.398+0000 7f94e8d35700 1 -- 172.21.15.154:0/3800156694 >> 172.21.15.154:0/3800156694 conn(0x7f94e4099c40 msgr2=0x7f94e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.398+0000 7f94e8d35700 1 -- 172.21.15.154:0/3800156694 shutdown_connections 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.398+0000 7f94e8d35700 1 -- 172.21.15.154:0/3800156694 wait complete. 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e8d35700 1 Processor -- start 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e8d35700 1 -- start start 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e8d35700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4133ad0 0x7f94e4071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e8d35700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 0x7f94e4071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e8d35700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f94e4139280 0x7f94e41c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e8d35700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4070350 con 0x7f94e4136960 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e8d35700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e406ecd0 con 0x7f94e4133ad0 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e8d35700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94e41315e0 con 0x7f94e4139280 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 0x7f94e4071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4133ad0 0x7f94e4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 0x7f94e4071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44532/0 (socket says 172.21.15.154:44532) 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e1d9b700 1 -- 172.21.15.154:0/1860518500 learned_addr learned my addr 172.21.15.154:0/1860518500 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.399+0000 7f94e2d9d700 1 --2- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f94e4139280 0x7f94e41c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94e259c700 1 -- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f94e4139280 msgr2=0x7f94e41c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94e259c700 1 --2- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f94e4139280 0x7f94e41c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94e259c700 1 -- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 msgr2=0x7f94e4071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94e259c700 1 --2- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 0x7f94e4071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94e259c700 1 -- 172.21.15.154:0/1860518500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc009a70 con 0x7f94e4133ad0 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94e1d9b700 1 --2- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 0x7f94e4071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94e259c700 1 --2- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4133ad0 0x7f94e4071830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f94d4000f60 tx=0x7f94d400c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94d2ffd700 1 -- 172.21.15.154:0/1860518500 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40052d0 con 0x7f94e4133ad0 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94d2ffd700 1 -- 172.21.15.154:0/1860518500 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4005430 con 0x7f94e4133ad0 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94e8d35700 1 -- 172.21.15.154:0/1860518500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d8009550 con 0x7f94e4133ad0 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94d2ffd700 1 -- 172.21.15.154:0/1860518500 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40038c0 con 0x7f94e4133ad0 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.400+0000 7f94e8d35700 1 -- 172.21.15.154:0/1860518500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e4070dc0 con 0x7f94e4133ad0 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.401+0000 7f94d2ffd700 1 -- 172.21.15.154:0/1860518500 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94d4003c30 con 0x7f94e4133ad0 2023-09-30T22:23:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.401+0000 7f94d2ffd700 1 -- 172.21.15.154:0/1860518500 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f94d403ec60 con 0x7f94e4133ad0 2023-09-30T22:23:47.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.401+0000 7f94e8d35700 1 -- 172.21.15.154:0/1860518500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e404f2a0 con 0x7f94e4133ad0 2023-09-30T22:23:47.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.406+0000 7f94d2ffd700 1 -- 172.21.15.154:0/1860518500 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94d4017080 con 0x7f94e4133ad0 2023-09-30T22:23:47.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.438+0000 7f02860a3700 1 Processor -- start 2023-09-30T22:23:47.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.438+0000 7f02860a3700 1 -- start start 2023-09-30T22:23:47.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f02860a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02801309f0 0x7f0280130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f02860a3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f028009d8f0 0x7f028009dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f02860a3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009e280 0x7f0280137750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f02860a3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028009c1f0 con 0x7f028009d8f0 2023-09-30T22:23:47.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f02860a3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028009b1f0 con 0x7f02801309f0 2023-09-30T22:23:47.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f02860a3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0280131300 con 0x7f028009e280 2023-09-30T22:23:47.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f027ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009e280 0x7f0280137750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f027f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02801309f0 0x7f0280130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f027f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02801309f0 0x7f0280130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58632/0 (socket says 172.21.15.154:58632) 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f027ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009e280 0x7f0280137750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58780/0 (socket says 172.21.15.154:58780) 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f027f7fe700 1 -- 172.21.15.154:0/1129062050 learned_addr learned my addr 172.21.15.154:0/1129062050 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.439+0000 7f027effd700 1 --2- 172.21.15.154:0/1129062050 >> v2:172.21.15.154:3300/0 conn(0x7f028009d8f0 0x7f028009dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027ffff700 1 -- 172.21.15.154:0/1129062050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02801309f0 msgr2=0x7f0280130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027ffff700 1 --2- 172.21.15.154:0/1129062050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02801309f0 0x7f0280130dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027ffff700 1 -- 172.21.15.154:0/1129062050 >> v2:172.21.15.154:3300/0 conn(0x7f028009d8f0 msgr2=0x7f028009dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027ffff700 1 --2- 172.21.15.154:0/1129062050 >> v2:172.21.15.154:3300/0 conn(0x7f028009d8f0 0x7f028009dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027ffff700 1 -- 172.21.15.154:0/1129062050 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028009e6f0 con 0x7f028009e280 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027f7fe700 1 --2- 172.21.15.154:0/1129062050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02801309f0 0x7f0280130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027effd700 1 --2- 172.21.15.154:0/1129062050 >> v2:172.21.15.154:3300/0 conn(0x7f028009d8f0 0x7f028009dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027ffff700 1 --2- 172.21.15.154:0/1129062050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009e280 0x7f0280137750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0278009d90 tx=0x7f027800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a653c293f0cab295 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:47.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027e7fc700 1 -- 172.21.15.154:0/1129062050 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800e070 con 0x7f028009e280 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027e7fc700 1 -- 172.21.15.154:0/1129062050 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027800bb20 con 0x7f028009e280 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.440+0000 7f027e7fc700 1 -- 172.21.15.154:0/1129062050 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278012430 con 0x7f028009e280 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.441+0000 7f02860a3700 1 -- 172.21.15.154:0/1129062050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009e280 msgr2=0x7f0280137750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.441+0000 7f02860a3700 1 --2- 172.21.15.154:0/1129062050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009e280 0x7f0280137750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0278009d90 tx=0x7f027800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.441+0000 7f02860a3700 1 -- 172.21.15.154:0/1129062050 shutdown_connections 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.441+0000 7f02860a3700 1 --2- 172.21.15.154:0/1129062050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02801309f0 0x7f0280130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.441+0000 7f02860a3700 1 --2- 172.21.15.154:0/1129062050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009e280 0x7f0280137750 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.441+0000 7f02860a3700 1 --2- 172.21.15.154:0/1129062050 >> v2:172.21.15.154:3300/0 conn(0x7f028009d8f0 0x7f028009dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.441+0000 7f02860a3700 1 -- 172.21.15.154:0/1129062050 >> 172.21.15.154:0/1129062050 conn(0x7f02800a2b30 msgr2=0x7f028009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.441+0000 7f02860a3700 1 -- 172.21.15.154:0/1129062050 shutdown_connections 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.441+0000 7f02860a3700 1 -- 172.21.15.154:0/1129062050 wait complete. 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f02860a3700 1 Processor -- start 2023-09-30T22:23:47.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f02860a3700 1 -- start start 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f02860a3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009d8f0 0x7f028012b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f02860a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028009e280 0x7f028012b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f02860a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801309f0 0x7f028012be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f02860a3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028009d2a0 con 0x7f02801309f0 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f02860a3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028012dbf0 con 0x7f028009e280 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f02860a3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f028008b7b0 con 0x7f028009d8f0 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f027f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009d8f0 0x7f028012b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f027effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028009e280 0x7f028012b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f027f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009d8f0 0x7f028012b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58794/0 (socket says 172.21.15.154:58794) 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.442+0000 7f027f7fe700 1 -- 172.21.15.154:0/527347959 learned_addr learned my addr 172.21.15.154:0/527347959 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f027ffff700 1 --2- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801309f0 0x7f028012be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f027f7fe700 1 -- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028009e280 msgr2=0x7f028012b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f027f7fe700 1 --2- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028009e280 0x7f028012b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f027f7fe700 1 -- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801309f0 msgr2=0x7f028012be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f027f7fe700 1 --2- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801309f0 0x7f028012be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f027f7fe700 1 -- 172.21.15.154:0/527347959 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740094a0 con 0x7f028009d8f0 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f027effd700 1 --2- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028009e280 0x7f028012b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f027f7fe700 1 --2- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009d8f0 0x7f028012b3b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f027000ed40 tx=0x7f027000d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f0267fff700 1 -- 172.21.15.154:0/527347959 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000dd30 con 0x7f028009d8f0 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f0267fff700 1 -- 172.21.15.154:0/527347959 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027000de90 con 0x7f028009d8f0 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f0267fff700 1 -- 172.21.15.154:0/527347959 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270005c60 con 0x7f028009d8f0 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f02860a3700 1 -- 172.21.15.154:0/527347959 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027000b7a0 con 0x7f028009d8f0 2023-09-30T22:23:47.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.443+0000 7f02860a3700 1 -- 172.21.15.154:0/527347959 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0278009a70 con 0x7f028009d8f0 2023-09-30T22:23:47.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.444+0000 7f0267fff700 1 -- 172.21.15.154:0/527347959 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0270006030 con 0x7f028009d8f0 2023-09-30T22:23:47.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.444+0000 7f0267fff700 1 -- 172.21.15.154:0/527347959 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f027003fce0 con 0x7f028009d8f0 2023-09-30T22:23:47.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.445+0000 7f02860a3700 1 -- 172.21.15.154:0/527347959 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028004f2a0 con 0x7f028009d8f0 2023-09-30T22:23:47.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.449+0000 7f0267fff700 1 -- 172.21.15.154:0/527347959 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0270010440 con 0x7f028009d8f0 2023-09-30T22:23:47.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.582+0000 7ff6bb496700 1 -- 172.21.15.154:0/4265753008 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff6b4121880 con 0x7ff6b412d280 2023-09-30T22:23:47.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.582+0000 7ff6a9ffb700 1 -- 172.21.15.154:0/4265753008 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6b4121880 con 0x7ff6b412d280 2023-09-30T22:23:47.582 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:47.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.584+0000 7ff6bb496700 1 -- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b412d280 msgr2=0x7ff6b411e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.584+0000 7ff6bb496700 1 --2- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b412d280 0x7ff6b411e250 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0000c00 tx=0x7ff6b0004750 comp rx=0 tx=0).stop 2023-09-30T22:23:47.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.584+0000 7ff6bb496700 1 -- 172.21.15.154:0/4265753008 shutdown_connections 2023-09-30T22:23:47.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.584+0000 7ff6bb496700 1 --2- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b4130ec0 0x7ff6b411ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.584+0000 7ff6bb496700 1 --2- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b412d280 0x7ff6b411e250 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.584+0000 7ff6bb496700 1 --2- 172.21.15.154:0/4265753008 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b4130350 0x7ff6b411e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.584+0000 7ff6bb496700 1 -- 172.21.15.154:0/4265753008 >> 172.21.15.154:0/4265753008 conn(0x7ff6b40a2980 msgr2=0x7ff6b4099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.585+0000 7ff6bb496700 1 -- 172.21.15.154:0/4265753008 shutdown_connections 2023-09-30T22:23:47.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.585+0000 7ff6bb496700 1 -- 172.21.15.154:0/4265753008 wait complete. 2023-09-30T22:23:47.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:47.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.620+0000 7f94e8d35700 1 -- 172.21.15.154:0/1860518500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f94e409f0f0 con 0x7f94e4133ad0 2023-09-30T22:23:47.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.620+0000 7f94d2ffd700 1 -- 172.21.15.154:0/1860518500 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94d401bb10 con 0x7f94e4133ad0 2023-09-30T22:23:47.620 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:47.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.622+0000 7f94e8d35700 1 -- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4133ad0 msgr2=0x7f94e4071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.622+0000 7f94e8d35700 1 --2- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4133ad0 0x7f94e4071830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f94d4000f60 tx=0x7f94d400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.622+0000 7f94e8d35700 1 -- 172.21.15.154:0/1860518500 shutdown_connections 2023-09-30T22:23:47.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.622+0000 7f94e8d35700 1 --2- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f94e4139280 0x7f94e41c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.622+0000 7f94e8d35700 1 --2- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e4133ad0 0x7f94e4071830 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.622+0000 7f94e8d35700 1 --2- 172.21.15.154:0/1860518500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e4136960 0x7f94e4071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.622+0000 7f94e8d35700 1 -- 172.21.15.154:0/1860518500 >> 172.21.15.154:0/1860518500 conn(0x7f94e4099c40 msgr2=0x7f94e4138700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.622+0000 7f94e8d35700 1 -- 172.21.15.154:0/1860518500 shutdown_connections 2023-09-30T22:23:47.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.622+0000 7f94e8d35700 1 -- 172.21.15.154:0/1860518500 wait complete. 2023-09-30T22:23:47.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:47.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.645+0000 7f02860a3700 1 -- 172.21.15.154:0/527347959 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f028012d190 con 0x7f028009d8f0 2023-09-30T22:23:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.645+0000 7f0267fff700 1 -- 172.21.15.154:0/527347959 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02700173a0 con 0x7f028009d8f0 2023-09-30T22:23:47.645 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.647+0000 7f02860a3700 1 -- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009d8f0 msgr2=0x7f028012b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.647+0000 7f02860a3700 1 --2- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009d8f0 0x7f028012b3b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f027000ed40 tx=0x7f027000d630 comp rx=0 tx=0).stop 2023-09-30T22:23:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.647+0000 7f02860a3700 1 -- 172.21.15.154:0/527347959 shutdown_connections 2023-09-30T22:23:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.647+0000 7f02860a3700 1 --2- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801309f0 0x7f028012be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.647+0000 7f02860a3700 1 --2- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f028009d8f0 0x7f028012b3b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.647+0000 7f02860a3700 1 --2- 172.21.15.154:0/527347959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028009e280 0x7f028012b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.647+0000 7f02860a3700 1 -- 172.21.15.154:0/527347959 >> 172.21.15.154:0/527347959 conn(0x7f02800a2b30 msgr2=0x7f0280098720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.647+0000 7f02860a3700 1 -- 172.21.15.154:0/527347959 shutdown_connections 2023-09-30T22:23:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.647+0000 7f02860a3700 1 -- 172.21.15.154:0/527347959 wait complete. 2023-09-30T22:23:47.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:47.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:47.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.837+0000 7f78a4ad5700 1 Processor -- start 2023-09-30T22:23:47.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.837+0000 7f78a4ad5700 1 -- start start 2023-09-30T22:23:47.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f78a4ad5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a006a770 0x7f78a006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f78a4ad5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78a0131ec0 0x7f78a0139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f78a4ad5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a009da80 con 0x7f78a006b080 2023-09-30T22:23:47.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f78a4ad5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a009dce0 con 0x7f78a0131ec0 2023-09-30T22:23:47.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f78a4ad5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a009eb20 con 0x7f78a006a770 2023-09-30T22:23:47.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a006a770 0x7f78a006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78a0131ec0 0x7f78a0139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78a0131ec0 0x7f78a0139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44572/0 (socket says 172.21.15.154:44572) 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a006a770 0x7f78a006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58798/0 (socket says 172.21.15.154:58798) 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789ed9d700 1 -- 172.21.15.154:0/342757372 learned_addr learned my addr 172.21.15.154:0/342757372 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789dd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f78a006b080 0x7f78a01317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41066/0 (socket says 172.21.15.154:41066) 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789e59c700 1 -- 172.21.15.154:0/342757372 >> v2:172.21.15.154:3300/0 conn(0x7f78a0131ec0 msgr2=0x7f78a0139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789e59c700 1 --2- 172.21.15.154:0/342757372 >> v2:172.21.15.154:3300/0 conn(0x7f78a0131ec0 0x7f78a0139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789e59c700 1 -- 172.21.15.154:0/342757372 >> v1:172.21.15.154:6789/0 conn(0x7f78a006b080 legacy=0x7f78a01317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789e59c700 1 -- 172.21.15.154:0/342757372 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a009d860 con 0x7f78a006a770 2023-09-30T22:23:47.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.838+0000 7f789ed9d700 1 --2- 172.21.15.154:0/342757372 >> v2:172.21.15.154:3300/0 conn(0x7f78a0131ec0 0x7f78a0139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f789e59c700 1 --2- 172.21.15.154:0/342757372 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a006a770 0x7f78a006ab40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7888009840 tx=0x7f7888009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd480dbbb5de4dc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f789d59a700 1 -- 172.21.15.154:0/342757372 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888011830 con 0x7f78a006a770 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f789d59a700 1 -- 172.21.15.154:0/342757372 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7888011990 con 0x7f78a006a770 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f789d59a700 1 -- 172.21.15.154:0/342757372 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888011d20 con 0x7f78a006a770 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f78a4ad5700 1 -- 172.21.15.154:0/342757372 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a006a770 msgr2=0x7f78a006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f78a4ad5700 1 --2- 172.21.15.154:0/342757372 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a006a770 0x7f78a006ab40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7888009840 tx=0x7f7888009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f78a4ad5700 1 -- 172.21.15.154:0/342757372 shutdown_connections 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f78a4ad5700 1 --2- 172.21.15.154:0/342757372 >> v2:172.21.15.154:3300/0 conn(0x7f78a0131ec0 0x7f78a0139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f78a4ad5700 1 --2- 172.21.15.154:0/342757372 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a006a770 0x7f78a006ab40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f78a4ad5700 1 -- 172.21.15.154:0/342757372 >> 172.21.15.154:0/342757372 conn(0x7f78a0099c40 msgr2=0x7f78a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f78a4ad5700 1 -- 172.21.15.154:0/342757372 shutdown_connections 2023-09-30T22:23:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.839+0000 7f78a4ad5700 1 -- 172.21.15.154:0/342757372 wait complete. 2023-09-30T22:23:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.840+0000 7f78a4ad5700 1 Processor -- start 2023-09-30T22:23:47.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.840+0000 7f78a4ad5700 1 -- start start 2023-09-30T22:23:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f78a4ad5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a006a770 0x7f78a011f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f78a4ad5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a006b080 0x7f78a011f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f78a4ad5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a0131ec0 0x7f78a011fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f78a4ad5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0122bc0 con 0x7f78a006b080 2023-09-30T22:23:47.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f78a4ad5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0121b40 con 0x7f78a006a770 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f78a4ad5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0071e10 con 0x7f78a0131ec0 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a006a770 0x7f78a011f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a006b080 0x7f78a011f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a006a770 0x7f78a011f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58646/0 (socket says 172.21.15.154:58646) 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a006b080 0x7f78a011f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44578/0 (socket says 172.21.15.154:44578) 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789e59c700 1 -- 172.21.15.154:0/4281163744 learned_addr learned my addr 172.21.15.154:0/4281163744 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789ed9d700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a0131ec0 0x7f78a011fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789e59c700 1 -- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a0131ec0 msgr2=0x7f78a011fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789e59c700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a0131ec0 0x7f78a011fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789e59c700 1 -- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a006b080 msgr2=0x7f78a011f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:47.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789e59c700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a006b080 0x7f78a011f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:47.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789e59c700 1 -- 172.21.15.154:0/4281163744 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009b30 con 0x7f78a006a770 2023-09-30T22:23:47.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789ed9d700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a0131ec0 0x7f78a011fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:47.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789dd9b700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a006b080 0x7f78a011f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:47.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.841+0000 7f789e59c700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a006a770 0x7f78a011f0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f78880090b0 tx=0x7f7888004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:47.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.842+0000 7f7896ffd700 1 -- 172.21.15.154:0/4281163744 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78880036a0 con 0x7f78a006a770 2023-09-30T22:23:47.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.842+0000 7f7896ffd700 1 -- 172.21.15.154:0/4281163744 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788801f070 con 0x7f78a006a770 2023-09-30T22:23:47.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.842+0000 7f78a4ad5700 1 -- 172.21.15.154:0/4281163744 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78880094a0 con 0x7f78a006a770 2023-09-30T22:23:47.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.842+0000 7f7896ffd700 1 -- 172.21.15.154:0/4281163744 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888003a60 con 0x7f78a006a770 2023-09-30T22:23:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.842+0000 7f78a4ad5700 1 -- 172.21.15.154:0/4281163744 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a0120cb0 con 0x7f78a006a770 2023-09-30T22:23:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.842+0000 7f7896ffd700 1 -- 172.21.15.154:0/4281163744 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7888003bc0 con 0x7f78a006a770 2023-09-30T22:23:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.843+0000 7f7896ffd700 1 -- 172.21.15.154:0/4281163744 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7888021070 con 0x7f78a006a770 2023-09-30T22:23:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.843+0000 7f78a4ad5700 1 -- 172.21.15.154:0/4281163744 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a011bde0 con 0x7f78a006a770 2023-09-30T22:23:47.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:47.847+0000 7f7896ffd700 1 -- 172.21.15.154:0/4281163744 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f788802b080 con 0x7f78a006a770 2023-09-30T22:23:48.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.034+0000 7f78a4ad5700 1 -- 172.21.15.154:0/4281163744 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78a004f2a0 con 0x7f78a006a770 2023-09-30T22:23:48.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.034+0000 7f7896ffd700 1 -- 172.21.15.154:0/4281163744 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7888015020 con 0x7f78a006a770 2023-09-30T22:23:48.035 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:48.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.036+0000 7f78a4ad5700 1 -- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a006a770 msgr2=0x7f78a011f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.036+0000 7f78a4ad5700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a006a770 0x7f78a011f0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f78880090b0 tx=0x7f7888004750 comp rx=0 tx=0).stop 2023-09-30T22:23:48.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.036+0000 7f78a4ad5700 1 -- 172.21.15.154:0/4281163744 shutdown_connections 2023-09-30T22:23:48.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.036+0000 7f78a4ad5700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a0131ec0 0x7f78a011fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.036+0000 7f78a4ad5700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a006a770 0x7f78a011f0f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.036+0000 7f78a4ad5700 1 --2- 172.21.15.154:0/4281163744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a006b080 0x7f78a011f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.036+0000 7f78a4ad5700 1 -- 172.21.15.154:0/4281163744 >> 172.21.15.154:0/4281163744 conn(0x7f78a0099c40 msgr2=0x7f78a0130fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.036+0000 7f78a4ad5700 1 -- 172.21.15.154:0/4281163744 shutdown_connections 2023-09-30T22:23:48.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.037+0000 7f78a4ad5700 1 -- 172.21.15.154:0/4281163744 wait complete. 2023-09-30T22:23:48.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:48.598 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:48.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:48.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa96d2700 1 Processor -- start 2023-09-30T22:23:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa96d2700 1 -- start start 2023-09-30T22:23:48.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa96d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4133900 0x7feaa4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa96d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4134210 0x7feaa40a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa96d2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa409a760 con 0x7feaa40a0ee0 2023-09-30T22:23:48.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa96d2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa41336e0 con 0x7feaa4133900 2023-09-30T22:23:48.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa96d2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa409a080 con 0x7feaa4134210 2023-09-30T22:23:48.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4134210 0x7feaa40a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4134210 0x7feaa40a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58828/0 (socket says 172.21.15.154:58828) 2023-09-30T22:23:48.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa37fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7feaa40a0ee0 0x7feaa413a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41074/0 (socket says 172.21.15.154:41074) 2023-09-30T22:23:48.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.728+0000 7feaa27fc700 1 -- 172.21.15.154:0/4101010592 learned_addr learned my addr 172.21.15.154:0/4101010592 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa2ffd700 1 --2- 172.21.15.154:0/4101010592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4133900 0x7feaa4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa27fc700 1 -- 172.21.15.154:0/4101010592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4133900 msgr2=0x7feaa4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa27fc700 1 --2- 172.21.15.154:0/4101010592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4133900 0x7feaa4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa1ffb700 1 -- 172.21.15.154:0/4101010592 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398949517 0 0) 0x7feaa409a760 con 0x7feaa40a0ee0 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa27fc700 1 -- 172.21.15.154:0/4101010592 >> v1:172.21.15.154:6789/0 conn(0x7feaa40a0ee0 legacy=0x7feaa413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa27fc700 1 -- 172.21.15.154:0/4101010592 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40a23e0 con 0x7feaa4134210 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa2ffd700 1 --2- 172.21.15.154:0/4101010592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4133900 0x7feaa4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa27fc700 1 --2- 172.21.15.154:0/4101010592 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4134210 0x7feaa40a09a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fea98009920 tx=0x7fea98009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24067b63bb043d83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa1ffb700 1 -- 172.21.15.154:0/4101010592 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98011830 con 0x7feaa4134210 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa1ffb700 1 -- 172.21.15.154:0/4101010592 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea98011990 con 0x7feaa4134210 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.729+0000 7feaa1ffb700 1 -- 172.21.15.154:0/4101010592 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98011d20 con 0x7feaa4134210 2023-09-30T22:23:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.730+0000 7feaa96d2700 1 -- 172.21.15.154:0/4101010592 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4134210 msgr2=0x7feaa40a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.730+0000 7feaa96d2700 1 --2- 172.21.15.154:0/4101010592 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4134210 0x7feaa40a09a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fea98009920 tx=0x7fea98009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.730+0000 7feaa96d2700 1 -- 172.21.15.154:0/4101010592 shutdown_connections 2023-09-30T22:23:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.730+0000 7feaa96d2700 1 --2- 172.21.15.154:0/4101010592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4133900 0x7feaa4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.730+0000 7feaa96d2700 1 --2- 172.21.15.154:0/4101010592 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4134210 0x7feaa40a09a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.730+0000 7feaa96d2700 1 -- 172.21.15.154:0/4101010592 >> 172.21.15.154:0/4101010592 conn(0x7feaa40a2980 msgr2=0x7feaa40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.730+0000 7feaa96d2700 1 -- 172.21.15.154:0/4101010592 shutdown_connections 2023-09-30T22:23:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.730+0000 7feaa96d2700 1 -- 172.21.15.154:0/4101010592 wait complete. 2023-09-30T22:23:48.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.731+0000 7feaa96d2700 1 Processor -- start 2023-09-30T22:23:48.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.731+0000 7feaa96d2700 1 -- start start 2023-09-30T22:23:48.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.731+0000 7feaa96d2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa40a0ee0 0x7feaa411d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa96d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4133900 0x7feaa411dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa96d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4134210 0x7feaa411e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa96d2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa411ebc0 con 0x7feaa40a0ee0 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa96d2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa411f320 con 0x7feaa4134210 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa96d2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa4120570 con 0x7feaa4133900 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa40a0ee0 0x7feaa411d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4133900 0x7feaa411dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa40a0ee0 0x7feaa411d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44586/0 (socket says 172.21.15.154:44586) 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa2ffd700 1 -- 172.21.15.154:0/3063574385 learned_addr learned my addr 172.21.15.154:0/3063574385 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa37fe700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4134210 0x7feaa411e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa2ffd700 1 -- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4133900 msgr2=0x7feaa411dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa2ffd700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4133900 0x7feaa411dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa2ffd700 1 -- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4134210 msgr2=0x7feaa411e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa2ffd700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4134210 0x7feaa411e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa2ffd700 1 -- 172.21.15.154:0/3063574385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea94009430 con 0x7feaa40a0ee0 2023-09-30T22:23:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa37fe700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4134210 0x7feaa411e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa27fc700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4133900 0x7feaa411dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7feaa2ffd700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa40a0ee0 0x7feaa411d710 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fea9400ec10 tx=0x7fea9400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.732+0000 7fea8b7fe700 1 -- 172.21.15.154:0/3063574385 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94005a20 con 0x7feaa40a0ee0 2023-09-30T22:23:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.733+0000 7fea8b7fe700 1 -- 172.21.15.154:0/3063574385 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94005b80 con 0x7feaa40a0ee0 2023-09-30T22:23:48.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.733+0000 7fea8b7fe700 1 -- 172.21.15.154:0/3063574385 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400c850 con 0x7feaa40a0ee0 2023-09-30T22:23:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.733+0000 7feaa96d2700 1 -- 172.21.15.154:0/3063574385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea98009550 con 0x7feaa40a0ee0 2023-09-30T22:23:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.733+0000 7feaa96d2700 1 -- 172.21.15.154:0/3063574385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa41209c0 con 0x7feaa40a0ee0 2023-09-30T22:23:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.733+0000 7fea8b7fe700 1 -- 172.21.15.154:0/3063574385 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea9400c9b0 con 0x7feaa40a0ee0 2023-09-30T22:23:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.734+0000 7fea8b7fe700 1 -- 172.21.15.154:0/3063574385 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea9403f8e0 con 0x7feaa40a0ee0 2023-09-30T22:23:48.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.734+0000 7feaa96d2700 1 -- 172.21.15.154:0/3063574385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa411a590 con 0x7feaa40a0ee0 2023-09-30T22:23:48.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.739+0000 7fea8b7fe700 1 -- 172.21.15.154:0/3063574385 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea94020070 con 0x7feaa40a0ee0 2023-09-30T22:23:48.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.769+0000 7f01646a5700 1 Processor -- start 2023-09-30T22:23:48.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.769+0000 7f01646a5700 1 -- start start 2023-09-30T22:23:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f01646a5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f015c09ad40 0x7f015c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f01646a5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c133f70 0x7f015c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f01646a5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c0a0a70 0x7f015c0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f01646a5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c0a3b60 con 0x7f015c09ad40 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f01646a5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c1348e0 con 0x7f015c133f70 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f01646a5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f015c09b110 con 0x7f015c0a0a70 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162441700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f015c09ad40 0x7f015c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0161c40700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c133f70 0x7f015c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162441700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f015c09ad40 0x7f015c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44602/0 (socket says 172.21.15.154:44602) 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0161c40700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c133f70 0x7f015c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58674/0 (socket says 172.21.15.154:58674) 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162441700 1 -- 172.21.15.154:0/3986257125 learned_addr learned my addr 172.21.15.154:0/3986257125 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162c42700 1 --2- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c0a0a70 0x7f015c0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162441700 1 -- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c0a0a70 msgr2=0x7f015c0a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162441700 1 --2- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c0a0a70 0x7f015c0a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162441700 1 -- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c133f70 msgr2=0x7f015c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162441700 1 --2- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c133f70 0x7f015c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162441700 1 -- 172.21.15.154:0/3986257125 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c0a2fa0 con 0x7f015c09ad40 2023-09-30T22:23:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0161c40700 1 --2- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c133f70 0x7f015c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.770+0000 7f0162441700 1 --2- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015c09ad40 0x7f015c133a30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0158009920 tx=0x7f0158009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfcaf586ec7c820 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.771+0000 7f016143f700 1 -- 172.21.15.154:0/3986257125 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158011830 con 0x7f015c09ad40 2023-09-30T22:23:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.771+0000 7f016143f700 1 -- 172.21.15.154:0/3986257125 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158011990 con 0x7f015c09ad40 2023-09-30T22:23:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.771+0000 7f016143f700 1 -- 172.21.15.154:0/3986257125 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158011d20 con 0x7f015c09ad40 2023-09-30T22:23:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.771+0000 7f01646a5700 1 -- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015c09ad40 msgr2=0x7f015c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.772+0000 7f01646a5700 1 --2- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015c09ad40 0x7f015c133a30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0158009920 tx=0x7f0158009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.772+0000 7f01646a5700 1 -- 172.21.15.154:0/3986257125 shutdown_connections 2023-09-30T22:23:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.772+0000 7f01646a5700 1 --2- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c0a0a70 0x7f015c0a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.772+0000 7f01646a5700 1 --2- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015c09ad40 0x7f015c133a30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.772+0000 7f01646a5700 1 --2- 172.21.15.154:0/3986257125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c133f70 0x7f015c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.772+0000 7f01646a5700 1 -- 172.21.15.154:0/3986257125 >> 172.21.15.154:0/3986257125 conn(0x7f015c099c40 msgr2=0x7f015c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.772+0000 7f01646a5700 1 -- 172.21.15.154:0/3986257125 shutdown_connections 2023-09-30T22:23:48.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.772+0000 7f01646a5700 1 -- 172.21.15.154:0/3986257125 wait complete. 2023-09-30T22:23:48.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.773+0000 7f01646a5700 1 Processor -- start 2023-09-30T22:23:48.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.773+0000 7f01646a5700 1 -- start start 2023-09-30T22:23:48.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f01646a5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c09ad40 0x7f015c121310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f01646a5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c0a0a70 0x7f015c121850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f01646a5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015c133f70 0x7f015c121d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f01646a5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c124e30 con 0x7f015c133f70 2023-09-30T22:23:48.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f01646a5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c123dd0 con 0x7f015c0a0a70 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f01646a5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f015c122770 con 0x7f015c09ad40 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0161c40700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c0a0a70 0x7f015c121850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0161c40700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c0a0a70 0x7f015c121850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58678/0 (socket says 172.21.15.154:58678) 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0161c40700 1 -- 172.21.15.154:0/4292035101 learned_addr learned my addr 172.21.15.154:0/4292035101 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0162441700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c09ad40 0x7f015c121310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0162c42700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015c133f70 0x7f015c121d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0161c40700 1 -- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c09ad40 msgr2=0x7f015c121310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0161c40700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c09ad40 0x7f015c121310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0161c40700 1 -- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015c133f70 msgr2=0x7f015c121d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0161c40700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015c133f70 0x7f015c121d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0161c40700 1 -- 172.21.15.154:0/4292035101 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0094a0 con 0x7f015c0a0a70 2023-09-30T22:23:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0162441700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c09ad40 0x7f015c121310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.774+0000 7f0161c40700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c0a0a70 0x7f015c121850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f014c00ec10 tx=0x7f014c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.775+0000 7f0152ffd700 1 -- 172.21.15.154:0/4292035101 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00c850 con 0x7f015c0a0a70 2023-09-30T22:23:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.775+0000 7f0152ffd700 1 -- 172.21.15.154:0/4292035101 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c00c9b0 con 0x7f015c0a0a70 2023-09-30T22:23:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.775+0000 7f01646a5700 1 -- 172.21.15.154:0/4292035101 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0158009550 con 0x7f015c0a0a70 2023-09-30T22:23:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.775+0000 7f0152ffd700 1 -- 172.21.15.154:0/4292035101 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00cd20 con 0x7f015c0a0a70 2023-09-30T22:23:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.775+0000 7f01646a5700 1 -- 172.21.15.154:0/4292035101 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c124890 con 0x7f015c0a0a70 2023-09-30T22:23:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.776+0000 7f0152ffd700 1 -- 172.21.15.154:0/4292035101 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f014c013470 con 0x7f015c0a0a70 2023-09-30T22:23:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.776+0000 7f0152ffd700 1 -- 172.21.15.154:0/4292035101 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f014c03f8f0 con 0x7f015c0a0a70 2023-09-30T22:23:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.776+0000 7f01646a5700 1 -- 172.21.15.154:0/4292035101 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c04f2a0 con 0x7f015c0a0a70 2023-09-30T22:23:48.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.781+0000 7f0152ffd700 1 -- 172.21.15.154:0/4292035101 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f014c013720 con 0x7f015c0a0a70 2023-09-30T22:23:48.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f3730fbb700 1 Processor -- start 2023-09-30T22:23:48.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f3730fbb700 1 -- start start 2023-09-30T22:23:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f3730fbb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a0a70 0x7f372c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f3730fbb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f372c134120 0x7f372c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f3730fbb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372c09dc00 con 0x7f372c0a1380 2023-09-30T22:23:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f3730fbb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c09ea60 con 0x7f372c134120 2023-09-30T22:23:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f3730fbb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c09dec0 con 0x7f372c0a0a70 2023-09-30T22:23:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f372a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a0a70 0x7f372c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f372a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a0a70 0x7f372c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58688/0 (socket says 172.21.15.154:58688) 2023-09-30T22:23:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f372ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f372c134120 0x7f372c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.813+0000 7f372a59c700 1 -- 172.21.15.154:0/2959217460 learned_addr learned my addr 172.21.15.154:0/2959217460 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.814+0000 7f372a59c700 1 -- 172.21.15.154:0/2959217460 >> v2:172.21.15.154:3300/0 conn(0x7f372c134120 msgr2=0x7f372c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.814+0000 7f372a59c700 1 --2- 172.21.15.154:0/2959217460 >> v2:172.21.15.154:3300/0 conn(0x7f372c134120 0x7f372c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.814+0000 7f372a59c700 1 -- 172.21.15.154:0/2959217460 >> v1:172.21.15.154:6789/0 conn(0x7f372c0a1380 legacy=0x7f372c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.814+0000 7f372a59c700 1 -- 172.21.15.154:0/2959217460 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c09e6a0 con 0x7f372c0a0a70 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.814+0000 7f372ad9d700 1 --2- 172.21.15.154:0/2959217460 >> v2:172.21.15.154:3300/0 conn(0x7f372c134120 0x7f372c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.814+0000 7f372a59c700 1 --2- 172.21.15.154:0/2959217460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a0a70 0x7f372c0a0e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f371c0098f0 tx=0x7f371c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14e5d6ffa7753b71 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.814+0000 7f372959a700 1 -- 172.21.15.154:0/2959217460 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c011830 con 0x7f372c0a0a70 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.814+0000 7f372959a700 1 -- 172.21.15.154:0/2959217460 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c011990 con 0x7f372c0a0a70 2023-09-30T22:23:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.814+0000 7f372959a700 1 -- 172.21.15.154:0/2959217460 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c011d20 con 0x7f372c0a0a70 2023-09-30T22:23:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.815+0000 7f3730fbb700 1 -- 172.21.15.154:0/2959217460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a0a70 msgr2=0x7f372c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.815+0000 7f3730fbb700 1 --2- 172.21.15.154:0/2959217460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a0a70 0x7f372c0a0e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f371c0098f0 tx=0x7f371c009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.815+0000 7f3730fbb700 1 -- 172.21.15.154:0/2959217460 shutdown_connections 2023-09-30T22:23:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.815+0000 7f3730fbb700 1 --2- 172.21.15.154:0/2959217460 >> v2:172.21.15.154:3300/0 conn(0x7f372c134120 0x7f372c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.815+0000 7f3730fbb700 1 --2- 172.21.15.154:0/2959217460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a0a70 0x7f372c0a0e40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.815+0000 7f3730fbb700 1 -- 172.21.15.154:0/2959217460 >> 172.21.15.154:0/2959217460 conn(0x7f372c0a6610 msgr2=0x7f372c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.815+0000 7f3730fbb700 1 -- 172.21.15.154:0/2959217460 shutdown_connections 2023-09-30T22:23:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.815+0000 7f3730fbb700 1 -- 172.21.15.154:0/2959217460 wait complete. 2023-09-30T22:23:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.816+0000 7f3730fbb700 1 Processor -- start 2023-09-30T22:23:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.816+0000 7f3730fbb700 1 -- start start 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f3730fbb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f372c0a0a70 0x7f372c122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f3730fbb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a1380 0x7f372c122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f3730fbb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f372c134120 0x7f372c1233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f3730fbb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c133a90 con 0x7f372c0a0a70 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f3730fbb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0a03e0 con 0x7f372c0a1380 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f3730fbb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f372c1337f0 con 0x7f372c134120 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f372a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f372c0a0a70 0x7f372c122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f372a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f372c0a0a70 0x7f372c122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44622/0 (socket says 172.21.15.154:44622) 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f372a59c700 1 -- 172.21.15.154:0/2870510711 learned_addr learned my addr 172.21.15.154:0/2870510711 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f372ad9d700 1 --2- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f372c134120 0x7f372c1233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f3729d9b700 1 --2- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a1380 0x7f372c122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f372a59c700 1 -- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f372c134120 msgr2=0x7f372c1233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f372a59c700 1 --2- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f372c134120 0x7f372c1233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f372a59c700 1 -- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a1380 msgr2=0x7f372c122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f372a59c700 1 --2- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a1380 0x7f372c122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.817+0000 7f372a59c700 1 -- 172.21.15.154:0/2870510711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3724009a70 con 0x7f372c0a0a70 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.818+0000 7f372a59c700 1 --2- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f372c0a0a70 0x7f372c122970 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f371c000c00 tx=0x7f371c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.818+0000 7f371affd700 1 -- 172.21.15.154:0/2870510711 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0043c0 con 0x7f372c0a0a70 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.818+0000 7f371affd700 1 -- 172.21.15.154:0/2870510711 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c01f070 con 0x7f372c0a0a70 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.818+0000 7f3730fbb700 1 -- 172.21.15.154:0/2870510711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c009550 con 0x7f372c0a0a70 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.818+0000 7f371affd700 1 -- 172.21.15.154:0/2870510711 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0038c0 con 0x7f372c0a0a70 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.818+0000 7f3730fbb700 1 -- 172.21.15.154:0/2870510711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c125e70 con 0x7f372c0a0a70 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.819+0000 7f371affd700 1 -- 172.21.15.154:0/2870510711 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f371c021030 con 0x7f372c0a0a70 2023-09-30T22:23:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.819+0000 7f3730fbb700 1 -- 172.21.15.154:0/2870510711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c04f2a0 con 0x7f372c0a0a70 2023-09-30T22:23:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.819+0000 7f371affd700 1 -- 172.21.15.154:0/2870510711 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f371c040960 con 0x7f372c0a0a70 2023-09-30T22:23:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.824+0000 7f371affd700 1 -- 172.21.15.154:0/2870510711 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f371c0199a0 con 0x7f372c0a0a70 2023-09-30T22:23:48.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.935+0000 7feaa96d2700 1 -- 172.21.15.154:0/3063574385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feaa4132c60 con 0x7feaa40a0ee0 2023-09-30T22:23:48.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.935+0000 7fea8b7fe700 1 -- 172.21.15.154:0/3063574385 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea94029090 con 0x7feaa40a0ee0 2023-09-30T22:23:48.935 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:48.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.937+0000 7feaa96d2700 1 -- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa40a0ee0 msgr2=0x7feaa411d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.937+0000 7feaa96d2700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa40a0ee0 0x7feaa411d710 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fea9400ec10 tx=0x7fea9400ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:48.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.937+0000 7feaa96d2700 1 -- 172.21.15.154:0/3063574385 shutdown_connections 2023-09-30T22:23:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.937+0000 7feaa96d2700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaa4134210 0x7feaa411e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.937+0000 7feaa96d2700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa40a0ee0 0x7feaa411d710 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.937+0000 7feaa96d2700 1 --2- 172.21.15.154:0/3063574385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaa4133900 0x7feaa411dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.937+0000 7feaa96d2700 1 -- 172.21.15.154:0/3063574385 >> 172.21.15.154:0/3063574385 conn(0x7feaa40a2980 msgr2=0x7feaa41bac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.937+0000 7feaa96d2700 1 -- 172.21.15.154:0/3063574385 shutdown_connections 2023-09-30T22:23:48.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.937+0000 7feaa96d2700 1 -- 172.21.15.154:0/3063574385 wait complete. 2023-09-30T22:23:48.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:48.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.977+0000 7f01646a5700 1 -- 172.21.15.154:0/4292035101 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f015c122f20 con 0x7f015c0a0a70 2023-09-30T22:23:48.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.977+0000 7f0152ffd700 1 -- 172.21.15.154:0/4292035101 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f014c02a090 con 0x7f015c0a0a70 2023-09-30T22:23:48.977 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:48.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.979+0000 7f01646a5700 1 -- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c0a0a70 msgr2=0x7f015c121850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:48.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.979+0000 7f01646a5700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c0a0a70 0x7f015c121850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f014c00ec10 tx=0x7f014c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:48.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.980+0000 7f01646a5700 1 -- 172.21.15.154:0/4292035101 shutdown_connections 2023-09-30T22:23:48.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.980+0000 7f01646a5700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015c133f70 0x7f015c121d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.980+0000 7f01646a5700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f015c09ad40 0x7f015c121310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.980+0000 7f01646a5700 1 --2- 172.21.15.154:0/4292035101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015c0a0a70 0x7f015c121850 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:48.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.980+0000 7f01646a5700 1 -- 172.21.15.154:0/4292035101 >> 172.21.15.154:0/4292035101 conn(0x7f015c099c40 msgr2=0x7f015c0a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:48.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.980+0000 7f01646a5700 1 -- 172.21.15.154:0/4292035101 shutdown_connections 2023-09-30T22:23:48.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:48.980+0000 7f01646a5700 1 -- 172.21.15.154:0/4292035101 wait complete. 2023-09-30T22:23:48.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:49.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.018+0000 7f3730fbb700 1 -- 172.21.15.154:0/2870510711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f372c072980 con 0x7f372c0a0a70 2023-09-30T22:23:49.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.018+0000 7f371affd700 1 -- 172.21.15.154:0/2870510711 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f371c015030 con 0x7f372c0a0a70 2023-09-30T22:23:49.018 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.021+0000 7f3730fbb700 1 -- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f372c0a0a70 msgr2=0x7f372c122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.021+0000 7f3730fbb700 1 --2- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f372c0a0a70 0x7f372c122970 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f371c000c00 tx=0x7f371c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.021+0000 7f3730fbb700 1 -- 172.21.15.154:0/2870510711 shutdown_connections 2023-09-30T22:23:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.021+0000 7f3730fbb700 1 --2- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f372c134120 0x7f372c1233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.021+0000 7f3730fbb700 1 --2- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f372c0a0a70 0x7f372c122970 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.021+0000 7f3730fbb700 1 --2- 172.21.15.154:0/2870510711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f372c0a1380 0x7f372c122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.021+0000 7f3730fbb700 1 -- 172.21.15.154:0/2870510711 >> 172.21.15.154:0/2870510711 conn(0x7f372c0a6610 msgr2=0x7f372c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.021+0000 7f3730fbb700 1 -- 172.21.15.154:0/2870510711 shutdown_connections 2023-09-30T22:23:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.021+0000 7f3730fbb700 1 -- 172.21.15.154:0/2870510711 wait complete. 2023-09-30T22:23:49.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:49.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:49.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e2504a700 1 Processor -- start 2023-09-30T22:23:49.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e2504a700 1 -- start start 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e2504a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e2009a150 0x7f7e2009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e2504a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009edb0 0x7f7e2009f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e2504a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e20133c20 0x7f7e20134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e2504a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2009a520 con 0x7f7e2009a150 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e2504a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2009fe00 con 0x7f7e20133c20 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e2504a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2006bec0 con 0x7f7e2009edb0 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009edb0 0x7f7e2009f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e1f59e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e20133c20 0x7f7e20134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e1ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e2009a150 0x7f7e2009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e1f59e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e20133c20 0x7f7e20134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58714/0 (socket says 172.21.15.154:58714) 2023-09-30T22:23:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009edb0 0x7f7e2009f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58872/0 (socket says 172.21.15.154:58872) 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e1f59e700 1 -- 172.21.15.154:0/1627434698 learned_addr learned my addr 172.21.15.154:0/1627434698 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e1ed9d700 1 -- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009edb0 msgr2=0x7f7e2009f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.195+0000 7f7e1ed9d700 1 --2- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009edb0 0x7f7e2009f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e1ed9d700 1 -- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e20133c20 msgr2=0x7f7e20134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e1ed9d700 1 --2- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e20133c20 0x7f7e20134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e1ed9d700 1 -- 172.21.15.154:0/1627434698 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2009af80 con 0x7f7e2009a150 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e1e59c700 1 --2- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009edb0 0x7f7e2009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e1f59e700 1 --2- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e20133c20 0x7f7e20134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e1ed9d700 1 --2- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e2009a150 0x7f7e2009e870 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009870 tx=0x7f7e08009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a913a93f6f4d257a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e1dd9b700 1 -- 172.21.15.154:0/1627434698 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08011830 con 0x7f7e2009a150 2023-09-30T22:23:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e1dd9b700 1 -- 172.21.15.154:0/1627434698 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08011990 con 0x7f7e2009a150 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e1dd9b700 1 -- 172.21.15.154:0/1627434698 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08011d20 con 0x7f7e2009a150 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e2504a700 1 -- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e2009a150 msgr2=0x7f7e2009e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e2504a700 1 --2- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e2009a150 0x7f7e2009e870 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009870 tx=0x7f7e08009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e2504a700 1 -- 172.21.15.154:0/1627434698 shutdown_connections 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e2504a700 1 --2- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e20133c20 0x7f7e20134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e2504a700 1 --2- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e2009a150 0x7f7e2009e870 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e2504a700 1 --2- 172.21.15.154:0/1627434698 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009edb0 0x7f7e2009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e2504a700 1 -- 172.21.15.154:0/1627434698 >> 172.21.15.154:0/1627434698 conn(0x7f7e200a4430 msgr2=0x7f7e200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e2504a700 1 -- 172.21.15.154:0/1627434698 shutdown_connections 2023-09-30T22:23:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.196+0000 7f7e2504a700 1 -- 172.21.15.154:0/1627434698 wait complete. 2023-09-30T22:23:49.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e2504a700 1 Processor -- start 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e2504a700 1 -- start start 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e2504a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009a150 0x7f7e201234d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e2504a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e2009edb0 0x7f7e20123a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e2504a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e20133c20 0x7f7e201c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e2504a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20126430 con 0x7f7e20133c20 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e2504a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20123150 con 0x7f7e2009edb0 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e2504a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200a3980 con 0x7f7e2009a150 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e1ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009a150 0x7f7e201234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e1f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e20133c20 0x7f7e201c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e1ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009a150 0x7f7e201234d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58882/0 (socket says 172.21.15.154:58882) 2023-09-30T22:23:49.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e1f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e20133c20 0x7f7e201c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44630/0 (socket says 172.21.15.154:44630) 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e1ed9d700 1 -- 172.21.15.154:0/2815570049 learned_addr learned my addr 172.21.15.154:0/2815570049 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.198+0000 7f7e1e59c700 1 --2- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e2009edb0 0x7f7e20123a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e1ed9d700 1 -- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e2009edb0 msgr2=0x7f7e20123a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e1ed9d700 1 --2- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e2009edb0 0x7f7e20123a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e1ed9d700 1 -- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e20133c20 msgr2=0x7f7e201c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e1ed9d700 1 --2- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e20133c20 0x7f7e201c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e1ed9d700 1 -- 172.21.15.154:0/2815570049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e100094a0 con 0x7f7e2009a150 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e1ed9d700 1 --2- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009a150 0x7f7e201234d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7e08014040 tx=0x7f7e08004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e177fe700 1 -- 172.21.15.154:0/2815570049 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08004510 con 0x7f7e2009a150 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e177fe700 1 -- 172.21.15.154:0/2815570049 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0801e070 con 0x7f7e2009a150 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e2504a700 1 -- 172.21.15.154:0/2815570049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e18009b30 con 0x7f7e2009a150 2023-09-30T22:23:49.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e177fe700 1 -- 172.21.15.154:0/2815570049 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080038e0 con 0x7f7e2009a150 2023-09-30T22:23:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.199+0000 7f7e2504a700 1 -- 172.21.15.154:0/2815570049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e080094a0 con 0x7f7e2009a150 2023-09-30T22:23:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.200+0000 7f7e177fe700 1 -- 172.21.15.154:0/2815570049 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e08003a40 con 0x7f7e2009a150 2023-09-30T22:23:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.200+0000 7f7e177fe700 1 -- 172.21.15.154:0/2815570049 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e080402e0 con 0x7f7e2009a150 2023-09-30T22:23:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.200+0000 7f7e2504a700 1 -- 172.21.15.154:0/2815570049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2009fa30 con 0x7f7e2009a150 2023-09-30T22:23:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.204+0000 7f7e177fe700 1 -- 172.21.15.154:0/2815570049 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e08015080 con 0x7f7e2009a150 2023-09-30T22:23:49.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.391+0000 7f7e2504a700 1 -- 172.21.15.154:0/2815570049 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e2004f2a0 con 0x7f7e2009a150 2023-09-30T22:23:49.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.391+0000 7f7e177fe700 1 -- 172.21.15.154:0/2815570049 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e0802d450 con 0x7f7e2009a150 2023-09-30T22:23:49.391 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.393+0000 7f7e2504a700 1 -- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009a150 msgr2=0x7f7e201234d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.393+0000 7f7e2504a700 1 --2- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009a150 0x7f7e201234d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7e08014040 tx=0x7f7e08004750 comp rx=0 tx=0).stop 2023-09-30T22:23:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.393+0000 7f7e2504a700 1 -- 172.21.15.154:0/2815570049 shutdown_connections 2023-09-30T22:23:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.393+0000 7f7e2504a700 1 --2- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e20133c20 0x7f7e201c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.393+0000 7f7e2504a700 1 --2- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e2009a150 0x7f7e201234d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.393+0000 7f7e2504a700 1 --2- 172.21.15.154:0/2815570049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e2009edb0 0x7f7e20123a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.393+0000 7f7e2504a700 1 -- 172.21.15.154:0/2815570049 >> 172.21.15.154:0/2815570049 conn(0x7f7e200a4430 msgr2=0x7f7e2009c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.393+0000 7f7e2504a700 1 -- 172.21.15.154:0/2815570049 shutdown_connections 2023-09-30T22:23:49.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:49.393+0000 7f7e2504a700 1 -- 172.21.15.154:0/2815570049 wait complete. 2023-09-30T22:23:49.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:49.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:49.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:50.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.082+0000 7f78bf718700 1 Processor -- start 2023-09-30T22:23:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.082+0000 7f78bf718700 1 -- start start 2023-09-30T22:23:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bf718700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bf718700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b809dec0 0x7f78b806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bf718700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b806b5c0 con 0x7f78b8131a00 2023-09-30T22:23:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bf718700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b806e900 con 0x7f78b806a770 2023-09-30T22:23:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bf718700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b809d180 con 0x7f78b809dec0 2023-09-30T22:23:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bd4b4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bccb3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b809dec0 0x7f78b806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bd4b4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44632/0 (socket says 172.21.15.154:44632) 2023-09-30T22:23:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bd4b4700 1 -- 172.21.15.154:0/2650690057 learned_addr learned my addr 172.21.15.154:0/2650690057 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bccb3700 1 -- 172.21.15.154:0/2650690057 >> v2:172.21.15.154:3300/0 conn(0x7f78b806a770 msgr2=0x7f78b806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bccb3700 1 --2- 172.21.15.154:0/2650690057 >> v2:172.21.15.154:3300/0 conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bccb3700 1 -- 172.21.15.154:0/2650690057 >> v1:172.21.15.154:6789/0 conn(0x7f78b8131a00 legacy=0x7f78b8131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.083+0000 7f78bccb3700 1 -- 172.21.15.154:0/2650690057 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b809e780 con 0x7f78b809dec0 2023-09-30T22:23:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.084+0000 7f78bd4b4700 1 --2- 172.21.15.154:0/2650690057 >> v2:172.21.15.154:3300/0 conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.084+0000 7f78bccb3700 1 --2- 172.21.15.154:0/2650690057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b809dec0 0x7f78b806b080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009840 tx=0x7f78a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1acc062b26226837 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.084+0000 7f78affff700 1 -- 172.21.15.154:0/2650690057 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8011830 con 0x7f78b809dec0 2023-09-30T22:23:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.084+0000 7f78affff700 1 -- 172.21.15.154:0/2650690057 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a8011990 con 0x7f78b809dec0 2023-09-30T22:23:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.084+0000 7f78affff700 1 -- 172.21.15.154:0/2650690057 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8011d20 con 0x7f78b809dec0 2023-09-30T22:23:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.084+0000 7f78bf718700 1 -- 172.21.15.154:0/2650690057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b809dec0 msgr2=0x7f78b806b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.084+0000 7f78bf718700 1 --2- 172.21.15.154:0/2650690057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b809dec0 0x7f78b806b080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009840 tx=0x7f78a8009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.085+0000 7f78bf718700 1 -- 172.21.15.154:0/2650690057 shutdown_connections 2023-09-30T22:23:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.085+0000 7f78bf718700 1 --2- 172.21.15.154:0/2650690057 >> v2:172.21.15.154:3300/0 conn(0x7f78b806a770 0x7f78b806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.085+0000 7f78bf718700 1 --2- 172.21.15.154:0/2650690057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b809dec0 0x7f78b806b080 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.085+0000 7f78bf718700 1 -- 172.21.15.154:0/2650690057 >> 172.21.15.154:0/2650690057 conn(0x7f78b8099c40 msgr2=0x7f78b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.085+0000 7f78bf718700 1 -- 172.21.15.154:0/2650690057 shutdown_connections 2023-09-30T22:23:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.085+0000 7f78bf718700 1 -- 172.21.15.154:0/2650690057 wait complete. 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.086+0000 7f78bf718700 1 Processor -- start 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.086+0000 7f78bf718700 1 -- start start 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.086+0000 7f78bf718700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b811bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.086+0000 7f78bf718700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b809dec0 0x7f78b811c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bf718700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b8131a00 0x7f78b811c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bf718700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b811f6b0 con 0x7f78b806a770 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bf718700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b811db90 con 0x7f78b8131a00 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bf718700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8130df0 con 0x7f78b809dec0 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bdcb5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b8131a00 0x7f78b811c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bdcb5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b8131a00 0x7f78b811c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58748/0 (socket says 172.21.15.154:58748) 2023-09-30T22:23:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bdcb5700 1 -- 172.21.15.154:0/93105783 learned_addr learned my addr 172.21.15.154:0/93105783 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bd4b4700 1 --2- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b811bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bdcb5700 1 -- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b809dec0 msgr2=0x7f78b811c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bdcb5700 1 --2- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b809dec0 0x7f78b811c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bdcb5700 1 -- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 msgr2=0x7f78b811bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bdcb5700 1 --2- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b811bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bdcb5700 1 -- 172.21.15.154:0/93105783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4009550 con 0x7f78b8131a00 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bd4b4700 1 --2- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b811bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bdcb5700 1 --2- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b8131a00 0x7f78b811c940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f78b000cc50 tx=0x7f78b000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78adffb700 1 -- 172.21.15.154:0/93105783 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0003c00 con 0x7f78b8131a00 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78adffb700 1 -- 172.21.15.154:0/93105783 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0003d60 con 0x7f78b8131a00 2023-09-30T22:23:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78adffb700 1 -- 172.21.15.154:0/93105783 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b000ab60 con 0x7f78b8131a00 2023-09-30T22:23:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.087+0000 7f78bf718700 1 -- 172.21.15.154:0/93105783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a80094a0 con 0x7f78b8131a00 2023-09-30T22:23:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.088+0000 7f78bf718700 1 -- 172.21.15.154:0/93105783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b811ecd0 con 0x7f78b8131a00 2023-09-30T22:23:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.088+0000 7f78adffb700 1 -- 172.21.15.154:0/93105783 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78b000acc0 con 0x7f78b8131a00 2023-09-30T22:23:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.089+0000 7f78adffb700 1 -- 172.21.15.154:0/93105783 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78b003f6b0 con 0x7f78b8131a00 2023-09-30T22:23:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.089+0000 7f78bf718700 1 -- 172.21.15.154:0/93105783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b804f2a0 con 0x7f78b8131a00 2023-09-30T22:23:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.093+0000 7f78adffb700 1 -- 172.21.15.154:0/93105783 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78b00198f0 con 0x7f78b8131a00 2023-09-30T22:23:50.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.124+0000 7f0cd3c0b700 1 Processor -- start 2023-09-30T22:23:50.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.124+0000 7f0cd3c0b700 1 -- start start 2023-09-30T22:23:50.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.124+0000 7f0cd3c0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a0a30 0x7f0ccc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.124+0000 7f0cd3c0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a1340 0x7f0ccc12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd3c0b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc0a1e70 con 0x7f0ccc1304a0 2023-09-30T22:23:50.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd3c0b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc09a720 con 0x7f0ccc0a0a30 2023-09-30T22:23:50.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd3c0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc09b300 con 0x7f0ccc0a1340 2023-09-30T22:23:50.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd19a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a0a30 0x7f0ccc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd19a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a0a30 0x7f0ccc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58762/0 (socket says 172.21.15.154:58762) 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd19a7700 1 -- 172.21.15.154:0/2084232073 learned_addr learned my addr 172.21.15.154:0/2084232073 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd11a6700 1 --2- 172.21.15.154:0/2084232073 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a1340 0x7f0ccc12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd19a7700 1 -- 172.21.15.154:0/2084232073 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a1340 msgr2=0x7f0ccc12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd19a7700 1 --2- 172.21.15.154:0/2084232073 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a1340 0x7f0ccc12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd19a7700 1 -- 172.21.15.154:0/2084232073 >> v1:172.21.15.154:6789/0 conn(0x7f0ccc1304a0 legacy=0x7f0ccc1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd19a7700 1 -- 172.21.15.154:0/2084232073 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc09abc0 con 0x7f0ccc0a0a30 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd19a7700 1 --2- 172.21.15.154:0/2084232073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a0a30 0x7f0ccc0a0e00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009970 tx=0x7f0cc8009c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30597a154356ff9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd09a5700 1 -- 172.21.15.154:0/2084232073 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8005e30 con 0x7f0ccc0a0a30 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd09a5700 1 -- 172.21.15.154:0/2084232073 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc8004030 con 0x7f0ccc0a0a30 2023-09-30T22:23:50.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.125+0000 7f0cd09a5700 1 -- 172.21.15.154:0/2084232073 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80043c0 con 0x7f0ccc0a0a30 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.126+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2084232073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a0a30 msgr2=0x7f0ccc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.126+0000 7f0cd3c0b700 1 --2- 172.21.15.154:0/2084232073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a0a30 0x7f0ccc0a0e00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009970 tx=0x7f0cc8009c80 comp rx=0 tx=0).stop 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.126+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2084232073 shutdown_connections 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.126+0000 7f0cd3c0b700 1 --2- 172.21.15.154:0/2084232073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a0a30 0x7f0ccc0a0e00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.126+0000 7f0cd3c0b700 1 --2- 172.21.15.154:0/2084232073 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a1340 0x7f0ccc12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.126+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2084232073 >> 172.21.15.154:0/2084232073 conn(0x7f0ccc0a2980 msgr2=0x7f0ccc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.126+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2084232073 shutdown_connections 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.126+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2084232073 wait complete. 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.127+0000 7f0cd3c0b700 1 Processor -- start 2023-09-30T22:23:50.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.127+0000 7f0cd3c0b700 1 -- start start 2023-09-30T22:23:50.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd3c0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd3c0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a1340 0x7f0ccc11a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd3c0b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc1304a0 0x7f0ccc1c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd3c0b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc11d160 con 0x7f0ccc1304a0 2023-09-30T22:23:50.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd3c0b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc12cd80 con 0x7f0ccc0a1340 2023-09-30T22:23:50.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd3c0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc09ae00 con 0x7f0ccc0a0a30 2023-09-30T22:23:50.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd11a6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a1340 0x7f0ccc11a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd11a6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a1340 0x7f0ccc11a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58768/0 (socket says 172.21.15.154:58768) 2023-09-30T22:23:50.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd11a6700 1 -- 172.21.15.154:0/2575492792 learned_addr learned my addr 172.21.15.154:0/2575492792 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd19a7700 1 --2- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd21a8700 1 --2- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc1304a0 0x7f0ccc1c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd11a6700 1 -- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a0a30 msgr2=0x7f0ccc119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd11a6700 1 --2- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd11a6700 1 -- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc1304a0 msgr2=0x7f0ccc1c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd11a6700 1 --2- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc1304a0 0x7f0ccc1c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd11a6700 1 -- 172.21.15.154:0/2575492792 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8009500 con 0x7f0ccc0a1340 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd11a6700 1 --2- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a1340 0x7f0ccc11a440 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00e980 tx=0x7f0cbc00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cc27fc700 1 -- 172.21.15.154:0/2575492792 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc009710 con 0x7f0ccc0a1340 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cc27fc700 1 -- 172.21.15.154:0/2575492792 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc00c690 con 0x7f0ccc0a1340 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cc27fc700 1 -- 172.21.15.154:0/2575492792 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc00ca20 con 0x7f0ccc0a1340 2023-09-30T22:23:50.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.128+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2575492792 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc11bd50 con 0x7f0ccc0a1340 2023-09-30T22:23:50.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.129+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2575492792 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc11cc40 con 0x7f0ccc0a1340 2023-09-30T22:23:50.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.129+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2575492792 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc04f2a0 con 0x7f0ccc0a1340 2023-09-30T22:23:50.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.130+0000 7f0cc27fc700 1 -- 172.21.15.154:0/2575492792 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cbc00cb80 con 0x7f0ccc0a1340 2023-09-30T22:23:50.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.130+0000 7f0cc27fc700 1 -- 172.21.15.154:0/2575492792 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0cbc047350 con 0x7f0ccc0a1340 2023-09-30T22:23:50.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.134+0000 7f0cc27fc700 1 -- 172.21.15.154:0/2575492792 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cbc044060 con 0x7f0ccc0a1340 2023-09-30T22:23:50.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.165+0000 7fca5d899700 1 Processor -- start 2023-09-30T22:23:50.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.165+0000 7fca5d899700 1 -- start start 2023-09-30T22:23:50.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca5d899700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca580a0a70 0x7fca580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca5d899700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca580a1380 0x7fca58133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca5d899700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5809dc00 con 0x7fca58133f50 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca5d899700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5809ea60 con 0x7fca580a0a70 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca5d899700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca5809dec0 con 0x7fca580a1380 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca56ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca580a0a70 0x7fca580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca56ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca580a0a70 0x7fca580a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44654/0 (socket says 172.21.15.154:44654) 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca567fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca580a1380 0x7fca58133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca56ffd700 1 -- 172.21.15.154:0/1471425186 learned_addr learned my addr 172.21.15.154:0/1471425186 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca56ffd700 1 -- 172.21.15.154:0/1471425186 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca580a1380 msgr2=0x7fca58133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca56ffd700 1 --2- 172.21.15.154:0/1471425186 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca580a1380 0x7fca58133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca56ffd700 1 -- 172.21.15.154:0/1471425186 >> v1:172.21.15.154:6789/0 conn(0x7fca58133f50 legacy=0x7fca5813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca56ffd700 1 -- 172.21.15.154:0/1471425186 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5809e6a0 con 0x7fca580a0a70 2023-09-30T22:23:50.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca567fc700 1 --2- 172.21.15.154:0/1471425186 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca580a1380 0x7fca58133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:50.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca56ffd700 1 --2- 172.21.15.154:0/1471425186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 0x7fca580a0e40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fca480098f0 tx=0x7fca48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1301e90d7b32f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:50.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.166+0000 7fca55ffb700 1 -- 172.21.15.154:0/1471425186 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48011830 con 0x7fca580a0a70 2023-09-30T22:23:50.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca55ffb700 1 -- 172.21.15.154:0/1471425186 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca48011990 con 0x7fca580a0a70 2023-09-30T22:23:50.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca55ffb700 1 -- 172.21.15.154:0/1471425186 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48011d20 con 0x7fca580a0a70 2023-09-30T22:23:50.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca5d899700 1 -- 172.21.15.154:0/1471425186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 msgr2=0x7fca580a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca5d899700 1 --2- 172.21.15.154:0/1471425186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 0x7fca580a0e40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fca480098f0 tx=0x7fca48009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:50.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca5d899700 1 -- 172.21.15.154:0/1471425186 shutdown_connections 2023-09-30T22:23:50.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca5d899700 1 --2- 172.21.15.154:0/1471425186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 0x7fca580a0e40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca5d899700 1 --2- 172.21.15.154:0/1471425186 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca580a1380 0x7fca58133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca5d899700 1 -- 172.21.15.154:0/1471425186 >> 172.21.15.154:0/1471425186 conn(0x7fca580a6610 msgr2=0x7fca580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca5d899700 1 -- 172.21.15.154:0/1471425186 shutdown_connections 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.167+0000 7fca5d899700 1 -- 172.21.15.154:0/1471425186 wait complete. 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.168+0000 7fca5d899700 1 Processor -- start 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.168+0000 7fca5d899700 1 -- start start 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca5d899700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 0x7fca5811e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca5d899700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca580a1380 0x7fca5811ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca5d899700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca58133f50 0x7fca5811f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca5d899700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca58133790 con 0x7fca580a0a70 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca5d899700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca58122320 con 0x7fca580a1380 2023-09-30T22:23:50.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca5d899700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca581339d0 con 0x7fca58133f50 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca56ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 0x7fca5811e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca56ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 0x7fca5811e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44656/0 (socket says 172.21.15.154:44656) 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca56ffd700 1 -- 172.21.15.154:0/375685481 learned_addr learned my addr 172.21.15.154:0/375685481 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca567fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca580a1380 0x7fca5811ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca577fe700 1 --2- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca58133f50 0x7fca5811f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca56ffd700 1 -- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca58133f50 msgr2=0x7fca5811f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca56ffd700 1 --2- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca58133f50 0x7fca5811f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca56ffd700 1 -- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca580a1380 msgr2=0x7fca5811ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca56ffd700 1 --2- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca580a1380 0x7fca5811ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca56ffd700 1 -- 172.21.15.154:0/375685481 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c0094a0 con 0x7fca580a0a70 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca567fc700 1 --2- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca580a1380 0x7fca5811ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:50.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca56ffd700 1 --2- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 0x7fca5811e840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fca48000c00 tx=0x7fca48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:50.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.169+0000 7fca3ffff700 1 -- 172.21.15.154:0/375685481 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48004480 con 0x7fca580a0a70 2023-09-30T22:23:50.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.170+0000 7fca3ffff700 1 -- 172.21.15.154:0/375685481 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4801f070 con 0x7fca580a0a70 2023-09-30T22:23:50.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.170+0000 7fca5d899700 1 -- 172.21.15.154:0/375685481 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca48009550 con 0x7fca580a0a70 2023-09-30T22:23:50.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.170+0000 7fca3ffff700 1 -- 172.21.15.154:0/375685481 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca480038c0 con 0x7fca580a0a70 2023-09-30T22:23:50.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.170+0000 7fca5d899700 1 -- 172.21.15.154:0/375685481 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca58120c00 con 0x7fca580a0a70 2023-09-30T22:23:50.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.170+0000 7fca3ffff700 1 -- 172.21.15.154:0/375685481 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca48021030 con 0x7fca580a0a70 2023-09-30T22:23:50.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.171+0000 7fca3ffff700 1 -- 172.21.15.154:0/375685481 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fca48040a90 con 0x7fca580a0a70 2023-09-30T22:23:50.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.171+0000 7fca5d899700 1 -- 172.21.15.154:0/375685481 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5804f2a0 con 0x7fca580a0a70 2023-09-30T22:23:50.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.175+0000 7fca3ffff700 1 -- 172.21.15.154:0/375685481 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca48015080 con 0x7fca580a0a70 2023-09-30T22:23:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.326+0000 7f78bf718700 1 -- 172.21.15.154:0/93105783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f78b809e3a0 con 0x7f78b8131a00 2023-09-30T22:23:50.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.326+0000 7f78adffb700 1 -- 172.21.15.154:0/93105783 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78b0019300 con 0x7f78b8131a00 2023-09-30T22:23:50.547 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.329+0000 7f78bf718700 1 -- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b8131a00 msgr2=0x7f78b811c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.329+0000 7f78bf718700 1 --2- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b8131a00 0x7f78b811c940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f78b000cc50 tx=0x7f78b000cf60 comp rx=0 tx=0).stop 2023-09-30T22:23:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.330+0000 7f78bf718700 1 -- 172.21.15.154:0/93105783 shutdown_connections 2023-09-30T22:23:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.330+0000 7f78bf718700 1 --2- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b8131a00 0x7f78b811c940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.330+0000 7f78bf718700 1 --2- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b806a770 0x7f78b811bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.330+0000 7f78bf718700 1 --2- 172.21.15.154:0/93105783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b809dec0 0x7f78b811c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.330+0000 7f78bf718700 1 -- 172.21.15.154:0/93105783 >> 172.21.15.154:0/93105783 conn(0x7f78b8099c40 msgr2=0x7f78b81b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.330+0000 7f78bf718700 1 -- 172.21.15.154:0/93105783 shutdown_connections 2023-09-30T22:23:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.330+0000 7f78bf718700 1 -- 172.21.15.154:0/93105783 wait complete. 2023-09-30T22:23:50.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.363+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2575492792 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0ccc11c6d0 con 0x7f0ccc0a1340 2023-09-30T22:23:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.363+0000 7f0cc27fc700 1 -- 172.21.15.154:0/2575492792 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cbc017020 con 0x7f0ccc0a1340 2023-09-30T22:23:50.553 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:50.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.365+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a1340 msgr2=0x7f0ccc11a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.365+0000 7f0cd3c0b700 1 --2- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a1340 0x7f0ccc11a440 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00e980 tx=0x7f0cbc00ec90 comp rx=0 tx=0).stop 2023-09-30T22:23:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.365+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2575492792 shutdown_connections 2023-09-30T22:23:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.365+0000 7f0cd3c0b700 1 --2- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ccc1304a0 0x7f0ccc1c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.365+0000 7f0cd3c0b700 1 --2- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.365+0000 7f0cd3c0b700 1 --2- 172.21.15.154:0/2575492792 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ccc0a1340 0x7f0ccc11a440 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.365+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2575492792 >> 172.21.15.154:0/2575492792 conn(0x7f0ccc0a2980 msgr2=0x7f0ccc12e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.365+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2575492792 shutdown_connections 2023-09-30T22:23:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.365+0000 7f0cd3c0b700 1 -- 172.21.15.154:0/2575492792 wait complete. 2023-09-30T22:23:50.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.379+0000 7fca5d899700 1 -- 172.21.15.154:0/375685481 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca58072980 con 0x7fca580a0a70 2023-09-30T22:23:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.380+0000 7fca3ffff700 1 -- 172.21.15.154:0/375685481 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca48003a20 con 0x7fca580a0a70 2023-09-30T22:23:50.557 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.382+0000 7fca5d899700 1 -- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 msgr2=0x7fca5811e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.382+0000 7fca5d899700 1 --2- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 0x7fca5811e840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fca48000c00 tx=0x7fca48004750 comp rx=0 tx=0).stop 2023-09-30T22:23:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.382+0000 7fca5d899700 1 -- 172.21.15.154:0/375685481 shutdown_connections 2023-09-30T22:23:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.382+0000 7fca5d899700 1 --2- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca58133f50 0x7fca5811f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.382+0000 7fca5d899700 1 --2- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca580a0a70 0x7fca5811e840 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.382+0000 7fca5d899700 1 --2- 172.21.15.154:0/375685481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca580a1380 0x7fca5811ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.382+0000 7fca5d899700 1 -- 172.21.15.154:0/375685481 >> 172.21.15.154:0/375685481 conn(0x7fca580a6610 msgr2=0x7fca580a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.382+0000 7fca5d899700 1 -- 172.21.15.154:0/375685481 shutdown_connections 2023-09-30T22:23:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.382+0000 7fca5d899700 1 -- 172.21.15.154:0/375685481 wait complete. 2023-09-30T22:23:50.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:50.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.717+0000 7f2ed15a6700 1 Processor -- start 2023-09-30T22:23:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.717+0000 7f2ed15a6700 1 -- start start 2023-09-30T22:23:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ed15a6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ecc09d860 0x7f2ecc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ed15a6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc130eb0 0x7f2ecc138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ed15a6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc09aaa0 con 0x7f2ecc09e170 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ed15a6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc09f870 con 0x7f2ecc09d860 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ed15a6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc09b360 con 0x7f2ecc130eb0 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ecc09d860 0x7f2ecc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc130eb0 0x7f2ecc138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ecc09d860 0x7f2ecc09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44672/0 (socket says 172.21.15.154:44672) 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecaffd700 1 -- 172.21.15.154:0/1907647610 learned_addr learned my addr 172.21.15.154:0/1907647610 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecb7fe700 1 -- 172.21.15.154:0/1907647610 >> v2:172.21.15.154:3300/0 conn(0x7f2ecc09d860 msgr2=0x7f2ecc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecb7fe700 1 --2- 172.21.15.154:0/1907647610 >> v2:172.21.15.154:3300/0 conn(0x7f2ecc09d860 0x7f2ecc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecb7fe700 1 -- 172.21.15.154:0/1907647610 >> v1:172.21.15.154:6789/0 conn(0x7f2ecc09e170 legacy=0x7f2ecc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecb7fe700 1 -- 172.21.15.154:0/1907647610 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc09b620 con 0x7f2ecc130eb0 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecaffd700 1 --2- 172.21.15.154:0/1907647610 >> v2:172.21.15.154:3300/0 conn(0x7f2ecc09d860 0x7f2ecc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ecb7fe700 1 --2- 172.21.15.154:0/1907647610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc130eb0 0x7f2ecc138a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009d90 tx=0x7f2ec400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f23db6791a3a7497 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.718+0000 7f2ec9ffb700 1 -- 172.21.15.154:0/1907647610 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400e070 con 0x7f2ecc130eb0 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ec9ffb700 1 -- 172.21.15.154:0/1907647610 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec400bb20 con 0x7f2ecc130eb0 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ec9ffb700 1 -- 172.21.15.154:0/1907647610 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4012430 con 0x7f2ecc130eb0 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1907647610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc130eb0 msgr2=0x7f2ecc138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ed15a6700 1 --2- 172.21.15.154:0/1907647610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc130eb0 0x7f2ecc138a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009d90 tx=0x7f2ec400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1907647610 shutdown_connections 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ed15a6700 1 --2- 172.21.15.154:0/1907647610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc130eb0 0x7f2ecc138a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ed15a6700 1 --2- 172.21.15.154:0/1907647610 >> v2:172.21.15.154:3300/0 conn(0x7f2ecc09d860 0x7f2ecc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1907647610 >> 172.21.15.154:0/1907647610 conn(0x7f2ecc099c40 msgr2=0x7f2ecc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:50.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1907647610 shutdown_connections 2023-09-30T22:23:50.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.719+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1907647610 wait complete. 2023-09-30T22:23:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.720+0000 7f2ed15a6700 1 Processor -- start 2023-09-30T22:23:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ed15a6700 1 -- start start 2023-09-30T22:23:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ed15a6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc09d860 0x7f2ecc11e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ed15a6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc09e170 0x7f2ecc11ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ed15a6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc130eb0 0x7f2ecc11ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ed15a6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc1201e0 con 0x7f2ecc09d860 2023-09-30T22:23:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ed15a6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc11fff0 con 0x7f2ecc130eb0 2023-09-30T22:23:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ed15a6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0a21b0 con 0x7f2ecc09e170 2023-09-30T22:23:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ecaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc09d860 0x7f2ecc11e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ecaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc09d860 0x7f2ecc11e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44680/0 (socket says 172.21.15.154:44680) 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ecaffd700 1 -- 172.21.15.154:0/1025261203 learned_addr learned my addr 172.21.15.154:0/1025261203 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2eca7fc700 1 --2- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc09e170 0x7f2ecc11ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.721+0000 7f2ecb7fe700 1 --2- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc130eb0 0x7f2ecc11ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2ecaffd700 1 -- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc09e170 msgr2=0x7f2ecc11ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2ecaffd700 1 --2- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc09e170 0x7f2ecc11ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2ecaffd700 1 -- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc130eb0 msgr2=0x7f2ecc11ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2ecaffd700 1 --2- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc130eb0 0x7f2ecc11ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2ecaffd700 1 -- 172.21.15.154:0/1025261203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec000b7f0 con 0x7f2ecc09d860 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2ecaffd700 1 --2- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc09d860 0x7f2ecc11e4d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000ecf0 tx=0x7f2ec000bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2eb37fe700 1 -- 172.21.15.154:0/1025261203 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000dd10 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2eb37fe700 1 -- 172.21.15.154:0/1025261203 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000de70 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1025261203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec4009a70 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2eb37fe700 1 -- 172.21.15.154:0/1025261203 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0010640 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.722+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1025261203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc121c90 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.723+0000 7f2eb37fe700 1 -- 172.21.15.154:0/1025261203 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ec00107a0 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.723+0000 7f2eb37fe700 1 -- 172.21.15.154:0/1025261203 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2ec0040110 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.723+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1025261203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc04f2a0 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.728+0000 7f2eb37fe700 1 -- 172.21.15.154:0/1025261203 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ec0020de0 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.911+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1025261203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ecc122740 con 0x7f2ecc09d860 2023-09-30T22:23:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.912+0000 7f2eb37fe700 1 -- 172.21.15.154:0/1025261203 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ec00203a0 con 0x7f2ecc09d860 2023-09-30T22:23:50.922 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:50.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.913+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc09d860 msgr2=0x7f2ecc11e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:50.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.913+0000 7f2ed15a6700 1 --2- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc09d860 0x7f2ecc11e4d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000ecf0 tx=0x7f2ec000bf80 comp rx=0 tx=0).stop 2023-09-30T22:23:50.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.913+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1025261203 shutdown_connections 2023-09-30T22:23:50.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.913+0000 7f2ed15a6700 1 --2- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc130eb0 0x7f2ecc11ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.913+0000 7f2ed15a6700 1 --2- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc09d860 0x7f2ecc11e4d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.913+0000 7f2ed15a6700 1 --2- 172.21.15.154:0/1025261203 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ecc09e170 0x7f2ecc11ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:50.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.914+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1025261203 >> 172.21.15.154:0/1025261203 conn(0x7f2ecc099c40 msgr2=0x7f2ecc0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:50.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.914+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1025261203 shutdown_connections 2023-09-30T22:23:50.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:50.914+0000 7f2ed15a6700 1 -- 172.21.15.154:0/1025261203 wait complete. 2023-09-30T22:23:50.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:51.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:51.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:51.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:51.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.691+0000 7f2ad8bd3700 1 Processor -- start 2023-09-30T22:23:51.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.691+0000 7f2ad8bd3700 1 -- start start 2023-09-30T22:23:51.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad8bd3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad409f350 0x7f2ad4138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad8bd3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ad4139480 0x7f2ad413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad8bd3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad406bec0 con 0x7f2ad409e870 2023-09-30T22:23:51.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad8bd3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad406ce60 con 0x7f2ad4139480 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad8bd3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad409f740 con 0x7f2ad409f350 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad409f350 0x7f2ad4138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad2d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ad4139480 0x7f2ad413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad409f350 0x7f2ad4138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58786/0 (socket says 172.21.15.154:58786) 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad1d9b700 1 -- 172.21.15.154:0/1135471184 learned_addr learned my addr 172.21.15.154:0/1135471184 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad2d9d700 1 -- 172.21.15.154:0/1135471184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad409f350 msgr2=0x7f2ad4138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad2d9d700 1 --2- 172.21.15.154:0/1135471184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad409f350 0x7f2ad4138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad2d9d700 1 -- 172.21.15.154:0/1135471184 >> v1:172.21.15.154:6789/0 conn(0x7f2ad409e870 legacy=0x7f2ad409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad2d9d700 1 -- 172.21.15.154:0/1135471184 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad409fa00 con 0x7f2ad4139480 2023-09-30T22:23:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad159a700 1 -- 172.21.15.154:0/1135471184 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447257479 0 0) 0x7f2ad406bec0 con 0x7f2ad409e870 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad1d9b700 1 --2- 172.21.15.154:0/1135471184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad409f350 0x7f2ad4138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad2d9d700 1 --2- 172.21.15.154:0/1135471184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad4139480 0x7f2ad413b860 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009d90 tx=0x7f2acc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62980b9acde51789 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.692+0000 7f2ad159a700 1 -- 172.21.15.154:0/1135471184 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00e070 con 0x7f2ad4139480 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad159a700 1 -- 172.21.15.154:0/1135471184 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc00bb20 con 0x7f2ad4139480 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad159a700 1 -- 172.21.15.154:0/1135471184 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc012430 con 0x7f2ad4139480 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/1135471184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad4139480 msgr2=0x7f2ad413b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad8bd3700 1 --2- 172.21.15.154:0/1135471184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad4139480 0x7f2ad413b860 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009d90 tx=0x7f2acc00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/1135471184 shutdown_connections 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad8bd3700 1 --2- 172.21.15.154:0/1135471184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad4139480 0x7f2ad413b860 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad8bd3700 1 --2- 172.21.15.154:0/1135471184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad409f350 0x7f2ad4138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/1135471184 >> 172.21.15.154:0/1135471184 conn(0x7f2ad40a4430 msgr2=0x7f2ad40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/1135471184 shutdown_connections 2023-09-30T22:23:51.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.693+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/1135471184 wait complete. 2023-09-30T22:23:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.695+0000 7f2ad8bd3700 1 Processor -- start 2023-09-30T22:23:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.695+0000 7f2ad8bd3700 1 -- start start 2023-09-30T22:23:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad8bd3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad409e870 0x7f2ad411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad8bd3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad409f350 0x7f2ad411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad8bd3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad4139480 0x7f2ad411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad8bd3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4122350 con 0x7f2ad409e870 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad8bd3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad406cfa0 con 0x7f2ad4139480 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad8bd3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40a3c40 con 0x7f2ad409f350 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad409f350 0x7f2ad411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad409f350 0x7f2ad411f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58964/0 (socket says 172.21.15.154:58964) 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad1d9b700 1 -- 172.21.15.154:0/3307680175 learned_addr learned my addr 172.21.15.154:0/3307680175 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad259c700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad409e870 0x7f2ad411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad2d9d700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad4139480 0x7f2ad411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad1d9b700 1 -- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad4139480 msgr2=0x7f2ad411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad1d9b700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad4139480 0x7f2ad411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad1d9b700 1 -- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad409e870 msgr2=0x7f2ad411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad1d9b700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad409e870 0x7f2ad411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad1d9b700 1 -- 172.21.15.154:0/3307680175 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8009550 con 0x7f2ad409f350 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad259c700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad409e870 0x7f2ad411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.696+0000 7f2ad1d9b700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad409f350 0x7f2ad411f010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800ebe0 tx=0x7f2ac800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.697+0000 7f2ac2ffd700 1 -- 172.21.15.154:0/3307680175 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800c850 con 0x7f2ad409f350 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.697+0000 7f2ac2ffd700 1 -- 172.21.15.154:0/3307680175 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac800c9b0 con 0x7f2ad409f350 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.697+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/3307680175 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc009a70 con 0x7f2ad409f350 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.697+0000 7f2ac2ffd700 1 -- 172.21.15.154:0/3307680175 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800cd40 con 0x7f2ad409f350 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.697+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/3307680175 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad4121aa0 con 0x7f2ad409f350 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.698+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/3307680175 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad4121c30 con 0x7f2ad409f350 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.698+0000 7f2ac2ffd700 1 -- 172.21.15.154:0/3307680175 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ac8013470 con 0x7f2ad409f350 2023-09-30T22:23:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.699+0000 7f2ac2ffd700 1 -- 172.21.15.154:0/3307680175 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2ac80400c0 con 0x7f2ad409f350 2023-09-30T22:23:51.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.703+0000 7f2ac2ffd700 1 -- 172.21.15.154:0/3307680175 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ac8011350 con 0x7f2ad409f350 2023-09-30T22:23:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.727+0000 7f98d4a10700 1 Processor -- start 2023-09-30T22:23:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.727+0000 7f98d4a10700 1 -- start start 2023-09-30T22:23:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.727+0000 7f0975c29700 1 Processor -- start 2023-09-30T22:23:51.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.727+0000 7f0975c29700 1 -- start start 2023-09-30T22:23:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98d4a10700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98d0133ad0 0x7f98d0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98d4a10700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d01300a0 0x7f98d01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98d4a10700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d006b2d0 con 0x7f98d01309f0 2023-09-30T22:23:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98d4a10700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d0133610 con 0x7f98d0133ad0 2023-09-30T22:23:51.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98d4a10700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98d009a500 con 0x7f98d01300a0 2023-09-30T22:23:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f0975c29700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f0970133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f0975c29700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09701300a0 0x7f09701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f0975c29700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09701309f0 0x7f097013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98cdd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d01300a0 0x7f98d01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98ce59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98d0133ad0 0x7f98d0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98cdd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d01300a0 0x7f98d01304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58970/0 (socket says 172.21.15.154:58970) 2023-09-30T22:23:51.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98cdd9b700 1 -- 172.21.15.154:0/459636591 learned_addr learned my addr 172.21.15.154:0/459636591 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:51.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98ce59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98d0133ad0 0x7f98d0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44710/0 (socket says 172.21.15.154:44710) 2023-09-30T22:23:51.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f0975c29700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097006b2d0 con 0x7f09701300a0 2023-09-30T22:23:51.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f0975c29700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0970133610 con 0x7f09701309f0 2023-09-30T22:23:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f0975c29700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f097009a500 con 0x7f0970133ad0 2023-09-30T22:23:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f096effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09701300a0 0x7f09701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f096effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09701300a0 0x7f09701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44716/0 (socket says 172.21.15.154:44716) 2023-09-30T22:23:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f096effd700 1 -- 172.21.15.154:0/996970962 learned_addr learned my addr 172.21.15.154:0/996970962 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f096f7fe700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f0970133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f096ffff700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09701309f0 0x7f097013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98cdd9b700 1 -- 172.21.15.154:0/459636591 >> v2:172.21.15.154:3300/0 conn(0x7f98d0133ad0 msgr2=0x7f98d0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:51.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98cdd9b700 1 --2- 172.21.15.154:0/459636591 >> v2:172.21.15.154:3300/0 conn(0x7f98d0133ad0 0x7f98d0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98cdd9b700 1 -- 172.21.15.154:0/459636591 >> v1:172.21.15.154:6789/0 conn(0x7f98d01309f0 legacy=0x7f98d013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98cdd9b700 1 -- 172.21.15.154:0/459636591 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d01338b0 con 0x7f98d01300a0 2023-09-30T22:23:51.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f98ce59c700 1 --2- 172.21.15.154:0/459636591 >> v2:172.21.15.154:3300/0 conn(0x7f98d0133ad0 0x7f98d0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:51.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f096effd700 1 -- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 msgr2=0x7f0970133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:51.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f096effd700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f0970133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f096effd700 1 -- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09701309f0 msgr2=0x7f097013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:51.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.728+0000 7f096effd700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09701309f0 0x7f097013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f096effd700 1 -- 172.21.15.154:0/996970962 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09701338b0 con 0x7f09701300a0 2023-09-30T22:23:51.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f096f7fe700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f0970133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:51.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f98cdd9b700 1 --2- 172.21.15.154:0/459636591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d01300a0 0x7f98d01304b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f98c40098f0 tx=0x7f98c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0806610395a72dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f096effd700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09701300a0 0x7f09701304b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f09640098f0 tx=0x7f0964009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a58e33959f9e0dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f98cd59a700 1 -- 172.21.15.154:0/459636591 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400b8a0 con 0x7f98d01300a0 2023-09-30T22:23:51.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f98cd59a700 1 -- 172.21.15.154:0/459636591 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c400ba00 con 0x7f98d01300a0 2023-09-30T22:23:51.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f98cd59a700 1 -- 172.21.15.154:0/459636591 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400bd90 con 0x7f98d01300a0 2023-09-30T22:23:51.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f096e7fc700 1 -- 172.21.15.154:0/996970962 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964011830 con 0x7f09701300a0 2023-09-30T22:23:51.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f096e7fc700 1 -- 172.21.15.154:0/996970962 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0964011990 con 0x7f09701300a0 2023-09-30T22:23:51.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.729+0000 7f096e7fc700 1 -- 172.21.15.154:0/996970962 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964011d20 con 0x7f09701300a0 2023-09-30T22:23:51.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f98d4a10700 1 -- 172.21.15.154:0/459636591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d01300a0 msgr2=0x7f98d01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f98d4a10700 1 --2- 172.21.15.154:0/459636591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d01300a0 0x7f98d01304b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f98c40098f0 tx=0x7f98c4009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:51.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f0975c29700 1 -- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09701300a0 msgr2=0x7f09701304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f0975c29700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09701300a0 0x7f09701304b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f09640098f0 tx=0x7f0964009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:51.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f0975c29700 1 -- 172.21.15.154:0/996970962 shutdown_connections 2023-09-30T22:23:51.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f0975c29700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09701309f0 0x7f097013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f0975c29700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f0970133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f0975c29700 1 --2- 172.21.15.154:0/996970962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09701300a0 0x7f09701304b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f0975c29700 1 -- 172.21.15.154:0/996970962 >> 172.21.15.154:0/996970962 conn(0x7f0970099c40 msgr2=0x7f09700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f0975c29700 1 -- 172.21.15.154:0/996970962 shutdown_connections 2023-09-30T22:23:51.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f98d4a10700 1 -- 172.21.15.154:0/459636591 shutdown_connections 2023-09-30T22:23:51.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f98d4a10700 1 --2- 172.21.15.154:0/459636591 >> v2:172.21.15.154:3300/0 conn(0x7f98d0133ad0 0x7f98d0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f98d4a10700 1 --2- 172.21.15.154:0/459636591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d01300a0 0x7f98d01304b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f98d4a10700 1 -- 172.21.15.154:0/459636591 >> 172.21.15.154:0/459636591 conn(0x7f98d0099c40 msgr2=0x7f98d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f0975c29700 1 -- 172.21.15.154:0/996970962 wait complete. 2023-09-30T22:23:51.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f98d4a10700 1 -- 172.21.15.154:0/459636591 shutdown_connections 2023-09-30T22:23:51.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.730+0000 7f98d4a10700 1 -- 172.21.15.154:0/459636591 wait complete. 2023-09-30T22:23:51.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.731+0000 7f0975c29700 1 Processor -- start 2023-09-30T22:23:51.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.731+0000 7f98d4a10700 1 Processor -- start 2023-09-30T22:23:51.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.731+0000 7f0975c29700 1 -- start start 2023-09-30T22:23:51.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.731+0000 7f98d4a10700 1 -- start start 2023-09-30T22:23:51.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f0975c29700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09701300a0 0x7f097011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98d4a10700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d01300a0 0x7f98d011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98d4a10700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d01309f0 0x7f98d011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f0975c29700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09701309f0 0x7f097011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f0975c29700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f097011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f0975c29700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097012dd00 con 0x7f09701300a0 2023-09-30T22:23:51.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f0975c29700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097011eaf0 con 0x7f09701309f0 2023-09-30T22:23:51.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f0975c29700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f097011ed70 con 0x7f0970133ad0 2023-09-30T22:23:51.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98d4a10700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0133ad0 0x7f98d011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:51.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98d4a10700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d011f0b0 con 0x7f98d01309f0 2023-09-30T22:23:51.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98d4a10700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d011fde0 con 0x7f98d01300a0 2023-09-30T22:23:51.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98d4a10700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98d011fbb0 con 0x7f98d0133ad0 2023-09-30T22:23:51.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98ced9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0133ad0 0x7f98d011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98ced9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0133ad0 0x7f98d011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:58988/0 (socket says 172.21.15.154:58988) 2023-09-30T22:23:51.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98ced9d700 1 -- 172.21.15.154:0/1936063413 learned_addr learned my addr 172.21.15.154:0/1936063413 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:51.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f096ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f097011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:51.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f096ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f097011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59002/0 (socket says 172.21.15.154:59002) 2023-09-30T22:23:51.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f096ffff700 1 -- 172.21.15.154:0/1490968396 learned_addr learned my addr 172.21.15.154:0/1490968396 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:51.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98ced9d700 1 -- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d01300a0 msgr2=0x7f98d011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98ced9d700 1 --2- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d01300a0 0x7f98d011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98ced9d700 1 -- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d01309f0 msgr2=0x7f98d011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98ced9d700 1 --2- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d01309f0 0x7f98d011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.732+0000 7f98ced9d700 1 -- 172.21.15.154:0/1936063413 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4009550 con 0x7f98d0133ad0 2023-09-30T22:23:51.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f096ffff700 1 -- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09701309f0 msgr2=0x7f097011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f096ffff700 1 --2- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09701309f0 0x7f097011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f096ffff700 1 -- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09701300a0 msgr2=0x7f097011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f096ffff700 1 --2- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09701300a0 0x7f097011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f096ffff700 1 -- 172.21.15.154:0/1490968396 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09600094a0 con 0x7f0970133ad0 2023-09-30T22:23:51.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f98ced9d700 1 --2- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0133ad0 0x7f98d011e4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f98c800cb50 tx=0x7f98c800cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f096ffff700 1 --2- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f097011e4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f096800efc0 tx=0x7f096800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:51.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f0957fff700 1 -- 172.21.15.154:0/1490968396 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096800cd40 con 0x7f0970133ad0 2023-09-30T22:23:51.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f0957fff700 1 -- 172.21.15.154:0/1490968396 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096800f040 con 0x7f0970133ad0 2023-09-30T22:23:51.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f0957fff700 1 -- 172.21.15.154:0/1490968396 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09680146c0 con 0x7f0970133ad0 2023-09-30T22:23:51.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f0975c29700 1 -- 172.21.15.154:0/1490968396 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0964009550 con 0x7f0970133ad0 2023-09-30T22:23:51.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f0975c29700 1 -- 172.21.15.154:0/1490968396 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097012d950 con 0x7f0970133ad0 2023-09-30T22:23:51.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f98beffd700 1 -- 172.21.15.154:0/1936063413 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8003c00 con 0x7f98d0133ad0 2023-09-30T22:23:51.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f98beffd700 1 -- 172.21.15.154:0/1936063413 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8003d60 con 0x7f98d0133ad0 2023-09-30T22:23:51.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.733+0000 7f98beffd700 1 -- 172.21.15.154:0/1936063413 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c800ab70 con 0x7f98d0133ad0 2023-09-30T22:23:51.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.734+0000 7f98d4a10700 1 -- 172.21.15.154:0/1936063413 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d0120a30 con 0x7f98d0133ad0 2023-09-30T22:23:51.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.734+0000 7f98d4a10700 1 -- 172.21.15.154:0/1936063413 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d012dd00 con 0x7f98d0133ad0 2023-09-30T22:23:51.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.734+0000 7f0957fff700 1 -- 172.21.15.154:0/1490968396 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0968014820 con 0x7f0970133ad0 2023-09-30T22:23:51.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.734+0000 7f0975c29700 1 -- 172.21.15.154:0/1490968396 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097004f2a0 con 0x7f0970133ad0 2023-09-30T22:23:51.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.734+0000 7f0957fff700 1 -- 172.21.15.154:0/1490968396 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f096803ffd0 con 0x7f0970133ad0 2023-09-30T22:23:51.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.735+0000 7f98beffd700 1 -- 172.21.15.154:0/1936063413 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98c800acd0 con 0x7f98d0133ad0 2023-09-30T22:23:51.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.735+0000 7f98beffd700 1 -- 172.21.15.154:0/1936063413 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f98c803f620 con 0x7f98d0133ad0 2023-09-30T22:23:51.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.735+0000 7f98d4a10700 1 -- 172.21.15.154:0/1936063413 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d004f2a0 con 0x7f98d0133ad0 2023-09-30T22:23:51.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.739+0000 7f0957fff700 1 -- 172.21.15.154:0/1490968396 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0968071750 con 0x7f0970133ad0 2023-09-30T22:23:51.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.743+0000 7f98beffd700 1 -- 172.21.15.154:0/1936063413 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98c80052b0 con 0x7f98d0133ad0 2023-09-30T22:23:51.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.900+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/3307680175 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ad404f2a0 con 0x7f2ad409f350 2023-09-30T22:23:51.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.900+0000 7f2ac2ffd700 1 -- 172.21.15.154:0/3307680175 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ac8017030 con 0x7f2ad409f350 2023-09-30T22:23:51.900 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:51.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.902+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad409f350 msgr2=0x7f2ad411f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.902+0000 7f2ad8bd3700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad409f350 0x7f2ad411f010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800ebe0 tx=0x7f2ac800eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.902+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/3307680175 shutdown_connections 2023-09-30T22:23:51.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.902+0000 7f2ad8bd3700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad4139480 0x7f2ad411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.902+0000 7f2ad8bd3700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad409e870 0x7f2ad411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.902+0000 7f2ad8bd3700 1 --2- 172.21.15.154:0/3307680175 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ad409f350 0x7f2ad411f010 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.902+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/3307680175 >> 172.21.15.154:0/3307680175 conn(0x7f2ad40a4430 msgr2=0x7f2ad40a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.902+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/3307680175 shutdown_connections 2023-09-30T22:23:51.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.902+0000 7f2ad8bd3700 1 -- 172.21.15.154:0/3307680175 wait complete. 2023-09-30T22:23:51.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:51.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.932+0000 7f0975c29700 1 -- 172.21.15.154:0/1490968396 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f097006c3b0 con 0x7f0970133ad0 2023-09-30T22:23:51.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.933+0000 7f0957fff700 1 -- 172.21.15.154:0/1490968396 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0968018030 con 0x7f0970133ad0 2023-09-30T22:23:51.932 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.936+0000 7f0975c29700 1 -- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 msgr2=0x7f097011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.936+0000 7f0975c29700 1 --2- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f097011e4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f096800efc0 tx=0x7f096800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.936+0000 7f0975c29700 1 -- 172.21.15.154:0/1490968396 shutdown_connections 2023-09-30T22:23:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.936+0000 7f0975c29700 1 --2- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0970133ad0 0x7f097011e4c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.936+0000 7f0975c29700 1 --2- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09701300a0 0x7f097011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.936+0000 7f0975c29700 1 --2- 172.21.15.154:0/1490968396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09701309f0 0x7f097011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.936+0000 7f0975c29700 1 -- 172.21.15.154:0/1490968396 >> 172.21.15.154:0/1490968396 conn(0x7f0970099c40 msgr2=0x7f097012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.936+0000 7f0975c29700 1 -- 172.21.15.154:0/1490968396 shutdown_connections 2023-09-30T22:23:51.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.936+0000 7f0975c29700 1 -- 172.21.15.154:0/1490968396 wait complete. 2023-09-30T22:23:51.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.942+0000 7f98d4a10700 1 -- 172.21.15.154:0/1936063413 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98d006c3b0 con 0x7f98d0133ad0 2023-09-30T22:23:51.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.942+0000 7f98beffd700 1 -- 172.21.15.154:0/1936063413 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98c8011380 con 0x7f98d0133ad0 2023-09-30T22:23:51.942 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:51.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.946+0000 7f98d4a10700 1 -- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0133ad0 msgr2=0x7f98d011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:51.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.946+0000 7f98d4a10700 1 --2- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0133ad0 0x7f98d011e4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f98c800cb50 tx=0x7f98c800cf10 comp rx=0 tx=0).stop 2023-09-30T22:23:51.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.946+0000 7f98d4a10700 1 -- 172.21.15.154:0/1936063413 shutdown_connections 2023-09-30T22:23:51.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.946+0000 7f98d4a10700 1 --2- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f98d0133ad0 0x7f98d011e4c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.946+0000 7f98d4a10700 1 --2- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d01300a0 0x7f98d011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.946+0000 7f98d4a10700 1 --2- 172.21.15.154:0/1936063413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d01309f0 0x7f98d011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:51.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.946+0000 7f98d4a10700 1 -- 172.21.15.154:0/1936063413 >> 172.21.15.154:0/1936063413 conn(0x7f98d0099c40 msgr2=0x7f98d012e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:51.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.946+0000 7f98d4a10700 1 -- 172.21.15.154:0/1936063413 shutdown_connections 2023-09-30T22:23:51.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:51.946+0000 7f98d4a10700 1 -- 172.21.15.154:0/1936063413 wait complete. 2023-09-30T22:23:51.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:51.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:52.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:52.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.189+0000 7f55b7cf5700 1 Processor -- start 2023-09-30T22:23:52.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.189+0000 7f55b7cf5700 1 -- start start 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b7cf5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55b0131980 0x7f55b0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b7cf5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009c790 0x7f55b0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b7cf5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b00a1640 con 0x7f55b009bc70 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b7cf5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b006eb30 con 0x7f55b0131980 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b7cf5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00a22d0 con 0x7f55b009c790 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b6292700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009c790 0x7f55b0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b5a91700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55b0131980 0x7f55b0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b6292700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009c790 0x7f55b0139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58830/0 (socket says 172.21.15.154:58830) 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b5a91700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55b0131980 0x7f55b0131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44730/0 (socket says 172.21.15.154:44730) 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b6292700 1 -- 172.21.15.154:0/1861778600 learned_addr learned my addr 172.21.15.154:0/1861778600 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:52.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b6292700 1 -- 172.21.15.154:0/1861778600 >> v2:172.21.15.154:3300/0 conn(0x7f55b0131980 msgr2=0x7f55b0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b6292700 1 --2- 172.21.15.154:0/1861778600 >> v2:172.21.15.154:3300/0 conn(0x7f55b0131980 0x7f55b0131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b6292700 1 -- 172.21.15.154:0/1861778600 >> v1:172.21.15.154:6789/0 conn(0x7f55b009bc70 legacy=0x7f55b009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b6292700 1 -- 172.21.15.154:0/1861778600 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b0131550 con 0x7f55b009c790 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b5a91700 1 --2- 172.21.15.154:0/1861778600 >> v2:172.21.15.154:3300/0 conn(0x7f55b0131980 0x7f55b0131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.190+0000 7f55b6292700 1 --2- 172.21.15.154:0/1861778600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009c790 0x7f55b0139710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009e50 tx=0x7f55a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4a5b6d9a47c469 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b4a8f700 1 -- 172.21.15.154:0/1861778600 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a800e070 con 0x7f55b009c790 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b4a8f700 1 -- 172.21.15.154:0/1861778600 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a800b910 con 0x7f55b009c790 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b4a8f700 1 -- 172.21.15.154:0/1861778600 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a800bcc0 con 0x7f55b009c790 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b7cf5700 1 -- 172.21.15.154:0/1861778600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009c790 msgr2=0x7f55b0139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b7cf5700 1 --2- 172.21.15.154:0/1861778600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009c790 0x7f55b0139710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009e50 tx=0x7f55a800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b7cf5700 1 -- 172.21.15.154:0/1861778600 shutdown_connections 2023-09-30T22:23:52.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b7cf5700 1 --2- 172.21.15.154:0/1861778600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009c790 0x7f55b0139710 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b7cf5700 1 --2- 172.21.15.154:0/1861778600 >> v2:172.21.15.154:3300/0 conn(0x7f55b0131980 0x7f55b0131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b7cf5700 1 -- 172.21.15.154:0/1861778600 >> 172.21.15.154:0/1861778600 conn(0x7f55b00a2980 msgr2=0x7f55b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b7cf5700 1 -- 172.21.15.154:0/1861778600 shutdown_connections 2023-09-30T22:23:52.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.191+0000 7f55b7cf5700 1 -- 172.21.15.154:0/1861778600 wait complete. 2023-09-30T22:23:52.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.192+0000 7f55b7cf5700 1 Processor -- start 2023-09-30T22:23:52.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.192+0000 7f55b7cf5700 1 -- start start 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b7cf5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009bc70 0x7f55b011b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b7cf5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55b009c790 0x7f55b011bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b7cf5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b0131980 0x7f55b011c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b7cf5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b011d8d0 con 0x7f55b0131980 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b7cf5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b011f190 con 0x7f55b009bc70 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b7cf5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55b011e560 con 0x7f55b009c790 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b5a91700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009bc70 0x7f55b011b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b5a91700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009bc70 0x7f55b011b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58842/0 (socket says 172.21.15.154:58842) 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b6292700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b0131980 0x7f55b011c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b5a91700 1 -- 172.21.15.154:0/709407016 learned_addr learned my addr 172.21.15.154:0/709407016 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:52.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b5290700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55b009c790 0x7f55b011bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b6292700 1 -- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55b009c790 msgr2=0x7f55b011bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b6292700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55b009c790 0x7f55b011bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b6292700 1 -- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009bc70 msgr2=0x7f55b011b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b6292700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009bc70 0x7f55b011b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b6292700 1 -- 172.21.15.154:0/709407016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac009430 con 0x7f55b0131980 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b5290700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55b009c790 0x7f55b011bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b5a91700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009bc70 0x7f55b011b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b6292700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b0131980 0x7f55b011c180 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f55b0066990 tx=0x7f55a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55a67fc700 1 -- 172.21.15.154:0/709407016 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8004800 con 0x7f55b0131980 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55a67fc700 1 -- 172.21.15.154:0/709407016 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8004960 con 0x7f55b0131980 2023-09-30T22:23:52.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b7cf5700 1 -- 172.21.15.154:0/709407016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a8009b30 con 0x7f55b0131980 2023-09-30T22:23:52.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55a67fc700 1 -- 172.21.15.154:0/709407016 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a801c680 con 0x7f55b0131980 2023-09-30T22:23:52.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.193+0000 7f55b7cf5700 1 -- 172.21.15.154:0/709407016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b011e970 con 0x7f55b0131980 2023-09-30T22:23:52.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.194+0000 7f55a67fc700 1 -- 172.21.15.154:0/709407016 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55a801c7e0 con 0x7f55b0131980 2023-09-30T22:23:52.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.194+0000 7f55a67fc700 1 -- 172.21.15.154:0/709407016 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f55a8040e30 con 0x7f55b0131980 2023-09-30T22:23:52.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.194+0000 7f55b7cf5700 1 -- 172.21.15.154:0/709407016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b004f2a0 con 0x7f55b0131980 2023-09-30T22:23:52.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.199+0000 7f55a67fc700 1 -- 172.21.15.154:0/709407016 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55a80249a0 con 0x7f55b0131980 2023-09-30T22:23:52.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.380+0000 7f55b7cf5700 1 -- 172.21.15.154:0/709407016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f55b011d240 con 0x7f55b0131980 2023-09-30T22:23:52.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.380+0000 7f55a67fc700 1 -- 172.21.15.154:0/709407016 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55a80243b0 con 0x7f55b0131980 2023-09-30T22:23:52.381 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:52.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.382+0000 7f55b7cf5700 1 -- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b0131980 msgr2=0x7f55b011c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:52.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.382+0000 7f55b7cf5700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b0131980 0x7f55b011c180 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f55b0066990 tx=0x7f55a8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.382+0000 7f55b7cf5700 1 -- 172.21.15.154:0/709407016 shutdown_connections 2023-09-30T22:23:52.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.382+0000 7f55b7cf5700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b0131980 0x7f55b011c180 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.382+0000 7f55b7cf5700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55b009bc70 0x7f55b011b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.382+0000 7f55b7cf5700 1 --2- 172.21.15.154:0/709407016 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55b009c790 0x7f55b011bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.382+0000 7f55b7cf5700 1 -- 172.21.15.154:0/709407016 >> 172.21.15.154:0/709407016 conn(0x7f55b00a2980 msgr2=0x7f55b0071820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.382+0000 7f55b7cf5700 1 -- 172.21.15.154:0/709407016 shutdown_connections 2023-09-30T22:23:52.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:52.382+0000 7f55b7cf5700 1 -- 172.21.15.154:0/709407016 wait complete. 2023-09-30T22:23:52.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:52.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:52.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:52.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:53.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.046+0000 7f8bf5031700 1 Processor -- start 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.046+0000 7f8bf5031700 1 -- start start 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bf5031700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8bf009ad40 0x7f8bf0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bf5031700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf01343d0 0x7f8bf00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bf5031700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf009b110 con 0x7f8bf0133f70 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bf5031700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf00a3b60 con 0x7f8bf009ad40 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bf5031700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0134850 con 0x7f8bf01343d0 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bef59e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf01343d0 0x7f8bf00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bef59e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf01343d0 0x7f8bf00a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58846/0 (socket says 172.21.15.154:58846) 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bef59e700 1 -- 172.21.15.154:0/1598665822 learned_addr learned my addr 172.21.15.154:0/1598665822 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8beed9d700 1 --2- 172.21.15.154:0/1598665822 >> v2:172.21.15.154:3300/0 conn(0x7f8bf009ad40 0x7f8bf0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bef59e700 1 -- 172.21.15.154:0/1598665822 >> v2:172.21.15.154:3300/0 conn(0x7f8bf009ad40 msgr2=0x7f8bf0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bef59e700 1 --2- 172.21.15.154:0/1598665822 >> v2:172.21.15.154:3300/0 conn(0x7f8bf009ad40 0x7f8bf0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bef59e700 1 -- 172.21.15.154:0/1598665822 >> v1:172.21.15.154:6789/0 conn(0x7f8bf0133f70 legacy=0x7f8bf00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bef59e700 1 -- 172.21.15.154:0/1598665822 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00a2fa0 con 0x7f8bf01343d0 2023-09-30T22:23:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.047+0000 7f8bef59e700 1 --2- 172.21.15.154:0/1598665822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf01343d0 0x7f8bf00a1180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009e50 tx=0x7f8be800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5b441ae23bac40d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bedd9b700 1 -- 172.21.15.154:0/1598665822 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800e070 con 0x7f8bf01343d0 2023-09-30T22:23:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bedd9b700 1 -- 172.21.15.154:0/1598665822 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800b910 con 0x7f8bf01343d0 2023-09-30T22:23:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bedd9b700 1 -- 172.21.15.154:0/1598665822 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800bcc0 con 0x7f8bf01343d0 2023-09-30T22:23:53.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bf5031700 1 -- 172.21.15.154:0/1598665822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf01343d0 msgr2=0x7f8bf00a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bf5031700 1 --2- 172.21.15.154:0/1598665822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf01343d0 0x7f8bf00a1180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009e50 tx=0x7f8be800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:53.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bf5031700 1 -- 172.21.15.154:0/1598665822 shutdown_connections 2023-09-30T22:23:53.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bf5031700 1 --2- 172.21.15.154:0/1598665822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf01343d0 0x7f8bf00a1180 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bf5031700 1 --2- 172.21.15.154:0/1598665822 >> v2:172.21.15.154:3300/0 conn(0x7f8bf009ad40 0x7f8bf0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bf5031700 1 -- 172.21.15.154:0/1598665822 >> 172.21.15.154:0/1598665822 conn(0x7f8bf0099c40 msgr2=0x7f8bf006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bf5031700 1 -- 172.21.15.154:0/1598665822 shutdown_connections 2023-09-30T22:23:53.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.048+0000 7f8bf5031700 1 -- 172.21.15.154:0/1598665822 wait complete. 2023-09-30T22:23:53.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.050+0000 7f8bf5031700 1 Processor -- start 2023-09-30T22:23:53.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.050+0000 7f8bf5031700 1 -- start start 2023-09-30T22:23:53.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bf5031700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf009ad40 0x7f8bf0121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bf5031700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8bf0133f70 0x7f8bf01217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bf5031700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01343d0 0x7f8bf0121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bf5031700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0124d90 con 0x7f8bf01343d0 2023-09-30T22:23:53.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bf5031700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0123d30 con 0x7f8bf009ad40 2023-09-30T22:23:53.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bf5031700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf01226d0 con 0x7f8bf0133f70 2023-09-30T22:23:53.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8beed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf009ad40 0x7f8bf0121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8beed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf009ad40 0x7f8bf0121270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58860/0 (socket says 172.21.15.154:58860) 2023-09-30T22:23:53.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8beed9d700 1 -- 172.21.15.154:0/387444301 learned_addr learned my addr 172.21.15.154:0/387444301 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:53.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bee59c700 1 --2- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8bf0133f70 0x7f8bf01217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bef59e700 1 --2- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01343d0 0x7f8bf0121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8beed9d700 1 -- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8bf0133f70 msgr2=0x7f8bf01217b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8beed9d700 1 --2- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8bf0133f70 0x7f8bf01217b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8beed9d700 1 -- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01343d0 msgr2=0x7f8bf0121cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8beed9d700 1 --2- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01343d0 0x7f8bf0121cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8beed9d700 1 -- 172.21.15.154:0/387444301 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8009b30 con 0x7f8bf009ad40 2023-09-30T22:23:53.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8beed9d700 1 --2- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf009ad40 0x7f8bf0121270 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8be000e8a0 tx=0x7f8be000ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bd77fe700 1 -- 172.21.15.154:0/387444301 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0013680 con 0x7f8bf009ad40 2023-09-30T22:23:53.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bd77fe700 1 -- 172.21.15.154:0/387444301 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be00137e0 con 0x7f8bf009ad40 2023-09-30T22:23:53.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bd77fe700 1 -- 172.21.15.154:0/387444301 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0013b50 con 0x7f8bf009ad40 2023-09-30T22:23:53.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.051+0000 7f8bf5031700 1 -- 172.21.15.154:0/387444301 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf00a4e90 con 0x7f8bf009ad40 2023-09-30T22:23:53.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.052+0000 7f8bf5031700 1 -- 172.21.15.154:0/387444301 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf009c7e0 con 0x7f8bf009ad40 2023-09-30T22:23:53.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.052+0000 7f8bd77fe700 1 -- 172.21.15.154:0/387444301 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8be0013cb0 con 0x7f8bf009ad40 2023-09-30T22:23:53.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.052+0000 7f8bd77fe700 1 -- 172.21.15.154:0/387444301 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8be003f980 con 0x7f8bf009ad40 2023-09-30T22:23:53.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.053+0000 7f8bf5031700 1 -- 172.21.15.154:0/387444301 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf011e060 con 0x7f8bf009ad40 2023-09-30T22:23:53.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.057+0000 7f8bd77fe700 1 -- 172.21.15.154:0/387444301 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8be001adc0 con 0x7f8bf009ad40 2023-09-30T22:23:53.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f7187b2c700 1 Processor -- start 2023-09-30T22:23:53.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f08abf56700 1 Processor -- start 2023-09-30T22:23:53.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f7187b2c700 1 -- start start 2023-09-30T22:23:53.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f08abf56700 1 -- start start 2023-09-30T22:23:53.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f7187b2c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 0x7f71801359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f7187b2c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f7180138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f08abf56700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a409e950 0x7f08a409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f08abf56700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409f260 0x7f08a4137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f08abf56700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a409ac20 con 0x7f08a41381e0 2023-09-30T22:23:53.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f08abf56700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40a06c0 con 0x7f08a409f260 2023-09-30T22:23:53.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f08abf56700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08a409ae90 con 0x7f08a409e950 2023-09-30T22:23:53.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f7187b2c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718009aaa0 con 0x7f718009d860 2023-09-30T22:23:53.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f7187b2c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718009e730 con 0x7f718009e340 2023-09-30T22:23:53.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.089+0000 7f7187b2c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f718009f870 con 0x7f7180135f20 2023-09-30T22:23:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a94f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409f260 0x7f08a4137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a94f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409f260 0x7f08a4137ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58886/0 (socket says 172.21.15.154:58886) 2023-09-30T22:23:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a94f1700 1 -- 172.21.15.154:0/1498477054 learned_addr learned my addr 172.21.15.154:0/1498477054 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71850c7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 0x7f71801359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71858c8700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f718009d860 0x7f718009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41144/0 (socket says 172.21.15.154:41144) 2023-09-30T22:23:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71858c8700 1 -- 172.21.15.154:0/1646504859 learned_addr learned my addr 172.21.15.154:0/1646504859 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:53.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71860c9700 1 --2- 172.21.15.154:0/1646504859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f7180138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a9cf2700 1 --2- 172.21.15.154:0/1498477054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a409e950 0x7f08a409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71848c6700 1 -- 172.21.15.154:0/1646504859 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323314338 0 0) 0x7f718009aaa0 con 0x7f718009d860 2023-09-30T22:23:53.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71848c6700 1 -- 172.21.15.154:0/1646504859 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f716c0035b0 con 0x7f718009d860 2023-09-30T22:23:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a94f1700 1 -- 172.21.15.154:0/1498477054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a409e950 msgr2=0x7f08a409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a94f1700 1 --2- 172.21.15.154:0/1498477054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a409e950 0x7f08a409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a94f1700 1 -- 172.21.15.154:0/1498477054 >> v1:172.21.15.154:6789/0 conn(0x7f08a41381e0 legacy=0x7f08a413a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a94f1700 1 -- 172.21.15.154:0/1498477054 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a406ba00 con 0x7f08a409f260 2023-09-30T22:23:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a94f1700 1 --2- 172.21.15.154:0/1498477054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409f260 0x7f08a4137ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0894009920 tx=0x7f0894009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9902bff3a307c107 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71850c7700 1 -- 172.21.15.154:0/1646504859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 msgr2=0x7f7180138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:53.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71850c7700 1 --2- 172.21.15.154:0/1646504859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f7180138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71850c7700 1 -- 172.21.15.154:0/1646504859 >> v1:172.21.15.154:6789/0 conn(0x7f718009d860 legacy=0x7f718009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f71850c7700 1 -- 172.21.15.154:0/1646504859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718009b360 con 0x7f718009e340 2023-09-30T22:23:53.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f71850c7700 1 --2- 172.21.15.154:0/1646504859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 0x7f71801359e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7170009870 tx=0x7f7170009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3684df87c0cbf089 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.090+0000 7f08a8cf0700 1 -- 172.21.15.154:0/1498477054 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894004230 con 0x7f08a409f260 2023-09-30T22:23:53.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f08a8cf0700 1 -- 172.21.15.154:0/1498477054 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0894004390 con 0x7f08a409f260 2023-09-30T22:23:53.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f08a8cf0700 1 -- 172.21.15.154:0/1498477054 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894009e70 con 0x7f08a409f260 2023-09-30T22:23:53.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f71848c6700 1 -- 172.21.15.154:0/1646504859 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170011830 con 0x7f718009e340 2023-09-30T22:23:53.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f71848c6700 1 -- 172.21.15.154:0/1646504859 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7170011990 con 0x7f718009e340 2023-09-30T22:23:53.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f71848c6700 1 -- 172.21.15.154:0/1646504859 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170011d20 con 0x7f718009e340 2023-09-30T22:23:53.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f08abf56700 1 -- 172.21.15.154:0/1498477054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409f260 msgr2=0x7f08a4137ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f08abf56700 1 --2- 172.21.15.154:0/1498477054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409f260 0x7f08a4137ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0894009920 tx=0x7f0894009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:53.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f08abf56700 1 -- 172.21.15.154:0/1498477054 shutdown_connections 2023-09-30T22:23:53.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f08abf56700 1 --2- 172.21.15.154:0/1498477054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a409e950 0x7f08a409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f08abf56700 1 --2- 172.21.15.154:0/1498477054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409f260 0x7f08a4137ca0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f08abf56700 1 -- 172.21.15.154:0/1498477054 >> 172.21.15.154:0/1498477054 conn(0x7f08a40a0f70 msgr2=0x7f08a40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.091+0000 7f08abf56700 1 -- 172.21.15.154:0/1498477054 shutdown_connections 2023-09-30T22:23:53.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f08abf56700 1 -- 172.21.15.154:0/1498477054 wait complete. 2023-09-30T22:23:53.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f7187b2c700 1 -- 172.21.15.154:0/1646504859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 msgr2=0x7f71801359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f7187b2c700 1 --2- 172.21.15.154:0/1646504859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 0x7f71801359e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7170009870 tx=0x7f7170009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:53.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f7187b2c700 1 -- 172.21.15.154:0/1646504859 shutdown_connections 2023-09-30T22:23:53.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f7187b2c700 1 --2- 172.21.15.154:0/1646504859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f7180138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f7187b2c700 1 --2- 172.21.15.154:0/1646504859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 0x7f71801359e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f7187b2c700 1 -- 172.21.15.154:0/1646504859 >> 172.21.15.154:0/1646504859 conn(0x7f7180099c40 msgr2=0x7f71800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f08abf56700 1 Processor -- start 2023-09-30T22:23:53.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f08abf56700 1 -- start start 2023-09-30T22:23:53.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f7187b2c700 1 -- 172.21.15.154:0/1646504859 shutdown_connections 2023-09-30T22:23:53.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.092+0000 7f7187b2c700 1 -- 172.21.15.154:0/1646504859 wait complete. 2023-09-30T22:23:53.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08abf56700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409e950 0x7f08a4121a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08abf56700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a409f260 0x7f08a4121f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08abf56700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a41381e0 0x7f08a41224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08abf56700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4122f20 con 0x7f08a409f260 2023-09-30T22:23:53.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08abf56700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4125570 con 0x7f08a409e950 2023-09-30T22:23:53.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08abf56700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4124fd0 con 0x7f08a41381e0 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08a9cf2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409e950 0x7f08a4121a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08a9cf2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409e950 0x7f08a4121a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58900/0 (socket says 172.21.15.154:58900) 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08a9cf2700 1 -- 172.21.15.154:0/4136836471 learned_addr learned my addr 172.21.15.154:0/4136836471 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08a94f1700 1 --2- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a409f260 0x7f08a4121f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08aa4f3700 1 --2- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a41381e0 0x7f08a41224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08a9cf2700 1 -- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a41381e0 msgr2=0x7f08a41224d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08a9cf2700 1 --2- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a41381e0 0x7f08a41224d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08a9cf2700 1 -- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a409f260 msgr2=0x7f08a4121f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08a9cf2700 1 --2- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a409f260 0x7f08a4121f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f08a9cf2700 1 -- 172.21.15.154:0/4136836471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0894009550 con 0x7f08a409e950 2023-09-30T22:23:53.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.093+0000 7f7187b2c700 1 Processor -- start 2023-09-30T22:23:53.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f7187b2c700 1 -- start start 2023-09-30T22:23:53.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f08a9cf2700 1 --2- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409e950 0x7f08a4121a50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f08a000e730 tx=0x7f08a000ea40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f089a7fc700 1 -- 172.21.15.154:0/4136836471 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0005c20 con 0x7f08a409e950 2023-09-30T22:23:53.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f089a7fc700 1 -- 172.21.15.154:0/4136836471 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a0005d80 con 0x7f08a409e950 2023-09-30T22:23:53.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f08abf56700 1 -- 172.21.15.154:0/4136836471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a4123660 con 0x7f08a409e950 2023-09-30T22:23:53.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f089a7fc700 1 -- 172.21.15.154:0/4136836471 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0006240 con 0x7f08a409e950 2023-09-30T22:23:53.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f08abf56700 1 -- 172.21.15.154:0/4136836471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a409e350 con 0x7f08a409e950 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f7187b2c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718009d860 0x7f7180139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f7187b2c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 0x7f7180139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f7187b2c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f718013a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f7187b2c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71801212c0 con 0x7f718009d860 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f7187b2c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7180120690 con 0x7f718009e340 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f7187b2c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f718011fc30 con 0x7f7180135f20 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f71860c9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f718013a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f71860c9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f718013a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59070/0 (socket says 172.21.15.154:59070) 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f71860c9700 1 -- 172.21.15.154:0/1984982562 learned_addr learned my addr 172.21.15.154:0/1984982562 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:53.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.094+0000 7f71858c8700 1 --2- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718009d860 0x7f7180139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f089a7fc700 1 -- 172.21.15.154:0/4136836471 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08a00063a0 con 0x7f08a409e950 2023-09-30T22:23:53.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71860c9700 1 -- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 msgr2=0x7f7180139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71860c9700 1 --2- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 0x7f7180139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71860c9700 1 -- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718009d860 msgr2=0x7f7180139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71860c9700 1 --2- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718009d860 0x7f7180139880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71860c9700 1 -- 172.21.15.154:0/1984982562 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700094a0 con 0x7f7180135f20 2023-09-30T22:23:53.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71858c8700 1 --2- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718009d860 0x7f7180139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:53.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f089a7fc700 1 -- 172.21.15.154:0/4136836471 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f08a003f170 con 0x7f08a409e950 2023-09-30T22:23:53.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71860c9700 1 --2- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f718013a300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7178007e40 tx=0x7f717800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f08abf56700 1 -- 172.21.15.154:0/4136836471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c0052e0 con 0x7f08a409e950 2023-09-30T22:23:53.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71767fc700 1 -- 172.21.15.154:0/1984982562 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717800eea0 con 0x7f7180135f20 2023-09-30T22:23:53.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71767fc700 1 -- 172.21.15.154:0/1984982562 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7178014420 con 0x7f7180135f20 2023-09-30T22:23:53.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f71767fc700 1 -- 172.21.15.154:0/1984982562 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71780147b0 con 0x7f7180135f20 2023-09-30T22:23:53.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f7187b2c700 1 -- 172.21.15.154:0/1984982562 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71800a2890 con 0x7f7180135f20 2023-09-30T22:23:53.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.095+0000 7f7187b2c700 1 -- 172.21.15.154:0/1984982562 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7180135be0 con 0x7f7180135f20 2023-09-30T22:23:53.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.096+0000 7f71767fc700 1 -- 172.21.15.154:0/1984982562 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7178014910 con 0x7f7180135f20 2023-09-30T22:23:53.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.096+0000 7f71767fc700 1 -- 172.21.15.154:0/1984982562 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f717803ff60 con 0x7f7180135f20 2023-09-30T22:23:53.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.096+0000 7f7187b2c700 1 -- 172.21.15.154:0/1984982562 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718004f2a0 con 0x7f7180135f20 2023-09-30T22:23:53.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.100+0000 7f089a7fc700 1 -- 172.21.15.154:0/4136836471 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08a0006650 con 0x7f08a409e950 2023-09-30T22:23:53.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.102+0000 7f71767fc700 1 -- 172.21.15.154:0/1984982562 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f717806b750 con 0x7f7180135f20 2023-09-30T22:23:53.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.254+0000 7f8bf5031700 1 -- 172.21.15.154:0/387444301 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8bf004f2a0 con 0x7f8bf009ad40 2023-09-30T22:23:53.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.254+0000 7f8bd77fe700 1 -- 172.21.15.154:0/387444301 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8be0021030 con 0x7f8bf009ad40 2023-09-30T22:23:53.256 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.257+0000 7f8bf5031700 1 -- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf009ad40 msgr2=0x7f8bf0121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.257+0000 7f8bf5031700 1 --2- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf009ad40 0x7f8bf0121270 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8be000e8a0 tx=0x7f8be000ebb0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.257+0000 7f8bf5031700 1 -- 172.21.15.154:0/387444301 shutdown_connections 2023-09-30T22:23:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.257+0000 7f8bf5031700 1 --2- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01343d0 0x7f8bf0121cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.257+0000 7f8bf5031700 1 --2- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf009ad40 0x7f8bf0121270 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.257+0000 7f8bf5031700 1 --2- 172.21.15.154:0/387444301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8bf0133f70 0x7f8bf01217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.257+0000 7f8bf5031700 1 -- 172.21.15.154:0/387444301 >> 172.21.15.154:0/387444301 conn(0x7f8bf0099c40 msgr2=0x7f8bf0133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.257+0000 7f8bf5031700 1 -- 172.21.15.154:0/387444301 shutdown_connections 2023-09-30T22:23:53.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.257+0000 7f8bf5031700 1 -- 172.21.15.154:0/387444301 wait complete. 2023-09-30T22:23:53.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:53.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.292+0000 7f08abf56700 1 -- 172.21.15.154:0/4136836471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f088c005590 con 0x7f08a409e950 2023-09-30T22:23:53.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.293+0000 7f089a7fc700 1 -- 172.21.15.154:0/4136836471 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08a002a090 con 0x7f08a409e950 2023-09-30T22:23:53.294 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:53.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.296+0000 7f08abf56700 1 -- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409e950 msgr2=0x7f08a4121a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.296+0000 7f08abf56700 1 --2- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409e950 0x7f08a4121a50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f08a000e730 tx=0x7f08a000ea40 comp rx=0 tx=0).stop 2023-09-30T22:23:53.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.296+0000 7f08abf56700 1 -- 172.21.15.154:0/4136836471 shutdown_connections 2023-09-30T22:23:53.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.296+0000 7f08abf56700 1 --2- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08a41381e0 0x7f08a41224d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.296+0000 7f08abf56700 1 --2- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08a409e950 0x7f08a4121a50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.296+0000 7f08abf56700 1 --2- 172.21.15.154:0/4136836471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08a409f260 0x7f08a4121f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.296+0000 7f08abf56700 1 -- 172.21.15.154:0/4136836471 >> 172.21.15.154:0/4136836471 conn(0x7f08a40a0f70 msgr2=0x7f08a4071060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.296+0000 7f08abf56700 1 -- 172.21.15.154:0/4136836471 shutdown_connections 2023-09-30T22:23:53.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.296+0000 7f08abf56700 1 -- 172.21.15.154:0/4136836471 wait complete. 2023-09-30T22:23:53.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.297+0000 7f7187b2c700 1 -- 172.21.15.154:0/1984982562 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f718006c3b0 con 0x7f7180135f20 2023-09-30T22:23:53.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.297+0000 7f71767fc700 1 -- 172.21.15.154:0/1984982562 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f717801bb60 con 0x7f7180135f20 2023-09-30T22:23:53.298 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:53.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.299+0000 7f7187b2c700 1 -- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 msgr2=0x7f718013a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.299+0000 7f7187b2c700 1 --2- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f718013a300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7178007e40 tx=0x7f717800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.299+0000 7f7187b2c700 1 -- 172.21.15.154:0/1984982562 shutdown_connections 2023-09-30T22:23:53.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.299+0000 7f7187b2c700 1 --2- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7180135f20 0x7f718013a300 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.299+0000 7f7187b2c700 1 --2- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f718009d860 0x7f7180139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.299+0000 7f7187b2c700 1 --2- 172.21.15.154:0/1984982562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f718009e340 0x7f7180139dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.299+0000 7f7187b2c700 1 -- 172.21.15.154:0/1984982562 >> 172.21.15.154:0/1984982562 conn(0x7f7180099c40 msgr2=0x7f71800a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.299+0000 7f7187b2c700 1 -- 172.21.15.154:0/1984982562 shutdown_connections 2023-09-30T22:23:53.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.299+0000 7f7187b2c700 1 -- 172.21.15.154:0/1984982562 wait complete. 2023-09-30T22:23:53.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:53.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:53.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:53.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.518+0000 7f9291a32700 1 Processor -- start 2023-09-30T22:23:53.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.518+0000 7f9291a32700 1 -- start start 2023-09-30T22:23:53.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f9291a32700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f928c133ad0 0x7f928c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f9291a32700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f9291a32700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f9291a32700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c06b2d0 con 0x7f928c133ad0 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f9291a32700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c133610 con 0x7f928c1300a0 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f9291a32700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f928c09a500 con 0x7f928c1309f0 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f928c133ad0 0x7f928c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f928c133ad0 0x7f928c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44804/0 (socket says 172.21.15.154:44804) 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928affd700 1 -- 172.21.15.154:0/3165396003 learned_addr learned my addr 172.21.15.154:0/3165396003 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928affd700 1 -- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 msgr2=0x7f928c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928affd700 1 --2- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928affd700 1 -- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 msgr2=0x7f928c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928affd700 1 --2- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928affd700 1 -- 172.21.15.154:0/3165396003 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c1338b0 con 0x7f928c133ad0 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928b7fe700 1 --2- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928a7fc700 1 --2- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f928affd700 1 --2- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 0x7f928c133ea0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f92800098f0 tx=0x7f9280009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f91c2ed36e349c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.519+0000 7f9289ffb700 1 -- 172.21.15.154:0/3165396003 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280011830 con 0x7f928c133ad0 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9289ffb700 1 -- 172.21.15.154:0/3165396003 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280011990 con 0x7f928c133ad0 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9289ffb700 1 -- 172.21.15.154:0/3165396003 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280011d20 con 0x7f928c133ad0 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9291a32700 1 -- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 msgr2=0x7f928c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9291a32700 1 --2- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 0x7f928c133ea0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f92800098f0 tx=0x7f9280009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9291a32700 1 -- 172.21.15.154:0/3165396003 shutdown_connections 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9291a32700 1 --2- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9291a32700 1 --2- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 0x7f928c133ea0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9291a32700 1 --2- 172.21.15.154:0/3165396003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9291a32700 1 -- 172.21.15.154:0/3165396003 >> 172.21.15.154:0/3165396003 conn(0x7f928c099c40 msgr2=0x7f928c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9291a32700 1 -- 172.21.15.154:0/3165396003 shutdown_connections 2023-09-30T22:23:53.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.520+0000 7f9291a32700 1 -- 172.21.15.154:0/3165396003 wait complete. 2023-09-30T22:23:53.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.521+0000 7f9291a32700 1 Processor -- start 2023-09-30T22:23:53.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.521+0000 7f9291a32700 1 -- start start 2023-09-30T22:23:53.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9291a32700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9291a32700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c1c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9291a32700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 0x7f928c1c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9291a32700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c11fe90 con 0x7f928c133ad0 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9291a32700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c120170 con 0x7f928c1300a0 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9291a32700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0a33c0 con 0x7f928c1309f0 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58924/0 (socket says 172.21.15.154:58924) 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928affd700 1 -- 172.21.15.154:0/880525900 learned_addr learned my addr 172.21.15.154:0/880525900 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928b7fe700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 0x7f928c1c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928a7fc700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c1c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928b7fe700 1 -- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 msgr2=0x7f928c1c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928b7fe700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c1c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928b7fe700 1 -- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 msgr2=0x7f928c1c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928b7fe700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928b7fe700 1 -- 172.21.15.154:0/880525900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c0094a0 con 0x7f928c133ad0 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928affd700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928a7fc700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c1c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f928b7fe700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 0x7f928c1c91d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f928400efc0 tx=0x7f928400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9273fff700 1 -- 172.21.15.154:0/880525900 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400ca90 con 0x7f928c133ad0 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9273fff700 1 -- 172.21.15.154:0/880525900 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928400f040 con 0x7f928c133ad0 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9291a32700 1 -- 172.21.15.154:0/880525900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9284009a70 con 0x7f928c133ad0 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9273fff700 1 -- 172.21.15.154:0/880525900 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400ce30 con 0x7f928c133ad0 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.522+0000 7f9291a32700 1 -- 172.21.15.154:0/880525900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9280009550 con 0x7f928c133ad0 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.523+0000 7f9273fff700 1 -- 172.21.15.154:0/880525900 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9284014480 con 0x7f928c133ad0 2023-09-30T22:23:53.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.523+0000 7f9273fff700 1 -- 172.21.15.154:0/880525900 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f928403fbe0 con 0x7f928c133ad0 2023-09-30T22:23:53.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.523+0000 7f9291a32700 1 -- 172.21.15.154:0/880525900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c133270 con 0x7f928c133ad0 2023-09-30T22:23:53.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.528+0000 7f9273fff700 1 -- 172.21.15.154:0/880525900 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9284012930 con 0x7f928c133ad0 2023-09-30T22:23:53.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.712+0000 7f9291a32700 1 -- 172.21.15.154:0/880525900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f928c04f2a0 con 0x7f928c133ad0 2023-09-30T22:23:53.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.713+0000 7f9273fff700 1 -- 172.21.15.154:0/880525900 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9284009cc0 con 0x7f928c133ad0 2023-09-30T22:23:53.714 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.715+0000 7f9291a32700 1 -- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 msgr2=0x7f928c1c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.715+0000 7f9291a32700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 0x7f928c1c91d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f928400efc0 tx=0x7f928400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.715+0000 7f9291a32700 1 -- 172.21.15.154:0/880525900 shutdown_connections 2023-09-30T22:23:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.715+0000 7f9291a32700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c133ad0 0x7f928c1c91d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.715+0000 7f9291a32700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f928c1300a0 0x7f928c1c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.715+0000 7f9291a32700 1 --2- 172.21.15.154:0/880525900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f928c1309f0 0x7f928c1c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.715+0000 7f9291a32700 1 -- 172.21.15.154:0/880525900 >> 172.21.15.154:0/880525900 conn(0x7f928c099c40 msgr2=0x7f928c1320b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.715+0000 7f9291a32700 1 -- 172.21.15.154:0/880525900 shutdown_connections 2023-09-30T22:23:53.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:53.715+0000 7f9291a32700 1 -- 172.21.15.154:0/880525900 wait complete. 2023-09-30T22:23:53.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:54.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:54.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:54.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:54.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.399+0000 7fbe91a59700 1 Processor -- start 2023-09-30T22:23:54.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.399+0000 7fbe91a59700 1 -- start start 2023-09-30T22:23:54.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.399+0000 7fbe91a59700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c09ad40 0x7fbe8c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.399+0000 7fbe91a59700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.399+0000 7fbe91a59700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c09b110 con 0x7fbe8c133f70 2023-09-30T22:23:54.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.399+0000 7fbe91a59700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0a3b60 con 0x7fbe8c09ad40 2023-09-30T22:23:54.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.399+0000 7fbe91a59700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0a2fa0 con 0x7fbe8c1343a0 2023-09-30T22:23:54.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.399+0000 7fbe8b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe8b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59080/0 (socket says 172.21.15.154:59080) 2023-09-30T22:23:54.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe8b7fe700 1 -- 172.21.15.154:0/242023824 learned_addr learned my addr 172.21.15.154:0/242023824 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:54.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe8affd700 1 --2- 172.21.15.154:0/242023824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c09ad40 0x7fbe8c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe8b7fe700 1 -- 172.21.15.154:0/242023824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c09ad40 msgr2=0x7fbe8c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:54.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe8b7fe700 1 --2- 172.21.15.154:0/242023824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c09ad40 0x7fbe8c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe8b7fe700 1 -- 172.21.15.154:0/242023824 >> v1:172.21.15.154:6789/0 conn(0x7fbe8c133f70 legacy=0x7fbe8c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe89ffb700 1 -- 172.21.15.154:0/242023824 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287503271 0 0) 0x7fbe8c09b110 con 0x7fbe8c133f70 2023-09-30T22:23:54.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe8b7fe700 1 -- 172.21.15.154:0/242023824 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c09a280 con 0x7fbe8c1343a0 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe8affd700 1 --2- 172.21.15.154:0/242023824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c09ad40 0x7fbe8c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe8b7fe700 1 --2- 172.21.15.154:0/242023824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c0a1180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009e80 tx=0x7fbe8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cdf71c8cfd27706 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe89ffb700 1 -- 172.21.15.154:0/242023824 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400e070 con 0x7fbe8c1343a0 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe89ffb700 1 -- 172.21.15.154:0/242023824 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8400b910 con 0x7fbe8c1343a0 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.400+0000 7fbe89ffb700 1 -- 172.21.15.154:0/242023824 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400bcc0 con 0x7fbe8c1343a0 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.401+0000 7fbe91a59700 1 -- 172.21.15.154:0/242023824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 msgr2=0x7fbe8c0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.401+0000 7fbe91a59700 1 --2- 172.21.15.154:0/242023824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c0a1180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009e80 tx=0x7fbe8400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.401+0000 7fbe91a59700 1 -- 172.21.15.154:0/242023824 shutdown_connections 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.401+0000 7fbe91a59700 1 --2- 172.21.15.154:0/242023824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c0a1180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.401+0000 7fbe91a59700 1 --2- 172.21.15.154:0/242023824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c09ad40 0x7fbe8c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.401+0000 7fbe91a59700 1 -- 172.21.15.154:0/242023824 >> 172.21.15.154:0/242023824 conn(0x7fbe8c099c40 msgr2=0x7fbe8c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.401+0000 7fbe91a59700 1 -- 172.21.15.154:0/242023824 shutdown_connections 2023-09-30T22:23:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.401+0000 7fbe91a59700 1 -- 172.21.15.154:0/242023824 wait complete. 2023-09-30T22:23:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.402+0000 7fbe91a59700 1 Processor -- start 2023-09-30T22:23:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.402+0000 7fbe91a59700 1 -- start start 2023-09-30T22:23:54.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe91a59700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe8c09ad40 0x7fbe8c1c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe91a59700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c133f70 0x7fbe8c1c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe91a59700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c1c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe91a59700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c122580 con 0x7fbe8c09ad40 2023-09-30T22:23:54.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe91a59700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c1208c0 con 0x7fbe8c133f70 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe91a59700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c09e7a0 con 0x7fbe8c1343a0 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe8b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c1c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe8b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c1c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59082/0 (socket says 172.21.15.154:59082) 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe8b7fe700 1 -- 172.21.15.154:0/2053726225 learned_addr learned my addr 172.21.15.154:0/2053726225 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe8a7fc700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c133f70 0x7fbe8c1c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.403+0000 7fbe8affd700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe8c09ad40 0x7fbe8c1c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe8a7fc700 1 -- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 msgr2=0x7fbe8c1c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe8a7fc700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c1c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe8a7fc700 1 -- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe8c09ad40 msgr2=0x7fbe8c1c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe8a7fc700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe8c09ad40 0x7fbe8c1c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe8a7fc700 1 -- 172.21.15.154:0/2053726225 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0094a0 con 0x7fbe8c133f70 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe8b7fe700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c1c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe8a7fc700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c133f70 0x7fbe8c1c8850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c06bec0 tx=0x7fbe8000c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe73fff700 1 -- 172.21.15.154:0/2053726225 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe800054e0 con 0x7fbe8c133f70 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe73fff700 1 -- 172.21.15.154:0/2053726225 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80003680 con 0x7fbe8c133f70 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe73fff700 1 -- 172.21.15.154:0/2053726225 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80003a30 con 0x7fbe8c133f70 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe91a59700 1 -- 172.21.15.154:0/2053726225 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe84009b30 con 0x7fbe8c133f70 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.404+0000 7fbe91a59700 1 -- 172.21.15.154:0/2053726225 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c1217b0 con 0x7fbe8c133f70 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.405+0000 7fbe73fff700 1 -- 172.21.15.154:0/2053726225 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe80003b90 con 0x7fbe8c133f70 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.405+0000 7fbe73fff700 1 -- 172.21.15.154:0/2053726225 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe8003ea30 con 0x7fbe8c133f70 2023-09-30T22:23:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.405+0000 7fbe91a59700 1 -- 172.21.15.154:0/2053726225 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c123020 con 0x7fbe8c133f70 2023-09-30T22:23:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.410+0000 7fbe73fff700 1 -- 172.21.15.154:0/2053726225 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe80017080 con 0x7fbe8c133f70 2023-09-30T22:23:54.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.443+0000 7fcb216e3700 1 Processor -- start 2023-09-30T22:23:54.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.443+0000 7fcb216e3700 1 -- start start 2023-09-30T22:23:54.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb216e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c134050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb216e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 0x7fcb1c13bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb216e3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1c133a60 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb216e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c09a360 con 0x7fcb1c133c80 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb216e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c09a880 con 0x7fcb1c0a1460 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb1affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c134050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb1affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c134050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58958/0 (socket says 172.21.15.154:58958) 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb1affd700 1 -- 172.21.15.154:0/3476188133 learned_addr learned my addr 172.21.15.154:0/3476188133 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb1b7fe700 1 --2- 172.21.15.154:0/3476188133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 0x7fcb1c13bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb1affd700 1 -- 172.21.15.154:0/3476188133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 msgr2=0x7fcb1c13bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb1affd700 1 --2- 172.21.15.154:0/3476188133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 0x7fcb1c13bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb1affd700 1 -- 172.21.15.154:0/3476188133 >> v1:172.21.15.154:6789/0 conn(0x7fcb1c0a08e0 legacy=0x7fcb1c0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb19ffb700 1 -- 172.21.15.154:0/3476188133 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832974023 0 0) 0x7fcb1c133a60 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.444+0000 7fcb1affd700 1 -- 172.21.15.154:0/3476188133 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c09ab40 con 0x7fcb1c133c80 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb1affd700 1 --2- 172.21.15.154:0/3476188133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c134050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009920 tx=0x7fcb0c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f754e3cc6f1f4e73 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb19ffb700 1 -- 172.21.15.154:0/3476188133 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c011830 con 0x7fcb1c133c80 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb19ffb700 1 -- 172.21.15.154:0/3476188133 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c011990 con 0x7fcb1c133c80 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb19ffb700 1 -- 172.21.15.154:0/3476188133 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c011d20 con 0x7fcb1c133c80 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb216e3700 1 -- 172.21.15.154:0/3476188133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 msgr2=0x7fcb1c134050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb216e3700 1 --2- 172.21.15.154:0/3476188133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c134050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009920 tx=0x7fcb0c009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb216e3700 1 -- 172.21.15.154:0/3476188133 shutdown_connections 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb216e3700 1 --2- 172.21.15.154:0/3476188133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 0x7fcb1c13bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb216e3700 1 --2- 172.21.15.154:0/3476188133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c134050 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb216e3700 1 -- 172.21.15.154:0/3476188133 >> 172.21.15.154:0/3476188133 conn(0x7fcb1c0a2980 msgr2=0x7fcb1c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb216e3700 1 -- 172.21.15.154:0/3476188133 shutdown_connections 2023-09-30T22:23:54.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.445+0000 7fcb216e3700 1 -- 172.21.15.154:0/3476188133 wait complete. 2023-09-30T22:23:54.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.447+0000 7fcb216e3700 1 Processor -- start 2023-09-30T22:23:54.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.447+0000 7fcb216e3700 1 -- start start 2023-09-30T22:23:54.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.447+0000 7fcb216e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0a08e0 0x7fcb1c11b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.447+0000 7fcb216e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 0x7fcb1c1c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.447+0000 7fcb216e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c1c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb216e3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c11e140 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb216e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c132ac0 con 0x7fcb1c133c80 2023-09-30T22:23:54.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb216e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c11d380 con 0x7fcb1c0a1460 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0a08e0 0x7fcb1c11b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 0x7fcb1c1c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0a08e0 0x7fcb1c11b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44826/0 (socket says 172.21.15.154:44826) 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1affd700 1 -- 172.21.15.154:0/4105851695 learned_addr learned my addr 172.21.15.154:0/4105851695 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1b7fe700 1 --2- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c1c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1affd700 1 -- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 msgr2=0x7fcb1c1c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1affd700 1 --2- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 0x7fcb1c1c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1affd700 1 -- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 msgr2=0x7fcb1c1c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1affd700 1 --2- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c1c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1affd700 1 -- 172.21.15.154:0/4105851695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c009550 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1b7fe700 1 --2- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:54.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb1affd700 1 --2- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0a08e0 0x7fcb1c11b6d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00a010 tx=0x7fcb0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb037fe700 1 -- 172.21.15.154:0/4105851695 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c004450 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb037fe700 1 -- 172.21.15.154:0/4105851695 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c0045b0 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb216e3700 1 -- 172.21.15.154:0/4105851695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1c11daa0 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb037fe700 1 -- 172.21.15.154:0/4105851695 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0038e0 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.448+0000 7fcb216e3700 1 -- 172.21.15.154:0/4105851695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1c11c130 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.449+0000 7fcb037fe700 1 -- 172.21.15.154:0/4105851695 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb0c003a40 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.449+0000 7fcb216e3700 1 -- 172.21.15.154:0/4105851695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1c04f2a0 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.450+0000 7fcb037fe700 1 -- 172.21.15.154:0/4105851695 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb0c040710 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.458+0000 7fa543935700 1 Processor -- start 2023-09-30T22:23:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.458+0000 7fa543935700 1 -- start start 2023-09-30T22:23:54.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.458+0000 7fcb037fe700 1 -- 172.21.15.154:0/4105851695 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb0c02b3a0 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa543935700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa53c09e870 0x7fa53c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa543935700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09f180 0x7fa53c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa543935700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c131d70 0x7fa53c1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa543935700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c0a0920 con 0x7fa53c09e870 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa543935700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c09c970 con 0x7fa53c131d70 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa543935700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c09bab0 con 0x7fa53c09f180 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa5416d1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa53c09e870 0x7fa53c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa540ed0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09f180 0x7fa53c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa5416d1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa53c09e870 0x7fa53c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44830/0 (socket says 172.21.15.154:44830) 2023-09-30T22:23:54.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa5416d1700 1 -- 172.21.15.154:0/1364448174 learned_addr learned my addr 172.21.15.154:0/1364448174 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa541ed2700 1 --2- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c131d70 0x7fa53c1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa5416d1700 1 -- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09f180 msgr2=0x7fa53c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa5416d1700 1 --2- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09f180 0x7fa53c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa5416d1700 1 -- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c131d70 msgr2=0x7fa53c1321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa5416d1700 1 --2- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c131d70 0x7fa53c1321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa5416d1700 1 -- 172.21.15.154:0/1364448174 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c09f9c0 con 0x7fa53c09e870 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa5416d1700 1 --2- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c09e870 0x7fa53c09ec40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa538009920 tx=0x7fa538009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da428d242579ea6c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.459+0000 7fa533fff700 1 -- 172.21.15.154:0/1364448174 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538011830 con 0x7fa53c09e870 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.460+0000 7fa533fff700 1 -- 172.21.15.154:0/1364448174 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa538011990 con 0x7fa53c09e870 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.460+0000 7fa533fff700 1 -- 172.21.15.154:0/1364448174 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538011d20 con 0x7fa53c09e870 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.460+0000 7fa543935700 1 -- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c09e870 msgr2=0x7fa53c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.460+0000 7fa543935700 1 --2- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c09e870 0x7fa53c09ec40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa538009920 tx=0x7fa538009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.461+0000 7fa543935700 1 -- 172.21.15.154:0/1364448174 shutdown_connections 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.461+0000 7fa543935700 1 --2- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c131d70 0x7fa53c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.461+0000 7fa543935700 1 --2- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c09e870 0x7fa53c09ec40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.461+0000 7fa543935700 1 --2- 172.21.15.154:0/1364448174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09f180 0x7fa53c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.461+0000 7fa543935700 1 -- 172.21.15.154:0/1364448174 >> 172.21.15.154:0/1364448174 conn(0x7fa53c0a4430 msgr2=0x7fa53c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.461+0000 7fa543935700 1 -- 172.21.15.154:0/1364448174 shutdown_connections 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.461+0000 7fa543935700 1 -- 172.21.15.154:0/1364448174 wait complete. 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa543935700 1 Processor -- start 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa543935700 1 -- start start 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa543935700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09e870 0x7fa53c11f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa543935700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c09f180 0x7fa53c11f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa543935700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c131d70 0x7fa53c11fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa543935700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c122a70 con 0x7fa53c131d70 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa543935700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c120da0 con 0x7fa53c09f180 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa543935700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c121c30 con 0x7fa53c09e870 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa541ed2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c131d70 0x7fa53c11fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa540ed0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c09f180 0x7fa53c11f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa541ed2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c131d70 0x7fa53c11fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44842/0 (socket says 172.21.15.154:44842) 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa541ed2700 1 -- 172.21.15.154:0/2911275181 learned_addr learned my addr 172.21.15.154:0/2911275181 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa540ed0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c09f180 0x7fa53c11f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58978/0 (socket says 172.21.15.154:58978) 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa5416d1700 1 --2- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09e870 0x7fa53c11f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.462+0000 7fa541ed2700 1 -- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09e870 msgr2=0x7fa53c11f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa541ed2700 1 --2- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09e870 0x7fa53c11f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa541ed2700 1 -- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c09f180 msgr2=0x7fa53c11f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa541ed2700 1 --2- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c09f180 0x7fa53c11f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa541ed2700 1 -- 172.21.15.154:0/2911275181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538009550 con 0x7fa53c131d70 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa541ed2700 1 --2- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c131d70 0x7fa53c11fc10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa534009dd0 tx=0x7fa53400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa531ffb700 1 -- 172.21.15.154:0/2911275181 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534009c40 con 0x7fa53c131d70 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa531ffb700 1 -- 172.21.15.154:0/2911275181 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53400f040 con 0x7fa53c131d70 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa543935700 1 -- 172.21.15.154:0/2911275181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c122710 con 0x7fa53c131d70 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa531ffb700 1 -- 172.21.15.154:0/2911275181 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400ceb0 con 0x7fa53c131d70 2023-09-30T22:23:54.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.463+0000 7fa543935700 1 -- 172.21.15.154:0/2911275181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c122440 con 0x7fa53c131d70 2023-09-30T22:23:54.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.464+0000 7fa543935700 1 -- 172.21.15.154:0/2911275181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c11be60 con 0x7fa53c131d70 2023-09-30T22:23:54.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.465+0000 7fa531ffb700 1 -- 172.21.15.154:0/2911275181 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa534014480 con 0x7fa53c131d70 2023-09-30T22:23:54.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.465+0000 7fa531ffb700 1 -- 172.21.15.154:0/2911275181 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa5340402f0 con 0x7fa53c131d70 2023-09-30T22:23:54.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.474+0000 7fa531ffb700 1 -- 172.21.15.154:0/2911275181 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa534007920 con 0x7fa53c131d70 2023-09-30T22:23:54.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.630+0000 7fbe91a59700 1 -- 172.21.15.154:0/2053726225 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe8c04f2a0 con 0x7fbe8c133f70 2023-09-30T22:23:54.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.631+0000 7fbe73fff700 1 -- 172.21.15.154:0/2053726225 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe80003e40 con 0x7fbe8c133f70 2023-09-30T22:23:54.632 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.634+0000 7fbe91a59700 1 -- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c133f70 msgr2=0x7fbe8c1c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.634+0000 7fbe91a59700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c133f70 0x7fbe8c1c8850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c06bec0 tx=0x7fbe8000c710 comp rx=0 tx=0).stop 2023-09-30T22:23:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.634+0000 7fbe91a59700 1 -- 172.21.15.154:0/2053726225 shutdown_connections 2023-09-30T22:23:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.634+0000 7fbe91a59700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8c1343a0 0x7fbe8c1c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.634+0000 7fbe91a59700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe8c09ad40 0x7fbe8c1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.634+0000 7fbe91a59700 1 --2- 172.21.15.154:0/2053726225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8c133f70 0x7fbe8c1c8850 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.634+0000 7fbe91a59700 1 -- 172.21.15.154:0/2053726225 >> 172.21.15.154:0/2053726225 conn(0x7fbe8c099c40 msgr2=0x7fbe8c1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.634+0000 7fbe91a59700 1 -- 172.21.15.154:0/2053726225 shutdown_connections 2023-09-30T22:23:54.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.634+0000 7fbe91a59700 1 -- 172.21.15.154:0/2053726225 wait complete. 2023-09-30T22:23:54.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:54.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.673+0000 7fcb216e3700 1 -- 172.21.15.154:0/4105851695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb1c06bce0 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.673+0000 7fcb037fe700 1 -- 172.21.15.154:0/4105851695 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb0c015070 con 0x7fcb1c0a08e0 2023-09-30T22:23:54.674 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:54.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.675+0000 7fcb216e3700 1 -- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0a08e0 msgr2=0x7fcb1c11b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.675+0000 7fcb216e3700 1 --2- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0a08e0 0x7fcb1c11b6d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00a010 tx=0x7fcb0c004750 comp rx=0 tx=0).stop 2023-09-30T22:23:54.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.675+0000 7fcb216e3700 1 -- 172.21.15.154:0/4105851695 shutdown_connections 2023-09-30T22:23:54.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.675+0000 7fcb216e3700 1 --2- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c133c80 0x7fcb1c1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.675+0000 7fcb216e3700 1 --2- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0a08e0 0x7fcb1c11b6d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.675+0000 7fcb216e3700 1 --2- 172.21.15.154:0/4105851695 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1c0a1460 0x7fcb1c1c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.675+0000 7fcb216e3700 1 -- 172.21.15.154:0/4105851695 >> 172.21.15.154:0/4105851695 conn(0x7fcb1c0a2980 msgr2=0x7fcb1c1baf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.675+0000 7fcb216e3700 1 -- 172.21.15.154:0/4105851695 shutdown_connections 2023-09-30T22:23:54.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.675+0000 7fcb216e3700 1 -- 172.21.15.154:0/4105851695 wait complete. 2023-09-30T22:23:54.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.676+0000 7fa543935700 1 -- 172.21.15.154:0/2911275181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa53c04f2a0 con 0x7fa53c131d70 2023-09-30T22:23:54.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.676+0000 7fa531ffb700 1 -- 172.21.15.154:0/2911275181 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa534007330 con 0x7fa53c131d70 2023-09-30T22:23:54.678 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:54.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.678+0000 7fa543935700 1 -- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c131d70 msgr2=0x7fa53c11fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.678+0000 7fa543935700 1 --2- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c131d70 0x7fa53c11fc10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa534009dd0 tx=0x7fa53400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.678+0000 7fa543935700 1 -- 172.21.15.154:0/2911275181 shutdown_connections 2023-09-30T22:23:54.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.678+0000 7fa543935700 1 --2- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa53c131d70 0x7fa53c11fc10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.678+0000 7fa543935700 1 --2- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa53c09e870 0x7fa53c11f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.678+0000 7fa543935700 1 --2- 172.21.15.154:0/2911275181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53c09f180 0x7fa53c11f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.678+0000 7fa543935700 1 -- 172.21.15.154:0/2911275181 >> 172.21.15.154:0/2911275181 conn(0x7fa53c0a4430 msgr2=0x7fa53c1310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.681+0000 7fa543935700 1 -- 172.21.15.154:0/2911275181 shutdown_connections 2023-09-30T22:23:54.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.681+0000 7fa543935700 1 -- 172.21.15.154:0/2911275181 wait complete. 2023-09-30T22:23:54.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:54.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:54.728 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:54.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.855+0000 7f3b91889700 1 Processor -- start 2023-09-30T22:23:54.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.855+0000 7f3b91889700 1 -- start start 2023-09-30T22:23:54.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b91889700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c0a0a90 0x7f3b8c0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b91889700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 0x7f3b8c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b91889700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b8c133f70 0x7f3b8c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b91889700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8c0a3aa0 con 0x7f3b8c133f70 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b91889700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c09a540 con 0x7f3b8c0a13a0 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b91889700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c0a1fe0 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b8c133f70 0x7f3b8c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 0x7f3b8c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c0a0a90 0x7f3b8c0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b8c133f70 0x7f3b8c134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44858/0 (socket says 172.21.15.154:44858) 2023-09-30T22:23:54.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8b7fe700 1 -- 172.21.15.154:0/989292563 learned_addr learned my addr 172.21.15.154:0/989292563 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8b7fe700 1 -- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c0a0a90 msgr2=0x7f3b8c0a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8b7fe700 1 --2- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c0a0a90 0x7f3b8c0a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8b7fe700 1 -- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 msgr2=0x7f3b8c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8b7fe700 1 --2- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 0x7f3b8c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8b7fe700 1 -- 172.21.15.154:0/989292563 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c09a280 con 0x7f3b8c133f70 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8a7fc700 1 --2- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 0x7f3b8c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8affd700 1 --2- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c0a0a90 0x7f3b8c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b8b7fe700 1 --2- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133f70 0x7f3b8c134410 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009e50 tx=0x7f3b8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2fb6579c1e867 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b89ffb700 1 -- 172.21.15.154:0/989292563 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400e070 con 0x7f3b8c133f70 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b89ffb700 1 -- 172.21.15.154:0/989292563 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8400b910 con 0x7f3b8c133f70 2023-09-30T22:23:54.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.856+0000 7f3b89ffb700 1 -- 172.21.15.154:0/989292563 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400bcc0 con 0x7f3b8c133f70 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.857+0000 7f3b91889700 1 -- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133f70 msgr2=0x7f3b8c134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.857+0000 7f3b91889700 1 --2- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133f70 0x7f3b8c134410 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009e50 tx=0x7f3b8400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.857+0000 7f3b91889700 1 -- 172.21.15.154:0/989292563 shutdown_connections 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.857+0000 7f3b91889700 1 --2- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c133f70 0x7f3b8c134410 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.857+0000 7f3b91889700 1 --2- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c0a0a90 0x7f3b8c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.857+0000 7f3b91889700 1 --2- 172.21.15.154:0/989292563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 0x7f3b8c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.857+0000 7f3b91889700 1 -- 172.21.15.154:0/989292563 >> 172.21.15.154:0/989292563 conn(0x7f3b8c099c40 msgr2=0x7f3b8c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.857+0000 7f3b91889700 1 -- 172.21.15.154:0/989292563 shutdown_connections 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.857+0000 7f3b91889700 1 -- 172.21.15.154:0/989292563 wait complete. 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.858+0000 7f3b91889700 1 Processor -- start 2023-09-30T22:23:54.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.858+0000 7f3b91889700 1 -- start start 2023-09-30T22:23:54.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.858+0000 7f3b91889700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c0a0a90 0x7f3b8c1223a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.858+0000 7f3b91889700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 0x7f3b8c1228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.858+0000 7f3b91889700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133f70 0x7f3b8c122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.858+0000 7f3b91889700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c125200 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.858+0000 7f3b91889700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c124130 con 0x7f3b8c0a13a0 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.858+0000 7f3b91889700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c124e40 con 0x7f3b8c133f70 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.858+0000 7f3b8affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c0a0a90 0x7f3b8c1223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c0a0a90 0x7f3b8c1223a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44870/0 (socket says 172.21.15.154:44870) 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8affd700 1 -- 172.21.15.154:0/2742622833 learned_addr learned my addr 172.21.15.154:0/2742622833 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8b7fe700 1 --2- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133f70 0x7f3b8c122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8a7fc700 1 --2- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 0x7f3b8c1228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:54.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8affd700 1 -- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133f70 msgr2=0x7f3b8c122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8affd700 1 --2- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133f70 0x7f3b8c122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8affd700 1 -- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 msgr2=0x7f3b8c1228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8affd700 1 --2- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 0x7f3b8c1228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8affd700 1 -- 172.21.15.154:0/2742622833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800094a0 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b8affd700 1 --2- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c0a0a90 0x7f3b8c1223a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000ec10 tx=0x7f3b8000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b73fff700 1 -- 172.21.15.154:0/2742622833 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80009780 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b73fff700 1 -- 172.21.15.154:0/2742622833 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000c7f0 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b73fff700 1 -- 172.21.15.154:0/2742622833 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000cb80 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b91889700 1 -- 172.21.15.154:0/2742622833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c0094a0 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.859+0000 7f3b91889700 1 -- 172.21.15.154:0/2742622833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b84009b30 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.860+0000 7f3b73fff700 1 -- 172.21.15.154:0/2742622833 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b8000cce0 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.860+0000 7f3b73fff700 1 -- 172.21.15.154:0/2742622833 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b8003faf0 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.860+0000 7f3b91889700 1 -- 172.21.15.154:0/2742622833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8c09bce0 con 0x7f3b8c0a0a90 2023-09-30T22:23:54.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:54.865+0000 7f3b73fff700 1 -- 172.21.15.154:0/2742622833 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b80017020 con 0x7f3b8c0a0a90 2023-09-30T22:23:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.048+0000 7f3b91889700 1 -- 172.21.15.154:0/2742622833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b8c04f2a0 con 0x7f3b8c0a0a90 2023-09-30T22:23:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.049+0000 7f3b73fff700 1 -- 172.21.15.154:0/2742622833 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b8001b3b0 con 0x7f3b8c0a0a90 2023-09-30T22:23:55.050 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.051+0000 7f3b91889700 1 -- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c0a0a90 msgr2=0x7f3b8c1223a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.051+0000 7f3b91889700 1 --2- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c0a0a90 0x7f3b8c1223a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000ec10 tx=0x7f3b8000ef20 comp rx=0 tx=0).stop 2023-09-30T22:23:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.051+0000 7f3b91889700 1 -- 172.21.15.154:0/2742622833 shutdown_connections 2023-09-30T22:23:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.051+0000 7f3b91889700 1 --2- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b8c133f70 0x7f3b8c122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.051+0000 7f3b91889700 1 --2- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b8c0a0a90 0x7f3b8c1223a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.051+0000 7f3b91889700 1 --2- 172.21.15.154:0/2742622833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b8c0a13a0 0x7f3b8c1228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.051+0000 7f3b91889700 1 -- 172.21.15.154:0/2742622833 >> 172.21.15.154:0/2742622833 conn(0x7f3b8c099c40 msgr2=0x7f3b8c0a5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.051+0000 7f3b91889700 1 -- 172.21.15.154:0/2742622833 shutdown_connections 2023-09-30T22:23:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.051+0000 7f3b91889700 1 -- 172.21.15.154:0/2742622833 wait complete. 2023-09-30T22:23:55.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:55.652 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:55.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:55.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:55.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.784+0000 7f4694cd4700 1 Processor -- start 2023-09-30T22:23:55.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.784+0000 7f4694cd4700 1 -- start start 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f4694cd4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a0a70 0x7f46900a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f4694cd4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4690134120 0x7f469013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f4694cd4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469009dc00 con 0x7f46900a1380 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f4694cd4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469009ea60 con 0x7f4690134120 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f4694cd4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f469009dec0 con 0x7f46900a0a70 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4690134120 0x7f469013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a0a70 0x7f46900a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4690134120 0x7f469013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45410/0 (socket says 172.21.15.154:45410) 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a0a70 0x7f46900a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52124/0 (socket says 172.21.15.154:52124) 2023-09-30T22:23:55.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468ed9d700 1 -- 172.21.15.154:0/3329125266 learned_addr learned my addr 172.21.15.154:0/3329125266 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:55.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468e59c700 1 -- 172.21.15.154:0/3329125266 >> v2:172.21.15.154:3300/0 conn(0x7f4690134120 msgr2=0x7f469013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:55.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468e59c700 1 --2- 172.21.15.154:0/3329125266 >> v2:172.21.15.154:3300/0 conn(0x7f4690134120 0x7f469013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468e59c700 1 -- 172.21.15.154:0/3329125266 >> v1:172.21.15.154:6789/0 conn(0x7f46900a1380 legacy=0x7f4690133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468e59c700 1 -- 172.21.15.154:0/3329125266 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469009e6a0 con 0x7f46900a0a70 2023-09-30T22:23:55.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.785+0000 7f468ed9d700 1 --2- 172.21.15.154:0/3329125266 >> v2:172.21.15.154:3300/0 conn(0x7f4690134120 0x7f469013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.786+0000 7f468e59c700 1 --2- 172.21.15.154:0/3329125266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a0a70 0x7f46900a0e40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4680009840 tx=0x7f4680009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4447aa7c6bd59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.786+0000 7f468d59a700 1 -- 172.21.15.154:0/3329125266 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680011830 con 0x7f46900a0a70 2023-09-30T22:23:55.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.786+0000 7f468d59a700 1 -- 172.21.15.154:0/3329125266 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4680011990 con 0x7f46900a0a70 2023-09-30T22:23:55.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.786+0000 7f468d59a700 1 -- 172.21.15.154:0/3329125266 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680011d20 con 0x7f46900a0a70 2023-09-30T22:23:55.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.786+0000 7f4694cd4700 1 -- 172.21.15.154:0/3329125266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a0a70 msgr2=0x7f46900a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.786+0000 7f4694cd4700 1 --2- 172.21.15.154:0/3329125266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a0a70 0x7f46900a0e40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4680009840 tx=0x7f4680009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:55.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.787+0000 7f4694cd4700 1 -- 172.21.15.154:0/3329125266 shutdown_connections 2023-09-30T22:23:55.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.787+0000 7f4694cd4700 1 --2- 172.21.15.154:0/3329125266 >> v2:172.21.15.154:3300/0 conn(0x7f4690134120 0x7f469013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.787+0000 7f4694cd4700 1 --2- 172.21.15.154:0/3329125266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a0a70 0x7f46900a0e40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.787+0000 7f4694cd4700 1 -- 172.21.15.154:0/3329125266 >> 172.21.15.154:0/3329125266 conn(0x7f46900a6610 msgr2=0x7f46900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.787+0000 7f4694cd4700 1 -- 172.21.15.154:0/3329125266 shutdown_connections 2023-09-30T22:23:55.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.787+0000 7f4694cd4700 1 -- 172.21.15.154:0/3329125266 wait complete. 2023-09-30T22:23:55.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f4694cd4700 1 Processor -- start 2023-09-30T22:23:55.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f4694cd4700 1 -- start start 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f4694cd4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46900a0a70 0x7f4690122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f4694cd4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a1380 0x7f4690122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f4694cd4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4690134120 0x7f46901233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f4694cd4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4690133a90 con 0x7f4690134120 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f4694cd4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46900a03e0 con 0x7f46900a0a70 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f4694cd4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46901337f0 con 0x7f46900a1380 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f468e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46900a0a70 0x7f4690122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f468ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4690134120 0x7f46901233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.788+0000 7f468e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46900a0a70 0x7f4690122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55584/0 (socket says 172.21.15.154:55584) 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4690134120 0x7f46901233f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45412/0 (socket says 172.21.15.154:45412) 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468e59c700 1 -- 172.21.15.154:0/2477918120 learned_addr learned my addr 172.21.15.154:0/2477918120 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468dd9b700 1 --2- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a1380 0x7f4690122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468ed9d700 1 -- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a1380 msgr2=0x7f4690122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468ed9d700 1 --2- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a1380 0x7f4690122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468ed9d700 1 -- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46900a0a70 msgr2=0x7f4690122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468ed9d700 1 --2- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46900a0a70 0x7f4690122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468ed9d700 1 -- 172.21.15.154:0/2477918120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4688009b30 con 0x7f4690134120 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468e59c700 1 --2- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46900a0a70 0x7f4690122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f468ed9d700 1 --2- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4690134120 0x7f46901233f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f468800efc0 tx=0x7f468800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f467effd700 1 -- 172.21.15.154:0/2477918120 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688018070 con 0x7f4690134120 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f467effd700 1 -- 172.21.15.154:0/2477918120 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468800f040 con 0x7f4690134120 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f4694cd4700 1 -- 172.21.15.154:0/2477918120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46800094a0 con 0x7f4690134120 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f467effd700 1 -- 172.21.15.154:0/2477918120 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688003c60 con 0x7f4690134120 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.789+0000 7f4694cd4700 1 -- 172.21.15.154:0/2477918120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4690126b50 con 0x7f4690134120 2023-09-30T22:23:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.790+0000 7f467effd700 1 -- 172.21.15.154:0/2477918120 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f468800c880 con 0x7f4690134120 2023-09-30T22:23:55.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.790+0000 7f467effd700 1 -- 172.21.15.154:0/2477918120 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f468803f760 con 0x7f4690134120 2023-09-30T22:23:55.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.791+0000 7f4694cd4700 1 -- 172.21.15.154:0/2477918120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4690125ed0 con 0x7f4690134120 2023-09-30T22:23:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.795+0000 7f467effd700 1 -- 172.21.15.154:0/2477918120 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4688003dc0 con 0x7f4690134120 2023-09-30T22:23:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.824+0000 7fcb4ba29700 1 Processor -- start 2023-09-30T22:23:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.824+0000 7fcb4ba29700 1 -- start start 2023-09-30T22:23:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb4ba29700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44136960 0x7fcb44138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb4ba29700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb44139280 0x7fcb4413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb4ba29700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4406b2d0 con 0x7fcb44133ad0 2023-09-30T22:23:55.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb4ba29700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb441345b0 con 0x7fcb44139280 2023-09-30T22:23:55.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb4ba29700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44133610 con 0x7fcb44136960 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb48fc4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44136960 0x7fcb44138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb497c5700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcb44133ad0 0x7fcb44133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59902/0 (socket says 172.21.15.154:59902) 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb497c5700 1 -- 172.21.15.154:0/425487604 learned_addr learned my addr 172.21.15.154:0/425487604 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb49fc6700 1 --2- 172.21.15.154:0/425487604 >> v2:172.21.15.154:3300/0 conn(0x7fcb44139280 0x7fcb4413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb48fc4700 1 -- 172.21.15.154:0/425487604 >> v2:172.21.15.154:3300/0 conn(0x7fcb44139280 msgr2=0x7fcb4413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb48fc4700 1 --2- 172.21.15.154:0/425487604 >> v2:172.21.15.154:3300/0 conn(0x7fcb44139280 0x7fcb4413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb48fc4700 1 -- 172.21.15.154:0/425487604 >> v1:172.21.15.154:6789/0 conn(0x7fcb44133ad0 legacy=0x7fcb44133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb48fc4700 1 -- 172.21.15.154:0/425487604 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4409a500 con 0x7fcb44136960 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.825+0000 7fcb49fc6700 1 --2- 172.21.15.154:0/425487604 >> v2:172.21.15.154:3300/0 conn(0x7fcb44139280 0x7fcb4413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb48fc4700 1 --2- 172.21.15.154:0/425487604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44136960 0x7fcb44138d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009870 tx=0x7fcb34009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd40f156304879f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb3bfff700 1 -- 172.21.15.154:0/425487604 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34011830 con 0x7fcb44136960 2023-09-30T22:23:55.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb3bfff700 1 -- 172.21.15.154:0/425487604 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb34011990 con 0x7fcb44136960 2023-09-30T22:23:55.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb3bfff700 1 -- 172.21.15.154:0/425487604 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34011d20 con 0x7fcb44136960 2023-09-30T22:23:55.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb4ba29700 1 -- 172.21.15.154:0/425487604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44136960 msgr2=0x7fcb44138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb4ba29700 1 --2- 172.21.15.154:0/425487604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44136960 0x7fcb44138d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009870 tx=0x7fcb34009b80 comp rx=0 tx=0).stop 2023-09-30T22:23:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb4ba29700 1 -- 172.21.15.154:0/425487604 shutdown_connections 2023-09-30T22:23:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb4ba29700 1 --2- 172.21.15.154:0/425487604 >> v2:172.21.15.154:3300/0 conn(0x7fcb44139280 0x7fcb4413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb4ba29700 1 --2- 172.21.15.154:0/425487604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44136960 0x7fcb44138d40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.826+0000 7fcb4ba29700 1 -- 172.21.15.154:0/425487604 >> 172.21.15.154:0/425487604 conn(0x7fcb44099c40 msgr2=0x7fcb440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.827+0000 7fcb4ba29700 1 -- 172.21.15.154:0/425487604 shutdown_connections 2023-09-30T22:23:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.827+0000 7fcb4ba29700 1 -- 172.21.15.154:0/425487604 wait complete. 2023-09-30T22:23:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.828+0000 7fcb4ba29700 1 Processor -- start 2023-09-30T22:23:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.828+0000 7fcb4ba29700 1 -- start start 2023-09-30T22:23:55.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.828+0000 7fcb4ba29700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb44133ad0 0x7fcb44071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.828+0000 7fcb4ba29700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb44136960 0x7fcb44071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.828+0000 7fcb4ba29700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44139280 0x7fcb441c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.828+0000 7fcb4ba29700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44070450 con 0x7fcb44136960 2023-09-30T22:23:55.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.828+0000 7fcb4ba29700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4409f390 con 0x7fcb44133ad0 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.828+0000 7fcb4ba29700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44138f50 con 0x7fcb44139280 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb497c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb44133ad0 0x7fcb44071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb497c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb44133ad0 0x7fcb44071930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55588/0 (socket says 172.21.15.154:55588) 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb497c5700 1 -- 172.21.15.154:0/2909426714 learned_addr learned my addr 172.21.15.154:0/2909426714 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb48fc4700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb44136960 0x7fcb44071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb49fc6700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44139280 0x7fcb441c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb497c5700 1 -- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44139280 msgr2=0x7fcb441c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb497c5700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44139280 0x7fcb441c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb497c5700 1 -- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb44136960 msgr2=0x7fcb44071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb497c5700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb44136960 0x7fcb44071e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb497c5700 1 -- 172.21.15.154:0/2909426714 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c009a70 con 0x7fcb44133ad0 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb49fc6700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44139280 0x7fcb441c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb48fc4700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb44136960 0x7fcb44071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb497c5700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb44133ad0 0x7fcb44071930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c480 tx=0x7fcb4000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb39ffb700 1 -- 172.21.15.154:0/2909426714 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40005d70 con 0x7fcb44133ad0 2023-09-30T22:23:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb39ffb700 1 -- 172.21.15.154:0/2909426714 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4000ce80 con 0x7fcb44133ad0 2023-09-30T22:23:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb4ba29700 1 -- 172.21.15.154:0/2909426714 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb340094a0 con 0x7fcb44133ad0 2023-09-30T22:23:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.829+0000 7fcb39ffb700 1 -- 172.21.15.154:0/2909426714 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb400072d0 con 0x7fcb44133ad0 2023-09-30T22:23:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.830+0000 7fcb4ba29700 1 -- 172.21.15.154:0/2909426714 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4406f0c0 con 0x7fcb44133ad0 2023-09-30T22:23:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.830+0000 7fcb39ffb700 1 -- 172.21.15.154:0/2909426714 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb40007430 con 0x7fcb44133ad0 2023-09-30T22:23:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.831+0000 7fcb39ffb700 1 -- 172.21.15.154:0/2909426714 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb4003e960 con 0x7fcb44133ad0 2023-09-30T22:23:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.831+0000 7fcb4ba29700 1 -- 172.21.15.154:0/2909426714 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4404f2a0 con 0x7fcb44133ad0 2023-09-30T22:23:55.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.836+0000 7f3a70017700 1 Processor -- start 2023-09-30T22:23:55.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.836+0000 7f3a70017700 1 -- start start 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a70017700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a681319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a70017700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a681314b0 0x7f3a68131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a70017700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6809c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a70017700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a680667e0 con 0x7f3a681314b0 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a70017700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680a23c0 con 0x7f3a68066410 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a70017700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680a0f20 con 0x7f3a6809bc70 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a6d5b2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a681314b0 0x7f3a68131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a6ddb3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a681319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a6d5b2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a681314b0 0x7f3a68131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45432/0 (socket says 172.21.15.154:45432) 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a6d5b2700 1 -- 172.21.15.154:0/2892550134 learned_addr learned my addr 172.21.15.154:0/2892550134 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.837+0000 7f3a6e5b4700 1 --2- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6809c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6d5b2700 1 -- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 msgr2=0x7f3a6809c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6d5b2700 1 --2- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6809c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6d5b2700 1 -- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 msgr2=0x7f3a681319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6d5b2700 1 --2- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a681319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6d5b2700 1 -- 172.21.15.154:0/2892550134 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680a16e0 con 0x7f3a681314b0 2023-09-30T22:23:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6ddb3700 1 --2- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a681319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7fcb39ffb700 1 -- 172.21.15.154:0/2909426714 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb4001b3b0 con 0x7fcb44133ad0 2023-09-30T22:23:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6d5b2700 1 --2- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 0x7f3a68131f30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009920 tx=0x7f3a58009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca14fee62884c042 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6cdb1700 1 -- 172.21.15.154:0/2892550134 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58010a90 con 0x7f3a681314b0 2023-09-30T22:23:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6cdb1700 1 -- 172.21.15.154:0/2892550134 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a58010bf0 con 0x7f3a681314b0 2023-09-30T22:23:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.838+0000 7f3a6cdb1700 1 -- 172.21.15.154:0/2892550134 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58018440 con 0x7f3a681314b0 2023-09-30T22:23:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.839+0000 7f3a70017700 1 -- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 msgr2=0x7f3a68131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.839+0000 7f3a70017700 1 --2- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 0x7f3a68131f30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009920 tx=0x7f3a58009c30 comp rx=0 tx=0).stop 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.839+0000 7f3a70017700 1 -- 172.21.15.154:0/2892550134 shutdown_connections 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.839+0000 7f3a70017700 1 --2- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a681319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.839+0000 7f3a70017700 1 --2- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6809c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.839+0000 7f3a70017700 1 --2- 172.21.15.154:0/2892550134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 0x7f3a68131f30 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.839+0000 7f3a70017700 1 -- 172.21.15.154:0/2892550134 >> 172.21.15.154:0/2892550134 conn(0x7f3a680a2980 msgr2=0x7f3a680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.839+0000 7f3a70017700 1 -- 172.21.15.154:0/2892550134 shutdown_connections 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.839+0000 7f3a70017700 1 -- 172.21.15.154:0/2892550134 wait complete. 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a70017700 1 Processor -- start 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a70017700 1 -- start start 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a70017700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a68119640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a70017700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a68119b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a70017700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 0x7f3a6811a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:55.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a70017700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6811cb70 con 0x7f3a681314b0 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a70017700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6811c4c0 con 0x7f3a68066410 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a70017700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680a1d50 con 0x7f3a6809bc70 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a6e5b4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 0x7f3a6811a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a6e5b4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 0x7f3a6811a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45438/0 (socket says 172.21.15.154:45438) 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.840+0000 7f3a6e5b4700 1 -- 172.21.15.154:0/1882637468 learned_addr learned my addr 172.21.15.154:0/1882637468 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6d5b2700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a68119b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6e5b4700 1 -- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 msgr2=0x7f3a68119b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6e5b4700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a68119b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6e5b4700 1 -- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 msgr2=0x7f3a68119640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6ddb3700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a68119640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6e5b4700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a68119640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6e5b4700 1 -- 172.21.15.154:0/1882637468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a64009430 con 0x7f3a681314b0 2023-09-30T22:23:55.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6d5b2700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a68119b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6ddb3700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a68119640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a6e5b4700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 0x7f3a6811a0c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000efc0 tx=0x7f3a6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a5e7fc700 1 -- 172.21.15.154:0/1882637468 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000cd40 con 0x7f3a681314b0 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a5e7fc700 1 -- 172.21.15.154:0/1882637468 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6000f040 con 0x7f3a681314b0 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a70017700 1 -- 172.21.15.154:0/1882637468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a58009550 con 0x7f3a681314b0 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a5e7fc700 1 -- 172.21.15.154:0/1882637468 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a600146c0 con 0x7f3a681314b0 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.841+0000 7f3a70017700 1 -- 172.21.15.154:0/1882637468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6811c000 con 0x7f3a681314b0 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.842+0000 7f3a70017700 1 -- 172.21.15.154:0/1882637468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6804f2a0 con 0x7f3a681314b0 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.842+0000 7f3a5e7fc700 1 -- 172.21.15.154:0/1882637468 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a60014820 con 0x7f3a681314b0 2023-09-30T22:23:55.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.842+0000 7f3a5e7fc700 1 -- 172.21.15.154:0/1882637468 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3a60040260 con 0x7f3a681314b0 2023-09-30T22:23:55.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:55.851+0000 7f3a5e7fc700 1 -- 172.21.15.154:0/1882637468 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a60007920 con 0x7f3a681314b0 2023-09-30T22:23:56.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.010+0000 7f4694cd4700 1 -- 172.21.15.154:0/2477918120 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46900a2710 con 0x7f4690134120 2023-09-30T22:23:56.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.010+0000 7f467effd700 1 -- 172.21.15.154:0/2477918120 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f468801cbb0 con 0x7f4690134120 2023-09-30T22:23:56.011 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:56.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.012+0000 7f4694cd4700 1 -- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4690134120 msgr2=0x7f46901233f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.012+0000 7f4694cd4700 1 --2- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4690134120 0x7f46901233f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f468800efc0 tx=0x7f468800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.013+0000 7f4694cd4700 1 -- 172.21.15.154:0/2477918120 shutdown_connections 2023-09-30T22:23:56.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.013+0000 7f4694cd4700 1 --2- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4690134120 0x7f46901233f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.013+0000 7f4694cd4700 1 --2- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46900a0a70 0x7f4690122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.013+0000 7f4694cd4700 1 --2- 172.21.15.154:0/2477918120 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46900a1380 0x7f4690122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.013+0000 7f4694cd4700 1 -- 172.21.15.154:0/2477918120 >> 172.21.15.154:0/2477918120 conn(0x7f46900a6610 msgr2=0x7f46900a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.013+0000 7f4694cd4700 1 -- 172.21.15.154:0/2477918120 shutdown_connections 2023-09-30T22:23:56.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.013+0000 7f4694cd4700 1 -- 172.21.15.154:0/2477918120 wait complete. 2023-09-30T22:23:56.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.034+0000 7fcb4ba29700 1 -- 172.21.15.154:0/2909426714 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb4409f0f0 con 0x7fcb44133ad0 2023-09-30T22:23:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.034+0000 7fcb39ffb700 1 -- 172.21.15.154:0/2909426714 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb40017020 con 0x7fcb44133ad0 2023-09-30T22:23:56.035 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:56.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.037+0000 7fcb4ba29700 1 -- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb44133ad0 msgr2=0x7fcb44071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.037+0000 7fcb4ba29700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb44133ad0 0x7fcb44071930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c480 tx=0x7fcb4000c790 comp rx=0 tx=0).stop 2023-09-30T22:23:56.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.037+0000 7fcb4ba29700 1 -- 172.21.15.154:0/2909426714 shutdown_connections 2023-09-30T22:23:56.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.037+0000 7fcb4ba29700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb44139280 0x7fcb441c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.037+0000 7fcb4ba29700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb44133ad0 0x7fcb44071930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.037+0000 7fcb4ba29700 1 --2- 172.21.15.154:0/2909426714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb44136960 0x7fcb44071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.037+0000 7fcb4ba29700 1 -- 172.21.15.154:0/2909426714 >> 172.21.15.154:0/2909426714 conn(0x7fcb44099c40 msgr2=0x7fcb44134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.037+0000 7fcb4ba29700 1 -- 172.21.15.154:0/2909426714 shutdown_connections 2023-09-30T22:23:56.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.037+0000 7fcb4ba29700 1 -- 172.21.15.154:0/2909426714 wait complete. 2023-09-30T22:23:56.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.047+0000 7f3a70017700 1 -- 172.21.15.154:0/1882637468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a680724e0 con 0x7f3a681314b0 2023-09-30T22:23:56.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.047+0000 7f3a5e7fc700 1 -- 172.21.15.154:0/1882637468 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a60018020 con 0x7f3a681314b0 2023-09-30T22:23:56.048 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:56.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.049+0000 7f3a70017700 1 -- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 msgr2=0x7f3a6811a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.049+0000 7f3a70017700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 0x7f3a6811a0c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000efc0 tx=0x7f3a6000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.049+0000 7f3a70017700 1 -- 172.21.15.154:0/1882637468 shutdown_connections 2023-09-30T22:23:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.049+0000 7f3a70017700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a681314b0 0x7f3a6811a0c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.049+0000 7f3a70017700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68066410 0x7f3a68119640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.049+0000 7f3a70017700 1 --2- 172.21.15.154:0/1882637468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a68119b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.049+0000 7f3a70017700 1 -- 172.21.15.154:0/1882637468 >> 172.21.15.154:0/1882637468 conn(0x7f3a680a2980 msgr2=0x7f3a6812e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.049+0000 7f3a70017700 1 -- 172.21.15.154:0/1882637468 shutdown_connections 2023-09-30T22:23:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.049+0000 7f3a70017700 1 -- 172.21.15.154:0/1882637468 wait complete. 2023-09-30T22:23:56.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:56.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.224+0000 7f9fa111d700 1 Processor -- start 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.224+0000 7f9fa111d700 1 -- start start 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9fa111d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9fa111d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9fa111d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c09a760 con 0x7f9f9c133900 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9fa111d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c1336e0 con 0x7f9f9c1368e0 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9fa111d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c09a080 con 0x7f9f9c139200 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9b59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55624/0 (socket says 172.21.15.154:55624) 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9a59c700 1 -- 172.21.15.154:0/3278994123 learned_addr learned my addr 172.21.15.154:0/3278994123 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9b59e700 1 --2- 172.21.15.154:0/3278994123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52174/0 (socket says 172.21.15.154:52174) 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f99d9b700 1 -- 172.21.15.154:0/3278994123 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343636781 0 0) 0x7f9f9c09a760 con 0x7f9f9c133900 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9b59e700 1 -- 172.21.15.154:0/3278994123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 msgr2=0x7f9f9c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9b59e700 1 --2- 172.21.15.154:0/3278994123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9b59e700 1 -- 172.21.15.154:0/3278994123 >> v1:172.21.15.154:6789/0 conn(0x7f9f9c133900 legacy=0x7f9f9c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9b59e700 1 -- 172.21.15.154:0/3278994123 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0a23e0 con 0x7f9f9c139200 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9a59c700 1 --2- 172.21.15.154:0/3278994123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f9b59e700 1 --2- 172.21.15.154:0/3278994123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c13b5e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009dc0 tx=0x7f9f9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4b197d4bc0afb2c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f99d9b700 1 -- 172.21.15.154:0/3278994123 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9400e070 con 0x7f9f9c139200 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f99d9b700 1 -- 172.21.15.154:0/3278994123 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9400bb20 con 0x7f9f9c139200 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.225+0000 7f9f99d9b700 1 -- 172.21.15.154:0/3278994123 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94012430 con 0x7f9f9c139200 2023-09-30T22:23:56.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.226+0000 7f9fa111d700 1 -- 172.21.15.154:0/3278994123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 msgr2=0x7f9f9c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.226+0000 7f9fa111d700 1 --2- 172.21.15.154:0/3278994123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c13b5e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009dc0 tx=0x7f9f9400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:56.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.226+0000 7f9fa111d700 1 -- 172.21.15.154:0/3278994123 shutdown_connections 2023-09-30T22:23:56.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.226+0000 7f9fa111d700 1 --2- 172.21.15.154:0/3278994123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c13b5e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.226+0000 7f9fa111d700 1 --2- 172.21.15.154:0/3278994123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.226+0000 7f9fa111d700 1 -- 172.21.15.154:0/3278994123 >> 172.21.15.154:0/3278994123 conn(0x7f9f9c0a2980 msgr2=0x7f9f9c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.226+0000 7f9fa111d700 1 -- 172.21.15.154:0/3278994123 shutdown_connections 2023-09-30T22:23:56.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.226+0000 7f9fa111d700 1 -- 172.21.15.154:0/3278994123 wait complete. 2023-09-30T22:23:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.227+0000 7f9fa111d700 1 Processor -- start 2023-09-30T22:23:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.227+0000 7f9fa111d700 1 -- start start 2023-09-30T22:23:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9fa111d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f9c133900 0x7f9f9c119d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9fa111d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c11a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9fa111d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c11a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9fa111d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c11c180 con 0x7f9f9c133900 2023-09-30T22:23:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9fa111d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c12fc00 con 0x7f9f9c1368e0 2023-09-30T22:23:56.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9fa111d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c11b9c0 con 0x7f9f9c139200 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9b59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c11a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f9c133900 0x7f9f9c119d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c11a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9b59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c11a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52176/0 (socket says 172.21.15.154:52176) 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9b59e700 1 -- 172.21.15.154:0/588034221 learned_addr learned my addr 172.21.15.154:0/588034221 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9ad9d700 1 -- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 msgr2=0x7f9f9c11a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9ad9d700 1 --2- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c11a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9ad9d700 1 -- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 msgr2=0x7f9f9c11a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9ad9d700 1 --2- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c11a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9ad9d700 1 -- 172.21.15.154:0/588034221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c009550 con 0x7f9f9c133900 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9a59c700 1 --2- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c11a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9b59e700 1 --2- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c11a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f9ad9d700 1 --2- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f9c133900 0x7f9f9c119d10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c430 tx=0x7f9f9000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f837fe700 1 -- 172.21.15.154:0/588034221 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900054e0 con 0x7f9f9c133900 2023-09-30T22:23:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f837fe700 1 -- 172.21.15.154:0/588034221 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9000ce40 con 0x7f9f9c133900 2023-09-30T22:23:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9fa111d700 1 -- 172.21.15.154:0/588034221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f94009a70 con 0x7f9f9c133900 2023-09-30T22:23:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9f837fe700 1 -- 172.21.15.154:0/588034221 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900038c0 con 0x7f9f9c133900 2023-09-30T22:23:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.228+0000 7f9fa111d700 1 -- 172.21.15.154:0/588034221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c11cf20 con 0x7f9f9c133900 2023-09-30T22:23:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.229+0000 7f9f837fe700 1 -- 172.21.15.154:0/588034221 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f90003a20 con 0x7f9f9c133900 2023-09-30T22:23:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.229+0000 7f9f837fe700 1 -- 172.21.15.154:0/588034221 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f9003e9f0 con 0x7f9f9c133900 2023-09-30T22:23:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.229+0000 7f9fa111d700 1 -- 172.21.15.154:0/588034221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c134360 con 0x7f9f9c133900 2023-09-30T22:23:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.234+0000 7f9f837fe700 1 -- 172.21.15.154:0/588034221 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f90017070 con 0x7f9f9c133900 2023-09-30T22:23:56.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.419+0000 7f9fa111d700 1 -- 172.21.15.154:0/588034221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f9c04f2a0 con 0x7f9f9c133900 2023-09-30T22:23:56.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.419+0000 7f9f837fe700 1 -- 172.21.15.154:0/588034221 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f90019cd0 con 0x7f9f9c133900 2023-09-30T22:23:56.420 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.421+0000 7f9fa111d700 1 -- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f9c133900 msgr2=0x7f9f9c119d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.421+0000 7f9fa111d700 1 --2- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f9c133900 0x7f9f9c119d10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c430 tx=0x7f9f9000c740 comp rx=0 tx=0).stop 2023-09-30T22:23:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.421+0000 7f9fa111d700 1 -- 172.21.15.154:0/588034221 shutdown_connections 2023-09-30T22:23:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.421+0000 7f9fa111d700 1 --2- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9f9c139200 0x7f9f9c11a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.421+0000 7f9fa111d700 1 --2- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f9c133900 0x7f9f9c119d10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.421+0000 7f9fa111d700 1 --2- 172.21.15.154:0/588034221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f9c1368e0 0x7f9f9c11a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.421+0000 7f9fa111d700 1 -- 172.21.15.154:0/588034221 >> 172.21.15.154:0/588034221 conn(0x7f9f9c0a2980 msgr2=0x7f9f9c0a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.421+0000 7f9fa111d700 1 -- 172.21.15.154:0/588034221 shutdown_connections 2023-09-30T22:23:56.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:56.421+0000 7f9fa111d700 1 -- 172.21.15.154:0/588034221 wait complete. 2023-09-30T22:23:56.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:57.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:57.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:57.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:57.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f7325ffe700 1 Processor -- start 2023-09-30T22:23:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f7325ffe700 1 -- start start 2023-09-30T22:23:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f7325ffe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f732009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f7325ffe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f732009e170 0x7f73201307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f7325ffe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7320130ce0 0x7f7320131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f7325ffe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732009aaa0 con 0x7f7320130ce0 2023-09-30T22:23:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f7325ffe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732009f870 con 0x7f732009d860 2023-09-30T22:23:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f7325ffe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f732009b360 con 0x7f732009e170 2023-09-30T22:23:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f731f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f732009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f731effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f732009e170 0x7f73201307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f731f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f732009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55634/0 (socket says 172.21.15.154:55634) 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f731ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7320130ce0 0x7f7320131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.158+0000 7f731f7fe700 1 -- 172.21.15.154:0/592465093 learned_addr learned my addr 172.21.15.154:0/592465093 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731effd700 1 -- 172.21.15.154:0/592465093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 msgr2=0x7f732009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731effd700 1 --2- 172.21.15.154:0/592465093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f732009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731effd700 1 -- 172.21.15.154:0/592465093 >> v2:172.21.15.154:3300/0 conn(0x7f7320130ce0 msgr2=0x7f7320131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731effd700 1 --2- 172.21.15.154:0/592465093 >> v2:172.21.15.154:3300/0 conn(0x7f7320130ce0 0x7f7320131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731effd700 1 -- 172.21.15.154:0/592465093 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732009b620 con 0x7f732009e170 2023-09-30T22:23:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731f7fe700 1 --2- 172.21.15.154:0/592465093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f732009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731ffff700 1 --2- 172.21.15.154:0/592465093 >> v2:172.21.15.154:3300/0 conn(0x7f7320130ce0 0x7f7320131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731effd700 1 --2- 172.21.15.154:0/592465093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f732009e170 0x7f73201307a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7314009840 tx=0x7f7314009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e05afdf06a42efa4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731e7fc700 1 -- 172.21.15.154:0/592465093 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314011830 con 0x7f732009e170 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731e7fc700 1 -- 172.21.15.154:0/592465093 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7314011990 con 0x7f732009e170 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.159+0000 7f731e7fc700 1 -- 172.21.15.154:0/592465093 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314011d20 con 0x7f732009e170 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.160+0000 7f7325ffe700 1 -- 172.21.15.154:0/592465093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f732009e170 msgr2=0x7f73201307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.160+0000 7f7325ffe700 1 --2- 172.21.15.154:0/592465093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f732009e170 0x7f73201307a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7314009840 tx=0x7f7314009b50 comp rx=0 tx=0).stop 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.160+0000 7f7325ffe700 1 -- 172.21.15.154:0/592465093 shutdown_connections 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.160+0000 7f7325ffe700 1 --2- 172.21.15.154:0/592465093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f732009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.160+0000 7f7325ffe700 1 --2- 172.21.15.154:0/592465093 >> v2:172.21.15.154:3300/0 conn(0x7f7320130ce0 0x7f7320131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.160+0000 7f7325ffe700 1 --2- 172.21.15.154:0/592465093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f732009e170 0x7f73201307a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.160+0000 7f7325ffe700 1 -- 172.21.15.154:0/592465093 >> 172.21.15.154:0/592465093 conn(0x7f7320099c40 msgr2=0x7f73200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.160+0000 7f7325ffe700 1 -- 172.21.15.154:0/592465093 shutdown_connections 2023-09-30T22:23:57.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.160+0000 7f7325ffe700 1 -- 172.21.15.154:0/592465093 wait complete. 2023-09-30T22:23:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.161+0000 7f7325ffe700 1 Processor -- start 2023-09-30T22:23:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.161+0000 7f7325ffe700 1 -- start start 2023-09-30T22:23:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.161+0000 7f7325ffe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f7320122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.161+0000 7f7325ffe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732009e170 0x7f7320122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.161+0000 7f7325ffe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7320130ce0 0x7f73201232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.161+0000 7f7325ffe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7320126370 con 0x7f732009e170 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.161+0000 7f7325ffe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7320124a80 con 0x7f732009d860 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.161+0000 7f7325ffe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f732009c8b0 con 0x7f7320130ce0 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f7320122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f7320122850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55642/0 (socket says 172.21.15.154:55642) 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731f7fe700 1 -- 172.21.15.154:0/1707720756 learned_addr learned my addr 172.21.15.154:0/1707720756 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732009e170 0x7f7320122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731ffff700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7320130ce0 0x7f73201232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731ffff700 1 -- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 msgr2=0x7f7320122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731ffff700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f7320122850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731ffff700 1 -- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732009e170 msgr2=0x7f7320122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731ffff700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732009e170 0x7f7320122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731ffff700 1 -- 172.21.15.154:0/1707720756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310009550 con 0x7f7320130ce0 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731f7fe700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f7320122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731effd700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732009e170 0x7f7320122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f731ffff700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7320130ce0 0x7f73201232d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7318009370 tx=0x7f731800e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f7307fff700 1 -- 172.21.15.154:0/1707720756 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318010040 con 0x7f7320130ce0 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f7307fff700 1 -- 172.21.15.154:0/1707720756 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318003c20 con 0x7f7320130ce0 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f7307fff700 1 -- 172.21.15.154:0/1707720756 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731800b3a0 con 0x7f7320130ce0 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f7325ffe700 1 -- 172.21.15.154:0/1707720756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731800bc80 con 0x7f7320130ce0 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.162+0000 7f7325ffe700 1 -- 172.21.15.154:0/1707720756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73140094a0 con 0x7f7320130ce0 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.163+0000 7f7307fff700 1 -- 172.21.15.154:0/1707720756 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f731800e940 con 0x7f7320130ce0 2023-09-30T22:23:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.163+0000 7f7307fff700 1 -- 172.21.15.154:0/1707720756 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f731803fa70 con 0x7f7320130ce0 2023-09-30T22:23:57.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.163+0000 7f7325ffe700 1 -- 172.21.15.154:0/1707720756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73201307d0 con 0x7f7320130ce0 2023-09-30T22:23:57.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.168+0000 7f7307fff700 1 -- 172.21.15.154:0/1707720756 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f731800ebf0 con 0x7f7320130ce0 2023-09-30T22:23:57.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.199+0000 7ff13331e700 1 Processor -- start 2023-09-30T22:23:57.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7fefbabfe700 1 Processor -- start 2023-09-30T22:23:57.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7ff13331e700 1 -- start start 2023-09-30T22:23:57.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7fefbabfe700 1 -- start start 2023-09-30T22:23:57.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7ff13331e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff12c09f350 0x7ff12c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7ff13331e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff12c1371c0 0x7ff12c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7fefbabfe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb409f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7fefbabfe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefb4138c30 0x7fefb413b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7ff13331e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c09c970 con 0x7ff12c09e870 2023-09-30T22:23:57.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7ff13331e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c0a0920 con 0x7ff12c1371c0 2023-09-30T22:23:57.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7ff13331e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c09f9c0 con 0x7ff12c09f350 2023-09-30T22:23:57.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7fefbabfe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb409e280 con 0x7fefb409ee60 2023-09-30T22:23:57.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7fefbabfe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40a0a50 con 0x7fefb4138c30 2023-09-30T22:23:57.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.200+0000 7fefbabfe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb409fe80 con 0x7fefb40a2540 2023-09-30T22:23:57.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb409f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb409f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55648/0 (socket says 172.21.15.154:55648) 2023-09-30T22:23:57.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb3fff700 1 -- 172.21.15.154:0/4268634215 learned_addr learned my addr 172.21.15.154:0/4268634215 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:57.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff1318bb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff12c1371c0 0x7ff12c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff1318bb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff12c1371c0 0x7ff12c1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45452/0 (socket says 172.21.15.154:45452) 2023-09-30T22:23:57.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff1318bb700 1 -- 172.21.15.154:0/2965889347 learned_addr learned my addr 172.21.15.154:0/2965889347 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:57.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb919b700 1 --2- 172.21.15.154:0/4268634215 >> v2:172.21.15.154:3300/0 conn(0x7fefb4138c30 0x7fefb413b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff1308b9700 1 --2- 172.21.15.154:0/2965889347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff12c09f350 0x7ff12c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb3fff700 1 -- 172.21.15.154:0/4268634215 >> v2:172.21.15.154:3300/0 conn(0x7fefb4138c30 msgr2=0x7fefb413b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:57.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb3fff700 1 --2- 172.21.15.154:0/4268634215 >> v2:172.21.15.154:3300/0 conn(0x7fefb4138c30 0x7fefb413b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb3fff700 1 -- 172.21.15.154:0/4268634215 >> v1:172.21.15.154:6789/0 conn(0x7fefb409ee60 legacy=0x7fefb409f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb3fff700 1 -- 172.21.15.154:0/4268634215 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb409dfa0 con 0x7fefb40a2540 2023-09-30T22:23:57.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff1318bb700 1 -- 172.21.15.154:0/2965889347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff12c09f350 msgr2=0x7ff12c136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:57.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff1318bb700 1 --2- 172.21.15.154:0/2965889347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff12c09f350 0x7ff12c136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff1318bb700 1 -- 172.21.15.154:0/2965889347 >> v1:172.21.15.154:6789/0 conn(0x7ff12c09e870 legacy=0x7ff12c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff1318bb700 1 -- 172.21.15.154:0/2965889347 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c09bab0 con 0x7ff12c1371c0 2023-09-30T22:23:57.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff1318bb700 1 --2- 172.21.15.154:0/2965889347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c1371c0 0x7ff12c1395a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff124009e50 tx=0x7ff12400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40066b4b4ac3acf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb3fff700 1 --2- 172.21.15.154:0/4268634215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb409f940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fefa00098f0 tx=0x7fefa0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dd8d83d5756bd04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff123fff700 1 -- 172.21.15.154:0/2965889347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400e070 con 0x7ff12c1371c0 2023-09-30T22:23:57.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb37fe700 1 -- 172.21.15.154:0/4268634215 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0011830 con 0x7fefb40a2540 2023-09-30T22:23:57.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff123fff700 1 -- 172.21.15.154:0/2965889347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12400b910 con 0x7ff12c1371c0 2023-09-30T22:23:57.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7ff123fff700 1 -- 172.21.15.154:0/2965889347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400bcc0 con 0x7ff12c1371c0 2023-09-30T22:23:57.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb37fe700 1 -- 172.21.15.154:0/4268634215 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa0011990 con 0x7fefb40a2540 2023-09-30T22:23:57.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.201+0000 7fefb37fe700 1 -- 172.21.15.154:0/4268634215 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0011d20 con 0x7fefb40a2540 2023-09-30T22:23:57.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7ff13331e700 1 -- 172.21.15.154:0/2965889347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c1371c0 msgr2=0x7ff12c1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7ff13331e700 1 --2- 172.21.15.154:0/2965889347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c1371c0 0x7ff12c1395a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff124009e50 tx=0x7ff12400b330 comp rx=0 tx=0).stop 2023-09-30T22:23:57.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7ff13331e700 1 -- 172.21.15.154:0/2965889347 shutdown_connections 2023-09-30T22:23:57.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7ff13331e700 1 --2- 172.21.15.154:0/2965889347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c1371c0 0x7ff12c1395a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7fefbabfe700 1 -- 172.21.15.154:0/4268634215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 msgr2=0x7fefb409f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7fefbabfe700 1 --2- 172.21.15.154:0/4268634215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb409f940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fefa00098f0 tx=0x7fefa0009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:57.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7ff13331e700 1 --2- 172.21.15.154:0/2965889347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff12c09f350 0x7ff12c136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7ff13331e700 1 -- 172.21.15.154:0/2965889347 >> 172.21.15.154:0/2965889347 conn(0x7ff12c0a4430 msgr2=0x7ff12c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7ff13331e700 1 -- 172.21.15.154:0/2965889347 shutdown_connections 2023-09-30T22:23:57.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7fefbabfe700 1 -- 172.21.15.154:0/4268634215 shutdown_connections 2023-09-30T22:23:57.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7fefbabfe700 1 --2- 172.21.15.154:0/4268634215 >> v2:172.21.15.154:3300/0 conn(0x7fefb4138c30 0x7fefb413b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7fefbabfe700 1 --2- 172.21.15.154:0/4268634215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb409f940 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7fefbabfe700 1 -- 172.21.15.154:0/4268634215 >> 172.21.15.154:0/4268634215 conn(0x7fefb40a65f0 msgr2=0x7fefb40a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7ff13331e700 1 -- 172.21.15.154:0/2965889347 wait complete. 2023-09-30T22:23:57.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7fefbabfe700 1 -- 172.21.15.154:0/4268634215 shutdown_connections 2023-09-30T22:23:57.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.202+0000 7fefbabfe700 1 -- 172.21.15.154:0/4268634215 wait complete. 2023-09-30T22:23:57.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.203+0000 7ff13331e700 1 Processor -- start 2023-09-30T22:23:57.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.203+0000 7fefbabfe700 1 Processor -- start 2023-09-30T22:23:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.203+0000 7ff13331e700 1 -- start start 2023-09-30T22:23:57.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.203+0000 7fefbabfe700 1 -- start start 2023-09-30T22:23:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff13331e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff12c09e870 0x7ff12c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff13331e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c09f350 0x7ff12c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff13331e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c1371c0 0x7ff12c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff13331e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c135330 con 0x7ff12c1371c0 2023-09-30T22:23:57.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff13331e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c1252a0 con 0x7ff12c09f350 2023-09-30T22:23:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff13331e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c06d640 con 0x7ff12c09e870 2023-09-30T22:23:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff1308b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c09f350 0x7ff12c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff1308b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c09f350 0x7ff12c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55658/0 (socket says 172.21.15.154:55658) 2023-09-30T22:23:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff1308b9700 1 -- 172.21.15.154:0/2793171589 learned_addr learned my addr 172.21.15.154:0/2793171589 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:57.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff1318bb700 1 --2- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c1371c0 0x7ff12c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefbabfe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb409ee60 0x7fefb4120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefbabfe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb4120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefbabfe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefb4138c30 0x7fefb4121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefbabfe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4122a30 con 0x7fefb409ee60 2023-09-30T22:23:57.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefbabfe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40a0330 con 0x7fefb40a2540 2023-09-30T22:23:57.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefbabfe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40a5220 con 0x7fefb4138c30 2023-09-30T22:23:57.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb4120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb4120d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55664/0 (socket says 172.21.15.154:55664) 2023-09-30T22:23:57.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb3fff700 1 -- 172.21.15.154:0/3544017783 learned_addr learned my addr 172.21.15.154:0/3544017783 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:57.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff1308b9700 1 -- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff12c09e870 msgr2=0x7ff12c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff1308b9700 1 --2- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff12c09e870 0x7ff12c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff1308b9700 1 -- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c1371c0 msgr2=0x7ff12c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff1308b9700 1 --2- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c1371c0 0x7ff12c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7ff1308b9700 1 -- 172.21.15.154:0/2793171589 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124009b30 con 0x7ff12c09f350 2023-09-30T22:23:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb899a700 1 --2- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb409ee60 0x7fefb4120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb3fff700 1 -- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefb4138c30 msgr2=0x7fefb4121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb3fff700 1 --2- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefb4138c30 0x7fefb4121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb3fff700 1 -- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb409ee60 msgr2=0x7fefb4120800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb3fff700 1 --2- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb409ee60 0x7fefb4120800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb3fff700 1 -- 172.21.15.154:0/3544017783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa0009550 con 0x7fefb40a2540 2023-09-30T22:23:57.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.204+0000 7fefb899a700 1 --2- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb409ee60 0x7fefb4120800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:23:57.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7ff1308b9700 1 --2- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c09f350 0x7ff12c06bdf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00e9b0 tx=0x7ff11c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7fefb3fff700 1 --2- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb4120d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fefa0000c00 tx=0x7fefa0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7ff121ffb700 1 -- 172.21.15.154:0/2793171589 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c009710 con 0x7ff12c09f350 2023-09-30T22:23:57.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7ff13331e700 1 -- 172.21.15.154:0/2793171589 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c072380 con 0x7ff12c09f350 2023-09-30T22:23:57.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7ff121ffb700 1 -- 172.21.15.154:0/2793171589 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c00c850 con 0x7ff12c09f350 2023-09-30T22:23:57.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7ff121ffb700 1 -- 172.21.15.154:0/2793171589 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00cbc0 con 0x7ff12c09f350 2023-09-30T22:23:57.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7fefb17fa700 1 -- 172.21.15.154:0/3544017783 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0004570 con 0x7fefb40a2540 2023-09-30T22:23:57.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7fefb17fa700 1 -- 172.21.15.154:0/3544017783 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa001f070 con 0x7fefb40a2540 2023-09-30T22:23:57.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7fefb17fa700 1 -- 172.21.15.154:0/3544017783 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa00038e0 con 0x7fefb40a2540 2023-09-30T22:23:57.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7fefbabfe700 1 -- 172.21.15.154:0/3544017783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb4124320 con 0x7fefb40a2540 2023-09-30T22:23:57.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7fefbabfe700 1 -- 172.21.15.154:0/3544017783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb4123dd0 con 0x7fefb40a2540 2023-09-30T22:23:57.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.206+0000 7fefb17fa700 1 -- 172.21.15.154:0/3544017783 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefa0021030 con 0x7fefb40a2540 2023-09-30T22:23:57.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.205+0000 7ff13331e700 1 -- 172.21.15.154:0/2793171589 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c123b80 con 0x7ff12c09f350 2023-09-30T22:23:57.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.206+0000 7fefbabfe700 1 -- 172.21.15.154:0/3544017783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb404f2a0 con 0x7fefb40a2540 2023-09-30T22:23:57.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.206+0000 7fefb17fa700 1 -- 172.21.15.154:0/3544017783 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fefa0040a20 con 0x7fefb40a2540 2023-09-30T22:23:57.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.206+0000 7ff121ffb700 1 -- 172.21.15.154:0/2793171589 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff11c00cd20 con 0x7ff12c09f350 2023-09-30T22:23:57.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.207+0000 7ff13331e700 1 -- 172.21.15.154:0/2793171589 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c04f2a0 con 0x7ff12c09f350 2023-09-30T22:23:57.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.207+0000 7ff121ffb700 1 -- 172.21.15.154:0/2793171589 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff11c01acf0 con 0x7ff12c09f350 2023-09-30T22:23:57.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.211+0000 7fefb17fa700 1 -- 172.21.15.154:0/3544017783 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefa00199a0 con 0x7fefb40a2540 2023-09-30T22:23:57.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.215+0000 7ff121ffb700 1 -- 172.21.15.154:0/2793171589 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff11c017030 con 0x7ff12c09f350 2023-09-30T22:23:57.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.385+0000 7f7325ffe700 1 -- 172.21.15.154:0/1707720756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7320125f10 con 0x7f7320130ce0 2023-09-30T22:23:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.385+0000 7f7307fff700 1 -- 172.21.15.154:0/1707720756 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73180143e0 con 0x7f7320130ce0 2023-09-30T22:23:57.386 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.388+0000 7f7325ffe700 1 -- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7320130ce0 msgr2=0x7f73201232d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.388+0000 7f7325ffe700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7320130ce0 0x7f73201232d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7318009370 tx=0x7f731800e3a0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.388+0000 7f7325ffe700 1 -- 172.21.15.154:0/1707720756 shutdown_connections 2023-09-30T22:23:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.388+0000 7f7325ffe700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7320130ce0 0x7f73201232d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.388+0000 7f7325ffe700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f732009d860 0x7f7320122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.388+0000 7f7325ffe700 1 --2- 172.21.15.154:0/1707720756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f732009e170 0x7f7320122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.388+0000 7f7325ffe700 1 -- 172.21.15.154:0/1707720756 >> 172.21.15.154:0/1707720756 conn(0x7f7320099c40 msgr2=0x7f73200a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.388+0000 7f7325ffe700 1 -- 172.21.15.154:0/1707720756 shutdown_connections 2023-09-30T22:23:57.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.388+0000 7f7325ffe700 1 -- 172.21.15.154:0/1707720756 wait complete. 2023-09-30T22:23:57.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:57.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.406+0000 7fefbabfe700 1 -- 172.21.15.154:0/3544017783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fefb40728e0 con 0x7fefb40a2540 2023-09-30T22:23:57.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.406+0000 7fefb17fa700 1 -- 172.21.15.154:0/3544017783 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefa001b430 con 0x7fefb40a2540 2023-09-30T22:23:57.407 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.409+0000 7fefbabfe700 1 -- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 msgr2=0x7fefb4120d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.409+0000 7fefbabfe700 1 --2- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb4120d40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fefa0000c00 tx=0x7fefa0004750 comp rx=0 tx=0).stop 2023-09-30T22:23:57.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.409+0000 7fefbabfe700 1 -- 172.21.15.154:0/3544017783 shutdown_connections 2023-09-30T22:23:57.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.409+0000 7fefbabfe700 1 --2- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefb4138c30 0x7fefb4121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.409+0000 7fefbabfe700 1 --2- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb409ee60 0x7fefb4120800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.409+0000 7fefbabfe700 1 --2- 172.21.15.154:0/3544017783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb40a2540 0x7fefb4120d40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.409+0000 7fefbabfe700 1 -- 172.21.15.154:0/3544017783 >> 172.21.15.154:0/3544017783 conn(0x7fefb40a65f0 msgr2=0x7fefb40a0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.410+0000 7fefbabfe700 1 -- 172.21.15.154:0/3544017783 shutdown_connections 2023-09-30T22:23:57.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.410+0000 7fefbabfe700 1 -- 172.21.15.154:0/3544017783 wait complete. 2023-09-30T22:23:57.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:57.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:57.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.446+0000 7ff13331e700 1 -- 172.21.15.154:0/2793171589 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff12c06b2a0 con 0x7ff12c09f350 2023-09-30T22:23:57.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.446+0000 7ff121ffb700 1 -- 172.21.15.154:0/2793171589 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff11c01b3b0 con 0x7ff12c09f350 2023-09-30T22:23:57.447 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:57.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.448+0000 7ff13331e700 1 -- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c09f350 msgr2=0x7ff12c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.448+0000 7ff13331e700 1 --2- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c09f350 0x7ff12c06bdf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00e9b0 tx=0x7ff11c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.448+0000 7ff13331e700 1 -- 172.21.15.154:0/2793171589 shutdown_connections 2023-09-30T22:23:57.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.448+0000 7ff13331e700 1 --2- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c1371c0 0x7ff12c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.448+0000 7ff13331e700 1 --2- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff12c09e870 0x7ff12c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.448+0000 7ff13331e700 1 --2- 172.21.15.154:0/2793171589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c09f350 0x7ff12c06bdf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.448+0000 7ff13331e700 1 -- 172.21.15.154:0/2793171589 >> 172.21.15.154:0/2793171589 conn(0x7ff12c0a4430 msgr2=0x7ff12c09cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.448+0000 7ff13331e700 1 -- 172.21.15.154:0/2793171589 shutdown_connections 2023-09-30T22:23:57.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.448+0000 7ff13331e700 1 -- 172.21.15.154:0/2793171589 wait complete. 2023-09-30T22:23:57.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.567+0000 7f097a0fd700 1 Processor -- start 2023-09-30T22:23:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.567+0000 7f097a0fd700 1 -- start start 2023-09-30T22:23:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.567+0000 7f097a0fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f097409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.567+0000 7f097a0fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09741343a0 0x7f097413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.567+0000 7f097a0fd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097406bec0 con 0x7f097409f180 2023-09-30T22:23:57.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.567+0000 7f097a0fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097406ce60 con 0x7f09741343a0 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.567+0000 7f097a0fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f097409fa00 con 0x7f097409e870 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f0973fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09741343a0 0x7f097413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f0972ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f097409f180 0x7f0974133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59928/0 (socket says 172.21.15.154:59928) 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f0972ffd700 1 -- 172.21.15.154:0/4141601543 learned_addr learned my addr 172.21.15.154:0/4141601543 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f09737fe700 1 --2- 172.21.15.154:0/4141601543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f097409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f0973fff700 1 -- 172.21.15.154:0/4141601543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 msgr2=0x7f097409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f0973fff700 1 --2- 172.21.15.154:0/4141601543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f097409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f0973fff700 1 -- 172.21.15.154:0/4141601543 >> v1:172.21.15.154:6789/0 conn(0x7f097409f180 legacy=0x7f0974133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f09727fc700 1 -- 172.21.15.154:0/4141601543 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096156130 0 0) 0x7f097406bec0 con 0x7f097409f180 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f0973fff700 1 -- 172.21.15.154:0/4141601543 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097409ad80 con 0x7f09741343a0 2023-09-30T22:23:57.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f09737fe700 1 --2- 172.21.15.154:0/4141601543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f097409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f0973fff700 1 --2- 172.21.15.154:0/4141601543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09741343a0 0x7f097413bf60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f096c009dc0 tx=0x7f096c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741a718997bfed95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f09727fc700 1 -- 172.21.15.154:0/4141601543 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00e070 con 0x7f09741343a0 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f09727fc700 1 -- 172.21.15.154:0/4141601543 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c00bb20 con 0x7f09741343a0 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.568+0000 7f09727fc700 1 -- 172.21.15.154:0/4141601543 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c012430 con 0x7f09741343a0 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.569+0000 7f097a0fd700 1 -- 172.21.15.154:0/4141601543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09741343a0 msgr2=0x7f097413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.569+0000 7f097a0fd700 1 --2- 172.21.15.154:0/4141601543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09741343a0 0x7f097413bf60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f096c009dc0 tx=0x7f096c00b330 comp rx=0 tx=0).stop 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.569+0000 7f097a0fd700 1 -- 172.21.15.154:0/4141601543 shutdown_connections 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.569+0000 7f097a0fd700 1 --2- 172.21.15.154:0/4141601543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09741343a0 0x7f097413bf60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.569+0000 7f097a0fd700 1 --2- 172.21.15.154:0/4141601543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f097409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.569+0000 7f097a0fd700 1 -- 172.21.15.154:0/4141601543 >> 172.21.15.154:0/4141601543 conn(0x7f09740a4430 msgr2=0x7f09740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.569+0000 7f097a0fd700 1 -- 172.21.15.154:0/4141601543 shutdown_connections 2023-09-30T22:23:57.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.569+0000 7f097a0fd700 1 -- 172.21.15.154:0/4141601543 wait complete. 2023-09-30T22:23:57.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f097a0fd700 1 Processor -- start 2023-09-30T22:23:57.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f097a0fd700 1 -- start start 2023-09-30T22:23:57.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f097a0fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f09741228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f097a0fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f097409f180 0x7f0974122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f097a0fd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09741343a0 0x7f0974123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:57.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f097a0fd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0974126190 con 0x7f09741343a0 2023-09-30T22:23:57.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f097a0fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0974124480 con 0x7f097409f180 2023-09-30T22:23:57.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f097a0fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f097406cfa0 con 0x7f097409e870 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f09737fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f09741228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f09737fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f09741228c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52236/0 (socket says 172.21.15.154:52236) 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f09737fe700 1 -- 172.21.15.154:0/4214704485 learned_addr learned my addr 172.21.15.154:0/4214704485 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f0973fff700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09741343a0 0x7f0974123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.570+0000 7f0972ffd700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f097409f180 0x7f0974122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f09737fe700 1 -- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f097409f180 msgr2=0x7f0974122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f09737fe700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f097409f180 0x7f0974122e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f09737fe700 1 -- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09741343a0 msgr2=0x7f0974123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f09737fe700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09741343a0 0x7f0974123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f09737fe700 1 -- 172.21.15.154:0/4214704485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640094a0 con 0x7f097409e870 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f0973fff700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09741343a0 0x7f0974123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:57.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f09737fe700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f09741228c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f096400ebe0 tx=0x7f096400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:57.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f095bfff700 1 -- 172.21.15.154:0/4214704485 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096400c850 con 0x7f097409e870 2023-09-30T22:23:57.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f095bfff700 1 -- 172.21.15.154:0/4214704485 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096400c9b0 con 0x7f097409e870 2023-09-30T22:23:57.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f097a0fd700 1 -- 172.21.15.154:0/4214704485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096c009a70 con 0x7f097409e870 2023-09-30T22:23:57.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f095bfff700 1 -- 172.21.15.154:0/4214704485 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096400cd40 con 0x7f097409e870 2023-09-30T22:23:57.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.571+0000 7f097a0fd700 1 -- 172.21.15.154:0/4214704485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0974126b20 con 0x7f097409e870 2023-09-30T22:23:57.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.572+0000 7f095bfff700 1 -- 172.21.15.154:0/4214704485 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0964013470 con 0x7f097409e870 2023-09-30T22:23:57.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.572+0000 7f095bfff700 1 -- 172.21.15.154:0/4214704485 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f096403f770 con 0x7f097409e870 2023-09-30T22:23:57.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.572+0000 7f097a0fd700 1 -- 172.21.15.154:0/4214704485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0974125fd0 con 0x7f097409e870 2023-09-30T22:23:57.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.577+0000 7f095bfff700 1 -- 172.21.15.154:0/4214704485 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0964021020 con 0x7f097409e870 2023-09-30T22:23:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.760+0000 7f097a0fd700 1 -- 172.21.15.154:0/4214704485 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f097404f2a0 con 0x7f097409e870 2023-09-30T22:23:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.760+0000 7f095bfff700 1 -- 172.21.15.154:0/4214704485 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f096400cea0 con 0x7f097409e870 2023-09-30T22:23:57.761 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.762+0000 7f097a0fd700 1 -- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 msgr2=0x7f09741228c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.762+0000 7f097a0fd700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f09741228c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f096400ebe0 tx=0x7f096400eef0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.762+0000 7f097a0fd700 1 -- 172.21.15.154:0/4214704485 shutdown_connections 2023-09-30T22:23:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.762+0000 7f097a0fd700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09741343a0 0x7f0974123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.762+0000 7f097a0fd700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f097409e870 0x7f09741228c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.762+0000 7f097a0fd700 1 --2- 172.21.15.154:0/4214704485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f097409f180 0x7f0974122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:57.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.762+0000 7f097a0fd700 1 -- 172.21.15.154:0/4214704485 >> 172.21.15.154:0/4214704485 conn(0x7f09740a4430 msgr2=0x7f09740a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:57.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.762+0000 7f097a0fd700 1 -- 172.21.15.154:0/4214704485 shutdown_connections 2023-09-30T22:23:57.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:57.762+0000 7f097a0fd700 1 -- 172.21.15.154:0/4214704485 wait complete. 2023-09-30T22:23:57.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:58.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:58.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:58.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:58.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.544+0000 7ff398236700 1 Processor -- start 2023-09-30T22:23:58.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.545+0000 7ff398236700 1 -- start start 2023-09-30T22:23:58.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff398236700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff39009dec0 0x7ff39006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff398236700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff390136cb0 0x7ff390139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff398236700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39006e900 con 0x7ff39006a770 2023-09-30T22:23:58.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff398236700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39009d180 con 0x7ff39009dec0 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff398236700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff39009e780 con 0x7ff390136cb0 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff3957d1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff39009dec0 0x7ff39006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff3967d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff390136cb0 0x7ff390139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff395fd2700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff39006a770 0x7ff39006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59944/0 (socket says 172.21.15.154:59944) 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff3957d1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff39009dec0 0x7ff39006b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45498/0 (socket says 172.21.15.154:45498) 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff395fd2700 1 -- 172.21.15.154:0/3745871122 learned_addr learned my addr 172.21.15.154:0/3745871122 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff394fd0700 1 -- 172.21.15.154:0/3745871122 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549569306 0 0) 0x7ff39006e900 con 0x7ff39006a770 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff3967d3700 1 -- 172.21.15.154:0/3745871122 >> v2:172.21.15.154:3300/0 conn(0x7ff39009dec0 msgr2=0x7ff39006b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff3967d3700 1 --2- 172.21.15.154:0/3745871122 >> v2:172.21.15.154:3300/0 conn(0x7ff39009dec0 0x7ff39006b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff3967d3700 1 -- 172.21.15.154:0/3745871122 >> v1:172.21.15.154:6789/0 conn(0x7ff39006a770 legacy=0x7ff39006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff3967d3700 1 -- 172.21.15.154:0/3745871122 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39009d3c0 con 0x7ff390136cb0 2023-09-30T22:23:58.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff3967d3700 1 --2- 172.21.15.154:0/3745871122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff390136cb0 0x7ff390139090 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff388009d90 tx=0x7ff38800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0406d544a9447d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff394fd0700 1 -- 172.21.15.154:0/3745871122 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38800e070 con 0x7ff390136cb0 2023-09-30T22:23:58.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff394fd0700 1 -- 172.21.15.154:0/3745871122 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38800bb20 con 0x7ff390136cb0 2023-09-30T22:23:58.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.546+0000 7ff394fd0700 1 -- 172.21.15.154:0/3745871122 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388012430 con 0x7ff390136cb0 2023-09-30T22:23:58.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.547+0000 7ff398236700 1 -- 172.21.15.154:0/3745871122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff390136cb0 msgr2=0x7ff390139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.547+0000 7ff398236700 1 --2- 172.21.15.154:0/3745871122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff390136cb0 0x7ff390139090 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff388009d90 tx=0x7ff38800b330 comp rx=0 tx=0).stop 2023-09-30T22:23:58.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.547+0000 7ff398236700 1 -- 172.21.15.154:0/3745871122 shutdown_connections 2023-09-30T22:23:58.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.547+0000 7ff398236700 1 --2- 172.21.15.154:0/3745871122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff390136cb0 0x7ff390139090 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.547+0000 7ff398236700 1 --2- 172.21.15.154:0/3745871122 >> v2:172.21.15.154:3300/0 conn(0x7ff39009dec0 0x7ff39006b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.547+0000 7ff398236700 1 -- 172.21.15.154:0/3745871122 >> 172.21.15.154:0/3745871122 conn(0x7ff390099c40 msgr2=0x7ff3900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.547+0000 7ff398236700 1 -- 172.21.15.154:0/3745871122 shutdown_connections 2023-09-30T22:23:58.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.547+0000 7ff398236700 1 -- 172.21.15.154:0/3745871122 wait complete. 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.548+0000 7ff398236700 1 Processor -- start 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.548+0000 7ff398236700 1 -- start start 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff398236700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39006a770 0x7ff390119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff398236700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff39009dec0 0x7ff390119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff398236700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff390136cb0 0x7ff39011a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff398236700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39011cb60 con 0x7ff39006a770 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff398236700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff390139330 con 0x7ff390136cb0 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff398236700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff39011afd0 con 0x7ff39009dec0 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3957d1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff39009dec0 0x7ff390119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3957d1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff39009dec0 0x7ff390119b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52264/0 (socket says 172.21.15.154:52264) 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3957d1700 1 -- 172.21.15.154:0/4188012879 learned_addr learned my addr 172.21.15.154:0/4188012879 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3967d3700 1 --2- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff390136cb0 0x7ff39011a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff395fd2700 1 --2- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39006a770 0x7ff390119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3957d1700 1 -- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff390136cb0 msgr2=0x7ff39011a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3957d1700 1 --2- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff390136cb0 0x7ff39011a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3957d1700 1 -- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39006a770 msgr2=0x7ff390119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3957d1700 1 --2- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39006a770 0x7ff390119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3957d1700 1 -- 172.21.15.154:0/4188012879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388009a70 con 0x7ff39009dec0 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.549+0000 7ff3957d1700 1 --2- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff39009dec0 0x7ff390119b70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff38000e9b0 tx=0x7ff38000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.550+0000 7ff3867fc700 1 -- 172.21.15.154:0/4188012879 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380009710 con 0x7ff39009dec0 2023-09-30T22:23:58.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.550+0000 7ff3867fc700 1 -- 172.21.15.154:0/4188012879 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38000ee50 con 0x7ff39009dec0 2023-09-30T22:23:58.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.550+0000 7ff398236700 1 -- 172.21.15.154:0/4188012879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff390071ce0 con 0x7ff39009dec0 2023-09-30T22:23:58.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.550+0000 7ff3867fc700 1 -- 172.21.15.154:0/4188012879 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000ca50 con 0x7ff39009dec0 2023-09-30T22:23:58.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.550+0000 7ff398236700 1 -- 172.21.15.154:0/4188012879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39011ce40 con 0x7ff39009dec0 2023-09-30T22:23:58.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.551+0000 7ff3867fc700 1 -- 172.21.15.154:0/4188012879 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff38000cbb0 con 0x7ff39009dec0 2023-09-30T22:23:58.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.551+0000 7ff3867fc700 1 -- 172.21.15.154:0/4188012879 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff38003fa90 con 0x7ff39009dec0 2023-09-30T22:23:58.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.551+0000 7ff398236700 1 -- 172.21.15.154:0/4188012879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39011c6d0 con 0x7ff39009dec0 2023-09-30T22:23:58.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.559+0000 7ff3867fc700 1 -- 172.21.15.154:0/4188012879 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff38001b3b0 con 0x7ff39009dec0 2023-09-30T22:23:58.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.584+0000 7fc223ef2700 1 Processor -- start 2023-09-30T22:23:58.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc223ef2700 1 -- start start 2023-09-30T22:23:58.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc223ef2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc21c0a0a70 0x7fc21c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc223ef2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc223ef2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c09dc00 con 0x7fc21c133f50 2023-09-30T22:23:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc223ef2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c09ea60 con 0x7fc21c0a0a70 2023-09-30T22:23:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc223ef2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c09dec0 con 0x7fc21c0a1380 2023-09-30T22:23:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc221c8e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc21c0a0a70 0x7fc21c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc22148d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc221c8e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc21c0a0a70 0x7fc21c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45516/0 (socket says 172.21.15.154:45516) 2023-09-30T22:23:58.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.585+0000 7fc221c8e700 1 -- 172.21.15.154:0/4005952022 learned_addr learned my addr 172.21.15.154:0/4005952022 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc221c8e700 1 -- 172.21.15.154:0/4005952022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 msgr2=0x7fc21c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc221c8e700 1 --2- 172.21.15.154:0/4005952022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc221c8e700 1 -- 172.21.15.154:0/4005952022 >> v1:172.21.15.154:6789/0 conn(0x7fc21c133f50 legacy=0x7fc21c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc221c8e700 1 -- 172.21.15.154:0/4005952022 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c09e6a0 con 0x7fc21c0a0a70 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc220c8c700 1 -- 172.21.15.154:0/4005952022 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24140471 0 0) 0x7fc21c09dc00 con 0x7fc21c133f50 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc22148d700 1 --2- 172.21.15.154:0/4005952022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc221c8e700 1 --2- 172.21.15.154:0/4005952022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c0a0a70 0x7fc21c0a0e40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc2180098f0 tx=0x7fc218009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87448d7b2e392cd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc220c8c700 1 -- 172.21.15.154:0/4005952022 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218011830 con 0x7fc21c0a0a70 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc220c8c700 1 -- 172.21.15.154:0/4005952022 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc218011990 con 0x7fc21c0a0a70 2023-09-30T22:23:58.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.586+0000 7fc220c8c700 1 -- 172.21.15.154:0/4005952022 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218011d20 con 0x7fc21c0a0a70 2023-09-30T22:23:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.587+0000 7fc223ef2700 1 -- 172.21.15.154:0/4005952022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c0a0a70 msgr2=0x7fc21c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.587+0000 7fc223ef2700 1 --2- 172.21.15.154:0/4005952022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c0a0a70 0x7fc21c0a0e40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc2180098f0 tx=0x7fc218009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.587+0000 7fc223ef2700 1 -- 172.21.15.154:0/4005952022 shutdown_connections 2023-09-30T22:23:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.587+0000 7fc223ef2700 1 --2- 172.21.15.154:0/4005952022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c0a0a70 0x7fc21c0a0e40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.587+0000 7fc223ef2700 1 --2- 172.21.15.154:0/4005952022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.587+0000 7fc223ef2700 1 -- 172.21.15.154:0/4005952022 >> 172.21.15.154:0/4005952022 conn(0x7fc21c0a6610 msgr2=0x7fc21c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.587+0000 7fc223ef2700 1 -- 172.21.15.154:0/4005952022 shutdown_connections 2023-09-30T22:23:58.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.587+0000 7fc223ef2700 1 -- 172.21.15.154:0/4005952022 wait complete. 2023-09-30T22:23:58.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.588+0000 7fc223ef2700 1 Processor -- start 2023-09-30T22:23:58.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.588+0000 7fc223ef2700 1 -- start start 2023-09-30T22:23:58.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc223ef2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc21c0a0a70 0x7fc21c122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc223ef2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc223ef2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c133f50 0x7fc21c1232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc223ef2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c133ad0 con 0x7fc21c133f50 2023-09-30T22:23:58.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc223ef2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c125de0 con 0x7fc21c0a0a70 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc223ef2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c124510 con 0x7fc21c0a1380 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc221c8e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc21c0a0a70 0x7fc21c122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc221c8e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc21c0a0a70 0x7fc21c122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55688/0 (socket says 172.21.15.154:55688) 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc221c8e700 1 -- 172.21.15.154:0/4277610435 learned_addr learned my addr 172.21.15.154:0/4277610435 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc22248f700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c133f50 0x7fc21c1232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc22148d700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc221c8e700 1 -- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 msgr2=0x7fc21c122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc221c8e700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc221c8e700 1 -- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c133f50 msgr2=0x7fc21c1232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc221c8e700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c133f50 0x7fc21c1232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc221c8e700 1 -- 172.21.15.154:0/4277610435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c0094a0 con 0x7fc21c0a0a70 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc22148d700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.589+0000 7fc22248f700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c133f50 0x7fc21c1232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.590+0000 7fc221c8e700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc21c0a0a70 0x7fc21c122860 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc21c09eba0 tx=0x7fc218004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.590+0000 7fc2127fc700 1 -- 172.21.15.154:0/4277610435 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218004300 con 0x7fc21c0a0a70 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.590+0000 7fc2127fc700 1 -- 172.21.15.154:0/4277610435 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21801f070 con 0x7fc21c0a0a70 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.590+0000 7fc2127fc700 1 -- 172.21.15.154:0/4277610435 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180036a0 con 0x7fc21c0a0a70 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.590+0000 7fc223ef2700 1 -- 172.21.15.154:0/4277610435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc218009550 con 0x7fc21c0a0a70 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.590+0000 7fc223ef2700 1 -- 172.21.15.154:0/4277610435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c133380 con 0x7fc21c0a0a70 2023-09-30T22:23:58.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.591+0000 7fc2127fc700 1 -- 172.21.15.154:0/4277610435 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc218021030 con 0x7fc21c0a0a70 2023-09-30T22:23:58.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.591+0000 7fc223ef2700 1 -- 172.21.15.154:0/4277610435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c04f2a0 con 0x7fc21c0a0a70 2023-09-30T22:23:58.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.591+0000 7fc2127fc700 1 -- 172.21.15.154:0/4277610435 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2180408e0 con 0x7fc21c0a0a70 2023-09-30T22:23:58.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.596+0000 7fc2127fc700 1 -- 172.21.15.154:0/4277610435 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2180199a0 con 0x7fc21c0a0a70 2023-09-30T22:23:58.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.624+0000 7f80188a1700 1 Processor -- start 2023-09-30T22:23:58.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.624+0000 7f80188a1700 1 -- start start 2023-09-30T22:23:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f80188a1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80140a0a70 0x7f80140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f80188a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8014134120 0x7f801413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f80188a1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801409dc00 con 0x7f80140a1380 2023-09-30T22:23:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f80188a1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801409ea90 con 0x7f80140a0a70 2023-09-30T22:23:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f80188a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801409dec0 con 0x7f8014134120 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f801259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80140a0a70 0x7f80140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f801259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80140a0a70 0x7f80140a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45526/0 (socket says 172.21.15.154:45526) 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f801259c700 1 -- 172.21.15.154:0/1065821414 learned_addr learned my addr 172.21.15.154:0/1065821414 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f8012d9d700 1 --2- 172.21.15.154:0/1065821414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8014134120 0x7f801413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f801259c700 1 -- 172.21.15.154:0/1065821414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8014134120 msgr2=0x7f801413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f801259c700 1 --2- 172.21.15.154:0/1065821414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8014134120 0x7f801413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f801259c700 1 -- 172.21.15.154:0/1065821414 >> v1:172.21.15.154:6789/0 conn(0x7f80140a1380 legacy=0x7f8014133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f801259c700 1 -- 172.21.15.154:0/1065821414 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801409e6a0 con 0x7f80140a0a70 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.625+0000 7f801259c700 1 --2- 172.21.15.154:0/1065821414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 0x7f80140a0e40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f80040098f0 tx=0x7f8004009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfba8ab280ee375 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f801159a700 1 -- 172.21.15.154:0/1065821414 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004011830 con 0x7f80140a0a70 2023-09-30T22:23:58.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f801159a700 1 -- 172.21.15.154:0/1065821414 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8004011990 con 0x7f80140a0a70 2023-09-30T22:23:58.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f801159a700 1 -- 172.21.15.154:0/1065821414 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004011d20 con 0x7f80140a0a70 2023-09-30T22:23:58.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f80188a1700 1 -- 172.21.15.154:0/1065821414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 msgr2=0x7f80140a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f80188a1700 1 --2- 172.21.15.154:0/1065821414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 0x7f80140a0e40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f80040098f0 tx=0x7f8004009c00 comp rx=0 tx=0).stop 2023-09-30T22:23:58.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f80188a1700 1 -- 172.21.15.154:0/1065821414 shutdown_connections 2023-09-30T22:23:58.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f80188a1700 1 --2- 172.21.15.154:0/1065821414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8014134120 0x7f801413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f80188a1700 1 --2- 172.21.15.154:0/1065821414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 0x7f80140a0e40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f80188a1700 1 -- 172.21.15.154:0/1065821414 >> 172.21.15.154:0/1065821414 conn(0x7f80140a6610 msgr2=0x7f80140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f80188a1700 1 -- 172.21.15.154:0/1065821414 shutdown_connections 2023-09-30T22:23:58.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.626+0000 7f80188a1700 1 -- 172.21.15.154:0/1065821414 wait complete. 2023-09-30T22:23:58.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.627+0000 7f80188a1700 1 Processor -- start 2023-09-30T22:23:58.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f80188a1700 1 -- start start 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f80188a1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 0x7f8014122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f80188a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80140a1380 0x7f8014122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f80188a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8014134120 0x7f80141233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f80188a1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80141334b0 con 0x7f80140a0a70 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f80188a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8014125ea0 con 0x7f80140a1380 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f80188a1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8014133aa0 con 0x7f8014134120 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f801259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 0x7f8014122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f801259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 0x7f8014122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45542/0 (socket says 172.21.15.154:45542) 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f801259c700 1 -- 172.21.15.154:0/750247879 learned_addr learned my addr 172.21.15.154:0/750247879 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f8011d9b700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80140a1380 0x7f8014122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f8012d9d700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8014134120 0x7f80141233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f801259c700 1 -- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8014134120 msgr2=0x7f80141233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f801259c700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8014134120 0x7f80141233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f801259c700 1 -- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80140a1380 msgr2=0x7f8014122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f801259c700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80140a1380 0x7f8014122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f801259c700 1 -- 172.21.15.154:0/750247879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004009550 con 0x7f80140a0a70 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f8012d9d700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8014134120 0x7f80141233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.628+0000 7f8011d9b700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80140a1380 0x7f8014122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.629+0000 7f801259c700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 0x7f8014122920 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8004000c00 tx=0x7f8004004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.629+0000 7f8002ffd700 1 -- 172.21.15.154:0/750247879 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004004480 con 0x7f80140a0a70 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.629+0000 7f8002ffd700 1 -- 172.21.15.154:0/750247879 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800401f070 con 0x7f80140a0a70 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.629+0000 7f80188a1700 1 -- 172.21.15.154:0/750247879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80140a03e0 con 0x7f80140a0a70 2023-09-30T22:23:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.629+0000 7f8002ffd700 1 -- 172.21.15.154:0/750247879 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80040038c0 con 0x7f80140a0a70 2023-09-30T22:23:58.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.629+0000 7f80188a1700 1 -- 172.21.15.154:0/750247879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8014124530 con 0x7f80140a0a70 2023-09-30T22:23:58.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.629+0000 7f8002ffd700 1 -- 172.21.15.154:0/750247879 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8004021030 con 0x7f80140a0a70 2023-09-30T22:23:58.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.630+0000 7f8002ffd700 1 -- 172.21.15.154:0/750247879 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f80040409e0 con 0x7f80140a0a70 2023-09-30T22:23:58.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.630+0000 7f80188a1700 1 -- 172.21.15.154:0/750247879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80141263a0 con 0x7f80140a0a70 2023-09-30T22:23:58.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.634+0000 7f8002ffd700 1 -- 172.21.15.154:0/750247879 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8004015080 con 0x7f80140a0a70 2023-09-30T22:23:58.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:23:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.796+0000 7ff398236700 1 -- 172.21.15.154:0/4188012879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff39004f2a0 con 0x7ff39009dec0 2023-09-30T22:23:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.796+0000 7ff3867fc700 1 -- 172.21.15.154:0/4188012879 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff380017020 con 0x7ff39009dec0 2023-09-30T22:23:58.797 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:58.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.800+0000 7ff398236700 1 -- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff39009dec0 msgr2=0x7ff390119b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.800+0000 7ff398236700 1 --2- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff39009dec0 0x7ff390119b70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff38000e9b0 tx=0x7ff38000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.800+0000 7ff398236700 1 -- 172.21.15.154:0/4188012879 shutdown_connections 2023-09-30T22:23:58.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.800+0000 7ff398236700 1 --2- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff390136cb0 0x7ff39011a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.800+0000 7ff398236700 1 --2- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39006a770 0x7ff390119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.800+0000 7ff398236700 1 --2- 172.21.15.154:0/4188012879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff39009dec0 0x7ff390119b70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.800+0000 7ff398236700 1 -- 172.21.15.154:0/4188012879 >> 172.21.15.154:0/4188012879 conn(0x7ff390099c40 msgr2=0x7ff39009bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.800+0000 7ff398236700 1 -- 172.21.15.154:0/4188012879 shutdown_connections 2023-09-30T22:23:58.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.800+0000 7ff398236700 1 -- 172.21.15.154:0/4188012879 wait complete. 2023-09-30T22:23:58.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:23:58.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.829+0000 7fc223ef2700 1 -- 172.21.15.154:0/4277610435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc21c072980 con 0x7fc21c0a0a70 2023-09-30T22:23:58.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.829+0000 7fc2127fc700 1 -- 172.21.15.154:0/4277610435 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc218015030 con 0x7fc21c0a0a70 2023-09-30T22:23:58.830 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:23:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.829+0000 7f80188a1700 1 -- 172.21.15.154:0/750247879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f801404f2a0 con 0x7f80140a0a70 2023-09-30T22:23:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.830+0000 7f8002ffd700 1 -- 172.21.15.154:0/750247879 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8004003a20 con 0x7f80140a0a70 2023-09-30T22:23:58.831 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:23:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7fc223ef2700 1 -- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc21c0a0a70 msgr2=0x7fc21c122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7fc223ef2700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc21c0a0a70 0x7fc21c122860 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc21c09eba0 tx=0x7fc218004750 comp rx=0 tx=0).stop 2023-09-30T22:23:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7fc223ef2700 1 -- 172.21.15.154:0/4277610435 shutdown_connections 2023-09-30T22:23:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7fc223ef2700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c133f50 0x7fc21c1232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7fc223ef2700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc21c0a0a70 0x7fc21c122860 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7fc223ef2700 1 --2- 172.21.15.154:0/4277610435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc21c0a1380 0x7fc21c122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7fc223ef2700 1 -- 172.21.15.154:0/4277610435 >> 172.21.15.154:0/4277610435 conn(0x7fc21c0a6610 msgr2=0x7fc21c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7fc223ef2700 1 -- 172.21.15.154:0/4277610435 shutdown_connections 2023-09-30T22:23:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7fc223ef2700 1 -- 172.21.15.154:0/4277610435 wait complete. 2023-09-30T22:23:58.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7f80188a1700 1 -- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 msgr2=0x7f8014122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7f80188a1700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 0x7f8014122920 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8004000c00 tx=0x7f8004004750 comp rx=0 tx=0).stop 2023-09-30T22:23:58.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7f80188a1700 1 -- 172.21.15.154:0/750247879 shutdown_connections 2023-09-30T22:23:58.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7f80188a1700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8014134120 0x7f80141233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7f80188a1700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80140a0a70 0x7f8014122920 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7f80188a1700 1 --2- 172.21.15.154:0/750247879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80140a1380 0x7f8014122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7f80188a1700 1 -- 172.21.15.154:0/750247879 >> 172.21.15.154:0/750247879 conn(0x7f80140a6610 msgr2=0x7f80140a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7f80188a1700 1 -- 172.21.15.154:0/750247879 shutdown_connections 2023-09-30T22:23:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.833+0000 7f80188a1700 1 -- 172.21.15.154:0/750247879 wait complete. 2023-09-30T22:23:58.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:23:58.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:23:58.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.903+0000 7fd59ba4e700 1 Processor -- start 2023-09-30T22:23:58.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.903+0000 7fd59ba4e700 1 -- start start 2023-09-30T22:23:58.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd59ba4e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd594131980 0x7fd594131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd59ba4e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd59409bc70 0x7fd59409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd59ba4e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5940a1640 con 0x7fd59409c5c0 2023-09-30T22:23:58.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd59ba4e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59406eb30 con 0x7fd59409bc70 2023-09-30T22:23:58.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd59ba4e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940a22d0 con 0x7fd594131980 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd5997ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd594131980 0x7fd594131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd599feb700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd59409c5c0 0x7fd594138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59974/0 (socket says 172.21.15.154:59974) 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd599feb700 1 -- 172.21.15.154:0/3159942227 learned_addr learned my addr 172.21.15.154:0/3159942227 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd598fe9700 1 --2- 172.21.15.154:0/3159942227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd59409bc70 0x7fd59409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd5997ea700 1 -- 172.21.15.154:0/3159942227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd59409bc70 msgr2=0x7fd59409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd5997ea700 1 --2- 172.21.15.154:0/3159942227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd59409bc70 0x7fd59409c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd58bfff700 1 -- 172.21.15.154:0/3159942227 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737738311 0 0) 0x7fd5940a1640 con 0x7fd59409c5c0 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd5997ea700 1 -- 172.21.15.154:0/3159942227 >> v1:172.21.15.154:6789/0 conn(0x7fd59409c5c0 legacy=0x7fd594138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd5997ea700 1 -- 172.21.15.154:0/3159942227 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd594131550 con 0x7fd594131980 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd598fe9700 1 --2- 172.21.15.154:0/3159942227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd59409bc70 0x7fd59409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:58.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd5997ea700 1 --2- 172.21.15.154:0/3159942227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd594131980 0x7fd594131d50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd584009850 tx=0x7fd584009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bb6dd4e961bc3eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd58bfff700 1 -- 172.21.15.154:0/3159942227 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584005e30 con 0x7fd594131980 2023-09-30T22:23:58.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd58bfff700 1 -- 172.21.15.154:0/3159942227 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584006030 con 0x7fd594131980 2023-09-30T22:23:58.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.904+0000 7fd58bfff700 1 -- 172.21.15.154:0/3159942227 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5840063e0 con 0x7fd594131980 2023-09-30T22:23:58.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.905+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3159942227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd594131980 msgr2=0x7fd594131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.905+0000 7fd59ba4e700 1 --2- 172.21.15.154:0/3159942227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd594131980 0x7fd594131d50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd584009850 tx=0x7fd584009b60 comp rx=0 tx=0).stop 2023-09-30T22:23:58.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.905+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3159942227 shutdown_connections 2023-09-30T22:23:58.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.905+0000 7fd59ba4e700 1 --2- 172.21.15.154:0/3159942227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd594131980 0x7fd594131d50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.905+0000 7fd59ba4e700 1 --2- 172.21.15.154:0/3159942227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd59409bc70 0x7fd59409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.905+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3159942227 >> 172.21.15.154:0/3159942227 conn(0x7fd5940a2980 msgr2=0x7fd5940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.905+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3159942227 shutdown_connections 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.905+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3159942227 wait complete. 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd59ba4e700 1 Processor -- start 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd59ba4e700 1 -- start start 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd59ba4e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd59409bc70 0x7fd594099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd59ba4e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd59409c5c0 0x7fd594099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd59ba4e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd594131980 0x7fd59409a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd59ba4e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd594130940 con 0x7fd59409bc70 2023-09-30T22:23:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd59ba4e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5941212d0 con 0x7fd594131980 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd59ba4e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd59409b9c0 con 0x7fd59409c5c0 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd5997ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd59409bc70 0x7fd594099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd5997ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd59409bc70 0x7fd594099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45558/0 (socket says 172.21.15.154:45558) 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd598fe9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd59409c5c0 0x7fd594099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd5997ea700 1 -- 172.21.15.154:0/3184207068 learned_addr learned my addr 172.21.15.154:0/3184207068 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.906+0000 7fd599feb700 1 --2- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd594131980 0x7fd59409a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd598fe9700 1 -- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd594131980 msgr2=0x7fd59409a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd598fe9700 1 --2- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd594131980 0x7fd59409a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd598fe9700 1 -- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd59409bc70 msgr2=0x7fd594099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd598fe9700 1 --2- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd59409bc70 0x7fd594099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd598fe9700 1 -- 172.21.15.154:0/3184207068 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900094a0 con 0x7fd59409c5c0 2023-09-30T22:23:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd5997ea700 1 --2- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd59409bc70 0x7fd594099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd598fe9700 1 --2- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd59409c5c0 0x7fd594099fa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd59000e980 tx=0x7fd59000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd589ffb700 1 -- 172.21.15.154:0/3184207068 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000c690 con 0x7fd59409c5c0 2023-09-30T22:23:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd589ffb700 1 -- 172.21.15.154:0/3184207068 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59000c7f0 con 0x7fd59409c5c0 2023-09-30T22:23:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3184207068 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd584009430 con 0x7fd59409c5c0 2023-09-30T22:23:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd589ffb700 1 -- 172.21.15.154:0/3184207068 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000cb80 con 0x7fd59409c5c0 2023-09-30T22:23:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.907+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3184207068 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5940a1c40 con 0x7fd59409c5c0 2023-09-30T22:23:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.908+0000 7fd589ffb700 1 -- 172.21.15.154:0/3184207068 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd59000cce0 con 0x7fd59409c5c0 2023-09-30T22:23:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.908+0000 7fd589ffb700 1 -- 172.21.15.154:0/3184207068 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd59003fab0 con 0x7fd59409c5c0 2023-09-30T22:23:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.908+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3184207068 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5940a2d50 con 0x7fd59409c5c0 2023-09-30T22:23:58.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:58.913+0000 7fd589ffb700 1 -- 172.21.15.154:0/3184207068 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd590011d90 con 0x7fd59409c5c0 2023-09-30T22:23:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.097+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3184207068 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd59404f2a0 con 0x7fd59409c5c0 2023-09-30T22:23:59.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.097+0000 7fd589ffb700 1 -- 172.21.15.154:0/3184207068 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd590017020 con 0x7fd59409c5c0 2023-09-30T22:23:59.099 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:23:59.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.100+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd59409c5c0 msgr2=0x7fd594099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.100+0000 7fd59ba4e700 1 --2- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd59409c5c0 0x7fd594099fa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd59000e980 tx=0x7fd59000ec90 comp rx=0 tx=0).stop 2023-09-30T22:23:59.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.100+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3184207068 shutdown_connections 2023-09-30T22:23:59.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.100+0000 7fd59ba4e700 1 --2- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd594131980 0x7fd59409a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.100+0000 7fd59ba4e700 1 --2- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd59409bc70 0x7fd594099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.100+0000 7fd59ba4e700 1 --2- 172.21.15.154:0/3184207068 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd59409c5c0 0x7fd594099fa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.100+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3184207068 >> 172.21.15.154:0/3184207068 conn(0x7fd5940a2980 msgr2=0x7fd594070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.100+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3184207068 shutdown_connections 2023-09-30T22:23:59.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.100+0000 7fd59ba4e700 1 -- 172.21.15.154:0/3184207068 wait complete. 2023-09-30T22:23:59.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:23:59.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:23:59.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:23:59.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:23:59.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f513996d700 1 Processor -- start 2023-09-30T22:23:59.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f513996d700 1 -- start start 2023-09-30T22:23:59.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f513996d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f5134133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f513996d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f51340a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f513996d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51340a0e20 0x7f51340a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f513996d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513409aa00 con 0x7f51340a0e20 2023-09-30T22:23:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f513996d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513409a080 con 0x7f5134099a60 2023-09-30T22:23:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f513996d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5134133750 con 0x7f5134133b80 2023-09-30T22:23:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f5132ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f5134133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f5132ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f5134133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52322/0 (socket says 172.21.15.154:52322) 2023-09-30T22:23:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f5132ffd700 1 -- 172.21.15.154:0/1679912355 learned_addr learned my addr 172.21.15.154:0/1679912355 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f51327fc700 1 --2- 172.21.15.154:0/1679912355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f51340a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.947+0000 7f51337fe700 1 --2- 172.21.15.154:0/1679912355 >> v2:172.21.15.154:3300/0 conn(0x7f51340a0e20 0x7f51340a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f5132ffd700 1 -- 172.21.15.154:0/1679912355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 msgr2=0x7f51340a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f5132ffd700 1 --2- 172.21.15.154:0/1679912355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f51340a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f5132ffd700 1 -- 172.21.15.154:0/1679912355 >> v2:172.21.15.154:3300/0 conn(0x7f51340a0e20 msgr2=0x7f51340a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f5132ffd700 1 --2- 172.21.15.154:0/1679912355 >> v2:172.21.15.154:3300/0 conn(0x7f51340a0e20 0x7f51340a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f5132ffd700 1 -- 172.21.15.154:0/1679912355 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513409a760 con 0x7f5134133b80 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f51327fc700 1 --2- 172.21.15.154:0/1679912355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f51340a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f5132ffd700 1 --2- 172.21.15.154:0/1679912355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f5134133f50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5124006fd0 tx=0x7f5124009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af4c031d11937e62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f5131ffb700 1 -- 172.21.15.154:0/1679912355 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124005e30 con 0x7f5134133b80 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f5131ffb700 1 -- 172.21.15.154:0/1679912355 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5124004030 con 0x7f5134133b80 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.948+0000 7f5131ffb700 1 -- 172.21.15.154:0/1679912355 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51240043e0 con 0x7f5134133b80 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.949+0000 7f513996d700 1 -- 172.21.15.154:0/1679912355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 msgr2=0x7f5134133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.949+0000 7f513996d700 1 --2- 172.21.15.154:0/1679912355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f5134133f50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5124006fd0 tx=0x7f5124009bd0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.949+0000 7f513996d700 1 -- 172.21.15.154:0/1679912355 shutdown_connections 2023-09-30T22:23:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.949+0000 7f513996d700 1 --2- 172.21.15.154:0/1679912355 >> v2:172.21.15.154:3300/0 conn(0x7f51340a0e20 0x7f51340a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.949+0000 7f513996d700 1 --2- 172.21.15.154:0/1679912355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f5134133f50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.949+0000 7f513996d700 1 --2- 172.21.15.154:0/1679912355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f51340a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.949+0000 7f513996d700 1 -- 172.21.15.154:0/1679912355 >> 172.21.15.154:0/1679912355 conn(0x7f51340a2980 msgr2=0x7f51340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:23:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.949+0000 7f513996d700 1 -- 172.21.15.154:0/1679912355 shutdown_connections 2023-09-30T22:23:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.949+0000 7f513996d700 1 -- 172.21.15.154:0/1679912355 wait complete. 2023-09-30T22:23:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f513996d700 1 Processor -- start 2023-09-30T22:23:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f513996d700 1 -- start start 2023-09-30T22:23:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f513996d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f513411c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f513996d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51340a0e20 0x7f513411ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f513996d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f513411d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f513996d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513411dda0 con 0x7f51340a0e20 2023-09-30T22:23:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f513996d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51341203f0 con 0x7f5134099a60 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f513996d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f513411eb00 con 0x7f5134133b80 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f5132ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f513411c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f5132ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f513411c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55736/0 (socket says 172.21.15.154:55736) 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f5132ffd700 1 -- 172.21.15.154:0/1986663345 learned_addr learned my addr 172.21.15.154:0/1986663345 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.950+0000 7f51337fe700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f513411d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f51327fc700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51340a0e20 0x7f513411ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f5132ffd700 1 -- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 msgr2=0x7f513411d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f5132ffd700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f513411d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f5132ffd700 1 -- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51340a0e20 msgr2=0x7f513411ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f5132ffd700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51340a0e20 0x7f513411ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f5132ffd700 1 -- 172.21.15.154:0/1986663345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280094a0 con 0x7f5134099a60 2023-09-30T22:23:59.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f51337fe700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f513411d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:23:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f5132ffd700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f513411c8d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5124009c10 tx=0x7f5124004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:23:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f511bfff700 1 -- 172.21.15.154:0/1986663345 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124003ab0 con 0x7f5134099a60 2023-09-30T22:23:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f511bfff700 1 -- 172.21.15.154:0/1986663345 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5124003c10 con 0x7f5134099a60 2023-09-30T22:23:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f511bfff700 1 -- 172.21.15.154:0/1986663345 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124005e60 con 0x7f5134099a60 2023-09-30T22:23:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f513996d700 1 -- 172.21.15.154:0/1986663345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5124009500 con 0x7f5134099a60 2023-09-30T22:23:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.951+0000 7f513996d700 1 -- 172.21.15.154:0/1986663345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513409c450 con 0x7f5134099a60 2023-09-30T22:23:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.952+0000 7f511bfff700 1 -- 172.21.15.154:0/1986663345 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5124006030 con 0x7f5134099a60 2023-09-30T22:23:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.952+0000 7f513996d700 1 -- 172.21.15.154:0/1986663345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513411ff70 con 0x7f5134099a60 2023-09-30T22:23:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.952+0000 7f511bfff700 1 -- 172.21.15.154:0/1986663345 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5124040360 con 0x7f5134099a60 2023-09-30T22:23:59.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.957+0000 7f511bfff700 1 -- 172.21.15.154:0/1986663345 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f513411ff70 con 0x7f5134099a60 2023-09-30T22:23:59.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.997+0000 7f3160626700 1 Processor -- start 2023-09-30T22:23:59.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.997+0000 7f3160626700 1 -- start start 2023-09-30T22:23:59.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.997+0000 7f40dd3ac700 1 Processor -- start 2023-09-30T22:23:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.997+0000 7f40dd3ac700 1 -- start start 2023-09-30T22:23:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40dd3ac700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809f350 0x7f40d8138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40dd3ac700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40d81393a0 0x7f40d813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:23:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40dd3ac700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d809fa00 con 0x7f40d809e870 2023-09-30T22:23:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40dd3ac700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d80a0370 con 0x7f40d81393a0 2023-09-30T22:23:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40dd3ac700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40d806bec0 con 0x7f40d809f350 2023-09-30T22:24:00.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f3160626700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31580a0a70 0x7f31580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f3160626700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31580a1380 0x7f3158133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f3160626700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3158133f50 0x7f3158134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f3160626700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315809e9d0 con 0x7f31580a1380 2023-09-30T22:24:00.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f3160626700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315809dc00 con 0x7f31580a0a70 2023-09-30T22:24:00.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f3160626700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f315809dec0 con 0x7f3158133f50 2023-09-30T22:24:00.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315ebc3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3158133f50 0x7f3158134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40d67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809f350 0x7f40d8138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40d67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809f350 0x7f40d8138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52344/0 (socket says 172.21.15.154:52344) 2023-09-30T22:24:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40d67fc700 1 -- 172.21.15.154:0/412192174 learned_addr learned my addr 172.21.15.154:0/412192174 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40d77fe700 1 --2- 172.21.15.154:0/412192174 >> v2:172.21.15.154:3300/0 conn(0x7f40d81393a0 0x7f40d813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315ebc3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3158133f50 0x7f3158134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52356/0 (socket says 172.21.15.154:52356) 2023-09-30T22:24:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315ebc3700 1 -- 172.21.15.154:0/2017582625 learned_addr learned my addr 172.21.15.154:0/2017582625 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315e3c2700 1 --2- 172.21.15.154:0/2017582625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31580a0a70 0x7f31580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315dbc1700 1 --2- 172.21.15.154:0/2017582625 >> v2:172.21.15.154:3300/0 conn(0x7f31580a1380 0x7f3158133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40d67fc700 1 -- 172.21.15.154:0/412192174 >> v2:172.21.15.154:3300/0 conn(0x7f40d81393a0 msgr2=0x7f40d813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40d67fc700 1 --2- 172.21.15.154:0/412192174 >> v2:172.21.15.154:3300/0 conn(0x7f40d81393a0 0x7f40d813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40d67fc700 1 -- 172.21.15.154:0/412192174 >> v1:172.21.15.154:6789/0 conn(0x7f40d809e870 legacy=0x7f40d809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40d67fc700 1 -- 172.21.15.154:0/412192174 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d809ada0 con 0x7f40d809f350 2023-09-30T22:24:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315e3c2700 1 -- 172.21.15.154:0/2017582625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3158133f50 msgr2=0x7f3158134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315e3c2700 1 --2- 172.21.15.154:0/2017582625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3158133f50 0x7f3158134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315e3c2700 1 -- 172.21.15.154:0/2017582625 >> v2:172.21.15.154:3300/0 conn(0x7f31580a1380 msgr2=0x7f3158133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315e3c2700 1 --2- 172.21.15.154:0/2017582625 >> v2:172.21.15.154:3300/0 conn(0x7f31580a1380 0x7f3158133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315e3c2700 1 -- 172.21.15.154:0/2017582625 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315809e6a0 con 0x7f31580a0a70 2023-09-30T22:24:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f315ebc3700 1 --2- 172.21.15.154:0/2017582625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3158133f50 0x7f3158134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.998+0000 7f40d67fc700 1 --2- 172.21.15.154:0/412192174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809f350 0x7f40d8138e60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0098f0 tx=0x7f40cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f59e23576bcfcbdf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f315e3c2700 1 --2- 172.21.15.154:0/2017582625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31580a0a70 0x7f31580a0e40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3154009840 tx=0x7f3154009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc4cd5caffa0203 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f40d5ffb700 1 -- 172.21.15.154:0/412192174 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc011830 con 0x7f40d809f350 2023-09-30T22:24:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f40d5ffb700 1 -- 172.21.15.154:0/412192174 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc011990 con 0x7f40d809f350 2023-09-30T22:24:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f40d5ffb700 1 -- 172.21.15.154:0/412192174 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc011d00 con 0x7f40d809f350 2023-09-30T22:24:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f315d3c0700 1 -- 172.21.15.154:0/2017582625 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154011830 con 0x7f31580a0a70 2023-09-30T22:24:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f315d3c0700 1 -- 172.21.15.154:0/2017582625 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154011990 con 0x7f31580a0a70 2023-09-30T22:24:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f315d3c0700 1 -- 172.21.15.154:0/2017582625 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154011d20 con 0x7f31580a0a70 2023-09-30T22:24:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f40dd3ac700 1 -- 172.21.15.154:0/412192174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809f350 msgr2=0x7f40d8138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f40dd3ac700 1 --2- 172.21.15.154:0/412192174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809f350 0x7f40d8138e60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0098f0 tx=0x7f40cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f3160626700 1 -- 172.21.15.154:0/2017582625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31580a0a70 msgr2=0x7f31580a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f3160626700 1 --2- 172.21.15.154:0/2017582625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31580a0a70 0x7f31580a0e40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3154009840 tx=0x7f3154009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f40dd3ac700 1 -- 172.21.15.154:0/412192174 shutdown_connections 2023-09-30T22:24:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f40dd3ac700 1 --2- 172.21.15.154:0/412192174 >> v2:172.21.15.154:3300/0 conn(0x7f40d81393a0 0x7f40d813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f40dd3ac700 1 --2- 172.21.15.154:0/412192174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809f350 0x7f40d8138e60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:23:59.999+0000 7f40dd3ac700 1 -- 172.21.15.154:0/412192174 >> 172.21.15.154:0/412192174 conn(0x7f40d80a4430 msgr2=0x7f40d80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.000+0000 7f40dd3ac700 1 -- 172.21.15.154:0/412192174 shutdown_connections 2023-09-30T22:24:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.000+0000 7f40dd3ac700 1 -- 172.21.15.154:0/412192174 wait complete. 2023-09-30T22:24:00.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.000+0000 7f3160626700 1 -- 172.21.15.154:0/2017582625 shutdown_connections 2023-09-30T22:24:00.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.000+0000 7f3160626700 1 --2- 172.21.15.154:0/2017582625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31580a0a70 0x7f31580a0e40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.000+0000 7f3160626700 1 --2- 172.21.15.154:0/2017582625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3158133f50 0x7f3158134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.000+0000 7f3160626700 1 --2- 172.21.15.154:0/2017582625 >> v2:172.21.15.154:3300/0 conn(0x7f31580a1380 0x7f3158133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.000+0000 7f3160626700 1 -- 172.21.15.154:0/2017582625 >> 172.21.15.154:0/2017582625 conn(0x7f31580a6610 msgr2=0x7f31580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.000+0000 7f3160626700 1 -- 172.21.15.154:0/2017582625 shutdown_connections 2023-09-30T22:24:00.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.000+0000 7f3160626700 1 -- 172.21.15.154:0/2017582625 wait complete. 2023-09-30T22:24:00.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40dd3ac700 1 Processor -- start 2023-09-30T22:24:00.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40dd3ac700 1 -- start start 2023-09-30T22:24:00.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40dd3ac700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809e870 0x7f40d81c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40dd3ac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40d809f350 0x7f40d81c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40dd3ac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40d81393a0 0x7f40d811ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40dd3ac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8122660 con 0x7f40d81393a0 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40dd3ac700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d81be480 con 0x7f40d809f350 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40dd3ac700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40d806f9f0 con 0x7f40d809e870 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40d67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40d809f350 0x7f40d81c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40d67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40d809f350 0x7f40d81c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55748/0 (socket says 172.21.15.154:55748) 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40d67fc700 1 -- 172.21.15.154:0/2596400380 learned_addr learned my addr 172.21.15.154:0/2596400380 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40d77fe700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40d81393a0 0x7f40d811ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f3160626700 1 Processor -- start 2023-09-30T22:24:00.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.001+0000 7f40d6ffd700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809e870 0x7f40d81c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40d67fc700 1 -- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809e870 msgr2=0x7f40d81c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40d67fc700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809e870 0x7f40d81c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40d67fc700 1 -- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40d81393a0 msgr2=0x7f40d811ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40d67fc700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40d81393a0 0x7f40d811ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40d67fc700 1 -- 172.21.15.154:0/2596400380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc009550 con 0x7f40d809f350 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40d77fe700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40d81393a0 0x7f40d811ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40d67fc700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40d809f350 0x7f40d81c8cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f40cc014040 tx=0x7f40cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40bf7fe700 1 -- 172.21.15.154:0/2596400380 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc004450 con 0x7f40d809f350 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40bf7fe700 1 -- 172.21.15.154:0/2596400380 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc01e070 con 0x7f40d809f350 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40dd3ac700 1 -- 172.21.15.154:0/2596400380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d81220c0 con 0x7f40d809f350 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40bf7fe700 1 -- 172.21.15.154:0/2596400380 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc0038e0 con 0x7f40d809f350 2023-09-30T22:24:00.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f40dd3ac700 1 -- 172.21.15.154:0/2596400380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d81206e0 con 0x7f40d809f350 2023-09-30T22:24:00.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.002+0000 7f3160626700 1 -- start start 2023-09-30T22:24:00.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f3160626700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31580a0a70 0x7f3158122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f40bf7fe700 1 -- 172.21.15.154:0/2596400380 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40cc003a40 con 0x7f40d809f350 2023-09-30T22:24:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f3160626700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31580a1380 0x7f3158122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f3160626700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3158133f50 0x7f3158123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f3160626700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31581239f0 con 0x7f31580a1380 2023-09-30T22:24:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f3160626700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31580a03e0 con 0x7f3158133f50 2023-09-30T22:24:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f3160626700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31580a5180 con 0x7f31580a0a70 2023-09-30T22:24:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315dbc1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31580a1380 0x7f3158122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315dbc1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31580a1380 0x7f3158122ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45618/0 (socket says 172.21.15.154:45618) 2023-09-30T22:24:00.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315dbc1700 1 -- 172.21.15.154:0/325150367 learned_addr learned my addr 172.21.15.154:0/325150367 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:00.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f40bf7fe700 1 -- 172.21.15.154:0/2596400380 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40cc040610 con 0x7f40d809f350 2023-09-30T22:24:00.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f40dd3ac700 1 -- 172.21.15.154:0/2596400380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d804f2a0 con 0x7f40d809f350 2023-09-30T22:24:00.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315ebc3700 1 --2- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3158133f50 0x7f3158123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315e3c2700 1 --2- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31580a0a70 0x7f3158122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315dbc1700 1 -- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31580a0a70 msgr2=0x7f3158122590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315dbc1700 1 --2- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31580a0a70 0x7f3158122590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315dbc1700 1 -- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3158133f50 msgr2=0x7f3158123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315dbc1700 1 --2- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3158133f50 0x7f3158123010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.003+0000 7f315dbc1700 1 -- 172.21.15.154:0/325150367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150009b30 con 0x7f31580a1380 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.004+0000 7f315dbc1700 1 --2- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31580a1380 0x7f3158122ad0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f314800e840 tx=0x7f314800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.004+0000 7f314effd700 1 -- 172.21.15.154:0/325150367 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148004230 con 0x7f31580a1380 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.004+0000 7f314effd700 1 -- 172.21.15.154:0/325150367 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3148004390 con 0x7f31580a1380 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.004+0000 7f3160626700 1 -- 172.21.15.154:0/325150367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31540094a0 con 0x7f31580a1380 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.004+0000 7f314effd700 1 -- 172.21.15.154:0/325150367 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31480036a0 con 0x7f31580a1380 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.004+0000 7f3160626700 1 -- 172.21.15.154:0/325150367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31581334e0 con 0x7f31580a1380 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.005+0000 7f314effd700 1 -- 172.21.15.154:0/325150367 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3148003820 con 0x7f31580a1380 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.005+0000 7f3160626700 1 -- 172.21.15.154:0/325150367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315804f2a0 con 0x7f31580a1380 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.005+0000 7f314effd700 1 -- 172.21.15.154:0/325150367 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3148040a50 con 0x7f31580a1380 2023-09-30T22:24:00.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.009+0000 7f40bf7fe700 1 -- 172.21.15.154:0/2596400380 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40cc02d440 con 0x7f40d809f350 2023-09-30T22:24:00.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.010+0000 7f314effd700 1 -- 172.21.15.154:0/325150367 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3148044060 con 0x7f31580a1380 2023-09-30T22:24:00.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:00.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.160+0000 7f513996d700 1 -- 172.21.15.154:0/1986663345 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f513411ff70 con 0x7f5134099a60 2023-09-30T22:24:00.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.161+0000 7f511bfff700 1 -- 172.21.15.154:0/1986663345 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5124020070 con 0x7f5134099a60 2023-09-30T22:24:00.162 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:00.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.163+0000 7f513996d700 1 -- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 msgr2=0x7f513411c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.163+0000 7f513996d700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f513411c8d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5124009c10 tx=0x7f5124004750 comp rx=0 tx=0).stop 2023-09-30T22:24:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.164+0000 7f513996d700 1 -- 172.21.15.154:0/1986663345 shutdown_connections 2023-09-30T22:24:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.164+0000 7f513996d700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5134133b80 0x7f513411d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.164+0000 7f513996d700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134099a60 0x7f513411c8d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.164+0000 7f513996d700 1 --2- 172.21.15.154:0/1986663345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51340a0e20 0x7f513411ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.164+0000 7f513996d700 1 -- 172.21.15.154:0/1986663345 >> 172.21.15.154:0/1986663345 conn(0x7f51340a2980 msgr2=0x7f51341bad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.164+0000 7f513996d700 1 -- 172.21.15.154:0/1986663345 shutdown_connections 2023-09-30T22:24:00.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.164+0000 7f513996d700 1 -- 172.21.15.154:0/1986663345 wait complete. 2023-09-30T22:24:00.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:00.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.205+0000 7f40dd3ac700 1 -- 172.21.15.154:0/2596400380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f40d8072d60 con 0x7f40d809f350 2023-09-30T22:24:00.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.205+0000 7f40bf7fe700 1 -- 172.21.15.154:0/2596400380 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40cc00bbd0 con 0x7f40d809f350 2023-09-30T22:24:00.206 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:00.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.207+0000 7f3160626700 1 -- 172.21.15.154:0/325150367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f31581330b0 con 0x7f31580a1380 2023-09-30T22:24:00.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.207+0000 7f314effd700 1 -- 172.21.15.154:0/325150367 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3148044030 con 0x7f31580a1380 2023-09-30T22:24:00.208 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:00.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.207+0000 7f40dd3ac700 1 -- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40d809f350 msgr2=0x7f40d81c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.207+0000 7f40dd3ac700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40d809f350 0x7f40d81c8cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f40cc014040 tx=0x7f40cc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:00.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.208+0000 7f40dd3ac700 1 -- 172.21.15.154:0/2596400380 shutdown_connections 2023-09-30T22:24:00.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.208+0000 7f40dd3ac700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40d81393a0 0x7f40d811ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.208+0000 7f40dd3ac700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40d809e870 0x7f40d81c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.208+0000 7f40dd3ac700 1 --2- 172.21.15.154:0/2596400380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40d809f350 0x7f40d81c8cf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.208+0000 7f40dd3ac700 1 -- 172.21.15.154:0/2596400380 >> 172.21.15.154:0/2596400380 conn(0x7f40d80a4430 msgr2=0x7f40d81383c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.208+0000 7f40dd3ac700 1 -- 172.21.15.154:0/2596400380 shutdown_connections 2023-09-30T22:24:00.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.208+0000 7f40dd3ac700 1 -- 172.21.15.154:0/2596400380 wait complete. 2023-09-30T22:24:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.209+0000 7f3160626700 1 -- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31580a1380 msgr2=0x7f3158122ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.209+0000 7f3160626700 1 --2- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31580a1380 0x7f3158122ad0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f314800e840 tx=0x7f314800eb50 comp rx=0 tx=0).stop 2023-09-30T22:24:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.209+0000 7f3160626700 1 -- 172.21.15.154:0/325150367 shutdown_connections 2023-09-30T22:24:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.209+0000 7f3160626700 1 --2- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3158133f50 0x7f3158123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.209+0000 7f3160626700 1 --2- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31580a0a70 0x7f3158122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.209+0000 7f3160626700 1 --2- 172.21.15.154:0/325150367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31580a1380 0x7f3158122ad0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.209+0000 7f3160626700 1 -- 172.21.15.154:0/325150367 >> 172.21.15.154:0/325150367 conn(0x7f31580a6610 msgr2=0x7f315809c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.209+0000 7f3160626700 1 -- 172.21.15.154:0/325150367 shutdown_connections 2023-09-30T22:24:00.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.209+0000 7f3160626700 1 -- 172.21.15.154:0/325150367 wait complete. 2023-09-30T22:24:00.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:00.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:00.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.248+0000 7fb3643b5700 1 Processor -- start 2023-09-30T22:24:00.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.248+0000 7fb3643b5700 1 -- start start 2023-09-30T22:24:00.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb3643b5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb35c1346e0 0x7fb35c136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb3643b5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c137000 0x7fb35c1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb3643b5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c0a1640 con 0x7fb35c131980 2023-09-30T22:24:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb3643b5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c06eb30 con 0x7fb35c1346e0 2023-09-30T22:24:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb3643b5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c0a22d0 con 0x7fb35c137000 2023-09-30T22:24:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb361950700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb35c1346e0 0x7fb35c136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb361950700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb35c1346e0 0x7fb35c136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45622/0 (socket says 172.21.15.154:45622) 2023-09-30T22:24:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb362952700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c137000 0x7fb35c1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb361950700 1 -- 172.21.15.154:0/1508854635 learned_addr learned my addr 172.21.15.154:0/1508854635 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:00.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.249+0000 7fb361950700 1 -- 172.21.15.154:0/1508854635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c137000 msgr2=0x7fb35c1393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:00.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb361950700 1 --2- 172.21.15.154:0/1508854635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c137000 0x7fb35c1393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb361950700 1 -- 172.21.15.154:0/1508854635 >> v1:172.21.15.154:6789/0 conn(0x7fb35c131980 legacy=0x7fb35c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb361950700 1 -- 172.21.15.154:0/1508854635 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c131550 con 0x7fb35c1346e0 2023-09-30T22:24:00.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb362952700 1 --2- 172.21.15.154:0/1508854635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c137000 0x7fb35c1393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:00.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb361950700 1 --2- 172.21.15.154:0/1508854635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb35c1346e0 0x7fb35c136ac0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0098f0 tx=0x7fb34c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45e5575e902dc50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb36114f700 1 -- 172.21.15.154:0/1508854635 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c011830 con 0x7fb35c1346e0 2023-09-30T22:24:00.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb36114f700 1 -- 172.21.15.154:0/1508854635 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c011990 con 0x7fb35c1346e0 2023-09-30T22:24:00.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb36114f700 1 -- 172.21.15.154:0/1508854635 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c011d20 con 0x7fb35c1346e0 2023-09-30T22:24:00.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb3643b5700 1 -- 172.21.15.154:0/1508854635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb35c1346e0 msgr2=0x7fb35c136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb3643b5700 1 --2- 172.21.15.154:0/1508854635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb35c1346e0 0x7fb35c136ac0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0098f0 tx=0x7fb34c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:00.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb3643b5700 1 -- 172.21.15.154:0/1508854635 shutdown_connections 2023-09-30T22:24:00.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb3643b5700 1 --2- 172.21.15.154:0/1508854635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c137000 0x7fb35c1393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb3643b5700 1 --2- 172.21.15.154:0/1508854635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb35c1346e0 0x7fb35c136ac0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.250+0000 7fb3643b5700 1 -- 172.21.15.154:0/1508854635 >> 172.21.15.154:0/1508854635 conn(0x7fb35c0a2980 msgr2=0x7fb35c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.251+0000 7fb3643b5700 1 -- 172.21.15.154:0/1508854635 shutdown_connections 2023-09-30T22:24:00.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.251+0000 7fb3643b5700 1 -- 172.21.15.154:0/1508854635 wait complete. 2023-09-30T22:24:00.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.251+0000 7fb3643b5700 1 Processor -- start 2023-09-30T22:24:00.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.251+0000 7fb3643b5700 1 -- start start 2023-09-30T22:24:00.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb3643b5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c131980 0x7fb35c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb3643b5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb35c1346e0 0x7fb35c119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb3643b5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb35c137000 0x7fb35c119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:00.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb3643b5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c11b8f0 con 0x7fb35c137000 2023-09-30T22:24:00.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb3643b5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c09feb0 con 0x7fb35c131980 2023-09-30T22:24:00.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb3643b5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c136df0 con 0x7fb35c1346e0 2023-09-30T22:24:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb361950700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb35c1346e0 0x7fb35c119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb362151700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c131980 0x7fb35c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb361950700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb35c1346e0 0x7fb35c119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52396/0 (socket says 172.21.15.154:52396) 2023-09-30T22:24:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb361950700 1 -- 172.21.15.154:0/2391080491 learned_addr learned my addr 172.21.15.154:0/2391080491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb362952700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb35c137000 0x7fb35c119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb362151700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c131980 0x7fb35c118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55788/0 (socket says 172.21.15.154:55788) 2023-09-30T22:24:00.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb362151700 1 -- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb35c1346e0 msgr2=0x7fb35c119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb362151700 1 --2- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb35c1346e0 0x7fb35c119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb362151700 1 -- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb35c137000 msgr2=0x7fb35c119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb362151700 1 --2- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb35c137000 0x7fb35c119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb362151700 1 -- 172.21.15.154:0/2391080491 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354009a70 con 0x7fb35c131980 2023-09-30T22:24:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb361950700 1 --2- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb35c1346e0 0x7fb35c119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.252+0000 7fb362151700 1 --2- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c131980 0x7fb35c118df0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb358000fd0 tx=0x7fb35800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:00.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.253+0000 7fb352ffd700 1 -- 172.21.15.154:0/2391080491 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580054e0 con 0x7fb35c131980 2023-09-30T22:24:00.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.253+0000 7fb352ffd700 1 -- 172.21.15.154:0/2391080491 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35800ce40 con 0x7fb35c131980 2023-09-30T22:24:00.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.253+0000 7fb3643b5700 1 -- 172.21.15.154:0/2391080491 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c009550 con 0x7fb35c131980 2023-09-30T22:24:00.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.253+0000 7fb352ffd700 1 -- 172.21.15.154:0/2391080491 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580038a0 con 0x7fb35c131980 2023-09-30T22:24:00.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.253+0000 7fb3643b5700 1 -- 172.21.15.154:0/2391080491 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c11b350 con 0x7fb35c131980 2023-09-30T22:24:00.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.254+0000 7fb352ffd700 1 -- 172.21.15.154:0/2391080491 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb358003a00 con 0x7fb35c131980 2023-09-30T22:24:00.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.254+0000 7fb352ffd700 1 -- 172.21.15.154:0/2391080491 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb35803e9d0 con 0x7fb35c131980 2023-09-30T22:24:00.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.254+0000 7fb3643b5700 1 -- 172.21.15.154:0/2391080491 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c11a230 con 0x7fb35c131980 2023-09-30T22:24:00.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.258+0000 7fb352ffd700 1 -- 172.21.15.154:0/2391080491 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb358017080 con 0x7fb35c131980 2023-09-30T22:24:00.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.442+0000 7fb3643b5700 1 -- 172.21.15.154:0/2391080491 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb35c04f2a0 con 0x7fb35c131980 2023-09-30T22:24:00.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.443+0000 7fb352ffd700 1 -- 172.21.15.154:0/2391080491 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb358019b40 con 0x7fb35c131980 2023-09-30T22:24:00.443 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:00.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.444+0000 7fb3643b5700 1 -- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c131980 msgr2=0x7fb35c118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:00.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.444+0000 7fb3643b5700 1 --2- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c131980 0x7fb35c118df0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb358000fd0 tx=0x7fb35800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.445+0000 7fb3643b5700 1 -- 172.21.15.154:0/2391080491 shutdown_connections 2023-09-30T22:24:00.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.445+0000 7fb3643b5700 1 --2- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb35c137000 0x7fb35c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.445+0000 7fb3643b5700 1 --2- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb35c131980 0x7fb35c118df0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.445+0000 7fb3643b5700 1 --2- 172.21.15.154:0/2391080491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb35c1346e0 0x7fb35c119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:00.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.445+0000 7fb3643b5700 1 -- 172.21.15.154:0/2391080491 >> 172.21.15.154:0/2391080491 conn(0x7fb35c0a2980 msgr2=0x7fb35c133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:00.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.445+0000 7fb3643b5700 1 -- 172.21.15.154:0/2391080491 shutdown_connections 2023-09-30T22:24:00.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:00.445+0000 7fb3643b5700 1 -- 172.21.15.154:0/2391080491 wait complete. 2023-09-30T22:24:00.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:01.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:01.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:01.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:01.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.315+0000 7f12f95f7700 1 Processor -- start 2023-09-30T22:24:01.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.315+0000 7f12f95f7700 1 -- start start 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f95f7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12f406b250 0x7f12f4136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f95f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f4137140 0x7f12f4139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f95f7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f409da80 con 0x7f12f406a770 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f95f7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f409f770 con 0x7f12f406b250 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f95f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f409dce0 con 0x7f12f4137140 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f27fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12f406b250 0x7f12f4136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f27fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12f406b250 0x7f12f4136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45650/0 (socket says 172.21.15.154:45650) 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f27fc700 1 -- 172.21.15.154:0/700727043 learned_addr learned my addr 172.21.15.154:0/700727043 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f37fe700 1 --2- 172.21.15.154:0/700727043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f4137140 0x7f12f4139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f27fc700 1 -- 172.21.15.154:0/700727043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f4137140 msgr2=0x7f12f4139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f27fc700 1 --2- 172.21.15.154:0/700727043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f4137140 0x7f12f4139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f27fc700 1 -- 172.21.15.154:0/700727043 >> v1:172.21.15.154:6789/0 conn(0x7f12f406a770 legacy=0x7f12f406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f27fc700 1 -- 172.21.15.154:0/700727043 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f409eb20 con 0x7f12f406b250 2023-09-30T22:24:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f37fe700 1 --2- 172.21.15.154:0/700727043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f4137140 0x7f12f4139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f27fc700 1 --2- 172.21.15.154:0/700727043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f406b250 0x7f12f4136c00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f12e80098f0 tx=0x7f12e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990489590d9aa73a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.316+0000 7f12f1ffb700 1 -- 172.21.15.154:0/700727043 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8011830 con 0x7f12f406b250 2023-09-30T22:24:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f1ffb700 1 -- 172.21.15.154:0/700727043 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8011990 con 0x7f12f406b250 2023-09-30T22:24:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f1ffb700 1 -- 172.21.15.154:0/700727043 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8011d20 con 0x7f12f406b250 2023-09-30T22:24:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f95f7700 1 -- 172.21.15.154:0/700727043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f406b250 msgr2=0x7f12f4136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f95f7700 1 --2- 172.21.15.154:0/700727043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f406b250 0x7f12f4136c00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f12e80098f0 tx=0x7f12e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f95f7700 1 -- 172.21.15.154:0/700727043 shutdown_connections 2023-09-30T22:24:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f95f7700 1 --2- 172.21.15.154:0/700727043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f4137140 0x7f12f4139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f95f7700 1 --2- 172.21.15.154:0/700727043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f406b250 0x7f12f4136c00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f95f7700 1 -- 172.21.15.154:0/700727043 >> 172.21.15.154:0/700727043 conn(0x7f12f4099c40 msgr2=0x7f12f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f95f7700 1 -- 172.21.15.154:0/700727043 shutdown_connections 2023-09-30T22:24:01.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.317+0000 7f12f95f7700 1 -- 172.21.15.154:0/700727043 wait complete. 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.318+0000 7f12f95f7700 1 Processor -- start 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.318+0000 7f12f95f7700 1 -- start start 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f95f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12f406a770 0x7f12f409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f95f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f406b250 0x7f12f409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f95f7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f4137140 0x7f12f409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f95f7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f4126160 con 0x7f12f4137140 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f95f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f41368d0 con 0x7f12f406b250 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f95f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12f4136390 con 0x7f12f406a770 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12f406a770 0x7f12f409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12f406a770 0x7f12f409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52412/0 (socket says 172.21.15.154:52412) 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f2ffd700 1 -- 172.21.15.154:0/1686052467 learned_addr learned my addr 172.21.15.154:0/1686052467 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:01.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f37fe700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f4137140 0x7f12f409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f27fc700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f406b250 0x7f12f409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f2ffd700 1 -- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f406b250 msgr2=0x7f12f409a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f2ffd700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f406b250 0x7f12f409a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f2ffd700 1 -- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f4137140 msgr2=0x7f12f409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f2ffd700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f4137140 0x7f12f409af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f2ffd700 1 -- 172.21.15.154:0/1686052467 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec009a70 con 0x7f12f406a770 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.319+0000 7f12f37fe700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f4137140 0x7f12f409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.320+0000 7f12f2ffd700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12f406a770 0x7f12f409a490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f12e400c4e0 tx=0x7f12e400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.320+0000 7f12db7fe700 1 -- 172.21.15.154:0/1686052467 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40052d0 con 0x7f12f406a770 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.320+0000 7f12db7fe700 1 -- 172.21.15.154:0/1686052467 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e4005430 con 0x7f12f406a770 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.320+0000 7f12f95f7700 1 -- 172.21.15.154:0/1686052467 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e8009550 con 0x7f12f406a770 2023-09-30T22:24:01.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.320+0000 7f12db7fe700 1 -- 172.21.15.154:0/1686052467 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40038c0 con 0x7f12f406a770 2023-09-30T22:24:01.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.320+0000 7f12f95f7700 1 -- 172.21.15.154:0/1686052467 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f4126a60 con 0x7f12f406a770 2023-09-30T22:24:01.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.321+0000 7f12db7fe700 1 -- 172.21.15.154:0/1686052467 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12e4003a20 con 0x7f12f406a770 2023-09-30T22:24:01.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.321+0000 7f12f95f7700 1 -- 172.21.15.154:0/1686052467 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f404f2a0 con 0x7f12f406a770 2023-09-30T22:24:01.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.321+0000 7f12db7fe700 1 -- 172.21.15.154:0/1686052467 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f12e403eb20 con 0x7f12f406a770 2023-09-30T22:24:01.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.326+0000 7f12db7fe700 1 -- 172.21.15.154:0/1686052467 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12e4018260 con 0x7f12f406a770 2023-09-30T22:24:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.356+0000 7f1992275700 1 Processor -- start 2023-09-30T22:24:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.356+0000 7f2d01eb4700 1 Processor -- start 2023-09-30T22:24:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.356+0000 7f2d01eb4700 1 -- start start 2023-09-30T22:24:01.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.356+0000 7f1992275700 1 -- start start 2023-09-30T22:24:01.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f1992275700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09d860 0x7f198c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2d01eb4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2d01eb4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc0a1340 0x7f2cfc12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2d01eb4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2cfc1304a0 0x7f2cfc1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f1992275700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f198c130eb0 0x7f198c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2d01eb4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cfc130e30 con 0x7f2cfc1304a0 2023-09-30T22:24:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2d01eb4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0a1e70 con 0x7f2cfc0a1340 2023-09-30T22:24:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2d01eb4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc09a720 con 0x7f2cfc0a0a30 2023-09-30T22:24:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f1992275700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c09aaa0 con 0x7f198c09e170 2023-09-30T22:24:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f1992275700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198c09f870 con 0x7f198c130eb0 2023-09-30T22:24:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f1992275700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f198c09b360 con 0x7f198c09d860 2023-09-30T22:24:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52416/0 (socket says 172.21.15.154:52416) 2023-09-30T22:24:01.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfb7fe700 1 -- 172.21.15.154:0/3232180277 learned_addr learned my addr 172.21.15.154:0/3232180277 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f198bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09d860 0x7f198c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f198bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09d860 0x7f198c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52414/0 (socket says 172.21.15.154:52414) 2023-09-30T22:24:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f198bfff700 1 -- 172.21.15.154:0/3529374704 learned_addr learned my addr 172.21.15.154:0/3529374704 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfbfff700 1 --2- 172.21.15.154:0/3232180277 >> v2:172.21.15.154:3300/0 conn(0x7f2cfc1304a0 0x7f2cfc1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfb7fe700 1 -- 172.21.15.154:0/3232180277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc0a1340 msgr2=0x7f2cfc12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfb7fe700 1 --2- 172.21.15.154:0/3232180277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc0a1340 0x7f2cfc12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfb7fe700 1 -- 172.21.15.154:0/3232180277 >> v2:172.21.15.154:3300/0 conn(0x7f2cfc1304a0 msgr2=0x7f2cfc1308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfb7fe700 1 --2- 172.21.15.154:0/3232180277 >> v2:172.21.15.154:3300/0 conn(0x7f2cfc1304a0 0x7f2cfc1308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfb7fe700 1 -- 172.21.15.154:0/3232180277 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc09b300 con 0x7f2cfc0a0a30 2023-09-30T22:24:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f1990812700 1 --2- 172.21.15.154:0/3529374704 >> v2:172.21.15.154:3300/0 conn(0x7f198c130eb0 0x7f198c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.357+0000 7f2cfb7fe700 1 --2- 172.21.15.154:0/3232180277 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc0a0e00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2cec006fd0 tx=0x7f2cec009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a24a9b8317389d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f2cfa7fc700 1 -- 172.21.15.154:0/3232180277 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec005e30 con 0x7f2cfc0a0a30 2023-09-30T22:24:01.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f1990812700 1 -- 172.21.15.154:0/3529374704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09d860 msgr2=0x7f198c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f1990812700 1 --2- 172.21.15.154:0/3529374704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09d860 0x7f198c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f1990812700 1 -- 172.21.15.154:0/3529374704 >> v1:172.21.15.154:6789/0 conn(0x7f198c09e170 legacy=0x7f198c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f1990812700 1 -- 172.21.15.154:0/3529374704 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c09b620 con 0x7f198c130eb0 2023-09-30T22:24:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f2cfa7fc700 1 -- 172.21.15.154:0/3232180277 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec004030 con 0x7f2cfc0a0a30 2023-09-30T22:24:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f2cfa7fc700 1 -- 172.21.15.154:0/3232180277 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0043e0 con 0x7f2cfc0a0a30 2023-09-30T22:24:01.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f1990812700 1 --2- 172.21.15.154:0/3529374704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c130eb0 0x7f198c138a00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f198400bfa0 tx=0x7f198400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3223015667ffdb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f198affd700 1 -- 172.21.15.154:0/3529374704 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984010070 con 0x7f198c130eb0 2023-09-30T22:24:01.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f198affd700 1 -- 172.21.15.154:0/3529374704 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198400b2e0 con 0x7f198c130eb0 2023-09-30T22:24:01.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.358+0000 7f198affd700 1 -- 172.21.15.154:0/3529374704 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400dcf0 con 0x7f198c130eb0 2023-09-30T22:24:01.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f2d01eb4700 1 -- 172.21.15.154:0/3232180277 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 msgr2=0x7f2cfc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f1992275700 1 -- 172.21.15.154:0/3529374704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c130eb0 msgr2=0x7f198c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f2d01eb4700 1 --2- 172.21.15.154:0/3232180277 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc0a0e00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2cec006fd0 tx=0x7f2cec009bd0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f1992275700 1 --2- 172.21.15.154:0/3529374704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c130eb0 0x7f198c138a00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f198400bfa0 tx=0x7f198400d330 comp rx=0 tx=0).stop 2023-09-30T22:24:01.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f1992275700 1 -- 172.21.15.154:0/3529374704 shutdown_connections 2023-09-30T22:24:01.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f1992275700 1 --2- 172.21.15.154:0/3529374704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c130eb0 0x7f198c138a00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f1992275700 1 --2- 172.21.15.154:0/3529374704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09d860 0x7f198c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f1992275700 1 -- 172.21.15.154:0/3529374704 >> 172.21.15.154:0/3529374704 conn(0x7f198c099c40 msgr2=0x7f198c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f2d01eb4700 1 -- 172.21.15.154:0/3232180277 shutdown_connections 2023-09-30T22:24:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f2d01eb4700 1 --2- 172.21.15.154:0/3232180277 >> v2:172.21.15.154:3300/0 conn(0x7f2cfc1304a0 0x7f2cfc1308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f2d01eb4700 1 --2- 172.21.15.154:0/3232180277 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc0a0e00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f2d01eb4700 1 --2- 172.21.15.154:0/3232180277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc0a1340 0x7f2cfc12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f2d01eb4700 1 -- 172.21.15.154:0/3232180277 >> 172.21.15.154:0/3232180277 conn(0x7f2cfc0a2980 msgr2=0x7f2cfc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f1992275700 1 -- 172.21.15.154:0/3529374704 shutdown_connections 2023-09-30T22:24:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f1992275700 1 -- 172.21.15.154:0/3529374704 wait complete. 2023-09-30T22:24:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f2d01eb4700 1 -- 172.21.15.154:0/3232180277 shutdown_connections 2023-09-30T22:24:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.359+0000 7f2d01eb4700 1 -- 172.21.15.154:0/3232180277 wait complete. 2023-09-30T22:24:01.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f1992275700 1 Processor -- start 2023-09-30T22:24:01.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f2d01eb4700 1 Processor -- start 2023-09-30T22:24:01.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f1992275700 1 -- start start 2023-09-30T22:24:01.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f2d01eb4700 1 -- start start 2023-09-30T22:24:01.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f1992275700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c09d860 0x7f198c11e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f1992275700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09e170 0x7f198c11e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f1992275700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f198c130eb0 0x7f198c11eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f2d01eb4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc1c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f2d01eb4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cfc0a1340 0x7f2cfc1c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f1992275700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1217f0 con 0x7f198c09d860 2023-09-30T22:24:01.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f1992275700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c11f8e0 con 0x7f198c130eb0 2023-09-30T22:24:01.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f1992275700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f198c120680 con 0x7f198c09e170 2023-09-30T22:24:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f2d01eb4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc1304a0 0x7f2cfc1c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f2d01eb4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc11f670 con 0x7f2cfc0a1340 2023-09-30T22:24:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f2d01eb4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc120e30 con 0x7f2cfc1304a0 2023-09-30T22:24:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.360+0000 7f2d01eb4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc09f1c0 con 0x7f2cfc0a0a30 2023-09-30T22:24:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc1c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc1c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52430/0 (socket says 172.21.15.154:52430) 2023-09-30T22:24:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfb7fe700 1 -- 172.21.15.154:0/2852289465 learned_addr learned my addr 172.21.15.154:0/2852289465 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c09d860 0x7f198c11e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c09d860 0x7f198c11e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45694/0 (socket says 172.21.15.154:45694) 2023-09-30T22:24:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198bfff700 1 -- 172.21.15.154:0/2353865558 learned_addr learned my addr 172.21.15.154:0/2353865558 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198b7fe700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09e170 0x7f198c11e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f1990812700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f198c130eb0 0x7f198c11eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfbfff700 1 --2- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc1304a0 0x7f2cfc1c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfaffd700 1 --2- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cfc0a1340 0x7f2cfc1c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfbfff700 1 -- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 msgr2=0x7f2cfc1c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfbfff700 1 --2- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc1c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfbfff700 1 -- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cfc0a1340 msgr2=0x7f2cfc1c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfbfff700 1 --2- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cfc0a1340 0x7f2cfc1c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfbfff700 1 -- 172.21.15.154:0/2852289465 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec009500 con 0x7f2cfc1304a0 2023-09-30T22:24:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198b7fe700 1 -- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f198c130eb0 msgr2=0x7f198c11eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198b7fe700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f198c130eb0 0x7f198c11eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198b7fe700 1 -- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c09d860 msgr2=0x7f198c11e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198b7fe700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c09d860 0x7f198c11e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198b7fe700 1 -- 172.21.15.154:0/2353865558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198400bc80 con 0x7f198c09e170 2023-09-30T22:24:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198bfff700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c09d860 0x7f198c11e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f2cfbfff700 1 --2- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc1304a0 0x7f2cfc1c8d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400efc0 tx=0x7f2cf400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.361+0000 7f198b7fe700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09e170 0x7f198c11e990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f198c09a100 tx=0x7f197c001a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f1988ff9700 1 -- 172.21.15.154:0/2353865558 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c013070 con 0x7f198c09e170 2023-09-30T22:24:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f1988ff9700 1 -- 172.21.15.154:0/2353865558 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c00e2e0 con 0x7f198c09e170 2023-09-30T22:24:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f2ce3fff700 1 -- 172.21.15.154:0/2852289465 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400cd40 con 0x7f2cfc1304a0 2023-09-30T22:24:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f1992275700 1 -- 172.21.15.154:0/2353865558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c072100 con 0x7f198c09e170 2023-09-30T22:24:01.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f2ce3fff700 1 -- 172.21.15.154:0/2852289465 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf400f040 con 0x7f2cfc1304a0 2023-09-30T22:24:01.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f1988ff9700 1 -- 172.21.15.154:0/2353865558 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0052f0 con 0x7f198c09e170 2023-09-30T22:24:01.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f2d01eb4700 1 -- 172.21.15.154:0/2852289465 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cfc09ae00 con 0x7f2cfc1304a0 2023-09-30T22:24:01.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f1992275700 1 -- 172.21.15.154:0/2353865558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c121c90 con 0x7f198c09e170 2023-09-30T22:24:01.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f2d01eb4700 1 -- 172.21.15.154:0/2852289465 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc1234d0 con 0x7f2cfc1304a0 2023-09-30T22:24:01.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.362+0000 7f2ce3fff700 1 -- 172.21.15.154:0/2852289465 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40146c0 con 0x7f2cfc1304a0 2023-09-30T22:24:01.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.363+0000 7f2ce3fff700 1 -- 172.21.15.154:0/2852289465 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cf4014820 con 0x7f2cfc1304a0 2023-09-30T22:24:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.363+0000 7f1992275700 1 -- 172.21.15.154:0/2353865558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c121e80 con 0x7f198c09e170 2023-09-30T22:24:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.363+0000 7f2ce3fff700 1 -- 172.21.15.154:0/2852289465 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2cf4040480 con 0x7f2cfc1304a0 2023-09-30T22:24:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.363+0000 7f2d01eb4700 1 -- 172.21.15.154:0/2852289465 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc0052e0 con 0x7f2cfc1304a0 2023-09-30T22:24:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.364+0000 7f1988ff9700 1 -- 172.21.15.154:0/2353865558 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f197c003680 con 0x7f198c09e170 2023-09-30T22:24:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.364+0000 7f1988ff9700 1 -- 172.21.15.154:0/2353865558 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f197c042d10 con 0x7f198c09e170 2023-09-30T22:24:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.368+0000 7f1988ff9700 1 -- 172.21.15.154:0/2353865558 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f197c048020 con 0x7f198c09e170 2023-09-30T22:24:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.368+0000 7f2ce3fff700 1 -- 172.21.15.154:0/2852289465 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cf4009e60 con 0x7f2cfc1304a0 2023-09-30T22:24:01.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:01.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.523+0000 7f12f95f7700 1 -- 172.21.15.154:0/1686052467 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f12f406c3b0 con 0x7f12f406a770 2023-09-30T22:24:01.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.524+0000 7f12db7fe700 1 -- 172.21.15.154:0/1686052467 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12e4017070 con 0x7f12f406a770 2023-09-30T22:24:01.525 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:01.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.526+0000 7f12f95f7700 1 -- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12f406a770 msgr2=0x7f12f409a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.526+0000 7f12f95f7700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12f406a770 0x7f12f409a490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f12e400c4e0 tx=0x7f12e400c8a0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.526+0000 7f12f95f7700 1 -- 172.21.15.154:0/1686052467 shutdown_connections 2023-09-30T22:24:01.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.526+0000 7f12f95f7700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f4137140 0x7f12f409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.526+0000 7f12f95f7700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12f406a770 0x7f12f409a490 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.526+0000 7f12f95f7700 1 --2- 172.21.15.154:0/1686052467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12f406b250 0x7f12f409a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.526+0000 7f12f95f7700 1 -- 172.21.15.154:0/1686052467 >> 172.21.15.154:0/1686052467 conn(0x7f12f4099c40 msgr2=0x7f12f406ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.526+0000 7f12f95f7700 1 -- 172.21.15.154:0/1686052467 shutdown_connections 2023-09-30T22:24:01.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.526+0000 7f12f95f7700 1 -- 172.21.15.154:0/1686052467 wait complete. 2023-09-30T22:24:01.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:01.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.565+0000 7f2d01eb4700 1 -- 172.21.15.154:0/2852289465 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2cdc005150 con 0x7f2cfc1304a0 2023-09-30T22:24:01.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.565+0000 7f2ce3fff700 1 -- 172.21.15.154:0/2852289465 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cf4012340 con 0x7f2cfc1304a0 2023-09-30T22:24:01.566 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:01.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f1992275700 1 -- 172.21.15.154:0/2353865558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f198c04f2a0 con 0x7f198c09e170 2023-09-30T22:24:01.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f2d01eb4700 1 -- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc1304a0 msgr2=0x7f2cfc1c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f2d01eb4700 1 --2- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc1304a0 0x7f2cfc1c8d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400efc0 tx=0x7f2cf400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f2d01eb4700 1 -- 172.21.15.154:0/2852289465 shutdown_connections 2023-09-30T22:24:01.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f2d01eb4700 1 --2- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cfc1304a0 0x7f2cfc1c8d20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f2d01eb4700 1 --2- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2cfc0a0a30 0x7f2cfc1c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f2d01eb4700 1 --2- 172.21.15.154:0/2852289465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cfc0a1340 0x7f2cfc1c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f2d01eb4700 1 -- 172.21.15.154:0/2852289465 >> 172.21.15.154:0/2852289465 conn(0x7f2cfc0a2980 msgr2=0x7f2cfc1b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f2d01eb4700 1 -- 172.21.15.154:0/2852289465 shutdown_connections 2023-09-30T22:24:01.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f2d01eb4700 1 -- 172.21.15.154:0/2852289465 wait complete. 2023-09-30T22:24:01.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.567+0000 7f1988ff9700 1 -- 172.21.15.154:0/2353865558 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f197c005450 con 0x7f198c09e170 2023-09-30T22:24:01.570 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:01.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.570+0000 7f1992275700 1 -- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09e170 msgr2=0x7f198c11e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.570+0000 7f1992275700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09e170 0x7f198c11e990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f198c09a100 tx=0x7f197c001a40 comp rx=0 tx=0).stop 2023-09-30T22:24:01.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.572+0000 7f1992275700 1 -- 172.21.15.154:0/2353865558 shutdown_connections 2023-09-30T22:24:01.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.572+0000 7f1992275700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f198c130eb0 0x7f198c11eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.572+0000 7f1992275700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c09d860 0x7f198c11e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.572+0000 7f1992275700 1 --2- 172.21.15.154:0/2353865558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f198c09e170 0x7f198c11e990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.572+0000 7f1992275700 1 -- 172.21.15.154:0/2353865558 >> 172.21.15.154:0/2353865558 conn(0x7f198c099c40 msgr2=0x7f198c070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.572+0000 7f1992275700 1 -- 172.21.15.154:0/2353865558 shutdown_connections 2023-09-30T22:24:01.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.572+0000 7f1992275700 1 -- 172.21.15.154:0/2353865558 wait complete. 2023-09-30T22:24:01.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:01.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:01.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.589+0000 7fc7721d3700 1 Processor -- start 2023-09-30T22:24:01.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.589+0000 7fc7721d3700 1 -- start start 2023-09-30T22:24:01.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.589+0000 7fc7721d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c133ad0 0x7fc76c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.589+0000 7fc7721d3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.589+0000 7fc7721d3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c06b2d0 con 0x7fc76c1309f0 2023-09-30T22:24:01.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc7721d3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c133610 con 0x7fc76c1300a0 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc7721d3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c09a500 con 0x7fc76c133ad0 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c133ad0 0x7fc76c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc76c1309f0 0x7fc76c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60010/0 (socket says 172.21.15.154:60010) 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76bfff700 1 -- 172.21.15.154:0/1959537857 learned_addr learned my addr 172.21.15.154:0/1959537857 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c133ad0 0x7fc76c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52434/0 (socket says 172.21.15.154:52434) 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76affd700 1 --2- 172.21.15.154:0/1959537857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76affd700 1 -- 172.21.15.154:0/1959537857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c133ad0 msgr2=0x7fc76c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76affd700 1 --2- 172.21.15.154:0/1959537857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c133ad0 0x7fc76c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76affd700 1 -- 172.21.15.154:0/1959537857 >> v1:172.21.15.154:6789/0 conn(0x7fc76c1309f0 legacy=0x7fc76c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76affd700 1 -- 172.21.15.154:0/1959537857 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c1338b0 con 0x7fc76c1300a0 2023-09-30T22:24:01.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76b7fe700 1 --2- 172.21.15.154:0/1959537857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c133ad0 0x7fc76c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76a7fc700 1 -- 172.21.15.154:0/1959537857 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377399963 0 0) 0x7fc76c06b2d0 con 0x7fc76c1309f0 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76affd700 1 --2- 172.21.15.154:0/1959537857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c1304b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc760009870 tx=0x7fc760009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b1aae045cc3ee70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76a7fc700 1 -- 172.21.15.154:0/1959537857 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760011830 con 0x7fc76c1300a0 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76a7fc700 1 -- 172.21.15.154:0/1959537857 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc760011990 con 0x7fc76c1300a0 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.590+0000 7fc76a7fc700 1 -- 172.21.15.154:0/1959537857 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760011d20 con 0x7fc76c1300a0 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.591+0000 7fc7721d3700 1 -- 172.21.15.154:0/1959537857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 msgr2=0x7fc76c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.591+0000 7fc7721d3700 1 --2- 172.21.15.154:0/1959537857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c1304b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc760009870 tx=0x7fc760009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.591+0000 7fc7721d3700 1 -- 172.21.15.154:0/1959537857 shutdown_connections 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.591+0000 7fc7721d3700 1 --2- 172.21.15.154:0/1959537857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c133ad0 0x7fc76c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.591+0000 7fc7721d3700 1 --2- 172.21.15.154:0/1959537857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c1304b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.591+0000 7fc7721d3700 1 -- 172.21.15.154:0/1959537857 >> 172.21.15.154:0/1959537857 conn(0x7fc76c099c40 msgr2=0x7fc76c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.591+0000 7fc7721d3700 1 -- 172.21.15.154:0/1959537857 shutdown_connections 2023-09-30T22:24:01.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.591+0000 7fc7721d3700 1 -- 172.21.15.154:0/1959537857 wait complete. 2023-09-30T22:24:01.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc7721d3700 1 Processor -- start 2023-09-30T22:24:01.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc7721d3700 1 -- start start 2023-09-30T22:24:01.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc7721d3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc7721d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c1309f0 0x7fc76c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc7721d3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c133ad0 0x7fc76c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:01.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc7721d3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c12d7a0 con 0x7fc76c133ad0 2023-09-30T22:24:01.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc7721d3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0a3390 con 0x7fc76c1300a0 2023-09-30T22:24:01.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc7721d3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c12dd00 con 0x7fc76c1309f0 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc76affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c1309f0 0x7fc76c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c1309f0 0x7fc76c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52442/0 (socket says 172.21.15.154:52442) 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76affd700 1 -- 172.21.15.154:0/2619309391 learned_addr learned my addr 172.21.15.154:0/2619309391 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76b7fe700 1 --2- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.592+0000 7fc76bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c133ad0 0x7fc76c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76affd700 1 -- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 msgr2=0x7fc76c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76affd700 1 --2- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76affd700 1 -- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c133ad0 msgr2=0x7fc76c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76affd700 1 --2- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c133ad0 0x7fc76c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76affd700 1 -- 172.21.15.154:0/2619309391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0094a0 con 0x7fc76c1309f0 2023-09-30T22:24:01.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76b7fe700 1 --2- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:01.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc76affd700 1 --2- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c1309f0 0x7fc76c11df80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc760009840 tx=0x7fc760004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:01.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc753fff700 1 -- 172.21.15.154:0/2619309391 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760004510 con 0x7fc76c1309f0 2023-09-30T22:24:01.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc753fff700 1 -- 172.21.15.154:0/2619309391 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76001e070 con 0x7fc76c1309f0 2023-09-30T22:24:01.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc7721d3700 1 -- 172.21.15.154:0/2619309391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7600094a0 con 0x7fc76c1309f0 2023-09-30T22:24:01.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc753fff700 1 -- 172.21.15.154:0/2619309391 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600038e0 con 0x7fc76c1309f0 2023-09-30T22:24:01.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.593+0000 7fc7721d3700 1 -- 172.21.15.154:0/2619309391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c120440 con 0x7fc76c1309f0 2023-09-30T22:24:01.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.594+0000 7fc753fff700 1 -- 172.21.15.154:0/2619309391 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc760003a40 con 0x7fc76c1309f0 2023-09-30T22:24:01.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.594+0000 7fc753fff700 1 -- 172.21.15.154:0/2619309391 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc760020070 con 0x7fc76c1309f0 2023-09-30T22:24:01.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.594+0000 7fc7721d3700 1 -- 172.21.15.154:0/2619309391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c11fdf0 con 0x7fc76c1309f0 2023-09-30T22:24:01.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.599+0000 7fc753fff700 1 -- 172.21.15.154:0/2619309391 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc760015070 con 0x7fc76c1309f0 2023-09-30T22:24:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.782+0000 7fc7721d3700 1 -- 172.21.15.154:0/2619309391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc76c04f2a0 con 0x7fc76c1309f0 2023-09-30T22:24:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.782+0000 7fc753fff700 1 -- 172.21.15.154:0/2619309391 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc760015070 con 0x7fc76c1309f0 2023-09-30T22:24:01.784 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.784+0000 7fc7721d3700 1 -- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c1309f0 msgr2=0x7fc76c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.784+0000 7fc7721d3700 1 --2- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c1309f0 0x7fc76c11df80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc760009840 tx=0x7fc760004750 comp rx=0 tx=0).stop 2023-09-30T22:24:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.784+0000 7fc7721d3700 1 -- 172.21.15.154:0/2619309391 shutdown_connections 2023-09-30T22:24:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.784+0000 7fc7721d3700 1 --2- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76c133ad0 0x7fc76c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.784+0000 7fc7721d3700 1 --2- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76c1300a0 0x7fc76c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.784+0000 7fc7721d3700 1 --2- 172.21.15.154:0/2619309391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76c1309f0 0x7fc76c11df80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.784+0000 7fc7721d3700 1 -- 172.21.15.154:0/2619309391 >> 172.21.15.154:0/2619309391 conn(0x7fc76c099c40 msgr2=0x7fc76c132b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.785+0000 7fc7721d3700 1 -- 172.21.15.154:0/2619309391 shutdown_connections 2023-09-30T22:24:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:01.785+0000 7fc7721d3700 1 -- 172.21.15.154:0/2619309391 wait complete. 2023-09-30T22:24:01.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:02.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:02.582 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:02.586 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:02.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.679+0000 7f597980c700 1 Processor -- start 2023-09-30T22:24:02.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.679+0000 7f597980c700 1 -- start start 2023-09-30T22:24:02.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f597980c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f597409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f597980c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f597409e170 0x7f59741307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f597980c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597409aaa0 con 0x7f5974130ce0 2023-09-30T22:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f597980c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597409f870 con 0x7f597409e170 2023-09-30T22:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f597980c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f597409b360 con 0x7f597409d860 2023-09-30T22:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f59727fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f597409e170 0x7f59741307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f59727fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f597409e170 0x7f59741307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55866/0 (socket says 172.21.15.154:55866) 2023-09-30T22:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f59737fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5974130ce0 0x7f59741379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60012/0 (socket says 172.21.15.154:60012) 2023-09-30T22:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f59727fc700 1 -- 172.21.15.154:0/2741487423 learned_addr learned my addr 172.21.15.154:0/2741487423 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:02.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f5972ffd700 1 --2- 172.21.15.154:0/2741487423 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f597409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f5972ffd700 1 -- 172.21.15.154:0/2741487423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f597409e170 msgr2=0x7f59741307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:02.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f5972ffd700 1 --2- 172.21.15.154:0/2741487423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f597409e170 0x7f59741307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f5972ffd700 1 -- 172.21.15.154:0/2741487423 >> v1:172.21.15.154:6789/0 conn(0x7f5974130ce0 legacy=0x7f59741379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f5971ffb700 1 -- 172.21.15.154:0/2741487423 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014501631 0 0) 0x7f597409aaa0 con 0x7f5974130ce0 2023-09-30T22:24:02.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f5972ffd700 1 -- 172.21.15.154:0/2741487423 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597409b620 con 0x7f597409d860 2023-09-30T22:24:02.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.680+0000 7f5972ffd700 1 --2- 172.21.15.154:0/2741487423 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f597409dc30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5964009870 tx=0x7f5964009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f73a5f4858216d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f5971ffb700 1 -- 172.21.15.154:0/2741487423 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964011830 con 0x7f597409d860 2023-09-30T22:24:02.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f5971ffb700 1 -- 172.21.15.154:0/2741487423 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964011990 con 0x7f597409d860 2023-09-30T22:24:02.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f5971ffb700 1 -- 172.21.15.154:0/2741487423 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964011d20 con 0x7f597409d860 2023-09-30T22:24:02.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f597980c700 1 -- 172.21.15.154:0/2741487423 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 msgr2=0x7f597409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f597980c700 1 --2- 172.21.15.154:0/2741487423 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f597409dc30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5964009870 tx=0x7f5964009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:02.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f597980c700 1 -- 172.21.15.154:0/2741487423 shutdown_connections 2023-09-30T22:24:02.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f597980c700 1 --2- 172.21.15.154:0/2741487423 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f597409dc30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f597980c700 1 --2- 172.21.15.154:0/2741487423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f597409e170 0x7f59741307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f597980c700 1 -- 172.21.15.154:0/2741487423 >> 172.21.15.154:0/2741487423 conn(0x7f5974099c40 msgr2=0x7f59740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f597980c700 1 -- 172.21.15.154:0/2741487423 shutdown_connections 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.681+0000 7f597980c700 1 -- 172.21.15.154:0/2741487423 wait complete. 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.682+0000 7f597980c700 1 Processor -- start 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f597980c700 1 -- start start 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f597980c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f5974135600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f597980c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f597409e170 0x7f5974135b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f597980c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5974130ce0 0x7f5974136080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f597980c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974139140 con 0x7f597409e170 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f597980c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59740a0660 con 0x7f5974130ce0 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f597980c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5974138b30 con 0x7f597409d860 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f59727fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f597409e170 0x7f5974135b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f59727fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f597409e170 0x7f5974135b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45722/0 (socket says 172.21.15.154:45722) 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f59727fc700 1 -- 172.21.15.154:0/836676573 learned_addr learned my addr 172.21.15.154:0/836676573 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f59737fe700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5974130ce0 0x7f5974136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f5972ffd700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f5974135600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f59737fe700 1 -- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 msgr2=0x7f5974135600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f59737fe700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f5974135600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.683+0000 7f59737fe700 1 -- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f597409e170 msgr2=0x7f5974135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f59737fe700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f597409e170 0x7f5974135b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f59737fe700 1 -- 172.21.15.154:0/836676573 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640094a0 con 0x7f5974130ce0 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f5972ffd700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f5974135600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f59727fc700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f597409e170 0x7f5974135b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f59737fe700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5974130ce0 0x7f5974136080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f596c00ef80 tx=0x7f596c010330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f595bfff700 1 -- 172.21.15.154:0/836676573 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c013070 con 0x7f5974130ce0 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f595bfff700 1 -- 172.21.15.154:0/836676573 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c0109d0 con 0x7f5974130ce0 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f597980c700 1 -- 172.21.15.154:0/836676573 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5974138df0 con 0x7f5974130ce0 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f595bfff700 1 -- 172.21.15.154:0/836676573 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c010d60 con 0x7f5974130ce0 2023-09-30T22:24:02.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.684+0000 7f597980c700 1 -- 172.21.15.154:0/836676573 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59741379b0 con 0x7f5974130ce0 2023-09-30T22:24:02.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.685+0000 7f595bfff700 1 -- 172.21.15.154:0/836676573 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f596c0070d0 con 0x7f5974130ce0 2023-09-30T22:24:02.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.685+0000 7f595bfff700 1 -- 172.21.15.154:0/836676573 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f596c0435d0 con 0x7f5974130ce0 2023-09-30T22:24:02.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.685+0000 7f597980c700 1 -- 172.21.15.154:0/836676573 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597404f2a0 con 0x7f5974130ce0 2023-09-30T22:24:02.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.694+0000 7f595bfff700 1 -- 172.21.15.154:0/836676573 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f596c01e030 con 0x7f5974130ce0 2023-09-30T22:24:02.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.721+0000 7f13b6512700 1 Processor -- start 2023-09-30T22:24:02.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13b6512700 1 -- start start 2023-09-30T22:24:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13b6512700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b009f350 0x7f13b0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13b6512700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13b01393a0 0x7f13b013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13b6512700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b009fa00 con 0x7f13b009e870 2023-09-30T22:24:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13b6512700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b00a0370 con 0x7f13b01393a0 2023-09-30T22:24:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13b6512700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13b006bec0 con 0x7f13b009f350 2023-09-30T22:24:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13affff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f13b009e870 0x7f13b009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60020/0 (socket says 172.21.15.154:60020) 2023-09-30T22:24:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13af7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b009f350 0x7f13b0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13affff700 1 -- 172.21.15.154:0/3316078268 learned_addr learned my addr 172.21.15.154:0/3316078268 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:02.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13b4aaf700 1 --2- 172.21.15.154:0/3316078268 >> v2:172.21.15.154:3300/0 conn(0x7f13b01393a0 0x7f13b013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13aeffd700 1 -- 172.21.15.154:0/3316078268 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697642365 0 0) 0x7f13b009fa00 con 0x7f13b009e870 2023-09-30T22:24:02.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.722+0000 7f13aeffd700 1 -- 172.21.15.154:0/3316078268 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13980035b0 con 0x7f13b009e870 2023-09-30T22:24:02.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.723+0000 7f13af7fe700 1 -- 172.21.15.154:0/3316078268 >> v2:172.21.15.154:3300/0 conn(0x7f13b01393a0 msgr2=0x7f13b013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:02.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.723+0000 7f13af7fe700 1 --2- 172.21.15.154:0/3316078268 >> v2:172.21.15.154:3300/0 conn(0x7f13b01393a0 0x7f13b013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.723+0000 7f13af7fe700 1 -- 172.21.15.154:0/3316078268 >> v1:172.21.15.154:6789/0 conn(0x7f13b009e870 legacy=0x7f13b009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.723+0000 7f13af7fe700 1 -- 172.21.15.154:0/3316078268 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b009ada0 con 0x7f13b009f350 2023-09-30T22:24:02.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.723+0000 7f13b4aaf700 1 --2- 172.21.15.154:0/3316078268 >> v2:172.21.15.154:3300/0 conn(0x7f13b01393a0 0x7f13b013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.723+0000 7f13af7fe700 1 --2- 172.21.15.154:0/3316078268 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b009f350 0x7f13b0138e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009840 tx=0x7f13a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=457c6608be2d25d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.723+0000 7f13aeffd700 1 -- 172.21.15.154:0/3316078268 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4011830 con 0x7f13b009f350 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.723+0000 7f13aeffd700 1 -- 172.21.15.154:0/3316078268 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4011990 con 0x7f13b009f350 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.723+0000 7f13aeffd700 1 -- 172.21.15.154:0/3316078268 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4011d20 con 0x7f13b009f350 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.724+0000 7f13b6512700 1 -- 172.21.15.154:0/3316078268 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b009f350 msgr2=0x7f13b0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.724+0000 7f13b6512700 1 --2- 172.21.15.154:0/3316078268 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b009f350 0x7f13b0138e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009840 tx=0x7f13a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.724+0000 7f13b6512700 1 -- 172.21.15.154:0/3316078268 shutdown_connections 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.724+0000 7f13b6512700 1 --2- 172.21.15.154:0/3316078268 >> v2:172.21.15.154:3300/0 conn(0x7f13b01393a0 0x7f13b013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.724+0000 7f13b6512700 1 --2- 172.21.15.154:0/3316078268 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b009f350 0x7f13b0138e60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.724+0000 7f13b6512700 1 -- 172.21.15.154:0/3316078268 >> 172.21.15.154:0/3316078268 conn(0x7f13b00a4430 msgr2=0x7f13b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.724+0000 7f13b6512700 1 -- 172.21.15.154:0/3316078268 shutdown_connections 2023-09-30T22:24:02.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.724+0000 7f13b6512700 1 -- 172.21.15.154:0/3316078268 wait complete. 2023-09-30T22:24:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.725+0000 7f13b6512700 1 Processor -- start 2023-09-30T22:24:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.725+0000 7f13b6512700 1 -- start start 2023-09-30T22:24:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13b6512700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b009e870 0x7f13b01208d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13b6512700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13b009f350 0x7f13b0120e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13b6512700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b01393a0 0x7f13b0121350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13b6512700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0122680 con 0x7f13b009e870 2023-09-30T22:24:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13b6512700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0122490 con 0x7f13b009f350 2023-09-30T22:24:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13b6512700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13b006cfa0 con 0x7f13b01393a0 2023-09-30T22:24:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13affff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b009e870 0x7f13b01208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13affff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b009e870 0x7f13b01208d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45728/0 (socket says 172.21.15.154:45728) 2023-09-30T22:24:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13b4aaf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b01393a0 0x7f13b0121350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13affff700 1 -- 172.21.15.154:0/2252332129 learned_addr learned my addr 172.21.15.154:0/2252332129 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.726+0000 7f13af7fe700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13b009f350 0x7f13b0120e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13affff700 1 -- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b01393a0 msgr2=0x7f13b0121350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13affff700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b01393a0 0x7f13b0121350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13affff700 1 -- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13b009f350 msgr2=0x7f13b0120e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13affff700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13b009f350 0x7f13b0120e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13affff700 1 -- 172.21.15.154:0/2252332129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a8009a70 con 0x7f13b009e870 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13b4aaf700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b01393a0 0x7f13b0121350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13af7fe700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13b009f350 0x7f13b0120e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13affff700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b009e870 0x7f13b01208d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c4d0 tx=0x7f13a000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13acff9700 1 -- 172.21.15.154:0/2252332129 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000cea0 con 0x7f13b009e870 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13acff9700 1 -- 172.21.15.154:0/2252332129 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a0005d70 con 0x7f13b009e870 2023-09-30T22:24:02.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13acff9700 1 -- 172.21.15.154:0/2252332129 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a00072f0 con 0x7f13b009e870 2023-09-30T22:24:02.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13b6512700 1 -- 172.21.15.154:0/2252332129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a40094a0 con 0x7f13b009e870 2023-09-30T22:24:02.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.727+0000 7f13b6512700 1 -- 172.21.15.154:0/2252332129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b01240c0 con 0x7f13b009e870 2023-09-30T22:24:02.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.728+0000 7f13acff9700 1 -- 172.21.15.154:0/2252332129 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13a0007450 con 0x7f13b009e870 2023-09-30T22:24:02.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.728+0000 7f13acff9700 1 -- 172.21.15.154:0/2252332129 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f13a003eab0 con 0x7f13b009e870 2023-09-30T22:24:02.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.728+0000 7f13b6512700 1 -- 172.21.15.154:0/2252332129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b0123f20 con 0x7f13b009e870 2023-09-30T22:24:02.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.733+0000 7f13acff9700 1 -- 172.21.15.154:0/2252332129 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13b0123f20 con 0x7f13b009e870 2023-09-30T22:24:02.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.758+0000 7fac05a57700 1 Processor -- start 2023-09-30T22:24:02.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.758+0000 7fac05a57700 1 -- start start 2023-09-30T22:24:02.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fac05a57700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac00138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fac05a57700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac00139200 0x7fac0013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fac05a57700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0009e9d0 con 0x7fac000a0a70 2023-09-30T22:24:02.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fac05a57700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0009dc00 con 0x7fac00139200 2023-09-30T22:24:02.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fac05a57700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0009dec0 con 0x7fac000a1550 2023-09-30T22:24:02.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfe7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac00138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfeffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fac000a0a70 0x7fac000a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60026/0 (socket says 172.21.15.154:60026) 2023-09-30T22:24:02.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfe7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac00138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55880/0 (socket says 172.21.15.154:55880) 2023-09-30T22:24:02.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfeffd700 1 -- 172.21.15.154:0/136061021 learned_addr learned my addr 172.21.15.154:0/136061021 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:02.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabff7fe700 1 --2- 172.21.15.154:0/136061021 >> v2:172.21.15.154:3300/0 conn(0x7fac00139200 0x7fac0013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfe7fc700 1 -- 172.21.15.154:0/136061021 >> v2:172.21.15.154:3300/0 conn(0x7fac00139200 msgr2=0x7fac0013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:02.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfe7fc700 1 --2- 172.21.15.154:0/136061021 >> v2:172.21.15.154:3300/0 conn(0x7fac00139200 0x7fac0013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfe7fc700 1 -- 172.21.15.154:0/136061021 >> v1:172.21.15.154:6789/0 conn(0x7fac000a0a70 legacy=0x7fac000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfe7fc700 1 -- 172.21.15.154:0/136061021 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0009e6a0 con 0x7fac000a1550 2023-09-30T22:24:02.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabff7fe700 1 --2- 172.21.15.154:0/136061021 >> v2:172.21.15.154:3300/0 conn(0x7fac00139200 0x7fac0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfe7fc700 1 --2- 172.21.15.154:0/136061021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac00138cc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009840 tx=0x7fabf4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a959dc09efb74d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfdffb700 1 -- 172.21.15.154:0/136061021 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4011830 con 0x7fac000a1550 2023-09-30T22:24:02.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfdffb700 1 -- 172.21.15.154:0/136061021 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf4011990 con 0x7fac000a1550 2023-09-30T22:24:02.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.759+0000 7fabfdffb700 1 -- 172.21.15.154:0/136061021 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4011d20 con 0x7fac000a1550 2023-09-30T22:24:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.760+0000 7fac05a57700 1 -- 172.21.15.154:0/136061021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 msgr2=0x7fac00138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.760+0000 7fac05a57700 1 --2- 172.21.15.154:0/136061021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac00138cc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009840 tx=0x7fabf4009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.760+0000 7fac05a57700 1 -- 172.21.15.154:0/136061021 shutdown_connections 2023-09-30T22:24:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.760+0000 7fac05a57700 1 --2- 172.21.15.154:0/136061021 >> v2:172.21.15.154:3300/0 conn(0x7fac00139200 0x7fac0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.760+0000 7fac05a57700 1 --2- 172.21.15.154:0/136061021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac00138cc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.760+0000 7fac05a57700 1 -- 172.21.15.154:0/136061021 >> 172.21.15.154:0/136061021 conn(0x7fac000a6610 msgr2=0x7fac000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.760+0000 7fac05a57700 1 -- 172.21.15.154:0/136061021 shutdown_connections 2023-09-30T22:24:02.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.760+0000 7fac05a57700 1 -- 172.21.15.154:0/136061021 wait complete. 2023-09-30T22:24:02.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.761+0000 7fac05a57700 1 Processor -- start 2023-09-30T22:24:02.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fac05a57700 1 -- start start 2023-09-30T22:24:02.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fac05a57700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac000a0a70 0x7fac0011e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fac05a57700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac0011eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fac05a57700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac00139200 0x7fac0011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fac05a57700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac001224a0 con 0x7fac00139200 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fac05a57700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac001220a0 con 0x7fac000a1550 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fac05a57700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac00121af0 con 0x7fac000a0a70 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fabfeffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac000a0a70 0x7fac0011e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fabfeffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac000a0a70 0x7fac0011e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52484/0 (socket says 172.21.15.154:52484) 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fabfeffd700 1 -- 172.21.15.154:0/1692262206 learned_addr learned my addr 172.21.15.154:0/1692262206 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.762+0000 7fabfe7fc700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac0011eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabff7fe700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac00139200 0x7fac0011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabfe7fc700 1 -- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac000a0a70 msgr2=0x7fac0011e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabfe7fc700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac000a0a70 0x7fac0011e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabfe7fc700 1 -- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac00139200 msgr2=0x7fac0011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabfe7fc700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac00139200 0x7fac0011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabfe7fc700 1 -- 172.21.15.154:0/1692262206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf8009a70 con 0x7fac000a1550 2023-09-30T22:24:02.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabfeffd700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac000a0a70 0x7fac0011e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabfe7fc700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac0011eda0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fabf4016000 tx=0x7fabf4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabe7fff700 1 -- 172.21.15.154:0/1692262206 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf40045d0 con 0x7fac000a1550 2023-09-30T22:24:02.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabe7fff700 1 -- 172.21.15.154:0/1692262206 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf401f070 con 0x7fac000a1550 2023-09-30T22:24:02.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fabe7fff700 1 -- 172.21.15.154:0/1692262206 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf40038e0 con 0x7fac000a1550 2023-09-30T22:24:02.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fac05a57700 1 -- 172.21.15.154:0/1692262206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf40094a0 con 0x7fac000a1550 2023-09-30T22:24:02.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.763+0000 7fac05a57700 1 -- 172.21.15.154:0/1692262206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac00120580 con 0x7fac000a1550 2023-09-30T22:24:02.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.764+0000 7fabe7fff700 1 -- 172.21.15.154:0/1692262206 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabf4003a40 con 0x7fac000a1550 2023-09-30T22:24:02.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.764+0000 7fac05a57700 1 -- 172.21.15.154:0/1692262206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac00121d40 con 0x7fac000a1550 2023-09-30T22:24:02.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.764+0000 7fabe7fff700 1 -- 172.21.15.154:0/1692262206 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fabf4021070 con 0x7fac000a1550 2023-09-30T22:24:02.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.769+0000 7fabe7fff700 1 -- 172.21.15.154:0/1692262206 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac00121d40 con 0x7fac000a1550 2023-09-30T22:24:02.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:02.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.898+0000 7f597980c700 1 -- 172.21.15.154:0/836676573 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f597406c3b0 con 0x7f5974130ce0 2023-09-30T22:24:02.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.898+0000 7f595bfff700 1 -- 172.21.15.154:0/836676573 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f596c018980 con 0x7f5974130ce0 2023-09-30T22:24:02.900 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:02.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.902+0000 7f597980c700 1 -- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5974130ce0 msgr2=0x7f5974136080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.902+0000 7f597980c700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5974130ce0 0x7f5974136080 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f596c00ef80 tx=0x7f596c010330 comp rx=0 tx=0).stop 2023-09-30T22:24:02.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.903+0000 7f597980c700 1 -- 172.21.15.154:0/836676573 shutdown_connections 2023-09-30T22:24:02.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.903+0000 7f597980c700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5974130ce0 0x7f5974136080 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.903+0000 7f597980c700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f597409d860 0x7f5974135600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.903+0000 7f597980c700 1 --2- 172.21.15.154:0/836676573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f597409e170 0x7f5974135b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.903+0000 7f597980c700 1 -- 172.21.15.154:0/836676573 >> 172.21.15.154:0/836676573 conn(0x7f5974099c40 msgr2=0x7f5974139500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.904+0000 7f597980c700 1 -- 172.21.15.154:0/836676573 shutdown_connections 2023-09-30T22:24:02.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.906+0000 7f597980c700 1 -- 172.21.15.154:0/836676573 wait complete. 2023-09-30T22:24:02.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.930+0000 7f13b6512700 1 -- 172.21.15.154:0/2252332129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13b0123f20 con 0x7f13b009e870 2023-09-30T22:24:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.931+0000 7f13acff9700 1 -- 172.21.15.154:0/2252332129 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13b0123f20 con 0x7f13b009e870 2023-09-30T22:24:02.932 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f13b6512700 1 -- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b009e870 msgr2=0x7f13b01208d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f13b6512700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b009e870 0x7f13b01208d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c4d0 tx=0x7f13a000c7e0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f13b6512700 1 -- 172.21.15.154:0/2252332129 shutdown_connections 2023-09-30T22:24:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f13b6512700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f13b01393a0 0x7f13b0121350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f13b6512700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13b009e870 0x7f13b01208d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f13b6512700 1 --2- 172.21.15.154:0/2252332129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13b009f350 0x7f13b0120e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f13b6512700 1 -- 172.21.15.154:0/2252332129 >> 172.21.15.154:0/2252332129 conn(0x7f13b00a4430 msgr2=0x7f13b0071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f13b6512700 1 -- 172.21.15.154:0/2252332129 shutdown_connections 2023-09-30T22:24:02.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f13b6512700 1 -- 172.21.15.154:0/2252332129 wait complete. 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f9db7a41700 1 Processor -- start 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.933+0000 7f9db7a41700 1 -- start start 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.934+0000 7f9db7a41700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9db0133900 0x7f9db0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.934+0000 7f9db7a41700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0134210 0x7f9db00a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.934+0000 7f9db7a41700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db009a760 con 0x7f9db00a0ee0 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.934+0000 7f9db7a41700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db01336e0 con 0x7f9db0133900 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.934+0000 7f9db7a41700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9db009a080 con 0x7f9db0134210 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.934+0000 7f9db4fdc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0134210 0x7f9db00a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.934+0000 7f9db4fdc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0134210 0x7f9db00a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52500/0 (socket says 172.21.15.154:52500) 2023-09-30T22:24:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.934+0000 7f9db4fdc700 1 -- 172.21.15.154:0/2911311676 learned_addr learned my addr 172.21.15.154:0/2911311676 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.934+0000 7f9db57dd700 1 --2- 172.21.15.154:0/2911311676 >> v2:172.21.15.154:3300/0 conn(0x7f9db0133900 0x7f9db0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.935+0000 7f9db57dd700 1 -- 172.21.15.154:0/2911311676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0134210 msgr2=0x7f9db00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.935+0000 7f9db57dd700 1 --2- 172.21.15.154:0/2911311676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0134210 0x7f9db00a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.935+0000 7f9db57dd700 1 -- 172.21.15.154:0/2911311676 >> v1:172.21.15.154:6789/0 conn(0x7f9db00a0ee0 legacy=0x7f9db013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.935+0000 7f9db57dd700 1 -- 172.21.15.154:0/2911311676 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00a23e0 con 0x7f9db0133900 2023-09-30T22:24:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.935+0000 7f9db4fdc700 1 --2- 172.21.15.154:0/2911311676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0134210 0x7f9db00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.935+0000 7f9db57dd700 1 --2- 172.21.15.154:0/2911311676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0133900 0x7f9db0133cd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009820 tx=0x7f9dac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33333dd205730c85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.935+0000 7f9da7fff700 1 -- 172.21.15.154:0/2911311676 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac005e30 con 0x7f9db0133900 2023-09-30T22:24:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.935+0000 7f9da7fff700 1 -- 172.21.15.154:0/2911311676 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac006030 con 0x7f9db0133900 2023-09-30T22:24:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.935+0000 7f9da7fff700 1 -- 172.21.15.154:0/2911311676 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0063c0 con 0x7f9db0133900 2023-09-30T22:24:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.936+0000 7f9db7a41700 1 -- 172.21.15.154:0/2911311676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0133900 msgr2=0x7f9db0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.936+0000 7f9db7a41700 1 --2- 172.21.15.154:0/2911311676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0133900 0x7f9db0133cd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009820 tx=0x7f9dac009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.936+0000 7f9db7a41700 1 -- 172.21.15.154:0/2911311676 shutdown_connections 2023-09-30T22:24:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.936+0000 7f9db7a41700 1 --2- 172.21.15.154:0/2911311676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0133900 0x7f9db0133cd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.936+0000 7f9db7a41700 1 --2- 172.21.15.154:0/2911311676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0134210 0x7f9db00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.936+0000 7f9db7a41700 1 -- 172.21.15.154:0/2911311676 >> 172.21.15.154:0/2911311676 conn(0x7f9db00a2980 msgr2=0x7f9db00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.936+0000 7f9db7a41700 1 -- 172.21.15.154:0/2911311676 shutdown_connections 2023-09-30T22:24:02.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.936+0000 7f9db7a41700 1 -- 172.21.15.154:0/2911311676 wait complete. 2023-09-30T22:24:02.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.937+0000 7f9db7a41700 1 Processor -- start 2023-09-30T22:24:02.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.937+0000 7f9db7a41700 1 -- start start 2023-09-30T22:24:02.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.937+0000 7f9db7a41700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00a0ee0 0x7f9db011da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.937+0000 7f9db7a41700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133900 0x7f9db011dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.937+0000 7f9db7a41700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0134210 0x7f9db011e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:02.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.937+0000 7f9db7a41700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db01214d0 con 0x7f9db00a0ee0 2023-09-30T22:24:02.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.937+0000 7f9db7a41700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db009a330 con 0x7f9db0134210 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.937+0000 7f9db7a41700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0132e40 con 0x7f9db0133900 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.937+0000 7f9db57dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00a0ee0 0x7f9db011da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db57dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00a0ee0 0x7f9db011da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45756/0 (socket says 172.21.15.154:45756) 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db57dd700 1 -- 172.21.15.154:0/3575356115 learned_addr learned my addr 172.21.15.154:0/3575356115 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db5fde700 1 --2- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0134210 0x7f9db011e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db4fdc700 1 --2- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133900 0x7f9db011dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db57dd700 1 -- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133900 msgr2=0x7f9db011dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db57dd700 1 --2- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133900 0x7f9db011dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db57dd700 1 -- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0134210 msgr2=0x7f9db011e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db57dd700 1 --2- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0134210 0x7f9db011e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db57dd700 1 -- 172.21.15.154:0/3575356115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da0009550 con 0x7f9db00a0ee0 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db57dd700 1 --2- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00a0ee0 0x7f9db011da90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9dac000c00 tx=0x7f9dac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9da5ffb700 1 -- 172.21.15.154:0/3575356115 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0063a0 con 0x7f9db00a0ee0 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9da5ffb700 1 -- 172.21.15.154:0/3575356115 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac020070 con 0x7f9db00a0ee0 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db7a41700 1 -- 172.21.15.154:0/3575356115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac009430 con 0x7f9db00a0ee0 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9da5ffb700 1 -- 172.21.15.154:0/3575356115 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac006760 con 0x7f9db00a0ee0 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.938+0000 7f9db7a41700 1 -- 172.21.15.154:0/3575356115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db0120f30 con 0x7f9db00a0ee0 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.939+0000 7f9da5ffb700 1 -- 172.21.15.154:0/3575356115 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dac022030 con 0x7f9db00a0ee0 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.939+0000 7f9da5ffb700 1 -- 172.21.15.154:0/3575356115 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9dac040bc0 con 0x7f9db00a0ee0 2023-09-30T22:24:02.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.940+0000 7f9db7a41700 1 -- 172.21.15.154:0/3575356115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db011a590 con 0x7f9db00a0ee0 2023-09-30T22:24:02.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:02.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.949+0000 7f9da5ffb700 1 -- 172.21.15.154:0/3575356115 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dac0193b0 con 0x7f9db00a0ee0 2023-09-30T22:24:02.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.974+0000 7fac05a57700 1 -- 172.21.15.154:0/1692262206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fac00121d40 con 0x7fac000a1550 2023-09-30T22:24:02.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.974+0000 7fabe7fff700 1 -- 172.21.15.154:0/1692262206 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac00121d40 con 0x7fac000a1550 2023-09-30T22:24:02.975 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:02.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.977+0000 7fac05a57700 1 -- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 msgr2=0x7fac0011eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:02.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.977+0000 7fac05a57700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac0011eda0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fabf4016000 tx=0x7fabf4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:02.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.977+0000 7fac05a57700 1 -- 172.21.15.154:0/1692262206 shutdown_connections 2023-09-30T22:24:02.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.977+0000 7fac05a57700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac00139200 0x7fac0011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.977+0000 7fac05a57700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac000a0a70 0x7fac0011e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.977+0000 7fac05a57700 1 --2- 172.21.15.154:0/1692262206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac000a1550 0x7fac0011eda0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:02.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.977+0000 7fac05a57700 1 -- 172.21.15.154:0/1692262206 >> 172.21.15.154:0/1692262206 conn(0x7fac000a6610 msgr2=0x7fac001381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:02.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.977+0000 7fac05a57700 1 -- 172.21.15.154:0/1692262206 shutdown_connections 2023-09-30T22:24:02.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:02.977+0000 7fac05a57700 1 -- 172.21.15.154:0/1692262206 wait complete. 2023-09-30T22:24:02.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:03.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.137+0000 7f9db7a41700 1 -- 172.21.15.154:0/3575356115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9db01bb420 con 0x7f9db00a0ee0 2023-09-30T22:24:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.138+0000 7f9da5ffb700 1 -- 172.21.15.154:0/3575356115 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dac01cc00 con 0x7f9db00a0ee0 2023-09-30T22:24:03.141 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:03.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.140+0000 7f9db7a41700 1 -- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00a0ee0 msgr2=0x7f9db011da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:03.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.140+0000 7f9db7a41700 1 --2- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00a0ee0 0x7f9db011da90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9dac000c00 tx=0x7f9dac004750 comp rx=0 tx=0).stop 2023-09-30T22:24:03.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.140+0000 7f9db7a41700 1 -- 172.21.15.154:0/3575356115 shutdown_connections 2023-09-30T22:24:03.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.140+0000 7f9db7a41700 1 --2- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0134210 0x7f9db011e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.140+0000 7f9db7a41700 1 --2- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00a0ee0 0x7f9db011da90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.140+0000 7f9db7a41700 1 --2- 172.21.15.154:0/3575356115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133900 0x7f9db011dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:03.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.140+0000 7f9db7a41700 1 -- 172.21.15.154:0/3575356115 >> 172.21.15.154:0/3575356115 conn(0x7f9db00a2980 msgr2=0x7f9db01bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:03.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.140+0000 7f9db7a41700 1 -- 172.21.15.154:0/3575356115 shutdown_connections 2023-09-30T22:24:03.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:03.140+0000 7f9db7a41700 1 -- 172.21.15.154:0/3575356115 wait complete. 2023-09-30T22:24:03.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:03.925 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:03.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:03.991 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:04.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.063+0000 7f3c6f9dd700 1 Processor -- start 2023-09-30T22:24:04.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.063+0000 7f3c6f9dd700 1 -- start start 2023-09-30T22:24:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.064+0000 7f3c6f9dd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c6806a770 0x7f3c6806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.064+0000 7f3c6f9dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.064+0000 7f3c6f9dd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6806e900 con 0x7f3c6809dec0 2023-09-30T22:24:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.064+0000 7f3c6f9dd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6809d180 con 0x7f3c6806a770 2023-09-30T22:24:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.064+0000 7f3c6f9dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6809e780 con 0x7f3c68136cb0 2023-09-30T22:24:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.064+0000 7f3c6d779700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c6806a770 0x7f3c6806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.064+0000 7f3c6d779700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c6806a770 0x7f3c6806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45770/0 (socket says 172.21.15.154:45770) 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.064+0000 7f3c6d779700 1 -- 172.21.15.154:0/1591815700 learned_addr learned my addr 172.21.15.154:0/1591815700 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.064+0000 7f3c6df7a700 1 --2- 172.21.15.154:0/1591815700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c6d779700 1 -- 172.21.15.154:0/1591815700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 msgr2=0x7f3c68139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c6d779700 1 --2- 172.21.15.154:0/1591815700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c6d779700 1 -- 172.21.15.154:0/1591815700 >> v1:172.21.15.154:6789/0 conn(0x7f3c6809dec0 legacy=0x7f3c6806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c6d779700 1 -- 172.21.15.154:0/1591815700 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6809d3c0 con 0x7f3c6806a770 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c5ffff700 1 -- 172.21.15.154:0/1591815700 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650380720 0 0) 0x7f3c6806e900 con 0x7f3c6809dec0 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c6df7a700 1 --2- 172.21.15.154:0/1591815700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c6d779700 1 --2- 172.21.15.154:0/1591815700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6806a770 0x7f3c6806ab40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3c640098f0 tx=0x7f3c64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca346e1147ab05f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c5ffff700 1 -- 172.21.15.154:0/1591815700 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64011830 con 0x7f3c6806a770 2023-09-30T22:24:04.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c5ffff700 1 -- 172.21.15.154:0/1591815700 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c64011990 con 0x7f3c6806a770 2023-09-30T22:24:04.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.065+0000 7f3c5ffff700 1 -- 172.21.15.154:0/1591815700 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64011d20 con 0x7f3c6806a770 2023-09-30T22:24:04.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.066+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1591815700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6806a770 msgr2=0x7f3c6806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.066+0000 7f3c6f9dd700 1 --2- 172.21.15.154:0/1591815700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6806a770 0x7f3c6806ab40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3c640098f0 tx=0x7f3c64009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.066+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1591815700 shutdown_connections 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.066+0000 7f3c6f9dd700 1 --2- 172.21.15.154:0/1591815700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.066+0000 7f3c6f9dd700 1 --2- 172.21.15.154:0/1591815700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6806a770 0x7f3c6806ab40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.066+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1591815700 >> 172.21.15.154:0/1591815700 conn(0x7f3c68099c40 msgr2=0x7f3c680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.066+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1591815700 shutdown_connections 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.066+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1591815700 wait complete. 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6f9dd700 1 Processor -- start 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6f9dd700 1 -- start start 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6f9dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c6806a770 0x7f3c681343e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6f9dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6809dec0 0x7f3c68134920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6f9dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68134e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6f9dd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68135840 con 0x7f3c6809dec0 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6f9dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68136170 con 0x7f3c68136cb0 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6f9dd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68131280 con 0x7f3c6806a770 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6df7a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68134e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.067+0000 7f3c6d779700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c6806a770 0x7f3c681343e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6df7a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68134e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55918/0 (socket says 172.21.15.154:55918) 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6df7a700 1 -- 172.21.15.154:0/1072833467 learned_addr learned my addr 172.21.15.154:0/1072833467 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6cf78700 1 --2- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6809dec0 0x7f3c68134920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6cf78700 1 -- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c6806a770 msgr2=0x7f3c681343e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6cf78700 1 --2- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c6806a770 0x7f3c681343e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6cf78700 1 -- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 msgr2=0x7f3c68134e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6cf78700 1 --2- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68134e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6cf78700 1 -- 172.21.15.154:0/1072833467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c60009a70 con 0x7f3c6809dec0 2023-09-30T22:24:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6df7a700 1 --2- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68134e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6cf78700 1 --2- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6809dec0 0x7f3c68134920 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c460 tx=0x7f3c5800c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c5dffb700 1 -- 172.21.15.154:0/1072833467 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580054e0 con 0x7f3c6809dec0 2023-09-30T22:24:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c5dffb700 1 -- 172.21.15.154:0/1072833467 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5800ce30 con 0x7f3c6809dec0 2023-09-30T22:24:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c5dffb700 1 -- 172.21.15.154:0/1072833467 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580038c0 con 0x7f3c6809dec0 2023-09-30T22:24:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.068+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1072833467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c64009550 con 0x7f3c6809dec0 2023-09-30T22:24:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.069+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1072833467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c68071ce0 con 0x7f3c6809dec0 2023-09-30T22:24:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.069+0000 7f3c5dffb700 1 -- 172.21.15.154:0/1072833467 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c58003a20 con 0x7f3c6809dec0 2023-09-30T22:24:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.069+0000 7f3c5dffb700 1 -- 172.21.15.154:0/1072833467 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3c5803ea00 con 0x7f3c6809dec0 2023-09-30T22:24:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.070+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1072833467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6804f2a0 con 0x7f3c6809dec0 2023-09-30T22:24:04.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.074+0000 7f3c5dffb700 1 -- 172.21.15.154:0/1072833467 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c58017080 con 0x7f3c6809dec0 2023-09-30T22:24:04.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.105+0000 7f00ad3b8700 1 Processor -- start 2023-09-30T22:24:04.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.105+0000 7f00ad3b8700 1 -- start start 2023-09-30T22:24:04.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00ad3b8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8133ad0 0x7f00a8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00ad3b8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00a8130bc0 0x7f00a813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00ad3b8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a806b2d0 con 0x7f00a81300a0 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00ad3b8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a8133610 con 0x7f00a8130bc0 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00ad3b8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a809a500 con 0x7f00a8133ad0 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8133ad0 0x7f00a8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00a8130bc0 0x7f00a813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8133ad0 0x7f00a8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55926/0 (socket says 172.21.15.154:55926) 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00a8130bc0 0x7f00a813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45796/0 (socket says 172.21.15.154:45796) 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a6ffd700 1 -- 172.21.15.154:0/394623018 learned_addr learned my addr 172.21.15.154:0/394623018 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a77fe700 1 -- 172.21.15.154:0/394623018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8133ad0 msgr2=0x7f00a8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a77fe700 1 --2- 172.21.15.154:0/394623018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8133ad0 0x7f00a8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a77fe700 1 -- 172.21.15.154:0/394623018 >> v1:172.21.15.154:6789/0 conn(0x7f00a81300a0 legacy=0x7f00a81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a77fe700 1 -- 172.21.15.154:0/394623018 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a81338b0 con 0x7f00a8130bc0 2023-09-30T22:24:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a5ffb700 1 -- 172.21.15.154:0/394623018 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570673960 0 0) 0x7f00a806b2d0 con 0x7f00a81300a0 2023-09-30T22:24:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.106+0000 7f00a77fe700 1 --2- 172.21.15.154:0/394623018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8130bc0 0x7f00a813b990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009d90 tx=0x7f00a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d07edbbf2f3525e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00a5ffb700 1 -- 172.21.15.154:0/394623018 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000e070 con 0x7f00a8130bc0 2023-09-30T22:24:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00a5ffb700 1 -- 172.21.15.154:0/394623018 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a000bb20 con 0x7f00a8130bc0 2023-09-30T22:24:04.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00a5ffb700 1 -- 172.21.15.154:0/394623018 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0012430 con 0x7f00a8130bc0 2023-09-30T22:24:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00ad3b8700 1 -- 172.21.15.154:0/394623018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8130bc0 msgr2=0x7f00a813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00ad3b8700 1 --2- 172.21.15.154:0/394623018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8130bc0 0x7f00a813b990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009d90 tx=0x7f00a000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00ad3b8700 1 -- 172.21.15.154:0/394623018 shutdown_connections 2023-09-30T22:24:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00ad3b8700 1 --2- 172.21.15.154:0/394623018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8130bc0 0x7f00a813b990 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00ad3b8700 1 --2- 172.21.15.154:0/394623018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8133ad0 0x7f00a8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00ad3b8700 1 -- 172.21.15.154:0/394623018 >> 172.21.15.154:0/394623018 conn(0x7f00a8099c40 msgr2=0x7f00a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00ad3b8700 1 -- 172.21.15.154:0/394623018 shutdown_connections 2023-09-30T22:24:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.107+0000 7f00ad3b8700 1 -- 172.21.15.154:0/394623018 wait complete. 2023-09-30T22:24:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.108+0000 7f00ad3b8700 1 Processor -- start 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.108+0000 7f00ad3b8700 1 -- start start 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00ad3b8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a81300a0 0x7f00a811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00ad3b8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8130bc0 0x7f00a811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00ad3b8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8133ad0 0x7f00a811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00ad3b8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a811fce0 con 0x7f00a8133ad0 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00ad3b8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a812d980 con 0x7f00a8130bc0 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00ad3b8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00a812f6f0 con 0x7f00a81300a0 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8130bc0 0x7f00a811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8130bc0 0x7f00a811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55936/0 (socket says 172.21.15.154:55936) 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8133ad0 0x7f00a811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a67fc700 1 -- 172.21.15.154:0/274522422 learned_addr learned my addr 172.21.15.154:0/274522422 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a6ffd700 1 --2- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a81300a0 0x7f00a811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a77fe700 1 -- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a81300a0 msgr2=0x7f00a811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a77fe700 1 --2- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a81300a0 0x7f00a811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a77fe700 1 -- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8130bc0 msgr2=0x7f00a811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a77fe700 1 --2- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8130bc0 0x7f00a811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a77fe700 1 -- 172.21.15.154:0/274522422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0009a70 con 0x7f00a8133ad0 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.109+0000 7f00a67fc700 1 --2- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8130bc0 0x7f00a811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.110+0000 7f00a77fe700 1 --2- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8133ad0 0x7f00a811e4c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f00a0016000 tx=0x7f00a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.110+0000 7f008f7fe700 1 -- 172.21.15.154:0/274522422 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0012430 con 0x7f00a8133ad0 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.110+0000 7f008f7fe700 1 -- 172.21.15.154:0/274522422 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a0020070 con 0x7f00a8133ad0 2023-09-30T22:24:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.110+0000 7f00ad3b8700 1 -- 172.21.15.154:0/274522422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a812dd00 con 0x7f00a8133ad0 2023-09-30T22:24:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.110+0000 7f008f7fe700 1 -- 172.21.15.154:0/274522422 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0004280 con 0x7f00a8133ad0 2023-09-30T22:24:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.110+0000 7f00ad3b8700 1 -- 172.21.15.154:0/274522422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a81208c0 con 0x7f00a8133ad0 2023-09-30T22:24:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.111+0000 7f008f7fe700 1 -- 172.21.15.154:0/274522422 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00a00043e0 con 0x7f00a8133ad0 2023-09-30T22:24:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.111+0000 7f008f7fe700 1 -- 172.21.15.154:0/274522422 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00a0022070 con 0x7f00a8133ad0 2023-09-30T22:24:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.112+0000 7f00ad3b8700 1 -- 172.21.15.154:0/274522422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a806be10 con 0x7f00a8133ad0 2023-09-30T22:24:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.116+0000 7f008f7fe700 1 -- 172.21.15.154:0/274522422 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00a0004870 con 0x7f00a8133ad0 2023-09-30T22:24:04.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.140+0000 7f8a99590700 1 Processor -- start 2023-09-30T22:24:04.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.140+0000 7f8a99590700 1 -- start start 2023-09-30T22:24:04.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a99590700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a0a70 0x7f8a940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a99590700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a1380 0x7f8a94133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a99590700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9409dc00 con 0x7f8a94133f50 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a99590700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9409ea60 con 0x7f8a940a1380 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a99590700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9409dec0 con 0x7f8a940a0a70 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a92ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a0a70 0x7f8a940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a92ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a0a70 0x7f8a940a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52546/0 (socket says 172.21.15.154:52546) 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a92ffd700 1 -- 172.21.15.154:0/1497689003 learned_addr learned my addr 172.21.15.154:0/1497689003 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a927fc700 1 --2- 172.21.15.154:0/1497689003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a1380 0x7f8a94133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a927fc700 1 -- 172.21.15.154:0/1497689003 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a0a70 msgr2=0x7f8a940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:04.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a927fc700 1 --2- 172.21.15.154:0/1497689003 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a0a70 0x7f8a940a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a927fc700 1 -- 172.21.15.154:0/1497689003 >> v1:172.21.15.154:6789/0 conn(0x7f8a94133f50 legacy=0x7f8a9413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.141+0000 7f8a927fc700 1 -- 172.21.15.154:0/1497689003 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9409e6a0 con 0x7f8a940a1380 2023-09-30T22:24:04.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.142+0000 7f8a927fc700 1 --2- 172.21.15.154:0/1497689003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a1380 0x7f8a94133a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8a88009870 tx=0x7f8a88009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8046aa44bd90946c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.142+0000 7f8a91ffb700 1 -- 172.21.15.154:0/1497689003 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88011830 con 0x7f8a940a1380 2023-09-30T22:24:04.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.142+0000 7f8a91ffb700 1 -- 172.21.15.154:0/1497689003 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a88011990 con 0x7f8a940a1380 2023-09-30T22:24:04.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.142+0000 7f8a91ffb700 1 -- 172.21.15.154:0/1497689003 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88011d20 con 0x7f8a940a1380 2023-09-30T22:24:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.142+0000 7f8a99590700 1 -- 172.21.15.154:0/1497689003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a1380 msgr2=0x7f8a94133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.142+0000 7f8a99590700 1 --2- 172.21.15.154:0/1497689003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a1380 0x7f8a94133a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8a88009870 tx=0x7f8a88009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.143+0000 7f8a99590700 1 -- 172.21.15.154:0/1497689003 shutdown_connections 2023-09-30T22:24:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.143+0000 7f8a99590700 1 --2- 172.21.15.154:0/1497689003 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a0a70 0x7f8a940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.143+0000 7f8a99590700 1 --2- 172.21.15.154:0/1497689003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a1380 0x7f8a94133a10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.143+0000 7f8a99590700 1 -- 172.21.15.154:0/1497689003 >> 172.21.15.154:0/1497689003 conn(0x7f8a940a6610 msgr2=0x7f8a940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.143+0000 7f8a99590700 1 -- 172.21.15.154:0/1497689003 shutdown_connections 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.143+0000 7f8a99590700 1 -- 172.21.15.154:0/1497689003 wait complete. 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a99590700 1 Processor -- start 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a99590700 1 -- start start 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a99590700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a0a70 0x7f8a941240c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a99590700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a1380 0x7f8a941c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a99590700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a94133f50 0x7f8a941c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a99590700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94126c20 con 0x7f8a94133f50 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a99590700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940a03e0 con 0x7f8a940a0a70 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a99590700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94125e80 con 0x7f8a940a1380 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a927fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a1380 0x7f8a941c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a94133f50 0x7f8a941c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a927fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a1380 0x7f8a941c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52560/0 (socket says 172.21.15.154:52560) 2023-09-30T22:24:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a927fc700 1 -- 172.21.15.154:0/747570295 learned_addr learned my addr 172.21.15.154:0/747570295 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.144+0000 7f8a92ffd700 1 --2- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a0a70 0x7f8a941240c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a937fe700 1 -- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a1380 msgr2=0x7f8a941c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a937fe700 1 --2- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a1380 0x7f8a941c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a937fe700 1 -- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a0a70 msgr2=0x7f8a941240c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a937fe700 1 --2- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a0a70 0x7f8a941240c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a937fe700 1 -- 172.21.15.154:0/747570295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a880094a0 con 0x7f8a94133f50 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a927fc700 1 --2- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a1380 0x7f8a941c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a937fe700 1 --2- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a94133f50 0x7f8a941c5e90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00cb90 tx=0x7f8a8c00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a7b7fe700 1 -- 172.21.15.154:0/747570295 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c003c00 con 0x7f8a94133f50 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a7b7fe700 1 -- 172.21.15.154:0/747570295 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c003d60 con 0x7f8a94133f50 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a99590700 1 -- 172.21.15.154:0/747570295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a941265a0 con 0x7f8a94133f50 2023-09-30T22:24:04.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a7b7fe700 1 -- 172.21.15.154:0/747570295 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00aa80 con 0x7f8a94133f50 2023-09-30T22:24:04.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.145+0000 7f8a99590700 1 -- 172.21.15.154:0/747570295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a94124c30 con 0x7f8a94133f50 2023-09-30T22:24:04.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.146+0000 7f8a7b7fe700 1 -- 172.21.15.154:0/747570295 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a8c00abe0 con 0x7f8a94133f50 2023-09-30T22:24:04.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.146+0000 7f8a7b7fe700 1 -- 172.21.15.154:0/747570295 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a8c03f530 con 0x7f8a94133f50 2023-09-30T22:24:04.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.146+0000 7f8a99590700 1 -- 172.21.15.154:0/747570295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a94124e20 con 0x7f8a94133f50 2023-09-30T22:24:04.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.151+0000 7f8a7b7fe700 1 -- 172.21.15.154:0/747570295 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a8c0198f0 con 0x7f8a94133f50 2023-09-30T22:24:04.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:04.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.273+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1072833467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c6809e3a0 con 0x7f3c6809dec0 2023-09-30T22:24:04.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.274+0000 7f3c5dffb700 1 -- 172.21.15.154:0/1072833467 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c58019b20 con 0x7f3c6809dec0 2023-09-30T22:24:04.275 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:04.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.276+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6809dec0 msgr2=0x7f3c68134920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.276+0000 7f3c6f9dd700 1 --2- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6809dec0 0x7f3c68134920 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c460 tx=0x7f3c5800c770 comp rx=0 tx=0).stop 2023-09-30T22:24:04.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.276+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1072833467 shutdown_connections 2023-09-30T22:24:04.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.276+0000 7f3c6f9dd700 1 --2- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c68136cb0 0x7f3c68134e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.276+0000 7f3c6f9dd700 1 --2- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3c6806a770 0x7f3c681343e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.276+0000 7f3c6f9dd700 1 --2- 172.21.15.154:0/1072833467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6809dec0 0x7f3c68134920 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.276+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1072833467 >> 172.21.15.154:0/1072833467 conn(0x7f3c68099c40 msgr2=0x7f3c68138940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.276+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1072833467 shutdown_connections 2023-09-30T22:24:04.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.277+0000 7f3c6f9dd700 1 -- 172.21.15.154:0/1072833467 wait complete. 2023-09-30T22:24:04.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.285+0000 7f85a5fa6700 1 Processor -- start 2023-09-30T22:24:04.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.285+0000 7f85a5fa6700 1 -- start start 2023-09-30T22:24:04.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f85a5fa6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a00a0a30 0x7f85a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f85a5fa6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a0130670 0x7f85a01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f85a5fa6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00a1e70 con 0x7f85a00a1340 2023-09-30T22:24:04.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f85a5fa6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a009a720 con 0x7f85a00a0a30 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f85a5fa6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85a009b300 con 0x7f85a0130670 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a0130670 0x7f85a01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a0130670 0x7f85a01381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52568/0 (socket says 172.21.15.154:52568) 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859ffff700 1 -- 172.21.15.154:0/292934325 learned_addr learned my addr 172.21.15.154:0/292934325 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859f7fe700 1 --2- 172.21.15.154:0/292934325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a00a0a30 0x7f85a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859ffff700 1 -- 172.21.15.154:0/292934325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a00a0a30 msgr2=0x7f85a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859e7fc700 1 -- 172.21.15.154:0/292934325 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240460368 0 0) 0x7f85a00a1e70 con 0x7f85a00a1340 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859ffff700 1 --2- 172.21.15.154:0/292934325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a00a0a30 0x7f85a00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859ffff700 1 -- 172.21.15.154:0/292934325 >> v1:172.21.15.154:6789/0 conn(0x7f85a00a1340 legacy=0x7f85a012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859ffff700 1 -- 172.21.15.154:0/292934325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a009abc0 con 0x7f85a0130670 2023-09-30T22:24:04.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.286+0000 7f859ffff700 1 --2- 172.21.15.154:0/292934325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a0130670 0x7f85a01381c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8598009e80 tx=0x7f859800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513017b0140742c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f859e7fc700 1 -- 172.21.15.154:0/292934325 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800e070 con 0x7f85a0130670 2023-09-30T22:24:04.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f859e7fc700 1 -- 172.21.15.154:0/292934325 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859800b9c0 con 0x7f85a0130670 2023-09-30T22:24:04.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f859e7fc700 1 -- 172.21.15.154:0/292934325 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800bd70 con 0x7f85a0130670 2023-09-30T22:24:04.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f85a5fa6700 1 -- 172.21.15.154:0/292934325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a0130670 msgr2=0x7f85a01381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f85a5fa6700 1 --2- 172.21.15.154:0/292934325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a0130670 0x7f85a01381c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8598009e80 tx=0x7f859800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:04.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f85a5fa6700 1 -- 172.21.15.154:0/292934325 shutdown_connections 2023-09-30T22:24:04.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f85a5fa6700 1 --2- 172.21.15.154:0/292934325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a0130670 0x7f85a01381c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f85a5fa6700 1 --2- 172.21.15.154:0/292934325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a00a0a30 0x7f85a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f85a5fa6700 1 -- 172.21.15.154:0/292934325 >> 172.21.15.154:0/292934325 conn(0x7f85a00a2980 msgr2=0x7f85a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f85a5fa6700 1 -- 172.21.15.154:0/292934325 shutdown_connections 2023-09-30T22:24:04.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.287+0000 7f85a5fa6700 1 -- 172.21.15.154:0/292934325 wait complete. 2023-09-30T22:24:04.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.288+0000 7f85a5fa6700 1 Processor -- start 2023-09-30T22:24:04.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f85a5fa6700 1 -- start start 2023-09-30T22:24:04.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:04.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f85a5fa6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85a00a0a30 0x7f85a01386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f85a5fa6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a00a1340 0x7f85a0139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f85a5fa6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a0130670 0x7f85a013a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f85a5fa6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0137400 con 0x7f85a00a0a30 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f85a5fa6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a01390c0 con 0x7f85a0130670 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f85a5fa6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0139310 con 0x7f85a00a1340 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f859effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a00a1340 0x7f85a0139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f859effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a00a1340 0x7f85a0139ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52582/0 (socket says 172.21.15.154:52582) 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f859effd700 1 -- 172.21.15.154:0/1601542124 learned_addr learned my addr 172.21.15.154:0/1601542124 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f859f7fe700 1 --2- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85a00a0a30 0x7f85a01386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.289+0000 7f859ffff700 1 --2- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a0130670 0x7f85a013a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f859effd700 1 -- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a0130670 msgr2=0x7f85a013a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f859effd700 1 --2- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a0130670 0x7f85a013a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f859effd700 1 -- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85a00a0a30 msgr2=0x7f85a01386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f859effd700 1 --2- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85a00a0a30 0x7f85a01386b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f859effd700 1 -- 172.21.15.154:0/1601542124 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598009b30 con 0x7f85a00a1340 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f859effd700 1 --2- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a00a1340 0x7f85a0139ef0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f859400c550 tx=0x7f859400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f8587fff700 1 -- 172.21.15.154:0/1601542124 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85940054e0 con 0x7f85a00a1340 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f8587fff700 1 -- 172.21.15.154:0/1601542124 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594003680 con 0x7f85a00a1340 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f85a5fa6700 1 -- 172.21.15.154:0/1601542124 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a009fae0 con 0x7f85a00a1340 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f8587fff700 1 -- 172.21.15.154:0/1601542124 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594003a30 con 0x7f85a00a1340 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.290+0000 7f85a5fa6700 1 -- 172.21.15.154:0/1601542124 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a0139aa0 con 0x7f85a00a1340 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.291+0000 7f8587fff700 1 -- 172.21.15.154:0/1601542124 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8594003b90 con 0x7f85a00a1340 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.291+0000 7f8587fff700 1 -- 172.21.15.154:0/1601542124 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f859403ea90 con 0x7f85a00a1340 2023-09-30T22:24:04.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.291+0000 7f85a5fa6700 1 -- 172.21.15.154:0/1601542124 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a004f2a0 con 0x7f85a00a1340 2023-09-30T22:24:04.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.296+0000 7f8587fff700 1 -- 172.21.15.154:0/1601542124 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8594017070 con 0x7f85a00a1340 2023-09-30T22:24:04.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.320+0000 7f00ad3b8700 1 -- 172.21.15.154:0/274522422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00a804f2a0 con 0x7f00a8133ad0 2023-09-30T22:24:04.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.320+0000 7f008f7fe700 1 -- 172.21.15.154:0/274522422 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00a0011e60 con 0x7f00a8133ad0 2023-09-30T22:24:04.321 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.323+0000 7f00ad3b8700 1 -- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8133ad0 msgr2=0x7f00a811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.323+0000 7f00ad3b8700 1 --2- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8133ad0 0x7f00a811e4c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f00a0016000 tx=0x7f00a0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.323+0000 7f00ad3b8700 1 -- 172.21.15.154:0/274522422 shutdown_connections 2023-09-30T22:24:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.323+0000 7f00ad3b8700 1 --2- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a8133ad0 0x7f00a811e4c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.323+0000 7f00ad3b8700 1 --2- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a81300a0 0x7f00a811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.323+0000 7f00ad3b8700 1 --2- 172.21.15.154:0/274522422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a8130bc0 0x7f00a811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.323+0000 7f00ad3b8700 1 -- 172.21.15.154:0/274522422 >> 172.21.15.154:0/274522422 conn(0x7f00a8099c40 msgr2=0x7f00a812e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.323+0000 7f00ad3b8700 1 -- 172.21.15.154:0/274522422 shutdown_connections 2023-09-30T22:24:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.323+0000 7f00ad3b8700 1 -- 172.21.15.154:0/274522422 wait complete. 2023-09-30T22:24:04.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:04.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.350+0000 7f8a99590700 1 -- 172.21.15.154:0/747570295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a940a2700 con 0x7f8a94133f50 2023-09-30T22:24:04.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.350+0000 7f8a7b7fe700 1 -- 172.21.15.154:0/747570295 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a8c019300 con 0x7f8a94133f50 2023-09-30T22:24:04.351 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:04.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.352+0000 7f8a99590700 1 -- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a94133f50 msgr2=0x7f8a941c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.352+0000 7f8a99590700 1 --2- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a94133f50 0x7f8a941c5e90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00cb90 tx=0x7f8a8c00cea0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.352+0000 7f8a99590700 1 -- 172.21.15.154:0/747570295 shutdown_connections 2023-09-30T22:24:04.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.352+0000 7f8a99590700 1 --2- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a94133f50 0x7f8a941c5e90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.352+0000 7f8a99590700 1 --2- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a940a0a70 0x7f8a941240c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.352+0000 7f8a99590700 1 --2- 172.21.15.154:0/747570295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a940a1380 0x7f8a941c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.352+0000 7f8a99590700 1 -- 172.21.15.154:0/747570295 >> 172.21.15.154:0/747570295 conn(0x7f8a940a6610 msgr2=0x7f8a940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.352+0000 7f8a99590700 1 -- 172.21.15.154:0/747570295 shutdown_connections 2023-09-30T22:24:04.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.352+0000 7f8a99590700 1 -- 172.21.15.154:0/747570295 wait complete. 2023-09-30T22:24:04.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:04.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.489+0000 7f85a5fa6700 1 -- 172.21.15.154:0/1601542124 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f85a006bce0 con 0x7f85a00a1340 2023-09-30T22:24:04.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.489+0000 7f8587fff700 1 -- 172.21.15.154:0/1601542124 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8594003e40 con 0x7f85a00a1340 2023-09-30T22:24:04.490 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:04.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.491+0000 7f85a5fa6700 1 -- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a00a1340 msgr2=0x7f85a0139ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.491+0000 7f85a5fa6700 1 --2- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a00a1340 0x7f85a0139ef0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f859400c550 tx=0x7f859400c860 comp rx=0 tx=0).stop 2023-09-30T22:24:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.491+0000 7f85a5fa6700 1 -- 172.21.15.154:0/1601542124 shutdown_connections 2023-09-30T22:24:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.491+0000 7f85a5fa6700 1 --2- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a0130670 0x7f85a013a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.491+0000 7f85a5fa6700 1 --2- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85a00a0a30 0x7f85a01386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.491+0000 7f85a5fa6700 1 --2- 172.21.15.154:0/1601542124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f85a00a1340 0x7f85a0139ef0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.491+0000 7f85a5fa6700 1 -- 172.21.15.154:0/1601542124 >> 172.21.15.154:0/1601542124 conn(0x7f85a00a2980 msgr2=0x7f85a009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.492+0000 7f85a5fa6700 1 -- 172.21.15.154:0/1601542124 shutdown_connections 2023-09-30T22:24:04.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:04.492+0000 7f85a5fa6700 1 -- 172.21.15.154:0/1601542124 wait complete. 2023-09-30T22:24:04.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:05.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:05.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:05.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:05.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.433+0000 7f56ef9a8700 1 Processor -- start 2023-09-30T22:24:05.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.433+0000 7f56ef9a8700 1 -- start start 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56ef9a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8133ad0 0x7f56e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56ef9a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e8130bc0 0x7f56e813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56ef9a8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e806b2d0 con 0x7f56e81300a0 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56ef9a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e8133610 con 0x7f56e8130bc0 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56ef9a8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56e809a500 con 0x7f56e8133ad0 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56edf45700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e8130bc0 0x7f56e813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56ecf43700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f56e81300a0 0x7f56e81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55772/0 (socket says 172.21.15.154:55772) 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56ecf43700 1 -- 172.21.15.154:0/473482139 learned_addr learned my addr 172.21.15.154:0/473482139 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56ed744700 1 --2- 172.21.15.154:0/473482139 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8133ad0 0x7f56e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56dffff700 1 -- 172.21.15.154:0/473482139 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015832287 0 0) 0x7f56e806b2d0 con 0x7f56e81300a0 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56dffff700 1 -- 172.21.15.154:0/473482139 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d40035b0 con 0x7f56e81300a0 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56edf45700 1 -- 172.21.15.154:0/473482139 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8133ad0 msgr2=0x7f56e8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56edf45700 1 --2- 172.21.15.154:0/473482139 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8133ad0 0x7f56e8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56edf45700 1 -- 172.21.15.154:0/473482139 >> v1:172.21.15.154:6789/0 conn(0x7f56e81300a0 legacy=0x7f56e81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56edf45700 1 -- 172.21.15.154:0/473482139 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e81338b0 con 0x7f56e8130bc0 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.434+0000 7f56ed744700 1 --2- 172.21.15.154:0/473482139 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8133ad0 0x7f56e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.435+0000 7f56edf45700 1 --2- 172.21.15.154:0/473482139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e8130bc0 0x7f56e813b990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009dc0 tx=0x7f56e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d479b6793392560f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.435+0000 7f56dffff700 1 -- 172.21.15.154:0/473482139 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e000e070 con 0x7f56e8130bc0 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.435+0000 7f56dffff700 1 -- 172.21.15.154:0/473482139 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e000bb20 con 0x7f56e8130bc0 2023-09-30T22:24:05.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.435+0000 7f56dffff700 1 -- 172.21.15.154:0/473482139 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0012430 con 0x7f56e8130bc0 2023-09-30T22:24:05.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.436+0000 7f56ef9a8700 1 -- 172.21.15.154:0/473482139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e8130bc0 msgr2=0x7f56e813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.436+0000 7f56ef9a8700 1 --2- 172.21.15.154:0/473482139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e8130bc0 0x7f56e813b990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009dc0 tx=0x7f56e000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:05.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.436+0000 7f56ef9a8700 1 -- 172.21.15.154:0/473482139 shutdown_connections 2023-09-30T22:24:05.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.436+0000 7f56ef9a8700 1 --2- 172.21.15.154:0/473482139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e8130bc0 0x7f56e813b990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.436+0000 7f56ef9a8700 1 --2- 172.21.15.154:0/473482139 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8133ad0 0x7f56e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.436+0000 7f56ef9a8700 1 -- 172.21.15.154:0/473482139 >> 172.21.15.154:0/473482139 conn(0x7f56e8099c40 msgr2=0x7f56e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.436+0000 7f56ef9a8700 1 -- 172.21.15.154:0/473482139 shutdown_connections 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.436+0000 7f56ef9a8700 1 -- 172.21.15.154:0/473482139 wait complete. 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ef9a8700 1 Processor -- start 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ef9a8700 1 -- start start 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ef9a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e81300a0 0x7f56e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ef9a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8130bc0 0x7f56e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ef9a8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8133ad0 0x7f56e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ef9a8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e812deb0 con 0x7f56e8133ad0 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ef9a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e8072150 con 0x7f56e81300a0 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ef9a8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56e8120050 con 0x7f56e8130bc0 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ecf43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8130bc0 0x7f56e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ecf43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8130bc0 0x7f56e811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55392/0 (socket says 172.21.15.154:55392) 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ecf43700 1 -- 172.21.15.154:0/4214289092 learned_addr learned my addr 172.21.15.154:0/4214289092 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56ed744700 1 --2- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e81300a0 0x7f56e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.437+0000 7f56edf45700 1 --2- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8133ad0 0x7f56e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ecf43700 1 -- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e81300a0 msgr2=0x7f56e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ecf43700 1 --2- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e81300a0 0x7f56e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ecf43700 1 -- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8133ad0 msgr2=0x7f56e811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ecf43700 1 --2- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8133ad0 0x7f56e811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ecf43700 1 -- 172.21.15.154:0/4214289092 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e40094a0 con 0x7f56e8130bc0 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ecf43700 1 --2- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8130bc0 0x7f56e811df80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f56d8005910 tx=0x7f56d800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ddffb700 1 -- 172.21.15.154:0/4214289092 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8005d70 con 0x7f56e8130bc0 2023-09-30T22:24:05.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ef9a8700 1 -- 172.21.15.154:0/4214289092 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e0009a70 con 0x7f56e8130bc0 2023-09-30T22:24:05.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ddffb700 1 -- 172.21.15.154:0/4214289092 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d800ce80 con 0x7f56e8130bc0 2023-09-30T22:24:05.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ddffb700 1 -- 172.21.15.154:0/4214289092 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80072f0 con 0x7f56e8130bc0 2023-09-30T22:24:05.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.438+0000 7f56ef9a8700 1 -- 172.21.15.154:0/4214289092 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e811ee30 con 0x7f56e8130bc0 2023-09-30T22:24:05.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.439+0000 7f56ddffb700 1 -- 172.21.15.154:0/4214289092 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56d8007450 con 0x7f56e8130bc0 2023-09-30T22:24:05.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.439+0000 7f56ddffb700 1 -- 172.21.15.154:0/4214289092 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56d803ea80 con 0x7f56e8130bc0 2023-09-30T22:24:05.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.439+0000 7f56ef9a8700 1 -- 172.21.15.154:0/4214289092 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e806be10 con 0x7f56e8130bc0 2023-09-30T22:24:05.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.448+0000 7f56ddffb700 1 -- 172.21.15.154:0/4214289092 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56d8017070 con 0x7f56e8130bc0 2023-09-30T22:24:05.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.471+0000 7f09e8e8f700 1 Processor -- start 2023-09-30T22:24:05.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.471+0000 7f09e8e8f700 1 -- start start 2023-09-30T22:24:05.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e8e8f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e4133ad0 0x7f09e4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e8e8f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09e41300a0 0x7f09e41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e8e8f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e8e8f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e406b2d0 con 0x7f09e41300a0 2023-09-30T22:24:05.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e8e8f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4133610 con 0x7f09e4133ad0 2023-09-30T22:24:05.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e8e8f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e409a500 con 0x7f09e41309f0 2023-09-30T22:24:05.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e4133ad0 0x7f09e4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e4133ad0 0x7f09e4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43464/0 (socket says 172.21.15.154:43464) 2023-09-30T22:24:05.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e259c700 1 -- 172.21.15.154:0/1866396535 learned_addr learned my addr 172.21.15.154:0/1866396535 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:05.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e1d9b700 1 --2- 172.21.15.154:0/1866396535 >> v2:172.21.15.154:3300/0 conn(0x7f09e41300a0 0x7f09e41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e2d9d700 1 -- 172.21.15.154:0/1866396535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e4133ad0 msgr2=0x7f09e4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e2d9d700 1 --2- 172.21.15.154:0/1866396535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e4133ad0 0x7f09e4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e2d9d700 1 -- 172.21.15.154:0/1866396535 >> v2:172.21.15.154:3300/0 conn(0x7f09e41300a0 msgr2=0x7f09e41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e2d9d700 1 --2- 172.21.15.154:0/1866396535 >> v2:172.21.15.154:3300/0 conn(0x7f09e41300a0 0x7f09e41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e2d9d700 1 -- 172.21.15.154:0/1866396535 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e41338b0 con 0x7f09e41309f0 2023-09-30T22:24:05.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e1d9b700 1 --2- 172.21.15.154:0/1866396535 >> v2:172.21.15.154:3300/0 conn(0x7f09e41300a0 0x7f09e41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.472+0000 7f09e2d9d700 1 --2- 172.21.15.154:0/1866396535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e413a980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009d90 tx=0x7f09dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff312d15ee4d2242 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e159a700 1 -- 172.21.15.154:0/1866396535 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00e070 con 0x7f09e41309f0 2023-09-30T22:24:05.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e159a700 1 -- 172.21.15.154:0/1866396535 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc00bb20 con 0x7f09e41309f0 2023-09-30T22:24:05.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e159a700 1 -- 172.21.15.154:0/1866396535 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc012430 con 0x7f09e41309f0 2023-09-30T22:24:05.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1866396535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 msgr2=0x7f09e413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e8e8f700 1 --2- 172.21.15.154:0/1866396535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e413a980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009d90 tx=0x7f09dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:05.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1866396535 shutdown_connections 2023-09-30T22:24:05.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e8e8f700 1 --2- 172.21.15.154:0/1866396535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e4133ad0 0x7f09e4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e8e8f700 1 --2- 172.21.15.154:0/1866396535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e413a980 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e8e8f700 1 --2- 172.21.15.154:0/1866396535 >> v2:172.21.15.154:3300/0 conn(0x7f09e41300a0 0x7f09e41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1866396535 >> 172.21.15.154:0/1866396535 conn(0x7f09e4099c40 msgr2=0x7f09e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1866396535 shutdown_connections 2023-09-30T22:24:05.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.473+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1866396535 wait complete. 2023-09-30T22:24:05.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.474+0000 7f09e8e8f700 1 Processor -- start 2023-09-30T22:24:05.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e8e8f700 1 -- start start 2023-09-30T22:24:05.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e8e8f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e41300a0 0x7f09e411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e8e8f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e8e8f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4133ad0 0x7f09e411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e8e8f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e411f950 con 0x7f09e4133ad0 2023-09-30T22:24:05.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e8e8f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e412d730 con 0x7f09e41300a0 2023-09-30T22:24:05.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e8e8f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e412f7e0 con 0x7f09e41309f0 2023-09-30T22:24:05.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e41300a0 0x7f09e411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e41300a0 0x7f09e411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43472/0 (socket says 172.21.15.154:43472) 2023-09-30T22:24:05.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e259c700 1 -- 172.21.15.154:0/1896510155 learned_addr learned my addr 172.21.15.154:0/1896510155 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e1d9b700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e2d9d700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4133ad0 0x7f09e411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e259c700 1 -- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 msgr2=0x7f09e411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e259c700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e259c700 1 -- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4133ad0 msgr2=0x7f09e411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e259c700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4133ad0 0x7f09e411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e259c700 1 -- 172.21.15.154:0/1896510155 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d80094a0 con 0x7f09e41300a0 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e1d9b700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.475+0000 7f09e2d9d700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4133ad0 0x7f09e411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:05.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.476+0000 7f09e259c700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e41300a0 0x7f09e411da40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e910 tx=0x7f09d400ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.476+0000 7f09d2ffd700 1 -- 172.21.15.154:0/1896510155 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d40096a0 con 0x7f09e41300a0 2023-09-30T22:24:05.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.476+0000 7f09d2ffd700 1 -- 172.21.15.154:0/1896510155 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400ee60 con 0x7f09e41300a0 2023-09-30T22:24:05.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.476+0000 7f09d2ffd700 1 -- 172.21.15.154:0/1896510155 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400ca90 con 0x7f09e41300a0 2023-09-30T22:24:05.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.476+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1896510155 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc009a70 con 0x7f09e41300a0 2023-09-30T22:24:05.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.476+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1896510155 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e412dd00 con 0x7f09e41300a0 2023-09-30T22:24:05.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.477+0000 7f09d2ffd700 1 -- 172.21.15.154:0/1896510155 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09d400cbf0 con 0x7f09e41300a0 2023-09-30T22:24:05.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.477+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1896510155 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e411ee60 con 0x7f09e41300a0 2023-09-30T22:24:05.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.477+0000 7f09d2ffd700 1 -- 172.21.15.154:0/1896510155 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09d403f900 con 0x7f09e41300a0 2023-09-30T22:24:05.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.482+0000 7f09d2ffd700 1 -- 172.21.15.154:0/1896510155 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09d4013470 con 0x7f09e41300a0 2023-09-30T22:24:05.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.515+0000 7f36650e4700 1 Processor -- start 2023-09-30T22:24:05.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.515+0000 7f36650e4700 1 -- start start 2023-09-30T22:24:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f36650e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3660099e20 0x7f366009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f36650e4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f366009a730 0x7f3660130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f36650e4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3660099a60 con 0x7f3660130890 2023-09-30T22:24:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f36650e4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366009bf50 con 0x7f366009a730 2023-09-30T22:24:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f36650e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f366009b230 con 0x7f3660099e20 2023-09-30T22:24:05.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f365ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3660099e20 0x7f366009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f365e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f366009a730 0x7f3660130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f365e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f366009a730 0x7f3660130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33862/0 (socket says 172.21.15.154:33862) 2023-09-30T22:24:05.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f365ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3660099e20 0x7f366009a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55424/0 (socket says 172.21.15.154:55424) 2023-09-30T22:24:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f365e59c700 1 -- 172.21.15.154:0/3221593634 learned_addr learned my addr 172.21.15.154:0/3221593634 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f365e59c700 1 -- 172.21.15.154:0/3221593634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3660099e20 msgr2=0x7f366009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f365e59c700 1 --2- 172.21.15.154:0/3221593634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3660099e20 0x7f366009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f365e59c700 1 -- 172.21.15.154:0/3221593634 >> v1:172.21.15.154:6789/0 conn(0x7f3660130890 legacy=0x7f3660137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.516+0000 7f365e59c700 1 -- 172.21.15.154:0/3221593634 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366009bb90 con 0x7f366009a730 2023-09-30T22:24:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.517+0000 7f365e59c700 1 --2- 172.21.15.154:0/3221593634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366009a730 0x7f3660130350 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f36540098f0 tx=0x7f3654009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be20a508a9e61fd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.517+0000 7f365dd9b700 1 -- 172.21.15.154:0/3221593634 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654011830 con 0x7f366009a730 2023-09-30T22:24:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.517+0000 7f365dd9b700 1 -- 172.21.15.154:0/3221593634 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3654011990 con 0x7f366009a730 2023-09-30T22:24:05.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.517+0000 7f365dd9b700 1 -- 172.21.15.154:0/3221593634 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654011d20 con 0x7f366009a730 2023-09-30T22:24:05.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.518+0000 7f36650e4700 1 -- 172.21.15.154:0/3221593634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366009a730 msgr2=0x7f3660130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.518+0000 7f36650e4700 1 --2- 172.21.15.154:0/3221593634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366009a730 0x7f3660130350 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f36540098f0 tx=0x7f3654009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.518+0000 7f36650e4700 1 -- 172.21.15.154:0/3221593634 shutdown_connections 2023-09-30T22:24:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.518+0000 7f36650e4700 1 --2- 172.21.15.154:0/3221593634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3660099e20 0x7f366009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.518+0000 7f36650e4700 1 --2- 172.21.15.154:0/3221593634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f366009a730 0x7f3660130350 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.518+0000 7f36650e4700 1 -- 172.21.15.154:0/3221593634 >> 172.21.15.154:0/3221593634 conn(0x7f36600a2980 msgr2=0x7f36600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.518+0000 7f36650e4700 1 -- 172.21.15.154:0/3221593634 shutdown_connections 2023-09-30T22:24:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.518+0000 7f36650e4700 1 -- 172.21.15.154:0/3221593634 wait complete. 2023-09-30T22:24:05.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.520+0000 7f36650e4700 1 Processor -- start 2023-09-30T22:24:05.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.520+0000 7f36650e4700 1 -- start start 2023-09-30T22:24:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f36650e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3660099e20 0x7f366011bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f36650e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366009a730 0x7f366011c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f36650e4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3660130890 0x7f366011c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f36650e4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366011d8b0 con 0x7f3660130890 2023-09-30T22:24:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f36650e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366011eca0 con 0x7f3660099e20 2023-09-30T22:24:05.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f36650e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f366011d680 con 0x7f366009a730 2023-09-30T22:24:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3660099e20 0x7f366011bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3660099e20 0x7f366011bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43474/0 (socket says 172.21.15.154:43474) 2023-09-30T22:24:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365ed9d700 1 -- 172.21.15.154:0/3244419798 learned_addr learned my addr 172.21.15.154:0/3244419798 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365e59c700 1 --2- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366009a730 0x7f366011c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365ed9d700 1 -- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366009a730 msgr2=0x7f366011c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365ed9d700 1 --2- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366009a730 0x7f366011c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365ed9d700 1 -- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3660130890 msgr2=0x7f366011c670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365ed9d700 1 --2- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3660130890 0x7f366011c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365ed9d700 1 -- 172.21.15.154:0/3244419798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3654009550 con 0x7f3660099e20 2023-09-30T22:24:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.521+0000 7f365ed9d700 1 --2- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3660099e20 0x7f366011bbf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f365000e990 tx=0x7f365000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.522+0000 7f36477fe700 1 -- 172.21.15.154:0/3244419798 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365000eee0 con 0x7f3660099e20 2023-09-30T22:24:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.522+0000 7f36477fe700 1 -- 172.21.15.154:0/3244419798 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365000c850 con 0x7f3660099e20 2023-09-30T22:24:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.522+0000 7f36650e4700 1 -- 172.21.15.154:0/3244419798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366011f060 con 0x7f3660099e20 2023-09-30T22:24:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.522+0000 7f36650e4700 1 -- 172.21.15.154:0/3244419798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366009b470 con 0x7f3660099e20 2023-09-30T22:24:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.522+0000 7f36477fe700 1 -- 172.21.15.154:0/3244419798 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365000cbc0 con 0x7f3660099e20 2023-09-30T22:24:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.523+0000 7f36477fe700 1 -- 172.21.15.154:0/3244419798 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f365000cd20 con 0x7f3660099e20 2023-09-30T22:24:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.523+0000 7f36650e4700 1 -- 172.21.15.154:0/3244419798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36400052e0 con 0x7f3660099e20 2023-09-30T22:24:05.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.523+0000 7f36477fe700 1 -- 172.21.15.154:0/3244419798 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f365003fc50 con 0x7f3660099e20 2023-09-30T22:24:05.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.528+0000 7f36477fe700 1 -- 172.21.15.154:0/3244419798 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f365003fe60 con 0x7f3660099e20 2023-09-30T22:24:05.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.635+0000 7f9d60554700 1 Processor -- start 2023-09-30T22:24:05.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.635+0000 7f9d60554700 1 -- start start 2023-09-30T22:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.635+0000 7f9d60554700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d58133ad0 0x7f9d58133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.635+0000 7f9d60554700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 0x7f9d5813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.635+0000 7f9d60554700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5806b2d0 con 0x7f9d581300a0 2023-09-30T22:24:05.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.635+0000 7f9d60554700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d58133610 con 0x7f9d58133ad0 2023-09-30T22:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.635+0000 7f9d60554700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5809a500 con 0x7f9d58130bc0 2023-09-30T22:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5e2f0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d58133ad0 0x7f9d58133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5e2f0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d58133ad0 0x7f9d58133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33872/0 (socket says 172.21.15.154:33872) 2023-09-30T22:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5e2f0700 1 -- 172.21.15.154:0/463355172 learned_addr learned my addr 172.21.15.154:0/463355172 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5eaf1700 1 --2- 172.21.15.154:0/463355172 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 0x7f9d5813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5e2f0700 1 -- 172.21.15.154:0/463355172 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 msgr2=0x7f9d5813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5e2f0700 1 --2- 172.21.15.154:0/463355172 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 0x7f9d5813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5e2f0700 1 -- 172.21.15.154:0/463355172 >> v1:172.21.15.154:6789/0 conn(0x7f9d581300a0 legacy=0x7f9d581304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5e2f0700 1 -- 172.21.15.154:0/463355172 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d581338b0 con 0x7f9d58133ad0 2023-09-30T22:24:05.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5e2f0700 1 --2- 172.21.15.154:0/463355172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58133ad0 0x7f9d58133ea0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9d540098f0 tx=0x7f9d54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62036f6a172cec2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5d2ee700 1 -- 172.21.15.154:0/463355172 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54011830 con 0x7f9d58133ad0 2023-09-30T22:24:05.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5d2ee700 1 -- 172.21.15.154:0/463355172 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d54011990 con 0x7f9d58133ad0 2023-09-30T22:24:05.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.636+0000 7f9d5d2ee700 1 -- 172.21.15.154:0/463355172 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54011d20 con 0x7f9d58133ad0 2023-09-30T22:24:05.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.637+0000 7f9d60554700 1 -- 172.21.15.154:0/463355172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58133ad0 msgr2=0x7f9d58133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.637+0000 7f9d60554700 1 --2- 172.21.15.154:0/463355172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58133ad0 0x7f9d58133ea0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9d540098f0 tx=0x7f9d54009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:05.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.637+0000 7f9d60554700 1 -- 172.21.15.154:0/463355172 shutdown_connections 2023-09-30T22:24:05.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.637+0000 7f9d60554700 1 --2- 172.21.15.154:0/463355172 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 0x7f9d5813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.637+0000 7f9d60554700 1 --2- 172.21.15.154:0/463355172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d58133ad0 0x7f9d58133ea0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.637+0000 7f9d60554700 1 -- 172.21.15.154:0/463355172 >> 172.21.15.154:0/463355172 conn(0x7f9d58099c40 msgr2=0x7f9d580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.637+0000 7f9d60554700 1 -- 172.21.15.154:0/463355172 shutdown_connections 2023-09-30T22:24:05.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.637+0000 7f9d60554700 1 -- 172.21.15.154:0/463355172 wait complete. 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.638+0000 7f9d60554700 1 Processor -- start 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.638+0000 7f9d60554700 1 -- start start 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d60554700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d581300a0 0x7f9d5811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d60554700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 0x7f9d5811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d60554700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d58133ad0 0x7f9d5811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d60554700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d581200a0 con 0x7f9d581300a0 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d60554700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5811f830 con 0x7f9d58133ad0 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d60554700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5811fb00 con 0x7f9d58130bc0 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5daef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 0x7f9d5811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5eaf1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d58133ad0 0x7f9d5811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5daef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 0x7f9d5811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55450/0 (socket says 172.21.15.154:55450) 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5daef700 1 -- 172.21.15.154:0/3689670040 learned_addr learned my addr 172.21.15.154:0/3689670040 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5e2f0700 1 --2- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d581300a0 0x7f9d5811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5eaf1700 1 -- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 msgr2=0x7f9d5811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5eaf1700 1 --2- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 0x7f9d5811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5eaf1700 1 -- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d581300a0 msgr2=0x7f9d5811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5eaf1700 1 --2- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d581300a0 0x7f9d5811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.639+0000 7f9d5eaf1700 1 -- 172.21.15.154:0/3689670040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009550 con 0x7f9d58133ad0 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.640+0000 7f9d5eaf1700 1 --2- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d58133ad0 0x7f9d5811e4c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000efc0 tx=0x7f9d5000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.640+0000 7f9d4effd700 1 -- 172.21.15.154:0/3689670040 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000cc90 con 0x7f9d58133ad0 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.640+0000 7f9d4effd700 1 -- 172.21.15.154:0/3689670040 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5000f040 con 0x7f9d58133ad0 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.640+0000 7f9d4effd700 1 -- 172.21.15.154:0/3689670040 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500146c0 con 0x7f9d58133ad0 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.640+0000 7f9d60554700 1 -- 172.21.15.154:0/3689670040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d581209a0 con 0x7f9d58133ad0 2023-09-30T22:24:05.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.640+0000 7f9d60554700 1 -- 172.21.15.154:0/3689670040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5812dd00 con 0x7f9d58133ad0 2023-09-30T22:24:05.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.641+0000 7f9d60554700 1 -- 172.21.15.154:0/3689670040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5804f2a0 con 0x7f9d58133ad0 2023-09-30T22:24:05.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.641+0000 7f9d4effd700 1 -- 172.21.15.154:0/3689670040 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d50014820 con 0x7f9d58133ad0 2023-09-30T22:24:05.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.642+0000 7f9d4effd700 1 -- 172.21.15.154:0/3689670040 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d50040740 con 0x7f9d58133ad0 2023-09-30T22:24:05.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.646+0000 7f9d4effd700 1 -- 172.21.15.154:0/3689670040 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d50014ad0 con 0x7f9d58133ad0 2023-09-30T22:24:05.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.653+0000 7f56ef9a8700 1 -- 172.21.15.154:0/4214289092 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f56e809cb20 con 0x7f56e8130bc0 2023-09-30T22:24:05.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.653+0000 7f56ddffb700 1 -- 172.21.15.154:0/4214289092 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56d803ce60 con 0x7f56e8130bc0 2023-09-30T22:24:05.654 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.657+0000 7f56ef9a8700 1 -- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8130bc0 msgr2=0x7f56e811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.657+0000 7f56ef9a8700 1 --2- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8130bc0 0x7f56e811df80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f56d8005910 tx=0x7f56d800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.657+0000 7f56ef9a8700 1 -- 172.21.15.154:0/4214289092 shutdown_connections 2023-09-30T22:24:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.657+0000 7f56ef9a8700 1 --2- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e8133ad0 0x7f56e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.657+0000 7f56ef9a8700 1 --2- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e81300a0 0x7f56e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.657+0000 7f56ef9a8700 1 --2- 172.21.15.154:0/4214289092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56e8130bc0 0x7f56e811df80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.657+0000 7f56ef9a8700 1 -- 172.21.15.154:0/4214289092 >> 172.21.15.154:0/4214289092 conn(0x7f56e8099c40 msgr2=0x7f56e8132980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.658+0000 7f56ef9a8700 1 -- 172.21.15.154:0/4214289092 shutdown_connections 2023-09-30T22:24:05.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.659+0000 7f56ef9a8700 1 -- 172.21.15.154:0/4214289092 wait complete. 2023-09-30T22:24:05.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:05.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.684+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1896510155 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f09e411fe30 con 0x7f09e41300a0 2023-09-30T22:24:05.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.684+0000 7f09d2ffd700 1 -- 172.21.15.154:0/1896510155 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09d4017030 con 0x7f09e41300a0 2023-09-30T22:24:05.685 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:05.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.686+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e41300a0 msgr2=0x7f09e411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.686+0000 7f09e8e8f700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e41300a0 0x7f09e411da40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e910 tx=0x7f09d400ec20 comp rx=0 tx=0).stop 2023-09-30T22:24:05.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.686+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1896510155 shutdown_connections 2023-09-30T22:24:05.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.686+0000 7f09e8e8f700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09e4133ad0 0x7f09e411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.686+0000 7f09e8e8f700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09e41300a0 0x7f09e411da40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.686+0000 7f09e8e8f700 1 --2- 172.21.15.154:0/1896510155 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09e41309f0 0x7f09e411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.686+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1896510155 >> 172.21.15.154:0/1896510155 conn(0x7f09e4099c40 msgr2=0x7f09e412e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.686+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1896510155 shutdown_connections 2023-09-30T22:24:05.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.686+0000 7f09e8e8f700 1 -- 172.21.15.154:0/1896510155 wait complete. 2023-09-30T22:24:05.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:05.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.729+0000 7f36650e4700 1 -- 172.21.15.154:0/3244419798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3640005590 con 0x7f3660099e20 2023-09-30T22:24:05.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.729+0000 7f36477fe700 1 -- 172.21.15.154:0/3244419798 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f365002a090 con 0x7f3660099e20 2023-09-30T22:24:05.730 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:05.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.731+0000 7f36650e4700 1 -- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3660099e20 msgr2=0x7f366011bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.731+0000 7f36650e4700 1 --2- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3660099e20 0x7f366011bbf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f365000e990 tx=0x7f365000eca0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.731+0000 7f36650e4700 1 -- 172.21.15.154:0/3244419798 shutdown_connections 2023-09-30T22:24:05.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.731+0000 7f36650e4700 1 --2- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3660130890 0x7f366011c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.731+0000 7f36650e4700 1 --2- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3660099e20 0x7f366011bbf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.731+0000 7f36650e4700 1 --2- 172.21.15.154:0/3244419798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f366009a730 0x7f366011c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.731+0000 7f36650e4700 1 -- 172.21.15.154:0/3244419798 >> 172.21.15.154:0/3244419798 conn(0x7f36600a2980 msgr2=0x7f366009fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.731+0000 7f36650e4700 1 -- 172.21.15.154:0/3244419798 shutdown_connections 2023-09-30T22:24:05.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.731+0000 7f36650e4700 1 -- 172.21.15.154:0/3244419798 wait complete. 2023-09-30T22:24:05.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:05.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.836+0000 7f9d60554700 1 -- 172.21.15.154:0/3689670040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d5812d950 con 0x7f9d58133ad0 2023-09-30T22:24:05.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.836+0000 7f9d4effd700 1 -- 172.21.15.154:0/3689670040 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d5001c3b0 con 0x7f9d58133ad0 2023-09-30T22:24:05.837 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:05.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.838+0000 7f9d60554700 1 -- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d58133ad0 msgr2=0x7f9d5811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:05.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.838+0000 7f9d60554700 1 --2- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d58133ad0 0x7f9d5811e4c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000efc0 tx=0x7f9d5000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.838+0000 7f9d60554700 1 -- 172.21.15.154:0/3689670040 shutdown_connections 2023-09-30T22:24:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.838+0000 7f9d60554700 1 --2- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d58133ad0 0x7f9d5811e4c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.838+0000 7f9d60554700 1 --2- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d581300a0 0x7f9d5811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.838+0000 7f9d60554700 1 --2- 172.21.15.154:0/3689670040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d58130bc0 0x7f9d5811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.838+0000 7f9d60554700 1 -- 172.21.15.154:0/3689670040 >> 172.21.15.154:0/3689670040 conn(0x7f9d58099c40 msgr2=0x7f9d580a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.838+0000 7f9d60554700 1 -- 172.21.15.154:0/3689670040 shutdown_connections 2023-09-30T22:24:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:05.838+0000 7f9d60554700 1 -- 172.21.15.154:0/3689670040 wait complete. 2023-09-30T22:24:05.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:06.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:06.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:06.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.812+0000 7f1ff1353700 1 Processor -- start 2023-09-30T22:24:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.812+0000 7f1ff1353700 1 -- start start 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1ff1353700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06a770 0x7f1fec06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1ff1353700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec131ec0 0x7f1fec139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1ff1353700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec09da80 con 0x7f1fec06b080 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1ff1353700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec09dce0 con 0x7f1fec131ec0 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1ff1353700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec09eb20 con 0x7f1fec06a770 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1feaffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06a770 0x7f1fec06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1feaffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06a770 0x7f1fec06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55452/0 (socket says 172.21.15.154:55452) 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1feaffd700 1 -- 172.21.15.154:0/2187380688 learned_addr learned my addr 172.21.15.154:0/2187380688 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1feb7fe700 1 --2- 172.21.15.154:0/2187380688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec131ec0 0x7f1fec139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1feaffd700 1 -- 172.21.15.154:0/2187380688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec131ec0 msgr2=0x7f1fec139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1feaffd700 1 --2- 172.21.15.154:0/2187380688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec131ec0 0x7f1fec139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1feaffd700 1 -- 172.21.15.154:0/2187380688 >> v1:172.21.15.154:6789/0 conn(0x7f1fec06b080 legacy=0x7f1fec1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1fe9ffb700 1 -- 172.21.15.154:0/2187380688 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434216537 0 0) 0x7f1fec09da80 con 0x7f1fec06b080 2023-09-30T22:24:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.813+0000 7f1feaffd700 1 -- 172.21.15.154:0/2187380688 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec09d860 con 0x7f1fec06a770 2023-09-30T22:24:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1feaffd700 1 --2- 172.21.15.154:0/2187380688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06a770 0x7f1fec06ab40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009920 tx=0x7f1fdc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea37f044d42243af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1fe9ffb700 1 -- 172.21.15.154:0/2187380688 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc010a90 con 0x7f1fec06a770 2023-09-30T22:24:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1fe9ffb700 1 -- 172.21.15.154:0/2187380688 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc010bf0 con 0x7f1fec06a770 2023-09-30T22:24:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1fe9ffb700 1 -- 172.21.15.154:0/2187380688 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc018440 con 0x7f1fec06a770 2023-09-30T22:24:06.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1ff1353700 1 -- 172.21.15.154:0/2187380688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06a770 msgr2=0x7f1fec06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1ff1353700 1 --2- 172.21.15.154:0/2187380688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06a770 0x7f1fec06ab40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009920 tx=0x7f1fdc009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:06.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1ff1353700 1 -- 172.21.15.154:0/2187380688 shutdown_connections 2023-09-30T22:24:06.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1ff1353700 1 --2- 172.21.15.154:0/2187380688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec131ec0 0x7f1fec139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1ff1353700 1 --2- 172.21.15.154:0/2187380688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06a770 0x7f1fec06ab40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.814+0000 7f1ff1353700 1 -- 172.21.15.154:0/2187380688 >> 172.21.15.154:0/2187380688 conn(0x7f1fec099c40 msgr2=0x7f1fec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.815+0000 7f1ff1353700 1 -- 172.21.15.154:0/2187380688 shutdown_connections 2023-09-30T22:24:06.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.815+0000 7f1ff1353700 1 -- 172.21.15.154:0/2187380688 wait complete. 2023-09-30T22:24:06.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.816+0000 7f1ff1353700 1 Processor -- start 2023-09-30T22:24:06.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.816+0000 7f1ff1353700 1 -- start start 2023-09-30T22:24:06.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1ff1353700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec06a770 0x7f1fec11bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1ff1353700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06b080 0x7f1fec11c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1ff1353700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec131ec0 0x7f1fec11c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1ff1353700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec11d3a0 con 0x7f1fec131ec0 2023-09-30T22:24:06.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1ff1353700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec11dab0 con 0x7f1fec06a770 2023-09-30T22:24:06.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1ff1353700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec11ed00 con 0x7f1fec06b080 2023-09-30T22:24:06.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1feaffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec06a770 0x7f1fec11bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1feaffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec06a770 0x7f1fec11bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43514/0 (socket says 172.21.15.154:43514) 2023-09-30T22:24:06.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1feaffd700 1 -- 172.21.15.154:0/4216326945 learned_addr learned my addr 172.21.15.154:0/4216326945 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:06.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1fea7fc700 1 --2- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06b080 0x7f1fec11c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1feb7fe700 1 --2- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec131ec0 0x7f1fec11c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1feaffd700 1 -- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06b080 msgr2=0x7f1fec11c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1feaffd700 1 --2- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06b080 0x7f1fec11c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1feaffd700 1 -- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec131ec0 msgr2=0x7f1fec11c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1feaffd700 1 --2- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec131ec0 0x7f1fec11c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.817+0000 7f1feaffd700 1 -- 172.21.15.154:0/4216326945 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc009550 con 0x7f1fec06a770 2023-09-30T22:24:06.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.818+0000 7f1feaffd700 1 --2- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec06a770 0x7f1fec11bef0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1fec09ec60 tx=0x7f1fdc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.818+0000 7f1fd37fe700 1 -- 172.21.15.154:0/4216326945 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0038a0 con 0x7f1fec06a770 2023-09-30T22:24:06.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.818+0000 7f1fd37fe700 1 -- 172.21.15.154:0/4216326945 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc003a00 con 0x7f1fec06a770 2023-09-30T22:24:06.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.818+0000 7f1fd37fe700 1 -- 172.21.15.154:0/4216326945 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc003d70 con 0x7f1fec06a770 2023-09-30T22:24:06.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.818+0000 7f1ff1353700 1 -- 172.21.15.154:0/4216326945 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec11f6e0 con 0x7f1fec06a770 2023-09-30T22:24:06.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.818+0000 7f1ff1353700 1 -- 172.21.15.154:0/4216326945 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0a2b70 con 0x7f1fec06a770 2023-09-30T22:24:06.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.819+0000 7f1fd37fe700 1 -- 172.21.15.154:0/4216326945 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fdc01f070 con 0x7f1fec06a770 2023-09-30T22:24:06.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.819+0000 7f1ff1353700 1 -- 172.21.15.154:0/4216326945 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec071e10 con 0x7f1fec06a770 2023-09-30T22:24:06.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.819+0000 7f1fd37fe700 1 -- 172.21.15.154:0/4216326945 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fdc044e50 con 0x7f1fec06a770 2023-09-30T22:24:06.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.823+0000 7f1fd37fe700 1 -- 172.21.15.154:0/4216326945 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fdc018b10 con 0x7f1fec06a770 2023-09-30T22:24:06.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.848+0000 7f4acca39700 1 Processor -- start 2023-09-30T22:24:06.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.848+0000 7f4acca39700 1 -- start start 2023-09-30T22:24:06.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.849+0000 7f4acca39700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ac809ad40 0x7f4ac8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.849+0000 7f4acca39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.849+0000 7f4acca39700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac809b110 con 0x7f4ac8133f70 2023-09-30T22:24:06.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.849+0000 7f4acca39700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac80a3b60 con 0x7f4ac809ad40 2023-09-30T22:24:06.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.849+0000 7f4acca39700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8134850 con 0x7f4ac81343d0 2023-09-30T22:24:06.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ac809ad40 0x7f4ac8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac6d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ac809ad40 0x7f4ac8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33900/0 (socket says 172.21.15.154:33900) 2023-09-30T22:24:06.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac659c700 1 -- 172.21.15.154:0/4228557794 learned_addr learned my addr 172.21.15.154:0/4228557794 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:06.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac659c700 1 -- 172.21.15.154:0/4228557794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 msgr2=0x7f4ac80a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac659c700 1 --2- 172.21.15.154:0/4228557794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac80a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac659c700 1 -- 172.21.15.154:0/4228557794 >> v1:172.21.15.154:6789/0 conn(0x7f4ac8133f70 legacy=0x7f4ac80a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac559a700 1 -- 172.21.15.154:0/4228557794 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466339017 0 0) 0x7f4ac809b110 con 0x7f4ac8133f70 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac659c700 1 -- 172.21.15.154:0/4228557794 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac80a2fa0 con 0x7f4ac809ad40 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac6d9d700 1 --2- 172.21.15.154:0/4228557794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac659c700 1 --2- 172.21.15.154:0/4228557794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac809ad40 0x7f4ac8133a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80098f0 tx=0x7f4ab8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f213ce4e21ccf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac559a700 1 -- 172.21.15.154:0/4228557794 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8011830 con 0x7f4ac809ad40 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac559a700 1 -- 172.21.15.154:0/4228557794 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab8011990 con 0x7f4ac809ad40 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.850+0000 7f4ac559a700 1 -- 172.21.15.154:0/4228557794 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8011d20 con 0x7f4ac809ad40 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.851+0000 7f4acca39700 1 -- 172.21.15.154:0/4228557794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac809ad40 msgr2=0x7f4ac8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.851+0000 7f4acca39700 1 --2- 172.21.15.154:0/4228557794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac809ad40 0x7f4ac8133a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80098f0 tx=0x7f4ab8009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.851+0000 7f4acca39700 1 -- 172.21.15.154:0/4228557794 shutdown_connections 2023-09-30T22:24:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.851+0000 7f4acca39700 1 --2- 172.21.15.154:0/4228557794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac80a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.851+0000 7f4acca39700 1 --2- 172.21.15.154:0/4228557794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac809ad40 0x7f4ac8133a30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.851+0000 7f4acca39700 1 -- 172.21.15.154:0/4228557794 >> 172.21.15.154:0/4228557794 conn(0x7f4ac8099c40 msgr2=0x7f4ac806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.851+0000 7f4acca39700 1 -- 172.21.15.154:0/4228557794 shutdown_connections 2023-09-30T22:24:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.851+0000 7f4acca39700 1 -- 172.21.15.154:0/4228557794 wait complete. 2023-09-30T22:24:06.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.853+0000 7f4acca39700 1 Processor -- start 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.853+0000 7f4acca39700 1 -- start start 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4acca39700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ac809ad40 0x7f4ac81c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4acca39700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac8133f70 0x7f4ac81c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4acca39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac81c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4acca39700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac811f950 con 0x7f4ac8133f70 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4acca39700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac811fd60 con 0x7f4ac81343d0 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4acca39700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8120550 con 0x7f4ac809ad40 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac8133f70 0x7f4ac81c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac8133f70 0x7f4ac81c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33910/0 (socket says 172.21.15.154:33910) 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac5d9b700 1 -- 172.21.15.154:0/667537491 learned_addr learned my addr 172.21.15.154:0/667537491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac659c700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ac809ad40 0x7f4ac81c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac6d9d700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac81c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac5d9b700 1 -- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ac809ad40 msgr2=0x7f4ac81c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac5d9b700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ac809ad40 0x7f4ac81c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac5d9b700 1 -- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 msgr2=0x7f4ac81c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac5d9b700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac81c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac5d9b700 1 -- 172.21.15.154:0/667537491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac0009a70 con 0x7f4ac8133f70 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac6d9d700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac81c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ac5d9b700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac8133f70 0x7f4ac81c8cf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c450 tx=0x7f4abc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ab6ffd700 1 -- 172.21.15.154:0/667537491 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0054e0 con 0x7f4ac8133f70 2023-09-30T22:24:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ab6ffd700 1 -- 172.21.15.154:0/667537491 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc00ce50 con 0x7f4ac8133f70 2023-09-30T22:24:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4ab6ffd700 1 -- 172.21.15.154:0/667537491 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0038c0 con 0x7f4ac8133f70 2023-09-30T22:24:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.854+0000 7f4acca39700 1 -- 172.21.15.154:0/667537491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab8009550 con 0x7f4ac8133f70 2023-09-30T22:24:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.855+0000 7f4acca39700 1 -- 172.21.15.154:0/667537491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac811ebe0 con 0x7f4ac8133f70 2023-09-30T22:24:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.855+0000 7f4ab6ffd700 1 -- 172.21.15.154:0/667537491 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4abc003a20 con 0x7f4ac8133f70 2023-09-30T22:24:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.856+0000 7f4ab6ffd700 1 -- 172.21.15.154:0/667537491 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4abc03e990 con 0x7f4ac8133f70 2023-09-30T22:24:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.856+0000 7f4acca39700 1 -- 172.21.15.154:0/667537491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac811eda0 con 0x7f4ac8133f70 2023-09-30T22:24:06.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.861+0000 7f4ab6ffd700 1 -- 172.21.15.154:0/667537491 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4abc017020 con 0x7f4ac8133f70 2023-09-30T22:24:06.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.899+0000 7f556e152700 1 Processor -- start 2023-09-30T22:24:06.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.899+0000 7f556e152700 1 -- start start 2023-09-30T22:24:06.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f556e152700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f5568133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f556e152700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5568130bc0 0x7f556813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f556e152700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556806b2d0 con 0x7f55681300a0 2023-09-30T22:24:06.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f556e152700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5568133610 con 0x7f5568130bc0 2023-09-30T22:24:06.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f556e152700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556809a500 con 0x7f5568133ad0 2023-09-30T22:24:06.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f5567fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5568130bc0 0x7f556813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f55677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f5568133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f5567fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5568130bc0 0x7f556813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33926/0 (socket says 172.21.15.154:33926) 2023-09-30T22:24:06.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f5567fff700 1 -- 172.21.15.154:0/1849449886 learned_addr learned my addr 172.21.15.154:0/1849449886 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:06.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f55677fe700 1 -- 172.21.15.154:0/1849449886 >> v2:172.21.15.154:3300/0 conn(0x7f5568130bc0 msgr2=0x7f556813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:06.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f55677fe700 1 --2- 172.21.15.154:0/1849449886 >> v2:172.21.15.154:3300/0 conn(0x7f5568130bc0 0x7f556813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f55677fe700 1 -- 172.21.15.154:0/1849449886 >> v1:172.21.15.154:6789/0 conn(0x7f55681300a0 legacy=0x7f55681304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f55677fe700 1 -- 172.21.15.154:0/1849449886 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55681338b0 con 0x7f5568133ad0 2023-09-30T22:24:06.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f5567fff700 1 --2- 172.21.15.154:0/1849449886 >> v2:172.21.15.154:3300/0 conn(0x7f5568130bc0 0x7f556813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:06.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.900+0000 7f55677fe700 1 --2- 172.21.15.154:0/1849449886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f5568133ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5558009840 tx=0x7f5558009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33039971168fe54a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f55667fc700 1 -- 172.21.15.154:0/1849449886 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558011830 con 0x7f5568133ad0 2023-09-30T22:24:06.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f55667fc700 1 -- 172.21.15.154:0/1849449886 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558011990 con 0x7f5568133ad0 2023-09-30T22:24:06.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f55667fc700 1 -- 172.21.15.154:0/1849449886 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558011d20 con 0x7f5568133ad0 2023-09-30T22:24:06.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f556e152700 1 -- 172.21.15.154:0/1849449886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 msgr2=0x7f5568133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f556e152700 1 --2- 172.21.15.154:0/1849449886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f5568133ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5558009840 tx=0x7f5558009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:06.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f556e152700 1 -- 172.21.15.154:0/1849449886 shutdown_connections 2023-09-30T22:24:06.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f556e152700 1 --2- 172.21.15.154:0/1849449886 >> v2:172.21.15.154:3300/0 conn(0x7f5568130bc0 0x7f556813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f556e152700 1 --2- 172.21.15.154:0/1849449886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f5568133ea0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f556e152700 1 -- 172.21.15.154:0/1849449886 >> 172.21.15.154:0/1849449886 conn(0x7f5568099c40 msgr2=0x7f55680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.901+0000 7f556e152700 1 -- 172.21.15.154:0/1849449886 shutdown_connections 2023-09-30T22:24:06.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.902+0000 7f556e152700 1 -- 172.21.15.154:0/1849449886 wait complete. 2023-09-30T22:24:06.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f556e152700 1 Processor -- start 2023-09-30T22:24:06.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f556e152700 1 -- start start 2023-09-30T22:24:06.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f556e152700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55681300a0 0x7f556811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f556e152700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5568130bc0 0x7f556811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f556e152700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f556811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f556e152700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556812fbb0 con 0x7f5568130bc0 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f556e152700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5568120b90 con 0x7f55681300a0 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f556e152700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556812d220 con 0x7f5568133ad0 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f5567fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f556811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f5567fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f556811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55490/0 (socket says 172.21.15.154:55490) 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.903+0000 7f5567fff700 1 -- 172.21.15.154:0/989915961 learned_addr learned my addr 172.21.15.154:0/989915961 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f55677fe700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55681300a0 0x7f556811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f5566ffd700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5568130bc0 0x7f556811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f5567fff700 1 -- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55681300a0 msgr2=0x7f556811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f5567fff700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55681300a0 0x7f556811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f5567fff700 1 -- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5568130bc0 msgr2=0x7f556811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f5567fff700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5568130bc0 0x7f556811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f5567fff700 1 -- 172.21.15.154:0/989915961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5560009b30 con 0x7f5568133ad0 2023-09-30T22:24:06.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f55677fe700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55681300a0 0x7f556811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:06.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f5567fff700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f556811e4c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f556000efc0 tx=0x7f556000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f554ffff700 1 -- 172.21.15.154:0/989915961 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560018070 con 0x7f5568133ad0 2023-09-30T22:24:06.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f554ffff700 1 -- 172.21.15.154:0/989915961 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556000f040 con 0x7f5568133ad0 2023-09-30T22:24:06.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.904+0000 7f556e152700 1 -- 172.21.15.154:0/989915961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55580094a0 con 0x7f5568133ad0 2023-09-30T22:24:06.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.905+0000 7f556e152700 1 -- 172.21.15.154:0/989915961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556812dd00 con 0x7f5568133ad0 2023-09-30T22:24:06.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.905+0000 7f554ffff700 1 -- 172.21.15.154:0/989915961 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560003c20 con 0x7f5568133ad0 2023-09-30T22:24:06.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.906+0000 7f556e152700 1 -- 172.21.15.154:0/989915961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55480052e0 con 0x7f5568133ad0 2023-09-30T22:24:06.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.906+0000 7f554ffff700 1 -- 172.21.15.154:0/989915961 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f556000c880 con 0x7f5568133ad0 2023-09-30T22:24:06.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.906+0000 7f554ffff700 1 -- 172.21.15.154:0/989915961 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5560040580 con 0x7f5568133ad0 2023-09-30T22:24:06.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.910+0000 7f554ffff700 1 -- 172.21.15.154:0/989915961 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5560013db0 con 0x7f5568133ad0 2023-09-30T22:24:06.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.986+0000 7fa72b3f4700 1 Processor -- start 2023-09-30T22:24:06.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa72b3f4700 1 -- start start 2023-09-30T22:24:06.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa72b3f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72409e950 0x7fa72409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa72b3f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa724131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa72b3f4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa724131dd0 0x7fa724132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa72b3f4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72409b6d0 con 0x7fa724131dd0 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa72b3f4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72409afb0 con 0x7fa72409e950 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa72b3f4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7240a0970 con 0x7fa72409f260 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa729190700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72409e950 0x7fa72409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa729190700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72409e950 0x7fa72409ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43550/0 (socket says 172.21.15.154:43550) 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa729190700 1 -- 172.21.15.154:0/4146902764 learned_addr learned my addr 172.21.15.154:0/4146902764 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa72898f700 1 --2- 172.21.15.154:0/4146902764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa724131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.987+0000 7fa729991700 1 --2- 172.21.15.154:0/4146902764 >> v2:172.21.15.154:3300/0 conn(0x7fa724131dd0 0x7fa724132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.988+0000 7fa729190700 1 -- 172.21.15.154:0/4146902764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 msgr2=0x7fa724131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.988+0000 7fa729190700 1 --2- 172.21.15.154:0/4146902764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa724131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.988+0000 7fa729190700 1 -- 172.21.15.154:0/4146902764 >> v2:172.21.15.154:3300/0 conn(0x7fa724131dd0 msgr2=0x7fa724132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.988+0000 7fa729190700 1 --2- 172.21.15.154:0/4146902764 >> v2:172.21.15.154:3300/0 conn(0x7fa724131dd0 0x7fa724132250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.988+0000 7fa729190700 1 -- 172.21.15.154:0/4146902764 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7240a0320 con 0x7fa72409e950 2023-09-30T22:24:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.988+0000 7fa729190700 1 --2- 172.21.15.154:0/4146902764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72409e950 0x7fa72409ed20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa720006fd0 tx=0x7fa720009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1465251ba764316 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.988+0000 7fa71bfff700 1 -- 172.21.15.154:0/4146902764 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa720005e30 con 0x7fa72409e950 2023-09-30T22:24:06.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.988+0000 7fa71bfff700 1 -- 172.21.15.154:0/4146902764 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa720004030 con 0x7fa72409e950 2023-09-30T22:24:06.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.988+0000 7fa71bfff700 1 -- 172.21.15.154:0/4146902764 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200043e0 con 0x7fa72409e950 2023-09-30T22:24:06.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.989+0000 7fa72b3f4700 1 -- 172.21.15.154:0/4146902764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72409e950 msgr2=0x7fa72409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.989+0000 7fa72b3f4700 1 --2- 172.21.15.154:0/4146902764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72409e950 0x7fa72409ed20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa720006fd0 tx=0x7fa720009bd0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.989+0000 7fa72b3f4700 1 -- 172.21.15.154:0/4146902764 shutdown_connections 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.989+0000 7fa72b3f4700 1 --2- 172.21.15.154:0/4146902764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72409e950 0x7fa72409ed20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.989+0000 7fa72b3f4700 1 --2- 172.21.15.154:0/4146902764 >> v2:172.21.15.154:3300/0 conn(0x7fa724131dd0 0x7fa724132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.989+0000 7fa72b3f4700 1 --2- 172.21.15.154:0/4146902764 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa724131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.989+0000 7fa72b3f4700 1 -- 172.21.15.154:0/4146902764 >> 172.21.15.154:0/4146902764 conn(0x7fa7240a0f70 msgr2=0x7fa7240a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.989+0000 7fa72b3f4700 1 -- 172.21.15.154:0/4146902764 shutdown_connections 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.989+0000 7fa72b3f4700 1 -- 172.21.15.154:0/4146902764 wait complete. 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72b3f4700 1 Processor -- start 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72b3f4700 1 -- start start 2023-09-30T22:24:06.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72b3f4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72409e950 0x7fa72411f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72b3f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa72411f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72b3f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa724131dd0 0x7fa72411fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72b3f4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa724122b40 con 0x7fa72409e950 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72b3f4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa724130630 con 0x7fa724131dd0 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72b3f4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7241227e0 con 0x7fa72409f260 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72898f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa72411f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.990+0000 7fa72898f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa72411f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55500/0 (socket says 172.21.15.154:55500) 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa72898f700 1 -- 172.21.15.154:0/3896515840 learned_addr learned my addr 172.21.15.154:0/3896515840 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa729991700 1 --2- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa724131dd0 0x7fa72411fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa729190700 1 --2- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72409e950 0x7fa72411f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:06.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa72898f700 1 -- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa724131dd0 msgr2=0x7fa72411fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa72898f700 1 --2- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa724131dd0 0x7fa72411fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa72898f700 1 -- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72409e950 msgr2=0x7fa72411f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa72898f700 1 --2- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72409e950 0x7fa72411f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa72898f700 1 -- 172.21.15.154:0/3896515840 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa720009500 con 0x7fa72409f260 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa72898f700 1 --2- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa72411f7f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa71400e9e0 tx=0x7fa71400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa719ffb700 1 -- 172.21.15.154:0/3896515840 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71400ee80 con 0x7fa72409f260 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa719ffb700 1 -- 172.21.15.154:0/3896515840 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71400c850 con 0x7fa72409f260 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa719ffb700 1 -- 172.21.15.154:0/3896515840 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71400cbc0 con 0x7fa72409f260 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.991+0000 7fa72b3f4700 1 -- 172.21.15.154:0/3896515840 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa724121d00 con 0x7fa72409f260 2023-09-30T22:24:06.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.992+0000 7fa72b3f4700 1 -- 172.21.15.154:0/3896515840 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa724122510 con 0x7fa72409f260 2023-09-30T22:24:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.993+0000 7fa719ffb700 1 -- 172.21.15.154:0/3896515840 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa71400cd20 con 0x7fa72409f260 2023-09-30T22:24:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.993+0000 7fa72b3f4700 1 -- 172.21.15.154:0/3896515840 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7241220c0 con 0x7fa72409f260 2023-09-30T22:24:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:06.993+0000 7fa719ffb700 1 -- 172.21.15.154:0/3896515840 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa714047350 con 0x7fa72409f260 2023-09-30T22:24:07.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.002+0000 7fa719ffb700 1 -- 172.21.15.154:0/3896515840 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa714044060 con 0x7fa72409f260 2023-09-30T22:24:07.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.030+0000 7f1ff1353700 1 -- 172.21.15.154:0/4216326945 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1fec04f2a0 con 0x7f1fec06a770 2023-09-30T22:24:07.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.031+0000 7f1fd37fe700 1 -- 172.21.15.154:0/4216326945 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fdc027020 con 0x7f1fec06a770 2023-09-30T22:24:07.032 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.034+0000 7f1ff1353700 1 -- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec06a770 msgr2=0x7f1fec11bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.034+0000 7f1ff1353700 1 --2- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec06a770 0x7f1fec11bef0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1fec09ec60 tx=0x7f1fdc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.034+0000 7f1ff1353700 1 -- 172.21.15.154:0/4216326945 shutdown_connections 2023-09-30T22:24:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.034+0000 7f1ff1353700 1 --2- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec131ec0 0x7f1fec11c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.034+0000 7f1ff1353700 1 --2- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fec06a770 0x7f1fec11bef0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.034+0000 7f1ff1353700 1 --2- 172.21.15.154:0/4216326945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fec06b080 0x7f1fec11c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.034+0000 7f1ff1353700 1 -- 172.21.15.154:0/4216326945 >> 172.21.15.154:0/4216326945 conn(0x7f1fec099c40 msgr2=0x7f1fec130c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.036+0000 7f1ff1353700 1 -- 172.21.15.154:0/4216326945 shutdown_connections 2023-09-30T22:24:07.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.036+0000 7f1ff1353700 1 -- 172.21.15.154:0/4216326945 wait complete. 2023-09-30T22:24:07.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:07.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.100+0000 7f4acca39700 1 -- 172.21.15.154:0/667537491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4ac804f2a0 con 0x7f4ac8133f70 2023-09-30T22:24:07.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.100+0000 7f4ab6ffd700 1 -- 172.21.15.154:0/667537491 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4abc019b20 con 0x7f4ac8133f70 2023-09-30T22:24:07.101 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.102+0000 7f4acca39700 1 -- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac8133f70 msgr2=0x7f4ac81c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.102+0000 7f4acca39700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac8133f70 0x7f4ac81c8cf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c450 tx=0x7f4abc00c760 comp rx=0 tx=0).stop 2023-09-30T22:24:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.102+0000 7f4acca39700 1 -- 172.21.15.154:0/667537491 shutdown_connections 2023-09-30T22:24:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.102+0000 7f4acca39700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ac81343d0 0x7f4ac81c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.102+0000 7f4acca39700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ac809ad40 0x7f4ac81c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.102+0000 7f4acca39700 1 --2- 172.21.15.154:0/667537491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ac8133f70 0x7f4ac81c8cf0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.102+0000 7f4acca39700 1 -- 172.21.15.154:0/667537491 >> 172.21.15.154:0/667537491 conn(0x7f4ac8099c40 msgr2=0x7f4ac8132200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.102+0000 7f4acca39700 1 -- 172.21.15.154:0/667537491 shutdown_connections 2023-09-30T22:24:07.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.102+0000 7f4acca39700 1 -- 172.21.15.154:0/667537491 wait complete. 2023-09-30T22:24:07.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:07.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.143+0000 7f556e152700 1 -- 172.21.15.154:0/989915961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5548005860 con 0x7f5568133ad0 2023-09-30T22:24:07.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.143+0000 7f554ffff700 1 -- 172.21.15.154:0/989915961 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f556002e090 con 0x7f5568133ad0 2023-09-30T22:24:07.144 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:07.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.145+0000 7f556e152700 1 -- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 msgr2=0x7f556811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.145+0000 7f556e152700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f556811e4c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f556000efc0 tx=0x7f556000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.145+0000 7f556e152700 1 -- 172.21.15.154:0/989915961 shutdown_connections 2023-09-30T22:24:07.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.145+0000 7f556e152700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5568133ad0 0x7f556811e4c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.145+0000 7f556e152700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55681300a0 0x7f556811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.145+0000 7f556e152700 1 --2- 172.21.15.154:0/989915961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5568130bc0 0x7f556811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.145+0000 7f556e152700 1 -- 172.21.15.154:0/989915961 >> 172.21.15.154:0/989915961 conn(0x7f5568099c40 msgr2=0x7f556812e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.145+0000 7f556e152700 1 -- 172.21.15.154:0/989915961 shutdown_connections 2023-09-30T22:24:07.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.146+0000 7f556e152700 1 -- 172.21.15.154:0/989915961 wait complete. 2023-09-30T22:24:07.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.214+0000 7fa72b3f4700 1 -- 172.21.15.154:0/3896515840 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa72411bec0 con 0x7fa72409f260 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.214+0000 7fa719ffb700 1 -- 172.21.15.154:0/3896515840 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa71403de60 con 0x7fa72409f260 2023-09-30T22:24:07.215 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:07.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.216+0000 7fa72b3f4700 1 -- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 msgr2=0x7fa72411f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:07.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.216+0000 7fa72b3f4700 1 --2- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa72411f7f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa71400e9e0 tx=0x7fa71400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.216+0000 7fa72b3f4700 1 -- 172.21.15.154:0/3896515840 shutdown_connections 2023-09-30T22:24:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.216+0000 7fa72b3f4700 1 --2- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa724131dd0 0x7fa72411fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.216+0000 7fa72b3f4700 1 --2- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72409e950 0x7fa72411f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.216+0000 7fa72b3f4700 1 --2- 172.21.15.154:0/3896515840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa72409f260 0x7fa72411f7f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.216+0000 7fa72b3f4700 1 -- 172.21.15.154:0/3896515840 >> 172.21.15.154:0/3896515840 conn(0x7fa7240a0f70 msgr2=0x7fa724131100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.216+0000 7fa72b3f4700 1 -- 172.21.15.154:0/3896515840 shutdown_connections 2023-09-30T22:24:07.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:07.216+0000 7fa72b3f4700 1 -- 172.21.15.154:0/3896515840 wait complete. 2023-09-30T22:24:07.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:08.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:08.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:08.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:08.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.197+0000 7fb6f23ef700 1 Processor -- start 2023-09-30T22:24:08.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.197+0000 7fb6f23ef700 1 -- start start 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.197+0000 7fb6f23ef700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6ec099e20 0x7fb6ec09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.197+0000 7fb6f23ef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec09a730 0x7fb6ec130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.197+0000 7fb6f23ef700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec099a60 con 0x7fb6ec130890 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.197+0000 7fb6f23ef700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec09bf50 con 0x7fb6ec099e20 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.197+0000 7fb6f23ef700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec09b230 con 0x7fb6ec09a730 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6ebfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6ec099e20 0x7fb6ec09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6ebfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6ec099e20 0x7fb6ec09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33966/0 (socket says 172.21.15.154:33966) 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec09a730 0x7fb6ec130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6ebfff700 1 -- 172.21.15.154:0/173098471 learned_addr learned my addr 172.21.15.154:0/173098471 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/173098471 >> v2:172.21.15.154:3300/0 conn(0x7fb6ec099e20 msgr2=0x7fb6ec09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eb7fe700 1 --2- 172.21.15.154:0/173098471 >> v2:172.21.15.154:3300/0 conn(0x7fb6ec099e20 0x7fb6ec09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/173098471 >> v1:172.21.15.154:6789/0 conn(0x7fb6ec130890 legacy=0x7fb6ec137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eb7fe700 1 -- 172.21.15.154:0/173098471 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec09bb90 con 0x7fb6ec09a730 2023-09-30T22:24:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eaffd700 1 -- 172.21.15.154:0/173098471 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599650573 0 0) 0x7fb6ec099a60 con 0x7fb6ec130890 2023-09-30T22:24:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6ebfff700 1 --2- 172.21.15.154:0/173098471 >> v2:172.21.15.154:3300/0 conn(0x7fb6ec099e20 0x7fb6ec09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eb7fe700 1 --2- 172.21.15.154:0/173098471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec09a730 0x7fb6ec130350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009840 tx=0x7fb6e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39622deed3e3523f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eaffd700 1 -- 172.21.15.154:0/173098471 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0011830 con 0x7fb6ec09a730 2023-09-30T22:24:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eaffd700 1 -- 172.21.15.154:0/173098471 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e0011990 con 0x7fb6ec09a730 2023-09-30T22:24:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.198+0000 7fb6eaffd700 1 -- 172.21.15.154:0/173098471 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0011d20 con 0x7fb6ec09a730 2023-09-30T22:24:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.199+0000 7fb6f23ef700 1 -- 172.21.15.154:0/173098471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec09a730 msgr2=0x7fb6ec130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.199+0000 7fb6f23ef700 1 --2- 172.21.15.154:0/173098471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec09a730 0x7fb6ec130350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009840 tx=0x7fb6e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.199+0000 7fb6f23ef700 1 -- 172.21.15.154:0/173098471 shutdown_connections 2023-09-30T22:24:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.199+0000 7fb6f23ef700 1 --2- 172.21.15.154:0/173098471 >> v2:172.21.15.154:3300/0 conn(0x7fb6ec099e20 0x7fb6ec09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.199+0000 7fb6f23ef700 1 --2- 172.21.15.154:0/173098471 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec09a730 0x7fb6ec130350 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.199+0000 7fb6f23ef700 1 -- 172.21.15.154:0/173098471 >> 172.21.15.154:0/173098471 conn(0x7fb6ec0a2980 msgr2=0x7fb6ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.199+0000 7fb6f23ef700 1 -- 172.21.15.154:0/173098471 shutdown_connections 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.199+0000 7fb6f23ef700 1 -- 172.21.15.154:0/173098471 wait complete. 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.200+0000 7fb6f23ef700 1 Processor -- start 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.200+0000 7fb6f23ef700 1 -- start start 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f23ef700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6ec099e20 0x7fb6ec136000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f23ef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6ec09a730 0x7fb6ec138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f23ef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec130890 0x7fb6ec1392e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f23ef700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec1379c0 con 0x7fb6ec099e20 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f23ef700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec13a8f0 con 0x7fb6ec09a730 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f23ef700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec12dcb0 con 0x7fb6ec130890 2023-09-30T22:24:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6ebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6ec099e20 0x7fb6ec136000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6ebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6ec099e20 0x7fb6ec136000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33976/0 (socket says 172.21.15.154:33976) 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6ebfff700 1 -- 172.21.15.154:0/2471699394 learned_addr learned my addr 172.21.15.154:0/2471699394 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f098c700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec130890 0x7fb6ec1392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6eb7fe700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6ec09a730 0x7fb6ec138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f098c700 1 -- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6ec09a730 msgr2=0x7fb6ec138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f098c700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6ec09a730 0x7fb6ec138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f098c700 1 -- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6ec099e20 msgr2=0x7fb6ec136000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f098c700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6ec099e20 0x7fb6ec136000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6f098c700 1 -- 172.21.15.154:0/2471699394 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc009500 con 0x7fb6ec130890 2023-09-30T22:24:08.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6ebfff700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6ec099e20 0x7fb6ec136000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.201+0000 7fb6eb7fe700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6ec09a730 0x7fb6ec138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.202+0000 7fb6f098c700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec130890 0x7fb6ec1392e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c7c0 tx=0x7fb6e400cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.202+0000 7fb6e8ff9700 1 -- 172.21.15.154:0/2471699394 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4003e30 con 0x7fb6ec130890 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.202+0000 7fb6e8ff9700 1 -- 172.21.15.154:0/2471699394 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e4005070 con 0x7fb6ec130890 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.202+0000 7fb6f23ef700 1 -- 172.21.15.154:0/2471699394 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e00094a0 con 0x7fb6ec130890 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.202+0000 7fb6e8ff9700 1 -- 172.21.15.154:0/2471699394 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4005420 con 0x7fb6ec130890 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.202+0000 7fb6f23ef700 1 -- 172.21.15.154:0/2471699394 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec136540 con 0x7fb6ec130890 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.203+0000 7fb6f23ef700 1 -- 172.21.15.154:0/2471699394 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec072480 con 0x7fb6ec130890 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.203+0000 7fb6e8ff9700 1 -- 172.21.15.154:0/2471699394 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6e4005580 con 0x7fb6ec130890 2023-09-30T22:24:08.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.204+0000 7fb6e8ff9700 1 -- 172.21.15.154:0/2471699394 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb6e403ef30 con 0x7fb6ec130890 2023-09-30T22:24:08.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.212+0000 7fb6e8ff9700 1 -- 172.21.15.154:0/2471699394 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6e401b3b0 con 0x7fb6ec130890 2023-09-30T22:24:08.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:08.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.256+0000 7f29d0ebb700 1 Processor -- start 2023-09-30T22:24:08.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.256+0000 7f29d0ebb700 1 -- start start 2023-09-30T22:24:08.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.256+0000 7f29d0ebb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29cc1350d0 0x7f29cc13ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.256+0000 7f29d0ebb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc13d210 0x7f29cc13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.256+0000 7f29d0ebb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29cc09eca0 con 0x7f29cc06a770 2023-09-30T22:24:08.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.256+0000 7f29d0ebb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc06b2e0 con 0x7f29cc1350d0 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.256+0000 7f29d0ebb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc09f720 con 0x7f29cc13d210 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29cc1350d0 0x7f29cc13ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29cc1350d0 0x7f29cc13ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33992/0 (socket says 172.21.15.154:33992) 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c9d9b700 1 -- 172.21.15.154:0/3892425132 learned_addr learned my addr 172.21.15.154:0/3892425132 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29cad9d700 1 --2- 172.21.15.154:0/3892425132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc13d210 0x7f29cc13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c9d9b700 1 -- 172.21.15.154:0/3892425132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc13d210 msgr2=0x7f29cc13f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c9d9b700 1 --2- 172.21.15.154:0/3892425132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc13d210 0x7f29cc13f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c9d9b700 1 -- 172.21.15.154:0/3892425132 >> v1:172.21.15.154:6789/0 conn(0x7f29cc06a770 legacy=0x7f29cc1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c9d9b700 1 -- 172.21.15.154:0/3892425132 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc06b480 con 0x7f29cc1350d0 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c9d9b700 1 --2- 172.21.15.154:0/3892425132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc1350d0 0x7f29cc13ccd0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f29b40098f0 tx=0x7f29b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f8b7179d98adce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c959a700 1 -- 172.21.15.154:0/3892425132 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4011830 con 0x7f29cc1350d0 2023-09-30T22:24:08.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c959a700 1 -- 172.21.15.154:0/3892425132 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4011990 con 0x7f29cc1350d0 2023-09-30T22:24:08.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.257+0000 7f29c959a700 1 -- 172.21.15.154:0/3892425132 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4011d20 con 0x7f29cc1350d0 2023-09-30T22:24:08.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.258+0000 7f29d0ebb700 1 -- 172.21.15.154:0/3892425132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc1350d0 msgr2=0x7f29cc13ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.258+0000 7f29d0ebb700 1 --2- 172.21.15.154:0/3892425132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc1350d0 0x7f29cc13ccd0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f29b40098f0 tx=0x7f29b4009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:08.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.258+0000 7f29d0ebb700 1 -- 172.21.15.154:0/3892425132 shutdown_connections 2023-09-30T22:24:08.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.258+0000 7f29d0ebb700 1 --2- 172.21.15.154:0/3892425132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc13d210 0x7f29cc13f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.258+0000 7f29d0ebb700 1 --2- 172.21.15.154:0/3892425132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc1350d0 0x7f29cc13ccd0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.258+0000 7f29d0ebb700 1 -- 172.21.15.154:0/3892425132 >> 172.21.15.154:0/3892425132 conn(0x7f29cc099c40 msgr2=0x7f29cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.258+0000 7f29d0ebb700 1 -- 172.21.15.154:0/3892425132 shutdown_connections 2023-09-30T22:24:08.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.258+0000 7f29d0ebb700 1 -- 172.21.15.154:0/3892425132 wait complete. 2023-09-30T22:24:08.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.260+0000 7f29d0ebb700 1 Processor -- start 2023-09-30T22:24:08.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.260+0000 7f29d0ebb700 1 -- start start 2023-09-30T22:24:08.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29d0ebb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29cc06a770 0x7f29cc132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29d0ebb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc1350d0 0x7f29cc1333d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29d0ebb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc13d210 0x7f29cc133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29d0ebb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc134270 con 0x7f29cc13d210 2023-09-30T22:24:08.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29d0ebb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc139290 con 0x7f29cc06a770 2023-09-30T22:24:08.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29d0ebb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc09f220 con 0x7f29cc1350d0 2023-09-30T22:24:08.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29cad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc13d210 0x7f29cc133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29c9d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc1350d0 0x7f29cc1333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29ca59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29cc06a770 0x7f29cc132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29cad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc13d210 0x7f29cc133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33994/0 (socket says 172.21.15.154:33994) 2023-09-30T22:24:08.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29cad9d700 1 -- 172.21.15.154:0/1460218997 learned_addr learned my addr 172.21.15.154:0/1460218997 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:08.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29ca59c700 1 -- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc1350d0 msgr2=0x7f29cc1333d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29ca59c700 1 --2- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc1350d0 0x7f29cc1333d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29ca59c700 1 -- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc13d210 msgr2=0x7f29cc133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29ca59c700 1 --2- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc13d210 0x7f29cc133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.261+0000 7f29ca59c700 1 -- 172.21.15.154:0/1460218997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4009550 con 0x7f29cc06a770 2023-09-30T22:24:08.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.262+0000 7f29ca59c700 1 --2- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29cc06a770 0x7f29cc132e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f29c400cb10 tx=0x7f29c400ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.262+0000 7f29c2ffd700 1 -- 172.21.15.154:0/1460218997 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4003c00 con 0x7f29cc06a770 2023-09-30T22:24:08.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.262+0000 7f29c2ffd700 1 -- 172.21.15.154:0/1460218997 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4003d60 con 0x7f29cc06a770 2023-09-30T22:24:08.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.262+0000 7f29d0ebb700 1 -- 172.21.15.154:0/1460218997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc139550 con 0x7f29cc06a770 2023-09-30T22:24:08.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.262+0000 7f29c2ffd700 1 -- 172.21.15.154:0/1460218997 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c400aa20 con 0x7f29cc06a770 2023-09-30T22:24:08.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.262+0000 7f29d0ebb700 1 -- 172.21.15.154:0/1460218997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc0717d0 con 0x7f29cc06a770 2023-09-30T22:24:08.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.262+0000 7f29c2ffd700 1 -- 172.21.15.154:0/1460218997 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29c400ab80 con 0x7f29cc06a770 2023-09-30T22:24:08.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.263+0000 7f29c2ffd700 1 -- 172.21.15.154:0/1460218997 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29c403f570 con 0x7f29cc06a770 2023-09-30T22:24:08.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.263+0000 7f29d0ebb700 1 -- 172.21.15.154:0/1460218997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29cc04f2a0 con 0x7f29cc06a770 2023-09-30T22:24:08.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.272+0000 7f29c2ffd700 1 -- 172.21.15.154:0/1460218997 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29c4012420 con 0x7f29cc06a770 2023-09-30T22:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.313+0000 7f77f6d8d700 1 Processor -- start 2023-09-30T22:24:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.313+0000 7f77f6d8d700 1 -- start start 2023-09-30T22:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f6d8d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77f0133900 0x7f77f0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f6d8d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f00a10b0 0x7f77f013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f6d8d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f009a760 con 0x7f77f0134210 2023-09-30T22:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f6d8d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f01336e0 con 0x7f77f0133900 2023-09-30T22:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f6d8d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77f009a080 con 0x7f77f00a10b0 2023-09-30T22:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f4b29700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77f0133900 0x7f77f0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f4b29700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77f0133900 0x7f77f0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34002/0 (socket says 172.21.15.154:34002) 2023-09-30T22:24:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f4b29700 1 -- 172.21.15.154:0/2520792380 learned_addr learned my addr 172.21.15.154:0/2520792380 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f532a700 1 --2- 172.21.15.154:0/2520792380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f00a10b0 0x7f77f013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f4b29700 1 -- 172.21.15.154:0/2520792380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f00a10b0 msgr2=0x7f77f013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f4b29700 1 --2- 172.21.15.154:0/2520792380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f00a10b0 0x7f77f013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f4b29700 1 -- 172.21.15.154:0/2520792380 >> v1:172.21.15.154:6789/0 conn(0x7f77f0134210 legacy=0x7f77f00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.314+0000 7f77f4b29700 1 -- 172.21.15.154:0/2520792380 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f00a23e0 con 0x7f77f0133900 2023-09-30T22:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.315+0000 7f77f4b29700 1 --2- 172.21.15.154:0/2520792380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 0x7f77f0133cd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006fd0 tx=0x7f77e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5dbc3e606ed07a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.315+0000 7f77ef7fe700 1 -- 172.21.15.154:0/2520792380 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4005e30 con 0x7f77f0133900 2023-09-30T22:24:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.315+0000 7f77ef7fe700 1 -- 172.21.15.154:0/2520792380 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e4004030 con 0x7f77f0133900 2023-09-30T22:24:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.315+0000 7f77ef7fe700 1 -- 172.21.15.154:0/2520792380 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40043e0 con 0x7f77f0133900 2023-09-30T22:24:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.316+0000 7f77f6d8d700 1 -- 172.21.15.154:0/2520792380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 msgr2=0x7f77f0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.316+0000 7f77f6d8d700 1 --2- 172.21.15.154:0/2520792380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 0x7f77f0133cd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006fd0 tx=0x7f77e4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.316+0000 7f77f6d8d700 1 -- 172.21.15.154:0/2520792380 shutdown_connections 2023-09-30T22:24:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.316+0000 7f77f6d8d700 1 --2- 172.21.15.154:0/2520792380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f00a10b0 0x7f77f013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.316+0000 7f77f6d8d700 1 --2- 172.21.15.154:0/2520792380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 0x7f77f0133cd0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.316+0000 7f77f6d8d700 1 -- 172.21.15.154:0/2520792380 >> 172.21.15.154:0/2520792380 conn(0x7f77f00a2980 msgr2=0x7f77f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.316+0000 7f77f6d8d700 1 -- 172.21.15.154:0/2520792380 shutdown_connections 2023-09-30T22:24:08.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.316+0000 7f77f6d8d700 1 -- 172.21.15.154:0/2520792380 wait complete. 2023-09-30T22:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.317+0000 7f77f6d8d700 1 Processor -- start 2023-09-30T22:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.317+0000 7f77f6d8d700 1 -- start start 2023-09-30T22:24:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77f6d8d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77f00a10b0 0x7f77f011c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77f6d8d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 0x7f77f011ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77f6d8d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f0134210 0x7f77f011d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77f6d8d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f011f120 con 0x7f77f0133900 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77f6d8d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f011dc60 con 0x7f77f00a10b0 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77f6d8d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77f011e320 con 0x7f77f0134210 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77effff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 0x7f77f011ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77f532a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f0134210 0x7f77f011d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77effff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 0x7f77f011ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34006/0 (socket says 172.21.15.154:34006) 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77f532a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f0134210 0x7f77f011d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55550/0 (socket says 172.21.15.154:55550) 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.318+0000 7f77effff700 1 -- 172.21.15.154:0/1402041456 learned_addr learned my addr 172.21.15.154:0/1402041456 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:08.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77f532a700 1 -- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77f00a10b0 msgr2=0x7f77f011c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77f532a700 1 --2- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77f00a10b0 0x7f77f011c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77f532a700 1 -- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 msgr2=0x7f77f011ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77f532a700 1 --2- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 0x7f77f011ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77f532a700 1 -- 172.21.15.154:0/1402041456 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e4009500 con 0x7f77f0134210 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77f532a700 1 --2- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f0134210 0x7f77f011d230 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009d90 tx=0x7f77e800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77ed7fa700 1 -- 172.21.15.154:0/1402041456 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8009c00 con 0x7f77f0134210 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77ed7fa700 1 -- 172.21.15.154:0/1402041456 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e800f040 con 0x7f77f0134210 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77f6d8d700 1 -- 172.21.15.154:0/1402041456 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f011f5e0 con 0x7f77f0134210 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77ed7fa700 1 -- 172.21.15.154:0/1402041456 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8014480 con 0x7f77f0134210 2023-09-30T22:24:08.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.319+0000 7f77f6d8d700 1 -- 172.21.15.154:0/1402041456 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f011ff50 con 0x7f77f0134210 2023-09-30T22:24:08.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.320+0000 7f77ed7fa700 1 -- 172.21.15.154:0/1402041456 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77e80145e0 con 0x7f77f0134210 2023-09-30T22:24:08.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.320+0000 7f77ed7fa700 1 -- 172.21.15.154:0/1402041456 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f77e8040370 con 0x7f77f0134210 2023-09-30T22:24:08.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.320+0000 7f77f6d8d700 1 -- 172.21.15.154:0/1402041456 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f004f2a0 con 0x7f77f0134210 2023-09-30T22:24:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.328+0000 7f77ed7fa700 1 -- 172.21.15.154:0/1402041456 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77e8012700 con 0x7f77f0134210 2023-09-30T22:24:08.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.373+0000 7f282a5f1700 1 Processor -- start 2023-09-30T22:24:08.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.373+0000 7f282a5f1700 1 -- start start 2023-09-30T22:24:08.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f282a5f1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 0x7f2824138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f282a5f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2824139200 0x7f282413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f282a5f1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282409e9d0 con 0x7f28240a0a70 2023-09-30T22:24:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f282a5f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282409dc00 con 0x7f2824139200 2023-09-30T22:24:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f282a5f1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282409dec0 con 0x7f28240a1550 2023-09-30T22:24:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f2823fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f28240a0a70 0x7f28240a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55842/0 (socket says 172.21.15.154:55842) 2023-09-30T22:24:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f28237fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 0x7f2824138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f2823fff700 1 -- 172.21.15.154:0/3407103524 learned_addr learned my addr 172.21.15.154:0/3407103524 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f2828b8e700 1 --2- 172.21.15.154:0/3407103524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2824139200 0x7f282413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.374+0000 7f28237fe700 1 -- 172.21.15.154:0/3407103524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2824139200 msgr2=0x7f282413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f28237fe700 1 --2- 172.21.15.154:0/3407103524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2824139200 0x7f282413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f28237fe700 1 -- 172.21.15.154:0/3407103524 >> v1:172.21.15.154:6789/0 conn(0x7f28240a0a70 legacy=0x7f28240a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f28237fe700 1 -- 172.21.15.154:0/3407103524 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282409e6a0 con 0x7f28240a1550 2023-09-30T22:24:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f2828b8e700 1 --2- 172.21.15.154:0/3407103524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2824139200 0x7f282413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f28237fe700 1 --2- 172.21.15.154:0/3407103524 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 0x7f2824138cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2818009870 tx=0x7f2818009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1790321b998d602 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f2822ffd700 1 -- 172.21.15.154:0/3407103524 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818011830 con 0x7f28240a1550 2023-09-30T22:24:08.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f2822ffd700 1 -- 172.21.15.154:0/3407103524 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2818011990 con 0x7f28240a1550 2023-09-30T22:24:08.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f2822ffd700 1 -- 172.21.15.154:0/3407103524 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818011d20 con 0x7f28240a1550 2023-09-30T22:24:08.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f282a5f1700 1 -- 172.21.15.154:0/3407103524 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 msgr2=0x7f2824138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.375+0000 7f282a5f1700 1 --2- 172.21.15.154:0/3407103524 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 0x7f2824138cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2818009870 tx=0x7f2818009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:08.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.376+0000 7f282a5f1700 1 -- 172.21.15.154:0/3407103524 shutdown_connections 2023-09-30T22:24:08.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.376+0000 7f282a5f1700 1 --2- 172.21.15.154:0/3407103524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2824139200 0x7f282413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.376+0000 7f282a5f1700 1 --2- 172.21.15.154:0/3407103524 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 0x7f2824138cc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.376+0000 7f282a5f1700 1 -- 172.21.15.154:0/3407103524 >> 172.21.15.154:0/3407103524 conn(0x7f28240a6610 msgr2=0x7f28240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.376+0000 7f282a5f1700 1 -- 172.21.15.154:0/3407103524 shutdown_connections 2023-09-30T22:24:08.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.376+0000 7f282a5f1700 1 -- 172.21.15.154:0/3407103524 wait complete. 2023-09-30T22:24:08.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.376+0000 7f282a5f1700 1 Processor -- start 2023-09-30T22:24:08.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f282a5f1700 1 -- start start 2023-09-30T22:24:08.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f282a5f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28240a0a70 0x7f28241c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f282a5f1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 0x7f28241c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f282a5f1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824139200 0x7f28241c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:08.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f282a5f1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2824121d50 con 0x7f2824139200 2023-09-30T22:24:08.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f282a5f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28240a03e0 con 0x7f28240a0a70 2023-09-30T22:24:08.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f282a5f1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2824122020 con 0x7f28240a1550 2023-09-30T22:24:08.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f2828b8e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824139200 0x7f28241c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f2828b8e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824139200 0x7f28241c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34010/0 (socket says 172.21.15.154:34010) 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f2828b8e700 1 -- 172.21.15.154:0/3730258901 learned_addr learned my addr 172.21.15.154:0/3730258901 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.377+0000 7f2823fff700 1 --2- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28240a0a70 0x7f28241c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f28237fe700 1 --2- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 0x7f28241c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f2828b8e700 1 -- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 msgr2=0x7f28241c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f2828b8e700 1 --2- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 0x7f28241c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f2828b8e700 1 -- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28240a0a70 msgr2=0x7f28241c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f2828b8e700 1 --2- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28240a0a70 0x7f28241c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f2828b8e700 1 -- 172.21.15.154:0/3730258901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180094a0 con 0x7f2824139200 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f2828b8e700 1 --2- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824139200 0x7f28241c8f70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ce80 tx=0x7f281c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f2820ff9700 1 -- 172.21.15.154:0/3730258901 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00ad40 con 0x7f2824139200 2023-09-30T22:24:08.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f2820ff9700 1 -- 172.21.15.154:0/3730258901 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c015440 con 0x7f2824139200 2023-09-30T22:24:08.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f282a5f1700 1 -- 172.21.15.154:0/3730258901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2824121320 con 0x7f2824139200 2023-09-30T22:24:08.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f2820ff9700 1 -- 172.21.15.154:0/3730258901 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00aea0 con 0x7f2824139200 2023-09-30T22:24:08.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.378+0000 7f282a5f1700 1 -- 172.21.15.154:0/3730258901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28241225c0 con 0x7f2824139200 2023-09-30T22:24:08.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.379+0000 7f2820ff9700 1 -- 172.21.15.154:0/3730258901 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f281c00d430 con 0x7f2824139200 2023-09-30T22:24:08.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.380+0000 7f2820ff9700 1 -- 172.21.15.154:0/3730258901 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f281c03fb90 con 0x7f2824139200 2023-09-30T22:24:08.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.380+0000 7f282a5f1700 1 -- 172.21.15.154:0/3730258901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282404f2a0 con 0x7f2824139200 2023-09-30T22:24:08.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.385+0000 7f2820ff9700 1 -- 172.21.15.154:0/3730258901 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f281c01a080 con 0x7f2824139200 2023-09-30T22:24:08.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.431+0000 7fb6f23ef700 1 -- 172.21.15.154:0/2471699394 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6ec072480 con 0x7fb6ec130890 2023-09-30T22:24:08.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.432+0000 7fb6e8ff9700 1 -- 172.21.15.154:0/2471699394 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6ec072480 con 0x7fb6ec130890 2023-09-30T22:24:08.433 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.434+0000 7fb6f23ef700 1 -- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec130890 msgr2=0x7fb6ec1392e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.434+0000 7fb6f23ef700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec130890 0x7fb6ec1392e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c7c0 tx=0x7fb6e400cad0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.435+0000 7fb6f23ef700 1 -- 172.21.15.154:0/2471699394 shutdown_connections 2023-09-30T22:24:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.435+0000 7fb6f23ef700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6ec130890 0x7fb6ec1392e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.435+0000 7fb6f23ef700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6ec099e20 0x7fb6ec136000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.435+0000 7fb6f23ef700 1 --2- 172.21.15.154:0/2471699394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6ec09a730 0x7fb6ec138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.435+0000 7fb6f23ef700 1 -- 172.21.15.154:0/2471699394 >> 172.21.15.154:0/2471699394 conn(0x7fb6ec0a2980 msgr2=0x7fb6ec127f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.435+0000 7fb6f23ef700 1 -- 172.21.15.154:0/2471699394 shutdown_connections 2023-09-30T22:24:08.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.435+0000 7fb6f23ef700 1 -- 172.21.15.154:0/2471699394 wait complete. 2023-09-30T22:24:08.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:08.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.494+0000 7f29d0ebb700 1 -- 172.21.15.154:0/1460218997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f29cc139790 con 0x7f29cc06a770 2023-09-30T22:24:08.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.494+0000 7f29c2ffd700 1 -- 172.21.15.154:0/1460218997 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29c401a360 con 0x7f29cc06a770 2023-09-30T22:24:08.495 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.497+0000 7f29d0ebb700 1 -- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29cc06a770 msgr2=0x7f29cc132e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.497+0000 7f29d0ebb700 1 --2- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29cc06a770 0x7f29cc132e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f29c400cb10 tx=0x7f29c400ce20 comp rx=0 tx=0).stop 2023-09-30T22:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.497+0000 7f29d0ebb700 1 -- 172.21.15.154:0/1460218997 shutdown_connections 2023-09-30T22:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.497+0000 7f29d0ebb700 1 --2- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29cc13d210 0x7f29cc133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.497+0000 7f29d0ebb700 1 --2- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29cc06a770 0x7f29cc132e90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.497+0000 7f29d0ebb700 1 --2- 172.21.15.154:0/1460218997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29cc1350d0 0x7f29cc1333d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.497+0000 7f29d0ebb700 1 -- 172.21.15.154:0/1460218997 >> 172.21.15.154:0/1460218997 conn(0x7f29cc099c40 msgr2=0x7f29cc09d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.497+0000 7f29d0ebb700 1 -- 172.21.15.154:0/1460218997 shutdown_connections 2023-09-30T22:24:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.497+0000 7f29d0ebb700 1 -- 172.21.15.154:0/1460218997 wait complete. 2023-09-30T22:24:08.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.529+0000 7f77f6d8d700 1 -- 172.21.15.154:0/1402041456 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77f006bce0 con 0x7f77f0134210 2023-09-30T22:24:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.529+0000 7f77ed7fa700 1 -- 172.21.15.154:0/1402041456 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77e802c090 con 0x7f77f0134210 2023-09-30T22:24:08.530 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:08.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.531+0000 7f77f6d8d700 1 -- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f0134210 msgr2=0x7f77f011d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.531+0000 7f77f6d8d700 1 --2- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f0134210 0x7f77f011d230 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009d90 tx=0x7f77e800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.531+0000 7f77f6d8d700 1 -- 172.21.15.154:0/1402041456 shutdown_connections 2023-09-30T22:24:08.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.531+0000 7f77f6d8d700 1 --2- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f0134210 0x7f77f011d230 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.531+0000 7f77f6d8d700 1 --2- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77f00a10b0 0x7f77f011c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.531+0000 7f77f6d8d700 1 --2- 172.21.15.154:0/1402041456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f0133900 0x7f77f011ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.531+0000 7f77f6d8d700 1 -- 172.21.15.154:0/1402041456 >> 172.21.15.154:0/1402041456 conn(0x7f77f00a2980 msgr2=0x7f77f01baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.531+0000 7f77f6d8d700 1 -- 172.21.15.154:0/1402041456 shutdown_connections 2023-09-30T22:24:08.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.531+0000 7f77f6d8d700 1 -- 172.21.15.154:0/1402041456 wait complete. 2023-09-30T22:24:08.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:08.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.595+0000 7f282a5f1700 1 -- 172.21.15.154:0/3730258901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f282409c640 con 0x7f2824139200 2023-09-30T22:24:08.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.595+0000 7f2820ff9700 1 -- 172.21.15.154:0/3730258901 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f281c008910 con 0x7f2824139200 2023-09-30T22:24:08.596 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:08.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.597+0000 7f282a5f1700 1 -- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824139200 msgr2=0x7f28241c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:08.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.597+0000 7f282a5f1700 1 --2- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824139200 0x7f28241c8f70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ce80 tx=0x7f281c00ceb0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.597+0000 7f282a5f1700 1 -- 172.21.15.154:0/3730258901 shutdown_connections 2023-09-30T22:24:08.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.597+0000 7f282a5f1700 1 --2- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824139200 0x7f28241c8f70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.597+0000 7f282a5f1700 1 --2- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28240a0a70 0x7f28241c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.597+0000 7f282a5f1700 1 --2- 172.21.15.154:0/3730258901 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28240a1550 0x7f28241c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:08.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.597+0000 7f282a5f1700 1 -- 172.21.15.154:0/3730258901 >> 172.21.15.154:0/3730258901 conn(0x7f28240a6610 msgr2=0x7f2824136ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:08.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.597+0000 7f282a5f1700 1 -- 172.21.15.154:0/3730258901 shutdown_connections 2023-09-30T22:24:08.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:08.597+0000 7f282a5f1700 1 -- 172.21.15.154:0/3730258901 wait complete. 2023-09-30T22:24:08.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:09.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:09.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:09.545 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:09.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.595+0000 7ff16d8ac700 1 Processor -- start 2023-09-30T22:24:09.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.595+0000 7ff16d8ac700 1 -- start start 2023-09-30T22:24:09.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.595+0000 7ff16d8ac700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff16809d860 0x7ff16809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.595+0000 7ff16d8ac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.595+0000 7ff16d8ac700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16809aaa0 con 0x7ff168130ce0 2023-09-30T22:24:09.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.595+0000 7ff16d8ac700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16809f870 con 0x7ff16809d860 2023-09-30T22:24:09.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.595+0000 7ff16d8ac700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16809b360 con 0x7ff16809e170 2023-09-30T22:24:09.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff1667fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff166ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff16809d860 0x7ff16809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff1667fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43628/0 (socket says 172.21.15.154:43628) 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff1667fc700 1 -- 172.21.15.154:0/3844467556 learned_addr learned my addr 172.21.15.154:0/3844467556 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff166ffd700 1 -- 172.21.15.154:0/3844467556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 msgr2=0x7ff1681307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff166ffd700 1 --2- 172.21.15.154:0/3844467556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff166ffd700 1 -- 172.21.15.154:0/3844467556 >> v1:172.21.15.154:6789/0 conn(0x7ff168130ce0 legacy=0x7ff1681379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff166ffd700 1 -- 172.21.15.154:0/3844467556 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16809b620 con 0x7ff16809d860 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff165ffb700 1 -- 172.21.15.154:0/3844467556 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377456221 0 0) 0x7ff16809aaa0 con 0x7ff168130ce0 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff166ffd700 1 --2- 172.21.15.154:0/3844467556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff16809d860 0x7ff16809dc30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff15800bae0 tx=0x7ff15800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34902b39f7cbe5fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff165ffb700 1 -- 172.21.15.154:0/3844467556 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800dc70 con 0x7ff16809d860 2023-09-30T22:24:09.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff165ffb700 1 -- 172.21.15.154:0/3844467556 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15800ddd0 con 0x7ff16809d860 2023-09-30T22:24:09.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.596+0000 7ff165ffb700 1 -- 172.21.15.154:0/3844467556 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158010690 con 0x7ff16809d860 2023-09-30T22:24:09.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.597+0000 7ff16d8ac700 1 -- 172.21.15.154:0/3844467556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff16809d860 msgr2=0x7ff16809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.597+0000 7ff16d8ac700 1 --2- 172.21.15.154:0/3844467556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff16809d860 0x7ff16809dc30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff15800bae0 tx=0x7ff15800bdf0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.597+0000 7ff16d8ac700 1 -- 172.21.15.154:0/3844467556 shutdown_connections 2023-09-30T22:24:09.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.597+0000 7ff16d8ac700 1 --2- 172.21.15.154:0/3844467556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff16809d860 0x7ff16809dc30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.597+0000 7ff16d8ac700 1 --2- 172.21.15.154:0/3844467556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.597+0000 7ff16d8ac700 1 -- 172.21.15.154:0/3844467556 >> 172.21.15.154:0/3844467556 conn(0x7ff168099c40 msgr2=0x7ff1680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.597+0000 7ff16d8ac700 1 -- 172.21.15.154:0/3844467556 shutdown_connections 2023-09-30T22:24:09.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.597+0000 7ff16d8ac700 1 -- 172.21.15.154:0/3844467556 wait complete. 2023-09-30T22:24:09.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.598+0000 7ff16d8ac700 1 Processor -- start 2023-09-30T22:24:09.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.598+0000 7ff16d8ac700 1 -- start start 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff16d8ac700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff16809d860 0x7ff1681baed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff16d8ac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681bb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff16d8ac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff168130ce0 0x7ff1681bb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff16d8ac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16811f550 con 0x7ff168130ce0 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff16d8ac700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1681bcae0 con 0x7ff16809e170 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff16d8ac700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680a05b0 con 0x7ff16809d860 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1677fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff168130ce0 0x7ff1681bb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1667fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681bb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1677fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff168130ce0 0x7ff1681bb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34032/0 (socket says 172.21.15.154:34032) 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1677fe700 1 -- 172.21.15.154:0/17337501 learned_addr learned my addr 172.21.15.154:0/17337501 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:09.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff166ffd700 1 --2- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff16809d860 0x7ff1681baed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1677fe700 1 -- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff16809d860 msgr2=0x7ff1681baed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1677fe700 1 --2- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff16809d860 0x7ff1681baed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1677fe700 1 -- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 msgr2=0x7ff1681bb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1677fe700 1 --2- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681bb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1677fe700 1 -- 172.21.15.154:0/17337501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15800b740 con 0x7ff168130ce0 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1667fc700 1 --2- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681bb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.599+0000 7ff1677fe700 1 --2- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff168130ce0 0x7ff1681bb950 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff160001560 tx=0x7ff16000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.600+0000 7ff14ffff700 1 -- 172.21.15.154:0/17337501 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160003e30 con 0x7ff168130ce0 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.600+0000 7ff14ffff700 1 -- 172.21.15.154:0/17337501 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160005070 con 0x7ff168130ce0 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.600+0000 7ff16d8ac700 1 -- 172.21.15.154:0/17337501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16811efb0 con 0x7ff168130ce0 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.600+0000 7ff14ffff700 1 -- 172.21.15.154:0/17337501 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160005420 con 0x7ff168130ce0 2023-09-30T22:24:09.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.600+0000 7ff16d8ac700 1 -- 172.21.15.154:0/17337501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16811fce0 con 0x7ff168130ce0 2023-09-30T22:24:09.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.601+0000 7ff14ffff700 1 -- 172.21.15.154:0/17337501 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff160005580 con 0x7ff168130ce0 2023-09-30T22:24:09.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.601+0000 7ff14ffff700 1 -- 172.21.15.154:0/17337501 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff16003ed00 con 0x7ff168130ce0 2023-09-30T22:24:09.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.601+0000 7ff16d8ac700 1 -- 172.21.15.154:0/17337501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16804f2a0 con 0x7ff168130ce0 2023-09-30T22:24:09.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.606+0000 7ff14ffff700 1 -- 172.21.15.154:0/17337501 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff160017070 con 0x7ff168130ce0 2023-09-30T22:24:09.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:09.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.649+0000 7fe36f598700 1 Processor -- start 2023-09-30T22:24:09.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.649+0000 7fe36f598700 1 -- start start 2023-09-30T22:24:09.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36f598700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368133900 0x7fe368133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36f598700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368134210 0x7fe3680a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36f598700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3680a0ee0 0x7fe3680a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36f598700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36809a760 con 0x7fe3680a0ee0 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36f598700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3681336e0 con 0x7fe368133900 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36f598700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe36809a080 con 0x7fe368134210 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36cb33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368134210 0x7fe3680a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36cb33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368134210 0x7fe3680a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55576/0 (socket says 172.21.15.154:55576) 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36cb33700 1 -- 172.21.15.154:0/2191602435 learned_addr learned my addr 172.21.15.154:0/2191602435 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36d334700 1 --2- 172.21.15.154:0/2191602435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368133900 0x7fe368133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36db35700 1 --2- 172.21.15.154:0/2191602435 >> v2:172.21.15.154:3300/0 conn(0x7fe3680a0ee0 0x7fe3680a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36cb33700 1 -- 172.21.15.154:0/2191602435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368133900 msgr2=0x7fe368133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36cb33700 1 --2- 172.21.15.154:0/2191602435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368133900 0x7fe368133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36cb33700 1 -- 172.21.15.154:0/2191602435 >> v2:172.21.15.154:3300/0 conn(0x7fe3680a0ee0 msgr2=0x7fe3680a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36cb33700 1 --2- 172.21.15.154:0/2191602435 >> v2:172.21.15.154:3300/0 conn(0x7fe3680a0ee0 0x7fe3680a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.650+0000 7fe36cb33700 1 -- 172.21.15.154:0/2191602435 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3680a23e0 con 0x7fe368134210 2023-09-30T22:24:09.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.651+0000 7fe36d334700 1 --2- 172.21.15.154:0/2191602435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368133900 0x7fe368133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.651+0000 7fe36cb33700 1 --2- 172.21.15.154:0/2191602435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368134210 0x7fe3680a09a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe3580098f0 tx=0x7fe358009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49b40c4cf0584775 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.651+0000 7fe35ffff700 1 -- 172.21.15.154:0/2191602435 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358011830 con 0x7fe368134210 2023-09-30T22:24:09.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.651+0000 7fe35ffff700 1 -- 172.21.15.154:0/2191602435 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe358011990 con 0x7fe368134210 2023-09-30T22:24:09.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.651+0000 7fe35ffff700 1 -- 172.21.15.154:0/2191602435 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe358011d20 con 0x7fe368134210 2023-09-30T22:24:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.651+0000 7fe36f598700 1 -- 172.21.15.154:0/2191602435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368134210 msgr2=0x7fe3680a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.651+0000 7fe36f598700 1 --2- 172.21.15.154:0/2191602435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368134210 0x7fe3680a09a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe3580098f0 tx=0x7fe358009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.652+0000 7fe36f598700 1 -- 172.21.15.154:0/2191602435 shutdown_connections 2023-09-30T22:24:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.652+0000 7fe36f598700 1 --2- 172.21.15.154:0/2191602435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368133900 0x7fe368133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.652+0000 7fe36f598700 1 --2- 172.21.15.154:0/2191602435 >> v2:172.21.15.154:3300/0 conn(0x7fe3680a0ee0 0x7fe3680a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.652+0000 7fe36f598700 1 --2- 172.21.15.154:0/2191602435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368134210 0x7fe3680a09a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.652+0000 7fe36f598700 1 -- 172.21.15.154:0/2191602435 >> 172.21.15.154:0/2191602435 conn(0x7fe3680a2980 msgr2=0x7fe3680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.652+0000 7fe36f598700 1 -- 172.21.15.154:0/2191602435 shutdown_connections 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.652+0000 7fe36f598700 1 -- 172.21.15.154:0/2191602435 wait complete. 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.653+0000 7fe36f598700 1 Processor -- start 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.653+0000 7fe36f598700 1 -- start start 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36f598700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3680a0ee0 0x7fe3681c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36f598700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368133900 0x7fe3681c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36f598700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368134210 0x7fe3681c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36f598700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3681c59e0 con 0x7fe3680a0ee0 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36f598700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36809a2c0 con 0x7fe368134210 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36f598700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3681203f0 con 0x7fe368133900 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36d334700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3680a0ee0 0x7fe3681c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36d334700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3680a0ee0 0x7fe3681c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34058/0 (socket says 172.21.15.154:34058) 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36d334700 1 -- 172.21.15.154:0/1524575581 learned_addr learned my addr 172.21.15.154:0/1524575581 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36db35700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368134210 0x7fe3681c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36cb33700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368133900 0x7fe3681c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36d334700 1 -- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368133900 msgr2=0x7fe3681c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36d334700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368133900 0x7fe3681c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36d334700 1 -- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368134210 msgr2=0x7fe3681c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36d334700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368134210 0x7fe3681c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36d334700 1 -- 172.21.15.154:0/1524575581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe364009430 con 0x7fe3680a0ee0 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36db35700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368134210 0x7fe3681c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36cb33700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368133900 0x7fe3681c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.654+0000 7fe36d334700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3680a0ee0 0x7fe3681c4f60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe36400ebe0 tx=0x7fe36400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.655+0000 7fe35dffb700 1 -- 172.21.15.154:0/1524575581 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364005a20 con 0x7fe3680a0ee0 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.655+0000 7fe35dffb700 1 -- 172.21.15.154:0/1524575581 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364005b80 con 0x7fe3680a0ee0 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.655+0000 7fe36f598700 1 -- 172.21.15.154:0/1524575581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe358009550 con 0x7fe3680a0ee0 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.655+0000 7fe35dffb700 1 -- 172.21.15.154:0/1524575581 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400c850 con 0x7fe3680a0ee0 2023-09-30T22:24:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.655+0000 7fe36f598700 1 -- 172.21.15.154:0/1524575581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe368120b10 con 0x7fe3680a0ee0 2023-09-30T22:24:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.656+0000 7fe36f598700 1 -- 172.21.15.154:0/1524575581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36804f2a0 con 0x7fe3680a0ee0 2023-09-30T22:24:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.656+0000 7fe35dffb700 1 -- 172.21.15.154:0/1524575581 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe36400c9b0 con 0x7fe3680a0ee0 2023-09-30T22:24:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.657+0000 7fe35dffb700 1 -- 172.21.15.154:0/1524575581 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe364047350 con 0x7fe3680a0ee0 2023-09-30T22:24:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.661+0000 7fe35dffb700 1 -- 172.21.15.154:0/1524575581 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe364044060 con 0x7fe3680a0ee0 2023-09-30T22:24:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.694+0000 7fddf9455700 1 Processor -- start 2023-09-30T22:24:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.694+0000 7fddf9455700 1 -- start start 2023-09-30T22:24:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf9455700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddf409b0d0 0x7fddf409b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf9455700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130480 0x7fddf41308b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf9455700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130df0 0x7fddf41377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf9455700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf409bf70 con 0x7fddf409b0d0 2023-09-30T22:24:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf9455700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf409b9e0 con 0x7fddf4130df0 2023-09-30T22:24:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf9455700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddf409ebb0 con 0x7fddf4130480 2023-09-30T22:24:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130480 0x7fddf41308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130df0 0x7fddf41377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130480 0x7fddf41308b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55594/0 (socket says 172.21.15.154:55594) 2023-09-30T22:24:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf27fc700 1 -- 172.21.15.154:0/196573846 learned_addr learned my addr 172.21.15.154:0/196573846 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf2ffd700 1 --2- 172.21.15.154:0/196573846 >> v2:172.21.15.154:3300/0 conn(0x7fddf409b0d0 0x7fddf409b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf37fe700 1 -- 172.21.15.154:0/196573846 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130480 msgr2=0x7fddf41308b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf37fe700 1 --2- 172.21.15.154:0/196573846 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130480 0x7fddf41308b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf37fe700 1 -- 172.21.15.154:0/196573846 >> v2:172.21.15.154:3300/0 conn(0x7fddf409b0d0 msgr2=0x7fddf409b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf37fe700 1 --2- 172.21.15.154:0/196573846 >> v2:172.21.15.154:3300/0 conn(0x7fddf409b0d0 0x7fddf409b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.695+0000 7fddf37fe700 1 -- 172.21.15.154:0/196573846 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf409e350 con 0x7fddf4130df0 2023-09-30T22:24:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.696+0000 7fddf27fc700 1 --2- 172.21.15.154:0/196573846 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130480 0x7fddf41308b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.696+0000 7fddf37fe700 1 --2- 172.21.15.154:0/196573846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130df0 0x7fddf41377b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fddec009d90 tx=0x7fddec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=174687cad1e07b35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.696+0000 7fddf1ffb700 1 -- 172.21.15.154:0/196573846 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec00e070 con 0x7fddf4130df0 2023-09-30T22:24:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.696+0000 7fddf1ffb700 1 -- 172.21.15.154:0/196573846 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec00bb20 con 0x7fddf4130df0 2023-09-30T22:24:09.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.696+0000 7fddf1ffb700 1 -- 172.21.15.154:0/196573846 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec012430 con 0x7fddf4130df0 2023-09-30T22:24:09.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.697+0000 7fddf9455700 1 -- 172.21.15.154:0/196573846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130df0 msgr2=0x7fddf41377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.697+0000 7fddf9455700 1 --2- 172.21.15.154:0/196573846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130df0 0x7fddf41377b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fddec009d90 tx=0x7fddec00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:09.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.697+0000 7fddf9455700 1 -- 172.21.15.154:0/196573846 shutdown_connections 2023-09-30T22:24:09.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.697+0000 7fddf9455700 1 --2- 172.21.15.154:0/196573846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130df0 0x7fddf41377b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.697+0000 7fddf9455700 1 --2- 172.21.15.154:0/196573846 >> v2:172.21.15.154:3300/0 conn(0x7fddf409b0d0 0x7fddf409b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.697+0000 7fddf9455700 1 --2- 172.21.15.154:0/196573846 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130480 0x7fddf41308b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.697+0000 7fddf9455700 1 -- 172.21.15.154:0/196573846 >> 172.21.15.154:0/196573846 conn(0x7fddf40a2eb0 msgr2=0x7fddf409eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.697+0000 7fddf9455700 1 -- 172.21.15.154:0/196573846 shutdown_connections 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.697+0000 7fddf9455700 1 -- 172.21.15.154:0/196573846 wait complete. 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.698+0000 7fddf9455700 1 Processor -- start 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf9455700 1 -- start start 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf9455700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf409b0d0 0x7fddf41c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf9455700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130480 0x7fddf41c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf9455700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130df0 0x7fddf41c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf9455700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf412ee20 con 0x7fddf409b0d0 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf9455700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf4096b00 con 0x7fddf4130480 2023-09-30T22:24:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf9455700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddf412f270 con 0x7fddf4130df0 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf409b0d0 0x7fddf41c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf409b0d0 0x7fddf41c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34072/0 (socket says 172.21.15.154:34072) 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf2ffd700 1 -- 172.21.15.154:0/3572279635 learned_addr learned my addr 172.21.15.154:0/3572279635 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf27fc700 1 --2- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130480 0x7fddf41c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.699+0000 7fddf37fe700 1 --2- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130df0 0x7fddf41c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fddf27fc700 1 -- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130df0 msgr2=0x7fddf41c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fddf27fc700 1 --2- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130df0 0x7fddf41c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fddf27fc700 1 -- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf409b0d0 msgr2=0x7fddf41c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fddf27fc700 1 --2- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf409b0d0 0x7fddf41c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fddf27fc700 1 -- 172.21.15.154:0/3572279635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde800b7f0 con 0x7fddf4130480 2023-09-30T22:24:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fddf27fc700 1 --2- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130480 0x7fddf41c8d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdde800ed40 tx=0x7fdde800d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fdddb7fe700 1 -- 172.21.15.154:0/3572279635 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde800dd90 con 0x7fddf4130480 2023-09-30T22:24:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fdddb7fe700 1 -- 172.21.15.154:0/3572279635 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde8004030 con 0x7fddf4130480 2023-09-30T22:24:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fddf9455700 1 -- 172.21.15.154:0/3572279635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec009a70 con 0x7fddf4130480 2023-09-30T22:24:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fdddb7fe700 1 -- 172.21.15.154:0/3572279635 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde80043a0 con 0x7fddf4130480 2023-09-30T22:24:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.700+0000 7fddf9455700 1 -- 172.21.15.154:0/3572279635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf412e090 con 0x7fddf4130480 2023-09-30T22:24:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.701+0000 7fdddb7fe700 1 -- 172.21.15.154:0/3572279635 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdde80036a0 con 0x7fddf4130480 2023-09-30T22:24:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.701+0000 7fddf9455700 1 -- 172.21.15.154:0/3572279635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf412f640 con 0x7fddf4130480 2023-09-30T22:24:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.701+0000 7fdddb7fe700 1 -- 172.21.15.154:0/3572279635 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdde803fb50 con 0x7fddf4130480 2023-09-30T22:24:09.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.710+0000 7fdddb7fe700 1 -- 172.21.15.154:0/3572279635 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdde8004500 con 0x7fddf4130480 2023-09-30T22:24:09.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.751+0000 7f46884f9700 1 Processor -- start 2023-09-30T22:24:09.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.751+0000 7f46884f9700 1 -- start start 2023-09-30T22:24:09.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f46884f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a1550 0x7f4680138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f46884f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f46884f9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468009e9d0 con 0x7f46800a0a70 2023-09-30T22:24:09.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f46884f9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468009dc00 con 0x7f4680139200 2023-09-30T22:24:09.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f46884f9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f468009dec0 con 0x7f46800a1550 2023-09-30T22:24:09.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4686295700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f46800a0a70 0x7f46800a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55848/0 (socket says 172.21.15.154:55848) 2023-09-30T22:24:09.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4686295700 1 -- 172.21.15.154:0/3151257808 learned_addr learned my addr 172.21.15.154:0/3151257808 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:09.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4685a94700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a1550 0x7f4680138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4686a96700 1 --2- 172.21.15.154:0/3151257808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4686a96700 1 -- 172.21.15.154:0/3151257808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a1550 msgr2=0x7f4680138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:09.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4686a96700 1 --2- 172.21.15.154:0/3151257808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a1550 0x7f4680138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4686a96700 1 -- 172.21.15.154:0/3151257808 >> v1:172.21.15.154:6789/0 conn(0x7f46800a0a70 legacy=0x7f46800a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4685293700 1 -- 172.21.15.154:0/3151257808 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873009221 0 0) 0x7f468009e9d0 con 0x7f46800a0a70 2023-09-30T22:24:09.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4686a96700 1 -- 172.21.15.154:0/3151257808 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468009e6a0 con 0x7f4680139200 2023-09-30T22:24:09.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.752+0000 7f4685a94700 1 --2- 172.21.15.154:0/3151257808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a1550 0x7f4680138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f4686a96700 1 --2- 172.21.15.154:0/3151257808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468013b5e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4678009dc0 tx=0x7f467800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a6c2e693f072cd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f4685293700 1 -- 172.21.15.154:0/3151257808 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800e070 con 0x7f4680139200 2023-09-30T22:24:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f4685293700 1 -- 172.21.15.154:0/3151257808 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800bb20 con 0x7f4680139200 2023-09-30T22:24:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f4685293700 1 -- 172.21.15.154:0/3151257808 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678012430 con 0x7f4680139200 2023-09-30T22:24:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f46884f9700 1 -- 172.21.15.154:0/3151257808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 msgr2=0x7f468013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f46884f9700 1 --2- 172.21.15.154:0/3151257808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468013b5e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4678009dc0 tx=0x7f467800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f46884f9700 1 -- 172.21.15.154:0/3151257808 shutdown_connections 2023-09-30T22:24:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f46884f9700 1 --2- 172.21.15.154:0/3151257808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468013b5e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f46884f9700 1 --2- 172.21.15.154:0/3151257808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a1550 0x7f4680138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.753+0000 7f46884f9700 1 -- 172.21.15.154:0/3151257808 >> 172.21.15.154:0/3151257808 conn(0x7f46800a6610 msgr2=0x7f46800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.754+0000 7f46884f9700 1 -- 172.21.15.154:0/3151257808 shutdown_connections 2023-09-30T22:24:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.754+0000 7f46884f9700 1 -- 172.21.15.154:0/3151257808 wait complete. 2023-09-30T22:24:09.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.755+0000 7f46884f9700 1 Processor -- start 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.755+0000 7f46884f9700 1 -- start start 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.755+0000 7f46884f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a0a70 0x7f468011e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.755+0000 7f46884f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46800a1550 0x7f468011edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.755+0000 7f46884f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468011f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.755+0000 7f46884f9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46800a03e0 con 0x7f46800a1550 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.755+0000 7f46884f9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46801220d0 con 0x7f4680139200 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.755+0000 7f46884f9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46801205b0 con 0x7f46800a0a70 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686295700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a0a70 0x7f468011e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4685a94700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46800a1550 0x7f468011edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686a96700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468011f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4685a94700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46800a1550 0x7f468011edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34086/0 (socket says 172.21.15.154:34086) 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686a96700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468011f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43696/0 (socket says 172.21.15.154:43696) 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4685a94700 1 -- 172.21.15.154:0/1029825949 learned_addr learned my addr 172.21.15.154:0/1029825949 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686295700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a0a70 0x7f468011e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55636/0 (socket says 172.21.15.154:55636) 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686a96700 1 -- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a0a70 msgr2=0x7f468011e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686a96700 1 --2- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a0a70 0x7f468011e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686a96700 1 -- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46800a1550 msgr2=0x7f468011edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686a96700 1 --2- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46800a1550 0x7f468011edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686a96700 1 -- 172.21.15.154:0/1029825949 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46700094a0 con 0x7f4680139200 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4686a96700 1 --2- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468011f310 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4678016000 tx=0x7f4678004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4676ffd700 1 -- 172.21.15.154:0/1029825949 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678004880 con 0x7f4680139200 2023-09-30T22:24:09.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4676ffd700 1 -- 172.21.15.154:0/1029825949 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4678020070 con 0x7f4680139200 2023-09-30T22:24:09.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f46884f9700 1 -- 172.21.15.154:0/1029825949 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4678009a70 con 0x7f4680139200 2023-09-30T22:24:09.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.756+0000 7f4676ffd700 1 -- 172.21.15.154:0/1029825949 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46780276c0 con 0x7f4680139200 2023-09-30T22:24:09.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.757+0000 7f46884f9700 1 -- 172.21.15.154:0/1029825949 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4680120e90 con 0x7f4680139200 2023-09-30T22:24:09.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.757+0000 7f4676ffd700 1 -- 172.21.15.154:0/1029825949 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4678012430 con 0x7f4680139200 2023-09-30T22:24:09.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.758+0000 7f4676ffd700 1 -- 172.21.15.154:0/1029825949 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4678022070 con 0x7f4680139200 2023-09-30T22:24:09.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.758+0000 7f46884f9700 1 -- 172.21.15.154:0/1029825949 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468004f2a0 con 0x7f4680139200 2023-09-30T22:24:09.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.767+0000 7f4676ffd700 1 -- 172.21.15.154:0/1029825949 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f467801a970 con 0x7f4680139200 2023-09-30T22:24:09.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.815+0000 7ff16d8ac700 1 -- 172.21.15.154:0/17337501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff16809c8b0 con 0x7ff168130ce0 2023-09-30T22:24:09.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.815+0000 7ff14ffff700 1 -- 172.21.15.154:0/17337501 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff16000ab40 con 0x7ff168130ce0 2023-09-30T22:24:09.816 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:09.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.817+0000 7ff16d8ac700 1 -- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff168130ce0 msgr2=0x7ff1681bb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.817+0000 7ff16d8ac700 1 --2- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff168130ce0 0x7ff1681bb950 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff160001560 tx=0x7ff16000cb50 comp rx=0 tx=0).stop 2023-09-30T22:24:09.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.817+0000 7ff16d8ac700 1 -- 172.21.15.154:0/17337501 shutdown_connections 2023-09-30T22:24:09.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.817+0000 7ff16d8ac700 1 --2- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff168130ce0 0x7ff1681bb950 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.817+0000 7ff16d8ac700 1 --2- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff16809d860 0x7ff1681baed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.817+0000 7ff16d8ac700 1 --2- 172.21.15.154:0/17337501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff16809e170 0x7ff1681bb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.817+0000 7ff16d8ac700 1 -- 172.21.15.154:0/17337501 >> 172.21.15.154:0/17337501 conn(0x7ff168099c40 msgr2=0x7ff1680a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.817+0000 7ff16d8ac700 1 -- 172.21.15.154:0/17337501 shutdown_connections 2023-09-30T22:24:09.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.817+0000 7ff16d8ac700 1 -- 172.21.15.154:0/17337501 wait complete. 2023-09-30T22:24:09.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.858+0000 7fe36f598700 1 -- 172.21.15.154:0/1524575581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe36811ff90 con 0x7fe3680a0ee0 2023-09-30T22:24:09.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.859+0000 7fe35dffb700 1 -- 172.21.15.154:0/1524575581 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe364044030 con 0x7fe3680a0ee0 2023-09-30T22:24:09.860 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:09.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.861+0000 7fe36f598700 1 -- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3680a0ee0 msgr2=0x7fe3681c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.861+0000 7fe36f598700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3680a0ee0 0x7fe3681c4f60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe36400ebe0 tx=0x7fe36400eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.861+0000 7fe36f598700 1 -- 172.21.15.154:0/1524575581 shutdown_connections 2023-09-30T22:24:09.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.861+0000 7fe36f598700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe368134210 0x7fe3681c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.861+0000 7fe36f598700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3680a0ee0 0x7fe3681c4f60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.861+0000 7fe36f598700 1 --2- 172.21.15.154:0/1524575581 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe368133900 0x7fe3681c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.861+0000 7fe36f598700 1 -- 172.21.15.154:0/1524575581 >> 172.21.15.154:0/1524575581 conn(0x7fe3680a2980 msgr2=0x7fe3681bad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.861+0000 7fe36f598700 1 -- 172.21.15.154:0/1524575581 shutdown_connections 2023-09-30T22:24:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.861+0000 7fe36f598700 1 -- 172.21.15.154:0/1524575581 wait complete. 2023-09-30T22:24:09.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.923+0000 7fddf9455700 1 -- 172.21.15.154:0/3572279635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fddf404f2a0 con 0x7fddf4130480 2023-09-30T22:24:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.923+0000 7fdddb7fe700 1 -- 172.21.15.154:0/3572279635 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdde801f300 con 0x7fddf4130480 2023-09-30T22:24:09.924 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:09.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.925+0000 7fddf9455700 1 -- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130480 msgr2=0x7fddf41c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.925+0000 7fddf9455700 1 --2- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130480 0x7fddf41c8d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdde800ed40 tx=0x7fdde800d630 comp rx=0 tx=0).stop 2023-09-30T22:24:09.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.925+0000 7fddf9455700 1 -- 172.21.15.154:0/3572279635 shutdown_connections 2023-09-30T22:24:09.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.925+0000 7fddf9455700 1 --2- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddf4130df0 0x7fddf41c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.925+0000 7fddf9455700 1 --2- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddf409b0d0 0x7fddf41c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.925+0000 7fddf9455700 1 --2- 172.21.15.154:0/3572279635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddf4130480 0x7fddf41c8d00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.925+0000 7fddf9455700 1 -- 172.21.15.154:0/3572279635 >> 172.21.15.154:0/3572279635 conn(0x7fddf40a2eb0 msgr2=0x7fddf40a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.925+0000 7fddf9455700 1 -- 172.21.15.154:0/3572279635 shutdown_connections 2023-09-30T22:24:09.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.925+0000 7fddf9455700 1 -- 172.21.15.154:0/3572279635 wait complete. 2023-09-30T22:24:09.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.971+0000 7f46884f9700 1 -- 172.21.15.154:0/1029825949 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f46800a56d0 con 0x7f4680139200 2023-09-30T22:24:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.971+0000 7f4676ffd700 1 -- 172.21.15.154:0/1029825949 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4678030390 con 0x7f4680139200 2023-09-30T22:24:09.973 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:09.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.973+0000 7f46884f9700 1 -- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 msgr2=0x7f468011f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:09.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.973+0000 7f46884f9700 1 --2- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468011f310 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4678016000 tx=0x7f4678004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.973+0000 7f46884f9700 1 -- 172.21.15.154:0/1029825949 shutdown_connections 2023-09-30T22:24:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.973+0000 7f46884f9700 1 --2- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4680139200 0x7f468011f310 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.973+0000 7f46884f9700 1 --2- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46800a0a70 0x7f468011e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.973+0000 7f46884f9700 1 --2- 172.21.15.154:0/1029825949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46800a1550 0x7f468011edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.973+0000 7f46884f9700 1 -- 172.21.15.154:0/1029825949 >> 172.21.15.154:0/1029825949 conn(0x7f46800a6610 msgr2=0x7f4680136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.973+0000 7f46884f9700 1 -- 172.21.15.154:0/1029825949 shutdown_connections 2023-09-30T22:24:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:09.974+0000 7f46884f9700 1 -- 172.21.15.154:0/1029825949 wait complete. 2023-09-30T22:24:09.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:10.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:10.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:10.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:10.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.974+0000 7fe1c2006700 1 Processor -- start 2023-09-30T22:24:10.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.974+0000 7fe1c2006700 1 -- start start 2023-09-30T22:24:10.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.974+0000 7fe1c2006700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1bc099e20 0x7fe1bc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.974+0000 7fe1c2006700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09a730 0x7fe1bc130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.974+0000 7fe1c2006700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 0x7fe1bc130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.974+0000 7fe1c2006700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1bc09bf50 con 0x7fe1bc099e20 2023-09-30T22:24:10.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.974+0000 7fe1c2006700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc131220 con 0x7fe1bc09a730 2023-09-30T22:24:10.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.974+0000 7fe1c2006700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc099a60 con 0x7fe1bc130890 2023-09-30T22:24:10.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1bb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1bc099e20 0x7fe1bc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1bbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 0x7fe1bc130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1baffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09a730 0x7fe1bc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1bb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1bc099e20 0x7fe1bc09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34102/0 (socket says 172.21.15.154:34102) 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1bb7fe700 1 -- 172.21.15.154:0/195854740 learned_addr learned my addr 172.21.15.154:0/195854740 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1baffd700 1 -- 172.21.15.154:0/195854740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 msgr2=0x7fe1bc130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1baffd700 1 --2- 172.21.15.154:0/195854740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 0x7fe1bc130ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1baffd700 1 -- 172.21.15.154:0/195854740 >> v2:172.21.15.154:3300/0 conn(0x7fe1bc099e20 msgr2=0x7fe1bc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1baffd700 1 --2- 172.21.15.154:0/195854740 >> v2:172.21.15.154:3300/0 conn(0x7fe1bc099e20 0x7fe1bc09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1baffd700 1 -- 172.21.15.154:0/195854740 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc09b230 con 0x7fe1bc09a730 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1bb7fe700 1 --2- 172.21.15.154:0/195854740 >> v2:172.21.15.154:3300/0 conn(0x7fe1bc099e20 0x7fe1bc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1baffd700 1 --2- 172.21.15.154:0/195854740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09a730 0x7fe1bc130350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009870 tx=0x7fe1b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7531fd5475173862 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1ba7fc700 1 -- 172.21.15.154:0/195854740 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0011830 con 0x7fe1bc09a730 2023-09-30T22:24:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1ba7fc700 1 -- 172.21.15.154:0/195854740 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0011990 con 0x7fe1bc09a730 2023-09-30T22:24:10.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.975+0000 7fe1ba7fc700 1 -- 172.21.15.154:0/195854740 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0011d20 con 0x7fe1bc09a730 2023-09-30T22:24:10.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.976+0000 7fe1c2006700 1 -- 172.21.15.154:0/195854740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09a730 msgr2=0x7fe1bc130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.976+0000 7fe1c2006700 1 --2- 172.21.15.154:0/195854740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09a730 0x7fe1bc130350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009870 tx=0x7fe1b0009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:10.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.976+0000 7fe1c2006700 1 -- 172.21.15.154:0/195854740 shutdown_connections 2023-09-30T22:24:10.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.976+0000 7fe1c2006700 1 --2- 172.21.15.154:0/195854740 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 0x7fe1bc130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.976+0000 7fe1c2006700 1 --2- 172.21.15.154:0/195854740 >> v2:172.21.15.154:3300/0 conn(0x7fe1bc099e20 0x7fe1bc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.976+0000 7fe1c2006700 1 --2- 172.21.15.154:0/195854740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09a730 0x7fe1bc130350 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.976+0000 7fe1c2006700 1 -- 172.21.15.154:0/195854740 >> 172.21.15.154:0/195854740 conn(0x7fe1bc0a2980 msgr2=0x7fe1bc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.976+0000 7fe1c2006700 1 -- 172.21.15.154:0/195854740 shutdown_connections 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.976+0000 7fe1c2006700 1 -- 172.21.15.154:0/195854740 wait complete. 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.978+0000 7fe1c2006700 1 Processor -- start 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.978+0000 7fe1c2006700 1 -- start start 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.978+0000 7fe1c2006700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc099e20 0x7fe1bc12d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1c2006700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc09a730 0x7fe1bc12d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1c2006700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 0x7fe1bc1376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:10.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1c2006700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc133640 con 0x7fe1bc09a730 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1c2006700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc133cb0 con 0x7fe1bc099e20 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1c2006700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc133240 con 0x7fe1bc130890 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1baffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc09a730 0x7fe1bc12d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1bb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc099e20 0x7fe1bc12d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1baffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc09a730 0x7fe1bc12d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34118/0 (socket says 172.21.15.154:34118) 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1baffd700 1 -- 172.21.15.154:0/3349209468 learned_addr learned my addr 172.21.15.154:0/3349209468 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1bbfff700 1 --2- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 0x7fe1bc1376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1baffd700 1 -- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 msgr2=0x7fe1bc1376b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1baffd700 1 --2- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 0x7fe1bc1376b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1baffd700 1 -- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc099e20 msgr2=0x7fe1bc12d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1baffd700 1 --2- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc099e20 0x7fe1bc12d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1baffd700 1 -- 172.21.15.154:0/3349209468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac009500 con 0x7fe1bc09a730 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1baffd700 1 --2- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc09a730 0x7fe1bc12d840 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0000c00 tx=0x7fe1b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1a3fff700 1 -- 172.21.15.154:0/3349209468 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0004300 con 0x7fe1bc09a730 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1a3fff700 1 -- 172.21.15.154:0/3349209468 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b001f070 con 0x7fe1bc09a730 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1c2006700 1 -- 172.21.15.154:0/3349209468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b00094a0 con 0x7fe1bc09a730 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.979+0000 7fe1a3fff700 1 -- 172.21.15.154:0/3349209468 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00036a0 con 0x7fe1bc09a730 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.980+0000 7fe1c2006700 1 -- 172.21.15.154:0/3349209468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1bc09b470 con 0x7fe1bc09a730 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.980+0000 7fe1a3fff700 1 -- 172.21.15.154:0/3349209468 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1b0021030 con 0x7fe1bc09a730 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.980+0000 7fe1a3fff700 1 -- 172.21.15.154:0/3349209468 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe1b00405b0 con 0x7fe1bc09a730 2023-09-30T22:24:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.981+0000 7fe1c2006700 1 -- 172.21.15.154:0/3349209468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1bc04f2a0 con 0x7fe1bc09a730 2023-09-30T22:24:10.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:10.986+0000 7fe1a3fff700 1 -- 172.21.15.154:0/3349209468 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1b0015080 con 0x7fe1bc09a730 2023-09-30T22:24:10.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:11.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.012+0000 7fd80d65e700 1 Processor -- start 2023-09-30T22:24:11.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.012+0000 7fd80d65e700 1 -- start start 2023-09-30T22:24:11.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd80d65e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd808134140 0x7fd808138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd80d65e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd808134570 0x7fd80813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd80d65e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80809b110 con 0x7fd80809ad40 2023-09-30T22:24:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd80d65e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8080a3b60 con 0x7fd808134570 2023-09-30T22:24:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd80d65e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080a1a80 con 0x7fd808134140 2023-09-30T22:24:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd8067fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd808134140 0x7fd808138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd806ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd80809ad40 0x7fd808133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55856/0 (socket says 172.21.15.154:55856) 2023-09-30T22:24:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd806ffd700 1 -- 172.21.15.154:0/1019611461 learned_addr learned my addr 172.21.15.154:0/1019611461 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd8067fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd808134140 0x7fd808138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43730/0 (socket says 172.21.15.154:43730) 2023-09-30T22:24:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd8077fe700 1 --2- 172.21.15.154:0/1019611461 >> v2:172.21.15.154:3300/0 conn(0x7fd808134570 0x7fd80813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd8067fc700 1 -- 172.21.15.154:0/1019611461 >> v2:172.21.15.154:3300/0 conn(0x7fd808134570 msgr2=0x7fd80813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd8067fc700 1 --2- 172.21.15.154:0/1019611461 >> v2:172.21.15.154:3300/0 conn(0x7fd808134570 0x7fd80813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd8067fc700 1 -- 172.21.15.154:0/1019611461 >> v1:172.21.15.154:6789/0 conn(0x7fd80809ad40 legacy=0x7fd808133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd8067fc700 1 -- 172.21.15.154:0/1019611461 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8080a2fa0 con 0x7fd808134140 2023-09-30T22:24:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.013+0000 7fd8067fc700 1 --2- 172.21.15.154:0/1019611461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd808134140 0x7fd808138e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009840 tx=0x7fd7fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd1695a6571ed87d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd805ffb700 1 -- 172.21.15.154:0/1019611461 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc011830 con 0x7fd808134140 2023-09-30T22:24:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd805ffb700 1 -- 172.21.15.154:0/1019611461 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc011990 con 0x7fd808134140 2023-09-30T22:24:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd805ffb700 1 -- 172.21.15.154:0/1019611461 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc011d20 con 0x7fd808134140 2023-09-30T22:24:11.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd80d65e700 1 -- 172.21.15.154:0/1019611461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd808134140 msgr2=0x7fd808138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd80d65e700 1 --2- 172.21.15.154:0/1019611461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd808134140 0x7fd808138e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009840 tx=0x7fd7fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:11.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd80d65e700 1 -- 172.21.15.154:0/1019611461 shutdown_connections 2023-09-30T22:24:11.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd80d65e700 1 --2- 172.21.15.154:0/1019611461 >> v2:172.21.15.154:3300/0 conn(0x7fd808134570 0x7fd80813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd80d65e700 1 --2- 172.21.15.154:0/1019611461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd808134140 0x7fd808138e80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd80d65e700 1 -- 172.21.15.154:0/1019611461 >> 172.21.15.154:0/1019611461 conn(0x7fd808099c40 msgr2=0x7fd80806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.014+0000 7fd80d65e700 1 -- 172.21.15.154:0/1019611461 shutdown_connections 2023-09-30T22:24:11.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.015+0000 7fd80d65e700 1 -- 172.21.15.154:0/1019611461 wait complete. 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.016+0000 7fd80d65e700 1 Processor -- start 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.016+0000 7fd80d65e700 1 -- start start 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd80d65e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80809ad40 0x7fd80811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd80d65e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd808134140 0x7fd80811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd80d65e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd808134570 0x7fd80811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd80d65e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80811ea80 con 0x7fd808134140 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd80d65e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80811f920 con 0x7fd80809ad40 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd80d65e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd80809c7e0 con 0x7fd808134570 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd806ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80809ad40 0x7fd80811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd806ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80809ad40 0x7fd80811c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43744/0 (socket says 172.21.15.154:43744) 2023-09-30T22:24:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd806ffd700 1 -- 172.21.15.154:0/1459825817 learned_addr learned my addr 172.21.15.154:0/1459825817 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd8077fe700 1 --2- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd808134570 0x7fd80811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd8067fc700 1 --2- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd808134140 0x7fd80811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd806ffd700 1 -- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd808134570 msgr2=0x7fd80811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd806ffd700 1 --2- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd808134570 0x7fd80811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd806ffd700 1 -- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd808134140 msgr2=0x7fd80811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd806ffd700 1 --2- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd808134140 0x7fd80811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd806ffd700 1 -- 172.21.15.154:0/1459825817 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0094a0 con 0x7fd80809ad40 2023-09-30T22:24:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.017+0000 7fd806ffd700 1 --2- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80809ad40 0x7fd80811c8c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c480 tx=0x7fd7f800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.018+0000 7fd7ef7fe700 1 -- 172.21.15.154:0/1459825817 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8005d70 con 0x7fd80809ad40 2023-09-30T22:24:11.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.018+0000 7fd7ef7fe700 1 -- 172.21.15.154:0/1459825817 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f800ce90 con 0x7fd80809ad40 2023-09-30T22:24:11.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.018+0000 7fd7ef7fe700 1 -- 172.21.15.154:0/1459825817 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80072d0 con 0x7fd80809ad40 2023-09-30T22:24:11.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.018+0000 7fd80d65e700 1 -- 172.21.15.154:0/1459825817 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8080a4110 con 0x7fd80809ad40 2023-09-30T22:24:11.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.018+0000 7fd80d65e700 1 -- 172.21.15.154:0/1459825817 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80811ec60 con 0x7fd80809ad40 2023-09-30T22:24:11.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.018+0000 7fd7ef7fe700 1 -- 172.21.15.154:0/1459825817 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7f8007430 con 0x7fd80809ad40 2023-09-30T22:24:11.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.019+0000 7fd7ef7fe700 1 -- 172.21.15.154:0/1459825817 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd7f803e940 con 0x7fd80809ad40 2023-09-30T22:24:11.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.020+0000 7fd80d65e700 1 -- 172.21.15.154:0/1459825817 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80811e8b0 con 0x7fd80809ad40 2023-09-30T22:24:11.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.025+0000 7fd7ef7fe700 1 -- 172.21.15.154:0/1459825817 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7f8017080 con 0x7fd80809ad40 2023-09-30T22:24:11.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.094+0000 7f28f895e700 1 Processor -- start 2023-09-30T22:24:11.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.094+0000 7f28f895e700 1 -- start start 2023-09-30T22:24:11.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f895e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f409c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f895e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f41337d0 0x7f28f4133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f895e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28f4134160 0x7f28f413ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f895e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f409ad30 con 0x7f28f4134160 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f895e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f409a8e0 con 0x7f28f409bd20 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f895e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4134600 con 0x7f28f41337d0 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f41337d0 0x7f28f4133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f41337d0 0x7f28f4133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55676/0 (socket says 172.21.15.154:55676) 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f1d9b700 1 -- 172.21.15.154:0/1843007858 learned_addr learned my addr 172.21.15.154:0/1843007858 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f259c700 1 --2- 172.21.15.154:0/1843007858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f409c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f2d9d700 1 --2- 172.21.15.154:0/1843007858 >> v2:172.21.15.154:3300/0 conn(0x7f28f4134160 0x7f28f413ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f1d9b700 1 -- 172.21.15.154:0/1843007858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 msgr2=0x7f28f409c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f1d9b700 1 --2- 172.21.15.154:0/1843007858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f409c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f1d9b700 1 -- 172.21.15.154:0/1843007858 >> v2:172.21.15.154:3300/0 conn(0x7f28f4134160 msgr2=0x7f28f413ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f1d9b700 1 --2- 172.21.15.154:0/1843007858 >> v2:172.21.15.154:3300/0 conn(0x7f28f4134160 0x7f28f413ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f1d9b700 1 -- 172.21.15.154:0/1843007858 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f409a620 con 0x7f28f41337d0 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.095+0000 7f28f259c700 1 --2- 172.21.15.154:0/1843007858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f409c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.096+0000 7f28f1d9b700 1 --2- 172.21.15.154:0/1843007858 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f41337d0 0x7f28f4133c20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009920 tx=0x7f28e8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b64767c03abe474f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.096+0000 7f28f159a700 1 -- 172.21.15.154:0/1843007858 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8011830 con 0x7f28f41337d0 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.096+0000 7f28f159a700 1 -- 172.21.15.154:0/1843007858 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e8011990 con 0x7f28f41337d0 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.096+0000 7f28f159a700 1 -- 172.21.15.154:0/1843007858 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8011d20 con 0x7f28f41337d0 2023-09-30T22:24:11.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.096+0000 7f28f895e700 1 -- 172.21.15.154:0/1843007858 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f41337d0 msgr2=0x7f28f4133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.096+0000 7f28f895e700 1 --2- 172.21.15.154:0/1843007858 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f41337d0 0x7f28f4133c20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009920 tx=0x7f28e8009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.097+0000 7f28f895e700 1 -- 172.21.15.154:0/1843007858 shutdown_connections 2023-09-30T22:24:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.097+0000 7f28f895e700 1 --2- 172.21.15.154:0/1843007858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f409c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.097+0000 7f28f895e700 1 --2- 172.21.15.154:0/1843007858 >> v2:172.21.15.154:3300/0 conn(0x7f28f4134160 0x7f28f413ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.097+0000 7f28f895e700 1 --2- 172.21.15.154:0/1843007858 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f41337d0 0x7f28f4133c20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.097+0000 7f28f895e700 1 -- 172.21.15.154:0/1843007858 >> 172.21.15.154:0/1843007858 conn(0x7f28f409f9f0 msgr2=0x7f28f409fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.097+0000 7f28f895e700 1 -- 172.21.15.154:0/1843007858 shutdown_connections 2023-09-30T22:24:11.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.097+0000 7f28f895e700 1 -- 172.21.15.154:0/1843007858 wait complete. 2023-09-30T22:24:11.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f895e700 1 Processor -- start 2023-09-30T22:24:11.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f895e700 1 -- start start 2023-09-30T22:24:11.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f895e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f411df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f895e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f41337d0 0x7f28f411e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f895e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f4134160 0x7f28f411e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f895e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4121800 con 0x7f28f41337d0 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f895e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4121a50 con 0x7f28f409bd20 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f895e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4120940 con 0x7f28f4134160 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f4134160 0x7f28f411e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.098+0000 7f28f259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f411df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f4134160 0x7f28f411e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55688/0 (socket says 172.21.15.154:55688) 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f2d9d700 1 -- 172.21.15.154:0/1757578184 learned_addr learned my addr 172.21.15.154:0/1757578184 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f1d9b700 1 --2- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f41337d0 0x7f28f411e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f2d9d700 1 -- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 msgr2=0x7f28f411df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f2d9d700 1 --2- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f411df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f2d9d700 1 -- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f41337d0 msgr2=0x7f28f411e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f2d9d700 1 --2- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f41337d0 0x7f28f411e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f2d9d700 1 -- 172.21.15.154:0/1757578184 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4009430 con 0x7f28f4134160 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f259c700 1 --2- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f411df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f2d9d700 1 --2- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f4134160 0x7f28f411e9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00efc0 tx=0x7f28ec00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28e2ffd700 1 -- 172.21.15.154:0/1757578184 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec009ea0 con 0x7f28f4134160 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28e2ffd700 1 -- 172.21.15.154:0/1757578184 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec00f040 con 0x7f28f4134160 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f895e700 1 -- 172.21.15.154:0/1757578184 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e8009550 con 0x7f28f4134160 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28e2ffd700 1 -- 172.21.15.154:0/1757578184 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec014480 con 0x7f28f4134160 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.099+0000 7f28f895e700 1 -- 172.21.15.154:0/1757578184 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f411fbe0 con 0x7f28f4134160 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.101+0000 7f28f895e700 1 -- 172.21.15.154:0/1757578184 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f411ad60 con 0x7f28f4134160 2023-09-30T22:24:11.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.101+0000 7f28e2ffd700 1 -- 172.21.15.154:0/1757578184 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28ec0145e0 con 0x7f28f4134160 2023-09-30T22:24:11.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.102+0000 7f28e2ffd700 1 -- 172.21.15.154:0/1757578184 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f28ec040720 con 0x7f28f4134160 2023-09-30T22:24:11.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.110+0000 7f28e2ffd700 1 -- 172.21.15.154:0/1757578184 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28ec012910 con 0x7f28f4134160 2023-09-30T22:24:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.120+0000 7f3831eea700 1 Processor -- start 2023-09-30T22:24:11.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.120+0000 7f3831eea700 1 -- start start 2023-09-30T22:24:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f3831eea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c0a0a70 0x7f382c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f3831eea700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f382c0a1380 0x7f382c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f3831eea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c133f50 0x7f382c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f3831eea700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c09e9d0 con 0x7f382c0a1380 2023-09-30T22:24:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f3831eea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c09dc00 con 0x7f382c133f50 2023-09-30T22:24:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f3831eea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c09dec0 con 0x7f382c0a0a70 2023-09-30T22:24:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c0a0a70 0x7f382c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c0a0a70 0x7f382c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55692/0 (socket says 172.21.15.154:55692) 2023-09-30T22:24:11.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f382b7fe700 1 -- 172.21.15.154:0/1795858732 learned_addr learned my addr 172.21.15.154:0/1795858732 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f382bfff700 1 --2- 172.21.15.154:0/1795858732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c133f50 0x7f382c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.121+0000 7f382b7fe700 1 -- 172.21.15.154:0/1795858732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c133f50 msgr2=0x7f382c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.122+0000 7f382b7fe700 1 --2- 172.21.15.154:0/1795858732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c133f50 0x7f382c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.122+0000 7f382b7fe700 1 -- 172.21.15.154:0/1795858732 >> v2:172.21.15.154:3300/0 conn(0x7f382c0a1380 msgr2=0x7f382c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.122+0000 7f382b7fe700 1 --2- 172.21.15.154:0/1795858732 >> v2:172.21.15.154:3300/0 conn(0x7f382c0a1380 0x7f382c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.122+0000 7f382b7fe700 1 -- 172.21.15.154:0/1795858732 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c09e6a0 con 0x7f382c0a0a70 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.122+0000 7f382bfff700 1 --2- 172.21.15.154:0/1795858732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c133f50 0x7f382c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.122+0000 7f382b7fe700 1 --2- 172.21.15.154:0/1795858732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c0a0a70 0x7f382c0a0e40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f381c0098f0 tx=0x7f381c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df0a84d85b08a55b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.122+0000 7f382a7fc700 1 -- 172.21.15.154:0/1795858732 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c011830 con 0x7f382c0a0a70 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.122+0000 7f382a7fc700 1 -- 172.21.15.154:0/1795858732 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c011990 con 0x7f382c0a0a70 2023-09-30T22:24:11.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.122+0000 7f382a7fc700 1 -- 172.21.15.154:0/1795858732 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c011d20 con 0x7f382c0a0a70 2023-09-30T22:24:11.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.123+0000 7f3831eea700 1 -- 172.21.15.154:0/1795858732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c0a0a70 msgr2=0x7f382c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.123+0000 7f3831eea700 1 --2- 172.21.15.154:0/1795858732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c0a0a70 0x7f382c0a0e40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f381c0098f0 tx=0x7f381c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:11.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.123+0000 7f3831eea700 1 -- 172.21.15.154:0/1795858732 shutdown_connections 2023-09-30T22:24:11.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.123+0000 7f3831eea700 1 --2- 172.21.15.154:0/1795858732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c133f50 0x7f382c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.123+0000 7f3831eea700 1 --2- 172.21.15.154:0/1795858732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c0a0a70 0x7f382c0a0e40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.123+0000 7f3831eea700 1 --2- 172.21.15.154:0/1795858732 >> v2:172.21.15.154:3300/0 conn(0x7f382c0a1380 0x7f382c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.123+0000 7f3831eea700 1 -- 172.21.15.154:0/1795858732 >> 172.21.15.154:0/1795858732 conn(0x7f382c0a6610 msgr2=0x7f382c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.123+0000 7f3831eea700 1 -- 172.21.15.154:0/1795858732 shutdown_connections 2023-09-30T22:24:11.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.123+0000 7f3831eea700 1 -- 172.21.15.154:0/1795858732 wait complete. 2023-09-30T22:24:11.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.124+0000 7f3831eea700 1 Processor -- start 2023-09-30T22:24:11.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.124+0000 7f3831eea700 1 -- start start 2023-09-30T22:24:11.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f3831eea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c0a0a70 0x7f382c122510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f3831eea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f382c0a1380 0x7f382c122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f3831eea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c133f50 0x7f382c122f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:11.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f3831eea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c125db0 con 0x7f382c0a1380 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f3831eea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c133800 con 0x7f382c0a0a70 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f3831eea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c125fb0 con 0x7f382c133f50 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c0a0a70 0x7f382c122510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f382bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c133f50 0x7f382c122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c0a0a70 0x7f382c122510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43774/0 (socket says 172.21.15.154:43774) 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f382b7fe700 1 -- 172.21.15.154:0/1927138814 learned_addr learned my addr 172.21.15.154:0/1927138814 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.125+0000 7f382affd700 1 --2- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f382c0a1380 0x7f382c122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f382b7fe700 1 -- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c133f50 msgr2=0x7f382c122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f382b7fe700 1 --2- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c133f50 0x7f382c122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f382b7fe700 1 -- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f382c0a1380 msgr2=0x7f382c122a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f382b7fe700 1 --2- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f382c0a1380 0x7f382c122a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f382b7fe700 1 -- 172.21.15.154:0/1927138814 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824009a70 con 0x7f382c0a0a70 2023-09-30T22:24:11.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f382bfff700 1 --2- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c133f50 0x7f382c122f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:11.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f382b7fe700 1 --2- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c0a0a70 0x7f382c122510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f381c014040 tx=0x7f381c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:11.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f3813fff700 1 -- 172.21.15.154:0/1927138814 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c004450 con 0x7f382c0a0a70 2023-09-30T22:24:11.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f3813fff700 1 -- 172.21.15.154:0/1927138814 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c01e070 con 0x7f382c0a0a70 2023-09-30T22:24:11.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f3813fff700 1 -- 172.21.15.154:0/1927138814 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c0038e0 con 0x7f382c0a0a70 2023-09-30T22:24:11.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f3831eea700 1 -- 172.21.15.154:0/1927138814 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c009550 con 0x7f382c0a0a70 2023-09-30T22:24:11.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.126+0000 7f3831eea700 1 -- 172.21.15.154:0/1927138814 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c124e30 con 0x7f382c0a0a70 2023-09-30T22:24:11.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.128+0000 7f3831eea700 1 -- 172.21.15.154:0/1927138814 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c11f050 con 0x7f382c0a0a70 2023-09-30T22:24:11.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.128+0000 7f3813fff700 1 -- 172.21.15.154:0/1927138814 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f381c003a40 con 0x7f382c0a0a70 2023-09-30T22:24:11.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.128+0000 7f3813fff700 1 -- 172.21.15.154:0/1927138814 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f381c0404a0 con 0x7f382c0a0a70 2023-09-30T22:24:11.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.137+0000 7f3813fff700 1 -- 172.21.15.154:0/1927138814 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f381c003cf0 con 0x7f382c0a0a70 2023-09-30T22:24:11.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.194+0000 7fe1c2006700 1 -- 172.21.15.154:0/3349209468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe1bc1343a0 con 0x7fe1bc09a730 2023-09-30T22:24:11.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.194+0000 7fe1a3fff700 1 -- 172.21.15.154:0/3349209468 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1b00199a0 con 0x7fe1bc09a730 2023-09-30T22:24:11.195 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:11.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.197+0000 7fe1c2006700 1 -- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc09a730 msgr2=0x7fe1bc12d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.197+0000 7fe1c2006700 1 --2- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc09a730 0x7fe1bc12d840 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0000c00 tx=0x7fe1b0004750 comp rx=0 tx=0).stop 2023-09-30T22:24:11.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.197+0000 7fe1c2006700 1 -- 172.21.15.154:0/3349209468 shutdown_connections 2023-09-30T22:24:11.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.197+0000 7fe1c2006700 1 --2- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc130890 0x7fe1bc1376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.197+0000 7fe1c2006700 1 --2- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc099e20 0x7fe1bc12d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.197+0000 7fe1c2006700 1 --2- 172.21.15.154:0/3349209468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc09a730 0x7fe1bc12d840 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.197+0000 7fe1c2006700 1 -- 172.21.15.154:0/3349209468 >> 172.21.15.154:0/3349209468 conn(0x7fe1bc0a2980 msgr2=0x7fe1bc12f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.197+0000 7fe1c2006700 1 -- 172.21.15.154:0/3349209468 shutdown_connections 2023-09-30T22:24:11.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.197+0000 7fe1c2006700 1 -- 172.21.15.154:0/3349209468 wait complete. 2023-09-30T22:24:11.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:11.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.281+0000 7fd80d65e700 1 -- 172.21.15.154:0/1459825817 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd80811e280 con 0x7fd80809ad40 2023-09-30T22:24:11.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.281+0000 7fd7ef7fe700 1 -- 172.21.15.154:0/1459825817 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7f8012400 con 0x7fd80809ad40 2023-09-30T22:24:11.282 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.284+0000 7fd80d65e700 1 -- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80809ad40 msgr2=0x7fd80811c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.284+0000 7fd80d65e700 1 --2- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80809ad40 0x7fd80811c8c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c480 tx=0x7fd7f800c790 comp rx=0 tx=0).stop 2023-09-30T22:24:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.284+0000 7fd80d65e700 1 -- 172.21.15.154:0/1459825817 shutdown_connections 2023-09-30T22:24:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.284+0000 7fd80d65e700 1 --2- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd808134570 0x7fd80811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.284+0000 7fd80d65e700 1 --2- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80809ad40 0x7fd80811c8c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.284+0000 7fd80d65e700 1 --2- 172.21.15.154:0/1459825817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd808134140 0x7fd80811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.284+0000 7fd80d65e700 1 -- 172.21.15.154:0/1459825817 >> 172.21.15.154:0/1459825817 conn(0x7fd808099c40 msgr2=0x7fd8080a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.284+0000 7fd80d65e700 1 -- 172.21.15.154:0/1459825817 shutdown_connections 2023-09-30T22:24:11.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.284+0000 7fd80d65e700 1 -- 172.21.15.154:0/1459825817 wait complete. 2023-09-30T22:24:11.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:11.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.311+0000 7f28f895e700 1 -- 172.21.15.154:0/1757578184 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f28f409b840 con 0x7f28f4134160 2023-09-30T22:24:11.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.311+0000 7f28e2ffd700 1 -- 172.21.15.154:0/1757578184 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28ec018020 con 0x7f28f4134160 2023-09-30T22:24:11.312 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:11.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.313+0000 7f28f895e700 1 -- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f4134160 msgr2=0x7f28f411e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.313+0000 7f28f895e700 1 --2- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f4134160 0x7f28f411e9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00efc0 tx=0x7f28ec00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.313+0000 7f28f895e700 1 -- 172.21.15.154:0/1757578184 shutdown_connections 2023-09-30T22:24:11.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.313+0000 7f28f895e700 1 --2- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28f4134160 0x7f28f411e9f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.313+0000 7f28f895e700 1 --2- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28f409bd20 0x7f28f411df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.313+0000 7f28f895e700 1 --2- 172.21.15.154:0/1757578184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28f41337d0 0x7f28f411e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.313+0000 7f28f895e700 1 -- 172.21.15.154:0/1757578184 >> 172.21.15.154:0/1757578184 conn(0x7f28f409f9f0 msgr2=0x7f28f4132f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.313+0000 7f28f895e700 1 -- 172.21.15.154:0/1757578184 shutdown_connections 2023-09-30T22:24:11.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.313+0000 7f28f895e700 1 -- 172.21.15.154:0/1757578184 wait complete. 2023-09-30T22:24:11.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:11.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.357+0000 7f3831eea700 1 -- 172.21.15.154:0/1927138814 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f382c04f2a0 con 0x7f382c0a0a70 2023-09-30T22:24:11.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.358+0000 7f3813fff700 1 -- 172.21.15.154:0/1927138814 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f381c015030 con 0x7f382c0a0a70 2023-09-30T22:24:11.358 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:11.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.360+0000 7f3831eea700 1 -- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c0a0a70 msgr2=0x7f382c122510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:11.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.360+0000 7f3831eea700 1 --2- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c0a0a70 0x7f382c122510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f381c014040 tx=0x7f381c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:11.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.360+0000 7f3831eea700 1 -- 172.21.15.154:0/1927138814 shutdown_connections 2023-09-30T22:24:11.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.360+0000 7f3831eea700 1 --2- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f382c133f50 0x7f382c122f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.360+0000 7f3831eea700 1 --2- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f382c0a0a70 0x7f382c122510 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.360+0000 7f3831eea700 1 --2- 172.21.15.154:0/1927138814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f382c0a1380 0x7f382c122a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:11.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.360+0000 7f3831eea700 1 -- 172.21.15.154:0/1927138814 >> 172.21.15.154:0/1927138814 conn(0x7f382c0a6610 msgr2=0x7f382c09f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:11.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.360+0000 7f3831eea700 1 -- 172.21.15.154:0/1927138814 shutdown_connections 2023-09-30T22:24:11.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:11.360+0000 7f3831eea700 1 -- 172.21.15.154:0/1927138814 wait complete. 2023-09-30T22:24:11.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:12.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:12.299 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:12.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:12.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.342+0000 7f7f4cb6a700 1 Processor -- start 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.342+0000 7f7f4cb6a700 1 -- start start 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f4cb6a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f4809e870 0x7f7f4809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f4cb6a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f48139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f4cb6a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4809c970 con 0x7f7f4809f180 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f4cb6a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480a0920 con 0x7f7f4809e870 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f4cb6a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4809f9c0 con 0x7f7f48131f40 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f4659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f4809e870 0x7f7f4809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f46d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f48139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f46d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f48139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43778/0 (socket says 172.21.15.154:43778) 2023-09-30T22:24:12.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f4659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f4809e870 0x7f7f4809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34176/0 (socket says 172.21.15.154:34176) 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.343+0000 7f7f46d9d700 1 -- 172.21.15.154:0/535549049 learned_addr learned my addr 172.21.15.154:0/535549049 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.344+0000 7f7f4659c700 1 -- 172.21.15.154:0/535549049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 msgr2=0x7f7f48139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.344+0000 7f7f4659c700 1 --2- 172.21.15.154:0/535549049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f48139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.344+0000 7f7f4659c700 1 -- 172.21.15.154:0/535549049 >> v1:172.21.15.154:6789/0 conn(0x7f7f4809f180 legacy=0x7f7f48131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.344+0000 7f7f4659c700 1 -- 172.21.15.154:0/535549049 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4809bab0 con 0x7f7f4809e870 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.344+0000 7f7f4559a700 1 -- 172.21.15.154:0/535549049 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682450990 0 0) 0x7f7f4809c970 con 0x7f7f4809f180 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.344+0000 7f7f4659c700 1 --2- 172.21.15.154:0/535549049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 0x7f7f4809ec40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009840 tx=0x7f7f38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2f57f2b5b239c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.344+0000 7f7f4559a700 1 -- 172.21.15.154:0/535549049 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38011830 con 0x7f7f4809e870 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.344+0000 7f7f4559a700 1 -- 172.21.15.154:0/535549049 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f38011990 con 0x7f7f4809e870 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.344+0000 7f7f4559a700 1 -- 172.21.15.154:0/535549049 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38011d20 con 0x7f7f4809e870 2023-09-30T22:24:12.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.345+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/535549049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 msgr2=0x7f7f4809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.345+0000 7f7f4cb6a700 1 --2- 172.21.15.154:0/535549049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 0x7f7f4809ec40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009840 tx=0x7f7f38009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.345+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/535549049 shutdown_connections 2023-09-30T22:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.345+0000 7f7f4cb6a700 1 --2- 172.21.15.154:0/535549049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f48139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.345+0000 7f7f4cb6a700 1 --2- 172.21.15.154:0/535549049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 0x7f7f4809ec40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.345+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/535549049 >> 172.21.15.154:0/535549049 conn(0x7f7f480a4430 msgr2=0x7f7f480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.345+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/535549049 shutdown_connections 2023-09-30T22:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.345+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/535549049 wait complete. 2023-09-30T22:24:12.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.346+0000 7f7f4cb6a700 1 Processor -- start 2023-09-30T22:24:12.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f4cb6a700 1 -- start start 2023-09-30T22:24:12.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f4cb6a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 0x7f7f4806c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f4cb6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f4809f180 0x7f7f4806c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f4cb6a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f481c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f4cb6a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481220c0 con 0x7f7f4809e870 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f4cb6a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48122460 con 0x7f7f48131f40 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f4cb6a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481314b0 con 0x7f7f4809f180 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f46d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f481c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f4659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 0x7f7f4806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f46d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f481c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43792/0 (socket says 172.21.15.154:43792) 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f4659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 0x7f7f4806c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34184/0 (socket says 172.21.15.154:34184) 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f46d9d700 1 -- 172.21.15.154:0/878814942 learned_addr learned my addr 172.21.15.154:0/878814942 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.347+0000 7f7f45d9b700 1 --2- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f4809f180 0x7f7f4806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f46d9d700 1 -- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f4809f180 msgr2=0x7f7f4806c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f46d9d700 1 --2- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f4809f180 0x7f7f4806c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f46d9d700 1 -- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 msgr2=0x7f7f4806c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f46d9d700 1 --2- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 0x7f7f4806c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f46d9d700 1 -- 172.21.15.154:0/878814942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380094a0 con 0x7f7f48131f40 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f4659c700 1 --2- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 0x7f7f4806c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f46d9d700 1 --2- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f481c8230 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009d90 tx=0x7f7f4000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f36ffd700 1 -- 172.21.15.154:0/878814942 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40003c20 con 0x7f7f48131f40 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f36ffd700 1 -- 172.21.15.154:0/878814942 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4000f040 con 0x7f7f48131f40 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/878814942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4806d4c0 con 0x7f7f48131f40 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f36ffd700 1 -- 172.21.15.154:0/878814942 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000c930 con 0x7f7f48131f40 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.348+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/878814942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4806cc90 con 0x7f7f48131f40 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.349+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/878814942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4804f2a0 con 0x7f7f48131f40 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.349+0000 7f7f36ffd700 1 -- 172.21.15.154:0/878814942 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f4000ca90 con 0x7f7f48131f40 2023-09-30T22:24:12.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.349+0000 7f7f36ffd700 1 -- 172.21.15.154:0/878814942 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f40047560 con 0x7f7f48131f40 2023-09-30T22:24:12.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.354+0000 7f7f36ffd700 1 -- 172.21.15.154:0/878814942 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f40074750 con 0x7f7f48131f40 2023-09-30T22:24:12.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:12.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.445+0000 7fad8b4b6700 1 Processor -- start 2023-09-30T22:24:12.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.445+0000 7fad8b4b6700 1 -- start start 2023-09-30T22:24:12.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.446+0000 7fad8b4b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413adf0 0x7fad8413d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.446+0000 7fad8b4b6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad8413d710 0x7fad8413faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.446+0000 7fad8b4b6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8409d060 con 0x7fad84137d60 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.446+0000 7fad8b4b6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8409a090 con 0x7fad8413d710 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.446+0000 7fad8b4b6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad84137b80 con 0x7fad8413adf0 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.446+0000 7fad88a51700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413adf0 0x7fad8413d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.446+0000 7fad88a51700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413adf0 0x7fad8413d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43804/0 (socket says 172.21.15.154:43804) 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.446+0000 7fad88a51700 1 -- 172.21.15.154:0/4143588431 learned_addr learned my addr 172.21.15.154:0/4143588431 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.447+0000 7fad88a51700 1 -- 172.21.15.154:0/4143588431 >> v2:172.21.15.154:3300/0 conn(0x7fad8413d710 msgr2=0x7fad8413faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.447+0000 7fad88a51700 1 --2- 172.21.15.154:0/4143588431 >> v2:172.21.15.154:3300/0 conn(0x7fad8413d710 0x7fad8413faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.447+0000 7fad88a51700 1 -- 172.21.15.154:0/4143588431 >> v1:172.21.15.154:6789/0 conn(0x7fad84137d60 legacy=0x7fad84138130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.447+0000 7fad88a51700 1 -- 172.21.15.154:0/4143588431 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8409aa80 con 0x7fad8413adf0 2023-09-30T22:24:12.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.447+0000 7fad88a51700 1 --2- 172.21.15.154:0/4143588431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413adf0 0x7fad8413d1d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad800098f0 tx=0x7fad80009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3145e59002adc177 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.447+0000 7fad77fff700 1 -- 172.21.15.154:0/4143588431 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80004230 con 0x7fad8413adf0 2023-09-30T22:24:12.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.447+0000 7fad77fff700 1 -- 172.21.15.154:0/4143588431 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80004390 con 0x7fad8413adf0 2023-09-30T22:24:12.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.447+0000 7fad77fff700 1 -- 172.21.15.154:0/4143588431 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad800036a0 con 0x7fad8413adf0 2023-09-30T22:24:12.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.448+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4143588431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413adf0 msgr2=0x7fad8413d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.448+0000 7fad8b4b6700 1 --2- 172.21.15.154:0/4143588431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413adf0 0x7fad8413d1d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad800098f0 tx=0x7fad80009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:12.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.448+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4143588431 shutdown_connections 2023-09-30T22:24:12.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.448+0000 7fad8b4b6700 1 --2- 172.21.15.154:0/4143588431 >> v2:172.21.15.154:3300/0 conn(0x7fad8413d710 0x7fad8413faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.448+0000 7fad8b4b6700 1 --2- 172.21.15.154:0/4143588431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413adf0 0x7fad8413d1d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.448+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4143588431 >> 172.21.15.154:0/4143588431 conn(0x7fad840a2980 msgr2=0x7fad840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.448+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4143588431 shutdown_connections 2023-09-30T22:24:12.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.448+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4143588431 wait complete. 2023-09-30T22:24:12.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad8b4b6700 1 Processor -- start 2023-09-30T22:24:12.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad8b4b6700 1 -- start start 2023-09-30T22:24:12.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad8b4b6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad84137d60 0x7fad8406ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad8b4b6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad8413adf0 0x7fad84070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad8b4b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413d710 0x7fad84070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad8b4b6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad84122dc0 con 0x7fad84137d60 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad8b4b6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad84123010 con 0x7fad8413d710 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad8b4b6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad84121f00 con 0x7fad8413adf0 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad89252700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad84137d60 0x7fad8406ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad89252700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad84137d60 0x7fad8406ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34204/0 (socket says 172.21.15.154:34204) 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.450+0000 7fad89252700 1 -- 172.21.15.154:0/4216987682 learned_addr learned my addr 172.21.15.154:0/4216987682 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad88a51700 1 --2- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad8413adf0 0x7fad84070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad89252700 1 -- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad8413adf0 msgr2=0x7fad84070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad89252700 1 --2- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad8413adf0 0x7fad84070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad89252700 1 -- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413d710 msgr2=0x7fad84070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad89252700 1 --2- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413d710 0x7fad84070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad89252700 1 -- 172.21.15.154:0/4216987682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad80009550 con 0x7fad84137d60 2023-09-30T22:24:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad89252700 1 --2- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad84137d60 0x7fad8406ff00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fad7800c520 tx=0x7fad7800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad75ffb700 1 -- 172.21.15.154:0/4216987682 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780054e0 con 0x7fad84137d60 2023-09-30T22:24:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad75ffb700 1 -- 172.21.15.154:0/4216987682 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad78003680 con 0x7fad84137d60 2023-09-30T22:24:12.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad75ffb700 1 -- 172.21.15.154:0/4216987682 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78003a30 con 0x7fad84137d60 2023-09-30T22:24:12.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.451+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4216987682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad841373d0 con 0x7fad84137d60 2023-09-30T22:24:12.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.452+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4216987682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad84071b20 con 0x7fad84137d60 2023-09-30T22:24:12.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.453+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4216987682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8404f2a0 con 0x7fad84137d60 2023-09-30T22:24:12.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.454+0000 7fad75ffb700 1 -- 172.21.15.154:0/4216987682 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad78003b90 con 0x7fad84137d60 2023-09-30T22:24:12.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.454+0000 7fad75ffb700 1 -- 172.21.15.154:0/4216987682 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad7803eb90 con 0x7fad84137d60 2023-09-30T22:24:12.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.459+0000 7fad75ffb700 1 -- 172.21.15.154:0/4216987682 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad78003e40 con 0x7fad84137d60 2023-09-30T22:24:12.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.476+0000 7f8283898700 1 Processor -- start 2023-09-30T22:24:12.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.477+0000 7f8283898700 1 -- start start 2023-09-30T22:24:12.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.477+0000 7f8283898700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09b400 0x7f827c09b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.477+0000 7f8283898700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f827c09bd10 0x7f827c13c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.477+0000 7f8283898700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827c0a0a70 con 0x7f827c13c760 2023-09-30T22:24:12.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.477+0000 7f8283898700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827c09b190 con 0x7f827c09bd10 2023-09-30T22:24:12.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.477+0000 7f8283898700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c09a820 con 0x7f827c09b400 2023-09-30T22:24:12.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.477+0000 7f8280e33700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f827c09bd10 0x7f827c13c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.477+0000 7f8280e33700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f827c09bd10 0x7f827c13c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34208/0 (socket says 172.21.15.154:34208) 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.477+0000 7f8280e33700 1 -- 172.21.15.154:0/2384378076 learned_addr learned my addr 172.21.15.154:0/2384378076 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.478+0000 7f8281634700 1 --2- 172.21.15.154:0/2384378076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09b400 0x7f827c09b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.478+0000 7f8280e33700 1 -- 172.21.15.154:0/2384378076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09b400 msgr2=0x7f827c09b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.478+0000 7f8280e33700 1 --2- 172.21.15.154:0/2384378076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09b400 0x7f827c09b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.478+0000 7f8280e33700 1 -- 172.21.15.154:0/2384378076 >> v1:172.21.15.154:6789/0 conn(0x7f827c13c760 legacy=0x7f827c13eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.478+0000 7f8280e33700 1 -- 172.21.15.154:0/2384378076 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c09a280 con 0x7f827c09bd10 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.478+0000 7f8280e33700 1 --2- 172.21.15.154:0/2384378076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c09bd10 0x7f827c13c220 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098f0 tx=0x7f826c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f8a72be56e9970 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.478+0000 7f8273fff700 1 -- 172.21.15.154:0/2384378076 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c011830 con 0x7f827c09bd10 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.478+0000 7f8273fff700 1 -- 172.21.15.154:0/2384378076 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c011990 con 0x7f827c09bd10 2023-09-30T22:24:12.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.478+0000 7f8273fff700 1 -- 172.21.15.154:0/2384378076 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c011d20 con 0x7f827c09bd10 2023-09-30T22:24:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.479+0000 7f8283898700 1 -- 172.21.15.154:0/2384378076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c09bd10 msgr2=0x7f827c13c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.479+0000 7f8283898700 1 --2- 172.21.15.154:0/2384378076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c09bd10 0x7f827c13c220 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098f0 tx=0x7f826c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.479+0000 7f8283898700 1 -- 172.21.15.154:0/2384378076 shutdown_connections 2023-09-30T22:24:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.479+0000 7f8283898700 1 --2- 172.21.15.154:0/2384378076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09b400 0x7f827c09b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.479+0000 7f8283898700 1 --2- 172.21.15.154:0/2384378076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c09bd10 0x7f827c13c220 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.479+0000 7f8283898700 1 -- 172.21.15.154:0/2384378076 >> 172.21.15.154:0/2384378076 conn(0x7f827c099c40 msgr2=0x7f827c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.479+0000 7f8283898700 1 -- 172.21.15.154:0/2384378076 shutdown_connections 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.479+0000 7f8283898700 1 -- 172.21.15.154:0/2384378076 wait complete. 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.480+0000 7f8283898700 1 Processor -- start 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.480+0000 7f8283898700 1 -- start start 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8283898700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f827c09b400 0x7f827c070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8283898700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09bd10 0x7f827c13a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8283898700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c13c760 0x7f827c13ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8283898700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c0717f0 con 0x7f827c13c760 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8283898700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c071600 con 0x7f827c09bd10 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8283898700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f827c134fb0 con 0x7f827c09b400 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8280e33700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09bd10 0x7f827c13a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8280e33700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09bd10 0x7f827c13a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43838/0 (socket says 172.21.15.154:43838) 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8280e33700 1 -- 172.21.15.154:0/3805939993 learned_addr learned my addr 172.21.15.154:0/3805939993 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8281634700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f827c09b400 0x7f827c070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8281e35700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c13c760 0x7f827c13ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8280e33700 1 -- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f827c09b400 msgr2=0x7f827c070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8280e33700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f827c09b400 0x7f827c070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8280e33700 1 -- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c13c760 msgr2=0x7f827c13ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8280e33700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c13c760 0x7f827c13ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8280e33700 1 -- 172.21.15.154:0/3805939993 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c009550 con 0x7f827c09bd10 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.481+0000 7f8281e35700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c13c760 0x7f827c13ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.482+0000 7f8280e33700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09bd10 0x7f827c13a850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f826c013000 tx=0x7f826c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.482+0000 7f8271ffb700 1 -- 172.21.15.154:0/3805939993 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c004480 con 0x7f827c09bd10 2023-09-30T22:24:12.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.482+0000 7f8271ffb700 1 -- 172.21.15.154:0/3805939993 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c01f070 con 0x7f827c09bd10 2023-09-30T22:24:12.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.482+0000 7f8271ffb700 1 -- 172.21.15.154:0/3805939993 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c0038a0 con 0x7f827c09bd10 2023-09-30T22:24:12.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.482+0000 7f8283898700 1 -- 172.21.15.154:0/3805939993 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c09c630 con 0x7f827c09bd10 2023-09-30T22:24:12.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.482+0000 7f8283898700 1 -- 172.21.15.154:0/3805939993 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c11df00 con 0x7f827c09bd10 2023-09-30T22:24:12.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.483+0000 7f8283898700 1 -- 172.21.15.154:0/3805939993 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c11da90 con 0x7f827c09bd10 2023-09-30T22:24:12.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.484+0000 7f8271ffb700 1 -- 172.21.15.154:0/3805939993 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f826c021030 con 0x7f827c09bd10 2023-09-30T22:24:12.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.488+0000 7f8271ffb700 1 -- 172.21.15.154:0/3805939993 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f826c023a20 con 0x7f827c09bd10 2023-09-30T22:24:12.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.488+0000 7f8271ffb700 1 -- 172.21.15.154:0/3805939993 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f826c01b7b0 con 0x7f827c09bd10 2023-09-30T22:24:12.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.514+0000 7f6acf549700 1 Processor -- start 2023-09-30T22:24:12.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.514+0000 7f6acf549700 1 -- start start 2023-09-30T22:24:12.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6acf549700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ac809f350 0x7f6ac8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6acf549700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac81371c0 0x7f6ac81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6acf549700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac809c970 con 0x7f6ac809e870 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6acf549700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac80a0920 con 0x7f6ac809f350 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6acf549700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac809f9c0 con 0x7f6ac81371c0 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6accae4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ac809f350 0x7f6ac8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6accae4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ac809f350 0x7f6ac8136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34226/0 (socket says 172.21.15.154:34226) 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6accae4700 1 -- 172.21.15.154:0/3039031048 learned_addr learned my addr 172.21.15.154:0/3039031048 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6acdae6700 1 --2- 172.21.15.154:0/3039031048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac81371c0 0x7f6ac81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6accae4700 1 -- 172.21.15.154:0/3039031048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac81371c0 msgr2=0x7f6ac81395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6accae4700 1 --2- 172.21.15.154:0/3039031048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac81371c0 0x7f6ac81395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6accae4700 1 -- 172.21.15.154:0/3039031048 >> v1:172.21.15.154:6789/0 conn(0x7f6ac809e870 legacy=0x7f6ac809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6accae4700 1 -- 172.21.15.154:0/3039031048 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac809bab0 con 0x7f6ac809f350 2023-09-30T22:24:12.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6abffff700 1 -- 172.21.15.154:0/3039031048 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037598828 0 0) 0x7f6ac809c970 con 0x7f6ac809e870 2023-09-30T22:24:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.515+0000 7f6accae4700 1 --2- 172.21.15.154:0/3039031048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac809f350 0x7f6ac8136c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80098f0 tx=0x7f6ab8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9527e678087a6b3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.516+0000 7f6abffff700 1 -- 172.21.15.154:0/3039031048 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8011830 con 0x7f6ac809f350 2023-09-30T22:24:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.516+0000 7f6abffff700 1 -- 172.21.15.154:0/3039031048 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab8011990 con 0x7f6ac809f350 2023-09-30T22:24:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.516+0000 7f6abffff700 1 -- 172.21.15.154:0/3039031048 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8011d20 con 0x7f6ac809f350 2023-09-30T22:24:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.516+0000 7f6acf549700 1 -- 172.21.15.154:0/3039031048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac809f350 msgr2=0x7f6ac8136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.516+0000 7f6acf549700 1 --2- 172.21.15.154:0/3039031048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac809f350 0x7f6ac8136c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80098f0 tx=0x7f6ab8009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.517+0000 7f6acf549700 1 -- 172.21.15.154:0/3039031048 shutdown_connections 2023-09-30T22:24:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.517+0000 7f6acf549700 1 --2- 172.21.15.154:0/3039031048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac81371c0 0x7f6ac81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.517+0000 7f6acf549700 1 --2- 172.21.15.154:0/3039031048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac809f350 0x7f6ac8136c80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.517+0000 7f6acf549700 1 -- 172.21.15.154:0/3039031048 >> 172.21.15.154:0/3039031048 conn(0x7f6ac80a4430 msgr2=0x7f6ac80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.517+0000 7f6acf549700 1 -- 172.21.15.154:0/3039031048 shutdown_connections 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.517+0000 7f6acf549700 1 -- 172.21.15.154:0/3039031048 wait complete. 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.517+0000 7f6acf549700 1 Processor -- start 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acf549700 1 -- start start 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acf549700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ac809e870 0x7f6ac81c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acf549700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac809f350 0x7f6ac81c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acf549700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac81371c0 0x7f6ac806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acf549700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8136520 con 0x7f6ac81371c0 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acf549700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac806d640 con 0x7f6ac809f350 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acf549700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8072250 con 0x7f6ac809e870 2023-09-30T22:24:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acdae6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac81371c0 0x7f6ac806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acdae6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac81371c0 0x7f6ac806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34238/0 (socket says 172.21.15.154:34238) 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acdae6700 1 -- 172.21.15.154:0/1971247239 learned_addr learned my addr 172.21.15.154:0/1971247239 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6accae4700 1 --2- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac809f350 0x7f6ac81c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acdae6700 1 -- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ac809e870 msgr2=0x7f6ac81c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acdae6700 1 --2- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ac809e870 0x7f6ac81c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acdae6700 1 -- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac809f350 msgr2=0x7f6ac81c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acdae6700 1 --2- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac809f350 0x7f6ac81c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6acdae6700 1 -- 172.21.15.154:0/1971247239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009550 con 0x7f6ac81371c0 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.518+0000 7f6accae4700 1 --2- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac809f350 0x7f6ac81c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.519+0000 7f6acdae6700 1 --2- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac81371c0 0x7f6ac806b8b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000efc0 tx=0x7f6ac000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.519+0000 7f6abdffb700 1 -- 172.21.15.154:0/1971247239 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac000cd40 con 0x7f6ac81371c0 2023-09-30T22:24:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.519+0000 7f6abdffb700 1 -- 172.21.15.154:0/1971247239 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac000f040 con 0x7f6ac81371c0 2023-09-30T22:24:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.519+0000 7f6abdffb700 1 -- 172.21.15.154:0/1971247239 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac00146c0 con 0x7f6ac81371c0 2023-09-30T22:24:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.519+0000 7f6acf549700 1 -- 172.21.15.154:0/1971247239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac8126470 con 0x7f6ac81371c0 2023-09-30T22:24:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.519+0000 7f6acf549700 1 -- 172.21.15.154:0/1971247239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac809dba0 con 0x7f6ac81371c0 2023-09-30T22:24:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.520+0000 7f6abdffb700 1 -- 172.21.15.154:0/1971247239 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ac0014820 con 0x7f6ac81371c0 2023-09-30T22:24:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.520+0000 7f6abdffb700 1 -- 172.21.15.154:0/1971247239 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ac0040060 con 0x7f6ac81371c0 2023-09-30T22:24:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.520+0000 7f6acf549700 1 -- 172.21.15.154:0/1971247239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac804f2a0 con 0x7f6ac81371c0 2023-09-30T22:24:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.529+0000 7f6abdffb700 1 -- 172.21.15.154:0/1971247239 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ac0018020 con 0x7f6ac81371c0 2023-09-30T22:24:12.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.623+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/878814942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f4806b2a0 con 0x7f7f48131f40 2023-09-30T22:24:12.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.623+0000 7f7f36ffd700 1 -- 172.21.15.154:0/878814942 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f40022020 con 0x7f7f48131f40 2023-09-30T22:24:12.624 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:12.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.626+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 msgr2=0x7f7f481c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.626+0000 7f7f4cb6a700 1 --2- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f481c8230 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009d90 tx=0x7f7f4000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.626+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/878814942 shutdown_connections 2023-09-30T22:24:12.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.626+0000 7f7f4cb6a700 1 --2- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f48131f40 0x7f7f481c8230 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.626+0000 7f7f4cb6a700 1 --2- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4809e870 0x7f7f4806c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.626+0000 7f7f4cb6a700 1 --2- 172.21.15.154:0/878814942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f4809f180 0x7f7f4806c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.626+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/878814942 >> 172.21.15.154:0/878814942 conn(0x7f7f480a4430 msgr2=0x7f7f480a2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.626+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/878814942 shutdown_connections 2023-09-30T22:24:12.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.626+0000 7f7f4cb6a700 1 -- 172.21.15.154:0/878814942 wait complete. 2023-09-30T22:24:12.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:12.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.690+0000 7f8283898700 1 -- 172.21.15.154:0/3805939993 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f827c04f2a0 con 0x7f827c09bd10 2023-09-30T22:24:12.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.690+0000 7f8271ffb700 1 -- 172.21.15.154:0/3805939993 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f826c015030 con 0x7f827c09bd10 2023-09-30T22:24:12.691 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:12.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.692+0000 7f8283898700 1 -- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09bd10 msgr2=0x7f827c13a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.692+0000 7f8283898700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09bd10 0x7f827c13a850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f826c013000 tx=0x7f826c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:12.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.692+0000 7f8283898700 1 -- 172.21.15.154:0/3805939993 shutdown_connections 2023-09-30T22:24:12.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.692+0000 7f8283898700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827c13c760 0x7f827c13ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.692+0000 7f8283898700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f827c09b400 0x7f827c070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.692+0000 7f8283898700 1 --2- 172.21.15.154:0/3805939993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f827c09bd10 0x7f827c13a850 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.692+0000 7f8283898700 1 -- 172.21.15.154:0/3805939993 >> 172.21.15.154:0/3805939993 conn(0x7f827c099c40 msgr2=0x7f827c13cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.692+0000 7f8283898700 1 -- 172.21.15.154:0/3805939993 shutdown_connections 2023-09-30T22:24:12.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.692+0000 7f8283898700 1 -- 172.21.15.154:0/3805939993 wait complete. 2023-09-30T22:24:12.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:12.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.718+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4216987682 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fad84122c20 con 0x7fad84137d60 2023-09-30T22:24:12.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.718+0000 7fad75ffb700 1 -- 172.21.15.154:0/4216987682 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad84122c20 con 0x7fad84137d60 2023-09-30T22:24:12.719 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:12.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.721+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad84137d60 msgr2=0x7fad8406ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.721+0000 7fad8b4b6700 1 --2- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad84137d60 0x7fad8406ff00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fad7800c520 tx=0x7fad7800c830 comp rx=0 tx=0).stop 2023-09-30T22:24:12.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.721+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4216987682 shutdown_connections 2023-09-30T22:24:12.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.721+0000 7fad8b4b6700 1 --2- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad8413d710 0x7fad84070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.721+0000 7fad8b4b6700 1 --2- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad84137d60 0x7fad8406ff00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.721+0000 7fad8b4b6700 1 --2- 172.21.15.154:0/4216987682 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad8413adf0 0x7fad84070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.721+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4216987682 >> 172.21.15.154:0/4216987682 conn(0x7fad840a2980 msgr2=0x7fad8409bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.721+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4216987682 shutdown_connections 2023-09-30T22:24:12.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.721+0000 7fad8b4b6700 1 -- 172.21.15.154:0/4216987682 wait complete. 2023-09-30T22:24:12.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.725+0000 7f6acf549700 1 -- 172.21.15.154:0/1971247239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ac8124d70 con 0x7f6ac81371c0 2023-09-30T22:24:12.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.725+0000 7f6abdffb700 1 -- 172.21.15.154:0/1971247239 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ac001a8b0 con 0x7f6ac81371c0 2023-09-30T22:24:12.726 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.729+0000 7f6acf549700 1 -- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac81371c0 msgr2=0x7f6ac806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.729+0000 7f6acf549700 1 --2- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac81371c0 0x7f6ac806b8b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000efc0 tx=0x7f6ac000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.729+0000 7f6acf549700 1 -- 172.21.15.154:0/1971247239 shutdown_connections 2023-09-30T22:24:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.729+0000 7f6acf549700 1 --2- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ac81371c0 0x7f6ac806b8b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.729+0000 7f6acf549700 1 --2- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ac809e870 0x7f6ac81c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.729+0000 7f6acf549700 1 --2- 172.21.15.154:0/1971247239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ac809f350 0x7f6ac81c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.729+0000 7f6acf549700 1 -- 172.21.15.154:0/1971247239 >> 172.21.15.154:0/1971247239 conn(0x7f6ac80a4430 msgr2=0x7f6ac80a28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.729+0000 7f6acf549700 1 -- 172.21.15.154:0/1971247239 shutdown_connections 2023-09-30T22:24:12.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:12.729+0000 7f6acf549700 1 -- 172.21.15.154:0/1971247239 wait complete. 2023-09-30T22:24:12.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:12.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:13.640 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:13.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:13.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:13.743 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:13.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.784+0000 7f8534083700 1 Processor -- start 2023-09-30T22:24:13.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.784+0000 7f8534083700 1 -- start start 2023-09-30T22:24:13.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.784+0000 7f8534083700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c133ad0 0x7f852c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.784+0000 7f8534083700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f852c1300a0 0x7f852c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.784+0000 7f8534083700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c06b2d0 con 0x7f852c1309f0 2023-09-30T22:24:13.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.784+0000 7f8534083700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c133610 con 0x7f852c1300a0 2023-09-30T22:24:13.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.784+0000 7f8534083700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f852c09a500 con 0x7f852c133ad0 2023-09-30T22:24:13.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.785+0000 7f8532620700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f852c1309f0 0x7f852c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55906/0 (socket says 172.21.15.154:55906) 2023-09-30T22:24:13.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.785+0000 7f8532620700 1 -- 172.21.15.154:0/3007193818 learned_addr learned my addr 172.21.15.154:0/3007193818 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:13.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.785+0000 7f853161e700 1 --2- 172.21.15.154:0/3007193818 >> v2:172.21.15.154:3300/0 conn(0x7f852c1300a0 0x7f852c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.785+0000 7f853161e700 1 -- 172.21.15.154:0/3007193818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c133ad0 msgr2=0x7f852c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:13.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.785+0000 7f853161e700 1 --2- 172.21.15.154:0/3007193818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c133ad0 0x7f852c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.785+0000 7f853161e700 1 -- 172.21.15.154:0/3007193818 >> v1:172.21.15.154:6789/0 conn(0x7f852c1309f0 legacy=0x7f852c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.785+0000 7f853161e700 1 -- 172.21.15.154:0/3007193818 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c1338b0 con 0x7f852c1300a0 2023-09-30T22:24:13.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.785+0000 7f853161e700 1 --2- 172.21.15.154:0/3007193818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 0x7f852c1304b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f851c009840 tx=0x7f851c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe589d22de0f0b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.787+0000 7f8530e1d700 1 -- 172.21.15.154:0/3007193818 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c011830 con 0x7f852c1300a0 2023-09-30T22:24:13.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.787+0000 7f8530e1d700 1 -- 172.21.15.154:0/3007193818 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c011990 con 0x7f852c1300a0 2023-09-30T22:24:13.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.787+0000 7f8530e1d700 1 -- 172.21.15.154:0/3007193818 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c011d20 con 0x7f852c1300a0 2023-09-30T22:24:13.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.787+0000 7f8534083700 1 -- 172.21.15.154:0/3007193818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 msgr2=0x7f852c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.787+0000 7f8534083700 1 --2- 172.21.15.154:0/3007193818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 0x7f852c1304b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f851c009840 tx=0x7f851c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:13.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.787+0000 7f8534083700 1 -- 172.21.15.154:0/3007193818 shutdown_connections 2023-09-30T22:24:13.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.787+0000 7f8534083700 1 --2- 172.21.15.154:0/3007193818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c133ad0 0x7f852c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.787+0000 7f8534083700 1 --2- 172.21.15.154:0/3007193818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 0x7f852c1304b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.787+0000 7f8534083700 1 -- 172.21.15.154:0/3007193818 >> 172.21.15.154:0/3007193818 conn(0x7f852c099c40 msgr2=0x7f852c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.788+0000 7f8534083700 1 -- 172.21.15.154:0/3007193818 shutdown_connections 2023-09-30T22:24:13.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.788+0000 7f8534083700 1 -- 172.21.15.154:0/3007193818 wait complete. 2023-09-30T22:24:13.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.789+0000 7f8534083700 1 Processor -- start 2023-09-30T22:24:13.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.789+0000 7f8534083700 1 -- start start 2023-09-30T22:24:13.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8534083700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 0x7f852c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8534083700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c1309f0 0x7f852c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8534083700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f852c133ad0 0x7f852c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8534083700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c120130 con 0x7f852c1300a0 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8534083700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c120aa0 con 0x7f852c133ad0 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8534083700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f852c072200 con 0x7f852c1309f0 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f853161e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c1309f0 0x7f852c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f853161e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c1309f0 0x7f852c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55742/0 (socket says 172.21.15.154:55742) 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f853161e700 1 -- 172.21.15.154:0/3667815183 learned_addr learned my addr 172.21.15.154:0/3667815183 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8531e1f700 1 --2- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 0x7f852c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8532620700 1 --2- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f852c133ad0 0x7f852c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8531e1f700 1 -- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c1309f0 msgr2=0x7f852c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8531e1f700 1 --2- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c1309f0 0x7f852c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8531e1f700 1 -- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f852c133ad0 msgr2=0x7f852c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8531e1f700 1 --2- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f852c133ad0 0x7f852c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8531e1f700 1 -- 172.21.15.154:0/3667815183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0094a0 con 0x7f852c1300a0 2023-09-30T22:24:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.790+0000 7f8531e1f700 1 --2- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 0x7f852c11da40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f852800b480 tx=0x7f852800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.791+0000 7f85227fc700 1 -- 172.21.15.154:0/3667815183 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528011830 con 0x7f852c1300a0 2023-09-30T22:24:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.791+0000 7f85227fc700 1 -- 172.21.15.154:0/3667815183 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528011990 con 0x7f852c1300a0 2023-09-30T22:24:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.791+0000 7f8534083700 1 -- 172.21.15.154:0/3667815183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c12dd00 con 0x7f852c1300a0 2023-09-30T22:24:13.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.791+0000 7f8534083700 1 -- 172.21.15.154:0/3667815183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c11ec10 con 0x7f852c1300a0 2023-09-30T22:24:13.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.791+0000 7f85227fc700 1 -- 172.21.15.154:0/3667815183 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528011d40 con 0x7f852c1300a0 2023-09-30T22:24:13.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.792+0000 7f85227fc700 1 -- 172.21.15.154:0/3667815183 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f852801a400 con 0x7f852c1300a0 2023-09-30T22:24:13.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.792+0000 7f8534083700 1 -- 172.21.15.154:0/3667815183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85140052e0 con 0x7f852c1300a0 2023-09-30T22:24:13.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.792+0000 7f85227fc700 1 -- 172.21.15.154:0/3667815183 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f852803f670 con 0x7f852c1300a0 2023-09-30T22:24:13.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.801+0000 7f85227fc700 1 -- 172.21.15.154:0/3667815183 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f852800f4c0 con 0x7f852c1300a0 2023-09-30T22:24:13.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.854+0000 7fe6e5973700 1 Processor -- start 2023-09-30T22:24:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.854+0000 7fe6e5973700 1 -- start start 2023-09-30T22:24:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.854+0000 7fe6e5973700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e009d860 0x7fe6e009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.854+0000 7fe6e5973700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009e170 0x7fe6e01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.854+0000 7fe6e5973700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe6e0130ce0 0x7fe6e0131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.854+0000 7fe6e5973700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e009aaa0 con 0x7fe6e0130ce0 2023-09-30T22:24:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.854+0000 7fe6e5973700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e009f870 con 0x7fe6e009d860 2023-09-30T22:24:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.854+0000 7fe6e5973700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e009b360 con 0x7fe6e009e170 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6de7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009e170 0x7fe6e01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6df7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe6e0130ce0 0x7fe6e0131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6de7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009e170 0x7fe6e01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55754/0 (socket says 172.21.15.154:55754) 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6de7fc700 1 -- 172.21.15.154:0/1630488138 learned_addr learned my addr 172.21.15.154:0/1630488138 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6deffd700 1 --2- 172.21.15.154:0/1630488138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e009d860 0x7fe6e009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6de7fc700 1 -- 172.21.15.154:0/1630488138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e009d860 msgr2=0x7fe6e009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6de7fc700 1 --2- 172.21.15.154:0/1630488138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e009d860 0x7fe6e009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6de7fc700 1 -- 172.21.15.154:0/1630488138 >> v2:172.21.15.154:3300/0 conn(0x7fe6e0130ce0 msgr2=0x7fe6e0131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6de7fc700 1 --2- 172.21.15.154:0/1630488138 >> v2:172.21.15.154:3300/0 conn(0x7fe6e0130ce0 0x7fe6e0131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6de7fc700 1 -- 172.21.15.154:0/1630488138 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e009b620 con 0x7fe6e009e170 2023-09-30T22:24:13.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6df7fe700 1 --2- 172.21.15.154:0/1630488138 >> v2:172.21.15.154:3300/0 conn(0x7fe6e0130ce0 0x7fe6e0131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:13.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6de7fc700 1 --2- 172.21.15.154:0/1630488138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009e170 0x7fe6e01307a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400bb90 tx=0x7fe6d400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd403cd713b6ac1c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6ddffb700 1 -- 172.21.15.154:0/1630488138 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400dc70 con 0x7fe6e009e170 2023-09-30T22:24:13.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6ddffb700 1 -- 172.21.15.154:0/1630488138 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d400ddd0 con 0x7fe6e009e170 2023-09-30T22:24:13.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.855+0000 7fe6ddffb700 1 -- 172.21.15.154:0/1630488138 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4012990 con 0x7fe6e009e170 2023-09-30T22:24:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.856+0000 7fe6e5973700 1 -- 172.21.15.154:0/1630488138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009e170 msgr2=0x7fe6e01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.856+0000 7fe6e5973700 1 --2- 172.21.15.154:0/1630488138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009e170 0x7fe6e01307a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400bb90 tx=0x7fe6d400bea0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.856+0000 7fe6e5973700 1 -- 172.21.15.154:0/1630488138 shutdown_connections 2023-09-30T22:24:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.856+0000 7fe6e5973700 1 --2- 172.21.15.154:0/1630488138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e009d860 0x7fe6e009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.856+0000 7fe6e5973700 1 --2- 172.21.15.154:0/1630488138 >> v2:172.21.15.154:3300/0 conn(0x7fe6e0130ce0 0x7fe6e0131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.856+0000 7fe6e5973700 1 --2- 172.21.15.154:0/1630488138 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009e170 0x7fe6e01307a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.856+0000 7fe6e5973700 1 -- 172.21.15.154:0/1630488138 >> 172.21.15.154:0/1630488138 conn(0x7fe6e0099c40 msgr2=0x7fe6e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.857+0000 7fe6e5973700 1 -- 172.21.15.154:0/1630488138 shutdown_connections 2023-09-30T22:24:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.857+0000 7fe6e5973700 1 -- 172.21.15.154:0/1630488138 wait complete. 2023-09-30T22:24:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.858+0000 7fe6e5973700 1 Processor -- start 2023-09-30T22:24:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.858+0000 7fe6e5973700 1 -- start start 2023-09-30T22:24:13.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6e5973700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009d860 0x7fe6e011d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6e5973700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e009e170 0x7fe6e011d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6e5973700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e0130ce0 0x7fe6e011daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6e5973700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e011e520 con 0x7fe6e009e170 2023-09-30T22:24:13.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6e5973700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e011ec80 con 0x7fe6e0130ce0 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6e5973700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e011f2a0 con 0x7fe6e009d860 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6deffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009d860 0x7fe6e011d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6deffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009d860 0x7fe6e011d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55756/0 (socket says 172.21.15.154:55756) 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6deffd700 1 -- 172.21.15.154:0/3300706543 learned_addr learned my addr 172.21.15.154:0/3300706543 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6df7fe700 1 --2- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e0130ce0 0x7fe6e011daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6de7fc700 1 --2- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e009e170 0x7fe6e011d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6deffd700 1 -- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e0130ce0 msgr2=0x7fe6e011daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6deffd700 1 --2- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e0130ce0 0x7fe6e011daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6deffd700 1 -- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e009e170 msgr2=0x7fe6e011d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6deffd700 1 --2- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e009e170 0x7fe6e011d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.859+0000 7fe6deffd700 1 -- 172.21.15.154:0/3300706543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8009a70 con 0x7fe6e009d860 2023-09-30T22:24:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.860+0000 7fe6deffd700 1 --2- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009d860 0x7fe6e011d070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000e930 tx=0x7fe6d000ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.860+0000 7fe6c7fff700 1 -- 172.21.15.154:0/3300706543 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000c640 con 0x7fe6e009d860 2023-09-30T22:24:13.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.860+0000 7fe6c7fff700 1 -- 172.21.15.154:0/3300706543 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d000c7a0 con 0x7fe6e009d860 2023-09-30T22:24:13.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.860+0000 7fe6e5973700 1 -- 172.21.15.154:0/3300706543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d400b7f0 con 0x7fe6e009d860 2023-09-30T22:24:13.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.860+0000 7fe6c7fff700 1 -- 172.21.15.154:0/3300706543 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000cb30 con 0x7fe6e009d860 2023-09-30T22:24:13.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.860+0000 7fe6e5973700 1 -- 172.21.15.154:0/3300706543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e00a22b0 con 0x7fe6e009d860 2023-09-30T22:24:13.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.861+0000 7fe6c7fff700 1 -- 172.21.15.154:0/3300706543 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6d000cc90 con 0x7fe6e009d860 2023-09-30T22:24:13.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.861+0000 7fe6c7fff700 1 -- 172.21.15.154:0/3300706543 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe6d003f7a0 con 0x7fe6e009d860 2023-09-30T22:24:13.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.863+0000 7fe6e5973700 1 -- 172.21.15.154:0/3300706543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e009c8b0 con 0x7fe6e009d860 2023-09-30T22:24:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.871+0000 7fe6c7fff700 1 -- 172.21.15.154:0/3300706543 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6d0021080 con 0x7fe6e009d860 2023-09-30T22:24:13.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.889+0000 7f84052ec700 1 Processor -- start 2023-09-30T22:24:13.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.889+0000 7f84052ec700 1 -- start start 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f84052ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f840006a770 0x7f84001349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f84052ec700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8400134f00 0x7f840009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f84052ec700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840009eca0 con 0x7f840009dea0 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f84052ec700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840009f720 con 0x7f8400134f00 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f84052ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840006b480 con 0x7f840006a770 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83fe7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8400134f00 0x7f840009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83ff7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f840009dea0 0x7f840013ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55912/0 (socket says 172.21.15.154:55912) 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83fe7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8400134f00 0x7f840009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34276/0 (socket says 172.21.15.154:34276) 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83ff7fe700 1 -- 172.21.15.154:0/508609096 learned_addr learned my addr 172.21.15.154:0/508609096 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:13.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83feffd700 1 --2- 172.21.15.154:0/508609096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f840006a770 0x7f84001349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83feffd700 1 -- 172.21.15.154:0/508609096 >> v2:172.21.15.154:3300/0 conn(0x7f8400134f00 msgr2=0x7f840009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83feffd700 1 --2- 172.21.15.154:0/508609096 >> v2:172.21.15.154:3300/0 conn(0x7f8400134f00 0x7f840009d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83feffd700 1 -- 172.21.15.154:0/508609096 >> v1:172.21.15.154:6789/0 conn(0x7f840009dea0 legacy=0x7f840013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83feffd700 1 -- 172.21.15.154:0/508609096 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84001352d0 con 0x7f840006a770 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.890+0000 7f83feffd700 1 --2- 172.21.15.154:0/508609096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f840006a770 0x7f84001349c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009840 tx=0x7f83f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d30d219239fd14d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f83fdffb700 1 -- 172.21.15.154:0/508609096 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0011830 con 0x7f840006a770 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f83fdffb700 1 -- 172.21.15.154:0/508609096 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0011990 con 0x7f840006a770 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f83fdffb700 1 -- 172.21.15.154:0/508609096 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0011d20 con 0x7f840006a770 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f84052ec700 1 -- 172.21.15.154:0/508609096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f840006a770 msgr2=0x7f84001349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f84052ec700 1 --2- 172.21.15.154:0/508609096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f840006a770 0x7f84001349c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009840 tx=0x7f83f0009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f84052ec700 1 -- 172.21.15.154:0/508609096 shutdown_connections 2023-09-30T22:24:13.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f84052ec700 1 --2- 172.21.15.154:0/508609096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f840006a770 0x7f84001349c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f84052ec700 1 --2- 172.21.15.154:0/508609096 >> v2:172.21.15.154:3300/0 conn(0x7f8400134f00 0x7f840009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f84052ec700 1 -- 172.21.15.154:0/508609096 >> 172.21.15.154:0/508609096 conn(0x7f8400099c40 msgr2=0x7f84000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.891+0000 7f84052ec700 1 -- 172.21.15.154:0/508609096 shutdown_connections 2023-09-30T22:24:13.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.892+0000 7f84052ec700 1 -- 172.21.15.154:0/508609096 wait complete. 2023-09-30T22:24:13.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f84052ec700 1 Processor -- start 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f84052ec700 1 -- start start 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f84052ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f840006a770 0x7f8400133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f84052ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f840009dea0 0x7f8400135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f84052ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8400134f00 0x7f8400135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f83feffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f840006a770 0x7f8400133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f84052ec700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8400138f30 con 0x7f840006a770 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f83feffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f840006a770 0x7f8400133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34286/0 (socket says 172.21.15.154:34286) 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f83feffd700 1 -- 172.21.15.154:0/3588334356 learned_addr learned my addr 172.21.15.154:0/3588334356 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8400139110 con 0x7f8400134f00 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f840009f220 con 0x7f840009dea0 2023-09-30T22:24:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.893+0000 7f83ff7fe700 1 --2- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8400134f00 0x7f8400135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83feffd700 1 -- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f840009dea0 msgr2=0x7f8400135850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83feffd700 1 --2- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f840009dea0 0x7f8400135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83feffd700 1 -- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8400134f00 msgr2=0x7f8400135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83feffd700 1 --2- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8400134f00 0x7f8400135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83feffd700 1 -- 172.21.15.154:0/3588334356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f00094a0 con 0x7f840006a770 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83ff7fe700 1 --2- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8400134f00 0x7f8400135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83feffd700 1 --2- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f840006a770 0x7f8400133d30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f83f00090b0 tx=0x7f83f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83e77fe700 1 -- 172.21.15.154:0/3588334356 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00036a0 con 0x7f840006a770 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83e77fe700 1 -- 172.21.15.154:0/3588334356 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f001e070 con 0x7f840006a770 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84000a01f0 con 0x7f840006a770 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f83e77fe700 1 -- 172.21.15.154:0/3588334356 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0003a60 con 0x7f840006a770 2023-09-30T22:24:13.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.894+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84001371e0 con 0x7f840006a770 2023-09-30T22:24:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.895+0000 7f83e77fe700 1 -- 172.21.15.154:0/3588334356 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83f0003bc0 con 0x7f840006a770 2023-09-30T22:24:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.895+0000 7f83e77fe700 1 -- 172.21.15.154:0/3588334356 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83f0020070 con 0x7f840006a770 2023-09-30T22:24:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.895+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8400138d50 con 0x7f840006a770 2023-09-30T22:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.897+0000 7f9016427700 1 Processor -- start 2023-09-30T22:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.897+0000 7f9016427700 1 -- start start 2023-09-30T22:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.897+0000 7f9016427700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90100a0a30 0x7f90100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.897+0000 7f9016427700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100a1340 0x7f901012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f9016427700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90100a1e70 con 0x7f90101304a0 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f9016427700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901009a720 con 0x7f90100a0a30 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f9016427700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901009b300 con 0x7f90100a1340 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f90149c4700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f90101304a0 0x7f90101371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55914/0 (socket says 172.21.15.154:55914) 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100a1340 0x7f901012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f90149c4700 1 -- 172.21.15.154:0/1075218274 learned_addr learned my addr 172.21.15.154:0/1075218274 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900ffff700 1 --2- 172.21.15.154:0/1075218274 >> v2:172.21.15.154:3300/0 conn(0x7f90100a0a30 0x7f90100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900f7fe700 1 -- 172.21.15.154:0/1075218274 >> v2:172.21.15.154:3300/0 conn(0x7f90100a0a30 msgr2=0x7f90100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900f7fe700 1 --2- 172.21.15.154:0/1075218274 >> v2:172.21.15.154:3300/0 conn(0x7f90100a0a30 0x7f90100a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900f7fe700 1 -- 172.21.15.154:0/1075218274 >> v1:172.21.15.154:6789/0 conn(0x7f90101304a0 legacy=0x7f90101371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900f7fe700 1 -- 172.21.15.154:0/1075218274 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901009abc0 con 0x7f90100a1340 2023-09-30T22:24:13.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900f7fe700 1 --2- 172.21.15.154:0/1075218274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100a1340 0x7f901012ff60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9004009840 tx=0x7f9004009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7648bf6feaff67f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900effd700 1 -- 172.21.15.154:0/1075218274 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900400c880 con 0x7f90100a1340 2023-09-30T22:24:13.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900effd700 1 -- 172.21.15.154:0/1075218274 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900400c9e0 con 0x7f90100a1340 2023-09-30T22:24:13.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.898+0000 7f900effd700 1 -- 172.21.15.154:0/1075218274 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900400cd70 con 0x7f90100a1340 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.899+0000 7f9016427700 1 -- 172.21.15.154:0/1075218274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100a1340 msgr2=0x7f901012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.899+0000 7f9016427700 1 --2- 172.21.15.154:0/1075218274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100a1340 0x7f901012ff60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9004009840 tx=0x7f9004009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.899+0000 7f9016427700 1 -- 172.21.15.154:0/1075218274 shutdown_connections 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.899+0000 7f9016427700 1 --2- 172.21.15.154:0/1075218274 >> v2:172.21.15.154:3300/0 conn(0x7f90100a0a30 0x7f90100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.899+0000 7f9016427700 1 --2- 172.21.15.154:0/1075218274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100a1340 0x7f901012ff60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.899+0000 7f9016427700 1 -- 172.21.15.154:0/1075218274 >> 172.21.15.154:0/1075218274 conn(0x7f90100a2980 msgr2=0x7f90100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.899+0000 7f9016427700 1 -- 172.21.15.154:0/1075218274 shutdown_connections 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.899+0000 7f9016427700 1 -- 172.21.15.154:0/1075218274 wait complete. 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.900+0000 7f9016427700 1 Processor -- start 2023-09-30T22:24:13.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f9016427700 1 -- start start 2023-09-30T22:24:13.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f83e77fe700 1 -- 172.21.15.154:0/3588334356 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83f002a020 con 0x7f840006a770 2023-09-30T22:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f9016427700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90100a0a30 0x7f901011db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f9016427700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100a1340 0x7f901011e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f9016427700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90101304a0 0x7f90101c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f9016427700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9010120ae0 con 0x7f90100a1340 2023-09-30T22:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f9016427700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9010120cc0 con 0x7f90101304a0 2023-09-30T22:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f9016427700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f901012fb10 con 0x7f90100a0a30 2023-09-30T22:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f900ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90100a0a30 0x7f901011db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f900ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90100a0a30 0x7f901011db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55770/0 (socket says 172.21.15.154:55770) 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.901+0000 7f900ffff700 1 -- 172.21.15.154:0/2981797287 learned_addr learned my addr 172.21.15.154:0/2981797287 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f90149c4700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90101304a0 0x7f90101c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900ffff700 1 -- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90101304a0 msgr2=0x7f90101c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900f7fe700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100a1340 0x7f901011e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900ffff700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90101304a0 0x7f90101c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900ffff700 1 -- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100a1340 msgr2=0x7f901011e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900ffff700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100a1340 0x7f901011e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900ffff700 1 -- 172.21.15.154:0/2981797287 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90040094a0 con 0x7f90100a0a30 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900f7fe700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100a1340 0x7f901011e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900ffff700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90100a0a30 0x7f901011db70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f900000e9c0 tx=0x7f900000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:13.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900cff9700 1 -- 172.21.15.154:0/2981797287 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90000096f0 con 0x7f90100a0a30 2023-09-30T22:24:13.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900cff9700 1 -- 172.21.15.154:0/2981797287 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900000c850 con 0x7f90100a0a30 2023-09-30T22:24:13.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.902+0000 7f900cff9700 1 -- 172.21.15.154:0/2981797287 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000cbc0 con 0x7f90100a0a30 2023-09-30T22:24:13.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.903+0000 7f9016427700 1 -- 172.21.15.154:0/2981797287 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901011d660 con 0x7f90100a0a30 2023-09-30T22:24:13.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.903+0000 7f9016427700 1 -- 172.21.15.154:0/2981797287 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901009ae00 con 0x7f90100a0a30 2023-09-30T22:24:13.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.904+0000 7f9016427700 1 -- 172.21.15.154:0/2981797287 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901011fd00 con 0x7f90100a0a30 2023-09-30T22:24:13.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.905+0000 7f900cff9700 1 -- 172.21.15.154:0/2981797287 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f900000cd20 con 0x7f90100a0a30 2023-09-30T22:24:13.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.905+0000 7f900cff9700 1 -- 172.21.15.154:0/2981797287 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f900003fc20 con 0x7f90100a0a30 2023-09-30T22:24:13.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:13.914+0000 7f900cff9700 1 -- 172.21.15.154:0/2981797287 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f900001b3b0 con 0x7f90100a0a30 2023-09-30T22:24:14.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.027+0000 7f8534083700 1 -- 172.21.15.154:0/3667815183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8514005150 con 0x7f852c1300a0 2023-09-30T22:24:14.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.027+0000 7f85227fc700 1 -- 172.21.15.154:0/3667815183 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8528009280 con 0x7f852c1300a0 2023-09-30T22:24:14.027 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:14.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.030+0000 7f8534083700 1 -- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 msgr2=0x7f852c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.030+0000 7f8534083700 1 --2- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 0x7f852c11da40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f852800b480 tx=0x7f852800b790 comp rx=0 tx=0).stop 2023-09-30T22:24:14.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.030+0000 7f8534083700 1 -- 172.21.15.154:0/3667815183 shutdown_connections 2023-09-30T22:24:14.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.030+0000 7f8534083700 1 --2- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f852c133ad0 0x7f852c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.030+0000 7f8534083700 1 --2- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f852c1300a0 0x7f852c11da40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.030+0000 7f8534083700 1 --2- 172.21.15.154:0/3667815183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f852c1309f0 0x7f852c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.030+0000 7f8534083700 1 -- 172.21.15.154:0/3667815183 >> 172.21.15.154:0/3667815183 conn(0x7f852c099c40 msgr2=0x7f852c12e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.030+0000 7f8534083700 1 -- 172.21.15.154:0/3667815183 shutdown_connections 2023-09-30T22:24:14.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.030+0000 7f8534083700 1 -- 172.21.15.154:0/3667815183 wait complete. 2023-09-30T22:24:14.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.068+0000 7fe6e5973700 1 -- 172.21.15.154:0/3300706543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe6e004f2a0 con 0x7fe6e009d860 2023-09-30T22:24:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.068+0000 7fe6c7fff700 1 -- 172.21.15.154:0/3300706543 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe6d00232f0 con 0x7fe6e009d860 2023-09-30T22:24:14.068 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.071+0000 7fe6e5973700 1 -- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009d860 msgr2=0x7fe6e011d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.071+0000 7fe6e5973700 1 --2- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009d860 0x7fe6e011d070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000e930 tx=0x7fe6d000ec40 comp rx=0 tx=0).stop 2023-09-30T22:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.071+0000 7fe6e5973700 1 -- 172.21.15.154:0/3300706543 shutdown_connections 2023-09-30T22:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.071+0000 7fe6e5973700 1 --2- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e0130ce0 0x7fe6e011daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.071+0000 7fe6e5973700 1 --2- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e009d860 0x7fe6e011d070 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.071+0000 7fe6e5973700 1 --2- 172.21.15.154:0/3300706543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e009e170 0x7fe6e011d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.071+0000 7fe6e5973700 1 -- 172.21.15.154:0/3300706543 >> 172.21.15.154:0/3300706543 conn(0x7fe6e0099c40 msgr2=0x7fe6e0130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.071+0000 7fe6e5973700 1 -- 172.21.15.154:0/3300706543 shutdown_connections 2023-09-30T22:24:14.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.071+0000 7fe6e5973700 1 -- 172.21.15.154:0/3300706543 wait complete. 2023-09-30T22:24:14.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:14.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.101+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f840004f2a0 con 0x7f840006a770 2023-09-30T22:24:14.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.101+0000 7f83e77fe700 1 -- 172.21.15.154:0/3588334356 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83f0033090 con 0x7f840006a770 2023-09-30T22:24:14.101 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:14.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.103+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f840006a770 msgr2=0x7f8400133d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.103+0000 7f84052ec700 1 --2- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f840006a770 0x7f8400133d30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f83f00090b0 tx=0x7f83f0004750 comp rx=0 tx=0).stop 2023-09-30T22:24:14.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.103+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 shutdown_connections 2023-09-30T22:24:14.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.103+0000 7f84052ec700 1 --2- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8400134f00 0x7f8400135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.103+0000 7f84052ec700 1 --2- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f840006a770 0x7f8400133d30 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.103+0000 7f84052ec700 1 --2- 172.21.15.154:0/3588334356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f840009dea0 0x7f8400135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.103+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 >> 172.21.15.154:0/3588334356 conn(0x7f8400099c40 msgr2=0x7f840009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.103+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 shutdown_connections 2023-09-30T22:24:14.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.103+0000 7f84052ec700 1 -- 172.21.15.154:0/3588334356 wait complete. 2023-09-30T22:24:14.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:14.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.127+0000 7f9016427700 1 -- 172.21.15.154:0/2981797287 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f901004f2a0 con 0x7f90100a0a30 2023-09-30T22:24:14.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.128+0000 7f900cff9700 1 -- 172.21.15.154:0/2981797287 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9000017030 con 0x7f90100a0a30 2023-09-30T22:24:14.128 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:14.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.130+0000 7f9016427700 1 -- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90100a0a30 msgr2=0x7f901011db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:14.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.130+0000 7f9016427700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90100a0a30 0x7f901011db70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f900000e9c0 tx=0x7f900000ecd0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.130+0000 7f9016427700 1 -- 172.21.15.154:0/2981797287 shutdown_connections 2023-09-30T22:24:14.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.130+0000 7f9016427700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90101304a0 0x7f90101c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.130+0000 7f9016427700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90100a0a30 0x7f901011db70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.130+0000 7f9016427700 1 --2- 172.21.15.154:0/2981797287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100a1340 0x7f901011e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:14.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.130+0000 7f9016427700 1 -- 172.21.15.154:0/2981797287 >> 172.21.15.154:0/2981797287 conn(0x7f90100a2980 msgr2=0x7f90101b79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.130+0000 7f9016427700 1 -- 172.21.15.154:0/2981797287 shutdown_connections 2023-09-30T22:24:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:14.130+0000 7f9016427700 1 -- 172.21.15.154:0/2981797287 wait complete. 2023-09-30T22:24:14.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:15.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:15.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:15.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:15.142 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.194+0000 7fb2e6bd0700 1 Processor -- start 2023-09-30T22:24:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.194+0000 7fb2e6bd0700 1 -- start start 2023-09-30T22:24:15.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.194+0000 7fb2e6bd0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2e0066410 0x7fb2e01319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.194+0000 7fb2e6bd0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e01314b0 0x7fb2e0131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.194+0000 7fb2e6bd0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2e009bc70 0x7fb2e009c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e6bd0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e00667e0 con 0x7fb2e009bc70 2023-09-30T22:24:15.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e6bd0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00a23c0 con 0x7fb2e01314b0 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e6bd0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00a0f20 con 0x7fb2e0066410 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2dffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e01314b0 0x7fb2e0131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2dffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e01314b0 0x7fb2e0131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43916/0 (socket says 172.21.15.154:43916) 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e496c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2e0066410 0x7fb2e01319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2dffff700 1 -- 172.21.15.154:0/299531465 learned_addr learned my addr 172.21.15.154:0/299531465 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e516d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2e009bc70 0x7fb2e009c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e516d700 1 -- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2e0066410 msgr2=0x7fb2e01319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e516d700 1 --2- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2e0066410 0x7fb2e01319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e516d700 1 -- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e01314b0 msgr2=0x7fb2e0131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e516d700 1 --2- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e01314b0 0x7fb2e0131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e516d700 1 -- 172.21.15.154:0/299531465 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00a16e0 con 0x7fb2e009bc70 2023-09-30T22:24:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2dffff700 1 --2- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e01314b0 0x7fb2e0131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2e516d700 1 --2- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 0x7fb2e009c0f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009e20 tx=0x7fb2d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc81c9226774a09e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.195+0000 7fb2df7fe700 1 -- 172.21.15.154:0/299531465 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800e070 con 0x7fb2e009bc70 2023-09-30T22:24:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.196+0000 7fb2df7fe700 1 -- 172.21.15.154:0/299531465 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d800baa0 con 0x7fb2e009bc70 2023-09-30T22:24:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.196+0000 7fb2df7fe700 1 -- 172.21.15.154:0/299531465 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800be50 con 0x7fb2e009bc70 2023-09-30T22:24:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.197+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 msgr2=0x7fb2e009c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.197+0000 7fb2e6bd0700 1 --2- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 0x7fb2e009c0f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009e20 tx=0x7fb2d800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.197+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/299531465 shutdown_connections 2023-09-30T22:24:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.197+0000 7fb2e6bd0700 1 --2- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 0x7fb2e009c0f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.197+0000 7fb2e6bd0700 1 --2- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2e0066410 0x7fb2e01319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.197+0000 7fb2e6bd0700 1 --2- 172.21.15.154:0/299531465 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e01314b0 0x7fb2e0131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.197+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/299531465 >> 172.21.15.154:0/299531465 conn(0x7fb2e00a2980 msgr2=0x7fb2e00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.197+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/299531465 shutdown_connections 2023-09-30T22:24:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.197+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/299531465 wait complete. 2023-09-30T22:24:15.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.198+0000 7fb2e6bd0700 1 Processor -- start 2023-09-30T22:24:15.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.198+0000 7fb2e6bd0700 1 -- start start 2023-09-30T22:24:15.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2e6bd0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e0066410 0x7fb2e0133050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2e6bd0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 0x7fb2e0133590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2e6bd0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2e01314b0 0x7fb2e0133ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2e6bd0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e01344b0 con 0x7fb2e009bc70 2023-09-30T22:24:15.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2e6bd0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0130b40 con 0x7fb2e0066410 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2e6bd0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00a1d50 con 0x7fb2e01314b0 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2e496c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e0066410 0x7fb2e0133050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2e496c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e0066410 0x7fb2e0133050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43928/0 (socket says 172.21.15.154:43928) 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2e496c700 1 -- 172.21.15.154:0/3356134906 learned_addr learned my addr 172.21.15.154:0/3356134906 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.199+0000 7fb2dffff700 1 --2- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 0x7fb2e0133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2e496c700 1 -- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2e01314b0 msgr2=0x7fb2e0133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2e496c700 1 --2- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2e01314b0 0x7fb2e0133ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2e496c700 1 -- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 msgr2=0x7fb2e0133590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2e496c700 1 --2- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 0x7fb2e0133590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2e496c700 1 -- 172.21.15.154:0/3356134906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc009550 con 0x7fb2e0066410 2023-09-30T22:24:15.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2dffff700 1 --2- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 0x7fb2e0133590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:15.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2e496c700 1 --2- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e0066410 0x7fb2e0133050 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400e990 tx=0x7fb2d400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2dd7fa700 1 -- 172.21.15.154:0/3356134906 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40096f0 con 0x7fb2e0066410 2023-09-30T22:24:15.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/3356134906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d8009a70 con 0x7fb2e0066410 2023-09-30T22:24:15.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2dd7fa700 1 -- 172.21.15.154:0/3356134906 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d400c850 con 0x7fb2e0066410 2023-09-30T22:24:15.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2dd7fa700 1 -- 172.21.15.154:0/3356134906 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400eee0 con 0x7fb2e0066410 2023-09-30T22:24:15.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.200+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/3356134906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e01367b0 con 0x7fb2e0066410 2023-09-30T22:24:15.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.201+0000 7fb2dd7fa700 1 -- 172.21.15.154:0/3356134906 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2d400cbc0 con 0x7fb2e0066410 2023-09-30T22:24:15.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.201+0000 7fb2dd7fa700 1 -- 172.21.15.154:0/3356134906 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2d401a360 con 0x7fb2e0066410 2023-09-30T22:24:15.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.201+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/3356134906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e004f2a0 con 0x7fb2e0066410 2023-09-30T22:24:15.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.206+0000 7fb2dd7fa700 1 -- 172.21.15.154:0/3356134906 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2d4017020 con 0x7fb2e0066410 2023-09-30T22:24:15.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.227+0000 7f988408a700 1 Processor -- start 2023-09-30T22:24:15.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f988408a700 1 -- start start 2023-09-30T22:24:15.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f988408a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c09d860 0x7f987c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f988408a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09e170 0x7f987c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f988408a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987c09aaa0 con 0x7f987c130ce0 2023-09-30T22:24:15.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f988408a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c09f870 con 0x7f987c09e170 2023-09-30T22:24:15.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f988408a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f987c09b360 con 0x7f987c09d860 2023-09-30T22:24:15.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f9881e26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c09d860 0x7f987c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f9881e26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c09d860 0x7f987c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55800/0 (socket says 172.21.15.154:55800) 2023-09-30T22:24:15.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f9881e26700 1 -- 172.21.15.154:0/2404156093 learned_addr learned my addr 172.21.15.154:0/2404156093 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:15.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.228+0000 7f9881625700 1 --2- 172.21.15.154:0/2404156093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09e170 0x7f987c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.229+0000 7f9881e26700 1 -- 172.21.15.154:0/2404156093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09e170 msgr2=0x7f987c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.229+0000 7f9881e26700 1 --2- 172.21.15.154:0/2404156093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09e170 0x7f987c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.229+0000 7f9881e26700 1 -- 172.21.15.154:0/2404156093 >> v1:172.21.15.154:6789/0 conn(0x7f987c130ce0 legacy=0x7f987c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.229+0000 7f9881e26700 1 -- 172.21.15.154:0/2404156093 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c09b620 con 0x7f987c09d860 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.229+0000 7f9881e26700 1 --2- 172.21.15.154:0/2404156093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c09d860 0x7f987c09dc30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f987800bbc0 tx=0x7f987800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be251098ee37e775 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.229+0000 7f9880e24700 1 -- 172.21.15.154:0/2404156093 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987800dd90 con 0x7f987c09d860 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.229+0000 7f9880e24700 1 -- 172.21.15.154:0/2404156093 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9878010470 con 0x7f987c09d860 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.229+0000 7f9880e24700 1 -- 172.21.15.154:0/2404156093 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878010800 con 0x7f987c09d860 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.230+0000 7f988408a700 1 -- 172.21.15.154:0/2404156093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c09d860 msgr2=0x7f987c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.230+0000 7f988408a700 1 --2- 172.21.15.154:0/2404156093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c09d860 0x7f987c09dc30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f987800bbc0 tx=0x7f987800bed0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.230+0000 7f988408a700 1 -- 172.21.15.154:0/2404156093 shutdown_connections 2023-09-30T22:24:15.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.230+0000 7f988408a700 1 --2- 172.21.15.154:0/2404156093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c09d860 0x7f987c09dc30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.230+0000 7f988408a700 1 --2- 172.21.15.154:0/2404156093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09e170 0x7f987c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.230+0000 7f988408a700 1 -- 172.21.15.154:0/2404156093 >> 172.21.15.154:0/2404156093 conn(0x7f987c099c40 msgr2=0x7f987c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.230+0000 7f988408a700 1 -- 172.21.15.154:0/2404156093 shutdown_connections 2023-09-30T22:24:15.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.230+0000 7f988408a700 1 -- 172.21.15.154:0/2404156093 wait complete. 2023-09-30T22:24:15.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.231+0000 7f988408a700 1 Processor -- start 2023-09-30T22:24:15.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.231+0000 7f988408a700 1 -- start start 2023-09-30T22:24:15.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.231+0000 7f988408a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09d860 0x7f987c123430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.231+0000 7f988408a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c09e170 0x7f987c123970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.231+0000 7f988408a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c130ce0 0x7f987c1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.231+0000 7f988408a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c126420 con 0x7f987c09e170 2023-09-30T22:24:15.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.231+0000 7f988408a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c1255e0 con 0x7f987c09d860 2023-09-30T22:24:15.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.231+0000 7f988408a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f987c126600 con 0x7f987c130ce0 2023-09-30T22:24:15.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881625700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c09e170 0x7f987c123970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881625700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c09e170 0x7f987c123970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34336/0 (socket says 172.21.15.154:34336) 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881625700 1 -- 172.21.15.154:0/1249915665 learned_addr learned my addr 172.21.15.154:0/1249915665 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9882627700 1 --2- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c130ce0 0x7f987c1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881e26700 1 --2- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09d860 0x7f987c123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881625700 1 -- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c130ce0 msgr2=0x7f987c1c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881625700 1 --2- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c130ce0 0x7f987c1c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881625700 1 -- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09d860 msgr2=0x7f987c123430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881625700 1 --2- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09d860 0x7f987c123430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881625700 1 -- 172.21.15.154:0/1249915665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987800b7f0 con 0x7f987c09e170 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f9881625700 1 --2- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c09e170 0x7f987c123970 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f986c00e810 tx=0x7f986c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f98727fc700 1 -- 172.21.15.154:0/1249915665 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c013610 con 0x7f987c09e170 2023-09-30T22:24:15.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f98727fc700 1 -- 172.21.15.154:0/1249915665 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c013770 con 0x7f987c09e170 2023-09-30T22:24:15.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f988408a700 1 -- 172.21.15.154:0/1249915665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c0a22f0 con 0x7f987c09e170 2023-09-30T22:24:15.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f98727fc700 1 -- 172.21.15.154:0/1249915665 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c013ae0 con 0x7f987c09e170 2023-09-30T22:24:15.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.232+0000 7f988408a700 1 -- 172.21.15.154:0/1249915665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c123030 con 0x7f987c09e170 2023-09-30T22:24:15.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.233+0000 7f98727fc700 1 -- 172.21.15.154:0/1249915665 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f986c013c40 con 0x7f987c09e170 2023-09-30T22:24:15.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.233+0000 7f98727fc700 1 -- 172.21.15.154:0/1249915665 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f986c03f410 con 0x7f987c09e170 2023-09-30T22:24:15.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.234+0000 7f988408a700 1 -- 172.21.15.154:0/1249915665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c125fc0 con 0x7f987c09e170 2023-09-30T22:24:15.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.243+0000 7f98727fc700 1 -- 172.21.15.154:0/1249915665 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f986c012370 con 0x7f987c09e170 2023-09-30T22:24:15.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.264+0000 7f8d3de0a700 1 Processor -- start 2023-09-30T22:24:15.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.264+0000 7f8d3de0a700 1 -- start start 2023-09-30T22:24:15.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d3de0a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d38133a70 0x7f8d38133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d3de0a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d380a08e0 0x7f8d380a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d3de0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a1290 0x7f8d3813a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d3de0a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d38133640 con 0x7f8d38133a70 2023-09-30T22:24:15.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d3de0a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380a1d50 con 0x7f8d380a1290 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d3de0a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380a1710 con 0x7f8d380a08e0 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d37fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a1290 0x7f8d3813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d37fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a1290 0x7f8d3813a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43962/0 (socket says 172.21.15.154:43962) 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d37fff700 1 -- 172.21.15.154:0/1069600985 learned_addr learned my addr 172.21.15.154:0/1069600985 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d36ffd700 1 --2- 172.21.15.154:0/1069600985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d380a08e0 0x7f8d380a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d377fe700 1 --2- 172.21.15.154:0/1069600985 >> v2:172.21.15.154:3300/0 conn(0x7f8d38133a70 0x7f8d38133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d37fff700 1 -- 172.21.15.154:0/1069600985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d380a08e0 msgr2=0x7f8d380a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d37fff700 1 --2- 172.21.15.154:0/1069600985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d380a08e0 0x7f8d380a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d37fff700 1 -- 172.21.15.154:0/1069600985 >> v2:172.21.15.154:3300/0 conn(0x7f8d38133a70 msgr2=0x7f8d38133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d37fff700 1 --2- 172.21.15.154:0/1069600985 >> v2:172.21.15.154:3300/0 conn(0x7f8d38133a70 0x7f8d38133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d37fff700 1 -- 172.21.15.154:0/1069600985 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3809b620 con 0x7f8d380a1290 2023-09-30T22:24:15.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.265+0000 7f8d37fff700 1 --2- 172.21.15.154:0/1069600985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a1290 0x7f8d3813a970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009e50 tx=0x7f8d3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8efbe28839bd7185 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.266+0000 7f8d367fc700 1 -- 172.21.15.154:0/1069600985 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000e070 con 0x7f8d380a1290 2023-09-30T22:24:15.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.266+0000 7f8d367fc700 1 -- 172.21.15.154:0/1069600985 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3000b910 con 0x7f8d380a1290 2023-09-30T22:24:15.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.266+0000 7f8d367fc700 1 -- 172.21.15.154:0/1069600985 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000bcc0 con 0x7f8d380a1290 2023-09-30T22:24:15.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.266+0000 7f8d3de0a700 1 -- 172.21.15.154:0/1069600985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a1290 msgr2=0x7f8d3813a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.266+0000 7f8d3de0a700 1 --2- 172.21.15.154:0/1069600985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a1290 0x7f8d3813a970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009e50 tx=0x7f8d3000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:15.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.267+0000 7f8d3de0a700 1 -- 172.21.15.154:0/1069600985 shutdown_connections 2023-09-30T22:24:15.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.267+0000 7f8d3de0a700 1 --2- 172.21.15.154:0/1069600985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a1290 0x7f8d3813a970 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.267+0000 7f8d3de0a700 1 --2- 172.21.15.154:0/1069600985 >> v2:172.21.15.154:3300/0 conn(0x7f8d38133a70 0x7f8d38133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.267+0000 7f8d3de0a700 1 --2- 172.21.15.154:0/1069600985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d380a08e0 0x7f8d380a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.267+0000 7f8d3de0a700 1 -- 172.21.15.154:0/1069600985 >> 172.21.15.154:0/1069600985 conn(0x7f8d380a2980 msgr2=0x7f8d380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.267+0000 7f8d3de0a700 1 -- 172.21.15.154:0/1069600985 shutdown_connections 2023-09-30T22:24:15.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.267+0000 7f8d3de0a700 1 -- 172.21.15.154:0/1069600985 wait complete. 2023-09-30T22:24:15.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.268+0000 7f8d3de0a700 1 Processor -- start 2023-09-30T22:24:15.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.268+0000 7f8d3de0a700 1 -- start start 2023-09-30T22:24:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d3de0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a08e0 0x7f8d3811c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d3de0a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d380a1290 0x7f8d3811cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d3de0a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133a70 0x7f8d3811d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d3de0a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3811fb90 con 0x7f8d380a1290 2023-09-30T22:24:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d3de0a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3811e3a0 con 0x7f8d380a08e0 2023-09-30T22:24:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d3de0a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3809a350 con 0x7f8d38133a70 2023-09-30T22:24:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d37fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133a70 0x7f8d3811d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d36ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d380a1290 0x7f8d3811cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d36ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d380a1290 0x7f8d3811cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53604/0 (socket says 172.21.15.154:53604) 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d36ffd700 1 -- 172.21.15.154:0/815698599 learned_addr learned my addr 172.21.15.154:0/815698599 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.269+0000 7f8d377fe700 1 --2- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a08e0 0x7f8d3811c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d36ffd700 1 -- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133a70 msgr2=0x7f8d3811d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d36ffd700 1 --2- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133a70 0x7f8d3811d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d36ffd700 1 -- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a08e0 msgr2=0x7f8d3811c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d36ffd700 1 --2- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a08e0 0x7f8d3811c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d36ffd700 1 -- 172.21.15.154:0/815698599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30009b30 con 0x7f8d380a1290 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d377fe700 1 --2- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a08e0 0x7f8d3811c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d36ffd700 1 --2- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d380a1290 0x7f8d3811cb50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00e9b0 tx=0x7f8d2c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d1ffff700 1 -- 172.21.15.154:0/815698599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c009710 con 0x7f8d380a1290 2023-09-30T22:24:15.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d1ffff700 1 -- 172.21.15.154:0/815698599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c00ee50 con 0x7f8d380a1290 2023-09-30T22:24:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d3de0a700 1 -- 172.21.15.154:0/815698599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d38120130 con 0x7f8d380a1290 2023-09-30T22:24:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d1ffff700 1 -- 172.21.15.154:0/815698599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c00ca50 con 0x7f8d380a1290 2023-09-30T22:24:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.270+0000 7f8d3de0a700 1 -- 172.21.15.154:0/815698599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3811f4c0 con 0x7f8d380a1290 2023-09-30T22:24:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.271+0000 7f8d1ffff700 1 -- 172.21.15.154:0/815698599 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d2c00cbb0 con 0x7f8d380a1290 2023-09-30T22:24:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.271+0000 7f8d1ffff700 1 -- 172.21.15.154:0/815698599 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d2c03fba0 con 0x7f8d380a1290 2023-09-30T22:24:15.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.271+0000 7f8d3de0a700 1 -- 172.21.15.154:0/815698599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3811f8c0 con 0x7f8d380a1290 2023-09-30T22:24:15.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.280+0000 7f8d1ffff700 1 -- 172.21.15.154:0/815698599 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d2c017020 con 0x7f8d380a1290 2023-09-30T22:24:15.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.318+0000 7f164e2dd700 1 Processor -- start 2023-09-30T22:24:15.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.318+0000 7f164e2dd700 1 -- start start 2023-09-30T22:24:15.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f164e2dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 0x7f16480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f164e2dd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16480a1380 0x7f1648133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f164e2dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f1648134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f164e2dd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164809e9d0 con 0x7f16480a1380 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f164e2dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164809dc00 con 0x7f16480a0a70 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f164e2dd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f164809dec0 con 0x7f1648133f50 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f16477fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16480a1380 0x7f1648133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f16477fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16480a1380 0x7f1648133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53610/0 (socket says 172.21.15.154:53610) 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f16477fe700 1 -- 172.21.15.154:0/3428599368 learned_addr learned my addr 172.21.15.154:0/3428599368 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f1647fff700 1 --2- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 0x7f16480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f164c87a700 1 --2- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f1648134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f16477fe700 1 -- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 msgr2=0x7f1648134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f16477fe700 1 --2- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f1648134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f16477fe700 1 -- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 msgr2=0x7f16480a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:15.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f16477fe700 1 --2- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 0x7f16480a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.319+0000 7f16477fe700 1 -- 172.21.15.154:0/3428599368 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164809e6a0 con 0x7f16480a1380 2023-09-30T22:24:15.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f16477fe700 1 --2- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 0x7f1648133a10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f163c0098f0 tx=0x7f163c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fd5f1964eb5541 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f1646ffd700 1 -- 172.21.15.154:0/3428599368 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c011830 con 0x7f16480a1380 2023-09-30T22:24:15.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f1646ffd700 1 -- 172.21.15.154:0/3428599368 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c011990 con 0x7f16480a1380 2023-09-30T22:24:15.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f1646ffd700 1 -- 172.21.15.154:0/3428599368 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c011d20 con 0x7f16480a1380 2023-09-30T22:24:15.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f164e2dd700 1 -- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 msgr2=0x7f1648133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f164e2dd700 1 --2- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 0x7f1648133a10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f163c0098f0 tx=0x7f163c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:15.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f164e2dd700 1 -- 172.21.15.154:0/3428599368 shutdown_connections 2023-09-30T22:24:15.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f164e2dd700 1 --2- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 0x7f16480a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f164e2dd700 1 --2- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f1648134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f164e2dd700 1 --2- 172.21.15.154:0/3428599368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 0x7f1648133a10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.320+0000 7f164e2dd700 1 -- 172.21.15.154:0/3428599368 >> 172.21.15.154:0/3428599368 conn(0x7f16480a6610 msgr2=0x7f16480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.321+0000 7f164e2dd700 1 -- 172.21.15.154:0/3428599368 shutdown_connections 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.321+0000 7f164e2dd700 1 -- 172.21.15.154:0/3428599368 wait complete. 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.322+0000 7f164e2dd700 1 Processor -- start 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.322+0000 7f164e2dd700 1 -- start start 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164e2dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 0x7f164811f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164e2dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 0x7f164811f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164e2dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f164811ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164e2dd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16481214e0 con 0x7f16480a1380 2023-09-30T22:24:15.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164e2dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1648122780 con 0x7f16480a0a70 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164e2dd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16480a03e0 con 0x7f1648133f50 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164c87a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f164811ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164c87a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f164811ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46888/0 (socket says 172.21.15.154:46888) 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164c87a700 1 -- 172.21.15.154:0/4205188622 learned_addr learned my addr 172.21.15.154:0/4205188622 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f1647fff700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 0x7f164811f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f16477fe700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 0x7f164811f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164c87a700 1 -- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 msgr2=0x7f164811f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164c87a700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 0x7f164811f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164c87a700 1 -- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 msgr2=0x7f164811f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164c87a700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 0x7f164811f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164c87a700 1 -- 172.21.15.154:0/4205188622 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c009550 con 0x7f1648133f50 2023-09-30T22:24:15.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f16477fe700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 0x7f164811f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:15.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f164c87a700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f164811ff00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f164000b700 tx=0x7f164000ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:15.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.323+0000 7f1644ff9700 1 -- 172.21.15.154:0/4205188622 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640019070 con 0x7f1648133f50 2023-09-30T22:24:15.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.324+0000 7f1644ff9700 1 -- 172.21.15.154:0/4205188622 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640007540 con 0x7f1648133f50 2023-09-30T22:24:15.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.324+0000 7f1644ff9700 1 -- 172.21.15.154:0/4205188622 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400078d0 con 0x7f1648133f50 2023-09-30T22:24:15.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.324+0000 7f164e2dd700 1 -- 172.21.15.154:0/4205188622 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1648122c30 con 0x7f1648133f50 2023-09-30T22:24:15.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.324+0000 7f164e2dd700 1 -- 172.21.15.154:0/4205188622 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1648122970 con 0x7f1648133f50 2023-09-30T22:24:15.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.325+0000 7f164e2dd700 1 -- 172.21.15.154:0/4205188622 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1648132280 con 0x7f1648133f50 2023-09-30T22:24:15.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.325+0000 7f1644ff9700 1 -- 172.21.15.154:0/4205188622 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1640007a30 con 0x7f1648133f50 2023-09-30T22:24:15.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.325+0000 7f1644ff9700 1 -- 172.21.15.154:0/4205188622 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1640047980 con 0x7f1648133f50 2023-09-30T22:24:15.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.330+0000 7f1644ff9700 1 -- 172.21.15.154:0/4205188622 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1640024b40 con 0x7f1648133f50 2023-09-30T22:24:15.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.410+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/3356134906 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2e0135dd0 con 0x7fb2e0066410 2023-09-30T22:24:15.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.410+0000 7fb2dd7fa700 1 -- 172.21.15.154:0/3356134906 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2d40102b0 con 0x7fb2e0066410 2023-09-30T22:24:15.410 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.413+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e0066410 msgr2=0x7fb2e0133050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.413+0000 7fb2e6bd0700 1 --2- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e0066410 0x7fb2e0133050 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400e990 tx=0x7fb2d400eca0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.413+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/3356134906 shutdown_connections 2023-09-30T22:24:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.413+0000 7fb2e6bd0700 1 --2- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2e01314b0 0x7fb2e0133ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.413+0000 7fb2e6bd0700 1 --2- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2e0066410 0x7fb2e0133050 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.413+0000 7fb2e6bd0700 1 --2- 172.21.15.154:0/3356134906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2e009bc70 0x7fb2e0133590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.413+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/3356134906 >> 172.21.15.154:0/3356134906 conn(0x7fb2e00a2980 msgr2=0x7fb2e012f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.413+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/3356134906 shutdown_connections 2023-09-30T22:24:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.413+0000 7fb2e6bd0700 1 -- 172.21.15.154:0/3356134906 wait complete. 2023-09-30T22:24:15.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:15.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.448+0000 7f988408a700 1 -- 172.21.15.154:0/1249915665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f987c04f2a0 con 0x7f987c09e170 2023-09-30T22:24:15.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.448+0000 7f98727fc700 1 -- 172.21.15.154:0/1249915665 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f986c021020 con 0x7f987c09e170 2023-09-30T22:24:15.448 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:15.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.451+0000 7f988408a700 1 -- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c09e170 msgr2=0x7f987c123970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.451+0000 7f988408a700 1 --2- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c09e170 0x7f987c123970 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f986c00e810 tx=0x7f986c00ebd0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.451+0000 7f988408a700 1 -- 172.21.15.154:0/1249915665 shutdown_connections 2023-09-30T22:24:15.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.451+0000 7f988408a700 1 --2- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f987c130ce0 0x7f987c1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.451+0000 7f988408a700 1 --2- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f987c09d860 0x7f987c123430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.451+0000 7f988408a700 1 --2- 172.21.15.154:0/1249915665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f987c09e170 0x7f987c123970 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.451+0000 7f988408a700 1 -- 172.21.15.154:0/1249915665 >> 172.21.15.154:0/1249915665 conn(0x7f987c099c40 msgr2=0x7f987c071060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.451+0000 7f988408a700 1 -- 172.21.15.154:0/1249915665 shutdown_connections 2023-09-30T22:24:15.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.451+0000 7f988408a700 1 -- 172.21.15.154:0/1249915665 wait complete. 2023-09-30T22:24:15.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:15.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.486+0000 7f8d3de0a700 1 -- 172.21.15.154:0/815698599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d3812ffd0 con 0x7f8d380a1290 2023-09-30T22:24:15.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.487+0000 7f8d1ffff700 1 -- 172.21.15.154:0/815698599 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d3812ffd0 con 0x7f8d380a1290 2023-09-30T22:24:15.487 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.488+0000 7f8d3de0a700 1 -- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d380a1290 msgr2=0x7f8d3811cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.488+0000 7f8d3de0a700 1 --2- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d380a1290 0x7f8d3811cb50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00e9b0 tx=0x7f8d2c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.489+0000 7f8d3de0a700 1 -- 172.21.15.154:0/815698599 shutdown_connections 2023-09-30T22:24:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.489+0000 7f8d3de0a700 1 --2- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133a70 0x7f8d3811d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.489+0000 7f8d3de0a700 1 --2- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a08e0 0x7f8d3811c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.489+0000 7f8d3de0a700 1 --2- 172.21.15.154:0/815698599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d380a1290 0x7f8d3811cb50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.489+0000 7f8d3de0a700 1 -- 172.21.15.154:0/815698599 >> 172.21.15.154:0/815698599 conn(0x7f8d380a2980 msgr2=0x7f8d381baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.489+0000 7f8d3de0a700 1 -- 172.21.15.154:0/815698599 shutdown_connections 2023-09-30T22:24:15.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.489+0000 7f8d3de0a700 1 -- 172.21.15.154:0/815698599 wait complete. 2023-09-30T22:24:15.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:15.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.531+0000 7f164e2dd700 1 -- 172.21.15.154:0/4205188622 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f164804f2a0 con 0x7f1648133f50 2023-09-30T22:24:15.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.532+0000 7f1644ff9700 1 -- 172.21.15.154:0/4205188622 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1640022020 con 0x7f1648133f50 2023-09-30T22:24:15.532 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.534+0000 7f164e2dd700 1 -- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 msgr2=0x7f164811ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.534+0000 7f164e2dd700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f164811ff00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f164000b700 tx=0x7f164000ba10 comp rx=0 tx=0).stop 2023-09-30T22:24:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.534+0000 7f164e2dd700 1 -- 172.21.15.154:0/4205188622 shutdown_connections 2023-09-30T22:24:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.534+0000 7f164e2dd700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1648133f50 0x7f164811ff00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.534+0000 7f164e2dd700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16480a0a70 0x7f164811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.534+0000 7f164e2dd700 1 --2- 172.21.15.154:0/4205188622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16480a1380 0x7f164811f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.534+0000 7f164e2dd700 1 -- 172.21.15.154:0/4205188622 >> 172.21.15.154:0/4205188622 conn(0x7f16480a6610 msgr2=0x7f16480a5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.534+0000 7f164e2dd700 1 -- 172.21.15.154:0/4205188622 shutdown_connections 2023-09-30T22:24:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:15.534+0000 7f164e2dd700 1 -- 172.21.15.154:0/4205188622 wait complete. 2023-09-30T22:24:15.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:16.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:16.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:16.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:16.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:16.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.568+0000 7f6b1045d700 1 Processor -- start 2023-09-30T22:24:16.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.568+0000 7f6b1045d700 1 -- start start 2023-09-30T22:24:16.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.569+0000 7f6b1045d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b08133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.569+0000 7f6b1045d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b08133f70 0x7f6b081343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.569+0000 7f6b1045d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0809b110 con 0x7f6b080a0a70 2023-09-30T22:24:16.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.569+0000 7f6b1045d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b080a3b60 con 0x7f6b08133f70 2023-09-30T22:24:16.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.569+0000 7f6b1045d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081348e0 con 0x7f6b0809ad40 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0e1f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b08133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0e1f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b08133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51660/0 (socket says 172.21.15.154:51660) 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0e1f9700 1 -- 172.21.15.154:0/693804692 learned_addr learned my addr 172.21.15.154:0/693804692 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0e9fa700 1 --1- 172.21.15.154:0/693804692 >> v1:172.21.15.154:6789/0 conn(0x7f6b080a0a70 0x7f6b080a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47006/0 (socket says 172.21.15.154:47006) 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0d9f8700 1 --2- 172.21.15.154:0/693804692 >> v2:172.21.15.154:3300/0 conn(0x7f6b08133f70 0x7f6b081343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0e1f9700 1 -- 172.21.15.154:0/693804692 >> v2:172.21.15.154:3300/0 conn(0x7f6b08133f70 msgr2=0x7f6b081343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0e1f9700 1 --2- 172.21.15.154:0/693804692 >> v2:172.21.15.154:3300/0 conn(0x7f6b08133f70 0x7f6b081343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0e1f9700 1 -- 172.21.15.154:0/693804692 >> v1:172.21.15.154:6789/0 conn(0x7f6b080a0a70 legacy=0x7f6b080a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0e1f9700 1 -- 172.21.15.154:0/693804692 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080a2fa0 con 0x7f6b0809ad40 2023-09-30T22:24:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0e1f9700 1 --2- 172.21.15.154:0/693804692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b08133a30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009920 tx=0x7f6b04009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921da09165bd3ffb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0d1f7700 1 -- 172.21.15.154:0/693804692 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04011830 con 0x7f6b0809ad40 2023-09-30T22:24:16.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0d1f7700 1 -- 172.21.15.154:0/693804692 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04011990 con 0x7f6b0809ad40 2023-09-30T22:24:16.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.570+0000 7f6b0d1f7700 1 -- 172.21.15.154:0/693804692 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04011d20 con 0x7f6b0809ad40 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.571+0000 7f6b1045d700 1 -- 172.21.15.154:0/693804692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 msgr2=0x7f6b08133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.571+0000 7f6b1045d700 1 --2- 172.21.15.154:0/693804692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b08133a30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009920 tx=0x7f6b04009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.572+0000 7f6b1045d700 1 -- 172.21.15.154:0/693804692 shutdown_connections 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.572+0000 7f6b1045d700 1 --2- 172.21.15.154:0/693804692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b08133a30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.572+0000 7f6b1045d700 1 --2- 172.21.15.154:0/693804692 >> v2:172.21.15.154:3300/0 conn(0x7f6b08133f70 0x7f6b081343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.572+0000 7f6b1045d700 1 -- 172.21.15.154:0/693804692 >> 172.21.15.154:0/693804692 conn(0x7f6b08099c40 msgr2=0x7f6b0806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.572+0000 7f6b1045d700 1 -- 172.21.15.154:0/693804692 shutdown_connections 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.572+0000 7f6b1045d700 1 -- 172.21.15.154:0/693804692 wait complete. 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.573+0000 7f6b1045d700 1 Processor -- start 2023-09-30T22:24:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.573+0000 7f6b1045d700 1 -- start start 2023-09-30T22:24:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b1045d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b081250d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b1045d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b080a0a70 0x7f6b08125610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b1045d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b08133f70 0x7f6b08125b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b1045d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08126c20 con 0x7f6b08133f70 2023-09-30T22:24:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b1045d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0809c7e0 con 0x7f6b0809ad40 2023-09-30T22:24:16.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b1045d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080a0f70 con 0x7f6b080a0a70 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b0e1f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b081250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b0e1f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b081250d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51668/0 (socket says 172.21.15.154:51668) 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b0e1f9700 1 -- 172.21.15.154:0/2182308540 learned_addr learned my addr 172.21.15.154:0/2182308540 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b0e1f9700 1 -- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b080a0a70 msgr2=0x7f6b08125610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b0e1f9700 1 --2- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b080a0a70 0x7f6b08125610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b0e1f9700 1 -- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b08133f70 msgr2=0x7f6b08125b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b0e1f9700 1 --2- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b08133f70 0x7f6b08125b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b0e1f9700 1 -- 172.21.15.154:0/2182308540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04009550 con 0x7f6b0809ad40 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6b0e1f9700 1 --2- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b081250d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009130 tx=0x7f6b04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6afeffd700 1 -- 172.21.15.154:0/2182308540 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b040036a0 con 0x7f6b0809ad40 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.574+0000 7f6afeffd700 1 -- 172.21.15.154:0/2182308540 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0401e070 con 0x7f6b0809ad40 2023-09-30T22:24:16.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.575+0000 7f6b1045d700 1 -- 172.21.15.154:0/2182308540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b08127910 con 0x7f6b0809ad40 2023-09-30T22:24:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.575+0000 7f6afeffd700 1 -- 172.21.15.154:0/2182308540 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04003a60 con 0x7f6b0809ad40 2023-09-30T22:24:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.575+0000 7f6b1045d700 1 -- 172.21.15.154:0/2182308540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b08126090 con 0x7f6b0809ad40 2023-09-30T22:24:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.575+0000 7f6afeffd700 1 -- 172.21.15.154:0/2182308540 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b04003bc0 con 0x7f6b0809ad40 2023-09-30T22:24:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.576+0000 7f6afeffd700 1 -- 172.21.15.154:0/2182308540 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6b04020070 con 0x7f6b0809ad40 2023-09-30T22:24:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.576+0000 7f6b1045d700 1 -- 172.21.15.154:0/2182308540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b080a0430 con 0x7f6b0809ad40 2023-09-30T22:24:16.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.585+0000 7f6afeffd700 1 -- 172.21.15.154:0/2182308540 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b0401a420 con 0x7f6b0809ad40 2023-09-30T22:24:16.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.618+0000 7f28b73db700 1 Processor -- start 2023-09-30T22:24:16.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b73db700 1 -- start start 2023-09-30T22:24:16.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b73db700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28b0138410 0x7f28b00a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b73db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b013dd10 0x7f28b01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b73db700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b01379e0 con 0x7f28b0138040 2023-09-30T22:24:16.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b73db700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b00a2100 con 0x7f28b0138410 2023-09-30T22:24:16.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b73db700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28b009b9b0 con 0x7f28b013dd10 2023-09-30T22:24:16.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b5978700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b013dd10 0x7f28b01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b5978700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b013dd10 0x7f28b01400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46908/0 (socket says 172.21.15.154:46908) 2023-09-30T22:24:16.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b5177700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f28b0138040 0x7f28b00a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47010/0 (socket says 172.21.15.154:47010) 2023-09-30T22:24:16.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b5978700 1 -- 172.21.15.154:0/126520576 learned_addr learned my addr 172.21.15.154:0/126520576 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:16.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.619+0000 7f28b4976700 1 --2- 172.21.15.154:0/126520576 >> v2:172.21.15.154:3300/0 conn(0x7f28b0138410 0x7f28b00a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.620+0000 7f28b5978700 1 -- 172.21.15.154:0/126520576 >> v2:172.21.15.154:3300/0 conn(0x7f28b0138410 msgr2=0x7f28b00a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:16.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.620+0000 7f28b5978700 1 --2- 172.21.15.154:0/126520576 >> v2:172.21.15.154:3300/0 conn(0x7f28b0138410 0x7f28b00a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.620+0000 7f28b5978700 1 -- 172.21.15.154:0/126520576 >> v1:172.21.15.154:6789/0 conn(0x7f28b0138040 legacy=0x7f28b00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.620+0000 7f28b5978700 1 -- 172.21.15.154:0/126520576 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0137c10 con 0x7f28b013dd10 2023-09-30T22:24:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.620+0000 7f28b5978700 1 --2- 172.21.15.154:0/126520576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b013dd10 0x7f28b01400f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009e80 tx=0x7f28a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f00ac300e5a20b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.620+0000 7f28a7fff700 1 -- 172.21.15.154:0/126520576 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800e070 con 0x7f28b013dd10 2023-09-30T22:24:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.620+0000 7f28a7fff700 1 -- 172.21.15.154:0/126520576 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a800b8d0 con 0x7f28b013dd10 2023-09-30T22:24:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.620+0000 7f28a7fff700 1 -- 172.21.15.154:0/126520576 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800bc80 con 0x7f28b013dd10 2023-09-30T22:24:16.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.621+0000 7f28b73db700 1 -- 172.21.15.154:0/126520576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b013dd10 msgr2=0x7f28b01400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.621+0000 7f28b73db700 1 --2- 172.21.15.154:0/126520576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b013dd10 0x7f28b01400f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009e80 tx=0x7f28a800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.621+0000 7f28b73db700 1 -- 172.21.15.154:0/126520576 shutdown_connections 2023-09-30T22:24:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.621+0000 7f28b73db700 1 --2- 172.21.15.154:0/126520576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b013dd10 0x7f28b01400f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.621+0000 7f28b73db700 1 --2- 172.21.15.154:0/126520576 >> v2:172.21.15.154:3300/0 conn(0x7f28b0138410 0x7f28b00a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.621+0000 7f28b73db700 1 -- 172.21.15.154:0/126520576 >> 172.21.15.154:0/126520576 conn(0x7f28b00a2980 msgr2=0x7f28b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.621+0000 7f28b73db700 1 -- 172.21.15.154:0/126520576 shutdown_connections 2023-09-30T22:24:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.621+0000 7f28b73db700 1 -- 172.21.15.154:0/126520576 wait complete. 2023-09-30T22:24:16.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b73db700 1 Processor -- start 2023-09-30T22:24:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b73db700 1 -- start start 2023-09-30T22:24:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b73db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b0138040 0x7f28b0137190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b73db700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b0138410 0x7f28b0135970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b73db700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b013dd10 0x7f28b0135eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b73db700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b0119090 con 0x7f28b0138410 2023-09-30T22:24:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b73db700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b013bb80 con 0x7f28b013dd10 2023-09-30T22:24:16.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b73db700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28b0130040 con 0x7f28b0138040 2023-09-30T22:24:16.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b5177700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b0138040 0x7f28b0137190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b5177700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b0138040 0x7f28b0137190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46922/0 (socket says 172.21.15.154:46922) 2023-09-30T22:24:16.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.622+0000 7f28b5177700 1 -- 172.21.15.154:0/1191237048 learned_addr learned my addr 172.21.15.154:0/1191237048 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:16.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28b5978700 1 --2- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b013dd10 0x7f28b0135eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28b4976700 1 --2- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b0138410 0x7f28b0135970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28b5177700 1 -- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b013dd10 msgr2=0x7f28b0135eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28b5177700 1 --2- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b013dd10 0x7f28b0135eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28b5177700 1 -- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b0138410 msgr2=0x7f28b0135970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28b5177700 1 --2- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b0138410 0x7f28b0135970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28b5177700 1 -- 172.21.15.154:0/1191237048 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a8009b30 con 0x7f28b0138040 2023-09-30T22:24:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28b5177700 1 --2- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b0138040 0x7f28b0137190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00c4b0 tx=0x7f28ac00c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28a5ffb700 1 -- 172.21.15.154:0/1191237048 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0074e0 con 0x7f28b0138040 2023-09-30T22:24:16.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28a5ffb700 1 -- 172.21.15.154:0/1191237048 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac007640 con 0x7f28b0138040 2023-09-30T22:24:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28b73db700 1 -- 172.21.15.154:0/1191237048 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b013cb40 con 0x7f28b0138040 2023-09-30T22:24:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.623+0000 7f28a5ffb700 1 -- 172.21.15.154:0/1191237048 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac005a70 con 0x7f28b0138040 2023-09-30T22:24:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.624+0000 7f28b73db700 1 -- 172.21.15.154:0/1191237048 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b013c250 con 0x7f28b0138040 2023-09-30T22:24:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.625+0000 7f28b73db700 1 -- 172.21.15.154:0/1191237048 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b004f2a0 con 0x7f28b0138040 2023-09-30T22:24:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.626+0000 7f28a5ffb700 1 -- 172.21.15.154:0/1191237048 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28ac005bd0 con 0x7f28b0138040 2023-09-30T22:24:16.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.626+0000 7f28a5ffb700 1 -- 172.21.15.154:0/1191237048 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f28ac03ee50 con 0x7f28b0138040 2023-09-30T22:24:16.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.630+0000 7f28a5ffb700 1 -- 172.21.15.154:0/1191237048 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28ac0011b0 con 0x7f28b0138040 2023-09-30T22:24:16.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.655+0000 7ff11c9b0700 1 Processor -- start 2023-09-30T22:24:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.655+0000 7ff11c9b0700 1 -- start start 2023-09-30T22:24:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.656+0000 7ff11c9b0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff1181349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.656+0000 7ff11c9b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.656+0000 7ff11c9b0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11809eca0 con 0x7ff11809dea0 2023-09-30T22:24:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.656+0000 7ff11c9b0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11806b2e0 con 0x7ff118134f00 2023-09-30T22:24:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.656+0000 7ff11c9b0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11809f720 con 0x7ff11806a770 2023-09-30T22:24:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.656+0000 7ff116d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff11809dea0 0x7ff11813ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47018/0 (socket says 172.21.15.154:47018) 2023-09-30T22:24:16.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.656+0000 7ff115d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.656+0000 7ff116d9d700 1 -- 172.21.15.154:0/3897379864 learned_addr learned my addr 172.21.15.154:0/3897379864 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:16.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.656+0000 7ff11659c700 1 --2- 172.21.15.154:0/3897379864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff1181349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.657+0000 7ff11659c700 1 -- 172.21.15.154:0/3897379864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 msgr2=0x7ff11809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.657+0000 7ff11659c700 1 --2- 172.21.15.154:0/3897379864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11809d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.657+0000 7ff11659c700 1 -- 172.21.15.154:0/3897379864 >> v1:172.21.15.154:6789/0 conn(0x7ff11809dea0 legacy=0x7ff11813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.657+0000 7ff11659c700 1 -- 172.21.15.154:0/3897379864 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11806b480 con 0x7ff11806a770 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.657+0000 7ff115d9b700 1 --2- 172.21.15.154:0/3897379864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.657+0000 7ff11659c700 1 --2- 172.21.15.154:0/3897379864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff1181349c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff108009870 tx=0x7ff108009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43bd58a5794b1aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.657+0000 7ff11559a700 1 -- 172.21.15.154:0/3897379864 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108011830 con 0x7ff11806a770 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.657+0000 7ff11559a700 1 -- 172.21.15.154:0/3897379864 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff108011990 con 0x7ff11806a770 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.657+0000 7ff11559a700 1 -- 172.21.15.154:0/3897379864 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108011d20 con 0x7ff11806a770 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.658+0000 7ff11c9b0700 1 -- 172.21.15.154:0/3897379864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 msgr2=0x7ff1181349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.658+0000 7ff11c9b0700 1 --2- 172.21.15.154:0/3897379864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff1181349c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff108009870 tx=0x7ff108009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.658+0000 7ff11c9b0700 1 -- 172.21.15.154:0/3897379864 shutdown_connections 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.658+0000 7ff11c9b0700 1 --2- 172.21.15.154:0/3897379864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff1181349c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.658+0000 7ff11c9b0700 1 --2- 172.21.15.154:0/3897379864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.658+0000 7ff11c9b0700 1 -- 172.21.15.154:0/3897379864 >> 172.21.15.154:0/3897379864 conn(0x7ff118099c40 msgr2=0x7ff1180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.658+0000 7ff11c9b0700 1 -- 172.21.15.154:0/3897379864 shutdown_connections 2023-09-30T22:24:16.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.658+0000 7ff11c9b0700 1 -- 172.21.15.154:0/3897379864 wait complete. 2023-09-30T22:24:16.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.659+0000 7ff11c9b0700 1 Processor -- start 2023-09-30T22:24:16.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.659+0000 7ff11c9b0700 1 -- start start 2023-09-30T22:24:16.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11c9b0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff11811a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11c9b0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11809dea0 0x7ff11811a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11c9b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11811aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11c9b0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11811b4c0 con 0x7ff11809dea0 2023-09-30T22:24:16.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11c9b0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11811bbf0 con 0x7ff118134f00 2023-09-30T22:24:16.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11c9b0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11811ceb0 con 0x7ff11806a770 2023-09-30T22:24:16.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff11811a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff11811a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46952/0 (socket says 172.21.15.154:46952) 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11659c700 1 -- 172.21.15.154:0/920532144 learned_addr learned my addr 172.21.15.154:0/920532144 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff115d9b700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11809dea0 0x7ff11811a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff116d9d700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11811aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff115d9b700 1 -- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 msgr2=0x7ff11811a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff115d9b700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff11811a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff115d9b700 1 -- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 msgr2=0x7ff11811aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff115d9b700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11811aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff115d9b700 1 -- 172.21.15.154:0/920532144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0094a0 con 0x7ff11809dea0 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff116d9d700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11811aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff11659c700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff11811a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:16.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.660+0000 7ff115d9b700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11809dea0 0x7ff11811a570 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00e980 tx=0x7ff10c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.661+0000 7ff106ffd700 1 -- 172.21.15.154:0/920532144 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c00c690 con 0x7ff11809dea0 2023-09-30T22:24:16.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.661+0000 7ff106ffd700 1 -- 172.21.15.154:0/920532144 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c00c7f0 con 0x7ff11809dea0 2023-09-30T22:24:16.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.661+0000 7ff11c9b0700 1 -- 172.21.15.154:0/920532144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1080094a0 con 0x7ff11809dea0 2023-09-30T22:24:16.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.661+0000 7ff106ffd700 1 -- 172.21.15.154:0/920532144 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c00cb80 con 0x7ff11809dea0 2023-09-30T22:24:16.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.661+0000 7ff11c9b0700 1 -- 172.21.15.154:0/920532144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff118138ab0 con 0x7ff11809dea0 2023-09-30T22:24:16.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.662+0000 7ff106ffd700 1 -- 172.21.15.154:0/920532144 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff10c00cce0 con 0x7ff11809dea0 2023-09-30T22:24:16.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.662+0000 7ff11c9b0700 1 -- 172.21.15.154:0/920532144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1180700a0 con 0x7ff11809dea0 2023-09-30T22:24:16.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.662+0000 7ff106ffd700 1 -- 172.21.15.154:0/920532144 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff10c03f660 con 0x7ff11809dea0 2023-09-30T22:24:16.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.671+0000 7ff106ffd700 1 -- 172.21.15.154:0/920532144 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff10c01bba0 con 0x7ff11809dea0 2023-09-30T22:24:16.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.693+0000 7f3beda6f700 1 Processor -- start 2023-09-30T22:24:16.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.694+0000 7f3beda6f700 1 -- start start 2023-09-30T22:24:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.694+0000 7f3beda6f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be81346e0 0x7f3be8136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.694+0000 7f3beda6f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3be8137000 0x7f3be81393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.694+0000 7f3beda6f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be80a1640 con 0x7f3be8131980 2023-09-30T22:24:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.694+0000 7f3beda6f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be806eb30 con 0x7f3be8137000 2023-09-30T22:24:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.694+0000 7f3beda6f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80a22d0 con 0x7f3be81346e0 2023-09-30T22:24:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.694+0000 7f3be6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be81346e0 0x7f3be8136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be81346e0 0x7f3be8136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51696/0 (socket says 172.21.15.154:51696) 2023-09-30T22:24:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be6ffd700 1 -- 172.21.15.154:0/121820981 learned_addr learned my addr 172.21.15.154:0/121820981 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be7fff700 1 --2- 172.21.15.154:0/121820981 >> v2:172.21.15.154:3300/0 conn(0x7f3be8137000 0x7f3be81393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be6ffd700 1 -- 172.21.15.154:0/121820981 >> v2:172.21.15.154:3300/0 conn(0x7f3be8137000 msgr2=0x7f3be81393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be6ffd700 1 --2- 172.21.15.154:0/121820981 >> v2:172.21.15.154:3300/0 conn(0x7f3be8137000 0x7f3be81393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be6ffd700 1 -- 172.21.15.154:0/121820981 >> v1:172.21.15.154:6789/0 conn(0x7f3be8131980 legacy=0x7f3be8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be6ffd700 1 -- 172.21.15.154:0/121820981 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8131550 con 0x7f3be81346e0 2023-09-30T22:24:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be6ffd700 1 --2- 172.21.15.154:0/121820981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be81346e0 0x7f3be8136ac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009920 tx=0x7f3bdc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42050942a932ff0a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be67fc700 1 -- 172.21.15.154:0/121820981 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011830 con 0x7f3be81346e0 2023-09-30T22:24:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be67fc700 1 -- 172.21.15.154:0/121820981 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc011990 con 0x7f3be81346e0 2023-09-30T22:24:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.695+0000 7f3be67fc700 1 -- 172.21.15.154:0/121820981 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011d20 con 0x7f3be81346e0 2023-09-30T22:24:16.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.696+0000 7f3beda6f700 1 -- 172.21.15.154:0/121820981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be81346e0 msgr2=0x7f3be8136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.696+0000 7f3beda6f700 1 --2- 172.21.15.154:0/121820981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be81346e0 0x7f3be8136ac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009920 tx=0x7f3bdc009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:16.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.696+0000 7f3beda6f700 1 -- 172.21.15.154:0/121820981 shutdown_connections 2023-09-30T22:24:16.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.696+0000 7f3beda6f700 1 --2- 172.21.15.154:0/121820981 >> v2:172.21.15.154:3300/0 conn(0x7f3be8137000 0x7f3be81393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.696+0000 7f3beda6f700 1 --2- 172.21.15.154:0/121820981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be81346e0 0x7f3be8136ac0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.696+0000 7f3beda6f700 1 -- 172.21.15.154:0/121820981 >> 172.21.15.154:0/121820981 conn(0x7f3be80a2980 msgr2=0x7f3be80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.696+0000 7f3beda6f700 1 -- 172.21.15.154:0/121820981 shutdown_connections 2023-09-30T22:24:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.696+0000 7f3beda6f700 1 -- 172.21.15.154:0/121820981 wait complete. 2023-09-30T22:24:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.698+0000 7f3beda6f700 1 Processor -- start 2023-09-30T22:24:16.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.698+0000 7f3beda6f700 1 -- start start 2023-09-30T22:24:16.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3beda6f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3be8131980 0x7f3be8118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3beda6f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3be81346e0 0x7f3be8119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3beda6f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be8137000 0x7f3be8119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:16.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3beda6f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be811b1a0 con 0x7f3be81346e0 2023-09-30T22:24:16.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3beda6f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be812dd00 con 0x7f3be8137000 2023-09-30T22:24:16.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3beda6f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80a1c40 con 0x7f3be8131980 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3be8131980 0x7f3be8118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3be8131980 0x7f3be8118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46956/0 (socket says 172.21.15.154:46956) 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be77fe700 1 -- 172.21.15.154:0/1541757863 learned_addr learned my addr 172.21.15.154:0/1541757863 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be6ffd700 1 --2- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3be81346e0 0x7f3be8119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be7fff700 1 --2- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be8137000 0x7f3be8119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be6ffd700 1 -- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3be8131980 msgr2=0x7f3be8118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be6ffd700 1 --2- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3be8131980 0x7f3be8118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be6ffd700 1 -- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be8137000 msgr2=0x7f3be8119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be6ffd700 1 --2- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be8137000 0x7f3be8119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be6ffd700 1 -- 172.21.15.154:0/1541757863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc009550 con 0x7f3be81346e0 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.699+0000 7f3be6ffd700 1 --2- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3be81346e0 0x7f3be8119330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc016000 tx=0x7f3bdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:16.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.700+0000 7f3bcffff700 1 -- 172.21.15.154:0/1541757863 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc004510 con 0x7f3be81346e0 2023-09-30T22:24:16.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.700+0000 7f3bcffff700 1 -- 172.21.15.154:0/1541757863 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc0036a0 con 0x7f3be81346e0 2023-09-30T22:24:16.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.700+0000 7f3bcffff700 1 -- 172.21.15.154:0/1541757863 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc003a50 con 0x7f3be81346e0 2023-09-30T22:24:16.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.700+0000 7f3beda6f700 1 -- 172.21.15.154:0/1541757863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be8071ab0 con 0x7f3be81346e0 2023-09-30T22:24:16.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.700+0000 7f3beda6f700 1 -- 172.21.15.154:0/1541757863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be8071080 con 0x7f3be81346e0 2023-09-30T22:24:16.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.701+0000 7f3bcffff700 1 -- 172.21.15.154:0/1541757863 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bdc003bb0 con 0x7f3be81346e0 2023-09-30T22:24:16.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.701+0000 7f3beda6f700 1 -- 172.21.15.154:0/1541757863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be804f2a0 con 0x7f3be81346e0 2023-09-30T22:24:16.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.701+0000 7f3bcffff700 1 -- 172.21.15.154:0/1541757863 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3bdc041e40 con 0x7f3be81346e0 2023-09-30T22:24:16.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.710+0000 7f3bcffff700 1 -- 172.21.15.154:0/1541757863 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bdc045060 con 0x7f3be81346e0 2023-09-30T22:24:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.797+0000 7f6b1045d700 1 -- 172.21.15.154:0/2182308540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b0804f2a0 con 0x7f6b0809ad40 2023-09-30T22:24:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.798+0000 7f6afeffd700 1 -- 172.21.15.154:0/2182308540 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b04015020 con 0x7f6b0809ad40 2023-09-30T22:24:16.798 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:16.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.800+0000 7f6b1045d700 1 -- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 msgr2=0x7f6b081250d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.800+0000 7f6b1045d700 1 --2- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b081250d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009130 tx=0x7f6b04004750 comp rx=0 tx=0).stop 2023-09-30T22:24:16.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.800+0000 7f6b1045d700 1 -- 172.21.15.154:0/2182308540 shutdown_connections 2023-09-30T22:24:16.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.800+0000 7f6b1045d700 1 --2- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b08133f70 0x7f6b08125b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.800+0000 7f6b1045d700 1 --2- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b0809ad40 0x7f6b081250d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.800+0000 7f6b1045d700 1 --2- 172.21.15.154:0/2182308540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b080a0a70 0x7f6b08125610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.800+0000 7f6b1045d700 1 -- 172.21.15.154:0/2182308540 >> 172.21.15.154:0/2182308540 conn(0x7f6b08099c40 msgr2=0x7f6b0809d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.801+0000 7f6b1045d700 1 -- 172.21.15.154:0/2182308540 shutdown_connections 2023-09-30T22:24:16.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.801+0000 7f6b1045d700 1 -- 172.21.15.154:0/2182308540 wait complete. 2023-09-30T22:24:16.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:16.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.845+0000 7f28b73db700 1 -- 172.21.15.154:0/1191237048 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f28b0118ef0 con 0x7f28b0138040 2023-09-30T22:24:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.845+0000 7f28a5ffb700 1 -- 172.21.15.154:0/1191237048 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28b0118ef0 con 0x7f28b0138040 2023-09-30T22:24:16.846 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.849+0000 7f28b73db700 1 -- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b0138040 msgr2=0x7f28b0137190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.849+0000 7f28b73db700 1 --2- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b0138040 0x7f28b0137190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00c4b0 tx=0x7f28ac00c7c0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.849+0000 7f28b73db700 1 -- 172.21.15.154:0/1191237048 shutdown_connections 2023-09-30T22:24:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.849+0000 7f28b73db700 1 --2- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b013dd10 0x7f28b0135eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.849+0000 7f28b73db700 1 --2- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28b0138040 0x7f28b0137190 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.849+0000 7f28b73db700 1 --2- 172.21.15.154:0/1191237048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b0138410 0x7f28b0135970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.849+0000 7f28b73db700 1 -- 172.21.15.154:0/1191237048 >> 172.21.15.154:0/1191237048 conn(0x7f28b00a2980 msgr2=0x7f28b013f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.849+0000 7f28b73db700 1 -- 172.21.15.154:0/1191237048 shutdown_connections 2023-09-30T22:24:16.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.849+0000 7f28b73db700 1 -- 172.21.15.154:0/1191237048 wait complete. 2023-09-30T22:24:16.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:16.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.871+0000 7ff11c9b0700 1 -- 172.21.15.154:0/920532144 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff118138e20 con 0x7ff11809dea0 2023-09-30T22:24:16.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.871+0000 7ff106ffd700 1 -- 172.21.15.154:0/920532144 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff10c021070 con 0x7ff11809dea0 2023-09-30T22:24:16.872 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:16.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.873+0000 7ff11c9b0700 1 -- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11809dea0 msgr2=0x7ff11811a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.873+0000 7ff11c9b0700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11809dea0 0x7ff11811a570 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00e980 tx=0x7ff10c00ec90 comp rx=0 tx=0).stop 2023-09-30T22:24:16.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.873+0000 7ff11c9b0700 1 -- 172.21.15.154:0/920532144 shutdown_connections 2023-09-30T22:24:16.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.873+0000 7ff11c9b0700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff118134f00 0x7ff11811aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.873+0000 7ff11c9b0700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11806a770 0x7ff11811a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.873+0000 7ff11c9b0700 1 --2- 172.21.15.154:0/920532144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11809dea0 0x7ff11811a570 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.873+0000 7ff11c9b0700 1 -- 172.21.15.154:0/920532144 >> 172.21.15.154:0/920532144 conn(0x7ff118099c40 msgr2=0x7ff118137fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.873+0000 7ff11c9b0700 1 -- 172.21.15.154:0/920532144 shutdown_connections 2023-09-30T22:24:16.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.873+0000 7ff11c9b0700 1 -- 172.21.15.154:0/920532144 wait complete. 2023-09-30T22:24:16.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:16.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.909+0000 7f3beda6f700 1 -- 172.21.15.154:0/1541757863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3be80a1020 con 0x7f3be81346e0 2023-09-30T22:24:16.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.909+0000 7f3bcffff700 1 -- 172.21.15.154:0/1541757863 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bdc015020 con 0x7f3be81346e0 2023-09-30T22:24:16.909 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:16.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.911+0000 7f3beda6f700 1 -- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3be81346e0 msgr2=0x7f3be8119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:16.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.911+0000 7f3beda6f700 1 --2- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3be81346e0 0x7f3be8119330 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc016000 tx=0x7f3bdc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:16.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.911+0000 7f3beda6f700 1 -- 172.21.15.154:0/1541757863 shutdown_connections 2023-09-30T22:24:16.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.911+0000 7f3beda6f700 1 --2- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3be8137000 0x7f3be8119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.911+0000 7f3beda6f700 1 --2- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3be8131980 0x7f3be8118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.911+0000 7f3beda6f700 1 --2- 172.21.15.154:0/1541757863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3be81346e0 0x7f3be8119330 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:16.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.911+0000 7f3beda6f700 1 -- 172.21.15.154:0/1541757863 >> 172.21.15.154:0/1541757863 conn(0x7f3be80a2980 msgr2=0x7f3be812e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:16.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.911+0000 7f3beda6f700 1 -- 172.21.15.154:0/1541757863 shutdown_connections 2023-09-30T22:24:16.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:16.911+0000 7f3beda6f700 1 -- 172.21.15.154:0/1541757863 wait complete. 2023-09-30T22:24:16.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:17.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:17.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:17.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:17.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:17.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f7455b92700 1 Processor -- start 2023-09-30T22:24:17.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f7455b92700 1 -- start start 2023-09-30T22:24:17.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f7455b92700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 0x7f74501351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f7455b92700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74501356e0 0x7f7450137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f7455b92700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500a1e70 con 0x7f74500a0a30 2023-09-30T22:24:17.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f7455b92700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745009a720 con 0x7f74501356e0 2023-09-30T22:24:17.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f7455b92700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745009b300 con 0x7f74500a1510 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f744ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74501356e0 0x7f7450137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f744ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74501356e0 0x7f7450137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53692/0 (socket says 172.21.15.154:53692) 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f744ffff700 1 -- 172.21.15.154:0/3397104487 learned_addr learned my addr 172.21.15.154:0/3397104487 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.954+0000 7f744effd700 1 --2- 172.21.15.154:0/3397104487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 0x7f74501351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.955+0000 7f744effd700 1 -- 172.21.15.154:0/3397104487 >> v2:172.21.15.154:3300/0 conn(0x7f74501356e0 msgr2=0x7f7450137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.955+0000 7f744effd700 1 --2- 172.21.15.154:0/3397104487 >> v2:172.21.15.154:3300/0 conn(0x7f74501356e0 0x7f7450137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.955+0000 7f744effd700 1 -- 172.21.15.154:0/3397104487 >> v1:172.21.15.154:6789/0 conn(0x7f74500a0a30 legacy=0x7f74500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.955+0000 7f744effd700 1 -- 172.21.15.154:0/3397104487 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745009abc0 con 0x7f74500a1510 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.955+0000 7f744effd700 1 --2- 172.21.15.154:0/3397104487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 0x7f74501351a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7444009840 tx=0x7f7444009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd4baf33328b72df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.955+0000 7f744e7fc700 1 -- 172.21.15.154:0/3397104487 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444011830 con 0x7f74500a1510 2023-09-30T22:24:17.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.955+0000 7f744e7fc700 1 -- 172.21.15.154:0/3397104487 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444011990 con 0x7f74500a1510 2023-09-30T22:24:17.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.955+0000 7f744e7fc700 1 -- 172.21.15.154:0/3397104487 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444011d20 con 0x7f74500a1510 2023-09-30T22:24:17.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.956+0000 7f7455b92700 1 -- 172.21.15.154:0/3397104487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 msgr2=0x7f74501351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.956+0000 7f7455b92700 1 --2- 172.21.15.154:0/3397104487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 0x7f74501351a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7444009840 tx=0x7f7444009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:17.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.956+0000 7f7455b92700 1 -- 172.21.15.154:0/3397104487 shutdown_connections 2023-09-30T22:24:17.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.956+0000 7f7455b92700 1 --2- 172.21.15.154:0/3397104487 >> v2:172.21.15.154:3300/0 conn(0x7f74501356e0 0x7f7450137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.956+0000 7f7455b92700 1 --2- 172.21.15.154:0/3397104487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 0x7f74501351a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.956+0000 7f7455b92700 1 -- 172.21.15.154:0/3397104487 >> 172.21.15.154:0/3397104487 conn(0x7f74500a2980 msgr2=0x7f74500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:17.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.956+0000 7f7455b92700 1 -- 172.21.15.154:0/3397104487 shutdown_connections 2023-09-30T22:24:17.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.956+0000 7f7455b92700 1 -- 172.21.15.154:0/3397104487 wait complete. 2023-09-30T22:24:17.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.957+0000 7f7455b92700 1 Processor -- start 2023-09-30T22:24:17.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.957+0000 7f7455b92700 1 -- start start 2023-09-30T22:24:17.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f7455b92700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74500a0a30 0x7f745011d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f7455b92700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 0x7f745011dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f7455b92700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74501356e0 0x7f745011e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:17.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f7455b92700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7450120a30 con 0x7f74500a0a30 2023-09-30T22:24:17.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f7455b92700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745009ae00 con 0x7f74500a1510 2023-09-30T22:24:17.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f7455b92700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7450071200 con 0x7f74501356e0 2023-09-30T22:24:17.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f744f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74500a0a30 0x7f745011d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:17.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f744f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74500a0a30 0x7f745011d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53708/0 (socket says 172.21.15.154:53708) 2023-09-30T22:24:17.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f744f7fe700 1 -- 172.21.15.154:0/2449400115 learned_addr learned my addr 172.21.15.154:0/2449400115 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:17.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f744f7fe700 1 -- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74501356e0 msgr2=0x7f745011e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:17.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f744f7fe700 1 --2- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74501356e0 0x7f745011e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f744f7fe700 1 -- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 msgr2=0x7f745011dcc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:17.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f744f7fe700 1 --2- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 0x7f745011dcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:17.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.958+0000 7f744f7fe700 1 -- 172.21.15.154:0/2449400115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74440094a0 con 0x7f74500a0a30 2023-09-30T22:24:17.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.959+0000 7f744f7fe700 1 --2- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74500a0a30 0x7f745011d780 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f744000c4d0 tx=0x7f744000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:17.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.959+0000 7f7437fff700 1 -- 172.21.15.154:0/2449400115 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400054e0 con 0x7f74500a0a30 2023-09-30T22:24:17.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.959+0000 7f7437fff700 1 -- 172.21.15.154:0/2449400115 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7440003680 con 0x7f74500a0a30 2023-09-30T22:24:17.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.959+0000 7f7437fff700 1 -- 172.21.15.154:0/2449400115 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440003a30 con 0x7f74500a0a30 2023-09-30T22:24:17.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.959+0000 7f7455b92700 1 -- 172.21.15.154:0/2449400115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745011f390 con 0x7f74500a0a30 2023-09-30T22:24:17.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.959+0000 7f7455b92700 1 -- 172.21.15.154:0/2449400115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74501217a0 con 0x7f74500a0a30 2023-09-30T22:24:17.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.960+0000 7f7437fff700 1 -- 172.21.15.154:0/2449400115 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7440003b90 con 0x7f74500a0a30 2023-09-30T22:24:17.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.960+0000 7f7437fff700 1 -- 172.21.15.154:0/2449400115 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f744003eb50 con 0x7f74500a0a30 2023-09-30T22:24:17.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.961+0000 7f7455b92700 1 -- 172.21.15.154:0/2449400115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745011a590 con 0x7f74500a0a30 2023-09-30T22:24:17.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:17.966+0000 7f7437fff700 1 -- 172.21.15.154:0/2449400115 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7440017080 con 0x7f74500a0a30 2023-09-30T22:24:18.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.006+0000 7f715eff8700 1 Processor -- start 2023-09-30T22:24:18.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.006+0000 7f715eff8700 1 -- start start 2023-09-30T22:24:18.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f715eff8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7158133ad0 0x7f7158133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f715eff8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7158130bc0 0x7f715813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f715eff8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715806b2d0 con 0x7f71581300a0 2023-09-30T22:24:18.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f715eff8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7158133610 con 0x7f7158130bc0 2023-09-30T22:24:18.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f715eff8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715809a500 con 0x7f7158133ad0 2023-09-30T22:24:18.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f7157fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f71581300a0 0x7f71581304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47048/0 (socket says 172.21.15.154:47048) 2023-09-30T22:24:18.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f715cd94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7158133ad0 0x7f7158133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f7157fff700 1 -- 172.21.15.154:0/3469918400 learned_addr learned my addr 172.21.15.154:0/3469918400 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:18.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f715d595700 1 --2- 172.21.15.154:0/3469918400 >> v2:172.21.15.154:3300/0 conn(0x7f7158130bc0 0x7f715813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f71577fe700 1 -- 172.21.15.154:0/3469918400 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000662557 0 0) 0x7f715806b2d0 con 0x7f71581300a0 2023-09-30T22:24:18.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.007+0000 7f71577fe700 1 -- 172.21.15.154:0/3469918400 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71480035b0 con 0x7f71581300a0 2023-09-30T22:24:18.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.008+0000 7f715cd94700 1 -- 172.21.15.154:0/3469918400 >> v2:172.21.15.154:3300/0 conn(0x7f7158130bc0 msgr2=0x7f715813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.008+0000 7f715cd94700 1 --2- 172.21.15.154:0/3469918400 >> v2:172.21.15.154:3300/0 conn(0x7f7158130bc0 0x7f715813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.008+0000 7f715cd94700 1 -- 172.21.15.154:0/3469918400 >> v1:172.21.15.154:6789/0 conn(0x7f71581300a0 legacy=0x7f71581304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.008+0000 7f715cd94700 1 -- 172.21.15.154:0/3469918400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71581338b0 con 0x7f7158133ad0 2023-09-30T22:24:18.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.008+0000 7f715d595700 1 --2- 172.21.15.154:0/3469918400 >> v2:172.21.15.154:3300/0 conn(0x7f7158130bc0 0x7f715813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:18.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.008+0000 7f715cd94700 1 --2- 172.21.15.154:0/3469918400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7158133ad0 0x7f7158133ea0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f714c009840 tx=0x7f714c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aca67c2519cf00b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.008+0000 7f71577fe700 1 -- 172.21.15.154:0/3469918400 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c011830 con 0x7f7158133ad0 2023-09-30T22:24:18.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.008+0000 7f71577fe700 1 -- 172.21.15.154:0/3469918400 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c011990 con 0x7f7158133ad0 2023-09-30T22:24:18.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.008+0000 7f71577fe700 1 -- 172.21.15.154:0/3469918400 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c011d20 con 0x7f7158133ad0 2023-09-30T22:24:18.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.009+0000 7f715eff8700 1 -- 172.21.15.154:0/3469918400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7158133ad0 msgr2=0x7f7158133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.009+0000 7f715eff8700 1 --2- 172.21.15.154:0/3469918400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7158133ad0 0x7f7158133ea0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f714c009840 tx=0x7f714c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:18.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.009+0000 7f715eff8700 1 -- 172.21.15.154:0/3469918400 shutdown_connections 2023-09-30T22:24:18.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.009+0000 7f715eff8700 1 --2- 172.21.15.154:0/3469918400 >> v2:172.21.15.154:3300/0 conn(0x7f7158130bc0 0x7f715813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.009+0000 7f715eff8700 1 --2- 172.21.15.154:0/3469918400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7158133ad0 0x7f7158133ea0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.009+0000 7f715eff8700 1 -- 172.21.15.154:0/3469918400 >> 172.21.15.154:0/3469918400 conn(0x7f7158099c40 msgr2=0x7f71580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.009+0000 7f715eff8700 1 -- 172.21.15.154:0/3469918400 shutdown_connections 2023-09-30T22:24:18.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.009+0000 7f715eff8700 1 -- 172.21.15.154:0/3469918400 wait complete. 2023-09-30T22:24:18.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.010+0000 7f715eff8700 1 Processor -- start 2023-09-30T22:24:18.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.011+0000 7f715eff8700 1 -- start start 2023-09-30T22:24:18.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.011+0000 7f715eff8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71581300a0 0x7f7158071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.011+0000 7f715eff8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7158130bc0 0x7f7158071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.011+0000 7f715eff8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7158133ad0 0x7f7158071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.011+0000 7f715eff8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71580727d0 con 0x7f7158130bc0 2023-09-30T22:24:18.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.011+0000 7f715eff8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715811ff20 con 0x7f71581300a0 2023-09-30T22:24:18.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.011+0000 7f715eff8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f715811eec0 con 0x7f7158133ad0 2023-09-30T22:24:18.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715cd94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71581300a0 0x7f7158071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715cd94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71581300a0 0x7f7158071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51734/0 (socket says 172.21.15.154:51734) 2023-09-30T22:24:18.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715cd94700 1 -- 172.21.15.154:0/1613869317 learned_addr learned my addr 172.21.15.154:0/1613869317 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:18.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715d595700 1 --2- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7158133ad0 0x7f7158071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f7157fff700 1 --2- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7158130bc0 0x7f7158071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715cd94700 1 -- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7158133ad0 msgr2=0x7f7158071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715cd94700 1 --2- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7158133ad0 0x7f7158071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715cd94700 1 -- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7158130bc0 msgr2=0x7f7158071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715cd94700 1 --2- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7158130bc0 0x7f7158071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715cd94700 1 -- 172.21.15.154:0/1613869317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150009a70 con 0x7f71581300a0 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715cd94700 1 --2- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71581300a0 0x7f7158071300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f715809a640 tx=0x7f714c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f71557fa700 1 -- 172.21.15.154:0/1613869317 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0045d0 con 0x7f71581300a0 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f71557fa700 1 -- 172.21.15.154:0/1613869317 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c01f070 con 0x7f71581300a0 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f71557fa700 1 -- 172.21.15.154:0/1613869317 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0038e0 con 0x7f71581300a0 2023-09-30T22:24:18.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715eff8700 1 -- 172.21.15.154:0/1613869317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c0094a0 con 0x7f71581300a0 2023-09-30T22:24:18.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.012+0000 7f715eff8700 1 -- 172.21.15.154:0/1613869317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715811f980 con 0x7f71581300a0 2023-09-30T22:24:18.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.013+0000 7f71557fa700 1 -- 172.21.15.154:0/1613869317 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f714c003a40 con 0x7f71581300a0 2023-09-30T22:24:18.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.014+0000 7f71557fa700 1 -- 172.21.15.154:0/1613869317 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f714c021070 con 0x7f71581300a0 2023-09-30T22:24:18.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.014+0000 7f715eff8700 1 -- 172.21.15.154:0/1613869317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715812dd60 con 0x7f71581300a0 2023-09-30T22:24:18.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.018+0000 7f71557fa700 1 -- 172.21.15.154:0/1613869317 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f714c01b430 con 0x7f71581300a0 2023-09-30T22:24:18.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda3279700 1 Processor -- start 2023-09-30T22:24:18.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda3279700 1 -- start start 2023-09-30T22:24:18.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda3279700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd9c09f350 0x7fcd9c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda3279700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c1371c0 0x7fcd9c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda3279700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c09c970 con 0x7fcd9c09e870 2023-09-30T22:24:18.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda3279700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0a0920 con 0x7fcd9c09f350 2023-09-30T22:24:18.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda3279700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c09f9c0 con 0x7fcd9c1371c0 2023-09-30T22:24:18.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda0814700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd9c09f350 0x7fcd9c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda1816700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c1371c0 0x7fcd9c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda0814700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd9c09f350 0x7fcd9c136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53734/0 (socket says 172.21.15.154:53734) 2023-09-30T22:24:18.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.051+0000 7fcda0814700 1 -- 172.21.15.154:0/1292740966 learned_addr learned my addr 172.21.15.154:0/1292740966 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:18.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.052+0000 7fcda0814700 1 -- 172.21.15.154:0/1292740966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c1371c0 msgr2=0x7fcd9c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.052+0000 7fcda0814700 1 --2- 172.21.15.154:0/1292740966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c1371c0 0x7fcd9c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.052+0000 7fcda0814700 1 -- 172.21.15.154:0/1292740966 >> v1:172.21.15.154:6789/0 conn(0x7fcd9c09e870 legacy=0x7fcd9c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.052+0000 7fcda0814700 1 -- 172.21.15.154:0/1292740966 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c09bab0 con 0x7fcd9c09f350 2023-09-30T22:24:18.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.052+0000 7fcda0814700 1 --2- 172.21.15.154:0/1292740966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c09f350 0x7fcd9c136c80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0098f0 tx=0x7fcd8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598ca38f5a5b186f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.052+0000 7fcd93fff700 1 -- 172.21.15.154:0/1292740966 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c011830 con 0x7fcd9c09f350 2023-09-30T22:24:18.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.052+0000 7fcd93fff700 1 -- 172.21.15.154:0/1292740966 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c011990 con 0x7fcd9c09f350 2023-09-30T22:24:18.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.052+0000 7fcd93fff700 1 -- 172.21.15.154:0/1292740966 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c011d20 con 0x7fcd9c09f350 2023-09-30T22:24:18.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.053+0000 7fcda3279700 1 -- 172.21.15.154:0/1292740966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c09f350 msgr2=0x7fcd9c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.053+0000 7fcda3279700 1 --2- 172.21.15.154:0/1292740966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c09f350 0x7fcd9c136c80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0098f0 tx=0x7fcd8c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.053+0000 7fcda3279700 1 -- 172.21.15.154:0/1292740966 shutdown_connections 2023-09-30T22:24:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.053+0000 7fcda3279700 1 --2- 172.21.15.154:0/1292740966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c1371c0 0x7fcd9c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.053+0000 7fcda3279700 1 --2- 172.21.15.154:0/1292740966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c09f350 0x7fcd9c136c80 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.053+0000 7fcda3279700 1 -- 172.21.15.154:0/1292740966 >> 172.21.15.154:0/1292740966 conn(0x7fcd9c0a4430 msgr2=0x7fcd9c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.053+0000 7fcda3279700 1 -- 172.21.15.154:0/1292740966 shutdown_connections 2023-09-30T22:24:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.053+0000 7fcda3279700 1 -- 172.21.15.154:0/1292740966 wait complete. 2023-09-30T22:24:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.054+0000 7fcda3279700 1 Processor -- start 2023-09-30T22:24:18.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.054+0000 7fcda3279700 1 -- start start 2023-09-30T22:24:18.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda3279700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9c09e870 0x7fcd9c1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda3279700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c09f350 0x7fcd9c135e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda3279700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c1371c0 0x7fcd9c120b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda3279700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c122010 con 0x7fcd9c1371c0 2023-09-30T22:24:18.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda3279700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c136bb0 con 0x7fcd9c09e870 2023-09-30T22:24:18.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda3279700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c09dba0 con 0x7fcd9c09f350 2023-09-30T22:24:18.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1816700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c1371c0 0x7fcd9c120b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1015700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9c09e870 0x7fcd9c1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda0814700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c09f350 0x7fcd9c135e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1816700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c1371c0 0x7fcd9c120b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53744/0 (socket says 172.21.15.154:53744) 2023-09-30T22:24:18.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1816700 1 -- 172.21.15.154:0/1327011429 learned_addr learned my addr 172.21.15.154:0/1327011429 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:18.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1816700 1 -- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c09f350 msgr2=0x7fcd9c135e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1816700 1 --2- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c09f350 0x7fcd9c135e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1816700 1 -- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9c09e870 msgr2=0x7fcd9c1358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1816700 1 --2- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9c09e870 0x7fcd9c1358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1816700 1 -- 172.21.15.154:0/1327011429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c009550 con 0x7fcd9c1371c0 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda0814700 1 --2- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c09f350 0x7fcd9c135e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1015700 1 --2- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9c09e870 0x7fcd9c1358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcda1816700 1 --2- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c1371c0 0x7fcd9c120b50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400efc0 tx=0x7fcd9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.055+0000 7fcd91ffb700 1 -- 172.21.15.154:0/1327011429 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94009ea0 con 0x7fcd9c1371c0 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.056+0000 7fcd91ffb700 1 -- 172.21.15.154:0/1327011429 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400f040 con 0x7fcd9c1371c0 2023-09-30T22:24:18.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.056+0000 7fcd91ffb700 1 -- 172.21.15.154:0/1327011429 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94014480 con 0x7fcd9c1371c0 2023-09-30T22:24:18.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.056+0000 7fcda3279700 1 -- 172.21.15.154:0/1327011429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c136370 con 0x7fcd9c1371c0 2023-09-30T22:24:18.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.056+0000 7fcda3279700 1 -- 172.21.15.154:0/1327011429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c122ec0 con 0x7fcd9c1371c0 2023-09-30T22:24:18.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.057+0000 7fcd91ffb700 1 -- 172.21.15.154:0/1327011429 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd940145e0 con 0x7fcd9c1371c0 2023-09-30T22:24:18.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.057+0000 7fcd91ffb700 1 -- 172.21.15.154:0/1327011429 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd94040070 con 0x7fcd9c1371c0 2023-09-30T22:24:18.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.058+0000 7fcda3279700 1 -- 172.21.15.154:0/1327011429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c1241a0 con 0x7fcd9c1371c0 2023-09-30T22:24:18.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.062+0000 7fcd91ffb700 1 -- 172.21.15.154:0/1327011429 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd9c1241a0 con 0x7fcd9c1371c0 2023-09-30T22:24:18.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.098+0000 7f6f5ea55700 1 Processor -- start 2023-09-30T22:24:18.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.098+0000 7f6f5ea55700 1 -- start start 2023-09-30T22:24:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.099+0000 7f6f5ea55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f580a1550 0x7f6f58138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.099+0000 7f6f5ea55700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f58139200 0x7f6f5813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.099+0000 7f6f5ea55700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5809e9d0 con 0x7f6f580a0a70 2023-09-30T22:24:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.099+0000 7f6f5ea55700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5809dc00 con 0x7f6f58139200 2023-09-30T22:24:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.099+0000 7f6f5ea55700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5809dec0 con 0x7f6f580a1550 2023-09-30T22:24:18.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.099+0000 7f6f577fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f580a1550 0x7f6f58138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.099+0000 7f6f577fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f580a1550 0x7f6f58138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46972/0 (socket says 172.21.15.154:46972) 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.099+0000 7f6f577fe700 1 -- 172.21.15.154:0/2249960840 learned_addr learned my addr 172.21.15.154:0/2249960840 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f5cff2700 1 --2- 172.21.15.154:0/2249960840 >> v2:172.21.15.154:3300/0 conn(0x7f6f58139200 0x7f6f5813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f577fe700 1 -- 172.21.15.154:0/2249960840 >> v2:172.21.15.154:3300/0 conn(0x7f6f58139200 msgr2=0x7f6f5813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f577fe700 1 --2- 172.21.15.154:0/2249960840 >> v2:172.21.15.154:3300/0 conn(0x7f6f58139200 0x7f6f5813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f577fe700 1 -- 172.21.15.154:0/2249960840 >> v1:172.21.15.154:6789/0 conn(0x7f6f580a0a70 legacy=0x7f6f580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f577fe700 1 -- 172.21.15.154:0/2249960840 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5809e6a0 con 0x7f6f580a1550 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f5cff2700 1 --2- 172.21.15.154:0/2249960840 >> v2:172.21.15.154:3300/0 conn(0x7f6f58139200 0x7f6f5813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f577fe700 1 --2- 172.21.15.154:0/2249960840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f580a1550 0x7f6f58138cc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0098f0 tx=0x7f6f4c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae116e26bc6a4a5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f56ffd700 1 -- 172.21.15.154:0/2249960840 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c004230 con 0x7f6f580a1550 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f56ffd700 1 -- 172.21.15.154:0/2249960840 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c004390 con 0x7f6f580a1550 2023-09-30T22:24:18.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.100+0000 7f6f56ffd700 1 -- 172.21.15.154:0/2249960840 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0036a0 con 0x7f6f580a1550 2023-09-30T22:24:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.101+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2249960840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f580a1550 msgr2=0x7f6f58138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.101+0000 7f6f5ea55700 1 --2- 172.21.15.154:0/2249960840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f580a1550 0x7f6f58138cc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0098f0 tx=0x7f6f4c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.101+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2249960840 shutdown_connections 2023-09-30T22:24:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.101+0000 7f6f5ea55700 1 --2- 172.21.15.154:0/2249960840 >> v2:172.21.15.154:3300/0 conn(0x7f6f58139200 0x7f6f5813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.101+0000 7f6f5ea55700 1 --2- 172.21.15.154:0/2249960840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f580a1550 0x7f6f58138cc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.101+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2249960840 >> 172.21.15.154:0/2249960840 conn(0x7f6f580a6610 msgr2=0x7f6f580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.101+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2249960840 shutdown_connections 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.101+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2249960840 wait complete. 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.102+0000 7f6f5ea55700 1 Processor -- start 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.102+0000 7f6f5ea55700 1 -- start start 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f5ea55700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f580a0a70 0x7f6f5811e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f5ea55700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f580a1550 0x7f6f5811edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f5ea55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f58139200 0x7f6f5811f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f5ea55700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580a03e0 con 0x7f6f580a1550 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f5ea55700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f581205b0 con 0x7f6f580a0a70 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f5ea55700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580a52b0 con 0x7f6f58139200 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f577fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f580a1550 0x7f6f5811edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f577fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f580a1550 0x7f6f5811edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53764/0 (socket says 172.21.15.154:53764) 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f577fe700 1 -- 172.21.15.154:0/2362935900 learned_addr learned my addr 172.21.15.154:0/2362935900 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.103+0000 7f6f5cff2700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f58139200 0x7f6f5811f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f57fff700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f580a0a70 0x7f6f5811e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f577fe700 1 -- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f58139200 msgr2=0x7f6f5811f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f577fe700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f58139200 0x7f6f5811f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f577fe700 1 -- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f580a0a70 msgr2=0x7f6f5811e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f577fe700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f580a0a70 0x7f6f5811e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f577fe700 1 -- 172.21.15.154:0/2362935900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c009550 con 0x7f6f580a1550 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f5cff2700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f58139200 0x7f6f5811f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f577fe700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f580a1550 0x7f6f5811edd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009130 tx=0x7f6f4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f54ff9700 1 -- 172.21.15.154:0/2362935900 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c003c00 con 0x7f6f580a1550 2023-09-30T22:24:18.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f54ff9700 1 -- 172.21.15.154:0/2362935900 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c01f070 con 0x7f6f580a1550 2023-09-30T22:24:18.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2362935900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f58120c90 con 0x7f6f580a1550 2023-09-30T22:24:18.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f54ff9700 1 -- 172.21.15.154:0/2362935900 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00b660 con 0x7f6f580a1550 2023-09-30T22:24:18.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.104+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2362935900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f581223b0 con 0x7f6f580a1550 2023-09-30T22:24:18.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.105+0000 7f6f54ff9700 1 -- 172.21.15.154:0/2362935900 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f4c021030 con 0x7f6f580a1550 2023-09-30T22:24:18.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.105+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2362935900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5804f2a0 con 0x7f6f580a1550 2023-09-30T22:24:18.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.105+0000 7f6f54ff9700 1 -- 172.21.15.154:0/2362935900 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f4c040d60 con 0x7f6f580a1550 2023-09-30T22:24:18.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.106+0000 7f6f57fff700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f580a0a70 0x7f6f5811e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:18.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.110+0000 7f6f54ff9700 1 -- 172.21.15.154:0/2362935900 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f4c023790 con 0x7f6f580a1550 2023-09-30T22:24:18.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.208+0000 7f7455b92700 1 -- 172.21.15.154:0/2449400115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7450120e40 con 0x7f74500a0a30 2023-09-30T22:24:18.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.208+0000 7f7437fff700 1 -- 172.21.15.154:0/2449400115 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7440003e40 con 0x7f74500a0a30 2023-09-30T22:24:18.208 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:18.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.210+0000 7f7455b92700 1 -- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74500a0a30 msgr2=0x7f745011d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.210+0000 7f7455b92700 1 --2- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74500a0a30 0x7f745011d780 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f744000c4d0 tx=0x7f744000c890 comp rx=0 tx=0).stop 2023-09-30T22:24:18.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.210+0000 7f7455b92700 1 -- 172.21.15.154:0/2449400115 shutdown_connections 2023-09-30T22:24:18.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.210+0000 7f7455b92700 1 --2- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74501356e0 0x7f745011e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.210+0000 7f7455b92700 1 --2- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74500a0a30 0x7f745011d780 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.210+0000 7f7455b92700 1 --2- 172.21.15.154:0/2449400115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74500a1510 0x7f745011dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.210+0000 7f7455b92700 1 -- 172.21.15.154:0/2449400115 >> 172.21.15.154:0/2449400115 conn(0x7f74500a2980 msgr2=0x7f7450134770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.210+0000 7f7455b92700 1 -- 172.21.15.154:0/2449400115 shutdown_connections 2023-09-30T22:24:18.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.210+0000 7f7455b92700 1 -- 172.21.15.154:0/2449400115 wait complete. 2023-09-30T22:24:18.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:18.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.255+0000 7f715eff8700 1 -- 172.21.15.154:0/1613869317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f715809cb20 con 0x7f71581300a0 2023-09-30T22:24:18.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.255+0000 7f71557fa700 1 -- 172.21.15.154:0/1613869317 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f714c015020 con 0x7f71581300a0 2023-09-30T22:24:18.255 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:18.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.257+0000 7f715eff8700 1 -- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71581300a0 msgr2=0x7f7158071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.257+0000 7f715eff8700 1 --2- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71581300a0 0x7f7158071300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f715809a640 tx=0x7f714c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.258+0000 7f715eff8700 1 -- 172.21.15.154:0/1613869317 shutdown_connections 2023-09-30T22:24:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.258+0000 7f715eff8700 1 --2- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7158133ad0 0x7f7158071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.258+0000 7f715eff8700 1 --2- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71581300a0 0x7f7158071300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.258+0000 7f715eff8700 1 --2- 172.21.15.154:0/1613869317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7158130bc0 0x7f7158071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.258+0000 7f715eff8700 1 -- 172.21.15.154:0/1613869317 >> 172.21.15.154:0/1613869317 conn(0x7f7158099c40 msgr2=0x7f7158132990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.258+0000 7f715eff8700 1 -- 172.21.15.154:0/1613869317 shutdown_connections 2023-09-30T22:24:18.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.258+0000 7f715eff8700 1 -- 172.21.15.154:0/1613869317 wait complete. 2023-09-30T22:24:18.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:18.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.333+0000 7fcda3279700 1 -- 172.21.15.154:0/1327011429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd9c1241a0 con 0x7fcd9c1371c0 2023-09-30T22:24:18.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.333+0000 7fcd91ffb700 1 -- 172.21.15.154:0/1327011429 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd9c1241a0 con 0x7fcd9c1371c0 2023-09-30T22:24:18.333 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:18.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.335+0000 7fcda3279700 1 -- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c1371c0 msgr2=0x7fcd9c120b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.335+0000 7fcda3279700 1 --2- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c1371c0 0x7fcd9c120b50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400efc0 tx=0x7fcd9400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.336+0000 7fcda3279700 1 -- 172.21.15.154:0/1327011429 shutdown_connections 2023-09-30T22:24:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.336+0000 7fcda3279700 1 --2- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9c1371c0 0x7fcd9c120b50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.336+0000 7fcda3279700 1 --2- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd9c09e870 0x7fcd9c1358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.336+0000 7fcda3279700 1 --2- 172.21.15.154:0/1327011429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd9c09f350 0x7fcd9c135e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.336+0000 7fcda3279700 1 -- 172.21.15.154:0/1327011429 >> 172.21.15.154:0/1327011429 conn(0x7fcd9c0a4430 msgr2=0x7fcd9c0a2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.336+0000 7fcda3279700 1 -- 172.21.15.154:0/1327011429 shutdown_connections 2023-09-30T22:24:18.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.336+0000 7fcda3279700 1 -- 172.21.15.154:0/1327011429 wait complete. 2023-09-30T22:24:18.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:18.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.370+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2362935900 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f5804f2a0 con 0x7f6f580a1550 2023-09-30T22:24:18.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.371+0000 7f6f54ff9700 1 -- 172.21.15.154:0/2362935900 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f4c0233d0 con 0x7f6f580a1550 2023-09-30T22:24:18.371 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:18.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.373+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f580a1550 msgr2=0x7f6f5811edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:18.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.373+0000 7f6f5ea55700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f580a1550 0x7f6f5811edd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009130 tx=0x7f6f4c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:18.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.373+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2362935900 shutdown_connections 2023-09-30T22:24:18.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.373+0000 7f6f5ea55700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f58139200 0x7f6f5811f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.373+0000 7f6f5ea55700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f580a0a70 0x7f6f5811e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.373+0000 7f6f5ea55700 1 --2- 172.21.15.154:0/2362935900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f580a1550 0x7f6f5811edd0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:18.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.373+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2362935900 >> 172.21.15.154:0/2362935900 conn(0x7f6f580a6610 msgr2=0x7f6f58136d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:18.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.373+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2362935900 shutdown_connections 2023-09-30T22:24:18.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:18.373+0000 7f6f5ea55700 1 -- 172.21.15.154:0/2362935900 wait complete. 2023-09-30T22:24:18.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:19.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:19.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:19.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:19.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.362+0000 7f8236879700 1 Processor -- start 2023-09-30T22:24:19.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.362+0000 7f8236879700 1 -- start start 2023-09-30T22:24:19.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f8236879700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230099e20 0x7f823009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f8236879700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 0x7f8230130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f8236879700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8230099a60 con 0x7f8230130890 2023-09-30T22:24:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f8236879700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823009bf50 con 0x7f8230099e20 2023-09-30T22:24:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f8236879700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f823009b230 con 0x7f823009a730 2023-09-30T22:24:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230099e20 0x7f823009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 0x7f8230130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230099e20 0x7f823009a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51758/0 (socket says 172.21.15.154:51758) 2023-09-30T22:24:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822ffff700 1 -- 172.21.15.154:0/3223632228 learned_addr learned my addr 172.21.15.154:0/3223632228 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822ffff700 1 -- 172.21.15.154:0/3223632228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 msgr2=0x7f8230130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822ffff700 1 --2- 172.21.15.154:0/3223632228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 0x7f8230130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822ffff700 1 -- 172.21.15.154:0/3223632228 >> v1:172.21.15.154:6789/0 conn(0x7f8230130890 legacy=0x7f8230137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822effd700 1 -- 172.21.15.154:0/3223632228 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810480607 0 0) 0x7f8230099a60 con 0x7f8230130890 2023-09-30T22:24:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822ffff700 1 -- 172.21.15.154:0/3223632228 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823009bb90 con 0x7f8230099e20 2023-09-30T22:24:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.363+0000 7f822ffff700 1 --2- 172.21.15.154:0/3223632228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230099e20 0x7f823009a1f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f822000b9a0 tx=0x7f822000bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf368cbd4fcd0c51 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.364+0000 7f822effd700 1 -- 172.21.15.154:0/3223632228 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220005e30 con 0x7f8230099e20 2023-09-30T22:24:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.364+0000 7f822effd700 1 -- 172.21.15.154:0/3223632228 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8220004030 con 0x7f8230099e20 2023-09-30T22:24:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.364+0000 7f822effd700 1 -- 172.21.15.154:0/3223632228 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200043e0 con 0x7f8230099e20 2023-09-30T22:24:19.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.365+0000 7f8236879700 1 -- 172.21.15.154:0/3223632228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230099e20 msgr2=0x7f823009a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.365+0000 7f8236879700 1 --2- 172.21.15.154:0/3223632228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230099e20 0x7f823009a1f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f822000b9a0 tx=0x7f822000bcb0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.365+0000 7f8236879700 1 -- 172.21.15.154:0/3223632228 shutdown_connections 2023-09-30T22:24:19.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.365+0000 7f8236879700 1 --2- 172.21.15.154:0/3223632228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230099e20 0x7f823009a1f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.365+0000 7f8236879700 1 --2- 172.21.15.154:0/3223632228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 0x7f8230130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.365+0000 7f8236879700 1 -- 172.21.15.154:0/3223632228 >> 172.21.15.154:0/3223632228 conn(0x7f82300a2980 msgr2=0x7f82300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.365+0000 7f8236879700 1 -- 172.21.15.154:0/3223632228 shutdown_connections 2023-09-30T22:24:19.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.365+0000 7f8236879700 1 -- 172.21.15.154:0/3223632228 wait complete. 2023-09-30T22:24:19.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.366+0000 7f8236879700 1 Processor -- start 2023-09-30T22:24:19.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.366+0000 7f8236879700 1 -- start start 2023-09-30T22:24:19.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f8236879700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8230099e20 0x7f823011a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f8236879700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 0x7f823011ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f8236879700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230130890 0x7f823011b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f8236879700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823011e220 con 0x7f8230099e20 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f8236879700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823011c3b0 con 0x7f8230130890 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f8236879700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82301302f0 con 0x7f823009a730 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f822ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8230099e20 0x7f823011a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f822ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8230099e20 0x7f823011a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53772/0 (socket says 172.21.15.154:53772) 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f822ffff700 1 -- 172.21.15.154:0/3790356247 learned_addr learned my addr 172.21.15.154:0/3790356247 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f8234e16700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230130890 0x7f823011b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.367+0000 7f822f7fe700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 0x7f823011ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f822f7fe700 1 -- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230130890 msgr2=0x7f823011b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f822f7fe700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230130890 0x7f823011b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f822f7fe700 1 -- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8230099e20 msgr2=0x7f823011a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f822f7fe700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8230099e20 0x7f823011a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f822f7fe700 1 -- 172.21.15.154:0/3790356247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822000b5b0 con 0x7f823009a730 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f8234e16700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230130890 0x7f823011b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f822f7fe700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 0x7f823011ac40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8224012be0 tx=0x7f8224012ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f822cff9700 1 -- 172.21.15.154:0/3790356247 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224010870 con 0x7f823009a730 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f822cff9700 1 -- 172.21.15.154:0/3790356247 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224013040 con 0x7f823009a730 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f8236879700 1 -- 172.21.15.154:0/3790356247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823009b470 con 0x7f823009a730 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f822cff9700 1 -- 172.21.15.154:0/3790356247 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224010bd0 con 0x7f823009a730 2023-09-30T22:24:19.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.368+0000 7f8236879700 1 -- 172.21.15.154:0/3790356247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823011d630 con 0x7f823009a730 2023-09-30T22:24:19.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.369+0000 7f822cff9700 1 -- 172.21.15.154:0/3790356247 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8224010d30 con 0x7f823009a730 2023-09-30T22:24:19.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.369+0000 7f822cff9700 1 -- 172.21.15.154:0/3790356247 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82240435c0 con 0x7f823009a730 2023-09-30T22:24:19.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.369+0000 7f8236879700 1 -- 172.21.15.154:0/3790356247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8230072480 con 0x7f823009a730 2023-09-30T22:24:19.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.374+0000 7f822cff9700 1 -- 172.21.15.154:0/3790356247 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8230072480 con 0x7f823009a730 2023-09-30T22:24:19.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:19.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.409+0000 7f74974b6700 1 Processor -- start 2023-09-30T22:24:19.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.409+0000 7f74974b6700 1 -- start start 2023-09-30T22:24:19.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f74974b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 0x7f749009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f74974b6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f74901307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f74974b6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7490130ce0 0x7f7490131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f74974b6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749009aaa0 con 0x7f7490130ce0 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f74974b6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749009f870 con 0x7f749009d860 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f74974b6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f749009b360 con 0x7f749009e170 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f7494a51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f74901307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f7494a51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f74901307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46996/0 (socket says 172.21.15.154:46996) 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f7494a51700 1 -- 172.21.15.154:0/2632360941 learned_addr learned my addr 172.21.15.154:0/2632360941 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f7494a51700 1 -- 172.21.15.154:0/2632360941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 msgr2=0x7f749009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f7494a51700 1 --2- 172.21.15.154:0/2632360941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 0x7f749009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f7494a51700 1 -- 172.21.15.154:0/2632360941 >> v2:172.21.15.154:3300/0 conn(0x7f7490130ce0 msgr2=0x7f7490131150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.410+0000 7f7494a51700 1 --2- 172.21.15.154:0/2632360941 >> v2:172.21.15.154:3300/0 conn(0x7f7490130ce0 0x7f7490131150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.411+0000 7f7494a51700 1 -- 172.21.15.154:0/2632360941 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749009b620 con 0x7f749009e170 2023-09-30T22:24:19.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.411+0000 7f7494a51700 1 --2- 172.21.15.154:0/2632360941 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f74901307a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f748000bb90 tx=0x7f748000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aee5683bf2a995ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.411+0000 7f7487fff700 1 -- 172.21.15.154:0/2632360941 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000dd50 con 0x7f749009e170 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.411+0000 7f7487fff700 1 -- 172.21.15.154:0/2632360941 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7480010470 con 0x7f749009e170 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.411+0000 7f7487fff700 1 -- 172.21.15.154:0/2632360941 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480010800 con 0x7f749009e170 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.412+0000 7f74974b6700 1 -- 172.21.15.154:0/2632360941 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 msgr2=0x7f74901307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.412+0000 7f74974b6700 1 --2- 172.21.15.154:0/2632360941 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f74901307a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f748000bb90 tx=0x7f748000bea0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.412+0000 7f74974b6700 1 -- 172.21.15.154:0/2632360941 shutdown_connections 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.412+0000 7f74974b6700 1 --2- 172.21.15.154:0/2632360941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 0x7f749009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.412+0000 7f74974b6700 1 --2- 172.21.15.154:0/2632360941 >> v2:172.21.15.154:3300/0 conn(0x7f7490130ce0 0x7f7490131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.412+0000 7f74974b6700 1 --2- 172.21.15.154:0/2632360941 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f74901307a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.412+0000 7f74974b6700 1 -- 172.21.15.154:0/2632360941 >> 172.21.15.154:0/2632360941 conn(0x7f7490099c40 msgr2=0x7f74900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.412+0000 7f74974b6700 1 -- 172.21.15.154:0/2632360941 shutdown_connections 2023-09-30T22:24:19.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.412+0000 7f74974b6700 1 -- 172.21.15.154:0/2632360941 wait complete. 2023-09-30T22:24:19.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.413+0000 7f74974b6700 1 Processor -- start 2023-09-30T22:24:19.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.413+0000 7f74974b6700 1 -- start start 2023-09-30T22:24:19.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.413+0000 7f74974b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 0x7f74901225e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.413+0000 7f74974b6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f7490122b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.413+0000 7f74974b6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490130ce0 0x7f7490123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.413+0000 7f74974b6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7490126100 con 0x7f7490130ce0 2023-09-30T22:24:19.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.413+0000 7f74974b6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7490130500 con 0x7f749009d860 2023-09-30T22:24:19.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.413+0000 7f74974b6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74901241f0 con 0x7f749009e170 2023-09-30T22:24:19.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7495252700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 0x7f74901225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7495252700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 0x7f74901225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51792/0 (socket says 172.21.15.154:51792) 2023-09-30T22:24:19.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7495252700 1 -- 172.21.15.154:0/1387848489 learned_addr learned my addr 172.21.15.154:0/1387848489 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:19.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7494a51700 1 --2- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f7490122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7495252700 1 -- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 msgr2=0x7f7490122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7495252700 1 --2- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f7490122b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7495252700 1 -- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490130ce0 msgr2=0x7f7490123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7495252700 1 --2- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490130ce0 0x7f7490123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7495252700 1 -- 172.21.15.154:0/1387848489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748000b7f0 con 0x7f749009d860 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7495252700 1 --2- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 0x7f74901225e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f748c00b530 tx=0x7f748c00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7485ffb700 1 -- 172.21.15.154:0/1387848489 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c011830 con 0x7f749009d860 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7485ffb700 1 -- 172.21.15.154:0/1387848489 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c0119b0 con 0x7f749009d860 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f74974b6700 1 -- 172.21.15.154:0/1387848489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74900a22d0 con 0x7f749009d860 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.414+0000 7f7485ffb700 1 -- 172.21.15.154:0/1387848489 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c011d60 con 0x7f749009d860 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.415+0000 7f74974b6700 1 -- 172.21.15.154:0/1387848489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7490126890 con 0x7f749009d860 2023-09-30T22:24:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.416+0000 7f74974b6700 1 -- 172.21.15.154:0/1387848489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7490125c80 con 0x7f749009d860 2023-09-30T22:24:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.417+0000 7f7485ffb700 1 -- 172.21.15.154:0/1387848489 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f748c01a400 con 0x7f749009d860 2023-09-30T22:24:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.417+0000 7f7485ffb700 1 -- 172.21.15.154:0/1387848489 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f748c03fc20 con 0x7f749009d860 2023-09-30T22:24:19.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.421+0000 7f7485ffb700 1 -- 172.21.15.154:0/1387848489 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f748c022af0 con 0x7f749009d860 2023-09-30T22:24:19.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.485+0000 7fe6ee6a5700 1 Processor -- start 2023-09-30T22:24:19.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.485+0000 7fe6ee6a5700 1 -- start start 2023-09-30T22:24:19.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.485+0000 7fe6ee6a5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe6e806a770 0x7fe6e81349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.485+0000 7fe6ee6a5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e809e070 0x7fe6e813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.485+0000 7fe6ee6a5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e809eca0 con 0x7fe6e8134f00 2023-09-30T22:24:19.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.485+0000 7fe6ee6a5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e806b2e0 con 0x7fe6e806a770 2023-09-30T22:24:19.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.485+0000 7fe6ee6a5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e809f720 con 0x7fe6e809e070 2023-09-30T22:24:19.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe6e8134f00 0x7fe6e809d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47088/0 (socket says 172.21.15.154:47088) 2023-09-30T22:24:19.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe6e806a770 0x7fe6e81349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e77fe700 1 -- 172.21.15.154:0/4200087326 learned_addr learned my addr 172.21.15.154:0/4200087326 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:19.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6ecc42700 1 --2- 172.21.15.154:0/4200087326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e809e070 0x7fe6e813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e7fff700 1 -- 172.21.15.154:0/4200087326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e809e070 msgr2=0x7fe6e813fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e7fff700 1 --2- 172.21.15.154:0/4200087326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e809e070 0x7fe6e813fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e7fff700 1 -- 172.21.15.154:0/4200087326 >> v1:172.21.15.154:6789/0 conn(0x7fe6e8134f00 legacy=0x7fe6e809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e7fff700 1 -- 172.21.15.154:0/4200087326 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e806b480 con 0x7fe6e806a770 2023-09-30T22:24:19.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e6ffd700 1 -- 172.21.15.154:0/4200087326 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049437682 0 0) 0x7fe6e809eca0 con 0x7fe6e8134f00 2023-09-30T22:24:19.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6ecc42700 1 --2- 172.21.15.154:0/4200087326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e809e070 0x7fe6e813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e7fff700 1 --2- 172.21.15.154:0/4200087326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e806a770 0x7fe6e81349c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009840 tx=0x7fe6d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74bdf390f2c1ece server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e6ffd700 1 -- 172.21.15.154:0/4200087326 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8011830 con 0x7fe6e806a770 2023-09-30T22:24:19.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.486+0000 7fe6e6ffd700 1 -- 172.21.15.154:0/4200087326 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d8011990 con 0x7fe6e806a770 2023-09-30T22:24:19.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.487+0000 7fe6e6ffd700 1 -- 172.21.15.154:0/4200087326 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8011d20 con 0x7fe6e806a770 2023-09-30T22:24:19.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.487+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/4200087326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e806a770 msgr2=0x7fe6e81349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.487+0000 7fe6ee6a5700 1 --2- 172.21.15.154:0/4200087326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e806a770 0x7fe6e81349c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009840 tx=0x7fe6d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:19.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.487+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/4200087326 shutdown_connections 2023-09-30T22:24:19.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.487+0000 7fe6ee6a5700 1 --2- 172.21.15.154:0/4200087326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e809e070 0x7fe6e813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.487+0000 7fe6ee6a5700 1 --2- 172.21.15.154:0/4200087326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e806a770 0x7fe6e81349c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.487+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/4200087326 >> 172.21.15.154:0/4200087326 conn(0x7fe6e8099c40 msgr2=0x7fe6e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.487+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/4200087326 shutdown_connections 2023-09-30T22:24:19.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.487+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/4200087326 wait complete. 2023-09-30T22:24:19.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.488+0000 7fe6ee6a5700 1 Processor -- start 2023-09-30T22:24:19.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.488+0000 7fe6ee6a5700 1 -- start start 2023-09-30T22:24:19.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6ee6a5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e806a770 0x7fe6e806f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6ee6a5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e809e070 0x7fe6e806fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6ee6a5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e8134f00 0x7fe6e806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6ee6a5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80727b0 con 0x7fe6e8134f00 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6ee6a5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e809f290 con 0x7fe6e806a770 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6ee6a5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80a0140 con 0x7fe6e809e070 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6e77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e809e070 0x7fe6e806fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6e77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e809e070 0x7fe6e806fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47008/0 (socket says 172.21.15.154:47008) 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6e77fe700 1 -- 172.21.15.154:0/2404796013 learned_addr learned my addr 172.21.15.154:0/2404796013 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6e7fff700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e806a770 0x7fe6e806f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6ecc42700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e8134f00 0x7fe6e806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6e77fe700 1 -- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e806a770 msgr2=0x7fe6e806f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6e77fe700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e806a770 0x7fe6e806f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6e77fe700 1 -- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e8134f00 msgr2=0x7fe6e806ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6e77fe700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e8134f00 0x7fe6e806ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.489+0000 7fe6e77fe700 1 -- 172.21.15.154:0/2404796013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0009a70 con 0x7fe6e809e070 2023-09-30T22:24:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.490+0000 7fe6e7fff700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e806a770 0x7fe6e806f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.490+0000 7fe6ecc42700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e8134f00 0x7fe6e806ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.490+0000 7fe6e77fe700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e809e070 0x7fe6e806fa40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00c520 tx=0x7fe6dc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.490+0000 7fe6e4ff9700 1 -- 172.21.15.154:0/2404796013 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc004c80 con 0x7fe6e809e070 2023-09-30T22:24:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.490+0000 7fe6e4ff9700 1 -- 172.21.15.154:0/2404796013 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc004e00 con 0x7fe6e809e070 2023-09-30T22:24:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.490+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/2404796013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d80094a0 con 0x7fe6e809e070 2023-09-30T22:24:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.490+0000 7fe6e4ff9700 1 -- 172.21.15.154:0/2404796013 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc007310 con 0x7fe6e809e070 2023-09-30T22:24:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.490+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/2404796013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e80723b0 con 0x7fe6e809e070 2023-09-30T22:24:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.491+0000 7fe6e4ff9700 1 -- 172.21.15.154:0/2404796013 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6dc007470 con 0x7fe6e809e070 2023-09-30T22:24:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.491+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/2404796013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e81399a0 con 0x7fe6e809e070 2023-09-30T22:24:19.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.491+0000 7fe6e4ff9700 1 -- 172.21.15.154:0/2404796013 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe6dc03f350 con 0x7fe6e809e070 2023-09-30T22:24:19.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.500+0000 7fe6e4ff9700 1 -- 172.21.15.154:0/2404796013 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6dc0106d0 con 0x7fe6e809e070 2023-09-30T22:24:19.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd085eb4700 1 Processor -- start 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd085eb4700 1 -- start start 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd085eb4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08009e950 0x7fd08009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd085eb4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009f260 0x7fd080131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd085eb4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08009afb0 con 0x7fd080131dd0 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd085eb4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0800a0970 con 0x7fd08009e950 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd085eb4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800a0320 con 0x7fd08009f260 2023-09-30T22:24:19.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd07f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08009e950 0x7fd08009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd07f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08009e950 0x7fd08009ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53810/0 (socket says 172.21.15.154:53810) 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd07f7fe700 1 -- 172.21.15.154:0/4275585061 learned_addr learned my addr 172.21.15.154:0/4275585061 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.527+0000 7fd07effd700 1 --2- 172.21.15.154:0/4275585061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009f260 0x7fd080131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.528+0000 7fd07effd700 1 -- 172.21.15.154:0/4275585061 >> v2:172.21.15.154:3300/0 conn(0x7fd08009e950 msgr2=0x7fd08009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.528+0000 7fd07effd700 1 --2- 172.21.15.154:0/4275585061 >> v2:172.21.15.154:3300/0 conn(0x7fd08009e950 0x7fd08009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.528+0000 7fd07effd700 1 -- 172.21.15.154:0/4275585061 >> v1:172.21.15.154:6789/0 conn(0x7fd080131dd0 legacy=0x7fd080138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.528+0000 7fd07effd700 1 -- 172.21.15.154:0/4275585061 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800a0750 con 0x7fd08009f260 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.528+0000 7fd07effd700 1 --2- 172.21.15.154:0/4275585061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009f260 0x7fd080131890 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd074009840 tx=0x7fd074009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7b4f7cef521fc96 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.528+0000 7fd07e7fc700 1 -- 172.21.15.154:0/4275585061 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074011830 con 0x7fd08009f260 2023-09-30T22:24:19.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.528+0000 7fd07e7fc700 1 -- 172.21.15.154:0/4275585061 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd074011990 con 0x7fd08009f260 2023-09-30T22:24:19.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.528+0000 7fd07e7fc700 1 -- 172.21.15.154:0/4275585061 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074011d20 con 0x7fd08009f260 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.529+0000 7fd085eb4700 1 -- 172.21.15.154:0/4275585061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009f260 msgr2=0x7fd080131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.529+0000 7fd085eb4700 1 --2- 172.21.15.154:0/4275585061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009f260 0x7fd080131890 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd074009840 tx=0x7fd074009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.529+0000 7fd085eb4700 1 -- 172.21.15.154:0/4275585061 shutdown_connections 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.529+0000 7fd085eb4700 1 --2- 172.21.15.154:0/4275585061 >> v2:172.21.15.154:3300/0 conn(0x7fd08009e950 0x7fd08009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.529+0000 7fd085eb4700 1 --2- 172.21.15.154:0/4275585061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009f260 0x7fd080131890 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.529+0000 7fd085eb4700 1 -- 172.21.15.154:0/4275585061 >> 172.21.15.154:0/4275585061 conn(0x7fd0800a0f70 msgr2=0x7fd0800a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.529+0000 7fd085eb4700 1 -- 172.21.15.154:0/4275585061 shutdown_connections 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.529+0000 7fd085eb4700 1 -- 172.21.15.154:0/4275585061 wait complete. 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.530+0000 7fd085eb4700 1 Processor -- start 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.530+0000 7fd085eb4700 1 -- start start 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd085eb4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009e950 0x7fd08011c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd085eb4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08009f260 0x7fd08011cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd085eb4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd080131dd0 0x7fd08011d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd085eb4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08011ff00 con 0x7fd08009f260 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd085eb4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0801200e0 con 0x7fd080131dd0 2023-09-30T22:24:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd085eb4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd080131890 con 0x7fd08009e950 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009e950 0x7fd08011c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009e950 0x7fd08011c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47020/0 (socket says 172.21.15.154:47020) 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd07f7fe700 1 -- 172.21.15.154:0/1160372095 learned_addr learned my addr 172.21.15.154:0/1160372095 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd07ffff700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd080131dd0 0x7fd08011d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.531+0000 7fd07effd700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08009f260 0x7fd08011cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd07effd700 1 -- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009e950 msgr2=0x7fd08011c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd07effd700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009e950 0x7fd08011c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd07effd700 1 -- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd080131dd0 msgr2=0x7fd08011d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd07effd700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd080131dd0 0x7fd08011d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd07effd700 1 -- 172.21.15.154:0/1160372095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740094a0 con 0x7fd08009f260 2023-09-30T22:24:19.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd07f7fe700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009e950 0x7fd08011c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd07effd700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08009f260 0x7fd08011cb40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd074016000 tx=0x7fd074004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd067fff700 1 -- 172.21.15.154:0/1160372095 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740036a0 con 0x7fd08009f260 2023-09-30T22:24:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd067fff700 1 -- 172.21.15.154:0/1160372095 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07401f070 con 0x7fd08009f260 2023-09-30T22:24:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd067fff700 1 -- 172.21.15.154:0/1160372095 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074003a40 con 0x7fd08009f260 2023-09-30T22:24:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd085eb4700 1 -- 172.21.15.154:0/1160372095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08009da40 con 0x7fd08009f260 2023-09-30T22:24:19.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.532+0000 7fd085eb4700 1 -- 172.21.15.154:0/1160372095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08011e2e0 con 0x7fd08009f260 2023-09-30T22:24:19.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.533+0000 7fd085eb4700 1 -- 172.21.15.154:0/1160372095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0801315b0 con 0x7fd08009f260 2023-09-30T22:24:19.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.533+0000 7fd067fff700 1 -- 172.21.15.154:0/1160372095 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd074003ba0 con 0x7fd08009f260 2023-09-30T22:24:19.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.534+0000 7fd067fff700 1 -- 172.21.15.154:0/1160372095 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd074021070 con 0x7fd08009f260 2023-09-30T22:24:19.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.542+0000 7fd067fff700 1 -- 172.21.15.154:0/1160372095 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd074026480 con 0x7fd08009f260 2023-09-30T22:24:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.576+0000 7f8236879700 1 -- 172.21.15.154:0/3790356247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8230072480 con 0x7f823009a730 2023-09-30T22:24:19.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.577+0000 7f822cff9700 1 -- 172.21.15.154:0/3790356247 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8230072480 con 0x7f823009a730 2023-09-30T22:24:19.577 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.579+0000 7f8236879700 1 -- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 msgr2=0x7f823011ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.579+0000 7f8236879700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 0x7f823011ac40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8224012be0 tx=0x7f8224012ef0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.579+0000 7f8236879700 1 -- 172.21.15.154:0/3790356247 shutdown_connections 2023-09-30T22:24:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.579+0000 7f8236879700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8230130890 0x7f823011b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.579+0000 7f8236879700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8230099e20 0x7f823011a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.579+0000 7f8236879700 1 --2- 172.21.15.154:0/3790356247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f823009a730 0x7f823011ac40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.579+0000 7f8236879700 1 -- 172.21.15.154:0/3790356247 >> 172.21.15.154:0/3790356247 conn(0x7f82300a2980 msgr2=0x7f823012d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.579+0000 7f8236879700 1 -- 172.21.15.154:0/3790356247 shutdown_connections 2023-09-30T22:24:19.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.579+0000 7f8236879700 1 -- 172.21.15.154:0/3790356247 wait complete. 2023-09-30T22:24:19.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:19.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.639+0000 7f74974b6700 1 -- 172.21.15.154:0/1387848489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7490125c80 con 0x7f749009d860 2023-09-30T22:24:19.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.640+0000 7f7485ffb700 1 -- 172.21.15.154:0/1387848489 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7490125c80 con 0x7f749009d860 2023-09-30T22:24:19.640 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:19.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.642+0000 7f74974b6700 1 -- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 msgr2=0x7f74901225e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.642+0000 7f74974b6700 1 --2- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 0x7f74901225e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f748c00b530 tx=0x7f748c00b840 comp rx=0 tx=0).stop 2023-09-30T22:24:19.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.642+0000 7f74974b6700 1 -- 172.21.15.154:0/1387848489 shutdown_connections 2023-09-30T22:24:19.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.642+0000 7f74974b6700 1 --2- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7490130ce0 0x7f7490123060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.642+0000 7f74974b6700 1 --2- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f749009d860 0x7f74901225e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.642+0000 7f74974b6700 1 --2- 172.21.15.154:0/1387848489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f749009e170 0x7f7490122b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.642+0000 7f74974b6700 1 -- 172.21.15.154:0/1387848489 >> 172.21.15.154:0/1387848489 conn(0x7f7490099c40 msgr2=0x7f74900709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.642+0000 7f74974b6700 1 -- 172.21.15.154:0/1387848489 shutdown_connections 2023-09-30T22:24:19.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.642+0000 7f74974b6700 1 -- 172.21.15.154:0/1387848489 wait complete. 2023-09-30T22:24:19.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:19.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.697+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/2404796013 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe6e804f2a0 con 0x7fe6e809e070 2023-09-30T22:24:19.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.698+0000 7fe6e4ff9700 1 -- 172.21.15.154:0/2404796013 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe6dc011360 con 0x7fe6e809e070 2023-09-30T22:24:19.698 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:19.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.700+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e809e070 msgr2=0x7fe6e806fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.700+0000 7fe6ee6a5700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e809e070 0x7fe6e806fa40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00c520 tx=0x7fe6dc00c830 comp rx=0 tx=0).stop 2023-09-30T22:24:19.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.700+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/2404796013 shutdown_connections 2023-09-30T22:24:19.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.700+0000 7fe6ee6a5700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6e8134f00 0x7fe6e806ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.700+0000 7fe6ee6a5700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6e806a770 0x7fe6e806f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.700+0000 7fe6ee6a5700 1 --2- 172.21.15.154:0/2404796013 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6e809e070 0x7fe6e806fa40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.700+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/2404796013 >> 172.21.15.154:0/2404796013 conn(0x7fe6e8099c40 msgr2=0x7fe6e809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.700+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/2404796013 shutdown_connections 2023-09-30T22:24:19.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.700+0000 7fe6ee6a5700 1 -- 172.21.15.154:0/2404796013 wait complete. 2023-09-30T22:24:19.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:19.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.744+0000 7fd085eb4700 1 -- 172.21.15.154:0/1160372095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd08004f2a0 con 0x7fd08009f260 2023-09-30T22:24:19.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.744+0000 7fd067fff700 1 -- 172.21.15.154:0/1160372095 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd074015020 con 0x7fd08009f260 2023-09-30T22:24:19.744 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:19.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.746+0000 7fd085eb4700 1 -- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08009f260 msgr2=0x7fd08011cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:19.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.746+0000 7fd085eb4700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08009f260 0x7fd08011cb40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd074016000 tx=0x7fd074004750 comp rx=0 tx=0).stop 2023-09-30T22:24:19.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.746+0000 7fd085eb4700 1 -- 172.21.15.154:0/1160372095 shutdown_connections 2023-09-30T22:24:19.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.746+0000 7fd085eb4700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd080131dd0 0x7fd08011d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.746+0000 7fd085eb4700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd08009e950 0x7fd08011c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.746+0000 7fd085eb4700 1 --2- 172.21.15.154:0/1160372095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08009f260 0x7fd08011cb40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:19.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.746+0000 7fd085eb4700 1 -- 172.21.15.154:0/1160372095 >> 172.21.15.154:0/1160372095 conn(0x7fd0800a0f70 msgr2=0x7fd0801b6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:19.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.746+0000 7fd085eb4700 1 -- 172.21.15.154:0/1160372095 shutdown_connections 2023-09-30T22:24:19.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:19.746+0000 7fd085eb4700 1 -- 172.21.15.154:0/1160372095 wait complete. 2023-09-30T22:24:19.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:20.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:20.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:20.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:20.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.725+0000 7ff430371700 1 Processor -- start 2023-09-30T22:24:20.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.725+0000 7ff430371700 1 -- start start 2023-09-30T22:24:20.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.725+0000 7ff430371700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42812e490 0x7ff42812e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.725+0000 7ff430371700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff42806ae80 0x7ff428139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff430371700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42809e780 con 0x7ff42809da10 2023-09-30T22:24:20.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff430371700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42809f6e0 con 0x7ff42806ae80 2023-09-30T22:24:20.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff430371700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff42809eb00 con 0x7ff42812e490 2023-09-30T22:24:20.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42e10d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42812e490 0x7ff42812e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42e10d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42812e490 0x7ff42812e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47028/0 (socket says 172.21.15.154:47028) 2023-09-30T22:24:20.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42e10d700 1 -- 172.21.15.154:0/3933157782 learned_addr learned my addr 172.21.15.154:0/3933157782 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:20.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42e90e700 1 --2- 172.21.15.154:0/3933157782 >> v2:172.21.15.154:3300/0 conn(0x7ff42806ae80 0x7ff428139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42e10d700 1 -- 172.21.15.154:0/3933157782 >> v2:172.21.15.154:3300/0 conn(0x7ff42806ae80 msgr2=0x7ff428139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42e10d700 1 --2- 172.21.15.154:0/3933157782 >> v2:172.21.15.154:3300/0 conn(0x7ff42806ae80 0x7ff428139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42e10d700 1 -- 172.21.15.154:0/3933157782 >> v1:172.21.15.154:6789/0 conn(0x7ff42809da10 legacy=0x7ff42806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42e10d700 1 -- 172.21.15.154:0/3933157782 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42812eda0 con 0x7ff42812e490 2023-09-30T22:24:20.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42e10d700 1 --2- 172.21.15.154:0/3933157782 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42812e490 0x7ff42812e860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff424009920 tx=0x7ff424009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cc5e2b6943c6c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42d10b700 1 -- 172.21.15.154:0/3933157782 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424011830 con 0x7ff42812e490 2023-09-30T22:24:20.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.726+0000 7ff42d10b700 1 -- 172.21.15.154:0/3933157782 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff424011990 con 0x7ff42812e490 2023-09-30T22:24:20.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.727+0000 7ff42d10b700 1 -- 172.21.15.154:0/3933157782 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424011d20 con 0x7ff42812e490 2023-09-30T22:24:20.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.727+0000 7ff430371700 1 -- 172.21.15.154:0/3933157782 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42812e490 msgr2=0x7ff42812e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.727+0000 7ff430371700 1 --2- 172.21.15.154:0/3933157782 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42812e490 0x7ff42812e860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff424009920 tx=0x7ff424009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:20.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.727+0000 7ff430371700 1 -- 172.21.15.154:0/3933157782 shutdown_connections 2023-09-30T22:24:20.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.727+0000 7ff430371700 1 --2- 172.21.15.154:0/3933157782 >> v2:172.21.15.154:3300/0 conn(0x7ff42806ae80 0x7ff428139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.727+0000 7ff430371700 1 --2- 172.21.15.154:0/3933157782 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42812e490 0x7ff42812e860 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.727+0000 7ff430371700 1 -- 172.21.15.154:0/3933157782 >> 172.21.15.154:0/3933157782 conn(0x7ff428099c40 msgr2=0x7ff4280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.727+0000 7ff430371700 1 -- 172.21.15.154:0/3933157782 shutdown_connections 2023-09-30T22:24:20.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.727+0000 7ff430371700 1 -- 172.21.15.154:0/3933157782 wait complete. 2023-09-30T22:24:20.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.728+0000 7ff430371700 1 Processor -- start 2023-09-30T22:24:20.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.728+0000 7ff430371700 1 -- start start 2023-09-30T22:24:20.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff430371700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff42806ae80 0x7ff42809a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff430371700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42809da10 0x7ff42809a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff430371700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff42812e490 0x7ff42809af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff430371700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428120450 con 0x7ff42806ae80 2023-09-30T22:24:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff430371700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42809b8f0 con 0x7ff42812e490 2023-09-30T22:24:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff430371700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280a1010 con 0x7ff42809da10 2023-09-30T22:24:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff42d90c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42809da10 0x7ff42809a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff42d90c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42809da10 0x7ff42809a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47038/0 (socket says 172.21.15.154:47038) 2023-09-30T22:24:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff42d90c700 1 -- 172.21.15.154:0/1718746530 learned_addr learned my addr 172.21.15.154:0/1718746530 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff42d90c700 1 -- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff42812e490 msgr2=0x7ff42809af10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff42d90c700 1 --2- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff42812e490 0x7ff42809af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.729+0000 7ff42d90c700 1 -- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff42806ae80 msgr2=0x7ff42809a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.730+0000 7ff42d90c700 1 --2- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff42806ae80 0x7ff42809a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.730+0000 7ff42d90c700 1 -- 172.21.15.154:0/1718746530 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424009550 con 0x7ff42809da10 2023-09-30T22:24:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.730+0000 7ff42d90c700 1 --2- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42809da10 0x7ff42809a9d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c480 tx=0x7ff41800c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.730+0000 7ff41effd700 1 -- 172.21.15.154:0/1718746530 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180052d0 con 0x7ff42809da10 2023-09-30T22:24:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.730+0000 7ff41effd700 1 -- 172.21.15.154:0/1718746530 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff418005430 con 0x7ff42809da10 2023-09-30T22:24:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.730+0000 7ff430371700 1 -- 172.21.15.154:0/1718746530 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42811fd60 con 0x7ff42809da10 2023-09-30T22:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.730+0000 7ff41effd700 1 -- 172.21.15.154:0/1718746530 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180038c0 con 0x7ff42809da10 2023-09-30T22:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.730+0000 7ff430371700 1 -- 172.21.15.154:0/1718746530 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42811ec10 con 0x7ff42809da10 2023-09-30T22:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.731+0000 7ff430371700 1 -- 172.21.15.154:0/1718746530 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42804f2a0 con 0x7ff42809da10 2023-09-30T22:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.731+0000 7ff41effd700 1 -- 172.21.15.154:0/1718746530 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff418003a20 con 0x7ff42809da10 2023-09-30T22:24:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.731+0000 7ff41effd700 1 -- 172.21.15.154:0/1718746530 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff41803e8f0 con 0x7ff42809da10 2023-09-30T22:24:20.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.736+0000 7ff41effd700 1 -- 172.21.15.154:0/1718746530 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff418011590 con 0x7ff42809da10 2023-09-30T22:24:20.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:20.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.786+0000 7fb9edd21700 1 Processor -- start 2023-09-30T22:24:20.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.786+0000 7fb9edd21700 1 -- start start 2023-09-30T22:24:20.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.786+0000 7fb9edd21700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 0x7fb9e8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.786+0000 7fb9edd21700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9e809c790 0x7fb9e8139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.786+0000 7fb9edd21700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80a1640 con 0x7fb9e809bc70 2023-09-30T22:24:20.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.786+0000 7fb9edd21700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e806eb30 con 0x7fb9e809c790 2023-09-30T22:24:20.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.786+0000 7fb9edd21700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80a22d0 con 0x7fb9e8131980 2023-09-30T22:24:20.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.787+0000 7fb9e7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9e809c790 0x7fb9e8139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.787+0000 7fb9e7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9e809c790 0x7fb9e8139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53854/0 (socket says 172.21.15.154:53854) 2023-09-30T22:24:20.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.787+0000 7fb9e7fff700 1 -- 172.21.15.154:0/2342909221 learned_addr learned my addr 172.21.15.154:0/2342909221 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:20.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.787+0000 7fb9e77fe700 1 --2- 172.21.15.154:0/2342909221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 0x7fb9e8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.787+0000 7fb9e7fff700 1 -- 172.21.15.154:0/2342909221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 msgr2=0x7fb9e8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.787+0000 7fb9e7fff700 1 --2- 172.21.15.154:0/2342909221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 0x7fb9e8131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.787+0000 7fb9e7fff700 1 -- 172.21.15.154:0/2342909221 >> v1:172.21.15.154:6789/0 conn(0x7fb9e809bc70 legacy=0x7fb9e809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.787+0000 7fb9e7fff700 1 -- 172.21.15.154:0/2342909221 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e8131550 con 0x7fb9e809c790 2023-09-30T22:24:20.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.787+0000 7fb9e7fff700 1 --2- 172.21.15.154:0/2342909221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809c790 0x7fb9e8139710 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009e50 tx=0x7fb9e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f18354aa046934b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.788+0000 7fb9e67fc700 1 -- 172.21.15.154:0/2342909221 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000e070 con 0x7fb9e809c790 2023-09-30T22:24:20.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.788+0000 7fb9e67fc700 1 -- 172.21.15.154:0/2342909221 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e000b910 con 0x7fb9e809c790 2023-09-30T22:24:20.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.788+0000 7fb9e67fc700 1 -- 172.21.15.154:0/2342909221 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000bcc0 con 0x7fb9e809c790 2023-09-30T22:24:20.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.788+0000 7fb9edd21700 1 -- 172.21.15.154:0/2342909221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809c790 msgr2=0x7fb9e8139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.788+0000 7fb9edd21700 1 --2- 172.21.15.154:0/2342909221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809c790 0x7fb9e8139710 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009e50 tx=0x7fb9e000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:20.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.789+0000 7fb9edd21700 1 -- 172.21.15.154:0/2342909221 shutdown_connections 2023-09-30T22:24:20.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.789+0000 7fb9edd21700 1 --2- 172.21.15.154:0/2342909221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809c790 0x7fb9e8139710 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.789+0000 7fb9edd21700 1 --2- 172.21.15.154:0/2342909221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 0x7fb9e8131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.789+0000 7fb9edd21700 1 -- 172.21.15.154:0/2342909221 >> 172.21.15.154:0/2342909221 conn(0x7fb9e80a2980 msgr2=0x7fb9e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.789+0000 7fb9edd21700 1 -- 172.21.15.154:0/2342909221 shutdown_connections 2023-09-30T22:24:20.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.789+0000 7fb9edd21700 1 -- 172.21.15.154:0/2342909221 wait complete. 2023-09-30T22:24:20.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.790+0000 7fb9edd21700 1 Processor -- start 2023-09-30T22:24:20.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.790+0000 7fb9edd21700 1 -- start start 2023-09-30T22:24:20.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9edd21700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809bc70 0x7fb9e8099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9edd21700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9e809c790 0x7fb9e8099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9edd21700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 0x7fb9e809a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9edd21700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8120b80 con 0x7fb9e809bc70 2023-09-30T22:24:20.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9edd21700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8120d70 con 0x7fb9e809c790 2023-09-30T22:24:20.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9edd21700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e809b6a0 con 0x7fb9e8131980 2023-09-30T22:24:20.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9e809c790 0x7fb9e8099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9e809c790 0x7fb9e8099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51850/0 (socket says 172.21.15.154:51850) 2023-09-30T22:24:20.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e6ffd700 1 -- 172.21.15.154:0/3260271147 learned_addr learned my addr 172.21.15.154:0/3260271147 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:20.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e7fff700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 0x7fb9e809a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e77fe700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809bc70 0x7fb9e8099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e6ffd700 1 -- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 msgr2=0x7fb9e809a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e6ffd700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 0x7fb9e809a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e6ffd700 1 -- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809bc70 msgr2=0x7fb9e8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e6ffd700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809bc70 0x7fb9e8099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e6ffd700 1 -- 172.21.15.154:0/3260271147 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0009b30 con 0x7fb9e809c790 2023-09-30T22:24:20.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e77fe700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809bc70 0x7fb9e8099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:20.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.791+0000 7fb9e6ffd700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9e809c790 0x7fb9e8099fa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c510 tx=0x7fb9dc00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.792+0000 7fb9cffff700 1 -- 172.21.15.154:0/3260271147 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0052d0 con 0x7fb9e809c790 2023-09-30T22:24:20.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.792+0000 7fb9cffff700 1 -- 172.21.15.154:0/3260271147 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc005430 con 0x7fb9e809c790 2023-09-30T22:24:20.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.792+0000 7fb9edd21700 1 -- 172.21.15.154:0/3260271147 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e8130d80 con 0x7fb9e809c790 2023-09-30T22:24:20.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.792+0000 7fb9cffff700 1 -- 172.21.15.154:0/3260271147 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0038c0 con 0x7fb9e809c790 2023-09-30T22:24:20.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.792+0000 7fb9edd21700 1 -- 172.21.15.154:0/3260271147 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e8121310 con 0x7fb9e809c790 2023-09-30T22:24:20.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.793+0000 7fb9cffff700 1 -- 172.21.15.154:0/3260271147 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9dc003a20 con 0x7fb9e809c790 2023-09-30T22:24:20.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.793+0000 7fb9cffff700 1 -- 172.21.15.154:0/3260271147 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9dc040b30 con 0x7fb9e809c790 2023-09-30T22:24:20.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.794+0000 7fb9edd21700 1 -- 172.21.15.154:0/3260271147 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e80a1a80 con 0x7fb9e809c790 2023-09-30T22:24:20.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.799+0000 7fb9cffff700 1 -- 172.21.15.154:0/3260271147 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9dc017020 con 0x7fb9e809c790 2023-09-30T22:24:20.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.848+0000 7f777a10b700 1 Processor -- start 2023-09-30T22:24:20.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.848+0000 7f777a10b700 1 -- start start 2023-09-30T22:24:20.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.848+0000 7f777a10b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409e870 0x7f777409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.848+0000 7f777a10b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409f180 0x7f7774131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.848+0000 7f777a10b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777409c970 con 0x7f7774131d70 2023-09-30T22:24:20.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.848+0000 7f777a10b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77740a0920 con 0x7f777409f180 2023-09-30T22:24:20.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.848+0000 7f777a10b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f777409f9c0 con 0x7f777409e870 2023-09-30T22:24:20.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f77737fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409e870 0x7f777409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f7772ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409f180 0x7f7774131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f77737fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409e870 0x7f777409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47066/0 (socket says 172.21.15.154:47066) 2023-09-30T22:24:20.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f7772ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409f180 0x7f7774131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51856/0 (socket says 172.21.15.154:51856) 2023-09-30T22:24:20.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f77737fe700 1 -- 172.21.15.154:0/1999523371 learned_addr learned my addr 172.21.15.154:0/1999523371 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:20.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f7772ffd700 1 -- 172.21.15.154:0/1999523371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409e870 msgr2=0x7f777409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f7772ffd700 1 --2- 172.21.15.154:0/1999523371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409e870 0x7f777409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f7772ffd700 1 -- 172.21.15.154:0/1999523371 >> v1:172.21.15.154:6789/0 conn(0x7f7774131d70 legacy=0x7f7774138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f7772ffd700 1 -- 172.21.15.154:0/1999523371 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777409bab0 con 0x7f777409f180 2023-09-30T22:24:20.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f7772ffd700 1 --2- 172.21.15.154:0/1999523371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409f180 0x7f7774131830 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7768009870 tx=0x7f7768009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360c0141c41dddd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f77727fc700 1 -- 172.21.15.154:0/1999523371 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768011830 con 0x7f777409f180 2023-09-30T22:24:20.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f77727fc700 1 -- 172.21.15.154:0/1999523371 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768011990 con 0x7f777409f180 2023-09-30T22:24:20.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.849+0000 7f77727fc700 1 -- 172.21.15.154:0/1999523371 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768011d20 con 0x7f777409f180 2023-09-30T22:24:20.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.850+0000 7f777a10b700 1 -- 172.21.15.154:0/1999523371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409f180 msgr2=0x7f7774131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.850+0000 7f777a10b700 1 --2- 172.21.15.154:0/1999523371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409f180 0x7f7774131830 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7768009870 tx=0x7f7768009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:20.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.850+0000 7f777a10b700 1 -- 172.21.15.154:0/1999523371 shutdown_connections 2023-09-30T22:24:20.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.850+0000 7f777a10b700 1 --2- 172.21.15.154:0/1999523371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409e870 0x7f777409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.850+0000 7f777a10b700 1 --2- 172.21.15.154:0/1999523371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409f180 0x7f7774131830 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.850+0000 7f777a10b700 1 -- 172.21.15.154:0/1999523371 >> 172.21.15.154:0/1999523371 conn(0x7f77740a4430 msgr2=0x7f77740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.850+0000 7f777a10b700 1 -- 172.21.15.154:0/1999523371 shutdown_connections 2023-09-30T22:24:20.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.850+0000 7f777a10b700 1 -- 172.21.15.154:0/1999523371 wait complete. 2023-09-30T22:24:20.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.851+0000 7f777a10b700 1 Processor -- start 2023-09-30T22:24:20.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.852+0000 7f777a10b700 1 -- start start 2023-09-30T22:24:20.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.852+0000 7f777a10b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409e870 0x7f777406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.852+0000 7f777a10b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409f180 0x7f777406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.852+0000 7f777a10b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7774131d70 0x7f777406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.852+0000 7f777a10b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774125e30 con 0x7f7774131d70 2023-09-30T22:24:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.852+0000 7f777a10b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777409b160 con 0x7f777409e870 2023-09-30T22:24:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.852+0000 7f777a10b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f777409dba0 con 0x7f777409f180 2023-09-30T22:24:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f77737fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409e870 0x7f777406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f77737fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409e870 0x7f777406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51858/0 (socket says 172.21.15.154:51858) 2023-09-30T22:24:20.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f77737fe700 1 -- 172.21.15.154:0/3539693662 learned_addr learned my addr 172.21.15.154:0/3539693662 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:20.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f7772ffd700 1 --2- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409f180 0x7f777406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f7773fff700 1 --2- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7774131d70 0x7f777406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f77737fe700 1 -- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409f180 msgr2=0x7f777406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f77737fe700 1 --2- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409f180 0x7f777406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f77737fe700 1 -- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7774131d70 msgr2=0x7f777406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f77737fe700 1 --2- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7774131d70 0x7f777406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f77737fe700 1 -- 172.21.15.154:0/3539693662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77680094a0 con 0x7f777409e870 2023-09-30T22:24:20.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f77737fe700 1 --2- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409e870 0x7f777406b8b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f776400e8b0 tx=0x7f776400ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f775bfff700 1 -- 172.21.15.154:0/3539693662 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764009600 con 0x7f777409e870 2023-09-30T22:24:20.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f775bfff700 1 -- 172.21.15.154:0/3539693662 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7764013680 con 0x7f777409e870 2023-09-30T22:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f777a10b700 1 -- 172.21.15.154:0/3539693662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77741249f0 con 0x7f777409e870 2023-09-30T22:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f775bfff700 1 -- 172.21.15.154:0/3539693662 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764013a30 con 0x7f777409e870 2023-09-30T22:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.853+0000 7f777a10b700 1 -- 172.21.15.154:0/3539693662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77741268a0 con 0x7f777409e870 2023-09-30T22:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.854+0000 7f777a10b700 1 -- 172.21.15.154:0/3539693662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777404f2a0 con 0x7f777409e870 2023-09-30T22:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.855+0000 7f775bfff700 1 -- 172.21.15.154:0/3539693662 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7764013b90 con 0x7f777409e870 2023-09-30T22:24:20.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.855+0000 7f775bfff700 1 -- 172.21.15.154:0/3539693662 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f776403fd40 con 0x7f777409e870 2023-09-30T22:24:20.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.859+0000 7f775bfff700 1 -- 172.21.15.154:0/3539693662 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77640253d0 con 0x7f777409e870 2023-09-30T22:24:20.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.905+0000 7f0507def700 1 Processor -- start 2023-09-30T22:24:20.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.905+0000 7f0507def700 1 -- start start 2023-09-30T22:24:20.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.906+0000 7f0507def700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f050012d280 0x7f050012d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.906+0000 7f0507def700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0500130ec0 0x7f0500138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.906+0000 7f0507def700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050009ae40 con 0x7f0500130350 2023-09-30T22:24:20.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.906+0000 7f0507def700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050009b9a0 con 0x7f050012d280 2023-09-30T22:24:20.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.906+0000 7f0507def700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f050009bbb0 con 0x7f0500130ec0 2023-09-30T22:24:20.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.906+0000 7f0505b8b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f050012d280 0x7f050012d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.906+0000 7f0505b8b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f050012d280 0x7f050012d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53890/0 (socket says 172.21.15.154:53890) 2023-09-30T22:24:20.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.906+0000 7f050638c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0500130ec0 0x7f0500138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.906+0000 7f0505b8b700 1 -- 172.21.15.154:0/3599557658 learned_addr learned my addr 172.21.15.154:0/3599557658 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:20.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.907+0000 7f0505b8b700 1 -- 172.21.15.154:0/3599557658 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0500130ec0 msgr2=0x7f0500138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:20.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.907+0000 7f0505b8b700 1 --2- 172.21.15.154:0/3599557658 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0500130ec0 0x7f0500138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.907+0000 7f0505b8b700 1 -- 172.21.15.154:0/3599557658 >> v1:172.21.15.154:6789/0 conn(0x7f0500130350 legacy=0x7f05001307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.907+0000 7f0505b8b700 1 -- 172.21.15.154:0/3599557658 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050009b250 con 0x7f050012d280 2023-09-30T22:24:20.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.907+0000 7f0505b8b700 1 --2- 172.21.15.154:0/3599557658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050012d280 0x7f050012d650 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f04fc006fd0 tx=0x7f04fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6de2088e6de3af5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.907+0000 7f0504b89700 1 -- 172.21.15.154:0/3599557658 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc005e30 con 0x7f050012d280 2023-09-30T22:24:20.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.907+0000 7f0504b89700 1 -- 172.21.15.154:0/3599557658 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc004030 con 0x7f050012d280 2023-09-30T22:24:20.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.907+0000 7f0504b89700 1 -- 172.21.15.154:0/3599557658 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0043e0 con 0x7f050012d280 2023-09-30T22:24:20.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.908+0000 7f0507def700 1 -- 172.21.15.154:0/3599557658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050012d280 msgr2=0x7f050012d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.908+0000 7f0507def700 1 --2- 172.21.15.154:0/3599557658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050012d280 0x7f050012d650 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f04fc006fd0 tx=0x7f04fc009bd0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.908+0000 7f0507def700 1 -- 172.21.15.154:0/3599557658 shutdown_connections 2023-09-30T22:24:20.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.908+0000 7f0507def700 1 --2- 172.21.15.154:0/3599557658 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0500130ec0 0x7f0500138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.908+0000 7f0507def700 1 --2- 172.21.15.154:0/3599557658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050012d280 0x7f050012d650 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.908+0000 7f0507def700 1 -- 172.21.15.154:0/3599557658 >> 172.21.15.154:0/3599557658 conn(0x7f05000a2980 msgr2=0x7f05000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.908+0000 7f0507def700 1 -- 172.21.15.154:0/3599557658 shutdown_connections 2023-09-30T22:24:20.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.908+0000 7f0507def700 1 -- 172.21.15.154:0/3599557658 wait complete. 2023-09-30T22:24:20.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0507def700 1 Processor -- start 2023-09-30T22:24:20.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0507def700 1 -- start start 2023-09-30T22:24:20.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0507def700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f050012d280 0x7f050011ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0507def700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0500130350 0x7f050011b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0507def700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0500130ec0 0x7f050011b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:20.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0507def700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050011cfc0 con 0x7f0500130350 2023-09-30T22:24:20.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0507def700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050011c800 con 0x7f0500130ec0 2023-09-30T22:24:20.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0507def700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f050011e320 con 0x7f050012d280 2023-09-30T22:24:20.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0505b8b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f050012d280 0x7f050011ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f050538a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0500130350 0x7f050011b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0505b8b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f050012d280 0x7f050011ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47092/0 (socket says 172.21.15.154:47092) 2023-09-30T22:24:20.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f0505b8b700 1 -- 172.21.15.154:0/1333653232 learned_addr learned my addr 172.21.15.154:0/1333653232 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:20.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.909+0000 7f050538a700 1 --2- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0500130350 0x7f050011b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53906/0 (socket says 172.21.15.154:53906) 2023-09-30T22:24:20.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f050638c700 1 --2- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0500130ec0 0x7f050011b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:20.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f0505b8b700 1 -- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0500130ec0 msgr2=0x7f050011b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f0505b8b700 1 --2- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0500130ec0 0x7f050011b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f0505b8b700 1 -- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0500130350 msgr2=0x7f050011b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f0505b8b700 1 --2- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0500130350 0x7f050011b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f0505b8b700 1 -- 172.21.15.154:0/1333653232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc009500 con 0x7f050012d280 2023-09-30T22:24:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f0505b8b700 1 --2- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f050012d280 0x7f050011ab30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f04fc004000 tx=0x7f04fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f04f67fc700 1 -- 172.21.15.154:0/1333653232 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc01c420 con 0x7f050012d280 2023-09-30T22:24:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f04f67fc700 1 -- 172.21.15.154:0/1333653232 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc01c580 con 0x7f050012d280 2023-09-30T22:24:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f0507def700 1 -- 172.21.15.154:0/1333653232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050011cca0 con 0x7f050012d280 2023-09-30T22:24:20.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f04f67fc700 1 -- 172.21.15.154:0/1333653232 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc01c910 con 0x7f050012d280 2023-09-30T22:24:20.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.910+0000 7f0507def700 1 -- 172.21.15.154:0/1333653232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050011ed90 con 0x7f050012d280 2023-09-30T22:24:20.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.911+0000 7f04f67fc700 1 -- 172.21.15.154:0/1333653232 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04fc01ca70 con 0x7f050012d280 2023-09-30T22:24:20.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.911+0000 7f0507def700 1 -- 172.21.15.154:0/1333653232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050012eb70 con 0x7f050012d280 2023-09-30T22:24:20.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.911+0000 7f04f67fc700 1 -- 172.21.15.154:0/1333653232 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f04fc040450 con 0x7f050012d280 2023-09-30T22:24:20.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.916+0000 7f04f67fc700 1 -- 172.21.15.154:0/1333653232 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04fc01a900 con 0x7f050012d280 2023-09-30T22:24:20.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.940+0000 7ff430371700 1 -- 172.21.15.154:0/1718746530 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff42811ebf0 con 0x7ff42809da10 2023-09-30T22:24:20.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.940+0000 7ff41effd700 1 -- 172.21.15.154:0/1718746530 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff418017030 con 0x7ff42809da10 2023-09-30T22:24:20.941 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:20.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.943+0000 7ff430371700 1 -- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42809da10 msgr2=0x7ff42809a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:20.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.943+0000 7ff430371700 1 --2- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42809da10 0x7ff42809a9d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c480 tx=0x7ff41800c840 comp rx=0 tx=0).stop 2023-09-30T22:24:20.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.943+0000 7ff430371700 1 -- 172.21.15.154:0/1718746530 shutdown_connections 2023-09-30T22:24:20.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.943+0000 7ff430371700 1 --2- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff42812e490 0x7ff42809af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.943+0000 7ff430371700 1 --2- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff42806ae80 0x7ff42809a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.943+0000 7ff430371700 1 --2- 172.21.15.154:0/1718746530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff42809da10 0x7ff42809a9d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:20.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.943+0000 7ff430371700 1 -- 172.21.15.154:0/1718746530 >> 172.21.15.154:0/1718746530 conn(0x7ff428099c40 msgr2=0x7ff42812cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:20.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.943+0000 7ff430371700 1 -- 172.21.15.154:0/1718746530 shutdown_connections 2023-09-30T22:24:20.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:20.943+0000 7ff430371700 1 -- 172.21.15.154:0/1718746530 wait complete. 2023-09-30T22:24:20.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:21.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.014+0000 7fb9edd21700 1 -- 172.21.15.154:0/3260271147 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb9e804f2a0 con 0x7fb9e809c790 2023-09-30T22:24:21.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.014+0000 7fb9cffff700 1 -- 172.21.15.154:0/3260271147 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9dc044060 con 0x7fb9e809c790 2023-09-30T22:24:21.014 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.016+0000 7fb9edd21700 1 -- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9e809c790 msgr2=0x7fb9e8099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.016+0000 7fb9edd21700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9e809c790 0x7fb9e8099fa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c510 tx=0x7fb9dc00c820 comp rx=0 tx=0).stop 2023-09-30T22:24:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.016+0000 7fb9edd21700 1 -- 172.21.15.154:0/3260271147 shutdown_connections 2023-09-30T22:24:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.016+0000 7fb9edd21700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9e8131980 0x7fb9e809a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.016+0000 7fb9edd21700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e809bc70 0x7fb9e8099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.016+0000 7fb9edd21700 1 --2- 172.21.15.154:0/3260271147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9e809c790 0x7fb9e8099fa0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.016+0000 7fb9edd21700 1 -- 172.21.15.154:0/3260271147 >> 172.21.15.154:0/3260271147 conn(0x7fb9e80a2980 msgr2=0x7fb9e809fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.016+0000 7fb9edd21700 1 -- 172.21.15.154:0/3260271147 shutdown_connections 2023-09-30T22:24:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.016+0000 7fb9edd21700 1 -- 172.21.15.154:0/3260271147 wait complete. 2023-09-30T22:24:21.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.066+0000 7f777a10b700 1 -- 172.21.15.154:0/3539693662 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7774131b50 con 0x7f777409e870 2023-09-30T22:24:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.067+0000 7f775bfff700 1 -- 172.21.15.154:0/3539693662 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7764021070 con 0x7f777409e870 2023-09-30T22:24:21.067 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.069+0000 7f777a10b700 1 -- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409e870 msgr2=0x7f777406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.069+0000 7f777a10b700 1 --2- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409e870 0x7f777406b8b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f776400e8b0 tx=0x7f776400ebc0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.069+0000 7f777a10b700 1 -- 172.21.15.154:0/3539693662 shutdown_connections 2023-09-30T22:24:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.069+0000 7f777a10b700 1 --2- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7774131d70 0x7f777406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.069+0000 7f777a10b700 1 --2- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777409e870 0x7f777406b8b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.069+0000 7f777a10b700 1 --2- 172.21.15.154:0/3539693662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f777409f180 0x7f777406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.069+0000 7f777a10b700 1 -- 172.21.15.154:0/3539693662 >> 172.21.15.154:0/3539693662 conn(0x7f77740a4430 msgr2=0x7f777411a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.069+0000 7f777a10b700 1 -- 172.21.15.154:0/3539693662 shutdown_connections 2023-09-30T22:24:21.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.069+0000 7f777a10b700 1 -- 172.21.15.154:0/3539693662 wait complete. 2023-09-30T22:24:21.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:21.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.112+0000 7f0507def700 1 -- 172.21.15.154:0/1333653232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f050011df70 con 0x7f050012d280 2023-09-30T22:24:21.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.112+0000 7f04f67fc700 1 -- 172.21.15.154:0/1333653232 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04fc020070 con 0x7f050012d280 2023-09-30T22:24:21.113 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:21.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.114+0000 7f0507def700 1 -- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f050012d280 msgr2=0x7f050011ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.114+0000 7f0507def700 1 --2- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f050012d280 0x7f050011ab30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f04fc004000 tx=0x7f04fc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.114+0000 7f0507def700 1 -- 172.21.15.154:0/1333653232 shutdown_connections 2023-09-30T22:24:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.114+0000 7f0507def700 1 --2- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0500130ec0 0x7f050011b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.114+0000 7f0507def700 1 --2- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f050012d280 0x7f050011ab30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.114+0000 7f0507def700 1 --2- 172.21.15.154:0/1333653232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0500130350 0x7f050011b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.114+0000 7f0507def700 1 -- 172.21.15.154:0/1333653232 >> 172.21.15.154:0/1333653232 conn(0x7f05000a2980 msgr2=0x7f0500099b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.114+0000 7f0507def700 1 -- 172.21.15.154:0/1333653232 shutdown_connections 2023-09-30T22:24:21.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:21.114+0000 7f0507def700 1 -- 172.21.15.154:0/1333653232 wait complete. 2023-09-30T22:24:21.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:21.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:22.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:22.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:22.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.101+0000 7f976a340700 1 Processor -- start 2023-09-30T22:24:22.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.101+0000 7f976a340700 1 -- start start 2023-09-30T22:24:22.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f976a340700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9764133900 0x7f9764133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f976a340700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9764134210 0x7f97640a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f976a340700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976409a760 con 0x7f97640a0ee0 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f976a340700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97641336e0 con 0x7f9764134210 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f976a340700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976409a080 con 0x7f9764133900 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f9763fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9764133900 0x7f9764133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f9763fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9764133900 0x7f9764133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51870/0 (socket says 172.21.15.154:51870) 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f97637fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9764134210 0x7f97640a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f9763fff700 1 -- 172.21.15.154:0/863669710 learned_addr learned my addr 172.21.15.154:0/863669710 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f9763fff700 1 -- 172.21.15.154:0/863669710 >> v2:172.21.15.154:3300/0 conn(0x7f9764134210 msgr2=0x7f97640a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f9763fff700 1 --2- 172.21.15.154:0/863669710 >> v2:172.21.15.154:3300/0 conn(0x7f9764134210 0x7f97640a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f9763fff700 1 -- 172.21.15.154:0/863669710 >> v1:172.21.15.154:6789/0 conn(0x7f97640a0ee0 legacy=0x7f976413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f9763fff700 1 -- 172.21.15.154:0/863669710 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97640a23e0 con 0x7f9764133900 2023-09-30T22:24:22.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.102+0000 7f97637fe700 1 --2- 172.21.15.154:0/863669710 >> v2:172.21.15.154:3300/0 conn(0x7f9764134210 0x7f97640a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.103+0000 7f9763fff700 1 --2- 172.21.15.154:0/863669710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9764133900 0x7f9764133cd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9754006fd0 tx=0x7f9754009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6d24f44f761da7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.103+0000 7f9762ffd700 1 -- 172.21.15.154:0/863669710 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754005e30 con 0x7f9764133900 2023-09-30T22:24:22.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.103+0000 7f9762ffd700 1 -- 172.21.15.154:0/863669710 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754004030 con 0x7f9764133900 2023-09-30T22:24:22.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.103+0000 7f9762ffd700 1 -- 172.21.15.154:0/863669710 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540043e0 con 0x7f9764133900 2023-09-30T22:24:22.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.103+0000 7f976a340700 1 -- 172.21.15.154:0/863669710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9764133900 msgr2=0x7f9764133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.103+0000 7f976a340700 1 --2- 172.21.15.154:0/863669710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9764133900 0x7f9764133cd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9754006fd0 tx=0x7f9754009bd0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.104+0000 7f976a340700 1 -- 172.21.15.154:0/863669710 shutdown_connections 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.104+0000 7f976a340700 1 --2- 172.21.15.154:0/863669710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9764133900 0x7f9764133cd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.104+0000 7f976a340700 1 --2- 172.21.15.154:0/863669710 >> v2:172.21.15.154:3300/0 conn(0x7f9764134210 0x7f97640a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.104+0000 7f976a340700 1 -- 172.21.15.154:0/863669710 >> 172.21.15.154:0/863669710 conn(0x7f97640a2980 msgr2=0x7f97640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.104+0000 7f976a340700 1 -- 172.21.15.154:0/863669710 shutdown_connections 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.104+0000 7f976a340700 1 -- 172.21.15.154:0/863669710 wait complete. 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f976a340700 1 Processor -- start 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f976a340700 1 -- start start 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f976a340700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97640a0ee0 0x7f976411d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f976a340700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9764133900 0x7f976411dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f976a340700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9764134210 0x7f976411e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f976a340700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976411ec40 con 0x7f9764133900 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f976a340700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97641212b0 con 0x7f97640a0ee0 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f976a340700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9764120660 con 0x7f9764134210 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f97688dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9764134210 0x7f976411e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f97637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9764133900 0x7f976411dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f97688dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9764134210 0x7f976411e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47104/0 (socket says 172.21.15.154:47104) 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.105+0000 7f97637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9764133900 0x7f976411dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53930/0 (socket says 172.21.15.154:53930) 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f97688dd700 1 -- 172.21.15.154:0/1490768153 learned_addr learned my addr 172.21.15.154:0/1490768153 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f9763fff700 1 --2- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97640a0ee0 0x7f976411d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f97637fe700 1 -- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9764134210 msgr2=0x7f976411e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f97637fe700 1 --2- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9764134210 0x7f976411e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f97637fe700 1 -- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97640a0ee0 msgr2=0x7f976411d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f97637fe700 1 --2- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97640a0ee0 0x7f976411d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f97637fe700 1 -- 172.21.15.154:0/1490768153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97580094a0 con 0x7f9764133900 2023-09-30T22:24:22.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f9763fff700 1 --2- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97640a0ee0 0x7f976411d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:22.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f97637fe700 1 --2- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9764133900 0x7f976411dcd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f975800e9b0 tx=0x7f975800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f9760ff9700 1 -- 172.21.15.154:0/1490768153 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800c850 con 0x7f9764133900 2023-09-30T22:24:22.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f9760ff9700 1 -- 172.21.15.154:0/1490768153 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975800c9b0 con 0x7f9764133900 2023-09-30T22:24:22.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f976a340700 1 -- 172.21.15.154:0/1490768153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9754009500 con 0x7f9764133900 2023-09-30T22:24:22.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f9760ff9700 1 -- 172.21.15.154:0/1490768153 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800cd40 con 0x7f9764133900 2023-09-30T22:24:22.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.106+0000 7f976a340700 1 -- 172.21.15.154:0/1490768153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97641201a0 con 0x7f9764133900 2023-09-30T22:24:22.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.107+0000 7f976a340700 1 -- 172.21.15.154:0/1490768153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976404f2a0 con 0x7f9764133900 2023-09-30T22:24:22.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.108+0000 7f9760ff9700 1 -- 172.21.15.154:0/1490768153 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9758013470 con 0x7f9764133900 2023-09-30T22:24:22.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.108+0000 7f9760ff9700 1 -- 172.21.15.154:0/1490768153 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f975803f740 con 0x7f9764133900 2023-09-30T22:24:22.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.113+0000 7f9760ff9700 1 -- 172.21.15.154:0/1490768153 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9758013720 con 0x7f9764133900 2023-09-30T22:24:22.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:22.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.164+0000 7f952929e700 1 Processor -- start 2023-09-30T22:24:22.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.164+0000 7f952929e700 1 -- start start 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f952929e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9524066410 0x7f95241319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f952929e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95241314b0 0x7f9524131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f952929e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f952409bc70 0x7f952409c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f952929e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95240667e0 con 0x7f952409bc70 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f952929e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240a23c0 con 0x7f95241314b0 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f952929e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95240a0f20 con 0x7f9524066410 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f95237fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f952409bc70 0x7f952409c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f95237fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f952409bc70 0x7f952409c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53942/0 (socket says 172.21.15.154:53942) 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f95237fe700 1 -- 172.21.15.154:0/15689844 learned_addr learned my addr 172.21.15.154:0/15689844 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f95227fc700 1 --2- 172.21.15.154:0/15689844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95241314b0 0x7f9524131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f9522ffd700 1 --2- 172.21.15.154:0/15689844 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9524066410 0x7f95241319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f95227fc700 1 -- 172.21.15.154:0/15689844 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9524066410 msgr2=0x7f95241319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f95227fc700 1 --2- 172.21.15.154:0/15689844 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9524066410 0x7f95241319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f95227fc700 1 -- 172.21.15.154:0/15689844 >> v2:172.21.15.154:3300/0 conn(0x7f952409bc70 msgr2=0x7f952409c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f95227fc700 1 --2- 172.21.15.154:0/15689844 >> v2:172.21.15.154:3300/0 conn(0x7f952409bc70 0x7f952409c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.165+0000 7f95227fc700 1 -- 172.21.15.154:0/15689844 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240a16e0 con 0x7f95241314b0 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.166+0000 7f95227fc700 1 --2- 172.21.15.154:0/15689844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95241314b0 0x7f9524131f30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f95180098a0 tx=0x7f9518009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=455dc0b886b96c95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.166+0000 7f9521ffb700 1 -- 172.21.15.154:0/15689844 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011830 con 0x7f95241314b0 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.166+0000 7f9521ffb700 1 -- 172.21.15.154:0/15689844 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518011990 con 0x7f95241314b0 2023-09-30T22:24:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.166+0000 7f9521ffb700 1 -- 172.21.15.154:0/15689844 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011d20 con 0x7f95241314b0 2023-09-30T22:24:22.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.167+0000 7f952929e700 1 -- 172.21.15.154:0/15689844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95241314b0 msgr2=0x7f9524131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.167+0000 7f952929e700 1 --2- 172.21.15.154:0/15689844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95241314b0 0x7f9524131f30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f95180098a0 tx=0x7f9518009bb0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.167+0000 7f952929e700 1 -- 172.21.15.154:0/15689844 shutdown_connections 2023-09-30T22:24:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.167+0000 7f952929e700 1 --2- 172.21.15.154:0/15689844 >> v2:172.21.15.154:3300/0 conn(0x7f952409bc70 0x7f952409c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.167+0000 7f952929e700 1 --2- 172.21.15.154:0/15689844 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9524066410 0x7f95241319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.167+0000 7f952929e700 1 --2- 172.21.15.154:0/15689844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95241314b0 0x7f9524131f30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.167+0000 7f952929e700 1 -- 172.21.15.154:0/15689844 >> 172.21.15.154:0/15689844 conn(0x7f95240a2980 msgr2=0x7f95240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.167+0000 7f952929e700 1 -- 172.21.15.154:0/15689844 shutdown_connections 2023-09-30T22:24:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.167+0000 7f952929e700 1 -- 172.21.15.154:0/15689844 wait complete. 2023-09-30T22:24:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.168+0000 7f952929e700 1 Processor -- start 2023-09-30T22:24:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f952929e700 1 -- start start 2023-09-30T22:24:22.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f952929e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9524066410 0x7f9524132fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f952929e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952409bc70 0x7f95241334f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f952929e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95241314b0 0x7f9524133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f952929e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95241367f0 con 0x7f952409bc70 2023-09-30T22:24:22.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f952929e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952412dbe0 con 0x7f9524066410 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f952929e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95241355c0 con 0x7f95241314b0 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f9522ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9524066410 0x7f9524132fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f9522ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9524066410 0x7f9524132fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51900/0 (socket says 172.21.15.154:51900) 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.169+0000 7f9522ffd700 1 -- 172.21.15.154:0/1879487325 learned_addr learned my addr 172.21.15.154:0/1879487325 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f95237fe700 1 --2- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95241314b0 0x7f9524133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f95227fc700 1 --2- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952409bc70 0x7f95241334f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f95237fe700 1 -- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9524066410 msgr2=0x7f9524132fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f95237fe700 1 --2- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9524066410 0x7f9524132fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f95237fe700 1 -- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952409bc70 msgr2=0x7f95241334f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f95237fe700 1 --2- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952409bc70 0x7f95241334f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f95237fe700 1 -- 172.21.15.154:0/1879487325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180094a0 con 0x7f95241314b0 2023-09-30T22:24:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f95237fe700 1 --2- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95241314b0 0x7f9524133a30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f951c009d90 tx=0x7f951c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f950b7fe700 1 -- 172.21.15.154:0/1879487325 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c003c20 con 0x7f95241314b0 2023-09-30T22:24:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f950b7fe700 1 -- 172.21.15.154:0/1879487325 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c00f040 con 0x7f95241314b0 2023-09-30T22:24:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f952929e700 1 -- 172.21.15.154:0/1879487325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9524135d70 con 0x7f95241314b0 2023-09-30T22:24:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f950b7fe700 1 -- 172.21.15.154:0/1879487325 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c00c880 con 0x7f95241314b0 2023-09-30T22:24:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.170+0000 7f952929e700 1 -- 172.21.15.154:0/1879487325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95241361c0 con 0x7f95241314b0 2023-09-30T22:24:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.171+0000 7f950b7fe700 1 -- 172.21.15.154:0/1879487325 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f951c00c9e0 con 0x7f95241314b0 2023-09-30T22:24:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.172+0000 7f950b7fe700 1 -- 172.21.15.154:0/1879487325 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f951c03f890 con 0x7f95241314b0 2023-09-30T22:24:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.172+0000 7f952929e700 1 -- 172.21.15.154:0/1879487325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952404f2a0 con 0x7f95241314b0 2023-09-30T22:24:22.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.176+0000 7f950b7fe700 1 -- 172.21.15.154:0/1879487325 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f951c00ce70 con 0x7f95241314b0 2023-09-30T22:24:22.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.214+0000 7efd64ce7700 1 Processor -- start 2023-09-30T22:24:22.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.214+0000 7efd64ce7700 1 -- start start 2023-09-30T22:24:22.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd64ce7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd600a09e0 0x7efd600a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd64ce7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd64ce7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd60133f40 0x7efd601343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd64ce7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6009de10 con 0x7efd60133f40 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd64ce7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6009db90 con 0x7efd600a09e0 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd64ce7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd600a2560 con 0x7efd600a12f0 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd5dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd5dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60133a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47128/0 (socket says 172.21.15.154:47128) 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd5dd9b700 1 -- 172.21.15.154:0/3349230371 learned_addr learned my addr 172.21.15.154:0/3349230371 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd5ed9d700 1 --2- 172.21.15.154:0/3349230371 >> v2:172.21.15.154:3300/0 conn(0x7efd60133f40 0x7efd601343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.215+0000 7efd5e59c700 1 --2- 172.21.15.154:0/3349230371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd600a09e0 0x7efd600a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5dd9b700 1 -- 172.21.15.154:0/3349230371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd600a09e0 msgr2=0x7efd600a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5dd9b700 1 --2- 172.21.15.154:0/3349230371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd600a09e0 0x7efd600a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5dd9b700 1 -- 172.21.15.154:0/3349230371 >> v2:172.21.15.154:3300/0 conn(0x7efd60133f40 msgr2=0x7efd601343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5dd9b700 1 --2- 172.21.15.154:0/3349230371 >> v2:172.21.15.154:3300/0 conn(0x7efd60133f40 0x7efd601343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5dd9b700 1 -- 172.21.15.154:0/3349230371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600a1f60 con 0x7efd600a12f0 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5ed9d700 1 --2- 172.21.15.154:0/3349230371 >> v2:172.21.15.154:3300/0 conn(0x7efd60133f40 0x7efd601343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5e59c700 1 --2- 172.21.15.154:0/3349230371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd600a09e0 0x7efd600a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5dd9b700 1 --2- 172.21.15.154:0/3349230371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60133a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd540098f0 tx=0x7efd54009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f729ecc06648c0cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5d59a700 1 -- 172.21.15.154:0/3349230371 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011830 con 0x7efd600a12f0 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5d59a700 1 -- 172.21.15.154:0/3349230371 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54011990 con 0x7efd600a12f0 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.216+0000 7efd5d59a700 1 -- 172.21.15.154:0/3349230371 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011d20 con 0x7efd600a12f0 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.217+0000 7efd64ce7700 1 -- 172.21.15.154:0/3349230371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 msgr2=0x7efd60133a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.217+0000 7efd64ce7700 1 --2- 172.21.15.154:0/3349230371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60133a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd540098f0 tx=0x7efd54009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:22.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.217+0000 7efd64ce7700 1 -- 172.21.15.154:0/3349230371 shutdown_connections 2023-09-30T22:24:22.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.217+0000 7efd64ce7700 1 --2- 172.21.15.154:0/3349230371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd600a09e0 0x7efd600a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.217+0000 7efd64ce7700 1 --2- 172.21.15.154:0/3349230371 >> v2:172.21.15.154:3300/0 conn(0x7efd60133f40 0x7efd601343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.217+0000 7efd64ce7700 1 --2- 172.21.15.154:0/3349230371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60133a00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.217+0000 7efd64ce7700 1 -- 172.21.15.154:0/3349230371 >> 172.21.15.154:0/3349230371 conn(0x7efd600a3000 msgr2=0x7efd600a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.217+0000 7efd64ce7700 1 -- 172.21.15.154:0/3349230371 shutdown_connections 2023-09-30T22:24:22.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.217+0000 7efd64ce7700 1 -- 172.21.15.154:0/3349230371 wait complete. 2023-09-30T22:24:22.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.218+0000 7efd64ce7700 1 Processor -- start 2023-09-30T22:24:22.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.218+0000 7efd64ce7700 1 -- start start 2023-09-30T22:24:22.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.218+0000 7efd64ce7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600a09e0 0x7efd60122830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.218+0000 7efd64ce7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60122d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.218+0000 7efd64ce7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd60133f40 0x7efd601232b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.218+0000 7efd64ce7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd60133370 con 0x7efd600a09e0 2023-09-30T22:24:22.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.218+0000 7efd64ce7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600a4ce0 con 0x7efd60133f40 2023-09-30T22:24:22.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.218+0000 7efd64ce7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd6009cdc0 con 0x7efd600a12f0 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600a09e0 0x7efd60122830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600a09e0 0x7efd60122830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53974/0 (socket says 172.21.15.154:53974) 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5e59c700 1 -- 172.21.15.154:0/1482469811 learned_addr learned my addr 172.21.15.154:0/1482469811 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5dd9b700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60122d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5ed9d700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd60133f40 0x7efd601232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5e59c700 1 -- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 msgr2=0x7efd60122d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5e59c700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60122d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5e59c700 1 -- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd60133f40 msgr2=0x7efd601232b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5e59c700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd60133f40 0x7efd601232b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5e59c700 1 -- 172.21.15.154:0/1482469811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500094a0 con 0x7efd600a09e0 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5ed9d700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd60133f40 0x7efd601232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd5e59c700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600a09e0 0x7efd60122830 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efd5000ebe0 tx=0x7efd5000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd4effd700 1 -- 172.21.15.154:0/1482469811 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50009800 con 0x7efd600a09e0 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd4effd700 1 -- 172.21.15.154:0/1482469811 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5000c910 con 0x7efd600a09e0 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.219+0000 7efd4effd700 1 -- 172.21.15.154:0/1482469811 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5000cc80 con 0x7efd600a09e0 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.220+0000 7efd64ce7700 1 -- 172.21.15.154:0/1482469811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd58009a70 con 0x7efd600a09e0 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.220+0000 7efd64ce7700 1 -- 172.21.15.154:0/1482469811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd54009550 con 0x7efd600a09e0 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.221+0000 7efd64ce7700 1 -- 172.21.15.154:0/1482469811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6004f2a0 con 0x7efd600a09e0 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.221+0000 7efd4effd700 1 -- 172.21.15.154:0/1482469811 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd50004020 con 0x7efd600a09e0 2023-09-30T22:24:22.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.222+0000 7efd4effd700 1 -- 172.21.15.154:0/1482469811 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd500400b0 con 0x7efd600a09e0 2023-09-30T22:24:22.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.226+0000 7efd4effd700 1 -- 172.21.15.154:0/1482469811 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd500042d0 con 0x7efd600a09e0 2023-09-30T22:24:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.302+0000 7fea71796700 1 Processor -- start 2023-09-30T22:24:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.302+0000 7fea71796700 1 -- start start 2023-09-30T22:24:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea71796700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 0x7fea6c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea71796700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea71796700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea6c1304a0 0x7fea6c1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea71796700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6c130e30 con 0x7fea6c1304a0 2023-09-30T22:24:22.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea71796700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0a1e70 con 0x7fea6c0a0a30 2023-09-30T22:24:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea71796700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c09a720 con 0x7fea6c0a1340 2023-09-30T22:24:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea6c1304a0 0x7fea6c1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c12ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47142/0 (socket says 172.21.15.154:47142) 2023-09-30T22:24:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6a7fc700 1 -- 172.21.15.154:0/1383219829 learned_addr learned my addr 172.21.15.154:0/1383219829 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:22.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea6c1304a0 0x7fea6c1308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53990/0 (socket says 172.21.15.154:53990) 2023-09-30T22:24:22.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6b7fe700 1 -- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 msgr2=0x7fea6c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6b7fe700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6b7fe700 1 -- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 msgr2=0x7fea6c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:22.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6affd700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 0x7fea6c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.303+0000 7fea6b7fe700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 0x7fea6c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.304+0000 7fea6b7fe700 1 -- 172.21.15.154:0/1383219829 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c09b300 con 0x7fea6c1304a0 2023-09-30T22:24:22.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.304+0000 7fea6a7fc700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.304+0000 7fea6affd700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 0x7fea6c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:22.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.304+0000 7fea6b7fe700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 0x7fea6c1308f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fea64009d90 tx=0x7fea6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f5675798d5722b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.304+0000 7fea69ffb700 1 -- 172.21.15.154:0/1383219829 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400e070 con 0x7fea6c1304a0 2023-09-30T22:24:22.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.304+0000 7fea69ffb700 1 -- 172.21.15.154:0/1383219829 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6400bb20 con 0x7fea6c1304a0 2023-09-30T22:24:22.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.304+0000 7fea69ffb700 1 -- 172.21.15.154:0/1383219829 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64012430 con 0x7fea6c1304a0 2023-09-30T22:24:22.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.305+0000 7fea71796700 1 -- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 msgr2=0x7fea6c1308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.305+0000 7fea71796700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 0x7fea6c1308f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fea64009d90 tx=0x7fea6400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.305+0000 7fea71796700 1 -- 172.21.15.154:0/1383219829 shutdown_connections 2023-09-30T22:24:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.305+0000 7fea71796700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 0x7fea6c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.305+0000 7fea71796700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 0x7fea6c1308f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.305+0000 7fea71796700 1 --2- 172.21.15.154:0/1383219829 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.305+0000 7fea71796700 1 -- 172.21.15.154:0/1383219829 >> 172.21.15.154:0/1383219829 conn(0x7fea6c0a2980 msgr2=0x7fea6c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.305+0000 7fea71796700 1 -- 172.21.15.154:0/1383219829 shutdown_connections 2023-09-30T22:24:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.305+0000 7fea71796700 1 -- 172.21.15.154:0/1383219829 wait complete. 2023-09-30T22:24:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.306+0000 7fea71796700 1 Processor -- start 2023-09-30T22:24:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea71796700 1 -- start start 2023-09-30T22:24:22.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea71796700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 0x7fea6c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea71796700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea71796700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 0x7fea6c1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:22.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea71796700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c09eec0 con 0x7fea6c1304a0 2023-09-30T22:24:22.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea71796700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c125a60 con 0x7fea6c0a0a30 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea71796700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c1243e0 con 0x7fea6c0a1340 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea6a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea6a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c1c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47152/0 (socket says 172.21.15.154:47152) 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea6a7fc700 1 -- 172.21.15.154:0/4251221463 learned_addr learned my addr 172.21.15.154:0/4251221463 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.307+0000 7fea6b7fe700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 0x7fea6c1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea6affd700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 0x7fea6c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea6b7fe700 1 -- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 msgr2=0x7fea6c1c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea6b7fe700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c1c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea6b7fe700 1 -- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 msgr2=0x7fea6c1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea6b7fe700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 0x7fea6c1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea6b7fe700 1 -- 172.21.15.154:0/4251221463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6000b7f0 con 0x7fea6c1304a0 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea6a7fc700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea6b7fe700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 0x7fea6c1c8aa0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fea64016000 tx=0x7fea64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea537fe700 1 -- 172.21.15.154:0/4251221463 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64004800 con 0x7fea6c1304a0 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea537fe700 1 -- 172.21.15.154:0/4251221463 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64020070 con 0x7fea6c1304a0 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea71796700 1 -- 172.21.15.154:0/4251221463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea64009a70 con 0x7fea6c1304a0 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea537fe700 1 -- 172.21.15.154:0/4251221463 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640276c0 con 0x7fea6c1304a0 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.308+0000 7fea71796700 1 -- 172.21.15.154:0/4251221463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c124620 con 0x7fea6c1304a0 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.309+0000 7fea537fe700 1 -- 172.21.15.154:0/4251221463 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea64012430 con 0x7fea6c1304a0 2023-09-30T22:24:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.309+0000 7fea537fe700 1 -- 172.21.15.154:0/4251221463 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea64022070 con 0x7fea6c1304a0 2023-09-30T22:24:22.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.310+0000 7fea71796700 1 -- 172.21.15.154:0/4251221463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c04f2a0 con 0x7fea6c1304a0 2023-09-30T22:24:22.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.314+0000 7fea537fe700 1 -- 172.21.15.154:0/4251221463 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea64046060 con 0x7fea6c1304a0 2023-09-30T22:24:22.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.318+0000 7f976a340700 1 -- 172.21.15.154:0/1490768153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f976406bce0 con 0x7f9764133900 2023-09-30T22:24:22.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.319+0000 7f9760ff9700 1 -- 172.21.15.154:0/1490768153 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9758021070 con 0x7f9764133900 2023-09-30T22:24:22.319 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:22.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.321+0000 7f976a340700 1 -- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9764133900 msgr2=0x7f976411dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.321+0000 7f976a340700 1 --2- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9764133900 0x7f976411dcd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f975800e9b0 tx=0x7f975800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.321+0000 7f976a340700 1 -- 172.21.15.154:0/1490768153 shutdown_connections 2023-09-30T22:24:22.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.321+0000 7f976a340700 1 --2- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9764134210 0x7f976411e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.321+0000 7f976a340700 1 --2- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97640a0ee0 0x7f976411d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.321+0000 7f976a340700 1 --2- 172.21.15.154:0/1490768153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9764133900 0x7f976411dcd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.321+0000 7f976a340700 1 -- 172.21.15.154:0/1490768153 >> 172.21.15.154:0/1490768153 conn(0x7f97640a2980 msgr2=0x7f97641b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.321+0000 7f976a340700 1 -- 172.21.15.154:0/1490768153 shutdown_connections 2023-09-30T22:24:22.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.321+0000 7f976a340700 1 -- 172.21.15.154:0/1490768153 wait complete. 2023-09-30T22:24:22.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:22.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.423+0000 7efd64ce7700 1 -- 172.21.15.154:0/1482469811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd60126ab0 con 0x7efd600a09e0 2023-09-30T22:24:22.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.424+0000 7efd4effd700 1 -- 172.21.15.154:0/1482469811 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd5001ab50 con 0x7efd600a09e0 2023-09-30T22:24:22.424 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.426+0000 7efd64ce7700 1 -- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600a09e0 msgr2=0x7efd60122830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.426+0000 7efd64ce7700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600a09e0 0x7efd60122830 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efd5000ebe0 tx=0x7efd5000eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.426+0000 7efd64ce7700 1 -- 172.21.15.154:0/1482469811 shutdown_connections 2023-09-30T22:24:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.426+0000 7efd64ce7700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd60133f40 0x7efd601232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.426+0000 7efd64ce7700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600a09e0 0x7efd60122830 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.426+0000 7efd64ce7700 1 --2- 172.21.15.154:0/1482469811 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd600a12f0 0x7efd60122d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.426+0000 7efd64ce7700 1 -- 172.21.15.154:0/1482469811 >> 172.21.15.154:0/1482469811 conn(0x7efd600a3000 msgr2=0x7efd6009ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.426+0000 7efd64ce7700 1 -- 172.21.15.154:0/1482469811 shutdown_connections 2023-09-30T22:24:22.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.426+0000 7efd64ce7700 1 -- 172.21.15.154:0/1482469811 wait complete. 2023-09-30T22:24:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.431+0000 7f952929e700 1 -- 172.21.15.154:0/1879487325 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95240724e0 con 0x7f95241314b0 2023-09-30T22:24:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.431+0000 7f950b7fe700 1 -- 172.21.15.154:0/1879487325 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f951c014e00 con 0x7f95241314b0 2023-09-30T22:24:22.431 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:22.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.433+0000 7f952929e700 1 -- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95241314b0 msgr2=0x7f9524133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.433+0000 7f952929e700 1 --2- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95241314b0 0x7f9524133a30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f951c009d90 tx=0x7f951c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.433+0000 7f952929e700 1 -- 172.21.15.154:0/1879487325 shutdown_connections 2023-09-30T22:24:22.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.433+0000 7f952929e700 1 --2- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95241314b0 0x7f9524133a30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.433+0000 7f952929e700 1 --2- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9524066410 0x7f9524132fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.433+0000 7f952929e700 1 --2- 172.21.15.154:0/1879487325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952409bc70 0x7f95241334f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.433+0000 7f952929e700 1 -- 172.21.15.154:0/1879487325 >> 172.21.15.154:0/1879487325 conn(0x7f95240a2980 msgr2=0x7f952409b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.433+0000 7f952929e700 1 -- 172.21.15.154:0/1879487325 shutdown_connections 2023-09-30T22:24:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.433+0000 7f952929e700 1 -- 172.21.15.154:0/1879487325 wait complete. 2023-09-30T22:24:22.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:22.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:22.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.515+0000 7fea71796700 1 -- 172.21.15.154:0/4251221463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea6c06bce0 con 0x7fea6c1304a0 2023-09-30T22:24:22.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.515+0000 7fea537fe700 1 -- 172.21.15.154:0/4251221463 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea640128c0 con 0x7fea6c1304a0 2023-09-30T22:24:22.516 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.518+0000 7fea71796700 1 -- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 msgr2=0x7fea6c1c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.518+0000 7fea71796700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 0x7fea6c1c8aa0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fea64016000 tx=0x7fea64004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.518+0000 7fea71796700 1 -- 172.21.15.154:0/4251221463 shutdown_connections 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.518+0000 7fea71796700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea6c1304a0 0x7fea6c1c8aa0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.518+0000 7fea71796700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea6c0a0a30 0x7fea6c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.518+0000 7fea71796700 1 --2- 172.21.15.154:0/4251221463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea6c0a1340 0x7fea6c1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.518+0000 7fea71796700 1 -- 172.21.15.154:0/4251221463 >> 172.21.15.154:0/4251221463 conn(0x7fea6c0a2980 msgr2=0x7fea6c09deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:22.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.518+0000 7fea71796700 1 -- 172.21.15.154:0/4251221463 shutdown_connections 2023-09-30T22:24:22.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:22.518+0000 7fea71796700 1 -- 172.21.15.154:0/4251221463 wait complete. 2023-09-30T22:24:22.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:23.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:23.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:23.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.473+0000 7fd642eac700 1 Processor -- start 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.473+0000 7fd642eac700 1 -- start start 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.473+0000 7fd642eac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.473+0000 7fd642eac700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd63c09e450 0x7fd63c138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.473+0000 7fd642eac700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c09c1f0 con 0x7fd63c09d8f0 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.473+0000 7fd642eac700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c06dc20 con 0x7fd63c09e450 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.473+0000 7fd642eac700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c09b1f0 con 0x7fd63c1309f0 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.473+0000 7fd640c48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd641449700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd63c09e450 0x7fd63c138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd640c48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51952/0 (socket says 172.21.15.154:51952) 2023-09-30T22:24:23.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd640c48700 1 -- 172.21.15.154:0/3698988563 learned_addr learned my addr 172.21.15.154:0/3698988563 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:23.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd640c48700 1 -- 172.21.15.154:0/3698988563 >> v2:172.21.15.154:3300/0 conn(0x7fd63c09e450 msgr2=0x7fd63c138760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd640c48700 1 --2- 172.21.15.154:0/3698988563 >> v2:172.21.15.154:3300/0 conn(0x7fd63c09e450 0x7fd63c138760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd640c48700 1 -- 172.21.15.154:0/3698988563 >> v1:172.21.15.154:6789/0 conn(0x7fd63c09d8f0 legacy=0x7fd63c09dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd640c48700 1 -- 172.21.15.154:0/3698988563 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c131300 con 0x7fd63c1309f0 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd640c48700 1 --2- 172.21.15.154:0/3698988563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c130dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd630006fd0 tx=0x7fd630009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c821ffa43fa82f2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd63b7fe700 1 -- 172.21.15.154:0/3698988563 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630005e30 con 0x7fd63c1309f0 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd63b7fe700 1 -- 172.21.15.154:0/3698988563 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd630004030 con 0x7fd63c1309f0 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.474+0000 7fd63b7fe700 1 -- 172.21.15.154:0/3698988563 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6300043e0 con 0x7fd63c1309f0 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.475+0000 7fd642eac700 1 -- 172.21.15.154:0/3698988563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 msgr2=0x7fd63c130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.475+0000 7fd642eac700 1 --2- 172.21.15.154:0/3698988563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c130dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd630006fd0 tx=0x7fd630009bd0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.475+0000 7fd642eac700 1 -- 172.21.15.154:0/3698988563 shutdown_connections 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.475+0000 7fd642eac700 1 --2- 172.21.15.154:0/3698988563 >> v2:172.21.15.154:3300/0 conn(0x7fd63c09e450 0x7fd63c138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.475+0000 7fd642eac700 1 --2- 172.21.15.154:0/3698988563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c130dc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.475+0000 7fd642eac700 1 -- 172.21.15.154:0/3698988563 >> 172.21.15.154:0/3698988563 conn(0x7fd63c0a2b30 msgr2=0x7fd63c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.475+0000 7fd642eac700 1 -- 172.21.15.154:0/3698988563 shutdown_connections 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.475+0000 7fd642eac700 1 -- 172.21.15.154:0/3698988563 wait complete. 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.476+0000 7fd642eac700 1 Processor -- start 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.476+0000 7fd642eac700 1 -- start start 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.476+0000 7fd642eac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c09d8f0 0x7fd63c12b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.476+0000 7fd642eac700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd63c09e450 0x7fd63c12b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.476+0000 7fd642eac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c12be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.476+0000 7fd642eac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c09d350 con 0x7fd63c09d8f0 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.476+0000 7fd642eac700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c09b430 con 0x7fd63c1309f0 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd642eac700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c08b240 con 0x7fd63c09e450 2023-09-30T22:24:23.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd640c48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c09d8f0 0x7fd63c12b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd63bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd63c09e450 0x7fd63c12b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd640c48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c09d8f0 0x7fd63c12b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54008/0 (socket says 172.21.15.154:54008) 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd640c48700 1 -- 172.21.15.154:0/3976437088 learned_addr learned my addr 172.21.15.154:0/3976437088 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd641449700 1 --2- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c12be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd640c48700 1 -- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd63c09e450 msgr2=0x7fd63c12b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd640c48700 1 --2- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd63c09e450 0x7fd63c12b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd640c48700 1 -- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 msgr2=0x7fd63c12be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd640c48700 1 --2- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c12be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd640c48700 1 -- 172.21.15.154:0/3976437088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd630009500 con 0x7fd63c09d8f0 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd63bfff700 1 --2- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd63c09e450 0x7fd63c12b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd640c48700 1 --2- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c09d8f0 0x7fd63c12b3b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd630009c10 tx=0x7fd630004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd6397fa700 1 -- 172.21.15.154:0/3976437088 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63001f070 con 0x7fd63c09d8f0 2023-09-30T22:24:23.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd6397fa700 1 -- 172.21.15.154:0/3976437088 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63000f490 con 0x7fd63c09d8f0 2023-09-30T22:24:23.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd642eac700 1 -- 172.21.15.154:0/3976437088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c08bb60 con 0x7fd63c09d8f0 2023-09-30T22:24:23.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd6397fa700 1 -- 172.21.15.154:0/3976437088 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63000f840 con 0x7fd63c09d8f0 2023-09-30T22:24:23.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.477+0000 7fd642eac700 1 -- 172.21.15.154:0/3976437088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c08c1f0 con 0x7fd63c09d8f0 2023-09-30T22:24:23.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.478+0000 7fd6397fa700 1 -- 172.21.15.154:0/3976437088 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd63000f9a0 con 0x7fd63c09d8f0 2023-09-30T22:24:23.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.478+0000 7fd6397fa700 1 -- 172.21.15.154:0/3976437088 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd6300402d0 con 0x7fd63c09d8f0 2023-09-30T22:24:23.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.479+0000 7fd642eac700 1 -- 172.21.15.154:0/3976437088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c08b9b0 con 0x7fd63c09d8f0 2023-09-30T22:24:23.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.484+0000 7fd6397fa700 1 -- 172.21.15.154:0/3976437088 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd63002a300 con 0x7fd63c09d8f0 2023-09-30T22:24:23.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:23.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.580+0000 7f00e119d700 1 Processor -- start 2023-09-30T22:24:23.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.580+0000 7f00e119d700 1 -- start start 2023-09-30T22:24:23.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00e119d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc138410 0x7f00dc0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00e119d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00dc13dd10 0x7f00dc1400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00e119d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc1379e0 con 0x7f00dc138040 2023-09-30T22:24:23.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00e119d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0a2100 con 0x7f00dc13dd10 2023-09-30T22:24:23.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00e119d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc09b9b0 con 0x7f00dc138410 2023-09-30T22:24:23.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00dad9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f00dc138040 0x7f00dc0a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47174/0 (socket says 172.21.15.154:47174) 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00dad9d700 1 -- 172.21.15.154:0/1564761103 learned_addr learned my addr 172.21.15.154:0/1564761103 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00da59c700 1 --2- 172.21.15.154:0/1564761103 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc138410 0x7f00dc0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00db59e700 1 --2- 172.21.15.154:0/1564761103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00dc13dd10 0x7f00dc1400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00d9d9b700 1 -- 172.21.15.154:0/1564761103 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238627498 0 0) 0x7f00dc1379e0 con 0x7f00dc138040 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00d9d9b700 1 -- 172.21.15.154:0/1564761103 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c40035b0 con 0x7f00dc138040 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00da59c700 1 -- 172.21.15.154:0/1564761103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00dc13dd10 msgr2=0x7f00dc1400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00da59c700 1 --2- 172.21.15.154:0/1564761103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00dc13dd10 0x7f00dc1400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00da59c700 1 -- 172.21.15.154:0/1564761103 >> v1:172.21.15.154:6789/0 conn(0x7f00dc138040 legacy=0x7f00dc0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.581+0000 7f00da59c700 1 -- 172.21.15.154:0/1564761103 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc137c10 con 0x7f00dc138410 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.582+0000 7f00da59c700 1 --2- 172.21.15.154:0/1564761103 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc138410 0x7f00dc0a0ff0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f00d00098a0 tx=0x7f00d0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=252cffdfc5f1fe89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.583+0000 7f00d9d9b700 1 -- 172.21.15.154:0/1564761103 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0011830 con 0x7f00dc138410 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.583+0000 7f00d9d9b700 1 -- 172.21.15.154:0/1564761103 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d0011990 con 0x7f00dc138410 2023-09-30T22:24:23.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.583+0000 7f00d9d9b700 1 -- 172.21.15.154:0/1564761103 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0011d00 con 0x7f00dc138410 2023-09-30T22:24:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.584+0000 7f00e119d700 1 -- 172.21.15.154:0/1564761103 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc138410 msgr2=0x7f00dc0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.584+0000 7f00e119d700 1 --2- 172.21.15.154:0/1564761103 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc138410 0x7f00dc0a0ff0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f00d00098a0 tx=0x7f00d0009bb0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.584+0000 7f00e119d700 1 -- 172.21.15.154:0/1564761103 shutdown_connections 2023-09-30T22:24:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.584+0000 7f00e119d700 1 --2- 172.21.15.154:0/1564761103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00dc13dd10 0x7f00dc1400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.584+0000 7f00e119d700 1 --2- 172.21.15.154:0/1564761103 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc138410 0x7f00dc0a0ff0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.584+0000 7f00e119d700 1 -- 172.21.15.154:0/1564761103 >> 172.21.15.154:0/1564761103 conn(0x7f00dc0a2980 msgr2=0x7f00dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.584+0000 7f00e119d700 1 -- 172.21.15.154:0/1564761103 shutdown_connections 2023-09-30T22:24:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.584+0000 7f00e119d700 1 -- 172.21.15.154:0/1564761103 wait complete. 2023-09-30T22:24:23.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.585+0000 7f00e119d700 1 Processor -- start 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.585+0000 7f00e119d700 1 -- start start 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.586+0000 7f00e119d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00dc138040 0x7f00dc121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.586+0000 7f00e119d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00dc138410 0x7f00dc121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.586+0000 7f00e119d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc13dd10 0x7f00dc122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.586+0000 7f00e119d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1241d0 con 0x7f00dc138040 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.586+0000 7f00e119d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc09a240 con 0x7f00dc138410 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.586+0000 7f00e119d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc09edc0 con 0x7f00dc13dd10 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.586+0000 7f00dad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00dc138040 0x7f00dc121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.586+0000 7f00dad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00dc138040 0x7f00dc121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54024/0 (socket says 172.21.15.154:54024) 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.586+0000 7f00dad9d700 1 -- 172.21.15.154:0/1840261728 learned_addr learned my addr 172.21.15.154:0/1840261728 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00dad9d700 1 -- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc13dd10 msgr2=0x7f00dc122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00dad9d700 1 --2- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc13dd10 0x7f00dc122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00dad9d700 1 -- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00dc138410 msgr2=0x7f00dc121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00dad9d700 1 --2- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00dc138410 0x7f00dc121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00dad9d700 1 -- 172.21.15.154:0/1840261728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00094a0 con 0x7f00dc138040 2023-09-30T22:24:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00dad9d700 1 --2- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00dc138040 0x7f00dc121600 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f00cc001260 tx=0x7f00cc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00c37fe700 1 -- 172.21.15.154:0/1840261728 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0074e0 con 0x7f00dc138040 2023-09-30T22:24:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00c37fe700 1 -- 172.21.15.154:0/1840261728 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc007640 con 0x7f00dc138040 2023-09-30T22:24:23.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00e119d700 1 -- 172.21.15.154:0/1840261728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc122ef0 con 0x7f00dc138040 2023-09-30T22:24:23.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00e119d700 1 -- 172.21.15.154:0/1840261728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc1236b0 con 0x7f00dc138040 2023-09-30T22:24:23.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.587+0000 7f00c37fe700 1 -- 172.21.15.154:0/1840261728 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc005a50 con 0x7f00dc138040 2023-09-30T22:24:23.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.588+0000 7f00c37fe700 1 -- 172.21.15.154:0/1840261728 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00cc005bb0 con 0x7f00dc138040 2023-09-30T22:24:23.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.588+0000 7f00c37fe700 1 -- 172.21.15.154:0/1840261728 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00cc03eb40 con 0x7f00dc138040 2023-09-30T22:24:23.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.588+0000 7f00e119d700 1 -- 172.21.15.154:0/1840261728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00bc0052e0 con 0x7f00dc138040 2023-09-30T22:24:23.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.593+0000 7f00c37fe700 1 -- 172.21.15.154:0/1840261728 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00cc017080 con 0x7f00dc138040 2023-09-30T22:24:23.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.608+0000 7f82bbe34700 1 Processor -- start 2023-09-30T22:24:23.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.608+0000 7f82bbe34700 1 -- start start 2023-09-30T22:24:23.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.608+0000 7f82bbe34700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4133900 0x7f82b4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.608+0000 7f82bbe34700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4134210 0x7f82b40a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.608+0000 7f82bbe34700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82b40a0ee0 0x7f82b40a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.608+0000 7f82bbe34700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b409a760 con 0x7f82b40a0ee0 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.608+0000 7f82bbe34700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b41336e0 con 0x7f82b4134210 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.608+0000 7f82bbe34700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82b409a080 con 0x7f82b4133900 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82ba3d1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82b40a0ee0 0x7f82b40a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82b93cf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4134210 0x7f82b40a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82ba3d1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82b40a0ee0 0x7f82b40a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54038/0 (socket says 172.21.15.154:54038) 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82ba3d1700 1 -- 172.21.15.154:0/3113994030 learned_addr learned my addr 172.21.15.154:0/3113994030 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:23.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82b9bd0700 1 --2- 172.21.15.154:0/3113994030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4133900 0x7f82b4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82b93cf700 1 -- 172.21.15.154:0/3113994030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4133900 msgr2=0x7f82b4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82b93cf700 1 --2- 172.21.15.154:0/3113994030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4133900 0x7f82b4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82b93cf700 1 -- 172.21.15.154:0/3113994030 >> v2:172.21.15.154:3300/0 conn(0x7f82b40a0ee0 msgr2=0x7f82b40a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82b93cf700 1 --2- 172.21.15.154:0/3113994030 >> v2:172.21.15.154:3300/0 conn(0x7f82b40a0ee0 0x7f82b40a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82b93cf700 1 -- 172.21.15.154:0/3113994030 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40a23e0 con 0x7f82b4134210 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82ba3d1700 1 --2- 172.21.15.154:0/3113994030 >> v2:172.21.15.154:3300/0 conn(0x7f82b40a0ee0 0x7f82b40a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82b9bd0700 1 --2- 172.21.15.154:0/3113994030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4133900 0x7f82b4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.609+0000 7f82b93cf700 1 --2- 172.21.15.154:0/3113994030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4134210 0x7f82b40a09a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009840 tx=0x7f82a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a938e497076e136b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82b8bce700 1 -- 172.21.15.154:0/3113994030 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4011830 con 0x7f82b4134210 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82b8bce700 1 -- 172.21.15.154:0/3113994030 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a4011990 con 0x7f82b4134210 2023-09-30T22:24:23.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82b8bce700 1 -- 172.21.15.154:0/3113994030 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4011d20 con 0x7f82b4134210 2023-09-30T22:24:23.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82bbe34700 1 -- 172.21.15.154:0/3113994030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4134210 msgr2=0x7f82b40a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82bbe34700 1 --2- 172.21.15.154:0/3113994030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4134210 0x7f82b40a09a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009840 tx=0x7f82a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:23.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82bbe34700 1 -- 172.21.15.154:0/3113994030 shutdown_connections 2023-09-30T22:24:23.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82bbe34700 1 --2- 172.21.15.154:0/3113994030 >> v2:172.21.15.154:3300/0 conn(0x7f82b40a0ee0 0x7f82b40a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82bbe34700 1 --2- 172.21.15.154:0/3113994030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4133900 0x7f82b4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82bbe34700 1 --2- 172.21.15.154:0/3113994030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4134210 0x7f82b40a09a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82bbe34700 1 -- 172.21.15.154:0/3113994030 >> 172.21.15.154:0/3113994030 conn(0x7f82b40a2980 msgr2=0x7f82b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82bbe34700 1 -- 172.21.15.154:0/3113994030 shutdown_connections 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.610+0000 7f82bbe34700 1 -- 172.21.15.154:0/3113994030 wait complete. 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.611+0000 7f82bbe34700 1 Processor -- start 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.611+0000 7f82bbe34700 1 -- start start 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82bbe34700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82b40a0ee0 0x7f82b411d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82bbe34700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4133900 0x7f82b411dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82bbe34700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4134210 0x7f82b411e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82bbe34700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4121b40 con 0x7f82b40a0ee0 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82bbe34700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b409a2c0 con 0x7f82b4133900 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82bbe34700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82b411f330 con 0x7f82b4134210 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82b93cf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4133900 0x7f82b411dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82b93cf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4133900 0x7f82b411dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51990/0 (socket says 172.21.15.154:51990) 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82b93cf700 1 -- 172.21.15.154:0/658670583 learned_addr learned my addr 172.21.15.154:0/658670583 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82b9bd0700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82b40a0ee0 0x7f82b411d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82ba3d1700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4134210 0x7f82b411e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82b93cf700 1 -- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4134210 msgr2=0x7f82b411e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82b93cf700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4134210 0x7f82b411e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82b93cf700 1 -- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82b40a0ee0 msgr2=0x7f82b411d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82b93cf700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82b40a0ee0 0x7f82b411d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82b93cf700 1 -- 172.21.15.154:0/658670583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac009b30 con 0x7f82b4133900 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.612+0000 7f82ba3d1700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4134210 0x7f82b411e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.613+0000 7f82b93cf700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4133900 0x7f82b411dc10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f82a40090b0 tx=0x7f82a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.613+0000 7f82aa7fc700 1 -- 172.21.15.154:0/658670583 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4004590 con 0x7f82b4133900 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.613+0000 7f82aa7fc700 1 -- 172.21.15.154:0/658670583 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a40036a0 con 0x7f82b4133900 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.613+0000 7f82bbe34700 1 -- 172.21.15.154:0/658670583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a40094a0 con 0x7f82b4133900 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.613+0000 7f82aa7fc700 1 -- 172.21.15.154:0/658670583 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4003a50 con 0x7f82b4133900 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.613+0000 7f82bbe34700 1 -- 172.21.15.154:0/658670583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b40a2f20 con 0x7f82b4133900 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.614+0000 7f82aa7fc700 1 -- 172.21.15.154:0/658670583 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82a4003bb0 con 0x7f82b4133900 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.614+0000 7f82bbe34700 1 -- 172.21.15.154:0/658670583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b411a590 con 0x7f82b4133900 2023-09-30T22:24:23.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.614+0000 7f82aa7fc700 1 -- 172.21.15.154:0/658670583 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82a4040a60 con 0x7f82b4133900 2023-09-30T22:24:23.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.623+0000 7f82aa7fc700 1 -- 172.21.15.154:0/658670583 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82a4015020 con 0x7f82b4133900 2023-09-30T22:24:23.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.668+0000 7f7bd93bf700 1 Processor -- start 2023-09-30T22:24:23.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.668+0000 7f7bd93bf700 1 -- start start 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd93bf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a0a70 0x7f7bd40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd93bf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7bd40a1380 0x7f7bd4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd93bf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd409dc00 con 0x7f7bd4133f50 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd93bf700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd409ea60 con 0x7f7bd40a1380 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd93bf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd409dec0 con 0x7f7bd40a0a70 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a0a70 0x7f7bd40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd27fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7bd40a1380 0x7f7bd4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a0a70 0x7f7bd40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47212/0 (socket says 172.21.15.154:47212) 2023-09-30T22:24:23.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd27fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7bd40a1380 0x7f7bd4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54060/0 (socket says 172.21.15.154:54060) 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd2ffd700 1 -- 172.21.15.154:0/3179324223 learned_addr learned my addr 172.21.15.154:0/3179324223 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.669+0000 7f7bd27fc700 1 -- 172.21.15.154:0/3179324223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a0a70 msgr2=0x7f7bd40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.670+0000 7f7bd27fc700 1 --2- 172.21.15.154:0/3179324223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a0a70 0x7f7bd40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.670+0000 7f7bd27fc700 1 -- 172.21.15.154:0/3179324223 >> v1:172.21.15.154:6789/0 conn(0x7f7bd4133f50 legacy=0x7f7bd413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.670+0000 7f7bd27fc700 1 -- 172.21.15.154:0/3179324223 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd409e6a0 con 0x7f7bd40a1380 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.670+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/3179324223 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579851342 0 0) 0x7f7bd409dc00 con 0x7f7bd4133f50 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.670+0000 7f7bd2ffd700 1 --2- 172.21.15.154:0/3179324223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a0a70 0x7f7bd40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.670+0000 7f7bd27fc700 1 --2- 172.21.15.154:0/3179324223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd40a1380 0x7f7bd4133a10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009840 tx=0x7f7bc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393c622371ad46c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.670+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/3179324223 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8011830 con 0x7f7bd40a1380 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.670+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/3179324223 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc8011990 con 0x7f7bd40a1380 2023-09-30T22:24:23.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.670+0000 7f7bd1ffb700 1 -- 172.21.15.154:0/3179324223 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8011d20 con 0x7f7bd40a1380 2023-09-30T22:24:23.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.671+0000 7f7bd93bf700 1 -- 172.21.15.154:0/3179324223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd40a1380 msgr2=0x7f7bd4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.671+0000 7f7bd93bf700 1 --2- 172.21.15.154:0/3179324223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd40a1380 0x7f7bd4133a10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009840 tx=0x7f7bc8009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:23.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.671+0000 7f7bd93bf700 1 -- 172.21.15.154:0/3179324223 shutdown_connections 2023-09-30T22:24:23.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.671+0000 7f7bd93bf700 1 --2- 172.21.15.154:0/3179324223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a0a70 0x7f7bd40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.671+0000 7f7bd93bf700 1 --2- 172.21.15.154:0/3179324223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd40a1380 0x7f7bd4133a10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.671+0000 7f7bd93bf700 1 -- 172.21.15.154:0/3179324223 >> 172.21.15.154:0/3179324223 conn(0x7f7bd40a6610 msgr2=0x7f7bd40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.671+0000 7f7bd93bf700 1 -- 172.21.15.154:0/3179324223 shutdown_connections 2023-09-30T22:24:23.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.671+0000 7f7bd93bf700 1 -- 172.21.15.154:0/3179324223 wait complete. 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.672+0000 7f7bd93bf700 1 Processor -- start 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.672+0000 7f7bd93bf700 1 -- start start 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd93bf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bd40a0a70 0x7f7bd4122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd93bf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a1380 0x7f7bd4122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd93bf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd4133f50 0x7f7bd4123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd93bf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd4126220 con 0x7f7bd4133f50 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd93bf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd4133960 con 0x7f7bd40a0a70 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd93bf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd4133420 con 0x7f7bd40a1380 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bd40a0a70 0x7f7bd4122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bd40a0a70 0x7f7bd4122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52002/0 (socket says 172.21.15.154:52002) 2023-09-30T22:24:23.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd2ffd700 1 -- 172.21.15.154:0/700800050 learned_addr learned my addr 172.21.15.154:0/700800050 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.673+0000 7f7bd27fc700 1 --2- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a1380 0x7f7bd4122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bd37fe700 1 --2- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd4133f50 0x7f7bd4123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bd27fc700 1 -- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bd40a0a70 msgr2=0x7f7bd4122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bd27fc700 1 --2- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bd40a0a70 0x7f7bd4122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bd27fc700 1 -- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd4133f50 msgr2=0x7f7bd4123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bd27fc700 1 --2- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd4133f50 0x7f7bd4123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bd27fc700 1 -- 172.21.15.154:0/700800050 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4009550 con 0x7f7bd40a1380 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bd27fc700 1 --2- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a1380 0x7f7bd4122e40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40a0370 tx=0x7f7bc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bbb7fe700 1 -- 172.21.15.154:0/700800050 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80036a0 con 0x7f7bd40a1380 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bbb7fe700 1 -- 172.21.15.154:0/700800050 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc801f070 con 0x7f7bd40a1380 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bbb7fe700 1 -- 172.21.15.154:0/700800050 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8003a20 con 0x7f7bd40a1380 2023-09-30T22:24:23.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bd93bf700 1 -- 172.21.15.154:0/700800050 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc80094a0 con 0x7f7bd40a1380 2023-09-30T22:24:23.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.674+0000 7f7bd93bf700 1 -- 172.21.15.154:0/700800050 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd4126bb0 con 0x7f7bd40a1380 2023-09-30T22:24:23.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.675+0000 7f7bbb7fe700 1 -- 172.21.15.154:0/700800050 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bc8003b80 con 0x7f7bd40a1380 2023-09-30T22:24:23.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.675+0000 7f7bd93bf700 1 -- 172.21.15.154:0/700800050 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd404f2a0 con 0x7f7bd40a1380 2023-09-30T22:24:23.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.676+0000 7f7bbb7fe700 1 -- 172.21.15.154:0/700800050 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7bc8021070 con 0x7f7bd40a1380 2023-09-30T22:24:23.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.684+0000 7f7bbb7fe700 1 -- 172.21.15.154:0/700800050 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bc802f3a0 con 0x7f7bd40a1380 2023-09-30T22:24:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.692+0000 7fd642eac700 1 -- 172.21.15.154:0/3976437088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd63c098ef0 con 0x7fd63c09d8f0 2023-09-30T22:24:23.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.696+0000 7fd6397fa700 1 -- 172.21.15.154:0/3976437088 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd630028020 con 0x7fd63c09d8f0 2023-09-30T22:24:23.695 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.698+0000 7fd642eac700 1 -- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c09d8f0 msgr2=0x7fd63c12b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.698+0000 7fd642eac700 1 --2- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c09d8f0 0x7fd63c12b3b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd630009c10 tx=0x7fd630004750 comp rx=0 tx=0).stop 2023-09-30T22:24:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.699+0000 7fd642eac700 1 -- 172.21.15.154:0/3976437088 shutdown_connections 2023-09-30T22:24:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.699+0000 7fd642eac700 1 --2- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c1309f0 0x7fd63c12be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.699+0000 7fd642eac700 1 --2- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c09d8f0 0x7fd63c12b3b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.699+0000 7fd642eac700 1 --2- 172.21.15.154:0/3976437088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd63c09e450 0x7fd63c12b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.699+0000 7fd642eac700 1 -- 172.21.15.154:0/3976437088 >> 172.21.15.154:0/3976437088 conn(0x7fd63c0a2b30 msgr2=0x7fd63c0987e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.700+0000 7fd642eac700 1 -- 172.21.15.154:0/3976437088 shutdown_connections 2023-09-30T22:24:23.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.700+0000 7fd642eac700 1 -- 172.21.15.154:0/3976437088 wait complete. 2023-09-30T22:24:23.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:23.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.790+0000 7f00e119d700 1 -- 172.21.15.154:0/1840261728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00bc005590 con 0x7f00dc138040 2023-09-30T22:24:23.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.790+0000 7f00c37fe700 1 -- 172.21.15.154:0/1840261728 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00cc007e60 con 0x7f00dc138040 2023-09-30T22:24:23.791 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:23.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.792+0000 7f00e119d700 1 -- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00dc138040 msgr2=0x7f00dc121600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.792+0000 7f00e119d700 1 --2- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00dc138040 0x7f00dc121600 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f00cc001260 tx=0x7f00cc00c860 comp rx=0 tx=0).stop 2023-09-30T22:24:23.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.792+0000 7f00e119d700 1 -- 172.21.15.154:0/1840261728 shutdown_connections 2023-09-30T22:24:23.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.792+0000 7f00e119d700 1 --2- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00dc13dd10 0x7f00dc122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.792+0000 7f00e119d700 1 --2- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00dc138040 0x7f00dc121600 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.792+0000 7f00e119d700 1 --2- 172.21.15.154:0/1840261728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00dc138410 0x7f00dc121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.792+0000 7f00e119d700 1 -- 172.21.15.154:0/1840261728 >> 172.21.15.154:0/1840261728 conn(0x7f00dc0a2980 msgr2=0x7f00dc09d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.792+0000 7f00e119d700 1 -- 172.21.15.154:0/1840261728 shutdown_connections 2023-09-30T22:24:23.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.792+0000 7f00e119d700 1 -- 172.21.15.154:0/1840261728 wait complete. 2023-09-30T22:24:23.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:23.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.841+0000 7f82bbe34700 1 -- 172.21.15.154:0/658670583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f82b4120540 con 0x7f82b4133900 2023-09-30T22:24:23.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.842+0000 7f82aa7fc700 1 -- 172.21.15.154:0/658670583 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82a402e970 con 0x7f82b4133900 2023-09-30T22:24:23.842 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:23.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.843+0000 7f82bbe34700 1 -- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4133900 msgr2=0x7f82b411dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.843+0000 7f82bbe34700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4133900 0x7f82b411dc10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f82a40090b0 tx=0x7f82a4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:23.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.844+0000 7f82bbe34700 1 -- 172.21.15.154:0/658670583 shutdown_connections 2023-09-30T22:24:23.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.844+0000 7f82bbe34700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82b4134210 0x7f82b411e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.844+0000 7f82bbe34700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82b40a0ee0 0x7f82b411d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.844+0000 7f82bbe34700 1 --2- 172.21.15.154:0/658670583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82b4133900 0x7f82b411dc10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.844+0000 7f82bbe34700 1 -- 172.21.15.154:0/658670583 >> 172.21.15.154:0/658670583 conn(0x7f82b40a2980 msgr2=0x7f82b41bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.844+0000 7f82bbe34700 1 -- 172.21.15.154:0/658670583 shutdown_connections 2023-09-30T22:24:23.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.844+0000 7f82bbe34700 1 -- 172.21.15.154:0/658670583 wait complete. 2023-09-30T22:24:23.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:23.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.885+0000 7f7bd93bf700 1 -- 172.21.15.154:0/700800050 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7bd4072980 con 0x7f7bd40a1380 2023-09-30T22:24:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.885+0000 7f7bbb7fe700 1 -- 172.21.15.154:0/700800050 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bc802b070 con 0x7f7bd40a1380 2023-09-30T22:24:23.885 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.887+0000 7f7bd93bf700 1 -- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a1380 msgr2=0x7f7bd4122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:23.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.887+0000 7f7bd93bf700 1 --2- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a1380 0x7f7bd4122e40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40a0370 tx=0x7f7bc8004750 comp rx=0 tx=0).stop 2023-09-30T22:24:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.887+0000 7f7bd93bf700 1 -- 172.21.15.154:0/700800050 shutdown_connections 2023-09-30T22:24:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.887+0000 7f7bd93bf700 1 --2- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bd4133f50 0x7f7bd4123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.887+0000 7f7bd93bf700 1 --2- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bd40a0a70 0x7f7bd4122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.887+0000 7f7bd93bf700 1 --2- 172.21.15.154:0/700800050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bd40a1380 0x7f7bd4122e40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.887+0000 7f7bd93bf700 1 -- 172.21.15.154:0/700800050 >> 172.21.15.154:0/700800050 conn(0x7f7bd40a6610 msgr2=0x7f7bd40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.887+0000 7f7bd93bf700 1 -- 172.21.15.154:0/700800050 shutdown_connections 2023-09-30T22:24:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:23.887+0000 7f7bd93bf700 1 -- 172.21.15.154:0/700800050 wait complete. 2023-09-30T22:24:23.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:24.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:24.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:24.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.852+0000 7f32bd668700 1 Processor -- start 2023-09-30T22:24:24.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.852+0000 7f32bd668700 1 -- start start 2023-09-30T22:24:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32bd668700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32b8134140 0x7f32b8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32bd668700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b81345a0 0x7f32b813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32bd668700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b809b110 con 0x7f32b809ad40 2023-09-30T22:24:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32bd668700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80a3b60 con 0x7f32b8134140 2023-09-30T22:24:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32bd668700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80a1a80 con 0x7f32b81345a0 2023-09-30T22:24:24.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32b8134140 0x7f32b8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b81345a0 0x7f32b813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32b8134140 0x7f32b8138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54072/0 (socket says 172.21.15.154:54072) 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b81345a0 0x7f32b813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52018/0 (socket says 172.21.15.154:52018) 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b67fc700 1 -- 172.21.15.154:0/2251415171 learned_addr learned my addr 172.21.15.154:0/2251415171 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b67fc700 1 -- 172.21.15.154:0/2251415171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b81345a0 msgr2=0x7f32b813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b67fc700 1 --2- 172.21.15.154:0/2251415171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b81345a0 0x7f32b813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b67fc700 1 -- 172.21.15.154:0/2251415171 >> v1:172.21.15.154:6789/0 conn(0x7f32b809ad40 legacy=0x7f32b8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b67fc700 1 -- 172.21.15.154:0/2251415171 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80a2fa0 con 0x7f32b8134140 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b5ffb700 1 -- 172.21.15.154:0/2251415171 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292466552 0 0) 0x7f32b809b110 con 0x7f32b809ad40 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b77fe700 1 --2- 172.21.15.154:0/2251415171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b81345a0 0x7f32b813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b67fc700 1 --2- 172.21.15.154:0/2251415171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b8134140 0x7f32b8138e80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0098f0 tx=0x7f32ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938deae2463a2fdf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b5ffb700 1 -- 172.21.15.154:0/2251415171 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac011830 con 0x7f32b8134140 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b5ffb700 1 -- 172.21.15.154:0/2251415171 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac011990 con 0x7f32b8134140 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.853+0000 7f32b5ffb700 1 -- 172.21.15.154:0/2251415171 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac011d20 con 0x7f32b8134140 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.854+0000 7f32bd668700 1 -- 172.21.15.154:0/2251415171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b8134140 msgr2=0x7f32b8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.854+0000 7f32bd668700 1 --2- 172.21.15.154:0/2251415171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b8134140 0x7f32b8138e80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0098f0 tx=0x7f32ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.854+0000 7f32bd668700 1 -- 172.21.15.154:0/2251415171 shutdown_connections 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.854+0000 7f32bd668700 1 --2- 172.21.15.154:0/2251415171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b81345a0 0x7f32b813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.854+0000 7f32bd668700 1 --2- 172.21.15.154:0/2251415171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b8134140 0x7f32b8138e80 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.854+0000 7f32bd668700 1 -- 172.21.15.154:0/2251415171 >> 172.21.15.154:0/2251415171 conn(0x7f32b8099c40 msgr2=0x7f32b806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.854+0000 7f32bd668700 1 -- 172.21.15.154:0/2251415171 shutdown_connections 2023-09-30T22:24:24.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.854+0000 7f32bd668700 1 -- 172.21.15.154:0/2251415171 wait complete. 2023-09-30T22:24:24.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:24.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32bd668700 1 Processor -- start 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32bd668700 1 -- start start 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32bd668700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b809ad40 0x7f32b811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32bd668700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f32b8134140 0x7f32b811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32bd668700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b81345a0 0x7f32b811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32bd668700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b811edf0 con 0x7f32b81345a0 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32bd668700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b813a980 con 0x7f32b809ad40 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32bd668700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32b811e1c0 con 0x7f32b8134140 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32b77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b81345a0 0x7f32b811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32b67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f32b8134140 0x7f32b811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32b67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f32b8134140 0x7f32b811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47236/0 (socket says 172.21.15.154:47236) 2023-09-30T22:24:24.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32b77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b81345a0 0x7f32b811d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54088/0 (socket says 172.21.15.154:54088) 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32b67fc700 1 -- 172.21.15.154:0/2506178244 learned_addr learned my addr 172.21.15.154:0/2506178244 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.856+0000 7f32b6ffd700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b809ad40 0x7f32b811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32b6ffd700 1 -- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f32b8134140 msgr2=0x7f32b811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32b6ffd700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f32b8134140 0x7f32b811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32b6ffd700 1 -- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b81345a0 msgr2=0x7f32b811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32b6ffd700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b81345a0 0x7f32b811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32b6ffd700 1 -- 172.21.15.154:0/2506178244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009a70 con 0x7f32b809ad40 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32b77fe700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b81345a0 0x7f32b811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32b67fc700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f32b8134140 0x7f32b811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32b6ffd700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b809ad40 0x7f32b811c8c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f32a800c3c0 tx=0x7f32a800c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f329f7fe700 1 -- 172.21.15.154:0/2506178244 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a80052d0 con 0x7f32b809ad40 2023-09-30T22:24:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f329f7fe700 1 -- 172.21.15.154:0/2506178244 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a8005450 con 0x7f32b809ad40 2023-09-30T22:24:24.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f329f7fe700 1 -- 172.21.15.154:0/2506178244 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a80038c0 con 0x7f32b809ad40 2023-09-30T22:24:24.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32bd668700 1 -- 172.21.15.154:0/2506178244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac009550 con 0x7f32b809ad40 2023-09-30T22:24:24.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.857+0000 7f32bd668700 1 -- 172.21.15.154:0/2506178244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b8133710 con 0x7f32b809ad40 2023-09-30T22:24:24.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.858+0000 7f329f7fe700 1 -- 172.21.15.154:0/2506178244 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32a8003a20 con 0x7f32b809ad40 2023-09-30T22:24:24.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.858+0000 7f329f7fe700 1 -- 172.21.15.154:0/2506178244 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f32a803e950 con 0x7f32b809ad40 2023-09-30T22:24:24.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.858+0000 7f32bd668700 1 -- 172.21.15.154:0/2506178244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b811e970 con 0x7f32b809ad40 2023-09-30T22:24:24.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.863+0000 7f329f7fe700 1 -- 172.21.15.154:0/2506178244 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32a8017020 con 0x7f32b809ad40 2023-09-30T22:24:24.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:24.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9f5649700 1 Processor -- start 2023-09-30T22:24:24.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9f5649700 1 -- start start 2023-09-30T22:24:24.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9f5649700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f0133ad0 0x7fb9f0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9f5649700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9f01300a0 0x7fb9f01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9f5649700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f006b2d0 con 0x7fb9f01309f0 2023-09-30T22:24:24.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9f5649700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0133610 con 0x7fb9f0133ad0 2023-09-30T22:24:24.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9f5649700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f009a500 con 0x7fb9f01300a0 2023-09-30T22:24:24.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f0133ad0 0x7fb9f0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9eeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f0133ad0 0x7fb9f0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52024/0 (socket says 172.21.15.154:52024) 2023-09-30T22:24:24.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.944+0000 7fb9eeffd700 1 -- 172.21.15.154:0/1172321724 learned_addr learned my addr 172.21.15.154:0/1172321724 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:24.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.945+0000 7fb9eeffd700 1 -- 172.21.15.154:0/1172321724 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9f01300a0 msgr2=0x7fb9f01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:24.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.945+0000 7fb9eeffd700 1 --2- 172.21.15.154:0/1172321724 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9f01300a0 0x7fb9f01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.945+0000 7fb9eeffd700 1 -- 172.21.15.154:0/1172321724 >> v1:172.21.15.154:6789/0 conn(0x7fb9f01309f0 legacy=0x7fb9f013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.945+0000 7fb9eeffd700 1 -- 172.21.15.154:0/1172321724 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f01338b0 con 0x7fb9f0133ad0 2023-09-30T22:24:24.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.945+0000 7fb9eeffd700 1 --2- 172.21.15.154:0/1172321724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f0133ad0 0x7fb9f0133ea0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009920 tx=0x7fb9e0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afae69188834abfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.945+0000 7fb9edffb700 1 -- 172.21.15.154:0/1172321724 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000ba60 con 0x7fb9f0133ad0 2023-09-30T22:24:24.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.945+0000 7fb9edffb700 1 -- 172.21.15.154:0/1172321724 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e000bbc0 con 0x7fb9f0133ad0 2023-09-30T22:24:24.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.945+0000 7fb9edffb700 1 -- 172.21.15.154:0/1172321724 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0009e70 con 0x7fb9f0133ad0 2023-09-30T22:24:24.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.946+0000 7fb9f5649700 1 -- 172.21.15.154:0/1172321724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f0133ad0 msgr2=0x7fb9f0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.946+0000 7fb9f5649700 1 --2- 172.21.15.154:0/1172321724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f0133ad0 0x7fb9f0133ea0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009920 tx=0x7fb9e0009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:24.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.946+0000 7fb9f5649700 1 -- 172.21.15.154:0/1172321724 shutdown_connections 2023-09-30T22:24:24.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.946+0000 7fb9f5649700 1 --2- 172.21.15.154:0/1172321724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f0133ad0 0x7fb9f0133ea0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.946+0000 7fb9f5649700 1 --2- 172.21.15.154:0/1172321724 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9f01300a0 0x7fb9f01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.946+0000 7fb9f5649700 1 -- 172.21.15.154:0/1172321724 >> 172.21.15.154:0/1172321724 conn(0x7fb9f0099c40 msgr2=0x7fb9f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:24.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.946+0000 7fb9f5649700 1 -- 172.21.15.154:0/1172321724 shutdown_connections 2023-09-30T22:24:24.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.946+0000 7fb9f5649700 1 -- 172.21.15.154:0/1172321724 wait complete. 2023-09-30T22:24:24.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.947+0000 7fb9f5649700 1 Processor -- start 2023-09-30T22:24:24.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.947+0000 7fb9f5649700 1 -- start start 2023-09-30T22:24:24.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9f5649700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9f01300a0 0x7fb9f011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9f5649700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f01309f0 0x7fb9f011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9f5649700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9f0133ad0 0x7fb9f011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:24.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9f5649700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f012dd00 con 0x7fb9f01300a0 2023-09-30T22:24:24.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9f5649700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0072630 con 0x7fb9f01309f0 2023-09-30T22:24:24.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9f5649700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f01201f0 con 0x7fb9f0133ad0 2023-09-30T22:24:24.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ee7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f01309f0 0x7fb9f011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ee7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f01309f0 0x7fb9f011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52032/0 (socket says 172.21.15.154:52032) 2023-09-30T22:24:24.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ee7fc700 1 -- 172.21.15.154:0/2531472888 learned_addr learned my addr 172.21.15.154:0/2531472888 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:24.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ef7fe700 1 --2- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9f0133ad0 0x7fb9f011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:24.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ee7fc700 1 -- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9f0133ad0 msgr2=0x7fb9f011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ee7fc700 1 --2- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9f0133ad0 0x7fb9f011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ee7fc700 1 -- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9f01300a0 msgr2=0x7fb9f011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:24.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ee7fc700 1 --2- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9f01300a0 0x7fb9f011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:24.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ee7fc700 1 -- 172.21.15.154:0/2531472888 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0009550 con 0x7fb9f01309f0 2023-09-30T22:24:24.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.948+0000 7fb9ee7fc700 1 --2- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f01309f0 0x7fb9f011df80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400b450 tx=0x7fb9e400b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:24.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.949+0000 7fb9d77fe700 1 -- 172.21.15.154:0/2531472888 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4011830 con 0x7fb9f01309f0 2023-09-30T22:24:24.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.949+0000 7fb9d77fe700 1 -- 172.21.15.154:0/2531472888 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e4011990 con 0x7fb9f01309f0 2023-09-30T22:24:24.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.949+0000 7fb9f5649700 1 -- 172.21.15.154:0/2531472888 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f012fd90 con 0x7fb9f01309f0 2023-09-30T22:24:24.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.949+0000 7fb9d77fe700 1 -- 172.21.15.154:0/2531472888 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4011d40 con 0x7fb9f01309f0 2023-09-30T22:24:24.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.949+0000 7fb9f5649700 1 -- 172.21.15.154:0/2531472888 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f0071b90 con 0x7fb9f01309f0 2023-09-30T22:24:24.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.950+0000 7fb9d77fe700 1 -- 172.21.15.154:0/2531472888 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9e401a400 con 0x7fb9f01309f0 2023-09-30T22:24:24.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.950+0000 7fb9d77fe700 1 -- 172.21.15.154:0/2531472888 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9e403f5e0 con 0x7fb9f01309f0 2023-09-30T22:24:24.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.951+0000 7fb9f5649700 1 -- 172.21.15.154:0/2531472888 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f004f2a0 con 0x7fb9f01309f0 2023-09-30T22:24:24.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:24.959+0000 7fb9d77fe700 1 -- 172.21.15.154:0/2531472888 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9e4015080 con 0x7fb9f01309f0 2023-09-30T22:24:25.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.012+0000 7fd0a324a700 1 Processor -- start 2023-09-30T22:24:25.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.012+0000 7fd0a324a700 1 -- start start 2023-09-30T22:24:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a324a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd09c0a0a70 0x7fd09c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a324a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c0a1380 0x7fd09c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a324a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c133f50 0x7fd09c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a324a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c09e9d0 con 0x7fd09c0a0a70 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a324a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c09dc00 con 0x7fd09c133f50 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a324a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c09dec0 con 0x7fd09c0a1380 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a17e7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c133f50 0x7fd09c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a17e7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c133f50 0x7fd09c1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52046/0 (socket says 172.21.15.154:52046) 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a17e7700 1 -- 172.21.15.154:0/1807833087 learned_addr learned my addr 172.21.15.154:0/1807833087 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd09bfff700 1 --2- 172.21.15.154:0/1807833087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c0a1380 0x7fd09c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a0fe6700 1 --2- 172.21.15.154:0/1807833087 >> v2:172.21.15.154:3300/0 conn(0x7fd09c0a0a70 0x7fd09c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a17e7700 1 -- 172.21.15.154:0/1807833087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c0a1380 msgr2=0x7fd09c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a17e7700 1 --2- 172.21.15.154:0/1807833087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c0a1380 0x7fd09c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a17e7700 1 -- 172.21.15.154:0/1807833087 >> v2:172.21.15.154:3300/0 conn(0x7fd09c0a0a70 msgr2=0x7fd09c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a17e7700 1 --2- 172.21.15.154:0/1807833087 >> v2:172.21.15.154:3300/0 conn(0x7fd09c0a0a70 0x7fd09c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a17e7700 1 -- 172.21.15.154:0/1807833087 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c09e6a0 con 0x7fd09c133f50 2023-09-30T22:24:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd09bfff700 1 --2- 172.21.15.154:0/1807833087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c0a1380 0x7fd09c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.013+0000 7fd0a17e7700 1 --2- 172.21.15.154:0/1807833087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c133f50 0x7fd09c1343b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd094009e50 tx=0x7fd09400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cb740a6330e5326 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd09b7fe700 1 -- 172.21.15.154:0/1807833087 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400e070 con 0x7fd09c133f50 2023-09-30T22:24:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd09b7fe700 1 -- 172.21.15.154:0/1807833087 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09400b910 con 0x7fd09c133f50 2023-09-30T22:24:25.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd09b7fe700 1 -- 172.21.15.154:0/1807833087 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400bcc0 con 0x7fd09c133f50 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd0a324a700 1 -- 172.21.15.154:0/1807833087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c133f50 msgr2=0x7fd09c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd0a324a700 1 --2- 172.21.15.154:0/1807833087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c133f50 0x7fd09c1343b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd094009e50 tx=0x7fd09400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd0a324a700 1 -- 172.21.15.154:0/1807833087 shutdown_connections 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd0a324a700 1 --2- 172.21.15.154:0/1807833087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c133f50 0x7fd09c1343b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd0a324a700 1 --2- 172.21.15.154:0/1807833087 >> v2:172.21.15.154:3300/0 conn(0x7fd09c0a0a70 0x7fd09c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd0a324a700 1 --2- 172.21.15.154:0/1807833087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c0a1380 0x7fd09c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.014+0000 7fd0a324a700 1 -- 172.21.15.154:0/1807833087 >> 172.21.15.154:0/1807833087 conn(0x7fd09c0a6610 msgr2=0x7fd09c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.015+0000 7fd0a324a700 1 -- 172.21.15.154:0/1807833087 shutdown_connections 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.015+0000 7fd0a324a700 1 -- 172.21.15.154:0/1807833087 wait complete. 2023-09-30T22:24:25.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.016+0000 7fd0a324a700 1 Processor -- start 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.016+0000 7fd0a324a700 1 -- start start 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a324a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c0a0a70 0x7fd09c121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a324a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd09c0a1380 0x7fd09c121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a324a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c133f50 0x7fd09c121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a324a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c124cd0 con 0x7fd09c0a1380 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a324a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c124eb0 con 0x7fd09c0a0a70 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a324a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c122930 con 0x7fd09c133f50 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a17e7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c133f50 0x7fd09c121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a17e7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c133f50 0x7fd09c121fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47284/0 (socket says 172.21.15.154:47284) 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a17e7700 1 -- 172.21.15.154:0/3578278767 learned_addr learned my addr 172.21.15.154:0/3578278767 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:25.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a0fe6700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c0a0a70 0x7fd09c121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd09bfff700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd09c0a1380 0x7fd09c121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a17e7700 1 -- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c0a0a70 msgr2=0x7fd09c121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a17e7700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c0a0a70 0x7fd09c121560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a17e7700 1 -- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd09c0a1380 msgr2=0x7fd09c121aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a17e7700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd09c0a1380 0x7fd09c121aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd0a17e7700 1 -- 172.21.15.154:0/3578278767 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880094a0 con 0x7fd09c133f50 2023-09-30T22:24:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.017+0000 7fd09bfff700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd09c0a1380 0x7fd09c121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.018+0000 7fd0a17e7700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c133f50 0x7fd09c121fe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd09400b680 tx=0x7fd094004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.018+0000 7fd0997fa700 1 -- 172.21.15.154:0/3578278767 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094004450 con 0x7fd09c133f50 2023-09-30T22:24:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.018+0000 7fd0997fa700 1 -- 172.21.15.154:0/3578278767 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0940045b0 con 0x7fd09c133f50 2023-09-30T22:24:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.018+0000 7fd0997fa700 1 -- 172.21.15.154:0/3578278767 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094004960 con 0x7fd09c133f50 2023-09-30T22:24:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.018+0000 7fd0a324a700 1 -- 172.21.15.154:0/3578278767 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd094009b30 con 0x7fd09c133f50 2023-09-30T22:24:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.018+0000 7fd0a324a700 1 -- 172.21.15.154:0/3578278767 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c0a03e0 con 0x7fd09c133f50 2023-09-30T22:24:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.019+0000 7fd0a324a700 1 -- 172.21.15.154:0/3578278767 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c124b10 con 0x7fd09c133f50 2023-09-30T22:24:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.020+0000 7fd0997fa700 1 -- 172.21.15.154:0/3578278767 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd09401c410 con 0x7fd09c133f50 2023-09-30T22:24:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.020+0000 7fd0997fa700 1 -- 172.21.15.154:0/3578278767 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd094046440 con 0x7fd09c133f50 2023-09-30T22:24:25.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.029+0000 7fd0997fa700 1 -- 172.21.15.154:0/3578278767 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd09c124b10 con 0x7fd09c133f50 2023-09-30T22:24:25.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.037+0000 7f858e6e9700 1 Processor -- start 2023-09-30T22:24:25.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.037+0000 7f858e6e9700 1 -- start start 2023-09-30T22:24:25.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858e6e9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858e6e9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8588130eb0 0x7f8588138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858e6e9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858809aaa0 con 0x7f858809e170 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858e6e9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858809f870 con 0x7f8588130eb0 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858e6e9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f858809b360 con 0x7f858809d860 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f8587fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f85877fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f858809e170 0x7f85881307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47194/0 (socket says 172.21.15.154:47194) 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f85877fe700 1 -- 172.21.15.154:0/1341833211 learned_addr learned my addr 172.21.15.154:0/1341833211 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858cc86700 1 --2- 172.21.15.154:0/1341833211 >> v2:172.21.15.154:3300/0 conn(0x7f8588130eb0 0x7f8588138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f8586ffd700 1 -- 172.21.15.154:0/1341833211 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589992111 0 0) 0x7f858809aaa0 con 0x7f858809e170 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f8586ffd700 1 -- 172.21.15.154:0/1341833211 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85700035b0 con 0x7f858809e170 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858cc86700 1 -- 172.21.15.154:0/1341833211 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 msgr2=0x7f858809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858cc86700 1 --2- 172.21.15.154:0/1341833211 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858cc86700 1 -- 172.21.15.154:0/1341833211 >> v1:172.21.15.154:6789/0 conn(0x7f858809e170 legacy=0x7f85881307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f858cc86700 1 -- 172.21.15.154:0/1341833211 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858809b620 con 0x7f8588130eb0 2023-09-30T22:24:25.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.038+0000 7f8587fff700 1 --2- 172.21.15.154:0/1341833211 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f858cc86700 1 --2- 172.21.15.154:0/1341833211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 0x7f8588138a00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f858000f370 tx=0x7f858000f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f141db6c707aa9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f8586ffd700 1 -- 172.21.15.154:0/1341833211 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580012070 con 0x7f8588130eb0 2023-09-30T22:24:25.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f8586ffd700 1 -- 172.21.15.154:0/1341833211 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858000fe70 con 0x7f8588130eb0 2023-09-30T22:24:25.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f8586ffd700 1 -- 172.21.15.154:0/1341833211 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858000d2f0 con 0x7f8588130eb0 2023-09-30T22:24:25.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f858e6e9700 1 -- 172.21.15.154:0/1341833211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 msgr2=0x7f8588138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f858e6e9700 1 --2- 172.21.15.154:0/1341833211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 0x7f8588138a00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f858000f370 tx=0x7f858000f680 comp rx=0 tx=0).stop 2023-09-30T22:24:25.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f858e6e9700 1 -- 172.21.15.154:0/1341833211 shutdown_connections 2023-09-30T22:24:25.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f858e6e9700 1 --2- 172.21.15.154:0/1341833211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 0x7f8588138a00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f858e6e9700 1 --2- 172.21.15.154:0/1341833211 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f858e6e9700 1 -- 172.21.15.154:0/1341833211 >> 172.21.15.154:0/1341833211 conn(0x7f8588099c40 msgr2=0x7f85880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f858e6e9700 1 -- 172.21.15.154:0/1341833211 shutdown_connections 2023-09-30T22:24:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.039+0000 7f858e6e9700 1 -- 172.21.15.154:0/1341833211 wait complete. 2023-09-30T22:24:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.041+0000 7f858e6e9700 1 Processor -- start 2023-09-30T22:24:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.041+0000 7f858e6e9700 1 -- start start 2023-09-30T22:24:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858e6e9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858811e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858e6e9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f858809e170 0x7f858811e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858e6e9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 0x7f858811ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858e6e9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588121e30 con 0x7f8588130eb0 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858e6e9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8588120750 con 0x7f858809e170 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858e6e9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f858809c8b0 con 0x7f858809d860 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858cc86700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 0x7f858811ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f8587fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858811e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858cc86700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 0x7f858811ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54126/0 (socket says 172.21.15.154:54126) 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858cc86700 1 -- 172.21.15.154:0/945781328 learned_addr learned my addr 172.21.15.154:0/945781328 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858cc86700 1 -- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 msgr2=0x7f858811e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858cc86700 1 --2- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858811e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858cc86700 1 -- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f858809e170 msgr2=0x7f858811e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858cc86700 1 --2- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f858809e170 0x7f858811e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858cc86700 1 -- 172.21.15.154:0/945781328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857800b550 con 0x7f8588130eb0 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f8587fff700 1 --2- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858811e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.042+0000 7f858cc86700 1 --2- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 0x7f858811ed40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8580011010 tx=0x7f8580004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.043+0000 7f8584ff9700 1 -- 172.21.15.154:0/945781328 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858000bb50 con 0x7f8588130eb0 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.043+0000 7f8584ff9700 1 -- 172.21.15.154:0/945781328 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580003e90 con 0x7f8588130eb0 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.043+0000 7f858e6e9700 1 -- 172.21.15.154:0/945781328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858000f050 con 0x7f8588130eb0 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.043+0000 7f8584ff9700 1 -- 172.21.15.154:0/945781328 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580004040 con 0x7f8588130eb0 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.043+0000 7f858e6e9700 1 -- 172.21.15.154:0/945781328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8588121520 con 0x7f8588130eb0 2023-09-30T22:24:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.044+0000 7f8584ff9700 1 -- 172.21.15.154:0/945781328 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85800041a0 con 0x7f8588130eb0 2023-09-30T22:24:25.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.044+0000 7f8584ff9700 1 -- 172.21.15.154:0/945781328 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f85800454a0 con 0x7f8588130eb0 2023-09-30T22:24:25.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.044+0000 7f858e6e9700 1 -- 172.21.15.154:0/945781328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858804f2a0 con 0x7f8588130eb0 2023-09-30T22:24:25.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.053+0000 7f8584ff9700 1 -- 172.21.15.154:0/945781328 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8580004450 con 0x7f8588130eb0 2023-09-30T22:24:25.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.075+0000 7f32bd668700 1 -- 172.21.15.154:0/2506178244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f32b804f2a0 con 0x7f32b809ad40 2023-09-30T22:24:25.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.076+0000 7f329f7fe700 1 -- 172.21.15.154:0/2506178244 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32a8019d20 con 0x7f32b809ad40 2023-09-30T22:24:25.075 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.078+0000 7f32bd668700 1 -- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b809ad40 msgr2=0x7f32b811c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.078+0000 7f32bd668700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b809ad40 0x7f32b811c8c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f32a800c3c0 tx=0x7f32a800c6d0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.078+0000 7f32bd668700 1 -- 172.21.15.154:0/2506178244 shutdown_connections 2023-09-30T22:24:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.078+0000 7f32bd668700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32b81345a0 0x7f32b811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.078+0000 7f32bd668700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32b809ad40 0x7f32b811c8c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.078+0000 7f32bd668700 1 --2- 172.21.15.154:0/2506178244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f32b8134140 0x7f32b811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.078+0000 7f32bd668700 1 -- 172.21.15.154:0/2506178244 >> 172.21.15.154:0/2506178244 conn(0x7f32b8099c40 msgr2=0x7f32b809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.078+0000 7f32bd668700 1 -- 172.21.15.154:0/2506178244 shutdown_connections 2023-09-30T22:24:25.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.078+0000 7f32bd668700 1 -- 172.21.15.154:0/2506178244 wait complete. 2023-09-30T22:24:25.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:25.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.184+0000 7fb9f5649700 1 -- 172.21.15.154:0/2531472888 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9f009e190 con 0x7fb9f01309f0 2023-09-30T22:24:25.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.184+0000 7fb9d77fe700 1 -- 172.21.15.154:0/2531472888 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9e400f8d0 con 0x7fb9f01309f0 2023-09-30T22:24:25.185 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:25.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.186+0000 7fb9f5649700 1 -- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f01309f0 msgr2=0x7fb9f011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.186+0000 7fb9f5649700 1 --2- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f01309f0 0x7fb9f011df80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400b450 tx=0x7fb9e400b760 comp rx=0 tx=0).stop 2023-09-30T22:24:25.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.186+0000 7fb9f5649700 1 -- 172.21.15.154:0/2531472888 shutdown_connections 2023-09-30T22:24:25.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.186+0000 7fb9f5649700 1 --2- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9f0133ad0 0x7fb9f011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.186+0000 7fb9f5649700 1 --2- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9f01300a0 0x7fb9f011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.186+0000 7fb9f5649700 1 --2- 172.21.15.154:0/2531472888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f01309f0 0x7fb9f011df80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.186+0000 7fb9f5649700 1 -- 172.21.15.154:0/2531472888 >> 172.21.15.154:0/2531472888 conn(0x7fb9f0099c40 msgr2=0x7fb9f00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.186+0000 7fb9f5649700 1 -- 172.21.15.154:0/2531472888 shutdown_connections 2023-09-30T22:24:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.186+0000 7fb9f5649700 1 -- 172.21.15.154:0/2531472888 wait complete. 2023-09-30T22:24:25.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:25.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.231+0000 7fd0a324a700 1 -- 172.21.15.154:0/3578278767 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd09c124b10 con 0x7fd09c133f50 2023-09-30T22:24:25.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.231+0000 7fd0997fa700 1 -- 172.21.15.154:0/3578278767 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd09c124b10 con 0x7fd09c133f50 2023-09-30T22:24:25.231 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.233+0000 7fd0a324a700 1 -- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c133f50 msgr2=0x7fd09c121fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.233+0000 7fd0a324a700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c133f50 0x7fd09c121fe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd09400b680 tx=0x7fd094004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.233+0000 7fd0a324a700 1 -- 172.21.15.154:0/3578278767 shutdown_connections 2023-09-30T22:24:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.233+0000 7fd0a324a700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd09c133f50 0x7fd09c121fe0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.233+0000 7fd0a324a700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd09c0a0a70 0x7fd09c121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.233+0000 7fd0a324a700 1 --2- 172.21.15.154:0/3578278767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd09c0a1380 0x7fd09c121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.233+0000 7fd0a324a700 1 -- 172.21.15.154:0/3578278767 >> 172.21.15.154:0/3578278767 conn(0x7fd09c0a6610 msgr2=0x7fd09c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.233+0000 7fd0a324a700 1 -- 172.21.15.154:0/3578278767 shutdown_connections 2023-09-30T22:24:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.233+0000 7fd0a324a700 1 -- 172.21.15.154:0/3578278767 wait complete. 2023-09-30T22:24:25.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:25.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.250+0000 7f858e6e9700 1 -- 172.21.15.154:0/945781328 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f858806c3b0 con 0x7f8588130eb0 2023-09-30T22:24:25.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.251+0000 7f8584ff9700 1 -- 172.21.15.154:0/945781328 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f858001e3c0 con 0x7f8588130eb0 2023-09-30T22:24:25.251 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.253+0000 7f858e6e9700 1 -- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 msgr2=0x7f858811ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.253+0000 7f858e6e9700 1 --2- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 0x7f858811ed40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8580011010 tx=0x7f8580004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.253+0000 7f858e6e9700 1 -- 172.21.15.154:0/945781328 shutdown_connections 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.253+0000 7f858e6e9700 1 --2- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588130eb0 0x7f858811ed40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.253+0000 7f858e6e9700 1 --2- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f858809d860 0x7f858811e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.253+0000 7f858e6e9700 1 --2- 172.21.15.154:0/945781328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f858809e170 0x7f858811e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.253+0000 7f858e6e9700 1 -- 172.21.15.154:0/945781328 >> 172.21.15.154:0/945781328 conn(0x7f8588099c40 msgr2=0x7f85880a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.253+0000 7f858e6e9700 1 -- 172.21.15.154:0/945781328 shutdown_connections 2023-09-30T22:24:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:25.253+0000 7f858e6e9700 1 -- 172.21.15.154:0/945781328 wait complete. 2023-09-30T22:24:25.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:26.091 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:26.200 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.218+0000 7f5eb1d85700 1 Processor -- start 2023-09-30T22:24:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.218+0000 7f5eb1d85700 1 -- start start 2023-09-30T22:24:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eb1d85700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eb1d85700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5eac130eb0 0x7f5eac138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eb1d85700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac09aaa0 con 0x7f5eac09e170 2023-09-30T22:24:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eb1d85700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac09f870 con 0x7f5eac130eb0 2023-09-30T22:24:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eb1d85700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac09b360 con 0x7f5eac09d860 2023-09-30T22:24:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eab7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eabfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5eac130eb0 0x7f5eac138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eab7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60044/0 (socket says 172.21.15.154:60044) 2023-09-30T22:24:26.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eabfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5eac130eb0 0x7f5eac138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50776/0 (socket says 172.21.15.154:50776) 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eab7fe700 1 -- 172.21.15.154:0/715261230 learned_addr learned my addr 172.21.15.154:0/715261230 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eab7fe700 1 -- 172.21.15.154:0/715261230 >> v2:172.21.15.154:3300/0 conn(0x7f5eac130eb0 msgr2=0x7f5eac138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eab7fe700 1 --2- 172.21.15.154:0/715261230 >> v2:172.21.15.154:3300/0 conn(0x7f5eac130eb0 0x7f5eac138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eab7fe700 1 -- 172.21.15.154:0/715261230 >> v1:172.21.15.154:6789/0 conn(0x7f5eac09e170 legacy=0x7f5eac1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eab7fe700 1 -- 172.21.15.154:0/715261230 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac09b620 con 0x7f5eac09d860 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.219+0000 7f5eabfff700 1 --2- 172.21.15.154:0/715261230 >> v2:172.21.15.154:3300/0 conn(0x7f5eac130eb0 0x7f5eac138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.220+0000 7f5eab7fe700 1 --2- 172.21.15.154:0/715261230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac09dc30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0098f0 tx=0x7f5e9c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50bdd6d07bd0f56 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.220+0000 7f5eaaffd700 1 -- 172.21.15.154:0/715261230 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c011830 con 0x7f5eac09d860 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.220+0000 7f5eaaffd700 1 -- 172.21.15.154:0/715261230 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c011990 con 0x7f5eac09d860 2023-09-30T22:24:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.220+0000 7f5eaaffd700 1 -- 172.21.15.154:0/715261230 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c011d20 con 0x7f5eac09d860 2023-09-30T22:24:26.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.221+0000 7f5eb1d85700 1 -- 172.21.15.154:0/715261230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 msgr2=0x7f5eac09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.221+0000 7f5eb1d85700 1 --2- 172.21.15.154:0/715261230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac09dc30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0098f0 tx=0x7f5e9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:26.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.221+0000 7f5eb1d85700 1 -- 172.21.15.154:0/715261230 shutdown_connections 2023-09-30T22:24:26.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.221+0000 7f5eb1d85700 1 --2- 172.21.15.154:0/715261230 >> v2:172.21.15.154:3300/0 conn(0x7f5eac130eb0 0x7f5eac138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.221+0000 7f5eb1d85700 1 --2- 172.21.15.154:0/715261230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac09dc30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.221+0000 7f5eb1d85700 1 -- 172.21.15.154:0/715261230 >> 172.21.15.154:0/715261230 conn(0x7f5eac099c40 msgr2=0x7f5eac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.221+0000 7f5eb1d85700 1 -- 172.21.15.154:0/715261230 shutdown_connections 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.221+0000 7f5eb1d85700 1 -- 172.21.15.154:0/715261230 wait complete. 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.222+0000 7f5eb1d85700 1 Processor -- start 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.222+0000 7f5eb1d85700 1 -- start start 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.222+0000 7f5eb1d85700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac11e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.222+0000 7f5eb1d85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac09e170 0x7f5eac11e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.222+0000 7f5eb1d85700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5eac130eb0 0x7f5eac11ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.222+0000 7f5eb1d85700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac120110 con 0x7f5eac09e170 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.222+0000 7f5eb1d85700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac121c30 con 0x7f5eac09d860 2023-09-30T22:24:26.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.222+0000 7f5eb1d85700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac1205b0 con 0x7f5eac130eb0 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5eab7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac11e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac09e170 0x7f5eac11e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac09e170 0x7f5eac11e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50790/0 (socket says 172.21.15.154:50790) 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea3fff700 1 -- 172.21.15.154:0/1366991716 learned_addr learned my addr 172.21.15.154:0/1366991716 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5eabfff700 1 --2- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5eac130eb0 0x7f5eac11ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea3fff700 1 -- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5eac130eb0 msgr2=0x7f5eac11ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea3fff700 1 --2- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5eac130eb0 0x7f5eac11ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea3fff700 1 -- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 msgr2=0x7f5eac11e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea3fff700 1 --2- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac11e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea3fff700 1 -- 172.21.15.154:0/1366991716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4009a70 con 0x7f5eac09e170 2023-09-30T22:24:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5eab7fe700 1 --2- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac11e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea3fff700 1 --2- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac09e170 0x7f5eac11e930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c4b0 tx=0x7f5e9400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea8ff9700 1 -- 172.21.15.154:0/1366991716 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e940052d0 con 0x7f5eac09e170 2023-09-30T22:24:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea8ff9700 1 -- 172.21.15.154:0/1366991716 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94005430 con 0x7f5eac09e170 2023-09-30T22:24:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5ea8ff9700 1 -- 172.21.15.154:0/1366991716 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e940038c0 con 0x7f5eac09e170 2023-09-30T22:24:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5eb1d85700 1 -- 172.21.15.154:0/1366991716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c009550 con 0x7f5eac09e170 2023-09-30T22:24:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.223+0000 7f5eb1d85700 1 -- 172.21.15.154:0/1366991716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac09c8b0 con 0x7f5eac09e170 2023-09-30T22:24:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.224+0000 7f5ea8ff9700 1 -- 172.21.15.154:0/1366991716 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e94003a20 con 0x7f5eac09e170 2023-09-30T22:24:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.224+0000 7f5ea8ff9700 1 -- 172.21.15.154:0/1366991716 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e9403ea30 con 0x7f5eac09e170 2023-09-30T22:24:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.224+0000 7f5eb1d85700 1 -- 172.21.15.154:0/1366991716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac122760 con 0x7f5eac09e170 2023-09-30T22:24:26.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.229+0000 7f5ea8ff9700 1 -- 172.21.15.154:0/1366991716 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e94017080 con 0x7f5eac09e170 2023-09-30T22:24:26.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:26.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:26.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.329+0000 7f6dfefd2700 1 Processor -- start 2023-09-30T22:24:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6dfefd2700 1 -- start start 2023-09-30T22:24:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6dfefd2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6dfefd2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6df809e170 0x7f6df81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6dfefd2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df8130ce0 0x7f6df8131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6dfefd2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df809aaa0 con 0x7f6df809e170 2023-09-30T22:24:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6dfefd2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df809f870 con 0x7f6df809d860 2023-09-30T22:24:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6dfefd2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6df809b360 con 0x7f6df8130ce0 2023-09-30T22:24:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6df7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6df809e170 0x7f6df81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6df7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6df809e170 0x7f6df81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50792/0 (socket says 172.21.15.154:50792) 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6df7fff700 1 -- 172.21.15.154:0/2995098344 learned_addr learned my addr 172.21.15.154:0/2995098344 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6dfd56f700 1 --2- 172.21.15.154:0/2995098344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df8130ce0 0x7f6df8131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.330+0000 7f6dfcd6e700 1 --2- 172.21.15.154:0/2995098344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6dfd56f700 1 -- 172.21.15.154:0/2995098344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 msgr2=0x7f6df809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6dfd56f700 1 --2- 172.21.15.154:0/2995098344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6dfd56f700 1 -- 172.21.15.154:0/2995098344 >> v2:172.21.15.154:3300/0 conn(0x7f6df809e170 msgr2=0x7f6df81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6dfd56f700 1 --2- 172.21.15.154:0/2995098344 >> v2:172.21.15.154:3300/0 conn(0x7f6df809e170 0x7f6df81307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6dfd56f700 1 -- 172.21.15.154:0/2995098344 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df809b620 con 0x7f6df8130ce0 2023-09-30T22:24:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6df7fff700 1 --2- 172.21.15.154:0/2995098344 >> v2:172.21.15.154:3300/0 conn(0x7f6df809e170 0x7f6df81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6dfd56f700 1 --2- 172.21.15.154:0/2995098344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df8130ce0 0x7f6df8131180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009dc0 tx=0x7f6df000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e8c4577fc2e162 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6df77fe700 1 -- 172.21.15.154:0/2995098344 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000e070 con 0x7f6df8130ce0 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6df77fe700 1 -- 172.21.15.154:0/2995098344 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df000bae0 con 0x7f6df8130ce0 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.331+0000 7f6df77fe700 1 -- 172.21.15.154:0/2995098344 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000be90 con 0x7f6df8130ce0 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.332+0000 7f6dfefd2700 1 -- 172.21.15.154:0/2995098344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df8130ce0 msgr2=0x7f6df8131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.332+0000 7f6dfefd2700 1 --2- 172.21.15.154:0/2995098344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df8130ce0 0x7f6df8131180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009dc0 tx=0x7f6df000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.332+0000 7f6dfefd2700 1 -- 172.21.15.154:0/2995098344 shutdown_connections 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.332+0000 7f6dfefd2700 1 --2- 172.21.15.154:0/2995098344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.332+0000 7f6dfefd2700 1 --2- 172.21.15.154:0/2995098344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df8130ce0 0x7f6df8131180 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.332+0000 7f6dfefd2700 1 --2- 172.21.15.154:0/2995098344 >> v2:172.21.15.154:3300/0 conn(0x7f6df809e170 0x7f6df81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.332+0000 7f6dfefd2700 1 -- 172.21.15.154:0/2995098344 >> 172.21.15.154:0/2995098344 conn(0x7f6df8099c40 msgr2=0x7f6df80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.332+0000 7f6dfefd2700 1 -- 172.21.15.154:0/2995098344 shutdown_connections 2023-09-30T22:24:26.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.332+0000 7f6dfefd2700 1 -- 172.21.15.154:0/2995098344 wait complete. 2023-09-30T22:24:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.333+0000 7f6dfefd2700 1 Processor -- start 2023-09-30T22:24:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.333+0000 7f6dfefd2700 1 -- start start 2023-09-30T22:24:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.333+0000 7f6dfefd2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df811d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.333+0000 7f6dfefd2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df809e170 0x7f6df811d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.333+0000 7f6dfefd2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6df8130ce0 0x7f6df811db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.333+0000 7f6dfefd2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df811ed40 con 0x7f6df8130ce0 2023-09-30T22:24:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.333+0000 7f6dfefd2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df811eb50 con 0x7f6df809d860 2023-09-30T22:24:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfefd2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6df811f3e0 con 0x7f6df809e170 2023-09-30T22:24:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfcd6e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df811d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfcd6e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df811d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60068/0 (socket says 172.21.15.154:60068) 2023-09-30T22:24:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfcd6e700 1 -- 172.21.15.154:0/3533589767 learned_addr learned my addr 172.21.15.154:0/3533589767 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6df7fff700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df809e170 0x7f6df811d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfd56f700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6df8130ce0 0x7f6df811db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfcd6e700 1 -- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df809e170 msgr2=0x7f6df811d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfcd6e700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df809e170 0x7f6df811d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfcd6e700 1 -- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6df8130ce0 msgr2=0x7f6df811db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfcd6e700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6df8130ce0 0x7f6df811db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfcd6e700 1 -- 172.21.15.154:0/3533589767 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de4009550 con 0x7f6df809d860 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfd56f700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6df8130ce0 0x7f6df811db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6df7fff700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df809e170 0x7f6df811d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6dfcd6e700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df811d080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00d860 tx=0x7f6dec00db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.334+0000 7f6df57fa700 1 -- 172.21.15.154:0/3533589767 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0125f0 con 0x7f6df809d860 2023-09-30T22:24:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.335+0000 7f6df57fa700 1 -- 172.21.15.154:0/3533589767 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec012750 con 0x7f6df809d860 2023-09-30T22:24:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.335+0000 7f6dfefd2700 1 -- 172.21.15.154:0/3533589767 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df0009a70 con 0x7f6df809d860 2023-09-30T22:24:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.335+0000 7f6dfefd2700 1 -- 172.21.15.154:0/3533589767 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df8120b30 con 0x7f6df809d860 2023-09-30T22:24:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.336+0000 7f6df57fa700 1 -- 172.21.15.154:0/3533589767 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec012ae0 con 0x7f6df809d860 2023-09-30T22:24:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.336+0000 7f6df57fa700 1 -- 172.21.15.154:0/3533589767 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6dec012c80 con 0x7f6df809d860 2023-09-30T22:24:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.336+0000 7f6dfefd2700 1 -- 172.21.15.154:0/3533589767 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df804f2a0 con 0x7f6df809d860 2023-09-30T22:24:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.336+0000 7f6df57fa700 1 -- 172.21.15.154:0/3533589767 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6dec03fac0 con 0x7f6df809d860 2023-09-30T22:24:26.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.345+0000 7f6df57fa700 1 -- 172.21.15.154:0/3533589767 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6dec01e460 con 0x7f6df809d860 2023-09-30T22:24:26.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.382+0000 7faa291d9700 1 Processor -- start 2023-09-30T22:24:26.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.382+0000 7faa291d9700 1 -- start start 2023-09-30T22:24:26.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.383+0000 7faa291d9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa2409e950 0x7faa2409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.383+0000 7faa291d9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 0x7faa2413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.383+0000 7faa291d9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2409ac20 con 0x7faa2409f260 2023-09-30T22:24:26.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.383+0000 7faa291d9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa240a06c0 con 0x7faa2409e950 2023-09-30T22:24:26.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.383+0000 7faa291d9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa2409ae90 con 0x7faa241393c0 2023-09-30T22:24:26.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.383+0000 7faa2359e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 0x7faa2413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.383+0000 7faa2359e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 0x7faa2413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46826/0 (socket says 172.21.15.154:46826) 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.383+0000 7faa2359e700 1 -- 172.21.15.154:0/3517578967 learned_addr learned my addr 172.21.15.154:0/3517578967 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.383+0000 7faa22d9d700 1 --2- 172.21.15.154:0/3517578967 >> v2:172.21.15.154:3300/0 conn(0x7faa2409e950 0x7faa2409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.384+0000 7faa22d9d700 1 -- 172.21.15.154:0/3517578967 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 msgr2=0x7faa2413b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.384+0000 7faa22d9d700 1 --2- 172.21.15.154:0/3517578967 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 0x7faa2413b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.384+0000 7faa22d9d700 1 -- 172.21.15.154:0/3517578967 >> v1:172.21.15.154:6789/0 conn(0x7faa2409f260 legacy=0x7faa24137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.384+0000 7faa22d9d700 1 -- 172.21.15.154:0/3517578967 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2406ba00 con 0x7faa2409e950 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.384+0000 7faa22d9d700 1 --2- 172.21.15.154:0/3517578967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409e950 0x7faa2409ed20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7faa14009850 tx=0x7faa14009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b0f47e8846d2b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.384+0000 7faa21d9b700 1 -- 172.21.15.154:0/3517578967 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14005e30 con 0x7faa2409e950 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.384+0000 7faa21d9b700 1 -- 172.21.15.154:0/3517578967 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa14006030 con 0x7faa2409e950 2023-09-30T22:24:26.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.384+0000 7faa21d9b700 1 -- 172.21.15.154:0/3517578967 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa140063c0 con 0x7faa2409e950 2023-09-30T22:24:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.385+0000 7faa291d9700 1 -- 172.21.15.154:0/3517578967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409e950 msgr2=0x7faa2409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.385+0000 7faa291d9700 1 --2- 172.21.15.154:0/3517578967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409e950 0x7faa2409ed20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7faa14009850 tx=0x7faa14009b60 comp rx=0 tx=0).stop 2023-09-30T22:24:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.385+0000 7faa291d9700 1 -- 172.21.15.154:0/3517578967 shutdown_connections 2023-09-30T22:24:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.385+0000 7faa291d9700 1 --2- 172.21.15.154:0/3517578967 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 0x7faa2413b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.385+0000 7faa291d9700 1 --2- 172.21.15.154:0/3517578967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409e950 0x7faa2409ed20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.385+0000 7faa291d9700 1 -- 172.21.15.154:0/3517578967 >> 172.21.15.154:0/3517578967 conn(0x7faa240a0f70 msgr2=0x7faa240a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.385+0000 7faa291d9700 1 -- 172.21.15.154:0/3517578967 shutdown_connections 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.385+0000 7faa291d9700 1 -- 172.21.15.154:0/3517578967 wait complete. 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.386+0000 7faa291d9700 1 Processor -- start 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.386+0000 7faa291d9700 1 -- start start 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa291d9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa2409e950 0x7faa2411eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa291d9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409f260 0x7faa2411f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa291d9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 0x7faa2411f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa291d9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa24120000 con 0x7faa2409f260 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa291d9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa240a0820 con 0x7faa2409e950 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa291d9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa24120520 con 0x7faa241393c0 2023-09-30T22:24:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa22d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa2409e950 0x7faa2411eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa22d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa2409e950 0x7faa2411eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60074/0 (socket says 172.21.15.154:60074) 2023-09-30T22:24:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa22d9d700 1 -- 172.21.15.154:0/1372764504 learned_addr learned my addr 172.21.15.154:0/1372764504 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa2259c700 1 --2- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409f260 0x7faa2411f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.387+0000 7faa2359e700 1 --2- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 0x7faa2411f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa2259c700 1 -- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 msgr2=0x7faa2411f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa2259c700 1 --2- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 0x7faa2411f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa2259c700 1 -- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa2409e950 msgr2=0x7faa2411eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa2259c700 1 --2- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa2409e950 0x7faa2411eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa2259c700 1 -- 172.21.15.154:0/1372764504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14009430 con 0x7faa2409f260 2023-09-30T22:24:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa2259c700 1 --2- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409f260 0x7faa2411f070 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c450 tx=0x7faa1800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa0b7fe700 1 -- 172.21.15.154:0/1372764504 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa180052d0 con 0x7faa2409f260 2023-09-30T22:24:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa0b7fe700 1 -- 172.21.15.154:0/1372764504 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18005430 con 0x7faa2409f260 2023-09-30T22:24:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa0b7fe700 1 -- 172.21.15.154:0/1372764504 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa180038a0 con 0x7faa2409f260 2023-09-30T22:24:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa291d9700 1 -- 172.21.15.154:0/1372764504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa241220b0 con 0x7faa2409f260 2023-09-30T22:24:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.388+0000 7faa291d9700 1 -- 172.21.15.154:0/1372764504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa24120980 con 0x7faa2409f260 2023-09-30T22:24:26.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.389+0000 7faa0b7fe700 1 -- 172.21.15.154:0/1372764504 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa18003a00 con 0x7faa2409f260 2023-09-30T22:24:26.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.390+0000 7faa0b7fe700 1 -- 172.21.15.154:0/1372764504 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa1803e9d0 con 0x7faa2409f260 2023-09-30T22:24:26.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.390+0000 7faa291d9700 1 -- 172.21.15.154:0/1372764504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa24121d50 con 0x7faa2409f260 2023-09-30T22:24:26.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.394+0000 7faa0b7fe700 1 -- 172.21.15.154:0/1372764504 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa18003cb0 con 0x7faa2409f260 2023-09-30T22:24:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.421+0000 7f9cc5bd8700 1 Processor -- start 2023-09-30T22:24:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.421+0000 7f9cc5bd8700 1 -- start start 2023-09-30T22:24:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.421+0000 7f9cc5bd8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc0133b80 0x7f9cc0133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.421+0000 7f9cc5bd8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cc00a0ff0 0x7f9cc013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.421+0000 7f9cc5bd8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc009aa00 con 0x7f9cc0099a60 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.421+0000 7f9cc5bd8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc009a080 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.421+0000 7f9cc5bd8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0133750 con 0x7f9cc0133b80 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbeffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9cc0099a60 0x7f9cc00a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41826/0 (socket says 172.21.15.154:41826) 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbeffd700 1 -- 172.21.15.154:0/1480512788 learned_addr learned my addr 172.21.15.154:0/1480512788 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbf7fe700 1 --2- 172.21.15.154:0/1480512788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc0133b80 0x7f9cc0133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbffff700 1 --2- 172.21.15.154:0/1480512788 >> v2:172.21.15.154:3300/0 conn(0x7f9cc00a0ff0 0x7f9cc013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbe7fc700 1 -- 172.21.15.154:0/1480512788 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746160199 0 0) 0x7f9cc009aa00 con 0x7f9cc0099a60 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbe7fc700 1 -- 172.21.15.154:0/1480512788 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca80035b0 con 0x7f9cc0099a60 2023-09-30T22:24:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbf7fe700 1 -- 172.21.15.154:0/1480512788 >> v2:172.21.15.154:3300/0 conn(0x7f9cc00a0ff0 msgr2=0x7f9cc013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbf7fe700 1 --2- 172.21.15.154:0/1480512788 >> v2:172.21.15.154:3300/0 conn(0x7f9cc00a0ff0 0x7f9cc013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbf7fe700 1 -- 172.21.15.154:0/1480512788 >> v1:172.21.15.154:6789/0 conn(0x7f9cc0099a60 legacy=0x7f9cc00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbe7fc700 1 -- 172.21.15.154:0/1480512788 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1180006214 0 0) 0x7f9ca80035b0 con 0x7f9cc0099a60 2023-09-30T22:24:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbf7fe700 1 -- 172.21.15.154:0/1480512788 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc009a760 con 0x7f9cc0133b80 2023-09-30T22:24:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbffff700 1 --2- 172.21.15.154:0/1480512788 >> v2:172.21.15.154:3300/0 conn(0x7f9cc00a0ff0 0x7f9cc013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.422+0000 7f9cbf7fe700 1 --2- 172.21.15.154:0/1480512788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc0133b80 0x7f9cc0133f50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009820 tx=0x7f9cb0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=529404c71d3c91d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cbe7fc700 1 -- 172.21.15.154:0/1480512788 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4001670 con 0x7f9cc0133b80 2023-09-30T22:24:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cbe7fc700 1 -- 172.21.15.154:0/1480512788 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0005c30 con 0x7f9cc0133b80 2023-09-30T22:24:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cbe7fc700 1 -- 172.21.15.154:0/1480512788 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0004030 con 0x7f9cc0133b80 2023-09-30T22:24:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/1480512788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc0133b80 msgr2=0x7f9cc0133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cc5bd8700 1 --2- 172.21.15.154:0/1480512788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc0133b80 0x7f9cc0133f50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009820 tx=0x7f9cb0009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/1480512788 shutdown_connections 2023-09-30T22:24:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cc5bd8700 1 --2- 172.21.15.154:0/1480512788 >> v2:172.21.15.154:3300/0 conn(0x7f9cc00a0ff0 0x7f9cc013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cc5bd8700 1 --2- 172.21.15.154:0/1480512788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc0133b80 0x7f9cc0133f50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/1480512788 >> 172.21.15.154:0/1480512788 conn(0x7f9cc00a2980 msgr2=0x7f9cc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/1480512788 shutdown_connections 2023-09-30T22:24:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.423+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/1480512788 wait complete. 2023-09-30T22:24:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.425+0000 7f9cc5bd8700 1 Processor -- start 2023-09-30T22:24:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.425+0000 7f9cc5bd8700 1 -- start start 2023-09-30T22:24:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cc5bd8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc0099a60 0x7f9cc011d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cc5bd8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc00a0ff0 0x7f9cc011de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cc5bd8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9cc0133b80 0x7f9cc011e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cc5bd8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0121150 con 0x7f9cc0099a60 2023-09-30T22:24:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cc5bd8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0120240 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cc5bd8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc009c310 con 0x7f9cc0133b80 2023-09-30T22:24:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc0099a60 0x7f9cc011d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc0099a60 0x7f9cc011d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50838/0 (socket says 172.21.15.154:50838) 2023-09-30T22:24:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbf7fe700 1 -- 172.21.15.154:0/3033493132 learned_addr learned my addr 172.21.15.154:0/3033493132 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbeffd700 1 --2- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc00a0ff0 0x7f9cc011de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbffff700 1 --2- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9cc0133b80 0x7f9cc011e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbeffd700 1 -- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9cc0133b80 msgr2=0x7f9cc011e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbeffd700 1 --2- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9cc0133b80 0x7f9cc011e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbeffd700 1 -- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc0099a60 msgr2=0x7f9cc011d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbeffd700 1 --2- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc0099a60 0x7f9cc011d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbeffd700 1 -- 172.21.15.154:0/3033493132 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8009a70 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.426+0000 7f9cbeffd700 1 --2- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc00a0ff0 0x7f9cc011de80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4000c00 tx=0x7f9cb400ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.427+0000 7f9ca7fff700 1 -- 172.21.15.154:0/3033493132 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4004c80 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.427+0000 7f9ca7fff700 1 -- 172.21.15.154:0/3033493132 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb4004e00 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.427+0000 7f9ca7fff700 1 -- 172.21.15.154:0/3033493132 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4007310 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.427+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/3033493132 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb0009430 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.427+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/3033493132 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc011f4e0 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.428+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/3033493132 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc011a590 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.428+0000 7f9ca7fff700 1 -- 172.21.15.154:0/3033493132 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cb4007470 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.428+0000 7f9ca7fff700 1 -- 172.21.15.154:0/3033493132 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9cb403f9e0 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.437+0000 7f9ca7fff700 1 -- 172.21.15.154:0/3033493132 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cb401a6c0 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.450+0000 7f5eb1d85700 1 -- 172.21.15.154:0/1366991716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5eac04f2a0 con 0x7f5eac09e170 2023-09-30T22:24:26.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.450+0000 7f5ea8ff9700 1 -- 172.21.15.154:0/1366991716 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e94019e60 con 0x7f5eac09e170 2023-09-30T22:24:26.450 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:26.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.452+0000 7f5eb1d85700 1 -- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac09e170 msgr2=0x7f5eac11e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.452+0000 7f5eb1d85700 1 --2- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac09e170 0x7f5eac11e930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400c4b0 tx=0x7f5e9400c7c0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.452+0000 7f5eb1d85700 1 -- 172.21.15.154:0/1366991716 shutdown_connections 2023-09-30T22:24:26.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.452+0000 7f5eb1d85700 1 --2- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5eac130eb0 0x7f5eac11ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.452+0000 7f5eb1d85700 1 --2- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac09d860 0x7f5eac11e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.452+0000 7f5eb1d85700 1 --2- 172.21.15.154:0/1366991716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac09e170 0x7f5eac11e930 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.452+0000 7f5eb1d85700 1 -- 172.21.15.154:0/1366991716 >> 172.21.15.154:0/1366991716 conn(0x7f5eac099c40 msgr2=0x7f5eac0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.452+0000 7f5eb1d85700 1 -- 172.21.15.154:0/1366991716 shutdown_connections 2023-09-30T22:24:26.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.452+0000 7f5eb1d85700 1 -- 172.21.15.154:0/1366991716 wait complete. 2023-09-30T22:24:26.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.603+0000 7f6dfefd2700 1 -- 172.21.15.154:0/3533589767 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6df806c3b0 con 0x7f6df809d860 2023-09-30T22:24:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.604+0000 7f6df57fa700 1 -- 172.21.15.154:0/3533589767 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6dec013390 con 0x7f6df809d860 2023-09-30T22:24:26.604 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.606+0000 7f6dfefd2700 1 -- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 msgr2=0x7f6df811d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.606+0000 7f6dfefd2700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df811d080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00d860 tx=0x7f6dec00db70 comp rx=0 tx=0).stop 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.606+0000 7f6dfefd2700 1 -- 172.21.15.154:0/3533589767 shutdown_connections 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.606+0000 7f6dfefd2700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6df8130ce0 0x7f6df811db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.606+0000 7f6dfefd2700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6df809d860 0x7f6df811d080 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.606+0000 7f6dfefd2700 1 --2- 172.21.15.154:0/3533589767 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6df809e170 0x7f6df811d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.606+0000 7f6dfefd2700 1 -- 172.21.15.154:0/3533589767 >> 172.21.15.154:0/3533589767 conn(0x7f6df8099c40 msgr2=0x7f6df812ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.606+0000 7f6dfefd2700 1 -- 172.21.15.154:0/3533589767 shutdown_connections 2023-09-30T22:24:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.606+0000 7f6dfefd2700 1 -- 172.21.15.154:0/3533589767 wait complete. 2023-09-30T22:24:26.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:26.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.631+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/3033493132 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9cc004f2a0 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.632+0000 7f9ca7fff700 1 -- 172.21.15.154:0/3033493132 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cb4011360 con 0x7f9cc00a0ff0 2023-09-30T22:24:26.632 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:26.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.634+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc00a0ff0 msgr2=0x7f9cc011de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.634+0000 7f9cc5bd8700 1 --2- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc00a0ff0 0x7f9cc011de80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4000c00 tx=0x7f9cb400ca90 comp rx=0 tx=0).stop 2023-09-30T22:24:26.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.634+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/3033493132 shutdown_connections 2023-09-30T22:24:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.634+0000 7f9cc5bd8700 1 --2- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9cc0133b80 0x7f9cc011e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.634+0000 7f9cc5bd8700 1 --2- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc0099a60 0x7f9cc011d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.634+0000 7f9cc5bd8700 1 --2- 172.21.15.154:0/3033493132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc00a0ff0 0x7f9cc011de80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.634+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/3033493132 >> 172.21.15.154:0/3033493132 conn(0x7f9cc00a2980 msgr2=0x7f9cc01bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.634+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/3033493132 shutdown_connections 2023-09-30T22:24:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.634+0000 7f9cc5bd8700 1 -- 172.21.15.154:0/3033493132 wait complete. 2023-09-30T22:24:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.643+0000 7faa291d9700 1 -- 172.21.15.154:0/1372764504 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa2404f2a0 con 0x7faa2409f260 2023-09-30T22:24:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.644+0000 7faa0b7fe700 1 -- 172.21.15.154:0/1372764504 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa18017020 con 0x7faa2409f260 2023-09-30T22:24:26.643 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.646+0000 7faa291d9700 1 -- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409f260 msgr2=0x7faa2411f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.646+0000 7faa291d9700 1 --2- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409f260 0x7faa2411f070 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7faa1800c450 tx=0x7faa1800c760 comp rx=0 tx=0).stop 2023-09-30T22:24:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.646+0000 7faa291d9700 1 -- 172.21.15.154:0/1372764504 shutdown_connections 2023-09-30T22:24:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.646+0000 7faa291d9700 1 --2- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa241393c0 0x7faa2411f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.646+0000 7faa291d9700 1 --2- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa2409e950 0x7faa2411eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.646+0000 7faa291d9700 1 --2- 172.21.15.154:0/1372764504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2409f260 0x7faa2411f070 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.646+0000 7faa291d9700 1 -- 172.21.15.154:0/1372764504 >> 172.21.15.154:0/1372764504 conn(0x7faa240a0f70 msgr2=0x7faa24136e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.646+0000 7faa291d9700 1 -- 172.21.15.154:0/1372764504 shutdown_connections 2023-09-30T22:24:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:26.646+0000 7faa291d9700 1 -- 172.21.15.154:0/1372764504 wait complete. 2023-09-30T22:24:26.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:26.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:27.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.593+0000 7fadc280a700 1 Processor -- start 2023-09-30T22:24:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.593+0000 7fadc280a700 1 -- start start 2023-09-30T22:24:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc280a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadbc09d8f0 0x7fadbc09dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc280a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09e200 0x7fadbc138090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc280a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc13a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc280a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc099490 con 0x7fadbc09d8f0 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc280a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc09a7c0 con 0x7fadbc09e200 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc280a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc098f20 con 0x7fadbc1385d0 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadbb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09e200 0x7fadbc138090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc0da7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc13a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadbbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadbc09d8f0 0x7fadbc09dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc0da7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc13a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46856/0 (socket says 172.21.15.154:46856) 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc0da7700 1 -- 172.21.15.154:0/3359639010 learned_addr learned my addr 172.21.15.154:0/3359639010 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadbb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09e200 0x7fadbc138090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60102/0 (socket says 172.21.15.154:60102) 2023-09-30T22:24:27.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadbbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadbc09d8f0 0x7fadbc09dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50842/0 (socket says 172.21.15.154:50842) 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc0da7700 1 -- 172.21.15.154:0/3359639010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09e200 msgr2=0x7fadbc138090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc0da7700 1 --2- 172.21.15.154:0/3359639010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09e200 0x7fadbc138090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc0da7700 1 -- 172.21.15.154:0/3359639010 >> v2:172.21.15.154:3300/0 conn(0x7fadbc09d8f0 msgr2=0x7fadbc09dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc0da7700 1 --2- 172.21.15.154:0/3359639010 >> v2:172.21.15.154:3300/0 conn(0x7fadbc09d8f0 0x7fadbc09dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc0da7700 1 -- 172.21.15.154:0/3359639010 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc09c200 con 0x7fadbc1385d0 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadbb7fe700 1 --2- 172.21.15.154:0/3359639010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09e200 0x7fadbc138090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadbbfff700 1 --2- 172.21.15.154:0/3359639010 >> v2:172.21.15.154:3300/0 conn(0x7fadbc09d8f0 0x7fadbc09dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadc0da7700 1 --2- 172.21.15.154:0/3359639010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc13a9b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009e80 tx=0x7fadb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9724805ade3e11e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadbaffd700 1 -- 172.21.15.154:0/3359639010 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400e070 con 0x7fadbc1385d0 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadbaffd700 1 -- 172.21.15.154:0/3359639010 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb400b8d0 con 0x7fadbc1385d0 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.594+0000 7fadbaffd700 1 -- 172.21.15.154:0/3359639010 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb400bc80 con 0x7fadbc1385d0 2023-09-30T22:24:27.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.595+0000 7fadc280a700 1 -- 172.21.15.154:0/3359639010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 msgr2=0x7fadbc13a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.595+0000 7fadc280a700 1 --2- 172.21.15.154:0/3359639010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc13a9b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009e80 tx=0x7fadb400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.595+0000 7fadc280a700 1 -- 172.21.15.154:0/3359639010 shutdown_connections 2023-09-30T22:24:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.595+0000 7fadc280a700 1 --2- 172.21.15.154:0/3359639010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc13a9b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.595+0000 7fadc280a700 1 --2- 172.21.15.154:0/3359639010 >> v2:172.21.15.154:3300/0 conn(0x7fadbc09d8f0 0x7fadbc09dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.595+0000 7fadc280a700 1 --2- 172.21.15.154:0/3359639010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09e200 0x7fadbc138090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.595+0000 7fadc280a700 1 -- 172.21.15.154:0/3359639010 >> 172.21.15.154:0/3359639010 conn(0x7fadbc0a2b30 msgr2=0x7fadbc09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.595+0000 7fadc280a700 1 -- 172.21.15.154:0/3359639010 shutdown_connections 2023-09-30T22:24:27.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.595+0000 7fadc280a700 1 -- 172.21.15.154:0/3359639010 wait complete. 2023-09-30T22:24:27.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.596+0000 7fadc280a700 1 Processor -- start 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.596+0000 7fadc280a700 1 -- start start 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.596+0000 7fadc280a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09d8f0 0x7fadbc097a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.596+0000 7fadc280a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadbc09e200 0x7fadbc097fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.596+0000 7fadc280a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc08b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadc280a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc08e940 con 0x7fadbc09e200 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadc280a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc08e5a0 con 0x7fadbc09d8f0 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadc280a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0984e0 con 0x7fadbc1385d0 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadc0da7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc08b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadbc09e200 0x7fadbc097fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadc0da7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc08b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46870/0 (socket says 172.21.15.154:46870) 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadc0da7700 1 -- 172.21.15.154:0/2836429064 learned_addr learned my addr 172.21.15.154:0/2836429064 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadbc09e200 0x7fadbc097fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50850/0 (socket says 172.21.15.154:50850) 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbbfff700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09d8f0 0x7fadbc097a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbb7fe700 1 -- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 msgr2=0x7fadbc08b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbb7fe700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc08b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbb7fe700 1 -- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09d8f0 msgr2=0x7fadbc097a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbb7fe700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09d8f0 0x7fadbc097a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbb7fe700 1 -- 172.21.15.154:0/2836429064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0009430 con 0x7fadbc09e200 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadc0da7700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc08b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbbfff700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09d8f0 0x7fadbc097a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadbb7fe700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadbc09e200 0x7fadbc097fa0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fadac00e9b0 tx=0x7fadac00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadb8ff9700 1 -- 172.21.15.154:0/2836429064 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00ee50 con 0x7fadbc09e200 2023-09-30T22:24:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadb8ff9700 1 -- 172.21.15.154:0/2836429064 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac00c850 con 0x7fadbc09e200 2023-09-30T22:24:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadc280a700 1 -- 172.21.15.154:0/2836429064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadac0094a0 con 0x7fadbc09e200 2023-09-30T22:24:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadb8ff9700 1 -- 172.21.15.154:0/2836429064 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00cc00 con 0x7fadbc09e200 2023-09-30T22:24:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.597+0000 7fadc280a700 1 -- 172.21.15.154:0/2836429064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb4009b30 con 0x7fadbc09e200 2023-09-30T22:24:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.598+0000 7fadb8ff9700 1 -- 172.21.15.154:0/2836429064 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadac013470 con 0x7fadbc09e200 2023-09-30T22:24:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.598+0000 7fadc280a700 1 -- 172.21.15.154:0/2836429064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc09d400 con 0x7fadbc09e200 2023-09-30T22:24:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.598+0000 7fadb8ff9700 1 -- 172.21.15.154:0/2836429064 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fadac03f770 con 0x7fadbc09e200 2023-09-30T22:24:27.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.603+0000 7fadb8ff9700 1 -- 172.21.15.154:0/2836429064 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadac017020 con 0x7fadbc09e200 2023-09-30T22:24:27.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:27.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:27.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:27.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.762+0000 7ff847fed700 1 Processor -- start 2023-09-30T22:24:27.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.762+0000 7ff847fed700 1 -- start start 2023-09-30T22:24:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff847fed700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff840133900 0x7ff840133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff847fed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8400a10b0 0x7ff84013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff847fed700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84009a760 con 0x7ff840134210 2023-09-30T22:24:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff847fed700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8401336e0 con 0x7ff840133900 2023-09-30T22:24:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff847fed700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff84009a080 con 0x7ff8400a10b0 2023-09-30T22:24:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff845d89700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff840133900 0x7ff840133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff845d89700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff840133900 0x7ff840133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50858/0 (socket says 172.21.15.154:50858) 2023-09-30T22:24:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff845d89700 1 -- 172.21.15.154:0/3935819945 learned_addr learned my addr 172.21.15.154:0/3935819945 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:27.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff84658a700 1 --2- 172.21.15.154:0/3935819945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8400a10b0 0x7ff84013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff845d89700 1 -- 172.21.15.154:0/3935819945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8400a10b0 msgr2=0x7ff84013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff845d89700 1 --2- 172.21.15.154:0/3935819945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8400a10b0 0x7ff84013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff845d89700 1 -- 172.21.15.154:0/3935819945 >> v1:172.21.15.154:6789/0 conn(0x7ff840134210 legacy=0x7ff8400a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.763+0000 7ff845d89700 1 -- 172.21.15.154:0/3935819945 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400a23e0 con 0x7ff840133900 2023-09-30T22:24:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.764+0000 7ff845d89700 1 --2- 172.21.15.154:0/3935819945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840133900 0x7ff840133cd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff83c006fd0 tx=0x7ff83c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273b238d9a4a5af1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.764+0000 7ff844d87700 1 -- 172.21.15.154:0/3935819945 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c005e30 con 0x7ff840133900 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.764+0000 7ff844d87700 1 -- 172.21.15.154:0/3935819945 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c004030 con 0x7ff840133900 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.764+0000 7ff844d87700 1 -- 172.21.15.154:0/3935819945 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0043e0 con 0x7ff840133900 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.765+0000 7ff847fed700 1 -- 172.21.15.154:0/3935819945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840133900 msgr2=0x7ff840133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.765+0000 7ff847fed700 1 --2- 172.21.15.154:0/3935819945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840133900 0x7ff840133cd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff83c006fd0 tx=0x7ff83c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.765+0000 7ff847fed700 1 -- 172.21.15.154:0/3935819945 shutdown_connections 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.765+0000 7ff847fed700 1 --2- 172.21.15.154:0/3935819945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8400a10b0 0x7ff84013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.765+0000 7ff847fed700 1 --2- 172.21.15.154:0/3935819945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840133900 0x7ff840133cd0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.765+0000 7ff847fed700 1 -- 172.21.15.154:0/3935819945 >> 172.21.15.154:0/3935819945 conn(0x7ff8400a2980 msgr2=0x7ff8400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.765+0000 7ff847fed700 1 -- 172.21.15.154:0/3935819945 shutdown_connections 2023-09-30T22:24:27.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.765+0000 7ff847fed700 1 -- 172.21.15.154:0/3935819945 wait complete. 2023-09-30T22:24:27.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.766+0000 7ff847fed700 1 Processor -- start 2023-09-30T22:24:27.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.766+0000 7ff847fed700 1 -- start start 2023-09-30T22:24:27.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff847fed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8400a10b0 0x7ff84011c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff847fed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff840133900 0x7ff84011cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff847fed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840134210 0x7ff84011d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff847fed700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401200e0 con 0x7ff840134210 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff847fed700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84012fbf0 con 0x7ff8400a10b0 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff847fed700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff84011f660 con 0x7ff840133900 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff845588700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff840133900 0x7ff84011cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff845588700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff840133900 0x7ff84011cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46890/0 (socket says 172.21.15.154:46890) 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff845588700 1 -- 172.21.15.154:0/3116136414 learned_addr learned my addr 172.21.15.154:0/3116136414 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.767+0000 7ff84658a700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840134210 0x7ff84011d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff84658a700 1 -- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff840133900 msgr2=0x7ff84011cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff84658a700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff840133900 0x7ff84011cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff84658a700 1 -- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8400a10b0 msgr2=0x7ff84011c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff845d89700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8400a10b0 0x7ff84011c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff84658a700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8400a10b0 0x7ff84011c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff84658a700 1 -- 172.21.15.154:0/3116136414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c009500 con 0x7ff840134210 2023-09-30T22:24:27.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff84658a700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840134210 0x7ff84011d280 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff838009d90 tx=0x7ff83800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff8367fc700 1 -- 172.21.15.154:0/3116136414 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838009c00 con 0x7ff840134210 2023-09-30T22:24:27.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff8367fc700 1 -- 172.21.15.154:0/3116136414 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83800f040 con 0x7ff840134210 2023-09-30T22:24:27.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff8367fc700 1 -- 172.21.15.154:0/3116136414 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838014480 con 0x7ff840134210 2023-09-30T22:24:27.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff847fed700 1 -- 172.21.15.154:0/3116136414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84011e9f0 con 0x7ff840134210 2023-09-30T22:24:27.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.768+0000 7ff847fed700 1 -- 172.21.15.154:0/3116136414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84009a2c0 con 0x7ff840134210 2023-09-30T22:24:27.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.769+0000 7ff847fed700 1 -- 172.21.15.154:0/3116136414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84004f2a0 con 0x7ff840134210 2023-09-30T22:24:27.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.769+0000 7ff8367fc700 1 -- 172.21.15.154:0/3116136414 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8380145e0 con 0x7ff840134210 2023-09-30T22:24:27.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.769+0000 7ff8367fc700 1 -- 172.21.15.154:0/3116136414 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff838040320 con 0x7ff840134210 2023-09-30T22:24:27.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.770+0000 7ff845d89700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8400a10b0 0x7ff84011c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:27.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.774+0000 7ff8367fc700 1 -- 172.21.15.154:0/3116136414 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff838007900 con 0x7ff840134210 2023-09-30T22:24:27.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.804+0000 7f2db1be4700 1 Processor -- start 2023-09-30T22:24:27.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.804+0000 7f2db1be4700 1 -- start start 2023-09-30T22:24:27.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2db1be4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac133ad0 0x7f2dac133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2db1be4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2dac1300a0 0x7f2dac1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2db1be4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1309f0 0x7f2dac13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2db1be4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac06b2d0 con 0x7f2dac1300a0 2023-09-30T22:24:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2db1be4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac133610 con 0x7f2dac1309f0 2023-09-30T22:24:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2db1be4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac09a500 con 0x7f2dac133ad0 2023-09-30T22:24:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2dab7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac133ad0 0x7f2dac133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2daaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2dac1300a0 0x7f2dac1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2daaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2dac1300a0 0x7f2dac1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50872/0 (socket says 172.21.15.154:50872) 2023-09-30T22:24:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2dab7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac133ad0 0x7f2dac133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46906/0 (socket says 172.21.15.154:46906) 2023-09-30T22:24:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.805+0000 7f2daaffd700 1 -- 172.21.15.154:0/2087729741 learned_addr learned my addr 172.21.15.154:0/2087729741 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:27.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2dabfff700 1 --2- 172.21.15.154:0/2087729741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1309f0 0x7f2dac13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2dab7fe700 1 -- 172.21.15.154:0/2087729741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1309f0 msgr2=0x7f2dac13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2dab7fe700 1 --2- 172.21.15.154:0/2087729741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1309f0 0x7f2dac13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2dab7fe700 1 -- 172.21.15.154:0/2087729741 >> v2:172.21.15.154:3300/0 conn(0x7f2dac1300a0 msgr2=0x7f2dac1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2dab7fe700 1 --2- 172.21.15.154:0/2087729741 >> v2:172.21.15.154:3300/0 conn(0x7f2dac1300a0 0x7f2dac1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2dab7fe700 1 -- 172.21.15.154:0/2087729741 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac1338b0 con 0x7f2dac133ad0 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2dabfff700 1 --2- 172.21.15.154:0/2087729741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1309f0 0x7f2dac13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2daaffd700 1 --2- 172.21.15.154:0/2087729741 >> v2:172.21.15.154:3300/0 conn(0x7f2dac1300a0 0x7f2dac1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2dab7fe700 1 --2- 172.21.15.154:0/2087729741 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac133ad0 0x7f2dac133ea0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009840 tx=0x7f2d9c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d4b12b2e2476da1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.806+0000 7f2daa7fc700 1 -- 172.21.15.154:0/2087729741 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c011830 con 0x7f2dac133ad0 2023-09-30T22:24:27.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.807+0000 7f2daa7fc700 1 -- 172.21.15.154:0/2087729741 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c011990 con 0x7f2dac133ad0 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.807+0000 7f2daa7fc700 1 -- 172.21.15.154:0/2087729741 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c011d20 con 0x7f2dac133ad0 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.807+0000 7f2db1be4700 1 -- 172.21.15.154:0/2087729741 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac133ad0 msgr2=0x7f2dac133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.807+0000 7f2db1be4700 1 --2- 172.21.15.154:0/2087729741 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac133ad0 0x7f2dac133ea0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009840 tx=0x7f2d9c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.807+0000 7f2db1be4700 1 -- 172.21.15.154:0/2087729741 shutdown_connections 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.807+0000 7f2db1be4700 1 --2- 172.21.15.154:0/2087729741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1309f0 0x7f2dac13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.807+0000 7f2db1be4700 1 --2- 172.21.15.154:0/2087729741 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac133ad0 0x7f2dac133ea0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.808+0000 7f2db1be4700 1 --2- 172.21.15.154:0/2087729741 >> v2:172.21.15.154:3300/0 conn(0x7f2dac1300a0 0x7f2dac1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.808+0000 7f2db1be4700 1 -- 172.21.15.154:0/2087729741 >> 172.21.15.154:0/2087729741 conn(0x7f2dac099c40 msgr2=0x7f2dac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.808+0000 7f2db1be4700 1 -- 172.21.15.154:0/2087729741 shutdown_connections 2023-09-30T22:24:27.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.808+0000 7f2db1be4700 1 -- 172.21.15.154:0/2087729741 wait complete. 2023-09-30T22:24:27.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.808+0000 7f631f16f700 1 Processor -- start 2023-09-30T22:24:27.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.808+0000 7f631f16f700 1 -- start start 2023-09-30T22:24:27.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.808+0000 7fadc280a700 1 -- 172.21.15.154:0/2836429064 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fadbc09a170 con 0x7fadbc09e200 2023-09-30T22:24:27.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f2db1be4700 1 Processor -- start 2023-09-30T22:24:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f631f16f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f631812d380 0x7f631812d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f631f16f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6318099a60 0x7f6318099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f631f16f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f631809a3d0 0x7f6318137610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f631f16f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631809bb90 con 0x7f631809a3d0 2023-09-30T22:24:27.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f631f16f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631809c210 con 0x7f6318099a60 2023-09-30T22:24:27.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f631f16f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f631809a870 con 0x7f631812d380 2023-09-30T22:24:27.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f2db1be4700 1 -- start start 2023-09-30T22:24:27.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f6317fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6318099a60 0x7f6318099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f6317fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6318099a60 0x7f6318099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60126/0 (socket says 172.21.15.154:60126) 2023-09-30T22:24:27.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f6317fff700 1 -- 172.21.15.154:0/99246844 learned_addr learned my addr 172.21.15.154:0/99246844 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:27.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7f631d70c700 1 --2- 172.21.15.154:0/99246844 >> v2:172.21.15.154:3300/0 conn(0x7f631809a3d0 0x7f6318137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.809+0000 7fadb8ff9700 1 -- 172.21.15.154:0/2836429064 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadac013720 con 0x7fadbc09e200 2023-09-30T22:24:27.813 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:27.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f6317fff700 1 -- 172.21.15.154:0/99246844 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f631812d380 msgr2=0x7f631812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f6317fff700 1 --2- 172.21.15.154:0/99246844 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f631812d380 0x7f631812d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f6317fff700 1 -- 172.21.15.154:0/99246844 >> v2:172.21.15.154:3300/0 conn(0x7f631809a3d0 msgr2=0x7f6318137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:27.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f6317fff700 1 --2- 172.21.15.154:0/99246844 >> v2:172.21.15.154:3300/0 conn(0x7f631809a3d0 0x7f6318137610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f6317fff700 1 -- 172.21.15.154:0/99246844 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631809ced0 con 0x7f6318099a60 2023-09-30T22:24:27.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2db1be4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1300a0 0x7f2dac11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2db1be4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac1309f0 0x7f2dac11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2db1be4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dac133ad0 0x7f2dac11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2db1be4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac11f2e0 con 0x7f2dac133ad0 2023-09-30T22:24:27.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2db1be4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac11fda0 con 0x7f2dac1300a0 2023-09-30T22:24:27.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2db1be4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac12d8f0 con 0x7f2dac1309f0 2023-09-30T22:24:27.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f6317fff700 1 --2- 172.21.15.154:0/99246844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6318099a60 0x7f6318099e90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f630400bb90 tx=0x7f630400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89fc026f581a1bd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2dab7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1300a0 0x7f2dac11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2dab7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1300a0 0x7f2dac11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60128/0 (socket says 172.21.15.154:60128) 2023-09-30T22:24:27.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2dab7fe700 1 -- 172.21.15.154:0/103949064 learned_addr learned my addr 172.21.15.154:0/103949064 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:27.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f63177fe700 1 -- 172.21.15.154:0/99246844 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400dd30 con 0x7f6318099a60 2023-09-30T22:24:27.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f63177fe700 1 -- 172.21.15.154:0/99246844 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630400de90 con 0x7f6318099a60 2023-09-30T22:24:27.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f63177fe700 1 -- 172.21.15.154:0/99246844 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304010690 con 0x7f6318099a60 2023-09-30T22:24:27.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2dab7fe700 1 -- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac1309f0 msgr2=0x7f2dac11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2dab7fe700 1 --2- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac1309f0 0x7f2dac11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2dab7fe700 1 -- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dac133ad0 msgr2=0x7f2dac11e4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2dab7fe700 1 --2- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dac133ad0 0x7f2dac11e4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2dab7fe700 1 -- 172.21.15.154:0/103949064 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0009550 con 0x7f2dac1300a0 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.810+0000 7f2dab7fe700 1 --2- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1300a0 0x7f2dac11da40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0090b0 tx=0x7f2d9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f2d93fff700 1 -- 172.21.15.154:0/103949064 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c004590 con 0x7f2dac1300a0 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f2d93fff700 1 -- 172.21.15.154:0/103949064 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c0036a0 con 0x7f2dac1300a0 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f2db1be4700 1 -- 172.21.15.154:0/103949064 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da4009a70 con 0x7f2dac1300a0 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f2d93fff700 1 -- 172.21.15.154:0/103949064 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c003a30 con 0x7f2dac1300a0 2023-09-30T22:24:27.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f2db1be4700 1 -- 172.21.15.154:0/103949064 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c0094a0 con 0x7f2dac1300a0 2023-09-30T22:24:27.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f631f16f700 1 -- 172.21.15.154:0/99246844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6318099a60 msgr2=0x7f6318099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f631f16f700 1 --2- 172.21.15.154:0/99246844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6318099a60 0x7f6318099e90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f630400bb90 tx=0x7f630400bea0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f631f16f700 1 -- 172.21.15.154:0/99246844 shutdown_connections 2023-09-30T22:24:27.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f631f16f700 1 --2- 172.21.15.154:0/99246844 >> v2:172.21.15.154:3300/0 conn(0x7f631809a3d0 0x7f6318137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f631f16f700 1 --2- 172.21.15.154:0/99246844 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f631812d380 0x7f631812d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f631f16f700 1 --2- 172.21.15.154:0/99246844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6318099a60 0x7f6318099e90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.811+0000 7f631f16f700 1 -- 172.21.15.154:0/99246844 >> 172.21.15.154:0/99246844 conn(0x7f63180a2980 msgr2=0x7f63180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.812+0000 7f631f16f700 1 -- 172.21.15.154:0/99246844 shutdown_connections 2023-09-30T22:24:27.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.812+0000 7f631f16f700 1 -- 172.21.15.154:0/99246844 wait complete. 2023-09-30T22:24:27.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.812+0000 7f2db1be4700 1 -- 172.21.15.154:0/103949064 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac11fbe0 con 0x7f2dac1300a0 2023-09-30T22:24:27.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.812+0000 7f2d93fff700 1 -- 172.21.15.154:0/103949064 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d9c003b90 con 0x7f2dac1300a0 2023-09-30T22:24:27.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.813+0000 7f2d93fff700 1 -- 172.21.15.154:0/103949064 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d9c040720 con 0x7f2dac1300a0 2023-09-30T22:24:27.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.813+0000 7fadc280a700 1 -- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadbc09e200 msgr2=0x7fadbc097fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.813+0000 7fadc280a700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadbc09e200 0x7fadbc097fa0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fadac00e9b0 tx=0x7fadac00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.813+0000 7f631f16f700 1 Processor -- start 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.813+0000 7f631f16f700 1 -- start start 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.814+0000 7f631f16f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6318099a60 0x7f631811ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.814+0000 7f631f16f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f631809a3d0 0x7f631811b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.814+0000 7f631f16f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63181cc8b0 0x7f63181ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.814+0000 7f631f16f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6318126810 con 0x7f63181cc8b0 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.814+0000 7f631f16f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631811a950 con 0x7f631809a3d0 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.814+0000 7f631f16f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f631811c0b0 con 0x7f6318099a60 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.814+0000 7f631cf0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6318099a60 0x7f631811ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.814+0000 7f631cf0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6318099a60 0x7f631811ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46946/0 (socket says 172.21.15.154:46946) 2023-09-30T22:24:27.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.814+0000 7f631cf0b700 1 -- 172.21.15.154:0/3682056171 learned_addr learned my addr 172.21.15.154:0/3682056171 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631cf0b700 1 -- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f631809a3d0 msgr2=0x7f631811b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f6317fff700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f631809a3d0 0x7f631811b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631cf0b700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f631809a3d0 0x7f631811b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631cf0b700 1 -- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63181cc8b0 msgr2=0x7f63181ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631d70c700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63181cc8b0 0x7f63181ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631cf0b700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63181cc8b0 0x7f63181ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631cf0b700 1 -- 172.21.15.154:0/3682056171 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630400b7f0 con 0x7f6318099a60 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f6317fff700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f631809a3d0 0x7f631811b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631d70c700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63181cc8b0 0x7f63181ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631cf0b700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6318099a60 0x7f631811ad40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f630c00b500 tx=0x7f630c00b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f63157fa700 1 -- 172.21.15.154:0/3682056171 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c005aa0 con 0x7f6318099a60 2023-09-30T22:24:27.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f63157fa700 1 -- 172.21.15.154:0/3682056171 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c005c00 con 0x7f6318099a60 2023-09-30T22:24:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f63157fa700 1 -- 172.21.15.154:0/3682056171 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c011630 con 0x7f6318099a60 2023-09-30T22:24:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631f16f700 1 -- 172.21.15.154:0/3682056171 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631809eeb0 con 0x7f6318099a60 2023-09-30T22:24:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.815+0000 7f631f16f700 1 -- 172.21.15.154:0/3682056171 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631811c8a0 con 0x7f6318099a60 2023-09-30T22:24:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.816+0000 7f63157fa700 1 -- 172.21.15.154:0/3682056171 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f630c011790 con 0x7f6318099a60 2023-09-30T22:24:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.816+0000 7f63157fa700 1 -- 172.21.15.154:0/3682056171 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f630c03f2d0 con 0x7f6318099a60 2023-09-30T22:24:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.816+0000 7f631f16f700 1 -- 172.21.15.154:0/3682056171 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631804f2a0 con 0x7f6318099a60 2023-09-30T22:24:27.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.817+0000 7fadc280a700 1 -- 172.21.15.154:0/2836429064 shutdown_connections 2023-09-30T22:24:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.817+0000 7fadc280a700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadbc1385d0 0x7fadbc08b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.817+0000 7fadc280a700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadbc09d8f0 0x7fadbc097a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.817+0000 7fadc280a700 1 --2- 172.21.15.154:0/2836429064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadbc09e200 0x7fadbc097fa0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.817+0000 7fadc280a700 1 -- 172.21.15.154:0/2836429064 >> 172.21.15.154:0/2836429064 conn(0x7fadbc0a2b30 msgr2=0x7fadbc070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.817+0000 7fadc280a700 1 -- 172.21.15.154:0/2836429064 shutdown_connections 2023-09-30T22:24:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.817+0000 7fadc280a700 1 -- 172.21.15.154:0/2836429064 wait complete. 2023-09-30T22:24:27.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.817+0000 7f2d93fff700 1 -- 172.21.15.154:0/103949064 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d9c01a420 con 0x7f2dac1300a0 2023-09-30T22:24:27.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:27.826+0000 7f63157fa700 1 -- 172.21.15.154:0/3682056171 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f630c005fd0 con 0x7f6318099a60 2023-09-30T22:24:27.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:28.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.012+0000 7f2db1be4700 1 -- 172.21.15.154:0/103949064 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2dac04f2a0 con 0x7f2dac1300a0 2023-09-30T22:24:28.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.012+0000 7f2d93fff700 1 -- 172.21.15.154:0/103949064 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d9c028020 con 0x7f2dac1300a0 2023-09-30T22:24:28.012 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.014+0000 7f2db1be4700 1 -- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1300a0 msgr2=0x7f2dac11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.014+0000 7f2db1be4700 1 --2- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1300a0 0x7f2dac11da40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0090b0 tx=0x7f2d9c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:28.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.014+0000 7f2db1be4700 1 -- 172.21.15.154:0/103949064 shutdown_connections 2023-09-30T22:24:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.014+0000 7f2db1be4700 1 --2- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dac133ad0 0x7f2dac11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.014+0000 7f2db1be4700 1 --2- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2dac1300a0 0x7f2dac11da40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.014+0000 7f2db1be4700 1 --2- 172.21.15.154:0/103949064 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2dac1309f0 0x7f2dac11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.014+0000 7f2db1be4700 1 -- 172.21.15.154:0/103949064 >> 172.21.15.154:0/103949064 conn(0x7f2dac099c40 msgr2=0x7f2dac132080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.014+0000 7f2db1be4700 1 -- 172.21.15.154:0/103949064 shutdown_connections 2023-09-30T22:24:28.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.014+0000 7f2db1be4700 1 -- 172.21.15.154:0/103949064 wait complete. 2023-09-30T22:24:28.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.017+0000 7ff847fed700 1 -- 172.21.15.154:0/3116136414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff84006bce0 con 0x7ff840134210 2023-09-30T22:24:28.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.017+0000 7ff8367fc700 1 -- 172.21.15.154:0/3116136414 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff838018020 con 0x7ff840134210 2023-09-30T22:24:28.017 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:28.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.019+0000 7ff847fed700 1 -- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840134210 msgr2=0x7ff84011d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.019+0000 7ff847fed700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840134210 0x7ff84011d280 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff838009d90 tx=0x7ff83800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.019+0000 7ff847fed700 1 -- 172.21.15.154:0/3116136414 shutdown_connections 2023-09-30T22:24:28.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.019+0000 7ff847fed700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff840134210 0x7ff84011d280 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.019+0000 7ff847fed700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8400a10b0 0x7ff84011c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.019+0000 7ff847fed700 1 --2- 172.21.15.154:0/3116136414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff840133900 0x7ff84011cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.019+0000 7ff847fed700 1 -- 172.21.15.154:0/3116136414 >> 172.21.15.154:0/3116136414 conn(0x7ff8400a2980 msgr2=0x7ff8401bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.019+0000 7ff847fed700 1 -- 172.21.15.154:0/3116136414 shutdown_connections 2023-09-30T22:24:28.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.020+0000 7ff847fed700 1 -- 172.21.15.154:0/3116136414 wait complete. 2023-09-30T22:24:28.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:28.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:28.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.051+0000 7f631f16f700 1 -- 172.21.15.154:0/3682056171 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6318127200 con 0x7f6318099a60 2023-09-30T22:24:28.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.051+0000 7f63157fa700 1 -- 172.21.15.154:0/3682056171 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f630c029090 con 0x7f6318099a60 2023-09-30T22:24:28.051 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:28.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.053+0000 7f631f16f700 1 -- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6318099a60 msgr2=0x7f631811ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.053+0000 7f631f16f700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6318099a60 0x7f631811ad40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f630c00b500 tx=0x7f630c00b8c0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.053+0000 7f631f16f700 1 -- 172.21.15.154:0/3682056171 shutdown_connections 2023-09-30T22:24:28.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.053+0000 7f631f16f700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63181cc8b0 0x7f63181ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.053+0000 7f631f16f700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6318099a60 0x7f631811ad40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.053+0000 7f631f16f700 1 --2- 172.21.15.154:0/3682056171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f631809a3d0 0x7f631811b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.053+0000 7f631f16f700 1 -- 172.21.15.154:0/3682056171 >> 172.21.15.154:0/3682056171 conn(0x7f63180a2980 msgr2=0x7f631809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.053+0000 7f631f16f700 1 -- 172.21.15.154:0/3682056171 shutdown_connections 2023-09-30T22:24:28.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.053+0000 7f631f16f700 1 -- 172.21.15.154:0/3682056171 wait complete. 2023-09-30T22:24:28.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:28.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.959+0000 7ffa555c5700 1 Processor -- start 2023-09-30T22:24:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.959+0000 7ffa555c5700 1 -- start start 2023-09-30T22:24:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa555c5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa50133ad0 0x7ffa50133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa555c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50130bc0 0x7ffa5013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa555c5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5006b2d0 con 0x7ffa501300a0 2023-09-30T22:24:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa555c5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa50133610 con 0x7ffa50133ad0 2023-09-30T22:24:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa555c5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5009a500 con 0x7ffa50130bc0 2023-09-30T22:24:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50130bc0 0x7ffa5013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa50133ad0 0x7ffa50133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50130bc0 0x7ffa5013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60146/0 (socket says 172.21.15.154:60146) 2023-09-30T22:24:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4f7fe700 1 -- 172.21.15.154:0/1152686342 learned_addr learned my addr 172.21.15.154:0/1152686342 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4f7fe700 1 -- 172.21.15.154:0/1152686342 >> v2:172.21.15.154:3300/0 conn(0x7ffa50133ad0 msgr2=0x7ffa50133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4f7fe700 1 --2- 172.21.15.154:0/1152686342 >> v2:172.21.15.154:3300/0 conn(0x7ffa50133ad0 0x7ffa50133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4f7fe700 1 -- 172.21.15.154:0/1152686342 >> v1:172.21.15.154:6789/0 conn(0x7ffa501300a0 legacy=0x7ffa501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4f7fe700 1 -- 172.21.15.154:0/1152686342 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa501338b0 con 0x7ffa50130bc0 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4effd700 1 --2- 172.21.15.154:0/1152686342 >> v2:172.21.15.154:3300/0 conn(0x7ffa50133ad0 0x7ffa50133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4f7fe700 1 --2- 172.21.15.154:0/1152686342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50130bc0 0x7ffa5013b990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009e50 tx=0x7ffa4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52e1500341144720 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4dffb700 1 -- 172.21.15.154:0/1152686342 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800e070 con 0x7ffa50130bc0 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4dffb700 1 -- 172.21.15.154:0/1152686342 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4800b910 con 0x7ffa50130bc0 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.960+0000 7ffa4dffb700 1 -- 172.21.15.154:0/1152686342 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800bcc0 con 0x7ffa50130bc0 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.961+0000 7ffa555c5700 1 -- 172.21.15.154:0/1152686342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50130bc0 msgr2=0x7ffa5013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.961+0000 7ffa555c5700 1 --2- 172.21.15.154:0/1152686342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50130bc0 0x7ffa5013b990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009e50 tx=0x7ffa4800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.961+0000 7ffa555c5700 1 -- 172.21.15.154:0/1152686342 shutdown_connections 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.961+0000 7ffa555c5700 1 --2- 172.21.15.154:0/1152686342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50130bc0 0x7ffa5013b990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.961+0000 7ffa555c5700 1 --2- 172.21.15.154:0/1152686342 >> v2:172.21.15.154:3300/0 conn(0x7ffa50133ad0 0x7ffa50133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.961+0000 7ffa555c5700 1 -- 172.21.15.154:0/1152686342 >> 172.21.15.154:0/1152686342 conn(0x7ffa50099c40 msgr2=0x7ffa500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.961+0000 7ffa555c5700 1 -- 172.21.15.154:0/1152686342 shutdown_connections 2023-09-30T22:24:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.961+0000 7ffa555c5700 1 -- 172.21.15.154:0/1152686342 wait complete. 2023-09-30T22:24:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.962+0000 7ffa555c5700 1 Processor -- start 2023-09-30T22:24:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.962+0000 7ffa555c5700 1 -- start start 2023-09-30T22:24:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.962+0000 7ffa555c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa501300a0 0x7ffa5011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa555c5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa50130bc0 0x7ffa5011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa555c5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50133ad0 0x7ffa5011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa555c5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5012d8f0 con 0x7ffa50133ad0 2023-09-30T22:24:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa555c5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5011ffa0 con 0x7ffa501300a0 2023-09-30T22:24:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa555c5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5012dd00 con 0x7ffa50130bc0 2023-09-30T22:24:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa501300a0 0x7ffa5011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa501300a0 0x7ffa5011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60162/0 (socket says 172.21.15.154:60162) 2023-09-30T22:24:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4effd700 1 -- 172.21.15.154:0/2846518819 learned_addr learned my addr 172.21.15.154:0/2846518819 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4f7fe700 1 --2- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50133ad0 0x7ffa5011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4e7fc700 1 --2- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa50130bc0 0x7ffa5011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4effd700 1 -- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa50130bc0 msgr2=0x7ffa5011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4effd700 1 --2- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa50130bc0 0x7ffa5011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4effd700 1 -- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50133ad0 msgr2=0x7ffa5011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4effd700 1 --2- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50133ad0 0x7ffa5011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4effd700 1 -- 172.21.15.154:0/2846518819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa440094a0 con 0x7ffa501300a0 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa4effd700 1 --2- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa501300a0 0x7ffa5011da40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400ebe0 tx=0x7ffa4400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa377fe700 1 -- 172.21.15.154:0/2846518819 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44009800 con 0x7ffa501300a0 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa377fe700 1 -- 172.21.15.154:0/2846518819 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4400c910 con 0x7ffa501300a0 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa555c5700 1 -- 172.21.15.154:0/2846518819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa48009b30 con 0x7ffa501300a0 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa377fe700 1 -- 172.21.15.154:0/2846518819 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4400cc80 con 0x7ffa501300a0 2023-09-30T22:24:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.963+0000 7ffa555c5700 1 -- 172.21.15.154:0/2846518819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5011f2e0 con 0x7ffa501300a0 2023-09-30T22:24:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.964+0000 7ffa377fe700 1 -- 172.21.15.154:0/2846518819 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa44013470 con 0x7ffa501300a0 2023-09-30T22:24:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.964+0000 7ffa377fe700 1 -- 172.21.15.154:0/2846518819 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa4403fba0 con 0x7ffa501300a0 2023-09-30T22:24:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.964+0000 7ffa555c5700 1 -- 172.21.15.154:0/2846518819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5004f2a0 con 0x7ffa501300a0 2023-09-30T22:24:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:28.969+0000 7ffa377fe700 1 -- 172.21.15.154:0/2846518819 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa44021080 con 0x7ffa501300a0 2023-09-30T22:24:29.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:29.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:29.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:29.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.158+0000 7f4a0dc4f700 1 Processor -- start 2023-09-30T22:24:29.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.158+0000 7f4a0dc4f700 1 -- start start 2023-09-30T22:24:29.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.158+0000 7f4a0dc4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a080a0a30 0x7f4a080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.158+0000 7f4a0dc4f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a080a1340 0x7f4a0812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.158+0000 7f4a0dc4f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a081304a0 0x7f4a081308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.158+0000 7f4a0dc4f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a08130e30 con 0x7f4a081304a0 2023-09-30T22:24:29.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.158+0000 7f4a0dc4f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080a1e70 con 0x7f4a080a1340 2023-09-30T22:24:29.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.158+0000 7f4a0dc4f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0809a720 con 0x7f4a080a0a30 2023-09-30T22:24:29.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a06ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a080a1340 0x7f4a0812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a06ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a080a1340 0x7f4a0812ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60172/0 (socket says 172.21.15.154:60172) 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a06ffd700 1 -- 172.21.15.154:0/252269177 learned_addr learned my addr 172.21.15.154:0/252269177 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a07fff700 1 --2- 172.21.15.154:0/252269177 >> v2:172.21.15.154:3300/0 conn(0x7f4a081304a0 0x7f4a081308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a077fe700 1 --2- 172.21.15.154:0/252269177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a080a0a30 0x7f4a080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a06ffd700 1 -- 172.21.15.154:0/252269177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a080a0a30 msgr2=0x7f4a080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a06ffd700 1 --2- 172.21.15.154:0/252269177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a080a0a30 0x7f4a080a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a06ffd700 1 -- 172.21.15.154:0/252269177 >> v2:172.21.15.154:3300/0 conn(0x7f4a081304a0 msgr2=0x7f4a081308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a06ffd700 1 --2- 172.21.15.154:0/252269177 >> v2:172.21.15.154:3300/0 conn(0x7f4a081304a0 0x7f4a081308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a06ffd700 1 -- 172.21.15.154:0/252269177 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0809b300 con 0x7f4a080a1340 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a06ffd700 1 --2- 172.21.15.154:0/252269177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a080a1340 0x7f4a0812ff60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00aa90 tx=0x7f49fc00ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e170ae37d3bc7bec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a067fc700 1 -- 172.21.15.154:0/252269177 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00cb70 con 0x7f4a080a1340 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a067fc700 1 -- 172.21.15.154:0/252269177 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc00ccd0 con 0x7f4a080a1340 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.159+0000 7f4a067fc700 1 -- 172.21.15.154:0/252269177 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc018620 con 0x7f4a080a1340 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.160+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/252269177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a080a1340 msgr2=0x7f4a0812ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.160+0000 7f4a0dc4f700 1 --2- 172.21.15.154:0/252269177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a080a1340 0x7f4a0812ff60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00aa90 tx=0x7f49fc00ada0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.160+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/252269177 shutdown_connections 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.160+0000 7f4a0dc4f700 1 --2- 172.21.15.154:0/252269177 >> v2:172.21.15.154:3300/0 conn(0x7f4a081304a0 0x7f4a081308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.160+0000 7f4a0dc4f700 1 --2- 172.21.15.154:0/252269177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a080a0a30 0x7f4a080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.160+0000 7f4a0dc4f700 1 --2- 172.21.15.154:0/252269177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a080a1340 0x7f4a0812ff60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.160+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/252269177 >> 172.21.15.154:0/252269177 conn(0x7f4a080a2980 msgr2=0x7f4a080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.160+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/252269177 shutdown_connections 2023-09-30T22:24:29.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.160+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/252269177 wait complete. 2023-09-30T22:24:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.161+0000 7f4a0dc4f700 1 Processor -- start 2023-09-30T22:24:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.161+0000 7f4a0dc4f700 1 -- start start 2023-09-30T22:24:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a0dc4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a080a0a30 0x7f4a0812f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a0dc4f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a080a1340 0x7f4a0812f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a0dc4f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a081304a0 0x7f4a081c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a0dc4f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0811d860 con 0x7f4a080a1340 2023-09-30T22:24:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a0dc4f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0809eec0 con 0x7f4a081304a0 2023-09-30T22:24:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a0dc4f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0809ae00 con 0x7f4a080a0a30 2023-09-30T22:24:29.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a07fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a081304a0 0x7f4a081c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a07fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a081304a0 0x7f4a081c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60174/0 (socket says 172.21.15.154:60174) 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a07fff700 1 -- 172.21.15.154:0/4174905100 learned_addr learned my addr 172.21.15.154:0/4174905100 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a06ffd700 1 --2- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a080a1340 0x7f4a0812f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a07fff700 1 -- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a080a0a30 msgr2=0x7f4a0812f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a07fff700 1 --2- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a080a0a30 0x7f4a0812f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a07fff700 1 -- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a080a1340 msgr2=0x7f4a0812f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a07fff700 1 --2- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a080a1340 0x7f4a0812f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a07fff700 1 -- 172.21.15.154:0/4174905100 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc00a6f0 con 0x7f4a081304a0 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a06ffd700 1 --2- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a080a1340 0x7f4a0812f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f4a07fff700 1 --2- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a081304a0 0x7f4a081c8250 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000efc0 tx=0x7f4a0000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.162+0000 7f49effff700 1 -- 172.21.15.154:0/4174905100 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00009ea0 con 0x7f4a081304a0 2023-09-30T22:24:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.163+0000 7f49effff700 1 -- 172.21.15.154:0/4174905100 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0000f040 con 0x7f4a081304a0 2023-09-30T22:24:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.163+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/4174905100 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0811e940 con 0x7f4a081304a0 2023-09-30T22:24:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.163+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/4174905100 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0811dc40 con 0x7f4a081304a0 2023-09-30T22:24:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.163+0000 7f49effff700 1 -- 172.21.15.154:0/4174905100 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00014480 con 0x7f4a081304a0 2023-09-30T22:24:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.164+0000 7f49effff700 1 -- 172.21.15.154:0/4174905100 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a000145e0 con 0x7f4a081304a0 2023-09-30T22:24:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.164+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/4174905100 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0811ead0 con 0x7f4a081304a0 2023-09-30T22:24:29.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.164+0000 7f49effff700 1 -- 172.21.15.154:0/4174905100 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4a00040000 con 0x7f4a081304a0 2023-09-30T22:24:29.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.167+0000 7ffa555c5700 1 -- 172.21.15.154:0/2846518819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa50071690 con 0x7ffa501300a0 2023-09-30T22:24:29.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.168+0000 7ffa377fe700 1 -- 172.21.15.154:0/2846518819 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa44017020 con 0x7ffa501300a0 2023-09-30T22:24:29.168 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:29.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.169+0000 7f49effff700 1 -- 172.21.15.154:0/4174905100 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a0811ead0 con 0x7f4a081304a0 2023-09-30T22:24:29.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.171+0000 7ffa555c5700 1 -- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa501300a0 msgr2=0x7ffa5011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.171+0000 7ffa555c5700 1 --2- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa501300a0 0x7ffa5011da40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400ebe0 tx=0x7ffa4400eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.171+0000 7ffa555c5700 1 -- 172.21.15.154:0/2846518819 shutdown_connections 2023-09-30T22:24:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.171+0000 7ffa555c5700 1 --2- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50133ad0 0x7ffa5011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.171+0000 7ffa555c5700 1 --2- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa501300a0 0x7ffa5011da40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.171+0000 7ffa555c5700 1 --2- 172.21.15.154:0/2846518819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa50130bc0 0x7ffa5011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.172+0000 7ffa555c5700 1 -- 172.21.15.154:0/2846518819 >> 172.21.15.154:0/2846518819 conn(0x7ffa50099c40 msgr2=0x7ffa5012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.172+0000 7ffa555c5700 1 -- 172.21.15.154:0/2846518819 shutdown_connections 2023-09-30T22:24:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.172+0000 7ffa555c5700 1 -- 172.21.15.154:0/2846518819 wait complete. 2023-09-30T22:24:29.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:29.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.204+0000 7fe1c0fd5700 1 Processor -- start 2023-09-30T22:24:29.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.204+0000 7fe1c0fd5700 1 -- start start 2023-09-30T22:24:29.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.204+0000 7f82d375a700 1 Processor -- start 2023-09-30T22:24:29.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.204+0000 7f82d375a700 1 -- start start 2023-09-30T22:24:29.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1c0fd5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1bc09f350 0x7fe1bc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1c0fd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc1371c0 0x7fe1bc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1c0fd5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1bc09c970 con 0x7fe1bc09e870 2023-09-30T22:24:29.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1c0fd5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1bc0a0920 con 0x7fe1bc09f350 2023-09-30T22:24:29.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1c0fd5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc09f9c0 con 0x7fe1bc1371c0 2023-09-30T22:24:29.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1bad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc1371c0 0x7fe1bc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1b9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1bc09f350 0x7fe1bc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1bad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc1371c0 0x7fe1bc1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60180/0 (socket says 172.21.15.154:60180) 2023-09-30T22:24:29.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1bad9d700 1 -- 172.21.15.154:0/3030007119 learned_addr learned my addr 172.21.15.154:0/3030007119 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:29.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d375a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc133b80 0x7f82cc133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d375a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82cc099a60 0x7f82cc0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d375a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc0a0e20 0x7f82cc0a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d375a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc09aa00 con 0x7f82cc099a60 2023-09-30T22:24:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d375a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc09a080 con 0x7f82cc0a0e20 2023-09-30T22:24:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d375a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc133750 con 0x7f82cc133b80 2023-09-30T22:24:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d1cf7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc0a0e20 0x7f82cc0a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d1cf7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc0a0e20 0x7f82cc0a12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60186/0 (socket says 172.21.15.154:60186) 2023-09-30T22:24:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d1cf7700 1 -- 172.21.15.154:0/1291543442 learned_addr learned my addr 172.21.15.154:0/1291543442 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:29.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7f82d0cf5700 1 --2- 172.21.15.154:0/1291543442 >> v2:172.21.15.154:3300/0 conn(0x7f82cc099a60 0x7f82cc0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1bad9d700 1 -- 172.21.15.154:0/3030007119 >> v2:172.21.15.154:3300/0 conn(0x7fe1bc09f350 msgr2=0x7fe1bc136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1bad9d700 1 --2- 172.21.15.154:0/3030007119 >> v2:172.21.15.154:3300/0 conn(0x7fe1bc09f350 0x7fe1bc136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1bad9d700 1 -- 172.21.15.154:0/3030007119 >> v1:172.21.15.154:6789/0 conn(0x7fe1bc09e870 legacy=0x7fe1bc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.205+0000 7fe1bad9d700 1 -- 172.21.15.154:0/3030007119 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc09bab0 con 0x7fe1bc1371c0 2023-09-30T22:24:29.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7fe1bad9d700 1 --2- 172.21.15.154:0/3030007119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc1371c0 0x7fe1bc1395a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009e50 tx=0x7fe1b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52cc2895e7c9d8e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82d14f6700 1 --2- 172.21.15.154:0/1291543442 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc133b80 0x7f82cc133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82d1cf7700 1 -- 172.21.15.154:0/1291543442 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc133b80 msgr2=0x7f82cc133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82d1cf7700 1 --2- 172.21.15.154:0/1291543442 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc133b80 0x7f82cc133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82d1cf7700 1 -- 172.21.15.154:0/1291543442 >> v2:172.21.15.154:3300/0 conn(0x7f82cc099a60 msgr2=0x7f82cc0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:29.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82d1cf7700 1 --2- 172.21.15.154:0/1291543442 >> v2:172.21.15.154:3300/0 conn(0x7f82cc099a60 0x7f82cc0a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82d1cf7700 1 -- 172.21.15.154:0/1291543442 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc09a760 con 0x7f82cc0a0e20 2023-09-30T22:24:29.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82d0cf5700 1 --2- 172.21.15.154:0/1291543442 >> v2:172.21.15.154:3300/0 conn(0x7f82cc099a60 0x7f82cc0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7fe1b959a700 1 -- 172.21.15.154:0/3030007119 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b400e070 con 0x7fe1bc1371c0 2023-09-30T22:24:29.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82d1cf7700 1 --2- 172.21.15.154:0/1291543442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc0a0e20 0x7f82cc0a12a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009e50 tx=0x7f82c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2383770789e9e665 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7fe1b959a700 1 -- 172.21.15.154:0/3030007119 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b400b910 con 0x7fe1bc1371c0 2023-09-30T22:24:29.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7fe1b959a700 1 -- 172.21.15.154:0/3030007119 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b400bcc0 con 0x7fe1bc1371c0 2023-09-30T22:24:29.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82c3fff700 1 -- 172.21.15.154:0/1291543442 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400e070 con 0x7f82cc0a0e20 2023-09-30T22:24:29.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82c3fff700 1 -- 172.21.15.154:0/1291543442 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c400b910 con 0x7f82cc0a0e20 2023-09-30T22:24:29.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.206+0000 7f82c3fff700 1 -- 172.21.15.154:0/1291543442 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400bcc0 con 0x7f82cc0a0e20 2023-09-30T22:24:29.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3030007119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc1371c0 msgr2=0x7fe1bc1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7fe1c0fd5700 1 --2- 172.21.15.154:0/3030007119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc1371c0 0x7fe1bc1395a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009e50 tx=0x7fe1b400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:29.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7f82d375a700 1 -- 172.21.15.154:0/1291543442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc0a0e20 msgr2=0x7f82cc0a12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7f82d375a700 1 --2- 172.21.15.154:0/1291543442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc0a0e20 0x7f82cc0a12a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009e50 tx=0x7f82c400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:29.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3030007119 shutdown_connections 2023-09-30T22:24:29.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7fe1c0fd5700 1 --2- 172.21.15.154:0/3030007119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc1371c0 0x7fe1bc1395a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7fe1c0fd5700 1 --2- 172.21.15.154:0/3030007119 >> v2:172.21.15.154:3300/0 conn(0x7fe1bc09f350 0x7fe1bc136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3030007119 >> 172.21.15.154:0/3030007119 conn(0x7fe1bc0a4430 msgr2=0x7fe1bc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7f82d375a700 1 -- 172.21.15.154:0/1291543442 shutdown_connections 2023-09-30T22:24:29.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7f82d375a700 1 --2- 172.21.15.154:0/1291543442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc0a0e20 0x7f82cc0a12a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7f82d375a700 1 --2- 172.21.15.154:0/1291543442 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc133b80 0x7f82cc133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7f82d375a700 1 --2- 172.21.15.154:0/1291543442 >> v2:172.21.15.154:3300/0 conn(0x7f82cc099a60 0x7f82cc0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7f82d375a700 1 -- 172.21.15.154:0/1291543442 >> 172.21.15.154:0/1291543442 conn(0x7f82cc0a2980 msgr2=0x7f82cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3030007119 shutdown_connections 2023-09-30T22:24:29.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3030007119 wait complete. 2023-09-30T22:24:29.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.207+0000 7f82d375a700 1 -- 172.21.15.154:0/1291543442 shutdown_connections 2023-09-30T22:24:29.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.208+0000 7fe1c0fd5700 1 Processor -- start 2023-09-30T22:24:29.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.208+0000 7f82d375a700 1 -- 172.21.15.154:0/1291543442 wait complete. 2023-09-30T22:24:29.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.208+0000 7fe1c0fd5700 1 -- start start 2023-09-30T22:24:29.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1c0fd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc09e870 0x7fe1bc11f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1c0fd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09f350 0x7fe1bc11fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1c0fd5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc1371c0 0x7fe1bc1200f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1c0fd5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc122bd0 con 0x7fe1bc1371c0 2023-09-30T22:24:29.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1c0fd5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc0723f0 con 0x7fe1bc09f350 2023-09-30T22:24:29.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1c0fd5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc121290 con 0x7fe1bc09e870 2023-09-30T22:24:29.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7f82d375a700 1 Processor -- start 2023-09-30T22:24:29.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1b9d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09f350 0x7fe1bc11fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1bad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc1371c0 0x7fe1bc1200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1b9d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09f350 0x7fe1bc11fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60202/0 (socket says 172.21.15.154:60202) 2023-09-30T22:24:29.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1b9d9b700 1 -- 172.21.15.154:0/3872093383 learned_addr learned my addr 172.21.15.154:0/3872093383 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:29.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7fe1bad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc1371c0 0x7fe1bc1200f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50954/0 (socket says 172.21.15.154:50954) 2023-09-30T22:24:29.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.209+0000 7f82d375a700 1 -- start start 2023-09-30T22:24:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1b9d9b700 1 -- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc09e870 msgr2=0x7fe1bc11f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1b9d9b700 1 --2- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc09e870 0x7fe1bc11f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1b9d9b700 1 -- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc1371c0 msgr2=0x7fe1bc1200f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1b9d9b700 1 --2- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc1371c0 0x7fe1bc1200f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1b9d9b700 1 -- 172.21.15.154:0/3872093383 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4009b30 con 0x7fe1bc09f350 2023-09-30T22:24:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1bad9d700 1 --2- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc1371c0 0x7fe1bc1200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1b9d9b700 1 --2- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09f350 0x7fe1bc11fbb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0010cf0 tx=0x7fe1b000b140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1aaffd700 1 -- 172.21.15.154:0/3872093383 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0015070 con 0x7fe1bc09f350 2023-09-30T22:24:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d375a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc099a60 0x7f82cc1ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d375a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82cc0a0e20 0x7f82cc1cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d375a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc133b80 0x7f82cc06dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d375a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc12fc10 con 0x7f82cc0a0e20 2023-09-30T22:24:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d375a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc09a2c0 con 0x7f82cc133b80 2023-09-30T22:24:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d375a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0714b0 con 0x7f82cc099a60 2023-09-30T22:24:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d14f6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc099a60 0x7f82cc1ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d14f6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc099a60 0x7f82cc1ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46998/0 (socket says 172.21.15.154:46998) 2023-09-30T22:24:29.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d14f6700 1 -- 172.21.15.154:0/2860566234 learned_addr learned my addr 172.21.15.154:0/2860566234 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:29.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d0cf5700 1 --2- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82cc0a0e20 0x7f82cc1cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d1cf7700 1 --2- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc133b80 0x7f82cc06dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:29.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1aaffd700 1 -- 172.21.15.154:0/3872093383 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b000ba80 con 0x7fe1bc09f350 2023-09-30T22:24:29.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7fe1aaffd700 1 -- 172.21.15.154:0/3872093383 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0009710 con 0x7fe1bc09f350 2023-09-30T22:24:29.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d14f6700 1 -- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc133b80 msgr2=0x7f82cc06dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d14f6700 1 --2- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc133b80 0x7f82cc06dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d14f6700 1 -- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82cc0a0e20 msgr2=0x7f82cc1cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d14f6700 1 --2- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82cc0a0e20 0x7f82cc1cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.210+0000 7f82d14f6700 1 -- 172.21.15.154:0/2860566234 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0094a0 con 0x7f82cc099a60 2023-09-30T22:24:29.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.211+0000 7f82d14f6700 1 --2- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc099a60 0x7f82cc1ccbe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f82c800e730 tx=0x7f82c800ea40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:29.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.211+0000 7f82c1ffb700 1 -- 172.21.15.154:0/2860566234 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c800c070 con 0x7f82cc099a60 2023-09-30T22:24:29.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.211+0000 7f82c1ffb700 1 -- 172.21.15.154:0/2860566234 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8005a20 con 0x7f82cc099a60 2023-09-30T22:24:29.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.211+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3872093383 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1bc09dba0 con 0x7fe1bc09f350 2023-09-30T22:24:29.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.211+0000 7f82c1ffb700 1 -- 172.21.15.154:0/2860566234 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8005d90 con 0x7f82cc099a60 2023-09-30T22:24:29.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.211+0000 7f82d375a700 1 -- 172.21.15.154:0/2860566234 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c4009b30 con 0x7f82cc099a60 2023-09-30T22:24:29.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.211+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3872093383 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1bc123890 con 0x7fe1bc09f350 2023-09-30T22:24:29.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.212+0000 7f82d375a700 1 -- 172.21.15.154:0/2860566234 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc12f750 con 0x7f82cc099a60 2023-09-30T22:24:29.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.212+0000 7fe1aaffd700 1 -- 172.21.15.154:0/3872093383 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1b0019410 con 0x7fe1bc09f350 2023-09-30T22:24:29.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.212+0000 7fe1aaffd700 1 -- 172.21.15.154:0/3872093383 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe1b0043140 con 0x7fe1bc09f350 2023-09-30T22:24:29.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.212+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3872093383 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1bc122a40 con 0x7fe1bc09f350 2023-09-30T22:24:29.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.213+0000 7f82d375a700 1 -- 172.21.15.154:0/2860566234 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc04f2a0 con 0x7f82cc099a60 2023-09-30T22:24:29.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.213+0000 7f82c1ffb700 1 -- 172.21.15.154:0/2860566234 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82c8006020 con 0x7f82cc099a60 2023-09-30T22:24:29.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.213+0000 7f82c1ffb700 1 -- 172.21.15.154:0/2860566234 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82c803ef70 con 0x7f82cc099a60 2023-09-30T22:24:29.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.217+0000 7fe1aaffd700 1 -- 172.21.15.154:0/3872093383 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1b001e020 con 0x7fe1bc09f350 2023-09-30T22:24:29.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.222+0000 7f82c1ffb700 1 -- 172.21.15.154:0/2860566234 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82c801a360 con 0x7f82cc099a60 2023-09-30T22:24:29.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.379+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/4174905100 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4a0804f2a0 con 0x7f4a081304a0 2023-09-30T22:24:29.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.379+0000 7f49effff700 1 -- 172.21.15.154:0/4174905100 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a00018030 con 0x7f4a081304a0 2023-09-30T22:24:29.379 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:29.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.382+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a081304a0 msgr2=0x7f4a081c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.382+0000 7f4a0dc4f700 1 --2- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a081304a0 0x7f4a081c8250 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000efc0 tx=0x7f4a0000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.382+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/4174905100 shutdown_connections 2023-09-30T22:24:29.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.382+0000 7f4a0dc4f700 1 --2- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a081304a0 0x7f4a081c8250 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.382+0000 7f4a0dc4f700 1 --2- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a080a0a30 0x7f4a0812f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.382+0000 7f4a0dc4f700 1 --2- 172.21.15.154:0/4174905100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a080a1340 0x7f4a0812f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.382+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/4174905100 >> 172.21.15.154:0/4174905100 conn(0x7f4a080a2980 msgr2=0x7f4a0809deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.382+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/4174905100 shutdown_connections 2023-09-30T22:24:29.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.382+0000 7f4a0dc4f700 1 -- 172.21.15.154:0/4174905100 wait complete. 2023-09-30T22:24:29.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.410+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3872093383 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe1bc04f2a0 con 0x7fe1bc09f350 2023-09-30T22:24:29.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.411+0000 7fe1aaffd700 1 -- 172.21.15.154:0/3872093383 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1b00202c0 con 0x7fe1bc09f350 2023-09-30T22:24:29.410 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:29.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.413+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09f350 msgr2=0x7fe1bc11fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.413+0000 7fe1c0fd5700 1 --2- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09f350 0x7fe1bc11fbb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0010cf0 tx=0x7fe1b000b140 comp rx=0 tx=0).stop 2023-09-30T22:24:29.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.413+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3872093383 shutdown_connections 2023-09-30T22:24:29.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.413+0000 7fe1c0fd5700 1 --2- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1bc1371c0 0x7fe1bc1200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.413+0000 7fe1c0fd5700 1 --2- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1bc09e870 0x7fe1bc11f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.413+0000 7fe1c0fd5700 1 --2- 172.21.15.154:0/3872093383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1bc09f350 0x7fe1bc11fbb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.413+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3872093383 >> 172.21.15.154:0/3872093383 conn(0x7fe1bc0a4430 msgr2=0x7fe1bc0a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.413+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3872093383 shutdown_connections 2023-09-30T22:24:29.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.413+0000 7fe1c0fd5700 1 -- 172.21.15.154:0/3872093383 wait complete. 2023-09-30T22:24:29.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:29.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.428+0000 7f82d375a700 1 -- 172.21.15.154:0/2860566234 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f82cc06bce0 con 0x7f82cc099a60 2023-09-30T22:24:29.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.428+0000 7f82c1ffb700 1 -- 172.21.15.154:0/2860566234 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82c801a360 con 0x7f82cc099a60 2023-09-30T22:24:29.428 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:29.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.430+0000 7f82d375a700 1 -- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc099a60 msgr2=0x7f82cc1ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:29.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.430+0000 7f82d375a700 1 --2- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc099a60 0x7f82cc1ccbe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f82c800e730 tx=0x7f82c800ea40 comp rx=0 tx=0).stop 2023-09-30T22:24:29.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.430+0000 7f82d375a700 1 -- 172.21.15.154:0/2860566234 shutdown_connections 2023-09-30T22:24:29.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.430+0000 7f82d375a700 1 --2- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82cc133b80 0x7f82cc06dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.430+0000 7f82d375a700 1 --2- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82cc099a60 0x7f82cc1ccbe0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.430+0000 7f82d375a700 1 --2- 172.21.15.154:0/2860566234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82cc0a0e20 0x7f82cc1cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:29.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.430+0000 7f82d375a700 1 -- 172.21.15.154:0/2860566234 >> 172.21.15.154:0/2860566234 conn(0x7f82cc0a2980 msgr2=0x7f82cc1b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:29.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.431+0000 7f82d375a700 1 -- 172.21.15.154:0/2860566234 shutdown_connections 2023-09-30T22:24:29.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:29.431+0000 7f82d375a700 1 -- 172.21.15.154:0/2860566234 wait complete. 2023-09-30T22:24:29.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:30.191 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:30.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.326+0000 7fab41722700 1 Processor -- start 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab41722700 1 -- start start 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab41722700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fab3c067c10 0x7fab3c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab41722700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c133fa0 0x7fab3c0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab41722700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3c09a360 con 0x7fab3c1343d0 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab41722700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3c067fe0 con 0x7fab3c067c10 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab41722700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c09a880 con 0x7fab3c133fa0 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab3affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fab3c067c10 0x7fab3c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab3a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c133fa0 0x7fab3c0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab3affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fab3c067c10 0x7fab3c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50964/0 (socket says 172.21.15.154:50964) 2023-09-30T22:24:30.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab3a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c133fa0 0x7fab3c0a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60222/0 (socket says 172.21.15.154:60222) 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab3affd700 1 -- 172.21.15.154:0/517405128 learned_addr learned my addr 172.21.15.154:0/517405128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab3a7fc700 1 -- 172.21.15.154:0/517405128 >> v2:172.21.15.154:3300/0 conn(0x7fab3c067c10 msgr2=0x7fab3c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab3a7fc700 1 --2- 172.21.15.154:0/517405128 >> v2:172.21.15.154:3300/0 conn(0x7fab3c067c10 0x7fab3c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.327+0000 7fab3a7fc700 1 -- 172.21.15.154:0/517405128 >> v1:172.21.15.154:6789/0 conn(0x7fab3c1343d0 legacy=0x7fab3c0a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab3a7fc700 1 -- 172.21.15.154:0/517405128 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c099e00 con 0x7fab3c133fa0 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab3affd700 1 --2- 172.21.15.154:0/517405128 >> v2:172.21.15.154:3300/0 conn(0x7fab3c067c10 0x7fab3c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab3a7fc700 1 --2- 172.21.15.154:0/517405128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c133fa0 0x7fab3c0a08e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009840 tx=0x7fab2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1def1367fe360e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab39ffb700 1 -- 172.21.15.154:0/517405128 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c011830 con 0x7fab3c133fa0 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab39ffb700 1 -- 172.21.15.154:0/517405128 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c011990 con 0x7fab3c133fa0 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab39ffb700 1 -- 172.21.15.154:0/517405128 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c011d20 con 0x7fab3c133fa0 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab41722700 1 -- 172.21.15.154:0/517405128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c133fa0 msgr2=0x7fab3c0a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab41722700 1 --2- 172.21.15.154:0/517405128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c133fa0 0x7fab3c0a08e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009840 tx=0x7fab2c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:30.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab41722700 1 -- 172.21.15.154:0/517405128 shutdown_connections 2023-09-30T22:24:30.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab41722700 1 --2- 172.21.15.154:0/517405128 >> v2:172.21.15.154:3300/0 conn(0x7fab3c067c10 0x7fab3c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab41722700 1 --2- 172.21.15.154:0/517405128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c133fa0 0x7fab3c0a08e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab41722700 1 -- 172.21.15.154:0/517405128 >> 172.21.15.154:0/517405128 conn(0x7fab3c0a2980 msgr2=0x7fab3c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab41722700 1 -- 172.21.15.154:0/517405128 shutdown_connections 2023-09-30T22:24:30.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.328+0000 7fab41722700 1 -- 172.21.15.154:0/517405128 wait complete. 2023-09-30T22:24:30.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab41722700 1 Processor -- start 2023-09-30T22:24:30.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab41722700 1 -- start start 2023-09-30T22:24:30.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab41722700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab3c067c10 0x7fab3c11c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab41722700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c133fa0 0x7fab3c11ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab41722700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c1343d0 0x7fab3c11d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab41722700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c11f6f0 con 0x7fab3c133fa0 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab41722700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c11e620 con 0x7fab3c1343d0 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab41722700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c11f330 con 0x7fab3c067c10 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3a7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c133fa0 0x7fab3c11ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab3c067c10 0x7fab3c11c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c1343d0 0x7fab3c11d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3a7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c133fa0 0x7fab3c11ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50968/0 (socket says 172.21.15.154:50968) 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3a7fc700 1 -- 172.21.15.154:0/1486481923 learned_addr learned my addr 172.21.15.154:0/1486481923 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3a7fc700 1 -- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab3c067c10 msgr2=0x7fab3c11c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3a7fc700 1 --2- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab3c067c10 0x7fab3c11c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3a7fc700 1 -- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c1343d0 msgr2=0x7fab3c11d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3a7fc700 1 --2- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c1343d0 0x7fab3c11d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3a7fc700 1 -- 172.21.15.154:0/1486481923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24009550 con 0x7fab3c133fa0 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.330+0000 7fab3b7fe700 1 --2- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c1343d0 0x7fab3c11d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.331+0000 7fab3a7fc700 1 --2- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c133fa0 0x7fab3c11ce60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0090b0 tx=0x7fab2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.331+0000 7fab337fe700 1 -- 172.21.15.154:0/1486481923 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0036a0 con 0x7fab3c133fa0 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.331+0000 7fab337fe700 1 -- 172.21.15.154:0/1486481923 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c01f070 con 0x7fab3c133fa0 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.331+0000 7fab41722700 1 -- 172.21.15.154:0/1486481923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c0094a0 con 0x7fab3c133fa0 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.331+0000 7fab337fe700 1 -- 172.21.15.154:0/1486481923 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c003a60 con 0x7fab3c133fa0 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.331+0000 7fab41722700 1 -- 172.21.15.154:0/1486481923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c11fe10 con 0x7fab3c133fa0 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.331+0000 7fab337fe700 1 -- 172.21.15.154:0/1486481923 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab2c003bc0 con 0x7fab3c133fa0 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.332+0000 7fab337fe700 1 -- 172.21.15.154:0/1486481923 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab2c021070 con 0x7fab3c133fa0 2023-09-30T22:24:30.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.332+0000 7fab41722700 1 -- 172.21.15.154:0/1486481923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c04f2a0 con 0x7fab3c133fa0 2023-09-30T22:24:30.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.336+0000 7fab337fe700 1 -- 172.21.15.154:0/1486481923 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab2c02b080 con 0x7fab3c133fa0 2023-09-30T22:24:30.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:30.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:30.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:30.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.530+0000 7fab41722700 1 -- 172.21.15.154:0/1486481923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab3c09aa70 con 0x7fab3c133fa0 2023-09-30T22:24:30.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.530+0000 7fab337fe700 1 -- 172.21.15.154:0/1486481923 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab2c015020 con 0x7fab3c133fa0 2023-09-30T22:24:30.530 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.533+0000 7fab41722700 1 -- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c133fa0 msgr2=0x7fab3c11ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.533+0000 7fab41722700 1 --2- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c133fa0 0x7fab3c11ce60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0090b0 tx=0x7fab2c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.533+0000 7fab41722700 1 -- 172.21.15.154:0/1486481923 shutdown_connections 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.533+0000 7fab41722700 1 --2- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c1343d0 0x7fab3c11d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.533+0000 7fab41722700 1 --2- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab3c067c10 0x7fab3c11c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.533+0000 7fab41722700 1 --2- 172.21.15.154:0/1486481923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c133fa0 0x7fab3c11ce60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.533+0000 7fab41722700 1 -- 172.21.15.154:0/1486481923 >> 172.21.15.154:0/1486481923 conn(0x7fab3c0a2980 msgr2=0x7fab3c131650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.533+0000 7fab41722700 1 -- 172.21.15.154:0/1486481923 shutdown_connections 2023-09-30T22:24:30.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.534+0000 7fab41722700 1 -- 172.21.15.154:0/1486481923 wait complete. 2023-09-30T22:24:30.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.539+0000 7f14fcf48700 1 Processor -- start 2023-09-30T22:24:30.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.539+0000 7f14fcf48700 1 -- start start 2023-09-30T22:24:30.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14fcf48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14fcf48700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14f8135f20 0x7f14f8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14fcf48700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f809aaa0 con 0x7f14f809d860 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14fcf48700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f809e730 con 0x7f14f8135f20 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14fcf48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14f809f870 con 0x7f14f809e340 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14f659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f14f809d860 0x7f14f809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41886/0 (socket says 172.21.15.154:41886) 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14f659c700 1 -- 172.21.15.154:0/1319609985 learned_addr learned my addr 172.21.15.154:0/1319609985 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14f6d9d700 1 --2- 172.21.15.154:0/1319609985 >> v2:172.21.15.154:3300/0 conn(0x7f14f8135f20 0x7f14f8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14f5d9b700 1 --2- 172.21.15.154:0/1319609985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14f6d9d700 1 -- 172.21.15.154:0/1319609985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 msgr2=0x7f14f81359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14f6d9d700 1 --2- 172.21.15.154:0/1319609985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14f6d9d700 1 -- 172.21.15.154:0/1319609985 >> v1:172.21.15.154:6789/0 conn(0x7f14f809d860 legacy=0x7f14f809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14f6d9d700 1 -- 172.21.15.154:0/1319609985 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f809b360 con 0x7f14f8135f20 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.540+0000 7f14f5d9b700 1 --2- 172.21.15.154:0/1319609985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.541+0000 7f14f6d9d700 1 --2- 172.21.15.154:0/1319609985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f8135f20 0x7f14f8138300 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009d90 tx=0x7f14f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee6e017136b3bd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.541+0000 7f14f559a700 1 -- 172.21.15.154:0/1319609985 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f000e070 con 0x7f14f8135f20 2023-09-30T22:24:30.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.541+0000 7f14f559a700 1 -- 172.21.15.154:0/1319609985 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f000bb20 con 0x7f14f8135f20 2023-09-30T22:24:30.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.541+0000 7f14f559a700 1 -- 172.21.15.154:0/1319609985 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0012430 con 0x7f14f8135f20 2023-09-30T22:24:30.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.542+0000 7f14fcf48700 1 -- 172.21.15.154:0/1319609985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f8135f20 msgr2=0x7f14f8138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.542+0000 7f14fcf48700 1 --2- 172.21.15.154:0/1319609985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f8135f20 0x7f14f8138300 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009d90 tx=0x7f14f000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:30.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.542+0000 7f14fcf48700 1 -- 172.21.15.154:0/1319609985 shutdown_connections 2023-09-30T22:24:30.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.542+0000 7f14fcf48700 1 --2- 172.21.15.154:0/1319609985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f8135f20 0x7f14f8138300 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.542+0000 7f14fcf48700 1 --2- 172.21.15.154:0/1319609985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.542+0000 7f14fcf48700 1 -- 172.21.15.154:0/1319609985 >> 172.21.15.154:0/1319609985 conn(0x7f14f8099c40 msgr2=0x7f14f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.542+0000 7f14fcf48700 1 -- 172.21.15.154:0/1319609985 shutdown_connections 2023-09-30T22:24:30.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.542+0000 7f14fcf48700 1 -- 172.21.15.154:0/1319609985 wait complete. 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.543+0000 7f14fcf48700 1 Processor -- start 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.543+0000 7f14fcf48700 1 -- start start 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14fcf48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14f809d860 0x7f14f81c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14fcf48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14fcf48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f8135f20 0x7f14f81c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14fcf48700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f811d550 con 0x7f14f8135f20 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14fcf48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f8123b40 con 0x7f14f809d860 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14fcf48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14f81240a0 con 0x7f14f809e340 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14f809d860 0x7f14f81c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14f809d860 0x7f14f81c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60242/0 (socket says 172.21.15.154:60242) 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f659c700 1 -- 172.21.15.154:0/2334873211 learned_addr learned my addr 172.21.15.154:0/2334873211 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f5d9b700 1 --2- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f6d9d700 1 --2- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f8135f20 0x7f14f81c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f5d9b700 1 -- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14f809d860 msgr2=0x7f14f81c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f5d9b700 1 --2- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14f809d860 0x7f14f81c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f5d9b700 1 -- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f8135f20 msgr2=0x7f14f81c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f5d9b700 1 --2- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f8135f20 0x7f14f81c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.544+0000 7f14f5d9b700 1 -- 172.21.15.154:0/2334873211 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0094a0 con 0x7f14f809e340 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.545+0000 7f14f5d9b700 1 --2- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81c8680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00e9b0 tx=0x7f14ec00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.545+0000 7f14e6ffd700 1 -- 172.21.15.154:0/2334873211 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec00ee50 con 0x7f14f809e340 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.545+0000 7f14e6ffd700 1 -- 172.21.15.154:0/2334873211 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec00c850 con 0x7f14f809e340 2023-09-30T22:24:30.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.545+0000 7f14fcf48700 1 -- 172.21.15.154:0/2334873211 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f0009a70 con 0x7f14f809e340 2023-09-30T22:24:30.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.545+0000 7f14e6ffd700 1 -- 172.21.15.154:0/2334873211 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec00cbe0 con 0x7f14f809e340 2023-09-30T22:24:30.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.545+0000 7f14fcf48700 1 -- 172.21.15.154:0/2334873211 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f811ea50 con 0x7f14f809e340 2023-09-30T22:24:30.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.546+0000 7f14e6ffd700 1 -- 172.21.15.154:0/2334873211 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14ec00cd40 con 0x7f14f809e340 2023-09-30T22:24:30.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.546+0000 7f14e6ffd700 1 -- 172.21.15.154:0/2334873211 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f14ec03f860 con 0x7f14f809e340 2023-09-30T22:24:30.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.548+0000 7f14fcf48700 1 -- 172.21.15.154:0/2334873211 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f806b2f0 con 0x7f14f809e340 2023-09-30T22:24:30.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:30.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.556+0000 7f14e6ffd700 1 -- 172.21.15.154:0/2334873211 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14ec0232f0 con 0x7f14f809e340 2023-09-30T22:24:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.576+0000 7fe8ab1f3700 1 Processor -- start 2023-09-30T22:24:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.576+0000 7fe8ab1f3700 1 -- start start 2023-09-30T22:24:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.577+0000 7fe8ab1f3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409d860 0x7fe8a409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.577+0000 7fe8ab1f3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8a4130eb0 0x7fe8a4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.577+0000 7fe8ab1f3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a409aaa0 con 0x7fe8a409e170 2023-09-30T22:24:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.577+0000 7fe8ab1f3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a409f870 con 0x7fe8a4130eb0 2023-09-30T22:24:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.577+0000 7fe8ab1f3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a409b360 con 0x7fe8a409d860 2023-09-30T22:24:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.577+0000 7fe8a8f8f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409d860 0x7fe8a409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.577+0000 7fe8a8f8f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409d860 0x7fe8a409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47042/0 (socket says 172.21.15.154:47042) 2023-09-30T22:24:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.577+0000 7fe8a8f8f700 1 -- 172.21.15.154:0/385584791 learned_addr learned my addr 172.21.15.154:0/385584791 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.577+0000 7fe8a9790700 1 --2- 172.21.15.154:0/385584791 >> v2:172.21.15.154:3300/0 conn(0x7fe8a4130eb0 0x7fe8a4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.578+0000 7fe8a8f8f700 1 -- 172.21.15.154:0/385584791 >> v2:172.21.15.154:3300/0 conn(0x7fe8a4130eb0 msgr2=0x7fe8a4138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.578+0000 7fe8a8f8f700 1 --2- 172.21.15.154:0/385584791 >> v2:172.21.15.154:3300/0 conn(0x7fe8a4130eb0 0x7fe8a4138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.578+0000 7fe8a8f8f700 1 -- 172.21.15.154:0/385584791 >> v1:172.21.15.154:6789/0 conn(0x7fe8a409e170 legacy=0x7fe8a41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.578+0000 7fe8a8f8f700 1 -- 172.21.15.154:0/385584791 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a409b620 con 0x7fe8a409d860 2023-09-30T22:24:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.578+0000 7fe8a8f8f700 1 --2- 172.21.15.154:0/385584791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409d860 0x7fe8a409dc30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe8980098f0 tx=0x7fe898009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5ff3b7b9770bad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.578+0000 7fe8a37fe700 1 -- 172.21.15.154:0/385584791 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898011830 con 0x7fe8a409d860 2023-09-30T22:24:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.578+0000 7fe8a37fe700 1 -- 172.21.15.154:0/385584791 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898011990 con 0x7fe8a409d860 2023-09-30T22:24:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.578+0000 7fe8a37fe700 1 -- 172.21.15.154:0/385584791 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898011d20 con 0x7fe8a409d860 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.579+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/385584791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409d860 msgr2=0x7fe8a409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.579+0000 7fe8ab1f3700 1 --2- 172.21.15.154:0/385584791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409d860 0x7fe8a409dc30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe8980098f0 tx=0x7fe898009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.579+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/385584791 shutdown_connections 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.579+0000 7fe8ab1f3700 1 --2- 172.21.15.154:0/385584791 >> v2:172.21.15.154:3300/0 conn(0x7fe8a4130eb0 0x7fe8a4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.579+0000 7fe8ab1f3700 1 --2- 172.21.15.154:0/385584791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409d860 0x7fe8a409dc30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.579+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/385584791 >> 172.21.15.154:0/385584791 conn(0x7fe8a4099c40 msgr2=0x7fe8a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.579+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/385584791 shutdown_connections 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.579+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/385584791 wait complete. 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8ab1f3700 1 Processor -- start 2023-09-30T22:24:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8ab1f3700 1 -- start start 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8ab1f3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8a409d860 0x7fe8a4123540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8ab1f3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409e170 0x7fe8a4123a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8ab1f3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a4130eb0 0x7fe8a41c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8ab1f3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a409c920 con 0x7fe8a4130eb0 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8ab1f3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4123150 con 0x7fe8a409d860 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8ab1f3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4126800 con 0x7fe8a409e170 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8a3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409e170 0x7fe8a4123a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.580+0000 7fe8a8f8f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8a409d860 0x7fe8a4123540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a8f8f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8a409d860 0x7fe8a4123540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60250/0 (socket says 172.21.15.154:60250) 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409e170 0x7fe8a4123a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47054/0 (socket says 172.21.15.154:47054) 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a8f8f700 1 -- 172.21.15.154:0/1510599311 learned_addr learned my addr 172.21.15.154:0/1510599311 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:30.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a9790700 1 --2- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a4130eb0 0x7fe8a41c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a8f8f700 1 -- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409e170 msgr2=0x7fe8a4123a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a8f8f700 1 --2- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409e170 0x7fe8a4123a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a8f8f700 1 -- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a4130eb0 msgr2=0x7fe8a41c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a8f8f700 1 --2- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a4130eb0 0x7fe8a41c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a8f8f700 1 -- 172.21.15.154:0/1510599311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe898009550 con 0x7fe8a409d860 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a3fff700 1 --2- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409e170 0x7fe8a4123a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a8f8f700 1 --2- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8a409d860 0x7fe8a4123540 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe898000c00 tx=0x7fe898004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a17fa700 1 -- 172.21.15.154:0/1510599311 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8980036a0 con 0x7fe8a409d860 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a17fa700 1 -- 172.21.15.154:0/1510599311 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898003800 con 0x7fe8a409d860 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/1510599311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a4130c00 con 0x7fe8a409d860 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8a17fa700 1 -- 172.21.15.154:0/1510599311 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898003bb0 con 0x7fe8a409d860 2023-09-30T22:24:30.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.581+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/1510599311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a4124ee0 con 0x7fe8a409d860 2023-09-30T22:24:30.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.582+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/1510599311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a404f2a0 con 0x7fe8a409d860 2023-09-30T22:24:30.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.582+0000 7fe8a17fa700 1 -- 172.21.15.154:0/1510599311 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe898021070 con 0x7fe8a409d860 2023-09-30T22:24:30.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.583+0000 7fe8a17fa700 1 -- 172.21.15.154:0/1510599311 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe898040eb0 con 0x7fe8a409d860 2023-09-30T22:24:30.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.587+0000 7fe8a17fa700 1 -- 172.21.15.154:0/1510599311 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe89802d3a0 con 0x7fe8a409d860 2023-09-30T22:24:30.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.594+0000 7f8741524700 1 Processor -- start 2023-09-30T22:24:30.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.594+0000 7f8741524700 1 -- start start 2023-09-30T22:24:30.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f8741524700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f873c0a0a70 0x7f873c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f8741524700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f8741524700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c09dc00 con 0x7f873c0a1380 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f8741524700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c09ea90 con 0x7f873c0a0a70 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f8741524700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f873c09dec0 con 0x7f873c134120 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47066/0 (socket says 172.21.15.154:47066) 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873b7fe700 1 -- 172.21.15.154:0/2365556262 learned_addr learned my addr 172.21.15.154:0/2365556262 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873affd700 1 --2- 172.21.15.154:0/2365556262 >> v2:172.21.15.154:3300/0 conn(0x7f873c0a0a70 0x7f873c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873b7fe700 1 -- 172.21.15.154:0/2365556262 >> v2:172.21.15.154:3300/0 conn(0x7f873c0a0a70 msgr2=0x7f873c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873b7fe700 1 --2- 172.21.15.154:0/2365556262 >> v2:172.21.15.154:3300/0 conn(0x7f873c0a0a70 0x7f873c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873b7fe700 1 -- 172.21.15.154:0/2365556262 >> v1:172.21.15.154:6789/0 conn(0x7f873c0a1380 legacy=0x7f873c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873b7fe700 1 -- 172.21.15.154:0/2365556262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c09e6a0 con 0x7f873c134120 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873affd700 1 --2- 172.21.15.154:0/2365556262 >> v2:172.21.15.154:3300/0 conn(0x7f873c0a0a70 0x7f873c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.595+0000 7f873b7fe700 1 --2- 172.21.15.154:0/2365556262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c13bce0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8734009e50 tx=0x7f873400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19100d5ef57bd5d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8739ffb700 1 -- 172.21.15.154:0/2365556262 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873400e070 con 0x7f873c134120 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8739ffb700 1 -- 172.21.15.154:0/2365556262 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873400b9c0 con 0x7f873c134120 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8739ffb700 1 -- 172.21.15.154:0/2365556262 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873400bd70 con 0x7f873c134120 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8741524700 1 -- 172.21.15.154:0/2365556262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 msgr2=0x7f873c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8741524700 1 --2- 172.21.15.154:0/2365556262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c13bce0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8734009e50 tx=0x7f873400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8741524700 1 -- 172.21.15.154:0/2365556262 shutdown_connections 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8741524700 1 --2- 172.21.15.154:0/2365556262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c13bce0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8741524700 1 --2- 172.21.15.154:0/2365556262 >> v2:172.21.15.154:3300/0 conn(0x7f873c0a0a70 0x7f873c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8741524700 1 -- 172.21.15.154:0/2365556262 >> 172.21.15.154:0/2365556262 conn(0x7f873c0a6610 msgr2=0x7f873c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8741524700 1 -- 172.21.15.154:0/2365556262 shutdown_connections 2023-09-30T22:24:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.596+0000 7f8741524700 1 -- 172.21.15.154:0/2365556262 wait complete. 2023-09-30T22:24:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.597+0000 7f8741524700 1 Processor -- start 2023-09-30T22:24:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.597+0000 7f8741524700 1 -- start start 2023-09-30T22:24:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f8741524700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f873c0a0a70 0x7f873c122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f8741524700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f873c0a1380 0x7f873c122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f8741524700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f8741524700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c126160 con 0x7f873c0a0a70 2023-09-30T22:24:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f8741524700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c126340 con 0x7f873c0a1380 2023-09-30T22:24:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f8741524700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f873c125da0 con 0x7f873c134120 2023-09-30T22:24:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f873b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f873b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c1232a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47070/0 (socket says 172.21.15.154:47070) 2023-09-30T22:24:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f873b7fe700 1 -- 172.21.15.154:0/3559001066 learned_addr learned my addr 172.21.15.154:0/3559001066 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f873affd700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f873c0a0a70 0x7f873c122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.598+0000 7f873a7fc700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f873c0a1380 0x7f873c122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f873a7fc700 1 -- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 msgr2=0x7f873c1232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f873a7fc700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c1232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f873a7fc700 1 -- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f873c0a0a70 msgr2=0x7f873c122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f873a7fc700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f873c0a0a70 0x7f873c122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f873a7fc700 1 -- 172.21.15.154:0/3559001066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734009b30 con 0x7f873c0a1380 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f873affd700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f873c0a0a70 0x7f873c122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f873a7fc700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f873c0a1380 0x7f873c122d60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8730000f60 tx=0x7f8730001db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f87237fe700 1 -- 172.21.15.154:0/3559001066 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730012670 con 0x7f873c0a1380 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f87237fe700 1 -- 172.21.15.154:0/3559001066 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87300050d0 con 0x7f873c0a1380 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f8741524700 1 -- 172.21.15.154:0/3559001066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c0a03e0 con 0x7f873c0a1380 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f87237fe700 1 -- 172.21.15.154:0/3559001066 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730005480 con 0x7f873c0a1380 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.599+0000 7f8741524700 1 -- 172.21.15.154:0/3559001066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c1339b0 con 0x7f873c0a1380 2023-09-30T22:24:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.600+0000 7f8741524700 1 -- 172.21.15.154:0/3559001066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c04f2a0 con 0x7f873c0a1380 2023-09-30T22:24:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.600+0000 7f87237fe700 1 -- 172.21.15.154:0/3559001066 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f873000f070 con 0x7f873c0a1380 2023-09-30T22:24:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.600+0000 7f87237fe700 1 -- 172.21.15.154:0/3559001066 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f873004fb40 con 0x7f873c0a1380 2023-09-30T22:24:30.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.605+0000 7f87237fe700 1 -- 172.21.15.154:0/3559001066 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8730014680 con 0x7f873c0a1380 2023-09-30T22:24:30.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.753+0000 7f14fcf48700 1 -- 172.21.15.154:0/2334873211 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f14f804f2a0 con 0x7f14f809e340 2023-09-30T22:24:30.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.754+0000 7f14e6ffd700 1 -- 172.21.15.154:0/2334873211 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14ec02b090 con 0x7f14f809e340 2023-09-30T22:24:30.754 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:30.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.756+0000 7f14fcf48700 1 -- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 msgr2=0x7f14f81c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.756+0000 7f14fcf48700 1 --2- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81c8680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00e9b0 tx=0x7f14ec00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.756+0000 7f14fcf48700 1 -- 172.21.15.154:0/2334873211 shutdown_connections 2023-09-30T22:24:30.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.756+0000 7f14fcf48700 1 --2- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14f8135f20 0x7f14f81c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.756+0000 7f14fcf48700 1 --2- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14f809d860 0x7f14f81c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.756+0000 7f14fcf48700 1 --2- 172.21.15.154:0/2334873211 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14f809e340 0x7f14f81c8680 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.756+0000 7f14fcf48700 1 -- 172.21.15.154:0/2334873211 >> 172.21.15.154:0/2334873211 conn(0x7f14f8099c40 msgr2=0x7f14f81338d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.756+0000 7f14fcf48700 1 -- 172.21.15.154:0/2334873211 shutdown_connections 2023-09-30T22:24:30.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.756+0000 7f14fcf48700 1 -- 172.21.15.154:0/2334873211 wait complete. 2023-09-30T22:24:30.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:30.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.784+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/1510599311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe8a406c3b0 con 0x7fe8a409d860 2023-09-30T22:24:30.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.784+0000 7fe8a17fa700 1 -- 172.21.15.154:0/1510599311 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe898015020 con 0x7fe8a409d860 2023-09-30T22:24:30.784 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:30.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.786+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8a409d860 msgr2=0x7fe8a4123540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.786+0000 7fe8ab1f3700 1 --2- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8a409d860 0x7fe8a4123540 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe898000c00 tx=0x7fe898004750 comp rx=0 tx=0).stop 2023-09-30T22:24:30.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.786+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/1510599311 shutdown_connections 2023-09-30T22:24:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.786+0000 7fe8ab1f3700 1 --2- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8a4130eb0 0x7fe8a41c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.786+0000 7fe8ab1f3700 1 --2- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8a409d860 0x7fe8a4123540 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.786+0000 7fe8ab1f3700 1 --2- 172.21.15.154:0/1510599311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe8a409e170 0x7fe8a4123a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.786+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/1510599311 >> 172.21.15.154:0/1510599311 conn(0x7fe8a4099c40 msgr2=0x7fe8a40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.786+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/1510599311 shutdown_connections 2023-09-30T22:24:30.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.786+0000 7fe8ab1f3700 1 -- 172.21.15.154:0/1510599311 wait complete. 2023-09-30T22:24:30.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:30.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.799+0000 7f8741524700 1 -- 172.21.15.154:0/3559001066 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f873c125fc0 con 0x7f873c0a1380 2023-09-30T22:24:30.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.800+0000 7f87237fe700 1 -- 172.21.15.154:0/3559001066 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f873c125fc0 con 0x7f873c0a1380 2023-09-30T22:24:30.800 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.802+0000 7f8741524700 1 -- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f873c0a1380 msgr2=0x7f873c122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.802+0000 7f8741524700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f873c0a1380 0x7f873c122d60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8730000f60 tx=0x7f8730001db0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.802+0000 7f8741524700 1 -- 172.21.15.154:0/3559001066 shutdown_connections 2023-09-30T22:24:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.802+0000 7f8741524700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f873c134120 0x7f873c1232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.802+0000 7f8741524700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f873c0a0a70 0x7f873c122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.802+0000 7f8741524700 1 --2- 172.21.15.154:0/3559001066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f873c0a1380 0x7f873c122d60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:30.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.802+0000 7f8741524700 1 -- 172.21.15.154:0/3559001066 >> 172.21.15.154:0/3559001066 conn(0x7f873c0a6610 msgr2=0x7f873c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:30.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.802+0000 7f8741524700 1 -- 172.21.15.154:0/3559001066 shutdown_connections 2023-09-30T22:24:30.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:30.802+0000 7f8741524700 1 -- 172.21.15.154:0/3559001066 wait complete. 2023-09-30T22:24:30.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:31.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:31.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.682+0000 7f991fb5c700 1 Processor -- start 2023-09-30T22:24:31.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.682+0000 7f991fb5c700 1 -- start start 2023-09-30T22:24:31.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.682+0000 7f991fb5c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918136960 0x7f9918138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.682+0000 7f991fb5c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f991813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.682+0000 7f991fb5c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991806b2d0 con 0x7f9918133ad0 2023-09-30T22:24:31.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.682+0000 7f991fb5c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99181345b0 con 0x7f9918139280 2023-09-30T22:24:31.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.682+0000 7f991fb5c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9918133610 con 0x7f9918136960 2023-09-30T22:24:31.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991d0f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918136960 0x7f9918138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991e0f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f991813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991d0f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918136960 0x7f9918138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47074/0 (socket says 172.21.15.154:47074) 2023-09-30T22:24:31.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991d0f7700 1 -- 172.21.15.154:0/2705766686 learned_addr learned my addr 172.21.15.154:0/2705766686 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:31.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991d0f7700 1 -- 172.21.15.154:0/2705766686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 msgr2=0x7f991813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991d0f7700 1 --2- 172.21.15.154:0/2705766686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f991813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991d0f7700 1 -- 172.21.15.154:0/2705766686 >> v1:172.21.15.154:6789/0 conn(0x7f9918133ad0 legacy=0x7f9918133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991d0f7700 1 -- 172.21.15.154:0/2705766686 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991809a500 con 0x7f9918136960 2023-09-30T22:24:31.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991c8f6700 1 -- 172.21.15.154:0/2705766686 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692601363 0 0) 0x7f991806b2d0 con 0x7f9918133ad0 2023-09-30T22:24:31.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991e0f9700 1 --2- 172.21.15.154:0/2705766686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f991813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991d0f7700 1 --2- 172.21.15.154:0/2705766686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918136960 0x7f9918138d40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9908009920 tx=0x7f9908009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a7e9720cfeea3e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991c8f6700 1 -- 172.21.15.154:0/2705766686 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908011830 con 0x7f9918136960 2023-09-30T22:24:31.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991c8f6700 1 -- 172.21.15.154:0/2705766686 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908011990 con 0x7f9918136960 2023-09-30T22:24:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.683+0000 7f991c8f6700 1 -- 172.21.15.154:0/2705766686 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908011d20 con 0x7f9918136960 2023-09-30T22:24:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.684+0000 7f991fb5c700 1 -- 172.21.15.154:0/2705766686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918136960 msgr2=0x7f9918138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.684+0000 7f991fb5c700 1 --2- 172.21.15.154:0/2705766686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918136960 0x7f9918138d40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9908009920 tx=0x7f9908009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.684+0000 7f991fb5c700 1 -- 172.21.15.154:0/2705766686 shutdown_connections 2023-09-30T22:24:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.684+0000 7f991fb5c700 1 --2- 172.21.15.154:0/2705766686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f991813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.684+0000 7f991fb5c700 1 --2- 172.21.15.154:0/2705766686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918136960 0x7f9918138d40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.684+0000 7f991fb5c700 1 -- 172.21.15.154:0/2705766686 >> 172.21.15.154:0/2705766686 conn(0x7f9918099c40 msgr2=0x7f99180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.684+0000 7f991fb5c700 1 -- 172.21.15.154:0/2705766686 shutdown_connections 2023-09-30T22:24:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.684+0000 7f991fb5c700 1 -- 172.21.15.154:0/2705766686 wait complete. 2023-09-30T22:24:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991fb5c700 1 Processor -- start 2023-09-30T22:24:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991fb5c700 1 -- start start 2023-09-30T22:24:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991fb5c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918133ad0 0x7f991812f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991fb5c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9918136960 0x7f991812fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991fb5c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f99181c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991fb5c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9918070650 con 0x7f9918136960 2023-09-30T22:24:31.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991fb5c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991809f390 con 0x7f9918139280 2023-09-30T22:24:31.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991fb5c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9918131730 con 0x7f9918133ad0 2023-09-30T22:24:31.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991d8f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918133ad0 0x7f991812f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991e0f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f99181c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991d8f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918133ad0 0x7f991812f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47084/0 (socket says 172.21.15.154:47084) 2023-09-30T22:24:31.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991d8f8700 1 -- 172.21.15.154:0/532487380 learned_addr learned my addr 172.21.15.154:0/532487380 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:31.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.685+0000 7f991d0f7700 1 --2- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9918136960 0x7f991812fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f991d8f8700 1 -- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 msgr2=0x7f99181c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f991d8f8700 1 --2- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f99181c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f991d8f8700 1 -- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9918136960 msgr2=0x7f991812fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f991d8f8700 1 --2- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9918136960 0x7f991812fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f991d8f8700 1 -- 172.21.15.154:0/532487380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910009a70 con 0x7f9918133ad0 2023-09-30T22:24:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f991e0f9700 1 --2- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f99181c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f991d8f8700 1 --2- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918133ad0 0x7f991812f8a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f991400c450 tx=0x7f991400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f990e7fc700 1 -- 172.21.15.154:0/532487380 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99140054e0 con 0x7f9918133ad0 2023-09-30T22:24:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f990e7fc700 1 -- 172.21.15.154:0/532487380 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991400ce50 con 0x7f9918133ad0 2023-09-30T22:24:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f991fb5c700 1 -- 172.21.15.154:0/532487380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9908009550 con 0x7f9918133ad0 2023-09-30T22:24:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f990e7fc700 1 -- 172.21.15.154:0/532487380 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99140038c0 con 0x7f9918133ad0 2023-09-30T22:24:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.686+0000 7f991fb5c700 1 -- 172.21.15.154:0/532487380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9918130320 con 0x7f9918133ad0 2023-09-30T22:24:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.687+0000 7f990e7fc700 1 -- 172.21.15.154:0/532487380 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9914003a20 con 0x7f9918133ad0 2023-09-30T22:24:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.687+0000 7f990e7fc700 1 -- 172.21.15.154:0/532487380 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f991403ea30 con 0x7f9918133ad0 2023-09-30T22:24:31.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.687+0000 7f991fb5c700 1 -- 172.21.15.154:0/532487380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9918133ea0 con 0x7f9918133ad0 2023-09-30T22:24:31.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.691+0000 7f990e7fc700 1 -- 172.21.15.154:0/532487380 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9914017080 con 0x7f9918133ad0 2023-09-30T22:24:31.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:31.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:31.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:31.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.887+0000 7f991fb5c700 1 -- 172.21.15.154:0/532487380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f991804f2a0 con 0x7f9918133ad0 2023-09-30T22:24:31.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.895+0000 7f990e7fc700 1 -- 172.21.15.154:0/532487380 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9914019b20 con 0x7f9918133ad0 2023-09-30T22:24:31.896 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:31.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.897+0000 7f991fb5c700 1 -- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918133ad0 msgr2=0x7f991812f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.897+0000 7f991fb5c700 1 --2- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918133ad0 0x7f991812f8a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f991400c450 tx=0x7f991400c760 comp rx=0 tx=0).stop 2023-09-30T22:24:31.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.897+0000 7f991fb5c700 1 -- 172.21.15.154:0/532487380 shutdown_connections 2023-09-30T22:24:31.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.897+0000 7f991fb5c700 1 --2- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9918139280 0x7f99181c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.897+0000 7f991fb5c700 1 --2- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9918133ad0 0x7f991812f8a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.897+0000 7f991fb5c700 1 --2- 172.21.15.154:0/532487380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9918136960 0x7f991812fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.897+0000 7f991fb5c700 1 -- 172.21.15.154:0/532487380 >> 172.21.15.154:0/532487380 conn(0x7f9918099c40 msgr2=0x7f99180a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.897+0000 7f991fb5c700 1 -- 172.21.15.154:0/532487380 shutdown_connections 2023-09-30T22:24:31.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.897+0000 7f991fb5c700 1 -- 172.21.15.154:0/532487380 wait complete. 2023-09-30T22:24:31.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.900+0000 7f4fdd568700 1 Processor -- start 2023-09-30T22:24:31.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.900+0000 7f4fdd568700 1 -- start start 2023-09-30T22:24:31.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fdd568700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd81319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fdd568700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd81314b0 0x7f4fd8131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fdd568700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80a0f20 con 0x7f4fd809bc70 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fdd568700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80667e0 con 0x7f4fd8066410 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fdd568700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80a23c0 con 0x7f4fd81314b0 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fd67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd81314b0 0x7f4fd8131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fd67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd81314b0 0x7f4fd8131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47098/0 (socket says 172.21.15.154:47098) 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fd67fc700 1 -- 172.21.15.154:0/457889758 learned_addr learned my addr 172.21.15.154:0/457889758 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fd6ffd700 1 --2- 172.21.15.154:0/457889758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd81319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fd6ffd700 1 -- 172.21.15.154:0/457889758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd81314b0 msgr2=0x7f4fd8131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fd6ffd700 1 --2- 172.21.15.154:0/457889758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd81314b0 0x7f4fd8131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fd6ffd700 1 -- 172.21.15.154:0/457889758 >> v1:172.21.15.154:6789/0 conn(0x7f4fd809bc70 legacy=0x7f4fd809c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fd6ffd700 1 -- 172.21.15.154:0/457889758 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80a16e0 con 0x7f4fd8066410 2023-09-30T22:24:31.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.901+0000 7f4fd67fc700 1 --2- 172.21.15.154:0/457889758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd81314b0 0x7f4fd8131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.902+0000 7f4fd6ffd700 1 --2- 172.21.15.154:0/457889758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd81319f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009880 tx=0x7f4fc8009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16bbc9f0aaa2612 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.902+0000 7f4fd5ffb700 1 -- 172.21.15.154:0/457889758 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8005e30 con 0x7f4fd8066410 2023-09-30T22:24:31.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.902+0000 7f4fd5ffb700 1 -- 172.21.15.154:0/457889758 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc8004030 con 0x7f4fd8066410 2023-09-30T22:24:31.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.902+0000 7f4fd5ffb700 1 -- 172.21.15.154:0/457889758 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80043c0 con 0x7f4fd8066410 2023-09-30T22:24:31.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.902+0000 7f4fdd568700 1 -- 172.21.15.154:0/457889758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 msgr2=0x7f4fd81319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.902+0000 7f4fdd568700 1 --2- 172.21.15.154:0/457889758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd81319f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009880 tx=0x7f4fc8009b90 comp rx=0 tx=0).stop 2023-09-30T22:24:31.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.903+0000 7f4fdd568700 1 -- 172.21.15.154:0/457889758 shutdown_connections 2023-09-30T22:24:31.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.903+0000 7f4fdd568700 1 --2- 172.21.15.154:0/457889758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd81319f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.903+0000 7f4fdd568700 1 --2- 172.21.15.154:0/457889758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd81314b0 0x7f4fd8131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.903+0000 7f4fdd568700 1 -- 172.21.15.154:0/457889758 >> 172.21.15.154:0/457889758 conn(0x7f4fd80a2980 msgr2=0x7f4fd80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.903+0000 7f4fdd568700 1 -- 172.21.15.154:0/457889758 shutdown_connections 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.903+0000 7f4fdd568700 1 -- 172.21.15.154:0/457889758 wait complete. 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.904+0000 7f4fdd568700 1 Processor -- start 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.904+0000 7f4fdd568700 1 -- start start 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.904+0000 7f4fdd568700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd8137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.904+0000 7f4fdd568700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd809bc70 0x7f4fd8137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.904+0000 7f4fdd568700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd81314b0 0x7f4fd81380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.904+0000 7f4fdd568700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8119640 con 0x7f4fd81314b0 2023-09-30T22:24:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.904+0000 7f4fdd568700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80a1d50 con 0x7f4fd8066410 2023-09-30T22:24:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.904+0000 7f4fdd568700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd811a910 con 0x7f4fd809bc70 2023-09-30T22:24:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.904+0000 7f4fd6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd8137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd8137660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60292/0 (socket says 172.21.15.154:60292) 2023-09-30T22:24:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd6ffd700 1 -- 172.21.15.154:0/3462141249 learned_addr learned my addr 172.21.15.154:0/3462141249 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd77fe700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd81314b0 0x7f4fd81380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd67fc700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd809bc70 0x7f4fd8137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd6ffd700 1 -- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd809bc70 msgr2=0x7f4fd8137ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd6ffd700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd809bc70 0x7f4fd8137ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd6ffd700 1 -- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd81314b0 msgr2=0x7f4fd81380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd6ffd700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd81314b0 0x7f4fd81380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd6ffd700 1 -- 172.21.15.154:0/3462141249 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc009550 con 0x7f4fd8066410 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd67fc700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd809bc70 0x7f4fd8137ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fd6ffd700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd8137660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009ee0 tx=0x7f4fc8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fbf7fe700 1 -- 172.21.15.154:0/3462141249 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8011420 con 0x7f4fd8066410 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fbf7fe700 1 -- 172.21.15.154:0/3462141249 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc80115a0 con 0x7f4fd8066410 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fdd568700 1 -- 172.21.15.154:0/3462141249 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc8009430 con 0x7f4fd8066410 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.905+0000 7f4fbf7fe700 1 -- 172.21.15.154:0/3462141249 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8011950 con 0x7f4fd8066410 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.906+0000 7f4fdd568700 1 -- 172.21.15.154:0/3462141249 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd811a520 con 0x7f4fd8066410 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.907+0000 7f4fdd568700 1 -- 172.21.15.154:0/3462141249 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd804f2a0 con 0x7f4fd8066410 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.907+0000 7f4fbf7fe700 1 -- 172.21.15.154:0/3462141249 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fc8018070 con 0x7f4fd8066410 2023-09-30T22:24:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.907+0000 7f4fbf7fe700 1 -- 172.21.15.154:0/3462141249 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4fc80403e0 con 0x7f4fd8066410 2023-09-30T22:24:31.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.912+0000 7f4fbf7fe700 1 -- 172.21.15.154:0/3462141249 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fc801b410 con 0x7f4fd8066410 2023-09-30T22:24:31.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:31.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.949+0000 7f6ec2a49700 1 Processor -- start 2023-09-30T22:24:31.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.949+0000 7f6ec2a49700 1 -- start start 2023-09-30T22:24:31.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.950+0000 7f6ec2a49700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc09e950 0x7f6ebc09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.950+0000 7f6ec2a49700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ebc09f260 0x7f6ebc131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.950+0000 7f6ec2a49700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc09afb0 con 0x7f6ebc131dd0 2023-09-30T22:24:31.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.950+0000 7f6ec2a49700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc0a0970 con 0x7f6ebc09f260 2023-09-30T22:24:31.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.950+0000 7f6ec2a49700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc0a0320 con 0x7f6ebc09e950 2023-09-30T22:24:31.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.950+0000 7f6ebbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc09e950 0x7f6ebc09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.950+0000 7f6ebb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ebc09f260 0x7f6ebc131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.950+0000 7f6ebbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc09e950 0x7f6ebc09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60308/0 (socket says 172.21.15.154:60308) 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.950+0000 7f6ebbfff700 1 -- 172.21.15.154:0/646821684 learned_addr learned my addr 172.21.15.154:0/646821684 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.951+0000 7f6ebbfff700 1 -- 172.21.15.154:0/646821684 >> v2:172.21.15.154:3300/0 conn(0x7f6ebc09f260 msgr2=0x7f6ebc131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.951+0000 7f6ebbfff700 1 --2- 172.21.15.154:0/646821684 >> v2:172.21.15.154:3300/0 conn(0x7f6ebc09f260 0x7f6ebc131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.951+0000 7f6ebbfff700 1 -- 172.21.15.154:0/646821684 >> v1:172.21.15.154:6789/0 conn(0x7f6ebc131dd0 legacy=0x7f6ebc138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.951+0000 7f6ebbfff700 1 -- 172.21.15.154:0/646821684 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0a0750 con 0x7f6ebc09e950 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.951+0000 7f6ebb7fe700 1 --2- 172.21.15.154:0/646821684 >> v2:172.21.15.154:3300/0 conn(0x7f6ebc09f260 0x7f6ebc131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.951+0000 7f6ebbfff700 1 --2- 172.21.15.154:0/646821684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc09e950 0x7f6ebc09ed20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6eac006fd0 tx=0x7f6eac00f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2251ca1fc64f758 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.951+0000 7f6ebaffd700 1 -- 172.21.15.154:0/646821684 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac012070 con 0x7f6ebc09e950 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.951+0000 7f6ebaffd700 1 -- 172.21.15.154:0/646821684 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac005a20 con 0x7f6ebc09e950 2023-09-30T22:24:31.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.951+0000 7f6ebaffd700 1 -- 172.21.15.154:0/646821684 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac005dd0 con 0x7f6ebc09e950 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.952+0000 7f6ec2a49700 1 -- 172.21.15.154:0/646821684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc09e950 msgr2=0x7f6ebc09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.952+0000 7f6ec2a49700 1 --2- 172.21.15.154:0/646821684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc09e950 0x7f6ebc09ed20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6eac006fd0 tx=0x7f6eac00f050 comp rx=0 tx=0).stop 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.952+0000 7f6ec2a49700 1 -- 172.21.15.154:0/646821684 shutdown_connections 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.952+0000 7f6ec2a49700 1 --2- 172.21.15.154:0/646821684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc09e950 0x7f6ebc09ed20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.952+0000 7f6ec2a49700 1 --2- 172.21.15.154:0/646821684 >> v2:172.21.15.154:3300/0 conn(0x7f6ebc09f260 0x7f6ebc131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.952+0000 7f6ec2a49700 1 -- 172.21.15.154:0/646821684 >> 172.21.15.154:0/646821684 conn(0x7f6ebc0a0f70 msgr2=0x7f6ebc0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.952+0000 7f6ec2a49700 1 -- 172.21.15.154:0/646821684 shutdown_connections 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.952+0000 7f6ec2a49700 1 -- 172.21.15.154:0/646821684 wait complete. 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.953+0000 7f6ec2a49700 1 Processor -- start 2023-09-30T22:24:31.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.953+0000 7f6ec2a49700 1 -- start start 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ec2a49700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc09e950 0x7f6ebc11e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ec2a49700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ebc09f260 0x7f6ebc11ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ec2a49700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc131dd0 0x7f6ebc11f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ec2a49700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc1209d0 con 0x7f6ebc09e950 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ec2a49700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc122050 con 0x7f6ebc131dd0 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ec2a49700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc120530 con 0x7f6ebc09f260 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ebb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ebc09f260 0x7f6ebc11ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ebb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ebc09f260 0x7f6ebc11ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47122/0 (socket says 172.21.15.154:47122) 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ebb7fe700 1 -- 172.21.15.154:0/3452024433 learned_addr learned my addr 172.21.15.154:0/3452024433 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ebbfff700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc09e950 0x7f6ebc11e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.954+0000 7f6ec0fe6700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc131dd0 0x7f6ebc11f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ec0fe6700 1 -- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ebc09f260 msgr2=0x7f6ebc11ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ec0fe6700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ebc09f260 0x7f6ebc11ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ec0fe6700 1 -- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc09e950 msgr2=0x7f6ebc11e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ec0fe6700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc09e950 0x7f6ebc11e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ec0fe6700 1 -- 172.21.15.154:0/3452024433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb00094a0 con 0x7f6ebc131dd0 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ebbfff700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc09e950 0x7f6ebc11e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ebb7fe700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ebc09f260 0x7f6ebc11ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ec0fe6700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc131dd0 0x7f6ebc11f290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400cbc0 tx=0x7f6eb400ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6eb8ff9700 1 -- 172.21.15.154:0/3452024433 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4003c00 con 0x7f6ebc131dd0 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6eb8ff9700 1 -- 172.21.15.154:0/3452024433 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb4003d60 con 0x7f6ebc131dd0 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ec2a49700 1 -- 172.21.15.154:0/3452024433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac00d9a0 con 0x7f6ebc131dd0 2023-09-30T22:24:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6eb8ff9700 1 -- 172.21.15.154:0/3452024433 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400aa40 con 0x7f6ebc131dd0 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.955+0000 7f6ec2a49700 1 -- 172.21.15.154:0/3452024433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc09ba00 con 0x7f6ebc131dd0 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.956+0000 7f6ec2a49700 1 -- 172.21.15.154:0/3452024433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc121e50 con 0x7f6ebc131dd0 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.956+0000 7f6eb8ff9700 1 -- 172.21.15.154:0/3452024433 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6eb400aba0 con 0x7f6ebc131dd0 2023-09-30T22:24:31.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.957+0000 7f6eb8ff9700 1 -- 172.21.15.154:0/3452024433 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6eb4040050 con 0x7f6ebc131dd0 2023-09-30T22:24:31.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.961+0000 7f6eb8ff9700 1 -- 172.21.15.154:0/3452024433 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6eb40050d0 con 0x7f6ebc131dd0 2023-09-30T22:24:31.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdfe0b3700 1 Processor -- start 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdfe0b3700 1 -- start start 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdfe0b3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf80a0a70 0x7fbdf80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdfe0b3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbdf80a1380 0x7fbdf8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdfe0b3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf809dc00 con 0x7fbdf8133f50 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdfe0b3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf809ea60 con 0x7fbdf80a1380 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdfe0b3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf809dec0 con 0x7fbdf80a0a70 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdf77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf80a0a70 0x7fbdf80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdf6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbdf80a1380 0x7fbdf8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdf77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf80a0a70 0x7fbdf80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47136/0 (socket says 172.21.15.154:47136) 2023-09-30T22:24:31.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.992+0000 7fbdf77fe700 1 -- 172.21.15.154:0/324249001 learned_addr learned my addr 172.21.15.154:0/324249001 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:31.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdf77fe700 1 -- 172.21.15.154:0/324249001 >> v2:172.21.15.154:3300/0 conn(0x7fbdf80a1380 msgr2=0x7fbdf8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:31.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdf77fe700 1 --2- 172.21.15.154:0/324249001 >> v2:172.21.15.154:3300/0 conn(0x7fbdf80a1380 0x7fbdf8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdf77fe700 1 -- 172.21.15.154:0/324249001 >> v1:172.21.15.154:6789/0 conn(0x7fbdf8133f50 legacy=0x7fbdf813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdf77fe700 1 -- 172.21.15.154:0/324249001 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf809e6a0 con 0x7fbdf80a0a70 2023-09-30T22:24:31.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdf6ffd700 1 --2- 172.21.15.154:0/324249001 >> v2:172.21.15.154:3300/0 conn(0x7fbdf80a1380 0x7fbdf8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:31.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdf77fe700 1 --2- 172.21.15.154:0/324249001 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf80a0a70 0x7fbdf80a0e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009e50 tx=0x7fbde800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5167fff7c041902 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:31.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdf67fc700 1 -- 172.21.15.154:0/324249001 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800e070 con 0x7fbdf80a0a70 2023-09-30T22:24:31.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdf67fc700 1 -- 172.21.15.154:0/324249001 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800b910 con 0x7fbdf80a0a70 2023-09-30T22:24:31.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdf67fc700 1 -- 172.21.15.154:0/324249001 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800bcc0 con 0x7fbdf80a0a70 2023-09-30T22:24:31.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/324249001 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf80a0a70 msgr2=0x7fbdf80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:31.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdfe0b3700 1 --2- 172.21.15.154:0/324249001 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf80a0a70 0x7fbdf80a0e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009e50 tx=0x7fbde800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:31.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.993+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/324249001 shutdown_connections 2023-09-30T22:24:31.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.994+0000 7fbdfe0b3700 1 --2- 172.21.15.154:0/324249001 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf80a0a70 0x7fbdf80a0e40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.994+0000 7fbdfe0b3700 1 --2- 172.21.15.154:0/324249001 >> v2:172.21.15.154:3300/0 conn(0x7fbdf80a1380 0x7fbdf8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:31.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.994+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/324249001 >> 172.21.15.154:0/324249001 conn(0x7fbdf80a6610 msgr2=0x7fbdf80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.994+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/324249001 shutdown_connections 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.994+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/324249001 wait complete. 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.994+0000 7fbdfe0b3700 1 Processor -- start 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdfe0b3700 1 -- start start 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdfe0b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf80a0a70 0x7fbdf81c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdfe0b3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf80a1380 0x7fbdf81c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdfe0b3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf8133f50 0x7fbdf81c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdfe0b3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81247f0 con 0x7fbdf80a1380 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdfe0b3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8124600 con 0x7fbdf80a0a70 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdfe0b3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81252e0 con 0x7fbdf8133f50 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf80a1380 0x7fbdf81c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:31.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf80a1380 0x7fbdf81c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51086/0 (socket says 172.21.15.154:51086) 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf6ffd700 1 -- 172.21.15.154:0/2826022841 learned_addr learned my addr 172.21.15.154:0/2826022841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf7fff700 1 --2- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf8133f50 0x7fbdf81c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf77fe700 1 --2- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf80a0a70 0x7fbdf81c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf6ffd700 1 -- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf8133f50 msgr2=0x7fbdf81c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf6ffd700 1 --2- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf8133f50 0x7fbdf81c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf6ffd700 1 -- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf80a0a70 msgr2=0x7fbdf81c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf6ffd700 1 --2- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf80a0a70 0x7fbdf81c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.995+0000 7fbdf6ffd700 1 -- 172.21.15.154:0/2826022841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec0094a0 con 0x7fbdf80a1380 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.996+0000 7fbdf6ffd700 1 --2- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf80a1380 0x7fbdf81c8740 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00ebe0 tx=0x7fbdec00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.996+0000 7fbddffff700 1 -- 172.21.15.154:0/2826022841 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00c850 con 0x7fbdf80a1380 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.996+0000 7fbddffff700 1 -- 172.21.15.154:0/2826022841 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec00c9b0 con 0x7fbdf80a1380 2023-09-30T22:24:32.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.996+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/2826022841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde8009b30 con 0x7fbdf80a1380 2023-09-30T22:24:32.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.996+0000 7fbddffff700 1 -- 172.21.15.154:0/2826022841 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00cd40 con 0x7fbdf80a1380 2023-09-30T22:24:32.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.996+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/2826022841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf8126230 con 0x7fbdf80a1380 2023-09-30T22:24:32.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.997+0000 7fbddffff700 1 -- 172.21.15.154:0/2826022841 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdec013470 con 0x7fbdf80a1380 2023-09-30T22:24:32.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.997+0000 7fbddffff700 1 -- 172.21.15.154:0/2826022841 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbdec03fb10 con 0x7fbdf80a1380 2023-09-30T22:24:32.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:31.997+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/2826022841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf8125ed0 con 0x7fbdf80a1380 2023-09-30T22:24:32.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.002+0000 7fbddffff700 1 -- 172.21.15.154:0/2826022841 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdf8125ed0 con 0x7fbdf80a1380 2023-09-30T22:24:32.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.107+0000 7f4fdd568700 1 -- 172.21.15.154:0/3462141249 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4fd80724e0 con 0x7f4fd8066410 2023-09-30T22:24:32.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.107+0000 7f4fbf7fe700 1 -- 172.21.15.154:0/3462141249 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fc8016030 con 0x7f4fd8066410 2023-09-30T22:24:32.108 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:32.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.109+0000 7f4fdd568700 1 -- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 msgr2=0x7f4fd8137660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.109+0000 7f4fdd568700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd8137660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009ee0 tx=0x7f4fc8004750 comp rx=0 tx=0).stop 2023-09-30T22:24:32.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.109+0000 7f4fdd568700 1 -- 172.21.15.154:0/3462141249 shutdown_connections 2023-09-30T22:24:32.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.109+0000 7f4fdd568700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd81314b0 0x7f4fd81380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.109+0000 7f4fdd568700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd8066410 0x7f4fd8137660 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.109+0000 7f4fdd568700 1 --2- 172.21.15.154:0/3462141249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd809bc70 0x7f4fd8137ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.109+0000 7f4fdd568700 1 -- 172.21.15.154:0/3462141249 >> 172.21.15.154:0/3462141249 conn(0x7f4fd80a2980 msgr2=0x7f4fd8130240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.109+0000 7f4fdd568700 1 -- 172.21.15.154:0/3462141249 shutdown_connections 2023-09-30T22:24:32.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.109+0000 7f4fdd568700 1 -- 172.21.15.154:0/3462141249 wait complete. 2023-09-30T22:24:32.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:32.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.157+0000 7f6ec2a49700 1 -- 172.21.15.154:0/3452024433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ebc04f2a0 con 0x7f6ebc131dd0 2023-09-30T22:24:32.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.157+0000 7f6eb8ff9700 1 -- 172.21.15.154:0/3452024433 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6eb4011380 con 0x7f6ebc131dd0 2023-09-30T22:24:32.158 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.160+0000 7f6ec2a49700 1 -- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc131dd0 msgr2=0x7f6ebc11f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.160+0000 7f6ec2a49700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc131dd0 0x7f6ebc11f290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400cbc0 tx=0x7f6eb400ced0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.160+0000 7f6ec2a49700 1 -- 172.21.15.154:0/3452024433 shutdown_connections 2023-09-30T22:24:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.160+0000 7f6ec2a49700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ebc131dd0 0x7f6ebc11f290 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.160+0000 7f6ec2a49700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc09e950 0x7f6ebc11e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.160+0000 7f6ec2a49700 1 --2- 172.21.15.154:0/3452024433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ebc09f260 0x7f6ebc11ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.160+0000 7f6ec2a49700 1 -- 172.21.15.154:0/3452024433 >> 172.21.15.154:0/3452024433 conn(0x7f6ebc0a0f70 msgr2=0x7f6ebc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.160+0000 7f6ec2a49700 1 -- 172.21.15.154:0/3452024433 shutdown_connections 2023-09-30T22:24:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.160+0000 7f6ec2a49700 1 -- 172.21.15.154:0/3452024433 wait complete. 2023-09-30T22:24:32.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:32.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.197+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/2826022841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbdf8125ed0 con 0x7fbdf80a1380 2023-09-30T22:24:32.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.197+0000 7fbddffff700 1 -- 172.21.15.154:0/2826022841 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdf8125ed0 con 0x7fbdf80a1380 2023-09-30T22:24:32.198 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.199+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf80a1380 msgr2=0x7fbdf81c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.199+0000 7fbdfe0b3700 1 --2- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf80a1380 0x7fbdf81c8740 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00ebe0 tx=0x7fbdec00eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.199+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/2826022841 shutdown_connections 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.199+0000 7fbdfe0b3700 1 --2- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbdf8133f50 0x7fbdf81c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.199+0000 7fbdfe0b3700 1 --2- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf80a0a70 0x7fbdf81c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.199+0000 7fbdfe0b3700 1 --2- 172.21.15.154:0/2826022841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf80a1380 0x7fbdf81c8740 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.199+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/2826022841 >> 172.21.15.154:0/2826022841 conn(0x7fbdf80a6610 msgr2=0x7fbdf80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.199+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/2826022841 shutdown_connections 2023-09-30T22:24:32.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:32.199+0000 7fbdfe0b3700 1 -- 172.21.15.154:0/2826022841 wait complete. 2023-09-30T22:24:32.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:32.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:33.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f813935e700 1 Processor -- start 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f813935e700 1 -- start start 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f813935e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81340a1570 0x7f8134138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f813935e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81341393c0 0x7f813413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f813935e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340a1fe0 con 0x7f81340a0a90 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f813935e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81340a3aa0 con 0x7f81340a1570 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f813935e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f813409a540 con 0x7f81341393c0 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f81337fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81341393c0 0x7f813413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f81327fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81340a1570 0x7f8134138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f81337fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81341393c0 0x7f813413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47166/0 (socket says 172.21.15.154:47166) 2023-09-30T22:24:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f81327fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81340a1570 0x7f8134138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51102/0 (socket says 172.21.15.154:51102) 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.041+0000 7f81337fe700 1 -- 172.21.15.154:0/3280464368 learned_addr learned my addr 172.21.15.154:0/3280464368 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f81337fe700 1 -- 172.21.15.154:0/3280464368 >> v2:172.21.15.154:3300/0 conn(0x7f81340a1570 msgr2=0x7f8134138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f81337fe700 1 --2- 172.21.15.154:0/3280464368 >> v2:172.21.15.154:3300/0 conn(0x7f81340a1570 0x7f8134138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f81337fe700 1 -- 172.21.15.154:0/3280464368 >> v1:172.21.15.154:6789/0 conn(0x7f81340a0a90 legacy=0x7f81340a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f81337fe700 1 -- 172.21.15.154:0/3280464368 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813409a280 con 0x7f81341393c0 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f81327fc700 1 --2- 172.21.15.154:0/3280464368 >> v2:172.21.15.154:3300/0 conn(0x7f81340a1570 0x7f8134138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f8131ffb700 1 -- 172.21.15.154:0/3280464368 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942093449 0 0) 0x7f81340a1fe0 con 0x7f81340a0a90 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f81337fe700 1 --2- 172.21.15.154:0/3280464368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81341393c0 0x7f813413b7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f812c009e50 tx=0x7f812c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2a6463e5a056012 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f8131ffb700 1 -- 172.21.15.154:0/3280464368 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00e070 con 0x7f81341393c0 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f8131ffb700 1 -- 172.21.15.154:0/3280464368 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00b910 con 0x7f81341393c0 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f8131ffb700 1 -- 172.21.15.154:0/3280464368 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00bcc0 con 0x7f81341393c0 2023-09-30T22:24:33.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f813935e700 1 -- 172.21.15.154:0/3280464368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81341393c0 msgr2=0x7f813413b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f813935e700 1 --2- 172.21.15.154:0/3280464368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81341393c0 0x7f813413b7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f812c009e50 tx=0x7f812c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:33.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f813935e700 1 -- 172.21.15.154:0/3280464368 shutdown_connections 2023-09-30T22:24:33.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f813935e700 1 --2- 172.21.15.154:0/3280464368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81341393c0 0x7f813413b7a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f813935e700 1 --2- 172.21.15.154:0/3280464368 >> v2:172.21.15.154:3300/0 conn(0x7f81340a1570 0x7f8134138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f813935e700 1 -- 172.21.15.154:0/3280464368 >> 172.21.15.154:0/3280464368 conn(0x7f8134099c40 msgr2=0x7f813406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f813935e700 1 -- 172.21.15.154:0/3280464368 shutdown_connections 2023-09-30T22:24:33.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.042+0000 7f813935e700 1 -- 172.21.15.154:0/3280464368 wait complete. 2023-09-30T22:24:33.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.043+0000 7f813935e700 1 Processor -- start 2023-09-30T22:24:33.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f813935e700 1 -- start start 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f813935e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81340a0a90 0x7f8134122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f813935e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340a1570 0x7f8134122d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f813935e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81341393c0 0x7f8134123290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f813935e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8134126330 con 0x7f81340a1570 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f813935e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813409c7e0 con 0x7f81341393c0 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f813935e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8134125ac0 con 0x7f81340a0a90 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f8132ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81340a0a90 0x7f8134122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f81327fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340a1570 0x7f8134122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f8132ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81340a0a90 0x7f8134122810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47180/0 (socket says 172.21.15.154:47180) 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f8132ffd700 1 -- 172.21.15.154:0/2525253568 learned_addr learned my addr 172.21.15.154:0/2525253568 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f81337fe700 1 --2- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81341393c0 0x7f8134123290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f81327fc700 1 -- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81340a0a90 msgr2=0x7f8134122810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f81327fc700 1 --2- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81340a0a90 0x7f8134122810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f81327fc700 1 -- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81341393c0 msgr2=0x7f8134123290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f81327fc700 1 --2- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81341393c0 0x7f8134123290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.044+0000 7f81327fc700 1 -- 172.21.15.154:0/2525253568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280094a0 con 0x7f81340a1570 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.045+0000 7f81327fc700 1 --2- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340a1570 0x7f8134122d50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f812800e9b0 tx=0x7f812800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.045+0000 7f811b7fe700 1 -- 172.21.15.154:0/2525253568 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800ee50 con 0x7f81340a1570 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.045+0000 7f811b7fe700 1 -- 172.21.15.154:0/2525253568 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812800c850 con 0x7f81340a1570 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.045+0000 7f813935e700 1 -- 172.21.15.154:0/2525253568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c009b30 con 0x7f81340a1570 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.045+0000 7f811b7fe700 1 -- 172.21.15.154:0/2525253568 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812800cc00 con 0x7f81340a1570 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.045+0000 7f813935e700 1 -- 172.21.15.154:0/2525253568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813409b130 con 0x7f81340a1570 2023-09-30T22:24:33.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.045+0000 7f811b7fe700 1 -- 172.21.15.154:0/2525253568 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8128013470 con 0x7f81340a1570 2023-09-30T22:24:33.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.046+0000 7f811b7fe700 1 -- 172.21.15.154:0/2525253568 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f812803f6b0 con 0x7f81340a1570 2023-09-30T22:24:33.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.046+0000 7f813935e700 1 -- 172.21.15.154:0/2525253568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81341256d0 con 0x7f81340a1570 2023-09-30T22:24:33.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.050+0000 7f811b7fe700 1 -- 172.21.15.154:0/2525253568 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8128013720 con 0x7f81340a1570 2023-09-30T22:24:33.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:33.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:33.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:33.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.253+0000 7f813935e700 1 -- 172.21.15.154:0/2525253568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8134125eb0 con 0x7f81340a1570 2023-09-30T22:24:33.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.254+0000 7f811b7fe700 1 -- 172.21.15.154:0/2525253568 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8128021020 con 0x7f81340a1570 2023-09-30T22:24:33.255 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:33.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.256+0000 7f813935e700 1 -- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340a1570 msgr2=0x7f8134122d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.256+0000 7f813935e700 1 --2- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340a1570 0x7f8134122d50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f812800e9b0 tx=0x7f812800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.256+0000 7f813935e700 1 -- 172.21.15.154:0/2525253568 shutdown_connections 2023-09-30T22:24:33.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.256+0000 7f813935e700 1 --2- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81341393c0 0x7f8134123290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.256+0000 7f813935e700 1 --2- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81340a0a90 0x7f8134122810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.256+0000 7f813935e700 1 --2- 172.21.15.154:0/2525253568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340a1570 0x7f8134122d50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.256+0000 7f813935e700 1 -- 172.21.15.154:0/2525253568 >> 172.21.15.154:0/2525253568 conn(0x7f8134099c40 msgr2=0x7f813411c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.256+0000 7f813935e700 1 -- 172.21.15.154:0/2525253568 shutdown_connections 2023-09-30T22:24:33.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.256+0000 7f813935e700 1 -- 172.21.15.154:0/2525253568 wait complete. 2023-09-30T22:24:33.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.264+0000 7fd4ef6b5700 1 Processor -- start 2023-09-30T22:24:33.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.265+0000 7fd4ef6b5700 1 -- start start 2023-09-30T22:24:33.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.265+0000 7fd4ef6b5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.265+0000 7fd4ef6b5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4e8135f20 0x7fd4e8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.265+0000 7fd4ef6b5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e809aaa0 con 0x7fd4e809d860 2023-09-30T22:24:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.265+0000 7fd4ef6b5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e809e730 con 0x7fd4e8135f20 2023-09-30T22:24:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.265+0000 7fd4ef6b5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e809f870 con 0x7fd4e809e340 2023-09-30T22:24:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4edc52700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4e8135f20 0x7fd4e8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4ecc50700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4edc52700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4e8135f20 0x7fd4e8138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51110/0 (socket says 172.21.15.154:51110) 2023-09-30T22:24:33.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4edc52700 1 -- 172.21.15.154:0/2093374196 learned_addr learned my addr 172.21.15.154:0/2093374196 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:33.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4edc52700 1 -- 172.21.15.154:0/2093374196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 msgr2=0x7fd4e81359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4edc52700 1 --2- 172.21.15.154:0/2093374196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e81359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4edc52700 1 -- 172.21.15.154:0/2093374196 >> v1:172.21.15.154:6789/0 conn(0x7fd4e809d860 legacy=0x7fd4e809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4dffff700 1 -- 172.21.15.154:0/2093374196 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422777112 0 0) 0x7fd4e809aaa0 con 0x7fd4e809d860 2023-09-30T22:24:33.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4edc52700 1 -- 172.21.15.154:0/2093374196 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e809b360 con 0x7fd4e8135f20 2023-09-30T22:24:33.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4ecc50700 1 --2- 172.21.15.154:0/2093374196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4edc52700 1 --2- 172.21.15.154:0/2093374196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 0x7fd4e8138300 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000bef0 tx=0x7fd4e0009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c387dbcf0ac5dd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.266+0000 7fd4dffff700 1 -- 172.21.15.154:0/2093374196 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000b480 con 0x7fd4e8135f20 2023-09-30T22:24:33.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.267+0000 7fd4dffff700 1 -- 172.21.15.154:0/2093374196 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e000c950 con 0x7fd4e8135f20 2023-09-30T22:24:33.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.267+0000 7fd4dffff700 1 -- 172.21.15.154:0/2093374196 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000cd00 con 0x7fd4e8135f20 2023-09-30T22:24:33.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.267+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/2093374196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 msgr2=0x7fd4e8138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.267+0000 7fd4ef6b5700 1 --2- 172.21.15.154:0/2093374196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 0x7fd4e8138300 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000bef0 tx=0x7fd4e0009370 comp rx=0 tx=0).stop 2023-09-30T22:24:33.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.267+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/2093374196 shutdown_connections 2023-09-30T22:24:33.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.267+0000 7fd4ef6b5700 1 --2- 172.21.15.154:0/2093374196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 0x7fd4e8138300 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.267+0000 7fd4ef6b5700 1 --2- 172.21.15.154:0/2093374196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.267+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/2093374196 >> 172.21.15.154:0/2093374196 conn(0x7fd4e8099c40 msgr2=0x7fd4e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.268+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/2093374196 shutdown_connections 2023-09-30T22:24:33.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.268+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/2093374196 wait complete. 2023-09-30T22:24:33.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.269+0000 7fd4ef6b5700 1 Processor -- start 2023-09-30T22:24:33.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.269+0000 7fd4ef6b5700 1 -- start start 2023-09-30T22:24:33.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.269+0000 7fd4ef6b5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4e809d860 0x7fd4e811c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ef6b5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e811c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ef6b5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 0x7fd4e811cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ef6b5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8071fc0 con 0x7fd4e8135f20 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ef6b5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e809c8b0 con 0x7fd4e809d860 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ef6b5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e811f5d0 con 0x7fd4e809e340 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ecc50700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e811c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ecc50700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e811c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47188/0 (socket says 172.21.15.154:47188) 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ecc50700 1 -- 172.21.15.154:0/3241130090 learned_addr learned my addr 172.21.15.154:0/3241130090 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4edc52700 1 --2- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 0x7fd4e811cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ecc50700 1 -- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4e809d860 msgr2=0x7fd4e811c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ecc50700 1 --2- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4e809d860 0x7fd4e811c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ecc50700 1 -- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 msgr2=0x7fd4e811cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ecc50700 1 --2- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 0x7fd4e811cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ecc50700 1 -- 172.21.15.154:0/3241130090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d800d940 con 0x7fd4e809e340 2023-09-30T22:24:33.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4edc52700 1 --2- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 0x7fd4e811cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:33.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ecc50700 1 --2- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e811c860 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8012fc0 tx=0x7fd4d80103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.270+0000 7fd4ddffb700 1 -- 172.21.15.154:0/3241130090 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8010bb0 con 0x7fd4e809e340 2023-09-30T22:24:33.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.271+0000 7fd4ddffb700 1 -- 172.21.15.154:0/3241130090 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d8013040 con 0x7fd4e809e340 2023-09-30T22:24:33.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.271+0000 7fd4ddffb700 1 -- 172.21.15.154:0/3241130090 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800d2e0 con 0x7fd4e809e340 2023-09-30T22:24:33.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.271+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/3241130090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e000bb50 con 0x7fd4e809e340 2023-09-30T22:24:33.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.271+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/3241130090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e811e6e0 con 0x7fd4e809e340 2023-09-30T22:24:33.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.272+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/3241130090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e804f2a0 con 0x7fd4e809e340 2023-09-30T22:24:33.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.272+0000 7fd4ddffb700 1 -- 172.21.15.154:0/3241130090 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4d8018480 con 0x7fd4e809e340 2023-09-30T22:24:33.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.272+0000 7fd4ddffb700 1 -- 172.21.15.154:0/3241130090 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd4d8044180 con 0x7fd4e809e340 2023-09-30T22:24:33.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.276+0000 7fd4ddffb700 1 -- 172.21.15.154:0/3241130090 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4d8020550 con 0x7fd4e809e340 2023-09-30T22:24:33.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.313+0000 7f1bf46d8700 1 Processor -- start 2023-09-30T22:24:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.313+0000 7f1bf46d8700 1 -- start start 2023-09-30T22:24:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf46d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec138040 0x7f1bec138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf46d8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bec0a08e0 0x7f1bec0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf46d8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec0a1230 0x7f1bec13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf46d8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec0a2100 con 0x7f1bec0a08e0 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf46d8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec138950 con 0x7f1bec138040 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf46d8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec1379e0 con 0x7f1bec0a1230 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf2474700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec138040 0x7f1bec138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf1c73700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bec0a08e0 0x7f1bec0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf2c75700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec0a1230 0x7f1bec13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf2474700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec138040 0x7f1bec138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60358/0 (socket says 172.21.15.154:60358) 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf1c73700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bec0a08e0 0x7f1bec0a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51132/0 (socket says 172.21.15.154:51132) 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf2474700 1 -- 172.21.15.154:0/1415569430 learned_addr learned my addr 172.21.15.154:0/1415569430 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf1c73700 1 -- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec0a1230 msgr2=0x7f1bec13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf1c73700 1 --2- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec0a1230 0x7f1bec13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf1c73700 1 -- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec138040 msgr2=0x7f1bec138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf1c73700 1 --2- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec138040 0x7f1bec138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf1c73700 1 -- 172.21.15.154:0/1415569430 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec09b9b0 con 0x7f1bec0a08e0 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf2474700 1 --2- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec138040 0x7f1bec138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf1c73700 1 --2- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bec0a08e0 0x7f1bec0a0cf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009870 tx=0x7f1bdc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91312cfea23f9d8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.314+0000 7f1bf1472700 1 -- 172.21.15.154:0/1415569430 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc011830 con 0x7f1bec0a08e0 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf1472700 1 -- 172.21.15.154:0/1415569430 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc011990 con 0x7f1bec0a08e0 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf1472700 1 -- 172.21.15.154:0/1415569430 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc011d20 con 0x7f1bec0a08e0 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf46d8700 1 -- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bec0a08e0 msgr2=0x7f1bec0a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf46d8700 1 --2- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bec0a08e0 0x7f1bec0a0cf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009870 tx=0x7f1bdc009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf46d8700 1 -- 172.21.15.154:0/1415569430 shutdown_connections 2023-09-30T22:24:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf46d8700 1 --2- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec138040 0x7f1bec138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf46d8700 1 --2- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec0a1230 0x7f1bec13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf46d8700 1 --2- 172.21.15.154:0/1415569430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bec0a08e0 0x7f1bec0a0cf0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf46d8700 1 -- 172.21.15.154:0/1415569430 >> 172.21.15.154:0/1415569430 conn(0x7f1bec0a2980 msgr2=0x7f1bec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf46d8700 1 -- 172.21.15.154:0/1415569430 shutdown_connections 2023-09-30T22:24:33.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.315+0000 7f1bf46d8700 1 -- 172.21.15.154:0/1415569430 wait complete. 2023-09-30T22:24:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.316+0000 7f1bf46d8700 1 Processor -- start 2023-09-30T22:24:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.316+0000 7f1bf46d8700 1 -- start start 2023-09-30T22:24:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf46d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec0a08e0 0x7f1bec1262f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf46d8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bec0a1230 0x7f1bec126830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf46d8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec138040 0x7f1bec126d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf46d8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec09a2b0 con 0x7f1bec0a1230 2023-09-30T22:24:33.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf46d8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec128720 con 0x7f1bec0a08e0 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf46d8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec09c8c0 con 0x7f1bec138040 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2474700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec0a08e0 0x7f1bec1262f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf1c73700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bec0a1230 0x7f1bec126830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2474700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec0a08e0 0x7f1bec1262f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60372/0 (socket says 172.21.15.154:60372) 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2474700 1 -- 172.21.15.154:0/2003454055 learned_addr learned my addr 172.21.15.154:0/2003454055 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2c75700 1 --2- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec138040 0x7f1bec126d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2474700 1 -- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec138040 msgr2=0x7f1bec126d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2474700 1 --2- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec138040 0x7f1bec126d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2474700 1 -- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bec0a1230 msgr2=0x7f1bec126830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2474700 1 --2- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bec0a1230 0x7f1bec126830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2474700 1 -- 172.21.15.154:0/2003454055 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8009500 con 0x7f1bec0a08e0 2023-09-30T22:24:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1bf2474700 1 --2- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec0a08e0 0x7f1bec1262f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1be800ebb0 tx=0x7f1be800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.317+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2003454055 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8005a20 con 0x7f1bec0a08e0 2023-09-30T22:24:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.318+0000 7f1bf46d8700 1 -- 172.21.15.154:0/2003454055 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bdc0094a0 con 0x7f1bec0a08e0 2023-09-30T22:24:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.318+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2003454055 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be8005b80 con 0x7f1bec0a08e0 2023-09-30T22:24:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.318+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2003454055 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be800c850 con 0x7f1bec0a08e0 2023-09-30T22:24:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.318+0000 7f1bf46d8700 1 -- 172.21.15.154:0/2003454055 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec136e10 con 0x7f1bec0a08e0 2023-09-30T22:24:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.319+0000 7f1bf46d8700 1 -- 172.21.15.154:0/2003454055 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec04f2a0 con 0x7f1bec0a08e0 2023-09-30T22:24:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.319+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2003454055 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1be800c9b0 con 0x7f1bec0a08e0 2023-09-30T22:24:33.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.319+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2003454055 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1be803f9b0 con 0x7f1bec0a08e0 2023-09-30T22:24:33.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.324+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2003454055 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1be8022300 con 0x7f1bec0a08e0 2023-09-30T22:24:33.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.348+0000 7f5db1412700 1 Processor -- start 2023-09-30T22:24:33.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5db1412700 1 -- start start 2023-09-30T22:24:33.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5db1412700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5dac131980 0x7f5dac131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5db1412700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09bc70 0x7f5dac09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5db1412700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09c5c0 0x7f5dac138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5db1412700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac06eb30 con 0x7f5dac131980 2023-09-30T22:24:33.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5db1412700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0a1640 con 0x7f5dac09bc70 2023-09-30T22:24:33.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5db1412700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0a22d0 con 0x7f5dac09c5c0 2023-09-30T22:24:33.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5daaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5dac131980 0x7f5dac131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5daaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5dac131980 0x7f5dac131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51148/0 (socket says 172.21.15.154:51148) 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5daaffd700 1 -- 172.21.15.154:0/3998125473 learned_addr learned my addr 172.21.15.154:0/3998125473 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5dab7fe700 1 --2- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09c5c0 0x7f5dac138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5daa7fc700 1 --2- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09bc70 0x7f5dac09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5daaffd700 1 -- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09c5c0 msgr2=0x7f5dac138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5daaffd700 1 --2- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09c5c0 0x7f5dac138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5daaffd700 1 -- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09bc70 msgr2=0x7f5dac09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5daaffd700 1 --2- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09bc70 0x7f5dac09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.349+0000 7f5daaffd700 1 -- 172.21.15.154:0/3998125473 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac131550 con 0x7f5dac131980 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.350+0000 7f5daaffd700 1 --2- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dac131980 0x7f5dac131d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0098f0 tx=0x7f5d9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cebd5c00a8d68d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.350+0000 7f5da9ffb700 1 -- 172.21.15.154:0/3998125473 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c005e30 con 0x7f5dac131980 2023-09-30T22:24:33.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.350+0000 7f5da9ffb700 1 -- 172.21.15.154:0/3998125473 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c004030 con 0x7f5dac131980 2023-09-30T22:24:33.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.350+0000 7f5da9ffb700 1 -- 172.21.15.154:0/3998125473 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0043e0 con 0x7f5dac131980 2023-09-30T22:24:33.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.350+0000 7f5db1412700 1 -- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dac131980 msgr2=0x7f5dac131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.350+0000 7f5db1412700 1 --2- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dac131980 0x7f5dac131d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0098f0 tx=0x7f5d9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.351+0000 7f5db1412700 1 -- 172.21.15.154:0/3998125473 shutdown_connections 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.351+0000 7f5db1412700 1 --2- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09c5c0 0x7f5dac138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.351+0000 7f5db1412700 1 --2- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dac131980 0x7f5dac131d50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.351+0000 7f5db1412700 1 --2- 172.21.15.154:0/3998125473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09bc70 0x7f5dac09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.351+0000 7f5db1412700 1 -- 172.21.15.154:0/3998125473 >> 172.21.15.154:0/3998125473 conn(0x7f5dac0a2980 msgr2=0x7f5dac0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.351+0000 7f5db1412700 1 -- 172.21.15.154:0/3998125473 shutdown_connections 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.351+0000 7f5db1412700 1 -- 172.21.15.154:0/3998125473 wait complete. 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5db1412700 1 Processor -- start 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5db1412700 1 -- start start 2023-09-30T22:24:33.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5db1412700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09bc70 0x7f5dac11f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5db1412700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09c5c0 0x7f5dac11f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5db1412700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dac131980 0x7f5dac11fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5db1412700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac122210 con 0x7f5dac131980 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5db1412700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac120c20 con 0x7f5dac09c5c0 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5db1412700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac1214b0 con 0x7f5dac09bc70 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5daa7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09c5c0 0x7f5dac11f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5daaffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09bc70 0x7f5dac11f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5daa7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09c5c0 0x7f5dac11f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60390/0 (socket says 172.21.15.154:60390) 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5daaffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09bc70 0x7f5dac11f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47228/0 (socket says 172.21.15.154:47228) 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5daa7fc700 1 -- 172.21.15.154:0/4108345309 learned_addr learned my addr 172.21.15.154:0/4108345309 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.352+0000 7f5dab7fe700 1 --2- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dac131980 0x7f5dac11fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:33.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5daa7fc700 1 -- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09bc70 msgr2=0x7f5dac11f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5daa7fc700 1 --2- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09bc70 0x7f5dac11f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5daa7fc700 1 -- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dac131980 msgr2=0x7f5dac11fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5daa7fc700 1 --2- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dac131980 0x7f5dac11fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5daa7fc700 1 -- 172.21.15.154:0/4108345309 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c009500 con 0x7f5dac09c5c0 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5daaffd700 1 --2- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09bc70 0x7f5dac11f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5daa7fc700 1 --2- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09c5c0 0x7f5dac11f5a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5da000e960 tx=0x7f5da000ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5d937fe700 1 -- 172.21.15.154:0/4108345309 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0013680 con 0x7f5dac09c5c0 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5d937fe700 1 -- 172.21.15.154:0/4108345309 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da00137e0 con 0x7f5dac09c5c0 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5db1412700 1 -- 172.21.15.154:0/4108345309 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac130b40 con 0x7f5dac09c5c0 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5d937fe700 1 -- 172.21.15.154:0/4108345309 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0013b70 con 0x7f5dac09c5c0 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.353+0000 7f5db1412700 1 -- 172.21.15.154:0/4108345309 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac122b80 con 0x7f5dac09c5c0 2023-09-30T22:24:33.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.354+0000 7f5d937fe700 1 -- 172.21.15.154:0/4108345309 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5da0013cd0 con 0x7f5dac09c5c0 2023-09-30T22:24:33.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.354+0000 7f5d937fe700 1 -- 172.21.15.154:0/4108345309 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5da003f890 con 0x7f5dac09c5c0 2023-09-30T22:24:33.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.354+0000 7f5db1412700 1 -- 172.21.15.154:0/4108345309 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac122b80 con 0x7f5dac09c5c0 2023-09-30T22:24:33.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.359+0000 7f5d937fe700 1 -- 172.21.15.154:0/4108345309 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5dac122b80 con 0x7f5dac09c5c0 2023-09-30T22:24:33.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.487+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/3241130090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd4e811f740 con 0x7fd4e809e340 2023-09-30T22:24:33.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.487+0000 7fd4ddffb700 1 -- 172.21.15.154:0/3241130090 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4d8020370 con 0x7fd4e809e340 2023-09-30T22:24:33.488 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.489+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 msgr2=0x7fd4e811c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.489+0000 7fd4ef6b5700 1 --2- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e811c860 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8012fc0 tx=0x7fd4d80103a0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.489+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/3241130090 shutdown_connections 2023-09-30T22:24:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.489+0000 7fd4ef6b5700 1 --2- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8135f20 0x7fd4e811cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.489+0000 7fd4ef6b5700 1 --2- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4e809d860 0x7fd4e811c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.489+0000 7fd4ef6b5700 1 --2- 172.21.15.154:0/3241130090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4e809e340 0x7fd4e811c860 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.489+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/3241130090 >> 172.21.15.154:0/3241130090 conn(0x7fd4e8099c40 msgr2=0x7fd4e80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.490+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/3241130090 shutdown_connections 2023-09-30T22:24:33.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.490+0000 7fd4ef6b5700 1 -- 172.21.15.154:0/3241130090 wait complete. 2023-09-30T22:24:33.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:33.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.526+0000 7f1bf46d8700 1 -- 172.21.15.154:0/2003454055 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1bec129bf0 con 0x7f1bec0a08e0 2023-09-30T22:24:33.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.526+0000 7f1be2ffd700 1 -- 172.21.15.154:0/2003454055 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1be8013e60 con 0x7f1bec0a08e0 2023-09-30T22:24:33.527 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:33.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.528+0000 7f1bf46d8700 1 -- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec0a08e0 msgr2=0x7f1bec1262f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.528+0000 7f1bf46d8700 1 --2- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec0a08e0 0x7f1bec1262f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1be800ebb0 tx=0x7f1be800eec0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.528+0000 7f1bf46d8700 1 -- 172.21.15.154:0/2003454055 shutdown_connections 2023-09-30T22:24:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.528+0000 7f1bf46d8700 1 --2- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bec138040 0x7f1bec126d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.528+0000 7f1bf46d8700 1 --2- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bec0a08e0 0x7f1bec1262f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.528+0000 7f1bf46d8700 1 --2- 172.21.15.154:0/2003454055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bec0a1230 0x7f1bec126830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.528+0000 7f1bf46d8700 1 -- 172.21.15.154:0/2003454055 >> 172.21.15.154:0/2003454055 conn(0x7f1bec0a2980 msgr2=0x7f1bec09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.528+0000 7f1bf46d8700 1 -- 172.21.15.154:0/2003454055 shutdown_connections 2023-09-30T22:24:33.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.528+0000 7f1bf46d8700 1 -- 172.21.15.154:0/2003454055 wait complete. 2023-09-30T22:24:33.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.552+0000 7f5db1412700 1 -- 172.21.15.154:0/4108345309 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5dac122b80 con 0x7f5dac09c5c0 2023-09-30T22:24:33.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.552+0000 7f5d937fe700 1 -- 172.21.15.154:0/4108345309 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5dac122b80 con 0x7f5dac09c5c0 2023-09-30T22:24:33.553 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.554+0000 7f5db1412700 1 -- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09c5c0 msgr2=0x7f5dac11f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.554+0000 7f5db1412700 1 --2- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09c5c0 0x7f5dac11f5a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5da000e960 tx=0x7f5da000ec70 comp rx=0 tx=0).stop 2023-09-30T22:24:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.555+0000 7f5db1412700 1 -- 172.21.15.154:0/4108345309 shutdown_connections 2023-09-30T22:24:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.555+0000 7f5db1412700 1 --2- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dac131980 0x7f5dac11fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.555+0000 7f5db1412700 1 --2- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5dac09bc70 0x7f5dac11f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.555+0000 7f5db1412700 1 --2- 172.21.15.154:0/4108345309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5dac09c5c0 0x7f5dac11f5a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.555+0000 7f5db1412700 1 -- 172.21.15.154:0/4108345309 >> 172.21.15.154:0/4108345309 conn(0x7f5dac0a2980 msgr2=0x7f5dac099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.555+0000 7f5db1412700 1 -- 172.21.15.154:0/4108345309 shutdown_connections 2023-09-30T22:24:33.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:33.555+0000 7f5db1412700 1 -- 172.21.15.154:0/4108345309 wait complete. 2023-09-30T22:24:33.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:34.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:34.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.407+0000 7fb597d6f700 1 Processor -- start 2023-09-30T22:24:34.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.407+0000 7fb597d6f700 1 -- start start 2023-09-30T22:24:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb597d6f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb59009e870 0x7fb59009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb597d6f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb59009f180 0x7fb590131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb597d6f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb590131d70 0x7fb590132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb597d6f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5900a0920 con 0x7fb59009f180 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb597d6f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59009c970 con 0x7fb590131d70 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb597d6f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb59009bab0 con 0x7fb59009e870 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59530a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb59009f180 0x7fb590131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb595b0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb59009e870 0x7fb59009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59630c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb590131d70 0x7fb590132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59530a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb59009f180 0x7fb590131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51164/0 (socket says 172.21.15.154:51164) 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59530a700 1 -- 172.21.15.154:0/2975589494 learned_addr learned my addr 172.21.15.154:0/2975589494 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb595b0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb59009e870 0x7fb59009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47230/0 (socket says 172.21.15.154:47230) 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59530a700 1 -- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb59009e870 msgr2=0x7fb59009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59530a700 1 --2- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb59009e870 0x7fb59009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59530a700 1 -- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb590131d70 msgr2=0x7fb590132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59530a700 1 --2- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb590131d70 0x7fb590132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59530a700 1 -- 172.21.15.154:0/2975589494 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59009f9c0 con 0x7fb59009f180 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59630c700 1 --2- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb590131d70 0x7fb590132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.408+0000 7fb59530a700 1 --2- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 0x7fb590131830 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009920 tx=0x7fb58c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b5b4e4b6198e4c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb594b09700 1 -- 172.21.15.154:0/2975589494 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c011830 con 0x7fb59009f180 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb594b09700 1 -- 172.21.15.154:0/2975589494 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c011990 con 0x7fb59009f180 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb594b09700 1 -- 172.21.15.154:0/2975589494 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c011d20 con 0x7fb59009f180 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb597d6f700 1 -- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 msgr2=0x7fb590131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb597d6f700 1 --2- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 0x7fb590131830 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009920 tx=0x7fb58c009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb597d6f700 1 -- 172.21.15.154:0/2975589494 shutdown_connections 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb597d6f700 1 --2- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb590131d70 0x7fb590132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb597d6f700 1 --2- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb59009e870 0x7fb59009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb597d6f700 1 --2- 172.21.15.154:0/2975589494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 0x7fb590131830 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb597d6f700 1 -- 172.21.15.154:0/2975589494 >> 172.21.15.154:0/2975589494 conn(0x7fb5900a4430 msgr2=0x7fb5900a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb597d6f700 1 -- 172.21.15.154:0/2975589494 shutdown_connections 2023-09-30T22:24:34.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.409+0000 7fb597d6f700 1 -- 172.21.15.154:0/2975589494 wait complete. 2023-09-30T22:24:34.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.410+0000 7fb597d6f700 1 Processor -- start 2023-09-30T22:24:34.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.410+0000 7fb597d6f700 1 -- start start 2023-09-30T22:24:34.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.410+0000 7fb597d6f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb59009e870 0x7fb59006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb597d6f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 0x7fb59006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb597d6f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb590131d70 0x7fb59006c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb597d6f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59006ccc0 con 0x7fb59009f180 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb597d6f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb590122600 con 0x7fb59009e870 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb597d6f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb590122b20 con 0x7fb590131d70 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb595b0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb59009e870 0x7fb59006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59530a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 0x7fb59006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59630c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb590131d70 0x7fb59006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59530a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 0x7fb59006bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51178/0 (socket says 172.21.15.154:51178) 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb595b0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb59009e870 0x7fb59006b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60412/0 (socket says 172.21.15.154:60412) 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59530a700 1 -- 172.21.15.154:0/2768500087 learned_addr learned my addr 172.21.15.154:0/2768500087 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59630c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb590131d70 0x7fb59006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47234/0 (socket says 172.21.15.154:47234) 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59530a700 1 -- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb590131d70 msgr2=0x7fb59006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59530a700 1 --2- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb590131d70 0x7fb59006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59530a700 1 -- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb59009e870 msgr2=0x7fb59006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59530a700 1 --2- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb59009e870 0x7fb59006b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59530a700 1 -- 172.21.15.154:0/2768500087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588009a70 con 0x7fb59009f180 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59630c700 1 --2- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb590131d70 0x7fb59006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb59530a700 1 --2- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 0x7fb59006bdc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009c70 tx=0x7fb58c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb5867fc700 1 -- 172.21.15.154:0/2768500087 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c004240 con 0x7fb59009f180 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb5867fc700 1 -- 172.21.15.154:0/2768500087 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c01f070 con 0x7fb59009f180 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb597d6f700 1 -- 172.21.15.154:0/2768500087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c009550 con 0x7fb59009f180 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb5867fc700 1 -- 172.21.15.154:0/2768500087 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0045e0 con 0x7fb59009f180 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.411+0000 7fb597d6f700 1 -- 172.21.15.154:0/2768500087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb590122860 con 0x7fb59009f180 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.412+0000 7fb597d6f700 1 -- 172.21.15.154:0/2768500087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59004f2a0 con 0x7fb59009f180 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.412+0000 7fb5867fc700 1 -- 172.21.15.154:0/2768500087 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb58c021030 con 0x7fb59009f180 2023-09-30T22:24:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.413+0000 7fb5867fc700 1 -- 172.21.15.154:0/2768500087 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb58c040d00 con 0x7fb59009f180 2023-09-30T22:24:34.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.417+0000 7fb5867fc700 1 -- 172.21.15.154:0/2768500087 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb58c003e00 con 0x7fb59009f180 2023-09-30T22:24:34.508 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:34.543 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:34.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:34.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.606+0000 7fb597d6f700 1 -- 172.21.15.154:0/2768500087 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb59009f660 con 0x7fb59009f180 2023-09-30T22:24:34.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.606+0000 7fb5867fc700 1 -- 172.21.15.154:0/2768500087 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb58c015030 con 0x7fb59009f180 2023-09-30T22:24:34.607 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:34.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.608+0000 7fb597d6f700 1 -- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 msgr2=0x7fb59006bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.608+0000 7fb597d6f700 1 --2- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 0x7fb59006bdc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009c70 tx=0x7fb58c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:34.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.608+0000 7fb597d6f700 1 -- 172.21.15.154:0/2768500087 shutdown_connections 2023-09-30T22:24:34.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.608+0000 7fb597d6f700 1 --2- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb590131d70 0x7fb59006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.608+0000 7fb597d6f700 1 --2- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb59009e870 0x7fb59006b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.608+0000 7fb597d6f700 1 --2- 172.21.15.154:0/2768500087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59009f180 0x7fb59006bdc0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.608+0000 7fb597d6f700 1 -- 172.21.15.154:0/2768500087 >> 172.21.15.154:0/2768500087 conn(0x7fb5900a4430 msgr2=0x7fb59009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.608+0000 7fb597d6f700 1 -- 172.21.15.154:0/2768500087 shutdown_connections 2023-09-30T22:24:34.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.609+0000 7fb597d6f700 1 -- 172.21.15.154:0/2768500087 wait complete. 2023-09-30T22:24:34.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:34.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.679+0000 7f6a4dc1e700 1 Processor -- start 2023-09-30T22:24:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.679+0000 7f8e8a5aa700 1 Processor -- start 2023-09-30T22:24:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a4dc1e700 1 -- start start 2023-09-30T22:24:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e8a5aa700 1 -- start start 2023-09-30T22:24:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e8a5aa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e84066410 0x7f8e841319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e8a5aa700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e841314b0 0x7f8e84131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e8a5aa700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e840a0f20 con 0x7f8e8409bc70 2023-09-30T22:24:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e8a5aa700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e840667e0 con 0x7f8e841314b0 2023-09-30T22:24:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e8a5aa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840a23c0 con 0x7f8e84066410 2023-09-30T22:24:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e837fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e841314b0 0x7f8e84131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e837fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e841314b0 0x7f8e84131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51184/0 (socket says 172.21.15.154:51184) 2023-09-30T22:24:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e837fe700 1 -- 172.21.15.154:0/3697432448 learned_addr learned my addr 172.21.15.154:0/3697432448 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f8e83fff700 1 --2- 172.21.15.154:0/3697432448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e84066410 0x7f8e841319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a4dc1e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a480a0a70 0x7f6a480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a4dc1e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a480a1380 0x7f6a48133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a4dc1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a48133f50 0x7f6a48134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a4dc1e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4809e9d0 con 0x7f6a480a1380 2023-09-30T22:24:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a4dc1e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4809dc00 con 0x7f6a48133f50 2023-09-30T22:24:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a4dc1e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4809dec0 con 0x7f6a480a0a70 2023-09-30T22:24:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a47fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a48133f50 0x7f6a48134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a47fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a48133f50 0x7f6a48134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60424/0 (socket says 172.21.15.154:60424) 2023-09-30T22:24:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a47fff700 1 -- 172.21.15.154:0/1758280453 learned_addr learned my addr 172.21.15.154:0/1758280453 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.680+0000 7f6a477fe700 1 --2- 172.21.15.154:0/1758280453 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a480a0a70 0x7f6a480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a46ffd700 1 --2- 172.21.15.154:0/1758280453 >> v2:172.21.15.154:3300/0 conn(0x7f6a480a1380 0x7f6a48133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a477fe700 1 -- 172.21.15.154:0/1758280453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a48133f50 msgr2=0x7f6a48134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a477fe700 1 --2- 172.21.15.154:0/1758280453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a48133f50 0x7f6a48134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a477fe700 1 -- 172.21.15.154:0/1758280453 >> v2:172.21.15.154:3300/0 conn(0x7f6a480a1380 msgr2=0x7f6a48133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a477fe700 1 --2- 172.21.15.154:0/1758280453 >> v2:172.21.15.154:3300/0 conn(0x7f6a480a1380 0x7f6a48133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a477fe700 1 -- 172.21.15.154:0/1758280453 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4809e6a0 con 0x7f6a480a0a70 2023-09-30T22:24:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f8e83fff700 1 -- 172.21.15.154:0/3697432448 >> v2:172.21.15.154:3300/0 conn(0x7f8e841314b0 msgr2=0x7f8e84131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f8e83fff700 1 --2- 172.21.15.154:0/3697432448 >> v2:172.21.15.154:3300/0 conn(0x7f8e841314b0 0x7f8e84131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f8e83fff700 1 -- 172.21.15.154:0/3697432448 >> v1:172.21.15.154:6789/0 conn(0x7f8e8409bc70 legacy=0x7f8e8409c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f8e83fff700 1 -- 172.21.15.154:0/3697432448 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e840a16e0 con 0x7f8e84066410 2023-09-30T22:24:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f8e837fe700 1 --2- 172.21.15.154:0/3697432448 >> v2:172.21.15.154:3300/0 conn(0x7f8e841314b0 0x7f8e84131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f8e83fff700 1 --2- 172.21.15.154:0/3697432448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e84066410 0x7f8e841319f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009850 tx=0x7f8e74009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbacd759d22caf6d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a477fe700 1 --2- 172.21.15.154:0/1758280453 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a480a0a70 0x7f6a480a0e40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009840 tx=0x7f6a38009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ca0d600f402bb15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f8e82ffd700 1 -- 172.21.15.154:0/3697432448 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74005e30 con 0x7f8e84066410 2023-09-30T22:24:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f8e82ffd700 1 -- 172.21.15.154:0/3697432448 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e74006030 con 0x7f8e84066410 2023-09-30T22:24:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f8e82ffd700 1 -- 172.21.15.154:0/3697432448 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e740063c0 con 0x7f8e84066410 2023-09-30T22:24:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a467fc700 1 -- 172.21.15.154:0/1758280453 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38011830 con 0x7f6a480a0a70 2023-09-30T22:24:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a467fc700 1 -- 172.21.15.154:0/1758280453 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a38011990 con 0x7f6a480a0a70 2023-09-30T22:24:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.681+0000 7f6a467fc700 1 -- 172.21.15.154:0/1758280453 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38011d20 con 0x7f6a480a0a70 2023-09-30T22:24:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3697432448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e84066410 msgr2=0x7f8e841319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f8e8a5aa700 1 --2- 172.21.15.154:0/3697432448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e84066410 0x7f8e841319f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009850 tx=0x7f8e74009b60 comp rx=0 tx=0).stop 2023-09-30T22:24:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/1758280453 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a480a0a70 msgr2=0x7f6a480a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f6a4dc1e700 1 --2- 172.21.15.154:0/1758280453 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a480a0a70 0x7f6a480a0e40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009840 tx=0x7f6a38009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/1758280453 shutdown_connections 2023-09-30T22:24:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3697432448 shutdown_connections 2023-09-30T22:24:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f6a4dc1e700 1 --2- 172.21.15.154:0/1758280453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a48133f50 0x7f6a48134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f6a4dc1e700 1 --2- 172.21.15.154:0/1758280453 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a480a0a70 0x7f6a480a0e40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f6a4dc1e700 1 --2- 172.21.15.154:0/1758280453 >> v2:172.21.15.154:3300/0 conn(0x7f6a480a1380 0x7f6a48133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/1758280453 >> 172.21.15.154:0/1758280453 conn(0x7f6a480a6610 msgr2=0x7f6a480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f8e8a5aa700 1 --2- 172.21.15.154:0/3697432448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e84066410 0x7f8e841319f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f8e8a5aa700 1 --2- 172.21.15.154:0/3697432448 >> v2:172.21.15.154:3300/0 conn(0x7f8e841314b0 0x7f8e84131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3697432448 >> 172.21.15.154:0/3697432448 conn(0x7f8e840a2980 msgr2=0x7f8e840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/1758280453 shutdown_connections 2023-09-30T22:24:34.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3697432448 shutdown_connections 2023-09-30T22:24:34.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/1758280453 wait complete. 2023-09-30T22:24:34.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.682+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3697432448 wait complete. 2023-09-30T22:24:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.683+0000 7f8e8a5aa700 1 Processor -- start 2023-09-30T22:24:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.683+0000 7f8e8a5aa700 1 -- start start 2023-09-30T22:24:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.683+0000 7f6a4dc1e700 1 Processor -- start 2023-09-30T22:24:34.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e8a5aa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e84066410 0x7f8e84137b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e8a5aa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e8409bc70 0x7f8e84138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e8a5aa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e841314b0 0x7f8e84099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e8a5aa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84130a40 con 0x7f8e841314b0 2023-09-30T22:24:34.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e8a5aa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840a1d50 con 0x7f8e84066410 2023-09-30T22:24:34.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e8a5aa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8409aef0 con 0x7f8e8409bc70 2023-09-30T22:24:34.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e88b47700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e841314b0 0x7f8e84099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e88b47700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e841314b0 0x7f8e84099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51196/0 (socket says 172.21.15.154:51196) 2023-09-30T22:24:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e88b47700 1 -- 172.21.15.154:0/3980901895 learned_addr learned my addr 172.21.15.154:0/3980901895 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e83fff700 1 --2- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e84066410 0x7f8e84137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e837fe700 1 --2- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e8409bc70 0x7f8e84138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a4dc1e700 1 -- start start 2023-09-30T22:24:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a4dc1e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a480a0a70 0x7f6a481223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a4dc1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a480a1380 0x7f6a48122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a4dc1e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a48133f50 0x7f6a48122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a4dc1e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48124150 con 0x7f6a480a0a70 2023-09-30T22:24:34.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a4dc1e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48124e60 con 0x7f6a480a1380 2023-09-30T22:24:34.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e88b47700 1 -- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e8409bc70 msgr2=0x7f8e84138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e88b47700 1 --2- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e8409bc70 0x7f8e84138050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e88b47700 1 -- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e84066410 msgr2=0x7f8e84137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e88b47700 1 --2- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e84066410 0x7f8e84137b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e88b47700 1 -- 172.21.15.154:0/3980901895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e78009550 con 0x7f8e841314b0 2023-09-30T22:24:34.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f8e88b47700 1 --2- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e841314b0 0x7f8e84099a90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00cc80 tx=0x7f8e7c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a4dc1e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48125220 con 0x7f6a48133f50 2023-09-30T22:24:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a477fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a480a0a70 0x7f6a481223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a477fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a480a0a70 0x7f6a481223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51204/0 (socket says 172.21.15.154:51204) 2023-09-30T22:24:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a477fe700 1 -- 172.21.15.154:0/738785959 learned_addr learned my addr 172.21.15.154:0/738785959 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.684+0000 7f6a46ffd700 1 --2- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a480a1380 0x7f6a48122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a47fff700 1 --2- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a48133f50 0x7f6a48122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a46ffd700 1 -- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a48133f50 msgr2=0x7f6a48122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a46ffd700 1 --2- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a48133f50 0x7f6a48122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a46ffd700 1 -- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a480a0a70 msgr2=0x7f6a481223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a46ffd700 1 --2- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a480a0a70 0x7f6a481223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a46ffd700 1 -- 172.21.15.154:0/738785959 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a380094a0 con 0x7f6a480a1380 2023-09-30T22:24:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f8e80ff9700 1 -- 172.21.15.154:0/3980901895 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c003c00 con 0x7f8e841314b0 2023-09-30T22:24:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a46ffd700 1 --2- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a480a1380 0x7f6a48122900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e5d0 tx=0x7f6a3c00e8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a2ffff700 1 -- 172.21.15.154:0/738785959 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c004230 con 0x7f6a480a1380 2023-09-30T22:24:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a2ffff700 1 -- 172.21.15.154:0/738785959 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c004390 con 0x7f6a480a1380 2023-09-30T22:24:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a2ffff700 1 -- 172.21.15.154:0/738785959 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0036a0 con 0x7f6a480a1380 2023-09-30T22:24:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/738785959 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a48125ee0 con 0x7f6a480a1380 2023-09-30T22:24:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/738785959 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a48125940 con 0x7f6a480a1380 2023-09-30T22:24:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.686+0000 7f6a2ffff700 1 -- 172.21.15.154:0/738785959 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a3c003800 con 0x7f6a480a1380 2023-09-30T22:24:34.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f8e80ff9700 1 -- 172.21.15.154:0/3980901895 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c003d60 con 0x7f8e841314b0 2023-09-30T22:24:34.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3980901895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e74009430 con 0x7f8e841314b0 2023-09-30T22:24:34.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f8e80ff9700 1 -- 172.21.15.154:0/3980901895 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00aa80 con 0x7f8e841314b0 2023-09-30T22:24:34.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.685+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3980901895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e84136760 con 0x7f8e841314b0 2023-09-30T22:24:34.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.686+0000 7f8e80ff9700 1 -- 172.21.15.154:0/3980901895 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e7c00abe0 con 0x7f8e841314b0 2023-09-30T22:24:34.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.686+0000 7f8e80ff9700 1 -- 172.21.15.154:0/3980901895 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8e7c0052b0 con 0x7f8e841314b0 2023-09-30T22:24:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.687+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/738785959 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4804f2a0 con 0x7f6a480a1380 2023-09-30T22:24:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.687+0000 7f6a2ffff700 1 -- 172.21.15.154:0/738785959 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a3c03ef60 con 0x7f6a480a1380 2023-09-30T22:24:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.687+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3980901895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e640052e0 con 0x7f8e841314b0 2023-09-30T22:24:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.691+0000 7f6a2ffff700 1 -- 172.21.15.154:0/738785959 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a3c01b720 con 0x7f6a480a1380 2023-09-30T22:24:34.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.692+0000 7f8e80ff9700 1 -- 172.21.15.154:0/3980901895 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e7c0198f0 con 0x7f8e841314b0 2023-09-30T22:24:34.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.717+0000 7f4e621ba700 1 Processor -- start 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.717+0000 7f4e621ba700 1 -- start start 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e621ba700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09f430 0x7f4e5c138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e621ba700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e5c139400 0x7f4e5c13b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e621ba700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c06bcc0 con 0x7f4e5c09e950 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e621ba700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c06c9a0 con 0x7f4e5c139400 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e621ba700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c09afe0 con 0x7f4e5c09f430 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e5bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e5c139400 0x7f4e5c13b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e5bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e5c139400 0x7f4e5c13b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51214/0 (socket says 172.21.15.154:51214) 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e5bfff700 1 -- 172.21.15.154:0/3601665646 learned_addr learned my addr 172.21.15.154:0/3601665646 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:34.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e5affd700 1 --2- 172.21.15.154:0/3601665646 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09f430 0x7f4e5c138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e5bfff700 1 -- 172.21.15.154:0/3601665646 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09f430 msgr2=0x7f4e5c138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:34.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e5bfff700 1 --2- 172.21.15.154:0/3601665646 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09f430 0x7f4e5c138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e5bfff700 1 -- 172.21.15.154:0/3601665646 >> v1:172.21.15.154:6789/0 conn(0x7f4e5c09e950 legacy=0x7f4e5c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e5bfff700 1 -- 172.21.15.154:0/3601665646 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c06cb80 con 0x7f4e5c139400 2023-09-30T22:24:34.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.718+0000 7f4e5affd700 1 --2- 172.21.15.154:0/3601665646 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09f430 0x7f4e5c138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:34.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.719+0000 7f4e5bfff700 1 --2- 172.21.15.154:0/3601665646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 0x7f4e5c13b7e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009e50 tx=0x7f4e5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12bc6a83d52bb32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.719+0000 7f4e5a7fc700 1 -- 172.21.15.154:0/3601665646 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400e070 con 0x7f4e5c139400 2023-09-30T22:24:34.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.719+0000 7f4e5a7fc700 1 -- 172.21.15.154:0/3601665646 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400b910 con 0x7f4e5c139400 2023-09-30T22:24:34.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.719+0000 7f4e5a7fc700 1 -- 172.21.15.154:0/3601665646 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400bcc0 con 0x7f4e5c139400 2023-09-30T22:24:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.720+0000 7f4e621ba700 1 -- 172.21.15.154:0/3601665646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 msgr2=0x7f4e5c13b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.720+0000 7f4e621ba700 1 --2- 172.21.15.154:0/3601665646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 0x7f4e5c13b7e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009e50 tx=0x7f4e5400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.720+0000 7f4e621ba700 1 -- 172.21.15.154:0/3601665646 shutdown_connections 2023-09-30T22:24:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.720+0000 7f4e621ba700 1 --2- 172.21.15.154:0/3601665646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 0x7f4e5c13b7e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.720+0000 7f4e621ba700 1 --2- 172.21.15.154:0/3601665646 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09f430 0x7f4e5c138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.720+0000 7f4e621ba700 1 -- 172.21.15.154:0/3601665646 >> 172.21.15.154:0/3601665646 conn(0x7f4e5c0a0f70 msgr2=0x7f4e5c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.720+0000 7f4e621ba700 1 -- 172.21.15.154:0/3601665646 shutdown_connections 2023-09-30T22:24:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.720+0000 7f4e621ba700 1 -- 172.21.15.154:0/3601665646 wait complete. 2023-09-30T22:24:34.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e621ba700 1 Processor -- start 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e621ba700 1 -- start start 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e621ba700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09e950 0x7f4e5c11ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e621ba700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e5c09f430 0x7f4e5c11f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e621ba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 0x7f4e5c11f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e621ba700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c120990 con 0x7f4e5c139400 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e621ba700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c09b650 con 0x7f4e5c09f430 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e621ba700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c120270 con 0x7f4e5c09e950 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e5bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 0x7f4e5c11f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e5bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 0x7f4e5c11f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51222/0 (socket says 172.21.15.154:51222) 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e5bfff700 1 -- 172.21.15.154:0/1326707930 learned_addr learned my addr 172.21.15.154:0/1326707930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e5affd700 1 --2- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e5c09f430 0x7f4e5c11f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.721+0000 7f4e5b7fe700 1 --2- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09e950 0x7f4e5c11ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e5bfff700 1 -- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09e950 msgr2=0x7f4e5c11ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e5bfff700 1 --2- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09e950 0x7f4e5c11ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e5bfff700 1 -- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e5c09f430 msgr2=0x7f4e5c11f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e5bfff700 1 --2- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e5c09f430 0x7f4e5c11f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e5bfff700 1 -- 172.21.15.154:0/1326707930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e500094a0 con 0x7f4e5c139400 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e5bfff700 1 --2- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 0x7f4e5c11f810 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c09a700 tx=0x7f4e54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e43fff700 1 -- 172.21.15.154:0/1326707930 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54004800 con 0x7f4e5c139400 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e43fff700 1 -- 172.21.15.154:0/1326707930 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54004960 con 0x7f4e5c139400 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e621ba700 1 -- 172.21.15.154:0/1326707930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e54009b30 con 0x7f4e5c139400 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e43fff700 1 -- 172.21.15.154:0/1326707930 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5401c680 con 0x7f4e5c139400 2023-09-30T22:24:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.722+0000 7f4e621ba700 1 -- 172.21.15.154:0/1326707930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c122420 con 0x7f4e5c139400 2023-09-30T22:24:34.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.723+0000 7f4e43fff700 1 -- 172.21.15.154:0/1326707930 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e5401c7e0 con 0x7f4e5c139400 2023-09-30T22:24:34.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.723+0000 7f4e43fff700 1 -- 172.21.15.154:0/1326707930 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e54041240 con 0x7f4e5c139400 2023-09-30T22:24:34.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.724+0000 7f4e621ba700 1 -- 172.21.15.154:0/1326707930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c04f2a0 con 0x7f4e5c139400 2023-09-30T22:24:34.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.728+0000 7f4e43fff700 1 -- 172.21.15.154:0/1326707930 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e5402d940 con 0x7f4e5c139400 2023-09-30T22:24:34.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.885+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/738785959 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a48125cc0 con 0x7f6a480a1380 2023-09-30T22:24:34.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.886+0000 7f6a2ffff700 1 -- 172.21.15.154:0/738785959 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a3c01c3c0 con 0x7f6a480a1380 2023-09-30T22:24:34.887 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:34.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.886+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3980901895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e64005590 con 0x7f8e841314b0 2023-09-30T22:24:34.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.887+0000 7f8e80ff9700 1 -- 172.21.15.154:0/3980901895 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e7c02a090 con 0x7f8e841314b0 2023-09-30T22:24:34.888 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:34.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.888+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a480a1380 msgr2=0x7f6a48122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.888+0000 7f6a4dc1e700 1 --2- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a480a1380 0x7f6a48122900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e5d0 tx=0x7f6a3c00e8e0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.888+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/738785959 shutdown_connections 2023-09-30T22:24:34.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.888+0000 7f6a4dc1e700 1 --2- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a48133f50 0x7f6a48122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.888+0000 7f6a4dc1e700 1 --2- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a480a0a70 0x7f6a481223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.888+0000 7f6a4dc1e700 1 --2- 172.21.15.154:0/738785959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a480a1380 0x7f6a48122900 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.888+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/738785959 >> 172.21.15.154:0/738785959 conn(0x7f6a480a6610 msgr2=0x7f6a4809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.889+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/738785959 shutdown_connections 2023-09-30T22:24:34.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.889+0000 7f6a4dc1e700 1 -- 172.21.15.154:0/738785959 wait complete. 2023-09-30T22:24:34.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.889+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e841314b0 msgr2=0x7f8e84099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.889+0000 7f8e8a5aa700 1 --2- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e841314b0 0x7f8e84099a90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00cc80 tx=0x7f8e7c00cf90 comp rx=0 tx=0).stop 2023-09-30T22:24:34.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.889+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3980901895 shutdown_connections 2023-09-30T22:24:34.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.889+0000 7f8e8a5aa700 1 --2- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e841314b0 0x7f8e84099a90 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.889+0000 7f8e8a5aa700 1 --2- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e84066410 0x7f8e84137b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.889+0000 7f8e8a5aa700 1 --2- 172.21.15.154:0/3980901895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e8409bc70 0x7f8e84138050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.889+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3980901895 >> 172.21.15.154:0/3980901895 conn(0x7f8e840a2980 msgr2=0x7f8e8412f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.890+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3980901895 shutdown_connections 2023-09-30T22:24:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.890+0000 7f8e8a5aa700 1 -- 172.21.15.154:0/3980901895 wait complete. 2023-09-30T22:24:34.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:34.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:34.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.924+0000 7f4e621ba700 1 -- 172.21.15.154:0/1326707930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4e5c0a0850 con 0x7f4e5c139400 2023-09-30T22:24:34.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.925+0000 7f4e43fff700 1 -- 172.21.15.154:0/1326707930 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e54034090 con 0x7f4e5c139400 2023-09-30T22:24:34.926 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.927+0000 7f4e621ba700 1 -- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 msgr2=0x7f4e5c11f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.927+0000 7f4e621ba700 1 --2- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 0x7f4e5c11f810 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c09a700 tx=0x7f4e54004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.927+0000 7f4e621ba700 1 -- 172.21.15.154:0/1326707930 shutdown_connections 2023-09-30T22:24:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.927+0000 7f4e621ba700 1 --2- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e5c139400 0x7f4e5c11f810 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.927+0000 7f4e621ba700 1 --2- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e5c09e950 0x7f4e5c11ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.927+0000 7f4e621ba700 1 --2- 172.21.15.154:0/1326707930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e5c09f430 0x7f4e5c11f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.927+0000 7f4e621ba700 1 -- 172.21.15.154:0/1326707930 >> 172.21.15.154:0/1326707930 conn(0x7f4e5c0a0f70 msgr2=0x7f4e5c138390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.927+0000 7f4e621ba700 1 -- 172.21.15.154:0/1326707930 shutdown_connections 2023-09-30T22:24:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:34.927+0000 7f4e621ba700 1 -- 172.21.15.154:0/1326707930 wait complete. 2023-09-30T22:24:34.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:35.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:35.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.755+0000 7fa71cb2c700 1 Processor -- start 2023-09-30T22:24:35.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.755+0000 7fa71cb2c700 1 -- start start 2023-09-30T22:24:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa71cb2c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa718136960 0x7fa718138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa71cb2c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718139280 0x7fa71813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa71cb2c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71806b2d0 con 0x7fa718133ad0 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa71cb2c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7181345b0 con 0x7fa718136960 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa71cb2c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa718133610 con 0x7fa718139280 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa716d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718139280 0x7fa71813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa715d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa718136960 0x7fa718138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa715d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa718136960 0x7fa718138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45294/0 (socket says 172.21.15.154:45294) 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa716d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718139280 0x7fa71813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45658/0 (socket says 172.21.15.154:45658) 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa715d9b700 1 -- 172.21.15.154:0/1754760694 learned_addr learned my addr 172.21.15.154:0/1754760694 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa716d9d700 1 -- 172.21.15.154:0/1754760694 >> v2:172.21.15.154:3300/0 conn(0x7fa718136960 msgr2=0x7fa718138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa716d9d700 1 --2- 172.21.15.154:0/1754760694 >> v2:172.21.15.154:3300/0 conn(0x7fa718136960 0x7fa718138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa716d9d700 1 -- 172.21.15.154:0/1754760694 >> v1:172.21.15.154:6789/0 conn(0x7fa718133ad0 legacy=0x7fa718133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa716d9d700 1 -- 172.21.15.154:0/1754760694 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71809a500 con 0x7fa718139280 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa716d9d700 1 --2- 172.21.15.154:0/1754760694 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718139280 0x7fa71813b660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa710009d90 tx=0x7fa71000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3bf5771df116285 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa71559a700 1 -- 172.21.15.154:0/1754760694 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71000e070 con 0x7fa718139280 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.756+0000 7fa71559a700 1 -- 172.21.15.154:0/1754760694 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71000bb20 con 0x7fa718139280 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.757+0000 7fa71559a700 1 -- 172.21.15.154:0/1754760694 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa710012430 con 0x7fa718139280 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.757+0000 7fa71cb2c700 1 -- 172.21.15.154:0/1754760694 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718139280 msgr2=0x7fa71813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.757+0000 7fa71cb2c700 1 --2- 172.21.15.154:0/1754760694 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718139280 0x7fa71813b660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa710009d90 tx=0x7fa71000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.757+0000 7fa71cb2c700 1 -- 172.21.15.154:0/1754760694 shutdown_connections 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.757+0000 7fa71cb2c700 1 --2- 172.21.15.154:0/1754760694 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718139280 0x7fa71813b660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.757+0000 7fa71cb2c700 1 --2- 172.21.15.154:0/1754760694 >> v2:172.21.15.154:3300/0 conn(0x7fa718136960 0x7fa718138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.757+0000 7fa71cb2c700 1 -- 172.21.15.154:0/1754760694 >> 172.21.15.154:0/1754760694 conn(0x7fa718099c40 msgr2=0x7fa7180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.757+0000 7fa71cb2c700 1 -- 172.21.15.154:0/1754760694 shutdown_connections 2023-09-30T22:24:35.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.757+0000 7fa71cb2c700 1 -- 172.21.15.154:0/1754760694 wait complete. 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.758+0000 7fa71cb2c700 1 Processor -- start 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.758+0000 7fa71cb2c700 1 -- start start 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa71cb2c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718133ad0 0x7fa71812fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa71cb2c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa718136960 0x7fa71812ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa71cb2c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa718139280 0x7fa7181c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa71cb2c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa718070370 con 0x7fa718139280 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa71cb2c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7181316a0 con 0x7fa718136960 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa71cb2c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa71806fe40 con 0x7fa718133ad0 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa716d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa718139280 0x7fa7181c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa715d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa718136960 0x7fa71812ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa71659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718133ad0 0x7fa71812fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa716d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa718139280 0x7fa7181c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45310/0 (socket says 172.21.15.154:45310) 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa716d9d700 1 -- 172.21.15.154:0/3837603746 learned_addr learned my addr 172.21.15.154:0/3837603746 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa715d9b700 1 -- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718133ad0 msgr2=0x7fa71812fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa715d9b700 1 --2- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718133ad0 0x7fa71812fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa715d9b700 1 -- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa718139280 msgr2=0x7fa7181c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa715d9b700 1 --2- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa718139280 0x7fa7181c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa715d9b700 1 -- 172.21.15.154:0/3837603746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710009a70 con 0x7fa718136960 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa716d9d700 1 --2- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa718139280 0x7fa7181c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa71659c700 1 --2- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718133ad0 0x7fa71812fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa715d9b700 1 --2- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa718136960 0x7fa71812ff70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa70800e910 tx=0x7fa70800ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:35.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa706ffd700 1 -- 172.21.15.154:0/3837603746 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708013680 con 0x7fa718136960 2023-09-30T22:24:35.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.759+0000 7fa706ffd700 1 -- 172.21.15.154:0/3837603746 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7080137e0 con 0x7fa718136960 2023-09-30T22:24:35.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.760+0000 7fa71cb2c700 1 -- 172.21.15.154:0/3837603746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71806ef30 con 0x7fa718136960 2023-09-30T22:24:35.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.760+0000 7fa706ffd700 1 -- 172.21.15.154:0/3837603746 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708013b70 con 0x7fa718136960 2023-09-30T22:24:35.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.760+0000 7fa71cb2c700 1 -- 172.21.15.154:0/3837603746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7181304b0 con 0x7fa718136960 2023-09-30T22:24:35.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.760+0000 7fa706ffd700 1 -- 172.21.15.154:0/3837603746 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa708013cd0 con 0x7fa718136960 2023-09-30T22:24:35.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.761+0000 7fa706ffd700 1 -- 172.21.15.154:0/3837603746 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa70803f5b0 con 0x7fa718136960 2023-09-30T22:24:35.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.761+0000 7fa71cb2c700 1 -- 172.21.15.154:0/3837603746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71804f2a0 con 0x7fa718136960 2023-09-30T22:24:35.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.765+0000 7fa706ffd700 1 -- 172.21.15.154:0/3837603746 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa70801be10 con 0x7fa718136960 2023-09-30T22:24:35.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:35.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:35.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:35.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.954+0000 7fa71cb2c700 1 -- 172.21.15.154:0/3837603746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa71809f390 con 0x7fa718136960 2023-09-30T22:24:35.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.955+0000 7fa706ffd700 1 -- 172.21.15.154:0/3837603746 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa708021030 con 0x7fa718136960 2023-09-30T22:24:35.955 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:35.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.957+0000 7fa71cb2c700 1 -- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa718136960 msgr2=0x7fa71812ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:35.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.957+0000 7fa71cb2c700 1 --2- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa718136960 0x7fa71812ff70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa70800e910 tx=0x7fa70800ec20 comp rx=0 tx=0).stop 2023-09-30T22:24:35.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.958+0000 7fa71cb2c700 1 -- 172.21.15.154:0/3837603746 shutdown_connections 2023-09-30T22:24:35.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.958+0000 7fa71cb2c700 1 --2- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa718139280 0x7fa7181c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.958+0000 7fa71cb2c700 1 --2- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa718133ad0 0x7fa71812fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.958+0000 7fa71cb2c700 1 --2- 172.21.15.154:0/3837603746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa718136960 0x7fa71812ff70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:35.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.958+0000 7fa71cb2c700 1 -- 172.21.15.154:0/3837603746 >> 172.21.15.154:0/3837603746 conn(0x7fa718099c40 msgr2=0x7fa718134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:35.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.958+0000 7fa71cb2c700 1 -- 172.21.15.154:0/3837603746 shutdown_connections 2023-09-30T22:24:35.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:35.958+0000 7fa71cb2c700 1 -- 172.21.15.154:0/3837603746 wait complete. 2023-09-30T22:24:35.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:36.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.043+0000 7f9326d9d700 1 Processor -- start 2023-09-30T22:24:36.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5ec4d700 1 Processor -- start 2023-09-30T22:24:36.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5ec4d700 1 -- start start 2023-09-30T22:24:36.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7f9326d9d700 1 -- start start 2023-09-30T22:24:36.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5ec4d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad580a0a70 0x7fad580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5ec4d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad58134120 0x7fad5813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5ec4d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5809dc00 con 0x7fad580a1380 2023-09-30T22:24:36.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5ec4d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5809ea90 con 0x7fad580a0a70 2023-09-30T22:24:36.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5ec4d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad5809dec0 con 0x7fad58134120 2023-09-30T22:24:36.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5c9e9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad580a0a70 0x7fad580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5c9e9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad580a0a70 0x7fad580a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36644/0 (socket says 172.21.15.154:36644) 2023-09-30T22:24:36.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5c9e9700 1 -- 172.21.15.154:0/1685774884 learned_addr learned my addr 172.21.15.154:0/1685774884 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:36.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.044+0000 7fad5d1ea700 1 --2- 172.21.15.154:0/1685774884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad58134120 0x7fad5813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f9326d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f932012ca60 0x7f932012ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f9326d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 0x7f9320138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f9326d9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9320099c90 con 0x7f93200700d0 2023-09-30T22:24:36.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f9326d9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932009a230 con 0x7f932012ca60 2023-09-30T22:24:36.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f9326d9d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9320066b20 con 0x7f9320135c20 2023-09-30T22:24:36.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f932559a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f932012ca60 0x7f932012ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f932559a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f932012ca60 0x7f932012ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45314/0 (socket says 172.21.15.154:45314) 2023-09-30T22:24:36.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f932559a700 1 -- 172.21.15.154:0/1346981370 learned_addr learned my addr 172.21.15.154:0/1346981370 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:36.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f9325d9b700 1 --1- 172.21.15.154:0/1346981370 >> v1:172.21.15.154:6789/0 conn(0x7f93200700d0 0x7f9320066410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41734/0 (socket says 172.21.15.154:41734) 2023-09-30T22:24:36.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad577fe700 1 -- 172.21.15.154:0/1685774884 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895934691 0 0) 0x7fad5809dc00 con 0x7fad580a1380 2023-09-30T22:24:36.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad577fe700 1 -- 172.21.15.154:0/1685774884 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad480035b0 con 0x7fad580a1380 2023-09-30T22:24:36.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad5d1ea700 1 -- 172.21.15.154:0/1685774884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad580a0a70 msgr2=0x7fad580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:36.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad5d1ea700 1 --2- 172.21.15.154:0/1685774884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad580a0a70 0x7fad580a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad5d1ea700 1 -- 172.21.15.154:0/1685774884 >> v1:172.21.15.154:6789/0 conn(0x7fad580a1380 legacy=0x7fad58133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad5d1ea700 1 -- 172.21.15.154:0/1685774884 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5809e6a0 con 0x7fad58134120 2023-09-30T22:24:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f932659c700 1 --2- 172.21.15.154:0/1346981370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 0x7f9320138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad5d1ea700 1 --2- 172.21.15.154:0/1685774884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad58134120 0x7fad5813bce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fad50009dc0 tx=0x7fad5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a20476ca9e16a96a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f9324d99700 1 -- 172.21.15.154:0/1346981370 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980227760 0 0) 0x7f9320099c90 con 0x7f93200700d0 2023-09-30T22:24:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f9324d99700 1 -- 172.21.15.154:0/1346981370 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f930c0035b0 con 0x7f93200700d0 2023-09-30T22:24:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f932559a700 1 -- 172.21.15.154:0/1346981370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 msgr2=0x7f9320138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f932559a700 1 --2- 172.21.15.154:0/1346981370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 0x7f9320138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f932559a700 1 -- 172.21.15.154:0/1346981370 >> v1:172.21.15.154:6789/0 conn(0x7f93200700d0 legacy=0x7f9320066410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7f932559a700 1 -- 172.21.15.154:0/1346981370 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93200704a0 con 0x7f932012ca60 2023-09-30T22:24:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad577fe700 1 -- 172.21.15.154:0/1685774884 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000e070 con 0x7fad58134120 2023-09-30T22:24:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad577fe700 1 -- 172.21.15.154:0/1685774884 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5000bb20 con 0x7fad58134120 2023-09-30T22:24:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.045+0000 7fad577fe700 1 -- 172.21.15.154:0/1685774884 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50012430 con 0x7fad58134120 2023-09-30T22:24:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7f932559a700 1 --2- 172.21.15.154:0/1346981370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932012ca60 0x7f932012ce70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f931000bbc0 tx=0x7f931000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b148d6c5851d17b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7f9324d99700 1 -- 172.21.15.154:0/1346981370 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931000dcf0 con 0x7f932012ca60 2023-09-30T22:24:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7f9324d99700 1 -- 172.21.15.154:0/1346981370 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931000de50 con 0x7f932012ca60 2023-09-30T22:24:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7f9324d99700 1 -- 172.21.15.154:0/1346981370 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310010690 con 0x7f932012ca60 2023-09-30T22:24:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1685774884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad58134120 msgr2=0x7fad5813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7fad5ec4d700 1 --2- 172.21.15.154:0/1685774884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad58134120 0x7fad5813bce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fad50009dc0 tx=0x7fad5000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1685774884 shutdown_connections 2023-09-30T22:24:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7fad5ec4d700 1 --2- 172.21.15.154:0/1685774884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad58134120 0x7fad5813bce0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7fad5ec4d700 1 --2- 172.21.15.154:0/1685774884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad580a0a70 0x7fad580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1685774884 >> 172.21.15.154:0/1685774884 conn(0x7fad580a6610 msgr2=0x7fad580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1685774884 shutdown_connections 2023-09-30T22:24:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1685774884 wait complete. 2023-09-30T22:24:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7f9326d9d700 1 -- 172.21.15.154:0/1346981370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932012ca60 msgr2=0x7f932012ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.046+0000 7f9326d9d700 1 --2- 172.21.15.154:0/1346981370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932012ca60 0x7f932012ce70 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f931000bbc0 tx=0x7f931000bed0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.047+0000 7f9326d9d700 1 -- 172.21.15.154:0/1346981370 shutdown_connections 2023-09-30T22:24:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.047+0000 7f9326d9d700 1 --2- 172.21.15.154:0/1346981370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 0x7f9320138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.047+0000 7f9326d9d700 1 --2- 172.21.15.154:0/1346981370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f932012ca60 0x7f932012ce70 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.047+0000 7f9326d9d700 1 -- 172.21.15.154:0/1346981370 >> 172.21.15.154:0/1346981370 conn(0x7f93200a27a0 msgr2=0x7f93200a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.047+0000 7fad5ec4d700 1 Processor -- start 2023-09-30T22:24:36.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.047+0000 7fad5ec4d700 1 -- start start 2023-09-30T22:24:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.047+0000 7f9326d9d700 1 -- 172.21.15.154:0/1346981370 shutdown_connections 2023-09-30T22:24:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.047+0000 7f9326d9d700 1 -- 172.21.15.154:0/1346981370 wait complete. 2023-09-30T22:24:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad5ec4d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad580a0a70 0x7fad581228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad5ec4d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad580a1380 0x7fad58122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad5ec4d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58134120 0x7fad58123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad5ec4d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58125ee0 con 0x7fad580a0a70 2023-09-30T22:24:36.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad5ec4d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad58126fd0 con 0x7fad58134120 2023-09-30T22:24:36.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad5ec4d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad58124ac0 con 0x7fad580a1380 2023-09-30T22:24:36.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7f9326d9d700 1 Processor -- start 2023-09-30T22:24:36.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad57fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad580a1380 0x7fad58122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad57fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad580a1380 0x7fad58122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45690/0 (socket says 172.21.15.154:45690) 2023-09-30T22:24:36.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad5d1ea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58134120 0x7fad58123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7fad57fff700 1 -- 172.21.15.154:0/1754626315 learned_addr learned my addr 172.21.15.154:0/1754626315 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:36.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.048+0000 7f9326d9d700 1 -- start start 2023-09-30T22:24:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7fad57fff700 1 -- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58134120 msgr2=0x7fad58123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7fad57fff700 1 --2- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58134120 0x7fad58123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7fad57fff700 1 -- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad580a0a70 msgr2=0x7fad581228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7fad57fff700 1 --2- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad580a0a70 0x7fad581228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7fad57fff700 1 -- 172.21.15.154:0/1754626315 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009a70 con 0x7fad580a1380 2023-09-30T22:24:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7fad57fff700 1 --2- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad580a1380 0x7fad58122e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c4f0 tx=0x7fad4400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f9326d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93200700d0 0x7f932009d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f9326d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f932012ca60 0x7f932009ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f9326d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 0x7f932009e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f9326d9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932009c430 con 0x7f93200700d0 2023-09-30T22:24:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f9326d9d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932006e9d0 con 0x7f9320135c20 2023-09-30T22:24:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f9326d9d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9320129ee0 con 0x7f932012ca60 2023-09-30T22:24:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7fad557fa700 1 -- 172.21.15.154:0/1754626315 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad440052d0 con 0x7fad580a1380 2023-09-30T22:24:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f932559a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f932012ca60 0x7f932009ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7fad557fa700 1 -- 172.21.15.154:0/1754626315 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad44005430 con 0x7fad580a1380 2023-09-30T22:24:36.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7fad557fa700 1 -- 172.21.15.154:0/1754626315 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44003880 con 0x7fad580a1380 2023-09-30T22:24:36.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f932559a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f932012ca60 0x7f932009ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45702/0 (socket says 172.21.15.154:45702) 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f932559a700 1 -- 172.21.15.154:0/1199040240 learned_addr learned my addr 172.21.15.154:0/1199040240 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f932659c700 1 --2- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 0x7f932009e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f9325d9b700 1 --2- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93200700d0 0x7f932009d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f932559a700 1 -- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 msgr2=0x7f932009e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f932559a700 1 --2- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 0x7f932009e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f932559a700 1 -- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93200700d0 msgr2=0x7f932009d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f932559a700 1 --2- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93200700d0 0x7f932009d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.049+0000 7f932559a700 1 -- 172.21.15.154:0/1199040240 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931000b7f0 con 0x7f932012ca60 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.050+0000 7f932559a700 1 --2- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f932012ca60 0x7f932009ddd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9310015000 tx=0x7f9310004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.050+0000 7f93167fc700 1 -- 172.21.15.154:0/1199040240 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310003b70 con 0x7f932012ca60 2023-09-30T22:24:36.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.050+0000 7f93167fc700 1 -- 172.21.15.154:0/1199040240 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310003cd0 con 0x7f932012ca60 2023-09-30T22:24:36.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.050+0000 7f93167fc700 1 -- 172.21.15.154:0/1199040240 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93100106b0 con 0x7f932012ca60 2023-09-30T22:24:36.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.050+0000 7f9326d9d700 1 -- 172.21.15.154:0/1199040240 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932009ae10 con 0x7f932012ca60 2023-09-30T22:24:36.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.050+0000 7f9326d9d700 1 -- 172.21.15.154:0/1199040240 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932009b590 con 0x7f932012ca60 2023-09-30T22:24:36.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.050+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1754626315 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad58126110 con 0x7fad580a1380 2023-09-30T22:24:36.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.050+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1754626315 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad581333f0 con 0x7fad580a1380 2023-09-30T22:24:36.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.051+0000 7f93167fc700 1 -- 172.21.15.154:0/1199040240 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9310019400 con 0x7f932012ca60 2023-09-30T22:24:36.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.051+0000 7f93167fc700 1 -- 172.21.15.154:0/1199040240 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93100196b0 con 0x7f932012ca60 2023-09-30T22:24:36.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.051+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1754626315 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5804f2a0 con 0x7fad580a1380 2023-09-30T22:24:36.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.051+0000 7f9326d9d700 1 -- 172.21.15.154:0/1199040240 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932009c670 con 0x7f932012ca60 2023-09-30T22:24:36.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.051+0000 7fad557fa700 1 -- 172.21.15.154:0/1754626315 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad440039e0 con 0x7fad580a1380 2023-09-30T22:24:36.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.052+0000 7fad557fa700 1 -- 172.21.15.154:0/1754626315 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad4401ac80 con 0x7fad580a1380 2023-09-30T22:24:36.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.055+0000 7f93167fc700 1 -- 172.21.15.154:0/1199040240 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f932009c670 con 0x7f932012ca60 2023-09-30T22:24:36.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.060+0000 7fad557fa700 1 -- 172.21.15.154:0/1754626315 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad440198b0 con 0x7fad580a1380 2023-09-30T22:24:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.089+0000 7fa9dc018700 1 Processor -- start 2023-09-30T22:24:36.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.089+0000 7fa9dc018700 1 -- start start 2023-09-30T22:24:36.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9dc018700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9d4136960 0x7fa9d4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9dc018700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4139280 0x7fa9d413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9dc018700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d406b2d0 con 0x7fa9d4133ad0 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9dc018700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d41345b0 con 0x7fa9d4136960 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9dc018700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4133610 con 0x7fa9d4139280 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9da5b5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4139280 0x7fa9d413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9da5b5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4139280 0x7fa9d413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36670/0 (socket says 172.21.15.154:36670) 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9d95b3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9d4136960 0x7fa9d4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9da5b5700 1 -- 172.21.15.154:0/1505524710 learned_addr learned my addr 172.21.15.154:0/1505524710 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9d95b3700 1 -- 172.21.15.154:0/1505524710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4139280 msgr2=0x7fa9d413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9d95b3700 1 --2- 172.21.15.154:0/1505524710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4139280 0x7fa9d413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9d95b3700 1 -- 172.21.15.154:0/1505524710 >> v1:172.21.15.154:6789/0 conn(0x7fa9d4133ad0 legacy=0x7fa9d4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9d95b3700 1 -- 172.21.15.154:0/1505524710 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d409a500 con 0x7fa9d4136960 2023-09-30T22:24:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9da5b5700 1 --2- 172.21.15.154:0/1505524710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4139280 0x7fa9d413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.090+0000 7fa9d95b3700 1 --2- 172.21.15.154:0/1505524710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4136960 0x7fa9d4138d40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009840 tx=0x7fa9c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c201fff11a8fa628 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9d8db2700 1 -- 172.21.15.154:0/1505524710 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011830 con 0x7fa9d4136960 2023-09-30T22:24:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9d8db2700 1 -- 172.21.15.154:0/1505524710 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c4011990 con 0x7fa9d4136960 2023-09-30T22:24:36.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9d8db2700 1 -- 172.21.15.154:0/1505524710 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011d20 con 0x7fa9d4136960 2023-09-30T22:24:36.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9dc018700 1 -- 172.21.15.154:0/1505524710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4136960 msgr2=0x7fa9d4138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9dc018700 1 --2- 172.21.15.154:0/1505524710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4136960 0x7fa9d4138d40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009840 tx=0x7fa9c4009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9dc018700 1 -- 172.21.15.154:0/1505524710 shutdown_connections 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9dc018700 1 --2- 172.21.15.154:0/1505524710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4139280 0x7fa9d413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9dc018700 1 --2- 172.21.15.154:0/1505524710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4136960 0x7fa9d4138d40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9dc018700 1 -- 172.21.15.154:0/1505524710 >> 172.21.15.154:0/1505524710 conn(0x7fa9d4099c40 msgr2=0x7fa9d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9dc018700 1 -- 172.21.15.154:0/1505524710 shutdown_connections 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.091+0000 7fa9dc018700 1 -- 172.21.15.154:0/1505524710 wait complete. 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.092+0000 7fa9dc018700 1 Processor -- start 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.092+0000 7fa9dc018700 1 -- start start 2023-09-30T22:24:36.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9dc018700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4133ad0 0x7fa9d4071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9dc018700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4136960 0x7fa9d4071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9dc018700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9d4139280 0x7fa9d41c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9dc018700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4070350 con 0x7fa9d4133ad0 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9dc018700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d406ecd0 con 0x7fa9d4136960 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9dc018700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d41315e0 con 0x7fa9d4139280 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d95b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4136960 0x7fa9d4071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d9db4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4133ad0 0x7fa9d4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d95b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4136960 0x7fa9d4071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36686/0 (socket says 172.21.15.154:36686) 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d95b3700 1 -- 172.21.15.154:0/130831836 learned_addr learned my addr 172.21.15.154:0/130831836 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9da5b5700 1 --2- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9d4139280 0x7fa9d41c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d9db4700 1 -- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9d4139280 msgr2=0x7fa9d41c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d9db4700 1 --2- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9d4139280 0x7fa9d41c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d9db4700 1 -- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4136960 msgr2=0x7fa9d4071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d9db4700 1 --2- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4136960 0x7fa9d4071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d9db4700 1 -- 172.21.15.154:0/130831836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc009b30 con 0x7fa9d4133ad0 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d95b3700 1 --2- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4136960 0x7fa9d4071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9d9db4700 1 --2- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4133ad0 0x7fa9d4071830 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0000f60 tx=0x7fa9d000c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9ca7fc700 1 -- 172.21.15.154:0/130831836 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d00052d0 con 0x7fa9d4133ad0 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9ca7fc700 1 -- 172.21.15.154:0/130831836 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d0005430 con 0x7fa9d4133ad0 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.093+0000 7fa9ca7fc700 1 -- 172.21.15.154:0/130831836 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d00038c0 con 0x7fa9d4133ad0 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.094+0000 7fa9dc018700 1 -- 172.21.15.154:0/130831836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c40094a0 con 0x7fa9d4133ad0 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.094+0000 7fa9dc018700 1 -- 172.21.15.154:0/130831836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d4070dc0 con 0x7fa9d4133ad0 2023-09-30T22:24:36.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.094+0000 7fa9ca7fc700 1 -- 172.21.15.154:0/130831836 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9d0003c30 con 0x7fa9d4133ad0 2023-09-30T22:24:36.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.095+0000 7fa9ca7fc700 1 -- 172.21.15.154:0/130831836 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9d003ebd0 con 0x7fa9d4133ad0 2023-09-30T22:24:36.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.095+0000 7fa9dc018700 1 -- 172.21.15.154:0/130831836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d404f2a0 con 0x7fa9d4133ad0 2023-09-30T22:24:36.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.100+0000 7fa9ca7fc700 1 -- 172.21.15.154:0/130831836 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9d001bb10 con 0x7fa9d4133ad0 2023-09-30T22:24:36.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.255+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1754626315 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fad580a5660 con 0x7fad580a1380 2023-09-30T22:24:36.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.255+0000 7fad557fa700 1 -- 172.21.15.154:0/1754626315 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad44017030 con 0x7fad580a1380 2023-09-30T22:24:36.256 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.257+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad580a1380 msgr2=0x7fad58122e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.257+0000 7fad5ec4d700 1 --2- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad580a1380 0x7fad58122e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fad4400c4f0 tx=0x7fad4400c800 comp rx=0 tx=0).stop 2023-09-30T22:24:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.257+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1754626315 shutdown_connections 2023-09-30T22:24:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.257+0000 7fad5ec4d700 1 --2- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58134120 0x7fad58123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.258+0000 7fad5ec4d700 1 --2- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad580a0a70 0x7fad581228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.258+0000 7fad5ec4d700 1 --2- 172.21.15.154:0/1754626315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad580a1380 0x7fad58122e10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.258+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1754626315 >> 172.21.15.154:0/1754626315 conn(0x7fad580a6610 msgr2=0x7fad580a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.258+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1754626315 shutdown_connections 2023-09-30T22:24:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.258+0000 7fad5ec4d700 1 -- 172.21.15.154:0/1754626315 wait complete. 2023-09-30T22:24:36.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:36.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.307+0000 7f9326d9d700 1 -- 172.21.15.154:0/1199040240 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f932009c830 con 0x7f932012ca60 2023-09-30T22:24:36.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.307+0000 7f93167fc700 1 -- 172.21.15.154:0/1199040240 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f932009c830 con 0x7f932012ca60 2023-09-30T22:24:36.308 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:36.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.309+0000 7f9326d9d700 1 -- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f932012ca60 msgr2=0x7f932009ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.309+0000 7f9326d9d700 1 --2- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f932012ca60 0x7f932009ddd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9310015000 tx=0x7f9310004750 comp rx=0 tx=0).stop 2023-09-30T22:24:36.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.309+0000 7f9326d9d700 1 -- 172.21.15.154:0/1199040240 shutdown_connections 2023-09-30T22:24:36.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.309+0000 7f9326d9d700 1 --2- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9320135c20 0x7f932009e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.309+0000 7f9326d9d700 1 --2- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93200700d0 0x7f932009d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.309+0000 7f9326d9d700 1 --2- 172.21.15.154:0/1199040240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f932012ca60 0x7f932009ddd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.309+0000 7f9326d9d700 1 -- 172.21.15.154:0/1199040240 >> 172.21.15.154:0/1199040240 conn(0x7f93200a27a0 msgr2=0x7f932012a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.309+0000 7f9326d9d700 1 -- 172.21.15.154:0/1199040240 shutdown_connections 2023-09-30T22:24:36.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.309+0000 7f9326d9d700 1 -- 172.21.15.154:0/1199040240 wait complete. 2023-09-30T22:24:36.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:36.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.337+0000 7fa9dc018700 1 -- 172.21.15.154:0/130831836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa9d409f0f0 con 0x7fa9d4133ad0 2023-09-30T22:24:36.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.338+0000 7fa9ca7fc700 1 -- 172.21.15.154:0/130831836 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9d0017020 con 0x7fa9d4133ad0 2023-09-30T22:24:36.339 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.340+0000 7fa9dc018700 1 -- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4133ad0 msgr2=0x7fa9d4071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.340+0000 7fa9dc018700 1 --2- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4133ad0 0x7fa9d4071830 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0000f60 tx=0x7fa9d000c6e0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.340+0000 7fa9dc018700 1 -- 172.21.15.154:0/130831836 shutdown_connections 2023-09-30T22:24:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.340+0000 7fa9dc018700 1 --2- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9d4139280 0x7fa9d41c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.340+0000 7fa9dc018700 1 --2- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d4133ad0 0x7fa9d4071830 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.340+0000 7fa9dc018700 1 --2- 172.21.15.154:0/130831836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9d4136960 0x7fa9d4071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:36.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.340+0000 7fa9dc018700 1 -- 172.21.15.154:0/130831836 >> 172.21.15.154:0/130831836 conn(0x7fa9d4099c40 msgr2=0x7fa9d4138700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:36.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.340+0000 7fa9dc018700 1 -- 172.21.15.154:0/130831836 shutdown_connections 2023-09-30T22:24:36.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:36.340+0000 7fa9dc018700 1 -- 172.21.15.154:0/130831836 wait complete. 2023-09-30T22:24:36.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:36.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:37.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.099+0000 7fecbc2e6700 1 Processor -- start 2023-09-30T22:24:37.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.099+0000 7fecbc2e6700 1 -- start start 2023-09-30T22:24:37.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecbc2e6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecb409dec0 0x7fecb406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecbc2e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb4136cb0 0x7fecb4139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecbc2e6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb406e900 con 0x7fecb406a770 2023-09-30T22:24:37.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecbc2e6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb409d180 con 0x7fecb409dec0 2023-09-30T22:24:37.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecbc2e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb409e780 con 0x7fecb4136cb0 2023-09-30T22:24:37.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecb9881700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecb409dec0 0x7fecb406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecba883700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb4136cb0 0x7fecb4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecba883700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb4136cb0 0x7fecb4139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36690/0 (socket says 172.21.15.154:36690) 2023-09-30T22:24:37.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecb9881700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecb409dec0 0x7fecb406b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45364/0 (socket says 172.21.15.154:45364) 2023-09-30T22:24:37.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecba883700 1 -- 172.21.15.154:0/706064527 learned_addr learned my addr 172.21.15.154:0/706064527 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:37.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecba883700 1 -- 172.21.15.154:0/706064527 >> v2:172.21.15.154:3300/0 conn(0x7fecb409dec0 msgr2=0x7fecb406b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecba883700 1 --2- 172.21.15.154:0/706064527 >> v2:172.21.15.154:3300/0 conn(0x7fecb409dec0 0x7fecb406b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecba883700 1 -- 172.21.15.154:0/706064527 >> v1:172.21.15.154:6789/0 conn(0x7fecb406a770 legacy=0x7fecb406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.100+0000 7fecba883700 1 -- 172.21.15.154:0/706064527 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb409d3c0 con 0x7fecb4136cb0 2023-09-30T22:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecba883700 1 --2- 172.21.15.154:0/706064527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb4136cb0 0x7fecb4139090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fecac009e50 tx=0x7fecac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce7ed6b5188c139f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecb9080700 1 -- 172.21.15.154:0/706064527 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00e070 con 0x7fecb4136cb0 2023-09-30T22:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecb9080700 1 -- 172.21.15.154:0/706064527 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac00b910 con 0x7fecb4136cb0 2023-09-30T22:24:37.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecb9080700 1 -- 172.21.15.154:0/706064527 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00bcc0 con 0x7fecb4136cb0 2023-09-30T22:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecbc2e6700 1 -- 172.21.15.154:0/706064527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb4136cb0 msgr2=0x7fecb4139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecbc2e6700 1 --2- 172.21.15.154:0/706064527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb4136cb0 0x7fecb4139090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fecac009e50 tx=0x7fecac00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecbc2e6700 1 -- 172.21.15.154:0/706064527 shutdown_connections 2023-09-30T22:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecbc2e6700 1 --2- 172.21.15.154:0/706064527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb4136cb0 0x7fecb4139090 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecbc2e6700 1 --2- 172.21.15.154:0/706064527 >> v2:172.21.15.154:3300/0 conn(0x7fecb409dec0 0x7fecb406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecbc2e6700 1 -- 172.21.15.154:0/706064527 >> 172.21.15.154:0/706064527 conn(0x7fecb4099c40 msgr2=0x7fecb40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecbc2e6700 1 -- 172.21.15.154:0/706064527 shutdown_connections 2023-09-30T22:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.101+0000 7fecbc2e6700 1 -- 172.21.15.154:0/706064527 wait complete. 2023-09-30T22:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.102+0000 7fecbc2e6700 1 Processor -- start 2023-09-30T22:24:37.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.102+0000 7fecbc2e6700 1 -- start start 2023-09-30T22:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecbc2e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb406a770 0x7fecb4119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecbc2e6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecb409dec0 0x7fecb4119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecbc2e6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecb4136cb0 0x7fecb411a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecbc2e6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb4071ce0 con 0x7fecb409dec0 2023-09-30T22:24:37.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecbc2e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb411b8b0 con 0x7fecb406a770 2023-09-30T22:24:37.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecbc2e6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecb411b110 con 0x7fecb4136cb0 2023-09-30T22:24:37.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecba082700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb406a770 0x7fecb4119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecb9881700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecb409dec0 0x7fecb4119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecba082700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb406a770 0x7fecb4119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36694/0 (socket says 172.21.15.154:36694) 2023-09-30T22:24:37.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecba883700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecb4136cb0 0x7fecb411a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecba082700 1 -- 172.21.15.154:0/3942445458 learned_addr learned my addr 172.21.15.154:0/3942445458 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecb9881700 1 -- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecb4136cb0 msgr2=0x7fecb411a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecb9881700 1 --2- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecb4136cb0 0x7fecb411a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecb9881700 1 -- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb406a770 msgr2=0x7fecb4119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecb9881700 1 --2- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb406a770 0x7fecb4119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecb9881700 1 -- 172.21.15.154:0/3942445458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac009b30 con 0x7fecb409dec0 2023-09-30T22:24:37.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecba082700 1 --2- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb406a770 0x7fecb4119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7fecb9881700 1 --2- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecb409dec0 0x7fecb4119b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fecb000e900 tx=0x7fecb000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.103+0000 7feca6ffd700 1 -- 172.21.15.154:0/3942445458 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0013680 con 0x7fecb409dec0 2023-09-30T22:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.104+0000 7feca6ffd700 1 -- 172.21.15.154:0/3942445458 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb00137e0 con 0x7fecb409dec0 2023-09-30T22:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.104+0000 7fecbc2e6700 1 -- 172.21.15.154:0/3942445458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb412f330 con 0x7fecb409dec0 2023-09-30T22:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.104+0000 7feca6ffd700 1 -- 172.21.15.154:0/3942445458 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0013b50 con 0x7fecb409dec0 2023-09-30T22:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.104+0000 7fecbc2e6700 1 -- 172.21.15.154:0/3942445458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb411cf60 con 0x7fecb409dec0 2023-09-30T22:24:37.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.104+0000 7feca6ffd700 1 -- 172.21.15.154:0/3942445458 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecb0013cb0 con 0x7fecb409dec0 2023-09-30T22:24:37.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.104+0000 7feca6ffd700 1 -- 172.21.15.154:0/3942445458 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fecb003f9e0 con 0x7fecb409dec0 2023-09-30T22:24:37.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.104+0000 7fecbc2e6700 1 -- 172.21.15.154:0/3942445458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb411c830 con 0x7fecb409dec0 2023-09-30T22:24:37.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.109+0000 7feca6ffd700 1 -- 172.21.15.154:0/3942445458 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecb001b7c0 con 0x7fecb409dec0 2023-09-30T22:24:37.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:37.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.296+0000 7fecbc2e6700 1 -- 172.21.15.154:0/3942445458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fecb411cb30 con 0x7fecb409dec0 2023-09-30T22:24:37.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.297+0000 7feca6ffd700 1 -- 172.21.15.154:0/3942445458 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecb001b3b0 con 0x7fecb409dec0 2023-09-30T22:24:37.298 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.299+0000 7fecbc2e6700 1 -- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecb409dec0 msgr2=0x7fecb4119b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.299+0000 7fecbc2e6700 1 --2- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecb409dec0 0x7fecb4119b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fecb000e900 tx=0x7fecb000ec10 comp rx=0 tx=0).stop 2023-09-30T22:24:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.299+0000 7fecbc2e6700 1 -- 172.21.15.154:0/3942445458 shutdown_connections 2023-09-30T22:24:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.299+0000 7fecbc2e6700 1 --2- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fecb4136cb0 0x7fecb411a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.299+0000 7fecbc2e6700 1 --2- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecb406a770 0x7fecb4119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.299+0000 7fecbc2e6700 1 --2- 172.21.15.154:0/3942445458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecb409dec0 0x7fecb4119b70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.299+0000 7fecbc2e6700 1 -- 172.21.15.154:0/3942445458 >> 172.21.15.154:0/3942445458 conn(0x7fecb4099c40 msgr2=0x7fecb412f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.299+0000 7fecbc2e6700 1 -- 172.21.15.154:0/3942445458 shutdown_connections 2023-09-30T22:24:37.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.299+0000 7fecbc2e6700 1 -- 172.21.15.154:0/3942445458 wait complete. 2023-09-30T22:24:37.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:37.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:37.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:37.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44bd362700 1 Processor -- start 2023-09-30T22:24:37.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44bd362700 1 -- start start 2023-09-30T22:24:37.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44bd362700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44b809d860 0x7f44b809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44bd362700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b8130eb0 0x7f44b8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44bd362700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b809aaa0 con 0x7f44b809e170 2023-09-30T22:24:37.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44bd362700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b809f870 con 0x7f44b809d860 2023-09-30T22:24:37.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44bd362700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44b809b360 con 0x7f44b8130eb0 2023-09-30T22:24:37.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44b6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44b809d860 0x7f44b809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44b6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44b809d860 0x7f44b809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45384/0 (socket says 172.21.15.154:45384) 2023-09-30T22:24:37.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44b6ffd700 1 -- 172.21.15.154:0/1908868808 learned_addr learned my addr 172.21.15.154:0/1908868808 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:37.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.400+0000 7f44b77fe700 1 --2- 172.21.15.154:0/1908868808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b8130eb0 0x7f44b8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.401+0000 7f44b77fe700 1 -- 172.21.15.154:0/1908868808 >> v2:172.21.15.154:3300/0 conn(0x7f44b809d860 msgr2=0x7f44b809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.401+0000 7f44b77fe700 1 --2- 172.21.15.154:0/1908868808 >> v2:172.21.15.154:3300/0 conn(0x7f44b809d860 0x7f44b809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.401+0000 7f44b77fe700 1 -- 172.21.15.154:0/1908868808 >> v1:172.21.15.154:6789/0 conn(0x7f44b809e170 legacy=0x7f44b81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.401+0000 7f44b77fe700 1 -- 172.21.15.154:0/1908868808 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b809b620 con 0x7f44b8130eb0 2023-09-30T22:24:37.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.401+0000 7f44b6ffd700 1 --2- 172.21.15.154:0/1908868808 >> v2:172.21.15.154:3300/0 conn(0x7f44b809d860 0x7f44b809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.401+0000 7f44b77fe700 1 --2- 172.21.15.154:0/1908868808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b8130eb0 0x7f44b8138a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009d90 tx=0x7f44b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953c18c9e410ed03 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.401+0000 7f44b5ffb700 1 -- 172.21.15.154:0/1908868808 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000e070 con 0x7f44b8130eb0 2023-09-30T22:24:37.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.401+0000 7f44b5ffb700 1 -- 172.21.15.154:0/1908868808 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000bb20 con 0x7f44b8130eb0 2023-09-30T22:24:37.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.401+0000 7f44b5ffb700 1 -- 172.21.15.154:0/1908868808 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0012430 con 0x7f44b8130eb0 2023-09-30T22:24:37.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.402+0000 7f44bd362700 1 -- 172.21.15.154:0/1908868808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b8130eb0 msgr2=0x7f44b8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.402+0000 7f44bd362700 1 --2- 172.21.15.154:0/1908868808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b8130eb0 0x7f44b8138a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009d90 tx=0x7f44b000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:37.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.402+0000 7f44bd362700 1 -- 172.21.15.154:0/1908868808 shutdown_connections 2023-09-30T22:24:37.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.402+0000 7f44bd362700 1 --2- 172.21.15.154:0/1908868808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b8130eb0 0x7f44b8138a00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.402+0000 7f44bd362700 1 --2- 172.21.15.154:0/1908868808 >> v2:172.21.15.154:3300/0 conn(0x7f44b809d860 0x7f44b809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.402+0000 7f44bd362700 1 -- 172.21.15.154:0/1908868808 >> 172.21.15.154:0/1908868808 conn(0x7f44b8099c40 msgr2=0x7f44b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.402+0000 7f44bd362700 1 -- 172.21.15.154:0/1908868808 shutdown_connections 2023-09-30T22:24:37.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.402+0000 7f44bd362700 1 -- 172.21.15.154:0/1908868808 wait complete. 2023-09-30T22:24:37.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.403+0000 7f44bd362700 1 Processor -- start 2023-09-30T22:24:37.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.403+0000 7f44bd362700 1 -- start start 2023-09-30T22:24:37.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.403+0000 7f44bd362700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b809d860 0x7f44b811e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.403+0000 7f44bd362700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b809e170 0x7f44b811ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.403+0000 7f44bd362700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b8130eb0 0x7f44b811ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.403+0000 7f44bd362700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b81201e0 con 0x7f44b8130eb0 2023-09-30T22:24:37.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.403+0000 7f44bd362700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b811fff0 con 0x7f44b809d860 2023-09-30T22:24:37.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.403+0000 7f44bd362700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80a21b0 con 0x7f44b809e170 2023-09-30T22:24:37.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.403+0000 7f44b6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b809d860 0x7f44b811e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b809d860 0x7f44b811e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36704/0 (socket says 172.21.15.154:36704) 2023-09-30T22:24:37.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b6ffd700 1 -- 172.21.15.154:0/2974759805 learned_addr learned my addr 172.21.15.154:0/2974759805 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:37.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b67fc700 1 --2- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b809e170 0x7f44b811ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b77fe700 1 --2- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b8130eb0 0x7f44b811ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b6ffd700 1 -- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b809e170 msgr2=0x7f44b811ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b6ffd700 1 --2- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b809e170 0x7f44b811ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b6ffd700 1 -- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b8130eb0 msgr2=0x7f44b811ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b6ffd700 1 --2- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b8130eb0 0x7f44b811ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b6ffd700 1 -- 172.21.15.154:0/2974759805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a800b7f0 con 0x7f44b809d860 2023-09-30T22:24:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44b6ffd700 1 --2- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b809d860 0x7f44b811e4d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f44a8010fa0 tx=0x7f44a800e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f449f7fe700 1 -- 172.21.15.154:0/2974759805 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8011450 con 0x7f44b809d860 2023-09-30T22:24:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f449f7fe700 1 -- 172.21.15.154:0/2974759805 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a80115b0 con 0x7f44b809d860 2023-09-30T22:24:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f449f7fe700 1 -- 172.21.15.154:0/2974759805 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8011920 con 0x7f44b809d860 2023-09-30T22:24:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44bd362700 1 -- 172.21.15.154:0/2974759805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b0009a70 con 0x7f44b809d860 2023-09-30T22:24:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.404+0000 7f44bd362700 1 -- 172.21.15.154:0/2974759805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b8121c90 con 0x7f44b809d860 2023-09-30T22:24:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.405+0000 7f449f7fe700 1 -- 172.21.15.154:0/2974759805 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44a8011a80 con 0x7f44b809d860 2023-09-30T22:24:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.405+0000 7f44bd362700 1 -- 172.21.15.154:0/2974759805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b804f2a0 con 0x7f44b809d860 2023-09-30T22:24:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.405+0000 7f449f7fe700 1 -- 172.21.15.154:0/2974759805 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f44a8040050 con 0x7f44b809d860 2023-09-30T22:24:37.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.410+0000 7f449f7fe700 1 -- 172.21.15.154:0/2974759805 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44a8019d70 con 0x7f44b809d860 2023-09-30T22:24:37.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.482+0000 7f3580408700 1 Processor -- start 2023-09-30T22:24:37.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.482+0000 7f3ee3304700 1 Processor -- start 2023-09-30T22:24:37.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.482+0000 7f3580408700 1 -- start start 2023-09-30T22:24:37.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee3304700 1 -- start start 2023-09-30T22:24:37.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee3304700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3580408700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3580408700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f357809f260 0x7f3578131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee3304700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc0a13a0 0x7f3edc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee3304700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3edc133f70 0x7f3edc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee3304700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc0a3aa0 con 0x7f3edc133f70 2023-09-30T22:24:37.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee3304700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc09a540 con 0x7f3edc0a0a90 2023-09-30T22:24:37.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee3304700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0a1fe0 con 0x7f3edc0a13a0 2023-09-30T22:24:37.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3580408700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357809afb0 con 0x7f3578131dd0 2023-09-30T22:24:37.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3580408700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35780a0970 con 0x7f357809f260 2023-09-30T22:24:37.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3580408700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35780a0320 con 0x7f357809e950 2023-09-30T22:24:37.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f357d9a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f357809f260 0x7f3578131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f357e9a5700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3578131dd0 0x7f3578138ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41758/0 (socket says 172.21.15.154:41758) 2023-09-30T22:24:37.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f357e9a5700 1 -- 172.21.15.154:0/3950239089 learned_addr learned my addr 172.21.15.154:0/3950239089 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:37.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee18a1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3edc133f70 0x7f3edc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee10a0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee18a1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3edc133f70 0x7f3edc134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45404/0 (socket says 172.21.15.154:45404) 2023-09-30T22:24:37.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee18a1700 1 -- 172.21.15.154:0/3217278167 learned_addr learned my addr 172.21.15.154:0/3217278167 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:37.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.483+0000 7f3ee089f700 1 --2- 172.21.15.154:0/3217278167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc0a13a0 0x7f3edc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357e1a4700 1 --2- 172.21.15.154:0/3950239089 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f3ee10a0700 1 -- 172.21.15.154:0/3217278167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc0a13a0 msgr2=0x7f3edc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f3ee10a0700 1 --2- 172.21.15.154:0/3217278167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc0a13a0 0x7f3edc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f3ee10a0700 1 -- 172.21.15.154:0/3217278167 >> v2:172.21.15.154:3300/0 conn(0x7f3edc133f70 msgr2=0x7f3edc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f3ee10a0700 1 --2- 172.21.15.154:0/3217278167 >> v2:172.21.15.154:3300/0 conn(0x7f3edc133f70 0x7f3edc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f3ee10a0700 1 -- 172.21.15.154:0/3217278167 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc09a280 con 0x7f3edc0a0a90 2023-09-30T22:24:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357d9a3700 1 -- 172.21.15.154:0/3950239089 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 msgr2=0x7f357809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357d9a3700 1 --2- 172.21.15.154:0/3950239089 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f3ee10a0700 1 --2- 172.21.15.154:0/3217278167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc0a0e60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009840 tx=0x7f3ed8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de7e3d1ee9d0317 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357d9a3700 1 -- 172.21.15.154:0/3950239089 >> v1:172.21.15.154:6789/0 conn(0x7f3578131dd0 legacy=0x7f3578138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357d9a3700 1 -- 172.21.15.154:0/3950239089 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780a0750 con 0x7f357809f260 2023-09-30T22:24:37.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357e1a4700 1 --2- 172.21.15.154:0/3950239089 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:37.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f3ed3fff700 1 -- 172.21.15.154:0/3217278167 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8011830 con 0x7f3edc0a0a90 2023-09-30T22:24:37.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f3ed3fff700 1 -- 172.21.15.154:0/3217278167 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed8011990 con 0x7f3edc0a0a90 2023-09-30T22:24:37.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f3ed3fff700 1 -- 172.21.15.154:0/3217278167 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8011d20 con 0x7f3edc0a0a90 2023-09-30T22:24:37.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357d9a3700 1 --2- 172.21.15.154:0/3950239089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f357809f260 0x7f3578131890 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3568009870 tx=0x7f3568009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cfb890657d5b7d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357d1a2700 1 -- 172.21.15.154:0/3950239089 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568004230 con 0x7f357809f260 2023-09-30T22:24:37.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357d1a2700 1 -- 172.21.15.154:0/3950239089 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3568004390 con 0x7f357809f260 2023-09-30T22:24:37.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.484+0000 7f357d1a2700 1 -- 172.21.15.154:0/3950239089 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35680036a0 con 0x7f357809f260 2023-09-30T22:24:37.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3ee3304700 1 -- 172.21.15.154:0/3217278167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 msgr2=0x7f3edc0a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3ee3304700 1 --2- 172.21.15.154:0/3217278167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc0a0e60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009840 tx=0x7f3ed8009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:37.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3ee3304700 1 -- 172.21.15.154:0/3217278167 shutdown_connections 2023-09-30T22:24:37.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3ee3304700 1 --2- 172.21.15.154:0/3217278167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc0a0e60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3ee3304700 1 --2- 172.21.15.154:0/3217278167 >> v2:172.21.15.154:3300/0 conn(0x7f3edc133f70 0x7f3edc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3ee3304700 1 --2- 172.21.15.154:0/3217278167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc0a13a0 0x7f3edc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3ee3304700 1 -- 172.21.15.154:0/3217278167 >> 172.21.15.154:0/3217278167 conn(0x7f3edc099c40 msgr2=0x7f3edc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3580408700 1 -- 172.21.15.154:0/3950239089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f357809f260 msgr2=0x7f3578131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3580408700 1 --2- 172.21.15.154:0/3950239089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f357809f260 0x7f3578131890 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3568009870 tx=0x7f3568009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:37.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3ee3304700 1 -- 172.21.15.154:0/3217278167 shutdown_connections 2023-09-30T22:24:37.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3ee3304700 1 -- 172.21.15.154:0/3217278167 wait complete. 2023-09-30T22:24:37.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3580408700 1 -- 172.21.15.154:0/3950239089 shutdown_connections 2023-09-30T22:24:37.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3580408700 1 --2- 172.21.15.154:0/3950239089 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3580408700 1 --2- 172.21.15.154:0/3950239089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f357809f260 0x7f3578131890 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3580408700 1 -- 172.21.15.154:0/3950239089 >> 172.21.15.154:0/3950239089 conn(0x7f35780a0f70 msgr2=0x7f35780a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3580408700 1 -- 172.21.15.154:0/3950239089 shutdown_connections 2023-09-30T22:24:37.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.485+0000 7f3580408700 1 -- 172.21.15.154:0/3950239089 wait complete. 2023-09-30T22:24:37.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.486+0000 7f3ee3304700 1 Processor -- start 2023-09-30T22:24:37.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.486+0000 7f3ee3304700 1 -- start start 2023-09-30T22:24:37.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.486+0000 7f3580408700 1 Processor -- start 2023-09-30T22:24:37.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.486+0000 7f3580408700 1 -- start start 2023-09-30T22:24:37.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee3304700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc122280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee3304700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3edc0a13a0 0x7f3edc1227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee3304700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc133f70 0x7f3edc122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee3304700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc123e40 con 0x7f3edc0a13a0 2023-09-30T22:24:37.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee3304700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc124cd0 con 0x7f3edc0a0a90 2023-09-30T22:24:37.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee3304700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc1257b0 con 0x7f3edc133f70 2023-09-30T22:24:37.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3580408700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357806c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3580408700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f357809f260 0x7f357806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3580408700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3578131dd0 0x7f35781c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:37.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3580408700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3578126020 con 0x7f357809f260 2023-09-30T22:24:37.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3580408700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3578126220 con 0x7f3578131dd0 2023-09-30T22:24:37.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3580408700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f357806d4c0 con 0x7f357809e950 2023-09-30T22:24:37.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee10a0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc122280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee10a0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc122280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36734/0 (socket says 172.21.15.154:36734) 2023-09-30T22:24:37.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee10a0700 1 -- 172.21.15.154:0/4031676703 learned_addr learned my addr 172.21.15.154:0/4031676703 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:37.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee18a1700 1 --2- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc133f70 0x7f3edc122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee089f700 1 --2- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3edc0a13a0 0x7f3edc1227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357d9a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f357809f260 0x7f357806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357e9a5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3578131dd0 0x7f35781c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357d9a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f357809f260 0x7f357806c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45408/0 (socket says 172.21.15.154:45408) 2023-09-30T22:24:37.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357d9a3700 1 -- 172.21.15.154:0/600438568 learned_addr learned my addr 172.21.15.154:0/600438568 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:37.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee089f700 1 -- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc133f70 msgr2=0x7f3edc122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee089f700 1 --2- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc133f70 0x7f3edc122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee089f700 1 -- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 msgr2=0x7f3edc122280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee089f700 1 --2- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc122280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f3ee089f700 1 -- 172.21.15.154:0/4031676703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80094a0 con 0x7f3edc0a13a0 2023-09-30T22:24:37.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357e1a4700 1 --2- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:37.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357d9a3700 1 -- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 msgr2=0x7f357806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357d9a3700 1 --2- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357806c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357d9a3700 1 -- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3578131dd0 msgr2=0x7f35781c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357d9a3700 1 --2- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3578131dd0 0x7f35781c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357d9a3700 1 -- 172.21.15.154:0/600438568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3574009430 con 0x7f357809f260 2023-09-30T22:24:37.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.487+0000 7f357e1a4700 1 --2- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357806c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:37.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f357d9a3700 1 --2- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f357809f260 0x7f357806c6c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f35680090b0 tx=0x7f3568004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f3ee089f700 1 --2- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3edc0a13a0 0x7f3edc1227c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc014d50 tx=0x7f3ecc016330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:37.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f356effd700 1 -- 172.21.15.154:0/600438568 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568003d00 con 0x7f357809f260 2023-09-30T22:24:37.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f356effd700 1 -- 172.21.15.154:0/600438568 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356801f070 con 0x7f357809f260 2023-09-30T22:24:37.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f3580408700 1 -- 172.21.15.154:0/600438568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35680094a0 con 0x7f357809f260 2023-09-30T22:24:37.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f356effd700 1 -- 172.21.15.154:0/600438568 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568011870 con 0x7f357809f260 2023-09-30T22:24:37.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f3ed1ffb700 1 -- 172.21.15.154:0/4031676703 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc014ea0 con 0x7f3edc0a13a0 2023-09-30T22:24:37.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f3ed1ffb700 1 -- 172.21.15.154:0/4031676703 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc004240 con 0x7f3edc0a13a0 2023-09-30T22:24:37.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f3ed1ffb700 1 -- 172.21.15.154:0/4031676703 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc019070 con 0x7f3edc0a13a0 2023-09-30T22:24:37.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f3ee3304700 1 -- 172.21.15.154:0/4031676703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc125a70 con 0x7f3edc0a13a0 2023-09-30T22:24:37.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.488+0000 7f3ee3304700 1 -- 172.21.15.154:0/4031676703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc125540 con 0x7f3edc0a13a0 2023-09-30T22:24:37.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.489+0000 7f3580408700 1 -- 172.21.15.154:0/600438568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357806cc00 con 0x7f357809f260 2023-09-30T22:24:37.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.489+0000 7f3ed1ffb700 1 -- 172.21.15.154:0/4031676703 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ecc0128e0 con 0x7f3edc0a13a0 2023-09-30T22:24:37.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.489+0000 7f356effd700 1 -- 172.21.15.154:0/600438568 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3568021030 con 0x7f357809f260 2023-09-30T22:24:37.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.489+0000 7f356effd700 1 -- 172.21.15.154:0/600438568 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3568044380 con 0x7f357809f260 2023-09-30T22:24:37.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.489+0000 7f3ed1ffb700 1 -- 172.21.15.154:0/4031676703 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ecc046f60 con 0x7f3edc0a13a0 2023-09-30T22:24:37.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.489+0000 7f3ee3304700 1 -- 172.21.15.154:0/4031676703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc11f780 con 0x7f3edc0a13a0 2023-09-30T22:24:37.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.490+0000 7f3580408700 1 -- 172.21.15.154:0/600438568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357804f2a0 con 0x7f357809f260 2023-09-30T22:24:37.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.494+0000 7f3ed1ffb700 1 -- 172.21.15.154:0/4031676703 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ecc0045b0 con 0x7f3edc0a13a0 2023-09-30T22:24:37.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.498+0000 7f356effd700 1 -- 172.21.15.154:0/600438568 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f356801a460 con 0x7f357809f260 2023-09-30T22:24:37.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.607+0000 7f44bd362700 1 -- 172.21.15.154:0/2974759805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f44b806c3b0 con 0x7f44b809d860 2023-09-30T22:24:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.608+0000 7f449f7fe700 1 -- 172.21.15.154:0/2974759805 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44a8019360 con 0x7f44b809d860 2023-09-30T22:24:37.609 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.610+0000 7f44bd362700 1 -- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b809d860 msgr2=0x7f44b811e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.610+0000 7f44bd362700 1 --2- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b809d860 0x7f44b811e4d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f44a8010fa0 tx=0x7f44a800e640 comp rx=0 tx=0).stop 2023-09-30T22:24:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.610+0000 7f44bd362700 1 -- 172.21.15.154:0/2974759805 shutdown_connections 2023-09-30T22:24:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.610+0000 7f44bd362700 1 --2- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b8130eb0 0x7f44b811ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.610+0000 7f44bd362700 1 --2- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b809d860 0x7f44b811e4d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.610+0000 7f44bd362700 1 --2- 172.21.15.154:0/2974759805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44b809e170 0x7f44b811ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.610+0000 7f44bd362700 1 -- 172.21.15.154:0/2974759805 >> 172.21.15.154:0/2974759805 conn(0x7f44b8099c40 msgr2=0x7f44b80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.610+0000 7f44bd362700 1 -- 172.21.15.154:0/2974759805 shutdown_connections 2023-09-30T22:24:37.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.610+0000 7f44bd362700 1 -- 172.21.15.154:0/2974759805 wait complete. 2023-09-30T22:24:37.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:37.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.700+0000 7f3ee3304700 1 -- 172.21.15.154:0/4031676703 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3edc1254e0 con 0x7f3edc0a13a0 2023-09-30T22:24:37.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.700+0000 7f3ed1ffb700 1 -- 172.21.15.154:0/4031676703 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ecc01c370 con 0x7f3edc0a13a0 2023-09-30T22:24:37.701 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:37.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.702+0000 7f3ee3304700 1 -- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3edc0a13a0 msgr2=0x7f3edc1227c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.702+0000 7f3ee3304700 1 --2- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3edc0a13a0 0x7f3edc1227c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc014d50 tx=0x7f3ecc016330 comp rx=0 tx=0).stop 2023-09-30T22:24:37.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.702+0000 7f3ee3304700 1 -- 172.21.15.154:0/4031676703 shutdown_connections 2023-09-30T22:24:37.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.702+0000 7f3ee3304700 1 --2- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3edc133f70 0x7f3edc122d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.702+0000 7f3ee3304700 1 --2- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3edc0a0a90 0x7f3edc122280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.702+0000 7f3ee3304700 1 --2- 172.21.15.154:0/4031676703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3edc0a13a0 0x7f3edc1227c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.702+0000 7f3ee3304700 1 -- 172.21.15.154:0/4031676703 >> 172.21.15.154:0/4031676703 conn(0x7f3edc099c40 msgr2=0x7f3edc11c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.702+0000 7f3ee3304700 1 -- 172.21.15.154:0/4031676703 shutdown_connections 2023-09-30T22:24:37.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.702+0000 7f3ee3304700 1 -- 172.21.15.154:0/4031676703 wait complete. 2023-09-30T22:24:37.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.704+0000 7f3580408700 1 -- 172.21.15.154:0/600438568 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f357804f2a0 con 0x7f357809f260 2023-09-30T22:24:37.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.705+0000 7f356effd700 1 -- 172.21.15.154:0/600438568 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3568031090 con 0x7f357809f260 2023-09-30T22:24:37.706 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.707+0000 7f3580408700 1 -- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f357809f260 msgr2=0x7f357806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.707+0000 7f3580408700 1 --2- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f357809f260 0x7f357806c6c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f35680090b0 tx=0x7f3568004750 comp rx=0 tx=0).stop 2023-09-30T22:24:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.707+0000 7f3580408700 1 -- 172.21.15.154:0/600438568 shutdown_connections 2023-09-30T22:24:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.707+0000 7f3580408700 1 --2- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3578131dd0 0x7f35781c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.707+0000 7f3580408700 1 --2- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f357809e950 0x7f357806c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.707+0000 7f3580408700 1 --2- 172.21.15.154:0/600438568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f357809f260 0x7f357806c6c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.707+0000 7f3580408700 1 -- 172.21.15.154:0/600438568 >> 172.21.15.154:0/600438568 conn(0x7f35780a0f70 msgr2=0x7f35780a2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.707+0000 7f3580408700 1 -- 172.21.15.154:0/600438568 shutdown_connections 2023-09-30T22:24:37.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:37.707+0000 7f3580408700 1 -- 172.21.15.154:0/600438568 wait complete. 2023-09-30T22:24:37.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:37.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:38.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65dc779700 1 Processor -- start 2023-09-30T22:24:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65dc779700 1 -- start start 2023-09-30T22:24:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65dc779700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65d409e870 0x7f65d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65dc779700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d4133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65dc779700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d409fa00 con 0x7f65d4134160 2023-09-30T22:24:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65dc779700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40a0370 con 0x7f65d409e870 2023-09-30T22:24:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65dc779700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65d406bec0 con 0x7f65d409f180 2023-09-30T22:24:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65d9d14700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d4133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65d9d14700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d4133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45802/0 (socket says 172.21.15.154:45802) 2023-09-30T22:24:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65d9d14700 1 -- 172.21.15.154:0/393357246 learned_addr learned my addr 172.21.15.154:0/393357246 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.439+0000 7f65da515700 1 --2- 172.21.15.154:0/393357246 >> v2:172.21.15.154:3300/0 conn(0x7f65d409e870 0x7f65d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65d9d14700 1 -- 172.21.15.154:0/393357246 >> v2:172.21.15.154:3300/0 conn(0x7f65d409e870 msgr2=0x7f65d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65d9d14700 1 --2- 172.21.15.154:0/393357246 >> v2:172.21.15.154:3300/0 conn(0x7f65d409e870 0x7f65d409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65d9d14700 1 -- 172.21.15.154:0/393357246 >> v1:172.21.15.154:6789/0 conn(0x7f65d4134160 legacy=0x7f65d413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65d9d14700 1 -- 172.21.15.154:0/393357246 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d409ada0 con 0x7f65d409f180 2023-09-30T22:24:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65da515700 1 --2- 172.21.15.154:0/393357246 >> v2:172.21.15.154:3300/0 conn(0x7f65d409e870 0x7f65d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65d9d14700 1 --2- 172.21.15.154:0/393357246 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d4133c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f65c40098f0 tx=0x7f65c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba2ab027a8a83e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65d9513700 1 -- 172.21.15.154:0/393357246 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011830 con 0x7f65d409f180 2023-09-30T22:24:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65d9513700 1 -- 172.21.15.154:0/393357246 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4011990 con 0x7f65d409f180 2023-09-30T22:24:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65d9513700 1 -- 172.21.15.154:0/393357246 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011d20 con 0x7f65d409f180 2023-09-30T22:24:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65dc779700 1 -- 172.21.15.154:0/393357246 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 msgr2=0x7f65d4133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.440+0000 7f65dc779700 1 --2- 172.21.15.154:0/393357246 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d4133c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f65c40098f0 tx=0x7f65c4009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.441+0000 7f65dc779700 1 -- 172.21.15.154:0/393357246 shutdown_connections 2023-09-30T22:24:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.441+0000 7f65dc779700 1 --2- 172.21.15.154:0/393357246 >> v2:172.21.15.154:3300/0 conn(0x7f65d409e870 0x7f65d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.441+0000 7f65dc779700 1 --2- 172.21.15.154:0/393357246 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d4133c20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.441+0000 7f65dc779700 1 -- 172.21.15.154:0/393357246 >> 172.21.15.154:0/393357246 conn(0x7f65d40a4430 msgr2=0x7f65d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.441+0000 7f65dc779700 1 -- 172.21.15.154:0/393357246 shutdown_connections 2023-09-30T22:24:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.441+0000 7f65dc779700 1 -- 172.21.15.154:0/393357246 wait complete. 2023-09-30T22:24:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.441+0000 7f65dc779700 1 Processor -- start 2023-09-30T22:24:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65dc779700 1 -- start start 2023-09-30T22:24:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65dc779700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d409e870 0x7f65d411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65dc779700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65dc779700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4134160 0x7f65d411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65dc779700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d41332f0 con 0x7f65d4134160 2023-09-30T22:24:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65dc779700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d406cfa0 con 0x7f65d409e870 2023-09-30T22:24:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65dc779700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4120b60 con 0x7f65d409f180 2023-09-30T22:24:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65da515700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d409e870 0x7f65d411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65d9d14700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65da515700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d409e870 0x7f65d411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36758/0 (socket says 172.21.15.154:36758) 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65da515700 1 -- 172.21.15.154:0/3584531046 learned_addr learned my addr 172.21.15.154:0/3584531046 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65dad16700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4134160 0x7f65d411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65d9d14700 1 -- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d409e870 msgr2=0x7f65d411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65d9d14700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d409e870 0x7f65d411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65d9d14700 1 -- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4134160 msgr2=0x7f65d411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65d9d14700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4134160 0x7f65d411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65d9d14700 1 -- 172.21.15.154:0/3584531046 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d00094a0 con 0x7f65d409f180 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65da515700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d409e870 0x7f65d411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.442+0000 7f65dad16700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4134160 0x7f65d411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.443+0000 7f65d9d14700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d411f010 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f65c4016000 tx=0x7f65c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.443+0000 7f65caffd700 1 -- 172.21.15.154:0/3584531046 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4004400 con 0x7f65d409f180 2023-09-30T22:24:38.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.443+0000 7f65caffd700 1 -- 172.21.15.154:0/3584531046 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c401f070 con 0x7f65d409f180 2023-09-30T22:24:38.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.443+0000 7f65dc779700 1 -- 172.21.15.154:0/3584531046 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c4009550 con 0x7f65d409f180 2023-09-30T22:24:38.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.443+0000 7f65caffd700 1 -- 172.21.15.154:0/3584531046 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40038e0 con 0x7f65d409f180 2023-09-30T22:24:38.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.443+0000 7f65dc779700 1 -- 172.21.15.154:0/3584531046 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d4121ee0 con 0x7f65d409f180 2023-09-30T22:24:38.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.444+0000 7f65caffd700 1 -- 172.21.15.154:0/3584531046 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65c4021030 con 0x7f65d409f180 2023-09-30T22:24:38.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.444+0000 7f65caffd700 1 -- 172.21.15.154:0/3584531046 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65c4040b90 con 0x7f65d409f180 2023-09-30T22:24:38.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.444+0000 7f65dc779700 1 -- 172.21.15.154:0/3584531046 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d404f2a0 con 0x7f65d409f180 2023-09-30T22:24:38.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.448+0000 7f65caffd700 1 -- 172.21.15.154:0/3584531046 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65c4004560 con 0x7f65d409f180 2023-09-30T22:24:38.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.631+0000 7f65dc779700 1 -- 172.21.15.154:0/3584531046 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65d406c9d0 con 0x7f65d409f180 2023-09-30T22:24:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.631+0000 7f65caffd700 1 -- 172.21.15.154:0/3584531046 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65c4015020 con 0x7f65d409f180 2023-09-30T22:24:38.632 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:38.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.634+0000 7f65dc779700 1 -- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 msgr2=0x7f65d411f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.634+0000 7f65dc779700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d411f010 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f65c4016000 tx=0x7f65c4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:38.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.634+0000 7f65dc779700 1 -- 172.21.15.154:0/3584531046 shutdown_connections 2023-09-30T22:24:38.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.634+0000 7f65dc779700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4134160 0x7f65d411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.634+0000 7f65dc779700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d409e870 0x7f65d411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.634+0000 7f65dc779700 1 --2- 172.21.15.154:0/3584531046 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65d409f180 0x7f65d411f010 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.634+0000 7f65dc779700 1 -- 172.21.15.154:0/3584531046 >> 172.21.15.154:0/3584531046 conn(0x7f65d40a4430 msgr2=0x7f65d409d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:38.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.634+0000 7f65dc779700 1 -- 172.21.15.154:0/3584531046 shutdown_connections 2023-09-30T22:24:38.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.634+0000 7f65dc779700 1 -- 172.21.15.154:0/3584531046 wait complete. 2023-09-30T22:24:38.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:38.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:38.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:38.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.748+0000 7f567de3c700 1 Processor -- start 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f567de3c700 1 -- start start 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f567de3c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f567de3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56781300a0 0x7f56781304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f567de3c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56781309f0 0x7f567813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f567de3c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567806b2d0 con 0x7f56781309f0 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f567de3c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5678133610 con 0x7f5678133ad0 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f567de3c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f567809a500 con 0x7f56781300a0 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f5677fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56781309f0 0x7f567813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f5676ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56781300a0 0x7f56781304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f5677fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56781309f0 0x7f567813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45424/0 (socket says 172.21.15.154:45424) 2023-09-30T22:24:38.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f5676ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56781300a0 0x7f56781304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45814/0 (socket says 172.21.15.154:45814) 2023-09-30T22:24:38.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f5677fff700 1 -- 172.21.15.154:0/1204013989 learned_addr learned my addr 172.21.15.154:0/1204013989 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:38.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.749+0000 7f56777fe700 1 --2- 172.21.15.154:0/1204013989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f5676ffd700 1 -- 172.21.15.154:0/1204013989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678133ad0 msgr2=0x7f5678133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f5676ffd700 1 --2- 172.21.15.154:0/1204013989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f5676ffd700 1 -- 172.21.15.154:0/1204013989 >> v2:172.21.15.154:3300/0 conn(0x7f56781309f0 msgr2=0x7f567813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f5676ffd700 1 --2- 172.21.15.154:0/1204013989 >> v2:172.21.15.154:3300/0 conn(0x7f56781309f0 0x7f567813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f5676ffd700 1 -- 172.21.15.154:0/1204013989 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56781338b0 con 0x7f56781300a0 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f5677fff700 1 --2- 172.21.15.154:0/1204013989 >> v2:172.21.15.154:3300/0 conn(0x7f56781309f0 0x7f567813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f56777fe700 1 --2- 172.21.15.154:0/1204013989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f5676ffd700 1 --2- 172.21.15.154:0/1204013989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56781300a0 0x7f56781304b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f566c009840 tx=0x7f566c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2bca7c8b46f12c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f56767fc700 1 -- 172.21.15.154:0/1204013989 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011830 con 0x7f56781300a0 2023-09-30T22:24:38.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f56767fc700 1 -- 172.21.15.154:0/1204013989 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c011990 con 0x7f56781300a0 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.750+0000 7f56767fc700 1 -- 172.21.15.154:0/1204013989 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011d20 con 0x7f56781300a0 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.751+0000 7f567de3c700 1 -- 172.21.15.154:0/1204013989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56781300a0 msgr2=0x7f56781304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.751+0000 7f567de3c700 1 --2- 172.21.15.154:0/1204013989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56781300a0 0x7f56781304b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f566c009840 tx=0x7f566c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.751+0000 7f567de3c700 1 -- 172.21.15.154:0/1204013989 shutdown_connections 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.751+0000 7f567de3c700 1 --2- 172.21.15.154:0/1204013989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.751+0000 7f567de3c700 1 --2- 172.21.15.154:0/1204013989 >> v2:172.21.15.154:3300/0 conn(0x7f56781309f0 0x7f567813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.751+0000 7f567de3c700 1 --2- 172.21.15.154:0/1204013989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f56781300a0 0x7f56781304b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.751+0000 7f567de3c700 1 -- 172.21.15.154:0/1204013989 >> 172.21.15.154:0/1204013989 conn(0x7f5678099c40 msgr2=0x7f56780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.751+0000 7f567de3c700 1 -- 172.21.15.154:0/1204013989 shutdown_connections 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.751+0000 7f567de3c700 1 -- 172.21.15.154:0/1204013989 wait complete. 2023-09-30T22:24:38.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f567de3c700 1 Processor -- start 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f567de3c700 1 -- start start 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f567de3c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56781300a0 0x7f56781c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f567de3c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56781309f0 0x7f56781c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f567de3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5678133ad0 0x7f567806e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f567de3c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5678070cd0 con 0x7f56781309f0 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f567de3c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5678072310 con 0x7f56781300a0 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f567de3c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f567812fe40 con 0x7f5678133ad0 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f5677fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5678133ad0 0x7f567806e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f5676ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56781309f0 0x7f56781c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f56777fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56781300a0 0x7f56781c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f5676ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56781309f0 0x7f56781c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45436/0 (socket says 172.21.15.154:45436) 2023-09-30T22:24:38.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f5677fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5678133ad0 0x7f567806e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45816/0 (socket says 172.21.15.154:45816) 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.752+0000 7f5676ffd700 1 -- 172.21.15.154:0/2808147512 learned_addr learned my addr 172.21.15.154:0/2808147512 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f5677fff700 1 -- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56781300a0 msgr2=0x7f56781c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f5677fff700 1 --2- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56781300a0 0x7f56781c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f5677fff700 1 -- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56781309f0 msgr2=0x7f56781c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f5677fff700 1 --2- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56781309f0 0x7f56781c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f5677fff700 1 -- 172.21.15.154:0/2808147512 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670009b30 con 0x7f5678133ad0 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f56777fe700 1 --2- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56781300a0 0x7f56781c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f5676ffd700 1 --2- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56781309f0 0x7f56781c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f5677fff700 1 --2- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5678133ad0 0x7f567806e900 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f567000efc0 tx=0x7f567000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f565ffff700 1 -- 172.21.15.154:0/2808147512 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670018070 con 0x7f5678133ad0 2023-09-30T22:24:38.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f565ffff700 1 -- 172.21.15.154:0/2808147512 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567000f040 con 0x7f5678133ad0 2023-09-30T22:24:38.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f567de3c700 1 -- 172.21.15.154:0/2808147512 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56680094a0 con 0x7f5678133ad0 2023-09-30T22:24:38.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f565ffff700 1 -- 172.21.15.154:0/2808147512 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670003c40 con 0x7f5678133ad0 2023-09-30T22:24:38.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.753+0000 7f567de3c700 1 -- 172.21.15.154:0/2808147512 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c0094a0 con 0x7f5678133ad0 2023-09-30T22:24:38.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.754+0000 7f565ffff700 1 -- 172.21.15.154:0/2808147512 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f567000c880 con 0x7f5678133ad0 2023-09-30T22:24:38.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.754+0000 7f565ffff700 1 -- 172.21.15.154:0/2808147512 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f567003f670 con 0x7f5678133ad0 2023-09-30T22:24:38.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.755+0000 7f567de3c700 1 -- 172.21.15.154:0/2808147512 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567804f2a0 con 0x7f5678133ad0 2023-09-30T22:24:38.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.760+0000 7f565ffff700 1 -- 172.21.15.154:0/2808147512 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5670012340 con 0x7f5678133ad0 2023-09-30T22:24:38.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.846+0000 7fb553a05700 1 Processor -- start 2023-09-30T22:24:38.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.846+0000 7fb553a05700 1 -- start start 2023-09-30T22:24:38.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb553a05700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb553a05700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c0a1380 0x7fb54c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb553a05700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c09dc00 con 0x7fb54c133f50 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb553a05700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c09ea60 con 0x7fb54c0a0a70 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb553a05700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c09dec0 con 0x7fb54c0a1380 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb5517a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb5517a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36786/0 (socket says 172.21.15.154:36786) 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb5517a1700 1 -- 172.21.15.154:0/1986488199 learned_addr learned my addr 172.21.15.154:0/1986488199 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb550fa0700 1 --2- 172.21.15.154:0/1986488199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c0a1380 0x7fb54c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb5517a1700 1 -- 172.21.15.154:0/1986488199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c0a1380 msgr2=0x7fb54c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb5517a1700 1 --2- 172.21.15.154:0/1986488199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c0a1380 0x7fb54c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb5517a1700 1 -- 172.21.15.154:0/1986488199 >> v1:172.21.15.154:6789/0 conn(0x7fb54c133f50 legacy=0x7fb54c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb5517a1700 1 -- 172.21.15.154:0/1986488199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c09e6a0 con 0x7fb54c0a0a70 2023-09-30T22:24:38.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb5517a1700 1 --2- 172.21.15.154:0/1986488199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c0a0e40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb548009920 tx=0x7fb548009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b87c1f26d7f92ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb543fff700 1 -- 172.21.15.154:0/1986488199 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548011830 con 0x7fb54c0a0a70 2023-09-30T22:24:38.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.847+0000 7fb543fff700 1 -- 172.21.15.154:0/1986488199 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548011990 con 0x7fb54c0a0a70 2023-09-30T22:24:38.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.848+0000 7fb543fff700 1 -- 172.21.15.154:0/1986488199 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548011d20 con 0x7fb54c0a0a70 2023-09-30T22:24:38.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.848+0000 7fb553a05700 1 -- 172.21.15.154:0/1986488199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 msgr2=0x7fb54c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.848+0000 7fb553a05700 1 --2- 172.21.15.154:0/1986488199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c0a0e40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb548009920 tx=0x7fb548009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.848+0000 7fb553a05700 1 -- 172.21.15.154:0/1986488199 shutdown_connections 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.848+0000 7fb553a05700 1 --2- 172.21.15.154:0/1986488199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c0a0e40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.848+0000 7fb553a05700 1 --2- 172.21.15.154:0/1986488199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c0a1380 0x7fb54c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.848+0000 7fb553a05700 1 -- 172.21.15.154:0/1986488199 >> 172.21.15.154:0/1986488199 conn(0x7fb54c0a6610 msgr2=0x7fb54c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.848+0000 7fb553a05700 1 -- 172.21.15.154:0/1986488199 shutdown_connections 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.848+0000 7fb553a05700 1 -- 172.21.15.154:0/1986488199 wait complete. 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.849+0000 7fb553a05700 1 Processor -- start 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.849+0000 7fb553a05700 1 -- start start 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb553a05700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c1c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb553a05700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb54c0a1380 0x7fb54c1c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb553a05700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c133f50 0x7fb54c1c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb553a05700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c125300 con 0x7fb54c0a1380 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb553a05700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c124780 con 0x7fb54c0a0a70 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb553a05700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0a03e0 con 0x7fb54c133f50 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb550fa0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb54c0a1380 0x7fb54c1c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb551fa2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c133f50 0x7fb54c1c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb550fa0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb54c0a1380 0x7fb54c1c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45454/0 (socket says 172.21.15.154:45454) 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb551fa2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c133f50 0x7fb54c1c8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45830/0 (socket says 172.21.15.154:45830) 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb550fa0700 1 -- 172.21.15.154:0/2332109395 learned_addr learned my addr 172.21.15.154:0/2332109395 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:38.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb5517a1700 1 --2- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c1c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb551fa2700 1 -- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 msgr2=0x7fb54c1c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb551fa2700 1 --2- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c1c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb551fa2700 1 -- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb54c0a1380 msgr2=0x7fb54c1c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb551fa2700 1 --2- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb54c0a1380 0x7fb54c1c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb551fa2700 1 -- 172.21.15.154:0/2332109395 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb548009550 con 0x7fb54c133f50 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb550fa0700 1 --2- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb54c0a1380 0x7fb54c1c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb551fa2700 1 --2- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c133f50 0x7fb54c1c8ce0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb54400cb90 tx=0x7fb54400cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb541ffb700 1 -- 172.21.15.154:0/2332109395 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544003c00 con 0x7fb54c133f50 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb541ffb700 1 -- 172.21.15.154:0/2332109395 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb544003d60 con 0x7fb54c133f50 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb553a05700 1 -- 172.21.15.154:0/2332109395 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c125f70 con 0x7fb54c133f50 2023-09-30T22:24:38.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.850+0000 7fb541ffb700 1 -- 172.21.15.154:0/2332109395 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400aaa0 con 0x7fb54c133f50 2023-09-30T22:24:38.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.851+0000 7fb553a05700 1 -- 172.21.15.154:0/2332109395 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c126ca0 con 0x7fb54c133f50 2023-09-30T22:24:38.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.851+0000 7fb541ffb700 1 -- 172.21.15.154:0/2332109395 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb54400ac00 con 0x7fb54c133f50 2023-09-30T22:24:38.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.852+0000 7fb541ffb700 1 -- 172.21.15.154:0/2332109395 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb54403f6e0 con 0x7fb54c133f50 2023-09-30T22:24:38.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.852+0000 7fb553a05700 1 -- 172.21.15.154:0/2332109395 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c04f2a0 con 0x7fb54c133f50 2023-09-30T22:24:38.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.861+0000 7fb541ffb700 1 -- 172.21.15.154:0/2332109395 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5440198f0 con 0x7fb54c133f50 2023-09-30T22:24:38.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.877+0000 7f1c07c10700 1 Processor -- start 2023-09-30T22:24:38.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.877+0000 7f1c07c10700 1 -- start start 2023-09-30T22:24:38.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c07c10700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009d860 0x7f1c0009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c07c10700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c0009e170 0x7f1c001307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c07c10700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0009aaa0 con 0x7f1c00130ce0 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c07c10700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0009f870 con 0x7f1c0009e170 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c07c10700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0009b360 con 0x7f1c0009d860 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c059ac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009d860 0x7f1c0009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c051ab700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c0009e170 0x7f1c001307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c059ac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009d860 0x7f1c0009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36792/0 (socket says 172.21.15.154:36792) 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c059ac700 1 -- 172.21.15.154:0/1542807952 learned_addr learned my addr 172.21.15.154:0/1542807952 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c051ab700 1 -- 172.21.15.154:0/1542807952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009d860 msgr2=0x7f1c0009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:38.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c051ab700 1 --2- 172.21.15.154:0/1542807952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009d860 0x7f1c0009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c051ab700 1 -- 172.21.15.154:0/1542807952 >> v1:172.21.15.154:6789/0 conn(0x7f1c00130ce0 legacy=0x7f1c001379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c051ab700 1 -- 172.21.15.154:0/1542807952 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0009b620 con 0x7f1c0009e170 2023-09-30T22:24:38.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.878+0000 7f1c059ac700 1 --2- 172.21.15.154:0/1542807952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009d860 0x7f1c0009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c051ab700 1 --2- 172.21.15.154:0/1542807952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0009e170 0x7f1c001307a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009840 tx=0x7f1bf0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cd6f8ed97acf7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c049aa700 1 -- 172.21.15.154:0/1542807952 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0011830 con 0x7f1c0009e170 2023-09-30T22:24:38.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c049aa700 1 -- 172.21.15.154:0/1542807952 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0011990 con 0x7f1c0009e170 2023-09-30T22:24:38.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c049aa700 1 -- 172.21.15.154:0/1542807952 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0011d20 con 0x7f1c0009e170 2023-09-30T22:24:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c07c10700 1 -- 172.21.15.154:0/1542807952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0009e170 msgr2=0x7f1c001307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c07c10700 1 --2- 172.21.15.154:0/1542807952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0009e170 0x7f1c001307a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009840 tx=0x7f1bf0009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c07c10700 1 -- 172.21.15.154:0/1542807952 shutdown_connections 2023-09-30T22:24:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c07c10700 1 --2- 172.21.15.154:0/1542807952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009d860 0x7f1c0009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c07c10700 1 --2- 172.21.15.154:0/1542807952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0009e170 0x7f1c001307a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.879+0000 7f1c07c10700 1 -- 172.21.15.154:0/1542807952 >> 172.21.15.154:0/1542807952 conn(0x7f1c00099c40 msgr2=0x7f1c000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.880+0000 7f1c07c10700 1 -- 172.21.15.154:0/1542807952 shutdown_connections 2023-09-30T22:24:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.880+0000 7f1c07c10700 1 -- 172.21.15.154:0/1542807952 wait complete. 2023-09-30T22:24:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.880+0000 7f1c07c10700 1 Processor -- start 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.880+0000 7f1c07c10700 1 -- start start 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c07c10700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0009d860 0x7f1c00138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c07c10700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009e170 0x7f1c001386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c07c10700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c00130ce0 0x7f1c001c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c07c10700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000a2220 con 0x7f1c00130ce0 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c07c10700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00135600 con 0x7f1c0009e170 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c07c10700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00136a40 con 0x7f1c0009d860 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c061ad700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c00130ce0 0x7f1c001c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c059ac700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0009d860 0x7f1c00138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c061ad700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c00130ce0 0x7f1c001c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45472/0 (socket says 172.21.15.154:45472) 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c061ad700 1 -- 172.21.15.154:0/1837325725 learned_addr learned my addr 172.21.15.154:0/1837325725 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:38.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c051ab700 1 --2- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009e170 0x7f1c001386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c061ad700 1 -- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0009d860 msgr2=0x7f1c00138170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c061ad700 1 --2- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0009d860 0x7f1c00138170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c061ad700 1 -- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009e170 msgr2=0x7f1c001386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c061ad700 1 --2- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009e170 0x7f1c001386b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c061ad700 1 -- 172.21.15.154:0/1837325725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc009550 con 0x7f1c00130ce0 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c059ac700 1 --2- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0009d860 0x7f1c00138170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.881+0000 7f1c061ad700 1 --2- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c00130ce0 0x7f1c001c8220 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800cc50 tx=0x7f1bf800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.882+0000 7f1bf67fc700 1 -- 172.21.15.154:0/1837325725 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8003c00 con 0x7f1c00130ce0 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.882+0000 7f1bf67fc700 1 -- 172.21.15.154:0/1837325725 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf8003d60 con 0x7f1c00130ce0 2023-09-30T22:24:38.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.882+0000 7f1bf67fc700 1 -- 172.21.15.154:0/1837325725 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800aab0 con 0x7f1c00130ce0 2023-09-30T22:24:38.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.882+0000 7f1c07c10700 1 -- 172.21.15.154:0/1837325725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf00094a0 con 0x7f1c00130ce0 2023-09-30T22:24:38.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.882+0000 7f1c07c10700 1 -- 172.21.15.154:0/1837325725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0009c910 con 0x7f1c00130ce0 2023-09-30T22:24:38.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.883+0000 7f1c07c10700 1 -- 172.21.15.154:0/1837325725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c00136f40 con 0x7f1c00130ce0 2023-09-30T22:24:38.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.883+0000 7f1bf67fc700 1 -- 172.21.15.154:0/1837325725 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bf800ac10 con 0x7f1c00130ce0 2023-09-30T22:24:38.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.883+0000 7f1bf67fc700 1 -- 172.21.15.154:0/1837325725 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1bf8040140 con 0x7f1c00130ce0 2023-09-30T22:24:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.892+0000 7f1bf67fc700 1 -- 172.21.15.154:0/1837325725 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bf80050d0 con 0x7f1c00130ce0 2023-09-30T22:24:38.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.971+0000 7f567de3c700 1 -- 172.21.15.154:0/2808147512 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f567812a7b0 con 0x7f5678133ad0 2023-09-30T22:24:38.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.971+0000 7f565ffff700 1 -- 172.21.15.154:0/2808147512 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f567001cbb0 con 0x7f5678133ad0 2023-09-30T22:24:38.972 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:38.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.973+0000 7f567de3c700 1 -- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5678133ad0 msgr2=0x7f567806e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:38.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.973+0000 7f567de3c700 1 --2- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5678133ad0 0x7f567806e900 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f567000efc0 tx=0x7f567000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.973+0000 7f567de3c700 1 -- 172.21.15.154:0/2808147512 shutdown_connections 2023-09-30T22:24:38.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.973+0000 7f567de3c700 1 --2- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5678133ad0 0x7f567806e900 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.973+0000 7f567de3c700 1 --2- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56781300a0 0x7f56781c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.973+0000 7f567de3c700 1 --2- 172.21.15.154:0/2808147512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56781309f0 0x7f56781c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:38.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.973+0000 7f567de3c700 1 -- 172.21.15.154:0/2808147512 >> 172.21.15.154:0/2808147512 conn(0x7f5678099c40 msgr2=0x7f5678131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:38.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.973+0000 7f567de3c700 1 -- 172.21.15.154:0/2808147512 shutdown_connections 2023-09-30T22:24:38.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:38.973+0000 7f567de3c700 1 -- 172.21.15.154:0/2808147512 wait complete. 2023-09-30T22:24:38.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:39.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.054+0000 7fb553a05700 1 -- 172.21.15.154:0/2332109395 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb54c0a2710 con 0x7fb54c133f50 2023-09-30T22:24:39.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.054+0000 7fb541ffb700 1 -- 172.21.15.154:0/2332109395 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb544019300 con 0x7fb54c133f50 2023-09-30T22:24:39.055 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:39.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.057+0000 7fb553a05700 1 -- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c133f50 msgr2=0x7fb54c1c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.057+0000 7fb553a05700 1 --2- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c133f50 0x7fb54c1c8ce0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb54400cb90 tx=0x7fb54400cea0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.057+0000 7fb553a05700 1 -- 172.21.15.154:0/2332109395 shutdown_connections 2023-09-30T22:24:39.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.057+0000 7fb553a05700 1 --2- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54c133f50 0x7fb54c1c8ce0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.057+0000 7fb553a05700 1 --2- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54c0a0a70 0x7fb54c1c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.057+0000 7fb553a05700 1 --2- 172.21.15.154:0/2332109395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb54c0a1380 0x7fb54c1c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.057+0000 7fb553a05700 1 -- 172.21.15.154:0/2332109395 >> 172.21.15.154:0/2332109395 conn(0x7fb54c0a6610 msgr2=0x7fb54c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.057+0000 7fb553a05700 1 -- 172.21.15.154:0/2332109395 shutdown_connections 2023-09-30T22:24:39.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.057+0000 7fb553a05700 1 -- 172.21.15.154:0/2332109395 wait complete. 2023-09-30T22:24:39.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:39.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.090+0000 7f1c07c10700 1 -- 172.21.15.154:0/1837325725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1c0004f2a0 con 0x7f1c00130ce0 2023-09-30T22:24:39.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.090+0000 7f1bf67fc700 1 -- 172.21.15.154:0/1837325725 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bf8011380 con 0x7f1c00130ce0 2023-09-30T22:24:39.091 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:39.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.092+0000 7f1c07c10700 1 -- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c00130ce0 msgr2=0x7f1c001c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.092+0000 7f1c07c10700 1 --2- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c00130ce0 0x7f1c001c8220 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800cc50 tx=0x7f1bf800cf60 comp rx=0 tx=0).stop 2023-09-30T22:24:39.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.092+0000 7f1c07c10700 1 -- 172.21.15.154:0/1837325725 shutdown_connections 2023-09-30T22:24:39.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.092+0000 7f1c07c10700 1 --2- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c00130ce0 0x7f1c001c8220 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.092+0000 7f1c07c10700 1 --2- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0009d860 0x7f1c00138170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.092+0000 7f1c07c10700 1 --2- 172.21.15.154:0/1837325725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0009e170 0x7f1c001386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.092+0000 7f1c07c10700 1 -- 172.21.15.154:0/1837325725 >> 172.21.15.154:0/1837325725 conn(0x7f1c00099c40 msgr2=0x7f1c00139690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.093+0000 7f1c07c10700 1 -- 172.21.15.154:0/1837325725 shutdown_connections 2023-09-30T22:24:39.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.093+0000 7f1c07c10700 1 -- 172.21.15.154:0/1837325725 wait complete. 2023-09-30T22:24:39.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:39.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb234d8f700 1 Processor -- start 2023-09-30T22:24:39.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb234d8f700 1 -- start start 2023-09-30T22:24:39.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb234d8f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb23009e870 0x7fb23009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb234d8f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb230133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb234d8f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23009fa00 con 0x7fb230134160 2023-09-30T22:24:39.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb234d8f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2300a0370 con 0x7fb23009e870 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb234d8f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23006bec0 con 0x7fb23009f180 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb22dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb230133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb22e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb23009e870 0x7fb23009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb22dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb230133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36816/0 (socket says 172.21.15.154:36816) 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.779+0000 7fb22dd9b700 1 -- 172.21.15.154:0/1351763065 learned_addr learned my addr 172.21.15.154:0/1351763065 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb22dd9b700 1 -- 172.21.15.154:0/1351763065 >> v2:172.21.15.154:3300/0 conn(0x7fb23009e870 msgr2=0x7fb23009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb22dd9b700 1 --2- 172.21.15.154:0/1351763065 >> v2:172.21.15.154:3300/0 conn(0x7fb23009e870 0x7fb23009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb22dd9b700 1 -- 172.21.15.154:0/1351763065 >> v1:172.21.15.154:6789/0 conn(0x7fb230134160 legacy=0x7fb23013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb22dd9b700 1 -- 172.21.15.154:0/1351763065 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23009ada0 con 0x7fb23009f180 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb22e59c700 1 --2- 172.21.15.154:0/1351763065 >> v2:172.21.15.154:3300/0 conn(0x7fb23009e870 0x7fb23009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:39.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb22dd9b700 1 --2- 172.21.15.154:0/1351763065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb230133c20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2240098f0 tx=0x7fb224009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f0e560170295b18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb22d59a700 1 -- 172.21.15.154:0/1351763065 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224011830 con 0x7fb23009f180 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb22d59a700 1 -- 172.21.15.154:0/1351763065 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb224011990 con 0x7fb23009f180 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb22d59a700 1 -- 172.21.15.154:0/1351763065 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224011d20 con 0x7fb23009f180 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb234d8f700 1 -- 172.21.15.154:0/1351763065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 msgr2=0x7fb230133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.780+0000 7fb234d8f700 1 --2- 172.21.15.154:0/1351763065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb230133c20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb2240098f0 tx=0x7fb224009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.781+0000 7fb234d8f700 1 -- 172.21.15.154:0/1351763065 shutdown_connections 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.781+0000 7fb234d8f700 1 --2- 172.21.15.154:0/1351763065 >> v2:172.21.15.154:3300/0 conn(0x7fb23009e870 0x7fb23009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.781+0000 7fb234d8f700 1 --2- 172.21.15.154:0/1351763065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb230133c20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.781+0000 7fb234d8f700 1 -- 172.21.15.154:0/1351763065 >> 172.21.15.154:0/1351763065 conn(0x7fb2300a4430 msgr2=0x7fb2300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.781+0000 7fb234d8f700 1 -- 172.21.15.154:0/1351763065 shutdown_connections 2023-09-30T22:24:39.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.781+0000 7fb234d8f700 1 -- 172.21.15.154:0/1351763065 wait complete. 2023-09-30T22:24:39.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb234d8f700 1 Processor -- start 2023-09-30T22:24:39.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb234d8f700 1 -- start start 2023-09-30T22:24:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb234d8f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb23009e870 0x7fb23011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb234d8f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb23011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb234d8f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb230134160 0x7fb23011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb234d8f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2301332f0 con 0x7fb230134160 2023-09-30T22:24:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb234d8f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23006cfa0 con 0x7fb23009f180 2023-09-30T22:24:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb234d8f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb230120b60 con 0x7fb23009e870 2023-09-30T22:24:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb22dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb23011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb22e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb23009e870 0x7fb23011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb22dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb23011f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36822/0 (socket says 172.21.15.154:36822) 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb22ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb230134160 0x7fb23011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.782+0000 7fb22dd9b700 1 -- 172.21.15.154:0/3087655113 learned_addr learned my addr 172.21.15.154:0/3087655113 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb22ed9d700 1 -- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb23009e870 msgr2=0x7fb23011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb22ed9d700 1 --2- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb23009e870 0x7fb23011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb22ed9d700 1 -- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 msgr2=0x7fb23011f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb22ed9d700 1 --2- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb23011f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb22ed9d700 1 -- 172.21.15.154:0/3087655113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200094a0 con 0x7fb230134160 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb22e59c700 1 --2- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb23009e870 0x7fb23011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb22dd9b700 1 --2- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb23011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb22ed9d700 1 --2- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb230134160 0x7fb23011f550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb22800cbc0 tx=0x7fb22800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb21effd700 1 -- 172.21.15.154:0/3087655113 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228003c00 con 0x7fb230134160 2023-09-30T22:24:39.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb21effd700 1 -- 172.21.15.154:0/3087655113 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb228003d60 con 0x7fb230134160 2023-09-30T22:24:39.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb234d8f700 1 -- 172.21.15.154:0/3087655113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb224009550 con 0x7fb230134160 2023-09-30T22:24:39.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb21effd700 1 -- 172.21.15.154:0/3087655113 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22800aa40 con 0x7fb230134160 2023-09-30T22:24:39.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.783+0000 7fb234d8f700 1 -- 172.21.15.154:0/3087655113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb230121ee0 con 0x7fb230134160 2023-09-30T22:24:39.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.784+0000 7fb21effd700 1 -- 172.21.15.154:0/3087655113 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb22800aba0 con 0x7fb230134160 2023-09-30T22:24:39.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.784+0000 7fb21effd700 1 -- 172.21.15.154:0/3087655113 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb22803f600 con 0x7fb230134160 2023-09-30T22:24:39.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.784+0000 7fb234d8f700 1 -- 172.21.15.154:0/3087655113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23004f2a0 con 0x7fb230134160 2023-09-30T22:24:39.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.788+0000 7fb21effd700 1 -- 172.21.15.154:0/3087655113 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb228012420 con 0x7fb230134160 2023-09-30T22:24:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.975+0000 7fb234d8f700 1 -- 172.21.15.154:0/3087655113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb23006c9d0 con 0x7fb230134160 2023-09-30T22:24:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.975+0000 7fb21effd700 1 -- 172.21.15.154:0/3087655113 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb228011380 con 0x7fb230134160 2023-09-30T22:24:39.977 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:39.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.977+0000 7fb234d8f700 1 -- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb230134160 msgr2=0x7fb23011f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.977+0000 7fb234d8f700 1 --2- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb230134160 0x7fb23011f550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb22800cbc0 tx=0x7fb22800ced0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.977+0000 7fb234d8f700 1 -- 172.21.15.154:0/3087655113 shutdown_connections 2023-09-30T22:24:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.977+0000 7fb234d8f700 1 --2- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb230134160 0x7fb23011f550 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.977+0000 7fb234d8f700 1 --2- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb23009e870 0x7fb23011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.977+0000 7fb234d8f700 1 --2- 172.21.15.154:0/3087655113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23009f180 0x7fb23011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.977+0000 7fb234d8f700 1 -- 172.21.15.154:0/3087655113 >> 172.21.15.154:0/3087655113 conn(0x7fb2300a4430 msgr2=0x7fb23009d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.977+0000 7fb234d8f700 1 -- 172.21.15.154:0/3087655113 shutdown_connections 2023-09-30T22:24:39.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:39.977+0000 7fb234d8f700 1 -- 172.21.15.154:0/3087655113 wait complete. 2023-09-30T22:24:39.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:39.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:40.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:40.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:40.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.111+0000 7f26225ad700 1 Processor -- start 2023-09-30T22:24:40.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f26225ad700 1 -- start start 2023-09-30T22:24:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f26225ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f26225ad700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f261c135f20 0x7f261c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f26225ad700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c09aaa0 con 0x7f261c09d860 2023-09-30T22:24:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f26225ad700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c09e730 con 0x7f261c135f20 2023-09-30T22:24:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f26225ad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c09f870 con 0x7f261c09e340 2023-09-30T22:24:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f261bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f261c09d860 0x7f261c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41810/0 (socket says 172.21.15.154:41810) 2023-09-30T22:24:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f261bfff700 1 -- 172.21.15.154:0/1539722780 learned_addr learned my addr 172.21.15.154:0/1539722780 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f261b7fe700 1 --2- 172.21.15.154:0/1539722780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.112+0000 7f2620b4a700 1 --2- 172.21.15.154:0/1539722780 >> v2:172.21.15.154:3300/0 conn(0x7f261c135f20 0x7f261c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f2620b4a700 1 -- 172.21.15.154:0/1539722780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 msgr2=0x7f261c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:40.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f2620b4a700 1 --2- 172.21.15.154:0/1539722780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f2620b4a700 1 -- 172.21.15.154:0/1539722780 >> v1:172.21.15.154:6789/0 conn(0x7f261c09d860 legacy=0x7f261c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f2620b4a700 1 -- 172.21.15.154:0/1539722780 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c09b360 con 0x7f261c135f20 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f261affd700 1 -- 172.21.15.154:0/1539722780 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234743019 0 0) 0x7f261c09aaa0 con 0x7f261c09d860 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f261b7fe700 1 --2- 172.21.15.154:0/1539722780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f2620b4a700 1 --2- 172.21.15.154:0/1539722780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c135f20 0x7f261c138300 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f261400be30 tx=0x7f2614009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d05c24d964fb74 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f261affd700 1 -- 172.21.15.154:0/1539722780 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400c890 con 0x7f261c135f20 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f261affd700 1 -- 172.21.15.154:0/1539722780 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261400c9f0 con 0x7f261c135f20 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.113+0000 7f261affd700 1 -- 172.21.15.154:0/1539722780 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400cda0 con 0x7f261c135f20 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.114+0000 7f26225ad700 1 -- 172.21.15.154:0/1539722780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c135f20 msgr2=0x7f261c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.114+0000 7f26225ad700 1 --2- 172.21.15.154:0/1539722780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c135f20 0x7f261c138300 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f261400be30 tx=0x7f2614009290 comp rx=0 tx=0).stop 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.114+0000 7f26225ad700 1 -- 172.21.15.154:0/1539722780 shutdown_connections 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.114+0000 7f26225ad700 1 --2- 172.21.15.154:0/1539722780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c135f20 0x7f261c138300 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.114+0000 7f26225ad700 1 --2- 172.21.15.154:0/1539722780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.114+0000 7f26225ad700 1 -- 172.21.15.154:0/1539722780 >> 172.21.15.154:0/1539722780 conn(0x7f261c099c40 msgr2=0x7f261c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.115+0000 7f26225ad700 1 -- 172.21.15.154:0/1539722780 shutdown_connections 2023-09-30T22:24:40.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.115+0000 7f26225ad700 1 -- 172.21.15.154:0/1539722780 wait complete. 2023-09-30T22:24:40.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f26225ad700 1 Processor -- start 2023-09-30T22:24:40.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f26225ad700 1 -- start start 2023-09-30T22:24:40.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f26225ad700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c09d860 0x7f261c11c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f26225ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c11c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f26225ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f261c135f20 0x7f261c11cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f26225ad700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c071fc0 con 0x7f261c09d860 2023-09-30T22:24:40.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f26225ad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c09c8b0 con 0x7f261c09e340 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f26225ad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f261c11f5d0 con 0x7f261c135f20 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f261bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c09d860 0x7f261c11c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f261b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c11c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f261b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c11c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36848/0 (socket says 172.21.15.154:36848) 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f261b7fe700 1 -- 172.21.15.154:0/3735119023 learned_addr learned my addr 172.21.15.154:0/3735119023 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f2620b4a700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f261c135f20 0x7f261c11cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.116+0000 7f261bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c09d860 0x7f261c11c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45514/0 (socket says 172.21.15.154:45514) 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f2620b4a700 1 -- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 msgr2=0x7f261c11c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f2620b4a700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c11c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f2620b4a700 1 -- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c09d860 msgr2=0x7f261c11c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f2620b4a700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c09d860 0x7f261c11c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f2620b4a700 1 -- 172.21.15.154:0/3735119023 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261000d940 con 0x7f261c135f20 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f261bfff700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c09d860 0x7f261c11c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f261b7fe700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c11c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f2620b4a700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f261c135f20 0x7f261c11cda0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2614015000 tx=0x7f2614004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f2618ff9700 1 -- 172.21.15.154:0/3735119023 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261400c890 con 0x7f261c135f20 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f2618ff9700 1 -- 172.21.15.154:0/3735119023 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261400cb60 con 0x7f261c135f20 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f26225ad700 1 -- 172.21.15.154:0/3735119023 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261400ba90 con 0x7f261c135f20 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f2618ff9700 1 -- 172.21.15.154:0/3735119023 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614026410 con 0x7f261c135f20 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.117+0000 7f26225ad700 1 -- 172.21.15.154:0/3735119023 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c11e6e0 con 0x7f261c135f20 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.118+0000 7f2618ff9700 1 -- 172.21.15.154:0/3735119023 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f261401a070 con 0x7f261c135f20 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.118+0000 7f2618ff9700 1 -- 172.21.15.154:0/3735119023 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2614040e10 con 0x7f261c135f20 2023-09-30T22:24:40.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.118+0000 7f26225ad700 1 -- 172.21.15.154:0/3735119023 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c11f7a0 con 0x7f261c135f20 2023-09-30T22:24:40.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.123+0000 7f2618ff9700 1 -- 172.21.15.154:0/3735119023 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f261402b080 con 0x7f261c135f20 2023-09-30T22:24:40.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.200+0000 7fc251488700 1 Processor -- start 2023-09-30T22:24:40.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.200+0000 7fc251488700 1 -- start start 2023-09-30T22:24:40.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc251488700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc251488700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09dec0 0x7fc24c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc251488700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c06b5c0 con 0x7fc24c131a00 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc251488700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c06e900 con 0x7fc24c09dec0 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc251488700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c09d180 con 0x7fc24c06a770 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45854/0 (socket says 172.21.15.154:45854) 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24affd700 1 -- 172.21.15.154:0/3510611301 learned_addr learned my addr 172.21.15.154:0/3510611301 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc24c131a00 0x7fc24c131e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41824/0 (socket says 172.21.15.154:41824) 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24a7fc700 1 --2- 172.21.15.154:0/3510611301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09dec0 0x7fc24c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc249ffb700 1 -- 172.21.15.154:0/3510611301 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291227645 0 0) 0x7fc24c06b5c0 con 0x7fc24c131a00 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc249ffb700 1 -- 172.21.15.154:0/3510611301 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2340035b0 con 0x7fc24c131a00 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24a7fc700 1 -- 172.21.15.154:0/3510611301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 msgr2=0x7fc24c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:40.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24a7fc700 1 --2- 172.21.15.154:0/3510611301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24a7fc700 1 -- 172.21.15.154:0/3510611301 >> v1:172.21.15.154:6789/0 conn(0x7fc24c131a00 legacy=0x7fc24c131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24a7fc700 1 -- 172.21.15.154:0/3510611301 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c09e780 con 0x7fc24c09dec0 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24affd700 1 --2- 172.21.15.154:0/3510611301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.201+0000 7fc24a7fc700 1 --2- 172.21.15.154:0/3510611301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09dec0 0x7fc24c06b080 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc240009870 tx=0x7fc240009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742340081bf659af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc249ffb700 1 -- 172.21.15.154:0/3510611301 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240011830 con 0x7fc24c09dec0 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc249ffb700 1 -- 172.21.15.154:0/3510611301 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240011990 con 0x7fc24c09dec0 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc249ffb700 1 -- 172.21.15.154:0/3510611301 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240011d00 con 0x7fc24c09dec0 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc251488700 1 -- 172.21.15.154:0/3510611301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09dec0 msgr2=0x7fc24c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc251488700 1 --2- 172.21.15.154:0/3510611301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09dec0 0x7fc24c06b080 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc240009870 tx=0x7fc240009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc251488700 1 -- 172.21.15.154:0/3510611301 shutdown_connections 2023-09-30T22:24:40.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc251488700 1 --2- 172.21.15.154:0/3510611301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc251488700 1 --2- 172.21.15.154:0/3510611301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09dec0 0x7fc24c06b080 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc251488700 1 -- 172.21.15.154:0/3510611301 >> 172.21.15.154:0/3510611301 conn(0x7fc24c099c40 msgr2=0x7fc24c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc251488700 1 -- 172.21.15.154:0/3510611301 shutdown_connections 2023-09-30T22:24:40.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.202+0000 7fc251488700 1 -- 172.21.15.154:0/3510611301 wait complete. 2023-09-30T22:24:40.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.203+0000 7fc251488700 1 Processor -- start 2023-09-30T22:24:40.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.203+0000 7fc251488700 1 -- start start 2023-09-30T22:24:40.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc251488700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c1c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc251488700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09dec0 0x7fc24c1c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc251488700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c131a00 0x7fc24c1c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc251488700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c11d580 con 0x7fc24c09dec0 2023-09-30T22:24:40.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc251488700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c11c7a0 con 0x7fc24c131a00 2023-09-30T22:24:40.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc251488700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c11cb80 con 0x7fc24c06a770 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c131a00 0x7fc24c1c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c131a00 0x7fc24c1c29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36872/0 (socket says 172.21.15.154:36872) 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c1c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24b7fe700 1 -- 172.21.15.154:0/4041502454 learned_addr learned my addr 172.21.15.154:0/4041502454 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24a7fc700 1 --2- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09dec0 0x7fc24c1c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24b7fe700 1 -- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 msgr2=0x7fc24c1c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24b7fe700 1 --2- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c1c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24b7fe700 1 -- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09dec0 msgr2=0x7fc24c1c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24b7fe700 1 --2- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09dec0 0x7fc24c1c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.204+0000 7fc24b7fe700 1 -- 172.21.15.154:0/4041502454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c009550 con 0x7fc24c131a00 2023-09-30T22:24:40.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.205+0000 7fc24b7fe700 1 --2- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c131a00 0x7fc24c1c29d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc24400cc50 tx=0x7fc24400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.205+0000 7fc2337fe700 1 -- 172.21.15.154:0/4041502454 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24400aad0 con 0x7fc24c131a00 2023-09-30T22:24:40.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.205+0000 7fc2337fe700 1 -- 172.21.15.154:0/4041502454 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24400ac30 con 0x7fc24c131a00 2023-09-30T22:24:40.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.205+0000 7fc251488700 1 -- 172.21.15.154:0/4041502454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2400094a0 con 0x7fc24c131a00 2023-09-30T22:24:40.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.205+0000 7fc2337fe700 1 -- 172.21.15.154:0/4041502454 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc244007070 con 0x7fc24c131a00 2023-09-30T22:24:40.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.205+0000 7fc251488700 1 -- 172.21.15.154:0/4041502454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c11b950 con 0x7fc24c131a00 2023-09-30T22:24:40.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.206+0000 7fc2337fe700 1 -- 172.21.15.154:0/4041502454 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2440071d0 con 0x7fc24c131a00 2023-09-30T22:24:40.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.206+0000 7fc2337fe700 1 -- 172.21.15.154:0/4041502454 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc24403f4b0 con 0x7fc24c131a00 2023-09-30T22:24:40.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.206+0000 7fc251488700 1 -- 172.21.15.154:0/4041502454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24c04f2a0 con 0x7fc24c131a00 2023-09-30T22:24:40.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.210+0000 7fc2337fe700 1 -- 172.21.15.154:0/4041502454 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc244017020 con 0x7fc24c131a00 2023-09-30T22:24:40.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.238+0000 7f552eacd700 1 Processor -- start 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.238+0000 7f552eacd700 1 -- start start 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f552eacd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55280a1550 0x7f5528138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f552eacd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5528139200 0x7f552813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f552eacd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552809e9d0 con 0x7f55280a0a70 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f552eacd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552809dc00 con 0x7f55280a1550 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f552eacd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f552809dec0 con 0x7f5528139200 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f552c869700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f55280a0a70 0x7f55280a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41838/0 (socket says 172.21.15.154:41838) 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f552c869700 1 -- 172.21.15.154:0/4223011884 learned_addr learned my addr 172.21.15.154:0/4223011884 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f5527fff700 1 --2- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55280a1550 0x7f5528138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f552d06a700 1 --2- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5528139200 0x7f552813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f55277fe700 1 -- 172.21.15.154:0/4223011884 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969175995 0 0) 0x7f552809e9d0 con 0x7f55280a0a70 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f55277fe700 1 -- 172.21.15.154:0/4223011884 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55180035b0 con 0x7f55280a0a70 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f5527fff700 1 -- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5528139200 msgr2=0x7f552813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f5527fff700 1 --2- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5528139200 0x7f552813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f5527fff700 1 -- 172.21.15.154:0/4223011884 >> v1:172.21.15.154:6789/0 conn(0x7f55280a0a70 legacy=0x7f55280a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f5527fff700 1 -- 172.21.15.154:0/4223011884 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552809e6a0 con 0x7f55280a1550 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.239+0000 7f552d06a700 1 --2- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5528139200 0x7f552813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.240+0000 7f5527fff700 1 --2- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55280a1550 0x7f5528138cc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5514009870 tx=0x7f5514009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b8915511b8a428d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.240+0000 7f55277fe700 1 -- 172.21.15.154:0/4223011884 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514011830 con 0x7f55280a1550 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.240+0000 7f55277fe700 1 -- 172.21.15.154:0/4223011884 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5514011990 con 0x7f55280a1550 2023-09-30T22:24:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.240+0000 7f55277fe700 1 -- 172.21.15.154:0/4223011884 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514011d00 con 0x7f55280a1550 2023-09-30T22:24:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.241+0000 7f552eacd700 1 -- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55280a1550 msgr2=0x7f5528138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.241+0000 7f552eacd700 1 --2- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55280a1550 0x7f5528138cc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5514009870 tx=0x7f5514009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.241+0000 7f552eacd700 1 -- 172.21.15.154:0/4223011884 shutdown_connections 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.241+0000 7f552eacd700 1 --2- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5528139200 0x7f552813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.241+0000 7f552eacd700 1 --2- 172.21.15.154:0/4223011884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55280a1550 0x7f5528138cc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.241+0000 7f552eacd700 1 -- 172.21.15.154:0/4223011884 >> 172.21.15.154:0/4223011884 conn(0x7f55280a6610 msgr2=0x7f55280a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.241+0000 7f552eacd700 1 -- 172.21.15.154:0/4223011884 shutdown_connections 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.241+0000 7f552eacd700 1 -- 172.21.15.154:0/4223011884 wait complete. 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.242+0000 7f552eacd700 1 Processor -- start 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.242+0000 7f552eacd700 1 -- start start 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f552eacd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55280a0a70 0x7f5528120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f552eacd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55280a1550 0x7f5528120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f552eacd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5528139200 0x7f55281212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f552eacd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5528136150 con 0x7f55280a1550 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f552eacd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5528124360 con 0x7f5528139200 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f552eacd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55280a03e0 con 0x7f55280a0a70 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f5527fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55280a1550 0x7f5528120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f552c869700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55280a0a70 0x7f5528120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f5527fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55280a1550 0x7f5528120d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45538/0 (socket says 172.21.15.154:45538) 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f5527fff700 1 -- 172.21.15.154:0/426128859 learned_addr learned my addr 172.21.15.154:0/426128859 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f552d06a700 1 --2- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5528139200 0x7f55281212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f5527fff700 1 -- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55280a0a70 msgr2=0x7f5528120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f5527fff700 1 --2- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55280a0a70 0x7f5528120840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f5527fff700 1 -- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5528139200 msgr2=0x7f55281212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f5527fff700 1 --2- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5528139200 0x7f55281212c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f5527fff700 1 -- 172.21.15.154:0/426128859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520009a70 con 0x7f55280a1550 2023-09-30T22:24:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.243+0000 7f5527fff700 1 --2- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55280a1550 0x7f5528120d80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5514009bc0 tx=0x7f5514004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.244+0000 7f55257fa700 1 -- 172.21.15.154:0/426128859 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140045d0 con 0x7f55280a1550 2023-09-30T22:24:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.244+0000 7f55257fa700 1 -- 172.21.15.154:0/426128859 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551401f070 con 0x7f55280a1550 2023-09-30T22:24:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.244+0000 7f552eacd700 1 -- 172.21.15.154:0/426128859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55140094a0 con 0x7f55280a1550 2023-09-30T22:24:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.244+0000 7f55257fa700 1 -- 172.21.15.154:0/426128859 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140038e0 con 0x7f55280a1550 2023-09-30T22:24:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.244+0000 7f552eacd700 1 -- 172.21.15.154:0/426128859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5528123dc0 con 0x7f55280a1550 2023-09-30T22:24:40.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.245+0000 7f55257fa700 1 -- 172.21.15.154:0/426128859 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5514003a40 con 0x7f55280a1550 2023-09-30T22:24:40.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.245+0000 7f552eacd700 1 -- 172.21.15.154:0/426128859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552804f2a0 con 0x7f55280a1550 2023-09-30T22:24:40.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.245+0000 7f55257fa700 1 -- 172.21.15.154:0/426128859 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5514021070 con 0x7f55280a1550 2023-09-30T22:24:40.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.250+0000 7f55257fa700 1 -- 172.21.15.154:0/426128859 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5514010380 con 0x7f55280a1550 2023-09-30T22:24:40.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.321+0000 7f26225ad700 1 -- 172.21.15.154:0/3735119023 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f261c11f180 con 0x7f261c135f20 2023-09-30T22:24:40.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.322+0000 7f2618ff9700 1 -- 172.21.15.154:0/3735119023 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2614035090 con 0x7f261c135f20 2023-09-30T22:24:40.323 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:40.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.325+0000 7f26225ad700 1 -- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f261c135f20 msgr2=0x7f261c11cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.325+0000 7f26225ad700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f261c135f20 0x7f261c11cda0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2614015000 tx=0x7f2614004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.325+0000 7f26225ad700 1 -- 172.21.15.154:0/3735119023 shutdown_connections 2023-09-30T22:24:40.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.325+0000 7f26225ad700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f261c135f20 0x7f261c11cda0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.325+0000 7f26225ad700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f261c09d860 0x7f261c11c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.325+0000 7f26225ad700 1 --2- 172.21.15.154:0/3735119023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f261c09e340 0x7f261c11c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.325+0000 7f26225ad700 1 -- 172.21.15.154:0/3735119023 >> 172.21.15.154:0/3735119023 conn(0x7f261c099c40 msgr2=0x7f261c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.325+0000 7f26225ad700 1 -- 172.21.15.154:0/3735119023 shutdown_connections 2023-09-30T22:24:40.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.325+0000 7f26225ad700 1 -- 172.21.15.154:0/3735119023 wait complete. 2023-09-30T22:24:40.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.407+0000 7fc251488700 1 -- 172.21.15.154:0/4041502454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc24c11d8b0 con 0x7fc24c131a00 2023-09-30T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.407+0000 7fc2337fe700 1 -- 172.21.15.154:0/4041502454 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2440198b0 con 0x7fc24c131a00 2023-09-30T22:24:40.408 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.409+0000 7fc251488700 1 -- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c131a00 msgr2=0x7fc24c1c29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.409+0000 7fc251488700 1 --2- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c131a00 0x7fc24c1c29d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc24400cc50 tx=0x7fc24400cf60 comp rx=0 tx=0).stop 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.409+0000 7fc251488700 1 -- 172.21.15.154:0/4041502454 shutdown_connections 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.409+0000 7fc251488700 1 --2- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c131a00 0x7fc24c1c29d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.409+0000 7fc251488700 1 --2- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c06a770 0x7fc24c1c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.409+0000 7fc251488700 1 --2- 172.21.15.154:0/4041502454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09dec0 0x7fc24c1c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.409+0000 7fc251488700 1 -- 172.21.15.154:0/4041502454 >> 172.21.15.154:0/4041502454 conn(0x7fc24c099c40 msgr2=0x7fc24c12ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.409+0000 7fc251488700 1 -- 172.21.15.154:0/4041502454 shutdown_connections 2023-09-30T22:24:40.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.409+0000 7fc251488700 1 -- 172.21.15.154:0/4041502454 wait complete. 2023-09-30T22:24:40.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:40.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.444+0000 7f552eacd700 1 -- 172.21.15.154:0/426128859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5528122c40 con 0x7f55280a1550 2023-09-30T22:24:40.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.445+0000 7f55257fa700 1 -- 172.21.15.154:0/426128859 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5514015020 con 0x7f55280a1550 2023-09-30T22:24:40.446 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:40.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.447+0000 7f552eacd700 1 -- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55280a1550 msgr2=0x7f5528120d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.447+0000 7f552eacd700 1 --2- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55280a1550 0x7f5528120d80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5514009bc0 tx=0x7f5514004750 comp rx=0 tx=0).stop 2023-09-30T22:24:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.447+0000 7f552eacd700 1 -- 172.21.15.154:0/426128859 shutdown_connections 2023-09-30T22:24:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.447+0000 7f552eacd700 1 --2- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5528139200 0x7f55281212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.447+0000 7f552eacd700 1 --2- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55280a0a70 0x7f5528120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.447+0000 7f552eacd700 1 --2- 172.21.15.154:0/426128859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55280a1550 0x7f5528120d80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:40.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.447+0000 7f552eacd700 1 -- 172.21.15.154:0/426128859 >> 172.21.15.154:0/426128859 conn(0x7f55280a6610 msgr2=0x7f55280a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.447+0000 7f552eacd700 1 -- 172.21.15.154:0/426128859 shutdown_connections 2023-09-30T22:24:40.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:40.447+0000 7f552eacd700 1 -- 172.21.15.154:0/426128859 wait complete. 2023-09-30T22:24:40.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:40.991 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:41.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.115+0000 7f41e4f0f700 1 Processor -- start 2023-09-30T22:24:41.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.115+0000 7f41e4f0f700 1 -- start start 2023-09-30T22:24:41.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41e4f0f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0133900 0x7f41e0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41e4f0f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f41e00a10b0 0x7f41e013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41e4f0f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e009a760 con 0x7f41e0134210 2023-09-30T22:24:41.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41e4f0f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e01336e0 con 0x7f41e00a10b0 2023-09-30T22:24:41.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41e4f0f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e009a080 con 0x7f41e0133900 2023-09-30T22:24:41.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41ded9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f41e00a10b0 0x7f41e013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41de59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0133900 0x7f41e0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41ded9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f41e00a10b0 0x7f41e013b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45554/0 (socket says 172.21.15.154:45554) 2023-09-30T22:24:41.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41de59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0133900 0x7f41e0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45890/0 (socket says 172.21.15.154:45890) 2023-09-30T22:24:41.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41ded9d700 1 -- 172.21.15.154:0/1869175898 learned_addr learned my addr 172.21.15.154:0/1869175898 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:41.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41de59c700 1 -- 172.21.15.154:0/1869175898 >> v2:172.21.15.154:3300/0 conn(0x7f41e00a10b0 msgr2=0x7f41e013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41de59c700 1 --2- 172.21.15.154:0/1869175898 >> v2:172.21.15.154:3300/0 conn(0x7f41e00a10b0 0x7f41e013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.116+0000 7f41de59c700 1 -- 172.21.15.154:0/1869175898 >> v1:172.21.15.154:6789/0 conn(0x7f41e0134210 legacy=0x7f41e00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41de59c700 1 -- 172.21.15.154:0/1869175898 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00a23e0 con 0x7f41e0133900 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41dd59a700 1 -- 172.21.15.154:0/1869175898 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191121212 0 0) 0x7f41e009a760 con 0x7f41e0134210 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41ded9d700 1 --2- 172.21.15.154:0/1869175898 >> v2:172.21.15.154:3300/0 conn(0x7f41e00a10b0 0x7f41e013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41de59c700 1 --2- 172.21.15.154:0/1869175898 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0133900 0x7f41e0133cd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009820 tx=0x7f41c8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a29f848fa2f473fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41dd59a700 1 -- 172.21.15.154:0/1869175898 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8005e30 con 0x7f41e0133900 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41dd59a700 1 -- 172.21.15.154:0/1869175898 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c8006030 con 0x7f41e0133900 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41dd59a700 1 -- 172.21.15.154:0/1869175898 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80063c0 con 0x7f41e0133900 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41e4f0f700 1 -- 172.21.15.154:0/1869175898 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0133900 msgr2=0x7f41e0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41e4f0f700 1 --2- 172.21.15.154:0/1869175898 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0133900 0x7f41e0133cd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009820 tx=0x7f41c8009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:41.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41e4f0f700 1 -- 172.21.15.154:0/1869175898 shutdown_connections 2023-09-30T22:24:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41e4f0f700 1 --2- 172.21.15.154:0/1869175898 >> v2:172.21.15.154:3300/0 conn(0x7f41e00a10b0 0x7f41e013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41e4f0f700 1 --2- 172.21.15.154:0/1869175898 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0133900 0x7f41e0133cd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41e4f0f700 1 -- 172.21.15.154:0/1869175898 >> 172.21.15.154:0/1869175898 conn(0x7f41e00a2980 msgr2=0x7f41e00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41e4f0f700 1 -- 172.21.15.154:0/1869175898 shutdown_connections 2023-09-30T22:24:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.117+0000 7f41e4f0f700 1 -- 172.21.15.154:0/1869175898 wait complete. 2023-09-30T22:24:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41e4f0f700 1 Processor -- start 2023-09-30T22:24:41.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41e4f0f700 1 -- start start 2023-09-30T22:24:41.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41e4f0f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e00a10b0 0x7f41e011d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41e4f0f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e0133900 0x7f41e011dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41e4f0f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0134210 0x7f41e011e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41e4f0f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0121bc0 con 0x7f41e00a10b0 2023-09-30T22:24:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41e4f0f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0121200 con 0x7f41e0133900 2023-09-30T22:24:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41e4f0f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e01205b0 con 0x7f41e0134210 2023-09-30T22:24:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41de59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e00a10b0 0x7f41e011d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41de59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e00a10b0 0x7f41e011d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45556/0 (socket says 172.21.15.154:45556) 2023-09-30T22:24:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41de59c700 1 -- 172.21.15.154:0/3056646707 learned_addr learned my addr 172.21.15.154:0/3056646707 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41ded9d700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0134210 0x7f41e011e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41ddd9b700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e0133900 0x7f41e011dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41de59c700 1 -- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0134210 msgr2=0x7f41e011e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41de59c700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0134210 0x7f41e011e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41de59c700 1 -- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e0133900 msgr2=0x7f41e011dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41de59c700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e0133900 0x7f41e011dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41de59c700 1 -- 172.21.15.154:0/3056646707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009b30 con 0x7f41e00a10b0 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.119+0000 7f41ded9d700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0134210 0x7f41e011e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.120+0000 7f41de59c700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e00a10b0 0x7f41e011d780 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f41e009a1c0 tx=0x7f41c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.120+0000 7f41d6ffd700 1 -- 172.21.15.154:0/3056646707 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80061a0 con 0x7f41e00a10b0 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.120+0000 7f41d6ffd700 1 -- 172.21.15.154:0/3056646707 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c8020070 con 0x7f41e00a10b0 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.120+0000 7f41d6ffd700 1 -- 172.21.15.154:0/3056646707 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8006540 con 0x7f41e00a10b0 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.120+0000 7f41e4f0f700 1 -- 172.21.15.154:0/3056646707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c8009430 con 0x7f41e00a10b0 2023-09-30T22:24:41.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.120+0000 7f41e4f0f700 1 -- 172.21.15.154:0/3056646707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e009a2c0 con 0x7f41e00a10b0 2023-09-30T22:24:41.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.121+0000 7f41d6ffd700 1 -- 172.21.15.154:0/3056646707 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41c8022030 con 0x7f41e00a10b0 2023-09-30T22:24:41.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.121+0000 7f41d6ffd700 1 -- 172.21.15.154:0/3056646707 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f41c8040c70 con 0x7f41e00a10b0 2023-09-30T22:24:41.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.121+0000 7f41e4f0f700 1 -- 172.21.15.154:0/3056646707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e011a590 con 0x7f41e00a10b0 2023-09-30T22:24:41.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.126+0000 7f41d6ffd700 1 -- 172.21.15.154:0/3056646707 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41c80247e0 con 0x7f41e00a10b0 2023-09-30T22:24:41.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.310+0000 7f41e4f0f700 1 -- 172.21.15.154:0/3056646707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f41e011f390 con 0x7f41e00a10b0 2023-09-30T22:24:41.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.310+0000 7f41d6ffd700 1 -- 172.21.15.154:0/3056646707 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41c801b410 con 0x7f41e00a10b0 2023-09-30T22:24:41.312 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:41.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.312+0000 7f41e4f0f700 1 -- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e00a10b0 msgr2=0x7f41e011d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.312+0000 7f41e4f0f700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e00a10b0 0x7f41e011d780 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f41e009a1c0 tx=0x7f41c8004750 comp rx=0 tx=0).stop 2023-09-30T22:24:41.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.312+0000 7f41e4f0f700 1 -- 172.21.15.154:0/3056646707 shutdown_connections 2023-09-30T22:24:41.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.312+0000 7f41e4f0f700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41e0134210 0x7f41e011e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.312+0000 7f41e4f0f700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41e00a10b0 0x7f41e011d780 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.312+0000 7f41e4f0f700 1 --2- 172.21.15.154:0/3056646707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41e0133900 0x7f41e011dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.312+0000 7f41e4f0f700 1 -- 172.21.15.154:0/3056646707 >> 172.21.15.154:0/3056646707 conn(0x7f41e00a2980 msgr2=0x7f41e01bab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.312+0000 7f41e4f0f700 1 -- 172.21.15.154:0/3056646707 shutdown_connections 2023-09-30T22:24:41.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.313+0000 7f41e4f0f700 1 -- 172.21.15.154:0/3056646707 wait complete. 2023-09-30T22:24:41.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:41.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:41.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:41.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:41.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.463+0000 7f30dcf5f700 1 Processor -- start 2023-09-30T22:24:41.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.463+0000 7f30dcf5f700 1 -- start start 2023-09-30T22:24:41.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30dcf5f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d809e870 0x7f30d809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30dcf5f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d8131f40 0x7f30d8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30dcf5f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d809c970 con 0x7f30d809f180 2023-09-30T22:24:41.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30dcf5f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80a0920 con 0x7f30d809e870 2023-09-30T22:24:41.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30dcf5f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30d809f9c0 con 0x7f30d8131f40 2023-09-30T22:24:41.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d8131f40 0x7f30d8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d809e870 0x7f30d809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d5d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f30d809f180 0x7f30d8131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41844/0 (socket says 172.21.15.154:41844) 2023-09-30T22:24:41.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d5d9b700 1 -- 172.21.15.154:0/3167470814 learned_addr learned my addr 172.21.15.154:0/3167470814 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d659c700 1 -- 172.21.15.154:0/3167470814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d8131f40 msgr2=0x7f30d8139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d559a700 1 -- 172.21.15.154:0/3167470814 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766920657 0 0) 0x7f30d809c970 con 0x7f30d809f180 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d659c700 1 --2- 172.21.15.154:0/3167470814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d8131f40 0x7f30d8139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d659c700 1 -- 172.21.15.154:0/3167470814 >> v1:172.21.15.154:6789/0 conn(0x7f30d809f180 legacy=0x7f30d8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d659c700 1 -- 172.21.15.154:0/3167470814 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d809bab0 con 0x7f30d809e870 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d6d9d700 1 --2- 172.21.15.154:0/3167470814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d8131f40 0x7f30d8139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d659c700 1 --2- 172.21.15.154:0/3167470814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d809e870 0x7f30d809ec40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f30c800dc90 tx=0x7f30c800f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7511946fd647358 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.464+0000 7f30d559a700 1 -- 172.21.15.154:0/3167470814 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8012070 con 0x7f30d809e870 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30d559a700 1 -- 172.21.15.154:0/3167470814 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c800d2e0 con 0x7f30d809e870 2023-09-30T22:24:41.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30d559a700 1 -- 172.21.15.154:0/3167470814 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800f8f0 con 0x7f30d809e870 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30dcf5f700 1 -- 172.21.15.154:0/3167470814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d809e870 msgr2=0x7f30d809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30dcf5f700 1 --2- 172.21.15.154:0/3167470814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d809e870 0x7f30d809ec40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f30c800dc90 tx=0x7f30c800f050 comp rx=0 tx=0).stop 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30dcf5f700 1 -- 172.21.15.154:0/3167470814 shutdown_connections 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30dcf5f700 1 --2- 172.21.15.154:0/3167470814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d8131f40 0x7f30d8139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30dcf5f700 1 --2- 172.21.15.154:0/3167470814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d809e870 0x7f30d809ec40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30dcf5f700 1 -- 172.21.15.154:0/3167470814 >> 172.21.15.154:0/3167470814 conn(0x7f30d80a4430 msgr2=0x7f30d80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30dcf5f700 1 -- 172.21.15.154:0/3167470814 shutdown_connections 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.465+0000 7f30dcf5f700 1 -- 172.21.15.154:0/3167470814 wait complete. 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30dcf5f700 1 Processor -- start 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30dcf5f700 1 -- start start 2023-09-30T22:24:41.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30dcf5f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d809e870 0x7f30d811be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30dcf5f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d809f180 0x7f30d811c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30dcf5f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d8131f40 0x7f30d811c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30dcf5f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d811e0c0 con 0x7f30d809f180 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30dcf5f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d811f9a0 con 0x7f30d8131f40 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30dcf5f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30d8120340 con 0x7f30d809e870 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d809e870 0x7f30d811be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d6d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d8131f40 0x7f30d811c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d809e870 0x7f30d811be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45906/0 (socket says 172.21.15.154:45906) 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d659c700 1 -- 172.21.15.154:0/810373683 learned_addr learned my addr 172.21.15.154:0/810373683 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d5d9b700 1 --2- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d809f180 0x7f30d811c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d659c700 1 -- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d8131f40 msgr2=0x7f30d811c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d659c700 1 --2- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d8131f40 0x7f30d811c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d659c700 1 -- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d809f180 msgr2=0x7f30d811c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d659c700 1 --2- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d809f180 0x7f30d811c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.467+0000 7f30d659c700 1 -- 172.21.15.154:0/810373683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d0009a70 con 0x7f30d809e870 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.468+0000 7f30d6d9d700 1 --2- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d8131f40 0x7f30d811c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.468+0000 7f30d659c700 1 --2- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d809e870 0x7f30d811be80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f30d809c8a0 tx=0x7f30c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.468+0000 7f30c6ffd700 1 -- 172.21.15.154:0/810373683 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8010df0 con 0x7f30d809e870 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.468+0000 7f30dcf5f700 1 -- 172.21.15.154:0/810373683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c800d940 con 0x7f30d809e870 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.468+0000 7f30c6ffd700 1 -- 172.21.15.154:0/810373683 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c80036a0 con 0x7f30d809e870 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.468+0000 7f30c6ffd700 1 -- 172.21.15.154:0/810373683 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8003a50 con 0x7f30d809e870 2023-09-30T22:24:41.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.468+0000 7f30dcf5f700 1 -- 172.21.15.154:0/810373683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d811ece0 con 0x7f30d809e870 2023-09-30T22:24:41.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.469+0000 7f30dcf5f700 1 -- 172.21.15.154:0/810373683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d811f360 con 0x7f30d809e870 2023-09-30T22:24:41.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.469+0000 7f30c6ffd700 1 -- 172.21.15.154:0/810373683 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30c8003bb0 con 0x7f30d809e870 2023-09-30T22:24:41.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.470+0000 7f30c6ffd700 1 -- 172.21.15.154:0/810373683 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f30c80446c0 con 0x7f30d809e870 2023-09-30T22:24:41.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.478+0000 7f30c6ffd700 1 -- 172.21.15.154:0/810373683 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30d811f360 con 0x7f30d809e870 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.554+0000 7f37f45d8700 1 Processor -- start 2023-09-30T22:24:41.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.554+0000 7f37f45d8700 1 -- start start 2023-09-30T22:24:41.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f45d8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f37ec0a1550 0x7f37ec138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f45d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec139200 0x7f37ec13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f45d8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec09e9d0 con 0x7f37ec0a0a70 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f45d8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ec09dc00 con 0x7f37ec0a1550 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f45d8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec09dec0 con 0x7f37ec139200 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f1b73700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f37ec0a1550 0x7f37ec138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f2b75700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec139200 0x7f37ec13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f1b73700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f37ec0a1550 0x7f37ec138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45574/0 (socket says 172.21.15.154:45574) 2023-09-30T22:24:41.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f2b75700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec139200 0x7f37ec13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36922/0 (socket says 172.21.15.154:36922) 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f1b73700 1 -- 172.21.15.154:0/43003854 learned_addr learned my addr 172.21.15.154:0/43003854 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f1b73700 1 -- 172.21.15.154:0/43003854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec139200 msgr2=0x7f37ec13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f1b73700 1 --2- 172.21.15.154:0/43003854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec139200 0x7f37ec13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f1b73700 1 -- 172.21.15.154:0/43003854 >> v1:172.21.15.154:6789/0 conn(0x7f37ec0a0a70 legacy=0x7f37ec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f1b73700 1 -- 172.21.15.154:0/43003854 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec09e6a0 con 0x7f37ec0a1550 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f2b75700 1 --2- 172.21.15.154:0/43003854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec139200 0x7f37ec13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.555+0000 7f37f1b73700 1 --2- 172.21.15.154:0/43003854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec0a1550 0x7f37ec138cc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f37dc0098f0 tx=0x7f37dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96bb006f437e688 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f1372700 1 -- 172.21.15.154:0/43003854 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc011830 con 0x7f37ec0a1550 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f1372700 1 -- 172.21.15.154:0/43003854 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc011990 con 0x7f37ec0a1550 2023-09-30T22:24:41.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f1372700 1 -- 172.21.15.154:0/43003854 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc011d20 con 0x7f37ec0a1550 2023-09-30T22:24:41.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f45d8700 1 -- 172.21.15.154:0/43003854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec0a1550 msgr2=0x7f37ec138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f45d8700 1 --2- 172.21.15.154:0/43003854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec0a1550 0x7f37ec138cc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f37dc0098f0 tx=0x7f37dc009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:41.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f45d8700 1 -- 172.21.15.154:0/43003854 shutdown_connections 2023-09-30T22:24:41.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f45d8700 1 --2- 172.21.15.154:0/43003854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec139200 0x7f37ec13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f45d8700 1 --2- 172.21.15.154:0/43003854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec0a1550 0x7f37ec138cc0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f45d8700 1 -- 172.21.15.154:0/43003854 >> 172.21.15.154:0/43003854 conn(0x7f37ec0a6610 msgr2=0x7f37ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.556+0000 7f37f45d8700 1 -- 172.21.15.154:0/43003854 shutdown_connections 2023-09-30T22:24:41.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.557+0000 7f37f45d8700 1 -- 172.21.15.154:0/43003854 wait complete. 2023-09-30T22:24:41.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.557+0000 7f37f45d8700 1 Processor -- start 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.557+0000 7f37f45d8700 1 -- start start 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f45d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec0a0a70 0x7f37ec11e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f45d8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37ec0a1550 0x7f37ec11ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f45d8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec139200 0x7f37ec11f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f45d8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec122070 con 0x7f37ec139200 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f45d8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec120440 con 0x7f37ec0a0a70 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f45d8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0a5290 con 0x7f37ec0a1550 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f1b73700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37ec0a1550 0x7f37ec11ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f2b75700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec139200 0x7f37ec11f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f2b75700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec139200 0x7f37ec11f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45578/0 (socket says 172.21.15.154:45578) 2023-09-30T22:24:41.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f2b75700 1 -- 172.21.15.154:0/909816326 learned_addr learned my addr 172.21.15.154:0/909816326 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f1b73700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37ec0a1550 0x7f37ec11ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45916/0 (socket says 172.21.15.154:45916) 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f2374700 1 --2- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec0a0a70 0x7f37ec11e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f2b75700 1 -- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37ec0a1550 msgr2=0x7f37ec11ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f2b75700 1 --2- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37ec0a1550 0x7f37ec11ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f2b75700 1 -- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec0a0a70 msgr2=0x7f37ec11e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f2b75700 1 --2- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec0a0a70 0x7f37ec11e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f2b75700 1 -- 172.21.15.154:0/909816326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4009a70 con 0x7f37ec139200 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.558+0000 7f37f1b73700 1 --2- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37ec0a1550 0x7f37ec11ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.559+0000 7f37f2b75700 1 --2- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec139200 0x7f37ec11f2b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f37e400efb0 tx=0x7f37e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.559+0000 7f37e2ffd700 1 -- 172.21.15.154:0/909816326 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400cc90 con 0x7f37ec139200 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.559+0000 7f37e2ffd700 1 -- 172.21.15.154:0/909816326 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e400f040 con 0x7f37ec139200 2023-09-30T22:24:41.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.559+0000 7f37f45d8700 1 -- 172.21.15.154:0/909816326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc009550 con 0x7f37ec139200 2023-09-30T22:24:41.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.559+0000 7f37e2ffd700 1 -- 172.21.15.154:0/909816326 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e4014480 con 0x7f37ec139200 2023-09-30T22:24:41.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.559+0000 7f37f45d8700 1 -- 172.21.15.154:0/909816326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ec121db0 con 0x7f37ec139200 2023-09-30T22:24:41.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.559+0000 7f37e2ffd700 1 -- 172.21.15.154:0/909816326 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37e40145e0 con 0x7f37ec139200 2023-09-30T22:24:41.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.560+0000 7f37e2ffd700 1 -- 172.21.15.154:0/909816326 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f37e4040570 con 0x7f37ec139200 2023-09-30T22:24:41.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.560+0000 7f37f45d8700 1 -- 172.21.15.154:0/909816326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ec04f2a0 con 0x7f37ec139200 2023-09-30T22:24:41.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.564+0000 7f37e2ffd700 1 -- 172.21.15.154:0/909816326 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37e4012930 con 0x7f37ec139200 2023-09-30T22:24:41.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.592+0000 7fd020144700 1 Processor -- start 2023-09-30T22:24:41.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.592+0000 7fd020144700 1 -- start start 2023-09-30T22:24:41.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd020144700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd020144700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd020144700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01809dc00 con 0x7fd018133f50 2023-09-30T22:24:41.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd020144700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01809ea60 con 0x7fd0180a1380 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd020144700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd01809dec0 con 0x7fd0180a0a70 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01dee0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01dee0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45932/0 (socket says 172.21.15.154:45932) 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01dee0700 1 -- 172.21.15.154:0/105260976 learned_addr learned my addr 172.21.15.154:0/105260976 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01e6e1700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd018133f50 0x7fd01813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41856/0 (socket says 172.21.15.154:41856) 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01d6df700 1 --2- 172.21.15.154:0/105260976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01cede700 1 -- 172.21.15.154:0/105260976 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889097315 0 0) 0x7fd01809dc00 con 0x7fd018133f50 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01cede700 1 -- 172.21.15.154:0/105260976 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0040035b0 con 0x7fd018133f50 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01dee0700 1 -- 172.21.15.154:0/105260976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0180a1380 msgr2=0x7fd018133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01dee0700 1 --2- 172.21.15.154:0/105260976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01dee0700 1 -- 172.21.15.154:0/105260976 >> v1:172.21.15.154:6789/0 conn(0x7fd018133f50 legacy=0x7fd01813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01dee0700 1 -- 172.21.15.154:0/105260976 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01809e6a0 con 0x7fd0180a0a70 2023-09-30T22:24:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.593+0000 7fd01dee0700 1 --2- 172.21.15.154:0/105260976 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd014009920 tx=0x7fd014009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea194ca69d8d1de4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd01cede700 1 -- 172.21.15.154:0/105260976 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014011830 con 0x7fd0180a0a70 2023-09-30T22:24:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd01cede700 1 -- 172.21.15.154:0/105260976 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014011990 con 0x7fd0180a0a70 2023-09-30T22:24:41.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd01cede700 1 -- 172.21.15.154:0/105260976 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014011d20 con 0x7fd0180a0a70 2023-09-30T22:24:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd020144700 1 -- 172.21.15.154:0/105260976 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a0a70 msgr2=0x7fd0180a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd020144700 1 --2- 172.21.15.154:0/105260976 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd014009920 tx=0x7fd014009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd020144700 1 -- 172.21.15.154:0/105260976 shutdown_connections 2023-09-30T22:24:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd020144700 1 --2- 172.21.15.154:0/105260976 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a0a70 0x7fd0180a0e40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd020144700 1 --2- 172.21.15.154:0/105260976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0180a1380 0x7fd018133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd020144700 1 -- 172.21.15.154:0/105260976 >> 172.21.15.154:0/105260976 conn(0x7fd0180a6610 msgr2=0x7fd0180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd020144700 1 -- 172.21.15.154:0/105260976 shutdown_connections 2023-09-30T22:24:41.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.594+0000 7fd020144700 1 -- 172.21.15.154:0/105260976 wait complete. 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.595+0000 7fd020144700 1 Processor -- start 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.595+0000 7fd020144700 1 -- start start 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd020144700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0180a0a70 0x7fd01811e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd020144700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a1380 0x7fd01811edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd020144700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd018133f50 0x7fd01811f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd020144700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018120c80 con 0x7fd0180a0a70 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd020144700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0181205a0 con 0x7fd018133f50 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd020144700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd018133810 con 0x7fd0180a1380 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01d6df700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a1380 0x7fd01811edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01d6df700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a1380 0x7fd01811edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45934/0 (socket says 172.21.15.154:45934) 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01d6df700 1 -- 172.21.15.154:0/1995953645 learned_addr learned my addr 172.21.15.154:0/1995953645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:41.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01dee0700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0180a0a70 0x7fd01811e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01e6e1700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd018133f50 0x7fd01811f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01d6df700 1 -- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd018133f50 msgr2=0x7fd01811f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01d6df700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd018133f50 0x7fd01811f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01d6df700 1 -- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0180a0a70 msgr2=0x7fd01811e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01d6df700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0180a0a70 0x7fd01811e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01d6df700 1 -- 172.21.15.154:0/1995953645 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd014009550 con 0x7fd0180a1380 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01e6e1700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd018133f50 0x7fd01811f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01dee0700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0180a0a70 0x7fd01811e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.596+0000 7fd01d6df700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a1380 0x7fd01811edc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd00800e9b0 tx=0x7fd00800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.597+0000 7fd00e7fc700 1 -- 172.21.15.154:0/1995953645 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008009710 con 0x7fd0180a1380 2023-09-30T22:24:41.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.597+0000 7fd00e7fc700 1 -- 172.21.15.154:0/1995953645 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00800c850 con 0x7fd0180a1380 2023-09-30T22:24:41.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.597+0000 7fd00e7fc700 1 -- 172.21.15.154:0/1995953645 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00800cbe0 con 0x7fd0180a1380 2023-09-30T22:24:41.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.597+0000 7fd020144700 1 -- 172.21.15.154:0/1995953645 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd018121e00 con 0x7fd0180a1380 2023-09-30T22:24:41.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.597+0000 7fd020144700 1 -- 172.21.15.154:0/1995953645 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0181209e0 con 0x7fd0180a1380 2023-09-30T22:24:41.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.598+0000 7fd00e7fc700 1 -- 172.21.15.154:0/1995953645 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd00800cd40 con 0x7fd0180a1380 2023-09-30T22:24:41.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.598+0000 7fd020144700 1 -- 172.21.15.154:0/1995953645 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01804f2a0 con 0x7fd0180a1380 2023-09-30T22:24:41.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.598+0000 7fd00e7fc700 1 -- 172.21.15.154:0/1995953645 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd00803f760 con 0x7fd0180a1380 2023-09-30T22:24:41.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.602+0000 7fd00e7fc700 1 -- 172.21.15.154:0/1995953645 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd00801bc50 con 0x7fd0180a1380 2023-09-30T22:24:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.679+0000 7f30dcf5f700 1 -- 172.21.15.154:0/810373683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f30d811f360 con 0x7f30d809e870 2023-09-30T22:24:41.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.680+0000 7f30c6ffd700 1 -- 172.21.15.154:0/810373683 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30d811f360 con 0x7f30d809e870 2023-09-30T22:24:41.681 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.682+0000 7f30dcf5f700 1 -- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d809e870 msgr2=0x7f30d811be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.682+0000 7f30dcf5f700 1 --2- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d809e870 0x7f30d811be80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f30d809c8a0 tx=0x7f30c8004750 comp rx=0 tx=0).stop 2023-09-30T22:24:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.682+0000 7f30dcf5f700 1 -- 172.21.15.154:0/810373683 shutdown_connections 2023-09-30T22:24:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.682+0000 7f30dcf5f700 1 --2- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30d8131f40 0x7f30d811c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.682+0000 7f30dcf5f700 1 --2- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30d809e870 0x7f30d811be80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.682+0000 7f30dcf5f700 1 --2- 172.21.15.154:0/810373683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30d809f180 0x7f30d811c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.682+0000 7f30dcf5f700 1 -- 172.21.15.154:0/810373683 >> 172.21.15.154:0/810373683 conn(0x7f30d80a4430 msgr2=0x7f30d8130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.682+0000 7f30dcf5f700 1 -- 172.21.15.154:0/810373683 shutdown_connections 2023-09-30T22:24:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.682+0000 7f30dcf5f700 1 -- 172.21.15.154:0/810373683 wait complete. 2023-09-30T22:24:41.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:41.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.760+0000 7f37f45d8700 1 -- 172.21.15.154:0/909816326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37ec120c00 con 0x7f37ec139200 2023-09-30T22:24:41.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.761+0000 7f37e2ffd700 1 -- 172.21.15.154:0/909816326 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37e402c090 con 0x7f37ec139200 2023-09-30T22:24:41.762 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.763+0000 7f37f45d8700 1 -- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec139200 msgr2=0x7f37ec11f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.763+0000 7f37f45d8700 1 --2- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec139200 0x7f37ec11f2b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f37e400efb0 tx=0x7f37e400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.763+0000 7f37f45d8700 1 -- 172.21.15.154:0/909816326 shutdown_connections 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.763+0000 7f37f45d8700 1 --2- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37ec139200 0x7f37ec11f2b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.763+0000 7f37f45d8700 1 --2- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37ec0a0a70 0x7f37ec11e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.763+0000 7f37f45d8700 1 --2- 172.21.15.154:0/909816326 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37ec0a1550 0x7f37ec11ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.763+0000 7f37f45d8700 1 -- 172.21.15.154:0/909816326 >> 172.21.15.154:0/909816326 conn(0x7f37ec0a6610 msgr2=0x7f37ec136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.763+0000 7f37f45d8700 1 -- 172.21.15.154:0/909816326 shutdown_connections 2023-09-30T22:24:41.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.763+0000 7f37f45d8700 1 -- 172.21.15.154:0/909816326 wait complete. 2023-09-30T22:24:41.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:41.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.799+0000 7fd020144700 1 -- 172.21.15.154:0/1995953645 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd018133d30 con 0x7fd0180a1380 2023-09-30T22:24:41.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.799+0000 7fd00e7fc700 1 -- 172.21.15.154:0/1995953645 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd00801ae40 con 0x7fd0180a1380 2023-09-30T22:24:41.800 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:41.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.802+0000 7fd020144700 1 -- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a1380 msgr2=0x7fd01811edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:41.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.802+0000 7fd020144700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a1380 0x7fd01811edc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd00800e9b0 tx=0x7fd00800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.802+0000 7fd020144700 1 -- 172.21.15.154:0/1995953645 shutdown_connections 2023-09-30T22:24:41.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.802+0000 7fd020144700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd018133f50 0x7fd01811f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.802+0000 7fd020144700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0180a0a70 0x7fd01811e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.802+0000 7fd020144700 1 --2- 172.21.15.154:0/1995953645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0180a1380 0x7fd01811edc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:41.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.802+0000 7fd020144700 1 -- 172.21.15.154:0/1995953645 >> 172.21.15.154:0/1995953645 conn(0x7fd0180a6610 msgr2=0x7fd0181b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:41.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.802+0000 7fd020144700 1 -- 172.21.15.154:0/1995953645 shutdown_connections 2023-09-30T22:24:41.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:41.802+0000 7fd020144700 1 -- 172.21.15.154:0/1995953645 wait complete. 2023-09-30T22:24:41.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:42.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.448+0000 7f7db8986700 1 Processor -- start 2023-09-30T22:24:42.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.448+0000 7f7db8986700 1 -- start start 2023-09-30T22:24:42.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db8986700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4099a60 0x7f7db41388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db8986700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7db4138e30 0x7f7db413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db8986700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db409aa00 con 0x7f7db4133b80 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db8986700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db409a080 con 0x7f7db4138e30 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db8986700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4133750 con 0x7f7db4099a60 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db2d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7db4138e30 0x7f7db413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4099a60 0x7f7db41388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db2d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7db4138e30 0x7f7db413b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45604/0 (socket says 172.21.15.154:45604) 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db2d9d700 1 -- 172.21.15.154:0/2876163923 learned_addr learned my addr 172.21.15.154:0/2876163923 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db1d9b700 1 -- 172.21.15.154:0/2876163923 >> v2:172.21.15.154:3300/0 conn(0x7f7db4138e30 msgr2=0x7f7db413b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:42.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db1d9b700 1 --2- 172.21.15.154:0/2876163923 >> v2:172.21.15.154:3300/0 conn(0x7f7db4138e30 0x7f7db413b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db1d9b700 1 -- 172.21.15.154:0/2876163923 >> v1:172.21.15.154:6789/0 conn(0x7f7db4133b80 legacy=0x7f7db4133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db1d9b700 1 -- 172.21.15.154:0/2876163923 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db409a760 con 0x7f7db4099a60 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db2d9d700 1 --2- 172.21.15.154:0/2876163923 >> v2:172.21.15.154:3300/0 conn(0x7f7db4138e30 0x7f7db413b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.449+0000 7f7db1d9b700 1 --2- 172.21.15.154:0/2876163923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4099a60 0x7f7db41388f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009840 tx=0x7f7d9c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc8388ed0d1a4e30 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db159a700 1 -- 172.21.15.154:0/2876163923 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c011830 con 0x7f7db4099a60 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db159a700 1 -- 172.21.15.154:0/2876163923 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c011990 con 0x7f7db4099a60 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db159a700 1 -- 172.21.15.154:0/2876163923 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c011d20 con 0x7f7db4099a60 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db8986700 1 -- 172.21.15.154:0/2876163923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4099a60 msgr2=0x7f7db41388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db8986700 1 --2- 172.21.15.154:0/2876163923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4099a60 0x7f7db41388f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009840 tx=0x7f7d9c009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:42.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db8986700 1 -- 172.21.15.154:0/2876163923 shutdown_connections 2023-09-30T22:24:42.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db8986700 1 --2- 172.21.15.154:0/2876163923 >> v2:172.21.15.154:3300/0 conn(0x7f7db4138e30 0x7f7db413b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db8986700 1 --2- 172.21.15.154:0/2876163923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4099a60 0x7f7db41388f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db8986700 1 -- 172.21.15.154:0/2876163923 >> 172.21.15.154:0/2876163923 conn(0x7f7db40a2980 msgr2=0x7f7db40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:42.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db8986700 1 -- 172.21.15.154:0/2876163923 shutdown_connections 2023-09-30T22:24:42.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.450+0000 7f7db8986700 1 -- 172.21.15.154:0/2876163923 wait complete. 2023-09-30T22:24:42.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.451+0000 7f7db8986700 1 Processor -- start 2023-09-30T22:24:42.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.451+0000 7f7db8986700 1 -- start start 2023-09-30T22:24:42.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db8986700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db4099a60 0x7f7db4118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db8986700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4133b80 0x7f7db4119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db8986700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7db4138e30 0x7f7db4119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db8986700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4132570 con 0x7f7db4099a60 2023-09-30T22:24:42.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db8986700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db409a2c0 con 0x7f7db4138e30 2023-09-30T22:24:42.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db8986700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7db411be30 con 0x7f7db4133b80 2023-09-30T22:24:42.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4133b80 0x7f7db4119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db4099a60 0x7f7db4118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4133b80 0x7f7db4119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45960/0 (socket says 172.21.15.154:45960) 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db1d9b700 1 -- 172.21.15.154:0/982108220 learned_addr learned my addr 172.21.15.154:0/982108220 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db2d9d700 1 --2- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7db4138e30 0x7f7db4119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db1d9b700 1 -- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7db4138e30 msgr2=0x7f7db4119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db1d9b700 1 --2- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7db4138e30 0x7f7db4119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db1d9b700 1 -- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db4099a60 msgr2=0x7f7db4118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db1d9b700 1 --2- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db4099a60 0x7f7db4118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db1d9b700 1 -- 172.21.15.154:0/982108220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da4009b30 con 0x7f7db4133b80 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db259c700 1 --2- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db4099a60 0x7f7db4118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:42.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.452+0000 7f7db1d9b700 1 --2- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4133b80 0x7f7db4119330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009fd0 tx=0x7f7d9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.453+0000 7f7daaffd700 1 -- 172.21.15.154:0/982108220 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0036a0 con 0x7f7db4133b80 2023-09-30T22:24:42.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.453+0000 7f7daaffd700 1 -- 172.21.15.154:0/982108220 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c01f070 con 0x7f7db4133b80 2023-09-30T22:24:42.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.453+0000 7f7db8986700 1 -- 172.21.15.154:0/982108220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c0094a0 con 0x7f7db4133b80 2023-09-30T22:24:42.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.453+0000 7f7daaffd700 1 -- 172.21.15.154:0/982108220 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c003a60 con 0x7f7db4133b80 2023-09-30T22:24:42.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.453+0000 7f7db8986700 1 -- 172.21.15.154:0/982108220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db411af80 con 0x7f7db4133b80 2023-09-30T22:24:42.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.453+0000 7f7daaffd700 1 -- 172.21.15.154:0/982108220 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d9c003bc0 con 0x7f7db4133b80 2023-09-30T22:24:42.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.454+0000 7f7daaffd700 1 -- 172.21.15.154:0/982108220 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d9c021070 con 0x7f7db4133b80 2023-09-30T22:24:42.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.454+0000 7f7db8986700 1 -- 172.21.15.154:0/982108220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db404f2a0 con 0x7f7db4133b80 2023-09-30T22:24:42.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.458+0000 7f7daaffd700 1 -- 172.21.15.154:0/982108220 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d9c040e60 con 0x7f7db4133b80 2023-09-30T22:24:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.643+0000 7f7db8986700 1 -- 172.21.15.154:0/982108220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7db406bce0 con 0x7f7db4133b80 2023-09-30T22:24:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.644+0000 7f7daaffd700 1 -- 172.21.15.154:0/982108220 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d9c02b080 con 0x7f7db4133b80 2023-09-30T22:24:42.645 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.645+0000 7f7db8986700 1 -- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4133b80 msgr2=0x7f7db4119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.645+0000 7f7db8986700 1 --2- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4133b80 0x7f7db4119330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009fd0 tx=0x7f7d9c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.645+0000 7f7db8986700 1 -- 172.21.15.154:0/982108220 shutdown_connections 2023-09-30T22:24:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.645+0000 7f7db8986700 1 --2- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7db4138e30 0x7f7db4119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.645+0000 7f7db8986700 1 --2- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db4099a60 0x7f7db4118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.645+0000 7f7db8986700 1 --2- 172.21.15.154:0/982108220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7db4133b80 0x7f7db4119330 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.646+0000 7f7db8986700 1 -- 172.21.15.154:0/982108220 >> 172.21.15.154:0/982108220 conn(0x7f7db40a2980 msgr2=0x7f7db409f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.646+0000 7f7db8986700 1 -- 172.21.15.154:0/982108220 shutdown_connections 2023-09-30T22:24:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.646+0000 7f7db8986700 1 -- 172.21.15.154:0/982108220 wait complete. 2023-09-30T22:24:42.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:42.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:42.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:42.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:42.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.821+0000 7f0fa544e700 1 Processor -- start 2023-09-30T22:24:42.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.821+0000 7f0fa544e700 1 -- start start 2023-09-30T22:24:42.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.821+0000 7f0fa544e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa00a0a70 0x7f0fa00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.821+0000 7f0fa544e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa0134120 0x7f0fa013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.821+0000 7f0fa544e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa009dc00 con 0x7f0fa00a1380 2023-09-30T22:24:42.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.821+0000 7f0fa544e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa009ea90 con 0x7f0fa00a0a70 2023-09-30T22:24:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.821+0000 7f0fa544e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa009dec0 con 0x7f0fa0134120 2023-09-30T22:24:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9e7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0fa00a1380 0x7f0fa0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41874/0 (socket says 172.21.15.154:41874) 2023-09-30T22:24:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa00a0a70 0x7f0fa00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9e7fc700 1 -- 172.21.15.154:0/4244792337 learned_addr learned my addr 172.21.15.154:0/4244792337 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9f7fe700 1 --2- 172.21.15.154:0/4244792337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa0134120 0x7f0fa013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9effd700 1 -- 172.21.15.154:0/4244792337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa0134120 msgr2=0x7f0fa013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9effd700 1 --2- 172.21.15.154:0/4244792337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa0134120 0x7f0fa013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9effd700 1 -- 172.21.15.154:0/4244792337 >> v1:172.21.15.154:6789/0 conn(0x7f0fa00a1380 legacy=0x7f0fa0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9effd700 1 -- 172.21.15.154:0/4244792337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa009e6a0 con 0x7f0fa00a0a70 2023-09-30T22:24:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9dffb700 1 -- 172.21.15.154:0/4244792337 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162916329 0 0) 0x7f0fa009dc00 con 0x7f0fa00a1380 2023-09-30T22:24:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9f7fe700 1 --2- 172.21.15.154:0/4244792337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa0134120 0x7f0fa013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9effd700 1 --2- 172.21.15.154:0/4244792337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa00a0a70 0x7f0fa00a0e40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009870 tx=0x7f0f90009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f66c8638c411c662 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9dffb700 1 -- 172.21.15.154:0/4244792337 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90011830 con 0x7f0fa00a0a70 2023-09-30T22:24:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9dffb700 1 -- 172.21.15.154:0/4244792337 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f90011990 con 0x7f0fa00a0a70 2023-09-30T22:24:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.822+0000 7f0f9dffb700 1 -- 172.21.15.154:0/4244792337 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90011d20 con 0x7f0fa00a0a70 2023-09-30T22:24:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.823+0000 7f0fa544e700 1 -- 172.21.15.154:0/4244792337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa00a0a70 msgr2=0x7f0fa00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.823+0000 7f0fa544e700 1 --2- 172.21.15.154:0/4244792337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa00a0a70 0x7f0fa00a0e40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009870 tx=0x7f0f90009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.823+0000 7f0fa544e700 1 -- 172.21.15.154:0/4244792337 shutdown_connections 2023-09-30T22:24:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.823+0000 7f0fa544e700 1 --2- 172.21.15.154:0/4244792337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa0134120 0x7f0fa013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.823+0000 7f0fa544e700 1 --2- 172.21.15.154:0/4244792337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa00a0a70 0x7f0fa00a0e40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.823+0000 7f0fa544e700 1 -- 172.21.15.154:0/4244792337 >> 172.21.15.154:0/4244792337 conn(0x7f0fa00a6610 msgr2=0x7f0fa00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.823+0000 7f0fa544e700 1 -- 172.21.15.154:0/4244792337 shutdown_connections 2023-09-30T22:24:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.823+0000 7f0fa544e700 1 -- 172.21.15.154:0/4244792337 wait complete. 2023-09-30T22:24:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.824+0000 7f0fa544e700 1 Processor -- start 2023-09-30T22:24:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.824+0000 7f0fa544e700 1 -- start start 2023-09-30T22:24:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0fa544e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fa00a0a70 0x7f0fa0122760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0fa544e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa00a1380 0x7f0fa0122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0fa544e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa0134120 0x7f0fa01231e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0fa544e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa0133330 con 0x7f0fa00a0a70 2023-09-30T22:24:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0fa544e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa0124370 con 0x7f0fa0134120 2023-09-30T22:24:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0fa544e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa0123bc0 con 0x7f0fa00a1380 2023-09-30T22:24:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa0134120 0x7f0fa01231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fa00a0a70 0x7f0fa0122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa0134120 0x7f0fa01231e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36990/0 (socket says 172.21.15.154:36990) 2023-09-30T22:24:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9f7fe700 1 -- 172.21.15.154:0/2396190673 learned_addr learned my addr 172.21.15.154:0/2396190673 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fa00a0a70 0x7f0fa0122760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45624/0 (socket says 172.21.15.154:45624) 2023-09-30T22:24:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9e7fc700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa00a1380 0x7f0fa0122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9f7fe700 1 -- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa00a1380 msgr2=0x7f0fa0122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9f7fe700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa00a1380 0x7f0fa0122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9f7fe700 1 -- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fa00a0a70 msgr2=0x7f0fa0122760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9f7fe700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fa00a0a70 0x7f0fa0122760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9f7fe700 1 -- 172.21.15.154:0/2396190673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900094a0 con 0x7f0fa0134120 2023-09-30T22:24:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9effd700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fa00a0a70 0x7f0fa0122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9e7fc700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa00a1380 0x7f0fa0122ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.825+0000 7f0f9f7fe700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa0134120 0x7f0fa01231e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f98007f20 tx=0x7f0f9800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.826+0000 7f0f877fe700 1 -- 172.21.15.154:0/2396190673 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800dd80 con 0x7f0fa0134120 2023-09-30T22:24:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.826+0000 7f0f877fe700 1 -- 172.21.15.154:0/2396190673 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9800f040 con 0x7f0fa0134120 2023-09-30T22:24:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.826+0000 7f0fa544e700 1 -- 172.21.15.154:0/2396190673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa0126280 con 0x7f0fa0134120 2023-09-30T22:24:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.826+0000 7f0f877fe700 1 -- 172.21.15.154:0/2396190673 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800dee0 con 0x7f0fa0134120 2023-09-30T22:24:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.826+0000 7f0fa544e700 1 -- 172.21.15.154:0/2396190673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa00a03e0 con 0x7f0fa0134120 2023-09-30T22:24:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.826+0000 7f0f877fe700 1 -- 172.21.15.154:0/2396190673 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f98003c60 con 0x7f0fa0134120 2023-09-30T22:24:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.827+0000 7f0f877fe700 1 -- 172.21.15.154:0/2396190673 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f9803f780 con 0x7f0fa0134120 2023-09-30T22:24:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.827+0000 7f0fa544e700 1 -- 172.21.15.154:0/2396190673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa0125bc0 con 0x7f0fa0134120 2023-09-30T22:24:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.832+0000 7f0f877fe700 1 -- 172.21.15.154:0/2396190673 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f9801e3b0 con 0x7f0fa0134120 2023-09-30T22:24:42.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.913+0000 7fe6adef2700 1 Processor -- start 2023-09-30T22:24:42.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.913+0000 7fe6adef2700 1 -- start start 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6adef2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a809f350 0x7fe6a8138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6adef2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe6a81393a0 0x7fe6a813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6adef2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a809fa00 con 0x7fe6a809e870 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6adef2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a80a0370 con 0x7fe6a81393a0 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6adef2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a806bec0 con 0x7fe6a809f350 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6a6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a809f350 0x7fe6a8138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6a6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a809f350 0x7fe6a8138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45980/0 (socket says 172.21.15.154:45980) 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6a6ffd700 1 -- 172.21.15.154:0/1845700167 learned_addr learned my addr 172.21.15.154:0/1845700167 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6a7fff700 1 --2- 172.21.15.154:0/1845700167 >> v2:172.21.15.154:3300/0 conn(0x7fe6a81393a0 0x7fe6a813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6a6ffd700 1 -- 172.21.15.154:0/1845700167 >> v2:172.21.15.154:3300/0 conn(0x7fe6a81393a0 msgr2=0x7fe6a813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:42.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6a6ffd700 1 --2- 172.21.15.154:0/1845700167 >> v2:172.21.15.154:3300/0 conn(0x7fe6a81393a0 0x7fe6a813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6a6ffd700 1 -- 172.21.15.154:0/1845700167 >> v1:172.21.15.154:6789/0 conn(0x7fe6a809e870 legacy=0x7fe6a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.914+0000 7fe6a6ffd700 1 -- 172.21.15.154:0/1845700167 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a809ada0 con 0x7fe6a809f350 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6a6ffd700 1 --2- 172.21.15.154:0/1845700167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a809f350 0x7fe6a8138e60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0098f0 tx=0x7fe69c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1493aa8d82f60c29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6a67fc700 1 -- 172.21.15.154:0/1845700167 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c011830 con 0x7fe6a809f350 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6a67fc700 1 -- 172.21.15.154:0/1845700167 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c011990 con 0x7fe6a809f350 2023-09-30T22:24:42.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6a67fc700 1 -- 172.21.15.154:0/1845700167 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c011d20 con 0x7fe6a809f350 2023-09-30T22:24:42.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6adef2700 1 -- 172.21.15.154:0/1845700167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a809f350 msgr2=0x7fe6a8138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6adef2700 1 --2- 172.21.15.154:0/1845700167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a809f350 0x7fe6a8138e60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe69c0098f0 tx=0x7fe69c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:42.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6adef2700 1 -- 172.21.15.154:0/1845700167 shutdown_connections 2023-09-30T22:24:42.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6adef2700 1 --2- 172.21.15.154:0/1845700167 >> v2:172.21.15.154:3300/0 conn(0x7fe6a81393a0 0x7fe6a813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6adef2700 1 --2- 172.21.15.154:0/1845700167 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a809f350 0x7fe6a8138e60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6adef2700 1 -- 172.21.15.154:0/1845700167 >> 172.21.15.154:0/1845700167 conn(0x7fe6a80a4430 msgr2=0x7fe6a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:42.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6adef2700 1 -- 172.21.15.154:0/1845700167 shutdown_connections 2023-09-30T22:24:42.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.915+0000 7fe6adef2700 1 -- 172.21.15.154:0/1845700167 wait complete. 2023-09-30T22:24:42.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.916+0000 7fe6adef2700 1 Processor -- start 2023-09-30T22:24:42.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.916+0000 7fe6adef2700 1 -- start start 2023-09-30T22:24:42.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6adef2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6a809e870 0x7fe6a811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6adef2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a809f350 0x7fe6a811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6adef2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a81393a0 0x7fe6a811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6adef2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a81222c0 con 0x7fe6a809f350 2023-09-30T22:24:42.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6adef2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a81207a0 con 0x7fe6a809e870 2023-09-30T22:24:42.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6adef2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a806f8f0 con 0x7fe6a81393a0 2023-09-30T22:24:42.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a809f350 0x7fe6a811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a809f350 0x7fe6a811f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45628/0 (socket says 172.21.15.154:45628) 2023-09-30T22:24:42.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a6ffd700 1 -- 172.21.15.154:0/2206285623 learned_addr learned my addr 172.21.15.154:0/2206285623 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a77fe700 1 --2- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6a809e870 0x7fe6a811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a7fff700 1 --2- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a81393a0 0x7fe6a811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a6ffd700 1 -- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a81393a0 msgr2=0x7fe6a811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a6ffd700 1 --2- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a81393a0 0x7fe6a811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a6ffd700 1 -- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6a809e870 msgr2=0x7fe6a811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a6ffd700 1 --2- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6a809e870 0x7fe6a811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.917+0000 7fe6a6ffd700 1 -- 172.21.15.154:0/2206285623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c009550 con 0x7fe6a809f350 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.918+0000 7fe6a6ffd700 1 --2- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a809f350 0x7fe6a811f010 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe69c000c00 tx=0x7fe69c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.918+0000 7fe68ffff700 1 -- 172.21.15.154:0/2206285623 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0036a0 con 0x7fe6a809f350 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.918+0000 7fe68ffff700 1 -- 172.21.15.154:0/2206285623 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c003800 con 0x7fe6a809f350 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.918+0000 7fe68ffff700 1 -- 172.21.15.154:0/2206285623 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c003bb0 con 0x7fe6a809f350 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.918+0000 7fe6adef2700 1 -- 172.21.15.154:0/2206285623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a806cfa0 con 0x7fe6a809f350 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.918+0000 7fe6adef2700 1 -- 172.21.15.154:0/2206285623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a8122d30 con 0x7fe6a809f350 2023-09-30T22:24:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.919+0000 7fe68ffff700 1 -- 172.21.15.154:0/2206285623 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe69c021070 con 0x7fe6a809f350 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.919+0000 7fe68ffff700 1 -- 172.21.15.154:0/2206285623 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe69c040c60 con 0x7fe6a809f350 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.919+0000 7fe6adef2700 1 -- 172.21.15.154:0/2206285623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a804f2a0 con 0x7fe6a809f350 2023-09-30T22:24:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.924+0000 7fe68ffff700 1 -- 172.21.15.154:0/2206285623 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe69c029020 con 0x7fe6a809f350 2023-09-30T22:24:42.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.956+0000 7f9262ccc700 1 Processor -- start 2023-09-30T22:24:42.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.956+0000 7f9262ccc700 1 -- start start 2023-09-30T22:24:42.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f9262ccc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c06a770 0x7f925c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f9262ccc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f925c09dec0 0x7f925c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f9262ccc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c06b5c0 con 0x7f925c131a00 2023-09-30T22:24:42.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f9262ccc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c06e900 con 0x7f925c09dec0 2023-09-30T22:24:42.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f9262ccc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c09d180 con 0x7f925c06a770 2023-09-30T22:24:42.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f9260a68700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c06a770 0x7f925c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f9260a68700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c06a770 0x7f925c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37012/0 (socket says 172.21.15.154:37012) 2023-09-30T22:24:42.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f9260a68700 1 -- 172.21.15.154:0/1402054869 learned_addr learned my addr 172.21.15.154:0/1402054869 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:42.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f925bfff700 1 --2- 172.21.15.154:0/1402054869 >> v2:172.21.15.154:3300/0 conn(0x7f925c09dec0 0x7f925c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f925bfff700 1 -- 172.21.15.154:0/1402054869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c06a770 msgr2=0x7f925c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:42.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f925bfff700 1 --2- 172.21.15.154:0/1402054869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c06a770 0x7f925c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f925bfff700 1 -- 172.21.15.154:0/1402054869 >> v1:172.21.15.154:6789/0 conn(0x7f925c131a00 legacy=0x7f925c131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f925b7fe700 1 -- 172.21.15.154:0/1402054869 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076539540 0 0) 0x7f925c06b5c0 con 0x7f925c131a00 2023-09-30T22:24:42.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f925bfff700 1 -- 172.21.15.154:0/1402054869 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c09e780 con 0x7f925c09dec0 2023-09-30T22:24:42.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f9260a68700 1 --2- 172.21.15.154:0/1402054869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c06a770 0x7f925c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:42.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.957+0000 7f925bfff700 1 --2- 172.21.15.154:0/1402054869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 0x7f925c06b080 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9248009840 tx=0x7f9248009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760f65c28187b311 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f925b7fe700 1 -- 172.21.15.154:0/1402054869 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248011830 con 0x7f925c09dec0 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f925b7fe700 1 -- 172.21.15.154:0/1402054869 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248011990 con 0x7f925c09dec0 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f925b7fe700 1 -- 172.21.15.154:0/1402054869 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248011d20 con 0x7f925c09dec0 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f9262ccc700 1 -- 172.21.15.154:0/1402054869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 msgr2=0x7f925c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f9262ccc700 1 --2- 172.21.15.154:0/1402054869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 0x7f925c06b080 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9248009840 tx=0x7f9248009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f9262ccc700 1 -- 172.21.15.154:0/1402054869 shutdown_connections 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f9262ccc700 1 --2- 172.21.15.154:0/1402054869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c06a770 0x7f925c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f9262ccc700 1 --2- 172.21.15.154:0/1402054869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 0x7f925c06b080 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f9262ccc700 1 -- 172.21.15.154:0/1402054869 >> 172.21.15.154:0/1402054869 conn(0x7f925c099c40 msgr2=0x7f925c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:42.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f9262ccc700 1 -- 172.21.15.154:0/1402054869 shutdown_connections 2023-09-30T22:24:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.958+0000 7f9262ccc700 1 -- 172.21.15.154:0/1402054869 wait complete. 2023-09-30T22:24:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.959+0000 7f9262ccc700 1 Processor -- start 2023-09-30T22:24:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f9262ccc700 1 -- start start 2023-09-30T22:24:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f9262ccc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f925c06a770 0x7f925c119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f9262ccc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 0x7f925c11a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f9262ccc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c131a00 0x7f925c11a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f9262ccc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c11d6d0 con 0x7f925c09dec0 2023-09-30T22:24:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f9262ccc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c11c7c0 con 0x7f925c131a00 2023-09-30T22:24:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f9262ccc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f925c130a10 con 0x7f925c06a770 2023-09-30T22:24:42.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f925bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 0x7f925c11a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f925bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 0x7f925c11a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45658/0 (socket says 172.21.15.154:45658) 2023-09-30T22:24:42.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f925bfff700 1 -- 172.21.15.154:0/1533736171 learned_addr learned my addr 172.21.15.154:0/1533736171 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:42.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.960+0000 7f9261269700 1 --2- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c131a00 0x7f925c11a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:42.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f925bfff700 1 -- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f925c06a770 msgr2=0x7f925c119db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f925bfff700 1 --2- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f925c06a770 0x7f925c119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f925bfff700 1 -- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c131a00 msgr2=0x7f925c11a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:42.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f925bfff700 1 --2- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c131a00 0x7f925c11a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f925bfff700 1 -- 172.21.15.154:0/1533736171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250009550 con 0x7f925c09dec0 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f925bfff700 1 --2- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 0x7f925c11a2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9248009fd0 tx=0x7f9248004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f92597fa700 1 -- 172.21.15.154:0/1533736171 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480036a0 con 0x7f925c09dec0 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f92597fa700 1 -- 172.21.15.154:0/1533736171 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924801f070 con 0x7f925c09dec0 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f92597fa700 1 -- 172.21.15.154:0/1533736171 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248003a20 con 0x7f925c09dec0 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f9262ccc700 1 -- 172.21.15.154:0/1533736171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92480094a0 con 0x7f925c09dec0 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.961+0000 7f9262ccc700 1 -- 172.21.15.154:0/1533736171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c071d30 con 0x7f925c09dec0 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.962+0000 7f92597fa700 1 -- 172.21.15.154:0/1533736171 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9248003b80 con 0x7f925c09dec0 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.962+0000 7f92597fa700 1 -- 172.21.15.154:0/1533736171 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9248021070 con 0x7f925c09dec0 2023-09-30T22:24:42.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.962+0000 7f9262ccc700 1 -- 172.21.15.154:0/1533736171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c04f2a0 con 0x7f925c09dec0 2023-09-30T22:24:42.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:42.967+0000 7f92597fa700 1 -- 172.21.15.154:0/1533736171 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9248015080 con 0x7f925c09dec0 2023-09-30T22:24:43.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.050+0000 7f0fa544e700 1 -- 172.21.15.154:0/2396190673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0fa004f2a0 con 0x7f0fa0134120 2023-09-30T22:24:43.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.051+0000 7f0f877fe700 1 -- 172.21.15.154:0/2396190673 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f9801a030 con 0x7f0fa0134120 2023-09-30T22:24:43.052 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:43.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.053+0000 7f0fa544e700 1 -- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa0134120 msgr2=0x7f0fa01231e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.053+0000 7f0fa544e700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa0134120 0x7f0fa01231e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f98007f20 tx=0x7f0f9800d3b0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.053+0000 7f0fa544e700 1 -- 172.21.15.154:0/2396190673 shutdown_connections 2023-09-30T22:24:43.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.053+0000 7f0fa544e700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fa0134120 0x7f0fa01231e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.053+0000 7f0fa544e700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fa00a0a70 0x7f0fa0122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.053+0000 7f0fa544e700 1 --2- 172.21.15.154:0/2396190673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0fa00a1380 0x7f0fa0122ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.053+0000 7f0fa544e700 1 -- 172.21.15.154:0/2396190673 >> 172.21.15.154:0/2396190673 conn(0x7f0fa00a6610 msgr2=0x7f0fa00a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.053+0000 7f0fa544e700 1 -- 172.21.15.154:0/2396190673 shutdown_connections 2023-09-30T22:24:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.053+0000 7f0fa544e700 1 -- 172.21.15.154:0/2396190673 wait complete. 2023-09-30T22:24:43.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:43.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.141+0000 7fe6adef2700 1 -- 172.21.15.154:0/2206285623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe6a8072d60 con 0x7fe6a809f350 2023-09-30T22:24:43.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.142+0000 7fe68ffff700 1 -- 172.21.15.154:0/2206285623 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe69c015070 con 0x7fe6a809f350 2023-09-30T22:24:43.143 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:43.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.143+0000 7fe6adef2700 1 -- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a809f350 msgr2=0x7fe6a811f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.143+0000 7fe6adef2700 1 --2- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a809f350 0x7fe6a811f010 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe69c000c00 tx=0x7fe69c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:43.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.144+0000 7fe6adef2700 1 -- 172.21.15.154:0/2206285623 shutdown_connections 2023-09-30T22:24:43.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.144+0000 7fe6adef2700 1 --2- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe6a81393a0 0x7fe6a811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.144+0000 7fe6adef2700 1 --2- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6a809e870 0x7fe6a811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.144+0000 7fe6adef2700 1 --2- 172.21.15.154:0/2206285623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a809f350 0x7fe6a811f010 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.144+0000 7fe6adef2700 1 -- 172.21.15.154:0/2206285623 >> 172.21.15.154:0/2206285623 conn(0x7fe6a80a4430 msgr2=0x7fe6a8138330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.144+0000 7fe6adef2700 1 -- 172.21.15.154:0/2206285623 shutdown_connections 2023-09-30T22:24:43.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.144+0000 7fe6adef2700 1 -- 172.21.15.154:0/2206285623 wait complete. 2023-09-30T22:24:43.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:43.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.161+0000 7f9262ccc700 1 -- 172.21.15.154:0/1533736171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f925c09e380 con 0x7f925c09dec0 2023-09-30T22:24:43.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.161+0000 7f92597fa700 1 -- 172.21.15.154:0/1533736171 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f924801a430 con 0x7f925c09dec0 2023-09-30T22:24:43.162 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:43.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.163+0000 7f9262ccc700 1 -- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 msgr2=0x7f925c11a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.163+0000 7f9262ccc700 1 --2- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 0x7f925c11a2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9248009fd0 tx=0x7f9248004750 comp rx=0 tx=0).stop 2023-09-30T22:24:43.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.164+0000 7f9262ccc700 1 -- 172.21.15.154:0/1533736171 shutdown_connections 2023-09-30T22:24:43.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.164+0000 7f9262ccc700 1 --2- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f925c131a00 0x7f925c11a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.164+0000 7f9262ccc700 1 --2- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f925c06a770 0x7f925c119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.164+0000 7f9262ccc700 1 --2- 172.21.15.154:0/1533736171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f925c09dec0 0x7f925c11a2f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.164+0000 7f9262ccc700 1 -- 172.21.15.154:0/1533736171 >> 172.21.15.154:0/1533736171 conn(0x7f925c099c40 msgr2=0x7f925c12ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.164+0000 7f9262ccc700 1 -- 172.21.15.154:0/1533736171 shutdown_connections 2023-09-30T22:24:43.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.164+0000 7f9262ccc700 1 -- 172.21.15.154:0/1533736171 wait complete. 2023-09-30T22:24:43.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:43.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:43.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.783+0000 7f5406827700 1 Processor -- start 2023-09-30T22:24:43.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.783+0000 7f5406827700 1 -- start start 2023-09-30T22:24:43.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f5406827700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5400133ad0 0x7f5400133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f5406827700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54001300a0 0x7f54001304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f5406827700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001309f0 0x7f540013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f5406827700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540006b2d0 con 0x7f54001300a0 2023-09-30T22:24:43.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f5406827700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5400133610 con 0x7f5400133ad0 2023-09-30T22:24:43.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f5406827700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f540009a500 con 0x7f54001309f0 2023-09-30T22:24:43.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53fffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5400133ad0 0x7f5400133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53ff7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54001300a0 0x7f54001304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f5404dc4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001309f0 0x7f540013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53ff7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54001300a0 0x7f54001304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45674/0 (socket says 172.21.15.154:45674) 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f5404dc4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001309f0 0x7f540013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45996/0 (socket says 172.21.15.154:45996) 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53fffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5400133ad0 0x7f5400133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37018/0 (socket says 172.21.15.154:37018) 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53ff7fe700 1 -- 172.21.15.154:0/2771301116 learned_addr learned my addr 172.21.15.154:0/2771301116 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53ff7fe700 1 -- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001309f0 msgr2=0x7f540013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53ff7fe700 1 --2- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001309f0 0x7f540013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53ff7fe700 1 -- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5400133ad0 msgr2=0x7f5400133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53ff7fe700 1 --2- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5400133ad0 0x7f5400133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53ff7fe700 1 -- 172.21.15.154:0/2771301116 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54001338b0 con 0x7f54001300a0 2023-09-30T22:24:43.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53fffff700 1 --2- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5400133ad0 0x7f5400133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53ff7fe700 1 --2- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54001300a0 0x7f54001304b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f53f00098f0 tx=0x7f53f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babff9be38504b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.784+0000 7f53feffd700 1 -- 172.21.15.154:0/2771301116 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0011830 con 0x7f54001300a0 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f53feffd700 1 -- 172.21.15.154:0/2771301116 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f0011990 con 0x7f54001300a0 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f53feffd700 1 -- 172.21.15.154:0/2771301116 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0011d20 con 0x7f54001300a0 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f5406827700 1 -- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54001300a0 msgr2=0x7f54001304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f5406827700 1 --2- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54001300a0 0x7f54001304b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f53f00098f0 tx=0x7f53f0009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f5406827700 1 -- 172.21.15.154:0/2771301116 shutdown_connections 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f5406827700 1 --2- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5400133ad0 0x7f5400133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f5406827700 1 --2- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001309f0 0x7f540013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f5406827700 1 --2- 172.21.15.154:0/2771301116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54001300a0 0x7f54001304b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f5406827700 1 -- 172.21.15.154:0/2771301116 >> 172.21.15.154:0/2771301116 conn(0x7f5400099c40 msgr2=0x7f54000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f5406827700 1 -- 172.21.15.154:0/2771301116 shutdown_connections 2023-09-30T22:24:43.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.785+0000 7f5406827700 1 -- 172.21.15.154:0/2771301116 wait complete. 2023-09-30T22:24:43.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.786+0000 7f5406827700 1 Processor -- start 2023-09-30T22:24:43.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.786+0000 7f5406827700 1 -- start start 2023-09-30T22:24:43.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5406827700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001300a0 0x7f540011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5406827700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54001309f0 0x7f540011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5406827700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400133ad0 0x7f540011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:43.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5406827700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540011f5b0 con 0x7f5400133ad0 2023-09-30T22:24:43.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5406827700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540012f800 con 0x7f54001309f0 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5406827700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f540012dd00 con 0x7f54001300a0 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53fffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001300a0 0x7f540011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54001309f0 0x7f540011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53fffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001300a0 0x7f540011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46002/0 (socket says 172.21.15.154:46002) 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53fffff700 1 -- 172.21.15.154:0/2359186732 learned_addr learned my addr 172.21.15.154:0/2359186732 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5404dc4700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400133ad0 0x7f540011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53ff7fe700 1 -- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001300a0 msgr2=0x7f540011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53ff7fe700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001300a0 0x7f540011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53ff7fe700 1 -- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400133ad0 msgr2=0x7f540011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53ff7fe700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400133ad0 0x7f540011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53ff7fe700 1 -- 172.21.15.154:0/2359186732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40094a0 con 0x7f54001309f0 2023-09-30T22:24:43.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53fffff700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001300a0 0x7f540011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5404dc4700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400133ad0 0x7f540011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53ff7fe700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54001309f0 0x7f540011df80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f540006e4e0 tx=0x7f53f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53fcff9700 1 -- 172.21.15.154:0/2359186732 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0004240 con 0x7f54001309f0 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53fcff9700 1 -- 172.21.15.154:0/2359186732 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f001f070 con 0x7f54001309f0 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5406827700 1 -- 172.21.15.154:0/2359186732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f0009550 con 0x7f54001309f0 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f53fcff9700 1 -- 172.21.15.154:0/2359186732 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f00036a0 con 0x7f54001309f0 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.787+0000 7f5406827700 1 -- 172.21.15.154:0/2359186732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540011f920 con 0x7f54001309f0 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.788+0000 7f53fcff9700 1 -- 172.21.15.154:0/2359186732 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53f0021030 con 0x7f54001309f0 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.788+0000 7f53fcff9700 1 -- 172.21.15.154:0/2359186732 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f53f00406f0 con 0x7f54001309f0 2023-09-30T22:24:43.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.788+0000 7f5406827700 1 -- 172.21.15.154:0/2359186732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540004f2a0 con 0x7f54001309f0 2023-09-30T22:24:43.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.793+0000 7f53fcff9700 1 -- 172.21.15.154:0/2359186732 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53f00199a0 con 0x7f54001309f0 2023-09-30T22:24:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.978+0000 7f5406827700 1 -- 172.21.15.154:0/2359186732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54000a2fc0 con 0x7f54001309f0 2023-09-30T22:24:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.978+0000 7f53fcff9700 1 -- 172.21.15.154:0/2359186732 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53f0015020 con 0x7f54001309f0 2023-09-30T22:24:43.979 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:43.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.980+0000 7f5406827700 1 -- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54001309f0 msgr2=0x7f540011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:43.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.980+0000 7f5406827700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54001309f0 0x7f540011df80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f540006e4e0 tx=0x7f53f0004750 comp rx=0 tx=0).stop 2023-09-30T22:24:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.980+0000 7f5406827700 1 -- 172.21.15.154:0/2359186732 shutdown_connections 2023-09-30T22:24:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.980+0000 7f5406827700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5400133ad0 0x7f540011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.980+0000 7f5406827700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54001300a0 0x7f540011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.980+0000 7f5406827700 1 --2- 172.21.15.154:0/2359186732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54001309f0 0x7f540011df80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.980+0000 7f5406827700 1 -- 172.21.15.154:0/2359186732 >> 172.21.15.154:0/2359186732 conn(0x7f5400099c40 msgr2=0x7f540012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.980+0000 7f5406827700 1 -- 172.21.15.154:0/2359186732 shutdown_connections 2023-09-30T22:24:43.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:43.981+0000 7f5406827700 1 -- 172.21.15.154:0/2359186732 wait complete. 2023-09-30T22:24:43.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:44.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:44.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:44.177 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:44.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.191+0000 7f2000d26700 1 Processor -- start 2023-09-30T22:24:44.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.191+0000 7f2000d26700 1 -- start start 2023-09-30T22:24:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.191+0000 7f2000d26700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ffc09a150 0x7f1ffc09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.191+0000 7f2000d26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.191+0000 7f2000d26700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc09af80 con 0x7f1ffc09edb0 2023-09-30T22:24:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.191+0000 7f2000d26700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc09a520 con 0x7f1ffc09a150 2023-09-30T22:24:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.191+0000 7f2000d26700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc09fe00 con 0x7f1ffc09f1a0 2023-09-30T22:24:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.191+0000 7f1ffa59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ffc09a150 0x7f1ffc09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.191+0000 7f1ffad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ffa59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ffc09a150 0x7f1ffc09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45682/0 (socket says 172.21.15.154:45682) 2023-09-30T22:24:44.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ffad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc134330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46018/0 (socket says 172.21.15.154:46018) 2023-09-30T22:24:44.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ffa59c700 1 -- 172.21.15.154:0/3632706697 learned_addr learned my addr 172.21.15.154:0/3632706697 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:44.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ff9d9b700 1 --1- 172.21.15.154:0/3632706697 >> v1:172.21.15.154:6789/0 conn(0x7f1ffc09edb0 0x7f1ffc133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41900/0 (socket says 172.21.15.154:41900) 2023-09-30T22:24:44.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ffad9d700 1 -- 172.21.15.154:0/3632706697 >> v2:172.21.15.154:3300/0 conn(0x7f1ffc09a150 msgr2=0x7f1ffc09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ffad9d700 1 --2- 172.21.15.154:0/3632706697 >> v2:172.21.15.154:3300/0 conn(0x7f1ffc09a150 0x7f1ffc09e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ffad9d700 1 -- 172.21.15.154:0/3632706697 >> v1:172.21.15.154:6789/0 conn(0x7f1ffc09edb0 legacy=0x7f1ffc133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ff959a700 1 -- 172.21.15.154:0/3632706697 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349454100 0 0) 0x7f1ffc09af80 con 0x7f1ffc09edb0 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ffad9d700 1 -- 172.21.15.154:0/3632706697 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc06bc20 con 0x7f1ffc09f1a0 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ffa59c700 1 --2- 172.21.15.154:0/3632706697 >> v2:172.21.15.154:3300/0 conn(0x7f1ffc09a150 0x7f1ffc09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ffad9d700 1 --2- 172.21.15.154:0/3632706697 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc134330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009dc0 tx=0x7f1ff400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=843959bc11817784 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ff959a700 1 -- 172.21.15.154:0/3632706697 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400e070 con 0x7f1ffc09f1a0 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ff959a700 1 -- 172.21.15.154:0/3632706697 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff400bae0 con 0x7f1ffc09f1a0 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.192+0000 7f1ff959a700 1 -- 172.21.15.154:0/3632706697 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400be90 con 0x7f1ffc09f1a0 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.193+0000 7f2000d26700 1 -- 172.21.15.154:0/3632706697 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 msgr2=0x7f1ffc134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.193+0000 7f2000d26700 1 --2- 172.21.15.154:0/3632706697 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc134330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009dc0 tx=0x7f1ff400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.193+0000 7f2000d26700 1 -- 172.21.15.154:0/3632706697 shutdown_connections 2023-09-30T22:24:44.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.193+0000 7f2000d26700 1 --2- 172.21.15.154:0/3632706697 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc134330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.193+0000 7f2000d26700 1 --2- 172.21.15.154:0/3632706697 >> v2:172.21.15.154:3300/0 conn(0x7f1ffc09a150 0x7f1ffc09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.193+0000 7f2000d26700 1 -- 172.21.15.154:0/3632706697 >> 172.21.15.154:0/3632706697 conn(0x7f1ffc0a4430 msgr2=0x7f1ffc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.193+0000 7f2000d26700 1 -- 172.21.15.154:0/3632706697 shutdown_connections 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.193+0000 7f2000d26700 1 -- 172.21.15.154:0/3632706697 wait complete. 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.194+0000 7f2000d26700 1 Processor -- start 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.194+0000 7f2000d26700 1 -- start start 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f2000d26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ffc09a150 0x7f1ffc1a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f2000d26700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc09edb0 0x7f1ffc1a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f2000d26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc1a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f2000d26700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc1a81d0 con 0x7f1ffc09edb0 2023-09-30T22:24:44.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f2000d26700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc1aa450 con 0x7f1ffc09a150 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f2000d26700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc1a9a90 con 0x7f1ffc09f1a0 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffa59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ffc09a150 0x7f1ffc1a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc1a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffa59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ffc09a150 0x7f1ffc1a5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37036/0 (socket says 172.21.15.154:37036) 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffa59c700 1 -- 172.21.15.154:0/4208904704 learned_addr learned my addr 172.21.15.154:0/4208904704 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc1a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46030/0 (socket says 172.21.15.154:46030) 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ff9d9b700 1 --2- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc09edb0 0x7f1ffc1a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffa59c700 1 -- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 msgr2=0x7f1ffc1a69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffa59c700 1 --2- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc1a69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffa59c700 1 -- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc09edb0 msgr2=0x7f1ffc1a64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffa59c700 1 --2- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc09edb0 0x7f1ffc1a64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffa59c700 1 -- 172.21.15.154:0/4208904704 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec009550 con 0x7f1ffc09a150 2023-09-30T22:24:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.195+0000 7f1ffa59c700 1 --2- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ffc09a150 0x7f1ffc1a5f70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00e9e0 tx=0x7f1fec00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.196+0000 7f1feaffd700 1 -- 172.21.15.154:0/4208904704 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00c850 con 0x7f1ffc09a150 2023-09-30T22:24:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.196+0000 7f1feaffd700 1 -- 172.21.15.154:0/4208904704 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec00c9b0 con 0x7f1ffc09a150 2023-09-30T22:24:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.196+0000 7f2000d26700 1 -- 172.21.15.154:0/4208904704 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff4009a70 con 0x7f1ffc09a150 2023-09-30T22:24:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.196+0000 7f1feaffd700 1 -- 172.21.15.154:0/4208904704 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00cd20 con 0x7f1ffc09a150 2023-09-30T22:24:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.196+0000 7f2000d26700 1 -- 172.21.15.154:0/4208904704 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc1a8dd0 con 0x7f1ffc09a150 2023-09-30T22:24:44.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.196+0000 7f1feaffd700 1 -- 172.21.15.154:0/4208904704 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fec013470 con 0x7f1ffc09a150 2023-09-30T22:24:44.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.197+0000 7f1feaffd700 1 -- 172.21.15.154:0/4208904704 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fec03fc00 con 0x7f1ffc09a150 2023-09-30T22:24:44.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.197+0000 7f2000d26700 1 -- 172.21.15.154:0/4208904704 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc09fa30 con 0x7f1ffc09a150 2023-09-30T22:24:44.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.201+0000 7f1feaffd700 1 -- 172.21.15.154:0/4208904704 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fec017080 con 0x7f1ffc09a150 2023-09-30T22:24:44.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.286+0000 7fc128014700 1 Processor -- start 2023-09-30T22:24:44.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.286+0000 7fc128014700 1 -- start start 2023-09-30T22:24:44.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc128014700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a0a70 0x7fc1200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc128014700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc120134120 0x7fc12013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc128014700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12009dc00 con 0x7fc1200a1380 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc128014700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12009ea60 con 0x7fc120134120 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc128014700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12009dec0 con 0x7fc1200a0a70 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc125db0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a0a70 0x7fc1200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc1255af700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc1200a1380 0x7fc120133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41910/0 (socket says 172.21.15.154:41910) 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc1255af700 1 -- 172.21.15.154:0/2801158839 learned_addr learned my addr 172.21.15.154:0/2801158839 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc1265b1700 1 --2- 172.21.15.154:0/2801158839 >> v2:172.21.15.154:3300/0 conn(0x7fc120134120 0x7fc12013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc124dae700 1 -- 172.21.15.154:0/2801158839 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345043852 0 0) 0x7fc12009dc00 con 0x7fc1200a1380 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc124dae700 1 -- 172.21.15.154:0/2801158839 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc10c0035b0 con 0x7fc1200a1380 2023-09-30T22:24:44.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc1265b1700 1 -- 172.21.15.154:0/2801158839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a0a70 msgr2=0x7fc1200a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc1265b1700 1 --2- 172.21.15.154:0/2801158839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a0a70 0x7fc1200a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc1265b1700 1 -- 172.21.15.154:0/2801158839 >> v1:172.21.15.154:6789/0 conn(0x7fc1200a1380 legacy=0x7fc120133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc1265b1700 1 -- 172.21.15.154:0/2801158839 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12009e6a0 con 0x7fc120134120 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc125db0700 1 --2- 172.21.15.154:0/2801158839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a0a70 0x7fc1200a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.287+0000 7fc1265b1700 1 --2- 172.21.15.154:0/2801158839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc120134120 0x7fc12013bce0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc118009d90 tx=0x7fc11800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678a34f0270bcfd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc124dae700 1 -- 172.21.15.154:0/2801158839 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800e070 con 0x7fc120134120 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc124dae700 1 -- 172.21.15.154:0/2801158839 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11800bb20 con 0x7fc120134120 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc124dae700 1 -- 172.21.15.154:0/2801158839 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118012430 con 0x7fc120134120 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc128014700 1 -- 172.21.15.154:0/2801158839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc120134120 msgr2=0x7fc12013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc128014700 1 --2- 172.21.15.154:0/2801158839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc120134120 0x7fc12013bce0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc118009d90 tx=0x7fc11800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc128014700 1 -- 172.21.15.154:0/2801158839 shutdown_connections 2023-09-30T22:24:44.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc128014700 1 --2- 172.21.15.154:0/2801158839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc120134120 0x7fc12013bce0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc128014700 1 --2- 172.21.15.154:0/2801158839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a0a70 0x7fc1200a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc128014700 1 -- 172.21.15.154:0/2801158839 >> 172.21.15.154:0/2801158839 conn(0x7fc1200a6610 msgr2=0x7fc1200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc128014700 1 -- 172.21.15.154:0/2801158839 shutdown_connections 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.288+0000 7fc128014700 1 -- 172.21.15.154:0/2801158839 wait complete. 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.289+0000 7fc128014700 1 Processor -- start 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.289+0000 7fc128014700 1 -- start start 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc128014700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1200a0a70 0x7fc120122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc128014700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a1380 0x7fc120122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc128014700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc120134120 0x7fc1201233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc128014700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc120124e10 con 0x7fc1200a0a70 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc128014700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc120133880 con 0x7fc1200a1380 2023-09-30T22:24:44.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc128014700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc120126170 con 0x7fc120134120 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc1255af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a1380 0x7fc120122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc1255af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a1380 0x7fc120122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37064/0 (socket says 172.21.15.154:37064) 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc1255af700 1 -- 172.21.15.154:0/1659624656 learned_addr learned my addr 172.21.15.154:0/1659624656 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc125db0700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1200a0a70 0x7fc120122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc1265b1700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc120134120 0x7fc1201233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc125db0700 1 -- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc120134120 msgr2=0x7fc1201233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc125db0700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc120134120 0x7fc1201233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc125db0700 1 -- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a1380 msgr2=0x7fc120122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc125db0700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a1380 0x7fc120122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc125db0700 1 -- 172.21.15.154:0/1659624656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0094a0 con 0x7fc1200a0a70 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc1265b1700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc120134120 0x7fc1201233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:44.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc1255af700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a1380 0x7fc120122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc125db0700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1200a0a70 0x7fc120122930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00e9e0 tx=0x7fc11c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc1167fc700 1 -- 172.21.15.154:0/1659624656 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00c850 con 0x7fc1200a0a70 2023-09-30T22:24:44.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc1167fc700 1 -- 172.21.15.154:0/1659624656 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00c9b0 con 0x7fc1200a0a70 2023-09-30T22:24:44.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.290+0000 7fc1167fc700 1 -- 172.21.15.154:0/1659624656 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00cd60 con 0x7fc1200a0a70 2023-09-30T22:24:44.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.291+0000 7fc128014700 1 -- 172.21.15.154:0/1659624656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc118009a70 con 0x7fc1200a0a70 2023-09-30T22:24:44.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.291+0000 7fc128014700 1 -- 172.21.15.154:0/1659624656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1200a03e0 con 0x7fc1200a0a70 2023-09-30T22:24:44.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.291+0000 7fc1167fc700 1 -- 172.21.15.154:0/1659624656 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc11c013470 con 0x7fc1200a0a70 2023-09-30T22:24:44.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.292+0000 7fc1167fc700 1 -- 172.21.15.154:0/1659624656 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc11c03f7a0 con 0x7fc1200a0a70 2023-09-30T22:24:44.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.292+0000 7fc128014700 1 -- 172.21.15.154:0/1659624656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1201263b0 con 0x7fc1200a0a70 2023-09-30T22:24:44.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.297+0000 7fc1167fc700 1 -- 172.21.15.154:0/1659624656 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc11c0232f0 con 0x7fc1200a0a70 2023-09-30T22:24:44.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.319+0000 7fb872c60700 1 Processor -- start 2023-09-30T22:24:44.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.319+0000 7fb872c60700 1 -- start start 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb872c60700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb86c0a0a70 0x7fb86c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb872c60700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c134120 0x7fb86c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb872c60700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c09dc00 con 0x7fb86c0a1380 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb872c60700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c09ea90 con 0x7fb86c0a0a70 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb872c60700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c09dec0 con 0x7fb86c134120 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8709fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb86c0a0a70 0x7fb86c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8709fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb86c0a0a70 0x7fb86c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45706/0 (socket says 172.21.15.154:45706) 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8709fc700 1 -- 172.21.15.154:0/938702977 learned_addr learned my addr 172.21.15.154:0/938702977 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8711fd700 1 --2- 172.21.15.154:0/938702977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c134120 0x7fb86c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8709fc700 1 -- 172.21.15.154:0/938702977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c134120 msgr2=0x7fb86c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:44.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8709fc700 1 --2- 172.21.15.154:0/938702977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c134120 0x7fb86c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8709fc700 1 -- 172.21.15.154:0/938702977 >> v1:172.21.15.154:6789/0 conn(0x7fb86c0a1380 legacy=0x7fb86c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8709fc700 1 -- 172.21.15.154:0/938702977 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c09e6a0 con 0x7fb86c0a0a70 2023-09-30T22:24:44.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8711fd700 1 --2- 172.21.15.154:0/938702977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c134120 0x7fb86c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb86b7fe700 1 -- 172.21.15.154:0/938702977 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201218638 0 0) 0x7fb86c09dc00 con 0x7fb86c0a1380 2023-09-30T22:24:44.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.320+0000 7fb8709fc700 1 --2- 172.21.15.154:0/938702977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a0a70 0x7fb86c0a0e40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb8600098f0 tx=0x7fb860009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea8e625ca9a6746 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb86b7fe700 1 -- 172.21.15.154:0/938702977 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860011830 con 0x7fb86c0a0a70 2023-09-30T22:24:44.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb86b7fe700 1 -- 172.21.15.154:0/938702977 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb860011990 con 0x7fb86c0a0a70 2023-09-30T22:24:44.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb86b7fe700 1 -- 172.21.15.154:0/938702977 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860011d20 con 0x7fb86c0a0a70 2023-09-30T22:24:44.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb872c60700 1 -- 172.21.15.154:0/938702977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a0a70 msgr2=0x7fb86c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb872c60700 1 --2- 172.21.15.154:0/938702977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a0a70 0x7fb86c0a0e40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb8600098f0 tx=0x7fb860009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb872c60700 1 -- 172.21.15.154:0/938702977 shutdown_connections 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb872c60700 1 --2- 172.21.15.154:0/938702977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c134120 0x7fb86c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb872c60700 1 --2- 172.21.15.154:0/938702977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a0a70 0x7fb86c0a0e40 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb872c60700 1 -- 172.21.15.154:0/938702977 >> 172.21.15.154:0/938702977 conn(0x7fb86c0a6610 msgr2=0x7fb86c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb872c60700 1 -- 172.21.15.154:0/938702977 shutdown_connections 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.321+0000 7fb872c60700 1 -- 172.21.15.154:0/938702977 wait complete. 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.322+0000 7fb872c60700 1 Processor -- start 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.322+0000 7fb872c60700 1 -- start start 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb872c60700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c0a0a70 0x7fb86c122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb872c60700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a1380 0x7fb86c122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb872c60700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb86c134120 0x7fb86c1233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb872c60700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c133aa0 con 0x7fb86c0a1380 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb872c60700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0a03e0 con 0x7fb86c0a0a70 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb872c60700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c125d30 con 0x7fb86c134120 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb86bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a1380 0x7fb86c122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb86bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a1380 0x7fb86c122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45714/0 (socket says 172.21.15.154:45714) 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb8709fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c0a0a70 0x7fb86c122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb86bfff700 1 -- 172.21.15.154:0/4016462776 learned_addr learned my addr 172.21.15.154:0/4016462776 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb8711fd700 1 --2- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb86c134120 0x7fb86c1233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb86bfff700 1 -- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb86c134120 msgr2=0x7fb86c1233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb86bfff700 1 --2- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb86c134120 0x7fb86c1233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb86bfff700 1 -- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c0a0a70 msgr2=0x7fb86c122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb86bfff700 1 --2- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c0a0a70 0x7fb86c122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb86bfff700 1 -- 172.21.15.154:0/4016462776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864009a70 con 0x7fb86c0a1380 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.323+0000 7fb8709fc700 1 --2- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c0a0a70 0x7fb86c122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.324+0000 7fb86bfff700 1 --2- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a1380 0x7fb86c122e80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb858001eb0 tx=0x7fb85800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.324+0000 7fb8697fa700 1 -- 172.21.15.154:0/4016462776 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580054e0 con 0x7fb86c0a1380 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.324+0000 7fb8697fa700 1 -- 172.21.15.154:0/4016462776 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858003680 con 0x7fb86c0a1380 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.324+0000 7fb872c60700 1 -- 172.21.15.154:0/4016462776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb860009550 con 0x7fb86c0a1380 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.324+0000 7fb8697fa700 1 -- 172.21.15.154:0/4016462776 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580039f0 con 0x7fb86c0a1380 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.324+0000 7fb872c60700 1 -- 172.21.15.154:0/4016462776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c126a60 con 0x7fb86c0a1380 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.324+0000 7fb8697fa700 1 -- 172.21.15.154:0/4016462776 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb858003b50 con 0x7fb86c0a1380 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.325+0000 7fb872c60700 1 -- 172.21.15.154:0/4016462776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c04f2a0 con 0x7fb86c0a1380 2023-09-30T22:24:44.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.325+0000 7fb8697fa700 1 -- 172.21.15.154:0/4016462776 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb85803ea10 con 0x7fb86c0a1380 2023-09-30T22:24:44.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.329+0000 7fb8697fa700 1 -- 172.21.15.154:0/4016462776 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb85801b730 con 0x7fb86c0a1380 2023-09-30T22:24:44.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.414+0000 7f2000d26700 1 -- 172.21.15.154:0/4208904704 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ffc04f2a0 con 0x7f1ffc09a150 2023-09-30T22:24:44.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.414+0000 7f1feaffd700 1 -- 172.21.15.154:0/4208904704 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fec021020 con 0x7f1ffc09a150 2023-09-30T22:24:44.415 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:44.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.416+0000 7f2000d26700 1 -- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ffc09a150 msgr2=0x7f1ffc1a5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.416+0000 7f2000d26700 1 --2- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ffc09a150 0x7f1ffc1a5f70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00e9e0 tx=0x7f1fec00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.416+0000 7f2000d26700 1 -- 172.21.15.154:0/4208904704 shutdown_connections 2023-09-30T22:24:44.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.416+0000 7f2000d26700 1 --2- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ffc09f1a0 0x7f1ffc1a69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.416+0000 7f2000d26700 1 --2- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ffc09a150 0x7f1ffc1a5f70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.416+0000 7f2000d26700 1 --2- 172.21.15.154:0/4208904704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ffc09edb0 0x7f1ffc1a64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.416+0000 7f2000d26700 1 -- 172.21.15.154:0/4208904704 >> 172.21.15.154:0/4208904704 conn(0x7f1ffc0a4430 msgr2=0x7f1ffc1bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.416+0000 7f2000d26700 1 -- 172.21.15.154:0/4208904704 shutdown_connections 2023-09-30T22:24:44.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.417+0000 7f2000d26700 1 -- 172.21.15.154:0/4208904704 wait complete. 2023-09-30T22:24:44.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.511+0000 7fc128014700 1 -- 172.21.15.154:0/1659624656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc12004f2a0 con 0x7fc1200a0a70 2023-09-30T22:24:44.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.511+0000 7fc1167fc700 1 -- 172.21.15.154:0/1659624656 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc11c021020 con 0x7fc1200a0a70 2023-09-30T22:24:44.513 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.514+0000 7fc128014700 1 -- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1200a0a70 msgr2=0x7fc120122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.514+0000 7fc128014700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1200a0a70 0x7fc120122930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00e9e0 tx=0x7fc11c00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.514+0000 7fc128014700 1 -- 172.21.15.154:0/1659624656 shutdown_connections 2023-09-30T22:24:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.514+0000 7fc128014700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc120134120 0x7fc1201233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.514+0000 7fc128014700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1200a0a70 0x7fc120122930 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.514+0000 7fc128014700 1 --2- 172.21.15.154:0/1659624656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1200a1380 0x7fc120122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.514+0000 7fc128014700 1 -- 172.21.15.154:0/1659624656 >> 172.21.15.154:0/1659624656 conn(0x7fc1200a6610 msgr2=0x7fc1200a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.514+0000 7fc128014700 1 -- 172.21.15.154:0/1659624656 shutdown_connections 2023-09-30T22:24:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.514+0000 7fc128014700 1 -- 172.21.15.154:0/1659624656 wait complete. 2023-09-30T22:24:44.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:44.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.531+0000 7fb872c60700 1 -- 172.21.15.154:0/4016462776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb86c072980 con 0x7fb86c0a1380 2023-09-30T22:24:44.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.531+0000 7fb8697fa700 1 -- 172.21.15.154:0/4016462776 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb858017070 con 0x7fb86c0a1380 2023-09-30T22:24:44.532 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:44.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.534+0000 7fb872c60700 1 -- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a1380 msgr2=0x7fb86c122e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:44.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.534+0000 7fb872c60700 1 --2- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a1380 0x7fb86c122e80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb858001eb0 tx=0x7fb85800c800 comp rx=0 tx=0).stop 2023-09-30T22:24:44.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.534+0000 7fb872c60700 1 -- 172.21.15.154:0/4016462776 shutdown_connections 2023-09-30T22:24:44.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.534+0000 7fb872c60700 1 --2- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb86c134120 0x7fb86c1233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.534+0000 7fb872c60700 1 --2- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb86c0a0a70 0x7fb86c122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.534+0000 7fb872c60700 1 --2- 172.21.15.154:0/4016462776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb86c0a1380 0x7fb86c122e80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:44.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.534+0000 7fb872c60700 1 -- 172.21.15.154:0/4016462776 >> 172.21.15.154:0/4016462776 conn(0x7fb86c0a6610 msgr2=0x7fb86c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:44.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.534+0000 7fb872c60700 1 -- 172.21.15.154:0/4016462776 shutdown_connections 2023-09-30T22:24:44.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:44.534+0000 7fb872c60700 1 -- 172.21.15.154:0/4016462776 wait complete. 2023-09-30T22:24:44.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:44.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:45.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.122+0000 7fa236da2700 1 Processor -- start 2023-09-30T22:24:45.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.122+0000 7fa236da2700 1 -- start start 2023-09-30T22:24:45.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa236da2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa23009e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa236da2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa23012cf70 0x7fa230130010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa236da2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23009aaa0 con 0x7fa230130550 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa236da2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23009bf30 con 0x7fa23012cf70 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa236da2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa23009a8e0 con 0x7fa23009bb60 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa235da0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa23009e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa23559f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa23012cf70 0x7fa230130010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa23559f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa23012cf70 0x7fa230130010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45726/0 (socket says 172.21.15.154:45726) 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa235da0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa23009e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46056/0 (socket says 172.21.15.154:46056) 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa23559f700 1 -- 172.21.15.154:0/3353848492 learned_addr learned my addr 172.21.15.154:0/3353848492 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa23559f700 1 -- 172.21.15.154:0/3353848492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 msgr2=0x7fa23009e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa23559f700 1 --2- 172.21.15.154:0/3353848492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa23009e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa23559f700 1 -- 172.21.15.154:0/3353848492 >> v1:172.21.15.154:6789/0 conn(0x7fa230130550 legacy=0x7fa2301373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa23559f700 1 -- 172.21.15.154:0/3353848492 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23012d450 con 0x7fa23012cf70 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa234d9e700 1 -- 172.21.15.154:0/3353848492 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964490402 0 0) 0x7fa23009aaa0 con 0x7fa230130550 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa235da0700 1 --2- 172.21.15.154:0/3353848492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa23009e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa23559f700 1 --2- 172.21.15.154:0/3353848492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa23012cf70 0x7fa230130010 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0098f0 tx=0x7fa22c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c90123ddb01761 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa234d9e700 1 -- 172.21.15.154:0/3353848492 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c011830 con 0x7fa23012cf70 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa234d9e700 1 -- 172.21.15.154:0/3353848492 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c011990 con 0x7fa23012cf70 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.123+0000 7fa234d9e700 1 -- 172.21.15.154:0/3353848492 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c011d20 con 0x7fa23012cf70 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.124+0000 7fa236da2700 1 -- 172.21.15.154:0/3353848492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa23012cf70 msgr2=0x7fa230130010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.124+0000 7fa236da2700 1 --2- 172.21.15.154:0/3353848492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa23012cf70 0x7fa230130010 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0098f0 tx=0x7fa22c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.124+0000 7fa236da2700 1 -- 172.21.15.154:0/3353848492 shutdown_connections 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.124+0000 7fa236da2700 1 --2- 172.21.15.154:0/3353848492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa23009e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.124+0000 7fa236da2700 1 --2- 172.21.15.154:0/3353848492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa23012cf70 0x7fa230130010 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.124+0000 7fa236da2700 1 -- 172.21.15.154:0/3353848492 >> 172.21.15.154:0/3353848492 conn(0x7fa2300a2d80 msgr2=0x7fa2300a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.124+0000 7fa236da2700 1 -- 172.21.15.154:0/3353848492 shutdown_connections 2023-09-30T22:24:45.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.124+0000 7fa236da2700 1 -- 172.21.15.154:0/3353848492 wait complete. 2023-09-30T22:24:45.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.125+0000 7fa236da2700 1 Processor -- start 2023-09-30T22:24:45.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.125+0000 7fa236da2700 1 -- start start 2023-09-30T22:24:45.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.125+0000 7fa236da2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa2301c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.125+0000 7fa236da2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa23012cf70 0x7fa2301c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.125+0000 7fa236da2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa230130550 0x7fa2301c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.125+0000 7fa236da2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23011fe10 con 0x7fa230130550 2023-09-30T22:24:45.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.125+0000 7fa236da2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23011d7e0 con 0x7fa23012cf70 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.125+0000 7fa236da2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa23012a6a0 con 0x7fa23009bb60 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa235da0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa2301c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa235da0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa2301c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46058/0 (socket says 172.21.15.154:46058) 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa235da0700 1 -- 172.21.15.154:0/1841154526 learned_addr learned my addr 172.21.15.154:0/1841154526 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa23559f700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa23012cf70 0x7fa2301c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa2365a1700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa230130550 0x7fa2301c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa235da0700 1 -- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa23012cf70 msgr2=0x7fa2301c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa235da0700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa23012cf70 0x7fa2301c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa235da0700 1 -- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa230130550 msgr2=0x7fa2301c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa235da0700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa230130550 0x7fa2301c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa235da0700 1 -- 172.21.15.154:0/1841154526 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22000b740 con 0x7fa23009bb60 2023-09-30T22:24:45.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa23559f700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa23012cf70 0x7fa2301c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa235da0700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa2301c8280 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa22000ed40 tx=0x7fa22000d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa2267fc700 1 -- 172.21.15.154:0/1841154526 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000dd90 con 0x7fa23009bb60 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa2267fc700 1 -- 172.21.15.154:0/1841154526 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa220010440 con 0x7fa23009bb60 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa236da2700 1 -- 172.21.15.154:0/1841154526 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c009550 con 0x7fa23009bb60 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa2267fc700 1 -- 172.21.15.154:0/1841154526 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200107b0 con 0x7fa23009bb60 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.126+0000 7fa236da2700 1 -- 172.21.15.154:0/1841154526 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23011ee50 con 0x7fa23009bb60 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.127+0000 7fa2267fc700 1 -- 172.21.15.154:0/1841154526 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa220010910 con 0x7fa23009bb60 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.127+0000 7fa2267fc700 1 -- 172.21.15.154:0/1841154526 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa22003fec0 con 0x7fa23009bb60 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.127+0000 7fa236da2700 1 -- 172.21.15.154:0/1841154526 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23004f2a0 con 0x7fa23009bb60 2023-09-30T22:24:45.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.132+0000 7fa2267fc700 1 -- 172.21.15.154:0/1841154526 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa220017be0 con 0x7fa23009bb60 2023-09-30T22:24:45.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.316+0000 7fa236da2700 1 -- 172.21.15.154:0/1841154526 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa23012c8d0 con 0x7fa23009bb60 2023-09-30T22:24:45.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.316+0000 7fa2267fc700 1 -- 172.21.15.154:0/1841154526 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2200177d0 con 0x7fa23009bb60 2023-09-30T22:24:45.317 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.318+0000 7fa236da2700 1 -- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 msgr2=0x7fa2301c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.318+0000 7fa236da2700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa2301c8280 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa22000ed40 tx=0x7fa22000d630 comp rx=0 tx=0).stop 2023-09-30T22:24:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.318+0000 7fa236da2700 1 -- 172.21.15.154:0/1841154526 shutdown_connections 2023-09-30T22:24:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.318+0000 7fa236da2700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa230130550 0x7fa2301c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.318+0000 7fa236da2700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa23009bb60 0x7fa2301c8280 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.318+0000 7fa236da2700 1 --2- 172.21.15.154:0/1841154526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa23012cf70 0x7fa2301c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.318+0000 7fa236da2700 1 -- 172.21.15.154:0/1841154526 >> 172.21.15.154:0/1841154526 conn(0x7fa2300a2d80 msgr2=0x7fa2300a11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.318+0000 7fa236da2700 1 -- 172.21.15.154:0/1841154526 shutdown_connections 2023-09-30T22:24:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.318+0000 7fa236da2700 1 -- 172.21.15.154:0/1841154526 wait complete. 2023-09-30T22:24:45.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:45.431 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:45.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:45.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.554+0000 7f91d2eb9700 1 Processor -- start 2023-09-30T22:24:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.554+0000 7f91d2eb9700 1 -- start start 2023-09-30T22:24:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d2eb9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91cc133ad0 0x7f91cc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d2eb9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1300a0 0x7f91cc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d2eb9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1309f0 0x7f91cc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d2eb9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc06b2d0 con 0x7f91cc133ad0 2023-09-30T22:24:45.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d2eb9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc133610 con 0x7f91cc1300a0 2023-09-30T22:24:45.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d2eb9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc09a500 con 0x7f91cc1309f0 2023-09-30T22:24:45.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91cbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1300a0 0x7f91cc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d0c55700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91cc133ad0 0x7f91cc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d1456700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1309f0 0x7f91cc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91cbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1300a0 0x7f91cc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40474/0 (socket says 172.21.15.154:40474) 2023-09-30T22:24:45.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91cbfff700 1 -- 172.21.15.154:0/1513584525 learned_addr learned my addr 172.21.15.154:0/1513584525 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:45.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d1456700 1 -- 172.21.15.154:0/1513584525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1300a0 msgr2=0x7f91cc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d1456700 1 --2- 172.21.15.154:0/1513584525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1300a0 0x7f91cc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d1456700 1 -- 172.21.15.154:0/1513584525 >> v2:172.21.15.154:3300/0 conn(0x7f91cc133ad0 msgr2=0x7f91cc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d1456700 1 --2- 172.21.15.154:0/1513584525 >> v2:172.21.15.154:3300/0 conn(0x7f91cc133ad0 0x7f91cc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d1456700 1 -- 172.21.15.154:0/1513584525 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc1338b0 con 0x7f91cc1309f0 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d0c55700 1 --2- 172.21.15.154:0/1513584525 >> v2:172.21.15.154:3300/0 conn(0x7f91cc133ad0 0x7f91cc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91cbfff700 1 --2- 172.21.15.154:0/1513584525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1300a0 0x7f91cc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91d1456700 1 --2- 172.21.15.154:0/1513584525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1309f0 0x7f91cc13a980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009d90 tx=0x7f91c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b75ff0a919ed8d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.555+0000 7f91cb7fe700 1 -- 172.21.15.154:0/1513584525 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c400e070 con 0x7f91cc1309f0 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91cb7fe700 1 -- 172.21.15.154:0/1513584525 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c400bb20 con 0x7f91cc1309f0 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91cb7fe700 1 -- 172.21.15.154:0/1513584525 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4012430 con 0x7f91cc1309f0 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91d2eb9700 1 -- 172.21.15.154:0/1513584525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1309f0 msgr2=0x7f91cc13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91d2eb9700 1 --2- 172.21.15.154:0/1513584525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1309f0 0x7f91cc13a980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009d90 tx=0x7f91c400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91d2eb9700 1 -- 172.21.15.154:0/1513584525 shutdown_connections 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91d2eb9700 1 --2- 172.21.15.154:0/1513584525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1309f0 0x7f91cc13a980 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91d2eb9700 1 --2- 172.21.15.154:0/1513584525 >> v2:172.21.15.154:3300/0 conn(0x7f91cc133ad0 0x7f91cc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91d2eb9700 1 --2- 172.21.15.154:0/1513584525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1300a0 0x7f91cc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91d2eb9700 1 -- 172.21.15.154:0/1513584525 >> 172.21.15.154:0/1513584525 conn(0x7f91cc099c40 msgr2=0x7f91cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91d2eb9700 1 -- 172.21.15.154:0/1513584525 shutdown_connections 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.556+0000 7f91d2eb9700 1 -- 172.21.15.154:0/1513584525 wait complete. 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.557+0000 7f91d2eb9700 1 Processor -- start 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.557+0000 7f91d2eb9700 1 -- start start 2023-09-30T22:24:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d2eb9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1300a0 0x7f91cc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d2eb9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1309f0 0x7f91cc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d2eb9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91cc133ad0 0x7f91cc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d2eb9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc12dd00 con 0x7f91cc133ad0 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d2eb9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc11fb50 con 0x7f91cc1309f0 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d2eb9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc120190 con 0x7f91cc1300a0 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d0c55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1300a0 0x7f91cc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d0c55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1300a0 0x7f91cc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54152/0 (socket says 172.21.15.154:54152) 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d0c55700 1 -- 172.21.15.154:0/2466190399 learned_addr learned my addr 172.21.15.154:0/2466190399 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d1456700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91cc133ad0 0x7f91cc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91cbfff700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1309f0 0x7f91cc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d1456700 1 -- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1300a0 msgr2=0x7f91cc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d1456700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1300a0 0x7f91cc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.558+0000 7f91d1456700 1 -- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1309f0 msgr2=0x7f91cc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91d1456700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1309f0 0x7f91cc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91d1456700 1 -- 172.21.15.154:0/2466190399 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8009550 con 0x7f91cc133ad0 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91d0c55700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1300a0 0x7f91cc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91cbfff700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1309f0 0x7f91cc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91d1456700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91cc133ad0 0x7f91cc11e4c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f91c4016000 tx=0x7f91c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91c97fa700 1 -- 172.21.15.154:0/2466190399 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4012430 con 0x7f91cc133ad0 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91c97fa700 1 -- 172.21.15.154:0/2466190399 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4020070 con 0x7f91cc133ad0 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91c97fa700 1 -- 172.21.15.154:0/2466190399 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4004280 con 0x7f91cc133ad0 2023-09-30T22:24:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91d2eb9700 1 -- 172.21.15.154:0/2466190399 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c00094a0 con 0x7f91cc133ad0 2023-09-30T22:24:45.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.559+0000 7f91d2eb9700 1 -- 172.21.15.154:0/2466190399 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c4009a70 con 0x7f91cc133ad0 2023-09-30T22:24:45.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.560+0000 7f91c97fa700 1 -- 172.21.15.154:0/2466190399 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91c40043e0 con 0x7f91cc133ad0 2023-09-30T22:24:45.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.560+0000 7f91c97fa700 1 -- 172.21.15.154:0/2466190399 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f91c4022070 con 0x7f91cc133ad0 2023-09-30T22:24:45.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.560+0000 7f91d2eb9700 1 -- 172.21.15.154:0/2466190399 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc09cb20 con 0x7f91cc133ad0 2023-09-30T22:24:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.565+0000 7f91c97fa700 1 -- 172.21.15.154:0/2466190399 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91c402c020 con 0x7f91cc133ad0 2023-09-30T22:24:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.656+0000 7f566bb06700 1 Processor -- start 2023-09-30T22:24:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.656+0000 7f566bb06700 1 -- start start 2023-09-30T22:24:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f566bb06700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f566409d860 0x7f566409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f566bb06700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f56641307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f566bb06700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566409aaa0 con 0x7f5664130ce0 2023-09-30T22:24:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f566bb06700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566409f870 con 0x7f566409d860 2023-09-30T22:24:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f566bb06700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f566409b360 con 0x7f566409e170 2023-09-30T22:24:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56690a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f56641307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56698a2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f566409d860 0x7f566409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56698a2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f566409d860 0x7f566409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52020/0 (socket says 172.21.15.154:52020) 2023-09-30T22:24:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56698a2700 1 -- 172.21.15.154:0/1669841662 learned_addr learned my addr 172.21.15.154:0/1669841662 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56690a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f56641307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54164/0 (socket says 172.21.15.154:54164) 2023-09-30T22:24:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56698a2700 1 -- 172.21.15.154:0/1669841662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 msgr2=0x7f56641307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56698a2700 1 --2- 172.21.15.154:0/1669841662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f56641307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56698a2700 1 -- 172.21.15.154:0/1669841662 >> v1:172.21.15.154:6789/0 conn(0x7f5664130ce0 legacy=0x7f56641379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56698a2700 1 -- 172.21.15.154:0/1669841662 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566409b620 con 0x7f566409d860 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.657+0000 7f56690a1700 1 --2- 172.21.15.154:0/1669841662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f56641307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f56698a2700 1 --2- 172.21.15.154:0/1669841662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 0x7f566409dc30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f56600098f0 tx=0x7f5660009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bc9030084cf1fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f56688a0700 1 -- 172.21.15.154:0/1669841662 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660011830 con 0x7f566409d860 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f56688a0700 1 -- 172.21.15.154:0/1669841662 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5660011990 con 0x7f566409d860 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f56688a0700 1 -- 172.21.15.154:0/1669841662 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660011d20 con 0x7f566409d860 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f566bb06700 1 -- 172.21.15.154:0/1669841662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 msgr2=0x7f566409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f566bb06700 1 --2- 172.21.15.154:0/1669841662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 0x7f566409dc30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f56600098f0 tx=0x7f5660009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f566bb06700 1 -- 172.21.15.154:0/1669841662 shutdown_connections 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f566bb06700 1 --2- 172.21.15.154:0/1669841662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 0x7f566409dc30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f566bb06700 1 --2- 172.21.15.154:0/1669841662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f56641307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.658+0000 7f566bb06700 1 -- 172.21.15.154:0/1669841662 >> 172.21.15.154:0/1669841662 conn(0x7f5664099c40 msgr2=0x7f56640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.659+0000 7f566bb06700 1 -- 172.21.15.154:0/1669841662 shutdown_connections 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.659+0000 7f566bb06700 1 -- 172.21.15.154:0/1669841662 wait complete. 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.659+0000 7f566bb06700 1 Processor -- start 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f566bb06700 1 -- start start 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f566bb06700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 0x7f566411e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f566bb06700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f566411ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f566bb06700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5664130ce0 0x7f566411f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f566bb06700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566411fb10 con 0x7f566409d860 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f566bb06700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56640720e0 con 0x7f5664130ce0 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f566bb06700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5664121ea0 con 0x7f566409e170 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f56690a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f566411ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f56690a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f566411ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54176/0 (socket says 172.21.15.154:54176) 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f56690a1700 1 -- 172.21.15.154:0/1494906189 learned_addr learned my addr 172.21.15.154:0/1494906189 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f56698a2700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 0x7f566411e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f566a0a3700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5664130ce0 0x7f566411f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f56690a1700 1 -- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5664130ce0 msgr2=0x7f566411f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f56690a1700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5664130ce0 0x7f566411f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f56690a1700 1 -- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 msgr2=0x7f566411e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f56690a1700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 0x7f566411e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.660+0000 7f56690a1700 1 -- 172.21.15.154:0/1494906189 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565400b740 con 0x7f566409e170 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.661+0000 7f56698a2700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 0x7f566411e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.661+0000 7f56690a1700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f566411ebf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5654010f80 tx=0x7f565400e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.661+0000 7f565a7fc700 1 -- 172.21.15.154:0/1494906189 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654011650 con 0x7f566409e170 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.661+0000 7f565a7fc700 1 -- 172.21.15.154:0/1494906189 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565400eed0 con 0x7f566409e170 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.661+0000 7f565a7fc700 1 -- 172.21.15.154:0/1494906189 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540119b0 con 0x7f566409e170 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.661+0000 7f566bb06700 1 -- 172.21.15.154:0/1494906189 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5660009550 con 0x7f566409e170 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.661+0000 7f566bb06700 1 -- 172.21.15.154:0/1494906189 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5664120a60 con 0x7f566409e170 2023-09-30T22:24:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.662+0000 7f565a7fc700 1 -- 172.21.15.154:0/1494906189 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5654011b10 con 0x7f566409e170 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.662+0000 7f566bb06700 1 -- 172.21.15.154:0/1494906189 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566404f2a0 con 0x7f566409e170 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.662+0000 7f565a7fc700 1 -- 172.21.15.154:0/1494906189 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5654042360 con 0x7f566409e170 2023-09-30T22:24:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.667+0000 7f565a7fc700 1 -- 172.21.15.154:0/1494906189 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5654017990 con 0x7f566409e170 2023-09-30T22:24:45.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.682+0000 7f12c8192700 1 Processor -- start 2023-09-30T22:24:45.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.682+0000 7f12c8192700 1 -- start start 2023-09-30T22:24:45.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c8192700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12c00a0a70 0x7f12c00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c8192700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c0134120 0x7f12c013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c8192700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c009dc00 con 0x7f12c00a1380 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c8192700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c009ea90 con 0x7f12c00a0a70 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c8192700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12c009dec0 con 0x7f12c0134120 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c5f2e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12c00a0a70 0x7f12c00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c672f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c0134120 0x7f12c013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c5f2e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12c00a0a70 0x7f12c00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52026/0 (socket says 172.21.15.154:52026) 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c672f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c0134120 0x7f12c013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54178/0 (socket says 172.21.15.154:54178) 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c5f2e700 1 -- 172.21.15.154:0/3935489765 learned_addr learned my addr 172.21.15.154:0/3935489765 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c5f2e700 1 -- 172.21.15.154:0/3935489765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c0134120 msgr2=0x7f12c013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c5f2e700 1 --2- 172.21.15.154:0/3935489765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c0134120 0x7f12c013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c5f2e700 1 -- 172.21.15.154:0/3935489765 >> v1:172.21.15.154:6789/0 conn(0x7f12c00a1380 legacy=0x7f12c0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c5f2e700 1 -- 172.21.15.154:0/3935489765 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c009e6a0 con 0x7f12c00a0a70 2023-09-30T22:24:45.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.683+0000 7f12c672f700 1 --2- 172.21.15.154:0/3935489765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c0134120 0x7f12c013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:45.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c5f2e700 1 --2- 172.21.15.154:0/3935489765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c00a0a70 0x7f12c00a0e40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0098f0 tx=0x7f12bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bad6952bd074fa1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c4f2c700 1 -- 172.21.15.154:0/3935489765 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc011830 con 0x7f12c00a0a70 2023-09-30T22:24:45.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c4f2c700 1 -- 172.21.15.154:0/3935489765 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc011990 con 0x7f12c00a0a70 2023-09-30T22:24:45.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c4f2c700 1 -- 172.21.15.154:0/3935489765 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc011d20 con 0x7f12c00a0a70 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c8192700 1 -- 172.21.15.154:0/3935489765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c00a0a70 msgr2=0x7f12c00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c8192700 1 --2- 172.21.15.154:0/3935489765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c00a0a70 0x7f12c00a0e40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0098f0 tx=0x7f12bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c8192700 1 -- 172.21.15.154:0/3935489765 shutdown_connections 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c8192700 1 --2- 172.21.15.154:0/3935489765 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c0134120 0x7f12c013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c8192700 1 --2- 172.21.15.154:0/3935489765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c00a0a70 0x7f12c00a0e40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.684+0000 7f12c8192700 1 -- 172.21.15.154:0/3935489765 >> 172.21.15.154:0/3935489765 conn(0x7f12c00a6610 msgr2=0x7f12c00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.685+0000 7f12c8192700 1 -- 172.21.15.154:0/3935489765 shutdown_connections 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.685+0000 7f12c8192700 1 -- 172.21.15.154:0/3935489765 wait complete. 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.685+0000 7f12c8192700 1 Processor -- start 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.685+0000 7f12c8192700 1 -- start start 2023-09-30T22:24:45.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c8192700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c00a0a70 0x7f12c0123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c8192700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12c00a1380 0x7f12c0123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c8192700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0134120 0x7f12c01c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c8192700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0133aa0 con 0x7f12c0134120 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c8192700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00a03e0 con 0x7f12c00a1380 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c8192700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0125300 con 0x7f12c00a0a70 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c5f2e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c00a0a70 0x7f12c0123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c5f2e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c00a0a70 0x7f12c0123350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54186/0 (socket says 172.21.15.154:54186) 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c5f2e700 1 -- 172.21.15.154:0/3315716401 learned_addr learned my addr 172.21.15.154:0/3315716401 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c672f700 1 --2- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0134120 0x7f12c01c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c672f700 1 -- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c00a0a70 msgr2=0x7f12c0123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c672f700 1 --2- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c00a0a70 0x7f12c0123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c672f700 1 -- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12c00a1380 msgr2=0x7f12c0123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c672f700 1 --2- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12c00a1380 0x7f12c0123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c672f700 1 -- 172.21.15.154:0/3315716401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8009a70 con 0x7f12c0134120 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.686+0000 7f12c672f700 1 --2- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0134120 0x7f12c01c8410 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f12b800efc0 tx=0x7f12b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.687+0000 7f12b67fc700 1 -- 172.21.15.154:0/3315716401 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800cb40 con 0x7f12c0134120 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.687+0000 7f12b67fc700 1 -- 172.21.15.154:0/3315716401 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b800f040 con 0x7f12c0134120 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.687+0000 7f12c8192700 1 -- 172.21.15.154:0/3315716401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc009550 con 0x7f12c0134120 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.687+0000 7f12b67fc700 1 -- 172.21.15.154:0/3315716401 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8003a20 con 0x7f12c0134120 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.687+0000 7f12c8192700 1 -- 172.21.15.154:0/3315716401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c0126d30 con 0x7f12c0134120 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.687+0000 7f12b67fc700 1 -- 172.21.15.154:0/3315716401 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12b8014480 con 0x7f12c0134120 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.688+0000 7f12b67fc700 1 -- 172.21.15.154:0/3315716401 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f12b803ff00 con 0x7f12c0134120 2023-09-30T22:24:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.688+0000 7f12c8192700 1 -- 172.21.15.154:0/3315716401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c009c8f0 con 0x7f12c0134120 2023-09-30T22:24:45.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.693+0000 7f12b67fc700 1 -- 172.21.15.154:0/3315716401 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12b8012930 con 0x7f12c0134120 2023-09-30T22:24:45.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.763+0000 7f91d2eb9700 1 -- 172.21.15.154:0/2466190399 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91cc04f2a0 con 0x7f91cc133ad0 2023-09-30T22:24:45.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.764+0000 7f91c97fa700 1 -- 172.21.15.154:0/2466190399 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91c4004690 con 0x7f91cc133ad0 2023-09-30T22:24:45.765 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:45.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.766+0000 7f91d2eb9700 1 -- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91cc133ad0 msgr2=0x7f91cc11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.766+0000 7f91d2eb9700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91cc133ad0 0x7f91cc11e4c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f91c4016000 tx=0x7f91c4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.766+0000 7f91d2eb9700 1 -- 172.21.15.154:0/2466190399 shutdown_connections 2023-09-30T22:24:45.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.766+0000 7f91d2eb9700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91cc133ad0 0x7f91cc11e4c0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.766+0000 7f91d2eb9700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f91cc1300a0 0x7f91cc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.766+0000 7f91d2eb9700 1 --2- 172.21.15.154:0/2466190399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91cc1309f0 0x7f91cc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.766+0000 7f91d2eb9700 1 -- 172.21.15.154:0/2466190399 >> 172.21.15.154:0/2466190399 conn(0x7f91cc099c40 msgr2=0x7f91cc132a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.766+0000 7f91d2eb9700 1 -- 172.21.15.154:0/2466190399 shutdown_connections 2023-09-30T22:24:45.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.766+0000 7f91d2eb9700 1 -- 172.21.15.154:0/2466190399 wait complete. 2023-09-30T22:24:45.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:45.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.862+0000 7f566bb06700 1 -- 172.21.15.154:0/1494906189 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f56641305c0 con 0x7f566409e170 2023-09-30T22:24:45.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.862+0000 7f565a7fc700 1 -- 172.21.15.154:0/1494906189 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5654017340 con 0x7f566409e170 2023-09-30T22:24:45.863 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:45.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.864+0000 7f566bb06700 1 -- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 msgr2=0x7f566411ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.864+0000 7f566bb06700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f566411ebf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5654010f80 tx=0x7f565400e640 comp rx=0 tx=0).stop 2023-09-30T22:24:45.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.864+0000 7f566bb06700 1 -- 172.21.15.154:0/1494906189 shutdown_connections 2023-09-30T22:24:45.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.864+0000 7f566bb06700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5664130ce0 0x7f566411f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.864+0000 7f566bb06700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566409d860 0x7f566411e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.864+0000 7f566bb06700 1 --2- 172.21.15.154:0/1494906189 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f566409e170 0x7f566411ebf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.864+0000 7f566bb06700 1 -- 172.21.15.154:0/1494906189 >> 172.21.15.154:0/1494906189 conn(0x7f5664099c40 msgr2=0x7f5664070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.864+0000 7f566bb06700 1 -- 172.21.15.154:0/1494906189 shutdown_connections 2023-09-30T22:24:45.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.864+0000 7f566bb06700 1 -- 172.21.15.154:0/1494906189 wait complete. 2023-09-30T22:24:45.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:45.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.885+0000 7f12c8192700 1 -- 172.21.15.154:0/3315716401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12c004f2a0 con 0x7f12c0134120 2023-09-30T22:24:45.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.885+0000 7f12b67fc700 1 -- 172.21.15.154:0/3315716401 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12b802b090 con 0x7f12c0134120 2023-09-30T22:24:45.886 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:45.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.887+0000 7f12c8192700 1 -- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0134120 msgr2=0x7f12c01c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:45.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.887+0000 7f12c8192700 1 --2- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0134120 0x7f12c01c8410 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f12b800efc0 tx=0x7f12b800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.887+0000 7f12c8192700 1 -- 172.21.15.154:0/3315716401 shutdown_connections 2023-09-30T22:24:45.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.887+0000 7f12c8192700 1 --2- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c0134120 0x7f12c01c8410 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.887+0000 7f12c8192700 1 --2- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12c00a0a70 0x7f12c0123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.887+0000 7f12c8192700 1 --2- 172.21.15.154:0/3315716401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12c00a1380 0x7f12c0123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:45.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.887+0000 7f12c8192700 1 -- 172.21.15.154:0/3315716401 >> 172.21.15.154:0/3315716401 conn(0x7f12c00a6610 msgr2=0x7f12c00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:45.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.887+0000 7f12c8192700 1 -- 172.21.15.154:0/3315716401 shutdown_connections 2023-09-30T22:24:45.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:45.887+0000 7f12c8192700 1 -- 172.21.15.154:0/3315716401 wait complete. 2023-09-30T22:24:45.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:46.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:46.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdda046c700 1 Processor -- start 2023-09-30T22:24:46.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdda046c700 1 -- start start 2023-09-30T22:24:46.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdda046c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd98133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdda046c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdda046c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9806b2d0 con 0x7fdd981300a0 2023-09-30T22:24:46.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdda046c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98133610 con 0x7fdd98133ad0 2023-09-30T22:24:46.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdda046c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9809a500 con 0x7fdd98130bc0 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdd9e208700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd98133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdd9ea09700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdd9e208700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd98133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40520/0 (socket says 172.21.15.154:40520) 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdd9ea09700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54198/0 (socket says 172.21.15.154:54198) 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdd9e208700 1 -- 172.21.15.154:0/2684013332 learned_addr learned my addr 172.21.15.154:0/2684013332 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.456+0000 7fdd9da07700 1 --1- 172.21.15.154:0/2684013332 >> v1:172.21.15.154:6789/0 conn(0x7fdd981300a0 0x7fdd981304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40318/0 (socket says 172.21.15.154:40318) 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9e208700 1 -- 172.21.15.154:0/2684013332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 msgr2=0x7fdd9813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9e208700 1 --2- 172.21.15.154:0/2684013332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9e208700 1 -- 172.21.15.154:0/2684013332 >> v1:172.21.15.154:6789/0 conn(0x7fdd981300a0 legacy=0x7fdd981304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9e208700 1 -- 172.21.15.154:0/2684013332 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd981338b0 con 0x7fdd98133ad0 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9d206700 1 -- 172.21.15.154:0/2684013332 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431808144 0 0) 0x7fdd9806b2d0 con 0x7fdd981300a0 2023-09-30T22:24:46.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9ea09700 1 --2- 172.21.15.154:0/2684013332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9e208700 1 --2- 172.21.15.154:0/2684013332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd98133ea0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009920 tx=0x7fdd94009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14fd80bf4a298d0a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9d206700 1 -- 172.21.15.154:0/2684013332 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94011830 con 0x7fdd98133ad0 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9d206700 1 -- 172.21.15.154:0/2684013332 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94011990 con 0x7fdd98133ad0 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.457+0000 7fdd9d206700 1 -- 172.21.15.154:0/2684013332 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94011d20 con 0x7fdd98133ad0 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.458+0000 7fdda046c700 1 -- 172.21.15.154:0/2684013332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 msgr2=0x7fdd98133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.458+0000 7fdda046c700 1 --2- 172.21.15.154:0/2684013332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd98133ea0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009920 tx=0x7fdd94009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.458+0000 7fdda046c700 1 -- 172.21.15.154:0/2684013332 shutdown_connections 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.458+0000 7fdda046c700 1 --2- 172.21.15.154:0/2684013332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.458+0000 7fdda046c700 1 --2- 172.21.15.154:0/2684013332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd98133ea0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.458+0000 7fdda046c700 1 -- 172.21.15.154:0/2684013332 >> 172.21.15.154:0/2684013332 conn(0x7fdd98099c40 msgr2=0x7fdd980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.458+0000 7fdda046c700 1 -- 172.21.15.154:0/2684013332 shutdown_connections 2023-09-30T22:24:46.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.458+0000 7fdda046c700 1 -- 172.21.15.154:0/2684013332 wait complete. 2023-09-30T22:24:46.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdda046c700 1 Processor -- start 2023-09-30T22:24:46.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdda046c700 1 -- start start 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdda046c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd981300a0 0x7fdd9811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdda046c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdda046c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd9811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdda046c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9811f080 con 0x7fdd981300a0 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdda046c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd981200c0 con 0x7fdd98133ad0 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdda046c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9811fb20 con 0x7fdd98130bc0 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9e208700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd981300a0 0x7fdd9811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9e208700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd981300a0 0x7fdd9811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52052/0 (socket says 172.21.15.154:52052) 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9e208700 1 -- 172.21.15.154:0/407949188 learned_addr learned my addr 172.21.15.154:0/407949188 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9da07700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9ea09700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd9811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9da07700 1 -- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 msgr2=0x7fdd9811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9da07700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd9811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9da07700 1 -- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd981300a0 msgr2=0x7fdd9811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9da07700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd981300a0 0x7fdd9811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9da07700 1 -- 172.21.15.154:0/407949188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd90009a70 con 0x7fdd98130bc0 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9e208700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd981300a0 0x7fdd9811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.459+0000 7fdd9ea09700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd9811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.460+0000 7fdd9da07700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9811df80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd9809ea20 tx=0x7fdd8800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.460+0000 7fdd8effd700 1 -- 172.21.15.154:0/407949188 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88004a70 con 0x7fdd98130bc0 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.460+0000 7fdd8effd700 1 -- 172.21.15.154:0/407949188 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd88004bd0 con 0x7fdd98130bc0 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.460+0000 7fdda046c700 1 -- 172.21.15.154:0/407949188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd94009550 con 0x7fdd98130bc0 2023-09-30T22:24:46.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.460+0000 7fdd8effd700 1 -- 172.21.15.154:0/407949188 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd880070d0 con 0x7fdd98130bc0 2023-09-30T22:24:46.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.460+0000 7fdda046c700 1 -- 172.21.15.154:0/407949188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9811f8a0 con 0x7fdd98130bc0 2023-09-30T22:24:46.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.460+0000 7fdd8effd700 1 -- 172.21.15.154:0/407949188 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd88007230 con 0x7fdd98130bc0 2023-09-30T22:24:46.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.461+0000 7fdd8effd700 1 -- 172.21.15.154:0/407949188 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdd8803f130 con 0x7fdd98130bc0 2023-09-30T22:24:46.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.461+0000 7fdda046c700 1 -- 172.21.15.154:0/407949188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9804f2a0 con 0x7fdd98130bc0 2023-09-30T22:24:46.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.465+0000 7fdd8effd700 1 -- 172.21.15.154:0/407949188 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd880074e0 con 0x7fdd98130bc0 2023-09-30T22:24:46.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.650+0000 7fdda046c700 1 -- 172.21.15.154:0/407949188 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdd9812d970 con 0x7fdd98130bc0 2023-09-30T22:24:46.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.651+0000 7fdd8effd700 1 -- 172.21.15.154:0/407949188 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd8801b340 con 0x7fdd98130bc0 2023-09-30T22:24:46.652 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:46.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.653+0000 7fdda046c700 1 -- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 msgr2=0x7fdd9811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.653+0000 7fdda046c700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9811df80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdd9809ea20 tx=0x7fdd8800c6a0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.653+0000 7fdda046c700 1 -- 172.21.15.154:0/407949188 shutdown_connections 2023-09-30T22:24:46.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.653+0000 7fdda046c700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd98133ad0 0x7fdd9811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.653+0000 7fdda046c700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd981300a0 0x7fdd9811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.653+0000 7fdda046c700 1 --2- 172.21.15.154:0/407949188 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd98130bc0 0x7fdd9811df80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.653+0000 7fdda046c700 1 -- 172.21.15.154:0/407949188 >> 172.21.15.154:0/407949188 conn(0x7fdd98099c40 msgr2=0x7fdd98132070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:46.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.653+0000 7fdda046c700 1 -- 172.21.15.154:0/407949188 shutdown_connections 2023-09-30T22:24:46.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.653+0000 7fdda046c700 1 -- 172.21.15.154:0/407949188 wait complete. 2023-09-30T22:24:46.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:46.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:46.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:46.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:46.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.905+0000 7f984b977700 1 Processor -- start 2023-09-30T22:24:46.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.905+0000 7f984b977700 1 -- start start 2023-09-30T22:24:46.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f984b977700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f984406a770 0x7f984406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f984b977700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984409dec0 0x7f984406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f984b977700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f9844131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f984b977700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984406b5c0 con 0x7f984406a770 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f984b977700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984406e900 con 0x7f9844131a00 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f984b977700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f984409d180 con 0x7f984409dec0 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849f14700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f9844131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849713700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f984406a770 0x7f984406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9848f12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984409dec0 0x7f984406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849f14700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f9844131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40530/0 (socket says 172.21.15.154:40530) 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849713700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f984406a770 0x7f984406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52054/0 (socket says 172.21.15.154:52054) 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849f14700 1 -- 172.21.15.154:0/3067906802 learned_addr learned my addr 172.21.15.154:0/3067906802 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:46.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849f14700 1 -- 172.21.15.154:0/3067906802 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984409dec0 msgr2=0x7f984406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:46.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849f14700 1 --2- 172.21.15.154:0/3067906802 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984409dec0 0x7f984406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849f14700 1 -- 172.21.15.154:0/3067906802 >> v2:172.21.15.154:3300/0 conn(0x7f984406a770 msgr2=0x7f984406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:46.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849f14700 1 --2- 172.21.15.154:0/3067906802 >> v2:172.21.15.154:3300/0 conn(0x7f984406a770 0x7f984406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849f14700 1 -- 172.21.15.154:0/3067906802 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984409e780 con 0x7f9844131a00 2023-09-30T22:24:46.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849713700 1 --2- 172.21.15.154:0/3067906802 >> v2:172.21.15.154:3300/0 conn(0x7f984406a770 0x7f984406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:46.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.906+0000 7f9849f14700 1 --2- 172.21.15.154:0/3067906802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f9844131e60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f983c009e50 tx=0x7f983c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74b4c2c03bea8d1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:46.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.909+0000 7f983bfff700 1 -- 172.21.15.154:0/3067906802 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c00e070 con 0x7f9844131a00 2023-09-30T22:24:46.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.909+0000 7f983bfff700 1 -- 172.21.15.154:0/3067906802 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c00b910 con 0x7f9844131a00 2023-09-30T22:24:46.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.909+0000 7f983bfff700 1 -- 172.21.15.154:0/3067906802 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c00bcc0 con 0x7f9844131a00 2023-09-30T22:24:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.910+0000 7f984b977700 1 -- 172.21.15.154:0/3067906802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 msgr2=0x7f9844131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.910+0000 7f984b977700 1 --2- 172.21.15.154:0/3067906802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f9844131e60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f983c009e50 tx=0x7f983c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.910+0000 7f984b977700 1 -- 172.21.15.154:0/3067906802 shutdown_connections 2023-09-30T22:24:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.910+0000 7f984b977700 1 --2- 172.21.15.154:0/3067906802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f9844131e60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.910+0000 7f984b977700 1 --2- 172.21.15.154:0/3067906802 >> v2:172.21.15.154:3300/0 conn(0x7f984406a770 0x7f984406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.910+0000 7f984b977700 1 --2- 172.21.15.154:0/3067906802 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984409dec0 0x7f984406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.910+0000 7f984b977700 1 -- 172.21.15.154:0/3067906802 >> 172.21.15.154:0/3067906802 conn(0x7f9844099c40 msgr2=0x7f98440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.914+0000 7f984b977700 1 -- 172.21.15.154:0/3067906802 shutdown_connections 2023-09-30T22:24:46.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.914+0000 7f984b977700 1 -- 172.21.15.154:0/3067906802 wait complete. 2023-09-30T22:24:46.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f984b977700 1 Processor -- start 2023-09-30T22:24:46.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f984b977700 1 -- start start 2023-09-30T22:24:46.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f984b977700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984406a770 0x7f9844119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f984b977700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f984409dec0 0x7f9844119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f984b977700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f984411a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:46.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f984b977700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984411d340 con 0x7f984409dec0 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f984b977700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984411c980 con 0x7f9844131a00 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f984b977700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f984411bcc0 con 0x7f984406a770 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f9849713700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984406a770 0x7f9844119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f9849713700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984406a770 0x7f9844119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54224/0 (socket says 172.21.15.154:54224) 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f9849713700 1 -- 172.21.15.154:0/3269071714 learned_addr learned my addr 172.21.15.154:0/3269071714 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f9848f12700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f984409dec0 0x7f9844119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.915+0000 7f9849f14700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f984411a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9848f12700 1 -- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984406a770 msgr2=0x7f9844119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9848f12700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984406a770 0x7f9844119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9848f12700 1 -- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 msgr2=0x7f984411a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9848f12700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f984411a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9848f12700 1 -- 172.21.15.154:0/3269071714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98400094a0 con 0x7f984409dec0 2023-09-30T22:24:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9849713700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984406a770 0x7f9844119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9848f12700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f984409dec0 0x7f9844119b70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f983400e900 tx=0x7f983400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9839ffb700 1 -- 172.21.15.154:0/3269071714 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400ee50 con 0x7f984409dec0 2023-09-30T22:24:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9839ffb700 1 -- 172.21.15.154:0/3269071714 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983400c850 con 0x7f984409dec0 2023-09-30T22:24:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f984b977700 1 -- 172.21.15.154:0/3269071714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c009b30 con 0x7f984409dec0 2023-09-30T22:24:46.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f9839ffb700 1 -- 172.21.15.154:0/3269071714 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400cbc0 con 0x7f984409dec0 2023-09-30T22:24:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.916+0000 7f984b977700 1 -- 172.21.15.154:0/3269071714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984411aa70 con 0x7f984409dec0 2023-09-30T22:24:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.917+0000 7f9839ffb700 1 -- 172.21.15.154:0/3269071714 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f983400cd20 con 0x7f984409dec0 2023-09-30T22:24:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.917+0000 7f9839ffb700 1 -- 172.21.15.154:0/3269071714 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f983403fa90 con 0x7f984409dec0 2023-09-30T22:24:46.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.918+0000 7f984b977700 1 -- 172.21.15.154:0/3269071714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984404f2a0 con 0x7f984409dec0 2023-09-30T22:24:46.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:46.923+0000 7f9839ffb700 1 -- 172.21.15.154:0/3269071714 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f983401ab10 con 0x7f984409dec0 2023-09-30T22:24:47.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.016+0000 7fa4012a7700 1 Processor -- start 2023-09-30T22:24:47.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.016+0000 7fa4012a7700 1 -- start start 2023-09-30T22:24:47.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.016+0000 7fa4012a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc0a0a70 0x7fa3fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa4012a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc134120 0x7fa3fc13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa4012a7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3fc09dc00 con 0x7fa3fc0a1380 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa4012a7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc09ea90 con 0x7fa3fc0a0a70 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa4012a7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc09dec0 con 0x7fa3fc134120 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3faffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc0a0a70 0x7fa3fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3faffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc0a0a70 0x7fa3fc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40544/0 (socket says 172.21.15.154:40544) 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3faffd700 1 -- 172.21.15.154:0/1270862282 learned_addr learned my addr 172.21.15.154:0/1270862282 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3fb7fe700 1 --2- 172.21.15.154:0/1270862282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc134120 0x7fa3fc13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3faffd700 1 -- 172.21.15.154:0/1270862282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc134120 msgr2=0x7fa3fc13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3faffd700 1 --2- 172.21.15.154:0/1270862282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc134120 0x7fa3fc13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3faffd700 1 -- 172.21.15.154:0/1270862282 >> v1:172.21.15.154:6789/0 conn(0x7fa3fc0a1380 legacy=0x7fa3fc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3faffd700 1 -- 172.21.15.154:0/1270862282 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc09e6a0 con 0x7fa3fc0a0a70 2023-09-30T22:24:47.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3f9ffb700 1 -- 172.21.15.154:0/1270862282 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569706836 0 0) 0x7fa3fc09dc00 con 0x7fa3fc0a1380 2023-09-30T22:24:47.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3fb7fe700 1 --2- 172.21.15.154:0/1270862282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc134120 0x7fa3fc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.017+0000 7fa3faffd700 1 --2- 172.21.15.154:0/1270862282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc0a0a70 0x7fa3fc0a0e40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009920 tx=0x7fa3ec009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f93fb787a7a6a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa3f9ffb700 1 -- 172.21.15.154:0/1270862282 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec011830 con 0x7fa3fc0a0a70 2023-09-30T22:24:47.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa3f9ffb700 1 -- 172.21.15.154:0/1270862282 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec011990 con 0x7fa3fc0a0a70 2023-09-30T22:24:47.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa3f9ffb700 1 -- 172.21.15.154:0/1270862282 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec011d20 con 0x7fa3fc0a0a70 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa4012a7700 1 -- 172.21.15.154:0/1270862282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc0a0a70 msgr2=0x7fa3fc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa4012a7700 1 --2- 172.21.15.154:0/1270862282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc0a0a70 0x7fa3fc0a0e40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009920 tx=0x7fa3ec009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa4012a7700 1 -- 172.21.15.154:0/1270862282 shutdown_connections 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa4012a7700 1 --2- 172.21.15.154:0/1270862282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc134120 0x7fa3fc13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa4012a7700 1 --2- 172.21.15.154:0/1270862282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc0a0a70 0x7fa3fc0a0e40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa4012a7700 1 -- 172.21.15.154:0/1270862282 >> 172.21.15.154:0/1270862282 conn(0x7fa3fc0a6610 msgr2=0x7fa3fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.018+0000 7fa4012a7700 1 -- 172.21.15.154:0/1270862282 shutdown_connections 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.019+0000 7fa4012a7700 1 -- 172.21.15.154:0/1270862282 wait complete. 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa4012a7700 1 Processor -- start 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa4012a7700 1 -- start start 2023-09-30T22:24:47.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa4012a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc0a0a70 0x7fa3fc06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa4012a7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3fc0a1380 0x7fa3fc06e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa4012a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc134120 0x7fa3fc06e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa4012a7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc06f7a0 con 0x7fa3fc0a1380 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa4012a7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc06f5b0 con 0x7fa3fc134120 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa4012a7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc06fe80 con 0x7fa3fc0a0a70 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa3fa7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3fc0a1380 0x7fa3fc06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa3fa7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3fc0a1380 0x7fa3fc06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52064/0 (socket says 172.21.15.154:52064) 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa3fa7fc700 1 -- 172.21.15.154:0/1122045706 learned_addr learned my addr 172.21.15.154:0/1122045706 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa3faffd700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc0a0a70 0x7fa3fc06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.020+0000 7fa3fb7fe700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc134120 0x7fa3fc06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3fa7fc700 1 -- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc0a0a70 msgr2=0x7fa3fc06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3fa7fc700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc0a0a70 0x7fa3fc06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3fa7fc700 1 -- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc134120 msgr2=0x7fa3fc06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3fa7fc700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc134120 0x7fa3fc06e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3fa7fc700 1 -- 172.21.15.154:0/1122045706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4009a70 con 0x7fa3fc0a1380 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3fb7fe700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc134120 0x7fa3fc06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3fa7fc700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3fc0a1380 0x7fa3fc06e000 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c550 tx=0x7fa3f000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3e37fe700 1 -- 172.21.15.154:0/1122045706 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00054e0 con 0x7fa3fc0a1380 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3e37fe700 1 -- 172.21.15.154:0/1122045706 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0003680 con 0x7fa3fc0a1380 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa4012a7700 1 -- 172.21.15.154:0/1122045706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec009550 con 0x7fa3fc0a1380 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa3e37fe700 1 -- 172.21.15.154:0/1122045706 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0003a30 con 0x7fa3fc0a1380 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.021+0000 7fa4012a7700 1 -- 172.21.15.154:0/1122045706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3fc0711e0 con 0x7fa3fc0a1380 2023-09-30T22:24:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.022+0000 7fa3e37fe700 1 -- 172.21.15.154:0/1122045706 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3f0003b90 con 0x7fa3fc0a1380 2023-09-30T22:24:47.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.022+0000 7fa4012a7700 1 -- 172.21.15.154:0/1122045706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3fc070e80 con 0x7fa3fc0a1380 2023-09-30T22:24:47.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.022+0000 7fa3e37fe700 1 -- 172.21.15.154:0/1122045706 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa3f003ea60 con 0x7fa3fc0a1380 2023-09-30T22:24:47.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.027+0000 7fa3e37fe700 1 -- 172.21.15.154:0/1122045706 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3fc070e80 con 0x7fa3fc0a1380 2023-09-30T22:24:47.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.036+0000 7f8f9dcd9700 1 Processor -- start 2023-09-30T22:24:47.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f9dcd9700 1 -- start start 2023-09-30T22:24:47.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f9dcd9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f98138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f9dcd9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 0x7f8f9813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f9dcd9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9809e9d0 con 0x7f8f980a0a70 2023-09-30T22:24:47.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f9dcd9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9809dc00 con 0x7f8f98139200 2023-09-30T22:24:47.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f9dcd9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9809dec0 con 0x7f8f980a1550 2023-09-30T22:24:47.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f96ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f98138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f96ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f98138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54258/0 (socket says 172.21.15.154:54258) 2023-09-30T22:24:47.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f96ffd700 1 -- 172.21.15.154:0/4122270339 learned_addr learned my addr 172.21.15.154:0/4122270339 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:47.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.037+0000 7f8f97fff700 1 --2- 172.21.15.154:0/4122270339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 0x7f8f9813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f96ffd700 1 -- 172.21.15.154:0/4122270339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 msgr2=0x7f8f9813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f96ffd700 1 --2- 172.21.15.154:0/4122270339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 0x7f8f9813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f96ffd700 1 -- 172.21.15.154:0/4122270339 >> v1:172.21.15.154:6789/0 conn(0x7f8f980a0a70 legacy=0x7f8f980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f967fc700 1 -- 172.21.15.154:0/4122270339 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756600684 0 0) 0x7f8f9809e9d0 con 0x7f8f980a0a70 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f96ffd700 1 -- 172.21.15.154:0/4122270339 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9809e6a0 con 0x7f8f980a1550 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f97fff700 1 --2- 172.21.15.154:0/4122270339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 0x7f8f9813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f96ffd700 1 --2- 172.21.15.154:0/4122270339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f98138cc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009920 tx=0x7f8f8c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa7a8ebb7e79f0c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f967fc700 1 -- 172.21.15.154:0/4122270339 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c011830 con 0x7f8f980a1550 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f967fc700 1 -- 172.21.15.154:0/4122270339 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c011990 con 0x7f8f980a1550 2023-09-30T22:24:47.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.038+0000 7f8f967fc700 1 -- 172.21.15.154:0/4122270339 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c011d20 con 0x7f8f980a1550 2023-09-30T22:24:47.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.039+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/4122270339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 msgr2=0x7f8f98138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.039+0000 7f8f9dcd9700 1 --2- 172.21.15.154:0/4122270339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f98138cc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009920 tx=0x7f8f8c009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:47.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.039+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/4122270339 shutdown_connections 2023-09-30T22:24:47.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.039+0000 7f8f9dcd9700 1 --2- 172.21.15.154:0/4122270339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 0x7f8f9813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.039+0000 7f8f9dcd9700 1 --2- 172.21.15.154:0/4122270339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f98138cc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.039+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/4122270339 >> 172.21.15.154:0/4122270339 conn(0x7f8f980a6610 msgr2=0x7f8f980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.039+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/4122270339 shutdown_connections 2023-09-30T22:24:47.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.039+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/4122270339 wait complete. 2023-09-30T22:24:47.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.040+0000 7f8f9dcd9700 1 Processor -- start 2023-09-30T22:24:47.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.040+0000 7f8f9dcd9700 1 -- start start 2023-09-30T22:24:47.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f9dcd9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f980a0a70 0x7f8f9811e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f9dcd9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f9811ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f9dcd9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 0x7f8f9811f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f9dcd9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98121a40 con 0x7f8f980a0a70 2023-09-30T22:24:47.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f9dcd9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98134000 con 0x7f8f98139200 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f9dcd9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98121f30 con 0x7f8f980a1550 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f977fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f980a0a70 0x7f8f9811e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f96ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f9811ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f977fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f980a0a70 0x7f8f9811e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52072/0 (socket says 172.21.15.154:52072) 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f977fe700 1 -- 172.21.15.154:0/1257220024 learned_addr learned my addr 172.21.15.154:0/1257220024 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.041+0000 7f8f97fff700 1 --2- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 0x7f8f9811f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f96ffd700 1 -- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 msgr2=0x7f8f9811f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f96ffd700 1 --2- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 0x7f8f9811f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f96ffd700 1 -- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f980a0a70 msgr2=0x7f8f9811e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f96ffd700 1 --2- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f980a0a70 0x7f8f9811e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f96ffd700 1 -- 172.21.15.154:0/1257220024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f900094a0 con 0x7f8f980a1550 2023-09-30T22:24:47.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f977fe700 1 --2- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f980a0a70 0x7f8f9811e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f96ffd700 1 --2- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f9811ecc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8f980a72d0 tx=0x7f8f8c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f7ffff700 1 -- 172.21.15.154:0/1257220024 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c004450 con 0x7f8f980a1550 2023-09-30T22:24:47.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f7ffff700 1 -- 172.21.15.154:0/1257220024 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c01f070 con 0x7f8f980a1550 2023-09-30T22:24:47.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/1257220024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c009550 con 0x7f8f980a1550 2023-09-30T22:24:47.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f7ffff700 1 -- 172.21.15.154:0/1257220024 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0038e0 con 0x7f8f980a1550 2023-09-30T22:24:47.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.042+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/1257220024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f98120ab0 con 0x7f8f980a1550 2023-09-30T22:24:47.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.043+0000 7f8f7ffff700 1 -- 172.21.15.154:0/1257220024 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f8c003a40 con 0x7f8f980a1550 2023-09-30T22:24:47.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.043+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/1257220024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9804f2a0 con 0x7f8f980a1550 2023-09-30T22:24:47.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.043+0000 7f8f7ffff700 1 -- 172.21.15.154:0/1257220024 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8f8c021070 con 0x7f8f980a1550 2023-09-30T22:24:47.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.052+0000 7f8f7ffff700 1 -- 172.21.15.154:0/1257220024 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f8c0045b0 con 0x7f8f980a1550 2023-09-30T22:24:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.134+0000 7f984b977700 1 -- 172.21.15.154:0/3269071714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f984409e380 con 0x7f984409dec0 2023-09-30T22:24:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.134+0000 7f9839ffb700 1 -- 172.21.15.154:0/3269071714 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9834017020 con 0x7f984409dec0 2023-09-30T22:24:47.135 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.136+0000 7f984b977700 1 -- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f984409dec0 msgr2=0x7f9844119b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.136+0000 7f984b977700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f984409dec0 0x7f9844119b70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f983400e900 tx=0x7f983400ec10 comp rx=0 tx=0).stop 2023-09-30T22:24:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.136+0000 7f984b977700 1 -- 172.21.15.154:0/3269071714 shutdown_connections 2023-09-30T22:24:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.136+0000 7f984b977700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9844131a00 0x7f984411a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.136+0000 7f984b977700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f984406a770 0x7f9844119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.136+0000 7f984b977700 1 --2- 172.21.15.154:0/3269071714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f984409dec0 0x7f9844119b70 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.136+0000 7f984b977700 1 -- 172.21.15.154:0/3269071714 >> 172.21.15.154:0/3269071714 conn(0x7f9844099c40 msgr2=0x7f984412f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.136+0000 7f984b977700 1 -- 172.21.15.154:0/3269071714 shutdown_connections 2023-09-30T22:24:47.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.136+0000 7f984b977700 1 -- 172.21.15.154:0/3269071714 wait complete. 2023-09-30T22:24:47.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:47.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.229+0000 7fa4012a7700 1 -- 172.21.15.154:0/1122045706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3fc070e80 con 0x7fa3fc0a1380 2023-09-30T22:24:47.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.229+0000 7fa3e37fe700 1 -- 172.21.15.154:0/1122045706 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3fc070e80 con 0x7fa3fc0a1380 2023-09-30T22:24:47.230 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.231+0000 7fa4012a7700 1 -- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3fc0a1380 msgr2=0x7fa3fc06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.231+0000 7fa4012a7700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3fc0a1380 0x7fa3fc06e000 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c550 tx=0x7fa3f000c860 comp rx=0 tx=0).stop 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.231+0000 7fa4012a7700 1 -- 172.21.15.154:0/1122045706 shutdown_connections 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.231+0000 7fa4012a7700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3fc134120 0x7fa3fc06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.231+0000 7fa4012a7700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3fc0a0a70 0x7fa3fc06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.231+0000 7fa4012a7700 1 --2- 172.21.15.154:0/1122045706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3fc0a1380 0x7fa3fc06e000 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.231+0000 7fa4012a7700 1 -- 172.21.15.154:0/1122045706 >> 172.21.15.154:0/1122045706 conn(0x7fa3fc0a6610 msgr2=0x7fa3fc0a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.231+0000 7fa4012a7700 1 -- 172.21.15.154:0/1122045706 shutdown_connections 2023-09-30T22:24:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.231+0000 7fa4012a7700 1 -- 172.21.15.154:0/1122045706 wait complete. 2023-09-30T22:24:47.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:47.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.245+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/1257220024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f98072980 con 0x7f8f980a1550 2023-09-30T22:24:47.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.245+0000 7f8f7ffff700 1 -- 172.21.15.154:0/1257220024 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f8c02b030 con 0x7f8f980a1550 2023-09-30T22:24:47.246 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:47.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.247+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 msgr2=0x7f8f9811ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.247+0000 7f8f9dcd9700 1 --2- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f9811ecc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8f980a72d0 tx=0x7f8f8c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:47.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.247+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/1257220024 shutdown_connections 2023-09-30T22:24:47.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.247+0000 7f8f9dcd9700 1 --2- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f98139200 0x7f8f9811f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.247+0000 7f8f9dcd9700 1 --2- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f980a0a70 0x7f8f9811e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.247+0000 7f8f9dcd9700 1 --2- 172.21.15.154:0/1257220024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f980a1550 0x7f8f9811ecc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.247+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/1257220024 >> 172.21.15.154:0/1257220024 conn(0x7f8f980a6610 msgr2=0x7f8f9809a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.248+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/1257220024 shutdown_connections 2023-09-30T22:24:47.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.248+0000 7f8f9dcd9700 1 -- 172.21.15.154:0/1257220024 wait complete. 2023-09-30T22:24:47.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:47.666 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f077f199700 1 Processor -- start 2023-09-30T22:24:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f077f199700 1 -- start start 2023-09-30T22:24:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f077f199700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f0778138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f077f199700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07781393a0 0x7f077813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f077f199700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077809fa00 con 0x7f077809e870 2023-09-30T22:24:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f077f199700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07780a0370 con 0x7f07781393a0 2023-09-30T22:24:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f077f199700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077806bec0 con 0x7f077809f350 2023-09-30T22:24:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f0777fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f0778138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f077d736700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07781393a0 0x7f077813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f0777fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f0778138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54278/0 (socket says 172.21.15.154:54278) 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f077d736700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07781393a0 0x7f077813b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52078/0 (socket says 172.21.15.154:52078) 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.792+0000 7f0777fff700 1 -- 172.21.15.154:0/2396539872 learned_addr learned my addr 172.21.15.154:0/2396539872 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f0777fff700 1 -- 172.21.15.154:0/2396539872 >> v2:172.21.15.154:3300/0 conn(0x7f07781393a0 msgr2=0x7f077813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f0777fff700 1 --2- 172.21.15.154:0/2396539872 >> v2:172.21.15.154:3300/0 conn(0x7f07781393a0 0x7f077813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f0777fff700 1 -- 172.21.15.154:0/2396539872 >> v1:172.21.15.154:6789/0 conn(0x7f077809e870 legacy=0x7f077809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f0777fff700 1 -- 172.21.15.154:0/2396539872 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077809ada0 con 0x7f077809f350 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f077d736700 1 --2- 172.21.15.154:0/2396539872 >> v2:172.21.15.154:3300/0 conn(0x7f07781393a0 0x7f077813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f0777fff700 1 --2- 172.21.15.154:0/2396539872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f0778138e60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07640098f0 tx=0x7f0764009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ff48f6e027136 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f07777fe700 1 -- 172.21.15.154:0/2396539872 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764011830 con 0x7f077809f350 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f07777fe700 1 -- 172.21.15.154:0/2396539872 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764011990 con 0x7f077809f350 2023-09-30T22:24:47.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f07777fe700 1 -- 172.21.15.154:0/2396539872 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764011d20 con 0x7f077809f350 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f077f199700 1 -- 172.21.15.154:0/2396539872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 msgr2=0x7f0778138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f077f199700 1 --2- 172.21.15.154:0/2396539872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f0778138e60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07640098f0 tx=0x7f0764009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f077f199700 1 -- 172.21.15.154:0/2396539872 shutdown_connections 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f077f199700 1 --2- 172.21.15.154:0/2396539872 >> v2:172.21.15.154:3300/0 conn(0x7f07781393a0 0x7f077813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f077f199700 1 --2- 172.21.15.154:0/2396539872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f0778138e60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f077f199700 1 -- 172.21.15.154:0/2396539872 >> 172.21.15.154:0/2396539872 conn(0x7f07780a4430 msgr2=0x7f07780a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f077f199700 1 -- 172.21.15.154:0/2396539872 shutdown_connections 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.793+0000 7f077f199700 1 -- 172.21.15.154:0/2396539872 wait complete. 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.794+0000 7f077f199700 1 Processor -- start 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.794+0000 7f077f199700 1 -- start start 2023-09-30T22:24:47.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077f199700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f077809e870 0x7f077811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077f199700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f077811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077f199700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07781393a0 0x7f077811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077f199700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0778134350 con 0x7f077809e870 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077f199700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0778122280 con 0x7f07781393a0 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077f199700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f077806cfa0 con 0x7f077809f350 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077cf35700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f077809e870 0x7f077811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f0777fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f077811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f0777fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f077811f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54280/0 (socket says 172.21.15.154:54280) 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077cf35700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f077809e870 0x7f077811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52088/0 (socket says 172.21.15.154:52088) 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f0777fff700 1 -- 172.21.15.154:0/1245004663 learned_addr learned my addr 172.21.15.154:0/1245004663 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077d736700 1 --2- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07781393a0 0x7f077811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:47.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f0777fff700 1 -- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07781393a0 msgr2=0x7f077811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f0777fff700 1 --2- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07781393a0 0x7f077811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f0777fff700 1 -- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f077809e870 msgr2=0x7f077811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f0777fff700 1 --2- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f077809e870 0x7f077811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f0777fff700 1 -- 172.21.15.154:0/1245004663 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770009a70 con 0x7f077809f350 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.795+0000 7f077cf35700 1 --2- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f077809e870 0x7f077811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.796+0000 7f0777fff700 1 --2- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f077811f010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0764009c40 tx=0x7f0764004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.796+0000 7f07757fa700 1 -- 172.21.15.154:0/1245004663 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764004400 con 0x7f077809f350 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.796+0000 7f07757fa700 1 -- 172.21.15.154:0/1245004663 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076401f070 con 0x7f077809f350 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.796+0000 7f07757fa700 1 -- 172.21.15.154:0/1245004663 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640038e0 con 0x7f077809f350 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.796+0000 7f077f199700 1 -- 172.21.15.154:0/1245004663 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0764009550 con 0x7f077809f350 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.796+0000 7f077f199700 1 -- 172.21.15.154:0/1245004663 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0778120760 con 0x7f077809f350 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.796+0000 7f07757fa700 1 -- 172.21.15.154:0/1245004663 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0764021030 con 0x7f077809f350 2023-09-30T22:24:47.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.797+0000 7f07757fa700 1 -- 172.21.15.154:0/1245004663 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0764040b40 con 0x7f077809f350 2023-09-30T22:24:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.797+0000 7f077f199700 1 -- 172.21.15.154:0/1245004663 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077804f2a0 con 0x7f077809f350 2023-09-30T22:24:47.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.801+0000 7f07757fa700 1 -- 172.21.15.154:0/1245004663 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0764015020 con 0x7f077809f350 2023-09-30T22:24:47.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.986+0000 7f077f199700 1 -- 172.21.15.154:0/1245004663 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0778072d60 con 0x7f077809f350 2023-09-30T22:24:47.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.986+0000 7f07757fa700 1 -- 172.21.15.154:0/1245004663 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f076400b9d0 con 0x7f077809f350 2023-09-30T22:24:47.990 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:47.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.988+0000 7f077f199700 1 -- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 msgr2=0x7f077811f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:47.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.988+0000 7f077f199700 1 --2- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f077811f010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0764009c40 tx=0x7f0764004750 comp rx=0 tx=0).stop 2023-09-30T22:24:47.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.988+0000 7f077f199700 1 -- 172.21.15.154:0/1245004663 shutdown_connections 2023-09-30T22:24:47.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.988+0000 7f077f199700 1 --2- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07781393a0 0x7f077811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.988+0000 7f077f199700 1 --2- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f077809e870 0x7f077811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.988+0000 7f077f199700 1 --2- 172.21.15.154:0/1245004663 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f077809f350 0x7f077811f010 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:47.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.988+0000 7f077f199700 1 -- 172.21.15.154:0/1245004663 >> 172.21.15.154:0/1245004663 conn(0x7f07780a4430 msgr2=0x7f07780a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:47.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.988+0000 7f077f199700 1 -- 172.21.15.154:0/1245004663 shutdown_connections 2023-09-30T22:24:47.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:47.988+0000 7f077f199700 1 -- 172.21.15.154:0/1245004663 wait complete. 2023-09-30T22:24:48.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:48.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:48.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:48.262 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:48.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.275+0000 7f6f1cf27700 1 Processor -- start 2023-09-30T22:24:48.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.275+0000 7f6f1cf27700 1 -- start start 2023-09-30T22:24:48.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.275+0000 7f6f1cf27700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f1809e870 0x7f6f1809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.275+0000 7f6f1cf27700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f1809f180 0x7f6f18131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1cf27700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1809c970 con 0x7f6f18131d70 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1cf27700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f180a0920 con 0x7f6f1809e870 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1cf27700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1809f9c0 con 0x7f6f1809f180 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f15d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f1809f180 0x7f6f18131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f1809e870 0x7f6f1809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f15d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f1809f180 0x7f6f18131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54286/0 (socket says 172.21.15.154:54286) 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f16d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6f18131d70 0x7f6f18138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40348/0 (socket says 172.21.15.154:40348) 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f15d9b700 1 -- 172.21.15.154:0/3223527338 learned_addr learned my addr 172.21.15.154:0/3223527338 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1659c700 1 -- 172.21.15.154:0/3223527338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f1809f180 msgr2=0x7f6f18131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1659c700 1 --2- 172.21.15.154:0/3223527338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f1809f180 0x7f6f18131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1659c700 1 -- 172.21.15.154:0/3223527338 >> v1:172.21.15.154:6789/0 conn(0x7f6f18131d70 legacy=0x7f6f18138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1559a700 1 -- 172.21.15.154:0/3223527338 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241711252 0 0) 0x7f6f1809c970 con 0x7f6f18131d70 2023-09-30T22:24:48.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1659c700 1 -- 172.21.15.154:0/3223527338 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1809bab0 con 0x7f6f1809e870 2023-09-30T22:24:48.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f15d9b700 1 --2- 172.21.15.154:0/3223527338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f1809f180 0x7f6f18131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:48.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1659c700 1 --2- 172.21.15.154:0/3223527338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 0x7f6f1809ec40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009840 tx=0x7f6f08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ad337e876bb7e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1559a700 1 -- 172.21.15.154:0/3223527338 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08011830 con 0x7f6f1809e870 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1559a700 1 -- 172.21.15.154:0/3223527338 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f08011990 con 0x7f6f1809e870 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.276+0000 7f6f1559a700 1 -- 172.21.15.154:0/3223527338 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08011d20 con 0x7f6f1809e870 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.277+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3223527338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 msgr2=0x7f6f1809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.277+0000 7f6f1cf27700 1 --2- 172.21.15.154:0/3223527338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 0x7f6f1809ec40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009840 tx=0x7f6f08009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.277+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3223527338 shutdown_connections 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.277+0000 7f6f1cf27700 1 --2- 172.21.15.154:0/3223527338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 0x7f6f1809ec40 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.277+0000 7f6f1cf27700 1 --2- 172.21.15.154:0/3223527338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f1809f180 0x7f6f18131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.277+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3223527338 >> 172.21.15.154:0/3223527338 conn(0x7f6f180a4430 msgr2=0x7f6f180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.277+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3223527338 shutdown_connections 2023-09-30T22:24:48.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.277+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3223527338 wait complete. 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.279+0000 7f6f1cf27700 1 Processor -- start 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.279+0000 7f6f1cf27700 1 -- start start 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f1cf27700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 0x7f6f1806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f1cf27700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f1809f180 0x7f6f1806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f1cf27700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f18131d70 0x7f6f1806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f1cf27700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1806cd80 con 0x7f6f1809e870 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f1cf27700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18124d90 con 0x7f6f1809f180 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f1cf27700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18124520 con 0x7f6f18131d70 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f15d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f1809f180 0x7f6f1806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f15d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f1809f180 0x7f6f1806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40600/0 (socket says 172.21.15.154:40600) 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f15d9b700 1 -- 172.21.15.154:0/3269177133 learned_addr learned my addr 172.21.15.154:0/3269177133 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:48.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f1659c700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 0x7f6f1806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f16d9d700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f18131d70 0x7f6f1806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f15d9b700 1 -- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f18131d70 msgr2=0x7f6f1806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f15d9b700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f18131d70 0x7f6f1806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f15d9b700 1 -- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 msgr2=0x7f6f1806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f15d9b700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 0x7f6f1806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f15d9b700 1 -- 172.21.15.154:0/3269177133 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c009550 con 0x7f6f1809f180 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f1659c700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 0x7f6f1806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f15d9b700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f1809f180 0x7f6f1806bdf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00ebe0 tx=0x7f6f0c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.280+0000 7f6f06ffd700 1 -- 172.21.15.154:0/3269177133 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00c850 con 0x7f6f1809f180 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.281+0000 7f6f06ffd700 1 -- 172.21.15.154:0/3269177133 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c00c9b0 con 0x7f6f1809f180 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.281+0000 7f6f06ffd700 1 -- 172.21.15.154:0/3269177133 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00cd20 con 0x7f6f1809f180 2023-09-30T22:24:48.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.281+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3269177133 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f080094a0 con 0x7f6f1809f180 2023-09-30T22:24:48.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.281+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3269177133 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f18130620 con 0x7f6f1809f180 2023-09-30T22:24:48.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.281+0000 7f6f06ffd700 1 -- 172.21.15.154:0/3269177133 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f0c013470 con 0x7f6f1809f180 2023-09-30T22:24:48.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.281+0000 7f6f06ffd700 1 -- 172.21.15.154:0/3269177133 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f0c03f860 con 0x7f6f1809f180 2023-09-30T22:24:48.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.284+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3269177133 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1811be60 con 0x7f6f1809f180 2023-09-30T22:24:48.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.289+0000 7f6f06ffd700 1 -- 172.21.15.154:0/3269177133 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f0c0232f0 con 0x7f6f1809f180 2023-09-30T22:24:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.400+0000 7f59ce4a2700 1 Processor -- start 2023-09-30T22:24:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.400+0000 7f59ce4a2700 1 -- start start 2023-09-30T22:24:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.400+0000 7f59ce4a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a0a70 0x7f59c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.400+0000 7f59ce4a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c80a1380 0x7f59c8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.400+0000 7f59ce4a2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c809dc00 con 0x7f59c8133f50 2023-09-30T22:24:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.400+0000 7f59ce4a2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c809ea60 con 0x7f59c80a0a70 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.400+0000 7f59ce4a2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59c809dec0 con 0x7f59c80a1380 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a0a70 0x7f59c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59cca3f700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f59c8133f50 0x7f59c813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40358/0 (socket says 172.21.15.154:40358) 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59cca3f700 1 -- 172.21.15.154:0/2715946712 learned_addr learned my addr 172.21.15.154:0/2715946712 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c77fe700 1 --2- 172.21.15.154:0/2715946712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c80a1380 0x7f59c8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c7fff700 1 -- 172.21.15.154:0/2715946712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c80a1380 msgr2=0x7f59c8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c7fff700 1 --2- 172.21.15.154:0/2715946712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c80a1380 0x7f59c8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c7fff700 1 -- 172.21.15.154:0/2715946712 >> v1:172.21.15.154:6789/0 conn(0x7f59c8133f50 legacy=0x7f59c813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c7fff700 1 -- 172.21.15.154:0/2715946712 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c809e6a0 con 0x7f59c80a0a70 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c7fff700 1 --2- 172.21.15.154:0/2715946712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a0a70 0x7f59c80a0e40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009870 tx=0x7f59b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58e21489e1ddefa9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c6ffd700 1 -- 172.21.15.154:0/2715946712 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8011830 con 0x7f59c80a0a70 2023-09-30T22:24:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c6ffd700 1 -- 172.21.15.154:0/2715946712 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8011990 con 0x7f59c80a0a70 2023-09-30T22:24:48.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.401+0000 7f59c6ffd700 1 -- 172.21.15.154:0/2715946712 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8011d20 con 0x7f59c80a0a70 2023-09-30T22:24:48.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.402+0000 7f59ce4a2700 1 -- 172.21.15.154:0/2715946712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a0a70 msgr2=0x7f59c80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.402+0000 7f59ce4a2700 1 --2- 172.21.15.154:0/2715946712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a0a70 0x7f59c80a0e40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009870 tx=0x7f59b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:48.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.402+0000 7f59ce4a2700 1 -- 172.21.15.154:0/2715946712 shutdown_connections 2023-09-30T22:24:48.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.402+0000 7f59ce4a2700 1 --2- 172.21.15.154:0/2715946712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a0a70 0x7f59c80a0e40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.402+0000 7f59ce4a2700 1 --2- 172.21.15.154:0/2715946712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c80a1380 0x7f59c8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.402+0000 7f59ce4a2700 1 -- 172.21.15.154:0/2715946712 >> 172.21.15.154:0/2715946712 conn(0x7f59c80a6610 msgr2=0x7f59c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.402+0000 7f59ce4a2700 1 -- 172.21.15.154:0/2715946712 shutdown_connections 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.402+0000 7f59ce4a2700 1 -- 172.21.15.154:0/2715946712 wait complete. 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.403+0000 7f59ce4a2700 1 Processor -- start 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.403+0000 7f59ce4a2700 1 -- start start 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59ce4a2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c80a0a70 0x7f59c81c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59ce4a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a1380 0x7f59c81c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59ce4a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c8133f50 0x7f59c8122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59ce4a2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8126250 con 0x7f59c80a0a70 2023-09-30T22:24:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59ce4a2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80a0450 con 0x7f59c80a1380 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59ce4a2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59c81339f0 con 0x7f59c8133f50 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59c7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c80a0a70 0x7f59c81c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59c7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c80a0a70 0x7f59c81c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52108/0 (socket says 172.21.15.154:52108) 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59c7fff700 1 -- 172.21.15.154:0/109996874 learned_addr learned my addr 172.21.15.154:0/109996874 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59c77fe700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a1380 0x7f59c81c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59cca3f700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c8133f50 0x7f59c8122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59c7fff700 1 -- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c8133f50 msgr2=0x7f59c8122ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59c7fff700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c8133f50 0x7f59c8122ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59c7fff700 1 -- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a1380 msgr2=0x7f59c81c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59c7fff700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a1380 0x7f59c81c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59c7fff700 1 -- 172.21.15.154:0/109996874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80094a0 con 0x7f59c80a0a70 2023-09-30T22:24:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.404+0000 7f59cca3f700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c8133f50 0x7f59c8122ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.405+0000 7f59c7fff700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c80a0a70 0x7f59c81c85d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009bc0 tx=0x7f59b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.405+0000 7f59c4ff9700 1 -- 172.21.15.154:0/109996874 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8004550 con 0x7f59c80a0a70 2023-09-30T22:24:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.405+0000 7f59c4ff9700 1 -- 172.21.15.154:0/109996874 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b801f070 con 0x7f59c80a0a70 2023-09-30T22:24:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.405+0000 7f59c4ff9700 1 -- 172.21.15.154:0/109996874 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80038e0 con 0x7f59c80a0a70 2023-09-30T22:24:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.405+0000 7f59ce4a2700 1 -- 172.21.15.154:0/109996874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c81271b0 con 0x7f59c80a0a70 2023-09-30T22:24:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.405+0000 7f59ce4a2700 1 -- 172.21.15.154:0/109996874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c81c9050 con 0x7f59c80a0a70 2023-09-30T22:24:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.406+0000 7f59c4ff9700 1 -- 172.21.15.154:0/109996874 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59b8003a40 con 0x7f59c80a0a70 2023-09-30T22:24:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.406+0000 7f59c4ff9700 1 -- 172.21.15.154:0/109996874 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f59b8021070 con 0x7f59c80a0a70 2023-09-30T22:24:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.406+0000 7f59ce4a2700 1 -- 172.21.15.154:0/109996874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c804f2a0 con 0x7f59c80a0a70 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.409+0000 7f687291b700 1 Processor -- start 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.409+0000 7f687291b700 1 -- start start 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f687291b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e870 0x7f686c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f687291b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f686c09f180 0x7f686c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f687291b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c09c970 con 0x7f686c131d70 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f687291b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c0a0920 con 0x7f686c09f180 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f687291b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f686c09f9c0 con 0x7f686c09e870 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f686b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f686c09f180 0x7f686c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f686bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e870 0x7f686c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f686b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f686c09f180 0x7f686c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52118/0 (socket says 172.21.15.154:52118) 2023-09-30T22:24:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f686b7fe700 1 -- 172.21.15.154:0/1161627038 learned_addr learned my addr 172.21.15.154:0/1161627038 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f686b7fe700 1 -- 172.21.15.154:0/1161627038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e870 msgr2=0x7f686c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f686b7fe700 1 --2- 172.21.15.154:0/1161627038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e870 0x7f686c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f686b7fe700 1 -- 172.21.15.154:0/1161627038 >> v1:172.21.15.154:6789/0 conn(0x7f686c131d70 legacy=0x7f686c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f686b7fe700 1 -- 172.21.15.154:0/1161627038 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c09bab0 con 0x7f686c09f180 2023-09-30T22:24:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.410+0000 7f686bfff700 1 --2- 172.21.15.154:0/1161627038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e870 0x7f686c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.411+0000 7f686b7fe700 1 --2- 172.21.15.154:0/1161627038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09f180 0x7f686c131830 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f68600098f0 tx=0x7f6860009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a11dff92edb860 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.415+0000 7f686affd700 1 -- 172.21.15.154:0/1161627038 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860011830 con 0x7f686c09f180 2023-09-30T22:24:48.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.415+0000 7f686affd700 1 -- 172.21.15.154:0/1161627038 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6860011990 con 0x7f686c09f180 2023-09-30T22:24:48.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.415+0000 7f686affd700 1 -- 172.21.15.154:0/1161627038 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860011d20 con 0x7f686c09f180 2023-09-30T22:24:48.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.415+0000 7f59c4ff9700 1 -- 172.21.15.154:0/109996874 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59b801a430 con 0x7f59c80a0a70 2023-09-30T22:24:48.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.415+0000 7f687291b700 1 -- 172.21.15.154:0/1161627038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09f180 msgr2=0x7f686c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.415+0000 7f687291b700 1 --2- 172.21.15.154:0/1161627038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09f180 0x7f686c131830 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f68600098f0 tx=0x7f6860009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:48.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.415+0000 7f687291b700 1 -- 172.21.15.154:0/1161627038 shutdown_connections 2023-09-30T22:24:48.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.415+0000 7f687291b700 1 --2- 172.21.15.154:0/1161627038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e870 0x7f686c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.415+0000 7f687291b700 1 --2- 172.21.15.154:0/1161627038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09f180 0x7f686c131830 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.416+0000 7f687291b700 1 -- 172.21.15.154:0/1161627038 >> 172.21.15.154:0/1161627038 conn(0x7f686c0a4430 msgr2=0x7f686c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.416+0000 7f687291b700 1 -- 172.21.15.154:0/1161627038 shutdown_connections 2023-09-30T22:24:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.416+0000 7f687291b700 1 -- 172.21.15.154:0/1161627038 wait complete. 2023-09-30T22:24:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.416+0000 7f687291b700 1 Processor -- start 2023-09-30T22:24:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f687291b700 1 -- start start 2023-09-30T22:24:48.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f687291b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09e870 0x7f686c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f687291b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09f180 0x7f686c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f687291b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c131d70 0x7f686c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f687291b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c06d4c0 con 0x7f686c09e870 2023-09-30T22:24:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f687291b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c09dc10 con 0x7f686c09f180 2023-09-30T22:24:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f687291b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f686c06cd10 con 0x7f686c131d70 2023-09-30T22:24:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f686bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09e870 0x7f686c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f686b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09f180 0x7f686c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f6870eb8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c131d70 0x7f686c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f686bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09e870 0x7f686c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52132/0 (socket says 172.21.15.154:52132) 2023-09-30T22:24:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.417+0000 7f686bfff700 1 -- 172.21.15.154:0/4261407010 learned_addr learned my addr 172.21.15.154:0/4261407010 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f686b7fe700 1 -- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c131d70 msgr2=0x7f686c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f686b7fe700 1 --2- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c131d70 0x7f686c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f686b7fe700 1 -- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09e870 msgr2=0x7f686c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f686b7fe700 1 --2- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09e870 0x7f686c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f686b7fe700 1 -- 172.21.15.154:0/4261407010 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0094a0 con 0x7f686c09f180 2023-09-30T22:24:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f6870eb8700 1 --2- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c131d70 0x7f686c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f686bfff700 1 --2- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09e870 0x7f686c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f686b7fe700 1 --2- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09f180 0x7f686c06bdf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6860016000 tx=0x7f6860004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f6868ff9700 1 -- 172.21.15.154:0/4261407010 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860004400 con 0x7f686c09f180 2023-09-30T22:24:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f6868ff9700 1 -- 172.21.15.154:0/4261407010 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686001f070 con 0x7f686c09f180 2023-09-30T22:24:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f6868ff9700 1 -- 172.21.15.154:0/4261407010 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68600038e0 con 0x7f686c09f180 2023-09-30T22:24:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f687291b700 1 -- 172.21.15.154:0/4261407010 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6860009550 con 0x7f686c09f180 2023-09-30T22:24:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.418+0000 7f687291b700 1 -- 172.21.15.154:0/4261407010 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c0a2e50 con 0x7f686c09f180 2023-09-30T22:24:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.419+0000 7f6868ff9700 1 -- 172.21.15.154:0/4261407010 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6860021030 con 0x7f686c09f180 2023-09-30T22:24:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.419+0000 7f6868ff9700 1 -- 172.21.15.154:0/4261407010 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6860040950 con 0x7f686c09f180 2023-09-30T22:24:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.419+0000 7f687291b700 1 -- 172.21.15.154:0/4261407010 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c04f2a0 con 0x7f686c09f180 2023-09-30T22:24:48.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.424+0000 7f6868ff9700 1 -- 172.21.15.154:0/4261407010 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68600239c0 con 0x7f686c09f180 2023-09-30T22:24:48.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.535+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3269177133 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f1804f2a0 con 0x7f6f1809f180 2023-09-30T22:24:48.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.535+0000 7f6f06ffd700 1 -- 172.21.15.154:0/3269177133 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f0c017030 con 0x7f6f1809f180 2023-09-30T22:24:48.536 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:48.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.537+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f1809f180 msgr2=0x7f6f1806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.537+0000 7f6f1cf27700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f1809f180 0x7f6f1806bdf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00ebe0 tx=0x7f6f0c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.537+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3269177133 shutdown_connections 2023-09-30T22:24:48.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.537+0000 7f6f1cf27700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6f18131d70 0x7f6f1806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.537+0000 7f6f1cf27700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f1809e870 0x7f6f1806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.537+0000 7f6f1cf27700 1 --2- 172.21.15.154:0/3269177133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f1809f180 0x7f6f1806bdf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.537+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3269177133 >> 172.21.15.154:0/3269177133 conn(0x7f6f180a4430 msgr2=0x7f6f18131080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.537+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3269177133 shutdown_connections 2023-09-30T22:24:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.537+0000 7f6f1cf27700 1 -- 172.21.15.154:0/3269177133 wait complete. 2023-09-30T22:24:48.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:48.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.609+0000 7f59ce4a2700 1 -- 172.21.15.154:0/109996874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59c8072980 con 0x7f59c80a0a70 2023-09-30T22:24:48.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.609+0000 7f59c4ff9700 1 -- 172.21.15.154:0/109996874 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59b8015020 con 0x7f59c80a0a70 2023-09-30T22:24:48.610 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:48.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.611+0000 7f59ce4a2700 1 -- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c80a0a70 msgr2=0x7f59c81c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.611+0000 7f59ce4a2700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c80a0a70 0x7f59c81c85d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009bc0 tx=0x7f59b8004750 comp rx=0 tx=0).stop 2023-09-30T22:24:48.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.611+0000 7f59ce4a2700 1 -- 172.21.15.154:0/109996874 shutdown_connections 2023-09-30T22:24:48.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.611+0000 7f59ce4a2700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f59c8133f50 0x7f59c8122ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.611+0000 7f59ce4a2700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c80a0a70 0x7f59c81c85d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.611+0000 7f59ce4a2700 1 --2- 172.21.15.154:0/109996874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59c80a1380 0x7f59c81c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.611+0000 7f59ce4a2700 1 -- 172.21.15.154:0/109996874 >> 172.21.15.154:0/109996874 conn(0x7f59c80a6610 msgr2=0x7f59c80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.611+0000 7f59ce4a2700 1 -- 172.21.15.154:0/109996874 shutdown_connections 2023-09-30T22:24:48.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.611+0000 7f59ce4a2700 1 -- 172.21.15.154:0/109996874 wait complete. 2023-09-30T22:24:48.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.618+0000 7f687291b700 1 -- 172.21.15.154:0/4261407010 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f686c125cd0 con 0x7f686c09f180 2023-09-30T22:24:48.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.618+0000 7f6868ff9700 1 -- 172.21.15.154:0/4261407010 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f686001b430 con 0x7f686c09f180 2023-09-30T22:24:48.619 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.622+0000 7f687291b700 1 -- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09f180 msgr2=0x7f686c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.622+0000 7f687291b700 1 --2- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09f180 0x7f686c06bdf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6860016000 tx=0x7f6860004750 comp rx=0 tx=0).stop 2023-09-30T22:24:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.622+0000 7f687291b700 1 -- 172.21.15.154:0/4261407010 shutdown_connections 2023-09-30T22:24:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.622+0000 7f687291b700 1 --2- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c131d70 0x7f686c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.622+0000 7f687291b700 1 --2- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09e870 0x7f686c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.622+0000 7f687291b700 1 --2- 172.21.15.154:0/4261407010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09f180 0x7f686c06bdf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.622+0000 7f687291b700 1 -- 172.21.15.154:0/4261407010 >> 172.21.15.154:0/4261407010 conn(0x7f686c0a4430 msgr2=0x7f686c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.622+0000 7f687291b700 1 -- 172.21.15.154:0/4261407010 shutdown_connections 2023-09-30T22:24:48.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:48.622+0000 7f687291b700 1 -- 172.21.15.154:0/4261407010 wait complete. 2023-09-30T22:24:48.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:48.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:49.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:49.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.125+0000 7fd121d15700 1 Processor -- start 2023-09-30T22:24:49.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.125+0000 7fd121d15700 1 -- start start 2023-09-30T22:24:49.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd121d15700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd121d15700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 0x7fd11c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd121d15700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd11c131a00 0x7fd11c131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd121d15700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11c06b5c0 con 0x7fd11c131a00 2023-09-30T22:24:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd121d15700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c06e900 con 0x7fd11c06a770 2023-09-30T22:24:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd121d15700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c09d180 con 0x7fd11c09dec0 2023-09-30T22:24:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 0x7fd11c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40640/0 (socket says 172.21.15.154:40640) 2023-09-30T22:24:49.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11b7fe700 1 -- 172.21.15.154:0/1802708537 learned_addr learned my addr 172.21.15.154:0/1802708537 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11bfff700 1 --2- 172.21.15.154:0/1802708537 >> v2:172.21.15.154:3300/0 conn(0x7fd11c131a00 0x7fd11c131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11bfff700 1 -- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 msgr2=0x7fd11c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11bfff700 1 --2- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 0x7fd11c06b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11bfff700 1 -- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 msgr2=0x7fd11c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11bfff700 1 --2- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11bfff700 1 -- 172.21.15.154:0/1802708537 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c09e780 con 0x7fd11c131a00 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.126+0000 7fd11affd700 1 --2- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 0x7fd11c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd11bfff700 1 --2- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 0x7fd11c131e80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd114009d90 tx=0x7fd11400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7201f8c5f70cd25 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd11a7fc700 1 -- 172.21.15.154:0/1802708537 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400e070 con 0x7fd11c131a00 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd11a7fc700 1 -- 172.21.15.154:0/1802708537 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11400bb20 con 0x7fd11c131a00 2023-09-30T22:24:49.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd11a7fc700 1 -- 172.21.15.154:0/1802708537 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114012430 con 0x7fd11c131a00 2023-09-30T22:24:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd121d15700 1 -- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 msgr2=0x7fd11c131e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd121d15700 1 --2- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 0x7fd11c131e80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd114009d90 tx=0x7fd11400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd121d15700 1 -- 172.21.15.154:0/1802708537 shutdown_connections 2023-09-30T22:24:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd121d15700 1 --2- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd121d15700 1 --2- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 0x7fd11c131e80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd121d15700 1 --2- 172.21.15.154:0/1802708537 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 0x7fd11c06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd121d15700 1 -- 172.21.15.154:0/1802708537 >> 172.21.15.154:0/1802708537 conn(0x7fd11c099c40 msgr2=0x7fd11c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd121d15700 1 -- 172.21.15.154:0/1802708537 shutdown_connections 2023-09-30T22:24:49.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.127+0000 7fd121d15700 1 -- 172.21.15.154:0/1802708537 wait complete. 2023-09-30T22:24:49.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.128+0000 7fd121d15700 1 Processor -- start 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd121d15700 1 -- start start 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd121d15700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd121d15700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 0x7fd11c11a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd121d15700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 0x7fd11c11aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd121d15700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c11b430 con 0x7fd11c131a00 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd121d15700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c11bb40 con 0x7fd11c06a770 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd121d15700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c11cd90 con 0x7fd11c09dec0 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 0x7fd11c11aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c119f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40648/0 (socket says 172.21.15.154:40648) 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11b7fe700 1 -- 172.21.15.154:0/360813030 learned_addr learned my addr 172.21.15.154:0/360813030 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11affd700 1 --2- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 0x7fd11c11a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11bfff700 1 -- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 msgr2=0x7fd11c11a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11bfff700 1 --2- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 0x7fd11c11a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11bfff700 1 -- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 msgr2=0x7fd11c119f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11bfff700 1 --2- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c119f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11bfff700 1 -- 172.21.15.154:0/360813030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11000d940 con 0x7fd11c131a00 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.129+0000 7fd11b7fe700 1 --2- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.130+0000 7fd11bfff700 1 --2- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 0x7fd11c11aa00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd11c09f140 tx=0x7fd114004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.130+0000 7fd103fff700 1 -- 172.21.15.154:0/360813030 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114004800 con 0x7fd11c131a00 2023-09-30T22:24:49.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.130+0000 7fd103fff700 1 -- 172.21.15.154:0/360813030 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114020070 con 0x7fd11c131a00 2023-09-30T22:24:49.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.130+0000 7fd121d15700 1 -- 172.21.15.154:0/360813030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd114009a70 con 0x7fd11c131a00 2023-09-30T22:24:49.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.130+0000 7fd103fff700 1 -- 172.21.15.154:0/360813030 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140276c0 con 0x7fd11c131a00 2023-09-30T22:24:49.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.130+0000 7fd121d15700 1 -- 172.21.15.154:0/360813030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c130eb0 con 0x7fd11c131a00 2023-09-30T22:24:49.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.130+0000 7fd103fff700 1 -- 172.21.15.154:0/360813030 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd114012430 con 0x7fd11c131a00 2023-09-30T22:24:49.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.131+0000 7fd103fff700 1 -- 172.21.15.154:0/360813030 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd114022070 con 0x7fd11c131a00 2023-09-30T22:24:49.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.131+0000 7fd121d15700 1 -- 172.21.15.154:0/360813030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11c071ce0 con 0x7fd11c131a00 2023-09-30T22:24:49.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.135+0000 7fd103fff700 1 -- 172.21.15.154:0/360813030 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd11401c400 con 0x7fd11c131a00 2023-09-30T22:24:49.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.318+0000 7fd121d15700 1 -- 172.21.15.154:0/360813030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd11c04f2a0 con 0x7fd11c131a00 2023-09-30T22:24:49.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.319+0000 7fd103fff700 1 -- 172.21.15.154:0/360813030 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd11401a380 con 0x7fd11c131a00 2023-09-30T22:24:49.320 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:49.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.321+0000 7fd121d15700 1 -- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 msgr2=0x7fd11c11aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.321+0000 7fd121d15700 1 --2- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 0x7fd11c11aa00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd11c09f140 tx=0x7fd114004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.321+0000 7fd121d15700 1 -- 172.21.15.154:0/360813030 shutdown_connections 2023-09-30T22:24:49.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.321+0000 7fd121d15700 1 --2- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd11c131a00 0x7fd11c11aa00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.321+0000 7fd121d15700 1 --2- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd11c06a770 0x7fd11c119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.321+0000 7fd121d15700 1 --2- 172.21.15.154:0/360813030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd11c09dec0 0x7fd11c11a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.321+0000 7fd121d15700 1 -- 172.21.15.154:0/360813030 >> 172.21.15.154:0/360813030 conn(0x7fd11c099c40 msgr2=0x7fd11c12ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.321+0000 7fd121d15700 1 -- 172.21.15.154:0/360813030 shutdown_connections 2023-09-30T22:24:49.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.321+0000 7fd121d15700 1 -- 172.21.15.154:0/360813030 wait complete. 2023-09-30T22:24:49.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:49.551 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:49.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:49.636 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:49.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.679+0000 7fd616d6b700 1 Processor -- start 2023-09-30T22:24:49.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.679+0000 7fd616d6b700 1 -- start start 2023-09-30T22:24:49.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.679+0000 7fd616d6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd610138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.679+0000 7fd616d6b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd610139280 0x7fd61013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.679+0000 7fd616d6b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61006b2d0 con 0x7fd610133ad0 2023-09-30T22:24:49.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.679+0000 7fd616d6b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6101345b0 con 0x7fd610139280 2023-09-30T22:24:49.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.679+0000 7fd616d6b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd610133610 con 0x7fd610136960 2023-09-30T22:24:49.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd610138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd610138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40660/0 (socket says 172.21.15.154:40660) 2023-09-30T22:24:49.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60ffff700 1 -- 172.21.15.154:0/4142031364 learned_addr learned my addr 172.21.15.154:0/4142031364 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:49.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd615308700 1 --2- 172.21.15.154:0/4142031364 >> v2:172.21.15.154:3300/0 conn(0x7fd610139280 0x7fd61013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60ffff700 1 -- 172.21.15.154:0/4142031364 >> v2:172.21.15.154:3300/0 conn(0x7fd610139280 msgr2=0x7fd61013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60ffff700 1 --2- 172.21.15.154:0/4142031364 >> v2:172.21.15.154:3300/0 conn(0x7fd610139280 0x7fd61013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60ffff700 1 -- 172.21.15.154:0/4142031364 >> v1:172.21.15.154:6789/0 conn(0x7fd610133ad0 legacy=0x7fd610133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60ffff700 1 -- 172.21.15.154:0/4142031364 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61009a500 con 0x7fd610136960 2023-09-30T22:24:49.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60ffff700 1 --2- 172.21.15.154:0/4142031364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd610138d40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009920 tx=0x7fd5fc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6a8fbc3c5b0db36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60f7fe700 1 -- 172.21.15.154:0/4142031364 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc011830 con 0x7fd610136960 2023-09-30T22:24:49.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60f7fe700 1 -- 172.21.15.154:0/4142031364 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc011990 con 0x7fd610136960 2023-09-30T22:24:49.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.680+0000 7fd60f7fe700 1 -- 172.21.15.154:0/4142031364 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc011d20 con 0x7fd610136960 2023-09-30T22:24:49.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.681+0000 7fd616d6b700 1 -- 172.21.15.154:0/4142031364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 msgr2=0x7fd610138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.681+0000 7fd616d6b700 1 --2- 172.21.15.154:0/4142031364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd610138d40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009920 tx=0x7fd5fc009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:49.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.681+0000 7fd616d6b700 1 -- 172.21.15.154:0/4142031364 shutdown_connections 2023-09-30T22:24:49.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.681+0000 7fd616d6b700 1 --2- 172.21.15.154:0/4142031364 >> v2:172.21.15.154:3300/0 conn(0x7fd610139280 0x7fd61013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.681+0000 7fd616d6b700 1 --2- 172.21.15.154:0/4142031364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd610138d40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.681+0000 7fd616d6b700 1 -- 172.21.15.154:0/4142031364 >> 172.21.15.154:0/4142031364 conn(0x7fd610099c40 msgr2=0x7fd6100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.681+0000 7fd616d6b700 1 -- 172.21.15.154:0/4142031364 shutdown_connections 2023-09-30T22:24:49.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.681+0000 7fd616d6b700 1 -- 172.21.15.154:0/4142031364 wait complete. 2023-09-30T22:24:49.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.683+0000 7fd616d6b700 1 Processor -- start 2023-09-30T22:24:49.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.683+0000 7fd616d6b700 1 -- start start 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.683+0000 7fd616d6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd610133ad0 0x7fd61012cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.683+0000 7fd616d6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd61012d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd616d6b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd610139280 0x7fd61012d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd616d6b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6100706d0 con 0x7fd610139280 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd616d6b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd610138fe0 con 0x7fd610136960 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd616d6b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd61012dd00 con 0x7fd610133ad0 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd615308700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd610139280 0x7fd61012d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd615308700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd610139280 0x7fd61012d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52162/0 (socket says 172.21.15.154:52162) 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd615308700 1 -- 172.21.15.154:0/1773697602 learned_addr learned my addr 172.21.15.154:0/1773697602 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:49.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd614b07700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd610133ad0 0x7fd61012cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd60ffff700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd61012d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd615308700 1 -- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd610133ad0 msgr2=0x7fd61012cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd615308700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd610133ad0 0x7fd61012cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd615308700 1 -- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 msgr2=0x7fd61012d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd615308700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd61012d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd615308700 1 -- 172.21.15.154:0/1773697602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc009550 con 0x7fd610139280 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd614b07700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd610133ad0 0x7fd61012cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd60ffff700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd61012d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd615308700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd610139280 0x7fd61012d620 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd60800ef90 tx=0x7fd60800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd60d7fa700 1 -- 172.21.15.154:0/1773697602 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60800cc90 con 0x7fd610139280 2023-09-30T22:24:49.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.684+0000 7fd60d7fa700 1 -- 172.21.15.154:0/1773697602 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60800f040 con 0x7fd610139280 2023-09-30T22:24:49.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.685+0000 7fd60d7fa700 1 -- 172.21.15.154:0/1773697602 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608014480 con 0x7fd610139280 2023-09-30T22:24:49.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.685+0000 7fd616d6b700 1 -- 172.21.15.154:0/1773697602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd610130d10 con 0x7fd610139280 2023-09-30T22:24:49.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.685+0000 7fd616d6b700 1 -- 172.21.15.154:0/1773697602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd610070c90 con 0x7fd610139280 2023-09-30T22:24:49.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.686+0000 7fd616d6b700 1 -- 172.21.15.154:0/1773697602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61004f2a0 con 0x7fd610139280 2023-09-30T22:24:49.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.686+0000 7fd60d7fa700 1 -- 172.21.15.154:0/1773697602 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6080145e0 con 0x7fd610139280 2023-09-30T22:24:49.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.687+0000 7fd60d7fa700 1 -- 172.21.15.154:0/1773697602 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd6080407a0 con 0x7fd610139280 2023-09-30T22:24:49.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.690+0000 7fd60d7fa700 1 -- 172.21.15.154:0/1773697602 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd608012910 con 0x7fd610139280 2023-09-30T22:24:49.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.757+0000 7fcb1e3e2700 1 Processor -- start 2023-09-30T22:24:49.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.757+0000 7fcb1e3e2700 1 -- start start 2023-09-30T22:24:49.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.757+0000 7fcb1e3e2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb18098410 0x7fcb180987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.757+0000 7fcb1e3e2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb1809d8f0 0x7fcb1809dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.757+0000 7fcb1e3e2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1809e240 0x7fcb181387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.757+0000 7fcb1e3e2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb180720a0 con 0x7fcb1809d8f0 2023-09-30T22:24:49.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.757+0000 7fcb1e3e2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1806f970 con 0x7fcb1809e240 2023-09-30T22:24:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.757+0000 7fcb1e3e2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1809e6e0 con 0x7fcb18098410 2023-09-30T22:24:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb177fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb1809d8f0 0x7fcb1809dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb177fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb1809d8f0 0x7fcb1809dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52176/0 (socket says 172.21.15.154:52176) 2023-09-30T22:24:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb177fe700 1 -- 172.21.15.154:0/2997310841 learned_addr learned my addr 172.21.15.154:0/2997310841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb17fff700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb18098410 0x7fcb180987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb1c97f700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1809e240 0x7fcb181387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb177fe700 1 -- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb18098410 msgr2=0x7fcb180987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb177fe700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb18098410 0x7fcb180987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb177fe700 1 -- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1809e240 msgr2=0x7fcb181387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb177fe700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1809e240 0x7fcb181387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb177fe700 1 -- 172.21.15.154:0/2997310841 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18072290 con 0x7fcb1809d8f0 2023-09-30T22:24:49.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb1c97f700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1809e240 0x7fcb181387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb177fe700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1809d8f0 0x7fcb1809dd00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0098f0 tx=0x7fcb0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf113137075f03b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb16ffd700 1 -- 172.21.15.154:0/2997310841 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c011830 con 0x7fcb1809d8f0 2023-09-30T22:24:49.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb16ffd700 1 -- 172.21.15.154:0/2997310841 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c011990 con 0x7fcb1809d8f0 2023-09-30T22:24:49.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.758+0000 7fcb16ffd700 1 -- 172.21.15.154:0/2997310841 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c011d20 con 0x7fcb1809d8f0 2023-09-30T22:24:49.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.759+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1809d8f0 msgr2=0x7fcb1809dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.759+0000 7fcb1e3e2700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1809d8f0 0x7fcb1809dd00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0098f0 tx=0x7fcb0c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:49.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.759+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/2997310841 shutdown_connections 2023-09-30T22:24:49.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.759+0000 7fcb1e3e2700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1809e240 0x7fcb181387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.759+0000 7fcb1e3e2700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb18098410 0x7fcb180987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.759+0000 7fcb1e3e2700 1 --2- 172.21.15.154:0/2997310841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1809d8f0 0x7fcb1809dd00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.759+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/2997310841 >> 172.21.15.154:0/2997310841 conn(0x7fcb180a2b30 msgr2=0x7fcb1809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.759+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/2997310841 shutdown_connections 2023-09-30T22:24:49.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.759+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/2997310841 wait complete. 2023-09-30T22:24:49.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.760+0000 7fcb1e3e2700 1 Processor -- start 2023-09-30T22:24:49.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.761+0000 7fcb1e3e2700 1 -- start start 2023-09-30T22:24:49.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.761+0000 7fcb1e3e2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb18098410 0x7fcb1812b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.761+0000 7fcb1e3e2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1809d8f0 0x7fcb1812b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.761+0000 7fcb1e3e2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1809e240 0x7fcb1812bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.761+0000 7fcb1e3e2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1812f070 con 0x7fcb1809e240 2023-09-30T22:24:49.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.761+0000 7fcb1e3e2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1812d730 con 0x7fcb18098410 2023-09-30T22:24:49.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.761+0000 7fcb1e3e2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18097e80 con 0x7fcb1809d8f0 2023-09-30T22:24:49.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb17fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb18098410 0x7fcb1812b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb17fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb18098410 0x7fcb1812b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40686/0 (socket says 172.21.15.154:40686) 2023-09-30T22:24:49.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb17fff700 1 -- 172.21.15.154:0/999986593 learned_addr learned my addr 172.21.15.154:0/999986593 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:49.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb1c97f700 1 --2- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1809e240 0x7fcb1812bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb177fe700 1 --2- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1809d8f0 0x7fcb1812b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb17fff700 1 -- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1809d8f0 msgr2=0x7fcb1812b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb17fff700 1 --2- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1809d8f0 0x7fcb1812b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb17fff700 1 -- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1809e240 msgr2=0x7fcb1812bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb17fff700 1 --2- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1809e240 0x7fcb1812bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb17fff700 1 -- 172.21.15.154:0/999986593 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10009a70 con 0x7fcb18098410 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb17fff700 1 --2- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb18098410 0x7fcb1812b130 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009f60 tx=0x7fcb08009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb14ff9700 1 -- 172.21.15.154:0/999986593 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08005a20 con 0x7fcb18098410 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb14ff9700 1 -- 172.21.15.154:0/999986593 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb08005b80 con 0x7fcb18098410 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/999986593 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0c009550 con 0x7fcb18098410 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb14ff9700 1 -- 172.21.15.154:0/999986593 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08013650 con 0x7fcb18098410 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.762+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/999986593 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1812e1f0 con 0x7fcb18098410 2023-09-30T22:24:49.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.763+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/999986593 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1804f2a0 con 0x7fcb18098410 2023-09-30T22:24:49.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.764+0000 7fcb14ff9700 1 -- 172.21.15.154:0/999986593 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb080137b0 con 0x7fcb18098410 2023-09-30T22:24:49.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.764+0000 7fcb14ff9700 1 -- 172.21.15.154:0/999986593 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb08043cc0 con 0x7fcb18098410 2023-09-30T22:24:49.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.768+0000 7fcb14ff9700 1 -- 172.21.15.154:0/999986593 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb08022310 con 0x7fcb18098410 2023-09-30T22:24:49.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.807+0000 7f69a51e4700 1 Processor -- start 2023-09-30T22:24:49.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.807+0000 7f69a51e4700 1 -- start start 2023-09-30T22:24:49.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f69a51e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f69a51e4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69a0139200 0x7f69a013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f69a51e4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a009e9d0 con 0x7f69a00a0a70 2023-09-30T22:24:49.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f69a51e4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a009dc00 con 0x7f69a0139200 2023-09-30T22:24:49.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f69a51e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a009dec0 con 0x7f69a00a1550 2023-09-30T22:24:49.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699ed9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f69a00a0a70 0x7f69a00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40376/0 (socket says 172.21.15.154:40376) 2023-09-30T22:24:49.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40698/0 (socket says 172.21.15.154:40698) 2023-09-30T22:24:49.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699ed9d700 1 -- 172.21.15.154:0/2492152342 learned_addr learned my addr 172.21.15.154:0/2492152342 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:49.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699f59e700 1 --2- 172.21.15.154:0/2492152342 >> v2:172.21.15.154:3300/0 conn(0x7f69a0139200 0x7f69a013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699f59e700 1 -- 172.21.15.154:0/2492152342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 msgr2=0x7f69a0138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:49.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699f59e700 1 --2- 172.21.15.154:0/2492152342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699f59e700 1 -- 172.21.15.154:0/2492152342 >> v1:172.21.15.154:6789/0 conn(0x7f69a00a0a70 legacy=0x7f69a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699f59e700 1 -- 172.21.15.154:0/2492152342 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a009e6a0 con 0x7f69a0139200 2023-09-30T22:24:49.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699dd9b700 1 -- 172.21.15.154:0/2492152342 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392467507 0 0) 0x7f69a009e9d0 con 0x7f69a00a0a70 2023-09-30T22:24:49.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699e59c700 1 --2- 172.21.15.154:0/2492152342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:49.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.808+0000 7f699f59e700 1 --2- 172.21.15.154:0/2492152342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a0139200 0x7f69a013b5e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6998009d90 tx=0x7f699800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bc519c5a362aee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.809+0000 7f699dd9b700 1 -- 172.21.15.154:0/2492152342 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699800e070 con 0x7f69a0139200 2023-09-30T22:24:49.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.809+0000 7f699dd9b700 1 -- 172.21.15.154:0/2492152342 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699800bb20 con 0x7f69a0139200 2023-09-30T22:24:49.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.809+0000 7f699dd9b700 1 -- 172.21.15.154:0/2492152342 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998012430 con 0x7f69a0139200 2023-09-30T22:24:49.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.809+0000 7f69a51e4700 1 -- 172.21.15.154:0/2492152342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a0139200 msgr2=0x7f69a013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.809+0000 7f69a51e4700 1 --2- 172.21.15.154:0/2492152342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a0139200 0x7f69a013b5e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6998009d90 tx=0x7f699800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:49.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.809+0000 7f69a51e4700 1 -- 172.21.15.154:0/2492152342 shutdown_connections 2023-09-30T22:24:49.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.809+0000 7f69a51e4700 1 --2- 172.21.15.154:0/2492152342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a0139200 0x7f69a013b5e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.809+0000 7f69a51e4700 1 --2- 172.21.15.154:0/2492152342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.809+0000 7f69a51e4700 1 -- 172.21.15.154:0/2492152342 >> 172.21.15.154:0/2492152342 conn(0x7f69a00a6610 msgr2=0x7f69a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.810+0000 7f69a51e4700 1 -- 172.21.15.154:0/2492152342 shutdown_connections 2023-09-30T22:24:49.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.810+0000 7f69a51e4700 1 -- 172.21.15.154:0/2492152342 wait complete. 2023-09-30T22:24:49.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.811+0000 7f69a51e4700 1 Processor -- start 2023-09-30T22:24:49.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.811+0000 7f69a51e4700 1 -- start start 2023-09-30T22:24:49.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f69a51e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a00a0a70 0x7f69a0120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f69a51e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f69a51e4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a0139200 0x7f69a01210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:49.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f69a51e4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0124140 con 0x7f69a0139200 2023-09-30T22:24:49.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f69a51e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0122850 con 0x7f69a00a1550 2023-09-30T22:24:49.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f69a51e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00a03e0 con 0x7f69a00a0a70 2023-09-30T22:24:49.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40712/0 (socket says 172.21.15.154:40712) 2023-09-30T22:24:49.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699e59c700 1 -- 172.21.15.154:0/823202525 learned_addr learned my addr 172.21.15.154:0/823202525 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:49.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699f59e700 1 --2- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a0139200 0x7f69a01210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699ed9d700 1 --2- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a00a0a70 0x7f69a0120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:49.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699e59c700 1 -- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a00a0a70 msgr2=0x7f69a0120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699e59c700 1 --2- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a00a0a70 0x7f69a0120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699e59c700 1 -- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a0139200 msgr2=0x7f69a01210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699e59c700 1 --2- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a0139200 0x7f69a01210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.812+0000 7f699e59c700 1 -- 172.21.15.154:0/823202525 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69940094a0 con 0x7f69a00a1550 2023-09-30T22:24:49.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.813+0000 7f699e59c700 1 --2- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0120b60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f699400ec10 tx=0x7f699400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:49.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.813+0000 7f69877fe700 1 -- 172.21.15.154:0/823202525 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699400c850 con 0x7f69a00a1550 2023-09-30T22:24:49.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.813+0000 7f69877fe700 1 -- 172.21.15.154:0/823202525 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699400c9b0 con 0x7f69a00a1550 2023-09-30T22:24:49.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.813+0000 7f69a51e4700 1 -- 172.21.15.154:0/823202525 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6998009a70 con 0x7f69a00a1550 2023-09-30T22:24:49.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.813+0000 7f69877fe700 1 -- 172.21.15.154:0/823202525 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699400cd20 con 0x7f69a00a1550 2023-09-30T22:24:49.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.813+0000 7f69a51e4700 1 -- 172.21.15.154:0/823202525 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a0123ba0 con 0x7f69a00a1550 2023-09-30T22:24:49.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.814+0000 7f69a51e4700 1 -- 172.21.15.154:0/823202525 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a01365a0 con 0x7f69a00a1550 2023-09-30T22:24:49.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.814+0000 7f69877fe700 1 -- 172.21.15.154:0/823202525 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6994013470 con 0x7f69a00a1550 2023-09-30T22:24:49.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.814+0000 7f69877fe700 1 -- 172.21.15.154:0/823202525 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6994040060 con 0x7f69a00a1550 2023-09-30T22:24:49.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.819+0000 7f69877fe700 1 -- 172.21.15.154:0/823202525 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6994013720 con 0x7f69a00a1550 2023-09-30T22:24:49.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.889+0000 7fd616d6b700 1 -- 172.21.15.154:0/1773697602 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd61006fff0 con 0x7fd610139280 2023-09-30T22:24:49.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.890+0000 7fd60d7fa700 1 -- 172.21.15.154:0/1773697602 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd60802a020 con 0x7fd610139280 2023-09-30T22:24:49.891 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:49.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.892+0000 7fd616d6b700 1 -- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd610139280 msgr2=0x7fd61012d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.892+0000 7fd616d6b700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd610139280 0x7fd61012d620 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd60800ef90 tx=0x7fd60800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.892+0000 7fd616d6b700 1 -- 172.21.15.154:0/1773697602 shutdown_connections 2023-09-30T22:24:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.892+0000 7fd616d6b700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd610139280 0x7fd61012d620 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.892+0000 7fd616d6b700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd610133ad0 0x7fd61012cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.892+0000 7fd616d6b700 1 --2- 172.21.15.154:0/1773697602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd610136960 0x7fd61012d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.892+0000 7fd616d6b700 1 -- 172.21.15.154:0/1773697602 >> 172.21.15.154:0/1773697602 conn(0x7fd610099c40 msgr2=0x7fd610134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.893+0000 7fd616d6b700 1 -- 172.21.15.154:0/1773697602 shutdown_connections 2023-09-30T22:24:49.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.895+0000 7fd616d6b700 1 -- 172.21.15.154:0/1773697602 wait complete. 2023-09-30T22:24:49.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:49.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.978+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/999986593 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb1812df80 con 0x7fcb18098410 2023-09-30T22:24:49.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.978+0000 7fcb14ff9700 1 -- 172.21.15.154:0/999986593 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb08023b50 con 0x7fcb18098410 2023-09-30T22:24:49.979 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:49.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.980+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb18098410 msgr2=0x7fcb1812b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:49.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.980+0000 7fcb1e3e2700 1 --2- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb18098410 0x7fcb1812b130 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009f60 tx=0x7fcb08009f90 comp rx=0 tx=0).stop 2023-09-30T22:24:49.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.980+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/999986593 shutdown_connections 2023-09-30T22:24:49.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.980+0000 7fcb1e3e2700 1 --2- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1809e240 0x7fcb1812bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.980+0000 7fcb1e3e2700 1 --2- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb18098410 0x7fcb1812b130 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.980+0000 7fcb1e3e2700 1 --2- 172.21.15.154:0/999986593 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb1809d8f0 0x7fcb1812b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:49.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.980+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/999986593 >> 172.21.15.154:0/999986593 conn(0x7fcb180a2b30 msgr2=0x7fcb181313b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:49.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.980+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/999986593 shutdown_connections 2023-09-30T22:24:49.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:49.980+0000 7fcb1e3e2700 1 -- 172.21.15.154:0/999986593 wait complete. 2023-09-30T22:24:49.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.015+0000 7f69a51e4700 1 -- 172.21.15.154:0/823202525 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f69a0122a80 con 0x7f69a00a1550 2023-09-30T22:24:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.016+0000 7f69877fe700 1 -- 172.21.15.154:0/823202525 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6994021020 con 0x7f69a00a1550 2023-09-30T22:24:50.016 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.018+0000 7f69a51e4700 1 -- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 msgr2=0x7f69a0120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.018+0000 7f69a51e4700 1 --2- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0120b60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f699400ec10 tx=0x7f699400ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.018+0000 7f69a51e4700 1 -- 172.21.15.154:0/823202525 shutdown_connections 2023-09-30T22:24:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.018+0000 7f69a51e4700 1 --2- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a0139200 0x7f69a01210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.018+0000 7f69a51e4700 1 --2- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69a00a0a70 0x7f69a0120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.018+0000 7f69a51e4700 1 --2- 172.21.15.154:0/823202525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00a1550 0x7f69a0120b60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.018+0000 7f69a51e4700 1 -- 172.21.15.154:0/823202525 >> 172.21.15.154:0/823202525 conn(0x7f69a00a6610 msgr2=0x7f69a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.018+0000 7f69a51e4700 1 -- 172.21.15.154:0/823202525 shutdown_connections 2023-09-30T22:24:50.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.018+0000 7f69a51e4700 1 -- 172.21.15.154:0/823202525 wait complete. 2023-09-30T22:24:50.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:50.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.457+0000 7fe3dbbc8700 1 Processor -- start 2023-09-30T22:24:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.457+0000 7fe3dbbc8700 1 -- start start 2023-09-30T22:24:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3dbbc8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3d409e340 0x7fe3d41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3dbbc8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d4135f20 0x7fe3d4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3dbbc8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d409aaa0 con 0x7fe3d409d860 2023-09-30T22:24:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3dbbc8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d409e730 con 0x7fe3d409e340 2023-09-30T22:24:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3dbbc8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d409f870 con 0x7fe3d4135f20 2023-09-30T22:24:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d9163700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3d409e340 0x7fe3d41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3da165700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d4135f20 0x7fe3d4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d9163700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3d409e340 0x7fe3d41359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52210/0 (socket says 172.21.15.154:52210) 2023-09-30T22:24:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3da165700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d4135f20 0x7fe3d4138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54396/0 (socket says 172.21.15.154:54396) 2023-09-30T22:24:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d9163700 1 -- 172.21.15.154:0/286672942 learned_addr learned my addr 172.21.15.154:0/286672942 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d9163700 1 -- 172.21.15.154:0/286672942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d4135f20 msgr2=0x7fe3d4138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d9163700 1 --2- 172.21.15.154:0/286672942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d4135f20 0x7fe3d4138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d9163700 1 -- 172.21.15.154:0/286672942 >> v1:172.21.15.154:6789/0 conn(0x7fe3d409d860 legacy=0x7fe3d409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d9163700 1 -- 172.21.15.154:0/286672942 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d409b360 con 0x7fe3d409e340 2023-09-30T22:24:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3da165700 1 --2- 172.21.15.154:0/286672942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d4135f20 0x7fe3d4138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d9163700 1 --2- 172.21.15.154:0/286672942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d409e340 0x7fe3d41359e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00098f0 tx=0x7fe3d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781b20401959d5f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d8962700 1 -- 172.21.15.154:0/286672942 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0011830 con 0x7fe3d409e340 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d8962700 1 -- 172.21.15.154:0/286672942 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d0011990 con 0x7fe3d409e340 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.458+0000 7fe3d8962700 1 -- 172.21.15.154:0/286672942 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0011d20 con 0x7fe3d409e340 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.459+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/286672942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d409e340 msgr2=0x7fe3d41359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.459+0000 7fe3dbbc8700 1 --2- 172.21.15.154:0/286672942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d409e340 0x7fe3d41359e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00098f0 tx=0x7fe3d0009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.459+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/286672942 shutdown_connections 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.459+0000 7fe3dbbc8700 1 --2- 172.21.15.154:0/286672942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d4135f20 0x7fe3d4138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.459+0000 7fe3dbbc8700 1 --2- 172.21.15.154:0/286672942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d409e340 0x7fe3d41359e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.459+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/286672942 >> 172.21.15.154:0/286672942 conn(0x7fe3d4099c40 msgr2=0x7fe3d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.459+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/286672942 shutdown_connections 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.459+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/286672942 wait complete. 2023-09-30T22:24:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.460+0000 7fe3dbbc8700 1 Processor -- start 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.460+0000 7fe3dbbc8700 1 -- start start 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.460+0000 7fe3dbbc8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3d409d860 0x7fe3d41c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.460+0000 7fe3dbbc8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d409e340 0x7fe3d41c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.460+0000 7fe3dbbc8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d4135f20 0x7fe3d41c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3dbbc8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d411b820 con 0x7fe3d4135f20 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3dbbc8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d411d7b0 con 0x7fe3d409d860 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3dbbc8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4072800 con 0x7fe3d409e340 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9964700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3d409d860 0x7fe3d41c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3da165700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d4135f20 0x7fe3d41c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9964700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3d409d860 0x7fe3d41c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40726/0 (socket says 172.21.15.154:40726) 2023-09-30T22:24:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9964700 1 -- 172.21.15.154:0/4185236793 learned_addr learned my addr 172.21.15.154:0/4185236793 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9163700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d409e340 0x7fe3d41c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9964700 1 -- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d409e340 msgr2=0x7fe3d41c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9964700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d409e340 0x7fe3d41c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9964700 1 -- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d4135f20 msgr2=0x7fe3d41c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9964700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d4135f20 0x7fe3d41c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9964700 1 -- 172.21.15.154:0/4185236793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc009a70 con 0x7fe3d409d860 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9163700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d409e340 0x7fe3d41c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3da165700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d4135f20 0x7fe3d41c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3d9964700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3d409d860 0x7fe3d41c85a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400c450 tx=0x7fe3c400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3ca7fc700 1 -- 172.21.15.154:0/4185236793 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40052d0 con 0x7fe3d409d860 2023-09-30T22:24:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3ca7fc700 1 -- 172.21.15.154:0/4185236793 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c4005430 con 0x7fe3d409d860 2023-09-30T22:24:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/4185236793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d0009550 con 0x7fe3d409d860 2023-09-30T22:24:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3ca7fc700 1 -- 172.21.15.154:0/4185236793 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40038c0 con 0x7fe3d409d860 2023-09-30T22:24:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.461+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/4185236793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d411ba60 con 0x7fe3d409d860 2023-09-30T22:24:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.462+0000 7fe3ca7fc700 1 -- 172.21.15.154:0/4185236793 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3c4003a20 con 0x7fe3d409d860 2023-09-30T22:24:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.462+0000 7fe3ca7fc700 1 -- 172.21.15.154:0/4185236793 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe3c403e960 con 0x7fe3d409d860 2023-09-30T22:24:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.462+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/4185236793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d404f2a0 con 0x7fe3d409d860 2023-09-30T22:24:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.467+0000 7fe3ca7fc700 1 -- 172.21.15.154:0/4185236793 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3c4019b40 con 0x7fe3d409d860 2023-09-30T22:24:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.649+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/4185236793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe3d4072210 con 0x7fe3d409d860 2023-09-30T22:24:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.649+0000 7fe3ca7fc700 1 -- 172.21.15.154:0/4185236793 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3c4017020 con 0x7fe3d409d860 2023-09-30T22:24:50.650 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.651+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3d409d860 msgr2=0x7fe3d41c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.651+0000 7fe3dbbc8700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3d409d860 0x7fe3d41c85a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400c450 tx=0x7fe3c400c760 comp rx=0 tx=0).stop 2023-09-30T22:24:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.651+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/4185236793 shutdown_connections 2023-09-30T22:24:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.651+0000 7fe3dbbc8700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3d4135f20 0x7fe3d41c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.651+0000 7fe3dbbc8700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3d409d860 0x7fe3d41c85a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.651+0000 7fe3dbbc8700 1 --2- 172.21.15.154:0/4185236793 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe3d409e340 0x7fe3d41c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.651+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/4185236793 >> 172.21.15.154:0/4185236793 conn(0x7fe3d4099c40 msgr2=0x7fe3d40a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.651+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/4185236793 shutdown_connections 2023-09-30T22:24:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:50.651+0000 7fe3dbbc8700 1 -- 172.21.15.154:0/4185236793 wait complete. 2023-09-30T22:24:50.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:50.908 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:50.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:51.031 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:51.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.031+0000 7fcf52c68700 1 Processor -- start 2023-09-30T22:24:51.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.031+0000 7fcf52c68700 1 -- start start 2023-09-30T22:24:51.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.032+0000 7fcf52c68700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.032+0000 7fcf52c68700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf4c09f180 0x7fcf4c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.032+0000 7fcf52c68700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c09c970 con 0x7fcf4c131d70 2023-09-30T22:24:51.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.032+0000 7fcf52c68700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c0a0920 con 0x7fcf4c09f180 2023-09-30T22:24:51.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.032+0000 7fcf52c68700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c09f9c0 con 0x7fcf4c09e870 2023-09-30T22:24:51.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.032+0000 7fcf4bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf4c09f180 0x7fcf4c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.032+0000 7fcf4bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf4c09f180 0x7fcf4c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52232/0 (socket says 172.21.15.154:52232) 2023-09-30T22:24:51.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.032+0000 7fcf4bfff700 1 -- 172.21.15.154:0/342441623 learned_addr learned my addr 172.21.15.154:0/342441623 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:51.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.032+0000 7fcf50a04700 1 --2- 172.21.15.154:0/342441623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.033+0000 7fcf4bfff700 1 -- 172.21.15.154:0/342441623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 msgr2=0x7fcf4c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.033+0000 7fcf4bfff700 1 --2- 172.21.15.154:0/342441623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.033+0000 7fcf4bfff700 1 -- 172.21.15.154:0/342441623 >> v1:172.21.15.154:6789/0 conn(0x7fcf4c131d70 legacy=0x7fcf4c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.033+0000 7fcf4bfff700 1 -- 172.21.15.154:0/342441623 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c09bab0 con 0x7fcf4c09f180 2023-09-30T22:24:51.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.033+0000 7fcf4bfff700 1 --2- 172.21.15.154:0/342441623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c09f180 0x7fcf4c131830 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcf380098f0 tx=0x7fcf38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3198120da732d692 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.033+0000 7fcf4b7fe700 1 -- 172.21.15.154:0/342441623 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38011830 con 0x7fcf4c09f180 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.033+0000 7fcf4b7fe700 1 -- 172.21.15.154:0/342441623 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38011990 con 0x7fcf4c09f180 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.033+0000 7fcf4b7fe700 1 -- 172.21.15.154:0/342441623 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38011d20 con 0x7fcf4c09f180 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.034+0000 7fcf52c68700 1 -- 172.21.15.154:0/342441623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c09f180 msgr2=0x7fcf4c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.034+0000 7fcf52c68700 1 --2- 172.21.15.154:0/342441623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c09f180 0x7fcf4c131830 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcf380098f0 tx=0x7fcf38009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.034+0000 7fcf52c68700 1 -- 172.21.15.154:0/342441623 shutdown_connections 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.034+0000 7fcf52c68700 1 --2- 172.21.15.154:0/342441623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.034+0000 7fcf52c68700 1 --2- 172.21.15.154:0/342441623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c09f180 0x7fcf4c131830 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.034+0000 7fcf52c68700 1 -- 172.21.15.154:0/342441623 >> 172.21.15.154:0/342441623 conn(0x7fcf4c0a4430 msgr2=0x7fcf4c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.034+0000 7fcf52c68700 1 -- 172.21.15.154:0/342441623 shutdown_connections 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.034+0000 7fcf52c68700 1 -- 172.21.15.154:0/342441623 wait complete. 2023-09-30T22:24:51.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf52c68700 1 Processor -- start 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf52c68700 1 -- start start 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf52c68700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf52c68700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf4c09f180 0x7fcf4c120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf52c68700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c131d70 0x7fcf4c1210b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf52c68700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c122240 con 0x7fcf4c131d70 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf52c68700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c09b160 con 0x7fcf4c09e870 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf52c68700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c09dba0 con 0x7fcf4c09f180 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf50a04700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf51205700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c131d70 0x7fcf4c1210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf50a04700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c120630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40752/0 (socket says 172.21.15.154:40752) 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf50a04700 1 -- 172.21.15.154:0/2805685675 learned_addr learned my addr 172.21.15.154:0/2805685675 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:51.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.035+0000 7fcf4bfff700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf4c09f180 0x7fcf4c120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf4bfff700 1 -- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 msgr2=0x7fcf4c120630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf4bfff700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c120630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf4bfff700 1 -- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c131d70 msgr2=0x7fcf4c1210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf4bfff700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c131d70 0x7fcf4c1210b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf4bfff700 1 -- 172.21.15.154:0/2805685675 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38009550 con 0x7fcf4c09f180 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf50a04700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf51205700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c131d70 0x7fcf4c1210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf4bfff700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf4c09f180 0x7fcf4c120b70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcf38016000 tx=0x7fcf38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf497fa700 1 -- 172.21.15.154:0/2805685675 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380036a0 con 0x7fcf4c09f180 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf497fa700 1 -- 172.21.15.154:0/2805685675 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38003800 con 0x7fcf4c09f180 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf52c68700 1 -- 172.21.15.154:0/2805685675 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c131580 con 0x7fcf4c09f180 2023-09-30T22:24:51.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf497fa700 1 -- 172.21.15.154:0/2805685675 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38003bb0 con 0x7fcf4c09f180 2023-09-30T22:24:51.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.036+0000 7fcf52c68700 1 -- 172.21.15.154:0/2805685675 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c124650 con 0x7fcf4c09f180 2023-09-30T22:24:51.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.037+0000 7fcf497fa700 1 -- 172.21.15.154:0/2805685675 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf38021070 con 0x7fcf4c09f180 2023-09-30T22:24:51.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.037+0000 7fcf52c68700 1 -- 172.21.15.154:0/2805685675 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c132660 con 0x7fcf4c09f180 2023-09-30T22:24:51.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.037+0000 7fcf497fa700 1 -- 172.21.15.154:0/2805685675 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf38040a30 con 0x7fcf4c09f180 2023-09-30T22:24:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.046+0000 7fcf497fa700 1 -- 172.21.15.154:0/2805685675 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf3800b3e0 con 0x7fcf4c09f180 2023-09-30T22:24:51.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.125+0000 7fbad0005700 1 Processor -- start 2023-09-30T22:24:51.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.125+0000 7fbad0005700 1 -- start start 2023-09-30T22:24:51.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.126+0000 7fbad0005700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134140 0x7fbac8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.126+0000 7fbad0005700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbac8134570 0x7fbac813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.126+0000 7fbad0005700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac809b110 con 0x7fbac809ad40 2023-09-30T22:24:51.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.126+0000 7fbad0005700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac80a3b60 con 0x7fbac8134570 2023-09-30T22:24:51.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.126+0000 7fbad0005700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80a1a80 con 0x7fbac8134140 2023-09-30T22:24:51.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.126+0000 7fbacd5a0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134140 0x7fbac8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.126+0000 7fbacdda1700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbac809ad40 0x7fbac8133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40402/0 (socket says 172.21.15.154:40402) 2023-09-30T22:24:51.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.126+0000 7fbacdda1700 1 -- 172.21.15.154:0/2088553996 learned_addr learned my addr 172.21.15.154:0/2088553996 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:51.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.126+0000 7fbace5a2700 1 --2- 172.21.15.154:0/2088553996 >> v2:172.21.15.154:3300/0 conn(0x7fbac8134570 0x7fbac813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.127+0000 7fbacd5a0700 1 -- 172.21.15.154:0/2088553996 >> v2:172.21.15.154:3300/0 conn(0x7fbac8134570 msgr2=0x7fbac813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.127+0000 7fbacd5a0700 1 --2- 172.21.15.154:0/2088553996 >> v2:172.21.15.154:3300/0 conn(0x7fbac8134570 0x7fbac813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.127+0000 7fbacd5a0700 1 -- 172.21.15.154:0/2088553996 >> v1:172.21.15.154:6789/0 conn(0x7fbac809ad40 legacy=0x7fbac8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.127+0000 7fbacd5a0700 1 -- 172.21.15.154:0/2088553996 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80a2fa0 con 0x7fbac8134140 2023-09-30T22:24:51.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.127+0000 7fbacd5a0700 1 --2- 172.21.15.154:0/2088553996 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134140 0x7fbac8138e80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009840 tx=0x7fbab8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23cdb78b1e63d734 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.127+0000 7fbaccd9f700 1 -- 172.21.15.154:0/2088553996 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8011830 con 0x7fbac8134140 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.127+0000 7fbaccd9f700 1 -- 172.21.15.154:0/2088553996 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab8011990 con 0x7fbac8134140 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.127+0000 7fbaccd9f700 1 -- 172.21.15.154:0/2088553996 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8011d20 con 0x7fbac8134140 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.128+0000 7fbad0005700 1 -- 172.21.15.154:0/2088553996 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134140 msgr2=0x7fbac8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.128+0000 7fbad0005700 1 --2- 172.21.15.154:0/2088553996 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134140 0x7fbac8138e80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009840 tx=0x7fbab8009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.128+0000 7fbad0005700 1 -- 172.21.15.154:0/2088553996 shutdown_connections 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.128+0000 7fbad0005700 1 --2- 172.21.15.154:0/2088553996 >> v2:172.21.15.154:3300/0 conn(0x7fbac8134570 0x7fbac813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.128+0000 7fbad0005700 1 --2- 172.21.15.154:0/2088553996 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134140 0x7fbac8138e80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.128+0000 7fbad0005700 1 -- 172.21.15.154:0/2088553996 >> 172.21.15.154:0/2088553996 conn(0x7fbac8099c40 msgr2=0x7fbac806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.128+0000 7fbad0005700 1 -- 172.21.15.154:0/2088553996 shutdown_connections 2023-09-30T22:24:51.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.128+0000 7fbad0005700 1 -- 172.21.15.154:0/2088553996 wait complete. 2023-09-30T22:24:51.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.129+0000 7fbad0005700 1 Processor -- start 2023-09-30T22:24:51.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.129+0000 7fbad0005700 1 -- start start 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbad0005700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac809ad40 0x7fbac811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbad0005700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbac8134140 0x7fbac811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbad0005700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134570 0x7fbac811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbad0005700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80a4110 con 0x7fbac809ad40 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbad0005700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac811ef40 con 0x7fbac8134140 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbad0005700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbac809c7e0 con 0x7fbac8134570 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbace5a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134570 0x7fbac811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbace5a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134570 0x7fbac811d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54432/0 (socket says 172.21.15.154:54432) 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbace5a2700 1 -- 172.21.15.154:0/1198496662 learned_addr learned my addr 172.21.15.154:0/1198496662 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbacdda1700 1 --2- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac809ad40 0x7fbac811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbacd5a0700 1 --2- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbac8134140 0x7fbac811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbacdda1700 1 -- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134570 msgr2=0x7fbac811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbacdda1700 1 --2- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134570 0x7fbac811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbacdda1700 1 -- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbac8134140 msgr2=0x7fbac811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbacdda1700 1 --2- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbac8134140 0x7fbac811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.130+0000 7fbacdda1700 1 -- 172.21.15.154:0/1198496662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab80094a0 con 0x7fbac809ad40 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.131+0000 7fbacdda1700 1 --2- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac809ad40 0x7fbac811c8c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c3c0 tx=0x7fbac400c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.131+0000 7fbabe7fc700 1 -- 172.21.15.154:0/1198496662 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4005b40 con 0x7fbac809ad40 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.131+0000 7fbabe7fc700 1 -- 172.21.15.154:0/1198496662 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4005ca0 con 0x7fbac809ad40 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.131+0000 7fbad0005700 1 -- 172.21.15.154:0/1198496662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac811e9a0 con 0x7fbac809ad40 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.131+0000 7fbabe7fc700 1 -- 172.21.15.154:0/1198496662 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac40072d0 con 0x7fbac809ad40 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.131+0000 7fbad0005700 1 -- 172.21.15.154:0/1198496662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac8139820 con 0x7fbac809ad40 2023-09-30T22:24:51.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.132+0000 7fbabe7fc700 1 -- 172.21.15.154:0/1198496662 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbac4007430 con 0x7fbac809ad40 2023-09-30T22:24:51.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.132+0000 7fbad0005700 1 -- 172.21.15.154:0/1198496662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac804f2a0 con 0x7fbac809ad40 2023-09-30T22:24:51.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.132+0000 7fbabe7fc700 1 -- 172.21.15.154:0/1198496662 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbac403e920 con 0x7fbac809ad40 2023-09-30T22:24:51.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.137+0000 7fbabe7fc700 1 -- 172.21.15.154:0/1198496662 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbac40076e0 con 0x7fbac809ad40 2023-09-30T22:24:51.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.160+0000 7f4147542700 1 Processor -- start 2023-09-30T22:24:51.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.160+0000 7f4147542700 1 -- start start 2023-09-30T22:24:51.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.160+0000 7f4147542700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41400a0a90 0x7f41400a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.160+0000 7f4147542700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.160+0000 7f4147542700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41400a1fe0 con 0x7f4140133f70 2023-09-30T22:24:51.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4147542700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41400a3aa0 con 0x7f41400a0a90 2023-09-30T22:24:51.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4147542700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f414009a540 con 0x7f41400a13a0 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4144add700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4145adf700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4140133f70 0x7f414013ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40408/0 (socket says 172.21.15.154:40408) 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4145adf700 1 -- 172.21.15.154:0/1969213954 learned_addr learned my addr 172.21.15.154:0/1969213954 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f41452de700 1 --2- 172.21.15.154:0/1969213954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41400a0a90 0x7f41400a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4144add700 1 -- 172.21.15.154:0/1969213954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41400a0a90 msgr2=0x7f41400a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4144add700 1 --2- 172.21.15.154:0/1969213954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41400a0a90 0x7f41400a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4144add700 1 -- 172.21.15.154:0/1969213954 >> v1:172.21.15.154:6789/0 conn(0x7f4140133f70 legacy=0x7f414013ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4144add700 1 -- 172.21.15.154:0/1969213954 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414009a280 con 0x7f41400a13a0 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4144add700 1 --2- 172.21.15.154:0/1969213954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140133a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4130009870 tx=0x7f4130009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c17fd6025a21f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4137fff700 1 -- 172.21.15.154:0/1969213954 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130011830 con 0x7f41400a13a0 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4137fff700 1 -- 172.21.15.154:0/1969213954 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4130011990 con 0x7f41400a13a0 2023-09-30T22:24:51.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.161+0000 7f4137fff700 1 -- 172.21.15.154:0/1969213954 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130011d20 con 0x7f41400a13a0 2023-09-30T22:24:51.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.162+0000 7f4147542700 1 -- 172.21.15.154:0/1969213954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 msgr2=0x7f4140133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.162+0000 7f4147542700 1 --2- 172.21.15.154:0/1969213954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140133a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4130009870 tx=0x7f4130009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:51.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.162+0000 7f4147542700 1 -- 172.21.15.154:0/1969213954 shutdown_connections 2023-09-30T22:24:51.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.162+0000 7f4147542700 1 --2- 172.21.15.154:0/1969213954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41400a0a90 0x7f41400a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.162+0000 7f4147542700 1 --2- 172.21.15.154:0/1969213954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140133a30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.162+0000 7f4147542700 1 -- 172.21.15.154:0/1969213954 >> 172.21.15.154:0/1969213954 conn(0x7f4140099c40 msgr2=0x7f414006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.162+0000 7f4147542700 1 -- 172.21.15.154:0/1969213954 shutdown_connections 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.162+0000 7f4147542700 1 -- 172.21.15.154:0/1969213954 wait complete. 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.163+0000 7f4147542700 1 Processor -- start 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.163+0000 7f4147542700 1 -- start start 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.163+0000 7f4147542700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41400a0a90 0x7f4140122310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.163+0000 7f4147542700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.163+0000 7f4147542700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4140133f70 0x7f4140122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.163+0000 7f4147542700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4140124de0 con 0x7f41400a0a90 2023-09-30T22:24:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4147542700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4140123ee0 con 0x7f4140133f70 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4147542700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f414009c7e0 con 0x7f41400a13a0 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4144add700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4144add700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140122850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54450/0 (socket says 172.21.15.154:54450) 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4144add700 1 -- 172.21.15.154:0/2258113651 learned_addr learned my addr 172.21.15.154:0/2258113651 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4145adf700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4140133f70 0x7f4140122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f41452de700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41400a0a90 0x7f4140122310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4144add700 1 -- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4140133f70 msgr2=0x7f4140122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4144add700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4140133f70 0x7f4140122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4144add700 1 -- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41400a0a90 msgr2=0x7f4140122310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4144add700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41400a0a90 0x7f4140122310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4144add700 1 -- 172.21.15.154:0/2258113651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41300094a0 con 0x7f41400a13a0 2023-09-30T22:24:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f41452de700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41400a0a90 0x7f4140122310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:51.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4144add700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140122850 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f41300090b0 tx=0x7f4130004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4135ffb700 1 -- 172.21.15.154:0/2258113651 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130004510 con 0x7f41400a13a0 2023-09-30T22:24:51.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4135ffb700 1 -- 172.21.15.154:0/2258113651 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413001f070 con 0x7f41400a13a0 2023-09-30T22:24:51.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4135ffb700 1 -- 172.21.15.154:0/2258113651 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41300038e0 con 0x7f41400a13a0 2023-09-30T22:24:51.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.164+0000 7f4147542700 1 -- 172.21.15.154:0/2258113651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4140125b10 con 0x7f41400a13a0 2023-09-30T22:24:51.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.165+0000 7f4147542700 1 -- 172.21.15.154:0/2258113651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4140125580 con 0x7f41400a13a0 2023-09-30T22:24:51.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.165+0000 7f4135ffb700 1 -- 172.21.15.154:0/2258113651 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4130003a40 con 0x7f41400a13a0 2023-09-30T22:24:51.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.166+0000 7f4135ffb700 1 -- 172.21.15.154:0/2258113651 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4130021070 con 0x7f41400a13a0 2023-09-30T22:24:51.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.166+0000 7f4147542700 1 -- 172.21.15.154:0/2258113651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414011f780 con 0x7f41400a13a0 2023-09-30T22:24:51.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.175+0000 7f4135ffb700 1 -- 172.21.15.154:0/2258113651 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f413001a430 con 0x7f41400a13a0 2023-09-30T22:24:51.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.249+0000 7fcf52c68700 1 -- 172.21.15.154:0/2805685675 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf4c04f2a0 con 0x7fcf4c09f180 2023-09-30T22:24:51.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.249+0000 7fcf497fa700 1 -- 172.21.15.154:0/2805685675 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf38015030 con 0x7fcf4c09f180 2023-09-30T22:24:51.250 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.252+0000 7fcf52c68700 1 -- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf4c09f180 msgr2=0x7fcf4c120b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.252+0000 7fcf52c68700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf4c09f180 0x7fcf4c120b70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcf38016000 tx=0x7fcf38004750 comp rx=0 tx=0).stop 2023-09-30T22:24:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.252+0000 7fcf52c68700 1 -- 172.21.15.154:0/2805685675 shutdown_connections 2023-09-30T22:24:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.252+0000 7fcf52c68700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf4c131d70 0x7fcf4c1210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.252+0000 7fcf52c68700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf4c09e870 0x7fcf4c120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.252+0000 7fcf52c68700 1 --2- 172.21.15.154:0/2805685675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf4c09f180 0x7fcf4c120b70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.252+0000 7fcf52c68700 1 -- 172.21.15.154:0/2805685675 >> 172.21.15.154:0/2805685675 conn(0x7fcf4c0a4430 msgr2=0x7fcf4c06fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.252+0000 7fcf52c68700 1 -- 172.21.15.154:0/2805685675 shutdown_connections 2023-09-30T22:24:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.252+0000 7fcf52c68700 1 -- 172.21.15.154:0/2805685675 wait complete. 2023-09-30T22:24:51.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.332+0000 7fbad0005700 1 -- 172.21.15.154:0/1198496662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbac80729d0 con 0x7fbac809ad40 2023-09-30T22:24:51.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.333+0000 7fbabe7fc700 1 -- 172.21.15.154:0/1198496662 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbac4017070 con 0x7fbac809ad40 2023-09-30T22:24:51.334 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.335+0000 7fbad0005700 1 -- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac809ad40 msgr2=0x7fbac811c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.335+0000 7fbad0005700 1 --2- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac809ad40 0x7fbac811c8c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c3c0 tx=0x7fbac400c6d0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.335+0000 7fbad0005700 1 -- 172.21.15.154:0/1198496662 shutdown_connections 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.335+0000 7fbad0005700 1 --2- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbac8134570 0x7fbac811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.335+0000 7fbad0005700 1 --2- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbac809ad40 0x7fbac811c8c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.335+0000 7fbad0005700 1 --2- 172.21.15.154:0/1198496662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbac8134140 0x7fbac811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.335+0000 7fbad0005700 1 -- 172.21.15.154:0/1198496662 >> 172.21.15.154:0/1198496662 conn(0x7fbac8099c40 msgr2=0x7fbac80a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.335+0000 7fbad0005700 1 -- 172.21.15.154:0/1198496662 shutdown_connections 2023-09-30T22:24:51.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.335+0000 7fbad0005700 1 -- 172.21.15.154:0/1198496662 wait complete. 2023-09-30T22:24:51.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.369+0000 7f4147542700 1 -- 172.21.15.154:0/2258113651 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f414004f2a0 con 0x7f41400a13a0 2023-09-30T22:24:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.370+0000 7f4135ffb700 1 -- 172.21.15.154:0/2258113651 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4130015020 con 0x7f41400a13a0 2023-09-30T22:24:51.370 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:51.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.372+0000 7f4147542700 1 -- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 msgr2=0x7f4140122850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.372+0000 7f4147542700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140122850 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f41300090b0 tx=0x7f4130004750 comp rx=0 tx=0).stop 2023-09-30T22:24:51.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.372+0000 7f4147542700 1 -- 172.21.15.154:0/2258113651 shutdown_connections 2023-09-30T22:24:51.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.372+0000 7f4147542700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4140133f70 0x7f4140122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.372+0000 7f4147542700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41400a0a90 0x7f4140122310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.372+0000 7f4147542700 1 --2- 172.21.15.154:0/2258113651 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41400a13a0 0x7f4140122850 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.372+0000 7f4147542700 1 -- 172.21.15.154:0/2258113651 >> 172.21.15.154:0/2258113651 conn(0x7f4140099c40 msgr2=0x7f414011c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.372+0000 7f4147542700 1 -- 172.21.15.154:0/2258113651 shutdown_connections 2023-09-30T22:24:51.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.372+0000 7f4147542700 1 -- 172.21.15.154:0/2258113651 wait complete. 2023-09-30T22:24:51.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:51.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:51.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.787+0000 7fcccc65e700 1 Processor -- start 2023-09-30T22:24:51.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.787+0000 7fcccc65e700 1 -- start start 2023-09-30T22:24:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fcccc65e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc4134140 0x7fccc4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fcccc65e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134570 0x7fccc413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fcccc65e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc409b110 con 0x7fccc409ad40 2023-09-30T22:24:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fcccc65e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40a3b60 con 0x7fccc4134140 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fcccc65e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40a1a80 con 0x7fccc4134570 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fccca3fa700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fccc409ad40 0x7fccc4133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40422/0 (socket says 172.21.15.154:40422) 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fcccabfb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134570 0x7fccc413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fccca3fa700 1 -- 172.21.15.154:0/2677426852 learned_addr learned my addr 172.21.15.154:0/2677426852 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fccc9bf9700 1 --2- 172.21.15.154:0/2677426852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc4134140 0x7fccc4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fccc93f8700 1 -- 172.21.15.154:0/2677426852 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139395753 0 0) 0x7fccc409b110 con 0x7fccc409ad40 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fccc93f8700 1 -- 172.21.15.154:0/2677426852 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb00035b0 con 0x7fccc409ad40 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fccc9bf9700 1 -- 172.21.15.154:0/2677426852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134570 msgr2=0x7fccc413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fccc9bf9700 1 --2- 172.21.15.154:0/2677426852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134570 0x7fccc413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fccc9bf9700 1 -- 172.21.15.154:0/2677426852 >> v1:172.21.15.154:6789/0 conn(0x7fccc409ad40 legacy=0x7fccc4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fccc9bf9700 1 -- 172.21.15.154:0/2677426852 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40a2fa0 con 0x7fccc4134140 2023-09-30T22:24:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.788+0000 7fcccabfb700 1 --2- 172.21.15.154:0/2677426852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134570 0x7fccc413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fccc9bf9700 1 --2- 172.21.15.154:0/2677426852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc4134140 0x7fccc4138e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fccc00098a0 tx=0x7fccc0009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556e1ec68b95d71b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fccc93f8700 1 -- 172.21.15.154:0/2677426852 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0011830 con 0x7fccc4134140 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fccc93f8700 1 -- 172.21.15.154:0/2677426852 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc0011990 con 0x7fccc4134140 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fccc93f8700 1 -- 172.21.15.154:0/2677426852 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0011d20 con 0x7fccc4134140 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fcccc65e700 1 -- 172.21.15.154:0/2677426852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc4134140 msgr2=0x7fccc4138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fcccc65e700 1 --2- 172.21.15.154:0/2677426852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc4134140 0x7fccc4138e80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fccc00098a0 tx=0x7fccc0009bb0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fcccc65e700 1 -- 172.21.15.154:0/2677426852 shutdown_connections 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fcccc65e700 1 --2- 172.21.15.154:0/2677426852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134570 0x7fccc413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fcccc65e700 1 --2- 172.21.15.154:0/2677426852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc4134140 0x7fccc4138e80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fcccc65e700 1 -- 172.21.15.154:0/2677426852 >> 172.21.15.154:0/2677426852 conn(0x7fccc4099c40 msgr2=0x7fccc406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fcccc65e700 1 -- 172.21.15.154:0/2677426852 shutdown_connections 2023-09-30T22:24:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.789+0000 7fcccc65e700 1 -- 172.21.15.154:0/2677426852 wait complete. 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.790+0000 7fcccc65e700 1 Processor -- start 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.790+0000 7fcccc65e700 1 -- start start 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fcccc65e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc409ad40 0x7fccc4139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fcccc65e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134140 0x7fccc41399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fcccc65e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc4134570 0x7fccc4139f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fcccc65e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc41336f0 con 0x7fccc4134570 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fcccc65e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc411e110 con 0x7fccc409ad40 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fcccc65e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccc411eaf0 con 0x7fccc4134140 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccca3fa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc409ad40 0x7fccc4139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccc9bf9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134140 0x7fccc41399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccca3fa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc409ad40 0x7fccc4139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40810/0 (socket says 172.21.15.154:40810) 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccca3fa700 1 -- 172.21.15.154:0/1253765812 learned_addr learned my addr 172.21.15.154:0/1253765812 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fcccabfb700 1 --2- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc4134570 0x7fccc4139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccca3fa700 1 -- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134140 msgr2=0x7fccc41399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccca3fa700 1 --2- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134140 0x7fccc41399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccca3fa700 1 -- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc4134570 msgr2=0x7fccc4139f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccca3fa700 1 --2- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc4134570 0x7fccc4139f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccca3fa700 1 -- 172.21.15.154:0/1253765812 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc009a70 con 0x7fccc409ad40 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccca3fa700 1 --2- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc409ad40 0x7fccc4139490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fccb4001eb0 tx=0x7fccb400c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccbaffd700 1 -- 172.21.15.154:0/1253765812 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4005d70 con 0x7fccc409ad40 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccbaffd700 1 -- 172.21.15.154:0/1253765812 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb40070d0 con 0x7fccc409ad40 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fcccc65e700 1 -- 172.21.15.154:0/1253765812 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc00094a0 con 0x7fccc409ad40 2023-09-30T22:24:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.791+0000 7fccbaffd700 1 -- 172.21.15.154:0/1253765812 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4007460 con 0x7fccc409ad40 2023-09-30T22:24:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.792+0000 7fcccc65e700 1 -- 172.21.15.154:0/1253765812 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc409e500 con 0x7fccc409ad40 2023-09-30T22:24:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.792+0000 7fccbaffd700 1 -- 172.21.15.154:0/1253765812 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccb40075c0 con 0x7fccc409ad40 2023-09-30T22:24:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.792+0000 7fccbaffd700 1 -- 172.21.15.154:0/1253765812 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fccb403ea60 con 0x7fccc409ad40 2023-09-30T22:24:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.792+0000 7fcccc65e700 1 -- 172.21.15.154:0/1253765812 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc41361e0 con 0x7fccc409ad40 2023-09-30T22:24:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.798+0000 7fccbaffd700 1 -- 172.21.15.154:0/1253765812 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccb4017070 con 0x7fccc409ad40 2023-09-30T22:24:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.984+0000 7fcccc65e700 1 -- 172.21.15.154:0/1253765812 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fccc409c7e0 con 0x7fccc409ad40 2023-09-30T22:24:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.984+0000 7fccbaffd700 1 -- 172.21.15.154:0/1253765812 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fccb4017070 con 0x7fccc409ad40 2023-09-30T22:24:51.985 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:51.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.986+0000 7fcccc65e700 1 -- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc409ad40 msgr2=0x7fccc4139490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:51.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.986+0000 7fcccc65e700 1 --2- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc409ad40 0x7fccc4139490 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fccb4001eb0 tx=0x7fccb400c7b0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.986+0000 7fcccc65e700 1 -- 172.21.15.154:0/1253765812 shutdown_connections 2023-09-30T22:24:51.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.986+0000 7fcccc65e700 1 --2- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccc4134570 0x7fccc4139f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.986+0000 7fcccc65e700 1 --2- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccc409ad40 0x7fccc4139490 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.986+0000 7fcccc65e700 1 --2- 172.21.15.154:0/1253765812 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccc4134140 0x7fccc41399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:51.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.986+0000 7fcccc65e700 1 -- 172.21.15.154:0/1253765812 >> 172.21.15.154:0/1253765812 conn(0x7fccc4099c40 msgr2=0x7fccc413b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:51.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.986+0000 7fcccc65e700 1 -- 172.21.15.154:0/1253765812 shutdown_connections 2023-09-30T22:24:51.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:51.986+0000 7fcccc65e700 1 -- 172.21.15.154:0/1253765812 wait complete. 2023-09-30T22:24:51.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:52.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:52.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:52.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:52.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.393+0000 7f0739206700 1 Processor -- start 2023-09-30T22:24:52.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.393+0000 7f0739206700 1 -- start start 2023-09-30T22:24:52.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.393+0000 7f0739206700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07340a1550 0x7f0734138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.393+0000 7f0739206700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 0x7f073413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.393+0000 7f0739206700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073409e9d0 con 0x7f07340a0a70 2023-09-30T22:24:52.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.393+0000 7f0739206700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073409dc00 con 0x7f07340a1550 2023-09-30T22:24:52.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.393+0000 7f0739206700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073409dec0 con 0x7f0734139200 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07340a1550 0x7f0734138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073359e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 0x7f073413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07340a1550 0x7f0734138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52296/0 (socket says 172.21.15.154:52296) 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073259c700 1 -- 172.21.15.154:0/1755903109 learned_addr learned my addr 172.21.15.154:0/1755903109 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073359e700 1 -- 172.21.15.154:0/1755903109 >> v2:172.21.15.154:3300/0 conn(0x7f07340a1550 msgr2=0x7f0734138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073359e700 1 --2- 172.21.15.154:0/1755903109 >> v2:172.21.15.154:3300/0 conn(0x7f07340a1550 0x7f0734138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073359e700 1 -- 172.21.15.154:0/1755903109 >> v1:172.21.15.154:6789/0 conn(0x7f07340a0a70 legacy=0x7f07340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073359e700 1 -- 172.21.15.154:0/1755903109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073409e6a0 con 0x7f0734139200 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073259c700 1 --2- 172.21.15.154:0/1755903109 >> v2:172.21.15.154:3300/0 conn(0x7f07340a1550 0x7f0734138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f073359e700 1 --2- 172.21.15.154:0/1755903109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 0x7f073413b5e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f072c009d90 tx=0x7f072c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e3517c446848811 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f0731d9b700 1 -- 172.21.15.154:0/1755903109 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c00e070 con 0x7f0734139200 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f0731d9b700 1 -- 172.21.15.154:0/1755903109 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c00bb20 con 0x7f0734139200 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.394+0000 7f0731d9b700 1 -- 172.21.15.154:0/1755903109 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c012430 con 0x7f0734139200 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.395+0000 7f0739206700 1 -- 172.21.15.154:0/1755903109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 msgr2=0x7f073413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.395+0000 7f0739206700 1 --2- 172.21.15.154:0/1755903109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 0x7f073413b5e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f072c009d90 tx=0x7f072c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.395+0000 7f0739206700 1 -- 172.21.15.154:0/1755903109 shutdown_connections 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.395+0000 7f0739206700 1 --2- 172.21.15.154:0/1755903109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 0x7f073413b5e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.395+0000 7f0739206700 1 --2- 172.21.15.154:0/1755903109 >> v2:172.21.15.154:3300/0 conn(0x7f07340a1550 0x7f0734138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.395+0000 7f0739206700 1 -- 172.21.15.154:0/1755903109 >> 172.21.15.154:0/1755903109 conn(0x7f07340a6610 msgr2=0x7f07340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.395+0000 7f0739206700 1 -- 172.21.15.154:0/1755903109 shutdown_connections 2023-09-30T22:24:52.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.395+0000 7f0739206700 1 -- 172.21.15.154:0/1755903109 wait complete. 2023-09-30T22:24:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.396+0000 7f0739206700 1 Processor -- start 2023-09-30T22:24:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.396+0000 7f0739206700 1 -- start start 2023-09-30T22:24:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f0739206700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07340a0a70 0x7f073411e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f0739206700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07340a1550 0x7f073411ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f0739206700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 0x7f073411f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f0739206700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07340a0470 con 0x7f07340a1550 2023-09-30T22:24:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f0739206700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0734122050 con 0x7f0734139200 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f0739206700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0734121aa0 con 0x7f07340a0a70 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f073259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07340a1550 0x7f073411ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f073259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07340a1550 0x7f073411ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52308/0 (socket says 172.21.15.154:52308) 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f073259c700 1 -- 172.21.15.154:0/4049238519 learned_addr learned my addr 172.21.15.154:0/4049238519 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f0732d9d700 1 --2- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07340a0a70 0x7f073411e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f073359e700 1 --2- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 0x7f073411f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f073259c700 1 -- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07340a0a70 msgr2=0x7f073411e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f073259c700 1 --2- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07340a0a70 0x7f073411e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f073259c700 1 -- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 msgr2=0x7f073411f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f073259c700 1 --2- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 0x7f073411f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.397+0000 7f073259c700 1 -- 172.21.15.154:0/4049238519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728009550 con 0x7f07340a1550 2023-09-30T22:24:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.398+0000 7f073259c700 1 --2- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07340a1550 0x7f073411ede0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f072800ebe0 tx=0x7f072800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.398+0000 7f071b7fe700 1 -- 172.21.15.154:0/4049238519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072800c850 con 0x7f07340a1550 2023-09-30T22:24:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.398+0000 7f071b7fe700 1 -- 172.21.15.154:0/4049238519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072800c9b0 con 0x7f07340a1550 2023-09-30T22:24:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.398+0000 7f0739206700 1 -- 172.21.15.154:0/4049238519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c009a70 con 0x7f07340a1550 2023-09-30T22:24:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.398+0000 7f071b7fe700 1 -- 172.21.15.154:0/4049238519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072800cd40 con 0x7f07340a1550 2023-09-30T22:24:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.398+0000 7f0739206700 1 -- 172.21.15.154:0/4049238519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0734120530 con 0x7f07340a1550 2023-09-30T22:24:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.399+0000 7f0739206700 1 -- 172.21.15.154:0/4049238519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073404f2a0 con 0x7f07340a1550 2023-09-30T22:24:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.399+0000 7f071b7fe700 1 -- 172.21.15.154:0/4049238519 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0728013470 con 0x7f07340a1550 2023-09-30T22:24:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.399+0000 7f071b7fe700 1 -- 172.21.15.154:0/4049238519 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0728040080 con 0x7f07340a1550 2023-09-30T22:24:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.408+0000 7f071b7fe700 1 -- 172.21.15.154:0/4049238519 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0728011760 con 0x7f07340a1550 2023-09-30T22:24:52.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.484+0000 7effd4715700 1 Processor -- start 2023-09-30T22:24:52.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd4715700 1 -- start start 2023-09-30T22:24:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd4715700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effcc0a0a70 0x7effcc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd4715700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a1380 0x7effcc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd4715700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd4715700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effcc09e9d0 con 0x7effcc0a0a70 2023-09-30T22:24:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd4715700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc09dc00 con 0x7effcc0a1380 2023-09-30T22:24:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd4715700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effcc09dec0 con 0x7effcc133f50 2023-09-30T22:24:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd24b1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effcc0a0a70 0x7effcc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd2cb2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd2cb2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54478/0 (socket says 172.21.15.154:54478) 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd2cb2700 1 -- 172.21.15.154:0/389061599 learned_addr learned my addr 172.21.15.154:0/389061599 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd24b1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effcc0a0a70 0x7effcc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52310/0 (socket says 172.21.15.154:52310) 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.485+0000 7effd1cb0700 1 --2- 172.21.15.154:0/389061599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a1380 0x7effcc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd2cb2700 1 -- 172.21.15.154:0/389061599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a1380 msgr2=0x7effcc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd2cb2700 1 --2- 172.21.15.154:0/389061599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a1380 0x7effcc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd2cb2700 1 -- 172.21.15.154:0/389061599 >> v2:172.21.15.154:3300/0 conn(0x7effcc0a0a70 msgr2=0x7effcc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd2cb2700 1 --2- 172.21.15.154:0/389061599 >> v2:172.21.15.154:3300/0 conn(0x7effcc0a0a70 0x7effcc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd2cb2700 1 -- 172.21.15.154:0/389061599 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc09e6a0 con 0x7effcc133f50 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd1cb0700 1 --2- 172.21.15.154:0/389061599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a1380 0x7effcc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd2cb2700 1 --2- 172.21.15.154:0/389061599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc1343b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7effc4009e50 tx=0x7effc400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be3243c2b358860 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd14af700 1 -- 172.21.15.154:0/389061599 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc400e070 con 0x7effcc133f50 2023-09-30T22:24:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd14af700 1 -- 172.21.15.154:0/389061599 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc400b910 con 0x7effcc133f50 2023-09-30T22:24:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.486+0000 7effd14af700 1 -- 172.21.15.154:0/389061599 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc400bcc0 con 0x7effcc133f50 2023-09-30T22:24:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.487+0000 7effd4715700 1 -- 172.21.15.154:0/389061599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 msgr2=0x7effcc1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.487+0000 7effd4715700 1 --2- 172.21.15.154:0/389061599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc1343b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7effc4009e50 tx=0x7effc400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.487+0000 7effd4715700 1 -- 172.21.15.154:0/389061599 shutdown_connections 2023-09-30T22:24:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.487+0000 7effd4715700 1 --2- 172.21.15.154:0/389061599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc1343b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.487+0000 7effd4715700 1 --2- 172.21.15.154:0/389061599 >> v2:172.21.15.154:3300/0 conn(0x7effcc0a0a70 0x7effcc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.487+0000 7effd4715700 1 --2- 172.21.15.154:0/389061599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a1380 0x7effcc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.487+0000 7effd4715700 1 -- 172.21.15.154:0/389061599 >> 172.21.15.154:0/389061599 conn(0x7effcc0a6610 msgr2=0x7effcc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.487+0000 7effd4715700 1 -- 172.21.15.154:0/389061599 shutdown_connections 2023-09-30T22:24:52.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.487+0000 7effd4715700 1 -- 172.21.15.154:0/389061599 wait complete. 2023-09-30T22:24:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd4715700 1 Processor -- start 2023-09-30T22:24:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd4715700 1 -- start start 2023-09-30T22:24:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd4715700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a0a70 0x7effcc121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd4715700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0a1380 0x7effcc121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd4715700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd4715700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc124e50 con 0x7effcc0a1380 2023-09-30T22:24:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd4715700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc123dd0 con 0x7effcc0a0a70 2023-09-30T22:24:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd4715700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0a03e0 con 0x7effcc133f50 2023-09-30T22:24:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd1cb0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0a1380 0x7effcc121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd1cb0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0a1380 0x7effcc121870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52314/0 (socket says 172.21.15.154:52314) 2023-09-30T22:24:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd1cb0700 1 -- 172.21.15.154:0/617692124 learned_addr learned my addr 172.21.15.154:0/617692124 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.488+0000 7effd2cb2700 1 --2- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effd24b1700 1 --2- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a0a70 0x7effcc121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effd1cb0700 1 -- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 msgr2=0x7effcc121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effd1cb0700 1 --2- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effd1cb0700 1 -- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a0a70 msgr2=0x7effcc121330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effd1cb0700 1 --2- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a0a70 0x7effcc121330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effd1cb0700 1 -- 172.21.15.154:0/617692124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0094a0 con 0x7effcc0a1380 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effd1cb0700 1 --2- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0a1380 0x7effcc121870 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7effbc00ec10 tx=0x7effbc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effc2ffd700 1 -- 172.21.15.154:0/617692124 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00c850 con 0x7effcc0a1380 2023-09-30T22:24:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effd4715700 1 -- 172.21.15.154:0/617692124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc4009b30 con 0x7effcc0a1380 2023-09-30T22:24:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effc2ffd700 1 -- 172.21.15.154:0/617692124 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc00c9b0 con 0x7effcc0a1380 2023-09-30T22:24:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effc2ffd700 1 -- 172.21.15.154:0/617692124 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00cd20 con 0x7effcc0a1380 2023-09-30T22:24:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.489+0000 7effd4715700 1 -- 172.21.15.154:0/617692124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc122f40 con 0x7effcc0a1380 2023-09-30T22:24:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.490+0000 7effc2ffd700 1 -- 172.21.15.154:0/617692124 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effbc013470 con 0x7effcc0a1380 2023-09-30T22:24:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.490+0000 7effc2ffd700 1 -- 172.21.15.154:0/617692124 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7effbc03f800 con 0x7effcc0a1380 2023-09-30T22:24:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.490+0000 7effd4715700 1 -- 172.21.15.154:0/617692124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc124220 con 0x7effcc0a1380 2023-09-30T22:24:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.495+0000 7effc2ffd700 1 -- 172.21.15.154:0/617692124 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effbc013720 con 0x7effcc0a1380 2023-09-30T22:24:52.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.524+0000 7f0a0a102700 1 Processor -- start 2023-09-30T22:24:52.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.524+0000 7f0a0a102700 1 -- start start 2023-09-30T22:24:52.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.524+0000 7f0a0a102700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.524+0000 7f0a0a102700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a040a1380 0x7f0a04133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.524+0000 7f0a0a102700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a04133f50 0x7f0a04134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.524+0000 7f0a0a102700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0409e9d0 con 0x7f0a040a1380 2023-09-30T22:24:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.524+0000 7f0a0a102700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0409dc00 con 0x7f0a040a0a70 2023-09-30T22:24:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.524+0000 7f0a0a102700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0409dec0 con 0x7f0a04133f50 2023-09-30T22:24:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a02ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a040a1380 0x7f0a04133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a02ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a040a1380 0x7f0a04133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52320/0 (socket says 172.21.15.154:52320) 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a02ffd700 1 -- 172.21.15.154:0/1455416778 learned_addr learned my addr 172.21.15.154:0/1455416778 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a037fe700 1 --2- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a03fff700 1 --2- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a04133f50 0x7f0a04134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a037fe700 1 -- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a04133f50 msgr2=0x7f0a04134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a037fe700 1 --2- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a04133f50 0x7f0a04134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a037fe700 1 -- 172.21.15.154:0/1455416778 >> v2:172.21.15.154:3300/0 conn(0x7f0a040a1380 msgr2=0x7f0a04133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a037fe700 1 --2- 172.21.15.154:0/1455416778 >> v2:172.21.15.154:3300/0 conn(0x7f0a040a1380 0x7f0a04133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a037fe700 1 -- 172.21.15.154:0/1455416778 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0409e6a0 con 0x7f0a040a0a70 2023-09-30T22:24:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a03fff700 1 --2- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a04133f50 0x7f0a04134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a037fe700 1 --2- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a040a0e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009840 tx=0x7f09fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=678bc75df56e6da1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a027fc700 1 -- 172.21.15.154:0/1455416778 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc011830 con 0x7f0a040a0a70 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a027fc700 1 -- 172.21.15.154:0/1455416778 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc011990 con 0x7f0a040a0a70 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.525+0000 7f0a027fc700 1 -- 172.21.15.154:0/1455416778 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc011d20 con 0x7f0a040a0a70 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.526+0000 7f0a0a102700 1 -- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 msgr2=0x7f0a040a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.526+0000 7f0a0a102700 1 --2- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a040a0e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009840 tx=0x7f09fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.526+0000 7f0a0a102700 1 -- 172.21.15.154:0/1455416778 shutdown_connections 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.526+0000 7f0a0a102700 1 --2- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a040a0e40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.526+0000 7f0a0a102700 1 --2- 172.21.15.154:0/1455416778 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a04133f50 0x7f0a04134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.526+0000 7f0a0a102700 1 --2- 172.21.15.154:0/1455416778 >> v2:172.21.15.154:3300/0 conn(0x7f0a040a1380 0x7f0a04133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.526+0000 7f0a0a102700 1 -- 172.21.15.154:0/1455416778 >> 172.21.15.154:0/1455416778 conn(0x7f0a040a6610 msgr2=0x7f0a040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.526+0000 7f0a0a102700 1 -- 172.21.15.154:0/1455416778 shutdown_connections 2023-09-30T22:24:52.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.526+0000 7f0a0a102700 1 -- 172.21.15.154:0/1455416778 wait complete. 2023-09-30T22:24:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.527+0000 7f0a0a102700 1 Processor -- start 2023-09-30T22:24:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.527+0000 7f0a0a102700 1 -- start start 2023-09-30T22:24:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a0a102700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a041223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a0a102700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1380 0x7f0a04122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a0a102700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04133f50 0x7f0a04122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a0a102700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04123890 con 0x7f0a04133f50 2023-09-30T22:24:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a0a102700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04133790 con 0x7f0a040a0a70 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a0a102700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04124e60 con 0x7f0a040a1380 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a041223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a02ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1380 0x7f0a04122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a03fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04133f50 0x7f0a04122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a041223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40874/0 (socket says 172.21.15.154:40874) 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.528+0000 7f0a037fe700 1 -- 172.21.15.154:0/2056293987 learned_addr learned my addr 172.21.15.154:0/2056293987 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f0a037fe700 1 -- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1380 msgr2=0x7f0a04122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f0a037fe700 1 --2- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1380 0x7f0a04122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f0a037fe700 1 -- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04133f50 msgr2=0x7f0a04122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f0a037fe700 1 --2- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04133f50 0x7f0a04122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f0a037fe700 1 -- 172.21.15.154:0/2056293987 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4009a70 con 0x7f0a040a0a70 2023-09-30T22:24:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f0a03fff700 1 --2- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04133f50 0x7f0a04122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f0a037fe700 1 --2- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a041223c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0090b0 tx=0x7f09fc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f09ebfff700 1 -- 172.21.15.154:0/2056293987 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0044d0 con 0x7f0a040a0a70 2023-09-30T22:24:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f09ebfff700 1 -- 172.21.15.154:0/2056293987 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc01e070 con 0x7f0a040a0a70 2023-09-30T22:24:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f0a0a102700 1 -- 172.21.15.154:0/2056293987 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc0094a0 con 0x7f0a040a0a70 2023-09-30T22:24:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f09ebfff700 1 -- 172.21.15.154:0/2056293987 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0038e0 con 0x7f0a040a0a70 2023-09-30T22:24:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.529+0000 7f0a0a102700 1 -- 172.21.15.154:0/2056293987 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a04125670 con 0x7f0a040a0a70 2023-09-30T22:24:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.530+0000 7f09ebfff700 1 -- 172.21.15.154:0/2056293987 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09fc003a40 con 0x7f0a040a0a70 2023-09-30T22:24:52.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.530+0000 7f0a0a102700 1 -- 172.21.15.154:0/2056293987 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0411f050 con 0x7f0a040a0a70 2023-09-30T22:24:52.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.530+0000 7f09ebfff700 1 -- 172.21.15.154:0/2056293987 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09fc048350 con 0x7f0a040a0a70 2023-09-30T22:24:52.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.535+0000 7f09ebfff700 1 -- 172.21.15.154:0/2056293987 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09fc045060 con 0x7f0a040a0a70 2023-09-30T22:24:52.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.611+0000 7f0739206700 1 -- 172.21.15.154:0/4049238519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0734120c10 con 0x7f07340a1550 2023-09-30T22:24:52.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.611+0000 7f071b7fe700 1 -- 172.21.15.154:0/4049238519 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0728011350 con 0x7f07340a1550 2023-09-30T22:24:52.612 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.614+0000 7f0739206700 1 -- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07340a1550 msgr2=0x7f073411ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.614+0000 7f0739206700 1 --2- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07340a1550 0x7f073411ede0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f072800ebe0 tx=0x7f072800eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.614+0000 7f0739206700 1 -- 172.21.15.154:0/4049238519 shutdown_connections 2023-09-30T22:24:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.614+0000 7f0739206700 1 --2- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0734139200 0x7f073411f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.614+0000 7f0739206700 1 --2- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07340a0a70 0x7f073411e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.614+0000 7f0739206700 1 --2- 172.21.15.154:0/4049238519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07340a1550 0x7f073411ede0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.614+0000 7f0739206700 1 -- 172.21.15.154:0/4049238519 >> 172.21.15.154:0/4049238519 conn(0x7f07340a6610 msgr2=0x7f0734138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.614+0000 7f0739206700 1 -- 172.21.15.154:0/4049238519 shutdown_connections 2023-09-30T22:24:52.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.614+0000 7f0739206700 1 -- 172.21.15.154:0/4049238519 wait complete. 2023-09-30T22:24:52.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:52.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.690+0000 7effd4715700 1 -- 172.21.15.154:0/617692124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7effcc11e040 con 0x7effcc0a1380 2023-09-30T22:24:52.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.691+0000 7effc2ffd700 1 -- 172.21.15.154:0/617692124 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effbc01bd00 con 0x7effcc0a1380 2023-09-30T22:24:52.691 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:52.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.693+0000 7effd4715700 1 -- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0a1380 msgr2=0x7effcc121870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.693+0000 7effd4715700 1 --2- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0a1380 0x7effcc121870 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7effbc00ec10 tx=0x7effbc00ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:52.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.693+0000 7effd4715700 1 -- 172.21.15.154:0/617692124 shutdown_connections 2023-09-30T22:24:52.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.693+0000 7effd4715700 1 --2- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7effcc133f50 0x7effcc121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.693+0000 7effd4715700 1 --2- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effcc0a0a70 0x7effcc121330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.693+0000 7effd4715700 1 --2- 172.21.15.154:0/617692124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effcc0a1380 0x7effcc121870 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.693+0000 7effd4715700 1 -- 172.21.15.154:0/617692124 >> 172.21.15.154:0/617692124 conn(0x7effcc0a6610 msgr2=0x7effcc133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.693+0000 7effd4715700 1 -- 172.21.15.154:0/617692124 shutdown_connections 2023-09-30T22:24:52.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.693+0000 7effd4715700 1 -- 172.21.15.154:0/617692124 wait complete. 2023-09-30T22:24:52.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:52.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.730+0000 7f0a0a102700 1 -- 172.21.15.154:0/2056293987 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0a04125a00 con 0x7f0a040a0a70 2023-09-30T22:24:52.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.731+0000 7f09ebfff700 1 -- 172.21.15.154:0/2056293987 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09fc015090 con 0x7f0a040a0a70 2023-09-30T22:24:52.731 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:52.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.733+0000 7f0a0a102700 1 -- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 msgr2=0x7f0a041223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:52.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.733+0000 7f0a0a102700 1 --2- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a041223c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0090b0 tx=0x7f09fc004750 comp rx=0 tx=0).stop 2023-09-30T22:24:52.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.733+0000 7f0a0a102700 1 -- 172.21.15.154:0/2056293987 shutdown_connections 2023-09-30T22:24:52.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.733+0000 7f0a0a102700 1 --2- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04133f50 0x7f0a04122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.733+0000 7f0a0a102700 1 --2- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a041223c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.733+0000 7f0a0a102700 1 --2- 172.21.15.154:0/2056293987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1380 0x7f0a04122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:52.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.733+0000 7f0a0a102700 1 -- 172.21.15.154:0/2056293987 >> 172.21.15.154:0/2056293987 conn(0x7f0a040a6610 msgr2=0x7f0a0409f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:52.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.733+0000 7f0a0a102700 1 -- 172.21.15.154:0/2056293987 shutdown_connections 2023-09-30T22:24:52.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:52.733+0000 7f0a0a102700 1 -- 172.21.15.154:0/2056293987 wait complete. 2023-09-30T22:24:52.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:53.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:53.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.125+0000 7f992094d700 1 Processor -- start 2023-09-30T22:24:53.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.125+0000 7f992094d700 1 -- start start 2023-09-30T22:24:53.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.125+0000 7f992094d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.125+0000 7f992094d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f991c1300a0 0x7f991c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.125+0000 7f992094d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1309f0 0x7f991c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.125+0000 7f992094d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c06b2d0 con 0x7f991c1300a0 2023-09-30T22:24:53.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.125+0000 7f992094d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c133610 con 0x7f991c1309f0 2023-09-30T22:24:53.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.125+0000 7f992094d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f991c09a500 con 0x7f991c133ad0 2023-09-30T22:24:53.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f991a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f9919d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f991c1300a0 0x7f991c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f991ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1309f0 0x7f991c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f9919d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f991c1300a0 0x7f991c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52340/0 (socket says 172.21.15.154:52340) 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f991a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54520/0 (socket says 172.21.15.154:54520) 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f9919d9b700 1 -- 172.21.15.154:0/1984451255 learned_addr learned my addr 172.21.15.154:0/1984451255 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f9919d9b700 1 -- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 msgr2=0x7f991c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f9919d9b700 1 --2- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f9919d9b700 1 -- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1309f0 msgr2=0x7f991c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f9919d9b700 1 --2- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1309f0 0x7f991c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f9919d9b700 1 -- 172.21.15.154:0/1984451255 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c1338b0 con 0x7f991c1300a0 2023-09-30T22:24:53.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f991ad9d700 1 --2- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1309f0 0x7f991c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f991a59c700 1 --2- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f9919d9b700 1 --2- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f991c1300a0 0x7f991c1304b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f990c0098f0 tx=0x7f990c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231e000c80b3106f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f991959a700 1 -- 172.21.15.154:0/1984451255 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c011830 con 0x7f991c1300a0 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f991959a700 1 -- 172.21.15.154:0/1984451255 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c011990 con 0x7f991c1300a0 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.126+0000 7f991959a700 1 -- 172.21.15.154:0/1984451255 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c011d20 con 0x7f991c1300a0 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.127+0000 7f992094d700 1 -- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f991c1300a0 msgr2=0x7f991c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.127+0000 7f992094d700 1 --2- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f991c1300a0 0x7f991c1304b0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f990c0098f0 tx=0x7f990c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.127+0000 7f992094d700 1 -- 172.21.15.154:0/1984451255 shutdown_connections 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.127+0000 7f992094d700 1 --2- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1309f0 0x7f991c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.127+0000 7f992094d700 1 --2- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.127+0000 7f992094d700 1 --2- 172.21.15.154:0/1984451255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f991c1300a0 0x7f991c1304b0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.127+0000 7f992094d700 1 -- 172.21.15.154:0/1984451255 >> 172.21.15.154:0/1984451255 conn(0x7f991c099c40 msgr2=0x7f991c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:53.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.127+0000 7f992094d700 1 -- 172.21.15.154:0/1984451255 shutdown_connections 2023-09-30T22:24:53.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.127+0000 7f992094d700 1 -- 172.21.15.154:0/1984451255 wait complete. 2023-09-30T22:24:53.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.128+0000 7f992094d700 1 Processor -- start 2023-09-30T22:24:53.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.128+0000 7f992094d700 1 -- start start 2023-09-30T22:24:53.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.128+0000 7f992094d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1300a0 0x7f991c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.128+0000 7f992094d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f991c1309f0 0x7f991c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.128+0000 7f992094d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.128+0000 7f992094d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c11ef90 con 0x7f991c1309f0 2023-09-30T22:24:53.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f992094d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0720e0 con 0x7f991c1300a0 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f992094d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f991c11fd70 con 0x7f991c133ad0 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1300a0 0x7f991c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1300a0 0x7f991c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40902/0 (socket says 172.21.15.154:40902) 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991a59c700 1 -- 172.21.15.154:0/2965634356 learned_addr learned my addr 172.21.15.154:0/2965634356 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f9919d9b700 1 --2- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f991c1309f0 0x7f991c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991ad9d700 1 -- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1300a0 msgr2=0x7f991c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991ad9d700 1 --2- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1300a0 0x7f991c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991ad9d700 1 -- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f991c1309f0 msgr2=0x7f991c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991ad9d700 1 --2- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f991c1309f0 0x7f991c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991ad9d700 1 -- 172.21.15.154:0/2965634356 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914009a70 con 0x7f991c133ad0 2023-09-30T22:24:53.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991a59c700 1 --2- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1300a0 0x7f991c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f991ad9d700 1 --2- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c11e4c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9914009e50 tx=0x7f991400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f990affd700 1 -- 172.21.15.154:0/2965634356 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400ca90 con 0x7f991c133ad0 2023-09-30T22:24:53.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f990affd700 1 -- 172.21.15.154:0/2965634356 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991400f040 con 0x7f991c133ad0 2023-09-30T22:24:53.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f992094d700 1 -- 172.21.15.154:0/2965634356 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99100094a0 con 0x7f991c133ad0 2023-09-30T22:24:53.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f990affd700 1 -- 172.21.15.154:0/2965634356 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400ce50 con 0x7f991c133ad0 2023-09-30T22:24:53.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.129+0000 7f992094d700 1 -- 172.21.15.154:0/2965634356 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c009550 con 0x7f991c133ad0 2023-09-30T22:24:53.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.130+0000 7f990affd700 1 -- 172.21.15.154:0/2965634356 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9914014480 con 0x7f991c133ad0 2023-09-30T22:24:53.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.130+0000 7f990affd700 1 -- 172.21.15.154:0/2965634356 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f991403fbe0 con 0x7f991c133ad0 2023-09-30T22:24:53.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.130+0000 7f992094d700 1 -- 172.21.15.154:0/2965634356 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c04f2a0 con 0x7f991c133ad0 2023-09-30T22:24:53.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.135+0000 7f990affd700 1 -- 172.21.15.154:0/2965634356 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9914012910 con 0x7f991c133ad0 2023-09-30T22:24:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.317+0000 7f992094d700 1 -- 172.21.15.154:0/2965634356 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f991c11fb10 con 0x7f991c133ad0 2023-09-30T22:24:53.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.318+0000 7f990affd700 1 -- 172.21.15.154:0/2965634356 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9914012340 con 0x7f991c133ad0 2023-09-30T22:24:53.318 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:53.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.320+0000 7f992094d700 1 -- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 msgr2=0x7f991c11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.320+0000 7f992094d700 1 --2- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c11e4c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9914009e50 tx=0x7f991400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.320+0000 7f992094d700 1 -- 172.21.15.154:0/2965634356 shutdown_connections 2023-09-30T22:24:53.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.320+0000 7f992094d700 1 --2- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f991c133ad0 0x7f991c11e4c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.320+0000 7f992094d700 1 --2- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f991c1300a0 0x7f991c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.320+0000 7f992094d700 1 --2- 172.21.15.154:0/2965634356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f991c1309f0 0x7f991c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.320+0000 7f992094d700 1 -- 172.21.15.154:0/2965634356 >> 172.21.15.154:0/2965634356 conn(0x7f991c099c40 msgr2=0x7f991c12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.320+0000 7f992094d700 1 -- 172.21.15.154:0/2965634356 shutdown_connections 2023-09-30T22:24:53.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.320+0000 7f992094d700 1 -- 172.21.15.154:0/2965634356 wait complete. 2023-09-30T22:24:53.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:53.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:53.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:53.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:53.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.759+0000 7f85594b2700 1 Processor -- start 2023-09-30T22:24:53.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.759+0000 7f85594b2700 1 -- start start 2023-09-30T22:24:53.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f85594b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f855409d860 0x7f855409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f85594b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f85541307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f85594b2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855409aaa0 con 0x7f8554130ce0 2023-09-30T22:24:53.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f85594b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855409f870 con 0x7f855409d860 2023-09-30T22:24:53.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f85594b2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f855409b360 con 0x7f855409e170 2023-09-30T22:24:53.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f85527fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f85541307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f85537fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8554130ce0 0x7f85541379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40444/0 (socket says 172.21.15.154:40444) 2023-09-30T22:24:53.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f85537fe700 1 -- 172.21.15.154:0/2476694302 learned_addr learned my addr 172.21.15.154:0/2476694302 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:53.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f8552ffd700 1 --2- 172.21.15.154:0/2476694302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f855409d860 0x7f855409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f8552ffd700 1 -- 172.21.15.154:0/2476694302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 msgr2=0x7f85541307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:53.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f8552ffd700 1 --2- 172.21.15.154:0/2476694302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f85541307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f8551ffb700 1 -- 172.21.15.154:0/2476694302 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830300318 0 0) 0x7f855409aaa0 con 0x7f8554130ce0 2023-09-30T22:24:53.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f8552ffd700 1 -- 172.21.15.154:0/2476694302 >> v1:172.21.15.154:6789/0 conn(0x7f8554130ce0 legacy=0x7f85541379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f8552ffd700 1 -- 172.21.15.154:0/2476694302 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855409b620 con 0x7f855409d860 2023-09-30T22:24:53.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f85527fc700 1 --2- 172.21.15.154:0/2476694302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f85541307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.760+0000 7f8552ffd700 1 --2- 172.21.15.154:0/2476694302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f855409d860 0x7f855409dc30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8544009870 tx=0x7f8544009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da93bd78c8ae275 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.761+0000 7f8551ffb700 1 -- 172.21.15.154:0/2476694302 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544011830 con 0x7f855409d860 2023-09-30T22:24:53.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.761+0000 7f8551ffb700 1 -- 172.21.15.154:0/2476694302 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8544011990 con 0x7f855409d860 2023-09-30T22:24:53.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.761+0000 7f8551ffb700 1 -- 172.21.15.154:0/2476694302 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544011d20 con 0x7f855409d860 2023-09-30T22:24:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.762+0000 7f85594b2700 1 -- 172.21.15.154:0/2476694302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f855409d860 msgr2=0x7f855409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.762+0000 7f85594b2700 1 --2- 172.21.15.154:0/2476694302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f855409d860 0x7f855409dc30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8544009870 tx=0x7f8544009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.762+0000 7f85594b2700 1 -- 172.21.15.154:0/2476694302 shutdown_connections 2023-09-30T22:24:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.762+0000 7f85594b2700 1 --2- 172.21.15.154:0/2476694302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f855409d860 0x7f855409dc30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.762+0000 7f85594b2700 1 --2- 172.21.15.154:0/2476694302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f85541307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.762+0000 7f85594b2700 1 -- 172.21.15.154:0/2476694302 >> 172.21.15.154:0/2476694302 conn(0x7f8554099c40 msgr2=0x7f85540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.762+0000 7f85594b2700 1 -- 172.21.15.154:0/2476694302 shutdown_connections 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.762+0000 7f85594b2700 1 -- 172.21.15.154:0/2476694302 wait complete. 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.763+0000 7f85594b2700 1 Processor -- start 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.763+0000 7f85594b2700 1 -- start start 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85594b2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855409d860 0x7f855412f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85594b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f855412fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85594b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8554130ce0 0x7f85541354d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85594b2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8554137f30 con 0x7f855409d860 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85594b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855409c8b0 con 0x7f8554130ce0 2023-09-30T22:24:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85594b2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f855411a0e0 con 0x7f855409e170 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85527fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f855412fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85527fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f855412fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54538/0 (socket says 172.21.15.154:54538) 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85527fc700 1 -- 172.21.15.154:0/3237720284 learned_addr learned my addr 172.21.15.154:0/3237720284 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85537fe700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8554130ce0 0x7f85541354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f8552ffd700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855409d860 0x7f855412f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.764+0000 7f85527fc700 1 -- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8554130ce0 msgr2=0x7f85541354d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f85527fc700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8554130ce0 0x7f85541354d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f85527fc700 1 -- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855409d860 msgr2=0x7f855412f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f85527fc700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855409d860 0x7f855412f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f85527fc700 1 -- 172.21.15.154:0/3237720284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480094a0 con 0x7f855409e170 2023-09-30T22:24:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f8552ffd700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855409d860 0x7f855412f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:24:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f85527fc700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f855412fee0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f854800ebb0 tx=0x7f854800eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f853b7fe700 1 -- 172.21.15.154:0/3237720284 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800c850 con 0x7f855409e170 2023-09-30T22:24:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f853b7fe700 1 -- 172.21.15.154:0/3237720284 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800c9b0 con 0x7f855409e170 2023-09-30T22:24:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f853b7fe700 1 -- 172.21.15.154:0/3237720284 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800cd40 con 0x7f855409e170 2023-09-30T22:24:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f85594b2700 1 -- 172.21.15.154:0/3237720284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85440094a0 con 0x7f855409e170 2023-09-30T22:24:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.765+0000 7f85594b2700 1 -- 172.21.15.154:0/3237720284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8554138fb0 con 0x7f855409e170 2023-09-30T22:24:53.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.766+0000 7f853b7fe700 1 -- 172.21.15.154:0/3237720284 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8548013470 con 0x7f855409e170 2023-09-30T22:24:53.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.766+0000 7f85594b2700 1 -- 172.21.15.154:0/3237720284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8554119c40 con 0x7f855409e170 2023-09-30T22:24:53.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.766+0000 7f853b7fe700 1 -- 172.21.15.154:0/3237720284 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f854803fc00 con 0x7f855409e170 2023-09-30T22:24:53.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.771+0000 7f853b7fe700 1 -- 172.21.15.154:0/3237720284 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f854801b3b0 con 0x7f855409e170 2023-09-30T22:24:53.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.839+0000 7f97b4227700 1 Processor -- start 2023-09-30T22:24:53.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.839+0000 7f97b4227700 1 -- start start 2023-09-30T22:24:53.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b4227700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97ac134140 0x7f97ac138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b4227700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac1345a0 0x7f97ac13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b4227700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ac09b110 con 0x7f97ac09ad40 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b4227700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac0a3b60 con 0x7f97ac134140 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b4227700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0a1a80 con 0x7f97ac1345a0 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b17c2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97ac134140 0x7f97ac138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b27c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac1345a0 0x7f97ac13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b17c2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97ac134140 0x7f97ac138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52352/0 (socket says 172.21.15.154:52352) 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b17c2700 1 -- 172.21.15.154:0/763201816 learned_addr learned my addr 172.21.15.154:0/763201816 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b1fc3700 1 --1- 172.21.15.154:0/763201816 >> v1:172.21.15.154:6789/0 conn(0x7f97ac09ad40 0x7f97ac133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40450/0 (socket says 172.21.15.154:40450) 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b17c2700 1 -- 172.21.15.154:0/763201816 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac1345a0 msgr2=0x7f97ac13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:53.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b17c2700 1 --2- 172.21.15.154:0/763201816 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac1345a0 0x7f97ac13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b17c2700 1 -- 172.21.15.154:0/763201816 >> v1:172.21.15.154:6789/0 conn(0x7f97ac09ad40 legacy=0x7f97ac133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b17c2700 1 -- 172.21.15.154:0/763201816 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0a2fa0 con 0x7f97ac134140 2023-09-30T22:24:53.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b27c4700 1 --2- 172.21.15.154:0/763201816 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac1345a0 0x7f97ac13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b17c2700 1 --2- 172.21.15.154:0/763201816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 0x7f97ac138e80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f979c0098f0 tx=0x7f979c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb86d7dfb575dae4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.840+0000 7f97b0fc1700 1 -- 172.21.15.154:0/763201816 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c011830 con 0x7f97ac134140 2023-09-30T22:24:53.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b0fc1700 1 -- 172.21.15.154:0/763201816 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c011990 con 0x7f97ac134140 2023-09-30T22:24:53.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b0fc1700 1 -- 172.21.15.154:0/763201816 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c011d20 con 0x7f97ac134140 2023-09-30T22:24:53.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b4227700 1 -- 172.21.15.154:0/763201816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 msgr2=0x7f97ac138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b4227700 1 --2- 172.21.15.154:0/763201816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 0x7f97ac138e80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f979c0098f0 tx=0x7f979c009c00 comp rx=0 tx=0).stop 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b4227700 1 -- 172.21.15.154:0/763201816 shutdown_connections 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b4227700 1 --2- 172.21.15.154:0/763201816 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac1345a0 0x7f97ac13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b4227700 1 --2- 172.21.15.154:0/763201816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 0x7f97ac138e80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b4227700 1 -- 172.21.15.154:0/763201816 >> 172.21.15.154:0/763201816 conn(0x7f97ac099c40 msgr2=0x7f97ac06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b4227700 1 -- 172.21.15.154:0/763201816 shutdown_connections 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.841+0000 7f97b4227700 1 -- 172.21.15.154:0/763201816 wait complete. 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.842+0000 7f97b4227700 1 Processor -- start 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.842+0000 7f97b4227700 1 -- start start 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b4227700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac09ad40 0x7f97ac11c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b4227700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 0x7f97ac11ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b4227700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97ac1345a0 0x7f97ac11d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b4227700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac11df30 con 0x7f97ac134140 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b4227700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac11f920 con 0x7f97ac1345a0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b4227700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac09c7e0 con 0x7f97ac09ad40 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b1fc3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac09ad40 0x7f97ac11c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b17c2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 0x7f97ac11ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b17c2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 0x7f97ac11ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52360/0 (socket says 172.21.15.154:52360) 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b17c2700 1 -- 172.21.15.154:0/2696477700 learned_addr learned my addr 172.21.15.154:0/2696477700 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b27c4700 1 --2- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97ac1345a0 0x7f97ac11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b17c2700 1 -- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac09ad40 msgr2=0x7f97ac11c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b17c2700 1 --2- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac09ad40 0x7f97ac11c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b17c2700 1 -- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97ac1345a0 msgr2=0x7f97ac11d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b17c2700 1 --2- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97ac1345a0 0x7f97ac11d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b17c2700 1 -- 172.21.15.154:0/2696477700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4009a70 con 0x7f97ac134140 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97b17c2700 1 --2- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 0x7f97ac11ce00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f979c009c40 tx=0x7f979c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.843+0000 7f97a27fc700 1 -- 172.21.15.154:0/2696477700 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c0044d0 con 0x7f97ac134140 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.844+0000 7f97a27fc700 1 -- 172.21.15.154:0/2696477700 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c01e070 con 0x7f97ac134140 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.844+0000 7f97a27fc700 1 -- 172.21.15.154:0/2696477700 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c0038e0 con 0x7f97ac134140 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.844+0000 7f97b4227700 1 -- 172.21.15.154:0/2696477700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c009550 con 0x7f97ac134140 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.844+0000 7f97b4227700 1 -- 172.21.15.154:0/2696477700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac11ec60 con 0x7f97ac134140 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.845+0000 7f97a27fc700 1 -- 172.21.15.154:0/2696477700 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f979c003a40 con 0x7f97ac134140 2023-09-30T22:24:53.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.845+0000 7f97b4227700 1 -- 172.21.15.154:0/2696477700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac04f2a0 con 0x7f97ac134140 2023-09-30T22:24:53.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.845+0000 7f97a27fc700 1 -- 172.21.15.154:0/2696477700 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f979c020070 con 0x7f97ac134140 2023-09-30T22:24:53.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.849+0000 7f97a27fc700 1 -- 172.21.15.154:0/2696477700 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f979c045060 con 0x7f97ac134140 2023-09-30T22:24:53.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ae3bc700 1 Processor -- start 2023-09-30T22:24:53.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ae3bc700 1 -- start start 2023-09-30T22:24:53.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ae3bc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809d860 0x7f74a809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ae3bc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a8130eb0 0x7f74a8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ae3bc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a809aaa0 con 0x7f74a809e170 2023-09-30T22:24:53.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ae3bc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a809f870 con 0x7f74a809d860 2023-09-30T22:24:53.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ae3bc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74a809b360 con 0x7f74a8130eb0 2023-09-30T22:24:53.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74a7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809d860 0x7f74a809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ac959700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a8130eb0 0x7f74a8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ac959700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a8130eb0 0x7f74a8138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54556/0 (socket says 172.21.15.154:54556) 2023-09-30T22:24:53.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74a7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809d860 0x7f74a809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:40942/0 (socket says 172.21.15.154:40942) 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.878+0000 7f74ac959700 1 -- 172.21.15.154:0/798112707 learned_addr learned my addr 172.21.15.154:0/798112707 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.879+0000 7f74a7fff700 1 -- 172.21.15.154:0/798112707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a8130eb0 msgr2=0x7f74a8138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.879+0000 7f74a7fff700 1 --2- 172.21.15.154:0/798112707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a8130eb0 0x7f74a8138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.879+0000 7f74a7fff700 1 -- 172.21.15.154:0/798112707 >> v1:172.21.15.154:6789/0 conn(0x7f74a809e170 legacy=0x7f74a81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.879+0000 7f74a7fff700 1 -- 172.21.15.154:0/798112707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a809b620 con 0x7f74a809d860 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.879+0000 7f74ac959700 1 --2- 172.21.15.154:0/798112707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a8130eb0 0x7f74a8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.879+0000 7f74a7fff700 1 --2- 172.21.15.154:0/798112707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809d860 0x7f74a809dc30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7498009870 tx=0x7f7498009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e564baa6daa4e510 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.879+0000 7f74a6ffd700 1 -- 172.21.15.154:0/798112707 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498011830 con 0x7f74a809d860 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.879+0000 7f74a6ffd700 1 -- 172.21.15.154:0/798112707 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498011990 con 0x7f74a809d860 2023-09-30T22:24:53.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.879+0000 7f74a6ffd700 1 -- 172.21.15.154:0/798112707 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498011d20 con 0x7f74a809d860 2023-09-30T22:24:53.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.880+0000 7f74ae3bc700 1 -- 172.21.15.154:0/798112707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809d860 msgr2=0x7f74a809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.880+0000 7f74ae3bc700 1 --2- 172.21.15.154:0/798112707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809d860 0x7f74a809dc30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7498009870 tx=0x7f7498009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:53.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.880+0000 7f74ae3bc700 1 -- 172.21.15.154:0/798112707 shutdown_connections 2023-09-30T22:24:53.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.880+0000 7f74ae3bc700 1 --2- 172.21.15.154:0/798112707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a8130eb0 0x7f74a8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.880+0000 7f74ae3bc700 1 --2- 172.21.15.154:0/798112707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809d860 0x7f74a809dc30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.880+0000 7f74ae3bc700 1 -- 172.21.15.154:0/798112707 >> 172.21.15.154:0/798112707 conn(0x7f74a8099c40 msgr2=0x7f74a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:53.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.880+0000 7f74ae3bc700 1 -- 172.21.15.154:0/798112707 shutdown_connections 2023-09-30T22:24:53.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.880+0000 7f74ae3bc700 1 -- 172.21.15.154:0/798112707 wait complete. 2023-09-30T22:24:53.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74ae3bc700 1 Processor -- start 2023-09-30T22:24:53.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74ae3bc700 1 -- start start 2023-09-30T22:24:53.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74ae3bc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a809d860 0x7f74a81230e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74ae3bc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809e170 0x7f74a8123620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74ae3bc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8130eb0 0x7f74a81c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:53.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74ae3bc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a81261c0 con 0x7f74a8130eb0 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74ae3bc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a81244b0 con 0x7f74a809e170 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74ae3bc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80a2190 con 0x7f74a809d860 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74a77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809e170 0x7f74a8123620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74a7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a809d860 0x7f74a81230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74a7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a809d860 0x7f74a81230e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54560/0 (socket says 172.21.15.154:54560) 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74a7fff700 1 -- 172.21.15.154:0/974176634 learned_addr learned my addr 172.21.15.154:0/974176634 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.881+0000 7f74ac959700 1 --2- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8130eb0 0x7f74a81c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74a7fff700 1 -- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809e170 msgr2=0x7f74a8123620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74a7fff700 1 --2- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809e170 0x7f74a8123620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74a7fff700 1 -- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8130eb0 msgr2=0x7f74a81c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74a7fff700 1 --2- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8130eb0 0x7f74a81c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74a7fff700 1 -- 172.21.15.154:0/974176634 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a000bd40 con 0x7f74a809d860 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74a7fff700 1 --2- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a809d860 0x7f74a81230e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f74980090b0 tx=0x7f7498004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74a4ff9700 1 -- 172.21.15.154:0/974176634 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498004240 con 0x7f74a809d860 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74a4ff9700 1 -- 172.21.15.154:0/974176634 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749801f070 con 0x7f74a809d860 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74a4ff9700 1 -- 172.21.15.154:0/974176634 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980036a0 con 0x7f74a809d860 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74ae3bc700 1 -- 172.21.15.154:0/974176634 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74980094a0 con 0x7f74a809d860 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.882+0000 7f74ae3bc700 1 -- 172.21.15.154:0/974176634 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a8124ca0 con 0x7f74a809d860 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.883+0000 7f74ae3bc700 1 -- 172.21.15.154:0/974176634 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a804f2a0 con 0x7f74a809d860 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.883+0000 7f74a4ff9700 1 -- 172.21.15.154:0/974176634 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7498021030 con 0x7f74a809d860 2023-09-30T22:24:53.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.883+0000 7f74a4ff9700 1 -- 172.21.15.154:0/974176634 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f74980406f0 con 0x7f74a809d860 2023-09-30T22:24:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.892+0000 7f74a4ff9700 1 -- 172.21.15.154:0/974176634 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74980239c0 con 0x7f74a809d860 2023-09-30T22:24:53.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.970+0000 7f85594b2700 1 -- 172.21.15.154:0/3237720284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f855404f2a0 con 0x7f855409e170 2023-09-30T22:24:53.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.970+0000 7f853b7fe700 1 -- 172.21.15.154:0/3237720284 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8548017070 con 0x7f855409e170 2023-09-30T22:24:53.970 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:53.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.972+0000 7f85594b2700 1 -- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 msgr2=0x7f855412fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:53.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.972+0000 7f85594b2700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f855412fee0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f854800ebb0 tx=0x7f854800eec0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.972+0000 7f85594b2700 1 -- 172.21.15.154:0/3237720284 shutdown_connections 2023-09-30T22:24:53.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.972+0000 7f85594b2700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8554130ce0 0x7f85541354d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.972+0000 7f85594b2700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855409d860 0x7f855412f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.972+0000 7f85594b2700 1 --2- 172.21.15.154:0/3237720284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f855409e170 0x7f855412fee0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:53.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.972+0000 7f85594b2700 1 -- 172.21.15.154:0/3237720284 >> 172.21.15.154:0/3237720284 conn(0x7f8554099c40 msgr2=0x7f85541393e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:53.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.972+0000 7f85594b2700 1 -- 172.21.15.154:0/3237720284 shutdown_connections 2023-09-30T22:24:53.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:53.972+0000 7f85594b2700 1 -- 172.21.15.154:0/3237720284 wait complete. 2023-09-30T22:24:53.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:54.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.050+0000 7f97b4227700 1 -- 172.21.15.154:0/2696477700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97ac0729d0 con 0x7f97ac134140 2023-09-30T22:24:54.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.051+0000 7f97a27fc700 1 -- 172.21.15.154:0/2696477700 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f979c015020 con 0x7f97ac134140 2023-09-30T22:24:54.051 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:54.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.053+0000 7f97b4227700 1 -- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 msgr2=0x7f97ac11ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.053+0000 7f97b4227700 1 --2- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 0x7f97ac11ce00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f979c009c40 tx=0x7f979c004750 comp rx=0 tx=0).stop 2023-09-30T22:24:54.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.053+0000 7f97b4227700 1 -- 172.21.15.154:0/2696477700 shutdown_connections 2023-09-30T22:24:54.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.053+0000 7f97b4227700 1 --2- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97ac1345a0 0x7f97ac11d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.053+0000 7f97b4227700 1 --2- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97ac09ad40 0x7f97ac11c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.053+0000 7f97b4227700 1 --2- 172.21.15.154:0/2696477700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97ac134140 0x7f97ac11ce00 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.053+0000 7f97b4227700 1 -- 172.21.15.154:0/2696477700 >> 172.21.15.154:0/2696477700 conn(0x7f97ac099c40 msgr2=0x7f97ac13b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.053+0000 7f97b4227700 1 -- 172.21.15.154:0/2696477700 shutdown_connections 2023-09-30T22:24:54.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.053+0000 7f97b4227700 1 -- 172.21.15.154:0/2696477700 wait complete. 2023-09-30T22:24:54.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:54.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.086+0000 7f74ae3bc700 1 -- 172.21.15.154:0/974176634 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f74a8125120 con 0x7f74a809d860 2023-09-30T22:24:54.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.087+0000 7f74a4ff9700 1 -- 172.21.15.154:0/974176634 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7498015070 con 0x7f74a809d860 2023-09-30T22:24:54.087 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:54.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.088+0000 7f74ae3bc700 1 -- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a809d860 msgr2=0x7f74a81230e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.088+0000 7f74ae3bc700 1 --2- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a809d860 0x7f74a81230e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f74980090b0 tx=0x7f7498004750 comp rx=0 tx=0).stop 2023-09-30T22:24:54.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.089+0000 7f74ae3bc700 1 -- 172.21.15.154:0/974176634 shutdown_connections 2023-09-30T22:24:54.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.089+0000 7f74ae3bc700 1 --2- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74a8130eb0 0x7f74a81c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.089+0000 7f74ae3bc700 1 --2- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74a809d860 0x7f74a81230e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.089+0000 7f74ae3bc700 1 --2- 172.21.15.154:0/974176634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74a809e170 0x7f74a8123620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.089+0000 7f74ae3bc700 1 -- 172.21.15.154:0/974176634 >> 172.21.15.154:0/974176634 conn(0x7f74a8099c40 msgr2=0x7f74a80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.089+0000 7f74ae3bc700 1 -- 172.21.15.154:0/974176634 shutdown_connections 2023-09-30T22:24:54.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.089+0000 7f74ae3bc700 1 -- 172.21.15.154:0/974176634 wait complete. 2023-09-30T22:24:54.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:54.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:54.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.456+0000 7fb02a1e2700 1 Processor -- start 2023-09-30T22:24:54.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.456+0000 7fb02a1e2700 1 -- start start 2023-09-30T22:24:54.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.456+0000 7fb02a1e2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02409e340 0x7fb0241359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.456+0000 7fb02a1e2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb024135f20 0x7fb024138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.456+0000 7fb02a1e2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02409aaa0 con 0x7fb02409d860 2023-09-30T22:24:54.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.456+0000 7fb02a1e2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02409e730 con 0x7fb02409e340 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.456+0000 7fb02a1e2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02409f870 con 0x7fb024135f20 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb022ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02409e340 0x7fb0241359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb0237fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb02409d860 0x7fb02409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40470/0 (socket says 172.21.15.154:40470) 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb023fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb024135f20 0x7fb024138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb0237fe700 1 -- 172.21.15.154:0/1813602677 learned_addr learned my addr 172.21.15.154:0/1813602677 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb023fff700 1 -- 172.21.15.154:0/1813602677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02409e340 msgr2=0x7fb0241359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb0227fc700 1 -- 172.21.15.154:0/1813602677 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852912294 0 0) 0x7fb02409aaa0 con 0x7fb02409d860 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb023fff700 1 --2- 172.21.15.154:0/1813602677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02409e340 0x7fb0241359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb023fff700 1 -- 172.21.15.154:0/1813602677 >> v1:172.21.15.154:6789/0 conn(0x7fb02409d860 legacy=0x7fb02409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb023fff700 1 -- 172.21.15.154:0/1813602677 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02409b360 con 0x7fb024135f20 2023-09-30T22:24:54.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb022ffd700 1 --2- 172.21.15.154:0/1813602677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02409e340 0x7fb0241359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:54.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb023fff700 1 --2- 172.21.15.154:0/1813602677 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb024135f20 0x7fb024138300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009df0 tx=0x7fb01c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953c0f8edf5510f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:54.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb0227fc700 1 -- 172.21.15.154:0/1813602677 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00e070 con 0x7fb024135f20 2023-09-30T22:24:54.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb0227fc700 1 -- 172.21.15.154:0/1813602677 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c00bae0 con 0x7fb024135f20 2023-09-30T22:24:54.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.457+0000 7fb0227fc700 1 -- 172.21.15.154:0/1813602677 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00be90 con 0x7fb024135f20 2023-09-30T22:24:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.458+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1813602677 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb024135f20 msgr2=0x7fb024138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.458+0000 7fb02a1e2700 1 --2- 172.21.15.154:0/1813602677 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb024135f20 0x7fb024138300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009df0 tx=0x7fb01c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.458+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1813602677 shutdown_connections 2023-09-30T22:24:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.458+0000 7fb02a1e2700 1 --2- 172.21.15.154:0/1813602677 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb024135f20 0x7fb024138300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.458+0000 7fb02a1e2700 1 --2- 172.21.15.154:0/1813602677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb02409e340 0x7fb0241359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.458+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1813602677 >> 172.21.15.154:0/1813602677 conn(0x7fb024099c40 msgr2=0x7fb0240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.458+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1813602677 shutdown_connections 2023-09-30T22:24:54.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.458+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1813602677 wait complete. 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb02a1e2700 1 Processor -- start 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb02a1e2700 1 -- start start 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb02a1e2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02409d860 0x7fb0241c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb02a1e2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02409e340 0x7fb0241c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb02a1e2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb024135f20 0x7fb0241207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb02a1e2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0241225c0 con 0x7fb02409d860 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb02a1e2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0241223d0 con 0x7fb024135f20 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb02a1e2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb024133150 con 0x7fb02409e340 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02409d860 0x7fb0241c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb022ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02409e340 0x7fb0241c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb023fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb024135f20 0x7fb0241207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb022ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02409e340 0x7fb0241c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54584/0 (socket says 172.21.15.154:54584) 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb022ffd700 1 -- 172.21.15.154:0/1419341258 learned_addr learned my addr 172.21.15.154:0/1419341258 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.459+0000 7fb0237fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02409d860 0x7fb0241c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52384/0 (socket says 172.21.15.154:52384) 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb022ffd700 1 -- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb024135f20 msgr2=0x7fb0241207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb022ffd700 1 --2- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb024135f20 0x7fb0241207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb022ffd700 1 -- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02409d860 msgr2=0x7fb0241c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb022ffd700 1 --2- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02409d860 0x7fb0241c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb022ffd700 1 -- 172.21.15.154:0/1419341258 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0140094a0 con 0x7fb02409e340 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb0237fe700 1 --2- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02409d860 0x7fb0241c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:54.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb022ffd700 1 --2- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02409e340 0x7fb0241c8a20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb01400ebe0 tx=0x7fb01400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb00bfff700 1 -- 172.21.15.154:0/1419341258 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400c850 con 0x7fb02409e340 2023-09-30T22:24:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb00bfff700 1 -- 172.21.15.154:0/1419341258 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400c9b0 con 0x7fb02409e340 2023-09-30T22:24:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1419341258 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c009a70 con 0x7fb02409e340 2023-09-30T22:24:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb00bfff700 1 -- 172.21.15.154:0/1419341258 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400cd40 con 0x7fb02409e340 2023-09-30T22:24:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.460+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1419341258 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb024122980 con 0x7fb02409e340 2023-09-30T22:24:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.461+0000 7fb00bfff700 1 -- 172.21.15.154:0/1419341258 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb014013470 con 0x7fb02409e340 2023-09-30T22:24:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.461+0000 7fb00bfff700 1 -- 172.21.15.154:0/1419341258 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb01403f7d0 con 0x7fb02409e340 2023-09-30T22:24:54.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.461+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1419341258 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02409c8b0 con 0x7fb02409e340 2023-09-30T22:24:54.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.465+0000 7fb00bfff700 1 -- 172.21.15.154:0/1419341258 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb014013720 con 0x7fb02409e340 2023-09-30T22:24:54.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.650+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1419341258 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb02404f2a0 con 0x7fb02409e340 2023-09-30T22:24:54.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.650+0000 7fb00bfff700 1 -- 172.21.15.154:0/1419341258 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb01402a090 con 0x7fb02409e340 2023-09-30T22:24:54.650 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.652+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02409e340 msgr2=0x7fb0241c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.652+0000 7fb02a1e2700 1 --2- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02409e340 0x7fb0241c8a20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb01400ebe0 tx=0x7fb01400eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.652+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1419341258 shutdown_connections 2023-09-30T22:24:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.652+0000 7fb02a1e2700 1 --2- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb024135f20 0x7fb0241207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.652+0000 7fb02a1e2700 1 --2- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb02409d860 0x7fb0241c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.652+0000 7fb02a1e2700 1 --2- 172.21.15.154:0/1419341258 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb02409e340 0x7fb0241c8a20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.652+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1419341258 >> 172.21.15.154:0/1419341258 conn(0x7fb024099c40 msgr2=0x7fb0240a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.652+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1419341258 shutdown_connections 2023-09-30T22:24:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:54.652+0000 7fb02a1e2700 1 -- 172.21.15.154:0/1419341258 wait complete. 2023-09-30T22:24:54.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:54.986 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:55.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:55.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d130b3700 1 Processor -- start 2023-09-30T22:24:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d130b3700 1 -- start start 2023-09-30T22:24:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f5b72e3d700 1 Processor -- start 2023-09-30T22:24:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f77ffcbf700 1 Processor -- start 2023-09-30T22:24:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f5b72e3d700 1 -- start start 2023-09-30T22:24:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f77ffcbf700 1 -- start start 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d130b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09a150 0x7f3d0c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d130b3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09edb0 0x7f3d0c09f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d130b3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d0c133c20 0x7f3d0c1340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d130b3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c09a520 con 0x7f3d0c133c20 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d130b3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c09fe00 con 0x7f3d0c09a150 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d130b3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c06bec0 con 0x7f3d0c09edb0 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d11650700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d0c133c20 0x7f3d0c1340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d10e4f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09a150 0x7f3d0c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d11650700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d0c133c20 0x7f3d0c1340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40944/0 (socket says 172.21.15.154:40944) 2023-09-30T22:24:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d11650700 1 -- 172.21.15.154:0/705971885 learned_addr learned my addr 172.21.15.154:0/705971885 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f5b72e3d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b6c0a0a30 0x7f5b6c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f3d0bfff700 1 --2- 172.21.15.154:0/705971885 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09edb0 0x7f3d0c09f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f5b72e3d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a1340 0x7f5b6c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f5b72e3d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c0a1e70 con 0x7f5b6c1304a0 2023-09-30T22:24:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f5b72e3d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6c09a720 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f5b72e3d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c09b300 con 0x7f5b6c0a1340 2023-09-30T22:24:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f3d10e4f700 1 -- 172.21.15.154:0/705971885 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09edb0 msgr2=0x7f3d0c09f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f3d10e4f700 1 --2- 172.21.15.154:0/705971885 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09edb0 0x7f3d0c09f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f3d10e4f700 1 -- 172.21.15.154:0/705971885 >> v2:172.21.15.154:3300/0 conn(0x7f3d0c133c20 msgr2=0x7f3d0c1340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f3d10e4f700 1 --2- 172.21.15.154:0/705971885 >> v2:172.21.15.154:3300/0 conn(0x7f3d0c133c20 0x7f3d0c1340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f3d10e4f700 1 -- 172.21.15.154:0/705971885 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c09af80 con 0x7f3d0c09a150 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.466+0000 7f77ffcbf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f812d280 0x7f77f812d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77ffcbf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77f8130eb0 0x7f77f8139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77ffcbf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f809ae40 con 0x7f77f8130350 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77ffcbf700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f809b9a0 con 0x7f77f8130eb0 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77ffcbf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77f809bbb0 con 0x7f77f812d280 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fd25a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f77f8130350 0x7f77f81307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38098/0 (socket says 172.21.15.154:38098) 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fd25a700 1 -- 172.21.15.154:0/1887368285 learned_addr learned my addr 172.21.15.154:0/1887368285 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fe25c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77f8130eb0 0x7f77f8139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fda5b700 1 --2- 172.21.15.154:0/1887368285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f812d280 0x7f77f812d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fca59700 1 -- 172.21.15.154:0/1887368285 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396200434 0 0) 0x7f77f809ae40 con 0x7f77f8130350 2023-09-30T22:24:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fca59700 1 -- 172.21.15.154:0/1887368285 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e40035b0 con 0x7f77f8130350 2023-09-30T22:24:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fda5b700 1 -- 172.21.15.154:0/1887368285 >> v2:172.21.15.154:3300/0 conn(0x7f77f8130eb0 msgr2=0x7f77f8139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fda5b700 1 --2- 172.21.15.154:0/1887368285 >> v2:172.21.15.154:3300/0 conn(0x7f77f8130eb0 0x7f77f8139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fda5b700 1 -- 172.21.15.154:0/1887368285 >> v1:172.21.15.154:6789/0 conn(0x7f77f8130350 legacy=0x7f77f81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f5b6bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a1340 0x7f5b6c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f5b6bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a1340 0x7f5b6c12ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34186/0 (socket says 172.21.15.154:34186) 2023-09-30T22:24:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f5b6bfff700 1 -- 172.21.15.154:0/2527958187 learned_addr learned my addr 172.21.15.154:0/2527958187 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f5b70bd9700 1 --2- 172.21.15.154:0/2527958187 >> v2:172.21.15.154:3300/0 conn(0x7f5b6c0a0a30 0x7f5b6c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f3d10e4f700 1 --2- 172.21.15.154:0/705971885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09a150 0x7f3d0c09e870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009840 tx=0x7f3d00009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd656e63a6d2eaf7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fda5b700 1 -- 172.21.15.154:0/1887368285 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f809b250 con 0x7f77f812d280 2023-09-30T22:24:55.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f5b70bd9700 1 -- 172.21.15.154:0/2527958187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a1340 msgr2=0x7f5b6c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f5b70bd9700 1 --2- 172.21.15.154:0/2527958187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a1340 0x7f5b6c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f5b70bd9700 1 -- 172.21.15.154:0/2527958187 >> v1:172.21.15.154:6789/0 conn(0x7f5b6c1304a0 legacy=0x7f5b6c1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f5b70bd9700 1 -- 172.21.15.154:0/2527958187 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c09abc0 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f3d0b7fe700 1 -- 172.21.15.154:0/705971885 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00011830 con 0x7f3d0c09a150 2023-09-30T22:24:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f3d0b7fe700 1 -- 172.21.15.154:0/705971885 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d00011990 con 0x7f3d0c09a150 2023-09-30T22:24:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f77fda5b700 1 --2- 172.21.15.154:0/1887368285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f812d280 0x7f77f812d650 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009820 tx=0x7f77f4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14ee89129d186df8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.467+0000 7f5b70bd9700 1 --2- 172.21.15.154:0/2527958187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c0a0a30 0x7f5b6c0a0e00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000bac0 tx=0x7f5b6000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1899973b34c98496 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f3d0b7fe700 1 -- 172.21.15.154:0/705971885 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00011d00 con 0x7f3d0c09a150 2023-09-30T22:24:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f77fca59700 1 -- 172.21.15.154:0/1887368285 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4005e30 con 0x7f77f812d280 2023-09-30T22:24:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f77fca59700 1 -- 172.21.15.154:0/1887368285 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4006030 con 0x7f77f812d280 2023-09-30T22:24:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f77fca59700 1 -- 172.21.15.154:0/1887368285 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40063a0 con 0x7f77f812d280 2023-09-30T22:24:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f3d130b3700 1 -- 172.21.15.154:0/705971885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09a150 msgr2=0x7f3d0c09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f3d130b3700 1 --2- 172.21.15.154:0/705971885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09a150 0x7f3d0c09e870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009840 tx=0x7f3d00009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:55.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f5b6b7fe700 1 -- 172.21.15.154:0/2527958187 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60005e30 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f5b6b7fe700 1 -- 172.21.15.154:0/2527958187 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6000d920 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f5b6b7fe700 1 -- 172.21.15.154:0/2527958187 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000dcb0 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f77ffcbf700 1 -- 172.21.15.154:0/1887368285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f812d280 msgr2=0x7f77f812d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f77ffcbf700 1 --2- 172.21.15.154:0/1887368285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f812d280 0x7f77f812d650 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009820 tx=0x7f77f4009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:55.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f3d130b3700 1 -- 172.21.15.154:0/705971885 shutdown_connections 2023-09-30T22:24:55.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f3d130b3700 1 --2- 172.21.15.154:0/705971885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09a150 0x7f3d0c09e870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f3d130b3700 1 --2- 172.21.15.154:0/705971885 >> v2:172.21.15.154:3300/0 conn(0x7f3d0c133c20 0x7f3d0c1340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f3d130b3700 1 --2- 172.21.15.154:0/705971885 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09edb0 0x7f3d0c09f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f3d130b3700 1 -- 172.21.15.154:0/705971885 >> 172.21.15.154:0/705971885 conn(0x7f3d0c0a4430 msgr2=0x7f3d0c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f77ffcbf700 1 -- 172.21.15.154:0/1887368285 shutdown_connections 2023-09-30T22:24:55.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f77ffcbf700 1 --2- 172.21.15.154:0/1887368285 >> v2:172.21.15.154:3300/0 conn(0x7f77f8130eb0 0x7f77f8139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f77ffcbf700 1 --2- 172.21.15.154:0/1887368285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f812d280 0x7f77f812d650 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009820 tx=0x7f77f4009b30 comp rx=0 tx=0).stop 2023-09-30T22:24:55.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.468+0000 7f77ffcbf700 1 -- 172.21.15.154:0/1887368285 >> 172.21.15.154:0/1887368285 conn(0x7f77f80a2980 msgr2=0x7f77f80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f3d130b3700 1 -- 172.21.15.154:0/705971885 shutdown_connections 2023-09-30T22:24:55.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f5b72e3d700 1 -- 172.21.15.154:0/2527958187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c0a0a30 msgr2=0x7f5b6c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f5b72e3d700 1 --2- 172.21.15.154:0/2527958187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c0a0a30 0x7f5b6c0a0e00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000bac0 tx=0x7f5b6000bdd0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f3d130b3700 1 -- 172.21.15.154:0/705971885 wait complete. 2023-09-30T22:24:55.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f77ffcbf700 1 -- 172.21.15.154:0/1887368285 shutdown_connections 2023-09-30T22:24:55.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f77ffcbf700 1 -- 172.21.15.154:0/1887368285 wait complete. 2023-09-30T22:24:55.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.470+0000 7f77ffcbf700 1 Processor -- start 2023-09-30T22:24:55.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.470+0000 7f3d130b3700 1 Processor -- start 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f5b72e3d700 1 -- 172.21.15.154:0/2527958187 shutdown_connections 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f5b72e3d700 1 --2- 172.21.15.154:0/2527958187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c0a0a30 0x7f5b6c0a0e00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f5b72e3d700 1 --2- 172.21.15.154:0/2527958187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a1340 0x7f5b6c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f5b72e3d700 1 -- 172.21.15.154:0/2527958187 >> 172.21.15.154:0/2527958187 conn(0x7f5b6c0a2980 msgr2=0x7f5b6c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f5b72e3d700 1 -- 172.21.15.154:0/2527958187 shutdown_connections 2023-09-30T22:24:55.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.469+0000 7f5b72e3d700 1 -- 172.21.15.154:0/2527958187 wait complete. 2023-09-30T22:24:55.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.470+0000 7f5b72e3d700 1 Processor -- start 2023-09-30T22:24:55.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.470+0000 7f77ffcbf700 1 -- start start 2023-09-30T22:24:55.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77ffcbf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77f8130350 0x7f77f813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77ffcbf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f8130eb0 0x7f77f811a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77ffcbf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f811aa90 0x7f77f811af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77ffcbf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f811c240 con 0x7f77f811aa90 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77ffcbf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f811c050 con 0x7f77f8130350 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77ffcbf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77f811cd70 con 0x7f77f8130eb0 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77fd25a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f8130eb0 0x7f77f811a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77fd25a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f8130eb0 0x7f77f811a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34200/0 (socket says 172.21.15.154:34200) 2023-09-30T22:24:55.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77fd25a700 1 -- 172.21.15.154:0/3241922464 learned_addr learned my addr 172.21.15.154:0/3241922464 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:55.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.470+0000 7f5b72e3d700 1 -- start start 2023-09-30T22:24:55.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b72e3d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a0a30 0x7f5b6c11d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b72e3d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b6c0a1340 0x7f5b6c11def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b72e3d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c1304a0 0x7f5b6c11e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b72e3d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c11ee60 con 0x7f5b6c1304a0 2023-09-30T22:24:55.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b72e3d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c121e40 con 0x7f5b6c0a1340 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b72e3d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c11f570 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b70bd9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a0a30 0x7f5b6c11d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b70bd9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a0a30 0x7f5b6c11d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34198/0 (socket says 172.21.15.154:34198) 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b70bd9700 1 -- 172.21.15.154:0/3973006082 learned_addr learned my addr 172.21.15.154:0/3973006082 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:55.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b6bfff700 1 --2- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b6c0a1340 0x7f5b6c11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f5b713da700 1 --2- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c1304a0 0x7f5b6c11e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.470+0000 7f3d130b3700 1 -- start start 2023-09-30T22:24:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f3d130b3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09a150 0x7f3d0c11a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f3d130b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09edb0 0x7f3d0c11ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f3d130b3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0c133c20 0x7f3d0c11b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f3d130b3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c09b470 con 0x7f3d0c133c20 2023-09-30T22:24:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f3d130b3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0a0440 con 0x7f3d0c09edb0 2023-09-30T22:24:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f3d130b3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c11c280 con 0x7f3d0c09a150 2023-09-30T22:24:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77fe25c700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f811aa90 0x7f77f811af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.471+0000 7f77fda5b700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77f8130350 0x7f77f813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d0bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09edb0 0x7f3d0c11ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d0bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09edb0 0x7f3d0c11ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57402/0 (socket says 172.21.15.154:57402) 2023-09-30T22:24:55.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d0bfff700 1 -- 172.21.15.154:0/3858120057 learned_addr learned my addr 172.21.15.154:0/3858120057 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:55.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77fe25c700 1 -- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f8130eb0 msgr2=0x7f77f811a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77fe25c700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f8130eb0 0x7f77f811a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77fe25c700 1 -- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77f8130350 msgr2=0x7f77f813cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77fe25c700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77f8130350 0x7f77f813cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77fe25c700 1 -- 172.21.15.154:0/3241922464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4009430 con 0x7f77f811aa90 2023-09-30T22:24:55.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d10e4f700 1 --2- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09a150 0x7f3d0c11a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b70bd9700 1 -- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b6c0a1340 msgr2=0x7f5b6c11def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b70bd9700 1 --2- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b6c0a1340 0x7f5b6c11def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b70bd9700 1 -- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c1304a0 msgr2=0x7f5b6c11e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b70bd9700 1 --2- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c1304a0 0x7f5b6c11e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b70bd9700 1 -- 172.21.15.154:0/3973006082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6000b6d0 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d11650700 1 --2- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0c133c20 0x7f3d0c11b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77fd25a700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f8130eb0 0x7f77f811a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77fe25c700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f811aa90 0x7f77f811af30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f77f0007dc0 tx=0x7f77f000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b70bd9700 1 --2- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a0a30 0x7f5b6c11d9b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000d5d0 tx=0x7f5b60004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d0bfff700 1 -- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09a150 msgr2=0x7f3d0c11a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d0bfff700 1 --2- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09a150 0x7f3d0c11a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d0bfff700 1 -- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0c133c20 msgr2=0x7f3d0c11b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d0bfff700 1 --2- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0c133c20 0x7f3d0c11b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f3d0bfff700 1 -- 172.21.15.154:0/3858120057 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000094a0 con 0x7f3d0c09edb0 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77ee7fc700 1 -- 172.21.15.154:0/3241922464 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0018070 con 0x7f77f811aa90 2023-09-30T22:24:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77ee7fc700 1 -- 172.21.15.154:0/3241922464 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f000ebe0 con 0x7f77f811aa90 2023-09-30T22:24:55.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b697fa700 1 -- 172.21.15.154:0/3973006082 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6001f070 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77ee7fc700 1 -- 172.21.15.154:0/3241922464 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0003a20 con 0x7f77f811aa90 2023-09-30T22:24:55.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b697fa700 1 -- 172.21.15.154:0/3973006082 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b60010d70 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f77ffcbf700 1 -- 172.21.15.154:0/3241922464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f812ee10 con 0x7f77f811aa90 2023-09-30T22:24:55.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b72e3d700 1 -- 172.21.15.154:0/3973006082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c120ee0 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.472+0000 7f5b697fa700 1 -- 172.21.15.154:0/3973006082 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60004260 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.473+0000 7f3d0bfff700 1 --2- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09edb0 0x7f3d0c11ac00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800e980 tx=0x7f3cf800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.473+0000 7f3d097fa700 1 -- 172.21.15.154:0/3858120057 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8009710 con 0x7f3d0c09edb0 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.473+0000 7f3d097fa700 1 -- 172.21.15.154:0/3858120057 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf800c690 con 0x7f3d0c09edb0 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.473+0000 7f3d097fa700 1 -- 172.21.15.154:0/3858120057 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800ca20 con 0x7f3d0c09edb0 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.473+0000 7f3d130b3700 1 -- 172.21.15.154:0/3858120057 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c11ddf0 con 0x7f3d0c09edb0 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.474+0000 7f3d130b3700 1 -- 172.21.15.154:0/3858120057 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c1cc860 con 0x7f3d0c09edb0 2023-09-30T22:24:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.473+0000 7f77ffcbf700 1 -- 172.21.15.154:0/3241922464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f809b490 con 0x7f77f811aa90 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.474+0000 7f77ffcbf700 1 -- 172.21.15.154:0/3241922464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e00052e0 con 0x7f77f811aa90 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.473+0000 7f5b72e3d700 1 -- 172.21.15.154:0/3973006082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c130010 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.474+0000 7f77ee7fc700 1 -- 172.21.15.154:0/3241922464 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77f0014420 con 0x7f77f811aa90 2023-09-30T22:24:55.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.474+0000 7f3d097fa700 1 -- 172.21.15.154:0/3858120057 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cf800cb80 con 0x7f3d0c09edb0 2023-09-30T22:24:55.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.474+0000 7f3d130b3700 1 -- 172.21.15.154:0/3858120057 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c09fa30 con 0x7f3d0c09edb0 2023-09-30T22:24:55.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.475+0000 7f3d097fa700 1 -- 172.21.15.154:0/3858120057 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3cf803f7c0 con 0x7f3d0c09edb0 2023-09-30T22:24:55.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.474+0000 7f5b72e3d700 1 -- 172.21.15.154:0/3973006082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c09ae60 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.475+0000 7f77ee7fc700 1 -- 172.21.15.154:0/3241922464 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f77f003f7b0 con 0x7f77f811aa90 2023-09-30T22:24:55.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.475+0000 7f5b697fa700 1 -- 172.21.15.154:0/3973006082 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b600043c0 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.475+0000 7f5b697fa700 1 -- 172.21.15.154:0/3973006082 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b60040e60 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.480+0000 7f77ee7fc700 1 -- 172.21.15.154:0/3241922464 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77f00146d0 con 0x7f77f811aa90 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.483+0000 7f3d097fa700 1 -- 172.21.15.154:0/3858120057 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cf80232f0 con 0x7f3d0c09edb0 2023-09-30T22:24:55.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.483+0000 7f5b697fa700 1 -- 172.21.15.154:0/3973006082 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b600197a0 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.672+0000 7f77ffcbf700 1 -- 172.21.15.154:0/3241922464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77e0005590 con 0x7f77f811aa90 2023-09-30T22:24:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.673+0000 7f77ee7fc700 1 -- 172.21.15.154:0/3241922464 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77f00122e0 con 0x7f77f811aa90 2023-09-30T22:24:55.673 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:55.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f3d130b3700 1 -- 172.21.15.154:0/3858120057 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3d0c04f2a0 con 0x7f3d0c09edb0 2023-09-30T22:24:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f77ffcbf700 1 -- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f811aa90 msgr2=0x7f77f811af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f77ffcbf700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f811aa90 0x7f77f811af30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f77f0007dc0 tx=0x7f77f000e3c0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f77ffcbf700 1 -- 172.21.15.154:0/3241922464 shutdown_connections 2023-09-30T22:24:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f77ffcbf700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77f811aa90 0x7f77f811af30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f77ffcbf700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77f8130350 0x7f77f813cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f77ffcbf700 1 --2- 172.21.15.154:0/3241922464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77f8130eb0 0x7f77f811a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f77ffcbf700 1 -- 172.21.15.154:0/3241922464 >> 172.21.15.154:0/3241922464 conn(0x7f77f80a2980 msgr2=0x7f77f809f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f3d097fa700 1 -- 172.21.15.154:0/3858120057 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cf8021020 con 0x7f3d0c09edb0 2023-09-30T22:24:55.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f77ffcbf700 1 -- 172.21.15.154:0/3241922464 shutdown_connections 2023-09-30T22:24:55.677 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:55.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.675+0000 7f77ffcbf700 1 -- 172.21.15.154:0/3241922464 wait complete. 2023-09-30T22:24:55.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.676+0000 7f5b72e3d700 1 -- 172.21.15.154:0/3973006082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b6c11a590 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.677+0000 7f5b697fa700 1 -- 172.21.15.154:0/3973006082 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b60015030 con 0x7f5b6c0a0a30 2023-09-30T22:24:55.678 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.678+0000 7f3d130b3700 1 -- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09edb0 msgr2=0x7f3d0c11ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.678+0000 7f3d130b3700 1 --2- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09edb0 0x7f3d0c11ac00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800e980 tx=0x7f3cf800ec90 comp rx=0 tx=0).stop 2023-09-30T22:24:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.679+0000 7f3d130b3700 1 -- 172.21.15.154:0/3858120057 shutdown_connections 2023-09-30T22:24:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.679+0000 7f3d130b3700 1 --2- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0c133c20 0x7f3d0c11b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.679+0000 7f3d130b3700 1 --2- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3d0c09a150 0x7f3d0c11a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.679+0000 7f3d130b3700 1 --2- 172.21.15.154:0/3858120057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0c09edb0 0x7f3d0c11ac00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.679+0000 7f3d130b3700 1 -- 172.21.15.154:0/3858120057 >> 172.21.15.154:0/3858120057 conn(0x7f3d0c0a4430 msgr2=0x7f3d0c1b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.679+0000 7f3d130b3700 1 -- 172.21.15.154:0/3858120057 shutdown_connections 2023-09-30T22:24:55.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.679+0000 7f3d130b3700 1 -- 172.21.15.154:0/3858120057 wait complete. 2023-09-30T22:24:55.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.680+0000 7f5b72e3d700 1 -- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a0a30 msgr2=0x7f5b6c11d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.680+0000 7f5b72e3d700 1 --2- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a0a30 0x7f5b6c11d9b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5b6000d5d0 tx=0x7f5b60004750 comp rx=0 tx=0).stop 2023-09-30T22:24:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.680+0000 7f5b72e3d700 1 -- 172.21.15.154:0/3973006082 shutdown_connections 2023-09-30T22:24:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.680+0000 7f5b72e3d700 1 --2- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b6c1304a0 0x7f5b6c11e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.680+0000 7f5b72e3d700 1 --2- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b6c0a0a30 0x7f5b6c11d9b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.680+0000 7f5b72e3d700 1 --2- 172.21.15.154:0/3973006082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b6c0a1340 0x7f5b6c11def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.680+0000 7f5b72e3d700 1 -- 172.21.15.154:0/3973006082 >> 172.21.15.154:0/3973006082 conn(0x7f5b6c0a2980 msgr2=0x7f5b6c12f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.680+0000 7f5b72e3d700 1 -- 172.21.15.154:0/3973006082 shutdown_connections 2023-09-30T22:24:55.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.680+0000 7f5b72e3d700 1 -- 172.21.15.154:0/3973006082 wait complete. 2023-09-30T22:24:55.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:55.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:55.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:55.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.792+0000 7f10f9d6b700 1 Processor -- start 2023-09-30T22:24:55.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.792+0000 7f10f9d6b700 1 -- start start 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f9d6b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10f409e870 0x7f10f409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f9d6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f9d6b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f406bec0 con 0x7f10f41341d0 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f9d6b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f406ce60 con 0x7f10f409e870 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f9d6b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f409fa00 con 0x7f10f409f180 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10f409e870 0x7f10f409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f4133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57406/0 (socket says 172.21.15.154:57406) 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10f409e870 0x7f10f409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41014/0 (socket says 172.21.15.154:41014) 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f2ffd700 1 -- 172.21.15.154:0/3869811179 learned_addr learned my addr 172.21.15.154:0/3869811179 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f37fe700 1 -- 172.21.15.154:0/3869811179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 msgr2=0x7f10f4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f37fe700 1 --2- 172.21.15.154:0/3869811179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f4133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f37fe700 1 -- 172.21.15.154:0/3869811179 >> v1:172.21.15.154:6789/0 conn(0x7f10f41341d0 legacy=0x7f10f413af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f37fe700 1 -- 172.21.15.154:0/3869811179 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f409ad80 con 0x7f10f409e870 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.793+0000 7f10f2ffd700 1 --2- 172.21.15.154:0/3869811179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f37fe700 1 --2- 172.21.15.154:0/3869811179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 0x7f10f409ec40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009840 tx=0x7f10e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea1942e898943a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f27fc700 1 -- 172.21.15.154:0/3869811179 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4011830 con 0x7f10f409e870 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f27fc700 1 -- 172.21.15.154:0/3869811179 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4011990 con 0x7f10f409e870 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f27fc700 1 -- 172.21.15.154:0/3869811179 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4011d20 con 0x7f10f409e870 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f9d6b700 1 -- 172.21.15.154:0/3869811179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 msgr2=0x7f10f409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f9d6b700 1 --2- 172.21.15.154:0/3869811179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 0x7f10f409ec40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009840 tx=0x7f10e4009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f9d6b700 1 -- 172.21.15.154:0/3869811179 shutdown_connections 2023-09-30T22:24:55.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f9d6b700 1 --2- 172.21.15.154:0/3869811179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 0x7f10f409ec40 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f9d6b700 1 --2- 172.21.15.154:0/3869811179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f9d6b700 1 -- 172.21.15.154:0/3869811179 >> 172.21.15.154:0/3869811179 conn(0x7f10f40a4430 msgr2=0x7f10f40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f9d6b700 1 -- 172.21.15.154:0/3869811179 shutdown_connections 2023-09-30T22:24:55.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.794+0000 7f10f9d6b700 1 -- 172.21.15.154:0/3869811179 wait complete. 2023-09-30T22:24:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.795+0000 7f10f9d6b700 1 Processor -- start 2023-09-30T22:24:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.795+0000 7f10f9d6b700 1 -- start start 2023-09-30T22:24:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f9d6b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 0x7f10f411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f9d6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f9d6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f41341d0 0x7f10f411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f9d6b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f406fd30 con 0x7f10f409e870 2023-09-30T22:24:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f9d6b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f41332d0 con 0x7f10f409f180 2023-09-30T22:24:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f9d6b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f406cfa0 con 0x7f10f41341d0 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 0x7f10f411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f41341d0 0x7f10f411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f411f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57422/0 (socket says 172.21.15.154:57422) 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 0x7f10f411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41016/0 (socket says 172.21.15.154:41016) 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f2ffd700 1 -- 172.21.15.154:0/399825333 learned_addr learned my addr 172.21.15.154:0/399825333 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f37fe700 1 -- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f41341d0 msgr2=0x7f10f411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f37fe700 1 --2- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f41341d0 0x7f10f411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f37fe700 1 -- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 msgr2=0x7f10f411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f37fe700 1 --2- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f37fe700 1 -- 172.21.15.154:0/399825333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc009550 con 0x7f10f409e870 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f2ffd700 1 --2- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10f37fe700 1 --2- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 0x7f10f411ead0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f10e4016000 tx=0x7f10e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10ebfff700 1 -- 172.21.15.154:0/399825333 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40036a0 con 0x7f10f409e870 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.796+0000 7f10ebfff700 1 -- 172.21.15.154:0/399825333 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e401f070 con 0x7f10f409e870 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.797+0000 7f10f9d6b700 1 -- 172.21.15.154:0/399825333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e40094a0 con 0x7f10f409e870 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.797+0000 7f10ebfff700 1 -- 172.21.15.154:0/399825333 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4003a60 con 0x7f10f409e870 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.797+0000 7f10f9d6b700 1 -- 172.21.15.154:0/399825333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f4120660 con 0x7f10f409e870 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.797+0000 7f10ebfff700 1 -- 172.21.15.154:0/399825333 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10e4003bc0 con 0x7f10f409e870 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.797+0000 7f10f9d6b700 1 -- 172.21.15.154:0/399825333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f41220e0 con 0x7f10f409e870 2023-09-30T22:24:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.797+0000 7f10ebfff700 1 -- 172.21.15.154:0/399825333 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10e4021070 con 0x7f10f409e870 2023-09-30T22:24:55.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.802+0000 7f10ebfff700 1 -- 172.21.15.154:0/399825333 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10e402b070 con 0x7f10f409e870 2023-09-30T22:24:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.988+0000 7f10f9d6b700 1 -- 172.21.15.154:0/399825333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f10f404f2a0 con 0x7f10f409e870 2023-09-30T22:24:55.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.988+0000 7f10ebfff700 1 -- 172.21.15.154:0/399825333 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10e4015030 con 0x7f10f409e870 2023-09-30T22:24:55.990 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:55.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.990+0000 7f10f9d6b700 1 -- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 msgr2=0x7f10f411ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:55.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.990+0000 7f10f9d6b700 1 --2- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 0x7f10f411ead0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f10e4016000 tx=0x7f10e4004750 comp rx=0 tx=0).stop 2023-09-30T22:24:55.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.990+0000 7f10f9d6b700 1 -- 172.21.15.154:0/399825333 shutdown_connections 2023-09-30T22:24:55.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.990+0000 7f10f9d6b700 1 --2- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f41341d0 0x7f10f411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.990+0000 7f10f9d6b700 1 --2- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f409e870 0x7f10f411ead0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.990+0000 7f10f9d6b700 1 --2- 172.21.15.154:0/399825333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f409f180 0x7f10f411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:55.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.990+0000 7f10f9d6b700 1 -- 172.21.15.154:0/399825333 >> 172.21.15.154:0/399825333 conn(0x7f10f40a4430 msgr2=0x7f10f4071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:55.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.990+0000 7f10f9d6b700 1 -- 172.21.15.154:0/399825333 shutdown_connections 2023-09-30T22:24:55.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:55.990+0000 7f10f9d6b700 1 -- 172.21.15.154:0/399825333 wait complete. 2023-09-30T22:24:56.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:56.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:56.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:56.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.835+0000 7f1860bd2700 1 Processor -- start 2023-09-30T22:24:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.835+0000 7f1860bd2700 1 -- start start 2023-09-30T22:24:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.835+0000 7fc461593700 1 Processor -- start 2023-09-30T22:24:56.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.835+0000 7fcd415c5700 1 Processor -- start 2023-09-30T22:24:56.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fc461593700 1 -- start start 2023-09-30T22:24:56.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd415c5700 1 -- start start 2023-09-30T22:24:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f1860bd2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f185c09f430 0x7f185c138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f1860bd2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c1391f0 0x7f185c13b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f1860bd2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c09ac20 con 0x7f185c09e950 2023-09-30T22:24:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f1860bd2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0a06c0 con 0x7f185c09f430 2023-09-30T22:24:56.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f1860bd2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c09ae90 con 0x7f185c1391f0 2023-09-30T22:24:56.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f185ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c1391f0 0x7f185c13b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f1859d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f185c09f430 0x7f185c138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f185ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c1391f0 0x7f185c13b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57430/0 (socket says 172.21.15.154:57430) 2023-09-30T22:24:56.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f185ad9d700 1 -- 172.21.15.154:0/3037900816 learned_addr learned my addr 172.21.15.154:0/3037900816 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:56.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f1859d9b700 1 --2- 172.21.15.154:0/3037900816 >> v2:172.21.15.154:3300/0 conn(0x7f185c09f430 0x7f185c138cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41022/0 (socket says 172.21.15.154:41022) 2023-09-30T22:24:56.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fc461593700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 0x7fc45c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fc461593700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc45c09a730 0x7fc45c130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fc461593700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c099a60 con 0x7fc45c130890 2023-09-30T22:24:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fc461593700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c09bf50 con 0x7fc45c09a730 2023-09-30T22:24:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fc461593700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c09b230 con 0x7fc45c099e20 2023-09-30T22:24:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd415c5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd415c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c139280 0x7fcd3c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd415c5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c06b2d0 con 0x7fcd3c133ad0 2023-09-30T22:24:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd415c5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c1345b0 con 0x7fcd3c139280 2023-09-30T22:24:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd3a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd3b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c139280 0x7fcd3c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fc45b7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc45c130890 0x7fc45c137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38114/0 (socket says 172.21.15.154:38114) 2023-09-30T22:24:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fc45b7fe700 1 -- 172.21.15.154:0/883624886 learned_addr learned my addr 172.21.15.154:0/883624886 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:56.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f185ad9d700 1 -- 172.21.15.154:0/3037900816 >> v2:172.21.15.154:3300/0 conn(0x7f185c09f430 msgr2=0x7f185c138cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fc45a7fc700 1 --2- 172.21.15.154:0/883624886 >> v2:172.21.15.154:3300/0 conn(0x7fc45c09a730 0x7fc45c130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7f185ad9d700 1 --2- 172.21.15.154:0/3037900816 >> v2:172.21.15.154:3300/0 conn(0x7f185c09f430 0x7f185c138cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7f185ad9d700 1 -- 172.21.15.154:0/3037900816 >> v1:172.21.15.154:6789/0 conn(0x7f185c09e950 legacy=0x7f185c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7f185ad9d700 1 -- 172.21.15.154:0/3037900816 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c06ba00 con 0x7f185c1391f0 2023-09-30T22:24:56.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd3a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34250/0 (socket says 172.21.15.154:34250) 2023-09-30T22:24:56.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd3a7fc700 1 -- 172.21.15.154:0/3732710137 learned_addr learned my addr 172.21.15.154:0/3732710137 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:56.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd3b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c139280 0x7fcd3c13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57432/0 (socket says 172.21.15.154:57432) 2023-09-30T22:24:56.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.836+0000 7fcd3affd700 1 --1- 172.21.15.154:0/3732710137 >> v1:172.21.15.154:6789/0 conn(0x7fcd3c133ad0 0x7fcd3c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38110/0 (socket says 172.21.15.154:38110) 2023-09-30T22:24:56.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd415c5700 1 -- 172.21.15.154:0/3732710137 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c133610 con 0x7fcd3c136960 2023-09-30T22:24:56.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7f185ad9d700 1 --2- 172.21.15.154:0/3037900816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c1391f0 0x7f185c13b5d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1854009e50 tx=0x7f185400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cecec2eb958c252 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd39ffb700 1 -- 172.21.15.154:0/3732710137 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785796872 0 0) 0x7fcd3c06b2d0 con 0x7fcd3c133ad0 2023-09-30T22:24:56.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd39ffb700 1 -- 172.21.15.154:0/3732710137 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd240035b0 con 0x7fcd3c133ad0 2023-09-30T22:24:56.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fc459ffb700 1 -- 172.21.15.154:0/883624886 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925451192 0 0) 0x7fc45c099a60 con 0x7fc45c130890 2023-09-30T22:24:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fc459ffb700 1 -- 172.21.15.154:0/883624886 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4440035b0 con 0x7fc45c130890 2023-09-30T22:24:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd3a7fc700 1 -- 172.21.15.154:0/3732710137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c139280 msgr2=0x7fcd3c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd3a7fc700 1 --2- 172.21.15.154:0/3732710137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c139280 0x7fcd3c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd3a7fc700 1 -- 172.21.15.154:0/3732710137 >> v1:172.21.15.154:6789/0 conn(0x7fcd3c133ad0 legacy=0x7fcd3c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd3a7fc700 1 -- 172.21.15.154:0/3732710137 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c09a500 con 0x7fcd3c136960 2023-09-30T22:24:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd3b7fe700 1 --2- 172.21.15.154:0/3732710137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c139280 0x7fcd3c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:56.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7f185959a700 1 -- 172.21.15.154:0/3037900816 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400e070 con 0x7f185c1391f0 2023-09-30T22:24:56.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7f185959a700 1 -- 172.21.15.154:0/3037900816 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400b910 con 0x7f185c1391f0 2023-09-30T22:24:56.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7f185959a700 1 -- 172.21.15.154:0/3037900816 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400bcc0 con 0x7f185c1391f0 2023-09-30T22:24:56.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fc45a7fc700 1 -- 172.21.15.154:0/883624886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 msgr2=0x7fc45c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:56.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fc45a7fc700 1 --2- 172.21.15.154:0/883624886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 0x7fc45c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fc45a7fc700 1 -- 172.21.15.154:0/883624886 >> v1:172.21.15.154:6789/0 conn(0x7fc45c130890 legacy=0x7fc45c137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fc45a7fc700 1 -- 172.21.15.154:0/883624886 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c09bb90 con 0x7fc45c09a730 2023-09-30T22:24:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd3a7fc700 1 --2- 172.21.15.154:0/3732710137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c138d40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009920 tx=0x7fcd30009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a6b12150d4c3f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fc45a7fc700 1 --2- 172.21.15.154:0/883624886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a730 0x7fc45c130350 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc450009840 tx=0x7fc450009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97f1ffe0c21fb11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.837+0000 7fcd39ffb700 1 -- 172.21.15.154:0/3732710137 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30011830 con 0x7fcd3c136960 2023-09-30T22:24:56.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fcd39ffb700 1 -- 172.21.15.154:0/3732710137 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd30011990 con 0x7fcd3c136960 2023-09-30T22:24:56.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fcd39ffb700 1 -- 172.21.15.154:0/3732710137 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30011d00 con 0x7fcd3c136960 2023-09-30T22:24:56.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fc459ffb700 1 -- 172.21.15.154:0/883624886 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450011830 con 0x7fc45c09a730 2023-09-30T22:24:56.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fc459ffb700 1 -- 172.21.15.154:0/883624886 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450011990 con 0x7fc45c09a730 2023-09-30T22:24:56.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fc459ffb700 1 -- 172.21.15.154:0/883624886 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450011d20 con 0x7fc45c09a730 2023-09-30T22:24:56.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7f1860bd2700 1 -- 172.21.15.154:0/3037900816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c1391f0 msgr2=0x7f185c13b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7f1860bd2700 1 --2- 172.21.15.154:0/3037900816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c1391f0 0x7f185c13b5d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1854009e50 tx=0x7f185400b330 comp rx=0 tx=0).stop 2023-09-30T22:24:56.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7f1860bd2700 1 -- 172.21.15.154:0/3037900816 shutdown_connections 2023-09-30T22:24:56.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7f1860bd2700 1 --2- 172.21.15.154:0/3037900816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c1391f0 0x7f185c13b5d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7f1860bd2700 1 --2- 172.21.15.154:0/3037900816 >> v2:172.21.15.154:3300/0 conn(0x7f185c09f430 0x7f185c138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7f1860bd2700 1 -- 172.21.15.154:0/3037900816 >> 172.21.15.154:0/3037900816 conn(0x7f185c0a0f70 msgr2=0x7f185c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7f1860bd2700 1 -- 172.21.15.154:0/3037900816 shutdown_connections 2023-09-30T22:24:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7f1860bd2700 1 -- 172.21.15.154:0/3037900816 wait complete. 2023-09-30T22:24:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fcd415c5700 1 -- 172.21.15.154:0/3732710137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 msgr2=0x7fcd3c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fcd415c5700 1 --2- 172.21.15.154:0/3732710137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c138d40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009920 tx=0x7fcd30009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fcd415c5700 1 -- 172.21.15.154:0/3732710137 shutdown_connections 2023-09-30T22:24:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fcd415c5700 1 --2- 172.21.15.154:0/3732710137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c139280 0x7fcd3c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fcd415c5700 1 --2- 172.21.15.154:0/3732710137 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c138d40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fcd415c5700 1 -- 172.21.15.154:0/3732710137 >> 172.21.15.154:0/3732710137 conn(0x7fcd3c099c40 msgr2=0x7fcd3c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fc461593700 1 -- 172.21.15.154:0/883624886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a730 msgr2=0x7fc45c130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.838+0000 7fc461593700 1 --2- 172.21.15.154:0/883624886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a730 0x7fc45c130350 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc450009840 tx=0x7fc450009b50 comp rx=0 tx=0).stop 2023-09-30T22:24:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.839+0000 7fc461593700 1 -- 172.21.15.154:0/883624886 shutdown_connections 2023-09-30T22:24:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.839+0000 7fc461593700 1 --2- 172.21.15.154:0/883624886 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 0x7fc45c09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.839+0000 7fc461593700 1 --2- 172.21.15.154:0/883624886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a730 0x7fc45c130350 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.839+0000 7fc461593700 1 -- 172.21.15.154:0/883624886 >> 172.21.15.154:0/883624886 conn(0x7fc45c0a2980 msgr2=0x7fc45c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.839+0000 7fcd415c5700 1 -- 172.21.15.154:0/3732710137 shutdown_connections 2023-09-30T22:24:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.839+0000 7fcd415c5700 1 -- 172.21.15.154:0/3732710137 wait complete. 2023-09-30T22:24:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.839+0000 7fc461593700 1 -- 172.21.15.154:0/883624886 shutdown_connections 2023-09-30T22:24:56.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.839+0000 7fc461593700 1 -- 172.21.15.154:0/883624886 wait complete. 2023-09-30T22:24:56.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7f1860bd2700 1 Processor -- start 2023-09-30T22:24:56.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc461593700 1 Processor -- start 2023-09-30T22:24:56.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc461593700 1 -- start start 2023-09-30T22:24:56.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fcd415c5700 1 Processor -- start 2023-09-30T22:24:56.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7f1860bd2700 1 -- start start 2023-09-30T22:24:56.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fcd415c5700 1 -- start start 2023-09-30T22:24:56.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc461593700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 0x7fc45c12ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc461593700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a730 0x7fc45c12b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc461593700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c130890 0x7fc45c1c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc461593700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c12cf40 con 0x7fc45c09a730 2023-09-30T22:24:56.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc461593700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c12a900 con 0x7fc45c130890 2023-09-30T22:24:56.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc461593700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c1398f0 con 0x7fc45c099e20 2023-09-30T22:24:56.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc45affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 0x7fc45c12ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc45affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 0x7fc45c12ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34260/0 (socket says 172.21.15.154:34260) 2023-09-30T22:24:56.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.840+0000 7fc45affd700 1 -- 172.21.15.154:0/3046771514 learned_addr learned my addr 172.21.15.154:0/3046771514 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:56.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc45a7fc700 1 --2- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a730 0x7fc45c12b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd415c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c133ad0 0x7fcd3c070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd415c5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd415c5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c139280 0x7fcd3c071970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd415c5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c138fc0 con 0x7fcd3c139280 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd415c5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c06fd70 con 0x7fcd3c133ad0 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd415c5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c130b40 con 0x7fcd3c136960 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f1860bd2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c09e950 0x7f185c120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f1860bd2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c09f430 0x7f185c120e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f1860bd2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f185c1391f0 0x7f185c1213c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f1860bd2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c124500 con 0x7f185c09f430 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f1860bd2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c136830 con 0x7f185c09e950 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f1860bd2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f185c122db0 con 0x7f185c1391f0 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f185ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f185c1391f0 0x7f185c1213c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f185ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f185c1391f0 0x7f185c1213c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34268/0 (socket says 172.21.15.154:34268) 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f185ad9d700 1 -- 172.21.15.154:0/674698841 learned_addr learned my addr 172.21.15.154:0/674698841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc45affd700 1 -- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c130890 msgr2=0x7fc45c1c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc45affd700 1 --2- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c130890 0x7fc45c1c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc45affd700 1 -- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a730 msgr2=0x7fc45c12b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc45affd700 1 --2- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a730 0x7fc45c12b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc45affd700 1 -- 172.21.15.154:0/3046771514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500094a0 con 0x7fc45c099e20 2023-09-30T22:24:56.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc45affd700 1 --2- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 0x7fc45c12ada0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00b520 tx=0x7fc44c00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f185ad9d700 1 -- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c09e950 msgr2=0x7f185c120940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:24:56.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f185ad9d700 1 --2- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c09e950 0x7f185c120940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f185ad9d700 1 -- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c09f430 msgr2=0x7f185c120e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f185ad9d700 1 --2- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c09f430 0x7f185c120e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f185ad9d700 1 -- 172.21.15.154:0/674698841 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854009b30 con 0x7f185c1391f0 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd3b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c139280 0x7fcd3c071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc4437fe700 1 -- 172.21.15.154:0/3046771514 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c005aa0 con 0x7fc45c099e20 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd3affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c133ad0 0x7fcd3c070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd3b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c139280 0x7fcd3c071970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41056/0 (socket says 172.21.15.154:41056) 2023-09-30T22:24:56.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd3b7fe700 1 -- 172.21.15.154:0/3139053422 learned_addr learned my addr 172.21.15.154:0/3139053422 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:56.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7f185ad9d700 1 --2- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f185c1391f0 0x7f185c1213c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1854003f50 tx=0x7f1854004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fcd3a7fc700 1 --2- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc4437fe700 1 -- 172.21.15.154:0/3046771514 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c005c00 con 0x7fc45c099e20 2023-09-30T22:24:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc4437fe700 1 -- 172.21.15.154:0/3046771514 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c011630 con 0x7fc45c099e20 2023-09-30T22:24:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc461593700 1 -- 172.21.15.154:0/3046771514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c09b470 con 0x7fc45c099e20 2023-09-30T22:24:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.841+0000 7fc461593700 1 -- 172.21.15.154:0/3046771514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c12c050 con 0x7fc45c099e20 2023-09-30T22:24:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7f184affd700 1 -- 172.21.15.154:0/674698841 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854004250 con 0x7f185c1391f0 2023-09-30T22:24:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7f184affd700 1 -- 172.21.15.154:0/674698841 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18540043b0 con 0x7f185c1391f0 2023-09-30T22:24:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7f184affd700 1 -- 172.21.15.154:0/674698841 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854004760 con 0x7f185c1391f0 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7fcd3b7fe700 1 -- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 msgr2=0x7fcd3c071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7fcd3b7fe700 1 --2- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7fcd3b7fe700 1 -- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c133ad0 msgr2=0x7fcd3c070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7fcd3b7fe700 1 --2- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c133ad0 0x7fcd3c070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7fcd3b7fe700 1 -- 172.21.15.154:0/3139053422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd34009a70 con 0x7fcd3c139280 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7fcd3b7fe700 1 --2- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c139280 0x7fcd3c071970 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009f00 tx=0x7fcd3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7fcd237fe700 1 -- 172.21.15.154:0/3139053422 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3400cc00 con 0x7fcd3c139280 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7f1860bd2700 1 -- 172.21.15.154:0/674698841 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c06fc50 con 0x7f185c1391f0 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.842+0000 7f1860bd2700 1 -- 172.21.15.154:0/674698841 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c124180 con 0x7f185c1391f0 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7fcd237fe700 1 -- 172.21.15.154:0/3139053422 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3400f040 con 0x7fcd3c139280 2023-09-30T22:24:56.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7fcd415c5700 1 -- 172.21.15.154:0/3139053422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd30009550 con 0x7fcd3c139280 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7f1860bd2700 1 -- 172.21.15.154:0/674698841 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c04f2a0 con 0x7f185c1391f0 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7fc461593700 1 -- 172.21.15.154:0/3046771514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c04f2a0 con 0x7fc45c099e20 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7fc4437fe700 1 -- 172.21.15.154:0/3046771514 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc44c011790 con 0x7fc45c099e20 2023-09-30T22:24:56.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7f184affd700 1 -- 172.21.15.154:0/674698841 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f185401c440 con 0x7f185c1391f0 2023-09-30T22:24:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7fc4437fe700 1 -- 172.21.15.154:0/3046771514 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc44c03f460 con 0x7fc45c099e20 2023-09-30T22:24:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.844+0000 7f184affd700 1 -- 172.21.15.154:0/674698841 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f18540415a0 con 0x7f185c1391f0 2023-09-30T22:24:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7fcd415c5700 1 -- 172.21.15.154:0/3139053422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c06fa10 con 0x7fcd3c139280 2023-09-30T22:24:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.843+0000 7fcd237fe700 1 -- 172.21.15.154:0/3139053422 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34003a20 con 0x7fcd3c139280 2023-09-30T22:24:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.844+0000 7fcd237fe700 1 -- 172.21.15.154:0/3139053422 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd34003b80 con 0x7fcd3c139280 2023-09-30T22:24:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.844+0000 7fcd415c5700 1 -- 172.21.15.154:0/3139053422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c04f2a0 con 0x7fcd3c139280 2023-09-30T22:24:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.845+0000 7fcd237fe700 1 -- 172.21.15.154:0/3139053422 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd340400e0 con 0x7fcd3c139280 2023-09-30T22:24:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.848+0000 7f184affd700 1 -- 172.21.15.154:0/674698841 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f185402ebd0 con 0x7f185c1391f0 2023-09-30T22:24:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.849+0000 7fcd237fe700 1 -- 172.21.15.154:0/3139053422 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd3401b360 con 0x7fcd3c139280 2023-09-30T22:24:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:56.852+0000 7fc4437fe700 1 -- 172.21.15.154:0/3046771514 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc44c0212f0 con 0x7fc45c099e20 2023-09-30T22:24:57.003 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.045+0000 7f1860bd2700 1 -- 172.21.15.154:0/674698841 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f185c06bbe0 con 0x7f185c1391f0 2023-09-30T22:24:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.046+0000 7f184affd700 1 -- 172.21.15.154:0/674698841 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1854033070 con 0x7f185c1391f0 2023-09-30T22:24:57.046 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.049+0000 7f1860bd2700 1 -- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f185c1391f0 msgr2=0x7f185c1213c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.049+0000 7f1860bd2700 1 --2- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f185c1391f0 0x7f185c1213c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1854003f50 tx=0x7f1854004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.049+0000 7f1860bd2700 1 -- 172.21.15.154:0/674698841 shutdown_connections 2023-09-30T22:24:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.049+0000 7f1860bd2700 1 --2- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f185c1391f0 0x7f185c1213c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.049+0000 7f1860bd2700 1 --2- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f185c09e950 0x7f185c120940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.049+0000 7f1860bd2700 1 --2- 172.21.15.154:0/674698841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f185c09f430 0x7f185c120e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.049+0000 7f1860bd2700 1 -- 172.21.15.154:0/674698841 >> 172.21.15.154:0/674698841 conn(0x7f185c0a0f70 msgr2=0x7f185c136d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.049+0000 7f1860bd2700 1 -- 172.21.15.154:0/674698841 shutdown_connections 2023-09-30T22:24:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.049+0000 7f1860bd2700 1 -- 172.21.15.154:0/674698841 wait complete. 2023-09-30T22:24:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.063+0000 7fc461593700 1 -- 172.21.15.154:0/3046771514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc45c0a0100 con 0x7fc45c099e20 2023-09-30T22:24:57.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.063+0000 7fc4437fe700 1 -- 172.21.15.154:0/3046771514 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc44c018b50 con 0x7fc45c099e20 2023-09-30T22:24:57.063 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:57.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.065+0000 7fc461593700 1 -- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 msgr2=0x7fc45c12ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.065+0000 7fc461593700 1 --2- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 0x7fc45c12ada0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00b520 tx=0x7fc44c00b8e0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.065+0000 7fc461593700 1 -- 172.21.15.154:0/3046771514 shutdown_connections 2023-09-30T22:24:57.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.065+0000 7fc461593700 1 --2- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c130890 0x7fc45c1c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.065+0000 7fc461593700 1 --2- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c099e20 0x7fc45c12ada0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.065+0000 7fc461593700 1 --2- 172.21.15.154:0/3046771514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a730 0x7fc45c12b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.065+0000 7fc461593700 1 -- 172.21.15.154:0/3046771514 >> 172.21.15.154:0/3046771514 conn(0x7fc45c0a2980 msgr2=0x7fc45c06df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.066+0000 7fc461593700 1 -- 172.21.15.154:0/3046771514 shutdown_connections 2023-09-30T22:24:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.066+0000 7fc461593700 1 -- 172.21.15.154:0/3046771514 wait complete. 2023-09-30T22:24:57.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.072+0000 7fcd415c5700 1 -- 172.21.15.154:0/3139053422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd3c06ff20 con 0x7fcd3c139280 2023-09-30T22:24:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.072+0000 7fcd237fe700 1 -- 172.21.15.154:0/3139053422 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd3c06ff20 con 0x7fcd3c139280 2023-09-30T22:24:57.072 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.076+0000 7fcd415c5700 1 -- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c139280 msgr2=0x7fcd3c071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.076+0000 7fcd415c5700 1 --2- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c139280 0x7fcd3c071970 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009f00 tx=0x7fcd3400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.076+0000 7fcd415c5700 1 -- 172.21.15.154:0/3139053422 shutdown_connections 2023-09-30T22:24:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.076+0000 7fcd415c5700 1 --2- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3c139280 0x7fcd3c071970 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.076+0000 7fcd415c5700 1 --2- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd3c133ad0 0x7fcd3c070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.076+0000 7fcd415c5700 1 --2- 172.21.15.154:0/3139053422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd3c136960 0x7fcd3c071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.076+0000 7fcd415c5700 1 -- 172.21.15.154:0/3139053422 >> 172.21.15.154:0/3139053422 conn(0x7fcd3c099c40 msgr2=0x7fcd3c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.076+0000 7fcd415c5700 1 -- 172.21.15.154:0/3139053422 shutdown_connections 2023-09-30T22:24:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.076+0000 7fcd415c5700 1 -- 172.21.15.154:0/3139053422 wait complete. 2023-09-30T22:24:57.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:57.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:57.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.140+0000 7fba6c664700 1 Processor -- start 2023-09-30T22:24:57.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.140+0000 7fba6c664700 1 -- start start 2023-09-30T22:24:57.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba6c664700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409e340 0x7fba641359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba6c664700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba64135f20 0x7fba64138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba6c664700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6409aaa0 con 0x7fba6409d860 2023-09-30T22:24:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba6c664700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6409e730 con 0x7fba64135f20 2023-09-30T22:24:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba6c664700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba6409f870 con 0x7fba6409e340 2023-09-30T22:24:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba69bff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409e340 0x7fba641359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba69bff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409e340 0x7fba641359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34274/0 (socket says 172.21.15.154:34274) 2023-09-30T22:24:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba6a400700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fba6409d860 0x7fba6409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38118/0 (socket says 172.21.15.154:38118) 2023-09-30T22:24:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba69bff700 1 -- 172.21.15.154:0/1555923093 learned_addr learned my addr 172.21.15.154:0/1555923093 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba6ac01700 1 --2- 172.21.15.154:0/1555923093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba64135f20 0x7fba64138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba693fe700 1 -- 172.21.15.154:0/1555923093 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284800440 0 0) 0x7fba6409aaa0 con 0x7fba6409d860 2023-09-30T22:24:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba69bff700 1 -- 172.21.15.154:0/1555923093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba64135f20 msgr2=0x7fba64138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba69bff700 1 --2- 172.21.15.154:0/1555923093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba64135f20 0x7fba64138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba69bff700 1 -- 172.21.15.154:0/1555923093 >> v1:172.21.15.154:6789/0 conn(0x7fba6409d860 legacy=0x7fba6409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.141+0000 7fba69bff700 1 -- 172.21.15.154:0/1555923093 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6409b360 con 0x7fba6409e340 2023-09-30T22:24:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba69bff700 1 --2- 172.21.15.154:0/1555923093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409e340 0x7fba641359e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fba5400bbf0 tx=0x7fba5400bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43efd5875dcdedf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba693fe700 1 -- 172.21.15.154:0/1555923093 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5400dcf0 con 0x7fba6409e340 2023-09-30T22:24:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba693fe700 1 -- 172.21.15.154:0/1555923093 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5400de50 con 0x7fba6409e340 2023-09-30T22:24:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba693fe700 1 -- 172.21.15.154:0/1555923093 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54010690 con 0x7fba6409e340 2023-09-30T22:24:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba6c664700 1 -- 172.21.15.154:0/1555923093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409e340 msgr2=0x7fba641359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba6c664700 1 --2- 172.21.15.154:0/1555923093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409e340 0x7fba641359e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fba5400bbf0 tx=0x7fba5400bf00 comp rx=0 tx=0).stop 2023-09-30T22:24:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba6c664700 1 -- 172.21.15.154:0/1555923093 shutdown_connections 2023-09-30T22:24:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba6c664700 1 --2- 172.21.15.154:0/1555923093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba64135f20 0x7fba64138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba6c664700 1 --2- 172.21.15.154:0/1555923093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409e340 0x7fba641359e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.142+0000 7fba6c664700 1 -- 172.21.15.154:0/1555923093 >> 172.21.15.154:0/1555923093 conn(0x7fba64099c40 msgr2=0x7fba640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.143+0000 7fba6c664700 1 -- 172.21.15.154:0/1555923093 shutdown_connections 2023-09-30T22:24:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.143+0000 7fba6c664700 1 -- 172.21.15.154:0/1555923093 wait complete. 2023-09-30T22:24:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.143+0000 7fba6c664700 1 Processor -- start 2023-09-30T22:24:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.143+0000 7fba6c664700 1 -- start start 2023-09-30T22:24:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6c664700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409d860 0x7fba6411c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6c664700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409e340 0x7fba6411c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6c664700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64135f20 0x7fba6411cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6c664700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba64072700 con 0x7fba64135f20 2023-09-30T22:24:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6c664700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6411f540 con 0x7fba6409e340 2023-09-30T22:24:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6c664700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba6411fe50 con 0x7fba6409d860 2023-09-30T22:24:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6a400700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409d860 0x7fba6411c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba69bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409e340 0x7fba6411c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6ac01700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64135f20 0x7fba6411cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6a400700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409d860 0x7fba6411c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34290/0 (socket says 172.21.15.154:34290) 2023-09-30T22:24:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6a400700 1 -- 172.21.15.154:0/190057709 learned_addr learned my addr 172.21.15.154:0/190057709 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba69bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409e340 0x7fba6411c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57464/0 (socket says 172.21.15.154:57464) 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6a400700 1 -- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409e340 msgr2=0x7fba6411c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6a400700 1 --2- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409e340 0x7fba6411c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6a400700 1 -- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64135f20 msgr2=0x7fba6411cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6a400700 1 --2- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64135f20 0x7fba6411cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6a400700 1 -- 172.21.15.154:0/190057709 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5400b7f0 con 0x7fba6409d860 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba69bff700 1 --2- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409e340 0x7fba6411c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6ac01700 1 --2- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64135f20 0x7fba6411cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.144+0000 7fba6a400700 1 --2- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409d860 0x7fba6411c290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fba6000c520 tx=0x7fba6000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.145+0000 7fba5affd700 1 -- 172.21.15.154:0/190057709 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60004c80 con 0x7fba6409d860 2023-09-30T22:24:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.145+0000 7fba5affd700 1 -- 172.21.15.154:0/190057709 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60004e00 con 0x7fba6409d860 2023-09-30T22:24:57.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.145+0000 7fba6c664700 1 -- 172.21.15.154:0/190057709 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6411e690 con 0x7fba6409d860 2023-09-30T22:24:57.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.145+0000 7fba5affd700 1 -- 172.21.15.154:0/190057709 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60007310 con 0x7fba6409d860 2023-09-30T22:24:57.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.145+0000 7fba6c664700 1 -- 172.21.15.154:0/190057709 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba64120540 con 0x7fba6409d860 2023-09-30T22:24:57.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.145+0000 7fba5affd700 1 -- 172.21.15.154:0/190057709 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba60007470 con 0x7fba6409d860 2023-09-30T22:24:57.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.146+0000 7fba5affd700 1 -- 172.21.15.154:0/190057709 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba6003f3a0 con 0x7fba6409d860 2023-09-30T22:24:57.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.146+0000 7fba6c664700 1 -- 172.21.15.154:0/190057709 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6411f750 con 0x7fba6409d860 2023-09-30T22:24:57.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.150+0000 7fba5affd700 1 -- 172.21.15.154:0/190057709 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba6411f750 con 0x7fba6409d860 2023-09-30T22:24:57.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.334+0000 7fba6c664700 1 -- 172.21.15.154:0/190057709 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fba6411f750 con 0x7fba6409d860 2023-09-30T22:24:57.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.334+0000 7fba5affd700 1 -- 172.21.15.154:0/190057709 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba6411f750 con 0x7fba6409d860 2023-09-30T22:24:57.334 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:57.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.336+0000 7fba6c664700 1 -- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409d860 msgr2=0x7fba6411c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:57.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.336+0000 7fba6c664700 1 --2- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409d860 0x7fba6411c290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fba6000c520 tx=0x7fba6000c830 comp rx=0 tx=0).stop 2023-09-30T22:24:57.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.336+0000 7fba6c664700 1 -- 172.21.15.154:0/190057709 shutdown_connections 2023-09-30T22:24:57.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.336+0000 7fba6c664700 1 --2- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba64135f20 0x7fba6411cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.336+0000 7fba6c664700 1 --2- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba6409d860 0x7fba6411c290 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.336+0000 7fba6c664700 1 --2- 172.21.15.154:0/190057709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba6409e340 0x7fba6411c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:57.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.336+0000 7fba6c664700 1 -- 172.21.15.154:0/190057709 >> 172.21.15.154:0/190057709 conn(0x7fba64099c40 msgr2=0x7fba6406ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:57.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.336+0000 7fba6c664700 1 -- 172.21.15.154:0/190057709 shutdown_connections 2023-09-30T22:24:57.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:57.336+0000 7fba6c664700 1 -- 172.21.15.154:0/190057709 wait complete. 2023-09-30T22:24:57.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:58.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:58.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:58.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:58.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.204+0000 7fa7a4b13700 1 Processor -- start 2023-09-30T22:24:58.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.204+0000 7fa7a4b13700 1 -- start start 2023-09-30T22:24:58.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa7a4b13700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 0x7fa7a0138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa7a4b13700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa7a4b13700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a009b110 con 0x7fa7a009ad40 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa7a4b13700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a00a3b60 con 0x7fa7a0134140 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa7a4b13700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a00a1a80 con 0x7fa7a0134570 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 0x7fa7a0138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79e59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa7a009ad40 0x7fa7a0133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38122/0 (socket says 172.21.15.154:38122) 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79e59c700 1 -- 172.21.15.154:0/3518149307 learned_addr learned my addr 172.21.15.154:0/3518149307 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79d59a700 1 -- 172.21.15.154:0/3518149307 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572990867 0 0) 0x7fa7a009b110 con 0x7fa7a009ad40 2023-09-30T22:24:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79d59a700 1 -- 172.21.15.154:0/3518149307 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7880035b0 con 0x7fa7a009ad40 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79ed9d700 1 -- 172.21.15.154:0/3518149307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 msgr2=0x7fa7a0138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79ed9d700 1 --2- 172.21.15.154:0/3518149307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 0x7fa7a0138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79ed9d700 1 -- 172.21.15.154:0/3518149307 >> v1:172.21.15.154:6789/0 conn(0x7fa7a009ad40 legacy=0x7fa7a0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79ed9d700 1 -- 172.21.15.154:0/3518149307 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a00a2fa0 con 0x7fa7a0134570 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.205+0000 7fa79dd9b700 1 --2- 172.21.15.154:0/3518149307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 0x7fa7a0138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.206+0000 7fa79ed9d700 1 --2- 172.21.15.154:0/3518149307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a013b3d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa798009dc0 tx=0x7fa79800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98c8a5205681c528 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.206+0000 7fa79d59a700 1 -- 172.21.15.154:0/3518149307 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800e070 con 0x7fa7a0134570 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.206+0000 7fa79d59a700 1 -- 172.21.15.154:0/3518149307 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79800bae0 con 0x7fa7a0134570 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.206+0000 7fa79d59a700 1 -- 172.21.15.154:0/3518149307 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800be90 con 0x7fa7a0134570 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.206+0000 7fa7a4b13700 1 -- 172.21.15.154:0/3518149307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 msgr2=0x7fa7a013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.206+0000 7fa7a4b13700 1 --2- 172.21.15.154:0/3518149307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a013b3d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa798009dc0 tx=0x7fa79800b330 comp rx=0 tx=0).stop 2023-09-30T22:24:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.207+0000 7fa7a4b13700 1 -- 172.21.15.154:0/3518149307 shutdown_connections 2023-09-30T22:24:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.207+0000 7fa7a4b13700 1 --2- 172.21.15.154:0/3518149307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a013b3d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.207+0000 7fa7a4b13700 1 --2- 172.21.15.154:0/3518149307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 0x7fa7a0138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.207+0000 7fa7a4b13700 1 -- 172.21.15.154:0/3518149307 >> 172.21.15.154:0/3518149307 conn(0x7fa7a0099c40 msgr2=0x7fa7a006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.207+0000 7fa7a4b13700 1 -- 172.21.15.154:0/3518149307 shutdown_connections 2023-09-30T22:24:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.207+0000 7fa7a4b13700 1 -- 172.21.15.154:0/3518149307 wait complete. 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa7a4b13700 1 Processor -- start 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa7a4b13700 1 -- start start 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa7a4b13700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a009ad40 0x7fa7a01393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa7a4b13700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 0x7fa7a0139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa7a4b13700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a0139e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa7a4b13700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a011eae0 con 0x7fa7a009ad40 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa7a4b13700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a011ce30 con 0x7fa7a0134140 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa7a4b13700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a011e060 con 0x7fa7a0134570 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa79ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a0139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa79e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a009ad40 0x7fa7a01393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa79ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a0139e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34296/0 (socket says 172.21.15.154:34296) 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa79ed9d700 1 -- 172.21.15.154:0/1242757384 learned_addr learned my addr 172.21.15.154:0/1242757384 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.208+0000 7fa79dd9b700 1 --2- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 0x7fa7a0139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa79e59c700 1 -- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 msgr2=0x7fa7a0139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa79e59c700 1 --2- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a0139e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa79e59c700 1 -- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 msgr2=0x7fa7a0139920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa79e59c700 1 --2- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 0x7fa7a0139920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa79e59c700 1 -- 172.21.15.154:0/1242757384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940094a0 con 0x7fa7a009ad40 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa79ed9d700 1 --2- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a0139e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa79e59c700 1 --2- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a009ad40 0x7fa7a01393e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa79000c440 tx=0x7fa79000c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa78effd700 1 -- 172.21.15.154:0/1242757384 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790004c80 con 0x7fa7a009ad40 2023-09-30T22:24:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa78effd700 1 -- 172.21.15.154:0/1242757384 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790004de0 con 0x7fa7a009ad40 2023-09-30T22:24:58.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa7a4b13700 1 -- 172.21.15.154:0/1242757384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa798009a70 con 0x7fa7a009ad40 2023-09-30T22:24:58.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa78effd700 1 -- 172.21.15.154:0/1242757384 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790007310 con 0x7fa7a009ad40 2023-09-30T22:24:58.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.209+0000 7fa7a4b13700 1 -- 172.21.15.154:0/1242757384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a009e300 con 0x7fa7a009ad40 2023-09-30T22:24:58.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.210+0000 7fa78effd700 1 -- 172.21.15.154:0/1242757384 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa790007470 con 0x7fa7a009ad40 2023-09-30T22:24:58.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.210+0000 7fa78effd700 1 -- 172.21.15.154:0/1242757384 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa79003f1e0 con 0x7fa7a009ad40 2023-09-30T22:24:58.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.210+0000 7fa7a4b13700 1 -- 172.21.15.154:0/1242757384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a009c840 con 0x7fa7a009ad40 2023-09-30T22:24:58.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.215+0000 7fa78effd700 1 -- 172.21.15.154:0/1242757384 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa79001a2b0 con 0x7fa7a009ad40 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.243+0000 7f0d39a42700 1 Processor -- start 2023-09-30T22:24:58.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.243+0000 7f0d39a42700 1 -- start start 2023-09-30T22:24:58.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d39a42700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d39a42700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 0x7f0d3409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d39a42700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d34133c20 0x7f0d341340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d39a42700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3409a520 con 0x7f0d34133c20 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d39a42700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3409fe00 con 0x7f0d3409a150 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d39a42700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3406bec0 con 0x7f0d3409edb0 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d337fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d34133c20 0x7f0d341340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d337fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d34133c20 0x7f0d341340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41096/0 (socket says 172.21.15.154:41096) 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d327fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 0x7f0d3409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d337fe700 1 -- 172.21.15.154:0/3951930599 learned_addr learned my addr 172.21.15.154:0/3951930599 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d32ffd700 1 --2- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d337fe700 1 -- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 msgr2=0x7f0d3409f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d337fe700 1 --2- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 0x7f0d3409f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d337fe700 1 -- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 msgr2=0x7f0d3409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d337fe700 1 --2- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d337fe700 1 -- 172.21.15.154:0/3951930599 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3409af80 con 0x7f0d34133c20 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d32ffd700 1 --2- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.244+0000 7f0d337fe700 1 --2- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34133c20 0x7f0d341340c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009e80 tx=0x7f0d2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4b21c35e012b8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d31ffb700 1 -- 172.21.15.154:0/3951930599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00e070 con 0x7f0d34133c20 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d31ffb700 1 -- 172.21.15.154:0/3951930599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c00b8d0 con 0x7f0d34133c20 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d31ffb700 1 -- 172.21.15.154:0/3951930599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00bc80 con 0x7f0d34133c20 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d39a42700 1 -- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34133c20 msgr2=0x7f0d341340c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d39a42700 1 --2- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34133c20 0x7f0d341340c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009e80 tx=0x7f0d2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d39a42700 1 -- 172.21.15.154:0/3951930599 shutdown_connections 2023-09-30T22:24:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d39a42700 1 --2- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d39a42700 1 --2- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34133c20 0x7f0d341340c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d39a42700 1 --2- 172.21.15.154:0/3951930599 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 0x7f0d3409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d39a42700 1 -- 172.21.15.154:0/3951930599 >> 172.21.15.154:0/3951930599 conn(0x7f0d340a4430 msgr2=0x7f0d340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d39a42700 1 -- 172.21.15.154:0/3951930599 shutdown_connections 2023-09-30T22:24:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.245+0000 7f0d39a42700 1 -- 172.21.15.154:0/3951930599 wait complete. 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.246+0000 7f0d39a42700 1 Processor -- start 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d39a42700 1 -- start start 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d39a42700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3411f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d39a42700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 0x7f0d3411fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d39a42700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34133c20 0x7f0d341c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d39a42700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d341335e0 con 0x7f0d34133c20 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d39a42700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3411f260 con 0x7f0d3409a150 2023-09-30T22:24:58.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d39a42700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34120880 con 0x7f0d3409edb0 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d32ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3411f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d32ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3411f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57508/0 (socket says 172.21.15.154:57508) 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d32ffd700 1 -- 172.21.15.154:0/463267691 learned_addr learned my addr 172.21.15.154:0/463267691 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d337fe700 1 --2- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34133c20 0x7f0d341c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d327fc700 1 --2- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 0x7f0d3411fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d32ffd700 1 -- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 msgr2=0x7f0d3411fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d32ffd700 1 --2- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 0x7f0d3411fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d32ffd700 1 -- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34133c20 msgr2=0x7f0d341c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d32ffd700 1 --2- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34133c20 0x7f0d341c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.247+0000 7f0d32ffd700 1 -- 172.21.15.154:0/463267691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d240094a0 con 0x7f0d3409a150 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.248+0000 7f0d32ffd700 1 --2- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3411f8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400ebe0 tx=0x7f0d2400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.248+0000 7f0d1bfff700 1 -- 172.21.15.154:0/463267691 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24009760 con 0x7f0d3409a150 2023-09-30T22:24:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.248+0000 7f0d39a42700 1 -- 172.21.15.154:0/463267691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c009b30 con 0x7f0d3409a150 2023-09-30T22:24:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.248+0000 7f0d1bfff700 1 -- 172.21.15.154:0/463267691 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400c850 con 0x7f0d3409a150 2023-09-30T22:24:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.248+0000 7f0d1bfff700 1 -- 172.21.15.154:0/463267691 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400cbe0 con 0x7f0d3409a150 2023-09-30T22:24:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.248+0000 7f0d39a42700 1 -- 172.21.15.154:0/463267691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d34122220 con 0x7f0d3409a150 2023-09-30T22:24:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.249+0000 7f0d1bfff700 1 -- 172.21.15.154:0/463267691 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d2400cd40 con 0x7f0d3409a150 2023-09-30T22:24:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.249+0000 7f0d39a42700 1 -- 172.21.15.154:0/463267691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3409fa30 con 0x7f0d3409a150 2023-09-30T22:24:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.249+0000 7f0d1bfff700 1 -- 172.21.15.154:0/463267691 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d2403fad0 con 0x7f0d3409a150 2023-09-30T22:24:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.254+0000 7f0d1bfff700 1 -- 172.21.15.154:0/463267691 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d24011d60 con 0x7f0d3409a150 2023-09-30T22:24:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.257+0000 7f998337f700 1 Processor -- start 2023-09-30T22:24:58.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.257+0000 7f998337f700 1 -- start start 2023-09-30T22:24:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998337f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c09d860 0x7f997c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998337f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c130eb0 0x7f997c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998337f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997c09aaa0 con 0x7f997c09e170 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998337f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997c09f870 con 0x7f997c09d860 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998337f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f997c09b360 con 0x7f997c130eb0 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998111b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c09d860 0x7f997c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998111b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c09d860 0x7f997c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57516/0 (socket says 172.21.15.154:57516) 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998111b700 1 -- 172.21.15.154:0/4087185863 learned_addr learned my addr 172.21.15.154:0/4087185863 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998091a700 1 --1- 172.21.15.154:0/4087185863 >> v1:172.21.15.154:6789/0 conn(0x7f997c09e170 0x7f997c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38134/0 (socket says 172.21.15.154:38134) 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998191c700 1 --2- 172.21.15.154:0/4087185863 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c130eb0 0x7f997c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998111b700 1 -- 172.21.15.154:0/4087185863 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c130eb0 msgr2=0x7f997c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998111b700 1 --2- 172.21.15.154:0/4087185863 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c130eb0 0x7f997c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f9973fff700 1 -- 172.21.15.154:0/4087185863 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19328487 0 0) 0x7f997c09aaa0 con 0x7f997c09e170 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998111b700 1 -- 172.21.15.154:0/4087185863 >> v1:172.21.15.154:6789/0 conn(0x7f997c09e170 legacy=0x7f997c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998111b700 1 -- 172.21.15.154:0/4087185863 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c09b620 con 0x7f997c09d860 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998191c700 1 --2- 172.21.15.154:0/4087185863 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c130eb0 0x7f997c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.258+0000 7f998111b700 1 --2- 172.21.15.154:0/4087185863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c09d860 0x7f997c09dc30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9978009920 tx=0x7f9978009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1e68d2de6e72390 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f9973fff700 1 -- 172.21.15.154:0/4087185863 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800f8a0 con 0x7f997c09d860 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f9973fff700 1 -- 172.21.15.154:0/4087185863 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997800fa00 con 0x7f997c09d860 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f9973fff700 1 -- 172.21.15.154:0/4087185863 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800fd90 con 0x7f997c09d860 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f998337f700 1 -- 172.21.15.154:0/4087185863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c09d860 msgr2=0x7f997c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f998337f700 1 --2- 172.21.15.154:0/4087185863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c09d860 0x7f997c09dc30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9978009920 tx=0x7f9978009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f998337f700 1 -- 172.21.15.154:0/4087185863 shutdown_connections 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f998337f700 1 --2- 172.21.15.154:0/4087185863 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c130eb0 0x7f997c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f998337f700 1 --2- 172.21.15.154:0/4087185863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c09d860 0x7f997c09dc30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f998337f700 1 -- 172.21.15.154:0/4087185863 >> 172.21.15.154:0/4087185863 conn(0x7f997c099c40 msgr2=0x7f997c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f998337f700 1 -- 172.21.15.154:0/4087185863 shutdown_connections 2023-09-30T22:24:58.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.259+0000 7f998337f700 1 -- 172.21.15.154:0/4087185863 wait complete. 2023-09-30T22:24:58.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.260+0000 7f998337f700 1 Processor -- start 2023-09-30T22:24:58.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.260+0000 7f998337f700 1 -- start start 2023-09-30T22:24:58.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998337f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c09d860 0x7f997c11e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998337f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997c09e170 0x7f997c11e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998337f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c130eb0 0x7f997c11ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998337f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c121e30 con 0x7f997c09e170 2023-09-30T22:24:58.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998337f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997c121660 con 0x7f997c130eb0 2023-09-30T22:24:58.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998337f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f997c09c8b0 con 0x7f997c09d860 2023-09-30T22:24:58.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998111b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c09d860 0x7f997c11e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998191c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c130eb0 0x7f997c11ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998191c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c130eb0 0x7f997c11ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57528/0 (socket says 172.21.15.154:57528) 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998191c700 1 -- 172.21.15.154:0/3851328915 learned_addr learned my addr 172.21.15.154:0/3851328915 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998111b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c09d860 0x7f997c11e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34328/0 (socket says 172.21.15.154:34328) 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998091a700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997c09e170 0x7f997c11e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998191c700 1 -- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c09d860 msgr2=0x7f997c11e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998191c700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c09d860 0x7f997c11e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998191c700 1 -- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997c09e170 msgr2=0x7f997c11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998191c700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997c09e170 0x7f997c11e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998191c700 1 -- 172.21.15.154:0/3851328915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974009a70 con 0x7f997c130eb0 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998111b700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c09d860 0x7f997c11e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998091a700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997c09e170 0x7f997c11e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:24:58.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.261+0000 7f998191c700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c130eb0 0x7f997c11ede0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f997400efc0 tx=0x7f997400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.262+0000 7f9971ffb700 1 -- 172.21.15.154:0/3851328915 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997400cb40 con 0x7f997c130eb0 2023-09-30T22:24:58.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.262+0000 7f9971ffb700 1 -- 172.21.15.154:0/3851328915 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997400f040 con 0x7f997c130eb0 2023-09-30T22:24:58.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.262+0000 7f998337f700 1 -- 172.21.15.154:0/3851328915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9978009550 con 0x7f997c130eb0 2023-09-30T22:24:58.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.262+0000 7f9971ffb700 1 -- 172.21.15.154:0/3851328915 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974003a20 con 0x7f997c130eb0 2023-09-30T22:24:58.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.262+0000 7f998337f700 1 -- 172.21.15.154:0/3851328915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997c0a0760 con 0x7f997c130eb0 2023-09-30T22:24:58.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.263+0000 7f998337f700 1 -- 172.21.15.154:0/3851328915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997c04f2a0 con 0x7f997c130eb0 2023-09-30T22:24:58.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.263+0000 7f9971ffb700 1 -- 172.21.15.154:0/3851328915 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9974014480 con 0x7f997c130eb0 2023-09-30T22:24:58.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.263+0000 7f9971ffb700 1 -- 172.21.15.154:0/3851328915 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f99740400f0 con 0x7f997c130eb0 2023-09-30T22:24:58.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.268+0000 7f9971ffb700 1 -- 172.21.15.154:0/3851328915 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9974012930 con 0x7f997c130eb0 2023-09-30T22:24:58.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:58.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.427+0000 7fa7a4b13700 1 -- 172.21.15.154:0/1242757384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7a01361e0 con 0x7fa7a009ad40 2023-09-30T22:24:58.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.428+0000 7fa78effd700 1 -- 172.21.15.154:0/1242757384 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7900010f0 con 0x7fa7a009ad40 2023-09-30T22:24:58.428 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.431+0000 7fa7a4b13700 1 -- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a009ad40 msgr2=0x7fa7a01393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.431+0000 7fa7a4b13700 1 --2- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a009ad40 0x7fa7a01393e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa79000c440 tx=0x7fa79000c750 comp rx=0 tx=0).stop 2023-09-30T22:24:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.431+0000 7fa7a4b13700 1 -- 172.21.15.154:0/1242757384 shutdown_connections 2023-09-30T22:24:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.431+0000 7fa7a4b13700 1 --2- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7a0134570 0x7fa7a0139e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.431+0000 7fa7a4b13700 1 --2- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7a009ad40 0x7fa7a01393e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.431+0000 7fa7a4b13700 1 --2- 172.21.15.154:0/1242757384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7a0134140 0x7fa7a0139920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.431+0000 7fa7a4b13700 1 -- 172.21.15.154:0/1242757384 >> 172.21.15.154:0/1242757384 conn(0x7fa7a0099c40 msgr2=0x7fa7a013b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.431+0000 7fa7a4b13700 1 -- 172.21.15.154:0/1242757384 shutdown_connections 2023-09-30T22:24:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.431+0000 7fa7a4b13700 1 -- 172.21.15.154:0/1242757384 wait complete. 2023-09-30T22:24:58.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:58.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.451+0000 7f0d39a42700 1 -- 172.21.15.154:0/463267691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d3404f2a0 con 0x7f0d3409a150 2023-09-30T22:24:58.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.452+0000 7f0d1bfff700 1 -- 172.21.15.154:0/463267691 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d24021070 con 0x7f0d3409a150 2023-09-30T22:24:58.452 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:58.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.454+0000 7f0d39a42700 1 -- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 msgr2=0x7f0d3411f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.454+0000 7f0d39a42700 1 --2- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3411f8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400ebe0 tx=0x7f0d2400eef0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.454+0000 7f0d39a42700 1 -- 172.21.15.154:0/463267691 shutdown_connections 2023-09-30T22:24:58.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.454+0000 7f0d39a42700 1 --2- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d34133c20 0x7f0d341c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.454+0000 7f0d39a42700 1 --2- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d3409a150 0x7f0d3411f8b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.454+0000 7f0d39a42700 1 --2- 172.21.15.154:0/463267691 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d3409edb0 0x7f0d3411fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.454+0000 7f0d39a42700 1 -- 172.21.15.154:0/463267691 >> 172.21.15.154:0/463267691 conn(0x7f0d340a4430 msgr2=0x7f0d341b8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.454+0000 7f0d39a42700 1 -- 172.21.15.154:0/463267691 shutdown_connections 2023-09-30T22:24:58.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.454+0000 7f0d39a42700 1 -- 172.21.15.154:0/463267691 wait complete. 2023-09-30T22:24:58.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.464+0000 7f998337f700 1 -- 172.21.15.154:0/3851328915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f997c06c3b0 con 0x7f997c130eb0 2023-09-30T22:24:58.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.465+0000 7f9971ffb700 1 -- 172.21.15.154:0/3851328915 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f997401c3b0 con 0x7f997c130eb0 2023-09-30T22:24:58.465 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:58.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.467+0000 7f998337f700 1 -- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c130eb0 msgr2=0x7f997c11ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.467+0000 7f998337f700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c130eb0 0x7f997c11ede0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f997400efc0 tx=0x7f997400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.467+0000 7f998337f700 1 -- 172.21.15.154:0/3851328915 shutdown_connections 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.467+0000 7f998337f700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f997c130eb0 0x7f997c11ede0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.467+0000 7f998337f700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f997c09d860 0x7f997c11e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.467+0000 7f998337f700 1 --2- 172.21.15.154:0/3851328915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997c09e170 0x7f997c11e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.467+0000 7f998337f700 1 -- 172.21.15.154:0/3851328915 >> 172.21.15.154:0/3851328915 conn(0x7f997c099c40 msgr2=0x7f997c070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.467+0000 7f998337f700 1 -- 172.21.15.154:0/3851328915 shutdown_connections 2023-09-30T22:24:58.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.467+0000 7f998337f700 1 -- 172.21.15.154:0/3851328915 wait complete. 2023-09-30T22:24:58.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:24:58.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.485+0000 7f409dac9700 1 Processor -- start 2023-09-30T22:24:58.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.485+0000 7f409dac9700 1 -- start start 2023-09-30T22:24:58.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f409dac9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40980a0b50 0x7f40980a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f409dac9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a1460 0x7f40981341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f409dac9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40980a1e60 con 0x7f40980a2e10 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f409dac9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409809aa00 con 0x7f40980a0b50 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f409dac9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40980a2340 con 0x7f40980a1460 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f40977fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40980a0b50 0x7f40980a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4097fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a1460 0x7f40981341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f40977fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40980a0b50 0x7f40980a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41116/0 (socket says 172.21.15.154:41116) 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4097fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a1460 0x7f40981341e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34344/0 (socket says 172.21.15.154:34344) 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f40977fe700 1 -- 172.21.15.154:0/576162721 learned_addr learned my addr 172.21.15.154:0/576162721 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4097fff700 1 -- 172.21.15.154:0/576162721 >> v2:172.21.15.154:3300/0 conn(0x7f40980a0b50 msgr2=0x7f40980a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4097fff700 1 --2- 172.21.15.154:0/576162721 >> v2:172.21.15.154:3300/0 conn(0x7f40980a0b50 0x7f40980a0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4097fff700 1 -- 172.21.15.154:0/576162721 >> v1:172.21.15.154:6789/0 conn(0x7f40980a2e10 legacy=0x7f4098133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4097fff700 1 -- 172.21.15.154:0/576162721 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409809a5b0 con 0x7f40980a1460 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4096ffd700 1 -- 172.21.15.154:0/576162721 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755042109 0 0) 0x7f40980a1e60 con 0x7f40980a2e10 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f40977fe700 1 --2- 172.21.15.154:0/576162721 >> v2:172.21.15.154:3300/0 conn(0x7f40980a0b50 0x7f40980a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4097fff700 1 --2- 172.21.15.154:0/576162721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a1460 0x7f40981341e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4090009d90 tx=0x7f409000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=592c0c58d10e7ecb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4096ffd700 1 -- 172.21.15.154:0/576162721 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409000e070 con 0x7f40980a1460 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4096ffd700 1 -- 172.21.15.154:0/576162721 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409000bb20 con 0x7f40980a1460 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.486+0000 7f4096ffd700 1 -- 172.21.15.154:0/576162721 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090012430 con 0x7f40980a1460 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.487+0000 7f409dac9700 1 -- 172.21.15.154:0/576162721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a1460 msgr2=0x7f40981341e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.487+0000 7f409dac9700 1 --2- 172.21.15.154:0/576162721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a1460 0x7f40981341e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4090009d90 tx=0x7f409000b330 comp rx=0 tx=0).stop 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.487+0000 7f409dac9700 1 -- 172.21.15.154:0/576162721 shutdown_connections 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.487+0000 7f409dac9700 1 --2- 172.21.15.154:0/576162721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a1460 0x7f40981341e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.487+0000 7f409dac9700 1 --2- 172.21.15.154:0/576162721 >> v2:172.21.15.154:3300/0 conn(0x7f40980a0b50 0x7f40980a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.487+0000 7f409dac9700 1 -- 172.21.15.154:0/576162721 >> 172.21.15.154:0/576162721 conn(0x7f409806c780 msgr2=0x7f409806cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.487+0000 7f409dac9700 1 -- 172.21.15.154:0/576162721 shutdown_connections 2023-09-30T22:24:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.487+0000 7f409dac9700 1 -- 172.21.15.154:0/576162721 wait complete. 2023-09-30T22:24:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.488+0000 7f409dac9700 1 Processor -- start 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.488+0000 7f409dac9700 1 -- start start 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f409dac9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40980a0b50 0x7f40981c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f409dac9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40980a1460 0x7f40981c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f409dac9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a2e10 0x7f409811eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f409dac9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40981bd0a0 con 0x7f40980a1460 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f409dac9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4098122770 con 0x7f40980a0b50 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f409dac9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40981333a0 con 0x7f40980a2e10 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f40977fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40980a0b50 0x7f40981c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f4097fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a2e10 0x7f409811eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f40977fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40980a0b50 0x7f40981c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57544/0 (socket says 172.21.15.154:57544) 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f40977fe700 1 -- 172.21.15.154:0/4137688586 learned_addr learned my addr 172.21.15.154:0/4137688586 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f408ffff700 1 --2- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40980a1460 0x7f40981c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f4097fff700 1 -- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40980a0b50 msgr2=0x7f40981c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f4097fff700 1 --2- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40980a0b50 0x7f40981c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f4097fff700 1 -- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40980a1460 msgr2=0x7f40981c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f4097fff700 1 --2- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40980a1460 0x7f40981c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f4097fff700 1 -- 172.21.15.154:0/4137688586 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088009550 con 0x7f40980a2e10 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.489+0000 7f4097fff700 1 --2- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a2e10 0x7f409811eaa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4090016000 tx=0x7f4090004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.490+0000 7f4094ff9700 1 -- 172.21.15.154:0/4137688586 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090012430 con 0x7f40980a2e10 2023-09-30T22:24:58.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.490+0000 7f4094ff9700 1 -- 172.21.15.154:0/4137688586 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090020070 con 0x7f40980a2e10 2023-09-30T22:24:58.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.490+0000 7f409dac9700 1 -- 172.21.15.154:0/4137688586 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4090009a70 con 0x7f40980a2e10 2023-09-30T22:24:58.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.490+0000 7f4094ff9700 1 -- 172.21.15.154:0/4137688586 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090004280 con 0x7f40980a2e10 2023-09-30T22:24:58.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.490+0000 7f409dac9700 1 -- 172.21.15.154:0/4137688586 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40980a51c0 con 0x7f40980a2e10 2023-09-30T22:24:58.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.490+0000 7f4094ff9700 1 -- 172.21.15.154:0/4137688586 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40900043e0 con 0x7f40980a2e10 2023-09-30T22:24:58.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.490+0000 7f4094ff9700 1 -- 172.21.15.154:0/4137688586 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4090022070 con 0x7f40980a2e10 2023-09-30T22:24:58.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.491+0000 7f409dac9700 1 -- 172.21.15.154:0/4137688586 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409804f2a0 con 0x7f40980a2e10 2023-09-30T22:24:58.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.495+0000 7f4094ff9700 1 -- 172.21.15.154:0/4137688586 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f409001b400 con 0x7f40980a2e10 2023-09-30T22:24:58.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.680+0000 7f409dac9700 1 -- 172.21.15.154:0/4137688586 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f40981c9020 con 0x7f40980a2e10 2023-09-30T22:24:58.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.680+0000 7f4094ff9700 1 -- 172.21.15.154:0/4137688586 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40900263e0 con 0x7f40980a2e10 2023-09-30T22:24:58.681 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.683+0000 7f409dac9700 1 -- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a2e10 msgr2=0x7f409811eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.683+0000 7f409dac9700 1 --2- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a2e10 0x7f409811eaa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4090016000 tx=0x7f4090004ad0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.683+0000 7f409dac9700 1 -- 172.21.15.154:0/4137688586 shutdown_connections 2023-09-30T22:24:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.683+0000 7f409dac9700 1 --2- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40980a2e10 0x7f409811eaa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.683+0000 7f409dac9700 1 --2- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40980a0b50 0x7f40981c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.683+0000 7f409dac9700 1 --2- 172.21.15.154:0/4137688586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40980a1460 0x7f40981c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.683+0000 7f409dac9700 1 -- 172.21.15.154:0/4137688586 >> 172.21.15.154:0/4137688586 conn(0x7f409806c780 msgr2=0x7f409809dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.683+0000 7f409dac9700 1 -- 172.21.15.154:0/4137688586 shutdown_connections 2023-09-30T22:24:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:58.683+0000 7f409dac9700 1 -- 172.21.15.154:0/4137688586 wait complete. 2023-09-30T22:24:58.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:24:59.449 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:24:59.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:24:59.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:24:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.584+0000 7efd1f152700 1 Processor -- start 2023-09-30T22:24:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.584+0000 7efd1f152700 1 -- start start 2023-09-30T22:24:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd1f152700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd1f152700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1809e170 0x7efd181307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd1f152700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1809aaa0 con 0x7efd18130ce0 2023-09-30T22:24:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd1f152700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1809f870 con 0x7efd1809e170 2023-09-30T22:24:59.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd1f152700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd1809b360 con 0x7efd1809d860 2023-09-30T22:24:59.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd17fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1809e170 0x7efd181307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd17fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1809e170 0x7efd181307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57552/0 (socket says 172.21.15.154:57552) 2023-09-30T22:24:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd17fff700 1 -- 172.21.15.154:0/408627571 learned_addr learned my addr 172.21.15.154:0/408627571 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd1d6ef700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efd18130ce0 0x7efd181379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38160/0 (socket says 172.21.15.154:38160) 2023-09-30T22:24:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd1ceee700 1 --2- 172.21.15.154:0/408627571 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd17fff700 1 -- 172.21.15.154:0/408627571 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 msgr2=0x7efd1809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd17fff700 1 --2- 172.21.15.154:0/408627571 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd177fe700 1 -- 172.21.15.154:0/408627571 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010847069 0 0) 0x7efd1809aaa0 con 0x7efd18130ce0 2023-09-30T22:24:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd17fff700 1 -- 172.21.15.154:0/408627571 >> v1:172.21.15.154:6789/0 conn(0x7efd18130ce0 legacy=0x7efd181379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd17fff700 1 -- 172.21.15.154:0/408627571 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1809b620 con 0x7efd1809e170 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.585+0000 7efd1ceee700 1 --2- 172.21.15.154:0/408627571 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.586+0000 7efd17fff700 1 --2- 172.21.15.154:0/408627571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1809e170 0x7efd181307a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efd04009920 tx=0x7efd04009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa6229fd1be0aebf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.586+0000 7efd177fe700 1 -- 172.21.15.154:0/408627571 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400f8a0 con 0x7efd1809e170 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.586+0000 7efd177fe700 1 -- 172.21.15.154:0/408627571 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0400fa00 con 0x7efd1809e170 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.586+0000 7efd177fe700 1 -- 172.21.15.154:0/408627571 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400fd90 con 0x7efd1809e170 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.587+0000 7efd1f152700 1 -- 172.21.15.154:0/408627571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1809e170 msgr2=0x7efd181307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.587+0000 7efd1f152700 1 --2- 172.21.15.154:0/408627571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1809e170 0x7efd181307a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efd04009920 tx=0x7efd04009c30 comp rx=0 tx=0).stop 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.587+0000 7efd1f152700 1 -- 172.21.15.154:0/408627571 shutdown_connections 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.587+0000 7efd1f152700 1 --2- 172.21.15.154:0/408627571 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.587+0000 7efd1f152700 1 --2- 172.21.15.154:0/408627571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1809e170 0x7efd181307a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.587+0000 7efd1f152700 1 -- 172.21.15.154:0/408627571 >> 172.21.15.154:0/408627571 conn(0x7efd18099c40 msgr2=0x7efd180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.587+0000 7efd1f152700 1 -- 172.21.15.154:0/408627571 shutdown_connections 2023-09-30T22:24:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.587+0000 7efd1f152700 1 -- 172.21.15.154:0/408627571 wait complete. 2023-09-30T22:24:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.588+0000 7efd1f152700 1 Processor -- start 2023-09-30T22:24:59.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.588+0000 7efd1f152700 1 -- start start 2023-09-30T22:24:59.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.588+0000 7efd1f152700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.588+0000 7efd1f152700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd1809e170 0x7efd1811ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.588+0000 7efd1f152700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd18130ce0 0x7efd1811ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.588+0000 7efd1f152700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd181200d0 con 0x7efd1809e170 2023-09-30T22:24:59.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.588+0000 7efd1f152700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd181206f0 con 0x7efd18130ce0 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1f152700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd18130420 con 0x7efd1809d860 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1ceee700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1d6ef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd18130ce0 0x7efd1811ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1ceee700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34368/0 (socket says 172.21.15.154:34368) 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1ceee700 1 -- 172.21.15.154:0/4052678731 learned_addr learned my addr 172.21.15.154:0/4052678731 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd17fff700 1 --2- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd1809e170 0x7efd1811ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1ceee700 1 -- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd18130ce0 msgr2=0x7efd1811ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1ceee700 1 --2- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd18130ce0 0x7efd1811ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1ceee700 1 -- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd1809e170 msgr2=0x7efd1811ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1ceee700 1 --2- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd1809e170 0x7efd1811ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1ceee700 1 -- 172.21.15.154:0/4052678731 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0094a0 con 0x7efd1809d860 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1d6ef700 1 --2- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd18130ce0 0x7efd1811ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1ceee700 1 --2- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1811e4c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00ec10 tx=0x7efd0c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd157fa700 1 -- 172.21.15.154:0/4052678731 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00c850 con 0x7efd1809d860 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd157fa700 1 -- 172.21.15.154:0/4052678731 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c00c9b0 con 0x7efd1809d860 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1f152700 1 -- 172.21.15.154:0/4052678731 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd04009550 con 0x7efd1809d860 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd157fa700 1 -- 172.21.15.154:0/4052678731 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00cd20 con 0x7efd1809d860 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.589+0000 7efd1f152700 1 -- 172.21.15.154:0/4052678731 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1809c8b0 con 0x7efd1809d860 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.590+0000 7efd157fa700 1 -- 172.21.15.154:0/4052678731 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd0c013470 con 0x7efd1809d860 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.590+0000 7efd1f152700 1 -- 172.21.15.154:0/4052678731 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1804f2a0 con 0x7efd1809d860 2023-09-30T22:24:59.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.591+0000 7efd157fa700 1 -- 172.21.15.154:0/4052678731 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd0c03f740 con 0x7efd1809d860 2023-09-30T22:24:59.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.599+0000 7efd157fa700 1 -- 172.21.15.154:0/4052678731 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd0c013720 con 0x7efd1809d860 2023-09-30T22:24:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.624+0000 7f3969e77700 1 Processor -- start 2023-09-30T22:24:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.624+0000 7f3969e77700 1 -- start start 2023-09-30T22:24:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.624+0000 7f3969e77700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.624+0000 7f3969e77700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f396409f260 0x7f3964131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.624+0000 7f3969e77700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396409afb0 con 0x7f3964131dd0 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.624+0000 7f3969e77700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39640a0970 con 0x7f396409f260 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.624+0000 7f3969e77700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39640a0320 con 0x7f396409e950 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f39637fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f3962ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f396409f260 0x7f3964131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f39637fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396409ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34384/0 (socket says 172.21.15.154:34384) 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f3962ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f396409f260 0x7f3964131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41148/0 (socket says 172.21.15.154:41148) 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f39637fe700 1 -- 172.21.15.154:0/2580206225 learned_addr learned my addr 172.21.15.154:0/2580206225 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f3962ffd700 1 -- 172.21.15.154:0/2580206225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 msgr2=0x7f396409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f3962ffd700 1 --2- 172.21.15.154:0/2580206225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f3962ffd700 1 -- 172.21.15.154:0/2580206225 >> v1:172.21.15.154:6789/0 conn(0x7f3964131dd0 legacy=0x7f3964138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f3962ffd700 1 -- 172.21.15.154:0/2580206225 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640a0750 con 0x7f396409f260 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f39637fe700 1 --2- 172.21.15.154:0/2580206225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f3962ffd700 1 --2- 172.21.15.154:0/2580206225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f396409f260 0x7f3964131890 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f395800dc60 tx=0x7f395800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fd54107b427f65 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f39627fc700 1 -- 172.21.15.154:0/2580206225 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958012070 con 0x7f396409f260 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f39627fc700 1 -- 172.21.15.154:0/2580206225 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800d2e0 con 0x7f396409f260 2023-09-30T22:24:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.625+0000 7f39627fc700 1 -- 172.21.15.154:0/2580206225 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395800f900 con 0x7f396409f260 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f3969e77700 1 -- 172.21.15.154:0/2580206225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f396409f260 msgr2=0x7f3964131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f3969e77700 1 --2- 172.21.15.154:0/2580206225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f396409f260 0x7f3964131890 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f395800dc60 tx=0x7f395800df70 comp rx=0 tx=0).stop 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f3969e77700 1 -- 172.21.15.154:0/2580206225 shutdown_connections 2023-09-30T22:24:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f3969e77700 1 --2- 172.21.15.154:0/2580206225 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f3969e77700 1 --2- 172.21.15.154:0/2580206225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f396409f260 0x7f3964131890 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f3969e77700 1 -- 172.21.15.154:0/2580206225 >> 172.21.15.154:0/2580206225 conn(0x7f39640a0f70 msgr2=0x7f39640a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f3969e77700 1 -- 172.21.15.154:0/2580206225 shutdown_connections 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f3969e77700 1 -- 172.21.15.154:0/2580206225 wait complete. 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f51a8a64700 1 Processor -- start 2023-09-30T22:24:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.626+0000 7f51a8a64700 1 -- start start 2023-09-30T22:24:59.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f3969e77700 1 Processor -- start 2023-09-30T22:24:59.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f51a8a64700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4136960 0x7f51a4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f51a8a64700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51a4139280 0x7f51a413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f51a8a64700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a406b2d0 con 0x7f51a4133ad0 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f51a8a64700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a41345b0 con 0x7f51a4139280 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f51a8a64700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4133610 con 0x7f51a4136960 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f51a1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4136960 0x7f51a4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f51a259c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f51a4133ad0 0x7f51a4133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38174/0 (socket says 172.21.15.154:38174) 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f51a259c700 1 -- 172.21.15.154:0/700591983 learned_addr learned my addr 172.21.15.154:0/700591983 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:24:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f51a2d9d700 1 --2- 172.21.15.154:0/700591983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51a4139280 0x7f51a413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.627+0000 7f3969e77700 1 -- start start 2023-09-30T22:24:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f3969e77700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396411c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f3969e77700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f396409f260 0x7f396411caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f3969e77700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3964131dd0 0x7f396411d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f3969e77700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396411fed0 con 0x7f3964131dd0 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f3969e77700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39641200d0 con 0x7f396409f260 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f3969e77700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f396411f840 con 0x7f396409e950 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f39637fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396411c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f39637fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396411c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34410/0 (socket says 172.21.15.154:34410) 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f39637fe700 1 -- 172.21.15.154:0/3562883368 learned_addr learned my addr 172.21.15.154:0/3562883368 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f3962ffd700 1 --2- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f396409f260 0x7f396411caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f3963fff700 1 --2- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3964131dd0 0x7f396411d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f39637fe700 1 -- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f396409f260 msgr2=0x7f396411caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f39637fe700 1 --2- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f396409f260 0x7f396411caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f39637fe700 1 -- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3964131dd0 msgr2=0x7f396411d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f39637fe700 1 --2- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3964131dd0 0x7f396411d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f39637fe700 1 -- 172.21.15.154:0/3562883368 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3954009500 con 0x7f396409e950 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f39637fe700 1 --2- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396411c5b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f395400ebb0 tx=0x7f395400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f394bfff700 1 -- 172.21.15.154:0/3562883368 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954005a20 con 0x7f396409e950 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f51a1d9b700 1 -- 172.21.15.154:0/700591983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51a4139280 msgr2=0x7f51a413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f51a1d9b700 1 --2- 172.21.15.154:0/700591983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51a4139280 0x7f51a413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f394bfff700 1 -- 172.21.15.154:0/3562883368 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3954005b80 con 0x7f396409e950 2023-09-30T22:24:59.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f51a1d9b700 1 -- 172.21.15.154:0/700591983 >> v1:172.21.15.154:6789/0 conn(0x7f51a4133ad0 legacy=0x7f51a4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f51a1d9b700 1 -- 172.21.15.154:0/700591983 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a409a500 con 0x7f51a4136960 2023-09-30T22:24:59.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.628+0000 7f51a1d9b700 1 --2- 172.21.15.154:0/700591983 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4136960 0x7f51a4138d40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5198009870 tx=0x7f5198009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86cfa56539aad405 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f51a159a700 1 -- 172.21.15.154:0/700591983 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198011830 con 0x7f51a4136960 2023-09-30T22:24:59.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f51a159a700 1 -- 172.21.15.154:0/700591983 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5198011990 con 0x7f51a4136960 2023-09-30T22:24:59.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f394bfff700 1 -- 172.21.15.154:0/3562883368 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395400c850 con 0x7f396409e950 2023-09-30T22:24:59.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f3969e77700 1 -- 172.21.15.154:0/3562883368 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395800d940 con 0x7f396409e950 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f51a159a700 1 -- 172.21.15.154:0/700591983 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198011d20 con 0x7f51a4136960 2023-09-30T22:24:59.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f3969e77700 1 -- 172.21.15.154:0/3562883368 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396409ba00 con 0x7f396409e950 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f51a8a64700 1 -- 172.21.15.154:0/700591983 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4136960 msgr2=0x7f51a4138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f51a8a64700 1 --2- 172.21.15.154:0/700591983 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4136960 0x7f51a4138d40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5198009870 tx=0x7f5198009b80 comp rx=0 tx=0).stop 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f51a8a64700 1 -- 172.21.15.154:0/700591983 shutdown_connections 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f51a8a64700 1 --2- 172.21.15.154:0/700591983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51a4139280 0x7f51a413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f51a8a64700 1 --2- 172.21.15.154:0/700591983 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4136960 0x7f51a4138d40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.629+0000 7f51a8a64700 1 -- 172.21.15.154:0/700591983 >> 172.21.15.154:0/700591983 conn(0x7f51a4099c40 msgr2=0x7f51a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.630+0000 7f51a8a64700 1 -- 172.21.15.154:0/700591983 shutdown_connections 2023-09-30T22:24:59.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.630+0000 7f51a8a64700 1 -- 172.21.15.154:0/700591983 wait complete. 2023-09-30T22:24:59.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.630+0000 7f3969e77700 1 -- 172.21.15.154:0/3562883368 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396409da40 con 0x7f396409e950 2023-09-30T22:24:59.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.630+0000 7f394bfff700 1 -- 172.21.15.154:0/3562883368 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f395400c9b0 con 0x7f396409e950 2023-09-30T22:24:59.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.630+0000 7f394bfff700 1 -- 172.21.15.154:0/3562883368 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f395403fe80 con 0x7f396409e950 2023-09-30T22:24:59.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a8a64700 1 Processor -- start 2023-09-30T22:24:59.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a8a64700 1 -- start start 2023-09-30T22:24:59.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a8a64700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4133ad0 0x7f51a40713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a8a64700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51a4136960 0x7f51a4071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a8a64700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51a4139280 0x7f51a4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a8a64700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a41317a0 con 0x7f51a4136960 2023-09-30T22:24:59.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a8a64700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a409f390 con 0x7f51a4139280 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a8a64700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51a40724d0 con 0x7f51a4133ad0 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4133ad0 0x7f51a40713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4133ad0 0x7f51a40713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34416/0 (socket says 172.21.15.154:34416) 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a259c700 1 -- 172.21.15.154:0/3306650754 learned_addr learned my addr 172.21.15.154:0/3306650754 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.631+0000 7f51a1d9b700 1 --2- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51a4136960 0x7f51a4071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.632+0000 7f51a259c700 1 -- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51a4139280 msgr2=0x7f51a4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.632+0000 7f51a259c700 1 --2- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51a4139280 0x7f51a4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.632+0000 7f51a259c700 1 -- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51a4136960 msgr2=0x7f51a4071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.632+0000 7f51a259c700 1 --2- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51a4136960 0x7f51a4071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.632+0000 7f51a259c700 1 -- 172.21.15.154:0/3306650754 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51980094a0 con 0x7f51a4133ad0 2023-09-30T22:24:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.632+0000 7f51a1d9b700 1 --2- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51a4136960 0x7f51a4071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:59.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.632+0000 7f51a259c700 1 --2- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4133ad0 0x7f51a40713e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f519400c480 tx=0x7f519400c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.639+0000 7f5192ffd700 1 -- 172.21.15.154:0/3306650754 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194005d70 con 0x7f51a4133ad0 2023-09-30T22:24:59.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.639+0000 7f5192ffd700 1 -- 172.21.15.154:0/3306650754 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51940070d0 con 0x7f51a4133ad0 2023-09-30T22:24:59.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.639+0000 7f51a8a64700 1 -- 172.21.15.154:0/3306650754 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a40700b0 con 0x7f51a4133ad0 2023-09-30T22:24:59.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.639+0000 7f5192ffd700 1 -- 172.21.15.154:0/3306650754 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194007440 con 0x7f51a4133ad0 2023-09-30T22:24:59.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.639+0000 7f394bfff700 1 -- 172.21.15.154:0/3562883368 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3954011350 con 0x7f396409e950 2023-09-30T22:24:59.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.639+0000 7f51a8a64700 1 -- 172.21.15.154:0/3306650754 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a4070f90 con 0x7f51a4133ad0 2023-09-30T22:24:59.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.640+0000 7f51a8a64700 1 -- 172.21.15.154:0/3306650754 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a404f2a0 con 0x7f51a4133ad0 2023-09-30T22:24:59.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.640+0000 7f5192ffd700 1 -- 172.21.15.154:0/3306650754 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51940075a0 con 0x7f51a4133ad0 2023-09-30T22:24:59.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.640+0000 7f5192ffd700 1 -- 172.21.15.154:0/3306650754 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f519403eb70 con 0x7f51a4133ad0 2023-09-30T22:24:59.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.644+0000 7f5192ffd700 1 -- 172.21.15.154:0/3306650754 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5194019b40 con 0x7f51a4133ad0 2023-09-30T22:24:59.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:24:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.806+0000 7efd1f152700 1 -- 172.21.15.154:0/4052678731 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efd1806c3b0 con 0x7efd1809d860 2023-09-30T22:24:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.806+0000 7efd157fa700 1 -- 172.21.15.154:0/4052678731 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd0c021070 con 0x7efd1809d860 2023-09-30T22:24:59.807 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:24:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.809+0000 7efd1f152700 1 -- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 msgr2=0x7efd1811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.809+0000 7efd1f152700 1 --2- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1811e4c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00ec10 tx=0x7efd0c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:24:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.809+0000 7efd1f152700 1 -- 172.21.15.154:0/4052678731 shutdown_connections 2023-09-30T22:24:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.809+0000 7efd1f152700 1 --2- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd18130ce0 0x7efd1811ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.809+0000 7efd1f152700 1 --2- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd1809d860 0x7efd1811e4c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.809+0000 7efd1f152700 1 --2- 172.21.15.154:0/4052678731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd1809e170 0x7efd1811ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.809+0000 7efd1f152700 1 -- 172.21.15.154:0/4052678731 >> 172.21.15.154:0/4052678731 conn(0x7efd18099c40 msgr2=0x7efd180a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.809+0000 7efd1f152700 1 -- 172.21.15.154:0/4052678731 shutdown_connections 2023-09-30T22:24:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.809+0000 7efd1f152700 1 -- 172.21.15.154:0/4052678731 wait complete. 2023-09-30T22:24:59.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:24:59.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.825+0000 7f2e634a2700 1 Processor -- start 2023-09-30T22:24:59.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.825+0000 7f2e634a2700 1 -- start start 2023-09-30T22:24:59.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e634a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c099e20 0x7f2e5c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e634a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c09a730 0x7f2e5c130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e634a2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c099a60 con 0x7f2e5c130890 2023-09-30T22:24:59.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e634a2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c09bf50 con 0x7f2e5c099e20 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e634a2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c09b230 con 0x7f2e5c09a730 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e60a3d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c09a730 0x7f2e5c130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e60a3d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c09a730 0x7f2e5c130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34424/0 (socket says 172.21.15.154:34424) 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e60a3d700 1 -- 172.21.15.154:0/3147378743 learned_addr learned my addr 172.21.15.154:0/3147378743 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e61a3f700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2e5c130890 0x7f2e5c137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38184/0 (socket says 172.21.15.154:38184) 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e6123e700 1 --2- 172.21.15.154:0/3147378743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c099e20 0x7f2e5c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e60a3d700 1 -- 172.21.15.154:0/3147378743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c099e20 msgr2=0x7f2e5c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e60a3d700 1 --2- 172.21.15.154:0/3147378743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c099e20 0x7f2e5c09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e60a3d700 1 -- 172.21.15.154:0/3147378743 >> v1:172.21.15.154:6789/0 conn(0x7f2e5c130890 legacy=0x7f2e5c137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e60a3d700 1 -- 172.21.15.154:0/3147378743 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c09bb90 con 0x7f2e5c09a730 2023-09-30T22:24:59.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e60a3d700 1 --2- 172.21.15.154:0/3147378743 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c09a730 0x7f2e5c130350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00dd80 tx=0x7f2e4c00f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f1c284186bddb0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e53fff700 1 -- 172.21.15.154:0/3147378743 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c012070 con 0x7f2e5c09a730 2023-09-30T22:24:59.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e53fff700 1 -- 172.21.15.154:0/3147378743 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00fae0 con 0x7f2e5c09a730 2023-09-30T22:24:59.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.826+0000 7f2e53fff700 1 -- 172.21.15.154:0/3147378743 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00fe70 con 0x7f2e5c09a730 2023-09-30T22:24:59.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.827+0000 7f2e634a2700 1 -- 172.21.15.154:0/3147378743 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c09a730 msgr2=0x7f2e5c130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.827+0000 7f2e634a2700 1 --2- 172.21.15.154:0/3147378743 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c09a730 0x7f2e5c130350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00dd80 tx=0x7f2e4c00f330 comp rx=0 tx=0).stop 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.827+0000 7f2e634a2700 1 -- 172.21.15.154:0/3147378743 shutdown_connections 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.827+0000 7f2e634a2700 1 --2- 172.21.15.154:0/3147378743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c099e20 0x7f2e5c09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.827+0000 7f2e634a2700 1 --2- 172.21.15.154:0/3147378743 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c09a730 0x7f2e5c130350 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.827+0000 7f2e634a2700 1 -- 172.21.15.154:0/3147378743 >> 172.21.15.154:0/3147378743 conn(0x7f2e5c0a2980 msgr2=0x7f2e5c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.827+0000 7f2e634a2700 1 -- 172.21.15.154:0/3147378743 shutdown_connections 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.827+0000 7f2e634a2700 1 -- 172.21.15.154:0/3147378743 wait complete. 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.828+0000 7f2e634a2700 1 Processor -- start 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.828+0000 7f2e634a2700 1 -- start start 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.828+0000 7f2e634a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c099e20 0x7f2e5c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.828+0000 7f2e634a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c09a730 0x7f2e5c119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.828+0000 7f2e634a2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130890 0x7f2e5c119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.828+0000 7f2e634a2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c11c1b0 con 0x7f2e5c130890 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.828+0000 7f2e634a2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c11c390 con 0x7f2e5c09a730 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.828+0000 7f2e634a2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c09b470 con 0x7f2e5c099e20 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e6123e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c099e20 0x7f2e5c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e6123e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c099e20 0x7f2e5c118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34436/0 (socket says 172.21.15.154:34436) 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e6123e700 1 -- 172.21.15.154:0/278037080 learned_addr learned my addr 172.21.15.154:0/278037080 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e61a3f700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130890 0x7f2e5c119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e60a3d700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c09a730 0x7f2e5c119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:24:59.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e60a3d700 1 -- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c099e20 msgr2=0x7f2e5c118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e60a3d700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c099e20 0x7f2e5c118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e60a3d700 1 -- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130890 msgr2=0x7f2e5c119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e60a3d700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130890 0x7f2e5c119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e60a3d700 1 -- 172.21.15.154:0/278037080 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c00da00 con 0x7f2e5c09a730 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e61a3f700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130890 0x7f2e5c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e60a3d700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c09a730 0x7f2e5c119330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c01a000 tx=0x7f2e4c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e51ffb700 1 -- 172.21.15.154:0/278037080 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c003720 con 0x7f2e5c09a730 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e51ffb700 1 -- 172.21.15.154:0/278037080 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0038a0 con 0x7f2e5c09a730 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e634a2700 1 -- 172.21.15.154:0/278037080 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c12bd20 con 0x7f2e5c09a730 2023-09-30T22:24:59.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.829+0000 7f2e51ffb700 1 -- 172.21.15.154:0/278037080 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c003c50 con 0x7f2e5c09a730 2023-09-30T22:24:59.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.830+0000 7f2e634a2700 1 -- 172.21.15.154:0/278037080 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c0a1420 con 0x7f2e5c09a730 2023-09-30T22:24:59.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.831+0000 7f2e51ffb700 1 -- 172.21.15.154:0/278037080 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e4c016430 con 0x7f2e5c09a730 2023-09-30T22:24:59.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.831+0000 7f2e634a2700 1 -- 172.21.15.154:0/278037080 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c072480 con 0x7f2e5c09a730 2023-09-30T22:24:59.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.831+0000 7f2e51ffb700 1 -- 172.21.15.154:0/278037080 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e4c049360 con 0x7f2e5c09a730 2023-09-30T22:24:59.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.835+0000 7f3969e77700 1 -- 172.21.15.154:0/3562883368 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f396404f2a0 con 0x7f396409e950 2023-09-30T22:24:59.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.835+0000 7f2e51ffb700 1 -- 172.21.15.154:0/278037080 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e5c072480 con 0x7f2e5c09a730 2023-09-30T22:24:59.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.836+0000 7f394bfff700 1 -- 172.21.15.154:0/3562883368 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39540243a0 con 0x7f396409e950 2023-09-30T22:24:59.836 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:24:59.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.838+0000 7f3969e77700 1 -- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 msgr2=0x7f396411c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.838+0000 7f3969e77700 1 --2- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396411c5b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f395400ebb0 tx=0x7f395400eec0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.838+0000 7f3969e77700 1 -- 172.21.15.154:0/3562883368 shutdown_connections 2023-09-30T22:24:59.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.838+0000 7f3969e77700 1 --2- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3964131dd0 0x7f396411d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.838+0000 7f3969e77700 1 --2- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f396409e950 0x7f396411c5b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.838+0000 7f3969e77700 1 --2- 172.21.15.154:0/3562883368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f396409f260 0x7f396411caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.838+0000 7f3969e77700 1 -- 172.21.15.154:0/3562883368 >> 172.21.15.154:0/3562883368 conn(0x7f39640a0f70 msgr2=0x7f396406c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.838+0000 7f3969e77700 1 -- 172.21.15.154:0/3562883368 shutdown_connections 2023-09-30T22:24:59.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.838+0000 7f3969e77700 1 -- 172.21.15.154:0/3562883368 wait complete. 2023-09-30T22:24:59.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.844+0000 7f51a8a64700 1 -- 172.21.15.154:0/3306650754 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51a4134180 con 0x7f51a4133ad0 2023-09-30T22:24:59.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.845+0000 7f5192ffd700 1 -- 172.21.15.154:0/3306650754 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5194017030 con 0x7f51a4133ad0 2023-09-30T22:24:59.844 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:24:59.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.847+0000 7f51a8a64700 1 -- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4133ad0 msgr2=0x7f51a40713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:24:59.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.847+0000 7f51a8a64700 1 --2- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4133ad0 0x7f51a40713e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f519400c480 tx=0x7f519400c790 comp rx=0 tx=0).stop 2023-09-30T22:24:59.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.847+0000 7f51a8a64700 1 -- 172.21.15.154:0/3306650754 shutdown_connections 2023-09-30T22:24:59.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.847+0000 7f51a8a64700 1 --2- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51a4139280 0x7f51a4071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.847+0000 7f51a8a64700 1 --2- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f51a4133ad0 0x7f51a40713e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.847+0000 7f51a8a64700 1 --2- 172.21.15.154:0/3306650754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51a4136960 0x7f51a4071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:24:59.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.847+0000 7f51a8a64700 1 -- 172.21.15.154:0/3306650754 >> 172.21.15.154:0/3306650754 conn(0x7f51a4099c40 msgr2=0x7f51a4134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:24:59.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.847+0000 7f51a8a64700 1 -- 172.21.15.154:0/3306650754 shutdown_connections 2023-09-30T22:24:59.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:24:59.847+0000 7f51a8a64700 1 -- 172.21.15.154:0/3306650754 wait complete. 2023-09-30T22:24:59.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:24:59.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.024+0000 7f2e634a2700 1 -- 172.21.15.154:0/278037080 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e5c072480 con 0x7f2e5c09a730 2023-09-30T22:25:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.024+0000 7f2e51ffb700 1 -- 172.21.15.154:0/278037080 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e5c072480 con 0x7f2e5c09a730 2023-09-30T22:25:00.024 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:00.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.026+0000 7f2e634a2700 1 -- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c09a730 msgr2=0x7f2e5c119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.026+0000 7f2e634a2700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c09a730 0x7f2e5c119330 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c01a000 tx=0x7f2e4c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.026+0000 7f2e634a2700 1 -- 172.21.15.154:0/278037080 shutdown_connections 2023-09-30T22:25:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.026+0000 7f2e634a2700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c130890 0x7f2e5c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.026+0000 7f2e634a2700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2e5c099e20 0x7f2e5c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.026+0000 7f2e634a2700 1 --2- 172.21.15.154:0/278037080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e5c09a730 0x7f2e5c119330 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.026+0000 7f2e634a2700 1 -- 172.21.15.154:0/278037080 >> 172.21.15.154:0/278037080 conn(0x7f2e5c0a2980 msgr2=0x7f2e5c12d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.027+0000 7f2e634a2700 1 -- 172.21.15.154:0/278037080 shutdown_connections 2023-09-30T22:25:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.027+0000 7f2e634a2700 1 -- 172.21.15.154:0/278037080 wait complete. 2023-09-30T22:25:00.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:00.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:00.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:00.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:00.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.964+0000 7f0a5d7d5700 1 Processor -- start 2023-09-30T22:25:00.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.964+0000 7f0a5d7d5700 1 -- start start 2023-09-30T22:25:00.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a5d7d5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a5809d860 0x7f0a5809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:00.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a5d7d5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a5809e170 0x7f0a581307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:00.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a5d7d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a58130ce0 0x7f0a58131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:00.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a5d7d5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5809aaa0 con 0x7f0a5809e170 2023-09-30T22:25:00.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a5d7d5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5809f870 con 0x7f0a5809d860 2023-09-30T22:25:00.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a5d7d5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5809b360 con 0x7f0a58130ce0 2023-09-30T22:25:00.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a567fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a5809e170 0x7f0a581307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a577fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a58130ce0 0x7f0a58131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a567fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a5809e170 0x7f0a581307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41188/0 (socket says 172.21.15.154:41188) 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a567fc700 1 -- 172.21.15.154:0/3793437822 learned_addr learned my addr 172.21.15.154:0/3793437822 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a56ffd700 1 --2- 172.21.15.154:0/3793437822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a5809d860 0x7f0a5809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a577fe700 1 -- 172.21.15.154:0/3793437822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a5809d860 msgr2=0x7f0a5809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a577fe700 1 --2- 172.21.15.154:0/3793437822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a5809d860 0x7f0a5809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a577fe700 1 -- 172.21.15.154:0/3793437822 >> v2:172.21.15.154:3300/0 conn(0x7f0a5809e170 msgr2=0x7f0a581307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a577fe700 1 --2- 172.21.15.154:0/3793437822 >> v2:172.21.15.154:3300/0 conn(0x7f0a5809e170 0x7f0a581307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a577fe700 1 -- 172.21.15.154:0/3793437822 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5809b620 con 0x7f0a58130ce0 2023-09-30T22:25:00.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.965+0000 7f0a567fc700 1 --2- 172.21.15.154:0/3793437822 >> v2:172.21.15.154:3300/0 conn(0x7f0a5809e170 0x7f0a581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:00.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a577fe700 1 --2- 172.21.15.154:0/3793437822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a58130ce0 0x7f0a58131180 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009dc0 tx=0x7f0a5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c101506577ed3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:00.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a55ffb700 1 -- 172.21.15.154:0/3793437822 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000e070 con 0x7f0a58130ce0 2023-09-30T22:25:00.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a55ffb700 1 -- 172.21.15.154:0/3793437822 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5000bae0 con 0x7f0a58130ce0 2023-09-30T22:25:00.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a55ffb700 1 -- 172.21.15.154:0/3793437822 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5000be90 con 0x7f0a58130ce0 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/3793437822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a58130ce0 msgr2=0x7f0a58131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a5d7d5700 1 --2- 172.21.15.154:0/3793437822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a58130ce0 0x7f0a58131180 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009dc0 tx=0x7f0a5000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/3793437822 shutdown_connections 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a5d7d5700 1 --2- 172.21.15.154:0/3793437822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a5809d860 0x7f0a5809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a5d7d5700 1 --2- 172.21.15.154:0/3793437822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a58130ce0 0x7f0a58131180 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a5d7d5700 1 --2- 172.21.15.154:0/3793437822 >> v2:172.21.15.154:3300/0 conn(0x7f0a5809e170 0x7f0a581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.966+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/3793437822 >> 172.21.15.154:0/3793437822 conn(0x7f0a58099c40 msgr2=0x7f0a580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.967+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/3793437822 shutdown_connections 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.967+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/3793437822 wait complete. 2023-09-30T22:25:00.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a5d7d5700 1 Processor -- start 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a5d7d5700 1 -- start start 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a5d7d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a5809d860 0x7f0a5811ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a5d7d5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5809e170 0x7f0a5811b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a5d7d5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a58130ce0 0x7f0a5811b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a5d7d5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5811f2e0 con 0x7f0a5809e170 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a5d7d5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5811ca10 con 0x7f0a58130ce0 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a5d7d5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5811d030 con 0x7f0a5809d860 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a56ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a5809d860 0x7f0a5811ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a567fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5809e170 0x7f0a5811b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a56ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a5809d860 0x7f0a5811ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34456/0 (socket says 172.21.15.154:34456) 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a56ffd700 1 -- 172.21.15.154:0/826899902 learned_addr learned my addr 172.21.15.154:0/826899902 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:00.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.968+0000 7f0a577fe700 1 --2- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a58130ce0 0x7f0a5811b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a567fc700 1 -- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a5809d860 msgr2=0x7f0a5811ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a567fc700 1 --2- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a5809d860 0x7f0a5811ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a567fc700 1 -- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a58130ce0 msgr2=0x7f0a5811b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a567fc700 1 --2- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a58130ce0 0x7f0a5811b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a567fc700 1 -- 172.21.15.154:0/826899902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c00b7f0 con 0x7f0a5809e170 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a56ffd700 1 --2- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a5809d860 0x7f0a5811ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a567fc700 1 --2- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5809e170 0x7f0a5811b340 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c010f00 tx=0x7f0a4c00e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a3f7fe700 1 -- 172.21.15.154:0/826899902 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c004030 con 0x7f0a5809e170 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a3f7fe700 1 -- 172.21.15.154:0/826899902 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c004190 con 0x7f0a5809e170 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a3f7fe700 1 -- 172.21.15.154:0/826899902 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c004520 con 0x7f0a5809e170 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/826899902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a50009a70 con 0x7f0a5809e170 2023-09-30T22:25:00.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.969+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/826899902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a580a0640 con 0x7f0a5809e170 2023-09-30T22:25:00.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.970+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/826899902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a580710b0 con 0x7f0a5809e170 2023-09-30T22:25:00.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.970+0000 7f0a3f7fe700 1 -- 172.21.15.154:0/826899902 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a4c0036a0 con 0x7f0a5809e170 2023-09-30T22:25:00.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.970+0000 7f0a3f7fe700 1 -- 172.21.15.154:0/826899902 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a4c0420c0 con 0x7f0a5809e170 2023-09-30T22:25:00.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:00.975+0000 7f0a3f7fe700 1 -- 172.21.15.154:0/826899902 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a4c011450 con 0x7f0a5809e170 2023-09-30T22:25:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.002+0000 7feb00714700 1 Processor -- start 2023-09-30T22:25:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.002+0000 7feb00714700 1 -- start start 2023-09-30T22:25:01.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.002+0000 7f06f2f76700 1 Processor -- start 2023-09-30T22:25:01.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06f2f76700 1 -- start start 2023-09-30T22:25:01.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7feb00714700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf809e950 0x7feaf809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7feb00714700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feaf809f260 0x7feaf8137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06f2f76700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06ec136960 0x7f06ec138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06f2f76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06f2f76700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec06b2d0 con 0x7f06ec133ad0 2023-09-30T22:25:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06f2f76700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec1345b0 con 0x7f06ec136960 2023-09-30T22:25:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06f2f76700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec133610 con 0x7f06ec139280 2023-09-30T22:25:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7feb00714700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf809ac20 con 0x7feaf81381e0 2023-09-30T22:25:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7feb00714700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80a06c0 con 0x7feaf809f260 2023-09-30T22:25:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7feb00714700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaf809ae90 con 0x7feaf809e950 2023-09-30T22:25:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7feafdcaf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feaf809f260 0x7feaf8137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7feafdcaf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feaf809f260 0x7feaf8137ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41204/0 (socket says 172.21.15.154:41204) 2023-09-30T22:25:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7feafdcaf700 1 -- 172.21.15.154:0/2644524766 learned_addr learned my addr 172.21.15.154:0/2644524766 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:01.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06ebfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06ec136960 0x7f06ec138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06f1513700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06ebfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06ec136960 0x7f06ec138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41210/0 (socket says 172.21.15.154:41210) 2023-09-30T22:25:01.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06ebfff700 1 -- 172.21.15.154:0/194113870 learned_addr learned my addr 172.21.15.154:0/194113870 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:01.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.003+0000 7f06f1513700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34466/0 (socket says 172.21.15.154:34466) 2023-09-30T22:25:01.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7feafdcaf700 1 -- 172.21.15.154:0/2644524766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf809e950 msgr2=0x7feaf809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7feafdcaf700 1 --2- 172.21.15.154:0/2644524766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf809e950 0x7feaf809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7feafdcaf700 1 -- 172.21.15.154:0/2644524766 >> v1:172.21.15.154:6789/0 conn(0x7feaf81381e0 legacy=0x7feaf813a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7feafdcaf700 1 -- 172.21.15.154:0/2644524766 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf806ba00 con 0x7feaf809f260 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7f06ebfff700 1 -- 172.21.15.154:0/194113870 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 msgr2=0x7f06ec13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7f06ebfff700 1 --2- 172.21.15.154:0/194113870 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7f06ebfff700 1 -- 172.21.15.154:0/194113870 >> v1:172.21.15.154:6789/0 conn(0x7f06ec133ad0 legacy=0x7f06ec133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7f06ebfff700 1 -- 172.21.15.154:0/194113870 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec09a500 con 0x7f06ec136960 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7f06ebfff700 1 --2- 172.21.15.154:0/194113870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec136960 0x7f06ec138d40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f06d80098f0 tx=0x7f06d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de56595074afc63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7feafdcaf700 1 --2- 172.21.15.154:0/2644524766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf809f260 0x7feaf8137ca0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7feae80098f0 tx=0x7feae8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c5c0e004ddb305 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7f06eb7fe700 1 -- 172.21.15.154:0/194113870 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8011830 con 0x7f06ec136960 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7f06eb7fe700 1 -- 172.21.15.154:0/194113870 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d8011990 con 0x7f06ec136960 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7f06eb7fe700 1 -- 172.21.15.154:0/194113870 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8011d20 con 0x7f06ec136960 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7feafd4ae700 1 -- 172.21.15.154:0/2644524766 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800b8a0 con 0x7feaf809f260 2023-09-30T22:25:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7feafd4ae700 1 -- 172.21.15.154:0/2644524766 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae800ba00 con 0x7feaf809f260 2023-09-30T22:25:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.004+0000 7feafd4ae700 1 -- 172.21.15.154:0/2644524766 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae800bd90 con 0x7feaf809f260 2023-09-30T22:25:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7f06f2f76700 1 -- 172.21.15.154:0/194113870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec136960 msgr2=0x7f06ec138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7f06f2f76700 1 --2- 172.21.15.154:0/194113870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec136960 0x7f06ec138d40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f06d80098f0 tx=0x7f06d8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7f06f2f76700 1 -- 172.21.15.154:0/194113870 shutdown_connections 2023-09-30T22:25:01.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7f06f2f76700 1 --2- 172.21.15.154:0/194113870 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7f06f2f76700 1 --2- 172.21.15.154:0/194113870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec136960 0x7f06ec138d40 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7f06f2f76700 1 -- 172.21.15.154:0/194113870 >> 172.21.15.154:0/194113870 conn(0x7f06ec099c40 msgr2=0x7f06ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7f06f2f76700 1 -- 172.21.15.154:0/194113870 shutdown_connections 2023-09-30T22:25:01.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7feb00714700 1 -- 172.21.15.154:0/2644524766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf809f260 msgr2=0x7feaf8137ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7feb00714700 1 --2- 172.21.15.154:0/2644524766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf809f260 0x7feaf8137ca0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7feae80098f0 tx=0x7feae8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7f06f2f76700 1 -- 172.21.15.154:0/194113870 wait complete. 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7feb00714700 1 -- 172.21.15.154:0/2644524766 shutdown_connections 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7feb00714700 1 --2- 172.21.15.154:0/2644524766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf809e950 0x7feaf809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7feb00714700 1 --2- 172.21.15.154:0/2644524766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf809f260 0x7feaf8137ca0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7feb00714700 1 -- 172.21.15.154:0/2644524766 >> 172.21.15.154:0/2644524766 conn(0x7feaf80a0f70 msgr2=0x7feaf80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7feb00714700 1 -- 172.21.15.154:0/2644524766 shutdown_connections 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.005+0000 7feb00714700 1 -- 172.21.15.154:0/2644524766 wait complete. 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7f06f2f76700 1 Processor -- start 2023-09-30T22:25:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7f06f2f76700 1 -- start start 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7feb00714700 1 Processor -- start 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7feb00714700 1 -- start start 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7feb00714700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf809e950 0x7feaf8123920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7feb00714700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf809f260 0x7feaf81c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7feb00714700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf81381e0 0x7feaf81c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7feb00714700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8123330 con 0x7feaf809e950 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7feb00714700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8126300 con 0x7feaf809f260 2023-09-30T22:25:01.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7feb00714700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81265c0 con 0x7feaf81381e0 2023-09-30T22:25:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.006+0000 7f06f2f76700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06ec133ad0 0x7f06ec12f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f2f76700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec136960 0x7f06ec12fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f2f76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f2f76700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec070370 con 0x7f06ec136960 2023-09-30T22:25:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f2f76700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec131730 con 0x7f06ec133ad0 2023-09-30T22:25:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f2f76700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec06fe40 con 0x7f06ec139280 2023-09-30T22:25:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f1513700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f1513700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec1c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34492/0 (socket says 172.21.15.154:34492) 2023-09-30T22:25:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f1513700 1 -- 172.21.15.154:0/990002002 learned_addr learned my addr 172.21.15.154:0/990002002 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06ebfff700 1 --2- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec136960 0x7f06ec12fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafecb1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf81381e0 0x7feaf81c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafecb1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf81381e0 0x7feaf81c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34480/0 (socket says 172.21.15.154:34480) 2023-09-30T22:25:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafecb1700 1 -- 172.21.15.154:0/3268922986 learned_addr learned my addr 172.21.15.154:0/3268922986 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafe4b0700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf809e950 0x7feaf8123920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f0d12700 1 --2- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06ec133ad0 0x7f06ec12f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafdcaf700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf809f260 0x7feaf81c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafecb1700 1 -- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf809f260 msgr2=0x7feaf81c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafecb1700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf809f260 0x7feaf81c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafecb1700 1 -- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf809e950 msgr2=0x7feaf8123920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafecb1700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf809e950 0x7feaf8123920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafecb1700 1 -- 172.21.15.154:0/3268922986 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8009550 con 0x7feaf81381e0 2023-09-30T22:25:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafdcaf700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf809f260 0x7feaf81c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f1513700 1 -- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06ec133ad0 msgr2=0x7f06ec12f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f1513700 1 --2- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06ec133ad0 0x7f06ec12f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f1513700 1 -- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec136960 msgr2=0x7f06ec12fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f1513700 1 --2- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec136960 0x7f06ec12fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f1513700 1 -- 172.21.15.154:0/990002002 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d8009550 con 0x7f06ec139280 2023-09-30T22:25:01.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7feafecb1700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf81381e0 0x7feaf81c8990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feaf000cc50 tx=0x7feaf000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.007+0000 7f06f1513700 1 --2- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec1c8570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f06e400ef90 tx=0x7f06e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7f06e97fa700 1 -- 172.21.15.154:0/990002002 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400cc90 con 0x7f06ec139280 2023-09-30T22:25:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7feaeeffd700 1 -- 172.21.15.154:0/3268922986 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0003c00 con 0x7feaf81381e0 2023-09-30T22:25:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7feaeeffd700 1 -- 172.21.15.154:0/3268922986 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf0003d60 con 0x7feaf81381e0 2023-09-30T22:25:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7feb00714700 1 -- 172.21.15.154:0/3268922986 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf8125600 con 0x7feaf81381e0 2023-09-30T22:25:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7feaeeffd700 1 -- 172.21.15.154:0/3268922986 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000ab40 con 0x7feaf81381e0 2023-09-30T22:25:01.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7feb00714700 1 -- 172.21.15.154:0/3268922986 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf81268a0 con 0x7feaf81381e0 2023-09-30T22:25:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7f06f2f76700 1 -- 172.21.15.154:0/990002002 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec06ef30 con 0x7f06ec139280 2023-09-30T22:25:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7f06f2f76700 1 -- 172.21.15.154:0/990002002 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec130240 con 0x7f06ec139280 2023-09-30T22:25:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7f06e97fa700 1 -- 172.21.15.154:0/990002002 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e400f040 con 0x7f06ec139280 2023-09-30T22:25:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.008+0000 7f06e97fa700 1 -- 172.21.15.154:0/990002002 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4014480 con 0x7f06ec139280 2023-09-30T22:25:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.009+0000 7feb00714700 1 -- 172.21.15.154:0/3268922986 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf8074f10 con 0x7feaf81381e0 2023-09-30T22:25:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.009+0000 7feaeeffd700 1 -- 172.21.15.154:0/3268922986 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feaf000aca0 con 0x7feaf81381e0 2023-09-30T22:25:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.010+0000 7feaeeffd700 1 -- 172.21.15.154:0/3268922986 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feaf0040210 con 0x7feaf81381e0 2023-09-30T22:25:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.010+0000 7f06f2f76700 1 -- 172.21.15.154:0/990002002 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc0052e0 con 0x7f06ec139280 2023-09-30T22:25:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.014+0000 7feaeeffd700 1 -- 172.21.15.154:0/3268922986 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feaf0011740 con 0x7feaf81381e0 2023-09-30T22:25:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.014+0000 7f06e97fa700 1 -- 172.21.15.154:0/990002002 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06e40145e0 con 0x7f06ec139280 2023-09-30T22:25:01.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.015+0000 7f06e97fa700 1 -- 172.21.15.154:0/990002002 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f06e40407d0 con 0x7f06ec139280 2023-09-30T22:25:01.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.018+0000 7f06e97fa700 1 -- 172.21.15.154:0/990002002 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06e4012930 con 0x7f06ec139280 2023-09-30T22:25:01.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:01.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.166+0000 7f9532ab8700 1 Processor -- start 2023-09-30T22:25:01.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.166+0000 7f9532ab8700 1 -- start start 2023-09-30T22:25:01.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.166+0000 7f9532ab8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.166+0000 7f9532ab8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c133b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.166+0000 7f9532ab8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c06d720 con 0x7f952c134060 2023-09-30T22:25:01.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.166+0000 7f9532ab8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c09ad60 con 0x7f952c09e870 2023-09-30T22:25:01.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.166+0000 7f9532ab8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952c06c970 con 0x7f952c09f180 2023-09-30T22:25:01.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.166+0000 7f9531055700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f952c134060 0x7f952c13ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38216/0 (socket says 172.21.15.154:38216) 2023-09-30T22:25:01.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f9531055700 1 -- 172.21.15.154:0/756173240 learned_addr learned my addr 172.21.15.154:0/756173240 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:01.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f9530854700 1 --2- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f952bfff700 1 --2- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c133b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f952b7fe700 1 -- 172.21.15.154:0/756173240 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087788474 0 0) 0x7f952c06d720 con 0x7f952c134060 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f952b7fe700 1 -- 172.21.15.154:0/756173240 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f951c0035b0 con 0x7f952c134060 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f9530854700 1 -- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 msgr2=0x7f952c133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f9530854700 1 --2- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c133b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f9530854700 1 -- 172.21.15.154:0/756173240 >> v1:172.21.15.154:6789/0 conn(0x7f952c134060 legacy=0x7f952c13ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f9530854700 1 -- 172.21.15.154:0/756173240 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c09a970 con 0x7f952c09e870 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f952bfff700 1 --2- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c133b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.167+0000 7f9530854700 1 --2- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c09ec40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9520009870 tx=0x7f9520009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d9e5e2ab9f7a9e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f952b7fe700 1 -- 172.21.15.154:0/756173240 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011830 con 0x7f952c09e870 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f952b7fe700 1 -- 172.21.15.154:0/756173240 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520011990 con 0x7f952c09e870 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f952b7fe700 1 -- 172.21.15.154:0/756173240 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011d00 con 0x7f952c09e870 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f9532ab8700 1 -- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 msgr2=0x7f952c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f9532ab8700 1 --2- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c09ec40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9520009870 tx=0x7f9520009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f9532ab8700 1 -- 172.21.15.154:0/756173240 shutdown_connections 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f9532ab8700 1 --2- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c09ec40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f9532ab8700 1 --2- 172.21.15.154:0/756173240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c133b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f9532ab8700 1 -- 172.21.15.154:0/756173240 >> 172.21.15.154:0/756173240 conn(0x7f952c0a4150 msgr2=0x7f952c0a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f9532ab8700 1 -- 172.21.15.154:0/756173240 shutdown_connections 2023-09-30T22:25:01.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.168+0000 7f9532ab8700 1 -- 172.21.15.154:0/756173240 wait complete. 2023-09-30T22:25:01.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.170+0000 7f9532ab8700 1 Processor -- start 2023-09-30T22:25:01.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.170+0000 7f9532ab8700 1 -- start start 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9532ab8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9532ab8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c122fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9532ab8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c134060 0x7f952c123510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9532ab8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c123f60 con 0x7f952c134060 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9532ab8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c1246a0 con 0x7f952c09e870 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9532ab8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952c1265b0 con 0x7f952c09f180 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9530854700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9530854700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c122a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57654/0 (socket says 172.21.15.154:57654) 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9530854700 1 -- 172.21.15.154:0/3913988674 learned_addr learned my addr 172.21.15.154:0/3913988674 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f952bfff700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9531055700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c134060 0x7f952c123510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9530854700 1 -- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 msgr2=0x7f952c122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9530854700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9530854700 1 -- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c134060 msgr2=0x7f952c123510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9530854700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c134060 0x7f952c123510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9530854700 1 -- 172.21.15.154:0/3913988674 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180094a0 con 0x7f952c09e870 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f952bfff700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c122fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.171+0000 7f9530854700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c122a90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9520000c00 tx=0x7f9520004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.172+0000 7f95297fa700 1 -- 172.21.15.154:0/3913988674 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520004550 con 0x7f952c09e870 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.172+0000 7f95297fa700 1 -- 172.21.15.154:0/3913988674 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952001e070 con 0x7f952c09e870 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.172+0000 7f95297fa700 1 -- 172.21.15.154:0/3913988674 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200038e0 con 0x7f952c09e870 2023-09-30T22:25:01.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.172+0000 7f9532ab8700 1 -- 172.21.15.154:0/3913988674 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95200094a0 con 0x7f952c09e870 2023-09-30T22:25:01.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.172+0000 7f9532ab8700 1 -- 172.21.15.154:0/3913988674 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c1262d0 con 0x7f952c09e870 2023-09-30T22:25:01.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.173+0000 7f95297fa700 1 -- 172.21.15.154:0/3913988674 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9520003a40 con 0x7f952c09e870 2023-09-30T22:25:01.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.173+0000 7f95297fa700 1 -- 172.21.15.154:0/3913988674 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9520040690 con 0x7f952c09e870 2023-09-30T22:25:01.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.173+0000 7f9532ab8700 1 -- 172.21.15.154:0/3913988674 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c04f2a0 con 0x7f952c09e870 2023-09-30T22:25:01.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.178+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/826899902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a5809c8b0 con 0x7f0a5809e170 2023-09-30T22:25:01.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.178+0000 7f0a3f7fe700 1 -- 172.21.15.154:0/826899902 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a4c00db40 con 0x7f0a5809e170 2023-09-30T22:25:01.178 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:01.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.180+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5809e170 msgr2=0x7f0a5811b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.180+0000 7f0a5d7d5700 1 --2- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5809e170 0x7f0a5811b340 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c010f00 tx=0x7f0a4c00e640 comp rx=0 tx=0).stop 2023-09-30T22:25:01.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.180+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/826899902 shutdown_connections 2023-09-30T22:25:01.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.180+0000 7f0a5d7d5700 1 --2- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a58130ce0 0x7f0a5811b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.180+0000 7f0a5d7d5700 1 --2- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a5809d860 0x7f0a5811ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.181+0000 7f0a5d7d5700 1 --2- 172.21.15.154:0/826899902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5809e170 0x7f0a5811b340 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.181+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/826899902 >> 172.21.15.154:0/826899902 conn(0x7f0a58099c40 msgr2=0x7f0a5812dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.181+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/826899902 shutdown_connections 2023-09-30T22:25:01.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.181+0000 7f0a5d7d5700 1 -- 172.21.15.154:0/826899902 wait complete. 2023-09-30T22:25:01.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.182+0000 7f95297fa700 1 -- 172.21.15.154:0/3913988674 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9520015030 con 0x7f952c09e870 2023-09-30T22:25:01.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:01.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.220+0000 7feb00714700 1 -- 172.21.15.154:0/3268922986 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feaf804f2a0 con 0x7feaf81381e0 2023-09-30T22:25:01.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.220+0000 7feaeeffd700 1 -- 172.21.15.154:0/3268922986 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feaf0029090 con 0x7feaf81381e0 2023-09-30T22:25:01.220 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:01.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.222+0000 7f06f2f76700 1 -- 172.21.15.154:0/990002002 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06cc005860 con 0x7f06ec139280 2023-09-30T22:25:01.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.222+0000 7f06e97fa700 1 -- 172.21.15.154:0/990002002 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06e402a030 con 0x7f06ec139280 2023-09-30T22:25:01.222 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:01.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.222+0000 7feb00714700 1 -- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf81381e0 msgr2=0x7feaf81c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.222+0000 7feb00714700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf81381e0 0x7feaf81c8990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feaf000cc50 tx=0x7feaf000cf60 comp rx=0 tx=0).stop 2023-09-30T22:25:01.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.223+0000 7feb00714700 1 -- 172.21.15.154:0/3268922986 shutdown_connections 2023-09-30T22:25:01.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.223+0000 7feb00714700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feaf81381e0 0x7feaf81c8990 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.223+0000 7feb00714700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf809e950 0x7feaf8123920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.223+0000 7feb00714700 1 --2- 172.21.15.154:0/3268922986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf809f260 0x7feaf81c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.223+0000 7feb00714700 1 -- 172.21.15.154:0/3268922986 >> 172.21.15.154:0/3268922986 conn(0x7feaf80a0f70 msgr2=0x7feaf8071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7feb00714700 1 -- 172.21.15.154:0/3268922986 shutdown_connections 2023-09-30T22:25:01.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7feb00714700 1 -- 172.21.15.154:0/3268922986 wait complete. 2023-09-30T22:25:01.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7f06f2f76700 1 -- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 msgr2=0x7f06ec1c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7f06f2f76700 1 --2- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec1c8570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f06e400ef90 tx=0x7f06e400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7f06f2f76700 1 -- 172.21.15.154:0/990002002 shutdown_connections 2023-09-30T22:25:01.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7f06f2f76700 1 --2- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06ec139280 0x7f06ec1c8570 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7f06f2f76700 1 --2- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06ec133ad0 0x7f06ec12f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7f06f2f76700 1 --2- 172.21.15.154:0/990002002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec136960 0x7f06ec12fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7f06f2f76700 1 -- 172.21.15.154:0/990002002 >> 172.21.15.154:0/990002002 conn(0x7f06ec099c40 msgr2=0x7f06ec134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7f06f2f76700 1 -- 172.21.15.154:0/990002002 shutdown_connections 2023-09-30T22:25:01.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.224+0000 7f06f2f76700 1 -- 172.21.15.154:0/990002002 wait complete. 2023-09-30T22:25:01.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:01.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:01.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.371+0000 7f9532ab8700 1 -- 172.21.15.154:0/3913988674 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f952c072840 con 0x7f952c09e870 2023-09-30T22:25:01.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.372+0000 7f95297fa700 1 -- 172.21.15.154:0/3913988674 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9520003cf0 con 0x7f952c09e870 2023-09-30T22:25:01.372 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.374+0000 7f9532ab8700 1 -- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 msgr2=0x7f952c122a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.374+0000 7f9532ab8700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c122a90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9520000c00 tx=0x7f9520004750 comp rx=0 tx=0).stop 2023-09-30T22:25:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.374+0000 7f9532ab8700 1 -- 172.21.15.154:0/3913988674 shutdown_connections 2023-09-30T22:25:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.374+0000 7f9532ab8700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c134060 0x7f952c123510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.374+0000 7f9532ab8700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f952c09e870 0x7f952c122a90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.374+0000 7f9532ab8700 1 --2- 172.21.15.154:0/3913988674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f952c09f180 0x7f952c122fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.374+0000 7f9532ab8700 1 -- 172.21.15.154:0/3913988674 >> 172.21.15.154:0/3913988674 conn(0x7f952c0a4150 msgr2=0x7f952c070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.374+0000 7f9532ab8700 1 -- 172.21.15.154:0/3913988674 shutdown_connections 2023-09-30T22:25:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:01.374+0000 7f9532ab8700 1 -- 172.21.15.154:0/3913988674 wait complete. 2023-09-30T22:25:01.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:02.198 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:02.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:02.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:02.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.331+0000 7fb7c4e15700 1 Processor -- start 2023-09-30T22:25:02.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.331+0000 7fb7c4e15700 1 -- start start 2023-09-30T22:25:02.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7c4e15700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7c009e870 0x7fb7c009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7c4e15700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009f180 0x7fb7c0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7c4e15700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c009c970 con 0x7fb7c0131d70 2023-09-30T22:25:02.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7c4e15700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c00a0920 con 0x7fb7c009e870 2023-09-30T22:25:02.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7c4e15700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c009f9c0 con 0x7fb7c009f180 2023-09-30T22:25:02.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7be59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7c009e870 0x7fb7c009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7bdd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009f180 0x7fb7c0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7be59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7c009e870 0x7fb7c009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41248/0 (socket says 172.21.15.154:41248) 2023-09-30T22:25:02.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7bdd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009f180 0x7fb7c0131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57670/0 (socket says 172.21.15.154:57670) 2023-09-30T22:25:02.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.332+0000 7fb7be59c700 1 -- 172.21.15.154:0/2127362527 learned_addr learned my addr 172.21.15.154:0/2127362527 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:02.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7bdd9b700 1 -- 172.21.15.154:0/2127362527 >> v2:172.21.15.154:3300/0 conn(0x7fb7c009e870 msgr2=0x7fb7c009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7bdd9b700 1 --2- 172.21.15.154:0/2127362527 >> v2:172.21.15.154:3300/0 conn(0x7fb7c009e870 0x7fb7c009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7bdd9b700 1 -- 172.21.15.154:0/2127362527 >> v1:172.21.15.154:6789/0 conn(0x7fb7c0131d70 legacy=0x7fb7c0138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7bd59a700 1 -- 172.21.15.154:0/2127362527 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704980213 0 0) 0x7fb7c009c970 con 0x7fb7c0131d70 2023-09-30T22:25:02.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7bdd9b700 1 -- 172.21.15.154:0/2127362527 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c009bab0 con 0x7fb7c009f180 2023-09-30T22:25:02.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7be59c700 1 --2- 172.21.15.154:0/2127362527 >> v2:172.21.15.154:3300/0 conn(0x7fb7c009e870 0x7fb7c009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7bdd9b700 1 --2- 172.21.15.154:0/2127362527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009f180 0x7fb7c0131830 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009840 tx=0x7fb7b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5b4ddd6f3d0e2e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7bd59a700 1 -- 172.21.15.154:0/2127362527 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4011830 con 0x7fb7c009f180 2023-09-30T22:25:02.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7bd59a700 1 -- 172.21.15.154:0/2127362527 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b4011990 con 0x7fb7c009f180 2023-09-30T22:25:02.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.333+0000 7fb7bd59a700 1 -- 172.21.15.154:0/2127362527 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4011d20 con 0x7fb7c009f180 2023-09-30T22:25:02.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.334+0000 7fb7c4e15700 1 -- 172.21.15.154:0/2127362527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009f180 msgr2=0x7fb7c0131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.334+0000 7fb7c4e15700 1 --2- 172.21.15.154:0/2127362527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009f180 0x7fb7c0131830 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009840 tx=0x7fb7b4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:02.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.334+0000 7fb7c4e15700 1 -- 172.21.15.154:0/2127362527 shutdown_connections 2023-09-30T22:25:02.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.334+0000 7fb7c4e15700 1 --2- 172.21.15.154:0/2127362527 >> v2:172.21.15.154:3300/0 conn(0x7fb7c009e870 0x7fb7c009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.334+0000 7fb7c4e15700 1 --2- 172.21.15.154:0/2127362527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009f180 0x7fb7c0131830 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.334+0000 7fb7c4e15700 1 -- 172.21.15.154:0/2127362527 >> 172.21.15.154:0/2127362527 conn(0x7fb7c00a4430 msgr2=0x7fb7c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.334+0000 7fb7c4e15700 1 -- 172.21.15.154:0/2127362527 shutdown_connections 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.334+0000 7fb7c4e15700 1 -- 172.21.15.154:0/2127362527 wait complete. 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.335+0000 7fb7c4e15700 1 Processor -- start 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7c4e15700 1 -- start start 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7c4e15700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009e870 0x7fb7c011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7c4e15700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c009f180 0x7fb7c011f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7c4e15700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c0131d70 0x7fb7c011fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7c4e15700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0121da0 con 0x7fb7c0131d70 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7c4e15700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0122db0 con 0x7fb7c009e870 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7c4e15700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c01228a0 con 0x7fb7c009f180 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7bdd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c009f180 0x7fb7c011f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7bdd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c009f180 0x7fb7c011f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34510/0 (socket says 172.21.15.154:34510) 2023-09-30T22:25:02.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7bdd9b700 1 -- 172.21.15.154:0/130997715 learned_addr learned my addr 172.21.15.154:0/130997715 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:02.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.336+0000 7fb7bed9d700 1 --2- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c0131d70 0x7fb7c011fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7be59c700 1 --2- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009e870 0x7fb7c011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7bdd9b700 1 -- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009e870 msgr2=0x7fb7c011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7bdd9b700 1 --2- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009e870 0x7fb7c011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7bdd9b700 1 -- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c0131d70 msgr2=0x7fb7c011fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7bdd9b700 1 --2- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c0131d70 0x7fb7c011fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7bdd9b700 1 -- 172.21.15.154:0/130997715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b0009550 con 0x7fb7c009f180 2023-09-30T22:25:02.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7bdd9b700 1 --2- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c009f180 0x7fb7c011f820 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40090b0 tx=0x7fb7b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7aeffd700 1 -- 172.21.15.154:0/130997715 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40036a0 con 0x7fb7c009f180 2023-09-30T22:25:02.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7aeffd700 1 -- 172.21.15.154:0/130997715 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b401f070 con 0x7fb7c009f180 2023-09-30T22:25:02.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7aeffd700 1 -- 172.21.15.154:0/130997715 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4003a20 con 0x7fb7c009f180 2023-09-30T22:25:02.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7c4e15700 1 -- 172.21.15.154:0/130997715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b40094a0 con 0x7fb7c009f180 2023-09-30T22:25:02.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.337+0000 7fb7c4e15700 1 -- 172.21.15.154:0/130997715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c0130660 con 0x7fb7c009f180 2023-09-30T22:25:02.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.338+0000 7fb7aeffd700 1 -- 172.21.15.154:0/130997715 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7b4003b80 con 0x7fb7c009f180 2023-09-30T22:25:02.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.338+0000 7fb7aeffd700 1 -- 172.21.15.154:0/130997715 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7b4021070 con 0x7fb7c009f180 2023-09-30T22:25:02.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.339+0000 7fb7c4e15700 1 -- 172.21.15.154:0/130997715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c011be60 con 0x7fb7c009f180 2023-09-30T22:25:02.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.343+0000 7fb7aeffd700 1 -- 172.21.15.154:0/130997715 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7b402b080 con 0x7fb7c009f180 2023-09-30T22:25:02.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.381+0000 7f24fe1cd700 1 Processor -- start 2023-09-30T22:25:02.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.381+0000 7f2a993a8700 1 Processor -- start 2023-09-30T22:25:02.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.381+0000 7f2a993a8700 1 -- start start 2023-09-30T22:25:02.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.381+0000 7f24fe1cd700 1 -- start start 2023-09-30T22:25:02.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a993a8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a9406a770 0x7f2a94133970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a993a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94130650 0x7f2a9413b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a993a8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9409f480 con 0x7f2a94133eb0 2023-09-30T22:25:02.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a993a8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9409a3f0 con 0x7f2a9406a770 2023-09-30T22:25:02.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a993a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9409ef40 con 0x7f2a94130650 2023-09-30T22:25:02.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24fe1cd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24f80a0a70 0x7f24f80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24fe1cd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f8134120 0x7f24f813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24fe1cd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f809dc00 con 0x7f24f80a1380 2023-09-30T22:25:02.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24fe1cd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f809ea90 con 0x7f24f80a0a70 2023-09-30T22:25:02.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24fe1cd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f809dec0 con 0x7f24f8134120 2023-09-30T22:25:02.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a92ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a9406a770 0x7f2a94133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a92ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a9406a770 0x7f2a94133970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41278/0 (socket says 172.21.15.154:41278) 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24f6ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f24f80a1380 0x7f24f8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38254/0 (socket says 172.21.15.154:38254) 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24f6ffd700 1 -- 172.21.15.154:0/3604652676 learned_addr learned my addr 172.21.15.154:0/3604652676 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a92ffd700 1 -- 172.21.15.154:0/4100877732 learned_addr learned my addr 172.21.15.154:0/4100877732 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:02.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a937fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94130650 0x7f2a9413b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a937fe700 1 -- 172.21.15.154:0/4100877732 >> v2:172.21.15.154:3300/0 conn(0x7f2a9406a770 msgr2=0x7f2a94133970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a937fe700 1 --2- 172.21.15.154:0/4100877732 >> v2:172.21.15.154:3300/0 conn(0x7f2a9406a770 0x7f2a94133970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a937fe700 1 -- 172.21.15.154:0/4100877732 >> v1:172.21.15.154:6789/0 conn(0x7f2a94133eb0 legacy=0x7f2a9412ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a937fe700 1 -- 172.21.15.154:0/4100877732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9409f6b0 con 0x7f2a94130650 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24f77fe700 1 --2- 172.21.15.154:0/3604652676 >> v2:172.21.15.154:3300/0 conn(0x7f24f80a0a70 0x7f24f80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f2a937fe700 1 --2- 172.21.15.154:0/4100877732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94130650 0x7f2a9413b830 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009d90 tx=0x7f2a8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a62b0dc6109bb05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24f7fff700 1 --2- 172.21.15.154:0/3604652676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f8134120 0x7f24f813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24f67fc700 1 -- 172.21.15.154:0/3604652676 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263497285 0 0) 0x7f24f809dc00 con 0x7f24f80a1380 2023-09-30T22:25:02.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.382+0000 7f24f67fc700 1 -- 172.21.15.154:0/3604652676 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e00035b0 con 0x7f24f80a1380 2023-09-30T22:25:02.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f24f77fe700 1 -- 172.21.15.154:0/3604652676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f8134120 msgr2=0x7f24f813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f24f77fe700 1 --2- 172.21.15.154:0/3604652676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f8134120 0x7f24f813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f24f77fe700 1 -- 172.21.15.154:0/3604652676 >> v1:172.21.15.154:6789/0 conn(0x7f24f80a1380 legacy=0x7f24f8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:02.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f2a91ffb700 1 -- 172.21.15.154:0/4100877732 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c00e070 con 0x7f2a94130650 2023-09-30T22:25:02.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f2a91ffb700 1 -- 172.21.15.154:0/4100877732 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c00bb20 con 0x7f2a94130650 2023-09-30T22:25:02.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f2a91ffb700 1 -- 172.21.15.154:0/4100877732 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c012430 con 0x7f2a94130650 2023-09-30T22:25:02.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f24f77fe700 1 -- 172.21.15.154:0/3604652676 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f809e6a0 con 0x7f24f80a0a70 2023-09-30T22:25:02.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f24f77fe700 1 --2- 172.21.15.154:0/3604652676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f80a0a70 0x7f24f80a0e40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009840 tx=0x7f24e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f582726ebaa39a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f24f67fc700 1 -- 172.21.15.154:0/3604652676 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8011830 con 0x7f24f80a0a70 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f24f67fc700 1 -- 172.21.15.154:0/3604652676 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e8011990 con 0x7f24f80a0a70 2023-09-30T22:25:02.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f24f67fc700 1 -- 172.21.15.154:0/3604652676 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8011d20 con 0x7f24f80a0a70 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f2a993a8700 1 -- 172.21.15.154:0/4100877732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94130650 msgr2=0x7f2a9413b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f2a993a8700 1 --2- 172.21.15.154:0/4100877732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94130650 0x7f2a9413b830 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009d90 tx=0x7f2a8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f2a993a8700 1 -- 172.21.15.154:0/4100877732 shutdown_connections 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f2a993a8700 1 --2- 172.21.15.154:0/4100877732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94130650 0x7f2a9413b830 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f2a993a8700 1 --2- 172.21.15.154:0/4100877732 >> v2:172.21.15.154:3300/0 conn(0x7f2a9406a770 0x7f2a94133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.383+0000 7f2a993a8700 1 -- 172.21.15.154:0/4100877732 >> 172.21.15.154:0/4100877732 conn(0x7f2a940a2ef0 msgr2=0x7f2a940a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f2a993a8700 1 -- 172.21.15.154:0/4100877732 shutdown_connections 2023-09-30T22:25:02.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f2a993a8700 1 -- 172.21.15.154:0/4100877732 wait complete. 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f24fe1cd700 1 -- 172.21.15.154:0/3604652676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f80a0a70 msgr2=0x7f24f80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f24fe1cd700 1 --2- 172.21.15.154:0/3604652676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f80a0a70 0x7f24f80a0e40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009840 tx=0x7f24e8009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f24fe1cd700 1 -- 172.21.15.154:0/3604652676 shutdown_connections 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f24fe1cd700 1 --2- 172.21.15.154:0/3604652676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f8134120 0x7f24f813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f24fe1cd700 1 --2- 172.21.15.154:0/3604652676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f80a0a70 0x7f24f80a0e40 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f24fe1cd700 1 -- 172.21.15.154:0/3604652676 >> 172.21.15.154:0/3604652676 conn(0x7f24f80a6610 msgr2=0x7f24f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f24fe1cd700 1 -- 172.21.15.154:0/3604652676 shutdown_connections 2023-09-30T22:25:02.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.384+0000 7f24fe1cd700 1 -- 172.21.15.154:0/3604652676 wait complete. 2023-09-30T22:25:02.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a993a8700 1 Processor -- start 2023-09-30T22:25:02.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a993a8700 1 -- start start 2023-09-30T22:25:02.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f24fe1cd700 1 Processor -- start 2023-09-30T22:25:02.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a993a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a9406a770 0x7f2a941c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a993a8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a94130650 0x7f2a941c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f24fe1cd700 1 -- start start 2023-09-30T22:25:02.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a993a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94133eb0 0x7f2a9411d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a993a8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9412dba0 con 0x7f2a94130650 2023-09-30T22:25:02.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a993a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a94120570 con 0x7f2a94133eb0 2023-09-30T22:25:02.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a993a8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a94072500 con 0x7f2a9406a770 2023-09-30T22:25:02.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a937fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94133eb0 0x7f2a9411d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a937fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94133eb0 0x7f2a9411d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57708/0 (socket says 172.21.15.154:57708) 2023-09-30T22:25:02.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a937fe700 1 -- 172.21.15.154:0/4183031511 learned_addr learned my addr 172.21.15.154:0/4183031511 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:02.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.385+0000 7f2a92ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a9406a770 0x7f2a941c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a937fe700 1 -- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a9406a770 msgr2=0x7f2a941c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a937fe700 1 --2- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a9406a770 0x7f2a941c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a937fe700 1 -- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a94130650 msgr2=0x7f2a941c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a937fe700 1 --2- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a94130650 0x7f2a941c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24fe1cd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f80a0a70 0x7f24f8122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24fe1cd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f80a1380 0x7f24f8122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24fe1cd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24f8134120 0x7f24f8123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24fe1cd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f81332b0 con 0x7f24f80a0a70 2023-09-30T22:25:02.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24fe1cd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f81258b0 con 0x7f24f80a1380 2023-09-30T22:25:02.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a937fe700 1 -- 172.21.15.154:0/4183031511 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c009a70 con 0x7f2a94133eb0 2023-09-30T22:25:02.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24fe1cd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24f81261d0 con 0x7f24f8134120 2023-09-30T22:25:02.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24f8134120 0x7f24f8123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24f8134120 0x7f24f8123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34528/0 (socket says 172.21.15.154:34528) 2023-09-30T22:25:02.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f7fff700 1 -- 172.21.15.154:0/2496371338 learned_addr learned my addr 172.21.15.154:0/2496371338 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:02.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a92ffd700 1 --2- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a9406a770 0x7f2a941c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:02.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f6ffd700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f80a1380 0x7f24f8122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a937fe700 1 --2- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94133eb0 0x7f2a9411d950 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c014040 tx=0x7f2a8c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f77fe700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f80a0a70 0x7f24f8122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f7fff700 1 -- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f80a1380 msgr2=0x7f24f8122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f7fff700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f80a1380 0x7f24f8122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f7fff700 1 -- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f80a0a70 msgr2=0x7f24f8122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f7fff700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f80a0a70 0x7f24f8122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f7fff700 1 -- 172.21.15.154:0/2496371338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e80094a0 con 0x7f24f8134120 2023-09-30T22:25:02.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f6ffd700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f80a1380 0x7f24f8122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:02.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a7b7fe700 1 -- 172.21.15.154:0/4183031511 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c012430 con 0x7f2a94133eb0 2023-09-30T22:25:02.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f24f7fff700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24f8134120 0x7f24f8123180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009dd0 tx=0x7f24f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a7b7fe700 1 -- 172.21.15.154:0/4183031511 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c020070 con 0x7f2a94133eb0 2023-09-30T22:25:02.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a993a8700 1 -- 172.21.15.154:0/4183031511 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a941326e0 con 0x7f2a94133eb0 2023-09-30T22:25:02.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.386+0000 7f2a7b7fe700 1 -- 172.21.15.154:0/4183031511 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c003ea0 con 0x7f2a94133eb0 2023-09-30T22:25:02.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.387+0000 7f2a993a8700 1 -- 172.21.15.154:0/4183031511 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9412d450 con 0x7f2a94133eb0 2023-09-30T22:25:02.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.387+0000 7f24dffff700 1 -- 172.21.15.154:0/2496371338 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000cd40 con 0x7f24f8134120 2023-09-30T22:25:02.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.387+0000 7f24dffff700 1 -- 172.21.15.154:0/2496371338 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f000f040 con 0x7f24f8134120 2023-09-30T22:25:02.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.387+0000 7f24dffff700 1 -- 172.21.15.154:0/2496371338 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f00146c0 con 0x7f24f8134120 2023-09-30T22:25:02.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.387+0000 7f2a7b7fe700 1 -- 172.21.15.154:0/4183031511 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a8c004040 con 0x7f2a94133eb0 2023-09-30T22:25:02.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.387+0000 7f2a7b7fe700 1 -- 172.21.15.154:0/4183031511 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a8c022070 con 0x7f2a94133eb0 2023-09-30T22:25:02.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.388+0000 7f24fe1cd700 1 -- 172.21.15.154:0/2496371338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f8125c30 con 0x7f24f8134120 2023-09-30T22:25:02.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.388+0000 7f24fe1cd700 1 -- 172.21.15.154:0/2496371338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f8133b00 con 0x7f24f8134120 2023-09-30T22:25:02.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.388+0000 7f24dffff700 1 -- 172.21.15.154:0/2496371338 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24f0014820 con 0x7f24f8134120 2023-09-30T22:25:02.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.388+0000 7f2a993a8700 1 -- 172.21.15.154:0/4183031511 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a941203b0 con 0x7f2a94133eb0 2023-09-30T22:25:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.388+0000 7f24dffff700 1 -- 172.21.15.154:0/2496371338 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f24f003ff30 con 0x7f24f8134120 2023-09-30T22:25:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.389+0000 7f24fe1cd700 1 -- 172.21.15.154:0/2496371338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f8125aa0 con 0x7f24f8134120 2023-09-30T22:25:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.393+0000 7f2a7b7fe700 1 -- 172.21.15.154:0/4183031511 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a941203b0 con 0x7f2a94133eb0 2023-09-30T22:25:02.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.393+0000 7f24dffff700 1 -- 172.21.15.154:0/2496371338 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24f0018020 con 0x7f24f8134120 2023-09-30T22:25:02.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.528+0000 7f3790023700 1 Processor -- start 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f3790023700 1 -- start start 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f3790023700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809d860 0x7f378809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f3790023700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f378809e170 0x7f37881307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f3790023700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 0x7f3788131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f3790023700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378809aaa0 con 0x7f378809e170 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f3790023700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378809f870 con 0x7f3788130ce0 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f3790023700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378809b360 con 0x7f378809d860 2023-09-30T22:25:02.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f378d5be700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f378809e170 0x7f37881307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f378ddbf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809d860 0x7f378809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f378d5be700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f378809e170 0x7f37881307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41322/0 (socket says 172.21.15.154:41322) 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f378d5be700 1 -- 172.21.15.154:0/3365484547 learned_addr learned my addr 172.21.15.154:0/3365484547 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f378ddbf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809d860 0x7f378809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34532/0 (socket says 172.21.15.154:34532) 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.529+0000 7f378e5c0700 1 --2- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 0x7f3788131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.530+0000 7f378d5be700 1 -- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809d860 msgr2=0x7f378809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.530+0000 7f378d5be700 1 --2- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809d860 0x7f378809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.530+0000 7f378d5be700 1 -- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 msgr2=0x7f3788131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.530+0000 7f378d5be700 1 --2- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 0x7f3788131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.530+0000 7f378d5be700 1 -- 172.21.15.154:0/3365484547 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378809b620 con 0x7f378809e170 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.530+0000 7f378d5be700 1 --2- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809e170 0x7f37881307a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f37780098f0 tx=0x7f3778009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e01c8b3965b1f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.530+0000 7f378cdbd700 1 -- 172.21.15.154:0/3365484547 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778011830 con 0x7f378809e170 2023-09-30T22:25:02.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.530+0000 7f378cdbd700 1 -- 172.21.15.154:0/3365484547 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3778011990 con 0x7f378809e170 2023-09-30T22:25:02.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.530+0000 7f378cdbd700 1 -- 172.21.15.154:0/3365484547 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778011d20 con 0x7f378809e170 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.531+0000 7f3790023700 1 -- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809e170 msgr2=0x7f37881307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.531+0000 7f3790023700 1 --2- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809e170 0x7f37881307a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f37780098f0 tx=0x7f3778009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.531+0000 7f3790023700 1 -- 172.21.15.154:0/3365484547 shutdown_connections 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.531+0000 7f3790023700 1 --2- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 0x7f3788131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.531+0000 7f3790023700 1 --2- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809d860 0x7f378809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.531+0000 7f3790023700 1 --2- 172.21.15.154:0/3365484547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809e170 0x7f37881307a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.531+0000 7f3790023700 1 -- 172.21.15.154:0/3365484547 >> 172.21.15.154:0/3365484547 conn(0x7f3788099c40 msgr2=0x7f37880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.531+0000 7f3790023700 1 -- 172.21.15.154:0/3365484547 shutdown_connections 2023-09-30T22:25:02.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.531+0000 7f3790023700 1 -- 172.21.15.154:0/3365484547 wait complete. 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.532+0000 7f3790023700 1 Processor -- start 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.532+0000 7f3790023700 1 -- start start 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.532+0000 7f3790023700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809d860 0x7f378806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.532+0000 7f3790023700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809e170 0x7f378806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.532+0000 7f3790023700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 0x7f378806f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.532+0000 7f3790023700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3788125dc0 con 0x7f378809d860 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.532+0000 7f3790023700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378809a150 con 0x7f3788130ce0 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.532+0000 7f3790023700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378809c8b0 con 0x7f378809e170 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.532+0000 7f378ddbf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809d860 0x7f378806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378ddbf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809d860 0x7f378806e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41326/0 (socket says 172.21.15.154:41326) 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378ddbf700 1 -- 172.21.15.154:0/2553579672 learned_addr learned my addr 172.21.15.154:0/2553579672 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:02.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378e5c0700 1 --2- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 0x7f378806f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378d5be700 1 --2- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809e170 0x7f378806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378ddbf700 1 -- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809e170 msgr2=0x7f378806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378ddbf700 1 --2- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809e170 0x7f378806ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378ddbf700 1 -- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 msgr2=0x7f378806f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378ddbf700 1 --2- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 0x7f378806f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378ddbf700 1 -- 172.21.15.154:0/2553579672 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009550 con 0x7f378809d860 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f378ddbf700 1 --2- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809d860 0x7f378806e930 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f378400e870 tx=0x7f378400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f377e7fc700 1 -- 172.21.15.154:0/2553579672 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784013680 con 0x7f378809d860 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f377e7fc700 1 -- 172.21.15.154:0/2553579672 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37840137e0 con 0x7f378809d860 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f3790023700 1 -- 172.21.15.154:0/2553579672 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3788124980 con 0x7f378809d860 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f377e7fc700 1 -- 172.21.15.154:0/2553579672 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784013b90 con 0x7f378809d860 2023-09-30T22:25:02.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.533+0000 7f3790023700 1 -- 172.21.15.154:0/2553579672 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3788126830 con 0x7f378809d860 2023-09-30T22:25:02.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.534+0000 7f3790023700 1 -- 172.21.15.154:0/2553579672 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3788125c00 con 0x7f378809d860 2023-09-30T22:25:02.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.535+0000 7f377e7fc700 1 -- 172.21.15.154:0/2553579672 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3784013cf0 con 0x7f378809d860 2023-09-30T22:25:02.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.538+0000 7f377e7fc700 1 -- 172.21.15.154:0/2553579672 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f378401abf0 con 0x7f378809d860 2023-09-30T22:25:02.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.544+0000 7f377e7fc700 1 -- 172.21.15.154:0/2553579672 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f378401be10 con 0x7f378809d860 2023-09-30T22:25:02.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.554+0000 7fb7c4e15700 1 -- 172.21.15.154:0/130997715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb7c009b0e0 con 0x7fb7c009f180 2023-09-30T22:25:02.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.554+0000 7fb7aeffd700 1 -- 172.21.15.154:0/130997715 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7b4015020 con 0x7fb7c009f180 2023-09-30T22:25:02.554 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:02.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.556+0000 7fb7c4e15700 1 -- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c009f180 msgr2=0x7fb7c011f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.556+0000 7fb7c4e15700 1 --2- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c009f180 0x7fb7c011f820 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40090b0 tx=0x7fb7b4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:02.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.556+0000 7fb7c4e15700 1 -- 172.21.15.154:0/130997715 shutdown_connections 2023-09-30T22:25:02.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.556+0000 7fb7c4e15700 1 --2- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c0131d70 0x7fb7c011fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.556+0000 7fb7c4e15700 1 --2- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c009e870 0x7fb7c011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.556+0000 7fb7c4e15700 1 --2- 172.21.15.154:0/130997715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c009f180 0x7fb7c011f820 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.556+0000 7fb7c4e15700 1 -- 172.21.15.154:0/130997715 >> 172.21.15.154:0/130997715 conn(0x7fb7c00a4430 msgr2=0x7fb7c0131120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.556+0000 7fb7c4e15700 1 -- 172.21.15.154:0/130997715 shutdown_connections 2023-09-30T22:25:02.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.556+0000 7fb7c4e15700 1 -- 172.21.15.154:0/130997715 wait complete. 2023-09-30T22:25:02.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:02.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.622+0000 7f24fe1cd700 1 -- 172.21.15.154:0/2496371338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f24f8126010 con 0x7f24f8134120 2023-09-30T22:25:02.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.622+0000 7f24dffff700 1 -- 172.21.15.154:0/2496371338 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24f0018020 con 0x7f24f8134120 2023-09-30T22:25:02.622 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:02.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.625+0000 7f24fe1cd700 1 -- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24f8134120 msgr2=0x7f24f8123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.625+0000 7f24fe1cd700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24f8134120 0x7f24f8123180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009dd0 tx=0x7f24f000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.625+0000 7f24fe1cd700 1 -- 172.21.15.154:0/2496371338 shutdown_connections 2023-09-30T22:25:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.625+0000 7f24fe1cd700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24f8134120 0x7f24f8123180 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.625+0000 7f24fe1cd700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f80a0a70 0x7f24f8122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.625+0000 7f24fe1cd700 1 --2- 172.21.15.154:0/2496371338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24f80a1380 0x7f24f8122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.625+0000 7f24fe1cd700 1 -- 172.21.15.154:0/2496371338 >> 172.21.15.154:0/2496371338 conn(0x7f24f80a6610 msgr2=0x7f24f80a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.626+0000 7f24fe1cd700 1 -- 172.21.15.154:0/2496371338 shutdown_connections 2023-09-30T22:25:02.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.626+0000 7f24fe1cd700 1 -- 172.21.15.154:0/2496371338 wait complete. 2023-09-30T22:25:02.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:02.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.642+0000 7f2a993a8700 1 -- 172.21.15.154:0/4183031511 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a941203b0 con 0x7f2a94133eb0 2023-09-30T22:25:02.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.642+0000 7f2a7b7fe700 1 -- 172.21.15.154:0/4183031511 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a941203b0 con 0x7f2a94133eb0 2023-09-30T22:25:02.642 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:02.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.644+0000 7f2a993a8700 1 -- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94133eb0 msgr2=0x7f2a9411d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.644+0000 7f2a993a8700 1 --2- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94133eb0 0x7f2a9411d950 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c014040 tx=0x7f2a8c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.644+0000 7f2a993a8700 1 -- 172.21.15.154:0/4183031511 shutdown_connections 2023-09-30T22:25:02.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.644+0000 7f2a993a8700 1 --2- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94133eb0 0x7f2a9411d950 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.644+0000 7f2a993a8700 1 --2- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a9406a770 0x7f2a941c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.644+0000 7f2a993a8700 1 --2- 172.21.15.154:0/4183031511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a94130650 0x7f2a941c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.644+0000 7f2a993a8700 1 -- 172.21.15.154:0/4183031511 >> 172.21.15.154:0/4183031511 conn(0x7f2a940a2ef0 msgr2=0x7f2a9409ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.644+0000 7f2a993a8700 1 -- 172.21.15.154:0/4183031511 shutdown_connections 2023-09-30T22:25:02.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.644+0000 7f2a993a8700 1 -- 172.21.15.154:0/4183031511 wait complete. 2023-09-30T22:25:02.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:02.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.763+0000 7f3790023700 1 -- 172.21.15.154:0/2553579672 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f378804f2a0 con 0x7f378809d860 2023-09-30T22:25:02.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.763+0000 7f377e7fc700 1 -- 172.21.15.154:0/2553579672 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3784017070 con 0x7f378809d860 2023-09-30T22:25:02.763 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.765+0000 7f3790023700 1 -- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809d860 msgr2=0x7f378806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.765+0000 7f3790023700 1 --2- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809d860 0x7f378806e930 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f378400e870 tx=0x7f378400eb80 comp rx=0 tx=0).stop 2023-09-30T22:25:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.765+0000 7f3790023700 1 -- 172.21.15.154:0/2553579672 shutdown_connections 2023-09-30T22:25:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.765+0000 7f3790023700 1 --2- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3788130ce0 0x7f378806f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.765+0000 7f3790023700 1 --2- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f378809d860 0x7f378806e930 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.765+0000 7f3790023700 1 --2- 172.21.15.154:0/2553579672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f378809e170 0x7f378806ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:02.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.765+0000 7f3790023700 1 -- 172.21.15.154:0/2553579672 >> 172.21.15.154:0/2553579672 conn(0x7f3788099c40 msgr2=0x7f3788070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:02.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.765+0000 7f3790023700 1 -- 172.21.15.154:0/2553579672 shutdown_connections 2023-09-30T22:25:02.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:02.765+0000 7f3790023700 1 -- 172.21.15.154:0/2553579672 wait complete. 2023-09-30T22:25:02.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:03.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:03.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:03.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:03.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.709+0000 7f8eb49c0700 1 Processor -- start 2023-09-30T22:25:03.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.709+0000 7f8eb49c0700 1 -- start start 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.709+0000 7f8eb49c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0133900 0x7f8eb0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.709+0000 7f8eb49c0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8eb0134210 0x7f8eb00a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.709+0000 7f8eb49c0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb009a760 con 0x7f8eb00a0ee0 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.709+0000 7f8eb49c0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb01336e0 con 0x7f8eb0134210 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.709+0000 7f8eb49c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb009a080 con 0x7f8eb0133900 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eadd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8eb0134210 0x7f8eb00a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eadd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8eb0134210 0x7f8eb00a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41336/0 (socket says 172.21.15.154:41336) 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eadd9b700 1 -- 172.21.15.154:0/2471816236 learned_addr learned my addr 172.21.15.154:0/2471816236 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eae59c700 1 --2- 172.21.15.154:0/2471816236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0133900 0x7f8eb0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eadd9b700 1 -- 172.21.15.154:0/2471816236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0133900 msgr2=0x7f8eb0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eadd9b700 1 --2- 172.21.15.154:0/2471816236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0133900 0x7f8eb0133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eadd9b700 1 -- 172.21.15.154:0/2471816236 >> v1:172.21.15.154:6789/0 conn(0x7f8eb00a0ee0 legacy=0x7f8eb013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eadd9b700 1 -- 172.21.15.154:0/2471816236 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb00a23e0 con 0x7f8eb0134210 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eae59c700 1 --2- 172.21.15.154:0/2471816236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0133900 0x7f8eb0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8eadd9b700 1 --2- 172.21.15.154:0/2471816236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0134210 0x7f8eb00a09a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098f0 tx=0x7f8ea4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb853a454157eaaa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8ead59a700 1 -- 172.21.15.154:0/2471816236 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011830 con 0x7f8eb0134210 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8ead59a700 1 -- 172.21.15.154:0/2471816236 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea4011990 con 0x7f8eb0134210 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.710+0000 7f8ead59a700 1 -- 172.21.15.154:0/2471816236 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011d20 con 0x7f8eb0134210 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.711+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2471816236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0134210 msgr2=0x7f8eb00a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.711+0000 7f8eb49c0700 1 --2- 172.21.15.154:0/2471816236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0134210 0x7f8eb00a09a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098f0 tx=0x7f8ea4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.711+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2471816236 shutdown_connections 2023-09-30T22:25:03.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.711+0000 7f8eb49c0700 1 --2- 172.21.15.154:0/2471816236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0133900 0x7f8eb0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.711+0000 7f8eb49c0700 1 --2- 172.21.15.154:0/2471816236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0134210 0x7f8eb00a09a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.711+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2471816236 >> 172.21.15.154:0/2471816236 conn(0x7f8eb00a2980 msgr2=0x7f8eb00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.711+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2471816236 shutdown_connections 2023-09-30T22:25:03.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.711+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2471816236 wait complete. 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.712+0000 7f8eb49c0700 1 Processor -- start 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.712+0000 7f8eb49c0700 1 -- start start 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.712+0000 7f8eb49c0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8eb00a0ee0 0x7f8eb011d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eb49c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0133900 0x7f8eb011dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eb49c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0134210 0x7f8eb011e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eb49c0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb0120690 con 0x7f8eb0133900 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eb49c0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb01210e0 con 0x7f8eb00a0ee0 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eb49c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb01212e0 con 0x7f8eb0134210 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eadd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0133900 0x7f8eb011dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eae59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8eb00a0ee0 0x7f8eb011d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eadd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0133900 0x7f8eb011dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41350/0 (socket says 172.21.15.154:41350) 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eadd9b700 1 -- 172.21.15.154:0/2358013813 learned_addr learned my addr 172.21.15.154:0/2358013813 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eaed9d700 1 --2- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0134210 0x7f8eb011e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eadd9b700 1 -- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0134210 msgr2=0x7f8eb011e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eadd9b700 1 --2- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0134210 0x7f8eb011e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eadd9b700 1 -- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8eb00a0ee0 msgr2=0x7f8eb011d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eadd9b700 1 --2- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8eb00a0ee0 0x7f8eb011d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eadd9b700 1 -- 172.21.15.154:0/2358013813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0009430 con 0x7f8eb0133900 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eae59c700 1 --2- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8eb00a0ee0 0x7f8eb011d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eadd9b700 1 --2- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0133900 0x7f8eb011dd50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009c40 tx=0x7f8ea4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8e9effd700 1 -- 172.21.15.154:0/2358013813 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4004480 con 0x7f8eb0133900 2023-09-30T22:25:03.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8e9effd700 1 -- 172.21.15.154:0/2358013813 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea401f070 con 0x7f8eb0133900 2023-09-30T22:25:03.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.713+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2358013813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea4009550 con 0x7f8eb0133900 2023-09-30T22:25:03.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.714+0000 7f8e9effd700 1 -- 172.21.15.154:0/2358013813 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40038c0 con 0x7f8eb0133900 2023-09-30T22:25:03.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.714+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2358013813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb011f4c0 con 0x7f8eb0133900 2023-09-30T22:25:03.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.714+0000 7f8e9effd700 1 -- 172.21.15.154:0/2358013813 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ea4021030 con 0x7f8eb0133900 2023-09-30T22:25:03.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.715+0000 7f8e9effd700 1 -- 172.21.15.154:0/2358013813 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ea4040b20 con 0x7f8eb0133900 2023-09-30T22:25:03.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.715+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2358013813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb009a320 con 0x7f8eb0133900 2023-09-30T22:25:03.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.720+0000 7f8e9effd700 1 -- 172.21.15.154:0/2358013813 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ea4015080 con 0x7f8eb0133900 2023-09-30T22:25:03.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.777+0000 7f9bd6eda700 1 Processor -- start 2023-09-30T22:25:03.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.777+0000 7f9bd6eda700 1 -- start start 2023-09-30T22:25:03.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd6eda700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bd009e870 0x7f9bd009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd6eda700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009f180 0x7f9bd0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd6eda700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd009c970 con 0x7f9bd0131d70 2023-09-30T22:25:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd6eda700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00a0920 con 0x7f9bd009e870 2023-09-30T22:25:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd6eda700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd009f9c0 con 0x7f9bd009f180 2023-09-30T22:25:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd4c76700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bd009e870 0x7f9bd009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd4c76700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bd009e870 0x7f9bd009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41362/0 (socket says 172.21.15.154:41362) 2023-09-30T22:25:03.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd4c76700 1 -- 172.21.15.154:0/3624055554 learned_addr learned my addr 172.21.15.154:0/3624055554 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bcffff700 1 --2- 172.21.15.154:0/3624055554 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009f180 0x7f9bd0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd4c76700 1 -- 172.21.15.154:0/3624055554 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009f180 msgr2=0x7f9bd0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd4c76700 1 --2- 172.21.15.154:0/3624055554 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009f180 0x7f9bd0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd4c76700 1 -- 172.21.15.154:0/3624055554 >> v1:172.21.15.154:6789/0 conn(0x7f9bd0131d70 legacy=0x7f9bd0138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.778+0000 7f9bd4c76700 1 -- 172.21.15.154:0/3624055554 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd009bab0 con 0x7f9bd009e870 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bd4c76700 1 --2- 172.21.15.154:0/3624055554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009e870 0x7f9bd009ec40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40098f0 tx=0x7f9bc4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5b1bbbdb8a07c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bcf7fe700 1 -- 172.21.15.154:0/3624055554 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4011830 con 0x7f9bd009e870 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bcf7fe700 1 -- 172.21.15.154:0/3624055554 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc4011990 con 0x7f9bd009e870 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bcf7fe700 1 -- 172.21.15.154:0/3624055554 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4011d20 con 0x7f9bd009e870 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bd6eda700 1 -- 172.21.15.154:0/3624055554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009e870 msgr2=0x7f9bd009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bd6eda700 1 --2- 172.21.15.154:0/3624055554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009e870 0x7f9bd009ec40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40098f0 tx=0x7f9bc4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:03.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bd6eda700 1 -- 172.21.15.154:0/3624055554 shutdown_connections 2023-09-30T22:25:03.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bd6eda700 1 --2- 172.21.15.154:0/3624055554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009e870 0x7f9bd009ec40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bd6eda700 1 --2- 172.21.15.154:0/3624055554 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009f180 0x7f9bd0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.779+0000 7f9bd6eda700 1 -- 172.21.15.154:0/3624055554 >> 172.21.15.154:0/3624055554 conn(0x7f9bd00a4430 msgr2=0x7f9bd00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.780+0000 7f9bd6eda700 1 -- 172.21.15.154:0/3624055554 shutdown_connections 2023-09-30T22:25:03.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.780+0000 7f9bd6eda700 1 -- 172.21.15.154:0/3624055554 wait complete. 2023-09-30T22:25:03.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.780+0000 7f9bd6eda700 1 Processor -- start 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.780+0000 7f9bd6eda700 1 -- start start 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bd6eda700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009e870 0x7f9bd006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bd6eda700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009f180 0x7f9bd006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bd6eda700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bd0131d70 0x7f9bd006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bd6eda700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00a2d30 con 0x7f9bd009f180 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bd6eda700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd009dba0 con 0x7f9bd0131d70 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bd6eda700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0124710 con 0x7f9bd009e870 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bd4c76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009e870 0x7f9bd006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bcffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009f180 0x7f9bd006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bd4c76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009e870 0x7f9bd006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34584/0 (socket says 172.21.15.154:34584) 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.781+0000 7f9bd4c76700 1 -- 172.21.15.154:0/523196571 learned_addr learned my addr 172.21.15.154:0/523196571 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bd5477700 1 --2- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bd0131d70 0x7f9bd006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bcffff700 1 -- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009e870 msgr2=0x7f9bd006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bcffff700 1 --2- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009e870 0x7f9bd006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bcffff700 1 -- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bd0131d70 msgr2=0x7f9bd006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bcffff700 1 --2- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bd0131d70 0x7f9bd006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bcffff700 1 -- 172.21.15.154:0/523196571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4009550 con 0x7f9bd009f180 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bcffff700 1 --2- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009f180 0x7f9bd006bdf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00e900 tx=0x7f9bbc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bd4c76700 1 --2- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009e870 0x7f9bd006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:03.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bcd7fa700 1 -- 172.21.15.154:0/523196571 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00ee50 con 0x7f9bd009f180 2023-09-30T22:25:03.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bcd7fa700 1 -- 172.21.15.154:0/523196571 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc00c850 con 0x7f9bd009f180 2023-09-30T22:25:03.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bcd7fa700 1 -- 172.21.15.154:0/523196571 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00cbc0 con 0x7f9bd009f180 2023-09-30T22:25:03.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bd6eda700 1 -- 172.21.15.154:0/523196571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd0124ca0 con 0x7f9bd009f180 2023-09-30T22:25:03.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.782+0000 7f9bd6eda700 1 -- 172.21.15.154:0/523196571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd0125710 con 0x7f9bd009f180 2023-09-30T22:25:03.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.784+0000 7f9bcd7fa700 1 -- 172.21.15.154:0/523196571 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bbc00cd20 con 0x7f9bd009f180 2023-09-30T22:25:03.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.784+0000 7f9bd6eda700 1 -- 172.21.15.154:0/523196571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd011be60 con 0x7f9bd009f180 2023-09-30T22:25:03.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.784+0000 7f9bcd7fa700 1 -- 172.21.15.154:0/523196571 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9bbc03f810 con 0x7f9bd009f180 2023-09-30T22:25:03.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.793+0000 7f9bcd7fa700 1 -- 172.21.15.154:0/523196571 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bbc021080 con 0x7f9bd009f180 2023-09-30T22:25:03.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.829+0000 7fc6178e3700 1 Processor -- start 2023-09-30T22:25:03.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.829+0000 7fc6178e3700 1 -- start start 2023-09-30T22:25:03.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc6178e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc610133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc6178e3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc6100a08e0 0x7fc6100a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc6178e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a1290 0x7fc61013a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc6178e3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc610133640 con 0x7fc6100a08e0 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc6178e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100a1d50 con 0x7fc6100a1290 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc6178e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc61009b620 con 0x7fc610133a70 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc615e80700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a1290 0x7fc61013a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc615e80700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a1290 0x7fc61013a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57752/0 (socket says 172.21.15.154:57752) 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc615e80700 1 -- 172.21.15.154:0/1148461632 learned_addr learned my addr 172.21.15.154:0/1148461632 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc61567f700 1 --2- 172.21.15.154:0/1148461632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc610133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc614e7e700 1 --2- 172.21.15.154:0/1148461632 >> v2:172.21.15.154:3300/0 conn(0x7fc6100a08e0 0x7fc6100a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc61567f700 1 -- 172.21.15.154:0/1148461632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a1290 msgr2=0x7fc61013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc61567f700 1 --2- 172.21.15.154:0/1148461632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a1290 0x7fc61013a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc61567f700 1 -- 172.21.15.154:0/1148461632 >> v2:172.21.15.154:3300/0 conn(0x7fc6100a08e0 msgr2=0x7fc6100a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc61567f700 1 --2- 172.21.15.154:0/1148461632 >> v2:172.21.15.154:3300/0 conn(0x7fc6100a08e0 0x7fc6100a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc61567f700 1 -- 172.21.15.154:0/1148461632 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610133870 con 0x7fc610133a70 2023-09-30T22:25:03.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc615e80700 1 --2- 172.21.15.154:0/1148461632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a1290 0x7fc61013a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:03.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.830+0000 7fc61567f700 1 --2- 172.21.15.154:0/1148461632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc610133e40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009820 tx=0x7fc60c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4d3f6c31c8dd3a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.831+0000 7fc607fff700 1 -- 172.21.15.154:0/1148461632 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c005e30 con 0x7fc610133a70 2023-09-30T22:25:03.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.831+0000 7fc607fff700 1 -- 172.21.15.154:0/1148461632 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c006030 con 0x7fc610133a70 2023-09-30T22:25:03.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.831+0000 7fc607fff700 1 -- 172.21.15.154:0/1148461632 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c0063c0 con 0x7fc610133a70 2023-09-30T22:25:03.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.832+0000 7fc6178e3700 1 -- 172.21.15.154:0/1148461632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 msgr2=0x7fc610133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.832+0000 7fc6178e3700 1 --2- 172.21.15.154:0/1148461632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc610133e40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009820 tx=0x7fc60c009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.832+0000 7fc6178e3700 1 -- 172.21.15.154:0/1148461632 shutdown_connections 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.832+0000 7fc6178e3700 1 --2- 172.21.15.154:0/1148461632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a1290 0x7fc61013a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.832+0000 7fc6178e3700 1 --2- 172.21.15.154:0/1148461632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc610133e40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.832+0000 7fc6178e3700 1 --2- 172.21.15.154:0/1148461632 >> v2:172.21.15.154:3300/0 conn(0x7fc6100a08e0 0x7fc6100a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.832+0000 7fc6178e3700 1 -- 172.21.15.154:0/1148461632 >> 172.21.15.154:0/1148461632 conn(0x7fc6100a2980 msgr2=0x7fc6100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.832+0000 7fc6178e3700 1 -- 172.21.15.154:0/1148461632 shutdown_connections 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.832+0000 7fc6178e3700 1 -- 172.21.15.154:0/1148461632 wait complete. 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.833+0000 7fc6178e3700 1 Processor -- start 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.833+0000 7fc6178e3700 1 -- start start 2023-09-30T22:25:03.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.833+0000 7fc6178e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a08e0 0x7fc61011a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.833+0000 7fc6178e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100a1290 0x7fc61011ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.833+0000 7fc6178e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc61011b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.833+0000 7fc6178e3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61011bb70 con 0x7fc6100a1290 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.833+0000 7fc6178e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61011c2f0 con 0x7fc6100a08e0 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.833+0000 7fc6178e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc61011c910 con 0x7fc610133a70 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc61567f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a08e0 0x7fc61011a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc615e80700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc61011b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc61567f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a08e0 0x7fc61011a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57758/0 (socket says 172.21.15.154:57758) 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc61567f700 1 -- 172.21.15.154:0/4219339448 learned_addr learned my addr 172.21.15.154:0/4219339448 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc615e80700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc61011b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34610/0 (socket says 172.21.15.154:34610) 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc614e7e700 1 --2- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100a1290 0x7fc61011ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc615e80700 1 -- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a08e0 msgr2=0x7fc61011a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc615e80700 1 --2- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a08e0 0x7fc61011a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc615e80700 1 -- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100a1290 msgr2=0x7fc61011ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc615e80700 1 --2- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100a1290 0x7fc61011ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc615e80700 1 -- 172.21.15.154:0/4219339448 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608009b30 con 0x7fc610133a70 2023-09-30T22:25:03.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc615e80700 1 --2- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc61011b160 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc608009e50 tx=0x7fc60800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc605ffb700 1 -- 172.21.15.154:0/4219339448 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608018070 con 0x7fc610133a70 2023-09-30T22:25:03.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc605ffb700 1 -- 172.21.15.154:0/4219339448 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60800f040 con 0x7fc610133a70 2023-09-30T22:25:03.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc605ffb700 1 -- 172.21.15.154:0/4219339448 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608003c40 con 0x7fc610133a70 2023-09-30T22:25:03.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.834+0000 7fc6178e3700 1 -- 172.21.15.154:0/4219339448 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c009430 con 0x7fc610133a70 2023-09-30T22:25:03.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.835+0000 7fc6178e3700 1 -- 172.21.15.154:0/4219339448 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61011df80 con 0x7fc610133a70 2023-09-30T22:25:03.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.836+0000 7fc605ffb700 1 -- 172.21.15.154:0/4219339448 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc60800c880 con 0x7fc610133a70 2023-09-30T22:25:03.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.836+0000 7fc605ffb700 1 -- 172.21.15.154:0/4219339448 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc60803f840 con 0x7fc610133a70 2023-09-30T22:25:03.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.836+0000 7fc6178e3700 1 -- 172.21.15.154:0/4219339448 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61009a350 con 0x7fc610133a70 2023-09-30T22:25:03.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.840+0000 7fc605ffb700 1 -- 172.21.15.154:0/4219339448 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc608012340 con 0x7fc610133a70 2023-09-30T22:25:03.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.917+0000 7faf80a95700 1 Processor -- start 2023-09-30T22:25:03.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.917+0000 7faf80a95700 1 -- start start 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.918+0000 7faf80a95700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf7c0a1550 0x7faf7c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.918+0000 7faf80a95700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c139200 0x7faf7c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.918+0000 7faf80a95700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c09e9d0 con 0x7faf7c0a0a70 2023-09-30T22:25:03.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.918+0000 7faf80a95700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c09dc00 con 0x7faf7c0a1550 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.918+0000 7faf80a95700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c09dec0 con 0x7faf7c139200 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.918+0000 7faf7a59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faf7c0a0a70 0x7faf7c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38298/0 (socket says 172.21.15.154:38298) 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.918+0000 7faf7a59c700 1 -- 172.21.15.154:0/428641151 learned_addr learned my addr 172.21.15.154:0/428641151 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.918+0000 7faf7ad9d700 1 --2- 172.21.15.154:0/428641151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c139200 0x7faf7c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.918+0000 7faf79d9b700 1 --2- 172.21.15.154:0/428641151 >> v2:172.21.15.154:3300/0 conn(0x7faf7c0a1550 0x7faf7c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.919+0000 7faf79d9b700 1 -- 172.21.15.154:0/428641151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c139200 msgr2=0x7faf7c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.919+0000 7faf79d9b700 1 --2- 172.21.15.154:0/428641151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c139200 0x7faf7c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.919+0000 7faf79d9b700 1 -- 172.21.15.154:0/428641151 >> v1:172.21.15.154:6789/0 conn(0x7faf7c0a0a70 legacy=0x7faf7c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.919+0000 7faf79d9b700 1 -- 172.21.15.154:0/428641151 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c09e6a0 con 0x7faf7c0a1550 2023-09-30T22:25:03.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.919+0000 7faf7ad9d700 1 --2- 172.21.15.154:0/428641151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c139200 0x7faf7c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:03.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.919+0000 7faf79d9b700 1 --2- 172.21.15.154:0/428641151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c0a1550 0x7faf7c138cc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faf70009840 tx=0x7faf70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a82138939c3f0c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.919+0000 7faf7959a700 1 -- 172.21.15.154:0/428641151 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70004230 con 0x7faf7c0a1550 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.919+0000 7faf7959a700 1 -- 172.21.15.154:0/428641151 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf70004390 con 0x7faf7c0a1550 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.919+0000 7faf7959a700 1 -- 172.21.15.154:0/428641151 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf700036a0 con 0x7faf7c0a1550 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.920+0000 7faf80a95700 1 -- 172.21.15.154:0/428641151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c0a1550 msgr2=0x7faf7c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.920+0000 7faf80a95700 1 --2- 172.21.15.154:0/428641151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c0a1550 0x7faf7c138cc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faf70009840 tx=0x7faf70009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.920+0000 7faf80a95700 1 -- 172.21.15.154:0/428641151 shutdown_connections 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.920+0000 7faf80a95700 1 --2- 172.21.15.154:0/428641151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c139200 0x7faf7c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.920+0000 7faf80a95700 1 --2- 172.21.15.154:0/428641151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c0a1550 0x7faf7c138cc0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.920+0000 7faf80a95700 1 -- 172.21.15.154:0/428641151 >> 172.21.15.154:0/428641151 conn(0x7faf7c0a6610 msgr2=0x7faf7c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.920+0000 7faf80a95700 1 -- 172.21.15.154:0/428641151 shutdown_connections 2023-09-30T22:25:03.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.920+0000 7faf80a95700 1 -- 172.21.15.154:0/428641151 wait complete. 2023-09-30T22:25:03.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf80a95700 1 Processor -- start 2023-09-30T22:25:03.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf80a95700 1 -- start start 2023-09-30T22:25:03.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf80a95700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c0a0a70 0x7faf7c125820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf80a95700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf7c0a1550 0x7faf7c125d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf80a95700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c139200 0x7faf7c1cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:03.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf80a95700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c138c10 con 0x7faf7c139200 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf80a95700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c127b50 con 0x7faf7c0a0a70 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf80a95700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c125150 con 0x7faf7c0a1550 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf7a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c0a0a70 0x7faf7c125820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf7a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c0a0a70 0x7faf7c125820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57782/0 (socket says 172.21.15.154:57782) 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf7a59c700 1 -- 172.21.15.154:0/444436756 learned_addr learned my addr 172.21.15.154:0/444436756 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.922+0000 7faf7ad9d700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c139200 0x7faf7c1cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf79d9b700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf7c0a1550 0x7faf7c125d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf7a59c700 1 -- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf7c0a1550 msgr2=0x7faf7c125d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf7a59c700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf7c0a1550 0x7faf7c125d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf7a59c700 1 -- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c139200 msgr2=0x7faf7c1cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf7a59c700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c139200 0x7faf7c1cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf7a59c700 1 -- 172.21.15.154:0/444436756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf74009a70 con 0x7faf7c0a0a70 2023-09-30T22:25:03.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf7ad9d700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c139200 0x7faf7c1cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:03.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf7a59c700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c0a0a70 0x7faf7c125820 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c7b0 tx=0x7faf6c00cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:03.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf6affd700 1 -- 172.21.15.154:0/444436756 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c004c80 con 0x7faf7c0a0a70 2023-09-30T22:25:03.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf6affd700 1 -- 172.21.15.154:0/444436756 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c004de0 con 0x7faf7c0a0a70 2023-09-30T22:25:03.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf6affd700 1 -- 172.21.15.154:0/444436756 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c007310 con 0x7faf7c0a0a70 2023-09-30T22:25:03.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf80a95700 1 -- 172.21.15.154:0/444436756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf700094a0 con 0x7faf7c0a0a70 2023-09-30T22:25:03.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.923+0000 7faf80a95700 1 -- 172.21.15.154:0/444436756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c127df0 con 0x7faf7c0a0a70 2023-09-30T22:25:03.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.925+0000 7faf6affd700 1 -- 172.21.15.154:0/444436756 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf6c007470 con 0x7faf7c0a0a70 2023-09-30T22:25:03.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.925+0000 7faf6affd700 1 -- 172.21.15.154:0/444436756 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf6c03e740 con 0x7faf7c0a0a70 2023-09-30T22:25:03.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.925+0000 7faf80a95700 1 -- 172.21.15.154:0/444436756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c127df0 con 0x7faf7c0a0a70 2023-09-30T22:25:03.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.926+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2358013813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8eb011a590 con 0x7f8eb0133900 2023-09-30T22:25:03.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.927+0000 7f8e9effd700 1 -- 172.21.15.154:0/2358013813 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ea403ee60 con 0x7f8eb0133900 2023-09-30T22:25:03.927 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.929+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0133900 msgr2=0x7f8eb011dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.929+0000 7f8eb49c0700 1 --2- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0133900 0x7f8eb011dd50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009c40 tx=0x7f8ea4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.929+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2358013813 shutdown_connections 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.929+0000 7f8eb49c0700 1 --2- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8eb0134210 0x7f8eb011e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.929+0000 7f8eb49c0700 1 --2- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8eb00a0ee0 0x7f8eb011d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.929+0000 7f8eb49c0700 1 --2- 172.21.15.154:0/2358013813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8eb0133900 0x7f8eb011dd50 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.929+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2358013813 >> 172.21.15.154:0/2358013813 conn(0x7f8eb00a2980 msgr2=0x7f8eb01bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.929+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2358013813 shutdown_connections 2023-09-30T22:25:03.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.929+0000 7f8eb49c0700 1 -- 172.21.15.154:0/2358013813 wait complete. 2023-09-30T22:25:03.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:03.934+0000 7faf6affd700 1 -- 172.21.15.154:0/444436756 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf7c127df0 con 0x7faf7c0a0a70 2023-09-30T22:25:03.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:04.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.025+0000 7f9bd6eda700 1 -- 172.21.15.154:0/523196571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9bd004f2a0 con 0x7f9bd009f180 2023-09-30T22:25:04.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.025+0000 7f9bcd7fa700 1 -- 172.21.15.154:0/523196571 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bbc017020 con 0x7f9bd009f180 2023-09-30T22:25:04.025 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:04.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.027+0000 7f9bd6eda700 1 -- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009f180 msgr2=0x7f9bd006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.027+0000 7f9bd6eda700 1 --2- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009f180 0x7f9bd006bdf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00e900 tx=0x7f9bbc00ec10 comp rx=0 tx=0).stop 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.027+0000 7f9bd6eda700 1 -- 172.21.15.154:0/523196571 shutdown_connections 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.028+0000 7f9bd6eda700 1 --2- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bd0131d70 0x7f9bd006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.028+0000 7f9bd6eda700 1 --2- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bd009e870 0x7f9bd006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.028+0000 7f9bd6eda700 1 --2- 172.21.15.154:0/523196571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bd009f180 0x7f9bd006bdf0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.028+0000 7f9bd6eda700 1 -- 172.21.15.154:0/523196571 >> 172.21.15.154:0/523196571 conn(0x7f9bd00a4430 msgr2=0x7f9bd01310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.028+0000 7f9bd6eda700 1 -- 172.21.15.154:0/523196571 shutdown_connections 2023-09-30T22:25:04.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.028+0000 7f9bd6eda700 1 -- 172.21.15.154:0/523196571 wait complete. 2023-09-30T22:25:04.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:04.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.042+0000 7fc6178e3700 1 -- 172.21.15.154:0/4219339448 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc61004f2a0 con 0x7fc610133a70 2023-09-30T22:25:04.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.042+0000 7fc605ffb700 1 -- 172.21.15.154:0/4219339448 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc60801de00 con 0x7fc610133a70 2023-09-30T22:25:04.042 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:04.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.044+0000 7fc6178e3700 1 -- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 msgr2=0x7fc61011b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.044+0000 7fc6178e3700 1 --2- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc61011b160 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc608009e50 tx=0x7fc60800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.044+0000 7fc6178e3700 1 -- 172.21.15.154:0/4219339448 shutdown_connections 2023-09-30T22:25:04.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.044+0000 7fc6178e3700 1 --2- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc610133a70 0x7fc61011b160 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.044+0000 7fc6178e3700 1 --2- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100a08e0 0x7fc61011a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.044+0000 7fc6178e3700 1 --2- 172.21.15.154:0/4219339448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100a1290 0x7fc61011ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.044+0000 7fc6178e3700 1 -- 172.21.15.154:0/4219339448 >> 172.21.15.154:0/4219339448 conn(0x7fc6100a2980 msgr2=0x7fc61012f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.044+0000 7fc6178e3700 1 -- 172.21.15.154:0/4219339448 shutdown_connections 2023-09-30T22:25:04.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.044+0000 7fc6178e3700 1 -- 172.21.15.154:0/4219339448 wait complete. 2023-09-30T22:25:04.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:04.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.145+0000 7faf80a95700 1 -- 172.21.15.154:0/444436756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faf7c127df0 con 0x7faf7c0a0a70 2023-09-30T22:25:04.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.145+0000 7faf6affd700 1 -- 172.21.15.154:0/444436756 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf7c127df0 con 0x7faf7c0a0a70 2023-09-30T22:25:04.145 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.147+0000 7faf80a95700 1 -- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c0a0a70 msgr2=0x7faf7c125820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.147+0000 7faf80a95700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c0a0a70 0x7faf7c125820 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c7b0 tx=0x7faf6c00cac0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.147+0000 7faf80a95700 1 -- 172.21.15.154:0/444436756 shutdown_connections 2023-09-30T22:25:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.147+0000 7faf80a95700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf7c139200 0x7faf7c1cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.147+0000 7faf80a95700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf7c0a0a70 0x7faf7c125820 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.147+0000 7faf80a95700 1 --2- 172.21.15.154:0/444436756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf7c0a1550 0x7faf7c125d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.147+0000 7faf80a95700 1 -- 172.21.15.154:0/444436756 >> 172.21.15.154:0/444436756 conn(0x7faf7c0a6610 msgr2=0x7faf7c1be2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.147+0000 7faf80a95700 1 -- 172.21.15.154:0/444436756 shutdown_connections 2023-09-30T22:25:04.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:04.147+0000 7faf80a95700 1 -- 172.21.15.154:0/444436756 wait complete. 2023-09-30T22:25:04.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:04.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:05.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:05.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:05.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.078+0000 7f7ee46e6700 1 Processor -- start 2023-09-30T22:25:05.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee46e6700 1 -- start start 2023-09-30T22:25:05.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee46e6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc06a770 0x7f7edc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee46e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc131ec0 0x7f7edc139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee46e6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc09da80 con 0x7f7edc06b080 2023-09-30T22:25:05.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee46e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc09dce0 con 0x7f7edc131ec0 2023-09-30T22:25:05.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee46e6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc09eb20 con 0x7f7edc06a770 2023-09-30T22:25:05.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee2c83700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc131ec0 0x7f7edc139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee2482700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc06a770 0x7f7edc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee1c81700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7edc06b080 0x7f7edc1317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38300/0 (socket says 172.21.15.154:38300) 2023-09-30T22:25:05.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.079+0000 7f7ee1c81700 1 -- 172.21.15.154:0/2928485983 learned_addr learned my addr 172.21.15.154:0/2928485983 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:05.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee2c83700 1 -- 172.21.15.154:0/2928485983 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc06a770 msgr2=0x7f7edc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee2c83700 1 --2- 172.21.15.154:0/2928485983 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc06a770 0x7f7edc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee2c83700 1 -- 172.21.15.154:0/2928485983 >> v1:172.21.15.154:6789/0 conn(0x7f7edc06b080 legacy=0x7f7edc1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee2c83700 1 -- 172.21.15.154:0/2928485983 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc09d860 con 0x7f7edc131ec0 2023-09-30T22:25:05.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee1480700 1 -- 172.21.15.154:0/2928485983 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256673527 0 0) 0x7f7edc09da80 con 0x7f7edc06b080 2023-09-30T22:25:05.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee2482700 1 --2- 172.21.15.154:0/2928485983 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc06a770 0x7f7edc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee2c83700 1 --2- 172.21.15.154:0/2928485983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc131ec0 0x7f7edc139c20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009dc0 tx=0x7f7ed400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c13c28e7a46f035 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee1480700 1 -- 172.21.15.154:0/2928485983 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400e070 con 0x7f7edc131ec0 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee1480700 1 -- 172.21.15.154:0/2928485983 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400bb20 con 0x7f7edc131ec0 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.080+0000 7f7ee1480700 1 -- 172.21.15.154:0/2928485983 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4012430 con 0x7f7edc131ec0 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.081+0000 7f7ee46e6700 1 -- 172.21.15.154:0/2928485983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc131ec0 msgr2=0x7f7edc139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.081+0000 7f7ee46e6700 1 --2- 172.21.15.154:0/2928485983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc131ec0 0x7f7edc139c20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009dc0 tx=0x7f7ed400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.081+0000 7f7ee46e6700 1 -- 172.21.15.154:0/2928485983 shutdown_connections 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.081+0000 7f7ee46e6700 1 --2- 172.21.15.154:0/2928485983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc131ec0 0x7f7edc139c20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.081+0000 7f7ee46e6700 1 --2- 172.21.15.154:0/2928485983 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc06a770 0x7f7edc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.081+0000 7f7ee46e6700 1 -- 172.21.15.154:0/2928485983 >> 172.21.15.154:0/2928485983 conn(0x7f7edc099c40 msgr2=0x7f7edc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.081+0000 7f7ee46e6700 1 -- 172.21.15.154:0/2928485983 shutdown_connections 2023-09-30T22:25:05.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.081+0000 7f7ee46e6700 1 -- 172.21.15.154:0/2928485983 wait complete. 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.082+0000 7f7ee46e6700 1 Processor -- start 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.082+0000 7f7ee46e6700 1 -- start start 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.082+0000 7f7ee46e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc06a770 0x7f7edc09adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.082+0000 7f7ee46e6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7edc06b080 0x7f7edc09b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.082+0000 7f7ee46e6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc131ec0 0x7f7edc1c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.082+0000 7f7ee46e6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc1304e0 con 0x7f7edc06b080 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.082+0000 7f7ee46e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc11ffe0 con 0x7f7edc06a770 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.082+0000 7f7ee46e6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc09a920 con 0x7f7edc131ec0 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.082+0000 7f7ee2482700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc06a770 0x7f7edc09adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee2482700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc06a770 0x7f7edc09adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57796/0 (socket says 172.21.15.154:57796) 2023-09-30T22:25:05.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee2482700 1 -- 172.21.15.154:0/3615312390 learned_addr learned my addr 172.21.15.154:0/3615312390 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee1c81700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7edc06b080 0x7f7edc09b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee2c83700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc131ec0 0x7f7edc1c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee2482700 1 -- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc131ec0 msgr2=0x7f7edc1c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee2482700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc131ec0 0x7f7edc1c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee2482700 1 -- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7edc06b080 msgr2=0x7f7edc09b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee2482700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7edc06b080 0x7f7edc09b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee2482700 1 -- 172.21.15.154:0/3615312390 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80094a0 con 0x7f7edc06a770 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee1c81700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7edc06b080 0x7f7edc09b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ee2482700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc06a770 0x7f7edc09adc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800ec10 tx=0x7f7ed800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ed2ffd700 1 -- 172.21.15.154:0/3615312390 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800c910 con 0x7f7edc06a770 2023-09-30T22:25:05.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ed2ffd700 1 -- 172.21.15.154:0/3615312390 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800ca70 con 0x7f7edc06a770 2023-09-30T22:25:05.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.083+0000 7f7ed2ffd700 1 -- 172.21.15.154:0/3615312390 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800cde0 con 0x7f7edc06a770 2023-09-30T22:25:05.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.084+0000 7f7ee46e6700 1 -- 172.21.15.154:0/3615312390 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed4009a70 con 0x7f7edc06a770 2023-09-30T22:25:05.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.084+0000 7f7ee46e6700 1 -- 172.21.15.154:0/3615312390 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc071e70 con 0x7f7edc06a770 2023-09-30T22:25:05.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.085+0000 7f7ed2ffd700 1 -- 172.21.15.154:0/3615312390 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ed8013470 con 0x7f7edc06a770 2023-09-30T22:25:05.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.085+0000 7f7ed2ffd700 1 -- 172.21.15.154:0/3615312390 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ed803f930 con 0x7f7edc06a770 2023-09-30T22:25:05.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.085+0000 7f7ee46e6700 1 -- 172.21.15.154:0/3615312390 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc09e510 con 0x7f7edc06a770 2023-09-30T22:25:05.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.094+0000 7f7ed2ffd700 1 -- 172.21.15.154:0/3615312390 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ed8021080 con 0x7f7edc06a770 2023-09-30T22:25:05.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:05.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.176+0000 7f282c536700 1 Processor -- start 2023-09-30T22:25:05.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.176+0000 7f282c536700 1 -- start start 2023-09-30T22:25:05.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282c536700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282c536700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2824131f40 0x7f2824139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282c536700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282409c970 con 0x7f282409f180 2023-09-30T22:25:05.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282c536700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28240a0920 con 0x7f2824131f40 2023-09-30T22:25:05.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282c536700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282409f9c0 con 0x7f282409e870 2023-09-30T22:25:05.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282aad3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2824131f40 0x7f2824139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282a2d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282aad3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2824131f40 0x7f2824139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41414/0 (socket says 172.21.15.154:41414) 2023-09-30T22:25:05.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282a2d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57808/0 (socket says 172.21.15.154:57808) 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282aad3700 1 -- 172.21.15.154:0/313505638 learned_addr learned my addr 172.21.15.154:0/313505638 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f2829ad1700 1 --1- 172.21.15.154:0/313505638 >> v1:172.21.15.154:6789/0 conn(0x7f282409f180 0x7f2824131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38308/0 (socket says 172.21.15.154:38308) 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282aad3700 1 -- 172.21.15.154:0/313505638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 msgr2=0x7f282409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282aad3700 1 --2- 172.21.15.154:0/313505638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282aad3700 1 -- 172.21.15.154:0/313505638 >> v1:172.21.15.154:6789/0 conn(0x7f282409f180 legacy=0x7f2824131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282aad3700 1 -- 172.21.15.154:0/313505638 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282409bab0 con 0x7f2824131f40 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f28292d0700 1 -- 172.21.15.154:0/313505638 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52907052 0 0) 0x7f282409c970 con 0x7f282409f180 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282a2d2700 1 --2- 172.21.15.154:0/313505638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.177+0000 7f282aad3700 1 --2- 172.21.15.154:0/313505638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824131f40 0x7f2824139ca0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f281c009e50 tx=0x7f281c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8016bef0aa4a91f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f28292d0700 1 -- 172.21.15.154:0/313505638 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00e070 con 0x7f2824131f40 2023-09-30T22:25:05.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f28292d0700 1 -- 172.21.15.154:0/313505638 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c00b910 con 0x7f2824131f40 2023-09-30T22:25:05.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f28292d0700 1 -- 172.21.15.154:0/313505638 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00bcc0 con 0x7f2824131f40 2023-09-30T22:25:05.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f282c536700 1 -- 172.21.15.154:0/313505638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824131f40 msgr2=0x7f2824139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f282c536700 1 --2- 172.21.15.154:0/313505638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824131f40 0x7f2824139ca0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f281c009e50 tx=0x7f281c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:05.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f282c536700 1 -- 172.21.15.154:0/313505638 shutdown_connections 2023-09-30T22:25:05.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f282c536700 1 --2- 172.21.15.154:0/313505638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824131f40 0x7f2824139ca0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f282c536700 1 --2- 172.21.15.154:0/313505638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f282c536700 1 -- 172.21.15.154:0/313505638 >> 172.21.15.154:0/313505638 conn(0x7f28240a4430 msgr2=0x7f28240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f282c536700 1 -- 172.21.15.154:0/313505638 shutdown_connections 2023-09-30T22:25:05.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.178+0000 7f282c536700 1 -- 172.21.15.154:0/313505638 wait complete. 2023-09-30T22:25:05.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.179+0000 7f282c536700 1 Processor -- start 2023-09-30T22:25:05.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.179+0000 7f282c536700 1 -- start start 2023-09-30T22:25:05.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282c536700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282c536700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282409f180 0x7f282406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282c536700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824131f40 0x7f282406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282c536700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2824125530 con 0x7f2824131f40 2023-09-30T22:25:05.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282c536700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2824131660 con 0x7f282409e870 2023-09-30T22:25:05.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282c536700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282406cca0 con 0x7f282409f180 2023-09-30T22:25:05.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282a2d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f2829ad1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282409f180 0x7f282406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282a2d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:57822/0 (socket says 172.21.15.154:57822) 2023-09-30T22:25:05.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282a2d2700 1 -- 172.21.15.154:0/1692389482 learned_addr learned my addr 172.21.15.154:0/1692389482 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:05.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282aad3700 1 --2- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824131f40 0x7f282406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f2829ad1700 1 -- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 msgr2=0x7f282406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f2829ad1700 1 --2- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f2829ad1700 1 -- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824131f40 msgr2=0x7f282406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f2829ad1700 1 --2- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824131f40 0x7f282406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f2829ad1700 1 -- 172.21.15.154:0/1692389482 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28200094a0 con 0x7f282409f180 2023-09-30T22:25:05.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f282a2d2700 1 --2- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.180+0000 7f2829ad1700 1 --2- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282409f180 0x7f282406bdf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f281400c470 tx=0x7f281400c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.181+0000 7f281affd700 1 -- 172.21.15.154:0/1692389482 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814004c80 con 0x7f282409f180 2023-09-30T22:25:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.181+0000 7f281affd700 1 -- 172.21.15.154:0/1692389482 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2814004de0 con 0x7f282409f180 2023-09-30T22:25:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.181+0000 7f281affd700 1 -- 172.21.15.154:0/1692389482 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814007310 con 0x7f282409f180 2023-09-30T22:25:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.181+0000 7f282c536700 1 -- 172.21.15.154:0/1692389482 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c009b30 con 0x7f282409f180 2023-09-30T22:25:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.181+0000 7f282c536700 1 -- 172.21.15.154:0/1692389482 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2824125790 con 0x7f282409f180 2023-09-30T22:25:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.182+0000 7f282c536700 1 -- 172.21.15.154:0/1692389482 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282404f2a0 con 0x7f282409f180 2023-09-30T22:25:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.182+0000 7f281affd700 1 -- 172.21.15.154:0/1692389482 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2814007470 con 0x7f282409f180 2023-09-30T22:25:05.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.182+0000 7f281affd700 1 -- 172.21.15.154:0/1692389482 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f281403f800 con 0x7f282409f180 2023-09-30T22:25:05.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.191+0000 7f281affd700 1 -- 172.21.15.154:0/1692389482 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2814007720 con 0x7f282409f180 2023-09-30T22:25:05.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.206+0000 7f5c3ca60700 1 Processor -- start 2023-09-30T22:25:05.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.206+0000 7f5c3ca60700 1 -- start start 2023-09-30T22:25:05.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3ca60700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3ca60700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 0x7f5c38131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3ca60700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3809c970 con 0x7f5c38131d70 2023-09-30T22:25:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3ca60700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c380a0920 con 0x7f5c3809f180 2023-09-30T22:25:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3ca60700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3809f9c0 con 0x7f5c3809e870 2023-09-30T22:25:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34662/0 (socket says 172.21.15.154:34662) 2023-09-30T22:25:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3659c700 1 -- 172.21.15.154:0/1338562459 learned_addr learned my addr 172.21.15.154:0/1338562459 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c35d9b700 1 --2- 172.21.15.154:0/1338562459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 0x7f5c38131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3659c700 1 -- 172.21.15.154:0/1338562459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 msgr2=0x7f5c38131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3559a700 1 -- 172.21.15.154:0/1338562459 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146735713 0 0) 0x7f5c3809c970 con 0x7f5c38131d70 2023-09-30T22:25:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3659c700 1 --2- 172.21.15.154:0/1338562459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 0x7f5c38131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3659c700 1 -- 172.21.15.154:0/1338562459 >> v1:172.21.15.154:6789/0 conn(0x7f5c38131d70 legacy=0x7f5c38138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c3659c700 1 -- 172.21.15.154:0/1338562459 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3809bab0 con 0x7f5c3809e870 2023-09-30T22:25:05.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.207+0000 7f5c35d9b700 1 --2- 172.21.15.154:0/1338562459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 0x7f5c38131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.208+0000 7f5c3659c700 1 --2- 172.21.15.154:0/1338562459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3809ec40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009920 tx=0x7f5c28009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d132cc4477398060 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.208+0000 7f5c3559a700 1 -- 172.21.15.154:0/1338562459 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28011830 con 0x7f5c3809e870 2023-09-30T22:25:05.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.208+0000 7f5c3559a700 1 -- 172.21.15.154:0/1338562459 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c28011990 con 0x7f5c3809e870 2023-09-30T22:25:05.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.208+0000 7f5c3559a700 1 -- 172.21.15.154:0/1338562459 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28011d20 con 0x7f5c3809e870 2023-09-30T22:25:05.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.209+0000 7f5c3ca60700 1 -- 172.21.15.154:0/1338562459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 msgr2=0x7f5c3809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.209+0000 7f5c3ca60700 1 --2- 172.21.15.154:0/1338562459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3809ec40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009920 tx=0x7f5c28009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:05.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.209+0000 7f5c3ca60700 1 -- 172.21.15.154:0/1338562459 shutdown_connections 2023-09-30T22:25:05.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.209+0000 7f5c3ca60700 1 --2- 172.21.15.154:0/1338562459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3809ec40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.209+0000 7f5c3ca60700 1 --2- 172.21.15.154:0/1338562459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 0x7f5c38131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.209+0000 7f5c3ca60700 1 -- 172.21.15.154:0/1338562459 >> 172.21.15.154:0/1338562459 conn(0x7f5c380a4430 msgr2=0x7f5c380a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.209+0000 7f5c3ca60700 1 -- 172.21.15.154:0/1338562459 shutdown_connections 2023-09-30T22:25:05.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.209+0000 7f5c3ca60700 1 -- 172.21.15.154:0/1338562459 wait complete. 2023-09-30T22:25:05.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.210+0000 7f5c3ca60700 1 Processor -- start 2023-09-30T22:25:05.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.210+0000 7f5c3ca60700 1 -- start start 2023-09-30T22:25:05.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.210+0000 7f5c3ca60700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3811f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.210+0000 7f5c3ca60700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 0x7f5c3811f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.210+0000 7f5c3ca60700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c38131d70 0x7f5c3811fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.210+0000 7f5c3ca60700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38121cd0 con 0x7f5c38131d70 2023-09-30T22:25:05.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.210+0000 7f5c3ca60700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38122d10 con 0x7f5c3809f180 2023-09-30T22:25:05.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.210+0000 7f5c3ca60700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38122800 con 0x7f5c3809e870 2023-09-30T22:25:05.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.210+0000 7f5c3659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3811f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3811f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34670/0 (socket says 172.21.15.154:34670) 2023-09-30T22:25:05.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3659c700 1 -- 172.21.15.154:0/3960077937 learned_addr learned my addr 172.21.15.154:0/3960077937 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:05.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c36d9d700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c38131d70 0x7f5c3811fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c35d9b700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 0x7f5c3811f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3659c700 1 -- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 msgr2=0x7f5c3811f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3659c700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 0x7f5c3811f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3659c700 1 -- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c38131d70 msgr2=0x7f5c3811fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3659c700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c38131d70 0x7f5c3811fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3659c700 1 -- 172.21.15.154:0/3960077937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0094a0 con 0x7f5c3809e870 2023-09-30T22:25:05.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c36d9d700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c38131d70 0x7f5c3811fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3659c700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3811f240 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5c28000c00 tx=0x7f5c28004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c26ffd700 1 -- 172.21.15.154:0/3960077937 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28004450 con 0x7f5c3809e870 2023-09-30T22:25:05.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c26ffd700 1 -- 172.21.15.154:0/3960077937 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2801e070 con 0x7f5c3809e870 2023-09-30T22:25:05.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3ca60700 1 -- 172.21.15.154:0/3960077937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c28009550 con 0x7f5c3809e870 2023-09-30T22:25:05.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c26ffd700 1 -- 172.21.15.154:0/3960077937 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c280038e0 con 0x7f5c3809e870 2023-09-30T22:25:05.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.211+0000 7f5c3ca60700 1 -- 172.21.15.154:0/3960077937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c381224f0 con 0x7f5c3809e870 2023-09-30T22:25:05.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.212+0000 7f5c3ca60700 1 -- 172.21.15.154:0/3960077937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c381220e0 con 0x7f5c3809e870 2023-09-30T22:25:05.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.212+0000 7f5c26ffd700 1 -- 172.21.15.154:0/3960077937 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c28003a40 con 0x7f5c3809e870 2023-09-30T22:25:05.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.212+0000 7f5c26ffd700 1 -- 172.21.15.154:0/3960077937 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c28040590 con 0x7f5c3809e870 2023-09-30T22:25:05.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.217+0000 7f5c26ffd700 1 -- 172.21.15.154:0/3960077937 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c28003cf0 con 0x7f5c3809e870 2023-09-30T22:25:05.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.301+0000 7f7ee46e6700 1 -- 172.21.15.154:0/3615312390 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7edc1212a0 con 0x7f7edc06a770 2023-09-30T22:25:05.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.301+0000 7f7ed2ffd700 1 -- 172.21.15.154:0/3615312390 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7edc1212a0 con 0x7f7edc06a770 2023-09-30T22:25:05.301 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.303+0000 7f7ee46e6700 1 -- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc06a770 msgr2=0x7f7edc09adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.303+0000 7f7ee46e6700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc06a770 0x7f7edc09adc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800ec10 tx=0x7f7ed800ef20 comp rx=0 tx=0).stop 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.303+0000 7f7ee46e6700 1 -- 172.21.15.154:0/3615312390 shutdown_connections 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.303+0000 7f7ee46e6700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7edc131ec0 0x7f7edc1c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.303+0000 7f7ee46e6700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7edc06a770 0x7f7edc09adc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.303+0000 7f7ee46e6700 1 --2- 172.21.15.154:0/3615312390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7edc06b080 0x7f7edc09b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.304+0000 7f7ee46e6700 1 -- 172.21.15.154:0/3615312390 >> 172.21.15.154:0/3615312390 conn(0x7f7edc099c40 msgr2=0x7f7edc1b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.307+0000 7f7ee46e6700 1 -- 172.21.15.154:0/3615312390 shutdown_connections 2023-09-30T22:25:05.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.307+0000 7f7ee46e6700 1 -- 172.21.15.154:0/3615312390 wait complete. 2023-09-30T22:25:05.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:05.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.382+0000 7fb6eb116700 1 Processor -- start 2023-09-30T22:25:05.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.382+0000 7fb6eb116700 1 -- start start 2023-09-30T22:25:05.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.382+0000 7fb6eb116700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e406a770 0x7fb6e406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.382+0000 7fb6eb116700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6e409dec0 0x7fb6e406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.382+0000 7fb6eb116700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e4131a00 0x7fb6e4131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.382+0000 7fb6eb116700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e406b5c0 con 0x7fb6e409dec0 2023-09-30T22:25:05.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.382+0000 7fb6eb116700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e406e900 con 0x7fb6e406a770 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.382+0000 7fb6eb116700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e409d180 con 0x7fb6e4131a00 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6e409dec0 0x7fb6e406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6e409dec0 0x7fb6e406b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38138/0 (socket says 172.21.15.154:38138) 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e3fff700 1 -- 172.21.15.154:0/29894910 learned_addr learned my addr 172.21.15.154:0/29894910 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e8eb2700 1 --2- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e406a770 0x7fb6e406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e96b3700 1 --2- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e4131a00 0x7fb6e4131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e96b3700 1 -- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e406a770 msgr2=0x7fb6e406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e96b3700 1 --2- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e406a770 0x7fb6e406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e96b3700 1 -- 172.21.15.154:0/29894910 >> v2:172.21.15.154:3300/0 conn(0x7fb6e409dec0 msgr2=0x7fb6e406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:05.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e96b3700 1 --2- 172.21.15.154:0/29894910 >> v2:172.21.15.154:3300/0 conn(0x7fb6e409dec0 0x7fb6e406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e96b3700 1 -- 172.21.15.154:0/29894910 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e409e780 con 0x7fb6e4131a00 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e8eb2700 1 --2- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e406a770 0x7fb6e406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e3fff700 1 --2- 172.21.15.154:0/29894910 >> v2:172.21.15.154:3300/0 conn(0x7fb6e409dec0 0x7fb6e406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e96b3700 1 --2- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e4131a00 0x7fb6e4131e60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc009d90 tx=0x7fb6dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dffe2c25d01d69e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e37fe700 1 -- 172.21.15.154:0/29894910 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00e070 con 0x7fb6e4131a00 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e37fe700 1 -- 172.21.15.154:0/29894910 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc00bb20 con 0x7fb6e4131a00 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.383+0000 7fb6e37fe700 1 -- 172.21.15.154:0/29894910 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc012430 con 0x7fb6e4131a00 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.384+0000 7fb6eb116700 1 -- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e4131a00 msgr2=0x7fb6e4131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.384+0000 7fb6eb116700 1 --2- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e4131a00 0x7fb6e4131e60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc009d90 tx=0x7fb6dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:05.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.384+0000 7fb6eb116700 1 -- 172.21.15.154:0/29894910 shutdown_connections 2023-09-30T22:25:05.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.384+0000 7fb6eb116700 1 --2- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e406a770 0x7fb6e406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.384+0000 7fb6eb116700 1 --2- 172.21.15.154:0/29894910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e4131a00 0x7fb6e4131e60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.384+0000 7fb6eb116700 1 --2- 172.21.15.154:0/29894910 >> v2:172.21.15.154:3300/0 conn(0x7fb6e409dec0 0x7fb6e406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.384+0000 7fb6eb116700 1 -- 172.21.15.154:0/29894910 >> 172.21.15.154:0/29894910 conn(0x7fb6e4099c40 msgr2=0x7fb6e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.384+0000 7fb6eb116700 1 -- 172.21.15.154:0/29894910 shutdown_connections 2023-09-30T22:25:05.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.384+0000 7fb6eb116700 1 -- 172.21.15.154:0/29894910 wait complete. 2023-09-30T22:25:05.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.385+0000 7fb6eb116700 1 Processor -- start 2023-09-30T22:25:05.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.385+0000 7fb6eb116700 1 -- start start 2023-09-30T22:25:05.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6eb116700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e406a770 0x7fb6e4119dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6eb116700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e409dec0 0x7fb6e411a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6eb116700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e4131a00 0x7fb6e411a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:05.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6eb116700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e411e2b0 con 0x7fb6e406a770 2023-09-30T22:25:05.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6eb116700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e411d8f0 con 0x7fb6e4131a00 2023-09-30T22:25:05.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6eb116700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e411ccc0 con 0x7fb6e409dec0 2023-09-30T22:25:05.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e8eb2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e406a770 0x7fb6e4119dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e8eb2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e406a770 0x7fb6e4119dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38148/0 (socket says 172.21.15.154:38148) 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e8eb2700 1 -- 172.21.15.154:0/2457397876 learned_addr learned my addr 172.21.15.154:0/2457397876 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e96b3700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e4131a00 0x7fb6e411a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e3fff700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e409dec0 0x7fb6e411a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e8eb2700 1 -- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e409dec0 msgr2=0x7fb6e411a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e8eb2700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e409dec0 0x7fb6e411a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e8eb2700 1 -- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e4131a00 msgr2=0x7fb6e411a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e8eb2700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e4131a00 0x7fb6e411a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.386+0000 7fb6e8eb2700 1 -- 172.21.15.154:0/2457397876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d80094a0 con 0x7fb6e406a770 2023-09-30T22:25:05.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.387+0000 7fb6e96b3700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e4131a00 0x7fb6e411a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.387+0000 7fb6e8eb2700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e406a770 0x7fb6e4119dd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800ebe0 tx=0x7fb6d800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.387+0000 7fb6e17fa700 1 -- 172.21.15.154:0/2457397876 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8009780 con 0x7fb6e406a770 2023-09-30T22:25:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.387+0000 7fb6e17fa700 1 -- 172.21.15.154:0/2457397876 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d800c850 con 0x7fb6e406a770 2023-09-30T22:25:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.387+0000 7fb6eb116700 1 -- 172.21.15.154:0/2457397876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d0009550 con 0x7fb6e406a770 2023-09-30T22:25:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.387+0000 7fb6e17fa700 1 -- 172.21.15.154:0/2457397876 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800cbe0 con 0x7fb6e406a770 2023-09-30T22:25:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.387+0000 7fb6eb116700 1 -- 172.21.15.154:0/2457397876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc009a70 con 0x7fb6e406a770 2023-09-30T22:25:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.388+0000 7fb6e17fa700 1 -- 172.21.15.154:0/2457397876 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6d800cd40 con 0x7fb6e406a770 2023-09-30T22:25:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.388+0000 7fb6e17fa700 1 -- 172.21.15.154:0/2457397876 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb6d803f7f0 con 0x7fb6e406a770 2023-09-30T22:25:05.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.388+0000 7fb6eb116700 1 -- 172.21.15.154:0/2457397876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e411c070 con 0x7fb6e406a770 2023-09-30T22:25:05.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.391+0000 7f282c536700 1 -- 172.21.15.154:0/1692389482 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f282406b2a0 con 0x7f282409f180 2023-09-30T22:25:05.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.391+0000 7f281affd700 1 -- 172.21.15.154:0/1692389482 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f281401ce90 con 0x7f282409f180 2023-09-30T22:25:05.393 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:05.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.393+0000 7fb6e17fa700 1 -- 172.21.15.154:0/2457397876 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6d80232f0 con 0x7fb6e406a770 2023-09-30T22:25:05.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.393+0000 7f282c536700 1 -- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282409f180 msgr2=0x7f282406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.393+0000 7f282c536700 1 --2- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282409f180 0x7f282406bdf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f281400c470 tx=0x7f281400c780 comp rx=0 tx=0).stop 2023-09-30T22:25:05.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.393+0000 7f282c536700 1 -- 172.21.15.154:0/1692389482 shutdown_connections 2023-09-30T22:25:05.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.393+0000 7f282c536700 1 --2- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2824131f40 0x7f282406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.393+0000 7f282c536700 1 --2- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282409e870 0x7f282406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.393+0000 7f282c536700 1 --2- 172.21.15.154:0/1692389482 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282409f180 0x7f282406bdf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.393+0000 7f282c536700 1 -- 172.21.15.154:0/1692389482 >> 172.21.15.154:0/1692389482 conn(0x7f28240a4430 msgr2=0x7f2824072210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.394+0000 7f282c536700 1 -- 172.21.15.154:0/1692389482 shutdown_connections 2023-09-30T22:25:05.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.394+0000 7f282c536700 1 -- 172.21.15.154:0/1692389482 wait complete. 2023-09-30T22:25:05.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:05.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.417+0000 7f5c3ca60700 1 -- 172.21.15.154:0/3960077937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c3804f2a0 con 0x7f5c3809e870 2023-09-30T22:25:05.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.417+0000 7f5c26ffd700 1 -- 172.21.15.154:0/3960077937 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c28015020 con 0x7f5c3809e870 2023-09-30T22:25:05.418 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.420+0000 7f5c3ca60700 1 -- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 msgr2=0x7f5c3811f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.420+0000 7f5c3ca60700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3811f240 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5c28000c00 tx=0x7f5c28004750 comp rx=0 tx=0).stop 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.420+0000 7f5c3ca60700 1 -- 172.21.15.154:0/3960077937 shutdown_connections 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.420+0000 7f5c3ca60700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c38131d70 0x7f5c3811fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.420+0000 7f5c3ca60700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c3809e870 0x7f5c3811f240 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.420+0000 7f5c3ca60700 1 --2- 172.21.15.154:0/3960077937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c3809f180 0x7f5c3811f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.420+0000 7f5c3ca60700 1 -- 172.21.15.154:0/3960077937 >> 172.21.15.154:0/3960077937 conn(0x7f5c380a4430 msgr2=0x7f5c38071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.420+0000 7f5c3ca60700 1 -- 172.21.15.154:0/3960077937 shutdown_connections 2023-09-30T22:25:05.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.420+0000 7f5c3ca60700 1 -- 172.21.15.154:0/3960077937 wait complete. 2023-09-30T22:25:05.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:05.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.579+0000 7fb6eb116700 1 -- 172.21.15.154:0/2457397876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6e411d490 con 0x7fb6e406a770 2023-09-30T22:25:05.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.579+0000 7fb6e17fa700 1 -- 172.21.15.154:0/2457397876 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6e411d490 con 0x7fb6e406a770 2023-09-30T22:25:05.579 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:05.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.581+0000 7fb6eb116700 1 -- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e406a770 msgr2=0x7fb6e4119dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:05.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.581+0000 7fb6eb116700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e406a770 0x7fb6e4119dd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800ebe0 tx=0x7fb6d800eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.581+0000 7fb6eb116700 1 -- 172.21.15.154:0/2457397876 shutdown_connections 2023-09-30T22:25:05.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.581+0000 7fb6eb116700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6e4131a00 0x7fb6e411a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.581+0000 7fb6eb116700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6e406a770 0x7fb6e4119dd0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.581+0000 7fb6eb116700 1 --2- 172.21.15.154:0/2457397876 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6e409dec0 0x7fb6e411a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:05.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.581+0000 7fb6eb116700 1 -- 172.21.15.154:0/2457397876 >> 172.21.15.154:0/2457397876 conn(0x7fb6e4099c40 msgr2=0x7fb6e412edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:05.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.581+0000 7fb6eb116700 1 -- 172.21.15.154:0/2457397876 shutdown_connections 2023-09-30T22:25:05.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:05.581+0000 7fb6eb116700 1 -- 172.21.15.154:0/2457397876 wait complete. 2023-09-30T22:25:05.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:06.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:06.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:06.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.452+0000 7f3b03d7b700 1 Processor -- start 2023-09-30T22:25:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.452+0000 7f3b03d7b700 1 -- start start 2023-09-30T22:25:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.452+0000 7f3b03d7b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc09ad40 0x7f3afc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.452+0000 7f3b03d7b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc133f70 0x7f3afc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.452+0000 7f3b03d7b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3afc0a0a70 0x7f3afc0a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.452+0000 7f3b03d7b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc0a3b60 con 0x7f3afc0a0a70 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.452+0000 7f3b03d7b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1348e0 con 0x7f3afc09ad40 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.452+0000 7f3b03d7b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc09b110 con 0x7f3afc133f70 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b01b17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc09ad40 0x7f3afc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b01b17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc09ad40 0x7f3afc133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60854/0 (socket says 172.21.15.154:60854) 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b02318700 1 --2- 172.21.15.154:0/2902532228 >> v2:172.21.15.154:3300/0 conn(0x7f3afc0a0a70 0x7f3afc0a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b01b17700 1 -- 172.21.15.154:0/2902532228 learned_addr learned my addr 172.21.15.154:0/2902532228 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b01316700 1 --2- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc133f70 0x7f3afc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b02318700 1 -- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc133f70 msgr2=0x7f3afc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b02318700 1 --2- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc133f70 0x7f3afc1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b02318700 1 -- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc09ad40 msgr2=0x7f3afc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b02318700 1 --2- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc09ad40 0x7f3afc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b02318700 1 -- 172.21.15.154:0/2902532228 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0a2fa0 con 0x7f3afc0a0a70 2023-09-30T22:25:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b01b17700 1 --2- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc09ad40 0x7f3afc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b02318700 1 --2- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0a0a70 0x7f3afc0a0ef0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009dc0 tx=0x7f3af400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5170378e76df54d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b00b15700 1 -- 172.21.15.154:0/2902532228 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af400e070 con 0x7f3afc0a0a70 2023-09-30T22:25:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b00b15700 1 -- 172.21.15.154:0/2902532228 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af400bae0 con 0x7f3afc0a0a70 2023-09-30T22:25:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.453+0000 7f3b00b15700 1 -- 172.21.15.154:0/2902532228 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af400be90 con 0x7f3afc0a0a70 2023-09-30T22:25:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.454+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0a0a70 msgr2=0x7f3afc0a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.454+0000 7f3b03d7b700 1 --2- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0a0a70 0x7f3afc0a0ef0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009dc0 tx=0x7f3af400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.454+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2902532228 shutdown_connections 2023-09-30T22:25:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.454+0000 7f3b03d7b700 1 --2- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc09ad40 0x7f3afc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.454+0000 7f3b03d7b700 1 --2- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0a0a70 0x7f3afc0a0ef0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.454+0000 7f3b03d7b700 1 --2- 172.21.15.154:0/2902532228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc133f70 0x7f3afc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.454+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2902532228 >> 172.21.15.154:0/2902532228 conn(0x7f3afc099c40 msgr2=0x7f3afc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.454+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2902532228 shutdown_connections 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.454+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2902532228 wait complete. 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.455+0000 7f3b03d7b700 1 Processor -- start 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b03d7b700 1 -- start start 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b03d7b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc09ad40 0x7f3afc11d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b03d7b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc0a0a70 0x7f3afc11de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b03d7b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc133f70 0x7f3afc1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b03d7b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc120410 con 0x7f3afc09ad40 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b03d7b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc132a90 con 0x7f3afc133f70 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b03d7b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc130830 con 0x7f3afc0a0a70 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b01316700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc0a0a70 0x7f3afc11de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b01316700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc0a0a70 0x7f3afc11de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48836/0 (socket says 172.21.15.154:48836) 2023-09-30T22:25:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b01316700 1 -- 172.21.15.154:0/2212274072 learned_addr learned my addr 172.21.15.154:0/2212274072 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.456+0000 7f3b02318700 1 --2- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc133f70 0x7f3afc1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3b01316700 1 -- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc133f70 msgr2=0x7f3afc1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3b01316700 1 --2- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc133f70 0x7f3afc1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3b01316700 1 -- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc09ad40 msgr2=0x7f3afc11d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3b01316700 1 --2- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc09ad40 0x7f3afc11d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3b01316700 1 -- 172.21.15.154:0/2212274072 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009550 con 0x7f3afc0a0a70 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3b02318700 1 --2- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc133f70 0x7f3afc1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3b01316700 1 --2- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc0a0a70 0x7f3afc11de00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e980 tx=0x7f3aec00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3af27fc700 1 -- 172.21.15.154:0/2212274072 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec009710 con 0x7f3afc0a0a70 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3af27fc700 1 -- 172.21.15.154:0/2212274072 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec00eed0 con 0x7f3afc0a0a70 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2212274072 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af4009a70 con 0x7f3afc0a0a70 2023-09-30T22:25:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2212274072 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc11e340 con 0x7f3afc0a0a70 2023-09-30T22:25:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.457+0000 7f3af27fc700 1 -- 172.21.15.154:0/2212274072 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00ca10 con 0x7f3afc0a0a70 2023-09-30T22:25:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.458+0000 7f3af27fc700 1 -- 172.21.15.154:0/2212274072 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3aec00cbf0 con 0x7f3afc0a0a70 2023-09-30T22:25:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.458+0000 7f3af27fc700 1 -- 172.21.15.154:0/2212274072 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3aec03f7e0 con 0x7f3afc0a0a70 2023-09-30T22:25:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.459+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2212274072 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae40052e0 con 0x7f3afc0a0a70 2023-09-30T22:25:06.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.464+0000 7f3af27fc700 1 -- 172.21.15.154:0/2212274072 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3aec017080 con 0x7f3afc0a0a70 2023-09-30T22:25:06.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.545+0000 7ff5ccfd1700 1 Processor -- start 2023-09-30T22:25:06.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.545+0000 7ff5ccfd1700 1 -- start start 2023-09-30T22:25:06.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5ccfd1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809e950 0x7ff5c809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5ccfd1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809f260 0x7ff5c8137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5ccfd1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5c81381e0 0x7ff5c813a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5ccfd1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c80a06c0 con 0x7ff5c81381e0 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5ccfd1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c809ae90 con 0x7ff5c809f260 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5ccfd1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c809ac20 con 0x7ff5c809e950 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809e950 0x7ff5c809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809e950 0x7ff5c809ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48848/0 (socket says 172.21.15.154:48848) 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809f260 0x7ff5c8137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c659c700 1 -- 172.21.15.154:0/3425843911 learned_addr learned my addr 172.21.15.154:0/3425843911 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:06.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c6d9d700 1 --2- 172.21.15.154:0/3425843911 >> v2:172.21.15.154:3300/0 conn(0x7ff5c81381e0 0x7ff5c813a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c5d9b700 1 -- 172.21.15.154:0/3425843911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809e950 msgr2=0x7ff5c809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c5d9b700 1 --2- 172.21.15.154:0/3425843911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809e950 0x7ff5c809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c5d9b700 1 -- 172.21.15.154:0/3425843911 >> v2:172.21.15.154:3300/0 conn(0x7ff5c81381e0 msgr2=0x7ff5c813a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c5d9b700 1 --2- 172.21.15.154:0/3425843911 >> v2:172.21.15.154:3300/0 conn(0x7ff5c81381e0 0x7ff5c813a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c5d9b700 1 -- 172.21.15.154:0/3425843911 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c806ba00 con 0x7ff5c809f260 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c659c700 1 --2- 172.21.15.154:0/3425843911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809e950 0x7ff5c809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c6d9d700 1 --2- 172.21.15.154:0/3425843911 >> v2:172.21.15.154:3300/0 conn(0x7ff5c81381e0 0x7ff5c813a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.546+0000 7ff5c5d9b700 1 --2- 172.21.15.154:0/3425843911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809f260 0x7ff5c8137ca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009870 tx=0x7ff5bc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63b060ac129d63c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.547+0000 7ff5c559a700 1 -- 172.21.15.154:0/3425843911 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc011830 con 0x7ff5c809f260 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.547+0000 7ff5c559a700 1 -- 172.21.15.154:0/3425843911 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc011990 con 0x7ff5c809f260 2023-09-30T22:25:06.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.547+0000 7ff5c559a700 1 -- 172.21.15.154:0/3425843911 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc011d20 con 0x7ff5c809f260 2023-09-30T22:25:06.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.547+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/3425843911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809f260 msgr2=0x7ff5c8137ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.547+0000 7ff5ccfd1700 1 --2- 172.21.15.154:0/3425843911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809f260 0x7ff5c8137ca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009870 tx=0x7ff5bc009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:06.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.548+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/3425843911 shutdown_connections 2023-09-30T22:25:06.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.548+0000 7ff5ccfd1700 1 --2- 172.21.15.154:0/3425843911 >> v2:172.21.15.154:3300/0 conn(0x7ff5c81381e0 0x7ff5c813a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.548+0000 7ff5ccfd1700 1 --2- 172.21.15.154:0/3425843911 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809e950 0x7ff5c809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.548+0000 7ff5ccfd1700 1 --2- 172.21.15.154:0/3425843911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809f260 0x7ff5c8137ca0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.548+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/3425843911 >> 172.21.15.154:0/3425843911 conn(0x7ff5c80a0f70 msgr2=0x7ff5c80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.548+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/3425843911 shutdown_connections 2023-09-30T22:25:06.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.548+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/3425843911 wait complete. 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.549+0000 7ff5ccfd1700 1 Processor -- start 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.549+0000 7ff5ccfd1700 1 -- start start 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5ccfd1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809e950 0x7ff5c8122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5ccfd1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809f260 0x7ff5c8123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5ccfd1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5c81381e0 0x7ff5c81236c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5ccfd1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8124de0 con 0x7ff5c81381e0 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5ccfd1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c80a0890 con 0x7ff5c809e950 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5ccfd1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8124940 con 0x7ff5c809f260 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809e950 0x7ff5c8122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809f260 0x7ff5c8123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809e950 0x7ff5c8122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60884/0 (socket says 172.21.15.154:60884) 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5c81381e0 0x7ff5c81236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c659c700 1 -- 172.21.15.154:0/1299215827 learned_addr learned my addr 172.21.15.154:0/1299215827 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c659c700 1 -- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809f260 msgr2=0x7ff5c8123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c659c700 1 --2- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809f260 0x7ff5c8123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c659c700 1 -- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5c81381e0 msgr2=0x7ff5c81236c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c659c700 1 --2- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5c81381e0 0x7ff5c81236c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c659c700 1 -- 172.21.15.154:0/1299215827 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8009500 con 0x7ff5c809e950 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c5d9b700 1 --2- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809f260 0x7ff5c8123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.550+0000 7ff5c6d9d700 1 --2- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5c81381e0 0x7ff5c81236c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.551+0000 7ff5c659c700 1 --2- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809e950 0x7ff5c8122c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800ebe0 tx=0x7ff5b800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.551+0000 7ff5b6ffd700 1 -- 172.21.15.154:0/1299215827 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8005a20 con 0x7ff5c809e950 2023-09-30T22:25:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.551+0000 7ff5b6ffd700 1 -- 172.21.15.154:0/1299215827 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b8005b80 con 0x7ff5c809e950 2023-09-30T22:25:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.551+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/1299215827 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c0009a70 con 0x7ff5c809e950 2023-09-30T22:25:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.551+0000 7ff5b6ffd700 1 -- 172.21.15.154:0/1299215827 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800c850 con 0x7ff5c809e950 2023-09-30T22:25:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.551+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/1299215827 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc0094a0 con 0x7ff5c809e950 2023-09-30T22:25:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.552+0000 7ff5b6ffd700 1 -- 172.21.15.154:0/1299215827 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5b800c9b0 con 0x7ff5c809e950 2023-09-30T22:25:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.552+0000 7ff5b6ffd700 1 -- 172.21.15.154:0/1299215827 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff5b803f9b0 con 0x7ff5c809e950 2023-09-30T22:25:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.552+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/1299215827 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c8074f10 con 0x7ff5c809e950 2023-09-30T22:25:06.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.557+0000 7ff5b6ffd700 1 -- 172.21.15.154:0/1299215827 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5b8022300 con 0x7ff5c809e950 2023-09-30T22:25:06.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:06.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.602+0000 7f9986940700 1 Processor -- start 2023-09-30T22:25:06.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.603+0000 7f9986940700 1 -- start start 2023-09-30T22:25:06.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.603+0000 7f9986940700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009e340 0x7f99801359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.603+0000 7f9986940700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9980135f20 0x7f9980138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.603+0000 7f9986940700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998009aaa0 con 0x7f998009d860 2023-09-30T22:25:06.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.603+0000 7f9986940700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998009e730 con 0x7f9980135f20 2023-09-30T22:25:06.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.603+0000 7f9986940700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998009f870 con 0x7f998009e340 2023-09-30T22:25:06.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.603+0000 7f997f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009e340 0x7f99801359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f998009d860 0x7f998009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47186/0 (socket says 172.21.15.154:47186) 2023-09-30T22:25:06.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997ffff700 1 -- 172.21.15.154:0/731301397 learned_addr learned my addr 172.21.15.154:0/731301397 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:06.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f9984edd700 1 --2- 172.21.15.154:0/731301397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9980135f20 0x7f9980138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997effd700 1 -- 172.21.15.154:0/731301397 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555317552 0 0) 0x7f998009aaa0 con 0x7f998009d860 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997effd700 1 -- 172.21.15.154:0/731301397 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99680035b0 con 0x7f998009d860 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997f7fe700 1 -- 172.21.15.154:0/731301397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9980135f20 msgr2=0x7f9980138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997f7fe700 1 --2- 172.21.15.154:0/731301397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9980135f20 0x7f9980138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997f7fe700 1 -- 172.21.15.154:0/731301397 >> v1:172.21.15.154:6789/0 conn(0x7f998009d860 legacy=0x7f998009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997f7fe700 1 -- 172.21.15.154:0/731301397 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998009b360 con 0x7f998009e340 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997f7fe700 1 --2- 172.21.15.154:0/731301397 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009e340 0x7f99801359e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f99740098a0 tx=0x7f9974009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4d7e89b22734415 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.604+0000 7f997effd700 1 -- 172.21.15.154:0/731301397 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974014e90 con 0x7f998009e340 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.605+0000 7f997effd700 1 -- 172.21.15.154:0/731301397 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997401c440 con 0x7f998009e340 2023-09-30T22:25:06.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.605+0000 7f997effd700 1 -- 172.21.15.154:0/731301397 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997401c7b0 con 0x7f998009e340 2023-09-30T22:25:06.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.605+0000 7f9986940700 1 -- 172.21.15.154:0/731301397 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009e340 msgr2=0x7f99801359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.605+0000 7f9986940700 1 --2- 172.21.15.154:0/731301397 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009e340 0x7f99801359e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f99740098a0 tx=0x7f9974009bb0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.605+0000 7f9986940700 1 -- 172.21.15.154:0/731301397 shutdown_connections 2023-09-30T22:25:06.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.605+0000 7f9986940700 1 --2- 172.21.15.154:0/731301397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9980135f20 0x7f9980138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.605+0000 7f9986940700 1 --2- 172.21.15.154:0/731301397 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009e340 0x7f99801359e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.605+0000 7f9986940700 1 -- 172.21.15.154:0/731301397 >> 172.21.15.154:0/731301397 conn(0x7f9980099c40 msgr2=0x7f99800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.606+0000 7f9986940700 1 -- 172.21.15.154:0/731301397 shutdown_connections 2023-09-30T22:25:06.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.606+0000 7f9986940700 1 -- 172.21.15.154:0/731301397 wait complete. 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.607+0000 7f9986940700 1 Processor -- start 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.607+0000 7f9986940700 1 -- start start 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f9986940700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009d860 0x7f998011c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f9986940700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998009e340 0x7f998011c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f9986940700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9980135f20 0x7f998011cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f9986940700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99800a1fe0 con 0x7f998009e340 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f9986940700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998009c8b0 con 0x7f9980135f20 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f9986940700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998011f5e0 con 0x7f998009d860 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f997ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009d860 0x7f998011c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f997ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009d860 0x7f998011c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48880/0 (socket says 172.21.15.154:48880) 2023-09-30T22:25:06.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f997ffff700 1 -- 172.21.15.154:0/313123924 learned_addr learned my addr 172.21.15.154:0/313123924 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:06.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f997ffff700 1 -- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9980135f20 msgr2=0x7f998011cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f997ffff700 1 --2- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9980135f20 0x7f998011cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f997ffff700 1 -- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998009e340 msgr2=0x7f998011c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f997ffff700 1 --2- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998009e340 0x7f998011c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f997ffff700 1 -- 172.21.15.154:0/313123924 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740094a0 con 0x7f998009d860 2023-09-30T22:25:06.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.608+0000 7f997ffff700 1 --2- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009d860 0x7f998011c330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9970001eb0 tx=0x7f997000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.609+0000 7f997cff9700 1 -- 172.21.15.154:0/313123924 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970005d70 con 0x7f998009d860 2023-09-30T22:25:06.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.609+0000 7f997cff9700 1 -- 172.21.15.154:0/313123924 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99700070d0 con 0x7f998009d860 2023-09-30T22:25:06.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.609+0000 7f997cff9700 1 -- 172.21.15.154:0/313123924 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970007440 con 0x7f998009d860 2023-09-30T22:25:06.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.609+0000 7f9986940700 1 -- 172.21.15.154:0/313123924 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998011fb70 con 0x7f998009d860 2023-09-30T22:25:06.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.609+0000 7f9986940700 1 -- 172.21.15.154:0/313123924 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99801205e0 con 0x7f998009d860 2023-09-30T22:25:06.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.610+0000 7f997cff9700 1 -- 172.21.15.154:0/313123924 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99700075a0 con 0x7f998009d860 2023-09-30T22:25:06.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.610+0000 7f9986940700 1 -- 172.21.15.154:0/313123924 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998004f2a0 con 0x7f998009d860 2023-09-30T22:25:06.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.610+0000 7f997cff9700 1 -- 172.21.15.154:0/313123924 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f997003eae0 con 0x7f998009d860 2023-09-30T22:25:06.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.615+0000 7f997cff9700 1 -- 172.21.15.154:0/313123924 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9970019b40 con 0x7f998009d860 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.664+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2212274072 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ae4005590 con 0x7f3afc0a0a70 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.665+0000 7f3af27fc700 1 -- 172.21.15.154:0/2212274072 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3aec01bdf0 con 0x7f3afc0a0a70 2023-09-30T22:25:06.664 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:06.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.667+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc0a0a70 msgr2=0x7f3afc11de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.667+0000 7f3b03d7b700 1 --2- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc0a0a70 0x7f3afc11de00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e980 tx=0x7f3aec00ec90 comp rx=0 tx=0).stop 2023-09-30T22:25:06.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.667+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2212274072 shutdown_connections 2023-09-30T22:25:06.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.667+0000 7f3b03d7b700 1 --2- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc133f70 0x7f3afc1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.667+0000 7f3b03d7b700 1 --2- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc09ad40 0x7f3afc11d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.667+0000 7f3b03d7b700 1 --2- 172.21.15.154:0/2212274072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3afc0a0a70 0x7f3afc11de00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.667+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2212274072 >> 172.21.15.154:0/2212274072 conn(0x7f3afc099c40 msgr2=0x7f3afc131f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.667+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2212274072 shutdown_connections 2023-09-30T22:25:06.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.667+0000 7f3b03d7b700 1 -- 172.21.15.154:0/2212274072 wait complete. 2023-09-30T22:25:06.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:06.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f759c219700 1 Processor -- start 2023-09-30T22:25:06.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f759c219700 1 -- start start 2023-09-30T22:25:06.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f759c219700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f759409e950 0x7f759409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f759c219700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409f260 0x7f7594131810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f759c219700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759406a770 con 0x7f7594131d50 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f759c219700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75940a0740 con 0x7f759409e950 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f759c219700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759406f1f0 con 0x7f759409f260 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f75997b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409f260 0x7f7594131810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f75997b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409f260 0x7f7594131810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60908/0 (socket says 172.21.15.154:60908) 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f75997b4700 1 -- 172.21.15.154:0/3232134474 learned_addr learned my addr 172.21.15.154:0/3232134474 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.723+0000 7f7599fb5700 1 --2- 172.21.15.154:0/3232134474 >> v2:172.21.15.154:3300/0 conn(0x7f759409e950 0x7f759409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.724+0000 7f75997b4700 1 -- 172.21.15.154:0/3232134474 >> v2:172.21.15.154:3300/0 conn(0x7f759409e950 msgr2=0x7f759409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.724+0000 7f75997b4700 1 --2- 172.21.15.154:0/3232134474 >> v2:172.21.15.154:3300/0 conn(0x7f759409e950 0x7f759409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.724+0000 7f75997b4700 1 -- 172.21.15.154:0/3232134474 >> v1:172.21.15.154:6789/0 conn(0x7f7594131d50 legacy=0x7f7594138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.724+0000 7f75997b4700 1 -- 172.21.15.154:0/3232134474 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75940a00c0 con 0x7f759409f260 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.724+0000 7f7599fb5700 1 --2- 172.21.15.154:0/3232134474 >> v2:172.21.15.154:3300/0 conn(0x7f759409e950 0x7f759409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.724+0000 7f75997b4700 1 --2- 172.21.15.154:0/3232134474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409f260 0x7f7594131810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7584009950 tx=0x7f7584009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa7c206d6c7d3b39 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.724+0000 7f7598fb3700 1 -- 172.21.15.154:0/3232134474 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584011830 con 0x7f759409f260 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.724+0000 7f7598fb3700 1 -- 172.21.15.154:0/3232134474 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584011990 con 0x7f759409f260 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.724+0000 7f7598fb3700 1 -- 172.21.15.154:0/3232134474 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584011d40 con 0x7f759409f260 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.725+0000 7f759c219700 1 -- 172.21.15.154:0/3232134474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409f260 msgr2=0x7f7594131810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.725+0000 7f759c219700 1 --2- 172.21.15.154:0/3232134474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409f260 0x7f7594131810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7584009950 tx=0x7f7584009c60 comp rx=0 tx=0).stop 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.725+0000 7f759c219700 1 -- 172.21.15.154:0/3232134474 shutdown_connections 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.725+0000 7f759c219700 1 --2- 172.21.15.154:0/3232134474 >> v2:172.21.15.154:3300/0 conn(0x7f759409e950 0x7f759409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.725+0000 7f759c219700 1 --2- 172.21.15.154:0/3232134474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409f260 0x7f7594131810 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.725+0000 7f759c219700 1 -- 172.21.15.154:0/3232134474 >> 172.21.15.154:0/3232134474 conn(0x7f75940a0b50 msgr2=0x7f75940a0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.725+0000 7f759c219700 1 -- 172.21.15.154:0/3232134474 shutdown_connections 2023-09-30T22:25:06.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.725+0000 7f759c219700 1 -- 172.21.15.154:0/3232134474 wait complete. 2023-09-30T22:25:06.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.726+0000 7f759c219700 1 Processor -- start 2023-09-30T22:25:06.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.726+0000 7f759c219700 1 -- start start 2023-09-30T22:25:06.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f759c219700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409e950 0x7f75941c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f759c219700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f759409f260 0x7f75941c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f759c219700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7594131d50 0x7f75941c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f759c219700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759406d4c0 con 0x7f7594131d50 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f759c219700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75941315d0 con 0x7f759409e950 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f759c219700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7594122500 con 0x7f759409f260 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f75997b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f759409f260 0x7f75941c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f75997b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f759409f260 0x7f75941c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48892/0 (socket says 172.21.15.154:48892) 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f75997b4700 1 -- 172.21.15.154:0/3278232006 learned_addr learned my addr 172.21.15.154:0/3278232006 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f759a7b6700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7594131d50 0x7f75941c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f7599fb5700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409e950 0x7f75941c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f75997b4700 1 -- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409e950 msgr2=0x7f75941c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f75997b4700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409e950 0x7f75941c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f75997b4700 1 -- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7594131d50 msgr2=0x7f75941c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f75997b4700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7594131d50 0x7f75941c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f75997b4700 1 -- 172.21.15.154:0/3278232006 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75900094a0 con 0x7f759409f260 2023-09-30T22:25:06.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f759a7b6700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7594131d50 0x7f75941c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:06.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f75997b4700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f759409f260 0x7f75941c86e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7584009fb0 tx=0x7f7584004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:06.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f758a7fc700 1 -- 172.21.15.154:0/3278232006 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584004380 con 0x7f759409f260 2023-09-30T22:25:06.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f758a7fc700 1 -- 172.21.15.154:0/3278232006 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758401f070 con 0x7f759409f260 2023-09-30T22:25:06.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f759c219700 1 -- 172.21.15.154:0/3278232006 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7584009550 con 0x7f759409f260 2023-09-30T22:25:06.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.727+0000 7f758a7fc700 1 -- 172.21.15.154:0/3278232006 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75840036a0 con 0x7f759409f260 2023-09-30T22:25:06.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.728+0000 7f759c219700 1 -- 172.21.15.154:0/3278232006 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7594122220 con 0x7f759409f260 2023-09-30T22:25:06.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.728+0000 7f759c219700 1 -- 172.21.15.154:0/3278232006 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759404f2a0 con 0x7f759409f260 2023-09-30T22:25:06.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.729+0000 7f758a7fc700 1 -- 172.21.15.154:0/3278232006 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7584021030 con 0x7f759409f260 2023-09-30T22:25:06.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.729+0000 7f758a7fc700 1 -- 172.21.15.154:0/3278232006 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7584040f40 con 0x7f759409f260 2023-09-30T22:25:06.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.737+0000 7f758a7fc700 1 -- 172.21.15.154:0/3278232006 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75840239c0 con 0x7f759409f260 2023-09-30T22:25:06.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.776+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/1299215827 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff5c80a0170 con 0x7ff5c809e950 2023-09-30T22:25:06.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.776+0000 7ff5b6ffd700 1 -- 172.21.15.154:0/1299215827 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5b802a090 con 0x7ff5c809e950 2023-09-30T22:25:06.776 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.779+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809e950 msgr2=0x7ff5c8122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.779+0000 7ff5ccfd1700 1 --2- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809e950 0x7ff5c8122c40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800ebe0 tx=0x7ff5b800eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.779+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/1299215827 shutdown_connections 2023-09-30T22:25:06.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.779+0000 7ff5ccfd1700 1 --2- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5c81381e0 0x7ff5c81236c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.779+0000 7ff5ccfd1700 1 --2- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5c809e950 0x7ff5c8122c40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.779+0000 7ff5ccfd1700 1 --2- 172.21.15.154:0/1299215827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5c809f260 0x7ff5c8123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.779+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/1299215827 >> 172.21.15.154:0/1299215827 conn(0x7ff5c80a0f70 msgr2=0x7ff5c8071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.779+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/1299215827 shutdown_connections 2023-09-30T22:25:06.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.779+0000 7ff5ccfd1700 1 -- 172.21.15.154:0/1299215827 wait complete. 2023-09-30T22:25:06.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:06.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.826+0000 7f9986940700 1 -- 172.21.15.154:0/313123924 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f998006c3b0 con 0x7f998009d860 2023-09-30T22:25:06.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.826+0000 7f997cff9700 1 -- 172.21.15.154:0/313123924 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9970017070 con 0x7f998009d860 2023-09-30T22:25:06.826 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:06.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.828+0000 7f9986940700 1 -- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009d860 msgr2=0x7f998011c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.828+0000 7f9986940700 1 --2- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009d860 0x7f998011c330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9970001eb0 tx=0x7f997000c860 comp rx=0 tx=0).stop 2023-09-30T22:25:06.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.829+0000 7f9986940700 1 -- 172.21.15.154:0/313123924 shutdown_connections 2023-09-30T22:25:06.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.829+0000 7f9986940700 1 --2- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9980135f20 0x7f998011cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.829+0000 7f9986940700 1 --2- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f998009d860 0x7f998011c330 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.829+0000 7f9986940700 1 --2- 172.21.15.154:0/313123924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f998009e340 0x7f998011c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.829+0000 7f9986940700 1 -- 172.21.15.154:0/313123924 >> 172.21.15.154:0/313123924 conn(0x7f9980099c40 msgr2=0x7f99800a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.829+0000 7f9986940700 1 -- 172.21.15.154:0/313123924 shutdown_connections 2023-09-30T22:25:06.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.829+0000 7f9986940700 1 -- 172.21.15.154:0/313123924 wait complete. 2023-09-30T22:25:06.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:06.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.933+0000 7f759c219700 1 -- 172.21.15.154:0/3278232006 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7594120de0 con 0x7f759409f260 2023-09-30T22:25:06.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.933+0000 7f758a7fc700 1 -- 172.21.15.154:0/3278232006 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7584015070 con 0x7f759409f260 2023-09-30T22:25:06.933 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.936+0000 7f759c219700 1 -- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f759409f260 msgr2=0x7f75941c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.936+0000 7f759c219700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f759409f260 0x7f75941c86e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7584009fb0 tx=0x7f7584004750 comp rx=0 tx=0).stop 2023-09-30T22:25:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.936+0000 7f759c219700 1 -- 172.21.15.154:0/3278232006 shutdown_connections 2023-09-30T22:25:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.936+0000 7f759c219700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7594131d50 0x7f75941c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.936+0000 7f759c219700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759409e950 0x7f75941c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.936+0000 7f759c219700 1 --2- 172.21.15.154:0/3278232006 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f759409f260 0x7f75941c86e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.936+0000 7f759c219700 1 -- 172.21.15.154:0/3278232006 >> 172.21.15.154:0/3278232006 conn(0x7f75940a0b50 msgr2=0x7f75941b9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.936+0000 7f759c219700 1 -- 172.21.15.154:0/3278232006 shutdown_connections 2023-09-30T22:25:06.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:06.936+0000 7f759c219700 1 -- 172.21.15.154:0/3278232006 wait complete. 2023-09-30T22:25:06.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:07.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:07.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:07.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.806+0000 7f0d6e4b2700 1 Processor -- start 2023-09-30T22:25:07.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.806+0000 7f0d6e4b2700 1 -- start start 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6e4b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d68131980 0x7f0d68131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6e4b2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d6809bc70 0x7f0d6809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6e4b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6809c5c0 0x7f0d68138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6e4b2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6806eb30 con 0x7f0d6809bc70 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6e4b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680a1640 con 0x7f0d68131980 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6e4b2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680a22d0 con 0x7f0d6809c5c0 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d677fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d6809bc70 0x7f0d6809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d67fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d68131980 0x7f0d68131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6ca4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6809c5c0 0x7f0d68138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d677fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d6809bc70 0x7f0d6809c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38232/0 (socket says 172.21.15.154:38232) 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d67fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d68131980 0x7f0d68131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60932/0 (socket says 172.21.15.154:60932) 2023-09-30T22:25:07.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d677fe700 1 -- 172.21.15.154:0/2585812217 learned_addr learned my addr 172.21.15.154:0/2585812217 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6ca4f700 1 -- 172.21.15.154:0/2585812217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d68131980 msgr2=0x7f0d68131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6ca4f700 1 --2- 172.21.15.154:0/2585812217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d68131980 0x7f0d68131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6ca4f700 1 -- 172.21.15.154:0/2585812217 >> v2:172.21.15.154:3300/0 conn(0x7f0d6809bc70 msgr2=0x7f0d6809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6ca4f700 1 --2- 172.21.15.154:0/2585812217 >> v2:172.21.15.154:3300/0 conn(0x7f0d6809bc70 0x7f0d6809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d6ca4f700 1 -- 172.21.15.154:0/2585812217 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68131550 con 0x7f0d6809c5c0 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d67fff700 1 --2- 172.21.15.154:0/2585812217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d68131980 0x7f0d68131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.807+0000 7f0d677fe700 1 --2- 172.21.15.154:0/2585812217 >> v2:172.21.15.154:3300/0 conn(0x7f0d6809bc70 0x7f0d6809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6ca4f700 1 --2- 172.21.15.154:0/2585812217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6809c5c0 0x7f0d68138700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0d60008630 tx=0x7f0d60008940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b57c9088b3faa9f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d66ffd700 1 -- 172.21.15.154:0/2585812217 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000d0d0 con 0x7f0d6809c5c0 2023-09-30T22:25:07.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d66ffd700 1 -- 172.21.15.154:0/2585812217 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6000d230 con 0x7f0d6809c5c0 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d66ffd700 1 -- 172.21.15.154:0/2585812217 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000d5e0 con 0x7f0d6809c5c0 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/2585812217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6809c5c0 msgr2=0x7f0d68138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6e4b2700 1 --2- 172.21.15.154:0/2585812217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6809c5c0 0x7f0d68138700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0d60008630 tx=0x7f0d60008940 comp rx=0 tx=0).stop 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/2585812217 shutdown_connections 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6e4b2700 1 --2- 172.21.15.154:0/2585812217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d68131980 0x7f0d68131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6e4b2700 1 --2- 172.21.15.154:0/2585812217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6809c5c0 0x7f0d68138700 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6e4b2700 1 --2- 172.21.15.154:0/2585812217 >> v2:172.21.15.154:3300/0 conn(0x7f0d6809bc70 0x7f0d6809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/2585812217 >> 172.21.15.154:0/2585812217 conn(0x7f0d680a2980 msgr2=0x7f0d680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/2585812217 shutdown_connections 2023-09-30T22:25:07.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.808+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/2585812217 wait complete. 2023-09-30T22:25:07.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.809+0000 7f0d6e4b2700 1 Processor -- start 2023-09-30T22:25:07.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d6e4b2700 1 -- start start 2023-09-30T22:25:07.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d6e4b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6809bc70 0x7f0d681c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d6e4b2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6809c5c0 0x7f0d681c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d6e4b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d68131980 0x7f0d681c0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d6e4b2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6811cb80 con 0x7f0d6809c5c0 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d6e4b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6811cd60 con 0x7f0d6809bc70 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d6e4b2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d681c4b70 con 0x7f0d68131980 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d677fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6809c5c0 0x7f0d681c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d67fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6809bc70 0x7f0d681c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d677fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6809c5c0 0x7f0d681c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38248/0 (socket says 172.21.15.154:38248) 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d6ca4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d68131980 0x7f0d681c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d677fe700 1 -- 172.21.15.154:0/1827352960 learned_addr learned my addr 172.21.15.154:0/1827352960 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d67fff700 1 -- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d68131980 msgr2=0x7f0d681c0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d67fff700 1 --2- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d68131980 0x7f0d681c0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d67fff700 1 -- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6809c5c0 msgr2=0x7f0d681c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d67fff700 1 --2- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6809c5c0 0x7f0d681c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d67fff700 1 -- 172.21.15.154:0/1827352960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c009550 con 0x7f0d6809bc70 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.810+0000 7f0d677fe700 1 --2- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6809c5c0 0x7f0d681c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.811+0000 7f0d67fff700 1 --2- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6809bc70 0x7f0d681c40f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0d58014340 tx=0x7f0d58014650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.811+0000 7f0d64ff9700 1 -- 172.21.15.154:0/1827352960 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58016050 con 0x7f0d6809bc70 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.811+0000 7f0d64ff9700 1 -- 172.21.15.154:0/1827352960 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58017040 con 0x7f0d6809bc70 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.811+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/1827352960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d58011cd0 con 0x7f0d6809bc70 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.811+0000 7f0d64ff9700 1 -- 172.21.15.154:0/1827352960 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58004250 con 0x7f0d6809bc70 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.811+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/1827352960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60008260 con 0x7f0d6809bc70 2023-09-30T22:25:07.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.812+0000 7f0d64ff9700 1 -- 172.21.15.154:0/1827352960 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d580043b0 con 0x7f0d6809bc70 2023-09-30T22:25:07.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.812+0000 7f0d64ff9700 1 -- 172.21.15.154:0/1827352960 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d58047990 con 0x7f0d6809bc70 2023-09-30T22:25:07.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.812+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/1827352960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6811cea0 con 0x7f0d6809bc70 2023-09-30T22:25:07.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.817+0000 7f0d64ff9700 1 -- 172.21.15.154:0/1827352960 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d6811cea0 con 0x7f0d6809bc70 2023-09-30T22:25:07.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:07.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.924+0000 7f4e2aa72700 1 Processor -- start 2023-09-30T22:25:07.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e2aa72700 1 -- start start 2023-09-30T22:25:07.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e2aa72700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e240a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e2aa72700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e24134120 0x7f4e2413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e2aa72700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2409dc00 con 0x7f4e240a1380 2023-09-30T22:25:07.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e2aa72700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2409ea60 con 0x7f4e24134120 2023-09-30T22:25:07.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e2aa72700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2409dec0 con 0x7f4e240a0a70 2023-09-30T22:25:07.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e23fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4e240a1380 0x7f4e24133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47214/0 (socket says 172.21.15.154:47214) 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e23fff700 1 -- 172.21.15.154:0/4119887027 learned_addr learned my addr 172.21.15.154:0/4119887027 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e2880e700 1 --2- 172.21.15.154:0/4119887027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e240a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.925+0000 7f4e2900f700 1 --2- 172.21.15.154:0/4119887027 >> v2:172.21.15.154:3300/0 conn(0x7f4e24134120 0x7f4e2413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e237fe700 1 -- 172.21.15.154:0/4119887027 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416172577 0 0) 0x7f4e2409dc00 con 0x7f4e240a1380 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e237fe700 1 -- 172.21.15.154:0/4119887027 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e140035b0 con 0x7f4e240a1380 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e2880e700 1 -- 172.21.15.154:0/4119887027 >> v2:172.21.15.154:3300/0 conn(0x7f4e24134120 msgr2=0x7f4e2413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e2880e700 1 --2- 172.21.15.154:0/4119887027 >> v2:172.21.15.154:3300/0 conn(0x7f4e24134120 0x7f4e2413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e2880e700 1 -- 172.21.15.154:0/4119887027 >> v1:172.21.15.154:6789/0 conn(0x7f4e240a1380 legacy=0x7f4e24133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e2880e700 1 -- 172.21.15.154:0/4119887027 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2409e6a0 con 0x7f4e240a0a70 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e2900f700 1 --2- 172.21.15.154:0/4119887027 >> v2:172.21.15.154:3300/0 conn(0x7f4e24134120 0x7f4e2413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:07.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e2880e700 1 --2- 172.21.15.154:0/4119887027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e240a0e40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009840 tx=0x7f4e18009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6beb7df13386719b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:07.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e237fe700 1 -- 172.21.15.154:0/4119887027 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18011830 con 0x7f4e240a0a70 2023-09-30T22:25:07.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e237fe700 1 -- 172.21.15.154:0/4119887027 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18011990 con 0x7f4e240a0a70 2023-09-30T22:25:07.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.926+0000 7f4e237fe700 1 -- 172.21.15.154:0/4119887027 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18011d00 con 0x7f4e240a0a70 2023-09-30T22:25:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.927+0000 7f4e2aa72700 1 -- 172.21.15.154:0/4119887027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 msgr2=0x7f4e240a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.927+0000 7f4e2aa72700 1 --2- 172.21.15.154:0/4119887027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e240a0e40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009840 tx=0x7f4e18009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.927+0000 7f4e2aa72700 1 -- 172.21.15.154:0/4119887027 shutdown_connections 2023-09-30T22:25:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.927+0000 7f4e2aa72700 1 --2- 172.21.15.154:0/4119887027 >> v2:172.21.15.154:3300/0 conn(0x7f4e24134120 0x7f4e2413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.927+0000 7f4e2aa72700 1 --2- 172.21.15.154:0/4119887027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e240a0e40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.927+0000 7f4e2aa72700 1 -- 172.21.15.154:0/4119887027 >> 172.21.15.154:0/4119887027 conn(0x7f4e240a6610 msgr2=0x7f4e240a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.927+0000 7f4e2aa72700 1 -- 172.21.15.154:0/4119887027 shutdown_connections 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.927+0000 7f4e2aa72700 1 -- 172.21.15.154:0/4119887027 wait complete. 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2aa72700 1 Processor -- start 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2aa72700 1 -- start start 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2aa72700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e24122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2aa72700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e240a1380 0x7f4e24122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2aa72700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24134120 0x7f4e24123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2aa72700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24126ed0 con 0x7f4e24134120 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2aa72700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e240a03e0 con 0x7f4e240a0a70 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2aa72700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24125cb0 con 0x7f4e240a1380 2023-09-30T22:25:07.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2880e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e24122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2880e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e24122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60960/0 (socket says 172.21.15.154:60960) 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2880e700 1 -- 172.21.15.154:0/2430552086 learned_addr learned my addr 172.21.15.154:0/2430552086 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.928+0000 7f4e2900f700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24134120 0x7f4e24123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e23fff700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e240a1380 0x7f4e24122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e2900f700 1 -- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e240a1380 msgr2=0x7f4e24122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e2900f700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e240a1380 0x7f4e24122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e2900f700 1 -- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 msgr2=0x7f4e24122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e2900f700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e24122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e2900f700 1 -- 172.21.15.154:0/2430552086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c009a70 con 0x7f4e24134120 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e2880e700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e24122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e23fff700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e240a1380 0x7f4e24122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:07.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e2900f700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24134120 0x7f4e24123280 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00efc0 tx=0x7f4e1c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:07.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e217fa700 1 -- 172.21.15.154:0/2430552086 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c00cb40 con 0x7f4e24134120 2023-09-30T22:25:07.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e217fa700 1 -- 172.21.15.154:0/2430552086 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c00f040 con 0x7f4e24134120 2023-09-30T22:25:07.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e217fa700 1 -- 172.21.15.154:0/2430552086 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c003a20 con 0x7f4e24134120 2023-09-30T22:25:07.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e2aa72700 1 -- 172.21.15.154:0/2430552086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e180094a0 con 0x7f4e24134120 2023-09-30T22:25:07.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.929+0000 7f4e2aa72700 1 -- 172.21.15.154:0/2430552086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e24126950 con 0x7f4e24134120 2023-09-30T22:25:07.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.930+0000 7f4e217fa700 1 -- 172.21.15.154:0/2430552086 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e1c014480 con 0x7f4e24134120 2023-09-30T22:25:07.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.930+0000 7f4e217fa700 1 -- 172.21.15.154:0/2430552086 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e1c03ff00 con 0x7f4e24134120 2023-09-30T22:25:07.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.930+0000 7f4e2aa72700 1 -- 172.21.15.154:0/2430552086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2404f2a0 con 0x7f4e24134120 2023-09-30T22:25:07.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.935+0000 7f4e217fa700 1 -- 172.21.15.154:0/2430552086 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e1c012930 con 0x7f4e24134120 2023-09-30T22:25:07.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:07.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.973+0000 7f90c258f700 1 Processor -- start 2023-09-30T22:25:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.973+0000 7f90c258f700 1 -- start start 2023-09-30T22:25:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90c258f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12cb80 0x7f90bc12cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90c258f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90bc12fab0 0x7f90bc12ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90c258f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc136de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90c258f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc09b700 con 0x7f90bc12fab0 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90c258f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc09c350 con 0x7f90bc130460 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90c258f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc1308d0 con 0x7f90bc12cb80 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12cb80 0x7f90bc12cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12cb80 0x7f90bc12cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48938/0 (socket says 172.21.15.154:48938) 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bbfff700 1 -- 172.21.15.154:0/2763561520 learned_addr learned my addr 172.21.15.154:0/2763561520 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90c0b2c700 1 --2- 172.21.15.154:0/2763561520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc136de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bb7fe700 1 --2- 172.21.15.154:0/2763561520 >> v2:172.21.15.154:3300/0 conn(0x7f90bc12fab0 0x7f90bc12ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bbfff700 1 -- 172.21.15.154:0/2763561520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 msgr2=0x7f90bc136de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bbfff700 1 --2- 172.21.15.154:0/2763561520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc136de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bbfff700 1 -- 172.21.15.154:0/2763561520 >> v2:172.21.15.154:3300/0 conn(0x7f90bc12fab0 msgr2=0x7f90bc12ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bbfff700 1 --2- 172.21.15.154:0/2763561520 >> v2:172.21.15.154:3300/0 conn(0x7f90bc12fab0 0x7f90bc12ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bbfff700 1 -- 172.21.15.154:0/2763561520 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc09abf0 con 0x7f90bc12cb80 2023-09-30T22:25:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90c0b2c700 1 --2- 172.21.15.154:0/2763561520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc136de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.974+0000 7f90bbfff700 1 --2- 172.21.15.154:0/2763561520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12cb80 0x7f90bc12cf50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f90ac013210 tx=0x7f90ac013520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edbdb2f64b6da4c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.975+0000 7f90baffd700 1 -- 172.21.15.154:0/2763561520 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac016070 con 0x7f90bc12cb80 2023-09-30T22:25:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.975+0000 7f90baffd700 1 -- 172.21.15.154:0/2763561520 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac013d70 con 0x7f90bc12cb80 2023-09-30T22:25:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.975+0000 7f90baffd700 1 -- 172.21.15.154:0/2763561520 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0112f0 con 0x7f90bc12cb80 2023-09-30T22:25:07.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.976+0000 7f90c258f700 1 -- 172.21.15.154:0/2763561520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12cb80 msgr2=0x7f90bc12cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.976+0000 7f90c258f700 1 --2- 172.21.15.154:0/2763561520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12cb80 0x7f90bc12cf50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f90ac013210 tx=0x7f90ac013520 comp rx=0 tx=0).stop 2023-09-30T22:25:07.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.976+0000 7f90c258f700 1 -- 172.21.15.154:0/2763561520 shutdown_connections 2023-09-30T22:25:07.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.976+0000 7f90c258f700 1 --2- 172.21.15.154:0/2763561520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc136de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.976+0000 7f90c258f700 1 --2- 172.21.15.154:0/2763561520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12cb80 0x7f90bc12cf50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.976+0000 7f90c258f700 1 --2- 172.21.15.154:0/2763561520 >> v2:172.21.15.154:3300/0 conn(0x7f90bc12fab0 0x7f90bc12ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.976+0000 7f90c258f700 1 -- 172.21.15.154:0/2763561520 >> 172.21.15.154:0/2763561520 conn(0x7f90bc0a2eb0 msgr2=0x7f90bc09eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.976+0000 7f90c258f700 1 -- 172.21.15.154:0/2763561520 shutdown_connections 2023-09-30T22:25:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.976+0000 7f90c258f700 1 -- 172.21.15.154:0/2763561520 wait complete. 2023-09-30T22:25:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.977+0000 7f90c258f700 1 Processor -- start 2023-09-30T22:25:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.977+0000 7f90c258f700 1 -- start start 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90c258f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90bc12cb80 0x7f90bc1c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90c258f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12fab0 0x7f90bc1c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90c258f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc1c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90c258f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc12f460 con 0x7f90bc12cb80 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90c258f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc06dd80 con 0x7f90bc130460 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90c258f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc12abc0 con 0x7f90bc12fab0 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90c0b2c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc1c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90c0b2c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc1c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60982/0 (socket says 172.21.15.154:60982) 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90c0b2c700 1 -- 172.21.15.154:0/459959051 learned_addr learned my addr 172.21.15.154:0/459959051 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.978+0000 7f90bbfff700 1 --2- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90bc12cb80 0x7f90bc1c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90bb7fe700 1 --2- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12fab0 0x7f90bc1c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90c0b2c700 1 -- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12fab0 msgr2=0x7f90bc1c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90c0b2c700 1 --2- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12fab0 0x7f90bc1c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90c0b2c700 1 -- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90bc12cb80 msgr2=0x7f90bc1c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90c0b2c700 1 --2- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90bc12cb80 0x7f90bc1c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90c0b2c700 1 -- 172.21.15.154:0/459959051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b4009a70 con 0x7f90bc130460 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90c0b2c700 1 --2- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc1c4a10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f90b400efc0 tx=0x7f90b400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90b8ff9700 1 -- 172.21.15.154:0/459959051 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400cb40 con 0x7f90bc130460 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90b8ff9700 1 -- 172.21.15.154:0/459959051 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b400f040 con 0x7f90bc130460 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90b8ff9700 1 -- 172.21.15.154:0/459959051 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400cea0 con 0x7f90bc130460 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90c258f700 1 -- 172.21.15.154:0/459959051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac011df0 con 0x7f90bc130460 2023-09-30T22:25:07.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.979+0000 7f90c258f700 1 -- 172.21.15.154:0/459959051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc070230 con 0x7f90bc130460 2023-09-30T22:25:07.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.980+0000 7f90c258f700 1 -- 172.21.15.154:0/459959051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc04f2a0 con 0x7f90bc130460 2023-09-30T22:25:07.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.980+0000 7f90b8ff9700 1 -- 172.21.15.154:0/459959051 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90b4003a20 con 0x7f90bc130460 2023-09-30T22:25:07.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.981+0000 7f90b8ff9700 1 -- 172.21.15.154:0/459959051 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f90b403ffa0 con 0x7f90bc130460 2023-09-30T22:25:07.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:07.989+0000 7f90b8ff9700 1 -- 172.21.15.154:0/459959051 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90b4071750 con 0x7f90bc130460 2023-09-30T22:25:08.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.031+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/1827352960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d6811cea0 con 0x7f0d6809bc70 2023-09-30T22:25:08.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.031+0000 7f0d64ff9700 1 -- 172.21.15.154:0/1827352960 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d6811cea0 con 0x7f0d6809bc70 2023-09-30T22:25:08.031 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:08.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.035+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6809bc70 msgr2=0x7f0d681c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.035+0000 7f0d6e4b2700 1 --2- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6809bc70 0x7f0d681c40f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0d58014340 tx=0x7f0d58014650 comp rx=0 tx=0).stop 2023-09-30T22:25:08.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.035+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/1827352960 shutdown_connections 2023-09-30T22:25:08.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.035+0000 7f0d6e4b2700 1 --2- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d68131980 0x7f0d681c0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.035+0000 7f0d6e4b2700 1 --2- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6809bc70 0x7f0d681c40f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.035+0000 7f0d6e4b2700 1 --2- 172.21.15.154:0/1827352960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6809c5c0 0x7f0d681c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.035+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/1827352960 >> 172.21.15.154:0/1827352960 conn(0x7f0d680a2980 msgr2=0x7f0d6812e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.035+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/1827352960 shutdown_connections 2023-09-30T22:25:08.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.035+0000 7f0d6e4b2700 1 -- 172.21.15.154:0/1827352960 wait complete. 2023-09-30T22:25:08.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:08.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.076+0000 7faf87725700 1 Processor -- start 2023-09-30T22:25:08.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf87725700 1 -- start start 2023-09-30T22:25:08.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf87725700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009e870 0x7faf8009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf87725700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009f180 0x7faf80131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf87725700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf80131d70 0x7faf80132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf87725700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf800a0920 con 0x7faf80131d70 2023-09-30T22:25:08.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf87725700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8009c970 con 0x7faf8009e870 2023-09-30T22:25:08.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf87725700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf8009bab0 con 0x7faf8009f180 2023-09-30T22:25:08.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf854c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009e870 0x7faf8009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf84cc0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009f180 0x7faf80131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf854c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009e870 0x7faf8009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60988/0 (socket says 172.21.15.154:60988) 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf854c1700 1 -- 172.21.15.154:0/4085859688 learned_addr learned my addr 172.21.15.154:0/4085859688 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.077+0000 7faf85cc2700 1 --2- 172.21.15.154:0/4085859688 >> v2:172.21.15.154:3300/0 conn(0x7faf80131d70 0x7faf80132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf854c1700 1 -- 172.21.15.154:0/4085859688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009f180 msgr2=0x7faf80131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf854c1700 1 --2- 172.21.15.154:0/4085859688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009f180 0x7faf80131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf854c1700 1 -- 172.21.15.154:0/4085859688 >> v2:172.21.15.154:3300/0 conn(0x7faf80131d70 msgr2=0x7faf80132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf854c1700 1 --2- 172.21.15.154:0/4085859688 >> v2:172.21.15.154:3300/0 conn(0x7faf80131d70 0x7faf80132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf854c1700 1 -- 172.21.15.154:0/4085859688 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8009f9c0 con 0x7faf8009e870 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf84cc0700 1 --2- 172.21.15.154:0/4085859688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009f180 0x7faf80131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf854c1700 1 --2- 172.21.15.154:0/4085859688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009e870 0x7faf8009ec40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0098f0 tx=0x7faf7c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b9feafb91795fa8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf77fff700 1 -- 172.21.15.154:0/4085859688 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c011830 con 0x7faf8009e870 2023-09-30T22:25:08.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf77fff700 1 -- 172.21.15.154:0/4085859688 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c011990 con 0x7faf8009e870 2023-09-30T22:25:08.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.078+0000 7faf77fff700 1 -- 172.21.15.154:0/4085859688 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c011d20 con 0x7faf8009e870 2023-09-30T22:25:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.079+0000 7faf87725700 1 -- 172.21.15.154:0/4085859688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009e870 msgr2=0x7faf8009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.079+0000 7faf87725700 1 --2- 172.21.15.154:0/4085859688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009e870 0x7faf8009ec40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0098f0 tx=0x7faf7c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.079+0000 7faf87725700 1 -- 172.21.15.154:0/4085859688 shutdown_connections 2023-09-30T22:25:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.079+0000 7faf87725700 1 --2- 172.21.15.154:0/4085859688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009e870 0x7faf8009ec40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.079+0000 7faf87725700 1 --2- 172.21.15.154:0/4085859688 >> v2:172.21.15.154:3300/0 conn(0x7faf80131d70 0x7faf80132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.079+0000 7faf87725700 1 --2- 172.21.15.154:0/4085859688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009f180 0x7faf80131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.079+0000 7faf87725700 1 -- 172.21.15.154:0/4085859688 >> 172.21.15.154:0/4085859688 conn(0x7faf800a4430 msgr2=0x7faf800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.079+0000 7faf87725700 1 -- 172.21.15.154:0/4085859688 shutdown_connections 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.079+0000 7faf87725700 1 -- 172.21.15.154:0/4085859688 wait complete. 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf87725700 1 Processor -- start 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf87725700 1 -- start start 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf87725700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009e870 0x7faf8011be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf87725700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009f180 0x7faf8011c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf87725700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf80131d70 0x7faf8011c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf87725700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8011f950 con 0x7faf80131d70 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf87725700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8011ed20 con 0x7faf8009f180 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf87725700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf8011e020 con 0x7faf8009e870 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf854c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009e870 0x7faf8011be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf85cc2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf80131d70 0x7faf8011c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf854c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009e870 0x7faf8011be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48964/0 (socket says 172.21.15.154:48964) 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf854c1700 1 -- 172.21.15.154:0/1515480675 learned_addr learned my addr 172.21.15.154:0/1515480675 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf84cc0700 1 --2- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009f180 0x7faf8011c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf85cc2700 1 -- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009e870 msgr2=0x7faf8011be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf85cc2700 1 --2- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009e870 0x7faf8011be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf85cc2700 1 -- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009f180 msgr2=0x7faf8011c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf85cc2700 1 --2- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009f180 0x7faf8011c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf85cc2700 1 -- 172.21.15.154:0/1515480675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7000d940 con 0x7faf80131d70 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.080+0000 7faf854c1700 1 --2- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009e870 0x7faf8011be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.081+0000 7faf85cc2700 1 --2- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf80131d70 0x7faf8011c8b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faf7800efc0 tx=0x7faf7800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.081+0000 7faf75ffb700 1 -- 172.21.15.154:0/1515480675 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800cc90 con 0x7faf80131d70 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.081+0000 7faf75ffb700 1 -- 172.21.15.154:0/1515480675 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7800f040 con 0x7faf80131d70 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.081+0000 7faf87725700 1 -- 172.21.15.154:0/1515480675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c009550 con 0x7faf80131d70 2023-09-30T22:25:08.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.081+0000 7faf75ffb700 1 -- 172.21.15.154:0/1515480675 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780146c0 con 0x7faf80131d70 2023-09-30T22:25:08.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.081+0000 7faf87725700 1 -- 172.21.15.154:0/1515480675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf800a0210 con 0x7faf80131d70 2023-09-30T22:25:08.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.082+0000 7faf75ffb700 1 -- 172.21.15.154:0/1515480675 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf78014820 con 0x7faf80131d70 2023-09-30T22:25:08.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.082+0000 7faf87725700 1 -- 172.21.15.154:0/1515480675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8004f2a0 con 0x7faf80131d70 2023-09-30T22:25:08.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.082+0000 7faf75ffb700 1 -- 172.21.15.154:0/1515480675 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf780401b0 con 0x7faf80131d70 2023-09-30T22:25:08.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.087+0000 7faf75ffb700 1 -- 172.21.15.154:0/1515480675 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf78007900 con 0x7faf80131d70 2023-09-30T22:25:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.170+0000 7f4e2aa72700 1 -- 172.21.15.154:0/2430552086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e24072980 con 0x7f4e24134120 2023-09-30T22:25:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.171+0000 7f4e217fa700 1 -- 172.21.15.154:0/2430552086 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e1c012340 con 0x7f4e24134120 2023-09-30T22:25:08.171 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.173+0000 7f4e2aa72700 1 -- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24134120 msgr2=0x7f4e24123280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.173+0000 7f4e2aa72700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24134120 0x7f4e24123280 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00efc0 tx=0x7f4e1c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.173+0000 7f4e2aa72700 1 -- 172.21.15.154:0/2430552086 shutdown_connections 2023-09-30T22:25:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.173+0000 7f4e2aa72700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e24134120 0x7f4e24123280 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.173+0000 7f4e2aa72700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e240a0a70 0x7f4e24122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.173+0000 7f4e2aa72700 1 --2- 172.21.15.154:0/2430552086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e240a1380 0x7f4e24122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.173+0000 7f4e2aa72700 1 -- 172.21.15.154:0/2430552086 >> 172.21.15.154:0/2430552086 conn(0x7f4e240a6610 msgr2=0x7f4e240a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.173+0000 7f4e2aa72700 1 -- 172.21.15.154:0/2430552086 shutdown_connections 2023-09-30T22:25:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.173+0000 7f4e2aa72700 1 -- 172.21.15.154:0/2430552086 wait complete. 2023-09-30T22:25:08.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.202+0000 7f90c258f700 1 -- 172.21.15.154:0/459959051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f90bc06bdf0 con 0x7f90bc130460 2023-09-30T22:25:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.202+0000 7f90b8ff9700 1 -- 172.21.15.154:0/459959051 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90b401b360 con 0x7f90bc130460 2023-09-30T22:25:08.202 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.204+0000 7f90c258f700 1 -- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 msgr2=0x7f90bc1c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.204+0000 7f90c258f700 1 --2- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc1c4a10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f90b400efc0 tx=0x7f90b400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.204+0000 7f90c258f700 1 -- 172.21.15.154:0/459959051 shutdown_connections 2023-09-30T22:25:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.204+0000 7f90c258f700 1 --2- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90bc130460 0x7f90bc1c4a10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.204+0000 7f90c258f700 1 --2- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90bc12cb80 0x7f90bc1c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.204+0000 7f90c258f700 1 --2- 172.21.15.154:0/459959051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90bc12fab0 0x7f90bc1c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.204+0000 7f90c258f700 1 -- 172.21.15.154:0/459959051 >> 172.21.15.154:0/459959051 conn(0x7f90bc0a2eb0 msgr2=0x7f90bc1b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.204+0000 7f90c258f700 1 -- 172.21.15.154:0/459959051 shutdown_connections 2023-09-30T22:25:08.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.204+0000 7f90c258f700 1 -- 172.21.15.154:0/459959051 wait complete. 2023-09-30T22:25:08.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:08.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.294+0000 7faf87725700 1 -- 172.21.15.154:0/1515480675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faf8011da40 con 0x7faf80131d70 2023-09-30T22:25:08.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.294+0000 7faf75ffb700 1 -- 172.21.15.154:0/1515480675 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf78018020 con 0x7faf80131d70 2023-09-30T22:25:08.294 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:08.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.296+0000 7faf87725700 1 -- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf80131d70 msgr2=0x7faf8011c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:08.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.296+0000 7faf87725700 1 --2- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf80131d70 0x7faf8011c8b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faf7800efc0 tx=0x7faf7800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.296+0000 7faf87725700 1 -- 172.21.15.154:0/1515480675 shutdown_connections 2023-09-30T22:25:08.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.296+0000 7faf87725700 1 --2- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf80131d70 0x7faf8011c8b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.296+0000 7faf87725700 1 --2- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faf8009e870 0x7faf8011be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.296+0000 7faf87725700 1 --2- 172.21.15.154:0/1515480675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf8009f180 0x7faf8011c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:08.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.296+0000 7faf87725700 1 -- 172.21.15.154:0/1515480675 >> 172.21.15.154:0/1515480675 conn(0x7faf800a4430 msgr2=0x7faf80130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:08.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.296+0000 7faf87725700 1 -- 172.21.15.154:0/1515480675 shutdown_connections 2023-09-30T22:25:08.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:08.296+0000 7faf87725700 1 -- 172.21.15.154:0/1515480675 wait complete. 2023-09-30T22:25:08.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:09.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:09.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.182+0000 7f497b28b700 1 Processor -- start 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.182+0000 7f497b28b700 1 -- start start 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f497b28b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4974133ad0 0x7f4974133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f497b28b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741300a0 0x7f49741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f497b28b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497406b2d0 con 0x7f49741309f0 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f497b28b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4974133610 con 0x7f4974133ad0 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f497b28b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f497409a500 con 0x7f49741300a0 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4978826700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741300a0 0x7f49741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4979027700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4974133ad0 0x7f4974133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4979027700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4974133ad0 0x7f4974133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38304/0 (socket says 172.21.15.154:38304) 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4978826700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741300a0 0x7f49741304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48974/0 (socket says 172.21.15.154:48974) 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4979027700 1 -- 172.21.15.154:0/588364713 learned_addr learned my addr 172.21.15.154:0/588364713 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:09.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4979828700 1 --1- 172.21.15.154:0/588364713 >> v1:172.21.15.154:6789/0 conn(0x7f49741309f0 0x7f497413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47226/0 (socket says 172.21.15.154:47226) 2023-09-30T22:25:09.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4979027700 1 -- 172.21.15.154:0/588364713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741300a0 msgr2=0x7f49741304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4979027700 1 --2- 172.21.15.154:0/588364713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741300a0 0x7f49741304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4979027700 1 -- 172.21.15.154:0/588364713 >> v1:172.21.15.154:6789/0 conn(0x7f49741309f0 legacy=0x7f497413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4979027700 1 -- 172.21.15.154:0/588364713 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49741338b0 con 0x7f4974133ad0 2023-09-30T22:25:09.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.183+0000 7f4978826700 1 --2- 172.21.15.154:0/588364713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741300a0 0x7f49741304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f4979027700 1 --2- 172.21.15.154:0/588364713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4974133ad0 0x7f4974133ea0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f49640098f0 tx=0x7f4964009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c1e518ba490ca1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f496bfff700 1 -- 172.21.15.154:0/588364713 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964011830 con 0x7f4974133ad0 2023-09-30T22:25:09.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f496bfff700 1 -- 172.21.15.154:0/588364713 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4964011990 con 0x7f4974133ad0 2023-09-30T22:25:09.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f496bfff700 1 -- 172.21.15.154:0/588364713 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964011d20 con 0x7f4974133ad0 2023-09-30T22:25:09.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f497b28b700 1 -- 172.21.15.154:0/588364713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4974133ad0 msgr2=0x7f4974133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f497b28b700 1 --2- 172.21.15.154:0/588364713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4974133ad0 0x7f4974133ea0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f49640098f0 tx=0x7f4964009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f497b28b700 1 -- 172.21.15.154:0/588364713 shutdown_connections 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f497b28b700 1 --2- 172.21.15.154:0/588364713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4974133ad0 0x7f4974133ea0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f497b28b700 1 --2- 172.21.15.154:0/588364713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741300a0 0x7f49741304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f497b28b700 1 -- 172.21.15.154:0/588364713 >> 172.21.15.154:0/588364713 conn(0x7f4974099c40 msgr2=0x7f49740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f497b28b700 1 -- 172.21.15.154:0/588364713 shutdown_connections 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.184+0000 7f497b28b700 1 -- 172.21.15.154:0/588364713 wait complete. 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.185+0000 7f497b28b700 1 Processor -- start 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f497b28b700 1 -- start start 2023-09-30T22:25:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f497b28b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49741300a0 0x7f497411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f497b28b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741309f0 0x7f497411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f497b28b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4974133ad0 0x7f497411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f497b28b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4974120b70 con 0x7f49741300a0 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f497b28b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4974072290 con 0x7f4974133ad0 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f497b28b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f497411ff90 con 0x7f49741309f0 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f4979027700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49741300a0 0x7f497411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f4979027700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49741300a0 0x7f497411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38316/0 (socket says 172.21.15.154:38316) 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f4979027700 1 -- 172.21.15.154:0/2149462180 learned_addr learned my addr 172.21.15.154:0/2149462180 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f4979828700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4974133ad0 0x7f497411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.186+0000 7f4978826700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741309f0 0x7f497411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4979027700 1 -- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741309f0 msgr2=0x7f497411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4979027700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741309f0 0x7f497411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4979027700 1 -- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4974133ad0 msgr2=0x7f497411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4979027700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4974133ad0 0x7f497411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4979027700 1 -- 172.21.15.154:0/2149462180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700094a0 con 0x7f49741300a0 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4979828700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4974133ad0 0x7f497411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4979027700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49741300a0 0x7f497411da40 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4964000c00 tx=0x7f4964004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4969ffb700 1 -- 172.21.15.154:0/2149462180 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49640036a0 con 0x7f49741300a0 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4969ffb700 1 -- 172.21.15.154:0/2149462180 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4964003800 con 0x7f49741300a0 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f497b28b700 1 -- 172.21.15.154:0/2149462180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4964009550 con 0x7f49741300a0 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f4969ffb700 1 -- 172.21.15.154:0/2149462180 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964003bb0 con 0x7f49741300a0 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.187+0000 7f497b28b700 1 -- 172.21.15.154:0/2149462180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4974120250 con 0x7f49741300a0 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.188+0000 7f4969ffb700 1 -- 172.21.15.154:0/2149462180 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4964021070 con 0x7f49741300a0 2023-09-30T22:25:09.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.188+0000 7f4969ffb700 1 -- 172.21.15.154:0/2149462180 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4964040a30 con 0x7f49741300a0 2023-09-30T22:25:09.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.188+0000 7f497b28b700 1 -- 172.21.15.154:0/2149462180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4974120250 con 0x7f49741300a0 2023-09-30T22:25:09.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.193+0000 7f4969ffb700 1 -- 172.21.15.154:0/2149462180 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4974120250 con 0x7f49741300a0 2023-09-30T22:25:09.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:09.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:09.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.313+0000 7f93eca1f700 1 Processor -- start 2023-09-30T22:25:09.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.314+0000 7f93eca1f700 1 -- start start 2023-09-30T22:25:09.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.314+0000 7f93eca1f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809f350 0x7f93e8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.314+0000 7f93eca1f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93e81371c0 0x7f93e81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.314+0000 7f93eca1f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e809c970 con 0x7f93e809e870 2023-09-30T22:25:09.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.314+0000 7f93eca1f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e80a0920 con 0x7f93e81371c0 2023-09-30T22:25:09.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.314+0000 7f93eca1f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e809f9c0 con 0x7f93e809f350 2023-09-30T22:25:09.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.314+0000 7f93e659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f93e809e870 0x7f93e809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47230/0 (socket says 172.21.15.154:47230) 2023-09-30T22:25:09.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.314+0000 7f93e659c700 1 -- 172.21.15.154:0/3296618944 learned_addr learned my addr 172.21.15.154:0/3296618944 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e5d9b700 1 --2- 172.21.15.154:0/3296618944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809f350 0x7f93e8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e6d9d700 1 --2- 172.21.15.154:0/3296618944 >> v2:172.21.15.154:3300/0 conn(0x7f93e81371c0 0x7f93e81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e559a700 1 -- 172.21.15.154:0/3296618944 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163559005 0 0) 0x7f93e809c970 con 0x7f93e809e870 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e559a700 1 -- 172.21.15.154:0/3296618944 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93d00035b0 con 0x7f93e809e870 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e5d9b700 1 -- 172.21.15.154:0/3296618944 >> v2:172.21.15.154:3300/0 conn(0x7f93e81371c0 msgr2=0x7f93e81395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e5d9b700 1 --2- 172.21.15.154:0/3296618944 >> v2:172.21.15.154:3300/0 conn(0x7f93e81371c0 0x7f93e81395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e5d9b700 1 -- 172.21.15.154:0/3296618944 >> v1:172.21.15.154:6789/0 conn(0x7f93e809e870 legacy=0x7f93e809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e5d9b700 1 -- 172.21.15.154:0/3296618944 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e809bab0 con 0x7f93e809f350 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e5d9b700 1 --2- 172.21.15.154:0/3296618944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809f350 0x7f93e8136c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009840 tx=0x7f93dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d153ca9962e88414 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e559a700 1 -- 172.21.15.154:0/3296618944 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc011830 con 0x7f93e809f350 2023-09-30T22:25:09.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e559a700 1 -- 172.21.15.154:0/3296618944 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc011990 con 0x7f93e809f350 2023-09-30T22:25:09.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.315+0000 7f93e559a700 1 -- 172.21.15.154:0/3296618944 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc011d00 con 0x7f93e809f350 2023-09-30T22:25:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.316+0000 7f93eca1f700 1 -- 172.21.15.154:0/3296618944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809f350 msgr2=0x7f93e8136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.316+0000 7f93eca1f700 1 --2- 172.21.15.154:0/3296618944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809f350 0x7f93e8136c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009840 tx=0x7f93dc009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.316+0000 7f93eca1f700 1 -- 172.21.15.154:0/3296618944 shutdown_connections 2023-09-30T22:25:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.316+0000 7f93eca1f700 1 --2- 172.21.15.154:0/3296618944 >> v2:172.21.15.154:3300/0 conn(0x7f93e81371c0 0x7f93e81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.316+0000 7f93eca1f700 1 --2- 172.21.15.154:0/3296618944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809f350 0x7f93e8136c80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.316+0000 7f93eca1f700 1 -- 172.21.15.154:0/3296618944 >> 172.21.15.154:0/3296618944 conn(0x7f93e80a4430 msgr2=0x7f93e80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.316+0000 7f93eca1f700 1 -- 172.21.15.154:0/3296618944 shutdown_connections 2023-09-30T22:25:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.316+0000 7f93eca1f700 1 -- 172.21.15.154:0/3296618944 wait complete. 2023-09-30T22:25:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.317+0000 7f93eca1f700 1 Processor -- start 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.317+0000 7f93eca1f700 1 -- start start 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93eca1f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809e870 0x7f93e811e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93eca1f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93e809f350 0x7f93e811eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93eca1f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93e81371c0 0x7f93e811f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93eca1f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8122070 con 0x7f93e81371c0 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93eca1f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e806d140 con 0x7f93e809e870 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93eca1f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93e809dba0 con 0x7f93e809f350 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93e809f350 0x7f93e811eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93e809f350 0x7f93e811eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48990/0 (socket says 172.21.15.154:48990) 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e5d9b700 1 -- 172.21.15.154:0/3869203479 learned_addr learned my addr 172.21.15.154:0/3869203479 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e659c700 1 --2- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809e870 0x7f93e811e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e6d9d700 1 --2- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93e81371c0 0x7f93e811f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e5d9b700 1 -- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809e870 msgr2=0x7f93e811e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e5d9b700 1 --2- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809e870 0x7f93e811e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e5d9b700 1 -- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93e81371c0 msgr2=0x7f93e811f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e5d9b700 1 --2- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93e81371c0 0x7f93e811f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.318+0000 7f93e5d9b700 1 -- 172.21.15.154:0/3869203479 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc0094a0 con 0x7f93e809f350 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.319+0000 7f93e5d9b700 1 --2- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93e809f350 0x7f93e811eae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009b90 tx=0x7f93dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.319+0000 7f93d6ffd700 1 -- 172.21.15.154:0/3869203479 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc004550 con 0x7f93e809f350 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.319+0000 7f93d6ffd700 1 -- 172.21.15.154:0/3869203479 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc01f070 con 0x7f93e809f350 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.319+0000 7f93eca1f700 1 -- 172.21.15.154:0/3869203479 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e8121ad0 con 0x7f93e809f350 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.319+0000 7f93eca1f700 1 -- 172.21.15.154:0/3869203479 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e8122800 con 0x7f93e809f350 2023-09-30T22:25:09.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.319+0000 7f93d6ffd700 1 -- 172.21.15.154:0/3869203479 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc0038e0 con 0x7f93e809f350 2023-09-30T22:25:09.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.320+0000 7f93eca1f700 1 -- 172.21.15.154:0/3869203479 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc0052e0 con 0x7f93e809f350 2023-09-30T22:25:09.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.320+0000 7f93d6ffd700 1 -- 172.21.15.154:0/3869203479 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93dc003a40 con 0x7f93e809f350 2023-09-30T22:25:09.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.321+0000 7f93d6ffd700 1 -- 172.21.15.154:0/3869203479 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93dc021070 con 0x7f93e809f350 2023-09-30T22:25:09.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.326+0000 7f93d6ffd700 1 -- 172.21.15.154:0/3869203479 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93dc019d80 con 0x7f93e809f350 2023-09-30T22:25:09.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.352+0000 7f2bfb851700 1 Processor -- start 2023-09-30T22:25:09.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.352+0000 7f2bfb851700 1 -- start start 2023-09-30T22:25:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.352+0000 7f2bfb851700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.352+0000 7f2bfb851700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf409e170 0x7f2bf41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.352+0000 7f2bfb851700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf409aaa0 con 0x7f2bf4130ce0 2023-09-30T22:25:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.352+0000 7f2bfb851700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf409f870 con 0x7f2bf409d860 2023-09-30T22:25:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.352+0000 7f2bfb851700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf409b360 con 0x7f2bf409e170 2023-09-30T22:25:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf95ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf8dec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf409e170 0x7f2bf41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf95ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32812/0 (socket says 172.21.15.154:32812) 2023-09-30T22:25:09.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf95ed700 1 -- 172.21.15.154:0/2874134088 learned_addr learned my addr 172.21.15.154:0/2874134088 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf95ed700 1 -- 172.21.15.154:0/2874134088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf409e170 msgr2=0x7f2bf41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf95ed700 1 --2- 172.21.15.154:0/2874134088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf409e170 0x7f2bf41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf95ed700 1 -- 172.21.15.154:0/2874134088 >> v1:172.21.15.154:6789/0 conn(0x7f2bf4130ce0 legacy=0x7f2bf41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bebfff700 1 -- 172.21.15.154:0/2874134088 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404102051 0 0) 0x7f2bf409aaa0 con 0x7f2bf4130ce0 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf95ed700 1 -- 172.21.15.154:0/2874134088 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf409b620 con 0x7f2bf409d860 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf8dec700 1 --2- 172.21.15.154:0/2874134088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf409e170 0x7f2bf41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bf95ed700 1 --2- 172.21.15.154:0/2874134088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf409dc30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009920 tx=0x7f2bf0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe5e5866ce8619d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bebfff700 1 -- 172.21.15.154:0/2874134088 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0011830 con 0x7f2bf409d860 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bebfff700 1 -- 172.21.15.154:0/2874134088 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0011990 con 0x7f2bf409d860 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.353+0000 7f2bebfff700 1 -- 172.21.15.154:0/2874134088 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0011d20 con 0x7f2bf409d860 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.354+0000 7f2bfb851700 1 -- 172.21.15.154:0/2874134088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 msgr2=0x7f2bf409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.354+0000 7f2bfb851700 1 --2- 172.21.15.154:0/2874134088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf409dc30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009920 tx=0x7f2bf0009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.354+0000 7f2bfb851700 1 -- 172.21.15.154:0/2874134088 shutdown_connections 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.354+0000 7f2bfb851700 1 --2- 172.21.15.154:0/2874134088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf409dc30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.354+0000 7f2bfb851700 1 --2- 172.21.15.154:0/2874134088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf409e170 0x7f2bf41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.354+0000 7f2bfb851700 1 -- 172.21.15.154:0/2874134088 >> 172.21.15.154:0/2874134088 conn(0x7f2bf4099c40 msgr2=0x7f2bf40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.354+0000 7f2bfb851700 1 -- 172.21.15.154:0/2874134088 shutdown_connections 2023-09-30T22:25:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.354+0000 7f2bfb851700 1 -- 172.21.15.154:0/2874134088 wait complete. 2023-09-30T22:25:09.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.355+0000 7f2bfb851700 1 Processor -- start 2023-09-30T22:25:09.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.355+0000 7f2bfb851700 1 -- start start 2023-09-30T22:25:09.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bfb851700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf41364d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bfb851700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf409e170 0x7f2bf4136a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bfb851700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf4130ce0 0x7f2bf4136f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bfb851700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf4139a00 con 0x7f2bf409e170 2023-09-30T22:25:09.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bfb851700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf4139730 con 0x7f2bf409d860 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bfb851700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40a0780 con 0x7f2bf4130ce0 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf95ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf41364d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf95ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf41364d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32820/0 (socket says 172.21.15.154:32820) 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf95ed700 1 -- 172.21.15.154:0/1229534668 learned_addr learned my addr 172.21.15.154:0/1229534668 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf8dec700 1 --2- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf409e170 0x7f2bf4136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf9dee700 1 --2- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf4130ce0 0x7f2bf4136f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf95ed700 1 -- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf4130ce0 msgr2=0x7f2bf4136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf95ed700 1 --2- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf4130ce0 0x7f2bf4136f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf95ed700 1 -- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf409e170 msgr2=0x7f2bf4136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf95ed700 1 --2- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf409e170 0x7f2bf4136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf95ed700 1 -- 172.21.15.154:0/1229534668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be40094a0 con 0x7f2bf409d860 2023-09-30T22:25:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2bf95ed700 1 --2- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf41364d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0000c00 tx=0x7f2bf0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.356+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1229534668 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0004510 con 0x7f2bf409d860 2023-09-30T22:25:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.357+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1229534668 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf00036a0 con 0x7f2bf409d860 2023-09-30T22:25:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.357+0000 7f2bfb851700 1 -- 172.21.15.154:0/1229534668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf0009550 con 0x7f2bf409d860 2023-09-30T22:25:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.357+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1229534668 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0003a10 con 0x7f2bf409d860 2023-09-30T22:25:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.357+0000 7f2bfb851700 1 -- 172.21.15.154:0/1229534668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf41385f0 con 0x7f2bf409d860 2023-09-30T22:25:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.357+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1229534668 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bf0021070 con 0x7f2bf409d860 2023-09-30T22:25:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.358+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1229534668 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2bf0040a30 con 0x7f2bf409d860 2023-09-30T22:25:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.358+0000 7f2bfb851700 1 -- 172.21.15.154:0/1229534668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf404f2a0 con 0x7f2bf409d860 2023-09-30T22:25:09.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.362+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1229534668 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bf001a450 con 0x7f2bf409d860 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.400+0000 7f497b28b700 1 -- 172.21.15.154:0/2149462180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4974120250 con 0x7f49741300a0 2023-09-30T22:25:09.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.401+0000 7f4969ffb700 1 -- 172.21.15.154:0/2149462180 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4974120250 con 0x7f49741300a0 2023-09-30T22:25:09.401 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.403+0000 7f497b28b700 1 -- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49741300a0 msgr2=0x7f497411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.403+0000 7f497b28b700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49741300a0 0x7f497411da40 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4964000c00 tx=0x7f4964004750 comp rx=0 tx=0).stop 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.403+0000 7f497b28b700 1 -- 172.21.15.154:0/2149462180 shutdown_connections 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.403+0000 7f497b28b700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4974133ad0 0x7f497411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.403+0000 7f497b28b700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49741300a0 0x7f497411da40 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.403+0000 7f497b28b700 1 --2- 172.21.15.154:0/2149462180 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49741309f0 0x7f497411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.403+0000 7f497b28b700 1 -- 172.21.15.154:0/2149462180 >> 172.21.15.154:0/2149462180 conn(0x7f4974099c40 msgr2=0x7f49740a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.403+0000 7f497b28b700 1 -- 172.21.15.154:0/2149462180 shutdown_connections 2023-09-30T22:25:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.403+0000 7f497b28b700 1 -- 172.21.15.154:0/2149462180 wait complete. 2023-09-30T22:25:09.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:09.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f8435e36700 1 Processor -- start 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f8435e36700 1 -- start start 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f8435e36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f84301359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f8435e36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8430135f20 0x7f8430138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f8435e36700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843009aaa0 con 0x7f843009d860 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f8435e36700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843009e730 con 0x7f8430135f20 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f8435e36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843009f870 con 0x7f843009e340 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f842effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f84301359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f842effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f84301359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32830/0 (socket says 172.21.15.154:32830) 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f842effd700 1 -- 172.21.15.154:0/747552019 learned_addr learned my addr 172.21.15.154:0/747552019 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.441+0000 7f842ffff700 1 --2- 172.21.15.154:0/747552019 >> v2:172.21.15.154:3300/0 conn(0x7f8430135f20 0x7f8430138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f842effd700 1 -- 172.21.15.154:0/747552019 >> v2:172.21.15.154:3300/0 conn(0x7f8430135f20 msgr2=0x7f8430138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f842effd700 1 --2- 172.21.15.154:0/747552019 >> v2:172.21.15.154:3300/0 conn(0x7f8430135f20 0x7f8430138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f842effd700 1 -- 172.21.15.154:0/747552019 >> v1:172.21.15.154:6789/0 conn(0x7f843009d860 legacy=0x7f843009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f842effd700 1 -- 172.21.15.154:0/747552019 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843009b360 con 0x7f843009e340 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f842effd700 1 --2- 172.21.15.154:0/747552019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f84301359e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f84240098f0 tx=0x7f8424009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b14dbdac0895e35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f842e7fc700 1 -- 172.21.15.154:0/747552019 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424011830 con 0x7f843009e340 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f842e7fc700 1 -- 172.21.15.154:0/747552019 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8424011990 con 0x7f843009e340 2023-09-30T22:25:09.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f842e7fc700 1 -- 172.21.15.154:0/747552019 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424011d20 con 0x7f843009e340 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f8435e36700 1 -- 172.21.15.154:0/747552019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 msgr2=0x7f84301359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.442+0000 7f8435e36700 1 --2- 172.21.15.154:0/747552019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f84301359e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f84240098f0 tx=0x7f8424009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:09.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.443+0000 7f8435e36700 1 -- 172.21.15.154:0/747552019 shutdown_connections 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.443+0000 7f8435e36700 1 --2- 172.21.15.154:0/747552019 >> v2:172.21.15.154:3300/0 conn(0x7f8430135f20 0x7f8430138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.443+0000 7f8435e36700 1 --2- 172.21.15.154:0/747552019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f84301359e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.443+0000 7f8435e36700 1 -- 172.21.15.154:0/747552019 >> 172.21.15.154:0/747552019 conn(0x7f8430099c40 msgr2=0x7f84300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.443+0000 7f8435e36700 1 -- 172.21.15.154:0/747552019 shutdown_connections 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.443+0000 7f8435e36700 1 -- 172.21.15.154:0/747552019 wait complete. 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.443+0000 7f8435e36700 1 Processor -- start 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f8435e36700 1 -- start start 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f8435e36700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843009d860 0x7f843011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f8435e36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f843011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f8435e36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8430135f20 0x7f843011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:09.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f8435e36700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843009c8b0 con 0x7f843009d860 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f8435e36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8430120a80 con 0x7f843009e340 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f8435e36700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8430072280 con 0x7f8430135f20 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f842effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f843011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f842f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843009d860 0x7f843011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f842effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f843011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32836/0 (socket says 172.21.15.154:32836) 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f842effd700 1 -- 172.21.15.154:0/4047588661 learned_addr learned my addr 172.21.15.154:0/4047588661 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.444+0000 7f842ffff700 1 --2- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8430135f20 0x7f843011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f842effd700 1 -- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8430135f20 msgr2=0x7f843011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f842effd700 1 --2- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8430135f20 0x7f843011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f842effd700 1 -- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843009d860 msgr2=0x7f843011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f842effd700 1 --2- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843009d860 0x7f843011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f842effd700 1 -- 172.21.15.154:0/4047588661 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424009550 con 0x7f843009e340 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f842f7fe700 1 --2- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843009d860 0x7f843011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f842effd700 1 --2- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f843011df80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8424009c40 tx=0x7f8424004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f8417fff700 1 -- 172.21.15.154:0/4047588661 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424004510 con 0x7f843009e340 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f8417fff700 1 -- 172.21.15.154:0/4047588661 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84240036a0 con 0x7f843009e340 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f8417fff700 1 -- 172.21.15.154:0/4047588661 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424003a50 con 0x7f843009e340 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f8435e36700 1 -- 172.21.15.154:0/4047588661 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8430135c10 con 0x7f843009e340 2023-09-30T22:25:09.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.445+0000 7f8435e36700 1 -- 172.21.15.154:0/4047588661 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8430121a80 con 0x7f843009e340 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.446+0000 7f8417fff700 1 -- 172.21.15.154:0/4047588661 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8424021070 con 0x7f843009e340 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.446+0000 7f8435e36700 1 -- 172.21.15.154:0/4047588661 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843004f2a0 con 0x7f843009e340 2023-09-30T22:25:09.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.446+0000 7f8417fff700 1 -- 172.21.15.154:0/4047588661 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8424040b00 con 0x7f843009e340 2023-09-30T22:25:09.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.451+0000 7f8417fff700 1 -- 172.21.15.154:0/4047588661 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8424019770 con 0x7f843009e340 2023-09-30T22:25:09.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.543+0000 7f93eca1f700 1 -- 172.21.15.154:0/3869203479 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f93cc005590 con 0x7f93e809f350 2023-09-30T22:25:09.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.544+0000 7f93d6ffd700 1 -- 172.21.15.154:0/3869203479 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93dc015030 con 0x7f93e809f350 2023-09-30T22:25:09.545 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.546+0000 7f93eca1f700 1 -- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93e809f350 msgr2=0x7f93e811eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.546+0000 7f93eca1f700 1 --2- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93e809f350 0x7f93e811eae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009b90 tx=0x7f93dc004750 comp rx=0 tx=0).stop 2023-09-30T22:25:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.546+0000 7f93eca1f700 1 -- 172.21.15.154:0/3869203479 shutdown_connections 2023-09-30T22:25:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.546+0000 7f93eca1f700 1 --2- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93e81371c0 0x7f93e811f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.546+0000 7f93eca1f700 1 --2- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93e809e870 0x7f93e811e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.546+0000 7f93eca1f700 1 --2- 172.21.15.154:0/3869203479 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93e809f350 0x7f93e811eae0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.546+0000 7f93eca1f700 1 -- 172.21.15.154:0/3869203479 >> 172.21.15.154:0/3869203479 conn(0x7f93e80a4430 msgr2=0x7f93e8071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.546+0000 7f93eca1f700 1 -- 172.21.15.154:0/3869203479 shutdown_connections 2023-09-30T22:25:09.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.546+0000 7f93eca1f700 1 -- 172.21.15.154:0/3869203479 wait complete. 2023-09-30T22:25:09.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:09.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.575+0000 7f2bfb851700 1 -- 172.21.15.154:0/1229534668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2bf41388a0 con 0x7f2bf409d860 2023-09-30T22:25:09.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.576+0000 7f2be9ffb700 1 -- 172.21.15.154:0/1229534668 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bf0015020 con 0x7f2bf409d860 2023-09-30T22:25:09.577 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:09.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.578+0000 7f2bfb851700 1 -- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 msgr2=0x7f2bf41364d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.578+0000 7f2bfb851700 1 --2- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf41364d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0000c00 tx=0x7f2bf0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:09.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.578+0000 7f2bfb851700 1 -- 172.21.15.154:0/1229534668 shutdown_connections 2023-09-30T22:25:09.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.578+0000 7f2bfb851700 1 --2- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2bf4130ce0 0x7f2bf4136f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.578+0000 7f2bfb851700 1 --2- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf409d860 0x7f2bf41364d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.578+0000 7f2bfb851700 1 --2- 172.21.15.154:0/1229534668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf409e170 0x7f2bf4136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.578+0000 7f2bfb851700 1 -- 172.21.15.154:0/1229534668 >> 172.21.15.154:0/1229534668 conn(0x7f2bf4099c40 msgr2=0x7f2bf40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.578+0000 7f2bfb851700 1 -- 172.21.15.154:0/1229534668 shutdown_connections 2023-09-30T22:25:09.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.578+0000 7f2bfb851700 1 -- 172.21.15.154:0/1229534668 wait complete. 2023-09-30T22:25:09.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:09.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.642+0000 7f8435e36700 1 -- 172.21.15.154:0/4047588661 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f843006c3b0 con 0x7f843009e340 2023-09-30T22:25:09.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.642+0000 7f8417fff700 1 -- 172.21.15.154:0/4047588661 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8424029030 con 0x7f843009e340 2023-09-30T22:25:09.643 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.645+0000 7f8435e36700 1 -- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 msgr2=0x7f843011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.645+0000 7f8435e36700 1 --2- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f843011df80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8424009c40 tx=0x7f8424004750 comp rx=0 tx=0).stop 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.645+0000 7f8435e36700 1 -- 172.21.15.154:0/4047588661 shutdown_connections 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.645+0000 7f8435e36700 1 --2- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8430135f20 0x7f843011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.645+0000 7f8435e36700 1 --2- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f843009d860 0x7f843011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.645+0000 7f8435e36700 1 --2- 172.21.15.154:0/4047588661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f843009e340 0x7f843011df80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.645+0000 7f8435e36700 1 -- 172.21.15.154:0/4047588661 >> 172.21.15.154:0/4047588661 conn(0x7f8430099c40 msgr2=0x7f84300a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.645+0000 7f8435e36700 1 -- 172.21.15.154:0/4047588661 shutdown_connections 2023-09-30T22:25:09.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:09.645+0000 7f8435e36700 1 -- 172.21.15.154:0/4047588661 wait complete. 2023-09-30T22:25:09.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:10.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:10.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.551+0000 7fecd28e1700 1 Processor -- start 2023-09-30T22:25:10.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.551+0000 7fecd28e1700 1 -- start start 2023-09-30T22:25:10.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7fecd28e1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc09d860 0x7feccc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7fecd28e1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09e170 0x7feccc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7fecd28e1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feccc130ce0 0x7feccc131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7fecd28e1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc09aaa0 con 0x7feccc130ce0 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7fecd28e1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc09f870 con 0x7feccc09d860 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7fecd28e1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feccc09b360 con 0x7feccc09e170 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc09d860 0x7feccc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09e170 0x7feccc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7fecd0e7e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feccc130ce0 0x7feccc131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc09d860 0x7feccc09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32850/0 (socket says 172.21.15.154:32850) 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09e170 0x7feccc1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:49014/0 (socket says 172.21.15.154:49014) 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7fecd0e7e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feccc130ce0 0x7feccc131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38388/0 (socket says 172.21.15.154:38388) 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccbfff700 1 -- 172.21.15.154:0/3305219011 learned_addr learned my addr 172.21.15.154:0/3305219011 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccb7fe700 1 -- 172.21.15.154:0/3305219011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc09d860 msgr2=0x7feccc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccb7fe700 1 --2- 172.21.15.154:0/3305219011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc09d860 0x7feccc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccb7fe700 1 -- 172.21.15.154:0/3305219011 >> v2:172.21.15.154:3300/0 conn(0x7feccc130ce0 msgr2=0x7feccc131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccb7fe700 1 --2- 172.21.15.154:0/3305219011 >> v2:172.21.15.154:3300/0 conn(0x7feccc130ce0 0x7feccc131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccb7fe700 1 -- 172.21.15.154:0/3305219011 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc09b620 con 0x7feccc09e170 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.552+0000 7feccbfff700 1 --2- 172.21.15.154:0/3305219011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc09d860 0x7feccc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7feccb7fe700 1 --2- 172.21.15.154:0/3305219011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09e170 0x7feccc1307a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009840 tx=0x7fecbc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28c04ad2ade00572 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7feccaffd700 1 -- 172.21.15.154:0/3305219011 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc011830 con 0x7feccc09e170 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7feccaffd700 1 -- 172.21.15.154:0/3305219011 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc011990 con 0x7feccc09e170 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7feccaffd700 1 -- 172.21.15.154:0/3305219011 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc011d20 con 0x7feccc09e170 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7fecd28e1700 1 -- 172.21.15.154:0/3305219011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09e170 msgr2=0x7feccc1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7fecd28e1700 1 --2- 172.21.15.154:0/3305219011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09e170 0x7feccc1307a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009840 tx=0x7fecbc009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7fecd28e1700 1 -- 172.21.15.154:0/3305219011 shutdown_connections 2023-09-30T22:25:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7fecd28e1700 1 --2- 172.21.15.154:0/3305219011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc09d860 0x7feccc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7fecd28e1700 1 --2- 172.21.15.154:0/3305219011 >> v2:172.21.15.154:3300/0 conn(0x7feccc130ce0 0x7feccc131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7fecd28e1700 1 --2- 172.21.15.154:0/3305219011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09e170 0x7feccc1307a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7fecd28e1700 1 -- 172.21.15.154:0/3305219011 >> 172.21.15.154:0/3305219011 conn(0x7feccc099c40 msgr2=0x7feccc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7fecd28e1700 1 -- 172.21.15.154:0/3305219011 shutdown_connections 2023-09-30T22:25:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.553+0000 7fecd28e1700 1 -- 172.21.15.154:0/3305219011 wait complete. 2023-09-30T22:25:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.554+0000 7fecd28e1700 1 Processor -- start 2023-09-30T22:25:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.554+0000 7fecd28e1700 1 -- start start 2023-09-30T22:25:10.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7fecd28e1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09d860 0x7feccc11ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7fecd28e1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc09e170 0x7feccc11f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7fecd28e1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc130ce0 0x7feccc11fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7fecd28e1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc126870 con 0x7feccc09e170 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7fecd28e1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc120160 con 0x7feccc130ce0 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7fecd28e1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feccc09c8b0 con 0x7feccc09d860 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc09e170 0x7feccc11f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc09e170 0x7feccc11f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38394/0 (socket says 172.21.15.154:38394) 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccb7fe700 1 -- 172.21.15.154:0/3146038016 learned_addr learned my addr 172.21.15.154:0/3146038016 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7fecd0e7e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc130ce0 0x7feccc11fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccbfff700 1 --2- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09d860 0x7feccc11ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccb7fe700 1 -- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09d860 msgr2=0x7feccc11ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccb7fe700 1 --2- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09d860 0x7feccc11ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccb7fe700 1 -- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc130ce0 msgr2=0x7feccc11fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccb7fe700 1 --2- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc130ce0 0x7feccc11fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccb7fe700 1 -- 172.21.15.154:0/3146038016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc0009550 con 0x7feccc09e170 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7fecd0e7e700 1 --2- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc130ce0 0x7feccc11fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7feccb7fe700 1 --2- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc09e170 0x7feccc11f4c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0090b0 tx=0x7fecbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.555+0000 7fecc8ff9700 1 -- 172.21.15.154:0/3146038016 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc004240 con 0x7feccc09e170 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.556+0000 7fecc8ff9700 1 -- 172.21.15.154:0/3146038016 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc01f070 con 0x7feccc09e170 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.556+0000 7fecd28e1700 1 -- 172.21.15.154:0/3146038016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc0094a0 con 0x7feccc09e170 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.556+0000 7fecc8ff9700 1 -- 172.21.15.154:0/3146038016 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0036a0 con 0x7feccc09e170 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.556+0000 7fecd28e1700 1 -- 172.21.15.154:0/3146038016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc125fa0 con 0x7feccc09e170 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.556+0000 7fecc8ff9700 1 -- 172.21.15.154:0/3146038016 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecbc021030 con 0x7feccc09e170 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.556+0000 7fecc8ff9700 1 -- 172.21.15.154:0/3146038016 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fecbc0404f0 con 0x7feccc09e170 2023-09-30T22:25:10.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.556+0000 7fecd28e1700 1 -- 172.21.15.154:0/3146038016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc04f2a0 con 0x7feccc09e170 2023-09-30T22:25:10.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:10.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.561+0000 7fecc8ff9700 1 -- 172.21.15.154:0/3146038016 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecbc015020 con 0x7feccc09e170 2023-09-30T22:25:10.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:10.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:10.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.693+0000 7fb4051c6700 1 Processor -- start 2023-09-30T22:25:10.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.693+0000 7fb4051c6700 1 -- start start 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.693+0000 7fb4051c6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40012d280 0x7fb40012d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.693+0000 7fb4051c6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 0x7fb400138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.693+0000 7fb4051c6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40009ae40 con 0x7fb400130350 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.693+0000 7fb4051c6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40009b9a0 con 0x7fb400130eb0 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.693+0000 7fb4051c6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40009bbb0 con 0x7fb40012d280 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3fe59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb400130350 0x7fb4001307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47260/0 (socket says 172.21.15.154:47260) 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3fe59c700 1 -- 172.21.15.154:0/1257682871 learned_addr learned my addr 172.21.15.154:0/1257682871 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3ff59e700 1 --2- 172.21.15.154:0/1257682871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 0x7fb400138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3fdd9b700 1 -- 172.21.15.154:0/1257682871 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673024688 0 0) 0x7fb40009ae40 con 0x7fb400130350 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3fed9d700 1 --2- 172.21.15.154:0/1257682871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40012d280 0x7fb40012d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3fdd9b700 1 -- 172.21.15.154:0/1257682871 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e80057c0 con 0x7fb400130350 2023-09-30T22:25:10.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3ff59e700 1 -- 172.21.15.154:0/1257682871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40012d280 msgr2=0x7fb40012d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3ff59e700 1 --2- 172.21.15.154:0/1257682871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40012d280 0x7fb40012d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3ff59e700 1 -- 172.21.15.154:0/1257682871 >> v1:172.21.15.154:6789/0 conn(0x7fb400130350 legacy=0x7fb4001307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3ff59e700 1 -- 172.21.15.154:0/1257682871 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40009b250 con 0x7fb400130eb0 2023-09-30T22:25:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.694+0000 7fb3ff59e700 1 --2- 172.21.15.154:0/1257682871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 0x7fb400138690 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009dc0 tx=0x7fb3f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d317fc5c4e8400 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.695+0000 7fb3fdd9b700 1 -- 172.21.15.154:0/1257682871 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800e070 con 0x7fb400130eb0 2023-09-30T22:25:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.695+0000 7fb3fdd9b700 1 -- 172.21.15.154:0/1257682871 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f800bb20 con 0x7fb400130eb0 2023-09-30T22:25:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.695+0000 7fb3fdd9b700 1 -- 172.21.15.154:0/1257682871 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800be90 con 0x7fb400130eb0 2023-09-30T22:25:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.695+0000 7fb4051c6700 1 -- 172.21.15.154:0/1257682871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 msgr2=0x7fb400138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.695+0000 7fb4051c6700 1 --2- 172.21.15.154:0/1257682871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 0x7fb400138690 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009dc0 tx=0x7fb3f800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.696+0000 7fb4051c6700 1 -- 172.21.15.154:0/1257682871 shutdown_connections 2023-09-30T22:25:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.696+0000 7fb4051c6700 1 --2- 172.21.15.154:0/1257682871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 0x7fb400138690 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.696+0000 7fb4051c6700 1 --2- 172.21.15.154:0/1257682871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40012d280 0x7fb40012d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.696+0000 7fb4051c6700 1 -- 172.21.15.154:0/1257682871 >> 172.21.15.154:0/1257682871 conn(0x7fb4000a2980 msgr2=0x7fb4000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.696+0000 7fb4051c6700 1 -- 172.21.15.154:0/1257682871 shutdown_connections 2023-09-30T22:25:10.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.696+0000 7fb4051c6700 1 -- 172.21.15.154:0/1257682871 wait complete. 2023-09-30T22:25:10.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.697+0000 7fb4051c6700 1 Processor -- start 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.697+0000 7fb4051c6700 1 -- start start 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.697+0000 7fb4051c6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40012d280 0x7fb40011a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.697+0000 7fb4051c6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb400130350 0x7fb40011aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.697+0000 7fb4051c6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 0x7fb40011b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.697+0000 7fb4051c6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40009b500 con 0x7fb40012d280 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.697+0000 7fb4051c6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb400072720 con 0x7fb400130eb0 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.697+0000 7fb4051c6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40011ce00 con 0x7fb400130350 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40012d280 0x7fb40011a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40012d280 0x7fb40011a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38404/0 (socket says 172.21.15.154:38404) 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fed9d700 1 -- 172.21.15.154:0/2969228790 learned_addr learned my addr 172.21.15.154:0/2969228790 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:10.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fe59c700 1 --2- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb400130350 0x7fb40011aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3ff59e700 1 --2- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 0x7fb40011b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fe59c700 1 -- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 msgr2=0x7fb40011b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fe59c700 1 --2- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 0x7fb40011b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fe59c700 1 -- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40012d280 msgr2=0x7fb40011a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fe59c700 1 --2- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40012d280 0x7fb40011a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fe59c700 1 -- 172.21.15.154:0/2969228790 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009a70 con 0x7fb400130350 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3fe59c700 1 --2- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb400130350 0x7fb40011aed0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400c460 tx=0x7fb3f400c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3e77fe700 1 -- 172.21.15.154:0/2969228790 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4005d70 con 0x7fb400130350 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3e77fe700 1 -- 172.21.15.154:0/2969228790 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f40070d0 con 0x7fb400130350 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.698+0000 7fb3e77fe700 1 -- 172.21.15.154:0/2969228790 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4007440 con 0x7fb400130350 2023-09-30T22:25:10.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.699+0000 7fb4051c6700 1 -- 172.21.15.154:0/2969228790 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40011cb50 con 0x7fb400130350 2023-09-30T22:25:10.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.699+0000 7fb4051c6700 1 -- 172.21.15.154:0/2969228790 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40011dc40 con 0x7fb400130350 2023-09-30T22:25:10.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.700+0000 7fb4051c6700 1 -- 172.21.15.154:0/2969228790 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40004f2a0 con 0x7fb400130350 2023-09-30T22:25:10.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.700+0000 7fb3e77fe700 1 -- 172.21.15.154:0/2969228790 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3f40075a0 con 0x7fb400130350 2023-09-30T22:25:10.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.701+0000 7fb3e77fe700 1 -- 172.21.15.154:0/2969228790 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3f403ef40 con 0x7fb400130350 2023-09-30T22:25:10.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.709+0000 7fb3e77fe700 1 -- 172.21.15.154:0/2969228790 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3f4019b90 con 0x7fb400130350 2023-09-30T22:25:10.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.736+0000 7f86b0c91700 1 Processor -- start 2023-09-30T22:25:10.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86b0c91700 1 -- start start 2023-09-30T22:25:10.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86b0c91700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86ac09f350 0x7f86ac136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86b0c91700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac1371c0 0x7f86ac1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86b0c91700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac09c970 con 0x7f86ac09e870 2023-09-30T22:25:10.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86b0c91700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac0a0920 con 0x7f86ac09f350 2023-09-30T22:25:10.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86b0c91700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac09f9c0 con 0x7f86ac1371c0 2023-09-30T22:25:10.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86a9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86ac09f350 0x7f86ac136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86a9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86ac09f350 0x7f86ac136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38412/0 (socket says 172.21.15.154:38412) 2023-09-30T22:25:10.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86a9d9b700 1 -- 172.21.15.154:0/1363702076 learned_addr learned my addr 172.21.15.154:0/1363702076 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:10.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.737+0000 7f86aad9d700 1 --2- 172.21.15.154:0/1363702076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac1371c0 0x7f86ac1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.738+0000 7f86aad9d700 1 -- 172.21.15.154:0/1363702076 >> v2:172.21.15.154:3300/0 conn(0x7f86ac09f350 msgr2=0x7f86ac136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.738+0000 7f86aad9d700 1 --2- 172.21.15.154:0/1363702076 >> v2:172.21.15.154:3300/0 conn(0x7f86ac09f350 0x7f86ac136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.738+0000 7f86aad9d700 1 -- 172.21.15.154:0/1363702076 >> v1:172.21.15.154:6789/0 conn(0x7f86ac09e870 legacy=0x7f86ac09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.738+0000 7f86aad9d700 1 -- 172.21.15.154:0/1363702076 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac09bab0 con 0x7f86ac1371c0 2023-09-30T22:25:10.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.738+0000 7f86aad9d700 1 --2- 172.21.15.154:0/1363702076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac1371c0 0x7f86ac1395a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009d90 tx=0x7f86a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63e3cb7df0fbfb21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.738+0000 7f86a959a700 1 -- 172.21.15.154:0/1363702076 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a400e070 con 0x7f86ac1371c0 2023-09-30T22:25:10.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.738+0000 7f86a959a700 1 -- 172.21.15.154:0/1363702076 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a400bb20 con 0x7f86ac1371c0 2023-09-30T22:25:10.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.738+0000 7f86a959a700 1 -- 172.21.15.154:0/1363702076 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4012430 con 0x7f86ac1371c0 2023-09-30T22:25:10.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.739+0000 7f86b0c91700 1 -- 172.21.15.154:0/1363702076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac1371c0 msgr2=0x7f86ac1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.739+0000 7f86b0c91700 1 --2- 172.21.15.154:0/1363702076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac1371c0 0x7f86ac1395a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009d90 tx=0x7f86a400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:10.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.739+0000 7f86b0c91700 1 -- 172.21.15.154:0/1363702076 shutdown_connections 2023-09-30T22:25:10.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.739+0000 7f86b0c91700 1 --2- 172.21.15.154:0/1363702076 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac1371c0 0x7f86ac1395a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.739+0000 7f86b0c91700 1 --2- 172.21.15.154:0/1363702076 >> v2:172.21.15.154:3300/0 conn(0x7f86ac09f350 0x7f86ac136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.739+0000 7f86b0c91700 1 -- 172.21.15.154:0/1363702076 >> 172.21.15.154:0/1363702076 conn(0x7f86ac0a4430 msgr2=0x7f86ac0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.739+0000 7f86b0c91700 1 -- 172.21.15.154:0/1363702076 shutdown_connections 2023-09-30T22:25:10.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.739+0000 7f86b0c91700 1 -- 172.21.15.154:0/1363702076 wait complete. 2023-09-30T22:25:10.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.741+0000 7f86b0c91700 1 Processor -- start 2023-09-30T22:25:10.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.741+0000 7f86b0c91700 1 -- start start 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.741+0000 7f86b0c91700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86ac09e870 0x7f86ac1208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.741+0000 7f86b0c91700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac09f350 0x7f86ac120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.741+0000 7f86b0c91700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86ac1371c0 0x7f86ac121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.741+0000 7f86b0c91700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac124340 con 0x7f86ac1371c0 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.741+0000 7f86b0c91700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac122d00 con 0x7f86ac09e870 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.741+0000 7f86b0c91700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac123af0 con 0x7f86ac09f350 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86aa59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86ac09e870 0x7f86ac1208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86aa59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86ac09e870 0x7f86ac1208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32880/0 (socket says 172.21.15.154:32880) 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86aa59c700 1 -- 172.21.15.154:0/2153507445 learned_addr learned my addr 172.21.15.154:0/2153507445 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86a9d9b700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac09f350 0x7f86ac120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86aad9d700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86ac1371c0 0x7f86ac121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86a9d9b700 1 -- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86ac09e870 msgr2=0x7f86ac1208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86a9d9b700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86ac09e870 0x7f86ac1208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86a9d9b700 1 -- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86ac1371c0 msgr2=0x7f86ac121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86a9d9b700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86ac1371c0 0x7f86ac121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86a9d9b700 1 -- 172.21.15.154:0/2153507445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4009a70 con 0x7f86ac09f350 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86aa59c700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86ac09e870 0x7f86ac1208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86a9d9b700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac09f350 0x7f86ac120e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f86a000e910 tx=0x7f86a000ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f869affd700 1 -- 172.21.15.154:0/2153507445 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0013680 con 0x7f86ac09f350 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f869affd700 1 -- 172.21.15.154:0/2153507445 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a00137e0 con 0x7f86ac09f350 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.742+0000 7f86b0c91700 1 -- 172.21.15.154:0/2153507445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac09dba0 con 0x7f86ac09f350 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.743+0000 7f869affd700 1 -- 172.21.15.154:0/2153507445 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0013b70 con 0x7f86ac09f350 2023-09-30T22:25:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.743+0000 7f86b0c91700 1 -- 172.21.15.154:0/2153507445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac123e00 con 0x7f86ac09f350 2023-09-30T22:25:10.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.743+0000 7f869affd700 1 -- 172.21.15.154:0/2153507445 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86a0013cd0 con 0x7f86ac09f350 2023-09-30T22:25:10.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.743+0000 7f869affd700 1 -- 172.21.15.154:0/2153507445 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86a003f630 con 0x7f86ac09f350 2023-09-30T22:25:10.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.744+0000 7f86b0c91700 1 -- 172.21.15.154:0/2153507445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac09fbc0 con 0x7f86ac09f350 2023-09-30T22:25:10.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.748+0000 7f869affd700 1 -- 172.21.15.154:0/2153507445 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86a0017080 con 0x7f86ac09f350 2023-09-30T22:25:10.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.773+0000 7fecd28e1700 1 -- 172.21.15.154:0/3146038016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feccc06c3b0 con 0x7feccc09e170 2023-09-30T22:25:10.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.773+0000 7fecc8ff9700 1 -- 172.21.15.154:0/3146038016 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecbc0239c0 con 0x7feccc09e170 2023-09-30T22:25:10.774 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:10.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.775+0000 7fecd28e1700 1 -- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc09e170 msgr2=0x7feccc11f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.775+0000 7fecd28e1700 1 --2- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc09e170 0x7feccc11f4c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0090b0 tx=0x7fecbc004750 comp rx=0 tx=0).stop 2023-09-30T22:25:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.775+0000 7fecd28e1700 1 -- 172.21.15.154:0/3146038016 shutdown_connections 2023-09-30T22:25:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.775+0000 7fecd28e1700 1 --2- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feccc130ce0 0x7feccc11fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.775+0000 7fecd28e1700 1 --2- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feccc09d860 0x7feccc11ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.775+0000 7fecd28e1700 1 --2- 172.21.15.154:0/3146038016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feccc09e170 0x7feccc11f4c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.775+0000 7fecd28e1700 1 -- 172.21.15.154:0/3146038016 >> 172.21.15.154:0/3146038016 conn(0x7feccc099c40 msgr2=0x7feccc119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.776+0000 7fecd28e1700 1 -- 172.21.15.154:0/3146038016 shutdown_connections 2023-09-30T22:25:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.776+0000 7fecd28e1700 1 -- 172.21.15.154:0/3146038016 wait complete. 2023-09-30T22:25:10.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:10.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.815+0000 7fe0aa9e5700 1 Processor -- start 2023-09-30T22:25:10.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.815+0000 7fe0aa9e5700 1 -- start start 2023-09-30T22:25:10.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.816+0000 7fe0aa9e5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe0a409dec0 0x7fe0a406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.816+0000 7fe0aa9e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 0x7fe0a4139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.816+0000 7fe0aa9e5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a406e900 con 0x7fe0a406a770 2023-09-30T22:25:10.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.816+0000 7fe0aa9e5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a409d180 con 0x7fe0a409dec0 2023-09-30T22:25:10.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.816+0000 7fe0aa9e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a409e780 con 0x7fe0a4136cb0 2023-09-30T22:25:10.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.816+0000 7fe0a37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe0a409dec0 0x7fe0a406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.816+0000 7fe0a37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe0a409dec0 0x7fe0a406b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38424/0 (socket says 172.21.15.154:38424) 2023-09-30T22:25:10.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.816+0000 7fe0a37fe700 1 -- 172.21.15.154:0/1119722187 learned_addr learned my addr 172.21.15.154:0/1119722187 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:10.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.816+0000 7fe0a8f82700 1 --2- 172.21.15.154:0/1119722187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 0x7fe0a4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a37fe700 1 -- 172.21.15.154:0/1119722187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 msgr2=0x7fe0a4139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:10.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a2ffd700 1 -- 172.21.15.154:0/1119722187 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345287583 0 0) 0x7fe0a406e900 con 0x7fe0a406a770 2023-09-30T22:25:10.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a37fe700 1 --2- 172.21.15.154:0/1119722187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 0x7fe0a4139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a37fe700 1 -- 172.21.15.154:0/1119722187 >> v1:172.21.15.154:6789/0 conn(0x7fe0a406a770 legacy=0x7fe0a406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a37fe700 1 -- 172.21.15.154:0/1119722187 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a409d3c0 con 0x7fe0a409dec0 2023-09-30T22:25:10.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a8f82700 1 --2- 172.21.15.154:0/1119722187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 0x7fe0a4139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:10.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a37fe700 1 --2- 172.21.15.154:0/1119722187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 0x7fe0a406b250 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe0980098f0 tx=0x7fe098009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f696ccca75f78e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a2ffd700 1 -- 172.21.15.154:0/1119722187 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011830 con 0x7fe0a409dec0 2023-09-30T22:25:10.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a2ffd700 1 -- 172.21.15.154:0/1119722187 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098011990 con 0x7fe0a409dec0 2023-09-30T22:25:10.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.817+0000 7fe0a2ffd700 1 -- 172.21.15.154:0/1119722187 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011d20 con 0x7fe0a409dec0 2023-09-30T22:25:10.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.818+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/1119722187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 msgr2=0x7fe0a406b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.818+0000 7fe0aa9e5700 1 --2- 172.21.15.154:0/1119722187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 0x7fe0a406b250 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe0980098f0 tx=0x7fe098009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.818+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/1119722187 shutdown_connections 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.818+0000 7fe0aa9e5700 1 --2- 172.21.15.154:0/1119722187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 0x7fe0a4139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.818+0000 7fe0aa9e5700 1 --2- 172.21.15.154:0/1119722187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 0x7fe0a406b250 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.818+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/1119722187 >> 172.21.15.154:0/1119722187 conn(0x7fe0a4099c40 msgr2=0x7fe0a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.818+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/1119722187 shutdown_connections 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.818+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/1119722187 wait complete. 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0aa9e5700 1 Processor -- start 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0aa9e5700 1 -- start start 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0aa9e5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0a406a770 0x7fe0a4134490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0aa9e5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 0x7fe0a41349d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0aa9e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 0x7fe0a4134f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0aa9e5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a412f470 con 0x7fe0a409dec0 2023-09-30T22:25:10.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0aa9e5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4136900 con 0x7fe0a406a770 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0aa9e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4119e90 con 0x7fe0a4136cb0 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0a37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 0x7fe0a41349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0a37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 0x7fe0a41349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38434/0 (socket says 172.21.15.154:38434) 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0a37fe700 1 -- 172.21.15.154:0/2933143986 learned_addr learned my addr 172.21.15.154:0/2933143986 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.819+0000 7fe0a3fff700 1 --2- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0a406a770 0x7fe0a4134490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a8f82700 1 --2- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 0x7fe0a4134f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a37fe700 1 -- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 msgr2=0x7fe0a4134f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a37fe700 1 --2- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 0x7fe0a4134f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a37fe700 1 -- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0a406a770 msgr2=0x7fe0a4134490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a37fe700 1 --2- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0a406a770 0x7fe0a4134490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a37fe700 1 -- 172.21.15.154:0/2933143986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c009a70 con 0x7fe0a409dec0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a37fe700 1 --2- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 0x7fe0a41349d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe0a409d2c0 tx=0x7fe098004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a0ff9700 1 -- 172.21.15.154:0/2933143986 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980042c0 con 0x7fe0a409dec0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a0ff9700 1 -- 172.21.15.154:0/2933143986 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09801f070 con 0x7fe0a409dec0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0a0ff9700 1 -- 172.21.15.154:0/2933143986 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980036a0 con 0x7fe0a409dec0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/2933143986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe098009550 con 0x7fe0a409dec0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.820+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/2933143986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a411a330 con 0x7fe0a409dec0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.821+0000 7fe0a0ff9700 1 -- 172.21.15.154:0/2933143986 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe098021030 con 0x7fe0a409dec0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.821+0000 7fe0a0ff9700 1 -- 172.21.15.154:0/2933143986 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe098040990 con 0x7fe0a409dec0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.821+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/2933143986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a404f2a0 con 0x7fe0a409dec0 2023-09-30T22:25:10.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.826+0000 7fe0a0ff9700 1 -- 172.21.15.154:0/2933143986 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe098015080 con 0x7fe0a409dec0 2023-09-30T22:25:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.907+0000 7fb4051c6700 1 -- 172.21.15.154:0/2969228790 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb40012ec20 con 0x7fb400130350 2023-09-30T22:25:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.907+0000 7fb3e77fe700 1 -- 172.21.15.154:0/2969228790 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3f4017070 con 0x7fb400130350 2023-09-30T22:25:10.908 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:10.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.909+0000 7fb4051c6700 1 -- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb400130350 msgr2=0x7fb40011aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.909+0000 7fb4051c6700 1 --2- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb400130350 0x7fb40011aed0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400c460 tx=0x7fb3f400c770 comp rx=0 tx=0).stop 2023-09-30T22:25:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.909+0000 7fb4051c6700 1 -- 172.21.15.154:0/2969228790 shutdown_connections 2023-09-30T22:25:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.909+0000 7fb4051c6700 1 --2- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb400130eb0 0x7fb40011b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.909+0000 7fb4051c6700 1 --2- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40012d280 0x7fb40011a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.909+0000 7fb4051c6700 1 --2- 172.21.15.154:0/2969228790 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb400130350 0x7fb40011aed0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.909+0000 7fb4051c6700 1 -- 172.21.15.154:0/2969228790 >> 172.21.15.154:0/2969228790 conn(0x7fb4000a2980 msgr2=0x7fb40009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.909+0000 7fb4051c6700 1 -- 172.21.15.154:0/2969228790 shutdown_connections 2023-09-30T22:25:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.909+0000 7fb4051c6700 1 -- 172.21.15.154:0/2969228790 wait complete. 2023-09-30T22:25:10.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.974+0000 7f86b0c91700 1 -- 172.21.15.154:0/2153507445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86ac04f2a0 con 0x7f86ac09f350 2023-09-30T22:25:10.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.974+0000 7f869affd700 1 -- 172.21.15.154:0/2153507445 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86a0021020 con 0x7f86ac09f350 2023-09-30T22:25:10.975 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.976+0000 7f86b0c91700 1 -- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac09f350 msgr2=0x7f86ac120e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.976+0000 7f86b0c91700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac09f350 0x7f86ac120e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f86a000e910 tx=0x7f86a000ec20 comp rx=0 tx=0).stop 2023-09-30T22:25:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.976+0000 7f86b0c91700 1 -- 172.21.15.154:0/2153507445 shutdown_connections 2023-09-30T22:25:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.976+0000 7f86b0c91700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86ac1371c0 0x7f86ac121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.976+0000 7f86b0c91700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86ac09e870 0x7f86ac1208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.976+0000 7f86b0c91700 1 --2- 172.21.15.154:0/2153507445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86ac09f350 0x7f86ac120e30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.977+0000 7f86b0c91700 1 -- 172.21.15.154:0/2153507445 >> 172.21.15.154:0/2153507445 conn(0x7f86ac0a4430 msgr2=0x7f86ac0a2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.977+0000 7f86b0c91700 1 -- 172.21.15.154:0/2153507445 shutdown_connections 2023-09-30T22:25:10.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:10.977+0000 7f86b0c91700 1 -- 172.21.15.154:0/2153507445 wait complete. 2023-09-30T22:25:10.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.019+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/2933143986 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe0a409e380 con 0x7fe0a409dec0 2023-09-30T22:25:11.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.019+0000 7fe0a0ff9700 1 -- 172.21.15.154:0/2933143986 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0980199a0 con 0x7fe0a409dec0 2023-09-30T22:25:11.020 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:11.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.022+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 msgr2=0x7fe0a41349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.022+0000 7fe0aa9e5700 1 --2- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 0x7fe0a41349d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe0a409d2c0 tx=0x7fe098004750 comp rx=0 tx=0).stop 2023-09-30T22:25:11.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.022+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/2933143986 shutdown_connections 2023-09-30T22:25:11.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.022+0000 7fe0aa9e5700 1 --2- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe0a4136cb0 0x7fe0a4134f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.022+0000 7fe0aa9e5700 1 --2- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0a406a770 0x7fe0a4134490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.022+0000 7fe0aa9e5700 1 --2- 172.21.15.154:0/2933143986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a409dec0 0x7fe0a41349d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.022+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/2933143986 >> 172.21.15.154:0/2933143986 conn(0x7fe0a4099c40 msgr2=0x7fe0a41388d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.022+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/2933143986 shutdown_connections 2023-09-30T22:25:11.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.022+0000 7fe0aa9e5700 1 -- 172.21.15.154:0/2933143986 wait complete. 2023-09-30T22:25:11.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:11.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:11.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d6b87700 1 Processor -- start 2023-09-30T22:25:11.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d6b87700 1 -- start start 2023-09-30T22:25:11.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d6b87700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0133ad0 0x7f27d0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d6b87700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27d0130bc0 0x7f27d013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d6b87700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d006b2d0 con 0x7f27d01300a0 2023-09-30T22:25:11.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d6b87700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d0133610 con 0x7f27d0130bc0 2023-09-30T22:25:11.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d6b87700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27d009a500 con 0x7f27d0133ad0 2023-09-30T22:25:11.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d4923700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0133ad0 0x7f27d0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d5124700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27d0130bc0 0x7f27d013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d4923700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0133ad0 0x7f27d0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:49094/0 (socket says 172.21.15.154:49094) 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.918+0000 7f27d4923700 1 -- 172.21.15.154:0/902942932 learned_addr learned my addr 172.21.15.154:0/902942932 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27d5124700 1 -- 172.21.15.154:0/902942932 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0133ad0 msgr2=0x7f27d0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27d5124700 1 --2- 172.21.15.154:0/902942932 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0133ad0 0x7f27d0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27d5124700 1 -- 172.21.15.154:0/902942932 >> v1:172.21.15.154:6789/0 conn(0x7f27d01300a0 legacy=0x7f27d01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27d5124700 1 -- 172.21.15.154:0/902942932 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d01338b0 con 0x7f27d0130bc0 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27d4923700 1 --2- 172.21.15.154:0/902942932 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0133ad0 0x7f27d0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27d5124700 1 --2- 172.21.15.154:0/902942932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0130bc0 0x7f27d013b990 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009d90 tx=0x7f27c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a4048219ba8bb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27cf7fe700 1 -- 172.21.15.154:0/902942932 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800e070 con 0x7f27d0130bc0 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27cf7fe700 1 -- 172.21.15.154:0/902942932 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c800bb20 con 0x7f27d0130bc0 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27cf7fe700 1 -- 172.21.15.154:0/902942932 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8012430 con 0x7f27d0130bc0 2023-09-30T22:25:11.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27d6b87700 1 -- 172.21.15.154:0/902942932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0130bc0 msgr2=0x7f27d013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.919+0000 7f27d6b87700 1 --2- 172.21.15.154:0/902942932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0130bc0 0x7f27d013b990 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009d90 tx=0x7f27c800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.920+0000 7f27d6b87700 1 -- 172.21.15.154:0/902942932 shutdown_connections 2023-09-30T22:25:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.920+0000 7f27d6b87700 1 --2- 172.21.15.154:0/902942932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0130bc0 0x7f27d013b990 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.920+0000 7f27d6b87700 1 --2- 172.21.15.154:0/902942932 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0133ad0 0x7f27d0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.920+0000 7f27d6b87700 1 -- 172.21.15.154:0/902942932 >> 172.21.15.154:0/902942932 conn(0x7f27d0099c40 msgr2=0x7f27d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.920+0000 7f27d6b87700 1 -- 172.21.15.154:0/902942932 shutdown_connections 2023-09-30T22:25:11.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.920+0000 7f27d6b87700 1 -- 172.21.15.154:0/902942932 wait complete. 2023-09-30T22:25:11.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.920+0000 7f27d6b87700 1 Processor -- start 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.920+0000 7f27d6b87700 1 -- start start 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d6b87700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27d01300a0 0x7f27d011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d6b87700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0130bc0 0x7f27d011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d6b87700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0133ad0 0x7f27d011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d6b87700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d012da10 con 0x7f27d0133ad0 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d6b87700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d011fe50 con 0x7f27d01300a0 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d6b87700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0120a30 con 0x7f27d0130bc0 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d5124700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0133ad0 0x7f27d011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d4923700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27d01300a0 0x7f27d011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d5124700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0133ad0 0x7f27d011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38456/0 (socket says 172.21.15.154:38456) 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d5124700 1 -- 172.21.15.154:0/2795986476 learned_addr learned my addr 172.21.15.154:0/2795986476 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27cffff700 1 --2- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0130bc0 0x7f27d011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d4923700 1 -- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0130bc0 msgr2=0x7f27d011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d4923700 1 --2- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0130bc0 0x7f27d011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d4923700 1 -- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0133ad0 msgr2=0x7f27d011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d4923700 1 --2- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0133ad0 0x7f27d011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d4923700 1 -- 172.21.15.154:0/2795986476 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c4009550 con 0x7f27d01300a0 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.921+0000 7f27d5124700 1 --2- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0133ad0 0x7f27d011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.922+0000 7f27d4923700 1 --2- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27d01300a0 0x7f27d011da40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f27c400e9a0 tx=0x7f27c400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.922+0000 7f27cd7fa700 1 -- 172.21.15.154:0/2795986476 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4004030 con 0x7f27d01300a0 2023-09-30T22:25:11.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.922+0000 7f27cd7fa700 1 -- 172.21.15.154:0/2795986476 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4004190 con 0x7f27d01300a0 2023-09-30T22:25:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.922+0000 7f27d6b87700 1 -- 172.21.15.154:0/2795986476 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c8009a70 con 0x7f27d01300a0 2023-09-30T22:25:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.922+0000 7f27cd7fa700 1 -- 172.21.15.154:0/2795986476 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4004520 con 0x7f27d01300a0 2023-09-30T22:25:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.922+0000 7f27d6b87700 1 -- 172.21.15.154:0/2795986476 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d012dd00 con 0x7f27d01300a0 2023-09-30T22:25:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.923+0000 7f27cd7fa700 1 -- 172.21.15.154:0/2795986476 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27c40036a0 con 0x7f27d01300a0 2023-09-30T22:25:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.923+0000 7f27d6b87700 1 -- 172.21.15.154:0/2795986476 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d004f2a0 con 0x7f27d01300a0 2023-09-30T22:25:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.923+0000 7f27cd7fa700 1 -- 172.21.15.154:0/2795986476 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f27c403f520 con 0x7f27d01300a0 2023-09-30T22:25:11.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:11.927+0000 7f27cd7fa700 1 -- 172.21.15.154:0/2795986476 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27c400c690 con 0x7f27d01300a0 2023-09-30T22:25:11.990 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:12.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:12.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.055+0000 7fad94bd4700 1 Processor -- start 2023-09-30T22:25:12.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.055+0000 7fad94bd4700 1 -- start start 2023-09-30T22:25:12.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad94bd4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad9009d860 0x7fad9009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad94bd4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad901307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad94bd4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad90131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad94bd4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad90131670 con 0x7fad9009d860 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad94bd4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9009aaa0 con 0x7fad9009e170 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad94bd4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad9009f870 con 0x7fad90130ce0 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad90131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad901307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad90131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:49110/0 (socket says 172.21.15.154:49110) 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8ed9d700 1 -- 172.21.15.154:0/3222629401 learned_addr learned my addr 172.21.15.154:0/3222629401 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:12.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad901307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32910/0 (socket says 172.21.15.154:32910) 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8e59c700 1 --2- 172.21.15.154:0/3222629401 >> v2:172.21.15.154:3300/0 conn(0x7fad9009d860 0x7fad9009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8dd9b700 1 -- 172.21.15.154:0/3222629401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 msgr2=0x7fad90131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8dd9b700 1 --2- 172.21.15.154:0/3222629401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad90131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8dd9b700 1 -- 172.21.15.154:0/3222629401 >> v2:172.21.15.154:3300/0 conn(0x7fad9009d860 msgr2=0x7fad9009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8dd9b700 1 --2- 172.21.15.154:0/3222629401 >> v2:172.21.15.154:3300/0 conn(0x7fad9009d860 0x7fad9009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8dd9b700 1 -- 172.21.15.154:0/3222629401 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9009b360 con 0x7fad9009e170 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.056+0000 7fad8ed9d700 1 --2- 172.21.15.154:0/3222629401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad90131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.057+0000 7fad8dd9b700 1 --2- 172.21.15.154:0/3222629401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad901307a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fad84009840 tx=0x7fad84009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=301c7651f8c6de5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.057+0000 7fad8d59a700 1 -- 172.21.15.154:0/3222629401 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84011830 con 0x7fad9009e170 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.057+0000 7fad8d59a700 1 -- 172.21.15.154:0/3222629401 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad84011990 con 0x7fad9009e170 2023-09-30T22:25:12.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.057+0000 7fad8d59a700 1 -- 172.21.15.154:0/3222629401 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84011d20 con 0x7fad9009e170 2023-09-30T22:25:12.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.058+0000 7fad94bd4700 1 -- 172.21.15.154:0/3222629401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 msgr2=0x7fad901307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.058+0000 7fad94bd4700 1 --2- 172.21.15.154:0/3222629401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad901307a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fad84009840 tx=0x7fad84009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.058+0000 7fad94bd4700 1 -- 172.21.15.154:0/3222629401 shutdown_connections 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.058+0000 7fad94bd4700 1 --2- 172.21.15.154:0/3222629401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad90131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.058+0000 7fad94bd4700 1 --2- 172.21.15.154:0/3222629401 >> v2:172.21.15.154:3300/0 conn(0x7fad9009d860 0x7fad9009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.058+0000 7fad94bd4700 1 --2- 172.21.15.154:0/3222629401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad901307a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.058+0000 7fad94bd4700 1 -- 172.21.15.154:0/3222629401 >> 172.21.15.154:0/3222629401 conn(0x7fad90099c40 msgr2=0x7fad900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.058+0000 7fad94bd4700 1 -- 172.21.15.154:0/3222629401 shutdown_connections 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.058+0000 7fad94bd4700 1 -- 172.21.15.154:0/3222629401 wait complete. 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad94bd4700 1 Processor -- start 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad94bd4700 1 -- start start 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad94bd4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9009d860 0x7fad9006f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad94bd4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad9006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad94bd4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad900703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad94bd4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad90070db0 con 0x7fad9009d860 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad94bd4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad90130a80 con 0x7fad9009e170 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad94bd4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad9012c070 con 0x7fad90130ce0 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad8ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad900703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.059+0000 7fad8dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad9006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad900703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:49126/0 (socket says 172.21.15.154:49126) 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8ed9d700 1 -- 172.21.15.154:0/1220961890 learned_addr learned my addr 172.21.15.154:0/1220961890 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8e59c700 1 --2- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9009d860 0x7fad9006f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8ed9d700 1 -- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 msgr2=0x7fad9006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8ed9d700 1 --2- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad9006fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8ed9d700 1 -- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9009d860 msgr2=0x7fad9006f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8ed9d700 1 --2- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9009d860 0x7fad9006f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8ed9d700 1 -- 172.21.15.154:0/1220961890 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88009b30 con 0x7fad90130ce0 2023-09-30T22:25:12.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8e59c700 1 --2- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9009d860 0x7fad9006f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:12.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad8ed9d700 1 --2- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad900703d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fad88009f10 tx=0x7fad8800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad7effd700 1 -- 172.21.15.154:0/1220961890 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88018070 con 0x7fad90130ce0 2023-09-30T22:25:12.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad7effd700 1 -- 172.21.15.154:0/1220961890 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8800f040 con 0x7fad90130ce0 2023-09-30T22:25:12.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad7effd700 1 -- 172.21.15.154:0/1220961890 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88003c40 con 0x7fad90130ce0 2023-09-30T22:25:12.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.060+0000 7fad94bd4700 1 -- 172.21.15.154:0/1220961890 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad840094a0 con 0x7fad90130ce0 2023-09-30T22:25:12.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.061+0000 7fad94bd4700 1 -- 172.21.15.154:0/1220961890 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9009c8b0 con 0x7fad90130ce0 2023-09-30T22:25:12.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.061+0000 7fad7effd700 1 -- 172.21.15.154:0/1220961890 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad8800c9f0 con 0x7fad90130ce0 2023-09-30T22:25:12.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.062+0000 7fad7effd700 1 -- 172.21.15.154:0/1220961890 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad8803f8c0 con 0x7fad90130ce0 2023-09-30T22:25:12.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.062+0000 7fad94bd4700 1 -- 172.21.15.154:0/1220961890 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9009a860 con 0x7fad90130ce0 2023-09-30T22:25:12.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.067+0000 7fad7effd700 1 -- 172.21.15.154:0/1220961890 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad88012340 con 0x7fad90130ce0 2023-09-30T22:25:12.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.117+0000 7f66f17e4700 1 Processor -- start 2023-09-30T22:25:12.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66f17e4700 1 -- start start 2023-09-30T22:25:12.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66f17e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09f350 0x7f66ec136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66f17e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec1371c0 0x7f66ec1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66f17e4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec09c970 con 0x7f66ec09e870 2023-09-30T22:25:12.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66f17e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0a0920 con 0x7f66ec09f350 2023-09-30T22:25:12.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66f17e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec09f9c0 con 0x7f66ec1371c0 2023-09-30T22:25:12.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66ea7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09f350 0x7f66ec136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66eaffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f66ec09e870 0x7f66ec09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47300/0 (socket says 172.21.15.154:47300) 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66ea7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09f350 0x7f66ec136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32918/0 (socket says 172.21.15.154:32918) 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66eaffd700 1 -- 172.21.15.154:0/2706322090 learned_addr learned my addr 172.21.15.154:0/2706322090 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.118+0000 7f66eb7fe700 1 --2- 172.21.15.154:0/2706322090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec1371c0 0x7f66ec1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.119+0000 7f66ea7fc700 1 -- 172.21.15.154:0/2706322090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec1371c0 msgr2=0x7f66ec1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.119+0000 7f66e9ffb700 1 -- 172.21.15.154:0/2706322090 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254644395 0 0) 0x7f66ec09c970 con 0x7f66ec09e870 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.119+0000 7f66ea7fc700 1 --2- 172.21.15.154:0/2706322090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec1371c0 0x7f66ec1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.119+0000 7f66ea7fc700 1 -- 172.21.15.154:0/2706322090 >> v1:172.21.15.154:6789/0 conn(0x7f66ec09e870 legacy=0x7f66ec09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.119+0000 7f66ea7fc700 1 -- 172.21.15.154:0/2706322090 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec09bab0 con 0x7f66ec09f350 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.119+0000 7f66ea7fc700 1 --2- 172.21.15.154:0/2706322090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09f350 0x7f66ec136c80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009870 tx=0x7f66e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f366f1b40974c5d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.119+0000 7f66e9ffb700 1 -- 172.21.15.154:0/2706322090 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e0011830 con 0x7f66ec09f350 2023-09-30T22:25:12.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.119+0000 7f66e9ffb700 1 -- 172.21.15.154:0/2706322090 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e0011990 con 0x7f66ec09f350 2023-09-30T22:25:12.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.119+0000 7f66e9ffb700 1 -- 172.21.15.154:0/2706322090 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e0011d20 con 0x7f66ec09f350 2023-09-30T22:25:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.120+0000 7f66f17e4700 1 -- 172.21.15.154:0/2706322090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09f350 msgr2=0x7f66ec136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.120+0000 7f66f17e4700 1 --2- 172.21.15.154:0/2706322090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09f350 0x7f66ec136c80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009870 tx=0x7f66e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.120+0000 7f66f17e4700 1 -- 172.21.15.154:0/2706322090 shutdown_connections 2023-09-30T22:25:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.120+0000 7f66f17e4700 1 --2- 172.21.15.154:0/2706322090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec1371c0 0x7f66ec1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.120+0000 7f66f17e4700 1 --2- 172.21.15.154:0/2706322090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09f350 0x7f66ec136c80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.120+0000 7f66f17e4700 1 -- 172.21.15.154:0/2706322090 >> 172.21.15.154:0/2706322090 conn(0x7f66ec0a4430 msgr2=0x7f66ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.120+0000 7f66f17e4700 1 -- 172.21.15.154:0/2706322090 shutdown_connections 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.120+0000 7f66f17e4700 1 -- 172.21.15.154:0/2706322090 wait complete. 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.121+0000 7f66f17e4700 1 Processor -- start 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66f17e4700 1 -- start start 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66f17e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09e870 0x7f66ec120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66f17e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec09f350 0x7f66ec120c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66f17e4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec1371c0 0x7f66ec1211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66f17e4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec09dba0 con 0x7f66ec1371c0 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66f17e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec123a60 con 0x7f66ec09e870 2023-09-30T22:25:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66f17e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec123f80 con 0x7f66ec09f350 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66eb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec1371c0 0x7f66ec1211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66eb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec1371c0 0x7f66ec1211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38480/0 (socket says 172.21.15.154:38480) 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.122+0000 7f66eb7fe700 1 -- 172.21.15.154:0/476596400 learned_addr learned my addr 172.21.15.154:0/476596400 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66eaffd700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09e870 0x7f66ec120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66ea7fc700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec09f350 0x7f66ec120c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66eb7fe700 1 -- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec09f350 msgr2=0x7f66ec120c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66eb7fe700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec09f350 0x7f66ec120c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66eb7fe700 1 -- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09e870 msgr2=0x7f66ec120740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66eb7fe700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09e870 0x7f66ec120740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66eb7fe700 1 -- 172.21.15.154:0/476596400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e00094a0 con 0x7f66ec1371c0 2023-09-30T22:25:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66eb7fe700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec1371c0 0x7f66ec1211c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f66e400ef90 tx=0x7f66e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66ea7fc700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec09f350 0x7f66ec120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66d37fe700 1 -- 172.21.15.154:0/476596400 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400cd40 con 0x7f66ec1371c0 2023-09-30T22:25:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66d37fe700 1 -- 172.21.15.154:0/476596400 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e400f040 con 0x7f66ec1371c0 2023-09-30T22:25:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66d37fe700 1 -- 172.21.15.154:0/476596400 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400cea0 con 0x7f66ec1371c0 2023-09-30T22:25:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66f17e4700 1 -- 172.21.15.154:0/476596400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec072250 con 0x7f66ec1371c0 2023-09-30T22:25:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.123+0000 7f66f17e4700 1 -- 172.21.15.154:0/476596400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec1249f0 con 0x7f66ec1371c0 2023-09-30T22:25:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.124+0000 7f66d37fe700 1 -- 172.21.15.154:0/476596400 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66e40146a0 con 0x7f66ec1371c0 2023-09-30T22:25:12.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.124+0000 7f66f17e4700 1 -- 172.21.15.154:0/476596400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec04f2a0 con 0x7f66ec1371c0 2023-09-30T22:25:12.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.124+0000 7f66d37fe700 1 -- 172.21.15.154:0/476596400 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66e4040270 con 0x7f66ec1371c0 2023-09-30T22:25:12.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.134+0000 7f66d37fe700 1 -- 172.21.15.154:0/476596400 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66e4018030 con 0x7f66ec1371c0 2023-09-30T22:25:12.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.137+0000 7f27d6b87700 1 -- 172.21.15.154:0/2795986476 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f27d006c3b0 con 0x7f27d01300a0 2023-09-30T22:25:12.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.138+0000 7f27cd7fa700 1 -- 172.21.15.154:0/2795986476 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27c4019300 con 0x7f27d01300a0 2023-09-30T22:25:12.139 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:12.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.140+0000 7f27d6b87700 1 -- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27d01300a0 msgr2=0x7f27d011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.140+0000 7f27d6b87700 1 --2- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27d01300a0 0x7f27d011da40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f27c400e9a0 tx=0x7f27c400ecb0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.140+0000 7f27d6b87700 1 -- 172.21.15.154:0/2795986476 shutdown_connections 2023-09-30T22:25:12.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.140+0000 7f27d6b87700 1 --2- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27d0133ad0 0x7f27d011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.140+0000 7f27d6b87700 1 --2- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27d01300a0 0x7f27d011da40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.140+0000 7f27d6b87700 1 --2- 172.21.15.154:0/2795986476 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27d0130bc0 0x7f27d011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.140+0000 7f27d6b87700 1 -- 172.21.15.154:0/2795986476 >> 172.21.15.154:0/2795986476 conn(0x7f27d0099c40 msgr2=0x7f27d0132d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.140+0000 7f27d6b87700 1 -- 172.21.15.154:0/2795986476 shutdown_connections 2023-09-30T22:25:12.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.140+0000 7f27d6b87700 1 -- 172.21.15.154:0/2795986476 wait complete. 2023-09-30T22:25:12.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.165+0000 7fe1d8e1a700 1 Processor -- start 2023-09-30T22:25:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.165+0000 7fe1d8e1a700 1 -- start start 2023-09-30T22:25:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d8e1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d8e1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d8e1a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d406b2d0 con 0x7fe1d41309f0 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d8e1a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4133610 con 0x7fe1d4133ad0 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d8e1a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d409a500 con 0x7fe1d41300a0 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d2d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe1d41309f0 0x7fe1d413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47306/0 (socket says 172.21.15.154:47306) 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32940/0 (socket says 172.21.15.154:32940) 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d2d9d700 1 -- 172.21.15.154:0/4011352928 learned_addr learned my addr 172.21.15.154:0/4011352928 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:12.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d159a700 1 -- 172.21.15.154:0/4011352928 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930338028 0 0) 0x7fe1d406b2d0 con 0x7fe1d41309f0 2023-09-30T22:25:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d1d9b700 1 -- 172.21.15.154:0/4011352928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 msgr2=0x7fe1d4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d1d9b700 1 --2- 172.21.15.154:0/4011352928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d1d9b700 1 -- 172.21.15.154:0/4011352928 >> v1:172.21.15.154:6789/0 conn(0x7fe1d41309f0 legacy=0x7fe1d413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d1d9b700 1 -- 172.21.15.154:0/4011352928 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d41338b0 con 0x7fe1d41300a0 2023-09-30T22:25:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.166+0000 7fe1d259c700 1 --2- 172.21.15.154:0/4011352928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d1d9b700 1 --2- 172.21.15.154:0/4011352928 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d41304b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009870 tx=0x7fe1c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83bc3cd6678d6a87 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d159a700 1 -- 172.21.15.154:0/4011352928 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8011830 con 0x7fe1d41300a0 2023-09-30T22:25:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d159a700 1 -- 172.21.15.154:0/4011352928 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8011990 con 0x7fe1d41300a0 2023-09-30T22:25:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d159a700 1 -- 172.21.15.154:0/4011352928 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8011d20 con 0x7fe1d41300a0 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/4011352928 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 msgr2=0x7fe1d41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d8e1a700 1 --2- 172.21.15.154:0/4011352928 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d41304b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009870 tx=0x7fe1c8009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/4011352928 shutdown_connections 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d8e1a700 1 --2- 172.21.15.154:0/4011352928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d8e1a700 1 --2- 172.21.15.154:0/4011352928 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d41304b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/4011352928 >> 172.21.15.154:0/4011352928 conn(0x7fe1d4099c40 msgr2=0x7fe1d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/4011352928 shutdown_connections 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.167+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/4011352928 wait complete. 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.169+0000 7fe1d8e1a700 1 Processor -- start 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.169+0000 7fe1d8e1a700 1 -- start start 2023-09-30T22:25:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d8e1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d8e1a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1d41309f0 0x7fe1d411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d8e1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d8e1a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4120950 con 0x7fe1d41309f0 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d8e1a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d412d930 con 0x7fe1d4133ad0 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d8e1a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d411fd00 con 0x7fe1d41300a0 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1d41309f0 0x7fe1d411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:49150/0 (socket says 172.21.15.154:49150) 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d259c700 1 -- 172.21.15.154:0/295224100 learned_addr learned my addr 172.21.15.154:0/295224100 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d2d9d700 1 --2- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:12.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d1d9b700 1 -- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 msgr2=0x7fe1d411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d1d9b700 1 --2- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d1d9b700 1 -- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 msgr2=0x7fe1d411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d1d9b700 1 --2- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d1d9b700 1 -- 172.21.15.154:0/295224100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c40094a0 con 0x7fe1d41309f0 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.170+0000 7fe1d1d9b700 1 --2- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1d41309f0 0x7fe1d411df80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8016000 tx=0x7fe1c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.171+0000 7fe1c2ffd700 1 -- 172.21.15.154:0/295224100 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8004510 con 0x7fe1d41309f0 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.171+0000 7fe1c2ffd700 1 -- 172.21.15.154:0/295224100 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c801e070 con 0x7fe1d41309f0 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.171+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/295224100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c80094a0 con 0x7fe1d41309f0 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.171+0000 7fe1c2ffd700 1 -- 172.21.15.154:0/295224100 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c80038c0 con 0x7fe1d41309f0 2023-09-30T22:25:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.171+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/295224100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d40a3400 con 0x7fe1d41309f0 2023-09-30T22:25:12.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.172+0000 7fe1c2ffd700 1 -- 172.21.15.154:0/295224100 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1c8003a20 con 0x7fe1d41309f0 2023-09-30T22:25:12.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.172+0000 7fe1c2ffd700 1 -- 172.21.15.154:0/295224100 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe1c8020070 con 0x7fe1d41309f0 2023-09-30T22:25:12.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.172+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/295224100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d412dd00 con 0x7fe1d41309f0 2023-09-30T22:25:12.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.177+0000 7fe1c2ffd700 1 -- 172.21.15.154:0/295224100 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1c801a420 con 0x7fe1d41309f0 2023-09-30T22:25:12.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.266+0000 7fad94bd4700 1 -- 172.21.15.154:0/1220961890 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fad9012bd10 con 0x7fad90130ce0 2023-09-30T22:25:12.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.266+0000 7fad7effd700 1 -- 172.21.15.154:0/1220961890 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad9012bd10 con 0x7fad90130ce0 2023-09-30T22:25:12.267 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:12.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.268+0000 7fad94bd4700 1 -- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 msgr2=0x7fad900703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.268+0000 7fad94bd4700 1 --2- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad900703d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fad88009f10 tx=0x7fad8800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.269+0000 7fad94bd4700 1 -- 172.21.15.154:0/1220961890 shutdown_connections 2023-09-30T22:25:12.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.269+0000 7fad94bd4700 1 --2- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fad90130ce0 0x7fad900703d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.269+0000 7fad94bd4700 1 --2- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9009d860 0x7fad9006f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.269+0000 7fad94bd4700 1 --2- 172.21.15.154:0/1220961890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9009e170 0x7fad9006fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.269+0000 7fad94bd4700 1 -- 172.21.15.154:0/1220961890 >> 172.21.15.154:0/1220961890 conn(0x7fad90099c40 msgr2=0x7fad9012a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.269+0000 7fad94bd4700 1 -- 172.21.15.154:0/1220961890 shutdown_connections 2023-09-30T22:25:12.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.269+0000 7fad94bd4700 1 -- 172.21.15.154:0/1220961890 wait complete. 2023-09-30T22:25:12.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:12.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.331+0000 7f66f17e4700 1 -- 172.21.15.154:0/476596400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f66ec06b2a0 con 0x7f66ec1371c0 2023-09-30T22:25:12.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.331+0000 7f66d37fe700 1 -- 172.21.15.154:0/476596400 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66e402b090 con 0x7f66ec1371c0 2023-09-30T22:25:12.332 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.333+0000 7f66f17e4700 1 -- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec1371c0 msgr2=0x7f66ec1211c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.333+0000 7f66f17e4700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec1371c0 0x7f66ec1211c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f66e400ef90 tx=0x7f66e400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.333+0000 7f66f17e4700 1 -- 172.21.15.154:0/476596400 shutdown_connections 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.333+0000 7f66f17e4700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec1371c0 0x7f66ec1211c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.333+0000 7f66f17e4700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66ec09e870 0x7f66ec120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.333+0000 7f66f17e4700 1 --2- 172.21.15.154:0/476596400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66ec09f350 0x7f66ec120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.333+0000 7f66f17e4700 1 -- 172.21.15.154:0/476596400 >> 172.21.15.154:0/476596400 conn(0x7f66ec0a4430 msgr2=0x7f66ec070450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.333+0000 7f66f17e4700 1 -- 172.21.15.154:0/476596400 shutdown_connections 2023-09-30T22:25:12.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.333+0000 7f66f17e4700 1 -- 172.21.15.154:0/476596400 wait complete. 2023-09-30T22:25:12.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:12.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.368+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/295224100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe1d404f2a0 con 0x7fe1d41309f0 2023-09-30T22:25:12.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.369+0000 7fe1c2ffd700 1 -- 172.21.15.154:0/295224100 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1c802a030 con 0x7fe1d41309f0 2023-09-30T22:25:12.370 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.371+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1d41309f0 msgr2=0x7fe1d411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.371+0000 7fe1d8e1a700 1 --2- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1d41309f0 0x7fe1d411df80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8016000 tx=0x7fe1c8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.371+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/295224100 shutdown_connections 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.371+0000 7fe1d8e1a700 1 --2- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1d4133ad0 0x7fe1d411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.371+0000 7fe1d8e1a700 1 --2- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe1d41300a0 0x7fe1d411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.371+0000 7fe1d8e1a700 1 --2- 172.21.15.154:0/295224100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1d41309f0 0x7fe1d411df80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.371+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/295224100 >> 172.21.15.154:0/295224100 conn(0x7fe1d4099c40 msgr2=0x7fe1d412e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.371+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/295224100 shutdown_connections 2023-09-30T22:25:12.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:12.371+0000 7fe1d8e1a700 1 -- 172.21.15.154:0/295224100 wait complete. 2023-09-30T22:25:12.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:13.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.280+0000 7fea40635700 1 Processor -- start 2023-09-30T22:25:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.280+0000 7fea40635700 1 -- start start 2023-09-30T22:25:13.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.281+0000 7fea40635700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea38133a70 0x7fea38133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.281+0000 7fea40635700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea380a1460 0x7fea3813b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.281+0000 7fea40635700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea38133640 con 0x7fea380a08e0 2023-09-30T22:25:13.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.281+0000 7fea40635700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea380a1d50 con 0x7fea380a1460 2023-09-30T22:25:13.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.281+0000 7fea40635700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea3809b620 con 0x7fea38133a70 2023-09-30T22:25:13.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.281+0000 7fea3ebd2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea380a1460 0x7fea3813b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.281+0000 7fea3e3d1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea38133a70 0x7fea38133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.281+0000 7fea3ebd2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea380a1460 0x7fea3813b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38502/0 (socket says 172.21.15.154:38502) 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.281+0000 7fea3ebd2700 1 -- 172.21.15.154:0/637690370 learned_addr learned my addr 172.21.15.154:0/637690370 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea3ebd2700 1 -- 172.21.15.154:0/637690370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea38133a70 msgr2=0x7fea38133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea3ebd2700 1 --2- 172.21.15.154:0/637690370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea38133a70 0x7fea38133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea3ebd2700 1 -- 172.21.15.154:0/637690370 >> v1:172.21.15.154:6789/0 conn(0x7fea380a08e0 legacy=0x7fea380a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea3ebd2700 1 -- 172.21.15.154:0/637690370 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38133870 con 0x7fea380a1460 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea3e3d1700 1 --2- 172.21.15.154:0/637690370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea38133a70 0x7fea38133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea3ebd2700 1 --2- 172.21.15.154:0/637690370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea380a1460 0x7fea3813b980 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fea30009e50 tx=0x7fea3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b332272c77204b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea3d3cf700 1 -- 172.21.15.154:0/637690370 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000e070 con 0x7fea380a1460 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea3d3cf700 1 -- 172.21.15.154:0/637690370 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3000b910 con 0x7fea380a1460 2023-09-30T22:25:13.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea3d3cf700 1 -- 172.21.15.154:0/637690370 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000bcc0 con 0x7fea380a1460 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea40635700 1 -- 172.21.15.154:0/637690370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea380a1460 msgr2=0x7fea3813b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea40635700 1 --2- 172.21.15.154:0/637690370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea380a1460 0x7fea3813b980 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fea30009e50 tx=0x7fea3000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea40635700 1 -- 172.21.15.154:0/637690370 shutdown_connections 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea40635700 1 --2- 172.21.15.154:0/637690370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea380a1460 0x7fea3813b980 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea40635700 1 --2- 172.21.15.154:0/637690370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea38133a70 0x7fea38133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.282+0000 7fea40635700 1 -- 172.21.15.154:0/637690370 >> 172.21.15.154:0/637690370 conn(0x7fea380a2980 msgr2=0x7fea380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.283+0000 7fea40635700 1 -- 172.21.15.154:0/637690370 shutdown_connections 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.283+0000 7fea40635700 1 -- 172.21.15.154:0/637690370 wait complete. 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.283+0000 7fea40635700 1 Processor -- start 2023-09-30T22:25:13.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.283+0000 7fea40635700 1 -- start start 2023-09-30T22:25:13.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea40635700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea380a08e0 0x7fea381197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea40635700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea380a1460 0x7fea38119d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea40635700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38133a70 0x7fea3811a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea40635700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3811b390 con 0x7fea38133a70 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea40635700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3809a350 con 0x7fea380a08e0 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea40635700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea3811c5e0 con 0x7fea380a1460 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3e3d1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea380a08e0 0x7fea381197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3dbd0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea380a1460 0x7fea38119d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3e3d1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea380a08e0 0x7fea381197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32962/0 (socket says 172.21.15.154:32962) 2023-09-30T22:25:13.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3e3d1700 1 -- 172.21.15.154:0/1517182895 learned_addr learned my addr 172.21.15.154:0/1517182895 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3ebd2700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38133a70 0x7fea3811a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3dbd0700 1 -- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea380a08e0 msgr2=0x7fea381197c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3dbd0700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea380a08e0 0x7fea381197c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3dbd0700 1 -- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38133a70 msgr2=0x7fea3811a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3dbd0700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38133a70 0x7fea3811a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3dbd0700 1 -- 172.21.15.154:0/1517182895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c009430 con 0x7fea380a1460 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3e3d1700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea380a08e0 0x7fea381197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3ebd2700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38133a70 0x7fea3811a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea3dbd0700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea380a1460 0x7fea38119d00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fea34000f60 tx=0x7fea3400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.284+0000 7fea2affd700 1 -- 172.21.15.154:0/1517182895 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340052d0 con 0x7fea380a1460 2023-09-30T22:25:13.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.285+0000 7fea2affd700 1 -- 172.21.15.154:0/1517182895 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea34005430 con 0x7fea380a1460 2023-09-30T22:25:13.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.285+0000 7fea40635700 1 -- 172.21.15.154:0/1517182895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea30009b30 con 0x7fea380a1460 2023-09-30T22:25:13.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.285+0000 7fea2affd700 1 -- 172.21.15.154:0/1517182895 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340038c0 con 0x7fea380a1460 2023-09-30T22:25:13.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.285+0000 7fea40635700 1 -- 172.21.15.154:0/1517182895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea38131f60 con 0x7fea380a1460 2023-09-30T22:25:13.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.285+0000 7fea2affd700 1 -- 172.21.15.154:0/1517182895 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea34003a20 con 0x7fea380a1460 2023-09-30T22:25:13.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.285+0000 7fea40635700 1 -- 172.21.15.154:0/1517182895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3804f2a0 con 0x7fea380a1460 2023-09-30T22:25:13.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.285+0000 7fea2affd700 1 -- 172.21.15.154:0/1517182895 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea3403e8d0 con 0x7fea380a1460 2023-09-30T22:25:13.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.290+0000 7fea2affd700 1 -- 172.21.15.154:0/1517182895 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea34017020 con 0x7fea380a1460 2023-09-30T22:25:13.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:13.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.419+0000 7f211f6d2700 1 Processor -- start 2023-09-30T22:25:13.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.419+0000 7f211f6d2700 1 -- start start 2023-09-30T22:25:13.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211f6d2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2118099e20 0x7f211809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211f6d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211809a730 0x7f2118130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211f6d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2118130890 0x7f2118130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211f6d2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211809bf50 con 0x7f2118099e20 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211f6d2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2118131220 con 0x7f211809a730 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211f6d2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2118099a60 con 0x7f2118130890 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211dc6f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2118130890 0x7f2118130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211dc6f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2118130890 0x7f2118130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:49186/0 (socket says 172.21.15.154:49186) 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211dc6f700 1 -- 172.21.15.154:0/2692201220 learned_addr learned my addr 172.21.15.154:0/2692201220 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211cc6d700 1 --2- 172.21.15.154:0/2692201220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211809a730 0x7f2118130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211d46e700 1 --2- 172.21.15.154:0/2692201220 >> v2:172.21.15.154:3300/0 conn(0x7f2118099e20 0x7f211809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211dc6f700 1 -- 172.21.15.154:0/2692201220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211809a730 msgr2=0x7f2118130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211dc6f700 1 --2- 172.21.15.154:0/2692201220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211809a730 0x7f2118130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211dc6f700 1 -- 172.21.15.154:0/2692201220 >> v2:172.21.15.154:3300/0 conn(0x7f2118099e20 msgr2=0x7f211809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211dc6f700 1 --2- 172.21.15.154:0/2692201220 >> v2:172.21.15.154:3300/0 conn(0x7f2118099e20 0x7f211809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211dc6f700 1 -- 172.21.15.154:0/2692201220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211809b230 con 0x7f2118130890 2023-09-30T22:25:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.420+0000 7f211d46e700 1 --2- 172.21.15.154:0/2692201220 >> v2:172.21.15.154:3300/0 conn(0x7f2118099e20 0x7f211809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.421+0000 7f211dc6f700 1 --2- 172.21.15.154:0/2692201220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2118130890 0x7f2118130ce0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2110009e80 tx=0x7f211000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1b49db4cb11698 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.421+0000 7f210ffff700 1 -- 172.21.15.154:0/2692201220 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211000e070 con 0x7f2118130890 2023-09-30T22:25:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.421+0000 7f210ffff700 1 -- 172.21.15.154:0/2692201220 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211000b8d0 con 0x7f2118130890 2023-09-30T22:25:13.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.421+0000 7f210ffff700 1 -- 172.21.15.154:0/2692201220 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211000bc80 con 0x7f2118130890 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.421+0000 7f211f6d2700 1 -- 172.21.15.154:0/2692201220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2118130890 msgr2=0x7f2118130ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.421+0000 7f211f6d2700 1 --2- 172.21.15.154:0/2692201220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2118130890 0x7f2118130ce0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2110009e80 tx=0x7f211000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.422+0000 7f211f6d2700 1 -- 172.21.15.154:0/2692201220 shutdown_connections 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.422+0000 7f211f6d2700 1 --2- 172.21.15.154:0/2692201220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2118130890 0x7f2118130ce0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.422+0000 7f211f6d2700 1 --2- 172.21.15.154:0/2692201220 >> v2:172.21.15.154:3300/0 conn(0x7f2118099e20 0x7f211809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.422+0000 7f211f6d2700 1 --2- 172.21.15.154:0/2692201220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211809a730 0x7f2118130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.422+0000 7f211f6d2700 1 -- 172.21.15.154:0/2692201220 >> 172.21.15.154:0/2692201220 conn(0x7f21180a2980 msgr2=0x7f21180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.422+0000 7f211f6d2700 1 -- 172.21.15.154:0/2692201220 shutdown_connections 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.422+0000 7f211f6d2700 1 -- 172.21.15.154:0/2692201220 wait complete. 2023-09-30T22:25:13.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.423+0000 7f211f6d2700 1 Processor -- start 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.423+0000 7f211f6d2700 1 -- start start 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211f6d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2118099e20 0x7f2118133280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211f6d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211809a730 0x7f21181337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211f6d2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2118130890 0x7f2118133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211f6d2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211809b470 con 0x7f2118130890 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211f6d2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211812df00 con 0x7f2118099e20 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211f6d2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2118135480 con 0x7f211809a730 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211dc6f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2118130890 0x7f2118133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211dc6f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2118130890 0x7f2118133d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38522/0 (socket says 172.21.15.154:38522) 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211dc6f700 1 -- 172.21.15.154:0/3138337090 learned_addr learned my addr 172.21.15.154:0/3138337090 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:13.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211d46e700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2118099e20 0x7f2118133280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211cc6d700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211809a730 0x7f21181337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211dc6f700 1 -- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211809a730 msgr2=0x7f21181337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211dc6f700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211809a730 0x7f21181337c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211dc6f700 1 -- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2118099e20 msgr2=0x7f2118133280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211dc6f700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2118099e20 0x7f2118133280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211dc6f700 1 -- 172.21.15.154:0/3138337090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110009b30 con 0x7f2118130890 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211d46e700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2118099e20 0x7f2118133280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211cc6d700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211809a730 0x7f21181337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.424+0000 7f211dc6f700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2118130890 0x7f2118133d00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f211000d000 tx=0x7f2110004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.425+0000 7f210dffb700 1 -- 172.21.15.154:0/3138337090 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110004450 con 0x7f2118130890 2023-09-30T22:25:13.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.425+0000 7f210dffb700 1 -- 172.21.15.154:0/3138337090 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21100045b0 con 0x7f2118130890 2023-09-30T22:25:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.425+0000 7f211f6d2700 1 -- 172.21.15.154:0/3138337090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21180a1300 con 0x7f2118130890 2023-09-30T22:25:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.425+0000 7f210dffb700 1 -- 172.21.15.154:0/3138337090 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110004920 con 0x7f2118130890 2023-09-30T22:25:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.425+0000 7f211f6d2700 1 -- 172.21.15.154:0/3138337090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2118119070 con 0x7f2118130890 2023-09-30T22:25:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.426+0000 7f211f6d2700 1 -- 172.21.15.154:0/3138337090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211804f2a0 con 0x7f2118130890 2023-09-30T22:25:13.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.427+0000 7f210dffb700 1 -- 172.21.15.154:0/3138337090 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f211001c410 con 0x7f2118130890 2023-09-30T22:25:13.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.427+0000 7f210dffb700 1 -- 172.21.15.154:0/3138337090 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21100413a0 con 0x7f2118130890 2023-09-30T22:25:13.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.431+0000 7f210dffb700 1 -- 172.21.15.154:0/3138337090 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f211002d760 con 0x7f2118130890 2023-09-30T22:25:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c42e9a700 1 Processor -- start 2023-09-30T22:25:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c42e9a700 1 -- start start 2023-09-30T22:25:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c42e9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c3c06a770 0x7f2c3c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c42e9a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 0x7f2c3c09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c42e9a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c09dea0 0x7f2c3c09e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c42e9a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c06b2e0 con 0x7f2c3c06a770 2023-09-30T22:25:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c42e9a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c09eca0 con 0x7f2c3c09dea0 2023-09-30T22:25:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c42e9a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c09f720 con 0x7f2c3c134f00 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c40c36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c3c06a770 0x7f2c3c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c40c36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c3c06a770 0x7f2c3c1349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38534/0 (socket says 172.21.15.154:38534) 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c40c36700 1 -- 172.21.15.154:0/2169373351 learned_addr learned my addr 172.21.15.154:0/2169373351 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c3bfff700 1 --2- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 0x7f2c3c09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.477+0000 7f2c41437700 1 --2- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c09dea0 0x7f2c3c09e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.478+0000 7f2c40c36700 1 -- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 msgr2=0x7f2c3c09d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.478+0000 7f2c40c36700 1 --2- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 0x7f2c3c09d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.478+0000 7f2c40c36700 1 -- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c09dea0 msgr2=0x7f2c3c09e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.478+0000 7f2c40c36700 1 --2- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c09dea0 0x7f2c3c09e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.478+0000 7f2c40c36700 1 -- 172.21.15.154:0/2169373351 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c06b480 con 0x7f2c3c06a770 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.478+0000 7f2c40c36700 1 --2- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c06a770 0x7f2c3c1349c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2c300098f0 tx=0x7f2c30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68273f7f30d80aca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.478+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/2169373351 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30011830 con 0x7f2c3c06a770 2023-09-30T22:25:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.478+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/2169373351 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c30011990 con 0x7f2c3c06a770 2023-09-30T22:25:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.478+0000 7f2c3b7fe700 1 -- 172.21.15.154:0/2169373351 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30011d00 con 0x7f2c3c06a770 2023-09-30T22:25:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.479+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c06a770 msgr2=0x7f2c3c1349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.479+0000 7f2c42e9a700 1 --2- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c06a770 0x7f2c3c1349c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2c300098f0 tx=0x7f2c30009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.479+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2169373351 shutdown_connections 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.479+0000 7f2c42e9a700 1 --2- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c09dea0 0x7f2c3c09e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.479+0000 7f2c42e9a700 1 --2- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c06a770 0x7f2c3c1349c0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.479+0000 7f2c42e9a700 1 --2- 172.21.15.154:0/2169373351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 0x7f2c3c09d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.479+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2169373351 >> 172.21.15.154:0/2169373351 conn(0x7f2c3c099c40 msgr2=0x7f2c3c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.479+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2169373351 shutdown_connections 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.479+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2169373351 wait complete. 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.480+0000 7f2c42e9a700 1 Processor -- start 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.480+0000 7f2c42e9a700 1 -- start start 2023-09-30T22:25:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.480+0000 7f2c42e9a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c06a770 0x7f2c3c11c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.480+0000 7f2c42e9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c09dea0 0x7f2c3c11aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.480+0000 7f2c42e9a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 0x7f2c3c11b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.480+0000 7f2c42e9a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c11ca60 con 0x7f2c3c09dea0 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.480+0000 7f2c42e9a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c11cd30 con 0x7f2c3c06a770 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.480+0000 7f2c42e9a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c126a50 con 0x7f2c3c134f00 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c3bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c09dea0 0x7f2c3c11aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c3bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c09dea0 0x7f2c3c11aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38538/0 (socket says 172.21.15.154:38538) 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c3bfff700 1 -- 172.21.15.154:0/2716995025 learned_addr learned my addr 172.21.15.154:0/2716995025 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c40c36700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c06a770 0x7f2c3c11c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c41437700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 0x7f2c3c11b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c3bfff700 1 -- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 msgr2=0x7f2c3c11b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c3bfff700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 0x7f2c3c11b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c3bfff700 1 -- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c06a770 msgr2=0x7f2c3c11c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c3bfff700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c06a770 0x7f2c3c11c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c3bfff700 1 -- 172.21.15.154:0/2716995025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30009550 con 0x7f2c3c09dea0 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c40c36700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c06a770 0x7f2c3c11c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c3bfff700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c09dea0 0x7f2c3c11aac0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800e9b0 tx=0x7f2c2800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c397fa700 1 -- 172.21.15.154:0/2716995025 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c28009710 con 0x7f2c3c09dea0 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c397fa700 1 -- 172.21.15.154:0/2716995025 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2800ee50 con 0x7f2c3c09dea0 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c397fa700 1 -- 172.21.15.154:0/2716995025 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800ca50 con 0x7f2c3c09dea0 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2716995025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c1274c0 con 0x7f2c3c09dea0 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.481+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2716995025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c11b540 con 0x7f2c3c09dea0 2023-09-30T22:25:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.482+0000 7f2c397fa700 1 -- 172.21.15.154:0/2716995025 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c2800cbb0 con 0x7f2c3c09dea0 2023-09-30T22:25:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.483+0000 7f2c397fa700 1 -- 172.21.15.154:0/2716995025 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c2803f6a0 con 0x7f2c3c09dea0 2023-09-30T22:25:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.483+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2716995025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c1268b0 con 0x7f2c3c09dea0 2023-09-30T22:25:13.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.487+0000 7f2c397fa700 1 -- 172.21.15.154:0/2716995025 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c3c1268b0 con 0x7f2c3c09dea0 2023-09-30T22:25:13.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.562+0000 7fea40635700 1 -- 172.21.15.154:0/1517182895 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea3806bce0 con 0x7fea380a1460 2023-09-30T22:25:13.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.562+0000 7fea2affd700 1 -- 172.21.15.154:0/1517182895 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea3403e090 con 0x7fea380a1460 2023-09-30T22:25:13.563 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.564+0000 7fea40635700 1 -- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea380a1460 msgr2=0x7fea38119d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.564+0000 7fea40635700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea380a1460 0x7fea38119d00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fea34000f60 tx=0x7fea3400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.564+0000 7fea40635700 1 -- 172.21.15.154:0/1517182895 shutdown_connections 2023-09-30T22:25:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.564+0000 7fea40635700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38133a70 0x7fea3811a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.564+0000 7fea40635700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea380a08e0 0x7fea381197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.564+0000 7fea40635700 1 --2- 172.21.15.154:0/1517182895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea380a1460 0x7fea38119d00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.564+0000 7fea40635700 1 -- 172.21.15.154:0/1517182895 >> 172.21.15.154:0/1517182895 conn(0x7fea380a2980 msgr2=0x7fea3812e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.565+0000 7fea40635700 1 -- 172.21.15.154:0/1517182895 shutdown_connections 2023-09-30T22:25:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.565+0000 7fea40635700 1 -- 172.21.15.154:0/1517182895 wait complete. 2023-09-30T22:25:13.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.578+0000 7f179bd02700 1 Processor -- start 2023-09-30T22:25:13.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:13.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.578+0000 7f179bd02700 1 -- start start 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179bd02700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f17941349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179bd02700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f179409e070 0x7f179413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179bd02700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179409eca0 con 0x7f1794134f00 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179bd02700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179409f720 con 0x7f179409e070 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179bd02700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179406b480 con 0x7f179406a770 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179a29f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f179409e070 0x7f179413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179929d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1794134f00 0x7f179409d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47324/0 (socket says 172.21.15.154:47324) 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179929d700 1 -- 172.21.15.154:0/3788392670 learned_addr learned my addr 172.21.15.154:0/3788392670 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f1799a9e700 1 --2- 172.21.15.154:0/3788392670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f17941349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179a29f700 1 -- 172.21.15.154:0/3788392670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 msgr2=0x7f17941349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179a29f700 1 --2- 172.21.15.154:0/3788392670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f17941349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179a29f700 1 -- 172.21.15.154:0/3788392670 >> v1:172.21.15.154:6789/0 conn(0x7f1794134f00 legacy=0x7f179409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179a29f700 1 -- 172.21.15.154:0/3788392670 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17941352d0 con 0x7f179409e070 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f1798a9c700 1 -- 172.21.15.154:0/3788392670 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564139514 0 0) 0x7f179409eca0 con 0x7f1794134f00 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f1799a9e700 1 --2- 172.21.15.154:0/3788392670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f17941349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f179a29f700 1 --2- 172.21.15.154:0/3788392670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179409e070 0x7f179413fcf0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f178c009d90 tx=0x7f178c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a389132e6a96b11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.579+0000 7f1798a9c700 1 -- 172.21.15.154:0/3788392670 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c00e070 con 0x7f179409e070 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f1798a9c700 1 -- 172.21.15.154:0/3788392670 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c00bbd0 con 0x7f179409e070 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f1798a9c700 1 -- 172.21.15.154:0/3788392670 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c012430 con 0x7f179409e070 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f179bd02700 1 -- 172.21.15.154:0/3788392670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179409e070 msgr2=0x7f179413fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f179bd02700 1 --2- 172.21.15.154:0/3788392670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179409e070 0x7f179413fcf0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f178c009d90 tx=0x7f178c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:13.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f179bd02700 1 -- 172.21.15.154:0/3788392670 shutdown_connections 2023-09-30T22:25:13.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f179bd02700 1 --2- 172.21.15.154:0/3788392670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f179409e070 0x7f179413fcf0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f179bd02700 1 --2- 172.21.15.154:0/3788392670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f17941349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f179bd02700 1 -- 172.21.15.154:0/3788392670 >> 172.21.15.154:0/3788392670 conn(0x7f1794099c40 msgr2=0x7f17940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f179bd02700 1 -- 172.21.15.154:0/3788392670 shutdown_connections 2023-09-30T22:25:13.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.580+0000 7f179bd02700 1 -- 172.21.15.154:0/3788392670 wait complete. 2023-09-30T22:25:13.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179bd02700 1 Processor -- start 2023-09-30T22:25:13.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179bd02700 1 -- start start 2023-09-30T22:25:13.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179bd02700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f1794135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179bd02700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f179409e070 0x7f1794135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179bd02700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1794134f00 0x7f17941362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179bd02700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794138ac0 con 0x7f1794134f00 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179bd02700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179409f220 con 0x7f179406a770 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179bd02700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1794140f30 con 0x7f179409e070 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f1799a9e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f1794135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f1799a9e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f1794135850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33014/0 (socket says 172.21.15.154:33014) 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179a29f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1794134f00 0x7f17941362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f179929d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f179409e070 0x7f1794135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.582+0000 7f1799a9e700 1 -- 172.21.15.154:0/3709595324 learned_addr learned my addr 172.21.15.154:0/3709595324 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f1799a9e700 1 -- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f179409e070 msgr2=0x7f1794135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f1799a9e700 1 --2- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f179409e070 0x7f1794135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f1799a9e700 1 -- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1794134f00 msgr2=0x7f17941362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f1799a9e700 1 --2- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1794134f00 0x7f17941362d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f1799a9e700 1 -- 172.21.15.154:0/3709595324 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c009a70 con 0x7f179406a770 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f179929d700 1 --2- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f179409e070 0x7f1794135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f179a29f700 1 --2- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1794134f00 0x7f17941362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f1799a9e700 1 --2- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f1794135850 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f179000e760 tx=0x7f179000ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f178a7fc700 1 -- 172.21.15.154:0/3709595324 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179000c070 con 0x7f179406a770 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f178a7fc700 1 -- 172.21.15.154:0/3709595324 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1790013610 con 0x7f179406a770 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f179bd02700 1 -- 172.21.15.154:0/3709595324 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1794140820 con 0x7f179406a770 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f178a7fc700 1 -- 172.21.15.154:0/3709595324 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17900139c0 con 0x7f179406a770 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.583+0000 7f179bd02700 1 -- 172.21.15.154:0/3709595324 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1794139760 con 0x7f179406a770 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.584+0000 7f179bd02700 1 -- 172.21.15.154:0/3709595324 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179404f2a0 con 0x7f179406a770 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.585+0000 7f178a7fc700 1 -- 172.21.15.154:0/3709595324 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1790013b20 con 0x7f179406a770 2023-09-30T22:25:13.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.585+0000 7f178a7fc700 1 -- 172.21.15.154:0/3709595324 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f179003f340 con 0x7f179406a770 2023-09-30T22:25:13.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.594+0000 7f178a7fc700 1 -- 172.21.15.154:0/3709595324 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f179000f040 con 0x7f179406a770 2023-09-30T22:25:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.627+0000 7f211f6d2700 1 -- 172.21.15.154:0/3138337090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2118072160 con 0x7f2118130890 2023-09-30T22:25:13.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.627+0000 7f210dffb700 1 -- 172.21.15.154:0/3138337090 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2110033090 con 0x7f2118130890 2023-09-30T22:25:13.629 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.629+0000 7f211f6d2700 1 -- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2118130890 msgr2=0x7f2118133d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.629+0000 7f211f6d2700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2118130890 0x7f2118133d00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f211000d000 tx=0x7f2110004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.630+0000 7f211f6d2700 1 -- 172.21.15.154:0/3138337090 shutdown_connections 2023-09-30T22:25:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.630+0000 7f211f6d2700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2118130890 0x7f2118133d00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.630+0000 7f211f6d2700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2118099e20 0x7f2118133280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.630+0000 7f211f6d2700 1 --2- 172.21.15.154:0/3138337090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211809a730 0x7f21181337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.630+0000 7f211f6d2700 1 -- 172.21.15.154:0/3138337090 >> 172.21.15.154:0/3138337090 conn(0x7f21180a2980 msgr2=0x7f211809fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.630+0000 7f211f6d2700 1 -- 172.21.15.154:0/3138337090 shutdown_connections 2023-09-30T22:25:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.630+0000 7f211f6d2700 1 -- 172.21.15.154:0/3138337090 wait complete. 2023-09-30T22:25:13.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.692+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2716995025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2c3c1268b0 con 0x7f2c3c09dea0 2023-09-30T22:25:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.693+0000 7f2c397fa700 1 -- 172.21.15.154:0/2716995025 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c3c1268b0 con 0x7f2c3c09dea0 2023-09-30T22:25:13.694 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:13.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.695+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c09dea0 msgr2=0x7f2c3c11aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.695+0000 7f2c42e9a700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c09dea0 0x7f2c3c11aac0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800e9b0 tx=0x7f2c2800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.695+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2716995025 shutdown_connections 2023-09-30T22:25:13.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.695+0000 7f2c42e9a700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c3c134f00 0x7f2c3c11b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.695+0000 7f2c42e9a700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c3c06a770 0x7f2c3c11c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.695+0000 7f2c42e9a700 1 --2- 172.21.15.154:0/2716995025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c3c09dea0 0x7f2c3c11aac0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.695+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2716995025 >> 172.21.15.154:0/2716995025 conn(0x7f2c3c099c40 msgr2=0x7f2c3c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.695+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2716995025 shutdown_connections 2023-09-30T22:25:13.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.695+0000 7f2c42e9a700 1 -- 172.21.15.154:0/2716995025 wait complete. 2023-09-30T22:25:13.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:13.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.787+0000 7f179bd02700 1 -- 172.21.15.154:0/3709595324 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1794134c60 con 0x7f179406a770 2023-09-30T22:25:13.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.787+0000 7f178a7fc700 1 -- 172.21.15.154:0/3709595324 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1790010540 con 0x7f179406a770 2023-09-30T22:25:13.789 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.790+0000 7f179bd02700 1 -- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 msgr2=0x7f1794135850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.790+0000 7f179bd02700 1 --2- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f1794135850 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f179000e760 tx=0x7f179000ea70 comp rx=0 tx=0).stop 2023-09-30T22:25:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.790+0000 7f179bd02700 1 -- 172.21.15.154:0/3709595324 shutdown_connections 2023-09-30T22:25:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.790+0000 7f179bd02700 1 --2- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1794134f00 0x7f17941362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.790+0000 7f179bd02700 1 --2- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f179406a770 0x7f1794135850 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.790+0000 7f179bd02700 1 --2- 172.21.15.154:0/3709595324 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f179409e070 0x7f1794135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.790+0000 7f179bd02700 1 -- 172.21.15.154:0/3709595324 >> 172.21.15.154:0/3709595324 conn(0x7f1794099c40 msgr2=0x7f179409cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.790+0000 7f179bd02700 1 -- 172.21.15.154:0/3709595324 shutdown_connections 2023-09-30T22:25:13.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:13.790+0000 7f179bd02700 1 -- 172.21.15.154:0/3709595324 wait complete. 2023-09-30T22:25:13.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:14.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:14.644 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:14.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:14.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.719+0000 7ffaf5adf700 1 Processor -- start 2023-09-30T22:25:14.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.719+0000 7ffaf5adf700 1 -- start start 2023-09-30T22:25:14.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaf5adf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaf5adf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf0131f30 0x7ffaf009c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaf5adf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00a0f20 con 0x7ffaf01314b0 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaf5adf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00667e0 con 0x7ffaf0131f30 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaf5adf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00a23c0 con 0x7ffaf0066410 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaeeffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ffaf01314b0 0x7ffaf009bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47326/0 (socket says 172.21.15.154:47326) 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaeeffd700 1 -- 172.21.15.154:0/4166859734 learned_addr learned my addr 172.21.15.154:0/4166859734 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaef7fe700 1 --2- 172.21.15.154:0/4166859734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaeffff700 1 --2- 172.21.15.154:0/4166859734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf0131f30 0x7ffaf009c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaef7fe700 1 -- 172.21.15.154:0/4166859734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf0131f30 msgr2=0x7ffaf009c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:14.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaef7fe700 1 --2- 172.21.15.154:0/4166859734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf0131f30 0x7ffaf009c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaef7fe700 1 -- 172.21.15.154:0/4166859734 >> v1:172.21.15.154:6789/0 conn(0x7ffaf01314b0 legacy=0x7ffaf009bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.720+0000 7ffaef7fe700 1 -- 172.21.15.154:0/4166859734 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf01323b0 con 0x7ffaf0066410 2023-09-30T22:25:14.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.721+0000 7ffaef7fe700 1 --2- 172.21.15.154:0/4166859734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01319f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009880 tx=0x7ffae0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93a8f3ab2389536f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.721+0000 7ffaee7fc700 1 -- 172.21.15.154:0/4166859734 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0005e30 con 0x7ffaf0066410 2023-09-30T22:25:14.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.721+0000 7ffaee7fc700 1 -- 172.21.15.154:0/4166859734 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae0004030 con 0x7ffaf0066410 2023-09-30T22:25:14.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.721+0000 7ffaee7fc700 1 -- 172.21.15.154:0/4166859734 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae00043c0 con 0x7ffaf0066410 2023-09-30T22:25:14.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.722+0000 7ffaf5adf700 1 -- 172.21.15.154:0/4166859734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 msgr2=0x7ffaf01319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.722+0000 7ffaf5adf700 1 --2- 172.21.15.154:0/4166859734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01319f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009880 tx=0x7ffae0009b90 comp rx=0 tx=0).stop 2023-09-30T22:25:14.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.722+0000 7ffaf5adf700 1 -- 172.21.15.154:0/4166859734 shutdown_connections 2023-09-30T22:25:14.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.722+0000 7ffaf5adf700 1 --2- 172.21.15.154:0/4166859734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf0131f30 0x7ffaf009c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.722+0000 7ffaf5adf700 1 --2- 172.21.15.154:0/4166859734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01319f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.722+0000 7ffaf5adf700 1 -- 172.21.15.154:0/4166859734 >> 172.21.15.154:0/4166859734 conn(0x7ffaf00a2980 msgr2=0x7ffaf00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.722+0000 7ffaf5adf700 1 -- 172.21.15.154:0/4166859734 shutdown_connections 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.722+0000 7ffaf5adf700 1 -- 172.21.15.154:0/4166859734 wait complete. 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.723+0000 7ffaf5adf700 1 Processor -- start 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.723+0000 7ffaf5adf700 1 -- start start 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.723+0000 7ffaf5adf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.723+0000 7ffaf5adf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf01314b0 0x7ffaf0137df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.723+0000 7ffaf5adf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaf0131f30 0x7ffaf0138330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.723+0000 7ffaf5adf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf011a950 con 0x7ffaf0131f30 2023-09-30T22:25:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.723+0000 7ffaf5adf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf0118ff0 con 0x7ffaf01314b0 2023-09-30T22:25:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.723+0000 7ffaf5adf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00a1d50 con 0x7ffaf0066410 2023-09-30T22:25:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaef7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaef7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01378b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:49256/0 (socket says 172.21.15.154:49256) 2023-09-30T22:25:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaef7fe700 1 -- 172.21.15.154:0/1221670331 learned_addr learned my addr 172.21.15.154:0/1221670331 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaeeffd700 1 --2- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf01314b0 0x7ffaf0137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaef7fe700 1 -- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf01314b0 msgr2=0x7ffaf0137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaef7fe700 1 --2- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf01314b0 0x7ffaf0137df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaef7fe700 1 -- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaf0131f30 msgr2=0x7ffaf0138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaef7fe700 1 --2- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaf0131f30 0x7ffaf0138330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaef7fe700 1 -- 172.21.15.154:0/1221670331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0009430 con 0x7ffaf0066410 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaef7fe700 1 --2- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01378b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009ee0 tx=0x7ffae0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffad7fff700 1 -- 172.21.15.154:0/1221670331 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0003d30 con 0x7ffaf0066410 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffad7fff700 1 -- 172.21.15.154:0/1221670331 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae0003e90 con 0x7ffaf0066410 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaf5adf700 1 -- 172.21.15.154:0/1221670331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf009dda0 con 0x7ffaf0066410 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffad7fff700 1 -- 172.21.15.154:0/1221670331 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae001d670 con 0x7ffaf0066410 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.724+0000 7ffaf5adf700 1 -- 172.21.15.154:0/1221670331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf011a3b0 con 0x7ffaf0066410 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.725+0000 7ffaf5adf700 1 -- 172.21.15.154:0/1221670331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf004f2a0 con 0x7ffaf0066410 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.725+0000 7ffad7fff700 1 -- 172.21.15.154:0/1221670331 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffae001d7d0 con 0x7ffaf0066410 2023-09-30T22:25:14.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.726+0000 7ffad7fff700 1 -- 172.21.15.154:0/1221670331 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffae0040790 con 0x7ffaf0066410 2023-09-30T22:25:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.730+0000 7ffad7fff700 1 -- 172.21.15.154:0/1221670331 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffae0018bd0 con 0x7ffaf0066410 2023-09-30T22:25:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.774+0000 7f6efce71700 1 Processor -- start 2023-09-30T22:25:14.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.774+0000 7f6efce71700 1 -- start start 2023-09-30T22:25:14.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.775+0000 7f6efce71700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ef809f350 0x7f6ef8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.775+0000 7f6efce71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef81371c0 0x7f6ef81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.775+0000 7f6efce71700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef809c970 con 0x7f6ef809e870 2023-09-30T22:25:14.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.775+0000 7f6efce71700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef80a0920 con 0x7f6ef809f350 2023-09-30T22:25:14.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.775+0000 7f6efce71700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef809f9c0 con 0x7f6ef81371c0 2023-09-30T22:25:14.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.775+0000 7f6ef6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef81371c0 0x7f6ef81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.775+0000 7f6ef5d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ef809f350 0x7f6ef8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.775+0000 7f6ef6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef81371c0 0x7f6ef81395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:49262/0 (socket says 172.21.15.154:49262) 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.775+0000 7f6ef6d9d700 1 -- 172.21.15.154:0/3072917363 learned_addr learned my addr 172.21.15.154:0/3072917363 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6ef6d9d700 1 -- 172.21.15.154:0/3072917363 >> v2:172.21.15.154:3300/0 conn(0x7f6ef809f350 msgr2=0x7f6ef8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6ef6d9d700 1 --2- 172.21.15.154:0/3072917363 >> v2:172.21.15.154:3300/0 conn(0x7f6ef809f350 0x7f6ef8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6ef6d9d700 1 -- 172.21.15.154:0/3072917363 >> v1:172.21.15.154:6789/0 conn(0x7f6ef809e870 legacy=0x7f6ef809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6ef6d9d700 1 -- 172.21.15.154:0/3072917363 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef809bab0 con 0x7f6ef81371c0 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6ef5d9b700 1 --2- 172.21.15.154:0/3072917363 >> v2:172.21.15.154:3300/0 conn(0x7f6ef809f350 0x7f6ef8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6ef6d9d700 1 --2- 172.21.15.154:0/3072917363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef81371c0 0x7f6ef81395a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009e50 tx=0x7f6ef000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e76e1b6c4142f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6ef559a700 1 -- 172.21.15.154:0/3072917363 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000e070 con 0x7f6ef81371c0 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6ef559a700 1 -- 172.21.15.154:0/3072917363 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef000b910 con 0x7f6ef81371c0 2023-09-30T22:25:14.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6ef559a700 1 -- 172.21.15.154:0/3072917363 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000bcc0 con 0x7f6ef81371c0 2023-09-30T22:25:14.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.776+0000 7f6efce71700 1 -- 172.21.15.154:0/3072917363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef81371c0 msgr2=0x7f6ef81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.777+0000 7f6efce71700 1 --2- 172.21.15.154:0/3072917363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef81371c0 0x7f6ef81395a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009e50 tx=0x7f6ef000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.777+0000 7f6efce71700 1 -- 172.21.15.154:0/3072917363 shutdown_connections 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.777+0000 7f6efce71700 1 --2- 172.21.15.154:0/3072917363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef81371c0 0x7f6ef81395a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.777+0000 7f6efce71700 1 --2- 172.21.15.154:0/3072917363 >> v2:172.21.15.154:3300/0 conn(0x7f6ef809f350 0x7f6ef8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.777+0000 7f6efce71700 1 -- 172.21.15.154:0/3072917363 >> 172.21.15.154:0/3072917363 conn(0x7f6ef80a4430 msgr2=0x7f6ef80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.777+0000 7f6efce71700 1 -- 172.21.15.154:0/3072917363 shutdown_connections 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.777+0000 7f6efce71700 1 -- 172.21.15.154:0/3072917363 wait complete. 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6efce71700 1 Processor -- start 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6efce71700 1 -- start start 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6efce71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef809e870 0x7f6ef811e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6efce71700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef809f350 0x7f6ef811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6efce71700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ef81371c0 0x7f6ef811f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6efce71700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8133f80 con 0x7f6ef809f350 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6efce71700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8122190 con 0x7f6ef81371c0 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6efce71700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef809dba0 con 0x7f6ef809e870 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6ef659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef809e870 0x7f6ef811e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6ef659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef809e870 0x7f6ef811e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:49274/0 (socket says 172.21.15.154:49274) 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6ef5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef809f350 0x7f6ef811ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.778+0000 7f6ef659c700 1 -- 172.21.15.154:0/1223748638 learned_addr learned my addr 172.21.15.154:0/1223748638 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ef6d9d700 1 --2- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ef81371c0 0x7f6ef811f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ef5d9b700 1 -- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef809e870 msgr2=0x7f6ef811e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ef5d9b700 1 --2- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef809e870 0x7f6ef811e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ef5d9b700 1 -- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ef81371c0 msgr2=0x7f6ef811f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ef5d9b700 1 --2- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ef81371c0 0x7f6ef811f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ef5d9b700 1 -- 172.21.15.154:0/1223748638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0094a0 con 0x7f6ef809f350 2023-09-30T22:25:14.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ef5d9b700 1 --2- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef809f350 0x7f6ef811ebb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00e9b0 tx=0x7f6eec00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ee6ffd700 1 -- 172.21.15.154:0/1223748638 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00ee50 con 0x7f6ef809f350 2023-09-30T22:25:14.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ee6ffd700 1 -- 172.21.15.154:0/1223748638 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec00c850 con 0x7f6ef809f350 2023-09-30T22:25:14.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6ee6ffd700 1 -- 172.21.15.154:0/1223748638 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00cc00 con 0x7f6ef809f350 2023-09-30T22:25:14.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6efce71700 1 -- 172.21.15.154:0/1223748638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef0009b30 con 0x7f6ef809f350 2023-09-30T22:25:14.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.779+0000 7f6efce71700 1 -- 172.21.15.154:0/1223748638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef8121bf0 con 0x7f6ef809f350 2023-09-30T22:25:14.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.780+0000 7f6ee6ffd700 1 -- 172.21.15.154:0/1223748638 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6eec013470 con 0x7f6ef809f350 2023-09-30T22:25:14.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.780+0000 7f6ee6ffd700 1 -- 172.21.15.154:0/1223748638 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6eec03fa60 con 0x7f6ef809f350 2023-09-30T22:25:14.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.780+0000 7f6efce71700 1 -- 172.21.15.154:0/1223748638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef804f2a0 con 0x7f6ef809f350 2023-09-30T22:25:14.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.785+0000 7f6ee6ffd700 1 -- 172.21.15.154:0/1223748638 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6eec021070 con 0x7f6ef809f350 2023-09-30T22:25:14.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:14.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.841+0000 7fca88259700 1 Processor -- start 2023-09-30T22:25:14.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.841+0000 7fca88259700 1 -- start start 2023-09-30T22:25:14.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca88259700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca8009ad40 0x7fca80133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca88259700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca80133f70 0x7fca801343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca88259700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 0x7fca800a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca88259700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca800a3b60 con 0x7fca8009ad40 2023-09-30T22:25:14.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca88259700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca801348e0 con 0x7fca80133f70 2023-09-30T22:25:14.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca88259700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca8009b110 con 0x7fca800a0a70 2023-09-30T22:25:14.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca857f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca80133f70 0x7fca801343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca85ff5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca8009ad40 0x7fca80133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca85ff5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca8009ad40 0x7fca80133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38586/0 (socket says 172.21.15.154:38586) 2023-09-30T22:25:14.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca857f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca80133f70 0x7fca801343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33046/0 (socket says 172.21.15.154:33046) 2023-09-30T22:25:14.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca85ff5700 1 -- 172.21.15.154:0/3380644654 learned_addr learned my addr 172.21.15.154:0/3380644654 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:14.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca867f6700 1 --2- 172.21.15.154:0/3380644654 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 0x7fca800a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca857f4700 1 -- 172.21.15.154:0/3380644654 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 msgr2=0x7fca800a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:14.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca857f4700 1 --2- 172.21.15.154:0/3380644654 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 0x7fca800a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca857f4700 1 -- 172.21.15.154:0/3380644654 >> v2:172.21.15.154:3300/0 conn(0x7fca8009ad40 msgr2=0x7fca80133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:14.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca857f4700 1 --2- 172.21.15.154:0/3380644654 >> v2:172.21.15.154:3300/0 conn(0x7fca8009ad40 0x7fca80133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca857f4700 1 -- 172.21.15.154:0/3380644654 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800a2fa0 con 0x7fca80133f70 2023-09-30T22:25:14.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.842+0000 7fca85ff5700 1 --2- 172.21.15.154:0/3380644654 >> v2:172.21.15.154:3300/0 conn(0x7fca8009ad40 0x7fca80133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:14.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.843+0000 7fca857f4700 1 --2- 172.21.15.154:0/3380644654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca80133f70 0x7fca801343a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fca70009840 tx=0x7fca70009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24b4a7bc0e0e594b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.843+0000 7fca84ff3700 1 -- 172.21.15.154:0/3380644654 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70011830 con 0x7fca80133f70 2023-09-30T22:25:14.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.843+0000 7fca84ff3700 1 -- 172.21.15.154:0/3380644654 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca70011990 con 0x7fca80133f70 2023-09-30T22:25:14.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.843+0000 7fca84ff3700 1 -- 172.21.15.154:0/3380644654 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70011d20 con 0x7fca80133f70 2023-09-30T22:25:14.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.844+0000 7fca88259700 1 -- 172.21.15.154:0/3380644654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca80133f70 msgr2=0x7fca801343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.844+0000 7fca88259700 1 --2- 172.21.15.154:0/3380644654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca80133f70 0x7fca801343a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fca70009840 tx=0x7fca70009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:14.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.844+0000 7fca88259700 1 -- 172.21.15.154:0/3380644654 shutdown_connections 2023-09-30T22:25:14.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.844+0000 7fca88259700 1 --2- 172.21.15.154:0/3380644654 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 0x7fca800a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.844+0000 7fca88259700 1 --2- 172.21.15.154:0/3380644654 >> v2:172.21.15.154:3300/0 conn(0x7fca8009ad40 0x7fca80133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.844+0000 7fca88259700 1 --2- 172.21.15.154:0/3380644654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca80133f70 0x7fca801343a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.844+0000 7fca88259700 1 -- 172.21.15.154:0/3380644654 >> 172.21.15.154:0/3380644654 conn(0x7fca80099c40 msgr2=0x7fca8006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.844+0000 7fca88259700 1 -- 172.21.15.154:0/3380644654 shutdown_connections 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.844+0000 7fca88259700 1 -- 172.21.15.154:0/3380644654 wait complete. 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca88259700 1 Processor -- start 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca88259700 1 -- start start 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca88259700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8009ad40 0x7fca80120290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca88259700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 0x7fca801207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca88259700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca80133f70 0x7fca80120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca88259700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca80121ea0 con 0x7fca80133f70 2023-09-30T22:25:14.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca88259700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca80123b70 con 0x7fca8009ad40 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca88259700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca80122d30 con 0x7fca800a0a70 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca867f6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca80133f70 0x7fca80120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca857f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 0x7fca801207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca867f6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca80133f70 0x7fca80120d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38598/0 (socket says 172.21.15.154:38598) 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.845+0000 7fca867f6700 1 -- 172.21.15.154:0/1457082247 learned_addr learned my addr 172.21.15.154:0/1457082247 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca85ff5700 1 --2- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8009ad40 0x7fca80120290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca867f6700 1 -- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 msgr2=0x7fca801207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca867f6700 1 --2- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 0x7fca801207d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca867f6700 1 -- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8009ad40 msgr2=0x7fca80120290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca867f6700 1 --2- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8009ad40 0x7fca80120290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca867f6700 1 -- 172.21.15.154:0/1457082247 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c009550 con 0x7fca80133f70 2023-09-30T22:25:14.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca857f4700 1 --2- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 0x7fca801207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:14.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca867f6700 1 --2- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca80133f70 0x7fca80120d10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fca78009dd0 tx=0x7fca7800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca767fc700 1 -- 172.21.15.154:0/1457082247 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800cce0 con 0x7fca80133f70 2023-09-30T22:25:14.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca767fc700 1 -- 172.21.15.154:0/1457082247 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800f040 con 0x7fca80133f70 2023-09-30T22:25:14.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.846+0000 7fca767fc700 1 -- 172.21.15.154:0/1457082247 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78009e60 con 0x7fca80133f70 2023-09-30T22:25:14.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.847+0000 7fca88259700 1 -- 172.21.15.154:0/1457082247 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca700094a0 con 0x7fca80133f70 2023-09-30T22:25:14.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.847+0000 7fca88259700 1 -- 172.21.15.154:0/1457082247 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8009bf00 con 0x7fca80133f70 2023-09-30T22:25:14.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.848+0000 7fca767fc700 1 -- 172.21.15.154:0/1457082247 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca78014480 con 0x7fca80133f70 2023-09-30T22:25:14.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.848+0000 7fca88259700 1 -- 172.21.15.154:0/1457082247 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca80123930 con 0x7fca80133f70 2023-09-30T22:25:14.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.848+0000 7fca767fc700 1 -- 172.21.15.154:0/1457082247 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fca7803ff70 con 0x7fca80133f70 2023-09-30T22:25:14.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.853+0000 7fca767fc700 1 -- 172.21.15.154:0/1457082247 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca80123930 con 0x7fca80133f70 2023-09-30T22:25:14.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.934+0000 7ffaf5adf700 1 -- 172.21.15.154:0/1221670331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffaf00724c0 con 0x7ffaf0066410 2023-09-30T22:25:14.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.935+0000 7ffad7fff700 1 -- 172.21.15.154:0/1221670331 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffae0016020 con 0x7ffaf0066410 2023-09-30T22:25:14.936 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.938+0000 7ffaf5adf700 1 -- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 msgr2=0x7ffaf01378b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.938+0000 7ffaf5adf700 1 --2- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01378b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009ee0 tx=0x7ffae0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:14.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.938+0000 7f927f32b700 1 Processor -- start 2023-09-30T22:25:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.938+0000 7ffaf5adf700 1 -- 172.21.15.154:0/1221670331 shutdown_connections 2023-09-30T22:25:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.938+0000 7ffaf5adf700 1 --2- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaf0131f30 0x7ffaf0138330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.938+0000 7ffaf5adf700 1 --2- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffaf0066410 0x7ffaf01378b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.938+0000 7ffaf5adf700 1 --2- 172.21.15.154:0/1221670331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaf01314b0 0x7ffaf0137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.938+0000 7ffaf5adf700 1 -- 172.21.15.154:0/1221670331 >> 172.21.15.154:0/1221670331 conn(0x7ffaf00a2980 msgr2=0x7ffaf009f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:14.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.938+0000 7f927f32b700 1 -- start start 2023-09-30T22:25:14.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7ffaf5adf700 1 -- 172.21.15.154:0/1221670331 shutdown_connections 2023-09-30T22:25:14.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7ffaf5adf700 1 -- 172.21.15.154:0/1221670331 wait complete. 2023-09-30T22:25:14.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7f927f32b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f927809f350 0x7f9278136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7f927f32b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f92781371c0 0x7f92781395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7f927f32b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927809c970 con 0x7f927809e870 2023-09-30T22:25:14.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7f927f32b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92780a0920 con 0x7f92781371c0 2023-09-30T22:25:14.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7f927f32b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f927809f9c0 con 0x7f927809f350 2023-09-30T22:25:14.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7f927d8c8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f92781371c0 0x7f92781395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7f927d0c7700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f927809e870 0x7f927809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47354/0 (socket says 172.21.15.154:47354) 2023-09-30T22:25:14.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7f927d0c7700 1 -- 172.21.15.154:0/1733320873 learned_addr learned my addr 172.21.15.154:0/1733320873 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:14.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.939+0000 7f927c8c6700 1 --2- 172.21.15.154:0/1733320873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f927809f350 0x7f9278136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.940+0000 7f927d8c8700 1 -- 172.21.15.154:0/1733320873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f927809f350 msgr2=0x7f9278136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.940+0000 7f927d8c8700 1 --2- 172.21.15.154:0/1733320873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f927809f350 0x7f9278136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.940+0000 7f927d8c8700 1 -- 172.21.15.154:0/1733320873 >> v1:172.21.15.154:6789/0 conn(0x7f927809e870 legacy=0x7f927809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.940+0000 7f926ffff700 1 -- 172.21.15.154:0/1733320873 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487084259 0 0) 0x7f927809c970 con 0x7f927809e870 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.940+0000 7f927d8c8700 1 -- 172.21.15.154:0/1733320873 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927809bab0 con 0x7f92781371c0 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.940+0000 7f927d8c8700 1 --2- 172.21.15.154:0/1733320873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 0x7f92781395a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9270009d90 tx=0x7f927000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb1bf0d6028e754 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.940+0000 7f926ffff700 1 -- 172.21.15.154:0/1733320873 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927000bd20 con 0x7f92781371c0 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.940+0000 7f926ffff700 1 -- 172.21.15.154:0/1733320873 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927000be80 con 0x7f92781371c0 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.940+0000 7f926ffff700 1 -- 172.21.15.154:0/1733320873 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270010710 con 0x7f92781371c0 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.941+0000 7f927f32b700 1 -- 172.21.15.154:0/1733320873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 msgr2=0x7f92781395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.941+0000 7f927f32b700 1 --2- 172.21.15.154:0/1733320873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 0x7f92781395a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9270009d90 tx=0x7f927000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.941+0000 7f927f32b700 1 -- 172.21.15.154:0/1733320873 shutdown_connections 2023-09-30T22:25:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.941+0000 7f927f32b700 1 --2- 172.21.15.154:0/1733320873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 0x7f92781395a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.941+0000 7f927f32b700 1 --2- 172.21.15.154:0/1733320873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f927809f350 0x7f9278136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.941+0000 7f927f32b700 1 -- 172.21.15.154:0/1733320873 >> 172.21.15.154:0/1733320873 conn(0x7f92780a4430 msgr2=0x7f92780a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.941+0000 7f927f32b700 1 -- 172.21.15.154:0/1733320873 shutdown_connections 2023-09-30T22:25:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.941+0000 7f927f32b700 1 -- 172.21.15.154:0/1733320873 wait complete. 2023-09-30T22:25:14.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.943+0000 7f927f32b700 1 Processor -- start 2023-09-30T22:25:14.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.943+0000 7f927f32b700 1 -- start start 2023-09-30T22:25:14.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.943+0000 7f927f32b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f927809e870 0x7f927811e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.943+0000 7f927f32b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f927809f350 0x7f927811ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.943+0000 7f927f32b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 0x7f927811f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:14.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.943+0000 7f927f32b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9278122260 con 0x7f92781371c0 2023-09-30T22:25:14.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.943+0000 7f927f32b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9278121630 con 0x7f927809f350 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.943+0000 7f927f32b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f927809dba0 con 0x7f927809e870 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.943+0000 7f927d8c8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 0x7f927811f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927d8c8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 0x7f927811f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38612/0 (socket says 172.21.15.154:38612) 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927d8c8700 1 -- 172.21.15.154:0/856594132 learned_addr learned my addr 172.21.15.154:0/856594132 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927c8c6700 1 --2- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f927809f350 0x7f927811ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927d8c8700 1 -- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f927809e870 msgr2=0x7f927811e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927d8c8700 1 --2- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f927809e870 0x7f927811e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927d8c8700 1 -- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f927809f350 msgr2=0x7f927811ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927d8c8700 1 --2- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f927809f350 0x7f927811ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927d8c8700 1 -- 172.21.15.154:0/856594132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270009a70 con 0x7f92781371c0 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927d8c8700 1 --2- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 0x7f927811f1c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f927809f830 tx=0x7f9270004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f926dffb700 1 -- 172.21.15.154:0/856594132 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270010070 con 0x7f92781371c0 2023-09-30T22:25:14.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f926dffb700 1 -- 172.21.15.154:0/856594132 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270003e10 con 0x7f92781371c0 2023-09-30T22:25:14.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f927f32b700 1 -- 172.21.15.154:0/856594132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92781219f0 con 0x7f92781371c0 2023-09-30T22:25:14.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.944+0000 7f926dffb700 1 -- 172.21.15.154:0/856594132 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270025e70 con 0x7f92781371c0 2023-09-30T22:25:14.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.945+0000 7f927f32b700 1 -- 172.21.15.154:0/856594132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9278120b50 con 0x7f92781371c0 2023-09-30T22:25:14.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.946+0000 7f927f32b700 1 -- 172.21.15.154:0/856594132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927804f2a0 con 0x7f92781371c0 2023-09-30T22:25:14.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.946+0000 7f926dffb700 1 -- 172.21.15.154:0/856594132 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9270004460 con 0x7f92781371c0 2023-09-30T22:25:14.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.946+0000 7f926dffb700 1 -- 172.21.15.154:0/856594132 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9270048a70 con 0x7f92781371c0 2023-09-30T22:25:14.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.951+0000 7f926dffb700 1 -- 172.21.15.154:0/856594132 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f927004ae60 con 0x7f92781371c0 2023-09-30T22:25:14.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:14.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.993+0000 7f6efce71700 1 -- 172.21.15.154:0/1223748638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ef8120a70 con 0x7f6ef809f350 2023-09-30T22:25:14.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.993+0000 7f6ee6ffd700 1 -- 172.21.15.154:0/1223748638 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6eec02a090 con 0x7f6ef809f350 2023-09-30T22:25:14.994 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:14.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.996+0000 7f6efce71700 1 -- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef809f350 msgr2=0x7f6ef811ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:14.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.997+0000 7f6efce71700 1 --2- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef809f350 0x7f6ef811ebb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00e9b0 tx=0x7f6eec00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.997+0000 7f6efce71700 1 -- 172.21.15.154:0/1223748638 shutdown_connections 2023-09-30T22:25:14.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.997+0000 7f6efce71700 1 --2- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ef81371c0 0x7f6ef811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.997+0000 7f6efce71700 1 --2- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ef809e870 0x7f6ef811e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.997+0000 7f6efce71700 1 --2- 172.21.15.154:0/1223748638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef809f350 0x7f6ef811ebb0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:14.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.997+0000 7f6efce71700 1 -- 172.21.15.154:0/1223748638 >> 172.21.15.154:0/1223748638 conn(0x7f6ef80a4430 msgr2=0x7f6ef8134960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:14.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.997+0000 7f6efce71700 1 -- 172.21.15.154:0/1223748638 shutdown_connections 2023-09-30T22:25:14.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:14.997+0000 7f6efce71700 1 -- 172.21.15.154:0/1223748638 wait complete. 2023-09-30T22:25:15.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.080+0000 7fca88259700 1 -- 172.21.15.154:0/1457082247 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fca80123930 con 0x7fca80133f70 2023-09-30T22:25:15.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.080+0000 7fca767fc700 1 -- 172.21.15.154:0/1457082247 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca80123930 con 0x7fca80133f70 2023-09-30T22:25:15.081 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:15.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.082+0000 7fca88259700 1 -- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca80133f70 msgr2=0x7fca80120d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.082+0000 7fca88259700 1 --2- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca80133f70 0x7fca80120d10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fca78009dd0 tx=0x7fca7800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.082+0000 7fca88259700 1 -- 172.21.15.154:0/1457082247 shutdown_connections 2023-09-30T22:25:15.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.082+0000 7fca88259700 1 --2- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca80133f70 0x7fca80120d10 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.082+0000 7fca88259700 1 --2- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8009ad40 0x7fca80120290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.082+0000 7fca88259700 1 --2- 172.21.15.154:0/1457082247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca800a0a70 0x7fca801207d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.082+0000 7fca88259700 1 -- 172.21.15.154:0/1457082247 >> 172.21.15.154:0/1457082247 conn(0x7fca80099c40 msgr2=0x7fca80132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.082+0000 7fca88259700 1 -- 172.21.15.154:0/1457082247 shutdown_connections 2023-09-30T22:25:15.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.083+0000 7fca88259700 1 -- 172.21.15.154:0/1457082247 wait complete. 2023-09-30T22:25:15.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:15.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.160+0000 7f927f32b700 1 -- 172.21.15.154:0/856594132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f927806b2a0 con 0x7f92781371c0 2023-09-30T22:25:15.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.160+0000 7f926dffb700 1 -- 172.21.15.154:0/856594132 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9270033020 con 0x7f92781371c0 2023-09-30T22:25:15.161 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:15.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.162+0000 7f927f32b700 1 -- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 msgr2=0x7f927811f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:15.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.162+0000 7f927f32b700 1 --2- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 0x7f927811f1c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f927809f830 tx=0x7f9270004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.162+0000 7f927f32b700 1 -- 172.21.15.154:0/856594132 shutdown_connections 2023-09-30T22:25:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.162+0000 7f927f32b700 1 --2- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92781371c0 0x7f927811f1c0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.162+0000 7f927f32b700 1 --2- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f927809e870 0x7f927811e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.162+0000 7f927f32b700 1 --2- 172.21.15.154:0/856594132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f927809f350 0x7f927811ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.162+0000 7f927f32b700 1 -- 172.21.15.154:0/856594132 >> 172.21.15.154:0/856594132 conn(0x7f92780a4430 msgr2=0x7f9278071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.162+0000 7f927f32b700 1 -- 172.21.15.154:0/856594132 shutdown_connections 2023-09-30T22:25:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:15.162+0000 7f927f32b700 1 -- 172.21.15.154:0/856594132 wait complete. 2023-09-30T22:25:15.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:15.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:16.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:16.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:16.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.104+0000 7f33fa807700 1 Processor -- start 2023-09-30T22:25:16.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.104+0000 7f33fa807700 1 -- start start 2023-09-30T22:25:16.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33fa807700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f4131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33fa807700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33f409bc70 0x7f33f409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33fa807700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f40a1640 con 0x7f33f409c5c0 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33fa807700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f406eb30 con 0x7f33f409bc70 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33fa807700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40a22d0 con 0x7f33f4131980 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33f37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33f409bc70 0x7f33f409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33f37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33f409bc70 0x7f33f409c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43476/0 (socket says 172.21.15.154:43476) 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33f37fe700 1 -- 172.21.15.154:0/3493200875 learned_addr learned my addr 172.21.15.154:0/3493200875 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33f3fff700 1 --2- 172.21.15.154:0/3493200875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f4131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33f3fff700 1 -- 172.21.15.154:0/3493200875 >> v2:172.21.15.154:3300/0 conn(0x7f33f409bc70 msgr2=0x7f33f409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33f3fff700 1 --2- 172.21.15.154:0/3493200875 >> v2:172.21.15.154:3300/0 conn(0x7f33f409bc70 0x7f33f409c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.105+0000 7f33f3fff700 1 -- 172.21.15.154:0/3493200875 >> v1:172.21.15.154:6789/0 conn(0x7f33f409c5c0 legacy=0x7f33f4138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.106+0000 7f33f2ffd700 1 -- 172.21.15.154:0/3493200875 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083263081 0 0) 0x7f33f40a1640 con 0x7f33f409c5c0 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.106+0000 7f33f3fff700 1 -- 172.21.15.154:0/3493200875 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f4131550 con 0x7f33f4131980 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.106+0000 7f33f37fe700 1 --2- 172.21.15.154:0/3493200875 >> v2:172.21.15.154:3300/0 conn(0x7f33f409bc70 0x7f33f409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.106+0000 7f33f3fff700 1 --2- 172.21.15.154:0/3493200875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f4131d50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009820 tx=0x7f33e4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f83aefa5e9d22aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.106+0000 7f33f2ffd700 1 -- 172.21.15.154:0/3493200875 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4005e30 con 0x7f33f4131980 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.106+0000 7f33f2ffd700 1 -- 172.21.15.154:0/3493200875 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4006030 con 0x7f33f4131980 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.106+0000 7f33f2ffd700 1 -- 172.21.15.154:0/3493200875 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40063c0 con 0x7f33f4131980 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.107+0000 7f33fa807700 1 -- 172.21.15.154:0/3493200875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 msgr2=0x7f33f4131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.107+0000 7f33fa807700 1 --2- 172.21.15.154:0/3493200875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f4131d50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009820 tx=0x7f33e4009b30 comp rx=0 tx=0).stop 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.107+0000 7f33fa807700 1 -- 172.21.15.154:0/3493200875 shutdown_connections 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.107+0000 7f33fa807700 1 --2- 172.21.15.154:0/3493200875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f4131d50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.107+0000 7f33fa807700 1 --2- 172.21.15.154:0/3493200875 >> v2:172.21.15.154:3300/0 conn(0x7f33f409bc70 0x7f33f409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.107+0000 7f33fa807700 1 -- 172.21.15.154:0/3493200875 >> 172.21.15.154:0/3493200875 conn(0x7f33f40a2980 msgr2=0x7f33f40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.107+0000 7f33fa807700 1 -- 172.21.15.154:0/3493200875 shutdown_connections 2023-09-30T22:25:16.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.107+0000 7f33fa807700 1 -- 172.21.15.154:0/3493200875 wait complete. 2023-09-30T22:25:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.108+0000 7f33fa807700 1 Processor -- start 2023-09-30T22:25:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.108+0000 7f33fa807700 1 -- start start 2023-09-30T22:25:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.108+0000 7f33fa807700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f409bc70 0x7f33f41c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.108+0000 7f33fa807700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33f409c5c0 0x7f33f41c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.108+0000 7f33fa807700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f41c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.108+0000 7f33fa807700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f411de30 con 0x7f33f409bc70 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.108+0000 7f33fa807700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f411e240 con 0x7f33f4131980 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.108+0000 7f33fa807700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f411ea30 con 0x7f33f409c5c0 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33f409c5c0 0x7f33f41c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f8da4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f41c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33f409c5c0 0x7f33f41c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50876/0 (socket says 172.21.15.154:50876) 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f8da4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f41c27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51494/0 (socket says 172.21.15.154:51494) 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f37fe700 1 -- 172.21.15.154:0/2914370974 learned_addr learned my addr 172.21.15.154:0/2914370974 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f3fff700 1 --2- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f409bc70 0x7f33f41c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f37fe700 1 -- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 msgr2=0x7f33f41c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f37fe700 1 --2- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f41c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f37fe700 1 -- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f409bc70 msgr2=0x7f33f41c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f37fe700 1 --2- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f409bc70 0x7f33f41c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f37fe700 1 -- 172.21.15.154:0/2914370974 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e8009550 con 0x7f33f409c5c0 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f8da4700 1 --2- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f41c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f37fe700 1 --2- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33f409c5c0 0x7f33f41c68c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f33e800e990 tx=0x7f33e800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f0ff9700 1 -- 172.21.15.154:0/2914370974 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800c690 con 0x7f33f409c5c0 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f0ff9700 1 -- 172.21.15.154:0/2914370974 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800c7f0 con 0x7f33f409c5c0 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33f0ff9700 1 -- 172.21.15.154:0/2914370974 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800cba0 con 0x7f33f409c5c0 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33fa807700 1 -- 172.21.15.154:0/2914370974 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e4009430 con 0x7f33f409c5c0 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.109+0000 7f33fa807700 1 -- 172.21.15.154:0/2914370974 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f411c790 con 0x7f33f409c5c0 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.110+0000 7f33f0ff9700 1 -- 172.21.15.154:0/2914370974 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33e800cd00 con 0x7f33f409c5c0 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.110+0000 7f33f0ff9700 1 -- 172.21.15.154:0/2914370974 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f33e803f6d0 con 0x7f33f409c5c0 2023-09-30T22:25:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.111+0000 7f33fa807700 1 -- 172.21.15.154:0/2914370974 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f411d240 con 0x7f33f409c5c0 2023-09-30T22:25:16.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.115+0000 7f33f0ff9700 1 -- 172.21.15.154:0/2914370974 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33e8021080 con 0x7f33f409c5c0 2023-09-30T22:25:16.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.150+0000 7fe54b1ca700 1 Processor -- start 2023-09-30T22:25:16.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.150+0000 7fe54b1ca700 1 -- start start 2023-09-30T22:25:16.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.150+0000 7fe54b1ca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe544136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.150+0000 7fe54b1ca700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe544137140 0x7fe544139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.150+0000 7fe54b1ca700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54409da80 con 0x7fe54406a770 2023-09-30T22:25:16.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.150+0000 7fe54b1ca700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54409dce0 con 0x7fe544137140 2023-09-30T22:25:16.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.150+0000 7fe54b1ca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54406b620 con 0x7fe54406b250 2023-09-30T22:25:16.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe543fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe544136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe543fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe544136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51502/0 (socket says 172.21.15.154:51502) 2023-09-30T22:25:16.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe543fff700 1 -- 172.21.15.154:0/4114242447 learned_addr learned my addr 172.21.15.154:0/4114242447 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:16.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe549767700 1 --2- 172.21.15.154:0/4114242447 >> v2:172.21.15.154:3300/0 conn(0x7fe544137140 0x7fe544139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe543fff700 1 -- 172.21.15.154:0/4114242447 >> v2:172.21.15.154:3300/0 conn(0x7fe544137140 msgr2=0x7fe544139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe543fff700 1 --2- 172.21.15.154:0/4114242447 >> v2:172.21.15.154:3300/0 conn(0x7fe544137140 0x7fe544139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe543fff700 1 -- 172.21.15.154:0/4114242447 >> v1:172.21.15.154:6789/0 conn(0x7fe54406a770 legacy=0x7fe54406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe543fff700 1 -- 172.21.15.154:0/4114242447 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54409eb20 con 0x7fe54406b250 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe543fff700 1 --2- 172.21.15.154:0/4114242447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe544136c00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe5300098f0 tx=0x7fe530009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7acbc84dc6904fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe5437fe700 1 -- 172.21.15.154:0/4114242447 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530011830 con 0x7fe54406b250 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe5437fe700 1 -- 172.21.15.154:0/4114242447 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe530011990 con 0x7fe54406b250 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.151+0000 7fe5437fe700 1 -- 172.21.15.154:0/4114242447 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530011d20 con 0x7fe54406b250 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.152+0000 7fe54b1ca700 1 -- 172.21.15.154:0/4114242447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 msgr2=0x7fe544136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.152+0000 7fe54b1ca700 1 --2- 172.21.15.154:0/4114242447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe544136c00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe5300098f0 tx=0x7fe530009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.152+0000 7fe54b1ca700 1 -- 172.21.15.154:0/4114242447 shutdown_connections 2023-09-30T22:25:16.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.152+0000 7fe54b1ca700 1 --2- 172.21.15.154:0/4114242447 >> v2:172.21.15.154:3300/0 conn(0x7fe544137140 0x7fe544139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.152+0000 7fe54b1ca700 1 --2- 172.21.15.154:0/4114242447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe544136c00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.152+0000 7fe54b1ca700 1 -- 172.21.15.154:0/4114242447 >> 172.21.15.154:0/4114242447 conn(0x7fe544099c40 msgr2=0x7fe5440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.152+0000 7fe54b1ca700 1 -- 172.21.15.154:0/4114242447 shutdown_connections 2023-09-30T22:25:16.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.152+0000 7fe54b1ca700 1 -- 172.21.15.154:0/4114242447 wait complete. 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.153+0000 7fe54b1ca700 1 Processor -- start 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.153+0000 7fe54b1ca700 1 -- start start 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe54b1ca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54406a770 0x7fe54411e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe54b1ca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe54411eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe54b1ca700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe544137140 0x7fe54411f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe54b1ca700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440a2fb0 con 0x7fe54406a770 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe54b1ca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe544121ac0 con 0x7fe54406b250 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe54b1ca700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe544120260 con 0x7fe544137140 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe548f66700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54406a770 0x7fe54411e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe549767700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe544137140 0x7fe54411f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe548f66700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54406a770 0x7fe54411e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43506/0 (socket says 172.21.15.154:43506) 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe548f66700 1 -- 172.21.15.154:0/1570874900 learned_addr learned my addr 172.21.15.154:0/1570874900 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe543fff700 1 --2- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe54411eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe549767700 1 -- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 msgr2=0x7fe54411eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe549767700 1 --2- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe54411eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe549767700 1 -- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54406a770 msgr2=0x7fe54411e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe549767700 1 --2- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54406a770 0x7fe54411e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe549767700 1 -- 172.21.15.154:0/1570874900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009550 con 0x7fe544137140 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe548f66700 1 --2- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54406a770 0x7fe54411e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe549767700 1 --2- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe544137140 0x7fe54411f080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00efc0 tx=0x7fe53c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe5417fa700 1 -- 172.21.15.154:0/1570874900 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00cc90 con 0x7fe544137140 2023-09-30T22:25:16.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe5417fa700 1 -- 172.21.15.154:0/1570874900 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c00f040 con 0x7fe544137140 2023-09-30T22:25:16.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe54b1ca700 1 -- 172.21.15.154:0/1570874900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe544071e70 con 0x7fe544137140 2023-09-30T22:25:16.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.154+0000 7fe5417fa700 1 -- 172.21.15.154:0/1570874900 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c009e60 con 0x7fe544137140 2023-09-30T22:25:16.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.155+0000 7fe54b1ca700 1 -- 172.21.15.154:0/1570874900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5441227f0 con 0x7fe544137140 2023-09-30T22:25:16.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.155+0000 7fe5417fa700 1 -- 172.21.15.154:0/1570874900 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe53c014480 con 0x7fe544137140 2023-09-30T22:25:16.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.155+0000 7fe54b1ca700 1 -- 172.21.15.154:0/1570874900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe544132590 con 0x7fe544137140 2023-09-30T22:25:16.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.156+0000 7fe5417fa700 1 -- 172.21.15.154:0/1570874900 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe53c03fe00 con 0x7fe544137140 2023-09-30T22:25:16.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.160+0000 7fe5417fa700 1 -- 172.21.15.154:0/1570874900 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe53c0118b0 con 0x7fe544137140 2023-09-30T22:25:16.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:16.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.227+0000 7fbb90e71700 1 Processor -- start 2023-09-30T22:25:16.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.227+0000 7fbb90e71700 1 -- start start 2023-09-30T22:25:16.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb90e71700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb90e71700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb8c0a1460 0x7fbb8c13b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb90e71700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c133640 con 0x7fbb8c0a08e0 2023-09-30T22:25:16.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb90e71700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c0a1d50 con 0x7fbb8c0a1460 2023-09-30T22:25:16.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb90e71700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c09b620 con 0x7fbb8c133a70 2023-09-30T22:25:16.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51512/0 (socket says 172.21.15.154:51512) 2023-09-30T22:25:16.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8a59c700 1 -- 172.21.15.154:0/958253377 learned_addr learned my addr 172.21.15.154:0/958253377 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:16.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8ad9d700 1 --2- 172.21.15.154:0/958253377 >> v2:172.21.15.154:3300/0 conn(0x7fbb8c0a1460 0x7fbb8c13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8ad9d700 1 -- 172.21.15.154:0/958253377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 msgr2=0x7fbb8c133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8ad9d700 1 --2- 172.21.15.154:0/958253377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8ad9d700 1 -- 172.21.15.154:0/958253377 >> v1:172.21.15.154:6789/0 conn(0x7fbb8c0a08e0 legacy=0x7fbb8c0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8ad9d700 1 -- 172.21.15.154:0/958253377 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c133870 con 0x7fbb8c0a1460 2023-09-30T22:25:16.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8a59c700 1 --2- 172.21.15.154:0/958253377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.228+0000 7fbb8ad9d700 1 --2- 172.21.15.154:0/958253377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 0x7fbb8c13b980 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009d90 tx=0x7fbb8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3d56772cfca143 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.229+0000 7fbb8959a700 1 -- 172.21.15.154:0/958253377 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400e070 con 0x7fbb8c0a1460 2023-09-30T22:25:16.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.229+0000 7fbb8959a700 1 -- 172.21.15.154:0/958253377 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8400bb20 con 0x7fbb8c0a1460 2023-09-30T22:25:16.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.229+0000 7fbb8959a700 1 -- 172.21.15.154:0/958253377 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84012430 con 0x7fbb8c0a1460 2023-09-30T22:25:16.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.229+0000 7fbb90e71700 1 -- 172.21.15.154:0/958253377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 msgr2=0x7fbb8c13b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.230+0000 7fbb90e71700 1 --2- 172.21.15.154:0/958253377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 0x7fbb8c13b980 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009d90 tx=0x7fbb8400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:16.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.230+0000 7fbb90e71700 1 -- 172.21.15.154:0/958253377 shutdown_connections 2023-09-30T22:25:16.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.230+0000 7fbb90e71700 1 --2- 172.21.15.154:0/958253377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 0x7fbb8c13b980 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.230+0000 7fbb90e71700 1 --2- 172.21.15.154:0/958253377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.230+0000 7fbb90e71700 1 -- 172.21.15.154:0/958253377 >> 172.21.15.154:0/958253377 conn(0x7fbb8c0a2980 msgr2=0x7fbb8c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.230+0000 7fbb90e71700 1 -- 172.21.15.154:0/958253377 shutdown_connections 2023-09-30T22:25:16.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.230+0000 7fbb90e71700 1 -- 172.21.15.154:0/958253377 wait complete. 2023-09-30T22:25:16.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.231+0000 7fbb90e71700 1 Processor -- start 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.231+0000 7fbb90e71700 1 -- start start 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.231+0000 7fbb90e71700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb8c0a08e0 0x7fbb8c1197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.231+0000 7fbb90e71700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 0x7fbb8c119d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.231+0000 7fbb90e71700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c11a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.231+0000 7fbb90e71700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c11b390 con 0x7fbb8c0a1460 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.231+0000 7fbb90e71700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c09a350 con 0x7fbb8c133a70 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.231+0000 7fbb90e71700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c11c5e0 con 0x7fbb8c0a08e0 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.231+0000 7fbb8ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c11a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c11a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51526/0 (socket says 172.21.15.154:51526) 2023-09-30T22:25:16.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8ad9d700 1 -- 172.21.15.154:0/2397687873 learned_addr learned my addr 172.21.15.154:0/2397687873 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8a59c700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb8c0a08e0 0x7fbb8c1197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb89d9b700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 0x7fbb8c119d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8ad9d700 1 -- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb8c0a08e0 msgr2=0x7fbb8c1197c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8ad9d700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb8c0a08e0 0x7fbb8c1197c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8ad9d700 1 -- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 msgr2=0x7fbb8c119d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8ad9d700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 0x7fbb8c119d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8ad9d700 1 -- 172.21.15.154:0/2397687873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c009500 con 0x7fbb8c133a70 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8a59c700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb8c0a08e0 0x7fbb8c1197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb89d9b700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 0x7fbb8c119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:16.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb8ad9d700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c11a240 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbb84014040 tx=0x7fbb84004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb7affd700 1 -- 172.21.15.154:0/2397687873 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84012430 con 0x7fbb8c133a70 2023-09-30T22:25:16.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb7affd700 1 -- 172.21.15.154:0/2397687873 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84020070 con 0x7fbb8c133a70 2023-09-30T22:25:16.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb7affd700 1 -- 172.21.15.154:0/2397687873 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84003ea0 con 0x7fbb8c133a70 2023-09-30T22:25:16.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.232+0000 7fbb90e71700 1 -- 172.21.15.154:0/2397687873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb84009a70 con 0x7fbb8c133a70 2023-09-30T22:25:16.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.233+0000 7fbb90e71700 1 -- 172.21.15.154:0/2397687873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c131f60 con 0x7fbb8c133a70 2023-09-30T22:25:16.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.234+0000 7fbb7affd700 1 -- 172.21.15.154:0/2397687873 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb84004280 con 0x7fbb8c133a70 2023-09-30T22:25:16.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.234+0000 7fbb90e71700 1 -- 172.21.15.154:0/2397687873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c04f2a0 con 0x7fbb8c133a70 2023-09-30T22:25:16.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.234+0000 7fbb7affd700 1 -- 172.21.15.154:0/2397687873 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb84022070 con 0x7fbb8c133a70 2023-09-30T22:25:16.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.242+0000 7fbb7affd700 1 -- 172.21.15.154:0/2397687873 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb84004530 con 0x7fbb8c133a70 2023-09-30T22:25:16.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.314+0000 7fee3deb7700 1 Processor -- start 2023-09-30T22:25:16.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.315+0000 7fee3deb7700 1 -- start start 2023-09-30T22:25:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.315+0000 7fee3deb7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee380a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.315+0000 7fee3deb7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee38134120 0x7fee3813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.315+0000 7fee3deb7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3809dc00 con 0x7fee380a1380 2023-09-30T22:25:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.315+0000 7fee3deb7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3809ea90 con 0x7fee380a0a70 2023-09-30T22:25:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.315+0000 7fee3deb7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee3809dec0 con 0x7fee38134120 2023-09-30T22:25:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.315+0000 7fee37fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee38134120 0x7fee3813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.315+0000 7fee37fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee38134120 0x7fee3813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50894/0 (socket says 172.21.15.154:50894) 2023-09-30T22:25:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.315+0000 7fee37fff700 1 -- 172.21.15.154:0/1399821617 learned_addr learned my addr 172.21.15.154:0/1399821617 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee367fc700 1 -- 172.21.15.154:0/1399821617 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515195976 0 0) 0x7fee3809dc00 con 0x7fee380a1380 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee367fc700 1 -- 172.21.15.154:0/1399821617 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee200035b0 con 0x7fee380a1380 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee377fe700 1 --2- 172.21.15.154:0/1399821617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee380a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee37fff700 1 -- 172.21.15.154:0/1399821617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 msgr2=0x7fee380a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee37fff700 1 --2- 172.21.15.154:0/1399821617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee380a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee37fff700 1 -- 172.21.15.154:0/1399821617 >> v1:172.21.15.154:6789/0 conn(0x7fee380a1380 legacy=0x7fee38133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee367fc700 1 -- 172.21.15.154:0/1399821617 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2630980354 0 0) 0x7fee200035b0 con 0x7fee380a1380 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee37fff700 1 -- 172.21.15.154:0/1399821617 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3809e6a0 con 0x7fee38134120 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee377fe700 1 --2- 172.21.15.154:0/1399821617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee380a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:16.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee37fff700 1 --2- 172.21.15.154:0/1399821617 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee38134120 0x7fee3813bce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fee30009e80 tx=0x7fee3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ddba2a0a5e0264 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee367fc700 1 -- 172.21.15.154:0/1399821617 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000e070 con 0x7fee38134120 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee367fc700 1 -- 172.21.15.154:0/1399821617 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee30003a20 con 0x7fee38134120 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.316+0000 7fee367fc700 1 -- 172.21.15.154:0/1399821617 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c001670 con 0x7fee38134120 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.317+0000 7fee3deb7700 1 -- 172.21.15.154:0/1399821617 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee38134120 msgr2=0x7fee3813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.317+0000 7fee3deb7700 1 --2- 172.21.15.154:0/1399821617 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee38134120 0x7fee3813bce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fee30009e80 tx=0x7fee3000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.317+0000 7fee3deb7700 1 -- 172.21.15.154:0/1399821617 shutdown_connections 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.317+0000 7fee3deb7700 1 --2- 172.21.15.154:0/1399821617 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee38134120 0x7fee3813bce0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.317+0000 7fee3deb7700 1 --2- 172.21.15.154:0/1399821617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee380a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.317+0000 7fee3deb7700 1 -- 172.21.15.154:0/1399821617 >> 172.21.15.154:0/1399821617 conn(0x7fee380a6610 msgr2=0x7fee380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.317+0000 7fee3deb7700 1 -- 172.21.15.154:0/1399821617 shutdown_connections 2023-09-30T22:25:16.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.317+0000 7fee3deb7700 1 -- 172.21.15.154:0/1399821617 wait complete. 2023-09-30T22:25:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.318+0000 7fee3deb7700 1 Processor -- start 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.318+0000 7fee3deb7700 1 -- start start 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee3deb7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee38122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee3deb7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee380a1380 0x7fee38122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee3deb7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38134120 0x7fee381230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee3deb7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee38125bc0 con 0x7fee38134120 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee3deb7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee38125f60 con 0x7fee380a0a70 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee3deb7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee381242f0 con 0x7fee380a1380 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee36ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee380a1380 0x7fee38122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee377fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee38122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee36ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee380a1380 0x7fee38122b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50900/0 (socket says 172.21.15.154:50900) 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee36ffd700 1 -- 172.21.15.154:0/1373573819 learned_addr learned my addr 172.21.15.154:0/1373573819 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee37fff700 1 --2- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38134120 0x7fee381230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee377fe700 1 -- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee380a1380 msgr2=0x7fee38122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee377fe700 1 --2- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee380a1380 0x7fee38122b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee377fe700 1 -- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38134120 msgr2=0x7fee381230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee377fe700 1 --2- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38134120 0x7fee381230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee377fe700 1 -- 172.21.15.154:0/1373573819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee30009b30 con 0x7fee380a0a70 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.319+0000 7fee377fe700 1 --2- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee38122640 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fee2800c820 tx=0x7fee2800cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.320+0000 7fee1ffff700 1 -- 172.21.15.154:0/1373573819 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28011800 con 0x7fee380a0a70 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.320+0000 7fee1ffff700 1 -- 172.21.15.154:0/1373573819 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28011960 con 0x7fee380a0a70 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.320+0000 7fee1ffff700 1 -- 172.21.15.154:0/1373573819 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28011cf0 con 0x7fee380a0a70 2023-09-30T22:25:16.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.320+0000 7fee3deb7700 1 -- 172.21.15.154:0/1373573819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee38126160 con 0x7fee380a0a70 2023-09-30T22:25:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.320+0000 7fee3deb7700 1 -- 172.21.15.154:0/1373573819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee381339e0 con 0x7fee380a0a70 2023-09-30T22:25:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.321+0000 7fee1ffff700 1 -- 172.21.15.154:0/1373573819 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee28018360 con 0x7fee380a0a70 2023-09-30T22:25:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.321+0000 7fee3deb7700 1 -- 172.21.15.154:0/1373573819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3804f2a0 con 0x7fee380a0a70 2023-09-30T22:25:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.321+0000 7fee1ffff700 1 -- 172.21.15.154:0/1373573819 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee2803f5b0 con 0x7fee380a0a70 2023-09-30T22:25:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.324+0000 7f33fa807700 1 -- 172.21.15.154:0/2914370974 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33f404f2a0 con 0x7f33f409c5c0 2023-09-30T22:25:16.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.324+0000 7f33f0ff9700 1 -- 172.21.15.154:0/2914370974 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33e80232f0 con 0x7f33f409c5c0 2023-09-30T22:25:16.326 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.326+0000 7fee1ffff700 1 -- 172.21.15.154:0/1373573819 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee28018610 con 0x7fee380a0a70 2023-09-30T22:25:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.326+0000 7f33fa807700 1 -- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33f409c5c0 msgr2=0x7f33f41c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.326+0000 7f33fa807700 1 --2- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33f409c5c0 0x7f33f41c68c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f33e800e990 tx=0x7f33e800eca0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.328+0000 7f33fa807700 1 -- 172.21.15.154:0/2914370974 shutdown_connections 2023-09-30T22:25:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.328+0000 7f33fa807700 1 --2- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f4131980 0x7f33f41c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.328+0000 7f33fa807700 1 --2- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f409bc70 0x7f33f41c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.328+0000 7f33fa807700 1 --2- 172.21.15.154:0/2914370974 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33f409c5c0 0x7f33f41c68c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.328+0000 7f33fa807700 1 -- 172.21.15.154:0/2914370974 >> 172.21.15.154:0/2914370974 conn(0x7f33f40a2980 msgr2=0x7f33f406f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.331+0000 7f33fa807700 1 -- 172.21.15.154:0/2914370974 shutdown_connections 2023-09-30T22:25:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.331+0000 7f33fa807700 1 -- 172.21.15.154:0/2914370974 wait complete. 2023-09-30T22:25:16.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:16.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.359+0000 7fe54b1ca700 1 -- 172.21.15.154:0/1570874900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe54404f2a0 con 0x7fe544137140 2023-09-30T22:25:16.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.360+0000 7fe5417fa700 1 -- 172.21.15.154:0/1570874900 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe53c041070 con 0x7fe544137140 2023-09-30T22:25:16.361 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.362+0000 7fe54b1ca700 1 -- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe544137140 msgr2=0x7fe54411f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.362+0000 7fe54b1ca700 1 --2- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe544137140 0x7fe54411f080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00efc0 tx=0x7fe53c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.362+0000 7fe54b1ca700 1 -- 172.21.15.154:0/1570874900 shutdown_connections 2023-09-30T22:25:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.362+0000 7fe54b1ca700 1 --2- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe544137140 0x7fe54411f080 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.362+0000 7fe54b1ca700 1 --2- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54406a770 0x7fe54411e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.362+0000 7fe54b1ca700 1 --2- 172.21.15.154:0/1570874900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b250 0x7fe54411eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.362+0000 7fe54b1ca700 1 -- 172.21.15.154:0/1570874900 >> 172.21.15.154:0/1570874900 conn(0x7fe544099c40 msgr2=0x7fe5440a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.362+0000 7fe54b1ca700 1 -- 172.21.15.154:0/1570874900 shutdown_connections 2023-09-30T22:25:16.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.362+0000 7fe54b1ca700 1 -- 172.21.15.154:0/1570874900 wait complete. 2023-09-30T22:25:16.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:16.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.484+0000 7fbb90e71700 1 -- 172.21.15.154:0/2397687873 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb8c06bce0 con 0x7fbb8c133a70 2023-09-30T22:25:16.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.484+0000 7fbb7affd700 1 -- 172.21.15.154:0/2397687873 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb8402c030 con 0x7fbb8c133a70 2023-09-30T22:25:16.485 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:16.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.486+0000 7fbb90e71700 1 -- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 msgr2=0x7fbb8c11a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.486+0000 7fbb90e71700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c11a240 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbb84014040 tx=0x7fbb84004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.486+0000 7fbb90e71700 1 -- 172.21.15.154:0/2397687873 shutdown_connections 2023-09-30T22:25:16.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.486+0000 7fbb90e71700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb8c133a70 0x7fbb8c11a240 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.486+0000 7fbb90e71700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbb8c0a08e0 0x7fbb8c1197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.486+0000 7fbb90e71700 1 --2- 172.21.15.154:0/2397687873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb8c0a1460 0x7fbb8c119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.486+0000 7fbb90e71700 1 -- 172.21.15.154:0/2397687873 >> 172.21.15.154:0/2397687873 conn(0x7fbb8c0a2980 msgr2=0x7fbb8c12e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.486+0000 7fbb90e71700 1 -- 172.21.15.154:0/2397687873 shutdown_connections 2023-09-30T22:25:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.486+0000 7fbb90e71700 1 -- 172.21.15.154:0/2397687873 wait complete. 2023-09-30T22:25:16.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:16.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.555+0000 7fee3deb7700 1 -- 172.21.15.154:0/1373573819 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee38072980 con 0x7fee380a0a70 2023-09-30T22:25:16.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.555+0000 7fee1ffff700 1 -- 172.21.15.154:0/1373573819 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee2801f030 con 0x7fee380a0a70 2023-09-30T22:25:16.556 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.557+0000 7fee3deb7700 1 -- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 msgr2=0x7fee38122640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.557+0000 7fee3deb7700 1 --2- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee38122640 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fee2800c820 tx=0x7fee2800cb30 comp rx=0 tx=0).stop 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.558+0000 7fee3deb7700 1 -- 172.21.15.154:0/1373573819 shutdown_connections 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.558+0000 7fee3deb7700 1 --2- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38134120 0x7fee381230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.558+0000 7fee3deb7700 1 --2- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380a0a70 0x7fee38122640 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.558+0000 7fee3deb7700 1 --2- 172.21.15.154:0/1373573819 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee380a1380 0x7fee38122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.558+0000 7fee3deb7700 1 -- 172.21.15.154:0/1373573819 >> 172.21.15.154:0/1373573819 conn(0x7fee380a6610 msgr2=0x7fee3809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.558+0000 7fee3deb7700 1 -- 172.21.15.154:0/1373573819 shutdown_connections 2023-09-30T22:25:16.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:16.558+0000 7fee3deb7700 1 -- 172.21.15.154:0/1373573819 wait complete. 2023-09-30T22:25:16.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:17.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:17.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:17.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.474+0000 7fbdecbca700 1 Processor -- start 2023-09-30T22:25:17.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.474+0000 7fbdecbca700 1 -- start start 2023-09-30T22:25:17.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbdecbca700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbdecbca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde81343a0 0x7fbde80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbdecbca700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde809b110 con 0x7fbde8133f70 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbdecbca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80a3b60 con 0x7fbde81343a0 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbdecbca700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80a2fa0 con 0x7fbde809ad40 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde6d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde81343a0 0x7fbde80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde6d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde81343a0 0x7fbde80a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51558/0 (socket says 172.21.15.154:51558) 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde6d9d700 1 -- 172.21.15.154:0/3881942427 learned_addr learned my addr 172.21.15.154:0/3881942427 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde5d9b700 1 --1- 172.21.15.154:0/3881942427 >> v1:172.21.15.154:6789/0 conn(0x7fbde8133f70 0x7fbde80a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59030/0 (socket says 172.21.15.154:59030) 2023-09-30T22:25:17.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde6d9d700 1 -- 172.21.15.154:0/3881942427 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 msgr2=0x7fbde8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde559a700 1 -- 172.21.15.154:0/3881942427 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474703342 0 0) 0x7fbde809b110 con 0x7fbde8133f70 2023-09-30T22:25:17.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde6d9d700 1 --2- 172.21.15.154:0/3881942427 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde6d9d700 1 -- 172.21.15.154:0/3881942427 >> v1:172.21.15.154:6789/0 conn(0x7fbde8133f70 legacy=0x7fbde80a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde6d9d700 1 -- 172.21.15.154:0/3881942427 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde809a280 con 0x7fbde81343a0 2023-09-30T22:25:17.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.475+0000 7fbde659c700 1 --2- 172.21.15.154:0/3881942427 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:17.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbde6d9d700 1 --2- 172.21.15.154:0/3881942427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde81343a0 0x7fbde80a1180 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e80 tx=0x7fbde000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4dfa6475ad236b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbde559a700 1 -- 172.21.15.154:0/3881942427 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde000e070 con 0x7fbde81343a0 2023-09-30T22:25:17.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbde559a700 1 -- 172.21.15.154:0/3881942427 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde000b910 con 0x7fbde81343a0 2023-09-30T22:25:17.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbde559a700 1 -- 172.21.15.154:0/3881942427 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde000bcc0 con 0x7fbde81343a0 2023-09-30T22:25:17.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbdecbca700 1 -- 172.21.15.154:0/3881942427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde81343a0 msgr2=0x7fbde80a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbdecbca700 1 --2- 172.21.15.154:0/3881942427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde81343a0 0x7fbde80a1180 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e80 tx=0x7fbde000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:17.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbdecbca700 1 -- 172.21.15.154:0/3881942427 shutdown_connections 2023-09-30T22:25:17.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbdecbca700 1 --2- 172.21.15.154:0/3881942427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde81343a0 0x7fbde80a1180 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbdecbca700 1 --2- 172.21.15.154:0/3881942427 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbdecbca700 1 -- 172.21.15.154:0/3881942427 >> 172.21.15.154:0/3881942427 conn(0x7fbde8099c40 msgr2=0x7fbde806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbdecbca700 1 -- 172.21.15.154:0/3881942427 shutdown_connections 2023-09-30T22:25:17.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.476+0000 7fbdecbca700 1 -- 172.21.15.154:0/3881942427 wait complete. 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbdecbca700 1 Processor -- start 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbdecbca700 1 -- start start 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbdecbca700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde81c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbdecbca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde8133f70 0x7fbde81c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbdecbca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde81343a0 0x7fbde81c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbdecbca700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8120790 con 0x7fbde81343a0 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbdecbca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde809c850 con 0x7fbde8133f70 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbdecbca700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbde81224b0 con 0x7fbde809ad40 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbde6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde81343a0 0x7fbde81c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbde659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde81c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbde6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde81343a0 0x7fbde81c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43544/0 (socket says 172.21.15.154:43544) 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbde5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde8133f70 0x7fbde81c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbde6d9d700 1 -- 172.21.15.154:0/587300195 learned_addr learned my addr 172.21.15.154:0/587300195 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbde5d9b700 1 -- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 msgr2=0x7fbde81c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbde5d9b700 1 --2- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde81c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbde5d9b700 1 -- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde81343a0 msgr2=0x7fbde81c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.478+0000 7fbde5d9b700 1 --2- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde81343a0 0x7fbde81c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.479+0000 7fbde5d9b700 1 -- 172.21.15.154:0/587300195 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80094a0 con 0x7fbde8133f70 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.479+0000 7fbde659c700 1 --2- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde81c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.479+0000 7fbde5d9b700 1 --2- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde8133f70 0x7fbde81c86d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbde806bec0 tx=0x7fbddc00c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.479+0000 7fbdd6ffd700 1 -- 172.21.15.154:0/587300195 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc004c80 con 0x7fbde8133f70 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.479+0000 7fbdd6ffd700 1 -- 172.21.15.154:0/587300195 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc004de0 con 0x7fbde8133f70 2023-09-30T22:25:17.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.479+0000 7fbdecbca700 1 -- 172.21.15.154:0/587300195 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde0009b30 con 0x7fbde8133f70 2023-09-30T22:25:17.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.479+0000 7fbdd6ffd700 1 -- 172.21.15.154:0/587300195 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc007310 con 0x7fbde8133f70 2023-09-30T22:25:17.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.479+0000 7fbdecbca700 1 -- 172.21.15.154:0/587300195 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde81221d0 con 0x7fbde8133f70 2023-09-30T22:25:17.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.480+0000 7fbdd6ffd700 1 -- 172.21.15.154:0/587300195 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbddc007470 con 0x7fbde8133f70 2023-09-30T22:25:17.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.480+0000 7fbdd6ffd700 1 -- 172.21.15.154:0/587300195 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbddc03f270 con 0x7fbde8133f70 2023-09-30T22:25:17.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.480+0000 7fbdecbca700 1 -- 172.21.15.154:0/587300195 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde804f2a0 con 0x7fbde8133f70 2023-09-30T22:25:17.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.485+0000 7fbdd6ffd700 1 -- 172.21.15.154:0/587300195 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbddc007720 con 0x7fbde8133f70 2023-09-30T22:25:17.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:17.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.514+0000 7fc870503700 1 Processor -- start 2023-09-30T22:25:17.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.514+0000 7fc870503700 1 -- start start 2023-09-30T22:25:17.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc870503700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc868138410 0x7fc8680a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc870503700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc86813dd10 0x7fc8681400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc870503700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8681379e0 con 0x7fc868138040 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc870503700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8680a2100 con 0x7fc868138410 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc870503700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc86809b9b0 con 0x7fc86813dd10 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc86da9e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc868138410 0x7fc8680a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc86da9e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc868138410 0x7fc8680a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43548/0 (socket says 172.21.15.154:43548) 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc86da9e700 1 -- 172.21.15.154:0/177705935 learned_addr learned my addr 172.21.15.154:0/177705935 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc86eaa0700 1 --2- 172.21.15.154:0/177705935 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc86813dd10 0x7fc8681400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc86da9e700 1 -- 172.21.15.154:0/177705935 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc86813dd10 msgr2=0x7fc8681400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc86da9e700 1 --2- 172.21.15.154:0/177705935 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc86813dd10 0x7fc8681400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc86da9e700 1 -- 172.21.15.154:0/177705935 >> v1:172.21.15.154:6789/0 conn(0x7fc868138040 legacy=0x7fc8680a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.515+0000 7fc86da9e700 1 -- 172.21.15.154:0/177705935 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868137c10 con 0x7fc868138410 2023-09-30T22:25:17.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc86da9e700 1 --2- 172.21.15.154:0/177705935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138410 0x7fc8680a0ff0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc8580098f0 tx=0x7fc858009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6ae3f2df8bfd7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc86d29d700 1 -- 172.21.15.154:0/177705935 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858011830 con 0x7fc868138410 2023-09-30T22:25:17.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc86d29d700 1 -- 172.21.15.154:0/177705935 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc858011990 con 0x7fc868138410 2023-09-30T22:25:17.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc86d29d700 1 -- 172.21.15.154:0/177705935 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858011d20 con 0x7fc868138410 2023-09-30T22:25:17.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc870503700 1 -- 172.21.15.154:0/177705935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138410 msgr2=0x7fc8680a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc870503700 1 --2- 172.21.15.154:0/177705935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138410 0x7fc8680a0ff0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc8580098f0 tx=0x7fc858009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc870503700 1 -- 172.21.15.154:0/177705935 shutdown_connections 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc870503700 1 --2- 172.21.15.154:0/177705935 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc86813dd10 0x7fc8681400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc870503700 1 --2- 172.21.15.154:0/177705935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138410 0x7fc8680a0ff0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc870503700 1 -- 172.21.15.154:0/177705935 >> 172.21.15.154:0/177705935 conn(0x7fc8680a2980 msgr2=0x7fc8680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.516+0000 7fc870503700 1 -- 172.21.15.154:0/177705935 shutdown_connections 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.517+0000 7fc870503700 1 -- 172.21.15.154:0/177705935 wait complete. 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.517+0000 7fc870503700 1 Processor -- start 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.517+0000 7fc870503700 1 -- start start 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc870503700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138040 0x7fc86813b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc870503700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc868138410 0x7fc868137090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc870503700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc86813dd10 0x7fc868135730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc870503700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86813cff0 con 0x7fc868138040 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc870503700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86809e8b0 con 0x7fc86813dd10 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc870503700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc86809a240 con 0x7fc868138410 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86e29f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138040 0x7fc86813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86da9e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc868138410 0x7fc868137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86e29f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138040 0x7fc86813b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43560/0 (socket says 172.21.15.154:43560) 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86e29f700 1 -- 172.21.15.154:0/1633019555 learned_addr learned my addr 172.21.15.154:0/1633019555 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86eaa0700 1 --2- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc86813dd10 0x7fc868135730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86e29f700 1 -- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc868138410 msgr2=0x7fc868137090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86e29f700 1 --2- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc868138410 0x7fc868137090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86e29f700 1 -- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc86813dd10 msgr2=0x7fc868135730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86e29f700 1 --2- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc86813dd10 0x7fc868135730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86e29f700 1 -- 172.21.15.154:0/1633019555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858009550 con 0x7fc868138040 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.518+0000 7fc86e29f700 1 --2- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138040 0x7fc86813b630 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc86400c430 tx=0x7fc86400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.519+0000 7fc85effd700 1 -- 172.21.15.154:0/1633019555 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640054e0 con 0x7fc868138040 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.519+0000 7fc85effd700 1 -- 172.21.15.154:0/1633019555 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86400ce40 con 0x7fc868138040 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.519+0000 7fc870503700 1 -- 172.21.15.154:0/1633019555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8681198c0 con 0x7fc868138040 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.519+0000 7fc85effd700 1 -- 172.21.15.154:0/1633019555 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640038c0 con 0x7fc868138040 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.519+0000 7fc870503700 1 -- 172.21.15.154:0/1633019555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86813c340 con 0x7fc868138040 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.519+0000 7fc85effd700 1 -- 172.21.15.154:0/1633019555 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc864003a20 con 0x7fc868138040 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.520+0000 7fc85effd700 1 -- 172.21.15.154:0/1633019555 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc86403e7f0 con 0x7fc868138040 2023-09-30T22:25:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.520+0000 7fc870503700 1 -- 172.21.15.154:0/1633019555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86813c340 con 0x7fc868138040 2023-09-30T22:25:17.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.525+0000 7fc85effd700 1 -- 172.21.15.154:0/1633019555 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc86813c340 con 0x7fc868138040 2023-09-30T22:25:17.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:17.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a24f5700 1 Processor -- start 2023-09-30T22:25:17.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a24f5700 1 -- start start 2023-09-30T22:25:17.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a24f5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa19c09e870 0x7fa19c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a24f5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c131f40 0x7fa19c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a24f5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c09c970 con 0x7fa19c09f180 2023-09-30T22:25:17.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a24f5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c0a0920 con 0x7fa19c09e870 2023-09-30T22:25:17.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a24f5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c09f9c0 con 0x7fa19c131f40 2023-09-30T22:25:17.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a0a92700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c131f40 0x7fa19c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa19bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa19c09e870 0x7fa19c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a0a92700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c131f40 0x7fa19c139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51596/0 (socket says 172.21.15.154:51596) 2023-09-30T22:25:17.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa19bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa19c09e870 0x7fa19c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43568/0 (socket says 172.21.15.154:43568) 2023-09-30T22:25:17.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.626+0000 7fa1a0a92700 1 -- 172.21.15.154:0/2585135187 learned_addr learned my addr 172.21.15.154:0/2585135187 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:17.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.627+0000 7fa1a0a92700 1 -- 172.21.15.154:0/2585135187 >> v2:172.21.15.154:3300/0 conn(0x7fa19c09e870 msgr2=0x7fa19c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.627+0000 7fa1a0a92700 1 --2- 172.21.15.154:0/2585135187 >> v2:172.21.15.154:3300/0 conn(0x7fa19c09e870 0x7fa19c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.627+0000 7fa1a0a92700 1 -- 172.21.15.154:0/2585135187 >> v1:172.21.15.154:6789/0 conn(0x7fa19c09f180 legacy=0x7fa19c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.627+0000 7fa1a0a92700 1 -- 172.21.15.154:0/2585135187 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c09bab0 con 0x7fa19c131f40 2023-09-30T22:25:17.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.627+0000 7fa1a0a92700 1 --2- 172.21.15.154:0/2585135187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c131f40 0x7fa19c139ca0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa194009e50 tx=0x7fa19400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f0ee6da5a714ea4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.627+0000 7fa19affd700 1 -- 172.21.15.154:0/2585135187 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400e070 con 0x7fa19c131f40 2023-09-30T22:25:17.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.627+0000 7fa19affd700 1 -- 172.21.15.154:0/2585135187 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa194003a20 con 0x7fa19c131f40 2023-09-30T22:25:17.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.627+0000 7fa19affd700 1 -- 172.21.15.154:0/2585135187 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194003dd0 con 0x7fa19c131f40 2023-09-30T22:25:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.628+0000 7fa1a24f5700 1 -- 172.21.15.154:0/2585135187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c131f40 msgr2=0x7fa19c139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.628+0000 7fa1a24f5700 1 --2- 172.21.15.154:0/2585135187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c131f40 0x7fa19c139ca0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa194009e50 tx=0x7fa19400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.628+0000 7fa1a24f5700 1 -- 172.21.15.154:0/2585135187 shutdown_connections 2023-09-30T22:25:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.628+0000 7fa1a24f5700 1 --2- 172.21.15.154:0/2585135187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c131f40 0x7fa19c139ca0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.628+0000 7fa1a24f5700 1 --2- 172.21.15.154:0/2585135187 >> v2:172.21.15.154:3300/0 conn(0x7fa19c09e870 0x7fa19c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.628+0000 7fa1a24f5700 1 -- 172.21.15.154:0/2585135187 >> 172.21.15.154:0/2585135187 conn(0x7fa19c0a4430 msgr2=0x7fa19c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.628+0000 7fa1a24f5700 1 -- 172.21.15.154:0/2585135187 shutdown_connections 2023-09-30T22:25:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.628+0000 7fa1a24f5700 1 -- 172.21.15.154:0/2585135187 wait complete. 2023-09-30T22:25:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.629+0000 7fa1a24f5700 1 Processor -- start 2023-09-30T22:25:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a24f5700 1 -- start start 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a24f5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c09e870 0x7fa19c120220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a24f5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19c09f180 0x7fa19c120760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a24f5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c131f40 0x7fa19c120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a24f5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c123d40 con 0x7fa19c131f40 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a24f5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c122cc0 con 0x7fa19c09e870 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a24f5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c1237a0 con 0x7fa19c09f180 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa19b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19c09f180 0x7fa19c120760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a0a92700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c131f40 0x7fa19c120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a0a92700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c131f40 0x7fa19c120ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43572/0 (socket says 172.21.15.154:43572) 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa1a0a92700 1 -- 172.21.15.154:0/467052022 learned_addr learned my addr 172.21.15.154:0/467052022 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.630+0000 7fa19b7fe700 1 --2- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19c09f180 0x7fa19c120760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50954/0 (socket says 172.21.15.154:50954) 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa19bfff700 1 --2- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c09e870 0x7fa19c120220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa19b7fe700 1 -- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c09e870 msgr2=0x7fa19c120220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa19b7fe700 1 --2- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c09e870 0x7fa19c120220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa19b7fe700 1 -- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c131f40 msgr2=0x7fa19c120ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa19b7fe700 1 --2- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c131f40 0x7fa19c120ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa19b7fe700 1 -- 172.21.15.154:0/467052022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194009b30 con 0x7fa19c09f180 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa19b7fe700 1 --2- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19c09f180 0x7fa19c120760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa190003f10 tx=0x7fa190004220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa198ff9700 1 -- 172.21.15.154:0/467052022 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa190013070 con 0x7fa19c09f180 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa1a24f5700 1 -- 172.21.15.154:0/467052022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c1315f0 con 0x7fa19c09f180 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa198ff9700 1 -- 172.21.15.154:0/467052022 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19000e2e0 con 0x7fa19c09f180 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa198ff9700 1 -- 172.21.15.154:0/467052022 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19000c670 con 0x7fa19c09f180 2023-09-30T22:25:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.631+0000 7fa1a24f5700 1 -- 172.21.15.154:0/467052022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c0a2fb0 con 0x7fa19c09f180 2023-09-30T22:25:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.632+0000 7fa198ff9700 1 -- 172.21.15.154:0/467052022 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa19000c7d0 con 0x7fa19c09f180 2023-09-30T22:25:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.633+0000 7fa198ff9700 1 -- 172.21.15.154:0/467052022 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa190042f70 con 0x7fa19c09f180 2023-09-30T22:25:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.633+0000 7fa1a24f5700 1 -- 172.21.15.154:0/467052022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c1235f0 con 0x7fa19c09f180 2023-09-30T22:25:17.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.638+0000 7fa198ff9700 1 -- 172.21.15.154:0/467052022 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa19000ca80 con 0x7fa19c09f180 2023-09-30T22:25:17.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.688+0000 7fbdecbca700 1 -- 172.21.15.154:0/587300195 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbde8120d90 con 0x7fbde8133f70 2023-09-30T22:25:17.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.688+0000 7fbdd6ffd700 1 -- 172.21.15.154:0/587300195 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbddc01ce30 con 0x7fbde8133f70 2023-09-30T22:25:17.689 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:17.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.690+0000 7fbdecbca700 1 -- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde8133f70 msgr2=0x7fbde81c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.690+0000 7fbdecbca700 1 --2- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde8133f70 0x7fbde81c86d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbde806bec0 tx=0x7fbddc00c750 comp rx=0 tx=0).stop 2023-09-30T22:25:17.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.690+0000 7fbdecbca700 1 -- 172.21.15.154:0/587300195 shutdown_connections 2023-09-30T22:25:17.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.690+0000 7fbdecbca700 1 --2- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde81343a0 0x7fbde81c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.690+0000 7fbdecbca700 1 --2- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde809ad40 0x7fbde81c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.690+0000 7fbdecbca700 1 --2- 172.21.15.154:0/587300195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde8133f70 0x7fbde81c86d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.690+0000 7fbdecbca700 1 -- 172.21.15.154:0/587300195 >> 172.21.15.154:0/587300195 conn(0x7fbde8099c40 msgr2=0x7fbde81bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.691+0000 7fbdecbca700 1 -- 172.21.15.154:0/587300195 shutdown_connections 2023-09-30T22:25:17.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.691+0000 7fbdecbca700 1 -- 172.21.15.154:0/587300195 wait complete. 2023-09-30T22:25:17.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.699+0000 7fb68cce7700 1 Processor -- start 2023-09-30T22:25:17.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.699+0000 7fb68cce7700 1 -- start start 2023-09-30T22:25:17.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.699+0000 7fb68cce7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688136960 0x7fb688138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.699+0000 7fb68cce7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 0x7fb68813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.699+0000 7fb68cce7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68806b2d0 con 0x7fb688133ad0 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.699+0000 7fb68cce7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6881345b0 con 0x7fb688136960 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.699+0000 7fb68cce7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb688133610 con 0x7fb688139280 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb685d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688136960 0x7fb688138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb686d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 0x7fb68813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb685d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688136960 0x7fb688138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51610/0 (socket says 172.21.15.154:51610) 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb685d9b700 1 -- 172.21.15.154:0/1171583680 learned_addr learned my addr 172.21.15.154:0/1171583680 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb685d9b700 1 -- 172.21.15.154:0/1171583680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 msgr2=0x7fb68813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb685d9b700 1 --2- 172.21.15.154:0/1171583680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 0x7fb68813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb685d9b700 1 -- 172.21.15.154:0/1171583680 >> v1:172.21.15.154:6789/0 conn(0x7fb688133ad0 legacy=0x7fb688133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb685d9b700 1 -- 172.21.15.154:0/1171583680 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68809a500 con 0x7fb688136960 2023-09-30T22:25:17.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb685d9b700 1 --2- 172.21.15.154:0/1171583680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688136960 0x7fb688138d40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009920 tx=0x7fb67c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acfd6f1ab11f6bcb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb68559a700 1 -- 172.21.15.154:0/1171583680 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c011830 con 0x7fb688136960 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb68559a700 1 -- 172.21.15.154:0/1171583680 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c011990 con 0x7fb688136960 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.700+0000 7fb68559a700 1 -- 172.21.15.154:0/1171583680 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c011d20 con 0x7fb688136960 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.701+0000 7fb68cce7700 1 -- 172.21.15.154:0/1171583680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688136960 msgr2=0x7fb688138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.701+0000 7fb68cce7700 1 --2- 172.21.15.154:0/1171583680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688136960 0x7fb688138d40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009920 tx=0x7fb67c009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.701+0000 7fb68cce7700 1 -- 172.21.15.154:0/1171583680 shutdown_connections 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.701+0000 7fb68cce7700 1 --2- 172.21.15.154:0/1171583680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 0x7fb68813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.701+0000 7fb68cce7700 1 --2- 172.21.15.154:0/1171583680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688136960 0x7fb688138d40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.701+0000 7fb68cce7700 1 -- 172.21.15.154:0/1171583680 >> 172.21.15.154:0/1171583680 conn(0x7fb688099c40 msgr2=0x7fb6880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.701+0000 7fb68cce7700 1 -- 172.21.15.154:0/1171583680 shutdown_connections 2023-09-30T22:25:17.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.701+0000 7fb68cce7700 1 -- 172.21.15.154:0/1171583680 wait complete. 2023-09-30T22:25:17.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.702+0000 7fb68cce7700 1 Processor -- start 2023-09-30T22:25:17.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.702+0000 7fb68cce7700 1 -- start start 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68cce7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688133ad0 0x7fb688071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68cce7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb688136960 0x7fb688071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68cce7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 0x7fb6881c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68cce7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68806e900 con 0x7fb688136960 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68cce7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68806f490 con 0x7fb688133ad0 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68cce7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6881316a0 con 0x7fb688139280 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb685d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb688136960 0x7fb688071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688133ad0 0x7fb688071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb685d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb688136960 0x7fb688071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43576/0 (socket says 172.21.15.154:43576) 2023-09-30T22:25:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688133ad0 0x7fb688071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51614/0 (socket says 172.21.15.154:51614) 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb685d9b700 1 -- 172.21.15.154:0/3111251729 learned_addr learned my addr 172.21.15.154:0/3111251729 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb686d9d700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 0x7fb6881c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68659c700 1 -- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 msgr2=0x7fb6881c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68659c700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 0x7fb6881c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68659c700 1 -- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb688136960 msgr2=0x7fb688071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68659c700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb688136960 0x7fb688071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb68659c700 1 -- 172.21.15.154:0/3111251729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c009550 con 0x7fb688133ad0 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb686d9d700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 0x7fb6881c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.703+0000 7fb685d9b700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb688136960 0x7fb688071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.704+0000 7fb68659c700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688133ad0 0x7fb688071850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb678000f60 tx=0x7fb67800c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.704+0000 7fb676ffd700 1 -- 172.21.15.154:0/3111251729 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780052d0 con 0x7fb688133ad0 2023-09-30T22:25:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.704+0000 7fb676ffd700 1 -- 172.21.15.154:0/3111251729 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb678005430 con 0x7fb688133ad0 2023-09-30T22:25:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.704+0000 7fb68cce7700 1 -- 172.21.15.154:0/3111251729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68806f010 con 0x7fb688133ad0 2023-09-30T22:25:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.704+0000 7fb676ffd700 1 -- 172.21.15.154:0/3111251729 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780038c0 con 0x7fb688133ad0 2023-09-30T22:25:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.704+0000 7fb68cce7700 1 -- 172.21.15.154:0/3111251729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6880722d0 con 0x7fb688133ad0 2023-09-30T22:25:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.705+0000 7fb676ffd700 1 -- 172.21.15.154:0/3111251729 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb678003c30 con 0x7fb688133ad0 2023-09-30T22:25:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.705+0000 7fb676ffd700 1 -- 172.21.15.154:0/3111251729 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb67803eb50 con 0x7fb688133ad0 2023-09-30T22:25:17.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.705+0000 7fb68cce7700 1 -- 172.21.15.154:0/3111251729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb688072520 con 0x7fb688133ad0 2023-09-30T22:25:17.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.710+0000 7fb676ffd700 1 -- 172.21.15.154:0/3111251729 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb67801bb10 con 0x7fb688133ad0 2023-09-30T22:25:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.730+0000 7fc870503700 1 -- 172.21.15.154:0/1633019555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc86813da30 con 0x7fc868138040 2023-09-30T22:25:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.731+0000 7fc85effd700 1 -- 172.21.15.154:0/1633019555 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc86813da30 con 0x7fc868138040 2023-09-30T22:25:17.731 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:17.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.733+0000 7fc870503700 1 -- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138040 msgr2=0x7fc86813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.733+0000 7fc870503700 1 --2- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138040 0x7fc86813b630 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc86400c430 tx=0x7fc86400c740 comp rx=0 tx=0).stop 2023-09-30T22:25:17.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.733+0000 7fc870503700 1 -- 172.21.15.154:0/1633019555 shutdown_connections 2023-09-30T22:25:17.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.733+0000 7fc870503700 1 --2- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc86813dd10 0x7fc868135730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.733+0000 7fc870503700 1 --2- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc868138040 0x7fc86813b630 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.733+0000 7fc870503700 1 --2- 172.21.15.154:0/1633019555 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc868138410 0x7fc868137090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.733+0000 7fc870503700 1 -- 172.21.15.154:0/1633019555 >> 172.21.15.154:0/1633019555 conn(0x7fc8680a2980 msgr2=0x7fc86813e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.733+0000 7fc870503700 1 -- 172.21.15.154:0/1633019555 shutdown_connections 2023-09-30T22:25:17.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.733+0000 7fc870503700 1 -- 172.21.15.154:0/1633019555 wait complete. 2023-09-30T22:25:17.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:17.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.835+0000 7fa1a24f5700 1 -- 172.21.15.154:0/467052022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa19c09f5b0 con 0x7fa19c09f180 2023-09-30T22:25:17.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.835+0000 7fa198ff9700 1 -- 172.21.15.154:0/467052022 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa19c09f5b0 con 0x7fa19c09f180 2023-09-30T22:25:17.836 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:17.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.837+0000 7fa1a24f5700 1 -- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19c09f180 msgr2=0x7fa19c120760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.837+0000 7fa1a24f5700 1 --2- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19c09f180 0x7fa19c120760 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa190003f10 tx=0x7fa190004220 comp rx=0 tx=0).stop 2023-09-30T22:25:17.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.837+0000 7fa1a24f5700 1 -- 172.21.15.154:0/467052022 shutdown_connections 2023-09-30T22:25:17.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.837+0000 7fa1a24f5700 1 --2- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c131f40 0x7fa19c120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.837+0000 7fa1a24f5700 1 --2- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa19c09e870 0x7fa19c120220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.837+0000 7fa1a24f5700 1 --2- 172.21.15.154:0/467052022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa19c09f180 0x7fa19c120760 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.837+0000 7fa1a24f5700 1 -- 172.21.15.154:0/467052022 >> 172.21.15.154:0/467052022 conn(0x7fa19c0a4430 msgr2=0x7fa19c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.837+0000 7fa1a24f5700 1 -- 172.21.15.154:0/467052022 shutdown_connections 2023-09-30T22:25:17.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.837+0000 7fa1a24f5700 1 -- 172.21.15.154:0/467052022 wait complete. 2023-09-30T22:25:17.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:17.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.904+0000 7fb68cce7700 1 -- 172.21.15.154:0/3111251729 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb68804f2a0 con 0x7fb688133ad0 2023-09-30T22:25:17.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.905+0000 7fb676ffd700 1 -- 172.21.15.154:0/3111251729 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb678017020 con 0x7fb688133ad0 2023-09-30T22:25:17.906 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.907+0000 7fb68cce7700 1 -- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688133ad0 msgr2=0x7fb688071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.907+0000 7fb68cce7700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688133ad0 0x7fb688071850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb678000f60 tx=0x7fb67800c6e0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.907+0000 7fb68cce7700 1 -- 172.21.15.154:0/3111251729 shutdown_connections 2023-09-30T22:25:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.907+0000 7fb68cce7700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb688139280 0x7fb6881c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.907+0000 7fb68cce7700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb688133ad0 0x7fb688071850 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.907+0000 7fb68cce7700 1 --2- 172.21.15.154:0/3111251729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb688136960 0x7fb688071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.907+0000 7fb68cce7700 1 -- 172.21.15.154:0/3111251729 >> 172.21.15.154:0/3111251729 conn(0x7fb688099c40 msgr2=0x7fb688134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.907+0000 7fb68cce7700 1 -- 172.21.15.154:0/3111251729 shutdown_connections 2023-09-30T22:25:17.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:17.907+0000 7fb68cce7700 1 -- 172.21.15.154:0/3111251729 wait complete. 2023-09-30T22:25:17.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:18.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:18.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:18.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.839+0000 7f0002d82700 1 Processor -- start 2023-09-30T22:25:18.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.839+0000 7f0002d82700 1 -- start start 2023-09-30T22:25:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0002d82700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc0a0a70 0x7efffc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0002d82700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efffc0a1380 0x7efffc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0002d82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc133f50 0x7efffc134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0002d82700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc09e9d0 con 0x7efffc0a1380 2023-09-30T22:25:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0002d82700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc09dc00 con 0x7efffc0a0a70 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0002d82700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efffc09dec0 con 0x7efffc133f50 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0000b1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc0a0a70 0x7efffc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7efffbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efffc0a1380 0x7efffc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0000b1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc0a0a70 0x7efffc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51624/0 (socket says 172.21.15.154:51624) 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0000b1e700 1 -- 172.21.15.154:0/510972302 learned_addr learned my addr 172.21.15.154:0/510972302 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f000131f700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc133f50 0x7efffc134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7efffbfff700 1 -- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc133f50 msgr2=0x7efffc134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7efffbfff700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc133f50 0x7efffc134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7efffbfff700 1 -- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc0a0a70 msgr2=0x7efffc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7efffbfff700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc0a0a70 0x7efffc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7efffbfff700 1 -- 172.21.15.154:0/510972302 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc09e6a0 con 0x7efffc0a1380 2023-09-30T22:25:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f0000b1e700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc0a0a70 0x7efffc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.840+0000 7f000131f700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc133f50 0x7efffc134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7efffbfff700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a1380 0x7efffc133a10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7effe8009840 tx=0x7effe8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971073c416012927 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7efffb7fe700 1 -- 172.21.15.154:0/510972302 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8011830 con 0x7efffc0a1380 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7efffb7fe700 1 -- 172.21.15.154:0/510972302 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe8011990 con 0x7efffc0a1380 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7efffb7fe700 1 -- 172.21.15.154:0/510972302 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8011d20 con 0x7efffc0a1380 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7f0002d82700 1 -- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a1380 msgr2=0x7efffc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7f0002d82700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a1380 0x7efffc133a10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7effe8009840 tx=0x7effe8009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7f0002d82700 1 -- 172.21.15.154:0/510972302 shutdown_connections 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7f0002d82700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc0a0a70 0x7efffc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7f0002d82700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc133f50 0x7efffc134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7f0002d82700 1 --2- 172.21.15.154:0/510972302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a1380 0x7efffc133a10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7f0002d82700 1 -- 172.21.15.154:0/510972302 >> 172.21.15.154:0/510972302 conn(0x7efffc0a6610 msgr2=0x7efffc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7f0002d82700 1 -- 172.21.15.154:0/510972302 shutdown_connections 2023-09-30T22:25:18.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.841+0000 7f0002d82700 1 -- 172.21.15.154:0/510972302 wait complete. 2023-09-30T22:25:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.842+0000 7f0002d82700 1 Processor -- start 2023-09-30T22:25:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.842+0000 7f0002d82700 1 -- start start 2023-09-30T22:25:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0002d82700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a0a70 0x7efffc122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0002d82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc0a1380 0x7efffc122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0002d82700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc133f50 0x7efffc123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0002d82700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc1239f0 con 0x7efffc0a0a70 2023-09-30T22:25:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0002d82700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0a03e0 con 0x7efffc133f50 2023-09-30T22:25:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0002d82700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0a5180 con 0x7efffc0a1380 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0000b1e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a0a70 0x7efffc122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f000131f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc133f50 0x7efffc123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0000b1e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a0a70 0x7efffc122590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43596/0 (socket says 172.21.15.154:43596) 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0000b1e700 1 -- 172.21.15.154:0/2903002519 learned_addr learned my addr 172.21.15.154:0/2903002519 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7efffbfff700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc0a1380 0x7efffc122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0000b1e700 1 -- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc0a1380 msgr2=0x7efffc122ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0000b1e700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc0a1380 0x7efffc122ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0000b1e700 1 -- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc133f50 msgr2=0x7efffc123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0000b1e700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc133f50 0x7efffc123010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f0000b1e700 1 -- 172.21.15.154:0/2903002519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff0009550 con 0x7efffc0a0a70 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7f000131f700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc133f50 0x7efffc123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.843+0000 7efffbfff700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc0a1380 0x7efffc122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.844+0000 7f0000b1e700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a0a70 0x7efffc122590 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7efff000e960 tx=0x7efff000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.844+0000 7efff97fa700 1 -- 172.21.15.154:0/2903002519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0004030 con 0x7efffc0a0a70 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.844+0000 7efff97fa700 1 -- 172.21.15.154:0/2903002519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff0004190 con 0x7efffc0a0a70 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.844+0000 7f0002d82700 1 -- 172.21.15.154:0/2903002519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff4009a70 con 0x7efffc0a0a70 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.844+0000 7efff97fa700 1 -- 172.21.15.154:0/2903002519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0004520 con 0x7efffc0a0a70 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.844+0000 7f0002d82700 1 -- 172.21.15.154:0/2903002519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe80094a0 con 0x7efffc0a0a70 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.845+0000 7f0002d82700 1 -- 172.21.15.154:0/2903002519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc125c30 con 0x7efffc0a0a70 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.845+0000 7efff97fa700 1 -- 172.21.15.154:0/2903002519 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efff00036a0 con 0x7efffc0a0a70 2023-09-30T22:25:18.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.846+0000 7efff97fa700 1 -- 172.21.15.154:0/2903002519 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efff003fab0 con 0x7efffc0a0a70 2023-09-30T22:25:18.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:18.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.850+0000 7efff97fa700 1 -- 172.21.15.154:0/2903002519 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efff0012c00 con 0x7efffc0a0a70 2023-09-30T22:25:18.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.882+0000 7f752b176700 1 Processor -- start 2023-09-30T22:25:18.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.882+0000 7f752b176700 1 -- start start 2023-09-30T22:25:18.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f752b176700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f752406a770 0x7f752406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f752b176700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752409da80 0x7f752406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f752b176700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752406b5c0 con 0x7f7524131740 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f752b176700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752409f6a0 con 0x7f752406a770 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f752b176700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f752409ec00 con 0x7f752409da80 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f7528f12700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f752406a770 0x7f752406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f7528f12700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f752406a770 0x7f752406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43604/0 (socket says 172.21.15.154:43604) 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f7528f12700 1 -- 172.21.15.154:0/741973294 learned_addr learned my addr 172.21.15.154:0/741973294 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f7523fff700 1 --2- 172.21.15.154:0/741973294 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752409da80 0x7f752406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f7528f12700 1 -- 172.21.15.154:0/741973294 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752409da80 msgr2=0x7f752406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:18.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f7528f12700 1 --2- 172.21.15.154:0/741973294 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752409da80 0x7f752406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f7528f12700 1 -- 172.21.15.154:0/741973294 >> v1:172.21.15.154:6789/0 conn(0x7f7524131740 legacy=0x7f7524131b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.883+0000 7f7528f12700 1 -- 172.21.15.154:0/741973294 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752409f230 con 0x7f752406a770 2023-09-30T22:25:18.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.884+0000 7f7528f12700 1 --2- 172.21.15.154:0/741973294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752406a770 0x7f752406ab40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7518006fd0 tx=0x7f7518009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3a022797e0df3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:18.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.884+0000 7f75237fe700 1 -- 172.21.15.154:0/741973294 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518005e30 con 0x7f752406a770 2023-09-30T22:25:18.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.884+0000 7f75237fe700 1 -- 172.21.15.154:0/741973294 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7518004030 con 0x7f752406a770 2023-09-30T22:25:18.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.884+0000 7f75237fe700 1 -- 172.21.15.154:0/741973294 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75180043e0 con 0x7f752406a770 2023-09-30T22:25:18.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.885+0000 7f752b176700 1 -- 172.21.15.154:0/741973294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752406a770 msgr2=0x7f752406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.885+0000 7f752b176700 1 --2- 172.21.15.154:0/741973294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752406a770 0x7f752406ab40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7518006fd0 tx=0x7f7518009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.885+0000 7f752b176700 1 -- 172.21.15.154:0/741973294 shutdown_connections 2023-09-30T22:25:18.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.885+0000 7f752b176700 1 --2- 172.21.15.154:0/741973294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752406a770 0x7f752406ab40 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.885+0000 7f752b176700 1 --2- 172.21.15.154:0/741973294 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752409da80 0x7f752406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.885+0000 7f752b176700 1 -- 172.21.15.154:0/741973294 >> 172.21.15.154:0/741973294 conn(0x7f752409f9f0 msgr2=0x7f752409fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.885+0000 7f752b176700 1 -- 172.21.15.154:0/741973294 shutdown_connections 2023-09-30T22:25:18.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.885+0000 7f752b176700 1 -- 172.21.15.154:0/741973294 wait complete. 2023-09-30T22:25:18.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.886+0000 7f752b176700 1 Processor -- start 2023-09-30T22:25:18.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.886+0000 7f752b176700 1 -- start start 2023-09-30T22:25:18.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f752b176700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752406a770 0x7f752411e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f752b176700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752409da80 0x7f752411e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f752b176700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7524131740 0x7f752411eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f752b176700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75241218b0 con 0x7f7524131740 2023-09-30T22:25:18.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f752b176700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75241313c0 con 0x7f752409da80 2023-09-30T22:25:18.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f752b176700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7524120e30 con 0x7f752406a770 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f7528f12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752406a770 0x7f752411e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f7528f12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752406a770 0x7f752411e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:50996/0 (socket says 172.21.15.154:50996) 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f7528f12700 1 -- 172.21.15.154:0/2876228323 learned_addr learned my addr 172.21.15.154:0/2876228323 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f7523fff700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752409da80 0x7f752411e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f7529713700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7524131740 0x7f752411eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f7528f12700 1 -- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752409da80 msgr2=0x7f752411e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f7528f12700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752409da80 0x7f752411e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f7528f12700 1 -- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7524131740 msgr2=0x7f752411eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.887+0000 7f7528f12700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7524131740 0x7f752411eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.888+0000 7f7528f12700 1 -- 172.21.15.154:0/2876228323 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518009500 con 0x7f752406a770 2023-09-30T22:25:18.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.888+0000 7f7529713700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7524131740 0x7f752411eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:18.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.888+0000 7f7528f12700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752406a770 0x7f752411e070 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7518004000 tx=0x7f7518004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:18.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.888+0000 7f75217fa700 1 -- 172.21.15.154:0/2876228323 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751801c420 con 0x7f752406a770 2023-09-30T22:25:18.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.888+0000 7f75217fa700 1 -- 172.21.15.154:0/2876228323 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751801c580 con 0x7f752406a770 2023-09-30T22:25:18.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.888+0000 7f752b176700 1 -- 172.21.15.154:0/2876228323 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75241201c0 con 0x7f752406a770 2023-09-30T22:25:18.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.888+0000 7f75217fa700 1 -- 172.21.15.154:0/2876228323 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751801c8f0 con 0x7f752406a770 2023-09-30T22:25:18.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.888+0000 7f752b176700 1 -- 172.21.15.154:0/2876228323 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524072230 con 0x7f752406a770 2023-09-30T22:25:18.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.889+0000 7f75217fa700 1 -- 172.21.15.154:0/2876228323 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7518006b70 con 0x7f752406a770 2023-09-30T22:25:18.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.889+0000 7f75217fa700 1 -- 172.21.15.154:0/2876228323 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7518040760 con 0x7f752406a770 2023-09-30T22:25:18.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.889+0000 7f752b176700 1 -- 172.21.15.154:0/2876228323 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752404f2a0 con 0x7f752406a770 2023-09-30T22:25:18.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.893+0000 7f75217fa700 1 -- 172.21.15.154:0/2876228323 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f751802a070 con 0x7f752406a770 2023-09-30T22:25:18.921 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:18.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.979+0000 7ff5e4391700 1 Processor -- start 2023-09-30T22:25:18.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.979+0000 7ff5e4391700 1 -- start start 2023-09-30T22:25:18.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.979+0000 7ff5e4391700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 0x7ff5dc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.979+0000 7ff5e4391700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5dc09f180 0x7ff5dc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.979+0000 7ff5e4391700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc09c970 con 0x7ff5dc131d70 2023-09-30T22:25:18.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.979+0000 7ff5e4391700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0a0920 con 0x7ff5dc09f180 2023-09-30T22:25:18.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.979+0000 7ff5e4391700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc09f9c0 con 0x7ff5dc09e870 2023-09-30T22:25:18.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.979+0000 7ff5e212d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 0x7ff5dc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e212d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 0x7ff5dc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51650/0 (socket says 172.21.15.154:51650) 2023-09-30T22:25:18.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e212d700 1 -- 172.21.15.154:0/3976796439 learned_addr learned my addr 172.21.15.154:0/3976796439 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:18.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e192c700 1 --2- 172.21.15.154:0/3976796439 >> v2:172.21.15.154:3300/0 conn(0x7ff5dc09f180 0x7ff5dc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e212d700 1 -- 172.21.15.154:0/3976796439 >> v2:172.21.15.154:3300/0 conn(0x7ff5dc09f180 msgr2=0x7ff5dc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:18.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e212d700 1 --2- 172.21.15.154:0/3976796439 >> v2:172.21.15.154:3300/0 conn(0x7ff5dc09f180 0x7ff5dc131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e212d700 1 -- 172.21.15.154:0/3976796439 >> v1:172.21.15.154:6789/0 conn(0x7ff5dc131d70 legacy=0x7ff5dc138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e212d700 1 -- 172.21.15.154:0/3976796439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc09bab0 con 0x7ff5dc09e870 2023-09-30T22:25:18.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e212d700 1 --2- 172.21.15.154:0/3976796439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 0x7ff5dc09ec40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80098f0 tx=0x7ff5d8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44944f23b75f57b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:18.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e112b700 1 -- 172.21.15.154:0/3976796439 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800b8a0 con 0x7ff5dc09e870 2023-09-30T22:25:18.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e112b700 1 -- 172.21.15.154:0/3976796439 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d800ba00 con 0x7ff5dc09e870 2023-09-30T22:25:18.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.980+0000 7ff5e112b700 1 -- 172.21.15.154:0/3976796439 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800bd90 con 0x7ff5dc09e870 2023-09-30T22:25:18.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.981+0000 7ff5e4391700 1 -- 172.21.15.154:0/3976796439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 msgr2=0x7ff5dc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.981+0000 7ff5e4391700 1 --2- 172.21.15.154:0/3976796439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 0x7ff5dc09ec40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80098f0 tx=0x7ff5d8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:18.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.981+0000 7ff5e4391700 1 -- 172.21.15.154:0/3976796439 shutdown_connections 2023-09-30T22:25:18.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.981+0000 7ff5e4391700 1 --2- 172.21.15.154:0/3976796439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 0x7ff5dc09ec40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.981+0000 7ff5e4391700 1 --2- 172.21.15.154:0/3976796439 >> v2:172.21.15.154:3300/0 conn(0x7ff5dc09f180 0x7ff5dc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.981+0000 7ff5e4391700 1 -- 172.21.15.154:0/3976796439 >> 172.21.15.154:0/3976796439 conn(0x7ff5dc0a4430 msgr2=0x7ff5dc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.981+0000 7ff5e4391700 1 -- 172.21.15.154:0/3976796439 shutdown_connections 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.981+0000 7ff5e4391700 1 -- 172.21.15.154:0/3976796439 wait complete. 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.982+0000 7ff5e4391700 1 Processor -- start 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.982+0000 7ff5e4391700 1 -- start start 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.982+0000 7ff5e4391700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 0x7ff5dc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.982+0000 7ff5e4391700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5dc09f180 0x7ff5dc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.982+0000 7ff5e4391700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc131d70 0x7ff5dc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.982+0000 7ff5e4391700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc126100 con 0x7ff5dc131d70 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e4391700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc06d4c0 con 0x7ff5dc09e870 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e4391700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc09b160 con 0x7ff5dc09f180 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e192c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5dc09f180 0x7ff5dc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:18.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e192c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5dc09f180 0x7ff5dc06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51010/0 (socket says 172.21.15.154:51010) 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e192c700 1 -- 172.21.15.154:0/2851514338 learned_addr learned my addr 172.21.15.154:0/2851514338 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e192c700 1 -- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 msgr2=0x7ff5dc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e192c700 1 --2- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 0x7ff5dc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e192c700 1 -- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc131d70 msgr2=0x7ff5dc06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e192c700 1 --2- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc131d70 0x7ff5dc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e192c700 1 -- 172.21.15.154:0/2851514338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8009550 con 0x7ff5dc09f180 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5e192c700 1 --2- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5dc09f180 0x7ff5dc06bdf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00e7e0 tx=0x7ff5cc00eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5d2ffd700 1 -- 172.21.15.154:0/2851514338 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc013610 con 0x7ff5dc09f180 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.983+0000 7ff5d2ffd700 1 -- 172.21.15.154:0/2851514338 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc013770 con 0x7ff5dc09f180 2023-09-30T22:25:18.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.984+0000 7ff5e4391700 1 -- 172.21.15.154:0/2851514338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc09dba0 con 0x7ff5dc09f180 2023-09-30T22:25:18.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.984+0000 7ff5e4391700 1 -- 172.21.15.154:0/2851514338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc1249e0 con 0x7ff5dc09f180 2023-09-30T22:25:18.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.984+0000 7ff5d2ffd700 1 -- 172.21.15.154:0/2851514338 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc013ae0 con 0x7ff5dc09f180 2023-09-30T22:25:18.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.984+0000 7ff5d2ffd700 1 -- 172.21.15.154:0/2851514338 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5cc013c40 con 0x7ff5dc09f180 2023-09-30T22:25:18.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.985+0000 7ff5e4391700 1 -- 172.21.15.154:0/2851514338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c40052e0 con 0x7ff5dc09f180 2023-09-30T22:25:18.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.985+0000 7ff5d2ffd700 1 -- 172.21.15.154:0/2851514338 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff5cc03f780 con 0x7ff5dc09f180 2023-09-30T22:25:18.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:18.994+0000 7ff5d2ffd700 1 -- 172.21.15.154:0/2851514338 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5cc0253a0 con 0x7ff5dc09f180 2023-09-30T22:25:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.055+0000 7fab1e114700 1 Processor -- start 2023-09-30T22:25:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.055+0000 7fab1e114700 1 -- start start 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab1e114700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fab180a0a70 0x7fab180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab1e114700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a1380 0x7fab18133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab1e114700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18133f50 0x7fab181343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab1e114700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1809e9d0 con 0x7fab180a0a70 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab1e114700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1809dc00 con 0x7fab180a1380 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab1e114700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab1809dec0 con 0x7fab18133f50 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab177fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fab180a0a70 0x7fab180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab17fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18133f50 0x7fab181343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab177fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fab180a0a70 0x7fab180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43654/0 (socket says 172.21.15.154:43654) 2023-09-30T22:25:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab177fe700 1 -- 172.21.15.154:0/230096431 learned_addr learned my addr 172.21.15.154:0/230096431 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab16ffd700 1 --2- 172.21.15.154:0/230096431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a1380 0x7fab18133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab17fff700 1 -- 172.21.15.154:0/230096431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a1380 msgr2=0x7fab18133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab17fff700 1 --2- 172.21.15.154:0/230096431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a1380 0x7fab18133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab17fff700 1 -- 172.21.15.154:0/230096431 >> v2:172.21.15.154:3300/0 conn(0x7fab180a0a70 msgr2=0x7fab180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab17fff700 1 --2- 172.21.15.154:0/230096431 >> v2:172.21.15.154:3300/0 conn(0x7fab180a0a70 0x7fab180a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.056+0000 7fab17fff700 1 -- 172.21.15.154:0/230096431 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1809e6a0 con 0x7fab18133f50 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.057+0000 7fab177fe700 1 --2- 172.21.15.154:0/230096431 >> v2:172.21.15.154:3300/0 conn(0x7fab180a0a70 0x7fab180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.057+0000 7fab17fff700 1 --2- 172.21.15.154:0/230096431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18133f50 0x7fab181343b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fab10009d90 tx=0x7fab1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=433e7e8cead3c5af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.057+0000 7fab167fc700 1 -- 172.21.15.154:0/230096431 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000e070 con 0x7fab18133f50 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.057+0000 7fab167fc700 1 -- 172.21.15.154:0/230096431 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1000bb20 con 0x7fab18133f50 2023-09-30T22:25:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.057+0000 7fab167fc700 1 -- 172.21.15.154:0/230096431 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10012430 con 0x7fab18133f50 2023-09-30T22:25:19.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.058+0000 7fab1e114700 1 -- 172.21.15.154:0/230096431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18133f50 msgr2=0x7fab181343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.058+0000 7fab1e114700 1 --2- 172.21.15.154:0/230096431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18133f50 0x7fab181343b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fab10009d90 tx=0x7fab1000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.058+0000 7fab1e114700 1 -- 172.21.15.154:0/230096431 shutdown_connections 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.058+0000 7fab1e114700 1 --2- 172.21.15.154:0/230096431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab18133f50 0x7fab181343b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.058+0000 7fab1e114700 1 --2- 172.21.15.154:0/230096431 >> v2:172.21.15.154:3300/0 conn(0x7fab180a0a70 0x7fab180a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.058+0000 7fab1e114700 1 --2- 172.21.15.154:0/230096431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a1380 0x7fab18133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.058+0000 7fab1e114700 1 -- 172.21.15.154:0/230096431 >> 172.21.15.154:0/230096431 conn(0x7fab180a6610 msgr2=0x7fab180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.058+0000 7fab1e114700 1 -- 172.21.15.154:0/230096431 shutdown_connections 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.058+0000 7fab1e114700 1 -- 172.21.15.154:0/230096431 wait complete. 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.059+0000 7fab1e114700 1 Processor -- start 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.059+0000 7fab1e114700 1 -- start start 2023-09-30T22:25:19.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab1e114700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a0a70 0x7fab181224c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab1e114700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab180a1380 0x7fab18122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab1e114700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18133f50 0x7fab18122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab1e114700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab18124250 con 0x7fab18133f50 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab1e114700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab18124f60 con 0x7fab180a0a70 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab1e114700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab18125320 con 0x7fab180a1380 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab17fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18133f50 0x7fab18122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab17fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18133f50 0x7fab18122f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43670/0 (socket says 172.21.15.154:43670) 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab17fff700 1 -- 172.21.15.154:0/2943065337 learned_addr learned my addr 172.21.15.154:0/2943065337 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.060+0000 7fab177fe700 1 --2- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a0a70 0x7fab181224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab17fff700 1 -- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab180a1380 msgr2=0x7fab18122a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab17fff700 1 --2- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab180a1380 0x7fab18122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab17fff700 1 -- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a0a70 msgr2=0x7fab181224c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab17fff700 1 --2- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a0a70 0x7fab181224c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab17fff700 1 -- 172.21.15.154:0/2943065337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab00009550 con 0x7fab18133f50 2023-09-30T22:25:19.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab17fff700 1 --2- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18133f50 0x7fab18122f40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fab1809e000 tx=0x7fab10004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:19.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab0ffff700 1 -- 172.21.15.154:0/2943065337 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10004550 con 0x7fab18133f50 2023-09-30T22:25:19.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab0ffff700 1 -- 172.21.15.154:0/2943065337 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10020070 con 0x7fab18133f50 2023-09-30T22:25:19.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab1e114700 1 -- 172.21.15.154:0/2943065337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab10009a70 con 0x7fab18133f50 2023-09-30T22:25:19.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab0ffff700 1 -- 172.21.15.154:0/2943065337 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10004910 con 0x7fab18133f50 2023-09-30T22:25:19.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.061+0000 7fab1e114700 1 -- 172.21.15.154:0/2943065337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab18125a40 con 0x7fab18133f50 2023-09-30T22:25:19.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.062+0000 7fab1e114700 1 -- 172.21.15.154:0/2943065337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1804f2a0 con 0x7fab18133f50 2023-09-30T22:25:19.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.062+0000 7fab0ffff700 1 -- 172.21.15.154:0/2943065337 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab10012430 con 0x7fab18133f50 2023-09-30T22:25:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.065+0000 7fab0ffff700 1 -- 172.21.15.154:0/2943065337 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab10022070 con 0x7fab18133f50 2023-09-30T22:25:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.065+0000 7f0002d82700 1 -- 172.21.15.154:0/2903002519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efffc125c30 con 0x7efffc0a0a70 2023-09-30T22:25:19.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.068+0000 7efff97fa700 1 -- 172.21.15.154:0/2903002519 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efffc125c30 con 0x7efffc0a0a70 2023-09-30T22:25:19.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.069+0000 7fab0ffff700 1 -- 172.21.15.154:0/2943065337 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab10046060 con 0x7fab18133f50 2023-09-30T22:25:19.070 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.071+0000 7f0002d82700 1 -- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a0a70 msgr2=0x7efffc122590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.071+0000 7f0002d82700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a0a70 0x7efffc122590 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7efff000e960 tx=0x7efff000ec70 comp rx=0 tx=0).stop 2023-09-30T22:25:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.072+0000 7f0002d82700 1 -- 172.21.15.154:0/2903002519 shutdown_connections 2023-09-30T22:25:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.072+0000 7f0002d82700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc133f50 0x7efffc123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.072+0000 7f0002d82700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc0a0a70 0x7efffc122590 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.072+0000 7f0002d82700 1 --2- 172.21.15.154:0/2903002519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc0a1380 0x7efffc122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.072+0000 7f0002d82700 1 -- 172.21.15.154:0/2903002519 >> 172.21.15.154:0/2903002519 conn(0x7efffc0a6610 msgr2=0x7efffc09c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.072+0000 7f0002d82700 1 -- 172.21.15.154:0/2903002519 shutdown_connections 2023-09-30T22:25:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.072+0000 7f0002d82700 1 -- 172.21.15.154:0/2903002519 wait complete. 2023-09-30T22:25:19.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:19.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.123+0000 7f752b176700 1 -- 172.21.15.154:0/2876228323 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7524072d60 con 0x7f752406a770 2023-09-30T22:25:19.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.123+0000 7f75217fa700 1 -- 172.21.15.154:0/2876228323 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7518033090 con 0x7f752406a770 2023-09-30T22:25:19.124 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.125+0000 7f752b176700 1 -- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752406a770 msgr2=0x7f752411e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.125+0000 7f752b176700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752406a770 0x7f752411e070 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7518004000 tx=0x7f7518004750 comp rx=0 tx=0).stop 2023-09-30T22:25:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.126+0000 7f752b176700 1 -- 172.21.15.154:0/2876228323 shutdown_connections 2023-09-30T22:25:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.126+0000 7f752b176700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7524131740 0x7f752411eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.126+0000 7f752b176700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752406a770 0x7f752411e070 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.126+0000 7f752b176700 1 --2- 172.21.15.154:0/2876228323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752409da80 0x7f752411e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.126+0000 7f752b176700 1 -- 172.21.15.154:0/2876228323 >> 172.21.15.154:0/2876228323 conn(0x7f752409f9f0 msgr2=0x7f75241b7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.126+0000 7f752b176700 1 -- 172.21.15.154:0/2876228323 shutdown_connections 2023-09-30T22:25:19.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.126+0000 7f752b176700 1 -- 172.21.15.154:0/2876228323 wait complete. 2023-09-30T22:25:19.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.206+0000 7ff5e4391700 1 -- 172.21.15.154:0/2851514338 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5c4005590 con 0x7ff5dc09f180 2023-09-30T22:25:19.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.206+0000 7ff5d2ffd700 1 -- 172.21.15.154:0/2851514338 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5cc021020 con 0x7ff5dc09f180 2023-09-30T22:25:19.207 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.208+0000 7ff5e4391700 1 -- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5dc09f180 msgr2=0x7ff5dc06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.208+0000 7ff5e4391700 1 --2- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5dc09f180 0x7ff5dc06bdf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00e7e0 tx=0x7ff5cc00eba0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.208+0000 7ff5e4391700 1 -- 172.21.15.154:0/2851514338 shutdown_connections 2023-09-30T22:25:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.208+0000 7ff5e4391700 1 --2- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc131d70 0x7ff5dc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.208+0000 7ff5e4391700 1 --2- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc09e870 0x7ff5dc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.208+0000 7ff5e4391700 1 --2- 172.21.15.154:0/2851514338 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5dc09f180 0x7ff5dc06bdf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.208+0000 7ff5e4391700 1 -- 172.21.15.154:0/2851514338 >> 172.21.15.154:0/2851514338 conn(0x7ff5dc0a4430 msgr2=0x7ff5dc06fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.208+0000 7ff5e4391700 1 -- 172.21.15.154:0/2851514338 shutdown_connections 2023-09-30T22:25:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.208+0000 7ff5e4391700 1 -- 172.21.15.154:0/2851514338 wait complete. 2023-09-30T22:25:19.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.262+0000 7fab1e114700 1 -- 172.21.15.154:0/2943065337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab180a4b40 con 0x7fab18133f50 2023-09-30T22:25:19.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.263+0000 7fab0ffff700 1 -- 172.21.15.154:0/2943065337 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab10046020 con 0x7fab18133f50 2023-09-30T22:25:19.264 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:19.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.265+0000 7fab1e114700 1 -- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18133f50 msgr2=0x7fab18122f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:19.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.265+0000 7fab1e114700 1 --2- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18133f50 0x7fab18122f40 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fab1809e000 tx=0x7fab10004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.265+0000 7fab1e114700 1 -- 172.21.15.154:0/2943065337 shutdown_connections 2023-09-30T22:25:19.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.265+0000 7fab1e114700 1 --2- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab18133f50 0x7fab18122f40 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.265+0000 7fab1e114700 1 --2- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab180a0a70 0x7fab181224c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.265+0000 7fab1e114700 1 --2- 172.21.15.154:0/2943065337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fab180a1380 0x7fab18122a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:19.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.265+0000 7fab1e114700 1 -- 172.21.15.154:0/2943065337 >> 172.21.15.154:0/2943065337 conn(0x7fab180a6610 msgr2=0x7fab1809b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:19.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.265+0000 7fab1e114700 1 -- 172.21.15.154:0/2943065337 shutdown_connections 2023-09-30T22:25:19.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:19.265+0000 7fab1e114700 1 -- 172.21.15.154:0/2943065337 wait complete. 2023-09-30T22:25:19.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:20.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:20.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:20.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:20.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.223+0000 7fc138efe700 1 Processor -- start 2023-09-30T22:25:20.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc138efe700 1 -- start start 2023-09-30T22:25:20.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc138efe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc13406a770 0x7fc13406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc138efe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc13409dec0 0x7fc13406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc138efe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13406b5c0 con 0x7fc134131a00 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc138efe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13406e900 con 0x7fc13409dec0 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc138efe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13409d180 con 0x7fc13406a770 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc13259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc13406a770 0x7fc13406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc131d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc13409dec0 0x7fc13406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc13259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc13406a770 0x7fc13406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51680/0 (socket says 172.21.15.154:51680) 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.224+0000 7fc13259c700 1 -- 172.21.15.154:0/189381169 learned_addr learned my addr 172.21.15.154:0/189381169 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.225+0000 7fc13259c700 1 -- 172.21.15.154:0/189381169 >> v2:172.21.15.154:3300/0 conn(0x7fc13409dec0 msgr2=0x7fc13406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.225+0000 7fc13259c700 1 --2- 172.21.15.154:0/189381169 >> v2:172.21.15.154:3300/0 conn(0x7fc13409dec0 0x7fc13406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.225+0000 7fc13259c700 1 -- 172.21.15.154:0/189381169 >> v1:172.21.15.154:6789/0 conn(0x7fc134131a00 legacy=0x7fc134131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.225+0000 7fc13259c700 1 -- 172.21.15.154:0/189381169 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13409e780 con 0x7fc13406a770 2023-09-30T22:25:20.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.225+0000 7fc13259c700 1 --2- 172.21.15.154:0/189381169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc13406a770 0x7fc13406ab40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc1240098f0 tx=0x7fc124009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=753d4a58c0c4c93b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.225+0000 7fc13159a700 1 -- 172.21.15.154:0/189381169 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124011830 con 0x7fc13406a770 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.225+0000 7fc13159a700 1 -- 172.21.15.154:0/189381169 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc124011990 con 0x7fc13406a770 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.225+0000 7fc13159a700 1 -- 172.21.15.154:0/189381169 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124011d20 con 0x7fc13406a770 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.226+0000 7fc138efe700 1 -- 172.21.15.154:0/189381169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc13406a770 msgr2=0x7fc13406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.226+0000 7fc138efe700 1 --2- 172.21.15.154:0/189381169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc13406a770 0x7fc13406ab40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc1240098f0 tx=0x7fc124009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.226+0000 7fc138efe700 1 -- 172.21.15.154:0/189381169 shutdown_connections 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.226+0000 7fc138efe700 1 --2- 172.21.15.154:0/189381169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc13406a770 0x7fc13406ab40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.226+0000 7fc138efe700 1 --2- 172.21.15.154:0/189381169 >> v2:172.21.15.154:3300/0 conn(0x7fc13409dec0 0x7fc13406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.226+0000 7fc138efe700 1 -- 172.21.15.154:0/189381169 >> 172.21.15.154:0/189381169 conn(0x7fc134099c40 msgr2=0x7fc1340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.226+0000 7fc138efe700 1 -- 172.21.15.154:0/189381169 shutdown_connections 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.226+0000 7fc138efe700 1 -- 172.21.15.154:0/189381169 wait complete. 2023-09-30T22:25:20.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.227+0000 7fc138efe700 1 Processor -- start 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.227+0000 7fc138efe700 1 -- start start 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc138efe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc13406a770 0x7fc13409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc138efe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc13409dec0 0x7fc13409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc138efe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134131a00 0x7fc13409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc138efe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc134121c00 con 0x7fc13406a770 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc138efe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc134120ba0 con 0x7fc134131a00 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc138efe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1341314f0 con 0x7fc13409dec0 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc13259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc13406a770 0x7fc13409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc132d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134131a00 0x7fc13409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc13259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc13406a770 0x7fc13409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43692/0 (socket says 172.21.15.154:43692) 2023-09-30T22:25:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc132d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134131a00 0x7fc13409af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51684/0 (socket says 172.21.15.154:51684) 2023-09-30T22:25:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc13259c700 1 -- 172.21.15.154:0/997101827 learned_addr learned my addr 172.21.15.154:0/997101827 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc131d9b700 1 --2- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc13409dec0 0x7fc13409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc13259c700 1 -- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc13409dec0 msgr2=0x7fc13409a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc13259c700 1 --2- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc13409dec0 0x7fc13409a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc13259c700 1 -- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134131a00 msgr2=0x7fc13409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc13259c700 1 --2- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134131a00 0x7fc13409af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc13259c700 1 -- 172.21.15.154:0/997101827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124009550 con 0x7fc13406a770 2023-09-30T22:25:20.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc132d9d700 1 --2- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134131a00 0x7fc13409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.228+0000 7fc13259c700 1 --2- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc13406a770 0x7fc13409a490 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc124000c00 tx=0x7fc124004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.229+0000 7fc122ffd700 1 -- 172.21.15.154:0/997101827 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124004400 con 0x7fc13406a770 2023-09-30T22:25:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.229+0000 7fc122ffd700 1 -- 172.21.15.154:0/997101827 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12401f070 con 0x7fc13406a770 2023-09-30T22:25:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.229+0000 7fc122ffd700 1 -- 172.21.15.154:0/997101827 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1240038e0 con 0x7fc13406a770 2023-09-30T22:25:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.229+0000 7fc138efe700 1 -- 172.21.15.154:0/997101827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc134071ce0 con 0x7fc13406a770 2023-09-30T22:25:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.229+0000 7fc138efe700 1 -- 172.21.15.154:0/997101827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc134121660 con 0x7fc13406a770 2023-09-30T22:25:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.230+0000 7fc138efe700 1 -- 172.21.15.154:0/997101827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13404f2a0 con 0x7fc13406a770 2023-09-30T22:25:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.230+0000 7fc122ffd700 1 -- 172.21.15.154:0/997101827 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc124021030 con 0x7fc13406a770 2023-09-30T22:25:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.231+0000 7fc122ffd700 1 -- 172.21.15.154:0/997101827 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc124040f00 con 0x7fc13406a770 2023-09-30T22:25:20.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.235+0000 7fc122ffd700 1 -- 172.21.15.154:0/997101827 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1240199a0 con 0x7fc13406a770 2023-09-30T22:25:20.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.269+0000 7fb8128fd700 1 Processor -- start 2023-09-30T22:25:20.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.269+0000 7fb8128fd700 1 -- start start 2023-09-30T22:25:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb8128fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c09ad40 0x7fb80c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb8128fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 0x7fb80c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb8128fd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c09b110 con 0x7fb80c0a0a70 2023-09-30T22:25:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb8128fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0a3b60 con 0x7fb80c133f70 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb8128fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c1348e0 con 0x7fb80c09ad40 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb810e9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb80c0a0a70 0x7fb80c0a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59084/0 (socket says 172.21.15.154:59084) 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 0x7fb80c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb810e9a700 1 -- 172.21.15.154:0/1556203578 learned_addr learned my addr 172.21.15.154:0/1556203578 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80bfff700 1 --2- 172.21.15.154:0/1556203578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c09ad40 0x7fb80c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80b7fe700 1 -- 172.21.15.154:0/1556203578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c09ad40 msgr2=0x7fb80c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80b7fe700 1 --2- 172.21.15.154:0/1556203578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c09ad40 0x7fb80c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80affd700 1 -- 172.21.15.154:0/1556203578 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437638669 0 0) 0x7fb80c09b110 con 0x7fb80c0a0a70 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80b7fe700 1 -- 172.21.15.154:0/1556203578 >> v1:172.21.15.154:6789/0 conn(0x7fb80c0a0a70 legacy=0x7fb80c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80b7fe700 1 -- 172.21.15.154:0/1556203578 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c0a2fa0 con 0x7fb80c133f70 2023-09-30T22:25:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80bfff700 1 --2- 172.21.15.154:0/1556203578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c09ad40 0x7fb80c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:20.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80b7fe700 1 --2- 172.21.15.154:0/1556203578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 0x7fb80c1343a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb800009870 tx=0x7fb800009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5685d1c57d44d9a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80affd700 1 -- 172.21.15.154:0/1556203578 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800011830 con 0x7fb80c133f70 2023-09-30T22:25:20.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80affd700 1 -- 172.21.15.154:0/1556203578 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800011990 con 0x7fb80c133f70 2023-09-30T22:25:20.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.270+0000 7fb80affd700 1 -- 172.21.15.154:0/1556203578 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800011d20 con 0x7fb80c133f70 2023-09-30T22:25:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.271+0000 7fb8128fd700 1 -- 172.21.15.154:0/1556203578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 msgr2=0x7fb80c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.271+0000 7fb8128fd700 1 --2- 172.21.15.154:0/1556203578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 0x7fb80c1343a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb800009870 tx=0x7fb800009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.271+0000 7fb8128fd700 1 -- 172.21.15.154:0/1556203578 shutdown_connections 2023-09-30T22:25:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.271+0000 7fb8128fd700 1 --2- 172.21.15.154:0/1556203578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c09ad40 0x7fb80c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.271+0000 7fb8128fd700 1 --2- 172.21.15.154:0/1556203578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 0x7fb80c1343a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.271+0000 7fb8128fd700 1 -- 172.21.15.154:0/1556203578 >> 172.21.15.154:0/1556203578 conn(0x7fb80c099c40 msgr2=0x7fb80c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.271+0000 7fb8128fd700 1 -- 172.21.15.154:0/1556203578 shutdown_connections 2023-09-30T22:25:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.271+0000 7fb8128fd700 1 -- 172.21.15.154:0/1556203578 wait complete. 2023-09-30T22:25:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.272+0000 7fb8128fd700 1 Processor -- start 2023-09-30T22:25:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.272+0000 7fb8128fd700 1 -- start start 2023-09-30T22:25:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb8128fd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb80c09ad40 0x7fb80c1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb8128fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c0a0a70 0x7fb80c1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb8128fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 0x7fb80c1c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb8128fd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c120be0 con 0x7fb80c09ad40 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb8128fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c09c850 con 0x7fb80c133f70 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb8128fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c120740 con 0x7fb80c0a0a70 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c0a0a70 0x7fb80c1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb80c09ad40 0x7fb80c1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c0a0a70 0x7fb80c1c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51062/0 (socket says 172.21.15.154:51062) 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80b7fe700 1 -- 172.21.15.154:0/858349872 learned_addr learned my addr 172.21.15.154:0/858349872 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb810e9a700 1 --2- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 0x7fb80c1c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80b7fe700 1 -- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 msgr2=0x7fb80c1c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80b7fe700 1 --2- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 0x7fb80c1c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80b7fe700 1 -- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb80c09ad40 msgr2=0x7fb80c1c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80b7fe700 1 --2- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb80c09ad40 0x7fb80c1c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80b7fe700 1 -- 172.21.15.154:0/858349872 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0094a0 con 0x7fb80c0a0a70 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.273+0000 7fb80b7fe700 1 --2- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c0a0a70 0x7fb80c1c86d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb8000090b0 tx=0x7fb800004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.274+0000 7fb808ff9700 1 -- 172.21.15.154:0/858349872 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800004590 con 0x7fb80c0a0a70 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.274+0000 7fb808ff9700 1 -- 172.21.15.154:0/858349872 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8000036a0 con 0x7fb80c0a0a70 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.274+0000 7fb8128fd700 1 -- 172.21.15.154:0/858349872 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8000094a0 con 0x7fb80c0a0a70 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.274+0000 7fb808ff9700 1 -- 172.21.15.154:0/858349872 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800003a30 con 0x7fb80c0a0a70 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.274+0000 7fb8128fd700 1 -- 172.21.15.154:0/858349872 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c1221f0 con 0x7fb80c0a0a70 2023-09-30T22:25:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.275+0000 7fb8128fd700 1 -- 172.21.15.154:0/858349872 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c1223e0 con 0x7fb80c0a0a70 2023-09-30T22:25:20.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.275+0000 7fb808ff9700 1 -- 172.21.15.154:0/858349872 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb800003b90 con 0x7fb80c0a0a70 2023-09-30T22:25:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.275+0000 7fb808ff9700 1 -- 172.21.15.154:0/858349872 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb800040b00 con 0x7fb80c0a0a70 2023-09-30T22:25:20.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.283+0000 7fb808ff9700 1 -- 172.21.15.154:0/858349872 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb80001a420 con 0x7fb80c0a0a70 2023-09-30T22:25:20.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.364+0000 7fa18c60c700 1 Processor -- start 2023-09-30T22:25:20.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.364+0000 7fa18c60c700 1 -- start start 2023-09-30T22:25:20.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.365+0000 7fa18c60c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a0a70 0x7fa1840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.365+0000 7fa18c60c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a1380 0x7fa184133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.365+0000 7fa18c60c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18409dc00 con 0x7fa184133f50 2023-09-30T22:25:20.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.365+0000 7fa18c60c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18409ea60 con 0x7fa1840a1380 2023-09-30T22:25:20.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.365+0000 7fa18c60c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa18409dec0 con 0x7fa1840a0a70 2023-09-30T22:25:20.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa18a3a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a0a70 0x7fa1840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa18aba9700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa184133f50 0x7fa18413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59096/0 (socket says 172.21.15.154:59096) 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa18aba9700 1 -- 172.21.15.154:0/1697744375 learned_addr learned my addr 172.21.15.154:0/1697744375 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa189ba7700 1 --2- 172.21.15.154:0/1697744375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a1380 0x7fa184133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa189ba7700 1 -- 172.21.15.154:0/1697744375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a0a70 msgr2=0x7fa1840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa189ba7700 1 --2- 172.21.15.154:0/1697744375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a0a70 0x7fa1840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa189ba7700 1 -- 172.21.15.154:0/1697744375 >> v1:172.21.15.154:6789/0 conn(0x7fa184133f50 legacy=0x7fa18413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa189ba7700 1 -- 172.21.15.154:0/1697744375 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18409e6a0 con 0x7fa1840a1380 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa18a3a8700 1 --2- 172.21.15.154:0/1697744375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a0a70 0x7fa1840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa189ba7700 1 --2- 172.21.15.154:0/1697744375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a1380 0x7fa184133a10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa174009870 tx=0x7fa174009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f458c1f90cee49c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa1893a6700 1 -- 172.21.15.154:0/1697744375 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174011830 con 0x7fa1840a1380 2023-09-30T22:25:20.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa1893a6700 1 -- 172.21.15.154:0/1697744375 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa174011990 con 0x7fa1840a1380 2023-09-30T22:25:20.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.366+0000 7fa1893a6700 1 -- 172.21.15.154:0/1697744375 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174011d20 con 0x7fa1840a1380 2023-09-30T22:25:20.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.367+0000 7fa18c60c700 1 -- 172.21.15.154:0/1697744375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a1380 msgr2=0x7fa184133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.367+0000 7fa18c60c700 1 --2- 172.21.15.154:0/1697744375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a1380 0x7fa184133a10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa174009870 tx=0x7fa174009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:20.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.367+0000 7fa18c60c700 1 -- 172.21.15.154:0/1697744375 shutdown_connections 2023-09-30T22:25:20.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.367+0000 7fa18c60c700 1 --2- 172.21.15.154:0/1697744375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a0a70 0x7fa1840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.367+0000 7fa18c60c700 1 --2- 172.21.15.154:0/1697744375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a1380 0x7fa184133a10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.367+0000 7fa18c60c700 1 -- 172.21.15.154:0/1697744375 >> 172.21.15.154:0/1697744375 conn(0x7fa1840a6610 msgr2=0x7fa1840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.367+0000 7fa18c60c700 1 -- 172.21.15.154:0/1697744375 shutdown_connections 2023-09-30T22:25:20.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.367+0000 7fa18c60c700 1 -- 172.21.15.154:0/1697744375 wait complete. 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.368+0000 7fa18c60c700 1 Processor -- start 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.368+0000 7fa18c60c700 1 -- start start 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa18c60c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a0a70 0x7fa18411e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa18c60c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a1380 0x7fa18411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa18c60c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa184133f50 0x7fa18411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa18c60c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1841203b0 con 0x7fa184133f50 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa18c60c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa184133130 con 0x7fa1840a0a70 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa18c60c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa184133970 con 0x7fa1840a1380 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa189ba7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a1380 0x7fa18411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa189ba7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a1380 0x7fa18411ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51078/0 (socket says 172.21.15.154:51078) 2023-09-30T22:25:20.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa189ba7700 1 -- 172.21.15.154:0/2550014558 learned_addr learned my addr 172.21.15.154:0/2550014558 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa18a3a8700 1 --2- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a0a70 0x7fa18411e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.369+0000 7fa18aba9700 1 --2- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa184133f50 0x7fa18411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa18a3a8700 1 -- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a1380 msgr2=0x7fa18411ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa18a3a8700 1 --2- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a1380 0x7fa18411ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa18a3a8700 1 -- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa184133f50 msgr2=0x7fa18411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa18a3a8700 1 --2- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa184133f50 0x7fa18411f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa18a3a8700 1 -- 172.21.15.154:0/2550014558 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1800094a0 con 0x7fa1840a0a70 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa18a3a8700 1 --2- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a0a70 0x7fa18411e7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa18000e9b0 tx=0x7fa18000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa17affd700 1 -- 172.21.15.154:0/2550014558 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18000ee50 con 0x7fa1840a0a70 2023-09-30T22:25:20.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa17affd700 1 -- 172.21.15.154:0/2550014558 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18000c850 con 0x7fa1840a0a70 2023-09-30T22:25:20.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa17affd700 1 -- 172.21.15.154:0/2550014558 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18000cc00 con 0x7fa1840a0a70 2023-09-30T22:25:20.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa18c60c700 1 -- 172.21.15.154:0/2550014558 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1740094a0 con 0x7fa1840a0a70 2023-09-30T22:25:20.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.370+0000 7fa18c60c700 1 -- 172.21.15.154:0/2550014558 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa184120b60 con 0x7fa1840a0a70 2023-09-30T22:25:20.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.371+0000 7fa17affd700 1 -- 172.21.15.154:0/2550014558 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa180013470 con 0x7fa1840a0a70 2023-09-30T22:25:20.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.371+0000 7fa17affd700 1 -- 172.21.15.154:0/2550014558 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa18003f750 con 0x7fa1840a0a70 2023-09-30T22:25:20.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.373+0000 7fa18c60c700 1 -- 172.21.15.154:0/2550014558 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18404f2a0 con 0x7fa1840a0a70 2023-09-30T22:25:20.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.381+0000 7fa17affd700 1 -- 172.21.15.154:0/2550014558 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa180013720 con 0x7fa1840a0a70 2023-09-30T22:25:20.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.415+0000 7fb7cfe97700 1 Processor -- start 2023-09-30T22:25:20.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.415+0000 7fb7cfe97700 1 -- start start 2023-09-30T22:25:20.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cfe97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8099e20 0x7fb7c809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cfe97700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8130a60 0x7fb7c8138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cfe97700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c8099a60 con 0x7fb7c809a730 2023-09-30T22:25:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cfe97700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c809bf50 con 0x7fb7c8099e20 2023-09-30T22:25:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cfe97700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c809b230 con 0x7fb7c8130a60 2023-09-30T22:25:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cdc33700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8099e20 0x7fb7c809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cdc33700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8099e20 0x7fb7c809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51732/0 (socket says 172.21.15.154:51732) 2023-09-30T22:25:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cdc33700 1 -- 172.21.15.154:0/1864781772 learned_addr learned my addr 172.21.15.154:0/1864781772 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7ce434700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8130a60 0x7fb7c8138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cdc33700 1 -- 172.21.15.154:0/1864781772 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8130a60 msgr2=0x7fb7c8138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cdc33700 1 --2- 172.21.15.154:0/1864781772 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8130a60 0x7fb7c8138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cdc33700 1 -- 172.21.15.154:0/1864781772 >> v1:172.21.15.154:6789/0 conn(0x7fb7c809a730 legacy=0x7fb7c8130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.416+0000 7fb7cdc33700 1 -- 172.21.15.154:0/1864781772 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c809bb90 con 0x7fb7c8099e20 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7cdc33700 1 --2- 172.21.15.154:0/1864781772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8099e20 0x7fb7c809a1f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400bb90 tx=0x7fb7c400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba05e0cec7f381e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7ccc31700 1 -- 172.21.15.154:0/1864781772 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4005e30 con 0x7fb7c8099e20 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7ccc31700 1 -- 172.21.15.154:0/1864781772 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4004030 con 0x7fb7c8099e20 2023-09-30T22:25:20.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7ccc31700 1 -- 172.21.15.154:0/1864781772 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c40043e0 con 0x7fb7c8099e20 2023-09-30T22:25:20.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7cfe97700 1 -- 172.21.15.154:0/1864781772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8099e20 msgr2=0x7fb7c809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7cfe97700 1 --2- 172.21.15.154:0/1864781772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8099e20 0x7fb7c809a1f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400bb90 tx=0x7fb7c400bea0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7cfe97700 1 -- 172.21.15.154:0/1864781772 shutdown_connections 2023-09-30T22:25:20.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7cfe97700 1 --2- 172.21.15.154:0/1864781772 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8130a60 0x7fb7c8138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7cfe97700 1 --2- 172.21.15.154:0/1864781772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8099e20 0x7fb7c809a1f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7cfe97700 1 -- 172.21.15.154:0/1864781772 >> 172.21.15.154:0/1864781772 conn(0x7fb7c80a2980 msgr2=0x7fb7c80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7cfe97700 1 -- 172.21.15.154:0/1864781772 shutdown_connections 2023-09-30T22:25:20.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.417+0000 7fb7cfe97700 1 -- 172.21.15.154:0/1864781772 wait complete. 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.418+0000 7fb7cfe97700 1 Processor -- start 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.418+0000 7fb7cfe97700 1 -- start start 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cfe97700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8099e20 0x7fb7c811b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cfe97700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c809a730 0x7fb7c811bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cfe97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8130a60 0x7fb7c811c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cfe97700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c812dc90 con 0x7fb7c809a730 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cfe97700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c811f3b0 con 0x7fb7c8130a60 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cfe97700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c811e760 con 0x7fb7c8099e20 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cdc33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8099e20 0x7fb7c811b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cdc33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8099e20 0x7fb7c811b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51102/0 (socket says 172.21.15.154:51102) 2023-09-30T22:25:20.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cdc33700 1 -- 172.21.15.154:0/2409161110 learned_addr learned my addr 172.21.15.154:0/2409161110 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cd432700 1 --2- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c809a730 0x7fb7c811bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7ce434700 1 --2- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8130a60 0x7fb7c811c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cdc33700 1 -- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8130a60 msgr2=0x7fb7c811c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cdc33700 1 --2- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8130a60 0x7fb7c811c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cdc33700 1 -- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c809a730 msgr2=0x7fb7c811bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cdc33700 1 --2- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c809a730 0x7fb7c811bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.419+0000 7fb7cdc33700 1 -- 172.21.15.154:0/2409161110 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c400b7a0 con 0x7fb7c8099e20 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.420+0000 7fb7cdc33700 1 --2- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8099e20 0x7fb7c811b890 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400bee0 tx=0x7fb7c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.420+0000 7fb7be7fc700 1 -- 172.21.15.154:0/2409161110 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c401e070 con 0x7fb7c8099e20 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.420+0000 7fb7be7fc700 1 -- 172.21.15.154:0/2409161110 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c40036a0 con 0x7fb7c8099e20 2023-09-30T22:25:20.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.420+0000 7fb7be7fc700 1 -- 172.21.15.154:0/2409161110 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4003a50 con 0x7fb7c8099e20 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.420+0000 7fb7cfe97700 1 -- 172.21.15.154:0/2409161110 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c80a1300 con 0x7fb7c8099e20 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.420+0000 7fb7cfe97700 1 -- 172.21.15.154:0/2409161110 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c811f0d0 con 0x7fb7c8099e20 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.421+0000 7fb7be7fc700 1 -- 172.21.15.154:0/2409161110 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7c4003bb0 con 0x7fb7c8099e20 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.421+0000 7fb7be7fc700 1 -- 172.21.15.154:0/2409161110 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7c4040850 con 0x7fb7c8099e20 2023-09-30T22:25:20.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.421+0000 7fb7cfe97700 1 -- 172.21.15.154:0/2409161110 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c8072480 con 0x7fb7c8099e20 2023-09-30T22:25:20.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.425+0000 7fb7be7fc700 1 -- 172.21.15.154:0/2409161110 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7c8072480 con 0x7fb7c8099e20 2023-09-30T22:25:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.442+0000 7fc138efe700 1 -- 172.21.15.154:0/997101827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc13409e380 con 0x7fc13406a770 2023-09-30T22:25:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.442+0000 7fc122ffd700 1 -- 172.21.15.154:0/997101827 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc124015070 con 0x7fc13406a770 2023-09-30T22:25:20.443 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:20.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.444+0000 7fc138efe700 1 -- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc13406a770 msgr2=0x7fc13409a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.444+0000 7fc138efe700 1 --2- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc13406a770 0x7fc13409a490 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc124000c00 tx=0x7fc124004750 comp rx=0 tx=0).stop 2023-09-30T22:25:20.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.444+0000 7fc138efe700 1 -- 172.21.15.154:0/997101827 shutdown_connections 2023-09-30T22:25:20.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.444+0000 7fc138efe700 1 --2- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134131a00 0x7fc13409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.444+0000 7fc138efe700 1 --2- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc13406a770 0x7fc13409a490 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.444+0000 7fc138efe700 1 --2- 172.21.15.154:0/997101827 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc13409dec0 0x7fc13409a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.444+0000 7fc138efe700 1 -- 172.21.15.154:0/997101827 >> 172.21.15.154:0/997101827 conn(0x7fc134099c40 msgr2=0x7fc1340a2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.445+0000 7fc138efe700 1 -- 172.21.15.154:0/997101827 shutdown_connections 2023-09-30T22:25:20.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.445+0000 7fc138efe700 1 -- 172.21.15.154:0/997101827 wait complete. 2023-09-30T22:25:20.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.533+0000 7fb8128fd700 1 -- 172.21.15.154:0/858349872 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb80c04f2a0 con 0x7fb80c0a0a70 2023-09-30T22:25:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.534+0000 7fb808ff9700 1 -- 172.21.15.154:0/858349872 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb800028070 con 0x7fb80c0a0a70 2023-09-30T22:25:20.534 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:20.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.536+0000 7fb8128fd700 1 -- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c0a0a70 msgr2=0x7fb80c1c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.536+0000 7fb8128fd700 1 --2- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c0a0a70 0x7fb80c1c86d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb8000090b0 tx=0x7fb800004750 comp rx=0 tx=0).stop 2023-09-30T22:25:20.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.536+0000 7fb8128fd700 1 -- 172.21.15.154:0/858349872 shutdown_connections 2023-09-30T22:25:20.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.536+0000 7fb8128fd700 1 --2- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb80c133f70 0x7fb80c1c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.536+0000 7fb8128fd700 1 --2- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb80c09ad40 0x7fb80c1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.536+0000 7fb8128fd700 1 --2- 172.21.15.154:0/858349872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb80c0a0a70 0x7fb80c1c86d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.536+0000 7fb8128fd700 1 -- 172.21.15.154:0/858349872 >> 172.21.15.154:0/858349872 conn(0x7fb80c099c40 msgr2=0x7fb80c1bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.536+0000 7fb8128fd700 1 -- 172.21.15.154:0/858349872 shutdown_connections 2023-09-30T22:25:20.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.536+0000 7fb8128fd700 1 -- 172.21.15.154:0/858349872 wait complete. 2023-09-30T22:25:20.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:20.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.619+0000 7fb7cfe97700 1 -- 172.21.15.154:0/2409161110 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb7c8072480 con 0x7fb7c8099e20 2023-09-30T22:25:20.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.619+0000 7fb7be7fc700 1 -- 172.21.15.154:0/2409161110 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7c8072480 con 0x7fb7c8099e20 2023-09-30T22:25:20.620 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.622+0000 7fb7cfe97700 1 -- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8099e20 msgr2=0x7fb7c811b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.622+0000 7fb7cfe97700 1 --2- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8099e20 0x7fb7c811b890 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400bee0 tx=0x7fb7c4004750 comp rx=0 tx=0).stop 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.622+0000 7fb7cfe97700 1 -- 172.21.15.154:0/2409161110 shutdown_connections 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.622+0000 7fb7cfe97700 1 --2- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7c8130a60 0x7fb7c811c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.622+0000 7fb7cfe97700 1 --2- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7c8099e20 0x7fb7c811b890 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.622+0000 7fb7cfe97700 1 --2- 172.21.15.154:0/2409161110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c809a730 0x7fb7c811bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.622+0000 7fb7cfe97700 1 -- 172.21.15.154:0/2409161110 >> 172.21.15.154:0/2409161110 conn(0x7fb7c80a2980 msgr2=0x7fb7c809fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.622+0000 7fb7cfe97700 1 -- 172.21.15.154:0/2409161110 shutdown_connections 2023-09-30T22:25:20.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.622+0000 7fb7cfe97700 1 -- 172.21.15.154:0/2409161110 wait complete. 2023-09-30T22:25:20.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.626+0000 7fa18c60c700 1 -- 172.21.15.154:0/2550014558 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa184122ab0 con 0x7fa1840a0a70 2023-09-30T22:25:20.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.627+0000 7fa17affd700 1 -- 172.21.15.154:0/2550014558 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa180017020 con 0x7fa1840a0a70 2023-09-30T22:25:20.628 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:20.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.629+0000 7fa18c60c700 1 -- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a0a70 msgr2=0x7fa18411e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:20.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.629+0000 7fa18c60c700 1 --2- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a0a70 0x7fa18411e7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa18000e9b0 tx=0x7fa18000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.629+0000 7fa18c60c700 1 -- 172.21.15.154:0/2550014558 shutdown_connections 2023-09-30T22:25:20.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.629+0000 7fa18c60c700 1 --2- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa184133f50 0x7fa18411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.629+0000 7fa18c60c700 1 --2- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1840a0a70 0x7fa18411e7a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.629+0000 7fa18c60c700 1 --2- 172.21.15.154:0/2550014558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1840a1380 0x7fa18411ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:20.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.629+0000 7fa18c60c700 1 -- 172.21.15.154:0/2550014558 >> 172.21.15.154:0/2550014558 conn(0x7fa1840a6610 msgr2=0x7fa1840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:20.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.629+0000 7fa18c60c700 1 -- 172.21.15.154:0/2550014558 shutdown_connections 2023-09-30T22:25:20.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:20.629+0000 7fa18c60c700 1 -- 172.21.15.154:0/2550014558 wait complete. 2023-09-30T22:25:20.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:20.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:21.459 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:21.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:21.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a06c54700 1 Processor -- start 2023-09-30T22:25:21.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a06c54700 1 -- start start 2023-09-30T22:25:21.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a06c54700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a06c54700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a00139200 0x7f0a0013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a06c54700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0009e9d0 con 0x7f0a000a0a70 2023-09-30T22:25:21.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a06c54700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0009dc00 con 0x7f0a00139200 2023-09-30T22:25:21.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a06c54700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0009dec0 con 0x7f0a000a1550 2023-09-30T22:25:21.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a051f1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a00139200 0x7f0a0013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f09fffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a051f1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a00139200 0x7f0a0013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43714/0 (socket says 172.21.15.154:43714) 2023-09-30T22:25:21.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f09fffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51116/0 (socket says 172.21.15.154:51116) 2023-09-30T22:25:21.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a051f1700 1 -- 172.21.15.154:0/1833103597 learned_addr learned my addr 172.21.15.154:0/1833103597 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:21.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.587+0000 7f0a049f0700 1 --1- 172.21.15.154:0/1833103597 >> v1:172.21.15.154:6789/0 conn(0x7f0a000a0a70 0x7f0a000a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59120/0 (socket says 172.21.15.154:59120) 2023-09-30T22:25:21.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f09fffff700 1 -- 172.21.15.154:0/1833103597 >> v2:172.21.15.154:3300/0 conn(0x7f0a00139200 msgr2=0x7f0a0013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f09fffff700 1 --2- 172.21.15.154:0/1833103597 >> v2:172.21.15.154:3300/0 conn(0x7f0a00139200 0x7f0a0013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f09fffff700 1 -- 172.21.15.154:0/1833103597 >> v1:172.21.15.154:6789/0 conn(0x7f0a000a0a70 legacy=0x7f0a000a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f09fffff700 1 -- 172.21.15.154:0/1833103597 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0009e6a0 con 0x7f0a000a1550 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f09ff7fe700 1 -- 172.21.15.154:0/1833103597 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328249385 0 0) 0x7f0a0009e9d0 con 0x7f0a000a0a70 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f0a051f1700 1 --2- 172.21.15.154:0/1833103597 >> v2:172.21.15.154:3300/0 conn(0x7f0a00139200 0x7f0a0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f09fffff700 1 --2- 172.21.15.154:0/1833103597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00138cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009840 tx=0x7f09ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b0a42ff71416fed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f09ff7fe700 1 -- 172.21.15.154:0/1833103597 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec011830 con 0x7f0a000a1550 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f09ff7fe700 1 -- 172.21.15.154:0/1833103597 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec011990 con 0x7f0a000a1550 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f09ff7fe700 1 -- 172.21.15.154:0/1833103597 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec011d20 con 0x7f0a000a1550 2023-09-30T22:25:21.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f0a06c54700 1 -- 172.21.15.154:0/1833103597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 msgr2=0x7f0a00138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.588+0000 7f0a06c54700 1 --2- 172.21.15.154:0/1833103597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00138cc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009840 tx=0x7f09ec009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:21.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.589+0000 7f0a06c54700 1 -- 172.21.15.154:0/1833103597 shutdown_connections 2023-09-30T22:25:21.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.589+0000 7f0a06c54700 1 --2- 172.21.15.154:0/1833103597 >> v2:172.21.15.154:3300/0 conn(0x7f0a00139200 0x7f0a0013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.589+0000 7f0a06c54700 1 --2- 172.21.15.154:0/1833103597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00138cc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.589+0000 7f0a06c54700 1 -- 172.21.15.154:0/1833103597 >> 172.21.15.154:0/1833103597 conn(0x7f0a000a6610 msgr2=0x7f0a000a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:21.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.589+0000 7f0a06c54700 1 -- 172.21.15.154:0/1833103597 shutdown_connections 2023-09-30T22:25:21.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.589+0000 7f0a06c54700 1 -- 172.21.15.154:0/1833103597 wait complete. 2023-09-30T22:25:21.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.589+0000 7f0a06c54700 1 Processor -- start 2023-09-30T22:25:21.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f0a06c54700 1 -- start start 2023-09-30T22:25:21.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f0a06c54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a000a0a70 0x7f0a00121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f0a06c54700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f0a06c54700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a00139200 0x7f0a001224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f0a06c54700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00123680 con 0x7f0a00139200 2023-09-30T22:25:21.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f0a06c54700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a00123ca0 con 0x7f0a000a0a70 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f0a06c54700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a000a03e0 con 0x7f0a000a1550 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f09fffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f09fffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00121fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51120/0 (socket says 172.21.15.154:51120) 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f0a051f1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a00139200 0x7f0a001224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f09fffff700 1 -- 172.21.15.154:0/1490309667 learned_addr learned my addr 172.21.15.154:0/1490309667 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f0a049f0700 1 --2- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a000a0a70 0x7f0a00121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f09fffff700 1 -- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a000a0a70 msgr2=0x7f0a00121a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f09fffff700 1 --2- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a000a0a70 0x7f0a00121a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f09fffff700 1 -- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a00139200 msgr2=0x7f0a001224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.590+0000 7f09fffff700 1 --2- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a00139200 0x7f0a001224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.591+0000 7f09fffff700 1 -- 172.21.15.154:0/1490309667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8009b30 con 0x7f0a000a1550 2023-09-30T22:25:21.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.591+0000 7f09fffff700 1 --2- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00121fb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0090b0 tx=0x7f09ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.591+0000 7f09fd7fa700 1 -- 172.21.15.154:0/1490309667 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec004400 con 0x7f0a000a1550 2023-09-30T22:25:21.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.591+0000 7f09fd7fa700 1 -- 172.21.15.154:0/1490309667 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec01f070 con 0x7f0a000a1550 2023-09-30T22:25:21.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.591+0000 7f0a06c54700 1 -- 172.21.15.154:0/1490309667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec0094a0 con 0x7f0a000a1550 2023-09-30T22:25:21.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.591+0000 7f09fd7fa700 1 -- 172.21.15.154:0/1490309667 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0038e0 con 0x7f0a000a1550 2023-09-30T22:25:21.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.591+0000 7f0a06c54700 1 -- 172.21.15.154:0/1490309667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a00124d70 con 0x7f0a000a1550 2023-09-30T22:25:21.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.592+0000 7f09fd7fa700 1 -- 172.21.15.154:0/1490309667 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09ec021030 con 0x7f0a000a1550 2023-09-30T22:25:21.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.592+0000 7f09fd7fa700 1 -- 172.21.15.154:0/1490309667 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09ec040820 con 0x7f0a000a1550 2023-09-30T22:25:21.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.592+0000 7f0a06c54700 1 -- 172.21.15.154:0/1490309667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a00124f50 con 0x7f0a000a1550 2023-09-30T22:25:21.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.596+0000 7f09fd7fa700 1 -- 172.21.15.154:0/1490309667 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a00124f50 con 0x7f0a000a1550 2023-09-30T22:25:21.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:21.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.675+0000 7f6329778700 1 Processor -- start 2023-09-30T22:25:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.675+0000 7f6329778700 1 -- start start 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.675+0000 7f6329778700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409e870 0x7f632409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.675+0000 7f6329778700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6324131f40 0x7f6324139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.675+0000 7f6329778700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632409c970 con 0x7f632409f180 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.675+0000 7f6329778700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63240a0920 con 0x7f6324131f40 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.675+0000 7f6329778700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f632409f9c0 con 0x7f632409e870 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.675+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409e870 0x7f632409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409e870 0x7f632409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51128/0 (socket says 172.21.15.154:51128) 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f6322ffd700 1 -- 172.21.15.154:0/3315568033 learned_addr learned my addr 172.21.15.154:0/3315568033 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f63237fe700 1 --2- 172.21.15.154:0/3315568033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6324131f40 0x7f6324139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f63237fe700 1 -- 172.21.15.154:0/3315568033 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409e870 msgr2=0x7f632409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f63237fe700 1 --2- 172.21.15.154:0/3315568033 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409e870 0x7f632409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f63237fe700 1 -- 172.21.15.154:0/3315568033 >> v1:172.21.15.154:6789/0 conn(0x7f632409f180 legacy=0x7f6324131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f6321ffb700 1 -- 172.21.15.154:0/3315568033 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083454970 0 0) 0x7f632409c970 con 0x7f632409f180 2023-09-30T22:25:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f63237fe700 1 -- 172.21.15.154:0/3315568033 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632409bab0 con 0x7f6324131f40 2023-09-30T22:25:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f63237fe700 1 --2- 172.21.15.154:0/3315568033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6324131f40 0x7f6324139ca0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f631c009dc0 tx=0x7f631c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2a547bcb77f3812 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f6321ffb700 1 -- 172.21.15.154:0/3315568033 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c00e070 con 0x7f6324131f40 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f6321ffb700 1 -- 172.21.15.154:0/3315568033 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c00bb20 con 0x7f6324131f40 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.676+0000 7f6321ffb700 1 -- 172.21.15.154:0/3315568033 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c012430 con 0x7f6324131f40 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.677+0000 7f6329778700 1 -- 172.21.15.154:0/3315568033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6324131f40 msgr2=0x7f6324139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.677+0000 7f6329778700 1 --2- 172.21.15.154:0/3315568033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6324131f40 0x7f6324139ca0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f631c009dc0 tx=0x7f631c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.677+0000 7f6329778700 1 -- 172.21.15.154:0/3315568033 shutdown_connections 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.677+0000 7f6329778700 1 --2- 172.21.15.154:0/3315568033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6324131f40 0x7f6324139ca0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.677+0000 7f6329778700 1 --2- 172.21.15.154:0/3315568033 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409e870 0x7f632409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.677+0000 7f6329778700 1 -- 172.21.15.154:0/3315568033 >> 172.21.15.154:0/3315568033 conn(0x7f63240a4430 msgr2=0x7f63240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.678+0000 7f6329778700 1 -- 172.21.15.154:0/3315568033 shutdown_connections 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.678+0000 7f6329778700 1 -- 172.21.15.154:0/3315568033 wait complete. 2023-09-30T22:25:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6329778700 1 Processor -- start 2023-09-30T22:25:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6329778700 1 -- start start 2023-09-30T22:25:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6329778700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f632409e870 0x7f6324120010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6329778700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409f180 0x7f6324120550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6329778700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6324131f40 0x7f6324120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6329778700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6324123bd0 con 0x7f6324131f40 2023-09-30T22:25:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6329778700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6324122e70 con 0x7f632409e870 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6329778700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6324121da0 con 0x7f632409f180 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f632409e870 0x7f6324120010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f63227fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409f180 0x7f6324120550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f632409e870 0x7f6324120010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51770/0 (socket says 172.21.15.154:51770) 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.680+0000 7f6322ffd700 1 -- 172.21.15.154:0/1074681847 learned_addr learned my addr 172.21.15.154:0/1074681847 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f63237fe700 1 --2- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6324131f40 0x7f6324120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f6322ffd700 1 -- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409f180 msgr2=0x7f6324120550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f6322ffd700 1 --2- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409f180 0x7f6324120550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f6322ffd700 1 -- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6324131f40 msgr2=0x7f6324120a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f6322ffd700 1 --2- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6324131f40 0x7f6324120a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f6322ffd700 1 -- 172.21.15.154:0/1074681847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c009a70 con 0x7f632409e870 2023-09-30T22:25:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f6322ffd700 1 --2- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f632409e870 0x7f6324120010 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f631400e8b0 tx=0x7f631400ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f630b7fe700 1 -- 172.21.15.154:0/1074681847 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314009600 con 0x7f632409e870 2023-09-30T22:25:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f630b7fe700 1 -- 172.21.15.154:0/1074681847 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314013680 con 0x7f632409e870 2023-09-30T22:25:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f6329778700 1 -- 172.21.15.154:0/1074681847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6324122ab0 con 0x7f632409e870 2023-09-30T22:25:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f630b7fe700 1 -- 172.21.15.154:0/1074681847 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314013a30 con 0x7f632409e870 2023-09-30T22:25:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.681+0000 7f6329778700 1 -- 172.21.15.154:0/1074681847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6324123850 con 0x7f632409e870 2023-09-30T22:25:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.682+0000 7f6329778700 1 -- 172.21.15.154:0/1074681847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632411ce70 con 0x7f632409e870 2023-09-30T22:25:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.683+0000 7f630b7fe700 1 -- 172.21.15.154:0/1074681847 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6314013b90 con 0x7f632409e870 2023-09-30T22:25:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.683+0000 7f630b7fe700 1 -- 172.21.15.154:0/1074681847 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f631403fd10 con 0x7f632409e870 2023-09-30T22:25:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.687+0000 7f630b7fe700 1 -- 172.21.15.154:0/1074681847 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6314026430 con 0x7f632409e870 2023-09-30T22:25:21.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.765+0000 7fc2f8b9f700 1 Processor -- start 2023-09-30T22:25:21.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.765+0000 7fc2f8b9f700 1 -- start start 2023-09-30T22:25:21.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f8b9f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f409d860 0x7fc2f409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f8b9f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f8b9f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2f4130ce0 0x7fc2f4131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f8b9f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f409aaa0 con 0x7fc2f4130ce0 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f8b9f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f409f870 con 0x7fc2f409d860 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f8b9f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f409b360 con 0x7fc2f409e170 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f409d860 0x7fc2f409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51148/0 (socket says 172.21.15.154:51148) 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f1d9b700 1 -- 172.21.15.154:0/95321088 learned_addr learned my addr 172.21.15.154:0/95321088 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f2d9d700 1 --2- 172.21.15.154:0/95321088 >> v2:172.21.15.154:3300/0 conn(0x7fc2f4130ce0 0x7fc2f4131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f1d9b700 1 -- 172.21.15.154:0/95321088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f409d860 msgr2=0x7fc2f409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f1d9b700 1 --2- 172.21.15.154:0/95321088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f409d860 0x7fc2f409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f1d9b700 1 -- 172.21.15.154:0/95321088 >> v2:172.21.15.154:3300/0 conn(0x7fc2f4130ce0 msgr2=0x7fc2f4131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f1d9b700 1 --2- 172.21.15.154:0/95321088 >> v2:172.21.15.154:3300/0 conn(0x7fc2f4130ce0 0x7fc2f4131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f1d9b700 1 -- 172.21.15.154:0/95321088 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f409b620 con 0x7fc2f409e170 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.766+0000 7fc2f259c700 1 --2- 172.21.15.154:0/95321088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f409d860 0x7fc2f409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.767+0000 7fc2f1d9b700 1 --2- 172.21.15.154:0/95321088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80098f0 tx=0x7fc2e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b460f4354100be2e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.767+0000 7fc2f159a700 1 -- 172.21.15.154:0/95321088 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8011830 con 0x7fc2f409e170 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.767+0000 7fc2f159a700 1 -- 172.21.15.154:0/95321088 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8011990 con 0x7fc2f409e170 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.767+0000 7fc2f159a700 1 -- 172.21.15.154:0/95321088 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8011d20 con 0x7fc2f409e170 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.767+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/95321088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 msgr2=0x7fc2f41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.768+0000 7fc2f8b9f700 1 --2- 172.21.15.154:0/95321088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80098f0 tx=0x7fc2e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.768+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/95321088 shutdown_connections 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.768+0000 7fc2f8b9f700 1 --2- 172.21.15.154:0/95321088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f409d860 0x7fc2f409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.768+0000 7fc2f8b9f700 1 --2- 172.21.15.154:0/95321088 >> v2:172.21.15.154:3300/0 conn(0x7fc2f4130ce0 0x7fc2f4131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.768+0000 7fc2f8b9f700 1 --2- 172.21.15.154:0/95321088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.768+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/95321088 >> 172.21.15.154:0/95321088 conn(0x7fc2f4099c40 msgr2=0x7fc2f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:21.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.768+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/95321088 shutdown_connections 2023-09-30T22:25:21.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.768+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/95321088 wait complete. 2023-09-30T22:25:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.769+0000 7fc2f8b9f700 1 Processor -- start 2023-09-30T22:25:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.769+0000 7fc2f8b9f700 1 -- start start 2023-09-30T22:25:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f8b9f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f409d860 0x7fc2f4119f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f8b9f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f411a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f8b9f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f4130ce0 0x7fc2f411a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f8b9f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f411b3a0 con 0x7fc2f409d860 2023-09-30T22:25:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f8b9f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f411bb20 con 0x7fc2f4130ce0 2023-09-30T22:25:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f8b9f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f411c140 con 0x7fc2f409e170 2023-09-30T22:25:21.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f4130ce0 0x7fc2f411a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f4130ce0 0x7fc2f411a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51798/0 (socket says 172.21.15.154:51798) 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f2d9d700 1 -- 172.21.15.154:0/1261328673 learned_addr learned my addr 172.21.15.154:0/1261328673 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f1d9b700 1 --2- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f411a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.770+0000 7fc2f259c700 1 --2- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f409d860 0x7fc2f4119f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2f2d9d700 1 -- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 msgr2=0x7fc2f411a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2f2d9d700 1 --2- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f411a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2f2d9d700 1 -- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f409d860 msgr2=0x7fc2f4119f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2f2d9d700 1 --2- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f409d860 0x7fc2f4119f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2f2d9d700 1 -- 172.21.15.154:0/1261328673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e400d940 con 0x7fc2f4130ce0 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2f2d9d700 1 --2- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f4130ce0 0x7fc2f411a990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec007ea0 tx=0x7fc2ec00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2e2ffd700 1 -- 172.21.15.154:0/1261328673 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00edf0 con 0x7fc2f4130ce0 2023-09-30T22:25:21.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/1261328673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e8009550 con 0x7fc2f4130ce0 2023-09-30T22:25:21.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/1261328673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f40a23d0 con 0x7fc2f4130ce0 2023-09-30T22:25:21.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2e2ffd700 1 -- 172.21.15.154:0/1261328673 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec01e460 con 0x7fc2f4130ce0 2023-09-30T22:25:21.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.771+0000 7fc2e2ffd700 1 -- 172.21.15.154:0/1261328673 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec01e7d0 con 0x7fc2f4130ce0 2023-09-30T22:25:21.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.772+0000 7fc2e2ffd700 1 -- 172.21.15.154:0/1261328673 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2ec01e930 con 0x7fc2f4130ce0 2023-09-30T22:25:21.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.772+0000 7fc2e2ffd700 1 -- 172.21.15.154:0/1261328673 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2ec03fec0 con 0x7fc2f4130ce0 2023-09-30T22:25:21.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.772+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/1261328673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d80052e0 con 0x7fc2f4130ce0 2023-09-30T22:25:21.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.781+0000 7fc2e2ffd700 1 -- 172.21.15.154:0/1261328673 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2ec01bd70 con 0x7fc2f4130ce0 2023-09-30T22:25:21.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.803+0000 7f0a06c54700 1 -- 172.21.15.154:0/1490309667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a00124f50 con 0x7f0a000a1550 2023-09-30T22:25:21.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.803+0000 7f09fd7fa700 1 -- 172.21.15.154:0/1490309667 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a00124f50 con 0x7f0a000a1550 2023-09-30T22:25:21.804 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.806+0000 7f0a06c54700 1 -- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 msgr2=0x7f0a00121fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.806+0000 7f0a06c54700 1 --2- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00121fb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0090b0 tx=0x7f09ec004750 comp rx=0 tx=0).stop 2023-09-30T22:25:21.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.806+0000 7f0a06c54700 1 -- 172.21.15.154:0/1490309667 shutdown_connections 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.806+0000 7f0a06c54700 1 --2- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a00139200 0x7f0a001224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.806+0000 7f0a06c54700 1 --2- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a000a0a70 0x7f0a00121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.806+0000 7f0a06c54700 1 --2- 172.21.15.154:0/1490309667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a000a1550 0x7f0a00121fb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.807+0000 7f0a06c54700 1 -- 172.21.15.154:0/1490309667 >> 172.21.15.154:0/1490309667 conn(0x7f0a000a6610 msgr2=0x7f0a000a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.807+0000 7f0a06c54700 1 -- 172.21.15.154:0/1490309667 shutdown_connections 2023-09-30T22:25:21.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.807+0000 7f0a06c54700 1 -- 172.21.15.154:0/1490309667 wait complete. 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.812+0000 7f8c3c9dd700 1 Processor -- start 2023-09-30T22:25:21.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.812+0000 7f8c3c9dd700 1 -- start start 2023-09-30T22:25:21.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.812+0000 7f8c3c9dd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c38133ad0 0x7f8c38133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.812+0000 7f8c3c9dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c381304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.812+0000 7f8c3c9dd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3806b2d0 con 0x7f8c381309f0 2023-09-30T22:25:21.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.812+0000 7f8c3c9dd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c38133610 con 0x7f8c38133ad0 2023-09-30T22:25:21.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.812+0000 7f8c3c9dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3809a500 con 0x7f8c381300a0 2023-09-30T22:25:21.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c3659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c38133ad0 0x7f8c38133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c35d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c381304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c3659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c38133ad0 0x7f8c38133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43740/0 (socket says 172.21.15.154:43740) 2023-09-30T22:25:21.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c3659c700 1 -- 172.21.15.154:0/988550206 learned_addr learned my addr 172.21.15.154:0/988550206 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:21.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c35d9b700 1 -- 172.21.15.154:0/988550206 >> v2:172.21.15.154:3300/0 conn(0x7f8c38133ad0 msgr2=0x7f8c38133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:21.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c35d9b700 1 --2- 172.21.15.154:0/988550206 >> v2:172.21.15.154:3300/0 conn(0x7f8c38133ad0 0x7f8c38133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c35d9b700 1 -- 172.21.15.154:0/988550206 >> v1:172.21.15.154:6789/0 conn(0x7f8c381309f0 legacy=0x7f8c3813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c35d9b700 1 -- 172.21.15.154:0/988550206 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c381338b0 con 0x7f8c381300a0 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c3559a700 1 -- 172.21.15.154:0/988550206 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327977321 0 0) 0x7f8c3806b2d0 con 0x7f8c381309f0 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c35d9b700 1 --2- 172.21.15.154:0/988550206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c381304b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009840 tx=0x7f8c2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84087e810332e744 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c3559a700 1 -- 172.21.15.154:0/988550206 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c011830 con 0x7f8c381300a0 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c3559a700 1 -- 172.21.15.154:0/988550206 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c011990 con 0x7f8c381300a0 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.813+0000 7f8c3559a700 1 -- 172.21.15.154:0/988550206 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c011d20 con 0x7f8c381300a0 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.814+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/988550206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 msgr2=0x7f8c381304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.814+0000 7f8c3c9dd700 1 --2- 172.21.15.154:0/988550206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c381304b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009840 tx=0x7f8c2c009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.814+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/988550206 shutdown_connections 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.814+0000 7f8c3c9dd700 1 --2- 172.21.15.154:0/988550206 >> v2:172.21.15.154:3300/0 conn(0x7f8c38133ad0 0x7f8c38133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.814+0000 7f8c3c9dd700 1 --2- 172.21.15.154:0/988550206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c381304b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.814+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/988550206 >> 172.21.15.154:0/988550206 conn(0x7f8c38099c40 msgr2=0x7f8c380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:21.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.814+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/988550206 shutdown_connections 2023-09-30T22:25:21.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.814+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/988550206 wait complete. 2023-09-30T22:25:21.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.815+0000 7f8c3c9dd700 1 Processor -- start 2023-09-30T22:25:21.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.815+0000 7f8c3c9dd700 1 -- start start 2023-09-30T22:25:21.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c3c9dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c3811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c3c9dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c381309f0 0x7f8c3811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c3c9dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c38133ad0 0x7f8c3811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:21.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c3c9dd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380724c0 con 0x7f8c381309f0 2023-09-30T22:25:21.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c3c9dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380722d0 con 0x7f8c381300a0 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c3c9dd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38120300 con 0x7f8c38133ad0 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c3659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c3811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c3659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c3811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51826/0 (socket says 172.21.15.154:51826) 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c36d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c38133ad0 0x7f8c3811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c3659c700 1 -- 172.21.15.154:0/2860710133 learned_addr learned my addr 172.21.15.154:0/2860710133 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c35d9b700 1 --2- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c381309f0 0x7f8c3811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c35d9b700 1 -- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c38133ad0 msgr2=0x7f8c3811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c35d9b700 1 --2- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c38133ad0 0x7f8c3811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c35d9b700 1 -- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 msgr2=0x7f8c3811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c35d9b700 1 --2- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c3811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c35d9b700 1 -- 172.21.15.154:0/2860710133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0094a0 con 0x7f8c381309f0 2023-09-30T22:25:21.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.816+0000 7f8c36d9d700 1 --2- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c38133ad0 0x7f8c3811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.817+0000 7f8c35d9b700 1 --2- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c381309f0 0x7f8c3811df80 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c016000 tx=0x7f8c2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.817+0000 7f8c26ffd700 1 -- 172.21.15.154:0/2860710133 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0036a0 con 0x7f8c381309f0 2023-09-30T22:25:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.817+0000 7f8c26ffd700 1 -- 172.21.15.154:0/2860710133 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c01e070 con 0x7f8c381309f0 2023-09-30T22:25:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.817+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/2860710133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3811fd60 con 0x7f8c381309f0 2023-09-30T22:25:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.817+0000 7f8c26ffd700 1 -- 172.21.15.154:0/2860710133 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c003a40 con 0x7f8c381309f0 2023-09-30T22:25:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.817+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/2860710133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3812dd00 con 0x7f8c381309f0 2023-09-30T22:25:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.818+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/2860710133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3804f2a0 con 0x7f8c381309f0 2023-09-30T22:25:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.818+0000 7f8c26ffd700 1 -- 172.21.15.154:0/2860710133 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c2c003ba0 con 0x7f8c381309f0 2023-09-30T22:25:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.818+0000 7f8c26ffd700 1 -- 172.21.15.154:0/2860710133 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c2c0405f0 con 0x7f8c381309f0 2023-09-30T22:25:21.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.823+0000 7f8c26ffd700 1 -- 172.21.15.154:0/2860710133 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c2c02d450 con 0x7f8c381309f0 2023-09-30T22:25:21.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:21.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.892+0000 7f6329778700 1 -- 172.21.15.154:0/1074681847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f632404f2a0 con 0x7f632409e870 2023-09-30T22:25:21.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.893+0000 7f630b7fe700 1 -- 172.21.15.154:0/1074681847 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f631402a090 con 0x7f632409e870 2023-09-30T22:25:21.894 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:21.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.896+0000 7f6329778700 1 -- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f632409e870 msgr2=0x7f6324120010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.896+0000 7f6329778700 1 --2- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f632409e870 0x7f6324120010 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f631400e8b0 tx=0x7f631400ebc0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.896+0000 7f6329778700 1 -- 172.21.15.154:0/1074681847 shutdown_connections 2023-09-30T22:25:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.896+0000 7f6329778700 1 --2- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6324131f40 0x7f6324120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.896+0000 7f6329778700 1 --2- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f632409e870 0x7f6324120010 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.897+0000 7f6329778700 1 --2- 172.21.15.154:0/1074681847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f632409f180 0x7f6324120550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.897+0000 7f6329778700 1 -- 172.21.15.154:0/1074681847 >> 172.21.15.154:0/1074681847 conn(0x7f63240a4430 msgr2=0x7f63240720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.897+0000 7f6329778700 1 -- 172.21.15.154:0/1074681847 shutdown_connections 2023-09-30T22:25:21.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.897+0000 7f6329778700 1 -- 172.21.15.154:0/1074681847 wait complete. 2023-09-30T22:25:21.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:21.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.995+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/1261328673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc2d8005590 con 0x7fc2f4130ce0 2023-09-30T22:25:21.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.995+0000 7fc2e2ffd700 1 -- 172.21.15.154:0/1261328673 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2ec01b310 con 0x7fc2f4130ce0 2023-09-30T22:25:21.998 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.998+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f4130ce0 msgr2=0x7fc2f411a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.998+0000 7fc2f8b9f700 1 --2- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f4130ce0 0x7fc2f411a990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec007ea0 tx=0x7fc2ec00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.998+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/1261328673 shutdown_connections 2023-09-30T22:25:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.998+0000 7fc2f8b9f700 1 --2- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f4130ce0 0x7fc2f411a990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.998+0000 7fc2f8b9f700 1 --2- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f409d860 0x7fc2f4119f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.998+0000 7fc2f8b9f700 1 --2- 172.21.15.154:0/1261328673 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2f409e170 0x7fc2f411a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.998+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/1261328673 >> 172.21.15.154:0/1261328673 conn(0x7fc2f4099c40 msgr2=0x7fc2f40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.998+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/1261328673 shutdown_connections 2023-09-30T22:25:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:21.998+0000 7fc2f8b9f700 1 -- 172.21.15.154:0/1261328673 wait complete. 2023-09-30T22:25:22.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:22.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.018+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/2860710133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c380a2ea0 con 0x7f8c381309f0 2023-09-30T22:25:22.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.018+0000 7f8c26ffd700 1 -- 172.21.15.154:0/2860710133 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c2c015070 con 0x7f8c381309f0 2023-09-30T22:25:22.019 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:22.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.020+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c381309f0 msgr2=0x7f8c3811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.020+0000 7f8c3c9dd700 1 --2- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c381309f0 0x7f8c3811df80 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c016000 tx=0x7f8c2c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.020+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/2860710133 shutdown_connections 2023-09-30T22:25:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.020+0000 7f8c3c9dd700 1 --2- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c38133ad0 0x7f8c3811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.020+0000 7f8c3c9dd700 1 --2- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c381300a0 0x7f8c3811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.020+0000 7f8c3c9dd700 1 --2- 172.21.15.154:0/2860710133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c381309f0 0x7f8c3811df80 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.020+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/2860710133 >> 172.21.15.154:0/2860710133 conn(0x7f8c38099c40 msgr2=0x7f8c381329f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.020+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/2860710133 shutdown_connections 2023-09-30T22:25:22.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.020+0000 7f8c3c9dd700 1 -- 172.21.15.154:0/2860710133 wait complete. 2023-09-30T22:25:22.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:22.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:22.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6592a4700 1 Processor -- start 2023-09-30T22:25:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6592a4700 1 -- start start 2023-09-30T22:25:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6592a4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6540a0a70 0x7fc6540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6592a4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc6540a1380 0x7fc654133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6592a4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc654133f50 0x7fc654134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6592a4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65409e9d0 con 0x7fc6540a1380 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6592a4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65409dc00 con 0x7fc6540a0a70 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6592a4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc65409dec0 con 0x7fc654133f50 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6540a0a70 0x7fc6540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6537fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc654133f50 0x7fc654134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6540a0a70 0x7fc6540a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51834/0 (socket says 172.21.15.154:51834) 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc652ffd700 1 -- 172.21.15.154:0/2464033205 learned_addr learned my addr 172.21.15.154:0/2464033205 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.966+0000 7fc6527fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc6540a1380 0x7fc654133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc652ffd700 1 -- 172.21.15.154:0/2464033205 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc654133f50 msgr2=0x7fc654134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc652ffd700 1 --2- 172.21.15.154:0/2464033205 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc654133f50 0x7fc654134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc652ffd700 1 -- 172.21.15.154:0/2464033205 >> v2:172.21.15.154:3300/0 conn(0x7fc6540a1380 msgr2=0x7fc654133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc652ffd700 1 --2- 172.21.15.154:0/2464033205 >> v2:172.21.15.154:3300/0 conn(0x7fc6540a1380 0x7fc654133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc652ffd700 1 -- 172.21.15.154:0/2464033205 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65409e6a0 con 0x7fc6540a0a70 2023-09-30T22:25:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc6527fc700 1 --2- 172.21.15.154:0/2464033205 >> v2:172.21.15.154:3300/0 conn(0x7fc6540a1380 0x7fc654133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc6537fe700 1 --2- 172.21.15.154:0/2464033205 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc654133f50 0x7fc654134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc652ffd700 1 --2- 172.21.15.154:0/2464033205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6540a0a70 0x7fc6540a0e40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc6440098f0 tx=0x7fc644009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c0393c66da8afdc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc651ffb700 1 -- 172.21.15.154:0/2464033205 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644011830 con 0x7fc6540a0a70 2023-09-30T22:25:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc651ffb700 1 -- 172.21.15.154:0/2464033205 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc644011990 con 0x7fc6540a0a70 2023-09-30T22:25:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.967+0000 7fc651ffb700 1 -- 172.21.15.154:0/2464033205 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644011d20 con 0x7fc6540a0a70 2023-09-30T22:25:22.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.968+0000 7fc6592a4700 1 -- 172.21.15.154:0/2464033205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6540a0a70 msgr2=0x7fc6540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.968+0000 7fc6592a4700 1 --2- 172.21.15.154:0/2464033205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6540a0a70 0x7fc6540a0e40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc6440098f0 tx=0x7fc644009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.968+0000 7fc6592a4700 1 -- 172.21.15.154:0/2464033205 shutdown_connections 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.968+0000 7fc6592a4700 1 --2- 172.21.15.154:0/2464033205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6540a0a70 0x7fc6540a0e40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.968+0000 7fc6592a4700 1 --2- 172.21.15.154:0/2464033205 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc654133f50 0x7fc654134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.968+0000 7fc6592a4700 1 --2- 172.21.15.154:0/2464033205 >> v2:172.21.15.154:3300/0 conn(0x7fc6540a1380 0x7fc654133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.968+0000 7fc6592a4700 1 -- 172.21.15.154:0/2464033205 >> 172.21.15.154:0/2464033205 conn(0x7fc6540a6610 msgr2=0x7fc6540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.968+0000 7fc6592a4700 1 -- 172.21.15.154:0/2464033205 shutdown_connections 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.968+0000 7fc6592a4700 1 -- 172.21.15.154:0/2464033205 wait complete. 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.969+0000 7fc6592a4700 1 Processor -- start 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.969+0000 7fc6592a4700 1 -- start start 2023-09-30T22:25:22.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.969+0000 7fc6592a4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6540a0a70 0x7fc654122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.969+0000 7fc6592a4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6540a1380 0x7fc654122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.969+0000 7fc6592a4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc654133f50 0x7fc654122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.969+0000 7fc6592a4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654125e70 con 0x7fc6540a0a70 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.969+0000 7fc6592a4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc654125960 con 0x7fc654133f50 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6592a4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc654124df0 con 0x7fc6540a1380 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6540a0a70 0x7fc654122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6537fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc654133f50 0x7fc654122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6540a0a70 0x7fc654122350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43770/0 (socket says 172.21.15.154:43770) 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc652ffd700 1 -- 172.21.15.154:0/3117344855 learned_addr learned my addr 172.21.15.154:0/3117344855 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6527fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6540a1380 0x7fc654122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6537fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc654133f50 0x7fc654122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51846/0 (socket says 172.21.15.154:51846) 2023-09-30T22:25:22.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6537fe700 1 -- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6540a1380 msgr2=0x7fc654122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6537fe700 1 --2- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6540a1380 0x7fc654122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6537fe700 1 -- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6540a0a70 msgr2=0x7fc654122350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6537fe700 1 --2- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6540a0a70 0x7fc654122350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6537fe700 1 -- 172.21.15.154:0/3117344855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6480094a0 con 0x7fc654133f50 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc652ffd700 1 --2- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6540a0a70 0x7fc654122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6537fe700 1 --2- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc654133f50 0x7fc654122dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00efc0 tx=0x7fc64c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc63b7fe700 1 -- 172.21.15.154:0/3117344855 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00ca90 con 0x7fc654133f50 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc63b7fe700 1 -- 172.21.15.154:0/3117344855 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c00f040 con 0x7fc654133f50 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc63b7fe700 1 -- 172.21.15.154:0/3117344855 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00ce30 con 0x7fc654133f50 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6592a4700 1 -- 172.21.15.154:0/3117344855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c009a70 con 0x7fc654133f50 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.970+0000 7fc6592a4700 1 -- 172.21.15.154:0/3117344855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc644009550 con 0x7fc654133f50 2023-09-30T22:25:22.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.971+0000 7fc63b7fe700 1 -- 172.21.15.154:0/3117344855 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc64c014480 con 0x7fc654133f50 2023-09-30T22:25:22.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.971+0000 7fc63b7fe700 1 -- 172.21.15.154:0/3117344855 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc64c03fc60 con 0x7fc654133f50 2023-09-30T22:25:22.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.972+0000 7fc6592a4700 1 -- 172.21.15.154:0/3117344855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65411f760 con 0x7fc654133f50 2023-09-30T22:25:22.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:22.977+0000 7fc63b7fe700 1 -- 172.21.15.154:0/3117344855 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc64c012930 con 0x7fc654133f50 2023-09-30T22:25:23.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:23.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.041+0000 7f7e7113f700 1 Processor -- start 2023-09-30T22:25:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e7113f700 1 -- start start 2023-09-30T22:25:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e7113f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e7113f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e6c1300a0 0x7f7e6c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e7113f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6c06b2d0 con 0x7f7e6c1309f0 2023-09-30T22:25:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e7113f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c133610 con 0x7f7e6c1300a0 2023-09-30T22:25:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e7113f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c09a500 con 0x7f7e6c133ad0 2023-09-30T22:25:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e6ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e6ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51184/0 (socket says 172.21.15.154:51184) 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e6ad9d700 1 -- 172.21.15.154:0/3171114986 learned_addr learned my addr 172.21.15.154:0/3171114986 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e6a59c700 1 --2- 172.21.15.154:0/3171114986 >> v2:172.21.15.154:3300/0 conn(0x7f7e6c1300a0 0x7f7e6c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e6a59c700 1 -- 172.21.15.154:0/3171114986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 msgr2=0x7f7e6c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e6a59c700 1 --2- 172.21.15.154:0/3171114986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e6a59c700 1 -- 172.21.15.154:0/3171114986 >> v1:172.21.15.154:6789/0 conn(0x7f7e6c1309f0 legacy=0x7f7e6c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.042+0000 7f7e6a59c700 1 -- 172.21.15.154:0/3171114986 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c1338b0 con 0x7f7e6c1300a0 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.043+0000 7f7e6a59c700 1 --2- 172.21.15.154:0/3171114986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6c1300a0 0x7f7e6c1304b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009840 tx=0x7f7e60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1029a21879fbb6d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.043+0000 7f7e69d9b700 1 -- 172.21.15.154:0/3171114986 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60011830 con 0x7f7e6c1300a0 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.043+0000 7f7e69d9b700 1 -- 172.21.15.154:0/3171114986 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60011990 con 0x7f7e6c1300a0 2023-09-30T22:25:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.043+0000 7f7e69d9b700 1 -- 172.21.15.154:0/3171114986 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60011d20 con 0x7f7e6c1300a0 2023-09-30T22:25:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.043+0000 7f7e7113f700 1 -- 172.21.15.154:0/3171114986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6c1300a0 msgr2=0x7f7e6c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.043+0000 7f7e7113f700 1 --2- 172.21.15.154:0/3171114986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6c1300a0 0x7f7e6c1304b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009840 tx=0x7f7e60009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.044+0000 7f7e7113f700 1 -- 172.21.15.154:0/3171114986 shutdown_connections 2023-09-30T22:25:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.044+0000 7f7e7113f700 1 --2- 172.21.15.154:0/3171114986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.044+0000 7f7e7113f700 1 --2- 172.21.15.154:0/3171114986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6c1300a0 0x7f7e6c1304b0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.044+0000 7f7e7113f700 1 -- 172.21.15.154:0/3171114986 >> 172.21.15.154:0/3171114986 conn(0x7f7e6c099c40 msgr2=0x7f7e6c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.044+0000 7f7e7113f700 1 -- 172.21.15.154:0/3171114986 shutdown_connections 2023-09-30T22:25:23.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.044+0000 7f7e7113f700 1 -- 172.21.15.154:0/3171114986 wait complete. 2023-09-30T22:25:23.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.045+0000 7f7e7113f700 1 Processor -- start 2023-09-30T22:25:23.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.045+0000 7f7e7113f700 1 -- start start 2023-09-30T22:25:23.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.045+0000 7f7e7113f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6c1300a0 0x7f7e6c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.045+0000 7f7e7113f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6c1309f0 0x7f7e6c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.045+0000 7f7e7113f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.045+0000 7f7e7113f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c120220 con 0x7f7e6c1300a0 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.045+0000 7f7e7113f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c11f060 con 0x7f7e6c1309f0 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.045+0000 7f7e7113f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c12d950 con 0x7f7e6c133ad0 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.045+0000 7f7e6b59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6b59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51196/0 (socket says 172.21.15.154:51196) 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6b59e700 1 -- 172.21.15.154:0/3059715439 learned_addr learned my addr 172.21.15.154:0/3059715439 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6a59c700 1 --2- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6c1309f0 0x7f7e6c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6ad9d700 1 --2- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6c1300a0 0x7f7e6c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6b59e700 1 -- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6c1309f0 msgr2=0x7f7e6c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6b59e700 1 --2- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6c1309f0 0x7f7e6c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6b59e700 1 -- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6c1300a0 msgr2=0x7f7e6c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6b59e700 1 --2- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6c1300a0 0x7f7e6c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6b59e700 1 -- 172.21.15.154:0/3059715439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600094a0 con 0x7f7e6c133ad0 2023-09-30T22:25:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e6b59e700 1 --2- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c11e4c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400cc50 tx=0x7f7e6400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e537fe700 1 -- 172.21.15.154:0/3059715439 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64003c00 con 0x7f7e6c133ad0 2023-09-30T22:25:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e537fe700 1 -- 172.21.15.154:0/3059715439 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64003d60 con 0x7f7e6c133ad0 2023-09-30T22:25:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e7113f700 1 -- 172.21.15.154:0/3059715439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c11fb00 con 0x7f7e6c133ad0 2023-09-30T22:25:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e537fe700 1 -- 172.21.15.154:0/3059715439 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400aa50 con 0x7f7e6c133ad0 2023-09-30T22:25:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.046+0000 7f7e7113f700 1 -- 172.21.15.154:0/3059715439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c12dd00 con 0x7f7e6c133ad0 2023-09-30T22:25:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.047+0000 7f7e537fe700 1 -- 172.21.15.154:0/3059715439 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e6400abb0 con 0x7f7e6c133ad0 2023-09-30T22:25:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.048+0000 7f7e537fe700 1 -- 172.21.15.154:0/3059715439 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e64042220 con 0x7f7e6c133ad0 2023-09-30T22:25:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.048+0000 7f7e7113f700 1 -- 172.21.15.154:0/3059715439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c04f2a0 con 0x7f7e6c133ad0 2023-09-30T22:25:23.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.054+0000 7f7e537fe700 1 -- 172.21.15.154:0/3059715439 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e6400ae60 con 0x7f7e6c133ad0 2023-09-30T22:25:23.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.147+0000 7ff55c8fb700 1 Processor -- start 2023-09-30T22:25:23.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.147+0000 7ff55c8fb700 1 -- start start 2023-09-30T22:25:23.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff55c8fb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5580a1550 0x7ff558138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff55c8fb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff558139200 0x7ff55813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff55c8fb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55809e9d0 con 0x7ff5580a0a70 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff55c8fb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55809dc00 con 0x7ff5580a1550 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff55c8fb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55809dec0 con 0x7ff558139200 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff555d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5580a1550 0x7ff558138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff556d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff558139200 0x7ff55813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff555d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5580a1550 0x7ff558138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43792/0 (socket says 172.21.15.154:43792) 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff556d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff558139200 0x7ff55813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51862/0 (socket says 172.21.15.154:51862) 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff555d9b700 1 -- 172.21.15.154:0/1932764081 learned_addr learned my addr 172.21.15.154:0/1932764081 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff556d9d700 1 -- 172.21.15.154:0/1932764081 >> v2:172.21.15.154:3300/0 conn(0x7ff5580a1550 msgr2=0x7ff558138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff556d9d700 1 --2- 172.21.15.154:0/1932764081 >> v2:172.21.15.154:3300/0 conn(0x7ff5580a1550 0x7ff558138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff556d9d700 1 -- 172.21.15.154:0/1932764081 >> v1:172.21.15.154:6789/0 conn(0x7ff5580a0a70 legacy=0x7ff5580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff556d9d700 1 -- 172.21.15.154:0/1932764081 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55809e6a0 con 0x7ff558139200 2023-09-30T22:25:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.148+0000 7ff555d9b700 1 --2- 172.21.15.154:0/1932764081 >> v2:172.21.15.154:3300/0 conn(0x7ff5580a1550 0x7ff558138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.149+0000 7ff556d9d700 1 --2- 172.21.15.154:0/1932764081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff558139200 0x7ff55813b5e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff550009d90 tx=0x7ff55000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c26347c0fe7f48d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.149+0000 7ff55559a700 1 -- 172.21.15.154:0/1932764081 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55000e070 con 0x7ff558139200 2023-09-30T22:25:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.149+0000 7ff55559a700 1 -- 172.21.15.154:0/1932764081 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55000bb20 con 0x7ff558139200 2023-09-30T22:25:23.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.149+0000 7ff55559a700 1 -- 172.21.15.154:0/1932764081 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550012430 con 0x7ff558139200 2023-09-30T22:25:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.149+0000 7ff55c8fb700 1 -- 172.21.15.154:0/1932764081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff558139200 msgr2=0x7ff55813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.149+0000 7ff55c8fb700 1 --2- 172.21.15.154:0/1932764081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff558139200 0x7ff55813b5e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff550009d90 tx=0x7ff55000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.150+0000 7ff55c8fb700 1 -- 172.21.15.154:0/1932764081 shutdown_connections 2023-09-30T22:25:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.150+0000 7ff55c8fb700 1 --2- 172.21.15.154:0/1932764081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff558139200 0x7ff55813b5e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.150+0000 7ff55c8fb700 1 --2- 172.21.15.154:0/1932764081 >> v2:172.21.15.154:3300/0 conn(0x7ff5580a1550 0x7ff558138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.150+0000 7ff55c8fb700 1 -- 172.21.15.154:0/1932764081 >> 172.21.15.154:0/1932764081 conn(0x7ff5580a6610 msgr2=0x7ff5580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.150+0000 7ff55c8fb700 1 -- 172.21.15.154:0/1932764081 shutdown_connections 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.150+0000 7ff55c8fb700 1 -- 172.21.15.154:0/1932764081 wait complete. 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.151+0000 7ff55c8fb700 1 Processor -- start 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.151+0000 7ff55c8fb700 1 -- start start 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55c8fb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5580a0a70 0x7ff55811e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55c8fb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5580a1550 0x7ff55811ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55c8fb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff558139200 0x7ff55811f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55c8fb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580a0470 con 0x7ff558139200 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55c8fb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff558122050 con 0x7ff5580a0a70 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55c8fb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff558121aa0 con 0x7ff5580a1550 2023-09-30T22:25:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5580a0a70 0x7ff55811e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5580a0a70 0x7ff55811e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51874/0 (socket says 172.21.15.154:51874) 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55659c700 1 -- 172.21.15.154:0/3473254942 learned_addr learned my addr 172.21.15.154:0/3473254942 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff555d9b700 1 --2- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5580a1550 0x7ff55811ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff556d9d700 1 --2- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff558139200 0x7ff55811f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55659c700 1 -- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5580a1550 msgr2=0x7ff55811ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55659c700 1 --2- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5580a1550 0x7ff55811ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55659c700 1 -- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff558139200 msgr2=0x7ff55811f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55659c700 1 --2- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff558139200 0x7ff55811f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.152+0000 7ff55659c700 1 -- 172.21.15.154:0/3473254942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c009550 con 0x7ff5580a0a70 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.153+0000 7ff55659c700 1 --2- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5580a0a70 0x7ff55811e8a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff54800c510 tx=0x7ff54800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.153+0000 7ff546ffd700 1 -- 172.21.15.154:0/3473254942 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480052d0 con 0x7ff5580a0a70 2023-09-30T22:25:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.153+0000 7ff546ffd700 1 -- 172.21.15.154:0/3473254942 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548005430 con 0x7ff5580a0a70 2023-09-30T22:25:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.153+0000 7ff55c8fb700 1 -- 172.21.15.154:0/3473254942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff550009a70 con 0x7ff5580a0a70 2023-09-30T22:25:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.153+0000 7ff546ffd700 1 -- 172.21.15.154:0/3473254942 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480038c0 con 0x7ff5580a0a70 2023-09-30T22:25:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.153+0000 7ff55c8fb700 1 -- 172.21.15.154:0/3473254942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff558120530 con 0x7ff5580a0a70 2023-09-30T22:25:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.154+0000 7ff55c8fb700 1 -- 172.21.15.154:0/3473254942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55804f2a0 con 0x7ff5580a0a70 2023-09-30T22:25:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.156+0000 7ff546ffd700 1 -- 172.21.15.154:0/3473254942 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff548003a20 con 0x7ff5580a0a70 2023-09-30T22:25:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.156+0000 7ff546ffd700 1 -- 172.21.15.154:0/3473254942 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff54803f130 con 0x7ff5580a0a70 2023-09-30T22:25:23.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.159+0000 7ff546ffd700 1 -- 172.21.15.154:0/3473254942 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff548018260 con 0x7ff5580a0a70 2023-09-30T22:25:23.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c220a1700 1 Processor -- start 2023-09-30T22:25:23.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c220a1700 1 -- start start 2023-09-30T22:25:23.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c220a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c098410 0x7f2c1c0987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c220a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09e410 0x7f2c1c1397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c220a1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c06f970 con 0x7f2c1c09d8f0 2023-09-30T22:25:23.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c220a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0720a0 con 0x7f2c1c09e410 2023-09-30T22:25:23.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c220a1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c072290 con 0x7f2c1c098410 2023-09-30T22:25:23.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c098410 0x7f2c1c0987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c098410 0x7f2c1c0987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51214/0 (socket says 172.21.15.154:51214) 2023-09-30T22:25:23.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09e410 0x7f2c1c1397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.171+0000 7f2c1b7fe700 1 -- 172.21.15.154:0/2892678273 learned_addr learned my addr 172.21.15.154:0/2892678273 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:23.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.172+0000 7f2c1b7fe700 1 -- 172.21.15.154:0/2892678273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09e410 msgr2=0x7f2c1c1397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:23.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.172+0000 7f2c1b7fe700 1 --2- 172.21.15.154:0/2892678273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09e410 0x7f2c1c1397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.172+0000 7f2c1b7fe700 1 -- 172.21.15.154:0/2892678273 >> v1:172.21.15.154:6789/0 conn(0x7f2c1c09d8f0 legacy=0x7f2c1c09dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.172+0000 7f2c1b7fe700 1 -- 172.21.15.154:0/2892678273 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c071530 con 0x7f2c1c098410 2023-09-30T22:25:23.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.172+0000 7f2c1bfff700 1 --2- 172.21.15.154:0/2892678273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09e410 0x7f2c1c1397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:23.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.172+0000 7f2c1b7fe700 1 --2- 172.21.15.154:0/2892678273 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c098410 0x7f2c1c0987e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0098f0 tx=0x7f2c0c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d455b87f3e57a2d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.172+0000 7f2c1a7fc700 1 -- 172.21.15.154:0/2892678273 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c005e30 con 0x7f2c1c098410 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.172+0000 7f2c1a7fc700 1 -- 172.21.15.154:0/2892678273 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c004030 con 0x7f2c1c098410 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.172+0000 7f2c1a7fc700 1 -- 172.21.15.154:0/2892678273 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0043c0 con 0x7f2c1c098410 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.173+0000 7f2c220a1700 1 -- 172.21.15.154:0/2892678273 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c098410 msgr2=0x7f2c1c0987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.173+0000 7f2c220a1700 1 --2- 172.21.15.154:0/2892678273 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c098410 0x7f2c1c0987e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0098f0 tx=0x7f2c0c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.173+0000 7f2c220a1700 1 -- 172.21.15.154:0/2892678273 shutdown_connections 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.173+0000 7f2c220a1700 1 --2- 172.21.15.154:0/2892678273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09e410 0x7f2c1c1397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.173+0000 7f2c220a1700 1 --2- 172.21.15.154:0/2892678273 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c098410 0x7f2c1c0987e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.173+0000 7f2c220a1700 1 -- 172.21.15.154:0/2892678273 >> 172.21.15.154:0/2892678273 conn(0x7f2c1c0a2b30 msgr2=0x7f2c1c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.173+0000 7f2c220a1700 1 -- 172.21.15.154:0/2892678273 shutdown_connections 2023-09-30T22:25:23.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.173+0000 7f2c220a1700 1 -- 172.21.15.154:0/2892678273 wait complete. 2023-09-30T22:25:23.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.174+0000 7f2c220a1700 1 Processor -- start 2023-09-30T22:25:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.174+0000 7f2c220a1700 1 -- start start 2023-09-30T22:25:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.174+0000 7f2c220a1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c1c098410 0x7f2c1c12b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.174+0000 7f2c220a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09d8f0 0x7f2c1c12b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.174+0000 7f2c220a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c09e410 0x7f2c1c12bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.174+0000 7f2c220a1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c12e430 con 0x7f2c1c098410 2023-09-30T22:25:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.174+0000 7f2c220a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c08b100 con 0x7f2c1c09d8f0 2023-09-30T22:25:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.174+0000 7f2c220a1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c097810 con 0x7f2c1c09e410 2023-09-30T22:25:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c1c098410 0x7f2c1c12b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c09e410 0x7f2c1c12bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c1c098410 0x7f2c1c12b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43798/0 (socket says 172.21.15.154:43798) 2023-09-30T22:25:23.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1b7fe700 1 -- 172.21.15.154:0/2073452682 learned_addr learned my addr 172.21.15.154:0/2073452682 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:23.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1affd700 1 --2- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09d8f0 0x7f2c1c12b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:23.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1bfff700 1 -- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09d8f0 msgr2=0x7f2c1c12b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1bfff700 1 --2- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09d8f0 0x7f2c1c12b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1bfff700 1 -- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c1c098410 msgr2=0x7f2c1c12b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1bfff700 1 --2- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c1c098410 0x7f2c1c12b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1bfff700 1 -- 172.21.15.154:0/2073452682 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c14009a70 con 0x7f2c1c09e410 2023-09-30T22:25:23.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c1bfff700 1 --2- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c09e410 0x7f2c1c12bd00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400b360 tx=0x7f2c1400b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:23.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c03fff700 1 -- 172.21.15.154:0/2073452682 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14015070 con 0x7f2c1c09e410 2023-09-30T22:25:23.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c03fff700 1 -- 172.21.15.154:0/2073452682 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1400be50 con 0x7f2c1c09e410 2023-09-30T22:25:23.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c220a1700 1 -- 172.21.15.154:0/2073452682 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0c009500 con 0x7f2c1c09e410 2023-09-30T22:25:23.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.175+0000 7f2c220a1700 1 -- 172.21.15.154:0/2073452682 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c12ea30 con 0x7f2c1c09e410 2023-09-30T22:25:23.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.176+0000 7f2c03fff700 1 -- 172.21.15.154:0/2073452682 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14003c40 con 0x7f2c1c09e410 2023-09-30T22:25:23.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.177+0000 7f2c220a1700 1 -- 172.21.15.154:0/2073452682 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc0052e0 con 0x7f2c1c09e410 2023-09-30T22:25:23.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.177+0000 7f2c03fff700 1 -- 172.21.15.154:0/2073452682 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c14019410 con 0x7f2c1c09e410 2023-09-30T22:25:23.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.177+0000 7f2c03fff700 1 -- 172.21.15.154:0/2073452682 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c140438e0 con 0x7f2c1c09e410 2023-09-30T22:25:23.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.177+0000 7fc6592a4700 1 -- 172.21.15.154:0/3117344855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc6540a51f0 con 0x7fc654133f50 2023-09-30T22:25:23.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.177+0000 7fc63b7fe700 1 -- 172.21.15.154:0/3117344855 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc64c012340 con 0x7fc654133f50 2023-09-30T22:25:23.183 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.180+0000 7fc6592a4700 1 -- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc654133f50 msgr2=0x7fc654122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.180+0000 7fc6592a4700 1 --2- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc654133f50 0x7fc654122dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00efc0 tx=0x7fc64c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.180+0000 7fc6592a4700 1 -- 172.21.15.154:0/3117344855 shutdown_connections 2023-09-30T22:25:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.180+0000 7fc6592a4700 1 --2- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc654133f50 0x7fc654122dd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.180+0000 7fc6592a4700 1 --2- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6540a0a70 0x7fc654122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.180+0000 7fc6592a4700 1 --2- 172.21.15.154:0/3117344855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6540a1380 0x7fc654122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.180+0000 7fc6592a4700 1 -- 172.21.15.154:0/3117344855 >> 172.21.15.154:0/3117344855 conn(0x7fc6540a6610 msgr2=0x7fc65411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.184+0000 7fc6592a4700 1 -- 172.21.15.154:0/3117344855 shutdown_connections 2023-09-30T22:25:23.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.184+0000 7fc6592a4700 1 -- 172.21.15.154:0/3117344855 wait complete. 2023-09-30T22:25:23.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.186+0000 7f2c03fff700 1 -- 172.21.15.154:0/2073452682 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c140206d0 con 0x7f2c1c09e410 2023-09-30T22:25:23.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:23.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.282+0000 7f7e7113f700 1 -- 172.21.15.154:0/3059715439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7e6c11fe80 con 0x7f7e6c133ad0 2023-09-30T22:25:23.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.282+0000 7f7e537fe700 1 -- 172.21.15.154:0/3059715439 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e64011380 con 0x7f7e6c133ad0 2023-09-30T22:25:23.283 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:23.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.285+0000 7f7e7113f700 1 -- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 msgr2=0x7f7e6c11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.285+0000 7f7e7113f700 1 --2- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c11e4c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400cc50 tx=0x7f7e6400cf60 comp rx=0 tx=0).stop 2023-09-30T22:25:23.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.285+0000 7f7e7113f700 1 -- 172.21.15.154:0/3059715439 shutdown_connections 2023-09-30T22:25:23.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.285+0000 7f7e7113f700 1 --2- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6c133ad0 0x7f7e6c11e4c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.285+0000 7f7e7113f700 1 --2- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6c1300a0 0x7f7e6c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.285+0000 7f7e7113f700 1 --2- 172.21.15.154:0/3059715439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6c1309f0 0x7f7e6c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.285+0000 7f7e7113f700 1 -- 172.21.15.154:0/3059715439 >> 172.21.15.154:0/3059715439 conn(0x7f7e6c099c40 msgr2=0x7f7e6c12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.286+0000 7f7e7113f700 1 -- 172.21.15.154:0/3059715439 shutdown_connections 2023-09-30T22:25:23.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.286+0000 7f7e7113f700 1 -- 172.21.15.154:0/3059715439 wait complete. 2023-09-30T22:25:23.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:23.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.363+0000 7ff55c8fb700 1 -- 172.21.15.154:0/3473254942 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff558120c10 con 0x7ff5580a0a70 2023-09-30T22:25:23.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.363+0000 7ff546ffd700 1 -- 172.21.15.154:0/3473254942 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff548017020 con 0x7ff5580a0a70 2023-09-30T22:25:23.364 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.366+0000 7ff55c8fb700 1 -- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5580a0a70 msgr2=0x7ff55811e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.366+0000 7ff55c8fb700 1 --2- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5580a0a70 0x7ff55811e8a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff54800c510 tx=0x7ff54800c820 comp rx=0 tx=0).stop 2023-09-30T22:25:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.366+0000 7ff55c8fb700 1 -- 172.21.15.154:0/3473254942 shutdown_connections 2023-09-30T22:25:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.366+0000 7ff55c8fb700 1 --2- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff558139200 0x7ff55811f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.366+0000 7ff55c8fb700 1 --2- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5580a0a70 0x7ff55811e8a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.366+0000 7ff55c8fb700 1 --2- 172.21.15.154:0/3473254942 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5580a1550 0x7ff55811ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.366+0000 7ff55c8fb700 1 -- 172.21.15.154:0/3473254942 >> 172.21.15.154:0/3473254942 conn(0x7ff5580a6610 msgr2=0x7ff558138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.366+0000 7ff55c8fb700 1 -- 172.21.15.154:0/3473254942 shutdown_connections 2023-09-30T22:25:23.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.366+0000 7ff55c8fb700 1 -- 172.21.15.154:0/3473254942 wait complete. 2023-09-30T22:25:23.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:23.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.405+0000 7f2c220a1700 1 -- 172.21.15.154:0/2073452682 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2bfc005590 con 0x7f2c1c09e410 2023-09-30T22:25:23.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.405+0000 7f2c03fff700 1 -- 172.21.15.154:0/2073452682 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c14020310 con 0x7f2c1c09e410 2023-09-30T22:25:23.406 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:23.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.407+0000 7f2c220a1700 1 -- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c09e410 msgr2=0x7f2c1c12bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:23.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.407+0000 7f2c220a1700 1 --2- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c09e410 0x7f2c1c12bd00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400b360 tx=0x7f2c1400b670 comp rx=0 tx=0).stop 2023-09-30T22:25:23.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.407+0000 7f2c220a1700 1 -- 172.21.15.154:0/2073452682 shutdown_connections 2023-09-30T22:25:23.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.407+0000 7f2c220a1700 1 --2- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2c1c09e410 0x7f2c1c12bd00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.407+0000 7f2c220a1700 1 --2- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c1c098410 0x7f2c1c12b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.407+0000 7f2c220a1700 1 --2- 172.21.15.154:0/2073452682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c1c09d8f0 0x7f2c1c12b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:23.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.407+0000 7f2c220a1700 1 -- 172.21.15.154:0/2073452682 >> 172.21.15.154:0/2073452682 conn(0x7f2c1c0a2b30 msgr2=0x7f2c1c09a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:23.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.407+0000 7f2c220a1700 1 -- 172.21.15.154:0/2073452682 shutdown_connections 2023-09-30T22:25:23.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:23.407+0000 7f2c220a1700 1 -- 172.21.15.154:0/2073452682 wait complete. 2023-09-30T22:25:23.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:24.198 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:24.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:24.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.336+0000 7f0268365700 1 Processor -- start 2023-09-30T22:25:24.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.336+0000 7f0268365700 1 -- start start 2023-09-30T22:25:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.336+0000 7f0268365700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009e870 0x7f026009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.336+0000 7f0268365700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02601342b0 0x7f026013be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.336+0000 7f0268365700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026006c700 con 0x7f026009f180 2023-09-30T22:25:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.336+0000 7f0268365700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026006d720 con 0x7f026009e870 2023-09-30T22:25:24.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.336+0000 7f0268365700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f026006d910 con 0x7f02601342b0 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0266101700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009e870 0x7f026009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0265900700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f026009f180 0x7f0260133ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59180/0 (socket says 172.21.15.154:59180) 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0265900700 1 -- 172.21.15.154:0/74750957 learned_addr learned my addr 172.21.15.154:0/74750957 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0266902700 1 --2- 172.21.15.154:0/74750957 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02601342b0 0x7f026013be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f02650ff700 1 -- 172.21.15.154:0/74750957 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363322361 0 0) 0x7f026006c700 con 0x7f026009f180 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f02650ff700 1 -- 172.21.15.154:0/74750957 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f024c0035b0 con 0x7f026009f180 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0266101700 1 -- 172.21.15.154:0/74750957 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02601342b0 msgr2=0x7f026013be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0266101700 1 --2- 172.21.15.154:0/74750957 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02601342b0 0x7f026013be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0266101700 1 -- 172.21.15.154:0/74750957 >> v1:172.21.15.154:6789/0 conn(0x7f026009f180 legacy=0x7f0260133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0266101700 1 -- 172.21.15.154:0/74750957 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026006c970 con 0x7f026009e870 2023-09-30T22:25:24.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0266902700 1 --2- 172.21.15.154:0/74750957 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02601342b0 0x7f026013be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f0266101700 1 --2- 172.21.15.154:0/74750957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009e870 0x7f026009ec40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098a0 tx=0x7f025c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=441a181109dcf45e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f02650ff700 1 -- 172.21.15.154:0/74750957 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c011830 con 0x7f026009e870 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f02650ff700 1 -- 172.21.15.154:0/74750957 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c011990 con 0x7f026009e870 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.337+0000 7f02650ff700 1 -- 172.21.15.154:0/74750957 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c011d20 con 0x7f026009e870 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.338+0000 7f0268365700 1 -- 172.21.15.154:0/74750957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009e870 msgr2=0x7f026009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.338+0000 7f0268365700 1 --2- 172.21.15.154:0/74750957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009e870 0x7f026009ec40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098a0 tx=0x7f025c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.338+0000 7f0268365700 1 -- 172.21.15.154:0/74750957 shutdown_connections 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.338+0000 7f0268365700 1 --2- 172.21.15.154:0/74750957 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02601342b0 0x7f026013be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.338+0000 7f0268365700 1 --2- 172.21.15.154:0/74750957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009e870 0x7f026009ec40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.338+0000 7f0268365700 1 -- 172.21.15.154:0/74750957 >> 172.21.15.154:0/74750957 conn(0x7f02600a4170 msgr2=0x7f02600a4570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.338+0000 7f0268365700 1 -- 172.21.15.154:0/74750957 shutdown_connections 2023-09-30T22:25:24.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.338+0000 7f0268365700 1 -- 172.21.15.154:0/74750957 wait complete. 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.339+0000 7f0268365700 1 Processor -- start 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.339+0000 7f0268365700 1 -- start start 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.339+0000 7f0268365700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f026009e870 0x7f0260122440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.339+0000 7f0268365700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009f180 0x7f0260122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.339+0000 7f0268365700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02601342b0 0x7f0260122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.339+0000 7f0268365700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0260125f60 con 0x7f02601342b0 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.339+0000 7f0268365700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02601259c0 con 0x7f026009f180 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.339+0000 7f0268365700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02601338d0 con 0x7f026009e870 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0266902700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02601342b0 0x7f0260122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0265900700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009f180 0x7f0260122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0266902700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02601342b0 0x7f0260122ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43804/0 (socket says 172.21.15.154:43804) 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0266902700 1 -- 172.21.15.154:0/691572670 learned_addr learned my addr 172.21.15.154:0/691572670 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0266101700 1 --2- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f026009e870 0x7f0260122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0265900700 1 -- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f026009e870 msgr2=0x7f0260122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0265900700 1 --2- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f026009e870 0x7f0260122440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0265900700 1 -- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02601342b0 msgr2=0x7f0260122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0265900700 1 --2- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02601342b0 0x7f0260122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0265900700 1 -- 172.21.15.154:0/691572670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258009a70 con 0x7f026009f180 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0266902700 1 --2- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02601342b0 0x7f0260122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0265900700 1 --2- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009f180 0x7f0260122980 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f025000c460 tx=0x7f025000c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0256ffd700 1 -- 172.21.15.154:0/691572670 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250005d70 con 0x7f026009f180 2023-09-30T22:25:24.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0256ffd700 1 -- 172.21.15.154:0/691572670 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02500070d0 con 0x7f026009f180 2023-09-30T22:25:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0268365700 1 -- 172.21.15.154:0/691572670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c0094a0 con 0x7f026009f180 2023-09-30T22:25:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0256ffd700 1 -- 172.21.15.154:0/691572670 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250007440 con 0x7f026009f180 2023-09-30T22:25:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.340+0000 7f0268365700 1 -- 172.21.15.154:0/691572670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0260124e50 con 0x7f026009f180 2023-09-30T22:25:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.341+0000 7f0256ffd700 1 -- 172.21.15.154:0/691572670 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02500075a0 con 0x7f026009f180 2023-09-30T22:25:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.341+0000 7f0256ffd700 1 -- 172.21.15.154:0/691572670 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f025003e6b0 con 0x7f026009f180 2023-09-30T22:25:24.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.341+0000 7f0268365700 1 -- 172.21.15.154:0/691572670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026004f2a0 con 0x7f026009f180 2023-09-30T22:25:24.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.350+0000 7f0256ffd700 1 -- 172.21.15.154:0/691572670 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0250017080 con 0x7f026009f180 2023-09-30T22:25:24.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:24.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.442+0000 7fe535a1d700 1 Processor -- start 2023-09-30T22:25:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.442+0000 7fe535a1d700 1 -- start start 2023-09-30T22:25:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe535a1d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530136960 0x7fe530138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe535a1d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe530139280 0x7fe53013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe535a1d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53006b2d0 con 0x7fe530133ad0 2023-09-30T22:25:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe535a1d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5301345b0 con 0x7fe530136960 2023-09-30T22:25:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe535a1d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe530133610 con 0x7fe530139280 2023-09-30T22:25:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52effd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe530133ad0 0x7fe530133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59190/0 (socket says 172.21.15.154:59190) 2023-09-30T22:25:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52effd700 1 -- 172.21.15.154:0/2352980552 learned_addr learned my addr 172.21.15.154:0/2352980552 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195436726 0 0) 0x7fe53006b2d0 con 0x7fe530133ad0 2023-09-30T22:25:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5180035b0 con 0x7fe530133ad0 2023-09-30T22:25:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3189095817 0 0) 0x7fe5180035b0 con 0x7fe530133ad0 2023-09-30T22:25:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe530139280 msgr2=0x7fe53013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52dffb700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe530139280 0x7fe53013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530136960 msgr2=0x7fe530138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52dffb700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530136960 0x7fe530138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53009a500 con 0x7fe530133ad0 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.443+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147001391 0 0) 0x7fe520001670 con 0x7fe530133ad0 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 >> v1:172.21.15.154:6789/0 conn(0x7fe530133ad0 legacy=0x7fe530133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52dffb700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518003a70 0x7fe518003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52dffb700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530136960 0x7fe518004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52dffb700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe518004e60 0x7fe5180052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5301345b0 con 0x7fe518004e60 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe530133610 con 0x7fe530136960 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe51800bd40 con 0x7fe518003a70 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52effd700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518003a70 0x7fe518003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52e7fc700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530136960 0x7fe518004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52f7fe700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe518004e60 0x7fe5180052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52e7fc700 1 -- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518003a70 msgr2=0x7fe518003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52e7fc700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518003a70 0x7fe518003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52e7fc700 1 -- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe518004e60 msgr2=0x7fe5180052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52e7fc700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe518004e60 0x7fe5180052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52e7fc700 1 -- 172.21.15.154:0/2352980552 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5180035b0 con 0x7fe530136960 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.444+0000 7fe52f7fe700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe518004e60 0x7fe5180052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.445+0000 7fe52e7fc700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530136960 0x7fe518004850 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe524009910 tx=0x7fe518005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d226a590861fdc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.445+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011620 con 0x7fe530136960 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.445+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524011780 con 0x7fe530136960 2023-09-30T22:25:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.445+0000 7fe52dffb700 1 -- 172.21.15.154:0/2352980552 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011b10 con 0x7fe530136960 2023-09-30T22:25:24.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.446+0000 7fe535a1d700 1 -- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530136960 msgr2=0x7fe518004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.446+0000 7fe535a1d700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530136960 0x7fe518004850 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe524009910 tx=0x7fe518005880 comp rx=0 tx=0).stop 2023-09-30T22:25:24.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.447+0000 7fe535a1d700 1 -- 172.21.15.154:0/2352980552 shutdown_connections 2023-09-30T22:25:24.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.447+0000 7fe535a1d700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe518004e60 0x7fe5180052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.447+0000 7fe535a1d700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530136960 0x7fe518004850 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.447+0000 7fe535a1d700 1 --2- 172.21.15.154:0/2352980552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518003a70 0x7fe518003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.447+0000 7fe535a1d700 1 -- 172.21.15.154:0/2352980552 >> 172.21.15.154:0/2352980552 conn(0x7fe530099c40 msgr2=0x7fe5300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.448+0000 7fe535a1d700 1 -- 172.21.15.154:0/2352980552 shutdown_connections 2023-09-30T22:25:24.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.448+0000 7fe535a1d700 1 -- 172.21.15.154:0/2352980552 wait complete. 2023-09-30T22:25:24.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.449+0000 7fe535a1d700 1 Processor -- start 2023-09-30T22:25:24.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.449+0000 7fe535a1d700 1 -- start start 2023-09-30T22:25:24.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe535a1d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518004e60 0x7fe53012ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe535a1d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530133ad0 0x7fe53012f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe535a1d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe530136960 0x7fe53012f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe535a1d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53012a640 con 0x7fe530136960 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe535a1d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53012c9b0 con 0x7fe530133ad0 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe535a1d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe53012bdd0 con 0x7fe518004e60 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518004e60 0x7fe53012ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518004e60 0x7fe53012ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51278/0 (socket says 172.21.15.154:51278) 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52effd700 1 -- 172.21.15.154:0/3963806351 learned_addr learned my addr 172.21.15.154:0/3963806351 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52f7fe700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe530136960 0x7fe53012f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52e7fc700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530133ad0 0x7fe53012f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52effd700 1 -- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530133ad0 msgr2=0x7fe53012f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52effd700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530133ad0 0x7fe53012f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52effd700 1 -- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe530136960 msgr2=0x7fe53012f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52effd700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe530136960 0x7fe53012f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52effd700 1 -- 172.21.15.154:0/3963806351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53012b830 con 0x7fe518004e60 2023-09-30T22:25:24.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52f7fe700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe530136960 0x7fe53012f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:24.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.450+0000 7fe52effd700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518004e60 0x7fe53012ed50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe52000e780 tx=0x7fe52000eb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.451+0000 7fe517fff700 1 -- 172.21.15.154:0/3963806351 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520010510 con 0x7fe518004e60 2023-09-30T22:25:24.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.451+0000 7fe517fff700 1 -- 172.21.15.154:0/3963806351 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5200106b0 con 0x7fe518004e60 2023-09-30T22:25:24.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.451+0000 7fe535a1d700 1 -- 172.21.15.154:0/3963806351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe530139070 con 0x7fe518004e60 2023-09-30T22:25:24.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.451+0000 7fe517fff700 1 -- 172.21.15.154:0/3963806351 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520010a60 con 0x7fe518004e60 2023-09-30T22:25:24.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.451+0000 7fe535a1d700 1 -- 172.21.15.154:0/3963806351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53012dd50 con 0x7fe518004e60 2023-09-30T22:25:24.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.452+0000 7fe517fff700 1 -- 172.21.15.154:0/3963806351 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe520010bc0 con 0x7fe518004e60 2023-09-30T22:25:24.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.452+0000 7fe517fff700 1 -- 172.21.15.154:0/3963806351 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe52003f040 con 0x7fe518004e60 2023-09-30T22:25:24.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.452+0000 7fe535a1d700 1 -- 172.21.15.154:0/3963806351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5100052e0 con 0x7fe518004e60 2023-09-30T22:25:24.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.460+0000 7fe517fff700 1 -- 172.21.15.154:0/3963806351 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe52001b2c0 con 0x7fe518004e60 2023-09-30T22:25:24.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.524+0000 7f52cd2fd700 1 Processor -- start 2023-09-30T22:25:24.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.524+0000 7f52cd2fd700 1 -- start start 2023-09-30T22:25:24.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52cd2fd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52c809e870 0x7f52c809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52cd2fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c8134330 0x7f52c813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52cd2fd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c809fa00 con 0x7f52c809f180 2023-09-30T22:25:24.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52cd2fd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c80a0370 con 0x7f52c809e870 2023-09-30T22:25:24.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52cd2fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c806bec0 con 0x7f52c8134330 2023-09-30T22:25:24.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52c6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52c809e870 0x7f52c809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52c6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52c809e870 0x7f52c809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43838/0 (socket says 172.21.15.154:43838) 2023-09-30T22:25:24.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52c6ffd700 1 -- 172.21.15.154:0/1091198952 learned_addr learned my addr 172.21.15.154:0/1091198952 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:24.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52c6ffd700 1 -- 172.21.15.154:0/1091198952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c8134330 msgr2=0x7f52c813be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52c6ffd700 1 --2- 172.21.15.154:0/1091198952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c8134330 0x7f52c813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52c6ffd700 1 -- 172.21.15.154:0/1091198952 >> v1:172.21.15.154:6789/0 conn(0x7f52c809f180 legacy=0x7f52c8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52c6ffd700 1 -- 172.21.15.154:0/1091198952 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c809ada0 con 0x7f52c809e870 2023-09-30T22:25:24.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.525+0000 7f52c5ffb700 1 -- 172.21.15.154:0/1091198952 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784589916 0 0) 0x7f52c809fa00 con 0x7f52c809f180 2023-09-30T22:25:24.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.526+0000 7f52c6ffd700 1 --2- 172.21.15.154:0/1091198952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809e870 0x7f52c809ec40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f52b80098f0 tx=0x7f52b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dba7e9da6b4ead3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.526+0000 7f52c5ffb700 1 -- 172.21.15.154:0/1091198952 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b800b8a0 con 0x7f52c809e870 2023-09-30T22:25:24.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.526+0000 7f52c5ffb700 1 -- 172.21.15.154:0/1091198952 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b800ba00 con 0x7f52c809e870 2023-09-30T22:25:24.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.526+0000 7f52c5ffb700 1 -- 172.21.15.154:0/1091198952 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b800bd90 con 0x7f52c809e870 2023-09-30T22:25:24.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.527+0000 7f52cd2fd700 1 -- 172.21.15.154:0/1091198952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809e870 msgr2=0x7f52c809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.527+0000 7f52cd2fd700 1 --2- 172.21.15.154:0/1091198952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809e870 0x7f52c809ec40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f52b80098f0 tx=0x7f52b8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:24.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.527+0000 7f52cd2fd700 1 -- 172.21.15.154:0/1091198952 shutdown_connections 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.527+0000 7f52cd2fd700 1 --2- 172.21.15.154:0/1091198952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c8134330 0x7f52c813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.527+0000 7f52cd2fd700 1 --2- 172.21.15.154:0/1091198952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809e870 0x7f52c809ec40 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.527+0000 7f52cd2fd700 1 -- 172.21.15.154:0/1091198952 >> 172.21.15.154:0/1091198952 conn(0x7f52c80a4430 msgr2=0x7f52c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.527+0000 7f52cd2fd700 1 -- 172.21.15.154:0/1091198952 shutdown_connections 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.527+0000 7f52cd2fd700 1 -- 172.21.15.154:0/1091198952 wait complete. 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.528+0000 7f52cd2fd700 1 Processor -- start 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.528+0000 7f52cd2fd700 1 -- start start 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.528+0000 7f52cd2fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52c809e870 0x7f52c8122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.528+0000 7f52cd2fd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809f180 0x7f52c8122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52cd2fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c8134330 0x7f52c8123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52cd2fd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c81260d0 con 0x7f52c809f180 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52cd2fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c81245b0 con 0x7f52c8134330 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52cd2fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c80a16a0 con 0x7f52c809e870 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52c809e870 0x7f52c8122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52c809e870 0x7f52c8122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51286/0 (socket says 172.21.15.154:51286) 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c6ffd700 1 -- 172.21.15.154:0/415821454 learned_addr learned my addr 172.21.15.154:0/415821454 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c67fc700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809f180 0x7f52c8122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c77fe700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c8134330 0x7f52c8123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c6ffd700 1 -- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c8134330 msgr2=0x7f52c8123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c6ffd700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c8134330 0x7f52c8123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c6ffd700 1 -- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809f180 msgr2=0x7f52c8122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c6ffd700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809f180 0x7f52c8122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c6ffd700 1 -- 172.21.15.154:0/415821454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009550 con 0x7f52c809e870 2023-09-30T22:25:24.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c67fc700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809f180 0x7f52c8122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52c6ffd700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52c809e870 0x7f52c8122890 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009c40 tx=0x7f52b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.529+0000 7f52af7fe700 1 -- 172.21.15.154:0/415821454 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8004380 con 0x7f52c809e870 2023-09-30T22:25:24.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.530+0000 7f52af7fe700 1 -- 172.21.15.154:0/415821454 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b801f070 con 0x7f52c809e870 2023-09-30T22:25:24.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.530+0000 7f52cd2fd700 1 -- 172.21.15.154:0/415821454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c806cfa0 con 0x7f52c809e870 2023-09-30T22:25:24.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.530+0000 7f52af7fe700 1 -- 172.21.15.154:0/415821454 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80036a0 con 0x7f52c809e870 2023-09-30T22:25:24.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.530+0000 7f52cd2fd700 1 -- 172.21.15.154:0/415821454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c8126b40 con 0x7f52c809e870 2023-09-30T22:25:24.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.531+0000 7f52cd2fd700 1 -- 172.21.15.154:0/415821454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c804f2a0 con 0x7f52c809e870 2023-09-30T22:25:24.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.531+0000 7f52af7fe700 1 -- 172.21.15.154:0/415821454 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52b8021030 con 0x7f52c809e870 2023-09-30T22:25:24.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.532+0000 7f52af7fe700 1 -- 172.21.15.154:0/415821454 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f52b8040fb0 con 0x7f52c809e870 2023-09-30T22:25:24.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.536+0000 7f52af7fe700 1 -- 172.21.15.154:0/415821454 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52b80239c0 con 0x7f52c809e870 2023-09-30T22:25:24.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.587+0000 7f81a0a21700 1 Processor -- start 2023-09-30T22:25:24.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.587+0000 7f81a0a21700 1 -- start start 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.587+0000 7f81a0a21700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c12d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.587+0000 7f81a0a21700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f819c130120 0x7f819c130570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.587+0000 7f81a0a21700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130ab0 0x7f819c137470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.587+0000 7f81a0a21700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c130f20 con 0x7f819c130120 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.587+0000 7f81a0a21700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c09b180 con 0x7f819c130ab0 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.587+0000 7f81a0a21700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f819c09ebd0 con 0x7f819c09e800 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130ab0 0x7f819c137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130ab0 0x7f819c137470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51974/0 (socket says 172.21.15.154:51974) 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819ad9d700 1 -- 172.21.15.154:0/3090336081 learned_addr learned my addr 172.21.15.154:0/3090336081 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:24.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c12d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f8199d9b700 1 --2- 172.21.15.154:0/3090336081 >> v2:172.21.15.154:3300/0 conn(0x7f819c130120 0x7f819c130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819ad9d700 1 -- 172.21.15.154:0/3090336081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 msgr2=0x7f819c12d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819ad9d700 1 --2- 172.21.15.154:0/3090336081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c12d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819ad9d700 1 -- 172.21.15.154:0/3090336081 >> v2:172.21.15.154:3300/0 conn(0x7f819c130120 msgr2=0x7f819c130570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819ad9d700 1 --2- 172.21.15.154:0/3090336081 >> v2:172.21.15.154:3300/0 conn(0x7f819c130120 0x7f819c130570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819ad9d700 1 -- 172.21.15.154:0/3090336081 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c09b440 con 0x7f819c130ab0 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819a59c700 1 --2- 172.21.15.154:0/3090336081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c12d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f8199d9b700 1 --2- 172.21.15.154:0/3090336081 >> v2:172.21.15.154:3300/0 conn(0x7f819c130120 0x7f819c130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819ad9d700 1 --2- 172.21.15.154:0/3090336081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130ab0 0x7f819c137470 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8194009e50 tx=0x7f819400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78ac071de9602cb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.588+0000 7f819959a700 1 -- 172.21.15.154:0/3090336081 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819400e070 con 0x7f819c130ab0 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.589+0000 7f819959a700 1 -- 172.21.15.154:0/3090336081 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819400b910 con 0x7f819c130ab0 2023-09-30T22:25:24.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.589+0000 7f819959a700 1 -- 172.21.15.154:0/3090336081 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819400bcc0 con 0x7f819c130ab0 2023-09-30T22:25:24.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.589+0000 7f81a0a21700 1 -- 172.21.15.154:0/3090336081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130ab0 msgr2=0x7f819c137470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.589+0000 7f81a0a21700 1 --2- 172.21.15.154:0/3090336081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130ab0 0x7f819c137470 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8194009e50 tx=0x7f819400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:24.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.589+0000 7f81a0a21700 1 -- 172.21.15.154:0/3090336081 shutdown_connections 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.589+0000 7f81a0a21700 1 --2- 172.21.15.154:0/3090336081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130ab0 0x7f819c137470 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.589+0000 7f81a0a21700 1 --2- 172.21.15.154:0/3090336081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c12d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.589+0000 7f81a0a21700 1 --2- 172.21.15.154:0/3090336081 >> v2:172.21.15.154:3300/0 conn(0x7f819c130120 0x7f819c130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.589+0000 7f81a0a21700 1 -- 172.21.15.154:0/3090336081 >> 172.21.15.154:0/3090336081 conn(0x7f819c0a2ef0 msgr2=0x7f819c0a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.590+0000 7f81a0a21700 1 -- 172.21.15.154:0/3090336081 shutdown_connections 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.590+0000 7f81a0a21700 1 -- 172.21.15.154:0/3090336081 wait complete. 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.591+0000 7f81a0a21700 1 Processor -- start 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.591+0000 7f81a0a21700 1 -- start start 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f81a0a21700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c11d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f81a0a21700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130120 0x7f819c11de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f81a0a21700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f819c130ab0 0x7f819c11e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f81a0a21700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c12a520 con 0x7f819c130ab0 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f81a0a21700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c11fd60 con 0x7f819c130120 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f81a0a21700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0721e0 con 0x7f819c09e800 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f819ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f819c130ab0 0x7f819c11e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f819ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f819c130ab0 0x7f819c11e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43872/0 (socket says 172.21.15.154:43872) 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f819a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c11d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f819ad9d700 1 -- 172.21.15.154:0/3476535684 learned_addr learned my addr 172.21.15.154:0/3476535684 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.592+0000 7f8199d9b700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130120 0x7f819c11de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f819a59c700 1 -- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130120 msgr2=0x7f819c11de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f819a59c700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130120 0x7f819c11de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f819a59c700 1 -- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f819c130ab0 msgr2=0x7f819c11e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f819a59c700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f819c130ab0 0x7f819c11e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f819a59c700 1 -- 172.21.15.154:0/3476535684 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c00b740 con 0x7f819c09e800 2023-09-30T22:25:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f819ad9d700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f819c130ab0 0x7f819c11e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f8199d9b700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130120 0x7f819c11de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f819a59c700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c11d950 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f818c00eda0 tx=0x7f818c00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f818affd700 1 -- 172.21.15.154:0/3476535684 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c00dd90 con 0x7f819c09e800 2023-09-30T22:25:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f81a0a21700 1 -- 172.21.15.154:0/3476535684 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81900094a0 con 0x7f819c09e800 2023-09-30T22:25:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f81a0a21700 1 -- 172.21.15.154:0/3476535684 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8194009b30 con 0x7f819c09e800 2023-09-30T22:25:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f818affd700 1 -- 172.21.15.154:0/3476535684 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c010440 con 0x7f819c09e800 2023-09-30T22:25:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.593+0000 7f818affd700 1 -- 172.21.15.154:0/3476535684 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0107f0 con 0x7f819c09e800 2023-09-30T22:25:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.594+0000 7f81a0a21700 1 -- 172.21.15.154:0/3476535684 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81800052e0 con 0x7f819c09e800 2023-09-30T22:25:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.594+0000 7f818affd700 1 -- 172.21.15.154:0/3476535684 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f818c010950 con 0x7f819c09e800 2023-09-30T22:25:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.595+0000 7f818affd700 1 -- 172.21.15.154:0/3476535684 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f818c03fd20 con 0x7f819c09e800 2023-09-30T22:25:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.602+0000 7f0268365700 1 -- 172.21.15.154:0/691572670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f026006ba10 con 0x7f026009f180 2023-09-30T22:25:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.603+0000 7f0256ffd700 1 -- 172.21.15.154:0/691572670 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0250018af0 con 0x7f026009f180 2023-09-30T22:25:24.604 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.603+0000 7f818affd700 1 -- 172.21.15.154:0/3476535684 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f818c044070 con 0x7f819c09e800 2023-09-30T22:25:24.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.605+0000 7f0268365700 1 -- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009f180 msgr2=0x7f0260122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.605+0000 7f0268365700 1 --2- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009f180 0x7f0260122980 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f025000c460 tx=0x7f025000c770 comp rx=0 tx=0).stop 2023-09-30T22:25:24.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.607+0000 7f0268365700 1 -- 172.21.15.154:0/691572670 shutdown_connections 2023-09-30T22:25:24.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.607+0000 7f0268365700 1 --2- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02601342b0 0x7f0260122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.607+0000 7f0268365700 1 --2- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f026009e870 0x7f0260122440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.607+0000 7f0268365700 1 --2- 172.21.15.154:0/691572670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f026009f180 0x7f0260122980 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.607+0000 7f0268365700 1 -- 172.21.15.154:0/691572670 >> 172.21.15.154:0/691572670 conn(0x7f02600a4170 msgr2=0x7f026009dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.607+0000 7f0268365700 1 -- 172.21.15.154:0/691572670 shutdown_connections 2023-09-30T22:25:24.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.607+0000 7f0268365700 1 -- 172.21.15.154:0/691572670 wait complete. 2023-09-30T22:25:24.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:24.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.690+0000 7fe535a1d700 1 -- 172.21.15.154:0/3963806351 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe510005590 con 0x7fe518004e60 2023-09-30T22:25:24.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.690+0000 7fe517fff700 1 -- 172.21.15.154:0/3963806351 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe520026070 con 0x7fe518004e60 2023-09-30T22:25:24.691 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:24.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.693+0000 7fe535a1d700 1 -- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518004e60 msgr2=0x7fe53012ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.693+0000 7fe535a1d700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518004e60 0x7fe53012ed50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe52000e780 tx=0x7fe52000eb40 comp rx=0 tx=0).stop 2023-09-30T22:25:24.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.693+0000 7fe535a1d700 1 -- 172.21.15.154:0/3963806351 shutdown_connections 2023-09-30T22:25:24.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.693+0000 7fe535a1d700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe530136960 0x7fe53012f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.693+0000 7fe535a1d700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe518004e60 0x7fe53012ed50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.693+0000 7fe535a1d700 1 --2- 172.21.15.154:0/3963806351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe530133ad0 0x7fe53012f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.693+0000 7fe535a1d700 1 -- 172.21.15.154:0/3963806351 >> 172.21.15.154:0/3963806351 conn(0x7fe530099c40 msgr2=0x7fe530132e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.693+0000 7fe535a1d700 1 -- 172.21.15.154:0/3963806351 shutdown_connections 2023-09-30T22:25:24.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.693+0000 7fe535a1d700 1 -- 172.21.15.154:0/3963806351 wait complete. 2023-09-30T22:25:24.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:24.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.754+0000 7f52cd2fd700 1 -- 172.21.15.154:0/415821454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52c8072d60 con 0x7f52c809e870 2023-09-30T22:25:24.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.754+0000 7f52af7fe700 1 -- 172.21.15.154:0/415821454 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52b80233d0 con 0x7f52c809e870 2023-09-30T22:25:24.755 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:24.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.756+0000 7f52cd2fd700 1 -- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52c809e870 msgr2=0x7f52c8122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.756+0000 7f52cd2fd700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52c809e870 0x7f52c8122890 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009c40 tx=0x7f52b8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:24.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.756+0000 7f52cd2fd700 1 -- 172.21.15.154:0/415821454 shutdown_connections 2023-09-30T22:25:24.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.756+0000 7f52cd2fd700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c8134330 0x7f52c8123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.756+0000 7f52cd2fd700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f52c809e870 0x7f52c8122890 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.756+0000 7f52cd2fd700 1 --2- 172.21.15.154:0/415821454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c809f180 0x7f52c8122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.756+0000 7f52cd2fd700 1 -- 172.21.15.154:0/415821454 >> 172.21.15.154:0/415821454 conn(0x7f52c80a4430 msgr2=0x7f52c8070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.756+0000 7f52cd2fd700 1 -- 172.21.15.154:0/415821454 shutdown_connections 2023-09-30T22:25:24.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.756+0000 7f52cd2fd700 1 -- 172.21.15.154:0/415821454 wait complete. 2023-09-30T22:25:24.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:24.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.807+0000 7f81a0a21700 1 -- 172.21.15.154:0/3476535684 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8180005590 con 0x7f819c09e800 2023-09-30T22:25:24.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.807+0000 7f818affd700 1 -- 172.21.15.154:0/3476535684 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f818c017b40 con 0x7f819c09e800 2023-09-30T22:25:24.808 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:24.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.809+0000 7f81a0a21700 1 -- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 msgr2=0x7f819c11d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:24.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.809+0000 7f81a0a21700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c11d950 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f818c00eda0 tx=0x7f818c00d630 comp rx=0 tx=0).stop 2023-09-30T22:25:24.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.809+0000 7f81a0a21700 1 -- 172.21.15.154:0/3476535684 shutdown_connections 2023-09-30T22:25:24.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.809+0000 7f81a0a21700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f819c130ab0 0x7f819c11e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.809+0000 7f81a0a21700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f819c09e800 0x7f819c11d950 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.809+0000 7f81a0a21700 1 --2- 172.21.15.154:0/3476535684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f819c130120 0x7f819c11de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:24.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.809+0000 7f81a0a21700 1 -- 172.21.15.154:0/3476535684 >> 172.21.15.154:0/3476535684 conn(0x7f819c0a2ef0 msgr2=0x7f819c12e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:24.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.809+0000 7f81a0a21700 1 -- 172.21.15.154:0/3476535684 shutdown_connections 2023-09-30T22:25:24.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:24.809+0000 7f81a0a21700 1 -- 172.21.15.154:0/3476535684 wait complete. 2023-09-30T22:25:24.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:25.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:25.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.755+0000 7f4292220700 1 Processor -- start 2023-09-30T22:25:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.755+0000 7f4292220700 1 -- start start 2023-09-30T22:25:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f4292220700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c09e870 0x7f428c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f4292220700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f428c09f180 0x7f428c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f4292220700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c09c970 con 0x7f428c131d70 2023-09-30T22:25:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f4292220700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c0a0920 con 0x7f428c09f180 2023-09-30T22:25:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f4292220700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c09f9c0 con 0x7f428c09e870 2023-09-30T22:25:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f428affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f428c09f180 0x7f428c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f428b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c09e870 0x7f428c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f428affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f428c09f180 0x7f428c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45646/0 (socket says 172.21.15.154:45646) 2023-09-30T22:25:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f428affd700 1 -- 172.21.15.154:0/4001057205 learned_addr learned my addr 172.21.15.154:0/4001057205 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f428affd700 1 -- 172.21.15.154:0/4001057205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c09e870 msgr2=0x7f428c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f428affd700 1 --2- 172.21.15.154:0/4001057205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c09e870 0x7f428c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f428affd700 1 -- 172.21.15.154:0/4001057205 >> v1:172.21.15.154:6789/0 conn(0x7f428c131d70 legacy=0x7f428c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f428affd700 1 -- 172.21.15.154:0/4001057205 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c09bab0 con 0x7f428c09f180 2023-09-30T22:25:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.756+0000 7f428b7fe700 1 --2- 172.21.15.154:0/4001057205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c09e870 0x7f428c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f428affd700 1 --2- 172.21.15.154:0/4001057205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 0x7f428c131830 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f42740098f0 tx=0x7f4274009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f65a7ba98399c1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f428a7fc700 1 -- 172.21.15.154:0/4001057205 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274011830 con 0x7f428c09f180 2023-09-30T22:25:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f428a7fc700 1 -- 172.21.15.154:0/4001057205 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274011990 con 0x7f428c09f180 2023-09-30T22:25:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f428a7fc700 1 -- 172.21.15.154:0/4001057205 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274011d20 con 0x7f428c09f180 2023-09-30T22:25:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f4292220700 1 -- 172.21.15.154:0/4001057205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 msgr2=0x7f428c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f4292220700 1 --2- 172.21.15.154:0/4001057205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 0x7f428c131830 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f42740098f0 tx=0x7f4274009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f4292220700 1 -- 172.21.15.154:0/4001057205 shutdown_connections 2023-09-30T22:25:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f4292220700 1 --2- 172.21.15.154:0/4001057205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c09e870 0x7f428c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f4292220700 1 --2- 172.21.15.154:0/4001057205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 0x7f428c131830 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f4292220700 1 -- 172.21.15.154:0/4001057205 >> 172.21.15.154:0/4001057205 conn(0x7f428c0a4430 msgr2=0x7f428c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f4292220700 1 -- 172.21.15.154:0/4001057205 shutdown_connections 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.757+0000 7f4292220700 1 -- 172.21.15.154:0/4001057205 wait complete. 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.758+0000 7f4292220700 1 Processor -- start 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.758+0000 7f4292220700 1 -- start start 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f4292220700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f428c09e870 0x7f428c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f4292220700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 0x7f428c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f4292220700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c131d70 0x7f428c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f4292220700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c06d4c0 con 0x7f428c09f180 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f4292220700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c09dc10 con 0x7f428c131d70 2023-09-30T22:25:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f4292220700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f428c06cd10 con 0x7f428c09e870 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 0x7f428c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 0x7f428c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45656/0 (socket says 172.21.15.154:45656) 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428affd700 1 -- 172.21.15.154:0/1035866275 learned_addr learned my addr 172.21.15.154:0/1035866275 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428bfff700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c131d70 0x7f428c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428b7fe700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f428c09e870 0x7f428c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428bfff700 1 -- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f428c09e870 msgr2=0x7f428c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428bfff700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f428c09e870 0x7f428c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428bfff700 1 -- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 msgr2=0x7f428c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428bfff700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 0x7f428c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428bfff700 1 -- 172.21.15.154:0/1035866275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c009a70 con 0x7f428c131d70 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.759+0000 7f428affd700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 0x7f428c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.760+0000 7f428bfff700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c131d70 0x7f428c06c330 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4284001eb0 tx=0x7f428400c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.760+0000 7f4283fff700 1 -- 172.21.15.154:0/1035866275 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840052d0 con 0x7f428c131d70 2023-09-30T22:25:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.760+0000 7f4283fff700 1 -- 172.21.15.154:0/1035866275 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4284005430 con 0x7f428c131d70 2023-09-30T22:25:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.760+0000 7f4292220700 1 -- 172.21.15.154:0/1035866275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4274009550 con 0x7f428c131d70 2023-09-30T22:25:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.760+0000 7f4283fff700 1 -- 172.21.15.154:0/1035866275 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840038c0 con 0x7f428c131d70 2023-09-30T22:25:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.760+0000 7f4292220700 1 -- 172.21.15.154:0/1035866275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c0a2e50 con 0x7f428c131d70 2023-09-30T22:25:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.760+0000 7f4283fff700 1 -- 172.21.15.154:0/1035866275 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4284003a20 con 0x7f428c131d70 2023-09-30T22:25:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.761+0000 7f4283fff700 1 -- 172.21.15.154:0/1035866275 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f428403ea10 con 0x7f428c131d70 2023-09-30T22:25:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.761+0000 7f4292220700 1 -- 172.21.15.154:0/1035866275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c04f2a0 con 0x7f428c131d70 2023-09-30T22:25:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.765+0000 7f4283fff700 1 -- 172.21.15.154:0/1035866275 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4284017080 con 0x7f428c131d70 2023-09-30T22:25:25.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:25.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:25.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.842+0000 7fc1770bc700 1 Processor -- start 2023-09-30T22:25:25.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.842+0000 7fc1770bc700 1 -- start start 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc1770bc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc170133ad0 0x7fc170133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc1770bc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc1770bc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1701309f0 0x7fc17013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc1770bc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17006b2d0 con 0x7fc170133ad0 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc1770bc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc170133610 con 0x7fc1701309f0 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc1770bc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc17009a500 con 0x7fc1701300a0 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc174e58700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc170133ad0 0x7fc170133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc174e58700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc170133ad0 0x7fc170133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45660/0 (socket says 172.21.15.154:45660) 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc174e58700 1 -- 172.21.15.154:0/4231453520 learned_addr learned my addr 172.21.15.154:0/4231453520 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc175659700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1701309f0 0x7fc17013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc16ffff700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc174e58700 1 -- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 msgr2=0x7fc1701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc174e58700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1701304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc174e58700 1 -- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1701309f0 msgr2=0x7fc17013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc174e58700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1701309f0 0x7fc17013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc174e58700 1 -- 172.21.15.154:0/4231453520 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1701338b0 con 0x7fc170133ad0 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc175659700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1701309f0 0x7fc17013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.843+0000 7fc174e58700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc170133ad0 0x7fc170133ea0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc1640098f0 tx=0x7fc164009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b52191e289c012 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc16f7fe700 1 -- 172.21.15.154:0/4231453520 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164011830 con 0x7fc170133ad0 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc16f7fe700 1 -- 172.21.15.154:0/4231453520 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164011990 con 0x7fc170133ad0 2023-09-30T22:25:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc16f7fe700 1 -- 172.21.15.154:0/4231453520 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164011d20 con 0x7fc170133ad0 2023-09-30T22:25:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc1770bc700 1 -- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc170133ad0 msgr2=0x7fc170133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc1770bc700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc170133ad0 0x7fc170133ea0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc1640098f0 tx=0x7fc164009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc1770bc700 1 -- 172.21.15.154:0/4231453520 shutdown_connections 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc1770bc700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1701309f0 0x7fc17013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc1770bc700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc170133ad0 0x7fc170133ea0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc1770bc700 1 --2- 172.21.15.154:0/4231453520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc1770bc700 1 -- 172.21.15.154:0/4231453520 >> 172.21.15.154:0/4231453520 conn(0x7fc170099c40 msgr2=0x7fc1700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc1770bc700 1 -- 172.21.15.154:0/4231453520 shutdown_connections 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.844+0000 7fc1770bc700 1 -- 172.21.15.154:0/4231453520 wait complete. 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.845+0000 7fc1770bc700 1 Processor -- start 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.846+0000 7fc1770bc700 1 -- start start 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.846+0000 7fc1770bc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1700717d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.846+0000 7fc1770bc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1701309f0 0x7fc170071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.846+0000 7fc1770bc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170133ad0 0x7fc1701cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.846+0000 7fc1770bc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17006ea10 con 0x7fc1701309f0 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.846+0000 7fc1770bc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17012dd00 con 0x7fc170133ad0 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.846+0000 7fc1770bc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc17011d5e0 con 0x7fc1701300a0 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc174e58700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1700717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc174e58700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1700717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35700/0 (socket says 172.21.15.154:35700) 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc174e58700 1 -- 172.21.15.154:0/2766098311 learned_addr learned my addr 172.21.15.154:0/2766098311 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc16ffff700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1701309f0 0x7fc170071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc175659700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170133ad0 0x7fc1701cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc174e58700 1 -- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170133ad0 msgr2=0x7fc1701cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc174e58700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170133ad0 0x7fc1701cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc174e58700 1 -- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1701309f0 msgr2=0x7fc170071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc174e58700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1701309f0 0x7fc170071d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc174e58700 1 -- 172.21.15.154:0/2766098311 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168009a70 con 0x7fc1701300a0 2023-09-30T22:25:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc175659700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170133ad0 0x7fc1701cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc174e58700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1700717d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc164000c00 tx=0x7fc164004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc16d7fa700 1 -- 172.21.15.154:0/2766098311 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164004450 con 0x7fc1701300a0 2023-09-30T22:25:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc16d7fa700 1 -- 172.21.15.154:0/2766098311 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640045d0 con 0x7fc1701300a0 2023-09-30T22:25:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc1770bc700 1 -- 172.21.15.154:0/2766098311 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc164009550 con 0x7fc1701300a0 2023-09-30T22:25:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc16d7fa700 1 -- 172.21.15.154:0/2766098311 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640038e0 con 0x7fc1701300a0 2023-09-30T22:25:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.847+0000 7fc1770bc700 1 -- 172.21.15.154:0/2766098311 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17006eff0 con 0x7fc1701300a0 2023-09-30T22:25:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.848+0000 7fc16d7fa700 1 -- 172.21.15.154:0/2766098311 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc164021070 con 0x7fc1701300a0 2023-09-30T22:25:25.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.849+0000 7fc16d7fa700 1 -- 172.21.15.154:0/2766098311 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc164040a40 con 0x7fc1701300a0 2023-09-30T22:25:25.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.849+0000 7fc1770bc700 1 -- 172.21.15.154:0/2766098311 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc170131760 con 0x7fc1701300a0 2023-09-30T22:25:25.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.854+0000 7fc16d7fa700 1 -- 172.21.15.154:0/2766098311 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc164029020 con 0x7fc1701300a0 2023-09-30T22:25:25.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.906+0000 7fbe5e1ce700 1 Processor -- start 2023-09-30T22:25:25.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.906+0000 7fbe5e1ce700 1 -- start start 2023-09-30T22:25:25.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe5e1ce700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe58133ad0 0x7fbe58133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe5e1ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581300a0 0x7fbe581304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe5e1ce700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5806b2d0 con 0x7fbe581309f0 2023-09-30T22:25:25.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe5e1ce700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe58133610 con 0x7fbe58133ad0 2023-09-30T22:25:25.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe5e1ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5809a500 con 0x7fbe581300a0 2023-09-30T22:25:25.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe577fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe58133ad0 0x7fbe58133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe56ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581300a0 0x7fbe581304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe57fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbe581309f0 0x7fbe5813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43748/0 (socket says 172.21.15.154:43748) 2023-09-30T22:25:25.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe57fff700 1 -- 172.21.15.154:0/3171957772 learned_addr learned my addr 172.21.15.154:0/3171957772 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:25.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe56ffd700 1 -- 172.21.15.154:0/3171957772 >> v2:172.21.15.154:3300/0 conn(0x7fbe58133ad0 msgr2=0x7fbe58133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:25.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe56ffd700 1 --2- 172.21.15.154:0/3171957772 >> v2:172.21.15.154:3300/0 conn(0x7fbe58133ad0 0x7fbe58133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe56ffd700 1 -- 172.21.15.154:0/3171957772 >> v1:172.21.15.154:6789/0 conn(0x7fbe581309f0 legacy=0x7fbe5813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe56ffd700 1 -- 172.21.15.154:0/3171957772 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe581338b0 con 0x7fbe581300a0 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.907+0000 7fbe56ffd700 1 --2- 172.21.15.154:0/3171957772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581300a0 0x7fbe581304b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009840 tx=0x7fbe4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6292410b55be7f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe567fc700 1 -- 172.21.15.154:0/3171957772 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c011830 con 0x7fbe581300a0 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe567fc700 1 -- 172.21.15.154:0/3171957772 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c011990 con 0x7fbe581300a0 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe567fc700 1 -- 172.21.15.154:0/3171957772 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c011d20 con 0x7fbe581300a0 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/3171957772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581300a0 msgr2=0x7fbe581304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe5e1ce700 1 --2- 172.21.15.154:0/3171957772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581300a0 0x7fbe581304b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009840 tx=0x7fbe4c009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/3171957772 shutdown_connections 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe5e1ce700 1 --2- 172.21.15.154:0/3171957772 >> v2:172.21.15.154:3300/0 conn(0x7fbe58133ad0 0x7fbe58133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe5e1ce700 1 --2- 172.21.15.154:0/3171957772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581300a0 0x7fbe581304b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/3171957772 >> 172.21.15.154:0/3171957772 conn(0x7fbe58099c40 msgr2=0x7fbe580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/3171957772 shutdown_connections 2023-09-30T22:25:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.908+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/3171957772 wait complete. 2023-09-30T22:25:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.910+0000 7fbe5e1ce700 1 Processor -- start 2023-09-30T22:25:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.910+0000 7fbe5e1ce700 1 -- start start 2023-09-30T22:25:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe5e1ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581300a0 0x7fbe580716c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe5e1ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe58071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe5e1ce700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe58133ad0 0x7fbe581cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe5e1ce700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5806ecd0 con 0x7fbe58133ad0 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe5e1ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5812fd40 con 0x7fbe581309f0 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe5e1ce700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58070350 con 0x7fbe581300a0 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe57fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe58133ad0 0x7fbe581cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe57fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe58133ad0 0x7fbe581cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45678/0 (socket says 172.21.15.154:45678) 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe57fff700 1 -- 172.21.15.154:0/2076659458 learned_addr learned my addr 172.21.15.154:0/2076659458 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe577fe700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581300a0 0x7fbe580716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe56ffd700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe58071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe57fff700 1 -- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581300a0 msgr2=0x7fbe580716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe57fff700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581300a0 0x7fbe580716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe57fff700 1 -- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 msgr2=0x7fbe58071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe57fff700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe58071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe57fff700 1 -- 172.21.15.154:0/2076659458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c0094a0 con 0x7fbe58133ad0 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe577fe700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581300a0 0x7fbe580716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe56ffd700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe58071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.911+0000 7fbe57fff700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe58133ad0 0x7fbe581cc870 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000ca80 tx=0x7fbe5000cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.912+0000 7fbe3ffff700 1 -- 172.21.15.154:0/2076659458 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000a9e0 con 0x7fbe58133ad0 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.912+0000 7fbe3ffff700 1 -- 172.21.15.154:0/2076659458 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5000ab40 con 0x7fbe58133ad0 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.912+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/2076659458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5806ef10 con 0x7fbe58133ad0 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.912+0000 7fbe3ffff700 1 -- 172.21.15.154:0/2076659458 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50012400 con 0x7fbe58133ad0 2023-09-30T22:25:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.912+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/2076659458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe58070630 con 0x7fbe58133ad0 2023-09-30T22:25:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.913+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/2076659458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe58070190 con 0x7fbe58133ad0 2023-09-30T22:25:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.914+0000 7fbe3ffff700 1 -- 172.21.15.154:0/2076659458 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe5001b3b0 con 0x7fbe58133ad0 2023-09-30T22:25:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.914+0000 7fbe3ffff700 1 -- 172.21.15.154:0/2076659458 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe5003f800 con 0x7fbe58133ad0 2023-09-30T22:25:25.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.922+0000 7fbe3ffff700 1 -- 172.21.15.154:0/2076659458 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe500192c0 con 0x7fbe58133ad0 2023-09-30T22:25:25.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.961+0000 7f4048298700 1 Processor -- start 2023-09-30T22:25:25.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.961+0000 7f4048298700 1 -- start start 2023-09-30T22:25:25.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.962+0000 7f4048298700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 0x7f4040136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.962+0000 7f4048298700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 0x7f40401393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.962+0000 7f4048298700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40400a1640 con 0x7f4040131980 2023-09-30T22:25:25.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.962+0000 7f4048298700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404006eb30 con 0x7f4040137000 2023-09-30T22:25:25.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.962+0000 7f4048298700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40400a22d0 con 0x7f40401346e0 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.962+0000 7f4046034700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4040131980 0x7f4040131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43760/0 (socket says 172.21.15.154:43760) 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.962+0000 7f4046034700 1 -- 172.21.15.154:0/686789340 learned_addr learned my addr 172.21.15.154:0/686789340 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.962+0000 7f4045833700 1 --2- 172.21.15.154:0/686789340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 0x7f4040136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.962+0000 7f4046835700 1 --2- 172.21.15.154:0/686789340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 0x7f40401393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045032700 1 -- 172.21.15.154:0/686789340 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720052280 0 0) 0x7f40400a1640 con 0x7f4040131980 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045032700 1 -- 172.21.15.154:0/686789340 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f402c0035b0 con 0x7f4040131980 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045833700 1 -- 172.21.15.154:0/686789340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 msgr2=0x7f40401393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045833700 1 --2- 172.21.15.154:0/686789340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 0x7f40401393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045833700 1 -- 172.21.15.154:0/686789340 >> v1:172.21.15.154:6789/0 conn(0x7f4040131980 legacy=0x7f4040131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045833700 1 -- 172.21.15.154:0/686789340 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040131550 con 0x7f40401346e0 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045833700 1 --2- 172.21.15.154:0/686789340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 0x7f4040136ac0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4030009870 tx=0x7f4030009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e9b9526d64e7019 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045032700 1 -- 172.21.15.154:0/686789340 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030011830 con 0x7f40401346e0 2023-09-30T22:25:25.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045032700 1 -- 172.21.15.154:0/686789340 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030011990 con 0x7f40401346e0 2023-09-30T22:25:25.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.963+0000 7f4045032700 1 -- 172.21.15.154:0/686789340 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030011d20 con 0x7f40401346e0 2023-09-30T22:25:25.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.964+0000 7f4048298700 1 -- 172.21.15.154:0/686789340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 msgr2=0x7f4040136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.964+0000 7f4048298700 1 --2- 172.21.15.154:0/686789340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 0x7f4040136ac0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4030009870 tx=0x7f4030009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.964+0000 7f4048298700 1 -- 172.21.15.154:0/686789340 shutdown_connections 2023-09-30T22:25:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.964+0000 7f4048298700 1 --2- 172.21.15.154:0/686789340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 0x7f40401393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.964+0000 7f4048298700 1 --2- 172.21.15.154:0/686789340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 0x7f4040136ac0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.964+0000 7f4048298700 1 -- 172.21.15.154:0/686789340 >> 172.21.15.154:0/686789340 conn(0x7f40400a2980 msgr2=0x7f40400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.964+0000 7f4048298700 1 -- 172.21.15.154:0/686789340 shutdown_connections 2023-09-30T22:25:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.964+0000 7f4048298700 1 -- 172.21.15.154:0/686789340 wait complete. 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4048298700 1 Processor -- start 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4048298700 1 -- start start 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4048298700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4040131980 0x7f40401c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4048298700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 0x7f40401c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4048298700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 0x7f4040099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4048298700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40400a1cb0 con 0x7f4040131980 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4048298700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404012ea00 con 0x7f4040137000 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4048298700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404009b820 con 0x7f40401346e0 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4046034700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4040131980 0x7f40401c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.966+0000 7f4046034700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4040131980 0x7f40401c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45690/0 (socket says 172.21.15.154:45690) 2023-09-30T22:25:25.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4046034700 1 -- 172.21.15.154:0/4192617609 learned_addr learned my addr 172.21.15.154:0/4192617609 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4046835700 1 --2- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 0x7f4040099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4046034700 1 -- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 msgr2=0x7f40401c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4046034700 1 --2- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 0x7f40401c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4046034700 1 -- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 msgr2=0x7f4040099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4046034700 1 --2- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 0x7f4040099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4046034700 1 -- 172.21.15.154:0/4192617609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300094a0 con 0x7f4040131980 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4046835700 1 --2- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 0x7f4040099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4046034700 1 --2- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4040131980 0x7f40401c85d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f403c00c700 tx=0x7f403c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4036ffd700 1 -- 172.21.15.154:0/4192617609 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0074e0 con 0x7f4040131980 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4036ffd700 1 -- 172.21.15.154:0/4192617609 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c007640 con 0x7f4040131980 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4036ffd700 1 -- 172.21.15.154:0/4192617609 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c005a30 con 0x7f4040131980 2023-09-30T22:25:25.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4048298700 1 -- 172.21.15.154:0/4192617609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404012ec40 con 0x7f4040131980 2023-09-30T22:25:25.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.967+0000 7f4048298700 1 -- 172.21.15.154:0/4192617609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4040136bd0 con 0x7f4040131980 2023-09-30T22:25:25.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.968+0000 7f4036ffd700 1 -- 172.21.15.154:0/4192617609 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f403c005b90 con 0x7f4040131980 2023-09-30T22:25:25.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.968+0000 7f4036ffd700 1 -- 172.21.15.154:0/4192617609 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f403c03ed50 con 0x7f4040131980 2023-09-30T22:25:25.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.969+0000 7f4048298700 1 -- 172.21.15.154:0/4192617609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404004f2a0 con 0x7f4040131980 2023-09-30T22:25:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.971+0000 7f4292220700 1 -- 172.21.15.154:0/1035866275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f428c125cd0 con 0x7f428c131d70 2023-09-30T22:25:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.971+0000 7f4283fff700 1 -- 172.21.15.154:0/1035866275 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4284019d20 con 0x7f428c131d70 2023-09-30T22:25:25.973 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.974+0000 7f4036ffd700 1 -- 172.21.15.154:0/4192617609 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f403c017080 con 0x7f4040131980 2023-09-30T22:25:25.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.974+0000 7f4292220700 1 -- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c131d70 msgr2=0x7f428c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.974+0000 7f4292220700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c131d70 0x7f428c06c330 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4284001eb0 tx=0x7f428400c6e0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.974+0000 7f4292220700 1 -- 172.21.15.154:0/1035866275 shutdown_connections 2023-09-30T22:25:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.974+0000 7f4292220700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f428c131d70 0x7f428c06c330 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.974+0000 7f4292220700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f428c09e870 0x7f428c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.974+0000 7f4292220700 1 --2- 172.21.15.154:0/1035866275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c09f180 0x7f428c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.974+0000 7f4292220700 1 -- 172.21.15.154:0/1035866275 >> 172.21.15.154:0/1035866275 conn(0x7f428c0a4430 msgr2=0x7f428c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.975+0000 7f4292220700 1 -- 172.21.15.154:0/1035866275 shutdown_connections 2023-09-30T22:25:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:25.975+0000 7f4292220700 1 -- 172.21.15.154:0/1035866275 wait complete. 2023-09-30T22:25:25.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:26.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.057+0000 7fc1770bc700 1 -- 172.21.15.154:0/2766098311 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc17006ac50 con 0x7fc1701300a0 2023-09-30T22:25:26.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.058+0000 7fc16d7fa700 1 -- 172.21.15.154:0/2766098311 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc164015070 con 0x7fc1701300a0 2023-09-30T22:25:26.058 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:26.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.061+0000 7fc1770bc700 1 -- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 msgr2=0x7fc1700717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.061+0000 7fc1770bc700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1700717d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc164000c00 tx=0x7fc164004750 comp rx=0 tx=0).stop 2023-09-30T22:25:26.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.061+0000 7fc1770bc700 1 -- 172.21.15.154:0/2766098311 shutdown_connections 2023-09-30T22:25:26.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.061+0000 7fc1770bc700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170133ad0 0x7fc1701cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.061+0000 7fc1770bc700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc1701300a0 0x7fc1700717d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.061+0000 7fc1770bc700 1 --2- 172.21.15.154:0/2766098311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1701309f0 0x7fc170071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.061+0000 7fc1770bc700 1 -- 172.21.15.154:0/2766098311 >> 172.21.15.154:0/2766098311 conn(0x7fc170099c40 msgr2=0x7fc17012ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.061+0000 7fc1770bc700 1 -- 172.21.15.154:0/2766098311 shutdown_connections 2023-09-30T22:25:26.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.061+0000 7fc1770bc700 1 -- 172.21.15.154:0/2766098311 wait complete. 2023-09-30T22:25:26.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:26.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.119+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/2076659458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe5806fff0 con 0x7fbe58133ad0 2023-09-30T22:25:26.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.119+0000 7fbe3ffff700 1 -- 172.21.15.154:0/2076659458 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe5806fff0 con 0x7fbe58133ad0 2023-09-30T22:25:26.120 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:26.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.122+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe58133ad0 msgr2=0x7fbe581cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.122+0000 7fbe5e1ce700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe58133ad0 0x7fbe581cc870 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000ca80 tx=0x7fbe5000cd90 comp rx=0 tx=0).stop 2023-09-30T22:25:26.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.123+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/2076659458 shutdown_connections 2023-09-30T22:25:26.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.123+0000 7fbe5e1ce700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe58133ad0 0x7fbe581cc870 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.123+0000 7fbe5e1ce700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe581300a0 0x7fbe580716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.123+0000 7fbe5e1ce700 1 --2- 172.21.15.154:0/2076659458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe581309f0 0x7fbe58071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.123+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/2076659458 >> 172.21.15.154:0/2076659458 conn(0x7fbe58099c40 msgr2=0x7fbe58132860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.123+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/2076659458 shutdown_connections 2023-09-30T22:25:26.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.123+0000 7fbe5e1ce700 1 -- 172.21.15.154:0/2076659458 wait complete. 2023-09-30T22:25:26.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:26.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.171+0000 7f4048298700 1 -- 172.21.15.154:0/4192617609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f404011e980 con 0x7f4040131980 2023-09-30T22:25:26.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.171+0000 7f4036ffd700 1 -- 172.21.15.154:0/4192617609 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f403c005e40 con 0x7f4040131980 2023-09-30T22:25:26.172 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:26.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.173+0000 7f4048298700 1 -- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4040131980 msgr2=0x7f40401c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.173+0000 7f4048298700 1 --2- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4040131980 0x7f40401c85d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f403c00c700 tx=0x7f403c00cac0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.173+0000 7f4048298700 1 -- 172.21.15.154:0/4192617609 shutdown_connections 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.173+0000 7f4048298700 1 --2- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4040137000 0x7f4040099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.173+0000 7f4048298700 1 --2- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4040131980 0x7f40401c85d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.173+0000 7f4048298700 1 --2- 172.21.15.154:0/4192617609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40401346e0 0x7f40401c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.173+0000 7f4048298700 1 -- 172.21.15.154:0/4192617609 >> 172.21.15.154:0/4192617609 conn(0x7f40400a2980 msgr2=0x7f4040133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.173+0000 7f4048298700 1 -- 172.21.15.154:0/4192617609 shutdown_connections 2023-09-30T22:25:26.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:26.173+0000 7f4048298700 1 -- 172.21.15.154:0/4192617609 wait complete. 2023-09-30T22:25:26.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:26.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:27.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:27.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.126+0000 7f3076096700 1 Processor -- start 2023-09-30T22:25:27.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.126+0000 7f3076096700 1 -- start start 2023-09-30T22:25:27.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f3076096700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f30700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f3076096700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3070130670 0x7f30701381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f3076096700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700a1e70 con 0x7f30700a1340 2023-09-30T22:25:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f3076096700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307009a720 con 0x7f3070130670 2023-09-30T22:25:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f3076096700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f307009b300 con 0x7f30700a0a30 2023-09-30T22:25:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f306f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f30700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f306effd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f30700a1340 0x7f307012ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43762/0 (socket says 172.21.15.154:43762) 2023-09-30T22:25:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f306effd700 1 -- 172.21.15.154:0/3051147423 learned_addr learned my addr 172.21.15.154:0/3051147423 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f306ffff700 1 --2- 172.21.15.154:0/3051147423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3070130670 0x7f30701381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f306e7fc700 1 -- 172.21.15.154:0/3051147423 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214290017 0 0) 0x7f30700a1e70 con 0x7f30700a1340 2023-09-30T22:25:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f306e7fc700 1 -- 172.21.15.154:0/3051147423 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30580035b0 con 0x7f30700a1340 2023-09-30T22:25:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f306f7fe700 1 -- 172.21.15.154:0/3051147423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3070130670 msgr2=0x7f30701381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.127+0000 7f306f7fe700 1 --2- 172.21.15.154:0/3051147423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3070130670 0x7f30701381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.128+0000 7f306f7fe700 1 -- 172.21.15.154:0/3051147423 >> v1:172.21.15.154:6789/0 conn(0x7f30700a1340 legacy=0x7f307012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.128+0000 7f306f7fe700 1 -- 172.21.15.154:0/3051147423 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307009abc0 con 0x7f30700a0a30 2023-09-30T22:25:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.128+0000 7f306ffff700 1 --2- 172.21.15.154:0/3051147423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3070130670 0x7f30701381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.128+0000 7f306f7fe700 1 --2- 172.21.15.154:0/3051147423 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f30700a0e00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3060009850 tx=0x7f3060009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6788004085a693a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.128+0000 7f306e7fc700 1 -- 172.21.15.154:0/3051147423 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060005e30 con 0x7f30700a0a30 2023-09-30T22:25:27.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.128+0000 7f306e7fc700 1 -- 172.21.15.154:0/3051147423 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060004030 con 0x7f30700a0a30 2023-09-30T22:25:27.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.128+0000 7f306e7fc700 1 -- 172.21.15.154:0/3051147423 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600043c0 con 0x7f30700a0a30 2023-09-30T22:25:27.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.128+0000 7f3076096700 1 -- 172.21.15.154:0/3051147423 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 msgr2=0x7f30700a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.129+0000 7f3076096700 1 --2- 172.21.15.154:0/3051147423 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f30700a0e00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3060009850 tx=0x7f3060009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:27.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.129+0000 7f3076096700 1 -- 172.21.15.154:0/3051147423 shutdown_connections 2023-09-30T22:25:27.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.129+0000 7f3076096700 1 --2- 172.21.15.154:0/3051147423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3070130670 0x7f30701381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.129+0000 7f3076096700 1 --2- 172.21.15.154:0/3051147423 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f30700a0e00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.129+0000 7f3076096700 1 -- 172.21.15.154:0/3051147423 >> 172.21.15.154:0/3051147423 conn(0x7f30700a2980 msgr2=0x7f30700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.129+0000 7f3076096700 1 -- 172.21.15.154:0/3051147423 shutdown_connections 2023-09-30T22:25:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.129+0000 7f3076096700 1 -- 172.21.15.154:0/3051147423 wait complete. 2023-09-30T22:25:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f3076096700 1 Processor -- start 2023-09-30T22:25:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f3076096700 1 -- start start 2023-09-30T22:25:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f3076096700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f3070135bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f3076096700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30700a1340 0x7f3070136130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f3076096700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070130670 0x7f3070136670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f3076096700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30701378a0 con 0x7f3070130670 2023-09-30T22:25:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f3076096700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3070118f10 con 0x7f30700a1340 2023-09-30T22:25:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f3076096700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3070138990 con 0x7f30700a0a30 2023-09-30T22:25:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f306f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f3070135bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f306f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f3070135bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35732/0 (socket says 172.21.15.154:35732) 2023-09-30T22:25:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f306f7fe700 1 -- 172.21.15.154:0/234611929 learned_addr learned my addr 172.21.15.154:0/234611929 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f306ffff700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070130670 0x7f3070136670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.130+0000 7f306effd700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30700a1340 0x7f3070136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f306f7fe700 1 -- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30700a1340 msgr2=0x7f3070136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f306f7fe700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30700a1340 0x7f3070136130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f306f7fe700 1 -- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070130670 msgr2=0x7f3070136670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f306f7fe700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070130670 0x7f3070136670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f306f7fe700 1 -- 172.21.15.154:0/234611929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009a70 con 0x7f30700a0a30 2023-09-30T22:25:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f306effd700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30700a1340 0x7f3070136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f306f7fe700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f3070135bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f307009b490 tx=0x7f3060004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f3057fff700 1 -- 172.21.15.154:0/234611929 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600041c0 con 0x7f30700a0a30 2023-09-30T22:25:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f3057fff700 1 -- 172.21.15.154:0/234611929 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306001c640 con 0x7f30700a0a30 2023-09-30T22:25:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f3076096700 1 -- 172.21.15.154:0/234611929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3060009430 con 0x7f30700a0a30 2023-09-30T22:25:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f3057fff700 1 -- 172.21.15.154:0/234611929 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306001c9f0 con 0x7f30700a0a30 2023-09-30T22:25:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.131+0000 7f3076096700 1 -- 172.21.15.154:0/234611929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3070119690 con 0x7f30700a0a30 2023-09-30T22:25:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.132+0000 7f3057fff700 1 -- 172.21.15.154:0/234611929 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f306001cb50 con 0x7f30700a0a30 2023-09-30T22:25:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.132+0000 7f3057fff700 1 -- 172.21.15.154:0/234611929 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3060040580 con 0x7f30700a0a30 2023-09-30T22:25:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.132+0000 7f3076096700 1 -- 172.21.15.154:0/234611929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307004f2a0 con 0x7f30700a0a30 2023-09-30T22:25:27.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:27.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.137+0000 7f3057fff700 1 -- 172.21.15.154:0/234611929 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3060016080 con 0x7f30700a0a30 2023-09-30T22:25:27.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:27.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.206+0000 7ffb70bb2700 1 Processor -- start 2023-09-30T22:25:27.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.206+0000 7ffb70bb2700 1 -- start start 2023-09-30T22:25:27.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.207+0000 7ffb70bb2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09d860 0x7ffb6c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.207+0000 7ffb70bb2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c09e170 0x7ffb6c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.207+0000 7ffb70bb2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c09aaa0 con 0x7ffb6c130ce0 2023-09-30T22:25:27.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.207+0000 7ffb70bb2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c09f870 con 0x7ffb6c09e170 2023-09-30T22:25:27.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.207+0000 7ffb70bb2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c09b360 con 0x7ffb6c09d860 2023-09-30T22:25:27.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.207+0000 7ffb69d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c09e170 0x7ffb6c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.207+0000 7ffb69d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c09e170 0x7ffb6c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36522/0 (socket says 172.21.15.154:36522) 2023-09-30T22:25:27.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.207+0000 7ffb69d9b700 1 -- 172.21.15.154:0/2966131052 learned_addr learned my addr 172.21.15.154:0/2966131052 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.207+0000 7ffb6a59c700 1 --2- 172.21.15.154:0/2966131052 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09d860 0x7ffb6c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.208+0000 7ffb69d9b700 1 -- 172.21.15.154:0/2966131052 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09d860 msgr2=0x7ffb6c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.208+0000 7ffb69d9b700 1 --2- 172.21.15.154:0/2966131052 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09d860 0x7ffb6c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.208+0000 7ffb6959a700 1 -- 172.21.15.154:0/2966131052 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868946404 0 0) 0x7ffb6c09aaa0 con 0x7ffb6c130ce0 2023-09-30T22:25:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.208+0000 7ffb69d9b700 1 -- 172.21.15.154:0/2966131052 >> v1:172.21.15.154:6789/0 conn(0x7ffb6c130ce0 legacy=0x7ffb6c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.208+0000 7ffb69d9b700 1 -- 172.21.15.154:0/2966131052 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c09b620 con 0x7ffb6c09e170 2023-09-30T22:25:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.208+0000 7ffb69d9b700 1 --2- 172.21.15.154:0/2966131052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c09e170 0x7ffb6c1307a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009920 tx=0x7ffb60009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbaecf43f49b277c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.208+0000 7ffb6959a700 1 -- 172.21.15.154:0/2966131052 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6000ba60 con 0x7ffb6c09e170 2023-09-30T22:25:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.208+0000 7ffb6959a700 1 -- 172.21.15.154:0/2966131052 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6000bbc0 con 0x7ffb6c09e170 2023-09-30T22:25:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.208+0000 7ffb6959a700 1 -- 172.21.15.154:0/2966131052 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60009e70 con 0x7ffb6c09e170 2023-09-30T22:25:27.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.209+0000 7ffb70bb2700 1 -- 172.21.15.154:0/2966131052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c09e170 msgr2=0x7ffb6c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.209+0000 7ffb70bb2700 1 --2- 172.21.15.154:0/2966131052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c09e170 0x7ffb6c1307a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009920 tx=0x7ffb60009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:27.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.209+0000 7ffb70bb2700 1 -- 172.21.15.154:0/2966131052 shutdown_connections 2023-09-30T22:25:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.209+0000 7ffb70bb2700 1 --2- 172.21.15.154:0/2966131052 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09d860 0x7ffb6c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.209+0000 7ffb70bb2700 1 --2- 172.21.15.154:0/2966131052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c09e170 0x7ffb6c1307a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.209+0000 7ffb70bb2700 1 -- 172.21.15.154:0/2966131052 >> 172.21.15.154:0/2966131052 conn(0x7ffb6c099c40 msgr2=0x7ffb6c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.209+0000 7ffb70bb2700 1 -- 172.21.15.154:0/2966131052 shutdown_connections 2023-09-30T22:25:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.209+0000 7ffb70bb2700 1 -- 172.21.15.154:0/2966131052 wait complete. 2023-09-30T22:25:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.210+0000 7ffb70bb2700 1 Processor -- start 2023-09-30T22:25:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.210+0000 7ffb70bb2700 1 -- start start 2023-09-30T22:25:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.210+0000 7ffb70bb2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb6c09d860 0x7ffb6c12fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.210+0000 7ffb70bb2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09e170 0x7ffb6c1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.210+0000 7ffb70bb2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c130ce0 0x7ffb6c130700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.210+0000 7ffb70bb2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c13be00 con 0x7ffb6c09d860 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.210+0000 7ffb70bb2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c09c8b0 con 0x7ffb6c130ce0 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.210+0000 7ffb70bb2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c136990 con 0x7ffb6c09e170 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.210+0000 7ffb6a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb6c09d860 0x7ffb6c12fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb6a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb6c09d860 0x7ffb6c12fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45718/0 (socket says 172.21.15.154:45718) 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb6a59c700 1 -- 172.21.15.154:0/3255696100 learned_addr learned my addr 172.21.15.154:0/3255696100 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb69d9b700 1 --2- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09e170 0x7ffb6c1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb6ad9d700 1 --2- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c130ce0 0x7ffb6c130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb69d9b700 1 -- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c130ce0 msgr2=0x7ffb6c130700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb69d9b700 1 --2- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c130ce0 0x7ffb6c130700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb69d9b700 1 -- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb6c09d860 msgr2=0x7ffb6c12fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb69d9b700 1 --2- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb6c09d860 0x7ffb6c12fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb69d9b700 1 -- 172.21.15.154:0/3255696100 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60009550 con 0x7ffb6c09e170 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb69d9b700 1 --2- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09e170 0x7ffb6c1301c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffb60016000 tx=0x7ffb60004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb5affd700 1 -- 172.21.15.154:0/3255696100 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60004510 con 0x7ffb6c09e170 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb5affd700 1 -- 172.21.15.154:0/3255696100 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600036a0 con 0x7ffb6c09e170 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb70bb2700 1 -- 172.21.15.154:0/3255696100 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6c135550 con 0x7ffb6c09e170 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb5affd700 1 -- 172.21.15.154:0/3255696100 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60003a50 con 0x7ffb6c09e170 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.211+0000 7ffb70bb2700 1 -- 172.21.15.154:0/3255696100 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c137b10 con 0x7ffb6c09e170 2023-09-30T22:25:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.212+0000 7ffb70bb2700 1 -- 172.21.15.154:0/3255696100 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c04f2a0 con 0x7ffb6c09e170 2023-09-30T22:25:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.212+0000 7ffb5affd700 1 -- 172.21.15.154:0/3255696100 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb60003bb0 con 0x7ffb6c09e170 2023-09-30T22:25:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.213+0000 7ffb5affd700 1 -- 172.21.15.154:0/3255696100 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb60021030 con 0x7ffb6c09e170 2023-09-30T22:25:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.221+0000 7ffb5affd700 1 -- 172.21.15.154:0/3255696100 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb6001a430 con 0x7ffb6c09e170 2023-09-30T22:25:27.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72fdc2700 1 Processor -- start 2023-09-30T22:25:27.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72fdc2700 1 -- start start 2023-09-30T22:25:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72fdc2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc72809f350 0x7fc728136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72fdc2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7281371c0 0x7fc7281395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72fdc2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72809c970 con 0x7fc72809e870 2023-09-30T22:25:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72fdc2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7280a0920 con 0x7fc72809f350 2023-09-30T22:25:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72fdc2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72809f9c0 con 0x7fc7281371c0 2023-09-30T22:25:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72d35d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc72809f350 0x7fc728136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72d35d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc72809f350 0x7fc728136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45728/0 (socket says 172.21.15.154:45728) 2023-09-30T22:25:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.272+0000 7fc72d35d700 1 -- 172.21.15.154:0/1494286278 learned_addr learned my addr 172.21.15.154:0/1494286278 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.273+0000 7fc72e35f700 1 --2- 172.21.15.154:0/1494286278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7281371c0 0x7fc7281395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.273+0000 7fc72d35d700 1 -- 172.21.15.154:0/1494286278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7281371c0 msgr2=0x7fc7281395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.273+0000 7fc72d35d700 1 --2- 172.21.15.154:0/1494286278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7281371c0 0x7fc7281395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.273+0000 7fc72d35d700 1 -- 172.21.15.154:0/1494286278 >> v1:172.21.15.154:6789/0 conn(0x7fc72809e870 legacy=0x7fc72809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.273+0000 7fc72d35d700 1 -- 172.21.15.154:0/1494286278 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72809bab0 con 0x7fc72809f350 2023-09-30T22:25:27.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.273+0000 7fc72d35d700 1 --2- 172.21.15.154:0/1494286278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809f350 0x7fc728136c80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc7180098f0 tx=0x7fc718009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807c96dee539c727 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.273+0000 7fc72cb5c700 1 -- 172.21.15.154:0/1494286278 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718011830 con 0x7fc72809f350 2023-09-30T22:25:27.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.273+0000 7fc72cb5c700 1 -- 172.21.15.154:0/1494286278 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc718011990 con 0x7fc72809f350 2023-09-30T22:25:27.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.273+0000 7fc72cb5c700 1 -- 172.21.15.154:0/1494286278 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718011d20 con 0x7fc72809f350 2023-09-30T22:25:27.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.274+0000 7fc72fdc2700 1 -- 172.21.15.154:0/1494286278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809f350 msgr2=0x7fc728136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.274+0000 7fc72fdc2700 1 --2- 172.21.15.154:0/1494286278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809f350 0x7fc728136c80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc7180098f0 tx=0x7fc718009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.274+0000 7fc72fdc2700 1 -- 172.21.15.154:0/1494286278 shutdown_connections 2023-09-30T22:25:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.274+0000 7fc72fdc2700 1 --2- 172.21.15.154:0/1494286278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7281371c0 0x7fc7281395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.274+0000 7fc72fdc2700 1 --2- 172.21.15.154:0/1494286278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809f350 0x7fc728136c80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.274+0000 7fc72fdc2700 1 -- 172.21.15.154:0/1494286278 >> 172.21.15.154:0/1494286278 conn(0x7fc7280a4430 msgr2=0x7fc7280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.274+0000 7fc72fdc2700 1 -- 172.21.15.154:0/1494286278 shutdown_connections 2023-09-30T22:25:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.274+0000 7fc72fdc2700 1 -- 172.21.15.154:0/1494286278 wait complete. 2023-09-30T22:25:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.275+0000 7fc72fdc2700 1 Processor -- start 2023-09-30T22:25:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72fdc2700 1 -- start start 2023-09-30T22:25:27.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72fdc2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809e870 0x7fc72806c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72fdc2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc72809f350 0x7fc72806c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72fdc2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7281371c0 0x7fc7281c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72fdc2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc728126680 con 0x7fc72809e870 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72fdc2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc728125010 con 0x7fc72809f350 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72fdc2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281364e0 con 0x7fc7281371c0 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72e35f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7281371c0 0x7fc7281c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72db5e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809e870 0x7fc72806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72e35f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7281371c0 0x7fc7281c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35760/0 (socket says 172.21.15.154:35760) 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.276+0000 7fc72e35f700 1 -- 172.21.15.154:0/4260078786 learned_addr learned my addr 172.21.15.154:0/4260078786 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72d35d700 1 --2- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc72809f350 0x7fc72806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72db5e700 1 -- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7281371c0 msgr2=0x7fc7281c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72db5e700 1 --2- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7281371c0 0x7fc7281c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72db5e700 1 -- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc72809f350 msgr2=0x7fc72806c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72db5e700 1 --2- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc72809f350 0x7fc72806c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72db5e700 1 -- 172.21.15.154:0/4260078786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718009550 con 0x7fc72809e870 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72d35d700 1 --2- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc72809f350 0x7fc72806c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72db5e700 1 --2- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809e870 0x7fc72806c210 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c450 tx=0x7fc72400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc71e7fc700 1 -- 172.21.15.154:0/4260078786 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240052d0 con 0x7fc72809e870 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc71e7fc700 1 -- 172.21.15.154:0/4260078786 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc724005430 con 0x7fc72809e870 2023-09-30T22:25:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72fdc2700 1 -- 172.21.15.154:0/4260078786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72806bd70 con 0x7fc72809e870 2023-09-30T22:25:27.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc71e7fc700 1 -- 172.21.15.154:0/4260078786 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240038c0 con 0x7fc72809e870 2023-09-30T22:25:27.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.277+0000 7fc72fdc2700 1 -- 172.21.15.154:0/4260078786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc728125430 con 0x7fc72809e870 2023-09-30T22:25:27.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.278+0000 7fc71e7fc700 1 -- 172.21.15.154:0/4260078786 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc724003a20 con 0x7fc72809e870 2023-09-30T22:25:27.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.278+0000 7fc71e7fc700 1 -- 172.21.15.154:0/4260078786 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc72403ea50 con 0x7fc72809e870 2023-09-30T22:25:27.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.278+0000 7fc72fdc2700 1 -- 172.21.15.154:0/4260078786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72806cd50 con 0x7fc72809e870 2023-09-30T22:25:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.283+0000 7fc71e7fc700 1 -- 172.21.15.154:0/4260078786 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc724017020 con 0x7fc72809e870 2023-09-30T22:25:27.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.323+0000 7fb42ad9e700 1 Processor -- start 2023-09-30T22:25:27.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.323+0000 7fb42ad9e700 1 -- start start 2023-09-30T22:25:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.323+0000 7fb42ad9e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240700d0 0x7fb42412ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.323+0000 7fb42ad9e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb42412cfa0 0x7fb42412f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.323+0000 7fb42ad9e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb424099c90 con 0x7fb42412fd30 2023-09-30T22:25:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.323+0000 7fb42ad9e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42409a230 con 0x7fb42412cfa0 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.323+0000 7fb42ad9e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240704a0 con 0x7fb4240700d0 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb42959b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb42412cfa0 0x7fb42412f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb42959b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb42412cfa0 0x7fb42412f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45756/0 (socket says 172.21.15.154:45756) 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb42959b700 1 -- 172.21.15.154:0/51789100 learned_addr learned my addr 172.21.15.154:0/51789100 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb429d9c700 1 --2- 172.21.15.154:0/51789100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240700d0 0x7fb42412ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb429d9c700 1 -- 172.21.15.154:0/51789100 >> v2:172.21.15.154:3300/0 conn(0x7fb42412cfa0 msgr2=0x7fb42412f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb429d9c700 1 --2- 172.21.15.154:0/51789100 >> v2:172.21.15.154:3300/0 conn(0x7fb42412cfa0 0x7fb42412f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb429d9c700 1 -- 172.21.15.154:0/51789100 >> v1:172.21.15.154:6789/0 conn(0x7fb42412fd30 legacy=0x7fb424136b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb428d9a700 1 -- 172.21.15.154:0/51789100 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156861609 0 0) 0x7fb424099c90 con 0x7fb42412fd30 2023-09-30T22:25:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb429d9c700 1 -- 172.21.15.154:0/51789100 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424099f50 con 0x7fb4240700d0 2023-09-30T22:25:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb42959b700 1 --2- 172.21.15.154:0/51789100 >> v2:172.21.15.154:3300/0 conn(0x7fb42412cfa0 0x7fb42412f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb429d9c700 1 --2- 172.21.15.154:0/51789100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240700d0 0x7fb42412ca60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb420009840 tx=0x7fb420009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c401519a5526be0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.324+0000 7fb428d9a700 1 -- 172.21.15.154:0/51789100 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420011830 con 0x7fb4240700d0 2023-09-30T22:25:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb428d9a700 1 -- 172.21.15.154:0/51789100 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb420011990 con 0x7fb4240700d0 2023-09-30T22:25:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb428d9a700 1 -- 172.21.15.154:0/51789100 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420011d20 con 0x7fb4240700d0 2023-09-30T22:25:27.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb42ad9e700 1 -- 172.21.15.154:0/51789100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240700d0 msgr2=0x7fb42412ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb42ad9e700 1 --2- 172.21.15.154:0/51789100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240700d0 0x7fb42412ca60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb420009840 tx=0x7fb420009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb42ad9e700 1 -- 172.21.15.154:0/51789100 shutdown_connections 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb42ad9e700 1 --2- 172.21.15.154:0/51789100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240700d0 0x7fb42412ca60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb42ad9e700 1 --2- 172.21.15.154:0/51789100 >> v2:172.21.15.154:3300/0 conn(0x7fb42412cfa0 0x7fb42412f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb42ad9e700 1 -- 172.21.15.154:0/51789100 >> 172.21.15.154:0/51789100 conn(0x7fb4240a27a0 msgr2=0x7fb4240a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb42ad9e700 1 -- 172.21.15.154:0/51789100 shutdown_connections 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.325+0000 7fb42ad9e700 1 -- 172.21.15.154:0/51789100 wait complete. 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.326+0000 7fb42ad9e700 1 Processor -- start 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.326+0000 7fb42ad9e700 1 -- start start 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb42ad9e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4240700d0 0x7fb4241308e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb42ad9e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb42412cfa0 0x7fb424130e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb42ad9e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42412fd30 0x7fb424131360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb42ad9e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424131ce0 con 0x7fb42412fd30 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb42ad9e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb424132680 con 0x7fb42412cfa0 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb42ad9e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb42412c4e0 con 0x7fb4240700d0 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb429d9c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4240700d0 0x7fb4241308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb429d9c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4240700d0 0x7fb4241308e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35770/0 (socket says 172.21.15.154:35770) 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb429d9c700 1 -- 172.21.15.154:0/1651031842 learned_addr learned my addr 172.21.15.154:0/1651031842 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb42a59d700 1 --2- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42412fd30 0x7fb424131360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb42959b700 1 --2- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb42412cfa0 0x7fb424130e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:27.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb429d9c700 1 -- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb42412cfa0 msgr2=0x7fb424130e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb429d9c700 1 --2- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb42412cfa0 0x7fb424130e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb429d9c700 1 -- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42412fd30 msgr2=0x7fb424131360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb429d9c700 1 --2- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42412fd30 0x7fb424131360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.327+0000 7fb429d9c700 1 -- 172.21.15.154:0/1651031842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb414009550 con 0x7fb4240700d0 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.328+0000 7fb429d9c700 1 --2- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4240700d0 0x7fb4241308e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb4200090b0 tx=0x7fb420004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.328+0000 7fb41a7fc700 1 -- 172.21.15.154:0/1651031842 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420004480 con 0x7fb4240700d0 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.328+0000 7fb41a7fc700 1 -- 172.21.15.154:0/1651031842 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42001f070 con 0x7fb4240700d0 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.328+0000 7fb42ad9e700 1 -- 172.21.15.154:0/1651031842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4200094a0 con 0x7fb4240700d0 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.328+0000 7fb41a7fc700 1 -- 172.21.15.154:0/1651031842 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200038c0 con 0x7fb4240700d0 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.328+0000 7fb42ad9e700 1 -- 172.21.15.154:0/1651031842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb424139730 con 0x7fb4240700d0 2023-09-30T22:25:27.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.329+0000 7fb42ad9e700 1 -- 172.21.15.154:0/1651031842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb424071cd0 con 0x7fb4240700d0 2023-09-30T22:25:27.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.329+0000 7fb41a7fc700 1 -- 172.21.15.154:0/1651031842 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb420021030 con 0x7fb4240700d0 2023-09-30T22:25:27.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.330+0000 7fb41a7fc700 1 -- 172.21.15.154:0/1651031842 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb420001cf0 con 0x7fb4240700d0 2023-09-30T22:25:27.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.338+0000 7fb41a7fc700 1 -- 172.21.15.154:0/1651031842 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb424071cd0 con 0x7fb4240700d0 2023-09-30T22:25:27.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.341+0000 7f3076096700 1 -- 172.21.15.154:0/234611929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3070137ff0 con 0x7f30700a0a30 2023-09-30T22:25:27.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.341+0000 7f3057fff700 1 -- 172.21.15.154:0/234611929 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3060020020 con 0x7f30700a0a30 2023-09-30T22:25:27.342 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.343+0000 7f3076096700 1 -- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 msgr2=0x7f3070135bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.343+0000 7f3076096700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f3070135bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f307009b490 tx=0x7f3060004750 comp rx=0 tx=0).stop 2023-09-30T22:25:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.344+0000 7f3076096700 1 -- 172.21.15.154:0/234611929 shutdown_connections 2023-09-30T22:25:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.344+0000 7f3076096700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070130670 0x7f3070136670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.344+0000 7f3076096700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f30700a0a30 0x7f3070135bf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.344+0000 7f3076096700 1 --2- 172.21.15.154:0/234611929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30700a1340 0x7f3070136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.344+0000 7f3076096700 1 -- 172.21.15.154:0/234611929 >> 172.21.15.154:0/234611929 conn(0x7f30700a2980 msgr2=0x7f3070070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.344+0000 7f3076096700 1 -- 172.21.15.154:0/234611929 shutdown_connections 2023-09-30T22:25:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.344+0000 7f3076096700 1 -- 172.21.15.154:0/234611929 wait complete. 2023-09-30T22:25:27.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:27.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.430+0000 7ffb70bb2700 1 -- 172.21.15.154:0/3255696100 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb6c06c3b0 con 0x7ffb6c09e170 2023-09-30T22:25:27.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.431+0000 7ffb5affd700 1 -- 172.21.15.154:0/3255696100 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb6002b020 con 0x7ffb6c09e170 2023-09-30T22:25:27.432 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:27.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.433+0000 7ffb70bb2700 1 -- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09e170 msgr2=0x7ffb6c1301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.433+0000 7ffb70bb2700 1 --2- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09e170 0x7ffb6c1301c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffb60016000 tx=0x7ffb60004750 comp rx=0 tx=0).stop 2023-09-30T22:25:27.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.433+0000 7ffb70bb2700 1 -- 172.21.15.154:0/3255696100 shutdown_connections 2023-09-30T22:25:27.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.433+0000 7ffb70bb2700 1 --2- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb6c130ce0 0x7ffb6c130700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.433+0000 7ffb70bb2700 1 --2- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb6c09d860 0x7ffb6c12fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.433+0000 7ffb70bb2700 1 --2- 172.21.15.154:0/3255696100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffb6c09e170 0x7ffb6c1301c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.433+0000 7ffb70bb2700 1 -- 172.21.15.154:0/3255696100 >> 172.21.15.154:0/3255696100 conn(0x7ffb6c099c40 msgr2=0x7ffb6c139500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.433+0000 7ffb70bb2700 1 -- 172.21.15.154:0/3255696100 shutdown_connections 2023-09-30T22:25:27.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.433+0000 7ffb70bb2700 1 -- 172.21.15.154:0/3255696100 wait complete. 2023-09-30T22:25:27.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:27.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.480+0000 7fc72fdc2700 1 -- 172.21.15.154:0/4260078786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc728126300 con 0x7fc72809e870 2023-09-30T22:25:27.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.481+0000 7fc71e7fc700 1 -- 172.21.15.154:0/4260078786 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc728126300 con 0x7fc72809e870 2023-09-30T22:25:27.482 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:27.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.482+0000 7fc72fdc2700 1 -- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809e870 msgr2=0x7fc72806c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.482+0000 7fc72fdc2700 1 --2- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809e870 0x7fc72806c210 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc72400c450 tx=0x7fc72400c760 comp rx=0 tx=0).stop 2023-09-30T22:25:27.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.483+0000 7fc72fdc2700 1 -- 172.21.15.154:0/4260078786 shutdown_connections 2023-09-30T22:25:27.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.483+0000 7fc72fdc2700 1 --2- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7281371c0 0x7fc7281c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.483+0000 7fc72fdc2700 1 --2- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc72809e870 0x7fc72806c210 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.483+0000 7fc72fdc2700 1 --2- 172.21.15.154:0/4260078786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc72809f350 0x7fc72806c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.483+0000 7fc72fdc2700 1 -- 172.21.15.154:0/4260078786 >> 172.21.15.154:0/4260078786 conn(0x7fc7280a4430 msgr2=0x7fc7280a2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.483+0000 7fc72fdc2700 1 -- 172.21.15.154:0/4260078786 shutdown_connections 2023-09-30T22:25:27.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.483+0000 7fc72fdc2700 1 -- 172.21.15.154:0/4260078786 wait complete. 2023-09-30T22:25:27.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.534+0000 7fb42ad9e700 1 -- 172.21.15.154:0/1651031842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb424071cd0 con 0x7fb4240700d0 2023-09-30T22:25:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.534+0000 7fb41a7fc700 1 -- 172.21.15.154:0/1651031842 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb424071cd0 con 0x7fb4240700d0 2023-09-30T22:25:27.535 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:27.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.536+0000 7fb42ad9e700 1 -- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4240700d0 msgr2=0x7fb4241308e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:27.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.536+0000 7fb42ad9e700 1 --2- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4240700d0 0x7fb4241308e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb4200090b0 tx=0x7fb420004750 comp rx=0 tx=0).stop 2023-09-30T22:25:27.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.536+0000 7fb42ad9e700 1 -- 172.21.15.154:0/1651031842 shutdown_connections 2023-09-30T22:25:27.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.536+0000 7fb42ad9e700 1 --2- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42412fd30 0x7fb424131360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.536+0000 7fb42ad9e700 1 --2- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4240700d0 0x7fb4241308e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.536+0000 7fb42ad9e700 1 --2- 172.21.15.154:0/1651031842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb42412cfa0 0x7fb424130e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:27.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.536+0000 7fb42ad9e700 1 -- 172.21.15.154:0/1651031842 >> 172.21.15.154:0/1651031842 conn(0x7fb4240a27a0 msgr2=0x7fb42412a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:27.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.536+0000 7fb42ad9e700 1 -- 172.21.15.154:0/1651031842 shutdown_connections 2023-09-30T22:25:27.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:27.536+0000 7fb42ad9e700 1 -- 172.21.15.154:0/1651031842 wait complete. 2023-09-30T22:25:27.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:28.358 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:28.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:28.497 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.496+0000 7f6e5af75700 1 Processor -- start 2023-09-30T22:25:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.496+0000 7f6e5af75700 1 -- start start 2023-09-30T22:25:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e5af75700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e540a0a70 0x7f6e540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e5af75700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 0x7f6e54133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e5af75700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e541343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e5af75700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5409e9d0 con 0x7f6e540a0a70 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e5af75700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5409dc00 con 0x7f6e54133f50 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e5af75700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5409dec0 con 0x7f6e540a1380 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e59512700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e541343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e58d11700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e540a0a70 0x7f6e540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e59512700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e541343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36570/0 (socket says 172.21.15.154:36570) 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e53fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 0x7f6e54133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e59512700 1 -- 172.21.15.154:0/2713895657 learned_addr learned my addr 172.21.15.154:0/2713895657 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e53fff700 1 -- 172.21.15.154:0/2713895657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 msgr2=0x7f6e541343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e53fff700 1 --2- 172.21.15.154:0/2713895657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e541343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e53fff700 1 -- 172.21.15.154:0/2713895657 >> v2:172.21.15.154:3300/0 conn(0x7f6e540a0a70 msgr2=0x7f6e540a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e53fff700 1 --2- 172.21.15.154:0/2713895657 >> v2:172.21.15.154:3300/0 conn(0x7f6e540a0a70 0x7f6e540a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e53fff700 1 -- 172.21.15.154:0/2713895657 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5409e6a0 con 0x7f6e540a1380 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e59512700 1 --2- 172.21.15.154:0/2713895657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e541343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e58d11700 1 --2- 172.21.15.154:0/2713895657 >> v2:172.21.15.154:3300/0 conn(0x7f6e540a0a70 0x7f6e540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.497+0000 7f6e53fff700 1 --2- 172.21.15.154:0/2713895657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 0x7f6e54133a10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009840 tx=0x7f6e40009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c60b3758fc94ed0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e537fe700 1 -- 172.21.15.154:0/2713895657 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40011830 con 0x7f6e540a1380 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e537fe700 1 -- 172.21.15.154:0/2713895657 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e40011990 con 0x7f6e540a1380 2023-09-30T22:25:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e537fe700 1 -- 172.21.15.154:0/2713895657 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40011d20 con 0x7f6e540a1380 2023-09-30T22:25:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e5af75700 1 -- 172.21.15.154:0/2713895657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 msgr2=0x7f6e54133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e5af75700 1 --2- 172.21.15.154:0/2713895657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 0x7f6e54133a10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009840 tx=0x7f6e40009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e5af75700 1 -- 172.21.15.154:0/2713895657 shutdown_connections 2023-09-30T22:25:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e5af75700 1 --2- 172.21.15.154:0/2713895657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e541343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e5af75700 1 --2- 172.21.15.154:0/2713895657 >> v2:172.21.15.154:3300/0 conn(0x7f6e540a0a70 0x7f6e540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e5af75700 1 --2- 172.21.15.154:0/2713895657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 0x7f6e54133a10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e5af75700 1 -- 172.21.15.154:0/2713895657 >> 172.21.15.154:0/2713895657 conn(0x7f6e540a6610 msgr2=0x7f6e540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e5af75700 1 -- 172.21.15.154:0/2713895657 shutdown_connections 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.498+0000 7f6e5af75700 1 -- 172.21.15.154:0/2713895657 wait complete. 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.499+0000 7f6e5af75700 1 Processor -- start 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.499+0000 7f6e5af75700 1 -- start start 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e5af75700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e540a0a70 0x7f6e54122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e5af75700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 0x7f6e54122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e5af75700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e54122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e5af75700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e541336f0 con 0x7f6e540a0a70 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e5af75700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54123780 con 0x7f6e54133f50 2023-09-30T22:25:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e5af75700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54124dc0 con 0x7f6e540a1380 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e58d11700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e540a0a70 0x7f6e54122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e59512700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e54122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e58d11700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e540a0a70 0x7f6e54122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45790/0 (socket says 172.21.15.154:45790) 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e58d11700 1 -- 172.21.15.154:0/2098320342 learned_addr learned my addr 172.21.15.154:0/2098320342 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e59512700 1 --2- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e54122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36582/0 (socket says 172.21.15.154:36582) 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e53fff700 1 --2- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 0x7f6e54122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e59512700 1 -- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 msgr2=0x7f6e54122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e59512700 1 --2- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 0x7f6e54122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e59512700 1 -- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e540a0a70 msgr2=0x7f6e54122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e59512700 1 --2- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e540a0a70 0x7f6e54122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.500+0000 7f6e59512700 1 -- 172.21.15.154:0/2098320342 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e480094a0 con 0x7f6e54133f50 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.501+0000 7f6e59512700 1 --2- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e54122da0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009e50 tx=0x7f6e4c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.501+0000 7f6e517fa700 1 -- 172.21.15.154:0/2098320342 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c018070 con 0x7f6e54133f50 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.501+0000 7f6e5af75700 1 -- 172.21.15.154:0/2098320342 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c009b30 con 0x7f6e54133f50 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.501+0000 7f6e5af75700 1 -- 172.21.15.154:0/2098320342 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e400094a0 con 0x7f6e54133f50 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.501+0000 7f6e517fa700 1 -- 172.21.15.154:0/2098320342 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00f040 con 0x7f6e54133f50 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.501+0000 7f6e517fa700 1 -- 172.21.15.154:0/2098320342 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c003c20 con 0x7f6e54133f50 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.502+0000 7f6e517fa700 1 -- 172.21.15.154:0/2098320342 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e4c00c930 con 0x7f6e54133f50 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.502+0000 7f6e517fa700 1 -- 172.21.15.154:0/2098320342 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6e4c03f6c0 con 0x7f6e54133f50 2023-09-30T22:25:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.502+0000 7f6e5af75700 1 -- 172.21.15.154:0/2098320342 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e541259b0 con 0x7f6e54133f50 2023-09-30T22:25:28.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.511+0000 7f6e517fa700 1 -- 172.21.15.154:0/2098320342 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e4c012750 con 0x7f6e54133f50 2023-09-30T22:25:28.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.582+0000 7f6b70d17700 1 Processor -- start 2023-09-30T22:25:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.582+0000 7f6b70d17700 1 -- start start 2023-09-30T22:25:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.583+0000 7f6b70d17700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b6c133ad0 0x7f6b6c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.583+0000 7f6b70d17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c1300a0 0x7f6b6c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.583+0000 7f6b70d17700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c06b2d0 con 0x7f6b6c1309f0 2023-09-30T22:25:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.583+0000 7f6b70d17700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c133610 con 0x7f6b6c133ad0 2023-09-30T22:25:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.583+0000 7f6b70d17700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c09a500 con 0x7f6b6c1300a0 2023-09-30T22:25:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.583+0000 7f6b69d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c1300a0 0x7f6b6c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.583+0000 7f6b69d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c1300a0 0x7f6b6c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36596/0 (socket says 172.21.15.154:36596) 2023-09-30T22:25:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.583+0000 7f6b69d9b700 1 -- 172.21.15.154:0/3187729660 learned_addr learned my addr 172.21.15.154:0/3187729660 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.584+0000 7f6b6a59c700 1 --2- 172.21.15.154:0/3187729660 >> v2:172.21.15.154:3300/0 conn(0x7f6b6c133ad0 0x7f6b6c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.584+0000 7f6b69d9b700 1 -- 172.21.15.154:0/3187729660 >> v2:172.21.15.154:3300/0 conn(0x7f6b6c133ad0 msgr2=0x7f6b6c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.584+0000 7f6b69d9b700 1 --2- 172.21.15.154:0/3187729660 >> v2:172.21.15.154:3300/0 conn(0x7f6b6c133ad0 0x7f6b6c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.584+0000 7f6b69d9b700 1 -- 172.21.15.154:0/3187729660 >> v1:172.21.15.154:6789/0 conn(0x7f6b6c1309f0 legacy=0x7f6b6c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.584+0000 7f6b69d9b700 1 -- 172.21.15.154:0/3187729660 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c1338b0 con 0x7f6b6c1300a0 2023-09-30T22:25:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.584+0000 7f6b69d9b700 1 --2- 172.21.15.154:0/3187729660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c1300a0 0x7f6b6c1304b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6b600098f0 tx=0x7f6b60009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839d3d4781d4304 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.584+0000 7f6b6959a700 1 -- 172.21.15.154:0/3187729660 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000b8a0 con 0x7f6b6c1300a0 2023-09-30T22:25:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.584+0000 7f6b6959a700 1 -- 172.21.15.154:0/3187729660 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6000ba00 con 0x7f6b6c1300a0 2023-09-30T22:25:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.584+0000 7f6b6959a700 1 -- 172.21.15.154:0/3187729660 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000bd90 con 0x7f6b6c1300a0 2023-09-30T22:25:28.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.585+0000 7f6b70d17700 1 -- 172.21.15.154:0/3187729660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c1300a0 msgr2=0x7f6b6c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.585+0000 7f6b70d17700 1 --2- 172.21.15.154:0/3187729660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c1300a0 0x7f6b6c1304b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6b600098f0 tx=0x7f6b60009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:28.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.585+0000 7f6b70d17700 1 -- 172.21.15.154:0/3187729660 shutdown_connections 2023-09-30T22:25:28.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.585+0000 7f6b70d17700 1 --2- 172.21.15.154:0/3187729660 >> v2:172.21.15.154:3300/0 conn(0x7f6b6c133ad0 0x7f6b6c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.585+0000 7f6b70d17700 1 --2- 172.21.15.154:0/3187729660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c1300a0 0x7f6b6c1304b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.585+0000 7f6b70d17700 1 -- 172.21.15.154:0/3187729660 >> 172.21.15.154:0/3187729660 conn(0x7f6b6c099c40 msgr2=0x7f6b6c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.585+0000 7f6b70d17700 1 -- 172.21.15.154:0/3187729660 shutdown_connections 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.585+0000 7f6b70d17700 1 -- 172.21.15.154:0/3187729660 wait complete. 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.586+0000 7f6b70d17700 1 Processor -- start 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.586+0000 7f6b70d17700 1 -- start start 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.586+0000 7f6b70d17700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b6c1300a0 0x7f6b6c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.586+0000 7f6b70d17700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6c1309f0 0x7f6b6c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b70d17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c133ad0 0x7f6b6c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b70d17700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c11f5b0 con 0x7f6b6c1300a0 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b70d17700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c12fcc0 con 0x7f6b6c133ad0 2023-09-30T22:25:28.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b70d17700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c12dd00 con 0x7f6b6c1309f0 2023-09-30T22:25:28.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b6c1300a0 0x7f6b6c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b6c1300a0 0x7f6b6c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45820/0 (socket says 172.21.15.154:45820) 2023-09-30T22:25:28.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6a59c700 1 -- 172.21.15.154:0/1701971919 learned_addr learned my addr 172.21.15.154:0/1701971919 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:28.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6ad9d700 1 --2- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c133ad0 0x7f6b6c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b69d9b700 1 --2- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6c1309f0 0x7f6b6c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6a59c700 1 -- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6c1309f0 msgr2=0x7f6b6c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6a59c700 1 --2- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6c1309f0 0x7f6b6c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6a59c700 1 -- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c133ad0 msgr2=0x7f6b6c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6a59c700 1 --2- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c133ad0 0x7f6b6c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6a59c700 1 -- 172.21.15.154:0/1701971919 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60009550 con 0x7f6b6c1300a0 2023-09-30T22:25:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b6a59c700 1 --2- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b6c1300a0 0x7f6b6c11da40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00e810 tx=0x7f6b5c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.587+0000 7f6b5affd700 1 -- 172.21.15.154:0/1701971919 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00c070 con 0x7f6b6c1300a0 2023-09-30T22:25:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.588+0000 7f6b5affd700 1 -- 172.21.15.154:0/1701971919 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c013610 con 0x7f6b6c1300a0 2023-09-30T22:25:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.588+0000 7f6b70d17700 1 -- 172.21.15.154:0/1701971919 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c11fbf0 con 0x7f6b6c1300a0 2023-09-30T22:25:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.588+0000 7f6b5affd700 1 -- 172.21.15.154:0/1701971919 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0139c0 con 0x7f6b6c1300a0 2023-09-30T22:25:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.588+0000 7f6b70d17700 1 -- 172.21.15.154:0/1701971919 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c11feb0 con 0x7f6b6c1300a0 2023-09-30T22:25:28.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.589+0000 7f6b70d17700 1 -- 172.21.15.154:0/1701971919 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c072720 con 0x7f6b6c1300a0 2023-09-30T22:25:28.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.589+0000 7f6b5affd700 1 -- 172.21.15.154:0/1701971919 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b5c013b20 con 0x7f6b6c1300a0 2023-09-30T22:25:28.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.589+0000 7f6b5affd700 1 -- 172.21.15.154:0/1701971919 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6b5c03f460 con 0x7f6b6c1300a0 2023-09-30T22:25:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.597+0000 7f6b5affd700 1 -- 172.21.15.154:0/1701971919 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b5c0108d0 con 0x7f6b6c1300a0 2023-09-30T22:25:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.633+0000 7f6ecfaa1700 1 Processor -- start 2023-09-30T22:25:28.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.633+0000 7f6ecfaa1700 1 -- start start 2023-09-30T22:25:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.634+0000 7f6ecfaa1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.634+0000 7f6ecfaa1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ec8134120 0x7f6ec813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.634+0000 7f6ecfaa1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec809dc00 con 0x7f6ec80a1380 2023-09-30T22:25:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.634+0000 7f6ecfaa1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec809ea60 con 0x7f6ec8134120 2023-09-30T22:25:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.634+0000 7f6ecfaa1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec809dec0 con 0x7f6ec80a0a70 2023-09-30T22:25:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.634+0000 7f6ece03e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ec8134120 0x7f6ec813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.634+0000 7f6ecd83d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.634+0000 7f6ece03e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ec8134120 0x7f6ec813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45824/0 (socket says 172.21.15.154:45824) 2023-09-30T22:25:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.634+0000 7f6ece03e700 1 -- 172.21.15.154:0/4145687995 learned_addr learned my addr 172.21.15.154:0/4145687995 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.635+0000 7f6ecd83d700 1 -- 172.21.15.154:0/4145687995 >> v2:172.21.15.154:3300/0 conn(0x7f6ec8134120 msgr2=0x7f6ec813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.635+0000 7f6ecd83d700 1 --2- 172.21.15.154:0/4145687995 >> v2:172.21.15.154:3300/0 conn(0x7f6ec8134120 0x7f6ec813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.635+0000 7f6ecd83d700 1 -- 172.21.15.154:0/4145687995 >> v1:172.21.15.154:6789/0 conn(0x7f6ec80a1380 legacy=0x7f6ec8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.635+0000 7f6ecd83d700 1 -- 172.21.15.154:0/4145687995 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec809e6a0 con 0x7f6ec80a0a70 2023-09-30T22:25:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.635+0000 7f6ecd83d700 1 --2- 172.21.15.154:0/4145687995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec80a0e40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009840 tx=0x7f6ec4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=299deac656c9dd38 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.635+0000 7f6ecc83b700 1 -- 172.21.15.154:0/4145687995 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4011830 con 0x7f6ec80a0a70 2023-09-30T22:25:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.635+0000 7f6ecc83b700 1 -- 172.21.15.154:0/4145687995 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec4011990 con 0x7f6ec80a0a70 2023-09-30T22:25:28.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.635+0000 7f6ecc83b700 1 -- 172.21.15.154:0/4145687995 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4011d20 con 0x7f6ec80a0a70 2023-09-30T22:25:28.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.636+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/4145687995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 msgr2=0x7f6ec80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.636+0000 7f6ecfaa1700 1 --2- 172.21.15.154:0/4145687995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec80a0e40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009840 tx=0x7f6ec4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.636+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/4145687995 shutdown_connections 2023-09-30T22:25:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.636+0000 7f6ecfaa1700 1 --2- 172.21.15.154:0/4145687995 >> v2:172.21.15.154:3300/0 conn(0x7f6ec8134120 0x7f6ec813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.636+0000 7f6ecfaa1700 1 --2- 172.21.15.154:0/4145687995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec80a0e40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.636+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/4145687995 >> 172.21.15.154:0/4145687995 conn(0x7f6ec80a6610 msgr2=0x7f6ec80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.636+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/4145687995 shutdown_connections 2023-09-30T22:25:28.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.636+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/4145687995 wait complete. 2023-09-30T22:25:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.638+0000 7f6ecfaa1700 1 Processor -- start 2023-09-30T22:25:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.638+0000 7f6ecfaa1700 1 -- start start 2023-09-30T22:25:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.638+0000 7f6ecfaa1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec81228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.638+0000 7f6ecfaa1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ec80a1380 0x7f6ec8122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.638+0000 7f6ecfaa1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ec8134120 0x7f6ec8123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.638+0000 7f6ecfaa1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80a03e0 con 0x7f6ec8134120 2023-09-30T22:25:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.638+0000 7f6ecfaa1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8124660 con 0x7f6ec80a0a70 2023-09-30T22:25:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.638+0000 7f6ecfaa1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81333f0 con 0x7f6ec80a1380 2023-09-30T22:25:28.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.638+0000 7f6ecd83d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec81228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ece03e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ec8134120 0x7f6ec8123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ecd83d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec81228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36616/0 (socket says 172.21.15.154:36616) 2023-09-30T22:25:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ecd83d700 1 -- 172.21.15.154:0/3024741883 learned_addr learned my addr 172.21.15.154:0/3024741883 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ecd03c700 1 --2- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ec80a1380 0x7f6ec8122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ece03e700 1 -- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ec80a1380 msgr2=0x7f6ec8122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ece03e700 1 --2- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ec80a1380 0x7f6ec8122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ece03e700 1 -- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 msgr2=0x7f6ec81228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ece03e700 1 --2- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec81228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ece03e700 1 -- 172.21.15.154:0/3024741883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec40094a0 con 0x7f6ec8134120 2023-09-30T22:25:28.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ece03e700 1 --2- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ec8134120 0x7f6ec8123350 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000efc0 tx=0x7f6ec000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ebe7fc700 1 -- 172.21.15.154:0/3024741883 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0003c20 con 0x7f6ec8134120 2023-09-30T22:25:28.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ebe7fc700 1 -- 172.21.15.154:0/3024741883 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000f040 con 0x7f6ec8134120 2023-09-30T22:25:28.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/3024741883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec8133aa0 con 0x7f6ec8134120 2023-09-30T22:25:28.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ebe7fc700 1 -- 172.21.15.154:0/3024741883 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0009e60 con 0x7f6ec8134120 2023-09-30T22:25:28.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.639+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/3024741883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8133820 con 0x7f6ec8134120 2023-09-30T22:25:28.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.640+0000 7f6ebe7fc700 1 -- 172.21.15.154:0/3024741883 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ec00179c0 con 0x7f6ec8134120 2023-09-30T22:25:28.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.641+0000 7f6ebe7fc700 1 -- 172.21.15.154:0/3024741883 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ec0047d70 con 0x7f6ec8134120 2023-09-30T22:25:28.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.641+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/3024741883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec804f2a0 con 0x7f6ec8134120 2023-09-30T22:25:28.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.649+0000 7f6ebe7fc700 1 -- 172.21.15.154:0/3024741883 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ec0004030 con 0x7f6ec8134120 2023-09-30T22:25:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.684+0000 7fb7f427c700 1 Processor -- start 2023-09-30T22:25:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.684+0000 7fb7f427c700 1 -- start start 2023-09-30T22:25:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.685+0000 7fb7f427c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7ec09d860 0x7fb7ec09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.685+0000 7fb7f427c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec130eb0 0x7fb7ec138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.685+0000 7fb7f427c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ec09aaa0 con 0x7fb7ec09e170 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.685+0000 7fb7f427c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec09f870 con 0x7fb7ec09d860 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.685+0000 7fb7f427c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec09b360 con 0x7fb7ec130eb0 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.685+0000 7fb7f2819700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec130eb0 0x7fb7ec138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.685+0000 7fb7f2819700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec130eb0 0x7fb7ec138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36620/0 (socket says 172.21.15.154:36620) 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.685+0000 7fb7f2819700 1 -- 172.21.15.154:0/1389980907 learned_addr learned my addr 172.21.15.154:0/1389980907 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.685+0000 7fb7f2018700 1 --2- 172.21.15.154:0/1389980907 >> v2:172.21.15.154:3300/0 conn(0x7fb7ec09d860 0x7fb7ec09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f1016700 1 -- 172.21.15.154:0/1389980907 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269891367 0 0) 0x7fb7ec09aaa0 con 0x7fb7ec09e170 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f2819700 1 -- 172.21.15.154:0/1389980907 >> v2:172.21.15.154:3300/0 conn(0x7fb7ec09d860 msgr2=0x7fb7ec09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f2819700 1 --2- 172.21.15.154:0/1389980907 >> v2:172.21.15.154:3300/0 conn(0x7fb7ec09d860 0x7fb7ec09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f2819700 1 -- 172.21.15.154:0/1389980907 >> v1:172.21.15.154:6789/0 conn(0x7fb7ec09e170 legacy=0x7fb7ec1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f2819700 1 -- 172.21.15.154:0/1389980907 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec09b620 con 0x7fb7ec130eb0 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f2018700 1 --2- 172.21.15.154:0/1389980907 >> v2:172.21.15.154:3300/0 conn(0x7fb7ec09d860 0x7fb7ec09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f2819700 1 --2- 172.21.15.154:0/1389980907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec130eb0 0x7fb7ec138a00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009e50 tx=0x7fb7e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96f884fd4fe6902e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f1016700 1 -- 172.21.15.154:0/1389980907 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400e070 con 0x7fb7ec130eb0 2023-09-30T22:25:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f1016700 1 -- 172.21.15.154:0/1389980907 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e400b910 con 0x7fb7ec130eb0 2023-09-30T22:25:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.686+0000 7fb7f1016700 1 -- 172.21.15.154:0/1389980907 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400bcc0 con 0x7fb7ec130eb0 2023-09-30T22:25:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.687+0000 7fb7f427c700 1 -- 172.21.15.154:0/1389980907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec130eb0 msgr2=0x7fb7ec138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.687+0000 7fb7f427c700 1 --2- 172.21.15.154:0/1389980907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec130eb0 0x7fb7ec138a00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009e50 tx=0x7fb7e400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.687+0000 7fb7f427c700 1 -- 172.21.15.154:0/1389980907 shutdown_connections 2023-09-30T22:25:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.687+0000 7fb7f427c700 1 --2- 172.21.15.154:0/1389980907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec130eb0 0x7fb7ec138a00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.687+0000 7fb7f427c700 1 --2- 172.21.15.154:0/1389980907 >> v2:172.21.15.154:3300/0 conn(0x7fb7ec09d860 0x7fb7ec09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.687+0000 7fb7f427c700 1 -- 172.21.15.154:0/1389980907 >> 172.21.15.154:0/1389980907 conn(0x7fb7ec099c40 msgr2=0x7fb7ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.687+0000 7fb7f427c700 1 -- 172.21.15.154:0/1389980907 shutdown_connections 2023-09-30T22:25:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.687+0000 7fb7f427c700 1 -- 172.21.15.154:0/1389980907 wait complete. 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.688+0000 7fb7f427c700 1 Processor -- start 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.688+0000 7fb7f427c700 1 -- start start 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f427c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec09d860 0x7fb7ec1366f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f427c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec09e170 0x7fb7ec136c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f427c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7ec130eb0 0x7fb7ec1c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f427c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1199d0 con 0x7fb7ec09e170 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f427c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1362e0 con 0x7fb7ec09d860 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f427c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec119bd0 con 0x7fb7ec130eb0 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f1817700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec09e170 0x7fb7ec136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f1817700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec09e170 0x7fb7ec136c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45864/0 (socket says 172.21.15.154:45864) 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f1817700 1 -- 172.21.15.154:0/2793130847 learned_addr learned my addr 172.21.15.154:0/2793130847 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f2819700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7ec130eb0 0x7fb7ec1c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f2018700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec09d860 0x7fb7ec1366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f1817700 1 -- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7ec130eb0 msgr2=0x7fb7ec1c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f1817700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7ec130eb0 0x7fb7ec1c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f1817700 1 -- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec09d860 msgr2=0x7fb7ec1366f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f1817700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec09d860 0x7fb7ec1366f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f1817700 1 -- 172.21.15.154:0/2793130847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80094a0 con 0x7fb7ec09e170 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.689+0000 7fb7f2018700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec09d860 0x7fb7ec1366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.690+0000 7fb7f1817700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec09e170 0x7fb7ec136c30 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00c520 tx=0x7fb7dc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.690+0000 7fb7e2ffd700 1 -- 172.21.15.154:0/2793130847 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0054e0 con 0x7fb7ec09e170 2023-09-30T22:25:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.690+0000 7fb7e2ffd700 1 -- 172.21.15.154:0/2793130847 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc003680 con 0x7fb7ec09e170 2023-09-30T22:25:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.690+0000 7fb7f427c700 1 -- 172.21.15.154:0/2793130847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e4009b30 con 0x7fb7ec09e170 2023-09-30T22:25:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.690+0000 7fb7e2ffd700 1 -- 172.21.15.154:0/2793130847 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc003a30 con 0x7fb7ec09e170 2023-09-30T22:25:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.690+0000 7fb7f427c700 1 -- 172.21.15.154:0/2793130847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec0a0790 con 0x7fb7ec09e170 2023-09-30T22:25:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.691+0000 7fb7f427c700 1 -- 172.21.15.154:0/2793130847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec04f2a0 con 0x7fb7ec09e170 2023-09-30T22:25:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.692+0000 7fb7e2ffd700 1 -- 172.21.15.154:0/2793130847 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7dc003b90 con 0x7fb7ec09e170 2023-09-30T22:25:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.692+0000 7fb7e2ffd700 1 -- 172.21.15.154:0/2793130847 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7dc03ec20 con 0x7fb7ec09e170 2023-09-30T22:25:28.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.696+0000 7fb7e2ffd700 1 -- 172.21.15.154:0/2793130847 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7dc003e40 con 0x7fb7ec09e170 2023-09-30T22:25:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.782+0000 7f6e5af75700 1 -- 172.21.15.154:0/2098320342 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e5411f760 con 0x7f6e54133f50 2023-09-30T22:25:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.782+0000 7f6e517fa700 1 -- 172.21.15.154:0/2098320342 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e4c0133e0 con 0x7f6e54133f50 2023-09-30T22:25:28.783 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.784+0000 7f6e5af75700 1 -- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 msgr2=0x7f6e54122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.784+0000 7f6e5af75700 1 --2- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e54122da0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009e50 tx=0x7f6e4c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.784+0000 7f6e5af75700 1 -- 172.21.15.154:0/2098320342 shutdown_connections 2023-09-30T22:25:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.784+0000 7f6e5af75700 1 --2- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e54133f50 0x7f6e54122da0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.784+0000 7f6e5af75700 1 --2- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e540a0a70 0x7f6e54122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.784+0000 7f6e5af75700 1 --2- 172.21.15.154:0/2098320342 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e540a1380 0x7f6e54122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.784+0000 7f6e5af75700 1 -- 172.21.15.154:0/2098320342 >> 172.21.15.154:0/2098320342 conn(0x7f6e540a6610 msgr2=0x7f6e5411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.785+0000 7f6e5af75700 1 -- 172.21.15.154:0/2098320342 shutdown_connections 2023-09-30T22:25:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.785+0000 7f6e5af75700 1 -- 172.21.15.154:0/2098320342 wait complete. 2023-09-30T22:25:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.797+0000 7f6b70d17700 1 -- 172.21.15.154:0/1701971919 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6b6c04f2a0 con 0x7f6b6c1300a0 2023-09-30T22:25:28.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:28.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.797+0000 7f6b5affd700 1 -- 172.21.15.154:0/1701971919 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b5c010310 con 0x7f6b6c1300a0 2023-09-30T22:25:28.799 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:28.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.799+0000 7f6b70d17700 1 -- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b6c1300a0 msgr2=0x7f6b6c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.799+0000 7f6b70d17700 1 --2- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b6c1300a0 0x7f6b6c11da40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00e810 tx=0x7f6b5c00eb20 comp rx=0 tx=0).stop 2023-09-30T22:25:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.799+0000 7f6b70d17700 1 -- 172.21.15.154:0/1701971919 shutdown_connections 2023-09-30T22:25:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.799+0000 7f6b70d17700 1 --2- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6c133ad0 0x7f6b6c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.799+0000 7f6b70d17700 1 --2- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b6c1300a0 0x7f6b6c11da40 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.799+0000 7f6b70d17700 1 --2- 172.21.15.154:0/1701971919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6c1309f0 0x7f6b6c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.799+0000 7f6b70d17700 1 -- 172.21.15.154:0/1701971919 >> 172.21.15.154:0/1701971919 conn(0x7f6b6c099c40 msgr2=0x7f6b6c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.799+0000 7f6b70d17700 1 -- 172.21.15.154:0/1701971919 shutdown_connections 2023-09-30T22:25:28.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.799+0000 7f6b70d17700 1 -- 172.21.15.154:0/1701971919 wait complete. 2023-09-30T22:25:28.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:28.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.863+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/3024741883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ec8072980 con 0x7f6ec8134120 2023-09-30T22:25:28.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.863+0000 7f6ebe7fc700 1 -- 172.21.15.154:0/3024741883 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ec00283a0 con 0x7f6ec8134120 2023-09-30T22:25:28.864 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.865+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ec8134120 msgr2=0x7f6ec8123350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.865+0000 7f6ecfaa1700 1 --2- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ec8134120 0x7f6ec8123350 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000efc0 tx=0x7f6ec000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.865+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/3024741883 shutdown_connections 2023-09-30T22:25:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.865+0000 7f6ecfaa1700 1 --2- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ec8134120 0x7f6ec8123350 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.865+0000 7f6ecfaa1700 1 --2- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ec80a0a70 0x7f6ec81228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.865+0000 7f6ecfaa1700 1 --2- 172.21.15.154:0/3024741883 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ec80a1380 0x7f6ec8122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.865+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/3024741883 >> 172.21.15.154:0/3024741883 conn(0x7f6ec80a6610 msgr2=0x7f6ec80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.865+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/3024741883 shutdown_connections 2023-09-30T22:25:28.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.865+0000 7f6ecfaa1700 1 -- 172.21.15.154:0/3024741883 wait complete. 2023-09-30T22:25:28.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:28.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.927+0000 7fb7f427c700 1 -- 172.21.15.154:0/2793130847 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb7ec0a1f20 con 0x7fb7ec09e170 2023-09-30T22:25:28.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.927+0000 7fb7e2ffd700 1 -- 172.21.15.154:0/2793130847 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7dc017070 con 0x7fb7ec09e170 2023-09-30T22:25:28.928 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.929+0000 7fb7f427c700 1 -- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec09e170 msgr2=0x7fb7ec136c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.929+0000 7fb7f427c700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec09e170 0x7fb7ec136c30 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00c520 tx=0x7fb7dc00c830 comp rx=0 tx=0).stop 2023-09-30T22:25:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.929+0000 7fb7f427c700 1 -- 172.21.15.154:0/2793130847 shutdown_connections 2023-09-30T22:25:28.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.929+0000 7fb7f427c700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7ec130eb0 0x7fb7ec1c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.929+0000 7fb7f427c700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7ec09d860 0x7fb7ec1366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.929+0000 7fb7f427c700 1 --2- 172.21.15.154:0/2793130847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7ec09e170 0x7fb7ec136c30 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:28.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.929+0000 7fb7f427c700 1 -- 172.21.15.154:0/2793130847 >> 172.21.15.154:0/2793130847 conn(0x7fb7ec099c40 msgr2=0x7fb7ec1395d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:28.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.929+0000 7fb7f427c700 1 -- 172.21.15.154:0/2793130847 shutdown_connections 2023-09-30T22:25:28.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:28.929+0000 7fb7f427c700 1 -- 172.21.15.154:0/2793130847 wait complete. 2023-09-30T22:25:28.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:29.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:29.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:29.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:29.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.935+0000 7f115dedc700 1 Processor -- start 2023-09-30T22:25:29.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.935+0000 7f115dedc700 1 -- start start 2023-09-30T22:25:29.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.935+0000 7f115dedc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.935+0000 7f115dedc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158130a60 0x7f1158138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.935+0000 7f115dedc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1158099a60 con 0x7f115809a730 2023-09-30T22:25:29.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.935+0000 7f115dedc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115809bf50 con 0x7f1158130a60 2023-09-30T22:25:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.935+0000 7f115dedc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f115809b230 con 0x7f1158099e20 2023-09-30T22:25:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f11577fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f1156ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f115809a730 0x7f1158130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43816/0 (socket says 172.21.15.154:43816) 2023-09-30T22:25:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f1156ffd700 1 -- 172.21.15.154:0/3358917638 learned_addr learned my addr 172.21.15.154:0/3358917638 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f1157fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158130a60 0x7f1158138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f11567fc700 1 -- 172.21.15.154:0/3358917638 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490104587 0 0) 0x7f1158099a60 con 0x7f115809a730 2023-09-30T22:25:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f1157fff700 1 -- 172.21.15.154:0/3358917638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 msgr2=0x7f115809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f1157fff700 1 --2- 172.21.15.154:0/3358917638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f1157fff700 1 -- 172.21.15.154:0/3358917638 >> v1:172.21.15.154:6789/0 conn(0x7f115809a730 legacy=0x7f1158130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f1157fff700 1 -- 172.21.15.154:0/3358917638 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115809bb90 con 0x7f1158130a60 2023-09-30T22:25:29.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f1157fff700 1 --2- 172.21.15.154:0/3358917638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158130a60 0x7f1158138690 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1150009df0 tx=0x7f115000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39fa7f23f17a752 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f11567fc700 1 -- 172.21.15.154:0/3358917638 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000e070 con 0x7f1158130a60 2023-09-30T22:25:29.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f11567fc700 1 -- 172.21.15.154:0/3358917638 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115000bae0 con 0x7f1158130a60 2023-09-30T22:25:29.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.936+0000 7f11567fc700 1 -- 172.21.15.154:0/3358917638 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000be90 con 0x7f1158130a60 2023-09-30T22:25:29.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.937+0000 7f115dedc700 1 -- 172.21.15.154:0/3358917638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158130a60 msgr2=0x7f1158138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.937+0000 7f115dedc700 1 --2- 172.21.15.154:0/3358917638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158130a60 0x7f1158138690 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1150009df0 tx=0x7f115000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:29.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.937+0000 7f115dedc700 1 -- 172.21.15.154:0/3358917638 shutdown_connections 2023-09-30T22:25:29.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.937+0000 7f115dedc700 1 --2- 172.21.15.154:0/3358917638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158130a60 0x7f1158138690 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.937+0000 7f115dedc700 1 --2- 172.21.15.154:0/3358917638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.937+0000 7f115dedc700 1 -- 172.21.15.154:0/3358917638 >> 172.21.15.154:0/3358917638 conn(0x7f11580a2980 msgr2=0x7f11580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.937+0000 7f115dedc700 1 -- 172.21.15.154:0/3358917638 shutdown_connections 2023-09-30T22:25:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.937+0000 7f115dedc700 1 -- 172.21.15.154:0/3358917638 wait complete. 2023-09-30T22:25:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.938+0000 7f115dedc700 1 Processor -- start 2023-09-30T22:25:29.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.938+0000 7f115dedc700 1 -- start start 2023-09-30T22:25:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f115dedc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115812ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f115dedc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115809a730 0x7f115812b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f115dedc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158130a60 0x7f11581c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f115dedc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11581314f0 con 0x7f1158130a60 2023-09-30T22:25:29.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f115dedc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115812db40 con 0x7f115809a730 2023-09-30T22:25:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f115dedc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11581396d0 con 0x7f1158099e20 2023-09-30T22:25:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f11577fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115812ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f11577fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115812ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35822/0 (socket says 172.21.15.154:35822) 2023-09-30T22:25:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f1157fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158130a60 0x7f11581c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f11577fe700 1 -- 172.21.15.154:0/1666257128 learned_addr learned my addr 172.21.15.154:0/1666257128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f1156ffd700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115809a730 0x7f115812b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f11577fe700 1 -- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115809a730 msgr2=0x7f115812b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f11577fe700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115809a730 0x7f115812b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f11577fe700 1 -- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158130a60 msgr2=0x7f11581c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f11577fe700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158130a60 0x7f11581c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f11577fe700 1 -- 172.21.15.154:0/1666257128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1150009a70 con 0x7f1158099e20 2023-09-30T22:25:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f1156ffd700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115809a730 0x7f115812b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.939+0000 7f1157fff700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158130a60 0x7f11581c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.940+0000 7f11577fe700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115812ade0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f114800e990 tx=0x7f114800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.940+0000 7f113ffff700 1 -- 172.21.15.154:0/1666257128 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11480096f0 con 0x7f1158099e20 2023-09-30T22:25:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.940+0000 7f113ffff700 1 -- 172.21.15.154:0/1666257128 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114800c690 con 0x7f1158099e20 2023-09-30T22:25:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.940+0000 7f115dedc700 1 -- 172.21.15.154:0/1666257128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115812aab0 con 0x7f1158099e20 2023-09-30T22:25:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.940+0000 7f113ffff700 1 -- 172.21.15.154:0/1666257128 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800ca00 con 0x7f1158099e20 2023-09-30T22:25:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.940+0000 7f115dedc700 1 -- 172.21.15.154:0/1666257128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115812c240 con 0x7f1158099e20 2023-09-30T22:25:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.941+0000 7f115dedc700 1 -- 172.21.15.154:0/1666257128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1158072480 con 0x7f1158099e20 2023-09-30T22:25:29.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.941+0000 7f113ffff700 1 -- 172.21.15.154:0/1666257128 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f114800cb60 con 0x7f1158099e20 2023-09-30T22:25:29.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.941+0000 7f113ffff700 1 -- 172.21.15.154:0/1666257128 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f114803fac0 con 0x7f1158099e20 2023-09-30T22:25:29.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:29.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.945+0000 7f113ffff700 1 -- 172.21.15.154:0/1666257128 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1158072480 con 0x7f1158099e20 2023-09-30T22:25:29.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.976+0000 7f0b8607a700 1 Processor -- start 2023-09-30T22:25:29.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.976+0000 7f0b8607a700 1 -- start start 2023-09-30T22:25:29.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b8607a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a0a30 0x7f0b800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b8607a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a1340 0x7f0b8012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b8607a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b801304a0 0x7f0b801308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b8607a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b80130e30 con 0x7f0b801304a0 2023-09-30T22:25:29.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b8607a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800a1e70 con 0x7f0b800a0a30 2023-09-30T22:25:29.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b8607a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8009a720 con 0x7f0b800a1340 2023-09-30T22:25:29.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a1340 0x7f0b8012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a1340 0x7f0b8012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35830/0 (socket says 172.21.15.154:35830) 2023-09-30T22:25:29.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7effd700 1 -- 172.21.15.154:0/2329507313 learned_addr learned my addr 172.21.15.154:0/2329507313 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:29.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7ffff700 1 --2- 172.21.15.154:0/2329507313 >> v2:172.21.15.154:3300/0 conn(0x7f0b801304a0 0x7f0b801308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7ffff700 1 -- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a1340 msgr2=0x7f0b8012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:29.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7ffff700 1 --2- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a1340 0x7f0b8012ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7ffff700 1 -- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a0a30 msgr2=0x7f0b800a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:29.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7ffff700 1 --2- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a0a30 0x7f0b800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7ffff700 1 -- 172.21.15.154:0/2329507313 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8009b300 con 0x7f0b801304a0 2023-09-30T22:25:29.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.977+0000 7f0b7effd700 1 --2- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a1340 0x7f0b8012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:29.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.978+0000 7f0b7ffff700 1 --2- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b801304a0 0x7f0b801308f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009d90 tx=0x7f0b7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd4ce019af1b387 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.978+0000 7f0b7e7fc700 1 -- 172.21.15.154:0/2329507313 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7800e070 con 0x7f0b801304a0 2023-09-30T22:25:29.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.978+0000 7f0b7e7fc700 1 -- 172.21.15.154:0/2329507313 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7800bb20 con 0x7f0b801304a0 2023-09-30T22:25:29.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.978+0000 7f0b7e7fc700 1 -- 172.21.15.154:0/2329507313 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78012430 con 0x7f0b801304a0 2023-09-30T22:25:29.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.979+0000 7f0b8607a700 1 -- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b801304a0 msgr2=0x7f0b801308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.979+0000 7f0b8607a700 1 --2- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b801304a0 0x7f0b801308f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009d90 tx=0x7f0b7800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:29.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.979+0000 7f0b8607a700 1 -- 172.21.15.154:0/2329507313 shutdown_connections 2023-09-30T22:25:29.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.979+0000 7f0b8607a700 1 --2- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a0a30 0x7f0b800a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.979+0000 7f0b8607a700 1 --2- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b801304a0 0x7f0b801308f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.979+0000 7f0b8607a700 1 --2- 172.21.15.154:0/2329507313 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a1340 0x7f0b8012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.979+0000 7f0b8607a700 1 -- 172.21.15.154:0/2329507313 >> 172.21.15.154:0/2329507313 conn(0x7f0b800a2980 msgr2=0x7f0b800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.979+0000 7f0b8607a700 1 -- 172.21.15.154:0/2329507313 shutdown_connections 2023-09-30T22:25:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.979+0000 7f0b8607a700 1 -- 172.21.15.154:0/2329507313 wait complete. 2023-09-30T22:25:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.980+0000 7f0b8607a700 1 Processor -- start 2023-09-30T22:25:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.980+0000 7f0b8607a700 1 -- start start 2023-09-30T22:25:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b8607a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a0a30 0x7f0b80132fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b8607a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a1340 0x7f0b80133510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b8607a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b801304a0 0x7f0b80133a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b8607a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b80136810 con 0x7f0b801304a0 2023-09-30T22:25:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b8607a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b80135b00 con 0x7f0b800a1340 2023-09-30T22:25:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b8607a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8009ae00 con 0x7f0b800a0a30 2023-09-30T22:25:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b7effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a1340 0x7f0b80133510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b7effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a1340 0x7f0b80133510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36660/0 (socket says 172.21.15.154:36660) 2023-09-30T22:25:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b7effd700 1 -- 172.21.15.154:0/3281859997 learned_addr learned my addr 172.21.15.154:0/3281859997 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b7f7fe700 1 --2- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a0a30 0x7f0b80132fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.981+0000 7f0b7ffff700 1 --2- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b801304a0 0x7f0b80133a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b7effd700 1 -- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a0a30 msgr2=0x7f0b80132fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b7effd700 1 --2- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a0a30 0x7f0b80132fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b7effd700 1 -- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b801304a0 msgr2=0x7f0b80133a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b7effd700 1 --2- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b801304a0 0x7f0b80133a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b7effd700 1 -- 172.21.15.154:0/3281859997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7400b7f0 con 0x7f0b800a1340 2023-09-30T22:25:29.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b7effd700 1 --2- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a1340 0x7f0b80133510 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400de30 tx=0x7f0b7400c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b67fff700 1 -- 172.21.15.154:0/3281859997 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74017400 con 0x7f0b800a1340 2023-09-30T22:25:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b8607a700 1 -- 172.21.15.154:0/3281859997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b78009a70 con 0x7f0b800a1340 2023-09-30T22:25:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b67fff700 1 -- 172.21.15.154:0/3281859997 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74017560 con 0x7f0b800a1340 2023-09-30T22:25:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b67fff700 1 -- 172.21.15.154:0/3281859997 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74017910 con 0x7f0b800a1340 2023-09-30T22:25:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.982+0000 7f0b8607a700 1 -- 172.21.15.154:0/3281859997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b80135850 con 0x7f0b800a1340 2023-09-30T22:25:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.983+0000 7f0b67fff700 1 -- 172.21.15.154:0/3281859997 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b74017a70 con 0x7f0b800a1340 2023-09-30T22:25:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.983+0000 7f0b67fff700 1 -- 172.21.15.154:0/3281859997 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b7400b030 con 0x7f0b800a1340 2023-09-30T22:25:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.983+0000 7f0b8607a700 1 -- 172.21.15.154:0/3281859997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b80135f50 con 0x7f0b800a1340 2023-09-30T22:25:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:29.988+0000 7f0b67fff700 1 -- 172.21.15.154:0/3281859997 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b7401d270 con 0x7f0b800a1340 2023-09-30T22:25:30.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.019+0000 7f5725fb5700 1 Processor -- start 2023-09-30T22:25:30.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.019+0000 7f5725fb5700 1 -- start start 2023-09-30T22:25:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.020+0000 7f5725fb5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f572009e870 0x7f572009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.020+0000 7f5725fb5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f572009f180 0x7f5720131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.020+0000 7f5725fb5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572009c970 con 0x7f5720131d70 2023-09-30T22:25:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.020+0000 7f5725fb5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200a0920 con 0x7f572009f180 2023-09-30T22:25:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.020+0000 7f5725fb5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572009f9c0 con 0x7f572009e870 2023-09-30T22:25:30.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.020+0000 7f571effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f572009f180 0x7f5720131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.020+0000 7f571f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f572009e870 0x7f572009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.020+0000 7f571effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f572009f180 0x7f5720131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45884/0 (socket says 172.21.15.154:45884) 2023-09-30T22:25:30.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.020+0000 7f571effd700 1 -- 172.21.15.154:0/2960914132 learned_addr learned my addr 172.21.15.154:0/2960914132 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:30.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.021+0000 7f571f7fe700 1 -- 172.21.15.154:0/2960914132 >> v2:172.21.15.154:3300/0 conn(0x7f572009f180 msgr2=0x7f5720131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.021+0000 7f571f7fe700 1 --2- 172.21.15.154:0/2960914132 >> v2:172.21.15.154:3300/0 conn(0x7f572009f180 0x7f5720131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.021+0000 7f571f7fe700 1 -- 172.21.15.154:0/2960914132 >> v1:172.21.15.154:6789/0 conn(0x7f5720131d70 legacy=0x7f5720138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.021+0000 7f571f7fe700 1 -- 172.21.15.154:0/2960914132 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572009bab0 con 0x7f572009e870 2023-09-30T22:25:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.021+0000 7f571effd700 1 --2- 172.21.15.154:0/2960914132 >> v2:172.21.15.154:3300/0 conn(0x7f572009f180 0x7f5720131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.021+0000 7f571f7fe700 1 --2- 172.21.15.154:0/2960914132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f572009e870 0x7f572009ec40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5710009840 tx=0x7f5710009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37db793174b04fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.021+0000 7f571e7fc700 1 -- 172.21.15.154:0/2960914132 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710011830 con 0x7f572009e870 2023-09-30T22:25:30.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.021+0000 7f571e7fc700 1 -- 172.21.15.154:0/2960914132 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710011990 con 0x7f572009e870 2023-09-30T22:25:30.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.021+0000 7f571e7fc700 1 -- 172.21.15.154:0/2960914132 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710011d20 con 0x7f572009e870 2023-09-30T22:25:30.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.022+0000 7f5725fb5700 1 -- 172.21.15.154:0/2960914132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f572009e870 msgr2=0x7f572009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.022+0000 7f5725fb5700 1 --2- 172.21.15.154:0/2960914132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f572009e870 0x7f572009ec40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5710009840 tx=0x7f5710009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:30.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.022+0000 7f5725fb5700 1 -- 172.21.15.154:0/2960914132 shutdown_connections 2023-09-30T22:25:30.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.022+0000 7f5725fb5700 1 --2- 172.21.15.154:0/2960914132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f572009e870 0x7f572009ec40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.022+0000 7f5725fb5700 1 --2- 172.21.15.154:0/2960914132 >> v2:172.21.15.154:3300/0 conn(0x7f572009f180 0x7f5720131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.022+0000 7f5725fb5700 1 -- 172.21.15.154:0/2960914132 >> 172.21.15.154:0/2960914132 conn(0x7f57200a4430 msgr2=0x7f57200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.022+0000 7f5725fb5700 1 -- 172.21.15.154:0/2960914132 shutdown_connections 2023-09-30T22:25:30.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.022+0000 7f5725fb5700 1 -- 172.21.15.154:0/2960914132 wait complete. 2023-09-30T22:25:30.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.023+0000 7f5725fb5700 1 Processor -- start 2023-09-30T22:25:30.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.023+0000 7f5725fb5700 1 -- start start 2023-09-30T22:25:30.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.023+0000 7f5725fb5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572009e870 0x7f572006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.023+0000 7f5725fb5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f572009f180 0x7f572006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.023+0000 7f5725fb5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5720131d70 0x7f572006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.023+0000 7f5725fb5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57201257d0 con 0x7f572009e870 2023-09-30T22:25:30.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.023+0000 7f5725fb5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572006d4c0 con 0x7f5720131d70 2023-09-30T22:25:30.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.023+0000 7f5725fb5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5720125b20 con 0x7f572009f180 2023-09-30T22:25:30.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.023+0000 7f571f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572009e870 0x7f572006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572009e870 0x7f572006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45890/0 (socket says 172.21.15.154:45890) 2023-09-30T22:25:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571f7fe700 1 -- 172.21.15.154:0/265616949 learned_addr learned my addr 172.21.15.154:0/265616949 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571ffff700 1 --2- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5720131d70 0x7f572006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571effd700 1 --2- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f572009f180 0x7f572006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571f7fe700 1 -- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f572009f180 msgr2=0x7f572006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571f7fe700 1 --2- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f572009f180 0x7f572006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571f7fe700 1 -- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5720131d70 msgr2=0x7f572006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571f7fe700 1 --2- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5720131d70 0x7f572006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571f7fe700 1 -- 172.21.15.154:0/265616949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714009550 con 0x7f572009e870 2023-09-30T22:25:30.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f571f7fe700 1 --2- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572009e870 0x7f572006b8b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5710009fd0 tx=0x7f5710004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f5707fff700 1 -- 172.21.15.154:0/265616949 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57100036a0 con 0x7f572009e870 2023-09-30T22:25:30.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f5707fff700 1 -- 172.21.15.154:0/265616949 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571001e070 con 0x7f572009e870 2023-09-30T22:25:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f5707fff700 1 -- 172.21.15.154:0/265616949 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710003a60 con 0x7f572009e870 2023-09-30T22:25:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f5725fb5700 1 -- 172.21.15.154:0/265616949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57100094a0 con 0x7f572009e870 2023-09-30T22:25:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.024+0000 7f5725fb5700 1 -- 172.21.15.154:0/265616949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5720125de0 con 0x7f572009e870 2023-09-30T22:25:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.025+0000 7f5725fb5700 1 -- 172.21.15.154:0/265616949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5720132820 con 0x7f572009e870 2023-09-30T22:25:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.026+0000 7f5707fff700 1 -- 172.21.15.154:0/265616949 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5710003bc0 con 0x7f572009e870 2023-09-30T22:25:30.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.026+0000 7f5707fff700 1 -- 172.21.15.154:0/265616949 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5710040ae0 con 0x7f572009e870 2023-09-30T22:25:30.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.030+0000 7f5707fff700 1 -- 172.21.15.154:0/265616949 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f571002c3b0 con 0x7f572009e870 2023-09-30T22:25:30.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.098+0000 7f850c37a700 1 Processor -- start 2023-09-30T22:25:30.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.098+0000 7f850c37a700 1 -- start start 2023-09-30T22:25:30.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850c37a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f850409d860 0x7f850409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850c37a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8504130eb0 0x7f8504138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850c37a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850409aaa0 con 0x7f850409e170 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850c37a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850409f870 con 0x7f850409d860 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850c37a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f850409b360 con 0x7f8504130eb0 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850a116700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f850409d860 0x7f850409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f8509915700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f850409e170 0x7f85041307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43836/0 (socket says 172.21.15.154:43836) 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850a116700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f850409d860 0x7f850409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36688/0 (socket says 172.21.15.154:36688) 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f8509915700 1 -- 172.21.15.154:0/4158085343 learned_addr learned my addr 172.21.15.154:0/4158085343 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850a917700 1 --2- 172.21.15.154:0/4158085343 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8504130eb0 0x7f8504138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850a116700 1 -- 172.21.15.154:0/4158085343 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8504130eb0 msgr2=0x7f8504138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850a116700 1 --2- 172.21.15.154:0/4158085343 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8504130eb0 0x7f8504138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850a116700 1 -- 172.21.15.154:0/4158085343 >> v1:172.21.15.154:6789/0 conn(0x7f850409e170 legacy=0x7f85041307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850a116700 1 -- 172.21.15.154:0/4158085343 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850409b620 con 0x7f850409d860 2023-09-30T22:25:30.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f8509114700 1 -- 172.21.15.154:0/4158085343 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428238361 0 0) 0x7f850409aaa0 con 0x7f850409e170 2023-09-30T22:25:30.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f850a116700 1 --2- 172.21.15.154:0/4158085343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f850409d860 0x7f850409dc30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8500009870 tx=0x7f8500009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e88c514b063cc94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.099+0000 7f8509114700 1 -- 172.21.15.154:0/4158085343 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500011830 con 0x7f850409d860 2023-09-30T22:25:30.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f8509114700 1 -- 172.21.15.154:0/4158085343 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8500011990 con 0x7f850409d860 2023-09-30T22:25:30.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f8509114700 1 -- 172.21.15.154:0/4158085343 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500011d20 con 0x7f850409d860 2023-09-30T22:25:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f850c37a700 1 -- 172.21.15.154:0/4158085343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f850409d860 msgr2=0x7f850409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f850c37a700 1 --2- 172.21.15.154:0/4158085343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f850409d860 0x7f850409dc30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8500009870 tx=0x7f8500009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f850c37a700 1 -- 172.21.15.154:0/4158085343 shutdown_connections 2023-09-30T22:25:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f850c37a700 1 --2- 172.21.15.154:0/4158085343 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8504130eb0 0x7f8504138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f850c37a700 1 --2- 172.21.15.154:0/4158085343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f850409d860 0x7f850409dc30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f850c37a700 1 -- 172.21.15.154:0/4158085343 >> 172.21.15.154:0/4158085343 conn(0x7f8504099c40 msgr2=0x7f85040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f850c37a700 1 -- 172.21.15.154:0/4158085343 shutdown_connections 2023-09-30T22:25:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.100+0000 7f850c37a700 1 -- 172.21.15.154:0/4158085343 wait complete. 2023-09-30T22:25:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.101+0000 7f850c37a700 1 Processor -- start 2023-09-30T22:25:30.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.101+0000 7f850c37a700 1 -- start start 2023-09-30T22:25:30.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850c37a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850409d860 0x7f8504123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850c37a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f850409e170 0x7f85041237c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850c37a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8504130eb0 0x7f85041c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:30.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850c37a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85041262a0 con 0x7f850409d860 2023-09-30T22:25:30.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850c37a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8504126480 con 0x7f8504130eb0 2023-09-30T22:25:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850c37a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8504122e90 con 0x7f850409e170 2023-09-30T22:25:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a116700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850409d860 0x7f8504123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a116700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850409d860 0x7f8504123280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45892/0 (socket says 172.21.15.154:45892) 2023-09-30T22:25:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a116700 1 -- 172.21.15.154:0/573630837 learned_addr learned my addr 172.21.15.154:0/573630837 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a917700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8504130eb0 0x7f85041c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f8509915700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f850409e170 0x7f85041237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a116700 1 -- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f850409e170 msgr2=0x7f85041237c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a116700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f850409e170 0x7f85041237c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a116700 1 -- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8504130eb0 msgr2=0x7f85041c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a116700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8504130eb0 0x7f85041c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a116700 1 -- 172.21.15.154:0/573630837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000094a0 con 0x7f850409d860 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f8509915700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f850409e170 0x7f85041237c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.102+0000 7f850a116700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850409d860 0x7f8504123280 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f8500009840 tx=0x7f8500004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.103+0000 7f84faffd700 1 -- 172.21.15.154:0/573630837 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500004590 con 0x7f850409d860 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.103+0000 7f84faffd700 1 -- 172.21.15.154:0/573630837 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850001f070 con 0x7f850409d860 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.103+0000 7f850c37a700 1 -- 172.21.15.154:0/573630837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85040a2240 con 0x7f850409d860 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.103+0000 7f850c37a700 1 -- 172.21.15.154:0/573630837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8504124570 con 0x7f850409d860 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.103+0000 7f84faffd700 1 -- 172.21.15.154:0/573630837 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85000038e0 con 0x7f850409d860 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.104+0000 7f84faffd700 1 -- 172.21.15.154:0/573630837 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8500003a40 con 0x7f850409d860 2023-09-30T22:25:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.104+0000 7f850c37a700 1 -- 172.21.15.154:0/573630837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85040a3470 con 0x7f850409d860 2023-09-30T22:25:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.104+0000 7f84faffd700 1 -- 172.21.15.154:0/573630837 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8500021070 con 0x7f850409d860 2023-09-30T22:25:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.109+0000 7f84faffd700 1 -- 172.21.15.154:0/573630837 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8500042e60 con 0x7f850409d860 2023-09-30T22:25:30.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.150+0000 7f115dedc700 1 -- 172.21.15.154:0/1666257128 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1158072480 con 0x7f1158099e20 2023-09-30T22:25:30.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.150+0000 7f113ffff700 1 -- 172.21.15.154:0/1666257128 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1158072480 con 0x7f1158099e20 2023-09-30T22:25:30.151 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:30.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.154+0000 7f115dedc700 1 -- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 msgr2=0x7f115812ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.154+0000 7f115dedc700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115812ade0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f114800e990 tx=0x7f114800eca0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.154+0000 7f115dedc700 1 -- 172.21.15.154:0/1666257128 shutdown_connections 2023-09-30T22:25:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.154+0000 7f115dedc700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158130a60 0x7f11581c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.154+0000 7f115dedc700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1158099e20 0x7f115812ade0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.154+0000 7f115dedc700 1 --2- 172.21.15.154:0/1666257128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115809a730 0x7f115812b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.154+0000 7f115dedc700 1 -- 172.21.15.154:0/1666257128 >> 172.21.15.154:0/1666257128 conn(0x7f11580a2980 msgr2=0x7f115806df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.155+0000 7f115dedc700 1 -- 172.21.15.154:0/1666257128 shutdown_connections 2023-09-30T22:25:30.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.155+0000 7f115dedc700 1 -- 172.21.15.154:0/1666257128 wait complete. 2023-09-30T22:25:30.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:30.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.215+0000 7f0b8607a700 1 -- 172.21.15.154:0/3281859997 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0b8004f2a0 con 0x7f0b800a1340 2023-09-30T22:25:30.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.215+0000 7f0b67fff700 1 -- 172.21.15.154:0/3281859997 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b74013ab0 con 0x7f0b800a1340 2023-09-30T22:25:30.216 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:30.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.217+0000 7f0b8607a700 1 -- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a1340 msgr2=0x7f0b80133510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.217+0000 7f0b8607a700 1 --2- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a1340 0x7f0b80133510 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400de30 tx=0x7f0b7400c6c0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.217+0000 7f0b8607a700 1 -- 172.21.15.154:0/3281859997 shutdown_connections 2023-09-30T22:25:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.217+0000 7f0b8607a700 1 --2- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b801304a0 0x7f0b80133a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.217+0000 7f0b8607a700 1 --2- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b800a0a30 0x7f0b80132fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.217+0000 7f0b8607a700 1 --2- 172.21.15.154:0/3281859997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b800a1340 0x7f0b80133510 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.217+0000 7f0b8607a700 1 -- 172.21.15.154:0/3281859997 >> 172.21.15.154:0/3281859997 conn(0x7f0b800a2980 msgr2=0x7f0b8009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.218+0000 7f0b8607a700 1 -- 172.21.15.154:0/3281859997 shutdown_connections 2023-09-30T22:25:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.218+0000 7f0b8607a700 1 -- 172.21.15.154:0/3281859997 wait complete. 2023-09-30T22:25:30.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.229+0000 7f5725fb5700 1 -- 172.21.15.154:0/265616949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f572004f2a0 con 0x7f572009e870 2023-09-30T22:25:30.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.229+0000 7f5707fff700 1 -- 172.21.15.154:0/265616949 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5710010b70 con 0x7f572009e870 2023-09-30T22:25:30.231 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.233+0000 7f5725fb5700 1 -- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572009e870 msgr2=0x7f572006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.233+0000 7f5725fb5700 1 --2- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572009e870 0x7f572006b8b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5710009fd0 tx=0x7f5710004750 comp rx=0 tx=0).stop 2023-09-30T22:25:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.233+0000 7f5725fb5700 1 -- 172.21.15.154:0/265616949 shutdown_connections 2023-09-30T22:25:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.233+0000 7f5725fb5700 1 --2- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5720131d70 0x7f572006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.233+0000 7f5725fb5700 1 --2- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572009e870 0x7f572006b8b0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.233+0000 7f5725fb5700 1 --2- 172.21.15.154:0/265616949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f572009f180 0x7f572006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.233+0000 7f5725fb5700 1 -- 172.21.15.154:0/265616949 >> 172.21.15.154:0/265616949 conn(0x7f57200a4430 msgr2=0x7f5720072380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.233+0000 7f5725fb5700 1 -- 172.21.15.154:0/265616949 shutdown_connections 2023-09-30T22:25:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.233+0000 7f5725fb5700 1 -- 172.21.15.154:0/265616949 wait complete. 2023-09-30T22:25:30.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.304+0000 7f850c37a700 1 -- 172.21.15.154:0/573630837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f850404f2a0 con 0x7f850409d860 2023-09-30T22:25:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.304+0000 7f84faffd700 1 -- 172.21.15.154:0/573630837 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85000253e0 con 0x7f850409d860 2023-09-30T22:25:30.305 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.306+0000 7f850c37a700 1 -- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850409d860 msgr2=0x7f8504123280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.306+0000 7f850c37a700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850409d860 0x7f8504123280 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f8500009840 tx=0x7f8500004750 comp rx=0 tx=0).stop 2023-09-30T22:25:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.306+0000 7f850c37a700 1 -- 172.21.15.154:0/573630837 shutdown_connections 2023-09-30T22:25:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.306+0000 7f850c37a700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8504130eb0 0x7f85041c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.306+0000 7f850c37a700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850409d860 0x7f8504123280 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.306+0000 7f850c37a700 1 --2- 172.21.15.154:0/573630837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f850409e170 0x7f85041237c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.306+0000 7f850c37a700 1 -- 172.21.15.154:0/573630837 >> 172.21.15.154:0/573630837 conn(0x7f8504099c40 msgr2=0x7f85040a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.306+0000 7f850c37a700 1 -- 172.21.15.154:0/573630837 shutdown_connections 2023-09-30T22:25:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:30.306+0000 7f850c37a700 1 -- 172.21.15.154:0/573630837 wait complete. 2023-09-30T22:25:30.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:31.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:31.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:31.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.314+0000 7f0dcebad700 1 Processor -- start 2023-09-30T22:25:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.314+0000 7f0dcebad700 1 -- start start 2023-09-30T22:25:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.314+0000 7f0dcebad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc8099e20 0x7f0dc809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.314+0000 7f0dcebad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 0x7f0dc8138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.314+0000 7f0dcebad700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc8099a60 con 0x7f0dc809a730 2023-09-30T22:25:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.314+0000 7f0dcebad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc809bf50 con 0x7f0dc8130a60 2023-09-30T22:25:31.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.314+0000 7f0dcebad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc809b230 con 0x7f0dc8099e20 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dc7fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0dc809a730 0x7f0dc8130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43840/0 (socket says 172.21.15.154:43840) 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dcd14a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 0x7f0dc8138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dc7fff700 1 -- 172.21.15.154:0/2484342547 learned_addr learned my addr 172.21.15.154:0/2484342547 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dcc949700 1 --2- 172.21.15.154:0/2484342547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc8099e20 0x7f0dc809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dc77fe700 1 -- 172.21.15.154:0/2484342547 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274121506 0 0) 0x7f0dc8099a60 con 0x7f0dc809a730 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dc77fe700 1 -- 172.21.15.154:0/2484342547 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db80035b0 con 0x7f0dc809a730 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dcc949700 1 -- 172.21.15.154:0/2484342547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 msgr2=0x7f0dc8138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dcc949700 1 --2- 172.21.15.154:0/2484342547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 0x7f0dc8138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dcc949700 1 -- 172.21.15.154:0/2484342547 >> v1:172.21.15.154:6789/0 conn(0x7f0dc809a730 legacy=0x7f0dc8130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dcc949700 1 -- 172.21.15.154:0/2484342547 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc809bb90 con 0x7f0dc8099e20 2023-09-30T22:25:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dcd14a700 1 --2- 172.21.15.154:0/2484342547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 0x7f0dc8138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dcc949700 1 --2- 172.21.15.154:0/2484342547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc8099e20 0x7f0dc809a1f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00dc70 tx=0x7f0dbc00df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8103e2da4838b93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dc77fe700 1 -- 172.21.15.154:0/2484342547 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc012070 con 0x7f0dc8099e20 2023-09-30T22:25:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dc77fe700 1 -- 172.21.15.154:0/2484342547 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc005a20 con 0x7f0dc8099e20 2023-09-30T22:25:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.315+0000 7f0dc77fe700 1 -- 172.21.15.154:0/2484342547 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc005db0 con 0x7f0dc8099e20 2023-09-30T22:25:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.316+0000 7f0dcebad700 1 -- 172.21.15.154:0/2484342547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc8099e20 msgr2=0x7f0dc809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.316+0000 7f0dcebad700 1 --2- 172.21.15.154:0/2484342547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc8099e20 0x7f0dc809a1f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00dc70 tx=0x7f0dbc00df80 comp rx=0 tx=0).stop 2023-09-30T22:25:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.316+0000 7f0dcebad700 1 -- 172.21.15.154:0/2484342547 shutdown_connections 2023-09-30T22:25:31.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.316+0000 7f0dcebad700 1 --2- 172.21.15.154:0/2484342547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 0x7f0dc8138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.316+0000 7f0dcebad700 1 --2- 172.21.15.154:0/2484342547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc8099e20 0x7f0dc809a1f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.316+0000 7f0dcebad700 1 -- 172.21.15.154:0/2484342547 >> 172.21.15.154:0/2484342547 conn(0x7f0dc80a2980 msgr2=0x7f0dc80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.316+0000 7f0dcebad700 1 -- 172.21.15.154:0/2484342547 shutdown_connections 2023-09-30T22:25:31.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.316+0000 7f0dcebad700 1 -- 172.21.15.154:0/2484342547 wait complete. 2023-09-30T22:25:31.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.317+0000 7f0dcebad700 1 Processor -- start 2023-09-30T22:25:31.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.317+0000 7f0dcebad700 1 -- start start 2023-09-30T22:25:31.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcebad700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8099e20 0x7f0dc811b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcebad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc809a730 0x7f0dc811bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcebad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 0x7f0dc811c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcebad700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80a11e0 con 0x7f0dc8099e20 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcebad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc811ec80 con 0x7f0dc8130a60 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcebad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc809b470 con 0x7f0dc809a730 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcc949700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8099e20 0x7f0dc811b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dc7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc809a730 0x7f0dc811bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcc949700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8099e20 0x7f0dc811b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45896/0 (socket says 172.21.15.154:45896) 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcc949700 1 -- 172.21.15.154:0/815028510 learned_addr learned my addr 172.21.15.154:0/815028510 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:31.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcd14a700 1 --2- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 0x7f0dc811c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dc7fff700 1 -- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 msgr2=0x7f0dc811c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dc7fff700 1 --2- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 0x7f0dc811c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dc7fff700 1 -- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8099e20 msgr2=0x7f0dc811b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dc7fff700 1 --2- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8099e20 0x7f0dc811b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dc7fff700 1 -- 172.21.15.154:0/815028510 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc000ba90 con 0x7f0dc809a730 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dcc949700 1 --2- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8099e20 0x7f0dc811b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.318+0000 7f0dc7fff700 1 --2- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc809a730 0x7f0dc811bc80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c460 tx=0x7f0db400c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.319+0000 7f0dc57fa700 1 -- 172.21.15.154:0/815028510 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4005d70 con 0x7f0dc809a730 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.319+0000 7f0dc57fa700 1 -- 172.21.15.154:0/815028510 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db40070d0 con 0x7f0dc809a730 2023-09-30T22:25:31.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.319+0000 7f0dcebad700 1 -- 172.21.15.154:0/815028510 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc00d8d0 con 0x7f0dc809a730 2023-09-30T22:25:31.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.319+0000 7f0dc57fa700 1 -- 172.21.15.154:0/815028510 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4007440 con 0x7f0dc809a730 2023-09-30T22:25:31.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.319+0000 7f0dcebad700 1 -- 172.21.15.154:0/815028510 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc811e110 con 0x7f0dc809a730 2023-09-30T22:25:31.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.319+0000 7f0dc57fa700 1 -- 172.21.15.154:0/815028510 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0db40075a0 con 0x7f0dc809a730 2023-09-30T22:25:31.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.320+0000 7f0dc57fa700 1 -- 172.21.15.154:0/815028510 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0db403ea90 con 0x7f0dc809a730 2023-09-30T22:25:31.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.320+0000 7f0dcebad700 1 -- 172.21.15.154:0/815028510 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc8071740 con 0x7f0dc809a730 2023-09-30T22:25:31.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:31.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.324+0000 7f0dc57fa700 1 -- 172.21.15.154:0/815028510 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0db401bb10 con 0x7f0dc809a730 2023-09-30T22:25:31.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.379+0000 7f7e64b72700 1 Processor -- start 2023-09-30T22:25:31.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.379+0000 7f7e64b72700 1 -- start start 2023-09-30T22:25:31.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e64b72700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e60138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e64b72700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e601393a0 0x7f7e6013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e64b72700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6009fa00 con 0x7f7e6009e870 2023-09-30T22:25:31.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e64b72700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e600a0370 con 0x7f7e601393a0 2023-09-30T22:25:31.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e64b72700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6006bec0 con 0x7f7e6009f350 2023-09-30T22:25:31.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5e59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7e6009e870 0x7f7e6009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43848/0 (socket says 172.21.15.154:43848) 2023-09-30T22:25:31.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e60138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5e59c700 1 -- 172.21.15.154:0/701037565 learned_addr learned my addr 172.21.15.154:0/701037565 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:31.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5ed9d700 1 --2- 172.21.15.154:0/701037565 >> v2:172.21.15.154:3300/0 conn(0x7f7e601393a0 0x7f7e6013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5d59a700 1 -- 172.21.15.154:0/701037565 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623528006 0 0) 0x7f7e6009fa00 con 0x7f7e6009e870 2023-09-30T22:25:31.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5d59a700 1 -- 172.21.15.154:0/701037565 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e480035b0 con 0x7f7e6009e870 2023-09-30T22:25:31.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5dd9b700 1 -- 172.21.15.154:0/701037565 >> v2:172.21.15.154:3300/0 conn(0x7f7e601393a0 msgr2=0x7f7e6013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5dd9b700 1 --2- 172.21.15.154:0/701037565 >> v2:172.21.15.154:3300/0 conn(0x7f7e601393a0 0x7f7e6013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5dd9b700 1 -- 172.21.15.154:0/701037565 >> v1:172.21.15.154:6789/0 conn(0x7f7e6009e870 legacy=0x7f7e6009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5dd9b700 1 -- 172.21.15.154:0/701037565 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6009ada0 con 0x7f7e6009f350 2023-09-30T22:25:31.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.380+0000 7f7e5ed9d700 1 --2- 172.21.15.154:0/701037565 >> v2:172.21.15.154:3300/0 conn(0x7f7e601393a0 0x7f7e6013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.381+0000 7f7e5dd9b700 1 --2- 172.21.15.154:0/701037565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e60138e60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009840 tx=0x7f7e54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d80360e22cef62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.381+0000 7f7e5d59a700 1 -- 172.21.15.154:0/701037565 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54011830 con 0x7f7e6009f350 2023-09-30T22:25:31.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.381+0000 7f7e5d59a700 1 -- 172.21.15.154:0/701037565 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e54011990 con 0x7f7e6009f350 2023-09-30T22:25:31.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.381+0000 7f7e5d59a700 1 -- 172.21.15.154:0/701037565 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54011d20 con 0x7f7e6009f350 2023-09-30T22:25:31.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.382+0000 7f7e64b72700 1 -- 172.21.15.154:0/701037565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 msgr2=0x7f7e60138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.382+0000 7f7e64b72700 1 --2- 172.21.15.154:0/701037565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e60138e60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009840 tx=0x7f7e54009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:31.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.382+0000 7f7e64b72700 1 -- 172.21.15.154:0/701037565 shutdown_connections 2023-09-30T22:25:31.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.382+0000 7f7e64b72700 1 --2- 172.21.15.154:0/701037565 >> v2:172.21.15.154:3300/0 conn(0x7f7e601393a0 0x7f7e6013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.382+0000 7f7e64b72700 1 --2- 172.21.15.154:0/701037565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e60138e60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.382+0000 7f7e64b72700 1 -- 172.21.15.154:0/701037565 >> 172.21.15.154:0/701037565 conn(0x7f7e600a4430 msgr2=0x7f7e600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.382+0000 7f7e64b72700 1 -- 172.21.15.154:0/701037565 shutdown_connections 2023-09-30T22:25:31.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.382+0000 7f7e64b72700 1 -- 172.21.15.154:0/701037565 wait complete. 2023-09-30T22:25:31.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e64b72700 1 Processor -- start 2023-09-30T22:25:31.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e64b72700 1 -- start start 2023-09-30T22:25:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e64b72700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6009e870 0x7f7e6011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e64b72700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e6011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e64b72700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e601393a0 0x7f7e6011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e64b72700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e601347f0 con 0x7f7e601393a0 2023-09-30T22:25:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e64b72700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60072510 con 0x7f7e6009e870 2023-09-30T22:25:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e64b72700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60120d70 con 0x7f7e6009f350 2023-09-30T22:25:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e5e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6009e870 0x7f7e6011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e5e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6009e870 0x7f7e6011ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36716/0 (socket says 172.21.15.154:36716) 2023-09-30T22:25:31.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.384+0000 7f7e5e59c700 1 -- 172.21.15.154:0/895589216 learned_addr learned my addr 172.21.15.154:0/895589216 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.385+0000 7f7e5dd9b700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e6011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.385+0000 7f7e5ed9d700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e601393a0 0x7f7e6011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.385+0000 7f7e5e59c700 1 -- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 msgr2=0x7f7e6011f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.385+0000 7f7e5e59c700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e6011f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.385+0000 7f7e5e59c700 1 -- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e601393a0 msgr2=0x7f7e6011f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.385+0000 7f7e5e59c700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e601393a0 0x7f7e6011f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.385+0000 7f7e5e59c700 1 -- 172.21.15.154:0/895589216 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58009a70 con 0x7f7e6009e870 2023-09-30T22:25:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.385+0000 7f7e5dd9b700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e6011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:31.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.385+0000 7f7e5e59c700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6009e870 0x7f7e6011ead0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000c4d0 tx=0x7f7e5000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.386+0000 7f7e4effd700 1 -- 172.21.15.154:0/895589216 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50005d70 con 0x7f7e6009e870 2023-09-30T22:25:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.386+0000 7f7e4effd700 1 -- 172.21.15.154:0/895589216 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e500070d0 con 0x7f7e6009e870 2023-09-30T22:25:31.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.386+0000 7f7e4effd700 1 -- 172.21.15.154:0/895589216 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50007460 con 0x7f7e6009e870 2023-09-30T22:25:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.386+0000 7f7e64b72700 1 -- 172.21.15.154:0/895589216 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e540094a0 con 0x7f7e6009e870 2023-09-30T22:25:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.386+0000 7f7e64b72700 1 -- 172.21.15.154:0/895589216 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6006cfa0 con 0x7f7e6009e870 2023-09-30T22:25:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.387+0000 7f7e64b72700 1 -- 172.21.15.154:0/895589216 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6004f2a0 con 0x7f7e6009e870 2023-09-30T22:25:31.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.387+0000 7f7e4effd700 1 -- 172.21.15.154:0/895589216 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e500075c0 con 0x7f7e6009e870 2023-09-30T22:25:31.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.387+0000 7f7e4effd700 1 -- 172.21.15.154:0/895589216 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e5003eba0 con 0x7f7e6009e870 2023-09-30T22:25:31.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.396+0000 7f7e4effd700 1 -- 172.21.15.154:0/895589216 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e5000f260 con 0x7f7e6009e870 2023-09-30T22:25:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.419+0000 7f8ab3439700 1 Processor -- start 2023-09-30T22:25:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.419+0000 7f8ab3439700 1 -- start start 2023-09-30T22:25:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab3439700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 0x7f8aac09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab3439700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8aac09f260 0x7f8aac131810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab3439700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac06a770 con 0x7f8aac131d50 2023-09-30T22:25:31.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab3439700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac0a0740 con 0x7f8aac09f260 2023-09-30T22:25:31.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab3439700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac06f1f0 con 0x7f8aac09e950 2023-09-30T22:25:31.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab09d4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8aac09f260 0x7f8aac131810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab09d4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8aac09f260 0x7f8aac131810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45924/0 (socket says 172.21.15.154:45924) 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab09d4700 1 -- 172.21.15.154:0/2915098269 learned_addr learned my addr 172.21.15.154:0/2915098269 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab11d5700 1 --2- 172.21.15.154:0/2915098269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 0x7f8aac09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab09d4700 1 -- 172.21.15.154:0/2915098269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 msgr2=0x7f8aac09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab09d4700 1 --2- 172.21.15.154:0/2915098269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 0x7f8aac09ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab09d4700 1 -- 172.21.15.154:0/2915098269 >> v1:172.21.15.154:6789/0 conn(0x7f8aac131d50 legacy=0x7f8aac138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab09d4700 1 -- 172.21.15.154:0/2915098269 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0a00c0 con 0x7f8aac09f260 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.420+0000 7f8ab09d4700 1 --2- 172.21.15.154:0/2915098269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aac09f260 0x7f8aac131810 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009920 tx=0x7f8a9c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bb07760ae4f0b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.421+0000 7f8aa3fff700 1 -- 172.21.15.154:0/2915098269 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c011830 con 0x7f8aac09f260 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.421+0000 7f8aa3fff700 1 -- 172.21.15.154:0/2915098269 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c011990 con 0x7f8aac09f260 2023-09-30T22:25:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.421+0000 7f8aa3fff700 1 -- 172.21.15.154:0/2915098269 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c011d20 con 0x7f8aac09f260 2023-09-30T22:25:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.422+0000 7f8ab3439700 1 -- 172.21.15.154:0/2915098269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aac09f260 msgr2=0x7f8aac131810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.422+0000 7f8ab3439700 1 --2- 172.21.15.154:0/2915098269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aac09f260 0x7f8aac131810 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009920 tx=0x7f8a9c009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.422+0000 7f8ab3439700 1 -- 172.21.15.154:0/2915098269 shutdown_connections 2023-09-30T22:25:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.422+0000 7f8ab3439700 1 --2- 172.21.15.154:0/2915098269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 0x7f8aac09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.422+0000 7f8ab3439700 1 --2- 172.21.15.154:0/2915098269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aac09f260 0x7f8aac131810 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.422+0000 7f8ab3439700 1 -- 172.21.15.154:0/2915098269 >> 172.21.15.154:0/2915098269 conn(0x7f8aac0a0b50 msgr2=0x7f8aac0a0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.422+0000 7f8ab3439700 1 -- 172.21.15.154:0/2915098269 shutdown_connections 2023-09-30T22:25:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.422+0000 7f8ab3439700 1 -- 172.21.15.154:0/2915098269 wait complete. 2023-09-30T22:25:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.423+0000 7f8ab3439700 1 Processor -- start 2023-09-30T22:25:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.423+0000 7f8ab3439700 1 -- start start 2023-09-30T22:25:31.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab3439700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 0x7f8aac1272c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab3439700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8aac09f260 0x7f8aac127800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab3439700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aac131d50 0x7f8aac127d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab3439700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac071230 con 0x7f8aac131d50 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab3439700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac1286a0 con 0x7f8aac09e950 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab3439700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac071e60 con 0x7f8aac09f260 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab09d4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8aac09f260 0x7f8aac127800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab09d4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8aac09f260 0x7f8aac127800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35902/0 (socket says 172.21.15.154:35902) 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab09d4700 1 -- 172.21.15.154:0/3148791062 learned_addr learned my addr 172.21.15.154:0/3148791062 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab11d5700 1 --2- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 0x7f8aac1272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab19d6700 1 --2- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aac131d50 0x7f8aac127d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab09d4700 1 -- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 msgr2=0x7f8aac1272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab09d4700 1 --2- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 0x7f8aac1272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab09d4700 1 -- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aac131d50 msgr2=0x7f8aac127d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab09d4700 1 --2- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aac131d50 0x7f8aac127d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab09d4700 1 -- 172.21.15.154:0/3148791062 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c009550 con 0x7f8aac09f260 2023-09-30T22:25:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.424+0000 7f8ab09d4700 1 --2- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8aac09f260 0x7f8aac127800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c000c00 tx=0x7f8a9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.425+0000 7f8aa1ffb700 1 -- 172.21.15.154:0/3148791062 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c004510 con 0x7f8aac09f260 2023-09-30T22:25:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.425+0000 7f8aa1ffb700 1 -- 172.21.15.154:0/3148791062 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0036a0 con 0x7f8aac09f260 2023-09-30T22:25:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.425+0000 7f8ab3439700 1 -- 172.21.15.154:0/3148791062 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac129ae0 con 0x7f8aac09f260 2023-09-30T22:25:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.425+0000 7f8aa1ffb700 1 -- 172.21.15.154:0/3148791062 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c003a50 con 0x7f8aac09f260 2023-09-30T22:25:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.425+0000 7f8ab3439700 1 -- 172.21.15.154:0/3148791062 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac129dc0 con 0x7f8aac09f260 2023-09-30T22:25:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.426+0000 7f8aa1ffb700 1 -- 172.21.15.154:0/3148791062 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a9c021070 con 0x7f8aac09f260 2023-09-30T22:25:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.426+0000 7f8ab3439700 1 -- 172.21.15.154:0/3148791062 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aac130df0 con 0x7f8aac09f260 2023-09-30T22:25:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.426+0000 7f8aa1ffb700 1 -- 172.21.15.154:0/3148791062 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a9c040980 con 0x7f8aac09f260 2023-09-30T22:25:31.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.435+0000 7f8aa1ffb700 1 -- 172.21.15.154:0/3148791062 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a9c003bb0 con 0x7f8aac09f260 2023-09-30T22:25:31.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.458+0000 7f3324365700 1 Processor -- start 2023-09-30T22:25:31.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.458+0000 7f3324365700 1 -- start start 2023-09-30T22:25:31.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.459+0000 7f3324365700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09d860 0x7f331c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.459+0000 7f3324365700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f331c09e170 0x7f331c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.459+0000 7f3324365700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331c09aaa0 con 0x7f331c130ce0 2023-09-30T22:25:31.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.459+0000 7f3324365700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331c09f870 con 0x7f331c09e170 2023-09-30T22:25:31.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.459+0000 7f3324365700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c09b360 con 0x7f331c09d860 2023-09-30T22:25:31.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3321900700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f331c09e170 0x7f331c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3322101700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09d860 0x7f331c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3322101700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09d860 0x7f331c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36750/0 (socket says 172.21.15.154:36750) 2023-09-30T22:25:31.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3321900700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f331c09e170 0x7f331c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45954/0 (socket says 172.21.15.154:45954) 2023-09-30T22:25:31.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3322101700 1 -- 172.21.15.154:0/3453701816 learned_addr learned my addr 172.21.15.154:0/3453701816 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3322101700 1 -- 172.21.15.154:0/3453701816 >> v2:172.21.15.154:3300/0 conn(0x7f331c09e170 msgr2=0x7f331c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3322101700 1 --2- 172.21.15.154:0/3453701816 >> v2:172.21.15.154:3300/0 conn(0x7f331c09e170 0x7f331c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3322101700 1 -- 172.21.15.154:0/3453701816 >> v1:172.21.15.154:6789/0 conn(0x7f331c130ce0 legacy=0x7f331c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3322101700 1 -- 172.21.15.154:0/3453701816 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c09b620 con 0x7f331c09d860 2023-09-30T22:25:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f3322101700 1 --2- 172.21.15.154:0/3453701816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09d860 0x7f331c09dc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f33180098f0 tx=0x7f3318009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26b284908970ee43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f33210ff700 1 -- 172.21.15.154:0/3453701816 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318011830 con 0x7f331c09d860 2023-09-30T22:25:31.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f33210ff700 1 -- 172.21.15.154:0/3453701816 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3318011990 con 0x7f331c09d860 2023-09-30T22:25:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.460+0000 7f33210ff700 1 -- 172.21.15.154:0/3453701816 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318011d00 con 0x7f331c09d860 2023-09-30T22:25:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.461+0000 7f3324365700 1 -- 172.21.15.154:0/3453701816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09d860 msgr2=0x7f331c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.461+0000 7f3324365700 1 --2- 172.21.15.154:0/3453701816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09d860 0x7f331c09dc30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f33180098f0 tx=0x7f3318009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.462+0000 7f3324365700 1 -- 172.21.15.154:0/3453701816 shutdown_connections 2023-09-30T22:25:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.462+0000 7f3324365700 1 --2- 172.21.15.154:0/3453701816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09d860 0x7f331c09dc30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.462+0000 7f3324365700 1 --2- 172.21.15.154:0/3453701816 >> v2:172.21.15.154:3300/0 conn(0x7f331c09e170 0x7f331c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.462+0000 7f3324365700 1 -- 172.21.15.154:0/3453701816 >> 172.21.15.154:0/3453701816 conn(0x7f331c099c40 msgr2=0x7f331c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.462+0000 7f3324365700 1 -- 172.21.15.154:0/3453701816 shutdown_connections 2023-09-30T22:25:31.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.462+0000 7f3324365700 1 -- 172.21.15.154:0/3453701816 wait complete. 2023-09-30T22:25:31.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.463+0000 7f3324365700 1 Processor -- start 2023-09-30T22:25:31.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.463+0000 7f3324365700 1 -- start start 2023-09-30T22:25:31.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3324365700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f331c09d860 0x7f331c1c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3324365700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09e170 0x7f331c1c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3324365700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331c130ce0 0x7f331c1c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:31.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3324365700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c06b4b0 con 0x7f331c130ce0 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3324365700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c06b2c0 con 0x7f331c09e170 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3324365700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f331c1203a0 con 0x7f331c09d860 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3321900700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09e170 0x7f331c1c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3321900700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09e170 0x7f331c1c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36762/0 (socket says 172.21.15.154:36762) 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3321900700 1 -- 172.21.15.154:0/2348432452 learned_addr learned my addr 172.21.15.154:0/2348432452 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3322101700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f331c09d860 0x7f331c1c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3322902700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331c130ce0 0x7f331c1c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3322902700 1 -- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f331c09d860 msgr2=0x7f331c1c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3322902700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f331c09d860 0x7f331c1c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3322902700 1 -- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09e170 msgr2=0x7f331c1c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3322902700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09e170 0x7f331c1c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3322902700 1 -- 172.21.15.154:0/2348432452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318009550 con 0x7f331c130ce0 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3321900700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09e170 0x7f331c1c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.464+0000 7f3322101700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f331c09d860 0x7f331c1c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.465+0000 7f3322902700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331c130ce0 0x7f331c1c6d40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f331400cb90 tx=0x7f331400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.465+0000 7f3312ffd700 1 -- 172.21.15.154:0/2348432452 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314003c00 con 0x7f331c130ce0 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.465+0000 7f3312ffd700 1 -- 172.21.15.154:0/2348432452 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3314003d60 con 0x7f331c130ce0 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.465+0000 7f3312ffd700 1 -- 172.21.15.154:0/2348432452 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331400aa80 con 0x7f331c130ce0 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.465+0000 7f3324365700 1 -- 172.21.15.154:0/2348432452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c09a150 con 0x7f331c130ce0 2023-09-30T22:25:31.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.465+0000 7f3324365700 1 -- 172.21.15.154:0/2348432452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c09c900 con 0x7f331c130ce0 2023-09-30T22:25:31.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.466+0000 7f3324365700 1 -- 172.21.15.154:0/2348432452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331c1201d0 con 0x7f331c130ce0 2023-09-30T22:25:31.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.466+0000 7f3312ffd700 1 -- 172.21.15.154:0/2348432452 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f331400abe0 con 0x7f331c130ce0 2023-09-30T22:25:31.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.466+0000 7f3312ffd700 1 -- 172.21.15.154:0/2348432452 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f331403f530 con 0x7f331c130ce0 2023-09-30T22:25:31.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.475+0000 7f3312ffd700 1 -- 172.21.15.154:0/2348432452 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33140198f0 con 0x7f331c130ce0 2023-09-30T22:25:31.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.536+0000 7f0dcebad700 1 -- 172.21.15.154:0/815028510 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0dc8072480 con 0x7f0dc809a730 2023-09-30T22:25:31.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.537+0000 7f0dc57fa700 1 -- 172.21.15.154:0/815028510 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dc8072480 con 0x7f0dc809a730 2023-09-30T22:25:31.537 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:31.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.539+0000 7f0dcebad700 1 -- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc809a730 msgr2=0x7f0dc811bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.539+0000 7f0dcebad700 1 --2- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc809a730 0x7f0dc811bc80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c460 tx=0x7f0db400c770 comp rx=0 tx=0).stop 2023-09-30T22:25:31.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.539+0000 7f0dcebad700 1 -- 172.21.15.154:0/815028510 shutdown_connections 2023-09-30T22:25:31.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.539+0000 7f0dcebad700 1 --2- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc8130a60 0x7f0dc811c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.539+0000 7f0dcebad700 1 --2- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc8099e20 0x7f0dc811b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.539+0000 7f0dcebad700 1 --2- 172.21.15.154:0/815028510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dc809a730 0x7f0dc811bc80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.539+0000 7f0dcebad700 1 -- 172.21.15.154:0/815028510 >> 172.21.15.154:0/815028510 conn(0x7f0dc80a2980 msgr2=0x7f0dc809fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.539+0000 7f0dcebad700 1 -- 172.21.15.154:0/815028510 shutdown_connections 2023-09-30T22:25:31.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.539+0000 7f0dcebad700 1 -- 172.21.15.154:0/815028510 wait complete. 2023-09-30T22:25:31.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:31.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.600+0000 7f7e64b72700 1 -- 172.21.15.154:0/895589216 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7e60072d60 con 0x7f7e6009e870 2023-09-30T22:25:31.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.601+0000 7f7e4effd700 1 -- 172.21.15.154:0/895589216 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e50017030 con 0x7f7e6009e870 2023-09-30T22:25:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.603+0000 7f7e64b72700 1 -- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6009e870 msgr2=0x7f7e6011ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.603+0000 7f7e64b72700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6009e870 0x7f7e6011ead0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000c4d0 tx=0x7f7e5000c7e0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.603+0000 7f7e64b72700 1 -- 172.21.15.154:0/895589216 shutdown_connections 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.603+0000 7f7e64b72700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e601393a0 0x7f7e6011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.603+0000 7f7e64b72700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e6009e870 0x7f7e6011ead0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.603+0000 7f7e64b72700 1 --2- 172.21.15.154:0/895589216 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e6009f350 0x7f7e6011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.603+0000 7f7e64b72700 1 -- 172.21.15.154:0/895589216 >> 172.21.15.154:0/895589216 conn(0x7f7e600a4430 msgr2=0x7f7e600a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.603+0000 7f7e64b72700 1 -- 172.21.15.154:0/895589216 shutdown_connections 2023-09-30T22:25:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.603+0000 7f7e64b72700 1 -- 172.21.15.154:0/895589216 wait complete. 2023-09-30T22:25:31.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:31.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.632+0000 7f8ab3439700 1 -- 172.21.15.154:0/3148791062 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8aac1298e0 con 0x7f8aac09f260 2023-09-30T22:25:31.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.632+0000 7f8aa1ffb700 1 -- 172.21.15.154:0/3148791062 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a9c015030 con 0x7f8aac09f260 2023-09-30T22:25:31.632 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:31.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.635+0000 7f8ab3439700 1 -- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8aac09f260 msgr2=0x7f8aac127800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.635+0000 7f8ab3439700 1 --2- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8aac09f260 0x7f8aac127800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c000c00 tx=0x7f8a9c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.635+0000 7f8ab3439700 1 -- 172.21.15.154:0/3148791062 shutdown_connections 2023-09-30T22:25:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.635+0000 7f8ab3439700 1 --2- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aac131d50 0x7f8aac127d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.635+0000 7f8ab3439700 1 --2- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aac09e950 0x7f8aac1272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.635+0000 7f8ab3439700 1 --2- 172.21.15.154:0/3148791062 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8aac09f260 0x7f8aac127800 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.635+0000 7f8ab3439700 1 -- 172.21.15.154:0/3148791062 >> 172.21.15.154:0/3148791062 conn(0x7f8aac0a0b50 msgr2=0x7f8aac09b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.635+0000 7f8ab3439700 1 -- 172.21.15.154:0/3148791062 shutdown_connections 2023-09-30T22:25:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.635+0000 7f8ab3439700 1 -- 172.21.15.154:0/3148791062 wait complete. 2023-09-30T22:25:31.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:31.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.671+0000 7f3324365700 1 -- 172.21.15.154:0/2348432452 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f331c11ff40 con 0x7f331c130ce0 2023-09-30T22:25:31.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.671+0000 7f3312ffd700 1 -- 172.21.15.154:0/2348432452 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3314019300 con 0x7f331c130ce0 2023-09-30T22:25:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.673+0000 7f3324365700 1 -- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331c130ce0 msgr2=0x7f331c1c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.673+0000 7f3324365700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331c130ce0 0x7f331c1c6d40 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f331400cb90 tx=0x7f331400cea0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.673+0000 7f3324365700 1 -- 172.21.15.154:0/2348432452 shutdown_connections 2023-09-30T22:25:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.673+0000 7f3324365700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f331c130ce0 0x7f331c1c6d40 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.673+0000 7f3324365700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f331c09d860 0x7f331c1c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.673+0000 7f3324365700 1 --2- 172.21.15.154:0/2348432452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331c09e170 0x7f331c1c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.673+0000 7f3324365700 1 -- 172.21.15.154:0/2348432452 >> 172.21.15.154:0/2348432452 conn(0x7f331c099c40 msgr2=0x7f331c070040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.674+0000 7f3324365700 1 -- 172.21.15.154:0/2348432452 shutdown_connections 2023-09-30T22:25:31.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:31.674+0000 7f3324365700 1 -- 172.21.15.154:0/2348432452 wait complete. 2023-09-30T22:25:31.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:32.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:32.616 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:32.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:32.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.683+0000 7f014c666700 1 Processor -- start 2023-09-30T22:25:32.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.683+0000 7f014c666700 1 -- start start 2023-09-30T22:25:32.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:32.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.684+0000 7f014c666700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f014409a150 0x7f014409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.684+0000 7f014c666700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 0x7f014409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.684+0000 7f014c666700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014409af80 con 0x7f0144133c20 2023-09-30T22:25:32.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.684+0000 7f014c666700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014409a520 con 0x7f014409edb0 2023-09-30T22:25:32.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.684+0000 7f014c666700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f014409fe00 con 0x7f014409a150 2023-09-30T22:25:32.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.684+0000 7f0149c01700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 0x7f014409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.684+0000 7f014ac03700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0144133c20 0x7f01441340c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43868/0 (socket says 172.21.15.154:43868) 2023-09-30T22:25:32.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.684+0000 7f014a402700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f014409a150 0x7f014409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.684+0000 7f014ac03700 1 -- 172.21.15.154:0/2985769054 learned_addr learned my addr 172.21.15.154:0/2985769054 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:32.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149400700 1 -- 172.21.15.154:0/2985769054 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488277622 0 0) 0x7f014409af80 con 0x7f0144133c20 2023-09-30T22:25:32.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149400700 1 -- 172.21.15.154:0/2985769054 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01300035b0 con 0x7f0144133c20 2023-09-30T22:25:32.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149c01700 1 -- 172.21.15.154:0/2985769054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f014409a150 msgr2=0x7f014409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:32.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149c01700 1 --2- 172.21.15.154:0/2985769054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f014409a150 0x7f014409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149c01700 1 -- 172.21.15.154:0/2985769054 >> v1:172.21.15.154:6789/0 conn(0x7f0144133c20 legacy=0x7f01441340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149c01700 1 -- 172.21.15.154:0/2985769054 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014409f6e0 con 0x7f014409edb0 2023-09-30T22:25:32.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f014a402700 1 --2- 172.21.15.154:0/2985769054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f014409a150 0x7f014409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:32.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149c01700 1 --2- 172.21.15.154:0/2985769054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 0x7f014409f1a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f01340098a0 tx=0x7f0134009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823c8e7aa26c300b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149400700 1 -- 172.21.15.154:0/2985769054 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011830 con 0x7f014409edb0 2023-09-30T22:25:32.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149400700 1 -- 172.21.15.154:0/2985769054 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134011990 con 0x7f014409edb0 2023-09-30T22:25:32.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.685+0000 7f0149400700 1 -- 172.21.15.154:0/2985769054 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011d20 con 0x7f014409edb0 2023-09-30T22:25:32.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.686+0000 7f014c666700 1 -- 172.21.15.154:0/2985769054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 msgr2=0x7f014409f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.686+0000 7f014c666700 1 --2- 172.21.15.154:0/2985769054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 0x7f014409f1a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f01340098a0 tx=0x7f0134009bb0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.686+0000 7f014c666700 1 -- 172.21.15.154:0/2985769054 shutdown_connections 2023-09-30T22:25:32.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.686+0000 7f014c666700 1 --2- 172.21.15.154:0/2985769054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f014409a150 0x7f014409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.686+0000 7f014c666700 1 --2- 172.21.15.154:0/2985769054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 0x7f014409f1a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.686+0000 7f014c666700 1 -- 172.21.15.154:0/2985769054 >> 172.21.15.154:0/2985769054 conn(0x7f01440a4430 msgr2=0x7f01440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.686+0000 7f014c666700 1 -- 172.21.15.154:0/2985769054 shutdown_connections 2023-09-30T22:25:32.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.686+0000 7f014c666700 1 -- 172.21.15.154:0/2985769054 wait complete. 2023-09-30T22:25:32.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.687+0000 7f014c666700 1 Processor -- start 2023-09-30T22:25:32.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.687+0000 7f014c666700 1 -- start start 2023-09-30T22:25:32.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014c666700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f014409a150 0x7f01441226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014c666700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 0x7f0144122c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014c666700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0144133c20 0x7f0144123160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014c666700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0144126120 con 0x7f014409a150 2023-09-30T22:25:32.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014c666700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01441250a0 con 0x7f014409edb0 2023-09-30T22:25:32.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014c666700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01441258b0 con 0x7f0144133c20 2023-09-30T22:25:32.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014a402700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f014409a150 0x7f01441226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014ac03700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0144133c20 0x7f0144123160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014a402700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f014409a150 0x7f01441226e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45968/0 (socket says 172.21.15.154:45968) 2023-09-30T22:25:32.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014ac03700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0144133c20 0x7f0144123160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35930/0 (socket says 172.21.15.154:35930) 2023-09-30T22:25:32.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014a402700 1 -- 172.21.15.154:0/3154986454 learned_addr learned my addr 172.21.15.154:0/3154986454 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:32.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f0149c01700 1 --2- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 0x7f0144122c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014ac03700 1 -- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 msgr2=0x7f0144122c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014ac03700 1 --2- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 0x7f0144122c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014ac03700 1 -- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f014409a150 msgr2=0x7f01441226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014ac03700 1 --2- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f014409a150 0x7f01441226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014ac03700 1 -- 172.21.15.154:0/3154986454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01340094a0 con 0x7f0144133c20 2023-09-30T22:25:32.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f014ac03700 1 --2- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0144133c20 0x7f0144123160 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f013c00ca80 tx=0x7f013c00cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f013affd700 1 -- 172.21.15.154:0/3154986454 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00a9e0 con 0x7f0144133c20 2023-09-30T22:25:32.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.688+0000 7f013affd700 1 -- 172.21.15.154:0/3154986454 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00ab40 con 0x7f0144133c20 2023-09-30T22:25:32.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.689+0000 7f014c666700 1 -- 172.21.15.154:0/3154986454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01440a04a0 con 0x7f0144133c20 2023-09-30T22:25:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.689+0000 7f013affd700 1 -- 172.21.15.154:0/3154986454 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c012400 con 0x7f0144133c20 2023-09-30T22:25:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.689+0000 7f014c666700 1 -- 172.21.15.154:0/3154986454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0144125b80 con 0x7f0144133c20 2023-09-30T22:25:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.689+0000 7f013affd700 1 -- 172.21.15.154:0/3154986454 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f013c01b3b0 con 0x7f0144133c20 2023-09-30T22:25:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.689+0000 7f013affd700 1 -- 172.21.15.154:0/3154986454 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f013c03f280 con 0x7f0144133c20 2023-09-30T22:25:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.689+0000 7f014c666700 1 -- 172.21.15.154:0/3154986454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014409fa30 con 0x7f0144133c20 2023-09-30T22:25:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.694+0000 7f013affd700 1 -- 172.21.15.154:0/3154986454 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f013c0192c0 con 0x7f0144133c20 2023-09-30T22:25:32.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.759+0000 7f9615df2700 1 Processor -- start 2023-09-30T22:25:32.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.759+0000 7f9615df2700 1 -- start start 2023-09-30T22:25:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f9615df2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f96100a0a30 0x7f96100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f9615df2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9610130670 0x7f96101381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f9615df2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96100a1e70 con 0x7f96100a1340 2023-09-30T22:25:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f9615df2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961009a720 con 0x7f96100a0a30 2023-09-30T22:25:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f9615df2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961009b300 con 0x7f9610130670 2023-09-30T22:25:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f960f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f96100a0a30 0x7f96100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f960f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f96100a0a30 0x7f96100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45982/0 (socket says 172.21.15.154:45982) 2023-09-30T22:25:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f960f7fe700 1 -- 172.21.15.154:0/178117645 learned_addr learned my addr 172.21.15.154:0/178117645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f960ffff700 1 --2- 172.21.15.154:0/178117645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9610130670 0x7f96101381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f960f7fe700 1 -- 172.21.15.154:0/178117645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9610130670 msgr2=0x7f96101381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:32.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f960f7fe700 1 --2- 172.21.15.154:0/178117645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9610130670 0x7f96101381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f960f7fe700 1 -- 172.21.15.154:0/178117645 >> v1:172.21.15.154:6789/0 conn(0x7f96100a1340 legacy=0x7f961012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.760+0000 7f960f7fe700 1 -- 172.21.15.154:0/178117645 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961009abc0 con 0x7f96100a0a30 2023-09-30T22:25:32.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.761+0000 7f960f7fe700 1 --2- 172.21.15.154:0/178117645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 0x7f96100a0e00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9600006fd0 tx=0x7f9600009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2099b5cd147718ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.761+0000 7f960e7fc700 1 -- 172.21.15.154:0/178117645 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600005e30 con 0x7f96100a0a30 2023-09-30T22:25:32.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.761+0000 7f960e7fc700 1 -- 172.21.15.154:0/178117645 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600004030 con 0x7f96100a0a30 2023-09-30T22:25:32.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.761+0000 7f960e7fc700 1 -- 172.21.15.154:0/178117645 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96000043e0 con 0x7f96100a0a30 2023-09-30T22:25:32.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.762+0000 7f9615df2700 1 -- 172.21.15.154:0/178117645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 msgr2=0x7f96100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.762+0000 7f9615df2700 1 --2- 172.21.15.154:0/178117645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 0x7f96100a0e00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9600006fd0 tx=0x7f9600009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.762+0000 7f9615df2700 1 -- 172.21.15.154:0/178117645 shutdown_connections 2023-09-30T22:25:32.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.762+0000 7f9615df2700 1 --2- 172.21.15.154:0/178117645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9610130670 0x7f96101381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.762+0000 7f9615df2700 1 --2- 172.21.15.154:0/178117645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 0x7f96100a0e00 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.762+0000 7f9615df2700 1 -- 172.21.15.154:0/178117645 >> 172.21.15.154:0/178117645 conn(0x7f96100a2980 msgr2=0x7f96100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.762+0000 7f9615df2700 1 -- 172.21.15.154:0/178117645 shutdown_connections 2023-09-30T22:25:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.762+0000 7f9615df2700 1 -- 172.21.15.154:0/178117645 wait complete. 2023-09-30T22:25:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.763+0000 7f9615df2700 1 Processor -- start 2023-09-30T22:25:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.764+0000 7f9615df2700 1 -- start start 2023-09-30T22:25:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.764+0000 7f9615df2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 0x7f961006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.764+0000 7f9615df2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96100a1340 0x7f961006ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.764+0000 7f9615df2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9610130670 0x7f96101c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.764+0000 7f9615df2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961006f3d0 con 0x7f96100a0a30 2023-09-30T22:25:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.764+0000 7f9615df2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9610120980 con 0x7f96100a1340 2023-09-30T22:25:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.764+0000 7f9615df2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f961012ffd0 con 0x7f9610130670 2023-09-30T22:25:32.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.764+0000 7f960f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 0x7f961006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 0x7f961006e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45990/0 (socket says 172.21.15.154:45990) 2023-09-30T22:25:32.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960f7fe700 1 -- 172.21.15.154:0/1537547540 learned_addr learned my addr 172.21.15.154:0/1537547540 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:32.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960effd700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96100a1340 0x7f961006ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960ffff700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9610130670 0x7f96101c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960effd700 1 -- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9610130670 msgr2=0x7f96101c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960effd700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9610130670 0x7f96101c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960effd700 1 -- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 msgr2=0x7f961006e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960effd700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 0x7f961006e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960effd700 1 -- 172.21.15.154:0/1537547540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600009500 con 0x7f96100a1340 2023-09-30T22:25:32.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960f7fe700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 0x7f961006e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:32.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f960effd700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96100a1340 0x7f961006ee90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f960400c450 tx=0x7f960400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f95f7fff700 1 -- 172.21.15.154:0/1537547540 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040052d0 con 0x7f96100a1340 2023-09-30T22:25:32.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f95f7fff700 1 -- 172.21.15.154:0/1537547540 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604005430 con 0x7f96100a1340 2023-09-30T22:25:32.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f95f7fff700 1 -- 172.21.15.154:0/1537547540 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040038a0 con 0x7f96100a1340 2023-09-30T22:25:32.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.765+0000 7f9615df2700 1 -- 172.21.15.154:0/1537547540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961006e480 con 0x7f96100a1340 2023-09-30T22:25:32.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.766+0000 7f9615df2700 1 -- 172.21.15.154:0/1537547540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9610120100 con 0x7f96100a1340 2023-09-30T22:25:32.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.766+0000 7f95f7fff700 1 -- 172.21.15.154:0/1537547540 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9604003a00 con 0x7f96100a1340 2023-09-30T22:25:32.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.766+0000 7f95f7fff700 1 -- 172.21.15.154:0/1537547540 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f960403e9c0 con 0x7f96100a1340 2023-09-30T22:25:32.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.767+0000 7f9615df2700 1 -- 172.21.15.154:0/1537547540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9610120af0 con 0x7f96100a1340 2023-09-30T22:25:32.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.771+0000 7f95f7fff700 1 -- 172.21.15.154:0/1537547540 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9604017080 con 0x7f96100a1340 2023-09-30T22:25:32.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.796+0000 7f8cf4ef8700 1 Processor -- start 2023-09-30T22:25:32.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.796+0000 7f8cf4ef8700 1 -- start start 2023-09-30T22:25:32.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.796+0000 7f8cf4ef8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf009d860 0x7f8cf009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.796+0000 7f8cf4ef8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009e170 0x7f8cf01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.796+0000 7f8cf4ef8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf009aaa0 con 0x7f8cf0130ce0 2023-09-30T22:25:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.796+0000 7f8cf4ef8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf009f870 con 0x7f8cf009e170 2023-09-30T22:25:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.796+0000 7f8cf4ef8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf009b360 con 0x7f8cf009d860 2023-09-30T22:25:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8cee59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf009d860 0x7f8cf009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8cee59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf009d860 0x7f8cf009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35956/0 (socket says 172.21.15.154:35956) 2023-09-30T22:25:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8ceed9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8cf0130ce0 0x7f8cf01379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43872/0 (socket says 172.21.15.154:43872) 2023-09-30T22:25:32.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8cedd9b700 1 --2- 172.21.15.154:0/1405771774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009e170 0x7f8cf01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8cee59c700 1 -- 172.21.15.154:0/1405771774 learned_addr learned my addr 172.21.15.154:0/1405771774 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8cee59c700 1 -- 172.21.15.154:0/1405771774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009e170 msgr2=0x7f8cf01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8cee59c700 1 --2- 172.21.15.154:0/1405771774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009e170 0x7f8cf01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8cee59c700 1 -- 172.21.15.154:0/1405771774 >> v1:172.21.15.154:6789/0 conn(0x7f8cf0130ce0 legacy=0x7f8cf01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8cee59c700 1 -- 172.21.15.154:0/1405771774 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf009b620 con 0x7f8cf009d860 2023-09-30T22:25:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8cee59c700 1 --2- 172.21.15.154:0/1405771774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf009d860 0x7f8cf009dc30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009920 tx=0x7f8ce0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e47ecbbbeeebd4dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8ced59a700 1 -- 172.21.15.154:0/1405771774 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0011830 con 0x7f8cf009d860 2023-09-30T22:25:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8ced59a700 1 -- 172.21.15.154:0/1405771774 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce0011990 con 0x7f8cf009d860 2023-09-30T22:25:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.797+0000 7f8ced59a700 1 -- 172.21.15.154:0/1405771774 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0011d20 con 0x7f8cf009d860 2023-09-30T22:25:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.798+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/1405771774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf009d860 msgr2=0x7f8cf009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.798+0000 7f8cf4ef8700 1 --2- 172.21.15.154:0/1405771774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf009d860 0x7f8cf009dc30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009920 tx=0x7f8ce0009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:32.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.798+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/1405771774 shutdown_connections 2023-09-30T22:25:32.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.798+0000 7f8cf4ef8700 1 --2- 172.21.15.154:0/1405771774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf009d860 0x7f8cf009dc30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.798+0000 7f8cf4ef8700 1 --2- 172.21.15.154:0/1405771774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009e170 0x7f8cf01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.798+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/1405771774 >> 172.21.15.154:0/1405771774 conn(0x7f8cf0099c40 msgr2=0x7f8cf00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.798+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/1405771774 shutdown_connections 2023-09-30T22:25:32.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.798+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/1405771774 wait complete. 2023-09-30T22:25:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.799+0000 7f8cf4ef8700 1 Processor -- start 2023-09-30T22:25:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.799+0000 7f8cf4ef8700 1 -- start start 2023-09-30T22:25:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cf4ef8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009d860 0x7f8cf01c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cf4ef8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf009e170 0x7f8cf01cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cf4ef8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf0130ce0 0x7f8cf01ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cf4ef8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf011cd10 con 0x7f8cf009e170 2023-09-30T22:25:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cf4ef8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0122050 con 0x7f8cf009d860 2023-09-30T22:25:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cf4ef8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0130340 con 0x7f8cf0130ce0 2023-09-30T22:25:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cee59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009d860 0x7f8cf01c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cee59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009d860 0x7f8cf01c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36818/0 (socket says 172.21.15.154:36818) 2023-09-30T22:25:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cee59c700 1 -- 172.21.15.154:0/578491024 learned_addr learned my addr 172.21.15.154:0/578491024 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8ceed9d700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf0130ce0 0x7f8cf01ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cedd9b700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf009e170 0x7f8cf01cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8ceed9d700 1 -- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009d860 msgr2=0x7f8cf01c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8ceed9d700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009d860 0x7f8cf01c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8ceed9d700 1 -- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf009e170 msgr2=0x7f8cf01cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8ceed9d700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf009e170 0x7f8cf01cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8ceed9d700 1 -- 172.21.15.154:0/578491024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0009550 con 0x7f8cf0130ce0 2023-09-30T22:25:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8cee59c700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009d860 0x7f8cf01c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.800+0000 7f8ceed9d700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf0130ce0 0x7f8cf01ce220 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800a380 tx=0x7f8ce800a690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.801+0000 7f8cdeffd700 1 -- 172.21.15.154:0/578491024 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce801d640 con 0x7f8cf0130ce0 2023-09-30T22:25:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.801+0000 7f8cdeffd700 1 -- 172.21.15.154:0/578491024 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce801d7a0 con 0x7f8cf0130ce0 2023-09-30T22:25:32.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.801+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/578491024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf011b6a0 con 0x7f8cf0130ce0 2023-09-30T22:25:32.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.801+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/578491024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf006a9e0 con 0x7f8cf0130ce0 2023-09-30T22:25:32.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.801+0000 7f8cdeffd700 1 -- 172.21.15.154:0/578491024 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce801db10 con 0x7f8cf0130ce0 2023-09-30T22:25:32.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.802+0000 7f8cdeffd700 1 -- 172.21.15.154:0/578491024 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ce8007070 con 0x7f8cf0130ce0 2023-09-30T22:25:32.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.802+0000 7f8cdeffd700 1 -- 172.21.15.154:0/578491024 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ce80482b0 con 0x7f8cf0130ce0 2023-09-30T22:25:32.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.802+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/578491024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd40052e0 con 0x7f8cf0130ce0 2023-09-30T22:25:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.807+0000 7f8cdeffd700 1 -- 172.21.15.154:0/578491024 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ce80238a0 con 0x7f8cf0130ce0 2023-09-30T22:25:32.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0f11f8700 1 Processor -- start 2023-09-30T22:25:32.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0f11f8700 1 -- start start 2023-09-30T22:25:32.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0f11f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09e340 0x7ff0ec1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0f11f8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0ec135f20 0x7ff0ec138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0f11f8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec09aaa0 con 0x7ff0ec09d860 2023-09-30T22:25:32.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0f11f8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec09e730 con 0x7ff0ec135f20 2023-09-30T22:25:32.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0f11f8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec09f870 con 0x7ff0ec09e340 2023-09-30T22:25:32.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0eb59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0ec135f20 0x7ff0ec138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0eb59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0ec135f20 0x7ff0ec138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46000/0 (socket says 172.21.15.154:46000) 2023-09-30T22:25:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.837+0000 7ff0eb59e700 1 -- 172.21.15.154:0/3958927082 learned_addr learned my addr 172.21.15.154:0/3958927082 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0ea59c700 1 --2- 172.21.15.154:0/3958927082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09e340 0x7ff0ec1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0eb59e700 1 -- 172.21.15.154:0/3958927082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09e340 msgr2=0x7ff0ec1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0eb59e700 1 --2- 172.21.15.154:0/3958927082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09e340 0x7ff0ec1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0eb59e700 1 -- 172.21.15.154:0/3958927082 >> v1:172.21.15.154:6789/0 conn(0x7ff0ec09d860 legacy=0x7ff0ec09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0e9d9b700 1 -- 172.21.15.154:0/3958927082 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755715119 0 0) 0x7ff0ec09aaa0 con 0x7ff0ec09d860 2023-09-30T22:25:32.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0eb59e700 1 -- 172.21.15.154:0/3958927082 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec09b360 con 0x7ff0ec135f20 2023-09-30T22:25:32.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0eb59e700 1 --2- 172.21.15.154:0/3958927082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 0x7ff0ec138300 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400d150 tx=0x7ff0e400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d38373ab6ad12c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0e9d9b700 1 -- 172.21.15.154:0/3958927082 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4010070 con 0x7ff0ec135f20 2023-09-30T22:25:32.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0e9d9b700 1 -- 172.21.15.154:0/3958927082 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400dd10 con 0x7ff0ec135f20 2023-09-30T22:25:32.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.838+0000 7ff0e9d9b700 1 -- 172.21.15.154:0/3958927082 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400b310 con 0x7ff0ec135f20 2023-09-30T22:25:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.839+0000 7ff0f11f8700 1 -- 172.21.15.154:0/3958927082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 msgr2=0x7ff0ec138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.839+0000 7ff0f11f8700 1 --2- 172.21.15.154:0/3958927082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 0x7ff0ec138300 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400d150 tx=0x7ff0e400d460 comp rx=0 tx=0).stop 2023-09-30T22:25:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.839+0000 7ff0f11f8700 1 -- 172.21.15.154:0/3958927082 shutdown_connections 2023-09-30T22:25:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.839+0000 7ff0f11f8700 1 --2- 172.21.15.154:0/3958927082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 0x7ff0ec138300 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.839+0000 7ff0f11f8700 1 --2- 172.21.15.154:0/3958927082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09e340 0x7ff0ec1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.839+0000 7ff0f11f8700 1 -- 172.21.15.154:0/3958927082 >> 172.21.15.154:0/3958927082 conn(0x7ff0ec099c40 msgr2=0x7ff0ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.839+0000 7ff0f11f8700 1 -- 172.21.15.154:0/3958927082 shutdown_connections 2023-09-30T22:25:32.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.839+0000 7ff0f11f8700 1 -- 172.21.15.154:0/3958927082 wait complete. 2023-09-30T22:25:32.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.840+0000 7ff0f11f8700 1 Processor -- start 2023-09-30T22:25:32.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.840+0000 7ff0f11f8700 1 -- start start 2023-09-30T22:25:32.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.840+0000 7ff0f11f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09d860 0x7ff0ec131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0f11f8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0ec09e340 0x7ff0ec1319a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0f11f8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 0x7ff0ec11f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:32.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0f11f8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec09c940 con 0x7ff0ec135f20 2023-09-30T22:25:32.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0f11f8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec121b20 con 0x7ff0ec09e340 2023-09-30T22:25:32.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0f11f8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0a07b0 con 0x7ff0ec09d860 2023-09-30T22:25:32.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ead9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09d860 0x7ff0ec131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ead9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09d860 0x7ff0ec131460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35998/0 (socket says 172.21.15.154:35998) 2023-09-30T22:25:32.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ead9d700 1 -- 172.21.15.154:0/2307335392 learned_addr learned my addr 172.21.15.154:0/2307335392 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:32.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ea59c700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0ec09e340 0x7ff0ec1319a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0eb59e700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 0x7ff0ec11f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:32.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ea59c700 1 -- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09d860 msgr2=0x7ff0ec131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ea59c700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09d860 0x7ff0ec131460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ea59c700 1 -- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 msgr2=0x7ff0ec11f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ea59c700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 0x7ff0ec11f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ea59c700 1 -- 172.21.15.154:0/2307335392 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e400bd40 con 0x7ff0ec09e340 2023-09-30T22:25:32.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0eb59e700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 0x7ff0ec11f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:32.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0ea59c700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0ec09e340 0x7ff0ec1319a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000e900 tx=0x7ff0e000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:32.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.841+0000 7ff0d37fe700 1 -- 172.21.15.154:0/2307335392 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0013680 con 0x7ff0ec09e340 2023-09-30T22:25:32.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.842+0000 7ff0d37fe700 1 -- 172.21.15.154:0/2307335392 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e00137e0 con 0x7ff0ec09e340 2023-09-30T22:25:32.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.842+0000 7ff0f11f8700 1 -- 172.21.15.154:0/2307335392 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec121410 con 0x7ff0ec09e340 2023-09-30T22:25:32.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.842+0000 7ff0d37fe700 1 -- 172.21.15.154:0/2307335392 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0013b50 con 0x7ff0ec09e340 2023-09-30T22:25:32.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.842+0000 7ff0f11f8700 1 -- 172.21.15.154:0/2307335392 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec123930 con 0x7ff0ec09e340 2023-09-30T22:25:32.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.842+0000 7ff0d37fe700 1 -- 172.21.15.154:0/2307335392 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0e0013cb0 con 0x7ff0ec09e340 2023-09-30T22:25:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.842+0000 7ff0d37fe700 1 -- 172.21.15.154:0/2307335392 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff0e003fa20 con 0x7ff0ec09e340 2023-09-30T22:25:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.843+0000 7ff0f11f8700 1 -- 172.21.15.154:0/2307335392 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec04f2a0 con 0x7ff0ec09e340 2023-09-30T22:25:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.847+0000 7ff0d37fe700 1 -- 172.21.15.154:0/2307335392 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0e0017020 con 0x7ff0ec09e340 2023-09-30T22:25:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.953+0000 7f014c666700 1 -- 172.21.15.154:0/3154986454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f014404f2a0 con 0x7f0144133c20 2023-09-30T22:25:32.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.953+0000 7f013affd700 1 -- 172.21.15.154:0/3154986454 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f013c017030 con 0x7f0144133c20 2023-09-30T22:25:32.954 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.956+0000 7f014c666700 1 -- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0144133c20 msgr2=0x7f0144123160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.956+0000 7f014c666700 1 --2- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0144133c20 0x7f0144123160 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f013c00ca80 tx=0x7f013c00cd90 comp rx=0 tx=0).stop 2023-09-30T22:25:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.956+0000 7f014c666700 1 -- 172.21.15.154:0/3154986454 shutdown_connections 2023-09-30T22:25:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.956+0000 7f014c666700 1 --2- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0144133c20 0x7f0144123160 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.956+0000 7f014c666700 1 --2- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f014409a150 0x7f01441226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.956+0000 7f014c666700 1 --2- 172.21.15.154:0/3154986454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f014409edb0 0x7f0144122c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.956+0000 7f014c666700 1 -- 172.21.15.154:0/3154986454 >> 172.21.15.154:0/3154986454 conn(0x7f01440a4430 msgr2=0x7f014409c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.956+0000 7f014c666700 1 -- 172.21.15.154:0/3154986454 shutdown_connections 2023-09-30T22:25:32.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:32.956+0000 7f014c666700 1 -- 172.21.15.154:0/3154986454 wait complete. 2023-09-30T22:25:32.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:33.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.002+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/578491024 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8cd4005590 con 0x7f8cf0130ce0 2023-09-30T22:25:33.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.003+0000 7f8cdeffd700 1 -- 172.21.15.154:0/578491024 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ce80232b0 con 0x7f8cf0130ce0 2023-09-30T22:25:33.003 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.005+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf0130ce0 msgr2=0x7f8cf01ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.005+0000 7f8cf4ef8700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf0130ce0 0x7f8cf01ce220 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800a380 tx=0x7f8ce800a690 comp rx=0 tx=0).stop 2023-09-30T22:25:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.005+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/578491024 shutdown_connections 2023-09-30T22:25:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.005+0000 7f8cf4ef8700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8cf0130ce0 0x7f8cf01ce220 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.005+0000 7f8cf4ef8700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8cf009d860 0x7f8cf01c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.005+0000 7f8cf4ef8700 1 --2- 172.21.15.154:0/578491024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cf009e170 0x7f8cf01cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.005+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/578491024 >> 172.21.15.154:0/578491024 conn(0x7f8cf0099c40 msgr2=0x7f8cf01b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.005+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/578491024 shutdown_connections 2023-09-30T22:25:33.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.005+0000 7f8cf4ef8700 1 -- 172.21.15.154:0/578491024 wait complete. 2023-09-30T22:25:33.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:33.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.028+0000 7f9615df2700 1 -- 172.21.15.154:0/1537547540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f961004f2a0 con 0x7f96100a1340 2023-09-30T22:25:33.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.028+0000 7f95f7fff700 1 -- 172.21.15.154:0/1537547540 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9604019d20 con 0x7f96100a1340 2023-09-30T22:25:33.029 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:33.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.030+0000 7f9615df2700 1 -- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96100a1340 msgr2=0x7f961006ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.030+0000 7f9615df2700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96100a1340 0x7f961006ee90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f960400c450 tx=0x7f960400c760 comp rx=0 tx=0).stop 2023-09-30T22:25:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.030+0000 7f9615df2700 1 -- 172.21.15.154:0/1537547540 shutdown_connections 2023-09-30T22:25:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.030+0000 7f9615df2700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9610130670 0x7f96101c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.030+0000 7f9615df2700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96100a0a30 0x7f961006e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.030+0000 7f9615df2700 1 --2- 172.21.15.154:0/1537547540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96100a1340 0x7f961006ee90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.030+0000 7f9615df2700 1 -- 172.21.15.154:0/1537547540 >> 172.21.15.154:0/1537547540 conn(0x7f96100a2980 msgr2=0x7f96101b9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.030+0000 7f9615df2700 1 -- 172.21.15.154:0/1537547540 shutdown_connections 2023-09-30T22:25:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.030+0000 7f9615df2700 1 -- 172.21.15.154:0/1537547540 wait complete. 2023-09-30T22:25:33.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.043+0000 7ff0f11f8700 1 -- 172.21.15.154:0/2307335392 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0ec06c3b0 con 0x7ff0ec09e340 2023-09-30T22:25:33.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.044+0000 7ff0d37fe700 1 -- 172.21.15.154:0/2307335392 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0e001ada0 con 0x7ff0ec09e340 2023-09-30T22:25:33.044 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:33.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.046+0000 7ff0f11f8700 1 -- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0ec09e340 msgr2=0x7ff0ec1319a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:33.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.046+0000 7ff0f11f8700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0ec09e340 0x7ff0ec1319a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000e900 tx=0x7ff0e000ec10 comp rx=0 tx=0).stop 2023-09-30T22:25:33.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.046+0000 7ff0f11f8700 1 -- 172.21.15.154:0/2307335392 shutdown_connections 2023-09-30T22:25:33.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.046+0000 7ff0f11f8700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0ec135f20 0x7ff0ec11f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.046+0000 7ff0f11f8700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0ec09d860 0x7ff0ec131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.046+0000 7ff0f11f8700 1 --2- 172.21.15.154:0/2307335392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0ec09e340 0x7ff0ec1319a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:33.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.046+0000 7ff0f11f8700 1 -- 172.21.15.154:0/2307335392 >> 172.21.15.154:0/2307335392 conn(0x7ff0ec099c40 msgr2=0x7ff0ec132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:33.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.046+0000 7ff0f11f8700 1 -- 172.21.15.154:0/2307335392 shutdown_connections 2023-09-30T22:25:33.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:33.046+0000 7ff0f11f8700 1 -- 172.21.15.154:0/2307335392 wait complete. 2023-09-30T22:25:33.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:33.970 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:34.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:34.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:34.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:34.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.125+0000 7f694450d700 1 Processor -- start 2023-09-30T22:25:34.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.125+0000 7f694450d700 1 -- start start 2023-09-30T22:25:34.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f694450d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f694450d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f693c1300a0 0x7f693c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f694450d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c06b2d0 con 0x7f693c1309f0 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f694450d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c133610 con 0x7f693c1300a0 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f694450d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f693c09a500 con 0x7f693c133ad0 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f69422a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f69422a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36012/0 (socket says 172.21.15.154:36012) 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f6941aa8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f693c1300a0 0x7f693c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f69422a9700 1 -- 172.21.15.154:0/2323525550 learned_addr learned my addr 172.21.15.154:0/2323525550 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f6942aaa700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f693c1309f0 0x7f693c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43892/0 (socket says 172.21.15.154:43892) 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f69422a9700 1 -- 172.21.15.154:0/2323525550 >> v2:172.21.15.154:3300/0 conn(0x7f693c1300a0 msgr2=0x7f693c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f69422a9700 1 --2- 172.21.15.154:0/2323525550 >> v2:172.21.15.154:3300/0 conn(0x7f693c1300a0 0x7f693c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f69422a9700 1 -- 172.21.15.154:0/2323525550 >> v1:172.21.15.154:6789/0 conn(0x7f693c1309f0 legacy=0x7f693c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f69422a9700 1 -- 172.21.15.154:0/2323525550 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c1338b0 con 0x7f693c133ad0 2023-09-30T22:25:34.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f69412a7700 1 -- 172.21.15.154:0/2323525550 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385353534 0 0) 0x7f693c06b2d0 con 0x7f693c1309f0 2023-09-30T22:25:34.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.126+0000 7f6941aa8700 1 --2- 172.21.15.154:0/2323525550 >> v2:172.21.15.154:3300/0 conn(0x7f693c1300a0 0x7f693c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.127+0000 7f69422a9700 1 --2- 172.21.15.154:0/2323525550 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c133ea0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f69380098f0 tx=0x7f6938009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6153ff099dcb4153 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.127+0000 7f69412a7700 1 -- 172.21.15.154:0/2323525550 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938011830 con 0x7f693c133ad0 2023-09-30T22:25:34.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.127+0000 7f69412a7700 1 -- 172.21.15.154:0/2323525550 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6938011990 con 0x7f693c133ad0 2023-09-30T22:25:34.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.127+0000 7f69412a7700 1 -- 172.21.15.154:0/2323525550 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938011d20 con 0x7f693c133ad0 2023-09-30T22:25:34.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.128+0000 7f694450d700 1 -- 172.21.15.154:0/2323525550 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 msgr2=0x7f693c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.128+0000 7f694450d700 1 --2- 172.21.15.154:0/2323525550 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c133ea0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f69380098f0 tx=0x7f6938009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:34.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.128+0000 7f694450d700 1 -- 172.21.15.154:0/2323525550 shutdown_connections 2023-09-30T22:25:34.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.128+0000 7f694450d700 1 --2- 172.21.15.154:0/2323525550 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c133ea0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.128+0000 7f694450d700 1 --2- 172.21.15.154:0/2323525550 >> v2:172.21.15.154:3300/0 conn(0x7f693c1300a0 0x7f693c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.128+0000 7f694450d700 1 -- 172.21.15.154:0/2323525550 >> 172.21.15.154:0/2323525550 conn(0x7f693c099c40 msgr2=0x7f693c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.128+0000 7f694450d700 1 -- 172.21.15.154:0/2323525550 shutdown_connections 2023-09-30T22:25:34.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.128+0000 7f694450d700 1 -- 172.21.15.154:0/2323525550 wait complete. 2023-09-30T22:25:34.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.129+0000 7f694450d700 1 Processor -- start 2023-09-30T22:25:34.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.129+0000 7f694450d700 1 -- start start 2023-09-30T22:25:34.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f694450d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f693c1300a0 0x7f693c12d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f694450d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c1309f0 0x7f693c071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f694450d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f694450d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c11e180 con 0x7f693c1309f0 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f694450d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c11df90 con 0x7f693c1300a0 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f694450d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f693c11ff20 con 0x7f693c133ad0 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f6942aaa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f6942aaa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c0718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36016/0 (socket says 172.21.15.154:36016) 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f6942aaa700 1 -- 172.21.15.154:0/5194109 learned_addr learned my addr 172.21.15.154:0/5194109 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.130+0000 7f6941aa8700 1 --2- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c1309f0 0x7f693c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6941aa8700 1 -- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 msgr2=0x7f693c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6941aa8700 1 --2- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6941aa8700 1 -- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f693c1300a0 msgr2=0x7f693c12d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6941aa8700 1 --2- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f693c1300a0 0x7f693c12d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6941aa8700 1 -- 172.21.15.154:0/5194109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c0094a0 con 0x7f693c1309f0 2023-09-30T22:25:34.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6942aaa700 1 --2- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:34.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6941aa8700 1 --2- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c1309f0 0x7f693c071370 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f692c00e980 tx=0x7f692c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6932ffd700 1 -- 172.21.15.154:0/5194109 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c00eed0 con 0x7f693c1309f0 2023-09-30T22:25:34.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f694450d700 1 -- 172.21.15.154:0/5194109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6938009550 con 0x7f693c1309f0 2023-09-30T22:25:34.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6932ffd700 1 -- 172.21.15.154:0/5194109 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c00c850 con 0x7f693c1309f0 2023-09-30T22:25:34.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f6932ffd700 1 -- 172.21.15.154:0/5194109 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c00cbe0 con 0x7f693c1309f0 2023-09-30T22:25:34.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.131+0000 7f694450d700 1 -- 172.21.15.154:0/5194109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c11fbc0 con 0x7f693c1309f0 2023-09-30T22:25:34.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.132+0000 7f6932ffd700 1 -- 172.21.15.154:0/5194109 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f692c00cd40 con 0x7f693c1309f0 2023-09-30T22:25:34.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.132+0000 7f6932ffd700 1 -- 172.21.15.154:0/5194109 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f692c03f800 con 0x7f693c1309f0 2023-09-30T22:25:34.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.132+0000 7f694450d700 1 -- 172.21.15.154:0/5194109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c0a2620 con 0x7f693c1309f0 2023-09-30T22:25:34.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.141+0000 7f6932ffd700 1 -- 172.21.15.154:0/5194109 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f692c0232f0 con 0x7f693c1309f0 2023-09-30T22:25:34.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.173+0000 7f1f66a9d700 1 Processor -- start 2023-09-30T22:25:34.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.173+0000 7f1f66a9d700 1 -- start start 2023-09-30T22:25:34.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f66a9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f6009e870 0x7f1f6009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f66a9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f6009f180 0x7f1f60133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f66a9d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6006bec0 con 0x7f1f60134160 2023-09-30T22:25:34.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f66a9d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6006b990 con 0x7f1f6009f180 2023-09-30T22:25:34.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f66a9d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600a0870 con 0x7f1f6009e870 2023-09-30T22:25:34.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f64839700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f6009e870 0x7f1f6009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f64839700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f6009e870 0x7f1f6009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36846/0 (socket says 172.21.15.154:36846) 2023-09-30T22:25:34.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f64839700 1 -- 172.21.15.154:0/4071262795 learned_addr learned my addr 172.21.15.154:0/4071262795 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:34.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f5ffff700 1 --2- 172.21.15.154:0/4071262795 >> v2:172.21.15.154:3300/0 conn(0x7f1f6009f180 0x7f1f60133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f64839700 1 -- 172.21.15.154:0/4071262795 >> v2:172.21.15.154:3300/0 conn(0x7f1f6009f180 msgr2=0x7f1f60133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f64839700 1 --2- 172.21.15.154:0/4071262795 >> v2:172.21.15.154:3300/0 conn(0x7f1f6009f180 0x7f1f60133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f64839700 1 -- 172.21.15.154:0/4071262795 >> v1:172.21.15.154:6789/0 conn(0x7f1f60134160 legacy=0x7f1f6013aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f64839700 1 -- 172.21.15.154:0/4071262795 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6009af50 con 0x7f1f6009e870 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f5ffff700 1 --2- 172.21.15.154:0/4071262795 >> v2:172.21.15.154:3300/0 conn(0x7f1f6009f180 0x7f1f60133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.174+0000 7f1f64839700 1 --2- 172.21.15.154:0/4071262795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f6009e870 0x7f1f6009ec40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1f540098f0 tx=0x7f1f54009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c482c4afb898a1e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f5f7fe700 1 -- 172.21.15.154:0/4071262795 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5400b8a0 con 0x7f1f6009e870 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f5f7fe700 1 -- 172.21.15.154:0/4071262795 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5400ba00 con 0x7f1f6009e870 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f5f7fe700 1 -- 172.21.15.154:0/4071262795 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5400bd90 con 0x7f1f6009e870 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f66a9d700 1 -- 172.21.15.154:0/4071262795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f6009e870 msgr2=0x7f1f6009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f66a9d700 1 --2- 172.21.15.154:0/4071262795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f6009e870 0x7f1f6009ec40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1f540098f0 tx=0x7f1f54009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f66a9d700 1 -- 172.21.15.154:0/4071262795 shutdown_connections 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f66a9d700 1 --2- 172.21.15.154:0/4071262795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f6009e870 0x7f1f6009ec40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f66a9d700 1 --2- 172.21.15.154:0/4071262795 >> v2:172.21.15.154:3300/0 conn(0x7f1f6009f180 0x7f1f60133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f66a9d700 1 -- 172.21.15.154:0/4071262795 >> 172.21.15.154:0/4071262795 conn(0x7f1f600a4430 msgr2=0x7f1f600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.175+0000 7f1f66a9d700 1 -- 172.21.15.154:0/4071262795 shutdown_connections 2023-09-30T22:25:34.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.176+0000 7f1f66a9d700 1 -- 172.21.15.154:0/4071262795 wait complete. 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.177+0000 7f1f66a9d700 1 Processor -- start 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.177+0000 7f1f66a9d700 1 -- start start 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f66a9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f6009e870 0x7f1f601c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f66a9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f6009f180 0x7f1f601c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f66a9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f60134160 0x7f1f601c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f66a9d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f60124f90 con 0x7f1f6009e870 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f66a9d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f60126350 con 0x7f1f60134160 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f66a9d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f601249e0 con 0x7f1f6009f180 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f6503a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f60134160 0x7f1f601c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f6503a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f60134160 0x7f1f601c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36864/0 (socket says 172.21.15.154:36864) 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f6503a700 1 -- 172.21.15.154:0/1385058166 learned_addr learned my addr 172.21.15.154:0/1385058166 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:34.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f64839700 1 --2- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f6009e870 0x7f1f601c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f6503a700 1 -- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f6009f180 msgr2=0x7f1f601c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f6503a700 1 --2- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f6009f180 0x7f1f601c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f6503a700 1 -- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f6009e870 msgr2=0x7f1f601c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f6503a700 1 --2- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f6009e870 0x7f1f601c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f6503a700 1 -- 172.21.15.154:0/1385058166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f54009550 con 0x7f1f60134160 2023-09-30T22:25:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.178+0000 7f1f6503a700 1 --2- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f60134160 0x7f1f601c9040 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800cc50 tx=0x7f1f5800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.179+0000 7f1f5d7fa700 1 -- 172.21.15.154:0/1385058166 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58003c00 con 0x7f1f60134160 2023-09-30T22:25:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.179+0000 7f1f66a9d700 1 -- 172.21.15.154:0/1385058166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f60133af0 con 0x7f1f60134160 2023-09-30T22:25:34.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.179+0000 7f1f66a9d700 1 -- 172.21.15.154:0/1385058166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f601232b0 con 0x7f1f60134160 2023-09-30T22:25:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.180+0000 7f1f5d7fa700 1 -- 172.21.15.154:0/1385058166 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f58003d60 con 0x7f1f60134160 2023-09-30T22:25:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.180+0000 7f1f5d7fa700 1 -- 172.21.15.154:0/1385058166 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800ab60 con 0x7f1f60134160 2023-09-30T22:25:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.181+0000 7f1f66a9d700 1 -- 172.21.15.154:0/1385058166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f400052e0 con 0x7f1f60134160 2023-09-30T22:25:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.181+0000 7f1f5d7fa700 1 -- 172.21.15.154:0/1385058166 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f5800ad00 con 0x7f1f60134160 2023-09-30T22:25:34.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.181+0000 7f1f5d7fa700 1 -- 172.21.15.154:0/1385058166 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1f5803f810 con 0x7f1f60134160 2023-09-30T22:25:34.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.190+0000 7f1f5d7fa700 1 -- 172.21.15.154:0/1385058166 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f580198f0 con 0x7f1f60134160 2023-09-30T22:25:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.200+0000 7fbd4e2ff700 1 Processor -- start 2023-09-30T22:25:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.200+0000 7f7b84e43700 1 Processor -- start 2023-09-30T22:25:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.200+0000 7fbd4e2ff700 1 -- start start 2023-09-30T22:25:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7fbd4e2ff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd4806a770 0x7fbd481349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7fbd4e2ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4809e070 0x7fbd4813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7fbd4e2ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4809eca0 con 0x7fbd48134f00 2023-09-30T22:25:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7fbd4e2ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4806b2e0 con 0x7fbd4809e070 2023-09-30T22:25:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7fbd4e2ff700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4809f720 con 0x7fbd4806a770 2023-09-30T22:25:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.200+0000 7f7b84e43700 1 -- start start 2023-09-30T22:25:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7f7b84e43700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b80138410 0x7f7b800a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7f7b84e43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8013dd10 0x7f7b801400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7f7b84e43700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b801379e0 con 0x7f7b80138040 2023-09-30T22:25:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7f7b84e43700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800a2100 con 0x7f7b80138410 2023-09-30T22:25:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7f7b84e43700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8009b9b0 con 0x7f7b8013dd10 2023-09-30T22:25:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7fbd477fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbd48134f00 0x7fbd4809d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43904/0 (socket says 172.21.15.154:43904) 2023-09-30T22:25:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7fbd477fe700 1 -- 172.21.15.154:0/1170937521 learned_addr learned my addr 172.21.15.154:0/1170937521 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:34.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7f7b7e59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7b80138040 0x7f7b800a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43908/0 (socket says 172.21.15.154:43908) 2023-09-30T22:25:34.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7f7b7e59c700 1 -- 172.21.15.154:0/1843646020 learned_addr learned my addr 172.21.15.154:0/1843646020 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:34.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7f7b7ed9d700 1 --2- 172.21.15.154:0/1843646020 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8013dd10 0x7f7b801400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.201+0000 7fbd4c89c700 1 --2- 172.21.15.154:0/1170937521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4809e070 0x7fbd4813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7fbd4c89c700 1 -- 172.21.15.154:0/1170937521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd4806a770 msgr2=0x7fbd481349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:34.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7fbd4c89c700 1 --2- 172.21.15.154:0/1170937521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd4806a770 0x7fbd481349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7fbd4c89c700 1 -- 172.21.15.154:0/1170937521 >> v1:172.21.15.154:6789/0 conn(0x7fbd48134f00 legacy=0x7fbd4809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7fbd4c89c700 1 -- 172.21.15.154:0/1170937521 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4806b480 con 0x7fbd4809e070 2023-09-30T22:25:34.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7fbd4c89c700 1 --2- 172.21.15.154:0/1170937521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4809e070 0x7fbd4813fcf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009dc0 tx=0x7fbd4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14375b722bcc1b57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7f7b7ed9d700 1 -- 172.21.15.154:0/1843646020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b80138410 msgr2=0x7f7b800a0ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:25:34.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7f7b7ed9d700 1 --2- 172.21.15.154:0/1843646020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b80138410 0x7f7b800a0ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7f7b7ed9d700 1 -- 172.21.15.154:0/1843646020 >> v1:172.21.15.154:6789/0 conn(0x7f7b80138040 legacy=0x7f7b800a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7f7b7ed9d700 1 -- 172.21.15.154:0/1843646020 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b80137c10 con 0x7f7b8013dd10 2023-09-30T22:25:34.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7fbd46ffd700 1 -- 172.21.15.154:0/1170937521 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000e070 con 0x7fbd4809e070 2023-09-30T22:25:34.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7fbd46ffd700 1 -- 172.21.15.154:0/1170937521 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4000bbd0 con 0x7fbd4809e070 2023-09-30T22:25:34.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7fbd46ffd700 1 -- 172.21.15.154:0/1170937521 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40012430 con 0x7fbd4809e070 2023-09-30T22:25:34.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7f7b7ed9d700 1 --2- 172.21.15.154:0/1843646020 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8013dd10 0x7f7b801400f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009df0 tx=0x7f7b7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f29f5c18ae34f396 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7f7b7d59a700 1 -- 172.21.15.154:0/1843646020 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800e070 con 0x7f7b8013dd10 2023-09-30T22:25:34.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7f7b7d59a700 1 -- 172.21.15.154:0/1843646020 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7800bb90 con 0x7f7b8013dd10 2023-09-30T22:25:34.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.202+0000 7f7b7d59a700 1 -- 172.21.15.154:0/1843646020 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78012430 con 0x7f7b8013dd10 2023-09-30T22:25:34.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/1170937521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4809e070 msgr2=0x7fbd4813fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7fbd4e2ff700 1 --2- 172.21.15.154:0/1170937521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4809e070 0x7fbd4813fcf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009dc0 tx=0x7fbd4000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:34.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/1170937521 shutdown_connections 2023-09-30T22:25:34.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7fbd4e2ff700 1 --2- 172.21.15.154:0/1170937521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4809e070 0x7fbd4813fcf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7fbd4e2ff700 1 --2- 172.21.15.154:0/1170937521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd4806a770 0x7fbd481349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/1170937521 >> 172.21.15.154:0/1170937521 conn(0x7fbd48099c40 msgr2=0x7fbd480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7f7b84e43700 1 -- 172.21.15.154:0/1843646020 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8013dd10 msgr2=0x7f7b801400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7f7b84e43700 1 --2- 172.21.15.154:0/1843646020 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8013dd10 0x7f7b801400f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009df0 tx=0x7f7b7800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:34.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/1170937521 shutdown_connections 2023-09-30T22:25:34.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7f7b84e43700 1 -- 172.21.15.154:0/1843646020 shutdown_connections 2023-09-30T22:25:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7f7b84e43700 1 --2- 172.21.15.154:0/1843646020 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b8013dd10 0x7f7b801400f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7f7b84e43700 1 --2- 172.21.15.154:0/1843646020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b80138410 0x7f7b800a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7f7b84e43700 1 -- 172.21.15.154:0/1843646020 >> 172.21.15.154:0/1843646020 conn(0x7f7b800a2980 msgr2=0x7f7b800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7f7b84e43700 1 -- 172.21.15.154:0/1843646020 shutdown_connections 2023-09-30T22:25:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7f7b84e43700 1 -- 172.21.15.154:0/1843646020 wait complete. 2023-09-30T22:25:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.203+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/1170937521 wait complete. 2023-09-30T22:25:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.204+0000 7fbd4e2ff700 1 Processor -- start 2023-09-30T22:25:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.204+0000 7f7b84e43700 1 Processor -- start 2023-09-30T22:25:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.204+0000 7fbd4e2ff700 1 -- start start 2023-09-30T22:25:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd4e2ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4806a770 0x7fbd48135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd4e2ff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd4809e070 0x7fbd48135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd4e2ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd48134f00 0x7fbd481362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd4e2ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48138d70 con 0x7fbd48134f00 2023-09-30T22:25:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd4e2ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48137c60 con 0x7fbd4806a770 2023-09-30T22:25:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd4e2ff700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48140680 con 0x7fbd4809e070 2023-09-30T22:25:34.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b84e43700 1 -- start start 2023-09-30T22:25:34.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b84e43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b80138040 0x7f7b8013a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b84e43700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80138410 0x7f7b80135b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b84e43700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8013dd10 0x7f7b80136070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:34.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b84e43700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8009ecf0 con 0x7f7b80138410 2023-09-30T22:25:34.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b84e43700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b80130200 con 0x7f7b8013dd10 2023-09-30T22:25:34.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b84e43700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8013c090 con 0x7f7b80138040 2023-09-30T22:25:34.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b7e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b80138040 0x7f7b8013a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b7e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b80138040 0x7f7b8013a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36078/0 (socket says 172.21.15.154:36078) 2023-09-30T22:25:34.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b7e59c700 1 -- 172.21.15.154:0/858214900 learned_addr learned my addr 172.21.15.154:0/858214900 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:34.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd4c89c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd48134f00 0x7fbd481362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd4c89c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd48134f00 0x7fbd481362d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46060/0 (socket says 172.21.15.154:46060) 2023-09-30T22:25:34.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd4c89c700 1 -- 172.21.15.154:0/2726027051 learned_addr learned my addr 172.21.15.154:0/2726027051 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:34.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd477fe700 1 --2- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd4809e070 0x7fbd48135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7fbd47fff700 1 --2- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4806a770 0x7fbd48135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b7dd9b700 1 --2- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80138410 0x7f7b80135b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.205+0000 7f7b7ed9d700 1 --2- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8013dd10 0x7f7b80136070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:34.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd4c89c700 1 -- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd4809e070 msgr2=0x7fbd48135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd4c89c700 1 --2- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd4809e070 0x7fbd48135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd4c89c700 1 -- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4806a770 msgr2=0x7fbd48135850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd4c89c700 1 --2- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4806a770 0x7fbd48135850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd4c89c700 1 -- 172.21.15.154:0/2726027051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd40009a70 con 0x7fbd48134f00 2023-09-30T22:25:34.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7f7b7e59c700 1 -- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8013dd10 msgr2=0x7f7b80136070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7f7b7e59c700 1 --2- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8013dd10 0x7f7b80136070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7f7b7e59c700 1 -- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80138410 msgr2=0x7f7b80135b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7f7b7e59c700 1 --2- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80138410 0x7f7b80135b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd4c89c700 1 --2- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd48134f00 0x7fbd481362d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000b370 tx=0x7fbd40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7f7b7e59c700 1 -- 172.21.15.154:0/858214900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009a70 con 0x7f7b80138040 2023-09-30T22:25:34.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd44ff9700 1 -- 172.21.15.154:0/2726027051 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40004040 con 0x7fbd48134f00 2023-09-30T22:25:34.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd44ff9700 1 -- 172.21.15.154:0/2726027051 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd40020070 con 0x7fbd48134f00 2023-09-30T22:25:34.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd44ff9700 1 -- 172.21.15.154:0/2726027051 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd400043e0 con 0x7fbd48134f00 2023-09-30T22:25:34.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/2726027051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd481387d0 con 0x7fbd48134f00 2023-09-30T22:25:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.206+0000 7f7b7e59c700 1 --2- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b80138040 0x7f7b8013a8b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c500 tx=0x7f7b7000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.207+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/2726027051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4809f220 con 0x7fbd48134f00 2023-09-30T22:25:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.207+0000 7f7b6effd700 1 -- 172.21.15.154:0/858214900 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700074e0 con 0x7f7b80138040 2023-09-30T22:25:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.207+0000 7f7b6effd700 1 -- 172.21.15.154:0/858214900 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70007640 con 0x7f7b80138040 2023-09-30T22:25:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.207+0000 7f7b6effd700 1 -- 172.21.15.154:0/858214900 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70005a30 con 0x7f7b80138040 2023-09-30T22:25:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.207+0000 7f7b84e43700 1 -- 172.21.15.154:0/858214900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8013b5a0 con 0x7f7b80138040 2023-09-30T22:25:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.207+0000 7f7b84e43700 1 -- 172.21.15.154:0/858214900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8013c700 con 0x7f7b80138040 2023-09-30T22:25:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.207+0000 7fbd44ff9700 1 -- 172.21.15.154:0/2726027051 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd40004540 con 0x7fbd48134f00 2023-09-30T22:25:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.207+0000 7fbd44ff9700 1 -- 172.21.15.154:0/2726027051 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbd40022070 con 0x7fbd48134f00 2023-09-30T22:25:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.208+0000 7f7b84e43700 1 -- 172.21.15.154:0/858214900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8009a2a0 con 0x7f7b80138040 2023-09-30T22:25:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.208+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/2726027051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4804f2a0 con 0x7fbd48134f00 2023-09-30T22:25:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.209+0000 7f7b6effd700 1 -- 172.21.15.154:0/858214900 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b70005b90 con 0x7f7b80138040 2023-09-30T22:25:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.209+0000 7f7b6effd700 1 -- 172.21.15.154:0/858214900 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b7003f330 con 0x7f7b80138040 2023-09-30T22:25:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.213+0000 7f7b6effd700 1 -- 172.21.15.154:0/858214900 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b70005e40 con 0x7f7b80138040 2023-09-30T22:25:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.217+0000 7fbd44ff9700 1 -- 172.21.15.154:0/2726027051 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd400263e0 con 0x7fbd48134f00 2023-09-30T22:25:34.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.369+0000 7f694450d700 1 -- 172.21.15.154:0/5194109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f693c04f2a0 con 0x7f693c1309f0 2023-09-30T22:25:34.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.369+0000 7f6932ffd700 1 -- 172.21.15.154:0/5194109 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f692c021020 con 0x7f693c1309f0 2023-09-30T22:25:34.369 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:34.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.372+0000 7f694450d700 1 -- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c1309f0 msgr2=0x7f693c071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.372+0000 7f694450d700 1 --2- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c1309f0 0x7f693c071370 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f692c00e980 tx=0x7f692c00ec90 comp rx=0 tx=0).stop 2023-09-30T22:25:34.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.372+0000 7f694450d700 1 -- 172.21.15.154:0/5194109 shutdown_connections 2023-09-30T22:25:34.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.372+0000 7f694450d700 1 --2- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f693c133ad0 0x7f693c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.372+0000 7f694450d700 1 --2- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f693c1300a0 0x7f693c12d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.372+0000 7f694450d700 1 --2- 172.21.15.154:0/5194109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f693c1309f0 0x7f693c071370 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.372+0000 7f694450d700 1 -- 172.21.15.154:0/5194109 >> 172.21.15.154:0/5194109 conn(0x7f693c099c40 msgr2=0x7f693c132930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.372+0000 7f694450d700 1 -- 172.21.15.154:0/5194109 shutdown_connections 2023-09-30T22:25:34.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.372+0000 7f694450d700 1 -- 172.21.15.154:0/5194109 wait complete. 2023-09-30T22:25:34.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:34.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.406+0000 7f1f66a9d700 1 -- 172.21.15.154:0/1385058166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1f40005590 con 0x7f1f60134160 2023-09-30T22:25:34.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.406+0000 7f1f5d7fa700 1 -- 172.21.15.154:0/1385058166 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f58011380 con 0x7f1f60134160 2023-09-30T22:25:34.406 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:34.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.407+0000 7f7b84e43700 1 -- 172.21.15.154:0/858214900 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b8004f2a0 con 0x7f7b80138040 2023-09-30T22:25:34.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.407+0000 7f7b6effd700 1 -- 172.21.15.154:0/858214900 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b70017030 con 0x7f7b80138040 2023-09-30T22:25:34.407 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:34.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.408+0000 7f1f66a9d700 1 -- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f60134160 msgr2=0x7f1f601c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.408+0000 7f1f66a9d700 1 --2- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f60134160 0x7f1f601c9040 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800cc50 tx=0x7f1f5800cf60 comp rx=0 tx=0).stop 2023-09-30T22:25:34.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.408+0000 7f1f66a9d700 1 -- 172.21.15.154:0/1385058166 shutdown_connections 2023-09-30T22:25:34.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.408+0000 7f1f66a9d700 1 --2- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f60134160 0x7f1f601c9040 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.408+0000 7f1f66a9d700 1 --2- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f6009e870 0x7f1f601c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.408+0000 7f1f66a9d700 1 --2- 172.21.15.154:0/1385058166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f6009f180 0x7f1f601c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.408+0000 7f1f66a9d700 1 -- 172.21.15.154:0/1385058166 >> 172.21.15.154:0/1385058166 conn(0x7f1f600a4430 msgr2=0x7f1f600a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.408+0000 7f1f66a9d700 1 -- 172.21.15.154:0/1385058166 shutdown_connections 2023-09-30T22:25:34.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.408+0000 7f1f66a9d700 1 -- 172.21.15.154:0/1385058166 wait complete. 2023-09-30T22:25:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.409+0000 7f7b84e43700 1 -- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b80138040 msgr2=0x7f7b8013a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.409+0000 7f7b84e43700 1 --2- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b80138040 0x7f7b8013a8b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c500 tx=0x7f7b7000c810 comp rx=0 tx=0).stop 2023-09-30T22:25:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.409+0000 7f7b84e43700 1 -- 172.21.15.154:0/858214900 shutdown_connections 2023-09-30T22:25:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.409+0000 7f7b84e43700 1 --2- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b8013dd10 0x7f7b80136070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.409+0000 7f7b84e43700 1 --2- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b80138040 0x7f7b8013a8b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.409+0000 7f7b84e43700 1 --2- 172.21.15.154:0/858214900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80138410 0x7f7b80135b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.410+0000 7f7b84e43700 1 -- 172.21.15.154:0/858214900 >> 172.21.15.154:0/858214900 conn(0x7f7b800a2980 msgr2=0x7f7b80140dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.410+0000 7f7b84e43700 1 -- 172.21.15.154:0/858214900 shutdown_connections 2023-09-30T22:25:34.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.410+0000 7f7b84e43700 1 -- 172.21.15.154:0/858214900 wait complete. 2023-09-30T22:25:34.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.414+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/2726027051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbd4806c3b0 con 0x7fbd48134f00 2023-09-30T22:25:34.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.415+0000 7fbd44ff9700 1 -- 172.21.15.154:0/2726027051 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd4001ab70 con 0x7fbd48134f00 2023-09-30T22:25:34.415 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.417+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd48134f00 msgr2=0x7fbd481362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.417+0000 7fbd4e2ff700 1 --2- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd48134f00 0x7fbd481362d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000b370 tx=0x7fbd40004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.417+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/2726027051 shutdown_connections 2023-09-30T22:25:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.417+0000 7fbd4e2ff700 1 --2- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd48134f00 0x7fbd481362d0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.417+0000 7fbd4e2ff700 1 --2- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd4806a770 0x7fbd48135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.417+0000 7fbd4e2ff700 1 --2- 172.21.15.154:0/2726027051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd4809e070 0x7fbd48135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:34.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.417+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/2726027051 >> 172.21.15.154:0/2726027051 conn(0x7fbd48099c40 msgr2=0x7fbd4809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:34.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.417+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/2726027051 shutdown_connections 2023-09-30T22:25:34.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:34.417+0000 7fbd4e2ff700 1 -- 172.21.15.154:0/2726027051 wait complete. 2023-09-30T22:25:34.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:34.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:34.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:35.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:35.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:35.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:35.431 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:35.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.533+0000 7f0cddb0d700 1 Processor -- start 2023-09-30T22:25:35.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.533+0000 7f0cddb0d700 1 -- start start 2023-09-30T22:25:35.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.533+0000 7f0cddb0d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0cd809e870 0x7f0cd809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cddb0d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd8134330 0x7f0cd813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cddb0d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd809fa00 con 0x7f0cd809f180 2023-09-30T22:25:35.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cddb0d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd80a0370 con 0x7f0cd809e870 2023-09-30T22:25:35.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cddb0d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd806bec0 con 0x7f0cd8134330 2023-09-30T22:25:35.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cd7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd8134330 0x7f0cd813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cd7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd8134330 0x7f0cd813be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43642/0 (socket says 172.21.15.154:43642) 2023-09-30T22:25:35.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cd7fff700 1 -- 172.21.15.154:0/298092153 learned_addr learned my addr 172.21.15.154:0/298092153 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:35.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cd77fe700 1 --2- 172.21.15.154:0/298092153 >> v2:172.21.15.154:3300/0 conn(0x7f0cd809e870 0x7f0cd809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cd7fff700 1 -- 172.21.15.154:0/298092153 >> v2:172.21.15.154:3300/0 conn(0x7f0cd809e870 msgr2=0x7f0cd809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cd7fff700 1 --2- 172.21.15.154:0/298092153 >> v2:172.21.15.154:3300/0 conn(0x7f0cd809e870 0x7f0cd809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cd7fff700 1 -- 172.21.15.154:0/298092153 >> v1:172.21.15.154:6789/0 conn(0x7f0cd809f180 legacy=0x7f0cd8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cd7fff700 1 -- 172.21.15.154:0/298092153 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd809ada0 con 0x7f0cd8134330 2023-09-30T22:25:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.534+0000 7f0cd7fff700 1 --2- 172.21.15.154:0/298092153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd8134330 0x7f0cd813be80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009e50 tx=0x7f0cd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70223081e8f59f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.535+0000 7f0cd67fc700 1 -- 172.21.15.154:0/298092153 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd000e070 con 0x7f0cd8134330 2023-09-30T22:25:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.535+0000 7f0cd67fc700 1 -- 172.21.15.154:0/298092153 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd000b910 con 0x7f0cd8134330 2023-09-30T22:25:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.535+0000 7f0cd67fc700 1 -- 172.21.15.154:0/298092153 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd000bcc0 con 0x7f0cd8134330 2023-09-30T22:25:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.536+0000 7f0cddb0d700 1 -- 172.21.15.154:0/298092153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd8134330 msgr2=0x7f0cd813be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.536+0000 7f0cddb0d700 1 --2- 172.21.15.154:0/298092153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd8134330 0x7f0cd813be80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009e50 tx=0x7f0cd000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.536+0000 7f0cddb0d700 1 -- 172.21.15.154:0/298092153 shutdown_connections 2023-09-30T22:25:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.536+0000 7f0cddb0d700 1 --2- 172.21.15.154:0/298092153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd8134330 0x7f0cd813be80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.536+0000 7f0cddb0d700 1 --2- 172.21.15.154:0/298092153 >> v2:172.21.15.154:3300/0 conn(0x7f0cd809e870 0x7f0cd809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.536+0000 7f0cddb0d700 1 -- 172.21.15.154:0/298092153 >> 172.21.15.154:0/298092153 conn(0x7f0cd80a4430 msgr2=0x7f0cd80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.536+0000 7f0cddb0d700 1 -- 172.21.15.154:0/298092153 shutdown_connections 2023-09-30T22:25:35.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.536+0000 7f0cddb0d700 1 -- 172.21.15.154:0/298092153 wait complete. 2023-09-30T22:25:35.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.537+0000 7f0cddb0d700 1 Processor -- start 2023-09-30T22:25:35.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.537+0000 7f0cddb0d700 1 -- start start 2023-09-30T22:25:35.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cddb0d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cd809e870 0x7f0cd81cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cddb0d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd809f180 0x7f0cd81ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cddb0d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cd8134330 0x7f0cd81cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cddb0d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd8129d20 con 0x7f0cd809e870 2023-09-30T22:25:35.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cddb0d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd8072510 con 0x7f0cd809f180 2023-09-30T22:25:35.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cddb0d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd8127380 con 0x7f0cd8134330 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cd809e870 0x7f0cd81cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cd809e870 0x7f0cd81cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36062/0 (socket says 172.21.15.154:36062) 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd77fe700 1 -- 172.21.15.154:0/3817676625 learned_addr learned my addr 172.21.15.154:0/3817676625 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd7fff700 1 --2- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cd8134330 0x7f0cd81cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd6ffd700 1 --2- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd809f180 0x7f0cd81ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd7fff700 1 -- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd809f180 msgr2=0x7f0cd81ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd7fff700 1 --2- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd809f180 0x7f0cd81ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd7fff700 1 -- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cd809e870 msgr2=0x7f0cd81cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd7fff700 1 --2- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cd809e870 0x7f0cd81cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.538+0000 7f0cd7fff700 1 -- 172.21.15.154:0/3817676625 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0009b30 con 0x7f0cd8134330 2023-09-30T22:25:35.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.539+0000 7f0cd7fff700 1 --2- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cd8134330 0x7f0cd81cd160 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0015000 tx=0x7f0cd0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.539+0000 7f0cbffff700 1 -- 172.21.15.154:0/3817676625 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00048b0 con 0x7f0cd8134330 2023-09-30T22:25:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.539+0000 7f0cbffff700 1 -- 172.21.15.154:0/3817676625 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00092e0 con 0x7f0cd8134330 2023-09-30T22:25:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.539+0000 7f0cddb0d700 1 -- 172.21.15.154:0/3817676625 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd8128660 con 0x7f0cd8134330 2023-09-30T22:25:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.539+0000 7f0cbffff700 1 -- 172.21.15.154:0/3817676625 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd001c660 con 0x7f0cd8134330 2023-09-30T22:25:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.539+0000 7f0cddb0d700 1 -- 172.21.15.154:0/3817676625 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd811dcd0 con 0x7f0cd8134330 2023-09-30T22:25:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.540+0000 7f0cbffff700 1 -- 172.21.15.154:0/3817676625 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cd001c7c0 con 0x7f0cd8134330 2023-09-30T22:25:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.540+0000 7f0cddb0d700 1 -- 172.21.15.154:0/3817676625 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd804f2a0 con 0x7f0cd8134330 2023-09-30T22:25:35.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.540+0000 7f0cbffff700 1 -- 172.21.15.154:0/3817676625 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0cd0024a00 con 0x7f0cd8134330 2023-09-30T22:25:35.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.549+0000 7f0cbffff700 1 -- 172.21.15.154:0/3817676625 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cd0046060 con 0x7f0cd8134330 2023-09-30T22:25:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.568+0000 7f875affa700 1 Processor -- start 2023-09-30T22:25:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.568+0000 7f875affa700 1 -- start start 2023-09-30T22:25:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.569+0000 7f875affa700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f875409d860 0x7f875409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.569+0000 7f875affa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8754130eb0 0x7f8754138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.569+0000 7f875affa700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875409aaa0 con 0x7f875409e170 2023-09-30T22:25:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.569+0000 7f875affa700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875409f870 con 0x7f875409d860 2023-09-30T22:25:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.569+0000 7f875affa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875409b360 con 0x7f8754130eb0 2023-09-30T22:25:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.569+0000 7f8759597700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8754130eb0 0x7f8754138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.569+0000 7f8759597700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8754130eb0 0x7f8754138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43660/0 (socket says 172.21.15.154:43660) 2023-09-30T22:25:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.569+0000 7f8759597700 1 -- 172.21.15.154:0/2010117797 learned_addr learned my addr 172.21.15.154:0/2010117797 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.570+0000 7f8759597700 1 -- 172.21.15.154:0/2010117797 >> v2:172.21.15.154:3300/0 conn(0x7f875409d860 msgr2=0x7f875409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.570+0000 7f8759597700 1 --2- 172.21.15.154:0/2010117797 >> v2:172.21.15.154:3300/0 conn(0x7f875409d860 0x7f875409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.570+0000 7f8759597700 1 -- 172.21.15.154:0/2010117797 >> v1:172.21.15.154:6789/0 conn(0x7f875409e170 legacy=0x7f87541307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.570+0000 7f8759597700 1 -- 172.21.15.154:0/2010117797 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875409b620 con 0x7f8754130eb0 2023-09-30T22:25:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.570+0000 7f8759597700 1 --2- 172.21.15.154:0/2010117797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8754130eb0 0x7f8754138a00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f874c009e50 tx=0x7f874c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=480f93084cbee8d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.570+0000 7f87537fe700 1 -- 172.21.15.154:0/2010117797 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c00e070 con 0x7f8754130eb0 2023-09-30T22:25:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.570+0000 7f87537fe700 1 -- 172.21.15.154:0/2010117797 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c003a20 con 0x7f8754130eb0 2023-09-30T22:25:35.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.570+0000 7f87537fe700 1 -- 172.21.15.154:0/2010117797 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c003dd0 con 0x7f8754130eb0 2023-09-30T22:25:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.571+0000 7f875affa700 1 -- 172.21.15.154:0/2010117797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8754130eb0 msgr2=0x7f8754138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.571+0000 7f875affa700 1 --2- 172.21.15.154:0/2010117797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8754130eb0 0x7f8754138a00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f874c009e50 tx=0x7f874c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.571+0000 7f875affa700 1 -- 172.21.15.154:0/2010117797 shutdown_connections 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.571+0000 7f875affa700 1 --2- 172.21.15.154:0/2010117797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8754130eb0 0x7f8754138a00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.571+0000 7f875affa700 1 --2- 172.21.15.154:0/2010117797 >> v2:172.21.15.154:3300/0 conn(0x7f875409d860 0x7f875409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.571+0000 7f875affa700 1 -- 172.21.15.154:0/2010117797 >> 172.21.15.154:0/2010117797 conn(0x7f8754099c40 msgr2=0x7f87540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.571+0000 7f875affa700 1 -- 172.21.15.154:0/2010117797 shutdown_connections 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.571+0000 7f875affa700 1 -- 172.21.15.154:0/2010117797 wait complete. 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.572+0000 7f875affa700 1 Processor -- start 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.572+0000 7f875affa700 1 -- start start 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.572+0000 7f875affa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f875409d860 0x7f87541366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.572+0000 7f875affa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875409e170 0x7f8754136bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.572+0000 7f875affa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8754130eb0 0x7f87541c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.572+0000 7f875affa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754137fb0 con 0x7f875409e170 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.572+0000 7f875affa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87541199d0 con 0x7f875409d860 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.572+0000 7f875affa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8754136230 con 0x7f8754130eb0 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8758d96700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f875409d860 0x7f87541366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8753fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875409e170 0x7f8754136bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8758d96700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f875409d860 0x7f87541366b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43664/0 (socket says 172.21.15.154:43664) 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8758d96700 1 -- 172.21.15.154:0/2402010850 learned_addr learned my addr 172.21.15.154:0/2402010850 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8759597700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8754130eb0 0x7f87541c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8758d96700 1 -- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8754130eb0 msgr2=0x7f87541c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8758d96700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8754130eb0 0x7f87541c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8758d96700 1 -- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875409e170 msgr2=0x7f8754136bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8758d96700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875409e170 0x7f8754136bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8758d96700 1 -- 172.21.15.154:0/2402010850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c009b30 con 0x7f875409d860 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8753fff700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875409e170 0x7f8754136bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8759597700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8754130eb0 0x7f87541c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f8758d96700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f875409d860 0x7f87541366b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f874800b4d0 tx=0x7f874800b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.573+0000 7f87517fa700 1 -- 172.21.15.154:0/2402010850 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874800bea0 con 0x7f875409d860 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.574+0000 7f875affa700 1 -- 172.21.15.154:0/2402010850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8754119bd0 con 0x7f875409d860 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.574+0000 7f87517fa700 1 -- 172.21.15.154:0/2402010850 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8748011830 con 0x7f875409d860 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.574+0000 7f87517fa700 1 -- 172.21.15.154:0/2402010850 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748011be0 con 0x7f875409d860 2023-09-30T22:25:35.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.574+0000 7f875affa700 1 -- 172.21.15.154:0/2402010850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875409c8b0 con 0x7f875409d860 2023-09-30T22:25:35.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.575+0000 7f875affa700 1 -- 172.21.15.154:0/2402010850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8754119690 con 0x7f875409d860 2023-09-30T22:25:35.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.575+0000 7f87517fa700 1 -- 172.21.15.154:0/2402010850 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8748011d40 con 0x7f875409d860 2023-09-30T22:25:35.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.576+0000 7f87517fa700 1 -- 172.21.15.154:0/2402010850 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f874803f930 con 0x7f875409d860 2023-09-30T22:25:35.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.577+0000 7fe50545e700 1 Processor -- start 2023-09-30T22:25:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.577+0000 7fe50545e700 1 -- start start 2023-09-30T22:25:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe50545e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe500133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe50545e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe5000a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe50545e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50009b110 con 0x7fe500133f70 2023-09-30T22:25:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe50545e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000a3b60 con 0x7fe50009ad40 2023-09-30T22:25:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe50545e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000a2fa0 con 0x7fe5001343a0 2023-09-30T22:25:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe4ff7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe5000a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe4fe7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe500133f70 0x7fe5000a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47310/0 (socket says 172.21.15.154:47310) 2023-09-30T22:25:35.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe4fe7fc700 1 -- 172.21.15.154:0/4130500389 learned_addr learned my addr 172.21.15.154:0/4130500389 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:35.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe4feffd700 1 --2- 172.21.15.154:0/4130500389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe500133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe4ff7fe700 1 -- 172.21.15.154:0/4130500389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 msgr2=0x7fe500133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe4ff7fe700 1 --2- 172.21.15.154:0/4130500389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe500133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe4ff7fe700 1 -- 172.21.15.154:0/4130500389 >> v1:172.21.15.154:6789/0 conn(0x7fe500133f70 legacy=0x7fe5000a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.578+0000 7fe4ff7fe700 1 -- 172.21.15.154:0/4130500389 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50009a280 con 0x7fe5001343a0 2023-09-30T22:25:35.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.579+0000 7fe4ff7fe700 1 --2- 172.21.15.154:0/4130500389 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe5000a1180 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009dc0 tx=0x7fe4f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e13ca9592651aee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.579+0000 7fe4fdffb700 1 -- 172.21.15.154:0/4130500389 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f800e070 con 0x7fe5001343a0 2023-09-30T22:25:35.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.579+0000 7fe4fdffb700 1 -- 172.21.15.154:0/4130500389 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f800bbd0 con 0x7fe5001343a0 2023-09-30T22:25:35.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.579+0000 7fe4fdffb700 1 -- 172.21.15.154:0/4130500389 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8012430 con 0x7fe5001343a0 2023-09-30T22:25:35.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.579+0000 7fe50545e700 1 -- 172.21.15.154:0/4130500389 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 msgr2=0x7fe5000a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.579+0000 7fe50545e700 1 --2- 172.21.15.154:0/4130500389 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe5000a1180 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009dc0 tx=0x7fe4f800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:35.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.580+0000 7fe50545e700 1 -- 172.21.15.154:0/4130500389 shutdown_connections 2023-09-30T22:25:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.580+0000 7fe50545e700 1 --2- 172.21.15.154:0/4130500389 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe5000a1180 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.580+0000 7fe50545e700 1 --2- 172.21.15.154:0/4130500389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe500133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.580+0000 7fe50545e700 1 -- 172.21.15.154:0/4130500389 >> 172.21.15.154:0/4130500389 conn(0x7fe500099c40 msgr2=0x7fe50006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.580+0000 7fe50545e700 1 -- 172.21.15.154:0/4130500389 shutdown_connections 2023-09-30T22:25:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.580+0000 7fe50545e700 1 -- 172.21.15.154:0/4130500389 wait complete. 2023-09-30T22:25:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe50545e700 1 Processor -- start 2023-09-30T22:25:35.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe50545e700 1 -- start start 2023-09-30T22:25:35.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7f87517fa700 1 -- 172.21.15.154:0/2402010850 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8748022b40 con 0x7f875409d860 2023-09-30T22:25:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe50545e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe50011e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe50545e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe500133f70 0x7fe50011e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe50545e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe50011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe50545e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe500121b70 con 0x7fe500133f70 2023-09-30T22:25:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe50545e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe500122510 con 0x7fe50009ad40 2023-09-30T22:25:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe50545e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe500121300 con 0x7fe5001343a0 2023-09-30T22:25:35.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe4feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe50011e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe4feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe50011e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43680/0 (socket says 172.21.15.154:43680) 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.581+0000 7fe4feffd700 1 -- 172.21.15.154:0/4177707247 learned_addr learned my addr 172.21.15.154:0/4177707247 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4ff7fe700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe50011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4fe7fc700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe500133f70 0x7fe50011e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4ff7fe700 1 -- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 msgr2=0x7fe50011e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4ff7fe700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe50011e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4ff7fe700 1 -- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe500133f70 msgr2=0x7fe50011e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4ff7fe700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe500133f70 0x7fe50011e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4ff7fe700 1 -- 172.21.15.154:0/4177707247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f8009a70 con 0x7fe5001343a0 2023-09-30T22:25:35.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4feffd700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe50011e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4ff7fe700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe50011ead0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8016000 tx=0x7fe4f8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4e77fe700 1 -- 172.21.15.154:0/4177707247 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8012430 con 0x7fe5001343a0 2023-09-30T22:25:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4e77fe700 1 -- 172.21.15.154:0/4177707247 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f8020070 con 0x7fe5001343a0 2023-09-30T22:25:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.582+0000 7fe4e77fe700 1 -- 172.21.15.154:0/4177707247 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8004280 con 0x7fe5001343a0 2023-09-30T22:25:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.583+0000 7fe50545e700 1 -- 172.21.15.154:0/4177707247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50009ea50 con 0x7fe5001343a0 2023-09-30T22:25:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.583+0000 7fe50545e700 1 -- 172.21.15.154:0/4177707247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50011fc60 con 0x7fe5001343a0 2023-09-30T22:25:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.584+0000 7fe4e77fe700 1 -- 172.21.15.154:0/4177707247 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4f80043e0 con 0x7fe5001343a0 2023-09-30T22:25:35.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.584+0000 7fe4e77fe700 1 -- 172.21.15.154:0/4177707247 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe4f8022070 con 0x7fe5001343a0 2023-09-30T22:25:35.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.588+0000 7fe50545e700 1 -- 172.21.15.154:0/4177707247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50004f2a0 con 0x7fe5001343a0 2023-09-30T22:25:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.592+0000 7fe4e77fe700 1 -- 172.21.15.154:0/4177707247 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4f80269d0 con 0x7fe5001343a0 2023-09-30T22:25:35.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.625+0000 7f2f47609700 1 Processor -- start 2023-09-30T22:25:35.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f47609700 1 -- start start 2023-09-30T22:25:35.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f47609700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40133ad0 0x7f2f40133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f47609700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40130bc0 0x7f2f4013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f47609700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4006b2d0 con 0x7f2f401300a0 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f47609700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40133610 con 0x7f2f40130bc0 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f47609700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4009a500 con 0x7f2f40133ad0 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f453a5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40133ad0 0x7f2f40133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f453a5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40133ad0 0x7f2f40133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42388/0 (socket says 172.21.15.154:42388) 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f44ba4700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2f401300a0 0x7f2f401304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47328/0 (socket says 172.21.15.154:47328) 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f453a5700 1 -- 172.21.15.154:0/1188288922 learned_addr learned my addr 172.21.15.154:0/1188288922 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.626+0000 7f2f45ba6700 1 --2- 172.21.15.154:0/1188288922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40130bc0 0x7f2f4013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.627+0000 7f2f37fff700 1 -- 172.21.15.154:0/1188288922 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593269347 0 0) 0x7f2f4006b2d0 con 0x7f2f401300a0 2023-09-30T22:25:35.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.627+0000 7f2f453a5700 1 -- 172.21.15.154:0/1188288922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40130bc0 msgr2=0x7f2f4013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:35.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.627+0000 7f2f453a5700 1 --2- 172.21.15.154:0/1188288922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40130bc0 0x7f2f4013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.627+0000 7f2f453a5700 1 -- 172.21.15.154:0/1188288922 >> v1:172.21.15.154:6789/0 conn(0x7f2f401300a0 legacy=0x7f2f401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.627+0000 7f2f453a5700 1 -- 172.21.15.154:0/1188288922 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f401338b0 con 0x7f2f40133ad0 2023-09-30T22:25:35.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.627+0000 7f2f453a5700 1 --2- 172.21.15.154:0/1188288922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40133ad0 0x7f2f40133ea0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009920 tx=0x7f2f3c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21258077c598c72 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.627+0000 7f2f37fff700 1 -- 172.21.15.154:0/1188288922 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c011830 con 0x7f2f40133ad0 2023-09-30T22:25:35.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.627+0000 7f2f37fff700 1 -- 172.21.15.154:0/1188288922 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c011990 con 0x7f2f40133ad0 2023-09-30T22:25:35.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.627+0000 7f2f37fff700 1 -- 172.21.15.154:0/1188288922 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c011d20 con 0x7f2f40133ad0 2023-09-30T22:25:35.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.628+0000 7f2f47609700 1 -- 172.21.15.154:0/1188288922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40133ad0 msgr2=0x7f2f40133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.628+0000 7f2f47609700 1 --2- 172.21.15.154:0/1188288922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40133ad0 0x7f2f40133ea0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009920 tx=0x7f2f3c009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:35.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.628+0000 7f2f47609700 1 -- 172.21.15.154:0/1188288922 shutdown_connections 2023-09-30T22:25:35.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.628+0000 7f2f47609700 1 --2- 172.21.15.154:0/1188288922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40130bc0 0x7f2f4013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.628+0000 7f2f47609700 1 --2- 172.21.15.154:0/1188288922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40133ad0 0x7f2f40133ea0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.628+0000 7f2f47609700 1 -- 172.21.15.154:0/1188288922 >> 172.21.15.154:0/1188288922 conn(0x7f2f40099c40 msgr2=0x7f2f400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.628+0000 7f2f47609700 1 -- 172.21.15.154:0/1188288922 shutdown_connections 2023-09-30T22:25:35.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.628+0000 7f2f47609700 1 -- 172.21.15.154:0/1188288922 wait complete. 2023-09-30T22:25:35.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.629+0000 7f2f47609700 1 Processor -- start 2023-09-30T22:25:35.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.629+0000 7f2f47609700 1 -- start start 2023-09-30T22:25:35.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f47609700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f401300a0 0x7f2f4011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f47609700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40130bc0 0x7f2f4011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f47609700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40133ad0 0x7f2f4011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f47609700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4011fd70 con 0x7f2f401300a0 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f47609700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40071fe0 con 0x7f2f40133ad0 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f47609700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f401208e0 con 0x7f2f40130bc0 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f453a5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f401300a0 0x7f2f4011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f453a5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f401300a0 0x7f2f4011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36110/0 (socket says 172.21.15.154:36110) 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f453a5700 1 -- 172.21.15.154:0/552736662 learned_addr learned my addr 172.21.15.154:0/552736662 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f44ba4700 1 --2- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40130bc0 0x7f2f4011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f45ba6700 1 --2- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40133ad0 0x7f2f4011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f453a5700 1 -- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40130bc0 msgr2=0x7f2f4011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f453a5700 1 --2- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40130bc0 0x7f2f4011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f453a5700 1 -- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40133ad0 msgr2=0x7f2f4011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f453a5700 1 --2- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40133ad0 0x7f2f4011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.630+0000 7f2f453a5700 1 -- 172.21.15.154:0/552736662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c009550 con 0x7f2f401300a0 2023-09-30T22:25:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.631+0000 7f2f453a5700 1 --2- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f401300a0 0x7f2f4011da40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0098f0 tx=0x7f2f3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.631+0000 7f2f35ffb700 1 -- 172.21.15.154:0/552736662 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c004510 con 0x7f2f401300a0 2023-09-30T22:25:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.631+0000 7f2f35ffb700 1 -- 172.21.15.154:0/552736662 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0036a0 con 0x7f2f401300a0 2023-09-30T22:25:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.631+0000 7f2f47609700 1 -- 172.21.15.154:0/552736662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4011ff70 con 0x7f2f401300a0 2023-09-30T22:25:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.631+0000 7f2f35ffb700 1 -- 172.21.15.154:0/552736662 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c003a30 con 0x7f2f401300a0 2023-09-30T22:25:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.631+0000 7f2f47609700 1 -- 172.21.15.154:0/552736662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4011f9d0 con 0x7f2f401300a0 2023-09-30T22:25:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.632+0000 7f2f35ffb700 1 -- 172.21.15.154:0/552736662 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f3c003b90 con 0x7f2f401300a0 2023-09-30T22:25:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.632+0000 7f2f35ffb700 1 -- 172.21.15.154:0/552736662 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f3c040730 con 0x7f2f401300a0 2023-09-30T22:25:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.633+0000 7f2f47609700 1 -- 172.21.15.154:0/552736662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4011fbc0 con 0x7f2f401300a0 2023-09-30T22:25:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.642+0000 7f2f35ffb700 1 -- 172.21.15.154:0/552736662 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f3c003e40 con 0x7f2f401300a0 2023-09-30T22:25:35.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.756+0000 7f0cddb0d700 1 -- 172.21.15.154:0/3817676625 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0cd8072d60 con 0x7f0cd8134330 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.756+0000 7f0cbffff700 1 -- 172.21.15.154:0/3817676625 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cd00123f0 con 0x7f0cd8134330 2023-09-30T22:25:35.756 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.758+0000 7f0cddb0d700 1 -- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cd8134330 msgr2=0x7f0cd81cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.758+0000 7f0cddb0d700 1 --2- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cd8134330 0x7f0cd81cd160 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0015000 tx=0x7f0cd0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.758+0000 7f0cddb0d700 1 -- 172.21.15.154:0/3817676625 shutdown_connections 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.758+0000 7f0cddb0d700 1 --2- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cd8134330 0x7f0cd81cd160 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.758+0000 7f0cddb0d700 1 --2- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cd809e870 0x7f0cd81cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.758+0000 7f0cddb0d700 1 --2- 172.21.15.154:0/3817676625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cd809f180 0x7f0cd81ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.758+0000 7f0cddb0d700 1 -- 172.21.15.154:0/3817676625 >> 172.21.15.154:0/3817676625 conn(0x7f0cd80a4430 msgr2=0x7f0cd81335b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.759+0000 7f0cddb0d700 1 -- 172.21.15.154:0/3817676625 shutdown_connections 2023-09-30T22:25:35.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.762+0000 7f0cddb0d700 1 -- 172.21.15.154:0/3817676625 wait complete. 2023-09-30T22:25:35.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:35.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.780+0000 7f875affa700 1 -- 172.21.15.154:0/2402010850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8754119690 con 0x7f875409d860 2023-09-30T22:25:35.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.780+0000 7f87517fa700 1 -- 172.21.15.154:0/2402010850 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8754119690 con 0x7f875409d860 2023-09-30T22:25:35.780 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:35.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.782+0000 7f875affa700 1 -- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f875409d860 msgr2=0x7f87541366b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.782+0000 7f875affa700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f875409d860 0x7f87541366b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f874800b4d0 tx=0x7f874800b7e0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.782+0000 7f875affa700 1 -- 172.21.15.154:0/2402010850 shutdown_connections 2023-09-30T22:25:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.782+0000 7f875affa700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8754130eb0 0x7f87541c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.782+0000 7f875affa700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f875409d860 0x7f87541366b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.782+0000 7f875affa700 1 --2- 172.21.15.154:0/2402010850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875409e170 0x7f8754136bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.782+0000 7f875affa700 1 -- 172.21.15.154:0/2402010850 >> 172.21.15.154:0/2402010850 conn(0x7f8754099c40 msgr2=0x7f87540a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.782+0000 7f875affa700 1 -- 172.21.15.154:0/2402010850 shutdown_connections 2023-09-30T22:25:35.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.782+0000 7f875affa700 1 -- 172.21.15.154:0/2402010850 wait complete. 2023-09-30T22:25:35.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:35.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.837+0000 7fe50545e700 1 -- 172.21.15.154:0/4177707247 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe500120eb0 con 0x7fe5001343a0 2023-09-30T22:25:35.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.838+0000 7fe4e77fe700 1 -- 172.21.15.154:0/4177707247 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4f80263e0 con 0x7fe5001343a0 2023-09-30T22:25:35.838 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:35.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.840+0000 7fe50545e700 1 -- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 msgr2=0x7fe50011ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.840+0000 7fe50545e700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe50011ead0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8016000 tx=0x7fe4f8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.840+0000 7fe50545e700 1 -- 172.21.15.154:0/4177707247 shutdown_connections 2023-09-30T22:25:35.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.840+0000 7fe50545e700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5001343a0 0x7fe50011ead0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.840+0000 7fe50545e700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe50009ad40 0x7fe50011e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.840+0000 7fe50545e700 1 --2- 172.21.15.154:0/4177707247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe500133f70 0x7fe50011e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.840+0000 7fe50545e700 1 -- 172.21.15.154:0/4177707247 >> 172.21.15.154:0/4177707247 conn(0x7fe500099c40 msgr2=0x7fe500132ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.840+0000 7fe50545e700 1 -- 172.21.15.154:0/4177707247 shutdown_connections 2023-09-30T22:25:35.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.840+0000 7fe50545e700 1 -- 172.21.15.154:0/4177707247 wait complete. 2023-09-30T22:25:35.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:35.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.875+0000 7f2f47609700 1 -- 172.21.15.154:0/552736662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f4009cb20 con 0x7f2f401300a0 2023-09-30T22:25:35.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.875+0000 7f2f35ffb700 1 -- 172.21.15.154:0/552736662 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f3c015030 con 0x7f2f401300a0 2023-09-30T22:25:35.927 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:35.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.877+0000 7f2f47609700 1 -- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f401300a0 msgr2=0x7f2f4011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:35.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.877+0000 7f2f47609700 1 --2- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f401300a0 0x7f2f4011da40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0098f0 tx=0x7f2f3c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:35.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.877+0000 7f2f47609700 1 -- 172.21.15.154:0/552736662 shutdown_connections 2023-09-30T22:25:35.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.877+0000 7f2f47609700 1 --2- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f40133ad0 0x7f2f4011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.877+0000 7f2f47609700 1 --2- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f401300a0 0x7f2f4011da40 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.877+0000 7f2f47609700 1 --2- 172.21.15.154:0/552736662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2f40130bc0 0x7f2f4011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:35.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.877+0000 7f2f47609700 1 -- 172.21.15.154:0/552736662 >> 172.21.15.154:0/552736662 conn(0x7f2f40099c40 msgr2=0x7f2f40132c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:35.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.877+0000 7f2f47609700 1 -- 172.21.15.154:0/552736662 shutdown_connections 2023-09-30T22:25:35.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:35.877+0000 7f2f47609700 1 -- 172.21.15.154:0/552736662 wait complete. 2023-09-30T22:25:35.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:36.779 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:36.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:36.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:36.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.921+0000 7f1834b36700 1 Processor -- start 2023-09-30T22:25:36.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.921+0000 7f1834b36700 1 -- start start 2023-09-30T22:25:36.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f1834b36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f183009f350 0x7f1830136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f1834b36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18301371c0 0x7f18301395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f1834b36700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183009c970 con 0x7f183009e870 2023-09-30T22:25:36.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f1834b36700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300a0920 con 0x7f183009f350 2023-09-30T22:25:36.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f1834b36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183009f9c0 con 0x7f18301371c0 2023-09-30T22:25:36.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f182dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f183009f350 0x7f1830136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f182dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f183009f350 0x7f1830136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36114/0 (socket says 172.21.15.154:36114) 2023-09-30T22:25:36.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f182dd9b700 1 -- 172.21.15.154:0/634120159 learned_addr learned my addr 172.21.15.154:0/634120159 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:36.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f182ed9d700 1 --2- 172.21.15.154:0/634120159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18301371c0 0x7f18301395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f182dd9b700 1 -- 172.21.15.154:0/634120159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18301371c0 msgr2=0x7f18301395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f182dd9b700 1 --2- 172.21.15.154:0/634120159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18301371c0 0x7f18301395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f182dd9b700 1 -- 172.21.15.154:0/634120159 >> v1:172.21.15.154:6789/0 conn(0x7f183009e870 legacy=0x7f183009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f182dd9b700 1 -- 172.21.15.154:0/634120159 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183009bab0 con 0x7f183009f350 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.922+0000 7f182dd9b700 1 --2- 172.21.15.154:0/634120159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009f350 0x7f1830136c80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f18240098f0 tx=0x7f1824009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7445436d0daf404 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f182d59a700 1 -- 172.21.15.154:0/634120159 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824011830 con 0x7f183009f350 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f182d59a700 1 -- 172.21.15.154:0/634120159 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824011990 con 0x7f183009f350 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f182d59a700 1 -- 172.21.15.154:0/634120159 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824011d20 con 0x7f183009f350 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f1834b36700 1 -- 172.21.15.154:0/634120159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009f350 msgr2=0x7f1830136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f1834b36700 1 --2- 172.21.15.154:0/634120159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009f350 0x7f1830136c80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f18240098f0 tx=0x7f1824009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:36.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f1834b36700 1 -- 172.21.15.154:0/634120159 shutdown_connections 2023-09-30T22:25:36.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f1834b36700 1 --2- 172.21.15.154:0/634120159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18301371c0 0x7f18301395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f1834b36700 1 --2- 172.21.15.154:0/634120159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009f350 0x7f1830136c80 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f1834b36700 1 -- 172.21.15.154:0/634120159 >> 172.21.15.154:0/634120159 conn(0x7f18300a4430 msgr2=0x7f18300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f1834b36700 1 -- 172.21.15.154:0/634120159 shutdown_connections 2023-09-30T22:25:36.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.923+0000 7f1834b36700 1 -- 172.21.15.154:0/634120159 wait complete. 2023-09-30T22:25:36.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.925+0000 7f1834b36700 1 Processor -- start 2023-09-30T22:25:36.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.925+0000 7f1834b36700 1 -- start start 2023-09-30T22:25:36.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f1834b36700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009e870 0x7f183006c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f1834b36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f183009f350 0x7f183006c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f1834b36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18301371c0 0x7f18301c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f1834b36700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183006bd60 con 0x7f183009e870 2023-09-30T22:25:36.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f1834b36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18301366b0 con 0x7f183009f350 2023-09-30T22:25:36.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f1834b36700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1830126570 con 0x7f18301371c0 2023-09-30T22:25:36.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009e870 0x7f183006c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f183009f350 0x7f183006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18301371c0 0x7f18301c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009e870 0x7f183006c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36130/0 (socket says 172.21.15.154:36130) 2023-09-30T22:25:36.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182e59c700 1 -- 172.21.15.154:0/1064094215 learned_addr learned my addr 172.21.15.154:0/1064094215 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:36.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182e59c700 1 -- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18301371c0 msgr2=0x7f18301c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182e59c700 1 --2- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18301371c0 0x7f18301c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182e59c700 1 -- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f183009f350 msgr2=0x7f183006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182e59c700 1 --2- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f183009f350 0x7f183006c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182e59c700 1 -- 172.21.15.154:0/1064094215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009550 con 0x7f183009e870 2023-09-30T22:25:36.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182ed9d700 1 --2- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18301371c0 0x7f18301c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:36.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182dd9b700 1 --2- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f183009f350 0x7f183006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:36.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.926+0000 7f182e59c700 1 --2- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009e870 0x7f183006c110 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f182000c4e0 tx=0x7f182000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.927+0000 7f181effd700 1 -- 172.21.15.154:0/1064094215 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200052d0 con 0x7f183009e870 2023-09-30T22:25:36.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.927+0000 7f181effd700 1 -- 172.21.15.154:0/1064094215 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1820005430 con 0x7f183009e870 2023-09-30T22:25:36.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.927+0000 7f1834b36700 1 -- 172.21.15.154:0/1064094215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1830136880 con 0x7f183009e870 2023-09-30T22:25:36.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.927+0000 7f181effd700 1 -- 172.21.15.154:0/1064094215 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200038c0 con 0x7f183009e870 2023-09-30T22:25:36.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.927+0000 7f1834b36700 1 -- 172.21.15.154:0/1064094215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1830136c00 con 0x7f183009e870 2023-09-30T22:25:36.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.928+0000 7f181effd700 1 -- 172.21.15.154:0/1064094215 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1820003a20 con 0x7f183009e870 2023-09-30T22:25:36.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.928+0000 7f181effd700 1 -- 172.21.15.154:0/1064094215 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f182003ea70 con 0x7f183009e870 2023-09-30T22:25:36.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.928+0000 7f1834b36700 1 -- 172.21.15.154:0/1064094215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183009eeb0 con 0x7f183009e870 2023-09-30T22:25:36.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:36.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.933+0000 7f181effd700 1 -- 172.21.15.154:0/1064094215 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1820018260 con 0x7f183009e870 2023-09-30T22:25:36.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.961+0000 7fa44b1ed700 1 Processor -- start 2023-09-30T22:25:36.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.961+0000 7fa44b1ed700 1 -- start start 2023-09-30T22:25:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.961+0000 7fa44b1ed700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4441368e0 0x7fa444138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.961+0000 7fa44b1ed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa444139200 0x7fa44413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.961+0000 7fa44b1ed700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44409a760 con 0x7fa444133900 2023-09-30T22:25:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.961+0000 7fa44b1ed700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4441336e0 con 0x7fa4441368e0 2023-09-30T22:25:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.961+0000 7fa44b1ed700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa44409a080 con 0x7fa444139200 2023-09-30T22:25:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa443fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4441368e0 0x7fa444138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa443fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4441368e0 0x7fa444138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36146/0 (socket says 172.21.15.154:36146) 2023-09-30T22:25:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa443fff700 1 -- 172.21.15.154:0/1582129088 learned_addr learned my addr 172.21.15.154:0/1582129088 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa44978a700 1 --2- 172.21.15.154:0/1582129088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa444139200 0x7fa44413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa44978a700 1 -- 172.21.15.154:0/1582129088 >> v2:172.21.15.154:3300/0 conn(0x7fa4441368e0 msgr2=0x7fa444138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa44978a700 1 --2- 172.21.15.154:0/1582129088 >> v2:172.21.15.154:3300/0 conn(0x7fa4441368e0 0x7fa444138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa44978a700 1 -- 172.21.15.154:0/1582129088 >> v1:172.21.15.154:6789/0 conn(0x7fa444133900 legacy=0x7fa444133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa44978a700 1 -- 172.21.15.154:0/1582129088 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440a23e0 con 0x7fa444139200 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa44978a700 1 --2- 172.21.15.154:0/1582129088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa444139200 0x7fa44413b5e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009d90 tx=0x7fa43c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7723bb5239311fcd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa4437fe700 1 -- 172.21.15.154:0/1582129088 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00e070 con 0x7fa444139200 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa4437fe700 1 -- 172.21.15.154:0/1582129088 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00bae0 con 0x7fa444139200 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.962+0000 7fa4437fe700 1 -- 172.21.15.154:0/1582129088 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00be90 con 0x7fa444139200 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.963+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1582129088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa444139200 msgr2=0x7fa44413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.963+0000 7fa44b1ed700 1 --2- 172.21.15.154:0/1582129088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa444139200 0x7fa44413b5e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009d90 tx=0x7fa43c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.963+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1582129088 shutdown_connections 2023-09-30T22:25:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.963+0000 7fa44b1ed700 1 --2- 172.21.15.154:0/1582129088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa444139200 0x7fa44413b5e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.963+0000 7fa44b1ed700 1 --2- 172.21.15.154:0/1582129088 >> v2:172.21.15.154:3300/0 conn(0x7fa4441368e0 0x7fa444138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.963+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1582129088 >> 172.21.15.154:0/1582129088 conn(0x7fa4440a2980 msgr2=0x7fa4440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:36.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.963+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1582129088 shutdown_connections 2023-09-30T22:25:36.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.963+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1582129088 wait complete. 2023-09-30T22:25:36.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.964+0000 7fa44b1ed700 1 Processor -- start 2023-09-30T22:25:36.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.964+0000 7fa44b1ed700 1 -- start start 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44b1ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa444133900 0x7fa444119e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44b1ed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4441368e0 0x7fa44411a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44b1ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa444139200 0x7fa44411a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44b1ed700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44411bf90 con 0x7fa444139200 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44b1ed700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44411ba70 con 0x7fa444133900 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44b1ed700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa44409c600 con 0x7fa4441368e0 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa448f89700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa444133900 0x7fa444119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44978a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa444139200 0x7fa44411a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa448f89700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa444133900 0x7fa444119e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43742/0 (socket says 172.21.15.154:43742) 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa443fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4441368e0 0x7fa44411a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:36.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa448f89700 1 -- 172.21.15.154:0/1673659821 learned_addr learned my addr 172.21.15.154:0/1673659821 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44978a700 1 -- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4441368e0 msgr2=0x7fa44411a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44978a700 1 --2- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4441368e0 0x7fa44411a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44978a700 1 -- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa444133900 msgr2=0x7fa444119e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44978a700 1 --2- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa444133900 0x7fa444119e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.965+0000 7fa44978a700 1 -- 172.21.15.154:0/1673659821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009a70 con 0x7fa444139200 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.966+0000 7fa44978a700 1 --2- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa444139200 0x7fa44411a8c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa43c015000 tx=0x7fa43c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.966+0000 7fa4417fa700 1 -- 172.21.15.154:0/1673659821 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c004540 con 0x7fa444139200 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.966+0000 7fa4417fa700 1 -- 172.21.15.154:0/1673659821 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c0046a0 con 0x7fa444139200 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.966+0000 7fa4417fa700 1 -- 172.21.15.154:0/1673659821 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c012430 con 0x7fa444139200 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.966+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1673659821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44411d570 con 0x7fa444139200 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.966+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1673659821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44411dfe0 con 0x7fa444139200 2023-09-30T22:25:36.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.967+0000 7fa4417fa700 1 -- 172.21.15.154:0/1673659821 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa43c012590 con 0x7fa444139200 2023-09-30T22:25:36.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.967+0000 7fa4417fa700 1 -- 172.21.15.154:0/1673659821 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa43c041230 con 0x7fa444139200 2023-09-30T22:25:36.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.967+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1673659821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44404f2a0 con 0x7fa444139200 2023-09-30T22:25:36.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:36.976+0000 7fa4417fa700 1 -- 172.21.15.154:0/1673659821 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa43c02a020 con 0x7fa444139200 2023-09-30T22:25:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.003+0000 7f390e69e700 1 Processor -- start 2023-09-30T22:25:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.003+0000 7f390e69e700 1 -- start start 2023-09-30T22:25:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f390e69e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 0x7f39080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f390e69e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39080a1340 0x7f390812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f390e69e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39080a1e70 con 0x7f39081304a0 2023-09-30T22:25:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f390e69e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390809a720 con 0x7f39080a1340 2023-09-30T22:25:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f390e69e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f390809b300 con 0x7f39080a0a30 2023-09-30T22:25:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f3907fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 0x7f39080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f390cc3b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f39081304a0 0x7f39081371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47342/0 (socket says 172.21.15.154:47342) 2023-09-30T22:25:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f390cc3b700 1 -- 172.21.15.154:0/2995204315 learned_addr learned my addr 172.21.15.154:0/2995204315 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f39077fe700 1 --2- 172.21.15.154:0/2995204315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39080a1340 0x7f390812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f39077fe700 1 -- 172.21.15.154:0/2995204315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 msgr2=0x7f39080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f39077fe700 1 --2- 172.21.15.154:0/2995204315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 0x7f39080a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f39077fe700 1 -- 172.21.15.154:0/2995204315 >> v1:172.21.15.154:6789/0 conn(0x7f39081304a0 legacy=0x7f39081371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f3906ffd700 1 -- 172.21.15.154:0/2995204315 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041182626 0 0) 0x7f39080a1e70 con 0x7f39081304a0 2023-09-30T22:25:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.004+0000 7f39077fe700 1 -- 172.21.15.154:0/2995204315 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390809abc0 con 0x7f39080a1340 2023-09-30T22:25:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f39077fe700 1 --2- 172.21.15.154:0/2995204315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39080a1340 0x7f390812ff60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00dc90 tx=0x7f38fc00f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42a7f968b92fdcad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f3906ffd700 1 -- 172.21.15.154:0/2995204315 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc012070 con 0x7f39080a1340 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f3906ffd700 1 -- 172.21.15.154:0/2995204315 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc00d2e0 con 0x7f39080a1340 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f3906ffd700 1 -- 172.21.15.154:0/2995204315 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00f8f0 con 0x7f39080a1340 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f390e69e700 1 -- 172.21.15.154:0/2995204315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39080a1340 msgr2=0x7f390812ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f390e69e700 1 --2- 172.21.15.154:0/2995204315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39080a1340 0x7f390812ff60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00dc90 tx=0x7f38fc00f050 comp rx=0 tx=0).stop 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f390e69e700 1 -- 172.21.15.154:0/2995204315 shutdown_connections 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f390e69e700 1 --2- 172.21.15.154:0/2995204315 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 0x7f39080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f390e69e700 1 --2- 172.21.15.154:0/2995204315 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39080a1340 0x7f390812ff60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.005+0000 7f390e69e700 1 -- 172.21.15.154:0/2995204315 >> 172.21.15.154:0/2995204315 conn(0x7f39080a2980 msgr2=0x7f39080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.006+0000 7f390e69e700 1 -- 172.21.15.154:0/2995204315 shutdown_connections 2023-09-30T22:25:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.006+0000 7f390e69e700 1 -- 172.21.15.154:0/2995204315 wait complete. 2023-09-30T22:25:37.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.007+0000 7f390e69e700 1 Processor -- start 2023-09-30T22:25:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.007+0000 7f390e69e700 1 -- start start 2023-09-30T22:25:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f390e69e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 0x7f39081c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f390e69e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39080a1340 0x7f39081c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f390e69e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39081304a0 0x7f390811ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f390e69e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390811cc00 con 0x7f39080a1340 2023-09-30T22:25:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f390e69e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390811ca10 con 0x7f39081304a0 2023-09-30T22:25:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f390e69e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f390812f790 con 0x7f39080a0a30 2023-09-30T22:25:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f39077fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39080a1340 0x7f39081c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f39077fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39080a1340 0x7f39081c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36160/0 (socket says 172.21.15.154:36160) 2023-09-30T22:25:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f39077fe700 1 -- 172.21.15.154:0/2997994810 learned_addr learned my addr 172.21.15.154:0/2997994810 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f3907fff700 1 --2- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 0x7f39081c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f390cc3b700 1 --2- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39081304a0 0x7f390811ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f39077fe700 1 -- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 msgr2=0x7f39081c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f39077fe700 1 --2- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 0x7f39081c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f39077fe700 1 -- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39081304a0 msgr2=0x7f390811ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f39077fe700 1 --2- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39081304a0 0x7f390811ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.008+0000 7f39077fe700 1 -- 172.21.15.154:0/2997994810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc00d940 con 0x7f39080a1340 2023-09-30T22:25:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.009+0000 7f39077fe700 1 --2- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39080a1340 0x7f39081c4730 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f38fc016000 tx=0x7f38fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.009+0000 7f3904ff9700 1 -- 172.21.15.154:0/2997994810 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc010e00 con 0x7f39080a1340 2023-09-30T22:25:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.009+0000 7f3904ff9700 1 -- 172.21.15.154:0/2997994810 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc0036a0 con 0x7f39080a1340 2023-09-30T22:25:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.009+0000 7f390e69e700 1 -- 172.21.15.154:0/2997994810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390811cff0 con 0x7f39080a1340 2023-09-30T22:25:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.009+0000 7f3904ff9700 1 -- 172.21.15.154:0/2997994810 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc003a50 con 0x7f39080a1340 2023-09-30T22:25:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.009+0000 7f390e69e700 1 -- 172.21.15.154:0/2997994810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390809ae50 con 0x7f39080a1340 2023-09-30T22:25:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.010+0000 7f390e69e700 1 -- 172.21.15.154:0/2997994810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390811e2e0 con 0x7f39080a1340 2023-09-30T22:25:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.010+0000 7f3904ff9700 1 -- 172.21.15.154:0/2997994810 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38fc003bb0 con 0x7f39080a1340 2023-09-30T22:25:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.010+0000 7f3904ff9700 1 -- 172.21.15.154:0/2997994810 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f38fc0448c0 con 0x7f39080a1340 2023-09-30T22:25:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.015+0000 7f3904ff9700 1 -- 172.21.15.154:0/2997994810 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f390811e2e0 con 0x7f39080a1340 2023-09-30T22:25:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.064+0000 7f0d2cdbf700 1 Processor -- start 2023-09-30T22:25:37.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d2cdbf700 1 -- start start 2023-09-30T22:25:37.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d2cdbf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 0x7f0d28133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d2cdbf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d281300a0 0x7f0d281304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d2cdbf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281309f0 0x7f0d2813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d2cdbf700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2806b2d0 con 0x7f0d281300a0 2023-09-30T22:25:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d2cdbf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28133610 con 0x7f0d28133ad0 2023-09-30T22:25:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d2cdbf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2809a500 con 0x7f0d281309f0 2023-09-30T22:25:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d25d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d281300a0 0x7f0d281304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d25d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d281300a0 0x7f0d281304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36164/0 (socket says 172.21.15.154:36164) 2023-09-30T22:25:37.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d25d9b700 1 -- 172.21.15.154:0/1259891198 learned_addr learned my addr 172.21.15.154:0/1259891198 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.065+0000 7f0d26d9d700 1 --2- 172.21.15.154:0/1259891198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281309f0 0x7f0d2813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d2659c700 1 --2- 172.21.15.154:0/1259891198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 0x7f0d28133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d26d9d700 1 -- 172.21.15.154:0/1259891198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 msgr2=0x7f0d28133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d26d9d700 1 --2- 172.21.15.154:0/1259891198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 0x7f0d28133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d26d9d700 1 -- 172.21.15.154:0/1259891198 >> v2:172.21.15.154:3300/0 conn(0x7f0d281300a0 msgr2=0x7f0d281304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d26d9d700 1 --2- 172.21.15.154:0/1259891198 >> v2:172.21.15.154:3300/0 conn(0x7f0d281300a0 0x7f0d281304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d26d9d700 1 -- 172.21.15.154:0/1259891198 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d281338b0 con 0x7f0d281309f0 2023-09-30T22:25:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d25d9b700 1 --2- 172.21.15.154:0/1259891198 >> v2:172.21.15.154:3300/0 conn(0x7f0d281300a0 0x7f0d281304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d26d9d700 1 --2- 172.21.15.154:0/1259891198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281309f0 0x7f0d2813a980 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009d90 tx=0x7f0d2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22af18c7204ba566 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d2559a700 1 -- 172.21.15.154:0/1259891198 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000e070 con 0x7f0d281309f0 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d2559a700 1 -- 172.21.15.154:0/1259891198 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2000bb20 con 0x7f0d281309f0 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.066+0000 7f0d2559a700 1 -- 172.21.15.154:0/1259891198 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20012430 con 0x7f0d281309f0 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.067+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/1259891198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281309f0 msgr2=0x7f0d2813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.067+0000 7f0d2cdbf700 1 --2- 172.21.15.154:0/1259891198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281309f0 0x7f0d2813a980 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009d90 tx=0x7f0d2000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.067+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/1259891198 shutdown_connections 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.067+0000 7f0d2cdbf700 1 --2- 172.21.15.154:0/1259891198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 0x7f0d28133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.067+0000 7f0d2cdbf700 1 --2- 172.21.15.154:0/1259891198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281309f0 0x7f0d2813a980 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.067+0000 7f0d2cdbf700 1 --2- 172.21.15.154:0/1259891198 >> v2:172.21.15.154:3300/0 conn(0x7f0d281300a0 0x7f0d281304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.067+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/1259891198 >> 172.21.15.154:0/1259891198 conn(0x7f0d28099c40 msgr2=0x7f0d280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.067+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/1259891198 shutdown_connections 2023-09-30T22:25:37.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.067+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/1259891198 wait complete. 2023-09-30T22:25:37.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.068+0000 7f0d2cdbf700 1 Processor -- start 2023-09-30T22:25:37.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.068+0000 7f0d2cdbf700 1 -- start start 2023-09-30T22:25:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2cdbf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281300a0 0x7f0d2811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2cdbf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d281309f0 0x7f0d2811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2cdbf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 0x7f0d2811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2cdbf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2811f950 con 0x7f0d281309f0 2023-09-30T22:25:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2cdbf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2812d730 con 0x7f0d28133ad0 2023-09-30T22:25:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2cdbf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2812f7e0 con 0x7f0d281300a0 2023-09-30T22:25:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281300a0 0x7f0d2811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281300a0 0x7f0d2811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42458/0 (socket says 172.21.15.154:42458) 2023-09-30T22:25:37.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2659c700 1 -- 172.21.15.154:0/3806645011 learned_addr learned my addr 172.21.15.154:0/3806645011 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d25d9b700 1 --2- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d281309f0 0x7f0d2811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d26d9d700 1 --2- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 0x7f0d2811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2659c700 1 -- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 msgr2=0x7f0d2811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2659c700 1 --2- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 0x7f0d2811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2659c700 1 -- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d281309f0 msgr2=0x7f0d2811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2659c700 1 --2- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d281309f0 0x7f0d2811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2659c700 1 -- 172.21.15.154:0/3806645011 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c009550 con 0x7f0d281300a0 2023-09-30T22:25:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d2659c700 1 --2- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281300a0 0x7f0d2811da40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800e810 tx=0x7f0d1800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:37.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.069+0000 7f0d16ffd700 1 -- 172.21.15.154:0/3806645011 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800c070 con 0x7f0d281300a0 2023-09-30T22:25:37.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.070+0000 7f0d16ffd700 1 -- 172.21.15.154:0/3806645011 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18013610 con 0x7f0d281300a0 2023-09-30T22:25:37.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.070+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/3806645011 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d20009a70 con 0x7f0d281300a0 2023-09-30T22:25:37.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.070+0000 7f0d16ffd700 1 -- 172.21.15.154:0/3806645011 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d180139c0 con 0x7f0d281300a0 2023-09-30T22:25:37.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.070+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/3806645011 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2811eda0 con 0x7f0d281300a0 2023-09-30T22:25:37.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.071+0000 7f0d16ffd700 1 -- 172.21.15.154:0/3806645011 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d18013b20 con 0x7f0d281300a0 2023-09-30T22:25:37.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.071+0000 7f0d16ffd700 1 -- 172.21.15.154:0/3806645011 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d1803f390 con 0x7f0d281300a0 2023-09-30T22:25:37.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.071+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/3806645011 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2811fb70 con 0x7f0d281300a0 2023-09-30T22:25:37.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.080+0000 7f0d16ffd700 1 -- 172.21.15.154:0/3806645011 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d18010900 con 0x7f0d281300a0 2023-09-30T22:25:37.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.149+0000 7f1834b36700 1 -- 172.21.15.154:0/1064094215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f183004f2a0 con 0x7f183009e870 2023-09-30T22:25:37.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.149+0000 7f181effd700 1 -- 172.21.15.154:0/1064094215 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1820017020 con 0x7f183009e870 2023-09-30T22:25:37.150 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.151+0000 7f1834b36700 1 -- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009e870 msgr2=0x7f183006c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.151+0000 7f1834b36700 1 --2- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009e870 0x7f183006c110 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f182000c4e0 tx=0x7f182000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.152+0000 7f1834b36700 1 -- 172.21.15.154:0/1064094215 shutdown_connections 2023-09-30T22:25:37.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.152+0000 7f1834b36700 1 --2- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18301371c0 0x7f18301c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.152+0000 7f1834b36700 1 --2- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183009e870 0x7f183006c110 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.152+0000 7f1834b36700 1 --2- 172.21.15.154:0/1064094215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f183009f350 0x7f183006c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.152+0000 7f1834b36700 1 -- 172.21.15.154:0/1064094215 >> 172.21.15.154:0/1064094215 conn(0x7f18300a4430 msgr2=0x7f18300a2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.152+0000 7f1834b36700 1 -- 172.21.15.154:0/1064094215 shutdown_connections 2023-09-30T22:25:37.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.152+0000 7f1834b36700 1 -- 172.21.15.154:0/1064094215 wait complete. 2023-09-30T22:25:37.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.175+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1673659821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa44406bce0 con 0x7fa444139200 2023-09-30T22:25:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.175+0000 7fa4417fa700 1 -- 172.21.15.154:0/1673659821 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa43c02d940 con 0x7fa444139200 2023-09-30T22:25:37.175 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.177+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa444139200 msgr2=0x7fa44411a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.177+0000 7fa44b1ed700 1 --2- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa444139200 0x7fa44411a8c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa43c015000 tx=0x7fa43c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.177+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1673659821 shutdown_connections 2023-09-30T22:25:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.177+0000 7fa44b1ed700 1 --2- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa444139200 0x7fa44411a8c0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.177+0000 7fa44b1ed700 1 --2- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa444133900 0x7fa444119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.177+0000 7fa44b1ed700 1 --2- 172.21.15.154:0/1673659821 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4441368e0 0x7fa44411a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.177+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1673659821 >> 172.21.15.154:0/1673659821 conn(0x7fa4440a2980 msgr2=0x7fa444130170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.177+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1673659821 shutdown_connections 2023-09-30T22:25:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.177+0000 7fa44b1ed700 1 -- 172.21.15.154:0/1673659821 wait complete. 2023-09-30T22:25:37.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:37.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.211+0000 7f390e69e700 1 -- 172.21.15.154:0/2997994810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f390811e2e0 con 0x7f39080a1340 2023-09-30T22:25:37.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.211+0000 7f3904ff9700 1 -- 172.21.15.154:0/2997994810 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f390811e2e0 con 0x7f39080a1340 2023-09-30T22:25:37.212 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:37.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.213+0000 7f390e69e700 1 -- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39080a1340 msgr2=0x7f39081c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.214+0000 7f390e69e700 1 --2- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39080a1340 0x7f39081c4730 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f38fc016000 tx=0x7f38fc004750 comp rx=0 tx=0).stop 2023-09-30T22:25:37.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.214+0000 7f390e69e700 1 -- 172.21.15.154:0/2997994810 shutdown_connections 2023-09-30T22:25:37.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.214+0000 7f390e69e700 1 --2- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39081304a0 0x7f390811ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.214+0000 7f390e69e700 1 --2- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39080a0a30 0x7f39081c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.214+0000 7f390e69e700 1 --2- 172.21.15.154:0/2997994810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39080a1340 0x7f39081c4730 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.214+0000 7f390e69e700 1 -- 172.21.15.154:0/2997994810 >> 172.21.15.154:0/2997994810 conn(0x7f39080a2980 msgr2=0x7f39081b79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.214+0000 7f390e69e700 1 -- 172.21.15.154:0/2997994810 shutdown_connections 2023-09-30T22:25:37.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.214+0000 7f390e69e700 1 -- 172.21.15.154:0/2997994810 wait complete. 2023-09-30T22:25:37.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:37.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.275+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/3806645011 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d2811fe30 con 0x7f0d281300a0 2023-09-30T22:25:37.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.275+0000 7f0d16ffd700 1 -- 172.21.15.154:0/3806645011 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d2811fe30 con 0x7f0d281300a0 2023-09-30T22:25:37.275 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:37.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.277+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281300a0 msgr2=0x7f0d2811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:37.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.277+0000 7f0d2cdbf700 1 --2- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281300a0 0x7f0d2811da40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800e810 tx=0x7f0d1800eb20 comp rx=0 tx=0).stop 2023-09-30T22:25:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.277+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/3806645011 shutdown_connections 2023-09-30T22:25:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.277+0000 7f0d2cdbf700 1 --2- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d28133ad0 0x7f0d2811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.277+0000 7f0d2cdbf700 1 --2- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d281300a0 0x7f0d2811da40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.277+0000 7f0d2cdbf700 1 --2- 172.21.15.154:0/3806645011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d281309f0 0x7f0d2811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.277+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/3806645011 >> 172.21.15.154:0/3806645011 conn(0x7f0d28099c40 msgr2=0x7f0d2812e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.277+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/3806645011 shutdown_connections 2023-09-30T22:25:37.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:37.277+0000 7f0d2cdbf700 1 -- 172.21.15.154:0/3806645011 wait complete. 2023-09-30T22:25:37.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:38.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:38.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:38.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:38.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:38.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.307+0000 7fc7a9647700 1 Processor -- start 2023-09-30T22:25:38.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a9647700 1 -- start start 2023-09-30T22:25:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a9647700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4136960 0x7fc7a4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a9647700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7a4139280 0x7fc7a413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a9647700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a406b2d0 con 0x7fc7a4133ad0 2023-09-30T22:25:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a9647700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a41345b0 con 0x7fc7a4139280 2023-09-30T22:25:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a9647700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a4133610 con 0x7fc7a4136960 2023-09-30T22:25:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4136960 0x7fc7a4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a27fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4136960 0x7fc7a4138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42472/0 (socket says 172.21.15.154:42472) 2023-09-30T22:25:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a27fc700 1 -- 172.21.15.154:0/1437756033 learned_addr learned my addr 172.21.15.154:0/1437756033 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.308+0000 7fc7a37fe700 1 --2- 172.21.15.154:0/1437756033 >> v2:172.21.15.154:3300/0 conn(0x7fc7a4139280 0x7fc7a413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.309+0000 7fc7a37fe700 1 -- 172.21.15.154:0/1437756033 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4136960 msgr2=0x7fc7a4138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.309+0000 7fc7a37fe700 1 --2- 172.21.15.154:0/1437756033 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4136960 0x7fc7a4138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.309+0000 7fc7a37fe700 1 -- 172.21.15.154:0/1437756033 >> v1:172.21.15.154:6789/0 conn(0x7fc7a4133ad0 legacy=0x7fc7a4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.309+0000 7fc7a37fe700 1 -- 172.21.15.154:0/1437756033 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a409a500 con 0x7fc7a4139280 2023-09-30T22:25:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.309+0000 7fc7a37fe700 1 --2- 172.21.15.154:0/1437756033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4139280 0x7fc7a413b660 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009dc0 tx=0x7fc79c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0ee1bfc5d3f4e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.309+0000 7fc7a1ffb700 1 -- 172.21.15.154:0/1437756033 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c00e070 con 0x7fc7a4139280 2023-09-30T22:25:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.309+0000 7fc7a1ffb700 1 -- 172.21.15.154:0/1437756033 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c00bb90 con 0x7fc7a4139280 2023-09-30T22:25:38.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.309+0000 7fc7a1ffb700 1 -- 172.21.15.154:0/1437756033 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c012430 con 0x7fc7a4139280 2023-09-30T22:25:38.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.310+0000 7fc7a9647700 1 -- 172.21.15.154:0/1437756033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4139280 msgr2=0x7fc7a413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.310+0000 7fc7a9647700 1 --2- 172.21.15.154:0/1437756033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4139280 0x7fc7a413b660 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009dc0 tx=0x7fc79c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.310+0000 7fc7a9647700 1 -- 172.21.15.154:0/1437756033 shutdown_connections 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.310+0000 7fc7a9647700 1 --2- 172.21.15.154:0/1437756033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4139280 0x7fc7a413b660 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.310+0000 7fc7a9647700 1 --2- 172.21.15.154:0/1437756033 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4136960 0x7fc7a4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.310+0000 7fc7a9647700 1 -- 172.21.15.154:0/1437756033 >> 172.21.15.154:0/1437756033 conn(0x7fc7a4099c40 msgr2=0x7fc7a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.310+0000 7fc7a9647700 1 -- 172.21.15.154:0/1437756033 shutdown_connections 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.310+0000 7fc7a9647700 1 -- 172.21.15.154:0/1437756033 wait complete. 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.311+0000 7fc7a9647700 1 Processor -- start 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.311+0000 7fc7a9647700 1 -- start start 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a9647700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4133ad0 0x7fc7a4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a9647700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7a4136960 0x7fc7a4071e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a9647700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4139280 0x7fc7a41c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a9647700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a406e900 con 0x7fc7a4133ad0 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a9647700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a409f390 con 0x7fc7a4136960 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a9647700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a4070100 con 0x7fc7a4139280 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4133ad0 0x7fc7a4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4133ad0 0x7fc7a4071910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36186/0 (socket says 172.21.15.154:36186) 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a2ffd700 1 -- 172.21.15.154:0/2188685051 learned_addr learned my addr 172.21.15.154:0/2188685051 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a37fe700 1 --2- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4139280 0x7fc7a41c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a27fc700 1 --2- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7a4136960 0x7fc7a4071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a2ffd700 1 -- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4139280 msgr2=0x7fc7a41c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a2ffd700 1 --2- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4139280 0x7fc7a41c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a2ffd700 1 -- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7a4136960 msgr2=0x7fc7a4071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a2ffd700 1 --2- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7a4136960 0x7fc7a4071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.312+0000 7fc7a2ffd700 1 -- 172.21.15.154:0/2188685051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c009a70 con 0x7fc7a4133ad0 2023-09-30T22:25:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.313+0000 7fc7a2ffd700 1 --2- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4133ad0 0x7fc7a4071910 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc79400c450 tx=0x7fc79400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.313+0000 7fc78b7fe700 1 -- 172.21.15.154:0/2188685051 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7940052d0 con 0x7fc7a4133ad0 2023-09-30T22:25:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.313+0000 7fc78b7fe700 1 -- 172.21.15.154:0/2188685051 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc794005430 con 0x7fc7a4133ad0 2023-09-30T22:25:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.313+0000 7fc78b7fe700 1 -- 172.21.15.154:0/2188685051 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7940038c0 con 0x7fc7a4133ad0 2023-09-30T22:25:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.313+0000 7fc7a9647700 1 -- 172.21.15.154:0/2188685051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a406f400 con 0x7fc7a4133ad0 2023-09-30T22:25:38.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.313+0000 7fc7a9647700 1 -- 172.21.15.154:0/2188685051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a40706a0 con 0x7fc7a4133ad0 2023-09-30T22:25:38.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.314+0000 7fc78b7fe700 1 -- 172.21.15.154:0/2188685051 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc794003a20 con 0x7fc7a4133ad0 2023-09-30T22:25:38.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.314+0000 7fc78b7fe700 1 -- 172.21.15.154:0/2188685051 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc79403ea10 con 0x7fc7a4133ad0 2023-09-30T22:25:38.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.314+0000 7fc7a9647700 1 -- 172.21.15.154:0/2188685051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a4070320 con 0x7fc7a4133ad0 2023-09-30T22:25:38.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.319+0000 7fc78b7fe700 1 -- 172.21.15.154:0/2188685051 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7a4070320 con 0x7fc7a4133ad0 2023-09-30T22:25:38.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.351+0000 7f75b5f32700 1 Processor -- start 2023-09-30T22:25:38.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.351+0000 7f75b5f32700 1 -- start start 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.352+0000 7f75b5f32700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75b009d860 0x7f75b009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.352+0000 7f75b5f32700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b0130eb0 0x7f75b0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.352+0000 7f75b5f32700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b009aaa0 con 0x7f75b009e170 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.352+0000 7f75b5f32700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b009f870 con 0x7f75b009d860 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.352+0000 7f75b5f32700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75b009b360 con 0x7f75b0130eb0 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.352+0000 7f75af7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75b009d860 0x7f75b009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.352+0000 7f75af7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75b009d860 0x7f75b009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36196/0 (socket says 172.21.15.154:36196) 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.352+0000 7f75af7fe700 1 -- 172.21.15.154:0/1305746857 learned_addr learned my addr 172.21.15.154:0/1305746857 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.352+0000 7f75affff700 1 --2- 172.21.15.154:0/1305746857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b0130eb0 0x7f75b0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.353+0000 7f75affff700 1 -- 172.21.15.154:0/1305746857 >> v2:172.21.15.154:3300/0 conn(0x7f75b009d860 msgr2=0x7f75b009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.353+0000 7f75affff700 1 --2- 172.21.15.154:0/1305746857 >> v2:172.21.15.154:3300/0 conn(0x7f75b009d860 0x7f75b009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.353+0000 7f75affff700 1 -- 172.21.15.154:0/1305746857 >> v1:172.21.15.154:6789/0 conn(0x7f75b009e170 legacy=0x7f75b01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.353+0000 7f75affff700 1 -- 172.21.15.154:0/1305746857 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b009b620 con 0x7f75b0130eb0 2023-09-30T22:25:38.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.353+0000 7f75affff700 1 --2- 172.21.15.154:0/1305746857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b0130eb0 0x7f75b0138a00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f75a800f370 tx=0x7f75a800f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25393ded0d69f92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.353+0000 7f75ae7fc700 1 -- 172.21.15.154:0/1305746857 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8012070 con 0x7f75b0130eb0 2023-09-30T22:25:38.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.353+0000 7f75ae7fc700 1 -- 172.21.15.154:0/1305746857 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a800fe70 con 0x7f75b0130eb0 2023-09-30T22:25:38.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.353+0000 7f75ae7fc700 1 -- 172.21.15.154:0/1305746857 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800d2f0 con 0x7f75b0130eb0 2023-09-30T22:25:38.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.354+0000 7f75b5f32700 1 -- 172.21.15.154:0/1305746857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b0130eb0 msgr2=0x7f75b0138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.354+0000 7f75b5f32700 1 --2- 172.21.15.154:0/1305746857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b0130eb0 0x7f75b0138a00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f75a800f370 tx=0x7f75a800f680 comp rx=0 tx=0).stop 2023-09-30T22:25:38.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.354+0000 7f75b5f32700 1 -- 172.21.15.154:0/1305746857 shutdown_connections 2023-09-30T22:25:38.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.354+0000 7f75b5f32700 1 --2- 172.21.15.154:0/1305746857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b0130eb0 0x7f75b0138a00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.354+0000 7f75b5f32700 1 --2- 172.21.15.154:0/1305746857 >> v2:172.21.15.154:3300/0 conn(0x7f75b009d860 0x7f75b009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.354+0000 7f75b5f32700 1 -- 172.21.15.154:0/1305746857 >> 172.21.15.154:0/1305746857 conn(0x7f75b0099c40 msgr2=0x7f75b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.354+0000 7f75b5f32700 1 -- 172.21.15.154:0/1305746857 shutdown_connections 2023-09-30T22:25:38.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.354+0000 7f75b5f32700 1 -- 172.21.15.154:0/1305746857 wait complete. 2023-09-30T22:25:38.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.355+0000 7f75b5f32700 1 Processor -- start 2023-09-30T22:25:38.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.355+0000 7f75b5f32700 1 -- start start 2023-09-30T22:25:38.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75b5f32700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75b009d860 0x7f75b011e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75b5f32700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b009e170 0x7f75b011e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75b5f32700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75b0130eb0 0x7f75b011ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75b5f32700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0121c30 con 0x7f75b009d860 2023-09-30T22:25:38.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75b5f32700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0120110 con 0x7f75b0130eb0 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75b5f32700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75b009c8b0 con 0x7f75b009e170 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75aeffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b009e170 0x7f75b011e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75af7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75b009d860 0x7f75b011e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75aeffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b009e170 0x7f75b011e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42500/0 (socket says 172.21.15.154:42500) 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75af7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75b009d860 0x7f75b011e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36200/0 (socket says 172.21.15.154:36200) 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.356+0000 7f75aeffd700 1 -- 172.21.15.154:0/1644473817 learned_addr learned my addr 172.21.15.154:0/1644473817 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f75aeffd700 1 -- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75b0130eb0 msgr2=0x7f75b011ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f75aeffd700 1 --2- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75b0130eb0 0x7f75b011ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f75aeffd700 1 -- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75b009d860 msgr2=0x7f75b011e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f75aeffd700 1 --2- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75b009d860 0x7f75b011e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f75aeffd700 1 -- 172.21.15.154:0/1644473817 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a800f050 con 0x7f75b009e170 2023-09-30T22:25:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f75af7fe700 1 --2- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75b009d860 0x7f75b011e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f75aeffd700 1 --2- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b009e170 0x7f75b011e930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75a400c4b0 tx=0x7f75a400c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f7597fff700 1 -- 172.21.15.154:0/1644473817 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40052d0 con 0x7f75b009e170 2023-09-30T22:25:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f7597fff700 1 -- 172.21.15.154:0/1644473817 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a4005430 con 0x7f75b009e170 2023-09-30T22:25:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f75b5f32700 1 -- 172.21.15.154:0/1644473817 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b00a2140 con 0x7f75b009e170 2023-09-30T22:25:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f7597fff700 1 -- 172.21.15.154:0/1644473817 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40038c0 con 0x7f75b009e170 2023-09-30T22:25:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.357+0000 7f75b5f32700 1 -- 172.21.15.154:0/1644473817 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b012ff80 con 0x7f75b009e170 2023-09-30T22:25:38.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.358+0000 7f7597fff700 1 -- 172.21.15.154:0/1644473817 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75a4003a20 con 0x7f75b009e170 2023-09-30T22:25:38.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.358+0000 7f75b5f32700 1 -- 172.21.15.154:0/1644473817 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b004f2a0 con 0x7f75b009e170 2023-09-30T22:25:38.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.358+0000 7f7597fff700 1 -- 172.21.15.154:0/1644473817 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f75a403ead0 con 0x7f75b009e170 2023-09-30T22:25:38.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.363+0000 7f7597fff700 1 -- 172.21.15.154:0/1644473817 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75a4018260 con 0x7f75b009e170 2023-09-30T22:25:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.392+0000 7f4edf44d700 1 Processor -- start 2023-09-30T22:25:38.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.392+0000 7f4edf44d700 1 -- start start 2023-09-30T22:25:38.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.392+0000 7f4edf44d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ed809e870 0x7f4ed809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.392+0000 7f4edf44d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 0x7f4ed8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.392+0000 7f4edf44d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed809c970 con 0x7f4ed8131d70 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.392+0000 7f4edf44d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed80a0920 con 0x7f4ed809e870 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.392+0000 7f4edf44d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed809f9c0 con 0x7f4ed809f180 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4edd1e9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ed809e870 0x7f4ed809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4edd1e9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ed809e870 0x7f4ed809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36206/0 (socket says 172.21.15.154:36206) 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4edd1e9700 1 -- 172.21.15.154:0/4112585971 learned_addr learned my addr 172.21.15.154:0/4112585971 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4edc9e8700 1 --2- 172.21.15.154:0/4112585971 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 0x7f4ed8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4edd1e9700 1 -- 172.21.15.154:0/4112585971 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 msgr2=0x7f4ed8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4edd1e9700 1 --2- 172.21.15.154:0/4112585971 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 0x7f4ed8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4ecffff700 1 -- 172.21.15.154:0/4112585971 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737953582 0 0) 0x7f4ed809c970 con 0x7f4ed8131d70 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4edd1e9700 1 -- 172.21.15.154:0/4112585971 >> v1:172.21.15.154:6789/0 conn(0x7f4ed8131d70 legacy=0x7f4ed8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4edd1e9700 1 -- 172.21.15.154:0/4112585971 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed809bab0 con 0x7f4ed809e870 2023-09-30T22:25:38.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4edd1e9700 1 --2- 172.21.15.154:0/4112585971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed809e870 0x7f4ed809ec40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40098f0 tx=0x7f4ed4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59252e10cb5365f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.393+0000 7f4ecffff700 1 -- 172.21.15.154:0/4112585971 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4011830 con 0x7f4ed809e870 2023-09-30T22:25:38.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.394+0000 7f4ecffff700 1 -- 172.21.15.154:0/4112585971 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed4011990 con 0x7f4ed809e870 2023-09-30T22:25:38.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.394+0000 7f4ecffff700 1 -- 172.21.15.154:0/4112585971 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4011d20 con 0x7f4ed809e870 2023-09-30T22:25:38.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.394+0000 7f4edf44d700 1 -- 172.21.15.154:0/4112585971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed809e870 msgr2=0x7f4ed809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.394+0000 7f4edf44d700 1 --2- 172.21.15.154:0/4112585971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed809e870 0x7f4ed809ec40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40098f0 tx=0x7f4ed4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:38.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.394+0000 7f4edf44d700 1 -- 172.21.15.154:0/4112585971 shutdown_connections 2023-09-30T22:25:38.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.394+0000 7f4edf44d700 1 --2- 172.21.15.154:0/4112585971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed809e870 0x7f4ed809ec40 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.394+0000 7f4edf44d700 1 --2- 172.21.15.154:0/4112585971 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 0x7f4ed8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.394+0000 7f4edf44d700 1 -- 172.21.15.154:0/4112585971 >> 172.21.15.154:0/4112585971 conn(0x7f4ed80a4430 msgr2=0x7f4ed80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.395+0000 7f4edf44d700 1 -- 172.21.15.154:0/4112585971 shutdown_connections 2023-09-30T22:25:38.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.395+0000 7f4edf44d700 1 -- 172.21.15.154:0/4112585971 wait complete. 2023-09-30T22:25:38.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.396+0000 7f4edf44d700 1 Processor -- start 2023-09-30T22:25:38.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.396+0000 7f4edf44d700 1 -- start start 2023-09-30T22:25:38.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edf44d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed809e870 0x7f4ed81c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edf44d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 0x7f4ed81c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edf44d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed8131d70 0x7f4ed81c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edf44d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed811e420 con 0x7f4ed8131d70 2023-09-30T22:25:38.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edf44d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed811e9d0 con 0x7f4ed809f180 2023-09-30T22:25:38.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edf44d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed809dba0 con 0x7f4ed809e870 2023-09-30T22:25:38.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edc9e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 0x7f4ed81c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edc9e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 0x7f4ed81c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43810/0 (socket says 172.21.15.154:43810) 2023-09-30T22:25:38.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edc9e8700 1 -- 172.21.15.154:0/3398486127 learned_addr learned my addr 172.21.15.154:0/3398486127 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edd1e9700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed809e870 0x7f4ed81c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edd9ea700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed8131d70 0x7f4ed81c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edd9ea700 1 -- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed809e870 msgr2=0x7f4ed81c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edd9ea700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed809e870 0x7f4ed81c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edd9ea700 1 -- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 msgr2=0x7f4ed81c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edd9ea700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 0x7f4ed81c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edd9ea700 1 -- 172.21.15.154:0/3398486127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4009550 con 0x7f4ed8131d70 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edd1e9700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed809e870 0x7f4ed81c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.397+0000 7f4edd9ea700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed8131d70 0x7f4ed81c6a80 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c7c0 tx=0x7f4ed000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.398+0000 7f4ecdffb700 1 -- 172.21.15.154:0/3398486127 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0003e30 con 0x7f4ed8131d70 2023-09-30T22:25:38.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.398+0000 7f4edf44d700 1 -- 172.21.15.154:0/3398486127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed811ec10 con 0x7f4ed8131d70 2023-09-30T22:25:38.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.398+0000 7f4ecdffb700 1 -- 172.21.15.154:0/3398486127 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0005070 con 0x7f4ed8131d70 2023-09-30T22:25:38.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.398+0000 7f4ecdffb700 1 -- 172.21.15.154:0/3398486127 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0005420 con 0x7f4ed8131d70 2023-09-30T22:25:38.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.398+0000 7f4edf44d700 1 -- 172.21.15.154:0/3398486127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed81317a0 con 0x7f4ed8131d70 2023-09-30T22:25:38.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.399+0000 7f4edf44d700 1 -- 172.21.15.154:0/3398486127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed804f2a0 con 0x7f4ed8131d70 2023-09-30T22:25:38.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.400+0000 7f4ecdffb700 1 -- 172.21.15.154:0/3398486127 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ed0005580 con 0x7f4ed8131d70 2023-09-30T22:25:38.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.400+0000 7f4ecdffb700 1 -- 172.21.15.154:0/3398486127 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4ed003f1c0 con 0x7f4ed8131d70 2023-09-30T22:25:38.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.408+0000 7f4ecdffb700 1 -- 172.21.15.154:0/3398486127 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ed0010d60 con 0x7f4ed8131d70 2023-09-30T22:25:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.432+0000 7fc6222ca700 1 Processor -- start 2023-09-30T22:25:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.432+0000 7fc6222ca700 1 -- start start 2023-09-30T22:25:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc6222ca700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc61c09e870 0x7fc61c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc6222ca700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc6222ca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c134160 0x7fc61c1345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc6222ca700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c0a0370 con 0x7fc61c09e870 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc6222ca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c09fa00 con 0x7fc61c134160 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc6222ca700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c09ada0 con 0x7fc61c09f180 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc620867700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c134160 0x7fc61c1345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc61bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc61c09e870 0x7fc61c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc620867700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c134160 0x7fc61c1345e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43818/0 (socket says 172.21.15.154:43818) 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc620867700 1 -- 172.21.15.154:0/3190340220 learned_addr learned my addr 172.21.15.154:0/3190340220 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc61b7fe700 1 --2- 172.21.15.154:0/3190340220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc61b7fe700 1 -- 172.21.15.154:0/3190340220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c134160 msgr2=0x7fc61c1345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc61b7fe700 1 --2- 172.21.15.154:0/3190340220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c134160 0x7fc61c1345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc61b7fe700 1 -- 172.21.15.154:0/3190340220 >> v2:172.21.15.154:3300/0 conn(0x7fc61c09e870 msgr2=0x7fc61c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc61b7fe700 1 --2- 172.21.15.154:0/3190340220 >> v2:172.21.15.154:3300/0 conn(0x7fc61c09e870 0x7fc61c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.433+0000 7fc61b7fe700 1 -- 172.21.15.154:0/3190340220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c06bec0 con 0x7fc61c09f180 2023-09-30T22:25:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.434+0000 7fc61b7fe700 1 --2- 172.21.15.154:0/3190340220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c133c20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc610009870 tx=0x7fc610009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86cf5e7e154e203f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.434+0000 7fc61affd700 1 -- 172.21.15.154:0/3190340220 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610011830 con 0x7fc61c09f180 2023-09-30T22:25:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.434+0000 7fc61affd700 1 -- 172.21.15.154:0/3190340220 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc610011990 con 0x7fc61c09f180 2023-09-30T22:25:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.434+0000 7fc61affd700 1 -- 172.21.15.154:0/3190340220 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610011d20 con 0x7fc61c09f180 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.434+0000 7fc6222ca700 1 -- 172.21.15.154:0/3190340220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 msgr2=0x7fc61c133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.434+0000 7fc6222ca700 1 --2- 172.21.15.154:0/3190340220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c133c20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc610009870 tx=0x7fc610009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.435+0000 7fc6222ca700 1 -- 172.21.15.154:0/3190340220 shutdown_connections 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.435+0000 7fc6222ca700 1 --2- 172.21.15.154:0/3190340220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c134160 0x7fc61c1345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.435+0000 7fc6222ca700 1 --2- 172.21.15.154:0/3190340220 >> v2:172.21.15.154:3300/0 conn(0x7fc61c09e870 0x7fc61c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.435+0000 7fc6222ca700 1 --2- 172.21.15.154:0/3190340220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c133c20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.435+0000 7fc6222ca700 1 -- 172.21.15.154:0/3190340220 >> 172.21.15.154:0/3190340220 conn(0x7fc61c0a4430 msgr2=0x7fc61c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.435+0000 7fc6222ca700 1 -- 172.21.15.154:0/3190340220 shutdown_connections 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.435+0000 7fc6222ca700 1 -- 172.21.15.154:0/3190340220 wait complete. 2023-09-30T22:25:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.436+0000 7fc6222ca700 1 Processor -- start 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.436+0000 7fc6222ca700 1 -- start start 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc6222ca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c09e870 0x7fc61c1224a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc6222ca700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c1229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc6222ca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c134160 0x7fc61c122f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc6222ca700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c125f70 con 0x7fc61c134160 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc6222ca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c125a60 con 0x7fc61c09e870 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc6222ca700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c125700 con 0x7fc61c09f180 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc61b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c1229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc61bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c09e870 0x7fc61c1224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc61b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c1229e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42538/0 (socket says 172.21.15.154:42538) 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc61b7fe700 1 -- 172.21.15.154:0/716534871 learned_addr learned my addr 172.21.15.154:0/716534871 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc620867700 1 --2- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c134160 0x7fc61c122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc61bfff700 1 -- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 msgr2=0x7fc61c1229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc61bfff700 1 --2- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c1229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc61bfff700 1 -- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c134160 msgr2=0x7fc61c122f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.437+0000 7fc61bfff700 1 --2- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c134160 0x7fc61c122f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.438+0000 7fc61bfff700 1 -- 172.21.15.154:0/716534871 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100094a0 con 0x7fc61c09e870 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.438+0000 7fc620867700 1 --2- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c134160 0x7fc61c122f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.438+0000 7fc61bfff700 1 --2- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c09e870 0x7fc61c1224a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00e870 tx=0x7fc60c00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.438+0000 7fc618ff9700 1 -- 172.21.15.154:0/716534871 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c013680 con 0x7fc61c09e870 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.438+0000 7fc618ff9700 1 -- 172.21.15.154:0/716534871 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c0137e0 con 0x7fc61c09e870 2023-09-30T22:25:38.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.438+0000 7fc6222ca700 1 -- 172.21.15.154:0/716534871 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c0a3ba0 con 0x7fc61c09e870 2023-09-30T22:25:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.438+0000 7fc618ff9700 1 -- 172.21.15.154:0/716534871 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c013b90 con 0x7fc61c09e870 2023-09-30T22:25:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.438+0000 7fc6222ca700 1 -- 172.21.15.154:0/716534871 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c124060 con 0x7fc61c09e870 2023-09-30T22:25:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.439+0000 7fc618ff9700 1 -- 172.21.15.154:0/716534871 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc60c013cf0 con 0x7fc61c09e870 2023-09-30T22:25:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.439+0000 7fc618ff9700 1 -- 172.21.15.154:0/716534871 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc60c020d50 con 0x7fc61c09e870 2023-09-30T22:25:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.439+0000 7fc6222ca700 1 -- 172.21.15.154:0/716534871 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c04f2a0 con 0x7fc61c09e870 2023-09-30T22:25:38.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.448+0000 7fc618ff9700 1 -- 172.21.15.154:0/716534871 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc60c017080 con 0x7fc61c09e870 2023-09-30T22:25:38.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.526+0000 7fc7a9647700 1 -- 172.21.15.154:0/2188685051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc7a40702d0 con 0x7fc7a4133ad0 2023-09-30T22:25:38.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.526+0000 7fc78b7fe700 1 -- 172.21.15.154:0/2188685051 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc794017030 con 0x7fc7a4133ad0 2023-09-30T22:25:38.526 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.529+0000 7fc7a9647700 1 -- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4133ad0 msgr2=0x7fc7a4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.529+0000 7fc7a9647700 1 --2- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4133ad0 0x7fc7a4071910 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc79400c450 tx=0x7fc79400c760 comp rx=0 tx=0).stop 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.529+0000 7fc7a9647700 1 -- 172.21.15.154:0/2188685051 shutdown_connections 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.529+0000 7fc7a9647700 1 --2- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7a4139280 0x7fc7a41c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.529+0000 7fc7a9647700 1 --2- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7a4133ad0 0x7fc7a4071910 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.529+0000 7fc7a9647700 1 --2- 172.21.15.154:0/2188685051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7a4136960 0x7fc7a4071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.529+0000 7fc7a9647700 1 -- 172.21.15.154:0/2188685051 >> 172.21.15.154:0/2188685051 conn(0x7fc7a4099c40 msgr2=0x7fc7a4134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.529+0000 7fc7a9647700 1 -- 172.21.15.154:0/2188685051 shutdown_connections 2023-09-30T22:25:38.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.529+0000 7fc7a9647700 1 -- 172.21.15.154:0/2188685051 wait complete. 2023-09-30T22:25:38.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:38.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.569+0000 7f75b5f32700 1 -- 172.21.15.154:0/1644473817 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f75b0121f70 con 0x7f75b009e170 2023-09-30T22:25:38.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.569+0000 7f7597fff700 1 -- 172.21.15.154:0/1644473817 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75a4017070 con 0x7f75b009e170 2023-09-30T22:25:38.569 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:38.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.571+0000 7f75b5f32700 1 -- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b009e170 msgr2=0x7f75b011e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.571+0000 7f75b5f32700 1 --2- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b009e170 0x7f75b011e930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75a400c4b0 tx=0x7f75a400c7c0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.571+0000 7f75b5f32700 1 -- 172.21.15.154:0/1644473817 shutdown_connections 2023-09-30T22:25:38.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.571+0000 7f75b5f32700 1 --2- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75b0130eb0 0x7f75b011ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.571+0000 7f75b5f32700 1 --2- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75b009d860 0x7f75b011e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.571+0000 7f75b5f32700 1 --2- 172.21.15.154:0/1644473817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75b009e170 0x7f75b011e930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.571+0000 7f75b5f32700 1 -- 172.21.15.154:0/1644473817 >> 172.21.15.154:0/1644473817 conn(0x7f75b0099c40 msgr2=0x7f75b00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.572+0000 7f75b5f32700 1 -- 172.21.15.154:0/1644473817 shutdown_connections 2023-09-30T22:25:38.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.572+0000 7f75b5f32700 1 -- 172.21.15.154:0/1644473817 wait complete. 2023-09-30T22:25:38.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:38.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.614+0000 7f4edf44d700 1 -- 172.21.15.154:0/3398486127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4ed806b2a0 con 0x7f4ed8131d70 2023-09-30T22:25:38.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.614+0000 7f4ecdffb700 1 -- 172.21.15.154:0/3398486127 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ed0017020 con 0x7f4ed8131d70 2023-09-30T22:25:38.614 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:38.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.616+0000 7f4edf44d700 1 -- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed8131d70 msgr2=0x7f4ed81c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.616+0000 7f4edf44d700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed8131d70 0x7f4ed81c6a80 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c7c0 tx=0x7f4ed000cad0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.616+0000 7f4edf44d700 1 -- 172.21.15.154:0/3398486127 shutdown_connections 2023-09-30T22:25:38.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.616+0000 7f4edf44d700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed8131d70 0x7f4ed81c6a80 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.616+0000 7f4edf44d700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed809e870 0x7f4ed81c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.616+0000 7f4edf44d700 1 --2- 172.21.15.154:0/3398486127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed809f180 0x7f4ed81c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.616+0000 7f4edf44d700 1 -- 172.21.15.154:0/3398486127 >> 172.21.15.154:0/3398486127 conn(0x7f4ed80a4430 msgr2=0x7f4ed809c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.616+0000 7f4edf44d700 1 -- 172.21.15.154:0/3398486127 shutdown_connections 2023-09-30T22:25:38.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.616+0000 7f4edf44d700 1 -- 172.21.15.154:0/3398486127 wait complete. 2023-09-30T22:25:38.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:38.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.647+0000 7fc6222ca700 1 -- 172.21.15.154:0/716534871 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc61c072d60 con 0x7fc61c09e870 2023-09-30T22:25:38.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.647+0000 7fc618ff9700 1 -- 172.21.15.154:0/716534871 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc60c01bbe0 con 0x7fc61c09e870 2023-09-30T22:25:38.648 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:38.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.649+0000 7fc6222ca700 1 -- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c09e870 msgr2=0x7fc61c1224a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:38.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.649+0000 7fc6222ca700 1 --2- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c09e870 0x7fc61c1224a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00e870 tx=0x7fc60c00eb80 comp rx=0 tx=0).stop 2023-09-30T22:25:38.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.649+0000 7fc6222ca700 1 -- 172.21.15.154:0/716534871 shutdown_connections 2023-09-30T22:25:38.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.649+0000 7fc6222ca700 1 --2- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc61c134160 0x7fc61c122f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.649+0000 7fc6222ca700 1 --2- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61c09e870 0x7fc61c1224a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.649+0000 7fc6222ca700 1 --2- 172.21.15.154:0/716534871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc61c09f180 0x7fc61c1229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:38.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.649+0000 7fc6222ca700 1 -- 172.21.15.154:0/716534871 >> 172.21.15.154:0/716534871 conn(0x7fc61c0a4430 msgr2=0x7fc61c0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:38.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.649+0000 7fc6222ca700 1 -- 172.21.15.154:0/716534871 shutdown_connections 2023-09-30T22:25:38.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:38.649+0000 7fc6222ca700 1 -- 172.21.15.154:0/716534871 wait complete. 2023-09-30T22:25:38.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:39.543 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:39.585 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:39.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:39.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:39.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.685+0000 7fa9c1c8a700 1 Processor -- start 2023-09-30T22:25:39.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.685+0000 7fa9c1c8a700 1 -- start start 2023-09-30T22:25:39.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.685+0000 7fa9c1c8a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.685+0000 7fa9c1c8a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9bc1356e0 0x7fa9bc137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.685+0000 7fa9c1c8a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc0a1e70 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.685+0000 7fa9c1c8a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9bc09a720 con 0x7fa9bc1356e0 2023-09-30T22:25:39.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.685+0000 7fa9c1c8a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc09b300 con 0x7fa9bc0a1510 2023-09-30T22:25:39.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.686+0000 7fa9baffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.686+0000 7fa9baffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc1351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42548/0 (socket says 172.21.15.154:42548) 2023-09-30T22:25:39.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.686+0000 7fa9baffd700 1 -- 172.21.15.154:0/1760411224 learned_addr learned my addr 172.21.15.154:0/1760411224 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:39.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.686+0000 7fa9bbfff700 1 --2- 172.21.15.154:0/1760411224 >> v2:172.21.15.154:3300/0 conn(0x7fa9bc1356e0 0x7fa9bc137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.686+0000 7fa9baffd700 1 -- 172.21.15.154:0/1760411224 >> v2:172.21.15.154:3300/0 conn(0x7fa9bc1356e0 msgr2=0x7fa9bc137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.686+0000 7fa9baffd700 1 --2- 172.21.15.154:0/1760411224 >> v2:172.21.15.154:3300/0 conn(0x7fa9bc1356e0 0x7fa9bc137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.686+0000 7fa9baffd700 1 -- 172.21.15.154:0/1760411224 >> v1:172.21.15.154:6789/0 conn(0x7fa9bc0a0a30 legacy=0x7fa9bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.686+0000 7fa9baffd700 1 -- 172.21.15.154:0/1760411224 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc09abc0 con 0x7fa9bc0a1510 2023-09-30T22:25:39.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.686+0000 7fa9baffd700 1 --2- 172.21.15.154:0/1760411224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc1351a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00098f0 tx=0x7fa9b0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a5096f4d88c650f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9ba7fc700 1 -- 172.21.15.154:0/1760411224 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000b8a0 con 0x7fa9bc0a1510 2023-09-30T22:25:39.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9ba7fc700 1 -- 172.21.15.154:0/1760411224 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b000ba00 con 0x7fa9bc0a1510 2023-09-30T22:25:39.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9ba7fc700 1 -- 172.21.15.154:0/1760411224 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000bd90 con 0x7fa9bc0a1510 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/1760411224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 msgr2=0x7fa9bc1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9c1c8a700 1 --2- 172.21.15.154:0/1760411224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc1351a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00098f0 tx=0x7fa9b0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/1760411224 shutdown_connections 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9c1c8a700 1 --2- 172.21.15.154:0/1760411224 >> v2:172.21.15.154:3300/0 conn(0x7fa9bc1356e0 0x7fa9bc137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9c1c8a700 1 --2- 172.21.15.154:0/1760411224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc1351a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/1760411224 >> 172.21.15.154:0/1760411224 conn(0x7fa9bc0a2980 msgr2=0x7fa9bc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/1760411224 shutdown_connections 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.687+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/1760411224 wait complete. 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.688+0000 7fa9c1c8a700 1 Processor -- start 2023-09-30T22:25:39.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9c1c8a700 1 -- start start 2023-09-30T22:25:39.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9c1c8a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0a0a30 0x7fa9bc11d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9c1c8a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc11dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9c1c8a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc1356e0 0x7fa9bc11e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9c1c8a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc120ad0 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9c1c8a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc09ae00 con 0x7fa9bc1356e0 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9c1c8a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc06fd90 con 0x7fa9bc0a1510 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9bbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc1356e0 0x7fa9bc11e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9bbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc1356e0 0x7fa9bc11e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43828/0 (socket says 172.21.15.154:43828) 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9bbfff700 1 -- 172.21.15.154:0/2560193590 learned_addr learned my addr 172.21.15.154:0/2560193590 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9bb7fe700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0a0a30 0x7fa9bc11d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.689+0000 7fa9baffd700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc11dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9bb7fe700 1 -- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 msgr2=0x7fa9bc11dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9bb7fe700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc11dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9bb7fe700 1 -- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc1356e0 msgr2=0x7fa9bc11e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9bb7fe700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc1356e0 0x7fa9bc11e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9bb7fe700 1 -- 172.21.15.154:0/2560193590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b0009550 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9bbfff700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc1356e0 0x7fa9bc11e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9baffd700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc11dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9bb7fe700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0a0a30 0x7fa9bc11d820 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000fd0 tx=0x7fa9ac00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9a3fff700 1 -- 172.21.15.154:0/2560193590 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac0054e0 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9a3fff700 1 -- 172.21.15.154:0/2560193590 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac00ce50 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9a3fff700 1 -- 172.21.15.154:0/2560193590 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac0038a0 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/2560193590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc11f430 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.690+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/2560193590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc121840 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.691+0000 7fa9a3fff700 1 -- 172.21.15.154:0/2560193590 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9ac003a00 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.691+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/2560193590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9bc120ec0 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.692+0000 7fa9a3fff700 1 -- 172.21.15.154:0/2560193590 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9ac03eb00 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.700+0000 7fa9a3fff700 1 -- 172.21.15.154:0/2560193590 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9bc120ec0 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.726+0000 7fa58f562700 1 Processor -- start 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.726+0000 7fa58f562700 1 -- start start 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58f562700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa5881368e0 0x7fa588138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58f562700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588139200 0x7fa58813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58f562700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58809a760 con 0x7fa588133900 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58f562700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5881336e0 con 0x7fa5881368e0 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58f562700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa58809a080 con 0x7fa588139200 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58daff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588139200 0x7fa58813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58daff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588139200 0x7fa58813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42566/0 (socket says 172.21.15.154:42566) 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58daff700 1 -- 172.21.15.154:0/3712921399 learned_addr learned my addr 172.21.15.154:0/3712921399 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58cafd700 1 --2- 172.21.15.154:0/3712921399 >> v2:172.21.15.154:3300/0 conn(0x7fa5881368e0 0x7fa588138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58daff700 1 -- 172.21.15.154:0/3712921399 >> v2:172.21.15.154:3300/0 conn(0x7fa5881368e0 msgr2=0x7fa588138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58daff700 1 --2- 172.21.15.154:0/3712921399 >> v2:172.21.15.154:3300/0 conn(0x7fa5881368e0 0x7fa588138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.727+0000 7fa58daff700 1 -- 172.21.15.154:0/3712921399 >> v1:172.21.15.154:6789/0 conn(0x7fa588133900 legacy=0x7fa588133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.728+0000 7fa58daff700 1 -- 172.21.15.154:0/3712921399 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880a23e0 con 0x7fa588139200 2023-09-30T22:25:39.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.728+0000 7fa58daff700 1 --2- 172.21.15.154:0/3712921399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588139200 0x7fa58813b5e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa580009e50 tx=0x7fa58000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7eb0da451ef96d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.728+0000 7fa57ffff700 1 -- 172.21.15.154:0/3712921399 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000e070 con 0x7fa588139200 2023-09-30T22:25:39.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.728+0000 7fa57ffff700 1 -- 172.21.15.154:0/3712921399 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000b910 con 0x7fa588139200 2023-09-30T22:25:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.728+0000 7fa57ffff700 1 -- 172.21.15.154:0/3712921399 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000bcc0 con 0x7fa588139200 2023-09-30T22:25:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.729+0000 7fa58f562700 1 -- 172.21.15.154:0/3712921399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588139200 msgr2=0x7fa58813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.729+0000 7fa58f562700 1 --2- 172.21.15.154:0/3712921399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588139200 0x7fa58813b5e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa580009e50 tx=0x7fa58000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.729+0000 7fa58f562700 1 -- 172.21.15.154:0/3712921399 shutdown_connections 2023-09-30T22:25:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.729+0000 7fa58f562700 1 --2- 172.21.15.154:0/3712921399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588139200 0x7fa58813b5e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.729+0000 7fa58f562700 1 --2- 172.21.15.154:0/3712921399 >> v2:172.21.15.154:3300/0 conn(0x7fa5881368e0 0x7fa588138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.729+0000 7fa58f562700 1 -- 172.21.15.154:0/3712921399 >> 172.21.15.154:0/3712921399 conn(0x7fa5880a2980 msgr2=0x7fa5880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.729+0000 7fa58f562700 1 -- 172.21.15.154:0/3712921399 shutdown_connections 2023-09-30T22:25:39.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.729+0000 7fa58f562700 1 -- 172.21.15.154:0/3712921399 wait complete. 2023-09-30T22:25:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.730+0000 7fa58f562700 1 Processor -- start 2023-09-30T22:25:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58f562700 1 -- start start 2023-09-30T22:25:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58f562700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588133900 0x7fa58811aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58f562700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5881368e0 0x7fa58811b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58f562700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588139200 0x7fa58811b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58f562700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58811ea40 con 0x7fa5881368e0 2023-09-30T22:25:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58f562700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58811e400 con 0x7fa588139200 2023-09-30T22:25:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58f562700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa588135c50 con 0x7fa588133900 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58d2fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588133900 0x7fa58811aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58d2fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588133900 0x7fa58811aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42570/0 (socket says 172.21.15.154:42570) 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.731+0000 7fa58d2fe700 1 -- 172.21.15.154:0/4147619737 learned_addr learned my addr 172.21.15.154:0/4147619737 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58daff700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588139200 0x7fa58811b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58cafd700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5881368e0 0x7fa58811b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58daff700 1 -- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588133900 msgr2=0x7fa58811aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58daff700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588133900 0x7fa58811aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58daff700 1 -- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5881368e0 msgr2=0x7fa58811b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58daff700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5881368e0 0x7fa58811b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58daff700 1 -- 172.21.15.154:0/4147619737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580009b30 con 0x7fa588139200 2023-09-30T22:25:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58cafd700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5881368e0 0x7fa58811b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58daff700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588139200 0x7fa58811b940 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa580015000 tx=0x7fa580004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa57dffb700 1 -- 172.21.15.154:0/4147619737 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa580004800 con 0x7fa588139200 2023-09-30T22:25:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa57dffb700 1 -- 172.21.15.154:0/4147619737 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa580004960 con 0x7fa588139200 2023-09-30T22:25:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa58f562700 1 -- 172.21.15.154:0/4147619737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58811cc00 con 0x7fa588139200 2023-09-30T22:25:39.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.732+0000 7fa57dffb700 1 -- 172.21.15.154:0/4147619737 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58001c680 con 0x7fa588139200 2023-09-30T22:25:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.733+0000 7fa58f562700 1 -- 172.21.15.154:0/4147619737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58811e6c0 con 0x7fa588139200 2023-09-30T22:25:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.733+0000 7fa57dffb700 1 -- 172.21.15.154:0/4147619737 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa58001c7e0 con 0x7fa588139200 2023-09-30T22:25:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.734+0000 7fa57dffb700 1 -- 172.21.15.154:0/4147619737 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa580040ce0 con 0x7fa588139200 2023-09-30T22:25:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.734+0000 7fa58f562700 1 -- 172.21.15.154:0/4147619737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58811cba0 con 0x7fa588139200 2023-09-30T22:25:39.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.739+0000 7fa57dffb700 1 -- 172.21.15.154:0/4147619737 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5800123f0 con 0x7fa588139200 2023-09-30T22:25:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.769+0000 7fb1d784a700 1 Processor -- start 2023-09-30T22:25:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d784a700 1 -- start start 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d784a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d006a770 0x7fb1d006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d784a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1d006b080 0x7fb1d01317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d784a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d0131cf0 0x7fb1d0132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d784a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d009f770 con 0x7fb1d006b080 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d4de5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1d006b080 0x7fb1d01317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d55e6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d006a770 0x7fb1d006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d4de5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1d006b080 0x7fb1d01317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36268/0 (socket says 172.21.15.154:36268) 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d4de5700 1 -- 172.21.15.154:0/3128679653 learned_addr learned my addr 172.21.15.154:0/3128679653 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d784a700 1 -- 172.21.15.154:0/3128679653 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d009dce0 con 0x7fb1d0131cf0 2023-09-30T22:25:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d784a700 1 -- 172.21.15.154:0/3128679653 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d009da80 con 0x7fb1d006a770 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.770+0000 7fb1d5de7700 1 --2- 172.21.15.154:0/3128679653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d0131cf0 0x7fb1d0132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.771+0000 7fb1d55e6700 1 -- 172.21.15.154:0/3128679653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d0131cf0 msgr2=0x7fb1d0132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.771+0000 7fb1d55e6700 1 --2- 172.21.15.154:0/3128679653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d0131cf0 0x7fb1d0132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.771+0000 7fb1d55e6700 1 -- 172.21.15.154:0/3128679653 >> v2:172.21.15.154:3300/0 conn(0x7fb1d006b080 msgr2=0x7fb1d01317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.771+0000 7fb1d55e6700 1 --2- 172.21.15.154:0/3128679653 >> v2:172.21.15.154:3300/0 conn(0x7fb1d006b080 0x7fb1d01317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.771+0000 7fb1d55e6700 1 -- 172.21.15.154:0/3128679653 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d009eb20 con 0x7fb1d006a770 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.771+0000 7fb1d55e6700 1 --2- 172.21.15.154:0/3128679653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d006a770 0x7fb1d006ab40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009840 tx=0x7fb1cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b6d6f35ed8b2565 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.771+0000 7fb1c7fff700 1 -- 172.21.15.154:0/3128679653 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc011830 con 0x7fb1d006a770 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.771+0000 7fb1c7fff700 1 -- 172.21.15.154:0/3128679653 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc011990 con 0x7fb1d006a770 2023-09-30T22:25:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.771+0000 7fb1c7fff700 1 -- 172.21.15.154:0/3128679653 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc011d20 con 0x7fb1d006a770 2023-09-30T22:25:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.772+0000 7fb1d784a700 1 -- 172.21.15.154:0/3128679653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d006a770 msgr2=0x7fb1d006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.772+0000 7fb1d784a700 1 --2- 172.21.15.154:0/3128679653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d006a770 0x7fb1d006ab40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009840 tx=0x7fb1cc009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.772+0000 7fb1d784a700 1 -- 172.21.15.154:0/3128679653 shutdown_connections 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.772+0000 7fb1d784a700 1 --2- 172.21.15.154:0/3128679653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d0131cf0 0x7fb1d0132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.772+0000 7fb1d784a700 1 --2- 172.21.15.154:0/3128679653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d006a770 0x7fb1d006ab40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.772+0000 7fb1d784a700 1 --2- 172.21.15.154:0/3128679653 >> v2:172.21.15.154:3300/0 conn(0x7fb1d006b080 0x7fb1d01317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.772+0000 7fb1d784a700 1 -- 172.21.15.154:0/3128679653 >> 172.21.15.154:0/3128679653 conn(0x7fb1d0099c40 msgr2=0x7fb1d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.772+0000 7fb1d784a700 1 -- 172.21.15.154:0/3128679653 shutdown_connections 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.772+0000 7fb1d784a700 1 -- 172.21.15.154:0/3128679653 wait complete. 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d784a700 1 Processor -- start 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d784a700 1 -- start start 2023-09-30T22:25:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d784a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d006a770 0x7fb1d01c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d784a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d006b080 0x7fb1d01c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d784a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d0131cf0 0x7fb1d01c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d784a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d011bcc0 con 0x7fb1d006a770 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d784a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d011d600 con 0x7fb1d006b080 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d784a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d011d3d0 con 0x7fb1d0131cf0 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d5de7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d0131cf0 0x7fb1d01c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d5de7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d0131cf0 0x7fb1d01c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42592/0 (socket says 172.21.15.154:42592) 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.773+0000 7fb1d5de7700 1 -- 172.21.15.154:0/1885861104 learned_addr learned my addr 172.21.15.154:0/1885861104 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d55e6700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d006a770 0x7fb1d01c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d4de5700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d006b080 0x7fb1d01c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d5de7700 1 -- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d006b080 msgr2=0x7fb1d01c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d5de7700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d006b080 0x7fb1d01c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d5de7700 1 -- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d006a770 msgr2=0x7fb1d01c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d5de7700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d006a770 0x7fb1d01c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d5de7700 1 -- 172.21.15.154:0/1885861104 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc0094a0 con 0x7fb1d0131cf0 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d4de5700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d006b080 0x7fb1d01c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d5de7700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d0131cf0 0x7fb1d01c6900 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800efc0 tx=0x7fb1c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1c5ffb700 1 -- 172.21.15.154:0/1885861104 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8009ea0 con 0x7fb1d0131cf0 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1c5ffb700 1 -- 172.21.15.154:0/1885861104 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c800f040 con 0x7fb1d0131cf0 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1c5ffb700 1 -- 172.21.15.154:0/1885861104 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8014480 con 0x7fb1d0131cf0 2023-09-30T22:25:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d784a700 1 -- 172.21.15.154:0/1885861104 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d00a2a40 con 0x7fb1d0131cf0 2023-09-30T22:25:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.774+0000 7fb1d784a700 1 -- 172.21.15.154:0/1885861104 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d0071e70 con 0x7fb1d0131cf0 2023-09-30T22:25:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.775+0000 7fb1c5ffb700 1 -- 172.21.15.154:0/1885861104 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1c80145e0 con 0x7fb1d0131cf0 2023-09-30T22:25:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.775+0000 7fb1c5ffb700 1 -- 172.21.15.154:0/1885861104 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb1c80401f0 con 0x7fb1d0131cf0 2023-09-30T22:25:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.776+0000 7fb1d784a700 1 -- 172.21.15.154:0/1885861104 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d011e0a0 con 0x7fb1d0131cf0 2023-09-30T22:25:39.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.780+0000 7fb1c5ffb700 1 -- 172.21.15.154:0/1885861104 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1c8018020 con 0x7fb1d0131cf0 2023-09-30T22:25:39.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.809+0000 7f0003351700 1 Processor -- start 2023-09-30T22:25:39.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.809+0000 7f0003351700 1 -- start start 2023-09-30T22:25:39.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.809+0000 7f0003351700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efffc099e20 0x7efffc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.809+0000 7f0003351700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc09a730 0x7efffc130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.809+0000 7f0003351700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc130890 0x7efffc130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.809+0000 7f0003351700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc09bf50 con 0x7efffc099e20 2023-09-30T22:25:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.809+0000 7f0003351700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc131220 con 0x7efffc130890 2023-09-30T22:25:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.809+0000 7f0003351700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efffc099a60 con 0x7efffc09a730 2023-09-30T22:25:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00018ee700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc130890 0x7efffc130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00018ee700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc130890 0x7efffc130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43852/0 (socket says 172.21.15.154:43852) 2023-09-30T22:25:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00018ee700 1 -- 172.21.15.154:0/4242996190 learned_addr learned my addr 172.21.15.154:0/4242996190 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00010ed700 1 --2- 172.21.15.154:0/4242996190 >> v2:172.21.15.154:3300/0 conn(0x7efffc099e20 0x7efffc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00008ec700 1 --2- 172.21.15.154:0/4242996190 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc09a730 0x7efffc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00018ee700 1 -- 172.21.15.154:0/4242996190 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc09a730 msgr2=0x7efffc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00018ee700 1 --2- 172.21.15.154:0/4242996190 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc09a730 0x7efffc130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00018ee700 1 -- 172.21.15.154:0/4242996190 >> v2:172.21.15.154:3300/0 conn(0x7efffc099e20 msgr2=0x7efffc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00018ee700 1 --2- 172.21.15.154:0/4242996190 >> v2:172.21.15.154:3300/0 conn(0x7efffc099e20 0x7efffc09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00018ee700 1 -- 172.21.15.154:0/4242996190 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc09b230 con 0x7efffc130890 2023-09-30T22:25:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7f00018ee700 1 --2- 172.21.15.154:0/4242996190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc130890 0x7efffc130ce0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efff400d180 tx=0x7efff400d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=302e880dbd13b62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7efff3fff700 1 -- 172.21.15.154:0/4242996190 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4010070 con 0x7efffc130890 2023-09-30T22:25:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7efff3fff700 1 -- 172.21.15.154:0/4242996190 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400dd00 con 0x7efffc130890 2023-09-30T22:25:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.810+0000 7efff3fff700 1 -- 172.21.15.154:0/4242996190 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400b310 con 0x7efffc130890 2023-09-30T22:25:39.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.811+0000 7f0003351700 1 -- 172.21.15.154:0/4242996190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc130890 msgr2=0x7efffc130ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.811+0000 7f0003351700 1 --2- 172.21.15.154:0/4242996190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc130890 0x7efffc130ce0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efff400d180 tx=0x7efff400d490 comp rx=0 tx=0).stop 2023-09-30T22:25:39.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.811+0000 7f0003351700 1 -- 172.21.15.154:0/4242996190 shutdown_connections 2023-09-30T22:25:39.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.811+0000 7f0003351700 1 --2- 172.21.15.154:0/4242996190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc130890 0x7efffc130ce0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.811+0000 7f0003351700 1 --2- 172.21.15.154:0/4242996190 >> v2:172.21.15.154:3300/0 conn(0x7efffc099e20 0x7efffc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.811+0000 7f0003351700 1 --2- 172.21.15.154:0/4242996190 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc09a730 0x7efffc130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.811+0000 7f0003351700 1 -- 172.21.15.154:0/4242996190 >> 172.21.15.154:0/4242996190 conn(0x7efffc0a2980 msgr2=0x7efffc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.811+0000 7f0003351700 1 -- 172.21.15.154:0/4242996190 shutdown_connections 2023-09-30T22:25:39.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.811+0000 7f0003351700 1 -- 172.21.15.154:0/4242996190 wait complete. 2023-09-30T22:25:39.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.812+0000 7f0003351700 1 Processor -- start 2023-09-30T22:25:39.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.812+0000 7f0003351700 1 -- start start 2023-09-30T22:25:39.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f0003351700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc099e20 0x7efffc11b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f0003351700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc09a730 0x7efffc11bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f0003351700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc130890 0x7efffc11c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f0003351700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc11e9d0 con 0x7efffc130890 2023-09-30T22:25:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f0003351700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc11d2f0 con 0x7efffc09a730 2023-09-30T22:25:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f0003351700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efffc11ee80 con 0x7efffc099e20 2023-09-30T22:25:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00018ee700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc130890 0x7efffc11c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00018ee700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc130890 0x7efffc11c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36284/0 (socket says 172.21.15.154:36284) 2023-09-30T22:25:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00018ee700 1 -- 172.21.15.154:0/1944739456 learned_addr learned my addr 172.21.15.154:0/1944739456 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00008ec700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc09a730 0x7efffc11bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00010ed700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc099e20 0x7efffc11b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:39.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00018ee700 1 -- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc099e20 msgr2=0x7efffc11b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00018ee700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc099e20 0x7efffc11b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00018ee700 1 -- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc09a730 msgr2=0x7efffc11bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00018ee700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc09a730 0x7efffc11bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00018ee700 1 -- 172.21.15.154:0/1944739456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff400bd40 con 0x7efffc130890 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00008ec700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc09a730 0x7efffc11bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.813+0000 7f00018ee700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc130890 0x7efffc11c0c0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7efff4003f50 tx=0x7efff4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.814+0000 7efff1ffb700 1 -- 172.21.15.154:0/1944739456 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4009a10 con 0x7efffc130890 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.814+0000 7efff1ffb700 1 -- 172.21.15.154:0/1944739456 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4009b90 con 0x7efffc130890 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.814+0000 7f0003351700 1 -- 172.21.15.154:0/1944739456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc0a1220 con 0x7efffc130890 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.814+0000 7efff1ffb700 1 -- 172.21.15.154:0/1944739456 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4004040 con 0x7efffc130890 2023-09-30T22:25:39.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.814+0000 7f0003351700 1 -- 172.21.15.154:0/1944739456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc09b4c0 con 0x7efffc130890 2023-09-30T22:25:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.815+0000 7efff1ffb700 1 -- 172.21.15.154:0/1944739456 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efff40041a0 con 0x7efffc130890 2023-09-30T22:25:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.815+0000 7efff1ffb700 1 -- 172.21.15.154:0/1944739456 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efff4041540 con 0x7efffc130890 2023-09-30T22:25:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.815+0000 7f0003351700 1 -- 172.21.15.154:0/1944739456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc071740 con 0x7efffc130890 2023-09-30T22:25:39.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.820+0000 7efff1ffb700 1 -- 172.21.15.154:0/1944739456 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efff4022070 con 0x7efffc130890 2023-09-30T22:25:39.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.934+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/2560193590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa9bc11a590 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.935+0000 7fa9a3fff700 1 -- 172.21.15.154:0/2560193590 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9ac017070 con 0x7fa9bc0a0a30 2023-09-30T22:25:39.935 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.938+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0a0a30 msgr2=0x7fa9bc11d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.938+0000 7fa9c1c8a700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0a0a30 0x7fa9bc11d820 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000fd0 tx=0x7fa9ac00c7b0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.938+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/2560193590 shutdown_connections 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.938+0000 7fa9c1c8a700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc1356e0 0x7fa9bc11e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.938+0000 7fa9c1c8a700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0a0a30 0x7fa9bc11d820 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.938+0000 7fa9c1c8a700 1 --2- 172.21.15.154:0/2560193590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9bc0a1510 0x7fa9bc11dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.938+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/2560193590 >> 172.21.15.154:0/2560193590 conn(0x7fa9bc0a2980 msgr2=0x7fa9bc134820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.938+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/2560193590 shutdown_connections 2023-09-30T22:25:39.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.938+0000 7fa9c1c8a700 1 -- 172.21.15.154:0/2560193590 wait complete. 2023-09-30T22:25:39.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:39.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.977+0000 7fb1d784a700 1 -- 172.21.15.154:0/1885861104 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb1d011f1d0 con 0x7fb1d0131cf0 2023-09-30T22:25:39.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.978+0000 7fb1c5ffb700 1 -- 172.21.15.154:0/1885861104 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1d011f1d0 con 0x7fb1d0131cf0 2023-09-30T22:25:39.978 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.980+0000 7fb1d784a700 1 -- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d0131cf0 msgr2=0x7fb1d01c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.980+0000 7fb1d784a700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d0131cf0 0x7fb1d01c6900 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800efc0 tx=0x7fb1c800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.980+0000 7fb1d784a700 1 -- 172.21.15.154:0/1885861104 shutdown_connections 2023-09-30T22:25:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.980+0000 7fb1d784a700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb1d0131cf0 0x7fb1d01c6900 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.980+0000 7fb1d784a700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1d006a770 0x7fb1d01c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.980+0000 7fb1d784a700 1 --2- 172.21.15.154:0/1885861104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1d006b080 0x7fb1d01c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.980+0000 7fb1d784a700 1 -- 172.21.15.154:0/1885861104 >> 172.21.15.154:0/1885861104 conn(0x7fb1d0099c40 msgr2=0x7fb1d00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.980+0000 7fb1d784a700 1 -- 172.21.15.154:0/1885861104 shutdown_connections 2023-09-30T22:25:39.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.980+0000 7fb1d784a700 1 -- 172.21.15.154:0/1885861104 wait complete. 2023-09-30T22:25:39.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.989+0000 7fa58f562700 1 -- 172.21.15.154:0/4147619737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa58804f2a0 con 0x7fa588139200 2023-09-30T22:25:39.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.990+0000 7fa57dffb700 1 -- 172.21.15.154:0/4147619737 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa580033090 con 0x7fa588139200 2023-09-30T22:25:39.990 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.993+0000 7fa58f562700 1 -- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588139200 msgr2=0x7fa58811b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.993+0000 7fa58f562700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588139200 0x7fa58811b940 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa580015000 tx=0x7fa580004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.993+0000 7fa58f562700 1 -- 172.21.15.154:0/4147619737 shutdown_connections 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.993+0000 7fa58f562700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588139200 0x7fa58811b940 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.993+0000 7fa58f562700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa588133900 0x7fa58811aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.993+0000 7fa58f562700 1 --2- 172.21.15.154:0/4147619737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5881368e0 0x7fa58811b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.993+0000 7fa58f562700 1 -- 172.21.15.154:0/4147619737 >> 172.21.15.154:0/4147619737 conn(0x7fa5880a2980 msgr2=0x7fa588135df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.993+0000 7fa58f562700 1 -- 172.21.15.154:0/4147619737 shutdown_connections 2023-09-30T22:25:39.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:39.993+0000 7fa58f562700 1 -- 172.21.15.154:0/4147619737 wait complete. 2023-09-30T22:25:39.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:40.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.033+0000 7f0003351700 1 -- 172.21.15.154:0/1944739456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efffc11f280 con 0x7efffc130890 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.034+0000 7efff1ffb700 1 -- 172.21.15.154:0/1944739456 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efff4004450 con 0x7efffc130890 2023-09-30T22:25:40.034 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:40.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.036+0000 7f0003351700 1 -- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc130890 msgr2=0x7efffc11c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.036+0000 7f0003351700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc130890 0x7efffc11c0c0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7efff4003f50 tx=0x7efff4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.036+0000 7f0003351700 1 -- 172.21.15.154:0/1944739456 shutdown_connections 2023-09-30T22:25:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.036+0000 7f0003351700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efffc130890 0x7efffc11c0c0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.036+0000 7f0003351700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efffc099e20 0x7efffc11b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.036+0000 7f0003351700 1 --2- 172.21.15.154:0/1944739456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efffc09a730 0x7efffc11bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.036+0000 7f0003351700 1 -- 172.21.15.154:0/1944739456 >> 172.21.15.154:0/1944739456 conn(0x7efffc0a2980 msgr2=0x7efffc09f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.036+0000 7f0003351700 1 -- 172.21.15.154:0/1944739456 shutdown_connections 2023-09-30T22:25:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:40.036+0000 7f0003351700 1 -- 172.21.15.154:0/1944739456 wait complete. 2023-09-30T22:25:40.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:40.956 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:40.997 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:41.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:41.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:41.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.086+0000 7f0698976700 1 Processor -- start 2023-09-30T22:25:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.086+0000 7f0698976700 1 -- start start 2023-09-30T22:25:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.086+0000 7f0698976700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f069409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.086+0000 7f0698976700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0694131f40 0x7f0694139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.086+0000 7f0698976700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069409c970 con 0x7f069409f180 2023-09-30T22:25:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.086+0000 7f0698976700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06940a0920 con 0x7f0694131f40 2023-09-30T22:25:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.086+0000 7f0698976700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f069409f9c0 con 0x7f069409e870 2023-09-30T22:25:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f069409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f0692d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0694131f40 0x7f0694139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f069409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42618/0 (socket says 172.21.15.154:42618) 2023-09-30T22:25:41.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f0692d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0694131f40 0x7f0694139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36290/0 (socket says 172.21.15.154:36290) 2023-09-30T22:25:41.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069259c700 1 -- 172.21.15.154:0/2672461161 learned_addr learned my addr 172.21.15.154:0/2672461161 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:41.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069259c700 1 -- 172.21.15.154:0/2672461161 >> v2:172.21.15.154:3300/0 conn(0x7f0694131f40 msgr2=0x7f0694139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069259c700 1 --2- 172.21.15.154:0/2672461161 >> v2:172.21.15.154:3300/0 conn(0x7f0694131f40 0x7f0694139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069259c700 1 -- 172.21.15.154:0/2672461161 >> v1:172.21.15.154:6789/0 conn(0x7f069409f180 legacy=0x7f0694131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069259c700 1 -- 172.21.15.154:0/2672461161 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069409bab0 con 0x7f069409e870 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f0692d9d700 1 --2- 172.21.15.154:0/2672461161 >> v2:172.21.15.154:3300/0 conn(0x7f0694131f40 0x7f0694139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069259c700 1 --2- 172.21.15.154:0/2672461161 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f069409ec40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f06840098f0 tx=0x7f0684009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9b852c2c1a5252f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069159a700 1 -- 172.21.15.154:0/2672461161 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011830 con 0x7f069409e870 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069159a700 1 -- 172.21.15.154:0/2672461161 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684011990 con 0x7f069409e870 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.087+0000 7f069159a700 1 -- 172.21.15.154:0/2672461161 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011d20 con 0x7f069409e870 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.088+0000 7f0698976700 1 -- 172.21.15.154:0/2672461161 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 msgr2=0x7f069409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.088+0000 7f0698976700 1 --2- 172.21.15.154:0/2672461161 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f069409ec40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f06840098f0 tx=0x7f0684009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.088+0000 7f0698976700 1 -- 172.21.15.154:0/2672461161 shutdown_connections 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.088+0000 7f0698976700 1 --2- 172.21.15.154:0/2672461161 >> v2:172.21.15.154:3300/0 conn(0x7f0694131f40 0x7f0694139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.088+0000 7f0698976700 1 --2- 172.21.15.154:0/2672461161 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f069409ec40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.088+0000 7f0698976700 1 -- 172.21.15.154:0/2672461161 >> 172.21.15.154:0/2672461161 conn(0x7f06940a4430 msgr2=0x7f06940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.088+0000 7f0698976700 1 -- 172.21.15.154:0/2672461161 shutdown_connections 2023-09-30T22:25:41.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.088+0000 7f0698976700 1 -- 172.21.15.154:0/2672461161 wait complete. 2023-09-30T22:25:41.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.089+0000 7f0698976700 1 Processor -- start 2023-09-30T22:25:41.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.089+0000 7f0698976700 1 -- start start 2023-09-30T22:25:41.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f0698976700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f0694132600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f0698976700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f069409f180 0x7f0694132b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f0698976700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0694131f40 0x7f0694133080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f0698976700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06941356d0 con 0x7f069409f180 2023-09-30T22:25:41.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f0698976700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06941347a0 con 0x7f0694131f40 2023-09-30T22:25:41.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f0698976700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06941338a0 con 0x7f069409e870 2023-09-30T22:25:41.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f069259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f0694132600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f069259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f0694132600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42620/0 (socket says 172.21.15.154:42620) 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f069259c700 1 -- 172.21.15.154:0/739382066 learned_addr learned my addr 172.21.15.154:0/739382066 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.090+0000 7f0691d9b700 1 --2- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f069409f180 0x7f0694132b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f069259c700 1 -- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0694131f40 msgr2=0x7f0694133080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f069259c700 1 --2- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0694131f40 0x7f0694133080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f069259c700 1 -- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f069409f180 msgr2=0x7f0694132b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f069259c700 1 --2- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f069409f180 0x7f0694132b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f069259c700 1 -- 172.21.15.154:0/739382066 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c009a70 con 0x7f069409e870 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f069259c700 1 --2- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f0694132600 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0684014040 tx=0x7f0684004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f0682ffd700 1 -- 172.21.15.154:0/739382066 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684004510 con 0x7f069409e870 2023-09-30T22:25:41.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f0682ffd700 1 -- 172.21.15.154:0/739382066 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068401e070 con 0x7f069409e870 2023-09-30T22:25:41.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f0698976700 1 -- 172.21.15.154:0/739382066 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0684009550 con 0x7f069409e870 2023-09-30T22:25:41.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f0682ffd700 1 -- 172.21.15.154:0/739382066 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840038e0 con 0x7f069409e870 2023-09-30T22:25:41.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.091+0000 7f0698976700 1 -- 172.21.15.154:0/739382066 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0694133d00 con 0x7f069409e870 2023-09-30T22:25:41.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.092+0000 7f0682ffd700 1 -- 172.21.15.154:0/739382066 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0684003a40 con 0x7f069409e870 2023-09-30T22:25:41.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.092+0000 7f0682ffd700 1 -- 172.21.15.154:0/739382066 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0684040670 con 0x7f069409e870 2023-09-30T22:25:41.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.092+0000 7f0698976700 1 -- 172.21.15.154:0/739382066 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069406ad00 con 0x7f069409e870 2023-09-30T22:25:41.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.098+0000 7f0682ffd700 1 -- 172.21.15.154:0/739382066 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0684015020 con 0x7f069409e870 2023-09-30T22:25:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.146+0000 7f1c2b3f4700 1 Processor -- start 2023-09-30T22:25:41.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.146+0000 7f1c2b3f4700 1 -- start start 2023-09-30T22:25:41.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.146+0000 7f1c2b3f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c24133900 0x7f1c24133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.146+0000 7f1c2b3f4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c24134210 0x7f1c240a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.146+0000 7f1c2b3f4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2409a760 con 0x7f1c240a0ee0 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.146+0000 7f1c2b3f4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c241336e0 con 0x7f1c24134210 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.146+0000 7f1c2b3f4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2409a080 con 0x7f1c24133900 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.146+0000 7f1c29190700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c24133900 0x7f1c24133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c29190700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c24133900 0x7f1c24133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42636/0 (socket says 172.21.15.154:42636) 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c29190700 1 -- 172.21.15.154:0/2373937198 learned_addr learned my addr 172.21.15.154:0/2373937198 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c2898f700 1 --2- 172.21.15.154:0/2373937198 >> v2:172.21.15.154:3300/0 conn(0x7f1c24134210 0x7f1c240a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c2898f700 1 -- 172.21.15.154:0/2373937198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c24133900 msgr2=0x7f1c24133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c2898f700 1 --2- 172.21.15.154:0/2373937198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c24133900 0x7f1c24133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c2898f700 1 -- 172.21.15.154:0/2373937198 >> v1:172.21.15.154:6789/0 conn(0x7f1c240a0ee0 legacy=0x7f1c2413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c1bfff700 1 -- 172.21.15.154:0/2373937198 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276693085 0 0) 0x7f1c2409a760 con 0x7f1c240a0ee0 2023-09-30T22:25:41.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c2898f700 1 -- 172.21.15.154:0/2373937198 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240a23e0 con 0x7f1c24134210 2023-09-30T22:25:41.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c2898f700 1 --2- 172.21.15.154:0/2373937198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c24134210 0x7f1c240a09a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009840 tx=0x7f1c14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2eb6c665088dfe9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.147+0000 7f1c1bfff700 1 -- 172.21.15.154:0/2373937198 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14011830 con 0x7f1c24134210 2023-09-30T22:25:41.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c1bfff700 1 -- 172.21.15.154:0/2373937198 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14011990 con 0x7f1c24134210 2023-09-30T22:25:41.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c1bfff700 1 -- 172.21.15.154:0/2373937198 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14011d20 con 0x7f1c24134210 2023-09-30T22:25:41.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2373937198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c24134210 msgr2=0x7f1c240a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c2b3f4700 1 --2- 172.21.15.154:0/2373937198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c24134210 0x7f1c240a09a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009840 tx=0x7f1c14009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:41.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2373937198 shutdown_connections 2023-09-30T22:25:41.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c2b3f4700 1 --2- 172.21.15.154:0/2373937198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c24133900 0x7f1c24133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c2b3f4700 1 --2- 172.21.15.154:0/2373937198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c24134210 0x7f1c240a09a0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2373937198 >> 172.21.15.154:0/2373937198 conn(0x7f1c240a2980 msgr2=0x7f1c240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2373937198 shutdown_connections 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.148+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2373937198 wait complete. 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.149+0000 7f1c2b3f4700 1 Processor -- start 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.149+0000 7f1c2b3f4700 1 -- start start 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c2b3f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c240a0ee0 0x7f1c241235a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c2b3f4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c24133900 0x7f1c24123ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c2b3f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c24134210 0x7f1c24124020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c2b3f4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24127020 con 0x7f1c24133900 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c2b3f4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24126a80 con 0x7f1c24134210 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c2b3f4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241251b0 con 0x7f1c240a0ee0 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c29991700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c24134210 0x7f1c24124020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c29991700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c24134210 0x7f1c24124020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43864/0 (socket says 172.21.15.154:43864) 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c29991700 1 -- 172.21.15.154:0/2231396806 learned_addr learned my addr 172.21.15.154:0/2231396806 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c29190700 1 --2- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c240a0ee0 0x7f1c241235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.150+0000 7f1c29190700 1 -- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c24134210 msgr2=0x7f1c24124020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c29190700 1 --2- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c24134210 0x7f1c24124020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c29190700 1 -- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c24133900 msgr2=0x7f1c24123ae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c29190700 1 --2- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c24133900 0x7f1c24123ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c29190700 1 -- 172.21.15.154:0/2231396806 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140094a0 con 0x7f1c240a0ee0 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c29991700 1 --2- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c24134210 0x7f1c24124020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c29190700 1 --2- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c240a0ee0 0x7f1c241235a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000e840 tx=0x7f1c2000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c19ffb700 1 -- 172.21.15.154:0/2231396806 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20013680 con 0x7f1c240a0ee0 2023-09-30T22:25:41.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c19ffb700 1 -- 172.21.15.154:0/2231396806 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c200137e0 con 0x7f1c240a0ee0 2023-09-30T22:25:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2231396806 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24132a30 con 0x7f1c240a0ee0 2023-09-30T22:25:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c19ffb700 1 -- 172.21.15.154:0/2231396806 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20013b70 con 0x7f1c240a0ee0 2023-09-30T22:25:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.151+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2231396806 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c241277b0 con 0x7f1c240a0ee0 2023-09-30T22:25:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.152+0000 7f1c19ffb700 1 -- 172.21.15.154:0/2231396806 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c20013cd0 con 0x7f1c240a0ee0 2023-09-30T22:25:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.152+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2231396806 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2404f2a0 con 0x7f1c240a0ee0 2023-09-30T22:25:41.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.152+0000 7f1c19ffb700 1 -- 172.21.15.154:0/2231396806 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1c2003fa30 con 0x7f1c240a0ee0 2023-09-30T22:25:41.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.157+0000 7f1c19ffb700 1 -- 172.21.15.154:0/2231396806 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c2001abc0 con 0x7f1c240a0ee0 2023-09-30T22:25:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.175+0000 7fda4f119700 1 Processor -- start 2023-09-30T22:25:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.175+0000 7fda4f119700 1 -- start start 2023-09-30T22:25:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4f119700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fda48133900 0x7fda48133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4f119700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48134210 0x7fda480a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4f119700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda480a0ee0 0x7fda480a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4f119700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4809a760 con 0x7fda48133900 2023-09-30T22:25:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4f119700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda481336e0 con 0x7fda480a0ee0 2023-09-30T22:25:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4f119700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda4809a080 con 0x7fda48134210 2023-09-30T22:25:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4d6b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda480a0ee0 0x7fda480a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4d6b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda480a0ee0 0x7fda480a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43866/0 (socket says 172.21.15.154:43866) 2023-09-30T22:25:41.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4d6b6700 1 -- 172.21.15.154:0/1756740689 learned_addr learned my addr 172.21.15.154:0/1756740689 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4d6b6700 1 -- 172.21.15.154:0/1756740689 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48134210 msgr2=0x7fda480a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4d6b6700 1 --2- 172.21.15.154:0/1756740689 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48134210 0x7fda480a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4d6b6700 1 -- 172.21.15.154:0/1756740689 >> v2:172.21.15.154:3300/0 conn(0x7fda48133900 msgr2=0x7fda48133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4d6b6700 1 --2- 172.21.15.154:0/1756740689 >> v2:172.21.15.154:3300/0 conn(0x7fda48133900 0x7fda48133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.176+0000 7fda4d6b6700 1 -- 172.21.15.154:0/1756740689 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480a23e0 con 0x7fda480a0ee0 2023-09-30T22:25:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.177+0000 7fda4d6b6700 1 --2- 172.21.15.154:0/1756740689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda480a0ee0 0x7fda480a1340 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fda40009e50 tx=0x7fda4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13adc4741bc27b5e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.177+0000 7fda477fe700 1 -- 172.21.15.154:0/1756740689 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000e070 con 0x7fda480a0ee0 2023-09-30T22:25:41.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.177+0000 7fda477fe700 1 -- 172.21.15.154:0/1756740689 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4000b9c0 con 0x7fda480a0ee0 2023-09-30T22:25:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.177+0000 7fda477fe700 1 -- 172.21.15.154:0/1756740689 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000bd70 con 0x7fda480a0ee0 2023-09-30T22:25:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.178+0000 7fda4f119700 1 -- 172.21.15.154:0/1756740689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda480a0ee0 msgr2=0x7fda480a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.178+0000 7fda4f119700 1 --2- 172.21.15.154:0/1756740689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda480a0ee0 0x7fda480a1340 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fda40009e50 tx=0x7fda4000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.178+0000 7fda4f119700 1 -- 172.21.15.154:0/1756740689 shutdown_connections 2023-09-30T22:25:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.178+0000 7fda4f119700 1 --2- 172.21.15.154:0/1756740689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda480a0ee0 0x7fda480a1340 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.178+0000 7fda4f119700 1 --2- 172.21.15.154:0/1756740689 >> v2:172.21.15.154:3300/0 conn(0x7fda48133900 0x7fda48133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.178+0000 7fda4f119700 1 --2- 172.21.15.154:0/1756740689 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48134210 0x7fda480a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.178+0000 7fda4f119700 1 -- 172.21.15.154:0/1756740689 >> 172.21.15.154:0/1756740689 conn(0x7fda480a2980 msgr2=0x7fda480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.178+0000 7fda4f119700 1 -- 172.21.15.154:0/1756740689 shutdown_connections 2023-09-30T22:25:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.178+0000 7fda4f119700 1 -- 172.21.15.154:0/1756740689 wait complete. 2023-09-30T22:25:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.179+0000 7fda4f119700 1 Processor -- start 2023-09-30T22:25:41.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.179+0000 7fda4f119700 1 -- start start 2023-09-30T22:25:41.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.179+0000 7fda4f119700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda480a0ee0 0x7fda4811c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.179+0000 7fda4f119700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48133900 0x7fda4811cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.179+0000 7fda4f119700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda48134210 0x7fda4811d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.179+0000 7fda4f119700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda48120310 con 0x7fda480a0ee0 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.179+0000 7fda4f119700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4811e9e0 con 0x7fda48134210 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.179+0000 7fda4f119700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda4811faa0 con 0x7fda48133900 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda4d6b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda48134210 0x7fda4811d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda4d6b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda48134210 0x7fda4811d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43872/0 (socket says 172.21.15.154:43872) 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda4d6b6700 1 -- 172.21.15.154:0/3846868486 learned_addr learned my addr 172.21.15.154:0/3846868486 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda4ceb5700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda480a0ee0 0x7fda4811c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda47fff700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48133900 0x7fda4811cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda47fff700 1 -- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda48134210 msgr2=0x7fda4811d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda47fff700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda48134210 0x7fda4811d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda47fff700 1 -- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda480a0ee0 msgr2=0x7fda4811c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda47fff700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda480a0ee0 0x7fda4811c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda47fff700 1 -- 172.21.15.154:0/3846868486 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40009b30 con 0x7fda48133900 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda4ceb5700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda480a0ee0 0x7fda4811c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.180+0000 7fda47fff700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48133900 0x7fda4811cd80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fda3400b480 tx=0x7fda3400b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.181+0000 7fda457fa700 1 -- 172.21.15.154:0/3846868486 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34011830 con 0x7fda48133900 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.181+0000 7fda457fa700 1 -- 172.21.15.154:0/3846868486 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34011990 con 0x7fda48133900 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.181+0000 7fda457fa700 1 -- 172.21.15.154:0/3846868486 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34011d40 con 0x7fda48133900 2023-09-30T22:25:41.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.181+0000 7fda4f119700 1 -- 172.21.15.154:0/3846868486 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4809a2c0 con 0x7fda48133900 2023-09-30T22:25:41.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.181+0000 7fda4f119700 1 -- 172.21.15.154:0/3846868486 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4812fbe0 con 0x7fda48133900 2023-09-30T22:25:41.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.182+0000 7fda457fa700 1 -- 172.21.15.154:0/3846868486 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda3401a400 con 0x7fda48133900 2023-09-30T22:25:41.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.182+0000 7fda457fa700 1 -- 172.21.15.154:0/3846868486 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fda3403f4b0 con 0x7fda48133900 2023-09-30T22:25:41.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.182+0000 7fda4f119700 1 -- 172.21.15.154:0/3846868486 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4811feb0 con 0x7fda48133900 2023-09-30T22:25:41.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.190+0000 7fda457fa700 1 -- 172.21.15.154:0/3846868486 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda3401a6b0 con 0x7fda48133900 2023-09-30T22:25:41.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.232+0000 7f7532738700 1 Processor -- start 2023-09-30T22:25:41.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.232+0000 7f7532738700 1 -- start start 2023-09-30T22:25:41.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f7532738700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f752c09e870 0x7f752c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f7532738700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c09f180 0x7f752c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f7532738700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c09c970 con 0x7f752c131d70 2023-09-30T22:25:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f7532738700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0a0920 con 0x7f752c09e870 2023-09-30T22:25:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f7532738700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f752c09f9c0 con 0x7f752c09f180 2023-09-30T22:25:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c09f180 0x7f752c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f752c09e870 0x7f752c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c09f180 0x7f752c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42684/0 (socket says 172.21.15.154:42684) 2023-09-30T22:25:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752b7fe700 1 -- 172.21.15.154:0/2923606183 learned_addr learned my addr 172.21.15.154:0/2923606183 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752b7fe700 1 -- 172.21.15.154:0/2923606183 >> v2:172.21.15.154:3300/0 conn(0x7f752c09e870 msgr2=0x7f752c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:41.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752b7fe700 1 --2- 172.21.15.154:0/2923606183 >> v2:172.21.15.154:3300/0 conn(0x7f752c09e870 0x7f752c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752b7fe700 1 -- 172.21.15.154:0/2923606183 >> v1:172.21.15.154:6789/0 conn(0x7f752c131d70 legacy=0x7f752c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752b7fe700 1 -- 172.21.15.154:0/2923606183 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c09bab0 con 0x7f752c09f180 2023-09-30T22:25:41.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752bfff700 1 --2- 172.21.15.154:0/2923606183 >> v2:172.21.15.154:3300/0 conn(0x7f752c09e870 0x7f752c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.233+0000 7f752b7fe700 1 --2- 172.21.15.154:0/2923606183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c09f180 0x7f752c131830 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f75200098f0 tx=0x7f7520009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca79ea436a21a231 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.234+0000 7f752affd700 1 -- 172.21.15.154:0/2923606183 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520011830 con 0x7f752c09f180 2023-09-30T22:25:41.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.234+0000 7f752affd700 1 -- 172.21.15.154:0/2923606183 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520011990 con 0x7f752c09f180 2023-09-30T22:25:41.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.234+0000 7f752affd700 1 -- 172.21.15.154:0/2923606183 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520011d20 con 0x7f752c09f180 2023-09-30T22:25:41.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.234+0000 7f7532738700 1 -- 172.21.15.154:0/2923606183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c09f180 msgr2=0x7f752c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.234+0000 7f7532738700 1 --2- 172.21.15.154:0/2923606183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c09f180 0x7f752c131830 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f75200098f0 tx=0x7f7520009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:41.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.235+0000 7f7532738700 1 -- 172.21.15.154:0/2923606183 shutdown_connections 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.235+0000 7f7532738700 1 --2- 172.21.15.154:0/2923606183 >> v2:172.21.15.154:3300/0 conn(0x7f752c09e870 0x7f752c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.235+0000 7f7532738700 1 --2- 172.21.15.154:0/2923606183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c09f180 0x7f752c131830 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.235+0000 7f7532738700 1 -- 172.21.15.154:0/2923606183 >> 172.21.15.154:0/2923606183 conn(0x7f752c0a4430 msgr2=0x7f752c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.235+0000 7f7532738700 1 -- 172.21.15.154:0/2923606183 shutdown_connections 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.235+0000 7f7532738700 1 -- 172.21.15.154:0/2923606183 wait complete. 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.236+0000 7f7532738700 1 Processor -- start 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.236+0000 7f7532738700 1 -- start start 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f7532738700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752c09e870 0x7f752c12b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f7532738700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752c09f180 0x7f752c12b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f7532738700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c131d70 0x7f752c12bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f7532738700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c12cc60 con 0x7f752c09f180 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f7532738700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c12f220 con 0x7f752c09e870 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f7532738700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f752c12e2d0 con 0x7f752c131d70 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752c09e870 0x7f752c12b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752c09e870 0x7f752c12b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43880/0 (socket says 172.21.15.154:43880) 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752bfff700 1 -- 172.21.15.154:0/1605124756 learned_addr learned my addr 172.21.15.154:0/1605124756 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752b7fe700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752c09f180 0x7f752c12b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f7530cd5700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c131d70 0x7f752c12bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752b7fe700 1 -- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c131d70 msgr2=0x7f752c12bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752b7fe700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c131d70 0x7f752c12bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752b7fe700 1 -- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752c09e870 msgr2=0x7f752c12b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752b7fe700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752c09e870 0x7f752c12b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752b7fe700 1 -- 172.21.15.154:0/1605124756 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0094a0 con 0x7f752c09f180 2023-09-30T22:25:41.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.237+0000 7f752bfff700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752c09e870 0x7f752c12b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:41.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.238+0000 7f752b7fe700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752c09f180 0x7f752c12b5e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f752c09afc0 tx=0x7f7520004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.238+0000 7f7528ff9700 1 -- 172.21.15.154:0/1605124756 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520004400 con 0x7f752c09f180 2023-09-30T22:25:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.238+0000 7f7528ff9700 1 -- 172.21.15.154:0/1605124756 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752001f070 con 0x7f752c09f180 2023-09-30T22:25:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.238+0000 7f7532738700 1 -- 172.21.15.154:0/1605124756 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7520009550 con 0x7f752c09f180 2023-09-30T22:25:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.238+0000 7f7528ff9700 1 -- 172.21.15.154:0/1605124756 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75200038e0 con 0x7f752c09f180 2023-09-30T22:25:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.238+0000 7f7532738700 1 -- 172.21.15.154:0/1605124756 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c12e640 con 0x7f752c09f180 2023-09-30T22:25:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.239+0000 7f7528ff9700 1 -- 172.21.15.154:0/1605124756 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7520021030 con 0x7f752c09f180 2023-09-30T22:25:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.239+0000 7f7532738700 1 -- 172.21.15.154:0/1605124756 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c04f2a0 con 0x7f752c09f180 2023-09-30T22:25:41.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.239+0000 7f7528ff9700 1 -- 172.21.15.154:0/1605124756 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7520001d10 con 0x7f752c09f180 2023-09-30T22:25:41.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.248+0000 7f7528ff9700 1 -- 172.21.15.154:0/1605124756 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f752000b9d0 con 0x7f752c09f180 2023-09-30T22:25:41.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.319+0000 7f0698976700 1 -- 172.21.15.154:0/739382066 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f069404f2a0 con 0x7f069409e870 2023-09-30T22:25:41.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.320+0000 7f0682ffd700 1 -- 172.21.15.154:0/739382066 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0684003cf0 con 0x7f069409e870 2023-09-30T22:25:41.320 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.322+0000 7f0698976700 1 -- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 msgr2=0x7f0694132600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.322+0000 7f0698976700 1 --2- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f0694132600 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0684014040 tx=0x7f0684004750 comp rx=0 tx=0).stop 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.322+0000 7f0698976700 1 -- 172.21.15.154:0/739382066 shutdown_connections 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.322+0000 7f0698976700 1 --2- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0694131f40 0x7f0694133080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.322+0000 7f0698976700 1 --2- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f069409e870 0x7f0694132600 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.322+0000 7f0698976700 1 --2- 172.21.15.154:0/739382066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f069409f180 0x7f0694132b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.322+0000 7f0698976700 1 -- 172.21.15.154:0/739382066 >> 172.21.15.154:0/739382066 conn(0x7f06940a4430 msgr2=0x7f069406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.322+0000 7f0698976700 1 -- 172.21.15.154:0/739382066 shutdown_connections 2023-09-30T22:25:41.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.322+0000 7f0698976700 1 -- 172.21.15.154:0/739382066 wait complete. 2023-09-30T22:25:41.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:41.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.393+0000 7fda4f119700 1 -- 172.21.15.154:0/3846868486 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fda4804f2a0 con 0x7fda48133900 2023-09-30T22:25:41.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.394+0000 7fda457fa700 1 -- 172.21.15.154:0/3846868486 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda34029090 con 0x7fda48133900 2023-09-30T22:25:41.394 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:41.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.396+0000 7fda4f119700 1 -- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48133900 msgr2=0x7fda4811cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.396+0000 7fda4f119700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48133900 0x7fda4811cd80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fda3400b480 tx=0x7fda3400b790 comp rx=0 tx=0).stop 2023-09-30T22:25:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.396+0000 7fda4f119700 1 -- 172.21.15.154:0/3846868486 shutdown_connections 2023-09-30T22:25:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.396+0000 7fda4f119700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda48134210 0x7fda4811d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.396+0000 7fda4f119700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda480a0ee0 0x7fda4811c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.396+0000 7fda4f119700 1 --2- 172.21.15.154:0/3846868486 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda48133900 0x7fda4811cd80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.396+0000 7fda4f119700 1 -- 172.21.15.154:0/3846868486 >> 172.21.15.154:0/3846868486 conn(0x7fda480a2980 msgr2=0x7fda48130060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.396+0000 7fda4f119700 1 -- 172.21.15.154:0/3846868486 shutdown_connections 2023-09-30T22:25:41.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.396+0000 7fda4f119700 1 -- 172.21.15.154:0/3846868486 wait complete. 2023-09-30T22:25:41.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:41.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.426+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2231396806 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1c2406bce0 con 0x7f1c240a0ee0 2023-09-30T22:25:41.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.426+0000 7f1c19ffb700 1 -- 172.21.15.154:0/2231396806 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c20017070 con 0x7f1c240a0ee0 2023-09-30T22:25:41.426 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:41.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.428+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c240a0ee0 msgr2=0x7f1c241235a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.428+0000 7f1c2b3f4700 1 --2- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c240a0ee0 0x7f1c241235a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000e840 tx=0x7f1c2000eb50 comp rx=0 tx=0).stop 2023-09-30T22:25:41.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.428+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2231396806 shutdown_connections 2023-09-30T22:25:41.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.428+0000 7f1c2b3f4700 1 --2- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c24134210 0x7f1c24124020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.428+0000 7f1c2b3f4700 1 --2- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c240a0ee0 0x7f1c241235a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.428+0000 7f1c2b3f4700 1 --2- 172.21.15.154:0/2231396806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c24133900 0x7f1c24123ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.428+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2231396806 >> 172.21.15.154:0/2231396806 conn(0x7f1c240a2980 msgr2=0x7f1c2409de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.428+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2231396806 shutdown_connections 2023-09-30T22:25:41.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.429+0000 7f1c2b3f4700 1 -- 172.21.15.154:0/2231396806 wait complete. 2023-09-30T22:25:41.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:41.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.498+0000 7f7532738700 1 -- 172.21.15.154:0/1605124756 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f752c131b20 con 0x7f752c09f180 2023-09-30T22:25:41.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.498+0000 7f7528ff9700 1 -- 172.21.15.154:0/1605124756 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75200233d0 con 0x7f752c09f180 2023-09-30T22:25:41.498 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:41.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.500+0000 7f7532738700 1 -- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752c09f180 msgr2=0x7f752c12b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:41.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.500+0000 7f7532738700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752c09f180 0x7f752c12b5e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f752c09afc0 tx=0x7f7520004750 comp rx=0 tx=0).stop 2023-09-30T22:25:41.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.500+0000 7f7532738700 1 -- 172.21.15.154:0/1605124756 shutdown_connections 2023-09-30T22:25:41.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.500+0000 7f7532738700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f752c131d70 0x7f752c12bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.500+0000 7f7532738700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f752c09e870 0x7f752c12b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.500+0000 7f7532738700 1 --2- 172.21.15.154:0/1605124756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f752c09f180 0x7f752c12b5e0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:41.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.500+0000 7f7532738700 1 -- 172.21.15.154:0/1605124756 >> 172.21.15.154:0/1605124756 conn(0x7f752c0a4430 msgr2=0x7f752c0a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:41.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.500+0000 7f7532738700 1 -- 172.21.15.154:0/1605124756 shutdown_connections 2023-09-30T22:25:41.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:41.500+0000 7f7532738700 1 -- 172.21.15.154:0/1605124756 wait complete. 2023-09-30T22:25:41.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:42.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:42.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:42.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:42.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.462+0000 7febfad73700 1 Processor -- start 2023-09-30T22:25:42.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.462+0000 7febfad73700 1 -- start start 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febfad73700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf4138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febfad73700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febf4139270 0x7febf413b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febfad73700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf4133640 con 0x7febf4133a70 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febfad73700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf40a1d50 con 0x7febf4139270 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febfad73700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf4134550 con 0x7febf4136950 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf4138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf9310700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febf4139270 0x7febf413b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf4138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43890/0 (socket says 172.21.15.154:43890) 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf9310700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7febf4139270 0x7febf413b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36358/0 (socket says 172.21.15.154:36358) 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf3fff700 1 -- 172.21.15.154:0/2711845531 learned_addr learned my addr 172.21.15.154:0/2711845531 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf3fff700 1 -- 172.21.15.154:0/2711845531 >> v2:172.21.15.154:3300/0 conn(0x7febf4139270 msgr2=0x7febf413b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf3fff700 1 --2- 172.21.15.154:0/2711845531 >> v2:172.21.15.154:3300/0 conn(0x7febf4139270 0x7febf413b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf3fff700 1 -- 172.21.15.154:0/2711845531 >> v1:172.21.15.154:6789/0 conn(0x7febf4133a70 legacy=0x7febf4133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf3fff700 1 -- 172.21.15.154:0/2711845531 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf409b620 con 0x7febf4136950 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.463+0000 7febf9310700 1 --2- 172.21.15.154:0/2711845531 >> v2:172.21.15.154:3300/0 conn(0x7febf4139270 0x7febf413b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.464+0000 7febf3fff700 1 --2- 172.21.15.154:0/2711845531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf4138d30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7febe00098f0 tx=0x7febe0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a677b80061c5e7f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.464+0000 7febf37fe700 1 -- 172.21.15.154:0/2711845531 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0011830 con 0x7febf4136950 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.464+0000 7febf37fe700 1 -- 172.21.15.154:0/2711845531 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0011990 con 0x7febf4136950 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.464+0000 7febf37fe700 1 -- 172.21.15.154:0/2711845531 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0011d20 con 0x7febf4136950 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.464+0000 7febfad73700 1 -- 172.21.15.154:0/2711845531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 msgr2=0x7febf4138d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.464+0000 7febfad73700 1 --2- 172.21.15.154:0/2711845531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf4138d30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7febe00098f0 tx=0x7febe0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:42.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.465+0000 7febfad73700 1 -- 172.21.15.154:0/2711845531 shutdown_connections 2023-09-30T22:25:42.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.465+0000 7febfad73700 1 --2- 172.21.15.154:0/2711845531 >> v2:172.21.15.154:3300/0 conn(0x7febf4139270 0x7febf413b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.465+0000 7febfad73700 1 --2- 172.21.15.154:0/2711845531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf4138d30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.465+0000 7febfad73700 1 -- 172.21.15.154:0/2711845531 >> 172.21.15.154:0/2711845531 conn(0x7febf40a2980 msgr2=0x7febf40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.465+0000 7febfad73700 1 -- 172.21.15.154:0/2711845531 shutdown_connections 2023-09-30T22:25:42.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.465+0000 7febfad73700 1 -- 172.21.15.154:0/2711845531 wait complete. 2023-09-30T22:25:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.466+0000 7febfad73700 1 Processor -- start 2023-09-30T22:25:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.466+0000 7febfad73700 1 -- start start 2023-09-30T22:25:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.466+0000 7febfad73700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf4133a70 0x7febf41c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.466+0000 7febfad73700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf41c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.466+0000 7febfad73700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febf4139270 0x7febf4119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.466+0000 7febfad73700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf411b470 con 0x7febf4133a70 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.466+0000 7febfad73700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf409a350 con 0x7febf4136950 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.466+0000 7febfad73700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febf41be3f0 con 0x7febf4139270 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.466+0000 7febf8b0f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf4133a70 0x7febf41c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf41c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf8b0f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf4133a70 0x7febf41c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36360/0 (socket says 172.21.15.154:36360) 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf8b0f700 1 -- 172.21.15.154:0/1661878826 learned_addr learned my addr 172.21.15.154:0/1661878826 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf9310700 1 --2- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febf4139270 0x7febf4119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf3fff700 1 -- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febf4139270 msgr2=0x7febf4119fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf3fff700 1 --2- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febf4139270 0x7febf4119fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf3fff700 1 -- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf4133a70 msgr2=0x7febf41c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf3fff700 1 --2- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf4133a70 0x7febf41c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf3fff700 1 -- 172.21.15.154:0/1661878826 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec009a70 con 0x7febf4136950 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf8b0f700 1 --2- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf4133a70 0x7febf41c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf3fff700 1 --2- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf41c8d10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7febe0016000 tx=0x7febe0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf17fa700 1 -- 172.21.15.154:0/1661878826 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00045d0 con 0x7febf4136950 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf17fa700 1 -- 172.21.15.154:0/1661878826 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe00036a0 con 0x7febf4136950 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febf17fa700 1 -- 172.21.15.154:0/1661878826 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0003a10 con 0x7febf4136950 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.467+0000 7febfad73700 1 -- 172.21.15.154:0/1661878826 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe0009550 con 0x7febf4136950 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.468+0000 7febfad73700 1 -- 172.21.15.154:0/1661878826 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf41c9250 con 0x7febf4136950 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.468+0000 7febf17fa700 1 -- 172.21.15.154:0/1661878826 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febe0021070 con 0x7febf4136950 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.468+0000 7febf17fa700 1 -- 172.21.15.154:0/1661878826 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7febe0040ae0 con 0x7febf4136950 2023-09-30T22:25:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.469+0000 7febfad73700 1 -- 172.21.15.154:0/1661878826 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf404f2a0 con 0x7febf4136950 2023-09-30T22:25:42.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.478+0000 7febf17fa700 1 -- 172.21.15.154:0/1661878826 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febe0015080 con 0x7febf4136950 2023-09-30T22:25:42.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.546+0000 7f9ee209b700 1 Processor -- start 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.546+0000 7f9ee209b700 1 -- start start 2023-09-30T22:25:42.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.546+0000 7f9ee209b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 0x7f9edc131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.546+0000 7f9ee209b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09bc70 0x7f9edc09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.546+0000 7f9ee209b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0a1640 con 0x7f9edc09c5c0 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.546+0000 7f9ee209b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc06eb30 con 0x7f9edc131980 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.546+0000 7f9ee209b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0a22d0 con 0x7f9edc09bc70 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9edb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 0x7f9edc131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9edbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9edc09c5c0 0x7f9edc138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47448/0 (socket says 172.21.15.154:47448) 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9edbfff700 1 -- 172.21.15.154:0/3799744854 learned_addr learned my addr 172.21.15.154:0/3799744854 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9edaffd700 1 --2- 172.21.15.154:0/3799744854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09bc70 0x7f9edc09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9eda7fc700 1 -- 172.21.15.154:0/3799744854 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743716346 0 0) 0x7f9edc0a1640 con 0x7f9edc09c5c0 2023-09-30T22:25:42.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9eda7fc700 1 -- 172.21.15.154:0/3799744854 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec40035b0 con 0x7f9edc09c5c0 2023-09-30T22:25:42.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9edb7fe700 1 -- 172.21.15.154:0/3799744854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09bc70 msgr2=0x7f9edc09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9edb7fe700 1 --2- 172.21.15.154:0/3799744854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09bc70 0x7f9edc09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9edb7fe700 1 -- 172.21.15.154:0/3799744854 >> v1:172.21.15.154:6789/0 conn(0x7f9edc09c5c0 legacy=0x7f9edc138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9edb7fe700 1 -- 172.21.15.154:0/3799744854 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc131550 con 0x7f9edc131980 2023-09-30T22:25:42.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9edb7fe700 1 --2- 172.21.15.154:0/3799744854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 0x7f9edc131d50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009850 tx=0x7f9ecc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc0d002c02db5ecd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.547+0000 7f9eda7fc700 1 -- 172.21.15.154:0/3799744854 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc005e30 con 0x7f9edc131980 2023-09-30T22:25:42.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9eda7fc700 1 -- 172.21.15.154:0/3799744854 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc006030 con 0x7f9edc131980 2023-09-30T22:25:42.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9eda7fc700 1 -- 172.21.15.154:0/3799744854 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0063e0 con 0x7f9edc131980 2023-09-30T22:25:42.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9ee209b700 1 -- 172.21.15.154:0/3799744854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 msgr2=0x7f9edc131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9ee209b700 1 --2- 172.21.15.154:0/3799744854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 0x7f9edc131d50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009850 tx=0x7f9ecc009b60 comp rx=0 tx=0).stop 2023-09-30T22:25:42.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9ee209b700 1 -- 172.21.15.154:0/3799744854 shutdown_connections 2023-09-30T22:25:42.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9ee209b700 1 --2- 172.21.15.154:0/3799744854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 0x7f9edc131d50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9ee209b700 1 --2- 172.21.15.154:0/3799744854 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09bc70 0x7f9edc09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9ee209b700 1 -- 172.21.15.154:0/3799744854 >> 172.21.15.154:0/3799744854 conn(0x7f9edc0a2980 msgr2=0x7f9edc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9ee209b700 1 -- 172.21.15.154:0/3799744854 shutdown_connections 2023-09-30T22:25:42.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.548+0000 7f9ee209b700 1 -- 172.21.15.154:0/3799744854 wait complete. 2023-09-30T22:25:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.549+0000 7f9ee209b700 1 Processor -- start 2023-09-30T22:25:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9ee209b700 1 -- start start 2023-09-30T22:25:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9ee209b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc09bc70 0x7f9edc11b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9ee209b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09c5c0 0x7f9edc11bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9ee209b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 0x7f9edc11c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9ee209b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc11ee80 con 0x7f9edc09bc70 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9ee209b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc130920 con 0x7f9edc131980 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9ee209b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0a1c40 con 0x7f9edc09c5c0 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9edb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc09bc70 0x7f9edc11b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9edb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc09bc70 0x7f9edc11b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36368/0 (socket says 172.21.15.154:36368) 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9edb7fe700 1 -- 172.21.15.154:0/2907544567 learned_addr learned my addr 172.21.15.154:0/2907544567 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9edbfff700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 0x7f9edc11c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.550+0000 7f9edaffd700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09c5c0 0x7f9edc11bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9edb7fe700 1 -- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09c5c0 msgr2=0x7f9edc11bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9edb7fe700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09c5c0 0x7f9edc11bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9edb7fe700 1 -- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 msgr2=0x7f9edc11c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9edb7fe700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 0x7f9edc11c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9edb7fe700 1 -- 172.21.15.154:0/2907544567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc009430 con 0x7f9edc09bc70 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9edaffd700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09c5c0 0x7f9edc11bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9edb7fe700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc09bc70 0x7f9edc11b680 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009ba0 tx=0x7f9ecc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9ec3fff700 1 -- 172.21.15.154:0/2907544567 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc026070 con 0x7f9edc09bc70 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9ec3fff700 1 -- 172.21.15.154:0/2907544567 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc020df0 con 0x7f9edc09bc70 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9ec3fff700 1 -- 172.21.15.154:0/2907544567 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc006800 con 0x7f9edc09bc70 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9ee209b700 1 -- 172.21.15.154:0/2907544567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc11d360 con 0x7f9edc09bc70 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.551+0000 7f9ee209b700 1 -- 172.21.15.154:0/2907544567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc11f160 con 0x7f9edc09bc70 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.553+0000 7f9ec3fff700 1 -- 172.21.15.154:0/2907544567 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ecc004040 con 0x7f9edc09bc70 2023-09-30T22:25:42.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.553+0000 7f9ec3fff700 1 -- 172.21.15.154:0/2907544567 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9ecc0485e0 con 0x7f9edc09bc70 2023-09-30T22:25:42.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.554+0000 7f9ee209b700 1 -- 172.21.15.154:0/2907544567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc11efc0 con 0x7f9edc09bc70 2023-09-30T22:25:42.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.558+0000 7f9ec3fff700 1 -- 172.21.15.154:0/2907544567 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9edc11efc0 con 0x7f9edc09bc70 2023-09-30T22:25:42.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.585+0000 7f7ca2ca5700 1 Processor -- start 2023-09-30T22:25:42.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.585+0000 7f7ca2ca5700 1 -- start start 2023-09-30T22:25:42.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7ca2ca5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 0x7f7c9c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7ca2ca5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 0x7f7c9c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7ca2ca5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9c09dc00 con 0x7f7c9c133f50 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7ca2ca5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c09ea60 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7ca2ca5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c09dec0 con 0x7f7c9c0a1380 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7ca1242700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7c9c133f50 0x7f7c9c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47458/0 (socket says 172.21.15.154:47458) 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7ca1242700 1 -- 172.21.15.154:0/4148877362 learned_addr learned my addr 172.21.15.154:0/4148877362 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7c9bfff700 1 --2- 172.21.15.154:0/4148877362 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 0x7f7c9c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7ca0a41700 1 --2- 172.21.15.154:0/4148877362 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 0x7f7c9c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7c9b7fe700 1 -- 172.21.15.154:0/4148877362 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204570059 0 0) 0x7f7c9c09dc00 con 0x7f7c9c133f50 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7c9b7fe700 1 -- 172.21.15.154:0/4148877362 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c8c0035b0 con 0x7f7c9c133f50 2023-09-30T22:25:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7c9bfff700 1 -- 172.21.15.154:0/4148877362 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 msgr2=0x7f7c9c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7c9bfff700 1 --2- 172.21.15.154:0/4148877362 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 0x7f7c9c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7c9bfff700 1 -- 172.21.15.154:0/4148877362 >> v1:172.21.15.154:6789/0 conn(0x7f7c9c133f50 legacy=0x7f7c9c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.586+0000 7f7c9bfff700 1 -- 172.21.15.154:0/4148877362 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c09e6a0 con 0x7f7c9c0a1380 2023-09-30T22:25:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.587+0000 7f7c9bfff700 1 --2- 172.21.15.154:0/4148877362 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 0x7f7c9c133a10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009870 tx=0x7f7c88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e872353ea2462022 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.587+0000 7f7c9b7fe700 1 -- 172.21.15.154:0/4148877362 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88011830 con 0x7f7c9c0a1380 2023-09-30T22:25:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.587+0000 7f7c9b7fe700 1 -- 172.21.15.154:0/4148877362 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88011990 con 0x7f7c9c0a1380 2023-09-30T22:25:42.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.587+0000 7f7c9b7fe700 1 -- 172.21.15.154:0/4148877362 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88011d00 con 0x7f7c9c0a1380 2023-09-30T22:25:42.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.587+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/4148877362 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 msgr2=0x7f7c9c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.587+0000 7f7ca2ca5700 1 --2- 172.21.15.154:0/4148877362 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 0x7f7c9c133a10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009870 tx=0x7f7c88009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:42.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.588+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/4148877362 shutdown_connections 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.588+0000 7f7ca2ca5700 1 --2- 172.21.15.154:0/4148877362 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 0x7f7c9c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.588+0000 7f7ca2ca5700 1 --2- 172.21.15.154:0/4148877362 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 0x7f7c9c133a10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.588+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/4148877362 >> 172.21.15.154:0/4148877362 conn(0x7f7c9c0a6610 msgr2=0x7f7c9c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.588+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/4148877362 shutdown_connections 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.588+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/4148877362 wait complete. 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.588+0000 7f7ca2ca5700 1 Processor -- start 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca2ca5700 1 -- start start 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca2ca5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 0x7f7c9c1c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca2ca5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 0x7f7c9c1c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca2ca5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c133f50 0x7f7c9c1c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca2ca5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c1248b0 con 0x7f7c9c133f50 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca2ca5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c133aa0 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca2ca5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c125ff0 con 0x7f7c9c0a1380 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca1242700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c133f50 0x7f7c9c1c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca0a41700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 0x7f7c9c1c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca1242700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c133f50 0x7f7c9c1c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36382/0 (socket says 172.21.15.154:36382) 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7ca1242700 1 -- 172.21.15.154:0/3547050784 learned_addr learned my addr 172.21.15.154:0/3547050784 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.589+0000 7f7c9bfff700 1 --2- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 0x7f7c9c1c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7ca0a41700 1 -- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 msgr2=0x7f7c9c1c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7ca0a41700 1 --2- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 0x7f7c9c1c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7ca0a41700 1 -- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c133f50 msgr2=0x7f7c9c1c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7ca0a41700 1 --2- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c133f50 0x7f7c9c1c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7ca0a41700 1 -- 172.21.15.154:0/3547050784 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c880094a0 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7ca0a41700 1 --2- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 0x7f7c9c1c82d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000e930 tx=0x7f7c9000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7c997fa700 1 -- 172.21.15.154:0/3547050784 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90013680 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7c997fa700 1 -- 172.21.15.154:0/3547050784 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900137e0 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/3547050784 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c0a0440 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7c997fa700 1 -- 172.21.15.154:0/3547050784 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90013b50 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.590+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/3547050784 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c1252f0 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.591+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/3547050784 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c04f2a0 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.592+0000 7f7c997fa700 1 -- 172.21.15.154:0/3547050784 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c90013cb0 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.592+0000 7f7c997fa700 1 -- 172.21.15.154:0/3547050784 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c9003f770 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.596+0000 7f7c997fa700 1 -- 172.21.15.154:0/3547050784 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c9001bc30 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.688+0000 7f61270cd700 1 Processor -- start 2023-09-30T22:25:42.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.688+0000 7f61270cd700 1 -- start start 2023-09-30T22:25:42.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f61270cd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61200a0a30 0x7f61200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f61270cd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6120130670 0x7f61201381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f61270cd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61200a1e70 con 0x7f61200a1340 2023-09-30T22:25:42.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f61270cd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612009a720 con 0x7f61200a0a30 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f61270cd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f612009b300 con 0x7f6120130670 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f6124e69700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61200a0a30 0x7f61200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f6124e69700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61200a0a30 0x7f61200a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36398/0 (socket says 172.21.15.154:36398) 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f6124e69700 1 -- 172.21.15.154:0/4041857 learned_addr learned my addr 172.21.15.154:0/4041857 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f611ffff700 1 --1- 172.21.15.154:0/4041857 >> v1:172.21.15.154:6789/0 conn(0x7f61200a1340 0x7f612012ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47472/0 (socket says 172.21.15.154:47472) 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f612566a700 1 --2- 172.21.15.154:0/4041857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6120130670 0x7f61201381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f6124e69700 1 -- 172.21.15.154:0/4041857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6120130670 msgr2=0x7f61201381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f6124e69700 1 --2- 172.21.15.154:0/4041857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6120130670 0x7f61201381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f6124e69700 1 -- 172.21.15.154:0/4041857 >> v1:172.21.15.154:6789/0 conn(0x7f61200a1340 legacy=0x7f612012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.689+0000 7f6124e69700 1 -- 172.21.15.154:0/4041857 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612009abc0 con 0x7f61200a0a30 2023-09-30T22:25:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.690+0000 7f6124e69700 1 --2- 172.21.15.154:0/4041857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61200a0a30 0x7f61200a0e00 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fd0 tx=0x7f6114009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95f2ef84a908f43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.690+0000 7f611f7fe700 1 -- 172.21.15.154:0/4041857 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114005e30 con 0x7f61200a0a30 2023-09-30T22:25:42.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.690+0000 7f611f7fe700 1 -- 172.21.15.154:0/4041857 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114004030 con 0x7f61200a0a30 2023-09-30T22:25:42.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.690+0000 7f611f7fe700 1 -- 172.21.15.154:0/4041857 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61140043e0 con 0x7f61200a0a30 2023-09-30T22:25:42.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.690+0000 7f61270cd700 1 -- 172.21.15.154:0/4041857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61200a0a30 msgr2=0x7f61200a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.690+0000 7f61270cd700 1 --2- 172.21.15.154:0/4041857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61200a0a30 0x7f61200a0e00 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fd0 tx=0x7f6114009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.691+0000 7f61270cd700 1 -- 172.21.15.154:0/4041857 shutdown_connections 2023-09-30T22:25:42.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.691+0000 7f61270cd700 1 --2- 172.21.15.154:0/4041857 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6120130670 0x7f61201381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.691+0000 7f61270cd700 1 --2- 172.21.15.154:0/4041857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61200a0a30 0x7f61200a0e00 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.691+0000 7f61270cd700 1 -- 172.21.15.154:0/4041857 >> 172.21.15.154:0/4041857 conn(0x7f61200a2980 msgr2=0x7f61200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.691+0000 7f61270cd700 1 -- 172.21.15.154:0/4041857 shutdown_connections 2023-09-30T22:25:42.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.691+0000 7f61270cd700 1 -- 172.21.15.154:0/4041857 wait complete. 2023-09-30T22:25:42.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.691+0000 7febfad73700 1 -- 172.21.15.154:0/1661878826 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7febf406bce0 con 0x7febf4136950 2023-09-30T22:25:42.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.692+0000 7f61270cd700 1 Processor -- start 2023-09-30T22:25:42.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.692+0000 7febf17fa700 1 -- 172.21.15.154:0/1661878826 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febe0029020 con 0x7febf4136950 2023-09-30T22:25:42.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.692+0000 7f61270cd700 1 -- start start 2023-09-30T22:25:42.694 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:42.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f61270cd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61200a0a30 0x7f6120119f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f61270cd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61200a1340 0x7f612011a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f61270cd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6120130670 0x7f612011a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f61270cd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612011bab0 con 0x7f6120130670 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f61270cd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612011dac0 con 0x7f61200a1340 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f61270cd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f612009ae00 con 0x7f61200a0a30 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f6124e69700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61200a0a30 0x7f6120119f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f6124e69700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61200a0a30 0x7f6120119f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42762/0 (socket says 172.21.15.154:42762) 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f6124e69700 1 -- 172.21.15.154:0/224837309 learned_addr learned my addr 172.21.15.154:0/224837309 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.693+0000 7f611ffff700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61200a1340 0x7f612011a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f6124e69700 1 -- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61200a1340 msgr2=0x7f612011a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f6124e69700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61200a1340 0x7f612011a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f612566a700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6120130670 0x7f612011a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:42.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f6124e69700 1 -- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6120130670 msgr2=0x7f612011a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f6124e69700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6120130670 0x7f612011a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f6124e69700 1 -- 172.21.15.154:0/224837309 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6114009500 con 0x7f61200a0a30 2023-09-30T22:25:42.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f612566a700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6120130670 0x7f612011a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:42.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f6124e69700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61200a0a30 0x7f6120119f40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6114009c10 tx=0x7f6114004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:42.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f611d7fa700 1 -- 172.21.15.154:0/224837309 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114003ce0 con 0x7f61200a0a30 2023-09-30T22:25:42.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f611d7fa700 1 -- 172.21.15.154:0/224837309 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114006b70 con 0x7f61200a0a30 2023-09-30T22:25:42.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f611d7fa700 1 -- 172.21.15.154:0/224837309 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611401c660 con 0x7f61200a0a30 2023-09-30T22:25:42.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f61270cd700 1 -- 172.21.15.154:0/224837309 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612011d420 con 0x7f61200a0a30 2023-09-30T22:25:42.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.694+0000 7f61270cd700 1 -- 172.21.15.154:0/224837309 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612011e150 con 0x7f61200a0a30 2023-09-30T22:25:42.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.695+0000 7febfad73700 1 -- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 msgr2=0x7febf41c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.695+0000 7febfad73700 1 --2- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf41c8d10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7febe0016000 tx=0x7febe0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:42.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.696+0000 7f610affd700 1 -- 172.21.15.154:0/224837309 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f80052e0 con 0x7f61200a0a30 2023-09-30T22:25:42.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.696+0000 7f611d7fa700 1 -- 172.21.15.154:0/224837309 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f611401c7c0 con 0x7f61200a0a30 2023-09-30T22:25:42.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.696+0000 7f611d7fa700 1 -- 172.21.15.154:0/224837309 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6114040820 con 0x7f61200a0a30 2023-09-30T22:25:42.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.697+0000 7febfad73700 1 -- 172.21.15.154:0/1661878826 shutdown_connections 2023-09-30T22:25:42.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.697+0000 7febfad73700 1 --2- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febf4139270 0x7febf4119fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.697+0000 7febfad73700 1 --2- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febf4133a70 0x7febf41c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.697+0000 7febfad73700 1 --2- 172.21.15.154:0/1661878826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febf4136950 0x7febf41c8d10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.697+0000 7febfad73700 1 -- 172.21.15.154:0/1661878826 >> 172.21.15.154:0/1661878826 conn(0x7febf40a2980 msgr2=0x7febf4131b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.697+0000 7febfad73700 1 -- 172.21.15.154:0/1661878826 shutdown_connections 2023-09-30T22:25:42.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.697+0000 7febfad73700 1 -- 172.21.15.154:0/1661878826 wait complete. 2023-09-30T22:25:42.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.701+0000 7f611d7fa700 1 -- 172.21.15.154:0/224837309 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6114011420 con 0x7f61200a0a30 2023-09-30T22:25:42.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:42.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.789+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/3547050784 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c9c0a5e30 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.790+0000 7f7c997fa700 1 -- 172.21.15.154:0/3547050784 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c90017020 con 0x7f7c9c0a0a70 2023-09-30T22:25:42.790 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:42.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.792+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 msgr2=0x7f7c9c1c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.792+0000 7f7ca2ca5700 1 --2- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 0x7f7c9c1c82d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000e930 tx=0x7f7c9000ec40 comp rx=0 tx=0).stop 2023-09-30T22:25:42.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.792+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/3547050784 shutdown_connections 2023-09-30T22:25:42.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.792+0000 7f7ca2ca5700 1 --2- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c133f50 0x7f7c9c1c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.792+0000 7f7ca2ca5700 1 --2- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9c0a0a70 0x7f7c9c1c82d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.792+0000 7f7ca2ca5700 1 --2- 172.21.15.154:0/3547050784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c9c0a1380 0x7f7c9c1c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.792+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/3547050784 >> 172.21.15.154:0/3547050784 conn(0x7f7c9c0a6610 msgr2=0x7f7c9c0a4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.792+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/3547050784 shutdown_connections 2023-09-30T22:25:42.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.792+0000 7f7ca2ca5700 1 -- 172.21.15.154:0/3547050784 wait complete. 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.797+0000 7f9ee209b700 1 -- 172.21.15.154:0/2907544567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9edc11efc0 con 0x7f9edc09bc70 2023-09-30T22:25:42.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.798+0000 7f9ec3fff700 1 -- 172.21.15.154:0/2907544567 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9edc11efc0 con 0x7f9edc09bc70 2023-09-30T22:25:42.798 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.800+0000 7f9ee209b700 1 -- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc09bc70 msgr2=0x7f9edc11b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.800+0000 7f9ee209b700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc09bc70 0x7f9edc11b680 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009ba0 tx=0x7f9ecc004750 comp rx=0 tx=0).stop 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.800+0000 7f9ee209b700 1 -- 172.21.15.154:0/2907544567 shutdown_connections 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.800+0000 7f9ee209b700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9edc131980 0x7f9edc11c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.800+0000 7f9ee209b700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc09bc70 0x7f9edc11b680 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.800+0000 7f9ee209b700 1 --2- 172.21.15.154:0/2907544567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9edc09c5c0 0x7f9edc11bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.800+0000 7f9ee209b700 1 -- 172.21.15.154:0/2907544567 >> 172.21.15.154:0/2907544567 conn(0x7f9edc0a2980 msgr2=0x7f9edc1b8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.800+0000 7f9ee209b700 1 -- 172.21.15.154:0/2907544567 shutdown_connections 2023-09-30T22:25:42.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.800+0000 7f9ee209b700 1 -- 172.21.15.154:0/2907544567 wait complete. 2023-09-30T22:25:42.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:42.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:42.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.893+0000 7f610affd700 1 -- 172.21.15.154:0/224837309 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f60f8005590 con 0x7f61200a0a30 2023-09-30T22:25:42.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.894+0000 7f611d7fa700 1 -- 172.21.15.154:0/224837309 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6114016030 con 0x7f61200a0a30 2023-09-30T22:25:42.894 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:42.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.896+0000 7f610affd700 1 -- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61200a0a30 msgr2=0x7f6120119f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:42.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.896+0000 7f610affd700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61200a0a30 0x7f6120119f40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6114009c10 tx=0x7f6114004750 comp rx=0 tx=0).stop 2023-09-30T22:25:42.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.896+0000 7f610affd700 1 -- 172.21.15.154:0/224837309 shutdown_connections 2023-09-30T22:25:42.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.896+0000 7f610affd700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6120130670 0x7f612011a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.896+0000 7f610affd700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61200a0a30 0x7f6120119f40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.896+0000 7f610affd700 1 --2- 172.21.15.154:0/224837309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61200a1340 0x7f612011a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:42.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.896+0000 7f610affd700 1 -- 172.21.15.154:0/224837309 >> 172.21.15.154:0/224837309 conn(0x7f61200a2980 msgr2=0x7f612009deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:42.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.896+0000 7f610affd700 1 -- 172.21.15.154:0/224837309 shutdown_connections 2023-09-30T22:25:42.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:42.896+0000 7f610affd700 1 -- 172.21.15.154:0/224837309 wait complete. 2023-09-30T22:25:42.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:43.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:43.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:43.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e85e8d700 1 Processor -- start 2023-09-30T22:25:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e85e8d700 1 -- start start 2023-09-30T22:25:43.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e85e8d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 0x7f4e80133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e85e8d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e800a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e85e8d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e800a0e20 0x7f4e800a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e85e8d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8009aa00 con 0x7f4e800a0e20 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e85e8d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8009a080 con 0x7f4e80099a60 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e85e8d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80133750 con 0x7f4e80133b80 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e7effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e800a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e7f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 0x7f4e80133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e7effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e800a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43958/0 (socket says 172.21.15.154:43958) 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e7effd700 1 -- 172.21.15.154:0/3953497401 learned_addr learned my addr 172.21.15.154:0/3953497401 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:43.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.840+0000 7f4e7ffff700 1 --2- 172.21.15.154:0/3953497401 >> v2:172.21.15.154:3300/0 conn(0x7f4e800a0e20 0x7f4e800a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7effd700 1 -- 172.21.15.154:0/3953497401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 msgr2=0x7f4e80133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7effd700 1 --2- 172.21.15.154:0/3953497401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 0x7f4e80133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7effd700 1 -- 172.21.15.154:0/3953497401 >> v2:172.21.15.154:3300/0 conn(0x7f4e800a0e20 msgr2=0x7f4e800a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7effd700 1 --2- 172.21.15.154:0/3953497401 >> v2:172.21.15.154:3300/0 conn(0x7f4e800a0e20 0x7f4e800a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7effd700 1 -- 172.21.15.154:0/3953497401 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8009a760 con 0x7f4e80099a60 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7f7fe700 1 --2- 172.21.15.154:0/3953497401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 0x7f4e80133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7ffff700 1 --2- 172.21.15.154:0/3953497401 >> v2:172.21.15.154:3300/0 conn(0x7f4e800a0e20 0x7f4e800a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7effd700 1 --2- 172.21.15.154:0/3953497401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e800a08e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4e740098f0 tx=0x7f4e74009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e86a9cbebd0a8b1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7e7fc700 1 -- 172.21.15.154:0/3953497401 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74011830 con 0x7f4e80099a60 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7e7fc700 1 -- 172.21.15.154:0/3953497401 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74011990 con 0x7f4e80099a60 2023-09-30T22:25:43.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.841+0000 7f4e7e7fc700 1 -- 172.21.15.154:0/3953497401 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74011d20 con 0x7f4e80099a60 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.842+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3953497401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 msgr2=0x7f4e800a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.842+0000 7f4e85e8d700 1 --2- 172.21.15.154:0/3953497401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e800a08e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4e740098f0 tx=0x7f4e74009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.842+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3953497401 shutdown_connections 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.842+0000 7f4e85e8d700 1 --2- 172.21.15.154:0/3953497401 >> v2:172.21.15.154:3300/0 conn(0x7f4e800a0e20 0x7f4e800a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.842+0000 7f4e85e8d700 1 --2- 172.21.15.154:0/3953497401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 0x7f4e80133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.842+0000 7f4e85e8d700 1 --2- 172.21.15.154:0/3953497401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e800a08e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.842+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3953497401 >> 172.21.15.154:0/3953497401 conn(0x7f4e800a2980 msgr2=0x7f4e800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.842+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3953497401 shutdown_connections 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.842+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3953497401 wait complete. 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e85e8d700 1 Processor -- start 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e85e8d700 1 -- start start 2023-09-30T22:25:43.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e85e8d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e8011d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e85e8d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e800a0e20 0x7f4e8011df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e85e8d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 0x7f4e8011e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e85e8d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80130d30 con 0x7f4e800a0e20 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e85e8d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e801207a0 con 0x7f4e80099a60 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e85e8d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80121180 con 0x7f4e80133b80 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e7f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e8011d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e7f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e8011d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43974/0 (socket says 172.21.15.154:43974) 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e7f7fe700 1 -- 172.21.15.154:0/3688497122 learned_addr learned my addr 172.21.15.154:0/3688497122 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.843+0000 7f4e7effd700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e800a0e20 0x7f4e8011df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e7ffff700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 0x7f4e8011e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e7f7fe700 1 -- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 msgr2=0x7f4e8011e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e7f7fe700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 0x7f4e8011e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e7f7fe700 1 -- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e800a0e20 msgr2=0x7f4e8011df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e7f7fe700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e800a0e20 0x7f4e8011df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e7f7fe700 1 -- 172.21.15.154:0/3688497122 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78009a70 con 0x7f4e80099a60 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e7effd700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e800a0e20 0x7f4e8011df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e7f7fe700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e8011d9d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000ebe0 tx=0x7f4e7000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e67fff700 1 -- 172.21.15.154:0/3688497122 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70005a20 con 0x7f4e80099a60 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e67fff700 1 -- 172.21.15.154:0/3688497122 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e70005b80 con 0x7f4e80099a60 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3688497122 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e70009430 con 0x7f4e80099a60 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e67fff700 1 -- 172.21.15.154:0/3688497122 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000c850 con 0x7f4e80099a60 2023-09-30T22:25:43.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.844+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3688497122 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e74009550 con 0x7f4e80099a60 2023-09-30T22:25:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.845+0000 7f4e67fff700 1 -- 172.21.15.154:0/3688497122 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e7000c9b0 con 0x7f4e80099a60 2023-09-30T22:25:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.845+0000 7f4e67fff700 1 -- 172.21.15.154:0/3688497122 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e7003f8f0 con 0x7f4e80099a60 2023-09-30T22:25:43.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.846+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3688497122 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8011a590 con 0x7f4e80099a60 2023-09-30T22:25:43.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.850+0000 7f4e67fff700 1 -- 172.21.15.154:0/3688497122 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e70020080 con 0x7f4e80099a60 2023-09-30T22:25:43.908 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:43.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.937+0000 7f7e6e639700 1 Processor -- start 2023-09-30T22:25:43.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.937+0000 7f7e6e639700 1 -- start start 2023-09-30T22:25:43.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.937+0000 7f7e6e639700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e681368e0 0x7f7e68138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.937+0000 7f7e6e639700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e68139200 0x7f7e6813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.937+0000 7f7e6e639700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6809a760 con 0x7f7e68133900 2023-09-30T22:25:43.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.937+0000 7f7e6e639700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681336e0 con 0x7f7e68139200 2023-09-30T22:25:43.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.937+0000 7f7e6e639700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6809a080 con 0x7f7e681368e0 2023-09-30T22:25:43.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e6cbd6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e68139200 0x7f7e6813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e6cbd6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e68139200 0x7f7e6813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:43978/0 (socket says 172.21.15.154:43978) 2023-09-30T22:25:43.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e6cbd6700 1 -- 172.21.15.154:0/2853790958 learned_addr learned my addr 172.21.15.154:0/2853790958 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:43.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e6cbd6700 1 -- 172.21.15.154:0/2853790958 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e681368e0 msgr2=0x7f7e68138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:43.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e6cbd6700 1 --2- 172.21.15.154:0/2853790958 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e681368e0 0x7f7e68138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e6cbd6700 1 -- 172.21.15.154:0/2853790958 >> v1:172.21.15.154:6789/0 conn(0x7f7e68133900 legacy=0x7f7e68133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:43.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e6cbd6700 1 -- 172.21.15.154:0/2853790958 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680a23e0 con 0x7f7e68139200 2023-09-30T22:25:43.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e6cbd6700 1 --2- 172.21.15.154:0/2853790958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e68139200 0x7f7e6813b5e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009e80 tx=0x7f7e6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c8c933e30018ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e66ffd700 1 -- 172.21.15.154:0/2853790958 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000e070 con 0x7f7e68139200 2023-09-30T22:25:43.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e66ffd700 1 -- 172.21.15.154:0/2853790958 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60003a20 con 0x7f7e68139200 2023-09-30T22:25:43.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.938+0000 7f7e66ffd700 1 -- 172.21.15.154:0/2853790958 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60003db0 con 0x7f7e68139200 2023-09-30T22:25:43.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.939+0000 7f7e6e639700 1 -- 172.21.15.154:0/2853790958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e68139200 msgr2=0x7f7e6813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.939+0000 7f7e6e639700 1 --2- 172.21.15.154:0/2853790958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e68139200 0x7f7e6813b5e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7e60009e80 tx=0x7f7e6000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:43.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.939+0000 7f7e6e639700 1 -- 172.21.15.154:0/2853790958 shutdown_connections 2023-09-30T22:25:43.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.939+0000 7f7e6e639700 1 --2- 172.21.15.154:0/2853790958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e68139200 0x7f7e6813b5e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.939+0000 7f7e6e639700 1 --2- 172.21.15.154:0/2853790958 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e681368e0 0x7f7e68138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.939+0000 7f7e6e639700 1 -- 172.21.15.154:0/2853790958 >> 172.21.15.154:0/2853790958 conn(0x7f7e680a2980 msgr2=0x7f7e680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.940+0000 7f7e6e639700 1 -- 172.21.15.154:0/2853790958 shutdown_connections 2023-09-30T22:25:43.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.940+0000 7f7e6e639700 1 -- 172.21.15.154:0/2853790958 wait complete. 2023-09-30T22:25:43.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.941+0000 7f7e6e639700 1 Processor -- start 2023-09-30T22:25:43.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.941+0000 7f7e6e639700 1 -- start start 2023-09-30T22:25:43.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.941+0000 7f7e6e639700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e68133900 0x7f7e681c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.941+0000 7f7e6e639700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e681368e0 0x7f7e681c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.941+0000 7f7e6e639700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e68139200 0x7f7e68119090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.941+0000 7f7e6e639700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6811caa0 con 0x7f7e68133900 2023-09-30T22:25:43.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.941+0000 7f7e6e639700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6812ea50 con 0x7f7e681368e0 2023-09-30T22:25:43.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.941+0000 7f7e6e639700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6809a2c0 con 0x7f7e68139200 2023-09-30T22:25:43.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e68133900 0x7f7e681c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e67fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e68133900 0x7f7e681c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36422/0 (socket says 172.21.15.154:36422) 2023-09-30T22:25:43.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e67fff700 1 -- 172.21.15.154:0/16375168 learned_addr learned my addr 172.21.15.154:0/16375168 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:43.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e6cbd6700 1 --2- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e68139200 0x7f7e68119090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e67fff700 1 -- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e68139200 msgr2=0x7f7e68119090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e67fff700 1 --2- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e68139200 0x7f7e68119090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e67fff700 1 -- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e681368e0 msgr2=0x7f7e681c8bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e67fff700 1 --2- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e681368e0 0x7f7e681c8bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e67fff700 1 -- 172.21.15.154:0/16375168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009b30 con 0x7f7e68133900 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e67fff700 1 --2- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e68133900 0x7f7e681c86b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f7e5800c550 tx=0x7f7e5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e64ff9700 1 -- 172.21.15.154:0/16375168 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580054e0 con 0x7f7e68133900 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e64ff9700 1 -- 172.21.15.154:0/16375168 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e58003680 con 0x7f7e68133900 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e6e639700 1 -- 172.21.15.154:0/16375168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e68134bf0 con 0x7f7e68133900 2023-09-30T22:25:43.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e64ff9700 1 -- 172.21.15.154:0/16375168 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58003a30 con 0x7f7e68133900 2023-09-30T22:25:43.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.942+0000 7f7e6e639700 1 -- 172.21.15.154:0/16375168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e681be440 con 0x7f7e68133900 2023-09-30T22:25:43.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.944+0000 7f7e6e639700 1 -- 172.21.15.154:0/16375168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6804f2a0 con 0x7f7e68133900 2023-09-30T22:25:43.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.944+0000 7f7e64ff9700 1 -- 172.21.15.154:0/16375168 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e58003b90 con 0x7f7e68133900 2023-09-30T22:25:43.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.946+0000 7f7e64ff9700 1 -- 172.21.15.154:0/16375168 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e58010b90 con 0x7f7e68133900 2023-09-30T22:25:43.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.948+0000 7f7e64ff9700 1 -- 172.21.15.154:0/16375168 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e58044060 con 0x7f7e68133900 2023-09-30T22:25:43.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f3500607700 1 Processor -- start 2023-09-30T22:25:43.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f3500607700 1 -- start start 2023-09-30T22:25:43.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f3500607700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8133900 0x7f34f8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f3500607700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8134210 0x7f34f80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f3500607700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f809a760 con 0x7f34f80a0ee0 2023-09-30T22:25:43.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f3500607700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f81336e0 con 0x7f34f8133900 2023-09-30T22:25:43.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f3500607700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f809a080 con 0x7f34f8134210 2023-09-30T22:25:43.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f34feba4700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f34f80a0ee0 0x7f34f813a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47500/0 (socket says 172.21.15.154:47500) 2023-09-30T22:25:43.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f34fdba2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8134210 0x7f34f80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.972+0000 7f34feba4700 1 -- 172.21.15.154:0/1509779586 learned_addr learned my addr 172.21.15.154:0/1509779586 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:43.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.973+0000 7f34fe3a3700 1 --2- 172.21.15.154:0/1509779586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8133900 0x7f34f8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.973+0000 7f34fdba2700 1 -- 172.21.15.154:0/1509779586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8133900 msgr2=0x7f34f8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:43.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.973+0000 7f34fdba2700 1 --2- 172.21.15.154:0/1509779586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8133900 0x7f34f8133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.973+0000 7f34fdba2700 1 -- 172.21.15.154:0/1509779586 >> v1:172.21.15.154:6789/0 conn(0x7f34f80a0ee0 legacy=0x7f34f813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.973+0000 7f34fdba2700 1 -- 172.21.15.154:0/1509779586 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80a23e0 con 0x7f34f8134210 2023-09-30T22:25:43.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.973+0000 7f34fdba2700 1 --2- 172.21.15.154:0/1509779586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8134210 0x7f34f80a09a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009870 tx=0x7f34e8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced392608d131609 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.973+0000 7f34fd3a1700 1 -- 172.21.15.154:0/1509779586 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8011830 con 0x7f34f8134210 2023-09-30T22:25:43.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.973+0000 7f34fd3a1700 1 -- 172.21.15.154:0/1509779586 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e8011990 con 0x7f34f8134210 2023-09-30T22:25:43.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.973+0000 7f34fd3a1700 1 -- 172.21.15.154:0/1509779586 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8011d20 con 0x7f34f8134210 2023-09-30T22:25:43.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.974+0000 7f3500607700 1 -- 172.21.15.154:0/1509779586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8134210 msgr2=0x7f34f80a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.974+0000 7f3500607700 1 --2- 172.21.15.154:0/1509779586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8134210 0x7f34f80a09a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009870 tx=0x7f34e8009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.974+0000 7f3500607700 1 -- 172.21.15.154:0/1509779586 shutdown_connections 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.974+0000 7f3500607700 1 --2- 172.21.15.154:0/1509779586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8133900 0x7f34f8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.974+0000 7f3500607700 1 --2- 172.21.15.154:0/1509779586 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8134210 0x7f34f80a09a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.974+0000 7f3500607700 1 -- 172.21.15.154:0/1509779586 >> 172.21.15.154:0/1509779586 conn(0x7f34f80a2980 msgr2=0x7f34f80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.974+0000 7f3500607700 1 -- 172.21.15.154:0/1509779586 shutdown_connections 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.974+0000 7f3500607700 1 -- 172.21.15.154:0/1509779586 wait complete. 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.975+0000 7f3500607700 1 Processor -- start 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.975+0000 7f3500607700 1 -- start start 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.975+0000 7f3500607700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f80a0ee0 0x7f34f811c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.975+0000 7f3500607700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8133900 0x7f34f811cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.975+0000 7f3500607700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8134210 0x7f34f811d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:43.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.975+0000 7f3500607700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8120100 con 0x7f34f80a0ee0 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.975+0000 7f3500607700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f812fc10 con 0x7f34f8134210 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.975+0000 7f3500607700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f811f680 con 0x7f34f8133900 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fdba2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8133900 0x7f34f811cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fdba2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8133900 0x7f34f811cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42814/0 (socket says 172.21.15.154:42814) 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fdba2700 1 -- 172.21.15.154:0/1010761224 learned_addr learned my addr 172.21.15.154:0/1010761224 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fe3a3700 1 --2- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f80a0ee0 0x7f34f811c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34feba4700 1 --2- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8134210 0x7f34f811d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fdba2700 1 -- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8134210 msgr2=0x7f34f811d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fdba2700 1 --2- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8134210 0x7f34f811d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fdba2700 1 -- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f80a0ee0 msgr2=0x7f34f811c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fdba2700 1 --2- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f80a0ee0 0x7f34f811c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:43.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fdba2700 1 -- 172.21.15.154:0/1010761224 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80094a0 con 0x7f34f8133900 2023-09-30T22:25:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34fdba2700 1 --2- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8133900 0x7f34f811cdb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f34e80090b0 tx=0x7f34e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34eeffd700 1 -- 172.21.15.154:0/1010761224 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8004510 con 0x7f34f8133900 2023-09-30T22:25:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34eeffd700 1 -- 172.21.15.154:0/1010761224 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e80036a0 con 0x7f34f8133900 2023-09-30T22:25:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f34eeffd700 1 -- 172.21.15.154:0/1010761224 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8003a50 con 0x7f34f8133900 2023-09-30T22:25:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f3500607700 1 -- 172.21.15.154:0/1010761224 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f811ea10 con 0x7f34f8133900 2023-09-30T22:25:43.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.976+0000 7f3500607700 1 -- 172.21.15.154:0/1010761224 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f809a2c0 con 0x7f34f8133900 2023-09-30T22:25:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.978+0000 7f3500607700 1 -- 172.21.15.154:0/1010761224 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f804f2a0 con 0x7f34f8133900 2023-09-30T22:25:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.978+0000 7f34eeffd700 1 -- 172.21.15.154:0/1010761224 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34e8003bb0 con 0x7f34f8133900 2023-09-30T22:25:43.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.978+0000 7f34eeffd700 1 -- 172.21.15.154:0/1010761224 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f34e8040970 con 0x7f34f8133900 2023-09-30T22:25:43.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:43.987+0000 7f34eeffd700 1 -- 172.21.15.154:0/1010761224 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34e8003e60 con 0x7f34f8133900 2023-09-30T22:25:44.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.041+0000 7f15cc643700 1 Processor -- start 2023-09-30T22:25:44.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.041+0000 7f15cc643700 1 -- start start 2023-09-30T22:25:44.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.041+0000 7f15cc643700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15c409e870 0x7f15c409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.041+0000 7f15cc643700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c4134330 0x7f15c413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.041+0000 7f15cc643700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c409fa00 con 0x7f15c409f180 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15cc643700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40a0370 con 0x7f15c409e870 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15cc643700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15c406bec0 con 0x7f15c4134330 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15ca3df700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15c409e870 0x7f15c409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15cabe0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c4134330 0x7f15c413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15ca3df700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15c409e870 0x7f15c409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36432/0 (socket says 172.21.15.154:36432) 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15cabe0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c4134330 0x7f15c413be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42830/0 (socket says 172.21.15.154:42830) 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15ca3df700 1 -- 172.21.15.154:0/689918688 learned_addr learned my addr 172.21.15.154:0/689918688 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15ca3df700 1 -- 172.21.15.154:0/689918688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c4134330 msgr2=0x7f15c413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:44.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15ca3df700 1 --2- 172.21.15.154:0/689918688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c4134330 0x7f15c413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15ca3df700 1 -- 172.21.15.154:0/689918688 >> v1:172.21.15.154:6789/0 conn(0x7f15c409f180 legacy=0x7f15c4133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15ca3df700 1 -- 172.21.15.154:0/689918688 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c409ada0 con 0x7f15c409e870 2023-09-30T22:25:44.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15ca3df700 1 --2- 172.21.15.154:0/689918688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 0x7f15c409ec40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f15c00098f0 tx=0x7f15c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1084b87430c10020 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.042+0000 7f15c93dd700 1 -- 172.21.15.154:0/689918688 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0011830 con 0x7f15c409e870 2023-09-30T22:25:44.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.043+0000 7f15c93dd700 1 -- 172.21.15.154:0/689918688 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0011990 con 0x7f15c409e870 2023-09-30T22:25:44.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.043+0000 7f15c93dd700 1 -- 172.21.15.154:0/689918688 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0011d20 con 0x7f15c409e870 2023-09-30T22:25:44.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.043+0000 7f15cc643700 1 -- 172.21.15.154:0/689918688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 msgr2=0x7f15c409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.043+0000 7f15cc643700 1 --2- 172.21.15.154:0/689918688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 0x7f15c409ec40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f15c00098f0 tx=0x7f15c0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:44.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.043+0000 7f15cc643700 1 -- 172.21.15.154:0/689918688 shutdown_connections 2023-09-30T22:25:44.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.043+0000 7f15cc643700 1 --2- 172.21.15.154:0/689918688 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c4134330 0x7f15c413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.043+0000 7f15cc643700 1 --2- 172.21.15.154:0/689918688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 0x7f15c409ec40 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.043+0000 7f15cc643700 1 -- 172.21.15.154:0/689918688 >> 172.21.15.154:0/689918688 conn(0x7f15c40a4430 msgr2=0x7f15c40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.044+0000 7f15cc643700 1 -- 172.21.15.154:0/689918688 shutdown_connections 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.044+0000 7f15cc643700 1 -- 172.21.15.154:0/689918688 wait complete. 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.044+0000 7f15cc643700 1 Processor -- start 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cc643700 1 -- start start 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cc643700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 0x7f15c41d5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cc643700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c409f180 0x7f15c41d5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cc643700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c4134330 0x7f15c41d1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cc643700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40726b0 con 0x7f15c409e870 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cc643700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41304f0 con 0x7f15c4134330 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cc643700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15c406cfa0 con 0x7f15c409f180 2023-09-30T22:25:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cabe0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c4134330 0x7f15c41d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cabe0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c4134330 0x7f15c41d1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44004/0 (socket says 172.21.15.154:44004) 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cabe0700 1 -- 172.21.15.154:0/1624760348 learned_addr learned my addr 172.21.15.154:0/1624760348 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15ca3df700 1 --2- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 0x7f15c41d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cabe0700 1 -- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c409f180 msgr2=0x7f15c41d5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cabe0700 1 --2- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c409f180 0x7f15c41d5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cabe0700 1 -- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 msgr2=0x7f15c41d5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.045+0000 7f15cabe0700 1 --2- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 0x7f15c41d5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.046+0000 7f15cabe0700 1 -- 172.21.15.154:0/1624760348 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0009550 con 0x7f15c4134330 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.046+0000 7f15ca3df700 1 --2- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 0x7f15c41d5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.046+0000 7f15cabe0700 1 --2- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c4134330 0x7f15c41d1850 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f15bc004400 tx=0x7f15bc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.046+0000 7f15baffd700 1 -- 172.21.15.154:0/1624760348 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc009700 con 0x7f15c4134330 2023-09-30T22:25:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.046+0000 7f15baffd700 1 -- 172.21.15.154:0/1624760348 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc018020 con 0x7f15c4134330 2023-09-30T22:25:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.046+0000 7f15baffd700 1 -- 172.21.15.154:0/1624760348 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc009aa0 con 0x7f15c4134330 2023-09-30T22:25:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.046+0000 7f15cc643700 1 -- 172.21.15.154:0/1624760348 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4132600 con 0x7f15c4134330 2023-09-30T22:25:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.046+0000 7f15cc643700 1 -- 172.21.15.154:0/1624760348 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c4133330 con 0x7f15c4134330 2023-09-30T22:25:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.047+0000 7f15cc643700 1 -- 172.21.15.154:0/1624760348 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c404f2a0 con 0x7f15c4134330 2023-09-30T22:25:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.047+0000 7f15baffd700 1 -- 172.21.15.154:0/1624760348 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15bc009c00 con 0x7f15c4134330 2023-09-30T22:25:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.047+0000 7f15baffd700 1 -- 172.21.15.154:0/1624760348 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f15bc019030 con 0x7f15c4134330 2023-09-30T22:25:44.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.056+0000 7f15baffd700 1 -- 172.21.15.154:0/1624760348 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15bc045060 con 0x7f15c4134330 2023-09-30T22:25:44.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.058+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3688497122 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4e8009ce70 con 0x7f4e80099a60 2023-09-30T22:25:44.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.059+0000 7f4e67fff700 1 -- 172.21.15.154:0/3688497122 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e70022300 con 0x7f4e80099a60 2023-09-30T22:25:44.059 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:44.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.061+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 msgr2=0x7f4e8011d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.061+0000 7f4e85e8d700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e8011d9d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000ebe0 tx=0x7f4e7000eef0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.061+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3688497122 shutdown_connections 2023-09-30T22:25:44.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.061+0000 7f4e85e8d700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e80133b80 0x7f4e8011e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.061+0000 7f4e85e8d700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e80099a60 0x7f4e8011d9d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.061+0000 7f4e85e8d700 1 --2- 172.21.15.154:0/3688497122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e800a0e20 0x7f4e8011df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.061+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3688497122 >> 172.21.15.154:0/3688497122 conn(0x7f4e800a2980 msgr2=0x7f4e801bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.061+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3688497122 shutdown_connections 2023-09-30T22:25:44.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.061+0000 7f4e85e8d700 1 -- 172.21.15.154:0/3688497122 wait complete. 2023-09-30T22:25:44.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:44.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.154+0000 7f7e6e639700 1 -- 172.21.15.154:0/16375168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7e6811c900 con 0x7f7e68133900 2023-09-30T22:25:44.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.154+0000 7f7e64ff9700 1 -- 172.21.15.154:0/16375168 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e6811c900 con 0x7f7e68133900 2023-09-30T22:25:44.154 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.156+0000 7f7e6e639700 1 -- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e68133900 msgr2=0x7f7e681c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.156+0000 7f7e6e639700 1 --2- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e68133900 0x7f7e681c86b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f7e5800c550 tx=0x7f7e5800c860 comp rx=0 tx=0).stop 2023-09-30T22:25:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.156+0000 7f7e6e639700 1 -- 172.21.15.154:0/16375168 shutdown_connections 2023-09-30T22:25:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.156+0000 7f7e6e639700 1 --2- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e68139200 0x7f7e68119090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.156+0000 7f7e6e639700 1 --2- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e68133900 0x7f7e681c86b0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.156+0000 7f7e6e639700 1 --2- 172.21.15.154:0/16375168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e681368e0 0x7f7e681c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.156+0000 7f7e6e639700 1 -- 172.21.15.154:0/16375168 >> 172.21.15.154:0/16375168 conn(0x7f7e680a2980 msgr2=0x7f7e6812f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.156+0000 7f7e6e639700 1 -- 172.21.15.154:0/16375168 shutdown_connections 2023-09-30T22:25:44.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.156+0000 7f7e6e639700 1 -- 172.21.15.154:0/16375168 wait complete. 2023-09-30T22:25:44.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:44.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.190+0000 7f3500607700 1 -- 172.21.15.154:0/1010761224 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f34f806bce0 con 0x7f34f8133900 2023-09-30T22:25:44.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.190+0000 7f34eeffd700 1 -- 172.21.15.154:0/1010761224 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34e8015030 con 0x7f34f8133900 2023-09-30T22:25:44.190 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:44.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.192+0000 7f3500607700 1 -- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8133900 msgr2=0x7f34f811cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.192+0000 7f3500607700 1 --2- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8133900 0x7f34f811cdb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f34e80090b0 tx=0x7f34e8004750 comp rx=0 tx=0).stop 2023-09-30T22:25:44.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.192+0000 7f3500607700 1 -- 172.21.15.154:0/1010761224 shutdown_connections 2023-09-30T22:25:44.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.192+0000 7f3500607700 1 --2- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34f8134210 0x7f34f811d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.192+0000 7f3500607700 1 --2- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f80a0ee0 0x7f34f811c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.192+0000 7f3500607700 1 --2- 172.21.15.154:0/1010761224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34f8133900 0x7f34f811cdb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.192+0000 7f3500607700 1 -- 172.21.15.154:0/1010761224 >> 172.21.15.154:0/1010761224 conn(0x7f34f80a2980 msgr2=0x7f34f81baf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.192+0000 7f3500607700 1 -- 172.21.15.154:0/1010761224 shutdown_connections 2023-09-30T22:25:44.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.192+0000 7f3500607700 1 -- 172.21.15.154:0/1010761224 wait complete. 2023-09-30T22:25:44.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.253+0000 7f15cc643700 1 -- 172.21.15.154:0/1624760348 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15c4072d60 con 0x7f15c4134330 2023-09-30T22:25:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.253+0000 7f15baffd700 1 -- 172.21.15.154:0/1624760348 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15bc045020 con 0x7f15c4134330 2023-09-30T22:25:44.253 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.255+0000 7f15cc643700 1 -- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c4134330 msgr2=0x7f15c41d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.255+0000 7f15cc643700 1 --2- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c4134330 0x7f15c41d1850 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f15bc004400 tx=0x7f15bc0047c0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.255+0000 7f15cc643700 1 -- 172.21.15.154:0/1624760348 shutdown_connections 2023-09-30T22:25:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.255+0000 7f15cc643700 1 --2- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15c4134330 0x7f15c41d1850 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.255+0000 7f15cc643700 1 --2- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c409e870 0x7f15c41d5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.255+0000 7f15cc643700 1 --2- 172.21.15.154:0/1624760348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15c409f180 0x7f15c41d5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:44.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.255+0000 7f15cc643700 1 -- 172.21.15.154:0/1624760348 >> 172.21.15.154:0/1624760348 conn(0x7f15c40a4430 msgr2=0x7f15c4133bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:44.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.255+0000 7f15cc643700 1 -- 172.21.15.154:0/1624760348 shutdown_connections 2023-09-30T22:25:44.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:44.255+0000 7f15cc643700 1 -- 172.21.15.154:0/1624760348 wait complete. 2023-09-30T22:25:44.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:45.074 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:45.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:45.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.211+0000 7f544705e700 1 Processor -- start 2023-09-30T22:25:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.211+0000 7f544705e700 1 -- start start 2023-09-30T22:25:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f544705e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f544009ad40 0x7f5440133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f544705e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54401343a0 0x7f54400a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f544705e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544009b110 con 0x7f5440133f70 2023-09-30T22:25:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f544705e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400a3b60 con 0x7f54401343a0 2023-09-30T22:25:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f544705e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54400a2fa0 con 0x7f544009ad40 2023-09-30T22:25:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f54455fb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54401343a0 0x7f54400a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f5444dfa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f544009ad40 0x7f5440133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f54455fb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54401343a0 0x7f54400a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36450/0 (socket says 172.21.15.154:36450) 2023-09-30T22:25:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f5444dfa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f544009ad40 0x7f5440133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42840/0 (socket says 172.21.15.154:42840) 2023-09-30T22:25:45.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f54455fb700 1 -- 172.21.15.154:0/552883866 learned_addr learned my addr 172.21.15.154:0/552883866 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:45.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f5444dfa700 1 -- 172.21.15.154:0/552883866 >> v2:172.21.15.154:3300/0 conn(0x7f54401343a0 msgr2=0x7f54400a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f5444dfa700 1 --2- 172.21.15.154:0/552883866 >> v2:172.21.15.154:3300/0 conn(0x7f54401343a0 0x7f54400a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f543f7fe700 1 -- 172.21.15.154:0/552883866 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345920085 0 0) 0x7f544009b110 con 0x7f5440133f70 2023-09-30T22:25:45.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f5444dfa700 1 -- 172.21.15.154:0/552883866 >> v1:172.21.15.154:6789/0 conn(0x7f5440133f70 legacy=0x7f54400a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.212+0000 7f5444dfa700 1 -- 172.21.15.154:0/552883866 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544009a280 con 0x7f544009ad40 2023-09-30T22:25:45.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.213+0000 7f5444dfa700 1 --2- 172.21.15.154:0/552883866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f544009ad40 0x7f5440133a30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5434009870 tx=0x7f5434009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ca9d3a4506612c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.213+0000 7f543f7fe700 1 -- 172.21.15.154:0/552883866 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434011830 con 0x7f544009ad40 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.213+0000 7f543f7fe700 1 -- 172.21.15.154:0/552883866 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5434011990 con 0x7f544009ad40 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.213+0000 7f543f7fe700 1 -- 172.21.15.154:0/552883866 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434011d00 con 0x7f544009ad40 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.214+0000 7f544705e700 1 -- 172.21.15.154:0/552883866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f544009ad40 msgr2=0x7f5440133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.214+0000 7f544705e700 1 --2- 172.21.15.154:0/552883866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f544009ad40 0x7f5440133a30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5434009870 tx=0x7f5434009b80 comp rx=0 tx=0).stop 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.214+0000 7f544705e700 1 -- 172.21.15.154:0/552883866 shutdown_connections 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.214+0000 7f544705e700 1 --2- 172.21.15.154:0/552883866 >> v2:172.21.15.154:3300/0 conn(0x7f54401343a0 0x7f54400a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.214+0000 7f544705e700 1 --2- 172.21.15.154:0/552883866 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f544009ad40 0x7f5440133a30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.214+0000 7f544705e700 1 -- 172.21.15.154:0/552883866 >> 172.21.15.154:0/552883866 conn(0x7f5440099c40 msgr2=0x7f544006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.214+0000 7f544705e700 1 -- 172.21.15.154:0/552883866 shutdown_connections 2023-09-30T22:25:45.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.214+0000 7f544705e700 1 -- 172.21.15.154:0/552883866 wait complete. 2023-09-30T22:25:45.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.215+0000 7f544705e700 1 Processor -- start 2023-09-30T22:25:45.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.215+0000 7f544705e700 1 -- start start 2023-09-30T22:25:45.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f544705e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133f70 0x7f544011d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f544705e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401343a0 0x7f544011d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f544705e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440130490 0x7f544011db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f544705e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440120bc0 con 0x7f5440130490 2023-09-30T22:25:45.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f544705e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5440120350 con 0x7f5440133f70 2023-09-30T22:25:45.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f544705e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5440132a20 con 0x7f54401343a0 2023-09-30T22:25:45.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f5444dfa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133f70 0x7f544011d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f543ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401343a0 0x7f544011d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f5444dfa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133f70 0x7f544011d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44020/0 (socket says 172.21.15.154:44020) 2023-09-30T22:25:45.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f543ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401343a0 0x7f544011d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:42856/0 (socket says 172.21.15.154:42856) 2023-09-30T22:25:45.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f5444dfa700 1 -- 172.21.15.154:0/2419980146 learned_addr learned my addr 172.21.15.154:0/2419980146 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:45.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f54455fb700 1 --2- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440130490 0x7f544011db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f543ffff700 1 -- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133f70 msgr2=0x7f544011d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f543ffff700 1 --2- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133f70 0x7f544011d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f543ffff700 1 -- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440130490 msgr2=0x7f544011db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f543ffff700 1 --2- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440130490 0x7f544011db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f543ffff700 1 -- 172.21.15.154:0/2419980146 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54340094a0 con 0x7f54401343a0 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f54455fb700 1 --2- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440130490 0x7f544011db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f543ffff700 1 --2- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401343a0 0x7f544011d5e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f544006bec0 tx=0x7f542c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.216+0000 7f543d7fa700 1 -- 172.21.15.154:0/2419980146 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c00cea0 con 0x7f54401343a0 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.217+0000 7f543d7fa700 1 -- 172.21.15.154:0/2419980146 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c005520 con 0x7f54401343a0 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.217+0000 7f544705e700 1 -- 172.21.15.154:0/2419980146 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544009c7e0 con 0x7f54401343a0 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.217+0000 7f543d7fa700 1 -- 172.21.15.154:0/2419980146 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c0038c0 con 0x7f54401343a0 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.217+0000 7f544705e700 1 -- 172.21.15.154:0/2419980146 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544011ff00 con 0x7f54401343a0 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.217+0000 7f543d7fa700 1 -- 172.21.15.154:0/2419980146 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f542c003a20 con 0x7f54401343a0 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.218+0000 7f543d7fa700 1 -- 172.21.15.154:0/2419980146 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f542c03e9f0 con 0x7f54401343a0 2023-09-30T22:25:45.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.218+0000 7f544705e700 1 -- 172.21.15.154:0/2419980146 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5440120580 con 0x7f54401343a0 2023-09-30T22:25:45.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.222+0000 7f543d7fa700 1 -- 172.21.15.154:0/2419980146 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5440120580 con 0x7f54401343a0 2023-09-30T22:25:45.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:45.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.312+0000 7fb9b8d81700 1 Processor -- start 2023-09-30T22:25:45.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.312+0000 7fb9b8d81700 1 -- start start 2023-09-30T22:25:45.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b8d81700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9b4133ad0 0x7fb9b4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b8d81700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b8d81700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b406b2d0 con 0x7fb9b41309f0 2023-09-30T22:25:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b8d81700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b4133610 con 0x7fb9b4133ad0 2023-09-30T22:25:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b8d81700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b409a500 con 0x7fb9b41300a0 2023-09-30T22:25:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9b4133ad0 0x7fb9b4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54382/0 (socket says 172.21.15.154:54382) 2023-09-30T22:25:45.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b1d9b700 1 -- 172.21.15.154:0/1587230645 learned_addr learned my addr 172.21.15.154:0/1587230645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:45.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b259c700 1 -- 172.21.15.154:0/1587230645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 msgr2=0x7fb9b41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b259c700 1 --2- 172.21.15.154:0/1587230645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b259c700 1 -- 172.21.15.154:0/1587230645 >> v1:172.21.15.154:6789/0 conn(0x7fb9b41309f0 legacy=0x7fb9b413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b259c700 1 -- 172.21.15.154:0/1587230645 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b41338b0 con 0x7fb9b4133ad0 2023-09-30T22:25:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.313+0000 7fb9b1d9b700 1 --2- 172.21.15.154:0/1587230645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.314+0000 7fb9b259c700 1 --2- 172.21.15.154:0/1587230645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b4133ad0 0x7fb9b4133ea0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009840 tx=0x7fb9a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108374718a960fe6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.314+0000 7fb9b159a700 1 -- 172.21.15.154:0/1587230645 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4004230 con 0x7fb9b4133ad0 2023-09-30T22:25:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.314+0000 7fb9b159a700 1 -- 172.21.15.154:0/1587230645 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a4004390 con 0x7fb9b4133ad0 2023-09-30T22:25:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.314+0000 7fb9b159a700 1 -- 172.21.15.154:0/1587230645 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40036a0 con 0x7fb9b4133ad0 2023-09-30T22:25:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.314+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1587230645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b4133ad0 msgr2=0x7fb9b4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.314+0000 7fb9b8d81700 1 --2- 172.21.15.154:0/1587230645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b4133ad0 0x7fb9b4133ea0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009840 tx=0x7fb9a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.315+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1587230645 shutdown_connections 2023-09-30T22:25:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.315+0000 7fb9b8d81700 1 --2- 172.21.15.154:0/1587230645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b4133ad0 0x7fb9b4133ea0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.315+0000 7fb9b8d81700 1 --2- 172.21.15.154:0/1587230645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.315+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1587230645 >> 172.21.15.154:0/1587230645 conn(0x7fb9b4099c40 msgr2=0x7fb9b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.315+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1587230645 shutdown_connections 2023-09-30T22:25:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.315+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1587230645 wait complete. 2023-09-30T22:25:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b8d81700 1 Processor -- start 2023-09-30T22:25:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b8d81700 1 -- start start 2023-09-30T22:25:45.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b8d81700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b8d81700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b41309f0 0x7fb9b41c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b8d81700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9b4133ad0 0x7fb9b41c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b8d81700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b411fe90 con 0x7fb9b41309f0 2023-09-30T22:25:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b8d81700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4120170 con 0x7fb9b41300a0 2023-09-30T22:25:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b8d81700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b412fd80 con 0x7fb9b4133ad0 2023-09-30T22:25:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9b4133ad0 0x7fb9b41c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9b4133ad0 0x7fb9b41c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35354/0 (socket says 172.21.15.154:35354) 2023-09-30T22:25:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b2d9d700 1 -- 172.21.15.154:0/1387788639 learned_addr learned my addr 172.21.15.154:0/1387788639 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b1d9b700 1 --2- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b41309f0 0x7fb9b41c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.316+0000 7fb9b259c700 1 --2- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9b2d9d700 1 -- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 msgr2=0x7fb9b41c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9b2d9d700 1 --2- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9b2d9d700 1 -- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b41309f0 msgr2=0x7fb9b41c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9b2d9d700 1 --2- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b41309f0 0x7fb9b41c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9b2d9d700 1 -- 172.21.15.154:0/1387788639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8009550 con 0x7fb9b4133ad0 2023-09-30T22:25:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9b2d9d700 1 --2- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9b4133ad0 0x7fb9b41c91d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00cc10 tx=0x7fb9ac00cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9a2ffd700 1 -- 172.21.15.154:0/1387788639 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00aa60 con 0x7fb9b4133ad0 2023-09-30T22:25:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9a2ffd700 1 -- 172.21.15.154:0/1387788639 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac00abc0 con 0x7fb9b4133ad0 2023-09-30T22:25:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1387788639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a40094a0 con 0x7fb9b4133ad0 2023-09-30T22:25:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9a2ffd700 1 -- 172.21.15.154:0/1387788639 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac012420 con 0x7fb9b4133ad0 2023-09-30T22:25:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.317+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1387788639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b412dd50 con 0x7fb9b4133ad0 2023-09-30T22:25:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.319+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1387788639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b404f2a0 con 0x7fb9b4133ad0 2023-09-30T22:25:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.319+0000 7fb9a2ffd700 1 -- 172.21.15.154:0/1387788639 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9ac012580 con 0x7fb9b4133ad0 2023-09-30T22:25:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.319+0000 7fb9a2ffd700 1 -- 172.21.15.154:0/1387788639 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9ac040470 con 0x7fb9b4133ad0 2023-09-30T22:25:45.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.327+0000 7fb9a2ffd700 1 -- 172.21.15.154:0/1387788639 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9ac011740 con 0x7fb9b4133ad0 2023-09-30T22:25:45.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.353+0000 7ff87186b700 1 Processor -- start 2023-09-30T22:25:45.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.353+0000 7ff87186b700 1 -- start start 2023-09-30T22:25:45.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.354+0000 7ff87186b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09e870 0x7ff86c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.354+0000 7ff87186b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff86c09f180 0x7ff86c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.354+0000 7ff87186b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86c09c970 con 0x7ff86c131d70 2023-09-30T22:25:45.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.354+0000 7ff87186b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86c0a0920 con 0x7ff86c09f180 2023-09-30T22:25:45.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.354+0000 7ff87186b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c09f9c0 con 0x7ff86c09e870 2023-09-30T22:25:45.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.354+0000 7ff86affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09e870 0x7ff86c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.354+0000 7ff86affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09e870 0x7ff86c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35358/0 (socket says 172.21.15.154:35358) 2023-09-30T22:25:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.354+0000 7ff86affd700 1 -- 172.21.15.154:0/1455217763 learned_addr learned my addr 172.21.15.154:0/1455217763 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.355+0000 7ff86affd700 1 -- 172.21.15.154:0/1455217763 >> v2:172.21.15.154:3300/0 conn(0x7ff86c09f180 msgr2=0x7ff86c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.355+0000 7ff86affd700 1 --2- 172.21.15.154:0/1455217763 >> v2:172.21.15.154:3300/0 conn(0x7ff86c09f180 0x7ff86c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.355+0000 7ff86affd700 1 -- 172.21.15.154:0/1455217763 >> v1:172.21.15.154:6789/0 conn(0x7ff86c131d70 legacy=0x7ff86c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.355+0000 7ff86affd700 1 -- 172.21.15.154:0/1455217763 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c09bab0 con 0x7ff86c09e870 2023-09-30T22:25:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.355+0000 7ff86affd700 1 --2- 172.21.15.154:0/1455217763 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09e870 0x7ff86c09ec40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0098f0 tx=0x7ff85c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3902f6ef7f38ad82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.355+0000 7ff869ffb700 1 -- 172.21.15.154:0/1455217763 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00b8a0 con 0x7ff86c09e870 2023-09-30T22:25:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.355+0000 7ff869ffb700 1 -- 172.21.15.154:0/1455217763 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c00ba00 con 0x7ff86c09e870 2023-09-30T22:25:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.355+0000 7ff869ffb700 1 -- 172.21.15.154:0/1455217763 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c00bd90 con 0x7ff86c09e870 2023-09-30T22:25:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.356+0000 7ff87186b700 1 -- 172.21.15.154:0/1455217763 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09e870 msgr2=0x7ff86c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.356+0000 7ff87186b700 1 --2- 172.21.15.154:0/1455217763 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09e870 0x7ff86c09ec40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0098f0 tx=0x7ff85c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.356+0000 7ff87186b700 1 -- 172.21.15.154:0/1455217763 shutdown_connections 2023-09-30T22:25:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.356+0000 7ff87186b700 1 --2- 172.21.15.154:0/1455217763 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09e870 0x7ff86c09ec40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.356+0000 7ff87186b700 1 --2- 172.21.15.154:0/1455217763 >> v2:172.21.15.154:3300/0 conn(0x7ff86c09f180 0x7ff86c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.356+0000 7ff87186b700 1 -- 172.21.15.154:0/1455217763 >> 172.21.15.154:0/1455217763 conn(0x7ff86c0a4430 msgr2=0x7ff86c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.356+0000 7ff87186b700 1 -- 172.21.15.154:0/1455217763 shutdown_connections 2023-09-30T22:25:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.356+0000 7ff87186b700 1 -- 172.21.15.154:0/1455217763 wait complete. 2023-09-30T22:25:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.357+0000 7ff87186b700 1 Processor -- start 2023-09-30T22:25:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.357+0000 7ff87186b700 1 -- start start 2023-09-30T22:25:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.357+0000 7ff87186b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86c09e870 0x7ff86c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.357+0000 7ff87186b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09f180 0x7ff86c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.357+0000 7ff87186b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff86c131d70 0x7ff86c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.357+0000 7ff87186b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c124b50 con 0x7ff86c09e870 2023-09-30T22:25:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.357+0000 7ff87186b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c1313d0 con 0x7ff86c131d70 2023-09-30T22:25:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.357+0000 7ff87186b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c125fc0 con 0x7ff86c09f180 2023-09-30T22:25:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86c09e870 0x7ff86c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86c09e870 0x7ff86c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33484/0 (socket says 172.21.15.154:33484) 2023-09-30T22:25:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86affd700 1 -- 172.21.15.154:0/775439877 learned_addr learned my addr 172.21.15.154:0/775439877 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86b7fe700 1 --2- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff86c131d70 0x7ff86c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86affd700 1 -- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09f180 msgr2=0x7ff86c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86affd700 1 --2- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09f180 0x7ff86c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86affd700 1 -- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff86c131d70 msgr2=0x7ff86c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86affd700 1 --2- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff86c131d70 0x7ff86c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86affd700 1 -- 172.21.15.154:0/775439877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c009550 con 0x7ff86c09e870 2023-09-30T22:25:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff86affd700 1 --2- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86c09e870 0x7ff86c06b880 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff85c014040 tx=0x7ff85c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff853fff700 1 -- 172.21.15.154:0/775439877 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0036a0 con 0x7ff86c09e870 2023-09-30T22:25:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff853fff700 1 -- 172.21.15.154:0/775439877 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c01e070 con 0x7ff86c09e870 2023-09-30T22:25:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff87186b700 1 -- 172.21.15.154:0/775439877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c126c40 con 0x7ff86c09e870 2023-09-30T22:25:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff853fff700 1 -- 172.21.15.154:0/775439877 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c003a60 con 0x7ff86c09e870 2023-09-30T22:25:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.358+0000 7ff87186b700 1 -- 172.21.15.154:0/775439877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c06d470 con 0x7ff86c09e870 2023-09-30T22:25:45.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.359+0000 7ff87186b700 1 -- 172.21.15.154:0/775439877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c09f5b0 con 0x7ff86c09e870 2023-09-30T22:25:45.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.360+0000 7ff853fff700 1 -- 172.21.15.154:0/775439877 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff85c003bc0 con 0x7ff86c09e870 2023-09-30T22:25:45.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.360+0000 7ff853fff700 1 -- 172.21.15.154:0/775439877 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff85c020070 con 0x7ff86c09e870 2023-09-30T22:25:45.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.364+0000 7ff853fff700 1 -- 172.21.15.154:0/775439877 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff86c09f5b0 con 0x7ff86c09e870 2023-09-30T22:25:45.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.402+0000 7fade8262700 1 Processor -- start 2023-09-30T22:25:45.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.402+0000 7fade8262700 1 -- start start 2023-09-30T22:25:45.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.402+0000 7fade8262700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fade00a0a70 0x7fade00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.402+0000 7fade8262700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.402+0000 7fade8262700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade0133f50 0x7fade01343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.402+0000 7fade8262700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade009e9d0 con 0x7fade00a0a70 2023-09-30T22:25:45.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.402+0000 7fade8262700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade009dc00 con 0x7fade00a1380 2023-09-30T22:25:45.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.402+0000 7fade8262700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fade009dec0 con 0x7fade0133f50 2023-09-30T22:25:45.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade57fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade57fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54410/0 (socket says 172.21.15.154:54410) 2023-09-30T22:25:45.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade57fd700 1 -- 172.21.15.154:0/3194854303 learned_addr learned my addr 172.21.15.154:0/3194854303 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:45.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade67ff700 1 --2- 172.21.15.154:0/3194854303 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade0133f50 0x7fade01343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade57fd700 1 -- 172.21.15.154:0/3194854303 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade0133f50 msgr2=0x7fade01343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade57fd700 1 --2- 172.21.15.154:0/3194854303 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade0133f50 0x7fade01343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade5ffe700 1 --2- 172.21.15.154:0/3194854303 >> v2:172.21.15.154:3300/0 conn(0x7fade00a0a70 0x7fade00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade57fd700 1 -- 172.21.15.154:0/3194854303 >> v2:172.21.15.154:3300/0 conn(0x7fade00a0a70 msgr2=0x7fade00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:45.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade57fd700 1 --2- 172.21.15.154:0/3194854303 >> v2:172.21.15.154:3300/0 conn(0x7fade00a0a70 0x7fade00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade57fd700 1 -- 172.21.15.154:0/3194854303 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade009e6a0 con 0x7fade00a1380 2023-09-30T22:25:45.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade5ffe700 1 --2- 172.21.15.154:0/3194854303 >> v2:172.21.15.154:3300/0 conn(0x7fade00a0a70 0x7fade00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:45.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade57fd700 1 --2- 172.21.15.154:0/3194854303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade0133a10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fadd00098f0 tx=0x7fadd0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9583bb6c20fed620 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade4ffc700 1 -- 172.21.15.154:0/3194854303 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000b8a0 con 0x7fade00a1380 2023-09-30T22:25:45.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade4ffc700 1 -- 172.21.15.154:0/3194854303 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000ba00 con 0x7fade00a1380 2023-09-30T22:25:45.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.403+0000 7fade4ffc700 1 -- 172.21.15.154:0/3194854303 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000bd90 con 0x7fade00a1380 2023-09-30T22:25:45.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.404+0000 7fade8262700 1 -- 172.21.15.154:0/3194854303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 msgr2=0x7fade0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.404+0000 7fade8262700 1 --2- 172.21.15.154:0/3194854303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade0133a10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fadd00098f0 tx=0x7fadd0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:45.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.404+0000 7fade8262700 1 -- 172.21.15.154:0/3194854303 shutdown_connections 2023-09-30T22:25:45.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.404+0000 7fade8262700 1 --2- 172.21.15.154:0/3194854303 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade0133f50 0x7fade01343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.404+0000 7fade8262700 1 --2- 172.21.15.154:0/3194854303 >> v2:172.21.15.154:3300/0 conn(0x7fade00a0a70 0x7fade00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.404+0000 7fade8262700 1 --2- 172.21.15.154:0/3194854303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade0133a10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.404+0000 7fade8262700 1 -- 172.21.15.154:0/3194854303 >> 172.21.15.154:0/3194854303 conn(0x7fade00a6610 msgr2=0x7fade00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.404+0000 7fade8262700 1 -- 172.21.15.154:0/3194854303 shutdown_connections 2023-09-30T22:25:45.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.404+0000 7fade8262700 1 -- 172.21.15.154:0/3194854303 wait complete. 2023-09-30T22:25:45.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.405+0000 7fade8262700 1 Processor -- start 2023-09-30T22:25:45.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.405+0000 7fade8262700 1 -- start start 2023-09-30T22:25:45.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade8262700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade00a0a70 0x7fade0121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade8262700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade01217c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade8262700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fade0133f50 0x7fade0121d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:45.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade8262700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0123d60 con 0x7fade0133f50 2023-09-30T22:25:45.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade8262700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade0124da0 con 0x7fade00a1380 2023-09-30T22:25:45.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade8262700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fade0124890 con 0x7fade00a0a70 2023-09-30T22:25:45.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade57fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade01217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade57fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade01217c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54412/0 (socket says 172.21.15.154:54412) 2023-09-30T22:25:45.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade57fd700 1 -- 172.21.15.154:0/3611108687 learned_addr learned my addr 172.21.15.154:0/3611108687 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:45.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade5ffe700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade00a0a70 0x7fade0121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade67ff700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fade0133f50 0x7fade0121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade57fd700 1 -- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade00a0a70 msgr2=0x7fade0121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade57fd700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade00a0a70 0x7fade0121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade57fd700 1 -- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fade0133f50 msgr2=0x7fade0121d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade57fd700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fade0133f50 0x7fade0121d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade57fd700 1 -- 172.21.15.154:0/3611108687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0009550 con 0x7fade00a1380 2023-09-30T22:25:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.406+0000 7fade5ffe700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade00a0a70 0x7fade0121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.407+0000 7fade57fd700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade01217c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009c40 tx=0x7fadd0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.407+0000 7fadd67fc700 1 -- 172.21.15.154:0/3611108687 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004300 con 0x7fade00a1380 2023-09-30T22:25:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.407+0000 7fadd67fc700 1 -- 172.21.15.154:0/3611108687 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd001f070 con 0x7fade00a1380 2023-09-30T22:25:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.407+0000 7fadd67fc700 1 -- 172.21.15.154:0/3611108687 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd00036a0 con 0x7fade00a1380 2023-09-30T22:25:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.407+0000 7fade8262700 1 -- 172.21.15.154:0/3611108687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade01226e0 con 0x7fade00a1380 2023-09-30T22:25:45.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.407+0000 7fade8262700 1 -- 172.21.15.154:0/3611108687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade00a03e0 con 0x7fade00a1380 2023-09-30T22:25:45.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.408+0000 7fadd67fc700 1 -- 172.21.15.154:0/3611108687 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadd0021030 con 0x7fade00a1380 2023-09-30T22:25:45.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.408+0000 7fade8262700 1 -- 172.21.15.154:0/3611108687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade011e040 con 0x7fade00a1380 2023-09-30T22:25:45.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.408+0000 7fadd67fc700 1 -- 172.21.15.154:0/3611108687 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fadd0040840 con 0x7fade00a1380 2023-09-30T22:25:45.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.413+0000 7fadd67fc700 1 -- 172.21.15.154:0/3611108687 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadd0006ce0 con 0x7fade00a1380 2023-09-30T22:25:45.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.464+0000 7f544705e700 1 -- 172.21.15.154:0/2419980146 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5440120580 con 0x7f54401343a0 2023-09-30T22:25:45.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.465+0000 7f543d7fa700 1 -- 172.21.15.154:0/2419980146 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5440120580 con 0x7f54401343a0 2023-09-30T22:25:45.465 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:45.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.467+0000 7f544705e700 1 -- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401343a0 msgr2=0x7f544011d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.467+0000 7f544705e700 1 --2- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401343a0 0x7f544011d5e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f544006bec0 tx=0x7f542c00c800 comp rx=0 tx=0).stop 2023-09-30T22:25:45.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.467+0000 7f544705e700 1 -- 172.21.15.154:0/2419980146 shutdown_connections 2023-09-30T22:25:45.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.467+0000 7f544705e700 1 --2- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5440130490 0x7f544011db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.467+0000 7f544705e700 1 --2- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5440133f70 0x7f544011d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.467+0000 7f544705e700 1 --2- 172.21.15.154:0/2419980146 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54401343a0 0x7f544011d5e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.467+0000 7f544705e700 1 -- 172.21.15.154:0/2419980146 >> 172.21.15.154:0/2419980146 conn(0x7f5440099c40 msgr2=0x7f54401320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.467+0000 7f544705e700 1 -- 172.21.15.154:0/2419980146 shutdown_connections 2023-09-30T22:25:45.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.467+0000 7f544705e700 1 -- 172.21.15.154:0/2419980146 wait complete. 2023-09-30T22:25:45.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:45.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.562+0000 7ff87186b700 1 -- 172.21.15.154:0/775439877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff86c09f5b0 con 0x7ff86c09e870 2023-09-30T22:25:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.563+0000 7ff853fff700 1 -- 172.21.15.154:0/775439877 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff86c09f5b0 con 0x7ff86c09e870 2023-09-30T22:25:45.563 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:45.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.564+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1387788639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9b406c3b0 con 0x7fb9b4133ad0 2023-09-30T22:25:45.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.564+0000 7fb9a2ffd700 1 -- 172.21.15.154:0/1387788639 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9ac02a090 con 0x7fb9b4133ad0 2023-09-30T22:25:45.564 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:45.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.565+0000 7ff87186b700 1 -- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86c09e870 msgr2=0x7ff86c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.565+0000 7ff87186b700 1 --2- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86c09e870 0x7ff86c06b880 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff85c014040 tx=0x7ff85c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:45.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.565+0000 7ff87186b700 1 -- 172.21.15.154:0/775439877 shutdown_connections 2023-09-30T22:25:45.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.565+0000 7ff87186b700 1 --2- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff86c131d70 0x7ff86c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.565+0000 7ff87186b700 1 --2- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff86c09e870 0x7ff86c06b880 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.565+0000 7ff87186b700 1 --2- 172.21.15.154:0/775439877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff86c09f180 0x7ff86c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.565+0000 7ff87186b700 1 -- 172.21.15.154:0/775439877 >> 172.21.15.154:0/775439877 conn(0x7ff86c0a4430 msgr2=0x7ff86c09cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.565+0000 7ff87186b700 1 -- 172.21.15.154:0/775439877 shutdown_connections 2023-09-30T22:25:45.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.565+0000 7ff87186b700 1 -- 172.21.15.154:0/775439877 wait complete. 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.566+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9b4133ad0 msgr2=0x7fb9b41c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.566+0000 7fb9b8d81700 1 --2- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9b4133ad0 0x7fb9b41c91d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00cc10 tx=0x7fb9ac00cf20 comp rx=0 tx=0).stop 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.566+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1387788639 shutdown_connections 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.566+0000 7fb9b8d81700 1 --2- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb9b4133ad0 0x7fb9b41c91d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.566+0000 7fb9b8d81700 1 --2- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b41300a0 0x7fb9b41c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.566+0000 7fb9b8d81700 1 --2- 172.21.15.154:0/1387788639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b41309f0 0x7fb9b41c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.566+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1387788639 >> 172.21.15.154:0/1387788639 conn(0x7fb9b4099c40 msgr2=0x7fb9b4131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.567+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1387788639 shutdown_connections 2023-09-30T22:25:45.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.567+0000 7fb9b8d81700 1 -- 172.21.15.154:0/1387788639 wait complete. 2023-09-30T22:25:45.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:45.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:45.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.610+0000 7fade8262700 1 -- 172.21.15.154:0/3611108687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fade004f2a0 con 0x7fade00a1380 2023-09-30T22:25:45.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.610+0000 7fadd67fc700 1 -- 172.21.15.154:0/3611108687 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadd0015030 con 0x7fade00a1380 2023-09-30T22:25:45.610 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:45.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.612+0000 7fade8262700 1 -- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 msgr2=0x7fade01217c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:45.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.612+0000 7fade8262700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade01217c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009c40 tx=0x7fadd0004750 comp rx=0 tx=0).stop 2023-09-30T22:25:45.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.612+0000 7fade8262700 1 -- 172.21.15.154:0/3611108687 shutdown_connections 2023-09-30T22:25:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.612+0000 7fade8262700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fade0133f50 0x7fade0121d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.612+0000 7fade8262700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fade00a0a70 0x7fade0121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.612+0000 7fade8262700 1 --2- 172.21.15.154:0/3611108687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fade00a1380 0x7fade01217c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.612+0000 7fade8262700 1 -- 172.21.15.154:0/3611108687 >> 172.21.15.154:0/3611108687 conn(0x7fade00a6610 msgr2=0x7fade01332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.612+0000 7fade8262700 1 -- 172.21.15.154:0/3611108687 shutdown_connections 2023-09-30T22:25:45.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:45.612+0000 7fade8262700 1 -- 172.21.15.154:0/3611108687 wait complete. 2023-09-30T22:25:45.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:46.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:46.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:46.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:46.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cfb547700 1 Processor -- start 2023-09-30T22:25:46.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cfb547700 1 -- start start 2023-09-30T22:25:46.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cfb547700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0cf4133b10 0x7f0cf4133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cfb547700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40a0980 0x7f0cf40a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cfb547700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 0x7f0cf413a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cfb547700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf409a080 con 0x7f0cf4133b10 2023-09-30T22:25:46.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cfb547700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41336e0 con 0x7f0cf40a0980 2023-09-30T22:25:46.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cfb547700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf409a760 con 0x7f0cf40a1310 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cf8ae2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40a0980 0x7f0cf40a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.618+0000 7f0cf9ae4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 0x7f0cf413a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cf92e3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0cf4133b10 0x7f0cf4133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cf8ae2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40a0980 0x7f0cf40a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54426/0 (socket says 172.21.15.154:54426) 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cf8ae2700 1 -- 172.21.15.154:0/515420482 learned_addr learned my addr 172.21.15.154:0/515420482 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cf8ae2700 1 -- 172.21.15.154:0/515420482 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 msgr2=0x7f0cf413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cf8ae2700 1 --2- 172.21.15.154:0/515420482 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 0x7f0cf413a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cf8ae2700 1 -- 172.21.15.154:0/515420482 >> v2:172.21.15.154:3300/0 conn(0x7f0cf4133b10 msgr2=0x7f0cf4133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cf8ae2700 1 --2- 172.21.15.154:0/515420482 >> v2:172.21.15.154:3300/0 conn(0x7f0cf4133b10 0x7f0cf4133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cf8ae2700 1 -- 172.21.15.154:0/515420482 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40a1760 con 0x7f0cf40a0980 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cf8ae2700 1 --2- 172.21.15.154:0/515420482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40a0980 0x7f0cf40a0dd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40098f0 tx=0x7f0ce4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e259fb1df986aafd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cebfff700 1 -- 172.21.15.154:0/515420482 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4011830 con 0x7f0cf40a0980 2023-09-30T22:25:46.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cebfff700 1 -- 172.21.15.154:0/515420482 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4011990 con 0x7f0cf40a0980 2023-09-30T22:25:46.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.619+0000 7f0cebfff700 1 -- 172.21.15.154:0/515420482 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4011d20 con 0x7f0cf40a0980 2023-09-30T22:25:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.620+0000 7f0cfb547700 1 -- 172.21.15.154:0/515420482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40a0980 msgr2=0x7f0cf40a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.620+0000 7f0cfb547700 1 --2- 172.21.15.154:0/515420482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40a0980 0x7f0cf40a0dd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40098f0 tx=0x7f0ce4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.620+0000 7f0cfb547700 1 -- 172.21.15.154:0/515420482 shutdown_connections 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.620+0000 7f0cfb547700 1 --2- 172.21.15.154:0/515420482 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 0x7f0cf413a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.620+0000 7f0cfb547700 1 --2- 172.21.15.154:0/515420482 >> v2:172.21.15.154:3300/0 conn(0x7f0cf4133b10 0x7f0cf4133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.620+0000 7f0cfb547700 1 --2- 172.21.15.154:0/515420482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40a0980 0x7f0cf40a0dd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.620+0000 7f0cfb547700 1 -- 172.21.15.154:0/515420482 >> 172.21.15.154:0/515420482 conn(0x7f0cf40a2980 msgr2=0x7f0cf40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.620+0000 7f0cfb547700 1 -- 172.21.15.154:0/515420482 shutdown_connections 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.620+0000 7f0cfb547700 1 -- 172.21.15.154:0/515420482 wait complete. 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.621+0000 7f0cfb547700 1 Processor -- start 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.621+0000 7f0cfb547700 1 -- start start 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.621+0000 7f0cfb547700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf40a0980 0x7f0cf411fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.621+0000 7f0cfb547700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 0x7f0cf411ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.621+0000 7f0cfb547700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf4133b10 0x7f0cf41204c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.621+0000 7f0cfb547700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41228a0 con 0x7f0cf40a0980 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.621+0000 7f0cfb547700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4130f90 con 0x7f0cf4133b10 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.621+0000 7f0cfb547700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41224e0 con 0x7f0cf40a1310 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.621+0000 7f0cf92e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf40a0980 0x7f0cf411fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf92e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf40a0980 0x7f0cf411fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33512/0 (socket says 172.21.15.154:33512) 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf92e3700 1 -- 172.21.15.154:0/3841965966 learned_addr learned my addr 172.21.15.154:0/3841965966 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf9ae4700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf4133b10 0x7f0cf41204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf8ae2700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 0x7f0cf411ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf9ae4700 1 -- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 msgr2=0x7f0cf411ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf9ae4700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 0x7f0cf411ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf9ae4700 1 -- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf40a0980 msgr2=0x7f0cf411fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf9ae4700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf40a0980 0x7f0cf411fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf9ae4700 1 -- 172.21.15.154:0/3841965966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce4009550 con 0x7f0cf4133b10 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf92e3700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf40a0980 0x7f0cf411fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cf9ae4700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf4133b10 0x7f0cf41204c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009d90 tx=0x7f0cec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0ce9ffb700 1 -- 172.21.15.154:0/3841965966 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec009c00 con 0x7f0cf4133b10 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0ce9ffb700 1 -- 172.21.15.154:0/3841965966 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00f040 con 0x7f0cf4133b10 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0cfb547700 1 -- 172.21.15.154:0/3841965966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf409a2c0 con 0x7f0cf4133b10 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.622+0000 7f0ce9ffb700 1 -- 172.21.15.154:0/3841965966 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec014480 con 0x7f0cf4133b10 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.623+0000 7f0cfb547700 1 -- 172.21.15.154:0/3841965966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf4123280 con 0x7f0cf4133b10 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.623+0000 7f0ce9ffb700 1 -- 172.21.15.154:0/3841965966 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cec0145e0 con 0x7f0cf4133b10 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.623+0000 7f0ce9ffb700 1 -- 172.21.15.154:0/3841965966 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0cec040210 con 0x7f0cf4133b10 2023-09-30T22:25:46.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.624+0000 7f0cfb547700 1 -- 172.21.15.154:0/3841965966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf4123470 con 0x7f0cf4133b10 2023-09-30T22:25:46.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:46.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.628+0000 7f0ce9ffb700 1 -- 172.21.15.154:0/3841965966 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cec007900 con 0x7f0cf4133b10 2023-09-30T22:25:46.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.711+0000 7fcf9565d700 1 Processor -- start 2023-09-30T22:25:46.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.711+0000 7fcf9565d700 1 -- start start 2023-09-30T22:25:46.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.711+0000 7fcf9565d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf9009ad40 0x7fcf90133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.711+0000 7fcf9565d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf90133f70 0x7fcf901343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.711+0000 7fcf9565d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9009b110 con 0x7fcf900a0a70 2023-09-30T22:25:46.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.711+0000 7fcf9565d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf900a3b60 con 0x7fcf9009ad40 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.711+0000 7fcf9565d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf901348e0 con 0x7fcf90133f70 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf9009ad40 0x7fcf90133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcf900a0a70 0x7fcf900a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34500/0 (socket says 172.21.15.154:34500) 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8f7fe700 1 -- 172.21.15.154:0/309781665 learned_addr learned my addr 172.21.15.154:0/309781665 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8e7fc700 1 --2- 172.21.15.154:0/309781665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf90133f70 0x7fcf901343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8effd700 1 -- 172.21.15.154:0/309781665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf90133f70 msgr2=0x7fcf901343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8effd700 1 --2- 172.21.15.154:0/309781665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf90133f70 0x7fcf901343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8effd700 1 -- 172.21.15.154:0/309781665 >> v1:172.21.15.154:6789/0 conn(0x7fcf900a0a70 legacy=0x7fcf900a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8effd700 1 -- 172.21.15.154:0/309781665 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900a2fa0 con 0x7fcf9009ad40 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8effd700 1 --2- 172.21.15.154:0/309781665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf9009ad40 0x7fcf90133a30 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009840 tx=0x7fcf80009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34957e4532d4c9d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8dffb700 1 -- 172.21.15.154:0/309781665 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80011830 con 0x7fcf9009ad40 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8dffb700 1 -- 172.21.15.154:0/309781665 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf80011990 con 0x7fcf9009ad40 2023-09-30T22:25:46.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.712+0000 7fcf8dffb700 1 -- 172.21.15.154:0/309781665 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80011d20 con 0x7fcf9009ad40 2023-09-30T22:25:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.713+0000 7fcf9565d700 1 -- 172.21.15.154:0/309781665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf9009ad40 msgr2=0x7fcf90133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.713+0000 7fcf9565d700 1 --2- 172.21.15.154:0/309781665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf9009ad40 0x7fcf90133a30 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009840 tx=0x7fcf80009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.713+0000 7fcf9565d700 1 -- 172.21.15.154:0/309781665 shutdown_connections 2023-09-30T22:25:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.713+0000 7fcf9565d700 1 --2- 172.21.15.154:0/309781665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf9009ad40 0x7fcf90133a30 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.713+0000 7fcf9565d700 1 --2- 172.21.15.154:0/309781665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf90133f70 0x7fcf901343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.713+0000 7fcf9565d700 1 -- 172.21.15.154:0/309781665 >> 172.21.15.154:0/309781665 conn(0x7fcf90099c40 msgr2=0x7fcf9006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.713+0000 7fcf9565d700 1 -- 172.21.15.154:0/309781665 shutdown_connections 2023-09-30T22:25:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.713+0000 7fcf9565d700 1 -- 172.21.15.154:0/309781665 wait complete. 2023-09-30T22:25:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.714+0000 7fcf9565d700 1 Processor -- start 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.714+0000 7fcf9565d700 1 -- start start 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf9565d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf9009ad40 0x7fcf9011e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf9565d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf900a0a70 0x7fcf9011e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf9565d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf90133f70 0x7fcf9011eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf9565d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf901225d0 con 0x7fcf90133f70 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf9565d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9011fd00 con 0x7fcf9009ad40 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf9565d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90120320 con 0x7fcf900a0a70 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf900a0a70 0x7fcf9011e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf90133f70 0x7fcf9011eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf900a0a70 0x7fcf9011e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35426/0 (socket says 172.21.15.154:35426) 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8e7fc700 1 -- 172.21.15.154:0/603932978 learned_addr learned my addr 172.21.15.154:0/603932978 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8e7fc700 1 -- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf9009ad40 msgr2=0x7fcf9011e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8e7fc700 1 --2- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf9009ad40 0x7fcf9011e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8e7fc700 1 -- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf90133f70 msgr2=0x7fcf9011eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8e7fc700 1 --2- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf90133f70 0x7fcf9011eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8e7fc700 1 -- 172.21.15.154:0/603932978 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf800094a0 con 0x7fcf900a0a70 2023-09-30T22:25:46.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8f7fe700 1 --2- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf90133f70 0x7fcf9011eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.715+0000 7fcf8e7fc700 1 --2- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf900a0a70 0x7fcf9011e630 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400e9e0 tx=0x7fcf8400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.716+0000 7fcf777fe700 1 -- 172.21.15.154:0/603932978 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84009710 con 0x7fcf900a0a70 2023-09-30T22:25:46.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.716+0000 7fcf777fe700 1 -- 172.21.15.154:0/603932978 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8400c850 con 0x7fcf900a0a70 2023-09-30T22:25:46.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.716+0000 7fcf777fe700 1 -- 172.21.15.154:0/603932978 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400cbc0 con 0x7fcf900a0a70 2023-09-30T22:25:46.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.716+0000 7fcf9565d700 1 -- 172.21.15.154:0/603932978 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf90120f50 con 0x7fcf900a0a70 2023-09-30T22:25:46.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.716+0000 7fcf9565d700 1 -- 172.21.15.154:0/603932978 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9009c7e0 con 0x7fcf900a0a70 2023-09-30T22:25:46.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.717+0000 7fcf777fe700 1 -- 172.21.15.154:0/603932978 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf8400cd20 con 0x7fcf900a0a70 2023-09-30T22:25:46.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.717+0000 7fcf9565d700 1 -- 172.21.15.154:0/603932978 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9009ed10 con 0x7fcf900a0a70 2023-09-30T22:25:46.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.717+0000 7fcf777fe700 1 -- 172.21.15.154:0/603932978 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf840139b0 con 0x7fcf900a0a70 2023-09-30T22:25:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.725+0000 7fcf777fe700 1 -- 172.21.15.154:0/603932978 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf8401ab10 con 0x7fcf900a0a70 2023-09-30T22:25:46.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.758+0000 7f9ada96e700 1 Processor -- start 2023-09-30T22:25:46.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.758+0000 7f9ada96e700 1 -- start start 2023-09-30T22:25:46.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.758+0000 7f8a2aa11700 1 Processor -- start 2023-09-30T22:25:46.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.758+0000 7f8a2aa11700 1 -- start start 2023-09-30T22:25:46.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ada96e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409d860 0x7f9ad409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ada96e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ad409e170 0x7f9ad41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ada96e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 0x7f9ad4131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ada96e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad409aaa0 con 0x7f9ad409e170 2023-09-30T22:25:46.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ada96e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad409f870 con 0x7f9ad4130ce0 2023-09-30T22:25:46.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ada96e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad409b360 con 0x7f9ad409d860 2023-09-30T22:25:46.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ad409e170 0x7f9ad41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ad409e170 0x7f9ad41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33544/0 (socket says 172.21.15.154:33544) 2023-09-30T22:25:46.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409d860 0x7f9ad409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad37fe700 1 -- 172.21.15.154:0/37037621 learned_addr learned my addr 172.21.15.154:0/37037621 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:46.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f8a2aa11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409ef80 0x7f8a24138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f8a2aa11700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a2409f370 0x7f8a2413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f8a2aa11700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2409af80 con 0x7f8a2409a150 2023-09-30T22:25:46.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f8a2aa11700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2409fe00 con 0x7f8a2409f370 2023-09-30T22:25:46.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f8a2aa11700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2406bec0 con 0x7f8a2409ef80 2023-09-30T22:25:46.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad37fe700 1 -- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409d860 msgr2=0x7f9ad409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad37fe700 1 --2- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409d860 0x7f9ad409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad37fe700 1 -- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 msgr2=0x7f9ad4131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad37fe700 1 --2- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 0x7f9ad4131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f8a28fae700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a2409f370 0x7f8a2413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f8a28fae700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a2409f370 0x7f8a2413b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33548/0 (socket says 172.21.15.154:33548) 2023-09-30T22:25:46.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f8a28fae700 1 -- 172.21.15.154:0/3902035981 learned_addr learned my addr 172.21.15.154:0/3902035981 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:46.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad37fe700 1 -- 172.21.15.154:0/37037621 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad409b620 con 0x7f9ad409e170 2023-09-30T22:25:46.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.759+0000 7f9ad3fff700 1 --2- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409d860 0x7f9ad409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f8a28fae700 1 -- 172.21.15.154:0/3902035981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409ef80 msgr2=0x7f8a24138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:46.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f8a28fae700 1 --2- 172.21.15.154:0/3902035981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409ef80 0x7f8a24138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f8a28fae700 1 -- 172.21.15.154:0/3902035981 >> v1:172.21.15.154:6789/0 conn(0x7f8a2409a150 legacy=0x7f8a2409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f8a28fae700 1 -- 172.21.15.154:0/3902035981 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2406bc20 con 0x7f8a2409f370 2023-09-30T22:25:46.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f9ad37fe700 1 --2- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad409e170 0x7f9ad41307a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80098f0 tx=0x7f9ac8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2d2924571ce5c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f8a28fae700 1 --2- 172.21.15.154:0/3902035981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2409f370 0x7f8a2413b3b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009e50 tx=0x7f8a1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76856b42087588e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f9ad2ffd700 1 -- 172.21.15.154:0/37037621 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8011830 con 0x7f9ad409e170 2023-09-30T22:25:46.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f9ad2ffd700 1 -- 172.21.15.154:0/37037621 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac8011990 con 0x7f9ad409e170 2023-09-30T22:25:46.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f9ad2ffd700 1 -- 172.21.15.154:0/37037621 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8011d20 con 0x7f9ad409e170 2023-09-30T22:25:46.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f8a22ffd700 1 -- 172.21.15.154:0/3902035981 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00e070 con 0x7f8a2409f370 2023-09-30T22:25:46.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f8a22ffd700 1 -- 172.21.15.154:0/3902035981 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00b9c0 con 0x7f8a2409f370 2023-09-30T22:25:46.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.760+0000 7f8a22ffd700 1 -- 172.21.15.154:0/3902035981 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00bd70 con 0x7f8a2409f370 2023-09-30T22:25:46.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f9ada96e700 1 -- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad409e170 msgr2=0x7f9ad41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f9ada96e700 1 --2- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad409e170 0x7f9ad41307a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80098f0 tx=0x7f9ac8009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:46.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f8a2aa11700 1 -- 172.21.15.154:0/3902035981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2409f370 msgr2=0x7f8a2413b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f8a2aa11700 1 --2- 172.21.15.154:0/3902035981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2409f370 0x7f8a2413b3b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009e50 tx=0x7f8a1c00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:46.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f9ada96e700 1 -- 172.21.15.154:0/37037621 shutdown_connections 2023-09-30T22:25:46.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f9ada96e700 1 --2- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 0x7f9ad4131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f9ada96e700 1 --2- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409d860 0x7f9ad409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f9ada96e700 1 --2- 172.21.15.154:0/37037621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad409e170 0x7f9ad41307a0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f9ada96e700 1 -- 172.21.15.154:0/37037621 >> 172.21.15.154:0/37037621 conn(0x7f9ad4099c40 msgr2=0x7f9ad40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f8a2aa11700 1 -- 172.21.15.154:0/3902035981 shutdown_connections 2023-09-30T22:25:46.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f8a2aa11700 1 --2- 172.21.15.154:0/3902035981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2409f370 0x7f8a2413b3b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f8a2aa11700 1 --2- 172.21.15.154:0/3902035981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409ef80 0x7f8a24138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f8a2aa11700 1 -- 172.21.15.154:0/3902035981 >> 172.21.15.154:0/3902035981 conn(0x7f8a240a4430 msgr2=0x7f8a240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f8a2aa11700 1 -- 172.21.15.154:0/3902035981 shutdown_connections 2023-09-30T22:25:46.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f8a2aa11700 1 -- 172.21.15.154:0/3902035981 wait complete. 2023-09-30T22:25:46.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f9ada96e700 1 -- 172.21.15.154:0/37037621 shutdown_connections 2023-09-30T22:25:46.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.761+0000 7f9ada96e700 1 -- 172.21.15.154:0/37037621 wait complete. 2023-09-30T22:25:46.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.762+0000 7f8a2aa11700 1 Processor -- start 2023-09-30T22:25:46.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.762+0000 7f8a2aa11700 1 -- start start 2023-09-30T22:25:46.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.762+0000 7f9ada96e700 1 Processor -- start 2023-09-30T22:25:46.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a2aa11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409a150 0x7f8a24139690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a2aa11700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2409ef80 0x7f8a24139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a2aa11700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2409f370 0x7f8a2413a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a2aa11700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2413ab60 con 0x7f8a2409f370 2023-09-30T22:25:46.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a2aa11700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2413b2a0 con 0x7f8a2409a150 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a2aa11700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2411f730 con 0x7f8a2409ef80 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409a150 0x7f8a24139690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409a150 0x7f8a24139690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54484/0 (socket says 172.21.15.154:54484) 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a23fff700 1 -- 172.21.15.154:0/1278343275 learned_addr learned my addr 172.21.15.154:0/1278343275 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a237fe700 1 --2- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2409ef80 0x7f8a24139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a23fff700 1 -- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2409ef80 msgr2=0x7f8a24139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a23fff700 1 --2- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2409ef80 0x7f8a24139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a23fff700 1 -- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2409f370 msgr2=0x7f8a2413a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a23fff700 1 --2- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2409f370 0x7f8a2413a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a23fff700 1 -- 172.21.15.154:0/1278343275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c009b30 con 0x7f8a2409a150 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a237fe700 1 --2- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2409ef80 0x7f8a24139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:46.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f8a23fff700 1 --2- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409a150 0x7f8a24139690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c450 tx=0x7f8a1400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f9ada96e700 1 -- start start 2023-09-30T22:25:46.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f9ada96e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad409d860 0x7f9ad41ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f9ada96e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409e170 0x7f9ad41cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f9ada96e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 0x7f9ad412df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:46.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f9ada96e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad41cd580 con 0x7f9ad409d860 2023-09-30T22:25:46.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f9ada96e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad411f3b0 con 0x7f9ad4130ce0 2023-09-30T22:25:46.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.763+0000 7f9ada96e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40a32d0 con 0x7f9ad409e170 2023-09-30T22:25:46.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f8a20ff9700 1 -- 172.21.15.154:0/1278343275 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140052d0 con 0x7f8a2409a150 2023-09-30T22:25:46.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f8a2aa11700 1 -- 172.21.15.154:0/1278343275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a24120170 con 0x7f8a2409a150 2023-09-30T22:25:46.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f8a2aa11700 1 -- 172.21.15.154:0/1278343275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2409b890 con 0x7f8a2409a150 2023-09-30T22:25:46.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409e170 0x7f9ad41cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409e170 0x7f9ad41cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35446/0 (socket says 172.21.15.154:35446) 2023-09-30T22:25:46.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad37fe700 1 -- 172.21.15.154:0/1703893437 learned_addr learned my addr 172.21.15.154:0/1703893437 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:46.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad8f0b700 1 --2- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 0x7f9ad412df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:46.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad8f0b700 1 -- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409e170 msgr2=0x7f9ad41cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad8f0b700 1 --2- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409e170 0x7f9ad41cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad8f0b700 1 -- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad409d860 msgr2=0x7f9ad41ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad8f0b700 1 --2- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad409d860 0x7f9ad41ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad8f0b700 1 -- 172.21.15.154:0/1703893437 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40094a0 con 0x7f9ad4130ce0 2023-09-30T22:25:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad8f0b700 1 --2- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 0x7f9ad412df80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00be50 tx=0x7f9acc00bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad0ff9700 1 -- 172.21.15.154:0/1703893437 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00cd10 con 0x7f9ad4130ce0 2023-09-30T22:25:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad0ff9700 1 -- 172.21.15.154:0/1703893437 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc00ce90 con 0x7f9ad4130ce0 2023-09-30T22:25:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.764+0000 7f9ad0ff9700 1 -- 172.21.15.154:0/1703893437 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc014680 con 0x7f9ad4130ce0 2023-09-30T22:25:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.765+0000 7f8a20ff9700 1 -- 172.21.15.154:0/1278343275 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a14005430 con 0x7f8a2409a150 2023-09-30T22:25:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.765+0000 7f8a20ff9700 1 -- 172.21.15.154:0/1278343275 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140038c0 con 0x7f8a2409a150 2023-09-30T22:25:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.765+0000 7f8a2aa11700 1 -- 172.21.15.154:0/1278343275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2404f2a0 con 0x7f8a2409a150 2023-09-30T22:25:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.765+0000 7f9ada96e700 1 -- 172.21.15.154:0/1703893437 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac8009550 con 0x7f9ad4130ce0 2023-09-30T22:25:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.765+0000 7f9ada96e700 1 -- 172.21.15.154:0/1703893437 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad411ffc0 con 0x7f9ad4130ce0 2023-09-30T22:25:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.766+0000 7f9ada96e700 1 -- 172.21.15.154:0/1703893437 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad404f2a0 con 0x7f9ad4130ce0 2023-09-30T22:25:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.766+0000 7f9ad0ff9700 1 -- 172.21.15.154:0/1703893437 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9acc01d3b0 con 0x7f9ad4130ce0 2023-09-30T22:25:46.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.766+0000 7f9ad0ff9700 1 -- 172.21.15.154:0/1703893437 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9acc006e40 con 0x7f9ad4130ce0 2023-09-30T22:25:46.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.770+0000 7f9ad0ff9700 1 -- 172.21.15.154:0/1703893437 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9acc01c360 con 0x7f9ad4130ce0 2023-09-30T22:25:46.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.771+0000 7f8a20ff9700 1 -- 172.21.15.154:0/1278343275 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a14003a20 con 0x7f8a2409a150 2023-09-30T22:25:46.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.771+0000 7f8a20ff9700 1 -- 172.21.15.154:0/1278343275 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a1403f060 con 0x7f8a2409a150 2023-09-30T22:25:46.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.779+0000 7f8a20ff9700 1 -- 172.21.15.154:0/1278343275 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a14018260 con 0x7f8a2409a150 2023-09-30T22:25:46.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.912+0000 7f0cfb547700 1 -- 172.21.15.154:0/3841965966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0cf406b700 con 0x7f0cf4133b10 2023-09-30T22:25:46.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.912+0000 7f0ce9ffb700 1 -- 172.21.15.154:0/3841965966 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cec02c090 con 0x7f0cf4133b10 2023-09-30T22:25:46.912 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:46.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.915+0000 7f0cfb547700 1 -- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf4133b10 msgr2=0x7f0cf41204c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.915+0000 7f0cfb547700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf4133b10 0x7f0cf41204c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009d90 tx=0x7f0cec00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.916+0000 7f0cfb547700 1 -- 172.21.15.154:0/3841965966 shutdown_connections 2023-09-30T22:25:46.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.916+0000 7f0cfb547700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf4133b10 0x7f0cf41204c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.916+0000 7f0cfb547700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf40a0980 0x7f0cf411fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.916+0000 7f0cfb547700 1 --2- 172.21.15.154:0/3841965966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cf40a1310 0x7f0cf411ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.916+0000 7f0cfb547700 1 -- 172.21.15.154:0/3841965966 >> 172.21.15.154:0/3841965966 conn(0x7f0cf40a2980 msgr2=0x7f0cf4132360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.916+0000 7f0cfb547700 1 -- 172.21.15.154:0/3841965966 shutdown_connections 2023-09-30T22:25:46.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.916+0000 7f0cfb547700 1 -- 172.21.15.154:0/3841965966 wait complete. 2023-09-30T22:25:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.924+0000 7fcf9565d700 1 -- 172.21.15.154:0/603932978 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf9004f2a0 con 0x7fcf900a0a70 2023-09-30T22:25:46.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.925+0000 7fcf777fe700 1 -- 172.21.15.154:0/603932978 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf84038090 con 0x7fcf900a0a70 2023-09-30T22:25:46.926 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:46.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.927+0000 7fcf9565d700 1 -- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf900a0a70 msgr2=0x7fcf9011e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.927+0000 7fcf9565d700 1 --2- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf900a0a70 0x7fcf9011e630 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400e9e0 tx=0x7fcf8400ecf0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.927+0000 7fcf9565d700 1 -- 172.21.15.154:0/603932978 shutdown_connections 2023-09-30T22:25:46.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.927+0000 7fcf9565d700 1 --2- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf90133f70 0x7fcf9011eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.927+0000 7fcf9565d700 1 --2- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf9009ad40 0x7fcf9011e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.927+0000 7fcf9565d700 1 --2- 172.21.15.154:0/603932978 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf900a0a70 0x7fcf9011e630 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.927+0000 7fcf9565d700 1 -- 172.21.15.154:0/603932978 >> 172.21.15.154:0/603932978 conn(0x7fcf90099c40 msgr2=0x7fcf90133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.927+0000 7fcf9565d700 1 -- 172.21.15.154:0/603932978 shutdown_connections 2023-09-30T22:25:46.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.927+0000 7fcf9565d700 1 -- 172.21.15.154:0/603932978 wait complete. 2023-09-30T22:25:46.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:46.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:46.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.979+0000 7f9ada96e700 1 -- 172.21.15.154:0/1703893437 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ad406c3b0 con 0x7f9ad4130ce0 2023-09-30T22:25:46.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.979+0000 7f9ad0ff9700 1 -- 172.21.15.154:0/1703893437 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9acc019030 con 0x7f9ad4130ce0 2023-09-30T22:25:46.979 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.981+0000 7f9ada96e700 1 -- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 msgr2=0x7f9ad412df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.981+0000 7f9ada96e700 1 --2- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 0x7f9ad412df80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00be50 tx=0x7f9acc00bf30 comp rx=0 tx=0).stop 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.981+0000 7f9ada96e700 1 -- 172.21.15.154:0/1703893437 shutdown_connections 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.981+0000 7f9ada96e700 1 --2- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad4130ce0 0x7f9ad412df80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.981+0000 7f9ada96e700 1 --2- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad409d860 0x7f9ad41ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.981+0000 7f9ada96e700 1 --2- 172.21.15.154:0/1703893437 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad409e170 0x7f9ad41cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:46.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.981+0000 7f9ada96e700 1 -- 172.21.15.154:0/1703893437 >> 172.21.15.154:0/1703893437 conn(0x7f9ad4099c40 msgr2=0x7f9ad4119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.981+0000 7f9ada96e700 1 -- 172.21.15.154:0/1703893437 shutdown_connections 2023-09-30T22:25:46.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:46.981+0000 7f9ada96e700 1 -- 172.21.15.154:0/1703893437 wait complete. 2023-09-30T22:25:46.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:47.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.001+0000 7f8a2aa11700 1 -- 172.21.15.154:0/1278343275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8a24072d60 con 0x7f8a2409a150 2023-09-30T22:25:47.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.001+0000 7f8a20ff9700 1 -- 172.21.15.154:0/1278343275 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a14017070 con 0x7f8a2409a150 2023-09-30T22:25:47.001 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.003+0000 7f8a2aa11700 1 -- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409a150 msgr2=0x7f8a24139690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.003+0000 7f8a2aa11700 1 --2- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409a150 0x7f8a24139690 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c450 tx=0x7f8a1400c760 comp rx=0 tx=0).stop 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.003+0000 7f8a2aa11700 1 -- 172.21.15.154:0/1278343275 shutdown_connections 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.003+0000 7f8a2aa11700 1 --2- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2409f370 0x7f8a2413a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.003+0000 7f8a2aa11700 1 --2- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2409a150 0x7f8a24139690 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.003+0000 7f8a2aa11700 1 --2- 172.21.15.154:0/1278343275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2409ef80 0x7f8a24139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.003+0000 7f8a2aa11700 1 -- 172.21.15.154:0/1278343275 >> 172.21.15.154:0/1278343275 conn(0x7f8a240a4430 msgr2=0x7f8a2409d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.003+0000 7f8a2aa11700 1 -- 172.21.15.154:0/1278343275 shutdown_connections 2023-09-30T22:25:47.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:47.003+0000 7f8a2aa11700 1 -- 172.21.15.154:0/1278343275 wait complete. 2023-09-30T22:25:47.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:47.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:47.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:47.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:48.016 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.070+0000 7f2337f3c700 1 Processor -- start 2023-09-30T22:25:48.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.070+0000 7f2337f3c700 1 -- start start 2023-09-30T22:25:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.070+0000 7f2337f3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f2330133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2337f3c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23301343d0 0x7f23300a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2337f3c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233009a360 con 0x7f2330133fa0 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2337f3c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2330067fe0 con 0x7f23301343d0 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2337f3c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f233009a880 con 0x7f2330067c10 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2335cd8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f2330133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2335cd8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f2330133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35454/0 (socket says 172.21.15.154:35454) 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2335cd8700 1 -- 172.21.15.154:0/2938240499 learned_addr learned my addr 172.21.15.154:0/2938240499 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f23364d9700 1 --2- 172.21.15.154:0/2938240499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23301343d0 0x7f23300a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2335cd8700 1 -- 172.21.15.154:0/2938240499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23301343d0 msgr2=0x7f23300a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2335cd8700 1 --2- 172.21.15.154:0/2938240499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23301343d0 0x7f23300a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2335cd8700 1 -- 172.21.15.154:0/2938240499 >> v1:172.21.15.154:6789/0 conn(0x7f2330133fa0 legacy=0x7f23300a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2335cd8700 1 -- 172.21.15.154:0/2938240499 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330099e00 con 0x7f2330067c10 2023-09-30T22:25:48.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2335cd8700 1 --2- 172.21.15.154:0/2938240499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f2330133a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f232c009920 tx=0x7f232c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=266688a79191e19b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2334cd6700 1 -- 172.21.15.154:0/2938240499 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c004230 con 0x7f2330067c10 2023-09-30T22:25:48.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2334cd6700 1 -- 172.21.15.154:0/2938240499 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c004390 con 0x7f2330067c10 2023-09-30T22:25:48.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.071+0000 7f2334cd6700 1 -- 172.21.15.154:0/2938240499 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0036a0 con 0x7f2330067c10 2023-09-30T22:25:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.072+0000 7f2337f3c700 1 -- 172.21.15.154:0/2938240499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 msgr2=0x7f2330133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.072+0000 7f2337f3c700 1 --2- 172.21.15.154:0/2938240499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f2330133a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f232c009920 tx=0x7f232c009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.072+0000 7f2337f3c700 1 -- 172.21.15.154:0/2938240499 shutdown_connections 2023-09-30T22:25:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.072+0000 7f2337f3c700 1 --2- 172.21.15.154:0/2938240499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23301343d0 0x7f23300a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.072+0000 7f2337f3c700 1 --2- 172.21.15.154:0/2938240499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f2330133a60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.072+0000 7f2337f3c700 1 -- 172.21.15.154:0/2938240499 >> 172.21.15.154:0/2938240499 conn(0x7f23300a2980 msgr2=0x7f23300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.073+0000 7f2337f3c700 1 -- 172.21.15.154:0/2938240499 shutdown_connections 2023-09-30T22:25:48.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.073+0000 7f2337f3c700 1 -- 172.21.15.154:0/2938240499 wait complete. 2023-09-30T22:25:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f2337f3c700 1 Processor -- start 2023-09-30T22:25:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f2337f3c700 1 -- start start 2023-09-30T22:25:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f2337f3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f233011cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f2337f3c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2330133fa0 0x7f233011d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f2337f3c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23301343d0 0x7f233011d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f2337f3c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233012dfa0 con 0x7f23301343d0 2023-09-30T22:25:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f2337f3c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233012db50 con 0x7f2330133fa0 2023-09-30T22:25:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f2337f3c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2330132f20 con 0x7f2330067c10 2023-09-30T22:25:48.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f23364d9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23301343d0 0x7f233011d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f23364d9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23301343d0 0x7f233011d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33568/0 (socket says 172.21.15.154:33568) 2023-09-30T22:25:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f23364d9700 1 -- 172.21.15.154:0/810325002 learned_addr learned my addr 172.21.15.154:0/810325002 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f23354d7700 1 --2- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2330133fa0 0x7f233011d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.074+0000 7f2335cd8700 1 --2- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f233011cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f23354d7700 1 -- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 msgr2=0x7f233011cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f23354d7700 1 --2- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f233011cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f23354d7700 1 -- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23301343d0 msgr2=0x7f233011d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f23354d7700 1 --2- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23301343d0 0x7f233011d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f23354d7700 1 -- 172.21.15.154:0/810325002 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c009550 con 0x7f2330133fa0 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f23354d7700 1 --2- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2330133fa0 0x7f233011d140 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2330068190 tx=0x7f232000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f23267fc700 1 -- 172.21.15.154:0/810325002 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320012620 con 0x7f2330133fa0 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f23267fc700 1 -- 172.21.15.154:0/810325002 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2320012780 con 0x7f2330133fa0 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f23267fc700 1 -- 172.21.15.154:0/810325002 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320012b30 con 0x7f2330133fa0 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f2337f3c700 1 -- 172.21.15.154:0/810325002 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2330120180 con 0x7f2330133fa0 2023-09-30T22:25:48.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.075+0000 7f2337f3c700 1 -- 172.21.15.154:0/810325002 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233011fe20 con 0x7f2330133fa0 2023-09-30T22:25:48.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.076+0000 7f2337f3c700 1 -- 172.21.15.154:0/810325002 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23300746f0 con 0x7f2330133fa0 2023-09-30T22:25:48.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.076+0000 7f23267fc700 1 -- 172.21.15.154:0/810325002 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f232001c460 con 0x7f2330133fa0 2023-09-30T22:25:48.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.077+0000 7f23267fc700 1 -- 172.21.15.154:0/810325002 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f232003f510 con 0x7f2330133fa0 2023-09-30T22:25:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.084+0000 7f23267fc700 1 -- 172.21.15.154:0/810325002 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f232001c710 con 0x7f2330133fa0 2023-09-30T22:25:48.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.121+0000 7f0e630c1700 1 Processor -- start 2023-09-30T22:25:48.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.121+0000 7f0e630c1700 1 -- start start 2023-09-30T22:25:48.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.122+0000 7f0e630c1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e5c09e340 0x7f0e5c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.122+0000 7f0e630c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c135f20 0x7f0e5c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.122+0000 7f0e630c1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5c09aaa0 con 0x7f0e5c09d860 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.122+0000 7f0e630c1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5c09e730 con 0x7f0e5c09e340 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.122+0000 7f0e630c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c09f870 con 0x7f0e5c135f20 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.122+0000 7f0e5bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e5c09e340 0x7f0e5c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.122+0000 7f0e5bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e5c09e340 0x7f0e5c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33574/0 (socket says 172.21.15.154:33574) 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.122+0000 7f0e5bfff700 1 -- 172.21.15.154:0/520440079 learned_addr learned my addr 172.21.15.154:0/520440079 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e6165e700 1 --2- 172.21.15.154:0/520440079 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c135f20 0x7f0e5c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e5bfff700 1 -- 172.21.15.154:0/520440079 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c135f20 msgr2=0x7f0e5c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e5bfff700 1 --2- 172.21.15.154:0/520440079 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c135f20 0x7f0e5c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e5bfff700 1 -- 172.21.15.154:0/520440079 >> v1:172.21.15.154:6789/0 conn(0x7f0e5c09d860 legacy=0x7f0e5c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e5bfff700 1 -- 172.21.15.154:0/520440079 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c09b360 con 0x7f0e5c09e340 2023-09-30T22:25:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e6165e700 1 --2- 172.21.15.154:0/520440079 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c135f20 0x7f0e5c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:48.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e5bfff700 1 --2- 172.21.15.154:0/520440079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e5c09e340 0x7f0e5c1359e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0e480098f0 tx=0x7f0e48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4844c49c15c532 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e5b7fe700 1 -- 172.21.15.154:0/520440079 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800b8a0 con 0x7f0e5c09e340 2023-09-30T22:25:48.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e5b7fe700 1 -- 172.21.15.154:0/520440079 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4800ba00 con 0x7f0e5c09e340 2023-09-30T22:25:48.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.123+0000 7f0e5b7fe700 1 -- 172.21.15.154:0/520440079 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800bd90 con 0x7f0e5c09e340 2023-09-30T22:25:48.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.124+0000 7f0e630c1700 1 -- 172.21.15.154:0/520440079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e5c09e340 msgr2=0x7f0e5c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.124+0000 7f0e630c1700 1 --2- 172.21.15.154:0/520440079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e5c09e340 0x7f0e5c1359e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0e480098f0 tx=0x7f0e48009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:48.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.124+0000 7f0e630c1700 1 -- 172.21.15.154:0/520440079 shutdown_connections 2023-09-30T22:25:48.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.124+0000 7f0e630c1700 1 --2- 172.21.15.154:0/520440079 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c135f20 0x7f0e5c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.124+0000 7f0e630c1700 1 --2- 172.21.15.154:0/520440079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e5c09e340 0x7f0e5c1359e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.124+0000 7f0e630c1700 1 -- 172.21.15.154:0/520440079 >> 172.21.15.154:0/520440079 conn(0x7f0e5c099c40 msgr2=0x7f0e5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.124+0000 7f0e630c1700 1 -- 172.21.15.154:0/520440079 shutdown_connections 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.124+0000 7f0e630c1700 1 -- 172.21.15.154:0/520440079 wait complete. 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.126+0000 7f0e630c1700 1 Processor -- start 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.126+0000 7f0e630c1700 1 -- start start 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e630c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5c09d860 0x7f0e5c139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e630c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c09e340 0x7f0e5c139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e630c1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e5c135f20 0x7f0e5c13a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e630c1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c135c90 con 0x7f0e5c135f20 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e630c1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c1206b0 con 0x7f0e5c09d860 2023-09-30T22:25:48.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e630c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c11fcc0 con 0x7f0e5c09e340 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e60e5d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5c09d860 0x7f0e5c139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e60e5d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5c09d860 0x7f0e5c139880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54522/0 (socket says 172.21.15.154:54522) 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e60e5d700 1 -- 172.21.15.154:0/139141707 learned_addr learned my addr 172.21.15.154:0/139141707 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e6165e700 1 --2- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e5c135f20 0x7f0e5c13a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e5bfff700 1 --2- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c09e340 0x7f0e5c139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e60e5d700 1 -- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c09e340 msgr2=0x7f0e5c139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e60e5d700 1 --2- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c09e340 0x7f0e5c139dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e60e5d700 1 -- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e5c135f20 msgr2=0x7f0e5c13a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e60e5d700 1 --2- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e5c135f20 0x7f0e5c13a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e60e5d700 1 -- 172.21.15.154:0/139141707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48009550 con 0x7f0e5c09d860 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.127+0000 7f0e60e5d700 1 --2- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5c09d860 0x7f0e5c139880 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c510 tx=0x7f0e5000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.128+0000 7f0e597fa700 1 -- 172.21.15.154:0/139141707 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500052d0 con 0x7f0e5c09d860 2023-09-30T22:25:48.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.128+0000 7f0e597fa700 1 -- 172.21.15.154:0/139141707 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50005430 con 0x7f0e5c09d860 2023-09-30T22:25:48.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.128+0000 7f0e630c1700 1 -- 172.21.15.154:0/139141707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c121090 con 0x7f0e5c09d860 2023-09-30T22:25:48.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.128+0000 7f0e597fa700 1 -- 172.21.15.154:0/139141707 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500038a0 con 0x7f0e5c09d860 2023-09-30T22:25:48.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.128+0000 7f0e630c1700 1 -- 172.21.15.154:0/139141707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c0a2890 con 0x7f0e5c09d860 2023-09-30T22:25:48.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.129+0000 7f0e597fa700 1 -- 172.21.15.154:0/139141707 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e50003a00 con 0x7f0e5c09d860 2023-09-30T22:25:48.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.129+0000 7f0e597fa700 1 -- 172.21.15.154:0/139141707 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0e5003ea60 con 0x7f0e5c09d860 2023-09-30T22:25:48.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.129+0000 7f0e630c1700 1 -- 172.21.15.154:0/139141707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c0717c0 con 0x7f0e5c09d860 2023-09-30T22:25:48.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.136+0000 7f0e597fa700 1 -- 172.21.15.154:0/139141707 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e50017080 con 0x7f0e5c09d860 2023-09-30T22:25:48.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.162+0000 7f0619325700 1 Processor -- start 2023-09-30T22:25:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.162+0000 7f0619325700 1 -- start start 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.162+0000 7f0619325700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0614138410 0x7f06140a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.162+0000 7f0619325700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061413dd10 0x7f06141400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f0619325700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06141379e0 con 0x7f0614138040 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f0619325700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06140a2100 con 0x7f0614138410 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f0619325700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061409b9b0 con 0x7f061413dd10 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06137fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061413dd10 0x7f06141400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06127fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0614138410 0x7f06140a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06137fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061413dd10 0x7f06141400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54530/0 (socket says 172.21.15.154:54530) 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06127fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0614138410 0x7f06140a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33588/0 (socket says 172.21.15.154:33588) 2023-09-30T22:25:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06137fe700 1 -- 172.21.15.154:0/2061289720 learned_addr learned my addr 172.21.15.154:0/2061289720 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06127fc700 1 -- 172.21.15.154:0/2061289720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061413dd10 msgr2=0x7f06141400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06127fc700 1 --2- 172.21.15.154:0/2061289720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061413dd10 0x7f06141400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06127fc700 1 -- 172.21.15.154:0/2061289720 >> v1:172.21.15.154:6789/0 conn(0x7f0614138040 legacy=0x7f06140a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06127fc700 1 -- 172.21.15.154:0/2061289720 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0614137c10 con 0x7f0614138410 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f0611ffb700 1 -- 172.21.15.154:0/2061289720 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112598146 0 0) 0x7f06141379e0 con 0x7f0614138040 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06137fe700 1 --2- 172.21.15.154:0/2061289720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061413dd10 0x7f06141400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.163+0000 7f06127fc700 1 --2- 172.21.15.154:0/2061289720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138410 0x7f06140a0ff0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0608009840 tx=0x7f0608009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215961d660e76f5d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.164+0000 7f0611ffb700 1 -- 172.21.15.154:0/2061289720 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608011830 con 0x7f0614138410 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.164+0000 7f0611ffb700 1 -- 172.21.15.154:0/2061289720 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0608011990 con 0x7f0614138410 2023-09-30T22:25:48.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.164+0000 7f0611ffb700 1 -- 172.21.15.154:0/2061289720 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608011d20 con 0x7f0614138410 2023-09-30T22:25:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.164+0000 7f0619325700 1 -- 172.21.15.154:0/2061289720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138410 msgr2=0x7f06140a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.164+0000 7f0619325700 1 --2- 172.21.15.154:0/2061289720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138410 0x7f06140a0ff0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0608009840 tx=0x7f0608009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.164+0000 7f0619325700 1 -- 172.21.15.154:0/2061289720 shutdown_connections 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.165+0000 7f0619325700 1 --2- 172.21.15.154:0/2061289720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061413dd10 0x7f06141400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.165+0000 7f0619325700 1 --2- 172.21.15.154:0/2061289720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138410 0x7f06140a0ff0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.165+0000 7f0619325700 1 -- 172.21.15.154:0/2061289720 >> 172.21.15.154:0/2061289720 conn(0x7f06140a2980 msgr2=0x7f06140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.165+0000 7f0619325700 1 -- 172.21.15.154:0/2061289720 shutdown_connections 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.165+0000 7f0619325700 1 -- 172.21.15.154:0/2061289720 wait complete. 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.166+0000 7f0619325700 1 Processor -- start 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.166+0000 7f0619325700 1 -- start start 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.166+0000 7f0619325700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138040 0x7f0614132640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.166+0000 7f0619325700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0614138410 0x7f0614132b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.166+0000 7f0619325700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f061413dd10 0x7f0614135700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.166+0000 7f0619325700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061413c040 con 0x7f0614138040 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.166+0000 7f0619325700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061413d320 con 0x7f0614138410 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.166+0000 7f0619325700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f061413c8a0 con 0x7f061413dd10 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0612ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138040 0x7f0614132640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f06127fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0614138410 0x7f0614132b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0612ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138040 0x7f0614132640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33604/0 (socket says 172.21.15.154:33604) 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f06127fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0614138410 0x7f0614132b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54538/0 (socket says 172.21.15.154:54538) 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0612ffd700 1 -- 172.21.15.154:0/1372231864 learned_addr learned my addr 172.21.15.154:0/1372231864 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0612ffd700 1 -- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f061413dd10 msgr2=0x7f0614135700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0612ffd700 1 --2- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f061413dd10 0x7f0614135700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0612ffd700 1 -- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0614138410 msgr2=0x7f0614132b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0612ffd700 1 --2- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0614138410 0x7f0614132b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0612ffd700 1 -- 172.21.15.154:0/1372231864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c009b30 con 0x7f0614138040 2023-09-30T22:25:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0612ffd700 1 --2- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138040 0x7f0614132640 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f060400c4b0 tx=0x7f060400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f05fb7fe700 1 -- 172.21.15.154:0/1372231864 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040054e0 con 0x7f0614138040 2023-09-30T22:25:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f05fb7fe700 1 -- 172.21.15.154:0/1372231864 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060400ce70 con 0x7f0614138040 2023-09-30T22:25:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0619325700 1 -- 172.21.15.154:0/1372231864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06080094a0 con 0x7f0614138040 2023-09-30T22:25:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f05fb7fe700 1 -- 172.21.15.154:0/1372231864 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040038a0 con 0x7f0614138040 2023-09-30T22:25:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.167+0000 7f0619325700 1 -- 172.21.15.154:0/1372231864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061413d6e0 con 0x7f0614138040 2023-09-30T22:25:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.168+0000 7f05fb7fe700 1 -- 172.21.15.154:0/1372231864 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0604003a00 con 0x7f0614138040 2023-09-30T22:25:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.169+0000 7f05fb7fe700 1 -- 172.21.15.154:0/1372231864 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f060403e9f0 con 0x7f0614138040 2023-09-30T22:25:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.169+0000 7f0619325700 1 -- 172.21.15.154:0/1372231864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f40052e0 con 0x7f0614138040 2023-09-30T22:25:48.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.173+0000 7f65c06b8700 1 Processor -- start 2023-09-30T22:25:48.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.173+0000 7f65c06b8700 1 -- start start 2023-09-30T22:25:48.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.174+0000 7f65c06b8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8133660 0x7f65b8135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.174+0000 7f65c06b8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65b8135f80 0x7f65b8138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.174+0000 7f65c06b8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b8099a60 con 0x7f65b8099e20 2023-09-30T22:25:48.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.174+0000 7f65c06b8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b809bf50 con 0x7f65b8135f80 2023-09-30T22:25:48.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.174+0000 7f65c06b8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b809b230 con 0x7f65b8133660 2023-09-30T22:25:48.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.174+0000 7f65bdc53700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8133660 0x7f65b8135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.174+0000 7f65bdc53700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8133660 0x7f65b8135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35520/0 (socket says 172.21.15.154:35520) 2023-09-30T22:25:48.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.174+0000 7f65bdc53700 1 -- 172.21.15.154:0/2576952565 learned_addr learned my addr 172.21.15.154:0/2576952565 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:48.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.175+0000 7f05fb7fe700 1 -- 172.21.15.154:0/1372231864 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0604017080 con 0x7f0614138040 2023-09-30T22:25:48.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.175+0000 7f65bdc53700 1 -- 172.21.15.154:0/2576952565 >> v2:172.21.15.154:3300/0 conn(0x7f65b8135f80 msgr2=0x7f65b8138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:48.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.175+0000 7f65bdc53700 1 --2- 172.21.15.154:0/2576952565 >> v2:172.21.15.154:3300/0 conn(0x7f65b8135f80 0x7f65b8138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.175+0000 7f65bdc53700 1 -- 172.21.15.154:0/2576952565 >> v1:172.21.15.154:6789/0 conn(0x7f65b8099e20 legacy=0x7f65b809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.175+0000 7f65bdc53700 1 -- 172.21.15.154:0/2576952565 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b809bb90 con 0x7f65b8133660 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.175+0000 7f65bdc53700 1 --2- 172.21.15.154:0/2576952565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8133660 0x7f65b8135a40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009920 tx=0x7f65a8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5952dddf397ee354 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.175+0000 7f65bd452700 1 -- 172.21.15.154:0/2576952565 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800ba20 con 0x7f65b8133660 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.175+0000 7f65bd452700 1 -- 172.21.15.154:0/2576952565 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800bb80 con 0x7f65b8133660 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.175+0000 7f65bd452700 1 -- 172.21.15.154:0/2576952565 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8009e70 con 0x7f65b8133660 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.176+0000 7f65c06b8700 1 -- 172.21.15.154:0/2576952565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8133660 msgr2=0x7f65b8135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.176+0000 7f65c06b8700 1 --2- 172.21.15.154:0/2576952565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8133660 0x7f65b8135a40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009920 tx=0x7f65a8009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.176+0000 7f65c06b8700 1 -- 172.21.15.154:0/2576952565 shutdown_connections 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.176+0000 7f65c06b8700 1 --2- 172.21.15.154:0/2576952565 >> v2:172.21.15.154:3300/0 conn(0x7f65b8135f80 0x7f65b8138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.176+0000 7f65c06b8700 1 --2- 172.21.15.154:0/2576952565 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8133660 0x7f65b8135a40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.176+0000 7f65c06b8700 1 -- 172.21.15.154:0/2576952565 >> 172.21.15.154:0/2576952565 conn(0x7f65b80a2980 msgr2=0x7f65b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.179+0000 7f65c06b8700 1 -- 172.21.15.154:0/2576952565 shutdown_connections 2023-09-30T22:25:48.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.179+0000 7f65c06b8700 1 -- 172.21.15.154:0/2576952565 wait complete. 2023-09-30T22:25:48.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.180+0000 7f65c06b8700 1 Processor -- start 2023-09-30T22:25:48.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65c06b8700 1 -- start start 2023-09-30T22:25:48.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65c06b8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8099e20 0x7f65b806df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65c06b8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b8133660 0x7f65b806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65c06b8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b8135f80 0x7f65b806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:48.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65be454700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8099e20 0x7f65b806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65c06b8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b806f280 con 0x7f65b8135f80 2023-09-30T22:25:48.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65c06b8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b8071280 con 0x7f65b8133660 2023-09-30T22:25:48.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65c06b8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b806f0c0 con 0x7f65b8099e20 2023-09-30T22:25:48.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65be454700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8099e20 0x7f65b806df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35530/0 (socket says 172.21.15.154:35530) 2023-09-30T22:25:48.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65be454700 1 -- 172.21.15.154:0/1817810041 learned_addr learned my addr 172.21.15.154:0/1817810041 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:48.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.181+0000 7f65bdc53700 1 --2- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b8133660 0x7f65b806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:48.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65bdc53700 1 -- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8099e20 msgr2=0x7f65b806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65bdc53700 1 --2- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8099e20 0x7f65b806df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65bdc53700 1 -- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b8135f80 msgr2=0x7f65b806ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65bdc53700 1 --2- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b8135f80 0x7f65b806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65bdc53700 1 -- 172.21.15.154:0/1817810041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a8009550 con 0x7f65b8133660 2023-09-30T22:25:48.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65bdc53700 1 --2- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b8133660 0x7f65b806e4d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f65a8016000 tx=0x7f65a80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:48.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65aeffd700 1 -- 172.21.15.154:0/1817810041 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8004500 con 0x7f65b8133660 2023-09-30T22:25:48.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65aeffd700 1 -- 172.21.15.154:0/1817810041 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a80036a0 con 0x7f65b8133660 2023-09-30T22:25:48.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65aeffd700 1 -- 172.21.15.154:0/1817810041 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8003a50 con 0x7f65b8133660 2023-09-30T22:25:48.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65c06b8700 1 -- 172.21.15.154:0/1817810041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b809fa40 con 0x7f65b8133660 2023-09-30T22:25:48.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.182+0000 7f65c06b8700 1 -- 172.21.15.154:0/1817810041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b80703c0 con 0x7f65b8133660 2023-09-30T22:25:48.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.183+0000 7f65aeffd700 1 -- 172.21.15.154:0/1817810041 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65a8003bb0 con 0x7f65b8133660 2023-09-30T22:25:48.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.183+0000 7f65aeffd700 1 -- 172.21.15.154:0/1817810041 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65a8021030 con 0x7f65b8133660 2023-09-30T22:25:48.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.184+0000 7f65c06b8700 1 -- 172.21.15.154:0/1817810041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b8072480 con 0x7f65b8133660 2023-09-30T22:25:48.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.188+0000 7f65aeffd700 1 -- 172.21.15.154:0/1817810041 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65b8072480 con 0x7f65b8133660 2023-09-30T22:25:48.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.318+0000 7f2337f3c700 1 -- 172.21.15.154:0/810325002 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f233004f2a0 con 0x7f2330133fa0 2023-09-30T22:25:48.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.318+0000 7f23267fc700 1 -- 172.21.15.154:0/810325002 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23200102e0 con 0x7f2330133fa0 2023-09-30T22:25:48.319 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:48.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.321+0000 7f2337f3c700 1 -- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2330133fa0 msgr2=0x7f233011d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.321+0000 7f2337f3c700 1 --2- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2330133fa0 0x7f233011d140 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2330068190 tx=0x7f232000c6e0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.321+0000 7f2337f3c700 1 -- 172.21.15.154:0/810325002 shutdown_connections 2023-09-30T22:25:48.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.321+0000 7f2337f3c700 1 --2- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23301343d0 0x7f233011d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.321+0000 7f2337f3c700 1 --2- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2330067c10 0x7f233011cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.321+0000 7f2337f3c700 1 --2- 172.21.15.154:0/810325002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2330133fa0 0x7f233011d140 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.321+0000 7f2337f3c700 1 -- 172.21.15.154:0/810325002 >> 172.21.15.154:0/810325002 conn(0x7f23300a2980 msgr2=0x7f233009e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.322+0000 7f2337f3c700 1 -- 172.21.15.154:0/810325002 shutdown_connections 2023-09-30T22:25:48.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.322+0000 7f2337f3c700 1 -- 172.21.15.154:0/810325002 wait complete. 2023-09-30T22:25:48.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:48.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.367+0000 7f0e630c1700 1 -- 172.21.15.154:0/139141707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0e5c04f2a0 con 0x7f0e5c09d860 2023-09-30T22:25:48.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.367+0000 7f0e597fa700 1 -- 172.21.15.154:0/139141707 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e50018260 con 0x7f0e5c09d860 2023-09-30T22:25:48.369 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:48.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.370+0000 7f0e630c1700 1 -- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5c09d860 msgr2=0x7f0e5c139880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.370+0000 7f0e630c1700 1 --2- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5c09d860 0x7f0e5c139880 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c510 tx=0x7f0e5000c820 comp rx=0 tx=0).stop 2023-09-30T22:25:48.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.370+0000 7f0e630c1700 1 -- 172.21.15.154:0/139141707 shutdown_connections 2023-09-30T22:25:48.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.370+0000 7f0e630c1700 1 --2- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e5c135f20 0x7f0e5c13a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.370+0000 7f0e630c1700 1 --2- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5c09d860 0x7f0e5c139880 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.370+0000 7f0e630c1700 1 --2- 172.21.15.154:0/139141707 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e5c09e340 0x7f0e5c139dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.370+0000 7f0e630c1700 1 -- 172.21.15.154:0/139141707 >> 172.21.15.154:0/139141707 conn(0x7f0e5c099c40 msgr2=0x7f0e5c06e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.370+0000 7f0e630c1700 1 -- 172.21.15.154:0/139141707 shutdown_connections 2023-09-30T22:25:48.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.370+0000 7f0e630c1700 1 -- 172.21.15.154:0/139141707 wait complete. 2023-09-30T22:25:48.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:48.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.404+0000 7f0619325700 1 -- 172.21.15.154:0/1372231864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05f4005590 con 0x7f0614138040 2023-09-30T22:25:48.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.404+0000 7f05fb7fe700 1 -- 172.21.15.154:0/1372231864 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0604019cd0 con 0x7f0614138040 2023-09-30T22:25:48.405 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:48.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.406+0000 7f65c06b8700 1 -- 172.21.15.154:0/1817810041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65b8072480 con 0x7f65b8133660 2023-09-30T22:25:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.406+0000 7f65aeffd700 1 -- 172.21.15.154:0/1817810041 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65b8072480 con 0x7f65b8133660 2023-09-30T22:25:48.407 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.406+0000 7f0619325700 1 -- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138040 msgr2=0x7f0614132640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.406+0000 7f0619325700 1 --2- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138040 0x7f0614132640 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f060400c4b0 tx=0x7f060400c7c0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.406+0000 7f0619325700 1 -- 172.21.15.154:0/1372231864 shutdown_connections 2023-09-30T22:25:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.406+0000 7f0619325700 1 --2- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f061413dd10 0x7f0614135700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.406+0000 7f0619325700 1 --2- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0614138040 0x7f0614132640 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.406+0000 7f0619325700 1 --2- 172.21.15.154:0/1372231864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0614138410 0x7f0614132b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.406+0000 7f0619325700 1 -- 172.21.15.154:0/1372231864 >> 172.21.15.154:0/1372231864 conn(0x7f06140a2980 msgr2=0x7f0614140d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.407+0000 7f0619325700 1 -- 172.21.15.154:0/1372231864 shutdown_connections 2023-09-30T22:25:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.407+0000 7f0619325700 1 -- 172.21.15.154:0/1372231864 wait complete. 2023-09-30T22:25:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.409+0000 7f65c06b8700 1 -- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b8133660 msgr2=0x7f65b806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.409+0000 7f65c06b8700 1 --2- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b8133660 0x7f65b806e4d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f65a8016000 tx=0x7f65a80047c0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.409+0000 7f65c06b8700 1 -- 172.21.15.154:0/1817810041 shutdown_connections 2023-09-30T22:25:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.409+0000 7f65c06b8700 1 --2- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b8135f80 0x7f65b806ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.409+0000 7f65c06b8700 1 --2- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f65b8099e20 0x7f65b806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.409+0000 7f65c06b8700 1 --2- 172.21.15.154:0/1817810041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b8133660 0x7f65b806e4d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.409+0000 7f65c06b8700 1 -- 172.21.15.154:0/1817810041 >> 172.21.15.154:0/1817810041 conn(0x7f65b80a2980 msgr2=0x7f65b8133a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.409+0000 7f65c06b8700 1 -- 172.21.15.154:0/1817810041 shutdown_connections 2023-09-30T22:25:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:48.409+0000 7f65c06b8700 1 -- 172.21.15.154:0/1817810041 wait complete. 2023-09-30T22:25:48.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:48.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:49.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:49.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:49.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:49.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f237e700 1 Processor -- start 2023-09-30T22:25:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f237e700 1 -- start start 2023-09-30T22:25:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f237e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f237e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31ec139270 0x7f31ec13b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f237e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec133640 con 0x7f31ec133a70 2023-09-30T22:25:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f237e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec0a1d50 con 0x7f31ec139270 2023-09-30T22:25:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f237e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec134550 con 0x7f31ec136950 2023-09-30T22:25:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f091b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31ec139270 0x7f31ec13b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f091b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31ec139270 0x7f31ec13b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33624/0 (socket says 172.21.15.154:33624) 2023-09-30T22:25:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31f091b700 1 -- 172.21.15.154:0/1942794789 learned_addr learned my addr 172.21.15.154:0/1942794789 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.480+0000 7f31eb7fe700 1 --2- 172.21.15.154:0/1942794789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.481+0000 7f31eb7fe700 1 -- 172.21.15.154:0/1942794789 >> v2:172.21.15.154:3300/0 conn(0x7f31ec139270 msgr2=0x7f31ec13b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.481+0000 7f31eb7fe700 1 --2- 172.21.15.154:0/1942794789 >> v2:172.21.15.154:3300/0 conn(0x7f31ec139270 0x7f31ec13b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.481+0000 7f31eb7fe700 1 -- 172.21.15.154:0/1942794789 >> v1:172.21.15.154:6789/0 conn(0x7f31ec133a70 legacy=0x7f31ec133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.481+0000 7f31eb7fe700 1 -- 172.21.15.154:0/1942794789 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec09b620 con 0x7f31ec136950 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.481+0000 7f31f091b700 1 --2- 172.21.15.154:0/1942794789 >> v2:172.21.15.154:3300/0 conn(0x7f31ec139270 0x7f31ec13b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.481+0000 7f31eb7fe700 1 --2- 172.21.15.154:0/1942794789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec138d30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009840 tx=0x7f31e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d56c717c3026cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.481+0000 7f31eaffd700 1 -- 172.21.15.154:0/1942794789 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0011830 con 0x7f31ec136950 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.481+0000 7f31eaffd700 1 -- 172.21.15.154:0/1942794789 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0011990 con 0x7f31ec136950 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.481+0000 7f31eaffd700 1 -- 172.21.15.154:0/1942794789 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0011d20 con 0x7f31ec136950 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.482+0000 7f31f237e700 1 -- 172.21.15.154:0/1942794789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 msgr2=0x7f31ec138d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.482+0000 7f31f237e700 1 --2- 172.21.15.154:0/1942794789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec138d30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009840 tx=0x7f31e0009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:49.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.482+0000 7f31f237e700 1 -- 172.21.15.154:0/1942794789 shutdown_connections 2023-09-30T22:25:49.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.482+0000 7f31f237e700 1 --2- 172.21.15.154:0/1942794789 >> v2:172.21.15.154:3300/0 conn(0x7f31ec139270 0x7f31ec13b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.482+0000 7f31f237e700 1 --2- 172.21.15.154:0/1942794789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec138d30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.482+0000 7f31f237e700 1 -- 172.21.15.154:0/1942794789 >> 172.21.15.154:0/1942794789 conn(0x7f31ec0a2980 msgr2=0x7f31ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.482+0000 7f31f237e700 1 -- 172.21.15.154:0/1942794789 shutdown_connections 2023-09-30T22:25:49.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.482+0000 7f31f237e700 1 -- 172.21.15.154:0/1942794789 wait complete. 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.483+0000 7f31f237e700 1 Processor -- start 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31f237e700 1 -- start start 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31f237e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec133a70 0x7f31ec1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31f237e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31f237e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec139270 0x7f31ec11a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31f237e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec11d8c0 con 0x7f31ec139270 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31f237e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec09a350 con 0x7f31ec133a70 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31f237e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec1c9210 con 0x7f31ec136950 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31eb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31eb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec1c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35552/0 (socket says 172.21.15.154:35552) 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31eb7fe700 1 -- 172.21.15.154:0/4177120643 learned_addr learned my addr 172.21.15.154:0/4177120643 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.484+0000 7f31f091b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec139270 0x7f31ec11a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31ebfff700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec133a70 0x7f31ec1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31f091b700 1 -- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 msgr2=0x7f31ec1c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31f091b700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec1c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31f091b700 1 -- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec133a70 msgr2=0x7f31ec1c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31f091b700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec133a70 0x7f31ec1c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31f091b700 1 -- 172.21.15.154:0/4177120643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4009b30 con 0x7f31ec139270 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31eb7fe700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31ebfff700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec133a70 0x7f31ec1c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31f091b700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec139270 0x7f31ec11a020 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f31e400ef90 tx=0x7f31e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31e8ff9700 1 -- 172.21.15.154:0/4177120643 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400cb30 con 0x7f31ec139270 2023-09-30T22:25:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31f237e700 1 -- 172.21.15.154:0/4177120643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e00094a0 con 0x7f31ec139270 2023-09-30T22:25:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31e8ff9700 1 -- 172.21.15.154:0/4177120643 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e400f040 con 0x7f31ec139270 2023-09-30T22:25:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31f237e700 1 -- 172.21.15.154:0/4177120643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec09c880 con 0x7f31ec139270 2023-09-30T22:25:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.485+0000 7f31e8ff9700 1 -- 172.21.15.154:0/4177120643 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400ce90 con 0x7f31ec139270 2023-09-30T22:25:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.486+0000 7f31e8ff9700 1 -- 172.21.15.154:0/4177120643 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31e4014480 con 0x7f31ec139270 2023-09-30T22:25:49.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.486+0000 7f31e8ff9700 1 -- 172.21.15.154:0/4177120643 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f31e403fbe0 con 0x7f31ec139270 2023-09-30T22:25:49.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.487+0000 7f31f237e700 1 -- 172.21.15.154:0/4177120643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec1338b0 con 0x7f31ec139270 2023-09-30T22:25:49.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.491+0000 7f31e8ff9700 1 -- 172.21.15.154:0/4177120643 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31e4012930 con 0x7f31ec139270 2023-09-30T22:25:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.521+0000 7f78b5eeb700 1 Processor -- start 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.521+0000 7f78b5eeb700 1 -- start start 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.521+0000 7f78b5eeb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b01346e0 0x7f78b0136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.521+0000 7f78b5eeb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b0137000 0x7f78b01393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.521+0000 7f78b5eeb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b00a1640 con 0x7f78b0131980 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78b5eeb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b006eb30 con 0x7f78b01346e0 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78b5eeb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00a22d0 con 0x7f78b0137000 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78aeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b01346e0 0x7f78b0136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78aeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b01346e0 0x7f78b0136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54564/0 (socket says 172.21.15.154:54564) 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78aeffd700 1 -- 172.21.15.154:0/1749856061 learned_addr learned my addr 172.21.15.154:0/1749856061 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78aeffd700 1 -- 172.21.15.154:0/1749856061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b0137000 msgr2=0x7f78b01393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78affff700 1 --2- 172.21.15.154:0/1749856061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b0137000 0x7f78b01393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78ae7fc700 1 -- 172.21.15.154:0/1749856061 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789089310 0 0) 0x7f78b00a1640 con 0x7f78b0131980 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78aeffd700 1 --2- 172.21.15.154:0/1749856061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b0137000 0x7f78b01393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78aeffd700 1 -- 172.21.15.154:0/1749856061 >> v1:172.21.15.154:6789/0 conn(0x7f78b0131980 legacy=0x7f78b0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78aeffd700 1 -- 172.21.15.154:0/1749856061 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0131550 con 0x7f78b01346e0 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78affff700 1 --2- 172.21.15.154:0/1749856061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b0137000 0x7f78b01393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.522+0000 7f78aeffd700 1 --2- 172.21.15.154:0/1749856061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b01346e0 0x7f78b0136ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009920 tx=0x7f78a4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7012c2bc7f147b31 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78ae7fc700 1 -- 172.21.15.154:0/1749856061 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400ba60 con 0x7f78b01346e0 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78ae7fc700 1 -- 172.21.15.154:0/1749856061 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a400bbc0 con 0x7f78b01346e0 2023-09-30T22:25:49.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78ae7fc700 1 -- 172.21.15.154:0/1749856061 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4009e70 con 0x7f78b01346e0 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78b5eeb700 1 -- 172.21.15.154:0/1749856061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b01346e0 msgr2=0x7f78b0136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78b5eeb700 1 --2- 172.21.15.154:0/1749856061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b01346e0 0x7f78b0136ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009920 tx=0x7f78a4009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78b5eeb700 1 -- 172.21.15.154:0/1749856061 shutdown_connections 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78b5eeb700 1 --2- 172.21.15.154:0/1749856061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b0137000 0x7f78b01393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78b5eeb700 1 --2- 172.21.15.154:0/1749856061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b01346e0 0x7f78b0136ac0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78b5eeb700 1 -- 172.21.15.154:0/1749856061 >> 172.21.15.154:0/1749856061 conn(0x7f78b00a2980 msgr2=0x7f78b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78b5eeb700 1 -- 172.21.15.154:0/1749856061 shutdown_connections 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.523+0000 7f78b5eeb700 1 -- 172.21.15.154:0/1749856061 wait complete. 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.525+0000 7f78b5eeb700 1 Processor -- start 2023-09-30T22:25:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.525+0000 7f78b5eeb700 1 -- start start 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78b5eeb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b0131980 0x7f78b01c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78b5eeb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b01346e0 0x7f78b01c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78b5eeb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b0137000 0x7f78b01c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78b5eeb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b011edb0 con 0x7f78b0137000 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78b5eeb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b009cd10 con 0x7f78b0131980 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78b5eeb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00a1c40 con 0x7f78b01346e0 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78af7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b0131980 0x7f78b01c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78af7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b0131980 0x7f78b01c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54570/0 (socket says 172.21.15.154:54570) 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78af7fe700 1 -- 172.21.15.154:0/2696436468 learned_addr learned my addr 172.21.15.154:0/2696436468 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78aeffd700 1 --2- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b01346e0 0x7f78b01c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78affff700 1 --2- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b0137000 0x7f78b01c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78af7fe700 1 -- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b01346e0 msgr2=0x7f78b01c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78af7fe700 1 --2- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b01346e0 0x7f78b01c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78af7fe700 1 -- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b0137000 msgr2=0x7f78b01c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78af7fe700 1 --2- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b0137000 0x7f78b01c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.526+0000 7f78af7fe700 1 -- 172.21.15.154:0/2696436468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4009550 con 0x7f78b0131980 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.527+0000 7f78af7fe700 1 --2- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b0131980 0x7f78b01c8310 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f78a000c550 tx=0x7f78a000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.527+0000 7f7897fff700 1 -- 172.21.15.154:0/2696436468 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a00054e0 con 0x7f78b0131980 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.527+0000 7f7897fff700 1 -- 172.21.15.154:0/2696436468 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0003680 con 0x7f78b0131980 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.527+0000 7f7897fff700 1 -- 172.21.15.154:0/2696436468 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0003a30 con 0x7f78b0131980 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.527+0000 7f78b5eeb700 1 -- 172.21.15.154:0/2696436468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b012ee60 con 0x7f78b0131980 2023-09-30T22:25:49.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.527+0000 7f78b5eeb700 1 -- 172.21.15.154:0/2696436468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b011f420 con 0x7f78b0131980 2023-09-30T22:25:49.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.528+0000 7f78b5eeb700 1 -- 172.21.15.154:0/2696436468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b004f2a0 con 0x7f78b0131980 2023-09-30T22:25:49.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.528+0000 7f7897fff700 1 -- 172.21.15.154:0/2696436468 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78a0003b90 con 0x7f78b0131980 2023-09-30T22:25:49.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.532+0000 7f7897fff700 1 -- 172.21.15.154:0/2696436468 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78a0019910 con 0x7f78b0131980 2023-09-30T22:25:49.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.537+0000 7f7897fff700 1 -- 172.21.15.154:0/2696436468 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78a0003e40 con 0x7f78b0131980 2023-09-30T22:25:49.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.560+0000 7f6c63bb0700 1 Processor -- start 2023-09-30T22:25:49.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.560+0000 7f6c63bb0700 1 -- start start 2023-09-30T22:25:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c63bb0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c0a0a30 0x7f6c5c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c63bb0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6c5c0a1340 0x7f6c5c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c63bb0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5c0a1e70 con 0x7f6c5c1304a0 2023-09-30T22:25:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c63bb0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5c09a720 con 0x7f6c5c0a1340 2023-09-30T22:25:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c63bb0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c09b300 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c6194c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c0a0a30 0x7f6c5c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c6194c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c0a0a30 0x7f6c5c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35564/0 (socket says 172.21.15.154:35564) 2023-09-30T22:25:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c6194c700 1 -- 172.21.15.154:0/3840781220 learned_addr learned my addr 172.21.15.154:0/3840781220 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c6114b700 1 --2- 172.21.15.154:0/3840781220 >> v2:172.21.15.154:3300/0 conn(0x7f6c5c0a1340 0x7f6c5c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c6114b700 1 -- 172.21.15.154:0/3840781220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c0a0a30 msgr2=0x7f6c5c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c6114b700 1 --2- 172.21.15.154:0/3840781220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c0a0a30 0x7f6c5c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.561+0000 7f6c6114b700 1 -- 172.21.15.154:0/3840781220 >> v1:172.21.15.154:6789/0 conn(0x7f6c5c1304a0 legacy=0x7f6c5c1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.562+0000 7f6c6114b700 1 -- 172.21.15.154:0/3840781220 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c09abc0 con 0x7f6c5c0a1340 2023-09-30T22:25:49.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.562+0000 7f6c6114b700 1 --2- 172.21.15.154:0/3840781220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a1340 0x7f6c5c12ff60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009840 tx=0x7f6c4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29650e4b2d873070 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.562+0000 7f6c6094a700 1 -- 172.21.15.154:0/3840781220 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00d980 con 0x7f6c5c0a1340 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.562+0000 7f6c6094a700 1 -- 172.21.15.154:0/3840781220 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00dae0 con 0x7f6c5c0a1340 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.562+0000 7f6c6094a700 1 -- 172.21.15.154:0/3840781220 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00de70 con 0x7f6c5c0a1340 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.562+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3840781220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a1340 msgr2=0x7f6c5c12ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.562+0000 7f6c63bb0700 1 --2- 172.21.15.154:0/3840781220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a1340 0x7f6c5c12ff60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009840 tx=0x7f6c4c009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.563+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3840781220 shutdown_connections 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.563+0000 7f6c63bb0700 1 --2- 172.21.15.154:0/3840781220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c0a0a30 0x7f6c5c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.563+0000 7f6c63bb0700 1 --2- 172.21.15.154:0/3840781220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a1340 0x7f6c5c12ff60 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.563+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3840781220 >> 172.21.15.154:0/3840781220 conn(0x7f6c5c0a2980 msgr2=0x7f6c5c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.563+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3840781220 shutdown_connections 2023-09-30T22:25:49.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.563+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3840781220 wait complete. 2023-09-30T22:25:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c63bb0700 1 Processor -- start 2023-09-30T22:25:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c63bb0700 1 -- start start 2023-09-30T22:25:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f2807de7700 1 Processor -- start 2023-09-30T22:25:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c63bb0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a0a30 0x7f6c5c11a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c63bb0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0a1340 0x7f6c5c11aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c63bb0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c1304a0 0x7f6c5c1c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c63bb0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c11d940 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c63bb0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c11c240 con 0x7f6c5c0a1340 2023-09-30T22:25:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c63bb0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c11db20 con 0x7f6c5c1304a0 2023-09-30T22:25:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c6194c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a0a30 0x7f6c5c11a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c6194c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a0a30 0x7f6c5c11a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33674/0 (socket says 172.21.15.154:33674) 2023-09-30T22:25:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c6194c700 1 -- 172.21.15.154:0/3630823828 learned_addr learned my addr 172.21.15.154:0/3630823828 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f6c6214d700 1 --2- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c1304a0 0x7f6c5c1c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.564+0000 7f2807de7700 1 -- start start 2023-09-30T22:25:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2807de7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f280009d860 0x7f280009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2807de7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2800130eb0 0x7f2800138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2807de7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280009aaa0 con 0x7f280009e170 2023-09-30T22:25:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2807de7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280009f870 con 0x7f280009d860 2023-09-30T22:25:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2807de7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280009b360 con 0x7f2800130eb0 2023-09-30T22:25:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2805382700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f280009e170 0x7f28001307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34596/0 (socket says 172.21.15.154:34596) 2023-09-30T22:25:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2805382700 1 -- 172.21.15.154:0/2867124192 learned_addr learned my addr 172.21.15.154:0/2867124192 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c6194c700 1 -- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c1304a0 msgr2=0x7f6c5c1c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c6194c700 1 --2- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c1304a0 0x7f6c5c1c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c6194c700 1 -- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0a1340 msgr2=0x7f6c5c11aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c6194c700 1 --2- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0a1340 0x7f6c5c11aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c6194c700 1 -- 172.21.15.154:0/3630823828 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c0094a0 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c6214d700 1 --2- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c1304a0 0x7f6c5c1c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:49.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2805b83700 1 --2- 172.21.15.154:0/2867124192 >> v2:172.21.15.154:3300/0 conn(0x7f280009d860 0x7f280009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c6194c700 1 --2- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a0a30 0x7f6c5c11a960 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800e8e0 tx=0x7f6c5800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2804b81700 1 -- 172.21.15.154:0/2867124192 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729386212 0 0) 0x7f280009aaa0 con 0x7f280009e170 2023-09-30T22:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2804b81700 1 -- 172.21.15.154:0/2867124192 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ec0035b0 con 0x7f280009e170 2023-09-30T22:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2805b83700 1 -- 172.21.15.154:0/2867124192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2800130eb0 msgr2=0x7f2800138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2805b83700 1 --2- 172.21.15.154:0/2867124192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2800130eb0 0x7f2800138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2805b83700 1 -- 172.21.15.154:0/2867124192 >> v1:172.21.15.154:6789/0 conn(0x7f280009e170 legacy=0x7f28001307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2805b83700 1 -- 172.21.15.154:0/2867124192 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280009b620 con 0x7f280009d860 2023-09-30T22:25:49.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c527fc700 1 -- 172.21.15.154:0/3630823828 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800c940 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c527fc700 1 -- 172.21.15.154:0/3630823828 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5800caa0 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3630823828 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5c11a4c0 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c527fc700 1 -- 172.21.15.154:0/3630823828 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800ce10 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3630823828 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5c09fe00 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.565+0000 7f2805b83700 1 --2- 172.21.15.154:0/2867124192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f280009d860 0x7f280009dc30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009840 tx=0x7f27fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e8f230ff45cebc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.566+0000 7f2804b81700 1 -- 172.21.15.154:0/2867124192 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc011830 con 0x7f280009d860 2023-09-30T22:25:49.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.566+0000 7f2804b81700 1 -- 172.21.15.154:0/2867124192 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc011990 con 0x7f280009d860 2023-09-30T22:25:49.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.566+0000 7f2804b81700 1 -- 172.21.15.154:0/2867124192 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc011d20 con 0x7f280009d860 2023-09-30T22:25:49.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.566+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3630823828 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5c04f2a0 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.566+0000 7f6c527fc700 1 -- 172.21.15.154:0/3630823828 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c580113f0 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.567+0000 7f6c527fc700 1 -- 172.21.15.154:0/3630823828 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c5803f6b0 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.567+0000 7f2807de7700 1 -- 172.21.15.154:0/2867124192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f280009d860 msgr2=0x7f280009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.567+0000 7f2807de7700 1 --2- 172.21.15.154:0/2867124192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f280009d860 0x7f280009dc30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009840 tx=0x7f27fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.567+0000 7f2807de7700 1 -- 172.21.15.154:0/2867124192 shutdown_connections 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.567+0000 7f2807de7700 1 --2- 172.21.15.154:0/2867124192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2800130eb0 0x7f2800138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.567+0000 7f2807de7700 1 --2- 172.21.15.154:0/2867124192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f280009d860 0x7f280009dc30 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.567+0000 7f2807de7700 1 -- 172.21.15.154:0/2867124192 >> 172.21.15.154:0/2867124192 conn(0x7f2800099c40 msgr2=0x7f28000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.567+0000 7f2807de7700 1 -- 172.21.15.154:0/2867124192 shutdown_connections 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.567+0000 7f2807de7700 1 -- 172.21.15.154:0/2867124192 wait complete. 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.568+0000 7f2807de7700 1 Processor -- start 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.568+0000 7f2807de7700 1 -- start start 2023-09-30T22:25:49.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2807de7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f280009d860 0x7f2800126fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2807de7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f280009e170 0x7f2800127510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2807de7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2800130eb0 0x7f28001cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2807de7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280012a020 con 0x7f2800130eb0 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2807de7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2800128310 con 0x7f280009d860 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2807de7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f280006ecd0 con 0x7f280009e170 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2806384700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2800130eb0 0x7f28001cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2806384700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2800130eb0 0x7f28001cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33694/0 (socket says 172.21.15.154:33694) 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2806384700 1 -- 172.21.15.154:0/672766023 learned_addr learned my addr 172.21.15.154:0/672766023 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2805b83700 1 --2- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f280009d860 0x7f2800126fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2806384700 1 -- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f280009e170 msgr2=0x7f2800127510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2806384700 1 --2- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f280009e170 0x7f2800127510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2806384700 1 -- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f280009d860 msgr2=0x7f2800126fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2806384700 1 --2- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f280009d860 0x7f2800126fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2806384700 1 -- 172.21.15.154:0/672766023 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc0094a0 con 0x7f2800130eb0 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.569+0000 7f2805b83700 1 --2- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f280009d860 0x7f2800126fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.570+0000 7f2806384700 1 --2- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2800130eb0 0x7f28001cc5b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f27f800b970 tx=0x7f27f800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.575+0000 7f27f67fc700 1 -- 172.21.15.154:0/672766023 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800c9b0 con 0x7f2800130eb0 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.575+0000 7f27f67fc700 1 -- 172.21.15.154:0/672766023 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f800cb30 con 0x7f2800130eb0 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.575+0000 7f27f67fc700 1 -- 172.21.15.154:0/672766023 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8014440 con 0x7f2800130eb0 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.576+0000 7f2807de7700 1 -- 172.21.15.154:0/672766023 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280009c8b0 con 0x7f2800130eb0 2023-09-30T22:25:49.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.575+0000 7f6c527fc700 1 -- 172.21.15.154:0/3630823828 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c580116a0 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.576+0000 7f2807de7700 1 -- 172.21.15.154:0/672766023 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280012a9b0 con 0x7f2800130eb0 2023-09-30T22:25:49.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.577+0000 7f27f67fc700 1 -- 172.21.15.154:0/672766023 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27f801d3b0 con 0x7f2800130eb0 2023-09-30T22:25:49.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.577+0000 7f2807de7700 1 -- 172.21.15.154:0/672766023 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280004f2a0 con 0x7f2800130eb0 2023-09-30T22:25:49.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.577+0000 7f27f67fc700 1 -- 172.21.15.154:0/672766023 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f27f8006e40 con 0x7f2800130eb0 2023-09-30T22:25:49.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.586+0000 7f27f67fc700 1 -- 172.21.15.154:0/672766023 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27f8007370 con 0x7f2800130eb0 2023-09-30T22:25:49.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.702+0000 7f31f237e700 1 -- 172.21.15.154:0/4177120643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f31ec04f2a0 con 0x7f31ec139270 2023-09-30T22:25:49.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.702+0000 7f31e8ff9700 1 -- 172.21.15.154:0/4177120643 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31e40133e0 con 0x7f31ec139270 2023-09-30T22:25:49.703 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.704+0000 7f31f237e700 1 -- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec139270 msgr2=0x7f31ec11a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.704+0000 7f31f237e700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec139270 0x7f31ec11a020 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f31e400ef90 tx=0x7f31e400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.704+0000 7f31f237e700 1 -- 172.21.15.154:0/4177120643 shutdown_connections 2023-09-30T22:25:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.704+0000 7f31f237e700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec139270 0x7f31ec11a020 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.704+0000 7f31f237e700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec133a70 0x7f31ec1c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.704+0000 7f31f237e700 1 --2- 172.21.15.154:0/4177120643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f31ec136950 0x7f31ec1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.704+0000 7f31f237e700 1 -- 172.21.15.154:0/4177120643 >> 172.21.15.154:0/4177120643 conn(0x7f31ec0a2980 msgr2=0x7f31ec0a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.704+0000 7f31f237e700 1 -- 172.21.15.154:0/4177120643 shutdown_connections 2023-09-30T22:25:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.704+0000 7f31f237e700 1 -- 172.21.15.154:0/4177120643 wait complete. 2023-09-30T22:25:49.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:49.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.734+0000 7f78b5eeb700 1 -- 172.21.15.154:0/2696436468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78b0136c80 con 0x7f78b0131980 2023-09-30T22:25:49.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.735+0000 7f7897fff700 1 -- 172.21.15.154:0/2696436468 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78a0017020 con 0x7f78b0131980 2023-09-30T22:25:49.736 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.737+0000 7f78b5eeb700 1 -- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b0131980 msgr2=0x7f78b01c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.737+0000 7f78b5eeb700 1 --2- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b0131980 0x7f78b01c8310 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f78a000c550 tx=0x7f78a000c860 comp rx=0 tx=0).stop 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.737+0000 7f78b5eeb700 1 -- 172.21.15.154:0/2696436468 shutdown_connections 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.737+0000 7f78b5eeb700 1 --2- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b0137000 0x7f78b01c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.737+0000 7f78b5eeb700 1 --2- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78b0131980 0x7f78b01c8310 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.737+0000 7f78b5eeb700 1 --2- 172.21.15.154:0/2696436468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78b01346e0 0x7f78b01c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.737+0000 7f78b5eeb700 1 -- 172.21.15.154:0/2696436468 >> 172.21.15.154:0/2696436468 conn(0x7f78b00a2980 msgr2=0x7f78b0133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.737+0000 7f78b5eeb700 1 -- 172.21.15.154:0/2696436468 shutdown_connections 2023-09-30T22:25:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.737+0000 7f78b5eeb700 1 -- 172.21.15.154:0/2696436468 wait complete. 2023-09-30T22:25:49.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:49.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.771+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3630823828 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c5c11bc10 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.772+0000 7f6c527fc700 1 -- 172.21.15.154:0/3630823828 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c58020070 con 0x7f6c5c0a0a30 2023-09-30T22:25:49.773 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:49.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.773+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a0a30 msgr2=0x7f6c5c11a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.773+0000 7f6c63bb0700 1 --2- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a0a30 0x7f6c5c11a960 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800e8e0 tx=0x7f6c5800eca0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.774+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3630823828 shutdown_connections 2023-09-30T22:25:49.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.774+0000 7f6c63bb0700 1 --2- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6c5c1304a0 0x7f6c5c1c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.774+0000 7f6c63bb0700 1 --2- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0a0a30 0x7f6c5c11a960 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.774+0000 7f6c63bb0700 1 --2- 172.21.15.154:0/3630823828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0a1340 0x7f6c5c11aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.774+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3630823828 >> 172.21.15.154:0/3630823828 conn(0x7f6c5c0a2980 msgr2=0x7f6c5c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.774+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3630823828 shutdown_connections 2023-09-30T22:25:49.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.774+0000 7f6c63bb0700 1 -- 172.21.15.154:0/3630823828 wait complete. 2023-09-30T22:25:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.780+0000 7f2807de7700 1 -- 172.21.15.154:0/672766023 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2800129320 con 0x7f2800130eb0 2023-09-30T22:25:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.780+0000 7f27f67fc700 1 -- 172.21.15.154:0/672766023 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27f8012340 con 0x7f2800130eb0 2023-09-30T22:25:49.782 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:49.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.783+0000 7f2807de7700 1 -- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2800130eb0 msgr2=0x7f28001cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:49.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.783+0000 7f2807de7700 1 --2- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2800130eb0 0x7f28001cc5b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f27f800b970 tx=0x7f27f800bd30 comp rx=0 tx=0).stop 2023-09-30T22:25:49.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.783+0000 7f2807de7700 1 -- 172.21.15.154:0/672766023 shutdown_connections 2023-09-30T22:25:49.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.783+0000 7f2807de7700 1 --2- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2800130eb0 0x7f28001cc5b0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.783+0000 7f2807de7700 1 --2- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f280009d860 0x7f2800126fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.783+0000 7f2807de7700 1 --2- 172.21.15.154:0/672766023 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f280009e170 0x7f2800127510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.783+0000 7f2807de7700 1 -- 172.21.15.154:0/672766023 >> 172.21.15.154:0/672766023 conn(0x7f2800099c40 msgr2=0x7f2800071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.783+0000 7f2807de7700 1 -- 172.21.15.154:0/672766023 shutdown_connections 2023-09-30T22:25:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:49.783+0000 7f2807de7700 1 -- 172.21.15.154:0/672766023 wait complete. 2023-09-30T22:25:49.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:49.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:50.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:50.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:50.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:50.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:50.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.863+0000 7f7e081bc700 1 Processor -- start 2023-09-30T22:25:50.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.863+0000 7f7e081bc700 1 -- start start 2023-09-30T22:25:50.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e081bc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 0x7f7e00135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e081bc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e081bc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e00099a60 con 0x7f7e00099e20 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e081bc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0009bf50 con 0x7f7e00135f80 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e081bc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0009b230 con 0x7f7e00133660 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e05f58700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7e00099e20 0x7f7e0009a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34602/0 (socket says 172.21.15.154:34602) 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e05f58700 1 -- 172.21.15.154:0/3300736499 learned_addr learned my addr 172.21.15.154:0/3300736499 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e06759700 1 --2- 172.21.15.154:0/3300736499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e05757700 1 --2- 172.21.15.154:0/3300736499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 0x7f7e00135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e06759700 1 -- 172.21.15.154:0/3300736499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 msgr2=0x7f7e00135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e06759700 1 --2- 172.21.15.154:0/3300736499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 0x7f7e00135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e06759700 1 -- 172.21.15.154:0/3300736499 >> v1:172.21.15.154:6789/0 conn(0x7f7e00099e20 legacy=0x7f7e0009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e04f56700 1 -- 172.21.15.154:0/3300736499 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191914670 0 0) 0x7f7e00099a60 con 0x7f7e00099e20 2023-09-30T22:25:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.864+0000 7f7e06759700 1 -- 172.21.15.154:0/3300736499 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0009bb90 con 0x7f7e00135f80 2023-09-30T22:25:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.865+0000 7f7e06759700 1 --2- 172.21.15.154:0/3300736499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00138360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7df800bfd0 tx=0x7f7df800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f8a320615ada29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.865+0000 7f7e04f56700 1 -- 172.21.15.154:0/3300736499 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8010070 con 0x7f7e00135f80 2023-09-30T22:25:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.865+0000 7f7e04f56700 1 -- 172.21.15.154:0/3300736499 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df800b2e0 con 0x7f7e00135f80 2023-09-30T22:25:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.865+0000 7f7e04f56700 1 -- 172.21.15.154:0/3300736499 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800dc70 con 0x7f7e00135f80 2023-09-30T22:25:50.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.866+0000 7f7e081bc700 1 -- 172.21.15.154:0/3300736499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 msgr2=0x7f7e00138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.866+0000 7f7e081bc700 1 --2- 172.21.15.154:0/3300736499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00138360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7df800bfd0 tx=0x7f7df800d330 comp rx=0 tx=0).stop 2023-09-30T22:25:50.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.866+0000 7f7e081bc700 1 -- 172.21.15.154:0/3300736499 shutdown_connections 2023-09-30T22:25:50.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.866+0000 7f7e081bc700 1 --2- 172.21.15.154:0/3300736499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00138360 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.866+0000 7f7e081bc700 1 --2- 172.21.15.154:0/3300736499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 0x7f7e00135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.866+0000 7f7e081bc700 1 -- 172.21.15.154:0/3300736499 >> 172.21.15.154:0/3300736499 conn(0x7f7e000a2980 msgr2=0x7f7e000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:50.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.866+0000 7f7e081bc700 1 -- 172.21.15.154:0/3300736499 shutdown_connections 2023-09-30T22:25:50.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.866+0000 7f7e081bc700 1 -- 172.21.15.154:0/3300736499 wait complete. 2023-09-30T22:25:50.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e081bc700 1 Processor -- start 2023-09-30T22:25:50.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e081bc700 1 -- start start 2023-09-30T22:25:50.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e081bc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e00099e20 0x7f7e0006fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e081bc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 0x7f7e00070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e081bc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e081bc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0011a250 con 0x7f7e00099e20 2023-09-30T22:25:50.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e081bc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00071330 con 0x7f7e00135f80 2023-09-30T22:25:50.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e081bc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0009b470 con 0x7f7e00133660 2023-09-30T22:25:50.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e06759700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.868+0000 7f7e06759700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54616/0 (socket says 172.21.15.154:54616) 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e06759700 1 -- 172.21.15.154:0/1065457746 learned_addr learned my addr 172.21.15.154:0/1065457746 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e05f58700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e00099e20 0x7f7e0006fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e05757700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 0x7f7e00070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e06759700 1 -- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 msgr2=0x7f7e00070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e06759700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 0x7f7e00070410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e06759700 1 -- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e00099e20 msgr2=0x7f7e0006fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e06759700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e00099e20 0x7f7e0006fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e06759700 1 -- 172.21.15.154:0/1065457746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df800bc80 con 0x7f7e00135f80 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e05f58700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e00099e20 0x7f7e0006fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e06759700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00070950 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7e000a2600 tx=0x7f7df8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7df67fc700 1 -- 172.21.15.154:0/1065457746 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8004450 con 0x7f7e00135f80 2023-09-30T22:25:50.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7df67fc700 1 -- 172.21.15.154:0/1065457746 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df80045d0 con 0x7f7e00135f80 2023-09-30T22:25:50.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7e081bc700 1 -- 172.21.15.154:0/1065457746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e00133a30 con 0x7f7e00135f80 2023-09-30T22:25:50.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.869+0000 7f7df67fc700 1 -- 172.21.15.154:0/1065457746 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800bb00 con 0x7f7e00135f80 2023-09-30T22:25:50.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.870+0000 7f7e081bc700 1 -- 172.21.15.154:0/1065457746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0011a430 con 0x7f7e00135f80 2023-09-30T22:25:50.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.871+0000 7f7e081bc700 1 -- 172.21.15.154:0/1065457746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e00072480 con 0x7f7e00135f80 2023-09-30T22:25:50.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.871+0000 7f7df67fc700 1 -- 172.21.15.154:0/1065457746 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7df8009460 con 0x7f7e00135f80 2023-09-30T22:25:50.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.871+0000 7f7df67fc700 1 -- 172.21.15.154:0/1065457746 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7df8043350 con 0x7f7e00135f80 2023-09-30T22:25:50.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.880+0000 7f7df67fc700 1 -- 172.21.15.154:0/1065457746 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e00072480 con 0x7f7e00135f80 2023-09-30T22:25:50.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f923d357700 1 Processor -- start 2023-09-30T22:25:50.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f923d357700 1 -- start start 2023-09-30T22:25:50.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f923d357700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f923809e340 0x7f92381359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f923d357700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9238135f20 0x7f9238138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f923d357700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923809aaa0 con 0x7f923809d860 2023-09-30T22:25:50.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f923d357700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923809e730 con 0x7f923809e340 2023-09-30T22:25:50.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f923d357700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923809f870 con 0x7f9238135f20 2023-09-30T22:25:50.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f92367fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f923809e340 0x7f92381359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f9236ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f923809d860 0x7f923809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34618/0 (socket says 172.21.15.154:34618) 2023-09-30T22:25:50.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.903+0000 7f9236ffd700 1 -- 172.21.15.154:0/2813964745 learned_addr learned my addr 172.21.15.154:0/2813964745 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:25:50.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.904+0000 7f92377fe700 1 --2- 172.21.15.154:0/2813964745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9238135f20 0x7f9238138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.904+0000 7f92367fc700 1 -- 172.21.15.154:0/2813964745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9238135f20 msgr2=0x7f9238138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:50.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.904+0000 7f92367fc700 1 --2- 172.21.15.154:0/2813964745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9238135f20 0x7f9238138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.904+0000 7f92367fc700 1 -- 172.21.15.154:0/2813964745 >> v1:172.21.15.154:6789/0 conn(0x7f923809d860 legacy=0x7f923809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.904+0000 7f92367fc700 1 -- 172.21.15.154:0/2813964745 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923809b360 con 0x7f923809e340 2023-09-30T22:25:50.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.904+0000 7f92367fc700 1 --2- 172.21.15.154:0/2813964745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f923809e340 0x7f92381359e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f922c009840 tx=0x7f922c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c1a2bb7e4185d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.904+0000 7f9235ffb700 1 -- 172.21.15.154:0/2813964745 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c014e90 con 0x7f923809e340 2023-09-30T22:25:50.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.904+0000 7f9235ffb700 1 -- 172.21.15.154:0/2813964745 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c01c440 con 0x7f923809e340 2023-09-30T22:25:50.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.904+0000 7f9235ffb700 1 -- 172.21.15.154:0/2813964745 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c01c7d0 con 0x7f923809e340 2023-09-30T22:25:50.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.905+0000 7f923d357700 1 -- 172.21.15.154:0/2813964745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f923809e340 msgr2=0x7f92381359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.905+0000 7f923d357700 1 --2- 172.21.15.154:0/2813964745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f923809e340 0x7f92381359e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f922c009840 tx=0x7f922c009b50 comp rx=0 tx=0).stop 2023-09-30T22:25:50.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.905+0000 7f923d357700 1 -- 172.21.15.154:0/2813964745 shutdown_connections 2023-09-30T22:25:50.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.905+0000 7f923d357700 1 --2- 172.21.15.154:0/2813964745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9238135f20 0x7f9238138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.905+0000 7f923d357700 1 --2- 172.21.15.154:0/2813964745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f923809e340 0x7f92381359e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.905+0000 7f923d357700 1 -- 172.21.15.154:0/2813964745 >> 172.21.15.154:0/2813964745 conn(0x7f9238099c40 msgr2=0x7f92380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:50.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.905+0000 7f923d357700 1 -- 172.21.15.154:0/2813964745 shutdown_connections 2023-09-30T22:25:50.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.905+0000 7f923d357700 1 -- 172.21.15.154:0/2813964745 wait complete. 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.906+0000 7f923d357700 1 Processor -- start 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.906+0000 7f923d357700 1 -- start start 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f923d357700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f923809d860 0x7f923811c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f923d357700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f923809e340 0x7f923811cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f923d357700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238135f20 0x7f923811d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f923d357700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923809c8b0 con 0x7f9238135f20 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f923d357700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92380a2190 con 0x7f923809d860 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f923d357700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f923811f830 con 0x7f923809e340 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92367fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f923809e340 0x7f923811cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92367fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f923809e340 0x7f923811cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35616/0 (socket says 172.21.15.154:35616) 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92367fc700 1 -- 172.21.15.154:0/2652435007 learned_addr learned my addr 172.21.15.154:0/2652435007 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92377fe700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238135f20 0x7f923811d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f9236ffd700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f923809d860 0x7f923811c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92377fe700 1 -- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f923809e340 msgr2=0x7f923811cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92377fe700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f923809e340 0x7f923811cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92377fe700 1 -- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f923809d860 msgr2=0x7f923811c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92377fe700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f923809d860 0x7f923811c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92377fe700 1 -- 172.21.15.154:0/2652435007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c0094a0 con 0x7f9238135f20 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f9236ffd700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f923809d860 0x7f923811c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:50.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.907+0000 7f92377fe700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238135f20 0x7f923811d090 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f923809b1e0 tx=0x7f9230009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.908+0000 7f921f7fe700 1 -- 172.21.15.154:0/2652435007 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923000d030 con 0x7f9238135f20 2023-09-30T22:25:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.908+0000 7f921f7fe700 1 -- 172.21.15.154:0/2652435007 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9230003c40 con 0x7f9238135f20 2023-09-30T22:25:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.908+0000 7f923d357700 1 -- 172.21.15.154:0/2652435007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923811fdc0 con 0x7f9238135f20 2023-09-30T22:25:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.908+0000 7f921f7fe700 1 -- 172.21.15.154:0/2652435007 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300074e0 con 0x7f9238135f20 2023-09-30T22:25:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.908+0000 7f923d357700 1 -- 172.21.15.154:0/2652435007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9238120830 con 0x7f9238135f20 2023-09-30T22:25:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.909+0000 7f923d357700 1 -- 172.21.15.154:0/2652435007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923804f2a0 con 0x7f9238135f20 2023-09-30T22:25:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.909+0000 7f921f7fe700 1 -- 172.21.15.154:0/2652435007 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9230007660 con 0x7f9238135f20 2023-09-30T22:25:50.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.909+0000 7f921f7fe700 1 -- 172.21.15.154:0/2652435007 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f923003f180 con 0x7f9238135f20 2023-09-30T22:25:50.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.918+0000 7f921f7fe700 1 -- 172.21.15.154:0/2652435007 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f923001ebe0 con 0x7f9238135f20 2023-09-30T22:25:50.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.943+0000 7f95cb7cb700 1 Processor -- start 2023-09-30T22:25:50.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.943+0000 7f00a7b54700 1 Processor -- start 2023-09-30T22:25:50.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.943+0000 7f00a7b54700 1 -- start start 2023-09-30T22:25:50.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.943+0000 7f95cb7cb700 1 -- start start 2023-09-30T22:25:50.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95cb7cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c413ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95cb7cb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 0x7f95c413f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95cb7cb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c409eca0 con 0x7f95c406a770 2023-09-30T22:25:50.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95cb7cb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c406b2e0 con 0x7f95c413d210 2023-09-30T22:25:50.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95cb7cb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95c409f720 con 0x7f95c41350d0 2023-09-30T22:25:50.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95c9d68700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 0x7f95c413f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95c9d68700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 0x7f95c413f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54652/0 (socket says 172.21.15.154:54652) 2023-09-30T22:25:50.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95c9d68700 1 -- 172.21.15.154:0/2532567910 learned_addr learned my addr 172.21.15.154:0/2532567910 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:50.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95c8d66700 1 --2- 172.21.15.154:0/2532567910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c413ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f00a7b54700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00a00a0a70 0x7f00a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f00a7b54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f00a7b54700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a009dc00 con 0x7f00a00a1380 2023-09-30T22:25:50.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f00a7b54700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a009ea90 con 0x7f00a00a0a70 2023-09-30T22:25:50.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f00a7b54700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a009dec0 con 0x7f00a0134120 2023-09-30T22:25:50.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95c9d68700 1 -- 172.21.15.154:0/2532567910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 msgr2=0x7f95c413ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:50.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95c9d68700 1 --2- 172.21.15.154:0/2532567910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c413ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95c9d68700 1 -- 172.21.15.154:0/2532567910 >> v1:172.21.15.154:6789/0 conn(0x7f95c406a770 legacy=0x7f95c41349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f95c9d68700 1 -- 172.21.15.154:0/2532567910 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c406b480 con 0x7f95c413d210 2023-09-30T22:25:50.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.944+0000 7f00a60f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a58f0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00a00a0a70 0x7f00a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a60f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54664/0 (socket says 172.21.15.154:54664) 2023-09-30T22:25:50.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a60f1700 1 -- 172.21.15.154:0/2524847332 learned_addr learned my addr 172.21.15.154:0/2524847332 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:50.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a50ef700 1 --1- 172.21.15.154:0/2524847332 >> v1:172.21.15.154:6789/0 conn(0x7f00a00a1380 0x7f00a0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34638/0 (socket says 172.21.15.154:34638) 2023-09-30T22:25:50.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f95c9d68700 1 --2- 172.21.15.154:0/2532567910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 0x7f95c413f5f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009e80 tx=0x7f95bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=818a9a42df02ef24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a60f1700 1 -- 172.21.15.154:0/2524847332 >> v2:172.21.15.154:3300/0 conn(0x7f00a00a0a70 msgr2=0x7f00a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:50.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a60f1700 1 --2- 172.21.15.154:0/2524847332 >> v2:172.21.15.154:3300/0 conn(0x7f00a00a0a70 0x7f00a00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a60f1700 1 -- 172.21.15.154:0/2524847332 >> v1:172.21.15.154:6789/0 conn(0x7f00a00a1380 legacy=0x7f00a0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a60f1700 1 -- 172.21.15.154:0/2524847332 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a009e6a0 con 0x7f00a0134120 2023-09-30T22:25:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a60f1700 1 --2- 172.21.15.154:0/2524847332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a013bce0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0098009e50 tx=0x7f009800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6d3882e97d7f1aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f95bbfff700 1 -- 172.21.15.154:0/2532567910 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00e070 con 0x7f95c413d210 2023-09-30T22:25:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f95bbfff700 1 -- 172.21.15.154:0/2532567910 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc00b910 con 0x7f95c413d210 2023-09-30T22:25:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f95bbfff700 1 -- 172.21.15.154:0/2532567910 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00bcc0 con 0x7f95c413d210 2023-09-30T22:25:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a48ee700 1 -- 172.21.15.154:0/2524847332 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009800e070 con 0x7f00a0134120 2023-09-30T22:25:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a48ee700 1 -- 172.21.15.154:0/2524847332 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0098003a20 con 0x7f00a0134120 2023-09-30T22:25:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.945+0000 7f00a48ee700 1 -- 172.21.15.154:0/2524847332 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098003dd0 con 0x7f00a0134120 2023-09-30T22:25:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2532567910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 msgr2=0x7f95c413f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f95cb7cb700 1 --2- 172.21.15.154:0/2532567910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 0x7f95c413f5f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009e80 tx=0x7f95bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2532567910 shutdown_connections 2023-09-30T22:25:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f95cb7cb700 1 --2- 172.21.15.154:0/2532567910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 0x7f95c413f5f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f95cb7cb700 1 --2- 172.21.15.154:0/2532567910 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c413ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2532567910 >> 172.21.15.154:0/2532567910 conn(0x7f95c4099c40 msgr2=0x7f95c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2532567910 shutdown_connections 2023-09-30T22:25:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2532567910 wait complete. 2023-09-30T22:25:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f00a7b54700 1 -- 172.21.15.154:0/2524847332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 msgr2=0x7f00a013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.946+0000 7f00a7b54700 1 --2- 172.21.15.154:0/2524847332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a013bce0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0098009e50 tx=0x7f009800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.947+0000 7f00a7b54700 1 -- 172.21.15.154:0/2524847332 shutdown_connections 2023-09-30T22:25:50.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.947+0000 7f00a7b54700 1 --2- 172.21.15.154:0/2524847332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a013bce0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.947+0000 7f00a7b54700 1 --2- 172.21.15.154:0/2524847332 >> v2:172.21.15.154:3300/0 conn(0x7f00a00a0a70 0x7f00a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.947+0000 7f00a7b54700 1 -- 172.21.15.154:0/2524847332 >> 172.21.15.154:0/2524847332 conn(0x7f00a00a6610 msgr2=0x7f00a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:50.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.947+0000 7f00a7b54700 1 -- 172.21.15.154:0/2524847332 shutdown_connections 2023-09-30T22:25:50.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.947+0000 7f00a7b54700 1 -- 172.21.15.154:0/2524847332 wait complete. 2023-09-30T22:25:50.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.947+0000 7f95cb7cb700 1 Processor -- start 2023-09-30T22:25:50.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.947+0000 7f95cb7cb700 1 -- start start 2023-09-30T22:25:50.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95cb7cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c406a770 0x7f95c41ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95cb7cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c41cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95cb7cb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 0x7f95c41cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95cb7cb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4138d60 con 0x7f95c406a770 2023-09-30T22:25:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95cb7cb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40722f0 con 0x7f95c413d210 2023-09-30T22:25:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95cb7cb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95c413ccf0 con 0x7f95c41350d0 2023-09-30T22:25:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c8d66700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c41cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c8d66700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c41cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35634/0 (socket says 172.21.15.154:35634) 2023-09-30T22:25:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c8d66700 1 -- 172.21.15.154:0/2753658337 learned_addr learned my addr 172.21.15.154:0/2753658337 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f00a7b54700 1 Processor -- start 2023-09-30T22:25:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c9567700 1 --2- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c406a770 0x7f95c41ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c8d66700 1 -- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 msgr2=0x7f95c41cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c8d66700 1 --2- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 0x7f95c41cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c8d66700 1 -- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c406a770 msgr2=0x7f95c41ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c8d66700 1 --2- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c406a770 0x7f95c41ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c8d66700 1 -- 172.21.15.154:0/2753658337 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc009b30 con 0x7f95c41350d0 2023-09-30T22:25:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c9567700 1 --2- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c406a770 0x7f95c41ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f00a7b54700 1 -- start start 2023-09-30T22:25:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95c8d66700 1 --2- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c41cd180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f95b400e9e0 tx=0x7f95b400eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.948+0000 7f95b9ffb700 1 -- 172.21.15.154:0/2753658337 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4009710 con 0x7f95c41350d0 2023-09-30T22:25:50.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f95b9ffb700 1 -- 172.21.15.154:0/2753658337 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b400c850 con 0x7f95c41350d0 2023-09-30T22:25:50.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2753658337 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c413a410 con 0x7f95c41350d0 2023-09-30T22:25:50.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2753658337 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c413c6a0 con 0x7f95c41350d0 2023-09-30T22:25:50.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f95b9ffb700 1 -- 172.21.15.154:0/2753658337 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b400cbc0 con 0x7f95c41350d0 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a7b54700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a00a0a70 0x7f00a0122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a7b54700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a00a1380 0x7f00a0122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a7b54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a01234e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a7b54700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00a03e0 con 0x7f00a00a0a70 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a7b54700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a0125eb0 con 0x7f00a0134120 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a7b54700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00a0126170 con 0x7f00a00a1380 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a50ef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a00a1380 0x7f00a0122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a50ef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a00a1380 0x7f00a0122fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35648/0 (socket says 172.21.15.154:35648) 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a50ef700 1 -- 172.21.15.154:0/548677984 learned_addr learned my addr 172.21.15.154:0/548677984 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a60f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a01234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.949+0000 7f00a58f0700 1 --2- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a00a0a70 0x7f00a0122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:50.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00a60f1700 1 -- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a00a1380 msgr2=0x7f00a0122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00a60f1700 1 --2- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a00a1380 0x7f00a0122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00a60f1700 1 -- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a00a0a70 msgr2=0x7f00a0122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:50.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00a60f1700 1 --2- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a00a0a70 0x7f00a0122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:50.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00a60f1700 1 -- 172.21.15.154:0/548677984 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098009b30 con 0x7f00a0134120 2023-09-30T22:25:50.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2753658337 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a40052e0 con 0x7f95c41350d0 2023-09-30T22:25:50.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00a60f1700 1 --2- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a01234e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0098014000 tx=0x7f0098004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:50.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00967fc700 1 -- 172.21.15.154:0/548677984 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098004440 con 0x7f00a0134120 2023-09-30T22:25:50.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00967fc700 1 -- 172.21.15.154:0/548677984 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00980045e0 con 0x7f00a0134120 2023-09-30T22:25:50.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00a7b54700 1 -- 172.21.15.154:0/548677984 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a0124640 con 0x7f00a0134120 2023-09-30T22:25:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00967fc700 1 -- 172.21.15.154:0/548677984 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00980092e0 con 0x7f00a0134120 2023-09-30T22:25:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.950+0000 7f00a7b54700 1 -- 172.21.15.154:0/548677984 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a0133880 con 0x7f00a0134120 2023-09-30T22:25:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.951+0000 7f00967fc700 1 -- 172.21.15.154:0/548677984 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0098012430 con 0x7f00a0134120 2023-09-30T22:25:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.951+0000 7f95b9ffb700 1 -- 172.21.15.154:0/2753658337 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95b400cd20 con 0x7f95c41350d0 2023-09-30T22:25:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.951+0000 7f95b9ffb700 1 -- 172.21.15.154:0/2753658337 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f95b403ff90 con 0x7f95c41350d0 2023-09-30T22:25:50.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.951+0000 7f00967fc700 1 -- 172.21.15.154:0/548677984 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0098012a60 con 0x7f00a0134120 2023-09-30T22:25:50.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.953+0000 7f00a7b54700 1 -- 172.21.15.154:0/548677984 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a004f2a0 con 0x7f00a0134120 2023-09-30T22:25:50.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.956+0000 7f95b9ffb700 1 -- 172.21.15.154:0/2753658337 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95b401a360 con 0x7f95c41350d0 2023-09-30T22:25:50.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:50.958+0000 7f00967fc700 1 -- 172.21.15.154:0/548677984 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0098017070 con 0x7f00a0134120 2023-09-30T22:25:51.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.079+0000 7f7e081bc700 1 -- 172.21.15.154:0/1065457746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7e00072480 con 0x7f7e00135f80 2023-09-30T22:25:51.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.080+0000 7f7df67fc700 1 -- 172.21.15.154:0/1065457746 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e00072480 con 0x7f7e00135f80 2023-09-30T22:25:51.081 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:51.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.083+0000 7f7e081bc700 1 -- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 msgr2=0x7f7e00070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.083+0000 7f7e081bc700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00070950 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7e000a2600 tx=0x7f7df8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.083+0000 7f7e081bc700 1 -- 172.21.15.154:0/1065457746 shutdown_connections 2023-09-30T22:25:51.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.083+0000 7f7e081bc700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e00135f80 0x7f7e00070950 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.083+0000 7f7e081bc700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e00099e20 0x7f7e0006fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.083+0000 7f7e081bc700 1 --2- 172.21.15.154:0/1065457746 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e00133660 0x7f7e00070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.083+0000 7f7e081bc700 1 -- 172.21.15.154:0/1065457746 >> 172.21.15.154:0/1065457746 conn(0x7f7e000a2980 msgr2=0x7f7e001324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.083+0000 7f7e081bc700 1 -- 172.21.15.154:0/1065457746 shutdown_connections 2023-09-30T22:25:51.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.083+0000 7f7e081bc700 1 -- 172.21.15.154:0/1065457746 wait complete. 2023-09-30T22:25:51.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.116+0000 7f923d357700 1 -- 172.21.15.154:0/2652435007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f923811fa00 con 0x7f9238135f20 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.116+0000 7f921f7fe700 1 -- 172.21.15.154:0/2652435007 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f923001b020 con 0x7f9238135f20 2023-09-30T22:25:51.117 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:51.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.118+0000 7f923d357700 1 -- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238135f20 msgr2=0x7f923811d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.118+0000 7f923d357700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238135f20 0x7f923811d090 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f923809b1e0 tx=0x7f9230009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:51.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.118+0000 7f923d357700 1 -- 172.21.15.154:0/2652435007 shutdown_connections 2023-09-30T22:25:51.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.118+0000 7f923d357700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238135f20 0x7f923811d090 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.118+0000 7f923d357700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f923809d860 0x7f923811c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.118+0000 7f923d357700 1 --2- 172.21.15.154:0/2652435007 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f923809e340 0x7f923811cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.118+0000 7f923d357700 1 -- 172.21.15.154:0/2652435007 >> 172.21.15.154:0/2652435007 conn(0x7f9238099c40 msgr2=0x7f92380a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.118+0000 7f923d357700 1 -- 172.21.15.154:0/2652435007 shutdown_connections 2023-09-30T22:25:51.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.118+0000 7f923d357700 1 -- 172.21.15.154:0/2652435007 wait complete. 2023-09-30T22:25:51.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:51.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.152+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2753658337 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95a4005860 con 0x7f95c41350d0 2023-09-30T22:25:51.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.153+0000 7f95b9ffb700 1 -- 172.21.15.154:0/2753658337 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95b402a090 con 0x7f95c41350d0 2023-09-30T22:25:51.154 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.155+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 msgr2=0x7f95c41cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.155+0000 7f95cb7cb700 1 --2- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c41cd180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f95b400e9e0 tx=0x7f95b400eda0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.155+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2753658337 shutdown_connections 2023-09-30T22:25:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.155+0000 7f95cb7cb700 1 --2- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c413d210 0x7f95c41cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.155+0000 7f95cb7cb700 1 --2- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c406a770 0x7f95c41ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.155+0000 7f95cb7cb700 1 --2- 172.21.15.154:0/2753658337 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95c41350d0 0x7f95c41cd180 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.155+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2753658337 >> 172.21.15.154:0/2753658337 conn(0x7f95c4099c40 msgr2=0x7f95c413d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.155+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2753658337 shutdown_connections 2023-09-30T22:25:51.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.155+0000 7f95cb7cb700 1 -- 172.21.15.154:0/2753658337 wait complete. 2023-09-30T22:25:51.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.163+0000 7f00a7b54700 1 -- 172.21.15.154:0/548677984 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00a0072980 con 0x7f00a0134120 2023-09-30T22:25:51.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.163+0000 7f00967fc700 1 -- 172.21.15.154:0/548677984 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0098034090 con 0x7f00a0134120 2023-09-30T22:25:51.164 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.165+0000 7f00a7b54700 1 -- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 msgr2=0x7f00a01234e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.165+0000 7f00a7b54700 1 --2- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a01234e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0098014000 tx=0x7f0098004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.165+0000 7f00a7b54700 1 -- 172.21.15.154:0/548677984 shutdown_connections 2023-09-30T22:25:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.165+0000 7f00a7b54700 1 --2- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a0134120 0x7f00a01234e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.165+0000 7f00a7b54700 1 --2- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a00a0a70 0x7f00a0122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.165+0000 7f00a7b54700 1 --2- 172.21.15.154:0/548677984 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00a00a1380 0x7f00a0122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:51.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.165+0000 7f00a7b54700 1 -- 172.21.15.154:0/548677984 >> 172.21.15.154:0/548677984 conn(0x7f00a00a6610 msgr2=0x7f00a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.165+0000 7f00a7b54700 1 -- 172.21.15.154:0/548677984 shutdown_connections 2023-09-30T22:25:51.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:51.165+0000 7f00a7b54700 1 -- 172.21.15.154:0/548677984 wait complete. 2023-09-30T22:25:51.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:51.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:52.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:52.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:52.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:52.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.250+0000 7fb3bd6af700 1 Processor -- start 2023-09-30T22:25:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.250+0000 7fb3bd6af700 1 -- start start 2023-09-30T22:25:52.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3bd6af700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3b8131980 0x7fb3b8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3bd6af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809bc70 0x7fb3b809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3bd6af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809c5c0 0x7fb3b8138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3bd6af700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b806eb30 con 0x7fb3b8131980 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3bd6af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80a1640 con 0x7fb3b809c5c0 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3bd6af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80a22d0 con 0x7fb3b809bc70 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3b8131980 0x7fb3b8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3b8131980 0x7fb3b8131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33766/0 (socket says 172.21.15.154:33766) 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b6ffd700 1 -- 172.21.15.154:0/4096759244 learned_addr learned my addr 172.21.15.154:0/4096759244 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b77fe700 1 --2- 172.21.15.154:0/4096759244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809c5c0 0x7fb3b8138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b67fc700 1 --2- 172.21.15.154:0/4096759244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809bc70 0x7fb3b809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b77fe700 1 -- 172.21.15.154:0/4096759244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809bc70 msgr2=0x7fb3b809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b77fe700 1 --2- 172.21.15.154:0/4096759244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809bc70 0x7fb3b809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b77fe700 1 -- 172.21.15.154:0/4096759244 >> v2:172.21.15.154:3300/0 conn(0x7fb3b8131980 msgr2=0x7fb3b8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b77fe700 1 --2- 172.21.15.154:0/4096759244 >> v2:172.21.15.154:3300/0 conn(0x7fb3b8131980 0x7fb3b8131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.251+0000 7fb3b77fe700 1 -- 172.21.15.154:0/4096759244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8131550 con 0x7fb3b809c5c0 2023-09-30T22:25:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.252+0000 7fb3b77fe700 1 --2- 172.21.15.154:0/4096759244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809c5c0 0x7fb3b8138700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009d90 tx=0x7fb3b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9914cc0fe4ac4eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.252+0000 7fb3b5ffb700 1 -- 172.21.15.154:0/4096759244 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000e070 con 0x7fb3b809c5c0 2023-09-30T22:25:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.252+0000 7fb3b5ffb700 1 -- 172.21.15.154:0/4096759244 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b000bb20 con 0x7fb3b809c5c0 2023-09-30T22:25:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.252+0000 7fb3b5ffb700 1 -- 172.21.15.154:0/4096759244 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0012430 con 0x7fb3b809c5c0 2023-09-30T22:25:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.253+0000 7fb3bd6af700 1 -- 172.21.15.154:0/4096759244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809c5c0 msgr2=0x7fb3b8138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.253+0000 7fb3bd6af700 1 --2- 172.21.15.154:0/4096759244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809c5c0 0x7fb3b8138700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009d90 tx=0x7fb3b000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.253+0000 7fb3bd6af700 1 -- 172.21.15.154:0/4096759244 shutdown_connections 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.253+0000 7fb3bd6af700 1 --2- 172.21.15.154:0/4096759244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809c5c0 0x7fb3b8138700 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.253+0000 7fb3bd6af700 1 --2- 172.21.15.154:0/4096759244 >> v2:172.21.15.154:3300/0 conn(0x7fb3b8131980 0x7fb3b8131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.253+0000 7fb3bd6af700 1 --2- 172.21.15.154:0/4096759244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809bc70 0x7fb3b809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.253+0000 7fb3bd6af700 1 -- 172.21.15.154:0/4096759244 >> 172.21.15.154:0/4096759244 conn(0x7fb3b80a2980 msgr2=0x7fb3b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.253+0000 7fb3bd6af700 1 -- 172.21.15.154:0/4096759244 shutdown_connections 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.253+0000 7fb3bd6af700 1 -- 172.21.15.154:0/4096759244 wait complete. 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.254+0000 7fb3bd6af700 1 Processor -- start 2023-09-30T22:25:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3bd6af700 1 -- start start 2023-09-30T22:25:52.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3bd6af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809bc70 0x7fb3b8099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3bd6af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809c5c0 0x7fb3b8099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3bd6af700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8131980 0x7fb3b809a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3bd6af700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b809b6a0 con 0x7fb3b8131980 2023-09-30T22:25:52.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3bd6af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80a1cb0 con 0x7fb3b809bc70 2023-09-30T22:25:52.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3bd6af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b812e7d0 con 0x7fb3b809c5c0 2023-09-30T22:25:52.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3b77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8131980 0x7fb3b809a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3b77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8131980 0x7fb3b809a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33776/0 (socket says 172.21.15.154:33776) 2023-09-30T22:25:52.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3b77fe700 1 -- 172.21.15.154:0/3067499125 learned_addr learned my addr 172.21.15.154:0/3067499125 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:52.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3b6ffd700 1 --2- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809bc70 0x7fb3b8099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.255+0000 7fb3b67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809c5c0 0x7fb3b8099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb3b77fe700 1 -- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809c5c0 msgr2=0x7fb3b8099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb3b77fe700 1 --2- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809c5c0 0x7fb3b8099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb3b77fe700 1 -- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809bc70 msgr2=0x7fb3b8099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb3b77fe700 1 --2- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809bc70 0x7fb3b8099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb3b77fe700 1 -- 172.21.15.154:0/3067499125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b0009a70 con 0x7fb3b8131980 2023-09-30T22:25:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb3b6ffd700 1 --2- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809bc70 0x7fb3b8099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb3b77fe700 1 --2- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8131980 0x7fb3b809a510 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000b680 tx=0x7fb3b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb39f7fe700 1 -- 172.21.15.154:0/3067499125 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0012430 con 0x7fb3b8131980 2023-09-30T22:25:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb39f7fe700 1 -- 172.21.15.154:0/3067499125 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b0020070 con 0x7fb3b8131980 2023-09-30T22:25:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb39f7fe700 1 -- 172.21.15.154:0/3067499125 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0004280 con 0x7fb3b8131980 2023-09-30T22:25:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb3bd6af700 1 -- 172.21.15.154:0/3067499125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b812eb90 con 0x7fb3b8131980 2023-09-30T22:25:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.256+0000 7fb3bd6af700 1 -- 172.21.15.154:0/3067499125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b81234a0 con 0x7fb3b8131980 2023-09-30T22:25:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.257+0000 7fb3bd6af700 1 -- 172.21.15.154:0/3067499125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b81220c0 con 0x7fb3b8131980 2023-09-30T22:25:52.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.258+0000 7fb39f7fe700 1 -- 172.21.15.154:0/3067499125 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3b00043e0 con 0x7fb3b8131980 2023-09-30T22:25:52.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.258+0000 7fb39f7fe700 1 -- 172.21.15.154:0/3067499125 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3b0022070 con 0x7fb3b8131980 2023-09-30T22:25:52.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.266+0000 7fb39f7fe700 1 -- 172.21.15.154:0/3067499125 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3b0004690 con 0x7fb3b8131980 2023-09-30T22:25:52.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.291+0000 7f53643e5700 1 Processor -- start 2023-09-30T22:25:52.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.291+0000 7f53643e5700 1 -- start start 2023-09-30T22:25:52.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.292+0000 7f53643e5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f535c133a70 0x7f535c133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.292+0000 7f53643e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c0a08e0 0x7f535c0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.292+0000 7f53643e5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c133640 con 0x7f535c0a1290 2023-09-30T22:25:52.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.292+0000 7f53643e5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c0a1d50 con 0x7f535c133a70 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.292+0000 7f53643e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0a1710 con 0x7f535c0a08e0 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5362181700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f535c133a70 0x7f535c133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5362181700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f535c133a70 0x7f535c133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33780/0 (socket says 172.21.15.154:33780) 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5362181700 1 -- 172.21.15.154:0/1943729306 learned_addr learned my addr 172.21.15.154:0/1943729306 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5361980700 1 --2- 172.21.15.154:0/1943729306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c0a08e0 0x7f535c0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5362181700 1 -- 172.21.15.154:0/1943729306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c0a08e0 msgr2=0x7f535c0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5362181700 1 --2- 172.21.15.154:0/1943729306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c0a08e0 0x7f535c0a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5362181700 1 -- 172.21.15.154:0/1943729306 >> v1:172.21.15.154:6789/0 conn(0x7f535c0a1290 legacy=0x7f535c13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5362181700 1 -- 172.21.15.154:0/1943729306 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c09b620 con 0x7f535c133a70 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5361980700 1 --2- 172.21.15.154:0/1943729306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c0a08e0 0x7f535c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f5362181700 1 --2- 172.21.15.154:0/1943729306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c133a70 0x7f535c133e40 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5358006fd0 tx=0x7f5358009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efec1bb9ac73b85b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f536117f700 1 -- 172.21.15.154:0/1943729306 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358005e30 con 0x7f535c133a70 2023-09-30T22:25:52.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f536117f700 1 -- 172.21.15.154:0/1943729306 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5358004030 con 0x7f535c133a70 2023-09-30T22:25:52.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.293+0000 7f536117f700 1 -- 172.21.15.154:0/1943729306 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580043e0 con 0x7f535c133a70 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.294+0000 7f53643e5700 1 -- 172.21.15.154:0/1943729306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c133a70 msgr2=0x7f535c133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.294+0000 7f53643e5700 1 --2- 172.21.15.154:0/1943729306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c133a70 0x7f535c133e40 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5358006fd0 tx=0x7f5358009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.294+0000 7f53643e5700 1 -- 172.21.15.154:0/1943729306 shutdown_connections 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.294+0000 7f53643e5700 1 --2- 172.21.15.154:0/1943729306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c133a70 0x7f535c133e40 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.294+0000 7f53643e5700 1 --2- 172.21.15.154:0/1943729306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c0a08e0 0x7f535c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.294+0000 7f53643e5700 1 -- 172.21.15.154:0/1943729306 >> 172.21.15.154:0/1943729306 conn(0x7f535c0a2980 msgr2=0x7f535c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.295+0000 7f53643e5700 1 -- 172.21.15.154:0/1943729306 shutdown_connections 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.295+0000 7f53643e5700 1 -- 172.21.15.154:0/1943729306 wait complete. 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.296+0000 7f53643e5700 1 Processor -- start 2023-09-30T22:25:52.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.296+0000 7f53643e5700 1 -- start start 2023-09-30T22:25:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f53643e5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c0a08e0 0x7f535c11a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f53643e5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f535c0a1290 0x7f535c11add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f53643e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c133a70 0x7f535c11b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f53643e5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c11c4a0 con 0x7f535c0a08e0 2023-09-30T22:25:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f53643e5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c11d6f0 con 0x7f535c0a1290 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f53643e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f535c11ca80 con 0x7f535c133a70 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362181700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c0a08e0 0x7f535c11a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362181700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c0a08e0 0x7f535c11a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33788/0 (socket says 172.21.15.154:33788) 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362181700 1 -- 172.21.15.154:0/2022035859 learned_addr learned my addr 172.21.15.154:0/2022035859 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362982700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c133a70 0x7f535c11b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5361980700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f535c0a1290 0x7f535c11add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362181700 1 -- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c133a70 msgr2=0x7f535c11b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362181700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c133a70 0x7f535c11b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362181700 1 -- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f535c0a1290 msgr2=0x7f535c11add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362181700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f535c0a1290 0x7f535c11add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362181700 1 -- 172.21.15.154:0/2022035859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0094a0 con 0x7f535c0a08e0 2023-09-30T22:25:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362982700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c133a70 0x7f535c11b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.297+0000 7f5362181700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c0a08e0 0x7f535c11a890 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5358009c10 tx=0x7f5358004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.298+0000 7f5352ffd700 1 -- 172.21.15.154:0/2022035859 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535801c620 con 0x7f535c0a08e0 2023-09-30T22:25:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.298+0000 7f5352ffd700 1 -- 172.21.15.154:0/2022035859 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535801c7a0 con 0x7f535c0a08e0 2023-09-30T22:25:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.298+0000 7f5352ffd700 1 -- 172.21.15.154:0/2022035859 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535801cb50 con 0x7f535c0a08e0 2023-09-30T22:25:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.298+0000 7f53643e5700 1 -- 172.21.15.154:0/2022035859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5358009500 con 0x7f535c0a08e0 2023-09-30T22:25:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.298+0000 7f53643e5700 1 -- 172.21.15.154:0/2022035859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c131f70 con 0x7f535c0a08e0 2023-09-30T22:25:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.299+0000 7f5352ffd700 1 -- 172.21.15.154:0/2022035859 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f535801ccb0 con 0x7f535c0a08e0 2023-09-30T22:25:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.299+0000 7f53643e5700 1 -- 172.21.15.154:0/2022035859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c09e870 con 0x7f535c0a08e0 2023-09-30T22:25:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.299+0000 7f5352ffd700 1 -- 172.21.15.154:0/2022035859 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5358040900 con 0x7f535c0a08e0 2023-09-30T22:25:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.304+0000 7f5352ffd700 1 -- 172.21.15.154:0/2022035859 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5358011420 con 0x7f535c0a08e0 2023-09-30T22:25:52.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.326+0000 7fdcad808700 1 Processor -- start 2023-09-30T22:25:52.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.326+0000 7fdcad808700 1 -- start start 2023-09-30T22:25:52.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdcad808700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdca8131e50 0x7fdca809c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdcad808700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca8137770 0x7fdca8139b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdcad808700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca80a23a0 con 0x7fdca8131a80 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdcad808700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca8131440 con 0x7fdca8131e50 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdcad808700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca806eaa0 con 0x7fdca8137770 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdca67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdca8131e50 0x7fdca809c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdca67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdca8131e50 0x7fdca809c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33792/0 (socket says 172.21.15.154:33792) 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdca67fc700 1 -- 172.21.15.154:0/2936228501 learned_addr learned my addr 172.21.15.154:0/2936228501 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdca6ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdca8131a80 0x7fdca809bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34650/0 (socket says 172.21.15.154:34650) 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdca67fc700 1 -- 172.21.15.154:0/2936228501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca8137770 msgr2=0x7fdca8139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdca67fc700 1 --2- 172.21.15.154:0/2936228501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca8137770 0x7fdca8139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdca67fc700 1 -- 172.21.15.154:0/2936228501 >> v1:172.21.15.154:6789/0 conn(0x7fdca8131a80 legacy=0x7fdca809bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.327+0000 7fdca67fc700 1 -- 172.21.15.154:0/2936228501 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80a25d0 con 0x7fdca8131e50 2023-09-30T22:25:52.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.328+0000 7fdca67fc700 1 --2- 172.21.15.154:0/2936228501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca8131e50 0x7fdca809c380 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0098f0 tx=0x7fdc9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a032c14b4797f231 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.328+0000 7fdca5ffb700 1 -- 172.21.15.154:0/2936228501 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00b8a0 con 0x7fdca8131e50 2023-09-30T22:25:52.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.328+0000 7fdca5ffb700 1 -- 172.21.15.154:0/2936228501 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00ba00 con 0x7fdca8131e50 2023-09-30T22:25:52.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.328+0000 7fdca5ffb700 1 -- 172.21.15.154:0/2936228501 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00bd90 con 0x7fdca8131e50 2023-09-30T22:25:52.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.328+0000 7f4d0774f700 1 Processor -- start 2023-09-30T22:25:52.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7fdcad808700 1 -- 172.21.15.154:0/2936228501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca8131e50 msgr2=0x7fdca809c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7fdcad808700 1 --2- 172.21.15.154:0/2936228501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca8131e50 0x7fdca809c380 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0098f0 tx=0x7fdc9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:52.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d0774f700 1 -- start start 2023-09-30T22:25:52.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7fdcad808700 1 -- 172.21.15.154:0/2936228501 shutdown_connections 2023-09-30T22:25:52.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7fdcad808700 1 --2- 172.21.15.154:0/2936228501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca8137770 0x7fdca8139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7fdcad808700 1 --2- 172.21.15.154:0/2936228501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca8131e50 0x7fdca809c380 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7fdcad808700 1 -- 172.21.15.154:0/2936228501 >> 172.21.15.154:0/2936228501 conn(0x7fdca80a2980 msgr2=0x7fdca80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7fdcad808700 1 -- 172.21.15.154:0/2936228501 shutdown_connections 2023-09-30T22:25:52.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7fdcad808700 1 -- 172.21.15.154:0/2936228501 wait complete. 2023-09-30T22:25:52.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d0774f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d000a1510 0x7f4d001351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d0774f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d001356e0 0x7f4d00137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d0774f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d000a1e70 con 0x7f4d000a0a30 2023-09-30T22:25:52.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d0774f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0009a720 con 0x7f4d001356e0 2023-09-30T22:25:52.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d0774f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0009b300 con 0x7f4d000a1510 2023-09-30T22:25:52.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d05cec700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d001356e0 0x7f4d00137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d05cec700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d001356e0 0x7f4d00137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33804/0 (socket says 172.21.15.154:33804) 2023-09-30T22:25:52.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d054eb700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4d000a0a30 0x7f4d000a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34662/0 (socket says 172.21.15.154:34662) 2023-09-30T22:25:52.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.329+0000 7f4d05cec700 1 -- 172.21.15.154:0/3628003779 learned_addr learned my addr 172.21.15.154:0/3628003779 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:52.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7f4d05cec700 1 -- 172.21.15.154:0/3628003779 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d000a1510 msgr2=0x7f4d001351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:52.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7f4d05cec700 1 --2- 172.21.15.154:0/3628003779 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d000a1510 0x7f4d001351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7f4d05cec700 1 -- 172.21.15.154:0/3628003779 >> v1:172.21.15.154:6789/0 conn(0x7f4d000a0a30 legacy=0x7f4d000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7f4d05cec700 1 -- 172.21.15.154:0/3628003779 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0009abc0 con 0x7f4d001356e0 2023-09-30T22:25:52.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7f4d05cec700 1 --2- 172.21.15.154:0/3628003779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001356e0 0x7f4d00137ac0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009e50 tx=0x7f4cf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02bc23eb10fd9a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7fdcad808700 1 Processor -- start 2023-09-30T22:25:52.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7f4cf7fff700 1 -- 172.21.15.154:0/3628003779 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800e070 con 0x7f4d001356e0 2023-09-30T22:25:52.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7f4cf7fff700 1 -- 172.21.15.154:0/3628003779 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf800b9c0 con 0x7f4d001356e0 2023-09-30T22:25:52.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7f4cf7fff700 1 -- 172.21.15.154:0/3628003779 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800bd70 con 0x7f4d001356e0 2023-09-30T22:25:52.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.330+0000 7fdcad808700 1 -- start start 2023-09-30T22:25:52.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdcad808700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca8131a80 0x7fdca8118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdcad808700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdca8131e50 0x7fdca8119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdcad808700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca8137770 0x7fdca8119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdcad808700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca811c240 con 0x7fdca8137770 2023-09-30T22:25:52.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdcad808700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca811b610 con 0x7fdca8131a80 2023-09-30T22:25:52.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdcad808700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80a1cf0 con 0x7fdca8131e50 2023-09-30T22:25:52.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7f4d0774f700 1 -- 172.21.15.154:0/3628003779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001356e0 msgr2=0x7f4d00137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7f4d0774f700 1 --2- 172.21.15.154:0/3628003779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001356e0 0x7f4d00137ac0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009e50 tx=0x7f4cf800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:52.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7f4d0774f700 1 -- 172.21.15.154:0/3628003779 shutdown_connections 2023-09-30T22:25:52.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7f4d0774f700 1 --2- 172.21.15.154:0/3628003779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d001356e0 0x7f4d00137ac0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7f4d0774f700 1 --2- 172.21.15.154:0/3628003779 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d000a1510 0x7f4d001351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7f4d0774f700 1 -- 172.21.15.154:0/3628003779 >> 172.21.15.154:0/3628003779 conn(0x7f4d000a2980 msgr2=0x7f4d000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7f4d0774f700 1 -- 172.21.15.154:0/3628003779 shutdown_connections 2023-09-30T22:25:52.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7f4d0774f700 1 -- 172.21.15.154:0/3628003779 wait complete. 2023-09-30T22:25:52.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdca8131e50 0x7fdca8119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdca8131e50 0x7fdca8119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35702/0 (socket says 172.21.15.154:35702) 2023-09-30T22:25:52.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca67fc700 1 -- 172.21.15.154:0/3202975868 learned_addr learned my addr 172.21.15.154:0/3202975868 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:52.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca6ffd700 1 --2- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca8131a80 0x7fdca8118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca77fe700 1 --2- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca8137770 0x7fdca8119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca67fc700 1 -- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca8131a80 msgr2=0x7fdca8118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca67fc700 1 --2- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca8131a80 0x7fdca8118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca67fc700 1 -- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca8137770 msgr2=0x7fdca8119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca67fc700 1 --2- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca8137770 0x7fdca8119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.331+0000 7fdca67fc700 1 -- 172.21.15.154:0/3202975868 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c009550 con 0x7fdca8131e50 2023-09-30T22:25:52.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.332+0000 7fdca67fc700 1 --2- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdca8131e50 0x7fdca8119330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009c40 tx=0x7fdc9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.332+0000 7f4d0774f700 1 Processor -- start 2023-09-30T22:25:52.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7fdc8ffff700 1 -- 172.21.15.154:0/3202975868 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c004510 con 0x7fdca8131e50 2023-09-30T22:25:52.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.332+0000 7f4d0774f700 1 -- start start 2023-09-30T22:25:52.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d0774f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d000a0a30 0x7f4d00135ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d0774f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d000a1510 0x7f4d00135ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d0774f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d001356e0 0x7f4d00136530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d0774f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d001394d0 con 0x7f4d000a1510 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d0774f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d00136a70 con 0x7f4d000a0a30 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d0774f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d00137240 con 0x7f4d001356e0 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d05cec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d001356e0 0x7f4d00136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d054eb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d000a0a30 0x7f4d00135ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d05cec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d001356e0 0x7f4d00136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35710/0 (socket says 172.21.15.154:35710) 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d04cea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d000a1510 0x7f4d00135ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d05cec700 1 -- 172.21.15.154:0/95422533 learned_addr learned my addr 172.21.15.154:0/95422533 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d05cec700 1 -- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d000a0a30 msgr2=0x7f4d00135ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d05cec700 1 --2- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d000a0a30 0x7f4d00135ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d05cec700 1 -- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d000a1510 msgr2=0x7f4d00135ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d05cec700 1 --2- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d000a1510 0x7f4d00135ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d05cec700 1 -- 172.21.15.154:0/95422533 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8009b30 con 0x7f4d001356e0 2023-09-30T22:25:52.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7f4d05cec700 1 --2- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d001356e0 0x7f4d00136530 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4d00099eb0 tx=0x7f4cf8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:52.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7fdc8ffff700 1 -- 172.21.15.154:0/3202975868 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0036a0 con 0x7fdca8131e50 2023-09-30T22:25:52.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7fdc8ffff700 1 -- 172.21.15.154:0/3202975868 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c003a10 con 0x7fdca8131e50 2023-09-30T22:25:52.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.333+0000 7fdcad808700 1 -- 172.21.15.154:0/3202975868 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca806ee30 con 0x7fdca8131e50 2023-09-30T22:25:52.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.334+0000 7f4cf5ffb700 1 -- 172.21.15.154:0/95422533 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8004800 con 0x7f4d001356e0 2023-09-30T22:25:52.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.334+0000 7f4cf5ffb700 1 -- 172.21.15.154:0/95422533 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8004960 con 0x7f4d001356e0 2023-09-30T22:25:52.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.334+0000 7f4cf5ffb700 1 -- 172.21.15.154:0/95422533 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf801c680 con 0x7f4d001356e0 2023-09-30T22:25:52.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.334+0000 7f4d0774f700 1 -- 172.21.15.154:0/95422533 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d001388f0 con 0x7f4d001356e0 2023-09-30T22:25:52.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.334+0000 7fdcad808700 1 -- 172.21.15.154:0/3202975868 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca811ba30 con 0x7fdca8131e50 2023-09-30T22:25:52.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.334+0000 7fdc8ffff700 1 -- 172.21.15.154:0/3202975868 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc9c021070 con 0x7fdca8131e50 2023-09-30T22:25:52.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.334+0000 7fdcad808700 1 -- 172.21.15.154:0/3202975868 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca804f2a0 con 0x7fdca8131e50 2023-09-30T22:25:52.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.335+0000 7fdc8ffff700 1 -- 172.21.15.154:0/3202975868 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdc9c0409f0 con 0x7fdca8131e50 2023-09-30T22:25:52.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.335+0000 7f4d0774f700 1 -- 172.21.15.154:0/95422533 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0009fc10 con 0x7f4d001356e0 2023-09-30T22:25:52.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.336+0000 7f4d0774f700 1 -- 172.21.15.154:0/95422533 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d00138290 con 0x7f4d001356e0 2023-09-30T22:25:52.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.340+0000 7fdc8ffff700 1 -- 172.21.15.154:0/3202975868 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc9c019730 con 0x7fdca8131e50 2023-09-30T22:25:52.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.340+0000 7f4cf5ffb700 1 -- 172.21.15.154:0/95422533 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cf801c7e0 con 0x7f4d001356e0 2023-09-30T22:25:52.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.340+0000 7f4cf5ffb700 1 -- 172.21.15.154:0/95422533 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4cf8041930 con 0x7f4d001356e0 2023-09-30T22:25:52.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.344+0000 7f4cf5ffb700 1 -- 172.21.15.154:0/95422533 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cf801ca90 con 0x7f4d001356e0 2023-09-30T22:25:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.487+0000 7fb3bd6af700 1 -- 172.21.15.154:0/3067499125 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3b804f2a0 con 0x7fb3b8131980 2023-09-30T22:25:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.488+0000 7fb39f7fe700 1 -- 172.21.15.154:0/3067499125 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3b001c400 con 0x7fb3b8131980 2023-09-30T22:25:52.488 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.491+0000 7fb3bd6af700 1 -- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8131980 msgr2=0x7fb3b809a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.491+0000 7fb3bd6af700 1 --2- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8131980 0x7fb3b809a510 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000b680 tx=0x7fb3b0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.491+0000 7fb3bd6af700 1 -- 172.21.15.154:0/3067499125 shutdown_connections 2023-09-30T22:25:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.491+0000 7fb3bd6af700 1 --2- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3b8131980 0x7fb3b809a510 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.491+0000 7fb3bd6af700 1 --2- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3b809bc70 0x7fb3b8099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.491+0000 7fb3bd6af700 1 --2- 172.21.15.154:0/3067499125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3b809c5c0 0x7fb3b8099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.491+0000 7fb3bd6af700 1 -- 172.21.15.154:0/3067499125 >> 172.21.15.154:0/3067499125 conn(0x7fb3b80a2980 msgr2=0x7fb3b806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.491+0000 7fb3bd6af700 1 -- 172.21.15.154:0/3067499125 shutdown_connections 2023-09-30T22:25:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.491+0000 7fb3bd6af700 1 -- 172.21.15.154:0/3067499125 wait complete. 2023-09-30T22:25:52.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:52.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.512+0000 7f53643e5700 1 -- 172.21.15.154:0/2022035859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f535c04f2a0 con 0x7f535c0a08e0 2023-09-30T22:25:52.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.512+0000 7f5352ffd700 1 -- 172.21.15.154:0/2022035859 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5358016070 con 0x7f535c0a08e0 2023-09-30T22:25:52.513 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:52.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.514+0000 7f53643e5700 1 -- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c0a08e0 msgr2=0x7f535c11a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.514+0000 7f53643e5700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c0a08e0 0x7f535c11a890 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5358009c10 tx=0x7f5358004750 comp rx=0 tx=0).stop 2023-09-30T22:25:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.514+0000 7f53643e5700 1 -- 172.21.15.154:0/2022035859 shutdown_connections 2023-09-30T22:25:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.514+0000 7f53643e5700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f535c133a70 0x7f535c11b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.514+0000 7f53643e5700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f535c0a08e0 0x7f535c11a890 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.514+0000 7f53643e5700 1 --2- 172.21.15.154:0/2022035859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f535c0a1290 0x7f535c11add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.514+0000 7f53643e5700 1 -- 172.21.15.154:0/2022035859 >> 172.21.15.154:0/2022035859 conn(0x7f535c0a2980 msgr2=0x7f535c12f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.514+0000 7f53643e5700 1 -- 172.21.15.154:0/2022035859 shutdown_connections 2023-09-30T22:25:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.514+0000 7f53643e5700 1 -- 172.21.15.154:0/2022035859 wait complete. 2023-09-30T22:25:52.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:52.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.534+0000 7fdcad808700 1 -- 172.21.15.154:0/3202975868 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdca811b9d0 con 0x7fdca8131e50 2023-09-30T22:25:52.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.534+0000 7fdc8ffff700 1 -- 172.21.15.154:0/3202975868 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc9c01a410 con 0x7fdca8131e50 2023-09-30T22:25:52.535 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:52.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.536+0000 7fdcad808700 1 -- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdca8131e50 msgr2=0x7fdca8119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.536+0000 7fdcad808700 1 --2- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdca8131e50 0x7fdca8119330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009c40 tx=0x7fdc9c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:52.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.536+0000 7fdcad808700 1 -- 172.21.15.154:0/3202975868 shutdown_connections 2023-09-30T22:25:52.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.536+0000 7fdcad808700 1 --2- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca8137770 0x7fdca8119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.536+0000 7fdcad808700 1 --2- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca8131a80 0x7fdca8118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.536+0000 7fdcad808700 1 --2- 172.21.15.154:0/3202975868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdca8131e50 0x7fdca8119330 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.536+0000 7fdcad808700 1 -- 172.21.15.154:0/3202975868 >> 172.21.15.154:0/3202975868 conn(0x7fdca80a2980 msgr2=0x7fdca8071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.536+0000 7fdcad808700 1 -- 172.21.15.154:0/3202975868 shutdown_connections 2023-09-30T22:25:52.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.536+0000 7fdcad808700 1 -- 172.21.15.154:0/3202975868 wait complete. 2023-09-30T22:25:52.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:52.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.555+0000 7f4d0774f700 1 -- 172.21.15.154:0/95422533 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d0004f2a0 con 0x7f4d001356e0 2023-09-30T22:25:52.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.555+0000 7f4cf5ffb700 1 -- 172.21.15.154:0/95422533 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cf8033030 con 0x7f4d001356e0 2023-09-30T22:25:52.556 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:52.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.557+0000 7f4d0774f700 1 -- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d001356e0 msgr2=0x7f4d00136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:52.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.557+0000 7f4d0774f700 1 --2- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d001356e0 0x7f4d00136530 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4d00099eb0 tx=0x7f4cf8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.557+0000 7f4d0774f700 1 -- 172.21.15.154:0/95422533 shutdown_connections 2023-09-30T22:25:52.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.557+0000 7f4d0774f700 1 --2- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d001356e0 0x7f4d00136530 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.557+0000 7f4d0774f700 1 --2- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d000a0a30 0x7f4d00135ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.557+0000 7f4d0774f700 1 --2- 172.21.15.154:0/95422533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d000a1510 0x7f4d00135ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:52.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.557+0000 7f4d0774f700 1 -- 172.21.15.154:0/95422533 >> 172.21.15.154:0/95422533 conn(0x7f4d000a2980 msgr2=0x7f4d0013adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:52.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.557+0000 7f4d0774f700 1 -- 172.21.15.154:0/95422533 shutdown_connections 2023-09-30T22:25:52.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:52.557+0000 7f4d0774f700 1 -- 172.21.15.154:0/95422533 wait complete. 2023-09-30T22:25:52.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:53.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:53.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:53.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:53.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:53.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.651+0000 7ff92a2fd700 1 Processor -- start 2023-09-30T22:25:53.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.651+0000 7ff92a2fd700 1 -- start start 2023-09-30T22:25:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff92a2fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff92a2fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff924130a60 0x7ff924138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff92a2fd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff924099a60 con 0x7ff92409a730 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff92a2fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92409bf50 con 0x7ff924099e20 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff92a2fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff92409b230 con 0x7ff924130a60 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff923fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff923fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54770/0 (socket says 172.21.15.154:54770) 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff923fff700 1 -- 172.21.15.154:0/3506872985 learned_addr learned my addr 172.21.15.154:0/3506872985 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff9237fe700 1 --1- 172.21.15.154:0/3506872985 >> v1:172.21.15.154:6789/0 conn(0x7ff92409a730 0x7ff924130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34678/0 (socket says 172.21.15.154:34678) 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff92889a700 1 --2- 172.21.15.154:0/3506872985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff924130a60 0x7ff924138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff922ffd700 1 -- 172.21.15.154:0/3506872985 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556435505 0 0) 0x7ff924099a60 con 0x7ff92409a730 2023-09-30T22:25:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff923fff700 1 -- 172.21.15.154:0/3506872985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff924130a60 msgr2=0x7ff924138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff923fff700 1 --2- 172.21.15.154:0/3506872985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff924130a60 0x7ff924138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff923fff700 1 -- 172.21.15.154:0/3506872985 >> v1:172.21.15.154:6789/0 conn(0x7ff92409a730 legacy=0x7ff924130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.652+0000 7ff923fff700 1 -- 172.21.15.154:0/3506872985 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92409bb90 con 0x7ff924099e20 2023-09-30T22:25:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.653+0000 7ff923fff700 1 --2- 172.21.15.154:0/3506872985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92409a1f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff914009920 tx=0x7ff914009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf4d381dd00c6417 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.653+0000 7ff922ffd700 1 -- 172.21.15.154:0/3506872985 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914005e30 con 0x7ff924099e20 2023-09-30T22:25:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.653+0000 7ff922ffd700 1 -- 172.21.15.154:0/3506872985 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914009e70 con 0x7ff924099e20 2023-09-30T22:25:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.653+0000 7ff922ffd700 1 -- 172.21.15.154:0/3506872985 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914004250 con 0x7ff924099e20 2023-09-30T22:25:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.653+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3506872985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 msgr2=0x7ff92409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.653+0000 7ff92a2fd700 1 --2- 172.21.15.154:0/3506872985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92409a1f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff914009920 tx=0x7ff914009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.653+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3506872985 shutdown_connections 2023-09-30T22:25:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.654+0000 7ff92a2fd700 1 --2- 172.21.15.154:0/3506872985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff924130a60 0x7ff924138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.654+0000 7ff92a2fd700 1 --2- 172.21.15.154:0/3506872985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92409a1f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.654+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3506872985 >> 172.21.15.154:0/3506872985 conn(0x7ff9240a2980 msgr2=0x7ff9240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.654+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3506872985 shutdown_connections 2023-09-30T22:25:53.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.654+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3506872985 wait complete. 2023-09-30T22:25:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.655+0000 7ff92a2fd700 1 Processor -- start 2023-09-30T22:25:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.655+0000 7ff92a2fd700 1 -- start start 2023-09-30T22:25:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff92a2fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92411a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff92a2fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff92409a730 0x7ff92411ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff92a2fd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff924130a60 0x7ff92411b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff92a2fd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92411dcc0 con 0x7ff924130a60 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff92a2fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9240a1170 con 0x7ff924099e20 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff92a2fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff92409b470 con 0x7ff92409a730 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff923fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92411a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff923fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92411a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54776/0 (socket says 172.21.15.154:54776) 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff923fff700 1 -- 172.21.15.154:0/3662665732 learned_addr learned my addr 172.21.15.154:0/3662665732 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff9237fe700 1 --2- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff92409a730 0x7ff92411ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff92889a700 1 --2- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff924130a60 0x7ff92411b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff923fff700 1 -- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff92409a730 msgr2=0x7ff92411ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff923fff700 1 --2- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff92409a730 0x7ff92411ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff923fff700 1 -- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff924130a60 msgr2=0x7ff92411b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.656+0000 7ff923fff700 1 --2- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff924130a60 0x7ff92411b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.657+0000 7ff923fff700 1 -- 172.21.15.154:0/3662665732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff914009500 con 0x7ff924099e20 2023-09-30T22:25:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.657+0000 7ff923fff700 1 --2- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92411a7c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff914000c00 tx=0x7ff914004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.657+0000 7ff920ff9700 1 -- 172.21.15.154:0/3662665732 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914003bb0 con 0x7ff924099e20 2023-09-30T22:25:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.657+0000 7ff920ff9700 1 -- 172.21.15.154:0/3662665732 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914003d30 con 0x7ff924099e20 2023-09-30T22:25:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.657+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3662665732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92411d0e0 con 0x7ff924099e20 2023-09-30T22:25:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.657+0000 7ff920ff9700 1 -- 172.21.15.154:0/3662665732 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914003ea0 con 0x7ff924099e20 2023-09-30T22:25:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.657+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3662665732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92411c4b0 con 0x7ff924099e20 2023-09-30T22:25:53.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.658+0000 7ff920ff9700 1 -- 172.21.15.154:0/3662665732 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff91400b850 con 0x7ff924099e20 2023-09-30T22:25:53.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.658+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3662665732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff924072480 con 0x7ff924099e20 2023-09-30T22:25:53.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.658+0000 7ff920ff9700 1 -- 172.21.15.154:0/3662665732 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff914040830 con 0x7ff924099e20 2023-09-30T22:25:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.667+0000 7ff920ff9700 1 -- 172.21.15.154:0/3662665732 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff924072480 con 0x7ff924099e20 2023-09-30T22:25:53.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.688+0000 7f8a31dad700 1 Processor -- start 2023-09-30T22:25:53.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.688+0000 7f8a31dad700 1 -- start start 2023-09-30T22:25:53.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.689+0000 7f8a31dad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c06a770 0x7f8a2c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.689+0000 7f8a31dad700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a2c136cb0 0x7f8a2c139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.689+0000 7f8a31dad700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c06e900 con 0x7f8a2c09dec0 2023-09-30T22:25:53.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.689+0000 7f8a31dad700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c09d180 con 0x7f8a2c136cb0 2023-09-30T22:25:53.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.689+0000 7f8a31dad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c09e780 con 0x7f8a2c06a770 2023-09-30T22:25:53.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.689+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c06a770 0x7f8a2c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.689+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c06a770 0x7f8a2c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35748/0 (socket says 172.21.15.154:35748) 2023-09-30T22:25:53.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.689+0000 7f8a2b7fe700 1 -- 172.21.15.154:0/3552847369 learned_addr learned my addr 172.21.15.154:0/3552847369 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:53.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.689+0000 7f8a2bfff700 1 --2- 172.21.15.154:0/3552847369 >> v2:172.21.15.154:3300/0 conn(0x7f8a2c136cb0 0x7f8a2c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.690+0000 7f8a2b7fe700 1 -- 172.21.15.154:0/3552847369 >> v2:172.21.15.154:3300/0 conn(0x7f8a2c136cb0 msgr2=0x7f8a2c139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.690+0000 7f8a2b7fe700 1 --2- 172.21.15.154:0/3552847369 >> v2:172.21.15.154:3300/0 conn(0x7f8a2c136cb0 0x7f8a2c139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.690+0000 7f8a2b7fe700 1 -- 172.21.15.154:0/3552847369 >> v1:172.21.15.154:6789/0 conn(0x7f8a2c09dec0 legacy=0x7f8a2c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.690+0000 7f8a2b7fe700 1 -- 172.21.15.154:0/3552847369 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c09d3c0 con 0x7f8a2c06a770 2023-09-30T22:25:53.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.690+0000 7f8a2b7fe700 1 --2- 172.21.15.154:0/3552847369 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c06a770 0x7f8a2c06ab40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0098f0 tx=0x7f8a1c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4118915de37e26e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.690+0000 7f8a2a7fc700 1 -- 172.21.15.154:0/3552847369 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00b8a0 con 0x7f8a2c06a770 2023-09-30T22:25:53.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.690+0000 7f8a2a7fc700 1 -- 172.21.15.154:0/3552847369 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00ba00 con 0x7f8a2c06a770 2023-09-30T22:25:53.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.690+0000 7f8a2a7fc700 1 -- 172.21.15.154:0/3552847369 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00bd90 con 0x7f8a2c06a770 2023-09-30T22:25:53.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.691+0000 7f8a31dad700 1 -- 172.21.15.154:0/3552847369 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c06a770 msgr2=0x7f8a2c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.691+0000 7f8a31dad700 1 --2- 172.21.15.154:0/3552847369 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c06a770 0x7f8a2c06ab40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0098f0 tx=0x7f8a1c009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:53.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.691+0000 7f8a31dad700 1 -- 172.21.15.154:0/3552847369 shutdown_connections 2023-09-30T22:25:53.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.691+0000 7f8a31dad700 1 --2- 172.21.15.154:0/3552847369 >> v2:172.21.15.154:3300/0 conn(0x7f8a2c136cb0 0x7f8a2c139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.691+0000 7f8a31dad700 1 --2- 172.21.15.154:0/3552847369 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c06a770 0x7f8a2c06ab40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.691+0000 7f8a31dad700 1 -- 172.21.15.154:0/3552847369 >> 172.21.15.154:0/3552847369 conn(0x7f8a2c099c40 msgr2=0x7f8a2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.691+0000 7f8a31dad700 1 -- 172.21.15.154:0/3552847369 shutdown_connections 2023-09-30T22:25:53.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.691+0000 7f8a31dad700 1 -- 172.21.15.154:0/3552847369 wait complete. 2023-09-30T22:25:53.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.692+0000 7f8a31dad700 1 Processor -- start 2023-09-30T22:25:53.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.692+0000 7f8a31dad700 1 -- start start 2023-09-30T22:25:53.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.693+0000 7f8a31dad700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2c06a770 0x7f8a2c1319c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.693+0000 7f8a31dad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2c09dec0 0x7f8a2c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.693+0000 7f8a31dad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c136cb0 0x7f8a2c132440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.693+0000 7f8a31dad700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c133dc0 con 0x7f8a2c06a770 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.693+0000 7f8a31dad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c1361d0 con 0x7f8a2c09dec0 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.693+0000 7f8a31dad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c136850 con 0x7f8a2c136cb0 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.693+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2c06a770 0x7f8a2c1319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.693+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2c06a770 0x7f8a2c1319c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33864/0 (socket says 172.21.15.154:33864) 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.693+0000 7f8a2b7fe700 1 -- 172.21.15.154:0/3594423460 learned_addr learned my addr 172.21.15.154:0/3594423460 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a2b7fe700 1 -- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c136cb0 msgr2=0x7f8a2c132440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a2b7fe700 1 --2- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c136cb0 0x7f8a2c132440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a2b7fe700 1 -- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2c09dec0 msgr2=0x7f8a2c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a2b7fe700 1 --2- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2c09dec0 0x7f8a2c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a2b7fe700 1 -- 172.21.15.154:0/3594423460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c009550 con 0x7f8a2c06a770 2023-09-30T22:25:53.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a2b7fe700 1 --2- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2c06a770 0x7f8a2c1319c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c000c00 tx=0x7f8a1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a13fff700 1 -- 172.21.15.154:0/3594423460 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c004590 con 0x7f8a2c06a770 2023-09-30T22:25:53.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a13fff700 1 -- 172.21.15.154:0/3594423460 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0036a0 con 0x7f8a2c06a770 2023-09-30T22:25:53.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a13fff700 1 -- 172.21.15.154:0/3594423460 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c003a50 con 0x7f8a2c06a770 2023-09-30T22:25:53.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a31dad700 1 -- 172.21.15.154:0/3594423460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c134f40 con 0x7f8a2c06a770 2023-09-30T22:25:53.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.694+0000 7f8a31dad700 1 -- 172.21.15.154:0/3594423460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c133b30 con 0x7f8a2c06a770 2023-09-30T22:25:53.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.695+0000 7f8a13fff700 1 -- 172.21.15.154:0/3594423460 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a1c003bb0 con 0x7f8a2c06a770 2023-09-30T22:25:53.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.695+0000 7f8a31dad700 1 -- 172.21.15.154:0/3594423460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c04f2a0 con 0x7f8a2c06a770 2023-09-30T22:25:53.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.696+0000 7f8a13fff700 1 -- 172.21.15.154:0/3594423460 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a1c021030 con 0x7f8a2c06a770 2023-09-30T22:25:53.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.696+0000 7fd9a088c700 1 Processor -- start 2023-09-30T22:25:53.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.696+0000 7fd9a088c700 1 -- start start 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd9a088c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c133ad0 0x7fd99c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd9a088c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c130bc0 0x7fd99c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd9a088c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99c06b2d0 con 0x7fd99c1300a0 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd9a088c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c133610 con 0x7fd99c130bc0 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd9a088c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c09a500 con 0x7fd99c133ad0 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd99a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c133ad0 0x7fd99c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd99a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c133ad0 0x7fd99c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35754/0 (socket says 172.21.15.154:35754) 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd99a59c700 1 -- 172.21.15.154:0/1740956215 learned_addr learned my addr 172.21.15.154:0/1740956215 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd999d9b700 1 --1- 172.21.15.154:0/1740956215 >> v1:172.21.15.154:6789/0 conn(0x7fd99c1300a0 0x7fd99c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34700/0 (socket says 172.21.15.154:34700) 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.697+0000 7fd99ad9d700 1 --2- 172.21.15.154:0/1740956215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c130bc0 0x7fd99c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.698+0000 7fd99a59c700 1 -- 172.21.15.154:0/1740956215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c130bc0 msgr2=0x7fd99c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.698+0000 7fd99a59c700 1 --2- 172.21.15.154:0/1740956215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c130bc0 0x7fd99c13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.698+0000 7fd99a59c700 1 -- 172.21.15.154:0/1740956215 >> v1:172.21.15.154:6789/0 conn(0x7fd99c1300a0 legacy=0x7fd99c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.698+0000 7fd99a59c700 1 -- 172.21.15.154:0/1740956215 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c1338b0 con 0x7fd99c133ad0 2023-09-30T22:25:53.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.698+0000 7fd99a59c700 1 --2- 172.21.15.154:0/1740956215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c133ad0 0x7fd99c133ea0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009920 tx=0x7fd98c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1abaff136a951335 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.698+0000 7fd99959a700 1 -- 172.21.15.154:0/1740956215 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c011830 con 0x7fd99c133ad0 2023-09-30T22:25:53.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.698+0000 7fd99959a700 1 -- 172.21.15.154:0/1740956215 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c011990 con 0x7fd99c133ad0 2023-09-30T22:25:53.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.698+0000 7fd99959a700 1 -- 172.21.15.154:0/1740956215 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c011d20 con 0x7fd99c133ad0 2023-09-30T22:25:53.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.699+0000 7fd9a088c700 1 -- 172.21.15.154:0/1740956215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c133ad0 msgr2=0x7fd99c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.699+0000 7fd9a088c700 1 --2- 172.21.15.154:0/1740956215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c133ad0 0x7fd99c133ea0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009920 tx=0x7fd98c009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:53.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.699+0000 7fd9a088c700 1 -- 172.21.15.154:0/1740956215 shutdown_connections 2023-09-30T22:25:53.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.699+0000 7fd9a088c700 1 --2- 172.21.15.154:0/1740956215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c130bc0 0x7fd99c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.699+0000 7fd9a088c700 1 --2- 172.21.15.154:0/1740956215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c133ad0 0x7fd99c133ea0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.699+0000 7fd9a088c700 1 -- 172.21.15.154:0/1740956215 >> 172.21.15.154:0/1740956215 conn(0x7fd99c099c40 msgr2=0x7fd99c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.699+0000 7fd9a088c700 1 -- 172.21.15.154:0/1740956215 shutdown_connections 2023-09-30T22:25:53.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.699+0000 7fd9a088c700 1 -- 172.21.15.154:0/1740956215 wait complete. 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.701+0000 7fd9a088c700 1 Processor -- start 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.701+0000 7fd9a088c700 1 -- start start 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd9a088c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c1300a0 0x7fd99c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd9a088c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99c130bc0 0x7fd99c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd9a088c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c133ad0 0x7fd99c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd9a088c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c120d70 con 0x7fd99c130bc0 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd9a088c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c11fdd0 con 0x7fd99c133ad0 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd9a088c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd99c12d3e0 con 0x7fd99c1300a0 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c1300a0 0x7fd99c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c1300a0 0x7fd99c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35768/0 (socket says 172.21.15.154:35768) 2023-09-30T22:25:53.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99a59c700 1 -- 172.21.15.154:0/395235837 learned_addr learned my addr 172.21.15.154:0/395235837 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:53.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99ad9d700 1 --2- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c133ad0 0x7fd99c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7f8a13fff700 1 -- 172.21.15.154:0/3594423460 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a1c01a430 con 0x7f8a2c06a770 2023-09-30T22:25:53.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd999d9b700 1 --2- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99c130bc0 0x7fd99c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99ad9d700 1 -- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c1300a0 msgr2=0x7fd99c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99ad9d700 1 --2- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c1300a0 0x7fd99c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99ad9d700 1 -- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99c130bc0 msgr2=0x7fd99c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99ad9d700 1 --2- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99c130bc0 0x7fd99c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99ad9d700 1 -- 172.21.15.154:0/395235837 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c009550 con 0x7fd99c133ad0 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.702+0000 7fd99ad9d700 1 --2- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c133ad0 0x7fd99c11e4c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd99400efc0 tx=0x7fd99400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.703+0000 7fd98affd700 1 -- 172.21.15.154:0/395235837 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99400cc90 con 0x7fd99c133ad0 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.703+0000 7fd9a088c700 1 -- 172.21.15.154:0/395235837 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99c120370 con 0x7fd99c133ad0 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.703+0000 7fd9a088c700 1 -- 172.21.15.154:0/395235837 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99c120090 con 0x7fd99c133ad0 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.703+0000 7fd98affd700 1 -- 172.21.15.154:0/395235837 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99400f040 con 0x7fd99c133ad0 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.703+0000 7fd98affd700 1 -- 172.21.15.154:0/395235837 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9940146c0 con 0x7fd99c133ad0 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.704+0000 7fd9a088c700 1 -- 172.21.15.154:0/395235837 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9800052e0 con 0x7fd99c133ad0 2023-09-30T22:25:53.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.704+0000 7fd98affd700 1 -- 172.21.15.154:0/395235837 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd994014820 con 0x7fd99c133ad0 2023-09-30T22:25:53.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.704+0000 7fd98affd700 1 -- 172.21.15.154:0/395235837 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd994040260 con 0x7fd99c133ad0 2023-09-30T22:25:53.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.713+0000 7fd98affd700 1 -- 172.21.15.154:0/395235837 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd994007920 con 0x7fd99c133ad0 2023-09-30T22:25:53.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.734+0000 7fe798b3d700 1 Processor -- start 2023-09-30T22:25:53.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.734+0000 7fe798b3d700 1 -- start start 2023-09-30T22:25:53.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe798b3d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe79406a770 0x7fe79406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe798b3d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79409dec0 0x7fe79406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe798b3d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 0x7fe794131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe798b3d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79406b5c0 con 0x7fe79406a770 2023-09-30T22:25:53.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe798b3d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79406e900 con 0x7fe79409dec0 2023-09-30T22:25:53.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe798b3d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe79409d180 con 0x7fe794131a00 2023-09-30T22:25:53.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe791d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79409dec0 0x7fe79406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe792d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 0x7fe794131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe791d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79409dec0 0x7fe79406b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54804/0 (socket says 172.21.15.154:54804) 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe791d9b700 1 -- 172.21.15.154:0/1429463169 learned_addr learned my addr 172.21.15.154:0/1429463169 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe79259c700 1 --2- 172.21.15.154:0/1429463169 >> v2:172.21.15.154:3300/0 conn(0x7fe79406a770 0x7fe79406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe791d9b700 1 -- 172.21.15.154:0/1429463169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 msgr2=0x7fe794131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.735+0000 7fe791d9b700 1 --2- 172.21.15.154:0/1429463169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 0x7fe794131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.736+0000 7fe791d9b700 1 -- 172.21.15.154:0/1429463169 >> v2:172.21.15.154:3300/0 conn(0x7fe79406a770 msgr2=0x7fe79406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.736+0000 7fe791d9b700 1 --2- 172.21.15.154:0/1429463169 >> v2:172.21.15.154:3300/0 conn(0x7fe79406a770 0x7fe79406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.736+0000 7fe791d9b700 1 -- 172.21.15.154:0/1429463169 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79409e780 con 0x7fe79409dec0 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.736+0000 7fe791d9b700 1 --2- 172.21.15.154:0/1429463169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79409dec0 0x7fe79406b080 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe7880098f0 tx=0x7fe788009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=795c32bbc29ea313 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.736+0000 7fe79159a700 1 -- 172.21.15.154:0/1429463169 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788011830 con 0x7fe79409dec0 2023-09-30T22:25:53.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.736+0000 7fe79159a700 1 -- 172.21.15.154:0/1429463169 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe788011990 con 0x7fe79409dec0 2023-09-30T22:25:53.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.736+0000 7fe79159a700 1 -- 172.21.15.154:0/1429463169 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788011d20 con 0x7fe79409dec0 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.737+0000 7fe798b3d700 1 -- 172.21.15.154:0/1429463169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79409dec0 msgr2=0x7fe79406b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.737+0000 7fe798b3d700 1 --2- 172.21.15.154:0/1429463169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79409dec0 0x7fe79406b080 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe7880098f0 tx=0x7fe788009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.737+0000 7fe798b3d700 1 -- 172.21.15.154:0/1429463169 shutdown_connections 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.737+0000 7fe798b3d700 1 --2- 172.21.15.154:0/1429463169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 0x7fe794131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.737+0000 7fe798b3d700 1 --2- 172.21.15.154:0/1429463169 >> v2:172.21.15.154:3300/0 conn(0x7fe79406a770 0x7fe79406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.737+0000 7fe798b3d700 1 --2- 172.21.15.154:0/1429463169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79409dec0 0x7fe79406b080 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.737+0000 7fe798b3d700 1 -- 172.21.15.154:0/1429463169 >> 172.21.15.154:0/1429463169 conn(0x7fe794099c40 msgr2=0x7fe7940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.737+0000 7fe798b3d700 1 -- 172.21.15.154:0/1429463169 shutdown_connections 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.737+0000 7fe798b3d700 1 -- 172.21.15.154:0/1429463169 wait complete. 2023-09-30T22:25:53.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.739+0000 7fe798b3d700 1 Processor -- start 2023-09-30T22:25:53.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.739+0000 7fe798b3d700 1 -- start start 2023-09-30T22:25:53.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.739+0000 7fe798b3d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79406a770 0x7fe79411bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.739+0000 7fe798b3d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe79409dec0 0x7fe79411c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.739+0000 7fe798b3d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 0x7fe79411c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:53.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.739+0000 7fe798b3d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79411d400 con 0x7fe79409dec0 2023-09-30T22:25:53.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.739+0000 7fe798b3d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79411db60 con 0x7fe79406a770 2023-09-30T22:25:53.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.739+0000 7fe798b3d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe79411edb0 con 0x7fe794131a00 2023-09-30T22:25:53.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe79259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79406a770 0x7fe79411bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe79259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79406a770 0x7fe79411bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54806/0 (socket says 172.21.15.154:54806) 2023-09-30T22:25:53.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe79259c700 1 -- 172.21.15.154:0/1861798721 learned_addr learned my addr 172.21.15.154:0/1861798721 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:53.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe792d9d700 1 --2- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 0x7fe79411c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe79259c700 1 -- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 msgr2=0x7fe79411c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe79259c700 1 --2- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 0x7fe79411c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe79259c700 1 -- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe79409dec0 msgr2=0x7fe79411c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe79259c700 1 --2- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe79409dec0 0x7fe79411c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe79259c700 1 -- 172.21.15.154:0/1861798721 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe788009550 con 0x7fe79406a770 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe79259c700 1 --2- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79406a770 0x7fe79411bf50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe78400e810 tx=0x7fe78400ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe782ffd700 1 -- 172.21.15.154:0/1861798721 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784013610 con 0x7fe79406a770 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe782ffd700 1 -- 172.21.15.154:0/1861798721 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe784013770 con 0x7fe79406a770 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe798b3d700 1 -- 172.21.15.154:0/1861798721 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79411f790 con 0x7fe79406a770 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe782ffd700 1 -- 172.21.15.154:0/1861798721 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784013b00 con 0x7fe79406a770 2023-09-30T22:25:53.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.740+0000 7fe798b3d700 1 -- 172.21.15.154:0/1861798721 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79411f260 con 0x7fe79406a770 2023-09-30T22:25:53.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.741+0000 7fe782ffd700 1 -- 172.21.15.154:0/1861798721 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe784013c60 con 0x7fe79406a770 2023-09-30T22:25:53.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.742+0000 7fe782ffd700 1 -- 172.21.15.154:0/1861798721 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe78403f2d0 con 0x7fe79406a770 2023-09-30T22:25:53.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.742+0000 7fe798b3d700 1 -- 172.21.15.154:0/1861798721 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79409d380 con 0x7fe79406a770 2023-09-30T22:25:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.751+0000 7fe782ffd700 1 -- 172.21.15.154:0/1861798721 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe784021080 con 0x7fe79406a770 2023-09-30T22:25:53.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.878+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3662665732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff924072480 con 0x7ff924099e20 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.879+0000 7ff920ff9700 1 -- 172.21.15.154:0/3662665732 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff924072480 con 0x7ff924099e20 2023-09-30T22:25:53.880 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.882+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 msgr2=0x7ff92411a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.882+0000 7ff92a2fd700 1 --2- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92411a7c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff914000c00 tx=0x7ff914004750 comp rx=0 tx=0).stop 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.882+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3662665732 shutdown_connections 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.882+0000 7ff92a2fd700 1 --2- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff924130a60 0x7ff92411b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.882+0000 7ff92a2fd700 1 --2- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff924099e20 0x7ff92411a7c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.882+0000 7ff92a2fd700 1 --2- 172.21.15.154:0/3662665732 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff92409a730 0x7ff92411ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.882+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3662665732 >> 172.21.15.154:0/3662665732 conn(0x7ff9240a2980 msgr2=0x7ff92412d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.882+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3662665732 shutdown_connections 2023-09-30T22:25:53.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.882+0000 7ff92a2fd700 1 -- 172.21.15.154:0/3662665732 wait complete. 2023-09-30T22:25:53.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.900+0000 7f8a31dad700 1 -- 172.21.15.154:0/3594423460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8a2c09e3a0 con 0x7f8a2c06a770 2023-09-30T22:25:53.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.900+0000 7f8a13fff700 1 -- 172.21.15.154:0/3594423460 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a1c015020 con 0x7f8a2c06a770 2023-09-30T22:25:53.901 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:53.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.902+0000 7f8a31dad700 1 -- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2c06a770 msgr2=0x7f8a2c1319c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.902+0000 7f8a31dad700 1 --2- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2c06a770 0x7f8a2c1319c0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c000c00 tx=0x7f8a1c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:53.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.902+0000 7f8a31dad700 1 -- 172.21.15.154:0/3594423460 shutdown_connections 2023-09-30T22:25:53.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.902+0000 7f8a31dad700 1 --2- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8a2c136cb0 0x7f8a2c132440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.902+0000 7f8a31dad700 1 --2- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a2c06a770 0x7f8a2c1319c0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.902+0000 7f8a31dad700 1 --2- 172.21.15.154:0/3594423460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a2c09dec0 0x7f8a2c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.902+0000 7f8a31dad700 1 -- 172.21.15.154:0/3594423460 >> 172.21.15.154:0/3594423460 conn(0x7f8a2c099c40 msgr2=0x7f8a2c137080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.903+0000 7f8a31dad700 1 -- 172.21.15.154:0/3594423460 shutdown_connections 2023-09-30T22:25:53.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.903+0000 7f8a31dad700 1 -- 172.21.15.154:0/3594423460 wait complete. 2023-09-30T22:25:53.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.913+0000 7fd9a088c700 1 -- 172.21.15.154:0/395235837 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd980005590 con 0x7fd99c133ad0 2023-09-30T22:25:53.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.914+0000 7fd98affd700 1 -- 172.21.15.154:0/395235837 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd994018030 con 0x7fd99c133ad0 2023-09-30T22:25:53.915 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:53.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:53.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.916+0000 7fd9a088c700 1 -- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c133ad0 msgr2=0x7fd99c11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.916+0000 7fd9a088c700 1 --2- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c133ad0 0x7fd99c11e4c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd99400efc0 tx=0x7fd99400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.916+0000 7fd9a088c700 1 -- 172.21.15.154:0/395235837 shutdown_connections 2023-09-30T22:25:53.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.916+0000 7fd9a088c700 1 --2- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99c133ad0 0x7fd99c11e4c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.916+0000 7fd9a088c700 1 --2- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99c1300a0 0x7fd99c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.916+0000 7fd9a088c700 1 --2- 172.21.15.154:0/395235837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99c130bc0 0x7fd99c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.916+0000 7fd9a088c700 1 -- 172.21.15.154:0/395235837 >> 172.21.15.154:0/395235837 conn(0x7fd99c099c40 msgr2=0x7fd99c1312c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.916+0000 7fd9a088c700 1 -- 172.21.15.154:0/395235837 shutdown_connections 2023-09-30T22:25:53.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.916+0000 7fd9a088c700 1 -- 172.21.15.154:0/395235837 wait complete. 2023-09-30T22:25:53.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:53.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.953+0000 7fe798b3d700 1 -- 172.21.15.154:0/1861798721 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe79411f200 con 0x7fe79406a770 2023-09-30T22:25:53.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.953+0000 7fe782ffd700 1 -- 172.21.15.154:0/1861798721 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe784010900 con 0x7fe79406a770 2023-09-30T22:25:53.955 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:53.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.956+0000 7fe798b3d700 1 -- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79406a770 msgr2=0x7fe79411bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:53.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.956+0000 7fe798b3d700 1 --2- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79406a770 0x7fe79411bf50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe78400e810 tx=0x7fe78400ebd0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.956+0000 7fe798b3d700 1 -- 172.21.15.154:0/1861798721 shutdown_connections 2023-09-30T22:25:53.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.956+0000 7fe798b3d700 1 --2- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe794131a00 0x7fe79411c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.956+0000 7fe798b3d700 1 --2- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79406a770 0x7fe79411bf50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.956+0000 7fe798b3d700 1 --2- 172.21.15.154:0/1861798721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe79409dec0 0x7fe79411c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:53.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.956+0000 7fe798b3d700 1 -- 172.21.15.154:0/1861798721 >> 172.21.15.154:0/1861798721 conn(0x7fe794099c40 msgr2=0x7fe79409bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:53.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.956+0000 7fe798b3d700 1 -- 172.21.15.154:0/1861798721 shutdown_connections 2023-09-30T22:25:53.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:53.956+0000 7fe798b3d700 1 -- 172.21.15.154:0/1861798721 wait complete. 2023-09-30T22:25:53.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:54.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:54.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:54.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:54.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.053+0000 7f1454be4700 1 Processor -- start 2023-09-30T22:25:55.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.053+0000 7f1454be4700 1 -- start start 2023-09-30T22:25:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.053+0000 7f1454be4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1450133ad0 0x7f1450133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.053+0000 7f1454be4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501300a0 0x7f14501304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.053+0000 7f1454be4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145006b2d0 con 0x7f14501309f0 2023-09-30T22:25:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.053+0000 7f1454be4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1450133610 con 0x7f14501300a0 2023-09-30T22:25:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.053+0000 7f1454be4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f145009a500 con 0x7f1450133ad0 2023-09-30T22:25:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1450133ad0 0x7f1450133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1450133ad0 0x7f1450133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35792/0 (socket says 172.21.15.154:35792) 2023-09-30T22:25:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144e59c700 1 -- 172.21.15.154:0/887358317 learned_addr learned my addr 172.21.15.154:0/887358317 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f1447fff700 1 --2- 172.21.15.154:0/887358317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501300a0 0x7f14501304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144e59c700 1 -- 172.21.15.154:0/887358317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501300a0 msgr2=0x7f14501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144e59c700 1 --2- 172.21.15.154:0/887358317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501300a0 0x7f14501304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144e59c700 1 -- 172.21.15.154:0/887358317 >> v1:172.21.15.154:6789/0 conn(0x7f14501309f0 legacy=0x7f145013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144e59c700 1 -- 172.21.15.154:0/887358317 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14501338b0 con 0x7f1450133ad0 2023-09-30T22:25:55.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144e59c700 1 --2- 172.21.15.154:0/887358317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1450133ad0 0x7f1450133ea0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1440009920 tx=0x7f1440009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=731812e616a2e6c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144dd9b700 1 -- 172.21.15.154:0/887358317 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440011830 con 0x7f1450133ad0 2023-09-30T22:25:55.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144dd9b700 1 -- 172.21.15.154:0/887358317 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1440011990 con 0x7f1450133ad0 2023-09-30T22:25:55.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.054+0000 7f144dd9b700 1 -- 172.21.15.154:0/887358317 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440011d20 con 0x7f1450133ad0 2023-09-30T22:25:55.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.055+0000 7f1454be4700 1 -- 172.21.15.154:0/887358317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1450133ad0 msgr2=0x7f1450133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.055+0000 7f1454be4700 1 --2- 172.21.15.154:0/887358317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1450133ad0 0x7f1450133ea0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1440009920 tx=0x7f1440009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:55.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.055+0000 7f1454be4700 1 -- 172.21.15.154:0/887358317 shutdown_connections 2023-09-30T22:25:55.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.055+0000 7f1454be4700 1 --2- 172.21.15.154:0/887358317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1450133ad0 0x7f1450133ea0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.055+0000 7f1454be4700 1 --2- 172.21.15.154:0/887358317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501300a0 0x7f14501304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.055+0000 7f1454be4700 1 -- 172.21.15.154:0/887358317 >> 172.21.15.154:0/887358317 conn(0x7f1450099c40 msgr2=0x7f14500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.056+0000 7f1454be4700 1 -- 172.21.15.154:0/887358317 shutdown_connections 2023-09-30T22:25:55.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.056+0000 7f1454be4700 1 -- 172.21.15.154:0/887358317 wait complete. 2023-09-30T22:25:55.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.057+0000 7f1454be4700 1 Processor -- start 2023-09-30T22:25:55.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.057+0000 7f1454be4700 1 -- start start 2023-09-30T22:25:55.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1454be4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14501300a0 0x7f145011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1454be4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501309f0 0x7f145011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1454be4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1450133ad0 0x7f145011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1454be4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1450120b10 con 0x7f1450133ad0 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1454be4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145011f530 con 0x7f14501309f0 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1454be4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f145012fd70 con 0x7f14501300a0 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1447fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501309f0 0x7f145011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1447fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501309f0 0x7f145011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54824/0 (socket says 172.21.15.154:54824) 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1447fff700 1 -- 172.21.15.154:0/1567641973 learned_addr learned my addr 172.21.15.154:0/1567641973 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f144ed9d700 1 --2- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1450133ad0 0x7f145011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1447fff700 1 -- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14501300a0 msgr2=0x7f145011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1447fff700 1 --2- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14501300a0 0x7f145011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1447fff700 1 -- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1450133ad0 msgr2=0x7f145011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1447fff700 1 --2- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1450133ad0 0x7f145011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f1447fff700 1 -- 172.21.15.154:0/1567641973 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1440009550 con 0x7f14501309f0 2023-09-30T22:25:55.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.058+0000 7f144ed9d700 1 --2- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1450133ad0 0x7f145011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:55.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.059+0000 7f1447fff700 1 --2- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501309f0 0x7f145011df80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f143800e870 tx=0x7f143800ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.059+0000 7f1446ffd700 1 -- 172.21.15.154:0/1567641973 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438009590 con 0x7f14501309f0 2023-09-30T22:25:55.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.059+0000 7f1446ffd700 1 -- 172.21.15.154:0/1567641973 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143800ee70 con 0x7f14501309f0 2023-09-30T22:25:55.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.059+0000 7f1454be4700 1 -- 172.21.15.154:0/1567641973 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145012dd00 con 0x7f14501309f0 2023-09-30T22:25:55.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.059+0000 7f1446ffd700 1 -- 172.21.15.154:0/1567641973 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800ca70 con 0x7f14501309f0 2023-09-30T22:25:55.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.059+0000 7f1454be4700 1 -- 172.21.15.154:0/1567641973 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145011f8a0 con 0x7f14501309f0 2023-09-30T22:25:55.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.060+0000 7f1446ffd700 1 -- 172.21.15.154:0/1567641973 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f143800cbd0 con 0x7f14501309f0 2023-09-30T22:25:55.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.060+0000 7f1446ffd700 1 -- 172.21.15.154:0/1567641973 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f143803f700 con 0x7f14501309f0 2023-09-30T22:25:55.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.060+0000 7f1454be4700 1 -- 172.21.15.154:0/1567641973 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145004f2a0 con 0x7f14501309f0 2023-09-30T22:25:55.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.066+0000 7f1446ffd700 1 -- 172.21.15.154:0/1567641973 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14380232f0 con 0x7f14501309f0 2023-09-30T22:25:55.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.092+0000 7fb41ad5a700 1 Processor -- start 2023-09-30T22:25:55.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.092+0000 7f67cb917700 1 Processor -- start 2023-09-30T22:25:55.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.092+0000 7f67cb917700 1 -- start start 2023-09-30T22:25:55.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb41ad5a700 1 -- start start 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67cb917700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f67c4133ad0 0x7f67c4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67cb917700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67c41300a0 0x7f67c41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67cb917700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c41309f0 0x7f67c413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67cb917700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c406b2d0 con 0x7f67c4133ad0 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67cb917700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4133610 con 0x7f67c41300a0 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67cb917700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67c409a500 con 0x7f67c41309f0 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67c9eb4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c41309f0 0x7f67c413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67c9eb4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c41309f0 0x7f67c413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35810/0 (socket says 172.21.15.154:35810) 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67c9eb4700 1 -- 172.21.15.154:0/2874746463 learned_addr learned my addr 172.21.15.154:0/2874746463 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7f67c96b3700 1 --2- 172.21.15.154:0/2874746463 >> v2:172.21.15.154:3300/0 conn(0x7f67c4133ad0 0x7f67c4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb41ad5a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb41409d860 0x7fb41409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb41ad5a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb41ad5a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb414130ce0 0x7fb414131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb41ad5a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41409aaa0 con 0x7fb414130ce0 2023-09-30T22:25:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb41ad5a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41409f870 con 0x7fb41409d860 2023-09-30T22:25:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb41ad5a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb41409b360 con 0x7fb41409e170 2023-09-30T22:25:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb418af6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb41409d860 0x7fb41409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb418af6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb41409d860 0x7fb41409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54832/0 (socket says 172.21.15.154:54832) 2023-09-30T22:25:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.093+0000 7fb418af6700 1 -- 172.21.15.154:0/399955653 learned_addr learned my addr 172.21.15.154:0/399955653 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb413fff700 1 --2- 172.21.15.154:0/399955653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb4192f7700 1 --2- 172.21.15.154:0/399955653 >> v2:172.21.15.154:3300/0 conn(0x7fb414130ce0 0x7fb414131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7f67c9eb4700 1 -- 172.21.15.154:0/2874746463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67c41300a0 msgr2=0x7f67c41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7f67c9eb4700 1 --2- 172.21.15.154:0/2874746463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67c41300a0 0x7f67c41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7f67c9eb4700 1 -- 172.21.15.154:0/2874746463 >> v2:172.21.15.154:3300/0 conn(0x7f67c4133ad0 msgr2=0x7f67c4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7f67c9eb4700 1 --2- 172.21.15.154:0/2874746463 >> v2:172.21.15.154:3300/0 conn(0x7f67c4133ad0 0x7f67c4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7f67c9eb4700 1 -- 172.21.15.154:0/2874746463 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c41338b0 con 0x7f67c41309f0 2023-09-30T22:25:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7f67c9eb4700 1 --2- 172.21.15.154:0/2874746463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c41309f0 0x7f67c413a980 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009e50 tx=0x7f67bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa54d459c591e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb413fff700 1 -- 172.21.15.154:0/399955653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb41409d860 msgr2=0x7fb41409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb413fff700 1 --2- 172.21.15.154:0/399955653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb41409d860 0x7fb41409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb413fff700 1 -- 172.21.15.154:0/399955653 >> v2:172.21.15.154:3300/0 conn(0x7fb414130ce0 msgr2=0x7fb414131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb413fff700 1 --2- 172.21.15.154:0/399955653 >> v2:172.21.15.154:3300/0 conn(0x7fb414130ce0 0x7fb414131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb413fff700 1 -- 172.21.15.154:0/399955653 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41409b620 con 0x7fb41409e170 2023-09-30T22:25:55.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb4192f7700 1 --2- 172.21.15.154:0/399955653 >> v2:172.21.15.154:3300/0 conn(0x7fb414130ce0 0x7fb414131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7f67bbfff700 1 -- 172.21.15.154:0/2874746463 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc00e070 con 0x7f67c41309f0 2023-09-30T22:25:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7f67bbfff700 1 -- 172.21.15.154:0/2874746463 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc00b910 con 0x7f67c41309f0 2023-09-30T22:25:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7f67bbfff700 1 -- 172.21.15.154:0/2874746463 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc00bcc0 con 0x7f67c41309f0 2023-09-30T22:25:55.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb413fff700 1 --2- 172.21.15.154:0/399955653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141307a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb40000bae0 tx=0x7fb40000bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56c18ce51f0d48c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb4137fe700 1 -- 172.21.15.154:0/399955653 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40000dc70 con 0x7fb41409e170 2023-09-30T22:25:55.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb4137fe700 1 -- 172.21.15.154:0/399955653 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40000ddd0 con 0x7fb41409e170 2023-09-30T22:25:55.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.094+0000 7fb4137fe700 1 -- 172.21.15.154:0/399955653 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400010690 con 0x7fb41409e170 2023-09-30T22:25:55.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7f67cb917700 1 -- 172.21.15.154:0/2874746463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c41309f0 msgr2=0x7f67c413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7f67cb917700 1 --2- 172.21.15.154:0/2874746463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c41309f0 0x7f67c413a980 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009e50 tx=0x7f67bc00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:55.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7f67cb917700 1 -- 172.21.15.154:0/2874746463 shutdown_connections 2023-09-30T22:25:55.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7f67cb917700 1 --2- 172.21.15.154:0/2874746463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c41309f0 0x7f67c413a980 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7f67cb917700 1 --2- 172.21.15.154:0/2874746463 >> v2:172.21.15.154:3300/0 conn(0x7f67c4133ad0 0x7f67c4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7f67cb917700 1 --2- 172.21.15.154:0/2874746463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67c41300a0 0x7f67c41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7f67cb917700 1 -- 172.21.15.154:0/2874746463 >> 172.21.15.154:0/2874746463 conn(0x7f67c4099c40 msgr2=0x7f67c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7f67cb917700 1 -- 172.21.15.154:0/2874746463 shutdown_connections 2023-09-30T22:25:55.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7f67cb917700 1 -- 172.21.15.154:0/2874746463 wait complete. 2023-09-30T22:25:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7fb41ad5a700 1 -- 172.21.15.154:0/399955653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 msgr2=0x7fb4141307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7fb41ad5a700 1 --2- 172.21.15.154:0/399955653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141307a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb40000bae0 tx=0x7fb40000bdf0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7fb41ad5a700 1 -- 172.21.15.154:0/399955653 shutdown_connections 2023-09-30T22:25:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7fb41ad5a700 1 --2- 172.21.15.154:0/399955653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb41409d860 0x7fb41409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7fb41ad5a700 1 --2- 172.21.15.154:0/399955653 >> v2:172.21.15.154:3300/0 conn(0x7fb414130ce0 0x7fb414131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7fb41ad5a700 1 --2- 172.21.15.154:0/399955653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141307a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7fb41ad5a700 1 -- 172.21.15.154:0/399955653 >> 172.21.15.154:0/399955653 conn(0x7fb414099c40 msgr2=0x7fb4140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7fb41ad5a700 1 -- 172.21.15.154:0/399955653 shutdown_connections 2023-09-30T22:25:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.095+0000 7fb41ad5a700 1 -- 172.21.15.154:0/399955653 wait complete. 2023-09-30T22:25:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.096+0000 7f67cb917700 1 Processor -- start 2023-09-30T22:25:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.096+0000 7f67cb917700 1 -- start start 2023-09-30T22:25:55.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.096+0000 7fb41ad5a700 1 Processor -- start 2023-09-30T22:25:55.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.096+0000 7fb41ad5a700 1 -- start start 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67cb917700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c41300a0 0x7f67c411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67cb917700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67c41309f0 0x7f67c411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67cb917700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c4133ad0 0x7f67c411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67cb917700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c411fd50 con 0x7f67c41300a0 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67cb917700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4120030 con 0x7f67c41309f0 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67cb917700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40a3400 con 0x7f67c4133ad0 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67c9eb4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c4133ad0 0x7f67c411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67c9eb4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c4133ad0 0x7f67c411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35824/0 (socket says 172.21.15.154:35824) 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67c9eb4700 1 -- 172.21.15.154:0/294916516 learned_addr learned my addr 172.21.15.154:0/294916516 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67c9eb4700 1 -- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67c41309f0 msgr2=0x7f67c411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67c9eb4700 1 --2- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67c41309f0 0x7f67c411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67c9eb4700 1 -- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c41300a0 msgr2=0x7f67c411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67c9eb4700 1 --2- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c41300a0 0x7f67c411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67c9eb4700 1 -- 172.21.15.154:0/294916516 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc009b30 con 0x7f67c4133ad0 2023-09-30T22:25:55.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb41ad5a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb41409d860 0x7fb4141cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb41ad5a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb41ad5a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb414130ce0 0x7fb4141264f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb41ad5a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb414129c30 con 0x7fb41409d860 2023-09-30T22:25:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb41ad5a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41412a9f0 con 0x7fb414130ce0 2023-09-30T22:25:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb41ad5a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140a22b0 con 0x7fb41409e170 2023-09-30T22:25:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7f67c9eb4700 1 --2- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c4133ad0 0x7f67c411e4c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f67c409a640 tx=0x7f67bc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb413fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb413fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35838/0 (socket says 172.21.15.154:35838) 2023-09-30T22:25:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb413fff700 1 -- 172.21.15.154:0/2165775487 learned_addr learned my addr 172.21.15.154:0/2165775487 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.097+0000 7fb4192f7700 1 --2- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb414130ce0 0x7fb4141264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7f67b9ffb700 1 -- 172.21.15.154:0/294916516 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc004250 con 0x7f67c4133ad0 2023-09-30T22:25:55.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7f67b9ffb700 1 -- 172.21.15.154:0/294916516 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc0043d0 con 0x7f67c4133ad0 2023-09-30T22:25:55.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7f67cb917700 1 -- 172.21.15.154:0/294916516 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c412dd00 con 0x7f67c4133ad0 2023-09-30T22:25:55.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7fb413fff700 1 -- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb414130ce0 msgr2=0x7fb4141264f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7fb413fff700 1 --2- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb414130ce0 0x7fb4141264f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7fb413fff700 1 -- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb41409d860 msgr2=0x7fb4141cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7fb413fff700 1 --2- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb41409d860 0x7fb4141cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7fb413fff700 1 -- 172.21.15.154:0/2165775487 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40000b740 con 0x7fb41409e170 2023-09-30T22:25:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7fb413fff700 1 --2- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141ccf20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb40000be30 tx=0x7fb400004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7fb4117fa700 1 -- 172.21.15.154:0/2165775487 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400003bf0 con 0x7fb41409e170 2023-09-30T22:25:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7fb4117fa700 1 -- 172.21.15.154:0/2165775487 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400003d50 con 0x7fb41409e170 2023-09-30T22:25:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7fb4117fa700 1 -- 172.21.15.154:0/2165775487 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000106b0 con 0x7fb41409e170 2023-09-30T22:25:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7f67b9ffb700 1 -- 172.21.15.154:0/294916516 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc004780 con 0x7f67c4133ad0 2023-09-30T22:25:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.098+0000 7f67cb917700 1 -- 172.21.15.154:0/294916516 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c411ed90 con 0x7f67c4133ad0 2023-09-30T22:25:55.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.099+0000 7fb41ad5a700 1 -- 172.21.15.154:0/2165775487 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41409c8b0 con 0x7fb41409e170 2023-09-30T22:25:55.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.099+0000 7fb41ad5a700 1 -- 172.21.15.154:0/2165775487 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4141cd460 con 0x7fb41409e170 2023-09-30T22:25:55.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.100+0000 7f67af7fe700 1 -- 172.21.15.154:0/294916516 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c411fbb0 con 0x7f67c4133ad0 2023-09-30T22:25:55.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.100+0000 7fb4117fa700 1 -- 172.21.15.154:0/2165775487 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb400019400 con 0x7fb41409e170 2023-09-30T22:25:55.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.100+0000 7fb4117fa700 1 -- 172.21.15.154:0/2165775487 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb4000405b0 con 0x7fb41409e170 2023-09-30T22:25:55.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.100+0000 7fb41ad5a700 1 -- 172.21.15.154:0/2165775487 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41404f2a0 con 0x7fb41409e170 2023-09-30T22:25:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.100+0000 7f67b9ffb700 1 -- 172.21.15.154:0/294916516 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67bc01c440 con 0x7f67c4133ad0 2023-09-30T22:25:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.100+0000 7f67b9ffb700 1 -- 172.21.15.154:0/294916516 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f67bc0409b0 con 0x7f67c4133ad0 2023-09-30T22:25:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.105+0000 7f67b9ffb700 1 -- 172.21.15.154:0/294916516 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67c411fbb0 con 0x7f67c4133ad0 2023-09-30T22:25:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.109+0000 7fb4117fa700 1 -- 172.21.15.154:0/2165775487 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb40000f3d0 con 0x7fb41409e170 2023-09-30T22:25:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.122+0000 7f7a0badb700 1 Processor -- start 2023-09-30T22:25:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.122+0000 7f7a0badb700 1 -- start start 2023-09-30T22:25:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0badb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 0x7f7a040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0badb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a040a1380 0x7f7a04133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0badb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a04133f50 0x7f7a04134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0badb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0409e9d0 con 0x7f7a040a1380 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0badb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0409dc00 con 0x7f7a040a0a70 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0badb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0409dec0 con 0x7f7a04133f50 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0a078700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a04133f50 0x7f7a04134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0a078700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a04133f50 0x7f7a04134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35846/0 (socket says 172.21.15.154:35846) 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0a078700 1 -- 172.21.15.154:0/3411623907 learned_addr learned my addr 172.21.15.154:0/3411623907 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a09877700 1 --2- 172.21.15.154:0/3411623907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 0x7f7a040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a09076700 1 --2- 172.21.15.154:0/3411623907 >> v2:172.21.15.154:3300/0 conn(0x7f7a040a1380 0x7f7a04133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0a078700 1 -- 172.21.15.154:0/3411623907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 msgr2=0x7f7a040a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0a078700 1 --2- 172.21.15.154:0/3411623907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 0x7f7a040a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0a078700 1 -- 172.21.15.154:0/3411623907 >> v2:172.21.15.154:3300/0 conn(0x7f7a040a1380 msgr2=0x7f7a04133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0a078700 1 --2- 172.21.15.154:0/3411623907 >> v2:172.21.15.154:3300/0 conn(0x7f7a040a1380 0x7f7a04133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a0a078700 1 -- 172.21.15.154:0/3411623907 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0409e6a0 con 0x7f7a04133f50 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.123+0000 7f7a09076700 1 --2- 172.21.15.154:0/3411623907 >> v2:172.21.15.154:3300/0 conn(0x7f7a040a1380 0x7f7a04133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.124+0000 7f7a0a078700 1 --2- 172.21.15.154:0/3411623907 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a04133f50 0x7f7a04134380 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009e50 tx=0x7f79fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42c425132bacbb93 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.124+0000 7f7a08875700 1 -- 172.21.15.154:0/3411623907 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00e070 con 0x7f7a04133f50 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.124+0000 7f7a08875700 1 -- 172.21.15.154:0/3411623907 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00b9c0 con 0x7f7a04133f50 2023-09-30T22:25:55.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.124+0000 7f7a08875700 1 -- 172.21.15.154:0/3411623907 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00bd70 con 0x7f7a04133f50 2023-09-30T22:25:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.124+0000 7f7a0badb700 1 -- 172.21.15.154:0/3411623907 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a04133f50 msgr2=0x7f7a04134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.124+0000 7f7a0badb700 1 --2- 172.21.15.154:0/3411623907 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a04133f50 0x7f7a04134380 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009e50 tx=0x7f79fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:25:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.125+0000 7f7a0badb700 1 -- 172.21.15.154:0/3411623907 shutdown_connections 2023-09-30T22:25:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.125+0000 7f7a0badb700 1 --2- 172.21.15.154:0/3411623907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 0x7f7a040a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.125+0000 7f7a0badb700 1 --2- 172.21.15.154:0/3411623907 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a04133f50 0x7f7a04134380 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.125+0000 7f7a0badb700 1 --2- 172.21.15.154:0/3411623907 >> v2:172.21.15.154:3300/0 conn(0x7f7a040a1380 0x7f7a04133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.125+0000 7f7a0badb700 1 -- 172.21.15.154:0/3411623907 >> 172.21.15.154:0/3411623907 conn(0x7f7a040a6610 msgr2=0x7f7a040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.125+0000 7f7a0badb700 1 -- 172.21.15.154:0/3411623907 shutdown_connections 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.125+0000 7f7a0badb700 1 -- 172.21.15.154:0/3411623907 wait complete. 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a0badb700 1 Processor -- start 2023-09-30T22:25:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a0badb700 1 -- start start 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a0badb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 0x7f7a04122490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a0badb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a040a1380 0x7f7a041229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a0badb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a04133f50 0x7f7a04122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a0badb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0409d340 con 0x7f7a04133f50 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a0badb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04124ec0 con 0x7f7a040a0a70 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a0badb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04125740 con 0x7f7a040a1380 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a09076700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a040a1380 0x7f7a041229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a09076700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a040a1380 0x7f7a041229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35850/0 (socket says 172.21.15.154:35850) 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a09076700 1 -- 172.21.15.154:0/2031095262 learned_addr learned my addr 172.21.15.154:0/2031095262 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a09877700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 0x7f7a04122490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a0a078700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a04133f50 0x7f7a04122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.126+0000 7f7a09076700 1 -- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 msgr2=0x7f7a04122490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f7a09076700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 0x7f7a04122490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f7a09076700 1 -- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a04133f50 msgr2=0x7f7a04122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f7a09076700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a04133f50 0x7f7a04122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f7a09076700 1 -- 172.21.15.154:0/2031095262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc009b30 con 0x7f7a040a1380 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f7a0a078700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a04133f50 0x7f7a04122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f7a09076700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a040a1380 0x7f7a041229d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f79f400c740 tx=0x7f79f400cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f79fa7fc700 1 -- 172.21.15.154:0/2031095262 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4004220 con 0x7f7a040a1380 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f79fa7fc700 1 -- 172.21.15.154:0/2031095262 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f4004380 con 0x7f7a040a1380 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f79fa7fc700 1 -- 172.21.15.154:0/2031095262 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40036a0 con 0x7f7a040a1380 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f7a0badb700 1 -- 172.21.15.154:0/2031095262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a04124890 con 0x7f7a040a1380 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.127+0000 7f7a0badb700 1 -- 172.21.15.154:0/2031095262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a04125cd0 con 0x7f7a040a1380 2023-09-30T22:25:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.128+0000 7f7a0badb700 1 -- 172.21.15.154:0/2031095262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0404f2a0 con 0x7f7a040a1380 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.128+0000 7f79fa7fc700 1 -- 172.21.15.154:0/2031095262 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79f4003800 con 0x7f7a040a1380 2023-09-30T22:25:55.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.128+0000 7f79fa7fc700 1 -- 172.21.15.154:0/2031095262 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f79f403f9d0 con 0x7f7a040a1380 2023-09-30T22:25:55.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.137+0000 7f79fa7fc700 1 -- 172.21.15.154:0/2031095262 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79f4010b40 con 0x7f7a040a1380 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.272+0000 7f1454be4700 1 -- 172.21.15.154:0/1567641973 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f145011fe90 con 0x7f14501309f0 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.272+0000 7f1446ffd700 1 -- 172.21.15.154:0/1567641973 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f143801bba0 con 0x7f14501309f0 2023-09-30T22:25:55.273 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.274+0000 7f1454be4700 1 -- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501309f0 msgr2=0x7f145011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.274+0000 7f1454be4700 1 --2- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501309f0 0x7f145011df80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f143800e870 tx=0x7f143800ec30 comp rx=0 tx=0).stop 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.274+0000 7f1454be4700 1 -- 172.21.15.154:0/1567641973 shutdown_connections 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.274+0000 7f1454be4700 1 --2- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1450133ad0 0x7f145011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.274+0000 7f1454be4700 1 --2- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14501300a0 0x7f145011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.274+0000 7f1454be4700 1 --2- 172.21.15.154:0/1567641973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14501309f0 0x7f145011df80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.274+0000 7f1454be4700 1 -- 172.21.15.154:0/1567641973 >> 172.21.15.154:0/1567641973 conn(0x7f1450099c40 msgr2=0x7f1450131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.274+0000 7f1454be4700 1 -- 172.21.15.154:0/1567641973 shutdown_connections 2023-09-30T22:25:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.274+0000 7f1454be4700 1 -- 172.21.15.154:0/1567641973 wait complete. 2023-09-30T22:25:55.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:55.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.312+0000 7f67af7fe700 1 -- 172.21.15.154:0/294916516 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f67c411fbb0 con 0x7f67c4133ad0 2023-09-30T22:25:55.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.312+0000 7f67b9ffb700 1 -- 172.21.15.154:0/294916516 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67c411fbb0 con 0x7f67c4133ad0 2023-09-30T22:25:55.313 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:55.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7f67af7fe700 1 -- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c4133ad0 msgr2=0x7f67c411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7f67af7fe700 1 --2- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c4133ad0 0x7f67c411e4c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f67c409a640 tx=0x7f67bc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7f67af7fe700 1 -- 172.21.15.154:0/294916516 shutdown_connections 2023-09-30T22:25:55.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7f67af7fe700 1 --2- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67c4133ad0 0x7f67c411e4c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7f67af7fe700 1 --2- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67c41300a0 0x7f67c411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7f67af7fe700 1 --2- 172.21.15.154:0/294916516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67c41309f0 0x7f67c411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7f67af7fe700 1 -- 172.21.15.154:0/294916516 >> 172.21.15.154:0/294916516 conn(0x7f67c4099c40 msgr2=0x7f67c412e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7f67af7fe700 1 -- 172.21.15.154:0/294916516 shutdown_connections 2023-09-30T22:25:55.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7f67af7fe700 1 -- 172.21.15.154:0/294916516 wait complete. 2023-09-30T22:25:55.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7fb41ad5a700 1 -- 172.21.15.154:0/2165775487 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4141299e0 con 0x7fb41409e170 2023-09-30T22:25:55.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.315+0000 7fb4117fa700 1 -- 172.21.15.154:0/2165775487 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb400028020 con 0x7fb41409e170 2023-09-30T22:25:55.320 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:55.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.319+0000 7fb41ad5a700 1 -- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 msgr2=0x7fb4141ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.319+0000 7fb41ad5a700 1 --2- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141ccf20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb40000be30 tx=0x7fb400004750 comp rx=0 tx=0).stop 2023-09-30T22:25:55.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.319+0000 7fb41ad5a700 1 -- 172.21.15.154:0/2165775487 shutdown_connections 2023-09-30T22:25:55.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.319+0000 7fb41ad5a700 1 --2- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb414130ce0 0x7fb4141264f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.319+0000 7fb41ad5a700 1 --2- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb41409d860 0x7fb4141cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.319+0000 7fb41ad5a700 1 --2- 172.21.15.154:0/2165775487 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb41409e170 0x7fb4141ccf20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.319+0000 7fb41ad5a700 1 -- 172.21.15.154:0/2165775487 >> 172.21.15.154:0/2165775487 conn(0x7fb414099c40 msgr2=0x7fb4140a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.319+0000 7fb41ad5a700 1 -- 172.21.15.154:0/2165775487 shutdown_connections 2023-09-30T22:25:55.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.319+0000 7fb41ad5a700 1 -- 172.21.15.154:0/2165775487 wait complete. 2023-09-30T22:25:55.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.333+0000 7f7a0badb700 1 -- 172.21.15.154:0/2031095262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a04133d30 con 0x7f7a040a1380 2023-09-30T22:25:55.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:55.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.333+0000 7f79fa7fc700 1 -- 172.21.15.154:0/2031095262 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79f4010b40 con 0x7f7a040a1380 2023-09-30T22:25:55.335 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:55.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.336+0000 7f7a0badb700 1 -- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a040a1380 msgr2=0x7f7a041229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:55.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.336+0000 7f7a0badb700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a040a1380 0x7f7a041229d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f79f400c740 tx=0x7f79f400cb00 comp rx=0 tx=0).stop 2023-09-30T22:25:55.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.336+0000 7f7a0badb700 1 -- 172.21.15.154:0/2031095262 shutdown_connections 2023-09-30T22:25:55.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.336+0000 7f7a0badb700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a04133f50 0x7f7a04122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.336+0000 7f7a0badb700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a040a0a70 0x7f7a04122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.336+0000 7f7a0badb700 1 --2- 172.21.15.154:0/2031095262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7a040a1380 0x7f7a041229d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:55.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.336+0000 7f7a0badb700 1 -- 172.21.15.154:0/2031095262 >> 172.21.15.154:0/2031095262 conn(0x7f7a040a6610 msgr2=0x7f7a04099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:55.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.336+0000 7f7a0badb700 1 -- 172.21.15.154:0/2031095262 shutdown_connections 2023-09-30T22:25:55.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:55.336+0000 7f7a0badb700 1 -- 172.21.15.154:0/2031095262 wait complete. 2023-09-30T22:25:55.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:55.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:56.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:56.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:56.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:56.350 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.440+0000 7fa3278e3700 1 Processor -- start 2023-09-30T22:25:56.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.440+0000 7fa3278e3700 1 -- start start 2023-09-30T22:25:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.441+0000 7fa3278e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa320138040 0x7fa320138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.441+0000 7fa3278e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3200a08e0 0x7fa3200a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.441+0000 7fa3278e3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa3200a1230 0x7fa32013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.441+0000 7fa3278e3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3200a2100 con 0x7fa3200a1230 2023-09-30T22:25:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.441+0000 7fa3278e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa320138950 con 0x7fa320138040 2023-09-30T22:25:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.441+0000 7fa3278e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3201379e0 con 0x7fa3200a08e0 2023-09-30T22:25:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.441+0000 7fa324e7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3200a08e0 0x7fa3200a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.441+0000 7fa324e7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3200a08e0 0x7fa3200a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39560/0 (socket says 172.21.15.154:39560) 2023-09-30T22:25:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.441+0000 7fa324e7e700 1 -- 172.21.15.154:0/968784399 learned_addr learned my addr 172.21.15.154:0/968784399 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.442+0000 7fa324e7e700 1 -- 172.21.15.154:0/968784399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa320138040 msgr2=0x7fa320138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.442+0000 7fa324e7e700 1 --2- 172.21.15.154:0/968784399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa320138040 0x7fa320138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.442+0000 7fa324e7e700 1 -- 172.21.15.154:0/968784399 >> v2:172.21.15.154:3300/0 conn(0x7fa3200a1230 msgr2=0x7fa32013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.442+0000 7fa324e7e700 1 --2- 172.21.15.154:0/968784399 >> v2:172.21.15.154:3300/0 conn(0x7fa3200a1230 0x7fa32013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.442+0000 7fa324e7e700 1 -- 172.21.15.154:0/968784399 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32009b9b0 con 0x7fa3200a08e0 2023-09-30T22:25:56.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.442+0000 7fa324e7e700 1 --2- 172.21.15.154:0/968784399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3200a08e0 0x7fa3200a0cf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009950 tx=0x7fa31c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899913d61b68968b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.443+0000 7fa313fff700 1 -- 172.21.15.154:0/968784399 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c009ea0 con 0x7fa3200a08e0 2023-09-30T22:25:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.443+0000 7fa313fff700 1 -- 172.21.15.154:0/968784399 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c00b9e0 con 0x7fa3200a08e0 2023-09-30T22:25:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.443+0000 7fa313fff700 1 -- 172.21.15.154:0/968784399 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c00bd70 con 0x7fa3200a08e0 2023-09-30T22:25:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.444+0000 7fa3278e3700 1 -- 172.21.15.154:0/968784399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3200a08e0 msgr2=0x7fa3200a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.444+0000 7fa3278e3700 1 --2- 172.21.15.154:0/968784399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3200a08e0 0x7fa3200a0cf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009950 tx=0x7fa31c009c60 comp rx=0 tx=0).stop 2023-09-30T22:25:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.444+0000 7fa3278e3700 1 -- 172.21.15.154:0/968784399 shutdown_connections 2023-09-30T22:25:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.444+0000 7fa3278e3700 1 --2- 172.21.15.154:0/968784399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa320138040 0x7fa320138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.444+0000 7fa3278e3700 1 --2- 172.21.15.154:0/968784399 >> v2:172.21.15.154:3300/0 conn(0x7fa3200a1230 0x7fa32013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.444+0000 7fa3278e3700 1 --2- 172.21.15.154:0/968784399 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa3200a08e0 0x7fa3200a0cf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.444+0000 7fa3278e3700 1 -- 172.21.15.154:0/968784399 >> 172.21.15.154:0/968784399 conn(0x7fa3200a2980 msgr2=0x7fa3200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.444+0000 7fa3278e3700 1 -- 172.21.15.154:0/968784399 shutdown_connections 2023-09-30T22:25:56.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.444+0000 7fa3278e3700 1 -- 172.21.15.154:0/968784399 wait complete. 2023-09-30T22:25:56.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.445+0000 7fa3278e3700 1 Processor -- start 2023-09-30T22:25:56.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa3278e3700 1 -- start start 2023-09-30T22:25:56.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa3278e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3200a08e0 0x7fa320126540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa3278e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3200a1230 0x7fa320126a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa3278e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa320138040 0x7fa320126fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa3278e3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa320129720 con 0x7fa3200a1230 2023-09-30T22:25:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa3278e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3201280c0 con 0x7fa3200a08e0 2023-09-30T22:25:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa3278e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3201279a0 con 0x7fa320138040 2023-09-30T22:25:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa325e80700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa320138040 0x7fa320126fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa325e80700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa320138040 0x7fa320126fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39562/0 (socket says 172.21.15.154:39562) 2023-09-30T22:25:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa325e80700 1 -- 172.21.15.154:0/2932264621 learned_addr learned my addr 172.21.15.154:0/2932264621 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:56.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.446+0000 7fa32567f700 1 --2- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3200a08e0 0x7fa320126540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.447+0000 7fa32567f700 1 -- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa320138040 msgr2=0x7fa320126fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.447+0000 7fa32567f700 1 --2- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa320138040 0x7fa320126fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.447+0000 7fa32567f700 1 -- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3200a1230 msgr2=0x7fa320126a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.447+0000 7fa32567f700 1 --2- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3200a1230 0x7fa320126a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.447+0000 7fa32567f700 1 -- 172.21.15.154:0/2932264621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c009550 con 0x7fa3200a08e0 2023-09-30T22:25:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.447+0000 7fa325e80700 1 --2- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa320138040 0x7fa320126fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.447+0000 7fa32567f700 1 --2- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3200a08e0 0x7fa320126540 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b450 tx=0x7fa31400b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.448+0000 7fa311ffb700 1 -- 172.21.15.154:0/2932264621 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314011830 con 0x7fa3200a08e0 2023-09-30T22:25:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.448+0000 7fa311ffb700 1 -- 172.21.15.154:0/2932264621 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3140119b0 con 0x7fa3200a08e0 2023-09-30T22:25:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.448+0000 7fa311ffb700 1 -- 172.21.15.154:0/2932264621 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314011d60 con 0x7fa3200a08e0 2023-09-30T22:25:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.448+0000 7fa3278e3700 1 -- 172.21.15.154:0/2932264621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa320129fd0 con 0x7fa3200a08e0 2023-09-30T22:25:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.448+0000 7fa3278e3700 1 -- 172.21.15.154:0/2932264621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32009a240 con 0x7fa3200a08e0 2023-09-30T22:25:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.449+0000 7fa311ffb700 1 -- 172.21.15.154:0/2932264621 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa31401a400 con 0x7fa3200a08e0 2023-09-30T22:25:56.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.449+0000 7fa311ffb700 1 -- 172.21.15.154:0/2932264621 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa31403f660 con 0x7fa3200a08e0 2023-09-30T22:25:56.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.451+0000 7fa3278e3700 1 -- 172.21.15.154:0/2932264621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32004f2a0 con 0x7fa3200a08e0 2023-09-30T22:25:56.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.459+0000 7fa311ffb700 1 -- 172.21.15.154:0/2932264621 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa31400f8d0 con 0x7fa3200a08e0 2023-09-30T22:25:56.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.479+0000 7fc9c155c700 1 Processor -- start 2023-09-30T22:25:56.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.479+0000 7fc9c155c700 1 -- start start 2023-09-30T22:25:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.480+0000 7fc9c155c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc133ad0 0x7fc9bc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.480+0000 7fc9c155c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc1300a0 0x7fc9bc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.480+0000 7fc9c155c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc06b2d0 con 0x7fc9bc1309f0 2023-09-30T22:25:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.480+0000 7fc9c155c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc133610 con 0x7fc9bc133ad0 2023-09-30T22:25:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.480+0000 7fc9c155c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc09a500 con 0x7fc9bc1300a0 2023-09-30T22:25:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.480+0000 7fc9ba7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc1300a0 0x7fc9bc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.480+0000 7fc9ba7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc1300a0 0x7fc9bc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39576/0 (socket says 172.21.15.154:39576) 2023-09-30T22:25:56.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.480+0000 7fc9ba7fc700 1 -- 172.21.15.154:0/825764999 learned_addr learned my addr 172.21.15.154:0/825764999 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:56.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.480+0000 7fc9baffd700 1 --2- 172.21.15.154:0/825764999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc133ad0 0x7fc9bc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.481+0000 7fc9ba7fc700 1 -- 172.21.15.154:0/825764999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc133ad0 msgr2=0x7fc9bc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.481+0000 7fc9ba7fc700 1 --2- 172.21.15.154:0/825764999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc133ad0 0x7fc9bc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.481+0000 7fc9ba7fc700 1 -- 172.21.15.154:0/825764999 >> v1:172.21.15.154:6789/0 conn(0x7fc9bc1309f0 legacy=0x7fc9bc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.481+0000 7fc9ba7fc700 1 -- 172.21.15.154:0/825764999 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc1338b0 con 0x7fc9bc1300a0 2023-09-30T22:25:56.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.481+0000 7fc9ba7fc700 1 --2- 172.21.15.154:0/825764999 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc1300a0 0x7fc9bc1304b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009920 tx=0x7fc9b0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b84907eca42d5bbb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.481+0000 7fc9b9ffb700 1 -- 172.21.15.154:0/825764999 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000ba60 con 0x7fc9bc1300a0 2023-09-30T22:25:56.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.481+0000 7fc9b9ffb700 1 -- 172.21.15.154:0/825764999 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b000bbc0 con 0x7fc9bc1300a0 2023-09-30T22:25:56.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.481+0000 7fc9b9ffb700 1 -- 172.21.15.154:0/825764999 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0009e70 con 0x7fc9bc1300a0 2023-09-30T22:25:56.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.482+0000 7fc9c155c700 1 -- 172.21.15.154:0/825764999 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc1300a0 msgr2=0x7fc9bc1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.482+0000 7fc9c155c700 1 --2- 172.21.15.154:0/825764999 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc1300a0 0x7fc9bc1304b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009920 tx=0x7fc9b0009c30 comp rx=0 tx=0).stop 2023-09-30T22:25:56.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.482+0000 7fc9c155c700 1 -- 172.21.15.154:0/825764999 shutdown_connections 2023-09-30T22:25:56.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.482+0000 7fc9c155c700 1 --2- 172.21.15.154:0/825764999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc133ad0 0x7fc9bc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.482+0000 7fc9c155c700 1 --2- 172.21.15.154:0/825764999 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc1300a0 0x7fc9bc1304b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.482+0000 7fc9c155c700 1 -- 172.21.15.154:0/825764999 >> 172.21.15.154:0/825764999 conn(0x7fc9bc099c40 msgr2=0x7fc9bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.482+0000 7fc9c155c700 1 -- 172.21.15.154:0/825764999 shutdown_connections 2023-09-30T22:25:56.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.482+0000 7fc9c155c700 1 -- 172.21.15.154:0/825764999 wait complete. 2023-09-30T22:25:56.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.484+0000 7fc9c155c700 1 Processor -- start 2023-09-30T22:25:56.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.484+0000 7fc9c155c700 1 -- start start 2023-09-30T22:25:56.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.484+0000 7fc9c155c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9bc1300a0 0x7fc9bc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.484+0000 7fc9c155c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc1309f0 0x7fc9bc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.484+0000 7fc9c155c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc133ad0 0x7fc9bc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.484+0000 7fc9c155c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc12dd00 con 0x7fc9bc1300a0 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.484+0000 7fc9c155c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc120d90 con 0x7fc9bc1309f0 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.484+0000 7fc9c155c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc11fc10 con 0x7fc9bc133ad0 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9baffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9bc1300a0 0x7fc9bc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9baffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9bc1300a0 0x7fc9bc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59200/0 (socket says 172.21.15.154:59200) 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9baffd700 1 -- 172.21.15.154:0/1052034239 learned_addr learned my addr 172.21.15.154:0/1052034239 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9ba7fc700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc1309f0 0x7fc9bc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9bb7fe700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc133ad0 0x7fc9bc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9baffd700 1 -- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc133ad0 msgr2=0x7fc9bc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9baffd700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc133ad0 0x7fc9bc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9baffd700 1 -- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc1309f0 msgr2=0x7fc9bc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9baffd700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc1309f0 0x7fc9bc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9baffd700 1 -- 172.21.15.154:0/1052034239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0009550 con 0x7fc9bc1300a0 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9bb7fe700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc133ad0 0x7fc9bc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9ba7fc700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc1309f0 0x7fc9bc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9baffd700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9bc1300a0 0x7fc9bc11da40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e810 tx=0x7fc9ac00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9a37fe700 1 -- 172.21.15.154:0/1052034239 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac013610 con 0x7fc9bc1300a0 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9a37fe700 1 -- 172.21.15.154:0/1052034239 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac013770 con 0x7fc9bc1300a0 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.485+0000 7fc9a37fe700 1 -- 172.21.15.154:0/1052034239 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac013b20 con 0x7fc9bc1300a0 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.486+0000 7fc9c155c700 1 -- 172.21.15.154:0/1052034239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc072220 con 0x7fc9bc1300a0 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.486+0000 7fc9c155c700 1 -- 172.21.15.154:0/1052034239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc11f900 con 0x7fc9bc1300a0 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.486+0000 7fc9a37fe700 1 -- 172.21.15.154:0/1052034239 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9ac013c80 con 0x7fc9bc1300a0 2023-09-30T22:25:56.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.487+0000 7fc9a37fe700 1 -- 172.21.15.154:0/1052034239 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc9ac03f410 con 0x7fc9bc1300a0 2023-09-30T22:25:56.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.487+0000 7fc9c155c700 1 -- 172.21.15.154:0/1052034239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc04f2a0 con 0x7fc9bc1300a0 2023-09-30T22:25:56.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.491+0000 7fc9a37fe700 1 -- 172.21.15.154:0/1052034239 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9ac012370 con 0x7fc9bc1300a0 2023-09-30T22:25:56.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.493+0000 7f095fec0700 1 Processor -- start 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.493+0000 7f095fec0700 1 -- start start 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095fec0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0958138040 0x7f0958138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095fec0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 0x7f09580a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095fec0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580a1230 0x7f095813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095fec0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580a2100 con 0x7f0958138040 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095fec0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0958138950 con 0x7f09580a1230 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095fec0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09581379e0 con 0x7f09580a08e0 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095dc5c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0958138040 0x7f0958138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095dc5c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0958138040 0x7f0958138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59202/0 (socket says 172.21.15.154:59202) 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095dc5c700 1 -- 172.21.15.154:0/1111883977 learned_addr learned my addr 172.21.15.154:0/1111883977 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095d45b700 1 --2- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 0x7f09580a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095e45d700 1 --2- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580a1230 0x7f095813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095dc5c700 1 -- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 msgr2=0x7f09580a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095dc5c700 1 --2- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 0x7f09580a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095dc5c700 1 -- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580a1230 msgr2=0x7f095813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095dc5c700 1 --2- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580a1230 0x7f095813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.494+0000 7f095dc5c700 1 -- 172.21.15.154:0/1111883977 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095809b9b0 con 0x7f0958138040 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.495+0000 7f095dc5c700 1 --2- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0958138040 0x7f0958138410 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f09540098f0 tx=0x7f0954009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df810b49a42da4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.495+0000 7f095cc5a700 1 -- 172.21.15.154:0/1111883977 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954005e30 con 0x7f0958138040 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.495+0000 7f095cc5a700 1 -- 172.21.15.154:0/1111883977 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0954004030 con 0x7f0958138040 2023-09-30T22:25:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.495+0000 7f095cc5a700 1 -- 172.21.15.154:0/1111883977 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09540043e0 con 0x7f0958138040 2023-09-30T22:25:56.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.495+0000 7f095fec0700 1 -- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0958138040 msgr2=0x7f0958138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.495+0000 7f095fec0700 1 --2- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0958138040 0x7f0958138410 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f09540098f0 tx=0x7f0954009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.496+0000 7f095fec0700 1 -- 172.21.15.154:0/1111883977 shutdown_connections 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.496+0000 7f095fec0700 1 --2- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580a1230 0x7f095813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.496+0000 7f095fec0700 1 --2- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0958138040 0x7f0958138410 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.496+0000 7f095fec0700 1 --2- 172.21.15.154:0/1111883977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 0x7f09580a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.496+0000 7f095fec0700 1 -- 172.21.15.154:0/1111883977 >> 172.21.15.154:0/1111883977 conn(0x7f09580a2980 msgr2=0x7f09580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.496+0000 7f095fec0700 1 -- 172.21.15.154:0/1111883977 shutdown_connections 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.496+0000 7f095fec0700 1 -- 172.21.15.154:0/1111883977 wait complete. 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095fec0700 1 Processor -- start 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095fec0700 1 -- start start 2023-09-30T22:25:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095fec0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 0x7f09581d5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095fec0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09580a1230 0x7f09581d5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095fec0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0958138040 0x7f0958118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095fec0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09581d5f80 con 0x7f09580a1230 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095fec0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09581d50f0 con 0x7f0958138040 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095fec0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0958134280 con 0x7f09580a08e0 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095d45b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09580a1230 0x7f09581d5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095e45d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0958138040 0x7f0958118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095d45b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09580a1230 0x7f09581d5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59210/0 (socket says 172.21.15.154:59210) 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095d45b700 1 -- 172.21.15.154:0/1946808409 learned_addr learned my addr 172.21.15.154:0/1946808409 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.497+0000 7f095dc5c700 1 --2- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 0x7f09581d5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f095d45b700 1 -- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 msgr2=0x7f09581d5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f095d45b700 1 --2- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 0x7f09581d5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f095d45b700 1 -- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0958138040 msgr2=0x7f0958118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f095d45b700 1 --2- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0958138040 0x7f0958118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f095d45b700 1 -- 172.21.15.154:0/1946808409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0954009500 con 0x7f09580a1230 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f095dc5c700 1 --2- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 0x7f09581d5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f095d45b700 1 --2- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09580a1230 0x7f09581d5a40 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f094800e870 tx=0x7f094800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f094e7fc700 1 -- 172.21.15.154:0/1946808409 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948013680 con 0x7f09580a1230 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f095fec0700 1 -- 172.21.15.154:0/1946808409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095809a240 con 0x7f09580a1230 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f095fec0700 1 -- 172.21.15.154:0/1946808409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095813daa0 con 0x7f09580a1230 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f094e7fc700 1 -- 172.21.15.154:0/1946808409 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09480137e0 con 0x7f09580a1230 2023-09-30T22:25:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.498+0000 7f094e7fc700 1 -- 172.21.15.154:0/1946808409 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948013b50 con 0x7f09580a1230 2023-09-30T22:25:56.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.499+0000 7f094e7fc700 1 -- 172.21.15.154:0/1946808409 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0948013cb0 con 0x7f09580a1230 2023-09-30T22:25:56.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.499+0000 7f094e7fc700 1 -- 172.21.15.154:0/1946808409 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f094803fb60 con 0x7f09580a1230 2023-09-30T22:25:56.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.499+0000 7f095fec0700 1 -- 172.21.15.154:0/1946808409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09400052e0 con 0x7f09580a1230 2023-09-30T22:25:56.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.504+0000 7f094e7fc700 1 -- 172.21.15.154:0/1946808409 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0948017080 con 0x7f09580a1230 2023-09-30T22:25:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.523+0000 7fc162985700 1 Processor -- start 2023-09-30T22:25:56.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.523+0000 7fc162985700 1 -- start start 2023-09-30T22:25:56.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc162985700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc15c131980 0x7fc15c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc162985700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c09bc70 0x7fc15c09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc162985700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09c5c0 0x7fc15c138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc162985700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15c06eb30 con 0x7fc15c131980 2023-09-30T22:25:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc162985700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c0a1640 con 0x7fc15c09c5c0 2023-09-30T22:25:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc162985700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c0a22d0 con 0x7fc15c09bc70 2023-09-30T22:25:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc160f22700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09c5c0 0x7fc15c138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc160f22700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09c5c0 0x7fc15c138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59510/0 (socket says 172.21.15.154:59510) 2023-09-30T22:25:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc15b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c09bc70 0x7fc15c09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc160f22700 1 -- 172.21.15.154:0/3894092544 learned_addr learned my addr 172.21.15.154:0/3894092544 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc15bfff700 1 --2- 172.21.15.154:0/3894092544 >> v2:172.21.15.154:3300/0 conn(0x7fc15c131980 0x7fc15c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc160f22700 1 -- 172.21.15.154:0/3894092544 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c09bc70 msgr2=0x7fc15c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc160f22700 1 --2- 172.21.15.154:0/3894092544 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c09bc70 0x7fc15c09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc160f22700 1 -- 172.21.15.154:0/3894092544 >> v2:172.21.15.154:3300/0 conn(0x7fc15c131980 msgr2=0x7fc15c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc160f22700 1 --2- 172.21.15.154:0/3894092544 >> v2:172.21.15.154:3300/0 conn(0x7fc15c131980 0x7fc15c131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc160f22700 1 -- 172.21.15.154:0/3894092544 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c131550 con 0x7fc15c09c5c0 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc15b7fe700 1 --2- 172.21.15.154:0/3894092544 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c09bc70 0x7fc15c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.524+0000 7fc15bfff700 1 --2- 172.21.15.154:0/3894092544 >> v2:172.21.15.154:3300/0 conn(0x7fc15c131980 0x7fc15c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc160f22700 1 --2- 172.21.15.154:0/3894092544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09c5c0 0x7fc15c138700 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc154009e50 tx=0x7fc15400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a729bf932f1c5226 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc15affd700 1 -- 172.21.15.154:0/3894092544 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400e070 con 0x7fc15c09c5c0 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc15affd700 1 -- 172.21.15.154:0/3894092544 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15400b910 con 0x7fc15c09c5c0 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc15affd700 1 -- 172.21.15.154:0/3894092544 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15400bcc0 con 0x7fc15c09c5c0 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc162985700 1 -- 172.21.15.154:0/3894092544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09c5c0 msgr2=0x7fc15c138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc162985700 1 --2- 172.21.15.154:0/3894092544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09c5c0 0x7fc15c138700 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc154009e50 tx=0x7fc15400b330 comp rx=0 tx=0).stop 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc162985700 1 -- 172.21.15.154:0/3894092544 shutdown_connections 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc162985700 1 --2- 172.21.15.154:0/3894092544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09c5c0 0x7fc15c138700 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc162985700 1 --2- 172.21.15.154:0/3894092544 >> v2:172.21.15.154:3300/0 conn(0x7fc15c131980 0x7fc15c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc162985700 1 --2- 172.21.15.154:0/3894092544 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c09bc70 0x7fc15c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc162985700 1 -- 172.21.15.154:0/3894092544 >> 172.21.15.154:0/3894092544 conn(0x7fc15c0a2980 msgr2=0x7fc15c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.525+0000 7fc162985700 1 -- 172.21.15.154:0/3894092544 shutdown_connections 2023-09-30T22:25:56.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.526+0000 7fc162985700 1 -- 172.21.15.154:0/3894092544 wait complete. 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.526+0000 7fc162985700 1 Processor -- start 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc162985700 1 -- start start 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc162985700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09bc70 0x7fc15c119740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc162985700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc15c09c5c0 0x7fc15c119c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc162985700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c131980 0x7fc15c11a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc162985700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c11cad0 con 0x7fc15c09c5c0 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc162985700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c11b3f0 con 0x7fc15c09bc70 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc162985700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc15c11cf80 con 0x7fc15c131980 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc15bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09bc70 0x7fc15c119740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc15bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09bc70 0x7fc15c119740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59522/0 (socket says 172.21.15.154:59522) 2023-09-30T22:25:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc15bfff700 1 -- 172.21.15.154:0/165698445 learned_addr learned my addr 172.21.15.154:0/165698445 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc160f22700 1 --2- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c131980 0x7fc15c11a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.527+0000 7fc15b7fe700 1 --2- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc15c09c5c0 0x7fc15c119c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc160f22700 1 -- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09bc70 msgr2=0x7fc15c119740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc160f22700 1 --2- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09bc70 0x7fc15c119740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc160f22700 1 -- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc15c09c5c0 msgr2=0x7fc15c119c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc160f22700 1 --2- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc15c09c5c0 0x7fc15c119c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc160f22700 1 -- 172.21.15.154:0/165698445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15000d940 con 0x7fc15c131980 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc160f22700 1 --2- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c131980 0x7fc15c11a1c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc154015000 tx=0x7fc154004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc158ff9700 1 -- 172.21.15.154:0/165698445 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1540092e0 con 0x7fc15c131980 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc158ff9700 1 -- 172.21.15.154:0/165698445 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc154004250 con 0x7fc15c131980 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc162985700 1 -- 172.21.15.154:0/165698445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc154009b30 con 0x7fc15c131980 2023-09-30T22:25:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc158ff9700 1 -- 172.21.15.154:0/165698445 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154004620 con 0x7fc15c131980 2023-09-30T22:25:56.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.528+0000 7fc162985700 1 -- 172.21.15.154:0/165698445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c11c5a0 con 0x7fc15c131980 2023-09-30T22:25:56.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.529+0000 7fc158ff9700 1 -- 172.21.15.154:0/165698445 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc154004780 con 0x7fc15c131980 2023-09-30T22:25:56.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.529+0000 7fc158ff9700 1 -- 172.21.15.154:0/165698445 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc154040930 con 0x7fc15c131980 2023-09-30T22:25:56.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.529+0000 7fc162985700 1 -- 172.21.15.154:0/165698445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15c04f2a0 con 0x7fc15c131980 2023-09-30T22:25:56.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.534+0000 7fc158ff9700 1 -- 172.21.15.154:0/165698445 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc154020070 con 0x7fc15c131980 2023-09-30T22:25:56.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.700+0000 7f095fec0700 1 -- 172.21.15.154:0/1946808409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0940005590 con 0x7f09580a1230 2023-09-30T22:25:56.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.700+0000 7f094e7fc700 1 -- 172.21.15.154:0/1946808409 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0948024350 con 0x7f09580a1230 2023-09-30T22:25:56.702 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:56.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.702+0000 7f095fec0700 1 -- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09580a1230 msgr2=0x7f09581d5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.702+0000 7f095fec0700 1 --2- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09580a1230 0x7f09581d5a40 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f094800e870 tx=0x7f094800eb80 comp rx=0 tx=0).stop 2023-09-30T22:25:56.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.702+0000 7f095fec0700 1 -- 172.21.15.154:0/1946808409 shutdown_connections 2023-09-30T22:25:56.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.702+0000 7f095fec0700 1 --2- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0958138040 0x7f0958118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.702+0000 7f095fec0700 1 --2- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09580a08e0 0x7f09581d5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.702+0000 7f095fec0700 1 --2- 172.21.15.154:0/1946808409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09580a1230 0x7f09581d5a40 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.702+0000 7f095fec0700 1 -- 172.21.15.154:0/1946808409 >> 172.21.15.154:0/1946808409 conn(0x7f09580a2980 msgr2=0x7f095809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.703+0000 7f095fec0700 1 -- 172.21.15.154:0/1946808409 shutdown_connections 2023-09-30T22:25:56.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.703+0000 7f095fec0700 1 -- 172.21.15.154:0/1946808409 wait complete. 2023-09-30T22:25:56.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.723+0000 7fa3278e3700 1 -- 172.21.15.154:0/2932264621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa32006bce0 con 0x7fa3200a08e0 2023-09-30T22:25:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.724+0000 7fa311ffb700 1 -- 172.21.15.154:0/2932264621 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa31400f2e0 con 0x7fa3200a08e0 2023-09-30T22:25:56.725 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.726+0000 7fa3278e3700 1 -- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3200a08e0 msgr2=0x7fa320126540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.726+0000 7fa3278e3700 1 --2- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3200a08e0 0x7fa320126540 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b450 tx=0x7fa31400b760 comp rx=0 tx=0).stop 2023-09-30T22:25:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.726+0000 7fa3278e3700 1 -- 172.21.15.154:0/2932264621 shutdown_connections 2023-09-30T22:25:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.726+0000 7fa3278e3700 1 --2- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa320138040 0x7fa320126fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.726+0000 7fa3278e3700 1 --2- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3200a08e0 0x7fa320126540 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.726+0000 7fa3278e3700 1 --2- 172.21.15.154:0/2932264621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3200a1230 0x7fa320126a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.726+0000 7fa3278e3700 1 -- 172.21.15.154:0/2932264621 >> 172.21.15.154:0/2932264621 conn(0x7fa3200a2980 msgr2=0x7fa32009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.726+0000 7fa3278e3700 1 -- 172.21.15.154:0/2932264621 shutdown_connections 2023-09-30T22:25:56.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.726+0000 7fa3278e3700 1 -- 172.21.15.154:0/2932264621 wait complete. 2023-09-30T22:25:56.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.728+0000 7fc162985700 1 -- 172.21.15.154:0/165698445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc15c06bce0 con 0x7fc15c131980 2023-09-30T22:25:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.728+0000 7fc158ff9700 1 -- 172.21.15.154:0/165698445 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc154011ce0 con 0x7fc15c131980 2023-09-30T22:25:56.729 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:56.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.730+0000 7fc162985700 1 -- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c131980 msgr2=0x7fc15c11a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.730+0000 7fc162985700 1 --2- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c131980 0x7fc15c11a1c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc154015000 tx=0x7fc154004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.730+0000 7fc162985700 1 -- 172.21.15.154:0/165698445 shutdown_connections 2023-09-30T22:25:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.730+0000 7fc162985700 1 --2- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc15c131980 0x7fc15c11a1c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.730+0000 7fc162985700 1 --2- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc15c09bc70 0x7fc15c119740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.730+0000 7fc162985700 1 --2- 172.21.15.154:0/165698445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc15c09c5c0 0x7fc15c119c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.730+0000 7fc162985700 1 -- 172.21.15.154:0/165698445 >> 172.21.15.154:0/165698445 conn(0x7fc15c0a2980 msgr2=0x7fc15c12e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.730+0000 7fc162985700 1 -- 172.21.15.154:0/165698445 shutdown_connections 2023-09-30T22:25:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.731+0000 7fc162985700 1 -- 172.21.15.154:0/165698445 wait complete. 2023-09-30T22:25:56.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:56.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.743+0000 7fc9c155c700 1 -- 172.21.15.154:0/1052034239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc9bc06c3b0 con 0x7fc9bc1300a0 2023-09-30T22:25:56.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.743+0000 7fc9a37fe700 1 -- 172.21.15.154:0/1052034239 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9ac021030 con 0x7fc9bc1300a0 2023-09-30T22:25:56.744 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:56.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:56.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.745+0000 7fc9c155c700 1 -- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9bc1300a0 msgr2=0x7fc9bc11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:56.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.745+0000 7fc9c155c700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9bc1300a0 0x7fc9bc11da40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e810 tx=0x7fc9ac00ebd0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.745+0000 7fc9c155c700 1 -- 172.21.15.154:0/1052034239 shutdown_connections 2023-09-30T22:25:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.745+0000 7fc9c155c700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9bc133ad0 0x7fc9bc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.745+0000 7fc9c155c700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9bc1300a0 0x7fc9bc11da40 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.745+0000 7fc9c155c700 1 --2- 172.21.15.154:0/1052034239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9bc1309f0 0x7fc9bc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.745+0000 7fc9c155c700 1 -- 172.21.15.154:0/1052034239 >> 172.21.15.154:0/1052034239 conn(0x7fc9bc099c40 msgr2=0x7fc9bc131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.745+0000 7fc9c155c700 1 -- 172.21.15.154:0/1052034239 shutdown_connections 2023-09-30T22:25:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:56.745+0000 7fc9c155c700 1 -- 172.21.15.154:0/1052034239 wait complete. 2023-09-30T22:25:56.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:57.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:57.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:57.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:57.759 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.886+0000 7fc5abb33700 1 Processor -- start 2023-09-30T22:25:57.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.886+0000 7fc5abb33700 1 -- start start 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.886+0000 7fc5abb33700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5a409e870 0x7fc5a409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.886+0000 7fc5abb33700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409f180 0x7fc5a4133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.886+0000 7fc5abb33700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a409fa00 con 0x7fc5a4134160 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.886+0000 7fc5abb33700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a40a0370 con 0x7fc5a409e870 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.886+0000 7fc5abb33700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a406bec0 con 0x7fc5a409f180 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a98cf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5a409e870 0x7fc5a409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a98cf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5a409e870 0x7fc5a409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59238/0 (socket says 172.21.15.154:59238) 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a98cf700 1 -- 172.21.15.154:0/2350740701 learned_addr learned my addr 172.21.15.154:0/2350740701 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:57.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a98cf700 1 -- 172.21.15.154:0/2350740701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409f180 msgr2=0x7fc5a4133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a98cf700 1 --2- 172.21.15.154:0/2350740701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409f180 0x7fc5a4133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a98cf700 1 -- 172.21.15.154:0/2350740701 >> v1:172.21.15.154:6789/0 conn(0x7fc5a4134160 legacy=0x7fc5a413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a98cf700 1 -- 172.21.15.154:0/2350740701 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a409ada0 con 0x7fc5a409e870 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a98cf700 1 --2- 172.21.15.154:0/2350740701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a409e870 0x7fc5a409ec40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00098f0 tx=0x7fc5a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ded12d5972c6b37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a88cd700 1 -- 172.21.15.154:0/2350740701 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0004230 con 0x7fc5a409e870 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a88cd700 1 -- 172.21.15.154:0/2350740701 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0004390 con 0x7fc5a409e870 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.887+0000 7fc5a88cd700 1 -- 172.21.15.154:0/2350740701 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00036a0 con 0x7fc5a409e870 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.888+0000 7fc5abb33700 1 -- 172.21.15.154:0/2350740701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a409e870 msgr2=0x7fc5a409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.888+0000 7fc5abb33700 1 --2- 172.21.15.154:0/2350740701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a409e870 0x7fc5a409ec40 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00098f0 tx=0x7fc5a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.888+0000 7fc5abb33700 1 -- 172.21.15.154:0/2350740701 shutdown_connections 2023-09-30T22:25:57.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.888+0000 7fc5abb33700 1 --2- 172.21.15.154:0/2350740701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a409e870 0x7fc5a409ec40 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.888+0000 7fc5abb33700 1 --2- 172.21.15.154:0/2350740701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409f180 0x7fc5a4133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.888+0000 7fc5abb33700 1 -- 172.21.15.154:0/2350740701 >> 172.21.15.154:0/2350740701 conn(0x7fc5a40a4430 msgr2=0x7fc5a40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.888+0000 7fc5abb33700 1 -- 172.21.15.154:0/2350740701 shutdown_connections 2023-09-30T22:25:57.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.888+0000 7fc5abb33700 1 -- 172.21.15.154:0/2350740701 wait complete. 2023-09-30T22:25:57.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.889+0000 7fc5abb33700 1 Processor -- start 2023-09-30T22:25:57.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.889+0000 7fc5abb33700 1 -- start start 2023-09-30T22:25:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5abb33700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409e870 0x7fc5a4122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5abb33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5a409f180 0x7fc5a41230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5abb33700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a4134160 0x7fc5a4123630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5abb33700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a41247c0 con 0x7fc5a4134160 2023-09-30T22:25:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5abb33700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a4125090 con 0x7fc5a409e870 2023-09-30T22:25:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5abb33700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a41266d0 con 0x7fc5a409f180 2023-09-30T22:25:57.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5aa0d0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a4134160 0x7fc5a4123630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5a98cf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409e870 0x7fc5a4122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5aa0d0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a4134160 0x7fc5a4123630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59240/0 (socket says 172.21.15.154:59240) 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5aa0d0700 1 -- 172.21.15.154:0/997344509 learned_addr learned my addr 172.21.15.154:0/997344509 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5aa0d0700 1 -- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5a409f180 msgr2=0x7fc5a41230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5aa0d0700 1 --2- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5a409f180 0x7fc5a41230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5aa0d0700 1 -- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409e870 msgr2=0x7fc5a4122bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5aa0d0700 1 --2- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409e870 0x7fc5a4122bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5aa0d0700 1 -- 172.21.15.154:0/997344509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a0009550 con 0x7fc5a4134160 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5a98cf700 1 --2- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409e870 0x7fc5a4122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5aa0d0700 1 --2- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a4134160 0x7fc5a4123630 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00cc10 tx=0x7fc59c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc59a7fc700 1 -- 172.21.15.154:0/997344509 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00ab10 con 0x7fc5a4134160 2023-09-30T22:25:57.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc59a7fc700 1 -- 172.21.15.154:0/997344509 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c00ac70 con 0x7fc5a4134160 2023-09-30T22:25:57.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc5abb33700 1 -- 172.21.15.154:0/997344509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a4124d70 con 0x7fc5a4134160 2023-09-30T22:25:57.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.890+0000 7fc59a7fc700 1 -- 172.21.15.154:0/997344509 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c012420 con 0x7fc5a4134160 2023-09-30T22:25:57.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.891+0000 7fc5abb33700 1 -- 172.21.15.154:0/997344509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a41263f0 con 0x7fc5a4134160 2023-09-30T22:25:57.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.892+0000 7fc5abb33700 1 -- 172.21.15.154:0/997344509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a404f2a0 con 0x7fc5a4134160 2023-09-30T22:25:57.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.892+0000 7fc59a7fc700 1 -- 172.21.15.154:0/997344509 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc59c012580 con 0x7fc5a4134160 2023-09-30T22:25:57.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.894+0000 7fd997a9e700 1 Processor -- start 2023-09-30T22:25:57.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fc59a7fc700 1 -- 172.21.15.154:0/997344509 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc59c011780 con 0x7fc5a4134160 2023-09-30T22:25:57.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd997a9e700 1 -- start start 2023-09-30T22:25:57.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd997a9e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd99009d860 0x7fd99009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd997a9e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99009e170 0x7fd9901307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd997a9e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99009aaa0 con 0x7fd990130ce0 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd997a9e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99009f870 con 0x7fd99009d860 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd997a9e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd99009b360 con 0x7fd99009e170 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd99583a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd99009d860 0x7fd99009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd99583a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd99009d860 0x7fd99009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59246/0 (socket says 172.21.15.154:59246) 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd99583a700 1 -- 172.21.15.154:0/4034097963 learned_addr learned my addr 172.21.15.154:0/4034097963 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd995039700 1 --2- 172.21.15.154:0/4034097963 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99009e170 0x7fd9901307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.895+0000 7fd99583a700 1 -- 172.21.15.154:0/4034097963 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99009e170 msgr2=0x7fd9901307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.896+0000 7fd99583a700 1 --2- 172.21.15.154:0/4034097963 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99009e170 0x7fd9901307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.896+0000 7fd99583a700 1 -- 172.21.15.154:0/4034097963 >> v1:172.21.15.154:6789/0 conn(0x7fd990130ce0 legacy=0x7fd9901379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.896+0000 7fd99583a700 1 -- 172.21.15.154:0/4034097963 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99009b620 con 0x7fd99009d860 2023-09-30T22:25:57.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.896+0000 7fd99583a700 1 --2- 172.21.15.154:0/4034097963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99009d860 0x7fd99009dc30 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fd98c010bb0 tx=0x7fd98c010ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762eda30a333a4fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.897+0000 7fd994838700 1 -- 172.21.15.154:0/4034097963 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c004030 con 0x7fd99009d860 2023-09-30T22:25:57.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.897+0000 7fd994838700 1 -- 172.21.15.154:0/4034097963 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c004190 con 0x7fd99009d860 2023-09-30T22:25:57.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.897+0000 7fd994838700 1 -- 172.21.15.154:0/4034097963 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c004520 con 0x7fd99009d860 2023-09-30T22:25:57.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.897+0000 7fc59a7fc700 1 -- 172.21.15.154:0/997344509 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc59c012cb0 con 0x7fc5a4134160 2023-09-30T22:25:57.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.898+0000 7fd997a9e700 1 -- 172.21.15.154:0/4034097963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99009d860 msgr2=0x7fd99009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.898+0000 7fd997a9e700 1 --2- 172.21.15.154:0/4034097963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99009d860 0x7fd99009dc30 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fd98c010bb0 tx=0x7fd98c010ec0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.898+0000 7fd997a9e700 1 -- 172.21.15.154:0/4034097963 shutdown_connections 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.898+0000 7fd997a9e700 1 --2- 172.21.15.154:0/4034097963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99009d860 0x7fd99009dc30 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.898+0000 7fd997a9e700 1 --2- 172.21.15.154:0/4034097963 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd99009e170 0x7fd9901307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.898+0000 7fd997a9e700 1 -- 172.21.15.154:0/4034097963 >> 172.21.15.154:0/4034097963 conn(0x7fd990099c40 msgr2=0x7fd9900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.898+0000 7fd997a9e700 1 -- 172.21.15.154:0/4034097963 shutdown_connections 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.898+0000 7fd997a9e700 1 -- 172.21.15.154:0/4034097963 wait complete. 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.899+0000 7fd997a9e700 1 Processor -- start 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.899+0000 7fd997a9e700 1 -- start start 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.900+0000 7fd997a9e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99009d860 0x7fd9901c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.900+0000 7fd997a9e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99009e170 0x7fd9901c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.900+0000 7fd997a9e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd990130ce0 0x7fd9901c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.900+0000 7fd997a9e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd990120430 con 0x7fd99009e170 2023-09-30T22:25:57.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.900+0000 7fd997a9e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd990121da0 con 0x7fd99009d860 2023-09-30T22:25:57.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.900+0000 7fd997a9e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900a21b0 con 0x7fd990130ce0 2023-09-30T22:25:57.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.900+0000 7fd99583a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99009d860 0x7fd9901c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.900+0000 7fd99583a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99009d860 0x7fd9901c3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59534/0 (socket says 172.21.15.154:59534) 2023-09-30T22:25:57.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.900+0000 7fd99583a700 1 -- 172.21.15.154:0/164327484 learned_addr learned my addr 172.21.15.154:0/164327484 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:57.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd99603b700 1 --2- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd990130ce0 0x7fd9901c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd99583a700 1 -- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd990130ce0 msgr2=0x7fd9901c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd99583a700 1 --2- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd990130ce0 0x7fd9901c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd99583a700 1 -- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99009e170 msgr2=0x7fd9901c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd99583a700 1 --2- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99009e170 0x7fd9901c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd99583a700 1 -- 172.21.15.154:0/164327484 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c010810 con 0x7fd99009d860 2023-09-30T22:25:57.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd99583a700 1 --2- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99009d860 0x7fd9901c3ff0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd98c01a040 tx=0x7fd98c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd9867fc700 1 -- 172.21.15.154:0/164327484 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c023640 con 0x7fd99009d860 2023-09-30T22:25:57.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7f44e6fa9700 1 Processor -- start 2023-09-30T22:25:57.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd9867fc700 1 -- 172.21.15.154:0/164327484 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c003e90 con 0x7fd99009d860 2023-09-30T22:25:57.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7fd9867fc700 1 -- 172.21.15.154:0/164327484 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c023a00 con 0x7fd99009d860 2023-09-30T22:25:57.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.901+0000 7f44e6fa9700 1 -- start start 2023-09-30T22:25:57.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e6fa9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44e009e800 0x7f44e012d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e6fa9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e0130120 0x7f44e0130570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e6fa9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130ab0 0x7f44e0137470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e6fa9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e009b180 con 0x7f44e009e800 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e6fa9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0130f00 con 0x7f44e0130ab0 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e6fa9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44e009ebd0 con 0x7f44e0130120 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44dffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e0130120 0x7f44e0130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e5546700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130ab0 0x7f44e0137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44dffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e0130120 0x7f44e0130570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39632/0 (socket says 172.21.15.154:39632) 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44dffff700 1 -- 172.21.15.154:0/320987961 learned_addr learned my addr 172.21.15.154:0/320987961 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:57.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e4d45700 1 --2- 172.21.15.154:0/320987961 >> v2:172.21.15.154:3300/0 conn(0x7f44e009e800 0x7f44e012d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e5546700 1 -- 172.21.15.154:0/320987961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e0130120 msgr2=0x7f44e0130570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e5546700 1 --2- 172.21.15.154:0/320987961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e0130120 0x7f44e0130570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e5546700 1 -- 172.21.15.154:0/320987961 >> v2:172.21.15.154:3300/0 conn(0x7f44e009e800 msgr2=0x7f44e012d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e5546700 1 --2- 172.21.15.154:0/320987961 >> v2:172.21.15.154:3300/0 conn(0x7f44e009e800 0x7f44e012d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7f44e5546700 1 -- 172.21.15.154:0/320987961 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e009b440 con 0x7f44e0130ab0 2023-09-30T22:25:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.903+0000 7f44e5546700 1 --2- 172.21.15.154:0/320987961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130ab0 0x7f44e0137470 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009d90 tx=0x7f44d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=341fee176811920f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.903+0000 7f44df7fe700 1 -- 172.21.15.154:0/320987961 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800e070 con 0x7f44e0130ab0 2023-09-30T22:25:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.903+0000 7f44df7fe700 1 -- 172.21.15.154:0/320987961 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d800bb20 con 0x7f44e0130ab0 2023-09-30T22:25:57.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.903+0000 7f44df7fe700 1 -- 172.21.15.154:0/320987961 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8012430 con 0x7f44e0130ab0 2023-09-30T22:25:57.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7fd997a9e700 1 -- 172.21.15.154:0/164327484 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99009c8b0 con 0x7fd99009d860 2023-09-30T22:25:57.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.902+0000 7fd997a9e700 1 -- 172.21.15.154:0/164327484 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9901210a0 con 0x7fd99009d860 2023-09-30T22:25:57.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.903+0000 7fd9867fc700 1 -- 172.21.15.154:0/164327484 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd98c023b60 con 0x7fd99009d860 2023-09-30T22:25:57.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.903+0000 7fd9867fc700 1 -- 172.21.15.154:0/164327484 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd98c045720 con 0x7fd99009d860 2023-09-30T22:25:57.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.903+0000 7fd997a9e700 1 -- 172.21.15.154:0/164327484 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99004f2a0 con 0x7fd99009d860 2023-09-30T22:25:57.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.904+0000 7f44e6fa9700 1 -- 172.21.15.154:0/320987961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130ab0 msgr2=0x7f44e0137470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.904+0000 7f44e6fa9700 1 --2- 172.21.15.154:0/320987961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130ab0 0x7f44e0137470 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009d90 tx=0x7f44d800b330 comp rx=0 tx=0).stop 2023-09-30T22:25:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.904+0000 7f44e6fa9700 1 -- 172.21.15.154:0/320987961 shutdown_connections 2023-09-30T22:25:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.904+0000 7f44e6fa9700 1 --2- 172.21.15.154:0/320987961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130ab0 0x7f44e0137470 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.904+0000 7f44e6fa9700 1 --2- 172.21.15.154:0/320987961 >> v2:172.21.15.154:3300/0 conn(0x7f44e009e800 0x7f44e012d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.904+0000 7f44e6fa9700 1 --2- 172.21.15.154:0/320987961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e0130120 0x7f44e0130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.904+0000 7f44e6fa9700 1 -- 172.21.15.154:0/320987961 >> 172.21.15.154:0/320987961 conn(0x7f44e00a2ef0 msgr2=0x7f44e00a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.904+0000 7f44e6fa9700 1 -- 172.21.15.154:0/320987961 shutdown_connections 2023-09-30T22:25:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.904+0000 7f44e6fa9700 1 -- 172.21.15.154:0/320987961 wait complete. 2023-09-30T22:25:57.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.905+0000 7f44e6fa9700 1 Processor -- start 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.905+0000 7f44e6fa9700 1 -- start start 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e6fa9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e009e800 0x7f44e0119540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e6fa9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130120 0x7f44e0119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e6fa9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e0130ab0 0x7f44e0119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e6fa9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e011c550 con 0x7f44e0130ab0 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e6fa9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e011b000 con 0x7f44e0130120 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e6fa9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44e011b5b0 con 0x7f44e009e800 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44dffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130120 0x7f44e0119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44dffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130120 0x7f44e0119a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59550/0 (socket says 172.21.15.154:59550) 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44dffff700 1 -- 172.21.15.154:0/3351575429 learned_addr learned my addr 172.21.15.154:0/3351575429 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e5546700 1 --2- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e0130ab0 0x7f44e0119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e4d45700 1 --2- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e009e800 0x7f44e0119540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e5546700 1 -- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e009e800 msgr2=0x7f44e0119540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e5546700 1 --2- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e009e800 0x7f44e0119540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e5546700 1 -- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130120 msgr2=0x7f44e0119a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e5546700 1 --2- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130120 0x7f44e0119a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e5546700 1 -- 172.21.15.154:0/3351575429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d8009a70 con 0x7f44e0130ab0 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44e5546700 1 --2- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e0130ab0 0x7f44e0119fc0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f44d8016000 tx=0x7f44d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.906+0000 7f44dd7fa700 1 -- 172.21.15.154:0/3351575429 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d80098f0 con 0x7f44e0130ab0 2023-09-30T22:25:57.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.907+0000 7f44e6fa9700 1 -- 172.21.15.154:0/3351575429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e011a8b0 con 0x7f44e0130ab0 2023-09-30T22:25:57.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.907+0000 7f44e6fa9700 1 -- 172.21.15.154:0/3351575429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e012a810 con 0x7f44e0130ab0 2023-09-30T22:25:57.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.907+0000 7f44dd7fa700 1 -- 172.21.15.154:0/3351575429 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d8020070 con 0x7f44e0130ab0 2023-09-30T22:25:57.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.907+0000 7f44dd7fa700 1 -- 172.21.15.154:0/3351575429 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d80276c0 con 0x7f44e0130ab0 2023-09-30T22:25:57.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.908+0000 7f44dd7fa700 1 -- 172.21.15.154:0/3351575429 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44d8012430 con 0x7f44e0130ab0 2023-09-30T22:25:57.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.908+0000 7f44e6fa9700 1 -- 172.21.15.154:0/3351575429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c00052e0 con 0x7f44e0130ab0 2023-09-30T22:25:57.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.908+0000 7f44dd7fa700 1 -- 172.21.15.154:0/3351575429 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f44d8022070 con 0x7f44e0130ab0 2023-09-30T22:25:57.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.909+0000 7fd9867fc700 1 -- 172.21.15.154:0/164327484 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd98c030020 con 0x7fd99009d860 2023-09-30T22:25:57.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.917+0000 7f44dd7fa700 1 -- 172.21.15.154:0/3351575429 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44d801b400 con 0x7f44e0130ab0 2023-09-30T22:25:57.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.934+0000 7f467b20a700 1 Processor -- start 2023-09-30T22:25:57.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.934+0000 7f467b20a700 1 -- start start 2023-09-30T22:25:57.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.934+0000 7f467b20a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 0x7f46740a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.934+0000 7f467b20a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46740a1380 0x7f4674133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.934+0000 7f467b20a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467409dc00 con 0x7f4674133f50 2023-09-30T22:25:57.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.934+0000 7f467b20a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467409ea60 con 0x7f46740a1380 2023-09-30T22:25:57.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.934+0000 7f467b20a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467409dec0 con 0x7f46740a0a70 2023-09-30T22:25:57.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f4673fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46740a1380 0x7f4674133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f4673fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46740a1380 0x7f4674133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59262/0 (socket says 172.21.15.154:59262) 2023-09-30T22:25:57.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f4673fff700 1 -- 172.21.15.154:0/2693783295 learned_addr learned my addr 172.21.15.154:0/2693783295 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:57.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f4678fa6700 1 --2- 172.21.15.154:0/2693783295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 0x7f46740a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f4673fff700 1 -- 172.21.15.154:0/2693783295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 msgr2=0x7f46740a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:57.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f4673fff700 1 --2- 172.21.15.154:0/2693783295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 0x7f46740a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f4673fff700 1 -- 172.21.15.154:0/2693783295 >> v1:172.21.15.154:6789/0 conn(0x7f4674133f50 legacy=0x7f467413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f4673fff700 1 -- 172.21.15.154:0/2693783295 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467409e6a0 con 0x7f46740a1380 2023-09-30T22:25:57.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f4673fff700 1 --2- 172.21.15.154:0/2693783295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 0x7f4674133a10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f46600098f0 tx=0x7f4660009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece67f876de6f8ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f46737fe700 1 -- 172.21.15.154:0/2693783295 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000b8a0 con 0x7f46740a1380 2023-09-30T22:25:57.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f46737fe700 1 -- 172.21.15.154:0/2693783295 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000ba00 con 0x7f46740a1380 2023-09-30T22:25:57.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.935+0000 7f46737fe700 1 -- 172.21.15.154:0/2693783295 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000bd90 con 0x7f46740a1380 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.936+0000 7f467b20a700 1 -- 172.21.15.154:0/2693783295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 msgr2=0x7f4674133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.936+0000 7f467b20a700 1 --2- 172.21.15.154:0/2693783295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 0x7f4674133a10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f46600098f0 tx=0x7f4660009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.936+0000 7f467b20a700 1 -- 172.21.15.154:0/2693783295 shutdown_connections 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.936+0000 7f467b20a700 1 --2- 172.21.15.154:0/2693783295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 0x7f46740a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.936+0000 7f467b20a700 1 --2- 172.21.15.154:0/2693783295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 0x7f4674133a10 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.936+0000 7f467b20a700 1 -- 172.21.15.154:0/2693783295 >> 172.21.15.154:0/2693783295 conn(0x7f46740a6610 msgr2=0x7f46740a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.936+0000 7f467b20a700 1 -- 172.21.15.154:0/2693783295 shutdown_connections 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.936+0000 7f467b20a700 1 -- 172.21.15.154:0/2693783295 wait complete. 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.937+0000 7f467b20a700 1 Processor -- start 2023-09-30T22:25:57.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.938+0000 7f467b20a700 1 -- start start 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.938+0000 7f467b20a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 0x7f46741232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.938+0000 7f467b20a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 0x7f4674123830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.938+0000 7f467b20a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4674133f50 0x7f46741c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.938+0000 7f467b20a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4674126030 con 0x7f46740a1380 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.938+0000 7f467b20a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4674124ec0 con 0x7f46740a0a70 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.938+0000 7f467b20a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4674122f00 con 0x7f4674133f50 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.938+0000 7f46797a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4674133f50 0x7f46741c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f46797a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4674133f50 0x7f46741c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39662/0 (socket says 172.21.15.154:39662) 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f46797a7700 1 -- 172.21.15.154:0/591110505 learned_addr learned my addr 172.21.15.154:0/591110505 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f4673fff700 1 --2- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 0x7f4674123830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f4678fa6700 1 --2- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 0x7f46741232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:57.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f4673fff700 1 -- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4674133f50 msgr2=0x7f46741c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f4673fff700 1 --2- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4674133f50 0x7f46741c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f4673fff700 1 -- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 msgr2=0x7f46741232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:57.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f4673fff700 1 --2- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 0x7f46741232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:57.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f4673fff700 1 -- 172.21.15.154:0/591110505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009550 con 0x7f46740a1380 2023-09-30T22:25:57.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f4673fff700 1 --2- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 0x7f4674123830 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f4660016000 tx=0x7f4660004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:57.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f46717fa700 1 -- 172.21.15.154:0/591110505 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660004380 con 0x7f46740a1380 2023-09-30T22:25:57.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f46717fa700 1 -- 172.21.15.154:0/591110505 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466001f070 con 0x7f46740a1380 2023-09-30T22:25:57.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f467b20a700 1 -- 172.21.15.154:0/591110505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4674126260 con 0x7f46740a1380 2023-09-30T22:25:57.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f46717fa700 1 -- 172.21.15.154:0/591110505 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600036a0 con 0x7f46740a1380 2023-09-30T22:25:57.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.939+0000 7f467b20a700 1 -- 172.21.15.154:0/591110505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46741252a0 con 0x7f46740a1380 2023-09-30T22:25:57.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.940+0000 7f46717fa700 1 -- 172.21.15.154:0/591110505 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4660021030 con 0x7f46740a1380 2023-09-30T22:25:57.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.941+0000 7f46717fa700 1 -- 172.21.15.154:0/591110505 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4660040b70 con 0x7f46740a1380 2023-09-30T22:25:57.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.941+0000 7f467b20a700 1 -- 172.21.15.154:0/591110505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4674133ad0 con 0x7f46740a1380 2023-09-30T22:25:57.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:57.950+0000 7f46717fa700 1 -- 172.21.15.154:0/591110505 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46600239c0 con 0x7f46740a1380 2023-09-30T22:25:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.103+0000 7fc5abb33700 1 -- 172.21.15.154:0/997344509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc5a4072d60 con 0x7fc5a4134160 2023-09-30T22:25:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.104+0000 7fc59a7fc700 1 -- 172.21.15.154:0/997344509 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc59c021020 con 0x7fc5a4134160 2023-09-30T22:25:58.105 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:58.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.106+0000 7fc5abb33700 1 -- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a4134160 msgr2=0x7fc5a4123630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.106+0000 7fc5abb33700 1 --2- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a4134160 0x7fc5a4123630 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00cc10 tx=0x7fc59c00cf20 comp rx=0 tx=0).stop 2023-09-30T22:25:58.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.106+0000 7fc5abb33700 1 -- 172.21.15.154:0/997344509 shutdown_connections 2023-09-30T22:25:58.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.106+0000 7fc5abb33700 1 --2- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a4134160 0x7fc5a4123630 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.106+0000 7fc5abb33700 1 --2- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a409e870 0x7fc5a4122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.106+0000 7fc5abb33700 1 --2- 172.21.15.154:0/997344509 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5a409f180 0x7fc5a41230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.106+0000 7fc5abb33700 1 -- 172.21.15.154:0/997344509 >> 172.21.15.154:0/997344509 conn(0x7fc5a40a4430 msgr2=0x7fc5a40a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.106+0000 7fc5abb33700 1 -- 172.21.15.154:0/997344509 shutdown_connections 2023-09-30T22:25:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.106+0000 7fc5abb33700 1 -- 172.21.15.154:0/997344509 wait complete. 2023-09-30T22:25:58.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.107+0000 7fd997a9e700 1 -- 172.21.15.154:0/164327484 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd990071ee0 con 0x7fd99009d860 2023-09-30T22:25:58.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.108+0000 7fd9867fc700 1 -- 172.21.15.154:0/164327484 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd98c023e10 con 0x7fd99009d860 2023-09-30T22:25:58.110 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:58.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.110+0000 7fd997a9e700 1 -- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99009d860 msgr2=0x7fd9901c3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.110+0000 7fd997a9e700 1 --2- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99009d860 0x7fd9901c3ff0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd98c01a040 tx=0x7fd98c004750 comp rx=0 tx=0).stop 2023-09-30T22:25:58.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.110+0000 7fd997a9e700 1 -- 172.21.15.154:0/164327484 shutdown_connections 2023-09-30T22:25:58.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.110+0000 7fd997a9e700 1 --2- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd990130ce0 0x7fd9901c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.110+0000 7fd997a9e700 1 --2- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd99009d860 0x7fd9901c3ff0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.110+0000 7fd997a9e700 1 --2- 172.21.15.154:0/164327484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd99009e170 0x7fd9901c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.110+0000 7fd997a9e700 1 -- 172.21.15.154:0/164327484 >> 172.21.15.154:0/164327484 conn(0x7fd990099c40 msgr2=0x7fd990070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.110+0000 7fd997a9e700 1 -- 172.21.15.154:0/164327484 shutdown_connections 2023-09-30T22:25:58.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.110+0000 7fd997a9e700 1 -- 172.21.15.154:0/164327484 wait complete. 2023-09-30T22:25:58.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:58.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:58.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.153+0000 7f44e6fa9700 1 -- 172.21.15.154:0/3351575429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f44c0005590 con 0x7f44e0130ab0 2023-09-30T22:25:58.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.153+0000 7f44dd7fa700 1 -- 172.21.15.154:0/3351575429 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44d8025380 con 0x7f44e0130ab0 2023-09-30T22:25:58.154 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:58.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.155+0000 7f44e6fa9700 1 -- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e0130ab0 msgr2=0x7f44e0119fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.155+0000 7f44e6fa9700 1 --2- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e0130ab0 0x7f44e0119fc0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f44d8016000 tx=0x7f44d8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.155+0000 7f44e6fa9700 1 -- 172.21.15.154:0/3351575429 shutdown_connections 2023-09-30T22:25:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.155+0000 7f44e6fa9700 1 --2- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e0130ab0 0x7f44e0119fc0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.155+0000 7f44e6fa9700 1 --2- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44e009e800 0x7f44e0119540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.155+0000 7f44e6fa9700 1 --2- 172.21.15.154:0/3351575429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e0130120 0x7f44e0119a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.155+0000 7f44e6fa9700 1 -- 172.21.15.154:0/3351575429 >> 172.21.15.154:0/3351575429 conn(0x7f44e00a2ef0 msgr2=0x7f44e012e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.155+0000 7f44e6fa9700 1 -- 172.21.15.154:0/3351575429 shutdown_connections 2023-09-30T22:25:58.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.155+0000 7f44e6fa9700 1 -- 172.21.15.154:0/3351575429 wait complete. 2023-09-30T22:25:58.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:58.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.178+0000 7f467b20a700 1 -- 172.21.15.154:0/591110505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4674124be0 con 0x7f46740a1380 2023-09-30T22:25:58.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.178+0000 7f46717fa700 1 -- 172.21.15.154:0/591110505 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4660015020 con 0x7f46740a1380 2023-09-30T22:25:58.179 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:58.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.180+0000 7f467b20a700 1 -- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 msgr2=0x7f4674123830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:58.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.180+0000 7f467b20a700 1 --2- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 0x7f4674123830 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f4660016000 tx=0x7f4660004750 comp rx=0 tx=0).stop 2023-09-30T22:25:58.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.180+0000 7f467b20a700 1 -- 172.21.15.154:0/591110505 shutdown_connections 2023-09-30T22:25:58.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.180+0000 7f467b20a700 1 --2- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4674133f50 0x7f46741c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.180+0000 7f467b20a700 1 --2- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740a0a70 0x7f46741232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.180+0000 7f467b20a700 1 --2- 172.21.15.154:0/591110505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740a1380 0x7f4674123830 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:58.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.180+0000 7f467b20a700 1 -- 172.21.15.154:0/591110505 >> 172.21.15.154:0/591110505 conn(0x7f46740a6610 msgr2=0x7f46740a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:58.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.180+0000 7f467b20a700 1 -- 172.21.15.154:0/591110505 shutdown_connections 2023-09-30T22:25:58.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:58.180+0000 7f467b20a700 1 -- 172.21.15.154:0/591110505 wait complete. 2023-09-30T22:25:58.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:25:59.126 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:25:59.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:25:59.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:25:59.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:25:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.263+0000 7f8ecd7d8700 1 Processor -- start 2023-09-30T22:25:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.263+0000 7f8ecd7d8700 1 -- start start 2023-09-30T22:25:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ecd7d8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ec8138040 0x7f8ec8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ecd7d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ec80a08e0 0x7f8ec80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ecd7d8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a1230 0x7f8ec813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ecd7d8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80a2100 con 0x7f8ec8138040 2023-09-30T22:25:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ecd7d8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8138950 con 0x7f8ec80a08e0 2023-09-30T22:25:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ecd7d8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec81379e0 con 0x7f8ec80a1230 2023-09-30T22:25:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ec77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a1230 0x7f8ec813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ec77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a1230 0x7f8ec813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39670/0 (socket says 172.21.15.154:39670) 2023-09-30T22:25:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ec77fe700 1 -- 172.21.15.154:0/3392602804 learned_addr learned my addr 172.21.15.154:0/3392602804 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ec77fe700 1 -- 172.21.15.154:0/3392602804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ec80a08e0 msgr2=0x7f8ec80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ec77fe700 1 --2- 172.21.15.154:0/3392602804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ec80a08e0 0x7f8ec80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ec77fe700 1 -- 172.21.15.154:0/3392602804 >> v2:172.21.15.154:3300/0 conn(0x7f8ec8138040 msgr2=0x7f8ec8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ec77fe700 1 --2- 172.21.15.154:0/3392602804 >> v2:172.21.15.154:3300/0 conn(0x7f8ec8138040 0x7f8ec8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.264+0000 7f8ec77fe700 1 -- 172.21.15.154:0/3392602804 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec809b9b0 con 0x7f8ec80a1230 2023-09-30T22:25:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded97b8700 1 Processor -- start 2023-09-30T22:25:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded97b8700 1 -- start start 2023-09-30T22:25:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded97b8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded97b8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded409f180 0x7fded4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded97b8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fded4131d70 0x7fded4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded97b8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded40a0920 con 0x7fded4131d70 2023-09-30T22:25:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded97b8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded409c970 con 0x7fded409f180 2023-09-30T22:25:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded97b8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fded409bab0 con 0x7fded409e870 2023-09-30T22:25:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7f8ec77fe700 1 --2- 172.21.15.154:0/3392602804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a1230 0x7f8ec813ed10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009eb0 tx=0x7f8ec000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=938b1434d18d5935 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7f8ec5ffb700 1 -- 172.21.15.154:0/3392602804 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000e070 con 0x7f8ec80a1230 2023-09-30T22:25:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7f8ec5ffb700 1 -- 172.21.15.154:0/3392602804 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec000b940 con 0x7f8ec80a1230 2023-09-30T22:25:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7f8ec5ffb700 1 -- 172.21.15.154:0/3392602804 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000bcf0 con 0x7f8ec80a1230 2023-09-30T22:25:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39680/0 (socket says 172.21.15.154:39680) 2023-09-30T22:25:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded2ffd700 1 -- 172.21.15.154:0/2927627330 learned_addr learned my addr 172.21.15.154:0/2927627330 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.265+0000 7fded27fc700 1 --2- 172.21.15.154:0/2927627330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded409f180 0x7fded4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded37fe700 1 --2- 172.21.15.154:0/2927627330 >> v2:172.21.15.154:3300/0 conn(0x7fded4131d70 0x7fded4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/3392602804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a1230 msgr2=0x7f8ec813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7f8ecd7d8700 1 --2- 172.21.15.154:0/3392602804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a1230 0x7f8ec813ed10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009eb0 tx=0x7f8ec000b330 comp rx=0 tx=0).stop 2023-09-30T22:25:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/3392602804 shutdown_connections 2023-09-30T22:25:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7f8ecd7d8700 1 --2- 172.21.15.154:0/3392602804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a1230 0x7f8ec813ed10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7f8ecd7d8700 1 --2- 172.21.15.154:0/3392602804 >> v2:172.21.15.154:3300/0 conn(0x7f8ec8138040 0x7f8ec8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7f8ecd7d8700 1 --2- 172.21.15.154:0/3392602804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ec80a08e0 0x7f8ec80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/3392602804 >> 172.21.15.154:0/3392602804 conn(0x7f8ec80a2980 msgr2=0x7f8ec80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded2ffd700 1 -- 172.21.15.154:0/2927627330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded409f180 msgr2=0x7fded4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded2ffd700 1 --2- 172.21.15.154:0/2927627330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded409f180 0x7fded4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded2ffd700 1 -- 172.21.15.154:0/2927627330 >> v2:172.21.15.154:3300/0 conn(0x7fded4131d70 msgr2=0x7fded4132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded2ffd700 1 --2- 172.21.15.154:0/2927627330 >> v2:172.21.15.154:3300/0 conn(0x7fded4131d70 0x7fded4132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded2ffd700 1 -- 172.21.15.154:0/2927627330 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded409f9c0 con 0x7fded409e870 2023-09-30T22:25:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded37fe700 1 --2- 172.21.15.154:0/2927627330 >> v2:172.21.15.154:3300/0 conn(0x7fded4131d70 0x7fded4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/3392602804 shutdown_connections 2023-09-30T22:25:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/3392602804 wait complete. 2023-09-30T22:25:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded2ffd700 1 --2- 172.21.15.154:0/2927627330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded409ec40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdec40098f0 tx=0x7fdec4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=459b210f80c3cafa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded1ffb700 1 -- 172.21.15.154:0/2927627330 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4010a90 con 0x7fded409e870 2023-09-30T22:25:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded1ffb700 1 -- 172.21.15.154:0/2927627330 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec4010bf0 con 0x7fded409e870 2023-09-30T22:25:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.266+0000 7fded1ffb700 1 -- 172.21.15.154:0/2927627330 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4018440 con 0x7fded409e870 2023-09-30T22:25:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.267+0000 7fded97b8700 1 -- 172.21.15.154:0/2927627330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 msgr2=0x7fded409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.267+0000 7fded97b8700 1 --2- 172.21.15.154:0/2927627330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded409ec40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdec40098f0 tx=0x7fdec4009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.267+0000 7fded97b8700 1 -- 172.21.15.154:0/2927627330 shutdown_connections 2023-09-30T22:25:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.267+0000 7fded97b8700 1 --2- 172.21.15.154:0/2927627330 >> v2:172.21.15.154:3300/0 conn(0x7fded4131d70 0x7fded4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.267+0000 7fded97b8700 1 --2- 172.21.15.154:0/2927627330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded409ec40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.267+0000 7fded97b8700 1 --2- 172.21.15.154:0/2927627330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded409f180 0x7fded4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.267+0000 7fded97b8700 1 -- 172.21.15.154:0/2927627330 >> 172.21.15.154:0/2927627330 conn(0x7fded40a4430 msgr2=0x7fded40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.267+0000 7f8ecd7d8700 1 Processor -- start 2023-09-30T22:25:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.268+0000 7fded97b8700 1 -- 172.21.15.154:0/2927627330 shutdown_connections 2023-09-30T22:25:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.268+0000 7f8ecd7d8700 1 -- start start 2023-09-30T22:25:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.268+0000 7fded97b8700 1 -- 172.21.15.154:0/2927627330 wait complete. 2023-09-30T22:25:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.268+0000 7f8ecd7d8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a08e0 0x7f8ec81370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.268+0000 7f8ecd7d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ec80a1230 0x7f8ec8135950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.268+0000 7f8ecd7d8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec8138040 0x7f8ec8135e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.268+0000 7f8ecd7d8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec813e330 con 0x7f8ec8138040 2023-09-30T22:25:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.268+0000 7f8ecd7d8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec811a800 con 0x7f8ec80a1230 2023-09-30T22:25:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.268+0000 7f8ecd7d8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec809c6b0 con 0x7f8ec80a08e0 2023-09-30T22:25:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7f8ec77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec8138040 0x7f8ec8135e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7f8ec77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec8138040 0x7f8ec8135e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59294/0 (socket says 172.21.15.154:59294) 2023-09-30T22:25:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7f8ec77fe700 1 -- 172.21.15.154:0/1613513094 learned_addr learned my addr 172.21.15.154:0/1613513094 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7f8ec77fe700 1 -- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a08e0 msgr2=0x7f8ec81370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7f8ec77fe700 1 --2- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a08e0 0x7f8ec81370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7f8ec77fe700 1 -- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ec80a1230 msgr2=0x7f8ec8135950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:25:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7f8ec77fe700 1 --2- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ec80a1230 0x7f8ec8135950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7f8ec77fe700 1 -- 172.21.15.154:0/1613513094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0009b30 con 0x7f8ec8138040 2023-09-30T22:25:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7fded97b8700 1 Processor -- start 2023-09-30T22:25:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7fded97b8700 1 -- start start 2023-09-30T22:25:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.269+0000 7f8ec77fe700 1 --2- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec8138040 0x7f8ec8135e90 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0012000 tx=0x7f8ec0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7f8eaf7fe700 1 -- 172.21.15.154:0/1613513094 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00042d0 con 0x7f8ec8138040 2023-09-30T22:25:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7f8eaf7fe700 1 -- 172.21.15.154:0/1613513094 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec0004450 con 0x7f8ec8138040 2023-09-30T22:25:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7f8eaf7fe700 1 -- 172.21.15.154:0/1613513094 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0004800 con 0x7f8ec8138040 2023-09-30T22:25:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/1613513094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec809a240 con 0x7f8ec8138040 2023-09-30T22:25:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/1613513094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec811b4e0 con 0x7f8ec8138040 2023-09-30T22:25:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded97b8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded411c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded97b8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fded409f180 0x7fded411c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded97b8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded4131d70 0x7fded411cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded97b8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded411e790 con 0x7fded409f180 2023-09-30T22:25:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded97b8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded412f4b0 con 0x7fded4131d70 2023-09-30T22:25:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded97b8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fded411efb0 con 0x7fded409e870 2023-09-30T22:25:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded411c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded4131d70 0x7fded411cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded411c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39690/0 (socket says 172.21.15.154:39690) 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.270+0000 7fded2ffd700 1 -- 172.21.15.154:0/2948839414 learned_addr learned my addr 172.21.15.154:0/2948839414 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fded37fe700 1 -- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 msgr2=0x7fded411c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fded37fe700 1 --2- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded411c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fded37fe700 1 -- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fded409f180 msgr2=0x7fded411c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fded37fe700 1 --2- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fded409f180 0x7fded411c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fded37fe700 1 -- 172.21.15.154:0/2948839414 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec80094a0 con 0x7fded4131d70 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fded2ffd700 1 --2- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded411c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fded37fe700 1 --2- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded4131d70 0x7fded411cbc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdec800e910 tx=0x7fdec800ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/1613513094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec804f2a0 con 0x7f8ec8138040 2023-09-30T22:25:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fdebb7fe700 1 -- 172.21.15.154:0/2948839414 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec800ee60 con 0x7fded4131d70 2023-09-30T22:25:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fdebb7fe700 1 -- 172.21.15.154:0/2948839414 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec8004020 con 0x7fded4131d70 2023-09-30T22:25:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fded97b8700 1 -- 172.21.15.154:0/2948839414 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec4009550 con 0x7fded4131d70 2023-09-30T22:25:59.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fdebb7fe700 1 -- 172.21.15.154:0/2948839414 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80043d0 con 0x7fded4131d70 2023-09-30T22:25:59.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.271+0000 7fded97b8700 1 -- 172.21.15.154:0/2948839414 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded411f900 con 0x7fded4131d70 2023-09-30T22:25:59.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.272+0000 7f8eaf7fe700 1 -- 172.21.15.154:0/1613513094 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ec001c440 con 0x7f8ec8138040 2023-09-30T22:25:59.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.272+0000 7f8eaf7fe700 1 -- 172.21.15.154:0/1613513094 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ec00416d0 con 0x7f8ec8138040 2023-09-30T22:25:59.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.272+0000 7fded97b8700 1 -- 172.21.15.154:0/2948839414 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded40a2ce0 con 0x7fded4131d70 2023-09-30T22:25:59.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.272+0000 7fdebb7fe700 1 -- 172.21.15.154:0/2948839414 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdec800c850 con 0x7fded4131d70 2023-09-30T22:25:59.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.273+0000 7fdebb7fe700 1 -- 172.21.15.154:0/2948839414 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdec803f3c0 con 0x7fded4131d70 2023-09-30T22:25:59.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.280+0000 7f8eaf7fe700 1 -- 172.21.15.154:0/1613513094 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ec001b990 con 0x7f8ec8138040 2023-09-30T22:25:59.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.281+0000 7fdebb7fe700 1 -- 172.21.15.154:0/2948839414 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdec80036a0 con 0x7fded4131d70 2023-09-30T22:25:59.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.305+0000 7f20c17d4700 1 Processor -- start 2023-09-30T22:25:59.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.306+0000 7f20c17d4700 1 -- start start 2023-09-30T22:25:59.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.306+0000 7f20c17d4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc133a70 0x7f20bc133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.306+0000 7f20c17d4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20bc0a1460 0x7f20bc13b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.306+0000 7f20c17d4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20bc133640 con 0x7f20bc0a08e0 2023-09-30T22:25:59.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.306+0000 7f20c17d4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20bc0a1d50 con 0x7f20bc0a1460 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.306+0000 7f20c17d4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc09b620 con 0x7f20bc133a70 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20baffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc133a70 0x7f20bc133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20baffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc133a70 0x7f20bc133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39702/0 (socket says 172.21.15.154:39702) 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20baffd700 1 -- 172.21.15.154:0/3973034916 learned_addr learned my addr 172.21.15.154:0/3973034916 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20bb7fe700 1 --2- 172.21.15.154:0/3973034916 >> v2:172.21.15.154:3300/0 conn(0x7f20bc0a1460 0x7f20bc13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20baffd700 1 -- 172.21.15.154:0/3973034916 >> v2:172.21.15.154:3300/0 conn(0x7f20bc0a1460 msgr2=0x7f20bc13b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20baffd700 1 --2- 172.21.15.154:0/3973034916 >> v2:172.21.15.154:3300/0 conn(0x7f20bc0a1460 0x7f20bc13b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20baffd700 1 -- 172.21.15.154:0/3973034916 >> v1:172.21.15.154:6789/0 conn(0x7f20bc0a08e0 legacy=0x7f20bc0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20baffd700 1 -- 172.21.15.154:0/3973034916 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc133870 con 0x7f20bc133a70 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20bb7fe700 1 --2- 172.21.15.154:0/3973034916 >> v2:172.21.15.154:3300/0 conn(0x7f20bc0a1460 0x7f20bc13b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20baffd700 1 --2- 172.21.15.154:0/3973034916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc133a70 0x7f20bc133e40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f20ac006fd0 tx=0x7f20ac009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db9c76610bd14ccb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3973034916 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac005e30 con 0x7f20bc133a70 2023-09-30T22:25:59.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3973034916 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac004030 con 0x7f20bc133a70 2023-09-30T22:25:59.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.307+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3973034916 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0043e0 con 0x7f20bc133a70 2023-09-30T22:25:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.308+0000 7f20c17d4700 1 -- 172.21.15.154:0/3973034916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc133a70 msgr2=0x7f20bc133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.308+0000 7f20c17d4700 1 --2- 172.21.15.154:0/3973034916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc133a70 0x7f20bc133e40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f20ac006fd0 tx=0x7f20ac009bd0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.308+0000 7f20c17d4700 1 -- 172.21.15.154:0/3973034916 shutdown_connections 2023-09-30T22:25:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.308+0000 7f20c17d4700 1 --2- 172.21.15.154:0/3973034916 >> v2:172.21.15.154:3300/0 conn(0x7f20bc0a1460 0x7f20bc13b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.308+0000 7f20c17d4700 1 --2- 172.21.15.154:0/3973034916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc133a70 0x7f20bc133e40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.308+0000 7f20c17d4700 1 -- 172.21.15.154:0/3973034916 >> 172.21.15.154:0/3973034916 conn(0x7f20bc0a2980 msgr2=0x7f20bc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.308+0000 7f20c17d4700 1 -- 172.21.15.154:0/3973034916 shutdown_connections 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.308+0000 7f20c17d4700 1 -- 172.21.15.154:0/3973034916 wait complete. 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.309+0000 7f20c17d4700 1 Processor -- start 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20c17d4700 1 -- start start 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20c17d4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc0a08e0 0x7f20bc1ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20c17d4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20bc0a1460 0x7f20bc1cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20c17d4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc133a70 0x7f20bc06dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20c17d4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0714b0 con 0x7f20bc133a70 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20c17d4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc071a50 con 0x7f20bc0a1460 2023-09-30T22:25:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20c17d4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc070100 con 0x7f20bc0a08e0 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20baffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc0a08e0 0x7f20bc1ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20baffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc0a08e0 0x7f20bc1ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39716/0 (socket says 172.21.15.154:39716) 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20baffd700 1 -- 172.21.15.154:0/1517436909 learned_addr learned my addr 172.21.15.154:0/1517436909 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20ba7fc700 1 --2- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20bc0a1460 0x7f20bc1cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.310+0000 7f20bb7fe700 1 --2- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc133a70 0x7f20bc06dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20baffd700 1 -- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20bc0a1460 msgr2=0x7f20bc1cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20baffd700 1 --2- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20bc0a1460 0x7f20bc1cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20baffd700 1 -- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc133a70 msgr2=0x7f20bc06dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20baffd700 1 --2- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc133a70 0x7f20bc06dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20baffd700 1 -- 172.21.15.154:0/1517436909 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4009a70 con 0x7f20bc0a08e0 2023-09-30T22:25:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20baffd700 1 --2- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc0a08e0 0x7f20bc1ccde0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f20ac000c00 tx=0x7f20ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20a37fe700 1 -- 172.21.15.154:0/1517436909 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac003ab0 con 0x7f20bc0a08e0 2023-09-30T22:25:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20c17d4700 1 -- 172.21.15.154:0/1517436909 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac009500 con 0x7f20bc0a08e0 2023-09-30T22:25:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20a37fe700 1 -- 172.21.15.154:0/1517436909 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac003c30 con 0x7f20bc0a08e0 2023-09-30T22:25:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20a37fe700 1 -- 172.21.15.154:0/1517436909 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac006030 con 0x7f20bc0a08e0 2023-09-30T22:25:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.311+0000 7f20c17d4700 1 -- 172.21.15.154:0/1517436909 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc071770 con 0x7f20bc0a08e0 2023-09-30T22:25:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.313+0000 7f20c17d4700 1 -- 172.21.15.154:0/1517436909 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20bc12eaf0 con 0x7f20bc0a08e0 2023-09-30T22:25:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.313+0000 7f20a37fe700 1 -- 172.21.15.154:0/1517436909 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20ac0061b0 con 0x7f20bc0a08e0 2023-09-30T22:25:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.313+0000 7f20a37fe700 1 -- 172.21.15.154:0/1517436909 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20ac040c00 con 0x7f20bc0a08e0 2023-09-30T22:25:59.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.317+0000 7f20a37fe700 1 -- 172.21.15.154:0/1517436909 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20ac006c40 con 0x7f20bc0a08e0 2023-09-30T22:25:59.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.349+0000 7fec7c39b700 1 Processor -- start 2023-09-30T22:25:59.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.349+0000 7fec7c39b700 1 -- start start 2023-09-30T22:25:59.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec7c39b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec7409f350 0x7fec74136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec7c39b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 0x7fec741395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec7c39b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7409c970 con 0x7fec7409e870 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec7c39b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec740a0920 con 0x7fec7409f350 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec7c39b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec7409f9c0 con 0x7fec741371c0 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec79936700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec7409f350 0x7fec74136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec79936700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec7409f350 0x7fec74136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59328/0 (socket says 172.21.15.154:59328) 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec79936700 1 -- 172.21.15.154:0/1896911945 learned_addr learned my addr 172.21.15.154:0/1896911945 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec7a938700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 0x7fec741395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec79936700 1 -- 172.21.15.154:0/1896911945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 msgr2=0x7fec741395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec79936700 1 --2- 172.21.15.154:0/1896911945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 0x7fec741395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec79936700 1 -- 172.21.15.154:0/1896911945 >> v1:172.21.15.154:6789/0 conn(0x7fec7409e870 legacy=0x7fec7409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec79936700 1 -- 172.21.15.154:0/1896911945 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7409bab0 con 0x7fec7409f350 2023-09-30T22:25:59.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.350+0000 7fec79936700 1 --2- 172.21.15.154:0/1896911945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7409f350 0x7fec74136c80 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fec640098f0 tx=0x7fec64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97557c867d713927 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec79135700 1 -- 172.21.15.154:0/1896911945 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64011830 con 0x7fec7409f350 2023-09-30T22:25:59.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec79135700 1 -- 172.21.15.154:0/1896911945 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec64011990 con 0x7fec7409f350 2023-09-30T22:25:59.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec79135700 1 -- 172.21.15.154:0/1896911945 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64011d20 con 0x7fec7409f350 2023-09-30T22:25:59.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec7c39b700 1 -- 172.21.15.154:0/1896911945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7409f350 msgr2=0x7fec74136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec7c39b700 1 --2- 172.21.15.154:0/1896911945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7409f350 0x7fec74136c80 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fec640098f0 tx=0x7fec64009c00 comp rx=0 tx=0).stop 2023-09-30T22:25:59.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec7c39b700 1 -- 172.21.15.154:0/1896911945 shutdown_connections 2023-09-30T22:25:59.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec7c39b700 1 --2- 172.21.15.154:0/1896911945 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 0x7fec741395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec7c39b700 1 --2- 172.21.15.154:0/1896911945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7409f350 0x7fec74136c80 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec7c39b700 1 -- 172.21.15.154:0/1896911945 >> 172.21.15.154:0/1896911945 conn(0x7fec740a4430 msgr2=0x7fec740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec7c39b700 1 -- 172.21.15.154:0/1896911945 shutdown_connections 2023-09-30T22:25:59.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.351+0000 7fec7c39b700 1 -- 172.21.15.154:0/1896911945 wait complete. 2023-09-30T22:25:59.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.352+0000 7fec7c39b700 1 Processor -- start 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.352+0000 7fec7c39b700 1 -- start start 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7c39b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7409e870 0x7fec7406c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7c39b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7409f350 0x7fec7406c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7c39b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 0x7fec741c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7c39b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7406bd60 con 0x7fec7409f350 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7c39b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec741366b0 con 0x7fec7409e870 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7c39b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec74126570 con 0x7fec741371c0 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a137700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7409e870 0x7fec7406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a137700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7409e870 0x7fec7406c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59640/0 (socket says 172.21.15.154:59640) 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a137700 1 -- 172.21.15.154:0/1238849505 learned_addr learned my addr 172.21.15.154:0/1238849505 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:25:59.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec79936700 1 --2- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7409f350 0x7fec7406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a938700 1 --2- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 0x7fec741c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a137700 1 -- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 msgr2=0x7fec741c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a137700 1 --2- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 0x7fec741c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a137700 1 -- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7409f350 msgr2=0x7fec7406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a137700 1 --2- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7409f350 0x7fec7406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a137700 1 -- 172.21.15.154:0/1238849505 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64009550 con 0x7fec7409e870 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.353+0000 7fec7a137700 1 --2- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7409e870 0x7fec7406c110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fec7000c4e0 tx=0x7fec7000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.354+0000 7fec6affd700 1 -- 172.21.15.154:0/1238849505 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700052d0 con 0x7fec7409e870 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.354+0000 7fec6affd700 1 -- 172.21.15.154:0/1238849505 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec70005430 con 0x7fec7409e870 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.354+0000 7fec7c39b700 1 -- 172.21.15.154:0/1238849505 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec74136880 con 0x7fec7409e870 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.354+0000 7fec6affd700 1 -- 172.21.15.154:0/1238849505 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700038c0 con 0x7fec7409e870 2023-09-30T22:25:59.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.354+0000 7fec7c39b700 1 -- 172.21.15.154:0/1238849505 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec74136c00 con 0x7fec7409e870 2023-09-30T22:25:59.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.355+0000 7fec6affd700 1 -- 172.21.15.154:0/1238849505 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec70003a20 con 0x7fec7409e870 2023-09-30T22:25:59.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.355+0000 7fec7c39b700 1 -- 172.21.15.154:0/1238849505 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7409eeb0 con 0x7fec7409e870 2023-09-30T22:25:59.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.355+0000 7fec6affd700 1 -- 172.21.15.154:0/1238849505 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec7003eae0 con 0x7fec7409e870 2023-09-30T22:25:59.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.359+0000 7fec6affd700 1 -- 172.21.15.154:0/1238849505 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec70018260 con 0x7fec7409e870 2023-09-30T22:25:59.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.515+0000 7f20c17d4700 1 -- 172.21.15.154:0/1517436909 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f20bc04f2a0 con 0x7f20bc0a08e0 2023-09-30T22:25:59.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.515+0000 7f20a37fe700 1 -- 172.21.15.154:0/1517436909 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20ac02a020 con 0x7f20bc0a08e0 2023-09-30T22:25:59.516 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:25:59.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.518+0000 7f20c17d4700 1 -- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc0a08e0 msgr2=0x7f20bc1ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.518+0000 7f20c17d4700 1 --2- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc0a08e0 0x7f20bc1ccde0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f20ac000c00 tx=0x7f20ac004750 comp rx=0 tx=0).stop 2023-09-30T22:25:59.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.518+0000 7f20c17d4700 1 -- 172.21.15.154:0/1517436909 shutdown_connections 2023-09-30T22:25:59.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.518+0000 7f20c17d4700 1 --2- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc133a70 0x7f20bc06dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.518+0000 7f20c17d4700 1 --2- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20bc0a08e0 0x7f20bc1ccde0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.518+0000 7f20c17d4700 1 --2- 172.21.15.154:0/1517436909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20bc0a1460 0x7f20bc1cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.518+0000 7f20c17d4700 1 -- 172.21.15.154:0/1517436909 >> 172.21.15.154:0/1517436909 conn(0x7f20bc0a2980 msgr2=0x7f20bc130140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.518+0000 7f20c17d4700 1 -- 172.21.15.154:0/1517436909 shutdown_connections 2023-09-30T22:25:59.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.518+0000 7f20c17d4700 1 -- 172.21.15.154:0/1517436909 wait complete. 2023-09-30T22:25:59.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:25:59.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.546+0000 7fded97b8700 1 -- 172.21.15.154:0/2948839414 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fded404f2a0 con 0x7fded4131d70 2023-09-30T22:25:59.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.546+0000 7fdebb7fe700 1 -- 172.21.15.154:0/2948839414 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdec8017030 con 0x7fded4131d70 2023-09-30T22:25:59.547 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:59.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.547+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/1613513094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ec806bce0 con 0x7f8ec8138040 2023-09-30T22:25:59.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.547+0000 7f8eaf7fe700 1 -- 172.21.15.154:0/1613513094 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ec0033030 con 0x7f8ec8138040 2023-09-30T22:25:59.548 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:25:59.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.549+0000 7fded97b8700 1 -- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded4131d70 msgr2=0x7fded411cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.549+0000 7fded97b8700 1 --2- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded4131d70 0x7fded411cbc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdec800e910 tx=0x7fdec800ec20 comp rx=0 tx=0).stop 2023-09-30T22:25:59.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.549+0000 7fded97b8700 1 -- 172.21.15.154:0/2948839414 shutdown_connections 2023-09-30T22:25:59.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.549+0000 7fded97b8700 1 --2- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fded4131d70 0x7fded411cbc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.549+0000 7fded97b8700 1 --2- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fded409e870 0x7fded411c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.549+0000 7fded97b8700 1 --2- 172.21.15.154:0/2948839414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fded409f180 0x7fded411c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.549+0000 7fded97b8700 1 -- 172.21.15.154:0/2948839414 >> 172.21.15.154:0/2948839414 conn(0x7fded40a4430 msgr2=0x7fded4130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.549+0000 7fded97b8700 1 -- 172.21.15.154:0/2948839414 shutdown_connections 2023-09-30T22:25:59.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.549+0000 7fded97b8700 1 -- 172.21.15.154:0/2948839414 wait complete. 2023-09-30T22:25:59.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.551+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec8138040 msgr2=0x7f8ec8135e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.551+0000 7f8ecd7d8700 1 --2- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec8138040 0x7f8ec8135e90 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0012000 tx=0x7f8ec0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.551+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/1613513094 shutdown_connections 2023-09-30T22:25:59.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.551+0000 7f8ecd7d8700 1 --2- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec8138040 0x7f8ec8135e90 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.551+0000 7f8ecd7d8700 1 --2- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ec80a08e0 0x7f8ec81370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.551+0000 7f8ecd7d8700 1 --2- 172.21.15.154:0/1613513094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ec80a1230 0x7f8ec8135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.551+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/1613513094 >> 172.21.15.154:0/1613513094 conn(0x7f8ec80a2980 msgr2=0x7f8ec809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.551+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/1613513094 shutdown_connections 2023-09-30T22:25:59.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.551+0000 7f8ecd7d8700 1 -- 172.21.15.154:0/1613513094 wait complete. 2023-09-30T22:25:59.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.556+0000 7fec7c39b700 1 -- 172.21.15.154:0/1238849505 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fec7404f2a0 con 0x7fec7409e870 2023-09-30T22:25:59.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.556+0000 7fec6affd700 1 -- 172.21.15.154:0/1238849505 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec70017070 con 0x7fec7409e870 2023-09-30T22:25:59.557 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.560+0000 7fec7c39b700 1 -- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7409e870 msgr2=0x7fec7406c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.560+0000 7fec7c39b700 1 --2- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7409e870 0x7fec7406c110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fec7000c4e0 tx=0x7fec7000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.560+0000 7fec7c39b700 1 -- 172.21.15.154:0/1238849505 shutdown_connections 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.560+0000 7fec7c39b700 1 --2- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec741371c0 0x7fec741c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.560+0000 7fec7c39b700 1 --2- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7409e870 0x7fec7406c110 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.560+0000 7fec7c39b700 1 --2- 172.21.15.154:0/1238849505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7409f350 0x7fec7406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:25:59.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.560+0000 7fec7c39b700 1 -- 172.21.15.154:0/1238849505 >> 172.21.15.154:0/1238849505 conn(0x7fec740a4430 msgr2=0x7fec740a2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:25:59.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.560+0000 7fec7c39b700 1 -- 172.21.15.154:0/1238849505 shutdown_connections 2023-09-30T22:25:59.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:25:59.560+0000 7fec7c39b700 1 -- 172.21.15.154:0/1238849505 wait complete. 2023-09-30T22:25:59.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:25:59.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:25:59.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:00.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:00.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:00.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:00.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:00.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.683+0000 7fbdec0f9700 1 Processor -- start 2023-09-30T22:26:00.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.683+0000 7fbdec0f9700 1 -- start start 2023-09-30T22:26:00.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbdec0f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbdec0f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41300a0 0x7fbde41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbdec0f9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde406b2d0 con 0x7fbde41309f0 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbdec0f9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde4133610 con 0x7fbde4133ad0 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbdec0f9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbde409a500 con 0x7fbde41300a0 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9e95700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9e95700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59656/0 (socket says 172.21.15.154:59656) 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9e95700 1 -- 172.21.15.154:0/3945022936 learned_addr learned my addr 172.21.15.154:0/3945022936 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9694700 1 --2- 172.21.15.154:0/3945022936 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41300a0 0x7fbde41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9694700 1 -- 172.21.15.154:0/3945022936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 msgr2=0x7fbde4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9694700 1 --2- 172.21.15.154:0/3945022936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9694700 1 -- 172.21.15.154:0/3945022936 >> v1:172.21.15.154:6789/0 conn(0x7fbde41309f0 legacy=0x7fbde413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9694700 1 -- 172.21.15.154:0/3945022936 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde41338b0 con 0x7fbde41300a0 2023-09-30T22:26:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde8e93700 1 -- 172.21.15.154:0/3945022936 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433388923 0 0) 0x7fbde406b2d0 con 0x7fbde41309f0 2023-09-30T22:26:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9e95700 1 --2- 172.21.15.154:0/3945022936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.684+0000 7fbde9694700 1 --2- 172.21.15.154:0/3945022936 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41300a0 0x7fbde41304b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009870 tx=0x7fbdd4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b684cf67b888f479 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.685+0000 7fbde8e93700 1 -- 172.21.15.154:0/3945022936 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4011830 con 0x7fbde41300a0 2023-09-30T22:26:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.685+0000 7fbde8e93700 1 -- 172.21.15.154:0/3945022936 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd4011990 con 0x7fbde41300a0 2023-09-30T22:26:00.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.685+0000 7fbde8e93700 1 -- 172.21.15.154:0/3945022936 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4011d20 con 0x7fbde41300a0 2023-09-30T22:26:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.685+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3945022936 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41300a0 msgr2=0x7fbde41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.685+0000 7fbdec0f9700 1 --2- 172.21.15.154:0/3945022936 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41300a0 0x7fbde41304b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009870 tx=0x7fbdd4009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:00.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.685+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3945022936 shutdown_connections 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.685+0000 7fbdec0f9700 1 --2- 172.21.15.154:0/3945022936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.685+0000 7fbdec0f9700 1 --2- 172.21.15.154:0/3945022936 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41300a0 0x7fbde41304b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.685+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3945022936 >> 172.21.15.154:0/3945022936 conn(0x7fbde4099c40 msgr2=0x7fbde40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.686+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3945022936 shutdown_connections 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.686+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3945022936 wait complete. 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.686+0000 7fbdec0f9700 1 Processor -- start 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbdec0f9700 1 -- start start 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbdec0f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde41300a0 0x7fbde411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbdec0f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41309f0 0x7fbde411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbdec0f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbdec0f9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde4120080 con 0x7fbde41300a0 2023-09-30T22:26:00.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbdec0f9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde412dd00 con 0x7fbde4133ad0 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbdec0f9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbde411fae0 con 0x7fbde41309f0 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbde9694700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41309f0 0x7fbde411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbde9694700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41309f0 0x7fbde411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39754/0 (socket says 172.21.15.154:39754) 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbde9694700 1 -- 172.21.15.154:0/3292931656 learned_addr learned my addr 172.21.15.154:0/3292931656 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbde9e95700 1 --2- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde41300a0 0x7fbde411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbdea696700 1 --2- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbde9e95700 1 -- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41309f0 msgr2=0x7fbde411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbde9e95700 1 --2- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41309f0 0x7fbde411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbde9e95700 1 -- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 msgr2=0x7fbde411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.687+0000 7fbde9e95700 1 --2- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.688+0000 7fbde9e95700 1 -- 172.21.15.154:0/3292931656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0009550 con 0x7fbde41300a0 2023-09-30T22:26:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.688+0000 7fbde9e95700 1 --2- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde41300a0 0x7fbde411da40 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbde000e9a0 tx=0x7fbde000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.688+0000 7fbdda7fc700 1 -- 172.21.15.154:0/3292931656 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0004030 con 0x7fbde41300a0 2023-09-30T22:26:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.688+0000 7fbdda7fc700 1 -- 172.21.15.154:0/3292931656 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0004190 con 0x7fbde41300a0 2023-09-30T22:26:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.688+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3292931656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd40094a0 con 0x7fbde41300a0 2023-09-30T22:26:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.688+0000 7fbdda7fc700 1 -- 172.21.15.154:0/3292931656 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0004520 con 0x7fbde41300a0 2023-09-30T22:26:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.688+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3292931656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde412d930 con 0x7fbde41300a0 2023-09-30T22:26:00.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.689+0000 7fbdda7fc700 1 -- 172.21.15.154:0/3292931656 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbde00036a0 con 0x7fbde41300a0 2023-09-30T22:26:00.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.689+0000 7fbdda7fc700 1 -- 172.21.15.154:0/3292931656 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbde003f5e0 con 0x7fbde41300a0 2023-09-30T22:26:00.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.689+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3292931656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde411f450 con 0x7fbde41300a0 2023-09-30T22:26:00.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.694+0000 7fbdda7fc700 1 -- 172.21.15.154:0/3292931656 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbde0019d60 con 0x7fbde41300a0 2023-09-30T22:26:00.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.712+0000 7efea2e7e700 1 Processor -- start 2023-09-30T22:26:00.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.712+0000 7efea2e7e700 1 -- start start 2023-09-30T22:26:00.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.713+0000 7efea2e7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c06a770 0x7efe9c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.713+0000 7efea2e7e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c134f00 0x7efe9c09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.713+0000 7efea2e7e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c09eca0 con 0x7efe9c09dea0 2023-09-30T22:26:00.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.713+0000 7efea2e7e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c06b2e0 con 0x7efe9c134f00 2023-09-30T22:26:00.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.713+0000 7efea2e7e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c09f720 con 0x7efe9c06a770 2023-09-30T22:26:00.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.713+0000 7efea0c1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c06a770 0x7efe9c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.713+0000 7efea141b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efe9c09dea0 0x7efe9c13ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53396/0 (socket says 172.21.15.154:53396) 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.713+0000 7efea141b700 1 -- 172.21.15.154:0/3064724925 learned_addr learned my addr 172.21.15.154:0/3064724925 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efe9bfff700 1 --2- 172.21.15.154:0/3064724925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c134f00 0x7efe9c09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efe9b7fe700 1 -- 172.21.15.154:0/3064724925 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138979446 0 0) 0x7efe9c09eca0 con 0x7efe9c09dea0 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efe9b7fe700 1 -- 172.21.15.154:0/3064724925 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe8c0035b0 con 0x7efe9c09dea0 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efea0c1a700 1 -- 172.21.15.154:0/3064724925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c134f00 msgr2=0x7efe9c09d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efea0c1a700 1 --2- 172.21.15.154:0/3064724925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c134f00 0x7efe9c09d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efea0c1a700 1 -- 172.21.15.154:0/3064724925 >> v1:172.21.15.154:6789/0 conn(0x7efe9c09dea0 legacy=0x7efe9c13ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efea0c1a700 1 -- 172.21.15.154:0/3064724925 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c06b480 con 0x7efe9c06a770 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efea0c1a700 1 --2- 172.21.15.154:0/3064724925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c06a770 0x7efe9c1349c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efe90009870 tx=0x7efe90009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dce719f29d184c53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efe9b7fe700 1 -- 172.21.15.154:0/3064724925 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90011830 con 0x7efe9c06a770 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efe9b7fe700 1 -- 172.21.15.154:0/3064724925 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe90011990 con 0x7efe9c06a770 2023-09-30T22:26:00.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.714+0000 7efe9b7fe700 1 -- 172.21.15.154:0/3064724925 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90011d20 con 0x7efe9c06a770 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.715+0000 7efea2e7e700 1 -- 172.21.15.154:0/3064724925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c06a770 msgr2=0x7efe9c1349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.715+0000 7efea2e7e700 1 --2- 172.21.15.154:0/3064724925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c06a770 0x7efe9c1349c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efe90009870 tx=0x7efe90009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.715+0000 7efea2e7e700 1 -- 172.21.15.154:0/3064724925 shutdown_connections 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.715+0000 7efea2e7e700 1 --2- 172.21.15.154:0/3064724925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c06a770 0x7efe9c1349c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.715+0000 7efea2e7e700 1 --2- 172.21.15.154:0/3064724925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c134f00 0x7efe9c09d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.715+0000 7efea2e7e700 1 -- 172.21.15.154:0/3064724925 >> 172.21.15.154:0/3064724925 conn(0x7efe9c099c40 msgr2=0x7efe9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.715+0000 7efea2e7e700 1 -- 172.21.15.154:0/3064724925 shutdown_connections 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.715+0000 7efea2e7e700 1 -- 172.21.15.154:0/3064724925 wait complete. 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.717+0000 7efea2e7e700 1 Processor -- start 2023-09-30T22:26:00.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.717+0000 7efea2e7e700 1 -- start start 2023-09-30T22:26:00.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.717+0000 7efea2e7e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c06a770 0x7efe9c119ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.717+0000 7efea2e7e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe9c09dea0 0x7efe9c11a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.717+0000 7efea2e7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c134f00 0x7efe9c11aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea2e7e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c11bd10 con 0x7efe9c09dea0 2023-09-30T22:26:00.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea2e7e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c140e50 con 0x7efe9c06a770 2023-09-30T22:26:00.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea2e7e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c140a10 con 0x7efe9c134f00 2023-09-30T22:26:00.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea0c1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c06a770 0x7efe9c119ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea0c1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c06a770 0x7efe9c119ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59690/0 (socket says 172.21.15.154:59690) 2023-09-30T22:26:00.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea0c1a700 1 -- 172.21.15.154:0/1895290479 learned_addr learned my addr 172.21.15.154:0/1895290479 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efe9bfff700 1 --2- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe9c09dea0 0x7efe9c11a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea0c1a700 1 -- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c134f00 msgr2=0x7efe9c11aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea0c1a700 1 --2- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c134f00 0x7efe9c11aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea0c1a700 1 -- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe9c09dea0 msgr2=0x7efe9c11a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea0c1a700 1 --2- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe9c09dea0 0x7efe9c11a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea0c1a700 1 -- 172.21.15.154:0/1895290479 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900094a0 con 0x7efe9c06a770 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea0c1a700 1 --2- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c06a770 0x7efe9c119ff0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efe90009840 tx=0x7efe90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efe997fa700 1 -- 172.21.15.154:0/1895290479 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90004510 con 0x7efe9c06a770 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efe997fa700 1 -- 172.21.15.154:0/1895290479 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9001e070 con 0x7efe9c06a770 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efe997fa700 1 -- 172.21.15.154:0/1895290479 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900038e0 con 0x7efe9c06a770 2023-09-30T22:26:00.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea2e7e700 1 -- 172.21.15.154:0/1895290479 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9c11d2a0 con 0x7efe9c06a770 2023-09-30T22:26:00.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.718+0000 7efea2e7e700 1 -- 172.21.15.154:0/1895290479 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c138d20 con 0x7efe9c06a770 2023-09-30T22:26:00.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.719+0000 7f74bc90d700 1 Processor -- start 2023-09-30T22:26:00.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.719+0000 7f74bc90d700 1 -- start start 2023-09-30T22:26:00.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.719+0000 7f74bc90d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b809a670 0x7f74b81389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.719+0000 7f74bc90d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74b8138f20 0x7f74b813b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.719+0000 7f74bc90d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b8130240 con 0x7f74b8130460 2023-09-30T22:26:00.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.719+0000 7f74bc90d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8099b20 con 0x7f74b809a670 2023-09-30T22:26:00.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.719+0000 7f74bc90d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74b809c0e0 con 0x7f74b8138f20 2023-09-30T22:26:00.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.719+0000 7efe997fa700 1 -- 172.21.15.154:0/1895290479 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe90003a40 con 0x7efe9c06a770 2023-09-30T22:26:00.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.719+0000 7efea2e7e700 1 -- 172.21.15.154:0/1895290479 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9c0700a0 con 0x7efe9c06a770 2023-09-30T22:26:00.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7f74b659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f74b8130460 0x7f74b8130830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53402/0 (socket says 172.21.15.154:53402) 2023-09-30T22:26:00.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7f74b659c700 1 -- 172.21.15.154:0/1495943817 learned_addr learned my addr 172.21.15.154:0/1495943817 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:00.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7f74b5d9b700 1 --2- 172.21.15.154:0/1495943817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b809a670 0x7f74b81389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7f74b559a700 1 -- 172.21.15.154:0/1495943817 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274225251 0 0) 0x7f74b8130240 con 0x7f74b8130460 2023-09-30T22:26:00.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7f74b5d9b700 1 -- 172.21.15.154:0/1495943817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74b8138f20 msgr2=0x7f74b813b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7f74b5d9b700 1 --2- 172.21.15.154:0/1495943817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74b8138f20 0x7f74b813b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7f74b5d9b700 1 -- 172.21.15.154:0/1495943817 >> v1:172.21.15.154:6789/0 conn(0x7f74b8130460 legacy=0x7f74b8130830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7f74b5d9b700 1 -- 172.21.15.154:0/1495943817 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8099de0 con 0x7f74b809a670 2023-09-30T22:26:00.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7f74b5d9b700 1 --2- 172.21.15.154:0/1495943817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b809a670 0x7f74b81389e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009870 tx=0x7f74ac009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6ca0b7bda4ae098 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.720+0000 7efe997fa700 1 -- 172.21.15.154:0/1895290479 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efe90020070 con 0x7efe9c06a770 2023-09-30T22:26:00.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.724+0000 7f0768eba700 1 Processor -- start 2023-09-30T22:26:00.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.724+0000 7f74b559a700 1 -- 172.21.15.154:0/1495943817 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011830 con 0x7f74b809a670 2023-09-30T22:26:00.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f74b559a700 1 -- 172.21.15.154:0/1495943817 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac011990 con 0x7f74b809a670 2023-09-30T22:26:00.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f74b559a700 1 -- 172.21.15.154:0/1495943817 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011d20 con 0x7f74b809a670 2023-09-30T22:26:00.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7efe997fa700 1 -- 172.21.15.154:0/1895290479 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe90024c00 con 0x7efe9c06a770 2023-09-30T22:26:00.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.724+0000 7f0768eba700 1 -- start start 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.724+0000 7f0768eba700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409a130 0x7f076409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.724+0000 7f0768eba700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f076409f1e0 0x7f076413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.724+0000 7f0768eba700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0764072b30 con 0x7f076409edb0 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.724+0000 7f0768eba700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076409a500 con 0x7f076409f1e0 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.724+0000 7f0768eba700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f076409ada0 con 0x7f076409a130 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f076259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409a130 0x7f076409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f076259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409a130 0x7f076409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39788/0 (socket says 172.21.15.154:39788) 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f076259c700 1 -- 172.21.15.154:0/327254841 learned_addr learned my addr 172.21.15.154:0/327254841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f0762d9d700 1 --2- 172.21.15.154:0/327254841 >> v2:172.21.15.154:3300/0 conn(0x7f076409f1e0 0x7f076413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f076259c700 1 -- 172.21.15.154:0/327254841 >> v2:172.21.15.154:3300/0 conn(0x7f076409f1e0 msgr2=0x7f076413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f076259c700 1 --2- 172.21.15.154:0/327254841 >> v2:172.21.15.154:3300/0 conn(0x7f076409f1e0 0x7f076413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f076259c700 1 -- 172.21.15.154:0/327254841 >> v1:172.21.15.154:6789/0 conn(0x7f076409edb0 legacy=0x7f076413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f076259c700 1 -- 172.21.15.154:0/327254841 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076409fe00 con 0x7f076409a130 2023-09-30T22:26:00.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f076259c700 1 --2- 172.21.15.154:0/327254841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409a130 0x7f076409e870 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f07540098f0 tx=0x7f0754009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc57226087ca1fc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f74bc90d700 1 -- 172.21.15.154:0/1495943817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b809a670 msgr2=0x7f74b81389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f74bc90d700 1 --2- 172.21.15.154:0/1495943817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b809a670 0x7f74b81389e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009870 tx=0x7f74ac009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:00.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.725+0000 7f076159a700 1 -- 172.21.15.154:0/327254841 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400b8a0 con 0x7f076409a130 2023-09-30T22:26:00.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f076159a700 1 -- 172.21.15.154:0/327254841 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075400ba00 con 0x7f076409a130 2023-09-30T22:26:00.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f076159a700 1 -- 172.21.15.154:0/327254841 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400bd90 con 0x7f076409a130 2023-09-30T22:26:00.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f74bc90d700 1 -- 172.21.15.154:0/1495943817 shutdown_connections 2023-09-30T22:26:00.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f74bc90d700 1 --2- 172.21.15.154:0/1495943817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74b8138f20 0x7f74b813b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f74bc90d700 1 --2- 172.21.15.154:0/1495943817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b809a670 0x7f74b81389e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f74bc90d700 1 -- 172.21.15.154:0/1495943817 >> 172.21.15.154:0/1495943817 conn(0x7f74b80a1ee0 msgr2=0x7f74b80a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f74bc90d700 1 -- 172.21.15.154:0/1495943817 shutdown_connections 2023-09-30T22:26:00.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f74bc90d700 1 -- 172.21.15.154:0/1495943817 wait complete. 2023-09-30T22:26:00.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f0768eba700 1 -- 172.21.15.154:0/327254841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409a130 msgr2=0x7f076409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.726+0000 7f0768eba700 1 --2- 172.21.15.154:0/327254841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409a130 0x7f076409e870 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f07540098f0 tx=0x7f0754009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:00.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.727+0000 7f0768eba700 1 -- 172.21.15.154:0/327254841 shutdown_connections 2023-09-30T22:26:00.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.727+0000 7f0768eba700 1 --2- 172.21.15.154:0/327254841 >> v2:172.21.15.154:3300/0 conn(0x7f076409f1e0 0x7f076413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.727+0000 7f0768eba700 1 --2- 172.21.15.154:0/327254841 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409a130 0x7f076409e870 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.727+0000 7f0768eba700 1 -- 172.21.15.154:0/327254841 >> 172.21.15.154:0/327254841 conn(0x7f07640a4430 msgr2=0x7f07640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.727+0000 7f74bc90d700 1 Processor -- start 2023-09-30T22:26:00.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.727+0000 7f74bc90d700 1 -- start start 2023-09-30T22:26:00.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74bc90d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b809a670 0x7f74b8126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74bc90d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74b8130460 0x7f74b81274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74bc90d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b8138f20 0x7f74b8127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74bc90d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8129620 con 0x7f74b809a670 2023-09-30T22:26:00.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74bc90d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b81281b0 con 0x7f74b8138f20 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74bc90d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8128960 con 0x7f74b8130460 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b809a670 0x7f74b8126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b6d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b8138f20 0x7f74b8127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b809a670 0x7f74b8126fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59362/0 (socket says 172.21.15.154:59362) 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b659c700 1 -- 172.21.15.154:0/159660050 learned_addr learned my addr 172.21.15.154:0/159660050 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b5d9b700 1 --2- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74b8130460 0x7f74b81274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b6d9d700 1 -- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74b8130460 msgr2=0x7f74b81274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b6d9d700 1 --2- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74b8130460 0x7f74b81274e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b6d9d700 1 -- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b809a670 msgr2=0x7f74b8126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b6d9d700 1 --2- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b809a670 0x7f74b8126fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f74b6d9d700 1 -- 172.21.15.154:0/159660050 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0094a0 con 0x7f74b8138f20 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.729+0000 7f74b6d9d700 1 --2- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b8138f20 0x7f74b8127a20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f74b000be50 tx=0x7f74b0009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.729+0000 7f74a6ffd700 1 -- 172.21.15.154:0/159660050 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b000cb90 con 0x7f74b8138f20 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.729+0000 7f74a6ffd700 1 -- 172.21.15.154:0/159660050 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b000cd10 con 0x7f74b8138f20 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f0768eba700 1 -- 172.21.15.154:0/327254841 shutdown_connections 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.728+0000 7f0768eba700 1 -- 172.21.15.154:0/327254841 wait complete. 2023-09-30T22:26:00.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.729+0000 7f0768eba700 1 Processor -- start 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.729+0000 7f74a6ffd700 1 -- 172.21.15.154:0/159660050 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0014680 con 0x7f74b8138f20 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.729+0000 7f74bc90d700 1 -- 172.21.15.154:0/159660050 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b8138cb0 con 0x7f74b8138f20 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.729+0000 7f74bc90d700 1 -- 172.21.15.154:0/159660050 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b8128db0 con 0x7f74b8138f20 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.729+0000 7f0768eba700 1 -- start start 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0768eba700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f076409a130 0x7f076411db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0768eba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f076409edb0 0x7f076412ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0768eba700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409f1e0 0x7f07641304c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0768eba700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0764133130 con 0x7f076409edb0 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0768eba700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0764131760 con 0x7f076409a130 2023-09-30T22:26:00.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0768eba700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0764134e50 con 0x7f076409f1e0 2023-09-30T22:26:00.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0762d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409f1e0 0x7f07641304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0762d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409f1e0 0x7f07641304c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39796/0 (socket says 172.21.15.154:39796) 2023-09-30T22:26:00.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0762d9d700 1 -- 172.21.15.154:0/2233506339 learned_addr learned my addr 172.21.15.154:0/2233506339 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:00.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f74bc90d700 1 -- 172.21.15.154:0/159660050 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b804f2a0 con 0x7f74b8138f20 2023-09-30T22:26:00.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0761d9b700 1 --2- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f076409edb0 0x7f076412ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f076259c700 1 --2- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f076409a130 0x7f076411db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:00.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0761d9b700 1 -- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409f1e0 msgr2=0x7f07641304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0761d9b700 1 --2- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409f1e0 0x7f07641304c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0761d9b700 1 -- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f076409a130 msgr2=0x7f076411db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0761d9b700 1 --2- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f076409a130 0x7f076411db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f0761d9b700 1 -- 172.21.15.154:0/2233506339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754009550 con 0x7f076409edb0 2023-09-30T22:26:00.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.731+0000 7f0761d9b700 1 --2- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f076409edb0 0x7f076412ff80 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0758000f60 tx=0x7f075800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:00.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.730+0000 7f74a6ffd700 1 -- 172.21.15.154:0/159660050 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f74b001d3b0 con 0x7f74b8138f20 2023-09-30T22:26:00.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.731+0000 7f74a6ffd700 1 -- 172.21.15.154:0/159660050 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f74b0006e40 con 0x7f74b8138f20 2023-09-30T22:26:00.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.731+0000 7f0752ffd700 1 -- 172.21.15.154:0/2233506339 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580052d0 con 0x7f076409edb0 2023-09-30T22:26:00.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.731+0000 7f0752ffd700 1 -- 172.21.15.154:0/2233506339 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758005430 con 0x7f076409edb0 2023-09-30T22:26:00.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.731+0000 7f0768eba700 1 -- 172.21.15.154:0/2233506339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0764133300 con 0x7f076409edb0 2023-09-30T22:26:00.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.731+0000 7f0768eba700 1 -- 172.21.15.154:0/2233506339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076413fe90 con 0x7f076409edb0 2023-09-30T22:26:00.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.731+0000 7f0752ffd700 1 -- 172.21.15.154:0/2233506339 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758003880 con 0x7f076409edb0 2023-09-30T22:26:00.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.733+0000 7f0752ffd700 1 -- 172.21.15.154:0/2233506339 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07580039e0 con 0x7f076409edb0 2023-09-30T22:26:00.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.733+0000 7f0752ffd700 1 -- 172.21.15.154:0/2233506339 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f075803e8e0 con 0x7f076409edb0 2023-09-30T22:26:00.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.733+0000 7f0768eba700 1 -- 172.21.15.154:0/2233506339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07480052e0 con 0x7f076409edb0 2023-09-30T22:26:00.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.738+0000 7f0752ffd700 1 -- 172.21.15.154:0/2233506339 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0758017080 con 0x7f076409edb0 2023-09-30T22:26:00.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.740+0000 7f74a6ffd700 1 -- 172.21.15.154:0/159660050 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74b001c360 con 0x7f74b8138f20 2023-09-30T22:26:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.898+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3292931656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbde40a2620 con 0x7fbde41300a0 2023-09-30T22:26:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.898+0000 7fbdda7fc700 1 -- 172.21.15.154:0/3292931656 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbde0019300 con 0x7fbde41300a0 2023-09-30T22:26:00.899 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:00.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.900+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde41300a0 msgr2=0x7fbde411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.900+0000 7fbdec0f9700 1 --2- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde41300a0 0x7fbde411da40 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbde000e9a0 tx=0x7fbde000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.900+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3292931656 shutdown_connections 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.900+0000 7fbdec0f9700 1 --2- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbde4133ad0 0x7fbde411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.900+0000 7fbdec0f9700 1 --2- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbde41300a0 0x7fbde411da40 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.900+0000 7fbdec0f9700 1 --2- 172.21.15.154:0/3292931656 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbde41309f0 0x7fbde411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.900+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3292931656 >> 172.21.15.154:0/3292931656 conn(0x7fbde4099c40 msgr2=0x7fbde4132c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.901+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3292931656 shutdown_connections 2023-09-30T22:26:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.901+0000 7fbdec0f9700 1 -- 172.21.15.154:0/3292931656 wait complete. 2023-09-30T22:26:00.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:00.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.922+0000 7efea2e7e700 1 -- 172.21.15.154:0/1895290479 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe9c04f2a0 con 0x7efe9c06a770 2023-09-30T22:26:00.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.922+0000 7efe997fa700 1 -- 172.21.15.154:0/1895290479 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe9002a020 con 0x7efe9c06a770 2023-09-30T22:26:00.923 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:00.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.924+0000 7efea2e7e700 1 -- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c06a770 msgr2=0x7efe9c119ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.924+0000 7efea2e7e700 1 --2- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c06a770 0x7efe9c119ff0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efe90009840 tx=0x7efe90004750 comp rx=0 tx=0).stop 2023-09-30T22:26:00.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.925+0000 7efea2e7e700 1 -- 172.21.15.154:0/1895290479 shutdown_connections 2023-09-30T22:26:00.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.925+0000 7efea2e7e700 1 --2- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe9c134f00 0x7efe9c11aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.925+0000 7efea2e7e700 1 --2- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9c06a770 0x7efe9c119ff0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.925+0000 7efea2e7e700 1 --2- 172.21.15.154:0/1895290479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe9c09dea0 0x7efe9c11a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.925+0000 7efea2e7e700 1 -- 172.21.15.154:0/1895290479 >> 172.21.15.154:0/1895290479 conn(0x7efe9c099c40 msgr2=0x7efe9c1380a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.925+0000 7efea2e7e700 1 -- 172.21.15.154:0/1895290479 shutdown_connections 2023-09-30T22:26:00.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.925+0000 7efea2e7e700 1 -- 172.21.15.154:0/1895290479 wait complete. 2023-09-30T22:26:00.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.934+0000 7f74bc90d700 1 -- 172.21.15.154:0/159660050 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f74b812fe60 con 0x7f74b8138f20 2023-09-30T22:26:00.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.934+0000 7f74a6ffd700 1 -- 172.21.15.154:0/159660050 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74b0019070 con 0x7f74b8138f20 2023-09-30T22:26:00.935 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:00.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.935+0000 7f0768eba700 1 -- 172.21.15.154:0/2233506339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0748005590 con 0x7f076409edb0 2023-09-30T22:26:00.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.936+0000 7f0752ffd700 1 -- 172.21.15.154:0/2233506339 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0758003c90 con 0x7f076409edb0 2023-09-30T22:26:00.936 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:00.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.936+0000 7f74bc90d700 1 -- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b8138f20 msgr2=0x7f74b8127a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.936+0000 7f74bc90d700 1 --2- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b8138f20 0x7f74b8127a20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f74b000be50 tx=0x7f74b0009ed0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.936+0000 7f74bc90d700 1 -- 172.21.15.154:0/159660050 shutdown_connections 2023-09-30T22:26:00.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.936+0000 7f74bc90d700 1 --2- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74b8138f20 0x7f74b8127a20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.936+0000 7f74bc90d700 1 --2- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74b809a670 0x7f74b8126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.936+0000 7f74bc90d700 1 --2- 172.21.15.154:0/159660050 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74b8130460 0x7f74b81274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.936+0000 7f74bc90d700 1 -- 172.21.15.154:0/159660050 >> 172.21.15.154:0/159660050 conn(0x7f74b80a1ee0 msgr2=0x7f74b809c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.936+0000 7f74bc90d700 1 -- 172.21.15.154:0/159660050 shutdown_connections 2023-09-30T22:26:00.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.937+0000 7f74bc90d700 1 -- 172.21.15.154:0/159660050 wait complete. 2023-09-30T22:26:00.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:00.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.938+0000 7f0768eba700 1 -- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f076409edb0 msgr2=0x7f076412ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:00.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.938+0000 7f0768eba700 1 --2- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f076409edb0 0x7f076412ff80 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f0758000f60 tx=0x7f075800c730 comp rx=0 tx=0).stop 2023-09-30T22:26:00.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.938+0000 7f0768eba700 1 -- 172.21.15.154:0/2233506339 shutdown_connections 2023-09-30T22:26:00.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.938+0000 7f0768eba700 1 --2- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f076409f1e0 0x7f07641304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.938+0000 7f0768eba700 1 --2- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f076409a130 0x7f076411db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.938+0000 7f0768eba700 1 --2- 172.21.15.154:0/2233506339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f076409edb0 0x7f076412ff80 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:00.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.938+0000 7f0768eba700 1 -- 172.21.15.154:0/2233506339 >> 172.21.15.154:0/2233506339 conn(0x7f07640a4430 msgr2=0x7f07640a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:00.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.938+0000 7f0768eba700 1 -- 172.21.15.154:0/2233506339 shutdown_connections 2023-09-30T22:26:00.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:00.938+0000 7f0768eba700 1 -- 172.21.15.154:0/2233506339 wait complete. 2023-09-30T22:26:00.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:00.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:01.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:01.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:01.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:01.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:02.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.056+0000 7f5f4d638700 1 Processor -- start 2023-09-30T22:26:02.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.056+0000 7f5f4d638700 1 -- start start 2023-09-30T22:26:02.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f4d638700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f48131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f4d638700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f4809c7b0 0x7f5f48139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f4d638700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f480a2590 con 0x7f5f4809bc70 2023-09-30T22:26:02.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f4d638700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4806eaa0 con 0x7f5f4809c7b0 2023-09-30T22:26:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f4d638700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481315c0 con 0x7f5f481319f0 2023-09-30T22:26:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f46ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f48131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f46ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f48131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39810/0 (socket says 172.21.15.154:39810) 2023-09-30T22:26:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f46ffd700 1 -- 172.21.15.154:0/1882265464 learned_addr learned my addr 172.21.15.154:0/1882265464 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f477fe700 1 --2- 172.21.15.154:0/1882265464 >> v2:172.21.15.154:3300/0 conn(0x7f5f4809c7b0 0x7f5f48139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f46ffd700 1 -- 172.21.15.154:0/1882265464 >> v2:172.21.15.154:3300/0 conn(0x7f5f4809c7b0 msgr2=0x7f5f48139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/1882265464 >> v2:172.21.15.154:3300/0 conn(0x7f5f4809c7b0 0x7f5f48139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f46ffd700 1 -- 172.21.15.154:0/1882265464 >> v1:172.21.15.154:6789/0 conn(0x7f5f4809bc70 legacy=0x7f5f4809c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.057+0000 7f5f46ffd700 1 -- 172.21.15.154:0/1882265464 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480a1640 con 0x7f5f481319f0 2023-09-30T22:26:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.058+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/1882265464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f48131dc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5f38006fd0 tx=0x7f5f38009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb5d18cb4cb2288 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.058+0000 7f5f45ffb700 1 -- 172.21.15.154:0/1882265464 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38005e30 con 0x7f5f481319f0 2023-09-30T22:26:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.058+0000 7f5f45ffb700 1 -- 172.21.15.154:0/1882265464 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38006030 con 0x7f5f481319f0 2023-09-30T22:26:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.058+0000 7f5f45ffb700 1 -- 172.21.15.154:0/1882265464 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f380063c0 con 0x7f5f481319f0 2023-09-30T22:26:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.058+0000 7f5f4d638700 1 -- 172.21.15.154:0/1882265464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 msgr2=0x7f5f48131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.058+0000 7f5f4d638700 1 --2- 172.21.15.154:0/1882265464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f48131dc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5f38006fd0 tx=0x7f5f38009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.059+0000 7f5f4d638700 1 -- 172.21.15.154:0/1882265464 shutdown_connections 2023-09-30T22:26:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.059+0000 7f5f4d638700 1 --2- 172.21.15.154:0/1882265464 >> v2:172.21.15.154:3300/0 conn(0x7f5f4809c7b0 0x7f5f48139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.059+0000 7f5f4d638700 1 --2- 172.21.15.154:0/1882265464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f48131dc0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.059+0000 7f5f4d638700 1 -- 172.21.15.154:0/1882265464 >> 172.21.15.154:0/1882265464 conn(0x7f5f480a2980 msgr2=0x7f5f480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.059+0000 7f5f4d638700 1 -- 172.21.15.154:0/1882265464 shutdown_connections 2023-09-30T22:26:02.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.059+0000 7f5f4d638700 1 -- 172.21.15.154:0/1882265464 wait complete. 2023-09-30T22:26:02.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.060+0000 7f5f4d638700 1 Processor -- start 2023-09-30T22:26:02.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.060+0000 7f5f4d638700 1 -- start start 2023-09-30T22:26:02.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f4d638700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f4809bc70 0x7f5f48099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f4d638700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f4809c7b0 0x7f5f48099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f4d638700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f4809a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f4d638700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4812e680 con 0x7f5f4809bc70 2023-09-30T22:26:02.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f4d638700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4809b4c0 con 0x7f5f4809c7b0 2023-09-30T22:26:02.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f4d638700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48130d60 con 0x7f5f481319f0 2023-09-30T22:26:02.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f477fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f4809a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f46ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f4809bc70 0x7f5f48099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f477fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f4809a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39816/0 (socket says 172.21.15.154:39816) 2023-09-30T22:26:02.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f46ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f4809bc70 0x7f5f48099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59372/0 (socket says 172.21.15.154:59372) 2023-09-30T22:26:02.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f477fe700 1 -- 172.21.15.154:0/248008058 learned_addr learned my addr 172.21.15.154:0/248008058 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:02.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f46ffd700 1 -- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 msgr2=0x7f5f4809a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f4809a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f46ffd700 1 -- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f4809c7b0 msgr2=0x7f5f48099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f4809c7b0 0x7f5f48099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f46ffd700 1 -- 172.21.15.154:0/248008058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38009500 con 0x7f5f4809bc70 2023-09-30T22:26:02.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.061+0000 7f5f477fe700 1 --2- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f4809a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:02.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.062+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f4809bc70 0x7f5f48099a60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5f38015000 tx=0x7f5f38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.062+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/248008058 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38011420 con 0x7f5f4809bc70 2023-09-30T22:26:02.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.062+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/248008058 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380115a0 con 0x7f5f4809bc70 2023-09-30T22:26:02.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.062+0000 7f5f4d638700 1 -- 172.21.15.154:0/248008058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f481215f0 con 0x7f5f4809bc70 2023-09-30T22:26:02.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.062+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/248008058 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38011950 con 0x7f5f4809bc70 2023-09-30T22:26:02.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.062+0000 7f5f4d638700 1 -- 172.21.15.154:0/248008058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f480a1cb0 con 0x7f5f4809bc70 2023-09-30T22:26:02.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.063+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/248008058 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f38011ab0 con 0x7f5f4809bc70 2023-09-30T22:26:02.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.063+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/248008058 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f38040ae0 con 0x7f5f4809bc70 2023-09-30T22:26:02.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.063+0000 7f5f4d638700 1 -- 172.21.15.154:0/248008058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f48070060 con 0x7f5f4809bc70 2023-09-30T22:26:02.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.072+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/248008058 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f3800b790 con 0x7f5f4809bc70 2023-09-30T22:26:02.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.094+0000 7efdd7b04700 1 Processor -- start 2023-09-30T22:26:02.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.094+0000 7efdd7b04700 1 -- start start 2023-09-30T22:26:02.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd7b04700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd006cc70 0x7efdd00a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd7b04700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efdd00a13e0 0x7efdd013f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd7b04700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd009df50 con 0x7efdd00a0fb0 2023-09-30T22:26:02.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd7b04700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd009cf30 con 0x7efdd00a13e0 2023-09-30T22:26:02.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd7b04700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00a24a0 con 0x7efdd006cc70 2023-09-30T22:26:02.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd58a0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd006cc70 0x7efdd00a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd58a0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd006cc70 0x7efdd00a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39828/0 (socket says 172.21.15.154:39828) 2023-09-30T22:26:02.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd58a0700 1 -- 172.21.15.154:0/593829473 learned_addr learned my addr 172.21.15.154:0/593829473 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:02.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd60a1700 1 --2- 172.21.15.154:0/593829473 >> v2:172.21.15.154:3300/0 conn(0x7efdd00a13e0 0x7efdd013f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd58a0700 1 -- 172.21.15.154:0/593829473 >> v2:172.21.15.154:3300/0 conn(0x7efdd00a13e0 msgr2=0x7efdd013f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd58a0700 1 --2- 172.21.15.154:0/593829473 >> v2:172.21.15.154:3300/0 conn(0x7efdd00a13e0 0x7efdd013f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd58a0700 1 -- 172.21.15.154:0/593829473 >> v1:172.21.15.154:6789/0 conn(0x7efdd00a0fb0 legacy=0x7efdd013c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd58a0700 1 -- 172.21.15.154:0/593829473 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd009e1a0 con 0x7efdd006cc70 2023-09-30T22:26:02.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd60a1700 1 --2- 172.21.15.154:0/593829473 >> v2:172.21.15.154:3300/0 conn(0x7efdd00a13e0 0x7efdd013f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:02.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7efdd58a0700 1 --2- 172.21.15.154:0/593829473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd006cc70 0x7efdd00a0a70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0098f0 tx=0x7efdcc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6675bf255edae109 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.095+0000 7f5a423c0700 1 Processor -- start 2023-09-30T22:26:02.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a423c0700 1 -- start start 2023-09-30T22:26:02.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7efdd489e700 1 -- 172.21.15.154:0/593829473 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00b8a0 con 0x7efdd006cc70 2023-09-30T22:26:02.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7efdd489e700 1 -- 172.21.15.154:0/593829473 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc00ba00 con 0x7efdd006cc70 2023-09-30T22:26:02.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7efdd489e700 1 -- 172.21.15.154:0/593829473 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00bd90 con 0x7efdd006cc70 2023-09-30T22:26:02.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a423c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c12cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a423c0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a3c130630 0x7f5a3c137df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a423c0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c09b700 con 0x7f5a3c12fab0 2023-09-30T22:26:02.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a423c0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c09c350 con 0x7f5a3c130630 2023-09-30T22:26:02.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a423c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c09abf0 con 0x7f5a3c12cb80 2023-09-30T22:26:02.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a3bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c12cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a3bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c12cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39844/0 (socket says 172.21.15.154:39844) 2023-09-30T22:26:02.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a3bfff700 1 -- 172.21.15.154:0/2559203623 learned_addr learned my addr 172.21.15.154:0/2559203623 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:02.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.096+0000 7f5a4095d700 1 --2- 172.21.15.154:0/2559203623 >> v2:172.21.15.154:3300/0 conn(0x7f5a3c130630 0x7f5a3c137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7f5a3bfff700 1 -- 172.21.15.154:0/2559203623 >> v2:172.21.15.154:3300/0 conn(0x7f5a3c130630 msgr2=0x7f5a3c137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7f5a3bfff700 1 --2- 172.21.15.154:0/2559203623 >> v2:172.21.15.154:3300/0 conn(0x7f5a3c130630 0x7f5a3c137df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7f5a3bfff700 1 -- 172.21.15.154:0/2559203623 >> v1:172.21.15.154:6789/0 conn(0x7f5a3c12fab0 legacy=0x7f5a3c12ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7f5a3bfff700 1 -- 172.21.15.154:0/2559203623 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c12d490 con 0x7f5a3c12cb80 2023-09-30T22:26:02.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7f5a3bfff700 1 --2- 172.21.15.154:0/2559203623 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c12cf50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0098f0 tx=0x7f5a2c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a85c17c2caca1f9b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7f5a3affd700 1 -- 172.21.15.154:0/2559203623 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c004230 con 0x7f5a3c12cb80 2023-09-30T22:26:02.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7f5a3affd700 1 -- 172.21.15.154:0/2559203623 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c004390 con 0x7f5a3c12cb80 2023-09-30T22:26:02.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7f5a3affd700 1 -- 172.21.15.154:0/2559203623 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0036a0 con 0x7f5a3c12cb80 2023-09-30T22:26:02.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7efdd7b04700 1 -- 172.21.15.154:0/593829473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd006cc70 msgr2=0x7efdd00a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7efdd7b04700 1 --2- 172.21.15.154:0/593829473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd006cc70 0x7efdd00a0a70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0098f0 tx=0x7efdcc009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:02.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7efdd7b04700 1 -- 172.21.15.154:0/593829473 shutdown_connections 2023-09-30T22:26:02.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7efdd7b04700 1 --2- 172.21.15.154:0/593829473 >> v2:172.21.15.154:3300/0 conn(0x7efdd00a13e0 0x7efdd013f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7efdd7b04700 1 --2- 172.21.15.154:0/593829473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd006cc70 0x7efdd00a0a70 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.097+0000 7efdd7b04700 1 -- 172.21.15.154:0/593829473 >> 172.21.15.154:0/593829473 conn(0x7efdd00a6610 msgr2=0x7efdd00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7efdd7b04700 1 -- 172.21.15.154:0/593829473 shutdown_connections 2023-09-30T22:26:02.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7efdd7b04700 1 -- 172.21.15.154:0/593829473 wait complete. 2023-09-30T22:26:02.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7f5a423c0700 1 -- 172.21.15.154:0/2559203623 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 msgr2=0x7f5a3c12cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7f5a423c0700 1 --2- 172.21.15.154:0/2559203623 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c12cf50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0098f0 tx=0x7f5a2c009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:02.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7f5a423c0700 1 -- 172.21.15.154:0/2559203623 shutdown_connections 2023-09-30T22:26:02.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7f5a423c0700 1 --2- 172.21.15.154:0/2559203623 >> v2:172.21.15.154:3300/0 conn(0x7f5a3c130630 0x7f5a3c137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7f5a423c0700 1 --2- 172.21.15.154:0/2559203623 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c12cf50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7f5a423c0700 1 -- 172.21.15.154:0/2559203623 >> 172.21.15.154:0/2559203623 conn(0x7f5a3c0a2eb0 msgr2=0x7f5a3c09eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7f5a423c0700 1 -- 172.21.15.154:0/2559203623 shutdown_connections 2023-09-30T22:26:02.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.098+0000 7f5a423c0700 1 -- 172.21.15.154:0/2559203623 wait complete. 2023-09-30T22:26:02.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f56057c1700 1 Processor -- start 2023-09-30T22:26:02.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7efdd7b04700 1 Processor -- start 2023-09-30T22:26:02.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f56057c1700 1 -- start start 2023-09-30T22:26:02.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7efdd7b04700 1 -- start start 2023-09-30T22:26:02.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f5a423c0700 1 Processor -- start 2023-09-30T22:26:02.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f5a423c0700 1 -- start start 2023-09-30T22:26:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f56057c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f560009e870 0x7f560009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f56057c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009f180 0x7f5600131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f56057c1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5600131d70 0x7f5600132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f56057c1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56000a0920 con 0x7f5600131d70 2023-09-30T22:26:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f56057c1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560009c970 con 0x7f560009e870 2023-09-30T22:26:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.099+0000 7f56057c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f560009bab0 con 0x7f560009f180 2023-09-30T22:26:02.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f55ff7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5600131d70 0x7f5600132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd7b04700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd006cc70 0x7efdd0070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd7b04700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00a0fb0 0x7efdd012dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd7b04700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd00a13e0 0x7efdd012e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd7b04700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd0071a90 con 0x7efdd00a0fb0 2023-09-30T22:26:02.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd7b04700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00718a0 con 0x7efdd006cc70 2023-09-30T22:26:02.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd7b04700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd01345e0 con 0x7efdd00a13e0 2023-09-30T22:26:02.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f55ff7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5600131d70 0x7f5600132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59402/0 (socket says 172.21.15.154:59402) 2023-09-30T22:26:02.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f55ff7fe700 1 -- 172.21.15.154:0/3813211754 learned_addr learned my addr 172.21.15.154:0/3813211754 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:02.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd509f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00a0fb0 0x7efdd012dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd509f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00a0fb0 0x7efdd012dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59414/0 (socket says 172.21.15.154:59414) 2023-09-30T22:26:02.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd509f700 1 -- 172.21.15.154:0/1640379322 learned_addr learned my addr 172.21.15.154:0/1640379322 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:02.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a423c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c131950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a423c0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a3c12fab0 0x7f5a3c131e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a423c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a3c130630 0x7f5a3c1c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a423c0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c09e210 con 0x7f5a3c130630 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a423c0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c09b050 con 0x7f5a3c12fab0 2023-09-30T22:26:02.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a423c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c132c30 con 0x7f5a3c12cb80 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f55ff7fe700 1 -- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009f180 msgr2=0x7f5600131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f55ff7fe700 1 --2- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009f180 0x7f5600131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f55ff7fe700 1 -- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f560009e870 msgr2=0x7f560009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f55ff7fe700 1 --2- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f560009e870 0x7f560009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f55ff7fe700 1 -- 172.21.15.154:0/3813211754 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560009f9c0 con 0x7f5600131d70 2023-09-30T22:26:02.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd509f700 1 -- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd00a13e0 msgr2=0x7efdd012e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd60a1700 1 --2- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd00a13e0 0x7efdd012e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a4095d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a3c130630 0x7f5a3c1c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a3bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c131950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a4095d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a3c130630 0x7f5a3c1c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59426/0 (socket says 172.21.15.154:59426) 2023-09-30T22:26:02.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a4095d700 1 -- 172.21.15.154:0/1162082522 learned_addr learned my addr 172.21.15.154:0/1162082522 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:02.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd509f700 1 --2- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd00a13e0 0x7efdd012e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd509f700 1 -- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd006cc70 msgr2=0x7efdd0070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd509f700 1 --2- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd006cc70 0x7efdd0070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd509f700 1 -- 172.21.15.154:0/1640379322 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc009550 con 0x7efdd00a0fb0 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7efdd60a1700 1 --2- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd00a13e0 0x7efdd012e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:02.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a4095d700 1 -- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 msgr2=0x7f5a3c131950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a4095d700 1 --2- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c131950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a4095d700 1 -- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a3c12fab0 msgr2=0x7f5a3c131e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f5a4095d700 1 --2- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a3c12fab0 0x7f5a3c131e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f5a4095d700 1 -- 172.21.15.154:0/1162082522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c009550 con 0x7f5a3c130630 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.100+0000 7f55ff7fe700 1 --2- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5600131d70 0x7f5600132210 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009e50 tx=0x7f55f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a719e2488c5234c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7efdd509f700 1 --2- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00a0fb0 0x7efdd012dc50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7efdc000c4b0 tx=0x7efdc000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f5a4095d700 1 --2- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a3c130630 0x7f5a3c1c8450 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400efc0 tx=0x7f5a3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f55fdffb700 1 -- 172.21.15.154:0/3813211754 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800e070 con 0x7f5600131d70 2023-09-30T22:26:02.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f55fdffb700 1 -- 172.21.15.154:0/3813211754 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f800b9c0 con 0x7f5600131d70 2023-09-30T22:26:02.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f55fdffb700 1 -- 172.21.15.154:0/3813211754 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f800bd70 con 0x7f5600131d70 2023-09-30T22:26:02.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7efdc67fc700 1 -- 172.21.15.154:0/1640379322 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc00052d0 con 0x7efdd00a0fb0 2023-09-30T22:26:02.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f5a38ff9700 1 -- 172.21.15.154:0/1162082522 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400cd40 con 0x7f5a3c130630 2023-09-30T22:26:02.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f5a423c0700 1 -- 172.21.15.154:0/1162082522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c134aa0 con 0x7f5a3c130630 2023-09-30T22:26:02.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7efdc67fc700 1 -- 172.21.15.154:0/1640379322 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc0005430 con 0x7efdd00a0fb0 2023-09-30T22:26:02.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7efdc67fc700 1 -- 172.21.15.154:0/1640379322 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc00038c0 con 0x7efdd00a0fb0 2023-09-30T22:26:02.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7efdd7b04700 1 -- 172.21.15.154:0/1640379322 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd01330d0 con 0x7efdd00a0fb0 2023-09-30T22:26:02.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f56057c1700 1 -- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5600131d70 msgr2=0x7f5600132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f56057c1700 1 --2- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5600131d70 0x7f5600132210 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009e50 tx=0x7f55f800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:02.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f5a38ff9700 1 -- 172.21.15.154:0/1162082522 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3400f040 con 0x7f5a3c130630 2023-09-30T22:26:02.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f5a38ff9700 1 -- 172.21.15.154:0/1162082522 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340146c0 con 0x7f5a3c130630 2023-09-30T22:26:02.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7f5a423c0700 1 -- 172.21.15.154:0/1162082522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c1323d0 con 0x7f5a3c130630 2023-09-30T22:26:02.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f56057c1700 1 -- 172.21.15.154:0/3813211754 shutdown_connections 2023-09-30T22:26:02.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f56057c1700 1 --2- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f560009e870 0x7f560009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f56057c1700 1 --2- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5600131d70 0x7f5600132210 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f56057c1700 1 --2- 172.21.15.154:0/3813211754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009f180 0x7f5600131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f56057c1700 1 -- 172.21.15.154:0/3813211754 >> 172.21.15.154:0/3813211754 conn(0x7f56000a4430 msgr2=0x7f56000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f56057c1700 1 -- 172.21.15.154:0/3813211754 shutdown_connections 2023-09-30T22:26:02.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f56057c1700 1 -- 172.21.15.154:0/3813211754 wait complete. 2023-09-30T22:26:02.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.101+0000 7efdd7b04700 1 -- 172.21.15.154:0/1640379322 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd00a40f0 con 0x7efdd00a0fb0 2023-09-30T22:26:02.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.102+0000 7f5a423c0700 1 -- 172.21.15.154:0/1162082522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c09d430 con 0x7f5a3c130630 2023-09-30T22:26:02.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.103+0000 7f5a38ff9700 1 -- 172.21.15.154:0/1162082522 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a34014820 con 0x7f5a3c130630 2023-09-30T22:26:02.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.103+0000 7f5a38ff9700 1 -- 172.21.15.154:0/1162082522 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a340408b0 con 0x7f5a3c130630 2023-09-30T22:26:02.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.103+0000 7efdc67fc700 1 -- 172.21.15.154:0/1640379322 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdc0003a20 con 0x7efdd00a0fb0 2023-09-30T22:26:02.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.103+0000 7f56057c1700 1 Processor -- start 2023-09-30T22:26:02.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.103+0000 7efdc67fc700 1 -- 172.21.15.154:0/1640379322 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efdc003ebf0 con 0x7efdd00a0fb0 2023-09-30T22:26:02.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7efdd7b04700 1 -- 172.21.15.154:0/1640379322 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd0071e20 con 0x7efdd00a0fb0 2023-09-30T22:26:02.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f56057c1700 1 -- start start 2023-09-30T22:26:02.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f56057c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009e870 0x7f5600120380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f56057c1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f560009f180 0x7f56001208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f56057c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5600131d70 0x7f5600120e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:02.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f56057c1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5600123b30 con 0x7f560009f180 2023-09-30T22:26:02.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f56057c1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5600122790 con 0x7f5600131d70 2023-09-30T22:26:02.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f56057c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5600123e10 con 0x7f560009e870 2023-09-30T22:26:02.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f55feffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009e870 0x7f5600120380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f55ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5600131d70 0x7f5600120e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f55feffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009e870 0x7f5600120380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39868/0 (socket says 172.21.15.154:39868) 2023-09-30T22:26:02.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f55ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5600131d70 0x7f5600120e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59756/0 (socket says 172.21.15.154:59756) 2023-09-30T22:26:02.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f55feffd700 1 -- 172.21.15.154:0/1835419183 learned_addr learned my addr 172.21.15.154:0/1835419183 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:02.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f55fe7fc700 1 --2- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f560009f180 0x7f56001208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:02.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f55feffd700 1 -- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5600131d70 msgr2=0x7f5600120e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.104+0000 7f55feffd700 1 --2- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5600131d70 0x7f5600120e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f55feffd700 1 -- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f560009f180 msgr2=0x7f56001208c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f55feffd700 1 --2- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f560009f180 0x7f56001208c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f55feffd700 1 -- 172.21.15.154:0/1835419183 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8009b30 con 0x7f560009e870 2023-09-30T22:26:02.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f55ff7fe700 1 --2- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5600131d70 0x7f5600120e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:02.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f55feffd700 1 --2- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009e870 0x7f5600120380 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f55f0008a10 tx=0x7f55f0008d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:02.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f55e77fe700 1 -- 172.21.15.154:0/1835419183 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0009590 con 0x7f560009e870 2023-09-30T22:26:02.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f55e77fe700 1 -- 172.21.15.154:0/1835419183 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f000d070 con 0x7f560009e870 2023-09-30T22:26:02.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f55e77fe700 1 -- 172.21.15.154:0/1835419183 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0009930 con 0x7f560009e870 2023-09-30T22:26:02.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f56057c1700 1 -- 172.21.15.154:0/1835419183 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56000a2b50 con 0x7f560009e870 2023-09-30T22:26:02.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.105+0000 7f56057c1700 1 -- 172.21.15.154:0/1835419183 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5600122d20 con 0x7f560009e870 2023-09-30T22:26:02.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.106+0000 7f55e77fe700 1 -- 172.21.15.154:0/1835419183 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55f0009a90 con 0x7f560009e870 2023-09-30T22:26:02.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.106+0000 7f55e77fe700 1 -- 172.21.15.154:0/1835419183 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f55f003ea60 con 0x7f560009e870 2023-09-30T22:26:02.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.107+0000 7f56057c1700 1 -- 172.21.15.154:0/1835419183 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560004f2a0 con 0x7f560009e870 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.109+0000 7f5a38ff9700 1 -- 172.21.15.154:0/1162082522 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a34012bc0 con 0x7f5a3c130630 2023-09-30T22:26:02.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.111+0000 7f55e77fe700 1 -- 172.21.15.154:0/1835419183 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55f001b020 con 0x7f560009e870 2023-09-30T22:26:02.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.115+0000 7efdc67fc700 1 -- 172.21.15.154:0/1640379322 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdc0017080 con 0x7efdd00a0fb0 2023-09-30T22:26:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.302+0000 7f5f4d638700 1 -- 172.21.15.154:0/248008058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f4804f2a0 con 0x7f5f4809bc70 2023-09-30T22:26:02.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.302+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/248008058 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f38019390 con 0x7f5f4809bc70 2023-09-30T22:26:02.303 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:02.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.304+0000 7f5f4d638700 1 -- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f4809bc70 msgr2=0x7f5f48099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.304+0000 7f5f4d638700 1 --2- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f4809bc70 0x7f5f48099a60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5f38015000 tx=0x7f5f38004750 comp rx=0 tx=0).stop 2023-09-30T22:26:02.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.305+0000 7f5f4d638700 1 -- 172.21.15.154:0/248008058 shutdown_connections 2023-09-30T22:26:02.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.305+0000 7f5f4d638700 1 --2- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481319f0 0x7f5f4809a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.305+0000 7f5f4d638700 1 --2- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f4809bc70 0x7f5f48099a60 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.305+0000 7f5f4d638700 1 --2- 172.21.15.154:0/248008058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f4809c7b0 0x7f5f48099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.305+0000 7f5f4d638700 1 -- 172.21.15.154:0/248008058 >> 172.21.15.154:0/248008058 conn(0x7f5f480a2980 msgr2=0x7f5f48071500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.305+0000 7f5f4d638700 1 -- 172.21.15.154:0/248008058 shutdown_connections 2023-09-30T22:26:02.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.305+0000 7f5f4d638700 1 -- 172.21.15.154:0/248008058 wait complete. 2023-09-30T22:26:02.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.306+0000 7f56057c1700 1 -- 172.21.15.154:0/1835419183 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56000a0470 con 0x7f560009e870 2023-09-30T22:26:02.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.306+0000 7f55e77fe700 1 -- 172.21.15.154:0/1835419183 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55f0015ba0 con 0x7f560009e870 2023-09-30T22:26:02.308 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7f56057c1700 1 -- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009e870 msgr2=0x7f5600120380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7f56057c1700 1 --2- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009e870 0x7f5600120380 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f55f0008a10 tx=0x7f55f0008d20 comp rx=0 tx=0).stop 2023-09-30T22:26:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7f56057c1700 1 -- 172.21.15.154:0/1835419183 shutdown_connections 2023-09-30T22:26:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7f56057c1700 1 --2- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5600131d70 0x7f5600120e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7f56057c1700 1 --2- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f560009e870 0x7f5600120380 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7f56057c1700 1 --2- 172.21.15.154:0/1835419183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f560009f180 0x7f56001208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7f56057c1700 1 -- 172.21.15.154:0/1835419183 >> 172.21.15.154:0/1835419183 conn(0x7f56000a4430 msgr2=0x7f560006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7f56057c1700 1 -- 172.21.15.154:0/1835419183 shutdown_connections 2023-09-30T22:26:02.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7f56057c1700 1 -- 172.21.15.154:0/1835419183 wait complete. 2023-09-30T22:26:02.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7efdd7b04700 1 -- 172.21.15.154:0/1640379322 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efdd00a0020 con 0x7efdd00a0fb0 2023-09-30T22:26:02.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.309+0000 7efdc67fc700 1 -- 172.21.15.154:0/1640379322 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdc000e280 con 0x7efdd00a0fb0 2023-09-30T22:26:02.311 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.312+0000 7efdd7b04700 1 -- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00a0fb0 msgr2=0x7efdd012dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.312+0000 7efdd7b04700 1 --2- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00a0fb0 0x7efdd012dc50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7efdc000c4b0 tx=0x7efdc000c870 comp rx=0 tx=0).stop 2023-09-30T22:26:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.313+0000 7efdd7b04700 1 -- 172.21.15.154:0/1640379322 shutdown_connections 2023-09-30T22:26:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.313+0000 7efdd7b04700 1 --2- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd00a13e0 0x7efdd012e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.313+0000 7efdd7b04700 1 --2- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd006cc70 0x7efdd0070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.313+0000 7efdd7b04700 1 --2- 172.21.15.154:0/1640379322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00a0fb0 0x7efdd012dc50 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.313+0000 7efdd7b04700 1 -- 172.21.15.154:0/1640379322 >> 172.21.15.154:0/1640379322 conn(0x7efdd00a6610 msgr2=0x7efdd00a2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.313+0000 7efdd7b04700 1 -- 172.21.15.154:0/1640379322 shutdown_connections 2023-09-30T22:26:02.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.313+0000 7efdd7b04700 1 -- 172.21.15.154:0/1640379322 wait complete. 2023-09-30T22:26:02.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:02.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:02.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:02.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.342+0000 7f5a423c0700 1 -- 172.21.15.154:0/1162082522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5a3c04f2a0 con 0x7f5a3c130630 2023-09-30T22:26:02.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.343+0000 7f5a38ff9700 1 -- 172.21.15.154:0/1162082522 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a3402a070 con 0x7f5a3c130630 2023-09-30T22:26:02.344 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:02.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.345+0000 7f5a423c0700 1 -- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a3c130630 msgr2=0x7f5a3c1c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:02.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.345+0000 7f5a423c0700 1 --2- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a3c130630 0x7f5a3c1c8450 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400efc0 tx=0x7f5a3400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.345+0000 7f5a423c0700 1 -- 172.21.15.154:0/1162082522 shutdown_connections 2023-09-30T22:26:02.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.345+0000 7f5a423c0700 1 --2- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a3c130630 0x7f5a3c1c8450 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.345+0000 7f5a423c0700 1 --2- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5a3c12cb80 0x7f5a3c131950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.345+0000 7f5a423c0700 1 --2- 172.21.15.154:0/1162082522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a3c12fab0 0x7f5a3c131e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:02.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.345+0000 7f5a423c0700 1 -- 172.21.15.154:0/1162082522 >> 172.21.15.154:0/1162082522 conn(0x7f5a3c0a2eb0 msgr2=0x7f5a3c12e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:02.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.345+0000 7f5a423c0700 1 -- 172.21.15.154:0/1162082522 shutdown_connections 2023-09-30T22:26:02.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:02.345+0000 7f5a423c0700 1 -- 172.21.15.154:0/1162082522 wait complete. 2023-09-30T22:26:02.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:03.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:03.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:03.329 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:03.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.468+0000 7efd74c1e700 1 Processor -- start 2023-09-30T22:26:03.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.468+0000 7efd74c1e700 1 -- start start 2023-09-30T22:26:03.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd74c1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd70133900 0x7efd70133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd74c1e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd70134210 0x7efd700a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd74c1e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7009a760 con 0x7efd700a0ee0 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd74c1e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd701336e0 con 0x7efd70134210 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd74c1e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7009a080 con 0x7efd70133900 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd6e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd70133900 0x7efd70133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd6e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd70133900 0x7efd70133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59762/0 (socket says 172.21.15.154:59762) 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd6e59c700 1 -- 172.21.15.154:0/1887531524 learned_addr learned my addr 172.21.15.154:0/1887531524 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd6e59c700 1 -- 172.21.15.154:0/1887531524 >> v2:172.21.15.154:3300/0 conn(0x7efd70134210 msgr2=0x7efd700a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd6e59c700 1 --2- 172.21.15.154:0/1887531524 >> v2:172.21.15.154:3300/0 conn(0x7efd70134210 0x7efd700a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd6e59c700 1 -- 172.21.15.154:0/1887531524 >> v1:172.21.15.154:6789/0 conn(0x7efd700a0ee0 legacy=0x7efd7013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.469+0000 7efd6e59c700 1 -- 172.21.15.154:0/1887531524 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700a23e0 con 0x7efd70133900 2023-09-30T22:26:03.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.470+0000 7efd6e59c700 1 --2- 172.21.15.154:0/1887531524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd70133900 0x7efd70133cd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efd60006fd0 tx=0x7efd60009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=156e0d7e02b7b80e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.470+0000 7efd6d59a700 1 -- 172.21.15.154:0/1887531524 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60005e30 con 0x7efd70133900 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.470+0000 7efd6d59a700 1 -- 172.21.15.154:0/1887531524 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60006030 con 0x7efd70133900 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.470+0000 7efd6d59a700 1 -- 172.21.15.154:0/1887531524 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600063c0 con 0x7efd70133900 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.470+0000 7efd74c1e700 1 -- 172.21.15.154:0/1887531524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd70133900 msgr2=0x7efd70133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.470+0000 7efd74c1e700 1 --2- 172.21.15.154:0/1887531524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd70133900 0x7efd70133cd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efd60006fd0 tx=0x7efd60009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.471+0000 7efd74c1e700 1 -- 172.21.15.154:0/1887531524 shutdown_connections 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.471+0000 7efd74c1e700 1 --2- 172.21.15.154:0/1887531524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd70133900 0x7efd70133cd0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.471+0000 7efd74c1e700 1 --2- 172.21.15.154:0/1887531524 >> v2:172.21.15.154:3300/0 conn(0x7efd70134210 0x7efd700a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.471+0000 7efd74c1e700 1 -- 172.21.15.154:0/1887531524 >> 172.21.15.154:0/1887531524 conn(0x7efd700a2980 msgr2=0x7efd700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.471+0000 7efd74c1e700 1 -- 172.21.15.154:0/1887531524 shutdown_connections 2023-09-30T22:26:03.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.471+0000 7efd74c1e700 1 -- 172.21.15.154:0/1887531524 wait complete. 2023-09-30T22:26:03.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd74c1e700 1 Processor -- start 2023-09-30T22:26:03.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd74c1e700 1 -- start start 2023-09-30T22:26:03.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd74c1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700a0ee0 0x7efd7011c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd74c1e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd70133900 0x7efd7011cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd74c1e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd70134210 0x7efd7011d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd74c1e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7011dd80 con 0x7efd70133900 2023-09-30T22:26:03.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd74c1e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7012fca0 con 0x7efd700a0ee0 2023-09-30T22:26:03.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd74c1e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd7011f710 con 0x7efd70134210 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd6dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd70133900 0x7efd7011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd6dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd70133900 0x7efd7011cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59444/0 (socket says 172.21.15.154:59444) 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.472+0000 7efd6dd9b700 1 -- 172.21.15.154:0/3413847825 learned_addr learned my addr 172.21.15.154:0/3413847825 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd6e59c700 1 --2- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700a0ee0 0x7efd7011c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd6e59c700 1 -- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd70134210 msgr2=0x7efd7011d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd6e59c700 1 --2- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd70134210 0x7efd7011d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd6e59c700 1 -- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd70133900 msgr2=0x7efd7011cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd6e59c700 1 --2- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd70133900 0x7efd7011cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd6e59c700 1 -- 172.21.15.154:0/3413847825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009500 con 0x7efd700a0ee0 2023-09-30T22:26:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd6dd9b700 1 --2- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd70133900 0x7efd7011cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd6e59c700 1 --2- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700a0ee0 0x7efd7011c8b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efd60015000 tx=0x7efd60004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd5effd700 1 -- 172.21.15.154:0/3413847825 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60011420 con 0x7efd700a0ee0 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd5effd700 1 -- 172.21.15.154:0/3413847825 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd600115a0 con 0x7efd700a0ee0 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd74c1e700 1 -- 172.21.15.154:0/3413847825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd701200f0 con 0x7efd700a0ee0 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.473+0000 7efd5effd700 1 -- 172.21.15.154:0/3413847825 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60011950 con 0x7efd700a0ee0 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.474+0000 7efd74c1e700 1 -- 172.21.15.154:0/3413847825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd70132eb0 con 0x7efd700a0ee0 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.475+0000 7efd74c1e700 1 -- 172.21.15.154:0/3413847825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7009a2c0 con 0x7efd700a0ee0 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.475+0000 7efd5effd700 1 -- 172.21.15.154:0/3413847825 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd60011ab0 con 0x7efd700a0ee0 2023-09-30T22:26:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.475+0000 7efd5effd700 1 -- 172.21.15.154:0/3413847825 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd6001bc20 con 0x7efd700a0ee0 2023-09-30T22:26:03.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.480+0000 7efd5effd700 1 -- 172.21.15.154:0/3413847825 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd60046060 con 0x7efd700a0ee0 2023-09-30T22:26:03.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.506+0000 7f71c2b1f700 1 Processor -- start 2023-09-30T22:26:03.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.506+0000 7f71c2b1f700 1 -- start start 2023-09-30T22:26:03.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.506+0000 7f71c2b1f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc133ad0 0x7f71bc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.506+0000 7f71c2b1f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71bc1300a0 0x7f71bc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.506+0000 7f71c2b1f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.506+0000 7f71c2b1f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc06b2d0 con 0x7f71bc1300a0 2023-09-30T22:26:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.506+0000 7f71c2b1f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc133610 con 0x7f71bc133ad0 2023-09-30T22:26:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.506+0000 7f71c2b1f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc09a500 con 0x7f71bc1309f0 2023-09-30T22:26:03.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.506+0000 7f2116b8c700 1 Processor -- start 2023-09-30T22:26:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c08bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc133ad0 0x7f71bc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c08bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc133ad0 0x7f71bc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59788/0 (socket says 172.21.15.154:59788) 2023-09-30T22:26:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c08bb700 1 -- 172.21.15.154:0/3292291144 learned_addr learned my addr 172.21.15.154:0/3292291144 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c10bc700 1 --2- 172.21.15.154:0/3292291144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f2116b8c700 1 -- start start 2023-09-30T22:26:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c10bc700 1 -- 172.21.15.154:0/3292291144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc133ad0 msgr2=0x7f71bc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c10bc700 1 --2- 172.21.15.154:0/3292291144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc133ad0 0x7f71bc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c10bc700 1 -- 172.21.15.154:0/3292291144 >> v2:172.21.15.154:3300/0 conn(0x7f71bc1300a0 msgr2=0x7f71bc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c10bc700 1 --2- 172.21.15.154:0/3292291144 >> v2:172.21.15.154:3300/0 conn(0x7f71bc1300a0 0x7f71bc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c10bc700 1 -- 172.21.15.154:0/3292291144 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc1338b0 con 0x7f71bc1309f0 2023-09-30T22:26:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f2116b8c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f211006a770 0x7f21101349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f2116b8c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211009e070 0x7f211013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f2116b8c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211009eca0 con 0x7f2110134f00 2023-09-30T22:26:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f2116b8c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211006b2e0 con 0x7f211006a770 2023-09-30T22:26:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f2116b8c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211009f720 con 0x7f211009e070 2023-09-30T22:26:03.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f71c10bc700 1 --2- 172.21.15.154:0/3292291144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc13a980 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009d90 tx=0x7f71b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50439f084deeaae3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.507+0000 7f2115129700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211009e070 0x7f211013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f2115129700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211009e070 0x7f211013fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39898/0 (socket says 172.21.15.154:39898) 2023-09-30T22:26:03.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f2115129700 1 -- 172.21.15.154:0/329595687 learned_addr learned my addr 172.21.15.154:0/329595687 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:03.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f71bb7fe700 1 -- 172.21.15.154:0/3292291144 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400e070 con 0x7f71bc1309f0 2023-09-30T22:26:03.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f71bb7fe700 1 -- 172.21.15.154:0/3292291144 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b400bb20 con 0x7f71bc1309f0 2023-09-30T22:26:03.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f71bb7fe700 1 -- 172.21.15.154:0/3292291144 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4012430 con 0x7f71bc1309f0 2023-09-30T22:26:03.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f2115129700 1 -- 172.21.15.154:0/329595687 >> v2:172.21.15.154:3300/0 conn(0x7f211006a770 msgr2=0x7f21101349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f2115129700 1 --2- 172.21.15.154:0/329595687 >> v2:172.21.15.154:3300/0 conn(0x7f211006a770 0x7f21101349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f2115129700 1 -- 172.21.15.154:0/329595687 >> v1:172.21.15.154:6789/0 conn(0x7f2110134f00 legacy=0x7f211009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f2115129700 1 -- 172.21.15.154:0/329595687 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211006b480 con 0x7f211009e070 2023-09-30T22:26:03.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f2115129700 1 --2- 172.21.15.154:0/329595687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211009e070 0x7f211013fcf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2108009e50 tx=0x7f210800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1b7ec05dcf3bd29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f210f7fe700 1 -- 172.21.15.154:0/329595687 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800e070 con 0x7f211009e070 2023-09-30T22:26:03.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f210f7fe700 1 -- 172.21.15.154:0/329595687 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2108003a20 con 0x7f211009e070 2023-09-30T22:26:03.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f210f7fe700 1 -- 172.21.15.154:0/329595687 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108003dd0 con 0x7f211009e070 2023-09-30T22:26:03.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f71c2b1f700 1 -- 172.21.15.154:0/3292291144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 msgr2=0x7f71bc13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.508+0000 7f71c2b1f700 1 --2- 172.21.15.154:0/3292291144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc13a980 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009d90 tx=0x7f71b400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:03.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f71c2b1f700 1 -- 172.21.15.154:0/3292291144 shutdown_connections 2023-09-30T22:26:03.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f71c2b1f700 1 --2- 172.21.15.154:0/3292291144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc133ad0 0x7f71bc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f71c2b1f700 1 --2- 172.21.15.154:0/3292291144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc13a980 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f71c2b1f700 1 --2- 172.21.15.154:0/3292291144 >> v2:172.21.15.154:3300/0 conn(0x7f71bc1300a0 0x7f71bc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f71c2b1f700 1 -- 172.21.15.154:0/3292291144 >> 172.21.15.154:0/3292291144 conn(0x7f71bc099c40 msgr2=0x7f71bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f2116b8c700 1 -- 172.21.15.154:0/329595687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211009e070 msgr2=0x7f211013fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f2116b8c700 1 --2- 172.21.15.154:0/329595687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211009e070 0x7f211013fcf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2108009e50 tx=0x7f210800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:03.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f71c2b1f700 1 -- 172.21.15.154:0/3292291144 shutdown_connections 2023-09-30T22:26:03.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f2116b8c700 1 -- 172.21.15.154:0/329595687 shutdown_connections 2023-09-30T22:26:03.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f2116b8c700 1 --2- 172.21.15.154:0/329595687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f211009e070 0x7f211013fcf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f2116b8c700 1 --2- 172.21.15.154:0/329595687 >> v2:172.21.15.154:3300/0 conn(0x7f211006a770 0x7f21101349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f2116b8c700 1 -- 172.21.15.154:0/329595687 >> 172.21.15.154:0/329595687 conn(0x7f2110099c40 msgr2=0x7f21100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f71c2b1f700 1 -- 172.21.15.154:0/3292291144 wait complete. 2023-09-30T22:26:03.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f2116b8c700 1 -- 172.21.15.154:0/329595687 shutdown_connections 2023-09-30T22:26:03.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.509+0000 7f2116b8c700 1 -- 172.21.15.154:0/329595687 wait complete. 2023-09-30T22:26:03.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.510+0000 7f2116b8c700 1 Processor -- start 2023-09-30T22:26:03.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.510+0000 7f71c2b1f700 1 Processor -- start 2023-09-30T22:26:03.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.510+0000 7f71c2b1f700 1 -- start start 2023-09-30T22:26:03.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.510+0000 7f2116b8c700 1 -- start start 2023-09-30T22:26:03.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7ff67d505700 1 Processor -- start 2023-09-30T22:26:03.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7ff67d505700 1 -- start start 2023-09-30T22:26:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f2116b8c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f211006a770 0x7f211011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f2116b8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211009e070 0x7f211011abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f2116b8c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2110134f00 0x7f211011b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f2116b8c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2110126370 con 0x7f211006a770 2023-09-30T22:26:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f2116b8c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211011c160 con 0x7f211009e070 2023-09-30T22:26:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f2116b8c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2110126ba0 con 0x7f2110134f00 2023-09-30T22:26:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f71c2b1f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc1300a0 0x7f71bc11c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f71c2b1f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc11c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f71c2b1f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc133ad0 0x7f71bc1cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f71c2b1f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc070370 con 0x7f71bc133ad0 2023-09-30T22:26:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f71c2b1f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc12dd00 con 0x7f71bc1300a0 2023-09-30T22:26:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f71c2b1f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc06ffd0 con 0x7f71bc1309f0 2023-09-30T22:26:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f71c10bc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc133ad0 0x7f71bc1cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f71c10bc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc133ad0 0x7f71bc1cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59486/0 (socket says 172.21.15.154:59486) 2023-09-30T22:26:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f71c10bc700 1 -- 172.21.15.154:0/2862031523 learned_addr learned my addr 172.21.15.154:0/2862031523 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:03.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f2115129700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2110134f00 0x7f211011b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f2115129700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2110134f00 0x7f211011b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39900/0 (socket says 172.21.15.154:39900) 2023-09-30T22:26:03.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f2115129700 1 -- 172.21.15.154:0/1484456275 learned_addr learned my addr 172.21.15.154:0/1484456275 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:03.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.511+0000 7f210ffff700 1 --2- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211009e070 0x7f211011abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f71c08bb700 1 --2- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc1300a0 0x7f71bc11c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f71bbfff700 1 --2- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc11c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff67d505700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff678066410 0x7ff6780a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff67d505700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678131180 0x7ff678131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff67d505700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6780a1e70 con 0x7ff6780667e0 2023-09-30T22:26:03.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff67d505700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67809a720 con 0x7ff678066410 2023-09-30T22:26:03.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff67d505700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67809b300 con 0x7ff678131180 2023-09-30T22:26:03.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff6767fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff6780667e0 0x7ff6780a0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53474/0 (socket says 172.21.15.154:53474) 2023-09-30T22:26:03.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff6767fc700 1 -- 172.21.15.154:0/733048632 learned_addr learned my addr 172.21.15.154:0/733048632 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:03.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f71bbfff700 1 -- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc1300a0 msgr2=0x7f71bc11c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f71bbfff700 1 --2- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc1300a0 0x7f71bc11c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f71bbfff700 1 -- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc133ad0 msgr2=0x7f71bc1cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f71bbfff700 1 --2- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc133ad0 0x7f71bc1cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f71bbfff700 1 -- 172.21.15.154:0/2862031523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b4009a70 con 0x7f71bc1309f0 2023-09-30T22:26:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f210ffff700 1 -- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2110134f00 msgr2=0x7f211011b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f210ffff700 1 --2- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2110134f00 0x7f211011b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f210ffff700 1 -- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f211006a770 msgr2=0x7f211011a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f210ffff700 1 --2- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f211006a770 0x7f211011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7f210ffff700 1 -- 172.21.15.154:0/1484456275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009b30 con 0x7f211009e070 2023-09-30T22:26:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff676ffd700 1 --2- 172.21.15.154:0/733048632 >> v2:172.21.15.154:3300/0 conn(0x7ff678066410 0x7ff6780a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238520354 0 0) 0x7ff6780a1e70 con 0x7ff6780667e0 2023-09-30T22:26:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6600035b0 con 0x7ff6780667e0 2023-09-30T22:26:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.512+0000 7ff6777fe700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678131180 0x7ff678131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f71bbfff700 1 --2- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc11c580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f71a800b3e0 tx=0x7f71a800b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f210ffff700 1 --2- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211009e070 0x7f211011abc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c3e0 tx=0x7f20fc00c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2034017134 0 0) 0x7ff6600035b0 con 0x7ff6780667e0 2023-09-30T22:26:03.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678131180 msgr2=0x7ff678131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678131180 0x7ff678131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 >> v2:172.21.15.154:3300/0 conn(0x7ff678066410 msgr2=0x7ff6780a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 --2- 172.21.15.154:0/733048632 >> v2:172.21.15.154:3300/0 conn(0x7ff678066410 0x7ff6780a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67809abc0 con 0x7ff6780667e0 2023-09-30T22:26:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f210d7fa700 1 -- 172.21.15.154:0/1484456275 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00cea0 con 0x7f211009e070 2023-09-30T22:26:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f210d7fa700 1 -- 172.21.15.154:0/1484456275 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20fc005500 con 0x7f211009e070 2023-09-30T22:26:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147001391 0 0) 0x7ff66c001670 con 0x7ff6780667e0 2023-09-30T22:26:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f210d7fa700 1 -- 172.21.15.154:0/1484456275 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0038c0 con 0x7f211009e070 2023-09-30T22:26:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f2116b8c700 1 -- 172.21.15.154:0/1484456275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2110126900 con 0x7f211009e070 2023-09-30T22:26:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 >> v1:172.21.15.154:6789/0 conn(0x7ff6780667e0 legacy=0x7ff6780a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f71b97fa700 1 -- 172.21.15.154:0/2862031523 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8011620 con 0x7f71bc1309f0 2023-09-30T22:26:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f71b97fa700 1 -- 172.21.15.154:0/2862031523 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a80117a0 con 0x7f71bc1309f0 2023-09-30T22:26:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660003a70 0x7ff660003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f71b97fa700 1 -- 172.21.15.154:0/2862031523 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8011b50 con 0x7f71bc1309f0 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff660004850 0x7ff660004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff660005200 0x7ff66000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f71c2b1f700 1 -- 172.21.15.154:0/2862031523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc06f260 con 0x7f71bc1309f0 2023-09-30T22:26:03.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7f71c2b1f700 1 -- 172.21.15.154:0/2862031523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc11d350 con 0x7f71bc1309f0 2023-09-30T22:26:03.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67809a720 con 0x7ff660004850 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67809b300 con 0x7ff660005200 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff66000c0b0 con 0x7ff660003a70 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.513+0000 7ff676ffd700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660003a70 0x7ff660003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7ff676ffd700 1 -- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff660005200 msgr2=0x7ff66000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7ff676ffd700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff660005200 0x7ff66000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7ff676ffd700 1 -- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff660004850 msgr2=0x7ff660004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7ff676ffd700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff660004850 0x7ff660004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7ff676ffd700 1 -- 172.21.15.154:0/733048632 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600035b0 con 0x7ff660003a70 2023-09-30T22:26:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7ff676ffd700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660003a70 0x7ff660003e80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff668009880 tx=0x7ff660005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a325c18f7af91685 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800c070 con 0x7ff660003a70 2023-09-30T22:26:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff668005c20 con 0x7ff660003a70 2023-09-30T22:26:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7ff675ffb700 1 -- 172.21.15.154:0/733048632 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668006050 con 0x7ff660003a70 2023-09-30T22:26:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7f71b97fa700 1 -- 172.21.15.154:0/2862031523 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71a8011cb0 con 0x7f71bc1309f0 2023-09-30T22:26:03.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.514+0000 7f71b97fa700 1 -- 172.21.15.154:0/2862031523 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71a803f590 con 0x7f71bc1309f0 2023-09-30T22:26:03.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.515+0000 7ff67d505700 1 -- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660003a70 msgr2=0x7ff660003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.515+0000 7ff67d505700 1 --2- 172.21.15.154:0/733048632 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660003a70 0x7ff660003e80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff668009880 tx=0x7ff660005880 comp rx=0 tx=0).stop 2023-09-30T22:26:03.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.515+0000 7f2116b8c700 1 -- 172.21.15.154:0/1484456275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2110126600 con 0x7f211009e070 2023-09-30T22:26:03.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.515+0000 7f210d7fa700 1 -- 172.21.15.154:0/1484456275 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20fc003a20 con 0x7f211009e070 2023-09-30T22:26:03.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.515+0000 7ff6777fe700 1 -- 172.21.15.154:0/733048632 reap_dead start 2023-09-30T22:26:03.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.515+0000 7ff67d505700 1 -- 172.21.15.154:0/733048632 shutdown_connections 2023-09-30T22:26:03.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.515+0000 7ff67d505700 1 -- 172.21.15.154:0/733048632 >> 172.21.15.154:0/733048632 conn(0x7ff6780a2980 msgr2=0x7ff6780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.515+0000 7f210d7fa700 1 -- 172.21.15.154:0/1484456275 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20fc003cd0 con 0x7f211009e070 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.516+0000 7ff67d505700 1 -- 172.21.15.154:0/733048632 shutdown_connections 2023-09-30T22:26:03.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.516+0000 7f2116b8c700 1 -- 172.21.15.154:0/1484456275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21100a01b0 con 0x7f211009e070 2023-09-30T22:26:03.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.516+0000 7f71c2b1f700 1 -- 172.21.15.154:0/2862031523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c0052e0 con 0x7f71bc1309f0 2023-09-30T22:26:03.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.516+0000 7ff67d505700 1 -- 172.21.15.154:0/733048632 wait complete. 2023-09-30T22:26:03.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.517+0000 7ff67d505700 1 Processor -- start 2023-09-30T22:26:03.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.518+0000 7ff67d505700 1 -- start start 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.518+0000 7ff67d505700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff678139760 0x7ff678136a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.518+0000 7ff67d505700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678136f40 0x7ff678137390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.518+0000 7ff67d505700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6781d16b0 0x7ff6781d3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.518+0000 7ff67d505700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6781378d0 con 0x7ff678139760 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.518+0000 7ff67d505700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff678138e50 con 0x7ff678136f40 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.518+0000 7ff67d505700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff678138580 con 0x7ff6781d16b0 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.519+0000 7ff6767fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678136f40 0x7ff678137390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.519+0000 7ff6767fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678136f40 0x7ff678137390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59838/0 (socket says 172.21.15.154:59838) 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.519+0000 7ff6767fc700 1 -- 172.21.15.154:0/2696762078 learned_addr learned my addr 172.21.15.154:0/2696762078 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.519+0000 7ff6767fc700 1 -- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6781d16b0 msgr2=0x7ff6781d3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.519+0000 7ff6767fc700 1 --2- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6781d16b0 0x7ff6781d3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.519+0000 7ff6767fc700 1 -- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff678139760 msgr2=0x7ff678136a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.519+0000 7ff6767fc700 1 --2- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff678139760 0x7ff678136a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.519+0000 7ff6767fc700 1 -- 172.21.15.154:0/2696762078 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67809fcc0 con 0x7ff678136f40 2023-09-30T22:26:03.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.519+0000 7ff6767fc700 1 --2- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678136f40 0x7ff678137390 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00cad0 tx=0x7ff66c00ce90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:03.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.520+0000 7ff65f7fe700 1 -- 172.21.15.154:0/2696762078 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c004b30 con 0x7ff678136f40 2023-09-30T22:26:03.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.520+0000 7ff65f7fe700 1 -- 172.21.15.154:0/2696762078 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c004cb0 con 0x7ff678136f40 2023-09-30T22:26:03.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.520+0000 7ff65f7fe700 1 -- 172.21.15.154:0/2696762078 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c007310 con 0x7ff678136f40 2023-09-30T22:26:03.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.520+0000 7ff67d505700 1 -- 172.21.15.154:0/2696762078 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67813a1b0 con 0x7ff678136f40 2023-09-30T22:26:03.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.521+0000 7ff67d505700 1 -- 172.21.15.154:0/2696762078 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67809ae00 con 0x7ff678136f40 2023-09-30T22:26:03.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.521+0000 7f210d7fa700 1 -- 172.21.15.154:0/1484456275 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20fc017020 con 0x7f211009e070 2023-09-30T22:26:03.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.521+0000 7ff65f7fe700 1 -- 172.21.15.154:0/2696762078 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff66c007470 con 0x7ff678136f40 2023-09-30T22:26:03.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.522+0000 7ff65f7fe700 1 -- 172.21.15.154:0/2696762078 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff66c03ea50 con 0x7ff678136f40 2023-09-30T22:26:03.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.522+0000 7ff67d505700 1 -- 172.21.15.154:0/2696762078 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67813a010 con 0x7ff678136f40 2023-09-30T22:26:03.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.522+0000 7f71b97fa700 1 -- 172.21.15.154:0/2862031523 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71a800f2e0 con 0x7f71bc1309f0 2023-09-30T22:26:03.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.531+0000 7ff65f7fe700 1 -- 172.21.15.154:0/2696762078 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff67813a010 con 0x7ff678136f40 2023-09-30T22:26:03.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.681+0000 7efd74c1e700 1 -- 172.21.15.154:0/3413847825 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd7004f2a0 con 0x7efd700a0ee0 2023-09-30T22:26:03.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.681+0000 7efd5effd700 1 -- 172.21.15.154:0/3413847825 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd60046030 con 0x7efd700a0ee0 2023-09-30T22:26:03.682 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:03.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.683+0000 7efd74c1e700 1 -- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700a0ee0 msgr2=0x7efd7011c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.683+0000 7efd74c1e700 1 --2- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700a0ee0 0x7efd7011c8b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efd60015000 tx=0x7efd60004750 comp rx=0 tx=0).stop 2023-09-30T22:26:03.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.683+0000 7efd74c1e700 1 -- 172.21.15.154:0/3413847825 shutdown_connections 2023-09-30T22:26:03.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.683+0000 7efd74c1e700 1 --2- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd70134210 0x7efd7011d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.683+0000 7efd74c1e700 1 --2- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700a0ee0 0x7efd7011c8b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.683+0000 7efd74c1e700 1 --2- 172.21.15.154:0/3413847825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd70133900 0x7efd7011cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.683+0000 7efd74c1e700 1 -- 172.21.15.154:0/3413847825 >> 172.21.15.154:0/3413847825 conn(0x7efd700a2980 msgr2=0x7efd701bae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.683+0000 7efd74c1e700 1 -- 172.21.15.154:0/3413847825 shutdown_connections 2023-09-30T22:26:03.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.683+0000 7efd74c1e700 1 -- 172.21.15.154:0/3413847825 wait complete. 2023-09-30T22:26:03.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:03.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.716+0000 7f71c2b1f700 1 -- 172.21.15.154:0/2862031523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f719c005590 con 0x7f71bc1309f0 2023-09-30T22:26:03.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.716+0000 7f71b97fa700 1 -- 172.21.15.154:0/2862031523 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71a8022350 con 0x7f71bc1309f0 2023-09-30T22:26:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:03.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.719+0000 7f71c2b1f700 1 -- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 msgr2=0x7f71bc11c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.719+0000 7f71c2b1f700 1 --2- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc11c580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f71a800b3e0 tx=0x7f71a800b6f0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.719+0000 7f71c2b1f700 1 -- 172.21.15.154:0/2862031523 shutdown_connections 2023-09-30T22:26:03.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.719+0000 7f71c2b1f700 1 --2- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc133ad0 0x7f71bc1cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.719+0000 7f71c2b1f700 1 --2- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc1300a0 0x7f71bc11c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.719+0000 7f71c2b1f700 1 --2- 172.21.15.154:0/2862031523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f71bc1309f0 0x7f71bc11c580 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.719+0000 7f71c2b1f700 1 -- 172.21.15.154:0/2862031523 >> 172.21.15.154:0/2862031523 conn(0x7f71bc099c40 msgr2=0x7f71bc132510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.719+0000 7f71c2b1f700 1 -- 172.21.15.154:0/2862031523 shutdown_connections 2023-09-30T22:26:03.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.719+0000 7f71c2b1f700 1 -- 172.21.15.154:0/2862031523 wait complete. 2023-09-30T22:26:03.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.721+0000 7f2116b8c700 1 -- 172.21.15.154:0/1484456275 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f211004f2a0 con 0x7f211009e070 2023-09-30T22:26:03.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.721+0000 7f210d7fa700 1 -- 172.21.15.154:0/1484456275 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20fc044060 con 0x7f211009e070 2023-09-30T22:26:03.722 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:03.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.723+0000 7f2116b8c700 1 -- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211009e070 msgr2=0x7f211011abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.723+0000 7f2116b8c700 1 --2- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211009e070 0x7f211011abc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c3e0 tx=0x7f20fc00c6f0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.724+0000 7f2116b8c700 1 -- 172.21.15.154:0/1484456275 shutdown_connections 2023-09-30T22:26:03.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.724+0000 7f2116b8c700 1 --2- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2110134f00 0x7f211011b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.724+0000 7f2116b8c700 1 --2- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f211006a770 0x7f211011a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.724+0000 7f2116b8c700 1 --2- 172.21.15.154:0/1484456275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f211009e070 0x7f211011abc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.724+0000 7f2116b8c700 1 -- 172.21.15.154:0/1484456275 >> 172.21.15.154:0/1484456275 conn(0x7f2110099c40 msgr2=0x7f21100a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.724+0000 7f2116b8c700 1 -- 172.21.15.154:0/1484456275 shutdown_connections 2023-09-30T22:26:03.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.724+0000 7f2116b8c700 1 -- 172.21.15.154:0/1484456275 wait complete. 2023-09-30T22:26:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.725+0000 7ff67d505700 1 -- 172.21.15.154:0/2696762078 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff67813a010 con 0x7ff678136f40 2023-09-30T22:26:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.725+0000 7ff65f7fe700 1 -- 172.21.15.154:0/2696762078 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff67813a010 con 0x7ff678136f40 2023-09-30T22:26:03.726 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:03.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.727+0000 7ff67d505700 1 -- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678136f40 msgr2=0x7ff678137390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:03.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.727+0000 7ff67d505700 1 --2- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678136f40 0x7ff678137390 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00cad0 tx=0x7ff66c00ce90 comp rx=0 tx=0).stop 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.727+0000 7ff67d505700 1 -- 172.21.15.154:0/2696762078 shutdown_connections 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.727+0000 7ff67d505700 1 --2- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6781d16b0 0x7ff6781d3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.727+0000 7ff67d505700 1 --2- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff678139760 0x7ff678136a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.727+0000 7ff67d505700 1 --2- 172.21.15.154:0/2696762078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff678136f40 0x7ff678137390 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.727+0000 7ff67d505700 1 -- 172.21.15.154:0/2696762078 >> 172.21.15.154:0/2696762078 conn(0x7ff6780a2980 msgr2=0x7ff67809deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.728+0000 7ff67d505700 1 -- 172.21.15.154:0/2696762078 shutdown_connections 2023-09-30T22:26:03.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:03.728+0000 7ff67d505700 1 -- 172.21.15.154:0/2696762078 wait complete. 2023-09-30T22:26:03.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:03.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:03.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:04.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:04.737 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:04.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:04.743 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:04.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.840+0000 7fd7bd859700 1 Processor -- start 2023-09-30T22:26:04.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.840+0000 7fd7bd859700 1 -- start start 2023-09-30T22:26:04.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.841+0000 7fd7bd859700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.841+0000 7fd7bd859700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 0x7fd7b81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.841+0000 7fd7bd859700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b809b110 con 0x7fd7b80a0a70 2023-09-30T22:26:04.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.841+0000 7fd7bd859700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80a3b60 con 0x7fd7b8133f70 2023-09-30T22:26:04.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.841+0000 7fd7bd859700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b81348e0 con 0x7fd7b809ad40 2023-09-30T22:26:04.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.841+0000 7fd7b6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.841+0000 7fd7b6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39942/0 (socket says 172.21.15.154:39942) 2023-09-30T22:26:04.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.841+0000 7fd7b67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 0x7fd7b81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.841+0000 7fd7b6ffd700 1 -- 172.21.15.154:0/1104994059 learned_addr learned my addr 172.21.15.154:0/1104994059 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:04.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.842+0000 7fd7b6ffd700 1 -- 172.21.15.154:0/1104994059 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 msgr2=0x7fd7b81343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.842+0000 7fd7b6ffd700 1 --2- 172.21.15.154:0/1104994059 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 0x7fd7b81343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.842+0000 7fd7b6ffd700 1 -- 172.21.15.154:0/1104994059 >> v1:172.21.15.154:6789/0 conn(0x7fd7b80a0a70 legacy=0x7fd7b80a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.842+0000 7fd7b6ffd700 1 -- 172.21.15.154:0/1104994059 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b80a2fa0 con 0x7fd7b809ad40 2023-09-30T22:26:04.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.842+0000 7fd7b67fc700 1 --2- 172.21.15.154:0/1104994059 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 0x7fd7b81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:04.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.842+0000 7fd7b6ffd700 1 --2- 172.21.15.154:0/1104994059 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b8133a30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009920 tx=0x7fd7a8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be72681298569f09 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.842+0000 7fd7b5ffb700 1 -- 172.21.15.154:0/1104994059 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8011830 con 0x7fd7b809ad40 2023-09-30T22:26:04.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.842+0000 7fd7b5ffb700 1 -- 172.21.15.154:0/1104994059 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a8011990 con 0x7fd7b809ad40 2023-09-30T22:26:04.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.842+0000 7fd7b5ffb700 1 -- 172.21.15.154:0/1104994059 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8011d20 con 0x7fd7b809ad40 2023-09-30T22:26:04.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.843+0000 7fd7bd859700 1 -- 172.21.15.154:0/1104994059 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 msgr2=0x7fd7b8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.843+0000 7fd7bd859700 1 --2- 172.21.15.154:0/1104994059 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b8133a30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009920 tx=0x7fd7a8009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:04.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.843+0000 7fd7bd859700 1 -- 172.21.15.154:0/1104994059 shutdown_connections 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.843+0000 7fd7bd859700 1 --2- 172.21.15.154:0/1104994059 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b8133a30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.843+0000 7fd7bd859700 1 --2- 172.21.15.154:0/1104994059 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 0x7fd7b81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.843+0000 7fd7bd859700 1 -- 172.21.15.154:0/1104994059 >> 172.21.15.154:0/1104994059 conn(0x7fd7b8099c40 msgr2=0x7fd7b806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.843+0000 7fd7bd859700 1 -- 172.21.15.154:0/1104994059 shutdown_connections 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.843+0000 7fd7bd859700 1 -- 172.21.15.154:0/1104994059 wait complete. 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.844+0000 7fd7bd859700 1 Processor -- start 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.844+0000 7fd7bd859700 1 -- start start 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7bd859700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b811e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7bd859700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b80a0a70 0x7fd7b811e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7bd859700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 0x7fd7b811eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7bd859700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b8122540 con 0x7fd7b80a0a70 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7bd859700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b811fc70 con 0x7fd7b8133f70 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7bd859700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b8120ec0 con 0x7fd7b809ad40 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b80a0a70 0x7fd7b811e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b80a0a70 0x7fd7b811e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59532/0 (socket says 172.21.15.154:59532) 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b67fc700 1 -- 172.21.15.154:0/3045645791 learned_addr learned my addr 172.21.15.154:0/3045645791 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b77fe700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 0x7fd7b811eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b6ffd700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b811e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b6ffd700 1 -- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 msgr2=0x7fd7b811eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b6ffd700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 0x7fd7b811eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b6ffd700 1 -- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b80a0a70 msgr2=0x7fd7b811e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b6ffd700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b80a0a70 0x7fd7b811e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b6ffd700 1 -- 172.21.15.154:0/3045645791 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac0094a0 con 0x7fd7b809ad40 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.845+0000 7fd7b67fc700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b80a0a70 0x7fd7b811e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.846+0000 7fd7b6ffd700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b811e060 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80a1ce0 tx=0x7fd7a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.846+0000 7fd79ffff700 1 -- 172.21.15.154:0/3045645791 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8004450 con 0x7fd7b809ad40 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.846+0000 7fd79ffff700 1 -- 172.21.15.154:0/3045645791 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a80045d0 con 0x7fd7b809ad40 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.846+0000 7fd79ffff700 1 -- 172.21.15.154:0/3045645791 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80038e0 con 0x7fd7b809ad40 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.846+0000 7fd7bd859700 1 -- 172.21.15.154:0/3045645791 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a8009550 con 0x7fd7b809ad40 2023-09-30T22:26:04.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.846+0000 7fd7bd859700 1 -- 172.21.15.154:0/3045645791 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b8121310 con 0x7fd7b809ad40 2023-09-30T22:26:04.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.847+0000 7fd79dffb700 1 -- 172.21.15.154:0/3045645791 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7900052e0 con 0x7fd7b809ad40 2023-09-30T22:26:04.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.848+0000 7fd79ffff700 1 -- 172.21.15.154:0/3045645791 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7a8003a40 con 0x7fd7b809ad40 2023-09-30T22:26:04.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.848+0000 7fd79ffff700 1 -- 172.21.15.154:0/3045645791 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd7a8020030 con 0x7fd7b809ad40 2023-09-30T22:26:04.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.852+0000 7fd79ffff700 1 -- 172.21.15.154:0/3045645791 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7a8003cf0 con 0x7fd7b809ad40 2023-09-30T22:26:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.874+0000 7f476421e700 1 Processor -- start 2023-09-30T22:26:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f476421e700 1 -- start start 2023-09-30T22:26:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f476421e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c133660 0x7f475c135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f476421e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 0x7f475c138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f476421e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475c09b930 con 0x7f475c099eb0 2023-09-30T22:26:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f476421e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c072410 con 0x7f475c135f80 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f476421e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475c09cd30 con 0x7f475c133660 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f47617b9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c133660 0x7f475c135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f47617b9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c133660 0x7f475c135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39970/0 (socket says 172.21.15.154:39970) 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f47617b9700 1 -- 172.21.15.154:0/2785306388 learned_addr learned my addr 172.21.15.154:0/2785306388 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.875+0000 7f47627bb700 1 --2- 172.21.15.154:0/2785306388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 0x7f475c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.876+0000 7f47617b9700 1 -- 172.21.15.154:0/2785306388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 msgr2=0x7f475c138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.876+0000 7f47617b9700 1 --2- 172.21.15.154:0/2785306388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 0x7f475c138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.876+0000 7f47617b9700 1 -- 172.21.15.154:0/2785306388 >> v1:172.21.15.154:6789/0 conn(0x7f475c099eb0 legacy=0x7f475c09a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.876+0000 7f47617b9700 1 -- 172.21.15.154:0/2785306388 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c09a990 con 0x7f475c133660 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.876+0000 7f47617b9700 1 --2- 172.21.15.154:0/2785306388 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c133660 0x7f475c135a40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f474c009920 tx=0x7f474c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=602407eaba78f425 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.876+0000 7f4760fb8700 1 -- 172.21.15.154:0/2785306388 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c00ba60 con 0x7f475c133660 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.876+0000 7f4760fb8700 1 -- 172.21.15.154:0/2785306388 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c00bbc0 con 0x7f475c133660 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.876+0000 7f4760fb8700 1 -- 172.21.15.154:0/2785306388 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c009e70 con 0x7f475c133660 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.877+0000 7f476421e700 1 -- 172.21.15.154:0/2785306388 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c133660 msgr2=0x7f475c135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.877+0000 7f476421e700 1 --2- 172.21.15.154:0/2785306388 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c133660 0x7f475c135a40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f474c009920 tx=0x7f474c009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:04.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.877+0000 7f476421e700 1 -- 172.21.15.154:0/2785306388 shutdown_connections 2023-09-30T22:26:04.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.877+0000 7f476421e700 1 --2- 172.21.15.154:0/2785306388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 0x7f475c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.877+0000 7f476421e700 1 --2- 172.21.15.154:0/2785306388 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c133660 0x7f475c135a40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.877+0000 7f476421e700 1 -- 172.21.15.154:0/2785306388 >> 172.21.15.154:0/2785306388 conn(0x7f475c0a2980 msgr2=0x7f475c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:04.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.877+0000 7f476421e700 1 -- 172.21.15.154:0/2785306388 shutdown_connections 2023-09-30T22:26:04.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.877+0000 7f476421e700 1 -- 172.21.15.154:0/2785306388 wait complete. 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.878+0000 7f476421e700 1 Processor -- start 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.878+0000 7f476421e700 1 -- start start 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.878+0000 7f476421e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c099eb0 0x7f475c11a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.878+0000 7f476421e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475c133660 0x7f475c06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.878+0000 7f476421e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 0x7f475c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.878+0000 7f476421e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c12cd50 con 0x7f475c133660 2023-09-30T22:26:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.878+0000 7f476421e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c071010 con 0x7f475c135f80 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.878+0000 7f476421e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475c11a360 con 0x7f475c099eb0 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f47627bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 0x7f475c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f47627bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 0x7f475c0703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59864/0 (socket says 172.21.15.154:59864) 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f47627bb700 1 -- 172.21.15.154:0/2588605969 learned_addr learned my addr 172.21.15.154:0/2588605969 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f4761fba700 1 --2- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c099eb0 0x7f475c11a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f47617b9700 1 --2- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475c133660 0x7f475c06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f4761fba700 1 -- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 msgr2=0x7f475c0703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f4761fba700 1 --2- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 0x7f475c0703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f4761fba700 1 -- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475c133660 msgr2=0x7f475c06fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f4761fba700 1 --2- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475c133660 0x7f475c06fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f4761fba700 1 -- 172.21.15.154:0/2588605969 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c009550 con 0x7f475c099eb0 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f301c772700 1 Processor -- start 2023-09-30T22:26:04.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f4761fba700 1 --2- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c099eb0 0x7f475c11a790 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4758000fd0 tx=0x7f475800c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f301c772700 1 -- start start 2023-09-30T22:26:04.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f47527fc700 1 -- 172.21.15.154:0/2588605969 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47580052d0 con 0x7f475c099eb0 2023-09-30T22:26:04.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f47527fc700 1 -- 172.21.15.154:0/2588605969 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4758005430 con 0x7f475c099eb0 2023-09-30T22:26:04.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.879+0000 7f476421e700 1 -- 172.21.15.154:0/2588605969 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c09b490 con 0x7f475c099eb0 2023-09-30T22:26:04.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f476421e700 1 -- 172.21.15.154:0/2588605969 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c0a0c20 con 0x7f475c099eb0 2023-09-30T22:26:04.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f47527fc700 1 -- 172.21.15.154:0/2588605969 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47580038a0 con 0x7f475c099eb0 2023-09-30T22:26:04.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f301c772700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f301409d860 0x7f301409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f301c772700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3014130eb0 0x7f3014138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f301c772700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301409aaa0 con 0x7f301409e170 2023-09-30T22:26:04.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f301c772700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301409f870 con 0x7f301409d860 2023-09-30T22:26:04.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f301c772700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301409b360 con 0x7f3014130eb0 2023-09-30T22:26:04.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f301a50e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f301409d860 0x7f301409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f301a50e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f301409d860 0x7f301409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59546/0 (socket says 172.21.15.154:59546) 2023-09-30T22:26:04.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f301a50e700 1 -- 172.21.15.154:0/699754657 learned_addr learned my addr 172.21.15.154:0/699754657 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:04.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f301ad0f700 1 --2- 172.21.15.154:0/699754657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3014130eb0 0x7f3014138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.880+0000 7f47527fc700 1 -- 172.21.15.154:0/2588605969 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4758003a00 con 0x7f475c099eb0 2023-09-30T22:26:04.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f301a50e700 1 -- 172.21.15.154:0/699754657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3014130eb0 msgr2=0x7f3014138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f301a50e700 1 --2- 172.21.15.154:0/699754657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3014130eb0 0x7f3014138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f301a50e700 1 -- 172.21.15.154:0/699754657 >> v1:172.21.15.154:6789/0 conn(0x7f301409e170 legacy=0x7f30141307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f301a50e700 1 -- 172.21.15.154:0/699754657 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301409b620 con 0x7f301409d860 2023-09-30T22:26:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f47527fc700 1 -- 172.21.15.154:0/2588605969 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f475803ea20 con 0x7f475c099eb0 2023-09-30T22:26:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f301a50e700 1 --2- 172.21.15.154:0/699754657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f301409d860 0x7f301409dc30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f30040098f0 tx=0x7f3004009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7619d759dcad0f67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f301950c700 1 -- 172.21.15.154:0/699754657 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300400b8a0 con 0x7f301409d860 2023-09-30T22:26:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f301950c700 1 -- 172.21.15.154:0/699754657 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300400ba00 con 0x7f301409d860 2023-09-30T22:26:04.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f301950c700 1 -- 172.21.15.154:0/699754657 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300400bd90 con 0x7f301409d860 2023-09-30T22:26:04.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.881+0000 7f476421e700 1 -- 172.21.15.154:0/2588605969 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47440052e0 con 0x7f475c099eb0 2023-09-30T22:26:04.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.882+0000 7f301c772700 1 -- 172.21.15.154:0/699754657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f301409d860 msgr2=0x7f301409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.882+0000 7f301c772700 1 --2- 172.21.15.154:0/699754657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f301409d860 0x7f301409dc30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f30040098f0 tx=0x7f3004009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:04.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.882+0000 7f301c772700 1 -- 172.21.15.154:0/699754657 shutdown_connections 2023-09-30T22:26:04.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.882+0000 7f301c772700 1 --2- 172.21.15.154:0/699754657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3014130eb0 0x7f3014138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.882+0000 7f301c772700 1 --2- 172.21.15.154:0/699754657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f301409d860 0x7f301409dc30 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.882+0000 7f301c772700 1 -- 172.21.15.154:0/699754657 >> 172.21.15.154:0/699754657 conn(0x7f3014099c40 msgr2=0x7f30140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:04.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.882+0000 7f301c772700 1 -- 172.21.15.154:0/699754657 shutdown_connections 2023-09-30T22:26:04.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.882+0000 7f301c772700 1 -- 172.21.15.154:0/699754657 wait complete. 2023-09-30T22:26:04.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.883+0000 7f301c772700 1 Processor -- start 2023-09-30T22:26:04.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.883+0000 7f301c772700 1 -- start start 2023-09-30T22:26:04.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.883+0000 7f301c772700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f301409d860 0x7f301413c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.883+0000 7f301c772700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f301409e170 0x7f301413c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.883+0000 7f301c772700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3014130eb0 0x7f301413cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f301c772700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301409c8b0 con 0x7f3014130eb0 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f301c772700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301413f9d0 con 0x7f301409d860 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f301c772700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3014135db0 con 0x7f301409e170 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f3019d0d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f301409e170 0x7f301413c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f3019d0d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f301409e170 0x7f301413c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39986/0 (socket says 172.21.15.154:39986) 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f3019d0d700 1 -- 172.21.15.154:0/509148567 learned_addr learned my addr 172.21.15.154:0/509148567 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f301a50e700 1 --2- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f301409d860 0x7f301413c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f3019d0d700 1 -- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f301409d860 msgr2=0x7f301413c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f3019d0d700 1 --2- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f301409d860 0x7f301413c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f3019d0d700 1 -- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3014130eb0 msgr2=0x7f301413cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f3019d0d700 1 --2- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3014130eb0 0x7f301413cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f3019d0d700 1 -- 172.21.15.154:0/509148567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3004009550 con 0x7f301409e170 2023-09-30T22:26:04.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.884+0000 7f3019d0d700 1 --2- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f301409e170 0x7f301413c6d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f301000c4b0 tx=0x7f301000c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.886+0000 7f300affd700 1 -- 172.21.15.154:0/509148567 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100052d0 con 0x7f301409e170 2023-09-30T22:26:04.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.886+0000 7f300affd700 1 -- 172.21.15.154:0/509148567 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3010005430 con 0x7f301409e170 2023-09-30T22:26:04.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.886+0000 7f300affd700 1 -- 172.21.15.154:0/509148567 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010003880 con 0x7f301409e170 2023-09-30T22:26:04.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.886+0000 7f47527fc700 1 -- 172.21.15.154:0/2588605969 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4758017020 con 0x7f475c099eb0 2023-09-30T22:26:04.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.886+0000 7f301c772700 1 -- 172.21.15.154:0/509148567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3014072170 con 0x7f301409e170 2023-09-30T22:26:04.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.886+0000 7f301c772700 1 -- 172.21.15.154:0/509148567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3014130a10 con 0x7f301409e170 2023-09-30T22:26:04.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.887+0000 7f300affd700 1 -- 172.21.15.154:0/509148567 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30100039e0 con 0x7f301409e170 2023-09-30T22:26:04.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.887+0000 7f300affd700 1 -- 172.21.15.154:0/509148567 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f301003ebb0 con 0x7f301409e170 2023-09-30T22:26:04.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.887+0000 7f301c772700 1 -- 172.21.15.154:0/509148567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3014130d10 con 0x7f301409e170 2023-09-30T22:26:04.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.896+0000 7f300affd700 1 -- 172.21.15.154:0/509148567 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3014130d10 con 0x7f301409e170 2023-09-30T22:26:04.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.952+0000 7f00782c4700 1 Processor -- start 2023-09-30T22:26:04.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.952+0000 7f00782c4700 1 -- start start 2023-09-30T22:26:04.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.953+0000 7f00782c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f00700a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.953+0000 7f00782c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 0x7f0070133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.953+0000 7f00782c4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0070133f50 0x7f00701343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.953+0000 7f00782c4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007009e9d0 con 0x7f0070133f50 2023-09-30T22:26:04.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.953+0000 7f00782c4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007009dc00 con 0x7f00700a0a70 2023-09-30T22:26:04.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.953+0000 7f00782c4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f007009dec0 con 0x7f00700a1380 2023-09-30T22:26:04.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.953+0000 7f007585f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 0x7f0070133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.953+0000 7f007585f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 0x7f0070133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39994/0 (socket says 172.21.15.154:39994) 2023-09-30T22:26:04.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.953+0000 7f007585f700 1 -- 172.21.15.154:0/3068099043 learned_addr learned my addr 172.21.15.154:0/3068099043 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:04.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f0076060700 1 --2- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f00700a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f0076861700 1 --2- 172.21.15.154:0/3068099043 >> v2:172.21.15.154:3300/0 conn(0x7f0070133f50 0x7f00701343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f0076861700 1 -- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 msgr2=0x7f0070133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f0076861700 1 --2- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 0x7f0070133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f0076861700 1 -- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 msgr2=0x7f00700a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:04.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f0076861700 1 --2- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f00700a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f0076861700 1 -- 172.21.15.154:0/3068099043 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007009e6a0 con 0x7f0070133f50 2023-09-30T22:26:04.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f0076060700 1 --2- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f00700a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:04.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f0076861700 1 --2- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 0x7f00701343f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0068009d90 tx=0x7f006800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e818cdc7c8f8f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f007505e700 1 -- 172.21.15.154:0/3068099043 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800e070 con 0x7f0070133f50 2023-09-30T22:26:04.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f007505e700 1 -- 172.21.15.154:0/3068099043 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006800bb20 con 0x7f0070133f50 2023-09-30T22:26:04.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.954+0000 7f007505e700 1 -- 172.21.15.154:0/3068099043 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068012430 con 0x7f0070133f50 2023-09-30T22:26:04.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.955+0000 7f00782c4700 1 -- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 msgr2=0x7f00701343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.955+0000 7f00782c4700 1 --2- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 0x7f00701343f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0068009d90 tx=0x7f006800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:04.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.955+0000 7f00782c4700 1 -- 172.21.15.154:0/3068099043 shutdown_connections 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.955+0000 7f00782c4700 1 --2- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f00700a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.955+0000 7f00782c4700 1 --2- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 0x7f00701343f0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.955+0000 7f00782c4700 1 --2- 172.21.15.154:0/3068099043 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 0x7f0070133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.955+0000 7f00782c4700 1 -- 172.21.15.154:0/3068099043 >> 172.21.15.154:0/3068099043 conn(0x7f00700a6610 msgr2=0x7f00700a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.955+0000 7f00782c4700 1 -- 172.21.15.154:0/3068099043 shutdown_connections 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.955+0000 7f00782c4700 1 -- 172.21.15.154:0/3068099043 wait complete. 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.956+0000 7f00782c4700 1 Processor -- start 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.956+0000 7f00782c4700 1 -- start start 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f00782c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f007011f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f00782c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 0x7f007011fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f00782c4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 0x7f00701c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f00782c4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070122710 con 0x7f0070133f50 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f00782c4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007011f3e0 con 0x7f00700a0a70 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f00782c4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0070120ae0 con 0x7f00700a1380 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076861700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 0x7f00701c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076861700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 0x7f00701c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59562/0 (socket says 172.21.15.154:59562) 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076861700 1 -- 172.21.15.154:0/2694064668 learned_addr learned my addr 172.21.15.154:0/2694064668 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076060700 1 --2- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f007011f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f007585f700 1 --2- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 0x7f007011fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076060700 1 -- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 msgr2=0x7f007011fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076060700 1 --2- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 0x7f007011fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076060700 1 -- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 msgr2=0x7f00701c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076060700 1 --2- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 0x7f00701c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076060700 1 -- 172.21.15.154:0/2694064668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c0094a0 con 0x7f00700a0a70 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.957+0000 7f0076060700 1 --2- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f007011f660 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f006c00e980 tx=0x7f006c00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.958+0000 7f0066ffd700 1 -- 172.21.15.154:0/2694064668 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c004030 con 0x7f00700a0a70 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.958+0000 7f0066ffd700 1 -- 172.21.15.154:0/2694064668 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c0041b0 con 0x7f00700a0a70 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.958+0000 7f00782c4700 1 -- 172.21.15.154:0/2694064668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0068009a70 con 0x7f00700a0a70 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.958+0000 7f0066ffd700 1 -- 172.21.15.154:0/2694064668 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c004560 con 0x7f00700a0a70 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.958+0000 7f00782c4700 1 -- 172.21.15.154:0/2694064668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00701200e0 con 0x7f00700a0a70 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.958+0000 7f0066ffd700 1 -- 172.21.15.154:0/2694064668 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f006c0036a0 con 0x7f00700a0a70 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.959+0000 7f0066ffd700 1 -- 172.21.15.154:0/2694064668 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f006c03f4d0 con 0x7f00700a0a70 2023-09-30T22:26:04.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.959+0000 7f00782c4700 1 -- 172.21.15.154:0/2694064668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0070121750 con 0x7f00700a0a70 2023-09-30T22:26:04.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:04.964+0000 7f0066ffd700 1 -- 172.21.15.154:0/2694064668 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f006c022940 con 0x7f00700a0a70 2023-09-30T22:26:05.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.087+0000 7f476421e700 1 -- 172.21.15.154:0/2588605969 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4744005590 con 0x7f475c099eb0 2023-09-30T22:26:05.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.087+0000 7f47527fc700 1 -- 172.21.15.154:0/2588605969 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4758003cb0 con 0x7f475c099eb0 2023-09-30T22:26:05.089 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:05.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.091+0000 7f476421e700 1 -- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c099eb0 msgr2=0x7f475c11a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.091+0000 7f476421e700 1 --2- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c099eb0 0x7f475c11a790 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4758000fd0 tx=0x7f475800c6e0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.091+0000 7f476421e700 1 -- 172.21.15.154:0/2588605969 shutdown_connections 2023-09-30T22:26:05.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.091+0000 7f476421e700 1 --2- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475c135f80 0x7f475c0703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.091+0000 7f476421e700 1 --2- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475c099eb0 0x7f475c11a790 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.091+0000 7f476421e700 1 --2- 172.21.15.154:0/2588605969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f475c133660 0x7f475c06fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.091+0000 7f476421e700 1 -- 172.21.15.154:0/2588605969 >> 172.21.15.154:0/2588605969 conn(0x7f475c0a2980 msgr2=0x7f475c12d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:05.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.091+0000 7f476421e700 1 -- 172.21.15.154:0/2588605969 shutdown_connections 2023-09-30T22:26:05.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.091+0000 7f476421e700 1 -- 172.21.15.154:0/2588605969 wait complete. 2023-09-30T22:26:05.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.097+0000 7fd79dffb700 1 -- 172.21.15.154:0/3045645791 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd790005860 con 0x7fd7b809ad40 2023-09-30T22:26:05.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.097+0000 7f301c772700 1 -- 172.21.15.154:0/509148567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3014130d10 con 0x7f301409e170 2023-09-30T22:26:05.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.097+0000 7fd79ffff700 1 -- 172.21.15.154:0/3045645791 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7a8015020 con 0x7fd7b809ad40 2023-09-30T22:26:05.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.097+0000 7f300affd700 1 -- 172.21.15.154:0/509148567 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3014130d10 con 0x7f301409e170 2023-09-30T22:26:05.099 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:05.100 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:05.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.100+0000 7fd79dffb700 1 -- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 msgr2=0x7fd7b811e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.100+0000 7fd79dffb700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b811e060 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80a1ce0 tx=0x7fd7a8004750 comp rx=0 tx=0).stop 2023-09-30T22:26:05.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7f301c772700 1 -- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f301409e170 msgr2=0x7f301413c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7f301c772700 1 --2- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f301409e170 0x7f301413c6d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f301000c4b0 tx=0x7f301000c7c0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7f301c772700 1 -- 172.21.15.154:0/509148567 shutdown_connections 2023-09-30T22:26:05.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7f301c772700 1 --2- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3014130eb0 0x7f301413cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7f301c772700 1 --2- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f301409d860 0x7f301413c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7f301c772700 1 --2- 172.21.15.154:0/509148567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f301409e170 0x7f301413c6d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7f301c772700 1 -- 172.21.15.154:0/509148567 >> 172.21.15.154:0/509148567 conn(0x7f3014099c40 msgr2=0x7f301413b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:05.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7fd79dffb700 1 -- 172.21.15.154:0/3045645791 shutdown_connections 2023-09-30T22:26:05.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7fd79dffb700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7b8133f70 0x7fd7b811eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7fd79dffb700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7b809ad40 0x7fd7b811e060 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7fd79dffb700 1 --2- 172.21.15.154:0/3045645791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b80a0a70 0x7fd7b811e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7fd79dffb700 1 -- 172.21.15.154:0/3045645791 >> 172.21.15.154:0/3045645791 conn(0x7fd7b8099c40 msgr2=0x7fd7b8133010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:05.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7fd79dffb700 1 -- 172.21.15.154:0/3045645791 shutdown_connections 2023-09-30T22:26:05.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.101+0000 7fd79dffb700 1 -- 172.21.15.154:0/3045645791 wait complete. 2023-09-30T22:26:05.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.103+0000 7f301c772700 1 -- 172.21.15.154:0/509148567 shutdown_connections 2023-09-30T22:26:05.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.103+0000 7f301c772700 1 -- 172.21.15.154:0/509148567 wait complete. 2023-09-30T22:26:05.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:05.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:05.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:05.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.161+0000 7f00782c4700 1 -- 172.21.15.154:0/2694064668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0070120390 con 0x7f00700a0a70 2023-09-30T22:26:05.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.161+0000 7f0066ffd700 1 -- 172.21.15.154:0/2694064668 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f006c0222f0 con 0x7f00700a0a70 2023-09-30T22:26:05.163 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.164+0000 7f00782c4700 1 -- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 msgr2=0x7f007011f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.164+0000 7f00782c4700 1 --2- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f007011f660 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f006c00e980 tx=0x7f006c00ec90 comp rx=0 tx=0).stop 2023-09-30T22:26:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.164+0000 7f00782c4700 1 -- 172.21.15.154:0/2694064668 shutdown_connections 2023-09-30T22:26:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.164+0000 7f00782c4700 1 --2- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0070133f50 0x7f00701c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.164+0000 7f00782c4700 1 --2- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00700a0a70 0x7f007011f660 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.164+0000 7f00782c4700 1 --2- 172.21.15.154:0/2694064668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f00700a1380 0x7f007011fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:05.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.164+0000 7f00782c4700 1 -- 172.21.15.154:0/2694064668 >> 172.21.15.154:0/2694064668 conn(0x7f00700a6610 msgr2=0x7f007009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:05.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.164+0000 7f00782c4700 1 -- 172.21.15.154:0/2694064668 shutdown_connections 2023-09-30T22:26:05.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:05.164+0000 7f00782c4700 1 -- 172.21.15.154:0/2694064668 wait complete. 2023-09-30T22:26:05.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:06.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:06.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:06.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:06.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:06.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.264+0000 7f42020c7700 1 Processor -- start 2023-09-30T22:26:06.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.264+0000 7f42020c7700 1 -- start start 2023-09-30T22:26:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f42020c7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc133ad0 0x7f41fc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f42020c7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 0x7f41fc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f42020c7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f41fc1309f0 0x7f41fc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f42020c7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc06b2d0 con 0x7f41fc1309f0 2023-09-30T22:26:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f42020c7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc133610 con 0x7f41fc133ad0 2023-09-30T22:26:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f42020c7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc09a500 con 0x7f41fc1300a0 2023-09-30T22:26:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc133ad0 0x7f41fc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc133ad0 0x7f41fc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51426/0 (socket says 172.21.15.154:51426) 2023-09-30T22:26:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fb7fe700 1 -- 172.21.15.154:0/3801159184 learned_addr learned my addr 172.21.15.154:0/3801159184 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fbfff700 1 --2- 172.21.15.154:0/3801159184 >> v2:172.21.15.154:3300/0 conn(0x7f41fc1309f0 0x7f41fc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41faffd700 1 --2- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 0x7f41fc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fbfff700 1 -- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 msgr2=0x7f41fc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fbfff700 1 --2- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 0x7f41fc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fbfff700 1 -- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc133ad0 msgr2=0x7f41fc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fbfff700 1 --2- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc133ad0 0x7f41fc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fbfff700 1 -- 172.21.15.154:0/3801159184 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc1338b0 con 0x7f41fc1309f0 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.265+0000 7f41fb7fe700 1 --2- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc133ad0 0x7f41fc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.266+0000 7f41fbfff700 1 --2- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41fc1309f0 0x7f41fc13a980 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009d90 tx=0x7f41f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c596e38754331c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.266+0000 7f41fa7fc700 1 -- 172.21.15.154:0/3801159184 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400e070 con 0x7f41fc1309f0 2023-09-30T22:26:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.266+0000 7f41fa7fc700 1 -- 172.21.15.154:0/3801159184 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f400bb20 con 0x7f41fc1309f0 2023-09-30T22:26:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.266+0000 7f41fa7fc700 1 -- 172.21.15.154:0/3801159184 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4012430 con 0x7f41fc1309f0 2023-09-30T22:26:06.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.267+0000 7f42020c7700 1 -- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41fc1309f0 msgr2=0x7f41fc13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.267+0000 7f42020c7700 1 --2- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41fc1309f0 0x7f41fc13a980 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009d90 tx=0x7f41f400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:06.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.267+0000 7f42020c7700 1 -- 172.21.15.154:0/3801159184 shutdown_connections 2023-09-30T22:26:06.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.267+0000 7f42020c7700 1 --2- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc133ad0 0x7f41fc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.267+0000 7f42020c7700 1 --2- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41fc1309f0 0x7f41fc13a980 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.267+0000 7f42020c7700 1 --2- 172.21.15.154:0/3801159184 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 0x7f41fc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.267+0000 7f42020c7700 1 -- 172.21.15.154:0/3801159184 >> 172.21.15.154:0/3801159184 conn(0x7f41fc099c40 msgr2=0x7f41fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.267+0000 7f42020c7700 1 -- 172.21.15.154:0/3801159184 shutdown_connections 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.267+0000 7f42020c7700 1 -- 172.21.15.154:0/3801159184 wait complete. 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.268+0000 7f42020c7700 1 Processor -- start 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.268+0000 7f42020c7700 1 -- start start 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f42020c7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 0x7f41fc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f42020c7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc1309f0 0x7f41fc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f42020c7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41fc133ad0 0x7f41fc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f42020c7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc120e00 con 0x7f41fc133ad0 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f42020c7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc12d580 con 0x7f41fc1309f0 2023-09-30T22:26:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f42020c7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc12dd00 con 0x7f41fc1300a0 2023-09-30T22:26:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f41faffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc1309f0 0x7f41fc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f41faffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc1309f0 0x7f41fc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51434/0 (socket says 172.21.15.154:51434) 2023-09-30T22:26:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f41faffd700 1 -- 172.21.15.154:0/1303199933 learned_addr learned my addr 172.21.15.154:0/1303199933 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f41fb7fe700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 0x7f41fc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.269+0000 7f41fbfff700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41fc133ad0 0x7f41fc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41faffd700 1 -- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 msgr2=0x7f41fc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41faffd700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 0x7f41fc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41faffd700 1 -- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41fc133ad0 msgr2=0x7f41fc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41faffd700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41fc133ad0 0x7f41fc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41faffd700 1 -- 172.21.15.154:0/1303199933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec009550 con 0x7f41fc1309f0 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41fb7fe700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 0x7f41fc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41faffd700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc1309f0 0x7f41fc11df80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f41f000d7d0 tx=0x7f41f000dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41e3fff700 1 -- 172.21.15.154:0/1303199933 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00125f0 con 0x7f41fc1309f0 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41e3fff700 1 -- 172.21.15.154:0/1303199933 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f0012750 con 0x7f41fc1309f0 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f41e3fff700 1 -- 172.21.15.154:0/1303199933 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0012ae0 con 0x7f41fc1309f0 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f42020c7700 1 -- 172.21.15.154:0/1303199933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f4009a70 con 0x7f41fc1309f0 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.270+0000 7f42020c7700 1 -- 172.21.15.154:0/1303199933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41fc072300 con 0x7f41fc1309f0 2023-09-30T22:26:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.271+0000 7f42020c7700 1 -- 172.21.15.154:0/1303199933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41fc04f2a0 con 0x7f41fc1309f0 2023-09-30T22:26:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.272+0000 7f41e3fff700 1 -- 172.21.15.154:0/1303199933 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41f0012c40 con 0x7f41fc1309f0 2023-09-30T22:26:06.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.272+0000 7f41e3fff700 1 -- 172.21.15.154:0/1303199933 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f41f0040240 con 0x7f41fc1309f0 2023-09-30T22:26:06.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.280+0000 7f41e3fff700 1 -- 172.21.15.154:0/1303199933 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41f001b770 con 0x7f41fc1309f0 2023-09-30T22:26:06.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.293+0000 7fa590567700 1 Processor -- start 2023-09-30T22:26:06.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.293+0000 7fa590567700 1 -- start start 2023-09-30T22:26:06.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa590567700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588138040 0x7fa588138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa590567700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa5880a08e0 0x7fa5880a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa590567700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a1230 0x7fa58813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa590567700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880a2100 con 0x7fa5880a08e0 2023-09-30T22:26:06.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa590567700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa588138950 con 0x7fa588138040 2023-09-30T22:26:06.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa590567700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5881379e0 con 0x7fa5880a1230 2023-09-30T22:26:06.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58e303700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588138040 0x7fa588138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58e303700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588138040 0x7fa588138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51448/0 (socket says 172.21.15.154:51448) 2023-09-30T22:26:06.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58e303700 1 -- 172.21.15.154:0/4283083272 learned_addr learned my addr 172.21.15.154:0/4283083272 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:06.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58db02700 1 --2- 172.21.15.154:0/4283083272 >> v2:172.21.15.154:3300/0 conn(0x7fa5880a08e0 0x7fa5880a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58eb04700 1 --2- 172.21.15.154:0/4283083272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a1230 0x7fa58813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58e303700 1 -- 172.21.15.154:0/4283083272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a1230 msgr2=0x7fa58813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58e303700 1 --2- 172.21.15.154:0/4283083272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a1230 0x7fa58813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58e303700 1 -- 172.21.15.154:0/4283083272 >> v2:172.21.15.154:3300/0 conn(0x7fa5880a08e0 msgr2=0x7fa5880a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58e303700 1 --2- 172.21.15.154:0/4283083272 >> v2:172.21.15.154:3300/0 conn(0x7fa5880a08e0 0x7fa5880a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.294+0000 7fa58e303700 1 -- 172.21.15.154:0/4283083272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58809b9b0 con 0x7fa588138040 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.295+0000 7fa58e303700 1 --2- 172.21.15.154:0/4283083272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588138040 0x7fa588138410 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa5840098f0 tx=0x7fa584009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=194336cab278133f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.295+0000 7fa58d301700 1 -- 172.21.15.154:0/4283083272 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584005e30 con 0x7fa588138040 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.295+0000 7fa58d301700 1 -- 172.21.15.154:0/4283083272 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa584004030 con 0x7fa588138040 2023-09-30T22:26:06.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.295+0000 7fa58d301700 1 -- 172.21.15.154:0/4283083272 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5840043e0 con 0x7fa588138040 2023-09-30T22:26:06.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.295+0000 7f732cdac700 1 Processor -- start 2023-09-30T22:26:06.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.295+0000 7f732cdac700 1 -- start start 2023-09-30T22:26:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7fa590567700 1 -- 172.21.15.154:0/4283083272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588138040 msgr2=0x7fa588138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7fa590567700 1 --2- 172.21.15.154:0/4283083272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588138040 0x7fa588138410 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa5840098f0 tx=0x7fa584009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7fa590567700 1 -- 172.21.15.154:0/4283083272 shutdown_connections 2023-09-30T22:26:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7fa590567700 1 --2- 172.21.15.154:0/4283083272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa588138040 0x7fa588138410 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7fa590567700 1 --2- 172.21.15.154:0/4283083272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a1230 0x7fa58813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7fa590567700 1 --2- 172.21.15.154:0/4283083272 >> v2:172.21.15.154:3300/0 conn(0x7fa5880a08e0 0x7fa5880a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7fa590567700 1 -- 172.21.15.154:0/4283083272 >> 172.21.15.154:0/4283083272 conn(0x7fa5880a2980 msgr2=0x7fa5880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7f732cdac700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7328133ad0 0x7f7328133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7f732cdac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 0x7f73281304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7f732cdac700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732806b2d0 con 0x7f73281309f0 2023-09-30T22:26:06.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7f732cdac700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7328133610 con 0x7f73281300a0 2023-09-30T22:26:06.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7f732cdac700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f732809a500 con 0x7f7328133ad0 2023-09-30T22:26:06.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7fa590567700 1 -- 172.21.15.154:0/4283083272 shutdown_connections 2023-09-30T22:26:06.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7f732659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7328133ad0 0x7f7328133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7f7325d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 0x7f73281304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7f7326d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f73281309f0 0x7f732813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37574/0 (socket says 172.21.15.154:37574) 2023-09-30T22:26:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7f7326d9d700 1 -- 172.21.15.154:0/1913474217 learned_addr learned my addr 172.21.15.154:0/1913474217 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.296+0000 7fa590567700 1 -- 172.21.15.154:0/4283083272 wait complete. 2023-09-30T22:26:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7f732659c700 1 -- 172.21.15.154:0/1913474217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 msgr2=0x7f73281304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7f732659c700 1 --2- 172.21.15.154:0/1913474217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 0x7f73281304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7f732659c700 1 -- 172.21.15.154:0/1913474217 >> v1:172.21.15.154:6789/0 conn(0x7f73281309f0 legacy=0x7f732813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7f732659c700 1 -- 172.21.15.154:0/1913474217 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73281338b0 con 0x7f7328133ad0 2023-09-30T22:26:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7f732659c700 1 --2- 172.21.15.154:0/1913474217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7328133ad0 0x7f7328133ea0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7318009870 tx=0x7f7318009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2437c3d90192cea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7f732559a700 1 -- 172.21.15.154:0/1913474217 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011830 con 0x7f7328133ad0 2023-09-30T22:26:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7f732559a700 1 -- 172.21.15.154:0/1913474217 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7318011990 con 0x7f7328133ad0 2023-09-30T22:26:06.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7f732559a700 1 -- 172.21.15.154:0/1913474217 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318011d20 con 0x7f7328133ad0 2023-09-30T22:26:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7fa590567700 1 Processor -- start 2023-09-30T22:26:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.297+0000 7fa590567700 1 -- start start 2023-09-30T22:26:06.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7f732cdac700 1 -- 172.21.15.154:0/1913474217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7328133ad0 msgr2=0x7f7328133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa590567700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a08e0 0x7fa5881262e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7f732cdac700 1 --2- 172.21.15.154:0/1913474217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7328133ad0 0x7f7328133ea0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7318009870 tx=0x7f7318009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:06.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7f732cdac700 1 -- 172.21.15.154:0/1913474217 shutdown_connections 2023-09-30T22:26:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7f732cdac700 1 --2- 172.21.15.154:0/1913474217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7328133ad0 0x7f7328133ea0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7f732cdac700 1 --2- 172.21.15.154:0/1913474217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 0x7f73281304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7f732cdac700 1 -- 172.21.15.154:0/1913474217 >> 172.21.15.154:0/1913474217 conn(0x7f7328099c40 msgr2=0x7f73280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7f732cdac700 1 -- 172.21.15.154:0/1913474217 shutdown_connections 2023-09-30T22:26:06.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa590567700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5880a1230 0x7fa588126820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa590567700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa588138040 0x7fa588126d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa590567700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa588129e00 con 0x7fa588138040 2023-09-30T22:26:06.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa590567700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58809a240 con 0x7fa5880a1230 2023-09-30T22:26:06.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa590567700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa588127f90 con 0x7fa5880a08e0 2023-09-30T22:26:06.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7f732cdac700 1 -- 172.21.15.154:0/1913474217 wait complete. 2023-09-30T22:26:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa58db02700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5880a1230 0x7fa588126820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa58db02700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5880a1230 0x7fa588126820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51468/0 (socket says 172.21.15.154:51468) 2023-09-30T22:26:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa58db02700 1 -- 172.21.15.154:0/3040962677 learned_addr learned my addr 172.21.15.154:0/3040962677 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa58eb04700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa588138040 0x7fa588126d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.298+0000 7fa58e303700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a08e0 0x7fa5881262e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa58db02700 1 -- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a08e0 msgr2=0x7fa5881262e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa58db02700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a08e0 0x7fa5881262e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa58db02700 1 -- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa588138040 msgr2=0x7fa588126d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa58db02700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa588138040 0x7fa588126d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa58db02700 1 -- 172.21.15.154:0/3040962677 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584009500 con 0x7fa5880a1230 2023-09-30T22:26:06.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa58e303700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a08e0 0x7fa5881262e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:06.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa58db02700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5880a1230 0x7fa588126820 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e840 tx=0x7fa57800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7f732cdac700 1 Processor -- start 2023-09-30T22:26:06.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7f732cdac700 1 -- start start 2023-09-30T22:26:06.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa57effd700 1 -- 172.21.15.154:0/3040962677 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578013680 con 0x7fa5880a1230 2023-09-30T22:26:06.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa57effd700 1 -- 172.21.15.154:0/3040962677 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5780137e0 con 0x7fa5880a1230 2023-09-30T22:26:06.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.299+0000 7fa57effd700 1 -- 172.21.15.154:0/3040962677 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578013b70 con 0x7fa5880a1230 2023-09-30T22:26:06.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f732cdac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 0x7f73281c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f732cdac700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f73281309f0 0x7f73281c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f732cdac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7328133ad0 0x7f73281c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f732cdac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7328120bc0 con 0x7f7328133ad0 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f732cdac700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732811ffe0 con 0x7f73281300a0 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f732cdac700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73280723b0 con 0x7f73281309f0 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f732659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 0x7f73281c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f732659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 0x7f73281c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51484/0 (socket says 172.21.15.154:51484) 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f732659c700 1 -- 172.21.15.154:0/4110485771 learned_addr learned my addr 172.21.15.154:0/4110485771 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f7325d9b700 1 --2- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f73281309f0 0x7f73281c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f7325d9b700 1 -- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 msgr2=0x7f73281c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f7325d9b700 1 --2- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 0x7f73281c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f7325d9b700 1 -- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7328133ad0 msgr2=0x7f73281c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f7325d9b700 1 --2- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7328133ad0 0x7f73281c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.300+0000 7f7325d9b700 1 -- 172.21.15.154:0/4110485771 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73180094a0 con 0x7f73281309f0 2023-09-30T22:26:06.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.301+0000 7fa590567700 1 -- 172.21.15.154:0/3040962677 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa588136e00 con 0x7fa5880a1230 2023-09-30T22:26:06.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.301+0000 7f7325d9b700 1 --2- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f73281309f0 0x7f73281c8c90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f731c00e870 tx=0x7f731c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.301+0000 7fa590567700 1 -- 172.21.15.154:0/3040962677 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa588137680 con 0x7fa5880a1230 2023-09-30T22:26:06.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.301+0000 7f7316ffd700 1 -- 172.21.15.154:0/4110485771 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c013680 con 0x7f73281309f0 2023-09-30T22:26:06.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.301+0000 7f732cdac700 1 -- 172.21.15.154:0/4110485771 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732812fdd0 con 0x7f73281309f0 2023-09-30T22:26:06.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.302+0000 7f732cdac700 1 -- 172.21.15.154:0/4110485771 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732812dd60 con 0x7f73281309f0 2023-09-30T22:26:06.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.302+0000 7f7316ffd700 1 -- 172.21.15.154:0/4110485771 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c0137e0 con 0x7f73281309f0 2023-09-30T22:26:06.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.302+0000 7f7316ffd700 1 -- 172.21.15.154:0/4110485771 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c013b70 con 0x7f73281309f0 2023-09-30T22:26:06.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.301+0000 7fa590567700 1 -- 172.21.15.154:0/3040962677 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa588129a40 con 0x7fa5880a1230 2023-09-30T22:26:06.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.302+0000 7fa57effd700 1 -- 172.21.15.154:0/3040962677 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa578013cd0 con 0x7fa5880a1230 2023-09-30T22:26:06.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.303+0000 7f7316ffd700 1 -- 172.21.15.154:0/4110485771 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f731c013cd0 con 0x7f73281309f0 2023-09-30T22:26:06.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.303+0000 7f7316ffd700 1 -- 172.21.15.154:0/4110485771 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f731c03f530 con 0x7f73281309f0 2023-09-30T22:26:06.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.302+0000 7fa57effd700 1 -- 172.21.15.154:0/3040962677 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa57803f600 con 0x7fa5880a1230 2023-09-30T22:26:06.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.305+0000 7f732cdac700 1 -- 172.21.15.154:0/4110485771 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730c0052e0 con 0x7f73281309f0 2023-09-30T22:26:06.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.308+0000 7fa57effd700 1 -- 172.21.15.154:0/3040962677 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa57801ba00 con 0x7fa5880a1230 2023-09-30T22:26:06.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.314+0000 7f7316ffd700 1 -- 172.21.15.154:0/4110485771 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f731c011db0 con 0x7f73281309f0 2023-09-30T22:26:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.340+0000 7f62517f4700 1 Processor -- start 2023-09-30T22:26:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.340+0000 7f62517f4700 1 -- start start 2023-09-30T22:26:06.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f62517f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f62517f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c1393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f62517f4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c09b6d0 con 0x7f624c09e950 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f62517f4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c09afb0 con 0x7f624c137010 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f62517f4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0a0970 con 0x7f624c09f430 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f624affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f624c09e950 0x7f624c09ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37588/0 (socket says 172.21.15.154:37588) 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f624affd700 1 -- 172.21.15.154:0/3312475920 learned_addr learned my addr 172.21.15.154:0/3312475920 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f624a7fc700 1 --2- 172.21.15.154:0/3312475920 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f624b7fe700 1 --2- 172.21.15.154:0/3312475920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c1393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f6249ffb700 1 -- 172.21.15.154:0/3312475920 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184481920 0 0) 0x7f624c09b6d0 con 0x7f624c09e950 2023-09-30T22:26:06.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f624a7fc700 1 -- 172.21.15.154:0/3312475920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 msgr2=0x7f624c1393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:06.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f624a7fc700 1 --2- 172.21.15.154:0/3312475920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c1393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f624a7fc700 1 -- 172.21.15.154:0/3312475920 >> v1:172.21.15.154:6789/0 conn(0x7f624c09e950 legacy=0x7f624c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.341+0000 7f624a7fc700 1 -- 172.21.15.154:0/3312475920 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0a0320 con 0x7f624c09f430 2023-09-30T22:26:06.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.342+0000 7f624a7fc700 1 --2- 172.21.15.154:0/3312475920 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c136ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f62400098a0 tx=0x7f6240009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c7c52d3fa531e36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.342+0000 7f6249ffb700 1 -- 172.21.15.154:0/3312475920 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240011830 con 0x7f624c09f430 2023-09-30T22:26:06.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.342+0000 7f6249ffb700 1 -- 172.21.15.154:0/3312475920 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6240011990 con 0x7f624c09f430 2023-09-30T22:26:06.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.342+0000 7f6249ffb700 1 -- 172.21.15.154:0/3312475920 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240011d40 con 0x7f624c09f430 2023-09-30T22:26:06.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.343+0000 7f62517f4700 1 -- 172.21.15.154:0/3312475920 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 msgr2=0x7f624c136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.343+0000 7f62517f4700 1 --2- 172.21.15.154:0/3312475920 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c136ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f62400098a0 tx=0x7f6240009bb0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.343+0000 7f62517f4700 1 -- 172.21.15.154:0/3312475920 shutdown_connections 2023-09-30T22:26:06.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.343+0000 7f62517f4700 1 --2- 172.21.15.154:0/3312475920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c1393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.343+0000 7f62517f4700 1 --2- 172.21.15.154:0/3312475920 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c136ad0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.343+0000 7f62517f4700 1 -- 172.21.15.154:0/3312475920 >> 172.21.15.154:0/3312475920 conn(0x7f624c0a0f70 msgr2=0x7f624c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.343+0000 7f62517f4700 1 -- 172.21.15.154:0/3312475920 shutdown_connections 2023-09-30T22:26:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.343+0000 7f62517f4700 1 -- 172.21.15.154:0/3312475920 wait complete. 2023-09-30T22:26:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.344+0000 7f62517f4700 1 Processor -- start 2023-09-30T22:26:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.344+0000 7f62517f4700 1 -- start start 2023-09-30T22:26:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.344+0000 7f62517f4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c09e950 0x7f624c11f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.344+0000 7f62517f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c11fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.344+0000 7f62517f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c120070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.344+0000 7f62517f4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1213f0 con 0x7f624c09e950 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.344+0000 7f62517f4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c121200 con 0x7f624c137010 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.344+0000 7f62517f4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f624c09da40 con 0x7f624c09f430 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.344+0000 7f624affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c09e950 0x7f624c11f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c120070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c120070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51500/0 (socket says 172.21.15.154:51500) 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c09e950 0x7f624c11f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34956/0 (socket says 172.21.15.154:34956) 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c11fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624b7fe700 1 -- 172.21.15.154:0/3137064038 learned_addr learned my addr 172.21.15.154:0/3137064038 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624b7fe700 1 -- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 msgr2=0x7f624c11fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624b7fe700 1 --2- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c11fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624b7fe700 1 -- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c09e950 msgr2=0x7f624c11f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624b7fe700 1 --2- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c09e950 0x7f624c11f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624b7fe700 1 -- 172.21.15.154:0/3137064038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400094a0 con 0x7f624c137010 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624a7fc700 1 --2- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c11fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f624b7fe700 1 --2- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c120070 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6244007de0 tx=0x7f624400e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f62337fe700 1 -- 172.21.15.154:0/3137064038 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400ed30 con 0x7f624c137010 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f62337fe700 1 -- 172.21.15.154:0/3137064038 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244014420 con 0x7f624c137010 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f62337fe700 1 -- 172.21.15.154:0/3137064038 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440147d0 con 0x7f624c137010 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f62517f4700 1 -- 172.21.15.154:0/3137064038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c1354e0 con 0x7f624c137010 2023-09-30T22:26:06.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.345+0000 7f62517f4700 1 -- 172.21.15.154:0/3137064038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c1219f0 con 0x7f624c137010 2023-09-30T22:26:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.346+0000 7f62337fe700 1 -- 172.21.15.154:0/3137064038 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6244014930 con 0x7f624c137010 2023-09-30T22:26:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.347+0000 7f62337fe700 1 -- 172.21.15.154:0/3137064038 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f624403fdd0 con 0x7f624c137010 2023-09-30T22:26:06.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.347+0000 7f62517f4700 1 -- 172.21.15.154:0/3137064038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c04f2a0 con 0x7f624c137010 2023-09-30T22:26:06.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.352+0000 7f62337fe700 1 -- 172.21.15.154:0/3137064038 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6244014be0 con 0x7f624c137010 2023-09-30T22:26:06.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.486+0000 7f42020c7700 1 -- 172.21.15.154:0/1303199933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f41fc120180 con 0x7f41fc1309f0 2023-09-30T22:26:06.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.486+0000 7f41e3fff700 1 -- 172.21.15.154:0/1303199933 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41fc120180 con 0x7f41fc1309f0 2023-09-30T22:26:06.487 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.489+0000 7f42020c7700 1 -- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc1309f0 msgr2=0x7f41fc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.489+0000 7f42020c7700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc1309f0 0x7f41fc11df80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f41f000d7d0 tx=0x7f41f000dae0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.489+0000 7f42020c7700 1 -- 172.21.15.154:0/1303199933 shutdown_connections 2023-09-30T22:26:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.489+0000 7f42020c7700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41fc133ad0 0x7f41fc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.489+0000 7f42020c7700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41fc1300a0 0x7f41fc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.489+0000 7f42020c7700 1 --2- 172.21.15.154:0/1303199933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41fc1309f0 0x7f41fc11df80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.489+0000 7f42020c7700 1 -- 172.21.15.154:0/1303199933 >> 172.21.15.154:0/1303199933 conn(0x7f41fc099c40 msgr2=0x7f41fc132cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.489+0000 7f42020c7700 1 -- 172.21.15.154:0/1303199933 shutdown_connections 2023-09-30T22:26:06.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.489+0000 7f42020c7700 1 -- 172.21.15.154:0/1303199933 wait complete. 2023-09-30T22:26:06.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:06.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.508+0000 7fa590567700 1 -- 172.21.15.154:0/3040962677 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa58812a650 con 0x7fa5880a1230 2023-09-30T22:26:06.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.508+0000 7fa57effd700 1 -- 172.21.15.154:0/3040962677 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa578021090 con 0x7fa5880a1230 2023-09-30T22:26:06.510 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:06.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.511+0000 7fa590567700 1 -- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5880a1230 msgr2=0x7fa588126820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.511+0000 7fa590567700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5880a1230 0x7fa588126820 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e840 tx=0x7fa57800eb50 comp rx=0 tx=0).stop 2023-09-30T22:26:06.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.511+0000 7fa590567700 1 -- 172.21.15.154:0/3040962677 shutdown_connections 2023-09-30T22:26:06.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.511+0000 7fa590567700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa588138040 0x7fa588126d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.511+0000 7fa590567700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5880a08e0 0x7fa5881262e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.511+0000 7fa590567700 1 --2- 172.21.15.154:0/3040962677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5880a1230 0x7fa588126820 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.511+0000 7fa590567700 1 -- 172.21.15.154:0/3040962677 >> 172.21.15.154:0/3040962677 conn(0x7fa5880a2980 msgr2=0x7fa58809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.511+0000 7fa590567700 1 -- 172.21.15.154:0/3040962677 shutdown_connections 2023-09-30T22:26:06.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.511+0000 7fa590567700 1 -- 172.21.15.154:0/3040962677 wait complete. 2023-09-30T22:26:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.518+0000 7f732cdac700 1 -- 172.21.15.154:0/4110485771 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f730c005590 con 0x7f73281309f0 2023-09-30T22:26:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.519+0000 7f7316ffd700 1 -- 172.21.15.154:0/4110485771 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f731c017020 con 0x7f73281309f0 2023-09-30T22:26:06.519 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:06.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.522+0000 7f732cdac700 1 -- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f73281309f0 msgr2=0x7f73281c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.522+0000 7f732cdac700 1 --2- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f73281309f0 0x7f73281c8c90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f731c00e870 tx=0x7f731c00eb80 comp rx=0 tx=0).stop 2023-09-30T22:26:06.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.522+0000 7f732cdac700 1 -- 172.21.15.154:0/4110485771 shutdown_connections 2023-09-30T22:26:06.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.522+0000 7f732cdac700 1 --2- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7328133ad0 0x7f73281c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.522+0000 7f732cdac700 1 --2- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73281300a0 0x7f73281c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.522+0000 7f732cdac700 1 --2- 172.21.15.154:0/4110485771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f73281309f0 0x7f73281c8c90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.522+0000 7f732cdac700 1 -- 172.21.15.154:0/4110485771 >> 172.21.15.154:0/4110485771 conn(0x7f7328099c40 msgr2=0x7f7328131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.522+0000 7f732cdac700 1 -- 172.21.15.154:0/4110485771 shutdown_connections 2023-09-30T22:26:06.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.522+0000 7f732cdac700 1 -- 172.21.15.154:0/4110485771 wait complete. 2023-09-30T22:26:06.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:06.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.557+0000 7f62517f4700 1 -- 172.21.15.154:0/3137064038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f624c09b8b0 con 0x7f624c137010 2023-09-30T22:26:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.557+0000 7f62337fe700 1 -- 172.21.15.154:0/3137064038 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f624401bb00 con 0x7f624c137010 2023-09-30T22:26:06.558 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:06.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.559+0000 7f62517f4700 1 -- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 msgr2=0x7f624c120070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:06.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.559+0000 7f62517f4700 1 --2- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c120070 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6244007de0 tx=0x7f624400e3c0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.559+0000 7f62517f4700 1 -- 172.21.15.154:0/3137064038 shutdown_connections 2023-09-30T22:26:06.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.559+0000 7f62517f4700 1 --2- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f624c137010 0x7f624c120070 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.559+0000 7f62517f4700 1 --2- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f624c09e950 0x7f624c11f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.559+0000 7f62517f4700 1 --2- 172.21.15.154:0/3137064038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f624c09f430 0x7f624c11fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:06.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.559+0000 7f62517f4700 1 -- 172.21.15.154:0/3137064038 >> 172.21.15.154:0/3137064038 conn(0x7f624c0a0f70 msgr2=0x7f624c135be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:06.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.559+0000 7f62517f4700 1 -- 172.21.15.154:0/3137064038 shutdown_connections 2023-09-30T22:26:06.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:06.559+0000 7f62517f4700 1 -- 172.21.15.154:0/3137064038 wait complete. 2023-09-30T22:26:06.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:07.508 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:07.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:07.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:07.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.650+0000 7fb668429700 1 Processor -- start 2023-09-30T22:26:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.650+0000 7fb668429700 1 -- start start 2023-09-30T22:26:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.650+0000 7fb668429700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6601346e0 0x7fb660136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.650+0000 7fb668429700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660137000 0x7fb6601393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb668429700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600a1640 con 0x7fb660131980 2023-09-30T22:26:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb668429700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66006eb30 con 0x7fb660137000 2023-09-30T22:26:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb668429700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600a22d0 con 0x7fb6601346e0 2023-09-30T22:26:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6661c5700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb660131980 0x7fb660131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37598/0 (socket says 172.21.15.154:37598) 2023-09-30T22:26:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6661c5700 1 -- 172.21.15.154:0/1935580469 learned_addr learned my addr 172.21.15.154:0/1935580469 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:07.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6669c6700 1 --2- 172.21.15.154:0/1935580469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660137000 0x7fb6601393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6659c4700 1 --2- 172.21.15.154:0/1935580469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6601346e0 0x7fb660136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6669c6700 1 -- 172.21.15.154:0/1935580469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6601346e0 msgr2=0x7fb660136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6669c6700 1 --2- 172.21.15.154:0/1935580469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6601346e0 0x7fb660136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6669c6700 1 -- 172.21.15.154:0/1935580469 >> v1:172.21.15.154:6789/0 conn(0x7fb660131980 legacy=0x7fb660131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6669c6700 1 -- 172.21.15.154:0/1935580469 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660131550 con 0x7fb660137000 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6651c3700 1 -- 172.21.15.154:0/1935580469 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499928577 0 0) 0x7fb6600a1640 con 0x7fb660131980 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6669c6700 1 --2- 172.21.15.154:0/1935580469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660137000 0x7fb6601393e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb658009e20 tx=0x7fb65800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d9ffe7c6f7bb2b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6651c3700 1 -- 172.21.15.154:0/1935580469 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800bd50 con 0x7fb660137000 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6651c3700 1 -- 172.21.15.154:0/1935580469 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb658003a20 con 0x7fb660137000 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.651+0000 7fb6651c3700 1 -- 172.21.15.154:0/1935580469 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658003dd0 con 0x7fb660137000 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.652+0000 7fb668429700 1 -- 172.21.15.154:0/1935580469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660137000 msgr2=0x7fb6601393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.652+0000 7fb668429700 1 --2- 172.21.15.154:0/1935580469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660137000 0x7fb6601393e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb658009e20 tx=0x7fb65800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:07.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.652+0000 7fb668429700 1 -- 172.21.15.154:0/1935580469 shutdown_connections 2023-09-30T22:26:07.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.652+0000 7fb668429700 1 --2- 172.21.15.154:0/1935580469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660137000 0x7fb6601393e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.652+0000 7fb668429700 1 --2- 172.21.15.154:0/1935580469 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6601346e0 0x7fb660136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.652+0000 7fb668429700 1 -- 172.21.15.154:0/1935580469 >> 172.21.15.154:0/1935580469 conn(0x7fb6600a2980 msgr2=0x7fb6600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.652+0000 7fb668429700 1 -- 172.21.15.154:0/1935580469 shutdown_connections 2023-09-30T22:26:07.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.652+0000 7fb668429700 1 -- 172.21.15.154:0/1935580469 wait complete. 2023-09-30T22:26:07.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.653+0000 7fb668429700 1 Processor -- start 2023-09-30T22:26:07.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.653+0000 7fb668429700 1 -- start start 2023-09-30T22:26:07.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb668429700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660131980 0x7fb66009a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb668429700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6601346e0 0x7fb66009ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb668429700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb660137000 0x7fb66009b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb668429700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6601302e0 con 0x7fb6601346e0 2023-09-30T22:26:07.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb668429700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66011a6a0 con 0x7fb660131980 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb668429700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600a1c40 con 0x7fb660137000 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6659c4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6601346e0 0x7fb66009ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6661c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660131980 0x7fb66009a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6659c4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6601346e0 0x7fb66009ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34970/0 (socket says 172.21.15.154:34970) 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6659c4700 1 -- 172.21.15.154:0/766877805 learned_addr learned my addr 172.21.15.154:0/766877805 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6661c5700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660131980 0x7fb66009a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51508/0 (socket says 172.21.15.154:51508) 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6669c6700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb660137000 0x7fb66009b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6661c5700 1 -- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb660137000 msgr2=0x7fb66009b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6661c5700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb660137000 0x7fb66009b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6661c5700 1 -- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6601346e0 msgr2=0x7fb66009ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6661c5700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6601346e0 0x7fb66009ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6661c5700 1 -- 172.21.15.154:0/766877805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb658009a70 con 0x7fb660131980 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.654+0000 7fb6659c4700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6601346e0 0x7fb66009ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.655+0000 7fb6661c5700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660131980 0x7fb66009a930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00c750 tx=0x7fb65c00ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.655+0000 7fb656ffd700 1 -- 172.21.15.154:0/766877805 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0074e0 con 0x7fb660131980 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.655+0000 7fb656ffd700 1 -- 172.21.15.154:0/766877805 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c007640 con 0x7fb660131980 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.655+0000 7fb668429700 1 -- 172.21.15.154:0/766877805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66011a100 con 0x7fb660131980 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.655+0000 7fb656ffd700 1 -- 172.21.15.154:0/766877805 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c005a70 con 0x7fb660131980 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.655+0000 7fb668429700 1 -- 172.21.15.154:0/766877805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66011ae30 con 0x7fb660131980 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.656+0000 7fb656ffd700 1 -- 172.21.15.154:0/766877805 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb65c005bd0 con 0x7fb660131980 2023-09-30T22:26:07.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.656+0000 7fb668429700 1 -- 172.21.15.154:0/766877805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66004f2a0 con 0x7fb660131980 2023-09-30T22:26:07.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.656+0000 7fb656ffd700 1 -- 172.21.15.154:0/766877805 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb65c03eb50 con 0x7fb660131980 2023-09-30T22:26:07.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.665+0000 7fb656ffd700 1 -- 172.21.15.154:0/766877805 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb65c007d40 con 0x7fb660131980 2023-09-30T22:26:07.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.689+0000 7fa0505cf700 1 Processor -- start 2023-09-30T22:26:07.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.689+0000 7fa0505cf700 1 -- start start 2023-09-30T22:26:07.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa0505cf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809e870 0x7fa04809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa0505cf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa048131f40 0x7fa048139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa0505cf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04809c970 con 0x7fa04809f180 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa0505cf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480a0920 con 0x7fa048131f40 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa0505cf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04809f9c0 con 0x7fa04809e870 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa04e36b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809e870 0x7fa04809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa04e36b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809e870 0x7fa04809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60664/0 (socket says 172.21.15.154:60664) 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa04e36b700 1 -- 172.21.15.154:0/2796188874 learned_addr learned my addr 172.21.15.154:0/2796188874 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa04eb6c700 1 --2- 172.21.15.154:0/2796188874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa048131f40 0x7fa048139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa04e36b700 1 -- 172.21.15.154:0/2796188874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa048131f40 msgr2=0x7fa048139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.690+0000 7fa04e36b700 1 --2- 172.21.15.154:0/2796188874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa048131f40 0x7fa048139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fa04e36b700 1 -- 172.21.15.154:0/2796188874 >> v1:172.21.15.154:6789/0 conn(0x7fa04809f180 legacy=0x7fa048131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fa04e36b700 1 -- 172.21.15.154:0/2796188874 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04809bab0 con 0x7fa04809e870 2023-09-30T22:26:07.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fa04e36b700 1 --2- 172.21.15.154:0/2796188874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809e870 0x7fa04809ec40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa044009920 tx=0x7fa044009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f59629ecd4f475d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fee11ba0700 1 Processor -- start 2023-09-30T22:26:07.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fee11ba0700 1 -- start start 2023-09-30T22:26:07.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fee11ba0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c1302c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fee11ba0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee0c12fdc0 0x7fee0c130800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fee11ba0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c1337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fee11ba0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c09eda0 con 0x7fee0c12fdc0 2023-09-30T22:26:07.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fee11ba0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c06b0a0 con 0x7fee0c06a770 2023-09-30T22:26:07.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fee11ba0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c130d40 con 0x7fee0c133330 2023-09-30T22:26:07.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fa04d369700 1 -- 172.21.15.154:0/2796188874 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044011830 con 0x7fa04809e870 2023-09-30T22:26:07.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fa04d369700 1 -- 172.21.15.154:0/2796188874 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044011990 con 0x7fa04809e870 2023-09-30T22:26:07.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fa04d369700 1 -- 172.21.15.154:0/2796188874 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044011d20 con 0x7fa04809e870 2023-09-30T22:26:07.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.691+0000 7fee1139f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c1337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fee1139f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c1337b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60680/0 (socket says 172.21.15.154:60680) 2023-09-30T22:26:07.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fee1139f700 1 -- 172.21.15.154:0/3041403143 learned_addr learned my addr 172.21.15.154:0/3041403143 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:07.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fee10b9e700 1 --2- 172.21.15.154:0/3041403143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c1302c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fee1139f700 1 -- 172.21.15.154:0/3041403143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 msgr2=0x7fee0c1302c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fee1139f700 1 --2- 172.21.15.154:0/3041403143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c1302c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fee1139f700 1 -- 172.21.15.154:0/3041403143 >> v2:172.21.15.154:3300/0 conn(0x7fee0c12fdc0 msgr2=0x7fee0c130800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fee1139f700 1 --2- 172.21.15.154:0/3041403143 >> v2:172.21.15.154:3300/0 conn(0x7fee0c12fdc0 0x7fee0c130800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fee1139f700 1 -- 172.21.15.154:0/3041403143 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c09f420 con 0x7fee0c133330 2023-09-30T22:26:07.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fee1139f700 1 --2- 172.21.15.154:0/3041403143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c1337b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fee04009eb0 tx=0x7fee0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d09e173533a9b82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fa0505cf700 1 -- 172.21.15.154:0/2796188874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809e870 msgr2=0x7fa04809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fa0505cf700 1 --2- 172.21.15.154:0/2796188874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809e870 0x7fa04809ec40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa044009920 tx=0x7fa044009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fa0505cf700 1 -- 172.21.15.154:0/2796188874 shutdown_connections 2023-09-30T22:26:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fa0505cf700 1 --2- 172.21.15.154:0/2796188874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa048131f40 0x7fa048139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fa0505cf700 1 --2- 172.21.15.154:0/2796188874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809e870 0x7fa04809ec40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fa0505cf700 1 -- 172.21.15.154:0/2796188874 >> 172.21.15.154:0/2796188874 conn(0x7fa0480a4430 msgr2=0x7fa0480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.692+0000 7fa0505cf700 1 -- 172.21.15.154:0/2796188874 shutdown_connections 2023-09-30T22:26:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.693+0000 7fa0505cf700 1 -- 172.21.15.154:0/2796188874 wait complete. 2023-09-30T22:26:07.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.693+0000 7fa0505cf700 1 Processor -- start 2023-09-30T22:26:07.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.693+0000 7fa0505cf700 1 -- start start 2023-09-30T22:26:07.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fee0b7fe700 1 -- 172.21.15.154:0/3041403143 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0400e070 con 0x7fee0c133330 2023-09-30T22:26:07.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fee0b7fe700 1 -- 172.21.15.154:0/3041403143 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0400b890 con 0x7fee0c133330 2023-09-30T22:26:07.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fee0b7fe700 1 -- 172.21.15.154:0/3041403143 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0400bc40 con 0x7fee0c133330 2023-09-30T22:26:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa0505cf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa04809e870 0x7fa04811f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa0505cf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809f180 0x7fa04811f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa0505cf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048131f40 0x7fa04811fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa0505cf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0481207b0 con 0x7fa048131f40 2023-09-30T22:26:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa0505cf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0481306b0 con 0x7fa04809e870 2023-09-30T22:26:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa0505cf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa048122860 con 0x7fa04809f180 2023-09-30T22:26:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa04eb6c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048131f40 0x7fa04811fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa04e36b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa04809e870 0x7fa04811f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa04eb6c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048131f40 0x7fa04811fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34994/0 (socket says 172.21.15.154:34994) 2023-09-30T22:26:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa04e36b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa04809e870 0x7fa04811f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51544/0 (socket says 172.21.15.154:51544) 2023-09-30T22:26:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fa04eb6c700 1 -- 172.21.15.154:0/1552324320 learned_addr learned my addr 172.21.15.154:0/1552324320 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fee11ba0700 1 -- 172.21.15.154:0/3041403143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 msgr2=0x7fee0c1337b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.694+0000 7fee11ba0700 1 --2- 172.21.15.154:0/3041403143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c1337b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fee04009eb0 tx=0x7fee0400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa04eb6c700 1 -- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809f180 msgr2=0x7fa04811f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa04eb6c700 1 --2- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809f180 0x7fa04811f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa04eb6c700 1 -- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa04809e870 msgr2=0x7fa04811f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa04eb6c700 1 --2- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa04809e870 0x7fa04811f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa04eb6c700 1 -- 172.21.15.154:0/1552324320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009550 con 0x7fa048131f40 2023-09-30T22:26:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa04e36b700 1 --2- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa04809e870 0x7fa04811f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fee11ba0700 1 -- 172.21.15.154:0/3041403143 shutdown_connections 2023-09-30T22:26:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fee11ba0700 1 --2- 172.21.15.154:0/3041403143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c1302c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fee11ba0700 1 --2- 172.21.15.154:0/3041403143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c1337b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fee11ba0700 1 --2- 172.21.15.154:0/3041403143 >> v2:172.21.15.154:3300/0 conn(0x7fee0c12fdc0 0x7fee0c130800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fee11ba0700 1 -- 172.21.15.154:0/3041403143 >> 172.21.15.154:0/3041403143 conn(0x7fee0c09f810 msgr2=0x7fee0c09fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fee11ba0700 1 -- 172.21.15.154:0/3041403143 shutdown_connections 2023-09-30T22:26:07.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fee11ba0700 1 -- 172.21.15.154:0/3041403143 wait complete. 2023-09-30T22:26:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa04eb6c700 1 --2- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048131f40 0x7fa04811fd60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa04000b390 tx=0x7fa04000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa03effd700 1 -- 172.21.15.154:0/1552324320 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040015070 con 0x7fa048131f40 2023-09-30T22:26:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa03effd700 1 -- 172.21.15.154:0/1552324320 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04000bdc0 con 0x7fa048131f40 2023-09-30T22:26:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa03effd700 1 -- 172.21.15.154:0/1552324320 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040019630 con 0x7fa048131f40 2023-09-30T22:26:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa0505cf700 1 -- 172.21.15.154:0/1552324320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa048122590 con 0x7fa048131f40 2023-09-30T22:26:07.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.695+0000 7fa0505cf700 1 -- 172.21.15.154:0/1552324320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04809dba0 con 0x7fa048131f40 2023-09-30T22:26:07.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.696+0000 7fee11ba0700 1 Processor -- start 2023-09-30T22:26:07.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.696+0000 7fa03effd700 1 -- 172.21.15.154:0/1552324320 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0400223b0 con 0x7fa048131f40 2023-09-30T22:26:07.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.696+0000 7fa03effd700 1 -- 172.21.15.154:0/1552324320 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa0400435a0 con 0x7fa048131f40 2023-09-30T22:26:07.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.697+0000 7fa0505cf700 1 -- 172.21.15.154:0/1552324320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04804f2a0 con 0x7fa048131f40 2023-09-30T22:26:07.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.697+0000 7fee11ba0700 1 -- start start 2023-09-30T22:26:07.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.697+0000 7fee11ba0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06a770 0x7fee0c11cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.697+0000 7fee11ba0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c12fdc0 0x7fee0c1193c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.697+0000 7fee11ba0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c119900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.697+0000 7fee11ba0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c12d630 con 0x7fee0c06a770 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.697+0000 7fee11ba0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c11c710 con 0x7fee0c12fdc0 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.697+0000 7fee11ba0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c09bb30 con 0x7fee0c133330 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee10b9e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06a770 0x7fee0c11cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee10b9e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06a770 0x7fee0c11cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35008/0 (socket says 172.21.15.154:35008) 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee10b9e700 1 -- 172.21.15.154:0/1126754080 learned_addr learned my addr 172.21.15.154:0/1126754080 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee0bfff700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c12fdc0 0x7fee0c1193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee1139f700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c119900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee10b9e700 1 -- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 msgr2=0x7fee0c119900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee10b9e700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c119900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee10b9e700 1 -- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c12fdc0 msgr2=0x7fee0c1193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee10b9e700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c12fdc0 0x7fee0c1193c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee10b9e700 1 -- 172.21.15.154:0/1126754080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04009b30 con 0x7fee0c06a770 2023-09-30T22:26:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee1139f700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c119900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.698+0000 7fee10b9e700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06a770 0x7fee0c11cd70 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fedf800e9b0 tx=0x7fedf800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.702+0000 7fee097fa700 1 -- 172.21.15.154:0/1126754080 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8009710 con 0x7fee0c06a770 2023-09-30T22:26:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.702+0000 7fee097fa700 1 -- 172.21.15.154:0/1126754080 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf800c850 con 0x7fee0c06a770 2023-09-30T22:26:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.702+0000 7fee097fa700 1 -- 172.21.15.154:0/1126754080 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800cbc0 con 0x7fee0c06a770 2023-09-30T22:26:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.702+0000 7fee11ba0700 1 -- 172.21.15.154:0/1126754080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c12da20 con 0x7fee0c06a770 2023-09-30T22:26:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.702+0000 7fee11ba0700 1 -- 172.21.15.154:0/1126754080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c11b850 con 0x7fee0c06a770 2023-09-30T22:26:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.702+0000 7fa03effd700 1 -- 172.21.15.154:0/1552324320 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa040018370 con 0x7fa048131f40 2023-09-30T22:26:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.703+0000 7fee11ba0700 1 -- 172.21.15.154:0/1126754080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c071830 con 0x7fee0c06a770 2023-09-30T22:26:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.708+0000 7fee097fa700 1 -- 172.21.15.154:0/1126754080 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedf800cd20 con 0x7fee0c06a770 2023-09-30T22:26:07.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.708+0000 7fee097fa700 1 -- 172.21.15.154:0/1126754080 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fedf803fc70 con 0x7fee0c06a770 2023-09-30T22:26:07.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.713+0000 7fee097fa700 1 -- 172.21.15.154:0/1126754080 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedf801adc0 con 0x7fee0c06a770 2023-09-30T22:26:07.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.740+0000 7ff0e1587700 1 Processor -- start 2023-09-30T22:26:07.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.740+0000 7ff0e1587700 1 -- start start 2023-09-30T22:26:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0e1587700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0dc133ad0 0x7ff0dc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0e1587700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 0x7ff0dc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0e1587700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc06b2d0 con 0x7ff0dc1309f0 2023-09-30T22:26:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0e1587700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc133610 con 0x7ff0dc133ad0 2023-09-30T22:26:07.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0e1587700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc09a500 con 0x7ff0dc1300a0 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0db7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff0dc1309f0 0x7ff0dc13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37616/0 (socket says 172.21.15.154:37616) 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0db7fe700 1 -- 172.21.15.154:0/1093934864 learned_addr learned my addr 172.21.15.154:0/1093934864 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0daffd700 1 --2- 172.21.15.154:0/1093934864 >> v2:172.21.15.154:3300/0 conn(0x7ff0dc133ad0 0x7ff0dc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0da7fc700 1 --2- 172.21.15.154:0/1093934864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 0x7ff0dc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0daffd700 1 -- 172.21.15.154:0/1093934864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 msgr2=0x7ff0dc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0daffd700 1 --2- 172.21.15.154:0/1093934864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 0x7ff0dc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0daffd700 1 -- 172.21.15.154:0/1093934864 >> v1:172.21.15.154:6789/0 conn(0x7ff0dc1309f0 legacy=0x7ff0dc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0daffd700 1 -- 172.21.15.154:0/1093934864 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc1338b0 con 0x7ff0dc133ad0 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.741+0000 7ff0da7fc700 1 --2- 172.21.15.154:0/1093934864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 0x7ff0dc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.742+0000 7ff0daffd700 1 --2- 172.21.15.154:0/1093934864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 0x7ff0dc133ea0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009840 tx=0x7ff0cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608375ce2b4a22ca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.742+0000 7ff0d9ffb700 1 -- 172.21.15.154:0/1093934864 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc011830 con 0x7ff0dc133ad0 2023-09-30T22:26:07.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.742+0000 7ff0d9ffb700 1 -- 172.21.15.154:0/1093934864 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc011990 con 0x7ff0dc133ad0 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.742+0000 7ff0d9ffb700 1 -- 172.21.15.154:0/1093934864 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc011d20 con 0x7ff0dc133ad0 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.742+0000 7ff0e1587700 1 -- 172.21.15.154:0/1093934864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 msgr2=0x7ff0dc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.742+0000 7ff0e1587700 1 --2- 172.21.15.154:0/1093934864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 0x7ff0dc133ea0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009840 tx=0x7ff0cc009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.743+0000 7ff0e1587700 1 -- 172.21.15.154:0/1093934864 shutdown_connections 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.743+0000 7ff0e1587700 1 --2- 172.21.15.154:0/1093934864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 0x7ff0dc133ea0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.743+0000 7ff0e1587700 1 --2- 172.21.15.154:0/1093934864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 0x7ff0dc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.743+0000 7ff0e1587700 1 -- 172.21.15.154:0/1093934864 >> 172.21.15.154:0/1093934864 conn(0x7ff0dc099c40 msgr2=0x7ff0dc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.743+0000 7ff0e1587700 1 -- 172.21.15.154:0/1093934864 shutdown_connections 2023-09-30T22:26:07.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.743+0000 7ff0e1587700 1 -- 172.21.15.154:0/1093934864 wait complete. 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.744+0000 7ff0e1587700 1 Processor -- start 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.744+0000 7ff0e1587700 1 -- start start 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0e1587700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 0x7ff0dc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0e1587700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc1309f0 0x7ff0dc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0e1587700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 0x7ff0dc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0e1587700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc120b70 con 0x7ff0dc133ad0 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0e1587700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc072290 con 0x7ff0dc1309f0 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0e1587700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc11ff90 con 0x7ff0dc1300a0 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0da7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc1309f0 0x7ff0dc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0da7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc1309f0 0x7ff0dc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51570/0 (socket says 172.21.15.154:51570) 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0da7fc700 1 -- 172.21.15.154:0/3592238467 learned_addr learned my addr 172.21.15.154:0/3592238467 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0daffd700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 0x7ff0dc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0db7fe700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 0x7ff0dc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0db7fe700 1 -- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 msgr2=0x7ff0dc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0db7fe700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 0x7ff0dc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0db7fe700 1 -- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc1309f0 msgr2=0x7ff0dc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0db7fe700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc1309f0 0x7ff0dc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0db7fe700 1 -- 172.21.15.154:0/3592238467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00094a0 con 0x7ff0dc133ad0 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.745+0000 7ff0da7fc700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc1309f0 0x7ff0dc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.746+0000 7ff0db7fe700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 0x7ff0dc11e4c0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400caa0 tx=0x7ff0d400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.746+0000 7ff0c37fe700 1 -- 172.21.15.154:0/3592238467 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400a9e0 con 0x7ff0dc133ad0 2023-09-30T22:26:07.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.746+0000 7ff0c37fe700 1 -- 172.21.15.154:0/3592238467 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400ab40 con 0x7ff0dc133ad0 2023-09-30T22:26:07.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.746+0000 7ff0e1587700 1 -- 172.21.15.154:0/3592238467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc0094a0 con 0x7ff0dc133ad0 2023-09-30T22:26:07.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.746+0000 7ff0c37fe700 1 -- 172.21.15.154:0/3592238467 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4012400 con 0x7ff0dc133ad0 2023-09-30T22:26:07.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.746+0000 7ff0e1587700 1 -- 172.21.15.154:0/3592238467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc120250 con 0x7ff0dc133ad0 2023-09-30T22:26:07.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.747+0000 7ff0c37fe700 1 -- 172.21.15.154:0/3592238467 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0d401b3b0 con 0x7ff0dc133ad0 2023-09-30T22:26:07.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.747+0000 7ff0c37fe700 1 -- 172.21.15.154:0/3592238467 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff0d403efa0 con 0x7ff0dc133ad0 2023-09-30T22:26:07.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.748+0000 7ff0e1587700 1 -- 172.21.15.154:0/3592238467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc120250 con 0x7ff0dc133ad0 2023-09-30T22:26:07.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.752+0000 7ff0c37fe700 1 -- 172.21.15.154:0/3592238467 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0dc120250 con 0x7ff0dc133ad0 2023-09-30T22:26:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.887+0000 7fb668429700 1 -- 172.21.15.154:0/766877805 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb660072410 con 0x7fb660131980 2023-09-30T22:26:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.888+0000 7fb656ffd700 1 -- 172.21.15.154:0/766877805 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb660072410 con 0x7fb660131980 2023-09-30T22:26:07.889 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.890+0000 7fb668429700 1 -- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660131980 msgr2=0x7fb66009a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.890+0000 7fb668429700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660131980 0x7fb66009a930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00c750 tx=0x7fb65c00ca60 comp rx=0 tx=0).stop 2023-09-30T22:26:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.890+0000 7fb668429700 1 -- 172.21.15.154:0/766877805 shutdown_connections 2023-09-30T22:26:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.890+0000 7fb668429700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb660137000 0x7fb66009b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.890+0000 7fb668429700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb660131980 0x7fb66009a930 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.890+0000 7fb668429700 1 --2- 172.21.15.154:0/766877805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6601346e0 0x7fb66009ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.890+0000 7fb668429700 1 -- 172.21.15.154:0/766877805 >> 172.21.15.154:0/766877805 conn(0x7fb6600a2980 msgr2=0x7fb66012f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.890+0000 7fb668429700 1 -- 172.21.15.154:0/766877805 shutdown_connections 2023-09-30T22:26:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.890+0000 7fb668429700 1 -- 172.21.15.154:0/766877805 wait complete. 2023-09-30T22:26:07.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:07.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.909+0000 7fee11ba0700 1 -- 172.21.15.154:0/1126754080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fee0c11b4f0 con 0x7fee0c06a770 2023-09-30T22:26:07.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.910+0000 7fee097fa700 1 -- 172.21.15.154:0/1126754080 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedf8021070 con 0x7fee0c06a770 2023-09-30T22:26:07.911 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:07.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fee11ba0700 1 -- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06a770 msgr2=0x7fee0c11cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fa0505cf700 1 -- 172.21.15.154:0/1552324320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa048122be0 con 0x7fa048131f40 2023-09-30T22:26:07.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fee11ba0700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06a770 0x7fee0c11cd70 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fedf800e9b0 tx=0x7fedf800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fee11ba0700 1 -- 172.21.15.154:0/1126754080 shutdown_connections 2023-09-30T22:26:07.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fee11ba0700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c133330 0x7fee0c119900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fee11ba0700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06a770 0x7fee0c11cd70 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fee11ba0700 1 --2- 172.21.15.154:0/1126754080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c12fdc0 0x7fee0c1193c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fee11ba0700 1 -- 172.21.15.154:0/1126754080 >> 172.21.15.154:0/1126754080 conn(0x7fee0c09f810 msgr2=0x7fee0c09d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fee11ba0700 1 -- 172.21.15.154:0/1126754080 shutdown_connections 2023-09-30T22:26:07.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fee11ba0700 1 -- 172.21.15.154:0/1126754080 wait complete. 2023-09-30T22:26:07.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.912+0000 7fa03effd700 1 -- 172.21.15.154:0/1552324320 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa04001e020 con 0x7fa048131f40 2023-09-30T22:26:07.915 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:07.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.914+0000 7fa0505cf700 1 -- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048131f40 msgr2=0x7fa04811fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.914+0000 7fa0505cf700 1 --2- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048131f40 0x7fa04811fd60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa04000b390 tx=0x7fa04000b6a0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.914+0000 7fa0505cf700 1 -- 172.21.15.154:0/1552324320 shutdown_connections 2023-09-30T22:26:07.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.914+0000 7fa0505cf700 1 --2- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa048131f40 0x7fa04811fd60 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.914+0000 7fa0505cf700 1 --2- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa04809e870 0x7fa04811f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.914+0000 7fa0505cf700 1 --2- 172.21.15.154:0/1552324320 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa04809f180 0x7fa04811f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.914+0000 7fa0505cf700 1 -- 172.21.15.154:0/1552324320 >> 172.21.15.154:0/1552324320 conn(0x7fa0480a4430 msgr2=0x7fa0480a26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.915+0000 7fa0505cf700 1 -- 172.21.15.154:0/1552324320 shutdown_connections 2023-09-30T22:26:07.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.915+0000 7fa0505cf700 1 -- 172.21.15.154:0/1552324320 wait complete. 2023-09-30T22:26:07.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:07.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:07.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.948+0000 7ff0e1587700 1 -- 172.21.15.154:0/3592238467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff0dc120250 con 0x7ff0dc133ad0 2023-09-30T22:26:07.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.948+0000 7ff0c37fe700 1 -- 172.21.15.154:0/3592238467 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0dc120250 con 0x7ff0dc133ad0 2023-09-30T22:26:07.950 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:07.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.950+0000 7ff0e1587700 1 -- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 msgr2=0x7ff0dc11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:07.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.950+0000 7ff0e1587700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 0x7ff0dc11e4c0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400caa0 tx=0x7ff0d400cdb0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.950+0000 7ff0e1587700 1 -- 172.21.15.154:0/3592238467 shutdown_connections 2023-09-30T22:26:07.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.950+0000 7ff0e1587700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc133ad0 0x7ff0dc11e4c0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.950+0000 7ff0e1587700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc1300a0 0x7ff0dc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.950+0000 7ff0e1587700 1 --2- 172.21.15.154:0/3592238467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc1309f0 0x7ff0dc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:07.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.950+0000 7ff0e1587700 1 -- 172.21.15.154:0/3592238467 >> 172.21.15.154:0/3592238467 conn(0x7ff0dc099c40 msgr2=0x7ff0dc0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:07.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.951+0000 7ff0e1587700 1 -- 172.21.15.154:0/3592238467 shutdown_connections 2023-09-30T22:26:07.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:07.951+0000 7ff0e1587700 1 -- 172.21.15.154:0/3592238467 wait complete. 2023-09-30T22:26:07.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:08.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:08.927 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:08.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:08.964 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:09.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.056+0000 7f3a6d5db700 1 Processor -- start 2023-09-30T22:26:09.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.056+0000 7f3a6d5db700 1 -- start start 2023-09-30T22:26:09.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.057+0000 7f3a6d5db700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68131980 0x7f3a68131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.057+0000 7f3a6d5db700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a6809c790 0x7f3a68139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.057+0000 7f3a6d5db700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a680a1640 con 0x7f3a6809bc70 2023-09-30T22:26:09.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.057+0000 7f3a6d5db700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6806eb30 con 0x7f3a6809c790 2023-09-30T22:26:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.057+0000 7f3a6d5db700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680a22d0 con 0x7f3a68131980 2023-09-30T22:26:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.057+0000 7f3a677fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a6809c790 0x7f3a68139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.057+0000 7f3a667fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3a6809bc70 0x7f3a6809c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37632/0 (socket says 172.21.15.154:37632) 2023-09-30T22:26:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.057+0000 7f3a677fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a6809c790 0x7f3a68139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35038/0 (socket says 172.21.15.154:35038) 2023-09-30T22:26:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.057+0000 7f3a667fc700 1 -- 172.21.15.154:0/1262971358 learned_addr learned my addr 172.21.15.154:0/1262971358 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a66ffd700 1 --2- 172.21.15.154:0/1262971358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68131980 0x7f3a68131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a65ffb700 1 -- 172.21.15.154:0/1262971358 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907476849 0 0) 0x7f3a680a1640 con 0x7f3a6809bc70 2023-09-30T22:26:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a677fe700 1 -- 172.21.15.154:0/1262971358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68131980 msgr2=0x7f3a68131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:09.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a677fe700 1 --2- 172.21.15.154:0/1262971358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68131980 0x7f3a68131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a677fe700 1 -- 172.21.15.154:0/1262971358 >> v1:172.21.15.154:6789/0 conn(0x7f3a6809bc70 legacy=0x7f3a6809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a677fe700 1 -- 172.21.15.154:0/1262971358 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68131550 con 0x7f3a6809c790 2023-09-30T22:26:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a677fe700 1 --2- 172.21.15.154:0/1262971358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6809c790 0x7f3a68139710 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009d90 tx=0x7f3a6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ba60c02563eb2b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a65ffb700 1 -- 172.21.15.154:0/1262971358 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000e070 con 0x7f3a6809c790 2023-09-30T22:26:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a65ffb700 1 -- 172.21.15.154:0/1262971358 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6000bb20 con 0x7f3a6809c790 2023-09-30T22:26:09.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.058+0000 7f3a65ffb700 1 -- 172.21.15.154:0/1262971358 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60012430 con 0x7f3a6809c790 2023-09-30T22:26:09.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.059+0000 7f3a6d5db700 1 -- 172.21.15.154:0/1262971358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6809c790 msgr2=0x7f3a68139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.059+0000 7f3a6d5db700 1 --2- 172.21.15.154:0/1262971358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6809c790 0x7f3a68139710 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009d90 tx=0x7f3a6000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.059+0000 7f3a6d5db700 1 -- 172.21.15.154:0/1262971358 shutdown_connections 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.060+0000 7f3a6d5db700 1 --2- 172.21.15.154:0/1262971358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6809c790 0x7f3a68139710 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.060+0000 7f3a6d5db700 1 --2- 172.21.15.154:0/1262971358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a68131980 0x7f3a68131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.060+0000 7f3a6d5db700 1 -- 172.21.15.154:0/1262971358 >> 172.21.15.154:0/1262971358 conn(0x7f3a680a2980 msgr2=0x7f3a680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.060+0000 7f3a6d5db700 1 -- 172.21.15.154:0/1262971358 shutdown_connections 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.060+0000 7f3a6d5db700 1 -- 172.21.15.154:0/1262971358 wait complete. 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.061+0000 7f3a6d5db700 1 Processor -- start 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.061+0000 7f3a6d5db700 1 -- start start 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a6d5db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6811b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a6d5db700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6809c790 0x7f3a6811bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a6d5db700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a68131980 0x7f3a6811c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a6d5db700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6811d250 con 0x7f3a68131980 2023-09-30T22:26:09.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a6d5db700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680a1c40 con 0x7f3a6809c790 2023-09-30T22:26:09.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a6d5db700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6811f130 con 0x7f3a6809bc70 2023-09-30T22:26:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a66ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6811b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a66ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6811b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60716/0 (socket says 172.21.15.154:60716) 2023-09-30T22:26:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a677fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a68131980 0x7f3a6811c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a66ffd700 1 -- 172.21.15.154:0/802037937 learned_addr learned my addr 172.21.15.154:0/802037937 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:09.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a66ffd700 1 -- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6809c790 msgr2=0x7f3a6811bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a66ffd700 1 --2- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6809c790 0x7f3a6811bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a66ffd700 1 -- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a68131980 msgr2=0x7f3a6811c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a66ffd700 1 --2- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a68131980 0x7f3a6811c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.062+0000 7f3a66ffd700 1 -- 172.21.15.154:0/802037937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60009a70 con 0x7f3a6809bc70 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.063+0000 7f3a66ffd700 1 --2- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6811b730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009ca0 tx=0x7f3a5800ff20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.063+0000 7f3a4f7fe700 1 -- 172.21.15.154:0/802037937 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58013b40 con 0x7f3a6809bc70 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.063+0000 7f3a4f7fe700 1 -- 172.21.15.154:0/802037937 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a58015040 con 0x7f3a6809bc70 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.063+0000 7f3a4f7fe700 1 -- 172.21.15.154:0/802037937 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58013ea0 con 0x7f3a6809bc70 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.063+0000 7f3a6d5db700 1 -- 172.21.15.154:0/802037937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a68130af0 con 0x7f3a6809bc70 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.063+0000 7f3a6d5db700 1 -- 172.21.15.154:0/802037937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6811dfb0 con 0x7f3a6809bc70 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.064+0000 7f3a4f7fe700 1 -- 172.21.15.154:0/802037937 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a5801b400 con 0x7f3a6809bc70 2023-09-30T22:26:09.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.064+0000 7f3a4f7fe700 1 -- 172.21.15.154:0/802037937 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3a580435e0 con 0x7f3a6809bc70 2023-09-30T22:26:09.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.064+0000 7f3a6d5db700 1 -- 172.21.15.154:0/802037937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6804f2a0 con 0x7f3a6809bc70 2023-09-30T22:26:09.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.073+0000 7f3a4f7fe700 1 -- 172.21.15.154:0/802037937 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a580226d0 con 0x7f3a6809bc70 2023-09-30T22:26:09.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.086+0000 7f7c1c882700 1 Processor -- start 2023-09-30T22:26:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.086+0000 7f7c1c882700 1 -- start start 2023-09-30T22:26:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.086+0000 7f7c1c882700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.086+0000 7f7c1c882700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 0x7f7c1809f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.086+0000 7f7c1c882700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c1813c410 0x7f7c1813e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.086+0000 7f7c1c882700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1809a500 con 0x7f7c1813c410 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.086+0000 7f7c1c882700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1809f720 con 0x7f7c1809edb0 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.086+0000 7f7c1c882700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18072b30 con 0x7f7c1809a130 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c1659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c1659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60720/0 (socket says 172.21.15.154:60720) 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c1659c700 1 -- 172.21.15.154:0/285935643 learned_addr learned my addr 172.21.15.154:0/285935643 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c15d9b700 1 --2- 172.21.15.154:0/285935643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 0x7f7c1809f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c16d9d700 1 --2- 172.21.15.154:0/285935643 >> v2:172.21.15.154:3300/0 conn(0x7f7c1813c410 0x7f7c1813e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c15d9b700 1 -- 172.21.15.154:0/285935643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 msgr2=0x7f7c1809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c15d9b700 1 --2- 172.21.15.154:0/285935643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c15d9b700 1 -- 172.21.15.154:0/285935643 >> v2:172.21.15.154:3300/0 conn(0x7f7c1813c410 msgr2=0x7f7c1813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:09.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c15d9b700 1 --2- 172.21.15.154:0/285935643 >> v2:172.21.15.154:3300/0 conn(0x7f7c1813c410 0x7f7c1813e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c15d9b700 1 -- 172.21.15.154:0/285935643 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1809fe00 con 0x7f7c1809edb0 2023-09-30T22:26:09.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c15d9b700 1 --2- 172.21.15.154:0/285935643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 0x7f7c1809f1e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009870 tx=0x7f7c0c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27ce2cc78283b44c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.087+0000 7f7c1559a700 1 -- 172.21.15.154:0/285935643 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c011830 con 0x7f7c1809edb0 2023-09-30T22:26:09.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7f7c1559a700 1 -- 172.21.15.154:0/285935643 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c011990 con 0x7f7c1809edb0 2023-09-30T22:26:09.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7f7c1559a700 1 -- 172.21.15.154:0/285935643 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c011d20 con 0x7f7c1809edb0 2023-09-30T22:26:09.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7fe421903700 1 Processor -- start 2023-09-30T22:26:09.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7fe421903700 1 -- start start 2023-09-30T22:26:09.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7fe421903700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7fe421903700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe41c1300a0 0x7fe41c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe421903700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1309f0 0x7fe41c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe421903700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c06b2d0 con 0x7fe41c1300a0 2023-09-30T22:26:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe421903700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c133610 con 0x7fe41c1309f0 2023-09-30T22:26:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe421903700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c09a500 con 0x7fe41c133ad0 2023-09-30T22:26:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41a7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe41c1300a0 0x7fe41c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41a7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe41c1300a0 0x7fe41c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35070/0 (socket says 172.21.15.154:35070) 2023-09-30T22:26:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41a7fc700 1 -- 172.21.15.154:0/1092137572 learned_addr learned my addr 172.21.15.154:0/1092137572 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41b7fe700 1 --2- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1309f0 0x7fe41c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41affd700 1 --2- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7f7c1c882700 1 -- 172.21.15.154:0/285935643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 msgr2=0x7f7c1809f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7f7c1c882700 1 --2- 172.21.15.154:0/285935643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 0x7f7c1809f1e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009870 tx=0x7f7c0c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7f7c1c882700 1 -- 172.21.15.154:0/285935643 shutdown_connections 2023-09-30T22:26:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7f7c1c882700 1 --2- 172.21.15.154:0/285935643 >> v2:172.21.15.154:3300/0 conn(0x7f7c1813c410 0x7f7c1813e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.088+0000 7f7c1c882700 1 --2- 172.21.15.154:0/285935643 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7f7c1c882700 1 --2- 172.21.15.154:0/285935643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 0x7f7c1809f1e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7f7c1c882700 1 -- 172.21.15.154:0/285935643 >> 172.21.15.154:0/285935643 conn(0x7f7c180a4430 msgr2=0x7f7c180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7f7c1c882700 1 -- 172.21.15.154:0/285935643 shutdown_connections 2023-09-30T22:26:09.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7f7c1c882700 1 -- 172.21.15.154:0/285935643 wait complete. 2023-09-30T22:26:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41a7fc700 1 -- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 msgr2=0x7fe41c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41a7fc700 1 --2- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41a7fc700 1 -- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1309f0 msgr2=0x7fe41c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41a7fc700 1 --2- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1309f0 0x7fe41c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41a7fc700 1 -- 172.21.15.154:0/1092137572 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c1338b0 con 0x7fe41c1300a0 2023-09-30T22:26:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe41a7fc700 1 --2- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1300a0 0x7fe41c1304b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fe4100098f0 tx=0x7fe410009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b97c5a86430b4e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.089+0000 7fe419ffb700 1 -- 172.21.15.154:0/1092137572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410011830 con 0x7fe41c1300a0 2023-09-30T22:26:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe419ffb700 1 -- 172.21.15.154:0/1092137572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe410011990 con 0x7fe41c1300a0 2023-09-30T22:26:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe419ffb700 1 -- 172.21.15.154:0/1092137572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410011d20 con 0x7fe41c1300a0 2023-09-30T22:26:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe421903700 1 -- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1300a0 msgr2=0x7fe41c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe421903700 1 --2- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1300a0 0x7fe41c1304b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fe4100098f0 tx=0x7fe410009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe421903700 1 -- 172.21.15.154:0/1092137572 shutdown_connections 2023-09-30T22:26:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe421903700 1 --2- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1309f0 0x7fe41c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe421903700 1 --2- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe421903700 1 --2- 172.21.15.154:0/1092137572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1300a0 0x7fe41c1304b0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe421903700 1 -- 172.21.15.154:0/1092137572 >> 172.21.15.154:0/1092137572 conn(0x7fe41c099c40 msgr2=0x7fe41c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe421903700 1 -- 172.21.15.154:0/1092137572 shutdown_connections 2023-09-30T22:26:09.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7fe421903700 1 -- 172.21.15.154:0/1092137572 wait complete. 2023-09-30T22:26:09.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.090+0000 7f7c1c882700 1 Processor -- start 2023-09-30T22:26:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c1c882700 1 -- start start 2023-09-30T22:26:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c1c882700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1811d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c1c882700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 0x7f7c1813a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c1c882700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c1813c410 0x7f7c1813adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c1c882700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18120040 con 0x7f7c1813c410 2023-09-30T22:26:09.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7fe421903700 1 Processor -- start 2023-09-30T22:26:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c1c882700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180a00f0 con 0x7f7c1809edb0 2023-09-30T22:26:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c1c882700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180a38b0 con 0x7f7c1809a130 2023-09-30T22:26:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c16d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c1813c410 0x7f7c1813adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c16d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c1813c410 0x7f7c1813adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35080/0 (socket says 172.21.15.154:35080) 2023-09-30T22:26:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c16d9d700 1 -- 172.21.15.154:0/2458543127 learned_addr learned my addr 172.21.15.154:0/2458543127 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.091+0000 7f7c1659c700 1 --2- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1811d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7f7c16d9d700 1 -- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 msgr2=0x7f7c1811d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7f7c16d9d700 1 --2- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1811d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7f7c16d9d700 1 -- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 msgr2=0x7f7c1813a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7f7c16d9d700 1 --2- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 0x7f7c1813a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7f7c16d9d700 1 -- 172.21.15.154:0/2458543127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c0094a0 con 0x7f7c1813c410 2023-09-30T22:26:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7f7c1659c700 1 --2- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1811d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe421903700 1 -- start start 2023-09-30T22:26:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe421903700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1300a0 0x7fe41c11cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe421903700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1309f0 0x7fe41c11d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe421903700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe421903700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c12d8a0 con 0x7fe41c1309f0 2023-09-30T22:26:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe421903700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c12f800 con 0x7fe41c1300a0 2023-09-30T22:26:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe421903700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c12dd00 con 0x7fe41c133ad0 2023-09-30T22:26:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe41a7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1309f0 0x7fe41c11d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe41b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe41b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60750/0 (socket says 172.21.15.154:60750) 2023-09-30T22:26:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe41a7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1309f0 0x7fe41c11d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35086/0 (socket says 172.21.15.154:35086) 2023-09-30T22:26:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe41b7fe700 1 -- 172.21.15.154:0/1515147071 learned_addr learned my addr 172.21.15.154:0/1515147071 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7f7c16d9d700 1 --2- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c1813c410 0x7f7c1813adb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000efc0 tx=0x7f7c1000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.092+0000 7fe41affd700 1 --2- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1300a0 0x7fe41c11cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7fe41b7fe700 1 -- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1300a0 msgr2=0x7fe41c11cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7fe41b7fe700 1 --2- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1300a0 0x7fe41c11cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7fe41b7fe700 1 -- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1309f0 msgr2=0x7fe41c11d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7fe41b7fe700 1 --2- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1309f0 0x7fe41c11d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7fe41b7fe700 1 -- 172.21.15.154:0/1515147071 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410009550 con 0x7fe41c133ad0 2023-09-30T22:26:09.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7fe41affd700 1 --2- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1300a0 0x7fe41c11cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:09.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7f7c06ffd700 1 -- 172.21.15.154:0/2458543127 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10009ea0 con 0x7f7c1813c410 2023-09-30T22:26:09.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7fe41b7fe700 1 --2- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c119630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe41400efc0 tx=0x7fe41400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7f7c06ffd700 1 -- 172.21.15.154:0/2458543127 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1000f040 con 0x7f7c1813c410 2023-09-30T22:26:09.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7f7c06ffd700 1 -- 172.21.15.154:0/2458543127 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10014480 con 0x7f7c1813c410 2023-09-30T22:26:09.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7f7c1c882700 1 -- 172.21.15.154:0/2458543127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1811f660 con 0x7f7c1813c410 2023-09-30T22:26:09.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.093+0000 7f7c1c882700 1 -- 172.21.15.154:0/2458543127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c18120820 con 0x7f7c1813c410 2023-09-30T22:26:09.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.094+0000 7f7c1c882700 1 -- 172.21.15.154:0/2458543127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1804f2a0 con 0x7f7c1813c410 2023-09-30T22:26:09.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.094+0000 7f7c06ffd700 1 -- 172.21.15.154:0/2458543127 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c100145e0 con 0x7f7c1813c410 2023-09-30T22:26:09.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.094+0000 7f7c06ffd700 1 -- 172.21.15.154:0/2458543127 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c1003ffa0 con 0x7f7c1813c410 2023-09-30T22:26:09.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.094+0000 7fe403fff700 1 -- 172.21.15.154:0/1515147071 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414009ea0 con 0x7fe41c133ad0 2023-09-30T22:26:09.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.095+0000 7fe403fff700 1 -- 172.21.15.154:0/1515147071 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41400f040 con 0x7fe41c133ad0 2023-09-30T22:26:09.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.095+0000 7fe421903700 1 -- 172.21.15.154:0/1515147071 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c11c960 con 0x7fe41c133ad0 2023-09-30T22:26:09.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.095+0000 7fe403fff700 1 -- 172.21.15.154:0/1515147071 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414014480 con 0x7fe41c133ad0 2023-09-30T22:26:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.095+0000 7fe421903700 1 -- 172.21.15.154:0/1515147071 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c11baa0 con 0x7fe41c133ad0 2023-09-30T22:26:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.097+0000 7fe421903700 1 -- 172.21.15.154:0/1515147071 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c11b740 con 0x7fe41c133ad0 2023-09-30T22:26:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.098+0000 7fe403fff700 1 -- 172.21.15.154:0/1515147071 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4140145e0 con 0x7fe41c133ad0 2023-09-30T22:26:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.098+0000 7fe403fff700 1 -- 172.21.15.154:0/1515147071 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe414040780 con 0x7fe41c133ad0 2023-09-30T22:26:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.101+0000 7fe403fff700 1 -- 172.21.15.154:0/1515147071 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe414012930 con 0x7fe41c133ad0 2023-09-30T22:26:09.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.103+0000 7f7c06ffd700 1 -- 172.21.15.154:0/2458543127 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c1001a8b0 con 0x7f7c1813c410 2023-09-30T22:26:09.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.148+0000 7ff4ca459700 1 Processor -- start 2023-09-30T22:26:09.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.148+0000 7ff4ca459700 1 -- start start 2023-09-30T22:26:09.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4ca459700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4ca459700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4ca459700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c409dc00 con 0x7ff4c40a1380 2023-09-30T22:26:09.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4ca459700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c409ea90 con 0x7ff4c4134120 2023-09-30T22:26:09.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4ca459700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c409dec0 con 0x7ff4c40a0a70 2023-09-30T22:26:09.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c89f6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60752/0 (socket says 172.21.15.154:60752) 2023-09-30T22:26:09.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c89f6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51630/0 (socket says 172.21.15.154:51630) 2023-09-30T22:26:09.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c3fff700 1 -- 172.21.15.154:0/4111872195 learned_addr learned my addr 172.21.15.154:0/4111872195 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:09.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c3fff700 1 -- 172.21.15.154:0/4111872195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 msgr2=0x7ff4c413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:09.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c3fff700 1 --2- 172.21.15.154:0/4111872195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c3fff700 1 -- 172.21.15.154:0/4111872195 >> v1:172.21.15.154:6789/0 conn(0x7ff4c40a1380 legacy=0x7ff4c4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c3fff700 1 -- 172.21.15.154:0/4111872195 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c409e6a0 con 0x7ff4c40a0a70 2023-09-30T22:26:09.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.149+0000 7ff4c2ffd700 1 -- 172.21.15.154:0/4111872195 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762496282 0 0) 0x7ff4c409dc00 con 0x7ff4c40a1380 2023-09-30T22:26:09.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4c3fff700 1 --2- 172.21.15.154:0/4111872195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c40a0e40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009920 tx=0x7ff4b4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d18a93547b763b5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4c2ffd700 1 -- 172.21.15.154:0/4111872195 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4011830 con 0x7ff4c40a0a70 2023-09-30T22:26:09.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4c2ffd700 1 -- 172.21.15.154:0/4111872195 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4011990 con 0x7ff4c40a0a70 2023-09-30T22:26:09.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4c2ffd700 1 -- 172.21.15.154:0/4111872195 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4011d20 con 0x7ff4c40a0a70 2023-09-30T22:26:09.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4ca459700 1 -- 172.21.15.154:0/4111872195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 msgr2=0x7ff4c40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4ca459700 1 --2- 172.21.15.154:0/4111872195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c40a0e40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009920 tx=0x7ff4b4009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4ca459700 1 -- 172.21.15.154:0/4111872195 shutdown_connections 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4ca459700 1 --2- 172.21.15.154:0/4111872195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4ca459700 1 --2- 172.21.15.154:0/4111872195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c40a0e40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.150+0000 7ff4ca459700 1 -- 172.21.15.154:0/4111872195 >> 172.21.15.154:0/4111872195 conn(0x7ff4c40a6610 msgr2=0x7ff4c40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.151+0000 7ff4ca459700 1 -- 172.21.15.154:0/4111872195 shutdown_connections 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.151+0000 7ff4ca459700 1 -- 172.21.15.154:0/4111872195 wait complete. 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.152+0000 7ff4ca459700 1 Processor -- start 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.152+0000 7ff4ca459700 1 -- start start 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4ca459700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c41228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4ca459700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4c40a1380 0x7ff4c4122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4ca459700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c4123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:09.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4ca459700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41260c0 con 0x7ff4c40a1380 2023-09-30T22:26:09.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4ca459700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41245a0 con 0x7ff4c4134120 2023-09-30T22:26:09.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4ca459700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40a5600 con 0x7ff4c40a0a70 2023-09-30T22:26:09.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c41228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c41228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60768/0 (socket says 172.21.15.154:60768) 2023-09-30T22:26:09.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c3fff700 1 -- 172.21.15.154:0/1466582981 learned_addr learned my addr 172.21.15.154:0/1466582981 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c37fe700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4c40a1380 0x7ff4c4122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c89f6700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c4123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c3fff700 1 -- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 msgr2=0x7ff4c4123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c3fff700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c4123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c3fff700 1 -- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4c40a1380 msgr2=0x7ff4c4122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c3fff700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4c40a1380 0x7ff4c4122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c3fff700 1 -- 172.21.15.154:0/1466582981 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4009550 con 0x7ff4c40a0a70 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c37fe700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4c40a1380 0x7ff4c4122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.153+0000 7ff4c89f6700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c4123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.154+0000 7ff4c3fff700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c41228d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4000c00 tx=0x7ff4b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:09.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.154+0000 7ff4c0ff9700 1 -- 172.21.15.154:0/1466582981 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40044d0 con 0x7ff4c40a0a70 2023-09-30T22:26:09.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.154+0000 7ff4c0ff9700 1 -- 172.21.15.154:0/1466582981 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b401f070 con 0x7ff4c40a0a70 2023-09-30T22:26:09.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.154+0000 7ff4ca459700 1 -- 172.21.15.154:0/1466582981 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c40a03e0 con 0x7ff4c40a0a70 2023-09-30T22:26:09.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.154+0000 7ff4c0ff9700 1 -- 172.21.15.154:0/1466582981 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40038c0 con 0x7ff4c40a0a70 2023-09-30T22:26:09.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.154+0000 7ff4ca459700 1 -- 172.21.15.154:0/1466582981 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c4126b30 con 0x7ff4c40a0a70 2023-09-30T22:26:09.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.155+0000 7ff4c0ff9700 1 -- 172.21.15.154:0/1466582981 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4b4003a20 con 0x7ff4c40a0a70 2023-09-30T22:26:09.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.155+0000 7ff4c0ff9700 1 -- 172.21.15.154:0/1466582981 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff4b4021070 con 0x7ff4c40a0a70 2023-09-30T22:26:09.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.155+0000 7ff4ca459700 1 -- 172.21.15.154:0/1466582981 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c404f2a0 con 0x7ff4c40a0a70 2023-09-30T22:26:09.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.164+0000 7ff4c0ff9700 1 -- 172.21.15.154:0/1466582981 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4b4015020 con 0x7ff4c40a0a70 2023-09-30T22:26:09.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.286+0000 7f3a6d5db700 1 -- 172.21.15.154:0/802037937 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3a6806bce0 con 0x7f3a6809bc70 2023-09-30T22:26:09.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.287+0000 7f3a4f7fe700 1 -- 172.21.15.154:0/802037937 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a58023360 con 0x7f3a6809bc70 2023-09-30T22:26:09.288 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:09.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.290+0000 7f3a6d5db700 1 -- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 msgr2=0x7f3a6811b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.290+0000 7f3a6d5db700 1 --2- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6811b730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009ca0 tx=0x7f3a5800ff20 comp rx=0 tx=0).stop 2023-09-30T22:26:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.290+0000 7f3a6d5db700 1 -- 172.21.15.154:0/802037937 shutdown_connections 2023-09-30T22:26:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.290+0000 7f3a6d5db700 1 --2- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a68131980 0x7f3a6811c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.290+0000 7f3a6d5db700 1 --2- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3a6809bc70 0x7f3a6811b730 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.290+0000 7f3a6d5db700 1 --2- 172.21.15.154:0/802037937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6809c790 0x7f3a6811bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.290+0000 7f3a6d5db700 1 -- 172.21.15.154:0/802037937 >> 172.21.15.154:0/802037937 conn(0x7f3a680a2980 msgr2=0x7f3a68071720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.290+0000 7f3a6d5db700 1 -- 172.21.15.154:0/802037937 shutdown_connections 2023-09-30T22:26:09.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.290+0000 7f3a6d5db700 1 -- 172.21.15.154:0/802037937 wait complete. 2023-09-30T22:26:09.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:09.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.309+0000 7f7c1c882700 1 -- 172.21.15.154:0/2458543127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c1809ad70 con 0x7f7c1813c410 2023-09-30T22:26:09.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.309+0000 7f7c06ffd700 1 -- 172.21.15.154:0/2458543127 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c10018070 con 0x7f7c1813c410 2023-09-30T22:26:09.310 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:09.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.311+0000 7f7c1c882700 1 -- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c1813c410 msgr2=0x7f7c1813adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.311+0000 7f7c1c882700 1 --2- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c1813c410 0x7f7c1813adb0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000efc0 tx=0x7f7c1000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.311+0000 7f7c1c882700 1 -- 172.21.15.154:0/2458543127 shutdown_connections 2023-09-30T22:26:09.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.312+0000 7f7c1c882700 1 --2- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c1813c410 0x7f7c1813adb0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.312+0000 7f7c1c882700 1 --2- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c1809a130 0x7f7c1811d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.312+0000 7f7c1c882700 1 --2- 172.21.15.154:0/2458543127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c1809edb0 0x7f7c1813a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.312+0000 7f7c1c882700 1 -- 172.21.15.154:0/2458543127 >> 172.21.15.154:0/2458543127 conn(0x7f7c180a4430 msgr2=0x7f7c180a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.312+0000 7f7c1c882700 1 -- 172.21.15.154:0/2458543127 shutdown_connections 2023-09-30T22:26:09.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.312+0000 7f7c1c882700 1 -- 172.21.15.154:0/2458543127 wait complete. 2023-09-30T22:26:09.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:09.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.359+0000 7fe421903700 1 -- 172.21.15.154:0/1515147071 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe41c04f2a0 con 0x7fe41c133ad0 2023-09-30T22:26:09.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.359+0000 7fe403fff700 1 -- 172.21.15.154:0/1515147071 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe414018020 con 0x7fe41c133ad0 2023-09-30T22:26:09.360 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:09.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.361+0000 7fe421903700 1 -- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 msgr2=0x7fe41c119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.361+0000 7fe421903700 1 --2- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c119630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe41400efc0 tx=0x7fe41400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.361+0000 7fe421903700 1 -- 172.21.15.154:0/1515147071 shutdown_connections 2023-09-30T22:26:09.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.361+0000 7fe421903700 1 --2- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe41c133ad0 0x7fe41c119630 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.361+0000 7fe421903700 1 --2- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe41c1300a0 0x7fe41c11cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.361+0000 7fe421903700 1 --2- 172.21.15.154:0/1515147071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe41c1309f0 0x7fe41c11d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.361+0000 7fe421903700 1 -- 172.21.15.154:0/1515147071 >> 172.21.15.154:0/1515147071 conn(0x7fe41c099c40 msgr2=0x7fe41c12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.362+0000 7fe421903700 1 -- 172.21.15.154:0/1515147071 shutdown_connections 2023-09-30T22:26:09.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.362+0000 7fe421903700 1 -- 172.21.15.154:0/1515147071 wait complete. 2023-09-30T22:26:09.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:09.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.410+0000 7ff4ca459700 1 -- 172.21.15.154:0/1466582981 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4c4072980 con 0x7ff4c40a0a70 2023-09-30T22:26:09.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.410+0000 7ff4c0ff9700 1 -- 172.21.15.154:0/1466582981 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4b401a950 con 0x7ff4c40a0a70 2023-09-30T22:26:09.411 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.412+0000 7ff4ca459700 1 -- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 msgr2=0x7ff4c41228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.412+0000 7ff4ca459700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c41228d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4000c00 tx=0x7ff4b4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.412+0000 7ff4ca459700 1 -- 172.21.15.154:0/1466582981 shutdown_connections 2023-09-30T22:26:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.412+0000 7ff4ca459700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4c4134120 0x7ff4c4123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.412+0000 7ff4ca459700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4c40a0a70 0x7ff4c41228d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.412+0000 7ff4ca459700 1 --2- 172.21.15.154:0/1466582981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4c40a1380 0x7ff4c4122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:09.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.412+0000 7ff4ca459700 1 -- 172.21.15.154:0/1466582981 >> 172.21.15.154:0/1466582981 conn(0x7ff4c40a6610 msgr2=0x7ff4c40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:09.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.412+0000 7ff4ca459700 1 -- 172.21.15.154:0/1466582981 shutdown_connections 2023-09-30T22:26:09.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:09.412+0000 7ff4ca459700 1 -- 172.21.15.154:0/1466582981 wait complete. 2023-09-30T22:26:09.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:10.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:10.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:10.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:10.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.457+0000 7f4fdb016700 1 Processor -- start 2023-09-30T22:26:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.457+0000 7f4fdb016700 1 -- start start 2023-09-30T22:26:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.458+0000 7f4fdb016700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd40a1510 0x7f4fd41351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.458+0000 7f4fdb016700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd41356e0 0x7f4fd4137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.458+0000 7f4fdb016700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd40a1e70 con 0x7f4fd40a0a30 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.458+0000 7f4fdb016700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd409a720 con 0x7f4fd41356e0 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.458+0000 7f4fdb016700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd409b300 con 0x7f4fd40a1510 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.458+0000 7f4fd3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd40a1510 0x7f4fd41351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.458+0000 7f4fd3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd40a1510 0x7f4fd41351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60782/0 (socket says 172.21.15.154:60782) 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd3fff700 1 -- 172.21.15.154:0/3477274588 learned_addr learned my addr 172.21.15.154:0/3477274588 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd95b3700 1 --2- 172.21.15.154:0/3477274588 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd41356e0 0x7f4fd4137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd3fff700 1 -- 172.21.15.154:0/3477274588 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd41356e0 msgr2=0x7f4fd4137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd3fff700 1 --2- 172.21.15.154:0/3477274588 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd41356e0 0x7f4fd4137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd3fff700 1 -- 172.21.15.154:0/3477274588 >> v1:172.21.15.154:6789/0 conn(0x7f4fd40a0a30 legacy=0x7f4fd40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd37fe700 1 -- 172.21.15.154:0/3477274588 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078954914 0 0) 0x7f4fd40a1e70 con 0x7f4fd40a0a30 2023-09-30T22:26:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd3fff700 1 -- 172.21.15.154:0/3477274588 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd409abc0 con 0x7f4fd40a1510 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd3fff700 1 --2- 172.21.15.154:0/3477274588 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd40a1510 0x7f4fd41351a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009920 tx=0x7f4fc0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=171aafdad5b43fa8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd37fe700 1 -- 172.21.15.154:0/3477274588 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0011830 con 0x7f4fd40a1510 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd37fe700 1 -- 172.21.15.154:0/3477274588 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc0011990 con 0x7f4fd40a1510 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.459+0000 7f4fd37fe700 1 -- 172.21.15.154:0/3477274588 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0011d20 con 0x7f4fd40a1510 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.460+0000 7f4fdb016700 1 -- 172.21.15.154:0/3477274588 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd40a1510 msgr2=0x7f4fd41351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.460+0000 7f4fdb016700 1 --2- 172.21.15.154:0/3477274588 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd40a1510 0x7f4fd41351a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009920 tx=0x7f4fc0009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.460+0000 7f4fdb016700 1 -- 172.21.15.154:0/3477274588 shutdown_connections 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.460+0000 7f4fdb016700 1 --2- 172.21.15.154:0/3477274588 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd41356e0 0x7f4fd4137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.460+0000 7f4fdb016700 1 --2- 172.21.15.154:0/3477274588 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd40a1510 0x7f4fd41351a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.460+0000 7f4fdb016700 1 -- 172.21.15.154:0/3477274588 >> 172.21.15.154:0/3477274588 conn(0x7f4fd40a2980 msgr2=0x7f4fd40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.460+0000 7f4fdb016700 1 -- 172.21.15.154:0/3477274588 shutdown_connections 2023-09-30T22:26:10.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.460+0000 7f4fdb016700 1 -- 172.21.15.154:0/3477274588 wait complete. 2023-09-30T22:26:10.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.462+0000 7f4fdb016700 1 Processor -- start 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.462+0000 7f4fdb016700 1 -- start start 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fdb016700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd40a0a30 0x7f4fd4137d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fdb016700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd40a1510 0x7f4fd4138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fdb016700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd41356e0 0x7f4fd41387a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fdb016700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4139160 con 0x7f4fd40a1510 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fdb016700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4135060 con 0x7f4fd40a0a30 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fdb016700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd412f790 con 0x7f4fd41356e0 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd95b3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd41356e0 0x7f4fd41387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd95b3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd41356e0 0x7f4fd41387a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60796/0 (socket says 172.21.15.154:60796) 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd95b3700 1 -- 172.21.15.154:0/2345613905 learned_addr learned my addr 172.21.15.154:0/2345613905 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd8db2700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd40a0a30 0x7f4fd4137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd3fff700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd40a1510 0x7f4fd4138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd95b3700 1 -- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd40a0a30 msgr2=0x7f4fd4137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd95b3700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd40a0a30 0x7f4fd4137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd95b3700 1 -- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd40a1510 msgr2=0x7f4fd4138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd95b3700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd40a1510 0x7f4fd4138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd95b3700 1 -- 172.21.15.154:0/2345613905 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0009550 con 0x7f4fd41356e0 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd3fff700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd40a1510 0x7f4fd4138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.463+0000 7f4fd95b3700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd41356e0 0x7f4fd41387a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00efc0 tx=0x7f4fcc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.464+0000 7f4fd17fa700 1 -- 172.21.15.154:0/2345613905 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc00cd40 con 0x7f4fd41356e0 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.464+0000 7f4fdb016700 1 -- 172.21.15.154:0/2345613905 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd4130b50 con 0x7f4fd41356e0 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.464+0000 7f4fd17fa700 1 -- 172.21.15.154:0/2345613905 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc00f040 con 0x7f4fd41356e0 2023-09-30T22:26:10.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.464+0000 7f4fd17fa700 1 -- 172.21.15.154:0/2345613905 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0146c0 con 0x7f4fd41356e0 2023-09-30T22:26:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.464+0000 7f4fdb016700 1 -- 172.21.15.154:0/2345613905 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd412f9d0 con 0x7f4fd41356e0 2023-09-30T22:26:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.465+0000 7f4fd17fa700 1 -- 172.21.15.154:0/2345613905 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fcc014820 con 0x7f4fd41356e0 2023-09-30T22:26:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.465+0000 7f4fd17fa700 1 -- 172.21.15.154:0/2345613905 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4fcc040360 con 0x7f4fd41356e0 2023-09-30T22:26:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.465+0000 7f4fdb016700 1 -- 172.21.15.154:0/2345613905 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd4130f20 con 0x7f4fd41356e0 2023-09-30T22:26:10.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.470+0000 7f4fd17fa700 1 -- 172.21.15.154:0/2345613905 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fcc018020 con 0x7f4fd41356e0 2023-09-30T22:26:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.503+0000 7f063f550700 1 Processor -- start 2023-09-30T22:26:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.503+0000 7f063f550700 1 -- start start 2023-09-30T22:26:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063f550700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134140 0x7f0638138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063f550700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134570 0x7f063813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063f550700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063809b110 con 0x7f063809ad40 2023-09-30T22:26:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063f550700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06380a3b60 con 0x7f0638134140 2023-09-30T22:26:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063f550700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06380a1a80 con 0x7f0638134570 2023-09-30T22:26:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063daed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134570 0x7f063813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063caeb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134140 0x7f0638138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063d2ec700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f063809ad40 0x7f0638133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37652/0 (socket says 172.21.15.154:37652) 2023-09-30T22:26:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063d2ec700 1 -- 172.21.15.154:0/2096678925 learned_addr learned my addr 172.21.15.154:0/2096678925 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063daed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134570 0x7f063813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60800/0 (socket says 172.21.15.154:60800) 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063daed700 1 -- 172.21.15.154:0/2096678925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134140 msgr2=0x7f0638138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063daed700 1 --2- 172.21.15.154:0/2096678925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134140 0x7f0638138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063daed700 1 -- 172.21.15.154:0/2096678925 >> v1:172.21.15.154:6789/0 conn(0x7f063809ad40 legacy=0x7f0638133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.504+0000 7f063daed700 1 -- 172.21.15.154:0/2096678925 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380a2fa0 con 0x7f0638134570 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.505+0000 7f063caeb700 1 --2- 172.21.15.154:0/2096678925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134140 0x7f0638138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.505+0000 7f063daed700 1 --2- 172.21.15.154:0/2096678925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134570 0x7f063813b3d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0630009dc0 tx=0x7f063000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dab913adeea92bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.505+0000 7f062ffff700 1 -- 172.21.15.154:0/2096678925 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000e070 con 0x7f0638134570 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.505+0000 7f062ffff700 1 -- 172.21.15.154:0/2096678925 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063000bae0 con 0x7f0638134570 2023-09-30T22:26:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.505+0000 7f062ffff700 1 -- 172.21.15.154:0/2096678925 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000be90 con 0x7f0638134570 2023-09-30T22:26:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.506+0000 7f063f550700 1 -- 172.21.15.154:0/2096678925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134570 msgr2=0x7f063813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.506+0000 7f063f550700 1 --2- 172.21.15.154:0/2096678925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134570 0x7f063813b3d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0630009dc0 tx=0x7f063000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.506+0000 7f063f550700 1 -- 172.21.15.154:0/2096678925 shutdown_connections 2023-09-30T22:26:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.506+0000 7f063f550700 1 --2- 172.21.15.154:0/2096678925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134570 0x7f063813b3d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.506+0000 7f063f550700 1 --2- 172.21.15.154:0/2096678925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134140 0x7f0638138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.506+0000 7f063f550700 1 -- 172.21.15.154:0/2096678925 >> 172.21.15.154:0/2096678925 conn(0x7f0638099c40 msgr2=0x7f063806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.506+0000 7f063f550700 1 -- 172.21.15.154:0/2096678925 shutdown_connections 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.506+0000 7f063f550700 1 -- 172.21.15.154:0/2096678925 wait complete. 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.507+0000 7f063f550700 1 Processor -- start 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.507+0000 7f063f550700 1 -- start start 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063f550700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f063809ad40 0x7f063811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063f550700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134140 0x7f063811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063f550700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134570 0x7f063811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063f550700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063811ef00 con 0x7f063809ad40 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063f550700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063811e960 con 0x7f0638134570 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063f550700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f063809c7e0 con 0x7f0638134140 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063caeb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134140 0x7f063811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063caeb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134140 0x7f063811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60814/0 (socket says 172.21.15.154:60814) 2023-09-30T22:26:10.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063caeb700 1 -- 172.21.15.154:0/2856327371 learned_addr learned my addr 172.21.15.154:0/2856327371 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:10.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063d2ec700 1 --2- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f063809ad40 0x7f063811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063daed700 1 --2- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134570 0x7f063811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063caeb700 1 -- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134570 msgr2=0x7f063811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063caeb700 1 --2- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134570 0x7f063811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063caeb700 1 -- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f063809ad40 msgr2=0x7f063811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063caeb700 1 --2- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f063809ad40 0x7f063811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.508+0000 7f063caeb700 1 -- 172.21.15.154:0/2856327371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06280094a0 con 0x7f0638134140 2023-09-30T22:26:10.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.509+0000 7f063caeb700 1 --2- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134140 0x7f063811ce00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f062800ebe0 tx=0x7f062800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.509+0000 7f062dffb700 1 -- 172.21.15.154:0/2856327371 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628009800 con 0x7f0638134140 2023-09-30T22:26:10.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.509+0000 7f063f550700 1 -- 172.21.15.154:0/2856327371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0630009a70 con 0x7f0638134140 2023-09-30T22:26:10.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.509+0000 7f062dffb700 1 -- 172.21.15.154:0/2856327371 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800c910 con 0x7f0638134140 2023-09-30T22:26:10.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.509+0000 7f062dffb700 1 -- 172.21.15.154:0/2856327371 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800cc80 con 0x7f0638134140 2023-09-30T22:26:10.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.509+0000 7f063f550700 1 -- 172.21.15.154:0/2856327371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063809e720 con 0x7f0638134140 2023-09-30T22:26:10.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.510+0000 7f062dffb700 1 -- 172.21.15.154:0/2856327371 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0628013470 con 0x7f0638134140 2023-09-30T22:26:10.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.510+0000 7f062dffb700 1 -- 172.21.15.154:0/2856327371 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0628040060 con 0x7f0638134140 2023-09-30T22:26:10.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.510+0000 7f063f550700 1 -- 172.21.15.154:0/2856327371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06381361e0 con 0x7f0638134140 2023-09-30T22:26:10.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.519+0000 7f062dffb700 1 -- 172.21.15.154:0/2856327371 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0628017080 con 0x7f0638134140 2023-09-30T22:26:10.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.532+0000 7fb62fc48700 1 Processor -- start 2023-09-30T22:26:10.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.533+0000 7fb62fc48700 1 -- start start 2023-09-30T22:26:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.533+0000 7fb62fc48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 0x7fb628138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.533+0000 7fb62fc48700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6280a08e0 0x7fb6280a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.533+0000 7fb62fc48700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6281379e0 con 0x7fb6280a1230 2023-09-30T22:26:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.533+0000 7fb62fc48700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6280a2100 con 0x7fb6280a08e0 2023-09-30T22:26:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.533+0000 7fb62fc48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb628138950 con 0x7fb628138040 2023-09-30T22:26:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.533+0000 7fb62d1e3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6280a08e0 0x7fb6280a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.533+0000 7fb62d1e3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6280a08e0 0x7fb6280a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35120/0 (socket says 172.21.15.154:35120) 2023-09-30T22:26:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.533+0000 7fb62d1e3700 1 -- 172.21.15.154:0/4032197197 learned_addr learned my addr 172.21.15.154:0/4032197197 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:10.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.534+0000 7fb62d1e3700 1 -- 172.21.15.154:0/4032197197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 msgr2=0x7fb628138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.534+0000 7fb62d9e4700 1 --2- 172.21.15.154:0/4032197197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 0x7fb628138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.534+0000 7fb62d1e3700 1 --2- 172.21.15.154:0/4032197197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 0x7fb628138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.534+0000 7fb62d1e3700 1 -- 172.21.15.154:0/4032197197 >> v1:172.21.15.154:6789/0 conn(0x7fb6280a1230 legacy=0x7fb62813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.534+0000 7fb62d1e3700 1 -- 172.21.15.154:0/4032197197 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62809b9b0 con 0x7fb6280a08e0 2023-09-30T22:26:10.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.534+0000 7fb62d9e4700 1 --2- 172.21.15.154:0/4032197197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 0x7fb628138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:10.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.534+0000 7fb62d1e3700 1 --2- 172.21.15.154:0/4032197197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a08e0 0x7fb6280a0cf0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fb618009920 tx=0x7fb618009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252c82de05d6179a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.536+0000 7fb62c9e2700 1 -- 172.21.15.154:0/4032197197 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61800ba20 con 0x7fb6280a08e0 2023-09-30T22:26:10.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.536+0000 7fb62c9e2700 1 -- 172.21.15.154:0/4032197197 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61800bb80 con 0x7fb6280a08e0 2023-09-30T22:26:10.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.536+0000 7fb62c9e2700 1 -- 172.21.15.154:0/4032197197 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618009e70 con 0x7fb6280a08e0 2023-09-30T22:26:10.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.536+0000 7fb62fc48700 1 -- 172.21.15.154:0/4032197197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a08e0 msgr2=0x7fb6280a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.536+0000 7fb62fc48700 1 --2- 172.21.15.154:0/4032197197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a08e0 0x7fb6280a0cf0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fb618009920 tx=0x7fb618009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:10.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.537+0000 7fb62fc48700 1 -- 172.21.15.154:0/4032197197 shutdown_connections 2023-09-30T22:26:10.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.537+0000 7fb62fc48700 1 --2- 172.21.15.154:0/4032197197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 0x7fb628138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.537+0000 7fb62fc48700 1 --2- 172.21.15.154:0/4032197197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a08e0 0x7fb6280a0cf0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.537+0000 7fb62fc48700 1 -- 172.21.15.154:0/4032197197 >> 172.21.15.154:0/4032197197 conn(0x7fb6280a2980 msgr2=0x7fb6280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.537+0000 7fb62fc48700 1 -- 172.21.15.154:0/4032197197 shutdown_connections 2023-09-30T22:26:10.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.537+0000 7fb62fc48700 1 -- 172.21.15.154:0/4032197197 wait complete. 2023-09-30T22:26:10.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.538+0000 7fb62fc48700 1 Processor -- start 2023-09-30T22:26:10.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.538+0000 7fb62fc48700 1 -- start start 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62fc48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6280a08e0 0x7fb6281370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62fc48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a1230 0x7fb628135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62fc48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 0x7fb628135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62fc48700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628119000 con 0x7fb6280a1230 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62fc48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62813f8c0 con 0x7fb628138040 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62fc48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb62812ffb0 con 0x7fb6280a08e0 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d1e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a1230 0x7fb628135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d1e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a1230 0x7fb628135850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35136/0 (socket says 172.21.15.154:35136) 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d1e3700 1 -- 172.21.15.154:0/2417703676 learned_addr learned my addr 172.21.15.154:0/2417703676 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:10.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62e1e5700 1 --2- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 0x7fb628135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d9e4700 1 --2- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6280a08e0 0x7fb6281370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d1e3700 1 -- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6280a08e0 msgr2=0x7fb6281370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d1e3700 1 --2- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6280a08e0 0x7fb6281370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d1e3700 1 -- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 msgr2=0x7fb628135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d1e3700 1 --2- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 0x7fb628135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d1e3700 1 -- 172.21.15.154:0/2417703676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb618009550 con 0x7fb6280a1230 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.539+0000 7fb62d1e3700 1 --2- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a1230 0x7fb628135850 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb618000c00 tx=0x7fb618004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.540+0000 7fb61e7fc700 1 -- 172.21.15.154:0/2417703676 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6180036a0 con 0x7fb6280a1230 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.540+0000 7fb61e7fc700 1 -- 172.21.15.154:0/2417703676 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61801e070 con 0x7fb6280a1230 2023-09-30T22:26:10.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.540+0000 7fb61e7fc700 1 -- 172.21.15.154:0/2417703676 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618003a40 con 0x7fb6280a1230 2023-09-30T22:26:10.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.540+0000 7fb62fc48700 1 -- 172.21.15.154:0/2417703676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb628140240 con 0x7fb6280a1230 2023-09-30T22:26:10.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.540+0000 7fb62fc48700 1 -- 172.21.15.154:0/2417703676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62813eff0 con 0x7fb6280a1230 2023-09-30T22:26:10.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.541+0000 7fb60bfff700 1 -- 172.21.15.154:0/2417703676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6040052e0 con 0x7fb6280a1230 2023-09-30T22:26:10.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.543+0000 7fb61e7fc700 1 -- 172.21.15.154:0/2417703676 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb618003ba0 con 0x7fb6280a1230 2023-09-30T22:26:10.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.543+0000 7fb61e7fc700 1 -- 172.21.15.154:0/2417703676 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb618020070 con 0x7fb6280a1230 2023-09-30T22:26:10.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.546+0000 7fb61e7fc700 1 -- 172.21.15.154:0/2417703676 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb61802e3a0 con 0x7fb6280a1230 2023-09-30T22:26:10.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.573+0000 7f0898874700 1 Processor -- start 2023-09-30T22:26:10.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.573+0000 7f0898874700 1 -- start start 2023-09-30T22:26:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0898874700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409a580 0x7f0894135b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0898874700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f089409e2d0 0x7f08941380d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0898874700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089409bca0 con 0x7f089409d7f0 2023-09-30T22:26:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0898874700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089409ac80 con 0x7f089409e2d0 2023-09-30T22:26:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0898874700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089409b700 con 0x7f089409a580 2023-09-30T22:26:10.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0892d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f089409e2d0 0x7f08941380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0891d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409a580 0x7f0894135b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0891d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409a580 0x7f0894135b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51716/0 (socket says 172.21.15.154:51716) 2023-09-30T22:26:10.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0891d9b700 1 -- 172.21.15.154:0/3911039618 learned_addr learned my addr 172.21.15.154:0/3911039618 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:10.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.574+0000 7f0892d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f089409e2d0 0x7f08941380d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35146/0 (socket says 172.21.15.154:35146) 2023-09-30T22:26:10.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f0891d9b700 1 -- 172.21.15.154:0/3911039618 >> v2:172.21.15.154:3300/0 conn(0x7f089409e2d0 msgr2=0x7f08941380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f0891d9b700 1 --2- 172.21.15.154:0/3911039618 >> v2:172.21.15.154:3300/0 conn(0x7f089409e2d0 0x7f08941380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f089159a700 1 -- 172.21.15.154:0/3911039618 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189813206 0 0) 0x7f089409bca0 con 0x7f089409d7f0 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f0891d9b700 1 -- 172.21.15.154:0/3911039618 >> v1:172.21.15.154:6789/0 conn(0x7f089409d7f0 legacy=0x7f089409dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f0891d9b700 1 -- 172.21.15.154:0/3911039618 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089409b450 con 0x7f089409a580 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f0892d9d700 1 --2- 172.21.15.154:0/3911039618 >> v2:172.21.15.154:3300/0 conn(0x7f089409e2d0 0x7f08941380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f0891d9b700 1 --2- 172.21.15.154:0/3911039618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409a580 0x7f0894135b80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f08880098f0 tx=0x7f0888009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb4a0ffee99be032 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f089159a700 1 -- 172.21.15.154:0/3911039618 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888011830 con 0x7f089409a580 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f089159a700 1 -- 172.21.15.154:0/3911039618 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0888011990 con 0x7f089409a580 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.575+0000 7f089159a700 1 -- 172.21.15.154:0/3911039618 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888011d20 con 0x7f089409a580 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.576+0000 7f0898874700 1 -- 172.21.15.154:0/3911039618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409a580 msgr2=0x7f0894135b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.576+0000 7f0898874700 1 --2- 172.21.15.154:0/3911039618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409a580 0x7f0894135b80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f08880098f0 tx=0x7f0888009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.576+0000 7f0898874700 1 -- 172.21.15.154:0/3911039618 shutdown_connections 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.576+0000 7f0898874700 1 --2- 172.21.15.154:0/3911039618 >> v2:172.21.15.154:3300/0 conn(0x7f089409e2d0 0x7f08941380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.576+0000 7f0898874700 1 --2- 172.21.15.154:0/3911039618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409a580 0x7f0894135b80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.576+0000 7f0898874700 1 -- 172.21.15.154:0/3911039618 >> 172.21.15.154:0/3911039618 conn(0x7f089409f9f0 msgr2=0x7f089409fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.576+0000 7f0898874700 1 -- 172.21.15.154:0/3911039618 shutdown_connections 2023-09-30T22:26:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.576+0000 7f0898874700 1 -- 172.21.15.154:0/3911039618 wait complete. 2023-09-30T22:26:10.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.577+0000 7f0898874700 1 Processor -- start 2023-09-30T22:26:10.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.577+0000 7f0898874700 1 -- start start 2023-09-30T22:26:10.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0898874700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f089409a580 0x7f08941cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0898874700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f089409d7f0 0x7f08941ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0898874700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409e2d0 0x7f08941cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:10.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0898874700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089411c830 con 0x7f089409d7f0 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0898874700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0894126d30 con 0x7f089409e2d0 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0898874700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f089411ccd0 con 0x7f089409a580 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0892d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409e2d0 0x7f08941cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0892d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409e2d0 0x7f08941cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51734/0 (socket says 172.21.15.154:51734) 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0892d9d700 1 -- 172.21.15.154:0/2930823699 learned_addr learned my addr 172.21.15.154:0/2930823699 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0891d9b700 1 --2- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f089409d7f0 0x7f08941ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0892d9d700 1 -- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f089409a580 msgr2=0x7f08941cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.578+0000 7f0892d9d700 1 --2- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f089409a580 0x7f08941cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.579+0000 7f0892d9d700 1 -- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f089409d7f0 msgr2=0x7f08941ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.579+0000 7f0892d9d700 1 --2- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f089409d7f0 0x7f08941ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.579+0000 7f0892d9d700 1 -- 172.21.15.154:0/2930823699 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c009a70 con 0x7f089409e2d0 2023-09-30T22:26:10.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.579+0000 7f0892d9d700 1 --2- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409e2d0 0x7f08941cd300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f088c00efc0 tx=0x7f088c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:10.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.579+0000 7f0882ffd700 1 -- 172.21.15.154:0/2930823699 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c00cb40 con 0x7f089409e2d0 2023-09-30T22:26:10.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.579+0000 7f0882ffd700 1 -- 172.21.15.154:0/2930823699 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c00f040 con 0x7f089409e2d0 2023-09-30T22:26:10.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.579+0000 7f0882ffd700 1 -- 172.21.15.154:0/2930823699 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c003a20 con 0x7f089409e2d0 2023-09-30T22:26:10.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.579+0000 7f0898874700 1 -- 172.21.15.154:0/2930823699 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0888009550 con 0x7f089409e2d0 2023-09-30T22:26:10.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.579+0000 7f0898874700 1 -- 172.21.15.154:0/2930823699 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08941277a0 con 0x7f089409e2d0 2023-09-30T22:26:10.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.580+0000 7f0882ffd700 1 -- 172.21.15.154:0/2930823699 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f088c003b80 con 0x7f089409e2d0 2023-09-30T22:26:10.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.580+0000 7f0882ffd700 1 -- 172.21.15.154:0/2930823699 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f088c0400f0 con 0x7f089409e2d0 2023-09-30T22:26:10.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.581+0000 7f0898874700 1 -- 172.21.15.154:0/2930823699 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0894126b70 con 0x7f089409e2d0 2023-09-30T22:26:10.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.590+0000 7f0882ffd700 1 -- 172.21.15.154:0/2930823699 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f088c01cba0 con 0x7f089409e2d0 2023-09-30T22:26:10.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.693+0000 7f4fdb016700 1 -- 172.21.15.154:0/2345613905 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4fd404f2a0 con 0x7f4fd41356e0 2023-09-30T22:26:10.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.693+0000 7f4fd17fa700 1 -- 172.21.15.154:0/2345613905 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fcc02b090 con 0x7f4fd41356e0 2023-09-30T22:26:10.693 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.695+0000 7f4fdb016700 1 -- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd41356e0 msgr2=0x7f4fd41387a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.695+0000 7f4fdb016700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd41356e0 0x7f4fd41387a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00efc0 tx=0x7f4fcc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.696+0000 7f4fdb016700 1 -- 172.21.15.154:0/2345613905 shutdown_connections 2023-09-30T22:26:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.696+0000 7f4fdb016700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4fd41356e0 0x7f4fd41387a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.696+0000 7f4fdb016700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4fd40a0a30 0x7f4fd4137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.696+0000 7f4fdb016700 1 --2- 172.21.15.154:0/2345613905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fd40a1510 0x7f4fd4138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.696+0000 7f4fdb016700 1 -- 172.21.15.154:0/2345613905 >> 172.21.15.154:0/2345613905 conn(0x7f4fd40a2980 msgr2=0x7f4fd412e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.696+0000 7f4fdb016700 1 -- 172.21.15.154:0/2345613905 shutdown_connections 2023-09-30T22:26:10.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.696+0000 7f4fdb016700 1 -- 172.21.15.154:0/2345613905 wait complete. 2023-09-30T22:26:10.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:10.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.728+0000 7f063f550700 1 -- 172.21.15.154:0/2856327371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f063804f2a0 con 0x7f0638134140 2023-09-30T22:26:10.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.729+0000 7f062dffb700 1 -- 172.21.15.154:0/2856327371 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0628021020 con 0x7f0638134140 2023-09-30T22:26:10.729 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:10.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.731+0000 7f063f550700 1 -- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134140 msgr2=0x7f063811ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.731+0000 7f063f550700 1 --2- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134140 0x7f063811ce00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f062800ebe0 tx=0x7f062800eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.731+0000 7f063f550700 1 -- 172.21.15.154:0/2856327371 shutdown_connections 2023-09-30T22:26:10.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.731+0000 7f063f550700 1 --2- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0638134570 0x7f063811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.731+0000 7f063f550700 1 --2- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f063809ad40 0x7f063811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.731+0000 7f063f550700 1 --2- 172.21.15.154:0/2856327371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0638134140 0x7f063811ce00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.731+0000 7f063f550700 1 -- 172.21.15.154:0/2856327371 >> 172.21.15.154:0/2856327371 conn(0x7f0638099c40 msgr2=0x7f063813b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.731+0000 7f063f550700 1 -- 172.21.15.154:0/2856327371 shutdown_connections 2023-09-30T22:26:10.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.731+0000 7f063f550700 1 -- 172.21.15.154:0/2856327371 wait complete. 2023-09-30T22:26:10.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.742+0000 7fb60bfff700 1 -- 172.21.15.154:0/2417703676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb604005860 con 0x7fb6280a1230 2023-09-30T22:26:10.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.743+0000 7fb61e7fc700 1 -- 172.21.15.154:0/2417703676 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb61802a020 con 0x7fb6280a1230 2023-09-30T22:26:10.742 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:10.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.745+0000 7fb60bfff700 1 -- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a1230 msgr2=0x7fb628135850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.745+0000 7fb60bfff700 1 --2- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a1230 0x7fb628135850 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb618000c00 tx=0x7fb618004750 comp rx=0 tx=0).stop 2023-09-30T22:26:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.745+0000 7fb60bfff700 1 -- 172.21.15.154:0/2417703676 shutdown_connections 2023-09-30T22:26:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.745+0000 7fb60bfff700 1 --2- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb628138040 0x7fb628135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.745+0000 7fb60bfff700 1 --2- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb6280a08e0 0x7fb6281370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.745+0000 7fb60bfff700 1 --2- 172.21.15.154:0/2417703676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6280a1230 0x7fb628135850 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.745+0000 7fb60bfff700 1 -- 172.21.15.154:0/2417703676 >> 172.21.15.154:0/2417703676 conn(0x7fb6280a2980 msgr2=0x7fb628071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.745+0000 7fb60bfff700 1 -- 172.21.15.154:0/2417703676 shutdown_connections 2023-09-30T22:26:10.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.745+0000 7fb60bfff700 1 -- 172.21.15.154:0/2417703676 wait complete. 2023-09-30T22:26:10.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:10.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.785+0000 7f0898874700 1 -- 172.21.15.154:0/2930823699 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f089404f2a0 con 0x7f089409e2d0 2023-09-30T22:26:10.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.785+0000 7f0882ffd700 1 -- 172.21.15.154:0/2930823699 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f088c014e40 con 0x7f089409e2d0 2023-09-30T22:26:10.785 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.788+0000 7f0898874700 1 -- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409e2d0 msgr2=0x7f08941cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.788+0000 7f0898874700 1 --2- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409e2d0 0x7f08941cd300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f088c00efc0 tx=0x7f088c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.788+0000 7f0898874700 1 -- 172.21.15.154:0/2930823699 shutdown_connections 2023-09-30T22:26:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.788+0000 7f0898874700 1 --2- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f089409e2d0 0x7f08941cd300 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.788+0000 7f0898874700 1 --2- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f089409a580 0x7f08941cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.788+0000 7f0898874700 1 --2- 172.21.15.154:0/2930823699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f089409d7f0 0x7f08941ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.788+0000 7f0898874700 1 -- 172.21.15.154:0/2930823699 >> 172.21.15.154:0/2930823699 conn(0x7f089409f9f0 msgr2=0x7f089413acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.788+0000 7f0898874700 1 -- 172.21.15.154:0/2930823699 shutdown_connections 2023-09-30T22:26:10.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:10.788+0000 7f0898874700 1 -- 172.21.15.154:0/2930823699 wait complete. 2023-09-30T22:26:10.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:11.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:11.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:11.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:11.800 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:11.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.853+0000 7fd55d2d5700 1 Processor -- start 2023-09-30T22:26:11.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd55d2d5700 1 -- start start 2023-09-30T22:26:11.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd55d2d5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd558133ad0 0x7fd558133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd55d2d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581300a0 0x7fd5581304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd55d2d5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5581309f0 0x7fd55813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd55d2d5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55806b2d0 con 0x7fd558133ad0 2023-09-30T22:26:11.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd55d2d5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd558133610 con 0x7fd5581309f0 2023-09-30T22:26:11.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd55d2d5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd55809a500 con 0x7fd5581300a0 2023-09-30T22:26:11.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd556ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd558133ad0 0x7fd558133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd556ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd558133ad0 0x7fd558133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35174/0 (socket says 172.21.15.154:35174) 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd556ffd700 1 -- 172.21.15.154:0/2368685671 learned_addr learned my addr 172.21.15.154:0/2368685671 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.854+0000 7fd5567fc700 1 --2- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581300a0 0x7fd5581304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.855+0000 7fd556ffd700 1 -- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581300a0 msgr2=0x7fd5581304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.855+0000 7fd556ffd700 1 --2- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581300a0 0x7fd5581304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.855+0000 7fd556ffd700 1 -- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5581309f0 msgr2=0x7fd55813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.855+0000 7fd556ffd700 1 --2- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5581309f0 0x7fd55813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.855+0000 7fd556ffd700 1 -- 172.21.15.154:0/2368685671 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5581338b0 con 0x7fd558133ad0 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.855+0000 7fd556ffd700 1 --2- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd558133ad0 0x7fd558133ea0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd5480098f0 tx=0x7fd548009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc01e930f2e4dcea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.855+0000 7fd555ffb700 1 -- 172.21.15.154:0/2368685671 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548011830 con 0x7fd558133ad0 2023-09-30T22:26:11.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.855+0000 7fd555ffb700 1 -- 172.21.15.154:0/2368685671 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548011990 con 0x7fd558133ad0 2023-09-30T22:26:11.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.855+0000 7fd555ffb700 1 -- 172.21.15.154:0/2368685671 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548011d20 con 0x7fd558133ad0 2023-09-30T22:26:11.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.856+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd558133ad0 msgr2=0x7fd558133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.856+0000 7fd55d2d5700 1 --2- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd558133ad0 0x7fd558133ea0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd5480098f0 tx=0x7fd548009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.856+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2368685671 shutdown_connections 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.856+0000 7fd55d2d5700 1 --2- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5581309f0 0x7fd55813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.856+0000 7fd55d2d5700 1 --2- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd558133ad0 0x7fd558133ea0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.856+0000 7fd55d2d5700 1 --2- 172.21.15.154:0/2368685671 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581300a0 0x7fd5581304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.856+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2368685671 >> 172.21.15.154:0/2368685671 conn(0x7fd558099c40 msgr2=0x7fd5580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.856+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2368685671 shutdown_connections 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.856+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2368685671 wait complete. 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.858+0000 7fd55d2d5700 1 Processor -- start 2023-09-30T22:26:11.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.858+0000 7fd55d2d5700 1 -- start start 2023-09-30T22:26:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.858+0000 7fd55d2d5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5581300a0 0x7fd55811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.858+0000 7fd55d2d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581309f0 0x7fd55811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.858+0000 7fd55d2d5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd558133ad0 0x7fd55811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.858+0000 7fd55d2d5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd558120080 con 0x7fd5581300a0 2023-09-30T22:26:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.858+0000 7fd55d2d5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55812dd00 con 0x7fd558133ad0 2023-09-30T22:26:11.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.858+0000 7fd55d2d5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5581209f0 con 0x7fd5581309f0 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd556ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5581300a0 0x7fd55811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd556ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5581300a0 0x7fd55811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35178/0 (socket says 172.21.15.154:35178) 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd556ffd700 1 -- 172.21.15.154:0/2750139811 learned_addr learned my addr 172.21.15.154:0/2750139811 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd5577fe700 1 --2- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd558133ad0 0x7fd55811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd5567fc700 1 --2- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581309f0 0x7fd55811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd556ffd700 1 -- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581309f0 msgr2=0x7fd55811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd556ffd700 1 --2- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581309f0 0x7fd55811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd556ffd700 1 -- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd558133ad0 msgr2=0x7fd55811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd556ffd700 1 --2- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd558133ad0 0x7fd55811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd556ffd700 1 -- 172.21.15.154:0/2750139811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd548009550 con 0x7fd5581300a0 2023-09-30T22:26:11.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd556ffd700 1 --2- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5581300a0 0x7fd55811da40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd548009c40 tx=0x7fd548004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd53f7fe700 1 -- 172.21.15.154:0/2750139811 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548004240 con 0x7fd5581300a0 2023-09-30T22:26:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd53f7fe700 1 -- 172.21.15.154:0/2750139811 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54801f070 con 0x7fd5581300a0 2023-09-30T22:26:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.859+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2750139811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55811f3c0 con 0x7fd5581300a0 2023-09-30T22:26:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.860+0000 7fd53f7fe700 1 -- 172.21.15.154:0/2750139811 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480045e0 con 0x7fd5581300a0 2023-09-30T22:26:11.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.860+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2750139811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55811eb00 con 0x7fd5581300a0 2023-09-30T22:26:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.860+0000 7fd53f7fe700 1 -- 172.21.15.154:0/2750139811 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd548021030 con 0x7fd5581300a0 2023-09-30T22:26:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.860+0000 7fd53f7fe700 1 -- 172.21.15.154:0/2750139811 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5480408d0 con 0x7fd5581300a0 2023-09-30T22:26:11.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.861+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2750139811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55812d9f0 con 0x7fd5581300a0 2023-09-30T22:26:11.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.866+0000 7fd53f7fe700 1 -- 172.21.15.154:0/2750139811 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd548015080 con 0x7fd5581300a0 2023-09-30T22:26:11.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.895+0000 7f20ca19f700 1 Processor -- start 2023-09-30T22:26:11.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.895+0000 7f20ca19f700 1 -- start start 2023-09-30T22:26:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.895+0000 7f20ca19f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c4071200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.895+0000 7f20ca19f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20c406a770 0x7f20c406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.895+0000 7f20ca19f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c4071740 con 0x7f20c406b0a0 2023-09-30T22:26:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.895+0000 7f20ca19f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c409d220 con 0x7f20c406a770 2023-09-30T22:26:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.895+0000 7f20ca19f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c409ce30 con 0x7f20c4070e30 2023-09-30T22:26:11.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c919d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c899c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20c406a770 0x7f20c406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c899c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20c406a770 0x7f20c406ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35180/0 (socket says 172.21.15.154:35180) 2023-09-30T22:26:11.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c919d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c4071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51760/0 (socket says 172.21.15.154:51760) 2023-09-30T22:26:11.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c899c700 1 -- 172.21.15.154:0/3376649528 learned_addr learned my addr 172.21.15.154:0/3376649528 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:11.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c999e700 1 --1- 172.21.15.154:0/3376649528 >> v1:172.21.15.154:6789/0 conn(0x7f20c406b0a0 0x7f20c4138590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37664/0 (socket says 172.21.15.154:37664) 2023-09-30T22:26:11.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c919d700 1 -- 172.21.15.154:0/3376649528 >> v2:172.21.15.154:3300/0 conn(0x7f20c406a770 msgr2=0x7f20c406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c919d700 1 --2- 172.21.15.154:0/3376649528 >> v2:172.21.15.154:3300/0 conn(0x7f20c406a770 0x7f20c406ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c919d700 1 -- 172.21.15.154:0/3376649528 >> v1:172.21.15.154:6789/0 conn(0x7f20c406b0a0 legacy=0x7f20c4138590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c919d700 1 -- 172.21.15.154:0/3376649528 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c406e730 con 0x7f20c4070e30 2023-09-30T22:26:11.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c899c700 1 --2- 172.21.15.154:0/3376649528 >> v2:172.21.15.154:3300/0 conn(0x7f20c406a770 0x7f20c406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20c919d700 1 --2- 172.21.15.154:0/3376649528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c4071200 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009840 tx=0x7f20c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a4ed7fcb352abd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20bbfff700 1 -- 172.21.15.154:0/3376649528 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0011830 con 0x7f20c4070e30 2023-09-30T22:26:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20bbfff700 1 -- 172.21.15.154:0/3376649528 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c0011990 con 0x7f20c4070e30 2023-09-30T22:26:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.896+0000 7f20bbfff700 1 -- 172.21.15.154:0/3376649528 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0011d20 con 0x7f20c4070e30 2023-09-30T22:26:11.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.897+0000 7f20ca19f700 1 -- 172.21.15.154:0/3376649528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 msgr2=0x7f20c4071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.897+0000 7f20ca19f700 1 --2- 172.21.15.154:0/3376649528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c4071200 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009840 tx=0x7f20c0009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.897+0000 7f20ca19f700 1 -- 172.21.15.154:0/3376649528 shutdown_connections 2023-09-30T22:26:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.897+0000 7f20ca19f700 1 --2- 172.21.15.154:0/3376649528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c4071200 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.897+0000 7f20ca19f700 1 --2- 172.21.15.154:0/3376649528 >> v2:172.21.15.154:3300/0 conn(0x7f20c406a770 0x7f20c406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.897+0000 7f20ca19f700 1 -- 172.21.15.154:0/3376649528 >> 172.21.15.154:0/3376649528 conn(0x7f20c40a2d80 msgr2=0x7f20c40a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.897+0000 7f20ca19f700 1 -- 172.21.15.154:0/3376649528 shutdown_connections 2023-09-30T22:26:11.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.897+0000 7f20ca19f700 1 -- 172.21.15.154:0/3376649528 wait complete. 2023-09-30T22:26:11.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.899+0000 7f20ca19f700 1 Processor -- start 2023-09-30T22:26:11.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.899+0000 7f20ca19f700 1 -- start start 2023-09-30T22:26:11.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.899+0000 7f20ca19f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c406a770 0x7f20c41a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20ca19f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20c406b0a0 0x7f20c41a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20ca19f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c41c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20ca19f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41a2b70 con 0x7f20c406a770 2023-09-30T22:26:11.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20ca19f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41a5340 con 0x7f20c4070e30 2023-09-30T22:26:11.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20ca19f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41a1be0 con 0x7f20c406b0a0 2023-09-30T22:26:11.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c999e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c41c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c999e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c41c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51764/0 (socket says 172.21.15.154:51764) 2023-09-30T22:26:11.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c999e700 1 -- 172.21.15.154:0/3123432757 learned_addr learned my addr 172.21.15.154:0/3123432757 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:11.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c899c700 1 --2- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20c406b0a0 0x7f20c41a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c919d700 1 --2- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c406a770 0x7f20c41a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c999e700 1 -- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20c406b0a0 msgr2=0x7f20c41a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c999e700 1 --2- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20c406b0a0 0x7f20c41a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c999e700 1 -- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c406a770 msgr2=0x7f20c41a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c999e700 1 --2- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c406a770 0x7f20c41a20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c999e700 1 -- 172.21.15.154:0/3123432757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4009550 con 0x7f20c4070e30 2023-09-30T22:26:11.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.900+0000 7f20c999e700 1 --2- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c41c60f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00cc50 tx=0x7f20bc00cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.901+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3123432757 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc011a90 con 0x7f20c4070e30 2023-09-30T22:26:11.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.901+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3123432757 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc011bf0 con 0x7f20c4070e30 2023-09-30T22:26:11.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.901+0000 7f20ca19f700 1 -- 172.21.15.154:0/3123432757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c00094a0 con 0x7f20c4070e30 2023-09-30T22:26:11.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.901+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3123432757 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00a520 con 0x7f20c4070e30 2023-09-30T22:26:11.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.901+0000 7f20ca19f700 1 -- 172.21.15.154:0/3123432757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c40718f0 con 0x7f20c4070e30 2023-09-30T22:26:11.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.902+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3123432757 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20bc017070 con 0x7f20c4070e30 2023-09-30T22:26:11.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.902+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3123432757 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20bc043800 con 0x7f20c4070e30 2023-09-30T22:26:11.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.902+0000 7f20ca19f700 1 -- 172.21.15.154:0/3123432757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c41a5180 con 0x7f20c4070e30 2023-09-30T22:26:11.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.908+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3123432757 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20c41a5180 con 0x7f20c4070e30 2023-09-30T22:26:11.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.944+0000 7ff2daaf6700 1 Processor -- start 2023-09-30T22:26:11.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.944+0000 7ff2daaf6700 1 -- start start 2023-09-30T22:26:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.944+0000 7f5ac8f49700 1 Processor -- start 2023-09-30T22:26:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.944+0000 7f5ac8f49700 1 -- start start 2023-09-30T22:26:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7ff2daaf6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d406cc70 0x7ff2d40a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7ff2daaf6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff2d40a0fb0 0x7ff2d40a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7ff2daaf6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d409df50 con 0x7ff2d413c200 2023-09-30T22:26:11.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7ff2daaf6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d40a1920 con 0x7ff2d40a0fb0 2023-09-30T22:26:11.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7ff2daaf6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d409cf30 con 0x7ff2d406cc70 2023-09-30T22:26:11.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac8f49700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409e340 0x7f5ac41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac8f49700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ac406a770 0x7f5ac406abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac8f49700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac409aaa0 con 0x7f5ac409d860 2023-09-30T22:26:11.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac8f49700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac409e730 con 0x7f5ac406a770 2023-09-30T22:26:11.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac8f49700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac409f870 con 0x7f5ac409e340 2023-09-30T22:26:11.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409e340 0x7f5ac41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409e340 0x7f5ac41359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51772/0 (socket says 172.21.15.154:51772) 2023-09-30T22:26:11.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac1d9b700 1 -- 172.21.15.154:0/88464854 learned_addr learned my addr 172.21.15.154:0/88464854 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:11.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac2d9d700 1 --2- 172.21.15.154:0/88464854 >> v2:172.21.15.154:3300/0 conn(0x7f5ac406a770 0x7f5ac406abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7ff2d8892700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d406cc70 0x7ff2d40a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7ff2d8892700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d406cc70 0x7ff2d40a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51766/0 (socket says 172.21.15.154:51766) 2023-09-30T22:26:11.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7ff2d8892700 1 -- 172.21.15.154:0/776513686 learned_addr learned my addr 172.21.15.154:0/776513686 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:11.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac1d9b700 1 -- 172.21.15.154:0/88464854 >> v2:172.21.15.154:3300/0 conn(0x7f5ac406a770 msgr2=0x7f5ac406abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac1d9b700 1 --2- 172.21.15.154:0/88464854 >> v2:172.21.15.154:3300/0 conn(0x7f5ac406a770 0x7f5ac406abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac1d9b700 1 -- 172.21.15.154:0/88464854 >> v1:172.21.15.154:6789/0 conn(0x7f5ac409d860 legacy=0x7f5ac409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.945+0000 7f5ac1d9b700 1 -- 172.21.15.154:0/88464854 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac409b360 con 0x7f5ac409e340 2023-09-30T22:26:11.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7ff2d8892700 1 -- 172.21.15.154:0/776513686 >> v2:172.21.15.154:3300/0 conn(0x7ff2d40a0fb0 msgr2=0x7ff2d40a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7ff2d8892700 1 --2- 172.21.15.154:0/776513686 >> v2:172.21.15.154:3300/0 conn(0x7ff2d40a0fb0 0x7ff2d40a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7ff2d8892700 1 -- 172.21.15.154:0/776513686 >> v1:172.21.15.154:6789/0 conn(0x7ff2d413c200 legacy=0x7ff2d413e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:11.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7ff2d8892700 1 -- 172.21.15.154:0/776513686 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40a24a0 con 0x7ff2d406cc70 2023-09-30T22:26:11.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7ff2d8892700 1 --2- 172.21.15.154:0/776513686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d406cc70 0x7ff2d40a0a70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009920 tx=0x7ff2c8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86ce895f2801a848 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7f5ac1d9b700 1 --2- 172.21.15.154:0/88464854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409e340 0x7f5ac41359e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80098f0 tx=0x7f5ab8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=955300f1a37c3f05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7f5ac159a700 1 -- 172.21.15.154:0/88464854 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8011830 con 0x7f5ac409e340 2023-09-30T22:26:11.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7f5ac159a700 1 -- 172.21.15.154:0/88464854 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8011990 con 0x7f5ac409e340 2023-09-30T22:26:11.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7f5ac159a700 1 -- 172.21.15.154:0/88464854 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8011d20 con 0x7f5ac409e340 2023-09-30T22:26:11.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7ff2d37fe700 1 -- 172.21.15.154:0/776513686 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8004230 con 0x7ff2d406cc70 2023-09-30T22:26:11.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7ff2d37fe700 1 -- 172.21.15.154:0/776513686 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c8004390 con 0x7ff2d406cc70 2023-09-30T22:26:11.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.946+0000 7ff2d37fe700 1 -- 172.21.15.154:0/776513686 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8009e70 con 0x7ff2d406cc70 2023-09-30T22:26:11.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7f5ac8f49700 1 -- 172.21.15.154:0/88464854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409e340 msgr2=0x7f5ac41359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7f5ac8f49700 1 --2- 172.21.15.154:0/88464854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409e340 0x7f5ac41359e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80098f0 tx=0x7f5ab8009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:11.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7f5ac8f49700 1 -- 172.21.15.154:0/88464854 shutdown_connections 2023-09-30T22:26:11.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7f5ac8f49700 1 --2- 172.21.15.154:0/88464854 >> v2:172.21.15.154:3300/0 conn(0x7f5ac406a770 0x7f5ac406abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7f5ac8f49700 1 --2- 172.21.15.154:0/88464854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409e340 0x7f5ac41359e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7f5ac8f49700 1 -- 172.21.15.154:0/88464854 >> 172.21.15.154:0/88464854 conn(0x7f5ac4099c40 msgr2=0x7f5ac40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7f5ac8f49700 1 -- 172.21.15.154:0/88464854 shutdown_connections 2023-09-30T22:26:11.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7f5ac8f49700 1 -- 172.21.15.154:0/88464854 wait complete. 2023-09-30T22:26:11.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7ff2daaf6700 1 -- 172.21.15.154:0/776513686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d406cc70 msgr2=0x7ff2d40a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7ff2daaf6700 1 --2- 172.21.15.154:0/776513686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d406cc70 0x7ff2d40a0a70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009920 tx=0x7ff2c8009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:11.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7ff2daaf6700 1 -- 172.21.15.154:0/776513686 shutdown_connections 2023-09-30T22:26:11.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7ff2daaf6700 1 --2- 172.21.15.154:0/776513686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d406cc70 0x7ff2d40a0a70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7ff2daaf6700 1 --2- 172.21.15.154:0/776513686 >> v2:172.21.15.154:3300/0 conn(0x7ff2d40a0fb0 0x7ff2d40a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.947+0000 7ff2daaf6700 1 -- 172.21.15.154:0/776513686 >> 172.21.15.154:0/776513686 conn(0x7ff2d40a6610 msgr2=0x7ff2d40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:11.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.948+0000 7ff2daaf6700 1 -- 172.21.15.154:0/776513686 shutdown_connections 2023-09-30T22:26:11.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.948+0000 7f5ac8f49700 1 Processor -- start 2023-09-30T22:26:11.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.948+0000 7ff2daaf6700 1 -- 172.21.15.154:0/776513686 wait complete. 2023-09-30T22:26:11.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.948+0000 7f5ac8f49700 1 -- start start 2023-09-30T22:26:11.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac8f49700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ac406a770 0x7f5ac41c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac8f49700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409d860 0x7f5ac41c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac8f49700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ac409e340 0x7f5ac4130820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac8f49700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac41c4270 con 0x7f5ac406a770 2023-09-30T22:26:11.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac8f49700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac4134220 con 0x7f5ac409d860 2023-09-30T22:26:11.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac8f49700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40a2a10 con 0x7f5ac409e340 2023-09-30T22:26:11.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409d860 0x7f5ac41c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ac406a770 0x7f5ac41c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac1d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409d860 0x7f5ac41c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51780/0 (socket says 172.21.15.154:51780) 2023-09-30T22:26:11.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac1d9b700 1 -- 172.21.15.154:0/1766590601 learned_addr learned my addr 172.21.15.154:0/1766590601 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:11.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac259c700 1 -- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ac409e340 msgr2=0x7f5ac4130820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac259c700 1 --2- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ac409e340 0x7f5ac4130820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac259c700 1 -- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409d860 msgr2=0x7f5ac41c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac259c700 1 --2- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409d860 0x7f5ac41c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac259c700 1 -- 172.21.15.154:0/1766590601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8009550 con 0x7f5ac406a770 2023-09-30T22:26:11.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac1d9b700 1 --2- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409d860 0x7f5ac41c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7ff2daaf6700 1 Processor -- start 2023-09-30T22:26:11.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7f5ac259c700 1 --2- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ac406a770 0x7f5ac41c8440 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4000f60 tx=0x7f5ab400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.949+0000 7ff2daaf6700 1 -- start start 2023-09-30T22:26:11.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7f5ab2ffd700 1 -- 172.21.15.154:0/1766590601 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40052d0 con 0x7f5ac406a770 2023-09-30T22:26:11.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7f5ab2ffd700 1 -- 172.21.15.154:0/1766590601 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4005430 con 0x7f5ac406a770 2023-09-30T22:26:11.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7f5ac8f49700 1 -- 172.21.15.154:0/1766590601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac4132b60 con 0x7f5ac406a770 2023-09-30T22:26:11.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7f5ab2ffd700 1 -- 172.21.15.154:0/1766590601 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40038c0 con 0x7f5ac406a770 2023-09-30T22:26:11.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7f5ac8f49700 1 -- 172.21.15.154:0/1766590601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac41323b0 con 0x7f5ac406a770 2023-09-30T22:26:11.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7ff2daaf6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2d406cc70 0x7ff2d41250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7ff2daaf6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2d40a0fb0 0x7ff2d41255f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7ff2daaf6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d413c200 0x7ff2d4125b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:11.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7ff2daaf6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4126ec0 con 0x7ff2d40a0fb0 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7ff2daaf6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40a4930 con 0x7ff2d413c200 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.950+0000 7ff2daaf6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40a0020 con 0x7ff2d406cc70 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d8892700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2d406cc70 0x7ff2d41250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d9093700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d413c200 0x7ff2d4125b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d8892700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2d406cc70 0x7ff2d41250b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60898/0 (socket says 172.21.15.154:60898) 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d8892700 1 -- 172.21.15.154:0/2835555349 learned_addr learned my addr 172.21.15.154:0/2835555349 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:11.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7f5ac8f49700 1 -- 172.21.15.154:0/1766590601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac404f2a0 con 0x7f5ac406a770 2023-09-30T22:26:11.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d8892700 1 -- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d413c200 msgr2=0x7ff2d4125b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d8892700 1 --2- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d413c200 0x7ff2d4125b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d8892700 1 -- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2d40a0fb0 msgr2=0x7ff2d41255f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:11.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d8892700 1 --2- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2d40a0fb0 0x7ff2d41255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:11.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d8892700 1 -- 172.21.15.154:0/2835555349 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c8009550 con 0x7ff2d406cc70 2023-09-30T22:26:11.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d9093700 1 --2- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d413c200 0x7ff2d4125b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:11.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7ff2d8892700 1 --2- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2d406cc70 0x7ff2d41250b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009fd0 tx=0x7ff2c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:11.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.951+0000 7f5ab2ffd700 1 -- 172.21.15.154:0/1766590601 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ab4003a20 con 0x7f5ac406a770 2023-09-30T22:26:11.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.952+0000 7ff2d17fa700 1 -- 172.21.15.154:0/2835555349 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80036a0 con 0x7ff2d406cc70 2023-09-30T22:26:11.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.952+0000 7ff2d17fa700 1 -- 172.21.15.154:0/2835555349 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c8003800 con 0x7ff2d406cc70 2023-09-30T22:26:11.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.952+0000 7ff2d17fa700 1 -- 172.21.15.154:0/2835555349 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8003b90 con 0x7ff2d406cc70 2023-09-30T22:26:11.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.952+0000 7ff2daaf6700 1 -- 172.21.15.154:0/2835555349 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d41277d0 con 0x7ff2d406cc70 2023-09-30T22:26:11.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.952+0000 7f5ab2ffd700 1 -- 172.21.15.154:0/1766590601 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ab403ebe0 con 0x7f5ac406a770 2023-09-30T22:26:11.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.952+0000 7ff2daaf6700 1 -- 172.21.15.154:0/2835555349 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d4127450 con 0x7ff2d406cc70 2023-09-30T22:26:11.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.952+0000 7ff2d17fa700 1 -- 172.21.15.154:0/2835555349 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2c8003cf0 con 0x7ff2d406cc70 2023-09-30T22:26:11.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.953+0000 7ff2d17fa700 1 -- 172.21.15.154:0/2835555349 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2c8040c70 con 0x7ff2d406cc70 2023-09-30T22:26:11.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.953+0000 7ff2daaf6700 1 -- 172.21.15.154:0/2835555349 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d404f2a0 con 0x7ff2d406cc70 2023-09-30T22:26:11.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.957+0000 7ff2d17fa700 1 -- 172.21.15.154:0/2835555349 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2c8028080 con 0x7ff2d406cc70 2023-09-30T22:26:11.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:11.960+0000 7f5ab2ffd700 1 -- 172.21.15.154:0/1766590601 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ab4011590 con 0x7f5ac406a770 2023-09-30T22:26:12.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.069+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2750139811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd55804f2a0 con 0x7fd5581300a0 2023-09-30T22:26:12.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.069+0000 7fd53f7fe700 1 -- 172.21.15.154:0/2750139811 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5480199a0 con 0x7fd5581300a0 2023-09-30T22:26:12.070 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:12.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.072+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5581300a0 msgr2=0x7fd55811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:12.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.072+0000 7fd55d2d5700 1 --2- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5581300a0 0x7fd55811da40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd548009c40 tx=0x7fd548004750 comp rx=0 tx=0).stop 2023-09-30T22:26:12.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.073+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2750139811 shutdown_connections 2023-09-30T22:26:12.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.073+0000 7fd55d2d5700 1 --2- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd558133ad0 0x7fd55811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.073+0000 7fd55d2d5700 1 --2- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5581300a0 0x7fd55811da40 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.073+0000 7fd55d2d5700 1 --2- 172.21.15.154:0/2750139811 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5581309f0 0x7fd55811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.073+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2750139811 >> 172.21.15.154:0/2750139811 conn(0x7fd558099c40 msgr2=0x7fd5581320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:12.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.073+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2750139811 shutdown_connections 2023-09-30T22:26:12.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.073+0000 7fd55d2d5700 1 -- 172.21.15.154:0/2750139811 wait complete. 2023-09-30T22:26:12.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:12.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.122+0000 7f20ca19f700 1 -- 172.21.15.154:0/3123432757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f20c41a5180 con 0x7f20c4070e30 2023-09-30T22:26:12.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.123+0000 7f20b9ffb700 1 -- 172.21.15.154:0/3123432757 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20c41a5180 con 0x7f20c4070e30 2023-09-30T22:26:12.125 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.125+0000 7f20ca19f700 1 -- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 msgr2=0x7f20c41c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.125+0000 7f20ca19f700 1 --2- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c41c60f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00cc50 tx=0x7f20bc00cf60 comp rx=0 tx=0).stop 2023-09-30T22:26:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.125+0000 7f20ca19f700 1 -- 172.21.15.154:0/3123432757 shutdown_connections 2023-09-30T22:26:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.125+0000 7f20ca19f700 1 --2- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20c4070e30 0x7f20c41c60f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.125+0000 7f20ca19f700 1 --2- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c406a770 0x7f20c41a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.125+0000 7f20ca19f700 1 --2- 172.21.15.154:0/3123432757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20c406b0a0 0x7f20c41a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.125+0000 7f20ca19f700 1 -- 172.21.15.154:0/3123432757 >> 172.21.15.154:0/3123432757 conn(0x7f20c40a2d80 msgr2=0x7f20c406f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.125+0000 7f20ca19f700 1 -- 172.21.15.154:0/3123432757 shutdown_connections 2023-09-30T22:26:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.125+0000 7f20ca19f700 1 -- 172.21.15.154:0/3123432757 wait complete. 2023-09-30T22:26:12.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:12.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.157+0000 7f5ac8f49700 1 -- 172.21.15.154:0/1766590601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ac4134cf0 con 0x7f5ac406a770 2023-09-30T22:26:12.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.157+0000 7f5ab2ffd700 1 -- 172.21.15.154:0/1766590601 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ab4017020 con 0x7f5ac406a770 2023-09-30T22:26:12.157 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:12.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.159+0000 7f5ac8f49700 1 -- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ac406a770 msgr2=0x7f5ac41c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:12.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.159+0000 7f5ac8f49700 1 --2- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ac406a770 0x7f5ac41c8440 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4000f60 tx=0x7f5ab400c730 comp rx=0 tx=0).stop 2023-09-30T22:26:12.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.159+0000 7f5ac8f49700 1 -- 172.21.15.154:0/1766590601 shutdown_connections 2023-09-30T22:26:12.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.159+0000 7f5ac8f49700 1 --2- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ac409e340 0x7f5ac4130820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.159+0000 7f5ac8f49700 1 --2- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ac406a770 0x7f5ac41c8440 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.159+0000 7f5ac8f49700 1 --2- 172.21.15.154:0/1766590601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ac409d860 0x7f5ac41c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.159+0000 7f5ac8f49700 1 -- 172.21.15.154:0/1766590601 >> 172.21.15.154:0/1766590601 conn(0x7f5ac4099c40 msgr2=0x7f5ac406f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:12.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.159+0000 7f5ac8f49700 1 -- 172.21.15.154:0/1766590601 shutdown_connections 2023-09-30T22:26:12.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.159+0000 7f5ac8f49700 1 -- 172.21.15.154:0/1766590601 wait complete. 2023-09-30T22:26:12.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.174+0000 7ff2daaf6700 1 -- 172.21.15.154:0/2835555349 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff2d4072980 con 0x7ff2d406cc70 2023-09-30T22:26:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.175+0000 7ff2d17fa700 1 -- 172.21.15.154:0/2835555349 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2c80197c0 con 0x7ff2d406cc70 2023-09-30T22:26:12.175 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:12.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.177+0000 7ff2daaf6700 1 -- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2d406cc70 msgr2=0x7ff2d41250b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:12.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.177+0000 7ff2daaf6700 1 --2- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2d406cc70 0x7ff2d41250b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009fd0 tx=0x7ff2c8004750 comp rx=0 tx=0).stop 2023-09-30T22:26:12.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.177+0000 7ff2daaf6700 1 -- 172.21.15.154:0/2835555349 shutdown_connections 2023-09-30T22:26:12.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.177+0000 7ff2daaf6700 1 --2- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2d413c200 0x7ff2d4125b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.177+0000 7ff2daaf6700 1 --2- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2d406cc70 0x7ff2d41250b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.177+0000 7ff2daaf6700 1 --2- 172.21.15.154:0/2835555349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2d40a0fb0 0x7ff2d41255f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:12.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.177+0000 7ff2daaf6700 1 -- 172.21.15.154:0/2835555349 >> 172.21.15.154:0/2835555349 conn(0x7ff2d40a6610 msgr2=0x7ff2d40a2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:12.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.177+0000 7ff2daaf6700 1 -- 172.21.15.154:0/2835555349 shutdown_connections 2023-09-30T22:26:12.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:12.177+0000 7ff2daaf6700 1 -- 172.21.15.154:0/2835555349 wait complete. 2023-09-30T22:26:12.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:13.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:13.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:13.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:13.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:13.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.225+0000 7f5571d5b700 1 Processor -- start 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.225+0000 7f5571d5b700 1 -- start start 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.225+0000 7f5571d5b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.225+0000 7f5571d5b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.225+0000 7f5571d5b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556c09aaa0 con 0x7f556c09e170 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.225+0000 7f5571d5b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09f870 con 0x7f556c09d860 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.225+0000 7f5571d5b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09b360 con 0x7f556c130eb0 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60912/0 (socket says 172.21.15.154:60912) 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556bfff700 1 -- 172.21.15.154:0/3014497860 learned_addr learned my addr 172.21.15.154:0/3014497860 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:13.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556b7fe700 1 --2- 172.21.15.154:0/3014497860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556b7fe700 1 -- 172.21.15.154:0/3014497860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 msgr2=0x7f556c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556b7fe700 1 --2- 172.21.15.154:0/3014497860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556b7fe700 1 -- 172.21.15.154:0/3014497860 >> v1:172.21.15.154:6789/0 conn(0x7f556c09e170 legacy=0x7f556c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556b7fe700 1 -- 172.21.15.154:0/3014497860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c09b620 con 0x7f556c09d860 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556a7fc700 1 -- 172.21.15.154:0/3014497860 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891053496 0 0) 0x7f556c09aaa0 con 0x7f556c09e170 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556bfff700 1 --2- 172.21.15.154:0/3014497860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.226+0000 7f556b7fe700 1 --2- 172.21.15.154:0/3014497860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c09dc30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f555c009870 tx=0x7f555c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df7a08c90bc91c78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f556a7fc700 1 -- 172.21.15.154:0/3014497860 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c011830 con 0x7f556c09d860 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f556a7fc700 1 -- 172.21.15.154:0/3014497860 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c011990 con 0x7f556c09d860 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f556a7fc700 1 -- 172.21.15.154:0/3014497860 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c011d20 con 0x7f556c09d860 2023-09-30T22:26:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f5571d5b700 1 -- 172.21.15.154:0/3014497860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 msgr2=0x7f556c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f5571d5b700 1 --2- 172.21.15.154:0/3014497860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c09dc30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f555c009870 tx=0x7f555c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:13.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f5571d5b700 1 -- 172.21.15.154:0/3014497860 shutdown_connections 2023-09-30T22:26:13.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f5571d5b700 1 --2- 172.21.15.154:0/3014497860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f5571d5b700 1 --2- 172.21.15.154:0/3014497860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c09dc30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f5571d5b700 1 -- 172.21.15.154:0/3014497860 >> 172.21.15.154:0/3014497860 conn(0x7f556c099c40 msgr2=0x7f556c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f5571d5b700 1 -- 172.21.15.154:0/3014497860 shutdown_connections 2023-09-30T22:26:13.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.227+0000 7f5571d5b700 1 -- 172.21.15.154:0/3014497860 wait complete. 2023-09-30T22:26:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.228+0000 7f5571d5b700 1 Processor -- start 2023-09-30T22:26:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f5571d5b700 1 -- start start 2023-09-30T22:26:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f5571d5b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c11e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f5571d5b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c09e170 0x7f556c11ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f5571d5b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c11f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f5571d5b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c121c90 con 0x7f556c09e170 2023-09-30T22:26:13.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f5571d5b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c122d80 con 0x7f556c09d860 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f5571d5b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c12c1e0 con 0x7f556c130eb0 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f556affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c09e170 0x7f556c11ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f556affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c09e170 0x7f556c11ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35232/0 (socket says 172.21.15.154:35232) 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f556affd700 1 -- 172.21.15.154:0/3065443439 learned_addr learned my addr 172.21.15.154:0/3065443439 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f556b7fe700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c11e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.229+0000 7f556bfff700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c11f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f556b7fe700 1 -- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 msgr2=0x7f556c11f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f556b7fe700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c11f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f556b7fe700 1 -- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c09e170 msgr2=0x7f556c11ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f556b7fe700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c09e170 0x7f556c11ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f556b7fe700 1 -- 172.21.15.154:0/3065443439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556400bd40 con 0x7f556c09d860 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f556affd700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c09e170 0x7f556c11ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f556b7fe700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c11e680 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f555c016000 tx=0x7f555c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f5553fff700 1 -- 172.21.15.154:0/3065443439 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c004300 con 0x7f556c09d860 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f5553fff700 1 -- 172.21.15.154:0/3065443439 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c01f070 con 0x7f556c09d860 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f5553fff700 1 -- 172.21.15.154:0/3065443439 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c0036a0 con 0x7f556c09d860 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f5571d5b700 1 -- 172.21.15.154:0/3065443439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c0094a0 con 0x7f556c09d860 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.230+0000 7f5571d5b700 1 -- 172.21.15.154:0/3065443439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c121f10 con 0x7f556c09d860 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.231+0000 7f5553fff700 1 -- 172.21.15.154:0/3065443439 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f555c021030 con 0x7f556c09d860 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.231+0000 7f5553fff700 1 -- 172.21.15.154:0/3065443439 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f555c0431c0 con 0x7f556c09d860 2023-09-30T22:26:13.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.231+0000 7f5571d5b700 1 -- 172.21.15.154:0/3065443439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556c04f2a0 con 0x7f556c09d860 2023-09-30T22:26:13.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.237+0000 7f5553fff700 1 -- 172.21.15.154:0/3065443439 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f555c015070 con 0x7f556c09d860 2023-09-30T22:26:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.272+0000 7f6775b36700 1 Processor -- start 2023-09-30T22:26:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.272+0000 7f6775b36700 1 -- start start 2023-09-30T22:26:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.273+0000 7f6775b36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 0x7f6770138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.273+0000 7f6775b36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6770139280 0x7f677013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.273+0000 7f6775b36700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677006b2d0 con 0x7f6770133ad0 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.273+0000 7f6775b36700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67701345b0 con 0x7f6770139280 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.273+0000 7f6775b36700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6770133610 con 0x7f6770136960 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6770139280 0x7f677013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6770139280 0x7f677013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35244/0 (socket says 172.21.15.154:35244) 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676ffff700 1 -- 172.21.15.154:0/2493436375 learned_addr learned my addr 172.21.15.154:0/2493436375 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676effd700 1 --2- 172.21.15.154:0/2493436375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 0x7f6770138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676ffff700 1 -- 172.21.15.154:0/2493436375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 msgr2=0x7f6770138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676ffff700 1 --2- 172.21.15.154:0/2493436375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 0x7f6770138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676ffff700 1 -- 172.21.15.154:0/2493436375 >> v1:172.21.15.154:6789/0 conn(0x7f6770133ad0 legacy=0x7f6770133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676ffff700 1 -- 172.21.15.154:0/2493436375 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677009a500 con 0x7f6770139280 2023-09-30T22:26:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676ffff700 1 --2- 172.21.15.154:0/2493436375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6770139280 0x7f677013b660 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6768009e80 tx=0x7f676800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116556076251082a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676e7fc700 1 -- 172.21.15.154:0/2493436375 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800e070 con 0x7f6770139280 2023-09-30T22:26:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676e7fc700 1 -- 172.21.15.154:0/2493436375 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676800b8d0 con 0x7f6770139280 2023-09-30T22:26:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.274+0000 7f676e7fc700 1 -- 172.21.15.154:0/2493436375 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800bc80 con 0x7f6770139280 2023-09-30T22:26:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.275+0000 7f6775b36700 1 -- 172.21.15.154:0/2493436375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6770139280 msgr2=0x7f677013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.275+0000 7f6775b36700 1 --2- 172.21.15.154:0/2493436375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6770139280 0x7f677013b660 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6768009e80 tx=0x7f676800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.275+0000 7f6775b36700 1 -- 172.21.15.154:0/2493436375 shutdown_connections 2023-09-30T22:26:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.275+0000 7f6775b36700 1 --2- 172.21.15.154:0/2493436375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6770139280 0x7f677013b660 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.275+0000 7f6775b36700 1 --2- 172.21.15.154:0/2493436375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 0x7f6770138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.275+0000 7f6775b36700 1 -- 172.21.15.154:0/2493436375 >> 172.21.15.154:0/2493436375 conn(0x7f6770099c40 msgr2=0x7f67700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.275+0000 7f6775b36700 1 -- 172.21.15.154:0/2493436375 shutdown_connections 2023-09-30T22:26:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.275+0000 7f6775b36700 1 -- 172.21.15.154:0/2493436375 wait complete. 2023-09-30T22:26:13.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.276+0000 7f6775b36700 1 Processor -- start 2023-09-30T22:26:13.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.276+0000 7f6775b36700 1 -- start start 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f6775b36700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6770133ad0 0x7f677012c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f6775b36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 0x7f677012cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f6775b36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6770139280 0x7f677012d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f6775b36700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6770072700 con 0x7f6770133ad0 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f6775b36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6770130470 con 0x7f6770139280 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f6775b36700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6770138de0 con 0x7f6770136960 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f676ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6770139280 0x7f677012d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f676ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6770139280 0x7f677012d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51808/0 (socket says 172.21.15.154:51808) 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f676ffff700 1 -- 172.21.15.154:0/939366971 learned_addr learned my addr 172.21.15.154:0/939366971 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:13.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f676effd700 1 --2- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 0x7f677012cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.277+0000 7f676f7fe700 1 --2- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6770133ad0 0x7f677012c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f676effd700 1 -- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6770139280 msgr2=0x7f677012d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f676effd700 1 --2- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6770139280 0x7f677012d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f676effd700 1 -- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6770133ad0 msgr2=0x7f677012c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f676effd700 1 --2- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6770133ad0 0x7f677012c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f676effd700 1 -- 172.21.15.154:0/939366971 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768009b30 con 0x7f6770136960 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f676effd700 1 --2- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 0x7f677012cca0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f676400e870 tx=0x7f676400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f6757fff700 1 -- 172.21.15.154:0/939366971 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764013680 con 0x7f6770136960 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f6757fff700 1 -- 172.21.15.154:0/939366971 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67640137e0 con 0x7f6770136960 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f6775b36700 1 -- 172.21.15.154:0/939366971 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677009f390 con 0x7f6770136960 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f6757fff700 1 -- 172.21.15.154:0/939366971 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764013b90 con 0x7f6770136960 2023-09-30T22:26:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.278+0000 7f6775b36700 1 -- 172.21.15.154:0/939366971 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67700703e0 con 0x7f6770136960 2023-09-30T22:26:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.279+0000 7f6757fff700 1 -- 172.21.15.154:0/939366971 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6764013cf0 con 0x7f6770136960 2023-09-30T22:26:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.279+0000 7f6757fff700 1 -- 172.21.15.154:0/939366971 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f676403f960 con 0x7f6770136960 2023-09-30T22:26:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.279+0000 7f6775b36700 1 -- 172.21.15.154:0/939366971 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677004f2a0 con 0x7f6770136960 2023-09-30T22:26:13.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.284+0000 7f6757fff700 1 -- 172.21.15.154:0/939366971 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6764021080 con 0x7f6770136960 2023-09-30T22:26:13.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.313+0000 7fb66fc41700 1 Processor -- start 2023-09-30T22:26:13.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.314+0000 7fb66fc41700 1 -- start start 2023-09-30T22:26:13.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.314+0000 7fb66fc41700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 0x7fb66809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.314+0000 7fb66fc41700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb66809e170 0x7fb6681307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.314+0000 7fb66fc41700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66809aaa0 con 0x7fb668130ce0 2023-09-30T22:26:13.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.314+0000 7fb66fc41700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66809f870 con 0x7fb66809e170 2023-09-30T22:26:13.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.314+0000 7fb66fc41700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb66809b360 con 0x7fb66809d860 2023-09-30T22:26:13.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66d1dc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb66809e170 0x7fb6681307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66d1dc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb66809e170 0x7fb6681307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35268/0 (socket says 172.21.15.154:35268) 2023-09-30T22:26:13.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66d1dc700 1 -- 172.21.15.154:0/24534285 learned_addr learned my addr 172.21.15.154:0/24534285 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:13.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66d9dd700 1 --2- 172.21.15.154:0/24534285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 0x7fb66809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66d1dc700 1 -- 172.21.15.154:0/24534285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 msgr2=0x7fb66809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:13.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66d1dc700 1 --2- 172.21.15.154:0/24534285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 0x7fb66809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66d1dc700 1 -- 172.21.15.154:0/24534285 >> v1:172.21.15.154:6789/0 conn(0x7fb668130ce0 legacy=0x7fb6681379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66d1dc700 1 -- 172.21.15.154:0/24534285 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66809b620 con 0x7fb66809e170 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66d1dc700 1 --2- 172.21.15.154:0/24534285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 0x7fb6681307a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb65800bb90 tx=0x7fb65800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a99c29e5f0ac0d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.315+0000 7fb66c9db700 1 -- 172.21.15.154:0/24534285 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800dd30 con 0x7fb66809e170 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.316+0000 7fb66c9db700 1 -- 172.21.15.154:0/24534285 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65800de90 con 0x7fb66809e170 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.316+0000 7fb66c9db700 1 -- 172.21.15.154:0/24534285 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658010690 con 0x7fb66809e170 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.316+0000 7fb66fc41700 1 -- 172.21.15.154:0/24534285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 msgr2=0x7fb6681307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.316+0000 7fb66fc41700 1 --2- 172.21.15.154:0/24534285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 0x7fb6681307a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb65800bb90 tx=0x7fb65800bea0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.317+0000 7fb66fc41700 1 -- 172.21.15.154:0/24534285 shutdown_connections 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.317+0000 7fb66fc41700 1 --2- 172.21.15.154:0/24534285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 0x7fb66809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.317+0000 7fb66fc41700 1 --2- 172.21.15.154:0/24534285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 0x7fb6681307a0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.317+0000 7fb66fc41700 1 -- 172.21.15.154:0/24534285 >> 172.21.15.154:0/24534285 conn(0x7fb668099c40 msgr2=0x7fb6680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.317+0000 7fb66fc41700 1 -- 172.21.15.154:0/24534285 shutdown_connections 2023-09-30T22:26:13.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.317+0000 7fb66fc41700 1 -- 172.21.15.154:0/24534285 wait complete. 2023-09-30T22:26:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.318+0000 7fb66fc41700 1 Processor -- start 2023-09-30T22:26:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.318+0000 7fb66fc41700 1 -- start start 2023-09-30T22:26:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66fc41700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 0x7fb668123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66fc41700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 0x7fb6681238d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66fc41700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb668130ce0 0x7fb6681c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66fc41700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6681263e0 con 0x7fb66809e170 2023-09-30T22:26:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66fc41700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6681265e0 con 0x7fb668130ce0 2023-09-30T22:26:13.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66fc41700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6681246d0 con 0x7fb66809d860 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66d1dc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 0x7fb6681238d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66d1dc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 0x7fb6681238d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35278/0 (socket says 172.21.15.154:35278) 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66d1dc700 1 -- 172.21.15.154:0/1072411640 learned_addr learned my addr 172.21.15.154:0/1072411640 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66e1de700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb668130ce0 0x7fb6681c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66d9dd700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 0x7fb668123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66d1dc700 1 -- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 msgr2=0x7fb668123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66d1dc700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 0x7fb668123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66d1dc700 1 -- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb668130ce0 msgr2=0x7fb6681c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66d1dc700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb668130ce0 0x7fb6681c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.319+0000 7fb66d1dc700 1 -- 172.21.15.154:0/1072411640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65800b7f0 con 0x7fb66809e170 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.320+0000 7fb66e1de700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb668130ce0 0x7fb6681c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:13.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.320+0000 7fb66d1dc700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 0x7fb6681238d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb658000c00 tx=0x7fb658004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.320+0000 7fb65e7fc700 1 -- 172.21.15.154:0/1072411640 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658003bf0 con 0x7fb66809e170 2023-09-30T22:26:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.320+0000 7fb65e7fc700 1 -- 172.21.15.154:0/1072411640 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb658003d50 con 0x7fb66809e170 2023-09-30T22:26:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.320+0000 7fb66fc41700 1 -- 172.21.15.154:0/1072411640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6680a2170 con 0x7fb66809e170 2023-09-30T22:26:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.320+0000 7fb65e7fc700 1 -- 172.21.15.154:0/1072411640 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658010670 con 0x7fb66809e170 2023-09-30T22:26:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.320+0000 7fb66fc41700 1 -- 172.21.15.154:0/1072411640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb668122f10 con 0x7fb66809e170 2023-09-30T22:26:13.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.321+0000 7fb65e7fc700 1 -- 172.21.15.154:0/1072411640 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb658019400 con 0x7fb66809e170 2023-09-30T22:26:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.321+0000 7fb66fc41700 1 -- 172.21.15.154:0/1072411640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66804f2a0 con 0x7fb66809e170 2023-09-30T22:26:13.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.321+0000 7fb65e7fc700 1 -- 172.21.15.154:0/1072411640 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb658040ab0 con 0x7fb66809e170 2023-09-30T22:26:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.330+0000 7fb65e7fc700 1 -- 172.21.15.154:0/1072411640 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6580196b0 con 0x7fb66809e170 2023-09-30T22:26:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.362+0000 7f8341705700 1 Processor -- start 2023-09-30T22:26:13.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.362+0000 7f8341705700 1 -- start start 2023-09-30T22:26:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.363+0000 7f8341705700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c136960 0x7f833c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.363+0000 7f8341705700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f833c139280 0x7f833c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.363+0000 7f8341705700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c06b2d0 con 0x7f833c133ad0 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.363+0000 7f8341705700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c1345b0 con 0x7f833c139280 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.363+0000 7f8341705700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c133610 con 0x7f833c136960 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.363+0000 7f833a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c136960 0x7f833c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.363+0000 7f833a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c136960 0x7f833c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51836/0 (socket says 172.21.15.154:51836) 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.363+0000 7f833a7fc700 1 -- 172.21.15.154:0/373667260 learned_addr learned my addr 172.21.15.154:0/373667260 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.363+0000 7f833b7fe700 1 --2- 172.21.15.154:0/373667260 >> v2:172.21.15.154:3300/0 conn(0x7f833c139280 0x7f833c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.364+0000 7f833a7fc700 1 -- 172.21.15.154:0/373667260 >> v2:172.21.15.154:3300/0 conn(0x7f833c139280 msgr2=0x7f833c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.364+0000 7f833a7fc700 1 --2- 172.21.15.154:0/373667260 >> v2:172.21.15.154:3300/0 conn(0x7f833c139280 0x7f833c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.364+0000 7f833a7fc700 1 -- 172.21.15.154:0/373667260 >> v1:172.21.15.154:6789/0 conn(0x7f833c133ad0 legacy=0x7f833c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.364+0000 7f833a7fc700 1 -- 172.21.15.154:0/373667260 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c09a500 con 0x7f833c136960 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.364+0000 7f833b7fe700 1 --2- 172.21.15.154:0/373667260 >> v2:172.21.15.154:3300/0 conn(0x7f833c139280 0x7f833c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.364+0000 7f833a7fc700 1 --2- 172.21.15.154:0/373667260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c136960 0x7f833c138d40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8330009920 tx=0x7f8330009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbe33b6d971b45b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.364+0000 7f8339ffb700 1 -- 172.21.15.154:0/373667260 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330011830 con 0x7f833c136960 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.364+0000 7f8339ffb700 1 -- 172.21.15.154:0/373667260 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8330011990 con 0x7f833c136960 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.364+0000 7f8339ffb700 1 -- 172.21.15.154:0/373667260 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330011d20 con 0x7f833c136960 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.365+0000 7f8341705700 1 -- 172.21.15.154:0/373667260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c136960 msgr2=0x7f833c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.365+0000 7f8341705700 1 --2- 172.21.15.154:0/373667260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c136960 0x7f833c138d40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8330009920 tx=0x7f8330009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.365+0000 7f8341705700 1 -- 172.21.15.154:0/373667260 shutdown_connections 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.365+0000 7f8341705700 1 --2- 172.21.15.154:0/373667260 >> v2:172.21.15.154:3300/0 conn(0x7f833c139280 0x7f833c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.365+0000 7f8341705700 1 --2- 172.21.15.154:0/373667260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c136960 0x7f833c138d40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.365+0000 7f8341705700 1 -- 172.21.15.154:0/373667260 >> 172.21.15.154:0/373667260 conn(0x7f833c099c40 msgr2=0x7f833c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.365+0000 7f8341705700 1 -- 172.21.15.154:0/373667260 shutdown_connections 2023-09-30T22:26:13.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.365+0000 7f8341705700 1 -- 172.21.15.154:0/373667260 wait complete. 2023-09-30T22:26:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f8341705700 1 Processor -- start 2023-09-30T22:26:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f8341705700 1 -- start start 2023-09-30T22:26:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f8341705700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c133ad0 0x7f833c071780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f8341705700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f833c136960 0x7f833c071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f8341705700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f833c139280 0x7f833c1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f8341705700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c06e900 con 0x7f833c136960 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f8341705700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c1317a0 con 0x7f833c133ad0 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f8341705700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f833c09f390 con 0x7f833c139280 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f833b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f833c139280 0x7f833c1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f833b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f833c139280 0x7f833c1c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60962/0 (socket says 172.21.15.154:60962) 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f833b7fe700 1 -- 172.21.15.154:0/111573425 learned_addr learned my addr 172.21.15.154:0/111573425 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.366+0000 7f833a7fc700 1 --2- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f833c136960 0x7f833c071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.367+0000 7f833b7fe700 1 -- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c133ad0 msgr2=0x7f833c071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.367+0000 7f833b7fe700 1 --2- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c133ad0 0x7f833c071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.367+0000 7f833b7fe700 1 -- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f833c136960 msgr2=0x7f833c071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.367+0000 7f833b7fe700 1 --2- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f833c136960 0x7f833c071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.367+0000 7f833b7fe700 1 -- 172.21.15.154:0/111573425 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8334009a70 con 0x7f833c139280 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.367+0000 7f833b7fe700 1 --2- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f833c139280 0x7f833c1c8570 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f833400efc0 tx=0x7f833400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.367+0000 7f83237fe700 1 -- 172.21.15.154:0/111573425 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833400cb40 con 0x7f833c139280 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.367+0000 7f83237fe700 1 -- 172.21.15.154:0/111573425 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833400f040 con 0x7f833c139280 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.367+0000 7f83237fe700 1 -- 172.21.15.154:0/111573425 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334003a20 con 0x7f833c139280 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.368+0000 7f8341705700 1 -- 172.21.15.154:0/111573425 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8330009550 con 0x7f833c139280 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.368+0000 7f8341705700 1 -- 172.21.15.154:0/111573425 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c072200 con 0x7f833c139280 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.369+0000 7f8341705700 1 -- 172.21.15.154:0/111573425 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c070080 con 0x7f833c139280 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.369+0000 7f83237fe700 1 -- 172.21.15.154:0/111573425 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8334014480 con 0x7f833c139280 2023-09-30T22:26:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.369+0000 7f83237fe700 1 -- 172.21.15.154:0/111573425 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8334040170 con 0x7f833c139280 2023-09-30T22:26:13.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.373+0000 7f83237fe700 1 -- 172.21.15.154:0/111573425 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f833c070080 con 0x7f833c139280 2023-09-30T22:26:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.441+0000 7f5571d5b700 1 -- 172.21.15.154:0/3065443439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f556c120a80 con 0x7f556c09d860 2023-09-30T22:26:13.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.441+0000 7f5553fff700 1 -- 172.21.15.154:0/3065443439 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f555c015020 con 0x7f556c09d860 2023-09-30T22:26:13.441 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.443+0000 7f5571d5b700 1 -- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 msgr2=0x7f556c11e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.443+0000 7f5571d5b700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c11e680 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f555c016000 tx=0x7f555c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.443+0000 7f5571d5b700 1 -- 172.21.15.154:0/3065443439 shutdown_connections 2023-09-30T22:26:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.443+0000 7f5571d5b700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f556c130eb0 0x7f556c11f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.443+0000 7f5571d5b700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f556c09d860 0x7f556c11e680 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.443+0000 7f5571d5b700 1 --2- 172.21.15.154:0/3065443439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f556c09e170 0x7f556c11ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.443+0000 7f5571d5b700 1 -- 172.21.15.154:0/3065443439 >> 172.21.15.154:0/3065443439 conn(0x7f556c099c40 msgr2=0x7f556c0721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.444+0000 7f5571d5b700 1 -- 172.21.15.154:0/3065443439 shutdown_connections 2023-09-30T22:26:13.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.444+0000 7f5571d5b700 1 -- 172.21.15.154:0/3065443439 wait complete. 2023-09-30T22:26:13.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.489+0000 7f6775b36700 1 -- 172.21.15.154:0/939366971 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f677009f0f0 con 0x7f6770136960 2023-09-30T22:26:13.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.489+0000 7f6757fff700 1 -- 172.21.15.154:0/939366971 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6764017020 con 0x7f6770136960 2023-09-30T22:26:13.490 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.492+0000 7f6775b36700 1 -- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 msgr2=0x7f677012cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.492+0000 7f6775b36700 1 --2- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 0x7f677012cca0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f676400e870 tx=0x7f676400eb80 comp rx=0 tx=0).stop 2023-09-30T22:26:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.492+0000 7f6775b36700 1 -- 172.21.15.154:0/939366971 shutdown_connections 2023-09-30T22:26:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.492+0000 7f6775b36700 1 --2- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6770139280 0x7f677012d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.492+0000 7f6775b36700 1 --2- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6770133ad0 0x7f677012c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.492+0000 7f6775b36700 1 --2- 172.21.15.154:0/939366971 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6770136960 0x7f677012cca0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.492+0000 7f6775b36700 1 -- 172.21.15.154:0/939366971 >> 172.21.15.154:0/939366971 conn(0x7f6770099c40 msgr2=0x7f67701372a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.492+0000 7f6775b36700 1 -- 172.21.15.154:0/939366971 shutdown_connections 2023-09-30T22:26:13.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.492+0000 7f6775b36700 1 -- 172.21.15.154:0/939366971 wait complete. 2023-09-30T22:26:13.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.524+0000 7fb66fc41700 1 -- 172.21.15.154:0/1072411640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb66809c8b0 con 0x7fb66809e170 2023-09-30T22:26:13.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.525+0000 7fb65e7fc700 1 -- 172.21.15.154:0/1072411640 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb658018360 con 0x7fb66809e170 2023-09-30T22:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:13.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.527+0000 7fb66fc41700 1 -- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 msgr2=0x7fb6681238d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.527+0000 7fb66fc41700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 0x7fb6681238d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb658000c00 tx=0x7fb658004750 comp rx=0 tx=0).stop 2023-09-30T22:26:13.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.527+0000 7fb66fc41700 1 -- 172.21.15.154:0/1072411640 shutdown_connections 2023-09-30T22:26:13.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.527+0000 7fb66fc41700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb668130ce0 0x7fb6681c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.527+0000 7fb66fc41700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb66809d860 0x7fb668123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.527+0000 7fb66fc41700 1 --2- 172.21.15.154:0/1072411640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb66809e170 0x7fb6681238d0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.527+0000 7fb66fc41700 1 -- 172.21.15.154:0/1072411640 >> 172.21.15.154:0/1072411640 conn(0x7fb668099c40 msgr2=0x7fb6680a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.527+0000 7fb66fc41700 1 -- 172.21.15.154:0/1072411640 shutdown_connections 2023-09-30T22:26:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.527+0000 7fb66fc41700 1 -- 172.21.15.154:0/1072411640 wait complete. 2023-09-30T22:26:13.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.569+0000 7f8341705700 1 -- 172.21.15.154:0/111573425 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f833c070080 con 0x7f833c139280 2023-09-30T22:26:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.569+0000 7f83237fe700 1 -- 172.21.15.154:0/111573425 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f833c070080 con 0x7f833c139280 2023-09-30T22:26:13.569 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:13.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.571+0000 7f8341705700 1 -- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f833c139280 msgr2=0x7f833c1c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:13.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.571+0000 7f8341705700 1 --2- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f833c139280 0x7f833c1c8570 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f833400efc0 tx=0x7f833400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.572+0000 7f8341705700 1 -- 172.21.15.154:0/111573425 shutdown_connections 2023-09-30T22:26:13.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.572+0000 7f8341705700 1 --2- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f833c139280 0x7f833c1c8570 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.572+0000 7f8341705700 1 --2- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f833c133ad0 0x7f833c071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.572+0000 7f8341705700 1 --2- 172.21.15.154:0/111573425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f833c136960 0x7f833c071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:13.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.572+0000 7f8341705700 1 -- 172.21.15.154:0/111573425 >> 172.21.15.154:0/111573425 conn(0x7f833c099c40 msgr2=0x7f833c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:13.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.572+0000 7f8341705700 1 -- 172.21.15.154:0/111573425 shutdown_connections 2023-09-30T22:26:13.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:13.572+0000 7f8341705700 1 -- 172.21.15.154:0/111573425 wait complete. 2023-09-30T22:26:13.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:14.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:14.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:14.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:14.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:14.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.599+0000 7f44acaae700 1 Processor -- start 2023-09-30T22:26:14.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.599+0000 7f44acaae700 1 -- start start 2023-09-30T22:26:14.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.600+0000 7f44acaae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 0x7f44a813ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.600+0000 7f44acaae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a813d210 0x7f44a813f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.600+0000 7f44acaae700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a809eca0 con 0x7f44a806a770 2023-09-30T22:26:14.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.600+0000 7f44acaae700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a806b2e0 con 0x7f44a81350d0 2023-09-30T22:26:14.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.600+0000 7f44acaae700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44a809f720 con 0x7f44a813d210 2023-09-30T22:26:14.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.600+0000 7f44a659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f44a806a770 0x7f44a81349c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37746/0 (socket says 172.21.15.154:37746) 2023-09-30T22:26:14.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.600+0000 7f44a659c700 1 -- 172.21.15.154:0/1362483987 learned_addr learned my addr 172.21.15.154:0/1362483987 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:14.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.600+0000 7f44a6d9d700 1 --2- 172.21.15.154:0/1362483987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a813d210 0x7f44a813f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.600+0000 7f44a559a700 1 -- 172.21.15.154:0/1362483987 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952938809 0 0) 0x7f44a809eca0 con 0x7f44a806a770 2023-09-30T22:26:14.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a5d9b700 1 --2- 172.21.15.154:0/1362483987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 0x7f44a813ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a559a700 1 -- 172.21.15.154:0/1362483987 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44900035b0 con 0x7f44a806a770 2023-09-30T22:26:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a6d9d700 1 -- 172.21.15.154:0/1362483987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 msgr2=0x7f44a813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a6d9d700 1 --2- 172.21.15.154:0/1362483987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 0x7f44a813ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a6d9d700 1 -- 172.21.15.154:0/1362483987 >> v1:172.21.15.154:6789/0 conn(0x7f44a806a770 legacy=0x7f44a81349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a6d9d700 1 -- 172.21.15.154:0/1362483987 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a806b480 con 0x7f44a813d210 2023-09-30T22:26:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a6d9d700 1 --2- 172.21.15.154:0/1362483987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a813d210 0x7f44a813f5f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009df0 tx=0x7f44a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbde42da4a7894ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a559a700 1 -- 172.21.15.154:0/1362483987 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000e070 con 0x7f44a813d210 2023-09-30T22:26:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a559a700 1 -- 172.21.15.154:0/1362483987 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a000bae0 con 0x7f44a813d210 2023-09-30T22:26:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.601+0000 7f44a559a700 1 -- 172.21.15.154:0/1362483987 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000be90 con 0x7f44a813d210 2023-09-30T22:26:14.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.602+0000 7f44acaae700 1 -- 172.21.15.154:0/1362483987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a813d210 msgr2=0x7f44a813f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.602+0000 7f44acaae700 1 --2- 172.21.15.154:0/1362483987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a813d210 0x7f44a813f5f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009df0 tx=0x7f44a000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:14.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.602+0000 7f44acaae700 1 -- 172.21.15.154:0/1362483987 shutdown_connections 2023-09-30T22:26:14.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.602+0000 7f44acaae700 1 --2- 172.21.15.154:0/1362483987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a813d210 0x7f44a813f5f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.602+0000 7f44acaae700 1 --2- 172.21.15.154:0/1362483987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 0x7f44a813ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.602+0000 7f44acaae700 1 -- 172.21.15.154:0/1362483987 >> 172.21.15.154:0/1362483987 conn(0x7f44a8099c40 msgr2=0x7f44a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.602+0000 7f44acaae700 1 -- 172.21.15.154:0/1362483987 shutdown_connections 2023-09-30T22:26:14.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.602+0000 7f44acaae700 1 -- 172.21.15.154:0/1362483987 wait complete. 2023-09-30T22:26:14.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.604+0000 7f44acaae700 1 Processor -- start 2023-09-30T22:26:14.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.604+0000 7f44acaae700 1 -- start start 2023-09-30T22:26:14.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44acaae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a806a770 0x7f44a806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44acaae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 0x7f44a80700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44acaae700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44a813d210 0x7f44a80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44acaae700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8071000 con 0x7f44a813d210 2023-09-30T22:26:14.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44acaae700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8134240 con 0x7f44a81350d0 2023-09-30T22:26:14.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44acaae700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8119de0 con 0x7f44a806a770 2023-09-30T22:26:14.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a806a770 0x7f44a806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a806a770 0x7f44a806fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60972/0 (socket says 172.21.15.154:60972) 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a6d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44a813d210 0x7f44a80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a659c700 1 -- 172.21.15.154:0/1537367439 learned_addr learned my addr 172.21.15.154:0/1537367439 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a5d9b700 1 --2- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 0x7f44a80700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a6d9d700 1 -- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a806a770 msgr2=0x7f44a806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a6d9d700 1 --2- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a806a770 0x7f44a806fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a6d9d700 1 -- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 msgr2=0x7f44a80700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a6d9d700 1 --2- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 0x7f44a80700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.605+0000 7f44a6d9d700 1 -- 172.21.15.154:0/1537367439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a0009a70 con 0x7f44a813d210 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.606+0000 7f44a6d9d700 1 --2- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44a813d210 0x7f44a80705f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f44a0016000 tx=0x7f44a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.606+0000 7f4496ffd700 1 -- 172.21.15.154:0/1537367439 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00045f0 con 0x7f44a813d210 2023-09-30T22:26:14.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.606+0000 7f4496ffd700 1 -- 172.21.15.154:0/1537367439 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a0020070 con 0x7f44a813d210 2023-09-30T22:26:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.606+0000 7f4496ffd700 1 -- 172.21.15.154:0/1537367439 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0025430 con 0x7f44a813d210 2023-09-30T22:26:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.607+0000 7f44acaae700 1 -- 172.21.15.154:0/1537367439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a809b0f0 con 0x7f44a813d210 2023-09-30T22:26:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.607+0000 7f44acaae700 1 -- 172.21.15.154:0/1537367439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a809f220 con 0x7f44a813d210 2023-09-30T22:26:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.607+0000 7f4496ffd700 1 -- 172.21.15.154:0/1537367439 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44a0022030 con 0x7f44a813d210 2023-09-30T22:26:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.608+0000 7f4496ffd700 1 -- 172.21.15.154:0/1537367439 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f44a0041670 con 0x7f44a813d210 2023-09-30T22:26:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.608+0000 7f44acaae700 1 -- 172.21.15.154:0/1537367439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a804f2a0 con 0x7f44a813d210 2023-09-30T22:26:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.613+0000 7f4496ffd700 1 -- 172.21.15.154:0/1537367439 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44a0012430 con 0x7f44a813d210 2023-09-30T22:26:14.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.643+0000 7f03870ca700 1 Processor -- start 2023-09-30T22:26:14.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.643+0000 7f03870ca700 1 -- start start 2023-09-30T22:26:14.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.643+0000 7f03870ca700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0380133900 0x7f0380133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.643+0000 7f03870ca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380134210 0x7f03800a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.643+0000 7f03870ca700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038009a760 con 0x7f03800a0ee0 2023-09-30T22:26:14.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.643+0000 7f03870ca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03801336e0 con 0x7f0380134210 2023-09-30T22:26:14.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.643+0000 7f03870ca700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f038009a080 con 0x7f0380133900 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f0385667700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f03800a0ee0 0x7f038013a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37756/0 (socket says 172.21.15.154:37756) 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f0385667700 1 -- 172.21.15.154:0/2567011346 learned_addr learned my addr 172.21.15.154:0/2567011346 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f0384e66700 1 --2- 172.21.15.154:0/2567011346 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0380133900 0x7f0380133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f037ffff700 1 --2- 172.21.15.154:0/2567011346 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380134210 0x7f03800a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f0384e66700 1 -- 172.21.15.154:0/2567011346 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380134210 msgr2=0x7f03800a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f0384e66700 1 --2- 172.21.15.154:0/2567011346 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380134210 0x7f03800a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f0384e66700 1 -- 172.21.15.154:0/2567011346 >> v1:172.21.15.154:6789/0 conn(0x7f03800a0ee0 legacy=0x7f038013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f0384e66700 1 -- 172.21.15.154:0/2567011346 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800a23e0 con 0x7f0380133900 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f0384e66700 1 --2- 172.21.15.154:0/2567011346 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0380133900 0x7f0380133cd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0374009850 tx=0x7f0374009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b8f95a8d118d6e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f037f7fe700 1 -- 172.21.15.154:0/2567011346 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374005e30 con 0x7f0380133900 2023-09-30T22:26:14.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f037f7fe700 1 -- 172.21.15.154:0/2567011346 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0374006030 con 0x7f0380133900 2023-09-30T22:26:14.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.644+0000 7f037f7fe700 1 -- 172.21.15.154:0/2567011346 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03740063e0 con 0x7f0380133900 2023-09-30T22:26:14.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.645+0000 7f03870ca700 1 -- 172.21.15.154:0/2567011346 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0380133900 msgr2=0x7f0380133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.645+0000 7f03870ca700 1 --2- 172.21.15.154:0/2567011346 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0380133900 0x7f0380133cd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0374009850 tx=0x7f0374009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.645+0000 7f03870ca700 1 -- 172.21.15.154:0/2567011346 shutdown_connections 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.645+0000 7f03870ca700 1 --2- 172.21.15.154:0/2567011346 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0380133900 0x7f0380133cd0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.645+0000 7f03870ca700 1 --2- 172.21.15.154:0/2567011346 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380134210 0x7f03800a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.645+0000 7f03870ca700 1 -- 172.21.15.154:0/2567011346 >> 172.21.15.154:0/2567011346 conn(0x7f03800a2980 msgr2=0x7f03800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.645+0000 7f03870ca700 1 -- 172.21.15.154:0/2567011346 shutdown_connections 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.645+0000 7f03870ca700 1 -- 172.21.15.154:0/2567011346 wait complete. 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.646+0000 7f03870ca700 1 Processor -- start 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.647+0000 7f03870ca700 1 -- start start 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.647+0000 7f03870ca700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03800a0ee0 0x7f038011d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.647+0000 7f03870ca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380133900 0x7f038011dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.647+0000 7f03870ca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0380134210 0x7f038011e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.647+0000 7f03870ca700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038011f3a0 con 0x7f0380134210 2023-09-30T22:26:14.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.647+0000 7f03870ca700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038009a2c0 con 0x7f0380133900 2023-09-30T22:26:14.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.647+0000 7f03870ca700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03801205f0 con 0x7f03800a0ee0 2023-09-30T22:26:14.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0384e66700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03800a0ee0 0x7f038011d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0384e66700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03800a0ee0 0x7f038011d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60982/0 (socket says 172.21.15.154:60982) 2023-09-30T22:26:14.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0384e66700 1 -- 172.21.15.154:0/3996418495 learned_addr learned my addr 172.21.15.154:0/3996418495 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:14.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f037ffff700 1 --2- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380133900 0x7f038011dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0385667700 1 --2- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0380134210 0x7f038011e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0384e66700 1 -- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380133900 msgr2=0x7f038011dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0384e66700 1 --2- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380133900 0x7f038011dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0384e66700 1 -- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0380134210 msgr2=0x7f038011e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0384e66700 1 --2- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0380134210 0x7f038011e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0384e66700 1 -- 172.21.15.154:0/3996418495 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374009430 con 0x7f03800a0ee0 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f0384e66700 1 --2- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03800a0ee0 0x7f038011d850 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0374009ba0 tx=0x7f0374004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f037d7fa700 1 -- 172.21.15.154:0/3996418495 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03740065b0 con 0x7f03800a0ee0 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f037d7fa700 1 -- 172.21.15.154:0/3996418495 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0374006750 con 0x7f03800a0ee0 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f03870ca700 1 -- 172.21.15.154:0/3996418495 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0380120fd0 con 0x7f03800a0ee0 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f037d7fa700 1 -- 172.21.15.154:0/3996418495 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374004570 con 0x7f03800a0ee0 2023-09-30T22:26:14.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.648+0000 7f03870ca700 1 -- 172.21.15.154:0/3996418495 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0380120a40 con 0x7f03800a0ee0 2023-09-30T22:26:14.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.649+0000 7f036affd700 1 -- 172.21.15.154:0/3996418495 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03580052e0 con 0x7f03800a0ee0 2023-09-30T22:26:14.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.650+0000 7f037d7fa700 1 -- 172.21.15.154:0/3996418495 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0374022070 con 0x7f03800a0ee0 2023-09-30T22:26:14.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.651+0000 7f037d7fa700 1 -- 172.21.15.154:0/3996418495 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0374003e20 con 0x7f03800a0ee0 2023-09-30T22:26:14.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.655+0000 7f037d7fa700 1 -- 172.21.15.154:0/3996418495 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f037402f800 con 0x7f03800a0ee0 2023-09-30T22:26:14.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.682+0000 7f00152cf700 1 Processor -- start 2023-09-30T22:26:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.682+0000 7f00152cf700 1 -- start start 2023-09-30T22:26:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f00152cf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001006a770 0x7f00101349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f00152cf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0010134f00 0x7f001009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f00152cf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001009eca0 con 0x7f001009dea0 2023-09-30T22:26:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f00152cf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001006b2e0 con 0x7f001006a770 2023-09-30T22:26:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f00152cf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f001009f720 con 0x7f0010134f00 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f000effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001006a770 0x7f00101349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f000effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001006a770 0x7f00101349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51896/0 (socket says 172.21.15.154:51896) 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f000effd700 1 -- 172.21.15.154:0/4259318088 learned_addr learned my addr 172.21.15.154:0/4259318088 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f000e7fc700 1 --2- 172.21.15.154:0/4259318088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0010134f00 0x7f001009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f000e7fc700 1 -- 172.21.15.154:0/4259318088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001006a770 msgr2=0x7f00101349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.683+0000 7f000e7fc700 1 --2- 172.21.15.154:0/4259318088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001006a770 0x7f00101349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.684+0000 7f000e7fc700 1 -- 172.21.15.154:0/4259318088 >> v1:172.21.15.154:6789/0 conn(0x7f001009dea0 legacy=0x7f001013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.684+0000 7f000e7fc700 1 -- 172.21.15.154:0/4259318088 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001006b480 con 0x7f0010134f00 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.684+0000 7f000e7fc700 1 --2- 172.21.15.154:0/4259318088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0010134f00 0x7f001009d960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0004009870 tx=0x7f0004009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3484b4c996e017ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.684+0000 7f000dffb700 1 -- 172.21.15.154:0/4259318088 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004011830 con 0x7f0010134f00 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.684+0000 7f000dffb700 1 -- 172.21.15.154:0/4259318088 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0004011990 con 0x7f0010134f00 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.684+0000 7f000dffb700 1 -- 172.21.15.154:0/4259318088 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004011d20 con 0x7f0010134f00 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.685+0000 7f00152cf700 1 -- 172.21.15.154:0/4259318088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0010134f00 msgr2=0x7f001009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.685+0000 7f00152cf700 1 --2- 172.21.15.154:0/4259318088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0010134f00 0x7f001009d960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0004009870 tx=0x7f0004009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.685+0000 7f00152cf700 1 -- 172.21.15.154:0/4259318088 shutdown_connections 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.685+0000 7f00152cf700 1 --2- 172.21.15.154:0/4259318088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001006a770 0x7f00101349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.685+0000 7f00152cf700 1 --2- 172.21.15.154:0/4259318088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0010134f00 0x7f001009d960 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.685+0000 7f00152cf700 1 -- 172.21.15.154:0/4259318088 >> 172.21.15.154:0/4259318088 conn(0x7f0010099c40 msgr2=0x7f00100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.685+0000 7f00152cf700 1 -- 172.21.15.154:0/4259318088 shutdown_connections 2023-09-30T22:26:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.685+0000 7f00152cf700 1 -- 172.21.15.154:0/4259318088 wait complete. 2023-09-30T22:26:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.686+0000 7f00152cf700 1 Processor -- start 2023-09-30T22:26:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.686+0000 7f00152cf700 1 -- start start 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.686+0000 7f00152cf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f001006a770 0x7f0010133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.686+0000 7f00152cf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001009dea0 0x7f0010133c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.686+0000 7f00152cf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0010134f00 0x7f00101320c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.686+0000 7f00152cf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001011b300 con 0x7f0010134f00 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.686+0000 7f00152cf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001009f220 con 0x7f001009dea0 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.686+0000 7f00152cf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0010138c40 con 0x7f001006a770 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.686+0000 7f000effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f001006a770 0x7f0010133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f001006a770 0x7f0010133750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:32768/0 (socket says 172.21.15.154:32768) 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000effd700 1 -- 172.21.15.154:0/412212927 learned_addr learned my addr 172.21.15.154:0/412212927 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000e7fc700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001009dea0 0x7f0010133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000f7fe700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0010134f00 0x7f00101320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000effd700 1 -- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001009dea0 msgr2=0x7f0010133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000effd700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001009dea0 0x7f0010133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000effd700 1 -- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0010134f00 msgr2=0x7f00101320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000effd700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0010134f00 0x7f00101320c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000effd700 1 -- 172.21.15.154:0/412212927 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040094a0 con 0x7f001006a770 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000e7fc700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001009dea0 0x7f0010133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000f7fe700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0010134f00 0x7f00101320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f000effd700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f001006a770 0x7f0010133750 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f000000e8b0 tx=0x7f000000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7efff77fe700 1 -- 172.21.15.154:0/412212927 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000009600 con 0x7f001006a770 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7efff77fe700 1 -- 172.21.15.154:0/412212927 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000000eeb0 con 0x7f001006a770 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f00152cf700 1 -- 172.21.15.154:0/412212927 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00100a01b0 con 0x7f001006a770 2023-09-30T22:26:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7f00152cf700 1 -- 172.21.15.154:0/412212927 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001011ba60 con 0x7f001006a770 2023-09-30T22:26:14.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.687+0000 7efff77fe700 1 -- 172.21.15.154:0/412212927 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000ca70 con 0x7f001006a770 2023-09-30T22:26:14.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.688+0000 7efff77fe700 1 -- 172.21.15.154:0/412212927 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f000000cc10 con 0x7f001006a770 2023-09-30T22:26:14.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.689+0000 7f00152cf700 1 -- 172.21.15.154:0/412212927 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff00052e0 con 0x7f001006a770 2023-09-30T22:26:14.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.689+0000 7efff77fe700 1 -- 172.21.15.154:0/412212927 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f000003f7e0 con 0x7f001006a770 2023-09-30T22:26:14.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.693+0000 7efff77fe700 1 -- 172.21.15.154:0/412212927 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00000232f0 con 0x7f001006a770 2023-09-30T22:26:14.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.725+0000 7f78efa7d700 1 Processor -- start 2023-09-30T22:26:14.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78efa7d700 1 -- start start 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78efa7d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e80a1550 0x7f78e8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78efa7d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e8139200 0x7f78e813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78efa7d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e809e9d0 con 0x7f78e80a0a70 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78efa7d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e809dc00 con 0x7f78e80a1550 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78efa7d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e809dec0 con 0x7f78e8139200 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78ee01a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e8139200 0x7f78e813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78ed819700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f78e80a0a70 0x7f78e80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37772/0 (socket says 172.21.15.154:37772) 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78ed819700 1 -- 172.21.15.154:0/115547461 learned_addr learned my addr 172.21.15.154:0/115547461 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.726+0000 7f78ed018700 1 --2- 172.21.15.154:0/115547461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e80a1550 0x7f78e8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.727+0000 7f78ed018700 1 -- 172.21.15.154:0/115547461 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e8139200 msgr2=0x7f78e813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.727+0000 7f78ed018700 1 --2- 172.21.15.154:0/115547461 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e8139200 0x7f78e813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.727+0000 7f78ed018700 1 -- 172.21.15.154:0/115547461 >> v1:172.21.15.154:6789/0 conn(0x7f78e80a0a70 legacy=0x7f78e80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.727+0000 7f78ed018700 1 -- 172.21.15.154:0/115547461 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e809e6a0 con 0x7f78e80a1550 2023-09-30T22:26:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.727+0000 7f78ed018700 1 --2- 172.21.15.154:0/115547461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e80a1550 0x7f78e8138cc0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009870 tx=0x7f78d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee941106bb87063c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.727+0000 7f78ec817700 1 -- 172.21.15.154:0/115547461 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8011830 con 0x7f78e80a1550 2023-09-30T22:26:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.727+0000 7f78ec817700 1 -- 172.21.15.154:0/115547461 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d8011990 con 0x7f78e80a1550 2023-09-30T22:26:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.727+0000 7f78ec817700 1 -- 172.21.15.154:0/115547461 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8011d20 con 0x7f78e80a1550 2023-09-30T22:26:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.728+0000 7f78efa7d700 1 -- 172.21.15.154:0/115547461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e80a1550 msgr2=0x7f78e8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.728+0000 7f78efa7d700 1 --2- 172.21.15.154:0/115547461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e80a1550 0x7f78e8138cc0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009870 tx=0x7f78d8009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.728+0000 7f78efa7d700 1 -- 172.21.15.154:0/115547461 shutdown_connections 2023-09-30T22:26:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.728+0000 7f78efa7d700 1 --2- 172.21.15.154:0/115547461 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e8139200 0x7f78e813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.728+0000 7f78efa7d700 1 --2- 172.21.15.154:0/115547461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e80a1550 0x7f78e8138cc0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.728+0000 7f78efa7d700 1 -- 172.21.15.154:0/115547461 >> 172.21.15.154:0/115547461 conn(0x7f78e80a6610 msgr2=0x7f78e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.728+0000 7f78efa7d700 1 -- 172.21.15.154:0/115547461 shutdown_connections 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.728+0000 7f78efa7d700 1 -- 172.21.15.154:0/115547461 wait complete. 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78efa7d700 1 Processor -- start 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78efa7d700 1 -- start start 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78efa7d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e80a0a70 0x7f78e81c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78efa7d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e80a1550 0x7f78e81c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78efa7d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e8139200 0x7f78e81c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78efa7d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80a53b0 con 0x7f78e80a1550 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78efa7d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e8120800 con 0x7f78e8139200 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78efa7d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e8121d20 con 0x7f78e80a0a70 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78ed018700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e80a1550 0x7f78e81c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78ed018700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e80a1550 0x7f78e81c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35342/0 (socket says 172.21.15.154:35342) 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78ed018700 1 -- 172.21.15.154:0/1593685662 learned_addr learned my addr 172.21.15.154:0/1593685662 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78ee01a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e8139200 0x7f78e81c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.729+0000 7f78ed819700 1 --2- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e80a0a70 0x7f78e81c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78ed018700 1 -- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e80a0a70 msgr2=0x7f78e81c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78ed018700 1 --2- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e80a0a70 0x7f78e81c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78ed018700 1 -- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e8139200 msgr2=0x7f78e81c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78ed018700 1 --2- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e8139200 0x7f78e81c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78ed018700 1 -- 172.21.15.154:0/1593685662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80094a0 con 0x7f78e80a1550 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78ee01a700 1 --2- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e8139200 0x7f78e81c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78ed018700 1 --2- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e80a1550 0x7f78e81c8a30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009840 tx=0x7f78d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78de7fc700 1 -- 172.21.15.154:0/1593685662 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8004450 con 0x7f78e80a1550 2023-09-30T22:26:14.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78de7fc700 1 -- 172.21.15.154:0/1593685662 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d8027070 con 0x7f78e80a1550 2023-09-30T22:26:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78efa7d700 1 -- 172.21.15.154:0/1593685662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e80a0440 con 0x7f78e80a1550 2023-09-30T22:26:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78de7fc700 1 -- 172.21.15.154:0/1593685662 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d80038e0 con 0x7f78e80a1550 2023-09-30T22:26:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.730+0000 7f78efa7d700 1 -- 172.21.15.154:0/1593685662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e8122d20 con 0x7f78e80a1550 2023-09-30T22:26:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.731+0000 7f78efa7d700 1 -- 172.21.15.154:0/1593685662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e8099a60 con 0x7f78e80a1550 2023-09-30T22:26:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.731+0000 7f78de7fc700 1 -- 172.21.15.154:0/1593685662 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78d8003a40 con 0x7f78e80a1550 2023-09-30T22:26:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.732+0000 7f78de7fc700 1 -- 172.21.15.154:0/1593685662 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78d8029070 con 0x7f78e80a1550 2023-09-30T22:26:14.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.740+0000 7f78de7fc700 1 -- 172.21.15.154:0/1593685662 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78d802d9d0 con 0x7f78e80a1550 2023-09-30T22:26:14.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.814+0000 7f44acaae700 1 -- 172.21.15.154:0/1537367439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44a8071780 con 0x7f44a813d210 2023-09-30T22:26:14.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.814+0000 7f4496ffd700 1 -- 172.21.15.154:0/1537367439 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44a002d3e0 con 0x7f44a813d210 2023-09-30T22:26:14.814 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:14.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.816+0000 7f44acaae700 1 -- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44a813d210 msgr2=0x7f44a80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.816+0000 7f44acaae700 1 --2- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44a813d210 0x7f44a80705f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f44a0016000 tx=0x7f44a0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.816+0000 7f44acaae700 1 -- 172.21.15.154:0/1537367439 shutdown_connections 2023-09-30T22:26:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.816+0000 7f44acaae700 1 --2- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44a813d210 0x7f44a80705f0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.816+0000 7f44acaae700 1 --2- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44a806a770 0x7f44a806fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.816+0000 7f44acaae700 1 --2- 172.21.15.154:0/1537367439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44a81350d0 0x7f44a80700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.816+0000 7f44acaae700 1 -- 172.21.15.154:0/1537367439 >> 172.21.15.154:0/1537367439 conn(0x7f44a8099c40 msgr2=0x7f44a809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.817+0000 7f44acaae700 1 -- 172.21.15.154:0/1537367439 shutdown_connections 2023-09-30T22:26:14.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.817+0000 7f44acaae700 1 -- 172.21.15.154:0/1537367439 wait complete. 2023-09-30T22:26:14.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:14.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.856+0000 7f036affd700 1 -- 172.21.15.154:0/3996418495 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0358005860 con 0x7f03800a0ee0 2023-09-30T22:26:14.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.857+0000 7f037d7fa700 1 -- 172.21.15.154:0/3996418495 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f037402a020 con 0x7f03800a0ee0 2023-09-30T22:26:14.857 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:14.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.860+0000 7f036affd700 1 -- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03800a0ee0 msgr2=0x7f038011d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.860+0000 7f036affd700 1 --2- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03800a0ee0 0x7f038011d850 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0374009ba0 tx=0x7f0374004750 comp rx=0 tx=0).stop 2023-09-30T22:26:14.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.860+0000 7f036affd700 1 -- 172.21.15.154:0/3996418495 shutdown_connections 2023-09-30T22:26:14.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.860+0000 7f036affd700 1 --2- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0380134210 0x7f038011e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.860+0000 7f036affd700 1 --2- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03800a0ee0 0x7f038011d850 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.860+0000 7f036affd700 1 --2- 172.21.15.154:0/3996418495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0380133900 0x7f038011dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.860+0000 7f036affd700 1 -- 172.21.15.154:0/3996418495 >> 172.21.15.154:0/3996418495 conn(0x7f03800a2980 msgr2=0x7f03801baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.860+0000 7f036affd700 1 -- 172.21.15.154:0/3996418495 shutdown_connections 2023-09-30T22:26:14.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.860+0000 7f036affd700 1 -- 172.21.15.154:0/3996418495 wait complete. 2023-09-30T22:26:14.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.896+0000 7f00152cf700 1 -- 172.21.15.154:0/412212927 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efff0005590 con 0x7f001006a770 2023-09-30T22:26:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.896+0000 7efff77fe700 1 -- 172.21.15.154:0/412212927 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0000021030 con 0x7f001006a770 2023-09-30T22:26:14.896 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.898+0000 7f00152cf700 1 -- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f001006a770 msgr2=0x7f0010133750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.898+0000 7f00152cf700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f001006a770 0x7f0010133750 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f000000e8b0 tx=0x7f000000ec70 comp rx=0 tx=0).stop 2023-09-30T22:26:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.898+0000 7f00152cf700 1 -- 172.21.15.154:0/412212927 shutdown_connections 2023-09-30T22:26:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.898+0000 7f00152cf700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0010134f00 0x7f00101320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.898+0000 7f00152cf700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f001006a770 0x7f0010133750 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.898+0000 7f00152cf700 1 --2- 172.21.15.154:0/412212927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f001009dea0 0x7f0010133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.898+0000 7f00152cf700 1 -- 172.21.15.154:0/412212927 >> 172.21.15.154:0/412212927 conn(0x7f0010099c40 msgr2=0x7f0010138060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.898+0000 7f00152cf700 1 -- 172.21.15.154:0/412212927 shutdown_connections 2023-09-30T22:26:14.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.898+0000 7f00152cf700 1 -- 172.21.15.154:0/412212927 wait complete. 2023-09-30T22:26:14.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:14.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.942+0000 7f78efa7d700 1 -- 172.21.15.154:0/1593685662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78e804f2a0 con 0x7f78e80a1550 2023-09-30T22:26:14.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.943+0000 7f78de7fc700 1 -- 172.21.15.154:0/1593685662 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78d8033070 con 0x7f78e80a1550 2023-09-30T22:26:14.943 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:14.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.944+0000 7f78efa7d700 1 -- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e80a1550 msgr2=0x7f78e81c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.944+0000 7f78efa7d700 1 --2- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e80a1550 0x7f78e81c8a30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009840 tx=0x7f78d8004750 comp rx=0 tx=0).stop 2023-09-30T22:26:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.944+0000 7f78efa7d700 1 -- 172.21.15.154:0/1593685662 shutdown_connections 2023-09-30T22:26:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.944+0000 7f78efa7d700 1 --2- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e8139200 0x7f78e81c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.944+0000 7f78efa7d700 1 --2- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78e80a0a70 0x7f78e81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.944+0000 7f78efa7d700 1 --2- 172.21.15.154:0/1593685662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e80a1550 0x7f78e81c8a30 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.945+0000 7f78efa7d700 1 -- 172.21.15.154:0/1593685662 >> 172.21.15.154:0/1593685662 conn(0x7f78e80a6610 msgr2=0x7f78e8136ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.945+0000 7f78efa7d700 1 -- 172.21.15.154:0/1593685662 shutdown_connections 2023-09-30T22:26:14.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:14.945+0000 7f78efa7d700 1 -- 172.21.15.154:0/1593685662 wait complete. 2023-09-30T22:26:14.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:15.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:15.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:15.912 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:15.957 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.973+0000 7f8c6f59e700 1 Processor -- start 2023-09-30T22:26:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.973+0000 7f8c6f59e700 1 -- start start 2023-09-30T22:26:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6f59e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c701338e0 0x7f8c70133cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6f59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c70099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6f59e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7009ba00 con 0x7f8c7009a3d0 2023-09-30T22:26:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6f59e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7006f790 con 0x7f8c701338e0 2023-09-30T22:26:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6f59e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7006f970 con 0x7f8c70099a60 2023-09-30T22:26:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c701338e0 0x7f8c70133cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c701338e0 0x7f8c70133cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37856/0 (socket says 172.21.15.154:37856) 2023-09-30T22:26:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6e59c700 1 -- 172.21.15.154:0/917627961 learned_addr learned my addr 172.21.15.154:0/917627961 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6dd9b700 1 --2- 172.21.15.154:0/917627961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c70099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6dd9b700 1 -- 172.21.15.154:0/917627961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c701338e0 msgr2=0x7f8c70133cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6dd9b700 1 --2- 172.21.15.154:0/917627961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c701338e0 0x7f8c70133cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6dd9b700 1 -- 172.21.15.154:0/917627961 >> v1:172.21.15.154:6789/0 conn(0x7f8c7009a3d0 legacy=0x7f8c7013a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6dd9b700 1 -- 172.21.15.154:0/917627961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7009b680 con 0x7f8c70099a60 2023-09-30T22:26:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6d59a700 1 -- 172.21.15.154:0/917627961 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164947175 0 0) 0x7f8c7009ba00 con 0x7f8c7009a3d0 2023-09-30T22:26:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.974+0000 7f8c6dd9b700 1 --2- 172.21.15.154:0/917627961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c70099e90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009870 tx=0x7f8c64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9025013c1a566ebe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.975+0000 7f8c6d59a700 1 -- 172.21.15.154:0/917627961 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64011830 con 0x7f8c70099a60 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.975+0000 7f8c6d59a700 1 -- 172.21.15.154:0/917627961 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c64011990 con 0x7f8c70099a60 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.975+0000 7f8c6d59a700 1 -- 172.21.15.154:0/917627961 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64011d20 con 0x7f8c70099a60 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.975+0000 7f8c6f59e700 1 -- 172.21.15.154:0/917627961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 msgr2=0x7f8c70099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.975+0000 7f8c6f59e700 1 --2- 172.21.15.154:0/917627961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c70099e90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009870 tx=0x7f8c64009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.976+0000 7f8c6f59e700 1 -- 172.21.15.154:0/917627961 shutdown_connections 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.976+0000 7f8c6f59e700 1 --2- 172.21.15.154:0/917627961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c701338e0 0x7f8c70133cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.976+0000 7f8c6f59e700 1 --2- 172.21.15.154:0/917627961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c70099e90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.976+0000 7f8c6f59e700 1 -- 172.21.15.154:0/917627961 >> 172.21.15.154:0/917627961 conn(0x7f8c700a27a0 msgr2=0x7f8c700a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.976+0000 7f8c6f59e700 1 -- 172.21.15.154:0/917627961 shutdown_connections 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.976+0000 7f8c6f59e700 1 -- 172.21.15.154:0/917627961 wait complete. 2023-09-30T22:26:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.977+0000 7f8c6f59e700 1 Processor -- start 2023-09-30T22:26:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.977+0000 7f8c6f59e700 1 -- start start 2023-09-30T22:26:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.977+0000 7f8c6f59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c7011d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.977+0000 7f8c6f59e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c7009a3d0 0x7f8c7011dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.977+0000 7f8c6f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c701338e0 0x7f8c7011e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.977+0000 7f8c6f59e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7011eb80 con 0x7f8c701338e0 2023-09-30T22:26:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.977+0000 7f8c6f59e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7011f220 con 0x7f8c7009a3d0 2023-09-30T22:26:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.977+0000 7f8c6f59e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7011f840 con 0x7f8c70099a60 2023-09-30T22:26:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.977+0000 7f8c6dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c7009a3d0 0x7f8c7011dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c7009a3d0 0x7f8c7011dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37866/0 (socket says 172.21.15.154:37866) 2023-09-30T22:26:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6dd9b700 1 -- 172.21.15.154:0/3423737088 learned_addr learned my addr 172.21.15.154:0/3423737088 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6ed9d700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c701338e0 0x7f8c7011e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6e59c700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c7011d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6ed9d700 1 -- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 msgr2=0x7f8c7011d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6ed9d700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c7011d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6ed9d700 1 -- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c7009a3d0 msgr2=0x7f8c7011dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6ed9d700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c7009a3d0 0x7f8c7011dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6ed9d700 1 -- 172.21.15.154:0/3423737088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640094a0 con 0x7f8c701338e0 2023-09-30T22:26:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6dd9b700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c7009a3d0 0x7f8c7011dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:15.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6e59c700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c7011d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6ed9d700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c701338e0 0x7f8c7011e170 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c760 tx=0x7f8c6800ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c5effd700 1 -- 172.21.15.154:0/3423737088 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68003e30 con 0x7f8c701338e0 2023-09-30T22:26:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c5effd700 1 -- 172.21.15.154:0/3423737088 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68005070 con 0x7f8c701338e0 2023-09-30T22:26:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6f59e700 1 -- 172.21.15.154:0/3423737088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c70120e50 con 0x7f8c701338e0 2023-09-30T22:26:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c5effd700 1 -- 172.21.15.154:0/3423737088 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68005420 con 0x7f8c701338e0 2023-09-30T22:26:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.978+0000 7f8c6f59e700 1 -- 172.21.15.154:0/3423737088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7006f4f0 con 0x7f8c701338e0 2023-09-30T22:26:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.979+0000 7f8c5effd700 1 -- 172.21.15.154:0/3423737088 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c68005580 con 0x7f8c701338e0 2023-09-30T22:26:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.979+0000 7f8c5effd700 1 -- 172.21.15.154:0/3423737088 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c6803f370 con 0x7f8c701338e0 2023-09-30T22:26:15.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.980+0000 7f8c6f59e700 1 -- 172.21.15.154:0/3423737088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7009a870 con 0x7f8c701338e0 2023-09-30T22:26:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:15.984+0000 7f8c5effd700 1 -- 172.21.15.154:0/3423737088 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c68005830 con 0x7f8c701338e0 2023-09-30T22:26:16.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.027+0000 7f331849a700 1 Processor -- start 2023-09-30T22:26:16.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.027+0000 7f331849a700 1 -- start start 2023-09-30T22:26:16.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f331849a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3310134140 0x7f3310138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f331849a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33101345a0 0x7f331013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f331849a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331009b110 con 0x7f331009ad40 2023-09-30T22:26:16.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f331849a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33100a3b60 con 0x7f3310134140 2023-09-30T22:26:16.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f331849a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33100a1a80 con 0x7f33101345a0 2023-09-30T22:26:16.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f3315a35700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3310134140 0x7f3310138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f3315a35700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3310134140 0x7f3310138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46174/0 (socket says 172.21.15.154:46174) 2023-09-30T22:26:16.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f3315a35700 1 -- 172.21.15.154:0/3375902028 learned_addr learned my addr 172.21.15.154:0/3375902028 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:16.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f3316a37700 1 --2- 172.21.15.154:0/3375902028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33101345a0 0x7f331013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f3315a35700 1 -- 172.21.15.154:0/3375902028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33101345a0 msgr2=0x7f331013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:16.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f3315a35700 1 --2- 172.21.15.154:0/3375902028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33101345a0 0x7f331013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f3315a35700 1 -- 172.21.15.154:0/3375902028 >> v1:172.21.15.154:6789/0 conn(0x7f331009ad40 legacy=0x7f3310133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f3315a35700 1 -- 172.21.15.154:0/3375902028 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33100a2fa0 con 0x7f3310134140 2023-09-30T22:26:16.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.028+0000 7f3315a35700 1 --2- 172.21.15.154:0/3375902028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310134140 0x7f3310138e80 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f33000098f0 tx=0x7f3300009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cd66b830f0875d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.029+0000 7f3315234700 1 -- 172.21.15.154:0/3375902028 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300011830 con 0x7f3310134140 2023-09-30T22:26:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.029+0000 7f3315234700 1 -- 172.21.15.154:0/3375902028 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3300011990 con 0x7f3310134140 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.029+0000 7f3315234700 1 -- 172.21.15.154:0/3375902028 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300011d20 con 0x7f3310134140 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.029+0000 7f331849a700 1 -- 172.21.15.154:0/3375902028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310134140 msgr2=0x7f3310138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.029+0000 7f331849a700 1 --2- 172.21.15.154:0/3375902028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310134140 0x7f3310138e80 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f33000098f0 tx=0x7f3300009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.029+0000 7f331849a700 1 -- 172.21.15.154:0/3375902028 shutdown_connections 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.029+0000 7f331849a700 1 --2- 172.21.15.154:0/3375902028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33101345a0 0x7f331013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.030+0000 7f331849a700 1 --2- 172.21.15.154:0/3375902028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3310134140 0x7f3310138e80 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.030+0000 7f331849a700 1 -- 172.21.15.154:0/3375902028 >> 172.21.15.154:0/3375902028 conn(0x7f3310099c40 msgr2=0x7f331006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.030+0000 7f331849a700 1 -- 172.21.15.154:0/3375902028 shutdown_connections 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.030+0000 7f331849a700 1 -- 172.21.15.154:0/3375902028 wait complete. 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.031+0000 7f331849a700 1 Processor -- start 2023-09-30T22:26:16.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.031+0000 7f331849a700 1 -- start start 2023-09-30T22:26:16.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.031+0000 7f331849a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331009ad40 0x7f331011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.031+0000 7f331849a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3310134140 0x7f331011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f331849a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33101345a0 0x7f331011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f331849a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33100a4110 con 0x7f33101345a0 2023-09-30T22:26:16.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f331849a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331011ef40 con 0x7f331009ad40 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f331849a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f331009c7e0 con 0x7f3310134140 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316236700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331009ad40 0x7f331011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316236700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331009ad40 0x7f331011c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37886/0 (socket says 172.21.15.154:37886) 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316236700 1 -- 172.21.15.154:0/3314393610 learned_addr learned my addr 172.21.15.154:0/3314393610 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3315a35700 1 --2- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3310134140 0x7f331011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316a37700 1 --2- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33101345a0 0x7f331011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316a37700 1 -- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3310134140 msgr2=0x7f331011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316a37700 1 --2- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3310134140 0x7f331011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316a37700 1 -- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331009ad40 msgr2=0x7f331011c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316a37700 1 --2- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331009ad40 0x7f331011c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316a37700 1 -- 172.21.15.154:0/3314393610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300009550 con 0x7f33101345a0 2023-09-30T22:26:16.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3316a37700 1 --2- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33101345a0 0x7f331011d340 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f330800efc0 tx=0x7f330800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:16.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.032+0000 7f3306ffd700 1 -- 172.21.15.154:0/3314393610 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800cd40 con 0x7f33101345a0 2023-09-30T22:26:16.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.033+0000 7f3306ffd700 1 -- 172.21.15.154:0/3314393610 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330800f040 con 0x7f33101345a0 2023-09-30T22:26:16.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.033+0000 7f331849a700 1 -- 172.21.15.154:0/3314393610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331011e9a0 con 0x7f33101345a0 2023-09-30T22:26:16.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.033+0000 7f3306ffd700 1 -- 172.21.15.154:0/3314393610 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33080146c0 con 0x7f33101345a0 2023-09-30T22:26:16.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.033+0000 7f331849a700 1 -- 172.21.15.154:0/3314393610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3310139860 con 0x7f33101345a0 2023-09-30T22:26:16.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.034+0000 7f331849a700 1 -- 172.21.15.154:0/3314393610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331004f2a0 con 0x7f33101345a0 2023-09-30T22:26:16.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.035+0000 7f3306ffd700 1 -- 172.21.15.154:0/3314393610 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3308014820 con 0x7f33101345a0 2023-09-30T22:26:16.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.035+0000 7f3306ffd700 1 -- 172.21.15.154:0/3314393610 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3308040860 con 0x7f33101345a0 2023-09-30T22:26:16.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.043+0000 7f3306ffd700 1 -- 172.21.15.154:0/3314393610 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3308012930 con 0x7f33101345a0 2023-09-30T22:26:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.056+0000 7f7e81a13700 1 Processor -- start 2023-09-30T22:26:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.056+0000 7f7e81a13700 1 -- start start 2023-09-30T22:26:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e81a13700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c136960 0x7f7e7c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e81a13700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e7c139280 0x7f7e7c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e81a13700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7c06b2d0 con 0x7f7e7c133ad0 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e81a13700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7c1345b0 con 0x7f7e7c139280 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e81a13700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c133610 con 0x7f7e7c136960 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e7c139280 0x7f7e7c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7e7c133ad0 0x7f7e7c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52870/0 (socket says 172.21.15.154:52870) 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7affd700 1 -- 172.21.15.154:0/767057674 learned_addr learned my addr 172.21.15.154:0/767057674 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7a7fc700 1 --2- 172.21.15.154:0/767057674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c136960 0x7f7e7c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7b7fe700 1 -- 172.21.15.154:0/767057674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c136960 msgr2=0x7f7e7c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7b7fe700 1 --2- 172.21.15.154:0/767057674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c136960 0x7f7e7c138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7b7fe700 1 -- 172.21.15.154:0/767057674 >> v1:172.21.15.154:6789/0 conn(0x7f7e7c133ad0 legacy=0x7f7e7c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7b7fe700 1 -- 172.21.15.154:0/767057674 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c09a500 con 0x7f7e7c139280 2023-09-30T22:26:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7a7fc700 1 --2- 172.21.15.154:0/767057674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c136960 0x7f7e7c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.057+0000 7f7e7b7fe700 1 --2- 172.21.15.154:0/767057674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 0x7f7e7c13b660 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009dc0 tx=0x7f7e7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc23cdaff4a087b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e79ffb700 1 -- 172.21.15.154:0/767057674 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400e070 con 0x7f7e7c139280 2023-09-30T22:26:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e79ffb700 1 -- 172.21.15.154:0/767057674 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7400bb90 con 0x7f7e7c139280 2023-09-30T22:26:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e79ffb700 1 -- 172.21.15.154:0/767057674 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74012430 con 0x7f7e7c139280 2023-09-30T22:26:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e81a13700 1 -- 172.21.15.154:0/767057674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 msgr2=0x7f7e7c13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e81a13700 1 --2- 172.21.15.154:0/767057674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 0x7f7e7c13b660 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009dc0 tx=0x7f7e7400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e81a13700 1 -- 172.21.15.154:0/767057674 shutdown_connections 2023-09-30T22:26:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e81a13700 1 --2- 172.21.15.154:0/767057674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 0x7f7e7c13b660 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e81a13700 1 --2- 172.21.15.154:0/767057674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c136960 0x7f7e7c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e81a13700 1 -- 172.21.15.154:0/767057674 >> 172.21.15.154:0/767057674 conn(0x7f7e7c099c40 msgr2=0x7f7e7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e81a13700 1 -- 172.21.15.154:0/767057674 shutdown_connections 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.058+0000 7f7e81a13700 1 -- 172.21.15.154:0/767057674 wait complete. 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e81a13700 1 Processor -- start 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e81a13700 1 -- start start 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e81a13700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c133ad0 0x7f7e7c071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e81a13700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e7c136960 0x7f7e7c071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e81a13700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 0x7f7e7c071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e81a13700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c138de0 con 0x7f7e7c139280 2023-09-30T22:26:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e81a13700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c09f390 con 0x7f7e7c136960 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e81a13700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c130a70 con 0x7f7e7c133ad0 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e7b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 0x7f7e7c071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e7b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 0x7f7e7c071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46200/0 (socket says 172.21.15.154:46200) 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e7b7fe700 1 -- 172.21.15.154:0/2371884660 learned_addr learned my addr 172.21.15.154:0/2371884660 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e7affd700 1 --2- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c133ad0 0x7f7e7c071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.060+0000 7f7e7a7fc700 1 --2- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e7c136960 0x7f7e7c071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e7b7fe700 1 -- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c133ad0 msgr2=0x7f7e7c071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e7b7fe700 1 --2- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c133ad0 0x7f7e7c071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e7b7fe700 1 -- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e7c136960 msgr2=0x7f7e7c071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e7b7fe700 1 --2- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e7c136960 0x7f7e7c071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e7b7fe700 1 -- 172.21.15.154:0/2371884660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74009a70 con 0x7f7e7c139280 2023-09-30T22:26:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e7b7fe700 1 --2- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 0x7f7e7c071bb0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400b370 tx=0x7f7e74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e63fff700 1 -- 172.21.15.154:0/2371884660 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74012430 con 0x7f7e7c139280 2023-09-30T22:26:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e81a13700 1 -- 172.21.15.154:0/2371884660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7c0721e0 con 0x7f7e7c139280 2023-09-30T22:26:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e81a13700 1 -- 172.21.15.154:0/2371884660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7c070c50 con 0x7f7e7c139280 2023-09-30T22:26:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e63fff700 1 -- 172.21.15.154:0/2371884660 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e74020070 con 0x7f7e7c139280 2023-09-30T22:26:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.061+0000 7f7e63fff700 1 -- 172.21.15.154:0/2371884660 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74004240 con 0x7f7e7c139280 2023-09-30T22:26:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.062+0000 7f7e81a13700 1 -- 172.21.15.154:0/2371884660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5c0052e0 con 0x7f7e7c139280 2023-09-30T22:26:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.063+0000 7f7e63fff700 1 -- 172.21.15.154:0/2371884660 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e740043a0 con 0x7f7e7c139280 2023-09-30T22:26:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.063+0000 7f7e63fff700 1 -- 172.21.15.154:0/2371884660 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e74022070 con 0x7f7e7c139280 2023-09-30T22:26:16.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.071+0000 7f7e63fff700 1 -- 172.21.15.154:0/2371884660 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e7402fd60 con 0x7f7e7c139280 2023-09-30T22:26:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.106+0000 7fca15eef700 1 Processor -- start 2023-09-30T22:26:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.106+0000 7fca15eef700 1 -- start start 2023-09-30T22:26:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.106+0000 7fca15eef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a1550 0x7fca10138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.106+0000 7fca15eef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 0x7fca1013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.106+0000 7fca15eef700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1009e9d0 con 0x7fca100a0a70 2023-09-30T22:26:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.106+0000 7fca15eef700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1009dc00 con 0x7fca10139200 2023-09-30T22:26:16.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.106+0000 7fca15eef700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca1009dec0 con 0x7fca100a1550 2023-09-30T22:26:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca06ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a1550 0x7fca10138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca06ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a1550 0x7fca10138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51766/0 (socket says 172.21.15.154:51766) 2023-09-30T22:26:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca06ffd700 1 -- 172.21.15.154:0/1101539531 learned_addr learned my addr 172.21.15.154:0/1101539531 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca0ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 0x7fca1013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca0ffff700 1 -- 172.21.15.154:0/1101539531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a1550 msgr2=0x7fca10138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca0ffff700 1 --2- 172.21.15.154:0/1101539531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a1550 0x7fca10138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca0ffff700 1 -- 172.21.15.154:0/1101539531 >> v1:172.21.15.154:6789/0 conn(0x7fca100a0a70 legacy=0x7fca100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca0ffff700 1 -- 172.21.15.154:0/1101539531 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1009e6a0 con 0x7fca10139200 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca0ffff700 1 --2- 172.21.15.154:0/1101539531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 0x7fca1013b5e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fca08009dc0 tx=0x7fca0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95282b55abcbed67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca0effd700 1 -- 172.21.15.154:0/1101539531 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800e070 con 0x7fca10139200 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca0effd700 1 -- 172.21.15.154:0/1101539531 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0800bb20 con 0x7fca10139200 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.107+0000 7fca0effd700 1 -- 172.21.15.154:0/1101539531 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08012430 con 0x7fca10139200 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.108+0000 7fca15eef700 1 -- 172.21.15.154:0/1101539531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 msgr2=0x7fca1013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.108+0000 7fca15eef700 1 --2- 172.21.15.154:0/1101539531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 0x7fca1013b5e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fca08009dc0 tx=0x7fca0800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.108+0000 7fca15eef700 1 -- 172.21.15.154:0/1101539531 shutdown_connections 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.108+0000 7fca15eef700 1 --2- 172.21.15.154:0/1101539531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 0x7fca1013b5e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.108+0000 7fca15eef700 1 --2- 172.21.15.154:0/1101539531 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a1550 0x7fca10138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.108+0000 7fca15eef700 1 -- 172.21.15.154:0/1101539531 >> 172.21.15.154:0/1101539531 conn(0x7fca100a6610 msgr2=0x7fca100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.108+0000 7fca15eef700 1 -- 172.21.15.154:0/1101539531 shutdown_connections 2023-09-30T22:26:16.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.108+0000 7fca15eef700 1 -- 172.21.15.154:0/1101539531 wait complete. 2023-09-30T22:26:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.110+0000 7fca15eef700 1 Processor -- start 2023-09-30T22:26:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.110+0000 7fca15eef700 1 -- start start 2023-09-30T22:26:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca15eef700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a0a70 0x7fca1011e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca15eef700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100a1550 0x7fca1011ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca15eef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 0x7fca1011f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca15eef700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca10134100 con 0x7fca100a1550 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca15eef700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca10122310 con 0x7fca10139200 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca15eef700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca100a03e0 con 0x7fca100a0a70 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a0a70 0x7fca1011e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca06ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100a1550 0x7fca1011ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca06ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100a1550 0x7fca1011ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46204/0 (socket says 172.21.15.154:46204) 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a0a70 0x7fca1011e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51772/0 (socket says 172.21.15.154:51772) 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca06ffd700 1 -- 172.21.15.154:0/1976033381 learned_addr learned my addr 172.21.15.154:0/1976033381 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0f7fe700 1 -- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 msgr2=0x7fca1011f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0f7fe700 1 --2- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 0x7fca1011f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0f7fe700 1 -- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100a1550 msgr2=0x7fca1011ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0f7fe700 1 --2- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100a1550 0x7fca1011ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0f7fe700 1 -- 172.21.15.154:0/1976033381 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08009a70 con 0x7fca100a0a70 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca06ffd700 1 --2- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100a1550 0x7fca1011ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0f7fe700 1 --2- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a0a70 0x7fca1011e7f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fca00000f60 tx=0x7fca0000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0cff9700 1 -- 172.21.15.154:0/1976033381 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000052d0 con 0x7fca100a0a70 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.111+0000 7fca0cff9700 1 -- 172.21.15.154:0/1976033381 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca00005430 con 0x7fca100a0a70 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.112+0000 7fca15eef700 1 -- 172.21.15.154:0/1976033381 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca10120400 con 0x7fca100a0a70 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.112+0000 7fca0cff9700 1 -- 172.21.15.154:0/1976033381 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000038c0 con 0x7fca100a0a70 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.112+0000 7fca15eef700 1 -- 172.21.15.154:0/1976033381 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca10120bf0 con 0x7fca100a0a70 2023-09-30T22:26:16.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.112+0000 7fca0cff9700 1 -- 172.21.15.154:0/1976033381 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca00003a20 con 0x7fca100a0a70 2023-09-30T22:26:16.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.113+0000 7fca0cff9700 1 -- 172.21.15.154:0/1976033381 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fca0003ea60 con 0x7fca100a0a70 2023-09-30T22:26:16.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.113+0000 7fca15eef700 1 -- 172.21.15.154:0/1976033381 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1004f2a0 con 0x7fca100a0a70 2023-09-30T22:26:16.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.122+0000 7fca0cff9700 1 -- 172.21.15.154:0/1976033381 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca00017080 con 0x7fca100a0a70 2023-09-30T22:26:16.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.244+0000 7f8c6f59e700 1 -- 172.21.15.154:0/3423737088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c7004f2a0 con 0x7f8c701338e0 2023-09-30T22:26:16.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.244+0000 7f8c5effd700 1 -- 172.21.15.154:0/3423737088 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c6802a090 con 0x7f8c701338e0 2023-09-30T22:26:16.244 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:16.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.246+0000 7f8c6f59e700 1 -- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c701338e0 msgr2=0x7f8c7011e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.246+0000 7f8c6f59e700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c701338e0 0x7f8c7011e170 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800c760 tx=0x7f8c6800ca70 comp rx=0 tx=0).stop 2023-09-30T22:26:16.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.246+0000 7f8c6f59e700 1 -- 172.21.15.154:0/3423737088 shutdown_connections 2023-09-30T22:26:16.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.246+0000 7f8c6f59e700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c701338e0 0x7f8c7011e170 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.246+0000 7f8c6f59e700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c70099a60 0x7f8c7011d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.246+0000 7f8c6f59e700 1 --2- 172.21.15.154:0/3423737088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c7009a3d0 0x7f8c7011dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.246+0000 7f8c6f59e700 1 -- 172.21.15.154:0/3423737088 >> 172.21.15.154:0/3423737088 conn(0x7f8c700a27a0 msgr2=0x7f8c701b9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.246+0000 7f8c6f59e700 1 -- 172.21.15.154:0/3423737088 shutdown_connections 2023-09-30T22:26:16.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.246+0000 7f8c6f59e700 1 -- 172.21.15.154:0/3423737088 wait complete. 2023-09-30T22:26:16.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.269+0000 7f7e81a13700 1 -- 172.21.15.154:0/2371884660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e5c005860 con 0x7f7e7c139280 2023-09-30T22:26:16.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.269+0000 7f7e63fff700 1 -- 172.21.15.154:0/2371884660 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e74035030 con 0x7f7e7c139280 2023-09-30T22:26:16.269 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:16.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.272+0000 7f7e81a13700 1 -- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 msgr2=0x7f7e7c071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.272+0000 7f7e81a13700 1 --2- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 0x7f7e7c071bb0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400b370 tx=0x7f7e74004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.272+0000 7f7e81a13700 1 -- 172.21.15.154:0/2371884660 shutdown_connections 2023-09-30T22:26:16.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.272+0000 7f7e81a13700 1 --2- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e7c139280 0x7f7e7c071bb0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.272+0000 7f7e81a13700 1 --2- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7e7c133ad0 0x7f7e7c071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.272+0000 7f7e81a13700 1 --2- 172.21.15.154:0/2371884660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e7c136960 0x7f7e7c071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.272+0000 7f7e81a13700 1 -- 172.21.15.154:0/2371884660 >> 172.21.15.154:0/2371884660 conn(0x7f7e7c099c40 msgr2=0x7f7e7c0a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.272+0000 7f7e81a13700 1 -- 172.21.15.154:0/2371884660 shutdown_connections 2023-09-30T22:26:16.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.272+0000 7f7e81a13700 1 -- 172.21.15.154:0/2371884660 wait complete. 2023-09-30T22:26:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.276+0000 7f331849a700 1 -- 172.21.15.154:0/3314393610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33100729d0 con 0x7f33101345a0 2023-09-30T22:26:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.277+0000 7f3306ffd700 1 -- 172.21.15.154:0/3314393610 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f330802a030 con 0x7f33101345a0 2023-09-30T22:26:16.277 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.279+0000 7f331849a700 1 -- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33101345a0 msgr2=0x7f331011d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.279+0000 7f331849a700 1 --2- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33101345a0 0x7f331011d340 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f330800efc0 tx=0x7f330800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.279+0000 7f331849a700 1 -- 172.21.15.154:0/3314393610 shutdown_connections 2023-09-30T22:26:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.279+0000 7f331849a700 1 --2- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33101345a0 0x7f331011d340 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.279+0000 7f331849a700 1 --2- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f331009ad40 0x7f331011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.279+0000 7f331849a700 1 --2- 172.21.15.154:0/3314393610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3310134140 0x7f331011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.279+0000 7f331849a700 1 -- 172.21.15.154:0/3314393610 >> 172.21.15.154:0/3314393610 conn(0x7f3310099c40 msgr2=0x7f33100a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.279+0000 7f331849a700 1 -- 172.21.15.154:0/3314393610 shutdown_connections 2023-09-30T22:26:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.279+0000 7f331849a700 1 -- 172.21.15.154:0/3314393610 wait complete. 2023-09-30T22:26:16.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:16.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.329+0000 7fca15eef700 1 -- 172.21.15.154:0/1976033381 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fca10072980 con 0x7fca100a0a70 2023-09-30T22:26:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.329+0000 7fca0cff9700 1 -- 172.21.15.154:0/1976033381 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca00019e60 con 0x7fca100a0a70 2023-09-30T22:26:16.330 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.331+0000 7fca15eef700 1 -- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a0a70 msgr2=0x7fca1011e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.331+0000 7fca15eef700 1 --2- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a0a70 0x7fca1011e7f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fca00000f60 tx=0x7fca0000c730 comp rx=0 tx=0).stop 2023-09-30T22:26:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.332+0000 7fca15eef700 1 -- 172.21.15.154:0/1976033381 shutdown_connections 2023-09-30T22:26:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.332+0000 7fca15eef700 1 --2- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca10139200 0x7fca1011f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.332+0000 7fca15eef700 1 --2- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fca100a0a70 0x7fca1011e7f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.332+0000 7fca15eef700 1 --2- 172.21.15.154:0/1976033381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca100a1550 0x7fca1011ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.332+0000 7fca15eef700 1 -- 172.21.15.154:0/1976033381 >> 172.21.15.154:0/1976033381 conn(0x7fca100a6610 msgr2=0x7fca10138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.332+0000 7fca15eef700 1 -- 172.21.15.154:0/1976033381 shutdown_connections 2023-09-30T22:26:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:16.332+0000 7fca15eef700 1 -- 172.21.15.154:0/1976033381 wait complete. 2023-09-30T22:26:16.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:17.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:17.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:17.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:17.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:17.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.404+0000 7fa613ae4700 1 Processor -- start 2023-09-30T22:26:17.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.404+0000 7fa613ae4700 1 -- start start 2023-09-30T22:26:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa613ae4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa613ae4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 0x7fa60c139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa613ae4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c09da80 con 0x7fa60c06a770 2023-09-30T22:26:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa613ae4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c09dce0 con 0x7fa60c137140 2023-09-30T22:26:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa613ae4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c06b620 con 0x7fa60c06b250 2023-09-30T22:26:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa611880700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa60c06a770 0x7fa60c06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52878/0 (socket says 172.21.15.154:52878) 2023-09-30T22:26:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa611880700 1 -- 172.21.15.154:0/2866624009 learned_addr learned my addr 172.21.15.154:0/2866624009 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa61107f700 1 --2- 172.21.15.154:0/2866624009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa612081700 1 --2- 172.21.15.154:0/2866624009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 0x7fa60c139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa61087e700 1 -- 172.21.15.154:0/2866624009 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234838243 0 0) 0x7fa60c09da80 con 0x7fa60c06a770 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.405+0000 7fa61087e700 1 -- 172.21.15.154:0/2866624009 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f80035b0 con 0x7fa60c06a770 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.406+0000 7fa61107f700 1 -- 172.21.15.154:0/2866624009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 msgr2=0x7fa60c139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.406+0000 7fa61107f700 1 --2- 172.21.15.154:0/2866624009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 0x7fa60c139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.406+0000 7fa61107f700 1 -- 172.21.15.154:0/2866624009 >> v1:172.21.15.154:6789/0 conn(0x7fa60c06a770 legacy=0x7fa60c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.406+0000 7fa61107f700 1 -- 172.21.15.154:0/2866624009 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c09eb20 con 0x7fa60c06b250 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.406+0000 7fa61107f700 1 --2- 172.21.15.154:0/2866624009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c136c00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009870 tx=0x7fa5fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33e66fbcebcabc2b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.406+0000 7fa61087e700 1 -- 172.21.15.154:0/2866624009 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc011830 con 0x7fa60c06b250 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.406+0000 7fa61087e700 1 -- 172.21.15.154:0/2866624009 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc011990 con 0x7fa60c06b250 2023-09-30T22:26:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.406+0000 7fa61087e700 1 -- 172.21.15.154:0/2866624009 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc011d20 con 0x7fa60c06b250 2023-09-30T22:26:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.407+0000 7fa613ae4700 1 -- 172.21.15.154:0/2866624009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 msgr2=0x7fa60c136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.407+0000 7fa613ae4700 1 --2- 172.21.15.154:0/2866624009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c136c00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009870 tx=0x7fa5fc009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.407+0000 7fa613ae4700 1 -- 172.21.15.154:0/2866624009 shutdown_connections 2023-09-30T22:26:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.407+0000 7fa613ae4700 1 --2- 172.21.15.154:0/2866624009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 0x7fa60c139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.407+0000 7fa613ae4700 1 --2- 172.21.15.154:0/2866624009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c136c00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.407+0000 7fa613ae4700 1 -- 172.21.15.154:0/2866624009 >> 172.21.15.154:0/2866624009 conn(0x7fa60c099c40 msgr2=0x7fa60c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.407+0000 7fa613ae4700 1 -- 172.21.15.154:0/2866624009 shutdown_connections 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.407+0000 7fa613ae4700 1 -- 172.21.15.154:0/2866624009 wait complete. 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.408+0000 7fa613ae4700 1 Processor -- start 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.408+0000 7fa613ae4700 1 -- start start 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa613ae4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa60c06a770 0x7fa60c11e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa613ae4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c11ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa613ae4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 0x7fa60c11f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa613ae4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0a0730 con 0x7fa60c06a770 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa613ae4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c071e10 con 0x7fa60c137140 2023-09-30T22:26:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa613ae4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c120280 con 0x7fa60c06b250 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa611880700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa60c06a770 0x7fa60c11e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa611880700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa60c06a770 0x7fa60c11e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46218/0 (socket says 172.21.15.154:46218) 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa611880700 1 -- 172.21.15.154:0/4101782989 learned_addr learned my addr 172.21.15.154:0/4101782989 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa61107f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c11ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa612081700 1 --2- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 0x7fa60c11f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa61107f700 1 -- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 msgr2=0x7fa60c11f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa61107f700 1 --2- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 0x7fa60c11f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa61107f700 1 -- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa60c06a770 msgr2=0x7fa60c11e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa61107f700 1 --2- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa60c06a770 0x7fa60c11e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa61107f700 1 -- 172.21.15.154:0/4101782989 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc0094a0 con 0x7fa60c06b250 2023-09-30T22:26:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa612081700 1 --2- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 0x7fa60c11f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:17.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.409+0000 7fa61107f700 1 --2- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c11ecd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc016000 tx=0x7fa5fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.410+0000 7fa6027fc700 1 -- 172.21.15.154:0/4101782989 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc004300 con 0x7fa60c06b250 2023-09-30T22:26:17.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.410+0000 7fa6027fc700 1 -- 172.21.15.154:0/4101782989 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc01f070 con 0x7fa60c06b250 2023-09-30T22:26:17.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.410+0000 7fa613ae4700 1 -- 172.21.15.154:0/4101782989 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c120720 con 0x7fa60c06b250 2023-09-30T22:26:17.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.410+0000 7fa6027fc700 1 -- 172.21.15.154:0/4101782989 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0036a0 con 0x7fa60c06b250 2023-09-30T22:26:17.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.410+0000 7fa613ae4700 1 -- 172.21.15.154:0/4101782989 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c122080 con 0x7fa60c06b250 2023-09-30T22:26:17.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.411+0000 7fa6027fc700 1 -- 172.21.15.154:0/4101782989 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5fc021030 con 0x7fa60c06b250 2023-09-30T22:26:17.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.411+0000 7fa6027fc700 1 -- 172.21.15.154:0/4101782989 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa5fc040630 con 0x7fa60c06b250 2023-09-30T22:26:17.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.411+0000 7fa613ae4700 1 -- 172.21.15.154:0/4101782989 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c121be0 con 0x7fa60c06b250 2023-09-30T22:26:17.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.416+0000 7fa6027fc700 1 -- 172.21.15.154:0/4101782989 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5fc0239c0 con 0x7fa60c06b250 2023-09-30T22:26:17.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.442+0000 7f0b66479700 1 Processor -- start 2023-09-30T22:26:17.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.442+0000 7f0b66479700 1 -- start start 2023-09-30T22:26:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.443+0000 7f0b66479700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a0a70 0x7f0b600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.443+0000 7f0b66479700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b60134120 0x7f0b6013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.443+0000 7f0b66479700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6009dc00 con 0x7f0b600a1380 2023-09-30T22:26:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.443+0000 7f0b66479700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6009ea90 con 0x7f0b600a0a70 2023-09-30T22:26:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.443+0000 7f0b66479700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6009dec0 con 0x7f0b60134120 2023-09-30T22:26:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.443+0000 7f0b5ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a0a70 0x7f0b600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.443+0000 7f0b5ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a0a70 0x7f0b600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37960/0 (socket says 172.21.15.154:37960) 2023-09-30T22:26:17.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.443+0000 7f0b5ffff700 1 -- 172.21.15.154:0/3517818131 learned_addr learned my addr 172.21.15.154:0/3517818131 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.443+0000 7f0b64a16700 1 --2- 172.21.15.154:0/3517818131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b60134120 0x7f0b6013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.444+0000 7f0b5ffff700 1 -- 172.21.15.154:0/3517818131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b60134120 msgr2=0x7f0b6013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.444+0000 7f0b5ffff700 1 --2- 172.21.15.154:0/3517818131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b60134120 0x7f0b6013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.444+0000 7f0b5ffff700 1 -- 172.21.15.154:0/3517818131 >> v1:172.21.15.154:6789/0 conn(0x7f0b600a1380 legacy=0x7f0b60133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.444+0000 7f0b5ffff700 1 -- 172.21.15.154:0/3517818131 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6009e6a0 con 0x7f0b600a0a70 2023-09-30T22:26:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.444+0000 7f0b5ffff700 1 --2- 172.21.15.154:0/3517818131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a0a70 0x7f0b600a0e40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009920 tx=0x7f0b50009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f6862f3ded0ce95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.444+0000 7f0b5effd700 1 -- 172.21.15.154:0/3517818131 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50011830 con 0x7f0b600a0a70 2023-09-30T22:26:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.444+0000 7f0b5effd700 1 -- 172.21.15.154:0/3517818131 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50011990 con 0x7f0b600a0a70 2023-09-30T22:26:17.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.444+0000 7f0b5effd700 1 -- 172.21.15.154:0/3517818131 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50011d20 con 0x7f0b600a0a70 2023-09-30T22:26:17.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f0b66479700 1 -- 172.21.15.154:0/3517818131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a0a70 msgr2=0x7f0b600a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f0b66479700 1 --2- 172.21.15.154:0/3517818131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a0a70 0x7f0b600a0e40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009920 tx=0x7f0b50009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:17.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f0b66479700 1 -- 172.21.15.154:0/3517818131 shutdown_connections 2023-09-30T22:26:17.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f0b66479700 1 --2- 172.21.15.154:0/3517818131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b60134120 0x7f0b6013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f0b66479700 1 --2- 172.21.15.154:0/3517818131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a0a70 0x7f0b600a0e40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f0b66479700 1 -- 172.21.15.154:0/3517818131 >> 172.21.15.154:0/3517818131 conn(0x7f0b600a6610 msgr2=0x7f0b600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f36b8ead700 1 Processor -- start 2023-09-30T22:26:17.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f36b8ead700 1 -- start start 2023-09-30T22:26:17.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f0b66479700 1 -- 172.21.15.154:0/3517818131 shutdown_connections 2023-09-30T22:26:17.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.445+0000 7f0b66479700 1 -- 172.21.15.154:0/3517818131 wait complete. 2023-09-30T22:26:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b8ead700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36b41368e0 0x7f36b4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b8ead700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b4139200 0x7f36b413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b8ead700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b409a760 con 0x7f36b4133900 2023-09-30T22:26:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b8ead700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b41336e0 con 0x7f36b41368e0 2023-09-30T22:26:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b8ead700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b409a080 con 0x7f36b4139200 2023-09-30T22:26:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b4139200 0x7f36b413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b4139200 0x7f36b413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37974/0 (socket says 172.21.15.154:37974) 2023-09-30T22:26:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b2d9d700 1 -- 172.21.15.154:0/1829587311 learned_addr learned my addr 172.21.15.154:0/1829587311 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:17.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f0b66479700 1 Processor -- start 2023-09-30T22:26:17.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b2d9d700 1 -- 172.21.15.154:0/1829587311 >> v2:172.21.15.154:3300/0 conn(0x7f36b41368e0 msgr2=0x7f36b4138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b2d9d700 1 --2- 172.21.15.154:0/1829587311 >> v2:172.21.15.154:3300/0 conn(0x7f36b41368e0 0x7f36b4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b2d9d700 1 -- 172.21.15.154:0/1829587311 >> v1:172.21.15.154:6789/0 conn(0x7f36b4133900 legacy=0x7f36b4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b2d9d700 1 -- 172.21.15.154:0/1829587311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b40a23e0 con 0x7f36b4139200 2023-09-30T22:26:17.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f36b2d9d700 1 --2- 172.21.15.154:0/1829587311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b4139200 0x7f36b413b5e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009e50 tx=0x7f36ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e702a2ca20142b7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f36b159a700 1 -- 172.21.15.154:0/1829587311 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00e070 con 0x7f36b4139200 2023-09-30T22:26:17.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f36b159a700 1 -- 172.21.15.154:0/1829587311 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac003a20 con 0x7f36b4139200 2023-09-30T22:26:17.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f36b159a700 1 -- 172.21.15.154:0/1829587311 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003dd0 con 0x7f36b4139200 2023-09-30T22:26:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.446+0000 7f0b66479700 1 -- start start 2023-09-30T22:26:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b66479700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b600a0a70 0x7f0b601228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b66479700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a1380 0x7f0b60122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b66479700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b60134120 0x7f0b60123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b66479700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60133aa0 con 0x7f0b60134120 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b66479700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b601333e0 con 0x7f0b600a1380 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b66479700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b601245e0 con 0x7f0b600a0a70 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b5f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a1380 0x7f0b60122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b5f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a1380 0x7f0b60122e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37990/0 (socket says 172.21.15.154:37990) 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b5f7fe700 1 -- 172.21.15.154:0/2069540253 learned_addr learned my addr 172.21.15.154:0/2069540253 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b64a16700 1 --2- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b60134120 0x7f0b60123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b5f7fe700 1 -- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b600a0a70 msgr2=0x7f0b601228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b5f7fe700 1 --2- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b600a0a70 0x7f0b601228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b5f7fe700 1 -- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b60134120 msgr2=0x7f0b60123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b5f7fe700 1 --2- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b60134120 0x7f0b60123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.447+0000 7f0b5f7fe700 1 -- 172.21.15.154:0/2069540253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b50009550 con 0x7f0b600a1380 2023-09-30T22:26:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f0b64a16700 1 --2- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b60134120 0x7f0b60123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f0b5f7fe700 1 --2- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a1380 0x7f0b60122e00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c4b0 tx=0x7f0b5400c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f36b8ead700 1 -- 172.21.15.154:0/1829587311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b4139200 msgr2=0x7f36b413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f36b8ead700 1 --2- 172.21.15.154:0/1829587311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b4139200 0x7f36b413b5e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009e50 tx=0x7f36ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:17.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f36b8ead700 1 -- 172.21.15.154:0/1829587311 shutdown_connections 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f36b8ead700 1 --2- 172.21.15.154:0/1829587311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b4139200 0x7f36b413b5e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f36b8ead700 1 --2- 172.21.15.154:0/1829587311 >> v2:172.21.15.154:3300/0 conn(0x7f36b41368e0 0x7f36b4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f36b8ead700 1 -- 172.21.15.154:0/1829587311 >> 172.21.15.154:0/1829587311 conn(0x7f36b40a2980 msgr2=0x7f36b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f0b5cff9700 1 -- 172.21.15.154:0/2069540253 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540052d0 con 0x7f0b600a1380 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f0b5cff9700 1 -- 172.21.15.154:0/2069540253 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54005430 con 0x7f0b600a1380 2023-09-30T22:26:17.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f0b5cff9700 1 -- 172.21.15.154:0/2069540253 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540038a0 con 0x7f0b600a1380 2023-09-30T22:26:17.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f36b8ead700 1 -- 172.21.15.154:0/1829587311 shutdown_connections 2023-09-30T22:26:17.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f36b8ead700 1 -- 172.21.15.154:0/1829587311 wait complete. 2023-09-30T22:26:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f0b66479700 1 -- 172.21.15.154:0/2069540253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b60124cd0 con 0x7f0b600a1380 2023-09-30T22:26:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.448+0000 7f0b66479700 1 -- 172.21.15.154:0/2069540253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b60133810 con 0x7f0b600a1380 2023-09-30T22:26:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.449+0000 7f0b5cff9700 1 -- 172.21.15.154:0/2069540253 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b54003a00 con 0x7f0b600a1380 2023-09-30T22:26:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.449+0000 7f0b5cff9700 1 -- 172.21.15.154:0/2069540253 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b5403ebc0 con 0x7f0b600a1380 2023-09-30T22:26:17.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.449+0000 7f0b66479700 1 -- 172.21.15.154:0/2069540253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6004f2a0 con 0x7f0b600a1380 2023-09-30T22:26:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.449+0000 7f36b8ead700 1 Processor -- start 2023-09-30T22:26:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.449+0000 7f36b8ead700 1 -- start start 2023-09-30T22:26:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b8ead700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f36b4133900 0x7f36b4119d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b8ead700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b41368e0 0x7f36b411a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b8ead700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b4139200 0x7f36b411a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b8ead700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b409a2c0 con 0x7f36b4139200 2023-09-30T22:26:17.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b8ead700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4138f80 con 0x7f36b41368e0 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b8ead700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36b411ba40 con 0x7f36b4133900 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f36b4133900 0x7f36b4119d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b4139200 0x7f36b411a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f36b4133900 0x7f36b4119d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51834/0 (socket says 172.21.15.154:51834) 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.450+0000 7f36b259c700 1 -- 172.21.15.154:0/645191968 learned_addr learned my addr 172.21.15.154:0/645191968 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36b2d9d700 1 -- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f36b4133900 msgr2=0x7f36b4119d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36b2d9d700 1 --2- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f36b4133900 0x7f36b4119d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36b2d9d700 1 -- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b41368e0 msgr2=0x7f36b411a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36b2d9d700 1 --2- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b41368e0 0x7f36b411a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36b2d9d700 1 -- 172.21.15.154:0/645191968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac009b30 con 0x7f36b4139200 2023-09-30T22:26:17.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36b2d9d700 1 --2- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b4139200 0x7f36b411a810 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f36ac014000 tx=0x7f36ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36a2ffd700 1 -- 172.21.15.154:0/645191968 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac004440 con 0x7f36b4139200 2023-09-30T22:26:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36a2ffd700 1 -- 172.21.15.154:0/645191968 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac0045a0 con 0x7f36b4139200 2023-09-30T22:26:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36b8ead700 1 -- 172.21.15.154:0/645191968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b411d040 con 0x7f36b4139200 2023-09-30T22:26:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36a2ffd700 1 -- 172.21.15.154:0/645191968 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac004930 con 0x7f36b4139200 2023-09-30T22:26:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.451+0000 7f36b8ead700 1 -- 172.21.15.154:0/645191968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b411c140 con 0x7f36b4139200 2023-09-30T22:26:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.452+0000 7f36a2ffd700 1 -- 172.21.15.154:0/645191968 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36ac019070 con 0x7f36b4139200 2023-09-30T22:26:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.452+0000 7f36a2ffd700 1 -- 172.21.15.154:0/645191968 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f36ac040650 con 0x7f36b4139200 2023-09-30T22:26:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.453+0000 7f36b8ead700 1 -- 172.21.15.154:0/645191968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b411d410 con 0x7f36b4139200 2023-09-30T22:26:17.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.457+0000 7f0b5cff9700 1 -- 172.21.15.154:0/2069540253 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b54017080 con 0x7f0b600a1380 2023-09-30T22:26:17.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.459+0000 7f36a2ffd700 1 -- 172.21.15.154:0/645191968 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36ac017080 con 0x7f36b4139200 2023-09-30T22:26:17.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.517+0000 7fc17b19d700 1 Processor -- start 2023-09-30T22:26:17.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.517+0000 7fc17b19d700 1 -- start start 2023-09-30T22:26:17.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.517+0000 7fc17b19d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc174138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.517+0000 7fc17b19d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 0x7fc17413b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.517+0000 7fc17b19d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17406bec0 con 0x7fc17409e870 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.517+0000 7fc17b19d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17409fdd0 con 0x7fc174139410 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.517+0000 7fc17b19d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc17406b990 con 0x7fc17409f350 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc173fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc174138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc173fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc174138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51850/0 (socket says 172.21.15.154:51850) 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc173fff700 1 -- 172.21.15.154:0/595817990 learned_addr learned my addr 172.21.15.154:0/595817990 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc17973a700 1 --2- 172.21.15.154:0/595817990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 0x7fc17413b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc173fff700 1 -- 172.21.15.154:0/595817990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 msgr2=0x7fc17413b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc173fff700 1 --2- 172.21.15.154:0/595817990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 0x7fc17413b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc173fff700 1 -- 172.21.15.154:0/595817990 >> v1:172.21.15.154:6789/0 conn(0x7fc17409e870 legacy=0x7fc17409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc1737fe700 1 -- 172.21.15.154:0/595817990 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809595262 0 0) 0x7fc17406bec0 con 0x7fc17409e870 2023-09-30T22:26:17.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc173fff700 1 -- 172.21.15.154:0/595817990 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740a0870 con 0x7fc17409f350 2023-09-30T22:26:17.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc173fff700 1 --2- 172.21.15.154:0/595817990 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc174138ed0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc160009950 tx=0x7fc160009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eebfc0d523277d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.518+0000 7fc1737fe700 1 -- 172.21.15.154:0/595817990 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160011830 con 0x7fc17409f350 2023-09-30T22:26:17.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc1737fe700 1 -- 172.21.15.154:0/595817990 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc160011990 con 0x7fc17409f350 2023-09-30T22:26:17.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc1737fe700 1 -- 172.21.15.154:0/595817990 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160011d40 con 0x7fc17409f350 2023-09-30T22:26:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc17b19d700 1 -- 172.21.15.154:0/595817990 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 msgr2=0x7fc174138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc17b19d700 1 --2- 172.21.15.154:0/595817990 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc174138ed0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc160009950 tx=0x7fc160009c60 comp rx=0 tx=0).stop 2023-09-30T22:26:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc17b19d700 1 -- 172.21.15.154:0/595817990 shutdown_connections 2023-09-30T22:26:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc17b19d700 1 --2- 172.21.15.154:0/595817990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 0x7fc17413b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc17b19d700 1 --2- 172.21.15.154:0/595817990 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc174138ed0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc17b19d700 1 -- 172.21.15.154:0/595817990 >> 172.21.15.154:0/595817990 conn(0x7fc1740a4430 msgr2=0x7fc1740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc17b19d700 1 -- 172.21.15.154:0/595817990 shutdown_connections 2023-09-30T22:26:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.519+0000 7fc17b19d700 1 -- 172.21.15.154:0/595817990 wait complete. 2023-09-30T22:26:17.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.521+0000 7fc17b19d700 1 Processor -- start 2023-09-30T22:26:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.521+0000 7fc17b19d700 1 -- start start 2023-09-30T22:26:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.521+0000 7fc17b19d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17409e870 0x7fc1741cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.521+0000 7fc17b19d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc1741ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.521+0000 7fc17b19d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 0x7fc1741cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.521+0000 7fc17b19d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17411da40 con 0x7fc17409e870 2023-09-30T22:26:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.521+0000 7fc17b19d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740726d0 con 0x7fc174139410 2023-09-30T22:26:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.521+0000 7fc17b19d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740a0440 con 0x7fc17409f350 2023-09-30T22:26:17.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc178f39700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17409e870 0x7fc1741cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc178f39700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17409e870 0x7fc1741cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46242/0 (socket says 172.21.15.154:46242) 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc17973a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 0x7fc1741cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc178f39700 1 -- 172.21.15.154:0/1557081498 learned_addr learned my addr 172.21.15.154:0/1557081498 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc173fff700 1 --2- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc1741ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc178f39700 1 -- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 msgr2=0x7fc1741ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc178f39700 1 --2- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc1741ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc178f39700 1 -- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 msgr2=0x7fc1741cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc178f39700 1 --2- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 0x7fc1741cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc178f39700 1 -- 172.21.15.154:0/1557081498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160009550 con 0x7fc17409e870 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.522+0000 7fc178f39700 1 --2- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17409e870 0x7fc1741cc6b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc168001eb0 tx=0x7fc16800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.523+0000 7fc1717fa700 1 -- 172.21.15.154:0/1557081498 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680054e0 con 0x7fc17409e870 2023-09-30T22:26:17.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.523+0000 7fc1717fa700 1 -- 172.21.15.154:0/1557081498 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168003680 con 0x7fc17409e870 2023-09-30T22:26:17.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.523+0000 7fc17b19d700 1 -- 172.21.15.154:0/1557081498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17411cd40 con 0x7fc17409e870 2023-09-30T22:26:17.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.523+0000 7fc1717fa700 1 -- 172.21.15.154:0/1557081498 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680039f0 con 0x7fc17409e870 2023-09-30T22:26:17.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.523+0000 7fc17b19d700 1 -- 172.21.15.154:0/1557081498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17411dfe0 con 0x7fc17409e870 2023-09-30T22:26:17.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.524+0000 7fc1717fa700 1 -- 172.21.15.154:0/1557081498 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc168003b50 con 0x7fc17409e870 2023-09-30T22:26:17.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.524+0000 7fc17b19d700 1 -- 172.21.15.154:0/1557081498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17404f2a0 con 0x7fc17409e870 2023-09-30T22:26:17.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.524+0000 7fc1717fa700 1 -- 172.21.15.154:0/1557081498 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc16803ea30 con 0x7fc17409e870 2023-09-30T22:26:17.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.533+0000 7fc1717fa700 1 -- 172.21.15.154:0/1557081498 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc16801b3b0 con 0x7fc17409e870 2023-09-30T22:26:17.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.652+0000 7f0b66479700 1 -- 172.21.15.154:0/2069540253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0b60125ef0 con 0x7f0b600a1380 2023-09-30T22:26:17.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.652+0000 7f0b5cff9700 1 -- 172.21.15.154:0/2069540253 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b54018260 con 0x7f0b600a1380 2023-09-30T22:26:17.652 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:17.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.653+0000 7f36b8ead700 1 -- 172.21.15.154:0/645191968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f36b411d230 con 0x7f36b4139200 2023-09-30T22:26:17.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.654+0000 7f36a2ffd700 1 -- 172.21.15.154:0/645191968 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36ac020020 con 0x7f36b4139200 2023-09-30T22:26:17.653 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:17.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.654+0000 7f0b66479700 1 -- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a1380 msgr2=0x7f0b60122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.654+0000 7f0b66479700 1 --2- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a1380 0x7f0b60122e00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400c4b0 tx=0x7f0b5400c7c0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.654+0000 7f0b66479700 1 -- 172.21.15.154:0/2069540253 shutdown_connections 2023-09-30T22:26:17.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.654+0000 7f0b66479700 1 --2- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b60134120 0x7f0b60123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.654+0000 7f0b66479700 1 --2- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b600a0a70 0x7f0b601228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.654+0000 7f0b66479700 1 --2- 172.21.15.154:0/2069540253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b600a1380 0x7f0b60122e00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.654+0000 7f0b66479700 1 -- 172.21.15.154:0/2069540253 >> 172.21.15.154:0/2069540253 conn(0x7f0b600a6610 msgr2=0x7f0b600a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.655+0000 7f0b66479700 1 -- 172.21.15.154:0/2069540253 shutdown_connections 2023-09-30T22:26:17.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.655+0000 7f0b66479700 1 -- 172.21.15.154:0/2069540253 wait complete. 2023-09-30T22:26:17.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.656+0000 7f36b8ead700 1 -- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b4139200 msgr2=0x7f36b411a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.656+0000 7f36b8ead700 1 --2- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b4139200 0x7f36b411a810 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f36ac014000 tx=0x7f36ac004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.658+0000 7f36b8ead700 1 -- 172.21.15.154:0/645191968 shutdown_connections 2023-09-30T22:26:17.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.658+0000 7f36b8ead700 1 --2- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36b4139200 0x7f36b411a810 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.658+0000 7f36b8ead700 1 --2- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f36b4133900 0x7f36b4119d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.658+0000 7f36b8ead700 1 --2- 172.21.15.154:0/645191968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36b41368e0 0x7f36b411a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.658+0000 7f36b8ead700 1 -- 172.21.15.154:0/645191968 >> 172.21.15.154:0/645191968 conn(0x7f36b40a2980 msgr2=0x7f36b4131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.658+0000 7f36b8ead700 1 -- 172.21.15.154:0/645191968 shutdown_connections 2023-09-30T22:26:17.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.658+0000 7f36b8ead700 1 -- 172.21.15.154:0/645191968 wait complete. 2023-09-30T22:26:17.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.660+0000 7fa613ae4700 1 -- 172.21.15.154:0/4101782989 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa60c04f2a0 con 0x7fa60c06b250 2023-09-30T22:26:17.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.660+0000 7fa6027fc700 1 -- 172.21.15.154:0/4101782989 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5fc015020 con 0x7fa60c06b250 2023-09-30T22:26:17.660 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:17.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.662+0000 7fa613ae4700 1 -- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 msgr2=0x7fa60c11ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.662+0000 7fa613ae4700 1 --2- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c11ecd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc016000 tx=0x7fa5fc004750 comp rx=0 tx=0).stop 2023-09-30T22:26:17.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.662+0000 7fa613ae4700 1 -- 172.21.15.154:0/4101782989 shutdown_connections 2023-09-30T22:26:17.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.662+0000 7fa613ae4700 1 --2- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa60c137140 0x7fa60c11f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.662+0000 7fa613ae4700 1 --2- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa60c06a770 0x7fa60c11e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.662+0000 7fa613ae4700 1 --2- 172.21.15.154:0/4101782989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa60c06b250 0x7fa60c11ecd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.662+0000 7fa613ae4700 1 -- 172.21.15.154:0/4101782989 >> 172.21.15.154:0/4101782989 conn(0x7fa60c099c40 msgr2=0x7fa60c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.662+0000 7fa613ae4700 1 -- 172.21.15.154:0/4101782989 shutdown_connections 2023-09-30T22:26:17.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.663+0000 7fa613ae4700 1 -- 172.21.15.154:0/4101782989 wait complete. 2023-09-30T22:26:17.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:17.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:17.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:17.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.727+0000 7fc17b19d700 1 -- 172.21.15.154:0/1557081498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc174072d60 con 0x7fc17409e870 2023-09-30T22:26:17.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.728+0000 7fc1717fa700 1 -- 172.21.15.154:0/1557081498 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc168017070 con 0x7fc17409e870 2023-09-30T22:26:17.728 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.730+0000 7fc17b19d700 1 -- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17409e870 msgr2=0x7fc1741cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.730+0000 7fc17b19d700 1 --2- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17409e870 0x7fc1741cc6b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc168001eb0 tx=0x7fc16800c800 comp rx=0 tx=0).stop 2023-09-30T22:26:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.730+0000 7fc17b19d700 1 -- 172.21.15.154:0/1557081498 shutdown_connections 2023-09-30T22:26:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.730+0000 7fc17b19d700 1 --2- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc174139410 0x7fc1741cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.730+0000 7fc17b19d700 1 --2- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc17409e870 0x7fc1741cc6b0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.730+0000 7fc17b19d700 1 --2- 172.21.15.154:0/1557081498 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc17409f350 0x7fc1741ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:17.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.730+0000 7fc17b19d700 1 -- 172.21.15.154:0/1557081498 >> 172.21.15.154:0/1557081498 conn(0x7fc1740a4430 msgr2=0x7fc1740a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.730+0000 7fc17b19d700 1 -- 172.21.15.154:0/1557081498 shutdown_connections 2023-09-30T22:26:17.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:17.730+0000 7fc17b19d700 1 -- 172.21.15.154:0/1557081498 wait complete. 2023-09-30T22:26:17.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:18.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:18.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:18.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:18.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:18.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.821+0000 7fd0b88e9700 1 Processor -- start 2023-09-30T22:26:18.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.821+0000 7fd0b88e9700 1 -- start start 2023-09-30T22:26:18.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.822+0000 7fd0b88e9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4133ad0 0x7fd0b4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.822+0000 7fd0b88e9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0b4130bc0 0x7fd0b413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.822+0000 7fd0b88e9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b406b2d0 con 0x7fd0b41300a0 2023-09-30T22:26:18.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.822+0000 7fd0b88e9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b4133610 con 0x7fd0b4130bc0 2023-09-30T22:26:18.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.822+0000 7fd0b88e9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b409a500 con 0x7fd0b4133ad0 2023-09-30T22:26:18.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.822+0000 7fd0b259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4133ad0 0x7fd0b4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.822+0000 7fd0b259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4133ad0 0x7fd0b4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51864/0 (socket says 172.21.15.154:51864) 2023-09-30T22:26:18.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.822+0000 7fd0b259c700 1 -- 172.21.15.154:0/3663798116 learned_addr learned my addr 172.21.15.154:0/3663798116 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:18.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.822+0000 7fd0b2d9d700 1 --2- 172.21.15.154:0/3663798116 >> v2:172.21.15.154:3300/0 conn(0x7fd0b4130bc0 0x7fd0b413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.823+0000 7fd0b2d9d700 1 -- 172.21.15.154:0/3663798116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4133ad0 msgr2=0x7fd0b4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.823+0000 7fd0b2d9d700 1 --2- 172.21.15.154:0/3663798116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4133ad0 0x7fd0b4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.823+0000 7fd0b2d9d700 1 -- 172.21.15.154:0/3663798116 >> v1:172.21.15.154:6789/0 conn(0x7fd0b41300a0 legacy=0x7fd0b41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.823+0000 7fd0b2d9d700 1 -- 172.21.15.154:0/3663798116 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b41338b0 con 0x7fd0b4130bc0 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.823+0000 7fd0b259c700 1 --2- 172.21.15.154:0/3663798116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4133ad0 0x7fd0b4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.823+0000 7fd0b2d9d700 1 --2- 172.21.15.154:0/3663798116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b4130bc0 0x7fd0b413b990 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009d90 tx=0x7fd0ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4acca707d8a2b3a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.823+0000 7fd0b159a700 1 -- 172.21.15.154:0/3663798116 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00e070 con 0x7fd0b4130bc0 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.823+0000 7fd0b159a700 1 -- 172.21.15.154:0/3663798116 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac00bb20 con 0x7fd0b4130bc0 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.823+0000 7fd0b159a700 1 -- 172.21.15.154:0/3663798116 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac012430 con 0x7fd0b4130bc0 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.824+0000 7fd0b88e9700 1 -- 172.21.15.154:0/3663798116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b4130bc0 msgr2=0x7fd0b413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.824+0000 7fd0b88e9700 1 --2- 172.21.15.154:0/3663798116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b4130bc0 0x7fd0b413b990 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009d90 tx=0x7fd0ac00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.824+0000 7fd0b88e9700 1 -- 172.21.15.154:0/3663798116 shutdown_connections 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.824+0000 7fd0b88e9700 1 --2- 172.21.15.154:0/3663798116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b4130bc0 0x7fd0b413b990 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.824+0000 7fd0b88e9700 1 --2- 172.21.15.154:0/3663798116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4133ad0 0x7fd0b4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.824+0000 7fd0b88e9700 1 -- 172.21.15.154:0/3663798116 >> 172.21.15.154:0/3663798116 conn(0x7fd0b4099c40 msgr2=0x7fd0b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.824+0000 7fd0b88e9700 1 -- 172.21.15.154:0/3663798116 shutdown_connections 2023-09-30T22:26:18.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.824+0000 7fd0b88e9700 1 -- 172.21.15.154:0/3663798116 wait complete. 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.825+0000 7fd0b88e9700 1 Processor -- start 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b88e9700 1 -- start start 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b88e9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0b41300a0 0x7fd0b411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b88e9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4130bc0 0x7fd0b411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b88e9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b4133ad0 0x7fd0b411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b88e9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b4120100 con 0x7fd0b4133ad0 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b88e9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40722d0 con 0x7fd0b41300a0 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b88e9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b4120c70 con 0x7fd0b4130bc0 2023-09-30T22:26:18.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4130bc0 0x7fd0b411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4130bc0 0x7fd0b411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51868/0 (socket says 172.21.15.154:51868) 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.826+0000 7fd0b1d9b700 1 -- 172.21.15.154:0/1515525908 learned_addr learned my addr 172.21.15.154:0/1515525908 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7f115fdaf700 1 Processor -- start 2023-09-30T22:26:18.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0b2d9d700 1 --2- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b4133ad0 0x7fd0b411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0b259c700 1 --2- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0b41300a0 0x7fd0b411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7f115fdaf700 1 -- start start 2023-09-30T22:26:18.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0b1d9b700 1 -- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0b41300a0 msgr2=0x7fd0b411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0b1d9b700 1 --2- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0b41300a0 0x7fd0b411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0b1d9b700 1 -- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b4133ad0 msgr2=0x7fd0b411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0b1d9b700 1 --2- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b4133ad0 0x7fd0b411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0b1d9b700 1 -- 172.21.15.154:0/1515525908 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a4009550 con 0x7fd0b4130bc0 2023-09-30T22:26:18.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0b1d9b700 1 --2- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4130bc0 0x7fd0b411df80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c450 tx=0x7fd0a800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0a2ffd700 1 -- 172.21.15.154:0/1515525908 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a80052d0 con 0x7fd0b4130bc0 2023-09-30T22:26:18.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7f115fdaf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1158138040 0x7f1158138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7f115fdaf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11580a08e0 0x7f11580a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0a2ffd700 1 -- 172.21.15.154:0/1515525908 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a8005430 con 0x7fd0b4130bc0 2023-09-30T22:26:18.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7fd0a2ffd700 1 -- 172.21.15.154:0/1515525908 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a80038c0 con 0x7fd0b4130bc0 2023-09-30T22:26:18.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7f115fdaf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11581379e0 con 0x7f11580a1230 2023-09-30T22:26:18.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7f115fdaf700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11580a2100 con 0x7f1158138040 2023-09-30T22:26:18.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.827+0000 7f115fdaf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1158138950 con 0x7f11580a08e0 2023-09-30T22:26:18.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.828+0000 7fd0b88e9700 1 -- 172.21.15.154:0/1515525908 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac009a70 con 0x7fd0b4130bc0 2023-09-30T22:26:18.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.828+0000 7fd0b88e9700 1 -- 172.21.15.154:0/1515525908 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b411f9a0 con 0x7fd0b4130bc0 2023-09-30T22:26:18.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.828+0000 7f115e34c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f11580a1230 0x7f115813ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52922/0 (socket says 172.21.15.154:52922) 2023-09-30T22:26:18.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.828+0000 7f115e34c700 1 -- 172.21.15.154:0/1171064876 learned_addr learned my addr 172.21.15.154:0/1171064876 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:18.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.828+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379003837 0 0) 0x7f11581379e0 con 0x7f11580a1230 2023-09-30T22:26:18.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.828+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11440035b0 con 0x7f11580a1230 2023-09-30T22:26:18.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.828+0000 7f115db4b700 1 --2- 172.21.15.154:0/1171064876 >> v2:172.21.15.154:3300/0 conn(0x7f1158138040 0x7f1158138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.828+0000 7fd0a2ffd700 1 -- 172.21.15.154:0/1515525908 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0a8003a20 con 0x7fd0b4130bc0 2023-09-30T22:26:18.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7fd0a2ffd700 1 -- 172.21.15.154:0/1515525908 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0a803e990 con 0x7fd0b4130bc0 2023-09-30T22:26:18.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7fd0b88e9700 1 -- 172.21.15.154:0/1515525908 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b412dd00 con 0x7fd0b4130bc0 2023-09-30T22:26:18.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129618567 0 0) 0x7f11440035b0 con 0x7f11580a1230 2023-09-30T22:26:18.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11580a08e0 msgr2=0x7f11580a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11580a08e0 0x7f11580a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 >> v2:172.21.15.154:3300/0 conn(0x7f1158138040 msgr2=0x7f1158138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 --2- 172.21.15.154:0/1171064876 >> v2:172.21.15.154:3300/0 conn(0x7f1158138040 0x7f1158138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115809b9b0 con 0x7f11580a1230 2023-09-30T22:26:18.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4147001391 0 0) 0x7f11500019f0 con 0x7f11580a1230 2023-09-30T22:26:18.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 >> v1:172.21.15.154:6789/0 conn(0x7f11580a1230 legacy=0x7f115813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1144003ad0 0x7f1144003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11580a08e0 0x7f1144004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1144004de0 0x7f1144005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11580a2100 con 0x7f1144003ad0 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1158138950 con 0x7f11580a08e0 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f114400bd20 con 0x7f1144004de0 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115e34c700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1144004de0 0x7f1144005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.829+0000 7f115db4b700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1144003ad0 0x7f1144003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.830+0000 7f115e34c700 1 -- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11580a08e0 msgr2=0x7f1144004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.830+0000 7f115e34c700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11580a08e0 0x7f1144004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.830+0000 7f115e34c700 1 -- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1144003ad0 msgr2=0x7f1144003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.830+0000 7f115e34c700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1144003ad0 0x7f1144003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.830+0000 7f115e34c700 1 -- 172.21.15.154:0/1171064876 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440035b0 con 0x7f1144004de0 2023-09-30T22:26:18.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.830+0000 7f115db4b700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1144003ad0 0x7f1144003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:18.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.830+0000 7f115e34c700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1144004de0 0x7f1144005250 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f115000a700 tx=0x7f1144005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=703a91a5697785b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.834+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11500072d0 con 0x7f1144004de0 2023-09-30T22:26:18.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.834+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150007450 con 0x7f1144004de0 2023-09-30T22:26:18.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.834+0000 7f115cb49700 1 -- 172.21.15.154:0/1171064876 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150007800 con 0x7f1144004de0 2023-09-30T22:26:18.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.834+0000 7fd0a2ffd700 1 -- 172.21.15.154:0/1515525908 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0a8017070 con 0x7fd0b4130bc0 2023-09-30T22:26:18.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.834+0000 7f115fdaf700 1 -- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1144004de0 msgr2=0x7f1144005250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.834+0000 7f115fdaf700 1 --2- 172.21.15.154:0/1171064876 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1144004de0 0x7f1144005250 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f115000a700 tx=0x7f1144005880 comp rx=0 tx=0).stop 2023-09-30T22:26:18.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.834+0000 7f115e34c700 1 -- 172.21.15.154:0/1171064876 reap_dead start 2023-09-30T22:26:18.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.834+0000 7f115fdaf700 1 -- 172.21.15.154:0/1171064876 shutdown_connections 2023-09-30T22:26:18.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.834+0000 7f115fdaf700 1 -- 172.21.15.154:0/1171064876 >> 172.21.15.154:0/1171064876 conn(0x7f11580a2980 msgr2=0x7f11580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.835+0000 7f115fdaf700 1 -- 172.21.15.154:0/1171064876 shutdown_connections 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.835+0000 7f115fdaf700 1 -- 172.21.15.154:0/1171064876 wait complete. 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.836+0000 7f115fdaf700 1 Processor -- start 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.836+0000 7f115fdaf700 1 -- start start 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115fdaf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158126370 0x7f1158126740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115fdaf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158126c80 0x7f11581ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115fdaf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11581cd020 0x7f11581cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115fdaf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158127840 con 0x7f1158126c80 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115fdaf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1158129e90 con 0x7f1158126370 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115fdaf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11581299a0 con 0x7f11581cd020 2023-09-30T22:26:18.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115d34a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158126c80 0x7f11581ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115d34a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158126c80 0x7f11581ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46298/0 (socket says 172.21.15.154:46298) 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115d34a700 1 -- 172.21.15.154:0/3022872515 learned_addr learned my addr 172.21.15.154:0/3022872515 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115db4b700 1 --2- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158126370 0x7f1158126740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115d34a700 1 -- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11581cd020 msgr2=0x7f11581cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115d34a700 1 --2- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11581cd020 0x7f11581cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115d34a700 1 -- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158126370 msgr2=0x7f1158126740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115d34a700 1 --2- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158126370 0x7f1158126740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115d34a700 1 -- 172.21.15.154:0/3022872515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158127f80 con 0x7f1158126c80 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.837+0000 7f115d34a700 1 --2- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158126c80 0x7f11581ccae0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f115400b550 tx=0x7f115400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.838+0000 7f114e7fc700 1 -- 172.21.15.154:0/3022872515 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154011830 con 0x7f1158126c80 2023-09-30T22:26:18.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.838+0000 7f114e7fc700 1 -- 172.21.15.154:0/3022872515 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1154011990 con 0x7f1158126c80 2023-09-30T22:26:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.838+0000 7f115fdaf700 1 -- 172.21.15.154:0/3022872515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1158137670 con 0x7f1158126c80 2023-09-30T22:26:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.838+0000 7f114e7fc700 1 -- 172.21.15.154:0/3022872515 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1154011d00 con 0x7f1158126c80 2023-09-30T22:26:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.838+0000 7f115fdaf700 1 -- 172.21.15.154:0/3022872515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115812a620 con 0x7f1158126c80 2023-09-30T22:26:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.839+0000 7f114e7fc700 1 -- 172.21.15.154:0/3022872515 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f115401a400 con 0x7f1158126c80 2023-09-30T22:26:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.839+0000 7f114e7fc700 1 -- 172.21.15.154:0/3022872515 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f115403f630 con 0x7f1158126c80 2023-09-30T22:26:18.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.839+0000 7f115fdaf700 1 -- 172.21.15.154:0/3022872515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1158136e70 con 0x7f1158126c80 2023-09-30T22:26:18.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.847+0000 7f114e7fc700 1 -- 172.21.15.154:0/3022872515 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1154011e60 con 0x7f1158126c80 2023-09-30T22:26:18.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.860+0000 7f5edf4af700 1 Processor -- start 2023-09-30T22:26:18.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.860+0000 7f5edf4af700 1 -- start start 2023-09-30T22:26:18.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edf4af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed809ad40 0x7f5ed8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edf4af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed8133f70 0x7f5ed81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edf4af700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed809b110 con 0x7f5ed80a0a70 2023-09-30T22:26:18.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edf4af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80a3b60 con 0x7f5ed809ad40 2023-09-30T22:26:18.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edf4af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81348e0 con 0x7f5ed8133f70 2023-09-30T22:26:18.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edd24b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed809ad40 0x7f5ed8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edd24b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed809ad40 0x7f5ed8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38078/0 (socket says 172.21.15.154:38078) 2023-09-30T22:26:18.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edd24b700 1 -- 172.21.15.154:0/2441481073 learned_addr learned my addr 172.21.15.154:0/2441481073 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:18.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edca4a700 1 --2- 172.21.15.154:0/2441481073 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed8133f70 0x7f5ed81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edd24b700 1 -- 172.21.15.154:0/2441481073 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed8133f70 msgr2=0x7f5ed81343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edd24b700 1 --2- 172.21.15.154:0/2441481073 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed8133f70 0x7f5ed81343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edd24b700 1 -- 172.21.15.154:0/2441481073 >> v1:172.21.15.154:6789/0 conn(0x7f5ed80a0a70 legacy=0x7f5ed80a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.861+0000 7f5edd24b700 1 -- 172.21.15.154:0/2441481073 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80a2fa0 con 0x7f5ed809ad40 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5edd24b700 1 --2- 172.21.15.154:0/2441481073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed809ad40 0x7f5ed8133a30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009920 tx=0x7f5ed4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf6fd1ae2edc002 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5ecffff700 1 -- 172.21.15.154:0/2441481073 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4004230 con 0x7f5ed809ad40 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5ecffff700 1 -- 172.21.15.154:0/2441481073 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4004390 con 0x7f5ed809ad40 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5ecffff700 1 -- 172.21.15.154:0/2441481073 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40036a0 con 0x7f5ed809ad40 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5edf4af700 1 -- 172.21.15.154:0/2441481073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed809ad40 msgr2=0x7f5ed8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5edf4af700 1 --2- 172.21.15.154:0/2441481073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed809ad40 0x7f5ed8133a30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009920 tx=0x7f5ed4009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:18.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5edf4af700 1 -- 172.21.15.154:0/2441481073 shutdown_connections 2023-09-30T22:26:18.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5edf4af700 1 --2- 172.21.15.154:0/2441481073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed809ad40 0x7f5ed8133a30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5edf4af700 1 --2- 172.21.15.154:0/2441481073 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed8133f70 0x7f5ed81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.862+0000 7f5edf4af700 1 -- 172.21.15.154:0/2441481073 >> 172.21.15.154:0/2441481073 conn(0x7f5ed8099c40 msgr2=0x7f5ed806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.863+0000 7f5edf4af700 1 -- 172.21.15.154:0/2441481073 shutdown_connections 2023-09-30T22:26:18.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.863+0000 7f5edf4af700 1 -- 172.21.15.154:0/2441481073 wait complete. 2023-09-30T22:26:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edf4af700 1 Processor -- start 2023-09-30T22:26:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edf4af700 1 -- start start 2023-09-30T22:26:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edf4af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed809ad40 0x7f5ed811e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edf4af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed80a0a70 0x7f5ed811e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edf4af700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed8133f70 0x7f5ed811ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edf4af700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed811f750 con 0x7f5ed8133f70 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edf4af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed811fe60 con 0x7f5ed80a0a70 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edf4af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81210b0 con 0x7f5ed809ad40 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edd24b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed809ad40 0x7f5ed811e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edd24b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed809ad40 0x7f5ed811e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51900/0 (socket says 172.21.15.154:51900) 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edd24b700 1 -- 172.21.15.154:0/1567612755 learned_addr learned my addr 172.21.15.154:0/1567612755 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.864+0000 7f5edca4a700 1 --2- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed80a0a70 0x7f5ed811e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5edda4c700 1 --2- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed8133f70 0x7f5ed811ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5edd24b700 1 -- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed80a0a70 msgr2=0x7f5ed811e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5edd24b700 1 --2- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed80a0a70 0x7f5ed811e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5edd24b700 1 -- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed8133f70 msgr2=0x7f5ed811ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5edd24b700 1 --2- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed8133f70 0x7f5ed811ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5edd24b700 1 -- 172.21.15.154:0/1567612755 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4009550 con 0x7f5ed809ad40 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5edd24b700 1 --2- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed809ad40 0x7f5ed811e2a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4000c00 tx=0x7f5ed4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5ecdffb700 1 -- 172.21.15.154:0/1567612755 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4003aa0 con 0x7f5ed809ad40 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5ecdffb700 1 -- 172.21.15.154:0/1567612755 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4003c20 con 0x7f5ed809ad40 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5edf4af700 1 -- 172.21.15.154:0/1567612755 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed8121a90 con 0x7f5ed809ad40 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5ecdffb700 1 -- 172.21.15.154:0/1567612755 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4011630 con 0x7f5ed809ad40 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.865+0000 7f5edf4af700 1 -- 172.21.15.154:0/1567612755 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed809c7e0 con 0x7f5ed809ad40 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.866+0000 7f5ecdffb700 1 -- 172.21.15.154:0/1567612755 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ed4028070 con 0x7f5ed809ad40 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.866+0000 7f5ecdffb700 1 -- 172.21.15.154:0/1567612755 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ed4049150 con 0x7f5ed809ad40 2023-09-30T22:26:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.867+0000 7f5edf4af700 1 -- 172.21.15.154:0/1567612755 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed80a58b0 con 0x7f5ed809ad40 2023-09-30T22:26:18.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.871+0000 7f5ecdffb700 1 -- 172.21.15.154:0/1567612755 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ed402a9c0 con 0x7f5ed809ad40 2023-09-30T22:26:18.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.896+0000 7f41c71d3700 1 Processor -- start 2023-09-30T22:26:18.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.896+0000 7f41c71d3700 1 -- start start 2023-09-30T22:26:18.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41c71d3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41c71d3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f41c0139200 0x7f41c013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41c71d3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c009e9d0 con 0x7f41c00a0a70 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41c71d3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c009dc00 con 0x7f41c0139200 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41c71d3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c009dec0 con 0x7f41c00a1550 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41bffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41bffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38098/0 (socket says 172.21.15.154:38098) 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41bffff700 1 -- 172.21.15.154:0/973222337 learned_addr learned my addr 172.21.15.154:0/973222337 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41c5770700 1 --2- 172.21.15.154:0/973222337 >> v2:172.21.15.154:3300/0 conn(0x7f41c0139200 0x7f41c013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41bffff700 1 -- 172.21.15.154:0/973222337 >> v2:172.21.15.154:3300/0 conn(0x7f41c0139200 msgr2=0x7f41c013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41bffff700 1 --2- 172.21.15.154:0/973222337 >> v2:172.21.15.154:3300/0 conn(0x7f41c0139200 0x7f41c013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41bffff700 1 -- 172.21.15.154:0/973222337 >> v1:172.21.15.154:6789/0 conn(0x7f41c00a0a70 legacy=0x7f41c00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41bffff700 1 -- 172.21.15.154:0/973222337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c009e6a0 con 0x7f41c00a1550 2023-09-30T22:26:18.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.897+0000 7f41bffff700 1 --2- 172.21.15.154:0/973222337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c0138cc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0098f0 tx=0x7f41ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d099cec581483c0d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41bf7fe700 1 -- 172.21.15.154:0/973222337 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac011830 con 0x7f41c00a1550 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41bf7fe700 1 -- 172.21.15.154:0/973222337 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac011990 con 0x7f41c00a1550 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41bf7fe700 1 -- 172.21.15.154:0/973222337 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac011d20 con 0x7f41c00a1550 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41c71d3700 1 -- 172.21.15.154:0/973222337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 msgr2=0x7f41c0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41c71d3700 1 --2- 172.21.15.154:0/973222337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c0138cc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0098f0 tx=0x7f41ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41c71d3700 1 -- 172.21.15.154:0/973222337 shutdown_connections 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41c71d3700 1 --2- 172.21.15.154:0/973222337 >> v2:172.21.15.154:3300/0 conn(0x7f41c0139200 0x7f41c013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41c71d3700 1 --2- 172.21.15.154:0/973222337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c0138cc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41c71d3700 1 -- 172.21.15.154:0/973222337 >> 172.21.15.154:0/973222337 conn(0x7f41c00a6610 msgr2=0x7f41c00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41c71d3700 1 -- 172.21.15.154:0/973222337 shutdown_connections 2023-09-30T22:26:18.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.898+0000 7f41c71d3700 1 -- 172.21.15.154:0/973222337 wait complete. 2023-09-30T22:26:18.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.900+0000 7f41c71d3700 1 Processor -- start 2023-09-30T22:26:18.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.900+0000 7f41c71d3700 1 -- start start 2023-09-30T22:26:18.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c71d3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c00a0a70 0x7f41c011e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c71d3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c011eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c71d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41c0139200 0x7f41c011f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c71d3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c01220e0 con 0x7f41c00a0a70 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c71d3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00a5290 con 0x7f41c00a1550 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c71d3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00a03e0 con 0x7f41c0139200 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c4f6f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c00a0a70 0x7f41c011e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c4f6f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c00a0a70 0x7f41c011e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46320/0 (socket says 172.21.15.154:46320) 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c4f6f700 1 -- 172.21.15.154:0/2635071864 learned_addr learned my addr 172.21.15.154:0/2635071864 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41bffff700 1 --2- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c011eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c5770700 1 --2- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41c0139200 0x7f41c011f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:18.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c4f6f700 1 -- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41c0139200 msgr2=0x7f41c011f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c4f6f700 1 --2- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41c0139200 0x7f41c011f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c4f6f700 1 -- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 msgr2=0x7f41c011eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c4f6f700 1 --2- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c011eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c4f6f700 1 -- 172.21.15.154:0/2635071864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac009550 con 0x7f41c00a0a70 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41c4f6f700 1 --2- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c00a0a70 0x7f41c011e970 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c4e0 tx=0x7f41b400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41bd7fa700 1 -- 172.21.15.154:0/2635071864 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b40052d0 con 0x7f41c00a0a70 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.901+0000 7f41bd7fa700 1 -- 172.21.15.154:0/2635071864 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b4005430 con 0x7f41c00a0a70 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.902+0000 7f41c71d3700 1 -- 172.21.15.154:0/2635071864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c01205c0 con 0x7f41c00a0a70 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.902+0000 7f41bd7fa700 1 -- 172.21.15.154:0/2635071864 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b40038c0 con 0x7f41c00a0a70 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.902+0000 7f41c71d3700 1 -- 172.21.15.154:0/2635071864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c0122b50 con 0x7f41c00a0a70 2023-09-30T22:26:18.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.902+0000 7f41bd7fa700 1 -- 172.21.15.154:0/2635071864 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41b4003a20 con 0x7f41c00a0a70 2023-09-30T22:26:18.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.902+0000 7f41bd7fa700 1 -- 172.21.15.154:0/2635071864 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f41b403ea60 con 0x7f41c00a0a70 2023-09-30T22:26:18.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.903+0000 7f41c71d3700 1 -- 172.21.15.154:0/2635071864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c004f2a0 con 0x7f41c00a0a70 2023-09-30T22:26:18.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:18.907+0000 7f41bd7fa700 1 -- 172.21.15.154:0/2635071864 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41b4017080 con 0x7f41c00a0a70 2023-09-30T22:26:19.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.064+0000 7fd0b88e9700 1 -- 172.21.15.154:0/1515525908 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd0b404f2a0 con 0x7fd0b4130bc0 2023-09-30T22:26:19.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.064+0000 7fd0a2ffd700 1 -- 172.21.15.154:0/1515525908 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0a8011590 con 0x7fd0b4130bc0 2023-09-30T22:26:19.064 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.066+0000 7fd0b88e9700 1 -- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4130bc0 msgr2=0x7fd0b411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.066+0000 7fd0b88e9700 1 --2- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4130bc0 0x7fd0b411df80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c450 tx=0x7fd0a800c760 comp rx=0 tx=0).stop 2023-09-30T22:26:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.066+0000 7fd0b88e9700 1 -- 172.21.15.154:0/1515525908 shutdown_connections 2023-09-30T22:26:19.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.066+0000 7fd0b88e9700 1 --2- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b4133ad0 0x7fd0b411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.066+0000 7fd0b88e9700 1 --2- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0b41300a0 0x7fd0b411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.066+0000 7fd0b88e9700 1 --2- 172.21.15.154:0/1515525908 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0b4130bc0 0x7fd0b411df80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.066+0000 7fd0b88e9700 1 -- 172.21.15.154:0/1515525908 >> 172.21.15.154:0/1515525908 conn(0x7fd0b4099c40 msgr2=0x7fd0b412e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.067+0000 7fd0b88e9700 1 -- 172.21.15.154:0/1515525908 shutdown_connections 2023-09-30T22:26:19.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.069+0000 7fd0b88e9700 1 -- 172.21.15.154:0/1515525908 wait complete. 2023-09-30T22:26:19.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.069+0000 7f5edf4af700 1 -- 172.21.15.154:0/1567612755 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5ed804f2a0 con 0x7f5ed809ad40 2023-09-30T22:26:19.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.071+0000 7f5ecdffb700 1 -- 172.21.15.154:0/1567612755 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ed4012e60 con 0x7f5ed809ad40 2023-09-30T22:26:19.071 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:19.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.073+0000 7f5edf4af700 1 -- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed809ad40 msgr2=0x7f5ed811e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.073+0000 7f5edf4af700 1 --2- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed809ad40 0x7f5ed811e2a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4000c00 tx=0x7f5ed4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.074+0000 7f5edf4af700 1 -- 172.21.15.154:0/1567612755 shutdown_connections 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.074+0000 7f5edf4af700 1 --2- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed8133f70 0x7f5ed811ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.074+0000 7f5edf4af700 1 --2- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ed809ad40 0x7f5ed811e2a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.074+0000 7f5edf4af700 1 --2- 172.21.15.154:0/1567612755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed80a0a70 0x7f5ed811e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.074+0000 7f5edf4af700 1 -- 172.21.15.154:0/1567612755 >> 172.21.15.154:0/1567612755 conn(0x7f5ed8099c40 msgr2=0x7f5ed81332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.074+0000 7f5edf4af700 1 -- 172.21.15.154:0/1567612755 shutdown_connections 2023-09-30T22:26:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.074+0000 7f5edf4af700 1 -- 172.21.15.154:0/1567612755 wait complete. 2023-09-30T22:26:19.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.076+0000 7f115fdaf700 1 -- 172.21.15.154:0/3022872515 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f115804f2a0 con 0x7f1158126c80 2023-09-30T22:26:19.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.076+0000 7f114e7fc700 1 -- 172.21.15.154:0/3022872515 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1154029090 con 0x7f1158126c80 2023-09-30T22:26:19.076 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.079+0000 7f115fdaf700 1 -- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158126c80 msgr2=0x7f11581ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.079+0000 7f115fdaf700 1 --2- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158126c80 0x7f11581ccae0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f115400b550 tx=0x7f115400b910 comp rx=0 tx=0).stop 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.080+0000 7f115fdaf700 1 -- 172.21.15.154:0/3022872515 shutdown_connections 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.080+0000 7f115fdaf700 1 --2- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f11581cd020 0x7f11581cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.080+0000 7f115fdaf700 1 --2- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1158126370 0x7f1158126740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.080+0000 7f115fdaf700 1 --2- 172.21.15.154:0/3022872515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1158126c80 0x7f11581ccae0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.080+0000 7f115fdaf700 1 -- 172.21.15.154:0/3022872515 >> 172.21.15.154:0/3022872515 conn(0x7f11580a2980 msgr2=0x7f115809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.080+0000 7f115fdaf700 1 -- 172.21.15.154:0/3022872515 shutdown_connections 2023-09-30T22:26:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.080+0000 7f115fdaf700 1 -- 172.21.15.154:0/3022872515 wait complete. 2023-09-30T22:26:19.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:19.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:19.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:19.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.104+0000 7f41c71d3700 1 -- 172.21.15.154:0/2635071864 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f41c0072980 con 0x7f41c00a0a70 2023-09-30T22:26:19.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.104+0000 7f41bd7fa700 1 -- 172.21.15.154:0/2635071864 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41b4019e60 con 0x7f41c00a0a70 2023-09-30T22:26:19.105 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:19.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.107+0000 7f41c71d3700 1 -- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c00a0a70 msgr2=0x7f41c011e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:19.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.107+0000 7f41c71d3700 1 --2- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c00a0a70 0x7f41c011e970 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c4e0 tx=0x7f41b400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.107+0000 7f41c71d3700 1 -- 172.21.15.154:0/2635071864 shutdown_connections 2023-09-30T22:26:19.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.107+0000 7f41c71d3700 1 --2- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41c0139200 0x7f41c011f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.107+0000 7f41c71d3700 1 --2- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c00a0a70 0x7f41c011e970 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.107+0000 7f41c71d3700 1 --2- 172.21.15.154:0/2635071864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c00a1550 0x7f41c011eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:19.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.107+0000 7f41c71d3700 1 -- 172.21.15.154:0/2635071864 >> 172.21.15.154:0/2635071864 conn(0x7f41c00a6610 msgr2=0x7f41c0136d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:19.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.107+0000 7f41c71d3700 1 -- 172.21.15.154:0/2635071864 shutdown_connections 2023-09-30T22:26:19.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:19.107+0000 7f41c71d3700 1 -- 172.21.15.154:0/2635071864 wait complete. 2023-09-30T22:26:19.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:20.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:20.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:20.095 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:20.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.231+0000 7f70a7a94700 1 Processor -- start 2023-09-30T22:26:20.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.231+0000 7f70a7a94700 1 -- start start 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a7a94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a0a30 0x7f70a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a7a94700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70a00a1340 0x7f70a012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a7a94700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a0130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a7a94700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a00a1e70 con 0x7f70a00a1340 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a7a94700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a009a720 con 0x7f70a00a0a30 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a7a94700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a009b300 con 0x7f70a01304a0 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a5830700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a0a30 0x7f70a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a5830700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a0a30 0x7f70a00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38102/0 (socket says 172.21.15.154:38102) 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a5830700 1 -- 172.21.15.154:0/3970771498 learned_addr learned my addr 172.21.15.154:0/3970771498 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:20.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a6031700 1 --2- 172.21.15.154:0/3970771498 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a0130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a5830700 1 -- 172.21.15.154:0/3970771498 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 msgr2=0x7f70a0130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a5830700 1 --2- 172.21.15.154:0/3970771498 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a0130940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a5830700 1 -- 172.21.15.154:0/3970771498 >> v2:172.21.15.154:3300/0 conn(0x7f70a00a1340 msgr2=0x7f70a012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a5830700 1 --2- 172.21.15.154:0/3970771498 >> v2:172.21.15.154:3300/0 conn(0x7f70a00a1340 0x7f70a012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a5830700 1 -- 172.21.15.154:0/3970771498 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a009abc0 con 0x7f70a00a0a30 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.232+0000 7f70a6031700 1 --2- 172.21.15.154:0/3970771498 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a0130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.233+0000 7f70a5830700 1 --2- 172.21.15.154:0/3970771498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a0a30 0x7f70a00a0e00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f709c006fd0 tx=0x7f709c00be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8bf35cedfd1d93e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.233+0000 7f70a482e700 1 -- 172.21.15.154:0/3970771498 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c005e30 con 0x7f70a00a0a30 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.233+0000 7f70a482e700 1 -- 172.21.15.154:0/3970771498 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c004030 con 0x7f70a00a0a30 2023-09-30T22:26:20.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.233+0000 7f70a482e700 1 -- 172.21.15.154:0/3970771498 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c0043e0 con 0x7f70a00a0a30 2023-09-30T22:26:20.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.234+0000 7f70a7a94700 1 -- 172.21.15.154:0/3970771498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a0a30 msgr2=0x7f70a00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.234+0000 7f70a7a94700 1 --2- 172.21.15.154:0/3970771498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a0a30 0x7f70a00a0e00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f709c006fd0 tx=0x7f709c00be70 comp rx=0 tx=0).stop 2023-09-30T22:26:20.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.234+0000 7f70a7a94700 1 -- 172.21.15.154:0/3970771498 shutdown_connections 2023-09-30T22:26:20.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.234+0000 7f70a7a94700 1 --2- 172.21.15.154:0/3970771498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a0a30 0x7f70a00a0e00 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.234+0000 7f70a7a94700 1 --2- 172.21.15.154:0/3970771498 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a0130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.234+0000 7f70a7a94700 1 --2- 172.21.15.154:0/3970771498 >> v2:172.21.15.154:3300/0 conn(0x7f70a00a1340 0x7f70a012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.234+0000 7f70a7a94700 1 -- 172.21.15.154:0/3970771498 >> 172.21.15.154:0/3970771498 conn(0x7f70a00a2980 msgr2=0x7f70a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.234+0000 7f70a7a94700 1 -- 172.21.15.154:0/3970771498 shutdown_connections 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.234+0000 7f70a7a94700 1 -- 172.21.15.154:0/3970771498 wait complete. 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.235+0000 7f70a7a94700 1 Processor -- start 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.235+0000 7f70a7a94700 1 -- start start 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a7a94700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a00a0a30 0x7f70a01c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a7a94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a1340 0x7f70a01c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a7a94700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a01c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a7a94700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a011e7a0 con 0x7f70a00a0a30 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a7a94700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a011cc80 con 0x7f70a00a1340 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a7a94700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a012fac0 con 0x7f70a01304a0 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a6031700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a01c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a6031700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a01c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51912/0 (socket says 172.21.15.154:51912) 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a6031700 1 -- 172.21.15.154:0/2189272780 learned_addr learned my addr 172.21.15.154:0/2189272780 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a502f700 1 --2- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a1340 0x7f70a01c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.236+0000 7f70a5830700 1 --2- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a00a0a30 0x7f70a01c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70a6031700 1 -- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a1340 msgr2=0x7f70a01c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70a6031700 1 --2- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a1340 0x7f70a01c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70a6031700 1 -- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a00a0a30 msgr2=0x7f70a01c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70a6031700 1 --2- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a00a0a30 0x7f70a01c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70a6031700 1 -- 172.21.15.154:0/2189272780 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098009a70 con 0x7f70a01304a0 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70a6031700 1 --2- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a01c4890 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f709800efc0 tx=0x7f709800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70967fc700 1 -- 172.21.15.154:0/2189272780 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800cc90 con 0x7f70a01304a0 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70967fc700 1 -- 172.21.15.154:0/2189272780 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709800f040 con 0x7f70a01304a0 2023-09-30T22:26:20.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70967fc700 1 -- 172.21.15.154:0/2189272780 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098003a20 con 0x7f70a01304a0 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70a7a94700 1 -- 172.21.15.154:0/2189272780 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c00b7a0 con 0x7f70a01304a0 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.237+0000 7f70a7a94700 1 -- 172.21.15.154:0/2189272780 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a011d0e0 con 0x7f70a01304a0 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.238+0000 7f70967fc700 1 -- 172.21.15.154:0/2189272780 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70980135c0 con 0x7f70a01304a0 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.239+0000 7f70967fc700 1 -- 172.21.15.154:0/2189272780 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7098043b40 con 0x7f70a01304a0 2023-09-30T22:26:20.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.239+0000 7f70a7a94700 1 -- 172.21.15.154:0/2189272780 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a00a1750 con 0x7f70a01304a0 2023-09-30T22:26:20.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.248+0000 7f70967fc700 1 -- 172.21.15.154:0/2189272780 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70a00a1750 con 0x7f70a01304a0 2023-09-30T22:26:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.268+0000 7f5dfbf26700 1 Processor -- start 2023-09-30T22:26:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.268+0000 7f5dfbf26700 1 -- start start 2023-09-30T22:26:20.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.268+0000 7f5dfbf26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df406a770 0x7f5df406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.268+0000 7f5dfbf26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df4131ec0 0x7f5df4139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.268+0000 7f5dfbf26700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df409da80 con 0x7f5df406b080 2023-09-30T22:26:20.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5dfbf26700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df409dce0 con 0x7f5df406a770 2023-09-30T22:26:20.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5dfbf26700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df409eb20 con 0x7f5df4131ec0 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df9cc2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df406a770 0x7f5df406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df94c1700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5df406b080 0x7f5df41317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52950/0 (socket says 172.21.15.154:52950) 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df94c1700 1 -- 172.21.15.154:0/2083289795 learned_addr learned my addr 172.21.15.154:0/2083289795 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5dfa4c3700 1 --2- 172.21.15.154:0/2083289795 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df4131ec0 0x7f5df4139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df8cc0700 1 -- 172.21.15.154:0/2083289795 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302177736 0 0) 0x7f5df409da80 con 0x7f5df406b080 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df8cc0700 1 -- 172.21.15.154:0/2083289795 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de00035b0 con 0x7f5df406b080 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df9cc2700 1 -- 172.21.15.154:0/2083289795 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df4131ec0 msgr2=0x7f5df4139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df9cc2700 1 --2- 172.21.15.154:0/2083289795 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df4131ec0 0x7f5df4139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df9cc2700 1 -- 172.21.15.154:0/2083289795 >> v1:172.21.15.154:6789/0 conn(0x7f5df406b080 legacy=0x7f5df41317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df9cc2700 1 -- 172.21.15.154:0/2083289795 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df409d860 con 0x7f5df406a770 2023-09-30T22:26:20.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df9cc2700 1 --2- 172.21.15.154:0/2083289795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df406a770 0x7f5df406ab40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009870 tx=0x7f5df0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d99aac150cd1282 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.269+0000 7f5df8cc0700 1 -- 172.21.15.154:0/2083289795 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0011830 con 0x7f5df406a770 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5df8cc0700 1 -- 172.21.15.154:0/2083289795 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0011990 con 0x7f5df406a770 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5df8cc0700 1 -- 172.21.15.154:0/2083289795 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0011d20 con 0x7f5df406a770 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2083289795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df406a770 msgr2=0x7f5df406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5dfbf26700 1 --2- 172.21.15.154:0/2083289795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df406a770 0x7f5df406ab40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009870 tx=0x7f5df0009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2083289795 shutdown_connections 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5dfbf26700 1 --2- 172.21.15.154:0/2083289795 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df4131ec0 0x7f5df4139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5dfbf26700 1 --2- 172.21.15.154:0/2083289795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df406a770 0x7f5df406ab40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2083289795 >> 172.21.15.154:0/2083289795 conn(0x7f5df4099c40 msgr2=0x7f5df40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2083289795 shutdown_connections 2023-09-30T22:26:20.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.270+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2083289795 wait complete. 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.271+0000 7f5dfbf26700 1 Processor -- start 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.271+0000 7f5dfbf26700 1 -- start start 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfbf26700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df406a770 0x7f5df41c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfbf26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df406b080 0x7f5df41c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfbf26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df4131ec0 0x7f5df41c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfbf26700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df411d950 con 0x7f5df406a770 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfbf26700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4071e80 con 0x7f5df4131ec0 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfbf26700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df411d4b0 con 0x7f5df406b080 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5df94c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df406b080 0x7f5df41c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5df94c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df406b080 0x7f5df41c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51930/0 (socket says 172.21.15.154:51930) 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5df9cc2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df406a770 0x7f5df41c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5df94c1700 1 -- 172.21.15.154:0/2621103659 learned_addr learned my addr 172.21.15.154:0/2621103659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfa4c3700 1 --2- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df4131ec0 0x7f5df41c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfa4c3700 1 -- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df406b080 msgr2=0x7f5df41c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfa4c3700 1 --2- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df406b080 0x7f5df41c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfa4c3700 1 -- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df406a770 msgr2=0x7f5df41c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfa4c3700 1 --2- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df406a770 0x7f5df41c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfa4c3700 1 -- 172.21.15.154:0/2621103659 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00094a0 con 0x7f5df4131ec0 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.272+0000 7f5dfa4c3700 1 --2- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df4131ec0 0x7f5df41c6990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00b390 tx=0x7f5dec00b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.273+0000 7f5dea7fc700 1 -- 172.21.15.154:0/2621103659 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec015070 con 0x7f5df4131ec0 2023-09-30T22:26:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.273+0000 7f5dea7fc700 1 -- 172.21.15.154:0/2621103659 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00bd10 con 0x7f5df4131ec0 2023-09-30T22:26:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.273+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2621103659 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df411f240 con 0x7f5df4131ec0 2023-09-30T22:26:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.273+0000 7f5dea7fc700 1 -- 172.21.15.154:0/2621103659 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec019650 con 0x7f5df4131ec0 2023-09-30T22:26:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.273+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2621103659 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df411db20 con 0x7f5df4131ec0 2023-09-30T22:26:20.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.273+0000 7f1d0699a700 1 Processor -- start 2023-09-30T22:26:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f5dea7fc700 1 -- 172.21.15.154:0/2621103659 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5dec0223b0 con 0x7f5df4131ec0 2023-09-30T22:26:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f5dea7fc700 1 -- 172.21.15.154:0/2621103659 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5dec043580 con 0x7f5df4131ec0 2023-09-30T22:26:20.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.273+0000 7f1d0699a700 1 -- start start 2023-09-30T22:26:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d0699a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d000a1510 0x7f1d001351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d0699a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d001356e0 0x7f1d00137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d0699a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d000a1e70 con 0x7f1d000a0a30 2023-09-30T22:26:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d0699a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0009a720 con 0x7f1d000a1510 2023-09-30T22:26:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d0699a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0009b300 con 0x7f1d001356e0 2023-09-30T22:26:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d04f37700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d001356e0 0x7f1d00137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d04f37700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d001356e0 0x7f1d00137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38132/0 (socket says 172.21.15.154:38132) 2023-09-30T22:26:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d04f37700 1 -- 172.21.15.154:0/1076557228 learned_addr learned my addr 172.21.15.154:0/1076557228 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:20.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1cff7fe700 1 --2- 172.21.15.154:0/1076557228 >> v2:172.21.15.154:3300/0 conn(0x7f1d000a1510 0x7f1d001351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2621103659 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df404f2a0 con 0x7f5df4131ec0 2023-09-30T22:26:20.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d04f37700 1 -- 172.21.15.154:0/1076557228 >> v2:172.21.15.154:3300/0 conn(0x7f1d000a1510 msgr2=0x7f1d001351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d04f37700 1 --2- 172.21.15.154:0/1076557228 >> v2:172.21.15.154:3300/0 conn(0x7f1d000a1510 0x7f1d001351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d04f37700 1 -- 172.21.15.154:0/1076557228 >> v1:172.21.15.154:6789/0 conn(0x7f1d000a0a30 legacy=0x7f1d000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1d04f37700 1 -- 172.21.15.154:0/1076557228 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0009abc0 con 0x7f1d001356e0 2023-09-30T22:26:20.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.274+0000 7f1cff7fe700 1 --2- 172.21.15.154:0/1076557228 >> v2:172.21.15.154:3300/0 conn(0x7f1d000a1510 0x7f1d001351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:20.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.275+0000 7f1d04f37700 1 --2- 172.21.15.154:0/1076557228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d001356e0 0x7f1d00137ac0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40098f0 tx=0x7f1cf4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2da0304b290508c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.275+0000 7f7c8aad5700 1 Processor -- start 2023-09-30T22:26:20.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.275+0000 7f7c8aad5700 1 -- start start 2023-09-30T22:26:20.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.275+0000 7f7c8aad5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 0x7f7c84133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.275+0000 7f7c8aad5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c84130bc0 0x7f7c8413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c8aad5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8406b2d0 con 0x7f7c841300a0 2023-09-30T22:26:20.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c8aad5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c84133610 con 0x7f7c84130bc0 2023-09-30T22:26:20.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c8aad5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8409a500 con 0x7f7c84133ad0 2023-09-30T22:26:20.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c89072700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c84130bc0 0x7f7c8413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c88871700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 0x7f7c84133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c89072700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c84130bc0 0x7f7c8413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46358/0 (socket says 172.21.15.154:46358) 2023-09-30T22:26:20.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c89072700 1 -- 172.21.15.154:0/2144842368 learned_addr learned my addr 172.21.15.154:0/2144842368 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c83fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7c841300a0 0x7f7c841304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52976/0 (socket says 172.21.15.154:52976) 2023-09-30T22:26:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c89072700 1 -- 172.21.15.154:0/2144842368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 msgr2=0x7f7c84133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c89072700 1 --2- 172.21.15.154:0/2144842368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 0x7f7c84133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c89072700 1 -- 172.21.15.154:0/2144842368 >> v1:172.21.15.154:6789/0 conn(0x7f7c841300a0 legacy=0x7f7c841304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c89072700 1 -- 172.21.15.154:0/2144842368 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c841338b0 con 0x7f7c84130bc0 2023-09-30T22:26:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c89072700 1 --2- 172.21.15.154:0/2144842368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 0x7f7c8413b990 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098f0 tx=0x7f7c74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0227d7d104d6f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c837fe700 1 -- 172.21.15.154:0/2144842368 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74011830 con 0x7f7c84130bc0 2023-09-30T22:26:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c837fe700 1 -- 172.21.15.154:0/2144842368 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c74011990 con 0x7f7c84130bc0 2023-09-30T22:26:20.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.276+0000 7f7c837fe700 1 -- 172.21.15.154:0/2144842368 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74011d20 con 0x7f7c84130bc0 2023-09-30T22:26:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.277+0000 7f7c8aad5700 1 -- 172.21.15.154:0/2144842368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 msgr2=0x7f7c8413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.277+0000 7f7c8aad5700 1 --2- 172.21.15.154:0/2144842368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 0x7f7c8413b990 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098f0 tx=0x7f7c74009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.277+0000 7f7c8aad5700 1 -- 172.21.15.154:0/2144842368 shutdown_connections 2023-09-30T22:26:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.277+0000 7f7c8aad5700 1 --2- 172.21.15.154:0/2144842368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 0x7f7c8413b990 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.277+0000 7f7c8aad5700 1 --2- 172.21.15.154:0/2144842368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 0x7f7c84133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.277+0000 7f7c8aad5700 1 -- 172.21.15.154:0/2144842368 >> 172.21.15.154:0/2144842368 conn(0x7f7c84099c40 msgr2=0x7f7c840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.277+0000 7f7c8aad5700 1 -- 172.21.15.154:0/2144842368 shutdown_connections 2023-09-30T22:26:20.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.277+0000 7f7c8aad5700 1 -- 172.21.15.154:0/2144842368 wait complete. 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.278+0000 7f7c8aad5700 1 Processor -- start 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.278+0000 7f7c8aad5700 1 -- start start 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c8aad5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c841300a0 0x7f7c8411cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c8aad5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 0x7f7c8411d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c8aad5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 0x7f7c84119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c8aad5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8411c650 con 0x7f7c84130bc0 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c8aad5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8411c8c0 con 0x7f7c841300a0 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c8aad5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8412f850 con 0x7f7c84133ad0 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c83fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 0x7f7c8411d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c83fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 0x7f7c8411d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46372/0 (socket says 172.21.15.154:46372) 2023-09-30T22:26:20.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c89072700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 0x7f7c84119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c83fff700 1 -- 172.21.15.154:0/1937021179 learned_addr learned my addr 172.21.15.154:0/1937021179 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:20.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c88871700 1 --2- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c841300a0 0x7f7c8411cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c89072700 1 -- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c841300a0 msgr2=0x7f7c8411cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c89072700 1 --2- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c841300a0 0x7f7c8411cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c89072700 1 -- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 msgr2=0x7f7c8411d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c89072700 1 --2- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 0x7f7c8411d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c89072700 1 -- 172.21.15.154:0/1937021179 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74009550 con 0x7f7c84133ad0 2023-09-30T22:26:20.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f7c83fff700 1 --2- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 0x7f7c8411d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:20.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f1cfeffd700 1 -- 172.21.15.154:0/1076557228 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400da00 con 0x7f1d001356e0 2023-09-30T22:26:20.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f1cfeffd700 1 -- 172.21.15.154:0/1076557228 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400db60 con 0x7f1d001356e0 2023-09-30T22:26:20.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f1cfeffd700 1 -- 172.21.15.154:0/1076557228 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4010470 con 0x7f1d001356e0 2023-09-30T22:26:20.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.279+0000 7f5dea7fc700 1 -- 172.21.15.154:0/2621103659 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5dec018370 con 0x7f5df4131ec0 2023-09-30T22:26:20.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.280+0000 7f7c89072700 1 --2- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 0x7f7c84119630 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7c74016000 tx=0x7f7c74004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.280+0000 7f7c817fa700 1 -- 172.21.15.154:0/1937021179 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74004590 con 0x7f7c84133ad0 2023-09-30T22:26:20.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.280+0000 7f7c817fa700 1 -- 172.21.15.154:0/1937021179 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c740036a0 con 0x7f7c84133ad0 2023-09-30T22:26:20.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.280+0000 7f7c817fa700 1 -- 172.21.15.154:0/1937021179 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74003a50 con 0x7f7c84133ad0 2023-09-30T22:26:20.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.280+0000 7f7c8aad5700 1 -- 172.21.15.154:0/1937021179 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8412dd00 con 0x7f7c84133ad0 2023-09-30T22:26:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.280+0000 7f7c8aad5700 1 -- 172.21.15.154:0/1937021179 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8411ba00 con 0x7f7c84133ad0 2023-09-30T22:26:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.280+0000 7f1d0699a700 1 -- 172.21.15.154:0/1076557228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d001356e0 msgr2=0x7f1d00137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.280+0000 7f1d0699a700 1 --2- 172.21.15.154:0/1076557228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d001356e0 0x7f1d00137ac0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40098f0 tx=0x7f1cf4009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.281+0000 7f1d0699a700 1 -- 172.21.15.154:0/1076557228 shutdown_connections 2023-09-30T22:26:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.281+0000 7f1d0699a700 1 --2- 172.21.15.154:0/1076557228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d001356e0 0x7f1d00137ac0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.281+0000 7f1d0699a700 1 --2- 172.21.15.154:0/1076557228 >> v2:172.21.15.154:3300/0 conn(0x7f1d000a1510 0x7f1d001351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.281+0000 7f1d0699a700 1 -- 172.21.15.154:0/1076557228 >> 172.21.15.154:0/1076557228 conn(0x7f1d000a2980 msgr2=0x7f1d000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.281+0000 7f7c817fa700 1 -- 172.21.15.154:0/1937021179 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c74021070 con 0x7f7c84133ad0 2023-09-30T22:26:20.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.281+0000 7f7c817fa700 1 -- 172.21.15.154:0/1937021179 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c74040a20 con 0x7f7c84133ad0 2023-09-30T22:26:20.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.281+0000 7f7c8aad5700 1 -- 172.21.15.154:0/1937021179 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8411b6a0 con 0x7f7c84133ad0 2023-09-30T22:26:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.282+0000 7f1d0699a700 1 -- 172.21.15.154:0/1076557228 shutdown_connections 2023-09-30T22:26:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.282+0000 7f1d0699a700 1 -- 172.21.15.154:0/1076557228 wait complete. 2023-09-30T22:26:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.282+0000 7f1d0699a700 1 Processor -- start 2023-09-30T22:26:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d0699a700 1 -- start start 2023-09-30T22:26:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d0699a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1d000a0a30 0x7f1d00134190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d0699a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d000a1510 0x7f1d001346d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d0699a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d001356e0 0x7f1d001d4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:20.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d0699a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00131dd0 con 0x7f1d001356e0 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d0699a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00132c70 con 0x7f1d000a1510 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d0699a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00132980 con 0x7f1d000a0a30 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d04f37700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d001356e0 0x7f1d001d4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d04f37700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d001356e0 0x7f1d001d4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46380/0 (socket says 172.21.15.154:46380) 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1d04f37700 1 -- 172.21.15.154:0/3988984979 learned_addr learned my addr 172.21.15.154:0/3988984979 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.283+0000 7f1cff7fe700 1 --2- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d000a1510 0x7f1d001346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1d04f37700 1 -- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1d000a0a30 msgr2=0x7f1d00134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1d04f37700 1 --2- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1d000a0a30 0x7f1d00134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1d04f37700 1 -- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d000a1510 msgr2=0x7f1d001346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1d04f37700 1 --2- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d000a1510 0x7f1d001346d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1d04f37700 1 -- 172.21.15.154:0/3988984979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf000a550 con 0x7f1d001356e0 2023-09-30T22:26:20.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1d04f37700 1 --2- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d001356e0 0x7f1d001d4e30 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009c40 tx=0x7f1cf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:20.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1cfcff9700 1 -- 172.21.15.154:0/3988984979 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400c070 con 0x7f1d001356e0 2023-09-30T22:26:20.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1cfcff9700 1 -- 172.21.15.154:0/3988984979 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400ded0 con 0x7f1d001356e0 2023-09-30T22:26:20.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1cfcff9700 1 -- 172.21.15.154:0/3988984979 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4004250 con 0x7f1d001356e0 2023-09-30T22:26:20.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1d0699a700 1 -- 172.21.15.154:0/3988984979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf4009550 con 0x7f1d001356e0 2023-09-30T22:26:20.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.284+0000 7f1d0699a700 1 -- 172.21.15.154:0/3988984979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d00131010 con 0x7f1d001356e0 2023-09-30T22:26:20.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.285+0000 7f1d0699a700 1 -- 172.21.15.154:0/3988984979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0004f2a0 con 0x7f1d001356e0 2023-09-30T22:26:20.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.286+0000 7f1cfcff9700 1 -- 172.21.15.154:0/3988984979 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1cf40043b0 con 0x7f1d001356e0 2023-09-30T22:26:20.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.286+0000 7f1cfcff9700 1 -- 172.21.15.154:0/3988984979 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1cf4040db0 con 0x7f1d001356e0 2023-09-30T22:26:20.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.290+0000 7f1cfcff9700 1 -- 172.21.15.154:0/3988984979 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cf4021750 con 0x7f1d001356e0 2023-09-30T22:26:20.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.290+0000 7f7c817fa700 1 -- 172.21.15.154:0/1937021179 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c74029080 con 0x7f7c84133ad0 2023-09-30T22:26:20.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.462+0000 7f70a7a94700 1 -- 172.21.15.154:0/2189272780 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f70a00a1750 con 0x7f70a01304a0 2023-09-30T22:26:20.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.462+0000 7f70967fc700 1 -- 172.21.15.154:0/2189272780 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70a00a1750 con 0x7f70a01304a0 2023-09-30T22:26:20.463 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:20.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.465+0000 7f70a7a94700 1 -- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 msgr2=0x7f70a01c4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.465+0000 7f70a7a94700 1 --2- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a01c4890 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f709800efc0 tx=0x7f709800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.465+0000 7f70a7a94700 1 -- 172.21.15.154:0/2189272780 shutdown_connections 2023-09-30T22:26:20.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.465+0000 7f70a7a94700 1 --2- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70a01304a0 0x7f70a01c4890 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.465+0000 7f70a7a94700 1 --2- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a00a0a30 0x7f70a01c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.465+0000 7f70a7a94700 1 --2- 172.21.15.154:0/2189272780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70a00a1340 0x7f70a01c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.465+0000 7f70a7a94700 1 -- 172.21.15.154:0/2189272780 >> 172.21.15.154:0/2189272780 conn(0x7f70a00a2980 msgr2=0x7f70a01b79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.465+0000 7f70a7a94700 1 -- 172.21.15.154:0/2189272780 shutdown_connections 2023-09-30T22:26:20.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.465+0000 7f70a7a94700 1 -- 172.21.15.154:0/2189272780 wait complete. 2023-09-30T22:26:20.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:20.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.479+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2621103659 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5df411ed50 con 0x7f5df4131ec0 2023-09-30T22:26:20.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.479+0000 7f5dea7fc700 1 -- 172.21.15.154:0/2621103659 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5dec01e020 con 0x7f5df4131ec0 2023-09-30T22:26:20.479 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:20.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.481+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df4131ec0 msgr2=0x7f5df41c6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.481+0000 7f5dfbf26700 1 --2- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df4131ec0 0x7f5df41c6990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00b390 tx=0x7f5dec00b6a0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.481+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2621103659 shutdown_connections 2023-09-30T22:26:20.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.481+0000 7f5dfbf26700 1 --2- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5df4131ec0 0x7f5df41c6990 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.481+0000 7f5dfbf26700 1 --2- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5df406a770 0x7f5df41c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.481+0000 7f5dfbf26700 1 --2- 172.21.15.154:0/2621103659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5df406b080 0x7f5df41c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.481+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2621103659 >> 172.21.15.154:0/2621103659 conn(0x7f5df4099c40 msgr2=0x7f5df40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.482+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2621103659 shutdown_connections 2023-09-30T22:26:20.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.482+0000 7f5dfbf26700 1 -- 172.21.15.154:0/2621103659 wait complete. 2023-09-30T22:26:20.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.491+0000 7f7c8aad5700 1 -- 172.21.15.154:0/1937021179 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c8404f2a0 con 0x7f7c84133ad0 2023-09-30T22:26:20.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.492+0000 7f7c817fa700 1 -- 172.21.15.154:0/1937021179 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c74015020 con 0x7f7c84133ad0 2023-09-30T22:26:20.492 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:20.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.493+0000 7f1d0699a700 1 -- 172.21.15.154:0/3988984979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d0006bce0 con 0x7f1d001356e0 2023-09-30T22:26:20.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.493+0000 7f1cfcff9700 1 -- 172.21.15.154:0/3988984979 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1cf4028020 con 0x7f1d001356e0 2023-09-30T22:26:20.493 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:20.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:20.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.494+0000 7f7c8aad5700 1 -- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 msgr2=0x7f7c84119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.494+0000 7f7c8aad5700 1 --2- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 0x7f7c84119630 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7c74016000 tx=0x7f7c74004750 comp rx=0 tx=0).stop 2023-09-30T22:26:20.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.494+0000 7f7c8aad5700 1 -- 172.21.15.154:0/1937021179 shutdown_connections 2023-09-30T22:26:20.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.494+0000 7f7c8aad5700 1 --2- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c84133ad0 0x7f7c84119630 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.494+0000 7f7c8aad5700 1 --2- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c841300a0 0x7f7c8411cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.494+0000 7f7c8aad5700 1 --2- 172.21.15.154:0/1937021179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c84130bc0 0x7f7c8411d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.494+0000 7f7c8aad5700 1 -- 172.21.15.154:0/1937021179 >> 172.21.15.154:0/1937021179 conn(0x7f7c84099c40 msgr2=0x7f7c8412e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f7c8aad5700 1 -- 172.21.15.154:0/1937021179 shutdown_connections 2023-09-30T22:26:20.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f7c8aad5700 1 -- 172.21.15.154:0/1937021179 wait complete. 2023-09-30T22:26:20.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f1d0699a700 1 -- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d001356e0 msgr2=0x7f1d001d4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:20.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f1d0699a700 1 --2- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d001356e0 0x7f1d001d4e30 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009c40 tx=0x7f1cf4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:20.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f1d0699a700 1 -- 172.21.15.154:0/3988984979 shutdown_connections 2023-09-30T22:26:20.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f1d0699a700 1 --2- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d001356e0 0x7f1d001d4e30 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f1d0699a700 1 --2- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1d000a0a30 0x7f1d00134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f1d0699a700 1 --2- 172.21.15.154:0/3988984979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d000a1510 0x7f1d001346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:20.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f1d0699a700 1 -- 172.21.15.154:0/3988984979 >> 172.21.15.154:0/3988984979 conn(0x7f1d000a2980 msgr2=0x7f1d000705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:20.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f1d0699a700 1 -- 172.21.15.154:0/3988984979 shutdown_connections 2023-09-30T22:26:20.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:20.495+0000 7f1d0699a700 1 -- 172.21.15.154:0/3988984979 wait complete. 2023-09-30T22:26:20.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:20.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:21.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:21.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:21.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:21.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:21.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.625+0000 7f2d1fea8700 1 Processor -- start 2023-09-30T22:26:21.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.626+0000 7f2d1fea8700 1 -- start start 2023-09-30T22:26:21.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.626+0000 7f2d1fea8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d18133ad0 0x7f2d18133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.626+0000 7f2d1fea8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d181304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.626+0000 7f2d1fea8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d181309f0 0x7f2d1813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.626+0000 7f2d1fea8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1806b2d0 con 0x7f2d18133ad0 2023-09-30T22:26:21.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.626+0000 7f2d1fea8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18133610 con 0x7f2d181309f0 2023-09-30T22:26:21.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.626+0000 7f2d1fea8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1809a500 con 0x7f2d181300a0 2023-09-30T22:26:21.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1d443700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d181304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1dc44700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d18133ad0 0x7f2d18133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1d443700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d181304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51958/0 (socket says 172.21.15.154:51958) 2023-09-30T22:26:21.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1e445700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d181309f0 0x7f2d1813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1d443700 1 -- 172.21.15.154:0/1979509872 learned_addr learned my addr 172.21.15.154:0/1979509872 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:21.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1dc44700 1 -- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 msgr2=0x7f2d181304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1dc44700 1 --2- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d181304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1dc44700 1 -- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d181309f0 msgr2=0x7f2d1813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1dc44700 1 --2- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d181309f0 0x7f2d1813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1dc44700 1 -- 172.21.15.154:0/1979509872 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d181338b0 con 0x7f2d18133ad0 2023-09-30T22:26:21.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1e445700 1 --2- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d181309f0 0x7f2d1813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1dc44700 1 --2- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18133ad0 0x7f2d18133ea0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009840 tx=0x7f2d14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b98c36ae628fe5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.627+0000 7f2d1cc42700 1 -- 172.21.15.154:0/1979509872 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14011830 con 0x7f2d18133ad0 2023-09-30T22:26:21.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1cc42700 1 -- 172.21.15.154:0/1979509872 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14011990 con 0x7f2d18133ad0 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1cc42700 1 -- 172.21.15.154:0/1979509872 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14011d20 con 0x7f2d18133ad0 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1fea8700 1 -- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18133ad0 msgr2=0x7f2d18133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1fea8700 1 --2- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18133ad0 0x7f2d18133ea0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009840 tx=0x7f2d14009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1fea8700 1 -- 172.21.15.154:0/1979509872 shutdown_connections 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1fea8700 1 --2- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d181309f0 0x7f2d1813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1fea8700 1 --2- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d18133ad0 0x7f2d18133ea0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1fea8700 1 --2- 172.21.15.154:0/1979509872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d181304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1fea8700 1 -- 172.21.15.154:0/1979509872 >> 172.21.15.154:0/1979509872 conn(0x7f2d18099c40 msgr2=0x7f2d180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1fea8700 1 -- 172.21.15.154:0/1979509872 shutdown_connections 2023-09-30T22:26:21.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.628+0000 7f2d1fea8700 1 -- 172.21.15.154:0/1979509872 wait complete. 2023-09-30T22:26:21.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.630+0000 7f2d1fea8700 1 Processor -- start 2023-09-30T22:26:21.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.630+0000 7f2d1fea8700 1 -- start start 2023-09-30T22:26:21.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.630+0000 7f2d1fea8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d1811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.630+0000 7f2d1fea8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d181309f0 0x7f2d1811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.630+0000 7f2d1fea8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133ad0 0x7f2d1811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.630+0000 7f2d1fea8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180a33e0 con 0x7f2d181309f0 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.630+0000 7f2d1fea8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1812dd00 con 0x7f2d18133ad0 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.630+0000 7f2d1fea8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1811fbf0 con 0x7f2d181300a0 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1dc44700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d1811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1dc44700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d1811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51962/0 (socket says 172.21.15.154:51962) 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1dc44700 1 -- 172.21.15.154:0/712044871 learned_addr learned my addr 172.21.15.154:0/712044871 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1e445700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133ad0 0x7f2d1811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1d443700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d181309f0 0x7f2d1811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1dc44700 1 -- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133ad0 msgr2=0x7f2d1811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1dc44700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133ad0 0x7f2d1811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1dc44700 1 -- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d181309f0 msgr2=0x7f2d1811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1dc44700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d181309f0 0x7f2d1811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1dc44700 1 -- 172.21.15.154:0/712044871 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10009a70 con 0x7f2d181300a0 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1e445700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133ad0 0x7f2d1811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1d443700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d181309f0 0x7f2d1811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1dc44700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d1811da40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2d140090b0 tx=0x7f2d14004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d0e7fc700 1 -- 172.21.15.154:0/712044871 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14004590 con 0x7f2d181300a0 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d0e7fc700 1 -- 172.21.15.154:0/712044871 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1401f070 con 0x7f2d181300a0 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d0e7fc700 1 -- 172.21.15.154:0/712044871 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d140038e0 con 0x7f2d181300a0 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.631+0000 7f2d1fea8700 1 -- 172.21.15.154:0/712044871 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d140094a0 con 0x7f2d181300a0 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.632+0000 7f2d1fea8700 1 -- 172.21.15.154:0/712044871 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1811feb0 con 0x7f2d181300a0 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.633+0000 7f2d0e7fc700 1 -- 172.21.15.154:0/712044871 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d14003a40 con 0x7f2d181300a0 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.633+0000 7f2d0e7fc700 1 -- 172.21.15.154:0/712044871 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d14021070 con 0x7f2d181300a0 2023-09-30T22:26:21.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.633+0000 7f2d1fea8700 1 -- 172.21.15.154:0/712044871 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1809cb20 con 0x7f2d181300a0 2023-09-30T22:26:21.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.638+0000 7f2d0e7fc700 1 -- 172.21.15.154:0/712044871 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d1402b080 con 0x7f2d181300a0 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9cae37700 1 Processor -- start 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9cae37700 1 -- start start 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9cae37700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9c4138410 0x7fd9c40a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9cae37700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9c413dd10 0x7fd9c41400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9cae37700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c41379e0 con 0x7fd9c4138040 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9cae37700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c40a2100 con 0x7fd9c4138410 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9cae37700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c409b9b0 con 0x7fd9c413dd10 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9c3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9c4138410 0x7fd9c40a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9c3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9c4138410 0x7fd9c40a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46402/0 (socket says 172.21.15.154:46402) 2023-09-30T22:26:21.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.658+0000 7fd9c3fff700 1 -- 172.21.15.154:0/1159600373 learned_addr learned my addr 172.21.15.154:0/1159600373 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.659+0000 7fd9c3fff700 1 -- 172.21.15.154:0/1159600373 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9c413dd10 msgr2=0x7fd9c41400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.659+0000 7fd9c3fff700 1 --2- 172.21.15.154:0/1159600373 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9c413dd10 0x7fd9c41400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.659+0000 7fd9c3fff700 1 -- 172.21.15.154:0/1159600373 >> v1:172.21.15.154:6789/0 conn(0x7fd9c4138040 legacy=0x7fd9c40a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.659+0000 7fd9c3fff700 1 -- 172.21.15.154:0/1159600373 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4137c10 con 0x7fd9c4138410 2023-09-30T22:26:21.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.659+0000 7fd9c3fff700 1 --2- 172.21.15.154:0/1159600373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138410 0x7fd9c40a0ff0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00098f0 tx=0x7fd9b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622a98be2c7b0ddc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.660+0000 7fd9c37fe700 1 -- 172.21.15.154:0/1159600373 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000b8a0 con 0x7fd9c4138410 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.660+0000 7fd9c37fe700 1 -- 172.21.15.154:0/1159600373 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b000ba00 con 0x7fd9c4138410 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.660+0000 7fd9c37fe700 1 -- 172.21.15.154:0/1159600373 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000bd90 con 0x7fd9c4138410 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.660+0000 7fd9cae37700 1 -- 172.21.15.154:0/1159600373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138410 msgr2=0x7fd9c40a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.660+0000 7fd9cae37700 1 --2- 172.21.15.154:0/1159600373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138410 0x7fd9c40a0ff0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00098f0 tx=0x7fd9b0009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.660+0000 7fd9cae37700 1 -- 172.21.15.154:0/1159600373 shutdown_connections 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.660+0000 7fd9cae37700 1 --2- 172.21.15.154:0/1159600373 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9c413dd10 0x7fd9c41400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.660+0000 7fd9cae37700 1 --2- 172.21.15.154:0/1159600373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138410 0x7fd9c40a0ff0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.660+0000 7fd9cae37700 1 -- 172.21.15.154:0/1159600373 >> 172.21.15.154:0/1159600373 conn(0x7fd9c40a2980 msgr2=0x7fd9c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.661+0000 7fd9cae37700 1 -- 172.21.15.154:0/1159600373 shutdown_connections 2023-09-30T22:26:21.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.661+0000 7fd9cae37700 1 -- 172.21.15.154:0/1159600373 wait complete. 2023-09-30T22:26:21.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.661+0000 7fd9cae37700 1 Processor -- start 2023-09-30T22:26:21.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9cae37700 1 -- start start 2023-09-30T22:26:21.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9cae37700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138040 0x7fd9c4121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9cae37700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9c4138410 0x7fd9c4121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9cae37700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9c413dd10 0x7fd9c4122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9cae37700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c409eef0 con 0x7fd9c4138040 2023-09-30T22:26:21.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9cae37700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c409a240 con 0x7fd9c413dd10 2023-09-30T22:26:21.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9cae37700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c41241f0 con 0x7fd9c4138410 2023-09-30T22:26:21.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9c8bd3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138040 0x7fd9c4121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9c3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9c4138410 0x7fd9c4121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9c8bd3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138040 0x7fd9c4121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46418/0 (socket says 172.21.15.154:46418) 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9c3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9c4138410 0x7fd9c4121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51968/0 (socket says 172.21.15.154:51968) 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9c8bd3700 1 -- 172.21.15.154:0/1412395297 learned_addr learned my addr 172.21.15.154:0/1412395297 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.662+0000 7fd9c93d4700 1 --2- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9c413dd10 0x7fd9c4122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9c8bd3700 1 -- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9c4138410 msgr2=0x7fd9c4121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9c8bd3700 1 --2- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9c4138410 0x7fd9c4121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9c8bd3700 1 -- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9c413dd10 msgr2=0x7fd9c4122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9c8bd3700 1 --2- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9c413dd10 0x7fd9c4122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9c8bd3700 1 -- 172.21.15.154:0/1412395297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0009550 con 0x7fd9c4138040 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9c8bd3700 1 --2- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138040 0x7fd9c4121600 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c430 tx=0x7fd9b800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9c17fa700 1 -- 172.21.15.154:0/1412395297 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80054e0 con 0x7fd9c4138040 2023-09-30T22:26:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9cae37700 1 -- 172.21.15.154:0/1412395297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c4124640 con 0x7fd9c4138040 2023-09-30T22:26:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9c17fa700 1 -- 172.21.15.154:0/1412395297 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80036a0 con 0x7fd9c4138040 2023-09-30T22:26:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9cae37700 1 -- 172.21.15.154:0/1412395297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c4124bd0 con 0x7fd9c4138040 2023-09-30T22:26:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.663+0000 7fd9c17fa700 1 -- 172.21.15.154:0/1412395297 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8003a10 con 0x7fd9c4138040 2023-09-30T22:26:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.664+0000 7fd9c17fa700 1 -- 172.21.15.154:0/1412395297 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9b8003b70 con 0x7fd9c4138040 2023-09-30T22:26:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.664+0000 7fd9c17fa700 1 -- 172.21.15.154:0/1412395297 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd9b803ea60 con 0x7fd9c4138040 2023-09-30T22:26:21.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.664+0000 7fd9cae37700 1 -- 172.21.15.154:0/1412395297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a40052e0 con 0x7fd9c4138040 2023-09-30T22:26:21.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.667+0000 7f88f7f16700 1 Processor -- start 2023-09-30T22:26:21.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.667+0000 7f88f7f16700 1 -- start start 2023-09-30T22:26:21.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f7f16700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88f0138040 0x7f88f0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f7f16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a08e0 0x7f88f00a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f7f16700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a1230 0x7f88f013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f7f16700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f00a2100 con 0x7f88f0138040 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f7f16700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0138950 con 0x7f88f00a08e0 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f7f16700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88f01379e0 con 0x7f88f00a1230 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f64b3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a1230 0x7f88f013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f5cb2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88f0138040 0x7f88f0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f54b1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a08e0 0x7f88f00a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f54b1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a08e0 0x7f88f00a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38208/0 (socket says 172.21.15.154:38208) 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f5cb2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88f0138040 0x7f88f0138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46426/0 (socket says 172.21.15.154:46426) 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f54b1700 1 -- 172.21.15.154:0/1627197963 learned_addr learned my addr 172.21.15.154:0/1627197963 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f64b3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a1230 0x7f88f013ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51974/0 (socket says 172.21.15.154:51974) 2023-09-30T22:26:21.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f5cb2700 1 -- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a1230 msgr2=0x7f88f013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f5cb2700 1 --2- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a1230 0x7f88f013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f5cb2700 1 -- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a08e0 msgr2=0x7f88f00a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f5cb2700 1 --2- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a08e0 0x7f88f00a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f5cb2700 1 -- 172.21.15.154:0/1627197963 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f009b9b0 con 0x7f88f0138040 2023-09-30T22:26:21.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f64b3700 1 --2- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a1230 0x7f88f013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.668+0000 7f88f54b1700 1 --2- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a08e0 0x7f88f00a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.669+0000 7f88f5cb2700 1 --2- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f0138040 0x7f88f0138410 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009850 tx=0x7f88ec009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76bbaf525d274cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.669+0000 7f88f4cb0700 1 -- 172.21.15.154:0/1627197963 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec005e30 con 0x7f88f0138040 2023-09-30T22:26:21.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f4cb0700 1 -- 172.21.15.154:0/1627197963 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec006030 con 0x7f88f0138040 2023-09-30T22:26:21.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f4cb0700 1 -- 172.21.15.154:0/1627197963 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0063c0 con 0x7f88f0138040 2023-09-30T22:26:21.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7fd9c17fa700 1 -- 172.21.15.154:0/1412395297 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9b8017020 con 0x7fd9c4138040 2023-09-30T22:26:21.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f7f16700 1 -- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f0138040 msgr2=0x7f88f0138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f7f16700 1 --2- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f0138040 0x7f88f0138410 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009850 tx=0x7f88ec009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:21.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f7f16700 1 -- 172.21.15.154:0/1627197963 shutdown_connections 2023-09-30T22:26:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f7f16700 1 --2- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a1230 0x7f88f013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f7f16700 1 --2- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f0138040 0x7f88f0138410 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f7f16700 1 --2- 172.21.15.154:0/1627197963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a08e0 0x7f88f00a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f7f16700 1 -- 172.21.15.154:0/1627197963 >> 172.21.15.154:0/1627197963 conn(0x7f88f00a2980 msgr2=0x7f88f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f7f16700 1 -- 172.21.15.154:0/1627197963 shutdown_connections 2023-09-30T22:26:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.670+0000 7f88f7f16700 1 -- 172.21.15.154:0/1627197963 wait complete. 2023-09-30T22:26:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.672+0000 7f88f7f16700 1 Processor -- start 2023-09-30T22:26:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.672+0000 7f88f7f16700 1 -- start start 2023-09-30T22:26:21.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.672+0000 7f88f7f16700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a08e0 0x7f88f01265c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.672+0000 7f88f7f16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a1230 0x7f88f0126b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.672+0000 7f88f7f16700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f0138040 0x7f88f0127040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.672+0000 7f88f7f16700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f009a240 con 0x7f88f0138040 2023-09-30T22:26:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.672+0000 7f88f7f16700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f01370e0 con 0x7f88f00a1230 2023-09-30T22:26:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f7f16700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0137690 con 0x7f88f00a08e0 2023-09-30T22:26:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f5cb2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a08e0 0x7f88f01265c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f5cb2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a08e0 0x7f88f01265c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51976/0 (socket says 172.21.15.154:51976) 2023-09-30T22:26:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f5cb2700 1 -- 172.21.15.154:0/1661372655 learned_addr learned my addr 172.21.15.154:0/1661372655 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f54b1700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a1230 0x7f88f0126b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f64b3700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f0138040 0x7f88f0127040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f54b1700 1 -- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a08e0 msgr2=0x7f88f01265c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f54b1700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a08e0 0x7f88f01265c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f54b1700 1 -- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f0138040 msgr2=0x7f88f0127040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f54b1700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f0138040 0x7f88f0127040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f54b1700 1 -- 172.21.15.154:0/1661372655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0009550 con 0x7f88f00a1230 2023-09-30T22:26:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f5cb2700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a08e0 0x7f88f01265c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88f54b1700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a1230 0x7f88f0126b00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e8e0 tx=0x7f88e000ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7fd432d86700 1 Processor -- start 2023-09-30T22:26:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.673+0000 7f88e67fc700 1 -- 172.21.15.154:0/1661372655 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0013680 con 0x7f88f00a1230 2023-09-30T22:26:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.674+0000 7f88e67fc700 1 -- 172.21.15.154:0/1661372655 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e00137e0 con 0x7f88f00a1230 2023-09-30T22:26:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.674+0000 7f88f7f16700 1 -- 172.21.15.154:0/1661372655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e8009a70 con 0x7f88f00a1230 2023-09-30T22:26:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.674+0000 7f88e67fc700 1 -- 172.21.15.154:0/1661372655 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0013b70 con 0x7f88f00a1230 2023-09-30T22:26:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.674+0000 7f88f7f16700 1 -- 172.21.15.154:0/1661372655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec009430 con 0x7f88f00a1230 2023-09-30T22:26:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.674+0000 7fd432d86700 1 -- start start 2023-09-30T22:26:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd432d86700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c06a770 0x7fd42c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd432d86700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd42c134f00 0x7fd42c09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd432d86700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c09eca0 con 0x7fd42c09dea0 2023-09-30T22:26:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd432d86700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c09f720 con 0x7fd42c134f00 2023-09-30T22:26:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd432d86700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c06b480 con 0x7fd42c06a770 2023-09-30T22:26:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7f88f7f16700 1 -- 172.21.15.154:0/1661372655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d80052e0 con 0x7f88f00a1230 2023-09-30T22:26:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd42bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd42c134f00 0x7fd42c09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd42bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd42c134f00 0x7fd42c09d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46450/0 (socket says 172.21.15.154:46450) 2023-09-30T22:26:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd42bfff700 1 -- 172.21.15.154:0/49287848 learned_addr learned my addr 172.21.15.154:0/49287848 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd430b22700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c06a770 0x7fd42c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd42bfff700 1 -- 172.21.15.154:0/49287848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c06a770 msgr2=0x7fd42c1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd42bfff700 1 --2- 172.21.15.154:0/49287848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c06a770 0x7fd42c1349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd42bfff700 1 -- 172.21.15.154:0/49287848 >> v1:172.21.15.154:6789/0 conn(0x7fd42c09dea0 legacy=0x7fd42c13ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7fd42bfff700 1 -- 172.21.15.154:0/49287848 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c1352d0 con 0x7fd42c134f00 2023-09-30T22:26:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.675+0000 7f88e67fc700 1 -- 172.21.15.154:0/1661372655 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88e0013cd0 con 0x7f88f00a1230 2023-09-30T22:26:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.676+0000 7fd42bfff700 1 --2- 172.21.15.154:0/49287848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c134f00 0x7fd42c09d960 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd4180098f0 tx=0x7fd418009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0bb0508a9c8604 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.676+0000 7f88e67fc700 1 -- 172.21.15.154:0/1661372655 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f88e0040020 con 0x7f88f00a1230 2023-09-30T22:26:21.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.676+0000 7fd42b7fe700 1 -- 172.21.15.154:0/49287848 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418004230 con 0x7fd42c134f00 2023-09-30T22:26:21.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.676+0000 7fd42b7fe700 1 -- 172.21.15.154:0/49287848 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd418004390 con 0x7fd42c134f00 2023-09-30T22:26:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.676+0000 7fd42b7fe700 1 -- 172.21.15.154:0/49287848 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4180036a0 con 0x7fd42c134f00 2023-09-30T22:26:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.677+0000 7fd432d86700 1 -- 172.21.15.154:0/49287848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c134f00 msgr2=0x7fd42c09d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.677+0000 7fd432d86700 1 --2- 172.21.15.154:0/49287848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c134f00 0x7fd42c09d960 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd4180098f0 tx=0x7fd418009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.677+0000 7fd432d86700 1 -- 172.21.15.154:0/49287848 shutdown_connections 2023-09-30T22:26:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.677+0000 7fd432d86700 1 --2- 172.21.15.154:0/49287848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c06a770 0x7fd42c1349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.677+0000 7fd432d86700 1 --2- 172.21.15.154:0/49287848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c134f00 0x7fd42c09d960 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.677+0000 7fd432d86700 1 -- 172.21.15.154:0/49287848 >> 172.21.15.154:0/49287848 conn(0x7fd42c099c40 msgr2=0x7fd42c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.677+0000 7fd432d86700 1 -- 172.21.15.154:0/49287848 shutdown_connections 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.677+0000 7fd432d86700 1 -- 172.21.15.154:0/49287848 wait complete. 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.678+0000 7fd432d86700 1 Processor -- start 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.678+0000 7fd432d86700 1 -- start start 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd432d86700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c06a770 0x7fd42c11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd432d86700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd42c09dea0 0x7fd42c11abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd432d86700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c134f00 0x7fd42c11b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd432d86700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c126370 con 0x7fd42c06a770 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd432d86700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c11c100 con 0x7fd42c09dea0 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd432d86700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c1341f0 con 0x7fd42c134f00 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd430b22700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c06a770 0x7fd42c11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd430b22700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c06a770 0x7fd42c11a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46462/0 (socket says 172.21.15.154:46462) 2023-09-30T22:26:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd430b22700 1 -- 172.21.15.154:0/3912813514 learned_addr learned my addr 172.21.15.154:0/3912813514 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.679+0000 7fd431323700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c134f00 0x7fd42c11b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd42bfff700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd42c09dea0 0x7fd42c11abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd431323700 1 -- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd42c09dea0 msgr2=0x7fd42c11abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd431323700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd42c09dea0 0x7fd42c11abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd431323700 1 -- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c06a770 msgr2=0x7fd42c11a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd431323700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c06a770 0x7fd42c11a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd431323700 1 -- 172.21.15.154:0/3912813514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418009550 con 0x7fd42c134f00 2023-09-30T22:26:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd430b22700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c06a770 0x7fd42c11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7f88e67fc700 1 -- 172.21.15.154:0/1661372655 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88e001adc0 con 0x7f88f00a1230 2023-09-30T22:26:21.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd431323700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c134f00 0x7fd42c11b100 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd42400c7b0 tx=0x7fd42400cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:21.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd4297fa700 1 -- 172.21.15.154:0/3912813514 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424003e10 con 0x7fd42c134f00 2023-09-30T22:26:21.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd432d86700 1 -- 172.21.15.154:0/3912813514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c11c490 con 0x7fd42c134f00 2023-09-30T22:26:21.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.680+0000 7fd432d86700 1 -- 172.21.15.154:0/3912813514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c126900 con 0x7fd42c134f00 2023-09-30T22:26:21.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.681+0000 7fd4297fa700 1 -- 172.21.15.154:0/3912813514 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4240050d0 con 0x7fd42c134f00 2023-09-30T22:26:21.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.681+0000 7fd4297fa700 1 -- 172.21.15.154:0/3912813514 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424005480 con 0x7fd42c134f00 2023-09-30T22:26:21.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.682+0000 7fd432d86700 1 -- 172.21.15.154:0/3912813514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c0052e0 con 0x7fd42c134f00 2023-09-30T22:26:21.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.682+0000 7fd4297fa700 1 -- 172.21.15.154:0/3912813514 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4240055e0 con 0x7fd42c134f00 2023-09-30T22:26:21.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.682+0000 7fd4297fa700 1 -- 172.21.15.154:0/3912813514 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd42403ee50 con 0x7fd42c134f00 2023-09-30T22:26:21.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.687+0000 7fd4297fa700 1 -- 172.21.15.154:0/3912813514 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd42400e280 con 0x7fd42c134f00 2023-09-30T22:26:21.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.835+0000 7f2d1fea8700 1 -- 172.21.15.154:0/712044871 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d1806ac50 con 0x7f2d181300a0 2023-09-30T22:26:21.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.835+0000 7f2d0e7fc700 1 -- 172.21.15.154:0/712044871 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d14015020 con 0x7f2d181300a0 2023-09-30T22:26:21.835 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:21.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.837+0000 7f2d1fea8700 1 -- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 msgr2=0x7f2d1811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.837+0000 7f2d1fea8700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d1811da40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2d140090b0 tx=0x7f2d14004750 comp rx=0 tx=0).stop 2023-09-30T22:26:21.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.837+0000 7f2d1fea8700 1 -- 172.21.15.154:0/712044871 shutdown_connections 2023-09-30T22:26:21.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.837+0000 7f2d1fea8700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d18133ad0 0x7f2d1811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.837+0000 7f2d1fea8700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d181300a0 0x7f2d1811da40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.837+0000 7f2d1fea8700 1 --2- 172.21.15.154:0/712044871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d181309f0 0x7f2d1811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.837+0000 7f2d1fea8700 1 -- 172.21.15.154:0/712044871 >> 172.21.15.154:0/712044871 conn(0x7f2d18099c40 msgr2=0x7f2d1812f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.837+0000 7f2d1fea8700 1 -- 172.21.15.154:0/712044871 shutdown_connections 2023-09-30T22:26:21.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.837+0000 7f2d1fea8700 1 -- 172.21.15.154:0/712044871 wait complete. 2023-09-30T22:26:21.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:21.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.866+0000 7fd9cae37700 1 -- 172.21.15.154:0/1412395297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd9a4005590 con 0x7fd9c4138040 2023-09-30T22:26:21.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.867+0000 7fd9c17fa700 1 -- 172.21.15.154:0/1412395297 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9b801b3b0 con 0x7fd9c4138040 2023-09-30T22:26:21.867 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:21.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.869+0000 7fd9cae37700 1 -- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138040 msgr2=0x7fd9c4121600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.869+0000 7fd9cae37700 1 --2- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138040 0x7fd9c4121600 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c430 tx=0x7fd9b800c740 comp rx=0 tx=0).stop 2023-09-30T22:26:21.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.869+0000 7fd9cae37700 1 -- 172.21.15.154:0/1412395297 shutdown_connections 2023-09-30T22:26:21.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.869+0000 7fd9cae37700 1 --2- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9c413dd10 0x7fd9c4122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.869+0000 7fd9cae37700 1 --2- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c4138040 0x7fd9c4121600 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.869+0000 7fd9cae37700 1 --2- 172.21.15.154:0/1412395297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9c4138410 0x7fd9c4121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.869+0000 7fd9cae37700 1 -- 172.21.15.154:0/1412395297 >> 172.21.15.154:0/1412395297 conn(0x7fd9c40a2980 msgr2=0x7fd9c409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.869+0000 7fd9cae37700 1 -- 172.21.15.154:0/1412395297 shutdown_connections 2023-09-30T22:26:21.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.869+0000 7fd9cae37700 1 -- 172.21.15.154:0/1412395297 wait complete. 2023-09-30T22:26:21.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.876+0000 7f88f7f16700 1 -- 172.21.15.154:0/1661372655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88d8005860 con 0x7f88f00a1230 2023-09-30T22:26:21.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.876+0000 7f88e67fc700 1 -- 172.21.15.154:0/1661372655 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88e001a360 con 0x7f88f00a1230 2023-09-30T22:26:21.877 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:21.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.878+0000 7f88f7f16700 1 -- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a1230 msgr2=0x7f88f0126b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.878+0000 7f88f7f16700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a1230 0x7f88f0126b00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f88e000e8e0 tx=0x7f88e000ebf0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.878+0000 7f88f7f16700 1 -- 172.21.15.154:0/1661372655 shutdown_connections 2023-09-30T22:26:21.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.878+0000 7f88f7f16700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f0138040 0x7f88f0127040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.878+0000 7f88f7f16700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88f00a08e0 0x7f88f01265c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.878+0000 7f88f7f16700 1 --2- 172.21.15.154:0/1661372655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f00a1230 0x7f88f0126b00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.878+0000 7f88f7f16700 1 -- 172.21.15.154:0/1661372655 >> 172.21.15.154:0/1661372655 conn(0x7f88f00a2980 msgr2=0x7f88f009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.878+0000 7f88f7f16700 1 -- 172.21.15.154:0/1661372655 shutdown_connections 2023-09-30T22:26:21.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.878+0000 7f88f7f16700 1 -- 172.21.15.154:0/1661372655 wait complete. 2023-09-30T22:26:21.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.880+0000 7fd432d86700 1 -- 172.21.15.154:0/3912813514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd40c005590 con 0x7fd42c134f00 2023-09-30T22:26:21.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.881+0000 7fd4297fa700 1 -- 172.21.15.154:0/3912813514 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd424040090 con 0x7fd42c134f00 2023-09-30T22:26:21.881 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:21.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:21.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.883+0000 7fd432d86700 1 -- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c134f00 msgr2=0x7fd42c11b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:21.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.883+0000 7fd432d86700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c134f00 0x7fd42c11b100 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd42400c7b0 tx=0x7fd42400cac0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.883+0000 7fd432d86700 1 -- 172.21.15.154:0/3912813514 shutdown_connections 2023-09-30T22:26:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.883+0000 7fd432d86700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd42c134f00 0x7fd42c11b100 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.883+0000 7fd432d86700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd42c06a770 0x7fd42c11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.883+0000 7fd432d86700 1 --2- 172.21.15.154:0/3912813514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd42c09dea0 0x7fd42c11abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.883+0000 7fd432d86700 1 -- 172.21.15.154:0/3912813514 >> 172.21.15.154:0/3912813514 conn(0x7fd42c099c40 msgr2=0x7fd42c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.883+0000 7fd432d86700 1 -- 172.21.15.154:0/3912813514 shutdown_connections 2023-09-30T22:26:21.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:21.883+0000 7fd432d86700 1 -- 172.21.15.154:0/3912813514 wait complete. 2023-09-30T22:26:21.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:21.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:22.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:22.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:22.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:22.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:22.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.992+0000 7f89b612a700 1 Processor -- start 2023-09-30T22:26:22.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89b612a700 1 -- start start 2023-09-30T22:26:22.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89b612a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b0138040 0x7f89b0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89b612a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b00a08e0 0x7f89b00a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:22.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89b612a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b01379e0 con 0x7f89b00a1230 2023-09-30T22:26:22.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89b612a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00a2100 con 0x7f89b00a08e0 2023-09-30T22:26:22.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89b612a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b0138950 con 0x7f89b0138040 2023-09-30T22:26:22.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89affff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f89b00a1230 0x7f89b013ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53012/0 (socket says 172.21.15.154:53012) 2023-09-30T22:26:22.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89affff700 1 -- 172.21.15.154:0/1686454285 learned_addr learned my addr 172.21.15.154:0/1686454285 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:22.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89aeffd700 1 --2- 172.21.15.154:0/1686454285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b00a08e0 0x7f89b00a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.993+0000 7f89af7fe700 1 --2- 172.21.15.154:0/1686454285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b0138040 0x7f89b0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:22.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89ae7fc700 1 -- 172.21.15.154:0/1686454285 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083639584 0 0) 0x7f89b01379e0 con 0x7f89b00a1230 2023-09-30T22:26:22.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89ae7fc700 1 -- 172.21.15.154:0/1686454285 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89980035b0 con 0x7f89b00a1230 2023-09-30T22:26:22.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89aeffd700 1 -- 172.21.15.154:0/1686454285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b0138040 msgr2=0x7f89b0138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:22.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89aeffd700 1 --2- 172.21.15.154:0/1686454285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b0138040 0x7f89b0138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89aeffd700 1 -- 172.21.15.154:0/1686454285 >> v1:172.21.15.154:6789/0 conn(0x7f89b00a1230 legacy=0x7f89b013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89aeffd700 1 -- 172.21.15.154:0/1686454285 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b009b9b0 con 0x7f89b00a08e0 2023-09-30T22:26:22.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89aeffd700 1 --2- 172.21.15.154:0/1686454285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b00a08e0 0x7f89b00a0cf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f89a40098a0 tx=0x7f89a4009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0e6bf8e16bbbb48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:22.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89ae7fc700 1 -- 172.21.15.154:0/1686454285 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4011830 con 0x7f89b00a08e0 2023-09-30T22:26:22.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89ae7fc700 1 -- 172.21.15.154:0/1686454285 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a4011990 con 0x7f89b00a08e0 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.994+0000 7f89ae7fc700 1 -- 172.21.15.154:0/1686454285 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4011d20 con 0x7f89b00a08e0 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.995+0000 7f89b612a700 1 -- 172.21.15.154:0/1686454285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b00a08e0 msgr2=0x7f89b00a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.995+0000 7f89b612a700 1 --2- 172.21.15.154:0/1686454285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b00a08e0 0x7f89b00a0cf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f89a40098a0 tx=0x7f89a4009bb0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.995+0000 7f89b612a700 1 -- 172.21.15.154:0/1686454285 shutdown_connections 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.995+0000 7f89b612a700 1 --2- 172.21.15.154:0/1686454285 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b0138040 0x7f89b0138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.995+0000 7f89b612a700 1 --2- 172.21.15.154:0/1686454285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b00a08e0 0x7f89b00a0cf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.995+0000 7f89b612a700 1 -- 172.21.15.154:0/1686454285 >> 172.21.15.154:0/1686454285 conn(0x7f89b00a2980 msgr2=0x7f89b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.995+0000 7f89b612a700 1 -- 172.21.15.154:0/1686454285 shutdown_connections 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.995+0000 7f89b612a700 1 -- 172.21.15.154:0/1686454285 wait complete. 2023-09-30T22:26:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.996+0000 7f89b612a700 1 Processor -- start 2023-09-30T22:26:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.996+0000 7f89b612a700 1 -- start start 2023-09-30T22:26:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89b612a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b00a08e0 0x7f89b0137090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89b612a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b00a1230 0x7f89b01375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89b612a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b0138040 0x7f89b0135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89b612a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b013f2f0 con 0x7f89b00a08e0 2023-09-30T22:26:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89b612a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b01403c0 con 0x7f89b0138040 2023-09-30T22:26:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89b612a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b009cb00 con 0x7f89b00a1230 2023-09-30T22:26:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b00a08e0 0x7f89b0137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89af7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b00a08e0 0x7f89b0137090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46474/0 (socket says 172.21.15.154:46474) 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89af7fe700 1 -- 172.21.15.154:0/2400464591 learned_addr learned my addr 172.21.15.154:0/2400464591 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89affff700 1 --2- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b0138040 0x7f89b0135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.997+0000 7f89aeffd700 1 --2- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b00a1230 0x7f89b01375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f89affff700 1 -- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b00a1230 msgr2=0x7f89b01375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f89affff700 1 --2- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b00a1230 0x7f89b01375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f89affff700 1 -- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b00a08e0 msgr2=0x7f89b0137090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f89affff700 1 --2- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b00a08e0 0x7f89b0137090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f89affff700 1 -- 172.21.15.154:0/2400464591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a40094a0 con 0x7f89b0138040 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f89affff700 1 --2- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b0138040 0x7f89b0135870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f89a800caa0 tx=0x7f89a800cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:23.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f8997fff700 1 -- 172.21.15.154:0/2400464591 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a800a9e0 con 0x7f89b0138040 2023-09-30T22:26:23.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f8997fff700 1 -- 172.21.15.154:0/2400464591 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a800ab40 con 0x7f89b0138040 2023-09-30T22:26:23.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f89b612a700 1 -- 172.21.15.154:0/2400464591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b013f9d0 con 0x7f89b0138040 2023-09-30T22:26:23.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f8997fff700 1 -- 172.21.15.154:0/2400464591 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8012400 con 0x7f89b0138040 2023-09-30T22:26:23.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.998+0000 7f89b612a700 1 -- 172.21.15.154:0/2400464591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b009a240 con 0x7f89b0138040 2023-09-30T22:26:23.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.999+0000 7f8997fff700 1 -- 172.21.15.154:0/2400464591 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89a801b3b0 con 0x7f89b0138040 2023-09-30T22:26:23.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:22.999+0000 7f8997fff700 1 -- 172.21.15.154:0/2400464591 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89a803f180 con 0x7f89b0138040 2023-09-30T22:26:23.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.000+0000 7f89b612a700 1 -- 172.21.15.154:0/2400464591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b01409c0 con 0x7f89b0138040 2023-09-30T22:26:23.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.009+0000 7f8997fff700 1 -- 172.21.15.154:0/2400464591 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89a8017080 con 0x7f89b0138040 2023-09-30T22:26:23.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.033+0000 7f9de6140700 1 Processor -- start 2023-09-30T22:26:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.033+0000 7f9de6140700 1 -- start start 2023-09-30T22:26:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.033+0000 7f9de6140700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.033+0000 7f9de6140700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de009edb0 0x7f9de009f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.033+0000 7f9de6140700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de0072b30 con 0x7f9de013c410 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9de6140700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de009a500 con 0x7f9de009edb0 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9de6140700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9de009f720 con 0x7f9de009a130 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9ddffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9de013c410 0x7f9de013e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53016/0 (socket says 172.21.15.154:53016) 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9ddffff700 1 -- 172.21.15.154:0/3817981460 learned_addr learned my addr 172.21.15.154:0/3817981460 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9ddeffd700 1 --2- 172.21.15.154:0/3817981460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de009edb0 0x7f9de009f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9dde7fc700 1 -- 172.21.15.154:0/3817981460 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684791862 0 0) 0x7f9de0072b30 con 0x7f9de013c410 2023-09-30T22:26:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9dde7fc700 1 -- 172.21.15.154:0/3817981460 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc80035b0 con 0x7f9de013c410 2023-09-30T22:26:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9ddf7fe700 1 -- 172.21.15.154:0/3817981460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de009edb0 msgr2=0x7f9de009f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9ddf7fe700 1 --2- 172.21.15.154:0/3817981460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de009edb0 0x7f9de009f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9ddf7fe700 1 -- 172.21.15.154:0/3817981460 >> v1:172.21.15.154:6789/0 conn(0x7f9de013c410 legacy=0x7f9de013e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9ddf7fe700 1 -- 172.21.15.154:0/3817981460 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de009fe00 con 0x7f9de009a130 2023-09-30T22:26:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9ddf7fe700 1 --2- 172.21.15.154:0/3817981460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de009e870 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009870 tx=0x7f9dd0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ead4d7e6cc1795e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.034+0000 7f9dde7fc700 1 -- 172.21.15.154:0/3817981460 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011830 con 0x7f9de009a130 2023-09-30T22:26:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9dde7fc700 1 -- 172.21.15.154:0/3817981460 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0011990 con 0x7f9de009a130 2023-09-30T22:26:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9dde7fc700 1 -- 172.21.15.154:0/3817981460 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011d20 con 0x7f9de009a130 2023-09-30T22:26:23.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9de6140700 1 -- 172.21.15.154:0/3817981460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 msgr2=0x7f9de009e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9de6140700 1 --2- 172.21.15.154:0/3817981460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de009e870 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009870 tx=0x7f9dd0009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:23.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9de6140700 1 -- 172.21.15.154:0/3817981460 shutdown_connections 2023-09-30T22:26:23.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9de6140700 1 --2- 172.21.15.154:0/3817981460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de009e870 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9de6140700 1 --2- 172.21.15.154:0/3817981460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de009edb0 0x7f9de009f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9de6140700 1 -- 172.21.15.154:0/3817981460 >> 172.21.15.154:0/3817981460 conn(0x7f9de00a4430 msgr2=0x7f9de00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9de6140700 1 -- 172.21.15.154:0/3817981460 shutdown_connections 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.035+0000 7f9de6140700 1 -- 172.21.15.154:0/3817981460 wait complete. 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.036+0000 7f9de6140700 1 Processor -- start 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.036+0000 7f9de6140700 1 -- start start 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9de6140700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de013bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9de6140700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de009edb0 0x7f9de013a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9de6140700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de013c410 0x7f9de013ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9de6140700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0134d60 con 0x7f9de009edb0 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9de6140700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00a00f0 con 0x7f9de013c410 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9de6140700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9de011bf50 con 0x7f9de009a130 2023-09-30T22:26:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de013bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de013bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52024/0 (socket says 172.21.15.154:52024) 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9ddf7fe700 1 -- 172.21.15.154:0/2519257715 learned_addr learned my addr 172.21.15.154:0/2519257715 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9ddeffd700 1 --2- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de009edb0 0x7f9de013a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9ddffff700 1 --2- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de013c410 0x7f9de013ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9ddf7fe700 1 -- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de013c410 msgr2=0x7f9de013ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9ddf7fe700 1 --2- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de013c410 0x7f9de013ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9ddf7fe700 1 -- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de009edb0 msgr2=0x7f9de013a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.037+0000 7f9ddf7fe700 1 --2- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de009edb0 0x7f9de013a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.038+0000 7f9ddf7fe700 1 -- 172.21.15.154:0/2519257715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00094a0 con 0x7f9de009a130 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.038+0000 7f9ddf7fe700 1 --2- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de013bc00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0000c00 tx=0x7f9dd0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.038+0000 7f9dc7fff700 1 -- 172.21.15.154:0/2519257715 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0004450 con 0x7f9de009a130 2023-09-30T22:26:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.038+0000 7f9dc7fff700 1 -- 172.21.15.154:0/2519257715 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd001e070 con 0x7f9de009a130 2023-09-30T22:26:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.038+0000 7f9de6140700 1 -- 172.21.15.154:0/2519257715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de011d000 con 0x7f9de009a130 2023-09-30T22:26:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.038+0000 7f9dc7fff700 1 -- 172.21.15.154:0/2519257715 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00038e0 con 0x7f9de009a130 2023-09-30T22:26:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.038+0000 7f9de6140700 1 -- 172.21.15.154:0/2519257715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de011e450 con 0x7f9de009a130 2023-09-30T22:26:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.039+0000 7f9dc7fff700 1 -- 172.21.15.154:0/2519257715 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dd0003a40 con 0x7f9de009a130 2023-09-30T22:26:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.039+0000 7f9dc7fff700 1 -- 172.21.15.154:0/2519257715 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9dd0040420 con 0x7f9de009a130 2023-09-30T22:26:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.039+0000 7f9de6140700 1 -- 172.21.15.154:0/2519257715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de004f2a0 con 0x7f9de009a130 2023-09-30T22:26:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f62952be700 1 Processor -- start 2023-09-30T22:26:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f62952be700 1 -- start start 2023-09-30T22:26:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f62952be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f62901359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f62952be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6290135f20 0x7f6290138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f62952be700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629009aaa0 con 0x7f629009d860 2023-09-30T22:26:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f62952be700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629009e730 con 0x7f6290135f20 2023-09-30T22:26:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f62952be700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f629009f870 con 0x7f629009e340 2023-09-30T22:26:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f628e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f62901359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f628e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f62901359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52040/0 (socket says 172.21.15.154:52040) 2023-09-30T22:26:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f628effd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f629009d860 0x7f629009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53030/0 (socket says 172.21.15.154:53030) 2023-09-30T22:26:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.043+0000 7f628e7fc700 1 -- 172.21.15.154:0/3650770202 learned_addr learned my addr 172.21.15.154:0/3650770202 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.044+0000 7f628f7fe700 1 --2- 172.21.15.154:0/3650770202 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6290135f20 0x7f6290138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.044+0000 7f628e7fc700 1 -- 172.21.15.154:0/3650770202 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6290135f20 msgr2=0x7f6290138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.044+0000 7f628e7fc700 1 --2- 172.21.15.154:0/3650770202 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6290135f20 0x7f6290138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.044+0000 7f628e7fc700 1 -- 172.21.15.154:0/3650770202 >> v1:172.21.15.154:6789/0 conn(0x7f629009d860 legacy=0x7f629009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.044+0000 7f628e7fc700 1 -- 172.21.15.154:0/3650770202 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629009b360 con 0x7f629009e340 2023-09-30T22:26:23.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.044+0000 7f9dc7fff700 1 -- 172.21.15.154:0/2519257715 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dd0015080 con 0x7f9de009a130 2023-09-30T22:26:23.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.044+0000 7f628e7fc700 1 --2- 172.21.15.154:0/3650770202 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f62901359e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6284009950 tx=0x7f6284009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=494b53dbbbb0e1ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.044+0000 7f628dffb700 1 -- 172.21.15.154:0/3650770202 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6284011830 con 0x7f629009e340 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.045+0000 7f628dffb700 1 -- 172.21.15.154:0/3650770202 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6284011990 con 0x7f629009e340 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.045+0000 7f628dffb700 1 -- 172.21.15.154:0/3650770202 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6284011d40 con 0x7f629009e340 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.045+0000 7f62952be700 1 -- 172.21.15.154:0/3650770202 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 msgr2=0x7f62901359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.045+0000 7f62952be700 1 --2- 172.21.15.154:0/3650770202 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f62901359e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6284009950 tx=0x7f6284009c60 comp rx=0 tx=0).stop 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.045+0000 7f62952be700 1 -- 172.21.15.154:0/3650770202 shutdown_connections 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.045+0000 7f62952be700 1 --2- 172.21.15.154:0/3650770202 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6290135f20 0x7f6290138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.045+0000 7f62952be700 1 --2- 172.21.15.154:0/3650770202 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f62901359e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.045+0000 7f62952be700 1 -- 172.21.15.154:0/3650770202 >> 172.21.15.154:0/3650770202 conn(0x7f6290099c40 msgr2=0x7f62900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.046+0000 7f62952be700 1 -- 172.21.15.154:0/3650770202 shutdown_connections 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.046+0000 7f62952be700 1 -- 172.21.15.154:0/3650770202 wait complete. 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f62952be700 1 Processor -- start 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f62952be700 1 -- start start 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f62952be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629009d860 0x7f629011d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f62952be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f629011da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f62952be700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6290135f20 0x7f629011df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f62952be700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6290131e70 con 0x7f6290135f20 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f62952be700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6290120fe0 con 0x7f629009d860 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f62952be700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62900a23d0 con 0x7f629009e340 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f628effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629009d860 0x7f629011d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f628effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629009d860 0x7f629011d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38268/0 (socket says 172.21.15.154:38268) 2023-09-30T22:26:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f628effd700 1 -- 172.21.15.154:0/2613136106 learned_addr learned my addr 172.21.15.154:0/2613136106 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.047+0000 7f628f7fe700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6290135f20 0x7f629011df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f628effd700 1 -- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 msgr2=0x7f629011da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f628e7fc700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f629011da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f628effd700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f629011da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f628effd700 1 -- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6290135f20 msgr2=0x7f629011df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f628effd700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6290135f20 0x7f629011df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f628effd700 1 -- 172.21.15.154:0/2613136106 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284009550 con 0x7f629009d860 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f628f7fe700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6290135f20 0x7f629011df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f628e7fc700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f629011da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f628effd700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629009d860 0x7f629011d4c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f628000c500 tx=0x7f628000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f62777fe700 1 -- 172.21.15.154:0/2613136106 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280005cb0 con 0x7f629009d860 2023-09-30T22:26:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f62777fe700 1 -- 172.21.15.154:0/2613136106 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6280005e10 con 0x7f629009d860 2023-09-30T22:26:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f62952be700 1 -- 172.21.15.154:0/2613136106 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629009c8b0 con 0x7f629009d860 2023-09-30T22:26:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f62777fe700 1 -- 172.21.15.154:0/2613136106 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62800072d0 con 0x7f629009d860 2023-09-30T22:26:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.048+0000 7f62952be700 1 -- 172.21.15.154:0/2613136106 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6290132450 con 0x7f629009d860 2023-09-30T22:26:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.049+0000 7f62952be700 1 -- 172.21.15.154:0/2613136106 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629004f2a0 con 0x7f629009d860 2023-09-30T22:26:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.050+0000 7f62777fe700 1 -- 172.21.15.154:0/2613136106 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6280007430 con 0x7f629009d860 2023-09-30T22:26:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.050+0000 7f62777fe700 1 -- 172.21.15.154:0/2613136106 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f628003f000 con 0x7f629009d860 2023-09-30T22:26:23.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.054+0000 7f62777fe700 1 -- 172.21.15.154:0/2613136106 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f628001b3b0 con 0x7f629009d860 2023-09-30T22:26:23.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.081+0000 7fd988a08700 1 Processor -- start 2023-09-30T22:26:23.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.081+0000 7fd988a08700 1 -- start start 2023-09-30T22:26:23.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd988a08700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd984133ad0 0x7fd984133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd988a08700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841300a0 0x7fd9841304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd988a08700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9841309f0 0x7fd98413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd988a08700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98406b2d0 con 0x7fd9841309f0 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd988a08700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd984133610 con 0x7fd9841300a0 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd988a08700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd98409a500 con 0x7fd984133ad0 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd98259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd984133ad0 0x7fd984133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd98259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd984133ad0 0x7fd984133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52070/0 (socket says 172.21.15.154:52070) 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd98259c700 1 -- 172.21.15.154:0/2514150788 learned_addr learned my addr 172.21.15.154:0/2514150788 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd981d9b700 1 --2- 172.21.15.154:0/2514150788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841300a0 0x7fd9841304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd982d9d700 1 --2- 172.21.15.154:0/2514150788 >> v2:172.21.15.154:3300/0 conn(0x7fd9841309f0 0x7fd98413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd98259c700 1 -- 172.21.15.154:0/2514150788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841300a0 msgr2=0x7fd9841304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd98259c700 1 --2- 172.21.15.154:0/2514150788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841300a0 0x7fd9841304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd98259c700 1 -- 172.21.15.154:0/2514150788 >> v2:172.21.15.154:3300/0 conn(0x7fd9841309f0 msgr2=0x7fd98413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd98259c700 1 --2- 172.21.15.154:0/2514150788 >> v2:172.21.15.154:3300/0 conn(0x7fd9841309f0 0x7fd98413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd98259c700 1 -- 172.21.15.154:0/2514150788 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9841338b0 con 0x7fd984133ad0 2023-09-30T22:26:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.082+0000 7fd981d9b700 1 --2- 172.21.15.154:0/2514150788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841300a0 0x7fd9841304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.083+0000 7fd98259c700 1 --2- 172.21.15.154:0/2514150788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd984133ad0 0x7fd984133ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd9740098f0 tx=0x7fd974009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c1c763790b9e736 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.083+0000 7fd98159a700 1 -- 172.21.15.154:0/2514150788 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974011830 con 0x7fd984133ad0 2023-09-30T22:26:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.083+0000 7fd98159a700 1 -- 172.21.15.154:0/2514150788 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd974011990 con 0x7fd984133ad0 2023-09-30T22:26:23.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.083+0000 7fd98159a700 1 -- 172.21.15.154:0/2514150788 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974011d20 con 0x7fd984133ad0 2023-09-30T22:26:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.084+0000 7fd988a08700 1 -- 172.21.15.154:0/2514150788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd984133ad0 msgr2=0x7fd984133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.084+0000 7fd988a08700 1 --2- 172.21.15.154:0/2514150788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd984133ad0 0x7fd984133ea0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd9740098f0 tx=0x7fd974009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.084+0000 7fd988a08700 1 -- 172.21.15.154:0/2514150788 shutdown_connections 2023-09-30T22:26:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.084+0000 7fd988a08700 1 --2- 172.21.15.154:0/2514150788 >> v2:172.21.15.154:3300/0 conn(0x7fd9841309f0 0x7fd98413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.084+0000 7fd988a08700 1 --2- 172.21.15.154:0/2514150788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd984133ad0 0x7fd984133ea0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.084+0000 7fd988a08700 1 --2- 172.21.15.154:0/2514150788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841300a0 0x7fd9841304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.084+0000 7fd988a08700 1 -- 172.21.15.154:0/2514150788 >> 172.21.15.154:0/2514150788 conn(0x7fd984099c40 msgr2=0x7fd9840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:23.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.084+0000 7fd988a08700 1 -- 172.21.15.154:0/2514150788 shutdown_connections 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.084+0000 7fd988a08700 1 -- 172.21.15.154:0/2514150788 wait complete. 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.085+0000 7fd988a08700 1 Processor -- start 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.085+0000 7fd988a08700 1 -- start start 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd988a08700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9841300a0 0x7fd98411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd988a08700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841309f0 0x7fd98411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd988a08700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd984133ad0 0x7fd98411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd988a08700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98411fde0 con 0x7fd984133ad0 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd988a08700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98411f850 con 0x7fd9841309f0 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd988a08700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9841200c0 con 0x7fd9841300a0 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd98259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9841300a0 0x7fd98411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd98259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9841300a0 0x7fd98411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52082/0 (socket says 172.21.15.154:52082) 2023-09-30T22:26:23.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd98259c700 1 -- 172.21.15.154:0/3607782719 learned_addr learned my addr 172.21.15.154:0/3607782719 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd981d9b700 1 --2- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841309f0 0x7fd98411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd982d9d700 1 --2- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd984133ad0 0x7fd98411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd98259c700 1 -- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841309f0 msgr2=0x7fd98411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd98259c700 1 --2- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841309f0 0x7fd98411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd98259c700 1 -- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd984133ad0 msgr2=0x7fd98411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd98259c700 1 --2- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd984133ad0 0x7fd98411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.086+0000 7fd98259c700 1 -- 172.21.15.154:0/3607782719 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780094a0 con 0x7fd9841300a0 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.087+0000 7fd98259c700 1 --2- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9841300a0 0x7fd98411da40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd974009c40 tx=0x7fd974004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.087+0000 7fd972ffd700 1 -- 172.21.15.154:0/3607782719 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974004450 con 0x7fd9841300a0 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.087+0000 7fd972ffd700 1 -- 172.21.15.154:0/3607782719 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9740045d0 con 0x7fd9841300a0 2023-09-30T22:26:23.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.087+0000 7fd972ffd700 1 -- 172.21.15.154:0/3607782719 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9740038e0 con 0x7fd9841300a0 2023-09-30T22:26:23.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.087+0000 7fd988a08700 1 -- 172.21.15.154:0/3607782719 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd974009550 con 0x7fd9841300a0 2023-09-30T22:26:23.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.087+0000 7fd988a08700 1 -- 172.21.15.154:0/3607782719 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9841209c0 con 0x7fd9841300a0 2023-09-30T22:26:23.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.088+0000 7fd972ffd700 1 -- 172.21.15.154:0/3607782719 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd974003a40 con 0x7fd9841300a0 2023-09-30T22:26:23.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.088+0000 7fd972ffd700 1 -- 172.21.15.154:0/3607782719 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd974040700 con 0x7fd9841300a0 2023-09-30T22:26:23.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.088+0000 7fd988a08700 1 -- 172.21.15.154:0/3607782719 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98411f400 con 0x7fd9841300a0 2023-09-30T22:26:23.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.093+0000 7fd972ffd700 1 -- 172.21.15.154:0/3607782719 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd974015080 con 0x7fd9841300a0 2023-09-30T22:26:23.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.230+0000 7f89b612a700 1 -- 172.21.15.154:0/2400464591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f89b004f2a0 con 0x7f89b0138040 2023-09-30T22:26:23.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.230+0000 7f8997fff700 1 -- 172.21.15.154:0/2400464591 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89a80192c0 con 0x7f89b0138040 2023-09-30T22:26:23.230 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:23.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.232+0000 7f89b612a700 1 -- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b0138040 msgr2=0x7f89b0135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.232+0000 7f89b612a700 1 --2- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b0138040 0x7f89b0135870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f89a800caa0 tx=0x7f89a800cdb0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.232+0000 7f89b612a700 1 -- 172.21.15.154:0/2400464591 shutdown_connections 2023-09-30T22:26:23.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.232+0000 7f89b612a700 1 --2- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89b0138040 0x7f89b0135870 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.232+0000 7f89b612a700 1 --2- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89b00a08e0 0x7f89b0137090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.232+0000 7f89b612a700 1 --2- 172.21.15.154:0/2400464591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89b00a1230 0x7f89b01375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.232+0000 7f89b612a700 1 -- 172.21.15.154:0/2400464591 >> 172.21.15.154:0/2400464591 conn(0x7f89b00a2980 msgr2=0x7f89b0071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:23.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.232+0000 7f89b612a700 1 -- 172.21.15.154:0/2400464591 shutdown_connections 2023-09-30T22:26:23.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.232+0000 7f89b612a700 1 -- 172.21.15.154:0/2400464591 wait complete. 2023-09-30T22:26:23.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:23.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.262+0000 7f62952be700 1 -- 172.21.15.154:0/2613136106 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6290120d60 con 0x7f629009d860 2023-09-30T22:26:23.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.262+0000 7f62777fe700 1 -- 172.21.15.154:0/2613136106 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62800192c0 con 0x7f629009d860 2023-09-30T22:26:23.262 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:23.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f9de6140700 1 -- 172.21.15.154:0/2519257715 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9de006be20 con 0x7f9de009a130 2023-09-30T22:26:23.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f62952be700 1 -- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629009d860 msgr2=0x7f629011d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f62952be700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629009d860 0x7f629011d4c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f628000c500 tx=0x7f628000c8c0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f9dc7fff700 1 -- 172.21.15.154:0/2519257715 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dd002d7d0 con 0x7f9de009a130 2023-09-30T22:26:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f62952be700 1 -- 172.21.15.154:0/2613136106 shutdown_connections 2023-09-30T22:26:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f62952be700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6290135f20 0x7f629011df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f62952be700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f629009d860 0x7f629011d4c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f62952be700 1 --2- 172.21.15.154:0/2613136106 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f629009e340 0x7f629011da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f62952be700 1 -- 172.21.15.154:0/2613136106 >> 172.21.15.154:0/2613136106 conn(0x7f6290099c40 msgr2=0x7f62900711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:23.265 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:23.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f62952be700 1 -- 172.21.15.154:0/2613136106 shutdown_connections 2023-09-30T22:26:23.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.264+0000 7f62952be700 1 -- 172.21.15.154:0/2613136106 wait complete. 2023-09-30T22:26:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.266+0000 7f9de6140700 1 -- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 msgr2=0x7f9de013bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.266+0000 7f9de6140700 1 --2- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de013bc00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0000c00 tx=0x7f9dd0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.267+0000 7f9de6140700 1 -- 172.21.15.154:0/2519257715 shutdown_connections 2023-09-30T22:26:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.267+0000 7f9de6140700 1 --2- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de013c410 0x7f9de013ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.267+0000 7f9de6140700 1 --2- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9de009a130 0x7f9de013bc00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.267+0000 7f9de6140700 1 --2- 172.21.15.154:0/2519257715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de009edb0 0x7f9de013a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.267+0000 7f9de6140700 1 -- 172.21.15.154:0/2519257715 >> 172.21.15.154:0/2519257715 conn(0x7f9de00a4430 msgr2=0x7f9de009ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.267+0000 7f9de6140700 1 -- 172.21.15.154:0/2519257715 shutdown_connections 2023-09-30T22:26:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.267+0000 7f9de6140700 1 -- 172.21.15.154:0/2519257715 wait complete. 2023-09-30T22:26:23.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:23.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:23.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.288+0000 7fd988a08700 1 -- 172.21.15.154:0/3607782719 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd98412dd00 con 0x7fd9841300a0 2023-09-30T22:26:23.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.288+0000 7fd972ffd700 1 -- 172.21.15.154:0/3607782719 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd974028020 con 0x7fd9841300a0 2023-09-30T22:26:23.288 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:23.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.290+0000 7fd988a08700 1 -- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9841300a0 msgr2=0x7fd98411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:23.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.290+0000 7fd988a08700 1 --2- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9841300a0 0x7fd98411da40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd974009c40 tx=0x7fd974004750 comp rx=0 tx=0).stop 2023-09-30T22:26:23.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.290+0000 7fd988a08700 1 -- 172.21.15.154:0/3607782719 shutdown_connections 2023-09-30T22:26:23.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.290+0000 7fd988a08700 1 --2- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd984133ad0 0x7fd98411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.290+0000 7fd988a08700 1 --2- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9841300a0 0x7fd98411da40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.290+0000 7fd988a08700 1 --2- 172.21.15.154:0/3607782719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9841309f0 0x7fd98411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:23.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.290+0000 7fd988a08700 1 -- 172.21.15.154:0/3607782719 >> 172.21.15.154:0/3607782719 conn(0x7fd984099c40 msgr2=0x7fd98412e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:23.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.291+0000 7fd988a08700 1 -- 172.21.15.154:0/3607782719 shutdown_connections 2023-09-30T22:26:23.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:23.291+0000 7fd988a08700 1 -- 172.21.15.154:0/3607782719 wait complete. 2023-09-30T22:26:23.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:24.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:24.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:24.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:24.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.385+0000 7f7638bfd700 1 Processor -- start 2023-09-30T22:26:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.385+0000 7f7638bfd700 1 -- start start 2023-09-30T22:26:24.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.385+0000 7f7638bfd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409f350 0x7f7634136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.385+0000 7f7638bfd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7634137000 0x7f76341393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7638bfd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763409b6a0 con 0x7f763409e870 2023-09-30T22:26:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7638bfd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763409f720 con 0x7f7634137000 2023-09-30T22:26:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7638bfd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f763409ad60 con 0x7f763409f350 2023-09-30T22:26:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7632d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7634137000 0x7f76341393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7632d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7634137000 0x7f76341393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46534/0 (socket says 172.21.15.154:46534) 2023-09-30T22:26:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7632d9d700 1 -- 172.21.15.154:0/2076867123 learned_addr learned my addr 172.21.15.154:0/2076867123 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f763259c700 1 --1- 172.21.15.154:0/2076867123 >> v1:172.21.15.154:6789/0 conn(0x7f763409e870 0x7f763409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53040/0 (socket says 172.21.15.154:53040) 2023-09-30T22:26:24.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7631d9b700 1 --2- 172.21.15.154:0/2076867123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409f350 0x7f7634136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7631d9b700 1 -- 172.21.15.154:0/2076867123 >> v2:172.21.15.154:3300/0 conn(0x7f7634137000 msgr2=0x7f76341393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7631d9b700 1 --2- 172.21.15.154:0/2076867123 >> v2:172.21.15.154:3300/0 conn(0x7f7634137000 0x7f76341393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7631d9b700 1 -- 172.21.15.154:0/2076867123 >> v1:172.21.15.154:6789/0 conn(0x7f763409e870 legacy=0x7f763409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7631d9b700 1 -- 172.21.15.154:0/2076867123 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76340a0650 con 0x7f763409f350 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f763159a700 1 -- 172.21.15.154:0/2076867123 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988680013 0 0) 0x7f763409b6a0 con 0x7f763409e870 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7632d9d700 1 --2- 172.21.15.154:0/2076867123 >> v2:172.21.15.154:3300/0 conn(0x7f7634137000 0x7f76341393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.386+0000 7f7631d9b700 1 --2- 172.21.15.154:0/2076867123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409f350 0x7f7634136ac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7628009840 tx=0x7f7628009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15ac62df7a6d4afd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.387+0000 7f763159a700 1 -- 172.21.15.154:0/2076867123 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628011830 con 0x7f763409f350 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.387+0000 7f763159a700 1 -- 172.21.15.154:0/2076867123 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7628011990 con 0x7f763409f350 2023-09-30T22:26:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.387+0000 7f763159a700 1 -- 172.21.15.154:0/2076867123 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628011d20 con 0x7f763409f350 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.387+0000 7f7638bfd700 1 -- 172.21.15.154:0/2076867123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409f350 msgr2=0x7f7634136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.387+0000 7f7638bfd700 1 --2- 172.21.15.154:0/2076867123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409f350 0x7f7634136ac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7628009840 tx=0x7f7628009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.387+0000 7f7638bfd700 1 -- 172.21.15.154:0/2076867123 shutdown_connections 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.387+0000 7f7638bfd700 1 --2- 172.21.15.154:0/2076867123 >> v2:172.21.15.154:3300/0 conn(0x7f7634137000 0x7f76341393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.387+0000 7f7638bfd700 1 --2- 172.21.15.154:0/2076867123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409f350 0x7f7634136ac0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.387+0000 7f7638bfd700 1 -- 172.21.15.154:0/2076867123 >> 172.21.15.154:0/2076867123 conn(0x7f76340a4150 msgr2=0x7f76340a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.388+0000 7f7638bfd700 1 -- 172.21.15.154:0/2076867123 shutdown_connections 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.388+0000 7f7638bfd700 1 -- 172.21.15.154:0/2076867123 wait complete. 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7638bfd700 1 Processor -- start 2023-09-30T22:26:24.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7638bfd700 1 -- start start 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7638bfd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409e870 0x7f7634120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7638bfd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f763409f350 0x7f7634120c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7638bfd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7634137000 0x7f76341211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7638bfd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76340a2f10 con 0x7f763409f350 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7638bfd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763409d820 con 0x7f7634137000 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7638bfd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76341223a0 con 0x7f763409e870 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f763259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409e870 0x7f7634120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f763259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409e870 0x7f7634120740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52110/0 (socket says 172.21.15.154:52110) 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f763259c700 1 -- 172.21.15.154:0/1291413544 learned_addr learned my addr 172.21.15.154:0/1291413544 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:24.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7631d9b700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f763409f350 0x7f7634120c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.389+0000 7f7632d9d700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7634137000 0x7f76341211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7631d9b700 1 -- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409e870 msgr2=0x7f7634120740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7631d9b700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409e870 0x7f7634120740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7631d9b700 1 -- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7634137000 msgr2=0x7f76341211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7631d9b700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7634137000 0x7f76341211c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7631d9b700 1 -- 172.21.15.154:0/1291413544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c009b30 con 0x7f763409f350 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f763259c700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409e870 0x7f7634120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7631d9b700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f763409f350 0x7f7634120c80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f7628016000 tx=0x7f7628004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7622ffd700 1 -- 172.21.15.154:0/1291413544 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628004480 con 0x7f763409f350 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7622ffd700 1 -- 172.21.15.154:0/1291413544 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762801f070 con 0x7f763409f350 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7638bfd700 1 -- 172.21.15.154:0/1291413544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76280094a0 con 0x7f763409f350 2023-09-30T22:26:24.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7622ffd700 1 -- 172.21.15.154:0/1291413544 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280038a0 con 0x7f763409f350 2023-09-30T22:26:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.390+0000 7f7638bfd700 1 -- 172.21.15.154:0/1291413544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76341241a0 con 0x7f763409f350 2023-09-30T22:26:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.391+0000 7f7622ffd700 1 -- 172.21.15.154:0/1291413544 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7628021030 con 0x7f763409f350 2023-09-30T22:26:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.392+0000 7f7622ffd700 1 -- 172.21.15.154:0/1291413544 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7628040a20 con 0x7f763409f350 2023-09-30T22:26:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.392+0000 7f7638bfd700 1 -- 172.21.15.154:0/1291413544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763404f2a0 con 0x7f763409f350 2023-09-30T22:26:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.397+0000 7f7622ffd700 1 -- 172.21.15.154:0/1291413544 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7628003a00 con 0x7f763409f350 2023-09-30T22:26:24.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.426+0000 7ffa62cc5700 1 Processor -- start 2023-09-30T22:26:24.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.426+0000 7ffa62cc5700 1 -- start start 2023-09-30T22:26:24.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.427+0000 7ffa62cc5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c09d860 0x7ffa5c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.427+0000 7ffa62cc5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.427+0000 7ffa62cc5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c09aaa0 con 0x7ffa5c130ce0 2023-09-30T22:26:24.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.427+0000 7ffa62cc5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c09f870 con 0x7ffa5c09d860 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.427+0000 7ffa62cc5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c09b360 con 0x7ffa5c09e170 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.427+0000 7ffa61262700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ffa5c130ce0 0x7ffa5c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53050/0 (socket says 172.21.15.154:53050) 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.427+0000 7ffa60a61700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c09d860 0x7ffa5c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.427+0000 7ffa61262700 1 -- 172.21.15.154:0/1738727850 learned_addr learned my addr 172.21.15.154:0/1738727850 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.427+0000 7ffa5bfff700 1 --2- 172.21.15.154:0/1738727850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.428+0000 7ffa5b7fe700 1 -- 172.21.15.154:0/1738727850 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723771061 0 0) 0x7ffa5c09aaa0 con 0x7ffa5c130ce0 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.428+0000 7ffa60a61700 1 -- 172.21.15.154:0/1738727850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 msgr2=0x7ffa5c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.428+0000 7ffa60a61700 1 --2- 172.21.15.154:0/1738727850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.428+0000 7ffa60a61700 1 -- 172.21.15.154:0/1738727850 >> v1:172.21.15.154:6789/0 conn(0x7ffa5c130ce0 legacy=0x7ffa5c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.428+0000 7ffa60a61700 1 -- 172.21.15.154:0/1738727850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c09b620 con 0x7ffa5c09d860 2023-09-30T22:26:24.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.428+0000 7ffa60a61700 1 --2- 172.21.15.154:0/1738727850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c09d860 0x7ffa5c09dc30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009870 tx=0x7ffa50009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d22036df396f964 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.428+0000 7ffa5b7fe700 1 -- 172.21.15.154:0/1738727850 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50011830 con 0x7ffa5c09d860 2023-09-30T22:26:24.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.428+0000 7ffa5b7fe700 1 -- 172.21.15.154:0/1738727850 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa50011990 con 0x7ffa5c09d860 2023-09-30T22:26:24.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.428+0000 7ffa5b7fe700 1 -- 172.21.15.154:0/1738727850 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50011d20 con 0x7ffa5c09d860 2023-09-30T22:26:24.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.429+0000 7ffa62cc5700 1 -- 172.21.15.154:0/1738727850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c09d860 msgr2=0x7ffa5c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.429+0000 7ffa62cc5700 1 --2- 172.21.15.154:0/1738727850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c09d860 0x7ffa5c09dc30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009870 tx=0x7ffa50009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:24.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.429+0000 7ffa62cc5700 1 -- 172.21.15.154:0/1738727850 shutdown_connections 2023-09-30T22:26:24.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.429+0000 7ffa62cc5700 1 --2- 172.21.15.154:0/1738727850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c09d860 0x7ffa5c09dc30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.429+0000 7ffa62cc5700 1 --2- 172.21.15.154:0/1738727850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.429+0000 7ffa62cc5700 1 -- 172.21.15.154:0/1738727850 >> 172.21.15.154:0/1738727850 conn(0x7ffa5c099c40 msgr2=0x7ffa5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.429+0000 7ffa62cc5700 1 -- 172.21.15.154:0/1738727850 shutdown_connections 2023-09-30T22:26:24.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.429+0000 7ffa62cc5700 1 -- 172.21.15.154:0/1738727850 wait complete. 2023-09-30T22:26:24.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.430+0000 7ffa62cc5700 1 Processor -- start 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.430+0000 7ffa62cc5700 1 -- start start 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa62cc5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5c09d860 0x7ffa5c1cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa62cc5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa62cc5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c130ce0 0x7ffa5c12e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa62cc5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c1cc470 con 0x7ffa5c09d860 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa62cc5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c1cd340 con 0x7ffa5c130ce0 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa62cc5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c12ff90 con 0x7ffa5c09e170 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa5bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa5bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52130/0 (socket says 172.21.15.154:52130) 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa5bfff700 1 -- 172.21.15.154:0/3860137852 learned_addr learned my addr 172.21.15.154:0/3860137852 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:24.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa60a61700 1 --2- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5c09d860 0x7ffa5c1cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa61262700 1 --2- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c130ce0 0x7ffa5c12e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa5bfff700 1 -- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c130ce0 msgr2=0x7ffa5c12e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa5bfff700 1 --2- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c130ce0 0x7ffa5c12e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa5bfff700 1 -- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5c09d860 msgr2=0x7ffa5c1cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa5bfff700 1 --2- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5c09d860 0x7ffa5c1cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.431+0000 7ffa5bfff700 1 -- 172.21.15.154:0/3860137852 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500094a0 con 0x7ffa5c09e170 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.432+0000 7ffa5bfff700 1 --2- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1cce00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800e980 tx=0x7ffa4800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.432+0000 7ffa597fa700 1 -- 172.21.15.154:0/3860137852 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48009710 con 0x7ffa5c09e170 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.432+0000 7ffa597fa700 1 -- 172.21.15.154:0/3860137852 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4800c690 con 0x7ffa5c09e170 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.432+0000 7ffa597fa700 1 -- 172.21.15.154:0/3860137852 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800ca20 con 0x7ffa5c09e170 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.432+0000 7ffa62cc5700 1 -- 172.21.15.154:0/3860137852 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c11f8c0 con 0x7ffa5c09e170 2023-09-30T22:26:24.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.432+0000 7ffa62cc5700 1 -- 172.21.15.154:0/3860137852 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c120330 con 0x7ffa5c09e170 2023-09-30T22:26:24.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.433+0000 7ffa597fa700 1 -- 172.21.15.154:0/3860137852 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa4800cb80 con 0x7ffa5c09e170 2023-09-30T22:26:24.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.433+0000 7ffa62cc5700 1 -- 172.21.15.154:0/3860137852 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c04f2a0 con 0x7ffa5c09e170 2023-09-30T22:26:24.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.433+0000 7ffa597fa700 1 -- 172.21.15.154:0/3860137852 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa4803f860 con 0x7ffa5c09e170 2023-09-30T22:26:24.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.435+0000 7ff6b545d700 1 Processor -- start 2023-09-30T22:26:24.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.435+0000 7ff6b545d700 1 -- start start 2023-09-30T22:26:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.435+0000 7ff6b545d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6b009ad40 0x7ff6b0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.435+0000 7ff6b545d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b0133f70 0x7ff6b01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.435+0000 7ff6b545d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b009b110 con 0x7ff6b00a0a70 2023-09-30T22:26:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.435+0000 7ff6b545d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b00a3b60 con 0x7ff6b009ad40 2023-09-30T22:26:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.435+0000 7ff6b545d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b01348e0 con 0x7ff6b0133f70 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6ae7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b0133f70 0x7ff6b01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6ae7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b0133f70 0x7ff6b01343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38332/0 (socket says 172.21.15.154:38332) 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6ae7fc700 1 -- 172.21.15.154:0/3439761705 learned_addr learned my addr 172.21.15.154:0/3439761705 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6aeffd700 1 --2- 172.21.15.154:0/3439761705 >> v2:172.21.15.154:3300/0 conn(0x7ff6b009ad40 0x7ff6b0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6ae7fc700 1 -- 172.21.15.154:0/3439761705 >> v2:172.21.15.154:3300/0 conn(0x7ff6b009ad40 msgr2=0x7ff6b0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6ae7fc700 1 --2- 172.21.15.154:0/3439761705 >> v2:172.21.15.154:3300/0 conn(0x7ff6b009ad40 0x7ff6b0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6ae7fc700 1 -- 172.21.15.154:0/3439761705 >> v1:172.21.15.154:6789/0 conn(0x7ff6b00a0a70 legacy=0x7ff6b00a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6ae7fc700 1 -- 172.21.15.154:0/3439761705 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00a2fa0 con 0x7ff6b0133f70 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6ae7fc700 1 --2- 172.21.15.154:0/3439761705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b0133f70 0x7ff6b01343a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098f0 tx=0x7ff6a4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46e7137bbdc52386 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6adffb700 1 -- 172.21.15.154:0/3439761705 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4011830 con 0x7ff6b0133f70 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6adffb700 1 -- 172.21.15.154:0/3439761705 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a4011990 con 0x7ff6b0133f70 2023-09-30T22:26:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.436+0000 7ff6adffb700 1 -- 172.21.15.154:0/3439761705 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4011d20 con 0x7ff6b0133f70 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.437+0000 7ff6b545d700 1 -- 172.21.15.154:0/3439761705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b0133f70 msgr2=0x7ff6b01343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.437+0000 7ff6b545d700 1 --2- 172.21.15.154:0/3439761705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b0133f70 0x7ff6b01343a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098f0 tx=0x7ff6a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.437+0000 7ff6b545d700 1 -- 172.21.15.154:0/3439761705 shutdown_connections 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.437+0000 7ff6b545d700 1 --2- 172.21.15.154:0/3439761705 >> v2:172.21.15.154:3300/0 conn(0x7ff6b009ad40 0x7ff6b0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.437+0000 7ff6b545d700 1 --2- 172.21.15.154:0/3439761705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b0133f70 0x7ff6b01343a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.437+0000 7ff6b545d700 1 -- 172.21.15.154:0/3439761705 >> 172.21.15.154:0/3439761705 conn(0x7ff6b0099c40 msgr2=0x7ff6b006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.437+0000 7ff6b545d700 1 -- 172.21.15.154:0/3439761705 shutdown_connections 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.438+0000 7ff6b545d700 1 -- 172.21.15.154:0/3439761705 wait complete. 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.439+0000 7ff6b545d700 1 Processor -- start 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.439+0000 7ff6b545d700 1 -- start start 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6b545d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b009ad40 0x7ff6b01c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6b545d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b00a0a70 0x7ff6b01c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6b545d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b0133f70 0x7ff6b01c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6b545d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0121920 con 0x7ff6b0133f70 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6b545d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0120e60 con 0x7ff6b009ad40 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6b545d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b01c5cf0 con 0x7ff6b00a0a70 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6aeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b009ad40 0x7ff6b01c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6aeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b009ad40 0x7ff6b01c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38344/0 (socket says 172.21.15.154:38344) 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6aeffd700 1 -- 172.21.15.154:0/2916799368 learned_addr learned my addr 172.21.15.154:0/2916799368 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6af7fe700 1 --2- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b0133f70 0x7ff6b01c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6aeffd700 1 -- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b00a0a70 msgr2=0x7ff6b01c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6aeffd700 1 --2- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b00a0a70 0x7ff6b01c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6aeffd700 1 -- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b0133f70 msgr2=0x7ff6b01c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6aeffd700 1 --2- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b0133f70 0x7ff6b01c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6aeffd700 1 -- 172.21.15.154:0/2916799368 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009550 con 0x7ff6b009ad40 2023-09-30T22:26:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6aeffd700 1 --2- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b009ad40 0x7ff6b01c5270 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000e870 tx=0x7ff6a000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.440+0000 7ff6977fe700 1 -- 172.21.15.154:0/2916799368 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0013680 con 0x7ff6b009ad40 2023-09-30T22:26:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.441+0000 7ff6977fe700 1 -- 172.21.15.154:0/2916799368 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a00137e0 con 0x7ff6b009ad40 2023-09-30T22:26:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.441+0000 7ff6977fe700 1 -- 172.21.15.154:0/2916799368 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0013b50 con 0x7ff6b009ad40 2023-09-30T22:26:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.441+0000 7ff6b545d700 1 -- 172.21.15.154:0/2916799368 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b011fc10 con 0x7ff6b009ad40 2023-09-30T22:26:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.441+0000 7ff6b545d700 1 -- 172.21.15.154:0/2916799368 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b0121b20 con 0x7ff6b009ad40 2023-09-30T22:26:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.442+0000 7ffa597fa700 1 -- 172.21.15.154:0/3860137852 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa48017070 con 0x7ffa5c09e170 2023-09-30T22:26:24.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.442+0000 7ff6b545d700 1 -- 172.21.15.154:0/2916799368 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b004f2a0 con 0x7ff6b009ad40 2023-09-30T22:26:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.448+0000 7ff6977fe700 1 -- 172.21.15.154:0/2916799368 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6a0013cb0 con 0x7ff6b009ad40 2023-09-30T22:26:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.448+0000 7ff6977fe700 1 -- 172.21.15.154:0/2916799368 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff6a003ffb0 con 0x7ff6b009ad40 2023-09-30T22:26:24.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.451+0000 7ff6977fe700 1 -- 172.21.15.154:0/2916799368 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6a000c970 con 0x7ff6b009ad40 2023-09-30T22:26:24.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.478+0000 7f0e9d50a700 1 Processor -- start 2023-09-30T22:26:24.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.479+0000 7f0e9d50a700 1 -- start start 2023-09-30T22:26:24.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.479+0000 7f0e9d50a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809e870 0x7f0e9809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.479+0000 7f0e9d50a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809f180 0x7f0e98131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.479+0000 7f0e9d50a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e98131d70 0x7f0e98132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.479+0000 7f0e9d50a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980a0920 con 0x7f0e98131d70 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.479+0000 7f0e9d50a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9809c970 con 0x7f0e9809f180 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.479+0000 7f0e9d50a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9809bab0 con 0x7f0e9809e870 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e96ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809e870 0x7f0e9809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e96ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809e870 0x7f0e9809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52140/0 (socket says 172.21.15.154:52140) 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e96ffd700 1 -- 172.21.15.154:0/3169368364 learned_addr learned my addr 172.21.15.154:0/3169368364 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e977fe700 1 --2- 172.21.15.154:0/3169368364 >> v2:172.21.15.154:3300/0 conn(0x7f0e98131d70 0x7f0e98132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e967fc700 1 --2- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809f180 0x7f0e98131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e977fe700 1 -- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809e870 msgr2=0x7f0e9809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e977fe700 1 --2- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809e870 0x7f0e9809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e977fe700 1 -- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809f180 msgr2=0x7f0e98131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:24.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e977fe700 1 --2- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809f180 0x7f0e98131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e977fe700 1 -- 172.21.15.154:0/3169368364 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9809f9c0 con 0x7f0e98131d70 2023-09-30T22:26:24.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e96ffd700 1 --2- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809e870 0x7f0e9809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:24.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e977fe700 1 --2- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 0x7f0e98132210 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009d90 tx=0x7f0e9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b25006507e792c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.480+0000 7f0e95ffb700 1 -- 172.21.15.154:0/3169368364 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000e070 con 0x7f0e98131d70 2023-09-30T22:26:24.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.481+0000 7f0e95ffb700 1 -- 172.21.15.154:0/3169368364 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000bb20 con 0x7f0e98131d70 2023-09-30T22:26:24.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.481+0000 7f0e95ffb700 1 -- 172.21.15.154:0/3169368364 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90012430 con 0x7f0e98131d70 2023-09-30T22:26:24.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.481+0000 7f0e9d50a700 1 -- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 msgr2=0x7f0e98132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.481+0000 7f0e9d50a700 1 --2- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 0x7f0e98132210 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009d90 tx=0x7f0e9000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:24.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.482+0000 7f0e9d50a700 1 -- 172.21.15.154:0/3169368364 shutdown_connections 2023-09-30T22:26:24.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.482+0000 7f0e9d50a700 1 --2- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 0x7f0e98132210 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.482+0000 7f0e9d50a700 1 --2- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809e870 0x7f0e9809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.482+0000 7f0e9d50a700 1 --2- 172.21.15.154:0/3169368364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809f180 0x7f0e98131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.482+0000 7f0e9d50a700 1 -- 172.21.15.154:0/3169368364 >> 172.21.15.154:0/3169368364 conn(0x7f0e980a4430 msgr2=0x7f0e980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.482+0000 7f0e9d50a700 1 -- 172.21.15.154:0/3169368364 shutdown_connections 2023-09-30T22:26:24.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.482+0000 7f0e9d50a700 1 -- 172.21.15.154:0/3169368364 wait complete. 2023-09-30T22:26:24.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.483+0000 7f0e9d50a700 1 Processor -- start 2023-09-30T22:26:24.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.483+0000 7f0e9d50a700 1 -- start start 2023-09-30T22:26:24.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e9d50a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809e870 0x7f0e981272e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e9d50a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809f180 0x7f0e98127820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e9d50a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 0x7f0e98127d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:24.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e9d50a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98129460 con 0x7f0e98131d70 2023-09-30T22:26:24.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e9d50a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98128710 con 0x7f0e9809e870 2023-09-30T22:26:24.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e9d50a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9811e250 con 0x7f0e9809f180 2023-09-30T22:26:24.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e977fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 0x7f0e98127d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e977fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 0x7f0e98127d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46578/0 (socket says 172.21.15.154:46578) 2023-09-30T22:26:24.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e977fe700 1 -- 172.21.15.154:0/1744925086 learned_addr learned my addr 172.21.15.154:0/1744925086 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:24.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e967fc700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809f180 0x7f0e98127820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e96ffd700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809e870 0x7f0e981272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e977fe700 1 -- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809f180 msgr2=0x7f0e98127820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e977fe700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809f180 0x7f0e98127820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e977fe700 1 -- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809e870 msgr2=0x7f0e981272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.484+0000 7f0e977fe700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809e870 0x7f0e981272e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.485+0000 7f0e977fe700 1 -- 172.21.15.154:0/1744925086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88009550 con 0x7f0e98131d70 2023-09-30T22:26:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.485+0000 7f0e96ffd700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809e870 0x7f0e981272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.485+0000 7f0e977fe700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 0x7f0e98127d60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0e90014040 tx=0x7f0e90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.485+0000 7f0e7f7fe700 1 -- 172.21.15.154:0/1744925086 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90004550 con 0x7f0e98131d70 2023-09-30T22:26:24.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.485+0000 7f0e7f7fe700 1 -- 172.21.15.154:0/1744925086 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e90020070 con 0x7f0e98131d70 2023-09-30T22:26:24.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.485+0000 7f0e7f7fe700 1 -- 172.21.15.154:0/1744925086 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90004910 con 0x7f0e98131d70 2023-09-30T22:26:24.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.485+0000 7f0e9d50a700 1 -- 172.21.15.154:0/1744925086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e90009a70 con 0x7f0e98131d70 2023-09-30T22:26:24.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.485+0000 7f0e9d50a700 1 -- 172.21.15.154:0/1744925086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9812a6c0 con 0x7f0e98131d70 2023-09-30T22:26:24.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.486+0000 7f0e7f7fe700 1 -- 172.21.15.154:0/1744925086 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e90012430 con 0x7f0e98131d70 2023-09-30T22:26:24.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.486+0000 7f0e7f7fe700 1 -- 172.21.15.154:0/1744925086 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0e90022070 con 0x7f0e98131d70 2023-09-30T22:26:24.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.486+0000 7f0e9d50a700 1 -- 172.21.15.154:0/1744925086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e980a0210 con 0x7f0e98131d70 2023-09-30T22:26:24.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.495+0000 7f0e7f7fe700 1 -- 172.21.15.154:0/1744925086 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e90012e40 con 0x7f0e98131d70 2023-09-30T22:26:24.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.615+0000 7f7638bfd700 1 -- 172.21.15.154:0/1291413544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7634072840 con 0x7f763409f350 2023-09-30T22:26:24.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.615+0000 7f7622ffd700 1 -- 172.21.15.154:0/1291413544 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7628015020 con 0x7f763409f350 2023-09-30T22:26:24.615 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:24.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.618+0000 7f7638bfd700 1 -- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f763409f350 msgr2=0x7f7634120c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.618+0000 7f7638bfd700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f763409f350 0x7f7634120c80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f7628016000 tx=0x7f7628004750 comp rx=0 tx=0).stop 2023-09-30T22:26:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.618+0000 7f7638bfd700 1 -- 172.21.15.154:0/1291413544 shutdown_connections 2023-09-30T22:26:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.618+0000 7f7638bfd700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7634137000 0x7f76341211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.618+0000 7f7638bfd700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f763409e870 0x7f7634120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.618+0000 7f7638bfd700 1 --2- 172.21.15.154:0/1291413544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f763409f350 0x7f7634120c80 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.618+0000 7f7638bfd700 1 -- 172.21.15.154:0/1291413544 >> 172.21.15.154:0/1291413544 conn(0x7f76340a4150 msgr2=0x7f76340a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.619+0000 7f7638bfd700 1 -- 172.21.15.154:0/1291413544 shutdown_connections 2023-09-30T22:26:24.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.619+0000 7f7638bfd700 1 -- 172.21.15.154:0/1291413544 wait complete. 2023-09-30T22:26:24.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:24.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.646+0000 7ffa62cc5700 1 -- 172.21.15.154:0/3860137852 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffa5c12fbb0 con 0x7ffa5c09e170 2023-09-30T22:26:24.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.647+0000 7ffa597fa700 1 -- 172.21.15.154:0/3860137852 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa480232f0 con 0x7ffa5c09e170 2023-09-30T22:26:24.647 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:24.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.649+0000 7ffa62cc5700 1 -- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 msgr2=0x7ffa5c1cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.649+0000 7ffa62cc5700 1 --2- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1cce00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800e980 tx=0x7ffa4800ec90 comp rx=0 tx=0).stop 2023-09-30T22:26:24.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.649+0000 7ffa62cc5700 1 -- 172.21.15.154:0/3860137852 shutdown_connections 2023-09-30T22:26:24.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.649+0000 7ffa62cc5700 1 --2- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa5c130ce0 0x7ffa5c12e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.649+0000 7ffa62cc5700 1 --2- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa5c09d860 0x7ffa5c1cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.649+0000 7ffa62cc5700 1 --2- 172.21.15.154:0/3860137852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ffa5c09e170 0x7ffa5c1cce00 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.649+0000 7ffa62cc5700 1 -- 172.21.15.154:0/3860137852 >> 172.21.15.154:0/3860137852 conn(0x7ffa5c099c40 msgr2=0x7ffa5c119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.649+0000 7ffa62cc5700 1 -- 172.21.15.154:0/3860137852 shutdown_connections 2023-09-30T22:26:24.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.649+0000 7ffa62cc5700 1 -- 172.21.15.154:0/3860137852 wait complete. 2023-09-30T22:26:24.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:24.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.688+0000 7ff6b545d700 1 -- 172.21.15.154:0/2916799368 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff6b009c7e0 con 0x7ff6b009ad40 2023-09-30T22:26:24.688 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:24.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.688+0000 7ff6977fe700 1 -- 172.21.15.154:0/2916799368 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6a0021020 con 0x7ff6b009ad40 2023-09-30T22:26:24.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.690+0000 7ff6b545d700 1 -- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b009ad40 msgr2=0x7ff6b01c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.690+0000 7ff6b545d700 1 --2- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b009ad40 0x7ff6b01c5270 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000e870 tx=0x7ff6a000eb80 comp rx=0 tx=0).stop 2023-09-30T22:26:24.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.690+0000 7ff6b545d700 1 -- 172.21.15.154:0/2916799368 shutdown_connections 2023-09-30T22:26:24.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.690+0000 7ff6b545d700 1 --2- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b0133f70 0x7ff6b01c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.690+0000 7ff6b545d700 1 --2- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b009ad40 0x7ff6b01c5270 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.690+0000 7ff6b545d700 1 --2- 172.21.15.154:0/2916799368 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b00a0a70 0x7ff6b01c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.690+0000 7ff6b545d700 1 -- 172.21.15.154:0/2916799368 >> 172.21.15.154:0/2916799368 conn(0x7ff6b0099c40 msgr2=0x7ff6b0132ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.690+0000 7ff6b545d700 1 -- 172.21.15.154:0/2916799368 shutdown_connections 2023-09-30T22:26:24.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.690+0000 7ff6b545d700 1 -- 172.21.15.154:0/2916799368 wait complete. 2023-09-30T22:26:24.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:24.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.721+0000 7f0e9d50a700 1 -- 172.21.15.154:0/1744925086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0e9804f2a0 con 0x7f0e98131d70 2023-09-30T22:26:24.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.721+0000 7f0e7f7fe700 1 -- 172.21.15.154:0/1744925086 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e9002c020 con 0x7f0e98131d70 2023-09-30T22:26:24.721 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:24.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.723+0000 7f0e9d50a700 1 -- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 msgr2=0x7f0e98127d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:24.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.723+0000 7f0e9d50a700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 0x7f0e98127d60 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0e90014040 tx=0x7f0e90004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.723+0000 7f0e9d50a700 1 -- 172.21.15.154:0/1744925086 shutdown_connections 2023-09-30T22:26:24.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.723+0000 7f0e9d50a700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e98131d70 0x7f0e98127d60 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.723+0000 7f0e9d50a700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e9809e870 0x7f0e981272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.723+0000 7f0e9d50a700 1 --2- 172.21.15.154:0/1744925086 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0e9809f180 0x7f0e98127820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:24.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.723+0000 7f0e9d50a700 1 -- 172.21.15.154:0/1744925086 >> 172.21.15.154:0/1744925086 conn(0x7f0e980a4430 msgr2=0x7f0e9809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:24.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.723+0000 7f0e9d50a700 1 -- 172.21.15.154:0/1744925086 shutdown_connections 2023-09-30T22:26:24.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:24.723+0000 7f0e9d50a700 1 -- 172.21.15.154:0/1744925086 wait complete. 2023-09-30T22:26:24.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:25.636 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:25.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:25.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:25.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:25.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.792+0000 7fb88072b700 1 Processor -- start 2023-09-30T22:26:25.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.792+0000 7fb88072b700 1 -- start start 2023-09-30T22:26:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb88072b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb88072b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb87809dec0 0x7fb87806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb88072b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb878131a00 0x7fb878131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb88072b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87806b5c0 con 0x7fb878131a00 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb88072b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87806e900 con 0x7fb87809dec0 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb88072b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb87809d180 con 0x7fb87806a770 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87e4c7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87dcc6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb87809dec0 0x7fb87806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87dcc6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb87809dec0 0x7fb87806b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54832/0 (socket says 172.21.15.154:54832) 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87e4c7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35896/0 (socket says 172.21.15.154:35896) 2023-09-30T22:26:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87dcc6700 1 -- 172.21.15.154:0/1266957198 learned_addr learned my addr 172.21.15.154:0/1266957198 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87ecc8700 1 --2- 172.21.15.154:0/1266957198 >> v2:172.21.15.154:3300/0 conn(0x7fb878131a00 0x7fb878131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87dcc6700 1 -- 172.21.15.154:0/1266957198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 msgr2=0x7fb87806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87dcc6700 1 --2- 172.21.15.154:0/1266957198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87dcc6700 1 -- 172.21.15.154:0/1266957198 >> v2:172.21.15.154:3300/0 conn(0x7fb878131a00 msgr2=0x7fb878131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87dcc6700 1 --2- 172.21.15.154:0/1266957198 >> v2:172.21.15.154:3300/0 conn(0x7fb878131a00 0x7fb878131e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.793+0000 7fb87dcc6700 1 -- 172.21.15.154:0/1266957198 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87809e780 con 0x7fb87809dec0 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.794+0000 7fb87dcc6700 1 --2- 172.21.15.154:0/1266957198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb87809dec0 0x7fb87806b080 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb8680098f0 tx=0x7fb868009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58c45deba4d44bdf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.794+0000 7fb87e4c7700 1 --2- 172.21.15.154:0/1266957198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.794+0000 7fb87d4c5700 1 -- 172.21.15.154:0/1266957198 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868011830 con 0x7fb87809dec0 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.794+0000 7fb87d4c5700 1 -- 172.21.15.154:0/1266957198 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb868011990 con 0x7fb87809dec0 2023-09-30T22:26:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.794+0000 7fb87d4c5700 1 -- 172.21.15.154:0/1266957198 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868011d00 con 0x7fb87809dec0 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.795+0000 7fb88072b700 1 -- 172.21.15.154:0/1266957198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb87809dec0 msgr2=0x7fb87806b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.795+0000 7fb88072b700 1 --2- 172.21.15.154:0/1266957198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb87809dec0 0x7fb87806b080 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb8680098f0 tx=0x7fb868009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.795+0000 7fb88072b700 1 -- 172.21.15.154:0/1266957198 shutdown_connections 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.795+0000 7fb88072b700 1 --2- 172.21.15.154:0/1266957198 >> v2:172.21.15.154:3300/0 conn(0x7fb878131a00 0x7fb878131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.795+0000 7fb88072b700 1 --2- 172.21.15.154:0/1266957198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.795+0000 7fb88072b700 1 --2- 172.21.15.154:0/1266957198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb87809dec0 0x7fb87806b080 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.795+0000 7fb88072b700 1 -- 172.21.15.154:0/1266957198 >> 172.21.15.154:0/1266957198 conn(0x7fb878099c40 msgr2=0x7fb8780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.795+0000 7fb88072b700 1 -- 172.21.15.154:0/1266957198 shutdown_connections 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.795+0000 7fb88072b700 1 -- 172.21.15.154:0/1266957198 wait complete. 2023-09-30T22:26:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.796+0000 7fb88072b700 1 Processor -- start 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.796+0000 7fb88072b700 1 -- start start 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.796+0000 7fb88072b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87812be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.796+0000 7fb88072b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb87809dec0 0x7fb87812abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.796+0000 7fb88072b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb878131a00 0x7fb87812b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.796+0000 7fb88072b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87812e6f0 con 0x7fb87809dec0 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.796+0000 7fb88072b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87812d720 con 0x7fb878131a00 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.796+0000 7fb88072b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb878130aa0 con 0x7fb87806a770 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87ecc8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb878131a00 0x7fb87812b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87ecc8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb878131a00 0x7fb87812b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54842/0 (socket says 172.21.15.154:54842) 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87ecc8700 1 -- 172.21.15.154:0/1053228994 learned_addr learned my addr 172.21.15.154:0/1053228994 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87e4c7700 1 --2- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87812be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87dcc6700 1 --2- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb87809dec0 0x7fb87812abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87e4c7700 1 -- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb878131a00 msgr2=0x7fb87812b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87e4c7700 1 --2- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb878131a00 0x7fb87812b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87e4c7700 1 -- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb87809dec0 msgr2=0x7fb87812abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87e4c7700 1 --2- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb87809dec0 0x7fb87812abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87e4c7700 1 -- 172.21.15.154:0/1053228994 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb868009550 con 0x7fb87806a770 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb87e4c7700 1 --2- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87812be70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb87400d830 tx=0x7fb87400db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.797+0000 7fb86effd700 1 -- 172.21.15.154:0/1053228994 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874004030 con 0x7fb87806a770 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.798+0000 7fb86effd700 1 -- 172.21.15.154:0/1053228994 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874004190 con 0x7fb87806a770 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.798+0000 7fb86effd700 1 -- 172.21.15.154:0/1053228994 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874004520 con 0x7fb87806a770 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.798+0000 7fb88072b700 1 -- 172.21.15.154:0/1053228994 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb878071ce0 con 0x7fb87806a770 2023-09-30T22:26:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.798+0000 7fb88072b700 1 -- 172.21.15.154:0/1053228994 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb878071210 con 0x7fb87806a770 2023-09-30T22:26:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.799+0000 7fb86effd700 1 -- 172.21.15.154:0/1053228994 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8740036a0 con 0x7fb87806a770 2023-09-30T22:26:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.799+0000 7fb86effd700 1 -- 172.21.15.154:0/1053228994 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb87403f4b0 con 0x7fb87806a770 2023-09-30T22:26:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.799+0000 7fb88072b700 1 -- 172.21.15.154:0/1053228994 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87812d560 con 0x7fb87806a770 2023-09-30T22:26:25.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.804+0000 7fb86effd700 1 -- 172.21.15.154:0/1053228994 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8740125f0 con 0x7fb87806a770 2023-09-30T22:26:25.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.841+0000 7f7f6ff39700 1 Processor -- start 2023-09-30T22:26:25.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.841+0000 7f7f6ff39700 1 -- start start 2023-09-30T22:26:25.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6ff39700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6809a130 0x7f7f6809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6ff39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809edb0 0x7f7f6809f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6ff39700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f68072b30 con 0x7f7f6813c410 2023-09-30T22:26:25.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6ff39700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6809a500 con 0x7f7f6809edb0 2023-09-30T22:26:25.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6ff39700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6809f720 con 0x7f7f6809a130 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6dcd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6809a130 0x7f7f6809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6e4d6700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7f6813c410 0x7f7f6813e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37662/0 (socket says 172.21.15.154:37662) 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6e4d6700 1 -- 172.21.15.154:0/2820152101 learned_addr learned my addr 172.21.15.154:0/2820152101 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6d4d4700 1 --2- 172.21.15.154:0/2820152101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809edb0 0x7f7f6809f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.842+0000 7f7f6ccd3700 1 -- 172.21.15.154:0/2820152101 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349062609 0 0) 0x7f7f68072b30 con 0x7f7f6813c410 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6ccd3700 1 -- 172.21.15.154:0/2820152101 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f540035b0 con 0x7f7f6813c410 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6dcd5700 1 -- 172.21.15.154:0/2820152101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809edb0 msgr2=0x7f7f6809f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6dcd5700 1 --2- 172.21.15.154:0/2820152101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809edb0 0x7f7f6809f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6dcd5700 1 -- 172.21.15.154:0/2820152101 >> v1:172.21.15.154:6789/0 conn(0x7f7f6813c410 legacy=0x7f7f6813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6dcd5700 1 -- 172.21.15.154:0/2820152101 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6809fe00 con 0x7f7f6809a130 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6d4d4700 1 --2- 172.21.15.154:0/2820152101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809edb0 0x7f7f6809f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6dcd5700 1 --2- 172.21.15.154:0/2820152101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6809a130 0x7f7f6809e870 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009870 tx=0x7f7f64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d916b434decaa57d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6ccd3700 1 -- 172.21.15.154:0/2820152101 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64011830 con 0x7f7f6809a130 2023-09-30T22:26:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6ccd3700 1 -- 172.21.15.154:0/2820152101 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64011990 con 0x7f7f6809a130 2023-09-30T22:26:25.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.843+0000 7f7f6ccd3700 1 -- 172.21.15.154:0/2820152101 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64011d00 con 0x7f7f6809a130 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.844+0000 7f7f6ff39700 1 -- 172.21.15.154:0/2820152101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6809a130 msgr2=0x7f7f6809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.844+0000 7f7f6ff39700 1 --2- 172.21.15.154:0/2820152101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6809a130 0x7f7f6809e870 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009870 tx=0x7f7f64009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.844+0000 7f7f6ff39700 1 -- 172.21.15.154:0/2820152101 shutdown_connections 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.844+0000 7f7f6ff39700 1 --2- 172.21.15.154:0/2820152101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6809a130 0x7f7f6809e870 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.844+0000 7f7f6ff39700 1 --2- 172.21.15.154:0/2820152101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809edb0 0x7f7f6809f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.844+0000 7f7f6ff39700 1 -- 172.21.15.154:0/2820152101 >> 172.21.15.154:0/2820152101 conn(0x7f7f680a4430 msgr2=0x7f7f680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.844+0000 7f7f6ff39700 1 -- 172.21.15.154:0/2820152101 shutdown_connections 2023-09-30T22:26:25.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.844+0000 7f7f6ff39700 1 -- 172.21.15.154:0/2820152101 wait complete. 2023-09-30T22:26:25.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6ff39700 1 Processor -- start 2023-09-30T22:26:25.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6ff39700 1 -- start start 2023-09-30T22:26:25.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6ff39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809a130 0x7f7f6811b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6ff39700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f6809edb0 0x7f7f6811b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6ff39700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6813c410 0x7f7f6811bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6ff39700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6811dce0 con 0x7f7f6809edb0 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6ff39700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6811e1e0 con 0x7f7f6809a130 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6ff39700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680a38e0 con 0x7f7f6813c410 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6dcd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809a130 0x7f7f6811b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6dcd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809a130 0x7f7f6811b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54850/0 (socket says 172.21.15.154:54850) 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.846+0000 7f7f6dcd5700 1 -- 172.21.15.154:0/4166947786 learned_addr learned my addr 172.21.15.154:0/4166947786 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6d4d4700 1 --2- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f6809edb0 0x7f7f6811b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6e4d6700 1 --2- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6813c410 0x7f7f6811bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6dcd5700 1 -- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6813c410 msgr2=0x7f7f6811bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6dcd5700 1 --2- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6813c410 0x7f7f6811bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6dcd5700 1 -- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f6809edb0 msgr2=0x7f7f6811b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6dcd5700 1 --2- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f6809edb0 0x7f7f6811b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6dcd5700 1 -- 172.21.15.154:0/4166947786 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f580094a0 con 0x7f7f6809a130 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6dcd5700 1 --2- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809a130 0x7f7f6811b310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7f64000c00 tx=0x7f7f64004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f5e7fc700 1 -- 172.21.15.154:0/4166947786 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640045d0 con 0x7f7f6809a130 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f5e7fc700 1 -- 172.21.15.154:0/4166947786 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6401e070 con 0x7f7f6809a130 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6ff39700 1 -- 172.21.15.154:0/4166947786 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f640094a0 con 0x7f7f6809a130 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f5e7fc700 1 -- 172.21.15.154:0/4166947786 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640038a0 con 0x7f7f6809a130 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.847+0000 7f7f6ff39700 1 -- 172.21.15.154:0/4166947786 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f680a00f0 con 0x7f7f6809a130 2023-09-30T22:26:25.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.848+0000 7f7f5e7fc700 1 -- 172.21.15.154:0/4166947786 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f64003a00 con 0x7f7f6809a130 2023-09-30T22:26:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.848+0000 7f7f5e7fc700 1 -- 172.21.15.154:0/4166947786 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f64040690 con 0x7f7f6809a130 2023-09-30T22:26:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.848+0000 7f7f6ff39700 1 -- 172.21.15.154:0/4166947786 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f68127400 con 0x7f7f6809a130 2023-09-30T22:26:25.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.857+0000 7f7f5e7fc700 1 -- 172.21.15.154:0/4166947786 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f68127400 con 0x7f7f6809a130 2023-09-30T22:26:25.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.860+0000 7fdaf968e700 1 Processor -- start 2023-09-30T22:26:25.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf968e700 1 -- start start 2023-09-30T22:26:25.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf968e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaf40a0a70 0x7fdaf40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf968e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf968e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdaf4133f50 0x7fdaf41343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf968e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf409e9d0 con 0x7fdaf4133f50 2023-09-30T22:26:25.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf968e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf409dc00 con 0x7fdaf40a1380 2023-09-30T22:26:25.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf968e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf409dec0 con 0x7fdaf40a0a70 2023-09-30T22:26:25.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdaf4133f50 0x7fdaf41343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdaf4133f50 0x7fdaf41343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57640/0 (socket says 172.21.15.154:57640) 2023-09-30T22:26:25.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf37fe700 1 -- 172.21.15.154:0/265905136 learned_addr learned my addr 172.21.15.154:0/265905136 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:25.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf27fc700 1 --2- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf37fe700 1 -- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaf40a0a70 msgr2=0x7fdaf40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf37fe700 1 --2- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaf40a0a70 0x7fdaf40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf37fe700 1 -- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 msgr2=0x7fdaf4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf37fe700 1 --2- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.861+0000 7fdaf37fe700 1 -- 172.21.15.154:0/265905136 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf409e6a0 con 0x7fdaf4133f50 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.862+0000 7fdaf27fc700 1 --2- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.862+0000 7fdaf37fe700 1 --2- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf4133f50 0x7fdaf41343f0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009e50 tx=0x7fdaec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a866309cf86d1e4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.862+0000 7fdaf1ffb700 1 -- 172.21.15.154:0/265905136 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00e070 con 0x7fdaf4133f50 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.862+0000 7fdaf1ffb700 1 -- 172.21.15.154:0/265905136 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec00b9c0 con 0x7fdaf4133f50 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.862+0000 7fdaf1ffb700 1 -- 172.21.15.154:0/265905136 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00bd70 con 0x7fdaf4133f50 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.862+0000 7fdaf968e700 1 -- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf4133f50 msgr2=0x7fdaf41343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.862+0000 7fdaf968e700 1 --2- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf4133f50 0x7fdaf41343f0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009e50 tx=0x7fdaec00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.863+0000 7fdaf968e700 1 -- 172.21.15.154:0/265905136 shutdown_connections 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.863+0000 7fdaf968e700 1 --2- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf4133f50 0x7fdaf41343f0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.863+0000 7fdaf968e700 1 --2- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaf40a0a70 0x7fdaf40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.863+0000 7fdaf968e700 1 --2- 172.21.15.154:0/265905136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.863+0000 7fdaf968e700 1 -- 172.21.15.154:0/265905136 >> 172.21.15.154:0/265905136 conn(0x7fdaf40a6610 msgr2=0x7fdaf40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.863+0000 7fdaf968e700 1 -- 172.21.15.154:0/265905136 shutdown_connections 2023-09-30T22:26:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.863+0000 7fdaf968e700 1 -- 172.21.15.154:0/265905136 wait complete. 2023-09-30T22:26:25.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf968e700 1 Processor -- start 2023-09-30T22:26:25.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf968e700 1 -- start start 2023-09-30T22:26:25.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf968e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf40a0a70 0x7fdaf406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf968e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf406e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf968e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaf4133f50 0x7fdaf41cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf968e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4070170 con 0x7fdaf40a0a70 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf968e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4071040 con 0x7fdaf40a1380 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf968e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf406f770 con 0x7fdaf4133f50 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf406e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf406e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54858/0 (socket says 172.21.15.154:54858) 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf27fc700 1 -- 172.21.15.154:0/3492912860 learned_addr learned my addr 172.21.15.154:0/3492912860 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf2ffd700 1 --2- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf40a0a70 0x7fdaf406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.864+0000 7fdaf37fe700 1 --2- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaf4133f50 0x7fdaf41cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdaf27fc700 1 -- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaf4133f50 msgr2=0x7fdaf41cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdaf27fc700 1 --2- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaf4133f50 0x7fdaf41cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdaf27fc700 1 -- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf40a0a70 msgr2=0x7fdaf406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdaf27fc700 1 --2- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf40a0a70 0x7fdaf406dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdaf27fc700 1 -- 172.21.15.154:0/3492912860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec009b30 con 0x7fdaf40a1380 2023-09-30T22:26:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdaf27fc700 1 --2- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf406e270 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e840 tx=0x7fdae800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdadb7fe700 1 -- 172.21.15.154:0/3492912860 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae800c070 con 0x7fdaf40a1380 2023-09-30T22:26:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdaf968e700 1 -- 172.21.15.154:0/3492912860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf409d340 con 0x7fdaf40a1380 2023-09-30T22:26:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdadb7fe700 1 -- 172.21.15.154:0/3492912860 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8013610 con 0x7fdaf40a1380 2023-09-30T22:26:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdaf968e700 1 -- 172.21.15.154:0/3492912860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf406e7b0 con 0x7fdaf40a1380 2023-09-30T22:26:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.865+0000 7fdadb7fe700 1 -- 172.21.15.154:0/3492912860 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8013980 con 0x7fdaf40a1380 2023-09-30T22:26:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.866+0000 7fdadb7fe700 1 -- 172.21.15.154:0/3492912860 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdae8013ae0 con 0x7fdaf40a1380 2023-09-30T22:26:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.866+0000 7fdaf968e700 1 -- 172.21.15.154:0/3492912860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad40052e0 con 0x7fdaf40a1380 2023-09-30T22:26:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.876+0000 7fdadb7fe700 1 -- 172.21.15.154:0/3492912860 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdae8012c60 con 0x7fdaf40a1380 2023-09-30T22:26:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.876+0000 7fdadb7fe700 1 -- 172.21.15.154:0/3492912860 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdae8010900 con 0x7fdaf40a1380 2023-09-30T22:26:25.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.926+0000 7fa5f4d48700 1 Processor -- start 2023-09-30T22:26:25.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.926+0000 7fa5f4d48700 1 -- start start 2023-09-30T22:26:25.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.927+0000 7fa5f4d48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f009e340 0x7fa5f01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.927+0000 7fa5f4d48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f0135f20 0x7fa5f0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.927+0000 7fa5f4d48700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f009aaa0 con 0x7fa5f009d860 2023-09-30T22:26:25.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.927+0000 7fa5f4d48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f009e730 con 0x7fa5f009e340 2023-09-30T22:26:25.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.927+0000 7fa5f4d48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f009f870 con 0x7fa5f0135f20 2023-09-30T22:26:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.927+0000 7fa5edd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f009e340 0x7fa5f01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.927+0000 7fa5ee59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa5f009d860 0x7fa5f009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37670/0 (socket says 172.21.15.154:37670) 2023-09-30T22:26:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.927+0000 7fa5ee59c700 1 -- 172.21.15.154:0/324907539 learned_addr learned my addr 172.21.15.154:0/324907539 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.927+0000 7fa5eed9d700 1 --2- 172.21.15.154:0/324907539 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f0135f20 0x7fa5f0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5ed59a700 1 -- 172.21.15.154:0/324907539 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619173291 0 0) 0x7fa5f009aaa0 con 0x7fa5f009d860 2023-09-30T22:26:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5ed59a700 1 -- 172.21.15.154:0/324907539 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d80035b0 con 0x7fa5f009d860 2023-09-30T22:26:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5edd9b700 1 -- 172.21.15.154:0/324907539 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f0135f20 msgr2=0x7fa5f0138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5edd9b700 1 --2- 172.21.15.154:0/324907539 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f0135f20 0x7fa5f0138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5edd9b700 1 -- 172.21.15.154:0/324907539 >> v1:172.21.15.154:6789/0 conn(0x7fa5f009d860 legacy=0x7fa5f009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5edd9b700 1 -- 172.21.15.154:0/324907539 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f009b360 con 0x7fa5f009e340 2023-09-30T22:26:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5edd9b700 1 --2- 172.21.15.154:0/324907539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f009e340 0x7fa5f01359e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009870 tx=0x7fa5e4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=980f5e75d1ca17a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5ed59a700 1 -- 172.21.15.154:0/324907539 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4011830 con 0x7fa5f009e340 2023-09-30T22:26:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5ed59a700 1 -- 172.21.15.154:0/324907539 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4011990 con 0x7fa5f009e340 2023-09-30T22:26:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.928+0000 7fa5ed59a700 1 -- 172.21.15.154:0/324907539 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4011d20 con 0x7fa5f009e340 2023-09-30T22:26:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.929+0000 7fa5f4d48700 1 -- 172.21.15.154:0/324907539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f009e340 msgr2=0x7fa5f01359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.929+0000 7fa5f4d48700 1 --2- 172.21.15.154:0/324907539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f009e340 0x7fa5f01359e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009870 tx=0x7fa5e4009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.929+0000 7fa5f4d48700 1 -- 172.21.15.154:0/324907539 shutdown_connections 2023-09-30T22:26:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.929+0000 7fa5f4d48700 1 --2- 172.21.15.154:0/324907539 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f0135f20 0x7fa5f0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.929+0000 7fa5f4d48700 1 --2- 172.21.15.154:0/324907539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f009e340 0x7fa5f01359e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.929+0000 7fa5f4d48700 1 -- 172.21.15.154:0/324907539 >> 172.21.15.154:0/324907539 conn(0x7fa5f0099c40 msgr2=0x7fa5f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.929+0000 7fa5f4d48700 1 -- 172.21.15.154:0/324907539 shutdown_connections 2023-09-30T22:26:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.929+0000 7fa5f4d48700 1 -- 172.21.15.154:0/324907539 wait complete. 2023-09-30T22:26:25.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.930+0000 7fa5f4d48700 1 Processor -- start 2023-09-30T22:26:25.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.930+0000 7fa5f4d48700 1 -- start start 2023-09-30T22:26:25.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.930+0000 7fa5f4d48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f009d860 0x7fa5f01c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5f4d48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f009e340 0x7fa5f01c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5f4d48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f0135f20 0x7fa5f01c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5f4d48700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f011c1b0 con 0x7fa5f009e340 2023-09-30T22:26:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5f4d48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f01c5ae0 con 0x7fa5f0135f20 2023-09-30T22:26:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5f4d48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f011aa50 con 0x7fa5f009d860 2023-09-30T22:26:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5eed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f0135f20 0x7fa5f01c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5eed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f0135f20 0x7fa5f01c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54872/0 (socket says 172.21.15.154:54872) 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5eed9d700 1 -- 172.21.15.154:0/2386317789 learned_addr learned my addr 172.21.15.154:0/2386317789 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5edd9b700 1 --2- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f009e340 0x7fa5f01c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5ee59c700 1 --2- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f009d860 0x7fa5f01c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5eed9d700 1 -- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f009d860 msgr2=0x7fa5f01c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5eed9d700 1 --2- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f009d860 0x7fa5f01c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5eed9d700 1 -- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f009e340 msgr2=0x7fa5f01c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5eed9d700 1 --2- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f009e340 0x7fa5f01c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5eed9d700 1 -- 172.21.15.154:0/2386317789 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40094a0 con 0x7fa5f0135f20 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5eed9d700 1 --2- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f0135f20 0x7fa5f01c8080 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800b700 tx=0x7fa5e800ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5deffd700 1 -- 172.21.15.154:0/2386317789 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8019070 con 0x7fa5f0135f20 2023-09-30T22:26:25.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5f4d48700 1 -- 172.21.15.154:0/2386317789 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f011b730 con 0x7fa5f0135f20 2023-09-30T22:26:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.931+0000 7fa5f4d48700 1 -- 172.21.15.154:0/2386317789 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f011c5c0 con 0x7fa5f0135f20 2023-09-30T22:26:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.932+0000 7fa5deffd700 1 -- 172.21.15.154:0/2386317789 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8007540 con 0x7fa5f0135f20 2023-09-30T22:26:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.932+0000 7fa5deffd700 1 -- 172.21.15.154:0/2386317789 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8009c40 con 0x7fa5f0135f20 2023-09-30T22:26:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.933+0000 7fa5f4d48700 1 -- 172.21.15.154:0/2386317789 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d40052e0 con 0x7fa5f0135f20 2023-09-30T22:26:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.933+0000 7fa5deffd700 1 -- 172.21.15.154:0/2386317789 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5e80078b0 con 0x7fa5f0135f20 2023-09-30T22:26:25.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.933+0000 7fa5deffd700 1 -- 172.21.15.154:0/2386317789 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa5e80478d0 con 0x7fa5f0135f20 2023-09-30T22:26:25.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:25.942+0000 7fa5deffd700 1 -- 172.21.15.154:0/2386317789 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5e801b900 con 0x7fa5f0135f20 2023-09-30T22:26:26.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.021+0000 7fb88072b700 1 -- 172.21.15.154:0/1053228994 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb87804f2a0 con 0x7fb87806a770 2023-09-30T22:26:26.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.022+0000 7fb86effd700 1 -- 172.21.15.154:0/1053228994 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb87401cb50 con 0x7fb87806a770 2023-09-30T22:26:26.022 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:26.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.025+0000 7fb88072b700 1 -- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 msgr2=0x7fb87812be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.025+0000 7fb88072b700 1 --2- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87812be70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb87400d830 tx=0x7fb87400db40 comp rx=0 tx=0).stop 2023-09-30T22:26:26.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.025+0000 7fb88072b700 1 -- 172.21.15.154:0/1053228994 shutdown_connections 2023-09-30T22:26:26.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.025+0000 7fb88072b700 1 --2- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb878131a00 0x7fb87812b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.025+0000 7fb88072b700 1 --2- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb87806a770 0x7fb87812be70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.025+0000 7fb88072b700 1 --2- 172.21.15.154:0/1053228994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb87809dec0 0x7fb87812abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.025+0000 7fb88072b700 1 -- 172.21.15.154:0/1053228994 >> 172.21.15.154:0/1053228994 conn(0x7fb878099c40 msgr2=0x7fb8780a1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:26.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.026+0000 7fb88072b700 1 -- 172.21.15.154:0/1053228994 shutdown_connections 2023-09-30T22:26:26.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.026+0000 7fb88072b700 1 -- 172.21.15.154:0/1053228994 wait complete. 2023-09-30T22:26:26.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:26.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.077+0000 7fdaf968e700 1 -- 172.21.15.154:0/3492912860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdad4005590 con 0x7fdaf40a1380 2023-09-30T22:26:26.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.078+0000 7fdadb7fe700 1 -- 172.21.15.154:0/3492912860 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdae8017020 con 0x7fdaf40a1380 2023-09-30T22:26:26.078 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.080+0000 7fdaf968e700 1 -- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 msgr2=0x7fdaf406e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.080+0000 7fdaf968e700 1 --2- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf406e270 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e840 tx=0x7fdae800eb50 comp rx=0 tx=0).stop 2023-09-30T22:26:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.080+0000 7fdaf968e700 1 -- 172.21.15.154:0/3492912860 shutdown_connections 2023-09-30T22:26:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.080+0000 7fdaf968e700 1 --2- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaf4133f50 0x7fdaf41cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.080+0000 7fdaf968e700 1 --2- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf40a0a70 0x7fdaf406dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.080+0000 7fdaf968e700 1 --2- 172.21.15.154:0/3492912860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40a1380 0x7fdaf406e270 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.080+0000 7fdaf968e700 1 -- 172.21.15.154:0/3492912860 >> 172.21.15.154:0/3492912860 conn(0x7fdaf40a6610 msgr2=0x7fdaf409f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.080+0000 7fdaf968e700 1 -- 172.21.15.154:0/3492912860 shutdown_connections 2023-09-30T22:26:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.080+0000 7fdaf968e700 1 -- 172.21.15.154:0/3492912860 wait complete. 2023-09-30T22:26:26.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:26.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.092+0000 7f7f6ff39700 1 -- 172.21.15.154:0/4166947786 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7f68127400 con 0x7f7f6809a130 2023-09-30T22:26:26.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.092+0000 7f7f5e7fc700 1 -- 172.21.15.154:0/4166947786 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f64015020 con 0x7f7f6809a130 2023-09-30T22:26:26.092 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:26.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.094+0000 7f7f6ff39700 1 -- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809a130 msgr2=0x7f7f6811b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.094+0000 7f7f6ff39700 1 --2- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809a130 0x7f7f6811b310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7f64000c00 tx=0x7f7f64004750 comp rx=0 tx=0).stop 2023-09-30T22:26:26.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.094+0000 7f7f6ff39700 1 -- 172.21.15.154:0/4166947786 shutdown_connections 2023-09-30T22:26:26.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.094+0000 7f7f6ff39700 1 --2- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7f6813c410 0x7f7f6811bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.094+0000 7f7f6ff39700 1 --2- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f6809a130 0x7f7f6811b310 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.094+0000 7f7f6ff39700 1 --2- 172.21.15.154:0/4166947786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f6809edb0 0x7f7f6811b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.094+0000 7f7f6ff39700 1 -- 172.21.15.154:0/4166947786 >> 172.21.15.154:0/4166947786 conn(0x7f7f680a4430 msgr2=0x7f7f6809dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:26.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.094+0000 7f7f6ff39700 1 -- 172.21.15.154:0/4166947786 shutdown_connections 2023-09-30T22:26:26.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.094+0000 7f7f6ff39700 1 -- 172.21.15.154:0/4166947786 wait complete. 2023-09-30T22:26:26.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:26.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.145+0000 7fa5f4d48700 1 -- 172.21.15.154:0/2386317789 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa5d4005590 con 0x7fa5f0135f20 2023-09-30T22:26:26.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.145+0000 7fa5deffd700 1 -- 172.21.15.154:0/2386317789 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5e8022030 con 0x7fa5f0135f20 2023-09-30T22:26:26.145 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.147+0000 7fa5f4d48700 1 -- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f0135f20 msgr2=0x7fa5f01c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.147+0000 7fa5f4d48700 1 --2- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f0135f20 0x7fa5f01c8080 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800b700 tx=0x7fa5e800ba10 comp rx=0 tx=0).stop 2023-09-30T22:26:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.147+0000 7fa5f4d48700 1 -- 172.21.15.154:0/2386317789 shutdown_connections 2023-09-30T22:26:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.147+0000 7fa5f4d48700 1 --2- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5f0135f20 0x7fa5f01c8080 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.147+0000 7fa5f4d48700 1 --2- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5f009d860 0x7fa5f01c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.147+0000 7fa5f4d48700 1 --2- 172.21.15.154:0/2386317789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5f009e340 0x7fa5f01c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.147+0000 7fa5f4d48700 1 -- 172.21.15.154:0/2386317789 >> 172.21.15.154:0/2386317789 conn(0x7fa5f0099c40 msgr2=0x7fa5f00a1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.147+0000 7fa5f4d48700 1 -- 172.21.15.154:0/2386317789 shutdown_connections 2023-09-30T22:26:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:26.147+0000 7fa5f4d48700 1 -- 172.21.15.154:0/2386317789 wait complete. 2023-09-30T22:26:26.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:27.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:27.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:27.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:27.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:27.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.184+0000 7ff2d23a3700 1 Processor -- start 2023-09-30T22:26:27.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.184+0000 7ff2d23a3700 1 -- start start 2023-09-30T22:26:27.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2d23a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2d23a3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff2cc09dec0 0x7ff2cc06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2d23a3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc06b5c0 con 0x7ff2cc131a00 2023-09-30T22:26:27.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2d23a3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc06e900 con 0x7ff2cc09dec0 2023-09-30T22:26:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2d23a3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc09d180 con 0x7ff2cc06a770 2023-09-30T22:26:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2cb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff2cc09dec0 0x7ff2cc06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2cb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff2cc09dec0 0x7ff2cc06b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57680/0 (socket says 172.21.15.154:57680) 2023-09-30T22:26:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2cb7fe700 1 -- 172.21.15.154:0/868939160 learned_addr learned my addr 172.21.15.154:0/868939160 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2cbfff700 1 --2- 172.21.15.154:0/868939160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2cb7fe700 1 -- 172.21.15.154:0/868939160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 msgr2=0x7ff2cc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2cb7fe700 1 --2- 172.21.15.154:0/868939160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2cb7fe700 1 -- 172.21.15.154:0/868939160 >> v1:172.21.15.154:6789/0 conn(0x7ff2cc131a00 legacy=0x7ff2cc131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2cb7fe700 1 -- 172.21.15.154:0/868939160 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc09e780 con 0x7ff2cc09dec0 2023-09-30T22:26:27.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.185+0000 7ff2cbfff700 1 --2- 172.21.15.154:0/868939160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:27.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.186+0000 7ff2cb7fe700 1 --2- 172.21.15.154:0/868939160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc09dec0 0x7ff2cc06b080 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00098f0 tx=0x7ff2c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829e34b9b6b87ba5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.186+0000 7ff2caffd700 1 -- 172.21.15.154:0/868939160 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0011830 con 0x7ff2cc09dec0 2023-09-30T22:26:27.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.186+0000 7ff2caffd700 1 -- 172.21.15.154:0/868939160 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c0011990 con 0x7ff2cc09dec0 2023-09-30T22:26:27.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.186+0000 7ff2caffd700 1 -- 172.21.15.154:0/868939160 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0011d20 con 0x7ff2cc09dec0 2023-09-30T22:26:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.187+0000 7ff2d23a3700 1 -- 172.21.15.154:0/868939160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc09dec0 msgr2=0x7ff2cc06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.187+0000 7ff2d23a3700 1 --2- 172.21.15.154:0/868939160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc09dec0 0x7ff2cc06b080 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00098f0 tx=0x7ff2c0009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.187+0000 7ff2d23a3700 1 -- 172.21.15.154:0/868939160 shutdown_connections 2023-09-30T22:26:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.187+0000 7ff2d23a3700 1 --2- 172.21.15.154:0/868939160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.187+0000 7ff2d23a3700 1 --2- 172.21.15.154:0/868939160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc09dec0 0x7ff2cc06b080 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.187+0000 7ff2d23a3700 1 -- 172.21.15.154:0/868939160 >> 172.21.15.154:0/868939160 conn(0x7ff2cc099c40 msgr2=0x7ff2cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.187+0000 7ff2d23a3700 1 -- 172.21.15.154:0/868939160 shutdown_connections 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.187+0000 7ff2d23a3700 1 -- 172.21.15.154:0/868939160 wait complete. 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.188+0000 7ff2d23a3700 1 Processor -- start 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.188+0000 7ff2d23a3700 1 -- start start 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d23a3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d23a3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2cc09dec0 0x7ff2cc09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d23a3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc131a00 0x7ff2cc09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d23a3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc11ecb0 con 0x7ff2cc131a00 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d23a3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc11fcc0 con 0x7ff2cc06a770 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d23a3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc1310b0 con 0x7ff2cc09dec0 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2cbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2cbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54894/0 (socket says 172.21.15.154:54894) 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2cbfff700 1 -- 172.21.15.154:0/2337782301 learned_addr learned my addr 172.21.15.154:0/2337782301 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d0940700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc131a00 0x7ff2cc09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2cb7fe700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2cc09dec0 0x7ff2cc09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d0940700 1 -- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2cc09dec0 msgr2=0x7ff2cc09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d0940700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2cc09dec0 0x7ff2cc09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d0940700 1 -- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 msgr2=0x7ff2cc09a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d0940700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc09a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2d0940700 1 -- 172.21.15.154:0/2337782301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc0094a0 con 0x7ff2cc131a00 2023-09-30T22:26:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.189+0000 7ff2cbfff700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc09a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.190+0000 7ff2d0940700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc131a00 0x7ff2cc09af10 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400cbc0 tx=0x7ff2c400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.190+0000 7ff2c8ff9700 1 -- 172.21.15.154:0/2337782301 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4003c00 con 0x7ff2cc131a00 2023-09-30T22:26:27.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.190+0000 7ff2c8ff9700 1 -- 172.21.15.154:0/2337782301 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c4003d60 con 0x7ff2cc131a00 2023-09-30T22:26:27.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.190+0000 7ff2c8ff9700 1 -- 172.21.15.154:0/2337782301 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400aa40 con 0x7ff2cc131a00 2023-09-30T22:26:27.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.190+0000 7ff2d23a3700 1 -- 172.21.15.154:0/2337782301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c0009550 con 0x7ff2cc131a00 2023-09-30T22:26:27.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.190+0000 7ff2d23a3700 1 -- 172.21.15.154:0/2337782301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc11f720 con 0x7ff2cc131a00 2023-09-30T22:26:27.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.191+0000 7ff2c8ff9700 1 -- 172.21.15.154:0/2337782301 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2c400aba0 con 0x7ff2cc131a00 2023-09-30T22:26:27.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.191+0000 7ff2c8ff9700 1 -- 172.21.15.154:0/2337782301 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2c403f580 con 0x7ff2cc131a00 2023-09-30T22:26:27.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.192+0000 7ff2d23a3700 1 -- 172.21.15.154:0/2337782301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc04f2a0 con 0x7ff2cc131a00 2023-09-30T22:26:27.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.197+0000 7ff2c8ff9700 1 -- 172.21.15.154:0/2337782301 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2c40198f0 con 0x7ff2cc131a00 2023-09-30T22:26:27.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.232+0000 7f68f6a46700 1 Processor -- start 2023-09-30T22:26:27.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.232+0000 7f68f6a46700 1 -- start start 2023-09-30T22:26:27.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.232+0000 7f68f6a46700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68f0131980 0x7f68f0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68f6a46700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68f009c790 0x7f68f0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68f6a46700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f00a1640 con 0x7f68f009bc70 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68f6a46700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f006eb30 con 0x7f68f0131980 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68f6a46700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00a22d0 con 0x7f68f009c790 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68effff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68f0131980 0x7f68f0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68ef7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f68f009bc70 0x7f68f009c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37696/0 (socket says 172.21.15.154:37696) 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68ef7fe700 1 -- 172.21.15.154:0/3437669646 learned_addr learned my addr 172.21.15.154:0/3437669646 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68effff700 1 -- 172.21.15.154:0/3437669646 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68f009c790 msgr2=0x7f68f0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68effff700 1 --2- 172.21.15.154:0/3437669646 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68f009c790 0x7f68f0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68effff700 1 -- 172.21.15.154:0/3437669646 >> v1:172.21.15.154:6789/0 conn(0x7f68f009bc70 legacy=0x7f68f009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68effff700 1 -- 172.21.15.154:0/3437669646 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f0131550 con 0x7f68f0131980 2023-09-30T22:26:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68effff700 1 --2- 172.21.15.154:0/3437669646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f0131980 0x7f68f0131d50 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009820 tx=0x7f68e0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e904ed40e46c58 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.233+0000 7f68eeffd700 1 -- 172.21.15.154:0/3437669646 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0005e30 con 0x7f68f0131980 2023-09-30T22:26:27.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68eeffd700 1 -- 172.21.15.154:0/3437669646 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0006030 con 0x7f68f0131980 2023-09-30T22:26:27.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68eeffd700 1 -- 172.21.15.154:0/3437669646 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00063e0 con 0x7f68f0131980 2023-09-30T22:26:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68f6a46700 1 -- 172.21.15.154:0/3437669646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f0131980 msgr2=0x7f68f0131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68f6a46700 1 --2- 172.21.15.154:0/3437669646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f0131980 0x7f68f0131d50 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009820 tx=0x7f68e0009b30 comp rx=0 tx=0).stop 2023-09-30T22:26:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68f6a46700 1 -- 172.21.15.154:0/3437669646 shutdown_connections 2023-09-30T22:26:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68f6a46700 1 --2- 172.21.15.154:0/3437669646 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68f009c790 0x7f68f0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68f6a46700 1 --2- 172.21.15.154:0/3437669646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f0131980 0x7f68f0131d50 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68f6a46700 1 -- 172.21.15.154:0/3437669646 >> 172.21.15.154:0/3437669646 conn(0x7f68f00a2980 msgr2=0x7f68f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68f6a46700 1 -- 172.21.15.154:0/3437669646 shutdown_connections 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.234+0000 7f68f6a46700 1 -- 172.21.15.154:0/3437669646 wait complete. 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.235+0000 7f68f6a46700 1 Processor -- start 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68f6a46700 1 -- start start 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68f6a46700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f009bc70 0x7f68f011b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68f6a46700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68f009c790 0x7f68f011bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68f6a46700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f0131980 0x7f68f011c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68f6a46700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f011d4b0 con 0x7f68f009bc70 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68f6a46700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f011e700 con 0x7f68f0131980 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68f6a46700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68f011da90 con 0x7f68f009c790 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68effff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f009bc70 0x7f68f011b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68effff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f009bc70 0x7f68f011b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57698/0 (socket says 172.21.15.154:57698) 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68effff700 1 -- 172.21.15.154:0/379414335 learned_addr learned my addr 172.21.15.154:0/379414335 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.236+0000 7f68f4fe3700 1 --2- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f0131980 0x7f68f011c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68effff700 1 -- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68f009c790 msgr2=0x7f68f011bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68effff700 1 --2- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68f009c790 0x7f68f011bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68effff700 1 -- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f0131980 msgr2=0x7f68f011c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68effff700 1 --2- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f0131980 0x7f68f011c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68effff700 1 -- 172.21.15.154:0/379414335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009430 con 0x7f68f009bc70 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68f4fe3700 1 --2- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f0131980 0x7f68f011c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68effff700 1 --2- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f009bc70 0x7f68f011b8a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f68e0012000 tx=0x7f68e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68ecff9700 1 -- 172.21.15.154:0/379414335 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0004040 con 0x7f68f009bc70 2023-09-30T22:26:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68ecff9700 1 -- 172.21.15.154:0/379414335 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e0020070 con 0x7f68f009bc70 2023-09-30T22:26:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68ecff9700 1 -- 172.21.15.154:0/379414335 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e00043e0 con 0x7f68f009bc70 2023-09-30T22:26:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68f6a46700 1 -- 172.21.15.154:0/379414335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f011f0e0 con 0x7f68f009bc70 2023-09-30T22:26:27.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.237+0000 7f68f6a46700 1 -- 172.21.15.154:0/379414335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f00a1c40 con 0x7f68f009bc70 2023-09-30T22:26:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.238+0000 7f68ecff9700 1 -- 172.21.15.154:0/379414335 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68e0022030 con 0x7f68f009bc70 2023-09-30T22:26:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.238+0000 7f68f6a46700 1 -- 172.21.15.154:0/379414335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f004f2a0 con 0x7f68f009bc70 2023-09-30T22:26:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.238+0000 7f68ecff9700 1 -- 172.21.15.154:0/379414335 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68e0042870 con 0x7f68f009bc70 2023-09-30T22:26:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.247+0000 7f68ecff9700 1 -- 172.21.15.154:0/379414335 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68e0046060 con 0x7f68f009bc70 2023-09-30T22:26:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.280+0000 7f27c43db700 1 Processor -- start 2023-09-30T22:26:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.280+0000 7f27c43db700 1 -- start start 2023-09-30T22:26:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c43db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc0a0a70 0x7f27bc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c43db700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27bc0a1380 0x7f27bc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c43db700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc09dc00 con 0x7f27bc133f50 2023-09-30T22:26:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c43db700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc09ea60 con 0x7f27bc0a1380 2023-09-30T22:26:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c43db700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc09dec0 con 0x7f27bc0a0a70 2023-09-30T22:26:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c2978700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f27bc133f50 0x7f27bc13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37702/0 (socket says 172.21.15.154:37702) 2023-09-30T22:26:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c2978700 1 -- 172.21.15.154:0/2933476636 learned_addr learned my addr 172.21.15.154:0/2933476636 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c1976700 1 --2- 172.21.15.154:0/2933476636 >> v2:172.21.15.154:3300/0 conn(0x7f27bc0a1380 0x7f27bc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c2177700 1 --2- 172.21.15.154:0/2933476636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc0a0a70 0x7f27bc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c1175700 1 -- 172.21.15.154:0/2933476636 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136724899 0 0) 0x7f27bc09dc00 con 0x7f27bc133f50 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c1175700 1 -- 172.21.15.154:0/2933476636 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a80035b0 con 0x7f27bc133f50 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c1976700 1 -- 172.21.15.154:0/2933476636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc0a0a70 msgr2=0x7f27bc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.281+0000 7f27c1976700 1 --2- 172.21.15.154:0/2933476636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc0a0a70 0x7f27bc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.282+0000 7f27c1976700 1 -- 172.21.15.154:0/2933476636 >> v1:172.21.15.154:6789/0 conn(0x7f27bc133f50 legacy=0x7f27bc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.282+0000 7f27c1976700 1 -- 172.21.15.154:0/2933476636 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc09e6a0 con 0x7f27bc0a1380 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.282+0000 7f27c1976700 1 --2- 172.21.15.154:0/2933476636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc0a1380 0x7f27bc133a10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009840 tx=0x7f27ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fabe86c7fa313c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.282+0000 7f27c1175700 1 -- 172.21.15.154:0/2933476636 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac011830 con 0x7f27bc0a1380 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.282+0000 7f27c1175700 1 -- 172.21.15.154:0/2933476636 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac011990 con 0x7f27bc0a1380 2023-09-30T22:26:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.282+0000 7f27c1175700 1 -- 172.21.15.154:0/2933476636 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac011d20 con 0x7f27bc0a1380 2023-09-30T22:26:27.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.283+0000 7f27c43db700 1 -- 172.21.15.154:0/2933476636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc0a1380 msgr2=0x7f27bc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.283+0000 7f27c43db700 1 --2- 172.21.15.154:0/2933476636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc0a1380 0x7f27bc133a10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009840 tx=0x7f27ac009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.283+0000 7f27c43db700 1 -- 172.21.15.154:0/2933476636 shutdown_connections 2023-09-30T22:26:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.283+0000 7f27c43db700 1 --2- 172.21.15.154:0/2933476636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc0a0a70 0x7f27bc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.283+0000 7f27c43db700 1 --2- 172.21.15.154:0/2933476636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc0a1380 0x7f27bc133a10 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.283+0000 7f27c43db700 1 -- 172.21.15.154:0/2933476636 >> 172.21.15.154:0/2933476636 conn(0x7f27bc0a6610 msgr2=0x7f27bc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.283+0000 7f27c43db700 1 -- 172.21.15.154:0/2933476636 shutdown_connections 2023-09-30T22:26:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.283+0000 7f27c43db700 1 -- 172.21.15.154:0/2933476636 wait complete. 2023-09-30T22:26:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.284+0000 7f27c43db700 1 Processor -- start 2023-09-30T22:26:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.284+0000 7f27c43db700 1 -- start start 2023-09-30T22:26:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c43db700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27bc0a0a70 0x7f27bc126e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c43db700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc0a1380 0x7f27bc127380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c43db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc133f50 0x7f27bc1cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c43db700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc1286c0 con 0x7f27bc0a1380 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c43db700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc133a10 con 0x7f27bc0a0a70 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c43db700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0a03e0 con 0x7f27bc133f50 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c2978700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc133f50 0x7f27bc1cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c2978700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc133f50 0x7f27bc1cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:35994/0 (socket says 172.21.15.154:35994) 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c2978700 1 -- 172.21.15.154:0/253204855 learned_addr learned my addr 172.21.15.154:0/253204855 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c2177700 1 --2- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27bc0a0a70 0x7f27bc126e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.285+0000 7f27c1976700 1 --2- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc0a1380 0x7f27bc127380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27c2177700 1 -- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc133f50 msgr2=0x7f27bc1cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27c2177700 1 --2- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc133f50 0x7f27bc1cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27c2177700 1 -- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc0a1380 msgr2=0x7f27bc127380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27c2177700 1 --2- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc0a1380 0x7f27bc127380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27c2177700 1 -- 172.21.15.154:0/253204855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac0094a0 con 0x7f27bc0a0a70 2023-09-30T22:26:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27c2177700 1 --2- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27bc0a0a70 0x7f27bc126e40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f27b800e900 tx=0x7f27b800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27b2ffd700 1 -- 172.21.15.154:0/253204855 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8013680 con 0x7f27bc0a0a70 2023-09-30T22:26:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27b2ffd700 1 -- 172.21.15.154:0/253204855 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b80137e0 con 0x7f27bc0a0a70 2023-09-30T22:26:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27b2ffd700 1 -- 172.21.15.154:0/253204855 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8013b50 con 0x7f27bc0a0a70 2023-09-30T22:26:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27c43db700 1 -- 172.21.15.154:0/253204855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc129ca0 con 0x7f27bc0a0a70 2023-09-30T22:26:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.286+0000 7f27c43db700 1 -- 172.21.15.154:0/253204855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc1278c0 con 0x7f27bc0a0a70 2023-09-30T22:26:27.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.287+0000 7f27b2ffd700 1 -- 172.21.15.154:0/253204855 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27b8013cb0 con 0x7f27bc0a0a70 2023-09-30T22:26:27.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.287+0000 7f27b2ffd700 1 -- 172.21.15.154:0/253204855 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f27b803f980 con 0x7f27bc0a0a70 2023-09-30T22:26:27.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.288+0000 7f27c43db700 1 -- 172.21.15.154:0/253204855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc128130 con 0x7f27bc0a0a70 2023-09-30T22:26:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.292+0000 7f27b2ffd700 1 -- 172.21.15.154:0/253204855 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27b8017070 con 0x7f27bc0a0a70 2023-09-30T22:26:27.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.336+0000 7fa43eaa9700 1 Processor -- start 2023-09-30T22:26:27.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.336+0000 7fa43eaa9700 1 -- start start 2023-09-30T22:26:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43eaa9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4380a0a70 0x7fa4380a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43eaa9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4380a1380 0x7fa438133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43eaa9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43809dc00 con 0x7fa438133f50 2023-09-30T22:26:27.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43eaa9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43809ea60 con 0x7fa4380a0a70 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43eaa9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa43809dec0 con 0x7fa4380a1380 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43d046700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa438133f50 0x7fa43813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37706/0 (socket says 172.21.15.154:37706) 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43d046700 1 -- 172.21.15.154:0/2704503788 learned_addr learned my addr 172.21.15.154:0/2704503788 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43c845700 1 --2- 172.21.15.154:0/2704503788 >> v2:172.21.15.154:3300/0 conn(0x7fa4380a0a70 0x7fa4380a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa437fff700 1 --2- 172.21.15.154:0/2704503788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4380a1380 0x7fa438133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43c845700 1 -- 172.21.15.154:0/2704503788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4380a1380 msgr2=0x7fa438133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43c845700 1 --2- 172.21.15.154:0/2704503788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4380a1380 0x7fa438133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43c845700 1 -- 172.21.15.154:0/2704503788 >> v1:172.21.15.154:6789/0 conn(0x7fa438133f50 legacy=0x7fa43813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa4377fe700 1 -- 172.21.15.154:0/2704503788 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823326314 0 0) 0x7fa43809dc00 con 0x7fa438133f50 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43c845700 1 -- 172.21.15.154:0/2704503788 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43809e6a0 con 0x7fa4380a0a70 2023-09-30T22:26:27.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa437fff700 1 --2- 172.21.15.154:0/2704503788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4380a1380 0x7fa438133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.337+0000 7fa43c845700 1 --2- 172.21.15.154:0/2704503788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 0x7fa4380a0e40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009840 tx=0x7fa42c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddb5012fb60976c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa4377fe700 1 -- 172.21.15.154:0/2704503788 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c011830 con 0x7fa4380a0a70 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa4377fe700 1 -- 172.21.15.154:0/2704503788 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c011990 con 0x7fa4380a0a70 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa4377fe700 1 -- 172.21.15.154:0/2704503788 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c011d20 con 0x7fa4380a0a70 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa43eaa9700 1 -- 172.21.15.154:0/2704503788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 msgr2=0x7fa4380a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa43eaa9700 1 --2- 172.21.15.154:0/2704503788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 0x7fa4380a0e40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009840 tx=0x7fa42c009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa43eaa9700 1 -- 172.21.15.154:0/2704503788 shutdown_connections 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa43eaa9700 1 --2- 172.21.15.154:0/2704503788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 0x7fa4380a0e40 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa43eaa9700 1 --2- 172.21.15.154:0/2704503788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4380a1380 0x7fa438133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa43eaa9700 1 -- 172.21.15.154:0/2704503788 >> 172.21.15.154:0/2704503788 conn(0x7fa4380a6610 msgr2=0x7fa4380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa43eaa9700 1 -- 172.21.15.154:0/2704503788 shutdown_connections 2023-09-30T22:26:27.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.338+0000 7fa43eaa9700 1 -- 172.21.15.154:0/2704503788 wait complete. 2023-09-30T22:26:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.340+0000 7fa43eaa9700 1 Processor -- start 2023-09-30T22:26:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.340+0000 7fa43eaa9700 1 -- start start 2023-09-30T22:26:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43eaa9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 0x7fa43811e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43eaa9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4380a1380 0x7fa43811e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43eaa9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa438133f50 0x7fa43811ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43eaa9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43811f8e0 con 0x7fa4380a0a70 2023-09-30T22:26:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43eaa9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4381201c0 con 0x7fa4380a1380 2023-09-30T22:26:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43eaa9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380a03e0 con 0x7fa438133f50 2023-09-30T22:26:27.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43d046700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa438133f50 0x7fa43811ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43c845700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 0x7fa43811e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43c845700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 0x7fa43811e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57722/0 (socket says 172.21.15.154:57722) 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43d046700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa438133f50 0x7fa43811ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36006/0 (socket says 172.21.15.154:36006) 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43c845700 1 -- 172.21.15.154:0/1713196514 learned_addr learned my addr 172.21.15.154:0/1713196514 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa437fff700 1 --2- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4380a1380 0x7fa43811e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43d046700 1 -- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4380a1380 msgr2=0x7fa43811e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43d046700 1 --2- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4380a1380 0x7fa43811e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43d046700 1 -- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 msgr2=0x7fa43811e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43d046700 1 --2- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 0x7fa43811e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43d046700 1 -- 172.21.15.154:0/1713196514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240094a0 con 0x7fa438133f50 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.341+0000 7fa43d046700 1 --2- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa438133f50 0x7fa43811ef00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa43000cc10 tx=0x7fa43000cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:27.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.342+0000 7fa4357fa700 1 -- 172.21.15.154:0/1713196514 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000aa00 con 0x7fa438133f50 2023-09-30T22:26:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.342+0000 7fa43eaa9700 1 -- 172.21.15.154:0/1713196514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c0094a0 con 0x7fa438133f50 2023-09-30T22:26:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.342+0000 7fa43eaa9700 1 -- 172.21.15.154:0/1713196514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa438121290 con 0x7fa438133f50 2023-09-30T22:26:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.343+0000 7fa4357fa700 1 -- 172.21.15.154:0/1713196514 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43000ab80 con 0x7fa438133f50 2023-09-30T22:26:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.343+0000 7fa43eaa9700 1 -- 172.21.15.154:0/1713196514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43804f2a0 con 0x7fa438133f50 2023-09-30T22:26:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.343+0000 7fa4357fa700 1 -- 172.21.15.154:0/1713196514 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4300070d0 con 0x7fa438133f50 2023-09-30T22:26:27.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.344+0000 7fa4357fa700 1 -- 172.21.15.154:0/1713196514 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa430007230 con 0x7fa438133f50 2023-09-30T22:26:27.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.344+0000 7fa4357fa700 1 -- 172.21.15.154:0/1713196514 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa43003f8b0 con 0x7fa438133f50 2023-09-30T22:26:27.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.352+0000 7fa4357fa700 1 -- 172.21.15.154:0/1713196514 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa43001a6d0 con 0x7fa438133f50 2023-09-30T22:26:27.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.402+0000 7ff2d23a3700 1 -- 172.21.15.154:0/2337782301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2cc09e3a0 con 0x7ff2cc131a00 2023-09-30T22:26:27.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.402+0000 7ff2c8ff9700 1 -- 172.21.15.154:0/2337782301 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2c4011380 con 0x7ff2cc131a00 2023-09-30T22:26:27.403 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:27.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.404+0000 7ff2d23a3700 1 -- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc131a00 msgr2=0x7ff2cc09af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.404+0000 7ff2d23a3700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc131a00 0x7ff2cc09af10 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400cbc0 tx=0x7ff2c400ced0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.404+0000 7ff2d23a3700 1 -- 172.21.15.154:0/2337782301 shutdown_connections 2023-09-30T22:26:27.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.404+0000 7ff2d23a3700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2cc131a00 0x7ff2cc09af10 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.404+0000 7ff2d23a3700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2cc06a770 0x7ff2cc09a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.404+0000 7ff2d23a3700 1 --2- 172.21.15.154:0/2337782301 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2cc09dec0 0x7ff2cc09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.404+0000 7ff2d23a3700 1 -- 172.21.15.154:0/2337782301 >> 172.21.15.154:0/2337782301 conn(0x7ff2cc099c40 msgr2=0x7ff2cc12ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.404+0000 7ff2d23a3700 1 -- 172.21.15.154:0/2337782301 shutdown_connections 2023-09-30T22:26:27.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.404+0000 7ff2d23a3700 1 -- 172.21.15.154:0/2337782301 wait complete. 2023-09-30T22:26:27.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:27.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.443+0000 7f68f6a46700 1 -- 172.21.15.154:0/379414335 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68f00a1020 con 0x7f68f009bc70 2023-09-30T22:26:27.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.443+0000 7f68ecff9700 1 -- 172.21.15.154:0/379414335 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68e0046070 con 0x7f68f009bc70 2023-09-30T22:26:27.444 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:27.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.445+0000 7f68f6a46700 1 -- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f009bc70 msgr2=0x7f68f011b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.445+0000 7f68f6a46700 1 --2- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f009bc70 0x7f68f011b8a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f68e0012000 tx=0x7f68e0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:27.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.445+0000 7f68f6a46700 1 -- 172.21.15.154:0/379414335 shutdown_connections 2023-09-30T22:26:27.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.445+0000 7f68f6a46700 1 --2- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f0131980 0x7f68f011c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.445+0000 7f68f6a46700 1 --2- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f009bc70 0x7f68f011b8a0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.445+0000 7f68f6a46700 1 --2- 172.21.15.154:0/379414335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68f009c790 0x7f68f011bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.445+0000 7f68f6a46700 1 -- 172.21.15.154:0/379414335 >> 172.21.15.154:0/379414335 conn(0x7f68f00a2980 msgr2=0x7f68f009fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.446+0000 7f68f6a46700 1 -- 172.21.15.154:0/379414335 shutdown_connections 2023-09-30T22:26:27.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.446+0000 7f68f6a46700 1 -- 172.21.15.154:0/379414335 wait complete. 2023-09-30T22:26:27.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:27.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.520+0000 7f27c43db700 1 -- 172.21.15.154:0/253204855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27bc129ae0 con 0x7f27bc0a0a70 2023-09-30T22:26:27.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.520+0000 7f27b2ffd700 1 -- 172.21.15.154:0/253204855 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27b801b590 con 0x7f27bc0a0a70 2023-09-30T22:26:27.521 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.522+0000 7f27c43db700 1 -- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27bc0a0a70 msgr2=0x7f27bc126e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.522+0000 7f27c43db700 1 --2- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27bc0a0a70 0x7f27bc126e40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f27b800e900 tx=0x7f27b800ec10 comp rx=0 tx=0).stop 2023-09-30T22:26:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.522+0000 7f27c43db700 1 -- 172.21.15.154:0/253204855 shutdown_connections 2023-09-30T22:26:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.522+0000 7f27c43db700 1 --2- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f27bc133f50 0x7f27bc1cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.522+0000 7f27c43db700 1 --2- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27bc0a0a70 0x7f27bc126e40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.522+0000 7f27c43db700 1 --2- 172.21.15.154:0/253204855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc0a1380 0x7f27bc127380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.522+0000 7f27c43db700 1 -- 172.21.15.154:0/253204855 >> 172.21.15.154:0/253204855 conn(0x7f27bc0a6610 msgr2=0x7f27bc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.522+0000 7f27c43db700 1 -- 172.21.15.154:0/253204855 shutdown_connections 2023-09-30T22:26:27.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.522+0000 7f27c43db700 1 -- 172.21.15.154:0/253204855 wait complete. 2023-09-30T22:26:27.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:27.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.559+0000 7fa43eaa9700 1 -- 172.21.15.154:0/1713196514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa438072980 con 0x7fa438133f50 2023-09-30T22:26:27.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.560+0000 7fa4357fa700 1 -- 172.21.15.154:0/1713196514 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa430018020 con 0x7fa438133f50 2023-09-30T22:26:27.561 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:27.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.562+0000 7fa43eaa9700 1 -- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa438133f50 msgr2=0x7fa43811ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:27.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.562+0000 7fa43eaa9700 1 --2- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa438133f50 0x7fa43811ef00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa43000cc10 tx=0x7fa43000cf20 comp rx=0 tx=0).stop 2023-09-30T22:26:27.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.562+0000 7fa43eaa9700 1 -- 172.21.15.154:0/1713196514 shutdown_connections 2023-09-30T22:26:27.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.562+0000 7fa43eaa9700 1 --2- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa438133f50 0x7fa43811ef00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.562+0000 7fa43eaa9700 1 --2- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4380a0a70 0x7fa43811e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.562+0000 7fa43eaa9700 1 --2- 172.21.15.154:0/1713196514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4380a1380 0x7fa43811e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:27.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.562+0000 7fa43eaa9700 1 -- 172.21.15.154:0/1713196514 >> 172.21.15.154:0/1713196514 conn(0x7fa4380a6610 msgr2=0x7fa4380a4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:27.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.562+0000 7fa43eaa9700 1 -- 172.21.15.154:0/1713196514 shutdown_connections 2023-09-30T22:26:27.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:27.562+0000 7fa43eaa9700 1 -- 172.21.15.154:0/1713196514 wait complete. 2023-09-30T22:26:27.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:28.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:28.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:28.535 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:28.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1df2394700 1 Processor -- start 2023-09-30T22:26:28.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1df2394700 1 -- start start 2023-09-30T22:26:28.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1df2394700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec133ad0 0x7f1dec133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1df2394700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1dec1300a0 0x7f1dec1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1df2394700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec06b2d0 con 0x7f1dec1309f0 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1df2394700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dec133610 con 0x7f1dec1300a0 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1df2394700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec09a500 con 0x7f1dec133ad0 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1debfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec133ad0 0x7f1dec133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1deb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1dec1300a0 0x7f1dec1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1debfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec133ad0 0x7f1dec133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36010/0 (socket says 172.21.15.154:36010) 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.558+0000 7f1debfff700 1 -- 172.21.15.154:0/1819890631 learned_addr learned my addr 172.21.15.154:0/1819890631 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.559+0000 7f1debfff700 1 -- 172.21.15.154:0/1819890631 >> v2:172.21.15.154:3300/0 conn(0x7f1dec1300a0 msgr2=0x7f1dec1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.559+0000 7f1debfff700 1 --2- 172.21.15.154:0/1819890631 >> v2:172.21.15.154:3300/0 conn(0x7f1dec1300a0 0x7f1dec1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.559+0000 7f1debfff700 1 -- 172.21.15.154:0/1819890631 >> v1:172.21.15.154:6789/0 conn(0x7f1dec1309f0 legacy=0x7f1dec13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.559+0000 7f1debfff700 1 -- 172.21.15.154:0/1819890631 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec1338b0 con 0x7f1dec133ad0 2023-09-30T22:26:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.559+0000 7f1deb7fe700 1 --2- 172.21.15.154:0/1819890631 >> v2:172.21.15.154:3300/0 conn(0x7f1dec1300a0 0x7f1dec1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.559+0000 7f1debfff700 1 --2- 172.21.15.154:0/1819890631 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec133ad0 0x7f1dec133ea0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0098f0 tx=0x7f1ddc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6860c1f02f3792af server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.559+0000 7f1deaffd700 1 -- 172.21.15.154:0/1819890631 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc011830 con 0x7f1dec133ad0 2023-09-30T22:26:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.559+0000 7f1deaffd700 1 -- 172.21.15.154:0/1819890631 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc011990 con 0x7f1dec133ad0 2023-09-30T22:26:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.559+0000 7f1deaffd700 1 -- 172.21.15.154:0/1819890631 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc011d20 con 0x7f1dec133ad0 2023-09-30T22:26:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.560+0000 7f1df2394700 1 -- 172.21.15.154:0/1819890631 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec133ad0 msgr2=0x7f1dec133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.560+0000 7f1df2394700 1 --2- 172.21.15.154:0/1819890631 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec133ad0 0x7f1dec133ea0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0098f0 tx=0x7f1ddc009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.560+0000 7f1df2394700 1 -- 172.21.15.154:0/1819890631 shutdown_connections 2023-09-30T22:26:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.560+0000 7f1df2394700 1 --2- 172.21.15.154:0/1819890631 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec133ad0 0x7f1dec133ea0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.560+0000 7f1df2394700 1 --2- 172.21.15.154:0/1819890631 >> v2:172.21.15.154:3300/0 conn(0x7f1dec1300a0 0x7f1dec1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.560+0000 7f1df2394700 1 -- 172.21.15.154:0/1819890631 >> 172.21.15.154:0/1819890631 conn(0x7f1dec099c40 msgr2=0x7f1dec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.560+0000 7f1df2394700 1 -- 172.21.15.154:0/1819890631 shutdown_connections 2023-09-30T22:26:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.560+0000 7f1df2394700 1 -- 172.21.15.154:0/1819890631 wait complete. 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.561+0000 7f1df2394700 1 Processor -- start 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.561+0000 7f1df2394700 1 -- start start 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.561+0000 7f1df2394700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec1300a0 0x7f1dec11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.561+0000 7f1df2394700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dec1309f0 0x7f1dec11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.561+0000 7f1df2394700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dec133ad0 0x7f1dec11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.561+0000 7f1df2394700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec11fde0 con 0x7f1dec133ad0 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.561+0000 7f1df2394700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0a2ea0 con 0x7f1dec1309f0 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.561+0000 7f1df2394700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec12dd00 con 0x7f1dec1300a0 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1debfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec1300a0 0x7f1dec11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1debfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec1300a0 0x7f1dec11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36020/0 (socket says 172.21.15.154:36020) 2023-09-30T22:26:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1debfff700 1 -- 172.21.15.154:0/2807276675 learned_addr learned my addr 172.21.15.154:0/2807276675 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1deb7fe700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dec1309f0 0x7f1dec11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1df0931700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dec133ad0 0x7f1dec11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1deb7fe700 1 -- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec1300a0 msgr2=0x7f1dec11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1deb7fe700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec1300a0 0x7f1dec11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1deb7fe700 1 -- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dec133ad0 msgr2=0x7f1dec11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1deb7fe700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dec133ad0 0x7f1dec11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1deb7fe700 1 -- 172.21.15.154:0/2807276675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00094a0 con 0x7f1dec1309f0 2023-09-30T22:26:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1debfff700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec1300a0 0x7f1dec11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1df0931700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dec133ad0 0x7f1dec11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1deb7fe700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dec1309f0 0x7f1dec11df80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1de000e980 tx=0x7f1de000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1de8ff9700 1 -- 172.21.15.154:0/2807276675 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000c690 con 0x7f1dec1309f0 2023-09-30T22:26:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1de8ff9700 1 -- 172.21.15.154:0/2807276675 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000c7f0 con 0x7f1dec1309f0 2023-09-30T22:26:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1df2394700 1 -- 172.21.15.154:0/2807276675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc009550 con 0x7f1dec1309f0 2023-09-30T22:26:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1de8ff9700 1 -- 172.21.15.154:0/2807276675 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000cb80 con 0x7f1dec1309f0 2023-09-30T22:26:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.562+0000 7f1df2394700 1 -- 172.21.15.154:0/2807276675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dec11fb20 con 0x7f1dec1309f0 2023-09-30T22:26:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.564+0000 7f1df2394700 1 -- 172.21.15.154:0/2807276675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dec09cb20 con 0x7f1dec1309f0 2023-09-30T22:26:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.564+0000 7f1de8ff9700 1 -- 172.21.15.154:0/2807276675 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1de000cce0 con 0x7f1dec1309f0 2023-09-30T22:26:28.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.564+0000 7f1de8ff9700 1 -- 172.21.15.154:0/2807276675 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1de003ff00 con 0x7f1dec1309f0 2023-09-30T22:26:28.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.568+0000 7f1de8ff9700 1 -- 172.21.15.154:0/2807276675 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1de0011350 con 0x7f1dec1309f0 2023-09-30T22:26:28.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.597+0000 7f3980e23700 1 Processor -- start 2023-09-30T22:26:28.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.597+0000 7f3980e23700 1 -- start start 2023-09-30T22:26:28.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.598+0000 7f3980e23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c099e20 0x7f397c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.598+0000 7f3980e23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c130a60 0x7f397c138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.598+0000 7f3980e23700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c099a60 con 0x7f397c09a730 2023-09-30T22:26:28.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.598+0000 7f3980e23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c09bf50 con 0x7f397c130a60 2023-09-30T22:26:28.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.598+0000 7f3980e23700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f397c09b230 con 0x7f397c099e20 2023-09-30T22:26:28.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.598+0000 7f3979d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f397c09a730 0x7f397c130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37726/0 (socket says 172.21.15.154:37726) 2023-09-30T22:26:28.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.598+0000 7f3979d9b700 1 -- 172.21.15.154:0/1072839621 learned_addr learned my addr 172.21.15.154:0/1072839621 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:28.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.598+0000 7f397a59c700 1 --2- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c099e20 0x7f397c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.598+0000 7f397ad9d700 1 --2- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c130a60 0x7f397c138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397a59c700 1 -- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c130a60 msgr2=0x7f397c138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397a59c700 1 --2- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c130a60 0x7f397c138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397a59c700 1 -- 172.21.15.154:0/1072839621 >> v1:172.21.15.154:6789/0 conn(0x7f397c09a730 legacy=0x7f397c130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397959a700 1 -- 172.21.15.154:0/1072839621 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147234324 0 0) 0x7f397c099a60 con 0x7f397c09a730 2023-09-30T22:26:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397a59c700 1 -- 172.21.15.154:0/1072839621 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c09bb90 con 0x7f397c099e20 2023-09-30T22:26:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397ad9d700 1 --2- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c130a60 0x7f397c138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:28.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397a59c700 1 --2- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c099e20 0x7f397c09a1f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f396c009850 tx=0x7f396c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f39e1f6c567edc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397959a700 1 -- 172.21.15.154:0/1072839621 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c005e30 con 0x7f397c099e20 2023-09-30T22:26:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397959a700 1 -- 172.21.15.154:0/1072839621 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c006030 con 0x7f397c099e20 2023-09-30T22:26:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.599+0000 7f397959a700 1 -- 172.21.15.154:0/1072839621 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c0063e0 con 0x7f397c099e20 2023-09-30T22:26:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.600+0000 7f3980e23700 1 -- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c099e20 msgr2=0x7f397c09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.600+0000 7f3980e23700 1 --2- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c099e20 0x7f397c09a1f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f396c009850 tx=0x7f396c009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:28.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.601+0000 7f3980e23700 1 -- 172.21.15.154:0/1072839621 shutdown_connections 2023-09-30T22:26:28.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.601+0000 7f3980e23700 1 --2- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c130a60 0x7f397c138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.601+0000 7f3980e23700 1 --2- 172.21.15.154:0/1072839621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c099e20 0x7f397c09a1f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.601+0000 7f3980e23700 1 -- 172.21.15.154:0/1072839621 >> 172.21.15.154:0/1072839621 conn(0x7f397c0a2980 msgr2=0x7f397c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.601+0000 7f3980e23700 1 -- 172.21.15.154:0/1072839621 shutdown_connections 2023-09-30T22:26:28.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.601+0000 7f3980e23700 1 -- 172.21.15.154:0/1072839621 wait complete. 2023-09-30T22:26:28.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.602+0000 7f3980e23700 1 Processor -- start 2023-09-30T22:26:28.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.602+0000 7f3980e23700 1 -- start start 2023-09-30T22:26:28.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f3980e23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c099e20 0x7f397c126210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f3980e23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c09a730 0x7f397c126750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f3980e23700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f397c130a60 0x7f397c1c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f3980e23700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c1298f0 con 0x7f397c130a60 2023-09-30T22:26:28.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f3980e23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c09b470 con 0x7f397c099e20 2023-09-30T22:26:28.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f3980e23700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f397c12b7e0 con 0x7f397c09a730 2023-09-30T22:26:28.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f397ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f397c130a60 0x7f397c1c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f397a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c099e20 0x7f397c126210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f397ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f397c130a60 0x7f397c1c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57750/0 (socket says 172.21.15.154:57750) 2023-09-30T22:26:28.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f397ad9d700 1 -- 172.21.15.154:0/4151620868 learned_addr learned my addr 172.21.15.154:0/4151620868 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:28.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.603+0000 7f3979d9b700 1 --2- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c09a730 0x7f397c126750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f397a59c700 1 -- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c09a730 msgr2=0x7f397c126750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f397a59c700 1 --2- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c09a730 0x7f397c126750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f397a59c700 1 -- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f397c130a60 msgr2=0x7f397c1c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f397a59c700 1 --2- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f397c130a60 0x7f397c1c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f397a59c700 1 -- 172.21.15.154:0/4151620868 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974009a70 con 0x7f397c099e20 2023-09-30T22:26:28.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f397a59c700 1 --2- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c099e20 0x7f397c126210 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f397c066a90 tx=0x7f396c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f396affd700 1 -- 172.21.15.154:0/4151620868 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c0068f0 con 0x7f397c099e20 2023-09-30T22:26:28.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f396affd700 1 -- 172.21.15.154:0/4151620868 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c020070 con 0x7f397c099e20 2023-09-30T22:26:28.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f396affd700 1 -- 172.21.15.154:0/4151620868 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c004280 con 0x7f397c099e20 2023-09-30T22:26:28.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f3980e23700 1 -- 172.21.15.154:0/4151620868 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c009430 con 0x7f397c099e20 2023-09-30T22:26:28.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.604+0000 7f3980e23700 1 -- 172.21.15.154:0/4151620868 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c139760 con 0x7f397c099e20 2023-09-30T22:26:28.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.605+0000 7f3980e23700 1 -- 172.21.15.154:0/4151620868 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c072480 con 0x7f397c099e20 2023-09-30T22:26:28.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.606+0000 7f396affd700 1 -- 172.21.15.154:0/4151620868 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f396c022030 con 0x7f397c099e20 2023-09-30T22:26:28.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.606+0000 7f396affd700 1 -- 172.21.15.154:0/4151620868 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f396c040e50 con 0x7f397c099e20 2023-09-30T22:26:28.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.611+0000 7f396affd700 1 -- 172.21.15.154:0/4151620868 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f396c0197c0 con 0x7f397c099e20 2023-09-30T22:26:28.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.676+0000 7f10f7e3a700 1 Processor -- start 2023-09-30T22:26:28.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.676+0000 7f10f7e3a700 1 -- start start 2023-09-30T22:26:28.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f7e3a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0136960 0x7f10f0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f7e3a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10f0139280 0x7f10f013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f7e3a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f006b2d0 con 0x7f10f0133ad0 2023-09-30T22:26:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f7e3a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f01345b0 con 0x7f10f0139280 2023-09-30T22:26:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f7e3a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f0133610 con 0x7f10f0136960 2023-09-30T22:26:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f5bd6700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f10f0133ad0 0x7f10f0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37740/0 (socket says 172.21.15.154:37740) 2023-09-30T22:26:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f5bd6700 1 -- 172.21.15.154:0/3284222487 learned_addr learned my addr 172.21.15.154:0/3284222487 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f53d5700 1 --2- 172.21.15.154:0/3284222487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0136960 0x7f10f0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f63d7700 1 --2- 172.21.15.154:0/3284222487 >> v2:172.21.15.154:3300/0 conn(0x7f10f0139280 0x7f10f013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f53d5700 1 -- 172.21.15.154:0/3284222487 >> v2:172.21.15.154:3300/0 conn(0x7f10f0139280 msgr2=0x7f10f013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f53d5700 1 --2- 172.21.15.154:0/3284222487 >> v2:172.21.15.154:3300/0 conn(0x7f10f0139280 0x7f10f013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f53d5700 1 -- 172.21.15.154:0/3284222487 >> v1:172.21.15.154:6789/0 conn(0x7f10f0133ad0 legacy=0x7f10f0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f53d5700 1 -- 172.21.15.154:0/3284222487 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f009a500 con 0x7f10f0136960 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f53d5700 1 --2- 172.21.15.154:0/3284222487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0136960 0x7f10f0138d40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009870 tx=0x7f10e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7a33cf43d99b20 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.677+0000 7f10f4bd4700 1 -- 172.21.15.154:0/3284222487 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011830 con 0x7f10f0136960 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.678+0000 7f10f4bd4700 1 -- 172.21.15.154:0/3284222487 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e0011990 con 0x7f10f0136960 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.678+0000 7f10f4bd4700 1 -- 172.21.15.154:0/3284222487 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011d20 con 0x7f10f0136960 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.678+0000 7f10f7e3a700 1 -- 172.21.15.154:0/3284222487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0136960 msgr2=0x7f10f0138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.678+0000 7f10f7e3a700 1 --2- 172.21.15.154:0/3284222487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0136960 0x7f10f0138d40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009870 tx=0x7f10e0009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.678+0000 7f10f7e3a700 1 -- 172.21.15.154:0/3284222487 shutdown_connections 2023-09-30T22:26:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.678+0000 7f10f7e3a700 1 --2- 172.21.15.154:0/3284222487 >> v2:172.21.15.154:3300/0 conn(0x7f10f0139280 0x7f10f013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.678+0000 7f10f7e3a700 1 --2- 172.21.15.154:0/3284222487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0136960 0x7f10f0138d40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.678+0000 7f10f7e3a700 1 -- 172.21.15.154:0/3284222487 >> 172.21.15.154:0/3284222487 conn(0x7f10f0099c40 msgr2=0x7f10f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.679+0000 7f10f7e3a700 1 -- 172.21.15.154:0/3284222487 shutdown_connections 2023-09-30T22:26:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.679+0000 7f10f7e3a700 1 -- 172.21.15.154:0/3284222487 wait complete. 2023-09-30T22:26:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.680+0000 7f10f7e3a700 1 Processor -- start 2023-09-30T22:26:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.680+0000 7f10f7e3a700 1 -- start start 2023-09-30T22:26:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f7e3a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0133ad0 0x7f10f01c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f7e3a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f0136960 0x7f10f01c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f7e3a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0139280 0x7f10f01c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f7e3a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f006e900 con 0x7f10f0139280 2023-09-30T22:26:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f7e3a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f0138ee0 con 0x7f10f0133ad0 2023-09-30T22:26:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f7e3a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f009f390 con 0x7f10f0136960 2023-09-30T22:26:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f53d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f0136960 0x7f10f01c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f53d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f0136960 0x7f10f01c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36040/0 (socket says 172.21.15.154:36040) 2023-09-30T22:26:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f53d5700 1 -- 172.21.15.154:0/344823747 learned_addr learned my addr 172.21.15.154:0/344823747 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f63d7700 1 --2- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0139280 0x7f10f01c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f5bd6700 1 --2- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0133ad0 0x7f10f01c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f53d5700 1 -- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0133ad0 msgr2=0x7f10f01c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f53d5700 1 --2- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0133ad0 0x7f10f01c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f53d5700 1 -- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0139280 msgr2=0x7f10f01c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f53d5700 1 --2- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0139280 0x7f10f01c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f53d5700 1 -- 172.21.15.154:0/344823747 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00094a0 con 0x7f10f0136960 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10f53d5700 1 --2- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f0136960 0x7f10f01c8ab0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009840 tx=0x7f10e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.681+0000 7f10e67fc700 1 -- 172.21.15.154:0/344823747 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00036a0 con 0x7f10f0136960 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.682+0000 7f10e67fc700 1 -- 172.21.15.154:0/344823747 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e001f070 con 0x7f10f0136960 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.682+0000 7f10f7e3a700 1 -- 172.21.15.154:0/344823747 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f006f010 con 0x7f10f0136960 2023-09-30T22:26:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.682+0000 7f10e67fc700 1 -- 172.21.15.154:0/344823747 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0003a40 con 0x7f10f0136960 2023-09-30T22:26:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.682+0000 7f10f7e3a700 1 -- 172.21.15.154:0/344823747 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f0070730 con 0x7f10f0136960 2023-09-30T22:26:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.682+0000 7f10e67fc700 1 -- 172.21.15.154:0/344823747 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10e0003ba0 con 0x7f10f0136960 2023-09-30T22:26:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.682+0000 7f10e67fc700 1 -- 172.21.15.154:0/344823747 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10e0021070 con 0x7f10f0136960 2023-09-30T22:26:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.683+0000 7f10d3fff700 1 -- 172.21.15.154:0/344823747 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc0052e0 con 0x7f10f0136960 2023-09-30T22:26:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.688+0000 7f10e67fc700 1 -- 172.21.15.154:0/344823747 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10e0015070 con 0x7f10f0136960 2023-09-30T22:26:28.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.717+0000 7f277370b700 1 Processor -- start 2023-09-30T22:26:28.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.717+0000 7f277370b700 1 -- start start 2023-09-30T22:26:28.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f277370b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c0a1550 0x7f276c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f277370b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f276c139200 0x7f276c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f277370b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c09e9d0 con 0x7f276c0a0a70 2023-09-30T22:26:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f277370b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276c09dc00 con 0x7f276c139200 2023-09-30T22:26:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f277370b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f276c09dec0 con 0x7f276c0a1550 2023-09-30T22:26:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f2770ca6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c0a1550 0x7f276c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f27714a7700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f276c0a0a70 0x7f276c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37746/0 (socket says 172.21.15.154:37746) 2023-09-30T22:26:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f27714a7700 1 -- 172.21.15.154:0/3077773403 learned_addr learned my addr 172.21.15.154:0/3077773403 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f2771ca8700 1 --2- 172.21.15.154:0/3077773403 >> v2:172.21.15.154:3300/0 conn(0x7f276c139200 0x7f276c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f2771ca8700 1 -- 172.21.15.154:0/3077773403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c0a1550 msgr2=0x7f276c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.718+0000 7f2771ca8700 1 --2- 172.21.15.154:0/3077773403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c0a1550 0x7f276c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.719+0000 7f2771ca8700 1 -- 172.21.15.154:0/3077773403 >> v1:172.21.15.154:6789/0 conn(0x7f276c0a0a70 legacy=0x7f276c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.719+0000 7f2771ca8700 1 -- 172.21.15.154:0/3077773403 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c09e6a0 con 0x7f276c139200 2023-09-30T22:26:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.719+0000 7f2770ca6700 1 --2- 172.21.15.154:0/3077773403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c0a1550 0x7f276c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.719+0000 7f2771ca8700 1 --2- 172.21.15.154:0/3077773403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c139200 0x7f276c13b5e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f2764009d90 tx=0x7f276400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63d23ccb701ac81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.719+0000 7f2763fff700 1 -- 172.21.15.154:0/3077773403 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400e070 con 0x7f276c139200 2023-09-30T22:26:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.719+0000 7f2763fff700 1 -- 172.21.15.154:0/3077773403 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2764003a20 con 0x7f276c139200 2023-09-30T22:26:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.719+0000 7f2763fff700 1 -- 172.21.15.154:0/3077773403 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764003dd0 con 0x7f276c139200 2023-09-30T22:26:28.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.719+0000 7f277370b700 1 -- 172.21.15.154:0/3077773403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c139200 msgr2=0x7f276c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.719+0000 7f277370b700 1 --2- 172.21.15.154:0/3077773403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c139200 0x7f276c13b5e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f2764009d90 tx=0x7f276400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.720+0000 7f277370b700 1 -- 172.21.15.154:0/3077773403 shutdown_connections 2023-09-30T22:26:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.720+0000 7f277370b700 1 --2- 172.21.15.154:0/3077773403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c139200 0x7f276c13b5e0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.720+0000 7f277370b700 1 --2- 172.21.15.154:0/3077773403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c0a1550 0x7f276c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.720+0000 7f277370b700 1 -- 172.21.15.154:0/3077773403 >> 172.21.15.154:0/3077773403 conn(0x7f276c0a6610 msgr2=0x7f276c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.720+0000 7f277370b700 1 -- 172.21.15.154:0/3077773403 shutdown_connections 2023-09-30T22:26:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.720+0000 7f277370b700 1 -- 172.21.15.154:0/3077773403 wait complete. 2023-09-30T22:26:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.721+0000 7f277370b700 1 Processor -- start 2023-09-30T22:26:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.721+0000 7f277370b700 1 -- start start 2023-09-30T22:26:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f277370b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0a0a70 0x7f276c11e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f277370b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0a1550 0x7f276c11ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f277370b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c139200 0x7f276c11f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f277370b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0a03e0 con 0x7f276c0a0a70 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f277370b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0a5190 con 0x7f276c0a1550 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f277370b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f276c1203b0 con 0x7f276c139200 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2771ca8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c139200 0x7f276c11f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f27714a7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0a0a70 0x7f276c11e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2771ca8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c139200 0x7f276c11f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36048/0 (socket says 172.21.15.154:36048) 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2771ca8700 1 -- 172.21.15.154:0/3232951386 learned_addr learned my addr 172.21.15.154:0/3232951386 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2770ca6700 1 --2- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0a1550 0x7f276c11ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2771ca8700 1 -- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0a1550 msgr2=0x7f276c11ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2771ca8700 1 --2- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0a1550 0x7f276c11ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2771ca8700 1 -- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0a0a70 msgr2=0x7f276c11e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2771ca8700 1 --2- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0a0a70 0x7f276c11e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2771ca8700 1 -- 172.21.15.154:0/3232951386 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c0094a0 con 0x7f276c139200 2023-09-30T22:26:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.722+0000 7f2771ca8700 1 --2- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c139200 0x7f276c11f2b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f276c09dd40 tx=0x7f2764004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.723+0000 7f2761ffb700 1 -- 172.21.15.154:0/3232951386 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764021ea0 con 0x7f276c139200 2023-09-30T22:26:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.723+0000 7f2761ffb700 1 -- 172.21.15.154:0/3232951386 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2764004030 con 0x7f276c139200 2023-09-30T22:26:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.723+0000 7f2761ffb700 1 -- 172.21.15.154:0/3232951386 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764026070 con 0x7f276c139200 2023-09-30T22:26:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.723+0000 7f277370b700 1 -- 172.21.15.154:0/3232951386 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2764009a70 con 0x7f276c139200 2023-09-30T22:26:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.723+0000 7f277370b700 1 -- 172.21.15.154:0/3232951386 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c121d20 con 0x7f276c139200 2023-09-30T22:26:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.724+0000 7f2761ffb700 1 -- 172.21.15.154:0/3232951386 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27640043a0 con 0x7f276c139200 2023-09-30T22:26:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.724+0000 7f274f7fe700 1 -- 172.21.15.154:0/3232951386 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27480052e0 con 0x7f276c139200 2023-09-30T22:26:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.724+0000 7f2761ffb700 1 -- 172.21.15.154:0/3232951386 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2764048930 con 0x7f276c139200 2023-09-30T22:26:28.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.733+0000 7f2761ffb700 1 -- 172.21.15.154:0/3232951386 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2764031900 con 0x7f276c139200 2023-09-30T22:26:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.823+0000 7f1df2394700 1 -- 172.21.15.154:0/2807276675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1dec11f910 con 0x7f1dec1309f0 2023-09-30T22:26:28.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.823+0000 7f1de8ff9700 1 -- 172.21.15.154:0/2807276675 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1de0017070 con 0x7f1dec1309f0 2023-09-30T22:26:28.825 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:28.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.826+0000 7f1df2394700 1 -- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dec1309f0 msgr2=0x7f1dec11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.826+0000 7f1df2394700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dec1309f0 0x7f1dec11df80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1de000e980 tx=0x7f1de000ec90 comp rx=0 tx=0).stop 2023-09-30T22:26:28.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.826+0000 7f1df2394700 1 -- 172.21.15.154:0/2807276675 shutdown_connections 2023-09-30T22:26:28.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.826+0000 7f1df2394700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dec133ad0 0x7f1dec11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.826+0000 7f1df2394700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dec1300a0 0x7f1dec11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.826+0000 7f1df2394700 1 --2- 172.21.15.154:0/2807276675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dec1309f0 0x7f1dec11df80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.826+0000 7f1df2394700 1 -- 172.21.15.154:0/2807276675 >> 172.21.15.154:0/2807276675 conn(0x7f1dec099c40 msgr2=0x7f1dec12f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.826+0000 7f1df2394700 1 -- 172.21.15.154:0/2807276675 shutdown_connections 2023-09-30T22:26:28.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.826+0000 7f1df2394700 1 -- 172.21.15.154:0/2807276675 wait complete. 2023-09-30T22:26:28.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:28.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.839+0000 7f3980e23700 1 -- 172.21.15.154:0/4151620868 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f397c072480 con 0x7f397c099e20 2023-09-30T22:26:28.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.839+0000 7f396affd700 1 -- 172.21.15.154:0/4151620868 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f397c072480 con 0x7f397c099e20 2023-09-30T22:26:28.841 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:28.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.841+0000 7f3980e23700 1 -- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c099e20 msgr2=0x7f397c126210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.841+0000 7f3980e23700 1 --2- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c099e20 0x7f397c126210 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f397c066a90 tx=0x7f396c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.841+0000 7f3980e23700 1 -- 172.21.15.154:0/4151620868 shutdown_connections 2023-09-30T22:26:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.841+0000 7f3980e23700 1 --2- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f397c130a60 0x7f397c1c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.841+0000 7f3980e23700 1 --2- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f397c099e20 0x7f397c126210 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.841+0000 7f3980e23700 1 --2- 172.21.15.154:0/4151620868 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f397c09a730 0x7f397c126750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.841+0000 7f3980e23700 1 -- 172.21.15.154:0/4151620868 >> 172.21.15.154:0/4151620868 conn(0x7f397c0a2980 msgr2=0x7f397c09e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.841+0000 7f3980e23700 1 -- 172.21.15.154:0/4151620868 shutdown_connections 2023-09-30T22:26:28.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.841+0000 7f3980e23700 1 -- 172.21.15.154:0/4151620868 wait complete. 2023-09-30T22:26:28.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:28.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.887+0000 7f10d3fff700 1 -- 172.21.15.154:0/344823747 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f10cc005590 con 0x7f10f0136960 2023-09-30T22:26:28.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.887+0000 7f10e67fc700 1 -- 172.21.15.154:0/344823747 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10e0019d40 con 0x7f10f0136960 2023-09-30T22:26:28.888 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.889+0000 7f10d3fff700 1 -- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f0136960 msgr2=0x7f10f01c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.889+0000 7f10d3fff700 1 --2- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f0136960 0x7f10f01c8ab0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009840 tx=0x7f10e0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.889+0000 7f10d3fff700 1 -- 172.21.15.154:0/344823747 shutdown_connections 2023-09-30T22:26:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.889+0000 7f10d3fff700 1 --2- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10f0139280 0x7f10f01c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.889+0000 7f10d3fff700 1 --2- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10f0133ad0 0x7f10f01c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.889+0000 7f10d3fff700 1 --2- 172.21.15.154:0/344823747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f10f0136960 0x7f10f01c8ab0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.889+0000 7f10d3fff700 1 -- 172.21.15.154:0/344823747 >> 172.21.15.154:0/344823747 conn(0x7f10f0099c40 msgr2=0x7f10f0131550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.889+0000 7f10d3fff700 1 -- 172.21.15.154:0/344823747 shutdown_connections 2023-09-30T22:26:28.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.889+0000 7f10d3fff700 1 -- 172.21.15.154:0/344823747 wait complete. 2023-09-30T22:26:28.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:28.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.945+0000 7f274f7fe700 1 -- 172.21.15.154:0/3232951386 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2748005590 con 0x7f276c139200 2023-09-30T22:26:28.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.945+0000 7f2761ffb700 1 -- 172.21.15.154:0/3232951386 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2764031310 con 0x7f276c139200 2023-09-30T22:26:28.947 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:28.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.947+0000 7f274f7fe700 1 -- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c139200 msgr2=0x7f276c11f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:28.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.947+0000 7f274f7fe700 1 --2- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c139200 0x7f276c11f2b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f276c09dd40 tx=0x7f2764004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.947+0000 7f274f7fe700 1 -- 172.21.15.154:0/3232951386 shutdown_connections 2023-09-30T22:26:28.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.947+0000 7f274f7fe700 1 --2- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f276c139200 0x7f276c11f2b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.947+0000 7f274f7fe700 1 --2- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0a0a70 0x7f276c11e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.947+0000 7f274f7fe700 1 --2- 172.21.15.154:0/3232951386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0a1550 0x7f276c11ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:28.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.947+0000 7f274f7fe700 1 -- 172.21.15.154:0/3232951386 >> 172.21.15.154:0/3232951386 conn(0x7f276c0a6610 msgr2=0x7f276c1381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:28.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.947+0000 7f274f7fe700 1 -- 172.21.15.154:0/3232951386 shutdown_connections 2023-09-30T22:26:28.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:28.947+0000 7f274f7fe700 1 -- 172.21.15.154:0/3232951386 wait complete. 2023-09-30T22:26:28.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:29.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:29.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:29.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:29.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:29.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.984+0000 7fdd64747700 1 Processor -- start 2023-09-30T22:26:29.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.984+0000 7fdd64747700 1 -- start start 2023-09-30T22:26:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.985+0000 7fdd64747700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 0x7fdd5c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.985+0000 7fdd64747700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.985+0000 7fdd64747700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c09aaa0 con 0x7fdd5c130ce0 2023-09-30T22:26:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.985+0000 7fdd64747700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c09f870 con 0x7fdd5c09e170 2023-09-30T22:26:29.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.985+0000 7fdd64747700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c09b360 con 0x7fdd5c09d860 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.985+0000 7fdd624e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 0x7fdd5c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.985+0000 7fdd61ce2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.985+0000 7fdd624e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 0x7fdd5c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36062/0 (socket says 172.21.15.154:36062) 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.985+0000 7fdd624e3700 1 -- 172.21.15.154:0/3386829574 learned_addr learned my addr 172.21.15.154:0/3386829574 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.986+0000 7fdd61ce2700 1 -- 172.21.15.154:0/3386829574 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 msgr2=0x7fdd5c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.986+0000 7fdd61ce2700 1 --2- 172.21.15.154:0/3386829574 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 0x7fdd5c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.986+0000 7fdd61ce2700 1 -- 172.21.15.154:0/3386829574 >> v1:172.21.15.154:6789/0 conn(0x7fdd5c130ce0 legacy=0x7fdd5c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.986+0000 7fdd614e1700 1 -- 172.21.15.154:0/3386829574 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977621673 0 0) 0x7fdd5c09aaa0 con 0x7fdd5c130ce0 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.986+0000 7fdd61ce2700 1 -- 172.21.15.154:0/3386829574 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c09b620 con 0x7fdd5c09e170 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.986+0000 7fdd61ce2700 1 --2- 172.21.15.154:0/3386829574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c1307a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009870 tx=0x7fdd4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58c342d393d2511 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.986+0000 7fdd614e1700 1 -- 172.21.15.154:0/3386829574 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c011830 con 0x7fdd5c09e170 2023-09-30T22:26:29.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.986+0000 7fdd614e1700 1 -- 172.21.15.154:0/3386829574 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c011990 con 0x7fdd5c09e170 2023-09-30T22:26:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.986+0000 7fdd614e1700 1 -- 172.21.15.154:0/3386829574 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c011d20 con 0x7fdd5c09e170 2023-09-30T22:26:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.987+0000 7fdd64747700 1 -- 172.21.15.154:0/3386829574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 msgr2=0x7fdd5c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.987+0000 7fdd64747700 1 --2- 172.21.15.154:0/3386829574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c1307a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009870 tx=0x7fdd4c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.987+0000 7fdd64747700 1 -- 172.21.15.154:0/3386829574 shutdown_connections 2023-09-30T22:26:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.987+0000 7fdd64747700 1 --2- 172.21.15.154:0/3386829574 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 0x7fdd5c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.987+0000 7fdd64747700 1 --2- 172.21.15.154:0/3386829574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c1307a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.987+0000 7fdd64747700 1 -- 172.21.15.154:0/3386829574 >> 172.21.15.154:0/3386829574 conn(0x7fdd5c099c40 msgr2=0x7fdd5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.987+0000 7fdd64747700 1 -- 172.21.15.154:0/3386829574 shutdown_connections 2023-09-30T22:26:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.987+0000 7fdd64747700 1 -- 172.21.15.154:0/3386829574 wait complete. 2023-09-30T22:26:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.988+0000 7fdd64747700 1 Processor -- start 2023-09-30T22:26:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.988+0000 7fdd64747700 1 -- start start 2023-09-30T22:26:29.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd64747700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 0x7fdd5c1206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd64747700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c120c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd64747700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c130ce0 0x7fdd5c121170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd64747700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c123d00 con 0x7fdd5c130ce0 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd64747700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c124df0 con 0x7fdd5c09e170 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd64747700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c130270 con 0x7fdd5c09d860 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd61ce2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c120c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd61ce2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c120c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54984/0 (socket says 172.21.15.154:54984) 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd61ce2700 1 -- 172.21.15.154:0/3134286409 learned_addr learned my addr 172.21.15.154:0/3134286409 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd624e3700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 0x7fdd5c1206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd62ce4700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c130ce0 0x7fdd5c121170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd61ce2700 1 -- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 msgr2=0x7fdd5c1206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd61ce2700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 0x7fdd5c1206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd61ce2700 1 -- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c130ce0 msgr2=0x7fdd5c121170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd61ce2700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c130ce0 0x7fdd5c121170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd61ce2700 1 -- 172.21.15.154:0/3134286409 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c0094a0 con 0x7fdd5c09e170 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.989+0000 7fdd62ce4700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c130ce0 0x7fdd5c121170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.990+0000 7fdd61ce2700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c120c30 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c013000 tx=0x7fdd4c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.990+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3134286409 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c004380 con 0x7fdd5c09e170 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.990+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3134286409 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c01f070 con 0x7fdd5c09e170 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.990+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3134286409 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0036a0 con 0x7fdd5c09e170 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.990+0000 7fdd64747700 1 -- 172.21.15.154:0/3134286409 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c123f30 con 0x7fdd5c09e170 2023-09-30T22:26:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.990+0000 7fdd64747700 1 -- 172.21.15.154:0/3134286409 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c1228b0 con 0x7fdd5c09e170 2023-09-30T22:26:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.991+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3134286409 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd4c021030 con 0x7fdd5c09e170 2023-09-30T22:26:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.991+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3134286409 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdd4c0406a0 con 0x7fdd5c09e170 2023-09-30T22:26:29.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.992+0000 7fdd64747700 1 -- 172.21.15.154:0/3134286409 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c04f2a0 con 0x7fdd5c09e170 2023-09-30T22:26:29.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:29.997+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3134286409 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd4c0199a0 con 0x7fdd5c09e170 2023-09-30T22:26:30.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe9595c0700 1 Processor -- start 2023-09-30T22:26:30.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe9595c0700 1 -- start start 2023-09-30T22:26:30.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe9595c0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe954131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe9595c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe95409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe9595c0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9540a1640 con 0x7fe95409c5c0 2023-09-30T22:26:30.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe9595c0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95406eb30 con 0x7fe954131980 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe9595c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540a22d0 con 0x7fe95409bc70 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe952ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe954131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe952ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe954131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54986/0 (socket says 172.21.15.154:54986) 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.036+0000 7fe952ffd700 1 -- 172.21.15.154:0/462672195 learned_addr learned my addr 172.21.15.154:0/462672195 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.037+0000 7fe9527fc700 1 --2- 172.21.15.154:0/462672195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe95409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.037+0000 7fe952ffd700 1 -- 172.21.15.154:0/462672195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 msgr2=0x7fe95409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.037+0000 7fe952ffd700 1 --2- 172.21.15.154:0/462672195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe95409c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.037+0000 7fe952ffd700 1 -- 172.21.15.154:0/462672195 >> v1:172.21.15.154:6789/0 conn(0x7fe95409c5c0 legacy=0x7fe954138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.037+0000 7fe952ffd700 1 -- 172.21.15.154:0/462672195 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954131550 con 0x7fe954131980 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.037+0000 7fe952ffd700 1 --2- 172.21.15.154:0/462672195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe954131d50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe944006f70 tx=0x7fe94400dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8a51193f7b92f15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.037+0000 7fe951ffb700 1 -- 172.21.15.154:0/462672195 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944005c20 con 0x7fe954131980 2023-09-30T22:26:30.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.037+0000 7fe951ffb700 1 -- 172.21.15.154:0/462672195 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944011070 con 0x7fe954131980 2023-09-30T22:26:30.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.037+0000 7fe951ffb700 1 -- 172.21.15.154:0/462672195 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94400de80 con 0x7fe954131980 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.038+0000 7fe9595c0700 1 -- 172.21.15.154:0/462672195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 msgr2=0x7fe954131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.038+0000 7fe9595c0700 1 --2- 172.21.15.154:0/462672195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe954131d50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe944006f70 tx=0x7fe94400dcf0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.038+0000 7fe9595c0700 1 -- 172.21.15.154:0/462672195 shutdown_connections 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.038+0000 7fe9595c0700 1 --2- 172.21.15.154:0/462672195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe954131d50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.038+0000 7fe9595c0700 1 --2- 172.21.15.154:0/462672195 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe95409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.038+0000 7fe9595c0700 1 -- 172.21.15.154:0/462672195 >> 172.21.15.154:0/462672195 conn(0x7fe9540a2980 msgr2=0x7fe9540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.038+0000 7fe9595c0700 1 -- 172.21.15.154:0/462672195 shutdown_connections 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.038+0000 7fe9595c0700 1 -- 172.21.15.154:0/462672195 wait complete. 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.040+0000 7fe9595c0700 1 Processor -- start 2023-09-30T22:26:30.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.040+0000 7fe9595c0700 1 -- start start 2023-09-30T22:26:30.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe9595c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe9541195f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe9595c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95409c5c0 0x7fe954119b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe9595c0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe95411a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe9595c0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95411d070 con 0x7fe95409c5c0 2023-09-30T22:26:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe9595c0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95411b780 con 0x7fe954131980 2023-09-30T22:26:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe9595c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe95411c440 con 0x7fe95409bc70 2023-09-30T22:26:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe952ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe9541195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe952ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe9541195f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36080/0 (socket says 172.21.15.154:36080) 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe952ffd700 1 -- 172.21.15.154:0/497358014 learned_addr learned my addr 172.21.15.154:0/497358014 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe9537fe700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe95411a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe9527fc700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95409c5c0 0x7fe954119b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe952ffd700 1 -- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 msgr2=0x7fe95411a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe952ffd700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe95411a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe952ffd700 1 -- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95409c5c0 msgr2=0x7fe954119b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe952ffd700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95409c5c0 0x7fe954119b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe952ffd700 1 -- 172.21.15.154:0/497358014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944006b50 con 0x7fe95409bc70 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe9537fe700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe95411a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.041+0000 7fe952ffd700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe9541195f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe944000c00 tx=0x7fe944004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.042+0000 7fe93b7fe700 1 -- 172.21.15.154:0/497358014 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94401c070 con 0x7fe95409bc70 2023-09-30T22:26:30.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.042+0000 7fe9595c0700 1 -- 172.21.15.154:0/497358014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95411aa50 con 0x7fe95409bc70 2023-09-30T22:26:30.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.042+0000 7fe93b7fe700 1 -- 172.21.15.154:0/497358014 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944005e00 con 0x7fe95409bc70 2023-09-30T22:26:30.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.042+0000 7fe93b7fe700 1 -- 172.21.15.154:0/497358014 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944004490 con 0x7fe95409bc70 2023-09-30T22:26:30.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.042+0000 7fe9595c0700 1 -- 172.21.15.154:0/497358014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe954130bd0 con 0x7fe95409bc70 2023-09-30T22:26:30.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.043+0000 7fe93b7fe700 1 -- 172.21.15.154:0/497358014 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9440036a0 con 0x7fe95409bc70 2023-09-30T22:26:30.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.043+0000 7fe93b7fe700 1 -- 172.21.15.154:0/497358014 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe94403f6f0 con 0x7fe95409bc70 2023-09-30T22:26:30.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.043+0000 7fe9595c0700 1 -- 172.21.15.154:0/497358014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95411cbf0 con 0x7fe95409bc70 2023-09-30T22:26:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.052+0000 7fe93b7fe700 1 -- 172.21.15.154:0/497358014 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe95411cbf0 con 0x7fe95409bc70 2023-09-30T22:26:30.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.080+0000 7f2d20aa0700 1 Processor -- start 2023-09-30T22:26:30.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.080+0000 7f2d20aa0700 1 -- start start 2023-09-30T22:26:30.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.081+0000 7f2d20aa0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d1c06a770 0x7f2d1c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.081+0000 7f2d20aa0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c09dec0 0x7f2d1c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.081+0000 7f2d20aa0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c06b5c0 con 0x7f2d1c131a00 2023-09-30T22:26:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.081+0000 7f2d20aa0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c06e900 con 0x7f2d1c06a770 2023-09-30T22:26:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.081+0000 7f2d20aa0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c09d180 con 0x7f2d1c09dec0 2023-09-30T22:26:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.081+0000 7f2d19d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c09dec0 0x7f2d1c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d19d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c09dec0 0x7f2d1c06b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36086/0 (socket says 172.21.15.154:36086) 2023-09-30T22:26:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d19d9b700 1 -- 172.21.15.154:0/1166695313 learned_addr learned my addr 172.21.15.154:0/1166695313 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d1a59c700 1 --2- 172.21.15.154:0/1166695313 >> v2:172.21.15.154:3300/0 conn(0x7f2d1c06a770 0x7f2d1c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d19d9b700 1 -- 172.21.15.154:0/1166695313 >> v2:172.21.15.154:3300/0 conn(0x7f2d1c06a770 msgr2=0x7f2d1c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d19d9b700 1 --2- 172.21.15.154:0/1166695313 >> v2:172.21.15.154:3300/0 conn(0x7f2d1c06a770 0x7f2d1c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d19d9b700 1 -- 172.21.15.154:0/1166695313 >> v1:172.21.15.154:6789/0 conn(0x7f2d1c131a00 legacy=0x7f2d1c131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d19d9b700 1 -- 172.21.15.154:0/1166695313 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c09e780 con 0x7f2d1c09dec0 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d1a59c700 1 --2- 172.21.15.154:0/1166695313 >> v2:172.21.15.154:3300/0 conn(0x7f2d1c06a770 0x7f2d1c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d19d9b700 1 --2- 172.21.15.154:0/1166695313 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c09dec0 0x7f2d1c06b080 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2d100098f0 tx=0x7f2d10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d18e36b45a4e7e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d1959a700 1 -- 172.21.15.154:0/1166695313 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10011830 con 0x7f2d1c09dec0 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d1959a700 1 -- 172.21.15.154:0/1166695313 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d10011990 con 0x7f2d1c09dec0 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.082+0000 7f2d1959a700 1 -- 172.21.15.154:0/1166695313 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10011d20 con 0x7f2d1c09dec0 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.083+0000 7f2d20aa0700 1 -- 172.21.15.154:0/1166695313 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c09dec0 msgr2=0x7f2d1c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.083+0000 7f2d20aa0700 1 --2- 172.21.15.154:0/1166695313 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c09dec0 0x7f2d1c06b080 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2d100098f0 tx=0x7f2d10009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.083+0000 7f2d20aa0700 1 -- 172.21.15.154:0/1166695313 shutdown_connections 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.083+0000 7f2d20aa0700 1 --2- 172.21.15.154:0/1166695313 >> v2:172.21.15.154:3300/0 conn(0x7f2d1c06a770 0x7f2d1c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.083+0000 7f2d20aa0700 1 --2- 172.21.15.154:0/1166695313 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c09dec0 0x7f2d1c06b080 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.083+0000 7f2d20aa0700 1 -- 172.21.15.154:0/1166695313 >> 172.21.15.154:0/1166695313 conn(0x7f2d1c099c40 msgr2=0x7f2d1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.083+0000 7f2d20aa0700 1 -- 172.21.15.154:0/1166695313 shutdown_connections 2023-09-30T22:26:30.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.083+0000 7f2d20aa0700 1 -- 172.21.15.154:0/1166695313 wait complete. 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.084+0000 7f2d20aa0700 1 Processor -- start 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.084+0000 7f2d20aa0700 1 -- start start 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d20aa0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c06a770 0x7f2d1c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d20aa0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d1c09dec0 0x7f2d1c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d20aa0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d1c131a00 0x7f2d1c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d20aa0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c130cd0 con 0x7f2d1c131a00 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d20aa0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c071ce0 con 0x7f2d1c09dec0 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d20aa0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c09b880 con 0x7f2d1c06a770 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d1a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c06a770 0x7f2d1c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d1a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c06a770 0x7f2d1c09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36102/0 (socket says 172.21.15.154:36102) 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d1a59c700 1 -- 172.21.15.154:0/176850095 learned_addr learned my addr 172.21.15.154:0/176850095 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d19d9b700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d1c09dec0 0x7f2d1c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d1ad9d700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d1c131a00 0x7f2d1c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d1a59c700 1 -- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d1c09dec0 msgr2=0x7f2d1c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d1a59c700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d1c09dec0 0x7f2d1c09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d1a59c700 1 -- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d1c131a00 msgr2=0x7f2d1c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.085+0000 7f2d1a59c700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d1c131a00 0x7f2d1c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.086+0000 7f2d1a59c700 1 -- 172.21.15.154:0/176850095 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0094a0 con 0x7f2d1c06a770 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.086+0000 7f2d19d9b700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d1c09dec0 0x7f2d1c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.086+0000 7f2d1a59c700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c06a770 0x7f2d1c09a490 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00ebe0 tx=0x7f2d0c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.086+0000 7f2d0affd700 1 -- 172.21.15.154:0/176850095 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00c850 con 0x7f2d1c06a770 2023-09-30T22:26:30.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.086+0000 7f2d0affd700 1 -- 172.21.15.154:0/176850095 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c00c9b0 con 0x7f2d1c06a770 2023-09-30T22:26:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.086+0000 7f2d20aa0700 1 -- 172.21.15.154:0/176850095 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d10009550 con 0x7f2d1c06a770 2023-09-30T22:26:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.086+0000 7f2d0affd700 1 -- 172.21.15.154:0/176850095 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00cd20 con 0x7f2d1c06a770 2023-09-30T22:26:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.086+0000 7f2d20aa0700 1 -- 172.21.15.154:0/176850095 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c11f4b0 con 0x7f2d1c06a770 2023-09-30T22:26:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.087+0000 7f2d0affd700 1 -- 172.21.15.154:0/176850095 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d0c013470 con 0x7f2d1c06a770 2023-09-30T22:26:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.087+0000 7f2d20aa0700 1 -- 172.21.15.154:0/176850095 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c11f060 con 0x7f2d1c06a770 2023-09-30T22:26:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.087+0000 7f2d0affd700 1 -- 172.21.15.154:0/176850095 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d0c012d90 con 0x7f2d1c06a770 2023-09-30T22:26:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.092+0000 7f2d0affd700 1 -- 172.21.15.154:0/176850095 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d0c021020 con 0x7f2d1c06a770 2023-09-30T22:26:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.113+0000 7f75ed545700 1 Processor -- start 2023-09-30T22:26:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.113+0000 7f75ed545700 1 -- start start 2023-09-30T22:26:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75ed545700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75e809e870 0x7f75e809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75ed545700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75ed545700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e809c970 con 0x7f75e8131d70 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75ed545700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e80a0920 con 0x7f75e809e870 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75ed545700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e809f9c0 con 0x7f75e809f180 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75e67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75e67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36104/0 (socket says 172.21.15.154:36104) 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75e67fc700 1 -- 172.21.15.154:0/2471047986 learned_addr learned my addr 172.21.15.154:0/2471047986 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75e6ffd700 1 --2- 172.21.15.154:0/2471047986 >> v2:172.21.15.154:3300/0 conn(0x7f75e809e870 0x7f75e809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75e67fc700 1 -- 172.21.15.154:0/2471047986 >> v2:172.21.15.154:3300/0 conn(0x7f75e809e870 msgr2=0x7f75e809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75e67fc700 1 --2- 172.21.15.154:0/2471047986 >> v2:172.21.15.154:3300/0 conn(0x7f75e809e870 0x7f75e809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75e67fc700 1 -- 172.21.15.154:0/2471047986 >> v1:172.21.15.154:6789/0 conn(0x7f75e8131d70 legacy=0x7f75e8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75e67fc700 1 -- 172.21.15.154:0/2471047986 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e809bab0 con 0x7f75e809f180 2023-09-30T22:26:30.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.114+0000 7f75e67fc700 1 --2- 172.21.15.154:0/2471047986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8131830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0098f0 tx=0x7f75dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7ae81aca4d070bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75e5ffb700 1 -- 172.21.15.154:0/2471047986 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00b8a0 con 0x7f75e809f180 2023-09-30T22:26:30.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75e5ffb700 1 -- 172.21.15.154:0/2471047986 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc00ba00 con 0x7f75e809f180 2023-09-30T22:26:30.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75e5ffb700 1 -- 172.21.15.154:0/2471047986 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00bd90 con 0x7f75e809f180 2023-09-30T22:26:30.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75ed545700 1 -- 172.21.15.154:0/2471047986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 msgr2=0x7f75e8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75ed545700 1 --2- 172.21.15.154:0/2471047986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8131830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0098f0 tx=0x7f75dc009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:30.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75ed545700 1 -- 172.21.15.154:0/2471047986 shutdown_connections 2023-09-30T22:26:30.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75ed545700 1 --2- 172.21.15.154:0/2471047986 >> v2:172.21.15.154:3300/0 conn(0x7f75e809e870 0x7f75e809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75ed545700 1 --2- 172.21.15.154:0/2471047986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8131830 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75ed545700 1 -- 172.21.15.154:0/2471047986 >> 172.21.15.154:0/2471047986 conn(0x7f75e80a4430 msgr2=0x7f75e80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75ed545700 1 -- 172.21.15.154:0/2471047986 shutdown_connections 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.115+0000 7f75ed545700 1 -- 172.21.15.154:0/2471047986 wait complete. 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.117+0000 7f75ed545700 1 Processor -- start 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.117+0000 7f75ed545700 1 -- start start 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.117+0000 7f75ed545700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e809e870 0x7f75e8120400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.117+0000 7f75ed545700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.117+0000 7f75ed545700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e8131d70 0x7f75e8120e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.117+0000 7f75ed545700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8123cd0 con 0x7f75e809e870 2023-09-30T22:26:30.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.117+0000 7f75ed545700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8123f20 con 0x7f75e8131d70 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.117+0000 7f75ed545700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81317a0 con 0x7f75e809f180 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.117+0000 7f75e77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e8131d70 0x7f75e8120e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e8131d70 0x7f75e8120e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55008/0 (socket says 172.21.15.154:55008) 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e77fe700 1 -- 172.21.15.154:0/1237112463 learned_addr learned my addr 172.21.15.154:0/1237112463 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e67fc700 1 --2- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8120940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e6ffd700 1 --2- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e809e870 0x7f75e8120400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e77fe700 1 -- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 msgr2=0x7f75e8120940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e77fe700 1 --2- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8120940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e77fe700 1 -- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e809e870 msgr2=0x7f75e8120400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e77fe700 1 --2- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e809e870 0x7f75e8120400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e77fe700 1 -- 172.21.15.154:0/1237112463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc009550 con 0x7f75e8131d70 2023-09-30T22:26:30.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75e77fe700 1 --2- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e8131d70 0x7f75e8120e80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f75e000cc50 tx=0x7f75e000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:30.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75cf7fe700 1 -- 172.21.15.154:0/1237112463 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0003c00 con 0x7f75e8131d70 2023-09-30T22:26:30.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75cf7fe700 1 -- 172.21.15.154:0/1237112463 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0003d60 con 0x7f75e8131d70 2023-09-30T22:26:30.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75cf7fe700 1 -- 172.21.15.154:0/1237112463 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e000ab60 con 0x7f75e8131d70 2023-09-30T22:26:30.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75ed545700 1 -- 172.21.15.154:0/1237112463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e809dc00 con 0x7f75e8131d70 2023-09-30T22:26:30.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.118+0000 7f75ed545700 1 -- 172.21.15.154:0/1237112463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e8123980 con 0x7f75e8131d70 2023-09-30T22:26:30.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.119+0000 7f75cf7fe700 1 -- 172.21.15.154:0/1237112463 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75e000acc0 con 0x7f75e8131d70 2023-09-30T22:26:30.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.119+0000 7f75ed545700 1 -- 172.21.15.154:0/1237112463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e804f2a0 con 0x7f75e8131d70 2023-09-30T22:26:30.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.120+0000 7f75cf7fe700 1 -- 172.21.15.154:0/1237112463 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f75e003f6b0 con 0x7f75e8131d70 2023-09-30T22:26:30.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.128+0000 7f75cf7fe700 1 -- 172.21.15.154:0/1237112463 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75e00198f0 con 0x7f75e8131d70 2023-09-30T22:26:30.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.204+0000 7fdd64747700 1 -- 172.21.15.154:0/3134286409 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdd5c06c3b0 con 0x7fdd5c09e170 2023-09-30T22:26:30.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.204+0000 7fdd52ffd700 1 -- 172.21.15.154:0/3134286409 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd4c015020 con 0x7fdd5c09e170 2023-09-30T22:26:30.206 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:30.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.206+0000 7fdd64747700 1 -- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 msgr2=0x7fdd5c120c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.206+0000 7fdd64747700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c120c30 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c013000 tx=0x7fdd4c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:30.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.207+0000 7fdd64747700 1 -- 172.21.15.154:0/3134286409 shutdown_connections 2023-09-30T22:26:30.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.207+0000 7fdd64747700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c130ce0 0x7fdd5c121170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.207+0000 7fdd64747700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd5c09d860 0x7fdd5c1206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.207+0000 7fdd64747700 1 --2- 172.21.15.154:0/3134286409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c09e170 0x7fdd5c120c30 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.207+0000 7fdd64747700 1 -- 172.21.15.154:0/3134286409 >> 172.21.15.154:0/3134286409 conn(0x7fdd5c099c40 msgr2=0x7fdd5c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.207+0000 7fdd64747700 1 -- 172.21.15.154:0/3134286409 shutdown_connections 2023-09-30T22:26:30.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.207+0000 7fdd64747700 1 -- 172.21.15.154:0/3134286409 wait complete. 2023-09-30T22:26:30.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:30.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.293+0000 7f2d20aa0700 1 -- 172.21.15.154:0/176850095 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d1c04f2a0 con 0x7f2d1c06a770 2023-09-30T22:26:30.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.294+0000 7f2d0affd700 1 -- 172.21.15.154:0/176850095 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d0c017070 con 0x7f2d1c06a770 2023-09-30T22:26:30.295 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.296+0000 7f2d20aa0700 1 -- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c06a770 msgr2=0x7f2d1c09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.296+0000 7f2d20aa0700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c06a770 0x7f2d1c09a490 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00ebe0 tx=0x7f2d0c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.296+0000 7f2d20aa0700 1 -- 172.21.15.154:0/176850095 shutdown_connections 2023-09-30T22:26:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.296+0000 7f2d20aa0700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d1c131a00 0x7f2d1c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.296+0000 7f2d20aa0700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d1c06a770 0x7f2d1c09a490 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.296+0000 7f2d20aa0700 1 --2- 172.21.15.154:0/176850095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d1c09dec0 0x7f2d1c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.296+0000 7f2d20aa0700 1 -- 172.21.15.154:0/176850095 >> 172.21.15.154:0/176850095 conn(0x7f2d1c099c40 msgr2=0x7f2d1c12ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.296+0000 7f2d20aa0700 1 -- 172.21.15.154:0/176850095 shutdown_connections 2023-09-30T22:26:30.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.296+0000 7f2d20aa0700 1 -- 172.21.15.154:0/176850095 wait complete. 2023-09-30T22:26:30.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.303+0000 7fe9595c0700 1 -- 172.21.15.154:0/497358014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe95411cbf0 con 0x7fe95409bc70 2023-09-30T22:26:30.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.304+0000 7fe93b7fe700 1 -- 172.21.15.154:0/497358014 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe95411cbf0 con 0x7fe95409bc70 2023-09-30T22:26:30.305 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.306+0000 7fe9595c0700 1 -- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 msgr2=0x7fe9541195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.306+0000 7fe9595c0700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe9541195f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe944000c00 tx=0x7fe944004750 comp rx=0 tx=0).stop 2023-09-30T22:26:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.306+0000 7fe9595c0700 1 -- 172.21.15.154:0/497358014 shutdown_connections 2023-09-30T22:26:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.306+0000 7fe9595c0700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe954131980 0x7fe95411a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.306+0000 7fe9595c0700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe95409bc70 0x7fe9541195f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.306+0000 7fe9595c0700 1 --2- 172.21.15.154:0/497358014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95409c5c0 0x7fe954119b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.306+0000 7fe9595c0700 1 -- 172.21.15.154:0/497358014 >> 172.21.15.154:0/497358014 conn(0x7fe9540a2980 msgr2=0x7fe95412e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.306+0000 7fe9595c0700 1 -- 172.21.15.154:0/497358014 shutdown_connections 2023-09-30T22:26:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.306+0000 7fe9595c0700 1 -- 172.21.15.154:0/497358014 wait complete. 2023-09-30T22:26:30.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:30.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:30.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.366+0000 7f75ed545700 1 -- 172.21.15.154:0/1237112463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75e80a2840 con 0x7f75e8131d70 2023-09-30T22:26:30.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.366+0000 7f75cf7fe700 1 -- 172.21.15.154:0/1237112463 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75e0019300 con 0x7f75e8131d70 2023-09-30T22:26:30.367 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:30.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.368+0000 7f75ed545700 1 -- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e8131d70 msgr2=0x7f75e8120e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:30.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.368+0000 7f75ed545700 1 --2- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e8131d70 0x7f75e8120e80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f75e000cc50 tx=0x7f75e000cf60 comp rx=0 tx=0).stop 2023-09-30T22:26:30.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.368+0000 7f75ed545700 1 -- 172.21.15.154:0/1237112463 shutdown_connections 2023-09-30T22:26:30.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.368+0000 7f75ed545700 1 --2- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e8131d70 0x7f75e8120e80 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.368+0000 7f75ed545700 1 --2- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e809e870 0x7f75e8120400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.368+0000 7f75ed545700 1 --2- 172.21.15.154:0/1237112463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e809f180 0x7f75e8120940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:30.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.368+0000 7f75ed545700 1 -- 172.21.15.154:0/1237112463 >> 172.21.15.154:0/1237112463 conn(0x7f75e80a4430 msgr2=0x7f75e80a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:30.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.368+0000 7f75ed545700 1 -- 172.21.15.154:0/1237112463 shutdown_connections 2023-09-30T22:26:30.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:30.369+0000 7f75ed545700 1 -- 172.21.15.154:0/1237112463 wait complete. 2023-09-30T22:26:30.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:31.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:31.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:31.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:31.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.355+0000 7f1947a27700 1 Processor -- start 2023-09-30T22:26:31.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1947a27700 1 -- start start 2023-09-30T22:26:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1947a27700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f1940133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1947a27700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1940099a60 0x7f19400a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1947a27700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19400a0e20 0x7f19400a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1947a27700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194009aa00 con 0x7f1940099a60 2023-09-30T22:26:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1947a27700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194009a080 con 0x7f19400a0e20 2023-09-30T22:26:31.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1947a27700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1940133750 con 0x7f1940133b80 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1944fc2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1940099a60 0x7f19400a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1944fc2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1940099a60 0x7f19400a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57856/0 (socket says 172.21.15.154:57856) 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1944fc2700 1 -- 172.21.15.154:0/1277587905 learned_addr learned my addr 172.21.15.154:0/1277587905 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f19457c3700 1 --2- 172.21.15.154:0/1277587905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f1940133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.356+0000 7f1945fc4700 1 --2- 172.21.15.154:0/1277587905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19400a0e20 0x7f19400a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.357+0000 7f19457c3700 1 -- 172.21.15.154:0/1277587905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19400a0e20 msgr2=0x7f19400a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.357+0000 7f19457c3700 1 --2- 172.21.15.154:0/1277587905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19400a0e20 0x7f19400a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.357+0000 7f19457c3700 1 -- 172.21.15.154:0/1277587905 >> v2:172.21.15.154:3300/0 conn(0x7f1940099a60 msgr2=0x7f19400a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.357+0000 7f19457c3700 1 --2- 172.21.15.154:0/1277587905 >> v2:172.21.15.154:3300/0 conn(0x7f1940099a60 0x7f19400a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.357+0000 7f19457c3700 1 -- 172.21.15.154:0/1277587905 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194009a760 con 0x7f1940133b80 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.357+0000 7f19457c3700 1 --2- 172.21.15.154:0/1277587905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f1940133f50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f193c009820 tx=0x7f193c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97c16ebc5996df32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.357+0000 7f1937fff700 1 -- 172.21.15.154:0/1277587905 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c005e30 con 0x7f1940133b80 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.357+0000 7f1937fff700 1 -- 172.21.15.154:0/1277587905 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c006030 con 0x7f1940133b80 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.357+0000 7f1937fff700 1 -- 172.21.15.154:0/1277587905 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c0063c0 con 0x7f1940133b80 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.358+0000 7f1947a27700 1 -- 172.21.15.154:0/1277587905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 msgr2=0x7f1940133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.358+0000 7f1947a27700 1 --2- 172.21.15.154:0/1277587905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f1940133f50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f193c009820 tx=0x7f193c009b30 comp rx=0 tx=0).stop 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.358+0000 7f1947a27700 1 -- 172.21.15.154:0/1277587905 shutdown_connections 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.358+0000 7f1947a27700 1 --2- 172.21.15.154:0/1277587905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19400a0e20 0x7f19400a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.358+0000 7f1947a27700 1 --2- 172.21.15.154:0/1277587905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f1940133f50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.358+0000 7f1947a27700 1 --2- 172.21.15.154:0/1277587905 >> v2:172.21.15.154:3300/0 conn(0x7f1940099a60 0x7f19400a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.358+0000 7f1947a27700 1 -- 172.21.15.154:0/1277587905 >> 172.21.15.154:0/1277587905 conn(0x7f19400a2980 msgr2=0x7f19400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.358+0000 7f1947a27700 1 -- 172.21.15.154:0/1277587905 shutdown_connections 2023-09-30T22:26:31.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.358+0000 7f1947a27700 1 -- 172.21.15.154:0/1277587905 wait complete. 2023-09-30T22:26:31.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.359+0000 7f1947a27700 1 Processor -- start 2023-09-30T22:26:31.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.359+0000 7f1947a27700 1 -- start start 2023-09-30T22:26:31.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.359+0000 7f1947a27700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1940099a60 0x7f194011b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.359+0000 7f1947a27700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19400a0e20 0x7f194011bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.359+0000 7f1947a27700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f194011c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.359+0000 7f1947a27700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194011d290 con 0x7f19400a0e20 2023-09-30T22:26:31.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.359+0000 7f1947a27700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194011d8b0 con 0x7f1940099a60 2023-09-30T22:26:31.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.359+0000 7f1947a27700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f194011e4e0 con 0x7f1940133b80 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.359+0000 7f19457c3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1940099a60 0x7f194011b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f19457c3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1940099a60 0x7f194011b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55022/0 (socket says 172.21.15.154:55022) 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f19457c3700 1 -- 172.21.15.154:0/597739108 learned_addr learned my addr 172.21.15.154:0/597739108 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1945fc4700 1 --2- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f194011c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1944fc2700 1 --2- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19400a0e20 0x7f194011bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1945fc4700 1 -- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1940099a60 msgr2=0x7f194011b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1945fc4700 1 --2- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1940099a60 0x7f194011b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1945fc4700 1 -- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19400a0e20 msgr2=0x7f194011bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1945fc4700 1 --2- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19400a0e20 0x7f194011bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1945fc4700 1 -- 172.21.15.154:0/597739108 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c009430 con 0x7f1940133b80 2023-09-30T22:26:31.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1945fc4700 1 --2- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f194011c150 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f193800efc0 tx=0x7f193800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1935ffb700 1 -- 172.21.15.154:0/597739108 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800cc90 con 0x7f1940133b80 2023-09-30T22:26:31.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1935ffb700 1 -- 172.21.15.154:0/597739108 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193800f040 con 0x7f1940133b80 2023-09-30T22:26:31.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1947a27700 1 -- 172.21.15.154:0/597739108 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194011cb50 con 0x7f1940133b80 2023-09-30T22:26:31.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.360+0000 7f1935ffb700 1 -- 172.21.15.154:0/597739108 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938009e60 con 0x7f1940133b80 2023-09-30T22:26:31.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.361+0000 7f1947a27700 1 -- 172.21.15.154:0/597739108 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1940130b70 con 0x7f1940133b80 2023-09-30T22:26:31.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.362+0000 7f1935ffb700 1 -- 172.21.15.154:0/597739108 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1938014480 con 0x7f1940133b80 2023-09-30T22:26:31.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.362+0000 7f1935ffb700 1 -- 172.21.15.154:0/597739108 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1938040240 con 0x7f1940133b80 2023-09-30T22:26:31.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.362+0000 7f1947a27700 1 -- 172.21.15.154:0/597739108 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194004f2a0 con 0x7f1940133b80 2023-09-30T22:26:31.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.367+0000 7f1935ffb700 1 -- 172.21.15.154:0/597739108 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1938018070 con 0x7f1940133b80 2023-09-30T22:26:31.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:31.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.443+0000 7f23cf7fd700 1 Processor -- start 2023-09-30T22:26:31.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.443+0000 7f23cf7fd700 1 -- start start 2023-09-30T22:26:31.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23cf7fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c809e3d0 0x7f23c813d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23cf7fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c813d830 0x7f23c813fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23cf7fd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c8098680 con 0x7f23c809d8f0 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23cf7fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8099560 con 0x7f23c809e3d0 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23cf7fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8098bb0 con 0x7f23c813d830 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23cdd9a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c813d830 0x7f23c813fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23cd599700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f23c809d8f0 0x7f23c809dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37774/0 (socket says 172.21.15.154:37774) 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23ccd98700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c809e3d0 0x7f23c813d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23cd599700 1 -- 172.21.15.154:0/3748333722 learned_addr learned my addr 172.21.15.154:0/3748333722 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23ccd98700 1 -- 172.21.15.154:0/3748333722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c813d830 msgr2=0x7f23c813fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23ccd98700 1 --2- 172.21.15.154:0/3748333722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c813d830 0x7f23c813fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23ccd98700 1 -- 172.21.15.154:0/3748333722 >> v1:172.21.15.154:6789/0 conn(0x7f23c809d8f0 legacy=0x7f23c809dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23ccd98700 1 -- 172.21.15.154:0/3748333722 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80980f0 con 0x7f23c809e3d0 2023-09-30T22:26:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23cdd9a700 1 --2- 172.21.15.154:0/3748333722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c813d830 0x7f23c813fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.444+0000 7f23ccd98700 1 --2- 172.21.15.154:0/3748333722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c809e3d0 0x7f23c813d2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009870 tx=0x7f23b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8da6eb5edcb4034e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23bffff700 1 -- 172.21.15.154:0/3748333722 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8011830 con 0x7f23c809e3d0 2023-09-30T22:26:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23bffff700 1 -- 172.21.15.154:0/3748333722 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b8011990 con 0x7f23c809e3d0 2023-09-30T22:26:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23bffff700 1 -- 172.21.15.154:0/3748333722 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8011d20 con 0x7f23c809e3d0 2023-09-30T22:26:31.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23cf7fd700 1 -- 172.21.15.154:0/3748333722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c809e3d0 msgr2=0x7f23c813d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23cf7fd700 1 --2- 172.21.15.154:0/3748333722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c809e3d0 0x7f23c813d2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009870 tx=0x7f23b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:31.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23cf7fd700 1 -- 172.21.15.154:0/3748333722 shutdown_connections 2023-09-30T22:26:31.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23cf7fd700 1 --2- 172.21.15.154:0/3748333722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c813d830 0x7f23c813fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23cf7fd700 1 --2- 172.21.15.154:0/3748333722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c809e3d0 0x7f23c813d2f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23cf7fd700 1 -- 172.21.15.154:0/3748333722 >> 172.21.15.154:0/3748333722 conn(0x7f23c80a2b30 msgr2=0x7f23c809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23cf7fd700 1 -- 172.21.15.154:0/3748333722 shutdown_connections 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.445+0000 7f23cf7fd700 1 -- 172.21.15.154:0/3748333722 wait complete. 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.446+0000 7f23cf7fd700 1 Processor -- start 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.446+0000 7f23cf7fd700 1 -- start start 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cf7fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c809d8f0 0x7f23c81ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cf7fd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c809e3d0 0x7f23c81cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cf7fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c813d830 0x7f23c81cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cf7fd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8070760 con 0x7f23c809e3d0 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cf7fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8098df0 con 0x7f23c813d830 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cf7fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8072240 con 0x7f23c809d8f0 2023-09-30T22:26:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cd599700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c809d8f0 0x7f23c81ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cd599700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c809d8f0 0x7f23c81ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36150/0 (socket says 172.21.15.154:36150) 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cd599700 1 -- 172.21.15.154:0/2380215672 learned_addr learned my addr 172.21.15.154:0/2380215672 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cdd9a700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c813d830 0x7f23c81cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23ccd98700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c809e3d0 0x7f23c81cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cd599700 1 -- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c813d830 msgr2=0x7f23c81cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cd599700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c813d830 0x7f23c81cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cd599700 1 -- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c809e3d0 msgr2=0x7f23c81cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cd599700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c809e3d0 0x7f23c81cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cd599700 1 -- 172.21.15.154:0/2380215672 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0009a70 con 0x7f23c809d8f0 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23cdd9a700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c813d830 0x7f23c81cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.447+0000 7f23ccd98700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c809e3d0 0x7f23c81cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:31.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.448+0000 7f23cd599700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c809d8f0 0x7f23c81ccb20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f23c400c700 tx=0x7f23c400cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.448+0000 7f23bdffb700 1 -- 172.21.15.154:0/2380215672 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c40074e0 con 0x7f23c809d8f0 2023-09-30T22:26:31.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.448+0000 7f23bdffb700 1 -- 172.21.15.154:0/2380215672 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c4007640 con 0x7f23c809d8f0 2023-09-30T22:26:31.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.448+0000 7f23cf7fd700 1 -- 172.21.15.154:0/2380215672 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b80094a0 con 0x7f23c809d8f0 2023-09-30T22:26:31.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.448+0000 7f23bdffb700 1 -- 172.21.15.154:0/2380215672 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c4005a30 con 0x7f23c809d8f0 2023-09-30T22:26:31.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.448+0000 7f23cf7fd700 1 -- 172.21.15.154:0/2380215672 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c80a10d0 con 0x7f23c809d8f0 2023-09-30T22:26:31.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.449+0000 7f23cf7fd700 1 -- 172.21.15.154:0/2380215672 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c8097f20 con 0x7f23c809d8f0 2023-09-30T22:26:31.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.450+0000 7f23bdffb700 1 -- 172.21.15.154:0/2380215672 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23c4005b90 con 0x7f23c809d8f0 2023-09-30T22:26:31.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.450+0000 7f23bdffb700 1 -- 172.21.15.154:0/2380215672 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f23c403efe0 con 0x7f23c809d8f0 2023-09-30T22:26:31.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.458+0000 7f23bdffb700 1 -- 172.21.15.154:0/2380215672 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23c401b3b0 con 0x7f23c809d8f0 2023-09-30T22:26:31.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.488+0000 7fafcec39700 1 Processor -- start 2023-09-30T22:26:31.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafcec39700 1 -- start start 2023-09-30T22:26:31.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafcec39700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809e870 0x7fafc809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafcec39700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fafc809f180 0x7fafc8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafcec39700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc809c970 con 0x7fafc8131d70 2023-09-30T22:26:31.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafcec39700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc80a0920 con 0x7fafc809f180 2023-09-30T22:26:31.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafcec39700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafc809f9c0 con 0x7fafc809e870 2023-09-30T22:26:31.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafcd1d6700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fafc8131d70 0x7fafc8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37780/0 (socket says 172.21.15.154:37780) 2023-09-30T22:26:31.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafcd1d6700 1 -- 172.21.15.154:0/3616481607 learned_addr learned my addr 172.21.15.154:0/3616481607 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:31.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafc7fff700 1 --2- 172.21.15.154:0/3616481607 >> v2:172.21.15.154:3300/0 conn(0x7fafc809f180 0x7fafc8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.489+0000 7fafcc9d5700 1 --2- 172.21.15.154:0/3616481607 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809e870 0x7fafc809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.490+0000 7fafc7fff700 1 -- 172.21.15.154:0/3616481607 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809e870 msgr2=0x7fafc809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.490+0000 7fafc7fff700 1 --2- 172.21.15.154:0/3616481607 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809e870 0x7fafc809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.490+0000 7fafc7fff700 1 -- 172.21.15.154:0/3616481607 >> v1:172.21.15.154:6789/0 conn(0x7fafc8131d70 legacy=0x7fafc8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.490+0000 7fafc7fff700 1 -- 172.21.15.154:0/3616481607 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc809bab0 con 0x7fafc809f180 2023-09-30T22:26:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.490+0000 7fafc7fff700 1 --2- 172.21.15.154:0/3616481607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc809f180 0x7fafc8131830 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009840 tx=0x7fafb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a7311fdc7b0d41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.490+0000 7fafc77fe700 1 -- 172.21.15.154:0/3616481607 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011830 con 0x7fafc809f180 2023-09-30T22:26:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.490+0000 7fafc77fe700 1 -- 172.21.15.154:0/3616481607 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb4011990 con 0x7fafc809f180 2023-09-30T22:26:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.490+0000 7fafc77fe700 1 -- 172.21.15.154:0/3616481607 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4011d20 con 0x7fafc809f180 2023-09-30T22:26:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.491+0000 7fafcec39700 1 -- 172.21.15.154:0/3616481607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc809f180 msgr2=0x7fafc8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.491+0000 7fafcec39700 1 --2- 172.21.15.154:0/3616481607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc809f180 0x7fafc8131830 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009840 tx=0x7fafb4009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.491+0000 7fafcec39700 1 -- 172.21.15.154:0/3616481607 shutdown_connections 2023-09-30T22:26:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.491+0000 7fafcec39700 1 --2- 172.21.15.154:0/3616481607 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809e870 0x7fafc809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.491+0000 7fafcec39700 1 --2- 172.21.15.154:0/3616481607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc809f180 0x7fafc8131830 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.491+0000 7fafcec39700 1 -- 172.21.15.154:0/3616481607 >> 172.21.15.154:0/3616481607 conn(0x7fafc80a4430 msgr2=0x7fafc80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.491+0000 7fafcec39700 1 -- 172.21.15.154:0/3616481607 shutdown_connections 2023-09-30T22:26:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.491+0000 7fafcec39700 1 -- 172.21.15.154:0/3616481607 wait complete. 2023-09-30T22:26:31.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.492+0000 7fafcec39700 1 Processor -- start 2023-09-30T22:26:31.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.492+0000 7fafcec39700 1 -- start start 2023-09-30T22:26:31.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.493+0000 7fafcec39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafc809e870 0x7fafc81206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.493+0000 7fafcec39700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809f180 0x7fafc8120bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.493+0000 7fafcec39700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc8131d70 0x7fafc8121130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.493+0000 7fafcec39700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8122220 con 0x7fafc8131d70 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.493+0000 7fafcec39700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc809b160 con 0x7fafc809e870 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.493+0000 7fafcec39700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafc809dba0 con 0x7fafc809f180 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.493+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809f180 0x7fafc8120bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809f180 0x7fafc8120bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36158/0 (socket says 172.21.15.154:36158) 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc7fff700 1 -- 172.21.15.154:0/1150120733 learned_addr learned my addr 172.21.15.154:0/1150120733 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafcd1d6700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc8131d70 0x7fafc8121130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafcc9d5700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafc809e870 0x7fafc81206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc7fff700 1 -- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafc809e870 msgr2=0x7fafc81206b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc7fff700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafc809e870 0x7fafc81206b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc7fff700 1 -- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc8131d70 msgr2=0x7fafc8121130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc7fff700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc8131d70 0x7fafc8121130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc7fff700 1 -- 172.21.15.154:0/1150120733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb40094a0 con 0x7fafc809f180 2023-09-30T22:26:31.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafcd1d6700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc8131d70 0x7fafc8121130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafcc9d5700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafc809e870 0x7fafc81206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc7fff700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809f180 0x7fafc8120bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fafb40090b0 tx=0x7fafb4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc57fa700 1 -- 172.21.15.154:0/1150120733 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40036a0 con 0x7fafc809f180 2023-09-30T22:26:31.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc57fa700 1 -- 172.21.15.154:0/1150120733 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb401f070 con 0x7fafc809f180 2023-09-30T22:26:31.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafc57fa700 1 -- 172.21.15.154:0/1150120733 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4003a60 con 0x7fafc809f180 2023-09-30T22:26:31.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.494+0000 7fafcec39700 1 -- 172.21.15.154:0/1150120733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc8131560 con 0x7fafc809f180 2023-09-30T22:26:31.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.495+0000 7fafcec39700 1 -- 172.21.15.154:0/1150120733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc8124630 con 0x7fafc809f180 2023-09-30T22:26:31.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.495+0000 7fafcec39700 1 -- 172.21.15.154:0/1150120733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc804f2a0 con 0x7fafc809f180 2023-09-30T22:26:31.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.496+0000 7fafc57fa700 1 -- 172.21.15.154:0/1150120733 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafb4003bc0 con 0x7fafc809f180 2023-09-30T22:26:31.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.496+0000 7fafc57fa700 1 -- 172.21.15.154:0/1150120733 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fafb4021070 con 0x7fafc809f180 2023-09-30T22:26:31.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.505+0000 7fafc57fa700 1 -- 172.21.15.154:0/1150120733 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafb402fd70 con 0x7fafc809f180 2023-09-30T22:26:31.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.515+0000 7ff6a1a59700 1 Processor -- start 2023-09-30T22:26:31.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.515+0000 7ff6a1a59700 1 -- start start 2023-09-30T22:26:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.515+0000 7ff6a1a59700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134140 0x7ff69c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.515+0000 7ff6a1a59700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c134570 0x7ff69c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.515+0000 7ff6a1a59700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c09b110 con 0x7ff69c09ad40 2023-09-30T22:26:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.515+0000 7ff6a1a59700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0a3b60 con 0x7ff69c134570 2023-09-30T22:26:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.515+0000 7ff6a1a59700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0a1a80 con 0x7ff69c134140 2023-09-30T22:26:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff69c09ad40 0x7ff69c133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37792/0 (socket says 172.21.15.154:37792) 2023-09-30T22:26:31.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69affd700 1 -- 172.21.15.154:0/61028287 learned_addr learned my addr 172.21.15.154:0/61028287 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69b7fe700 1 --2- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c134570 0x7ff69c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69a7fc700 1 --2- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134140 0x7ff69c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff699ffb700 1 -- 172.21.15.154:0/61028287 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898766850 0 0) 0x7ff69c09b110 con 0x7ff69c09ad40 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff699ffb700 1 -- 172.21.15.154:0/61028287 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6840035b0 con 0x7ff69c09ad40 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69a7fc700 1 -- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c134570 msgr2=0x7ff69c13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69a7fc700 1 --2- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c134570 0x7ff69c13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69a7fc700 1 -- 172.21.15.154:0/61028287 >> v1:172.21.15.154:6789/0 conn(0x7ff69c09ad40 legacy=0x7ff69c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69a7fc700 1 -- 172.21.15.154:0/61028287 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0a2fa0 con 0x7ff69c134140 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69b7fe700 1 --2- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c134570 0x7ff69c13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:31.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff69a7fc700 1 --2- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134140 0x7ff69c138e80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff690009870 tx=0x7ff690009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9234d9f2ced0bac2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.516+0000 7ff699ffb700 1 -- 172.21.15.154:0/61028287 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690011830 con 0x7ff69c134140 2023-09-30T22:26:31.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff699ffb700 1 -- 172.21.15.154:0/61028287 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff690011990 con 0x7ff69c134140 2023-09-30T22:26:31.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff699ffb700 1 -- 172.21.15.154:0/61028287 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690011d20 con 0x7ff69c134140 2023-09-30T22:26:31.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff6a1a59700 1 -- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134140 msgr2=0x7ff69c138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff6a1a59700 1 --2- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134140 0x7ff69c138e80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff690009870 tx=0x7ff690009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:31.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff6a1a59700 1 -- 172.21.15.154:0/61028287 shutdown_connections 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff6a1a59700 1 --2- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c134570 0x7ff69c13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff6a1a59700 1 --2- 172.21.15.154:0/61028287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134140 0x7ff69c138e80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff6a1a59700 1 -- 172.21.15.154:0/61028287 >> 172.21.15.154:0/61028287 conn(0x7ff69c099c40 msgr2=0x7ff69c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff6a1a59700 1 -- 172.21.15.154:0/61028287 shutdown_connections 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.517+0000 7ff6a1a59700 1 -- 172.21.15.154:0/61028287 wait complete. 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.518+0000 7ff6a1a59700 1 Processor -- start 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.518+0000 7ff6a1a59700 1 -- start start 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff6a1a59700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c09ad40 0x7ff69c139430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff6a1a59700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c134140 0x7ff69c139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff6a1a59700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134570 0x7ff69c139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff6a1a59700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c11ed70 con 0x7ff69c134140 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff6a1a59700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c11e500 con 0x7ff69c09ad40 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff6a1a59700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c09c7e0 con 0x7ff69c134570 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69a7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c134140 0x7ff69c139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69a7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c134140 0x7ff69c139970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57920/0 (socket says 172.21.15.154:57920) 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69a7fc700 1 -- 172.21.15.154:0/1443932748 learned_addr learned my addr 172.21.15.154:0/1443932748 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69b7fe700 1 --2- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134570 0x7ff69c139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69affd700 1 --2- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c09ad40 0x7ff69c139430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69a7fc700 1 -- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134570 msgr2=0x7ff69c139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69a7fc700 1 --2- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134570 0x7ff69c139eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69a7fc700 1 -- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c09ad40 msgr2=0x7ff69c139430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69a7fc700 1 --2- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c09ad40 0x7ff69c139430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69a7fc700 1 -- 172.21.15.154:0/1443932748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009a70 con 0x7ff69c134140 2023-09-30T22:26:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.519+0000 7ff69a7fc700 1 --2- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c134140 0x7ff69c139970 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7ff690009840 tx=0x7ff690004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.520+0000 7ff683fff700 1 -- 172.21.15.154:0/1443932748 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690004450 con 0x7ff69c134140 2023-09-30T22:26:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.520+0000 7ff683fff700 1 -- 172.21.15.154:0/1443932748 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69001f070 con 0x7ff69c134140 2023-09-30T22:26:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.520+0000 7ff6a1a59700 1 -- 172.21.15.154:0/1443932748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6900094a0 con 0x7ff69c134140 2023-09-30T22:26:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.520+0000 7ff683fff700 1 -- 172.21.15.154:0/1443932748 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900038c0 con 0x7ff69c134140 2023-09-30T22:26:31.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.520+0000 7ff6a1a59700 1 -- 172.21.15.154:0/1443932748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c09e3c0 con 0x7ff69c134140 2023-09-30T22:26:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.521+0000 7ff683fff700 1 -- 172.21.15.154:0/1443932748 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff690003a20 con 0x7ff69c134140 2023-09-30T22:26:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.521+0000 7ff683fff700 1 -- 172.21.15.154:0/1443932748 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff690021070 con 0x7ff69c134140 2023-09-30T22:26:31.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.521+0000 7ff6a1a59700 1 -- 172.21.15.154:0/1443932748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c11e730 con 0x7ff69c134140 2023-09-30T22:26:31.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.526+0000 7ff683fff700 1 -- 172.21.15.154:0/1443932748 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff69c11e730 con 0x7ff69c134140 2023-09-30T22:26:31.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.569+0000 7f1947a27700 1 -- 172.21.15.154:0/597739108 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f194011eb60 con 0x7f1940133b80 2023-09-30T22:26:31.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.570+0000 7f1935ffb700 1 -- 172.21.15.154:0/597739108 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f193802c090 con 0x7f1940133b80 2023-09-30T22:26:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:31.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.572+0000 7f1947a27700 1 -- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 msgr2=0x7f194011c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.572+0000 7f1947a27700 1 --2- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f194011c150 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f193800efc0 tx=0x7f193800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.572+0000 7f1947a27700 1 -- 172.21.15.154:0/597739108 shutdown_connections 2023-09-30T22:26:31.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.572+0000 7f1947a27700 1 --2- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1940133b80 0x7f194011c150 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.572+0000 7f1947a27700 1 --2- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1940099a60 0x7f194011b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.572+0000 7f1947a27700 1 --2- 172.21.15.154:0/597739108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19400a0e20 0x7f194011bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.572+0000 7f1947a27700 1 -- 172.21.15.154:0/597739108 >> 172.21.15.154:0/597739108 conn(0x7f19400a2980 msgr2=0x7f19401bafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.573+0000 7f1947a27700 1 -- 172.21.15.154:0/597739108 shutdown_connections 2023-09-30T22:26:31.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.573+0000 7f1947a27700 1 -- 172.21.15.154:0/597739108 wait complete. 2023-09-30T22:26:31.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:31.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.659+0000 7f23cf7fd700 1 -- 172.21.15.154:0/2380215672 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f23c804f2a0 con 0x7f23c809d8f0 2023-09-30T22:26:31.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.659+0000 7f23bdffb700 1 -- 172.21.15.154:0/2380215672 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23c4017030 con 0x7f23c809d8f0 2023-09-30T22:26:31.661 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.662+0000 7f23cf7fd700 1 -- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c809d8f0 msgr2=0x7f23c81ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.662+0000 7f23cf7fd700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c809d8f0 0x7f23c81ccb20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f23c400c700 tx=0x7f23c400cac0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.662+0000 7f23cf7fd700 1 -- 172.21.15.154:0/2380215672 shutdown_connections 2023-09-30T22:26:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.662+0000 7f23cf7fd700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23c813d830 0x7f23c81cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.662+0000 7f23cf7fd700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23c809d8f0 0x7f23c81ccb20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.662+0000 7f23cf7fd700 1 --2- 172.21.15.154:0/2380215672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23c809e3d0 0x7f23c81cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.662+0000 7f23cf7fd700 1 -- 172.21.15.154:0/2380215672 >> 172.21.15.154:0/2380215672 conn(0x7f23c80a2b30 msgr2=0x7f23c813b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.662+0000 7f23cf7fd700 1 -- 172.21.15.154:0/2380215672 shutdown_connections 2023-09-30T22:26:31.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.662+0000 7f23cf7fd700 1 -- 172.21.15.154:0/2380215672 wait complete. 2023-09-30T22:26:31.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:31.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.702+0000 7fafcec39700 1 -- 172.21.15.154:0/1150120733 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fafc8123cb0 con 0x7fafc809f180 2023-09-30T22:26:31.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.702+0000 7fafc57fa700 1 -- 172.21.15.154:0/1150120733 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafb4035090 con 0x7fafc809f180 2023-09-30T22:26:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:31.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.704+0000 7fafcec39700 1 -- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809f180 msgr2=0x7fafc8120bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.704+0000 7fafcec39700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809f180 0x7fafc8120bf0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fafb40090b0 tx=0x7fafb4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.704+0000 7fafcec39700 1 -- 172.21.15.154:0/1150120733 shutdown_connections 2023-09-30T22:26:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.704+0000 7fafcec39700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc8131d70 0x7fafc8121130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.704+0000 7fafcec39700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafc809e870 0x7fafc81206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.704+0000 7fafcec39700 1 --2- 172.21.15.154:0/1150120733 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fafc809f180 0x7fafc8120bf0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.704+0000 7fafcec39700 1 -- 172.21.15.154:0/1150120733 >> 172.21.15.154:0/1150120733 conn(0x7fafc80a4430 msgr2=0x7fafc811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.705+0000 7fafcec39700 1 -- 172.21.15.154:0/1150120733 shutdown_connections 2023-09-30T22:26:31.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.705+0000 7fafcec39700 1 -- 172.21.15.154:0/1150120733 wait complete. 2023-09-30T22:26:31.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.721+0000 7ff6a1a59700 1 -- 172.21.15.154:0/1443932748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff69c11e730 con 0x7ff69c134140 2023-09-30T22:26:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.721+0000 7ff683fff700 1 -- 172.21.15.154:0/1443932748 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff69c11e730 con 0x7ff69c134140 2023-09-30T22:26:31.722 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:31.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.723+0000 7ff6a1a59700 1 -- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c134140 msgr2=0x7ff69c139970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:31.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.723+0000 7ff6a1a59700 1 --2- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c134140 0x7ff69c139970 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7ff690009840 tx=0x7ff690004750 comp rx=0 tx=0).stop 2023-09-30T22:26:31.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.723+0000 7ff6a1a59700 1 -- 172.21.15.154:0/1443932748 shutdown_connections 2023-09-30T22:26:31.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.723+0000 7ff6a1a59700 1 --2- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff69c134570 0x7ff69c139eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.723+0000 7ff6a1a59700 1 --2- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69c09ad40 0x7ff69c139430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.723+0000 7ff6a1a59700 1 --2- 172.21.15.154:0/1443932748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff69c134140 0x7ff69c139970 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:31.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.723+0000 7ff6a1a59700 1 -- 172.21.15.154:0/1443932748 >> 172.21.15.154:0/1443932748 conn(0x7ff69c099c40 msgr2=0x7ff69c13afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:31.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.724+0000 7ff6a1a59700 1 -- 172.21.15.154:0/1443932748 shutdown_connections 2023-09-30T22:26:31.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:31.724+0000 7ff6a1a59700 1 -- 172.21.15.154:0/1443932748 wait complete. 2023-09-30T22:26:31.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:32.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:32.676 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:32.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:32.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.719+0000 7febae2b5700 1 Processor -- start 2023-09-30T22:26:32.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.719+0000 7febae2b5700 1 -- start start 2023-09-30T22:26:32.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7febae2b5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809e870 0x7feba809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7febae2b5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba8131f40 0x7feba8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7febae2b5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba809c970 con 0x7feba809f180 2023-09-30T22:26:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7febae2b5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba80a0920 con 0x7feba8131f40 2023-09-30T22:26:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7febae2b5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba809f9c0 con 0x7feba809e870 2023-09-30T22:26:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7feba7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809e870 0x7feba809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7febac852700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba8131f40 0x7feba8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7feba7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809e870 0x7feba809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36180/0 (socket says 172.21.15.154:36180) 2023-09-30T22:26:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7feba7fff700 1 -- 172.21.15.154:0/3574857701 learned_addr learned my addr 172.21.15.154:0/3574857701 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:32.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.720+0000 7febac852700 1 --2- 172.21.15.154:0/3574857701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba8131f40 0x7feba8139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55080/0 (socket says 172.21.15.154:55080) 2023-09-30T22:26:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7febac852700 1 -- 172.21.15.154:0/3574857701 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809e870 msgr2=0x7feba809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7febac852700 1 --2- 172.21.15.154:0/3574857701 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809e870 0x7feba809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7febac852700 1 -- 172.21.15.154:0/3574857701 >> v1:172.21.15.154:6789/0 conn(0x7feba809f180 legacy=0x7feba8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7feba6ffd700 1 -- 172.21.15.154:0/3574857701 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559578602 0 0) 0x7feba809c970 con 0x7feba809f180 2023-09-30T22:26:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7febac852700 1 -- 172.21.15.154:0/3574857701 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba809bab0 con 0x7feba8131f40 2023-09-30T22:26:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7feba7fff700 1 --2- 172.21.15.154:0/3574857701 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809e870 0x7feba809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7febac852700 1 --2- 172.21.15.154:0/3574857701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba8131f40 0x7feba8139ca0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7feba0009dc0 tx=0x7feba000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a22010114598266 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7feba6ffd700 1 -- 172.21.15.154:0/3574857701 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba000e070 con 0x7feba8131f40 2023-09-30T22:26:32.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7feba6ffd700 1 -- 172.21.15.154:0/3574857701 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba000bb20 con 0x7feba8131f40 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.721+0000 7feba6ffd700 1 -- 172.21.15.154:0/3574857701 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0012430 con 0x7feba8131f40 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.722+0000 7febae2b5700 1 -- 172.21.15.154:0/3574857701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba8131f40 msgr2=0x7feba8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.722+0000 7febae2b5700 1 --2- 172.21.15.154:0/3574857701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba8131f40 0x7feba8139ca0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7feba0009dc0 tx=0x7feba000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.722+0000 7febae2b5700 1 -- 172.21.15.154:0/3574857701 shutdown_connections 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.722+0000 7febae2b5700 1 --2- 172.21.15.154:0/3574857701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba8131f40 0x7feba8139ca0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.722+0000 7febae2b5700 1 --2- 172.21.15.154:0/3574857701 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809e870 0x7feba809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.722+0000 7febae2b5700 1 -- 172.21.15.154:0/3574857701 >> 172.21.15.154:0/3574857701 conn(0x7feba80a4430 msgr2=0x7feba80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.722+0000 7febae2b5700 1 -- 172.21.15.154:0/3574857701 shutdown_connections 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.722+0000 7febae2b5700 1 -- 172.21.15.154:0/3574857701 wait complete. 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.723+0000 7febae2b5700 1 Processor -- start 2023-09-30T22:26:32.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.723+0000 7febae2b5700 1 -- start start 2023-09-30T22:26:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.723+0000 7febae2b5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba809e870 0x7feba811ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.723+0000 7febae2b5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809f180 0x7feba8120500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.723+0000 7febae2b5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8131f40 0x7feba8120a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.723+0000 7febae2b5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba8122e20 con 0x7feba8131f40 2023-09-30T22:26:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.723+0000 7febae2b5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba8121d50 con 0x7feba809e870 2023-09-30T22:26:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.723+0000 7febae2b5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba8122a60 con 0x7feba809f180 2023-09-30T22:26:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809f180 0x7feba8120500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809f180 0x7feba8120500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36188/0 (socket says 172.21.15.154:36188) 2023-09-30T22:26:32.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba77fe700 1 -- 172.21.15.154:0/1500414165 learned_addr learned my addr 172.21.15.154:0/1500414165 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:32.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba7fff700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba809e870 0x7feba811ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7febac852700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8131f40 0x7feba8120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba77fe700 1 -- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba809e870 msgr2=0x7feba811ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba77fe700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba809e870 0x7feba811ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba77fe700 1 -- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8131f40 msgr2=0x7feba8120a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba77fe700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8131f40 0x7feba8120a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba77fe700 1 -- 172.21.15.154:0/1500414165 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009550 con 0x7feba809f180 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba7fff700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba809e870 0x7feba811ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba77fe700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809f180 0x7feba8120500 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00c550 tx=0x7feb9c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba4ff9700 1 -- 172.21.15.154:0/1500414165 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0054e0 con 0x7feba809f180 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba4ff9700 1 -- 172.21.15.154:0/1500414165 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c003680 con 0x7feba809f180 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7febae2b5700 1 -- 172.21.15.154:0/1500414165 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba0009a70 con 0x7feba809f180 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.724+0000 7feba4ff9700 1 -- 172.21.15.154:0/1500414165 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c003a30 con 0x7feba809f180 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.725+0000 7febae2b5700 1 -- 172.21.15.154:0/1500414165 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba8123540 con 0x7feba809f180 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.725+0000 7feba4ff9700 1 -- 172.21.15.154:0/1500414165 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb9c003b90 con 0x7feba809f180 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.726+0000 7feba4ff9700 1 -- 172.21.15.154:0/1500414165 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb9c03eac0 con 0x7feba809f180 2023-09-30T22:26:32.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.726+0000 7febae2b5700 1 -- 172.21.15.154:0/1500414165 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba804f2a0 con 0x7feba809f180 2023-09-30T22:26:32.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.730+0000 7feba4ff9700 1 -- 172.21.15.154:0/1500414165 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb9c017020 con 0x7feba809f180 2023-09-30T22:26:32.737 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:32.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.819+0000 7fdb90beb700 1 Processor -- start 2023-09-30T22:26:32.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.819+0000 7fdb90beb700 1 -- start start 2023-09-30T22:26:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.819+0000 7fdb90beb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09f350 0x7fdb8c138f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb90beb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb8c139480 0x7fdb8c13b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb90beb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c06bec0 con 0x7fdb8c09e870 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb90beb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8c06ce60 con 0x7fdb8c139480 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb90beb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c09f740 con 0x7fdb8c09f350 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb89d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09f350 0x7fdb8c138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb89d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09f350 0x7fdb8c138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55102/0 (socket says 172.21.15.154:55102) 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb89d9b700 1 -- 172.21.15.154:0/2094041241 learned_addr learned my addr 172.21.15.154:0/2094041241 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb8ad9d700 1 --2- 172.21.15.154:0/2094041241 >> v2:172.21.15.154:3300/0 conn(0x7fdb8c139480 0x7fdb8c13b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb89d9b700 1 -- 172.21.15.154:0/2094041241 >> v2:172.21.15.154:3300/0 conn(0x7fdb8c139480 msgr2=0x7fdb8c13b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb89d9b700 1 --2- 172.21.15.154:0/2094041241 >> v2:172.21.15.154:3300/0 conn(0x7fdb8c139480 0x7fdb8c13b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb89d9b700 1 -- 172.21.15.154:0/2094041241 >> v1:172.21.15.154:6789/0 conn(0x7fdb8c09e870 legacy=0x7fdb8c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb89d9b700 1 -- 172.21.15.154:0/2094041241 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c09fa00 con 0x7fdb8c09f350 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb89d9b700 1 --2- 172.21.15.154:0/2094041241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09f350 0x7fdb8c138f40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009920 tx=0x7fdb80009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e63317beaff1241 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.820+0000 7fdb8959a700 1 -- 172.21.15.154:0/2094041241 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb80011830 con 0x7fdb8c09f350 2023-09-30T22:26:32.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.821+0000 7fdb8959a700 1 -- 172.21.15.154:0/2094041241 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb80011990 con 0x7fdb8c09f350 2023-09-30T22:26:32.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.821+0000 7fdb8959a700 1 -- 172.21.15.154:0/2094041241 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb80011d20 con 0x7fdb8c09f350 2023-09-30T22:26:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.821+0000 7fdb90beb700 1 -- 172.21.15.154:0/2094041241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09f350 msgr2=0x7fdb8c138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.821+0000 7fdb90beb700 1 --2- 172.21.15.154:0/2094041241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09f350 0x7fdb8c138f40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009920 tx=0x7fdb80009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:32.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.822+0000 7fdb90beb700 1 -- 172.21.15.154:0/2094041241 shutdown_connections 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.822+0000 7fdb90beb700 1 --2- 172.21.15.154:0/2094041241 >> v2:172.21.15.154:3300/0 conn(0x7fdb8c139480 0x7fdb8c13b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.822+0000 7fdb90beb700 1 --2- 172.21.15.154:0/2094041241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09f350 0x7fdb8c138f40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.822+0000 7fdb90beb700 1 -- 172.21.15.154:0/2094041241 >> 172.21.15.154:0/2094041241 conn(0x7fdb8c0a4430 msgr2=0x7fdb8c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.822+0000 7fdb90beb700 1 -- 172.21.15.154:0/2094041241 shutdown_connections 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.822+0000 7fdb90beb700 1 -- 172.21.15.154:0/2094041241 wait complete. 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb90beb700 1 Processor -- start 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb90beb700 1 -- start start 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb90beb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09e870 0x7fdb8c11eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb90beb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb8c09f350 0x7fdb8c11f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb90beb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb8c139480 0x7fdb8c11f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb90beb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c06f960 con 0x7fdb8c09f350 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb90beb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c120d60 con 0x7fdb8c09e870 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb90beb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c120850 con 0x7fdb8c139480 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb89d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb8c09f350 0x7fdb8c11f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb8a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09e870 0x7fdb8c11eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb89d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb8c09f350 0x7fdb8c11f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57952/0 (socket says 172.21.15.154:57952) 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb89d9b700 1 -- 172.21.15.154:0/6897512 learned_addr learned my addr 172.21.15.154:0/6897512 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.823+0000 7fdb8ad9d700 1 --2- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb8c139480 0x7fdb8c11f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb89d9b700 1 -- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb8c139480 msgr2=0x7fdb8c11f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb89d9b700 1 --2- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb8c139480 0x7fdb8c11f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb89d9b700 1 -- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09e870 msgr2=0x7fdb8c11eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb89d9b700 1 --2- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09e870 0x7fdb8c11eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb89d9b700 1 -- 172.21.15.154:0/6897512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb80009550 con 0x7fdb8c09f350 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb89d9b700 1 --2- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb8c09f350 0x7fdb8c11f0e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009870 tx=0x7fdb80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb7affd700 1 -- 172.21.15.154:0/6897512 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb80004450 con 0x7fdb8c09f350 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb90beb700 1 -- 172.21.15.154:0/6897512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8c134a90 con 0x7fdb8c09f350 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb7affd700 1 -- 172.21.15.154:0/6897512 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb800045b0 con 0x7fdb8c09f350 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb7affd700 1 -- 172.21.15.154:0/6897512 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb800038e0 con 0x7fdb8c09f350 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.824+0000 7fdb90beb700 1 -- 172.21.15.154:0/6897512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c1223e0 con 0x7fdb8c09f350 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.825+0000 7fdb90beb700 1 -- 172.21.15.154:0/6897512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8c122000 con 0x7fdb8c09f350 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.826+0000 7fdb7affd700 1 -- 172.21.15.154:0/6897512 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb80003a40 con 0x7fdb8c09f350 2023-09-30T22:26:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.827+0000 7fdb7affd700 1 -- 172.21.15.154:0/6897512 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb80021030 con 0x7fdb8c09f350 2023-09-30T22:26:32.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.831+0000 7fdb7affd700 1 -- 172.21.15.154:0/6897512 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb8001a7b0 con 0x7fdb8c09f350 2023-09-30T22:26:32.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.850+0000 7f8d511e9700 1 Processor -- start 2023-09-30T22:26:32.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.850+0000 7f8d511e9700 1 -- start start 2023-09-30T22:26:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d511e9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a0a30 0x7f8d4c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d511e9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d4c130670 0x7f8d4c1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d511e9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c0a1e70 con 0x7f8d4c0a1340 2023-09-30T22:26:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d511e9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c09a720 con 0x7f8d4c130670 2023-09-30T22:26:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d511e9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c09b300 con 0x7f8d4c0a0a30 2023-09-30T22:26:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d4b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d4c130670 0x7f8d4c1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d4ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a0a30 0x7f8d4c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d4ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a0a30 0x7f8d4c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36206/0 (socket says 172.21.15.154:36206) 2023-09-30T22:26:32.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d4b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d4c130670 0x7f8d4c1381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57954/0 (socket says 172.21.15.154:57954) 2023-09-30T22:26:32.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d4ad9d700 1 -- 172.21.15.154:0/856825131 learned_addr learned my addr 172.21.15.154:0/856825131 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:32.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d4ad9d700 1 -- 172.21.15.154:0/856825131 >> v2:172.21.15.154:3300/0 conn(0x7f8d4c130670 msgr2=0x7f8d4c1381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.851+0000 7f8d4ad9d700 1 --2- 172.21.15.154:0/856825131 >> v2:172.21.15.154:3300/0 conn(0x7f8d4c130670 0x7f8d4c1381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.852+0000 7f8d4ad9d700 1 -- 172.21.15.154:0/856825131 >> v1:172.21.15.154:6789/0 conn(0x7f8d4c0a1340 legacy=0x7f8d4c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.852+0000 7f8d4ad9d700 1 -- 172.21.15.154:0/856825131 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c09abc0 con 0x7f8d4c0a0a30 2023-09-30T22:26:32.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.852+0000 7f8d4ad9d700 1 --2- 172.21.15.154:0/856825131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a0a30 0x7f8d4c0a0e00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c006fd0 tx=0x7f8d3c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f234399b3c970407 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.852+0000 7f8d49d9b700 1 -- 172.21.15.154:0/856825131 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c005e30 con 0x7f8d4c0a0a30 2023-09-30T22:26:32.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.852+0000 7f8d49d9b700 1 -- 172.21.15.154:0/856825131 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c004030 con 0x7f8d4c0a0a30 2023-09-30T22:26:32.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.852+0000 7f8d49d9b700 1 -- 172.21.15.154:0/856825131 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0043e0 con 0x7f8d4c0a0a30 2023-09-30T22:26:32.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.852+0000 7f8d511e9700 1 -- 172.21.15.154:0/856825131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a0a30 msgr2=0x7f8d4c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.852+0000 7f8d511e9700 1 --2- 172.21.15.154:0/856825131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a0a30 0x7f8d4c0a0e00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c006fd0 tx=0x7f8d3c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.853+0000 7f8d511e9700 1 -- 172.21.15.154:0/856825131 shutdown_connections 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.853+0000 7f8d511e9700 1 --2- 172.21.15.154:0/856825131 >> v2:172.21.15.154:3300/0 conn(0x7f8d4c130670 0x7f8d4c1381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.853+0000 7f8d511e9700 1 --2- 172.21.15.154:0/856825131 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a0a30 0x7f8d4c0a0e00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.853+0000 7f8d511e9700 1 -- 172.21.15.154:0/856825131 >> 172.21.15.154:0/856825131 conn(0x7f8d4c0a2980 msgr2=0x7f8d4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.853+0000 7f8d511e9700 1 -- 172.21.15.154:0/856825131 shutdown_connections 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.853+0000 7f8d511e9700 1 -- 172.21.15.154:0/856825131 wait complete. 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.854+0000 7f8d511e9700 1 Processor -- start 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.854+0000 7f8d511e9700 1 -- start start 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d511e9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d4c0a0a30 0x7f8d4c13a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d511e9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a1340 0x7f8d4c13ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d511e9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d4c130670 0x7f8d4c13b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d511e9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c09ae00 con 0x7f8d4c0a0a30 2023-09-30T22:26:32.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d511e9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c1352e0 con 0x7f8d4c130670 2023-09-30T22:26:32.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d511e9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c135810 con 0x7f8d4c0a1340 2023-09-30T22:26:32.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4b59e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d4c130670 0x7f8d4c13b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d4c0a0a30 0x7f8d4c13a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4b59e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d4c130670 0x7f8d4c13b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55128/0 (socket says 172.21.15.154:55128) 2023-09-30T22:26:32.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a1340 0x7f8d4c13ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d4c0a0a30 0x7f8d4c13a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57968/0 (socket says 172.21.15.154:57968) 2023-09-30T22:26:32.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4b59e700 1 -- 172.21.15.154:0/3046100832 learned_addr learned my addr 172.21.15.154:0/3046100832 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:32.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4b59e700 1 -- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a1340 msgr2=0x7f8d4c13ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4b59e700 1 --2- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a1340 0x7f8d4c13ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4b59e700 1 -- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d4c0a0a30 msgr2=0x7f8d4c13a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4b59e700 1 --2- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d4c0a0a30 0x7f8d4c13a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4b59e700 1 -- 172.21.15.154:0/3046100832 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c009500 con 0x7f8d4c130670 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4ad9d700 1 --2- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d4c0a0a30 0x7f8d4c13a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.855+0000 7f8d4a59c700 1 --2- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a1340 0x7f8d4c13ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.856+0000 7f8d4b59e700 1 --2- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d4c130670 0x7f8d4c13b2a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400efc0 tx=0x7f8d4400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.856+0000 7f8d337fe700 1 -- 172.21.15.154:0/3046100832 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44009ea0 con 0x7f8d4c130670 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.856+0000 7f8d337fe700 1 -- 172.21.15.154:0/3046100832 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4400f040 con 0x7f8d4c130670 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.856+0000 7f8d337fe700 1 -- 172.21.15.154:0/3046100832 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400ced0 con 0x7f8d4c130670 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.856+0000 7f8d511e9700 1 -- 172.21.15.154:0/3046100832 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c13bfa0 con 0x7f8d4c130670 2023-09-30T22:26:32.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.856+0000 7f8d511e9700 1 -- 172.21.15.154:0/3046100832 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c12fec0 con 0x7f8d4c130670 2023-09-30T22:26:32.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.857+0000 7f8d511e9700 1 -- 172.21.15.154:0/3046100832 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c134f00 con 0x7f8d4c130670 2023-09-30T22:26:32.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.858+0000 7f8d337fe700 1 -- 172.21.15.154:0/3046100832 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d44014480 con 0x7f8d4c130670 2023-09-30T22:26:32.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.858+0000 7f8d337fe700 1 -- 172.21.15.154:0/3046100832 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d44040790 con 0x7f8d4c130670 2023-09-30T22:26:32.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.867+0000 7f8d337fe700 1 -- 172.21.15.154:0/3046100832 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d44012910 con 0x7f8d4c130670 2023-09-30T22:26:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.872+0000 7f9549e11700 1 Processor -- start 2023-09-30T22:26:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9549e11700 1 -- start start 2023-09-30T22:26:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9549e11700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f954409d860 0x7f954409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9549e11700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f954409e170 0x7f95441307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9549e11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9544130ce0 0x7f9544131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9549e11700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9544131670 con 0x7f954409d860 2023-09-30T22:26:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9549e11700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954409aaa0 con 0x7f9544130ce0 2023-09-30T22:26:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9549e11700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f954409f870 con 0x7f954409e170 2023-09-30T22:26:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9543fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9544130ce0 0x7f9544131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9543fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9544130ce0 0x7f9544131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55140/0 (socket says 172.21.15.154:55140) 2023-09-30T22:26:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9543fff700 1 -- 172.21.15.154:0/734429620 learned_addr learned my addr 172.21.15.154:0/734429620 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:32.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.873+0000 7f9542ffd700 1 --2- 172.21.15.154:0/734429620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f954409e170 0x7f95441307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f9542ffd700 1 -- 172.21.15.154:0/734429620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9544130ce0 msgr2=0x7f9544131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f9542ffd700 1 --2- 172.21.15.154:0/734429620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9544130ce0 0x7f9544131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f9542ffd700 1 -- 172.21.15.154:0/734429620 >> v2:172.21.15.154:3300/0 conn(0x7f954409d860 msgr2=0x7f954409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f9542ffd700 1 --2- 172.21.15.154:0/734429620 >> v2:172.21.15.154:3300/0 conn(0x7f954409d860 0x7f954409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f9542ffd700 1 -- 172.21.15.154:0/734429620 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954409b360 con 0x7f954409e170 2023-09-30T22:26:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f9543fff700 1 --2- 172.21.15.154:0/734429620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9544130ce0 0x7f9544131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f9542ffd700 1 --2- 172.21.15.154:0/734429620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f954409e170 0x7f95441307a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9538009870 tx=0x7f9538009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bee7d48050c3ffa8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f95427fc700 1 -- 172.21.15.154:0/734429620 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538010a90 con 0x7f954409e170 2023-09-30T22:26:32.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f95427fc700 1 -- 172.21.15.154:0/734429620 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9538010bf0 con 0x7f954409e170 2023-09-30T22:26:32.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.874+0000 7f95427fc700 1 -- 172.21.15.154:0/734429620 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538018440 con 0x7f954409e170 2023-09-30T22:26:32.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.875+0000 7f9549e11700 1 -- 172.21.15.154:0/734429620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f954409e170 msgr2=0x7f95441307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.875+0000 7f9549e11700 1 --2- 172.21.15.154:0/734429620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f954409e170 0x7f95441307a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9538009870 tx=0x7f9538009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:32.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.875+0000 7f9549e11700 1 -- 172.21.15.154:0/734429620 shutdown_connections 2023-09-30T22:26:32.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.875+0000 7f9549e11700 1 --2- 172.21.15.154:0/734429620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9544130ce0 0x7f9544131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.875+0000 7f9549e11700 1 --2- 172.21.15.154:0/734429620 >> v2:172.21.15.154:3300/0 conn(0x7f954409d860 0x7f954409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.875+0000 7f9549e11700 1 --2- 172.21.15.154:0/734429620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f954409e170 0x7f95441307a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.875+0000 7f9549e11700 1 -- 172.21.15.154:0/734429620 >> 172.21.15.154:0/734429620 conn(0x7f9544099c40 msgr2=0x7f95440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.875+0000 7f9549e11700 1 -- 172.21.15.154:0/734429620 shutdown_connections 2023-09-30T22:26:32.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.875+0000 7f9549e11700 1 -- 172.21.15.154:0/734429620 wait complete. 2023-09-30T22:26:32.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.876+0000 7f9549e11700 1 Processor -- start 2023-09-30T22:26:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.876+0000 7f9549e11700 1 -- start start 2023-09-30T22:26:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f9549e11700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954409d860 0x7f954411ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f9549e11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954409e170 0x7f954411d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f9549e11700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9544130ce0 0x7f954411d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f9549e11700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95441201f0 con 0x7f954409d860 2023-09-30T22:26:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f9549e11700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9544121340 con 0x7f954409e170 2023-09-30T22:26:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f9549e11700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f954411fcc0 con 0x7f9544130ce0 2023-09-30T22:26:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f95437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954409d860 0x7f954411ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f95437fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954409d860 0x7f954411ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57984/0 (socket says 172.21.15.154:57984) 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f9543fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9544130ce0 0x7f954411d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f95437fe700 1 -- 172.21.15.154:0/1775553725 learned_addr learned my addr 172.21.15.154:0/1775553725 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f9542ffd700 1 --2- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954409e170 0x7f954411d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f95437fe700 1 -- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9544130ce0 msgr2=0x7f954411d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f95437fe700 1 --2- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9544130ce0 0x7f954411d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f95437fe700 1 -- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954409e170 msgr2=0x7f954411d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.877+0000 7f95437fe700 1 --2- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954409e170 0x7f954411d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.878+0000 7f95437fe700 1 -- 172.21.15.154:0/1775553725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c00bd40 con 0x7f954409d860 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.878+0000 7f9543fff700 1 --2- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9544130ce0 0x7f954411d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.878+0000 7f95437fe700 1 --2- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954409d860 0x7f954411ceb0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f953400b590 tx=0x7f953400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:32.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.878+0000 7f952bfff700 1 -- 172.21.15.154:0/1775553725 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534011830 con 0x7f954409d860 2023-09-30T22:26:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.878+0000 7f952bfff700 1 -- 172.21.15.154:0/1775553725 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534011990 con 0x7f954409d860 2023-09-30T22:26:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.878+0000 7f952bfff700 1 -- 172.21.15.154:0/1775553725 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534011d40 con 0x7f954409d860 2023-09-30T22:26:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.878+0000 7f9549e11700 1 -- 172.21.15.154:0/1775553725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95380094a0 con 0x7f954409d860 2023-09-30T22:26:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.878+0000 7f9549e11700 1 -- 172.21.15.154:0/1775553725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95440a2220 con 0x7f954409d860 2023-09-30T22:26:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.879+0000 7f9549e11700 1 -- 172.21.15.154:0/1775553725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954409c910 con 0x7f954409d860 2023-09-30T22:26:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.879+0000 7f952bfff700 1 -- 172.21.15.154:0/1775553725 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f953401a400 con 0x7f954409d860 2023-09-30T22:26:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.879+0000 7f952bfff700 1 -- 172.21.15.154:0/1775553725 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f953403f560 con 0x7f954409d860 2023-09-30T22:26:32.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.888+0000 7f952bfff700 1 -- 172.21.15.154:0/1775553725 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f953400f8b0 con 0x7f954409d860 2023-09-30T22:26:32.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.951+0000 7febae2b5700 1 -- 172.21.15.154:0/1500414165 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feba806b2a0 con 0x7feba809f180 2023-09-30T22:26:32.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.952+0000 7feba4ff9700 1 -- 172.21.15.154:0/1500414165 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb9c003e40 con 0x7feba809f180 2023-09-30T22:26:32.953 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.954+0000 7febae2b5700 1 -- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809f180 msgr2=0x7feba8120500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.954+0000 7febae2b5700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809f180 0x7feba8120500 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00c550 tx=0x7feb9c00c860 comp rx=0 tx=0).stop 2023-09-30T22:26:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.954+0000 7febae2b5700 1 -- 172.21.15.154:0/1500414165 shutdown_connections 2023-09-30T22:26:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.954+0000 7febae2b5700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba8131f40 0x7feba8120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.954+0000 7febae2b5700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba809e870 0x7feba811ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.954+0000 7febae2b5700 1 --2- 172.21.15.154:0/1500414165 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba809f180 0x7feba8120500 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:32.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.954+0000 7febae2b5700 1 -- 172.21.15.154:0/1500414165 >> 172.21.15.154:0/1500414165 conn(0x7feba80a4430 msgr2=0x7feba809d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.955+0000 7febae2b5700 1 -- 172.21.15.154:0/1500414165 shutdown_connections 2023-09-30T22:26:32.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:32.955+0000 7febae2b5700 1 -- 172.21.15.154:0/1500414165 wait complete. 2023-09-30T22:26:32.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:33.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.037+0000 7fdb90beb700 1 -- 172.21.15.154:0/6897512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb8c04f2a0 con 0x7fdb8c09f350 2023-09-30T22:26:33.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.037+0000 7fdb7affd700 1 -- 172.21.15.154:0/6897512 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb80034020 con 0x7fdb8c09f350 2023-09-30T22:26:33.038 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:33.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.039+0000 7fdb90beb700 1 -- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb8c09f350 msgr2=0x7fdb8c11f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.039+0000 7fdb90beb700 1 --2- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb8c09f350 0x7fdb8c11f0e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009870 tx=0x7fdb80004750 comp rx=0 tx=0).stop 2023-09-30T22:26:33.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.039+0000 7fdb90beb700 1 -- 172.21.15.154:0/6897512 shutdown_connections 2023-09-30T22:26:33.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.039+0000 7fdb90beb700 1 --2- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb8c139480 0x7fdb8c11f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.039+0000 7fdb90beb700 1 --2- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb8c09e870 0x7fdb8c11eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.039+0000 7fdb90beb700 1 --2- 172.21.15.154:0/6897512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb8c09f350 0x7fdb8c11f0e0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.039+0000 7fdb90beb700 1 -- 172.21.15.154:0/6897512 >> 172.21.15.154:0/6897512 conn(0x7fdb8c0a4430 msgr2=0x7fdb8c138450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:33.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.039+0000 7fdb90beb700 1 -- 172.21.15.154:0/6897512 shutdown_connections 2023-09-30T22:26:33.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.040+0000 7fdb90beb700 1 -- 172.21.15.154:0/6897512 wait complete. 2023-09-30T22:26:33.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:33.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.072+0000 7f8d511e9700 1 -- 172.21.15.154:0/3046100832 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8d4c04f2a0 con 0x7f8d4c130670 2023-09-30T22:26:33.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.072+0000 7f8d337fe700 1 -- 172.21.15.154:0/3046100832 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d44018070 con 0x7f8d4c130670 2023-09-30T22:26:33.073 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:33.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.074+0000 7f8d511e9700 1 -- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d4c130670 msgr2=0x7f8d4c13b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.074+0000 7f8d511e9700 1 --2- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d4c130670 0x7f8d4c13b2a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400efc0 tx=0x7f8d4400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.074+0000 7f8d511e9700 1 -- 172.21.15.154:0/3046100832 shutdown_connections 2023-09-30T22:26:33.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.074+0000 7f8d511e9700 1 --2- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d4c130670 0x7f8d4c13b2a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.074+0000 7f8d511e9700 1 --2- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d4c0a0a30 0x7f8d4c13a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.074+0000 7f8d511e9700 1 --2- 172.21.15.154:0/3046100832 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d4c0a1340 0x7f8d4c13ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.074+0000 7f8d511e9700 1 -- 172.21.15.154:0/3046100832 >> 172.21.15.154:0/3046100832 conn(0x7f8d4c0a2980 msgr2=0x7f8d4c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:33.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.074+0000 7f8d511e9700 1 -- 172.21.15.154:0/3046100832 shutdown_connections 2023-09-30T22:26:33.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.074+0000 7f8d511e9700 1 -- 172.21.15.154:0/3046100832 wait complete. 2023-09-30T22:26:33.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.083+0000 7f9549e11700 1 -- 172.21.15.154:0/1775553725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f954404f2a0 con 0x7f954409d860 2023-09-30T22:26:33.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.084+0000 7f952bfff700 1 -- 172.21.15.154:0/1775553725 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9534015020 con 0x7f954409d860 2023-09-30T22:26:33.084 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.086+0000 7f9549e11700 1 -- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954409d860 msgr2=0x7f954411ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.086+0000 7f9549e11700 1 --2- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954409d860 0x7f954411ceb0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f953400b590 tx=0x7f953400b8a0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.086+0000 7f9549e11700 1 -- 172.21.15.154:0/1775553725 shutdown_connections 2023-09-30T22:26:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.086+0000 7f9549e11700 1 --2- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9544130ce0 0x7f954411d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.086+0000 7f9549e11700 1 --2- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954409d860 0x7f954411ceb0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.086+0000 7f9549e11700 1 --2- 172.21.15.154:0/1775553725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954409e170 0x7f954411d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.086+0000 7f9549e11700 1 -- 172.21.15.154:0/1775553725 >> 172.21.15.154:0/1775553725 conn(0x7f9544099c40 msgr2=0x7f954412fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:33.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.086+0000 7f9549e11700 1 -- 172.21.15.154:0/1775553725 shutdown_connections 2023-09-30T22:26:33.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:33.086+0000 7f9549e11700 1 -- 172.21.15.154:0/1775553725 wait complete. 2023-09-30T22:26:33.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:33.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:33.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:34.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:34.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:34.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:34.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.105+0000 7ff739ec1700 1 Processor -- start 2023-09-30T22:26:34.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff739ec1700 1 -- start start 2023-09-30T22:26:34.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff739ec1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73409d860 0x7ff73409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff739ec1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409e170 0x7ff7341307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff739ec1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73409aaa0 con 0x7ff734130ce0 2023-09-30T22:26:34.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff739ec1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73409f870 con 0x7ff73409e170 2023-09-30T22:26:34.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff739ec1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73409b360 con 0x7ff73409d860 2023-09-30T22:26:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73409d860 0x7ff73409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409e170 0x7ff7341307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73409d860 0x7ff73409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36248/0 (socket says 172.21.15.154:36248) 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.106+0000 7ff7337fe700 1 -- 172.21.15.154:0/27788807 learned_addr learned my addr 172.21.15.154:0/27788807 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff7327fc700 1 -- 172.21.15.154:0/27788807 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410858567 0 0) 0x7ff73409aaa0 con 0x7ff734130ce0 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff7327fc700 1 -- 172.21.15.154:0/27788807 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff71c0035b0 con 0x7ff734130ce0 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff732ffd700 1 -- 172.21.15.154:0/27788807 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73409d860 msgr2=0x7ff73409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff732ffd700 1 --2- 172.21.15.154:0/27788807 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73409d860 0x7ff73409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff732ffd700 1 -- 172.21.15.154:0/27788807 >> v1:172.21.15.154:6789/0 conn(0x7ff734130ce0 legacy=0x7ff7341379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff732ffd700 1 -- 172.21.15.154:0/27788807 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73409b620 con 0x7ff73409e170 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff7337fe700 1 --2- 172.21.15.154:0/27788807 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73409d860 0x7ff73409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff732ffd700 1 --2- 172.21.15.154:0/27788807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409e170 0x7ff7341307a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff728013de0 tx=0x7ff728009660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc76377718914f9d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff7327fc700 1 -- 172.21.15.154:0/27788807 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728009e50 con 0x7ff73409e170 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff7327fc700 1 -- 172.21.15.154:0/27788807 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7280128e0 con 0x7ff73409e170 2023-09-30T22:26:34.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.107+0000 7ff7327fc700 1 -- 172.21.15.154:0/27788807 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728012c70 con 0x7ff73409e170 2023-09-30T22:26:34.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.108+0000 7ff739ec1700 1 -- 172.21.15.154:0/27788807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409e170 msgr2=0x7ff7341307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.108+0000 7ff739ec1700 1 --2- 172.21.15.154:0/27788807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409e170 0x7ff7341307a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff728013de0 tx=0x7ff728009660 comp rx=0 tx=0).stop 2023-09-30T22:26:34.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.108+0000 7ff739ec1700 1 -- 172.21.15.154:0/27788807 shutdown_connections 2023-09-30T22:26:34.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.108+0000 7ff739ec1700 1 --2- 172.21.15.154:0/27788807 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73409d860 0x7ff73409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.108+0000 7ff739ec1700 1 --2- 172.21.15.154:0/27788807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409e170 0x7ff7341307a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.108+0000 7ff739ec1700 1 -- 172.21.15.154:0/27788807 >> 172.21.15.154:0/27788807 conn(0x7ff734099c40 msgr2=0x7ff7340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.108+0000 7ff739ec1700 1 -- 172.21.15.154:0/27788807 shutdown_connections 2023-09-30T22:26:34.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.108+0000 7ff739ec1700 1 -- 172.21.15.154:0/27788807 wait complete. 2023-09-30T22:26:34.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.109+0000 7ff739ec1700 1 Processor -- start 2023-09-30T22:26:34.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff739ec1700 1 -- start start 2023-09-30T22:26:34.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff739ec1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409d860 0x7ff73411e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff739ec1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73409e170 0x7ff73411e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff739ec1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff734130ce0 0x7ff73411ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff739ec1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7341216a0 con 0x7ff73409e170 2023-09-30T22:26:34.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff739ec1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff734120090 con 0x7ff73409d860 2023-09-30T22:26:34.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff739ec1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff734130470 con 0x7ff734130ce0 2023-09-30T22:26:34.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409d860 0x7ff73411e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73409e170 0x7ff73411e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff7337fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409d860 0x7ff73411e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55166/0 (socket says 172.21.15.154:55166) 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.110+0000 7ff7337fe700 1 -- 172.21.15.154:0/1478808754 learned_addr learned my addr 172.21.15.154:0/1478808754 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff7337fe700 1 -- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff734130ce0 msgr2=0x7ff73411ef00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff7337fe700 1 --2- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff734130ce0 0x7ff73411ef00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff7337fe700 1 -- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73409e170 msgr2=0x7ff73411e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff7337fe700 1 --2- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73409e170 0x7ff73411e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff7337fe700 1 -- 172.21.15.154:0/1478808754 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72400da00 con 0x7ff73409d860 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff732ffd700 1 --2- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73409e170 0x7ff73411e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff7337fe700 1 --2- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409d860 0x7ff73411e480 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff72400bf20 tx=0x7ff724009530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff71bfff700 1 -- 172.21.15.154:0/1478808754 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724009c90 con 0x7ff73409d860 2023-09-30T22:26:34.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff71bfff700 1 -- 172.21.15.154:0/1478808754 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff724009df0 con 0x7ff73409d860 2023-09-30T22:26:34.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff739ec1700 1 -- 172.21.15.154:0/1478808754 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff728013a10 con 0x7ff73409d860 2023-09-30T22:26:34.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff71bfff700 1 -- 172.21.15.154:0/1478808754 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724016620 con 0x7ff73409d860 2023-09-30T22:26:34.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.111+0000 7ff739ec1700 1 -- 172.21.15.154:0/1478808754 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73409c8b0 con 0x7ff73409d860 2023-09-30T22:26:34.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.112+0000 7ff71bfff700 1 -- 172.21.15.154:0/1478808754 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff724014070 con 0x7ff73409d860 2023-09-30T22:26:34.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.112+0000 7ff71bfff700 1 -- 172.21.15.154:0/1478808754 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff72403f350 con 0x7ff73409d860 2023-09-30T22:26:34.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.112+0000 7ff739ec1700 1 -- 172.21.15.154:0/1478808754 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73404f2a0 con 0x7ff73409d860 2023-09-30T22:26:34.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.118+0000 7ff71bfff700 1 -- 172.21.15.154:0/1478808754 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff72401b020 con 0x7ff73409d860 2023-09-30T22:26:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.192+0000 7f47567c5700 1 Processor -- start 2023-09-30T22:26:34.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.192+0000 7f47567c5700 1 -- start start 2023-09-30T22:26:34.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.192+0000 7f47567c5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4750099e20 0x7f475009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.192+0000 7f47567c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475009a730 0x7f4750130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.192+0000 7f47567c5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4750099a60 con 0x7f4750130890 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.192+0000 7f47567c5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475009bf50 con 0x7f475009a730 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.192+0000 7f47567c5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475009b230 con 0x7f4750099e20 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4750099e20 0x7f475009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4750099e20 0x7f475009a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36252/0 (socket says 172.21.15.154:36252) 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474ffff700 1 -- 172.21.15.154:0/719324036 learned_addr learned my addr 172.21.15.154:0/719324036 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474f7fe700 1 --2- 172.21.15.154:0/719324036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475009a730 0x7f4750130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474ffff700 1 -- 172.21.15.154:0/719324036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475009a730 msgr2=0x7f4750130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474ffff700 1 --2- 172.21.15.154:0/719324036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475009a730 0x7f4750130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474ffff700 1 -- 172.21.15.154:0/719324036 >> v1:172.21.15.154:6789/0 conn(0x7f4750130890 legacy=0x7f4750137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474effd700 1 -- 172.21.15.154:0/719324036 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838645065 0 0) 0x7f4750099a60 con 0x7f4750130890 2023-09-30T22:26:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474ffff700 1 -- 172.21.15.154:0/719324036 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475009bb90 con 0x7f4750099e20 2023-09-30T22:26:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474f7fe700 1 --2- 172.21.15.154:0/719324036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475009a730 0x7f4750130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474ffff700 1 --2- 172.21.15.154:0/719324036 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4750099e20 0x7f475009a1f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4740009920 tx=0x7f4740009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d00f58017e7b9ad7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474effd700 1 -- 172.21.15.154:0/719324036 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740005e30 con 0x7f4750099e20 2023-09-30T22:26:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474effd700 1 -- 172.21.15.154:0/719324036 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740009e70 con 0x7f4750099e20 2023-09-30T22:26:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.193+0000 7f474effd700 1 -- 172.21.15.154:0/719324036 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740004250 con 0x7f4750099e20 2023-09-30T22:26:34.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.194+0000 7f47567c5700 1 -- 172.21.15.154:0/719324036 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4750099e20 msgr2=0x7f475009a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.194+0000 7f47567c5700 1 --2- 172.21.15.154:0/719324036 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4750099e20 0x7f475009a1f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4740009920 tx=0x7f4740009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.194+0000 7f47567c5700 1 -- 172.21.15.154:0/719324036 shutdown_connections 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.194+0000 7f47567c5700 1 --2- 172.21.15.154:0/719324036 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4750099e20 0x7f475009a1f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.194+0000 7f47567c5700 1 --2- 172.21.15.154:0/719324036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f475009a730 0x7f4750130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.194+0000 7f47567c5700 1 -- 172.21.15.154:0/719324036 >> 172.21.15.154:0/719324036 conn(0x7f47500a2980 msgr2=0x7f47500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.194+0000 7f47567c5700 1 -- 172.21.15.154:0/719324036 shutdown_connections 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.194+0000 7f47567c5700 1 -- 172.21.15.154:0/719324036 wait complete. 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.195+0000 7f47567c5700 1 Processor -- start 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.196+0000 7f47567c5700 1 -- start start 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.196+0000 7f47567c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4750099e20 0x7f475012d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.196+0000 7f47567c5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475009a730 0x7f4750137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.196+0000 7f47567c5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4750130890 0x7f4750138220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.196+0000 7f47567c5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750130340 con 0x7f4750130890 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.196+0000 7f47567c5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475009b470 con 0x7f4750099e20 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.196+0000 7f47567c5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4750135a90 con 0x7f475009a730 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4750099e20 0x7f475012d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4750099e20 0x7f475012d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55180/0 (socket says 172.21.15.154:55180) 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474ffff700 1 -- 172.21.15.154:0/3163675144 learned_addr learned my addr 172.21.15.154:0/3163675144 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f4754d62700 1 --2- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4750130890 0x7f4750138220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474f7fe700 1 --2- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475009a730 0x7f4750137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474ffff700 1 -- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475009a730 msgr2=0x7f4750137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474ffff700 1 --2- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475009a730 0x7f4750137ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474ffff700 1 -- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4750130890 msgr2=0x7f4750138220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474ffff700 1 --2- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4750130890 0x7f4750138220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474ffff700 1 -- 172.21.15.154:0/3163675144 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4740009500 con 0x7f4750099e20 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474ffff700 1 --2- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4750099e20 0x7f475012d740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f47400042e0 tx=0x7f4740004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474cff9700 1 -- 172.21.15.154:0/3163675144 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740003bb0 con 0x7f4750099e20 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474cff9700 1 -- 172.21.15.154:0/3163675144 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740003d10 con 0x7f4750099e20 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f47567c5700 1 -- 172.21.15.154:0/3163675144 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4750137890 con 0x7f4750099e20 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.197+0000 7f474cff9700 1 -- 172.21.15.154:0/3163675144 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474000b830 con 0x7f4750099e20 2023-09-30T22:26:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.198+0000 7f47567c5700 1 -- 172.21.15.154:0/3163675144 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475013b950 con 0x7f4750099e20 2023-09-30T22:26:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.198+0000 7f474cff9700 1 -- 172.21.15.154:0/3163675144 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f474000b990 con 0x7f4750099e20 2023-09-30T22:26:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.199+0000 7f47567c5700 1 -- 172.21.15.154:0/3163675144 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475013bb40 con 0x7f4750099e20 2023-09-30T22:26:34.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.199+0000 7f474cff9700 1 -- 172.21.15.154:0/3163675144 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f47400405c0 con 0x7f4750099e20 2023-09-30T22:26:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.207+0000 7f474cff9700 1 -- 172.21.15.154:0/3163675144 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f474001a6d0 con 0x7f4750099e20 2023-09-30T22:26:34.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.234+0000 7f282eb28700 1 Processor -- start 2023-09-30T22:26:34.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.234+0000 7f282eb28700 1 -- start start 2023-09-30T22:26:34.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.234+0000 7f282eb28700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809e870 0x7f282809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.234+0000 7f282eb28700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f282809f180 0x7f2828131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.234+0000 7f282eb28700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131d70 0x7f2828132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.234+0000 7f282eb28700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28280a0920 con 0x7f282809f180 2023-09-30T22:26:34.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.234+0000 7f282eb28700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282809c970 con 0x7f282809e870 2023-09-30T22:26:34.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.234+0000 7f282eb28700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282809bab0 con 0x7f2828131d70 2023-09-30T22:26:34.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.234+0000 7f282c8c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809e870 0x7f282809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f282c8c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809e870 0x7f282809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55188/0 (socket says 172.21.15.154:55188) 2023-09-30T22:26:34.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f282c8c4700 1 -- 172.21.15.154:0/3766507238 learned_addr learned my addr 172.21.15.154:0/3766507238 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:34.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f2827fff700 1 --2- 172.21.15.154:0/3766507238 >> v2:172.21.15.154:3300/0 conn(0x7f282809f180 0x7f2828131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f282d0c5700 1 --2- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131d70 0x7f2828132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f2827fff700 1 -- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131d70 msgr2=0x7f2828132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:34.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f2827fff700 1 --2- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131d70 0x7f2828132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f2827fff700 1 -- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809e870 msgr2=0x7f282809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:34.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f2827fff700 1 --2- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809e870 0x7f282809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f2827fff700 1 -- 172.21.15.154:0/3766507238 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282809f9c0 con 0x7f282809f180 2023-09-30T22:26:34.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f2827fff700 1 --2- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809f180 0x7f2828131830 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2814009870 tx=0x7f2814009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c3e034bc5a4546 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f28277fe700 1 -- 172.21.15.154:0/3766507238 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814011830 con 0x7f282809f180 2023-09-30T22:26:34.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f28277fe700 1 -- 172.21.15.154:0/3766507238 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2814011990 con 0x7f282809f180 2023-09-30T22:26:34.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.235+0000 7f28277fe700 1 -- 172.21.15.154:0/3766507238 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814011d20 con 0x7f282809f180 2023-09-30T22:26:34.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.236+0000 7f282eb28700 1 -- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809f180 msgr2=0x7f2828131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.236+0000 7f282eb28700 1 --2- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809f180 0x7f2828131830 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2814009870 tx=0x7f2814009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:34.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.236+0000 7f282eb28700 1 -- 172.21.15.154:0/3766507238 shutdown_connections 2023-09-30T22:26:34.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.236+0000 7f282eb28700 1 --2- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809e870 0x7f282809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.236+0000 7f282eb28700 1 --2- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131d70 0x7f2828132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.236+0000 7f282eb28700 1 --2- 172.21.15.154:0/3766507238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809f180 0x7f2828131830 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.236+0000 7f282eb28700 1 -- 172.21.15.154:0/3766507238 >> 172.21.15.154:0/3766507238 conn(0x7f28280a4430 msgr2=0x7f28280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.236+0000 7f282eb28700 1 -- 172.21.15.154:0/3766507238 shutdown_connections 2023-09-30T22:26:34.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.236+0000 7f282eb28700 1 -- 172.21.15.154:0/3766507238 wait complete. 2023-09-30T22:26:34.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.237+0000 7f282eb28700 1 Processor -- start 2023-09-30T22:26:34.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.237+0000 7f282eb28700 1 -- start start 2023-09-30T22:26:34.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.237+0000 7f282eb28700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809e870 0x7f282806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.237+0000 7f282eb28700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282809f180 0x7f282806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282eb28700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2828131d70 0x7f282806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282eb28700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282812e660 con 0x7f282809e870 2023-09-30T22:26:34.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282eb28700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2828122a50 con 0x7f2828131d70 2023-09-30T22:26:34.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282eb28700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2828122790 con 0x7f282809f180 2023-09-30T22:26:34.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282c8c4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809e870 0x7f282806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f2827fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282809f180 0x7f282806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282c8c4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809e870 0x7f282806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58034/0 (socket says 172.21.15.154:58034) 2023-09-30T22:26:34.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f2827fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282809f180 0x7f282806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36276/0 (socket says 172.21.15.154:36276) 2023-09-30T22:26:34.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282d0c5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2828131d70 0x7f282806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282c8c4700 1 -- 172.21.15.154:0/3881053040 learned_addr learned my addr 172.21.15.154:0/3881053040 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:34.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282c8c4700 1 -- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282809f180 msgr2=0x7f282806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282c8c4700 1 --2- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282809f180 0x7f282806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282c8c4700 1 -- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2828131d70 msgr2=0x7f282806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282c8c4700 1 --2- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2828131d70 0x7f282806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282c8c4700 1 -- 172.21.15.154:0/3881053040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28140094a0 con 0x7f282809e870 2023-09-30T22:26:34.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f282c8c4700 1 --2- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809e870 0x7f282806b8b0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f281c00e960 tx=0x7f281c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.238+0000 7f28257fa700 1 -- 172.21.15.154:0/3881053040 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c013680 con 0x7f282809e870 2023-09-30T22:26:34.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.239+0000 7f28257fa700 1 -- 172.21.15.154:0/3881053040 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c0137e0 con 0x7f282809e870 2023-09-30T22:26:34.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.239+0000 7f28257fa700 1 -- 172.21.15.154:0/3881053040 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c013b50 con 0x7f282809e870 2023-09-30T22:26:34.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.239+0000 7f282eb28700 1 -- 172.21.15.154:0/3881053040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2828131830 con 0x7f282809e870 2023-09-30T22:26:34.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.239+0000 7f282eb28700 1 -- 172.21.15.154:0/3881053040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28281234c0 con 0x7f282809e870 2023-09-30T22:26:34.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.239+0000 7f28257fa700 1 -- 172.21.15.154:0/3881053040 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f281c013cb0 con 0x7f282809e870 2023-09-30T22:26:34.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.239+0000 7f28257fa700 1 -- 172.21.15.154:0/3881053040 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f281c03fa10 con 0x7f282809e870 2023-09-30T22:26:34.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.240+0000 7f282eb28700 1 -- 172.21.15.154:0/3881053040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2828122070 con 0x7f282809e870 2023-09-30T22:26:34.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.242+0000 7fc041224700 1 Processor -- start 2023-09-30T22:26:34.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.242+0000 7fc041224700 1 -- start start 2023-09-30T22:26:34.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc041224700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc03c133900 0x7fc03c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc041224700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c134210 0x7fc03c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc041224700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03c09a760 con 0x7fc03c0a0ee0 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc041224700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03c1336e0 con 0x7fc03c133900 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc041224700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c09a080 con 0x7fc03c134210 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc03ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc03c133900 0x7fc03c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc03ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc03c133900 0x7fc03c133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58050/0 (socket says 172.21.15.154:58050) 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc03ad9d700 1 -- 172.21.15.154:0/1986305710 learned_addr learned my addr 172.21.15.154:0/1986305710 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc03a59c700 1 --2- 172.21.15.154:0/1986305710 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c134210 0x7fc03c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc03ad9d700 1 -- 172.21.15.154:0/1986305710 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c134210 msgr2=0x7fc03c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc03ad9d700 1 --2- 172.21.15.154:0/1986305710 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c134210 0x7fc03c0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc03ad9d700 1 -- 172.21.15.154:0/1986305710 >> v1:172.21.15.154:6789/0 conn(0x7fc03c0a0ee0 legacy=0x7fc03c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc03ad9d700 1 -- 172.21.15.154:0/1986305710 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c0a23e0 con 0x7fc03c133900 2023-09-30T22:26:34.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.243+0000 7fc03ad9d700 1 --2- 172.21.15.154:0/1986305710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc03c133900 0x7fc03c133cd0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc02c006fd0 tx=0x7fc02c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3334357984755971 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.245+0000 7fc039d9b700 1 -- 172.21.15.154:0/1986305710 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c005e30 con 0x7fc03c133900 2023-09-30T22:26:34.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.245+0000 7fc039d9b700 1 -- 172.21.15.154:0/1986305710 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c004030 con 0x7fc03c133900 2023-09-30T22:26:34.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.245+0000 7fc039d9b700 1 -- 172.21.15.154:0/1986305710 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0043e0 con 0x7fc03c133900 2023-09-30T22:26:34.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.246+0000 7f28257fa700 1 -- 172.21.15.154:0/3881053040 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f281c0119a0 con 0x7f282809e870 2023-09-30T22:26:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.246+0000 7fc041224700 1 -- 172.21.15.154:0/1986305710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc03c133900 msgr2=0x7fc03c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.246+0000 7fc041224700 1 --2- 172.21.15.154:0/1986305710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc03c133900 0x7fc03c133cd0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc02c006fd0 tx=0x7fc02c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.246+0000 7fc041224700 1 -- 172.21.15.154:0/1986305710 shutdown_connections 2023-09-30T22:26:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.246+0000 7fc041224700 1 --2- 172.21.15.154:0/1986305710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc03c133900 0x7fc03c133cd0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.246+0000 7fc041224700 1 --2- 172.21.15.154:0/1986305710 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c134210 0x7fc03c0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.246+0000 7fc041224700 1 -- 172.21.15.154:0/1986305710 >> 172.21.15.154:0/1986305710 conn(0x7fc03c0a2980 msgr2=0x7fc03c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.246+0000 7fc041224700 1 -- 172.21.15.154:0/1986305710 shutdown_connections 2023-09-30T22:26:34.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.246+0000 7fc041224700 1 -- 172.21.15.154:0/1986305710 wait complete. 2023-09-30T22:26:34.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc041224700 1 Processor -- start 2023-09-30T22:26:34.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc041224700 1 -- start start 2023-09-30T22:26:34.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc041224700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c0a0ee0 0x7fc03c11da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc041224700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03c133900 0x7fc03c11df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc041224700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc03c134210 0x7fc03c11e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:34.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc041224700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c121530 con 0x7fc03c134210 2023-09-30T22:26:34.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc041224700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c11fbd0 con 0x7fc03c133900 2023-09-30T22:26:34.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc041224700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c132ef0 con 0x7fc03c0a0ee0 2023-09-30T22:26:34.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc03a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03c133900 0x7fc03c11df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc03a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03c133900 0x7fc03c11df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55206/0 (socket says 172.21.15.154:55206) 2023-09-30T22:26:34.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc03a59c700 1 -- 172.21.15.154:0/915538889 learned_addr learned my addr 172.21.15.154:0/915538889 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:34.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc03ad9d700 1 --2- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c0a0ee0 0x7fc03c11da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.248+0000 7fc03b59e700 1 --2- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc03c134210 0x7fc03c11e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:34.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc03a59c700 1 -- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c0a0ee0 msgr2=0x7fc03c11da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc03a59c700 1 --2- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c0a0ee0 0x7fc03c11da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc03a59c700 1 -- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc03c134210 msgr2=0x7fc03c11e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc03a59c700 1 --2- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc03c134210 0x7fc03c11e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc03a59c700 1 -- 172.21.15.154:0/915538889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c009500 con 0x7fc03c133900 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc03a59c700 1 --2- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03c133900 0x7fc03c11df50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc03000e9b0 tx=0x7fc03000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc0237fe700 1 -- 172.21.15.154:0/915538889 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000ee50 con 0x7fc03c133900 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc0237fe700 1 -- 172.21.15.154:0/915538889 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03000c850 con 0x7fc03c133900 2023-09-30T22:26:34.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc0237fe700 1 -- 172.21.15.154:0/915538889 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000cbc0 con 0x7fc03c133900 2023-09-30T22:26:34.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc041224700 1 -- 172.21.15.154:0/915538889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03c09a2c0 con 0x7fc03c133900 2023-09-30T22:26:34.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.249+0000 7fc041224700 1 -- 172.21.15.154:0/915538889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03c120cc0 con 0x7fc03c133900 2023-09-30T22:26:34.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.250+0000 7fc0237fe700 1 -- 172.21.15.154:0/915538889 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc03000cd20 con 0x7fc03c133900 2023-09-30T22:26:34.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.250+0000 7fc041224700 1 -- 172.21.15.154:0/915538889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03c11a590 con 0x7fc03c133900 2023-09-30T22:26:34.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.251+0000 7fc0237fe700 1 -- 172.21.15.154:0/915538889 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc03003fbd0 con 0x7fc03c133900 2023-09-30T22:26:34.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.255+0000 7fc0237fe700 1 -- 172.21.15.154:0/915538889 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc03001b3b0 con 0x7fc03c133900 2023-09-30T22:26:34.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.354+0000 7ff739ec1700 1 -- 172.21.15.154:0/1478808754 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff73406c3b0 con 0x7ff73409d860 2023-09-30T22:26:34.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.355+0000 7ff71bfff700 1 -- 172.21.15.154:0/1478808754 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff724014910 con 0x7ff73409d860 2023-09-30T22:26:34.356 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:34.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.358+0000 7ff739ec1700 1 -- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409d860 msgr2=0x7ff73411e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.358+0000 7ff739ec1700 1 --2- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409d860 0x7ff73411e480 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff72400bf20 tx=0x7ff724009530 comp rx=0 tx=0).stop 2023-09-30T22:26:34.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.358+0000 7ff739ec1700 1 -- 172.21.15.154:0/1478808754 shutdown_connections 2023-09-30T22:26:34.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.358+0000 7ff739ec1700 1 --2- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff734130ce0 0x7ff73411ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.358+0000 7ff739ec1700 1 --2- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73409d860 0x7ff73411e480 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.358+0000 7ff739ec1700 1 --2- 172.21.15.154:0/1478808754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73409e170 0x7ff73411e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.358+0000 7ff739ec1700 1 -- 172.21.15.154:0/1478808754 >> 172.21.15.154:0/1478808754 conn(0x7ff734099c40 msgr2=0x7ff7340a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.358+0000 7ff739ec1700 1 -- 172.21.15.154:0/1478808754 shutdown_connections 2023-09-30T22:26:34.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.358+0000 7ff739ec1700 1 -- 172.21.15.154:0/1478808754 wait complete. 2023-09-30T22:26:34.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.439+0000 7f47567c5700 1 -- 172.21.15.154:0/3163675144 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4750072480 con 0x7f4750099e20 2023-09-30T22:26:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.439+0000 7f474cff9700 1 -- 172.21.15.154:0/3163675144 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4750072480 con 0x7f4750099e20 2023-09-30T22:26:34.440 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.441+0000 7f47567c5700 1 -- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4750099e20 msgr2=0x7f475012d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.441+0000 7f47567c5700 1 --2- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4750099e20 0x7f475012d740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f47400042e0 tx=0x7f4740004750 comp rx=0 tx=0).stop 2023-09-30T22:26:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.441+0000 7f47567c5700 1 -- 172.21.15.154:0/3163675144 shutdown_connections 2023-09-30T22:26:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.441+0000 7f47567c5700 1 --2- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4750130890 0x7f4750138220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.441+0000 7f47567c5700 1 --2- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4750099e20 0x7f475012d740 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.441+0000 7f47567c5700 1 --2- 172.21.15.154:0/3163675144 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f475009a730 0x7f4750137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.441+0000 7f47567c5700 1 -- 172.21.15.154:0/3163675144 >> 172.21.15.154:0/3163675144 conn(0x7f47500a2980 msgr2=0x7f475006df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.441+0000 7f47567c5700 1 -- 172.21.15.154:0/3163675144 shutdown_connections 2023-09-30T22:26:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.441+0000 7f47567c5700 1 -- 172.21.15.154:0/3163675144 wait complete. 2023-09-30T22:26:34.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:34.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.463+0000 7f282eb28700 1 -- 172.21.15.154:0/3881053040 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f282804f2a0 con 0x7f282809e870 2023-09-30T22:26:34.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.463+0000 7f28257fa700 1 -- 172.21.15.154:0/3881053040 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f281c021020 con 0x7f282809e870 2023-09-30T22:26:34.465 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:34.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.465+0000 7f282eb28700 1 -- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809e870 msgr2=0x7f282806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.465+0000 7f282eb28700 1 --2- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809e870 0x7f282806b8b0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f281c00e960 tx=0x7f281c00ec70 comp rx=0 tx=0).stop 2023-09-30T22:26:34.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.465+0000 7f282eb28700 1 -- 172.21.15.154:0/3881053040 shutdown_connections 2023-09-30T22:26:34.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.465+0000 7f282eb28700 1 --2- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2828131d70 0x7f282806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.465+0000 7f282eb28700 1 --2- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282809e870 0x7f282806b8b0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.465+0000 7f282eb28700 1 --2- 172.21.15.154:0/3881053040 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282809f180 0x7f282806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.465+0000 7f282eb28700 1 -- 172.21.15.154:0/3881053040 >> 172.21.15.154:0/3881053040 conn(0x7f28280a4430 msgr2=0x7f282809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.465+0000 7f282eb28700 1 -- 172.21.15.154:0/3881053040 shutdown_connections 2023-09-30T22:26:34.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.465+0000 7f282eb28700 1 -- 172.21.15.154:0/3881053040 wait complete. 2023-09-30T22:26:34.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.481+0000 7fc041224700 1 -- 172.21.15.154:0/915538889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc03c04f2a0 con 0x7fc03c133900 2023-09-30T22:26:34.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.482+0000 7fc0237fe700 1 -- 172.21.15.154:0/915538889 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc030017030 con 0x7fc03c133900 2023-09-30T22:26:34.482 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.484+0000 7fc041224700 1 -- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03c133900 msgr2=0x7fc03c11df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.484+0000 7fc041224700 1 --2- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03c133900 0x7fc03c11df50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc03000e9b0 tx=0x7fc03000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.484+0000 7fc041224700 1 -- 172.21.15.154:0/915538889 shutdown_connections 2023-09-30T22:26:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.484+0000 7fc041224700 1 --2- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc03c134210 0x7fc03c11e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.484+0000 7fc041224700 1 --2- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc03c0a0ee0 0x7fc03c11da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.484+0000 7fc041224700 1 --2- 172.21.15.154:0/915538889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03c133900 0x7fc03c11df50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.484+0000 7fc041224700 1 -- 172.21.15.154:0/915538889 >> 172.21.15.154:0/915538889 conn(0x7fc03c0a2980 msgr2=0x7fc03c1bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.484+0000 7fc041224700 1 -- 172.21.15.154:0/915538889 shutdown_connections 2023-09-30T22:26:34.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:34.484+0000 7fc041224700 1 -- 172.21.15.154:0/915538889 wait complete. 2023-09-30T22:26:34.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:35.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:35.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:35.479 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:35.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:35.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.514+0000 7ff18265d700 1 Processor -- start 2023-09-30T22:26:35.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.514+0000 7ff18265d700 1 -- start start 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff18265d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 0x7ff17c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff18265d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff17c133f70 0x7ff17c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff18265d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c0a0a70 0x7ff17c0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff18265d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c0a3b60 con 0x7ff17c133f70 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff18265d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c1348e0 con 0x7ff17c09ad40 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff18265d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c09b110 con 0x7ff17c0a0a70 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 0x7ff17c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 0x7ff17c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34434/0 (socket says 172.21.15.154:34434) 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17bfff700 1 -- 172.21.15.154:0/4002438699 learned_addr learned my addr 172.21.15.154:0/4002438699 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:35.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17b7fe700 1 --2- 172.21.15.154:0/4002438699 >> v2:172.21.15.154:3300/0 conn(0x7ff17c133f70 0x7ff17c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17b7fe700 1 -- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c0a0a70 msgr2=0x7ff17c0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17b7fe700 1 --2- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c0a0a70 0x7ff17c0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17b7fe700 1 -- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 msgr2=0x7ff17c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17b7fe700 1 --2- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 0x7ff17c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17b7fe700 1 -- 172.21.15.154:0/4002438699 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c0a2fa0 con 0x7ff17c133f70 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17bfff700 1 --2- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 0x7ff17c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.515+0000 7ff17b7fe700 1 --2- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c133f70 0x7ff17c1343a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff170009870 tx=0x7ff170009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ae3cdd23861987 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff17affd700 1 -- 172.21.15.154:0/4002438699 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170011830 con 0x7ff17c133f70 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff17affd700 1 -- 172.21.15.154:0/4002438699 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170011990 con 0x7ff17c133f70 2023-09-30T22:26:35.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff17affd700 1 -- 172.21.15.154:0/4002438699 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170011d20 con 0x7ff17c133f70 2023-09-30T22:26:35.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff18265d700 1 -- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c133f70 msgr2=0x7ff17c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff18265d700 1 --2- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c133f70 0x7ff17c1343a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff170009870 tx=0x7ff170009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff18265d700 1 -- 172.21.15.154:0/4002438699 shutdown_connections 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff18265d700 1 --2- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 0x7ff17c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff18265d700 1 --2- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c0a0a70 0x7ff17c0a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff18265d700 1 --2- 172.21.15.154:0/4002438699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c133f70 0x7ff17c1343a0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.516+0000 7ff18265d700 1 -- 172.21.15.154:0/4002438699 >> 172.21.15.154:0/4002438699 conn(0x7ff17c099c40 msgr2=0x7ff17c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.517+0000 7ff18265d700 1 -- 172.21.15.154:0/4002438699 shutdown_connections 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.517+0000 7ff18265d700 1 -- 172.21.15.154:0/4002438699 wait complete. 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.518+0000 7ff18265d700 1 Processor -- start 2023-09-30T22:26:35.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.518+0000 7ff18265d700 1 -- start start 2023-09-30T22:26:35.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff18265d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 0x7ff17c121310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff18265d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c0a0a70 0x7ff17c121850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff18265d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c133f70 0x7ff17c121d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff18265d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c123df0 con 0x7ff17c0a0a70 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff18265d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c124e30 con 0x7ff17c09ad40 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff18265d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c124920 con 0x7ff17c133f70 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff17b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c0a0a70 0x7ff17c121850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff180bfa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c133f70 0x7ff17c121d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff17b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c0a0a70 0x7ff17c121850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47056/0 (socket says 172.21.15.154:47056) 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff17b7fe700 1 -- 172.21.15.154:0/1361675284 learned_addr learned my addr 172.21.15.154:0/1361675284 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff180bfa700 1 -- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 msgr2=0x7ff17c121310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff180bfa700 1 --2- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 0x7ff17c121310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff180bfa700 1 -- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c0a0a70 msgr2=0x7ff17c121850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.519+0000 7ff180bfa700 1 --2- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c0a0a70 0x7ff17c121850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.520+0000 7ff180bfa700 1 -- 172.21.15.154:0/1361675284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009550 con 0x7ff17c133f70 2023-09-30T22:26:35.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.520+0000 7ff17b7fe700 1 --2- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c0a0a70 0x7ff17c121850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:35.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.520+0000 7ff180bfa700 1 --2- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c133f70 0x7ff17c121d90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff17400be20 tx=0x7ff17400bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.520+0000 7ff178ff9700 1 -- 172.21.15.154:0/1361675284 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17400cd10 con 0x7ff17c133f70 2023-09-30T22:26:35.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.520+0000 7ff178ff9700 1 -- 172.21.15.154:0/1361675284 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17400ce90 con 0x7ff17c133f70 2023-09-30T22:26:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.520+0000 7ff18265d700 1 -- 172.21.15.154:0/1361675284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1700094a0 con 0x7ff17c133f70 2023-09-30T22:26:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.520+0000 7ff178ff9700 1 -- 172.21.15.154:0/1361675284 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174014680 con 0x7ff17c133f70 2023-09-30T22:26:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.520+0000 7ff18265d700 1 -- 172.21.15.154:0/1361675284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c133a30 con 0x7ff17c133f70 2023-09-30T22:26:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.522+0000 7ff178ff9700 1 -- 172.21.15.154:0/1361675284 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff17401d3b0 con 0x7ff17c133f70 2023-09-30T22:26:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.522+0000 7ff18265d700 1 -- 172.21.15.154:0/1361675284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c09c840 con 0x7ff17c133f70 2023-09-30T22:26:35.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.522+0000 7ff178ff9700 1 -- 172.21.15.154:0/1361675284 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff174006e40 con 0x7ff17c133f70 2023-09-30T22:26:35.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.528+0000 7ff178ff9700 1 -- 172.21.15.154:0/1361675284 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff17401c360 con 0x7ff17c133f70 2023-09-30T22:26:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.591+0000 7f9bbcbf3700 1 Processor -- start 2023-09-30T22:26:35.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.591+0000 7f9bbcbf3700 1 -- start start 2023-09-30T22:26:35.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bbcbf3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8136960 0x7f9bb8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bbcbf3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bbcbf3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb806b2d0 con 0x7f9bb8133ad0 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bbcbf3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81345b0 con 0x7f9bb8139280 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bbcbf3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8133610 con 0x7f9bb8136960 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8136960 0x7f9bb8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb6d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8136960 0x7f9bb8138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45934/0 (socket says 172.21.15.154:45934) 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb5d9b700 1 -- 172.21.15.154:0/3368861355 learned_addr learned my addr 172.21.15.154:0/3368861355 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb659c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9bb8133ad0 0x7f9bb8133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41996/0 (socket says 172.21.15.154:41996) 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb6d9d700 1 --2- 172.21.15.154:0/3368861355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34438/0 (socket says 172.21.15.154:34438) 2023-09-30T22:26:35.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb5d9b700 1 -- 172.21.15.154:0/3368861355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 msgr2=0x7f9bb813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb5d9b700 1 --2- 172.21.15.154:0/3368861355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb5d9b700 1 -- 172.21.15.154:0/3368861355 >> v1:172.21.15.154:6789/0 conn(0x7f9bb8133ad0 legacy=0x7f9bb8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.592+0000 7f9bb559a700 1 -- 172.21.15.154:0/3368861355 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087751924 0 0) 0x7f9bb806b2d0 con 0x7f9bb8133ad0 2023-09-30T22:26:35.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.593+0000 7f9bb5d9b700 1 -- 172.21.15.154:0/3368861355 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb809a500 con 0x7f9bb8136960 2023-09-30T22:26:35.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.593+0000 7f9bb5d9b700 1 --2- 172.21.15.154:0/3368861355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8136960 0x7f9bb8138d40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009920 tx=0x7f9bac009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=931bc8f73de1207c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.593+0000 7f9bb559a700 1 -- 172.21.15.154:0/3368861355 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac011830 con 0x7f9bb8136960 2023-09-30T22:26:35.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.593+0000 7f9bb559a700 1 -- 172.21.15.154:0/3368861355 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac011990 con 0x7f9bb8136960 2023-09-30T22:26:35.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.593+0000 7f9bb559a700 1 -- 172.21.15.154:0/3368861355 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac011d20 con 0x7f9bb8136960 2023-09-30T22:26:35.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.594+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/3368861355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8136960 msgr2=0x7f9bb8138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.594+0000 7f9bbcbf3700 1 --2- 172.21.15.154:0/3368861355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8136960 0x7f9bb8138d40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009920 tx=0x7f9bac009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:35.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.594+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/3368861355 shutdown_connections 2023-09-30T22:26:35.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.594+0000 7f9bbcbf3700 1 --2- 172.21.15.154:0/3368861355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.594+0000 7f9bbcbf3700 1 --2- 172.21.15.154:0/3368861355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8136960 0x7f9bb8138d40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.594+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/3368861355 >> 172.21.15.154:0/3368861355 conn(0x7f9bb8099c40 msgr2=0x7f9bb80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.594+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/3368861355 shutdown_connections 2023-09-30T22:26:35.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.594+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/3368861355 wait complete. 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.595+0000 7f9bbcbf3700 1 Processor -- start 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.595+0000 7f9bbcbf3700 1 -- start start 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.595+0000 7f9bbcbf3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8133ad0 0x7f9bb812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.595+0000 7f9bbcbf3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bb8136960 0x7f9bb812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.595+0000 7f9bbcbf3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.595+0000 7f9bbcbf3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80701e0 con 0x7f9bb8136960 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.595+0000 7f9bbcbf3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8130230 con 0x7f9bb8139280 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.595+0000 7f9bbcbf3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb806eb60 con 0x7f9bb8133ad0 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8133ad0 0x7f9bb812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8133ad0 0x7f9bb812cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45940/0 (socket says 172.21.15.154:45940) 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb659c700 1 -- 172.21.15.154:0/2284837922 learned_addr learned my addr 172.21.15.154:0/2284837922 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:35.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb5d9b700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bb8136960 0x7f9bb812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb6d9d700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb5d9b700 1 -- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8133ad0 msgr2=0x7f9bb812cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb5d9b700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8133ad0 0x7f9bb812cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb5d9b700 1 -- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 msgr2=0x7f9bb812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb5d9b700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb812d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb5d9b700 1 -- 172.21.15.154:0/2284837922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac009550 con 0x7f9bb8136960 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb6d9d700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9bb5d9b700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bb8136960 0x7f9bb812d070 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f9bac016000 tx=0x7f9bac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.596+0000 7f9ba6ffd700 1 -- 172.21.15.154:0/2284837922 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac004240 con 0x7f9bb8136960 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.597+0000 7f9ba6ffd700 1 -- 172.21.15.154:0/2284837922 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac01f070 con 0x7f9bb8136960 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.597+0000 7f9ba6ffd700 1 -- 172.21.15.154:0/2284837922 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac0045e0 con 0x7f9bb8136960 2023-09-30T22:26:35.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.597+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/2284837922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb8138db0 con 0x7f9bb8136960 2023-09-30T22:26:35.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.597+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/2284837922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb8070c50 con 0x7f9bb8136960 2023-09-30T22:26:35.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.598+0000 7f9ba6ffd700 1 -- 172.21.15.154:0/2284837922 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bac021030 con 0x7f9bb8136960 2023-09-30T22:26:35.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.598+0000 7f9ba6ffd700 1 -- 172.21.15.154:0/2284837922 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9bac03ff40 con 0x7f9bb8136960 2023-09-30T22:26:35.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.598+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/2284837922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb804f2a0 con 0x7f9bb8136960 2023-09-30T22:26:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.607+0000 7f9ba6ffd700 1 -- 172.21.15.154:0/2284837922 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bac015080 con 0x7f9bb8136960 2023-09-30T22:26:35.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.631+0000 7f4e8829c700 1 Processor -- start 2023-09-30T22:26:35.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.632+0000 7f4e8829c700 1 -- start start 2023-09-30T22:26:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.632+0000 7f4e8829c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e8009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.632+0000 7f4e8829c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e80134330 0x7f4e8013be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.632+0000 7f4e8829c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8009fa00 con 0x7f4e8009f180 2023-09-30T22:26:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.632+0000 7f4e8829c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e800a0370 con 0x7f4e80134330 2023-09-30T22:26:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.632+0000 7f4e8829c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8006bec0 con 0x7f4e8009e870 2023-09-30T22:26:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.632+0000 7f4e86839700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e80134330 0x7f4e8013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.632+0000 7f4e86839700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e80134330 0x7f4e8013be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47074/0 (socket says 172.21.15.154:47074) 2023-09-30T22:26:35.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.632+0000 7f4e86839700 1 -- 172.21.15.154:0/2595814428 learned_addr learned my addr 172.21.15.154:0/2595814428 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e86038700 1 --2- 172.21.15.154:0/2595814428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e8009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e85036700 1 -- 172.21.15.154:0/2595814428 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2599717219 0 0) 0x7f4e8009fa00 con 0x7f4e8009f180 2023-09-30T22:26:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e85036700 1 -- 172.21.15.154:0/2595814428 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e6c0035b0 con 0x7f4e8009f180 2023-09-30T22:26:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e86038700 1 -- 172.21.15.154:0/2595814428 >> v2:172.21.15.154:3300/0 conn(0x7f4e80134330 msgr2=0x7f4e8013be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e86038700 1 --2- 172.21.15.154:0/2595814428 >> v2:172.21.15.154:3300/0 conn(0x7f4e80134330 0x7f4e8013be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e86038700 1 -- 172.21.15.154:0/2595814428 >> v1:172.21.15.154:6789/0 conn(0x7f4e8009f180 legacy=0x7f4e80133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e86038700 1 -- 172.21.15.154:0/2595814428 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8009ada0 con 0x7f4e8009e870 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e86038700 1 --2- 172.21.15.154:0/2595814428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e8009ec40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009840 tx=0x7f4e7c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e9a179ed2deaac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e85036700 1 -- 172.21.15.154:0/2595814428 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c011830 con 0x7f4e8009e870 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e85036700 1 -- 172.21.15.154:0/2595814428 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c011990 con 0x7f4e8009e870 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.633+0000 7f4e85036700 1 -- 172.21.15.154:0/2595814428 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c011d20 con 0x7f4e8009e870 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.634+0000 7f4e8829c700 1 -- 172.21.15.154:0/2595814428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 msgr2=0x7f4e8009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.634+0000 7f4e8829c700 1 --2- 172.21.15.154:0/2595814428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e8009ec40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009840 tx=0x7f4e7c009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.634+0000 7f4e8829c700 1 -- 172.21.15.154:0/2595814428 shutdown_connections 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.634+0000 7f4e8829c700 1 --2- 172.21.15.154:0/2595814428 >> v2:172.21.15.154:3300/0 conn(0x7f4e80134330 0x7f4e8013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.634+0000 7f4e8829c700 1 --2- 172.21.15.154:0/2595814428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e8009ec40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.634+0000 7f4e8829c700 1 -- 172.21.15.154:0/2595814428 >> 172.21.15.154:0/2595814428 conn(0x7f4e800a4430 msgr2=0x7f4e800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.634+0000 7f4e8829c700 1 -- 172.21.15.154:0/2595814428 shutdown_connections 2023-09-30T22:26:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.634+0000 7f4e8829c700 1 -- 172.21.15.154:0/2595814428 wait complete. 2023-09-30T22:26:35.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.635+0000 7f4e8829c700 1 Processor -- start 2023-09-30T22:26:35.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.635+0000 7f4e8829c700 1 -- start start 2023-09-30T22:26:35.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e8829c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e801227f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e8829c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e8009f180 0x7f4e80122d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e8829c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e80134330 0x7f4e80123270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e8829c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e801262c0 con 0x7f4e80134330 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e8829c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8006cfa0 con 0x7f4e8009e870 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e8829c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e801243b0 con 0x7f4e8009f180 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e86038700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e801227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e86038700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e801227f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34460/0 (socket says 172.21.15.154:34460) 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e86038700 1 -- 172.21.15.154:0/344009734 learned_addr learned my addr 172.21.15.154:0/344009734 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e85837700 1 --2- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e8009f180 0x7f4e80122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e86038700 1 -- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e8009f180 msgr2=0x7f4e80122d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e86038700 1 --2- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e8009f180 0x7f4e80122d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e86038700 1 -- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e80134330 msgr2=0x7f4e80123270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e86038700 1 --2- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e80134330 0x7f4e80123270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e86038700 1 -- 172.21.15.154:0/344009734 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0094a0 con 0x7f4e8009e870 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e86038700 1 --2- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e801227f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0090b0 tx=0x7f4e7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.636+0000 7f4e76ffd700 1 -- 172.21.15.154:0/344009734 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0036a0 con 0x7f4e8009e870 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.637+0000 7f4e76ffd700 1 -- 172.21.15.154:0/344009734 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c01f070 con 0x7f4e8009e870 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.637+0000 7f4e8829c700 1 -- 172.21.15.154:0/344009734 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e80124bd0 con 0x7f4e8009e870 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.637+0000 7f4e76ffd700 1 -- 172.21.15.154:0/344009734 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c003a40 con 0x7f4e8009e870 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.637+0000 7f4e8829c700 1 -- 172.21.15.154:0/344009734 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e801332c0 con 0x7f4e8009e870 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.637+0000 7f4e76ffd700 1 -- 172.21.15.154:0/344009734 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e7c003ba0 con 0x7f4e8009e870 2023-09-30T22:26:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.638+0000 7f4e76ffd700 1 -- 172.21.15.154:0/344009734 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e7c021070 con 0x7f4e8009e870 2023-09-30T22:26:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.641+0000 7f4e8829c700 1 -- 172.21.15.154:0/344009734 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e80125e60 con 0x7f4e8009e870 2023-09-30T22:26:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.641+0000 7f81be9f9700 1 Processor -- start 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.641+0000 7f81be9f9700 1 -- start start 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81be9f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 0x7f81b8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81be9f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a08e0 0x7f81b80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81be9f9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81b80a1230 0x7f81b813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81be9f9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b80a2100 con 0x7f81b80a1230 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81be9f9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8138950 con 0x7f81b8138040 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81be9f9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b81379e0 con 0x7f81b80a08e0 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a08e0 0x7f81b80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a08e0 0x7f81b80a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:45960/0 (socket says 172.21.15.154:45960) 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b77fe700 1 -- 172.21.15.154:0/2849571878 learned_addr learned my addr 172.21.15.154:0/2849571878 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81bcf96700 1 --2- 172.21.15.154:0/2849571878 >> v2:172.21.15.154:3300/0 conn(0x7f81b80a1230 0x7f81b813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b7fff700 1 --2- 172.21.15.154:0/2849571878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 0x7f81b8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b77fe700 1 -- 172.21.15.154:0/2849571878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 msgr2=0x7f81b8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b77fe700 1 --2- 172.21.15.154:0/2849571878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 0x7f81b8138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b77fe700 1 -- 172.21.15.154:0/2849571878 >> v2:172.21.15.154:3300/0 conn(0x7f81b80a1230 msgr2=0x7f81b813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b77fe700 1 --2- 172.21.15.154:0/2849571878 >> v2:172.21.15.154:3300/0 conn(0x7f81b80a1230 0x7f81b813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b77fe700 1 -- 172.21.15.154:0/2849571878 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b809b9b0 con 0x7f81b80a08e0 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81bcf96700 1 --2- 172.21.15.154:0/2849571878 >> v2:172.21.15.154:3300/0 conn(0x7f81b80a1230 0x7f81b813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b77fe700 1 --2- 172.21.15.154:0/2849571878 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a08e0 0x7f81b80a0cf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009950 tx=0x7f81ac009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=188f5ed3f6f84020 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.642+0000 7f81b6ffd700 1 -- 172.21.15.154:0/2849571878 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac011830 con 0x7f81b80a08e0 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81b6ffd700 1 -- 172.21.15.154:0/2849571878 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac011990 con 0x7f81b80a08e0 2023-09-30T22:26:35.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81b6ffd700 1 -- 172.21.15.154:0/2849571878 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac011d40 con 0x7f81b80a08e0 2023-09-30T22:26:35.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81be9f9700 1 -- 172.21.15.154:0/2849571878 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a08e0 msgr2=0x7f81b80a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81be9f9700 1 --2- 172.21.15.154:0/2849571878 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a08e0 0x7f81b80a0cf0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009950 tx=0x7f81ac009c60 comp rx=0 tx=0).stop 2023-09-30T22:26:35.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81be9f9700 1 -- 172.21.15.154:0/2849571878 shutdown_connections 2023-09-30T22:26:35.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81be9f9700 1 --2- 172.21.15.154:0/2849571878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 0x7f81b8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81be9f9700 1 --2- 172.21.15.154:0/2849571878 >> v2:172.21.15.154:3300/0 conn(0x7f81b80a1230 0x7f81b813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81be9f9700 1 --2- 172.21.15.154:0/2849571878 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a08e0 0x7f81b80a0cf0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81be9f9700 1 -- 172.21.15.154:0/2849571878 >> 172.21.15.154:0/2849571878 conn(0x7f81b80a2980 msgr2=0x7f81b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81be9f9700 1 -- 172.21.15.154:0/2849571878 shutdown_connections 2023-09-30T22:26:35.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.643+0000 7f81be9f9700 1 -- 172.21.15.154:0/2849571878 wait complete. 2023-09-30T22:26:35.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.644+0000 7f81be9f9700 1 Processor -- start 2023-09-30T22:26:35.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81be9f9700 1 -- start start 2023-09-30T22:26:35.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81be9f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b80a08e0 0x7f81b8126390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81be9f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a1230 0x7f81b81268d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81be9f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 0x7f81b8126e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81be9f9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b81298c0 con 0x7f81b80a08e0 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81be9f9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8129c60 con 0x7f81b8138040 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81be9f9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b81277f0 con 0x7f81b80a1230 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81b7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b80a08e0 0x7f81b8126390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81b7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b80a08e0 0x7f81b8126390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47104/0 (socket says 172.21.15.154:47104) 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.645+0000 7f81b7fff700 1 -- 172.21.15.154:0/1465523098 learned_addr learned my addr 172.21.15.154:0/1465523098 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81bcf96700 1 --2- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 0x7f81b8126e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b77fe700 1 --2- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a1230 0x7f81b81268d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:35.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b7fff700 1 -- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a1230 msgr2=0x7f81b81268d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b7fff700 1 --2- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a1230 0x7f81b81268d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b7fff700 1 -- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 msgr2=0x7f81b8126e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b7fff700 1 --2- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 0x7f81b8126e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b7fff700 1 -- 172.21.15.154:0/1465523098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0009a70 con 0x7f81b80a08e0 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b7fff700 1 --2- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b80a08e0 0x7f81b8126390 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f81a800e990 tx=0x7f81a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b4ff9700 1 -- 172.21.15.154:0/1465523098 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a80096f0 con 0x7f81b80a08e0 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b4ff9700 1 -- 172.21.15.154:0/1465523098 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a800c5e0 con 0x7f81b80a08e0 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81b4ff9700 1 -- 172.21.15.154:0/1465523098 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a800c950 con 0x7f81b80a08e0 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81be9f9700 1 -- 172.21.15.154:0/1465523098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac009550 con 0x7f81b80a08e0 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.646+0000 7f81be9f9700 1 -- 172.21.15.154:0/1465523098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b8127ff0 con 0x7f81b80a08e0 2023-09-30T22:26:35.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.648+0000 7f81be9f9700 1 -- 172.21.15.154:0/1465523098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b809a2a0 con 0x7f81b80a08e0 2023-09-30T22:26:35.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.648+0000 7f81b4ff9700 1 -- 172.21.15.154:0/1465523098 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81a800ccc0 con 0x7f81b80a08e0 2023-09-30T22:26:35.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.648+0000 7f81b4ff9700 1 -- 172.21.15.154:0/1465523098 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81a8040120 con 0x7f81b80a08e0 2023-09-30T22:26:35.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.651+0000 7f4e76ffd700 1 -- 172.21.15.154:0/344009734 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e80125e60 con 0x7f4e8009e870 2023-09-30T22:26:35.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.657+0000 7f81b4ff9700 1 -- 172.21.15.154:0/1465523098 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81a8011350 con 0x7f81b80a08e0 2023-09-30T22:26:35.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.732+0000 7ff18265d700 1 -- 172.21.15.154:0/1361675284 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff17c11e060 con 0x7ff17c133f70 2023-09-30T22:26:35.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.732+0000 7ff178ff9700 1 -- 172.21.15.154:0/1361675284 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff174019070 con 0x7ff17c133f70 2023-09-30T22:26:35.733 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:35.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.735+0000 7ff18265d700 1 -- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c133f70 msgr2=0x7ff17c121d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.735+0000 7ff18265d700 1 --2- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c133f70 0x7ff17c121d90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff17400be20 tx=0x7ff17400bf00 comp rx=0 tx=0).stop 2023-09-30T22:26:35.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.735+0000 7ff18265d700 1 -- 172.21.15.154:0/1361675284 shutdown_connections 2023-09-30T22:26:35.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.735+0000 7ff18265d700 1 --2- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff17c133f70 0x7ff17c121d90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.735+0000 7ff18265d700 1 --2- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff17c09ad40 0x7ff17c121310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.735+0000 7ff18265d700 1 --2- 172.21.15.154:0/1361675284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff17c0a0a70 0x7ff17c121850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.735+0000 7ff18265d700 1 -- 172.21.15.154:0/1361675284 >> 172.21.15.154:0/1361675284 conn(0x7ff17c099c40 msgr2=0x7ff17c133320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.735+0000 7ff18265d700 1 -- 172.21.15.154:0/1361675284 shutdown_connections 2023-09-30T22:26:35.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.735+0000 7ff18265d700 1 -- 172.21.15.154:0/1361675284 wait complete. 2023-09-30T22:26:35.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:35.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.821+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/2284837922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9bb809f0f0 con 0x7f9bb8136960 2023-09-30T22:26:35.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.821+0000 7f9ba6ffd700 1 -- 172.21.15.154:0/2284837922 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bac029020 con 0x7f9bb8136960 2023-09-30T22:26:35.822 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:35.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.823+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bb8136960 msgr2=0x7f9bb812d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.823+0000 7f9bbcbf3700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bb8136960 0x7f9bb812d070 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f9bac016000 tx=0x7f9bac004750 comp rx=0 tx=0).stop 2023-09-30T22:26:35.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.823+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/2284837922 shutdown_connections 2023-09-30T22:26:35.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.823+0000 7f9bbcbf3700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bb8139280 0x7f9bb812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.823+0000 7f9bbcbf3700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9bb8133ad0 0x7f9bb812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.823+0000 7f9bbcbf3700 1 --2- 172.21.15.154:0/2284837922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bb8136960 0x7f9bb812d070 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.823+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/2284837922 >> 172.21.15.154:0/2284837922 conn(0x7f9bb8099c40 msgr2=0x7f9bb81385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.823+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/2284837922 shutdown_connections 2023-09-30T22:26:35.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.823+0000 7f9bbcbf3700 1 -- 172.21.15.154:0/2284837922 wait complete. 2023-09-30T22:26:35.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:35.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.845+0000 7f4e8829c700 1 -- 172.21.15.154:0/344009734 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e8006c9d0 con 0x7f4e8009e870 2023-09-30T22:26:35.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.845+0000 7f4e76ffd700 1 -- 172.21.15.154:0/344009734 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e7c02b080 con 0x7f4e8009e870 2023-09-30T22:26:35.846 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:35.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.847+0000 7f4e8829c700 1 -- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 msgr2=0x7f4e801227f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.847+0000 7f4e8829c700 1 --2- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e801227f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0090b0 tx=0x7f4e7c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:35.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.847+0000 7f4e8829c700 1 -- 172.21.15.154:0/344009734 shutdown_connections 2023-09-30T22:26:35.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.847+0000 7f4e8829c700 1 --2- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e80134330 0x7f4e80123270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.847+0000 7f4e8829c700 1 --2- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e8009e870 0x7f4e801227f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.847+0000 7f4e8829c700 1 --2- 172.21.15.154:0/344009734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e8009f180 0x7f4e80122d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.847+0000 7f4e8829c700 1 -- 172.21.15.154:0/344009734 >> 172.21.15.154:0/344009734 conn(0x7f4e800a4430 msgr2=0x7f4e80070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.847+0000 7f4e8829c700 1 -- 172.21.15.154:0/344009734 shutdown_connections 2023-09-30T22:26:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.847+0000 7f4e8829c700 1 -- 172.21.15.154:0/344009734 wait complete. 2023-09-30T22:26:35.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.851+0000 7f81be9f9700 1 -- 172.21.15.154:0/1465523098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81b804f2a0 con 0x7f81b80a08e0 2023-09-30T22:26:35.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.851+0000 7f81b4ff9700 1 -- 172.21.15.154:0/1465523098 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81a802b090 con 0x7f81b80a08e0 2023-09-30T22:26:35.852 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.853+0000 7f81be9f9700 1 -- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b80a08e0 msgr2=0x7f81b8126390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.853+0000 7f81be9f9700 1 --2- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b80a08e0 0x7f81b8126390 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f81a800e990 tx=0x7f81a800eca0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.853+0000 7f81be9f9700 1 -- 172.21.15.154:0/1465523098 shutdown_connections 2023-09-30T22:26:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.853+0000 7f81be9f9700 1 --2- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81b8138040 0x7f81b8126e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.853+0000 7f81be9f9700 1 --2- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b80a08e0 0x7f81b8126390 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.853+0000 7f81be9f9700 1 --2- 172.21.15.154:0/1465523098 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f81b80a1230 0x7f81b81268d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.853+0000 7f81be9f9700 1 -- 172.21.15.154:0/1465523098 >> 172.21.15.154:0/1465523098 conn(0x7f81b80a2980 msgr2=0x7f81b809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.853+0000 7f81be9f9700 1 -- 172.21.15.154:0/1465523098 shutdown_connections 2023-09-30T22:26:35.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:35.853+0000 7f81be9f9700 1 -- 172.21.15.154:0/1465523098 wait complete. 2023-09-30T22:26:35.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:35.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:36.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:36.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:36.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:36.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:36.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.878+0000 7f0e01eb5700 1 Processor -- start 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0e01eb5700 1 -- start start 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0e01eb5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0e01eb5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0dfc133f70 0x7f0dfc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0e01eb5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 0x7f0dfc0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0e01eb5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc0a3b60 con 0x7f0dfc133f70 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0e01eb5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc1348e0 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0e01eb5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc09b110 con 0x7f0dfc09ad40 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0dfaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0dfc133f70 0x7f0dfc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0dfaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0dfc133f70 0x7f0dfc1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47112/0 (socket says 172.21.15.154:47112) 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0dfaffd700 1 -- 172.21.15.154:0/1859219808 learned_addr learned my addr 172.21.15.154:0/1859219808 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:36.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0dfb7fe700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.879+0000 7f0dfbfff700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 0x7f0dfc0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfaffd700 1 -- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 msgr2=0x7f0dfc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfaffd700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfaffd700 1 -- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 msgr2=0x7f0dfc0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfaffd700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 0x7f0dfc0a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfaffd700 1 -- 172.21.15.154:0/1859219808 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc0a2fa0 con 0x7f0dfc133f70 2023-09-30T22:26:36.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfb7fe700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:36.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfaffd700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc133f70 0x7f0dfc1343a0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009920 tx=0x7f0df0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f1d7576f1bb595 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfa7fc700 1 -- 172.21.15.154:0/1859219808 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0011830 con 0x7f0dfc133f70 2023-09-30T22:26:36.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfa7fc700 1 -- 172.21.15.154:0/1859219808 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df0011990 con 0x7f0dfc133f70 2023-09-30T22:26:36.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.880+0000 7f0dfa7fc700 1 -- 172.21.15.154:0/1859219808 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0011d20 con 0x7f0dfc133f70 2023-09-30T22:26:36.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.881+0000 7f0e01eb5700 1 -- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc133f70 msgr2=0x7f0dfc1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.881+0000 7f0e01eb5700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc133f70 0x7f0dfc1343a0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009920 tx=0x7f0df0009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:36.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.881+0000 7f0e01eb5700 1 -- 172.21.15.154:0/1859219808 shutdown_connections 2023-09-30T22:26:36.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.881+0000 7f0e01eb5700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 0x7f0dfc0a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.881+0000 7f0e01eb5700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.881+0000 7f0e01eb5700 1 --2- 172.21.15.154:0/1859219808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc133f70 0x7f0dfc1343a0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.881+0000 7f0e01eb5700 1 -- 172.21.15.154:0/1859219808 >> 172.21.15.154:0/1859219808 conn(0x7f0dfc099c40 msgr2=0x7f0dfc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:36.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.881+0000 7f0e01eb5700 1 -- 172.21.15.154:0/1859219808 shutdown_connections 2023-09-30T22:26:36.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.881+0000 7f0e01eb5700 1 -- 172.21.15.154:0/1859219808 wait complete. 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.882+0000 7f0e01eb5700 1 Processor -- start 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.882+0000 7f0e01eb5700 1 -- start start 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0e01eb5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0e01eb5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 0x7f0dfc1217c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0e01eb5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc133f70 0x7f0dfc121d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0e01eb5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc124da0 con 0x7f0dfc133f70 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0e01eb5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc123d40 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0e01eb5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc1226e0 con 0x7f0dfc09ad40 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0dfb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0dfb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc121280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46002/0 (socket says 172.21.15.154:46002) 2023-09-30T22:26:36.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0dfaffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 0x7f0dfc1217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0dfb7fe700 1 -- 172.21.15.154:0/3696137161 learned_addr learned my addr 172.21.15.154:0/3696137161 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.883+0000 7f0dfbfff700 1 --2- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc133f70 0x7f0dfc121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0dfaffd700 1 -- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 msgr2=0x7f0dfc121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0dfaffd700 1 --2- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0dfaffd700 1 -- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc133f70 msgr2=0x7f0dfc121d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0dfaffd700 1 --2- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc133f70 0x7f0dfc121d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0dfaffd700 1 -- 172.21.15.154:0/3696137161 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec0094a0 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0dfaffd700 1 --2- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 0x7f0dfc1217c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0df0016000 tx=0x7f0df0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0de3fff700 1 -- 172.21.15.154:0/3696137161 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0004450 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0de3fff700 1 -- 172.21.15.154:0/3696137161 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df001f070 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0e01eb5700 1 -- 172.21.15.154:0/3696137161 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df0009550 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0de3fff700 1 -- 172.21.15.154:0/3696137161 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00045f0 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.884+0000 7f0e01eb5700 1 -- 172.21.15.154:0/3696137161 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc124800 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.885+0000 7f0de3fff700 1 -- 172.21.15.154:0/3696137161 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0df00038e0 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.885+0000 7f0de3fff700 1 -- 172.21.15.154:0/3696137161 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0df0021070 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.886+0000 7f0e01eb5700 1 -- 172.21.15.154:0/3696137161 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc11e060 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.891+0000 7f0de3fff700 1 -- 172.21.15.154:0/3696137161 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0df0015020 con 0x7f0dfc0a0a70 2023-09-30T22:26:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.994+0000 7f1f6e165700 1 Processor -- start 2023-09-30T22:26:36.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.994+0000 7f1f6e165700 1 -- start start 2023-09-30T22:26:36.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f6e165700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f68133900 0x7f1f68133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f6e165700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68134210 0x7f1f680a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f6e165700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 0x7f1f680a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:36.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f6e165700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6809a760 con 0x7f1f68133900 2023-09-30T22:26:36.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f6e165700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f681336e0 con 0x7f1f68134210 2023-09-30T22:26:36.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f6e165700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6809a080 con 0x7f1f680a0ee0 2023-09-30T22:26:36.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f677fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f68133900 0x7f1f68133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f677fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f68133900 0x7f1f68133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47124/0 (socket says 172.21.15.154:47124) 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f677fe700 1 -- 172.21.15.154:0/4226976695 learned_addr learned my addr 172.21.15.154:0/4226976695 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.995+0000 7f1f66ffd700 1 --2- 172.21.15.154:0/4226976695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68134210 0x7f1f680a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f66ffd700 1 -- 172.21.15.154:0/4226976695 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 msgr2=0x7f1f680a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f66ffd700 1 --2- 172.21.15.154:0/4226976695 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 0x7f1f680a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f66ffd700 1 -- 172.21.15.154:0/4226976695 >> v2:172.21.15.154:3300/0 conn(0x7f1f68133900 msgr2=0x7f1f68133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f66ffd700 1 --2- 172.21.15.154:0/4226976695 >> v2:172.21.15.154:3300/0 conn(0x7f1f68133900 0x7f1f68133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f66ffd700 1 -- 172.21.15.154:0/4226976695 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680a23e0 con 0x7f1f68134210 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f677fe700 1 --2- 172.21.15.154:0/4226976695 >> v2:172.21.15.154:3300/0 conn(0x7f1f68133900 0x7f1f68133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f66ffd700 1 --2- 172.21.15.154:0/4226976695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68134210 0x7f1f680a09a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009840 tx=0x7f1f5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee88b4e7681a883b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f667fc700 1 -- 172.21.15.154:0/4226976695 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c011830 con 0x7f1f68134210 2023-09-30T22:26:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f667fc700 1 -- 172.21.15.154:0/4226976695 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c011990 con 0x7f1f68134210 2023-09-30T22:26:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.996+0000 7f1f667fc700 1 -- 172.21.15.154:0/4226976695 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c011d20 con 0x7f1f68134210 2023-09-30T22:26:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.997+0000 7f1f6e165700 1 -- 172.21.15.154:0/4226976695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68134210 msgr2=0x7f1f680a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.997+0000 7f1f6e165700 1 --2- 172.21.15.154:0/4226976695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68134210 0x7f1f680a09a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009840 tx=0x7f1f5c009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.997+0000 7f1f6e165700 1 -- 172.21.15.154:0/4226976695 shutdown_connections 2023-09-30T22:26:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.997+0000 7f1f6e165700 1 --2- 172.21.15.154:0/4226976695 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 0x7f1f680a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.997+0000 7f1f6e165700 1 --2- 172.21.15.154:0/4226976695 >> v2:172.21.15.154:3300/0 conn(0x7f1f68133900 0x7f1f68133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.997+0000 7f1f6e165700 1 --2- 172.21.15.154:0/4226976695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68134210 0x7f1f680a09a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.997+0000 7f1f6e165700 1 -- 172.21.15.154:0/4226976695 >> 172.21.15.154:0/4226976695 conn(0x7f1f680a2980 msgr2=0x7f1f680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.997+0000 7f1f6e165700 1 -- 172.21.15.154:0/4226976695 shutdown_connections 2023-09-30T22:26:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.997+0000 7f1f6e165700 1 -- 172.21.15.154:0/4226976695 wait complete. 2023-09-30T22:26:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.998+0000 7f1f6e165700 1 Processor -- start 2023-09-30T22:26:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f6e165700 1 -- start start 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f6e165700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 0x7f1f6811c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f6e165700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68133900 0x7f1f6811cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f6e165700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f68134210 0x7f1f6811d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f6e165700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6811dbc0 con 0x7f1f68134210 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f6e165700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6811e950 con 0x7f1f68133900 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f6e165700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6811fa10 con 0x7f1f680a0ee0 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 0x7f1f6811c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 0x7f1f6811c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46012/0 (socket says 172.21.15.154:46012) 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f677fe700 1 -- 172.21.15.154:0/1007401408 learned_addr learned my addr 172.21.15.154:0/1007401408 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f67fff700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f68134210 0x7f1f6811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:36.999+0000 7f1f66ffd700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68133900 0x7f1f6811cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f677fe700 1 -- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68133900 msgr2=0x7f1f6811cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f677fe700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68133900 0x7f1f6811cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f677fe700 1 -- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f68134210 msgr2=0x7f1f6811d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f677fe700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f68134210 0x7f1f6811d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f677fe700 1 -- 172.21.15.154:0/1007401408 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58009500 con 0x7f1f680a0ee0 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f67fff700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f68134210 0x7f1f6811d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f677fe700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 0x7f1f6811c760 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800ebe0 tx=0x7f1f5800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f4ffff700 1 -- 172.21.15.154:0/1007401408 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58005a20 con 0x7f1f680a0ee0 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f4ffff700 1 -- 172.21.15.154:0/1007401408 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f58005b80 con 0x7f1f680a0ee0 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f6e165700 1 -- 172.21.15.154:0/1007401408 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c0094a0 con 0x7f1f680a0ee0 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f4ffff700 1 -- 172.21.15.154:0/1007401408 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800c850 con 0x7f1f680a0ee0 2023-09-30T22:26:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.000+0000 7f1f6e165700 1 -- 172.21.15.154:0/1007401408 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f68132e90 con 0x7f1f680a0ee0 2023-09-30T22:26:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.001+0000 7f1f4ffff700 1 -- 172.21.15.154:0/1007401408 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f5800c9b0 con 0x7f1f680a0ee0 2023-09-30T22:26:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.001+0000 7f1f6e165700 1 -- 172.21.15.154:0/1007401408 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6804f2a0 con 0x7f1f680a0ee0 2023-09-30T22:26:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.002+0000 7f1f4ffff700 1 -- 172.21.15.154:0/1007401408 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1f5803f970 con 0x7f1f680a0ee0 2023-09-30T22:26:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.009+0000 7f6cc73c0700 1 Processor -- start 2023-09-30T22:26:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.009+0000 7f6cc73c0700 1 -- start start 2023-09-30T22:26:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.009+0000 7f6cc73c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc01368e0 0x7f6cc0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.009+0000 7f6cc73c0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6cc0139200 0x7f6cc013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.009+0000 7f6cc73c0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc009a760 con 0x7f6cc0133900 2023-09-30T22:26:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.009+0000 7f6cc73c0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc01336e0 con 0x7f6cc0139200 2023-09-30T22:26:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.009+0000 7f6cc73c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc009a080 con 0x7f6cc01368e0 2023-09-30T22:26:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc495b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc01368e0 0x7f6cc0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc495b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc01368e0 0x7f6cc0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46018/0 (socket says 172.21.15.154:46018) 2023-09-30T22:26:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc495b700 1 -- 172.21.15.154:0/804908459 learned_addr learned my addr 172.21.15.154:0/804908459 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc595d700 1 --2- 172.21.15.154:0/804908459 >> v2:172.21.15.154:3300/0 conn(0x7f6cc0139200 0x7f6cc013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f1f4ffff700 1 -- 172.21.15.154:0/1007401408 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f58006030 con 0x7f1f680a0ee0 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc495b700 1 -- 172.21.15.154:0/804908459 >> v2:172.21.15.154:3300/0 conn(0x7f6cc0139200 msgr2=0x7f6cc013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc495b700 1 --2- 172.21.15.154:0/804908459 >> v2:172.21.15.154:3300/0 conn(0x7f6cc0139200 0x7f6cc013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc495b700 1 -- 172.21.15.154:0/804908459 >> v1:172.21.15.154:6789/0 conn(0x7f6cc0133900 legacy=0x7f6cc0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc495b700 1 -- 172.21.15.154:0/804908459 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc00a23e0 con 0x7f6cc01368e0 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc595d700 1 --2- 172.21.15.154:0/804908459 >> v2:172.21.15.154:3300/0 conn(0x7f6cc0139200 0x7f6cc013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cc495b700 1 --2- 172.21.15.154:0/804908459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc01368e0 0x7f6cc0138cc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00098f0 tx=0x7f6cb0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=964a73c90ac7b8ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cb7fff700 1 -- 172.21.15.154:0/804908459 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0011830 con 0x7f6cc01368e0 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cb7fff700 1 -- 172.21.15.154:0/804908459 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0011990 con 0x7f6cc01368e0 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.010+0000 7f6cb7fff700 1 -- 172.21.15.154:0/804908459 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0011d20 con 0x7f6cc01368e0 2023-09-30T22:26:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.011+0000 7f6cc73c0700 1 -- 172.21.15.154:0/804908459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc01368e0 msgr2=0x7f6cc0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.011+0000 7f6cc73c0700 1 --2- 172.21.15.154:0/804908459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc01368e0 0x7f6cc0138cc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00098f0 tx=0x7f6cb0009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.011+0000 7f6cc73c0700 1 -- 172.21.15.154:0/804908459 shutdown_connections 2023-09-30T22:26:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.011+0000 7f6cc73c0700 1 --2- 172.21.15.154:0/804908459 >> v2:172.21.15.154:3300/0 conn(0x7f6cc0139200 0x7f6cc013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.011+0000 7f6cc73c0700 1 --2- 172.21.15.154:0/804908459 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc01368e0 0x7f6cc0138cc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.011+0000 7f6cc73c0700 1 -- 172.21.15.154:0/804908459 >> 172.21.15.154:0/804908459 conn(0x7f6cc00a2980 msgr2=0x7f6cc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.012+0000 7f6cc73c0700 1 -- 172.21.15.154:0/804908459 shutdown_connections 2023-09-30T22:26:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.012+0000 7f6cc73c0700 1 -- 172.21.15.154:0/804908459 wait complete. 2023-09-30T22:26:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.012+0000 7f6cc73c0700 1 Processor -- start 2023-09-30T22:26:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.012+0000 7f6cc73c0700 1 -- start start 2023-09-30T22:26:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc73c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc0133900 0x7f6cc006e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc73c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc01368e0 0x7f6cc006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc73c0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0139200 0x7f6cc01cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc73c0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc0139060 con 0x7f6cc01368e0 2023-09-30T22:26:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc73c0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc0071540 con 0x7f6cc0139200 2023-09-30T22:26:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc73c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc006fc70 con 0x7f6cc0133900 2023-09-30T22:26:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc495b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc01368e0 0x7f6cc006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc495b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc01368e0 0x7f6cc006e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47156/0 (socket says 172.21.15.154:47156) 2023-09-30T22:26:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc495b700 1 -- 172.21.15.154:0/3746494331 learned_addr learned my addr 172.21.15.154:0/3746494331 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc515c700 1 --2- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc0133900 0x7f6cc006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc595d700 1 --2- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0139200 0x7f6cc01cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc595d700 1 -- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc0133900 msgr2=0x7f6cc006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc595d700 1 --2- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc0133900 0x7f6cc006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc595d700 1 -- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc01368e0 msgr2=0x7f6cc006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc595d700 1 --2- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc01368e0 0x7f6cc006e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.013+0000 7f6cc595d700 1 -- 172.21.15.154:0/3746494331 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb8009a70 con 0x7f6cc0139200 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.014+0000 7f6cc595d700 1 --2- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0139200 0x7f6cc01cc760 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009e50 tx=0x7f6cb800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.014+0000 7f6cb5ffb700 1 -- 172.21.15.154:0/3746494331 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800ca90 con 0x7f6cc0139200 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.014+0000 7f6cb5ffb700 1 -- 172.21.15.154:0/3746494331 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb800f040 con 0x7f6cc0139200 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.014+0000 7f6cc73c0700 1 -- 172.21.15.154:0/3746494331 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb0009550 con 0x7f6cc0139200 2023-09-30T22:26:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.014+0000 7f6cb5ffb700 1 -- 172.21.15.154:0/3746494331 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800ce50 con 0x7f6cc0139200 2023-09-30T22:26:37.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7faddb50b700 1 Processor -- start 2023-09-30T22:26:37.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7f6cc73c0700 1 -- 172.21.15.154:0/3746494331 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc00711e0 con 0x7f6cc0139200 2023-09-30T22:26:37.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7f6cb5ffb700 1 -- 172.21.15.154:0/3746494331 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6cb8014480 con 0x7f6cc0139200 2023-09-30T22:26:37.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7faddb50b700 1 -- start start 2023-09-30T22:26:37.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7faddb50b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409d860 0x7fadd409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7faddb50b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadd409e170 0x7fadd41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7faddb50b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd409aaa0 con 0x7fadd4130ce0 2023-09-30T22:26:37.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7faddb50b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd409f870 con 0x7fadd409e170 2023-09-30T22:26:37.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7faddb50b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd409b360 con 0x7fadd409d860 2023-09-30T22:26:37.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7f6cb5ffb700 1 -- 172.21.15.154:0/3746494331 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6cb8040560 con 0x7f6cc0139200 2023-09-30T22:26:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.015+0000 7fadd92a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409d860 0x7fadd409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadd92a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409d860 0x7fadd409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34522/0 (socket says 172.21.15.154:34522) 2023-09-30T22:26:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadd92a7700 1 -- 172.21.15.154:0/1920929799 learned_addr learned my addr 172.21.15.154:0/1920929799 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadd8aa6700 1 --2- 172.21.15.154:0/1920929799 >> v2:172.21.15.154:3300/0 conn(0x7fadd409e170 0x7fadd41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadd92a7700 1 -- 172.21.15.154:0/1920929799 >> v2:172.21.15.154:3300/0 conn(0x7fadd409e170 msgr2=0x7fadd41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadd92a7700 1 --2- 172.21.15.154:0/1920929799 >> v2:172.21.15.154:3300/0 conn(0x7fadd409e170 0x7fadd41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadd92a7700 1 -- 172.21.15.154:0/1920929799 >> v1:172.21.15.154:6789/0 conn(0x7fadd4130ce0 legacy=0x7fadd41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadd92a7700 1 -- 172.21.15.154:0/1920929799 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd409b620 con 0x7fadd409d860 2023-09-30T22:26:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadd92a7700 1 --2- 172.21.15.154:0/1920929799 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409d860 0x7fadd409dc30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fadd00098f0 tx=0x7fadd0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=586a8dfe9577a85b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadcbfff700 1 -- 172.21.15.154:0/1920929799 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000b8a0 con 0x7fadd409d860 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadcbfff700 1 -- 172.21.15.154:0/1920929799 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000ba00 con 0x7fadd409d860 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.016+0000 7fadcbfff700 1 -- 172.21.15.154:0/1920929799 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000bd90 con 0x7fadd409d860 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.017+0000 7faddb50b700 1 -- 172.21.15.154:0/1920929799 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409d860 msgr2=0x7fadd409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.017+0000 7faddb50b700 1 --2- 172.21.15.154:0/1920929799 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409d860 0x7fadd409dc30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fadd00098f0 tx=0x7fadd0009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.017+0000 7faddb50b700 1 -- 172.21.15.154:0/1920929799 shutdown_connections 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.017+0000 7faddb50b700 1 --2- 172.21.15.154:0/1920929799 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409d860 0x7fadd409dc30 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.017+0000 7faddb50b700 1 --2- 172.21.15.154:0/1920929799 >> v2:172.21.15.154:3300/0 conn(0x7fadd409e170 0x7fadd41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.017+0000 7faddb50b700 1 -- 172.21.15.154:0/1920929799 >> 172.21.15.154:0/1920929799 conn(0x7fadd4099c40 msgr2=0x7fadd40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.017+0000 7faddb50b700 1 -- 172.21.15.154:0/1920929799 shutdown_connections 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.017+0000 7faddb50b700 1 -- 172.21.15.154:0/1920929799 wait complete. 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.018+0000 7faddb50b700 1 Processor -- start 2023-09-30T22:26:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.018+0000 7faddb50b700 1 -- start start 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7faddb50b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadd409d860 0x7fadd41d1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7faddb50b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409e170 0x7fadd41d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7faddb50b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadd4130ce0 0x7fadd41b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7faddb50b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd409c8b0 con 0x7fadd4130ce0 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7faddb50b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40a21c0 con 0x7fadd409e170 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7faddb50b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadd41d1a40 con 0x7fadd409d860 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd92a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadd409d860 0x7fadd41d1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd92a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadd409d860 0x7fadd41d1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46038/0 (socket says 172.21.15.154:46038) 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd92a7700 1 -- 172.21.15.154:0/378439818 learned_addr learned my addr 172.21.15.154:0/378439818 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd9aa8700 1 --2- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadd4130ce0 0x7fadd41b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd92a7700 1 -- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409e170 msgr2=0x7fadd41d23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd92a7700 1 --2- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409e170 0x7fadd41d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd92a7700 1 -- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadd4130ce0 msgr2=0x7fadd41b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd92a7700 1 --2- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadd4130ce0 0x7fadd41b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd92a7700 1 -- 172.21.15.154:0/378439818 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0009550 con 0x7fadd409d860 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.019+0000 7fadd92a7700 1 --2- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadd409d860 0x7fadd41d1e90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009c40 tx=0x7fadd0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.020+0000 7fadc9ffb700 1 -- 172.21.15.154:0/378439818 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004510 con 0x7fadd409d860 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.020+0000 7fadc9ffb700 1 -- 172.21.15.154:0/378439818 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd00036a0 con 0x7fadd409d860 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.020+0000 7fadc9ffb700 1 -- 172.21.15.154:0/378439818 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0003a30 con 0x7fadd409d860 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.020+0000 7faddb50b700 1 -- 172.21.15.154:0/378439818 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd41b7790 con 0x7fadd409d860 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.020+0000 7faddb50b700 1 -- 172.21.15.154:0/378439818 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd412f980 con 0x7fadd409d860 2023-09-30T22:26:37.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.021+0000 7faddb50b700 1 -- 172.21.15.154:0/378439818 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd404f2a0 con 0x7fadd409d860 2023-09-30T22:26:37.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.022+0000 7f6cc73c0700 1 -- 172.21.15.154:0/3746494331 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc009a320 con 0x7f6cc0139200 2023-09-30T22:26:37.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.022+0000 7fadc9ffb700 1 -- 172.21.15.154:0/378439818 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadd0003b90 con 0x7fadd409d860 2023-09-30T22:26:37.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.022+0000 7fadc9ffb700 1 -- 172.21.15.154:0/378439818 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fadd0041090 con 0x7fadd409d860 2023-09-30T22:26:37.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.026+0000 7fadc9ffb700 1 -- 172.21.15.154:0/378439818 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadd0011420 con 0x7fadd409d860 2023-09-30T22:26:37.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.032+0000 7f6cb5ffb700 1 -- 172.21.15.154:0/3746494331 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6cb8012930 con 0x7f6cc0139200 2023-09-30T22:26:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.131+0000 7f0e01eb5700 1 -- 172.21.15.154:0/3696137161 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0dfc04f2a0 con 0x7f0dfc0a0a70 2023-09-30T22:26:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.132+0000 7f0de3fff700 1 -- 172.21.15.154:0/3696137161 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0df001a7b0 con 0x7f0dfc0a0a70 2023-09-30T22:26:37.133 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:37.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.135+0000 7f0e01eb5700 1 -- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 msgr2=0x7f0dfc1217c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.135+0000 7f0e01eb5700 1 --2- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 0x7f0dfc1217c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0df0016000 tx=0x7f0df0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:37.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.135+0000 7f0e01eb5700 1 -- 172.21.15.154:0/3696137161 shutdown_connections 2023-09-30T22:26:37.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.135+0000 7f0e01eb5700 1 --2- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc133f70 0x7f0dfc121d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.135+0000 7f0e01eb5700 1 --2- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc09ad40 0x7f0dfc121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.135+0000 7f0e01eb5700 1 --2- 172.21.15.154:0/3696137161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0a70 0x7f0dfc1217c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.136+0000 7f0e01eb5700 1 -- 172.21.15.154:0/3696137161 >> 172.21.15.154:0/3696137161 conn(0x7f0dfc099c40 msgr2=0x7f0dfc133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.136+0000 7f0e01eb5700 1 -- 172.21.15.154:0/3696137161 shutdown_connections 2023-09-30T22:26:37.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.136+0000 7f0e01eb5700 1 -- 172.21.15.154:0/3696137161 wait complete. 2023-09-30T22:26:37.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:37.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.221+0000 7faddb50b700 1 -- 172.21.15.154:0/378439818 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fadd406c3b0 con 0x7fadd409d860 2023-09-30T22:26:37.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.221+0000 7fadc9ffb700 1 -- 172.21.15.154:0/378439818 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadd0028030 con 0x7fadd409d860 2023-09-30T22:26:37.222 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:37.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.223+0000 7faddb50b700 1 -- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadd409d860 msgr2=0x7fadd41d1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.223+0000 7faddb50b700 1 --2- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadd409d860 0x7fadd41d1e90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009c40 tx=0x7fadd0004750 comp rx=0 tx=0).stop 2023-09-30T22:26:37.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.223+0000 7faddb50b700 1 -- 172.21.15.154:0/378439818 shutdown_connections 2023-09-30T22:26:37.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.223+0000 7faddb50b700 1 --2- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadd4130ce0 0x7fadd41b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.223+0000 7faddb50b700 1 --2- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fadd409d860 0x7fadd41d1e90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.223+0000 7faddb50b700 1 --2- 172.21.15.154:0/378439818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadd409e170 0x7fadd41d23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.223+0000 7faddb50b700 1 -- 172.21.15.154:0/378439818 >> 172.21.15.154:0/378439818 conn(0x7fadd4099c40 msgr2=0x7fadd4070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.223+0000 7faddb50b700 1 -- 172.21.15.154:0/378439818 shutdown_connections 2023-09-30T22:26:37.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.223+0000 7faddb50b700 1 -- 172.21.15.154:0/378439818 wait complete. 2023-09-30T22:26:37.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:37.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.247+0000 7f1f6e165700 1 -- 172.21.15.154:0/1007401408 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1f6811fe00 con 0x7f1f680a0ee0 2023-09-30T22:26:37.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.248+0000 7f1f4ffff700 1 -- 172.21.15.154:0/1007401408 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f6811fe00 con 0x7f1f680a0ee0 2023-09-30T22:26:37.249 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:37.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.250+0000 7f1f6e165700 1 -- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 msgr2=0x7f1f6811c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.250+0000 7f1f6e165700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 0x7f1f6811c760 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800ebe0 tx=0x7f1f5800eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.250+0000 7f1f6e165700 1 -- 172.21.15.154:0/1007401408 shutdown_connections 2023-09-30T22:26:37.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.250+0000 7f1f6e165700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f68134210 0x7f1f6811d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.250+0000 7f1f6e165700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f680a0ee0 0x7f1f6811c760 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.250+0000 7f1f6e165700 1 --2- 172.21.15.154:0/1007401408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f68133900 0x7f1f6811cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.250+0000 7f1f6e165700 1 -- 172.21.15.154:0/1007401408 >> 172.21.15.154:0/1007401408 conn(0x7f1f680a2980 msgr2=0x7f1f681baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.250+0000 7f1f6e165700 1 -- 172.21.15.154:0/1007401408 shutdown_connections 2023-09-30T22:26:37.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.250+0000 7f1f6e165700 1 -- 172.21.15.154:0/1007401408 wait complete. 2023-09-30T22:26:37.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.260+0000 7f6cc73c0700 1 -- 172.21.15.154:0/3746494331 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6cc009c060 con 0x7f6cc0139200 2023-09-30T22:26:37.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.260+0000 7f6cb5ffb700 1 -- 172.21.15.154:0/3746494331 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6cb8012340 con 0x7f6cc0139200 2023-09-30T22:26:37.261 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:37.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:37.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.263+0000 7f6cc73c0700 1 -- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0139200 msgr2=0x7f6cc01cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:37.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.263+0000 7f6cc73c0700 1 --2- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0139200 0x7f6cc01cc760 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009e50 tx=0x7f6cb800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.263+0000 7f6cc73c0700 1 -- 172.21.15.154:0/3746494331 shutdown_connections 2023-09-30T22:26:37.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.263+0000 7f6cc73c0700 1 --2- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6cc0139200 0x7f6cc01cc760 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.263+0000 7f6cc73c0700 1 --2- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6cc0133900 0x7f6cc006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.263+0000 7f6cc73c0700 1 --2- 172.21.15.154:0/3746494331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cc01368e0 0x7f6cc006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:37.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.263+0000 7f6cc73c0700 1 -- 172.21.15.154:0/3746494331 >> 172.21.15.154:0/3746494331 conn(0x7f6cc00a2980 msgr2=0x7f6cc0131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:37.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.263+0000 7f6cc73c0700 1 -- 172.21.15.154:0/3746494331 shutdown_connections 2023-09-30T22:26:37.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:37.263+0000 7f6cc73c0700 1 -- 172.21.15.154:0/3746494331 wait complete. 2023-09-30T22:26:37.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:38.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:38.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:38.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:38.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:38.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.293+0000 7f34f40d0700 1 Processor -- start 2023-09-30T22:26:38.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.293+0000 7f34f40d0700 1 -- start start 2023-09-30T22:26:38.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f40d0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec099e20 0x7f34ec09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f40d0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec09a730 0x7f34ec130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f40d0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34ec130890 0x7f34ec130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f40d0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ec09bf50 con 0x7f34ec130890 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f40d0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec099a60 con 0x7f34ec099e20 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f40d0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec09b230 con 0x7f34ec09a730 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f1e6c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec099e20 0x7f34ec09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f266d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34ec130890 0x7f34ec130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f1e6c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec099e20 0x7f34ec09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34544/0 (socket says 172.21.15.154:34544) 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f1e6c700 1 -- 172.21.15.154:0/1822661828 learned_addr learned my addr 172.21.15.154:0/1822661828 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:38.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f166b700 1 --2- 172.21.15.154:0/1822661828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec09a730 0x7f34ec130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f166b700 1 -- 172.21.15.154:0/1822661828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec099e20 msgr2=0x7f34ec09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f166b700 1 --2- 172.21.15.154:0/1822661828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec099e20 0x7f34ec09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f166b700 1 -- 172.21.15.154:0/1822661828 >> v2:172.21.15.154:3300/0 conn(0x7f34ec130890 msgr2=0x7f34ec130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f166b700 1 --2- 172.21.15.154:0/1822661828 >> v2:172.21.15.154:3300/0 conn(0x7f34ec130890 0x7f34ec130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f166b700 1 -- 172.21.15.154:0/1822661828 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec09bb90 con 0x7f34ec09a730 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f266d700 1 --2- 172.21.15.154:0/1822661828 >> v2:172.21.15.154:3300/0 conn(0x7f34ec130890 0x7f34ec130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.294+0000 7f34f166b700 1 --2- 172.21.15.154:0/1822661828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec09a730 0x7f34ec130350 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f34dc013150 tx=0x7f34dc013460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35bcf792bb5083ea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f0e6a700 1 -- 172.21.15.154:0/1822661828 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc016070 con 0x7f34ec09a730 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f0e6a700 1 -- 172.21.15.154:0/1822661828 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc013d10 con 0x7f34ec09a730 2023-09-30T22:26:38.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f0e6a700 1 -- 172.21.15.154:0/1822661828 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0112f0 con 0x7f34ec09a730 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f40d0700 1 -- 172.21.15.154:0/1822661828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec09a730 msgr2=0x7f34ec130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f40d0700 1 --2- 172.21.15.154:0/1822661828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec09a730 0x7f34ec130350 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f34dc013150 tx=0x7f34dc013460 comp rx=0 tx=0).stop 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f40d0700 1 -- 172.21.15.154:0/1822661828 shutdown_connections 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f40d0700 1 --2- 172.21.15.154:0/1822661828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec099e20 0x7f34ec09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f40d0700 1 --2- 172.21.15.154:0/1822661828 >> v2:172.21.15.154:3300/0 conn(0x7f34ec130890 0x7f34ec130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f40d0700 1 --2- 172.21.15.154:0/1822661828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec09a730 0x7f34ec130350 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.295+0000 7f34f40d0700 1 -- 172.21.15.154:0/1822661828 >> 172.21.15.154:0/1822661828 conn(0x7f34ec0a2980 msgr2=0x7f34ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.296+0000 7f34f40d0700 1 -- 172.21.15.154:0/1822661828 shutdown_connections 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.296+0000 7f34f40d0700 1 -- 172.21.15.154:0/1822661828 wait complete. 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f40d0700 1 Processor -- start 2023-09-30T22:26:38.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f40d0700 1 -- start start 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f40d0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec099e20 0x7f34ec11a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f40d0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec09a730 0x7f34ec11ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f40d0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ec130890 0x7f34ec11b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f40d0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec11e330 con 0x7f34ec130890 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f40d0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec11ca40 con 0x7f34ec09a730 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f40d0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec11d700 con 0x7f34ec099e20 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f1e6c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec099e20 0x7f34ec11a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f1e6c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec099e20 0x7f34ec11a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46048/0 (socket says 172.21.15.154:46048) 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.297+0000 7f34f1e6c700 1 -- 172.21.15.154:0/3989469299 learned_addr learned my addr 172.21.15.154:0/3989469299 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f166b700 1 --2- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec09a730 0x7f34ec11ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f266d700 1 --2- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ec130890 0x7f34ec11b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f1e6c700 1 -- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec09a730 msgr2=0x7f34ec11ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f1e6c700 1 --2- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec09a730 0x7f34ec11ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f1e6c700 1 -- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ec130890 msgr2=0x7f34ec11b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f1e6c700 1 --2- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ec130890 0x7f34ec11b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f1e6c700 1 -- 172.21.15.154:0/3989469299 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4008200 con 0x7f34ec099e20 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f1e6c700 1 --2- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec099e20 0x7f34ec11a810 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f34e800fb00 tx=0x7f34e800fe10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34e27fc700 1 -- 172.21.15.154:0/3989469299 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e800dc50 con 0x7f34ec099e20 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34e27fc700 1 -- 172.21.15.154:0/3989469299 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e800ddb0 con 0x7f34ec099e20 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f40d0700 1 -- 172.21.15.154:0/3989469299 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc011d40 con 0x7f34ec099e20 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34e27fc700 1 -- 172.21.15.154:0/3989469299 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8018680 con 0x7f34ec099e20 2023-09-30T22:26:38.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.298+0000 7f34f40d0700 1 -- 172.21.15.154:0/3989469299 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ec09b470 con 0x7f34ec099e20 2023-09-30T22:26:38.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.299+0000 7f34e27fc700 1 -- 172.21.15.154:0/3989469299 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34e80187e0 con 0x7f34ec099e20 2023-09-30T22:26:38.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.299+0000 7f34e27fc700 1 -- 172.21.15.154:0/3989469299 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f34e803fcc0 con 0x7f34ec099e20 2023-09-30T22:26:38.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.300+0000 7f34f40d0700 1 -- 172.21.15.154:0/3989469299 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ec070740 con 0x7f34ec099e20 2023-09-30T22:26:38.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.308+0000 7f34e27fc700 1 -- 172.21.15.154:0/3989469299 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34e801d020 con 0x7f34ec099e20 2023-09-30T22:26:38.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.374+0000 7ff0e61d6700 1 Processor -- start 2023-09-30T22:26:38.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.374+0000 7ff0e61d6700 1 -- start start 2023-09-30T22:26:38.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0e61d6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0e0133ad0 0x7ff0e0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0e61d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e01300a0 0x7ff0e01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0e61d6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0e61d6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e006b2d0 con 0x7ff0e0133ad0 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0e61d6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0133610 con 0x7ff0e01309f0 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0e61d6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e009a500 con 0x7ff0e01300a0 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0df7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0e0133ad0 0x7ff0e0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0deffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e01300a0 0x7ff0e01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0df7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0e0133ad0 0x7ff0e0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47212/0 (socket says 172.21.15.154:47212) 2023-09-30T22:26:38.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0df7fe700 1 -- 172.21.15.154:0/3619630500 learned_addr learned my addr 172.21.15.154:0/3619630500 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0dffff700 1 --2- 172.21.15.154:0/3619630500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0deffd700 1 -- 172.21.15.154:0/3619630500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 msgr2=0x7ff0e013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0deffd700 1 --2- 172.21.15.154:0/3619630500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0deffd700 1 -- 172.21.15.154:0/3619630500 >> v2:172.21.15.154:3300/0 conn(0x7ff0e0133ad0 msgr2=0x7ff0e0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.375+0000 7ff0deffd700 1 --2- 172.21.15.154:0/3619630500 >> v2:172.21.15.154:3300/0 conn(0x7ff0e0133ad0 0x7ff0e0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.376+0000 7ff0deffd700 1 -- 172.21.15.154:0/3619630500 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e01338b0 con 0x7ff0e01300a0 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.376+0000 7ff0df7fe700 1 --2- 172.21.15.154:0/3619630500 >> v2:172.21.15.154:3300/0 conn(0x7ff0e0133ad0 0x7ff0e0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.376+0000 7ff0deffd700 1 --2- 172.21.15.154:0/3619630500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e01300a0 0x7ff0e01304b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009840 tx=0x7ff0d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fbeb0750193a6b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.376+0000 7ff0de7fc700 1 -- 172.21.15.154:0/3619630500 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4011830 con 0x7ff0e01300a0 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.376+0000 7ff0de7fc700 1 -- 172.21.15.154:0/3619630500 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d4011990 con 0x7ff0e01300a0 2023-09-30T22:26:38.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.376+0000 7ff0de7fc700 1 -- 172.21.15.154:0/3619630500 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4011d20 con 0x7ff0e01300a0 2023-09-30T22:26:38.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.377+0000 7ff0e61d6700 1 -- 172.21.15.154:0/3619630500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e01300a0 msgr2=0x7ff0e01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.377+0000 7ff0e61d6700 1 --2- 172.21.15.154:0/3619630500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e01300a0 0x7ff0e01304b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009840 tx=0x7ff0d4009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.377+0000 7ff0e61d6700 1 -- 172.21.15.154:0/3619630500 shutdown_connections 2023-09-30T22:26:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.377+0000 7ff0e61d6700 1 --2- 172.21.15.154:0/3619630500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.377+0000 7ff0e61d6700 1 --2- 172.21.15.154:0/3619630500 >> v2:172.21.15.154:3300/0 conn(0x7ff0e0133ad0 0x7ff0e0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.377+0000 7ff0e61d6700 1 --2- 172.21.15.154:0/3619630500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e01300a0 0x7ff0e01304b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.377+0000 7ff0e61d6700 1 -- 172.21.15.154:0/3619630500 >> 172.21.15.154:0/3619630500 conn(0x7ff0e0099c40 msgr2=0x7ff0e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.377+0000 7ff0e61d6700 1 -- 172.21.15.154:0/3619630500 shutdown_connections 2023-09-30T22:26:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.377+0000 7ff0e61d6700 1 -- 172.21.15.154:0/3619630500 wait complete. 2023-09-30T22:26:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.378+0000 7ff0e61d6700 1 Processor -- start 2023-09-30T22:26:38.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.379+0000 7ff0e61d6700 1 -- start start 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.379+0000 7ff0e61d6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0e01300a0 0x7ff0e011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.379+0000 7ff0e61d6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.379+0000 7ff0e61d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e0133ad0 0x7ff0e011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.379+0000 7ff0e61d6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e011ee40 con 0x7ff0e01300a0 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.379+0000 7ff0e61d6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0072580 con 0x7ff0e01309f0 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.379+0000 7ff0e61d6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e011ffc0 con 0x7ff0e0133ad0 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.379+0000 7ff0deffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.379+0000 7ff0deffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34572/0 (socket says 172.21.15.154:34572) 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0deffd700 1 -- 172.21.15.154:0/1863609237 learned_addr learned my addr 172.21.15.154:0/1863609237 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:38.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0df7fe700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0e01300a0 0x7ff0e011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0dffff700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e0133ad0 0x7ff0e011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0deffd700 1 -- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e0133ad0 msgr2=0x7ff0e011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0deffd700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e0133ad0 0x7ff0e011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0deffd700 1 -- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0e01300a0 msgr2=0x7ff0e011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0deffd700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0e01300a0 0x7ff0e011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0deffd700 1 -- 172.21.15.154:0/1863609237 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0009550 con 0x7ff0e01309f0 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0df7fe700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0e01300a0 0x7ff0e011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0deffd700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e011df80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4000c00 tx=0x7ff0d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0c7fff700 1 -- 172.21.15.154:0/1863609237 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4004450 con 0x7ff0e01309f0 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0c7fff700 1 -- 172.21.15.154:0/1863609237 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d401f070 con 0x7ff0e01309f0 2023-09-30T22:26:38.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0e61d6700 1 -- 172.21.15.154:0/1863609237 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d40094a0 con 0x7ff0e01309f0 2023-09-30T22:26:38.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0c7fff700 1 -- 172.21.15.154:0/1863609237 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40038e0 con 0x7ff0e01309f0 2023-09-30T22:26:38.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.380+0000 7ff0e61d6700 1 -- 172.21.15.154:0/1863609237 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e0071fa0 con 0x7ff0e01309f0 2023-09-30T22:26:38.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.381+0000 7ff0e61d6700 1 -- 172.21.15.154:0/1863609237 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e004f2a0 con 0x7ff0e01309f0 2023-09-30T22:26:38.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.381+0000 7ff0c7fff700 1 -- 172.21.15.154:0/1863609237 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0d4003a40 con 0x7ff0e01309f0 2023-09-30T22:26:38.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.382+0000 7ff0c7fff700 1 -- 172.21.15.154:0/1863609237 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff0d4021070 con 0x7ff0e01309f0 2023-09-30T22:26:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.390+0000 7ff0c7fff700 1 -- 172.21.15.154:0/1863609237 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0d4024970 con 0x7ff0e01309f0 2023-09-30T22:26:38.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.415+0000 7f7c27bde700 1 Processor -- start 2023-09-30T22:26:38.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.415+0000 7f7c27bde700 1 -- start start 2023-09-30T22:26:38.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.415+0000 7f7c27bde700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009ef80 0x7f7c2013d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.415+0000 7f7c27bde700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c2009f3b0 0x7f7c2013f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.415+0000 7f7c27bde700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c20072b30 con 0x7f7c2009a130 2023-09-30T22:26:38.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.415+0000 7f7c27bde700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2009a500 con 0x7f7c2009f3b0 2023-09-30T22:26:38.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c27bde700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2009ada0 con 0x7f7c2009ef80 2023-09-30T22:26:38.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c25179700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009ef80 0x7f7c2013d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c2617b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c2009f3b0 0x7f7c2013f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c25179700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009ef80 0x7f7c2013d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46078/0 (socket says 172.21.15.154:46078) 2023-09-30T22:26:38.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c25179700 1 -- 172.21.15.154:0/3498857641 learned_addr learned my addr 172.21.15.154:0/3498857641 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:38.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c2617b700 1 -- 172.21.15.154:0/3498857641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009ef80 msgr2=0x7f7c2013d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c2617b700 1 --2- 172.21.15.154:0/3498857641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009ef80 0x7f7c2013d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c2617b700 1 -- 172.21.15.154:0/3498857641 >> v1:172.21.15.154:6789/0 conn(0x7f7c2009a130 legacy=0x7f7c2009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c2617b700 1 -- 172.21.15.154:0/3498857641 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2009fe00 con 0x7f7c2009f3b0 2023-09-30T22:26:38.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.416+0000 7f7c2617b700 1 --2- 172.21.15.154:0/3498857641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 0x7f7c2013f970 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009d90 tx=0x7f7c1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15527a835ec27d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c24978700 1 -- 172.21.15.154:0/3498857641 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800e070 con 0x7f7c2009f3b0 2023-09-30T22:26:38.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c24978700 1 -- 172.21.15.154:0/3498857641 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1800bb20 con 0x7f7c2009f3b0 2023-09-30T22:26:38.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c24978700 1 -- 172.21.15.154:0/3498857641 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18012430 con 0x7f7c2009f3b0 2023-09-30T22:26:38.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c27bde700 1 -- 172.21.15.154:0/3498857641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 msgr2=0x7f7c2013f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c27bde700 1 --2- 172.21.15.154:0/3498857641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 0x7f7c2013f970 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009d90 tx=0x7f7c1800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:38.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c27bde700 1 -- 172.21.15.154:0/3498857641 shutdown_connections 2023-09-30T22:26:38.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c27bde700 1 --2- 172.21.15.154:0/3498857641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 0x7f7c2013f970 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c27bde700 1 --2- 172.21.15.154:0/3498857641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009ef80 0x7f7c2013d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c27bde700 1 -- 172.21.15.154:0/3498857641 >> 172.21.15.154:0/3498857641 conn(0x7f7c200a4430 msgr2=0x7f7c200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c27bde700 1 -- 172.21.15.154:0/3498857641 shutdown_connections 2023-09-30T22:26:38.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f7c27bde700 1 -- 172.21.15.154:0/3498857641 wait complete. 2023-09-30T22:26:38.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.417+0000 7f87117aa700 1 Processor -- start 2023-09-30T22:26:38.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f87117aa700 1 -- start start 2023-09-30T22:26:38.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f87117aa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c133900 0x7f870c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f7c27bde700 1 Processor -- start 2023-09-30T22:26:38.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f87117aa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c134210 0x7f870c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f87117aa700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c09a760 con 0x7f870c0a0ee0 2023-09-30T22:26:38.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f87117aa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1336e0 con 0x7f870c134210 2023-09-30T22:26:38.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f87117aa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f870c09a080 con 0x7f870c133900 2023-09-30T22:26:38.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f870affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c133900 0x7f870c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f870affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c133900 0x7f870c133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46092/0 (socket says 172.21.15.154:46092) 2023-09-30T22:26:38.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f870affd700 1 -- 172.21.15.154:0/3567613850 learned_addr learned my addr 172.21.15.154:0/3567613850 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:38.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f870a7fc700 1 --2- 172.21.15.154:0/3567613850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c134210 0x7f870c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f870affd700 1 -- 172.21.15.154:0/3567613850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c134210 msgr2=0x7f870c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:38.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f870affd700 1 --2- 172.21.15.154:0/3567613850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c134210 0x7f870c0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f870affd700 1 -- 172.21.15.154:0/3567613850 >> v1:172.21.15.154:6789/0 conn(0x7f870c0a0ee0 legacy=0x7f870c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f870affd700 1 -- 172.21.15.154:0/3567613850 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0a23e0 con 0x7f870c133900 2023-09-30T22:26:38.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.418+0000 7f7c27bde700 1 -- start start 2023-09-30T22:26:38.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c27bde700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009a130 0x7f7c2011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c27bde700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c2009ef80 0x7f7c2011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c27bde700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 0x7f7c2011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c27bde700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200a3090 con 0x7f7c2009f3b0 2023-09-30T22:26:38.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c27bde700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20138cb0 con 0x7f7c2009ef80 2023-09-30T22:26:38.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c27bde700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20121940 con 0x7f7c2009a130 2023-09-30T22:26:38.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f870affd700 1 --2- 172.21.15.154:0/3567613850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c133900 0x7f870c133cd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0098f0 tx=0x7f86fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e286371e2917c22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f8709ffb700 1 -- 172.21.15.154:0/3567613850 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc005e30 con 0x7f870c133900 2023-09-30T22:26:38.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c2617b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 0x7f7c2011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c2617b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 0x7f7c2011f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47254/0 (socket says 172.21.15.154:47254) 2023-09-30T22:26:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c2617b700 1 -- 172.21.15.154:0/3931399077 learned_addr learned my addr 172.21.15.154:0/3931399077 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c2597a700 1 --2- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009a130 0x7f7c2011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f7c25179700 1 --2- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c2009ef80 0x7f7c2011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f8709ffb700 1 -- 172.21.15.154:0/3567613850 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc004030 con 0x7f870c133900 2023-09-30T22:26:38.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.419+0000 7f8709ffb700 1 -- 172.21.15.154:0/3567613850 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0043e0 con 0x7f870c133900 2023-09-30T22:26:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c2617b700 1 -- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009a130 msgr2=0x7f7c2011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c2617b700 1 --2- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009a130 0x7f7c2011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c2617b700 1 -- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c2009ef80 msgr2=0x7f7c2011f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c2617b700 1 --2- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c2009ef80 0x7f7c2011f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c2617b700 1 -- 172.21.15.154:0/3931399077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18009a70 con 0x7f7c2009f3b0 2023-09-30T22:26:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c2617b700 1 --2- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 0x7f7c2011f550 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7c2009f830 tx=0x7f7c18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c167fc700 1 -- 172.21.15.154:0/3931399077 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18012430 con 0x7f7c2009f3b0 2023-09-30T22:26:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c167fc700 1 -- 172.21.15.154:0/3931399077 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c18020070 con 0x7f7c2009f3b0 2023-09-30T22:26:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c27bde700 1 -- 172.21.15.154:0/3931399077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20120170 con 0x7f7c2009f3b0 2023-09-30T22:26:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f87117aa700 1 -- 172.21.15.154:0/3567613850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c133900 msgr2=0x7f870c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f87117aa700 1 --2- 172.21.15.154:0/3567613850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c133900 0x7f870c133cd0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0098f0 tx=0x7f86fc009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:38.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c167fc700 1 -- 172.21.15.154:0/3931399077 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18003ea0 con 0x7f7c2009f3b0 2023-09-30T22:26:38.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.420+0000 7f7c27bde700 1 -- 172.21.15.154:0/3931399077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c20121f40 con 0x7f7c2009f3b0 2023-09-30T22:26:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.421+0000 7f87117aa700 1 -- 172.21.15.154:0/3567613850 shutdown_connections 2023-09-30T22:26:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.421+0000 7f87117aa700 1 --2- 172.21.15.154:0/3567613850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c133900 0x7f870c133cd0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.421+0000 7f87117aa700 1 --2- 172.21.15.154:0/3567613850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c134210 0x7f870c0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.421+0000 7f87117aa700 1 -- 172.21.15.154:0/3567613850 >> 172.21.15.154:0/3567613850 conn(0x7f870c0a2980 msgr2=0x7f870c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.421+0000 7f87117aa700 1 -- 172.21.15.154:0/3567613850 shutdown_connections 2023-09-30T22:26:38.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.421+0000 7f87117aa700 1 -- 172.21.15.154:0/3567613850 wait complete. 2023-09-30T22:26:38.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.421+0000 7f7c27bde700 1 -- 172.21.15.154:0/3931399077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c20121280 con 0x7f7c2009f3b0 2023-09-30T22:26:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.422+0000 7f87117aa700 1 Processor -- start 2023-09-30T22:26:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f87117aa700 1 -- start start 2023-09-30T22:26:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f87117aa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c0a0ee0 0x7f870c11d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f87117aa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f870c133900 0x7f870c11dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f87117aa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c134210 0x7f870c11e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f87117aa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c121120 con 0x7f870c133900 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f87117aa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c130c30 con 0x7f870c0a0ee0 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f87117aa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1206a0 con 0x7f870c134210 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f870b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c134210 0x7f870c11e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f870b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c134210 0x7f870c11e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46106/0 (socket says 172.21.15.154:46106) 2023-09-30T22:26:38.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.423+0000 7f870b7fe700 1 -- 172.21.15.154:0/1341503454 learned_addr learned my addr 172.21.15.154:0/1341503454 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f870affd700 1 --2- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c0a0ee0 0x7f870c11d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f870a7fc700 1 --2- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f870c133900 0x7f870c11dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f870b7fe700 1 -- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c0a0ee0 msgr2=0x7f870c11d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f870b7fe700 1 --2- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c0a0ee0 0x7f870c11d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f870b7fe700 1 -- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f870c133900 msgr2=0x7f870c11dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f870b7fe700 1 --2- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f870c133900 0x7f870c11dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f870b7fe700 1 -- 172.21.15.154:0/1341503454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc009500 con 0x7f870c134210 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f870b7fe700 1 --2- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c134210 0x7f870c11e2c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f870400cc80 tx=0x7f870400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f86f37fe700 1 -- 172.21.15.154:0/1341503454 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704003c00 con 0x7f870c134210 2023-09-30T22:26:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f86f37fe700 1 -- 172.21.15.154:0/1341503454 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8704003d60 con 0x7f870c134210 2023-09-30T22:26:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f86f37fe700 1 -- 172.21.15.154:0/1341503454 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400aaa0 con 0x7f870c134210 2023-09-30T22:26:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f87117aa700 1 -- 172.21.15.154:0/1341503454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c120af0 con 0x7f870c134210 2023-09-30T22:26:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.424+0000 7f87117aa700 1 -- 172.21.15.154:0/1341503454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c09a2c0 con 0x7f870c134210 2023-09-30T22:26:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.425+0000 7f87117aa700 1 -- 172.21.15.154:0/1341503454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c04f2a0 con 0x7f870c134210 2023-09-30T22:26:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.426+0000 7f86f37fe700 1 -- 172.21.15.154:0/1341503454 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f870400ac00 con 0x7f870c134210 2023-09-30T22:26:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.426+0000 7f86f37fe700 1 -- 172.21.15.154:0/1341503454 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f870403f640 con 0x7f870c134210 2023-09-30T22:26:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.427+0000 7f7c167fc700 1 -- 172.21.15.154:0/3931399077 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c18004040 con 0x7f7c2009f3b0 2023-09-30T22:26:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.427+0000 7f7c167fc700 1 -- 172.21.15.154:0/3931399077 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c18022070 con 0x7f7c2009f3b0 2023-09-30T22:26:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.430+0000 7f7c167fc700 1 -- 172.21.15.154:0/3931399077 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c180042f0 con 0x7f7c2009f3b0 2023-09-30T22:26:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.431+0000 7f86f37fe700 1 -- 172.21.15.154:0/1341503454 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87040196c0 con 0x7f870c134210 2023-09-30T22:26:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.514+0000 7f34f40d0700 1 -- 172.21.15.154:0/3989469299 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34ec11ded0 con 0x7f34ec099e20 2023-09-30T22:26:38.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.514+0000 7f34e27fc700 1 -- 172.21.15.154:0/3989469299 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34ec11ded0 con 0x7f34ec099e20 2023-09-30T22:26:38.515 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:38.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.517+0000 7f34f40d0700 1 -- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec099e20 msgr2=0x7f34ec11a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.517+0000 7f34f40d0700 1 --2- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec099e20 0x7f34ec11a810 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f34e800fb00 tx=0x7f34e800fe10 comp rx=0 tx=0).stop 2023-09-30T22:26:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.517+0000 7f34f40d0700 1 -- 172.21.15.154:0/3989469299 shutdown_connections 2023-09-30T22:26:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.517+0000 7f34f40d0700 1 --2- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ec130890 0x7f34ec11b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.517+0000 7f34f40d0700 1 --2- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f34ec099e20 0x7f34ec11a810 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.517+0000 7f34f40d0700 1 --2- 172.21.15.154:0/3989469299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec09a730 0x7f34ec11ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.517+0000 7f34f40d0700 1 -- 172.21.15.154:0/3989469299 >> 172.21.15.154:0/3989469299 conn(0x7f34ec0a2980 msgr2=0x7f34ec12d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.518+0000 7f34f40d0700 1 -- 172.21.15.154:0/3989469299 shutdown_connections 2023-09-30T22:26:38.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.518+0000 7f34f40d0700 1 -- 172.21.15.154:0/3989469299 wait complete. 2023-09-30T22:26:38.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:38.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.589+0000 7ff0e61d6700 1 -- 172.21.15.154:0/1863609237 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff0e006c3b0 con 0x7ff0e01309f0 2023-09-30T22:26:38.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.590+0000 7ff0c7fff700 1 -- 172.21.15.154:0/1863609237 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0d402b020 con 0x7ff0e01309f0 2023-09-30T22:26:38.591 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:38.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.591+0000 7ff0e61d6700 1 -- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 msgr2=0x7ff0e011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.591+0000 7ff0e61d6700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e011df80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4000c00 tx=0x7ff0d4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:38.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.592+0000 7ff0e61d6700 1 -- 172.21.15.154:0/1863609237 shutdown_connections 2023-09-30T22:26:38.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.592+0000 7ff0e61d6700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0e0133ad0 0x7ff0e011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.592+0000 7ff0e61d6700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0e01300a0 0x7ff0e011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.592+0000 7ff0e61d6700 1 --2- 172.21.15.154:0/1863609237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e01309f0 0x7ff0e011df80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.592+0000 7ff0e61d6700 1 -- 172.21.15.154:0/1863609237 >> 172.21.15.154:0/1863609237 conn(0x7ff0e0099c40 msgr2=0x7ff0e012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.592+0000 7ff0e61d6700 1 -- 172.21.15.154:0/1863609237 shutdown_connections 2023-09-30T22:26:38.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.592+0000 7ff0e61d6700 1 -- 172.21.15.154:0/1863609237 wait complete. 2023-09-30T22:26:38.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.625+0000 7f7c27bde700 1 -- 172.21.15.154:0/3931399077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c2004f2a0 con 0x7f7c2009f3b0 2023-09-30T22:26:38.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.626+0000 7f7c167fc700 1 -- 172.21.15.154:0/3931399077 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c18035090 con 0x7f7c2009f3b0 2023-09-30T22:26:38.627 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:38.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.628+0000 7f7c27bde700 1 -- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 msgr2=0x7f7c2011f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.628+0000 7f7c27bde700 1 --2- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 0x7f7c2011f550 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7c2009f830 tx=0x7f7c18004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.628+0000 7f7c27bde700 1 -- 172.21.15.154:0/3931399077 shutdown_connections 2023-09-30T22:26:38.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.628+0000 7f7c27bde700 1 --2- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c2009f3b0 0x7f7c2011f550 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.628+0000 7f7c27bde700 1 --2- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7c2009a130 0x7f7c2011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.628+0000 7f7c27bde700 1 --2- 172.21.15.154:0/3931399077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c2009ef80 0x7f7c2011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.628+0000 7f7c27bde700 1 -- 172.21.15.154:0/3931399077 >> 172.21.15.154:0/3931399077 conn(0x7f7c200a4430 msgr2=0x7f7c2009d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.628+0000 7f7c27bde700 1 -- 172.21.15.154:0/3931399077 shutdown_connections 2023-09-30T22:26:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.628+0000 7f7c27bde700 1 -- 172.21.15.154:0/3931399077 wait complete. 2023-09-30T22:26:38.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.638+0000 7f87117aa700 1 -- 172.21.15.154:0/1341503454 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f870c06bce0 con 0x7f870c134210 2023-09-30T22:26:38.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.638+0000 7f86f37fe700 1 -- 172.21.15.154:0/1341503454 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8704019300 con 0x7f870c134210 2023-09-30T22:26:38.639 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:38.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.642+0000 7f87117aa700 1 -- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c134210 msgr2=0x7f870c11e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:38.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.642+0000 7f87117aa700 1 --2- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c134210 0x7f870c11e2c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f870400cc80 tx=0x7f870400cf90 comp rx=0 tx=0).stop 2023-09-30T22:26:38.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.642+0000 7f87117aa700 1 -- 172.21.15.154:0/1341503454 shutdown_connections 2023-09-30T22:26:38.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.642+0000 7f87117aa700 1 --2- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f870c134210 0x7f870c11e2c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.642+0000 7f87117aa700 1 --2- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f870c0a0ee0 0x7f870c11d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.642+0000 7f87117aa700 1 --2- 172.21.15.154:0/1341503454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f870c133900 0x7f870c11dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:38.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.642+0000 7f87117aa700 1 -- 172.21.15.154:0/1341503454 >> 172.21.15.154:0/1341503454 conn(0x7f870c0a2980 msgr2=0x7f870c1b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:38.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.642+0000 7f87117aa700 1 -- 172.21.15.154:0/1341503454 shutdown_connections 2023-09-30T22:26:38.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:38.642+0000 7f87117aa700 1 -- 172.21.15.154:0/1341503454 wait complete. 2023-09-30T22:26:38.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:38.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:39.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:39.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:39.646 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:39.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:39.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cbd27d700 1 Processor -- start 2023-09-30T22:26:39.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cbd27d700 1 -- start start 2023-09-30T22:26:39.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cbd27d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cb809e340 0x7f7cb81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cbd27d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb8135f20 0x7f7cb8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cbd27d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb809aaa0 con 0x7f7cb809d860 2023-09-30T22:26:39.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cbd27d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb809e730 con 0x7f7cb809e340 2023-09-30T22:26:39.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cbd27d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb809f870 con 0x7f7cb8135f20 2023-09-30T22:26:39.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cb67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cb809e340 0x7f7cb81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cb67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cb809e340 0x7f7cb81359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47272/0 (socket says 172.21.15.154:47272) 2023-09-30T22:26:39.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.670+0000 7f7cb67fc700 1 -- 172.21.15.154:0/3390694340 learned_addr learned my addr 172.21.15.154:0/3390694340 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:39.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.671+0000 7f7cb77fe700 1 --2- 172.21.15.154:0/3390694340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb8135f20 0x7f7cb8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.671+0000 7f7cb67fc700 1 -- 172.21.15.154:0/3390694340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb8135f20 msgr2=0x7f7cb8138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.671+0000 7f7cb67fc700 1 --2- 172.21.15.154:0/3390694340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb8135f20 0x7f7cb8138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.671+0000 7f7cb67fc700 1 -- 172.21.15.154:0/3390694340 >> v1:172.21.15.154:6789/0 conn(0x7f7cb809d860 legacy=0x7f7cb809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.671+0000 7f7cb67fc700 1 -- 172.21.15.154:0/3390694340 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb809b360 con 0x7f7cb809e340 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.671+0000 7f7cb67fc700 1 --2- 172.21.15.154:0/3390694340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809e340 0x7f7cb81359e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0098f0 tx=0x7f7cac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45457729120fba81 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.671+0000 7f7cb5ffb700 1 -- 172.21.15.154:0/3390694340 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac011830 con 0x7f7cb809e340 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.671+0000 7f7cb5ffb700 1 -- 172.21.15.154:0/3390694340 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac011990 con 0x7f7cb809e340 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.671+0000 7f7cb5ffb700 1 -- 172.21.15.154:0/3390694340 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac011d20 con 0x7f7cb809e340 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.672+0000 7f7cbd27d700 1 -- 172.21.15.154:0/3390694340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809e340 msgr2=0x7f7cb81359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.672+0000 7f7cbd27d700 1 --2- 172.21.15.154:0/3390694340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809e340 0x7f7cb81359e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0098f0 tx=0x7f7cac009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.672+0000 7f7cbd27d700 1 -- 172.21.15.154:0/3390694340 shutdown_connections 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.672+0000 7f7cbd27d700 1 --2- 172.21.15.154:0/3390694340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb8135f20 0x7f7cb8138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.672+0000 7f7cbd27d700 1 --2- 172.21.15.154:0/3390694340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809e340 0x7f7cb81359e0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.672+0000 7f7cbd27d700 1 -- 172.21.15.154:0/3390694340 >> 172.21.15.154:0/3390694340 conn(0x7f7cb8099c40 msgr2=0x7f7cb80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.672+0000 7f7cbd27d700 1 -- 172.21.15.154:0/3390694340 shutdown_connections 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.672+0000 7f7cbd27d700 1 -- 172.21.15.154:0/3390694340 wait complete. 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cbd27d700 1 Processor -- start 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cbd27d700 1 -- start start 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cbd27d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809d860 0x7f7cb811b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cbd27d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb809e340 0x7f7cb811be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cbd27d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cb8135f20 0x7f7cb811c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cbd27d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb811e0a0 con 0x7f7cb809d860 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cbd27d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8135d70 con 0x7f7cb809e340 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cbd27d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80a2900 con 0x7f7cb8135f20 2023-09-30T22:26:39.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cb67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb809e340 0x7f7cb811be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cb67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb809e340 0x7f7cb811be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34614/0 (socket says 172.21.15.154:34614) 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cb67fc700 1 -- 172.21.15.154:0/4094168356 learned_addr learned my addr 172.21.15.154:0/4094168356 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.674+0000 7f7cb77fe700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cb8135f20 0x7f7cb811c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cb6ffd700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809d860 0x7f7cb811b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cb67fc700 1 -- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cb8135f20 msgr2=0x7f7cb811c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cb67fc700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cb8135f20 0x7f7cb811c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cb67fc700 1 -- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809d860 msgr2=0x7f7cb811b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cb67fc700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809d860 0x7f7cb811b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cb67fc700 1 -- 172.21.15.154:0/4094168356 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac009550 con 0x7f7cb809e340 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cb6ffd700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809d860 0x7f7cb811b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cb67fc700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb809e340 0x7f7cb811be50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009c40 tx=0x7f7cac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7c9f7fe700 1 -- 172.21.15.154:0/4094168356 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0036a0 con 0x7f7cb809e340 2023-09-30T22:26:39.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7c9f7fe700 1 -- 172.21.15.154:0/4094168356 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac003800 con 0x7f7cb809e340 2023-09-30T22:26:39.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7c9f7fe700 1 -- 172.21.15.154:0/4094168356 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac003bb0 con 0x7f7cb809e340 2023-09-30T22:26:39.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cbd27d700 1 -- 172.21.15.154:0/4094168356 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb809c8b0 con 0x7f7cb809e340 2023-09-30T22:26:39.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.675+0000 7f7cbd27d700 1 -- 172.21.15.154:0/4094168356 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb8135a60 con 0x7f7cb809e340 2023-09-30T22:26:39.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.676+0000 7f7c9f7fe700 1 -- 172.21.15.154:0/4094168356 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cac021070 con 0x7f7cb809e340 2023-09-30T22:26:39.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.677+0000 7f7c9f7fe700 1 -- 172.21.15.154:0/4094168356 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7cac040da0 con 0x7f7cb809e340 2023-09-30T22:26:39.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.677+0000 7f7cbd27d700 1 -- 172.21.15.154:0/4094168356 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb80710b0 con 0x7f7cb809e340 2023-09-30T22:26:39.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.686+0000 7f7c9f7fe700 1 -- 172.21.15.154:0/4094168356 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cac029070 con 0x7f7cb809e340 2023-09-30T22:26:39.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.760+0000 7fd79c230700 1 Processor -- start 2023-09-30T22:26:39.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.760+0000 7fd79c230700 1 -- start start 2023-09-30T22:26:39.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd79c230700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd79409e870 0x7fd79409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd79c230700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79409f180 0x7fd794131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd79c230700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd794131d70 0x7fd7941321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd79c230700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7940a0920 con 0x7fd79409e870 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd79c230700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79409c970 con 0x7fd79409f180 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd79c230700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd79409bab0 con 0x7fd794131d70 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd799fcc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd79409e870 0x7fd79409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd799fcc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd79409e870 0x7fd79409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47282/0 (socket says 172.21.15.154:47282) 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd799fcc700 1 -- 172.21.15.154:0/3879653219 learned_addr learned my addr 172.21.15.154:0/3879653219 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd7997cb700 1 --2- 172.21.15.154:0/3879653219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79409f180 0x7fd794131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd79a7cd700 1 --2- 172.21.15.154:0/3879653219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd794131d70 0x7fd7941321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd7997cb700 1 -- 172.21.15.154:0/3879653219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd794131d70 msgr2=0x7fd7941321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd7997cb700 1 --2- 172.21.15.154:0/3879653219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd794131d70 0x7fd7941321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd7997cb700 1 -- 172.21.15.154:0/3879653219 >> v2:172.21.15.154:3300/0 conn(0x7fd79409e870 msgr2=0x7fd79409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd7997cb700 1 --2- 172.21.15.154:0/3879653219 >> v2:172.21.15.154:3300/0 conn(0x7fd79409e870 0x7fd79409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd7997cb700 1 -- 172.21.15.154:0/3879653219 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79409f9c0 con 0x7fd79409f180 2023-09-30T22:26:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.761+0000 7fd7997cb700 1 --2- 172.21.15.154:0/3879653219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79409f180 0x7fd794131830 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd784009870 tx=0x7fd784009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=412af953d4031614 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.762+0000 7fd798fca700 1 -- 172.21.15.154:0/3879653219 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784011830 con 0x7fd79409f180 2023-09-30T22:26:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.762+0000 7fd798fca700 1 -- 172.21.15.154:0/3879653219 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784011990 con 0x7fd79409f180 2023-09-30T22:26:39.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.762+0000 7fd798fca700 1 -- 172.21.15.154:0/3879653219 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784011d00 con 0x7fd79409f180 2023-09-30T22:26:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.763+0000 7fd79c230700 1 -- 172.21.15.154:0/3879653219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79409f180 msgr2=0x7fd794131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.763+0000 7fd79c230700 1 --2- 172.21.15.154:0/3879653219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79409f180 0x7fd794131830 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd784009870 tx=0x7fd784009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.763+0000 7fd79c230700 1 -- 172.21.15.154:0/3879653219 shutdown_connections 2023-09-30T22:26:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.763+0000 7fd79c230700 1 --2- 172.21.15.154:0/3879653219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd794131d70 0x7fd7941321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.763+0000 7fd79c230700 1 --2- 172.21.15.154:0/3879653219 >> v2:172.21.15.154:3300/0 conn(0x7fd79409e870 0x7fd79409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.763+0000 7fd79c230700 1 --2- 172.21.15.154:0/3879653219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79409f180 0x7fd794131830 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.763+0000 7fd79c230700 1 -- 172.21.15.154:0/3879653219 >> 172.21.15.154:0/3879653219 conn(0x7fd7940a4430 msgr2=0x7fd7940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.763+0000 7fd79c230700 1 -- 172.21.15.154:0/3879653219 shutdown_connections 2023-09-30T22:26:39.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.763+0000 7fd79c230700 1 -- 172.21.15.154:0/3879653219 wait complete. 2023-09-30T22:26:39.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.764+0000 7fd79c230700 1 Processor -- start 2023-09-30T22:26:39.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.764+0000 7fd79c230700 1 -- start start 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd79c230700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79409e870 0x7fd794136a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd79c230700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79409f180 0x7fd794136fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd79c230700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd794131d70 0x7fd7941c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd79c230700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794136410 con 0x7fd79409e870 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd79c230700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd794137500 con 0x7fd794131d70 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd79c230700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd794136670 con 0x7fd79409f180 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd79a7cd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd794131d70 0x7fd7941c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd7997cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79409f180 0x7fd794136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd79a7cd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd794131d70 0x7fd7941c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34636/0 (socket says 172.21.15.154:34636) 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd79a7cd700 1 -- 172.21.15.154:0/3178767445 learned_addr learned my addr 172.21.15.154:0/3178767445 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.765+0000 7fd799fcc700 1 --2- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79409e870 0x7fd794136a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd79a7cd700 1 -- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79409f180 msgr2=0x7fd794136fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd79a7cd700 1 --2- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79409f180 0x7fd794136fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd79a7cd700 1 -- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79409e870 msgr2=0x7fd794136a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd79a7cd700 1 --2- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79409e870 0x7fd794136a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd79a7cd700 1 -- 172.21.15.154:0/3178767445 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7840094a0 con 0x7fd794131d70 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd799fcc700 1 --2- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79409e870 0x7fd794136a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd79a7cd700 1 --2- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd794131d70 0x7fd7941c8200 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00efc0 tx=0x7fd78c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd78a7fc700 1 -- 172.21.15.154:0/3178767445 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c009ea0 con 0x7fd794131d70 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd79c230700 1 -- 172.21.15.154:0/3178767445 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79409dba0 con 0x7fd794131d70 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.766+0000 7fd79c230700 1 -- 172.21.15.154:0/3178767445 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79412d550 con 0x7fd794131d70 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.767+0000 7fd78a7fc700 1 -- 172.21.15.154:0/3178767445 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c00f040 con 0x7fd794131d70 2023-09-30T22:26:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.767+0000 7fd78a7fc700 1 -- 172.21.15.154:0/3178767445 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c014480 con 0x7fd794131d70 2023-09-30T22:26:39.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.767+0000 7fd78a7fc700 1 -- 172.21.15.154:0/3178767445 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd78c0145e0 con 0x7fd794131d70 2023-09-30T22:26:39.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.767+0000 7fd78a7fc700 1 -- 172.21.15.154:0/3178767445 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd78c03fe70 con 0x7fd794131d70 2023-09-30T22:26:39.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.768+0000 7fd79c230700 1 -- 172.21.15.154:0/3178767445 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c0052e0 con 0x7fd794131d70 2023-09-30T22:26:39.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.772+0000 7fd78a7fc700 1 -- 172.21.15.154:0/3178767445 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd78c018070 con 0x7fd794131d70 2023-09-30T22:26:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.793+0000 7f870549f700 1 Processor -- start 2023-09-30T22:26:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.793+0000 7f870549f700 1 -- start start 2023-09-30T22:26:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.793+0000 7f870549f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8700138040 0x7f8700138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.793+0000 7f870549f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87000a1400 0x7f870013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.793+0000 7f870549f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87001379e0 con 0x7f87000a08e0 2023-09-30T22:26:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.793+0000 7f870549f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87000a2100 con 0x7f87000a1400 2023-09-30T22:26:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.793+0000 7f870549f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8700138950 con 0x7f8700138040 2023-09-30T22:26:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86fe7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f87000a08e0 0x7f87000a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42048/0 (socket says 172.21.15.154:42048) 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86fe7fc700 1 -- 172.21.15.154:0/1072235307 learned_addr learned my addr 172.21.15.154:0/1072235307 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86ff7fe700 1 --2- 172.21.15.154:0/1072235307 >> v2:172.21.15.154:3300/0 conn(0x7f87000a1400 0x7f870013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86feffd700 1 --2- 172.21.15.154:0/1072235307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8700138040 0x7f8700138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86ff7fe700 1 -- 172.21.15.154:0/1072235307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8700138040 msgr2=0x7f8700138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86ff7fe700 1 --2- 172.21.15.154:0/1072235307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8700138040 0x7f8700138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86ff7fe700 1 -- 172.21.15.154:0/1072235307 >> v1:172.21.15.154:6789/0 conn(0x7f87000a08e0 legacy=0x7f87000a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86ff7fe700 1 -- 172.21.15.154:0/1072235307 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870009b9b0 con 0x7f87000a1400 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86ff7fe700 1 --2- 172.21.15.154:0/1072235307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87000a1400 0x7f870013fd20 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009dc0 tx=0x7f86f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42188068a4cbe21a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86fdffb700 1 -- 172.21.15.154:0/1072235307 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800e070 con 0x7f87000a1400 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86fdffb700 1 -- 172.21.15.154:0/1072235307 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f800bae0 con 0x7f87000a1400 2023-09-30T22:26:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.794+0000 7f86fdffb700 1 -- 172.21.15.154:0/1072235307 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800be90 con 0x7f87000a1400 2023-09-30T22:26:39.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.795+0000 7f870549f700 1 -- 172.21.15.154:0/1072235307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87000a1400 msgr2=0x7f870013fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.795+0000 7f870549f700 1 --2- 172.21.15.154:0/1072235307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87000a1400 0x7f870013fd20 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009dc0 tx=0x7f86f800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:39.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.795+0000 7f870549f700 1 -- 172.21.15.154:0/1072235307 shutdown_connections 2023-09-30T22:26:39.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.795+0000 7f870549f700 1 --2- 172.21.15.154:0/1072235307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87000a1400 0x7f870013fd20 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.795+0000 7f870549f700 1 --2- 172.21.15.154:0/1072235307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8700138040 0x7f8700138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.795+0000 7f870549f700 1 -- 172.21.15.154:0/1072235307 >> 172.21.15.154:0/1072235307 conn(0x7f87000a2980 msgr2=0x7f87000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.795+0000 7f870549f700 1 -- 172.21.15.154:0/1072235307 shutdown_connections 2023-09-30T22:26:39.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.795+0000 7f870549f700 1 -- 172.21.15.154:0/1072235307 wait complete. 2023-09-30T22:26:39.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.797+0000 7f870549f700 1 Processor -- start 2023-09-30T22:26:39.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.797+0000 7f870549f700 1 -- start start 2023-09-30T22:26:39.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.797+0000 7f870549f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87000a08e0 0x7f8700126380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.797+0000 7f870549f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87000a1400 0x7f87001268c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.797+0000 7f870549f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8700138040 0x7f8700126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.797+0000 7f870549f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870009a240 con 0x7f87000a08e0 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.797+0000 7f870549f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8700137720 con 0x7f8700138040 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.797+0000 7f870549f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87001280a0 con 0x7f87000a1400 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8700138040 0x7f8700126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8700138040 0x7f8700126e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34648/0 (socket says 172.21.15.154:34648) 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86ff7fe700 1 -- 172.21.15.154:0/1649004250 learned_addr learned my addr 172.21.15.154:0/1649004250 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86feffd700 1 --2- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87000a08e0 0x7f8700126380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86ff7fe700 1 -- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87000a1400 msgr2=0x7f87001268c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86ff7fe700 1 --2- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87000a1400 0x7f87001268c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86ff7fe700 1 -- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87000a08e0 msgr2=0x7f8700126380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86ff7fe700 1 --2- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87000a08e0 0x7f8700126380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86ff7fe700 1 -- 172.21.15.154:0/1649004250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8009a70 con 0x7f8700138040 2023-09-30T22:26:39.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86ff7fe700 1 --2- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8700138040 0x7f8700126e00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f86f8014040 tx=0x7f86f8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86e77fe700 1 -- 172.21.15.154:0/1649004250 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8004690 con 0x7f8700138040 2023-09-30T22:26:39.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f870549f700 1 -- 172.21.15.154:0/1649004250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8700136ea0 con 0x7f8700138040 2023-09-30T22:26:39.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f870549f700 1 -- 172.21.15.154:0/1649004250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870012a3a0 con 0x7f8700138040 2023-09-30T22:26:39.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.798+0000 7f86e77fe700 1 -- 172.21.15.154:0/1649004250 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f8020070 con 0x7f8700138040 2023-09-30T22:26:39.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.799+0000 7f86e77fe700 1 -- 172.21.15.154:0/1649004250 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8027480 con 0x7f8700138040 2023-09-30T22:26:39.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.799+0000 7f86e77fe700 1 -- 172.21.15.154:0/1649004250 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86f8012430 con 0x7f8700138040 2023-09-30T22:26:39.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.799+0000 7f86e77fe700 1 -- 172.21.15.154:0/1649004250 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86f8022070 con 0x7f8700138040 2023-09-30T22:26:39.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.800+0000 7f870549f700 1 -- 172.21.15.154:0/1649004250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e00052e0 con 0x7f8700138040 2023-09-30T22:26:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.800+0000 7f6ddbc1d700 1 Processor -- start 2023-09-30T22:26:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.801+0000 7f6ddbc1d700 1 -- start start 2023-09-30T22:26:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.801+0000 7f6ddbc1d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd4133a70 0x7f6dd4133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.801+0000 7f6ddbc1d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6dd40a1460 0x7f6dd413b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.801+0000 7f6ddbc1d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd4133640 con 0x7f6dd40a08e0 2023-09-30T22:26:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.801+0000 7f6ddbc1d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40a1d50 con 0x7f6dd4133a70 2023-09-30T22:26:39.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.801+0000 7f6ddbc1d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd409b620 con 0x7f6dd40a1460 2023-09-30T22:26:39.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.801+0000 7f6dd99b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd4133a70 0x7f6dd4133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.801+0000 7f6dd99b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd4133a70 0x7f6dd4133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34660/0 (socket says 172.21.15.154:34660) 2023-09-30T22:26:39.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.801+0000 7f6dd99b9700 1 -- 172.21.15.154:0/2982453560 learned_addr learned my addr 172.21.15.154:0/2982453560 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:39.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.802+0000 7f6dda1ba700 1 --2- 172.21.15.154:0/2982453560 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6dd40a1460 0x7f6dd413b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.802+0000 7f6dd99b9700 1 -- 172.21.15.154:0/2982453560 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6dd40a1460 msgr2=0x7f6dd413b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.802+0000 7f6dd99b9700 1 --2- 172.21.15.154:0/2982453560 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6dd40a1460 0x7f6dd413b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.802+0000 7f6dd99b9700 1 -- 172.21.15.154:0/2982453560 >> v1:172.21.15.154:6789/0 conn(0x7f6dd40a08e0 legacy=0x7f6dd40a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:39.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.802+0000 7f6dd99b9700 1 -- 172.21.15.154:0/2982453560 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4133870 con 0x7f6dd4133a70 2023-09-30T22:26:39.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.802+0000 7f6dd99b9700 1 --2- 172.21.15.154:0/2982453560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd4133a70 0x7f6dd4133e40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00098f0 tx=0x7f6dd0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b50f67aeb8854c80 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.805+0000 7f6dd89b7700 1 -- 172.21.15.154:0/2982453560 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0005e30 con 0x7f6dd4133a70 2023-09-30T22:26:39.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.805+0000 7f86e77fe700 1 -- 172.21.15.154:0/1649004250 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86f8025970 con 0x7f8700138040 2023-09-30T22:26:39.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.805+0000 7f6dd89b7700 1 -- 172.21.15.154:0/2982453560 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd0006030 con 0x7f6dd4133a70 2023-09-30T22:26:39.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.805+0000 7f6dd89b7700 1 -- 172.21.15.154:0/2982453560 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00063c0 con 0x7f6dd4133a70 2023-09-30T22:26:39.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.806+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/2982453560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd4133a70 msgr2=0x7f6dd4133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.806+0000 7f6ddbc1d700 1 --2- 172.21.15.154:0/2982453560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd4133a70 0x7f6dd4133e40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6dd00098f0 tx=0x7f6dd0009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:39.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.806+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/2982453560 shutdown_connections 2023-09-30T22:26:39.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.806+0000 7f6ddbc1d700 1 --2- 172.21.15.154:0/2982453560 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6dd40a1460 0x7f6dd413b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.806+0000 7f6ddbc1d700 1 --2- 172.21.15.154:0/2982453560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd4133a70 0x7f6dd4133e40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.806+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/2982453560 >> 172.21.15.154:0/2982453560 conn(0x7f6dd40a2980 msgr2=0x7f6dd40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.808+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/2982453560 shutdown_connections 2023-09-30T22:26:39.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.808+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/2982453560 wait complete. 2023-09-30T22:26:39.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6ddbc1d700 1 Processor -- start 2023-09-30T22:26:39.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6ddbc1d700 1 -- start start 2023-09-30T22:26:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6ddbc1d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd40a08e0 0x7f6dd411fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6ddbc1d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd40a1460 0x7f6dd41201f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6ddbc1d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6dd4133a70 0x7f6dd4120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6ddbc1d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41218c0 con 0x7f6dd40a08e0 2023-09-30T22:26:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6ddbc1d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4121110 con 0x7f6dd40a1460 2023-09-30T22:26:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6ddbc1d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4130840 con 0x7f6dd4133a70 2023-09-30T22:26:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6dd91b8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd40a1460 0x7f6dd41201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:39.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6dd91b8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd40a1460 0x7f6dd41201f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34666/0 (socket says 172.21.15.154:34666) 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.809+0000 7f6dd91b8700 1 -- 172.21.15.154:0/1340702433 learned_addr learned my addr 172.21.15.154:0/1340702433 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.810+0000 7f6dd91b8700 1 -- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6dd4133a70 msgr2=0x7f6dd4120730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.810+0000 7f6dd91b8700 1 --2- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6dd4133a70 0x7f6dd4120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.810+0000 7f6dd91b8700 1 -- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd40a08e0 msgr2=0x7f6dd411fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.810+0000 7f6dd91b8700 1 --2- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd40a08e0 0x7f6dd411fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.810+0000 7f6dd91b8700 1 -- 172.21.15.154:0/1340702433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009500 con 0x7f6dd40a1460 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.810+0000 7f6dd91b8700 1 --2- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd40a1460 0x7f6dd41201f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400b450 tx=0x7f6dc400b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.810+0000 7f6dca7fc700 1 -- 172.21.15.154:0/1340702433 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4011830 con 0x7f6dd40a1460 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.810+0000 7f6dca7fc700 1 -- 172.21.15.154:0/1340702433 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc4011990 con 0x7f6dd40a1460 2023-09-30T22:26:39.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.810+0000 7f6dca7fc700 1 -- 172.21.15.154:0/1340702433 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4011d20 con 0x7f6dd40a1460 2023-09-30T22:26:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.811+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/1340702433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd4123230 con 0x7f6dd40a1460 2023-09-30T22:26:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.811+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/1340702433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd409a350 con 0x7f6dd40a1460 2023-09-30T22:26:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.812+0000 7f6dca7fc700 1 -- 172.21.15.154:0/1340702433 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6dc401a400 con 0x7f6dd40a1460 2023-09-30T22:26:39.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.812+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/1340702433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd409cd50 con 0x7f6dd40a1460 2023-09-30T22:26:39.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.812+0000 7f6dca7fc700 1 -- 172.21.15.154:0/1340702433 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6dc403f6f0 con 0x7f6dd40a1460 2023-09-30T22:26:39.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.816+0000 7f6dca7fc700 1 -- 172.21.15.154:0/1340702433 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6dc400f6f0 con 0x7f6dd40a1460 2023-09-30T22:26:39.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.906+0000 7f7cbd27d700 1 -- 172.21.15.154:0/4094168356 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7cb804f2a0 con 0x7f7cb809e340 2023-09-30T22:26:39.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.906+0000 7f7c9f7fe700 1 -- 172.21.15.154:0/4094168356 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cac015030 con 0x7f7cb809e340 2023-09-30T22:26:39.907 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.908+0000 7f7cbd27d700 1 -- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb809e340 msgr2=0x7f7cb811be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.908+0000 7f7cbd27d700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb809e340 0x7f7cb811be50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009c40 tx=0x7f7cac004750 comp rx=0 tx=0).stop 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.909+0000 7f7cbd27d700 1 -- 172.21.15.154:0/4094168356 shutdown_connections 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.909+0000 7f7cbd27d700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7cb8135f20 0x7f7cb811c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.909+0000 7f7cbd27d700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb809d860 0x7f7cb811b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.909+0000 7f7cbd27d700 1 --2- 172.21.15.154:0/4094168356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb809e340 0x7f7cb811be50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:39.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.909+0000 7f7cbd27d700 1 -- 172.21.15.154:0/4094168356 >> 172.21.15.154:0/4094168356 conn(0x7f7cb8099c40 msgr2=0x7f7cb80a2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:39.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.913+0000 7f7cbd27d700 1 -- 172.21.15.154:0/4094168356 shutdown_connections 2023-09-30T22:26:39.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:39.913+0000 7f7cbd27d700 1 -- 172.21.15.154:0/4094168356 wait complete. 2023-09-30T22:26:39.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:40.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.008+0000 7fd79c230700 1 -- 172.21.15.154:0/3178767445 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd77c005590 con 0x7fd794131d70 2023-09-30T22:26:40.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.009+0000 7fd78a7fc700 1 -- 172.21.15.154:0/3178767445 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd78c01a680 con 0x7fd794131d70 2023-09-30T22:26:40.010 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:40.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.010+0000 7fd79c230700 1 -- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd794131d70 msgr2=0x7fd7941c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.010+0000 7fd79c230700 1 --2- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd794131d70 0x7fd7941c8200 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00efc0 tx=0x7fd78c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.011+0000 7fd79c230700 1 -- 172.21.15.154:0/3178767445 shutdown_connections 2023-09-30T22:26:40.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.011+0000 7fd79c230700 1 --2- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd794131d70 0x7fd7941c8200 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.011+0000 7fd79c230700 1 --2- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79409e870 0x7fd794136a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.011+0000 7fd79c230700 1 --2- 172.21.15.154:0/3178767445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79409f180 0x7fd794136fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.011+0000 7fd79c230700 1 -- 172.21.15.154:0/3178767445 >> 172.21.15.154:0/3178767445 conn(0x7fd7940a4430 msgr2=0x7fd79406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:40.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.011+0000 7fd79c230700 1 -- 172.21.15.154:0/3178767445 shutdown_connections 2023-09-30T22:26:40.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.011+0000 7fd79c230700 1 -- 172.21.15.154:0/3178767445 wait complete. 2023-09-30T22:26:40.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.011+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/1340702433 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6dd404f2a0 con 0x7f6dd40a1460 2023-09-30T22:26:40.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.011+0000 7f6dca7fc700 1 -- 172.21.15.154:0/1340702433 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6dc401ae60 con 0x7f6dd40a1460 2023-09-30T22:26:40.014 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:40.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.014+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd40a1460 msgr2=0x7f6dd41201f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.014+0000 7f6ddbc1d700 1 --2- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd40a1460 0x7f6dd41201f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400b450 tx=0x7f6dc400b810 comp rx=0 tx=0).stop 2023-09-30T22:26:40.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.015+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/1340702433 shutdown_connections 2023-09-30T22:26:40.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.015+0000 7f6ddbc1d700 1 --2- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6dd4133a70 0x7f6dd4120730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.015+0000 7f6ddbc1d700 1 --2- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dd40a08e0 0x7f6dd411fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.015+0000 7f6ddbc1d700 1 --2- 172.21.15.154:0/1340702433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dd40a1460 0x7f6dd41201f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.015+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/1340702433 >> 172.21.15.154:0/1340702433 conn(0x7f6dd40a2980 msgr2=0x7f6dd409e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:40.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.015+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/1340702433 shutdown_connections 2023-09-30T22:26:40.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.015+0000 7f6ddbc1d700 1 -- 172.21.15.154:0/1340702433 wait complete. 2023-09-30T22:26:40.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:40.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:40.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.036+0000 7f870549f700 1 -- 172.21.15.154:0/1649004250 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f86e0005590 con 0x7f8700138040 2023-09-30T22:26:40.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.037+0000 7f86e77fe700 1 -- 172.21.15.154:0/1649004250 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86f8025380 con 0x7f8700138040 2023-09-30T22:26:40.038 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:40.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.039+0000 7f870549f700 1 -- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8700138040 msgr2=0x7f8700126e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:40.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.039+0000 7f870549f700 1 --2- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8700138040 0x7f8700126e00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f86f8014040 tx=0x7f86f8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.039+0000 7f870549f700 1 -- 172.21.15.154:0/1649004250 shutdown_connections 2023-09-30T22:26:40.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.039+0000 7f870549f700 1 --2- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8700138040 0x7f8700126e00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.039+0000 7f870549f700 1 --2- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87000a08e0 0x7f8700126380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.039+0000 7f870549f700 1 --2- 172.21.15.154:0/1649004250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f87000a1400 0x7f87001268c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:40.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.039+0000 7f870549f700 1 -- 172.21.15.154:0/1649004250 >> 172.21.15.154:0/1649004250 conn(0x7f87000a2980 msgr2=0x7f870009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:40.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.039+0000 7f870549f700 1 -- 172.21.15.154:0/1649004250 shutdown_connections 2023-09-30T22:26:40.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:40.039+0000 7f870549f700 1 -- 172.21.15.154:0/1649004250 wait complete. 2023-09-30T22:26:40.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:40.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:41.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:41.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:41.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:41.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.058+0000 7fcf14a47700 1 Processor -- start 2023-09-30T22:26:41.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.058+0000 7fcf14a47700 1 -- start start 2023-09-30T22:26:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf14a47700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf10131980 0x7fcf10131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf14a47700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1009bc70 0x7fcf1009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf14a47700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009c5c0 0x7fcf10138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf14a47700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1006eb30 con 0x7fcf10131980 2023-09-30T22:26:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf14a47700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100a1640 con 0x7fcf1009bc70 2023-09-30T22:26:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf14a47700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100a22d0 con 0x7fcf1009c5c0 2023-09-30T22:26:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf10131980 0x7fcf10131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009c5c0 0x7fcf10138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1009bc70 0x7fcf1009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009c5c0 0x7fcf10138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46172/0 (socket says 172.21.15.154:46172) 2023-09-30T22:26:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf10131980 0x7fcf10131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47330/0 (socket says 172.21.15.154:47330) 2023-09-30T22:26:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0ed9d700 1 -- 172.21.15.154:0/1006689960 learned_addr learned my addr 172.21.15.154:0/1006689960 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1009bc70 0x7fcf1009c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34674/0 (socket says 172.21.15.154:34674) 2023-09-30T22:26:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0dd9b700 1 -- 172.21.15.154:0/1006689960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009c5c0 msgr2=0x7fcf10138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0dd9b700 1 --2- 172.21.15.154:0/1006689960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009c5c0 0x7fcf10138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0dd9b700 1 -- 172.21.15.154:0/1006689960 >> v2:172.21.15.154:3300/0 conn(0x7fcf10131980 msgr2=0x7fcf10131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:41.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0dd9b700 1 --2- 172.21.15.154:0/1006689960 >> v2:172.21.15.154:3300/0 conn(0x7fcf10131980 0x7fcf10131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0dd9b700 1 -- 172.21.15.154:0/1006689960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10131550 con 0x7fcf1009bc70 2023-09-30T22:26:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0ed9d700 1 --2- 172.21.15.154:0/1006689960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009c5c0 0x7fcf10138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:41.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0e59c700 1 --2- 172.21.15.154:0/1006689960 >> v2:172.21.15.154:3300/0 conn(0x7fcf10131980 0x7fcf10131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0dd9b700 1 --2- 172.21.15.154:0/1006689960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1009bc70 0x7fcf1009c080 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009840 tx=0x7fcf04009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c0d6d057abd645 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0d59a700 1 -- 172.21.15.154:0/1006689960 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04011830 con 0x7fcf1009bc70 2023-09-30T22:26:41.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0d59a700 1 -- 172.21.15.154:0/1006689960 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf04011990 con 0x7fcf1009bc70 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.059+0000 7fcf0d59a700 1 -- 172.21.15.154:0/1006689960 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04011d20 con 0x7fcf1009bc70 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.060+0000 7fcf14a47700 1 -- 172.21.15.154:0/1006689960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1009bc70 msgr2=0x7fcf1009c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.060+0000 7fcf14a47700 1 --2- 172.21.15.154:0/1006689960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1009bc70 0x7fcf1009c080 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009840 tx=0x7fcf04009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.060+0000 7fcf14a47700 1 -- 172.21.15.154:0/1006689960 shutdown_connections 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.060+0000 7fcf14a47700 1 --2- 172.21.15.154:0/1006689960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009c5c0 0x7fcf10138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.060+0000 7fcf14a47700 1 --2- 172.21.15.154:0/1006689960 >> v2:172.21.15.154:3300/0 conn(0x7fcf10131980 0x7fcf10131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.060+0000 7fcf14a47700 1 --2- 172.21.15.154:0/1006689960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1009bc70 0x7fcf1009c080 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.060+0000 7fcf14a47700 1 -- 172.21.15.154:0/1006689960 >> 172.21.15.154:0/1006689960 conn(0x7fcf100a2980 msgr2=0x7fcf100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.060+0000 7fcf14a47700 1 -- 172.21.15.154:0/1006689960 shutdown_connections 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.060+0000 7fcf14a47700 1 -- 172.21.15.154:0/1006689960 wait complete. 2023-09-30T22:26:41.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.062+0000 7fcf14a47700 1 Processor -- start 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.062+0000 7fcf14a47700 1 -- start start 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.062+0000 7fcf14a47700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009bc70 0x7fcf1011d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.062+0000 7fcf14a47700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1009c5c0 0x7fcf1011ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.062+0000 7fcf14a47700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf10131980 0x7fcf1011e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.062+0000 7fcf14a47700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10120ee0 con 0x7fcf1009c5c0 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.062+0000 7fcf14a47700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1011edf0 con 0x7fcf10131980 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.062+0000 7fcf14a47700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf10120370 con 0x7fcf1009bc70 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009bc70 0x7fcf1011d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009bc70 0x7fcf1011d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46180/0 (socket says 172.21.15.154:46180) 2023-09-30T22:26:41.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0e59c700 1 -- 172.21.15.154:0/664622879 learned_addr learned my addr 172.21.15.154:0/664622879 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0ed9d700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf10131980 0x7fcf1011e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0dd9b700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1009c5c0 0x7fcf1011ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0ed9d700 1 -- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009bc70 msgr2=0x7fcf1011d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0ed9d700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009bc70 0x7fcf1011d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0ed9d700 1 -- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1009c5c0 msgr2=0x7fcf1011ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0ed9d700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1009c5c0 0x7fcf1011ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0ed9d700 1 -- 172.21.15.154:0/664622879 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08009b30 con 0x7fcf10131980 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0dd9b700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1009c5c0 0x7fcf1011ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf0ed9d700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf10131980 0x7fcf1011e410 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800eed0 tx=0x7fcf0800b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcefeffd700 1 -- 172.21.15.154:0/664622879 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800ba70 con 0x7fcf10131980 2023-09-30T22:26:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcefeffd700 1 -- 172.21.15.154:0/664622879 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0800bbd0 con 0x7fcf10131980 2023-09-30T22:26:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf14a47700 1 -- 172.21.15.154:0/664622879 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf00009430 con 0x7fcf10131980 2023-09-30T22:26:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcefeffd700 1 -- 172.21.15.154:0/664622879 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08013540 con 0x7fcf10131980 2023-09-30T22:26:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.063+0000 7fcf14a47700 1 -- 172.21.15.154:0/664622879 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf040094a0 con 0x7fcf10131980 2023-09-30T22:26:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.064+0000 7fcefeffd700 1 -- 172.21.15.154:0/664622879 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf080136a0 con 0x7fcf10131980 2023-09-30T22:26:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.065+0000 7fcefeffd700 1 -- 172.21.15.154:0/664622879 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf08043920 con 0x7fcf10131980 2023-09-30T22:26:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.065+0000 7fcf14a47700 1 -- 172.21.15.154:0/664622879 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf10130ef0 con 0x7fcf10131980 2023-09-30T22:26:41.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.069+0000 7fcefeffd700 1 -- 172.21.15.154:0/664622879 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf0801b3f0 con 0x7fcf10131980 2023-09-30T22:26:41.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.159+0000 7f52190a7700 1 Processor -- start 2023-09-30T22:26:41.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.159+0000 7f52190a7700 1 -- start start 2023-09-30T22:26:41.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.159+0000 7f52190a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214099a60 0x7f52141388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.159+0000 7f52190a7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5214138e30 0x7f521413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.159+0000 7f52190a7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521409aa00 con 0x7f5214133b80 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f52190a7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521409a080 con 0x7f5214138e30 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f52190a7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5214133750 con 0x7f5214099a60 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f521359e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5214138e30 0x7f521413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f521359e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5214138e30 0x7f521413b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47360/0 (socket says 172.21.15.154:47360) 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f521359e700 1 -- 172.21.15.154:0/1380063279 learned_addr learned my addr 172.21.15.154:0/1380063279 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f521259c700 1 --2- 172.21.15.154:0/1380063279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214099a60 0x7f52141388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f521359e700 1 -- 172.21.15.154:0/1380063279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214099a60 msgr2=0x7f52141388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f521359e700 1 --2- 172.21.15.154:0/1380063279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214099a60 0x7f52141388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f521359e700 1 -- 172.21.15.154:0/1380063279 >> v1:172.21.15.154:6789/0 conn(0x7f5214133b80 legacy=0x7f5214133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f521359e700 1 -- 172.21.15.154:0/1380063279 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521409a760 con 0x7f5214138e30 2023-09-30T22:26:41.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f521359e700 1 --2- 172.21.15.154:0/1380063279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214138e30 0x7f521413b210 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f520c009e50 tx=0x7f520c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d9f62437f942fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.160+0000 7f5211d9b700 1 -- 172.21.15.154:0/1380063279 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c00bb10 con 0x7f5214138e30 2023-09-30T22:26:41.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f5211d9b700 1 -- 172.21.15.154:0/1380063279 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c00bc70 con 0x7f5214138e30 2023-09-30T22:26:41.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f5211d9b700 1 -- 172.21.15.154:0/1380063279 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0148d0 con 0x7f5214138e30 2023-09-30T22:26:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f52190a7700 1 -- 172.21.15.154:0/1380063279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214138e30 msgr2=0x7f521413b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f52190a7700 1 --2- 172.21.15.154:0/1380063279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214138e30 0x7f521413b210 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f520c009e50 tx=0x7f520c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:41.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f52190a7700 1 -- 172.21.15.154:0/1380063279 shutdown_connections 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f52190a7700 1 --2- 172.21.15.154:0/1380063279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214138e30 0x7f521413b210 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f52190a7700 1 --2- 172.21.15.154:0/1380063279 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214099a60 0x7f52141388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f52190a7700 1 -- 172.21.15.154:0/1380063279 >> 172.21.15.154:0/1380063279 conn(0x7f52140a2980 msgr2=0x7f52140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f52190a7700 1 -- 172.21.15.154:0/1380063279 shutdown_connections 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.161+0000 7f52190a7700 1 -- 172.21.15.154:0/1380063279 wait complete. 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.162+0000 7f52190a7700 1 Processor -- start 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f52190a7700 1 -- start start 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f52190a7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214099a60 0x7f5214135910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f52190a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214133b80 0x7f5214135e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f52190a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5214138e30 0x7f5214136390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f52190a7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5214137890 con 0x7f5214099a60 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f52190a7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5214119bf0 con 0x7f5214138e30 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f52190a7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f521409a330 con 0x7f5214133b80 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f5212d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214099a60 0x7f5214135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f5212d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214099a60 0x7f5214135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47368/0 (socket says 172.21.15.154:47368) 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f521259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214133b80 0x7f5214135e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f5212d9d700 1 -- 172.21.15.154:0/1766785722 learned_addr learned my addr 172.21.15.154:0/1766785722 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.163+0000 7f521359e700 1 --2- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5214138e30 0x7f5214136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f5212d9d700 1 -- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214133b80 msgr2=0x7f5214135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f5212d9d700 1 --2- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214133b80 0x7f5214135e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f5212d9d700 1 -- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5214138e30 msgr2=0x7f5214136390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f5212d9d700 1 --2- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5214138e30 0x7f5214136390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f5212d9d700 1 -- 172.21.15.154:0/1766785722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c009b30 con 0x7f5214099a60 2023-09-30T22:26:41.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f5212d9d700 1 --2- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214099a60 0x7f5214135910 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f520400c500 tx=0x7f520400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f51fb7fe700 1 -- 172.21.15.154:0/1766785722 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040054e0 con 0x7f5214099a60 2023-09-30T22:26:41.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f51fb7fe700 1 -- 172.21.15.154:0/1766785722 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520400ce10 con 0x7f5214099a60 2023-09-30T22:26:41.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f51fb7fe700 1 -- 172.21.15.154:0/1766785722 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040038c0 con 0x7f5214099a60 2023-09-30T22:26:41.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f52190a7700 1 -- 172.21.15.154:0/1766785722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52141375e0 con 0x7f5214099a60 2023-09-30T22:26:41.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.164+0000 7f52190a7700 1 -- 172.21.15.154:0/1766785722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5214137cc0 con 0x7f5214099a60 2023-09-30T22:26:41.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.165+0000 7f51fb7fe700 1 -- 172.21.15.154:0/1766785722 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5204003a20 con 0x7f5214099a60 2023-09-30T22:26:41.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.165+0000 7f52190a7700 1 -- 172.21.15.154:0/1766785722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5214118fd0 con 0x7f5214099a60 2023-09-30T22:26:41.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.165+0000 7f51fb7fe700 1 -- 172.21.15.154:0/1766785722 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f520403ea60 con 0x7f5214099a60 2023-09-30T22:26:41.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.174+0000 7f51fb7fe700 1 -- 172.21.15.154:0/1766785722 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5214118fd0 con 0x7f5214099a60 2023-09-30T22:26:41.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.198+0000 7f5488b77700 1 Processor -- start 2023-09-30T22:26:41.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.198+0000 7f5488b77700 1 -- start start 2023-09-30T22:26:41.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.198+0000 7fa70ef0a700 1 Processor -- start 2023-09-30T22:26:41.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.198+0000 7fa70ef0a700 1 -- start start 2023-09-30T22:26:41.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7f5488b77700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f548406a770 0x7f548406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7f5488b77700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5484136cb0 0x7f5484139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7f5488b77700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548406e900 con 0x7f548409dec0 2023-09-30T22:26:41.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7f5488b77700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548409d180 con 0x7f548406a770 2023-09-30T22:26:41.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7f5488b77700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f548409e780 con 0x7f5484136cb0 2023-09-30T22:26:41.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7fa70ef0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa708131980 0x7fa708131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7fa70ef0a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa70809bc70 0x7fa70809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7fa70ef0a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809c5c0 0x7fa708138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7fa70ef0a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70806eb30 con 0x7fa70809bc70 2023-09-30T22:26:41.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7fa70ef0a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080a1640 con 0x7fa708131980 2023-09-30T22:26:41.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7fa70ef0a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080a22d0 con 0x7fa70809c5c0 2023-09-30T22:26:41.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7f548259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f548406a770 0x7f548406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7fa70d4a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809c5c0 0x7fa708138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7fa70d4a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809c5c0 0x7fa708138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46206/0 (socket says 172.21.15.154:46206) 2023-09-30T22:26:41.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7fa70d4a7700 1 -- 172.21.15.154:0/1871819551 learned_addr learned my addr 172.21.15.154:0/1871819551 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:41.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7f548259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f548406a770 0x7f548406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47382/0 (socket says 172.21.15.154:47382) 2023-09-30T22:26:41.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7f548259c700 1 -- 172.21.15.154:0/2764810072 learned_addr learned my addr 172.21.15.154:0/2764810072 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:41.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.199+0000 7f5482d9d700 1 --2- 172.21.15.154:0/2764810072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5484136cb0 0x7f5484139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa707fff700 1 --2- 172.21.15.154:0/1871819551 >> v2:172.21.15.154:3300/0 conn(0x7fa70809bc70 0x7fa70809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa70cca6700 1 --2- 172.21.15.154:0/1871819551 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa708131980 0x7fa708131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7f548259c700 1 -- 172.21.15.154:0/2764810072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5484136cb0 msgr2=0x7f5484139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:41.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7f548259c700 1 --2- 172.21.15.154:0/2764810072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5484136cb0 0x7f5484139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7f548259c700 1 -- 172.21.15.154:0/2764810072 >> v1:172.21.15.154:6789/0 conn(0x7f548409dec0 legacy=0x7f548406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7f548259c700 1 -- 172.21.15.154:0/2764810072 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548409d3c0 con 0x7f548406a770 2023-09-30T22:26:41.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa70d4a7700 1 -- 172.21.15.154:0/1871819551 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa708131980 msgr2=0x7fa708131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:41.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa70d4a7700 1 --2- 172.21.15.154:0/1871819551 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa708131980 0x7fa708131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa70d4a7700 1 -- 172.21.15.154:0/1871819551 >> v2:172.21.15.154:3300/0 conn(0x7fa70809bc70 msgr2=0x7fa70809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:41.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa70d4a7700 1 --2- 172.21.15.154:0/1871819551 >> v2:172.21.15.154:3300/0 conn(0x7fa70809bc70 0x7fa70809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa70d4a7700 1 -- 172.21.15.154:0/1871819551 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa708131550 con 0x7fa70809c5c0 2023-09-30T22:26:41.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa70d4a7700 1 --2- 172.21.15.154:0/1871819551 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809c5c0 0x7fa708138700 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa700009e80 tx=0x7fa70000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1cc3c6f27f9acc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa7077fe700 1 -- 172.21.15.154:0/1871819551 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70000e070 con 0x7fa70809c5c0 2023-09-30T22:26:41.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7f548259c700 1 --2- 172.21.15.154:0/2764810072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 0x7f548406ab40 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f54740098f0 tx=0x7f5474009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105da894a8570add server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa7077fe700 1 -- 172.21.15.154:0/1871819551 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70000b980 con 0x7fa70809c5c0 2023-09-30T22:26:41.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.200+0000 7fa7077fe700 1 -- 172.21.15.154:0/1871819551 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70000bd30 con 0x7fa70809c5c0 2023-09-30T22:26:41.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.201+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1871819551 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809c5c0 msgr2=0x7fa708138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.201+0000 7fa70ef0a700 1 --2- 172.21.15.154:0/1871819551 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809c5c0 0x7fa708138700 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa700009e80 tx=0x7fa70000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.201+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1871819551 shutdown_connections 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.201+0000 7fa70ef0a700 1 --2- 172.21.15.154:0/1871819551 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa708131980 0x7fa708131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.201+0000 7fa70ef0a700 1 --2- 172.21.15.154:0/1871819551 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809c5c0 0x7fa708138700 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.201+0000 7fa70ef0a700 1 --2- 172.21.15.154:0/1871819551 >> v2:172.21.15.154:3300/0 conn(0x7fa70809bc70 0x7fa70809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.201+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1871819551 >> 172.21.15.154:0/1871819551 conn(0x7fa7080a2980 msgr2=0x7fa7080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.201+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1871819551 shutdown_connections 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.201+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1871819551 wait complete. 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.202+0000 7fa70ef0a700 1 Processor -- start 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.202+0000 7fa70ef0a700 1 -- start start 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.202+0000 7fa70ef0a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809bc70 0x7fa7081cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70ef0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70809c5c0 0x7fa7081ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70ef0a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa708131980 0x7fa7081cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70ef0a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080a1cb0 con 0x7fa708131980 2023-09-30T22:26:41.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70ef0a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7081254d0 con 0x7fa70809c5c0 2023-09-30T22:26:41.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70ef0a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa708130ec0 con 0x7fa70809bc70 2023-09-30T22:26:41.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7f548159a700 1 -- 172.21.15.154:0/2764810072 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474011830 con 0x7f548406a770 2023-09-30T22:26:41.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7f548159a700 1 -- 172.21.15.154:0/2764810072 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474011990 con 0x7f548406a770 2023-09-30T22:26:41.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7f548159a700 1 -- 172.21.15.154:0/2764810072 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474011d20 con 0x7f548406a770 2023-09-30T22:26:41.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa707fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70809c5c0 0x7fa7081ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70d4a7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa708131980 0x7fa7081cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70d4a7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa708131980 0x7fa7081cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47388/0 (socket says 172.21.15.154:47388) 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa707fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70809c5c0 0x7fa7081ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34710/0 (socket says 172.21.15.154:34710) 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70d4a7700 1 -- 172.21.15.154:0/1267525590 learned_addr learned my addr 172.21.15.154:0/1267525590 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70cca6700 1 --2- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809bc70 0x7fa7081cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa707fff700 1 -- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809bc70 msgr2=0x7fa7081cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa707fff700 1 --2- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809bc70 0x7fa7081cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa707fff700 1 -- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa708131980 msgr2=0x7fa7081cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa707fff700 1 --2- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa708131980 0x7fa7081cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa707fff700 1 -- 172.21.15.154:0/1267525590 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa700009b30 con 0x7fa70809c5c0 2023-09-30T22:26:41.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa70d4a7700 1 --2- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa708131980 0x7fa7081cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:41.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa707fff700 1 --2- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70809c5c0 0x7fa7081ccae0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400e5d0 tx=0x7fa6f400e8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa7057fa700 1 -- 172.21.15.154:0/1267525590 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4004230 con 0x7fa70809c5c0 2023-09-30T22:26:41.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa7057fa700 1 -- 172.21.15.154:0/1267525590 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f4004390 con 0x7fa70809c5c0 2023-09-30T22:26:41.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.203+0000 7fa7057fa700 1 -- 172.21.15.154:0/1267525590 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40036a0 con 0x7fa70809c5c0 2023-09-30T22:26:41.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.204+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1267525590 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa708126f80 con 0x7fa70809c5c0 2023-09-30T22:26:41.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.204+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1267525590 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7081279f0 con 0x7fa70809c5c0 2023-09-30T22:26:41.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.204+0000 7f5488b77700 1 -- 172.21.15.154:0/2764810072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 msgr2=0x7f548406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.204+0000 7f5488b77700 1 --2- 172.21.15.154:0/2764810072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 0x7f548406ab40 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f54740098f0 tx=0x7f5474009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:41.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.204+0000 7f5488b77700 1 -- 172.21.15.154:0/2764810072 shutdown_connections 2023-09-30T22:26:41.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.204+0000 7f5488b77700 1 --2- 172.21.15.154:0/2764810072 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5484136cb0 0x7f5484139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.204+0000 7f5488b77700 1 --2- 172.21.15.154:0/2764810072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 0x7f548406ab40 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.204+0000 7f5488b77700 1 -- 172.21.15.154:0/2764810072 >> 172.21.15.154:0/2764810072 conn(0x7f5484099c40 msgr2=0x7f54840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.204+0000 7f5488b77700 1 -- 172.21.15.154:0/2764810072 shutdown_connections 2023-09-30T22:26:41.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.205+0000 7fa7057fa700 1 -- 172.21.15.154:0/1267525590 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6f4003800 con 0x7fa70809c5c0 2023-09-30T22:26:41.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.205+0000 7fa7057fa700 1 -- 172.21.15.154:0/1267525590 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa6f403ef50 con 0x7fa70809c5c0 2023-09-30T22:26:41.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.205+0000 7f5488b77700 1 -- 172.21.15.154:0/2764810072 wait complete. 2023-09-30T22:26:41.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.205+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1267525590 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70804f2a0 con 0x7fa70809c5c0 2023-09-30T22:26:41.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f5488b77700 1 Processor -- start 2023-09-30T22:26:41.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f5488b77700 1 -- start start 2023-09-30T22:26:41.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f5488b77700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 0x7f5484134310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f5488b77700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f548409dec0 0x7f5484134850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f5488b77700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5484136cb0 0x7f5484134d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f5488b77700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548411af60 con 0x7f548406a770 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f5488b77700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54841390a0 con 0x7f5484136cb0 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f5488b77700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5484071ce0 con 0x7f548409dec0 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f548259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 0x7f5484134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.207+0000 7f5482d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5484136cb0 0x7f5484134d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f548259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 0x7f5484134310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47390/0 (socket says 172.21.15.154:47390) 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f5481d9b700 1 --2- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f548409dec0 0x7f5484134850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f5482d9d700 1 -- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f548409dec0 msgr2=0x7f5484134850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f5482d9d700 1 --2- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f548409dec0 0x7f5484134850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f5482d9d700 1 -- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 msgr2=0x7f5484134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f5482d9d700 1 --2- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 0x7f5484134310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f5482d9d700 1 -- 172.21.15.154:0/3230899629 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5474009550 con 0x7f5484136cb0 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f548259c700 1 -- 172.21.15.154:0/3230899629 learned_addr learned my addr 172.21.15.154:0/3230899629 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f548259c700 1 --2- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 0x7f5484134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.208+0000 7f5482d9d700 1 --2- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5484136cb0 0x7f5484134d90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f547c00b6d0 tx=0x7f547c00b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.210+0000 7f5472ffd700 1 -- 172.21.15.154:0/3230899629 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c019070 con 0x7f5484136cb0 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.210+0000 7f5472ffd700 1 -- 172.21.15.154:0/3230899629 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c007540 con 0x7f5484136cb0 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.210+0000 7f5472ffd700 1 -- 172.21.15.154:0/3230899629 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0078f0 con 0x7f5484136cb0 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.210+0000 7f5488b77700 1 -- 172.21.15.154:0/3230899629 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548411a900 con 0x7f5484136cb0 2023-09-30T22:26:41.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.210+0000 7f5488b77700 1 -- 172.21.15.154:0/3230899629 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548411b630 con 0x7f5484136cb0 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.210+0000 7fa7057fa700 1 -- 172.21.15.154:0/1267525590 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6f401b720 con 0x7fa70809c5c0 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.211+0000 7f5472ffd700 1 -- 172.21.15.154:0/3230899629 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f547c007a50 con 0x7f5484136cb0 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.211+0000 7f5488b77700 1 -- 172.21.15.154:0/3230899629 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548411a1e0 con 0x7f5484136cb0 2023-09-30T22:26:41.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.211+0000 7f5472ffd700 1 -- 172.21.15.154:0/3230899629 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f547c047b10 con 0x7f5484136cb0 2023-09-30T22:26:41.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.216+0000 7f5472ffd700 1 -- 172.21.15.154:0/3230899629 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f547c024b40 con 0x7f5484136cb0 2023-09-30T22:26:41.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.277+0000 7fcf14a47700 1 -- 172.21.15.154:0/664622879 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf1004f2a0 con 0x7fcf10131980 2023-09-30T22:26:41.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.278+0000 7fcefeffd700 1 -- 172.21.15.154:0/664622879 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf08022b00 con 0x7fcf10131980 2023-09-30T22:26:41.279 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:41.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.280+0000 7fcf14a47700 1 -- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf10131980 msgr2=0x7fcf1011e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.280+0000 7fcf14a47700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf10131980 0x7fcf1011e410 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800eed0 tx=0x7fcf0800b390 comp rx=0 tx=0).stop 2023-09-30T22:26:41.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.280+0000 7fcf14a47700 1 -- 172.21.15.154:0/664622879 shutdown_connections 2023-09-30T22:26:41.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.280+0000 7fcf14a47700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf10131980 0x7fcf1011e410 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.280+0000 7fcf14a47700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcf1009bc70 0x7fcf1011d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.280+0000 7fcf14a47700 1 --2- 172.21.15.154:0/664622879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1009c5c0 0x7fcf1011ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.280+0000 7fcf14a47700 1 -- 172.21.15.154:0/664622879 >> 172.21.15.154:0/664622879 conn(0x7fcf100a2980 msgr2=0x7fcf1006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.280+0000 7fcf14a47700 1 -- 172.21.15.154:0/664622879 shutdown_connections 2023-09-30T22:26:41.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.280+0000 7fcf14a47700 1 -- 172.21.15.154:0/664622879 wait complete. 2023-09-30T22:26:41.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:41.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.377+0000 7f52190a7700 1 -- 172.21.15.154:0/1766785722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5214118fd0 con 0x7f5214099a60 2023-09-30T22:26:41.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.377+0000 7f51fb7fe700 1 -- 172.21.15.154:0/1766785722 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5214118fd0 con 0x7f5214099a60 2023-09-30T22:26:41.378 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:41.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.379+0000 7f52190a7700 1 -- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214099a60 msgr2=0x7f5214135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.379+0000 7f52190a7700 1 --2- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214099a60 0x7f5214135910 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f520400c500 tx=0x7f520400c810 comp rx=0 tx=0).stop 2023-09-30T22:26:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.379+0000 7f52190a7700 1 -- 172.21.15.154:0/1766785722 shutdown_connections 2023-09-30T22:26:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.379+0000 7f52190a7700 1 --2- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5214138e30 0x7f5214136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.379+0000 7f52190a7700 1 --2- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5214099a60 0x7f5214135910 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.379+0000 7f52190a7700 1 --2- 172.21.15.154:0/1766785722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5214133b80 0x7f5214135e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.379+0000 7f52190a7700 1 -- 172.21.15.154:0/1766785722 >> 172.21.15.154:0/1766785722 conn(0x7f52140a2980 msgr2=0x7f52141300b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.379+0000 7f52190a7700 1 -- 172.21.15.154:0/1766785722 shutdown_connections 2023-09-30T22:26:41.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.379+0000 7f52190a7700 1 -- 172.21.15.154:0/1766785722 wait complete. 2023-09-30T22:26:41.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:41.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.477+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1267525590 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa70806bce0 con 0x7fa70809c5c0 2023-09-30T22:26:41.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.477+0000 7fa7057fa700 1 -- 172.21.15.154:0/1267525590 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6f402c090 con 0x7fa70809c5c0 2023-09-30T22:26:41.478 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.480+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70809c5c0 msgr2=0x7fa7081ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.480+0000 7fa70ef0a700 1 --2- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70809c5c0 0x7fa7081ccae0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400e5d0 tx=0x7fa6f400e8e0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.480+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1267525590 shutdown_connections 2023-09-30T22:26:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.480+0000 7fa70ef0a700 1 --2- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa708131980 0x7fa7081cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.480+0000 7fa70ef0a700 1 --2- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa70809bc70 0x7fa7081cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.480+0000 7fa70ef0a700 1 --2- 172.21.15.154:0/1267525590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70809c5c0 0x7fa7081ccae0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.480+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1267525590 >> 172.21.15.154:0/1267525590 conn(0x7fa7080a2980 msgr2=0x7fa70809ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.480+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1267525590 shutdown_connections 2023-09-30T22:26:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.480+0000 7fa70ef0a700 1 -- 172.21.15.154:0/1267525590 wait complete. 2023-09-30T22:26:41.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.486+0000 7f5488b77700 1 -- 172.21.15.154:0/3230899629 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f548404f2a0 con 0x7f5484136cb0 2023-09-30T22:26:41.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.487+0000 7f5472ffd700 1 -- 172.21.15.154:0/3230899629 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f547c022070 con 0x7f5484136cb0 2023-09-30T22:26:41.488 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.489+0000 7f5488b77700 1 -- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5484136cb0 msgr2=0x7f5484134d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.489+0000 7f5488b77700 1 --2- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5484136cb0 0x7f5484134d90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f547c00b6d0 tx=0x7f547c00b9e0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.489+0000 7f5488b77700 1 -- 172.21.15.154:0/3230899629 shutdown_connections 2023-09-30T22:26:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.489+0000 7f5488b77700 1 --2- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5484136cb0 0x7f5484134d90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.489+0000 7f5488b77700 1 --2- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f548406a770 0x7f5484134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.489+0000 7f5488b77700 1 --2- 172.21.15.154:0/3230899629 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f548409dec0 0x7f5484134850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.489+0000 7f5488b77700 1 -- 172.21.15.154:0/3230899629 >> 172.21.15.154:0/3230899629 conn(0x7f5484099c40 msgr2=0x7f548412f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.489+0000 7f5488b77700 1 -- 172.21.15.154:0/3230899629 shutdown_connections 2023-09-30T22:26:41.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:41.489+0000 7f5488b77700 1 -- 172.21.15.154:0/3230899629 wait complete. 2023-09-30T22:26:41.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:41.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:42.294 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:42.393 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.427+0000 7f90d1228700 1 Processor -- start 2023-09-30T22:26:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.427+0000 7f90d1228700 1 -- start start 2023-09-30T22:26:42.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90d1228700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc09e870 0x7f90cc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90d1228700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90cc09f180 0x7f90cc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90d1228700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc131d70 0x7f90cc132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90d1228700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc0a0920 con 0x7f90cc09f180 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90d1228700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc09c970 con 0x7f90cc131d70 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90d1228700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc09bab0 con 0x7f90cc09e870 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc09e870 0x7f90cc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc09e870 0x7f90cc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46246/0 (socket says 172.21.15.154:46246) 2023-09-30T22:26:42.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cad9d700 1 -- 172.21.15.154:0/3099228630 learned_addr learned my addr 172.21.15.154:0/3099228630 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:42.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cb59e700 1 --2- 172.21.15.154:0/3099228630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc131d70 0x7f90cc132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90ca59c700 1 --2- 172.21.15.154:0/3099228630 >> v2:172.21.15.154:3300/0 conn(0x7f90cc09f180 0x7f90cc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cb59e700 1 -- 172.21.15.154:0/3099228630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc09e870 msgr2=0x7f90cc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cb59e700 1 --2- 172.21.15.154:0/3099228630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc09e870 0x7f90cc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cb59e700 1 -- 172.21.15.154:0/3099228630 >> v2:172.21.15.154:3300/0 conn(0x7f90cc09f180 msgr2=0x7f90cc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cb59e700 1 --2- 172.21.15.154:0/3099228630 >> v2:172.21.15.154:3300/0 conn(0x7f90cc09f180 0x7f90cc131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cb59e700 1 -- 172.21.15.154:0/3099228630 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc09f9c0 con 0x7f90cc131d70 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cad9d700 1 --2- 172.21.15.154:0/3099228630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc09e870 0x7f90cc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90ca59c700 1 --2- 172.21.15.154:0/3099228630 >> v2:172.21.15.154:3300/0 conn(0x7f90cc09f180 0x7f90cc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90cb59e700 1 --2- 172.21.15.154:0/3099228630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc131d70 0x7f90cc132210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009dc0 tx=0x7f90c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=715ccd6b41f426c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.428+0000 7f90c9d9b700 1 -- 172.21.15.154:0/3099228630 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400e070 con 0x7f90cc131d70 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90c9d9b700 1 -- 172.21.15.154:0/3099228630 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c400bae0 con 0x7f90cc131d70 2023-09-30T22:26:42.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90c9d9b700 1 -- 172.21.15.154:0/3099228630 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400be90 con 0x7f90cc131d70 2023-09-30T22:26:42.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90d1228700 1 -- 172.21.15.154:0/3099228630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc131d70 msgr2=0x7f90cc132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90d1228700 1 --2- 172.21.15.154:0/3099228630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc131d70 0x7f90cc132210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009dc0 tx=0x7f90c400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90d1228700 1 -- 172.21.15.154:0/3099228630 shutdown_connections 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90d1228700 1 --2- 172.21.15.154:0/3099228630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc131d70 0x7f90cc132210 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90d1228700 1 --2- 172.21.15.154:0/3099228630 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc09e870 0x7f90cc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90d1228700 1 --2- 172.21.15.154:0/3099228630 >> v2:172.21.15.154:3300/0 conn(0x7f90cc09f180 0x7f90cc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90d1228700 1 -- 172.21.15.154:0/3099228630 >> 172.21.15.154:0/3099228630 conn(0x7f90cc0a4430 msgr2=0x7f90cc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90d1228700 1 -- 172.21.15.154:0/3099228630 shutdown_connections 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.429+0000 7f90d1228700 1 -- 172.21.15.154:0/3099228630 wait complete. 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.431+0000 7f90d1228700 1 Processor -- start 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.431+0000 7f90d1228700 1 -- start start 2023-09-30T22:26:42.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.431+0000 7f90d1228700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc09e870 0x7f90cc06c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.431+0000 7f90d1228700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90cc09f180 0x7f90cc06c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.431+0000 7f90d1228700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc131d70 0x7f90cc1c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.431+0000 7f90d1228700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc122290 con 0x7f90cc09f180 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.431+0000 7f90d1228700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0a2bc0 con 0x7f90cc09e870 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.431+0000 7f90d1228700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0a0210 con 0x7f90cc131d70 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc09e870 0x7f90cc06c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cb59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc131d70 0x7f90cc1c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc09e870 0x7f90cc06c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34740/0 (socket says 172.21.15.154:34740) 2023-09-30T22:26:42.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cb59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc131d70 0x7f90cc1c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46260/0 (socket says 172.21.15.154:46260) 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cad9d700 1 -- 172.21.15.154:0/973588228 learned_addr learned my addr 172.21.15.154:0/973588228 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90ca59c700 1 --2- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90cc09f180 0x7f90cc06c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cad9d700 1 -- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc131d70 msgr2=0x7f90cc1c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cad9d700 1 --2- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc131d70 0x7f90cc1c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cad9d700 1 -- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90cc09f180 msgr2=0x7f90cc06c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cad9d700 1 --2- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90cc09f180 0x7f90cc06c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cad9d700 1 -- 172.21.15.154:0/973588228 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009550 con 0x7f90cc09e870 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cb59e700 1 --2- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc131d70 0x7f90cc1c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90cad9d700 1 --2- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc09e870 0x7f90cc06c0c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00ebb0 tx=0x7f90bc00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90b37fe700 1 -- 172.21.15.154:0/973588228 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc004030 con 0x7f90cc09e870 2023-09-30T22:26:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90b37fe700 1 -- 172.21.15.154:0/973588228 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc004190 con 0x7f90cc09e870 2023-09-30T22:26:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90d1228700 1 -- 172.21.15.154:0/973588228 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c00094a0 con 0x7f90cc09e870 2023-09-30T22:26:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90b37fe700 1 -- 172.21.15.154:0/973588228 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc004520 con 0x7f90cc09e870 2023-09-30T22:26:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.432+0000 7f90d1228700 1 -- 172.21.15.154:0/973588228 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c4009a70 con 0x7f90cc09e870 2023-09-30T22:26:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.433+0000 7f90b37fe700 1 -- 172.21.15.154:0/973588228 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90bc00c850 con 0x7f90cc09e870 2023-09-30T22:26:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.433+0000 7f90b37fe700 1 -- 172.21.15.154:0/973588228 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f90bc03f810 con 0x7f90cc09e870 2023-09-30T22:26:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.433+0000 7f90d1228700 1 -- 172.21.15.154:0/973588228 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90cc1223d0 con 0x7f90cc09e870 2023-09-30T22:26:42.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.438+0000 7f90b37fe700 1 -- 172.21.15.154:0/973588228 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90cc1223d0 con 0x7f90cc09e870 2023-09-30T22:26:42.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:42.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:42.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.521+0000 7f9db67e2700 1 Processor -- start 2023-09-30T22:26:42.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.521+0000 7f9db67e2700 1 -- start start 2023-09-30T22:26:42.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9db67e2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9db0136960 0x7f9db0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9db67e2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0139280 0x7f9db013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9db67e2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db006b2d0 con 0x7f9db0133ad0 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9db67e2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db01345b0 con 0x7f9db0136960 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9db67e2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0133610 con 0x7f9db0139280 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9daf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9db0136960 0x7f9db0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9daf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9db0136960 0x7f9db0138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47414/0 (socket says 172.21.15.154:47414) 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9daf7fe700 1 -- 172.21.15.154:0/2154197738 learned_addr learned my addr 172.21.15.154:0/2154197738 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9daf7fe700 1 -- 172.21.15.154:0/2154197738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0139280 msgr2=0x7f9db013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9daf7fe700 1 --2- 172.21.15.154:0/2154197738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0139280 0x7f9db013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9daf7fe700 1 -- 172.21.15.154:0/2154197738 >> v1:172.21.15.154:6789/0 conn(0x7f9db0133ad0 legacy=0x7f9db0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9daf7fe700 1 -- 172.21.15.154:0/2154197738 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db009a500 con 0x7f9db0136960 2023-09-30T22:26:42.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.522+0000 7f9daf7fe700 1 --2- 172.21.15.154:0/2154197738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 0x7f9db0138d40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f9da40098f0 tx=0x7f9da4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7135a0ac2aba3216 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9daeffd700 1 -- 172.21.15.154:0/2154197738 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400b8a0 con 0x7f9db0136960 2023-09-30T22:26:42.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9daeffd700 1 -- 172.21.15.154:0/2154197738 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da400ba00 con 0x7f9db0136960 2023-09-30T22:26:42.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9daeffd700 1 -- 172.21.15.154:0/2154197738 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400bd90 con 0x7f9db0136960 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9db67e2700 1 -- 172.21.15.154:0/2154197738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 msgr2=0x7f9db0138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9db67e2700 1 --2- 172.21.15.154:0/2154197738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 0x7f9db0138d40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f9da40098f0 tx=0x7f9da4009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9db67e2700 1 -- 172.21.15.154:0/2154197738 shutdown_connections 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9db67e2700 1 --2- 172.21.15.154:0/2154197738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0139280 0x7f9db013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9db67e2700 1 --2- 172.21.15.154:0/2154197738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 0x7f9db0138d40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9db67e2700 1 -- 172.21.15.154:0/2154197738 >> 172.21.15.154:0/2154197738 conn(0x7f9db0099c40 msgr2=0x7f9db00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.523+0000 7f9db67e2700 1 -- 172.21.15.154:0/2154197738 shutdown_connections 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.524+0000 7f9db67e2700 1 -- 172.21.15.154:0/2154197738 wait complete. 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.525+0000 7f9db67e2700 1 Processor -- start 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.525+0000 7f9db67e2700 1 -- start start 2023-09-30T22:26:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.525+0000 7f9db67e2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133ad0 0x7f9db012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.525+0000 7f9db67e2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 0x7f9db012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.525+0000 7f9db67e2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0139280 0x7f9db012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.525+0000 7f9db67e2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db009f390 con 0x7f9db0136960 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9db67e2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0070020 con 0x7f9db0139280 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9db67e2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9db01316a0 con 0x7f9db0133ad0 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 0x7f9db012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133ad0 0x7f9db012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 0x7f9db012d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47424/0 (socket says 172.21.15.154:47424) 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daf7fe700 1 -- 172.21.15.154:0/1345368026 learned_addr learned my addr 172.21.15.154:0/1345368026 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daffff700 1 -- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0139280 msgr2=0x7f9db012d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daffff700 1 --2- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0139280 0x7f9db012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daffff700 1 -- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 msgr2=0x7f9db012d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daffff700 1 --2- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 0x7f9db012d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daffff700 1 -- 172.21.15.154:0/1345368026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4009550 con 0x7f9db0133ad0 2023-09-30T22:26:42.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daf7fe700 1 --2- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 0x7f9db012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:42.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9daffff700 1 --2- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133ad0 0x7f9db012cb30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9da0000f60 tx=0x7f9da000c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.526+0000 7f9dacff9700 1 -- 172.21.15.154:0/1345368026 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00052d0 con 0x7f9db0133ad0 2023-09-30T22:26:42.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.527+0000 7f9dacff9700 1 -- 172.21.15.154:0/1345368026 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da000ce90 con 0x7f9db0133ad0 2023-09-30T22:26:42.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.527+0000 7f9dacff9700 1 -- 172.21.15.154:0/1345368026 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0003680 con 0x7f9db0133ad0 2023-09-30T22:26:42.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.527+0000 7f9db67e2700 1 -- 172.21.15.154:0/1345368026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db0072390 con 0x7f9db0133ad0 2023-09-30T22:26:42.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.527+0000 7f9db67e2700 1 -- 172.21.15.154:0/1345368026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db00705c0 con 0x7f9db0133ad0 2023-09-30T22:26:42.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.528+0000 7f9dacff9700 1 -- 172.21.15.154:0/1345368026 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9da00037e0 con 0x7f9db0133ad0 2023-09-30T22:26:42.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.528+0000 7f9dacff9700 1 -- 172.21.15.154:0/1345368026 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9da003e860 con 0x7f9db0133ad0 2023-09-30T22:26:42.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.528+0000 7f9db67e2700 1 -- 172.21.15.154:0/1345368026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db0130d40 con 0x7f9db0133ad0 2023-09-30T22:26:42.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.533+0000 7f9dacff9700 1 -- 172.21.15.154:0/1345368026 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9da0017020 con 0x7f9db0133ad0 2023-09-30T22:26:42.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.634+0000 7fb11afe8700 1 Processor -- start 2023-09-30T22:26:42.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.635+0000 7fb11afe8700 1 -- start start 2023-09-30T22:26:42.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.635+0000 7fb11afe8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130350 0x7fb114130720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.635+0000 7fb11afe8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb114130c60 0x7fb11412cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.635+0000 7fb11afe8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb11412d470 0x7fb11412d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.635+0000 7fb11afe8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb114072520 con 0x7fb11412d470 2023-09-30T22:26:42.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.635+0000 7fb11afe8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1140a24b0 con 0x7fb114130350 2023-09-30T22:26:42.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.635+0000 7fb11afe8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb11409bbb0 con 0x7fb114130c60 2023-09-30T22:26:42.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.635+0000 7fb118d84700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130350 0x7fb114130720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb118d84700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130350 0x7fb114130720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34772/0 (socket says 172.21.15.154:34772) 2023-09-30T22:26:42.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb118d84700 1 -- 172.21.15.154:0/3783030687 learned_addr learned my addr 172.21.15.154:0/3783030687 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb119585700 1 --2- 172.21.15.154:0/3783030687 >> v2:172.21.15.154:3300/0 conn(0x7fb11412d470 0x7fb11412d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb113fff700 1 --2- 172.21.15.154:0/3783030687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb114130c60 0x7fb11412cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb118d84700 1 -- 172.21.15.154:0/3783030687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb114130c60 msgr2=0x7fb11412cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb118d84700 1 --2- 172.21.15.154:0/3783030687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb114130c60 0x7fb11412cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb118d84700 1 -- 172.21.15.154:0/3783030687 >> v2:172.21.15.154:3300/0 conn(0x7fb11412d470 msgr2=0x7fb11412d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb118d84700 1 --2- 172.21.15.154:0/3783030687 >> v2:172.21.15.154:3300/0 conn(0x7fb11412d470 0x7fb11412d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb118d84700 1 -- 172.21.15.154:0/3783030687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11409cd30 con 0x7fb114130350 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb118d84700 1 --2- 172.21.15.154:0/3783030687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130350 0x7fb114130720 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb10800bbc0 tx=0x7fb10800bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba10ad16517b9a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb1137fe700 1 -- 172.21.15.154:0/3783030687 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108005e30 con 0x7fb114130350 2023-09-30T22:26:42.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb1137fe700 1 -- 172.21.15.154:0/3783030687 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb108004030 con 0x7fb114130350 2023-09-30T22:26:42.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.636+0000 7fb1137fe700 1 -- 172.21.15.154:0/3783030687 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080043e0 con 0x7fb114130350 2023-09-30T22:26:42.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.637+0000 7fb11afe8700 1 -- 172.21.15.154:0/3783030687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130350 msgr2=0x7fb114130720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.637+0000 7fb11afe8700 1 --2- 172.21.15.154:0/3783030687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130350 0x7fb114130720 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb10800bbc0 tx=0x7fb10800bed0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.637+0000 7fb11afe8700 1 -- 172.21.15.154:0/3783030687 shutdown_connections 2023-09-30T22:26:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.637+0000 7fb11afe8700 1 --2- 172.21.15.154:0/3783030687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130350 0x7fb114130720 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.637+0000 7fb11afe8700 1 --2- 172.21.15.154:0/3783030687 >> v2:172.21.15.154:3300/0 conn(0x7fb11412d470 0x7fb11412d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.637+0000 7fb11afe8700 1 --2- 172.21.15.154:0/3783030687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb114130c60 0x7fb11412cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.637+0000 7fb11afe8700 1 -- 172.21.15.154:0/3783030687 >> 172.21.15.154:0/3783030687 conn(0x7fb1140a2980 msgr2=0x7fb1140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.637+0000 7fb11afe8700 1 -- 172.21.15.154:0/3783030687 shutdown_connections 2023-09-30T22:26:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.637+0000 7fb11afe8700 1 -- 172.21.15.154:0/3783030687 wait complete. 2023-09-30T22:26:42.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.638+0000 7fb11afe8700 1 Processor -- start 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.638+0000 7fb11afe8700 1 -- start start 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb11afe8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb11412d470 0x7fb114119640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb11afe8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb114130350 0x7fb114119b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb11afe8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130c60 0x7fb11411a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb11afe8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11411cf60 con 0x7fb114130350 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb11afe8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11411d160 con 0x7fb114130c60 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb11afe8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb11411c050 con 0x7fb11412d470 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb119585700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130c60 0x7fb11411a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb119585700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130c60 0x7fb11411a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34776/0 (socket says 172.21.15.154:34776) 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb119585700 1 -- 172.21.15.154:0/2221889113 learned_addr learned my addr 172.21.15.154:0/2221889113 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb118d84700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb11412d470 0x7fb114119640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.639+0000 7fb113fff700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb114130350 0x7fb114119b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb119585700 1 -- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb11412d470 msgr2=0x7fb114119640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb119585700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb11412d470 0x7fb114119640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb119585700 1 -- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb114130350 msgr2=0x7fb114119b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb119585700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb114130350 0x7fb114119b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb119585700 1 -- 172.21.15.154:0/2221889113 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10800b7a0 con 0x7fb114130c60 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb118d84700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb11412d470 0x7fb114119640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb119585700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130c60 0x7fb11411a0c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009dd0 tx=0x7fb10c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb1117fa700 1 -- 172.21.15.154:0/2221889113 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c009c40 con 0x7fb114130c60 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb1117fa700 1 -- 172.21.15.154:0/2221889113 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c00f040 con 0x7fb114130c60 2023-09-30T22:26:42.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb1117fa700 1 -- 172.21.15.154:0/2221889113 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c00c880 con 0x7fb114130c60 2023-09-30T22:26:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb11afe8700 1 -- 172.21.15.154:0/2221889113 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11411b2f0 con 0x7fb114130c60 2023-09-30T22:26:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.640+0000 7fb11afe8700 1 -- 172.21.15.154:0/2221889113 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11409b490 con 0x7fb114130c60 2023-09-30T22:26:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.641+0000 7fb1117fa700 1 -- 172.21.15.154:0/2221889113 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb10c00ca00 con 0x7fb114130c60 2023-09-30T22:26:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.642+0000 7fb11afe8700 1 -- 172.21.15.154:0/2221889113 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11406f730 con 0x7fb114130c60 2023-09-30T22:26:42.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.642+0000 7fb1117fa700 1 -- 172.21.15.154:0/2221889113 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb10c04b220 con 0x7fb114130c60 2023-09-30T22:26:42.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.646+0000 7fb1117fa700 1 -- 172.21.15.154:0/2221889113 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb10c00ccb0 con 0x7fb114130c60 2023-09-30T22:26:42.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.650+0000 7f5d348a7700 1 Processor -- start 2023-09-30T22:26:42.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.650+0000 7f5d348a7700 1 -- start start 2023-09-30T22:26:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d348a7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d30136960 0x7f5d30138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d348a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d3013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d348a7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3006b2d0 con 0x7f5d30133ad0 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d348a7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d301345b0 con 0x7f5d30136960 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d348a7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30133610 con 0x7f5d30139280 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d2ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d3013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d2ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d3013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46318/0 (socket says 172.21.15.154:46318) 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d2ed9d700 1 -- 172.21.15.154:0/697579904 learned_addr learned my addr 172.21.15.154:0/697579904 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d2dd9b700 1 --2- 172.21.15.154:0/697579904 >> v2:172.21.15.154:3300/0 conn(0x7f5d30136960 0x7f5d30138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d2ed9d700 1 -- 172.21.15.154:0/697579904 >> v2:172.21.15.154:3300/0 conn(0x7f5d30136960 msgr2=0x7f5d30138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d2ed9d700 1 --2- 172.21.15.154:0/697579904 >> v2:172.21.15.154:3300/0 conn(0x7f5d30136960 0x7f5d30138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d2ed9d700 1 -- 172.21.15.154:0/697579904 >> v1:172.21.15.154:6789/0 conn(0x7f5d30133ad0 legacy=0x7f5d30133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d2ed9d700 1 -- 172.21.15.154:0/697579904 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3009a500 con 0x7f5d30139280 2023-09-30T22:26:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.651+0000 7f5d2ed9d700 1 --2- 172.21.15.154:0/697579904 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d3013b660 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009e50 tx=0x7f5d2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=194329eaabddba7f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d2d59a700 1 -- 172.21.15.154:0/697579904 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800e070 con 0x7f5d30139280 2023-09-30T22:26:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d2d59a700 1 -- 172.21.15.154:0/697579904 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800b9c0 con 0x7f5d30139280 2023-09-30T22:26:42.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d2d59a700 1 -- 172.21.15.154:0/697579904 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800bd70 con 0x7f5d30139280 2023-09-30T22:26:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d348a7700 1 -- 172.21.15.154:0/697579904 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 msgr2=0x7f5d3013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d348a7700 1 --2- 172.21.15.154:0/697579904 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d3013b660 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009e50 tx=0x7f5d2800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d348a7700 1 -- 172.21.15.154:0/697579904 shutdown_connections 2023-09-30T22:26:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d348a7700 1 --2- 172.21.15.154:0/697579904 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d3013b660 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d348a7700 1 --2- 172.21.15.154:0/697579904 >> v2:172.21.15.154:3300/0 conn(0x7f5d30136960 0x7f5d30138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d348a7700 1 -- 172.21.15.154:0/697579904 >> 172.21.15.154:0/697579904 conn(0x7f5d30099c40 msgr2=0x7f5d300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d348a7700 1 -- 172.21.15.154:0/697579904 shutdown_connections 2023-09-30T22:26:42.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.652+0000 7f5d348a7700 1 -- 172.21.15.154:0/697579904 wait complete. 2023-09-30T22:26:42.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.653+0000 7f90d1228700 1 -- 172.21.15.154:0/973588228 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f90cc121f10 con 0x7f90cc09e870 2023-09-30T22:26:42.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.653+0000 7f5d348a7700 1 Processor -- start 2023-09-30T22:26:42.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.653+0000 7f5d348a7700 1 -- start start 2023-09-30T22:26:42.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d348a7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30133ad0 0x7f5d3012fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d348a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30136960 0x7f5d3012ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d348a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d301c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d348a7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30070370 con 0x7f5d30133ad0 2023-09-30T22:26:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d348a7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d301316a0 con 0x7f5d30136960 2023-09-30T22:26:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d348a7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3006fe40 con 0x7f5d30139280 2023-09-30T22:26:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d301c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d301c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46322/0 (socket says 172.21.15.154:46322) 2023-09-30T22:26:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2ed9d700 1 -- 172.21.15.154:0/635292591 learned_addr learned my addr 172.21.15.154:0/635292591 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2e59c700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30133ad0 0x7f5d3012fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2dd9b700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30136960 0x7f5d3012ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2ed9d700 1 -- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30136960 msgr2=0x7f5d3012ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2ed9d700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30136960 0x7f5d3012ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2ed9d700 1 -- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30133ad0 msgr2=0x7f5d3012fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2ed9d700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30133ad0 0x7f5d3012fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.654+0000 7f5d2ed9d700 1 -- 172.21.15.154:0/635292591 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28009b30 con 0x7f5d30139280 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.655+0000 7f5d2ed9d700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d301c8570 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5d28012000 tx=0x7f5d28004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.655+0000 7f5d2dd9b700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30136960 0x7f5d3012ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.655+0000 7f5d1effd700 1 -- 172.21.15.154:0/635292591 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280048b0 con 0x7f5d30139280 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.655+0000 7f5d348a7700 1 -- 172.21.15.154:0/635292591 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3006ef30 con 0x7f5d30139280 2023-09-30T22:26:42.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.655+0000 7f5d348a7700 1 -- 172.21.15.154:0/635292591 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d301304b0 con 0x7f5d30139280 2023-09-30T22:26:42.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.655+0000 7f5d1effd700 1 -- 172.21.15.154:0/635292591 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d280092e0 con 0x7f5d30139280 2023-09-30T22:26:42.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.655+0000 7f5d1effd700 1 -- 172.21.15.154:0/635292591 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2801c610 con 0x7f5d30139280 2023-09-30T22:26:42.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.656+0000 7f5d1effd700 1 -- 172.21.15.154:0/635292591 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d2801c770 con 0x7f5d30139280 2023-09-30T22:26:42.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.656+0000 7f5d1effd700 1 -- 172.21.15.154:0/635292591 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5d28041750 con 0x7f5d30139280 2023-09-30T22:26:42.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.656+0000 7f5d348a7700 1 -- 172.21.15.154:0/635292591 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3004f2a0 con 0x7f5d30139280 2023-09-30T22:26:42.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.665+0000 7f90b37fe700 1 -- 172.21.15.154:0/973588228 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90cc121f10 con 0x7f90cc09e870 2023-09-30T22:26:42.666 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:42.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.665+0000 7f5d1effd700 1 -- 172.21.15.154:0/635292591 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d2801ca20 con 0x7f5d30139280 2023-09-30T22:26:42.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.667+0000 7f90d1228700 1 -- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc09e870 msgr2=0x7f90cc06c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.667+0000 7f90d1228700 1 --2- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc09e870 0x7f90cc06c0c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00ebb0 tx=0x7f90bc00eec0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.667+0000 7f90d1228700 1 -- 172.21.15.154:0/973588228 shutdown_connections 2023-09-30T22:26:42.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.667+0000 7f90d1228700 1 --2- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f90cc131d70 0x7f90cc1c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.667+0000 7f90d1228700 1 --2- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90cc09e870 0x7f90cc06c0c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.667+0000 7f90d1228700 1 --2- 172.21.15.154:0/973588228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90cc09f180 0x7f90cc06c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.667+0000 7f90d1228700 1 -- 172.21.15.154:0/973588228 >> 172.21.15.154:0/973588228 conn(0x7f90cc0a4430 msgr2=0x7f90cc1b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.667+0000 7f90d1228700 1 -- 172.21.15.154:0/973588228 shutdown_connections 2023-09-30T22:26:42.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.667+0000 7f90d1228700 1 -- 172.21.15.154:0/973588228 wait complete. 2023-09-30T22:26:42.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:42.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.736+0000 7f9db67e2700 1 -- 172.21.15.154:0/1345368026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9db0072330 con 0x7f9db0133ad0 2023-09-30T22:26:42.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.736+0000 7f9dacff9700 1 -- 172.21.15.154:0/1345368026 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9da00196b0 con 0x7f9db0133ad0 2023-09-30T22:26:42.737 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:42.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.738+0000 7f9db67e2700 1 -- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133ad0 msgr2=0x7f9db012cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.738+0000 7f9db67e2700 1 --2- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133ad0 0x7f9db012cb30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9da0000f60 tx=0x7f9da000c6e0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.738+0000 7f9db67e2700 1 -- 172.21.15.154:0/1345368026 shutdown_connections 2023-09-30T22:26:42.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.738+0000 7f9db67e2700 1 --2- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db0139280 0x7f9db012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.738+0000 7f9db67e2700 1 --2- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9db0133ad0 0x7f9db012cb30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.738+0000 7f9db67e2700 1 --2- 172.21.15.154:0/1345368026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db0136960 0x7f9db012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.738+0000 7f9db67e2700 1 -- 172.21.15.154:0/1345368026 >> 172.21.15.154:0/1345368026 conn(0x7f9db0099c40 msgr2=0x7f9db0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.738+0000 7f9db67e2700 1 -- 172.21.15.154:0/1345368026 shutdown_connections 2023-09-30T22:26:42.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.738+0000 7f9db67e2700 1 -- 172.21.15.154:0/1345368026 wait complete. 2023-09-30T22:26:42.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:42.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.849+0000 7fb11afe8700 1 -- 172.21.15.154:0/2221889113 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb11404f2a0 con 0x7fb114130c60 2023-09-30T22:26:42.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.850+0000 7fb1117fa700 1 -- 172.21.15.154:0/2221889113 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb10c026c60 con 0x7fb114130c60 2023-09-30T22:26:42.851 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:42.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.853+0000 7fb11afe8700 1 -- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130c60 msgr2=0x7fb11411a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.853+0000 7fb11afe8700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130c60 0x7fb11411a0c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009dd0 tx=0x7fb10c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.853+0000 7fb11afe8700 1 -- 172.21.15.154:0/2221889113 shutdown_connections 2023-09-30T22:26:42.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.853+0000 7fb11afe8700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb114130c60 0x7fb11411a0c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.853+0000 7fb11afe8700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb11412d470 0x7fb114119640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.853+0000 7fb11afe8700 1 --2- 172.21.15.154:0/2221889113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb114130350 0x7fb114119b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.853+0000 7fb11afe8700 1 -- 172.21.15.154:0/2221889113 >> 172.21.15.154:0/2221889113 conn(0x7fb1140a2980 msgr2=0x7fb11412c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.853+0000 7fb11afe8700 1 -- 172.21.15.154:0/2221889113 shutdown_connections 2023-09-30T22:26:42.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.853+0000 7fb11afe8700 1 -- 172.21.15.154:0/2221889113 wait complete. 2023-09-30T22:26:42.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.862+0000 7f5d348a7700 1 -- 172.21.15.154:0/635292591 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d3009f0f0 con 0x7f5d30139280 2023-09-30T22:26:42.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.862+0000 7f5d1effd700 1 -- 172.21.15.154:0/635292591 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d28032030 con 0x7f5d30139280 2023-09-30T22:26:42.863 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:42.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.864+0000 7f5d348a7700 1 -- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 msgr2=0x7f5d301c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:42.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.864+0000 7f5d348a7700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d301c8570 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5d28012000 tx=0x7f5d28004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.864+0000 7f5d348a7700 1 -- 172.21.15.154:0/635292591 shutdown_connections 2023-09-30T22:26:42.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.864+0000 7f5d348a7700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d30139280 0x7f5d301c8570 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.864+0000 7f5d348a7700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d30133ad0 0x7f5d3012fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.864+0000 7f5d348a7700 1 --2- 172.21.15.154:0/635292591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30136960 0x7f5d3012ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.864+0000 7f5d348a7700 1 -- 172.21.15.154:0/635292591 >> 172.21.15.154:0/635292591 conn(0x7f5d30099c40 msgr2=0x7f5d30134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.864+0000 7f5d348a7700 1 -- 172.21.15.154:0/635292591 shutdown_connections 2023-09-30T22:26:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:42.864+0000 7f5d348a7700 1 -- 172.21.15.154:0/635292591 wait complete. 2023-09-30T22:26:42.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:42.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:43.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:43.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:43.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.825+0000 7f39b2e76700 1 Processor -- start 2023-09-30T22:26:43.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39b2e76700 1 -- start start 2023-09-30T22:26:43.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39b2e76700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a1550 0x7f39ac138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39b2e76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac139200 0x7f39ac13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39b2e76700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ac09e9d0 con 0x7f39ac0a0a70 2023-09-30T22:26:43.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39b2e76700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac09dc00 con 0x7f39ac0a1550 2023-09-30T22:26:43.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39b2e76700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac09dec0 con 0x7f39ac139200 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39abfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a1550 0x7f39ac138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39abfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a1550 0x7f39ac138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34796/0 (socket says 172.21.15.154:34796) 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39b0c12700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f39ac0a0a70 0x7f39ac0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42108/0 (socket says 172.21.15.154:42108) 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39abfff700 1 -- 172.21.15.154:0/2484621108 learned_addr learned my addr 172.21.15.154:0/2484621108 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.826+0000 7f39b1413700 1 --2- 172.21.15.154:0/2484621108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac139200 0x7f39ac13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39b1413700 1 -- 172.21.15.154:0/2484621108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a1550 msgr2=0x7f39ac138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39b1413700 1 --2- 172.21.15.154:0/2484621108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a1550 0x7f39ac138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39b1413700 1 -- 172.21.15.154:0/2484621108 >> v1:172.21.15.154:6789/0 conn(0x7f39ac0a0a70 legacy=0x7f39ac0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39b1413700 1 -- 172.21.15.154:0/2484621108 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac09e6a0 con 0x7f39ac139200 2023-09-30T22:26:43.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39ab7fe700 1 -- 172.21.15.154:0/2484621108 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501374025 0 0) 0x7f39ac09e9d0 con 0x7f39ac0a0a70 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39abfff700 1 --2- 172.21.15.154:0/2484621108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a1550 0x7f39ac138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39b1413700 1 --2- 172.21.15.154:0/2484621108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac139200 0x7f39ac13b5e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009dc0 tx=0x7f39a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1ba81833037d04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39ab7fe700 1 -- 172.21.15.154:0/2484621108 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400e070 con 0x7f39ac139200 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39ab7fe700 1 -- 172.21.15.154:0/2484621108 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a400bb20 con 0x7f39ac139200 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.827+0000 7f39ab7fe700 1 -- 172.21.15.154:0/2484621108 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4012430 con 0x7f39ac139200 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.828+0000 7f39b2e76700 1 -- 172.21.15.154:0/2484621108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac139200 msgr2=0x7f39ac13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.828+0000 7f39b2e76700 1 --2- 172.21.15.154:0/2484621108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac139200 0x7f39ac13b5e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009dc0 tx=0x7f39a400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.828+0000 7f39b2e76700 1 -- 172.21.15.154:0/2484621108 shutdown_connections 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.828+0000 7f39b2e76700 1 --2- 172.21.15.154:0/2484621108 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac139200 0x7f39ac13b5e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.828+0000 7f39b2e76700 1 --2- 172.21.15.154:0/2484621108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a1550 0x7f39ac138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.828+0000 7f39b2e76700 1 -- 172.21.15.154:0/2484621108 >> 172.21.15.154:0/2484621108 conn(0x7f39ac0a6610 msgr2=0x7f39ac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.828+0000 7f39b2e76700 1 -- 172.21.15.154:0/2484621108 shutdown_connections 2023-09-30T22:26:43.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.828+0000 7f39b2e76700 1 -- 172.21.15.154:0/2484621108 wait complete. 2023-09-30T22:26:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.829+0000 7f39b2e76700 1 Processor -- start 2023-09-30T22:26:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.829+0000 7f39b2e76700 1 -- start start 2023-09-30T22:26:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b2e76700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a0a70 0x7f39ac11e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b2e76700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac0a1550 0x7f39ac11ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b2e76700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39ac139200 0x7f39ac11f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b2e76700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac122080 con 0x7f39ac139200 2023-09-30T22:26:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b2e76700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac120560 con 0x7f39ac0a0a70 2023-09-30T22:26:43.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b2e76700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac09d340 con 0x7f39ac0a1550 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b0c12700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a0a70 0x7f39ac11e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b1413700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39ac139200 0x7f39ac11f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b0c12700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a0a70 0x7f39ac11e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34806/0 (socket says 172.21.15.154:34806) 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b0c12700 1 -- 172.21.15.154:0/2715376985 learned_addr learned my addr 172.21.15.154:0/2715376985 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39abfff700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac0a1550 0x7f39ac11ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b0c12700 1 -- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac0a1550 msgr2=0x7f39ac11ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b0c12700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac0a1550 0x7f39ac11ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b0c12700 1 -- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39ac139200 msgr2=0x7f39ac11f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b0c12700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39ac139200 0x7f39ac11f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b0c12700 1 -- 172.21.15.154:0/2715376985 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998009550 con 0x7f39ac0a0a70 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39abfff700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac0a1550 0x7f39ac11ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b1413700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39ac139200 0x7f39ac11f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39b0c12700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a0a70 0x7f39ac11e7a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f39a000c520 tx=0x7f39a000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39a97fa700 1 -- 172.21.15.154:0/2715376985 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0004c80 con 0x7f39ac0a0a70 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.830+0000 7f39a97fa700 1 -- 172.21.15.154:0/2715376985 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a0004e00 con 0x7f39ac0a0a70 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.831+0000 7f39b2e76700 1 -- 172.21.15.154:0/2715376985 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a4009a70 con 0x7f39ac0a0a70 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.831+0000 7f39a97fa700 1 -- 172.21.15.154:0/2715376985 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0007310 con 0x7f39ac0a0a70 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.831+0000 7f39b2e76700 1 -- 172.21.15.154:0/2715376985 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac134730 con 0x7f39ac0a0a70 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.831+0000 7f39a97fa700 1 -- 172.21.15.154:0/2715376985 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39a0007470 con 0x7f39ac0a0a70 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.831+0000 7f39a97fa700 1 -- 172.21.15.154:0/2715376985 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f39a003f300 con 0x7f39ac0a0a70 2023-09-30T22:26:43.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.832+0000 7f39b2e76700 1 -- 172.21.15.154:0/2715376985 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac122bb0 con 0x7f39ac0a0a70 2023-09-30T22:26:43.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.836+0000 7f39a97fa700 1 -- 172.21.15.154:0/2715376985 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39a00123b0 con 0x7f39ac0a0a70 2023-09-30T22:26:43.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:43.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:43.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.890+0000 7fc97a609700 1 Processor -- start 2023-09-30T22:26:43.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.890+0000 7fc97a609700 1 -- start start 2023-09-30T22:26:43.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.890+0000 7fc97a609700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc97406a770 0x7fc9741349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.890+0000 7fc97a609700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc97409e070 0x7fc97413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.890+0000 7fc97a609700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97409eca0 con 0x7fc974134f00 2023-09-30T22:26:43.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.890+0000 7fc97a609700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97409f720 con 0x7fc97409e070 2023-09-30T22:26:43.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.890+0000 7fc97a609700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc97406b480 con 0x7fc97406a770 2023-09-30T22:26:43.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc978ba6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc97409e070 0x7fc97413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc96bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc974134f00 0x7fc97409d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42124/0 (socket says 172.21.15.154:42124) 2023-09-30T22:26:43.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc978ba6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc97409e070 0x7fc97413fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47472/0 (socket says 172.21.15.154:47472) 2023-09-30T22:26:43.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc96bfff700 1 -- 172.21.15.154:0/135697628 learned_addr learned my addr 172.21.15.154:0/135697628 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:43.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc973fff700 1 --2- 172.21.15.154:0/135697628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc97406a770 0x7fc9741349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc978ba6700 1 -- 172.21.15.154:0/135697628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc97406a770 msgr2=0x7fc9741349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:43.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc978ba6700 1 --2- 172.21.15.154:0/135697628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc97406a770 0x7fc9741349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc978ba6700 1 -- 172.21.15.154:0/135697628 >> v1:172.21.15.154:6789/0 conn(0x7fc974134f00 legacy=0x7fc97409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc978ba6700 1 -- 172.21.15.154:0/135697628 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9741352d0 con 0x7fc97409e070 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc978ba6700 1 --2- 172.21.15.154:0/135697628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97409e070 0x7fc97413fcf0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a514e3ede8af21ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc9737fe700 1 -- 172.21.15.154:0/135697628 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00e070 con 0x7fc97409e070 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc9737fe700 1 -- 172.21.15.154:0/135697628 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00bb20 con 0x7fc97409e070 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.891+0000 7fc9737fe700 1 -- 172.21.15.154:0/135697628 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c012430 con 0x7fc97409e070 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.892+0000 7fc97a609700 1 -- 172.21.15.154:0/135697628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97409e070 msgr2=0x7fc97413fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.892+0000 7fc97a609700 1 --2- 172.21.15.154:0/135697628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97409e070 0x7fc97413fcf0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.892+0000 7fc97a609700 1 -- 172.21.15.154:0/135697628 shutdown_connections 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.892+0000 7fc97a609700 1 --2- 172.21.15.154:0/135697628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97409e070 0x7fc97413fcf0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.892+0000 7fc97a609700 1 --2- 172.21.15.154:0/135697628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc97406a770 0x7fc9741349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.892+0000 7fc97a609700 1 -- 172.21.15.154:0/135697628 >> 172.21.15.154:0/135697628 conn(0x7fc974099c40 msgr2=0x7fc9740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:43.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.892+0000 7fc97a609700 1 -- 172.21.15.154:0/135697628 shutdown_connections 2023-09-30T22:26:43.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.892+0000 7fc97a609700 1 -- 172.21.15.154:0/135697628 wait complete. 2023-09-30T22:26:43.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.893+0000 7fc97a609700 1 Processor -- start 2023-09-30T22:26:43.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.893+0000 7fc97a609700 1 -- start start 2023-09-30T22:26:43.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc97a609700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97406a770 0x7fc9741ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc97a609700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc97409e070 0x7fc9741cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc97a609700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc974134f00 0x7fc9741cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc97a609700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740a01b0 con 0x7fc97406a770 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc97a609700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741267d0 con 0x7fc97409e070 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc97a609700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc974126f80 con 0x7fc974134f00 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc973fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97406a770 0x7fc9741ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc973fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97406a770 0x7fc9741ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47476/0 (socket says 172.21.15.154:47476) 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc973fff700 1 -- 172.21.15.154:0/2465343766 learned_addr learned my addr 172.21.15.154:0/2465343766 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.894+0000 7fc96bfff700 1 --2- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc97409e070 0x7fc9741cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc978ba6700 1 --2- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc974134f00 0x7fc9741cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc96bfff700 1 -- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc974134f00 msgr2=0x7fc9741cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc96bfff700 1 --2- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc974134f00 0x7fc9741cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc96bfff700 1 -- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97406a770 msgr2=0x7fc9741ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc96bfff700 1 --2- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97406a770 0x7fc9741ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc96bfff700 1 -- 172.21.15.154:0/2465343766 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009a70 con 0x7fc97409e070 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc96bfff700 1 --2- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc97409e070 0x7fc9741cd160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c4d0 tx=0x7fc95c00c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc9717fa700 1 -- 172.21.15.154:0/2465343766 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c005d70 con 0x7fc97409e070 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc9717fa700 1 -- 172.21.15.154:0/2465343766 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c0070d0 con 0x7fc97409e070 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc97a609700 1 -- 172.21.15.154:0/2465343766 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc974126a00 con 0x7fc97409e070 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.895+0000 7fc97a609700 1 -- 172.21.15.154:0/2465343766 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc974126ca0 con 0x7fc97409e070 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.896+0000 7fc9717fa700 1 -- 172.21.15.154:0/2465343766 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c007440 con 0x7fc97409e070 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.896+0000 7fc9717fa700 1 -- 172.21.15.154:0/2465343766 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc95c0075a0 con 0x7fc97409e070 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.896+0000 7fc9717fa700 1 -- 172.21.15.154:0/2465343766 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc95c010950 con 0x7fc97409e070 2023-09-30T22:26:43.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.897+0000 7fc97a609700 1 -- 172.21.15.154:0/2465343766 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9580052e0 con 0x7fc97409e070 2023-09-30T22:26:43.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.904+0000 7fc9717fa700 1 -- 172.21.15.154:0/2465343766 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc95c017070 con 0x7fc97409e070 2023-09-30T22:26:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.999+0000 7fd6e86d6700 1 Processor -- start 2023-09-30T22:26:44.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:43.999+0000 7fd6e86d6700 1 -- start start 2023-09-30T22:26:44.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.000+0000 7fd6e86d6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6e009e340 0x7fd6e01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.000+0000 7fd6e86d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e0135f20 0x7fd6e0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.000+0000 7fd6e86d6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e009aaa0 con 0x7fd6e009d860 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.000+0000 7fd6e86d6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e009e730 con 0x7fd6e009e340 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.000+0000 7fd6e86d6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e009f870 con 0x7fd6e0135f20 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e6c73700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e0135f20 0x7fd6e0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e5c71700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6e009e340 0x7fd6e01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e5c71700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6e009e340 0x7fd6e01359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47488/0 (socket says 172.21.15.154:47488) 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e6c73700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e0135f20 0x7fd6e0138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46388/0 (socket says 172.21.15.154:46388) 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e5c71700 1 -- 172.21.15.154:0/3563174410 learned_addr learned my addr 172.21.15.154:0/3563174410 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e6c73700 1 -- 172.21.15.154:0/3563174410 >> v2:172.21.15.154:3300/0 conn(0x7fd6e009e340 msgr2=0x7fd6e01359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e5470700 1 -- 172.21.15.154:0/3563174410 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461845117 0 0) 0x7fd6e009aaa0 con 0x7fd6e009d860 2023-09-30T22:26:44.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e6c73700 1 --2- 172.21.15.154:0/3563174410 >> v2:172.21.15.154:3300/0 conn(0x7fd6e009e340 0x7fd6e01359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e6c73700 1 -- 172.21.15.154:0/3563174410 >> v1:172.21.15.154:6789/0 conn(0x7fd6e009d860 legacy=0x7fd6e009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e6c73700 1 -- 172.21.15.154:0/3563174410 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e009b360 con 0x7fd6e0135f20 2023-09-30T22:26:44.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e5c71700 1 --2- 172.21.15.154:0/3563174410 >> v2:172.21.15.154:3300/0 conn(0x7fd6e009e340 0x7fd6e01359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e6c73700 1 --2- 172.21.15.154:0/3563174410 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e0135f20 0x7fd6e0138300 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009dc0 tx=0x7fd6d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56c07704908b1462 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e5470700 1 -- 172.21.15.154:0/3563174410 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800e070 con 0x7fd6e0135f20 2023-09-30T22:26:44.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e5470700 1 -- 172.21.15.154:0/3563174410 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d800bae0 con 0x7fd6e0135f20 2023-09-30T22:26:44.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.001+0000 7fd6e5470700 1 -- 172.21.15.154:0/3563174410 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800be90 con 0x7fd6e0135f20 2023-09-30T22:26:44.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.002+0000 7fd6e86d6700 1 -- 172.21.15.154:0/3563174410 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e0135f20 msgr2=0x7fd6e0138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.002+0000 7fd6e86d6700 1 --2- 172.21.15.154:0/3563174410 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e0135f20 0x7fd6e0138300 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009dc0 tx=0x7fd6d800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.002+0000 7fd6e86d6700 1 -- 172.21.15.154:0/3563174410 shutdown_connections 2023-09-30T22:26:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.002+0000 7fd6e86d6700 1 --2- 172.21.15.154:0/3563174410 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e0135f20 0x7fd6e0138300 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.002+0000 7fd6e86d6700 1 --2- 172.21.15.154:0/3563174410 >> v2:172.21.15.154:3300/0 conn(0x7fd6e009e340 0x7fd6e01359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.002+0000 7fd6e86d6700 1 -- 172.21.15.154:0/3563174410 >> 172.21.15.154:0/3563174410 conn(0x7fd6e0099c40 msgr2=0x7fd6e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.003+0000 7fd6e86d6700 1 -- 172.21.15.154:0/3563174410 shutdown_connections 2023-09-30T22:26:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.003+0000 7fd6e86d6700 1 -- 172.21.15.154:0/3563174410 wait complete. 2023-09-30T22:26:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.003+0000 7fd6e86d6700 1 Processor -- start 2023-09-30T22:26:44.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.003+0000 7fd6e86d6700 1 -- start start 2023-09-30T22:26:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e86d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e009d860 0x7fd6e011f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e86d6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e009e340 0x7fd6e011fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e86d6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e0135f20 0x7fd6e0120040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e86d6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e01212e0 con 0x7fd6e0135f20 2023-09-30T22:26:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e86d6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0122e00 con 0x7fd6e009e340 2023-09-30T22:26:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e86d6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0121780 con 0x7fd6e009d860 2023-09-30T22:26:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e6472700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e009d860 0x7fd6e011f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e5c71700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e009e340 0x7fd6e011fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e6472700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e009d860 0x7fd6e011f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46400/0 (socket says 172.21.15.154:46400) 2023-09-30T22:26:44.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e6472700 1 -- 172.21.15.154:0/81354322 learned_addr learned my addr 172.21.15.154:0/81354322 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:44.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e6c73700 1 --2- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e0135f20 0x7fd6e0120040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e5c71700 1 -- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e009d860 msgr2=0x7fd6e011f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e5c71700 1 --2- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e009d860 0x7fd6e011f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e5c71700 1 -- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e0135f20 msgr2=0x7fd6e0120040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e5c71700 1 --2- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e0135f20 0x7fd6e0120040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e5c71700 1 -- 172.21.15.154:0/81354322 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d000b7f0 con 0x7fd6e009e340 2023-09-30T22:26:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.004+0000 7fd6e6472700 1 --2- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e009d860 0x7fd6e011f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.005+0000 7fd6e5c71700 1 --2- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e009e340 0x7fd6e011fb00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd6e009ee50 tx=0x7fd6d000da20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.005+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/81354322 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0004440 con 0x7fd6e009e340 2023-09-30T22:26:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.005+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/81354322 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d00045a0 con 0x7fd6e009e340 2023-09-30T22:26:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.005+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/81354322 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00038a0 con 0x7fd6e009e340 2023-09-30T22:26:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.005+0000 7fd6e86d6700 1 -- 172.21.15.154:0/81354322 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d8009a70 con 0x7fd6e009e340 2023-09-30T22:26:44.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.005+0000 7fd6e86d6700 1 -- 172.21.15.154:0/81354322 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e009c8b0 con 0x7fd6e009e340 2023-09-30T22:26:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.006+0000 7fd6e86d6700 1 -- 172.21.15.154:0/81354322 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e004f2a0 con 0x7fd6e009e340 2023-09-30T22:26:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.006+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/81354322 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6d0003a00 con 0x7fd6e009e340 2023-09-30T22:26:44.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.006+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/81354322 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd6d0047f70 con 0x7fd6e009e340 2023-09-30T22:26:44.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.015+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/81354322 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6d001db30 con 0x7fd6e009e340 2023-09-30T22:26:44.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.021+0000 7f9eee528700 1 Processor -- start 2023-09-30T22:26:44.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.021+0000 7f9eee528700 1 -- start start 2023-09-30T22:26:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.021+0000 7f9eee528700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 0x7f9ee809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.021+0000 7f9eee528700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 0x7f9ee8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.021+0000 7f9eee528700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee809aaa0 con 0x7f9ee809e170 2023-09-30T22:26:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.021+0000 7f9eee528700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee809f870 con 0x7f9ee809d860 2023-09-30T22:26:44.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.021+0000 7f9eee528700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee809b360 con 0x7f9ee8130eb0 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9ee77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9ee809e170 0x7f9ee81307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42152/0 (socket says 172.21.15.154:42152) 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9eecac5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 0x7f9ee8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9ee77fe700 1 -- 172.21.15.154:0/131160532 learned_addr learned my addr 172.21.15.154:0/131160532 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 0x7f9ee809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9eecac5700 1 -- 172.21.15.154:0/131160532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 msgr2=0x7f9ee809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9eecac5700 1 --2- 172.21.15.154:0/131160532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 0x7f9ee809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9eecac5700 1 -- 172.21.15.154:0/131160532 >> v1:172.21.15.154:6789/0 conn(0x7f9ee809e170 legacy=0x7f9ee81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9eecac5700 1 -- 172.21.15.154:0/131160532 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee809b620 con 0x7f9ee8130eb0 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9ee6ffd700 1 -- 172.21.15.154:0/131160532 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230453955 0 0) 0x7f9ee809aaa0 con 0x7f9ee809e170 2023-09-30T22:26:44.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9eecac5700 1 --2- 172.21.15.154:0/131160532 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 0x7f9ee8138a00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000be60 tx=0x7f9ee0009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a35c99399c5d41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9ee6ffd700 1 -- 172.21.15.154:0/131160532 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000c890 con 0x7f9ee8130eb0 2023-09-30T22:26:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9ee6ffd700 1 -- 172.21.15.154:0/131160532 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000c9f0 con 0x7f9ee8130eb0 2023-09-30T22:26:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.022+0000 7f9ee6ffd700 1 -- 172.21.15.154:0/131160532 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000cda0 con 0x7f9ee8130eb0 2023-09-30T22:26:44.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.023+0000 7f9eee528700 1 -- 172.21.15.154:0/131160532 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 msgr2=0x7f9ee8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.023+0000 7f9eee528700 1 --2- 172.21.15.154:0/131160532 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 0x7f9ee8138a00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000be60 tx=0x7f9ee0009290 comp rx=0 tx=0).stop 2023-09-30T22:26:44.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.023+0000 7f9eee528700 1 -- 172.21.15.154:0/131160532 shutdown_connections 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.023+0000 7f9eee528700 1 --2- 172.21.15.154:0/131160532 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 0x7f9ee8138a00 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.023+0000 7f9eee528700 1 --2- 172.21.15.154:0/131160532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 0x7f9ee809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.023+0000 7f9eee528700 1 -- 172.21.15.154:0/131160532 >> 172.21.15.154:0/131160532 conn(0x7f9ee8099c40 msgr2=0x7f9ee80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.023+0000 7f9eee528700 1 -- 172.21.15.154:0/131160532 shutdown_connections 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.023+0000 7f9eee528700 1 -- 172.21.15.154:0/131160532 wait complete. 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.024+0000 7f9eee528700 1 Processor -- start 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.024+0000 7f9eee528700 1 -- start start 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9eee528700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 0x7f9ee811e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9eee528700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ee809e170 0x7f9ee811e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9eee528700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 0x7f9ee811ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9eee528700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee8120840 con 0x7f9ee809e170 2023-09-30T22:26:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9eee528700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee8121e80 con 0x7f9ee809d860 2023-09-30T22:26:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9eee528700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee80a07d0 con 0x7f9ee8130eb0 2023-09-30T22:26:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 0x7f9ee811e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 0x7f9ee811e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34852/0 (socket says 172.21.15.154:34852) 2023-09-30T22:26:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee7fff700 1 -- 172.21.15.154:0/516865105 learned_addr learned my addr 172.21.15.154:0/516865105 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9eecac5700 1 --2- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 0x7f9ee811ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee77fe700 1 --2- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ee809e170 0x7f9ee811e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee77fe700 1 -- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 msgr2=0x7f9ee811ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee77fe700 1 --2- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 0x7f9ee811ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee77fe700 1 -- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 msgr2=0x7f9ee811e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee77fe700 1 --2- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 0x7f9ee811e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee77fe700 1 -- 172.21.15.154:0/516865105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee000ba90 con 0x7f9ee809e170 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.025+0000 7f9ee77fe700 1 --2- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ee809e170 0x7f9ee811e8e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c470 tx=0x7f9edc00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.026+0000 7f9ee4ff9700 1 -- 172.21.15.154:0/516865105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc004c80 con 0x7f9ee809e170 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.026+0000 7f9ee4ff9700 1 -- 172.21.15.154:0/516865105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc004de0 con 0x7f9ee809e170 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.026+0000 7f9eee528700 1 -- 172.21.15.154:0/516865105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee811ff70 con 0x7f9ee809e170 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.026+0000 7f9ee4ff9700 1 -- 172.21.15.154:0/516865105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc007310 con 0x7f9ee809e170 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.026+0000 7f9eee528700 1 -- 172.21.15.154:0/516865105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee8130320 con 0x7f9ee809e170 2023-09-30T22:26:44.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.026+0000 7f9eee528700 1 -- 172.21.15.154:0/516865105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee8121840 con 0x7f9ee809e170 2023-09-30T22:26:44.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.027+0000 7f9ee4ff9700 1 -- 172.21.15.154:0/516865105 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9edc007470 con 0x7f9ee809e170 2023-09-30T22:26:44.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.027+0000 7f9ee4ff9700 1 -- 172.21.15.154:0/516865105 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9edc03f680 con 0x7f9ee809e170 2023-09-30T22:26:44.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.036+0000 7f9ee4ff9700 1 -- 172.21.15.154:0/516865105 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9edc00ce40 con 0x7f9ee809e170 2023-09-30T22:26:44.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.048+0000 7f39b2e76700 1 -- 172.21.15.154:0/2715376985 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f39ac04f2a0 con 0x7f39ac0a0a70 2023-09-30T22:26:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.049+0000 7f39a97fa700 1 -- 172.21.15.154:0/2715376985 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39a0011360 con 0x7f39ac0a0a70 2023-09-30T22:26:44.050 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:44.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.051+0000 7f39b2e76700 1 -- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a0a70 msgr2=0x7f39ac11e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.051+0000 7f39b2e76700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a0a70 0x7f39ac11e7a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f39a000c520 tx=0x7f39a000c830 comp rx=0 tx=0).stop 2023-09-30T22:26:44.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.051+0000 7f39b2e76700 1 -- 172.21.15.154:0/2715376985 shutdown_connections 2023-09-30T22:26:44.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.051+0000 7f39b2e76700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39ac139200 0x7f39ac11f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.051+0000 7f39b2e76700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39ac0a0a70 0x7f39ac11e7a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.051+0000 7f39b2e76700 1 --2- 172.21.15.154:0/2715376985 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f39ac0a1550 0x7f39ac11ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.051+0000 7f39b2e76700 1 -- 172.21.15.154:0/2715376985 >> 172.21.15.154:0/2715376985 conn(0x7f39ac0a6610 msgr2=0x7f39ac0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.051+0000 7f39b2e76700 1 -- 172.21.15.154:0/2715376985 shutdown_connections 2023-09-30T22:26:44.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.051+0000 7f39b2e76700 1 -- 172.21.15.154:0/2715376985 wait complete. 2023-09-30T22:26:44.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:44.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.131+0000 7fc97a609700 1 -- 172.21.15.154:0/2465343766 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc958005590 con 0x7fc97409e070 2023-09-30T22:26:44.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.132+0000 7fc9717fa700 1 -- 172.21.15.154:0/2465343766 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc95c019d20 con 0x7fc97409e070 2023-09-30T22:26:44.133 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.134+0000 7fc97a609700 1 -- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc97409e070 msgr2=0x7fc9741cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.134+0000 7fc97a609700 1 --2- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc97409e070 0x7fc9741cd160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c4d0 tx=0x7fc95c00c7e0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.134+0000 7fc97a609700 1 -- 172.21.15.154:0/2465343766 shutdown_connections 2023-09-30T22:26:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.134+0000 7fc97a609700 1 --2- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc974134f00 0x7fc9741cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.134+0000 7fc97a609700 1 --2- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc97406a770 0x7fc9741ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.134+0000 7fc97a609700 1 --2- 172.21.15.154:0/2465343766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc97409e070 0x7fc9741cd160 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.134+0000 7fc97a609700 1 -- 172.21.15.154:0/2465343766 >> 172.21.15.154:0/2465343766 conn(0x7fc974099c40 msgr2=0x7fc9740a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.134+0000 7fc97a609700 1 -- 172.21.15.154:0/2465343766 shutdown_connections 2023-09-30T22:26:44.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.134+0000 7fc97a609700 1 -- 172.21.15.154:0/2465343766 wait complete. 2023-09-30T22:26:44.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:44.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.233+0000 7f9eee528700 1 -- 172.21.15.154:0/516865105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9ee8121a00 con 0x7f9ee809e170 2023-09-30T22:26:44.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.233+0000 7f9ee4ff9700 1 -- 172.21.15.154:0/516865105 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ee8121a00 con 0x7f9ee809e170 2023-09-30T22:26:44.235 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:44.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.234+0000 7fd6e86d6700 1 -- 172.21.15.154:0/81354322 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd6e006c3b0 con 0x7fd6e009e340 2023-09-30T22:26:44.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.234+0000 7fd6d6ffd700 1 -- 172.21.15.154:0/81354322 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6d001db30 con 0x7fd6e009e340 2023-09-30T22:26:44.236 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.236+0000 7f9eee528700 1 -- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ee809e170 msgr2=0x7f9ee811e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.236+0000 7f9eee528700 1 --2- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ee809e170 0x7f9ee811e8e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c470 tx=0x7f9edc00c780 comp rx=0 tx=0).stop 2023-09-30T22:26:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.236+0000 7f9eee528700 1 -- 172.21.15.154:0/516865105 shutdown_connections 2023-09-30T22:26:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.236+0000 7f9eee528700 1 --2- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ee8130eb0 0x7f9ee811ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.236+0000 7f9eee528700 1 --2- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ee809d860 0x7f9ee811e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.236+0000 7f9eee528700 1 --2- 172.21.15.154:0/516865105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ee809e170 0x7f9ee811e8e0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.236+0000 7f9eee528700 1 -- 172.21.15.154:0/516865105 >> 172.21.15.154:0/516865105 conn(0x7f9ee8099c40 msgr2=0x7f9ee80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.236+0000 7f9eee528700 1 -- 172.21.15.154:0/516865105 shutdown_connections 2023-09-30T22:26:44.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.236+0000 7f9eee528700 1 -- 172.21.15.154:0/516865105 wait complete. 2023-09-30T22:26:44.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.237+0000 7fd6e86d6700 1 -- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e009e340 msgr2=0x7fd6e011fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:44.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.237+0000 7fd6e86d6700 1 --2- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e009e340 0x7fd6e011fb00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd6e009ee50 tx=0x7fd6d000da20 comp rx=0 tx=0).stop 2023-09-30T22:26:44.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.237+0000 7fd6e86d6700 1 -- 172.21.15.154:0/81354322 shutdown_connections 2023-09-30T22:26:44.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.237+0000 7fd6e86d6700 1 --2- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6e0135f20 0x7fd6e0120040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.237+0000 7fd6e86d6700 1 --2- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6e009d860 0x7fd6e011f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.237+0000 7fd6e86d6700 1 --2- 172.21.15.154:0/81354322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6e009e340 0x7fd6e011fb00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:44.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.237+0000 7fd6e86d6700 1 -- 172.21.15.154:0/81354322 >> 172.21.15.154:0/81354322 conn(0x7fd6e0099c40 msgr2=0x7fd6e0132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:44.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.237+0000 7fd6e86d6700 1 -- 172.21.15.154:0/81354322 shutdown_connections 2023-09-30T22:26:44.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:44.237+0000 7fd6e86d6700 1 -- 172.21.15.154:0/81354322 wait complete. 2023-09-30T22:26:44.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:44.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:45.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:45.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.201+0000 7f33ce660700 1 Processor -- start 2023-09-30T22:26:45.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.201+0000 7f33ce660700 1 -- start start 2023-09-30T22:26:45.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33ce660700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c8134140 0x7f33c8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33ce660700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33c8134570 0x7f33c813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33ce660700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c809b110 con 0x7f33c809ad40 2023-09-30T22:26:45.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33ce660700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c80a3b60 con 0x7f33c8134570 2023-09-30T22:26:45.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33ce660700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80a1a80 con 0x7f33c8134140 2023-09-30T22:26:45.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33ccbfd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33c8134570 0x7f33c813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33c77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c8134140 0x7f33c8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33ccbfd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33c8134570 0x7f33c813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47506/0 (socket says 172.21.15.154:47506) 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33ccbfd700 1 -- 172.21.15.154:0/835804998 learned_addr learned my addr 172.21.15.154:0/835804998 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33c77fe700 1 -- 172.21.15.154:0/835804998 >> v2:172.21.15.154:3300/0 conn(0x7f33c8134570 msgr2=0x7f33c813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33c77fe700 1 --2- 172.21.15.154:0/835804998 >> v2:172.21.15.154:3300/0 conn(0x7f33c8134570 0x7f33c813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33c77fe700 1 -- 172.21.15.154:0/835804998 >> v1:172.21.15.154:6789/0 conn(0x7f33c809ad40 legacy=0x7f33c8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33c77fe700 1 -- 172.21.15.154:0/835804998 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80a2fa0 con 0x7f33c8134140 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.202+0000 7f33ccbfd700 1 --2- 172.21.15.154:0/835804998 >> v2:172.21.15.154:3300/0 conn(0x7f33c8134570 0x7f33c813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33c77fe700 1 --2- 172.21.15.154:0/835804998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c8134140 0x7f33c8138e80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009840 tx=0x7f33bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=508e21500422ea5a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33c6ffd700 1 -- 172.21.15.154:0/835804998 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc011830 con 0x7f33c8134140 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33c6ffd700 1 -- 172.21.15.154:0/835804998 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc011990 con 0x7f33c8134140 2023-09-30T22:26:45.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33c6ffd700 1 -- 172.21.15.154:0/835804998 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc011d20 con 0x7f33c8134140 2023-09-30T22:26:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33ce660700 1 -- 172.21.15.154:0/835804998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c8134140 msgr2=0x7f33c8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33ce660700 1 --2- 172.21.15.154:0/835804998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c8134140 0x7f33c8138e80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009840 tx=0x7f33bc009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33ce660700 1 -- 172.21.15.154:0/835804998 shutdown_connections 2023-09-30T22:26:45.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33ce660700 1 --2- 172.21.15.154:0/835804998 >> v2:172.21.15.154:3300/0 conn(0x7f33c8134570 0x7f33c813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33ce660700 1 --2- 172.21.15.154:0/835804998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c8134140 0x7f33c8138e80 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.203+0000 7f33ce660700 1 -- 172.21.15.154:0/835804998 >> 172.21.15.154:0/835804998 conn(0x7f33c8099c40 msgr2=0x7f33c806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.204+0000 7f33ce660700 1 -- 172.21.15.154:0/835804998 shutdown_connections 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.204+0000 7f33ce660700 1 -- 172.21.15.154:0/835804998 wait complete. 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.204+0000 7f33ce660700 1 Processor -- start 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33ce660700 1 -- start start 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33ce660700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c809ad40 0x7f33c811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33ce660700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33c8134140 0x7f33c811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33ce660700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33c8134570 0x7f33c811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33ce660700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c811ea60 con 0x7f33c8134140 2023-09-30T22:26:45.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33ce660700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80a4110 con 0x7f33c809ad40 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33ce660700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33c809c7e0 con 0x7f33c8134570 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33c7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c809ad40 0x7f33c811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33ccbfd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33c8134570 0x7f33c811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33c77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33c8134140 0x7f33c811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33c7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c809ad40 0x7f33c811c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34864/0 (socket says 172.21.15.154:34864) 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.205+0000 7f33c7fff700 1 -- 172.21.15.154:0/2780558522 learned_addr learned my addr 172.21.15.154:0/2780558522 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33ccbfd700 1 -- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c809ad40 msgr2=0x7f33c811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33ccbfd700 1 --2- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c809ad40 0x7f33c811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33ccbfd700 1 -- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33c8134140 msgr2=0x7f33c811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33ccbfd700 1 --2- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33c8134140 0x7f33c811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33ccbfd700 1 -- 172.21.15.154:0/2780558522 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c0009b30 con 0x7f33c8134570 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33c77fe700 1 --2- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33c8134140 0x7f33c811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33c7fff700 1 --2- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c809ad40 0x7f33c811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33ccbfd700 1 --2- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33c8134570 0x7f33c811d340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009e50 tx=0x7f33c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33c4ff9700 1 -- 172.21.15.154:0/2780558522 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0018070 con 0x7f33c8134570 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33c4ff9700 1 -- 172.21.15.154:0/2780558522 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c000f040 con 0x7f33c8134570 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33ce660700 1 -- 172.21.15.154:0/2780558522 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc0094a0 con 0x7f33c8134570 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33c4ff9700 1 -- 172.21.15.154:0/2780558522 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0003c40 con 0x7f33c8134570 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.206+0000 7f33ce660700 1 -- 172.21.15.154:0/2780558522 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c811e6b0 con 0x7f33c8134570 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.207+0000 7f33c4ff9700 1 -- 172.21.15.154:0/2780558522 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33c000c880 con 0x7f33c8134570 2023-09-30T22:26:45.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.207+0000 7f33c4ff9700 1 -- 172.21.15.154:0/2780558522 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f33c003f850 con 0x7f33c8134570 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.207+0000 7f33ce660700 1 -- 172.21.15.154:0/2780558522 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c811e8a0 con 0x7f33c8134570 2023-09-30T22:26:45.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.212+0000 7f33c4ff9700 1 -- 172.21.15.154:0/2780558522 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33c0012340 con 0x7f33c8134570 2023-09-30T22:26:45.252 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:45.252 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:45.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.278+0000 7efe30127700 1 Processor -- start 2023-09-30T22:26:45.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.278+0000 7efe30127700 1 -- start start 2023-09-30T22:26:45.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.278+0000 7efe30127700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe28138410 0x7efe280a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.278+0000 7efe30127700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe2813dd10 0x7efe281400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.278+0000 7efe30127700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe281379e0 con 0x7efe28138040 2023-09-30T22:26:45.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.278+0000 7efe30127700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe280a2100 con 0x7efe28138410 2023-09-30T22:26:45.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.278+0000 7efe30127700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe2809b9b0 con 0x7efe2813dd10 2023-09-30T22:26:45.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2e6c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe2813dd10 0x7efe281400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2e6c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe2813dd10 0x7efe281400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46736/0 (socket says 172.21.15.154:46736) 2023-09-30T22:26:45.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2e6c4700 1 -- 172.21.15.154:0/3987653896 learned_addr learned my addr 172.21.15.154:0/3987653896 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:45.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2d6c2700 1 --2- 172.21.15.154:0/3987653896 >> v2:172.21.15.154:3300/0 conn(0x7efe28138410 0x7efe280a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2e6c4700 1 -- 172.21.15.154:0/3987653896 >> v2:172.21.15.154:3300/0 conn(0x7efe28138410 msgr2=0x7efe280a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2e6c4700 1 --2- 172.21.15.154:0/3987653896 >> v2:172.21.15.154:3300/0 conn(0x7efe28138410 0x7efe280a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2e6c4700 1 -- 172.21.15.154:0/3987653896 >> v1:172.21.15.154:6789/0 conn(0x7efe28138040 legacy=0x7efe280a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2e6c4700 1 -- 172.21.15.154:0/3987653896 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28137c10 con 0x7efe2813dd10 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2e6c4700 1 --2- 172.21.15.154:0/3987653896 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe2813dd10 0x7efe281400f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe20009e80 tx=0x7efe2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f63098200a26d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.279+0000 7efe2cec1700 1 -- 172.21.15.154:0/3987653896 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000e070 con 0x7efe2813dd10 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.280+0000 7efe2cec1700 1 -- 172.21.15.154:0/3987653896 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe20003a20 con 0x7efe2813dd10 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.280+0000 7efe2cec1700 1 -- 172.21.15.154:0/3987653896 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20003dd0 con 0x7efe2813dd10 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.280+0000 7efe30127700 1 -- 172.21.15.154:0/3987653896 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe2813dd10 msgr2=0x7efe281400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.280+0000 7efe30127700 1 --2- 172.21.15.154:0/3987653896 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe2813dd10 0x7efe281400f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe20009e80 tx=0x7efe2000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.281+0000 7efe30127700 1 -- 172.21.15.154:0/3987653896 shutdown_connections 2023-09-30T22:26:45.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.281+0000 7efe30127700 1 --2- 172.21.15.154:0/3987653896 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe2813dd10 0x7efe281400f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.281+0000 7efe30127700 1 --2- 172.21.15.154:0/3987653896 >> v2:172.21.15.154:3300/0 conn(0x7efe28138410 0x7efe280a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.281+0000 7efe30127700 1 -- 172.21.15.154:0/3987653896 >> 172.21.15.154:0/3987653896 conn(0x7efe280a2980 msgr2=0x7efe280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.281+0000 7efe30127700 1 -- 172.21.15.154:0/3987653896 shutdown_connections 2023-09-30T22:26:45.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.281+0000 7efe30127700 1 -- 172.21.15.154:0/3987653896 wait complete. 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.282+0000 7efe30127700 1 Processor -- start 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.282+0000 7efe30127700 1 -- start start 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe30127700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe28138040 0x7efe28121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe30127700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe28138410 0x7efe28121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe30127700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe2813dd10 0x7efe28122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe30127700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe28124f00 con 0x7efe2813dd10 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe30127700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2809a240 con 0x7efe28138040 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe30127700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe2809f050 con 0x7efe28138410 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2dec3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe28138040 0x7efe28121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2dec3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe28138040 0x7efe28121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38210/0 (socket says 172.21.15.154:38210) 2023-09-30T22:26:45.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2dec3700 1 -- 172.21.15.154:0/3436236403 learned_addr learned my addr 172.21.15.154:0/3436236403 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:45.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2d6c2700 1 --2- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe28138410 0x7efe28121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2dec3700 1 -- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe28138410 msgr2=0x7efe28121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2dec3700 1 --2- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe28138410 0x7efe28121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2dec3700 1 -- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe2813dd10 msgr2=0x7efe28122080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:45.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2dec3700 1 --2- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe2813dd10 0x7efe28122080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2dec3700 1 -- 172.21.15.154:0/3436236403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20009b30 con 0x7efe28138040 2023-09-30T22:26:45.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.283+0000 7efe2dec3700 1 --2- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe28138040 0x7efe28121600 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efe2400c450 tx=0x7efe2400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.284+0000 7efe1e7fc700 1 -- 172.21.15.154:0/3436236403 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe240054e0 con 0x7efe28138040 2023-09-30T22:26:45.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.284+0000 7efe1e7fc700 1 -- 172.21.15.154:0/3436236403 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe24003680 con 0x7efe28138040 2023-09-30T22:26:45.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.284+0000 7efe30127700 1 -- 172.21.15.154:0/3436236403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe28124960 con 0x7efe28138040 2023-09-30T22:26:45.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.284+0000 7efe1e7fc700 1 -- 172.21.15.154:0/3436236403 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24003a30 con 0x7efe28138040 2023-09-30T22:26:45.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.284+0000 7efe30127700 1 -- 172.21.15.154:0/3436236403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe281237e0 con 0x7efe28138040 2023-09-30T22:26:45.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.285+0000 7efe1e7fc700 1 -- 172.21.15.154:0/3436236403 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe24003b90 con 0x7efe28138040 2023-09-30T22:26:45.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.285+0000 7efe1e7fc700 1 -- 172.21.15.154:0/3436236403 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efe24040b00 con 0x7efe28138040 2023-09-30T22:26:45.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.285+0000 7efe30127700 1 -- 172.21.15.154:0/3436236403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2804f2a0 con 0x7efe28138040 2023-09-30T22:26:45.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.290+0000 7efe1e7fc700 1 -- 172.21.15.154:0/3436236403 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe24017070 con 0x7efe28138040 2023-09-30T22:26:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.381+0000 7f1af933c700 1 Processor -- start 2023-09-30T22:26:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.381+0000 7f1af933c700 1 -- start start 2023-09-30T22:26:45.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.381+0000 7f1af933c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1af409e950 0x7f1af409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.381+0000 7f1af933c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af4131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.381+0000 7f1af933c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af4131dd0 0x7f1af4132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.381+0000 7f1af933c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af409b6d0 con 0x7f1af409e950 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af933c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af409afb0 con 0x7f1af409f260 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af933c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40a0970 con 0x7f1af4131dd0 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1af409e950 0x7f1af409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af4131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1af409e950 0x7f1af409ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59720/0 (socket says 172.21.15.154:59720) 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af4131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38218/0 (socket says 172.21.15.154:38218) 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af2ffd700 1 -- 172.21.15.154:0/2089917952 learned_addr learned my addr 172.21.15.154:0/2089917952 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:45.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af37fe700 1 --2- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af4131dd0 0x7f1af4132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af2ffd700 1 -- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af4131dd0 msgr2=0x7f1af4132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af2ffd700 1 --2- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af4131dd0 0x7f1af4132250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af2ffd700 1 -- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 msgr2=0x7f1af4131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af2ffd700 1 --2- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af4131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af2ffd700 1 -- 172.21.15.154:0/2089917952 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40a0320 con 0x7f1af409e950 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af27fc700 1 --2- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af4131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af2ffd700 1 --2- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af409e950 0x7f1af409ed20 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4006fd0 tx=0x7f1ae4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e9dd3c75d23ff2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.382+0000 7f1af1ffb700 1 -- 172.21.15.154:0/2089917952 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4005e30 con 0x7f1af409e950 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af1ffb700 1 -- 172.21.15.154:0/2089917952 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae4004030 con 0x7f1af409e950 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af1ffb700 1 -- 172.21.15.154:0/2089917952 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae40043e0 con 0x7f1af409e950 2023-09-30T22:26:45.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af933c700 1 -- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af409e950 msgr2=0x7f1af409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af933c700 1 --2- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af409e950 0x7f1af409ed20 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4006fd0 tx=0x7f1ae4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af933c700 1 -- 172.21.15.154:0/2089917952 shutdown_connections 2023-09-30T22:26:45.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af933c700 1 --2- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af4131dd0 0x7f1af4132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af933c700 1 --2- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af409e950 0x7f1af409ed20 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af933c700 1 --2- 172.21.15.154:0/2089917952 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af4131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af933c700 1 -- 172.21.15.154:0/2089917952 >> 172.21.15.154:0/2089917952 conn(0x7f1af40a0f70 msgr2=0x7f1af40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af933c700 1 -- 172.21.15.154:0/2089917952 shutdown_connections 2023-09-30T22:26:45.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.383+0000 7f1af933c700 1 -- 172.21.15.154:0/2089917952 wait complete. 2023-09-30T22:26:45.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af933c700 1 Processor -- start 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af933c700 1 -- start start 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af933c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af409e950 0x7f1af411d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af933c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af411d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af933c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af4131dd0 0x7f1af411dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af933c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af4120970 con 0x7f1af4131dd0 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af933c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af409da40 con 0x7f1af409f260 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af933c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af411ee50 con 0x7f1af409e950 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af409e950 0x7f1af411d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.385+0000 7f1af2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af409e950 0x7f1af411d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46760/0 (socket says 172.21.15.154:46760) 2023-09-30T22:26:45.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af2ffd700 1 -- 172.21.15.154:0/2036914126 learned_addr learned my addr 172.21.15.154:0/2036914126 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af37fe700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af4131dd0 0x7f1af411dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af27fc700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af411d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af37fe700 1 -- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af409e950 msgr2=0x7f1af411d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af37fe700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af409e950 0x7f1af411d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af37fe700 1 -- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 msgr2=0x7f1af411d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af37fe700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af411d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af37fe700 1 -- 172.21.15.154:0/2036914126 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80094a0 con 0x7f1af4131dd0 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af2ffd700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af409e950 0x7f1af411d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af37fe700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af4131dd0 0x7f1af411dbb0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f1aec007dc0 tx=0x7f1aec00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1adb7fe700 1 -- 172.21.15.154:0/2036914126 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00ed30 con 0x7f1af4131dd0 2023-09-30T22:26:45.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1adb7fe700 1 -- 172.21.15.154:0/2036914126 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00ee90 con 0x7f1af4131dd0 2023-09-30T22:26:45.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af933c700 1 -- 172.21.15.154:0/2036914126 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae4009500 con 0x7f1af4131dd0 2023-09-30T22:26:45.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1adb7fe700 1 -- 172.21.15.154:0/2036914126 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec014640 con 0x7f1af4131dd0 2023-09-30T22:26:45.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.386+0000 7f1af933c700 1 -- 172.21.15.154:0/2036914126 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af409d400 con 0x7f1af4131dd0 2023-09-30T22:26:45.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.387+0000 7f1adb7fe700 1 -- 172.21.15.154:0/2036914126 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1aec0147a0 con 0x7f1af4131dd0 2023-09-30T22:26:45.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.387+0000 7f1adb7fe700 1 -- 172.21.15.154:0/2036914126 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1aec03fd40 con 0x7f1af4131dd0 2023-09-30T22:26:45.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.388+0000 7f1af933c700 1 -- 172.21.15.154:0/2036914126 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af40a4e30 con 0x7f1af4131dd0 2023-09-30T22:26:45.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.393+0000 7f1adb7fe700 1 -- 172.21.15.154:0/2036914126 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1aec0122e0 con 0x7f1af4131dd0 2023-09-30T22:26:45.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.413+0000 7f33ce660700 1 -- 172.21.15.154:0/2780558522 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f33c804f2a0 con 0x7f33c8134570 2023-09-30T22:26:45.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.414+0000 7f33c4ff9700 1 -- 172.21.15.154:0/2780558522 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33c002c090 con 0x7f33c8134570 2023-09-30T22:26:45.414 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.416+0000 7f33ce660700 1 -- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33c8134570 msgr2=0x7f33c811d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.416+0000 7f33ce660700 1 --2- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33c8134570 0x7f33c811d340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009e50 tx=0x7f33c000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.416+0000 7f33ce660700 1 -- 172.21.15.154:0/2780558522 shutdown_connections 2023-09-30T22:26:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.416+0000 7f33ce660700 1 --2- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33c8134570 0x7f33c811d340 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.416+0000 7f33ce660700 1 --2- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33c809ad40 0x7f33c811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.416+0000 7f33ce660700 1 --2- 172.21.15.154:0/2780558522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33c8134140 0x7f33c811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.416+0000 7f33ce660700 1 -- 172.21.15.154:0/2780558522 >> 172.21.15.154:0/2780558522 conn(0x7f33c8099c40 msgr2=0x7f33c80a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.416+0000 7f33ce660700 1 -- 172.21.15.154:0/2780558522 shutdown_connections 2023-09-30T22:26:45.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.416+0000 7f33ce660700 1 -- 172.21.15.154:0/2780558522 wait complete. 2023-09-30T22:26:45.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:45.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe265527700 1 Processor -- start 2023-09-30T22:26:45.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe265527700 1 -- start start 2023-09-30T22:26:45.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe265527700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe260133ad0 0x7fe260133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe265527700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2601300a0 0x7fe2601304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe265527700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26006b2d0 con 0x7fe2601309f0 2023-09-30T22:26:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe265527700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe260133610 con 0x7fe260133ad0 2023-09-30T22:26:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe265527700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe26009a500 con 0x7fe2601300a0 2023-09-30T22:26:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe25e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2601300a0 0x7fe2601304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe25e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2601300a0 0x7fe2601304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46774/0 (socket says 172.21.15.154:46774) 2023-09-30T22:26:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.433+0000 7fe25e7fc700 1 -- 172.21.15.154:0/3056309374 learned_addr learned my addr 172.21.15.154:0/3056309374 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25effd700 1 --2- 172.21.15.154:0/3056309374 >> v2:172.21.15.154:3300/0 conn(0x7fe260133ad0 0x7fe260133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25e7fc700 1 -- 172.21.15.154:0/3056309374 >> v2:172.21.15.154:3300/0 conn(0x7fe260133ad0 msgr2=0x7fe260133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25e7fc700 1 --2- 172.21.15.154:0/3056309374 >> v2:172.21.15.154:3300/0 conn(0x7fe260133ad0 0x7fe260133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25e7fc700 1 -- 172.21.15.154:0/3056309374 >> v1:172.21.15.154:6789/0 conn(0x7fe2601309f0 legacy=0x7fe26013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25e7fc700 1 -- 172.21.15.154:0/3056309374 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2601338b0 con 0x7fe2601300a0 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25effd700 1 --2- 172.21.15.154:0/3056309374 >> v2:172.21.15.154:3300/0 conn(0x7fe260133ad0 0x7fe260133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25e7fc700 1 --2- 172.21.15.154:0/3056309374 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2601300a0 0x7fe2601304b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098f0 tx=0x7fe254009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7012f5dc1983834 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25dffb700 1 -- 172.21.15.154:0/3056309374 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011830 con 0x7fe2601300a0 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25dffb700 1 -- 172.21.15.154:0/3056309374 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254011990 con 0x7fe2601300a0 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.434+0000 7fe25dffb700 1 -- 172.21.15.154:0/3056309374 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011d20 con 0x7fe2601300a0 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.435+0000 7fe265527700 1 -- 172.21.15.154:0/3056309374 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2601300a0 msgr2=0x7fe2601304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.435+0000 7fe265527700 1 --2- 172.21.15.154:0/3056309374 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2601300a0 0x7fe2601304b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098f0 tx=0x7fe254009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.435+0000 7fe265527700 1 -- 172.21.15.154:0/3056309374 shutdown_connections 2023-09-30T22:26:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.435+0000 7fe265527700 1 --2- 172.21.15.154:0/3056309374 >> v2:172.21.15.154:3300/0 conn(0x7fe260133ad0 0x7fe260133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.435+0000 7fe265527700 1 --2- 172.21.15.154:0/3056309374 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2601300a0 0x7fe2601304b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.435+0000 7fe265527700 1 -- 172.21.15.154:0/3056309374 >> 172.21.15.154:0/3056309374 conn(0x7fe260099c40 msgr2=0x7fe2600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.435+0000 7fe265527700 1 -- 172.21.15.154:0/3056309374 shutdown_connections 2023-09-30T22:26:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.435+0000 7fe265527700 1 -- 172.21.15.154:0/3056309374 wait complete. 2023-09-30T22:26:45.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe265527700 1 Processor -- start 2023-09-30T22:26:45.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe265527700 1 -- start start 2023-09-30T22:26:45.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe265527700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2601300a0 0x7fe26011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe265527700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2601309f0 0x7fe26011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe265527700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe260133ad0 0x7fe26011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:45.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe265527700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26012fdf0 con 0x7fe2601309f0 2023-09-30T22:26:45.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe265527700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26012dd00 con 0x7fe2601300a0 2023-09-30T22:26:45.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe265527700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe260072380 con 0x7fe260133ad0 2023-09-30T22:26:45.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe25e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2601309f0 0x7fe26011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe25e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2601309f0 0x7fe26011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59762/0 (socket says 172.21.15.154:59762) 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.437+0000 7fe25e7fc700 1 -- 172.21.15.154:0/2007662010 learned_addr learned my addr 172.21.15.154:0/2007662010 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe25effd700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2601300a0 0x7fe26011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe25f7fe700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe260133ad0 0x7fe26011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe25e7fc700 1 -- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe260133ad0 msgr2=0x7fe26011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe25e7fc700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe260133ad0 0x7fe26011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe25e7fc700 1 -- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2601300a0 msgr2=0x7fe26011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe25e7fc700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2601300a0 0x7fe26011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe25e7fc700 1 -- 172.21.15.154:0/2007662010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500094a0 con 0x7fe2601309f0 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe25effd700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2601300a0 0x7fe26011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe25e7fc700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2601309f0 0x7fe26011df80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fe254009c40 tx=0x7fe254004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe2477fe700 1 -- 172.21.15.154:0/2007662010 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254004510 con 0x7fe2601309f0 2023-09-30T22:26:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe2477fe700 1 -- 172.21.15.154:0/2007662010 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25401e070 con 0x7fe2601309f0 2023-09-30T22:26:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe2477fe700 1 -- 172.21.15.154:0/2007662010 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540038e0 con 0x7fe2601309f0 2023-09-30T22:26:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe265527700 1 -- 172.21.15.154:0/2007662010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe254009550 con 0x7fe2601309f0 2023-09-30T22:26:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.438+0000 7fe265527700 1 -- 172.21.15.154:0/2007662010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26011ff20 con 0x7fe2601309f0 2023-09-30T22:26:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.439+0000 7fe2477fe700 1 -- 172.21.15.154:0/2007662010 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe254003a40 con 0x7fe2601309f0 2023-09-30T22:26:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.439+0000 7fe2477fe700 1 -- 172.21.15.154:0/2007662010 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe254020070 con 0x7fe2601309f0 2023-09-30T22:26:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.440+0000 7fe265527700 1 -- 172.21.15.154:0/2007662010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26011fd40 con 0x7fe2601309f0 2023-09-30T22:26:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.445+0000 7fe2477fe700 1 -- 172.21.15.154:0/2007662010 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe25402a080 con 0x7fe2601309f0 2023-09-30T22:26:45.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.578+0000 7efe30127700 1 -- 172.21.15.154:0/3436236403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efe2806bce0 con 0x7efe28138040 2023-09-30T22:26:45.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.578+0000 7efe1e7fc700 1 -- 172.21.15.154:0/3436236403 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe24017030 con 0x7efe28138040 2023-09-30T22:26:45.580 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:45.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.581+0000 7efe30127700 1 -- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe28138040 msgr2=0x7efe28121600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.581+0000 7efe30127700 1 --2- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe28138040 0x7efe28121600 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efe2400c450 tx=0x7efe2400c760 comp rx=0 tx=0).stop 2023-09-30T22:26:45.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.581+0000 7efe30127700 1 -- 172.21.15.154:0/3436236403 shutdown_connections 2023-09-30T22:26:45.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.581+0000 7efe30127700 1 --2- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe2813dd10 0x7efe28122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.581+0000 7efe30127700 1 --2- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe28138040 0x7efe28121600 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.581+0000 7efe30127700 1 --2- 172.21.15.154:0/3436236403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe28138410 0x7efe28121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.581+0000 7efe30127700 1 -- 172.21.15.154:0/3436236403 >> 172.21.15.154:0/3436236403 conn(0x7efe280a2980 msgr2=0x7efe2809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.581+0000 7efe30127700 1 -- 172.21.15.154:0/3436236403 shutdown_connections 2023-09-30T22:26:45.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.581+0000 7efe30127700 1 -- 172.21.15.154:0/3436236403 wait complete. 2023-09-30T22:26:45.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.588+0000 7f1af933c700 1 -- 172.21.15.154:0/2036914126 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1af404f2a0 con 0x7f1af4131dd0 2023-09-30T22:26:45.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.588+0000 7f1adb7fe700 1 -- 172.21.15.154:0/2036914126 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1aec009950 con 0x7f1af4131dd0 2023-09-30T22:26:45.589 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:45.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.590+0000 7f1af933c700 1 -- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af4131dd0 msgr2=0x7f1af411dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.590+0000 7f1af933c700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af4131dd0 0x7f1af411dbb0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f1aec007dc0 tx=0x7f1aec00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.590+0000 7f1af933c700 1 -- 172.21.15.154:0/2036914126 shutdown_connections 2023-09-30T22:26:45.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.590+0000 7f1af933c700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1af4131dd0 0x7f1af411dbb0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.590+0000 7f1af933c700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1af409e950 0x7f1af411d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.590+0000 7f1af933c700 1 --2- 172.21.15.154:0/2036914126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1af409f260 0x7f1af411d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.590+0000 7f1af933c700 1 -- 172.21.15.154:0/2036914126 >> 172.21.15.154:0/2036914126 conn(0x7f1af40a0f70 msgr2=0x7f1af40a1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.590+0000 7f1af933c700 1 -- 172.21.15.154:0/2036914126 shutdown_connections 2023-09-30T22:26:45.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.590+0000 7f1af933c700 1 -- 172.21.15.154:0/2036914126 wait complete. 2023-09-30T22:26:45.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:45.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.662+0000 7fe265527700 1 -- 172.21.15.154:0/2007662010 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe26004f2a0 con 0x7fe2601309f0 2023-09-30T22:26:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.662+0000 7fe2477fe700 1 -- 172.21.15.154:0/2007662010 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe254025480 con 0x7fe2601309f0 2023-09-30T22:26:45.664 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.665+0000 7fe265527700 1 -- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2601309f0 msgr2=0x7fe26011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.665+0000 7fe265527700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2601309f0 0x7fe26011df80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fe254009c40 tx=0x7fe254004750 comp rx=0 tx=0).stop 2023-09-30T22:26:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.665+0000 7fe265527700 1 -- 172.21.15.154:0/2007662010 shutdown_connections 2023-09-30T22:26:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.665+0000 7fe265527700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe260133ad0 0x7fe26011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.665+0000 7fe265527700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2601300a0 0x7fe26011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.665+0000 7fe265527700 1 --2- 172.21.15.154:0/2007662010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2601309f0 0x7fe26011df80 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.665+0000 7fe265527700 1 -- 172.21.15.154:0/2007662010 >> 172.21.15.154:0/2007662010 conn(0x7fe260099c40 msgr2=0x7fe260131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.665+0000 7fe265527700 1 -- 172.21.15.154:0/2007662010 shutdown_connections 2023-09-30T22:26:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:45.665+0000 7fe265527700 1 -- 172.21.15.154:0/2007662010 wait complete. 2023-09-30T22:26:45.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:46.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:46.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.563+0000 7fbc301f8700 1 Processor -- start 2023-09-30T22:26:46.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.563+0000 7fbc301f8700 1 -- start start 2023-09-30T22:26:46.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc301f8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc2809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc301f8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc28134330 0x7fbc2813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc301f8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2809fa00 con 0x7fbc2809f180 2023-09-30T22:26:46.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc301f8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc280a0370 con 0x7fbc28134330 2023-09-30T22:26:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc301f8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2806bec0 con 0x7fbc2809e870 2023-09-30T22:26:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2e795700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc28134330 0x7fbc2813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2df94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc2809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2e795700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc28134330 0x7fbc2813be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59766/0 (socket says 172.21.15.154:59766) 2023-09-30T22:26:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2e795700 1 -- 172.21.15.154:0/3513578975 learned_addr learned my addr 172.21.15.154:0/3513578975 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2e795700 1 -- 172.21.15.154:0/3513578975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 msgr2=0x7fbc2809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2e795700 1 --2- 172.21.15.154:0/3513578975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc2809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2e795700 1 -- 172.21.15.154:0/3513578975 >> v1:172.21.15.154:6789/0 conn(0x7fbc2809f180 legacy=0x7fbc28133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2e795700 1 -- 172.21.15.154:0/3513578975 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2809ada0 con 0x7fbc28134330 2023-09-30T22:26:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2df94700 1 --2- 172.21.15.154:0/3513578975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc2809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.564+0000 7fbc2e795700 1 --2- 172.21.15.154:0/3513578975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc28134330 0x7fbc2813be80 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009e50 tx=0x7fbc2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378ab661896d58f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc2cf92700 1 -- 172.21.15.154:0/3513578975 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000e070 con 0x7fbc28134330 2023-09-30T22:26:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc2cf92700 1 -- 172.21.15.154:0/3513578975 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2000b910 con 0x7fbc28134330 2023-09-30T22:26:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc2cf92700 1 -- 172.21.15.154:0/3513578975 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000bcc0 con 0x7fbc28134330 2023-09-30T22:26:46.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc301f8700 1 -- 172.21.15.154:0/3513578975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc28134330 msgr2=0x7fbc2813be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc301f8700 1 --2- 172.21.15.154:0/3513578975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc28134330 0x7fbc2813be80 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fbc20009e50 tx=0x7fbc2000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc301f8700 1 -- 172.21.15.154:0/3513578975 shutdown_connections 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc301f8700 1 --2- 172.21.15.154:0/3513578975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc28134330 0x7fbc2813be80 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc301f8700 1 --2- 172.21.15.154:0/3513578975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc2809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc301f8700 1 -- 172.21.15.154:0/3513578975 >> 172.21.15.154:0/3513578975 conn(0x7fbc280a4430 msgr2=0x7fbc280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc301f8700 1 -- 172.21.15.154:0/3513578975 shutdown_connections 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.565+0000 7fbc301f8700 1 -- 172.21.15.154:0/3513578975 wait complete. 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.566+0000 7fbc301f8700 1 Processor -- start 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.566+0000 7fbc301f8700 1 -- start start 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc301f8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc281228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc301f8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2809f180 0x7fbc28122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc301f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbc28134330 0x7fbc28123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc301f8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc281334f0 con 0x7fbc2809f180 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc301f8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc28125b10 con 0x7fbc2809e870 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc301f8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc28124500 con 0x7fbc28134330 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2df94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc281228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2d793700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2809f180 0x7fbc28122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2df94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc281228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38250/0 (socket says 172.21.15.154:38250) 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2df94700 1 -- 172.21.15.154:0/800763253 learned_addr learned my addr 172.21.15.154:0/800763253 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2e795700 1 --2- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbc28134330 0x7fbc28123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2df94700 1 -- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbc28134330 msgr2=0x7fbc28123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2df94700 1 --2- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbc28134330 0x7fbc28123370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2df94700 1 -- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2809f180 msgr2=0x7fbc28122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2df94700 1 --2- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2809f180 0x7fbc28122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2df94700 1 -- 172.21.15.154:0/800763253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180094a0 con 0x7fbc2809e870 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2d793700 1 --2- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2809f180 0x7fbc28122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc2df94700 1 --2- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc281228f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800ebe0 tx=0x7fbc1800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc1e7fc700 1 -- 172.21.15.154:0/800763253 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800c850 con 0x7fbc2809e870 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc1e7fc700 1 -- 172.21.15.154:0/800763253 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1800c9b0 con 0x7fbc2809e870 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc1e7fc700 1 -- 172.21.15.154:0/800763253 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800cd40 con 0x7fbc2809e870 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc301f8700 1 -- 172.21.15.154:0/800763253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc20009b30 con 0x7fbc2809e870 2023-09-30T22:26:46.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.567+0000 7fbc301f8700 1 -- 172.21.15.154:0/800763253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc28125e70 con 0x7fbc2809e870 2023-09-30T22:26:46.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.568+0000 7fbc1e7fc700 1 -- 172.21.15.154:0/800763253 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc18013470 con 0x7fbc2809e870 2023-09-30T22:26:46.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.568+0000 7fbc1e7fc700 1 -- 172.21.15.154:0/800763253 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbc1803f710 con 0x7fbc2809e870 2023-09-30T22:26:46.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.568+0000 7fbc301f8700 1 -- 172.21.15.154:0/800763253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2804f2a0 con 0x7fbc2809e870 2023-09-30T22:26:46.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.573+0000 7fbc1e7fc700 1 -- 172.21.15.154:0/800763253 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc18021020 con 0x7fbc2809e870 2023-09-30T22:26:46.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:46.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:46.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.733+0000 7ff2717ab700 1 Processor -- start 2023-09-30T22:26:46.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.733+0000 7ff2717ab700 1 -- start start 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff2717ab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c09e340 0x7ff26c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff2717ab700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c135f20 0x7ff26c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff2717ab700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c09aaa0 con 0x7ff26c09d860 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff2717ab700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c09e730 con 0x7ff26c09e340 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff2717ab700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c09f870 con 0x7ff26c135f20 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff26a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c09e340 0x7ff26c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff26affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff26c09d860 0x7ff26c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:32994/0 (socket says 172.21.15.154:32994) 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff26affd700 1 -- 172.21.15.154:0/3454698843 learned_addr learned my addr 172.21.15.154:0/3454698843 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff26a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c09e340 0x7ff26c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38256/0 (socket says 172.21.15.154:38256) 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff26b7fe700 1 --2- 172.21.15.154:0/3454698843 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c135f20 0x7ff26c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.734+0000 7ff269ffb700 1 -- 172.21.15.154:0/3454698843 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073837485 0 0) 0x7ff26c09aaa0 con 0x7ff26c09d860 2023-09-30T22:26:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff269ffb700 1 -- 172.21.15.154:0/3454698843 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2540035b0 con 0x7ff26c09d860 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff26b7fe700 1 -- 172.21.15.154:0/3454698843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c09e340 msgr2=0x7ff26c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff26b7fe700 1 --2- 172.21.15.154:0/3454698843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c09e340 0x7ff26c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff26b7fe700 1 -- 172.21.15.154:0/3454698843 >> v1:172.21.15.154:6789/0 conn(0x7ff26c09d860 legacy=0x7ff26c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff26b7fe700 1 -- 172.21.15.154:0/3454698843 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c09b360 con 0x7ff26c135f20 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff26a7fc700 1 --2- 172.21.15.154:0/3454698843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c09e340 0x7ff26c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff26b7fe700 1 --2- 172.21.15.154:0/3454698843 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c135f20 0x7ff26c138300 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff264009df0 tx=0x7ff26400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c8aa629131c57f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff269ffb700 1 -- 172.21.15.154:0/3454698843 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26400e070 con 0x7ff26c135f20 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff269ffb700 1 -- 172.21.15.154:0/3454698843 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26400bae0 con 0x7ff26c135f20 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.735+0000 7ff269ffb700 1 -- 172.21.15.154:0/3454698843 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26400be90 con 0x7ff26c135f20 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.736+0000 7ff2717ab700 1 -- 172.21.15.154:0/3454698843 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c135f20 msgr2=0x7ff26c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.736+0000 7ff2717ab700 1 --2- 172.21.15.154:0/3454698843 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c135f20 0x7ff26c138300 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff264009df0 tx=0x7ff26400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.736+0000 7ff2717ab700 1 -- 172.21.15.154:0/3454698843 shutdown_connections 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.736+0000 7ff2717ab700 1 --2- 172.21.15.154:0/3454698843 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c135f20 0x7ff26c138300 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.736+0000 7ff2717ab700 1 --2- 172.21.15.154:0/3454698843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c09e340 0x7ff26c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.736+0000 7ff2717ab700 1 -- 172.21.15.154:0/3454698843 >> 172.21.15.154:0/3454698843 conn(0x7ff26c099c40 msgr2=0x7ff26c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.736+0000 7ff2717ab700 1 -- 172.21.15.154:0/3454698843 shutdown_connections 2023-09-30T22:26:46.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.736+0000 7ff2717ab700 1 -- 172.21.15.154:0/3454698843 wait complete. 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.737+0000 7ff2717ab700 1 Processor -- start 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff2717ab700 1 -- start start 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff2717ab700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26c09d860 0x7ff26c1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff2717ab700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c09e340 0x7ff26c1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff2717ab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c135f20 0x7ff26c134de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff2717ab700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c11d0c0 con 0x7ff26c09d860 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff2717ab700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c11daa0 con 0x7ff26c135f20 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff2717ab700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1c8f70 con 0x7ff26c09e340 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff26affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26c09d860 0x7ff26c1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff26a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c09e340 0x7ff26c1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff26affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26c09d860 0x7ff26c1c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59776/0 (socket says 172.21.15.154:59776) 2023-09-30T22:26:46.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.738+0000 7ff26affd700 1 -- 172.21.15.154:0/1708903683 learned_addr learned my addr 172.21.15.154:0/1708903683 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff26b7fe700 1 --2- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c135f20 0x7ff26c134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff26a7fc700 1 -- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c135f20 msgr2=0x7ff26c134de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff26a7fc700 1 --2- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c135f20 0x7ff26c134de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff26a7fc700 1 -- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26c09d860 msgr2=0x7ff26c1c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff26a7fc700 1 --2- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26c09d860 0x7ff26c1c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff26a7fc700 1 -- 172.21.15.154:0/1708903683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2600094a0 con 0x7ff26c09e340 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff26a7fc700 1 --2- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c09e340 0x7ff26c1c8a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff26000e9b0 tx=0x7ff26000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff2537fe700 1 -- 172.21.15.154:0/1708903683 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26000ee50 con 0x7ff26c09e340 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff2537fe700 1 -- 172.21.15.154:0/1708903683 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26000c850 con 0x7ff26c09e340 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff2717ab700 1 -- 172.21.15.154:0/1708903683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff264009a70 con 0x7ff26c09e340 2023-09-30T22:26:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff2537fe700 1 -- 172.21.15.154:0/1708903683 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26000cbe0 con 0x7ff26c09e340 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.739+0000 7ff2717ab700 1 -- 172.21.15.154:0/1708903683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c072090 con 0x7ff26c09e340 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.740+0000 7ff2537fe700 1 -- 172.21.15.154:0/1708903683 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff26000cd40 con 0x7ff26c09e340 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.741+0000 7ff2537fe700 1 -- 172.21.15.154:0/1708903683 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff26003f3c0 con 0x7ff26c09e340 2023-09-30T22:26:46.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.741+0000 7ff2717ab700 1 -- 172.21.15.154:0/1708903683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c11dbe0 con 0x7ff26c09e340 2023-09-30T22:26:46.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.745+0000 7ff2537fe700 1 -- 172.21.15.154:0/1708903683 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff26c11dbe0 con 0x7ff26c09e340 2023-09-30T22:26:46.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.774+0000 7fbc301f8700 1 -- 172.21.15.154:0/800763253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbc2806c9d0 con 0x7fbc2809e870 2023-09-30T22:26:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.774+0000 7fbc1e7fc700 1 -- 172.21.15.154:0/800763253 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc18021020 con 0x7fbc2809e870 2023-09-30T22:26:46.775 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:46.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.776+0000 7fbc301f8700 1 -- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 msgr2=0x7fbc281228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.776+0000 7fbc301f8700 1 --2- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc281228f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800ebe0 tx=0x7fbc1800eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.776+0000 7fbc301f8700 1 -- 172.21.15.154:0/800763253 shutdown_connections 2023-09-30T22:26:46.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.776+0000 7fbc301f8700 1 --2- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbc28134330 0x7fbc28123370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.776+0000 7fbc301f8700 1 --2- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc2809e870 0x7fbc281228f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.776+0000 7fbc301f8700 1 --2- 172.21.15.154:0/800763253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc2809f180 0x7fbc28122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.776+0000 7fbc301f8700 1 -- 172.21.15.154:0/800763253 >> 172.21.15.154:0/800763253 conn(0x7fbc280a4430 msgr2=0x7fbc28070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.776+0000 7fbc301f8700 1 -- 172.21.15.154:0/800763253 shutdown_connections 2023-09-30T22:26:46.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.776+0000 7fbc301f8700 1 -- 172.21.15.154:0/800763253 wait complete. 2023-09-30T22:26:46.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.789+0000 7fd38e181700 1 Processor -- start 2023-09-30T22:26:46.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:46.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.789+0000 7fd38e181700 1 -- start start 2023-09-30T22:26:46.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd38e181700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd38e181700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3881356e0 0x7fd388137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd38e181700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3880a1e70 con 0x7fd3880a0a30 2023-09-30T22:26:46.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd38e181700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38809a720 con 0x7fd3881356e0 2023-09-30T22:26:46.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd38e181700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38809b300 con 0x7fd3880a1510 2023-09-30T22:26:46.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd3877fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3880a0a30 0x7fd3880a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33000/0 (socket says 172.21.15.154:33000) 2023-09-30T22:26:46.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd386ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd3877fe700 1 -- 172.21.15.154:0/698663973 learned_addr learned my addr 172.21.15.154:0/698663973 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:46.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd387fff700 1 --2- 172.21.15.154:0/698663973 >> v2:172.21.15.154:3300/0 conn(0x7fd3881356e0 0x7fd388137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd387fff700 1 -- 172.21.15.154:0/698663973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 msgr2=0x7fd3881351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd387fff700 1 --2- 172.21.15.154:0/698663973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd387fff700 1 -- 172.21.15.154:0/698663973 >> v1:172.21.15.154:6789/0 conn(0x7fd3880a0a30 legacy=0x7fd3880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.790+0000 7fd387fff700 1 -- 172.21.15.154:0/698663973 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38809abc0 con 0x7fd3881356e0 2023-09-30T22:26:46.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.791+0000 7fd387fff700 1 --2- 172.21.15.154:0/698663973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3881356e0 0x7fd388137ac0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd380009d90 tx=0x7fd38000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9caeefd2d0b68f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.791+0000 7fd3867fc700 1 -- 172.21.15.154:0/698663973 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000e070 con 0x7fd3881356e0 2023-09-30T22:26:46.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.791+0000 7fd3867fc700 1 -- 172.21.15.154:0/698663973 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38000bbd0 con 0x7fd3881356e0 2023-09-30T22:26:46.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.791+0000 7fd3867fc700 1 -- 172.21.15.154:0/698663973 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380012430 con 0x7fd3881356e0 2023-09-30T22:26:46.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.792+0000 7fd38e181700 1 -- 172.21.15.154:0/698663973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3881356e0 msgr2=0x7fd388137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.792+0000 7fd38e181700 1 --2- 172.21.15.154:0/698663973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3881356e0 0x7fd388137ac0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd380009d90 tx=0x7fd38000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:46.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.792+0000 7fd38e181700 1 -- 172.21.15.154:0/698663973 shutdown_connections 2023-09-30T22:26:46.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.792+0000 7fd38e181700 1 --2- 172.21.15.154:0/698663973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3881356e0 0x7fd388137ac0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.792+0000 7fd38e181700 1 --2- 172.21.15.154:0/698663973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.792+0000 7fd38e181700 1 -- 172.21.15.154:0/698663973 >> 172.21.15.154:0/698663973 conn(0x7fd3880a2980 msgr2=0x7fd3880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.792+0000 7fd38e181700 1 -- 172.21.15.154:0/698663973 shutdown_connections 2023-09-30T22:26:46.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.792+0000 7fd38e181700 1 -- 172.21.15.154:0/698663973 wait complete. 2023-09-30T22:26:46.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd38e181700 1 Processor -- start 2023-09-30T22:26:46.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd38e181700 1 -- start start 2023-09-30T22:26:46.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd38e181700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3880a0a30 0x7fd3881c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd38e181700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd38e181700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3881356e0 0x7fd3881c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd38e181700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd388132d40 con 0x7fd3880a0a30 2023-09-30T22:26:46.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd38e181700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd388130480 con 0x7fd3880a1510 2023-09-30T22:26:46.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd38e181700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd388130170 con 0x7fd3881356e0 2023-09-30T22:26:46.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd386ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd3877fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3880a0a30 0x7fd3881c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd387fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3881356e0 0x7fd3881c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd387fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3881356e0 0x7fd3881c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46824/0 (socket says 172.21.15.154:46824) 2023-09-30T22:26:46.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd386ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38286/0 (socket says 172.21.15.154:38286) 2023-09-30T22:26:46.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.793+0000 7fd387fff700 1 -- 172.21.15.154:0/242812659 learned_addr learned my addr 172.21.15.154:0/242812659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:46.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd387fff700 1 -- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 msgr2=0x7fd3881c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd387fff700 1 --2- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd387fff700 1 -- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3880a0a30 msgr2=0x7fd3881c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd387fff700 1 --2- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3880a0a30 0x7fd3881c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd387fff700 1 -- 172.21.15.154:0/242812659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009a70 con 0x7fd3881356e0 2023-09-30T22:26:46.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd3877fe700 1 --2- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3880a0a30 0x7fd3881c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd386ffd700 1 --2- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd387fff700 1 --2- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3881356e0 0x7fd3881c8d10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd380014040 tx=0x7fd380004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd36ffff700 1 -- 172.21.15.154:0/242812659 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380003ea0 con 0x7fd3881356e0 2023-09-30T22:26:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd36ffff700 1 -- 172.21.15.154:0/242812659 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380020070 con 0x7fd3881356e0 2023-09-30T22:26:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd38e181700 1 -- 172.21.15.154:0/242812659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd388071580 con 0x7fd3881356e0 2023-09-30T22:26:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd36ffff700 1 -- 172.21.15.154:0/242812659 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800098f0 con 0x7fd3881356e0 2023-09-30T22:26:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.794+0000 7fd38e181700 1 -- 172.21.15.154:0/242812659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd388131ae0 con 0x7fd3881356e0 2023-09-30T22:26:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.795+0000 7fd36ffff700 1 -- 172.21.15.154:0/242812659 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd380004040 con 0x7fd3881356e0 2023-09-30T22:26:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.795+0000 7fd38e181700 1 -- 172.21.15.154:0/242812659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd388132b80 con 0x7fd3881356e0 2023-09-30T22:26:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.795+0000 7fd36ffff700 1 -- 172.21.15.154:0/242812659 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd380022070 con 0x7fd3881356e0 2023-09-30T22:26:46.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.800+0000 7fd36ffff700 1 -- 172.21.15.154:0/242812659 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd38001a970 con 0x7fd3881356e0 2023-09-30T22:26:46.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.811+0000 7f95f2bcb700 1 Processor -- start 2023-09-30T22:26:46.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.811+0000 7f95f2bcb700 1 -- start start 2023-09-30T22:26:46.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f2bcb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09e340 0x7f95ec1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f2bcb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95ec135f20 0x7f95ec138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f2bcb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec09aaa0 con 0x7f95ec09d860 2023-09-30T22:26:46.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f2bcb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec09e730 con 0x7f95ec135f20 2023-09-30T22:26:46.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f2bcb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec09f870 con 0x7f95ec09e340 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09e340 0x7f95ec1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09e340 0x7f95ec1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46828/0 (socket says 172.21.15.154:46828) 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95ebfff700 1 -- 172.21.15.154:0/2966294139 learned_addr learned my addr 172.21.15.154:0/2966294139 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f1168700 1 --2- 172.21.15.154:0/2966294139 >> v2:172.21.15.154:3300/0 conn(0x7f95ec135f20 0x7f95ec138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f1168700 1 -- 172.21.15.154:0/2966294139 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09e340 msgr2=0x7f95ec1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f1168700 1 --2- 172.21.15.154:0/2966294139 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09e340 0x7f95ec1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f1168700 1 -- 172.21.15.154:0/2966294139 >> v1:172.21.15.154:6789/0 conn(0x7f95ec09d860 legacy=0x7f95ec09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95f1168700 1 -- 172.21.15.154:0/2966294139 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec09b360 con 0x7f95ec135f20 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.812+0000 7f95ebfff700 1 --2- 172.21.15.154:0/2966294139 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09e340 0x7f95ec1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95f1168700 1 --2- 172.21.15.154:0/2966294139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec135f20 0x7f95ec138300 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009d90 tx=0x7f95e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bf248e7af675c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95eb7fe700 1 -- 172.21.15.154:0/2966294139 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400e070 con 0x7f95ec135f20 2023-09-30T22:26:46.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95eb7fe700 1 -- 172.21.15.154:0/2966294139 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400bb20 con 0x7f95ec135f20 2023-09-30T22:26:46.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95eb7fe700 1 -- 172.21.15.154:0/2966294139 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e4012430 con 0x7f95ec135f20 2023-09-30T22:26:46.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95f2bcb700 1 -- 172.21.15.154:0/2966294139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec135f20 msgr2=0x7f95ec138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95f2bcb700 1 --2- 172.21.15.154:0/2966294139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec135f20 0x7f95ec138300 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009d90 tx=0x7f95e400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:46.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95f2bcb700 1 -- 172.21.15.154:0/2966294139 shutdown_connections 2023-09-30T22:26:46.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95f2bcb700 1 --2- 172.21.15.154:0/2966294139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec135f20 0x7f95ec138300 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95f2bcb700 1 --2- 172.21.15.154:0/2966294139 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09e340 0x7f95ec1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95f2bcb700 1 -- 172.21.15.154:0/2966294139 >> 172.21.15.154:0/2966294139 conn(0x7f95ec099c40 msgr2=0x7f95ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95f2bcb700 1 -- 172.21.15.154:0/2966294139 shutdown_connections 2023-09-30T22:26:46.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.813+0000 7f95f2bcb700 1 -- 172.21.15.154:0/2966294139 wait complete. 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.815+0000 7f95f2bcb700 1 Processor -- start 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.815+0000 7f95f2bcb700 1 -- start start 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.815+0000 7f95f2bcb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09d860 0x7f95ec11b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.815+0000 7f95f2bcb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec09e340 0x7f95ec11bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.815+0000 7f95f2bcb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ec135f20 0x7f95ec11bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.815+0000 7f95f2bcb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec132310 con 0x7f95ec09e340 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.815+0000 7f95f2bcb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec09c8b0 con 0x7f95ec135f20 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.815+0000 7f95f2bcb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec11d9a0 con 0x7f95ec09d860 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.815+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec09e340 0x7f95ec11bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec09e340 0x7f95ec11bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59802/0 (socket says 172.21.15.154:59802) 2023-09-30T22:26:46.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95ebfff700 1 -- 172.21.15.154:0/98481810 learned_addr learned my addr 172.21.15.154:0/98481810 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95f1168700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ec135f20 0x7f95ec11bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95f0967700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09d860 0x7f95ec11b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95ebfff700 1 -- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09d860 msgr2=0x7f95ec11b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95ebfff700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09d860 0x7f95ec11b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95ebfff700 1 -- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ec135f20 msgr2=0x7f95ec11bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95ebfff700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ec135f20 0x7f95ec11bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95ebfff700 1 -- 172.21.15.154:0/98481810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d800b7f0 con 0x7f95ec09e340 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95f1168700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ec135f20 0x7f95ec11bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95ebfff700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec09e340 0x7f95ec11bab0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f95d8010fd0 tx=0x7f95d800e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95e97fa700 1 -- 172.21.15.154:0/98481810 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8011650 con 0x7f95ec09e340 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95e97fa700 1 -- 172.21.15.154:0/98481810 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d800eed0 con 0x7f95ec09e340 2023-09-30T22:26:46.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95e97fa700 1 -- 172.21.15.154:0/98481810 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80119b0 con 0x7f95ec09e340 2023-09-30T22:26:46.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95f2bcb700 1 -- 172.21.15.154:0/98481810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e4009a70 con 0x7f95ec09e340 2023-09-30T22:26:46.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.816+0000 7f95f2bcb700 1 -- 172.21.15.154:0/98481810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec11ed70 con 0x7f95ec09e340 2023-09-30T22:26:46.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.817+0000 7f95e97fa700 1 -- 172.21.15.154:0/98481810 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95d8011b10 con 0x7f95ec09e340 2023-09-30T22:26:46.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.817+0000 7f95e97fa700 1 -- 172.21.15.154:0/98481810 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f95d80422a0 con 0x7f95ec09e340 2023-09-30T22:26:46.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.817+0000 7f95f2bcb700 1 -- 172.21.15.154:0/98481810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec11ea10 con 0x7f95ec09e340 2023-09-30T22:26:46.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.822+0000 7f95e97fa700 1 -- 172.21.15.154:0/98481810 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95d801e080 con 0x7f95ec09e340 2023-09-30T22:26:46.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.959+0000 7ff2717ab700 1 -- 172.21.15.154:0/1708903683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff26c11c700 con 0x7ff26c09e340 2023-09-30T22:26:46.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.959+0000 7ff2537fe700 1 -- 172.21.15.154:0/1708903683 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff26c11c700 con 0x7ff26c09e340 2023-09-30T22:26:46.961 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:46.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.961+0000 7ff2717ab700 1 -- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c09e340 msgr2=0x7ff26c1c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:46.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.961+0000 7ff2717ab700 1 --2- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c09e340 0x7ff26c1c8a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff26000e9b0 tx=0x7ff26000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.961+0000 7ff2717ab700 1 -- 172.21.15.154:0/1708903683 shutdown_connections 2023-09-30T22:26:46.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.961+0000 7ff2717ab700 1 --2- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff26c135f20 0x7ff26c134de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.961+0000 7ff2717ab700 1 --2- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26c09d860 0x7ff26c1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.961+0000 7ff2717ab700 1 --2- 172.21.15.154:0/1708903683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff26c09e340 0x7ff26c1c8a30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:46.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.961+0000 7ff2717ab700 1 -- 172.21.15.154:0/1708903683 >> 172.21.15.154:0/1708903683 conn(0x7ff26c099c40 msgr2=0x7ff26c0a1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:46.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.961+0000 7ff2717ab700 1 -- 172.21.15.154:0/1708903683 shutdown_connections 2023-09-30T22:26:46.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.961+0000 7ff2717ab700 1 -- 172.21.15.154:0/1708903683 wait complete. 2023-09-30T22:26:46.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:46.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.999+0000 7fd38e181700 1 -- 172.21.15.154:0/242812659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd38804f2a0 con 0x7fd3881356e0 2023-09-30T22:26:47.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:46.999+0000 7fd36ffff700 1 -- 172.21.15.154:0/242812659 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd38002c030 con 0x7fd3881356e0 2023-09-30T22:26:47.000 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:47.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.001+0000 7fd38e181700 1 -- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3881356e0 msgr2=0x7fd3881c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.001+0000 7fd38e181700 1 --2- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3881356e0 0x7fd3881c8d10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd380014040 tx=0x7fd380004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.001+0000 7fd38e181700 1 -- 172.21.15.154:0/242812659 shutdown_connections 2023-09-30T22:26:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.001+0000 7fd38e181700 1 --2- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3881356e0 0x7fd3881c8d10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.001+0000 7fd38e181700 1 --2- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3880a0a30 0x7fd3881c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.001+0000 7fd38e181700 1 --2- 172.21.15.154:0/242812659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3880a1510 0x7fd3881c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.001+0000 7fd38e181700 1 -- 172.21.15.154:0/242812659 >> 172.21.15.154:0/242812659 conn(0x7fd3880a2980 msgr2=0x7fd38809ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.001+0000 7fd38e181700 1 -- 172.21.15.154:0/242812659 shutdown_connections 2023-09-30T22:26:47.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.001+0000 7fd38e181700 1 -- 172.21.15.154:0/242812659 wait complete. 2023-09-30T22:26:47.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.025+0000 7f95f2bcb700 1 -- 172.21.15.154:0/98481810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f95ec04f2a0 con 0x7f95ec09e340 2023-09-30T22:26:47.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.025+0000 7f95e97fa700 1 -- 172.21.15.154:0/98481810 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95d8017da0 con 0x7f95ec09e340 2023-09-30T22:26:47.025 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:47.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.027+0000 7f95f2bcb700 1 -- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec09e340 msgr2=0x7f95ec11bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.027+0000 7f95f2bcb700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec09e340 0x7f95ec11bab0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f95d8010fd0 tx=0x7f95d800e640 comp rx=0 tx=0).stop 2023-09-30T22:26:47.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.027+0000 7f95f2bcb700 1 -- 172.21.15.154:0/98481810 shutdown_connections 2023-09-30T22:26:47.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.027+0000 7f95f2bcb700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ec135f20 0x7f95ec11bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.027+0000 7f95f2bcb700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95ec09d860 0x7f95ec11b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.027+0000 7f95f2bcb700 1 --2- 172.21.15.154:0/98481810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ec09e340 0x7f95ec11bab0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.027+0000 7f95f2bcb700 1 -- 172.21.15.154:0/98481810 >> 172.21.15.154:0/98481810 conn(0x7f95ec099c40 msgr2=0x7f95ec132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:47.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.027+0000 7f95f2bcb700 1 -- 172.21.15.154:0/98481810 shutdown_connections 2023-09-30T22:26:47.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.027+0000 7f95f2bcb700 1 -- 172.21.15.154:0/98481810 wait complete. 2023-09-30T22:26:47.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:47.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:47.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.927+0000 7efd14805700 1 Processor -- start 2023-09-30T22:26:47.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.927+0000 7efd14805700 1 -- start start 2023-09-30T22:26:47.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd14805700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd101368b0 0x7efd10138c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd14805700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd101391d0 0x7efd1013b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd14805700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1009ac40 con 0x7efd1012cef0 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd14805700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1009a740 con 0x7efd101368b0 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd14805700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1012d9d0 con 0x7efd101391d0 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd101391d0 0x7efd1013b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd101391d0 0x7efd1013b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38296/0 (socket says 172.21.15.154:38296) 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd101368b0 0x7efd10138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0ed9d700 1 -- 172.21.15.154:0/1085090654 learned_addr learned my addr 172.21.15.154:0/1085090654 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0ed9d700 1 -- 172.21.15.154:0/1085090654 >> v2:172.21.15.154:3300/0 conn(0x7efd101368b0 msgr2=0x7efd10138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0ed9d700 1 --2- 172.21.15.154:0/1085090654 >> v2:172.21.15.154:3300/0 conn(0x7efd101368b0 0x7efd10138c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0ed9d700 1 -- 172.21.15.154:0/1085090654 >> v1:172.21.15.154:6789/0 conn(0x7efd1012cef0 legacy=0x7efd1012d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0ed9d700 1 -- 172.21.15.154:0/1085090654 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1009f3a0 con 0x7efd101391d0 2023-09-30T22:26:47.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0dd9b700 1 --2- 172.21.15.154:0/1085090654 >> v2:172.21.15.154:3300/0 conn(0x7efd101368b0 0x7efd10138c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:47.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0ed9d700 1 --2- 172.21.15.154:0/1085090654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd101391d0 0x7efd1013b5b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efd08009e50 tx=0x7efd0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73c501fc46f8877c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:47.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.928+0000 7efd0d59a700 1 -- 172.21.15.154:0/1085090654 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0800e070 con 0x7efd101391d0 2023-09-30T22:26:47.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd0d59a700 1 -- 172.21.15.154:0/1085090654 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0800b910 con 0x7efd101391d0 2023-09-30T22:26:47.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd0d59a700 1 -- 172.21.15.154:0/1085090654 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0800bcc0 con 0x7efd101391d0 2023-09-30T22:26:47.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd14805700 1 -- 172.21.15.154:0/1085090654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd101391d0 msgr2=0x7efd1013b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd14805700 1 --2- 172.21.15.154:0/1085090654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd101391d0 0x7efd1013b5b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efd08009e50 tx=0x7efd0800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:47.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd14805700 1 -- 172.21.15.154:0/1085090654 shutdown_connections 2023-09-30T22:26:47.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd14805700 1 --2- 172.21.15.154:0/1085090654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd101391d0 0x7efd1013b5b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd14805700 1 --2- 172.21.15.154:0/1085090654 >> v2:172.21.15.154:3300/0 conn(0x7efd101368b0 0x7efd10138c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd14805700 1 -- 172.21.15.154:0/1085090654 >> 172.21.15.154:0/1085090654 conn(0x7efd10099c40 msgr2=0x7efd100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:47.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd14805700 1 -- 172.21.15.154:0/1085090654 shutdown_connections 2023-09-30T22:26:47.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.929+0000 7efd14805700 1 -- 172.21.15.154:0/1085090654 wait complete. 2023-09-30T22:26:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd14805700 1 Processor -- start 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd14805700 1 -- start start 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd14805700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1012cef0 0x7efd101326c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd14805700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd101368b0 0x7efd10132c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd14805700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd101391d0 0x7efd10133140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd14805700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd100a2ea0 con 0x7efd101368b0 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd14805700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd10133a90 con 0x7efd1012cef0 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd14805700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd101342c0 con 0x7efd101391d0 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd0dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd101368b0 0x7efd10132c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd0dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd101368b0 0x7efd10132c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59822/0 (socket says 172.21.15.154:59822) 2023-09-30T22:26:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd0ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd101391d0 0x7efd10133140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd0dd9b700 1 -- 172.21.15.154:0/1439750564 learned_addr learned my addr 172.21.15.154:0/1439750564 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.931+0000 7efd0e59c700 1 --2- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1012cef0 0x7efd101326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efd0dd9b700 1 -- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd101391d0 msgr2=0x7efd10133140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efd0dd9b700 1 --2- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd101391d0 0x7efd10133140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efd0dd9b700 1 -- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1012cef0 msgr2=0x7efd101326c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efd0dd9b700 1 --2- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1012cef0 0x7efd101326c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efd0dd9b700 1 -- 172.21.15.154:0/1439750564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd000094a0 con 0x7efd101368b0 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efd0dd9b700 1 --2- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd101368b0 0x7efd10132c00 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7efd0000ebe0 tx=0x7efd0000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efcfeffd700 1 -- 172.21.15.154:0/1439750564 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000c850 con 0x7efd101368b0 2023-09-30T22:26:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efcfeffd700 1 -- 172.21.15.154:0/1439750564 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0000c9b0 con 0x7efd101368b0 2023-09-30T22:26:47.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efd14805700 1 -- 172.21.15.154:0/1439750564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd08009b30 con 0x7efd101368b0 2023-09-30T22:26:47.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efcfeffd700 1 -- 172.21.15.154:0/1439750564 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000cd40 con 0x7efd101368b0 2023-09-30T22:26:47.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.932+0000 7efd14805700 1 -- 172.21.15.154:0/1439750564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd101349a0 con 0x7efd101368b0 2023-09-30T22:26:47.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.933+0000 7efcfeffd700 1 -- 172.21.15.154:0/1439750564 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd00013470 con 0x7efd101368b0 2023-09-30T22:26:47.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.933+0000 7efcfeffd700 1 -- 172.21.15.154:0/1439750564 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd0003fb30 con 0x7efd101368b0 2023-09-30T22:26:47.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.933+0000 7efd14805700 1 -- 172.21.15.154:0/1439750564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1006f140 con 0x7efd101368b0 2023-09-30T22:26:47.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:47.938+0000 7efcfeffd700 1 -- 172.21.15.154:0/1439750564 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd00021080 con 0x7efd101368b0 2023-09-30T22:26:47.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:48.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:48.040 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.103+0000 7f8e3c02e700 1 Processor -- start 2023-09-30T22:26:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.104+0000 7f8e3c02e700 1 -- start start 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.104+0000 7f8e3c02e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e34099e20 0x7f8e3409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.104+0000 7f8e3c02e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e34130a60 0x7f8e34138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.104+0000 7f8e3c02e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e34099a60 con 0x7f8e3409a730 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.104+0000 7f8e3c02e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3409bf50 con 0x7f8e34130a60 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.104+0000 7f8e3c02e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3409b230 con 0x7f8e34099e20 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.104+0000 7f8e3a5cb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e34130a60 0x7f8e34138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.104+0000 7f8e395c9700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8e3409a730 0x7f8e34130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33022/0 (socket says 172.21.15.154:33022) 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.104+0000 7f8e395c9700 1 -- 172.21.15.154:0/2606882261 learned_addr learned my addr 172.21.15.154:0/2606882261 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e38dc8700 1 -- 172.21.15.154:0/2606882261 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094408236 0 0) 0x7f8e34099a60 con 0x7f8e3409a730 2023-09-30T22:26:48.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e38dc8700 1 -- 172.21.15.154:0/2606882261 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e200035b0 con 0x7f8e3409a730 2023-09-30T22:26:48.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e3a5cb700 1 -- 172.21.15.154:0/2606882261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e34099e20 msgr2=0x7f8e3409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e3a5cb700 1 --2- 172.21.15.154:0/2606882261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e34099e20 0x7f8e3409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e3a5cb700 1 -- 172.21.15.154:0/2606882261 >> v1:172.21.15.154:6789/0 conn(0x7f8e3409a730 legacy=0x7f8e34130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e3a5cb700 1 -- 172.21.15.154:0/2606882261 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3409bb90 con 0x7f8e34130a60 2023-09-30T22:26:48.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e3a5cb700 1 --2- 172.21.15.154:0/2606882261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e34130a60 0x7f8e34138690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009df0 tx=0x7f8e2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3589007a14d94b7a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e38dc8700 1 -- 172.21.15.154:0/2606882261 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00e070 con 0x7f8e34130a60 2023-09-30T22:26:48.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e38dc8700 1 -- 172.21.15.154:0/2606882261 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c00bae0 con 0x7f8e34130a60 2023-09-30T22:26:48.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.105+0000 7f8e38dc8700 1 -- 172.21.15.154:0/2606882261 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00be90 con 0x7f8e34130a60 2023-09-30T22:26:48.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.106+0000 7f8e3c02e700 1 -- 172.21.15.154:0/2606882261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e34130a60 msgr2=0x7f8e34138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.106+0000 7f8e3c02e700 1 --2- 172.21.15.154:0/2606882261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e34130a60 0x7f8e34138690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009df0 tx=0x7f8e2c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:48.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.106+0000 7f8e3c02e700 1 -- 172.21.15.154:0/2606882261 shutdown_connections 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.106+0000 7f8e3c02e700 1 --2- 172.21.15.154:0/2606882261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e34130a60 0x7f8e34138690 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.106+0000 7f8e3c02e700 1 --2- 172.21.15.154:0/2606882261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e34099e20 0x7f8e3409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.106+0000 7f8e3c02e700 1 -- 172.21.15.154:0/2606882261 >> 172.21.15.154:0/2606882261 conn(0x7f8e340a2980 msgr2=0x7f8e340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.106+0000 7f8e3c02e700 1 -- 172.21.15.154:0/2606882261 shutdown_connections 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.106+0000 7f8e3c02e700 1 -- 172.21.15.154:0/2606882261 wait complete. 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.107+0000 7f8e3c02e700 1 Processor -- start 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.107+0000 7f8e3c02e700 1 -- start start 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.107+0000 7f8e3c02e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e34099e20 0x7f8e3412ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.107+0000 7f8e3c02e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e3409a730 0x7f8e3412d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.107+0000 7f8e3c02e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e34130a60 0x7f8e3412d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.107+0000 7f8e3c02e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3412bfe0 con 0x7f8e34130a60 2023-09-30T22:26:48.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.107+0000 7f8e3c02e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3413b820 con 0x7f8e3409a730 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.107+0000 7f8e3c02e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3412af90 con 0x7f8e34099e20 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3a5cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e34130a60 0x7f8e3412d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3a5cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e34130a60 0x7f8e3412d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59828/0 (socket says 172.21.15.154:59828) 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3a5cb700 1 -- 172.21.15.154:0/3179576613 learned_addr learned my addr 172.21.15.154:0/3179576613 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e39dca700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e34099e20 0x7f8e3412ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e395c9700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e3409a730 0x7f8e3412d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3a5cb700 1 -- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e34099e20 msgr2=0x7f8e3412ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3a5cb700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e34099e20 0x7f8e3412ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3a5cb700 1 -- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e3409a730 msgr2=0x7f8e3412d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3a5cb700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e3409a730 0x7f8e3412d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3a5cb700 1 -- 172.21.15.154:0/3179576613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c009a70 con 0x7f8e34130a60 2023-09-30T22:26:48.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e395c9700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e3409a730 0x7f8e3412d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:48.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3a5cb700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e34130a60 0x7f8e3412d890 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8e340a2630 tx=0x7f8e2c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e2a7fc700 1 -- 172.21.15.154:0/3179576613 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0046a0 con 0x7f8e34130a60 2023-09-30T22:26:48.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e2a7fc700 1 -- 172.21.15.154:0/3179576613 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c020070 con 0x7f8e34130a60 2023-09-30T22:26:48.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.108+0000 7f8e3c02e700 1 -- 172.21.15.154:0/3179576613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e34139860 con 0x7f8e34130a60 2023-09-30T22:26:48.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.109+0000 7f8e3c02e700 1 -- 172.21.15.154:0/3179576613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3412b930 con 0x7f8e34130a60 2023-09-30T22:26:48.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.109+0000 7f8e2a7fc700 1 -- 172.21.15.154:0/3179576613 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c027480 con 0x7f8e34130a60 2023-09-30T22:26:48.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.110+0000 7f8e3c02e700 1 -- 172.21.15.154:0/3179576613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c0052e0 con 0x7f8e34130a60 2023-09-30T22:26:48.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.110+0000 7f8e2a7fc700 1 -- 172.21.15.154:0/3179576613 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e2c0275e0 con 0x7f8e34130a60 2023-09-30T22:26:48.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.110+0000 7f8e2a7fc700 1 -- 172.21.15.154:0/3179576613 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8e2c022070 con 0x7f8e34130a60 2023-09-30T22:26:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.115+0000 7f8e2a7fc700 1 -- 172.21.15.154:0/3179576613 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e2c046060 con 0x7f8e34130a60 2023-09-30T22:26:48.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.147+0000 7efd14805700 1 -- 172.21.15.154:0/1439750564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd1006ee80 con 0x7efd101368b0 2023-09-30T22:26:48.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.147+0000 7efcfeffd700 1 -- 172.21.15.154:0/1439750564 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd1006ee80 con 0x7efd101368b0 2023-09-30T22:26:48.147 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:48.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.150+0000 7efd14805700 1 -- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd101368b0 msgr2=0x7efd10132c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.150+0000 7efd14805700 1 --2- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd101368b0 0x7efd10132c00 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7efd0000ebe0 tx=0x7efd0000eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.150+0000 7efd14805700 1 -- 172.21.15.154:0/1439750564 shutdown_connections 2023-09-30T22:26:48.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.150+0000 7efd14805700 1 --2- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd101391d0 0x7efd10133140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.150+0000 7efd14805700 1 --2- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd1012cef0 0x7efd101326c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.150+0000 7efd14805700 1 --2- 172.21.15.154:0/1439750564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd101368b0 0x7efd10132c00 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.150+0000 7efd14805700 1 -- 172.21.15.154:0/1439750564 >> 172.21.15.154:0/1439750564 conn(0x7efd10099c40 msgr2=0x7efd10136c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.150+0000 7efd14805700 1 -- 172.21.15.154:0/1439750564 shutdown_connections 2023-09-30T22:26:48.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.151+0000 7efd14805700 1 -- 172.21.15.154:0/1439750564 wait complete. 2023-09-30T22:26:48.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.162+0000 7ff233e3b700 1 Processor -- start 2023-09-30T22:26:48.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.162+0000 7ff233e3b700 1 -- start start 2023-09-30T22:26:48.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff233e3b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09d860 0x7ff22c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff233e3b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09e170 0x7ff22c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff233e3b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff22c130ce0 0x7ff22c131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff233e3b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22c09aaa0 con 0x7ff22c130ce0 2023-09-30T22:26:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff233e3b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c09f870 con 0x7ff22c09d860 2023-09-30T22:26:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff233e3b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c09b360 con 0x7ff22c09e170 2023-09-30T22:26:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2313d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09e170 0x7ff22c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2313d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09e170 0x7ff22c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46894/0 (socket says 172.21.15.154:46894) 2023-09-30T22:26:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2313d6700 1 -- 172.21.15.154:0/480914573 learned_addr learned my addr 172.21.15.154:0/480914573 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:48.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff231bd7700 1 --2- 172.21.15.154:0/480914573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09d860 0x7ff22c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2323d8700 1 --2- 172.21.15.154:0/480914573 >> v2:172.21.15.154:3300/0 conn(0x7ff22c130ce0 0x7ff22c131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2313d6700 1 -- 172.21.15.154:0/480914573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09d860 msgr2=0x7ff22c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2313d6700 1 --2- 172.21.15.154:0/480914573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09d860 0x7ff22c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2313d6700 1 -- 172.21.15.154:0/480914573 >> v2:172.21.15.154:3300/0 conn(0x7ff22c130ce0 msgr2=0x7ff22c131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2313d6700 1 --2- 172.21.15.154:0/480914573 >> v2:172.21.15.154:3300/0 conn(0x7ff22c130ce0 0x7ff22c131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2313d6700 1 -- 172.21.15.154:0/480914573 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c09b620 con 0x7ff22c09e170 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.163+0000 7ff2313d6700 1 --2- 172.21.15.154:0/480914573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09e170 0x7ff22c1307a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00bb90 tx=0x7ff21c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b65fce0cbe24ff05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff230bd5700 1 -- 172.21.15.154:0/480914573 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00dd30 con 0x7ff22c09e170 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff230bd5700 1 -- 172.21.15.154:0/480914573 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c00de90 con 0x7ff22c09e170 2023-09-30T22:26:48.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff230bd5700 1 -- 172.21.15.154:0/480914573 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c010670 con 0x7ff22c09e170 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff233e3b700 1 -- 172.21.15.154:0/480914573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09e170 msgr2=0x7ff22c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff233e3b700 1 --2- 172.21.15.154:0/480914573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09e170 0x7ff22c1307a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00bb90 tx=0x7ff21c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff233e3b700 1 -- 172.21.15.154:0/480914573 shutdown_connections 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff233e3b700 1 --2- 172.21.15.154:0/480914573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09d860 0x7ff22c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff233e3b700 1 --2- 172.21.15.154:0/480914573 >> v2:172.21.15.154:3300/0 conn(0x7ff22c130ce0 0x7ff22c131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff233e3b700 1 --2- 172.21.15.154:0/480914573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09e170 0x7ff22c1307a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.164+0000 7ff233e3b700 1 -- 172.21.15.154:0/480914573 >> 172.21.15.154:0/480914573 conn(0x7ff22c099c40 msgr2=0x7ff22c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.165+0000 7ff233e3b700 1 -- 172.21.15.154:0/480914573 shutdown_connections 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.165+0000 7ff233e3b700 1 -- 172.21.15.154:0/480914573 wait complete. 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.166+0000 7ff233e3b700 1 Processor -- start 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.166+0000 7ff233e3b700 1 -- start start 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff233e3b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09d860 0x7ff22c1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff233e3b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09e170 0x7ff22c121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff233e3b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c130ce0 0x7ff22c121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff233e3b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c124fb0 con 0x7ff22c130ce0 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff233e3b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c122920 con 0x7ff22c09e170 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff233e3b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c1230a0 con 0x7ff22c09d860 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff231bd7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09d860 0x7ff22c1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff231bd7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09d860 0x7ff22c1214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46906/0 (socket says 172.21.15.154:46906) 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff231bd7700 1 -- 172.21.15.154:0/3918356227 learned_addr learned my addr 172.21.15.154:0/3918356227 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff2313d6700 1 --2- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09e170 0x7ff22c121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff2323d8700 1 --2- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c130ce0 0x7ff22c121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff231bd7700 1 -- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09e170 msgr2=0x7ff22c121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff231bd7700 1 --2- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09e170 0x7ff22c121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff231bd7700 1 -- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c130ce0 msgr2=0x7ff22c121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff231bd7700 1 --2- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c130ce0 0x7ff22c121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff231bd7700 1 -- 172.21.15.154:0/3918356227 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c00b7f0 con 0x7ff22c09d860 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff231bd7700 1 --2- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09d860 0x7ff22c1214e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff22800e960 tx=0x7ff22800ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.167+0000 7ff2227fc700 1 -- 172.21.15.154:0/3918356227 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228013680 con 0x7ff22c09d860 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.168+0000 7ff2227fc700 1 -- 172.21.15.154:0/3918356227 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280137e0 con 0x7ff22c09d860 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.168+0000 7ff2227fc700 1 -- 172.21.15.154:0/3918356227 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228013b70 con 0x7ff22c09d860 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.168+0000 7ff233e3b700 1 -- 172.21.15.154:0/3918356227 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c0a2320 con 0x7ff22c09d860 2023-09-30T22:26:48.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.168+0000 7ff233e3b700 1 -- 172.21.15.154:0/3918356227 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c123860 con 0x7ff22c09d860 2023-09-30T22:26:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.168+0000 7ff233e3b700 1 -- 172.21.15.154:0/3918356227 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c124b50 con 0x7ff22c09d860 2023-09-30T22:26:48.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.169+0000 7ff2227fc700 1 -- 172.21.15.154:0/3918356227 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff228013cd0 con 0x7ff22c09d860 2023-09-30T22:26:48.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:48.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.169+0000 7ff2227fc700 1 -- 172.21.15.154:0/3918356227 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff22803fe50 con 0x7ff22c09d860 2023-09-30T22:26:48.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.173+0000 7ff2227fc700 1 -- 172.21.15.154:0/3918356227 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff228024350 con 0x7ff22c09d860 2023-09-30T22:26:48.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcc14cc700 1 Processor -- start 2023-09-30T22:26:48.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcc14cc700 1 -- start start 2023-09-30T22:26:48.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcc14cc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbcbc06a770 0x7fbcbc1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcc14cc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc134f00 0x7fbcbc09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcc14cc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 0x7fbcbc09e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcc14cc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc06b2e0 con 0x7fbcbc06a770 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcc14cc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc09eca0 con 0x7fbcbc09dea0 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcc14cc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc09f720 con 0x7fbcbc134f00 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcbaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbcbc06a770 0x7fbcbc1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcbaffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbcbc06a770 0x7fbcbc1349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59852/0 (socket says 172.21.15.154:59852) 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcbaffd700 1 -- 172.21.15.154:0/2465463846 learned_addr learned my addr 172.21.15.154:0/2465463846 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.201+0000 7fbcbb7fe700 1 --2- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 0x7fbcbc09e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.202+0000 7fbcbaffd700 1 -- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc134f00 msgr2=0x7fbcbc09d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.202+0000 7fbcbaffd700 1 --2- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc134f00 0x7fbcbc09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.202+0000 7fbcbaffd700 1 -- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 msgr2=0x7fbcbc09e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:48.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.202+0000 7fbcbaffd700 1 --2- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 0x7fbcbc09e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.202+0000 7fbcbaffd700 1 -- 172.21.15.154:0/2465463846 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc06b480 con 0x7fbcbc06a770 2023-09-30T22:26:48.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.202+0000 7fbcbaffd700 1 --2- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc06a770 0x7fbcbc1349c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fbca40098f0 tx=0x7fbca4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837162b7044c8045 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.202+0000 7fbcb9ffb700 1 -- 172.21.15.154:0/2465463846 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4011830 con 0x7fbcbc06a770 2023-09-30T22:26:48.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.202+0000 7fbcb9ffb700 1 -- 172.21.15.154:0/2465463846 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4011990 con 0x7fbcbc06a770 2023-09-30T22:26:48.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.202+0000 7fbcb9ffb700 1 -- 172.21.15.154:0/2465463846 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4011d20 con 0x7fbcbc06a770 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.203+0000 7fbcc14cc700 1 -- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc06a770 msgr2=0x7fbcbc1349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.203+0000 7fbcc14cc700 1 --2- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc06a770 0x7fbcbc1349c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fbca40098f0 tx=0x7fbca4009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.203+0000 7fbcc14cc700 1 -- 172.21.15.154:0/2465463846 shutdown_connections 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.203+0000 7fbcc14cc700 1 --2- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 0x7fbcbc09e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.203+0000 7fbcc14cc700 1 --2- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc06a770 0x7fbcbc1349c0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.203+0000 7fbcc14cc700 1 --2- 172.21.15.154:0/2465463846 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc134f00 0x7fbcbc09d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.203+0000 7fbcc14cc700 1 -- 172.21.15.154:0/2465463846 >> 172.21.15.154:0/2465463846 conn(0x7fbcbc099c40 msgr2=0x7fbcbc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.203+0000 7fbcc14cc700 1 -- 172.21.15.154:0/2465463846 shutdown_connections 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.203+0000 7fbcc14cc700 1 -- 172.21.15.154:0/2465463846 wait complete. 2023-09-30T22:26:48.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcc14cc700 1 Processor -- start 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcc14cc700 1 -- start start 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcc14cc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc06a770 0x7fbcbc11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcc14cc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 0x7fbcbc11abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcc14cc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc134f00 0x7fbcbc11b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcc14cc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc1267e0 con 0x7fbcbc134f00 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcc14cc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0a0510 con 0x7fbcbc09dea0 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcc14cc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc09f220 con 0x7fbcbc06a770 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcbaffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc06a770 0x7fbcbc11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcbaffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc06a770 0x7fbcbc11a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46924/0 (socket says 172.21.15.154:46924) 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcba7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 0x7fbcbc11abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcbaffd700 1 -- 172.21.15.154:0/345707422 learned_addr learned my addr 172.21.15.154:0/345707422 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.204+0000 7fbcbb7fe700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc134f00 0x7fbcbc11b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcbaffd700 1 -- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 msgr2=0x7fbcbc11abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcbaffd700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 0x7fbcbc11abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcbaffd700 1 -- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc134f00 msgr2=0x7fbcbc11b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcbaffd700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc134f00 0x7fbcbc11b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcbaffd700 1 -- 172.21.15.154:0/345707422 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4009550 con 0x7fbcbc06a770 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcbb7fe700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc134f00 0x7fbcbc11b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcba7fc700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 0x7fbcbc11abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcbaffd700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc06a770 0x7fbcbc11a680 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009c40 tx=0x7fbca4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcb37fe700 1 -- 172.21.15.154:0/345707422 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4004510 con 0x7fbcbc06a770 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcb37fe700 1 -- 172.21.15.154:0/345707422 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca401e070 con 0x7fbcbc06a770 2023-09-30T22:26:48.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcb37fe700 1 -- 172.21.15.154:0/345707422 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40038e0 con 0x7fbcbc06a770 2023-09-30T22:26:48.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcc14cc700 1 -- 172.21.15.154:0/345707422 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc126520 con 0x7fbcbc06a770 2023-09-30T22:26:48.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.205+0000 7fbcc14cc700 1 -- 172.21.15.154:0/345707422 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc126ac0 con 0x7fbcbc06a770 2023-09-30T22:26:48.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.206+0000 7fbcb37fe700 1 -- 172.21.15.154:0/345707422 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbca4003a40 con 0x7fbcbc06a770 2023-09-30T22:26:48.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.206+0000 7fbcb37fe700 1 -- 172.21.15.154:0/345707422 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbca40403f0 con 0x7fbcbc06a770 2023-09-30T22:26:48.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.206+0000 7fbcc14cc700 1 -- 172.21.15.154:0/345707422 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc04f2a0 con 0x7fbcbc06a770 2023-09-30T22:26:48.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.211+0000 7fbcb37fe700 1 -- 172.21.15.154:0/345707422 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbca402d7d0 con 0x7fbcbc06a770 2023-09-30T22:26:48.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.328+0000 7f8e3c02e700 1 -- 172.21.15.154:0/3179576613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e1c005590 con 0x7f8e34130a60 2023-09-30T22:26:48.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.328+0000 7f8e2a7fc700 1 -- 172.21.15.154:0/3179576613 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e2c046020 con 0x7f8e34130a60 2023-09-30T22:26:48.329 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:48.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.330+0000 7f8e3c02e700 1 -- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e34130a60 msgr2=0x7f8e3412d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.330+0000 7f8e3c02e700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e34130a60 0x7f8e3412d890 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8e340a2630 tx=0x7f8e2c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.330+0000 7f8e3c02e700 1 -- 172.21.15.154:0/3179576613 shutdown_connections 2023-09-30T22:26:48.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.330+0000 7f8e3c02e700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e34130a60 0x7f8e3412d890 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.330+0000 7f8e3c02e700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8e34099e20 0x7f8e3412ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.330+0000 7f8e3c02e700 1 --2- 172.21.15.154:0/3179576613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e3409a730 0x7f8e3412d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.330+0000 7f8e3c02e700 1 -- 172.21.15.154:0/3179576613 >> 172.21.15.154:0/3179576613 conn(0x7f8e340a2980 msgr2=0x7f8e3406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.330+0000 7f8e3c02e700 1 -- 172.21.15.154:0/3179576613 shutdown_connections 2023-09-30T22:26:48.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.330+0000 7f8e3c02e700 1 -- 172.21.15.154:0/3179576613 wait complete. 2023-09-30T22:26:48.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:48.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.370+0000 7ff233e3b700 1 -- 172.21.15.154:0/3918356227 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff22c04f2a0 con 0x7ff22c09d860 2023-09-30T22:26:48.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.370+0000 7ff2227fc700 1 -- 172.21.15.154:0/3918356227 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff228017070 con 0x7ff22c09d860 2023-09-30T22:26:48.370 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:48.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.372+0000 7ff233e3b700 1 -- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09d860 msgr2=0x7ff22c1214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.372+0000 7ff233e3b700 1 --2- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09d860 0x7ff22c1214e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff22800e960 tx=0x7ff22800ec70 comp rx=0 tx=0).stop 2023-09-30T22:26:48.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.373+0000 7ff233e3b700 1 -- 172.21.15.154:0/3918356227 shutdown_connections 2023-09-30T22:26:48.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.373+0000 7ff233e3b700 1 --2- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22c130ce0 0x7ff22c121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.373+0000 7ff233e3b700 1 --2- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff22c09d860 0x7ff22c1214e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.373+0000 7ff233e3b700 1 --2- 172.21.15.154:0/3918356227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff22c09e170 0x7ff22c121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.373+0000 7ff233e3b700 1 -- 172.21.15.154:0/3918356227 >> 172.21.15.154:0/3918356227 conn(0x7ff22c099c40 msgr2=0x7ff22c12fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.373+0000 7ff233e3b700 1 -- 172.21.15.154:0/3918356227 shutdown_connections 2023-09-30T22:26:48.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.373+0000 7ff233e3b700 1 -- 172.21.15.154:0/3918356227 wait complete. 2023-09-30T22:26:48.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:48.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.405+0000 7fbcc14cc700 1 -- 172.21.15.154:0/345707422 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcbc09f390 con 0x7fbcbc06a770 2023-09-30T22:26:48.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.405+0000 7fbcb37fe700 1 -- 172.21.15.154:0/345707422 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbca4015020 con 0x7fbcbc06a770 2023-09-30T22:26:48.405 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.407+0000 7fbcc14cc700 1 -- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc06a770 msgr2=0x7fbcbc11a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:48.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.407+0000 7fbcc14cc700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc06a770 0x7fbcbc11a680 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009c40 tx=0x7fbca4004750 comp rx=0 tx=0).stop 2023-09-30T22:26:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.407+0000 7fbcc14cc700 1 -- 172.21.15.154:0/345707422 shutdown_connections 2023-09-30T22:26:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.407+0000 7fbcc14cc700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcbc134f00 0x7fbcbc11b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.407+0000 7fbcc14cc700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbcbc06a770 0x7fbcbc11a680 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.407+0000 7fbcc14cc700 1 --2- 172.21.15.154:0/345707422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbcbc09dea0 0x7fbcbc11abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.407+0000 7fbcc14cc700 1 -- 172.21.15.154:0/345707422 >> 172.21.15.154:0/345707422 conn(0x7fbcbc099c40 msgr2=0x7fbcbc09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.407+0000 7fbcc14cc700 1 -- 172.21.15.154:0/345707422 shutdown_connections 2023-09-30T22:26:48.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:48.407+0000 7fbcc14cc700 1 -- 172.21.15.154:0/345707422 wait complete. 2023-09-30T22:26:48.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:49.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:49.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.309+0000 7fd49bf16700 1 Processor -- start 2023-09-30T22:26:49.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.309+0000 7fd49bf16700 1 -- start start 2023-09-30T22:26:49.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.309+0000 7fd49bf16700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd494133a70 0x7fd494133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.309+0000 7fd49bf16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4940a1470 0x7fd49413b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.309+0000 7fd49bf16700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd494133640 con 0x7fd4940a08e0 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.309+0000 7fd49bf16700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4940a1d50 con 0x7fd494133a70 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.309+0000 7fd49bf16700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49409b620 con 0x7fd4940a1470 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd499cb2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd494133a70 0x7fd494133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd49a4b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4940a1470 0x7fd49413b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd499cb2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd494133a70 0x7fd494133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59874/0 (socket says 172.21.15.154:59874) 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd499cb2700 1 -- 172.21.15.154:0/525770368 learned_addr learned my addr 172.21.15.154:0/525770368 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd49a4b3700 1 -- 172.21.15.154:0/525770368 >> v2:172.21.15.154:3300/0 conn(0x7fd494133a70 msgr2=0x7fd494133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd49a4b3700 1 --2- 172.21.15.154:0/525770368 >> v2:172.21.15.154:3300/0 conn(0x7fd494133a70 0x7fd494133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd49a4b3700 1 -- 172.21.15.154:0/525770368 >> v1:172.21.15.154:6789/0 conn(0x7fd4940a08e0 legacy=0x7fd4940a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd49a4b3700 1 -- 172.21.15.154:0/525770368 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494133870 con 0x7fd4940a1470 2023-09-30T22:26:49.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd498cb0700 1 -- 172.21.15.154:0/525770368 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246074427 0 0) 0x7fd494133640 con 0x7fd4940a08e0 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd499cb2700 1 --2- 172.21.15.154:0/525770368 >> v2:172.21.15.154:3300/0 conn(0x7fd494133a70 0x7fd494133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd49a4b3700 1 --2- 172.21.15.154:0/525770368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4940a1470 0x7fd49413b980 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009d90 tx=0x7fd48c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3438252dd37f0a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd498cb0700 1 -- 172.21.15.154:0/525770368 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00e070 con 0x7fd4940a1470 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd498cb0700 1 -- 172.21.15.154:0/525770368 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00bb20 con 0x7fd4940a1470 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.310+0000 7fd498cb0700 1 -- 172.21.15.154:0/525770368 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c012430 con 0x7fd4940a1470 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.311+0000 7fd49bf16700 1 -- 172.21.15.154:0/525770368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4940a1470 msgr2=0x7fd49413b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.311+0000 7fd49bf16700 1 --2- 172.21.15.154:0/525770368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4940a1470 0x7fd49413b980 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009d90 tx=0x7fd48c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.311+0000 7fd49bf16700 1 -- 172.21.15.154:0/525770368 shutdown_connections 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.311+0000 7fd49bf16700 1 --2- 172.21.15.154:0/525770368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4940a1470 0x7fd49413b980 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.311+0000 7fd49bf16700 1 --2- 172.21.15.154:0/525770368 >> v2:172.21.15.154:3300/0 conn(0x7fd494133a70 0x7fd494133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.311+0000 7fd49bf16700 1 -- 172.21.15.154:0/525770368 >> 172.21.15.154:0/525770368 conn(0x7fd4940a2980 msgr2=0x7fd4940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.311+0000 7fd49bf16700 1 -- 172.21.15.154:0/525770368 shutdown_connections 2023-09-30T22:26:49.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.311+0000 7fd49bf16700 1 -- 172.21.15.154:0/525770368 wait complete. 2023-09-30T22:26:49.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.312+0000 7fd49bf16700 1 Processor -- start 2023-09-30T22:26:49.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.312+0000 7fd49bf16700 1 -- start start 2023-09-30T22:26:49.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd49bf16700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4940a08e0 0x7fd49411a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd49bf16700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4940a1470 0x7fd49411ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd49bf16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd494133a70 0x7fd49411b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd49bf16700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49411dc90 con 0x7fd4940a1470 2023-09-30T22:26:49.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd49bf16700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49411c430 con 0x7fd494133a70 2023-09-30T22:26:49.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd49bf16700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd49409a350 con 0x7fd4940a08e0 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd4994b1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4940a1470 0x7fd49411ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd49a4b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd494133a70 0x7fd49411b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd499cb2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4940a08e0 0x7fd49411a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd4994b1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4940a1470 0x7fd49411ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59876/0 (socket says 172.21.15.154:59876) 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd4994b1700 1 -- 172.21.15.154:0/3398703 learned_addr learned my addr 172.21.15.154:0/3398703 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd49a4b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd494133a70 0x7fd49411b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38382/0 (socket says 172.21.15.154:38382) 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd499cb2700 1 -- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd494133a70 msgr2=0x7fd49411b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd499cb2700 1 --2- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd494133a70 0x7fd49411b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd499cb2700 1 -- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4940a1470 msgr2=0x7fd49411ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd499cb2700 1 --2- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4940a1470 0x7fd49411ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd499cb2700 1 -- 172.21.15.154:0/3398703 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd490009500 con 0x7fd4940a08e0 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd49a4b3700 1 --2- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd494133a70 0x7fd49411b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd4994b1700 1 --2- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4940a1470 0x7fd49411ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.313+0000 7fd499cb2700 1 --2- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4940a08e0 0x7fd49411a710 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd49000ebb0 tx=0x7fd49000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.314+0000 7fd48a7fc700 1 -- 172.21.15.154:0/3398703 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490005a20 con 0x7fd4940a08e0 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.314+0000 7fd48a7fc700 1 -- 172.21.15.154:0/3398703 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490005b80 con 0x7fd4940a08e0 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.314+0000 7fd49bf16700 1 -- 172.21.15.154:0/3398703 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c009a70 con 0x7fd4940a08e0 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.314+0000 7fd48a7fc700 1 -- 172.21.15.154:0/3398703 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000c850 con 0x7fd4940a08e0 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.314+0000 7fd49bf16700 1 -- 172.21.15.154:0/3398703 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49411d120 con 0x7fd4940a08e0 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.314+0000 7fd48a7fc700 1 -- 172.21.15.154:0/3398703 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd49000c9b0 con 0x7fd4940a08e0 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.314+0000 7fd48a7fc700 1 -- 172.21.15.154:0/3398703 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd49003f9b0 con 0x7fd4940a08e0 2023-09-30T22:26:49.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.315+0000 7fd49bf16700 1 -- 172.21.15.154:0/3398703 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49409e9b0 con 0x7fd4940a08e0 2023-09-30T22:26:49.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.319+0000 7fd48a7fc700 1 -- 172.21.15.154:0/3398703 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd490020080 con 0x7fd4940a08e0 2023-09-30T22:26:49.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:49.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:49.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:49.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.472+0000 7ff899e5c700 1 Processor -- start 2023-09-30T22:26:49.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.472+0000 7ff899e5c700 1 -- start start 2023-09-30T22:26:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff899e5c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 0x7ff894133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff899e5c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff894133f70 0x7ff8941343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff899e5c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89409b110 con 0x7ff8940a0a70 2023-09-30T22:26:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff899e5c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940a3b60 con 0x7ff89409ad40 2023-09-30T22:26:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff899e5c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8941348e0 con 0x7ff894133f70 2023-09-30T22:26:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff893fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff8940a0a70 0x7ff8940a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33046/0 (socket says 172.21.15.154:33046) 2023-09-30T22:26:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff893fff700 1 -- 172.21.15.154:0/2391086602 learned_addr learned my addr 172.21.15.154:0/2391086602 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:49.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff892ffd700 1 --2- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff894133f70 0x7ff8941343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff8937fe700 1 --2- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 0x7ff894133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff892ffd700 1 -- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 msgr2=0x7ff894133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff892ffd700 1 --2- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 0x7ff894133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff892ffd700 1 -- 172.21.15.154:0/2391086602 >> v1:172.21.15.154:6789/0 conn(0x7ff8940a0a70 legacy=0x7ff8940a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff892ffd700 1 -- 172.21.15.154:0/2391086602 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940a2fa0 con 0x7ff894133f70 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.473+0000 7ff8937fe700 1 --2- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 0x7ff894133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.474+0000 7ff892ffd700 1 --2- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff894133f70 0x7ff8941343a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff888009870 tx=0x7ff888009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9786d3e34b69113c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.474+0000 7ff8927fc700 1 -- 172.21.15.154:0/2391086602 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888011830 con 0x7ff894133f70 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.474+0000 7ff8927fc700 1 -- 172.21.15.154:0/2391086602 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff888011990 con 0x7ff894133f70 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.474+0000 7ff8927fc700 1 -- 172.21.15.154:0/2391086602 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888011d20 con 0x7ff894133f70 2023-09-30T22:26:49.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.475+0000 7ff899e5c700 1 -- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff894133f70 msgr2=0x7ff8941343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.475+0000 7ff899e5c700 1 --2- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff894133f70 0x7ff8941343a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff888009870 tx=0x7ff888009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.475+0000 7ff899e5c700 1 -- 172.21.15.154:0/2391086602 shutdown_connections 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.475+0000 7ff899e5c700 1 --2- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 0x7ff894133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.475+0000 7ff899e5c700 1 --2- 172.21.15.154:0/2391086602 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff894133f70 0x7ff8941343a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.475+0000 7ff899e5c700 1 -- 172.21.15.154:0/2391086602 >> 172.21.15.154:0/2391086602 conn(0x7ff894099c40 msgr2=0x7ff89406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.475+0000 7ff899e5c700 1 -- 172.21.15.154:0/2391086602 shutdown_connections 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.475+0000 7ff899e5c700 1 -- 172.21.15.154:0/2391086602 wait complete. 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.476+0000 7ff899e5c700 1 Processor -- start 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.476+0000 7ff899e5c700 1 -- start start 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.476+0000 7ff899e5c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 0x7ff89411e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.476+0000 7ff899e5c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8940a0a70 0x7ff89411e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.476+0000 7ff899e5c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff894133f70 0x7ff89411eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.476+0000 7ff899e5c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8941225a0 con 0x7ff894133f70 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.476+0000 7ff899e5c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89411fcd0 con 0x7ff89409ad40 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.476+0000 7ff899e5c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff894120f20 con 0x7ff8940a0a70 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.476+0000 7ff893fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff894133f70 0x7ff89411eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff893fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff894133f70 0x7ff89411eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59886/0 (socket says 172.21.15.154:59886) 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff893fff700 1 -- 172.21.15.154:0/24051657 learned_addr learned my addr 172.21.15.154:0/24051657 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff892ffd700 1 --2- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8940a0a70 0x7ff89411e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff8937fe700 1 --2- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 0x7ff89411e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff893fff700 1 -- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8940a0a70 msgr2=0x7ff89411e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff893fff700 1 --2- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8940a0a70 0x7ff89411e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff893fff700 1 -- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 msgr2=0x7ff89411e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff893fff700 1 --2- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 0x7ff89411e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff893fff700 1 -- 172.21.15.154:0/24051657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840094a0 con 0x7ff894133f70 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff893fff700 1 --2- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff894133f70 0x7ff89411eb40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00cbf0 tx=0x7ff88c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff87bfff700 1 -- 172.21.15.154:0/24051657 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00ab10 con 0x7ff894133f70 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff87bfff700 1 -- 172.21.15.154:0/24051657 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c00ac70 con 0x7ff894133f70 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff899e5c700 1 -- 172.21.15.154:0/24051657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8880094a0 con 0x7ff894133f70 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.477+0000 7ff87bfff700 1 -- 172.21.15.154:0/24051657 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c012400 con 0x7ff894133f70 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.478+0000 7ff899e5c700 1 -- 172.21.15.154:0/24051657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8940a1040 con 0x7ff894133f70 2023-09-30T22:26:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.479+0000 7ff899e5c700 1 -- 172.21.15.154:0/24051657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89409c840 con 0x7ff894133f70 2023-09-30T22:26:49.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.480+0000 7ff87bfff700 1 -- 172.21.15.154:0/24051657 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff88c01b3b0 con 0x7ff894133f70 2023-09-30T22:26:49.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.480+0000 7ff87bfff700 1 -- 172.21.15.154:0/24051657 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff88c03f7c0 con 0x7ff894133f70 2023-09-30T22:26:49.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.484+0000 7ff87bfff700 1 -- 172.21.15.154:0/24051657 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff88c0192c0 con 0x7ff894133f70 2023-09-30T22:26:49.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.514+0000 7fa7c7f01700 1 Processor -- start 2023-09-30T22:26:49.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c7f01700 1 -- start start 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c7f01700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 0x7fa7c009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c7f01700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7c0131f40 0x7fa7c0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c7f01700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c009c970 con 0x7fa7c009f180 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c7f01700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c00a0920 con 0x7fa7c0131f40 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c7f01700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c009f9c0 con 0x7fa7c009e870 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c549c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa7c009f180 0x7fa7c0131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33048/0 (socket says 172.21.15.154:33048) 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c549c700 1 -- 172.21.15.154:0/3228560160 learned_addr learned my addr 172.21.15.154:0/3228560160 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c5c9d700 1 --2- 172.21.15.154:0/3228560160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 0x7fa7c009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.515+0000 7fa7c649e700 1 --2- 172.21.15.154:0/3228560160 >> v2:172.21.15.154:3300/0 conn(0x7fa7c0131f40 0x7fa7c0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.516+0000 7fa7c5c9d700 1 -- 172.21.15.154:0/3228560160 >> v2:172.21.15.154:3300/0 conn(0x7fa7c0131f40 msgr2=0x7fa7c0139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.516+0000 7fa7c5c9d700 1 --2- 172.21.15.154:0/3228560160 >> v2:172.21.15.154:3300/0 conn(0x7fa7c0131f40 0x7fa7c0139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.516+0000 7fa7c5c9d700 1 -- 172.21.15.154:0/3228560160 >> v1:172.21.15.154:6789/0 conn(0x7fa7c009f180 legacy=0x7fa7c0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.516+0000 7fa7c5c9d700 1 -- 172.21.15.154:0/3228560160 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c009bab0 con 0x7fa7c009e870 2023-09-30T22:26:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.516+0000 7fa7c649e700 1 --2- 172.21.15.154:0/3228560160 >> v2:172.21.15.154:3300/0 conn(0x7fa7c0131f40 0x7fa7c0139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.516+0000 7fa7c5c9d700 1 --2- 172.21.15.154:0/3228560160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 0x7fa7c009ec40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009840 tx=0x7fa7bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60181e109e5ccd15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.516+0000 7fa7c4c9b700 1 -- 172.21.15.154:0/3228560160 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc011830 con 0x7fa7c009e870 2023-09-30T22:26:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.516+0000 7fa7c4c9b700 1 -- 172.21.15.154:0/3228560160 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc011990 con 0x7fa7c009e870 2023-09-30T22:26:49.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.516+0000 7fa7c4c9b700 1 -- 172.21.15.154:0/3228560160 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc011d20 con 0x7fa7c009e870 2023-09-30T22:26:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.517+0000 7fa7c7f01700 1 -- 172.21.15.154:0/3228560160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 msgr2=0x7fa7c009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.517+0000 7fa7c7f01700 1 --2- 172.21.15.154:0/3228560160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 0x7fa7c009ec40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009840 tx=0x7fa7bc009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.517+0000 7fa7c7f01700 1 -- 172.21.15.154:0/3228560160 shutdown_connections 2023-09-30T22:26:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.517+0000 7fa7c7f01700 1 --2- 172.21.15.154:0/3228560160 >> v2:172.21.15.154:3300/0 conn(0x7fa7c0131f40 0x7fa7c0139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.517+0000 7fa7c7f01700 1 --2- 172.21.15.154:0/3228560160 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 0x7fa7c009ec40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.517+0000 7fa7c7f01700 1 -- 172.21.15.154:0/3228560160 >> 172.21.15.154:0/3228560160 conn(0x7fa7c00a4430 msgr2=0x7fa7c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.517+0000 7fa7c7f01700 1 -- 172.21.15.154:0/3228560160 shutdown_connections 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.517+0000 7fa7c7f01700 1 -- 172.21.15.154:0/3228560160 wait complete. 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c7f01700 1 Processor -- start 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c7f01700 1 -- start start 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c7f01700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 0x7fa7c01202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c7f01700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c009f180 0x7fa7c0120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c7f01700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c0131f40 0x7fa7c0120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c7f01700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0122da0 con 0x7fa7c0131f40 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c7f01700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0122090 con 0x7fa7c009f180 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c7f01700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0121ea0 con 0x7fa7c009e870 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c549c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c009f180 0x7fa7c0120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.518+0000 7fa7c549c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c009f180 0x7fa7c0120810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38414/0 (socket says 172.21.15.154:38414) 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c549c700 1 -- 172.21.15.154:0/1312519426 learned_addr learned my addr 172.21.15.154:0/1312519426 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c5c9d700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 0x7fa7c01202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c649e700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c0131f40 0x7fa7c0120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c549c700 1 -- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 msgr2=0x7fa7c01202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c549c700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 0x7fa7c01202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c549c700 1 -- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c0131f40 msgr2=0x7fa7c0120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c549c700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c0131f40 0x7fa7c0120d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c549c700 1 -- 172.21.15.154:0/1312519426 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8009a70 con 0x7fa7c009f180 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c649e700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c0131f40 0x7fa7c0120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7c549c700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c009f180 0x7fa7c0120810 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c500 tx=0x7fa7b000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7b67fc700 1 -- 172.21.15.154:0/1312519426 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0005d70 con 0x7fa7c009f180 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7b67fc700 1 -- 172.21.15.154:0/1312519426 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b00070d0 con 0x7fa7c009f180 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.519+0000 7fa7b67fc700 1 -- 172.21.15.154:0/1312519426 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0007440 con 0x7fa7c009f180 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.520+0000 7fa7c7f01700 1 -- 172.21.15.154:0/1312519426 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc0094a0 con 0x7fa7c009f180 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.520+0000 7fa7c7f01700 1 -- 172.21.15.154:0/1312519426 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c01230f0 con 0x7fa7c009f180 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.521+0000 7fa7b67fc700 1 -- 172.21.15.154:0/1312519426 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7b00075a0 con 0x7fa7c009f180 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.521+0000 7fa7b67fc700 1 -- 172.21.15.154:0/1312519426 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa7b003ea00 con 0x7fa7c009f180 2023-09-30T22:26:49.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.521+0000 7fa7c7f01700 1 -- 172.21.15.154:0/1312519426 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c011d580 con 0x7fa7c009f180 2023-09-30T22:26:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.524+0000 7fd49bf16700 1 -- 172.21.15.154:0/3398703 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd49411de00 con 0x7fd4940a08e0 2023-09-30T22:26:49.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.525+0000 7fd48a7fc700 1 -- 172.21.15.154:0/3398703 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd490022300 con 0x7fd4940a08e0 2023-09-30T22:26:49.524 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:49.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.526+0000 7fa7b67fc700 1 -- 172.21.15.154:0/1312519426 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7b0017080 con 0x7fa7c009f180 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.527+0000 7fd49bf16700 1 -- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4940a08e0 msgr2=0x7fd49411a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.527+0000 7fd49bf16700 1 --2- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4940a08e0 0x7fd49411a710 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd49000ebb0 tx=0x7fd49000eec0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.528+0000 7fd49bf16700 1 -- 172.21.15.154:0/3398703 shutdown_connections 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.528+0000 7fd49bf16700 1 --2- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd494133a70 0x7fd49411b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.528+0000 7fd49bf16700 1 --2- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd4940a08e0 0x7fd49411a710 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.528+0000 7fd49bf16700 1 --2- 172.21.15.154:0/3398703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4940a1470 0x7fd49411ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.528+0000 7fd49bf16700 1 -- 172.21.15.154:0/3398703 >> 172.21.15.154:0/3398703 conn(0x7fd4940a2980 msgr2=0x7fd49412f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.528+0000 7fd49bf16700 1 -- 172.21.15.154:0/3398703 shutdown_connections 2023-09-30T22:26:49.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.528+0000 7fd49bf16700 1 -- 172.21.15.154:0/3398703 wait complete. 2023-09-30T22:26:49.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:49.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.561+0000 7fc28ad9c700 1 Processor -- start 2023-09-30T22:26:49.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.561+0000 7fc28ad9c700 1 -- start start 2023-09-30T22:26:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.561+0000 7fc28ad9c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc284099e20 0x7fc28409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.561+0000 7fc28ad9c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc28409a730 0x7fc284130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.561+0000 7fc28ad9c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc284099a60 con 0x7fc284130890 2023-09-30T22:26:49.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.561+0000 7fc28ad9c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28409bf50 con 0x7fc28409a730 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.561+0000 7fc28ad9c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc28409b230 con 0x7fc284099e20 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc283fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc28409a730 0x7fc284130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc288b38700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc284099e20 0x7fc28409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc283fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc28409a730 0x7fc284130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38426/0 (socket says 172.21.15.154:38426) 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc288b38700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc284099e20 0x7fc28409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:46992/0 (socket says 172.21.15.154:46992) 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc289339700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc284130890 0x7fc284137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33062/0 (socket says 172.21.15.154:33062) 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc283fff700 1 -- 172.21.15.154:0/1277723240 learned_addr learned my addr 172.21.15.154:0/1277723240 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc288b38700 1 -- 172.21.15.154:0/1277723240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc28409a730 msgr2=0x7fc284130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc288b38700 1 --2- 172.21.15.154:0/1277723240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc28409a730 0x7fc284130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc2837fe700 1 -- 172.21.15.154:0/1277723240 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136261835 0 0) 0x7fc284099a60 con 0x7fc284130890 2023-09-30T22:26:49.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc288b38700 1 -- 172.21.15.154:0/1277723240 >> v1:172.21.15.154:6789/0 conn(0x7fc284130890 legacy=0x7fc284137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc288b38700 1 -- 172.21.15.154:0/1277723240 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28409bb90 con 0x7fc284099e20 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc288b38700 1 --2- 172.21.15.154:0/1277723240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc284099e20 0x7fc28409a1f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc278009880 tx=0x7fc278009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f0e7b6e035ab1f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc2837fe700 1 -- 172.21.15.154:0/1277723240 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc278005e30 con 0x7fc284099e20 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc2837fe700 1 -- 172.21.15.154:0/1277723240 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc278006030 con 0x7fc284099e20 2023-09-30T22:26:49.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.562+0000 7fc2837fe700 1 -- 172.21.15.154:0/1277723240 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780063c0 con 0x7fc284099e20 2023-09-30T22:26:49.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.563+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1277723240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc284099e20 msgr2=0x7fc28409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.563+0000 7fc28ad9c700 1 --2- 172.21.15.154:0/1277723240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc284099e20 0x7fc28409a1f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc278009880 tx=0x7fc278009b90 comp rx=0 tx=0).stop 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.563+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1277723240 shutdown_connections 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.563+0000 7fc28ad9c700 1 --2- 172.21.15.154:0/1277723240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc284099e20 0x7fc28409a1f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.563+0000 7fc28ad9c700 1 --2- 172.21.15.154:0/1277723240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc28409a730 0x7fc284130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.563+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1277723240 >> 172.21.15.154:0/1277723240 conn(0x7fc2840a2980 msgr2=0x7fc2840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.563+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1277723240 shutdown_connections 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.563+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1277723240 wait complete. 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.564+0000 7fc28ad9c700 1 Processor -- start 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.564+0000 7fc28ad9c700 1 -- start start 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc28ad9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284099e20 0x7fc28411ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc28ad9c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc28409a730 0x7fc28411f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc28ad9c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc284130890 0x7fc28411f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc28ad9c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2841206a0 con 0x7fc284099e20 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc28ad9c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc284130240 con 0x7fc284130890 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc28ad9c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc28409b470 con 0x7fc28409a730 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc288b38700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284099e20 0x7fc28411ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc288b38700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284099e20 0x7fc28411ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59910/0 (socket says 172.21.15.154:59910) 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc288b38700 1 -- 172.21.15.154:0/1890276409 learned_addr learned my addr 172.21.15.154:0/1890276409 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc289339700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc284130890 0x7fc28411f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.565+0000 7fc283fff700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc28409a730 0x7fc28411f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc288b38700 1 -- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc28409a730 msgr2=0x7fc28411f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc288b38700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc28409a730 0x7fc28411f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc288b38700 1 -- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc284130890 msgr2=0x7fc28411f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc288b38700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc284130890 0x7fc28411f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc288b38700 1 -- 172.21.15.154:0/1890276409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278009430 con 0x7fc284099e20 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc289339700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc284130890 0x7fc28411f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc283fff700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc28409a730 0x7fc28411f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc288b38700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284099e20 0x7fc28411ebd0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc278009bd0 tx=0x7fc278004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc2817fa700 1 -- 172.21.15.154:0/1890276409 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27801f070 con 0x7fc284099e20 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc2817fa700 1 -- 172.21.15.154:0/1890276409 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc278004050 con 0x7fc284099e20 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1890276409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc284122010 con 0x7fc284099e20 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc2817fa700 1 -- 172.21.15.154:0/1890276409 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780043e0 con 0x7fc284099e20 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.566+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1890276409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc284122d40 con 0x7fc284099e20 2023-09-30T22:26:49.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.567+0000 7fc2817fa700 1 -- 172.21.15.154:0/1890276409 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2780036a0 con 0x7fc284099e20 2023-09-30T22:26:49.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.567+0000 7fc2817fa700 1 -- 172.21.15.154:0/1890276409 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc278040a50 con 0x7fc284099e20 2023-09-30T22:26:49.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.567+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1890276409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284072480 con 0x7fc284099e20 2023-09-30T22:26:49.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.572+0000 7fc2817fa700 1 -- 172.21.15.154:0/1890276409 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc284072480 con 0x7fc284099e20 2023-09-30T22:26:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.697+0000 7ff899e5c700 1 -- 172.21.15.154:0/24051657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff8940a58b0 con 0x7ff894133f70 2023-09-30T22:26:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.698+0000 7ff87bfff700 1 -- 172.21.15.154:0/24051657 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff88c017070 con 0x7ff894133f70 2023-09-30T22:26:49.698 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.700+0000 7ff899e5c700 1 -- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff894133f70 msgr2=0x7ff89411eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.700+0000 7ff899e5c700 1 --2- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff894133f70 0x7ff89411eb40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00cbf0 tx=0x7ff88c00cf00 comp rx=0 tx=0).stop 2023-09-30T22:26:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.700+0000 7ff899e5c700 1 -- 172.21.15.154:0/24051657 shutdown_connections 2023-09-30T22:26:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.700+0000 7ff899e5c700 1 --2- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff894133f70 0x7ff89411eb40 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.700+0000 7ff899e5c700 1 --2- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff89409ad40 0x7ff89411e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.700+0000 7ff899e5c700 1 --2- 172.21.15.154:0/24051657 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff8940a0a70 0x7ff89411e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.700+0000 7ff899e5c700 1 -- 172.21.15.154:0/24051657 >> 172.21.15.154:0/24051657 conn(0x7ff894099c40 msgr2=0x7ff894133110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.700+0000 7ff899e5c700 1 -- 172.21.15.154:0/24051657 shutdown_connections 2023-09-30T22:26:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.700+0000 7ff899e5c700 1 -- 172.21.15.154:0/24051657 wait complete. 2023-09-30T22:26:49.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.732+0000 7fa7c7f01700 1 -- 172.21.15.154:0/1312519426 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7c0123540 con 0x7fa7c009f180 2023-09-30T22:26:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.733+0000 7fa7b67fc700 1 -- 172.21.15.154:0/1312519426 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7b0019d20 con 0x7fa7c009f180 2023-09-30T22:26:49.733 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:49.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.735+0000 7fa7c7f01700 1 -- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c009f180 msgr2=0x7fa7c0120810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.735+0000 7fa7c7f01700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c009f180 0x7fa7c0120810 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c500 tx=0x7fa7b000c810 comp rx=0 tx=0).stop 2023-09-30T22:26:49.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.735+0000 7fa7c7f01700 1 -- 172.21.15.154:0/1312519426 shutdown_connections 2023-09-30T22:26:49.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.735+0000 7fa7c7f01700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c0131f40 0x7fa7c0120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.735+0000 7fa7c7f01700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa7c009e870 0x7fa7c01202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.735+0000 7fa7c7f01700 1 --2- 172.21.15.154:0/1312519426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7c009f180 0x7fa7c0120810 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.735+0000 7fa7c7f01700 1 -- 172.21.15.154:0/1312519426 >> 172.21.15.154:0/1312519426 conn(0x7fa7c00a4430 msgr2=0x7fa7c011a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.735+0000 7fa7c7f01700 1 -- 172.21.15.154:0/1312519426 shutdown_connections 2023-09-30T22:26:49.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.735+0000 7fa7c7f01700 1 -- 172.21.15.154:0/1312519426 wait complete. 2023-09-30T22:26:49.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:49.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.765+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1890276409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc284072480 con 0x7fc284099e20 2023-09-30T22:26:49.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.765+0000 7fc2817fa700 1 -- 172.21.15.154:0/1890276409 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc284072480 con 0x7fc284099e20 2023-09-30T22:26:49.765 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:49.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.767+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284099e20 msgr2=0x7fc28411ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:49.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.767+0000 7fc28ad9c700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284099e20 0x7fc28411ebd0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc278009bd0 tx=0x7fc278004750 comp rx=0 tx=0).stop 2023-09-30T22:26:49.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.767+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1890276409 shutdown_connections 2023-09-30T22:26:49.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.767+0000 7fc28ad9c700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc284130890 0x7fc28411f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.767+0000 7fc28ad9c700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc284099e20 0x7fc28411ebd0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.767+0000 7fc28ad9c700 1 --2- 172.21.15.154:0/1890276409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc28409a730 0x7fc28411f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.767+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1890276409 >> 172.21.15.154:0/1890276409 conn(0x7fc2840a2980 msgr2=0x7fc28412d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.767+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1890276409 shutdown_connections 2023-09-30T22:26:49.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:49.767+0000 7fc28ad9c700 1 -- 172.21.15.154:0/1890276409 wait complete. 2023-09-30T22:26:49.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:50.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:50.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.674+0000 7f78af52d700 1 Processor -- start 2023-09-30T22:26:50.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.674+0000 7f78af52d700 1 -- start start 2023-09-30T22:26:50.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.674+0000 7f78af52d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809e870 0x7f78a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.674+0000 7f78af52d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a809f180 0x7f78a8133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.674+0000 7f78af52d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a809fa00 con 0x7f78a8134160 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.674+0000 7f78af52d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80a0370 con 0x7f78a809f180 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.674+0000 7f78af52d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a806bec0 con 0x7f78a809e870 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.674+0000 7f78ad2c9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809e870 0x7f78a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.674+0000 7f78adaca700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f78a8134160 0x7f78a813ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33072/0 (socket says 172.21.15.154:33072) 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f78adaca700 1 -- 172.21.15.154:0/1126493949 learned_addr learned my addr 172.21.15.154:0/1126493949 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f78acac8700 1 --2- 172.21.15.154:0/1126493949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a809f180 0x7f78a8133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f789ffff700 1 -- 172.21.15.154:0/1126493949 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167928436 0 0) 0x7f78a809fa00 con 0x7f78a8134160 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f78ad2c9700 1 -- 172.21.15.154:0/1126493949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a809f180 msgr2=0x7f78a8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f78ad2c9700 1 --2- 172.21.15.154:0/1126493949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a809f180 0x7f78a8133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f78ad2c9700 1 -- 172.21.15.154:0/1126493949 >> v1:172.21.15.154:6789/0 conn(0x7f78a8134160 legacy=0x7f78a813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f78ad2c9700 1 -- 172.21.15.154:0/1126493949 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a809ada0 con 0x7f78a809e870 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f78acac8700 1 --2- 172.21.15.154:0/1126493949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a809f180 0x7f78a8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f78ad2c9700 1 --2- 172.21.15.154:0/1126493949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809e870 0x7f78a809ec40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f78980098a0 tx=0x7f7898009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ea96473cb5f291b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f789ffff700 1 -- 172.21.15.154:0/1126493949 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898011830 con 0x7f78a809e870 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f789ffff700 1 -- 172.21.15.154:0/1126493949 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7898011990 con 0x7f78a809e870 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.675+0000 7f789ffff700 1 -- 172.21.15.154:0/1126493949 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898011d20 con 0x7f78a809e870 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.676+0000 7f78af52d700 1 -- 172.21.15.154:0/1126493949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809e870 msgr2=0x7f78a809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.676+0000 7f78af52d700 1 --2- 172.21.15.154:0/1126493949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809e870 0x7f78a809ec40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f78980098a0 tx=0x7f7898009bb0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.676+0000 7f78af52d700 1 -- 172.21.15.154:0/1126493949 shutdown_connections 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.676+0000 7f78af52d700 1 --2- 172.21.15.154:0/1126493949 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809e870 0x7f78a809ec40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.676+0000 7f78af52d700 1 --2- 172.21.15.154:0/1126493949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a809f180 0x7f78a8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.676+0000 7f78af52d700 1 -- 172.21.15.154:0/1126493949 >> 172.21.15.154:0/1126493949 conn(0x7f78a80a4430 msgr2=0x7f78a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.676+0000 7f78af52d700 1 -- 172.21.15.154:0/1126493949 shutdown_connections 2023-09-30T22:26:50.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.676+0000 7f78af52d700 1 -- 172.21.15.154:0/1126493949 wait complete. 2023-09-30T22:26:50.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78af52d700 1 Processor -- start 2023-09-30T22:26:50.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78af52d700 1 -- start start 2023-09-30T22:26:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78af52d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a809e870 0x7f78a81229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78af52d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809f180 0x7f78a8122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78af52d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a8134160 0x7f78a8123450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78af52d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81264a0 con 0x7f78a809e870 2023-09-30T22:26:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78af52d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8125c10 con 0x7f78a8134160 2023-09-30T22:26:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78af52d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80a1650 con 0x7f78a809f180 2023-09-30T22:26:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78ad2c9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a809e870 0x7f78a81229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78ad2c9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a809e870 0x7f78a81229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59914/0 (socket says 172.21.15.154:59914) 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78acac8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809f180 0x7f78a8122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78ad2c9700 1 -- 172.21.15.154:0/2531338803 learned_addr learned my addr 172.21.15.154:0/2531338803 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.677+0000 7f78adaca700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a8134160 0x7f78a8123450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78acac8700 1 -- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a8134160 msgr2=0x7f78a8123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78acac8700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a8134160 0x7f78a8123450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78acac8700 1 -- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a809e870 msgr2=0x7f78a81229d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78acac8700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a809e870 0x7f78a81229d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78acac8700 1 -- 172.21.15.154:0/2531338803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40094a0 con 0x7f78a809f180 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78ad2c9700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a809e870 0x7f78a81229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78adaca700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a8134160 0x7f78a8123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78acac8700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809f180 0x7f78a8122f10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f78a400e980 tx=0x7f78a400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f789dffb700 1 -- 172.21.15.154:0/2531338803 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400c690 con 0x7f78a809f180 2023-09-30T22:26:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f789dffb700 1 -- 172.21.15.154:0/2531338803 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a400c7f0 con 0x7f78a809f180 2023-09-30T22:26:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78af52d700 1 -- 172.21.15.154:0/2531338803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78980094a0 con 0x7f78a809f180 2023-09-30T22:26:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f789dffb700 1 -- 172.21.15.154:0/2531338803 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400cb80 con 0x7f78a809f180 2023-09-30T22:26:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.678+0000 7f78af52d700 1 -- 172.21.15.154:0/2531338803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a8125f00 con 0x7f78a809f180 2023-09-30T22:26:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.679+0000 7f789dffb700 1 -- 172.21.15.154:0/2531338803 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78a400cce0 con 0x7f78a809f180 2023-09-30T22:26:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.679+0000 7f789dffb700 1 -- 172.21.15.154:0/2531338803 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78a403f750 con 0x7f78a809f180 2023-09-30T22:26:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.679+0000 7f78af52d700 1 -- 172.21.15.154:0/2531338803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a806cfa0 con 0x7f78a809f180 2023-09-30T22:26:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.684+0000 7f789dffb700 1 -- 172.21.15.154:0/2531338803 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78a40232f0 con 0x7f78a809f180 2023-09-30T22:26:50.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:50.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:50.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.851+0000 7f14150f3700 1 Processor -- start 2023-09-30T22:26:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.851+0000 7f14150f3700 1 -- start start 2023-09-30T22:26:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.851+0000 7f14150f3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14100a0a30 0x7f14100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.851+0000 7f14150f3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1410130670 0x7f14101381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.851+0000 7f14150f3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100a1e70 con 0x7f14100a1340 2023-09-30T22:26:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.851+0000 7f14150f3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141009a720 con 0x7f14100a0a30 2023-09-30T22:26:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.851+0000 7f14150f3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141009b300 con 0x7f1410130670 2023-09-30T22:26:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.851+0000 7f140ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14100a0a30 0x7f14100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14100a0a30 0x7f14100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59916/0 (socket says 172.21.15.154:59916) 2023-09-30T22:26:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140ed9d700 1 -- 172.21.15.154:0/68669256 learned_addr learned my addr 172.21.15.154:0/68669256 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140f59e700 1 --2- 172.21.15.154:0/68669256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1410130670 0x7f14101381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140f59e700 1 -- 172.21.15.154:0/68669256 >> v2:172.21.15.154:3300/0 conn(0x7f14100a0a30 msgr2=0x7f14100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140f59e700 1 --2- 172.21.15.154:0/68669256 >> v2:172.21.15.154:3300/0 conn(0x7f14100a0a30 0x7f14100a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140f59e700 1 -- 172.21.15.154:0/68669256 >> v1:172.21.15.154:6789/0 conn(0x7f14100a1340 legacy=0x7f141012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140f59e700 1 -- 172.21.15.154:0/68669256 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141009abc0 con 0x7f1410130670 2023-09-30T22:26:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140f59e700 1 --2- 172.21.15.154:0/68669256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1410130670 0x7f14101381c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1408009d90 tx=0x7f140800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=335da347c39fc2cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140dd9b700 1 -- 172.21.15.154:0/68669256 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140800e070 con 0x7f1410130670 2023-09-30T22:26:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140dd9b700 1 -- 172.21.15.154:0/68669256 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140800bb20 con 0x7f1410130670 2023-09-30T22:26:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.852+0000 7f140dd9b700 1 -- 172.21.15.154:0/68669256 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408012430 con 0x7f1410130670 2023-09-30T22:26:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.853+0000 7f14150f3700 1 -- 172.21.15.154:0/68669256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1410130670 msgr2=0x7f14101381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.853+0000 7f14150f3700 1 --2- 172.21.15.154:0/68669256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1410130670 0x7f14101381c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1408009d90 tx=0x7f140800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.853+0000 7f14150f3700 1 -- 172.21.15.154:0/68669256 shutdown_connections 2023-09-30T22:26:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.853+0000 7f14150f3700 1 --2- 172.21.15.154:0/68669256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1410130670 0x7f14101381c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.853+0000 7f14150f3700 1 --2- 172.21.15.154:0/68669256 >> v2:172.21.15.154:3300/0 conn(0x7f14100a0a30 0x7f14100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.853+0000 7f14150f3700 1 -- 172.21.15.154:0/68669256 >> 172.21.15.154:0/68669256 conn(0x7f14100a2980 msgr2=0x7f14100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.853+0000 7f14150f3700 1 -- 172.21.15.154:0/68669256 shutdown_connections 2023-09-30T22:26:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.853+0000 7f14150f3700 1 -- 172.21.15.154:0/68669256 wait complete. 2023-09-30T22:26:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f14150f3700 1 Processor -- start 2023-09-30T22:26:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f14150f3700 1 -- start start 2023-09-30T22:26:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f14150f3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14100a0a30 0x7f14101c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f14150f3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14100a1340 0x7f14101c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f14150f3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1410130670 0x7f14101c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f14150f3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141009ae00 con 0x7f1410130670 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f14150f3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1410120ab0 con 0x7f14100a0a30 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f14150f3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1410071a80 con 0x7f14100a1340 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f140f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1410130670 0x7f14101c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f140f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1410130670 0x7f14101c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59926/0 (socket says 172.21.15.154:59926) 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f140f59e700 1 -- 172.21.15.154:0/3182364674 learned_addr learned my addr 172.21.15.154:0/3182364674 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f140e59c700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14100a1340 0x7f14101c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.855+0000 7f140ed9d700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14100a0a30 0x7f14101c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f140f59e700 1 -- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14100a1340 msgr2=0x7f14101c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f140f59e700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14100a1340 0x7f14101c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f140f59e700 1 -- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14100a0a30 msgr2=0x7f14101c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f140f59e700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14100a0a30 0x7f14101c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f140f59e700 1 -- 172.21.15.154:0/3182364674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408009a70 con 0x7f1410130670 2023-09-30T22:26:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f140ed9d700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14100a0a30 0x7f14101c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:26:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f140f59e700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1410130670 0x7f14101c8c10 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f141009b440 tx=0x7f1408004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f13f77fe700 1 -- 172.21.15.154:0/3182364674 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408012430 con 0x7f1410130670 2023-09-30T22:26:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f14150f3700 1 -- 172.21.15.154:0/3182364674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141009fe60 con 0x7f1410130670 2023-09-30T22:26:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f13f77fe700 1 -- 172.21.15.154:0/3182364674 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1408020070 con 0x7f1410130670 2023-09-30T22:26:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f13f77fe700 1 -- 172.21.15.154:0/3182364674 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408003ea0 con 0x7f1410130670 2023-09-30T22:26:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.856+0000 7f14150f3700 1 -- 172.21.15.154:0/3182364674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141011f640 con 0x7f1410130670 2023-09-30T22:26:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.857+0000 7f14150f3700 1 -- 172.21.15.154:0/3182364674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141004f2a0 con 0x7f1410130670 2023-09-30T22:26:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.858+0000 7f13f77fe700 1 -- 172.21.15.154:0/3182364674 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1408004280 con 0x7f1410130670 2023-09-30T22:26:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.858+0000 7f13f77fe700 1 -- 172.21.15.154:0/3182364674 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1408022070 con 0x7f1410130670 2023-09-30T22:26:50.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.864+0000 7f13f77fe700 1 -- 172.21.15.154:0/3182364674 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1408004530 con 0x7f1410130670 2023-09-30T22:26:50.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.887+0000 7fb2ad8d1700 1 Processor -- start 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2ad8d1700 1 -- start start 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2ad8d1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2a809a130 0x7fb2a809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2ad8d1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a809edb0 0x7fb2a809f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2ad8d1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a8072b30 con 0x7fb2a813c410 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2ad8d1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a809a500 con 0x7fb2a809a130 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2ad8d1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a809f720 con 0x7fb2a809edb0 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2a6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2a809a130 0x7fb2a809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2a67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a809edb0 0x7fb2a809f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2a6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2a809a130 0x7fb2a809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59932/0 (socket says 172.21.15.154:59932) 2023-09-30T22:26:50.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.888+0000 7fb2a6ffd700 1 -- 172.21.15.154:0/3919597333 learned_addr learned my addr 172.21.15.154:0/3919597333 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:50.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.889+0000 7fb2a67fc700 1 -- 172.21.15.154:0/3919597333 >> v2:172.21.15.154:3300/0 conn(0x7fb2a809a130 msgr2=0x7fb2a809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.889+0000 7fb2a67fc700 1 --2- 172.21.15.154:0/3919597333 >> v2:172.21.15.154:3300/0 conn(0x7fb2a809a130 0x7fb2a809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.889+0000 7fb2a67fc700 1 -- 172.21.15.154:0/3919597333 >> v1:172.21.15.154:6789/0 conn(0x7fb2a813c410 legacy=0x7fb2a813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.889+0000 7fb2a67fc700 1 -- 172.21.15.154:0/3919597333 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a809fe00 con 0x7fb2a809edb0 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.889+0000 7fb2a6ffd700 1 --2- 172.21.15.154:0/3919597333 >> v2:172.21.15.154:3300/0 conn(0x7fb2a809a130 0x7fb2a809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.889+0000 7fb2a67fc700 1 --2- 172.21.15.154:0/3919597333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a809edb0 0x7fb2a809f1e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009840 tx=0x7fb29c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1173c368c8758ae8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.889+0000 7fb2a5ffb700 1 -- 172.21.15.154:0/3919597333 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c011830 con 0x7fb2a809edb0 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.889+0000 7fb2a5ffb700 1 -- 172.21.15.154:0/3919597333 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c011990 con 0x7fb2a809edb0 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.889+0000 7fb2a5ffb700 1 -- 172.21.15.154:0/3919597333 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c011d20 con 0x7fb2a809edb0 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.890+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3919597333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a809edb0 msgr2=0x7fb2a809f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.890+0000 7fb2ad8d1700 1 --2- 172.21.15.154:0/3919597333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a809edb0 0x7fb2a809f1e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009840 tx=0x7fb29c009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.890+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3919597333 shutdown_connections 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.890+0000 7fb2ad8d1700 1 --2- 172.21.15.154:0/3919597333 >> v2:172.21.15.154:3300/0 conn(0x7fb2a809a130 0x7fb2a809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.890+0000 7fb2ad8d1700 1 --2- 172.21.15.154:0/3919597333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a809edb0 0x7fb2a809f1e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.890+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3919597333 >> 172.21.15.154:0/3919597333 conn(0x7fb2a80a4430 msgr2=0x7fb2a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.890+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3919597333 shutdown_connections 2023-09-30T22:26:50.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.890+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3919597333 wait complete. 2023-09-30T22:26:50.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.890+0000 7f78af52d700 1 -- 172.21.15.154:0/2531338803 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78a8123e80 con 0x7f78a809f180 2023-09-30T22:26:50.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.891+0000 7fb2ad8d1700 1 Processor -- start 2023-09-30T22:26:50.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.891+0000 7f789dffb700 1 -- 172.21.15.154:0/2531338803 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78a402a090 con 0x7f78a809f180 2023-09-30T22:26:50.893 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.891+0000 7fb2ad8d1700 1 -- start start 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.891+0000 7fb2ad8d1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a809a130 0x7fb2a813aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.891+0000 7fb2ad8d1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a813c410 0x7fb2a813af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.891+0000 7fb2ad8d1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a811b6d0 0x7fb2a813b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.891+0000 7fb2ad8d1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a811dd00 con 0x7fb2a811b6d0 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.891+0000 7fb2ad8d1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a813fb30 con 0x7fb2a813c410 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.891+0000 7fb2ad8d1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a80a00f0 con 0x7fb2a809a130 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a811b6d0 0x7fb2a813b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a811b6d0 0x7fb2a813b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59934/0 (socket says 172.21.15.154:59934) 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a77fe700 1 -- 172.21.15.154:0/3407139128 learned_addr learned my addr 172.21.15.154:0/3407139128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:50.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a6ffd700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a809a130 0x7fb2a813aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a67fc700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a813c410 0x7fb2a813af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a77fe700 1 -- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a809a130 msgr2=0x7fb2a813aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a77fe700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a809a130 0x7fb2a813aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a77fe700 1 -- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a813c410 msgr2=0x7fb2a813af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a77fe700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a813c410 0x7fb2a813af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a77fe700 1 -- 172.21.15.154:0/3407139128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298009550 con 0x7fb2a811b6d0 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a67fc700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a813c410 0x7fb2a813af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2a77fe700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a811b6d0 0x7fb2a813b4b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000cb90 tx=0x7fb2a000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb28ffff700 1 -- 172.21.15.154:0/3407139128 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0003c00 con 0x7fb2a811b6d0 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb28ffff700 1 -- 172.21.15.154:0/3407139128 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a0003d60 con 0x7fb2a811b6d0 2023-09-30T22:26:50.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3407139128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c0094a0 con 0x7fb2a811b6d0 2023-09-30T22:26:50.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb28ffff700 1 -- 172.21.15.154:0/3407139128 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000ab00 con 0x7fb2a811b6d0 2023-09-30T22:26:50.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.892+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3407139128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a813bfe0 con 0x7fb2a811b6d0 2023-09-30T22:26:50.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.893+0000 7fb28ffff700 1 -- 172.21.15.154:0/3407139128 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2a000ac60 con 0x7fb2a811b6d0 2023-09-30T22:26:50.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.893+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3407139128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a804f2a0 con 0x7fb2a811b6d0 2023-09-30T22:26:50.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.894+0000 7fb28ffff700 1 -- 172.21.15.154:0/3407139128 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2a003f640 con 0x7fb2a811b6d0 2023-09-30T22:26:50.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.894+0000 7f78af52d700 1 -- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809f180 msgr2=0x7f78a8122f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.894+0000 7f78af52d700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809f180 0x7f78a8122f10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f78a400e980 tx=0x7f78a400ec90 comp rx=0 tx=0).stop 2023-09-30T22:26:50.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.896+0000 7f78af52d700 1 -- 172.21.15.154:0/2531338803 shutdown_connections 2023-09-30T22:26:50.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.896+0000 7f78af52d700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78a8134160 0x7f78a8123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.896+0000 7f78af52d700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a809e870 0x7f78a81229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.896+0000 7f78af52d700 1 --2- 172.21.15.154:0/2531338803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78a809f180 0x7f78a8122f10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.896+0000 7f78af52d700 1 -- 172.21.15.154:0/2531338803 >> 172.21.15.154:0/2531338803 conn(0x7f78a80a4430 msgr2=0x7f78a8070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.896+0000 7f78af52d700 1 -- 172.21.15.154:0/2531338803 shutdown_connections 2023-09-30T22:26:50.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.896+0000 7f78af52d700 1 -- 172.21.15.154:0/2531338803 wait complete. 2023-09-30T22:26:50.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.898+0000 7fb28ffff700 1 -- 172.21.15.154:0/3407139128 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2a00196c0 con 0x7fb2a811b6d0 2023-09-30T22:26:50.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:50.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.931+0000 7f45a67e5700 1 Processor -- start 2023-09-30T22:26:50.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.931+0000 7f45a67e5700 1 -- start start 2023-09-30T22:26:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.931+0000 7f45a67e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.931+0000 7f45a67e5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45a00a1380 0x7f45a0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.931+0000 7f45a67e5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a009dc00 con 0x7f45a0133f50 2023-09-30T22:26:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.931+0000 7f45a67e5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a009ea60 con 0x7f45a00a1380 2023-09-30T22:26:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.931+0000 7f45a67e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a009dec0 con 0x7f45a00a0a70 2023-09-30T22:26:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.931+0000 7f45a4d82700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f45a0133f50 0x7f45a013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33098/0 (socket says 172.21.15.154:33098) 2023-09-30T22:26:50.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f45a4d82700 1 -- 172.21.15.154:0/2309891563 learned_addr learned my addr 172.21.15.154:0/2309891563 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459ffff700 1 --2- 172.21.15.154:0/2309891563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459f7fe700 1 --2- 172.21.15.154:0/2309891563 >> v2:172.21.15.154:3300/0 conn(0x7f45a00a1380 0x7f45a0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459f7fe700 1 -- 172.21.15.154:0/2309891563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 msgr2=0x7f45a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459f7fe700 1 --2- 172.21.15.154:0/2309891563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459f7fe700 1 -- 172.21.15.154:0/2309891563 >> v1:172.21.15.154:6789/0 conn(0x7f45a0133f50 legacy=0x7f45a013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459f7fe700 1 -- 172.21.15.154:0/2309891563 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a009e6a0 con 0x7f45a00a1380 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459effd700 1 -- 172.21.15.154:0/2309891563 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094500796 0 0) 0x7f45a009dc00 con 0x7f45a0133f50 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459ffff700 1 --2- 172.21.15.154:0/2309891563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459f7fe700 1 --2- 172.21.15.154:0/2309891563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a00a1380 0x7f45a0133a10 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f4594009840 tx=0x7f4594009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff85f8156ab4261 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459effd700 1 -- 172.21.15.154:0/2309891563 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594011830 con 0x7f45a00a1380 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459effd700 1 -- 172.21.15.154:0/2309891563 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4594011990 con 0x7f45a00a1380 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.932+0000 7f459effd700 1 -- 172.21.15.154:0/2309891563 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594011d20 con 0x7f45a00a1380 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.933+0000 7f45a67e5700 1 -- 172.21.15.154:0/2309891563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a00a1380 msgr2=0x7f45a0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.933+0000 7f45a67e5700 1 --2- 172.21.15.154:0/2309891563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a00a1380 0x7f45a0133a10 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f4594009840 tx=0x7f4594009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.933+0000 7f45a67e5700 1 -- 172.21.15.154:0/2309891563 shutdown_connections 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.933+0000 7f45a67e5700 1 --2- 172.21.15.154:0/2309891563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.933+0000 7f45a67e5700 1 --2- 172.21.15.154:0/2309891563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a00a1380 0x7f45a0133a10 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.933+0000 7f45a67e5700 1 -- 172.21.15.154:0/2309891563 >> 172.21.15.154:0/2309891563 conn(0x7f45a00a6610 msgr2=0x7f45a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.933+0000 7f45a67e5700 1 -- 172.21.15.154:0/2309891563 shutdown_connections 2023-09-30T22:26:50.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.933+0000 7f45a67e5700 1 -- 172.21.15.154:0/2309891563 wait complete. 2023-09-30T22:26:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.934+0000 7f45a67e5700 1 Processor -- start 2023-09-30T22:26:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.934+0000 7f45a67e5700 1 -- start start 2023-09-30T22:26:50.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.934+0000 7f45a67e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a0122a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f45a67e5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a00a1380 0x7f45a0122f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f45a67e5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a0133f50 0x7f45a0123480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f45a67e5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0126fb0 con 0x7f45a0133f50 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f45a67e5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a0125e30 con 0x7f45a00a1380 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f45a67e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00a03e0 con 0x7f45a00a0a70 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a0122a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a00a1380 0x7f45a0122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a0122a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47048/0 (socket says 172.21.15.154:47048) 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a00a1380 0x7f45a0122f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38490/0 (socket says 172.21.15.154:38490) 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459ffff700 1 -- 172.21.15.154:0/2925139152 learned_addr learned my addr 172.21.15.154:0/2925139152 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:50.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f45a4d82700 1 --2- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a0133f50 0x7f45a0123480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459ffff700 1 -- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a00a1380 msgr2=0x7f45a0122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459ffff700 1 --2- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a00a1380 0x7f45a0122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459ffff700 1 -- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a0133f50 msgr2=0x7f45a0123480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459ffff700 1 --2- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a0133f50 0x7f45a0123480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459ffff700 1 -- 172.21.15.154:0/2925139152 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900094a0 con 0x7f45a00a0a70 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459ffff700 1 --2- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a0122a00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f459000ebe0 tx=0x7f459000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459cff9700 1 -- 172.21.15.154:0/2925139152 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000c850 con 0x7f45a00a0a70 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459cff9700 1 -- 172.21.15.154:0/2925139152 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459000c9b0 con 0x7f45a00a0a70 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f459cff9700 1 -- 172.21.15.154:0/2925139152 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000cd40 con 0x7f45a00a0a70 2023-09-30T22:26:50.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f45a67e5700 1 -- 172.21.15.154:0/2925139152 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45940094a0 con 0x7f45a00a0a70 2023-09-30T22:26:50.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.935+0000 7f45a67e5700 1 -- 172.21.15.154:0/2925139152 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a01338a0 con 0x7f45a00a0a70 2023-09-30T22:26:50.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.936+0000 7f459cff9700 1 -- 172.21.15.154:0/2925139152 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4590013470 con 0x7f45a00a0a70 2023-09-30T22:26:50.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.936+0000 7f459cff9700 1 -- 172.21.15.154:0/2925139152 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f459003fb30 con 0x7f45a00a0a70 2023-09-30T22:26:50.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.937+0000 7f45a67e5700 1 -- 172.21.15.154:0/2925139152 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a004f2a0 con 0x7f45a00a0a70 2023-09-30T22:26:50.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:50.941+0000 7f459cff9700 1 -- 172.21.15.154:0/2925139152 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4590013720 con 0x7f45a00a0a70 2023-09-30T22:26:51.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.062+0000 7f14150f3700 1 -- 172.21.15.154:0/3182364674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f141006bce0 con 0x7f1410130670 2023-09-30T22:26:51.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.062+0000 7f13f77fe700 1 -- 172.21.15.154:0/3182364674 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f140802c070 con 0x7f1410130670 2023-09-30T22:26:51.062 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:51.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.064+0000 7f14150f3700 1 -- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1410130670 msgr2=0x7f14101c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.064+0000 7f14150f3700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1410130670 0x7f14101c8c10 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f141009b440 tx=0x7f1408004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.064+0000 7f14150f3700 1 -- 172.21.15.154:0/3182364674 shutdown_connections 2023-09-30T22:26:51.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.064+0000 7f14150f3700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1410130670 0x7f14101c8c10 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.064+0000 7f14150f3700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14100a0a30 0x7f14101c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.064+0000 7f14150f3700 1 --2- 172.21.15.154:0/3182364674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14100a1340 0x7f14101c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.064+0000 7f14150f3700 1 -- 172.21.15.154:0/3182364674 >> 172.21.15.154:0/3182364674 conn(0x7f14100a2980 msgr2=0x7f141009e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.064+0000 7f14150f3700 1 -- 172.21.15.154:0/3182364674 shutdown_connections 2023-09-30T22:26:51.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.064+0000 7f14150f3700 1 -- 172.21.15.154:0/3182364674 wait complete. 2023-09-30T22:26:51.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:51.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.099+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3407139128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb2a811da90 con 0x7fb2a811b6d0 2023-09-30T22:26:51.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.100+0000 7fb28ffff700 1 -- 172.21.15.154:0/3407139128 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2a001bdc0 con 0x7fb2a811b6d0 2023-09-30T22:26:51.099 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:51.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.102+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a811b6d0 msgr2=0x7fb2a813b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.102+0000 7fb2ad8d1700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a811b6d0 0x7fb2a813b4b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000cb90 tx=0x7fb2a000cea0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.102+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3407139128 shutdown_connections 2023-09-30T22:26:51.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.102+0000 7fb2ad8d1700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a811b6d0 0x7fb2a813b4b0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.102+0000 7fb2ad8d1700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a809a130 0x7fb2a813aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.102+0000 7fb2ad8d1700 1 --2- 172.21.15.154:0/3407139128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a813c410 0x7fb2a813af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.102+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3407139128 >> 172.21.15.154:0/3407139128 conn(0x7fb2a80a4430 msgr2=0x7fb2a813e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.102+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3407139128 shutdown_connections 2023-09-30T22:26:51.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.102+0000 7fb2ad8d1700 1 -- 172.21.15.154:0/3407139128 wait complete. 2023-09-30T22:26:51.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:51.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.135+0000 7f45a67e5700 1 -- 172.21.15.154:0/2925139152 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45a01261b0 con 0x7f45a00a0a70 2023-09-30T22:26:51.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.136+0000 7f459cff9700 1 -- 172.21.15.154:0/2925139152 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4590021030 con 0x7f45a00a0a70 2023-09-30T22:26:51.136 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:51.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.138+0000 7f45a67e5700 1 -- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 msgr2=0x7f45a0122a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:51.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.138+0000 7f45a67e5700 1 --2- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a0122a00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f459000ebe0 tx=0x7f459000eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.138+0000 7f45a67e5700 1 -- 172.21.15.154:0/2925139152 shutdown_connections 2023-09-30T22:26:51.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.138+0000 7f45a67e5700 1 --2- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45a0133f50 0x7f45a0123480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.138+0000 7f45a67e5700 1 --2- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45a00a0a70 0x7f45a0122a00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.138+0000 7f45a67e5700 1 --2- 172.21.15.154:0/2925139152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45a00a1380 0x7f45a0122f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:51.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.138+0000 7f45a67e5700 1 -- 172.21.15.154:0/2925139152 >> 172.21.15.154:0/2925139152 conn(0x7f45a00a6610 msgr2=0x7f45a009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:51.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.138+0000 7f45a67e5700 1 -- 172.21.15.154:0/2925139152 shutdown_connections 2023-09-30T22:26:51.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:51.138+0000 7f45a67e5700 1 -- 172.21.15.154:0/2925139152 wait complete. 2023-09-30T22:26:51.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:51.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:52.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.049+0000 7fd7a305c700 1 Processor -- start 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.049+0000 7fd7a305c700 1 -- start start 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a305c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd79c134140 0x7fd79c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a305c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c1345a0 0x7fd79c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a305c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c09b110 con 0x7fd79c09ad40 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a305c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c0a3b60 con 0x7fd79c134140 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a305c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0a1a80 con 0x7fd79c1345a0 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd79bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd79c134140 0x7fd79c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a15f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c1345a0 0x7fd79c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd79bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd79c134140 0x7fd79c138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59968/0 (socket says 172.21.15.154:59968) 2023-09-30T22:26:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a0df8700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd79c09ad40 0x7fd79c133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33114/0 (socket says 172.21.15.154:33114) 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd79bfff700 1 -- 172.21.15.154:0/1186319482 learned_addr learned my addr 172.21.15.154:0/1186319482 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a15f9700 1 -- 172.21.15.154:0/1186319482 >> v2:172.21.15.154:3300/0 conn(0x7fd79c134140 msgr2=0x7fd79c138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a15f9700 1 --2- 172.21.15.154:0/1186319482 >> v2:172.21.15.154:3300/0 conn(0x7fd79c134140 0x7fd79c138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a15f9700 1 -- 172.21.15.154:0/1186319482 >> v1:172.21.15.154:6789/0 conn(0x7fd79c09ad40 legacy=0x7fd79c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a15f9700 1 -- 172.21.15.154:0/1186319482 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c0a2fa0 con 0x7fd79c1345a0 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd79bfff700 1 --2- 172.21.15.154:0/1186319482 >> v2:172.21.15.154:3300/0 conn(0x7fd79c134140 0x7fd79c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.050+0000 7fd7a15f9700 1 --2- 172.21.15.154:0/1186319482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c1345a0 0x7fd79c13b3d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd794009d90 tx=0x7fd79400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76c08f8ddd20eb1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd79b7fe700 1 -- 172.21.15.154:0/1186319482 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79400e070 con 0x7fd79c1345a0 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd79b7fe700 1 -- 172.21.15.154:0/1186319482 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79400bb20 con 0x7fd79c1345a0 2023-09-30T22:26:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd79b7fe700 1 -- 172.21.15.154:0/1186319482 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd794012430 con 0x7fd79c1345a0 2023-09-30T22:26:52.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd7a305c700 1 -- 172.21.15.154:0/1186319482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c1345a0 msgr2=0x7fd79c13b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd7a305c700 1 --2- 172.21.15.154:0/1186319482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c1345a0 0x7fd79c13b3d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd794009d90 tx=0x7fd79400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:52.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd7a305c700 1 -- 172.21.15.154:0/1186319482 shutdown_connections 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd7a305c700 1 --2- 172.21.15.154:0/1186319482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c1345a0 0x7fd79c13b3d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd7a305c700 1 --2- 172.21.15.154:0/1186319482 >> v2:172.21.15.154:3300/0 conn(0x7fd79c134140 0x7fd79c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd7a305c700 1 -- 172.21.15.154:0/1186319482 >> 172.21.15.154:0/1186319482 conn(0x7fd79c099c40 msgr2=0x7fd79c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd7a305c700 1 -- 172.21.15.154:0/1186319482 shutdown_connections 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.051+0000 7fd7a305c700 1 -- 172.21.15.154:0/1186319482 wait complete. 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.052+0000 7fd7a305c700 1 Processor -- start 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.052+0000 7fd7a305c700 1 -- start start 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a305c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c09ad40 0x7fd79c11c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a305c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79c134140 0x7fd79c11ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a305c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79c1345a0 0x7fd79c11d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a305c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c11ebd0 con 0x7fd79c1345a0 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a305c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c11eeb0 con 0x7fd79c09ad40 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a305c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c0a4110 con 0x7fd79c134140 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a0df8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c09ad40 0x7fd79c11c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a15f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79c1345a0 0x7fd79c11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a15f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79c1345a0 0x7fd79c11d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59974/0 (socket says 172.21.15.154:59974) 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a0df8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c09ad40 0x7fd79c11c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38500/0 (socket says 172.21.15.154:38500) 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a15f9700 1 -- 172.21.15.154:0/3435943208 learned_addr learned my addr 172.21.15.154:0/3435943208 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd79bfff700 1 --2- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79c134140 0x7fd79c11ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a15f9700 1 -- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79c134140 msgr2=0x7fd79c11ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a15f9700 1 --2- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79c134140 0x7fd79c11ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a15f9700 1 -- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c09ad40 msgr2=0x7fd79c11c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a15f9700 1 --2- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c09ad40 0x7fd79c11c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a15f9700 1 -- 172.21.15.154:0/3435943208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd788009550 con 0x7fd79c1345a0 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a0df8700 1 --2- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c09ad40 0x7fd79c11c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7a15f9700 1 --2- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79c1345a0 0x7fd79c11d340 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd794014040 tx=0x7fd794004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7997fa700 1 -- 172.21.15.154:0/3435943208 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd794012430 con 0x7fd79c1345a0 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.053+0000 7fd7997fa700 1 -- 172.21.15.154:0/3435943208 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd794020070 con 0x7fd79c1345a0 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.054+0000 7fd7a305c700 1 -- 172.21.15.154:0/3435943208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd794009a70 con 0x7fd79c1345a0 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.054+0000 7fd7997fa700 1 -- 172.21.15.154:0/3435943208 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd794003ea0 con 0x7fd79c1345a0 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.054+0000 7fd7a305c700 1 -- 172.21.15.154:0/3435943208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c11dc10 con 0x7fd79c1345a0 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.054+0000 7fd7997fa700 1 -- 172.21.15.154:0/3435943208 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd794004280 con 0x7fd79c1345a0 2023-09-30T22:26:52.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.054+0000 7fd7997fa700 1 -- 172.21.15.154:0/3435943208 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd794022070 con 0x7fd79c1345a0 2023-09-30T22:26:52.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.055+0000 7fd7a305c700 1 -- 172.21.15.154:0/3435943208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c11deb0 con 0x7fd79c1345a0 2023-09-30T22:26:52.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.059+0000 7fd7997fa700 1 -- 172.21.15.154:0/3435943208 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd794012e60 con 0x7fd79c1345a0 2023-09-30T22:26:52.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:52.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:52.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:52.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.208+0000 7fbed45b4700 1 Processor -- start 2023-09-30T22:26:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.208+0000 7fbed45b4700 1 -- start start 2023-09-30T22:26:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed45b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed45b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc130670 0x7fbecc1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed45b4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0a1e70 con 0x7fbecc0a1340 2023-09-30T22:26:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed45b4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc09a720 con 0x7fbecc0a0a30 2023-09-30T22:26:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed45b4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc09b300 con 0x7fbecc130670 2023-09-30T22:26:52.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed2b51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc130670 0x7fbecc1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed2350700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed2b51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc130670 0x7fbecc1381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47068/0 (socket says 172.21.15.154:47068) 2023-09-30T22:26:52.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed2b51700 1 -- 172.21.15.154:0/1385660912 learned_addr learned my addr 172.21.15.154:0/1385660912 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:52.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.209+0000 7fbed2350700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38514/0 (socket says 172.21.15.154:38514) 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.210+0000 7fbed2b51700 1 -- 172.21.15.154:0/1385660912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 msgr2=0x7fbecc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.210+0000 7fbed2b51700 1 --2- 172.21.15.154:0/1385660912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.210+0000 7fbed2b51700 1 -- 172.21.15.154:0/1385660912 >> v1:172.21.15.154:6789/0 conn(0x7fbecc0a1340 legacy=0x7fbecc12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.210+0000 7fbed2b51700 1 -- 172.21.15.154:0/1385660912 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc09abc0 con 0x7fbecc130670 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.210+0000 7fbed2350700 1 --2- 172.21.15.154:0/1385660912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.210+0000 7fbed2b51700 1 --2- 172.21.15.154:0/1385660912 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc130670 0x7fbecc1381c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009f00 tx=0x7fbec400d540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=791545dfe2e99732 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.210+0000 7fbed134e700 1 -- 172.21.15.154:0/1385660912 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400dde0 con 0x7fbecc130670 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.210+0000 7fbed134e700 1 -- 172.21.15.154:0/1385660912 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4011460 con 0x7fbecc130670 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.210+0000 7fbed134e700 1 -- 172.21.15.154:0/1385660912 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4011810 con 0x7fbecc130670 2023-09-30T22:26:52.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.211+0000 7fbed45b4700 1 -- 172.21.15.154:0/1385660912 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc130670 msgr2=0x7fbecc1381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.211+0000 7fbed45b4700 1 --2- 172.21.15.154:0/1385660912 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc130670 0x7fbecc1381c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009f00 tx=0x7fbec400d540 comp rx=0 tx=0).stop 2023-09-30T22:26:52.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.211+0000 7fbed45b4700 1 -- 172.21.15.154:0/1385660912 shutdown_connections 2023-09-30T22:26:52.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.211+0000 7fbed45b4700 1 --2- 172.21.15.154:0/1385660912 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc130670 0x7fbecc1381c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.211+0000 7fbed45b4700 1 --2- 172.21.15.154:0/1385660912 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.211+0000 7fbed45b4700 1 -- 172.21.15.154:0/1385660912 >> 172.21.15.154:0/1385660912 conn(0x7fbecc0a2980 msgr2=0x7fbecc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.211+0000 7fbed45b4700 1 -- 172.21.15.154:0/1385660912 shutdown_connections 2023-09-30T22:26:52.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.211+0000 7fbed45b4700 1 -- 172.21.15.154:0/1385660912 wait complete. 2023-09-30T22:26:52.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.212+0000 7fbed45b4700 1 Processor -- start 2023-09-30T22:26:52.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.212+0000 7fbed45b4700 1 -- start start 2023-09-30T22:26:52.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.212+0000 7fbed45b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc1c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.212+0000 7fbed45b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc0a1340 0x7fbecc1c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.212+0000 7fbed45b4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbecc130670 0x7fbecc1c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.212+0000 7fbed45b4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc11bcc0 con 0x7fbecc130670 2023-09-30T22:26:52.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.212+0000 7fbed45b4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc11bad0 con 0x7fbecc0a0a30 2023-09-30T22:26:52.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.212+0000 7fbed45b4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc11d9e0 con 0x7fbecc0a1340 2023-09-30T22:26:52.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2350700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc1c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2350700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc1c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38528/0 (socket says 172.21.15.154:38528) 2023-09-30T22:26:52.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2350700 1 -- 172.21.15.154:0/2762413604 learned_addr learned my addr 172.21.15.154:0/2762413604 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:52.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2b51700 1 --2- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbecc130670 0x7fbecc1c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed1b4f700 1 --2- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc0a1340 0x7fbecc1c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2350700 1 -- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc0a1340 msgr2=0x7fbecc1c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2350700 1 --2- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc0a1340 0x7fbecc1c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2350700 1 -- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbecc130670 msgr2=0x7fbecc1c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2350700 1 --2- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbecc130670 0x7fbecc1c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2350700 1 -- 172.21.15.154:0/2762413604 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec800a4e0 con 0x7fbecc0a0a30 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed2350700 1 --2- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc1c3ed0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fbec800fb20 tx=0x7fbec800fe30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbec2ffd700 1 -- 172.21.15.154:0/2762413604 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800a930 con 0x7fbecc0a0a30 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbec2ffd700 1 -- 172.21.15.154:0/2762413604 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec8005c20 con 0x7fbecc0a0a30 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbec2ffd700 1 -- 172.21.15.154:0/2762413604 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800d9c0 con 0x7fbecc0a0a30 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.213+0000 7fbed45b4700 1 -- 172.21.15.154:0/2762413604 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec4009b30 con 0x7fbecc0a0a30 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.214+0000 7fbed45b4700 1 -- 172.21.15.154:0/2762413604 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc11d700 con 0x7fbecc0a0a30 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.214+0000 7fbec2ffd700 1 -- 172.21.15.154:0/2762413604 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbec800db20 con 0x7fbecc0a0a30 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.215+0000 7fbec2ffd700 1 -- 172.21.15.154:0/2762413604 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbec803fcf0 con 0x7fbecc0a0a30 2023-09-30T22:26:52.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.215+0000 7fbed45b4700 1 -- 172.21.15.154:0/2762413604 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc04f2a0 con 0x7fbecc0a0a30 2023-09-30T22:26:52.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.224+0000 7fbec2ffd700 1 -- 172.21.15.154:0/2762413604 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbec801c3a0 con 0x7fbecc0a0a30 2023-09-30T22:26:52.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.252+0000 7fd13f692700 1 Processor -- start 2023-09-30T22:26:52.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.253+0000 7fd13f692700 1 -- start start 2023-09-30T22:26:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.253+0000 7fd13f692700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13812d380 0x7fd13812d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.253+0000 7fd13f692700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd138099a60 0x7fd138099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13f692700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13809bb90 con 0x7fd13809a3d0 2023-09-30T22:26:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13f692700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13809c210 con 0x7fd138099a60 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13f692700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13809a870 con 0x7fd13812d380 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13cc2d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd138099a60 0x7fd138099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13cc2d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd138099a60 0x7fd138099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38532/0 (socket says 172.21.15.154:38532) 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13cc2d700 1 -- 172.21.15.154:0/4080998168 learned_addr learned my addr 172.21.15.154:0/4080998168 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13d42e700 1 --2- 172.21.15.154:0/4080998168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13812d380 0x7fd13812d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13d42e700 1 -- 172.21.15.154:0/4080998168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd138099a60 msgr2=0x7fd138099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13d42e700 1 --2- 172.21.15.154:0/4080998168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd138099a60 0x7fd138099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13d42e700 1 -- 172.21.15.154:0/4080998168 >> v1:172.21.15.154:6789/0 conn(0x7fd13809a3d0 legacy=0x7fd138137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13d42e700 1 -- 172.21.15.154:0/4080998168 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13809ced0 con 0x7fd13812d380 2023-09-30T22:26:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd13d42e700 1 --2- 172.21.15.154:0/4080998168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13812d380 0x7fd13812d750 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd134009850 tx=0x7fd134009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b923d426d9ee135f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.254+0000 7fd12ffff700 1 -- 172.21.15.154:0/4080998168 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134005e30 con 0x7fd13812d380 2023-09-30T22:26:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd12ffff700 1 -- 172.21.15.154:0/4080998168 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134006030 con 0x7fd13812d380 2023-09-30T22:26:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd12ffff700 1 -- 172.21.15.154:0/4080998168 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340063e0 con 0x7fd13812d380 2023-09-30T22:26:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd13f692700 1 -- 172.21.15.154:0/4080998168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13812d380 msgr2=0x7fd13812d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd13f692700 1 --2- 172.21.15.154:0/4080998168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13812d380 0x7fd13812d750 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd134009850 tx=0x7fd134009b60 comp rx=0 tx=0).stop 2023-09-30T22:26:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd13f692700 1 -- 172.21.15.154:0/4080998168 shutdown_connections 2023-09-30T22:26:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd13f692700 1 --2- 172.21.15.154:0/4080998168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13812d380 0x7fd13812d750 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd13f692700 1 --2- 172.21.15.154:0/4080998168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd138099a60 0x7fd138099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd13f692700 1 -- 172.21.15.154:0/4080998168 >> 172.21.15.154:0/4080998168 conn(0x7fd1380a2980 msgr2=0x7fd1380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd13f692700 1 -- 172.21.15.154:0/4080998168 shutdown_connections 2023-09-30T22:26:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.255+0000 7fd13f692700 1 -- 172.21.15.154:0/4080998168 wait complete. 2023-09-30T22:26:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.257+0000 7fd13f692700 1 Processor -- start 2023-09-30T22:26:52.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.257+0000 7fd13f692700 1 -- start start 2023-09-30T22:26:52.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.257+0000 7fd13f692700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138099a60 0x7fd13806e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.257+0000 7fd13f692700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13809a3d0 0x7fd13806ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.257+0000 7fd13f692700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13812d380 0x7fd1381c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.257+0000 7fd13f692700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13806e480 con 0x7fd138099a60 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.257+0000 7fd13f692700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13809af90 con 0x7fd13812d380 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.257+0000 7fd13f692700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd138122c50 con 0x7fd13809a3d0 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13dc2f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13812d380 0x7fd1381c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13dc2f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13812d380 0x7fd1381c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38534/0 (socket says 172.21.15.154:38534) 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13dc2f700 1 -- 172.21.15.154:0/1163327267 learned_addr learned my addr 172.21.15.154:0/1163327267 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13cc2d700 1 --2- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13809a3d0 0x7fd13806ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13d42e700 1 --2- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138099a60 0x7fd13806e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13dc2f700 1 -- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13809a3d0 msgr2=0x7fd13806ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13dc2f700 1 --2- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13809a3d0 0x7fd13806ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13dc2f700 1 -- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138099a60 msgr2=0x7fd13806e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13dc2f700 1 --2- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138099a60 0x7fd13806e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13dc2f700 1 -- 172.21.15.154:0/1163327267 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134009430 con 0x7fd13812d380 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd13dc2f700 1 --2- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13812d380 0x7fd1381c84f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd13000cc50 tx=0x7fd13000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.258+0000 7fd12dffb700 1 -- 172.21.15.154:0/1163327267 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130003c00 con 0x7fd13812d380 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.259+0000 7fd12dffb700 1 -- 172.21.15.154:0/1163327267 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd130003d60 con 0x7fd13812d380 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.259+0000 7fd13f692700 1 -- 172.21.15.154:0/1163327267 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13809fb50 con 0x7fd13812d380 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.259+0000 7fd12dffb700 1 -- 172.21.15.154:0/1163327267 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000aab0 con 0x7fd13812d380 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.259+0000 7fd13f692700 1 -- 172.21.15.154:0/1163327267 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1381218b0 con 0x7fd13812d380 2023-09-30T22:26:52.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.260+0000 7fd13f692700 1 -- 172.21.15.154:0/1163327267 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd138122ab0 con 0x7fd13812d380 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.260+0000 7fd12dffb700 1 -- 172.21.15.154:0/1163327267 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd13000ac10 con 0x7fd13812d380 2023-09-30T22:26:52.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.261+0000 7fd12dffb700 1 -- 172.21.15.154:0/1163327267 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd13003f730 con 0x7fd13812d380 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.264+0000 7fd7a305c700 1 -- 172.21.15.154:0/3435943208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd79c04f2a0 con 0x7fd79c1345a0 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.264+0000 7fd7997fa700 1 -- 172.21.15.154:0/3435943208 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd79401a380 con 0x7fd79c1345a0 2023-09-30T22:26:52.264 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:52.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.266+0000 7fd12dffb700 1 -- 172.21.15.154:0/1163327267 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd138122ab0 con 0x7fd13812d380 2023-09-30T22:26:52.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.268+0000 7fd7a305c700 1 -- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79c1345a0 msgr2=0x7fd79c11d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.268+0000 7fd7a305c700 1 --2- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79c1345a0 0x7fd79c11d340 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fd794014040 tx=0x7fd794004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.268+0000 7fd7a305c700 1 -- 172.21.15.154:0/3435943208 shutdown_connections 2023-09-30T22:26:52.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.268+0000 7fd7a305c700 1 --2- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd79c1345a0 0x7fd79c11d340 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.268+0000 7fd7a305c700 1 --2- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd79c09ad40 0x7fd79c11c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.268+0000 7fd7a305c700 1 --2- 172.21.15.154:0/3435943208 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd79c134140 0x7fd79c11ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.268+0000 7fd7a305c700 1 -- 172.21.15.154:0/3435943208 >> 172.21.15.154:0/3435943208 conn(0x7fd79c099c40 msgr2=0x7fd79c09f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.269+0000 7fd7a305c700 1 -- 172.21.15.154:0/3435943208 shutdown_connections 2023-09-30T22:26:52.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.269+0000 7fd7a305c700 1 -- 172.21.15.154:0/3435943208 wait complete. 2023-09-30T22:26:52.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:52.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.298+0000 7f70ca187700 1 Processor -- start 2023-09-30T22:26:52.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70ca187700 1 -- start start 2023-09-30T22:26:52.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70ca187700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70c409ad40 0x7f70c4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70ca187700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c4133f70 0x7f70c41343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70ca187700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c409b110 con 0x7f70c40a0a70 2023-09-30T22:26:52.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70ca187700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c40a3b60 con 0x7f70c409ad40 2023-09-30T22:26:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70ca187700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70c41348e0 con 0x7f70c4133f70 2023-09-30T22:26:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70c37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70c409ad40 0x7f70c4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70c37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70c409ad40 0x7f70c4133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60010/0 (socket says 172.21.15.154:60010) 2023-09-30T22:26:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70c2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c4133f70 0x7f70c41343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70c37fe700 1 -- 172.21.15.154:0/3346699798 learned_addr learned my addr 172.21.15.154:0/3346699798 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70c37fe700 1 -- 172.21.15.154:0/3346699798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c4133f70 msgr2=0x7f70c41343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70c37fe700 1 --2- 172.21.15.154:0/3346699798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c4133f70 0x7f70c41343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70c37fe700 1 -- 172.21.15.154:0/3346699798 >> v1:172.21.15.154:6789/0 conn(0x7f70c40a0a70 legacy=0x7f70c40a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.299+0000 7f70c37fe700 1 -- 172.21.15.154:0/3346699798 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c40a2fa0 con 0x7f70c409ad40 2023-09-30T22:26:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70c37fe700 1 --2- 172.21.15.154:0/3346699798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70c409ad40 0x7f70c4133a30 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009e50 tx=0x7f70b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc564499d613b95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70c27fc700 1 -- 172.21.15.154:0/3346699798 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b400e070 con 0x7f70c409ad40 2023-09-30T22:26:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70c27fc700 1 -- 172.21.15.154:0/3346699798 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b400b910 con 0x7f70c409ad40 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70c27fc700 1 -- 172.21.15.154:0/3346699798 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b400bcc0 con 0x7f70c409ad40 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70ca187700 1 -- 172.21.15.154:0/3346699798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70c409ad40 msgr2=0x7f70c4133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70ca187700 1 --2- 172.21.15.154:0/3346699798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70c409ad40 0x7f70c4133a30 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009e50 tx=0x7f70b400b330 comp rx=0 tx=0).stop 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70ca187700 1 -- 172.21.15.154:0/3346699798 shutdown_connections 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70ca187700 1 --2- 172.21.15.154:0/3346699798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70c409ad40 0x7f70c4133a30 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70ca187700 1 --2- 172.21.15.154:0/3346699798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c4133f70 0x7f70c41343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.300+0000 7f70ca187700 1 -- 172.21.15.154:0/3346699798 >> 172.21.15.154:0/3346699798 conn(0x7f70c4099c40 msgr2=0x7f70c406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.301+0000 7f70ca187700 1 -- 172.21.15.154:0/3346699798 shutdown_connections 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.301+0000 7f70ca187700 1 -- 172.21.15.154:0/3346699798 wait complete. 2023-09-30T22:26:52.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.301+0000 7f70ca187700 1 Processor -- start 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70ca187700 1 -- start start 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70ca187700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c409ad40 0x7f70c41c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70ca187700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70c40a0a70 0x7f70c41c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70ca187700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70c4133f70 0x7f70c41c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70ca187700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c411fbd0 con 0x7f70c40a0a70 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70ca187700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c41204a0 con 0x7f70c4133f70 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70ca187700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70c40a1010 con 0x7f70c409ad40 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70c37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c409ad40 0x7f70c41c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70c37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c409ad40 0x7f70c41c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47114/0 (socket says 172.21.15.154:47114) 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70c37fe700 1 -- 172.21.15.154:0/2359985997 learned_addr learned my addr 172.21.15.154:0/2359985997 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:52.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70c3fff700 1 --2- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70c4133f70 0x7f70c41c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70c37fe700 1 -- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70c4133f70 msgr2=0x7f70c41c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70c37fe700 1 --2- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70c4133f70 0x7f70c41c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70c37fe700 1 -- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70c40a0a70 msgr2=0x7f70c41c57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70c37fe700 1 --2- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70c40a0a70 0x7f70c41c57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.302+0000 7f70c37fe700 1 -- 172.21.15.154:0/2359985997 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4009b30 con 0x7f70c409ad40 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.303+0000 7f70c37fe700 1 --2- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c409ad40 0x7f70c41c52a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f70c409a5d0 tx=0x7f70b4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.303+0000 7f70bbfff700 1 -- 172.21.15.154:0/2359985997 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40092e0 con 0x7f70c409ad40 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.303+0000 7f70bbfff700 1 -- 172.21.15.154:0/2359985997 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4004960 con 0x7f70c409ad40 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.303+0000 7f70bbfff700 1 -- 172.21.15.154:0/2359985997 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b401b670 con 0x7f70c409ad40 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.303+0000 7f70ca187700 1 -- 172.21.15.154:0/2359985997 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c4121ae0 con 0x7f70c409ad40 2023-09-30T22:26:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.303+0000 7f70ca187700 1 -- 172.21.15.154:0/2359985997 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c409c840 con 0x7f70c409ad40 2023-09-30T22:26:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.304+0000 7f70bbfff700 1 -- 172.21.15.154:0/2359985997 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70b401b7d0 con 0x7f70c409ad40 2023-09-30T22:26:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.304+0000 7f70bbfff700 1 -- 172.21.15.154:0/2359985997 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f70b40410d0 con 0x7f70c409ad40 2023-09-30T22:26:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.304+0000 7f70ca187700 1 -- 172.21.15.154:0/2359985997 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c404f2a0 con 0x7f70c409ad40 2023-09-30T22:26:52.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.313+0000 7f70bbfff700 1 -- 172.21.15.154:0/2359985997 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70b401f030 con 0x7f70c409ad40 2023-09-30T22:26:52.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.427+0000 7fbed45b4700 1 -- 172.21.15.154:0/2762413604 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbecc11c2c0 con 0x7fbecc0a0a30 2023-09-30T22:26:52.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.427+0000 7fbec2ffd700 1 -- 172.21.15.154:0/2762413604 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbec8011bb0 con 0x7fbecc0a0a30 2023-09-30T22:26:52.427 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.430+0000 7fbed45b4700 1 -- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 msgr2=0x7fbecc1c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.430+0000 7fbed45b4700 1 --2- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc1c3ed0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fbec800fb20 tx=0x7fbec800fe30 comp rx=0 tx=0).stop 2023-09-30T22:26:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.430+0000 7fbed45b4700 1 -- 172.21.15.154:0/2762413604 shutdown_connections 2023-09-30T22:26:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.430+0000 7fbed45b4700 1 --2- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbecc130670 0x7fbecc1c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.430+0000 7fbed45b4700 1 --2- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbecc0a0a30 0x7fbecc1c3ed0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.430+0000 7fbed45b4700 1 --2- 172.21.15.154:0/2762413604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbecc0a1340 0x7fbecc1c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.430+0000 7fbed45b4700 1 -- 172.21.15.154:0/2762413604 >> 172.21.15.154:0/2762413604 conn(0x7fbecc0a2980 msgr2=0x7fbecc12f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.430+0000 7fbed45b4700 1 -- 172.21.15.154:0/2762413604 shutdown_connections 2023-09-30T22:26:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.430+0000 7fbed45b4700 1 -- 172.21.15.154:0/2762413604 wait complete. 2023-09-30T22:26:52.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:52.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.475+0000 7fd13f692700 1 -- 172.21.15.154:0/1163327267 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd138122ab0 con 0x7fd13812d380 2023-09-30T22:26:52.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.475+0000 7fd12dffb700 1 -- 172.21.15.154:0/1163327267 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd138122ab0 con 0x7fd13812d380 2023-09-30T22:26:52.476 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.477+0000 7fd13f692700 1 -- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13812d380 msgr2=0x7fd1381c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.477+0000 7fd13f692700 1 --2- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13812d380 0x7fd1381c84f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd13000cc50 tx=0x7fd13000cf60 comp rx=0 tx=0).stop 2023-09-30T22:26:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.477+0000 7fd13f692700 1 -- 172.21.15.154:0/1163327267 shutdown_connections 2023-09-30T22:26:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.477+0000 7fd13f692700 1 --2- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13812d380 0x7fd1381c84f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.477+0000 7fd13f692700 1 --2- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138099a60 0x7fd13806e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.477+0000 7fd13f692700 1 --2- 172.21.15.154:0/1163327267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd13809a3d0 0x7fd13806ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.477+0000 7fd13f692700 1 -- 172.21.15.154:0/1163327267 >> 172.21.15.154:0/1163327267 conn(0x7fd1380a2980 msgr2=0x7fd13812f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.477+0000 7fd13f692700 1 -- 172.21.15.154:0/1163327267 shutdown_connections 2023-09-30T22:26:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.477+0000 7fd13f692700 1 -- 172.21.15.154:0/1163327267 wait complete. 2023-09-30T22:26:52.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:52.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.513+0000 7f70ca187700 1 -- 172.21.15.154:0/2359985997 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f70c4121860 con 0x7f70c409ad40 2023-09-30T22:26:52.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.514+0000 7f70bbfff700 1 -- 172.21.15.154:0/2359985997 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70b40247d0 con 0x7f70c409ad40 2023-09-30T22:26:52.514 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.516+0000 7f70ca187700 1 -- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c409ad40 msgr2=0x7f70c41c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.516+0000 7f70ca187700 1 --2- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c409ad40 0x7f70c41c52a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f70c409a5d0 tx=0x7f70b4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.516+0000 7f70ca187700 1 -- 172.21.15.154:0/2359985997 shutdown_connections 2023-09-30T22:26:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.516+0000 7f70ca187700 1 --2- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70c4133f70 0x7f70c41c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.516+0000 7f70ca187700 1 --2- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70c409ad40 0x7f70c41c52a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.516+0000 7f70ca187700 1 --2- 172.21.15.154:0/2359985997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70c40a0a70 0x7f70c41c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:52.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.516+0000 7f70ca187700 1 -- 172.21.15.154:0/2359985997 >> 172.21.15.154:0/2359985997 conn(0x7f70c4099c40 msgr2=0x7f70c4133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:52.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.516+0000 7f70ca187700 1 -- 172.21.15.154:0/2359985997 shutdown_connections 2023-09-30T22:26:52.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:52.516+0000 7f70ca187700 1 -- 172.21.15.154:0/2359985997 wait complete. 2023-09-30T22:26:52.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:53.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:53.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.423+0000 7fa2b34f2700 1 Processor -- start 2023-09-30T22:26:53.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.423+0000 7fa2b34f2700 1 -- start start 2023-09-30T22:26:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.423+0000 7fa2b34f2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.423+0000 7fa2b34f2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac139280 0x7fa2ac13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.423+0000 7fa2b34f2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac06b2d0 con 0x7fa2ac133ad0 2023-09-30T22:26:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.423+0000 7fa2b34f2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1345b0 con 0x7fa2ac136960 2023-09-30T22:26:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.423+0000 7fa2b34f2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac133610 con 0x7fa2ac139280 2023-09-30T22:26:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b0a8d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b128e700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa2ac133ad0 0x7fa2ac133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33158/0 (socket says 172.21.15.154:33158) 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b128e700 1 -- 172.21.15.154:0/1166182350 learned_addr learned my addr 172.21.15.154:0/1166182350 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b1a8f700 1 --2- 172.21.15.154:0/1166182350 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac139280 0x7fa2ac13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b0a8d700 1 -- 172.21.15.154:0/1166182350 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac139280 msgr2=0x7fa2ac13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b0a8d700 1 --2- 172.21.15.154:0/1166182350 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac139280 0x7fa2ac13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b0a8d700 1 -- 172.21.15.154:0/1166182350 >> v1:172.21.15.154:6789/0 conn(0x7fa2ac133ad0 legacy=0x7fa2ac133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2a3fff700 1 -- 172.21.15.154:0/1166182350 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369874040 0 0) 0x7fa2ac06b2d0 con 0x7fa2ac133ad0 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b0a8d700 1 -- 172.21.15.154:0/1166182350 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac09a500 con 0x7fa2ac136960 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b1a8f700 1 --2- 172.21.15.154:0/1166182350 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac139280 0x7fa2ac13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2b0a8d700 1 --2- 172.21.15.154:0/1166182350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac138d40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009870 tx=0x7fa29c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54f935be168b20ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2a3fff700 1 -- 172.21.15.154:0/1166182350 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c011830 con 0x7fa2ac136960 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2a3fff700 1 -- 172.21.15.154:0/1166182350 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c011990 con 0x7fa2ac136960 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.424+0000 7fa2a3fff700 1 -- 172.21.15.154:0/1166182350 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c011d20 con 0x7fa2ac136960 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.425+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1166182350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 msgr2=0x7fa2ac138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.425+0000 7fa2b34f2700 1 --2- 172.21.15.154:0/1166182350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac138d40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009870 tx=0x7fa29c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.425+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1166182350 shutdown_connections 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.425+0000 7fa2b34f2700 1 --2- 172.21.15.154:0/1166182350 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac139280 0x7fa2ac13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.425+0000 7fa2b34f2700 1 --2- 172.21.15.154:0/1166182350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac138d40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.425+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1166182350 >> 172.21.15.154:0/1166182350 conn(0x7fa2ac099c40 msgr2=0x7fa2ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.425+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1166182350 shutdown_connections 2023-09-30T22:26:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.425+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1166182350 wait complete. 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.426+0000 7fa2b34f2700 1 Processor -- start 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.426+0000 7fa2b34f2700 1 -- start start 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b34f2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac133ad0 0x7fa2ac12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b34f2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b34f2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac139280 0x7fa2ac12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b34f2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1317a0 con 0x7fa2ac139280 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b34f2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac06edc0 con 0x7fa2ac136960 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b34f2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac09f390 con 0x7fa2ac133ad0 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b128e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac133ad0 0x7fa2ac12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b0a8d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b128e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac133ad0 0x7fa2ac12cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47136/0 (socket says 172.21.15.154:47136) 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b128e700 1 -- 172.21.15.154:0/1045914350 learned_addr learned my addr 172.21.15.154:0/1045914350 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b1a8f700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac139280 0x7fa2ac12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b0a8d700 1 -- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac133ad0 msgr2=0x7fa2ac12cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b0a8d700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac133ad0 0x7fa2ac12cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b0a8d700 1 -- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac139280 msgr2=0x7fa2ac12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b0a8d700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac139280 0x7fa2ac12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b0a8d700 1 -- 172.21.15.154:0/1045914350 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4009a70 con 0x7fa2ac136960 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b128e700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac133ad0 0x7fa2ac12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b1a8f700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac139280 0x7fa2ac12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.427+0000 7fa2b0a8d700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac12d070 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa29c016000 tx=0x7fa29c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.428+0000 7fa2a1ffb700 1 -- 172.21.15.154:0/1045914350 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0042c0 con 0x7fa2ac136960 2023-09-30T22:26:53.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.428+0000 7fa2a1ffb700 1 -- 172.21.15.154:0/1045914350 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c01f070 con 0x7fa2ac136960 2023-09-30T22:26:53.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.428+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1045914350 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c0094a0 con 0x7fa2ac136960 2023-09-30T22:26:53.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.428+0000 7fa2a1ffb700 1 -- 172.21.15.154:0/1045914350 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0036a0 con 0x7fa2ac136960 2023-09-30T22:26:53.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.428+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1045914350 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac0701b0 con 0x7fa2ac136960 2023-09-30T22:26:53.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.428+0000 7fa2a1ffb700 1 -- 172.21.15.154:0/1045914350 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa29c021030 con 0x7fa2ac136960 2023-09-30T22:26:53.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.429+0000 7fa2a1ffb700 1 -- 172.21.15.154:0/1045914350 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa29c040630 con 0x7fa2ac136960 2023-09-30T22:26:53.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.429+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1045914350 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac070ce0 con 0x7fa2ac136960 2023-09-30T22:26:53.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.433+0000 7fa2a1ffb700 1 -- 172.21.15.154:0/1045914350 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa29c015080 con 0x7fa2ac136960 2023-09-30T22:26:53.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:53.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:53.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:53.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e36028700 1 Processor -- start 2023-09-30T22:26:53.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e36028700 1 -- start start 2023-09-30T22:26:53.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e36028700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e30133660 0x7f9e30135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e36028700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e30138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e36028700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e30099a60 con 0x7f9e30099e20 2023-09-30T22:26:53.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e36028700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3009bf50 con 0x7f9e30133660 2023-09-30T22:26:53.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e36028700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3009b230 con 0x7f9e30135f80 2023-09-30T22:26:53.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e2ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e30138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e2ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e30138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38560/0 (socket says 172.21.15.154:38560) 2023-09-30T22:26:53.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e2ffff700 1 -- 172.21.15.154:0/1740191324 learned_addr learned my addr 172.21.15.154:0/1740191324 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:53.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.574+0000 7f9e2effd700 1 --2- 172.21.15.154:0/1740191324 >> v2:172.21.15.154:3300/0 conn(0x7f9e30133660 0x7f9e30135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2ffff700 1 -- 172.21.15.154:0/1740191324 >> v2:172.21.15.154:3300/0 conn(0x7f9e30133660 msgr2=0x7f9e30135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2ffff700 1 --2- 172.21.15.154:0/1740191324 >> v2:172.21.15.154:3300/0 conn(0x7f9e30133660 0x7f9e30135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2ffff700 1 -- 172.21.15.154:0/1740191324 >> v1:172.21.15.154:6789/0 conn(0x7f9e30099e20 legacy=0x7f9e3009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2ffff700 1 -- 172.21.15.154:0/1740191324 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3009bb90 con 0x7f9e30135f80 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2e7fc700 1 -- 172.21.15.154:0/1740191324 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059079439 0 0) 0x7f9e30099a60 con 0x7f9e30099e20 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2effd700 1 --2- 172.21.15.154:0/1740191324 >> v2:172.21.15.154:3300/0 conn(0x7f9e30133660 0x7f9e30135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2ffff700 1 --2- 172.21.15.154:0/1740191324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e30138360 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009e50 tx=0x7f9e2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24acfd251fc9504 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2e7fc700 1 -- 172.21.15.154:0/1740191324 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800e070 con 0x7f9e30135f80 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2e7fc700 1 -- 172.21.15.154:0/1740191324 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800b910 con 0x7f9e30135f80 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.575+0000 7f9e2e7fc700 1 -- 172.21.15.154:0/1740191324 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800bcc0 con 0x7f9e30135f80 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.576+0000 7f9e36028700 1 -- 172.21.15.154:0/1740191324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 msgr2=0x7f9e30138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.576+0000 7f9e36028700 1 --2- 172.21.15.154:0/1740191324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e30138360 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009e50 tx=0x7f9e2800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.576+0000 7f9e36028700 1 -- 172.21.15.154:0/1740191324 shutdown_connections 2023-09-30T22:26:53.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.576+0000 7f9e36028700 1 --2- 172.21.15.154:0/1740191324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e30138360 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.576+0000 7f9e36028700 1 --2- 172.21.15.154:0/1740191324 >> v2:172.21.15.154:3300/0 conn(0x7f9e30133660 0x7f9e30135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.576+0000 7f9e36028700 1 -- 172.21.15.154:0/1740191324 >> 172.21.15.154:0/1740191324 conn(0x7f9e300a2980 msgr2=0x7f9e300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.576+0000 7f9e36028700 1 -- 172.21.15.154:0/1740191324 shutdown_connections 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.576+0000 7f9e36028700 1 -- 172.21.15.154:0/1740191324 wait complete. 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.577+0000 7f9e36028700 1 Processor -- start 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.577+0000 7f9e36028700 1 -- start start 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.577+0000 7f9e36028700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e30099e20 0x7f9e3009e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.577+0000 7f9e36028700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e30133660 0x7f9e3009ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.577+0000 7f9e36028700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e3009f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.577+0000 7f9e36028700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3009b470 con 0x7f9e30133660 2023-09-30T22:26:53.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.577+0000 7f9e36028700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30072720 con 0x7f9e30135f80 2023-09-30T22:26:53.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.577+0000 7f9e36028700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3012df60 con 0x7f9e30099e20 2023-09-30T22:26:53.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e3009f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e3009f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38562/0 (socket says 172.21.15.154:38562) 2023-09-30T22:26:53.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2ffff700 1 -- 172.21.15.154:0/1065083691 learned_addr learned my addr 172.21.15.154:0/1065083691 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:53.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2effd700 1 --2- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e30133660 0x7f9e3009ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2ffff700 1 -- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e30099e20 msgr2=0x7f9e3009e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2ffff700 1 --2- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e30099e20 0x7f9e3009e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2ffff700 1 -- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e30133660 msgr2=0x7f9e3009ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2ffff700 1 --2- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e30133660 0x7f9e3009ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2ffff700 1 -- 172.21.15.154:0/1065083691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240094a0 con 0x7f9e30135f80 2023-09-30T22:26:53.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2effd700 1 --2- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e30133660 0x7f9e3009ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e2ffff700 1 --2- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e3009f140 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9e28012000 tx=0x7f9e28004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e17fff700 1 -- 172.21.15.154:0/1065083691 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28003ea0 con 0x7f9e30135f80 2023-09-30T22:26:53.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e17fff700 1 -- 172.21.15.154:0/1065083691 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e28004780 con 0x7f9e30135f80 2023-09-30T22:26:53.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.578+0000 7f9e17fff700 1 -- 172.21.15.154:0/1065083691 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2801c650 con 0x7f9e30135f80 2023-09-30T22:26:53.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.579+0000 7f9e36028700 1 -- 172.21.15.154:0/1065083691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e28009b30 con 0x7f9e30135f80 2023-09-30T22:26:53.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.579+0000 7f9e36028700 1 -- 172.21.15.154:0/1065083691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3012ead0 con 0x7f9e30135f80 2023-09-30T22:26:53.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.580+0000 7f9e17fff700 1 -- 172.21.15.154:0/1065083691 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e2801c7b0 con 0x7f9e30135f80 2023-09-30T22:26:53.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.581+0000 7f9e17fff700 1 -- 172.21.15.154:0/1065083691 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9e28040e10 con 0x7f9e30135f80 2023-09-30T22:26:53.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.581+0000 7f9e36028700 1 -- 172.21.15.154:0/1065083691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3004f2a0 con 0x7f9e30135f80 2023-09-30T22:26:53.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.589+0000 7f9e17fff700 1 -- 172.21.15.154:0/1065083691 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e2806c750 con 0x7f9e30135f80 2023-09-30T22:26:53.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.622+0000 7f06c5f79700 1 Processor -- start 2023-09-30T22:26:53.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.622+0000 7f06c5f79700 1 -- start start 2023-09-30T22:26:53.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06c5f79700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c00a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06c5f79700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c013dd10 0x7f06c01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06c5f79700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c01379e0 con 0x7f06c0138040 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06c5f79700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00a2100 con 0x7f06c013dd10 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06c5f79700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06c009b9b0 con 0x7f06c0138410 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06beffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c00a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06beffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c00a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47154/0 (socket says 172.21.15.154:47154) 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06bf7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f06c0138040 0x7f06c00a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33164/0 (socket says 172.21.15.154:33164) 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06beffd700 1 -- 172.21.15.154:0/2445247100 learned_addr learned my addr 172.21.15.154:0/2445247100 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06bffff700 1 --2- 172.21.15.154:0/2445247100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c013dd10 0x7f06c01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06beffd700 1 -- 172.21.15.154:0/2445247100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c013dd10 msgr2=0x7f06c01400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06beffd700 1 --2- 172.21.15.154:0/2445247100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c013dd10 0x7f06c01400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06beffd700 1 -- 172.21.15.154:0/2445247100 >> v1:172.21.15.154:6789/0 conn(0x7f06c0138040 legacy=0x7f06c00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06beffd700 1 -- 172.21.15.154:0/2445247100 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0137c10 con 0x7f06c0138410 2023-09-30T22:26:53.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06beffd700 1 --2- 172.21.15.154:0/2445247100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c00a0ff0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009950 tx=0x7f06b4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87f0f0cb16dfd2aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06be7fc700 1 -- 172.21.15.154:0/2445247100 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4011830 con 0x7f06c0138410 2023-09-30T22:26:53.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.623+0000 7f06be7fc700 1 -- 172.21.15.154:0/2445247100 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b4011990 con 0x7f06c0138410 2023-09-30T22:26:53.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.624+0000 7f06be7fc700 1 -- 172.21.15.154:0/2445247100 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4011d40 con 0x7f06c0138410 2023-09-30T22:26:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.624+0000 7f06c5f79700 1 -- 172.21.15.154:0/2445247100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 msgr2=0x7f06c00a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.624+0000 7f06c5f79700 1 --2- 172.21.15.154:0/2445247100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c00a0ff0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009950 tx=0x7f06b4009c60 comp rx=0 tx=0).stop 2023-09-30T22:26:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.624+0000 7f06c5f79700 1 -- 172.21.15.154:0/2445247100 shutdown_connections 2023-09-30T22:26:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.624+0000 7f06c5f79700 1 --2- 172.21.15.154:0/2445247100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c013dd10 0x7f06c01400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.624+0000 7f06c5f79700 1 --2- 172.21.15.154:0/2445247100 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c00a0ff0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.624+0000 7f06c5f79700 1 -- 172.21.15.154:0/2445247100 >> 172.21.15.154:0/2445247100 conn(0x7f06c00a2980 msgr2=0x7f06c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.624+0000 7f06c5f79700 1 -- 172.21.15.154:0/2445247100 shutdown_connections 2023-09-30T22:26:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.624+0000 7f06c5f79700 1 -- 172.21.15.154:0/2445247100 wait complete. 2023-09-30T22:26:53.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.625+0000 7f06c5f79700 1 Processor -- start 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06c5f79700 1 -- start start 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06c5f79700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c0138040 0x7f06c0121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06c5f79700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c0121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06c5f79700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c013dd10 0x7f06c0122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06c5f79700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0124ea0 con 0x7f06c013dd10 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06c5f79700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c01241e0 con 0x7f06c0138040 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06c5f79700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06c01237f0 con 0x7f06c0138410 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c0138040 0x7f06c0121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c0138040 0x7f06c0121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38576/0 (socket says 172.21.15.154:38576) 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06bf7fe700 1 -- 172.21.15.154:0/1235135244 learned_addr learned my addr 172.21.15.154:0/1235135244 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06beffd700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c0121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.626+0000 7f06bffff700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c013dd10 0x7f06c0122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06bf7fe700 1 -- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 msgr2=0x7f06c0121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06bf7fe700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c0121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06bf7fe700 1 -- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c013dd10 msgr2=0x7f06c0122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06bf7fe700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c013dd10 0x7f06c0122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06bf7fe700 1 -- 172.21.15.154:0/1235135244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b4009550 con 0x7f06c0138040 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06bffff700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c013dd10 0x7f06c0122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06bf7fe700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c0138040 0x7f06c0121600 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c500 tx=0x7f06b000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06a7fff700 1 -- 172.21.15.154:0/1235135244 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0005cb0 con 0x7f06c0138040 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06a7fff700 1 -- 172.21.15.154:0/1235135244 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0005e10 con 0x7f06c0138040 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06c5f79700 1 -- 172.21.15.154:0/1235135244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c0122a30 con 0x7f06c0138040 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06a7fff700 1 -- 172.21.15.154:0/1235135244 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0007310 con 0x7f06c0138040 2023-09-30T22:26:53.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.627+0000 7f06c5f79700 1 -- 172.21.15.154:0/1235135244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c009f050 con 0x7f06c0138040 2023-09-30T22:26:53.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.628+0000 7f06c5f79700 1 -- 172.21.15.154:0/1235135244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c009a240 con 0x7f06c0138040 2023-09-30T22:26:53.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.629+0000 7f06a7fff700 1 -- 172.21.15.154:0/1235135244 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06b0007470 con 0x7f06c0138040 2023-09-30T22:26:53.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.629+0000 7f06a7fff700 1 -- 172.21.15.154:0/1235135244 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f06b003ee70 con 0x7f06c0138040 2023-09-30T22:26:53.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.633+0000 7f06a7fff700 1 -- 172.21.15.154:0/1235135244 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06b0007720 con 0x7f06c0138040 2023-09-30T22:26:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.666+0000 7fc251a90700 1 Processor -- start 2023-09-30T22:26:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.666+0000 7fc251a90700 1 -- start start 2023-09-30T22:26:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.666+0000 7fc251a90700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.666+0000 7fc251a90700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc24c09f180 0x7fc24c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.666+0000 7fc251a90700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c09c970 con 0x7fc24c131d70 2023-09-30T22:26:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.666+0000 7fc251a90700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24c0a0920 con 0x7fc24c09f180 2023-09-30T22:26:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.666+0000 7fc251a90700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c09f9c0 con 0x7fc24c09e870 2023-09-30T22:26:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.666+0000 7fc24affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc24c09f180 0x7fc24c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc24c09f180 0x7fc24c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60056/0 (socket says 172.21.15.154:60056) 2023-09-30T22:26:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24affd700 1 -- 172.21.15.154:0/1172393718 learned_addr learned my addr 172.21.15.154:0/1172393718 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24b7fe700 1 --2- 172.21.15.154:0/1172393718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24b7fe700 1 -- 172.21.15.154:0/1172393718 >> v2:172.21.15.154:3300/0 conn(0x7fc24c09f180 msgr2=0x7fc24c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24b7fe700 1 --2- 172.21.15.154:0/1172393718 >> v2:172.21.15.154:3300/0 conn(0x7fc24c09f180 0x7fc24c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24b7fe700 1 -- 172.21.15.154:0/1172393718 >> v1:172.21.15.154:6789/0 conn(0x7fc24c131d70 legacy=0x7fc24c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24b7fe700 1 -- 172.21.15.154:0/1172393718 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c09bab0 con 0x7fc24c09e870 2023-09-30T22:26:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24affd700 1 --2- 172.21.15.154:0/1172393718 >> v2:172.21.15.154:3300/0 conn(0x7fc24c09f180 0x7fc24c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24b7fe700 1 --2- 172.21.15.154:0/1172393718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c09ec40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009840 tx=0x7fc23c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80c9b018ef6bc03a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24a7fc700 1 -- 172.21.15.154:0/1172393718 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c004230 con 0x7fc24c09e870 2023-09-30T22:26:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24a7fc700 1 -- 172.21.15.154:0/1172393718 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c004390 con 0x7fc24c09e870 2023-09-30T22:26:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.667+0000 7fc24a7fc700 1 -- 172.21.15.154:0/1172393718 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0036a0 con 0x7fc24c09e870 2023-09-30T22:26:53.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.668+0000 7fc251a90700 1 -- 172.21.15.154:0/1172393718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 msgr2=0x7fc24c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.668+0000 7fc251a90700 1 --2- 172.21.15.154:0/1172393718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c09ec40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009840 tx=0x7fc23c009b50 comp rx=0 tx=0).stop 2023-09-30T22:26:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.668+0000 7fc251a90700 1 -- 172.21.15.154:0/1172393718 shutdown_connections 2023-09-30T22:26:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.668+0000 7fc251a90700 1 --2- 172.21.15.154:0/1172393718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c09ec40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.668+0000 7fc251a90700 1 --2- 172.21.15.154:0/1172393718 >> v2:172.21.15.154:3300/0 conn(0x7fc24c09f180 0x7fc24c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.668+0000 7fc251a90700 1 -- 172.21.15.154:0/1172393718 >> 172.21.15.154:0/1172393718 conn(0x7fc24c0a4430 msgr2=0x7fc24c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.668+0000 7fc251a90700 1 -- 172.21.15.154:0/1172393718 shutdown_connections 2023-09-30T22:26:53.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.668+0000 7fc251a90700 1 -- 172.21.15.154:0/1172393718 wait complete. 2023-09-30T22:26:53.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc251a90700 1 Processor -- start 2023-09-30T22:26:53.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc251a90700 1 -- start start 2023-09-30T22:26:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc251a90700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc251a90700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09f180 0x7fc24c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc251a90700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c131d70 0x7fc24c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc251a90700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c06d4e0 con 0x7fc24c09f180 2023-09-30T22:26:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc251a90700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0a2d10 con 0x7fc24c09e870 2023-09-30T22:26:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc251a90700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c09dba0 con 0x7fc24c131d70 2023-09-30T22:26:53.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc24b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc24b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38586/0 (socket says 172.21.15.154:38586) 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.669+0000 7fc24b7fe700 1 -- 172.21.15.154:0/967115859 learned_addr learned my addr 172.21.15.154:0/967115859 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc24bfff700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c131d70 0x7fc24c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc24affd700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09f180 0x7fc24c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc24b7fe700 1 -- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c131d70 msgr2=0x7fc24c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc24b7fe700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c131d70 0x7fc24c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc24b7fe700 1 -- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09f180 msgr2=0x7fc24c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc24b7fe700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09f180 0x7fc24c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc24b7fe700 1 -- 172.21.15.154:0/967115859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240009550 con 0x7fc24c09e870 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc24affd700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09f180 0x7fc24c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc24b7fe700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c06b8b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc23c000c00 tx=0x7fc23c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:53.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc233fff700 1 -- 172.21.15.154:0/967115859 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0038a0 con 0x7fc24c09e870 2023-09-30T22:26:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc233fff700 1 -- 172.21.15.154:0/967115859 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c024070 con 0x7fc24c09e870 2023-09-30T22:26:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc233fff700 1 -- 172.21.15.154:0/967115859 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c003c40 con 0x7fc24c09e870 2023-09-30T22:26:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc251a90700 1 -- 172.21.15.154:0/967115859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c0094a0 con 0x7fc24c09e870 2023-09-30T22:26:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.670+0000 7fc251a90700 1 -- 172.21.15.154:0/967115859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c125f40 con 0x7fc24c09e870 2023-09-30T22:26:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.671+0000 7fc233fff700 1 -- 172.21.15.154:0/967115859 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc23c018040 con 0x7fc24c09e870 2023-09-30T22:26:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.671+0000 7fc233fff700 1 -- 172.21.15.154:0/967115859 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc23c047f10 con 0x7fc24c09e870 2023-09-30T22:26:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.672+0000 7fc251a90700 1 -- 172.21.15.154:0/967115859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24c11d580 con 0x7fc24c09e870 2023-09-30T22:26:53.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.676+0000 7fc233fff700 1 -- 172.21.15.154:0/967115859 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc23c011630 con 0x7fc24c09e870 2023-09-30T22:26:53.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.679+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1045914350 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2ac04f2a0 con 0x7fa2ac136960 2023-09-30T22:26:53.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.679+0000 7fa2a1ffb700 1 -- 172.21.15.154:0/1045914350 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa29c0239c0 con 0x7fa2ac136960 2023-09-30T22:26:53.679 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:53.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.682+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 msgr2=0x7fa2ac12d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.682+0000 7fa2b34f2700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac12d070 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa29c016000 tx=0x7fa29c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:53.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.682+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1045914350 shutdown_connections 2023-09-30T22:26:53.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.682+0000 7fa2b34f2700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2ac139280 0x7fa2ac12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.682+0000 7fa2b34f2700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2ac133ad0 0x7fa2ac12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.682+0000 7fa2b34f2700 1 --2- 172.21.15.154:0/1045914350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2ac136960 0x7fa2ac12d070 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.682+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1045914350 >> 172.21.15.154:0/1045914350 conn(0x7fa2ac099c40 msgr2=0x7fa2ac134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.682+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1045914350 shutdown_connections 2023-09-30T22:26:53.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.682+0000 7fa2b34f2700 1 -- 172.21.15.154:0/1045914350 wait complete. 2023-09-30T22:26:53.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:53.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.829+0000 7f06c5f79700 1 -- 172.21.15.154:0/1235135244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f06c004f2a0 con 0x7f06c0138040 2023-09-30T22:26:53.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.830+0000 7f06a7fff700 1 -- 172.21.15.154:0/1235135244 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06b0017030 con 0x7f06c0138040 2023-09-30T22:26:53.830 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:53.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f9e36028700 1 -- 172.21.15.154:0/1065083691 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e30072260 con 0x7f9e30135f80 2023-09-30T22:26:53.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f06c5f79700 1 -- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c0138040 msgr2=0x7f06c0121600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f06c5f79700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c0138040 0x7f06c0121600 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c500 tx=0x7f06b000c810 comp rx=0 tx=0).stop 2023-09-30T22:26:53.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f06c5f79700 1 -- 172.21.15.154:0/1235135244 shutdown_connections 2023-09-30T22:26:53.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f06c5f79700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c013dd10 0x7f06c0122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f06c5f79700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c0138040 0x7f06c0121600 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f06c5f79700 1 --2- 172.21.15.154:0/1235135244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06c0138410 0x7f06c0121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f06c5f79700 1 -- 172.21.15.154:0/1235135244 >> 172.21.15.154:0/1235135244 conn(0x7f06c00a2980 msgr2=0x7f06c009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f9e17fff700 1 -- 172.21.15.154:0/1065083691 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e28029080 con 0x7f9e30135f80 2023-09-30T22:26:53.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f06c5f79700 1 -- 172.21.15.154:0/1235135244 shutdown_connections 2023-09-30T22:26:53.833 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:53.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.832+0000 7f06c5f79700 1 -- 172.21.15.154:0/1235135244 wait complete. 2023-09-30T22:26:53.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.834+0000 7f9e36028700 1 -- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 msgr2=0x7f9e3009f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.834+0000 7f9e36028700 1 --2- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e3009f140 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9e28012000 tx=0x7f9e28004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.834+0000 7f9e36028700 1 -- 172.21.15.154:0/1065083691 shutdown_connections 2023-09-30T22:26:53.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.834+0000 7f9e36028700 1 --2- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e30135f80 0x7f9e3009f140 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.834+0000 7f9e36028700 1 --2- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e30099e20 0x7f9e3009e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.834+0000 7f9e36028700 1 --2- 172.21.15.154:0/1065083691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e30133660 0x7f9e3009ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.834+0000 7f9e36028700 1 -- 172.21.15.154:0/1065083691 >> 172.21.15.154:0/1065083691 conn(0x7f9e300a2980 msgr2=0x7f9e301324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.834+0000 7f9e36028700 1 -- 172.21.15.154:0/1065083691 shutdown_connections 2023-09-30T22:26:53.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.834+0000 7f9e36028700 1 -- 172.21.15.154:0/1065083691 wait complete. 2023-09-30T22:26:53.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:53.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:53.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.869+0000 7fc251a90700 1 -- 172.21.15.154:0/967115859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc24c125d80 con 0x7fc24c09e870 2023-09-30T22:26:53.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.870+0000 7fc233fff700 1 -- 172.21.15.154:0/967115859 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc23c032ed0 con 0x7fc24c09e870 2023-09-30T22:26:53.869 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.872+0000 7fc251a90700 1 -- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 msgr2=0x7fc24c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.872+0000 7fc251a90700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c06b8b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc23c000c00 tx=0x7fc23c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.872+0000 7fc251a90700 1 -- 172.21.15.154:0/967115859 shutdown_connections 2023-09-30T22:26:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.872+0000 7fc251a90700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc24c131d70 0x7fc24c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.872+0000 7fc251a90700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc24c09e870 0x7fc24c06b8b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.872+0000 7fc251a90700 1 --2- 172.21.15.154:0/967115859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc24c09f180 0x7fc24c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:53.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.872+0000 7fc251a90700 1 -- 172.21.15.154:0/967115859 >> 172.21.15.154:0/967115859 conn(0x7fc24c0a4430 msgr2=0x7fc24c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:53.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.872+0000 7fc251a90700 1 -- 172.21.15.154:0/967115859 shutdown_connections 2023-09-30T22:26:53.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:53.872+0000 7fc251a90700 1 -- 172.21.15.154:0/967115859 wait complete. 2023-09-30T22:26:53.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:54.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:54.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.834+0000 7f167c5d7700 1 Processor -- start 2023-09-30T22:26:54.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.834+0000 7f167c5d7700 1 -- start start 2023-09-30T22:26:54.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f167c5d7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1674133ad0 0x7f1674133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f167c5d7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16741300a0 0x7f16741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f167c5d7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167406b2d0 con 0x7f16741309f0 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f167c5d7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1674133610 con 0x7f1674133ad0 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f167c5d7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167409a500 con 0x7f16741300a0 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f1679b72700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16741300a0 0x7f16741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f1679b72700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16741300a0 0x7f16741304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38596/0 (socket says 172.21.15.154:38596) 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f167a373700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1674133ad0 0x7f1674133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f1679b72700 1 -- 172.21.15.154:0/976382276 learned_addr learned my addr 172.21.15.154:0/976382276 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f1679b72700 1 -- 172.21.15.154:0/976382276 >> v2:172.21.15.154:3300/0 conn(0x7f1674133ad0 msgr2=0x7f1674133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:54.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f1679b72700 1 --2- 172.21.15.154:0/976382276 >> v2:172.21.15.154:3300/0 conn(0x7f1674133ad0 0x7f1674133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f1679b72700 1 -- 172.21.15.154:0/976382276 >> v1:172.21.15.154:6789/0 conn(0x7f16741309f0 legacy=0x7f167413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f1679b72700 1 -- 172.21.15.154:0/976382276 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16741338b0 con 0x7f16741300a0 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.835+0000 7f167a373700 1 --2- 172.21.15.154:0/976382276 >> v2:172.21.15.154:3300/0 conn(0x7f1674133ad0 0x7f1674133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f1679b72700 1 --2- 172.21.15.154:0/976382276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16741300a0 0x7f16741304b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f16700098f0 tx=0x7f1670009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d49b3235df91902e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f1679371700 1 -- 172.21.15.154:0/976382276 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670011830 con 0x7f16741300a0 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f1679371700 1 -- 172.21.15.154:0/976382276 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1670011990 con 0x7f16741300a0 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f1679371700 1 -- 172.21.15.154:0/976382276 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670011d20 con 0x7f16741300a0 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f167c5d7700 1 -- 172.21.15.154:0/976382276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16741300a0 msgr2=0x7f16741304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f167c5d7700 1 --2- 172.21.15.154:0/976382276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16741300a0 0x7f16741304b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f16700098f0 tx=0x7f1670009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f167c5d7700 1 -- 172.21.15.154:0/976382276 shutdown_connections 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f167c5d7700 1 --2- 172.21.15.154:0/976382276 >> v2:172.21.15.154:3300/0 conn(0x7f1674133ad0 0x7f1674133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f167c5d7700 1 --2- 172.21.15.154:0/976382276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16741300a0 0x7f16741304b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f167c5d7700 1 -- 172.21.15.154:0/976382276 >> 172.21.15.154:0/976382276 conn(0x7f1674099c40 msgr2=0x7f16740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:54.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f167c5d7700 1 -- 172.21.15.154:0/976382276 shutdown_connections 2023-09-30T22:26:54.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.836+0000 7f167c5d7700 1 -- 172.21.15.154:0/976382276 wait complete. 2023-09-30T22:26:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.837+0000 7f167c5d7700 1 Processor -- start 2023-09-30T22:26:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.837+0000 7f167c5d7700 1 -- start start 2023-09-30T22:26:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167c5d7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741300a0 0x7f167411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167c5d7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16741309f0 0x7f167411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167c5d7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1674133ad0 0x7f167411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167c5d7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167412fdf0 con 0x7f16741300a0 2023-09-30T22:26:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167c5d7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167412dd00 con 0x7f1674133ad0 2023-09-30T22:26:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167c5d7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1674072380 con 0x7f16741309f0 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167a373700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741300a0 0x7f167411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167a373700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741300a0 0x7f167411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60084/0 (socket says 172.21.15.154:60084) 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167ab74700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1674133ad0 0x7f167411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167a373700 1 -- 172.21.15.154:0/3669765939 learned_addr learned my addr 172.21.15.154:0/3669765939 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f1679b72700 1 --2- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16741309f0 0x7f167411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167a373700 1 -- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16741309f0 msgr2=0x7f167411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167a373700 1 --2- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16741309f0 0x7f167411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167a373700 1 -- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1674133ad0 msgr2=0x7f167411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167a373700 1 --2- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1674133ad0 0x7f167411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167a373700 1 -- 172.21.15.154:0/3669765939 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16640094a0 con 0x7f16741300a0 2023-09-30T22:26:54.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.838+0000 7f167a373700 1 --2- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741300a0 0x7f167411da40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f166400ebe0 tx=0x7f166400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:54.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.839+0000 7f166affd700 1 -- 172.21.15.154:0/3669765939 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166400c850 con 0x7f16741300a0 2023-09-30T22:26:54.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.839+0000 7f166affd700 1 -- 172.21.15.154:0/3669765939 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166400c9b0 con 0x7f16741300a0 2023-09-30T22:26:54.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.839+0000 7f167c5d7700 1 -- 172.21.15.154:0/3669765939 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1670009550 con 0x7f16741300a0 2023-09-30T22:26:54.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.839+0000 7f166affd700 1 -- 172.21.15.154:0/3669765939 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166400cd40 con 0x7f16741300a0 2023-09-30T22:26:54.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.839+0000 7f167c5d7700 1 -- 172.21.15.154:0/3669765939 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167411ff20 con 0x7f16741300a0 2023-09-30T22:26:54.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.839+0000 7f166affd700 1 -- 172.21.15.154:0/3669765939 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1664013470 con 0x7f16741300a0 2023-09-30T22:26:54.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.839+0000 7f167c5d7700 1 -- 172.21.15.154:0/3669765939 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167404f2a0 con 0x7f16741300a0 2023-09-30T22:26:54.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.840+0000 7f166affd700 1 -- 172.21.15.154:0/3669765939 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f166403fb30 con 0x7f16741300a0 2023-09-30T22:26:54.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.844+0000 7f166affd700 1 -- 172.21.15.154:0/3669765939 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1664017080 con 0x7f16741300a0 2023-09-30T22:26:54.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:54.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:54.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.986+0000 7fba21a1f700 1 Processor -- start 2023-09-30T22:26:54.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.986+0000 7fba21a1f700 1 -- start start 2023-09-30T22:26:54.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba21a1f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c133900 0x7fba1c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba21a1f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c134210 0x7fba1c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba21a1f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba1c0a0ee0 0x7fba1c0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba21a1f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c09a760 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba21a1f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c1336e0 con 0x7fba1c134210 2023-09-30T22:26:54.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba21a1f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c09a080 con 0x7fba1c133900 2023-09-30T22:26:54.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c134210 0x7fba1c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:54.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba1c0a0ee0 0x7fba1c0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:54.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c134210 0x7fba1c0a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38612/0 (socket says 172.21.15.154:38612) 2023-09-30T22:26:54.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1a7fc700 1 -- 172.21.15.154:0/4267578244 learned_addr learned my addr 172.21.15.154:0/4267578244 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:54.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1a7fc700 1 -- 172.21.15.154:0/4267578244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c133900 msgr2=0x7fba1c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1a7fc700 1 --2- 172.21.15.154:0/4267578244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c133900 0x7fba1c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1a7fc700 1 -- 172.21.15.154:0/4267578244 >> v2:172.21.15.154:3300/0 conn(0x7fba1c0a0ee0 msgr2=0x7fba1c0a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1a7fc700 1 --2- 172.21.15.154:0/4267578244 >> v2:172.21.15.154:3300/0 conn(0x7fba1c0a0ee0 0x7fba1c0a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1a7fc700 1 -- 172.21.15.154:0/4267578244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0a23e0 con 0x7fba1c134210 2023-09-30T22:26:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.987+0000 7fba1b7fe700 1 --2- 172.21.15.154:0/4267578244 >> v2:172.21.15.154:3300/0 conn(0x7fba1c0a0ee0 0x7fba1c0a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.988+0000 7fba1a7fc700 1 --2- 172.21.15.154:0/4267578244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c134210 0x7fba1c0a09a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fba100098f0 tx=0x7fba10009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5691a0368b1592a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.988+0000 7fba19ffb700 1 -- 172.21.15.154:0/4267578244 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10011830 con 0x7fba1c134210 2023-09-30T22:26:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.988+0000 7fba19ffb700 1 -- 172.21.15.154:0/4267578244 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba10011990 con 0x7fba1c134210 2023-09-30T22:26:54.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.988+0000 7fba19ffb700 1 -- 172.21.15.154:0/4267578244 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10011d20 con 0x7fba1c134210 2023-09-30T22:26:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.988+0000 7fba21a1f700 1 -- 172.21.15.154:0/4267578244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c134210 msgr2=0x7fba1c0a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.989+0000 7fba21a1f700 1 --2- 172.21.15.154:0/4267578244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c134210 0x7fba1c0a09a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fba100098f0 tx=0x7fba10009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.989+0000 7fba21a1f700 1 -- 172.21.15.154:0/4267578244 shutdown_connections 2023-09-30T22:26:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.989+0000 7fba21a1f700 1 --2- 172.21.15.154:0/4267578244 >> v2:172.21.15.154:3300/0 conn(0x7fba1c0a0ee0 0x7fba1c0a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.989+0000 7fba21a1f700 1 --2- 172.21.15.154:0/4267578244 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c133900 0x7fba1c133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.989+0000 7fba21a1f700 1 --2- 172.21.15.154:0/4267578244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c134210 0x7fba1c0a09a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.989+0000 7fba21a1f700 1 -- 172.21.15.154:0/4267578244 >> 172.21.15.154:0/4267578244 conn(0x7fba1c0a2980 msgr2=0x7fba1c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.989+0000 7fba21a1f700 1 -- 172.21.15.154:0/4267578244 shutdown_connections 2023-09-30T22:26:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.989+0000 7fba21a1f700 1 -- 172.21.15.154:0/4267578244 wait complete. 2023-09-30T22:26:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.990+0000 7fba21a1f700 1 Processor -- start 2023-09-30T22:26:54.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.990+0000 7fba21a1f700 1 -- start start 2023-09-30T22:26:54.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba21a1f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c0a0ee0 0x7fba1c11c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba21a1f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c133900 0x7fba1c11cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba21a1f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c134210 0x7fba1c11d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:54.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba21a1f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c120270 con 0x7fba1c133900 2023-09-30T22:26:54.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba21a1f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c11dbb0 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba21a1f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c11e400 con 0x7fba1c134210 2023-09-30T22:26:54.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba1affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c0a0ee0 0x7fba1c11c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:54.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba1affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c0a0ee0 0x7fba1c11c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:38622/0 (socket says 172.21.15.154:38622) 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba1affd700 1 -- 172.21.15.154:0/1646659468 learned_addr learned my addr 172.21.15.154:0/1646659468 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba1a7fc700 1 --2- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c133900 0x7fba1c11cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba1affd700 1 -- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c134210 msgr2=0x7fba1c11d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.991+0000 7fba1affd700 1 --2- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c134210 0x7fba1c11d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba1affd700 1 -- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c133900 msgr2=0x7fba1c11cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba1affd700 1 --2- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c133900 0x7fba1c11cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba1affd700 1 -- 172.21.15.154:0/1646659468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba14009a70 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba1a7fc700 1 --2- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c133900 0x7fba1c11cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba1affd700 1 --2- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c0a0ee0 0x7fba1c11c750 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00b4a0 tx=0x7fba0c00b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:54.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba03fff700 1 -- 172.21.15.154:0/1646659468 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c005aa0 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba03fff700 1 -- 172.21.15.154:0/1646659468 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c005c00 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba21a1f700 1 -- 172.21.15.154:0/1646659468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba10009550 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba03fff700 1 -- 172.21.15.154:0/1646659468 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c011630 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.992+0000 7fba21a1f700 1 -- 172.21.15.154:0/1646659468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c11f620 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.993+0000 7fba03fff700 1 -- 172.21.15.154:0/1646659468 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba0c011790 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.993+0000 7fba03fff700 1 -- 172.21.15.154:0/1646659468 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba0c03f230 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.993+0000 7fba21a1f700 1 -- 172.21.15.154:0/1646659468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c04f2a0 con 0x7fba1c0a0ee0 2023-09-30T22:26:54.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:54.998+0000 7fba03fff700 1 -- 172.21.15.154:0/1646659468 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba0c005fd0 con 0x7fba1c0a0ee0 2023-09-30T22:26:55.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.018+0000 7f764a197700 1 Processor -- start 2023-09-30T22:26:55.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.018+0000 7f764a197700 1 -- start start 2023-09-30T22:26:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.018+0000 7f764a197700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f764409d860 0x7f764409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.018+0000 7f764a197700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409e170 0x7f76441307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.018+0000 7f764a197700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7644130ce0 0x7f7644131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.018+0000 7f764a197700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7644131670 con 0x7f764409d860 2023-09-30T22:26:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.018+0000 7f764a197700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764409aaa0 con 0x7f7644130ce0 2023-09-30T22:26:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.018+0000 7f764a197700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f764409f870 con 0x7f764409e170 2023-09-30T22:26:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7642ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409e170 0x7f76441307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7642ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409e170 0x7f76441307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47218/0 (socket says 172.21.15.154:47218) 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7643fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7644130ce0 0x7f7644131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7642ffd700 1 -- 172.21.15.154:0/156378510 learned_addr learned my addr 172.21.15.154:0/156378510 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7642ffd700 1 -- 172.21.15.154:0/156378510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7644130ce0 msgr2=0x7f7644131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7642ffd700 1 --2- 172.21.15.154:0/156378510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7644130ce0 0x7f7644131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7642ffd700 1 -- 172.21.15.154:0/156378510 >> v2:172.21.15.154:3300/0 conn(0x7f764409d860 msgr2=0x7f764409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7642ffd700 1 --2- 172.21.15.154:0/156378510 >> v2:172.21.15.154:3300/0 conn(0x7f764409d860 0x7f764409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7642ffd700 1 -- 172.21.15.154:0/156378510 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764409b360 con 0x7f764409e170 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7643fff700 1 --2- 172.21.15.154:0/156378510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7644130ce0 0x7f7644131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f7642ffd700 1 --2- 172.21.15.154:0/156378510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409e170 0x7f76441307a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f763800bbc0 tx=0x7f763800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=389b5046d6fa46e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f76427fc700 1 -- 172.21.15.154:0/156378510 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763800dcf0 con 0x7f764409e170 2023-09-30T22:26:55.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f76427fc700 1 -- 172.21.15.154:0/156378510 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763800de50 con 0x7f764409e170 2023-09-30T22:26:55.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.019+0000 7f76427fc700 1 -- 172.21.15.154:0/156378510 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638010690 con 0x7f764409e170 2023-09-30T22:26:55.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.020+0000 7f764a197700 1 -- 172.21.15.154:0/156378510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409e170 msgr2=0x7f76441307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.020+0000 7f764a197700 1 --2- 172.21.15.154:0/156378510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409e170 0x7f76441307a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f763800bbc0 tx=0x7f763800bed0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.020+0000 7f764a197700 1 -- 172.21.15.154:0/156378510 shutdown_connections 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.020+0000 7f764a197700 1 --2- 172.21.15.154:0/156378510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7644130ce0 0x7f7644131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.020+0000 7f764a197700 1 --2- 172.21.15.154:0/156378510 >> v2:172.21.15.154:3300/0 conn(0x7f764409d860 0x7f764409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.020+0000 7f764a197700 1 --2- 172.21.15.154:0/156378510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409e170 0x7f76441307a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.020+0000 7f764a197700 1 -- 172.21.15.154:0/156378510 >> 172.21.15.154:0/156378510 conn(0x7f7644099c40 msgr2=0x7f76440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.020+0000 7f764a197700 1 -- 172.21.15.154:0/156378510 shutdown_connections 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.020+0000 7f764a197700 1 -- 172.21.15.154:0/156378510 wait complete. 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.022+0000 7f764a197700 1 Processor -- start 2023-09-30T22:26:55.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.022+0000 7f764a197700 1 -- start start 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f764a197700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409d860 0x7f76441203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f764a197700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f764409e170 0x7f7644120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f764a197700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7644130ce0 0x7f7644120e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f764a197700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764412e320 con 0x7f7644130ce0 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f764a197700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7644122020 con 0x7f764409e170 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f764a197700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7644123bb0 con 0x7f764409d860 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f76437fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409d860 0x7f76441203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f76437fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409d860 0x7f76441203e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47232/0 (socket says 172.21.15.154:47232) 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f76437fe700 1 -- 172.21.15.154:0/4030560540 learned_addr learned my addr 172.21.15.154:0/4030560540 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f7642ffd700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f764409e170 0x7f7644120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f7643fff700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7644130ce0 0x7f7644120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f76437fe700 1 -- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f764409e170 msgr2=0x7f7644120920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f76437fe700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f764409e170 0x7f7644120920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f76437fe700 1 -- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7644130ce0 msgr2=0x7f7644120e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f76437fe700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7644130ce0 0x7f7644120e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f76437fe700 1 -- 172.21.15.154:0/4030560540 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c009a70 con 0x7f764409d860 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f7642ffd700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f764409e170 0x7f7644120920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.023+0000 7f76437fe700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409d860 0x7f76441203e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f763400b4a0 tx=0x7f763400b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.024+0000 7f762bfff700 1 -- 172.21.15.154:0/4030560540 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400bea0 con 0x7f764409d860 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.024+0000 7f762bfff700 1 -- 172.21.15.154:0/4030560540 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634011830 con 0x7f764409d860 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.024+0000 7f764a197700 1 -- 172.21.15.154:0/4030560540 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763800b7f0 con 0x7f764409d860 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.024+0000 7f764a197700 1 -- 172.21.15.154:0/4030560540 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7644122770 con 0x7f764409d860 2023-09-30T22:26:55.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.024+0000 7f762bfff700 1 -- 172.21.15.154:0/4030560540 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634011bc0 con 0x7f764409d860 2023-09-30T22:26:55.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.025+0000 7f762bfff700 1 -- 172.21.15.154:0/4030560540 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7634011d20 con 0x7f764409d860 2023-09-30T22:26:55.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.025+0000 7f764a197700 1 -- 172.21.15.154:0/4030560540 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76240052e0 con 0x7f764409d860 2023-09-30T22:26:55.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.026+0000 7f762bfff700 1 -- 172.21.15.154:0/4030560540 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f763403f4a0 con 0x7f764409d860 2023-09-30T22:26:55.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.030+0000 7f762bfff700 1 -- 172.21.15.154:0/4030560540 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f763400f2e0 con 0x7f764409d860 2023-09-30T22:26:55.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.043+0000 7f3f49f14700 1 Processor -- start 2023-09-30T22:26:55.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.043+0000 7f3f49f14700 1 -- start start 2023-09-30T22:26:55.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f49f14700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f44136960 0x7f3f44138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f49f14700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44139280 0x7f3f4413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f49f14700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4406b2d0 con 0x7f3f44133ad0 2023-09-30T22:26:55.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f49f14700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f441345b0 con 0x7f3f44136960 2023-09-30T22:26:55.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f49f14700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44133610 con 0x7f3f44139280 2023-09-30T22:26:55.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f42ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f44136960 0x7f3f44138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f42ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f44136960 0x7f3f44138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60148/0 (socket says 172.21.15.154:60148) 2023-09-30T22:26:55.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f42ffd700 1 -- 172.21.15.154:0/3191262130 learned_addr learned my addr 172.21.15.154:0/3191262130 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:55.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f43fff700 1 --2- 172.21.15.154:0/3191262130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44139280 0x7f3f4413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f43fff700 1 -- 172.21.15.154:0/3191262130 >> v2:172.21.15.154:3300/0 conn(0x7f3f44136960 msgr2=0x7f3f44138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:55.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f43fff700 1 --2- 172.21.15.154:0/3191262130 >> v2:172.21.15.154:3300/0 conn(0x7f3f44136960 0x7f3f44138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f43fff700 1 -- 172.21.15.154:0/3191262130 >> v1:172.21.15.154:6789/0 conn(0x7f3f44133ad0 legacy=0x7f3f44133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f43fff700 1 -- 172.21.15.154:0/3191262130 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4409a500 con 0x7f3f44139280 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f42ffd700 1 --2- 172.21.15.154:0/3191262130 >> v2:172.21.15.154:3300/0 conn(0x7f3f44136960 0x7f3f44138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f43fff700 1 --2- 172.21.15.154:0/3191262130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44139280 0x7f3f4413b660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009d90 tx=0x7f3f3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dc46971fcbf349 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.044+0000 7f3f427fc700 1 -- 172.21.15.154:0/3191262130 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00e070 con 0x7f3f44139280 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.045+0000 7f3f427fc700 1 -- 172.21.15.154:0/3191262130 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00bb20 con 0x7f3f44139280 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.045+0000 7f3f427fc700 1 -- 172.21.15.154:0/3191262130 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c012430 con 0x7f3f44139280 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.045+0000 7f3f49f14700 1 -- 172.21.15.154:0/3191262130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44139280 msgr2=0x7f3f4413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.045+0000 7f3f49f14700 1 --2- 172.21.15.154:0/3191262130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44139280 0x7f3f4413b660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009d90 tx=0x7f3f3c00b330 comp rx=0 tx=0).stop 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.045+0000 7f3f49f14700 1 -- 172.21.15.154:0/3191262130 shutdown_connections 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.045+0000 7f3f49f14700 1 --2- 172.21.15.154:0/3191262130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44139280 0x7f3f4413b660 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.045+0000 7f3f49f14700 1 --2- 172.21.15.154:0/3191262130 >> v2:172.21.15.154:3300/0 conn(0x7f3f44136960 0x7f3f44138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.045+0000 7f3f49f14700 1 -- 172.21.15.154:0/3191262130 >> 172.21.15.154:0/3191262130 conn(0x7f3f44099c40 msgr2=0x7f3f440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.045+0000 7f3f49f14700 1 -- 172.21.15.154:0/3191262130 shutdown_connections 2023-09-30T22:26:55.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.046+0000 7f3f49f14700 1 -- 172.21.15.154:0/3191262130 wait complete. 2023-09-30T22:26:55.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.046+0000 7f3f49f14700 1 Processor -- start 2023-09-30T22:26:55.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f49f14700 1 -- start start 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f49f14700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44133ad0 0x7f3f44070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f49f14700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f44136960 0x7f3f440714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f49f14700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f44139280 0x7f3f44071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f49f14700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440700f0 con 0x7f3f44136960 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f49f14700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44072060 con 0x7f3f44133ad0 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f49f14700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4412dd00 con 0x7f3f44139280 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f42ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f44136960 0x7f3f440714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f42ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f44136960 0x7f3f440714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60160/0 (socket says 172.21.15.154:60160) 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f43fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f44139280 0x7f3f44071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f42ffd700 1 -- 172.21.15.154:0/3512852610 learned_addr learned my addr 172.21.15.154:0/3512852610 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.047+0000 7f3f437fe700 1 --2- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44133ad0 0x7f3f44070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f42ffd700 1 -- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f44139280 msgr2=0x7f3f44071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f42ffd700 1 --2- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f44139280 0x7f3f44071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f42ffd700 1 -- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44133ad0 msgr2=0x7f3f44070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f42ffd700 1 --2- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44133ad0 0x7f3f44070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f42ffd700 1 -- 172.21.15.154:0/3512852610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f38009550 con 0x7f3f44136960 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f42ffd700 1 --2- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f44136960 0x7f3f440714f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800e9b0 tx=0x7f3f3800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f2bfff700 1 -- 172.21.15.154:0/3512852610 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800ee50 con 0x7f3f44136960 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f2bfff700 1 -- 172.21.15.154:0/3512852610 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3800c850 con 0x7f3f44136960 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f2bfff700 1 -- 172.21.15.154:0/3512852610 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800cbc0 con 0x7f3f44136960 2023-09-30T22:26:55.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f49f14700 1 -- 172.21.15.154:0/3512852610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c009a70 con 0x7f3f44136960 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.048+0000 7f3f49f14700 1 -- 172.21.15.154:0/3512852610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f44072300 con 0x7f3f44136960 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.049+0000 7f3f2bfff700 1 -- 172.21.15.154:0/3512852610 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f3800cd20 con 0x7f3f44136960 2023-09-30T22:26:55.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.049+0000 7f167c5d7700 1 -- 172.21.15.154:0/3669765939 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f167406c3b0 con 0x7f16741300a0 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.050+0000 7f3f49f14700 1 -- 172.21.15.154:0/3512852610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f44070c20 con 0x7f3f44136960 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.050+0000 7f3f2bfff700 1 -- 172.21.15.154:0/3512852610 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f3801a360 con 0x7f3f44136960 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.050+0000 7f166affd700 1 -- 172.21.15.154:0/3669765939 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1664038090 con 0x7f16741300a0 2023-09-30T22:26:55.052 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.052+0000 7f167c5d7700 1 -- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741300a0 msgr2=0x7f167411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.052+0000 7f167c5d7700 1 --2- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741300a0 0x7f167411da40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f166400ebe0 tx=0x7f166400eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.054+0000 7f167c5d7700 1 -- 172.21.15.154:0/3669765939 shutdown_connections 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.054+0000 7f167c5d7700 1 --2- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1674133ad0 0x7f167411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.054+0000 7f167c5d7700 1 --2- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16741300a0 0x7f167411da40 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.054+0000 7f167c5d7700 1 --2- 172.21.15.154:0/3669765939 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f16741309f0 0x7f167411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.054+0000 7f167c5d7700 1 -- 172.21.15.154:0/3669765939 >> 172.21.15.154:0/3669765939 conn(0x7f1674099c40 msgr2=0x7f1674131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.055+0000 7f3f2bfff700 1 -- 172.21.15.154:0/3512852610 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f38017070 con 0x7f3f44136960 2023-09-30T22:26:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.055+0000 7f167c5d7700 1 -- 172.21.15.154:0/3669765939 shutdown_connections 2023-09-30T22:26:55.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.055+0000 7f167c5d7700 1 -- 172.21.15.154:0/3669765939 wait complete. 2023-09-30T22:26:55.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:55.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.221+0000 7fba21a1f700 1 -- 172.21.15.154:0/1646659468 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba1c06bce0 con 0x7fba1c0a0ee0 2023-09-30T22:26:55.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.222+0000 7fba03fff700 1 -- 172.21.15.154:0/1646659468 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba0c029090 con 0x7fba1c0a0ee0 2023-09-30T22:26:55.222 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:55.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.224+0000 7fba21a1f700 1 -- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c0a0ee0 msgr2=0x7fba1c11c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.224+0000 7fba21a1f700 1 --2- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c0a0ee0 0x7fba1c11c750 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00b4a0 tx=0x7fba0c00b7b0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.224+0000 7fba21a1f700 1 -- 172.21.15.154:0/1646659468 shutdown_connections 2023-09-30T22:26:55.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.224+0000 7fba21a1f700 1 --2- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c134210 0x7fba1c11d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.224+0000 7fba21a1f700 1 --2- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c0a0ee0 0x7fba1c11c750 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.224+0000 7fba21a1f700 1 --2- 172.21.15.154:0/1646659468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c133900 0x7fba1c11cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.224+0000 7fba21a1f700 1 -- 172.21.15.154:0/1646659468 >> 172.21.15.154:0/1646659468 conn(0x7fba1c0a2980 msgr2=0x7fba1c1badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.224+0000 7fba21a1f700 1 -- 172.21.15.154:0/1646659468 shutdown_connections 2023-09-30T22:26:55.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.224+0000 7fba21a1f700 1 -- 172.21.15.154:0/1646659468 wait complete. 2023-09-30T22:26:55.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.235+0000 7f764a197700 1 -- 172.21.15.154:0/4030560540 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7624005590 con 0x7f764409d860 2023-09-30T22:26:55.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.235+0000 7f762bfff700 1 -- 172.21.15.154:0/4030560540 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7634021ab0 con 0x7f764409d860 2023-09-30T22:26:55.235 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:55.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:55.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.238+0000 7f764a197700 1 -- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409d860 msgr2=0x7f76441203e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.238+0000 7f764a197700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409d860 0x7f76441203e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f763400b4a0 tx=0x7f763400b7b0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.238+0000 7f764a197700 1 -- 172.21.15.154:0/4030560540 shutdown_connections 2023-09-30T22:26:55.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.238+0000 7f764a197700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7644130ce0 0x7f7644120e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.238+0000 7f764a197700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f764409d860 0x7f76441203e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.238+0000 7f764a197700 1 --2- 172.21.15.154:0/4030560540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f764409e170 0x7f7644120920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.238+0000 7f764a197700 1 -- 172.21.15.154:0/4030560540 >> 172.21.15.154:0/4030560540 conn(0x7f7644099c40 msgr2=0x7f76441300a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.239+0000 7f764a197700 1 -- 172.21.15.154:0/4030560540 shutdown_connections 2023-09-30T22:26:55.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.239+0000 7f764a197700 1 -- 172.21.15.154:0/4030560540 wait complete. 2023-09-30T22:26:55.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:55.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.261+0000 7f3f49f14700 1 -- 172.21.15.154:0/3512852610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f440702a0 con 0x7f3f44136960 2023-09-30T22:26:55.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.262+0000 7f3f2bfff700 1 -- 172.21.15.154:0/3512852610 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f440702a0 con 0x7f3f44136960 2023-09-30T22:26:55.262 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.264+0000 7f3f49f14700 1 -- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f44136960 msgr2=0x7f3f440714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.264+0000 7f3f49f14700 1 --2- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f44136960 0x7f3f440714f0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800e9b0 tx=0x7f3f3800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.264+0000 7f3f49f14700 1 -- 172.21.15.154:0/3512852610 shutdown_connections 2023-09-30T22:26:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.264+0000 7f3f49f14700 1 --2- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f44139280 0x7f3f44071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.264+0000 7f3f49f14700 1 --2- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f44133ad0 0x7f3f44070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.264+0000 7f3f49f14700 1 --2- 172.21.15.154:0/3512852610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f44136960 0x7f3f440714f0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:55.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.264+0000 7f3f49f14700 1 -- 172.21.15.154:0/3512852610 >> 172.21.15.154:0/3512852610 conn(0x7f3f44099c40 msgr2=0x7f3f44134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:55.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.264+0000 7f3f49f14700 1 -- 172.21.15.154:0/3512852610 shutdown_connections 2023-09-30T22:26:55.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:55.264+0000 7f3f49f14700 1 -- 172.21.15.154:0/3512852610 wait complete. 2023-09-30T22:26:55.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:56.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:56.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.207+0000 7f1c62a31700 1 Processor -- start 2023-09-30T22:26:56.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.207+0000 7f1c62a31700 1 -- start start 2023-09-30T22:26:56.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.207+0000 7f1c62a31700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c09e950 0x7f1c5c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.207+0000 7f1c62a31700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09f260 0x7f1c5c137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.207+0000 7f1c62a31700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c5c138180 0x7f1c5c13a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.207+0000 7f1c62a31700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c0a06a0 con 0x7f1c5c138180 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.207+0000 7f1c62a31700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0a0150 con 0x7f1c5c09f260 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.207+0000 7f1c62a31700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c06b920 con 0x7f1c5c09e950 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c09e950 0x7f1c5c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09f260 0x7f1c5c137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c60fce700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c5c138180 0x7f1c5c13a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c09e950 0x7f1c5c09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51342/0 (socket says 172.21.15.154:51342) 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09f260 0x7f1c5c137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32888/0 (socket says 172.21.15.154:32888) 2023-09-30T22:26:56.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5bfff700 1 -- 172.21.15.154:0/4169700815 learned_addr learned my addr 172.21.15.154:0/4169700815 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:56.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5b7fe700 1 -- 172.21.15.154:0/4169700815 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c09e950 msgr2=0x7f1c5c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5b7fe700 1 --2- 172.21.15.154:0/4169700815 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c09e950 0x7f1c5c09ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5b7fe700 1 -- 172.21.15.154:0/4169700815 >> v2:172.21.15.154:3300/0 conn(0x7f1c5c138180 msgr2=0x7f1c5c13a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5b7fe700 1 --2- 172.21.15.154:0/4169700815 >> v2:172.21.15.154:3300/0 conn(0x7f1c5c138180 0x7f1c5c13a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5b7fe700 1 -- 172.21.15.154:0/4169700815 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c06d8e0 con 0x7f1c5c09f260 2023-09-30T22:26:56.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5bfff700 1 --2- 172.21.15.154:0/4169700815 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c09e950 0x7f1c5c09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c60fce700 1 --2- 172.21.15.154:0/4169700815 >> v2:172.21.15.154:3300/0 conn(0x7f1c5c138180 0x7f1c5c13a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5b7fe700 1 --2- 172.21.15.154:0/4169700815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09f260 0x7f1c5c137c40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0130a0 tx=0x7f1c4c0133b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6370c2bc72406e3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5affd700 1 -- 172.21.15.154:0/4169700815 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c016070 con 0x7f1c5c09f260 2023-09-30T22:26:56.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5affd700 1 -- 172.21.15.154:0/4169700815 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c013cc0 con 0x7f1c5c09f260 2023-09-30T22:26:56.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.208+0000 7f1c5affd700 1 -- 172.21.15.154:0/4169700815 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c005c40 con 0x7f1c5c09f260 2023-09-30T22:26:56.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.209+0000 7f1c62a31700 1 -- 172.21.15.154:0/4169700815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09f260 msgr2=0x7f1c5c137c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.209+0000 7f1c62a31700 1 --2- 172.21.15.154:0/4169700815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09f260 0x7f1c5c137c40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0130a0 tx=0x7f1c4c0133b0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.209+0000 7f1c62a31700 1 -- 172.21.15.154:0/4169700815 shutdown_connections 2023-09-30T22:26:56.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.209+0000 7f1c62a31700 1 --2- 172.21.15.154:0/4169700815 >> v2:172.21.15.154:3300/0 conn(0x7f1c5c138180 0x7f1c5c13a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.209+0000 7f1c62a31700 1 --2- 172.21.15.154:0/4169700815 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c09e950 0x7f1c5c09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.209+0000 7f1c62a31700 1 --2- 172.21.15.154:0/4169700815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09f260 0x7f1c5c137c40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.209+0000 7f1c62a31700 1 -- 172.21.15.154:0/4169700815 >> 172.21.15.154:0/4169700815 conn(0x7f1c5c0a4470 msgr2=0x7f1c5c0a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.209+0000 7f1c62a31700 1 -- 172.21.15.154:0/4169700815 shutdown_connections 2023-09-30T22:26:56.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.209+0000 7f1c62a31700 1 -- 172.21.15.154:0/4169700815 wait complete. 2023-09-30T22:26:56.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.210+0000 7f1c62a31700 1 Processor -- start 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.210+0000 7f1c62a31700 1 -- start start 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.210+0000 7f1c62a31700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09e950 0x7f1c5c134f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.210+0000 7f1c62a31700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c5c09f260 0x7f1c5c1354b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.210+0000 7f1c62a31700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c138180 0x7f1c5c1359f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.210+0000 7f1c62a31700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c136ed0 con 0x7f1c5c09f260 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.210+0000 7f1c62a31700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c11b220 con 0x7f1c5c09e950 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.210+0000 7f1c62a31700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c137cd0 con 0x7f1c5c138180 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09e950 0x7f1c5c134f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c60fce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c138180 0x7f1c5c1359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c5c09f260 0x7f1c5c1354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09e950 0x7f1c5c134f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32892/0 (socket says 172.21.15.154:32892) 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c60fce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c138180 0x7f1c5c1359f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51344/0 (socket says 172.21.15.154:51344) 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5bfff700 1 -- 172.21.15.154:0/1616080989 learned_addr learned my addr 172.21.15.154:0/1616080989 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5b7fe700 1 -- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c138180 msgr2=0x7f1c5c1359f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5b7fe700 1 --2- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c138180 0x7f1c5c1359f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5b7fe700 1 -- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09e950 msgr2=0x7f1c5c134f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5b7fe700 1 --2- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09e950 0x7f1c5c134f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5b7fe700 1 -- 172.21.15.154:0/1616080989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50009500 con 0x7f1c5c09f260 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c60fce700 1 --2- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c138180 0x7f1c5c1359f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5bfff700 1 --2- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09e950 0x7f1c5c134f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c5b7fe700 1 --2- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c5c09f260 0x7f1c5c1354b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c01c000 tx=0x7f1c4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c58ff9700 1 -- 172.21.15.154:0/1616080989 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c006ee0 con 0x7f1c5c09f260 2023-09-30T22:26:56.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c58ff9700 1 -- 172.21.15.154:0/1616080989 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c005c20 con 0x7f1c5c09f260 2023-09-30T22:26:56.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c58ff9700 1 -- 172.21.15.154:0/1616080989 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00f850 con 0x7f1c5c09f260 2023-09-30T22:26:56.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c62a31700 1 -- 172.21.15.154:0/1616080989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c54009a70 con 0x7f1c5c09f260 2023-09-30T22:26:56.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.211+0000 7f1c62a31700 1 -- 172.21.15.154:0/1616080989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c011cd0 con 0x7f1c5c09f260 2023-09-30T22:26:56.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.212+0000 7f1c58ff9700 1 -- 172.21.15.154:0/1616080989 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c4c00f9b0 con 0x7f1c5c09f260 2023-09-30T22:26:56.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.212+0000 7f1c58ff9700 1 -- 172.21.15.154:0/1616080989 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1c4c048c20 con 0x7f1c5c09f260 2023-09-30T22:26:56.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.212+0000 7f1c62a31700 1 -- 172.21.15.154:0/1616080989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c06ccc0 con 0x7f1c5c09f260 2023-09-30T22:26:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.217+0000 7f1c58ff9700 1 -- 172.21.15.154:0/1616080989 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c4c028070 con 0x7f1c5c09f260 2023-09-30T22:26:56.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:56.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:56.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:56.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.375+0000 7fdaa51cb700 1 Processor -- start 2023-09-30T22:26:56.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.376+0000 7fdaa51cb700 1 -- start start 2023-09-30T22:26:56.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.376+0000 7fdaa51cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa009ad40 0x7fdaa0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.376+0000 7fdaa51cb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa01343a0 0x7fdaa00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.376+0000 7fdaa51cb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa009b110 con 0x7fdaa0133f70 2023-09-30T22:26:56.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.376+0000 7fdaa51cb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa00a3b60 con 0x7fdaa01343a0 2023-09-30T22:26:56.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.376+0000 7fdaa51cb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa00a2fa0 con 0x7fdaa009ad40 2023-09-30T22:26:56.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa009ad40 0x7fdaa0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa009ad40 0x7fdaa0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51354/0 (socket says 172.21.15.154:51354) 2023-09-30T22:26:56.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9ed9d700 1 -- 172.21.15.154:0/950303362 learned_addr learned my addr 172.21.15.154:0/950303362 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:56.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9f59e700 1 --2- 172.21.15.154:0/950303362 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa01343a0 0x7fdaa00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9f59e700 1 -- 172.21.15.154:0/950303362 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa009ad40 msgr2=0x7fdaa0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9f59e700 1 --2- 172.21.15.154:0/950303362 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa009ad40 0x7fdaa0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9f59e700 1 -- 172.21.15.154:0/950303362 >> v1:172.21.15.154:6789/0 conn(0x7fdaa0133f70 legacy=0x7fdaa00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9f59e700 1 -- 172.21.15.154:0/950303362 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa009a280 con 0x7fdaa01343a0 2023-09-30T22:26:56.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9ed9d700 1 --2- 172.21.15.154:0/950303362 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa009ad40 0x7fdaa0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9f59e700 1 --2- 172.21.15.154:0/950303362 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa01343a0 0x7fdaa00a1180 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fda98009dc0 tx=0x7fda9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e85bcb0a2393a41 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9dd9b700 1 -- 172.21.15.154:0/950303362 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9800e070 con 0x7fdaa01343a0 2023-09-30T22:26:56.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9dd9b700 1 -- 172.21.15.154:0/950303362 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9800bb20 con 0x7fdaa01343a0 2023-09-30T22:26:56.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.377+0000 7fda9dd9b700 1 -- 172.21.15.154:0/950303362 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98012430 con 0x7fdaa01343a0 2023-09-30T22:26:56.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.378+0000 7fdaa51cb700 1 -- 172.21.15.154:0/950303362 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa01343a0 msgr2=0x7fdaa00a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.378+0000 7fdaa51cb700 1 --2- 172.21.15.154:0/950303362 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa01343a0 0x7fdaa00a1180 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fda98009dc0 tx=0x7fda9800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:56.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.378+0000 7fdaa51cb700 1 -- 172.21.15.154:0/950303362 shutdown_connections 2023-09-30T22:26:56.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.378+0000 7fdaa51cb700 1 --2- 172.21.15.154:0/950303362 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa01343a0 0x7fdaa00a1180 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.378+0000 7fdaa51cb700 1 --2- 172.21.15.154:0/950303362 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa009ad40 0x7fdaa0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.378+0000 7fdaa51cb700 1 -- 172.21.15.154:0/950303362 >> 172.21.15.154:0/950303362 conn(0x7fdaa0099c40 msgr2=0x7fdaa006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.378+0000 7fdaa51cb700 1 -- 172.21.15.154:0/950303362 shutdown_connections 2023-09-30T22:26:56.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.378+0000 7fdaa51cb700 1 -- 172.21.15.154:0/950303362 wait complete. 2023-09-30T22:26:56.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.380+0000 7fdaa51cb700 1 Processor -- start 2023-09-30T22:26:56.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.380+0000 7fdaa51cb700 1 -- start start 2023-09-30T22:26:56.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fdaa51cb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa009ad40 0x7fdaa011e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fdaa51cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa0133f70 0x7fdaa011e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fdaa51cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa01343a0 0x7fdaa011eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fdaa51cb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa011fc20 con 0x7fdaa01343a0 2023-09-30T22:26:56.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fdaa51cb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0120e70 con 0x7fdaa009ad40 2023-09-30T22:26:56.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fdaa51cb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0120200 con 0x7fdaa0133f70 2023-09-30T22:26:56.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa009ad40 0x7fdaa011e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa009ad40 0x7fdaa011e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32908/0 (socket says 172.21.15.154:32908) 2023-09-30T22:26:56.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9ed9d700 1 -- 172.21.15.154:0/1178032693 learned_addr learned my addr 172.21.15.154:0/1178032693 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:56.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9e59c700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa0133f70 0x7fdaa011e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9f59e700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa01343a0 0x7fdaa011eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9f59e700 1 -- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa0133f70 msgr2=0x7fdaa011e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9f59e700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa0133f70 0x7fdaa011e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9f59e700 1 -- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa009ad40 msgr2=0x7fdaa011e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9f59e700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa009ad40 0x7fdaa011e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9f59e700 1 -- 172.21.15.154:0/1178032693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90009550 con 0x7fdaa01343a0 2023-09-30T22:26:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9ed9d700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa009ad40 0x7fdaa011e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.381+0000 7fda9f59e700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa01343a0 0x7fdaa011eae0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fda98016000 tx=0x7fda98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.382+0000 7fda877fe700 1 -- 172.21.15.154:0/1178032693 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98012430 con 0x7fdaa01343a0 2023-09-30T22:26:56.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.382+0000 7fda877fe700 1 -- 172.21.15.154:0/1178032693 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98020070 con 0x7fdaa01343a0 2023-09-30T22:26:56.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.382+0000 7fda877fe700 1 -- 172.21.15.154:0/1178032693 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98004280 con 0x7fdaa01343a0 2023-09-30T22:26:56.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.382+0000 7fdaa51cb700 1 -- 172.21.15.154:0/1178032693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda98009a70 con 0x7fdaa01343a0 2023-09-30T22:26:56.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.382+0000 7fdaa51cb700 1 -- 172.21.15.154:0/1178032693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa009c7e0 con 0x7fdaa01343a0 2023-09-30T22:26:56.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.383+0000 7fdaa51cb700 1 -- 172.21.15.154:0/1178032693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa00a58b0 con 0x7fdaa01343a0 2023-09-30T22:26:56.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.384+0000 7fda877fe700 1 -- 172.21.15.154:0/1178032693 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda980043e0 con 0x7fdaa01343a0 2023-09-30T22:26:56.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.384+0000 7fda877fe700 1 -- 172.21.15.154:0/1178032693 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fda98022070 con 0x7fdaa01343a0 2023-09-30T22:26:56.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.392+0000 7fda877fe700 1 -- 172.21.15.154:0/1178032693 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda9801a970 con 0x7fdaa01343a0 2023-09-30T22:26:56.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.410+0000 7fdea5a3a700 1 Processor -- start 2023-09-30T22:26:56.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.410+0000 7fdea5a3a700 1 -- start start 2023-09-30T22:26:56.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fdea5a3a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea009e340 0x7fdea01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fdea5a3a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0135f20 0x7fdea0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fdea5a3a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea009aaa0 con 0x7fdea009d860 2023-09-30T22:26:56.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fdea5a3a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea009e730 con 0x7fdea009e340 2023-09-30T22:26:56.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fdea5a3a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea009f870 con 0x7fdea0135f20 2023-09-30T22:26:56.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fde9e7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea009e340 0x7fdea01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fde9e7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea009e340 0x7fdea01359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32922/0 (socket says 172.21.15.154:32922) 2023-09-30T22:26:56.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fde9e7fc700 1 -- 172.21.15.154:0/2642513930 learned_addr learned my addr 172.21.15.154:0/2642513930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:56.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fde9f7fe700 1 --2- 172.21.15.154:0/2642513930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0135f20 0x7fdea0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fde9e7fc700 1 -- 172.21.15.154:0/2642513930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0135f20 msgr2=0x7fdea0138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fde9e7fc700 1 --2- 172.21.15.154:0/2642513930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0135f20 0x7fdea0138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fde9e7fc700 1 -- 172.21.15.154:0/2642513930 >> v1:172.21.15.154:6789/0 conn(0x7fdea009d860 legacy=0x7fdea009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fde9e7fc700 1 -- 172.21.15.154:0/2642513930 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea009b360 con 0x7fdea009e340 2023-09-30T22:26:56.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.411+0000 7fde9f7fe700 1 --2- 172.21.15.154:0/2642513930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0135f20 0x7fdea0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.412+0000 7fde9e7fc700 1 --2- 172.21.15.154:0/2642513930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea009e340 0x7fdea01359e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fde94009920 tx=0x7fde94009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef862f30e71a37f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.412+0000 7fde9dffb700 1 -- 172.21.15.154:0/2642513930 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011830 con 0x7fdea009e340 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.412+0000 7fde9dffb700 1 -- 172.21.15.154:0/2642513930 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94011990 con 0x7fdea009e340 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.412+0000 7fde9dffb700 1 -- 172.21.15.154:0/2642513930 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011d20 con 0x7fdea009e340 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.412+0000 7fdea5a3a700 1 -- 172.21.15.154:0/2642513930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea009e340 msgr2=0x7fdea01359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.412+0000 7fdea5a3a700 1 --2- 172.21.15.154:0/2642513930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea009e340 0x7fdea01359e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fde94009920 tx=0x7fde94009c30 comp rx=0 tx=0).stop 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.413+0000 7fdea5a3a700 1 -- 172.21.15.154:0/2642513930 shutdown_connections 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.413+0000 7fdea5a3a700 1 --2- 172.21.15.154:0/2642513930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea0135f20 0x7fdea0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.413+0000 7fdea5a3a700 1 --2- 172.21.15.154:0/2642513930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea009e340 0x7fdea01359e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.413+0000 7fdea5a3a700 1 -- 172.21.15.154:0/2642513930 >> 172.21.15.154:0/2642513930 conn(0x7fdea0099c40 msgr2=0x7fdea00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.413+0000 7fdea5a3a700 1 -- 172.21.15.154:0/2642513930 shutdown_connections 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.413+0000 7fdea5a3a700 1 -- 172.21.15.154:0/2642513930 wait complete. 2023-09-30T22:26:56.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.414+0000 7fdea5a3a700 1 Processor -- start 2023-09-30T22:26:56.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.414+0000 7fdea5a3a700 1 -- start start 2023-09-30T22:26:56.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fdea5a3a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea009d860 0x7fdea01c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fdea5a3a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009e340 0x7fdea01c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fdea5a3a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea0135f20 0x7fdea011b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fdea5a3a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea011efa0 con 0x7fdea009e340 2023-09-30T22:26:56.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fdea5a3a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea01c5ec0 con 0x7fdea0135f20 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fdea5a3a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea011d220 con 0x7fdea009d860 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea009d860 0x7fdea01c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009e340 0x7fdea01c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea009d860 0x7fdea01c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51386/0 (socket says 172.21.15.154:51386) 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9effd700 1 -- 172.21.15.154:0/463206888 learned_addr learned my addr 172.21.15.154:0/463206888 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9f7fe700 1 --2- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea0135f20 0x7fdea011b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9effd700 1 -- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea0135f20 msgr2=0x7fdea011b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9effd700 1 --2- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea0135f20 0x7fdea011b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9effd700 1 -- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009e340 msgr2=0x7fdea01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9effd700 1 --2- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009e340 0x7fdea01c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9effd700 1 -- 172.21.15.154:0/463206888 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98009a70 con 0x7fdea009d860 2023-09-30T22:26:56.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.415+0000 7fde9effd700 1 --2- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea009d860 0x7fdea01c5440 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c450 tx=0x7fde9000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.416+0000 7fde87fff700 1 -- 172.21.15.154:0/463206888 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde900052d0 con 0x7fdea009d860 2023-09-30T22:26:56.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.416+0000 7fde87fff700 1 -- 172.21.15.154:0/463206888 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90005430 con 0x7fdea009d860 2023-09-30T22:26:56.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.416+0000 7fde87fff700 1 -- 172.21.15.154:0/463206888 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde900038c0 con 0x7fdea009d860 2023-09-30T22:26:56.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.416+0000 7fdea5a3a700 1 -- 172.21.15.154:0/463206888 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde94009550 con 0x7fdea009d860 2023-09-30T22:26:56.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.416+0000 7fdea5a3a700 1 -- 172.21.15.154:0/463206888 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea009c8b0 con 0x7fdea009d860 2023-09-30T22:26:56.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.417+0000 7fdea5a3a700 1 -- 172.21.15.154:0/463206888 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea004f2a0 con 0x7fdea009d860 2023-09-30T22:26:56.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.418+0000 7fde87fff700 1 -- 172.21.15.154:0/463206888 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde90003a20 con 0x7fdea009d860 2023-09-30T22:26:56.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.418+0000 7fde87fff700 1 -- 172.21.15.154:0/463206888 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde9003ee10 con 0x7fdea009d860 2023-09-30T22:26:56.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.421+0000 7f1c62a31700 1 -- 172.21.15.154:0/1616080989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c5c04f2a0 con 0x7f1c5c09f260 2023-09-30T22:26:56.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.422+0000 7fde87fff700 1 -- 172.21.15.154:0/463206888 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde90011590 con 0x7fdea009d860 2023-09-30T22:26:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.422+0000 7f1c58ff9700 1 -- 172.21.15.154:0/1616080989 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c4c03c090 con 0x7f1c5c09f260 2023-09-30T22:26:56.422 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:56.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.425+0000 7f1c62a31700 1 -- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c5c09f260 msgr2=0x7f1c5c1354b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.425+0000 7f1c62a31700 1 --2- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c5c09f260 0x7f1c5c1354b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c01c000 tx=0x7f1c4c004750 comp rx=0 tx=0).stop 2023-09-30T22:26:56.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.425+0000 7fc2a509e700 1 Processor -- start 2023-09-30T22:26:56.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.425+0000 7fc2a509e700 1 -- start start 2023-09-30T22:26:56.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7f1c62a31700 1 -- 172.21.15.154:0/1616080989 shutdown_connections 2023-09-30T22:26:56.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7f1c62a31700 1 --2- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c5c138180 0x7f1c5c1359f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7f1c62a31700 1 --2- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c5c09e950 0x7f1c5c134f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7f1c62a31700 1 --2- 172.21.15.154:0/1616080989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c5c09f260 0x7f1c5c1354b0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7f1c62a31700 1 -- 172.21.15.154:0/1616080989 >> 172.21.15.154:0/1616080989 conn(0x7f1c5c0a4470 msgr2=0x7f1c5c132ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc2a509e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 0x7fc2a0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc2a509e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc2a509e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a009a760 con 0x7fc2a0134210 2023-09-30T22:26:56.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc2a509e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01336e0 con 0x7fc2a0133900 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc2a509e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a009a080 con 0x7fc2a00a10b0 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 0x7fc2a0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 0x7fc2a0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32938/0 (socket says 172.21.15.154:32938) 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29ed9d700 1 -- 172.21.15.154:0/605472082 learned_addr learned my addr 172.21.15.154:0/605472082 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29f59e700 1 --2- 172.21.15.154:0/605472082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29dd9b700 1 -- 172.21.15.154:0/605472082 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235602924 0 0) 0x7fc2a009a760 con 0x7fc2a0134210 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29dd9b700 1 -- 172.21.15.154:0/605472082 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2880035b0 con 0x7fc2a0134210 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29f59e700 1 -- 172.21.15.154:0/605472082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 msgr2=0x7fc2a0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29f59e700 1 --2- 172.21.15.154:0/605472082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 0x7fc2a0133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29f59e700 1 -- 172.21.15.154:0/605472082 >> v1:172.21.15.154:6789/0 conn(0x7fc2a0134210 legacy=0x7fc2a00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.426+0000 7fc29f59e700 1 -- 172.21.15.154:0/605472082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a00a23e0 con 0x7fc2a00a10b0 2023-09-30T22:26:56.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.427+0000 7f1c62a31700 1 -- 172.21.15.154:0/1616080989 shutdown_connections 2023-09-30T22:26:56.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.427+0000 7f1c62a31700 1 -- 172.21.15.154:0/1616080989 wait complete. 2023-09-30T22:26:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.427+0000 7fc29f59e700 1 --2- 172.21.15.154:0/605472082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a013b910 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc298009dc0 tx=0x7fc29800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d07348e73faef1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.428+0000 7fc29dd9b700 1 -- 172.21.15.154:0/605472082 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800e070 con 0x7fc2a00a10b0 2023-09-30T22:26:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.428+0000 7fc29dd9b700 1 -- 172.21.15.154:0/605472082 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29800bb20 con 0x7fc2a00a10b0 2023-09-30T22:26:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.428+0000 7fc29dd9b700 1 -- 172.21.15.154:0/605472082 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298012430 con 0x7fc2a00a10b0 2023-09-30T22:26:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.428+0000 7fc2a509e700 1 -- 172.21.15.154:0/605472082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 msgr2=0x7fc2a013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.428+0000 7fc2a509e700 1 --2- 172.21.15.154:0/605472082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a013b910 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc298009dc0 tx=0x7fc29800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.432+0000 7fc2a509e700 1 -- 172.21.15.154:0/605472082 shutdown_connections 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.432+0000 7fc2a509e700 1 --2- 172.21.15.154:0/605472082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a013b910 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.432+0000 7fc2a509e700 1 --2- 172.21.15.154:0/605472082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 0x7fc2a0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.432+0000 7fc2a509e700 1 -- 172.21.15.154:0/605472082 >> 172.21.15.154:0/605472082 conn(0x7fc2a00a2980 msgr2=0x7fc2a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.432+0000 7fc2a509e700 1 -- 172.21.15.154:0/605472082 shutdown_connections 2023-09-30T22:26:56.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.432+0000 7fc2a509e700 1 -- 172.21.15.154:0/605472082 wait complete. 2023-09-30T22:26:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.433+0000 7fc2a509e700 1 Processor -- start 2023-09-30T22:26:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.433+0000 7fc2a509e700 1 -- start start 2023-09-30T22:26:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.433+0000 7fc2a509e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a006e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.433+0000 7fc2a509e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 0x7fc2a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.433+0000 7fc2a509e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a0134210 0x7fc2a006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:56.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.433+0000 7fc2a509e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0071ae0 con 0x7fc2a0134210 2023-09-30T22:26:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.433+0000 7fc2a509e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0071540 con 0x7fc2a0133900 2023-09-30T22:26:56.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.433+0000 7fc2a509e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01329d0 con 0x7fc2a00a10b0 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a0134210 0x7fc2a006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29f59e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a0134210 0x7fc2a006ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44330/0 (socket says 172.21.15.154:44330) 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29f59e700 1 -- 172.21.15.154:0/1716397091 learned_addr learned my addr 172.21.15.154:0/1716397091 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29e59c700 1 --2- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 0x7fc2a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29ed9d700 1 -- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 msgr2=0x7fc2a006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29ed9d700 1 --2- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 0x7fc2a006e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29ed9d700 1 -- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a0134210 msgr2=0x7fc2a006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29ed9d700 1 --2- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a0134210 0x7fc2a006ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29ed9d700 1 -- 172.21.15.154:0/1716397091 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc298009a70 con 0x7fc2a00a10b0 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29f59e700 1 --2- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a0134210 0x7fc2a006ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.434+0000 7fc29ed9d700 1 --2- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a006e230 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc29000e7e0 tx=0x7fc29000eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.435+0000 7fc2877fe700 1 -- 172.21.15.154:0/1716397091 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000c070 con 0x7fc2a00a10b0 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.435+0000 7fc2877fe700 1 -- 172.21.15.154:0/1716397091 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290005a20 con 0x7fc2a00a10b0 2023-09-30T22:26:56.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.435+0000 7fc2877fe700 1 -- 172.21.15.154:0/1716397091 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290005dd0 con 0x7fc2a00a10b0 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.436+0000 7fc2a509e700 1 -- 172.21.15.154:0/1716397091 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a009a2c0 con 0x7fc2a00a10b0 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.436+0000 7fc2a509e700 1 -- 172.21.15.154:0/1716397091 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a0071230 con 0x7fc2a00a10b0 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.436+0000 7fc2a509e700 1 -- 172.21.15.154:0/1716397091 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a011a590 con 0x7fc2a00a10b0 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.437+0000 7fc2877fe700 1 -- 172.21.15.154:0/1716397091 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc290006020 con 0x7fc2a00a10b0 2023-09-30T22:26:56.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.437+0000 7fc2877fe700 1 -- 172.21.15.154:0/1716397091 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc29003efd0 con 0x7fc2a00a10b0 2023-09-30T22:26:56.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:56.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.446+0000 7fc2877fe700 1 -- 172.21.15.154:0/1716397091 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc290070750 con 0x7fc2a00a10b0 2023-09-30T22:26:56.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.591+0000 7fdaa51cb700 1 -- 172.21.15.154:0/1178032693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdaa004f2a0 con 0x7fdaa01343a0 2023-09-30T22:26:56.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.591+0000 7fda877fe700 1 -- 172.21.15.154:0/1178032693 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda9801a380 con 0x7fdaa01343a0 2023-09-30T22:26:56.592 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:56.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.593+0000 7fdaa51cb700 1 -- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa01343a0 msgr2=0x7fdaa011eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.593+0000 7fdaa51cb700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa01343a0 0x7fdaa011eae0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fda98016000 tx=0x7fda98004ad0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.593+0000 7fdaa51cb700 1 -- 172.21.15.154:0/1178032693 shutdown_connections 2023-09-30T22:26:56.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.593+0000 7fdaa51cb700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaa01343a0 0x7fdaa011eae0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.593+0000 7fdaa51cb700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaa009ad40 0x7fdaa011e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.593+0000 7fdaa51cb700 1 --2- 172.21.15.154:0/1178032693 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdaa0133f70 0x7fdaa011e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.593+0000 7fdaa51cb700 1 -- 172.21.15.154:0/1178032693 >> 172.21.15.154:0/1178032693 conn(0x7fdaa0099c40 msgr2=0x7fdaa01330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.593+0000 7fdaa51cb700 1 -- 172.21.15.154:0/1178032693 shutdown_connections 2023-09-30T22:26:56.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.593+0000 7fdaa51cb700 1 -- 172.21.15.154:0/1178032693 wait complete. 2023-09-30T22:26:56.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:56.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.623+0000 7fdea5a3a700 1 -- 172.21.15.154:0/463206888 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdea011d9d0 con 0x7fdea009d860 2023-09-30T22:26:56.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.623+0000 7fde87fff700 1 -- 172.21.15.154:0/463206888 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde90017030 con 0x7fdea009d860 2023-09-30T22:26:56.623 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:56.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.625+0000 7fdea5a3a700 1 -- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea009d860 msgr2=0x7fdea01c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.625+0000 7fdea5a3a700 1 --2- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea009d860 0x7fdea01c5440 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c450 tx=0x7fde9000c760 comp rx=0 tx=0).stop 2023-09-30T22:26:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.625+0000 7fdea5a3a700 1 -- 172.21.15.154:0/463206888 shutdown_connections 2023-09-30T22:26:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.625+0000 7fdea5a3a700 1 --2- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdea0135f20 0x7fdea011b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.625+0000 7fdea5a3a700 1 --2- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdea009d860 0x7fdea01c5440 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.625+0000 7fdea5a3a700 1 --2- 172.21.15.154:0/463206888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea009e340 0x7fdea01c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.625+0000 7fdea5a3a700 1 -- 172.21.15.154:0/463206888 >> 172.21.15.154:0/463206888 conn(0x7fdea0099c40 msgr2=0x7fdea0134eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.625+0000 7fdea5a3a700 1 -- 172.21.15.154:0/463206888 shutdown_connections 2023-09-30T22:26:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.625+0000 7fdea5a3a700 1 -- 172.21.15.154:0/463206888 wait complete. 2023-09-30T22:26:56.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:56.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.641+0000 7fc2a509e700 1 -- 172.21.15.154:0/1716397091 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc2a004f2a0 con 0x7fc2a00a10b0 2023-09-30T22:26:56.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.642+0000 7fc2877fe700 1 -- 172.21.15.154:0/1716397091 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc29001a750 con 0x7fc2a00a10b0 2023-09-30T22:26:56.641 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.644+0000 7fc2a509e700 1 -- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 msgr2=0x7fc2a006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.644+0000 7fc2a509e700 1 --2- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a006e230 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc29000e7e0 tx=0x7fc29000eaf0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.644+0000 7fc2a509e700 1 -- 172.21.15.154:0/1716397091 shutdown_connections 2023-09-30T22:26:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.644+0000 7fc2a509e700 1 --2- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2a0134210 0x7fc2a006ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.644+0000 7fc2a509e700 1 --2- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc2a00a10b0 0x7fc2a006e230 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.644+0000 7fc2a509e700 1 --2- 172.21.15.154:0/1716397091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2a0133900 0x7fc2a006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.644+0000 7fc2a509e700 1 -- 172.21.15.154:0/1716397091 >> 172.21.15.154:0/1716397091 conn(0x7fc2a00a2980 msgr2=0x7fc2a01baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:56.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.644+0000 7fc2a509e700 1 -- 172.21.15.154:0/1716397091 shutdown_connections 2023-09-30T22:26:56.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:56.644+0000 7fc2a509e700 1 -- 172.21.15.154:0/1716397091 wait complete. 2023-09-30T22:26:56.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:57.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:57.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.578+0000 7f6fb2bdf700 1 Processor -- start 2023-09-30T22:26:57.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.578+0000 7f6fb2bdf700 1 -- start start 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fb2bdf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fac133ad0 0x7f6fac133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fb2bdf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1300a0 0x7f6fac1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fb2bdf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac06b2d0 con 0x7f6fac1309f0 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fb2bdf700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac133610 con 0x7f6fac133ad0 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fb2bdf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac09a500 con 0x7f6fac1300a0 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fabfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1300a0 0x7f6fac1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fb097b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fac133ad0 0x7f6fac133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fabfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1300a0 0x7f6fac1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51426/0 (socket says 172.21.15.154:51426) 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fb097b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fac133ad0 0x7f6fac133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44344/0 (socket says 172.21.15.154:44344) 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fabfff700 1 -- 172.21.15.154:0/4034854979 learned_addr learned my addr 172.21.15.154:0/4034854979 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:57.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fb117c700 1 --1- 172.21.15.154:0/4034854979 >> v1:172.21.15.154:6789/0 conn(0x7f6fac1309f0 0x7f6fac13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56874/0 (socket says 172.21.15.154:56874) 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fabfff700 1 -- 172.21.15.154:0/4034854979 >> v2:172.21.15.154:3300/0 conn(0x7f6fac133ad0 msgr2=0x7f6fac133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fabfff700 1 --2- 172.21.15.154:0/4034854979 >> v2:172.21.15.154:3300/0 conn(0x7f6fac133ad0 0x7f6fac133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fabfff700 1 -- 172.21.15.154:0/4034854979 >> v1:172.21.15.154:6789/0 conn(0x7f6fac1309f0 legacy=0x7f6fac13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fabfff700 1 -- 172.21.15.154:0/4034854979 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac1338b0 con 0x7f6fac1300a0 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fb097b700 1 --2- 172.21.15.154:0/4034854979 >> v2:172.21.15.154:3300/0 conn(0x7f6fac133ad0 0x7f6fac133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fabfff700 1 --2- 172.21.15.154:0/4034854979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1300a0 0x7f6fac1304b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6f980098f0 tx=0x7f6f98009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72d7747c72e51f88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fab7fe700 1 -- 172.21.15.154:0/4034854979 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98011830 con 0x7f6fac1300a0 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fab7fe700 1 -- 172.21.15.154:0/4034854979 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98011990 con 0x7f6fac1300a0 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.579+0000 7f6fab7fe700 1 -- 172.21.15.154:0/4034854979 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98011d20 con 0x7f6fac1300a0 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.580+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/4034854979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1300a0 msgr2=0x7f6fac1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.580+0000 7f6fb2bdf700 1 --2- 172.21.15.154:0/4034854979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1300a0 0x7f6fac1304b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6f980098f0 tx=0x7f6f98009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:57.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.580+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/4034854979 shutdown_connections 2023-09-30T22:26:57.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.580+0000 7f6fb2bdf700 1 --2- 172.21.15.154:0/4034854979 >> v2:172.21.15.154:3300/0 conn(0x7f6fac133ad0 0x7f6fac133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.580+0000 7f6fb2bdf700 1 --2- 172.21.15.154:0/4034854979 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1300a0 0x7f6fac1304b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.580+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/4034854979 >> 172.21.15.154:0/4034854979 conn(0x7f6fac099c40 msgr2=0x7f6fac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.580+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/4034854979 shutdown_connections 2023-09-30T22:26:57.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.580+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/4034854979 wait complete. 2023-09-30T22:26:57.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.581+0000 7f6fb2bdf700 1 Processor -- start 2023-09-30T22:26:57.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.581+0000 7f6fb2bdf700 1 -- start start 2023-09-30T22:26:57.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb2bdf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fac1300a0 0x7f6fac11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb2bdf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1309f0 0x7f6fac11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb2bdf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac133ad0 0x7f6fac11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb2bdf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac12fdf0 con 0x7f6fac133ad0 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb2bdf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac12dd00 con 0x7f6fac1300a0 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb2bdf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac072380 con 0x7f6fac1309f0 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb097b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fac1300a0 0x7f6fac11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fabfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1309f0 0x7f6fac11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb117c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac133ad0 0x7f6fac11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb097b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fac1300a0 0x7f6fac11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32956/0 (socket says 172.21.15.154:32956) 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fabfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1309f0 0x7f6fac11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51438/0 (socket says 172.21.15.154:51438) 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb097b700 1 -- 172.21.15.154:0/1417610756 learned_addr learned my addr 172.21.15.154:0/1417610756 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fabfff700 1 -- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fac1300a0 msgr2=0x7f6fac11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fabfff700 1 --2- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fac1300a0 0x7f6fac11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fabfff700 1 -- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac133ad0 msgr2=0x7f6fac11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fabfff700 1 --2- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac133ad0 0x7f6fac11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fabfff700 1 -- 172.21.15.154:0/1417610756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00094a0 con 0x7f6fac1309f0 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb097b700 1 --2- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fac1300a0 0x7f6fac11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fabfff700 1 --2- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1309f0 0x7f6fac11df80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6f98016000 tx=0x7f6f98004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fa97fa700 1 -- 172.21.15.154:0/1417610756 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98004510 con 0x7f6fac1309f0 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fa97fa700 1 -- 172.21.15.154:0/1417610756 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9801e070 con 0x7f6fac1309f0 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/1417610756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f98009550 con 0x7f6fac1309f0 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fa97fa700 1 -- 172.21.15.154:0/1417610756 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f980038a0 con 0x7f6fac1309f0 2023-09-30T22:26:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.582+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/1417610756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac11ff20 con 0x7f6fac1309f0 2023-09-30T22:26:57.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.583+0000 7f6fa97fa700 1 -- 172.21.15.154:0/1417610756 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f98003a00 con 0x7f6fac1309f0 2023-09-30T22:26:57.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.583+0000 7f6fa97fa700 1 -- 172.21.15.154:0/1417610756 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f98020070 con 0x7f6fac1309f0 2023-09-30T22:26:57.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.583+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/1417610756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fac11fd40 con 0x7f6fac1309f0 2023-09-30T22:26:57.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.588+0000 7f6fa97fa700 1 -- 172.21.15.154:0/1417610756 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f9802a020 con 0x7f6fac1309f0 2023-09-30T22:26:57.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:57.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:57.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:57.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.736+0000 7feba58e1700 1 Processor -- start 2023-09-30T22:26:57.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.736+0000 7feba58e1700 1 -- start start 2023-09-30T22:26:57.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feba58e1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba0133ad0 0x7feba0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feba58e1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0130bc0 0x7feba013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feba58e1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba006b2d0 con 0x7feba01300a0 2023-09-30T22:26:57.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feba58e1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba0133610 con 0x7feba0130bc0 2023-09-30T22:26:57.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feba58e1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba009a500 con 0x7feba0133ad0 2023-09-30T22:26:57.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feb9effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba0133ad0 0x7feba0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feb9effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba0133ad0 0x7feba0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51452/0 (socket says 172.21.15.154:51452) 2023-09-30T22:26:57.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feb9effd700 1 -- 172.21.15.154:0/4291305267 learned_addr learned my addr 172.21.15.154:0/4291305267 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feb9f7fe700 1 --2- 172.21.15.154:0/4291305267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0130bc0 0x7feba013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feb9f7fe700 1 -- 172.21.15.154:0/4291305267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba0133ad0 msgr2=0x7feba0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feb9f7fe700 1 --2- 172.21.15.154:0/4291305267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba0133ad0 0x7feba0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feb9f7fe700 1 -- 172.21.15.154:0/4291305267 >> v1:172.21.15.154:6789/0 conn(0x7feba01300a0 legacy=0x7feba01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.737+0000 7feb9f7fe700 1 -- 172.21.15.154:0/4291305267 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba01338b0 con 0x7feba0130bc0 2023-09-30T22:26:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.738+0000 7feb9f7fe700 1 --2- 172.21.15.154:0/4291305267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0130bc0 0x7feba013b990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7feb98009dc0 tx=0x7feb9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8312aa12f06ef2d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.738+0000 7feb9dffb700 1 -- 172.21.15.154:0/4291305267 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800e070 con 0x7feba0130bc0 2023-09-30T22:26:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.738+0000 7feb9dffb700 1 -- 172.21.15.154:0/4291305267 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800bb20 con 0x7feba0130bc0 2023-09-30T22:26:57.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.738+0000 7feb9dffb700 1 -- 172.21.15.154:0/4291305267 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98012430 con 0x7feba0130bc0 2023-09-30T22:26:57.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.739+0000 7feba58e1700 1 -- 172.21.15.154:0/4291305267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0130bc0 msgr2=0x7feba013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.739+0000 7feba58e1700 1 --2- 172.21.15.154:0/4291305267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0130bc0 0x7feba013b990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7feb98009dc0 tx=0x7feb9800b330 comp rx=0 tx=0).stop 2023-09-30T22:26:57.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.739+0000 7feba58e1700 1 -- 172.21.15.154:0/4291305267 shutdown_connections 2023-09-30T22:26:57.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.739+0000 7feba58e1700 1 --2- 172.21.15.154:0/4291305267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0130bc0 0x7feba013b990 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.739+0000 7feba58e1700 1 --2- 172.21.15.154:0/4291305267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba0133ad0 0x7feba0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.739+0000 7feba58e1700 1 -- 172.21.15.154:0/4291305267 >> 172.21.15.154:0/4291305267 conn(0x7feba0099c40 msgr2=0x7feba00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.739+0000 7feba58e1700 1 -- 172.21.15.154:0/4291305267 shutdown_connections 2023-09-30T22:26:57.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.739+0000 7feba58e1700 1 -- 172.21.15.154:0/4291305267 wait complete. 2023-09-30T22:26:57.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.740+0000 7feba58e1700 1 Processor -- start 2023-09-30T22:26:57.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feba58e1700 1 -- start start 2023-09-30T22:26:57.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feba58e1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba01300a0 0x7feba011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feba58e1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba0130bc0 0x7feba011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feba58e1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0133ad0 0x7feba011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feba58e1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01201f0 con 0x7feba0130bc0 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feba58e1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba011f8e0 con 0x7feba0133ad0 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feba58e1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba012dd00 con 0x7feba01300a0 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feb9e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba0130bc0 0x7feba011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feb9e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba0130bc0 0x7feba011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44354/0 (socket says 172.21.15.154:44354) 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feb9e7fc700 1 -- 172.21.15.154:0/3526086814 learned_addr learned my addr 172.21.15.154:0/3526086814 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.741+0000 7feb9effd700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba01300a0 0x7feba011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb9f7fe700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0133ad0 0x7feba011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb9e7fc700 1 -- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba01300a0 msgr2=0x7feba011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb9e7fc700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba01300a0 0x7feba011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb9e7fc700 1 -- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0133ad0 msgr2=0x7feba011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb9e7fc700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0133ad0 0x7feba011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb9e7fc700 1 -- 172.21.15.154:0/3526086814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009a70 con 0x7feba0130bc0 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb9effd700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba01300a0 0x7feba011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb9e7fc700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba0130bc0 0x7feba011df80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7feb9400c450 tx=0x7feb9400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb87fff700 1 -- 172.21.15.154:0/3526086814 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb940052d0 con 0x7feba0130bc0 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb87fff700 1 -- 172.21.15.154:0/3526086814 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb94005430 con 0x7feba0130bc0 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feba58e1700 1 -- 172.21.15.154:0/3526086814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba00a2ea0 con 0x7feba0130bc0 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feb87fff700 1 -- 172.21.15.154:0/3526086814 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb940038c0 con 0x7feba0130bc0 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.742+0000 7feba58e1700 1 -- 172.21.15.154:0/3526086814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba011fe70 con 0x7feba0130bc0 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.743+0000 7feb87fff700 1 -- 172.21.15.154:0/3526086814 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb94003a20 con 0x7feba0130bc0 2023-09-30T22:26:57.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.743+0000 7feb87fff700 1 -- 172.21.15.154:0/3526086814 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb9403e970 con 0x7feba0130bc0 2023-09-30T22:26:57.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.744+0000 7feba58e1700 1 -- 172.21.15.154:0/3526086814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba004f2a0 con 0x7feba0130bc0 2023-09-30T22:26:57.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.753+0000 7feb87fff700 1 -- 172.21.15.154:0/3526086814 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb94011590 con 0x7feba0130bc0 2023-09-30T22:26:57.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.790+0000 7fcdb47a1700 1 Processor -- start 2023-09-30T22:26:57.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.790+0000 7fcdb47a1700 1 -- start start 2023-09-30T22:26:57.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb47a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 0x7fcdac138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb47a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 0x7fcdac13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb47a1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac09e9d0 con 0x7fcdac0a0a70 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb47a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac09dc00 con 0x7fcdac139200 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb47a1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac09dec0 con 0x7fcdac0a1550 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb253d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcdac0a0a70 0x7fcdac0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56900/0 (socket says 172.21.15.154:56900) 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb253d700 1 -- 172.21.15.154:0/3124521711 learned_addr learned my addr 172.21.15.154:0/3124521711 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb1d3c700 1 --2- 172.21.15.154:0/3124521711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 0x7fcdac138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb2d3e700 1 --2- 172.21.15.154:0/3124521711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 0x7fcdac13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb1d3c700 1 -- 172.21.15.154:0/3124521711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 msgr2=0x7fcdac13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb1d3c700 1 --2- 172.21.15.154:0/3124521711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 0x7fcdac13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb1d3c700 1 -- 172.21.15.154:0/3124521711 >> v1:172.21.15.154:6789/0 conn(0x7fcdac0a0a70 legacy=0x7fcdac0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb153b700 1 -- 172.21.15.154:0/3124521711 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030106445 0 0) 0x7fcdac09e9d0 con 0x7fcdac0a0a70 2023-09-30T22:26:57.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb1d3c700 1 -- 172.21.15.154:0/3124521711 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac09e6a0 con 0x7fcdac0a1550 2023-09-30T22:26:57.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.791+0000 7fcdb1d3c700 1 --2- 172.21.15.154:0/3124521711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 0x7fcdac138cc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6796c32e9776e971 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb153b700 1 -- 172.21.15.154:0/3124521711 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c011830 con 0x7fcdac0a1550 2023-09-30T22:26:57.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb153b700 1 -- 172.21.15.154:0/3124521711 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c011990 con 0x7fcdac0a1550 2023-09-30T22:26:57.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb153b700 1 -- 172.21.15.154:0/3124521711 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c011d20 con 0x7fcdac0a1550 2023-09-30T22:26:57.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb47a1700 1 -- 172.21.15.154:0/3124521711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 msgr2=0x7fcdac138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb47a1700 1 --2- 172.21.15.154:0/3124521711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 0x7fcdac138cc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:57.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb47a1700 1 -- 172.21.15.154:0/3124521711 shutdown_connections 2023-09-30T22:26:57.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb47a1700 1 --2- 172.21.15.154:0/3124521711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 0x7fcdac13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb47a1700 1 --2- 172.21.15.154:0/3124521711 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 0x7fcdac138cc0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb47a1700 1 -- 172.21.15.154:0/3124521711 >> 172.21.15.154:0/3124521711 conn(0x7fcdac0a6610 msgr2=0x7fcdac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb47a1700 1 -- 172.21.15.154:0/3124521711 shutdown_connections 2023-09-30T22:26:57.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.792+0000 7fcdb47a1700 1 -- 172.21.15.154:0/3124521711 wait complete. 2023-09-30T22:26:57.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.794+0000 7fcdb47a1700 1 Processor -- start 2023-09-30T22:26:57.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.794+0000 7fcdb47a1700 1 -- start start 2023-09-30T22:26:57.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.794+0000 7fcdb47a1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdac0a0a70 0x7fcdac11e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.794+0000 7fcdb47a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 0x7fcdac11ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.794+0000 7fcdb47a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 0x7fcdac11f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.794+0000 7fcdb47a1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac120370 con 0x7fcdac0a0a70 2023-09-30T22:26:57.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.794+0000 7fcdb47a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac134650 con 0x7fcdac139200 2023-09-30T22:26:57.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.794+0000 7fcdb47a1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac121fa0 con 0x7fcdac0a1550 2023-09-30T22:26:57.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.794+0000 7fcdb253d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdac0a0a70 0x7fcdac11e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb253d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdac0a0a70 0x7fcdac11e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44358/0 (socket says 172.21.15.154:44358) 2023-09-30T22:26:57.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb1d3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 0x7fcdac11ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb253d700 1 -- 172.21.15.154:0/4034510881 learned_addr learned my addr 172.21.15.154:0/4034510881 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:57.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb2d3e700 1 --2- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 0x7fcdac11f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb253d700 1 -- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 msgr2=0x7fcdac11ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb253d700 1 --2- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 0x7fcdac11ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb253d700 1 -- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 msgr2=0x7fcdac11f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb253d700 1 --2- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 0x7fcdac11f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb253d700 1 -- 172.21.15.154:0/4034510881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0094a0 con 0x7fcdac0a0a70 2023-09-30T22:26:57.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb253d700 1 --2- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdac0a0a70 0x7fcdac11e7b0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fcda80011e0 tx=0x7fcda800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcda2ffd700 1 -- 172.21.15.154:0/4034510881 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8004c80 con 0x7fcdac0a0a70 2023-09-30T22:26:57.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcda2ffd700 1 -- 172.21.15.154:0/4034510881 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda8004e00 con 0x7fcdac0a0a70 2023-09-30T22:26:57.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb47a1700 1 -- 172.21.15.154:0/4034510881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac121a10 con 0x7fcdac0a0a70 2023-09-30T22:26:57.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.795+0000 7fcdb47a1700 1 -- 172.21.15.154:0/4034510881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac0a5100 con 0x7fcdac0a0a70 2023-09-30T22:26:57.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.796+0000 7fcda2ffd700 1 -- 172.21.15.154:0/4034510881 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8007310 con 0x7fcdac0a0a70 2023-09-30T22:26:57.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.797+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/1417610756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6fac04f2a0 con 0x7f6fac1309f0 2023-09-30T22:26:57.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.797+0000 7f6fa97fa700 1 -- 172.21.15.154:0/1417610756 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f98003cb0 con 0x7f6fac1309f0 2023-09-30T22:26:57.800 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:57.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.797+0000 7fcda2ffd700 1 -- 172.21.15.154:0/4034510881 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcda8007470 con 0x7fcdac0a0a70 2023-09-30T22:26:57.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.797+0000 7fcda2ffd700 1 -- 172.21.15.154:0/4034510881 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcda803f3c0 con 0x7fcdac0a0a70 2023-09-30T22:26:57.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.797+0000 7fcdb47a1700 1 -- 172.21.15.154:0/4034510881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd940052e0 con 0x7fcdac0a0a70 2023-09-30T22:26:57.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.799+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1309f0 msgr2=0x7f6fac11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.799+0000 7f6fb2bdf700 1 --2- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1309f0 0x7f6fac11df80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6f98016000 tx=0x7f6f98004750 comp rx=0 tx=0).stop 2023-09-30T22:26:57.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.800+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/1417610756 shutdown_connections 2023-09-30T22:26:57.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.800+0000 7f6fb2bdf700 1 --2- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fac133ad0 0x7f6fac11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.800+0000 7f6fb2bdf700 1 --2- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fac1300a0 0x7f6fac11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.800+0000 7f6fb2bdf700 1 --2- 172.21.15.154:0/1417610756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fac1309f0 0x7f6fac11df80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.800+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/1417610756 >> 172.21.15.154:0/1417610756 conn(0x7f6fac099c40 msgr2=0x7f6fac131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.802+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/1417610756 shutdown_connections 2023-09-30T22:26:57.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.802+0000 7f6fb2bdf700 1 -- 172.21.15.154:0/1417610756 wait complete. 2023-09-30T22:26:57.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.802+0000 7fcda2ffd700 1 -- 172.21.15.154:0/4034510881 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcda801a2b0 con 0x7fcdac0a0a70 2023-09-30T22:26:57.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.825+0000 7f6a010e3700 1 Processor -- start 2023-09-30T22:26:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.825+0000 7f6a010e3700 1 -- start start 2023-09-30T22:26:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.825+0000 7f6a010e3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69fc09d860 0x7f69fc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.825+0000 7f6a010e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 0x7f69fc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.825+0000 7f6a010e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc130ce0 0x7f69fc131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.825+0000 7f6a010e3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc131670 con 0x7f69fc09d860 2023-09-30T22:26:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.825+0000 7f6a010e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc09aaa0 con 0x7f69fc09e170 2023-09-30T22:26:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.825+0000 7f6a010e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc09f870 con 0x7f69fc130ce0 2023-09-30T22:26:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fb59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc130ce0 0x7f69fc131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69fc09d860 0x7f69fc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fb59e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc130ce0 0x7f69fc131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51478/0 (socket says 172.21.15.154:51478) 2023-09-30T22:26:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fb59e700 1 -- 172.21.15.154:0/877741436 learned_addr learned my addr 172.21.15.154:0/877741436 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fa59c700 1 --2- 172.21.15.154:0/877741436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 0x7f69fc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fb59e700 1 -- 172.21.15.154:0/877741436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 msgr2=0x7f69fc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fb59e700 1 --2- 172.21.15.154:0/877741436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 0x7f69fc1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fb59e700 1 -- 172.21.15.154:0/877741436 >> v2:172.21.15.154:3300/0 conn(0x7f69fc09d860 msgr2=0x7f69fc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fb59e700 1 --2- 172.21.15.154:0/877741436 >> v2:172.21.15.154:3300/0 conn(0x7f69fc09d860 0x7f69fc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fb59e700 1 -- 172.21.15.154:0/877741436 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc09b360 con 0x7f69fc130ce0 2023-09-30T22:26:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fad9d700 1 --2- 172.21.15.154:0/877741436 >> v2:172.21.15.154:3300/0 conn(0x7f69fc09d860 0x7f69fc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69fb59e700 1 --2- 172.21.15.154:0/877741436 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc130ce0 0x7f69fc131130 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f69f400d180 tx=0x7f69f400d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5af1f5c79ab7c7b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69f9d9b700 1 -- 172.21.15.154:0/877741436 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4010070 con 0x7f69fc130ce0 2023-09-30T22:26:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69f9d9b700 1 -- 172.21.15.154:0/877741436 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f400dd00 con 0x7f69fc130ce0 2023-09-30T22:26:57.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.826+0000 7f69f9d9b700 1 -- 172.21.15.154:0/877741436 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f400b310 con 0x7f69fc130ce0 2023-09-30T22:26:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.827+0000 7f6a010e3700 1 -- 172.21.15.154:0/877741436 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc130ce0 msgr2=0x7f69fc131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.827+0000 7f6a010e3700 1 --2- 172.21.15.154:0/877741436 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc130ce0 0x7f69fc131130 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f69f400d180 tx=0x7f69f400d490 comp rx=0 tx=0).stop 2023-09-30T22:26:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.827+0000 7f6a010e3700 1 -- 172.21.15.154:0/877741436 shutdown_connections 2023-09-30T22:26:57.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.827+0000 7f6a010e3700 1 --2- 172.21.15.154:0/877741436 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc130ce0 0x7f69fc131130 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.827+0000 7f6a010e3700 1 --2- 172.21.15.154:0/877741436 >> v2:172.21.15.154:3300/0 conn(0x7f69fc09d860 0x7f69fc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.827+0000 7f6a010e3700 1 --2- 172.21.15.154:0/877741436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 0x7f69fc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.827+0000 7f6a010e3700 1 -- 172.21.15.154:0/877741436 >> 172.21.15.154:0/877741436 conn(0x7f69fc099c40 msgr2=0x7f69fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.827+0000 7f6a010e3700 1 -- 172.21.15.154:0/877741436 shutdown_connections 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.827+0000 7f6a010e3700 1 -- 172.21.15.154:0/877741436 wait complete. 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f6a010e3700 1 Processor -- start 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f6a010e3700 1 -- start start 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f6a010e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc09d860 0x7f69fc121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f6a010e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 0x7f69fc1217c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f6a010e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69fc130ce0 0x7f69fc121d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:57.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f6a010e3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc12f620 con 0x7f69fc130ce0 2023-09-30T22:26:57.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f6a010e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc124800 con 0x7f69fc09e170 2023-09-30T22:26:57.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f6a010e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc124ac0 con 0x7f69fc09d860 2023-09-30T22:26:57.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f69fad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc09d860 0x7f69fc121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f69fa59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 0x7f69fc1217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f69fad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc09d860 0x7f69fc121280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51482/0 (socket says 172.21.15.154:51482) 2023-09-30T22:26:57.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.829+0000 7f69fad9d700 1 -- 172.21.15.154:0/565805853 learned_addr learned my addr 172.21.15.154:0/565805853 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:57.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69fb59e700 1 --2- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69fc130ce0 0x7f69fc121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:57.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69fad9d700 1 -- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 msgr2=0x7f69fc1217c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69fad9d700 1 --2- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 0x7f69fc1217c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69fad9d700 1 -- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69fc130ce0 msgr2=0x7f69fc121d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69fad9d700 1 --2- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69fc130ce0 0x7f69fc121d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69fad9d700 1 -- 172.21.15.154:0/565805853 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec0094a0 con 0x7f69fc09d860 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69fa59c700 1 --2- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 0x7f69fc1217c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69fad9d700 1 --2- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc09d860 0x7f69fc121280 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00ebe0 tx=0x7f69ec00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69e37fe700 1 -- 172.21.15.154:0/565805853 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec009780 con 0x7f69fc09d860 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69e37fe700 1 -- 172.21.15.154:0/565805853 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec00c850 con 0x7f69fc09d860 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f69e37fe700 1 -- 172.21.15.154:0/565805853 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00cbe0 con 0x7f69fc09d860 2023-09-30T22:26:57.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f6a010e3700 1 -- 172.21.15.154:0/565805853 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f400bd40 con 0x7f69fc09d860 2023-09-30T22:26:57.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.830+0000 7f6a010e3700 1 -- 172.21.15.154:0/565805853 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc124530 con 0x7f69fc09d860 2023-09-30T22:26:57.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.831+0000 7f69e37fe700 1 -- 172.21.15.154:0/565805853 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69ec00cd40 con 0x7f69fc09d860 2023-09-30T22:26:57.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.831+0000 7f6a010e3700 1 -- 172.21.15.154:0/565805853 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc04f2a0 con 0x7f69fc09d860 2023-09-30T22:26:57.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.832+0000 7f69e37fe700 1 -- 172.21.15.154:0/565805853 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f69ec03fac0 con 0x7f69fc09d860 2023-09-30T22:26:57.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.836+0000 7f69e37fe700 1 -- 172.21.15.154:0/565805853 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69ec013470 con 0x7f69fc09d860 2023-09-30T22:26:57.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.977+0000 7feba58e1700 1 -- 172.21.15.154:0/3526086814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feba011fc30 con 0x7feba0130bc0 2023-09-30T22:26:57.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.977+0000 7feb87fff700 1 -- 172.21.15.154:0/3526086814 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb94017020 con 0x7feba0130bc0 2023-09-30T22:26:57.977 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:57.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.979+0000 7feba58e1700 1 -- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba0130bc0 msgr2=0x7feba011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:57.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.979+0000 7feba58e1700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba0130bc0 0x7feba011df80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7feb9400c450 tx=0x7feb9400c760 comp rx=0 tx=0).stop 2023-09-30T22:26:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.979+0000 7feba58e1700 1 -- 172.21.15.154:0/3526086814 shutdown_connections 2023-09-30T22:26:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.979+0000 7feba58e1700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feba0133ad0 0x7feba011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.979+0000 7feba58e1700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feba01300a0 0x7feba011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.979+0000 7feba58e1700 1 --2- 172.21.15.154:0/3526086814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feba0130bc0 0x7feba011df80 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.979+0000 7feba58e1700 1 -- 172.21.15.154:0/3526086814 >> 172.21.15.154:0/3526086814 conn(0x7feba0099c40 msgr2=0x7feba012e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.979+0000 7feba58e1700 1 -- 172.21.15.154:0/3526086814 shutdown_connections 2023-09-30T22:26:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:57.979+0000 7feba58e1700 1 -- 172.21.15.154:0/3526086814 wait complete. 2023-09-30T22:26:57.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:58.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.007+0000 7fcdb47a1700 1 -- 172.21.15.154:0/4034510881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd94005590 con 0x7fcdac0a0a70 2023-09-30T22:26:58.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.007+0000 7fcda2ffd700 1 -- 172.21.15.154:0/4034510881 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcda801bb30 con 0x7fcdac0a0a70 2023-09-30T22:26:58.007 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:58.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.009+0000 7fcdb47a1700 1 -- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdac0a0a70 msgr2=0x7fcdac11e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.009+0000 7fcdb47a1700 1 --2- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdac0a0a70 0x7fcdac11e7b0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fcda80011e0 tx=0x7fcda800ca30 comp rx=0 tx=0).stop 2023-09-30T22:26:58.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.009+0000 7fcdb47a1700 1 -- 172.21.15.154:0/4034510881 shutdown_connections 2023-09-30T22:26:58.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.009+0000 7fcdb47a1700 1 --2- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdac139200 0x7fcdac11f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.009+0000 7fcdb47a1700 1 --2- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdac0a0a70 0x7fcdac11e7b0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.009+0000 7fcdb47a1700 1 --2- 172.21.15.154:0/4034510881 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdac0a1550 0x7fcdac11ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.009+0000 7fcdb47a1700 1 -- 172.21.15.154:0/4034510881 >> 172.21.15.154:0/4034510881 conn(0x7fcdac0a6610 msgr2=0x7fcdac0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.009+0000 7fcdb47a1700 1 -- 172.21.15.154:0/4034510881 shutdown_connections 2023-09-30T22:26:58.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.009+0000 7fcdb47a1700 1 -- 172.21.15.154:0/4034510881 wait complete. 2023-09-30T22:26:58.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:58.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.029+0000 7f6a010e3700 1 -- 172.21.15.154:0/565805853 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f69fc09b580 con 0x7f69fc09d860 2023-09-30T22:26:58.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.030+0000 7f69e37fe700 1 -- 172.21.15.154:0/565805853 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f69ec021070 con 0x7f69fc09d860 2023-09-30T22:26:58.030 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:58.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.032+0000 7f6a010e3700 1 -- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc09d860 msgr2=0x7f69fc121280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.032+0000 7f6a010e3700 1 --2- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc09d860 0x7f69fc121280 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00ebe0 tx=0x7f69ec00eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.032+0000 7f6a010e3700 1 -- 172.21.15.154:0/565805853 shutdown_connections 2023-09-30T22:26:58.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.032+0000 7f6a010e3700 1 --2- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69fc130ce0 0x7f69fc121d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.032+0000 7f6a010e3700 1 --2- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f69fc09d860 0x7f69fc121280 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.032+0000 7f6a010e3700 1 --2- 172.21.15.154:0/565805853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69fc09e170 0x7f69fc1217c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.032+0000 7f6a010e3700 1 -- 172.21.15.154:0/565805853 >> 172.21.15.154:0/565805853 conn(0x7f69fc099c40 msgr2=0x7f69fc130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.032+0000 7f6a010e3700 1 -- 172.21.15.154:0/565805853 shutdown_connections 2023-09-30T22:26:58.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.032+0000 7f6a010e3700 1 -- 172.21.15.154:0/565805853 wait complete. 2023-09-30T22:26:58.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:26:58.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:26:58.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.951+0000 7f08ed595700 1 Processor -- start 2023-09-30T22:26:58.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.951+0000 7f08ed595700 1 -- start start 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08ed595700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08e80a1570 0x7f08e8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08ed595700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e81393c0 0x7f08e813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08ed595700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e80a1fe0 con 0x7f08e80a0a90 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08ed595700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e80a3aa0 con 0x7f08e80a1570 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08ed595700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e809a540 con 0x7f08e81393c0 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08e67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08e80a1570 0x7f08e8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08e77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e81393c0 0x7f08e813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08e67fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08e80a1570 0x7f08e8138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44396/0 (socket says 172.21.15.154:44396) 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08e67fc700 1 -- 172.21.15.154:0/3641523526 learned_addr learned my addr 172.21.15.154:0/3641523526 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08e77fe700 1 -- 172.21.15.154:0/3641523526 >> v2:172.21.15.154:3300/0 conn(0x7f08e80a1570 msgr2=0x7f08e8138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08e77fe700 1 --2- 172.21.15.154:0/3641523526 >> v2:172.21.15.154:3300/0 conn(0x7f08e80a1570 0x7f08e8138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08e77fe700 1 -- 172.21.15.154:0/3641523526 >> v1:172.21.15.154:6789/0 conn(0x7f08e80a0a90 legacy=0x7f08e80a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08e77fe700 1 -- 172.21.15.154:0/3641523526 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e809a280 con 0x7f08e81393c0 2023-09-30T22:26:58.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.952+0000 7f08e67fc700 1 --2- 172.21.15.154:0/3641523526 >> v2:172.21.15.154:3300/0 conn(0x7f08e80a1570 0x7f08e8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:58.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08e77fe700 1 --2- 172.21.15.154:0/3641523526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e81393c0 0x7f08e813b7a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009d90 tx=0x7f08e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d58cf8acdf3689 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:58.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08e5ffb700 1 -- 172.21.15.154:0/3641523526 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e000e070 con 0x7f08e81393c0 2023-09-30T22:26:58.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08e5ffb700 1 -- 172.21.15.154:0/3641523526 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e000bb20 con 0x7f08e81393c0 2023-09-30T22:26:58.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08e5ffb700 1 -- 172.21.15.154:0/3641523526 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0012430 con 0x7f08e81393c0 2023-09-30T22:26:58.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08ed595700 1 -- 172.21.15.154:0/3641523526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e81393c0 msgr2=0x7f08e813b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08ed595700 1 --2- 172.21.15.154:0/3641523526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e81393c0 0x7f08e813b7a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009d90 tx=0x7f08e000b330 comp rx=0 tx=0).stop 2023-09-30T22:26:58.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08ed595700 1 -- 172.21.15.154:0/3641523526 shutdown_connections 2023-09-30T22:26:58.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08ed595700 1 --2- 172.21.15.154:0/3641523526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e81393c0 0x7f08e813b7a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08ed595700 1 --2- 172.21.15.154:0/3641523526 >> v2:172.21.15.154:3300/0 conn(0x7f08e80a1570 0x7f08e8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08ed595700 1 -- 172.21.15.154:0/3641523526 >> 172.21.15.154:0/3641523526 conn(0x7f08e8099c40 msgr2=0x7f08e806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:58.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08ed595700 1 -- 172.21.15.154:0/3641523526 shutdown_connections 2023-09-30T22:26:58.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.953+0000 7f08ed595700 1 -- 172.21.15.154:0/3641523526 wait complete. 2023-09-30T22:26:58.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.954+0000 7f08ed595700 1 Processor -- start 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.954+0000 7f08ed595700 1 -- start start 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08ed595700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e80a0a90 0x7f08e8122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08ed595700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e80a1570 0x7f08e8123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08ed595700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08e81393c0 0x7f08e81235c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08ed595700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e8124860 con 0x7f08e80a0a90 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08ed595700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e809c7e0 con 0x7f08e80a1570 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08ed595700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08e8138c70 con 0x7f08e81393c0 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e80a1570 0x7f08e8123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e80a0a90 0x7f08e8122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e80a1570 0x7f08e8123080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33020/0 (socket says 172.21.15.154:33020) 2023-09-30T22:26:58.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e67fc700 1 -- 172.21.15.154:0/4031272391 learned_addr learned my addr 172.21.15.154:0/4031272391 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e77fe700 1 --2- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08e81393c0 0x7f08e81235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e67fc700 1 -- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08e81393c0 msgr2=0x7f08e81235c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e67fc700 1 --2- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08e81393c0 0x7f08e81235c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e67fc700 1 -- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e80a0a90 msgr2=0x7f08e8122b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e67fc700 1 --2- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e80a0a90 0x7f08e8122b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e67fc700 1 -- 172.21.15.154:0/4031272391 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009550 con 0x7f08e80a1570 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e6ffd700 1 --2- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e80a0a90 0x7f08e8122b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.955+0000 7f08e67fc700 1 --2- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e80a1570 0x7f08e8123080 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f08d800ebe0 tx=0x7f08d800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.956+0000 7f08df7fe700 1 -- 172.21.15.154:0/4031272391 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800c850 con 0x7f08e80a1570 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.956+0000 7f08df7fe700 1 -- 172.21.15.154:0/4031272391 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d800c9b0 con 0x7f08e80a1570 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.956+0000 7f08ed595700 1 -- 172.21.15.154:0/4031272391 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e0009a70 con 0x7f08e80a1570 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.956+0000 7f08df7fe700 1 -- 172.21.15.154:0/4031272391 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800cd40 con 0x7f08e80a1570 2023-09-30T22:26:58.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.956+0000 7f08ed595700 1 -- 172.21.15.154:0/4031272391 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e809b130 con 0x7f08e80a1570 2023-09-30T22:26:58.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.956+0000 7f08df7fe700 1 -- 172.21.15.154:0/4031272391 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08d8013470 con 0x7f08e80a1570 2023-09-30T22:26:58.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.956+0000 7f08df7fe700 1 -- 172.21.15.154:0/4031272391 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f08d803fc00 con 0x7f08e80a1570 2023-09-30T22:26:58.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.957+0000 7f08ed595700 1 -- 172.21.15.154:0/4031272391 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e80a10d0 con 0x7f08e80a1570 2023-09-30T22:26:58.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:58.961+0000 7f08df7fe700 1 -- 172.21.15.154:0/4031272391 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08d801b3b0 con 0x7f08e80a1570 2023-09-30T22:26:58.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:26:59.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:26:59.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:26:59.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.120+0000 7fc76df2a700 1 Processor -- start 2023-09-30T22:26:59.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.120+0000 7fc76df2a700 1 -- start start 2023-09-30T22:26:59.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.121+0000 7fc76df2a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76809e340 0x7fc7681359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.121+0000 7fc76df2a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc768135f20 0x7fc768138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.121+0000 7fc76df2a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76809aaa0 con 0x7fc76809d860 2023-09-30T22:26:59.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.121+0000 7fc76df2a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76809e730 con 0x7fc76809e340 2023-09-30T22:26:59.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.121+0000 7fc76df2a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc76809f870 con 0x7fc768135f20 2023-09-30T22:26:59.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.121+0000 7fc767fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc768135f20 0x7fc768138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.121+0000 7fc766ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76809e340 0x7fc7681359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.121+0000 7fc767fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc768135f20 0x7fc768138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51496/0 (socket says 172.21.15.154:51496) 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.121+0000 7fc767fff700 1 -- 172.21.15.154:0/2253028852 learned_addr learned my addr 172.21.15.154:0/2253028852 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.122+0000 7fc766ffd700 1 -- 172.21.15.154:0/2253028852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc768135f20 msgr2=0x7fc768138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.122+0000 7fc766ffd700 1 --2- 172.21.15.154:0/2253028852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc768135f20 0x7fc768138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.122+0000 7fc766ffd700 1 -- 172.21.15.154:0/2253028852 >> v1:172.21.15.154:6789/0 conn(0x7fc76809d860 legacy=0x7fc76809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.122+0000 7fc766ffd700 1 -- 172.21.15.154:0/2253028852 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76809b360 con 0x7fc76809e340 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.122+0000 7fc766ffd700 1 --2- 172.21.15.154:0/2253028852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76809e340 0x7fc7681359e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009870 tx=0x7fc75c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=555924ed49abd50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.122+0000 7fc7667fc700 1 -- 172.21.15.154:0/2253028852 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011830 con 0x7fc76809e340 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.122+0000 7fc7667fc700 1 -- 172.21.15.154:0/2253028852 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c011990 con 0x7fc76809e340 2023-09-30T22:26:59.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.122+0000 7fc7667fc700 1 -- 172.21.15.154:0/2253028852 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011d20 con 0x7fc76809e340 2023-09-30T22:26:59.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.123+0000 7fc76df2a700 1 -- 172.21.15.154:0/2253028852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76809e340 msgr2=0x7fc7681359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.123+0000 7fc76df2a700 1 --2- 172.21.15.154:0/2253028852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76809e340 0x7fc7681359e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009870 tx=0x7fc75c009b80 comp rx=0 tx=0).stop 2023-09-30T22:26:59.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.123+0000 7fc76df2a700 1 -- 172.21.15.154:0/2253028852 shutdown_connections 2023-09-30T22:26:59.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.123+0000 7fc76df2a700 1 --2- 172.21.15.154:0/2253028852 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc768135f20 0x7fc768138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.123+0000 7fc76df2a700 1 --2- 172.21.15.154:0/2253028852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc76809e340 0x7fc7681359e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.123+0000 7fc76df2a700 1 -- 172.21.15.154:0/2253028852 >> 172.21.15.154:0/2253028852 conn(0x7fc768099c40 msgr2=0x7fc7680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.123+0000 7fc76df2a700 1 -- 172.21.15.154:0/2253028852 shutdown_connections 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.123+0000 7fc76df2a700 1 -- 172.21.15.154:0/2253028852 wait complete. 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.124+0000 7fc76df2a700 1 Processor -- start 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.124+0000 7fc76df2a700 1 -- start start 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc76df2a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76809d860 0x7fc7681c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc76df2a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76809e340 0x7fc7681c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc76df2a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc768135f20 0x7fc768119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc76df2a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76811c7a0 con 0x7fc76809e340 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc76df2a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76811b210 con 0x7fc768135f20 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc76df2a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc768130240 con 0x7fc76809d860 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc7677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76809d860 0x7fc7681c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc7677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76809d860 0x7fc7681c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51508/0 (socket says 172.21.15.154:51508) 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc7677fe700 1 -- 172.21.15.154:0/2783323499 learned_addr learned my addr 172.21.15.154:0/2783323499 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc766ffd700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76809e340 0x7fc7681c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.125+0000 7fc767fff700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc768135f20 0x7fc768119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc767fff700 1 -- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76809d860 msgr2=0x7fc7681c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc767fff700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76809d860 0x7fc7681c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc767fff700 1 -- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76809e340 msgr2=0x7fc7681c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc767fff700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76809e340 0x7fc7681c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc767fff700 1 -- 172.21.15.154:0/2783323499 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0094a0 con 0x7fc768135f20 2023-09-30T22:26:59.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc766ffd700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76809e340 0x7fc7681c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:59.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc767fff700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc768135f20 0x7fc768119630 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc760009fc0 tx=0x7fc76000e5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc74ffff700 1 -- 172.21.15.154:0/2783323499 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76000ee30 con 0x7fc768135f20 2023-09-30T22:26:59.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc74ffff700 1 -- 172.21.15.154:0/2783323499 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc760003a20 con 0x7fc768135f20 2023-09-30T22:26:59.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc76df2a700 1 -- 172.21.15.154:0/2783323499 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76811ca00 con 0x7fc768135f20 2023-09-30T22:26:59.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc74ffff700 1 -- 172.21.15.154:0/2783323499 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760003db0 con 0x7fc768135f20 2023-09-30T22:26:59.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.126+0000 7fc76df2a700 1 -- 172.21.15.154:0/2783323499 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76811d010 con 0x7fc768135f20 2023-09-30T22:26:59.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.127+0000 7fc76df2a700 1 -- 172.21.15.154:0/2783323499 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76811cc20 con 0x7fc768135f20 2023-09-30T22:26:59.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.127+0000 7fc74ffff700 1 -- 172.21.15.154:0/2783323499 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc760004030 con 0x7fc768135f20 2023-09-30T22:26:59.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.128+0000 7fc74ffff700 1 -- 172.21.15.154:0/2783323499 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc760016030 con 0x7fc768135f20 2023-09-30T22:26:59.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.136+0000 7fc74ffff700 1 -- 172.21.15.154:0/2783323499 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc760023940 con 0x7fc768135f20 2023-09-30T22:26:59.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.161+0000 7f08ed595700 1 -- 172.21.15.154:0/4031272391 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08e804f2a0 con 0x7f08e80a1570 2023-09-30T22:26:59.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.162+0000 7f08df7fe700 1 -- 172.21.15.154:0/4031272391 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08d8011ca0 con 0x7f08e80a1570 2023-09-30T22:26:59.162 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:26:59.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.164+0000 7f08ed595700 1 -- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e80a1570 msgr2=0x7f08e8123080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.164+0000 7f08ed595700 1 --2- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e80a1570 0x7f08e8123080 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f08d800ebe0 tx=0x7f08d800eef0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.164+0000 7f08ed595700 1 -- 172.21.15.154:0/4031272391 shutdown_connections 2023-09-30T22:26:59.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.164+0000 7f08ed595700 1 --2- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f08e81393c0 0x7f08e81235c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.164+0000 7f08ed595700 1 --2- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e80a0a90 0x7f08e8122b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.164+0000 7f08ed595700 1 --2- 172.21.15.154:0/4031272391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08e80a1570 0x7f08e8123080 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.164+0000 7f08ed595700 1 -- 172.21.15.154:0/4031272391 >> 172.21.15.154:0/4031272391 conn(0x7f08e8099c40 msgr2=0x7f08e811c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.164+0000 7f08ed595700 1 -- 172.21.15.154:0/4031272391 shutdown_connections 2023-09-30T22:26:59.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.165+0000 7f08ed595700 1 -- 172.21.15.154:0/4031272391 wait complete. 2023-09-30T22:26:59.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.169+0000 7f19810fd700 1 Processor -- start 2023-09-30T22:26:59.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.169+0000 7f19810fd700 1 -- start start 2023-09-30T22:26:59.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f19810fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f19810fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f19810fd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f197c0a1290 0x7f197c13a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f19810fd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c133640 con 0x7f197c0a1290 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f19810fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0a1d50 con 0x7f197c0a08e0 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f19810fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0a1730 con 0x7f197c133a70 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51524/0 (socket says 172.21.15.154:51524) 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197ad9d700 1 -- 172.21.15.154:0/2148403564 learned_addr learned my addr 172.21.15.154:0/2148403564 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197a59c700 1 --2- 172.21.15.154:0/2148403564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197b59e700 1 --2- 172.21.15.154:0/2148403564 >> v2:172.21.15.154:3300/0 conn(0x7f197c0a1290 0x7f197c13a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197ad9d700 1 -- 172.21.15.154:0/2148403564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 msgr2=0x7f197c0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197ad9d700 1 --2- 172.21.15.154:0/2148403564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c0a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197ad9d700 1 -- 172.21.15.154:0/2148403564 >> v2:172.21.15.154:3300/0 conn(0x7f197c0a1290 msgr2=0x7f197c13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197ad9d700 1 --2- 172.21.15.154:0/2148403564 >> v2:172.21.15.154:3300/0 conn(0x7f197c0a1290 0x7f197c13a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197ad9d700 1 -- 172.21.15.154:0/2148403564 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c09b620 con 0x7f197c133a70 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.170+0000 7f197a59c700 1 --2- 172.21.15.154:0/2148403564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f197ad9d700 1 --2- 172.21.15.154:0/2148403564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c133e40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f196c006fd0 tx=0x7f196c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c30a6aaeb5c8d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f1979d9b700 1 -- 172.21.15.154:0/2148403564 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c005e30 con 0x7f197c133a70 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f1979d9b700 1 -- 172.21.15.154:0/2148403564 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c004030 con 0x7f197c133a70 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f1979d9b700 1 -- 172.21.15.154:0/2148403564 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c0043e0 con 0x7f197c133a70 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f19810fd700 1 -- 172.21.15.154:0/2148403564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 msgr2=0x7f197c133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f19810fd700 1 --2- 172.21.15.154:0/2148403564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c133e40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f196c006fd0 tx=0x7f196c009bd0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f19810fd700 1 -- 172.21.15.154:0/2148403564 shutdown_connections 2023-09-30T22:26:59.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f19810fd700 1 --2- 172.21.15.154:0/2148403564 >> v2:172.21.15.154:3300/0 conn(0x7f197c0a1290 0x7f197c13a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f19810fd700 1 --2- 172.21.15.154:0/2148403564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c133e40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.171+0000 7f19810fd700 1 --2- 172.21.15.154:0/2148403564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.172+0000 7f19810fd700 1 -- 172.21.15.154:0/2148403564 >> 172.21.15.154:0/2148403564 conn(0x7f197c0a2980 msgr2=0x7f197c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.172+0000 7f19810fd700 1 -- 172.21.15.154:0/2148403564 shutdown_connections 2023-09-30T22:26:59.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.172+0000 7f19810fd700 1 -- 172.21.15.154:0/2148403564 wait complete. 2023-09-30T22:26:59.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.173+0000 7f19810fd700 1 Processor -- start 2023-09-30T22:26:59.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.173+0000 7f19810fd700 1 -- start start 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.173+0000 7f19810fd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c11c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.173+0000 7f19810fd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197c0a1290 0x7f197c11cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.173+0000 7f19810fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c11d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.173+0000 7f19810fd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c11ff60 con 0x7f197c0a1290 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.173+0000 7f19810fd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c09a350 con 0x7f197c0a08e0 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.173+0000 7f19810fd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f197c11e440 con 0x7f197c133a70 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c11c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197c0a1290 0x7f197c11cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c11c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33058/0 (socket says 172.21.15.154:33058) 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197c0a1290 0x7f197c11cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44422/0 (socket says 172.21.15.154:44422) 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197ad9d700 1 -- 172.21.15.154:0/1294295219 learned_addr learned my addr 172.21.15.154:0/1294295219 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:59.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197b59e700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c11d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197a59c700 1 -- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 msgr2=0x7f197c11d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197a59c700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c11d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197a59c700 1 -- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 msgr2=0x7f197c11c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197a59c700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c11c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197a59c700 1 -- 172.21.15.154:0/1294295219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700094a0 con 0x7f197c0a1290 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197b59e700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c11d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197ad9d700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c11c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f197a59c700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197c0a1290 0x7f197c11cc60 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f197000e980 tx=0x7f197000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f19637fe700 1 -- 172.21.15.154:0/1294295219 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000c690 con 0x7f197c0a1290 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f19637fe700 1 -- 172.21.15.154:0/1294295219 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197000c7f0 con 0x7f197c0a1290 2023-09-30T22:26:59.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f19810fd700 1 -- 172.21.15.154:0/1294295219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c009500 con 0x7f197c0a1290 2023-09-30T22:26:59.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f19637fe700 1 -- 172.21.15.154:0/1294295219 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000cb80 con 0x7f197c0a1290 2023-09-30T22:26:59.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.174+0000 7f19810fd700 1 -- 172.21.15.154:0/1294295219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c131ea0 con 0x7f197c0a1290 2023-09-30T22:26:59.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.176+0000 7f19810fd700 1 -- 172.21.15.154:0/1294295219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c120360 con 0x7f197c0a1290 2023-09-30T22:26:59.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.176+0000 7f19637fe700 1 -- 172.21.15.154:0/1294295219 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f197000cce0 con 0x7f197c0a1290 2023-09-30T22:26:59.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.176+0000 7f19637fe700 1 -- 172.21.15.154:0/1294295219 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f197003fec0 con 0x7f197c0a1290 2023-09-30T22:26:59.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.181+0000 7f19637fe700 1 -- 172.21.15.154:0/1294295219 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1970024350 con 0x7f197c0a1290 2023-09-30T22:26:59.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:26:59.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.220+0000 7f61c7a83700 1 Processor -- start 2023-09-30T22:26:59.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.220+0000 7f61c7a83700 1 -- start start 2023-09-30T22:26:59.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c7a83700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61c009d860 0x7f61c009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c7a83700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c009e170 0x7f61c01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c7a83700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c009aaa0 con 0x7f61c0130ce0 2023-09-30T22:26:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c7a83700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c009f870 con 0x7f61c009d860 2023-09-30T22:26:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c7a83700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61c009b360 con 0x7f61c009e170 2023-09-30T22:26:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c581f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61c009d860 0x7f61c009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c581f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61c009d860 0x7f61c009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44436/0 (socket says 172.21.15.154:44436) 2023-09-30T22:26:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c581f700 1 -- 172.21.15.154:0/1358748125 learned_addr learned my addr 172.21.15.154:0/1358748125 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:59.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c501e700 1 --2- 172.21.15.154:0/1358748125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c009e170 0x7f61c01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c581f700 1 -- 172.21.15.154:0/1358748125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c009e170 msgr2=0x7f61c01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:26:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c581f700 1 --2- 172.21.15.154:0/1358748125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c009e170 0x7f61c01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c581f700 1 -- 172.21.15.154:0/1358748125 >> v1:172.21.15.154:6789/0 conn(0x7f61c0130ce0 legacy=0x7f61c01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c581f700 1 -- 172.21.15.154:0/1358748125 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c009b620 con 0x7f61c009d860 2023-09-30T22:26:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c481d700 1 -- 172.21.15.154:0/1358748125 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516026499 0 0) 0x7f61c009aaa0 con 0x7f61c0130ce0 2023-09-30T22:26:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c501e700 1 --2- 172.21.15.154:0/1358748125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c009e170 0x7f61c01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:26:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.221+0000 7f61c581f700 1 --2- 172.21.15.154:0/1358748125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 0x7f61c009dc30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0098f0 tx=0x7f61bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d15b4e9e4148ef server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c481d700 1 -- 172.21.15.154:0/1358748125 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc011830 con 0x7f61c009d860 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c481d700 1 -- 172.21.15.154:0/1358748125 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc011990 con 0x7f61c009d860 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c481d700 1 -- 172.21.15.154:0/1358748125 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc011d20 con 0x7f61c009d860 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c7a83700 1 -- 172.21.15.154:0/1358748125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 msgr2=0x7f61c009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c7a83700 1 --2- 172.21.15.154:0/1358748125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 0x7f61c009dc30 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0098f0 tx=0x7f61bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c7a83700 1 -- 172.21.15.154:0/1358748125 shutdown_connections 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c7a83700 1 --2- 172.21.15.154:0/1358748125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 0x7f61c009dc30 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c7a83700 1 --2- 172.21.15.154:0/1358748125 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c009e170 0x7f61c01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c7a83700 1 -- 172.21.15.154:0/1358748125 >> 172.21.15.154:0/1358748125 conn(0x7f61c0099c40 msgr2=0x7f61c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c7a83700 1 -- 172.21.15.154:0/1358748125 shutdown_connections 2023-09-30T22:26:59.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.222+0000 7f61c7a83700 1 -- 172.21.15.154:0/1358748125 wait complete. 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.224+0000 7f61c7a83700 1 Processor -- start 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.224+0000 7f61c7a83700 1 -- start start 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.224+0000 7f61c7a83700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 0x7f61c011f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.224+0000 7f61c7a83700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61c009e170 0x7f61c011fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.224+0000 7f61c7a83700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c0130ce0 0x7f61c011ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.224+0000 7f61c7a83700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0122740 con 0x7f61c009d860 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.224+0000 7f61c7a83700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00a0700 con 0x7f61c009e170 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.224+0000 7f61c7a83700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61c009c8b0 con 0x7f61c0130ce0 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.224+0000 7f61c581f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 0x7f61c011f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c581f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 0x7f61c011f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44438/0 (socket says 172.21.15.154:44438) 2023-09-30T22:26:59.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c581f700 1 -- 172.21.15.154:0/2785099612 learned_addr learned my addr 172.21.15.154:0/2785099612 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c6020700 1 --2- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c0130ce0 0x7f61c011ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c581f700 1 -- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c0130ce0 msgr2=0x7f61c011ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c581f700 1 --2- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c0130ce0 0x7f61c011ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c581f700 1 -- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61c009e170 msgr2=0x7f61c011fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c581f700 1 --2- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61c009e170 0x7f61c011fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c581f700 1 -- 172.21.15.154:0/2785099612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00094a0 con 0x7f61c009d860 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c581f700 1 --2- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 0x7f61c011f4f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009c40 tx=0x7f61bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61b67fc700 1 -- 172.21.15.154:0/2785099612 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc0036a0 con 0x7f61c009d860 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c7a83700 1 -- 172.21.15.154:0/2785099612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc009550 con 0x7f61c009d860 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61b67fc700 1 -- 172.21.15.154:0/2785099612 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc003800 con 0x7f61c009d860 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61b67fc700 1 -- 172.21.15.154:0/2785099612 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc003bb0 con 0x7f61c009d860 2023-09-30T22:26:59.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.225+0000 7f61c7a83700 1 -- 172.21.15.154:0/2785099612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c0122d60 con 0x7f61c009d860 2023-09-30T22:26:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.226+0000 7f61b67fc700 1 -- 172.21.15.154:0/2785099612 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61bc003d10 con 0x7f61c009d860 2023-09-30T22:26:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.226+0000 7f61b67fc700 1 -- 172.21.15.154:0/2785099612 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f61bc042a60 con 0x7f61c009d860 2023-09-30T22:26:59.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.226+0000 7f61c7a83700 1 -- 172.21.15.154:0/2785099612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c004f2a0 con 0x7f61c009d860 2023-09-30T22:26:59.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.231+0000 7f61b67fc700 1 -- 172.21.15.154:0/2785099612 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61bc02e440 con 0x7f61c009d860 2023-09-30T22:26:59.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.378+0000 7fc76df2a700 1 -- 172.21.15.154:0/2783323499 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc76804f2a0 con 0x7fc768135f20 2023-09-30T22:26:59.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.379+0000 7fc74ffff700 1 -- 172.21.15.154:0/2783323499 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc760023350 con 0x7fc768135f20 2023-09-30T22:26:59.379 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:59.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.381+0000 7fc76df2a700 1 -- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc768135f20 msgr2=0x7fc768119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.381+0000 7fc76df2a700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc768135f20 0x7fc768119630 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc760009fc0 tx=0x7fc76000e5b0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.381+0000 7fc76df2a700 1 -- 172.21.15.154:0/2783323499 shutdown_connections 2023-09-30T22:26:59.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.381+0000 7fc76df2a700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc768135f20 0x7fc768119630 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.381+0000 7fc76df2a700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc76809d860 0x7fc7681c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.381+0000 7fc76df2a700 1 --2- 172.21.15.154:0/2783323499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc76809e340 0x7fc7681c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.381+0000 7fc76df2a700 1 -- 172.21.15.154:0/2783323499 >> 172.21.15.154:0/2783323499 conn(0x7fc768099c40 msgr2=0x7fc7680a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.381+0000 7fc76df2a700 1 -- 172.21.15.154:0/2783323499 shutdown_connections 2023-09-30T22:26:59.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.381+0000 7fc76df2a700 1 -- 172.21.15.154:0/2783323499 wait complete. 2023-09-30T22:26:59.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.392+0000 7f19810fd700 1 -- 172.21.15.154:0/1294295219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f197c04f2a0 con 0x7f197c0a1290 2023-09-30T22:26:59.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.393+0000 7f19637fe700 1 -- 172.21.15.154:0/1294295219 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f197002a090 con 0x7f197c0a1290 2023-09-30T22:26:59.392 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:26:59.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:26:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.395+0000 7f19810fd700 1 -- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197c0a1290 msgr2=0x7f197c11cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.395+0000 7f19810fd700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197c0a1290 0x7f197c11cc60 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f197000e980 tx=0x7f197000ec90 comp rx=0 tx=0).stop 2023-09-30T22:26:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.395+0000 7f19810fd700 1 -- 172.21.15.154:0/1294295219 shutdown_connections 2023-09-30T22:26:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.395+0000 7f19810fd700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f197c133a70 0x7f197c11d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.395+0000 7f19810fd700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197c0a08e0 0x7f197c11c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.395+0000 7f19810fd700 1 --2- 172.21.15.154:0/1294295219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197c0a1290 0x7f197c11cc60 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.395+0000 7f19810fd700 1 -- 172.21.15.154:0/1294295219 >> 172.21.15.154:0/1294295219 conn(0x7f197c0a2980 msgr2=0x7f197c1bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.395+0000 7f19810fd700 1 -- 172.21.15.154:0/1294295219 shutdown_connections 2023-09-30T22:26:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.395+0000 7f19810fd700 1 -- 172.21.15.154:0/1294295219 wait complete. 2023-09-30T22:26:59.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:26:59.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.446+0000 7f61c7a83700 1 -- 172.21.15.154:0/2785099612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61c0121160 con 0x7f61c009d860 2023-09-30T22:26:59.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.447+0000 7f61b67fc700 1 -- 172.21.15.154:0/2785099612 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61bc015020 con 0x7f61c009d860 2023-09-30T22:26:59.447 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:26:59.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.449+0000 7f61c7a83700 1 -- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 msgr2=0x7f61c011f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:26:59.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.449+0000 7f61c7a83700 1 --2- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 0x7f61c011f4f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009c40 tx=0x7f61bc004750 comp rx=0 tx=0).stop 2023-09-30T22:26:59.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.449+0000 7f61c7a83700 1 -- 172.21.15.154:0/2785099612 shutdown_connections 2023-09-30T22:26:59.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.449+0000 7f61c7a83700 1 --2- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61c0130ce0 0x7f61c011ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.449+0000 7f61c7a83700 1 --2- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c009d860 0x7f61c011f4f0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.449+0000 7f61c7a83700 1 --2- 172.21.15.154:0/2785099612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61c009e170 0x7f61c011fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:26:59.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.449+0000 7f61c7a83700 1 -- 172.21.15.154:0/2785099612 >> 172.21.15.154:0/2785099612 conn(0x7f61c0099c40 msgr2=0x7f61c00a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:26:59.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.449+0000 7f61c7a83700 1 -- 172.21.15.154:0/2785099612 shutdown_connections 2023-09-30T22:26:59.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:26:59.449+0000 7f61c7a83700 1 -- 172.21.15.154:0/2785099612 wait complete. 2023-09-30T22:26:59.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:00.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:00.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.322+0000 7f1f2d19f700 1 Processor -- start 2023-09-30T22:27:00.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.322+0000 7f1f2d19f700 1 -- start start 2023-09-30T22:27:00.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2d19f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f2809a150 0x7f1f2809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2d19f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f2809edb0 0x7f1f2809f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2d19f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2809af80 con 0x7f1f28133c20 2023-09-30T22:27:00.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2d19f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2809fe00 con 0x7f1f2809a150 2023-09-30T22:27:00.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2d19f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2806bec0 con 0x7f1f2809edb0 2023-09-30T22:27:00.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f2809edb0 0x7f1f2809f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f26d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f2809a150 0x7f1f2809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f2809edb0 0x7f1f2809f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51570/0 (socket says 172.21.15.154:51570) 2023-09-30T22:27:00.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f26d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f2809a150 0x7f1f2809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44452/0 (socket says 172.21.15.154:44452) 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2659c700 1 -- 172.21.15.154:0/1942153514 learned_addr learned my addr 172.21.15.154:0/1942153514 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2659c700 1 -- 172.21.15.154:0/1942153514 >> v2:172.21.15.154:3300/0 conn(0x7f1f2809a150 msgr2=0x7f1f2809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2659c700 1 --2- 172.21.15.154:0/1942153514 >> v2:172.21.15.154:3300/0 conn(0x7f1f2809a150 0x7f1f2809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2659c700 1 -- 172.21.15.154:0/1942153514 >> v1:172.21.15.154:6789/0 conn(0x7f1f28133c20 legacy=0x7f1f281340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2659c700 1 -- 172.21.15.154:0/1942153514 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2809f6e0 con 0x7f1f2809edb0 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f26d9d700 1 --2- 172.21.15.154:0/1942153514 >> v2:172.21.15.154:3300/0 conn(0x7f1f2809a150 0x7f1f2809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f2659c700 1 --2- 172.21.15.154:0/1942153514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f2809edb0 0x7f1f2809f1a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1f180098f0 tx=0x7f1f18009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfdb2b1adc6cbcea server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f25d9b700 1 -- 172.21.15.154:0/1942153514 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18011830 con 0x7f1f2809edb0 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f25d9b700 1 -- 172.21.15.154:0/1942153514 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f18011990 con 0x7f1f2809edb0 2023-09-30T22:27:00.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.323+0000 7f1f25d9b700 1 -- 172.21.15.154:0/1942153514 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18011d20 con 0x7f1f2809edb0 2023-09-30T22:27:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.324+0000 7f1f2d19f700 1 -- 172.21.15.154:0/1942153514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f2809edb0 msgr2=0x7f1f2809f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.324+0000 7f1f2d19f700 1 --2- 172.21.15.154:0/1942153514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f2809edb0 0x7f1f2809f1a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1f180098f0 tx=0x7f1f18009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.324+0000 7f1f2d19f700 1 -- 172.21.15.154:0/1942153514 shutdown_connections 2023-09-30T22:27:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.324+0000 7f1f2d19f700 1 --2- 172.21.15.154:0/1942153514 >> v2:172.21.15.154:3300/0 conn(0x7f1f2809a150 0x7f1f2809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.324+0000 7f1f2d19f700 1 --2- 172.21.15.154:0/1942153514 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f2809edb0 0x7f1f2809f1a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.324+0000 7f1f2d19f700 1 -- 172.21.15.154:0/1942153514 >> 172.21.15.154:0/1942153514 conn(0x7f1f280a4430 msgr2=0x7f1f280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.324+0000 7f1f2d19f700 1 -- 172.21.15.154:0/1942153514 shutdown_connections 2023-09-30T22:27:00.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.324+0000 7f1f2d19f700 1 -- 172.21.15.154:0/1942153514 wait complete. 2023-09-30T22:27:00.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.325+0000 7f1f2d19f700 1 Processor -- start 2023-09-30T22:27:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.325+0000 7f1f2d19f700 1 -- start start 2023-09-30T22:27:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2d19f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2809a150 0x7f1f281227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2d19f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f2809edb0 0x7f1f28122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2d19f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f28133c20 0x7f1f28123250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2d19f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f281262f0 con 0x7f1f2809a150 2023-09-30T22:27:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2d19f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28124c70 con 0x7f1f2809edb0 2023-09-30T22:27:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2d19f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f280a3a60 con 0x7f1f28133c20 2023-09-30T22:27:00.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2759e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f28133c20 0x7f1f28123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f26d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2809a150 0x7f1f281227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f2809edb0 0x7f1f28122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2759e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f28133c20 0x7f1f28123250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51574/0 (socket says 172.21.15.154:51574) 2023-09-30T22:27:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f2809edb0 0x7f1f28122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33086/0 (socket says 172.21.15.154:33086) 2023-09-30T22:27:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f26d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2809a150 0x7f1f281227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44466/0 (socket says 172.21.15.154:44466) 2023-09-30T22:27:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2759e700 1 -- 172.21.15.154:0/401526473 learned_addr learned my addr 172.21.15.154:0/401526473 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f26d9d700 1 -- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f28133c20 msgr2=0x7f1f28123250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f26d9d700 1 --2- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f28133c20 0x7f1f28123250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f26d9d700 1 -- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f2809edb0 msgr2=0x7f1f28122d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f26d9d700 1 --2- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f2809edb0 0x7f1f28122d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f26d9d700 1 -- 172.21.15.154:0/401526473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0094a0 con 0x7f1f2809a150 2023-09-30T22:27:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f2759e700 1 --2- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f28133c20 0x7f1f28123250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f26d9d700 1 --2- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2809a150 0x7f1f281227d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00e900 tx=0x7f1f1c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.326+0000 7f1f0f7fe700 1 -- 172.21.15.154:0/401526473 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c013680 con 0x7f1f2809a150 2023-09-30T22:27:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.327+0000 7f1f0f7fe700 1 -- 172.21.15.154:0/401526473 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1c0137e0 con 0x7f1f2809a150 2023-09-30T22:27:00.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.327+0000 7f1f2d19f700 1 -- 172.21.15.154:0/401526473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f18009550 con 0x7f1f2809a150 2023-09-30T22:27:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.327+0000 7f1f0f7fe700 1 -- 172.21.15.154:0/401526473 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c013b70 con 0x7f1f2809a150 2023-09-30T22:27:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.327+0000 7f1f2d19f700 1 -- 172.21.15.154:0/401526473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f28133720 con 0x7f1f2809a150 2023-09-30T22:27:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.327+0000 7f1f0f7fe700 1 -- 172.21.15.154:0/401526473 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f1c013cd0 con 0x7f1f2809a150 2023-09-30T22:27:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.328+0000 7f1f2d19f700 1 -- 172.21.15.154:0/401526473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2809fa30 con 0x7f1f2809a150 2023-09-30T22:27:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.328+0000 7f1f0f7fe700 1 -- 172.21.15.154:0/401526473 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1f1c03fb60 con 0x7f1f2809a150 2023-09-30T22:27:00.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.332+0000 7f1f0f7fe700 1 -- 172.21.15.154:0/401526473 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f1c021070 con 0x7f1f2809a150 2023-09-30T22:27:00.394 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:00.408 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:00.462 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:00.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.528+0000 7f97ce7d6700 1 Processor -- start 2023-09-30T22:27:00.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.528+0000 7f97ce7d6700 1 -- start start 2023-09-30T22:27:00.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.528+0000 7f97ce7d6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97c809e870 0x7f97c809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.528+0000 7f97ce7d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.528+0000 7f97ce7d6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c809c970 con 0x7f97c8131d70 2023-09-30T22:27:00.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.528+0000 7f97ce7d6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c80a0920 con 0x7f97c809e870 2023-09-30T22:27:00.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.528+0000 7f97ce7d6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97c809f9c0 con 0x7f97c809f180 2023-09-30T22:27:00.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51586/0 (socket says 172.21.15.154:51586) 2023-09-30T22:27:00.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97ccd73700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f97c8131d70 0x7f97c8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56940/0 (socket says 172.21.15.154:56940) 2023-09-30T22:27:00.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c77fe700 1 -- 172.21.15.154:0/1084675411 learned_addr learned my addr 172.21.15.154:0/1084675411 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:00.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c7fff700 1 --2- 172.21.15.154:0/1084675411 >> v2:172.21.15.154:3300/0 conn(0x7f97c809e870 0x7f97c809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c77fe700 1 -- 172.21.15.154:0/1084675411 >> v2:172.21.15.154:3300/0 conn(0x7f97c809e870 msgr2=0x7f97c809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c77fe700 1 --2- 172.21.15.154:0/1084675411 >> v2:172.21.15.154:3300/0 conn(0x7f97c809e870 0x7f97c809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c77fe700 1 -- 172.21.15.154:0/1084675411 >> v1:172.21.15.154:6789/0 conn(0x7f97c8131d70 legacy=0x7f97c8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c77fe700 1 -- 172.21.15.154:0/1084675411 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c809bab0 con 0x7f97c809f180 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c77fe700 1 --2- 172.21.15.154:0/1084675411 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c8131830 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0098f0 tx=0x7f97bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3a5d236888410d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c6ffd700 1 -- 172.21.15.154:0/1084675411 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc011830 con 0x7f97c809f180 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c6ffd700 1 -- 172.21.15.154:0/1084675411 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc011990 con 0x7f97c809f180 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.529+0000 7f97c6ffd700 1 -- 172.21.15.154:0/1084675411 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc011d00 con 0x7f97c809f180 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.530+0000 7f97ce7d6700 1 -- 172.21.15.154:0/1084675411 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 msgr2=0x7f97c8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.530+0000 7f97ce7d6700 1 --2- 172.21.15.154:0/1084675411 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c8131830 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0098f0 tx=0x7f97bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:00.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.530+0000 7f97ce7d6700 1 -- 172.21.15.154:0/1084675411 shutdown_connections 2023-09-30T22:27:00.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.530+0000 7f97ce7d6700 1 --2- 172.21.15.154:0/1084675411 >> v2:172.21.15.154:3300/0 conn(0x7f97c809e870 0x7f97c809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.530+0000 7f97ce7d6700 1 --2- 172.21.15.154:0/1084675411 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c8131830 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.530+0000 7f97ce7d6700 1 -- 172.21.15.154:0/1084675411 >> 172.21.15.154:0/1084675411 conn(0x7f97c80a4430 msgr2=0x7f97c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.530+0000 7f97ce7d6700 1 -- 172.21.15.154:0/1084675411 shutdown_connections 2023-09-30T22:27:00.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.530+0000 7f97ce7d6700 1 -- 172.21.15.154:0/1084675411 wait complete. 2023-09-30T22:27:00.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.531+0000 7f97ce7d6700 1 Processor -- start 2023-09-30T22:27:00.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.531+0000 7f1f2d19f700 1 -- 172.21.15.154:0/401526473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f28125c80 con 0x7f1f2809a150 2023-09-30T22:27:00.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.531+0000 7f97ce7d6700 1 -- start start 2023-09-30T22:27:00.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f1f0f7fe700 1 -- 172.21.15.154:0/401526473 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f1c017030 con 0x7f1f2809a150 2023-09-30T22:27:00.533 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:00.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97ce7d6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c809e870 0x7f97c806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97ce7d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97ce7d6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97c8131d70 0x7f97c806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97ce7d6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8125810 con 0x7f97c809e870 2023-09-30T22:27:00.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97ce7d6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8125e50 con 0x7f97c8131d70 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97ce7d6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97c806d4c0 con 0x7f97c809f180 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c809e870 0x7f97c806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c809e870 0x7f97c806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44482/0 (socket says 172.21.15.154:44482) 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c7fff700 1 -- 172.21.15.154:0/2349404119 learned_addr learned my addr 172.21.15.154:0/2349404119 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c77fe700 1 --2- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51596/0 (socket says 172.21.15.154:51596) 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c77fe700 1 -- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97c8131d70 msgr2=0x7f97c806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c77fe700 1 --2- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97c8131d70 0x7f97c806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c77fe700 1 -- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c809e870 msgr2=0x7f97c806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c77fe700 1 --2- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c809e870 0x7f97c806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c77fe700 1 -- 172.21.15.154:0/2349404119 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc009550 con 0x7f97c809f180 2023-09-30T22:27:00.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.532+0000 7f97c7fff700 1 --2- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c809e870 0x7f97c806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.533+0000 7f97c77fe700 1 --2- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c806bdf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f97bc016000 tx=0x7f97bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.533+0000 7f97c4ff9700 1 -- 172.21.15.154:0/2349404119 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc0036a0 con 0x7f97c809f180 2023-09-30T22:27:00.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.533+0000 7f97c4ff9700 1 -- 172.21.15.154:0/2349404119 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc003800 con 0x7f97c809f180 2023-09-30T22:27:00.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.533+0000 7f97ce7d6700 1 -- 172.21.15.154:0/2349404119 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c80a2cd0 con 0x7f97c809f180 2023-09-30T22:27:00.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.533+0000 7f97c4ff9700 1 -- 172.21.15.154:0/2349404119 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc003b90 con 0x7f97c809f180 2023-09-30T22:27:00.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.533+0000 7f97ce7d6700 1 -- 172.21.15.154:0/2349404119 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c8125b20 con 0x7f97c809f180 2023-09-30T22:27:00.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f97c4ff9700 1 -- 172.21.15.154:0/2349404119 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97bc003cf0 con 0x7f97c809f180 2023-09-30T22:27:00.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f97c4ff9700 1 -- 172.21.15.154:0/2349404119 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f97bc021030 con 0x7f97c809f180 2023-09-30T22:27:00.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f97ce7d6700 1 -- 172.21.15.154:0/2349404119 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c8125980 con 0x7f97c809f180 2023-09-30T22:27:00.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f1f2d19f700 1 -- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2809a150 msgr2=0x7f1f281227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f1f2d19f700 1 --2- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2809a150 0x7f1f281227d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00e900 tx=0x7f1f1c00ec10 comp rx=0 tx=0).stop 2023-09-30T22:27:00.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f1f2d19f700 1 -- 172.21.15.154:0/401526473 shutdown_connections 2023-09-30T22:27:00.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f1f2d19f700 1 --2- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1f28133c20 0x7f1f28123250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f1f2d19f700 1 --2- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f2809a150 0x7f1f281227d0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f1f2d19f700 1 --2- 172.21.15.154:0/401526473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f2809edb0 0x7f1f28122d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.534+0000 7f1f2d19f700 1 -- 172.21.15.154:0/401526473 >> 172.21.15.154:0/401526473 conn(0x7f1f280a4430 msgr2=0x7f1f2809c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.536+0000 7f1f2d19f700 1 -- 172.21.15.154:0/401526473 shutdown_connections 2023-09-30T22:27:00.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.536+0000 7f1f2d19f700 1 -- 172.21.15.154:0/401526473 wait complete. 2023-09-30T22:27:00.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.539+0000 7f97c4ff9700 1 -- 172.21.15.154:0/2349404119 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97c8125980 con 0x7f97c809f180 2023-09-30T22:27:00.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:00.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.572+0000 7fb37ad2c700 1 Processor -- start 2023-09-30T22:27:00.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.572+0000 7fb37ad2c700 1 -- start start 2023-09-30T22:27:00.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.572+0000 7fb37ad2c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb374133ad0 0x7fb374133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.572+0000 7fb37ad2c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3741300a0 0x7fb3741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb37ad2c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37406b2d0 con 0x7fb3741309f0 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb37ad2c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb374133610 con 0x7fb374133ad0 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb37ad2c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb37409a500 con 0x7fb3741300a0 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb378ac8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb374133ad0 0x7fb374133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb378ac8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb374133ad0 0x7fb374133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33098/0 (socket says 172.21.15.154:33098) 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb378ac8700 1 -- 172.21.15.154:0/255956892 learned_addr learned my addr 172.21.15.154:0/255956892 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb373fff700 1 --2- 172.21.15.154:0/255956892 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3741300a0 0x7fb3741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb373fff700 1 -- 172.21.15.154:0/255956892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb374133ad0 msgr2=0x7fb374133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb3737fe700 1 -- 172.21.15.154:0/255956892 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776200402 0 0) 0x7fb37406b2d0 con 0x7fb3741309f0 2023-09-30T22:27:00.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb373fff700 1 --2- 172.21.15.154:0/255956892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb374133ad0 0x7fb374133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb373fff700 1 -- 172.21.15.154:0/255956892 >> v1:172.21.15.154:6789/0 conn(0x7fb3741309f0 legacy=0x7fb37413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb373fff700 1 -- 172.21.15.154:0/255956892 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3741338b0 con 0x7fb3741300a0 2023-09-30T22:27:00.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb373fff700 1 --2- 172.21.15.154:0/255956892 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3741300a0 0x7fb3741304b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb360009870 tx=0x7fb360009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6a7d727afa178b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb3737fe700 1 -- 172.21.15.154:0/255956892 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360011830 con 0x7fb3741300a0 2023-09-30T22:27:00.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb3737fe700 1 -- 172.21.15.154:0/255956892 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb360011990 con 0x7fb3741300a0 2023-09-30T22:27:00.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.573+0000 7fb3737fe700 1 -- 172.21.15.154:0/255956892 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360011d20 con 0x7fb3741300a0 2023-09-30T22:27:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.574+0000 7fb37ad2c700 1 -- 172.21.15.154:0/255956892 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3741300a0 msgr2=0x7fb3741304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.574+0000 7fb37ad2c700 1 --2- 172.21.15.154:0/255956892 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3741300a0 0x7fb3741304b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb360009870 tx=0x7fb360009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.574+0000 7fb37ad2c700 1 -- 172.21.15.154:0/255956892 shutdown_connections 2023-09-30T22:27:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.574+0000 7fb37ad2c700 1 --2- 172.21.15.154:0/255956892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb374133ad0 0x7fb374133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.574+0000 7fb37ad2c700 1 --2- 172.21.15.154:0/255956892 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb3741300a0 0x7fb3741304b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.574+0000 7fb37ad2c700 1 -- 172.21.15.154:0/255956892 >> 172.21.15.154:0/255956892 conn(0x7fb374099c40 msgr2=0x7fb3740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.574+0000 7fb37ad2c700 1 -- 172.21.15.154:0/255956892 shutdown_connections 2023-09-30T22:27:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.574+0000 7fb37ad2c700 1 -- 172.21.15.154:0/255956892 wait complete. 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.575+0000 7fb37ad2c700 1 Processor -- start 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.575+0000 7fb37ad2c700 1 -- start start 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb37ad2c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3741300a0 0x7fb37411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb37ad2c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3741309f0 0x7fb37411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb37ad2c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb374133ad0 0x7fb37411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb37ad2c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb374120950 con 0x7fb3741309f0 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb37ad2c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37412d930 con 0x7fb3741300a0 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb37ad2c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb37411fd00 con 0x7fb374133ad0 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb373fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3741309f0 0x7fb37411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb378ac8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3741300a0 0x7fb37411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb3792c9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb374133ad0 0x7fb37411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb373fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3741309f0 0x7fb37411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44494/0 (socket says 172.21.15.154:44494) 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb378ac8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3741300a0 0x7fb37411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33102/0 (socket says 172.21.15.154:33102) 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb373fff700 1 -- 172.21.15.154:0/3394921163 learned_addr learned my addr 172.21.15.154:0/3394921163 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb373fff700 1 -- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb374133ad0 msgr2=0x7fb37411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb373fff700 1 --2- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb374133ad0 0x7fb37411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb373fff700 1 -- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3741300a0 msgr2=0x7fb37411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb373fff700 1 --2- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3741300a0 0x7fb37411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb373fff700 1 -- 172.21.15.154:0/3394921163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600094a0 con 0x7fb3741309f0 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb378ac8700 1 --2- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3741300a0 0x7fb37411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb3792c9700 1 --2- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb374133ad0 0x7fb37411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.576+0000 7fb373fff700 1 --2- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3741309f0 0x7fb37411df80 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fb360009840 tx=0x7fb360004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.577+0000 7fb3717fa700 1 -- 172.21.15.154:0/3394921163 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360004510 con 0x7fb3741309f0 2023-09-30T22:27:00.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.577+0000 7fb3717fa700 1 -- 172.21.15.154:0/3394921163 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36001e070 con 0x7fb3741309f0 2023-09-30T22:27:00.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.577+0000 7fb37ad2c700 1 -- 172.21.15.154:0/3394921163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37411fa40 con 0x7fb3741309f0 2023-09-30T22:27:00.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.577+0000 7fb3717fa700 1 -- 172.21.15.154:0/3394921163 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3600038e0 con 0x7fb3741309f0 2023-09-30T22:27:00.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.577+0000 7fb37ad2c700 1 -- 172.21.15.154:0/3394921163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37412dd00 con 0x7fb3741309f0 2023-09-30T22:27:00.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.577+0000 7fb3717fa700 1 -- 172.21.15.154:0/3394921163 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb360003a40 con 0x7fb3741309f0 2023-09-30T22:27:00.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.577+0000 7fb3717fa700 1 -- 172.21.15.154:0/3394921163 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb360020070 con 0x7fb3741309f0 2023-09-30T22:27:00.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.578+0000 7fb37ad2c700 1 -- 172.21.15.154:0/3394921163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37404f2a0 con 0x7fb3741309f0 2023-09-30T22:27:00.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.582+0000 7fb3717fa700 1 -- 172.21.15.154:0/3394921163 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb360015080 con 0x7fb3741309f0 2023-09-30T22:27:00.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.616+0000 7fefb20f7700 1 Processor -- start 2023-09-30T22:27:00.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.616+0000 7fefb20f7700 1 -- start start 2023-09-30T22:27:00.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.616+0000 7fefb20f7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefac0a0a70 0x7fefac0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefb20f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefb20f7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac09dc00 con 0x7fefac0a1380 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefb20f7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac09ea90 con 0x7fefac0a0a70 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefb20f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefac09dec0 con 0x7fefac134120 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefab7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefac0a0a70 0x7fefac0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefab7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefac0a0a70 0x7fefac0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44510/0 (socket says 172.21.15.154:44510) 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefab7fe700 1 -- 172.21.15.154:0/3774078101 learned_addr learned my addr 172.21.15.154:0/3774078101 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefabfff700 1 --2- 172.21.15.154:0/3774078101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefab7fe700 1 -- 172.21.15.154:0/3774078101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 msgr2=0x7fefac13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefab7fe700 1 --2- 172.21.15.154:0/3774078101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefab7fe700 1 -- 172.21.15.154:0/3774078101 >> v1:172.21.15.154:6789/0 conn(0x7fefac0a1380 legacy=0x7fefac133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefab7fe700 1 -- 172.21.15.154:0/3774078101 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac09e6a0 con 0x7fefac0a0a70 2023-09-30T22:27:00.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefabfff700 1 --2- 172.21.15.154:0/3774078101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefab7fe700 1 --2- 172.21.15.154:0/3774078101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 0x7fefac0a0e40 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0098f0 tx=0x7fef9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d75e04275f9b52 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefaaffd700 1 -- 172.21.15.154:0/3774078101 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c011830 con 0x7fefac0a0a70 2023-09-30T22:27:00.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefaaffd700 1 -- 172.21.15.154:0/3774078101 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c011990 con 0x7fefac0a0a70 2023-09-30T22:27:00.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.617+0000 7fefaaffd700 1 -- 172.21.15.154:0/3774078101 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c011d20 con 0x7fefac0a0a70 2023-09-30T22:27:00.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.618+0000 7fefb20f7700 1 -- 172.21.15.154:0/3774078101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 msgr2=0x7fefac0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.618+0000 7fefb20f7700 1 --2- 172.21.15.154:0/3774078101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 0x7fefac0a0e40 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0098f0 tx=0x7fef9c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:00.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.618+0000 7fefb20f7700 1 -- 172.21.15.154:0/3774078101 shutdown_connections 2023-09-30T22:27:00.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.618+0000 7fefb20f7700 1 --2- 172.21.15.154:0/3774078101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.618+0000 7fefb20f7700 1 --2- 172.21.15.154:0/3774078101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 0x7fefac0a0e40 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.618+0000 7fefb20f7700 1 -- 172.21.15.154:0/3774078101 >> 172.21.15.154:0/3774078101 conn(0x7fefac0a6610 msgr2=0x7fefac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.618+0000 7fefb20f7700 1 -- 172.21.15.154:0/3774078101 shutdown_connections 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.618+0000 7fefb20f7700 1 -- 172.21.15.154:0/3774078101 wait complete. 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.619+0000 7fefb20f7700 1 Processor -- start 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.619+0000 7fefb20f7700 1 -- start start 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefb20f7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 0x7fefac123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefb20f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefac0a1380 0x7fefac123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefb20f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac1c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefb20f7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac133aa0 con 0x7fefac0a0a70 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefb20f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0a03e0 con 0x7fefac0a1380 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefb20f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefac125300 con 0x7fefac134120 2023-09-30T22:27:00.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefa2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefac0a1380 0x7fefac123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefabfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac1c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefab7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 0x7fefac123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefabfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac1c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51628/0 (socket says 172.21.15.154:51628) 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefa2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefac0a1380 0x7fefac123890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33114/0 (socket says 172.21.15.154:33114) 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefabfff700 1 -- 172.21.15.154:0/967401824 learned_addr learned my addr 172.21.15.154:0/967401824 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefab7fe700 1 -- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 msgr2=0x7fefac1c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefab7fe700 1 --2- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac1c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefab7fe700 1 -- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefac0a1380 msgr2=0x7fefac123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefab7fe700 1 --2- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefac0a1380 0x7fefac123890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefab7fe700 1 -- 172.21.15.154:0/967401824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa4009a70 con 0x7fefac0a0a70 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefabfff700 1 --2- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac1c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefa2ffd700 1 --2- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefac0a1380 0x7fefac123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.620+0000 7fefab7fe700 1 --2- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 0x7fefac123350 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fef9c016000 tx=0x7fef9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.621+0000 7fefa8ff9700 1 -- 172.21.15.154:0/967401824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c0036a0 con 0x7fefac0a0a70 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.621+0000 7fefa8ff9700 1 -- 172.21.15.154:0/967401824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c003800 con 0x7fefac0a0a70 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.621+0000 7fefb20f7700 1 -- 172.21.15.154:0/967401824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c009550 con 0x7fefac0a0a70 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.621+0000 7fefa8ff9700 1 -- 172.21.15.154:0/967401824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c003b90 con 0x7fefac0a0a70 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.621+0000 7fefb20f7700 1 -- 172.21.15.154:0/967401824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac126d30 con 0x7fefac0a0a70 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.622+0000 7fefb20f7700 1 -- 172.21.15.154:0/967401824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefac09c8f0 con 0x7fefac0a0a70 2023-09-30T22:27:00.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.622+0000 7fefa8ff9700 1 -- 172.21.15.154:0/967401824 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef9c021070 con 0x7fefac0a0a70 2023-09-30T22:27:00.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.622+0000 7fefa8ff9700 1 -- 172.21.15.154:0/967401824 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef9c024990 con 0x7fefac0a0a70 2023-09-30T22:27:00.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.631+0000 7fefa8ff9700 1 -- 172.21.15.154:0/967401824 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef9c045020 con 0x7fefac0a0a70 2023-09-30T22:27:00.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.740+0000 7f97ce7d6700 1 -- 172.21.15.154:0/2349404119 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97c8125980 con 0x7f97c809f180 2023-09-30T22:27:00.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.740+0000 7f97c4ff9700 1 -- 172.21.15.154:0/2349404119 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97c8125980 con 0x7f97c809f180 2023-09-30T22:27:00.740 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:00.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.742+0000 7f97ce7d6700 1 -- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 msgr2=0x7f97c806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.742+0000 7f97ce7d6700 1 --2- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c806bdf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f97bc016000 tx=0x7f97bc004750 comp rx=0 tx=0).stop 2023-09-30T22:27:00.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.742+0000 7f97ce7d6700 1 -- 172.21.15.154:0/2349404119 shutdown_connections 2023-09-30T22:27:00.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.742+0000 7f97ce7d6700 1 --2- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97c8131d70 0x7f97c806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.742+0000 7f97ce7d6700 1 --2- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97c809e870 0x7f97c806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.742+0000 7f97ce7d6700 1 --2- 172.21.15.154:0/2349404119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f97c809f180 0x7f97c806bdf0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.742+0000 7f97ce7d6700 1 -- 172.21.15.154:0/2349404119 >> 172.21.15.154:0/2349404119 conn(0x7f97c80a4430 msgr2=0x7f97c8072260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.742+0000 7f97ce7d6700 1 -- 172.21.15.154:0/2349404119 shutdown_connections 2023-09-30T22:27:00.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.743+0000 7f97ce7d6700 1 -- 172.21.15.154:0/2349404119 wait complete. 2023-09-30T22:27:00.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:00.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.780+0000 7fb37ad2c700 1 -- 172.21.15.154:0/3394921163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb37406c3b0 con 0x7fb3741309f0 2023-09-30T22:27:00.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.780+0000 7fb3717fa700 1 -- 172.21.15.154:0/3394921163 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3600243e0 con 0x7fb3741309f0 2023-09-30T22:27:00.780 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.782+0000 7fb37ad2c700 1 -- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3741309f0 msgr2=0x7fb37411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.782+0000 7fb37ad2c700 1 --2- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3741309f0 0x7fb37411df80 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fb360009840 tx=0x7fb360004750 comp rx=0 tx=0).stop 2023-09-30T22:27:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.782+0000 7fb37ad2c700 1 -- 172.21.15.154:0/3394921163 shutdown_connections 2023-09-30T22:27:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.782+0000 7fb37ad2c700 1 --2- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb374133ad0 0x7fb37411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.782+0000 7fb37ad2c700 1 --2- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3741300a0 0x7fb37411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.782+0000 7fb37ad2c700 1 --2- 172.21.15.154:0/3394921163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3741309f0 0x7fb37411df80 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.782+0000 7fb37ad2c700 1 -- 172.21.15.154:0/3394921163 >> 172.21.15.154:0/3394921163 conn(0x7fb374099c40 msgr2=0x7fb37412e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.782+0000 7fb37ad2c700 1 -- 172.21.15.154:0/3394921163 shutdown_connections 2023-09-30T22:27:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.782+0000 7fb37ad2c700 1 -- 172.21.15.154:0/3394921163 wait complete. 2023-09-30T22:27:00.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:00.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.824+0000 7fefb20f7700 1 -- 172.21.15.154:0/967401824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fefac04f2a0 con 0x7fefac0a0a70 2023-09-30T22:27:00.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.824+0000 7fefa8ff9700 1 -- 172.21.15.154:0/967401824 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef9c010380 con 0x7fefac0a0a70 2023-09-30T22:27:00.825 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.826+0000 7fefb20f7700 1 -- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 msgr2=0x7fefac123350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.826+0000 7fefb20f7700 1 --2- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 0x7fefac123350 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fef9c016000 tx=0x7fef9c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.826+0000 7fefb20f7700 1 -- 172.21.15.154:0/967401824 shutdown_connections 2023-09-30T22:27:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.826+0000 7fefb20f7700 1 --2- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fefac134120 0x7fefac1c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.826+0000 7fefb20f7700 1 --2- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefac0a0a70 0x7fefac123350 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.826+0000 7fefb20f7700 1 --2- 172.21.15.154:0/967401824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefac0a1380 0x7fefac123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.826+0000 7fefb20f7700 1 -- 172.21.15.154:0/967401824 >> 172.21.15.154:0/967401824 conn(0x7fefac0a6610 msgr2=0x7fefac0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.826+0000 7fefb20f7700 1 -- 172.21.15.154:0/967401824 shutdown_connections 2023-09-30T22:27:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:00.826+0000 7fefb20f7700 1 -- 172.21.15.154:0/967401824 wait complete. 2023-09-30T22:27:00.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:01.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:01.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.682+0000 7fdd33314700 1 Processor -- start 2023-09-30T22:27:01.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.682+0000 7fdd33314700 1 -- start start 2023-09-30T22:27:01.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd33314700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c133ad0 0x7fdd2c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd33314700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd2c1300a0 0x7fdd2c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd33314700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd33314700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c06b2d0 con 0x7fdd2c1300a0 2023-09-30T22:27:01.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd33314700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c133610 con 0x7fdd2c133ad0 2023-09-30T22:27:01.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd33314700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c09a500 con 0x7fdd2c1309f0 2023-09-30T22:27:01.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd310b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c133ad0 0x7fdd2c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd308af700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd2c1300a0 0x7fdd2c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd318b1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd318b1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51638/0 (socket says 172.21.15.154:51638) 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd308af700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd2c1300a0 0x7fdd2c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44518/0 (socket says 172.21.15.154:44518) 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd318b1700 1 -- 172.21.15.154:0/1029258635 learned_addr learned my addr 172.21.15.154:0/1029258635 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd310b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c133ad0 0x7fdd2c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33128/0 (socket says 172.21.15.154:33128) 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd310b0700 1 -- 172.21.15.154:0/1029258635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 msgr2=0x7fdd2c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd310b0700 1 --2- 172.21.15.154:0/1029258635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd310b0700 1 -- 172.21.15.154:0/1029258635 >> v2:172.21.15.154:3300/0 conn(0x7fdd2c1300a0 msgr2=0x7fdd2c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd310b0700 1 --2- 172.21.15.154:0/1029258635 >> v2:172.21.15.154:3300/0 conn(0x7fdd2c1300a0 0x7fdd2c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd310b0700 1 -- 172.21.15.154:0/1029258635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c1338b0 con 0x7fdd2c133ad0 2023-09-30T22:27:01.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd308af700 1 --2- 172.21.15.154:0/1029258635 >> v2:172.21.15.154:3300/0 conn(0x7fdd2c1300a0 0x7fdd2c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.683+0000 7fdd318b1700 1 --2- 172.21.15.154:0/1029258635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd310b0700 1 --2- 172.21.15.154:0/1029258635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c133ad0 0x7fdd2c133ea0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009840 tx=0x7fdd1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87eea4ba69496463 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd23fff700 1 -- 172.21.15.154:0/1029258635 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c011830 con 0x7fdd2c133ad0 2023-09-30T22:27:01.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd23fff700 1 -- 172.21.15.154:0/1029258635 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c011990 con 0x7fdd2c133ad0 2023-09-30T22:27:01.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd23fff700 1 -- 172.21.15.154:0/1029258635 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c011d20 con 0x7fdd2c133ad0 2023-09-30T22:27:01.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd33314700 1 -- 172.21.15.154:0/1029258635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c133ad0 msgr2=0x7fdd2c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd33314700 1 --2- 172.21.15.154:0/1029258635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c133ad0 0x7fdd2c133ea0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009840 tx=0x7fdd1c009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:01.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd33314700 1 -- 172.21.15.154:0/1029258635 shutdown_connections 2023-09-30T22:27:01.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd33314700 1 --2- 172.21.15.154:0/1029258635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c133ad0 0x7fdd2c133ea0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd33314700 1 --2- 172.21.15.154:0/1029258635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd33314700 1 --2- 172.21.15.154:0/1029258635 >> v2:172.21.15.154:3300/0 conn(0x7fdd2c1300a0 0x7fdd2c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd33314700 1 -- 172.21.15.154:0/1029258635 >> 172.21.15.154:0/1029258635 conn(0x7fdd2c099c40 msgr2=0x7fdd2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd33314700 1 -- 172.21.15.154:0/1029258635 shutdown_connections 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.684+0000 7fdd33314700 1 -- 172.21.15.154:0/1029258635 wait complete. 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.685+0000 7fdd33314700 1 Processor -- start 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.685+0000 7fdd33314700 1 -- start start 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd33314700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c1300a0 0x7fdd2c071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd33314700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd33314700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd2c133ad0 0x7fdd2c071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd33314700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c11e010 con 0x7fdd2c133ad0 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd33314700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0727f0 con 0x7fdd2c1300a0 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd33314700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c11eea0 con 0x7fdd2c1309f0 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd310b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c1300a0 0x7fdd2c071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd308af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd318b1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd2c133ad0 0x7fdd2c071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd310b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c1300a0 0x7fdd2c071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33136/0 (socket says 172.21.15.154:33136) 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd308af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c0718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51650/0 (socket says 172.21.15.154:51650) 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd310b0700 1 -- 172.21.15.154:0/40379116 learned_addr learned my addr 172.21.15.154:0/40379116 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd310b0700 1 -- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 msgr2=0x7fdd2c0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd310b0700 1 --2- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd310b0700 1 -- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd2c133ad0 msgr2=0x7fdd2c071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd310b0700 1 --2- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd2c133ad0 0x7fdd2c071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd310b0700 1 -- 172.21.15.154:0/40379116 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280094a0 con 0x7fdd2c1300a0 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd308af700 1 --2- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd318b1700 1 --2- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd2c133ad0 0x7fdd2c071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd310b0700 1 --2- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c1300a0 0x7fdd2c071390 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0090b0 tx=0x7fdd1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd21ffb700 1 -- 172.21.15.154:0/40379116 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c004450 con 0x7fdd2c1300a0 2023-09-30T22:27:01.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd21ffb700 1 -- 172.21.15.154:0/40379116 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c0045b0 con 0x7fdd2c1300a0 2023-09-30T22:27:01.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.686+0000 7fdd33314700 1 -- 172.21.15.154:0/40379116 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd24009b30 con 0x7fdd2c1300a0 2023-09-30T22:27:01.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.687+0000 7fdd21ffb700 1 -- 172.21.15.154:0/40379116 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c0038e0 con 0x7fdd2c1300a0 2023-09-30T22:27:01.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.687+0000 7fdd33314700 1 -- 172.21.15.154:0/40379116 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c0094a0 con 0x7fdd2c1300a0 2023-09-30T22:27:01.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.687+0000 7fdd21ffb700 1 -- 172.21.15.154:0/40379116 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd1c003a40 con 0x7fdd2c1300a0 2023-09-30T22:27:01.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.687+0000 7fdd21ffb700 1 -- 172.21.15.154:0/40379116 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdd1c040810 con 0x7fdd2c1300a0 2023-09-30T22:27:01.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.688+0000 7fdd33314700 1 -- 172.21.15.154:0/40379116 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c11f8e0 con 0x7fdd2c1300a0 2023-09-30T22:27:01.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.692+0000 7fdd21ffb700 1 -- 172.21.15.154:0/40379116 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd1c01a420 con 0x7fdd2c1300a0 2023-09-30T22:27:01.755 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:01.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:01.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:01.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.892+0000 7f12c2efb700 1 Processor -- start 2023-09-30T22:27:01.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.892+0000 7f12c2efb700 1 -- start start 2023-09-30T22:27:01.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.892+0000 7f12c2efb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc133ad0 0x7f12bc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.892+0000 7f12c2efb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12bc1300a0 0x7f12bc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.892+0000 7f12c2efb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc1309f0 0x7f12bc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.892+0000 7f12c2efb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc06b2d0 con 0x7f12bc1300a0 2023-09-30T22:27:01.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.892+0000 7f12c2efb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc133610 con 0x7f12bc133ad0 2023-09-30T22:27:01.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.892+0000 7f12c2efb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc09a500 con 0x7f12bc1309f0 2023-09-30T22:27:01.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12bc1300a0 0x7f12bc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12c0c97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc133ad0 0x7f12bc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12bc1300a0 0x7f12bc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44538/0 (socket says 172.21.15.154:44538) 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bbfff700 1 -- 172.21.15.154:0/3183154397 learned_addr learned my addr 172.21.15.154:0/3183154397 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12c1498700 1 --2- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc1309f0 0x7f12bc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bbfff700 1 -- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc1309f0 msgr2=0x7f12bc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bbfff700 1 --2- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc1309f0 0x7f12bc13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bbfff700 1 -- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc133ad0 msgr2=0x7f12bc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bbfff700 1 --2- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc133ad0 0x7f12bc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bbfff700 1 -- 172.21.15.154:0/3183154397 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc1338b0 con 0x7f12bc1300a0 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12c0c97700 1 --2- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc133ad0 0x7f12bc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bbfff700 1 --2- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1300a0 0x7f12bc1304b0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f12a80098f0 tx=0x7f12a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb8932d16ad4f57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.893+0000 7f12bb7fe700 1 -- 172.21.15.154:0/3183154397 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8011830 con 0x7f12bc1300a0 2023-09-30T22:27:01.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12bb7fe700 1 -- 172.21.15.154:0/3183154397 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a8011990 con 0x7f12bc1300a0 2023-09-30T22:27:01.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12bb7fe700 1 -- 172.21.15.154:0/3183154397 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8011d20 con 0x7f12bc1300a0 2023-09-30T22:27:01.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12c2efb700 1 -- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1300a0 msgr2=0x7f12bc1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12c2efb700 1 --2- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1300a0 0x7f12bc1304b0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f12a80098f0 tx=0x7f12a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:01.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12c2efb700 1 -- 172.21.15.154:0/3183154397 shutdown_connections 2023-09-30T22:27:01.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12c2efb700 1 --2- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc133ad0 0x7f12bc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12c2efb700 1 --2- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc1309f0 0x7f12bc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12c2efb700 1 --2- 172.21.15.154:0/3183154397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1300a0 0x7f12bc1304b0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12c2efb700 1 -- 172.21.15.154:0/3183154397 >> 172.21.15.154:0/3183154397 conn(0x7f12bc099c40 msgr2=0x7f12bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12c2efb700 1 -- 172.21.15.154:0/3183154397 shutdown_connections 2023-09-30T22:27:01.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.894+0000 7f12c2efb700 1 -- 172.21.15.154:0/3183154397 wait complete. 2023-09-30T22:27:01.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.895+0000 7fdd33314700 1 -- 172.21.15.154:0/40379116 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdd2c0a2620 con 0x7fdd2c1300a0 2023-09-30T22:27:01.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.895+0000 7f12c2efb700 1 Processor -- start 2023-09-30T22:27:01.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.895+0000 7f12c2efb700 1 -- start start 2023-09-30T22:27:01.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7fdd21ffb700 1 -- 172.21.15.154:0/40379116 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd1c015020 con 0x7fdd2c1300a0 2023-09-30T22:27:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7f12c2efb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc1300a0 0x7f12bc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7f12c2efb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1309f0 0x7f12bc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7f12c2efb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc133ad0 0x7f12bc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7f12c2efb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc11f5b0 con 0x7f12bc1309f0 2023-09-30T22:27:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7f12c2efb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc12f800 con 0x7f12bc1300a0 2023-09-30T22:27:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7f12c2efb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc12dd00 con 0x7f12bc133ad0 2023-09-30T22:27:01.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7f12c0c97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc1300a0 0x7f12bc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.900 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7f12c0c97700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc1300a0 0x7f12bc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33144/0 (socket says 172.21.15.154:33144) 2023-09-30T22:27:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.896+0000 7f12c0c97700 1 -- 172.21.15.154:0/971702970 learned_addr learned my addr 172.21.15.154:0/971702970 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12c1498700 1 --2- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc133ad0 0x7f12bc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12c0c97700 1 -- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc133ad0 msgr2=0x7f12bc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12c0c97700 1 --2- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc133ad0 0x7f12bc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12c0c97700 1 -- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1309f0 msgr2=0x7f12bc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12c0c97700 1 --2- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1309f0 0x7f12bc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12c0c97700 1 -- 172.21.15.154:0/971702970 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00094a0 con 0x7f12bc1300a0 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12c0c97700 1 --2- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc1300a0 0x7f12bc11da40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f12b000ec10 tx=0x7f12b0009ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12b97fa700 1 -- 172.21.15.154:0/971702970 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b000c940 con 0x7f12bc1300a0 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12b97fa700 1 -- 172.21.15.154:0/971702970 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b000caa0 con 0x7f12bc1300a0 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12b97fa700 1 -- 172.21.15.154:0/971702970 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b000ce10 con 0x7f12bc1300a0 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12c2efb700 1 -- 172.21.15.154:0/971702970 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a8009550 con 0x7f12bc1300a0 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.897+0000 7f12c2efb700 1 -- 172.21.15.154:0/971702970 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc11f920 con 0x7f12bc1300a0 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.898+0000 7f12c2efb700 1 -- 172.21.15.154:0/971702970 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc04f2a0 con 0x7f12bc1300a0 2023-09-30T22:27:01.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7f12b97fa700 1 -- 172.21.15.154:0/971702970 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12b0013470 con 0x7f12bc1300a0 2023-09-30T22:27:01.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7f12b97fa700 1 -- 172.21.15.154:0/971702970 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f12b003f9c0 con 0x7f12bc1300a0 2023-09-30T22:27:01.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7fdd33314700 1 -- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c1300a0 msgr2=0x7fdd2c071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7fdd33314700 1 --2- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c1300a0 0x7fdd2c071390 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0090b0 tx=0x7fdd1c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:01.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7fdd33314700 1 -- 172.21.15.154:0/40379116 shutdown_connections 2023-09-30T22:27:01.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7fdd33314700 1 --2- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd2c133ad0 0x7fdd2c071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7fdd33314700 1 --2- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd2c1300a0 0x7fdd2c071390 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7fdd33314700 1 --2- 172.21.15.154:0/40379116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdd2c1309f0 0x7fdd2c0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7fdd33314700 1 -- 172.21.15.154:0/40379116 >> 172.21.15.154:0/40379116 conn(0x7fdd2c099c40 msgr2=0x7fdd2c12f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7fdd33314700 1 -- 172.21.15.154:0/40379116 shutdown_connections 2023-09-30T22:27:01.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.899+0000 7fdd33314700 1 -- 172.21.15.154:0/40379116 wait complete. 2023-09-30T22:27:01.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.904+0000 7f12b97fa700 1 -- 172.21.15.154:0/971702970 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12b00232f0 con 0x7f12bc1300a0 2023-09-30T22:27:01.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:01.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.929+0000 7f2cacf6e700 1 Processor -- start 2023-09-30T22:27:01.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.929+0000 7f2cacf6e700 1 -- start start 2023-09-30T22:27:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2cacf6e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ca809f350 0x7f2ca8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2cacf6e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca81371c0 0x7f2ca81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2cacf6e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca809c970 con 0x7f2ca809e870 2023-09-30T22:27:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2cacf6e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca80a0920 con 0x7f2ca809f350 2023-09-30T22:27:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2cacf6e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca809f9c0 con 0x7f2ca81371c0 2023-09-30T22:27:01.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca5d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ca809f350 0x7f2ca8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca81371c0 0x7f2ca81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca81371c0 0x7f2ca81395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51672/0 (socket says 172.21.15.154:51672) 2023-09-30T22:27:01.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca5d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ca809f350 0x7f2ca8136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44568/0 (socket says 172.21.15.154:44568) 2023-09-30T22:27:01.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca6d9d700 1 -- 172.21.15.154:0/3175307773 learned_addr learned my addr 172.21.15.154:0/3175307773 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:01.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca5d9b700 1 -- 172.21.15.154:0/3175307773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca81371c0 msgr2=0x7f2ca81395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca5d9b700 1 --2- 172.21.15.154:0/3175307773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca81371c0 0x7f2ca81395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca5d9b700 1 -- 172.21.15.154:0/3175307773 >> v1:172.21.15.154:6789/0 conn(0x7f2ca809e870 legacy=0x7f2ca809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca5d9b700 1 -- 172.21.15.154:0/3175307773 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca809bab0 con 0x7f2ca809f350 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca6d9d700 1 --2- 172.21.15.154:0/3175307773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca81371c0 0x7f2ca81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca5d9b700 1 --2- 172.21.15.154:0/3175307773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca809f350 0x7f2ca8136c80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009840 tx=0x7f2c9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f1105eff12b1f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca559a700 1 -- 172.21.15.154:0/3175307773 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c011830 con 0x7f2ca809f350 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca559a700 1 -- 172.21.15.154:0/3175307773 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c011990 con 0x7f2ca809f350 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.930+0000 7f2ca559a700 1 -- 172.21.15.154:0/3175307773 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c011d20 con 0x7f2ca809f350 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.931+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3175307773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca809f350 msgr2=0x7f2ca8136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.931+0000 7f2cacf6e700 1 --2- 172.21.15.154:0/3175307773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca809f350 0x7f2ca8136c80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009840 tx=0x7f2c9c009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.931+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3175307773 shutdown_connections 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.931+0000 7f2cacf6e700 1 --2- 172.21.15.154:0/3175307773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca81371c0 0x7f2ca81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.931+0000 7f2cacf6e700 1 --2- 172.21.15.154:0/3175307773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca809f350 0x7f2ca8136c80 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.931+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3175307773 >> 172.21.15.154:0/3175307773 conn(0x7f2ca80a4430 msgr2=0x7f2ca80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.931+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3175307773 shutdown_connections 2023-09-30T22:27:01.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.931+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3175307773 wait complete. 2023-09-30T22:27:01.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.932+0000 7f2cacf6e700 1 Processor -- start 2023-09-30T22:27:01.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.932+0000 7f2cacf6e700 1 -- start start 2023-09-30T22:27:01.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2cacf6e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca809e870 0x7f2ca806c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2cacf6e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca809f350 0x7f2ca806c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2cacf6e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca81371c0 0x7f2ca81c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2cacf6e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8123ce0 con 0x7f2ca809e870 2023-09-30T22:27:01.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2cacf6e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca81353f0 con 0x7f2ca81371c0 2023-09-30T22:27:01.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2cacf6e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8124dc0 con 0x7f2ca809f350 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca809f350 0x7f2ca806c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca809f350 0x7f2ca806c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51674/0 (socket says 172.21.15.154:51674) 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca5d9b700 1 -- 172.21.15.154:0/3380998017 learned_addr learned my addr 172.21.15.154:0/3380998017 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca809e870 0x7f2ca806c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca6d9d700 1 --2- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca81371c0 0x7f2ca81c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca5d9b700 1 -- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca81371c0 msgr2=0x7f2ca81c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca5d9b700 1 --2- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca81371c0 0x7f2ca81c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca5d9b700 1 -- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca809e870 msgr2=0x7f2ca806c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca5d9b700 1 --2- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca809e870 0x7f2ca806c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca5d9b700 1 -- 172.21.15.154:0/3380998017 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009b30 con 0x7f2ca809f350 2023-09-30T22:27:01.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.933+0000 7f2ca5d9b700 1 --2- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca809f350 0x7f2ca806c7f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009fd0 tx=0x7f2c9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.934+0000 7f2c96ffd700 1 -- 172.21.15.154:0/3380998017 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c0036a0 con 0x7f2ca809f350 2023-09-30T22:27:01.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.934+0000 7f2c96ffd700 1 -- 172.21.15.154:0/3380998017 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c01f070 con 0x7f2ca809f350 2023-09-30T22:27:01.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.934+0000 7f2c96ffd700 1 -- 172.21.15.154:0/3380998017 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c003a60 con 0x7f2ca809f350 2023-09-30T22:27:01.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.934+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3380998017 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9c0094a0 con 0x7f2ca809f350 2023-09-30T22:27:01.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.934+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3380998017 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca8136c00 con 0x7f2ca809f350 2023-09-30T22:27:01.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.934+0000 7f2c96ffd700 1 -- 172.21.15.154:0/3380998017 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c9c003bc0 con 0x7f2ca809f350 2023-09-30T22:27:01.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.935+0000 7f2c96ffd700 1 -- 172.21.15.154:0/3380998017 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c9c021070 con 0x7f2ca809f350 2023-09-30T22:27:01.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.935+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3380998017 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca804f2a0 con 0x7f2ca809f350 2023-09-30T22:27:01.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.939+0000 7f2c96ffd700 1 -- 172.21.15.154:0/3380998017 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c9c015080 con 0x7f2ca809f350 2023-09-30T22:27:01.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.975+0000 7f07e4dd8700 1 Processor -- start 2023-09-30T22:27:01.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.975+0000 7f07e4dd8700 1 -- start start 2023-09-30T22:27:01.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.975+0000 7f07e4dd8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 0x7f07e0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.975+0000 7f07e4dd8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07e0139200 0x7f07e013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.975+0000 7f07e4dd8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e009e9d0 con 0x7f07e00a0a70 2023-09-30T22:27:01.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.975+0000 7f07e4dd8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e009dc00 con 0x7f07e0139200 2023-09-30T22:27:01.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.975+0000 7f07e4dd8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e009dec0 con 0x7f07e00a1550 2023-09-30T22:27:01.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07ded9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07e0139200 0x7f07e013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07de59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f07e00a0a70 0x7f07e00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56990/0 (socket says 172.21.15.154:56990) 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07de59c700 1 -- 172.21.15.154:0/677778975 learned_addr learned my addr 172.21.15.154:0/677778975 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07ddd9b700 1 --2- 172.21.15.154:0/677778975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 0x7f07e0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07ded9d700 1 -- 172.21.15.154:0/677778975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 msgr2=0x7f07e0138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07ded9d700 1 --2- 172.21.15.154:0/677778975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 0x7f07e0138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07ded9d700 1 -- 172.21.15.154:0/677778975 >> v1:172.21.15.154:6789/0 conn(0x7f07e00a0a70 legacy=0x7f07e00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07ded9d700 1 -- 172.21.15.154:0/677778975 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e009e6a0 con 0x7f07e0139200 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07ded9d700 1 --2- 172.21.15.154:0/677778975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 0x7f07e013b5e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009d90 tx=0x7f07d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfb6a541e191a01 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07dd59a700 1 -- 172.21.15.154:0/677778975 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800e070 con 0x7f07e0139200 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07dd59a700 1 -- 172.21.15.154:0/677778975 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d800bb20 con 0x7f07e0139200 2023-09-30T22:27:01.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.976+0000 7f07dd59a700 1 -- 172.21.15.154:0/677778975 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8012430 con 0x7f07e0139200 2023-09-30T22:27:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.977+0000 7f07e4dd8700 1 -- 172.21.15.154:0/677778975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 msgr2=0x7f07e013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.977+0000 7f07e4dd8700 1 --2- 172.21.15.154:0/677778975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 0x7f07e013b5e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009d90 tx=0x7f07d800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.977+0000 7f07e4dd8700 1 -- 172.21.15.154:0/677778975 shutdown_connections 2023-09-30T22:27:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.977+0000 7f07e4dd8700 1 --2- 172.21.15.154:0/677778975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 0x7f07e013b5e0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.977+0000 7f07e4dd8700 1 --2- 172.21.15.154:0/677778975 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 0x7f07e0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.977+0000 7f07e4dd8700 1 -- 172.21.15.154:0/677778975 >> 172.21.15.154:0/677778975 conn(0x7f07e00a6610 msgr2=0x7f07e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.977+0000 7f07e4dd8700 1 -- 172.21.15.154:0/677778975 shutdown_connections 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.977+0000 7f07e4dd8700 1 -- 172.21.15.154:0/677778975 wait complete. 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.978+0000 7f07e4dd8700 1 Processor -- start 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.978+0000 7f07e4dd8700 1 -- start start 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07e4dd8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07e00a0a70 0x7f07e01c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07e4dd8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 0x7f07e01c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07e4dd8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 0x7f07e01c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07e4dd8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0122230 con 0x7f07e0139200 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07e4dd8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0120710 con 0x7f07e00a1550 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07e4dd8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0121270 con 0x7f07e00a0a70 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07de59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07e00a0a70 0x7f07e01c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07de59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07e00a0a70 0x7f07e01c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51686/0 (socket says 172.21.15.154:51686) 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07de59c700 1 -- 172.21.15.154:0/2632473828 learned_addr learned my addr 172.21.15.154:0/2632473828 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07ddd9b700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 0x7f07e01c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07ded9d700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 0x7f07e01c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07ddd9b700 1 -- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07e00a0a70 msgr2=0x7f07e01c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07ddd9b700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07e00a0a70 0x7f07e01c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07ddd9b700 1 -- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 msgr2=0x7f07e01c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07ddd9b700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 0x7f07e01c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07ddd9b700 1 -- 172.21.15.154:0/2632473828 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8009a70 con 0x7f07e00a1550 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07de59c700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07e00a0a70 0x7f07e01c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.979+0000 7f07ded9d700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 0x7f07e01c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.980+0000 7f07ddd9b700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 0x7f07e01c8930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f07d400e900 tx=0x7f07d400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.980+0000 7f07ceffd700 1 -- 172.21.15.154:0/2632473828 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400ee50 con 0x7f07e00a1550 2023-09-30T22:27:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.980+0000 7f07ceffd700 1 -- 172.21.15.154:0/2632473828 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d400c850 con 0x7f07e00a1550 2023-09-30T22:27:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.980+0000 7f07e4dd8700 1 -- 172.21.15.154:0/2632473828 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e0121f70 con 0x7f07e00a1550 2023-09-30T22:27:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.980+0000 7f07ceffd700 1 -- 172.21.15.154:0/2632473828 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400cbc0 con 0x7f07e00a1550 2023-09-30T22:27:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.980+0000 7f07e4dd8700 1 -- 172.21.15.154:0/2632473828 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e0120b50 con 0x7f07e00a1550 2023-09-30T22:27:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.981+0000 7f07ceffd700 1 -- 172.21.15.154:0/2632473828 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07d400cd20 con 0x7f07e00a1550 2023-09-30T22:27:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.981+0000 7f07e4dd8700 1 -- 172.21.15.154:0/2632473828 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e004f2a0 con 0x7f07e00a1550 2023-09-30T22:27:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.981+0000 7f07ceffd700 1 -- 172.21.15.154:0/2632473828 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f07d403fa80 con 0x7f07e00a1550 2023-09-30T22:27:01.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:01.985+0000 7f07ceffd700 1 -- 172.21.15.154:0/2632473828 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07d401ab90 con 0x7f07e00a1550 2023-09-30T22:27:02.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.109+0000 7f12c2efb700 1 -- 172.21.15.154:0/971702970 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12bc0a2fc0 con 0x7f12bc1300a0 2023-09-30T22:27:02.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.109+0000 7f12b97fa700 1 -- 172.21.15.154:0/971702970 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12b0017020 con 0x7f12bc1300a0 2023-09-30T22:27:02.110 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.111+0000 7f12c2efb700 1 -- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc1300a0 msgr2=0x7f12bc11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.111+0000 7f12c2efb700 1 --2- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc1300a0 0x7f12bc11da40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f12b000ec10 tx=0x7f12b0009ec0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.111+0000 7f12c2efb700 1 -- 172.21.15.154:0/971702970 shutdown_connections 2023-09-30T22:27:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.111+0000 7f12c2efb700 1 --2- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f12bc133ad0 0x7f12bc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.111+0000 7f12c2efb700 1 --2- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12bc1300a0 0x7f12bc11da40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.111+0000 7f12c2efb700 1 --2- 172.21.15.154:0/971702970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1309f0 0x7f12bc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.111+0000 7f12c2efb700 1 -- 172.21.15.154:0/971702970 >> 172.21.15.154:0/971702970 conn(0x7f12bc099c40 msgr2=0x7f12bc12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.111+0000 7f12c2efb700 1 -- 172.21.15.154:0/971702970 shutdown_connections 2023-09-30T22:27:02.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.111+0000 7f12c2efb700 1 -- 172.21.15.154:0/971702970 wait complete. 2023-09-30T22:27:02.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:02.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.136+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3380998017 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ca806b2a0 con 0x7f2ca809f350 2023-09-30T22:27:02.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.137+0000 7f2c96ffd700 1 -- 172.21.15.154:0/3380998017 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c9c02b020 con 0x7f2ca809f350 2023-09-30T22:27:02.137 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.139+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca809f350 msgr2=0x7f2ca806c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.139+0000 7f2cacf6e700 1 --2- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca809f350 0x7f2ca806c7f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009fd0 tx=0x7f2c9c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.139+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3380998017 shutdown_connections 2023-09-30T22:27:02.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.139+0000 7f2cacf6e700 1 --2- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca81371c0 0x7f2ca81c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.139+0000 7f2cacf6e700 1 --2- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca809e870 0x7f2ca806c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.139+0000 7f2cacf6e700 1 --2- 172.21.15.154:0/3380998017 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ca809f350 0x7f2ca806c7f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.139+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3380998017 >> 172.21.15.154:0/3380998017 conn(0x7f2ca80a4430 msgr2=0x7f2ca809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.139+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3380998017 shutdown_connections 2023-09-30T22:27:02.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.139+0000 7f2cacf6e700 1 -- 172.21.15.154:0/3380998017 wait complete. 2023-09-30T22:27:02.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:02.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.179+0000 7f07e4dd8700 1 -- 172.21.15.154:0/2632473828 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f07e009c760 con 0x7f07e00a1550 2023-09-30T22:27:02.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.179+0000 7f07ceffd700 1 -- 172.21.15.154:0/2632473828 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07d4017070 con 0x7f07e00a1550 2023-09-30T22:27:02.180 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:02.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.182+0000 7f07e4dd8700 1 -- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 msgr2=0x7f07e01c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:02.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.182+0000 7f07e4dd8700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 0x7f07e01c8930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f07d400e900 tx=0x7f07d400ec10 comp rx=0 tx=0).stop 2023-09-30T22:27:02.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.182+0000 7f07e4dd8700 1 -- 172.21.15.154:0/2632473828 shutdown_connections 2023-09-30T22:27:02.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.182+0000 7f07e4dd8700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07e0139200 0x7f07e01c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.182+0000 7f07e4dd8700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f07e00a0a70 0x7f07e01c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.182+0000 7f07e4dd8700 1 --2- 172.21.15.154:0/2632473828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07e00a1550 0x7f07e01c8930 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:02.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.182+0000 7f07e4dd8700 1 -- 172.21.15.154:0/2632473828 >> 172.21.15.154:0/2632473828 conn(0x7f07e00a6610 msgr2=0x7f07e0138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:02.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.182+0000 7f07e4dd8700 1 -- 172.21.15.154:0/2632473828 shutdown_connections 2023-09-30T22:27:02.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:02.182+0000 7f07e4dd8700 1 -- 172.21.15.154:0/2632473828 wait complete. 2023-09-30T22:27:02.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:02.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f95057c8700 1 Processor -- start 2023-09-30T22:27:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f95057c8700 1 -- start start 2023-09-30T22:27:03.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f95057c8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9500098410 0x7f95000987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f95057c8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f950009d8f0 0x7f950009dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f95057c8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f950009e240 0x7f95001387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f95057c8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95000720a0 con 0x7f950009d8f0 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f95057c8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950006f970 con 0x7f950009e240 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f95057c8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f950009e6e0 con 0x7f9500098410 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f94feffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9500098410 0x7f95000987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f94ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f950009e240 0x7f95001387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f94fe7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f950009d8f0 0x7f950009dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f94feffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9500098410 0x7f95000987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51688/0 (socket says 172.21.15.154:51688) 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f94ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f950009e240 0x7f95001387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33184/0 (socket says 172.21.15.154:33184) 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.049+0000 7f94feffd700 1 -- 172.21.15.154:0/4216359357 learned_addr learned my addr 172.21.15.154:0/4216359357 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94feffd700 1 -- 172.21.15.154:0/4216359357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f950009e240 msgr2=0x7f95001387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94feffd700 1 --2- 172.21.15.154:0/4216359357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f950009e240 0x7f95001387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94feffd700 1 -- 172.21.15.154:0/4216359357 >> v2:172.21.15.154:3300/0 conn(0x7f950009d8f0 msgr2=0x7f950009dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94feffd700 1 --2- 172.21.15.154:0/4216359357 >> v2:172.21.15.154:3300/0 conn(0x7f950009d8f0 0x7f950009dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94feffd700 1 -- 172.21.15.154:0/4216359357 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500072290 con 0x7f9500098410 2023-09-30T22:27:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94fe7fc700 1 --2- 172.21.15.154:0/4216359357 >> v2:172.21.15.154:3300/0 conn(0x7f950009d8f0 0x7f950009dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94ff7fe700 1 --2- 172.21.15.154:0/4216359357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f950009e240 0x7f95001387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94feffd700 1 --2- 172.21.15.154:0/4216359357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9500098410 0x7f95000987e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f94f4006fd0 tx=0x7f94f4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851bfbeccc032bf1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94fdffb700 1 -- 172.21.15.154:0/4216359357 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4005e30 con 0x7f9500098410 2023-09-30T22:27:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94fdffb700 1 -- 172.21.15.154:0/4216359357 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f4004030 con 0x7f9500098410 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.050+0000 7f94fdffb700 1 -- 172.21.15.154:0/4216359357 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f40043e0 con 0x7f9500098410 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.051+0000 7f95057c8700 1 -- 172.21.15.154:0/4216359357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9500098410 msgr2=0x7f95000987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.051+0000 7f95057c8700 1 --2- 172.21.15.154:0/4216359357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9500098410 0x7f95000987e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f94f4006fd0 tx=0x7f94f4009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.051+0000 7f95057c8700 1 -- 172.21.15.154:0/4216359357 shutdown_connections 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.051+0000 7f95057c8700 1 --2- 172.21.15.154:0/4216359357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f950009e240 0x7f95001387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.051+0000 7f95057c8700 1 --2- 172.21.15.154:0/4216359357 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9500098410 0x7f95000987e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.051+0000 7f95057c8700 1 --2- 172.21.15.154:0/4216359357 >> v2:172.21.15.154:3300/0 conn(0x7f950009d8f0 0x7f950009dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.051+0000 7f95057c8700 1 -- 172.21.15.154:0/4216359357 >> 172.21.15.154:0/4216359357 conn(0x7f95000a2b30 msgr2=0x7f950009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.051+0000 7f95057c8700 1 -- 172.21.15.154:0/4216359357 shutdown_connections 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.051+0000 7f95057c8700 1 -- 172.21.15.154:0/4216359357 wait complete. 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f95057c8700 1 Processor -- start 2023-09-30T22:27:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f95057c8700 1 -- start start 2023-09-30T22:27:03.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f95057c8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9500098410 0x7f95001c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f95057c8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f950009d8f0 0x7f95001c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f95057c8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f950009e240 0x7f950012ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f95057c8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950008aff0 con 0x7f950009e240 2023-09-30T22:27:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f95057c8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9500070880 con 0x7f9500098410 2023-09-30T22:27:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f95057c8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f950012c910 con 0x7f950009d8f0 2023-09-30T22:27:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f94feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9500098410 0x7f95001c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f94feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9500098410 0x7f95001c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33196/0 (socket says 172.21.15.154:33196) 2023-09-30T22:27:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f94feffd700 1 -- 172.21.15.154:0/267081649 learned_addr learned my addr 172.21.15.154:0/267081649 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f94ff7fe700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f950009e240 0x7f950012ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.052+0000 7f94fe7fc700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f950009d8f0 0x7f95001c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94feffd700 1 -- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f950009d8f0 msgr2=0x7f95001c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94feffd700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f950009d8f0 0x7f95001c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94feffd700 1 -- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f950009e240 msgr2=0x7f950012ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94feffd700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f950009e240 0x7f950012ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94feffd700 1 -- 172.21.15.154:0/267081649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f00094a0 con 0x7f9500098410 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94ff7fe700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f950009e240 0x7f950012ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94feffd700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9500098410 0x7f95001c6810 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009c10 tx=0x7f94f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94e77fe700 1 -- 172.21.15.154:0/267081649 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4003c70 con 0x7f9500098410 2023-09-30T22:27:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94e77fe700 1 -- 172.21.15.154:0/267081649 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f4003dd0 con 0x7f9500098410 2023-09-30T22:27:03.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f95057c8700 1 -- 172.21.15.154:0/267081649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f8009a70 con 0x7f9500098410 2023-09-30T22:27:03.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f94e77fe700 1 -- 172.21.15.154:0/267081649 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f401c660 con 0x7f9500098410 2023-09-30T22:27:03.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.053+0000 7f95057c8700 1 -- 172.21.15.154:0/267081649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f4009500 con 0x7f9500098410 2023-09-30T22:27:03.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.054+0000 7f94e77fe700 1 -- 172.21.15.154:0/267081649 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94f401c7c0 con 0x7f9500098410 2023-09-30T22:27:03.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.054+0000 7f94e77fe700 1 -- 172.21.15.154:0/267081649 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f94f40402f0 con 0x7f9500098410 2023-09-30T22:27:03.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.054+0000 7f95057c8700 1 -- 172.21.15.154:0/267081649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950004f2a0 con 0x7f9500098410 2023-09-30T22:27:03.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.058+0000 7f94e77fe700 1 -- 172.21.15.154:0/267081649 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94f4020020 con 0x7f9500098410 2023-09-30T22:27:03.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:03.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:03.196 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:03.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.251+0000 7f95057c8700 1 -- 172.21.15.154:0/267081649 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f950006b2a0 con 0x7f9500098410 2023-09-30T22:27:03.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.251+0000 7f94e77fe700 1 -- 172.21.15.154:0/267081649 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94f4016070 con 0x7f9500098410 2023-09-30T22:27:03.251 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:03.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.253+0000 7f95057c8700 1 -- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9500098410 msgr2=0x7f95001c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.253+0000 7f95057c8700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9500098410 0x7f95001c6810 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009c10 tx=0x7f94f4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:03.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.253+0000 7f95057c8700 1 -- 172.21.15.154:0/267081649 shutdown_connections 2023-09-30T22:27:03.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.253+0000 7f95057c8700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f950009e240 0x7f950012ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.253+0000 7f95057c8700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9500098410 0x7f95001c6810 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.253+0000 7f95057c8700 1 --2- 172.21.15.154:0/267081649 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f950009d8f0 0x7f95001c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.253+0000 7f95057c8700 1 -- 172.21.15.154:0/267081649 >> 172.21.15.154:0/267081649 conn(0x7f95000a2b30 msgr2=0x7f950009a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.253+0000 7f95057c8700 1 -- 172.21.15.154:0/267081649 shutdown_connections 2023-09-30T22:27:03.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.253+0000 7f95057c8700 1 -- 172.21.15.154:0/267081649 wait complete. 2023-09-30T22:27:03.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.263+0000 7f152c1f3700 1 Processor -- start 2023-09-30T22:27:03.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.264+0000 7f152c1f3700 1 -- start start 2023-09-30T22:27:03.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.264+0000 7f152c1f3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1524133900 0x7f1524133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.264+0000 7f152c1f3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1524134210 0x7f15240a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.264+0000 7f152c1f3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15240a0ee0 0x7f15240a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.264+0000 7f152c1f3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152409a760 con 0x7f1524133900 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.264+0000 7f152c1f3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15241336e0 con 0x7f1524134210 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.264+0000 7f152c1f3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f152409a080 con 0x7f15240a0ee0 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.264+0000 7f152978e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1524134210 0x7f15240a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.264+0000 7f1529f8f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1524133900 0x7f1524133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f1529f8f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1524133900 0x7f1524133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44622/0 (socket says 172.21.15.154:44622) 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f152978e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1524134210 0x7f15240a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33212/0 (socket says 172.21.15.154:33212) 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f1529f8f700 1 -- 172.21.15.154:0/3128636221 learned_addr learned my addr 172.21.15.154:0/3128636221 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f152a790700 1 --2- 172.21.15.154:0/3128636221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15240a0ee0 0x7f15240a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f152978e700 1 -- 172.21.15.154:0/3128636221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15240a0ee0 msgr2=0x7f15240a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f152978e700 1 --2- 172.21.15.154:0/3128636221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15240a0ee0 0x7f15240a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f152978e700 1 -- 172.21.15.154:0/3128636221 >> v2:172.21.15.154:3300/0 conn(0x7f1524133900 msgr2=0x7f1524133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f152978e700 1 --2- 172.21.15.154:0/3128636221 >> v2:172.21.15.154:3300/0 conn(0x7f1524133900 0x7f1524133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f152978e700 1 -- 172.21.15.154:0/3128636221 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240a23e0 con 0x7f1524134210 2023-09-30T22:27:03.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f1529f8f700 1 --2- 172.21.15.154:0/3128636221 >> v2:172.21.15.154:3300/0 conn(0x7f1524133900 0x7f1524133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f152978e700 1 --2- 172.21.15.154:0/3128636221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1524134210 0x7f15240a09a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1514009840 tx=0x7f1514009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d8e3ffb15ddfa3c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f1528f8d700 1 -- 172.21.15.154:0/3128636221 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514011830 con 0x7f1524134210 2023-09-30T22:27:03.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f1528f8d700 1 -- 172.21.15.154:0/3128636221 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514011990 con 0x7f1524134210 2023-09-30T22:27:03.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.265+0000 7f1528f8d700 1 -- 172.21.15.154:0/3128636221 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514011d20 con 0x7f1524134210 2023-09-30T22:27:03.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.266+0000 7f152c1f3700 1 -- 172.21.15.154:0/3128636221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1524134210 msgr2=0x7f15240a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.266+0000 7f152c1f3700 1 --2- 172.21.15.154:0/3128636221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1524134210 0x7f15240a09a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1514009840 tx=0x7f1514009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:03.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.266+0000 7f152c1f3700 1 -- 172.21.15.154:0/3128636221 shutdown_connections 2023-09-30T22:27:03.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.266+0000 7f152c1f3700 1 --2- 172.21.15.154:0/3128636221 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15240a0ee0 0x7f15240a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.266+0000 7f152c1f3700 1 --2- 172.21.15.154:0/3128636221 >> v2:172.21.15.154:3300/0 conn(0x7f1524133900 0x7f1524133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.266+0000 7f152c1f3700 1 --2- 172.21.15.154:0/3128636221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1524134210 0x7f15240a09a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.266+0000 7f152c1f3700 1 -- 172.21.15.154:0/3128636221 >> 172.21.15.154:0/3128636221 conn(0x7f15240a2980 msgr2=0x7f15240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.266+0000 7f152c1f3700 1 -- 172.21.15.154:0/3128636221 shutdown_connections 2023-09-30T22:27:03.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.267+0000 7f152c1f3700 1 -- 172.21.15.154:0/3128636221 wait complete. 2023-09-30T22:27:03.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:03.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.268+0000 7f152c1f3700 1 Processor -- start 2023-09-30T22:27:03.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.268+0000 7f152c1f3700 1 -- start start 2023-09-30T22:27:03.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152c1f3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15240a0ee0 0x7f152411d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152c1f3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1524133900 0x7f152411dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152c1f3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1524134210 0x7f152411e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152c1f3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1524121210 con 0x7f1524134210 2023-09-30T22:27:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152c1f3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15241205e0 con 0x7f15240a0ee0 2023-09-30T22:27:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152c1f3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1524132df0 con 0x7f1524133900 2023-09-30T22:27:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152978e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1524133900 0x7f152411dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f1529f8f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15240a0ee0 0x7f152411d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152978e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1524133900 0x7f152411dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51714/0 (socket says 172.21.15.154:51714) 2023-09-30T22:27:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152978e700 1 -- 172.21.15.154:0/1096331054 learned_addr learned my addr 172.21.15.154:0/1096331054 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152a790700 1 --2- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1524134210 0x7f152411e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152978e700 1 -- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15240a0ee0 msgr2=0x7f152411d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152978e700 1 --2- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15240a0ee0 0x7f152411d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152978e700 1 -- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1524134210 msgr2=0x7f152411e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152978e700 1 --2- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1524134210 0x7f152411e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152978e700 1 -- 172.21.15.154:0/1096331054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1520009500 con 0x7f1524133900 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f1529f8f700 1 --2- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15240a0ee0 0x7f152411d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f152978e700 1 --2- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1524133900 0x7f152411dc30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1514009b90 tx=0x7f1514004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f151a7fc700 1 -- 172.21.15.154:0/1096331054 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514004450 con 0x7f1524133900 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.269+0000 7f151a7fc700 1 -- 172.21.15.154:0/1096331054 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15140045b0 con 0x7f1524133900 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.270+0000 7f152c1f3700 1 -- 172.21.15.154:0/1096331054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15140094a0 con 0x7f1524133900 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.270+0000 7f151a7fc700 1 -- 172.21.15.154:0/1096331054 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140038e0 con 0x7f1524133900 2023-09-30T22:27:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.270+0000 7f152c1f3700 1 -- 172.21.15.154:0/1096331054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152411f300 con 0x7f1524133900 2023-09-30T22:27:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.271+0000 7f152c1f3700 1 -- 172.21.15.154:0/1096331054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152411a590 con 0x7f1524133900 2023-09-30T22:27:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.271+0000 7f151a7fc700 1 -- 172.21.15.154:0/1096331054 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1514003a40 con 0x7f1524133900 2023-09-30T22:27:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.271+0000 7f151a7fc700 1 -- 172.21.15.154:0/1096331054 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1514040bd0 con 0x7f1524133900 2023-09-30T22:27:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.276+0000 7f151a7fc700 1 -- 172.21.15.154:0/1096331054 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f151402e450 con 0x7f1524133900 2023-09-30T22:27:03.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.301+0000 7f689b24b700 1 Processor -- start 2023-09-30T22:27:03.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.301+0000 7f689b24b700 1 -- start start 2023-09-30T22:27:03.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f689b24b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f689406a770 0x7f689406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f689b24b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689409dec0 0x7f689406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f689b24b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6894131a00 0x7f6894131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f6898fe7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f689406a770 0x7f689406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f689b24b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689406b5c0 con 0x7f689406a770 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f689b24b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689406e900 con 0x7f689409dec0 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f689b24b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f689409d180 con 0x7f6894131a00 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f6898fe7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f689406a770 0x7f689406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44636/0 (socket says 172.21.15.154:44636) 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f6898fe7700 1 -- 172.21.15.154:0/3277512560 learned_addr learned my addr 172.21.15.154:0/3277512560 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f68997e8700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6894131a00 0x7f6894131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.302+0000 7f6893fff700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689409dec0 0x7f689406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.303+0000 7f6898fe7700 1 -- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6894131a00 msgr2=0x7f6894131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.303+0000 7f6898fe7700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6894131a00 0x7f6894131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.303+0000 7f6898fe7700 1 -- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689409dec0 msgr2=0x7f689406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.303+0000 7f6898fe7700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689409dec0 0x7f689406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.303+0000 7f6898fe7700 1 -- 172.21.15.154:0/3277512560 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689409e780 con 0x7f689406a770 2023-09-30T22:27:03.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.303+0000 7f68997e8700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6894131a00 0x7f6894131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.303+0000 7f6898fe7700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689406a770 0x7f689406ab40 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f68880098f0 tx=0x7f6888009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec20170fad175d52 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.305+0000 7f68937fe700 1 -- 172.21.15.154:0/3277512560 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888011830 con 0x7f689406a770 2023-09-30T22:27:03.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.305+0000 7f68937fe700 1 -- 172.21.15.154:0/3277512560 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888011990 con 0x7f689406a770 2023-09-30T22:27:03.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.305+0000 7f68937fe700 1 -- 172.21.15.154:0/3277512560 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888011d20 con 0x7f689406a770 2023-09-30T22:27:03.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.306+0000 7f689b24b700 1 -- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689406a770 msgr2=0x7f689406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.306+0000 7f689b24b700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689406a770 0x7f689406ab40 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f68880098f0 tx=0x7f6888009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:03.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.306+0000 7f689b24b700 1 -- 172.21.15.154:0/3277512560 shutdown_connections 2023-09-30T22:27:03.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.306+0000 7f689b24b700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6894131a00 0x7f6894131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.306+0000 7f689b24b700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689406a770 0x7f689406ab40 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.306+0000 7f689b24b700 1 --2- 172.21.15.154:0/3277512560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689409dec0 0x7f689406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.306+0000 7f689b24b700 1 -- 172.21.15.154:0/3277512560 >> 172.21.15.154:0/3277512560 conn(0x7f6894099c40 msgr2=0x7f68940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.306+0000 7f689b24b700 1 -- 172.21.15.154:0/3277512560 shutdown_connections 2023-09-30T22:27:03.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.306+0000 7f689b24b700 1 -- 172.21.15.154:0/3277512560 wait complete. 2023-09-30T22:27:03.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.308+0000 7f689b24b700 1 Processor -- start 2023-09-30T22:27:03.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.308+0000 7f689b24b700 1 -- start start 2023-09-30T22:27:03.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.308+0000 7f689b24b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f689406a770 0x7f6894119fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.308+0000 7f689b24b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689409dec0 0x7f689411a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.308+0000 7f689b24b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6894131a00 0x7f689411aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.308+0000 7f689b24b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689411e430 con 0x7f689409dec0 2023-09-30T22:27:03.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.308+0000 7f689b24b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689411d790 con 0x7f6894131a00 2023-09-30T22:27:03.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.308+0000 7f689b24b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6894131050 con 0x7f689406a770 2023-09-30T22:27:03.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6893fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689409dec0 0x7f689411a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6893fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689409dec0 0x7f689411a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44650/0 (socket says 172.21.15.154:44650) 2023-09-30T22:27:03.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6893fff700 1 -- 172.21.15.154:0/1209008264 learned_addr learned my addr 172.21.15.154:0/1209008264 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f68997e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6894131a00 0x7f689411aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6898fe7700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f689406a770 0x7f6894119fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6893fff700 1 -- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f689406a770 msgr2=0x7f6894119fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6893fff700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f689406a770 0x7f6894119fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6893fff700 1 -- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6894131a00 msgr2=0x7f689411aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6893fff700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6894131a00 0x7f689411aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6893fff700 1 -- 172.21.15.154:0/1209008264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c009a70 con 0x7f689409dec0 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6898fe7700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f689406a770 0x7f6894119fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f68997e8700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6894131a00 0x7f689411aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f6893fff700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689409dec0 0x7f689411a520 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f688000e930 tx=0x7f688000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f68917fa700 1 -- 172.21.15.154:0/1209008264 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000c640 con 0x7f689409dec0 2023-09-30T22:27:03.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f68917fa700 1 -- 172.21.15.154:0/1209008264 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688000c7a0 con 0x7f689409dec0 2023-09-30T22:27:03.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f689b24b700 1 -- 172.21.15.154:0/1209008264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6888009550 con 0x7f689409dec0 2023-09-30T22:27:03.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f68917fa700 1 -- 172.21.15.154:0/1209008264 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000cb30 con 0x7f689409dec0 2023-09-30T22:27:03.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.309+0000 7f689b24b700 1 -- 172.21.15.154:0/1209008264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689411cdb0 con 0x7f689409dec0 2023-09-30T22:27:03.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.310+0000 7f689b24b700 1 -- 172.21.15.154:0/1209008264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689404f2a0 con 0x7f689409dec0 2023-09-30T22:27:03.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.311+0000 7f68917fa700 1 -- 172.21.15.154:0/1209008264 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f688000cc90 con 0x7f689409dec0 2023-09-30T22:27:03.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.311+0000 7f68917fa700 1 -- 172.21.15.154:0/1209008264 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f688003fa10 con 0x7f689409dec0 2023-09-30T22:27:03.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.320+0000 7f68917fa700 1 -- 172.21.15.154:0/1209008264 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f688001b3b0 con 0x7f689409dec0 2023-09-30T22:27:03.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.345+0000 7f7b172a2700 1 Processor -- start 2023-09-30T22:27:03.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.345+0000 7f7b172a2700 1 -- start start 2023-09-30T22:27:03.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.345+0000 7f7b172a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b100a0a70 0x7f7b100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b172a2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b100a1380 0x7f7b10133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b172a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b10133f50 0x7f7b10134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b172a2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1009e9d0 con 0x7f7b100a1380 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b172a2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1009dc00 con 0x7f7b100a0a70 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b172a2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1009dec0 con 0x7f7b10133f50 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1503e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b100a0a70 0x7f7b100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1503e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b100a0a70 0x7f7b100a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33256/0 (socket says 172.21.15.154:33256) 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1503e700 1 -- 172.21.15.154:0/2347316716 learned_addr learned my addr 172.21.15.154:0/2347316716 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1583f700 1 --2- 172.21.15.154:0/2347316716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b10133f50 0x7f7b10134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1483d700 1 --2- 172.21.15.154:0/2347316716 >> v2:172.21.15.154:3300/0 conn(0x7f7b100a1380 0x7f7b10133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1503e700 1 -- 172.21.15.154:0/2347316716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b10133f50 msgr2=0x7f7b10134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1503e700 1 --2- 172.21.15.154:0/2347316716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b10133f50 0x7f7b10134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1503e700 1 -- 172.21.15.154:0/2347316716 >> v2:172.21.15.154:3300/0 conn(0x7f7b100a1380 msgr2=0x7f7b10133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:03.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1503e700 1 --2- 172.21.15.154:0/2347316716 >> v2:172.21.15.154:3300/0 conn(0x7f7b100a1380 0x7f7b10133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1503e700 1 -- 172.21.15.154:0/2347316716 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1009e6a0 con 0x7f7b100a0a70 2023-09-30T22:27:03.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1483d700 1 --2- 172.21.15.154:0/2347316716 >> v2:172.21.15.154:3300/0 conn(0x7f7b100a1380 0x7f7b10133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b1503e700 1 --2- 172.21.15.154:0/2347316716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b100a0a70 0x7f7b100a0e40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0098f0 tx=0x7f7b0c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a93e8d146e490038 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b07fff700 1 -- 172.21.15.154:0/2347316716 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c011830 con 0x7f7b100a0a70 2023-09-30T22:27:03.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b07fff700 1 -- 172.21.15.154:0/2347316716 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c011990 con 0x7f7b100a0a70 2023-09-30T22:27:03.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.346+0000 7f7b07fff700 1 -- 172.21.15.154:0/2347316716 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c011d20 con 0x7f7b100a0a70 2023-09-30T22:27:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.347+0000 7f7b172a2700 1 -- 172.21.15.154:0/2347316716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b100a0a70 msgr2=0x7f7b100a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.347+0000 7f7b172a2700 1 --2- 172.21.15.154:0/2347316716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b100a0a70 0x7f7b100a0e40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0098f0 tx=0x7f7b0c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.347+0000 7f7b172a2700 1 -- 172.21.15.154:0/2347316716 shutdown_connections 2023-09-30T22:27:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.347+0000 7f7b172a2700 1 --2- 172.21.15.154:0/2347316716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b100a0a70 0x7f7b100a0e40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.347+0000 7f7b172a2700 1 --2- 172.21.15.154:0/2347316716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b10133f50 0x7f7b10134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.347+0000 7f7b172a2700 1 --2- 172.21.15.154:0/2347316716 >> v2:172.21.15.154:3300/0 conn(0x7f7b100a1380 0x7f7b10133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.347+0000 7f7b172a2700 1 -- 172.21.15.154:0/2347316716 >> 172.21.15.154:0/2347316716 conn(0x7f7b100a6610 msgr2=0x7f7b100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.347+0000 7f7b172a2700 1 -- 172.21.15.154:0/2347316716 shutdown_connections 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.347+0000 7f7b172a2700 1 -- 172.21.15.154:0/2347316716 wait complete. 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.348+0000 7f7b172a2700 1 Processor -- start 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.348+0000 7f7b172a2700 1 -- start start 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b172a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b100a0a70 0x7f7b10122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b172a2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b100a1380 0x7f7b10122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b172a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b10133f50 0x7f7b10123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b172a2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10123e50 con 0x7f7b100a1380 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b172a2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10126120 con 0x7f7b10133f50 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b172a2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10124600 con 0x7f7b100a0a70 2023-09-30T22:27:03.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b1483d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b100a1380 0x7f7b10122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b1503e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b100a0a70 0x7f7b10122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b1583f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b10133f50 0x7f7b10123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b1483d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b100a1380 0x7f7b10122ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44674/0 (socket says 172.21.15.154:44674) 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b1503e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b100a0a70 0x7f7b10122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51754/0 (socket says 172.21.15.154:51754) 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.349+0000 7f7b1483d700 1 -- 172.21.15.154:0/4194755786 learned_addr learned my addr 172.21.15.154:0/4194755786 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b1483d700 1 -- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b100a0a70 msgr2=0x7f7b10122980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b1483d700 1 --2- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b100a0a70 0x7f7b10122980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b1483d700 1 -- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b10133f50 msgr2=0x7f7b10123400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b1483d700 1 --2- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b10133f50 0x7f7b10123400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b1483d700 1 -- 172.21.15.154:0/4194755786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b000094a0 con 0x7f7b100a1380 2023-09-30T22:27:03.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b1583f700 1 --2- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b10133f50 0x7f7b10123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b1503e700 1 --2- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b100a0a70 0x7f7b10122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b1483d700 1 --2- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b100a1380 0x7f7b10122ec0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000ebb0 tx=0x7f7b0000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b05ffb700 1 -- 172.21.15.154:0/4194755786 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000c850 con 0x7f7b100a1380 2023-09-30T22:27:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b05ffb700 1 -- 172.21.15.154:0/4194755786 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000c9b0 con 0x7f7b100a1380 2023-09-30T22:27:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b05ffb700 1 -- 172.21.15.154:0/4194755786 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000cd40 con 0x7f7b100a1380 2023-09-30T22:27:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b172a2700 1 -- 172.21.15.154:0/4194755786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0c009550 con 0x7f7b100a1380 2023-09-30T22:27:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.350+0000 7f7b172a2700 1 -- 172.21.15.154:0/4194755786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b10124af0 con 0x7f7b100a1380 2023-09-30T22:27:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.351+0000 7f7b05ffb700 1 -- 172.21.15.154:0/4194755786 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b00013470 con 0x7f7b100a1380 2023-09-30T22:27:03.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.351+0000 7f7b05ffb700 1 -- 172.21.15.154:0/4194755786 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b0003fa90 con 0x7f7b100a1380 2023-09-30T22:27:03.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.352+0000 7f7b172a2700 1 -- 172.21.15.154:0/4194755786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b100a2920 con 0x7f7b100a1380 2023-09-30T22:27:03.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.356+0000 7f7b05ffb700 1 -- 172.21.15.154:0/4194755786 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b0001b3b0 con 0x7f7b100a1380 2023-09-30T22:27:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.477+0000 7f152c1f3700 1 -- 172.21.15.154:0/1096331054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f152404f2a0 con 0x7f1524133900 2023-09-30T22:27:03.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.477+0000 7f151a7fc700 1 -- 172.21.15.154:0/1096331054 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1514015070 con 0x7f1524133900 2023-09-30T22:27:03.478 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:03.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.479+0000 7f152c1f3700 1 -- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1524133900 msgr2=0x7f152411dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.479+0000 7f152c1f3700 1 --2- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1524133900 0x7f152411dc30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1514009b90 tx=0x7f1514004750 comp rx=0 tx=0).stop 2023-09-30T22:27:03.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.479+0000 7f152c1f3700 1 -- 172.21.15.154:0/1096331054 shutdown_connections 2023-09-30T22:27:03.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.479+0000 7f152c1f3700 1 --2- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1524134210 0x7f152411e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.479+0000 7f152c1f3700 1 --2- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15240a0ee0 0x7f152411d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.479+0000 7f152c1f3700 1 --2- 172.21.15.154:0/1096331054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1524133900 0x7f152411dc30 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.479+0000 7f152c1f3700 1 -- 172.21.15.154:0/1096331054 >> 172.21.15.154:0/1096331054 conn(0x7f15240a2980 msgr2=0x7f15241bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.479+0000 7f152c1f3700 1 -- 172.21.15.154:0/1096331054 shutdown_connections 2023-09-30T22:27:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.479+0000 7f152c1f3700 1 -- 172.21.15.154:0/1096331054 wait complete. 2023-09-30T22:27:03.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:03.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.516+0000 7f689b24b700 1 -- 172.21.15.154:0/1209008264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f689409e380 con 0x7f689409dec0 2023-09-30T22:27:03.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.516+0000 7f68917fa700 1 -- 172.21.15.154:0/1209008264 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6880017020 con 0x7f689409dec0 2023-09-30T22:27:03.516 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:03.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.519+0000 7f689b24b700 1 -- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689409dec0 msgr2=0x7f689411a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.519+0000 7f689b24b700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689409dec0 0x7f689411a520 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f688000e930 tx=0x7f688000ec40 comp rx=0 tx=0).stop 2023-09-30T22:27:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.519+0000 7f689b24b700 1 -- 172.21.15.154:0/1209008264 shutdown_connections 2023-09-30T22:27:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.519+0000 7f689b24b700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6894131a00 0x7f689411aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.519+0000 7f689b24b700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f689406a770 0x7f6894119fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.519+0000 7f689b24b700 1 --2- 172.21.15.154:0/1209008264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689409dec0 0x7f689411a520 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.519+0000 7f689b24b700 1 -- 172.21.15.154:0/1209008264 >> 172.21.15.154:0/1209008264 conn(0x7f6894099c40 msgr2=0x7f689412f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.519+0000 7f689b24b700 1 -- 172.21.15.154:0/1209008264 shutdown_connections 2023-09-30T22:27:03.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.519+0000 7f689b24b700 1 -- 172.21.15.154:0/1209008264 wait complete. 2023-09-30T22:27:03.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:03.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.549+0000 7f7b172a2700 1 -- 172.21.15.154:0/4194755786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b1004f2a0 con 0x7f7b100a1380 2023-09-30T22:27:03.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.550+0000 7f7b05ffb700 1 -- 172.21.15.154:0/4194755786 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b00011b40 con 0x7f7b100a1380 2023-09-30T22:27:03.550 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:03.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.552+0000 7f7b172a2700 1 -- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b100a1380 msgr2=0x7f7b10122ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:03.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.552+0000 7f7b172a2700 1 --2- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b100a1380 0x7f7b10122ec0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000ebb0 tx=0x7f7b0000eec0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.552+0000 7f7b172a2700 1 -- 172.21.15.154:0/4194755786 shutdown_connections 2023-09-30T22:27:03.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.552+0000 7f7b172a2700 1 --2- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b10133f50 0x7f7b10123400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.552+0000 7f7b172a2700 1 --2- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7b100a0a70 0x7f7b10122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.552+0000 7f7b172a2700 1 --2- 172.21.15.154:0/4194755786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b100a1380 0x7f7b10122ec0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:03.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.552+0000 7f7b172a2700 1 -- 172.21.15.154:0/4194755786 >> 172.21.15.154:0/4194755786 conn(0x7f7b100a6610 msgr2=0x7f7b1009c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:03.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.552+0000 7f7b172a2700 1 -- 172.21.15.154:0/4194755786 shutdown_connections 2023-09-30T22:27:03.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:03.552+0000 7f7b172a2700 1 -- 172.21.15.154:0/4194755786 wait complete. 2023-09-30T22:27:03.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:04.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:04.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd94a9700 1 Processor -- start 2023-09-30T22:27:04.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd94a9700 1 -- start start 2023-09-30T22:27:04.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd94a9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd4132e70 0x7fddd4135250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd94a9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddd4135790 0x7fddd4137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd94a9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd409a540 con 0x7fddd412feb0 2023-09-30T22:27:04.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd94a9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd409ad40 con 0x7fddd4135790 2023-09-30T22:27:04.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd94a9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd409e640 con 0x7fddd4132e70 2023-09-30T22:27:04.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddd4135790 0x7fddd4137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd4132e70 0x7fddd4135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd27fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd4132e70 0x7fddd4135250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33282/0 (socket says 172.21.15.154:33282) 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddd4135790 0x7fddd4137b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44680/0 (socket says 172.21.15.154:44680) 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.403+0000 7fddd27fc700 1 -- 172.21.15.154:0/2107605497 learned_addr learned my addr 172.21.15.154:0/2107605497 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.404+0000 7fddd27fc700 1 -- 172.21.15.154:0/2107605497 >> v2:172.21.15.154:3300/0 conn(0x7fddd4135790 msgr2=0x7fddd4137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.404+0000 7fddd27fc700 1 --2- 172.21.15.154:0/2107605497 >> v2:172.21.15.154:3300/0 conn(0x7fddd4135790 0x7fddd4137b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.404+0000 7fddd27fc700 1 -- 172.21.15.154:0/2107605497 >> v1:172.21.15.154:6789/0 conn(0x7fddd412feb0 legacy=0x7fddd4130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.404+0000 7fddd27fc700 1 -- 172.21.15.154:0/2107605497 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd409e3c0 con 0x7fddd4132e70 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.404+0000 7fddd37fe700 1 --2- 172.21.15.154:0/2107605497 >> v2:172.21.15.154:3300/0 conn(0x7fddd4135790 0x7fddd4137b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.404+0000 7fddd27fc700 1 --2- 172.21.15.154:0/2107605497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd4132e70 0x7fddd4135250 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fddc800aa90 tx=0x7fddc800ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b1b3be8c589f6ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.404+0000 7fddd1ffb700 1 -- 172.21.15.154:0/2107605497 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800cb70 con 0x7fddd4132e70 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.404+0000 7fddd1ffb700 1 -- 172.21.15.154:0/2107605497 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc800ccd0 con 0x7fddd4132e70 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.404+0000 7fddd1ffb700 1 -- 172.21.15.154:0/2107605497 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8018620 con 0x7fddd4132e70 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.405+0000 7fddd94a9700 1 -- 172.21.15.154:0/2107605497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd4132e70 msgr2=0x7fddd4135250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.405+0000 7fddd94a9700 1 --2- 172.21.15.154:0/2107605497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd4132e70 0x7fddd4135250 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fddc800aa90 tx=0x7fddc800ada0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.405+0000 7fddd94a9700 1 -- 172.21.15.154:0/2107605497 shutdown_connections 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.405+0000 7fddd94a9700 1 --2- 172.21.15.154:0/2107605497 >> v2:172.21.15.154:3300/0 conn(0x7fddd4135790 0x7fddd4137b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.405+0000 7fddd94a9700 1 --2- 172.21.15.154:0/2107605497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd4132e70 0x7fddd4135250 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.405+0000 7fddd94a9700 1 -- 172.21.15.154:0/2107605497 >> 172.21.15.154:0/2107605497 conn(0x7fddd40a2b30 msgr2=0x7fddd409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.405+0000 7fddd94a9700 1 -- 172.21.15.154:0/2107605497 shutdown_connections 2023-09-30T22:27:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.405+0000 7fddd94a9700 1 -- 172.21.15.154:0/2107605497 wait complete. 2023-09-30T22:27:04.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd94a9700 1 Processor -- start 2023-09-30T22:27:04.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd94a9700 1 -- start start 2023-09-30T22:27:04.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd94a9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd412feb0 0x7fddd40988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd94a9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd4132e70 0x7fddd4128a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd94a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddd4135790 0x7fddd4128f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd94a9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd412d0b0 con 0x7fddd4132e70 2023-09-30T22:27:04.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd94a9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd412a2e0 con 0x7fddd412feb0 2023-09-30T22:27:04.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd94a9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd412cf00 con 0x7fddd4135790 2023-09-30T22:27:04.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd4132e70 0x7fddd4128a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd27fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd4132e70 0x7fddd4128a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44682/0 (socket says 172.21.15.154:44682) 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd412feb0 0x7fddd40988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd27fc700 1 -- 172.21.15.154:0/2334478378 learned_addr learned my addr 172.21.15.154:0/2334478378 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.406+0000 7fddd37fe700 1 --2- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddd4135790 0x7fddd4128f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddd27fc700 1 -- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddd4135790 msgr2=0x7fddd4128f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddd27fc700 1 --2- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddd4135790 0x7fddd4128f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddd27fc700 1 -- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd412feb0 msgr2=0x7fddd40988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddd27fc700 1 --2- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd412feb0 0x7fddd40988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddd27fc700 1 -- 172.21.15.154:0/2334478378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009a70 con 0x7fddd4132e70 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddd27fc700 1 --2- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd4132e70 0x7fddd4128a40 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fddc800ade0 tx=0x7fddc80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2334478378 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc80038b0 con 0x7fddd4132e70 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2334478378 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8003a30 con 0x7fddd4132e70 2023-09-30T22:27:04.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2334478378 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8003de0 con 0x7fddd4132e70 2023-09-30T22:27:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddd94a9700 1 -- 172.21.15.154:0/2334478378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc800a6f0 con 0x7fddd4132e70 2023-09-30T22:27:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.407+0000 7fddd94a9700 1 -- 172.21.15.154:0/2334478378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd4127e60 con 0x7fddd4132e70 2023-09-30T22:27:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.408+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2334478378 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddc8018400 con 0x7fddd4132e70 2023-09-30T22:27:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.408+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2334478378 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fddc8040a10 con 0x7fddd4132e70 2023-09-30T22:27:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.408+0000 7fddd94a9700 1 -- 172.21.15.154:0/2334478378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd412c400 con 0x7fddd4132e70 2023-09-30T22:27:04.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.413+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2334478378 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddc801e710 con 0x7fddd4132e70 2023-09-30T22:27:04.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:04.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:04.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:04.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.612+0000 7fddd94a9700 1 -- 172.21.15.154:0/2334478378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddd404f2a0 con 0x7fddd4132e70 2023-09-30T22:27:04.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.613+0000 7fddbb7fe700 1 -- 172.21.15.154:0/2334478378 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddc8025030 con 0x7fddd4132e70 2023-09-30T22:27:04.613 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:04.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.616+0000 7fddd94a9700 1 -- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd4132e70 msgr2=0x7fddd4128a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.616+0000 7fddd94a9700 1 --2- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd4132e70 0x7fddd4128a40 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fddc800ade0 tx=0x7fddc80047c0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.616+0000 7fddd94a9700 1 -- 172.21.15.154:0/2334478378 shutdown_connections 2023-09-30T22:27:04.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.616+0000 7fddd94a9700 1 --2- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fddd4135790 0x7fddd4128f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.616+0000 7fddd94a9700 1 --2- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddd412feb0 0x7fddd40988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.616+0000 7fddd94a9700 1 --2- 172.21.15.154:0/2334478378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddd4132e70 0x7fddd4128a40 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.616+0000 7fddd94a9700 1 -- 172.21.15.154:0/2334478378 >> 172.21.15.154:0/2334478378 conn(0x7fddd40a2b30 msgr2=0x7fddd409c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.616+0000 7fddd94a9700 1 -- 172.21.15.154:0/2334478378 shutdown_connections 2023-09-30T22:27:04.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.616+0000 7fddd94a9700 1 -- 172.21.15.154:0/2334478378 wait complete. 2023-09-30T22:27:04.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.622+0000 7fd99bba3700 1 Processor -- start 2023-09-30T22:27:04.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99bba3700 1 -- start start 2023-09-30T22:27:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99bba3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994136960 0x7fd994138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99bba3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994139280 0x7fd99413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99bba3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99406b2d0 con 0x7fd994133ad0 2023-09-30T22:27:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99bba3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9941345b0 con 0x7fd994136960 2023-09-30T22:27:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99bba3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd994133610 con 0x7fd994139280 2023-09-30T22:27:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99913e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994136960 0x7fd994138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99a140700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994139280 0x7fd99413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99993f700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd994133ad0 0x7fd994133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57018/0 (socket says 172.21.15.154:57018) 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.623+0000 7fd99993f700 1 -- 172.21.15.154:0/732514488 learned_addr learned my addr 172.21.15.154:0/732514488 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99893d700 1 -- 172.21.15.154:0/732514488 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301819433 0 0) 0x7fd99406b2d0 con 0x7fd994133ad0 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99893d700 1 -- 172.21.15.154:0/732514488 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9800035b0 con 0x7fd994133ad0 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99913e700 1 -- 172.21.15.154:0/732514488 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994139280 msgr2=0x7fd99413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99913e700 1 --2- 172.21.15.154:0/732514488 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994139280 0x7fd99413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99913e700 1 -- 172.21.15.154:0/732514488 >> v1:172.21.15.154:6789/0 conn(0x7fd994133ad0 legacy=0x7fd994133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99913e700 1 -- 172.21.15.154:0/732514488 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99409a500 con 0x7fd994136960 2023-09-30T22:27:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99a140700 1 --2- 172.21.15.154:0/732514488 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994139280 0x7fd99413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99913e700 1 --2- 172.21.15.154:0/732514488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994136960 0x7fd994138d40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd984009870 tx=0x7fd984009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d750619461747d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99893d700 1 -- 172.21.15.154:0/732514488 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984011830 con 0x7fd994136960 2023-09-30T22:27:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99893d700 1 -- 172.21.15.154:0/732514488 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd984011990 con 0x7fd994136960 2023-09-30T22:27:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.624+0000 7fd99893d700 1 -- 172.21.15.154:0/732514488 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984011d20 con 0x7fd994136960 2023-09-30T22:27:04.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.625+0000 7fd99bba3700 1 -- 172.21.15.154:0/732514488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994136960 msgr2=0x7fd994138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.625+0000 7fd99bba3700 1 --2- 172.21.15.154:0/732514488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994136960 0x7fd994138d40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd984009870 tx=0x7fd984009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.625+0000 7fd99bba3700 1 -- 172.21.15.154:0/732514488 shutdown_connections 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.625+0000 7fd99bba3700 1 --2- 172.21.15.154:0/732514488 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994139280 0x7fd99413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.625+0000 7fd99bba3700 1 --2- 172.21.15.154:0/732514488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994136960 0x7fd994138d40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.625+0000 7fd99bba3700 1 -- 172.21.15.154:0/732514488 >> 172.21.15.154:0/732514488 conn(0x7fd994099c40 msgr2=0x7fd9940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.625+0000 7fd99bba3700 1 -- 172.21.15.154:0/732514488 shutdown_connections 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.625+0000 7fd99bba3700 1 -- 172.21.15.154:0/732514488 wait complete. 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.626+0000 7fd99bba3700 1 Processor -- start 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.626+0000 7fd99bba3700 1 -- start start 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99bba3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994133ad0 0x7fd99412ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99bba3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd994136960 0x7fd99412f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99bba3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994139280 0x7fd99412f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99bba3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd994070fd0 con 0x7fd994136960 2023-09-30T22:27:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99bba3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99406fe50 con 0x7fd994139280 2023-09-30T22:27:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99bba3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd99409f390 con 0x7fd994133ad0 2023-09-30T22:27:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99a140700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994139280 0x7fd99412f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99913e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd994136960 0x7fd99412f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99a140700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994139280 0x7fd99412f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33310/0 (socket says 172.21.15.154:33310) 2023-09-30T22:27:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99a140700 1 -- 172.21.15.154:0/2880300520 learned_addr learned my addr 172.21.15.154:0/2880300520 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.627+0000 7fd99993f700 1 --2- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994133ad0 0x7fd99412ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd99913e700 1 -- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994133ad0 msgr2=0x7fd99412ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd99913e700 1 --2- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994133ad0 0x7fd99412ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd99913e700 1 -- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994139280 msgr2=0x7fd99412f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd99913e700 1 --2- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994139280 0x7fd99412f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd99913e700 1 -- 172.21.15.154:0/2880300520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c009a70 con 0x7fd994136960 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd99913e700 1 --2- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd994136960 0x7fd99412f340 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd984016000 tx=0x7fd984004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd98a7fc700 1 -- 172.21.15.154:0/2880300520 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984004240 con 0x7fd994136960 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd98a7fc700 1 -- 172.21.15.154:0/2880300520 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98401f070 con 0x7fd994136960 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd99bba3700 1 -- 172.21.15.154:0/2880300520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9840094a0 con 0x7fd994136960 2023-09-30T22:27:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd98a7fc700 1 -- 172.21.15.154:0/2880300520 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840045a0 con 0x7fd994136960 2023-09-30T22:27:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.628+0000 7fd99bba3700 1 -- 172.21.15.154:0/2880300520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd994131730 con 0x7fd994136960 2023-09-30T22:27:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.629+0000 7fd98a7fc700 1 -- 172.21.15.154:0/2880300520 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd984021030 con 0x7fd994136960 2023-09-30T22:27:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.629+0000 7fd98a7fc700 1 -- 172.21.15.154:0/2880300520 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd984040660 con 0x7fd994136960 2023-09-30T22:27:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.629+0000 7fd99bba3700 1 -- 172.21.15.154:0/2880300520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99404f2a0 con 0x7fd994136960 2023-09-30T22:27:04.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.634+0000 7fd98a7fc700 1 -- 172.21.15.154:0/2880300520 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd98401a450 con 0x7fd994136960 2023-09-30T22:27:04.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:04.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.668+0000 7fc090ba4700 1 Processor -- start 2023-09-30T22:27:04.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.668+0000 7fc090ba4700 1 -- start start 2023-09-30T22:27:04.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc090ba4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c09e340 0x7fc08c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc090ba4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c135f20 0x7fc08c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc090ba4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c09aaa0 con 0x7fc08c09d860 2023-09-30T22:27:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc090ba4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c09e730 con 0x7fc08c09e340 2023-09-30T22:27:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc090ba4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c09f870 con 0x7fc08c135f20 2023-09-30T22:27:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc089d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c09e340 0x7fc08c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc08a59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc08c09d860 0x7fc08c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57026/0 (socket says 172.21.15.154:57026) 2023-09-30T22:27:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc08a59c700 1 -- 172.21.15.154:0/1708887582 learned_addr learned my addr 172.21.15.154:0/1708887582 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc08ad9d700 1 --2- 172.21.15.154:0/1708887582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c135f20 0x7fc08c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc089d9b700 1 -- 172.21.15.154:0/1708887582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c135f20 msgr2=0x7fc08c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.669+0000 7fc08959a700 1 -- 172.21.15.154:0/1708887582 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975829642 0 0) 0x7fc08c09aaa0 con 0x7fc08c09d860 2023-09-30T22:27:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc089d9b700 1 --2- 172.21.15.154:0/1708887582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c135f20 0x7fc08c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc089d9b700 1 -- 172.21.15.154:0/1708887582 >> v1:172.21.15.154:6789/0 conn(0x7fc08c09d860 legacy=0x7fc08c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc089d9b700 1 -- 172.21.15.154:0/1708887582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c09b360 con 0x7fc08c09e340 2023-09-30T22:27:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc089d9b700 1 --2- 172.21.15.154:0/1708887582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c09e340 0x7fc08c1359e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc080009870 tx=0x7fc080009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97aea6063773b883 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc08959a700 1 -- 172.21.15.154:0/1708887582 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011830 con 0x7fc08c09e340 2023-09-30T22:27:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc08959a700 1 -- 172.21.15.154:0/1708887582 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc080011990 con 0x7fc08c09e340 2023-09-30T22:27:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc08959a700 1 -- 172.21.15.154:0/1708887582 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011d20 con 0x7fc08c09e340 2023-09-30T22:27:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc090ba4700 1 -- 172.21.15.154:0/1708887582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c09e340 msgr2=0x7fc08c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.670+0000 7fc090ba4700 1 --2- 172.21.15.154:0/1708887582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c09e340 0x7fc08c1359e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc080009870 tx=0x7fc080009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.671+0000 7fc090ba4700 1 -- 172.21.15.154:0/1708887582 shutdown_connections 2023-09-30T22:27:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.671+0000 7fc090ba4700 1 --2- 172.21.15.154:0/1708887582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c135f20 0x7fc08c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.671+0000 7fc090ba4700 1 --2- 172.21.15.154:0/1708887582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c09e340 0x7fc08c1359e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.671+0000 7fc090ba4700 1 -- 172.21.15.154:0/1708887582 >> 172.21.15.154:0/1708887582 conn(0x7fc08c099c40 msgr2=0x7fc08c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.671+0000 7fc090ba4700 1 -- 172.21.15.154:0/1708887582 shutdown_connections 2023-09-30T22:27:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.671+0000 7fc090ba4700 1 -- 172.21.15.154:0/1708887582 wait complete. 2023-09-30T22:27:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.672+0000 7fc090ba4700 1 Processor -- start 2023-09-30T22:27:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.672+0000 7fc090ba4700 1 -- start start 2023-09-30T22:27:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc090ba4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c09d860 0x7fc08c11b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc090ba4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c09e340 0x7fc08c11b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc090ba4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c135f20 0x7fc08c11be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc090ba4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0a2090 con 0x7fc08c09d860 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc090ba4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c09c8b0 con 0x7fc08c135f20 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc090ba4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c11e5a0 con 0x7fc08c09e340 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc08a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c09d860 0x7fc08c11b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc08a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c09d860 0x7fc08c11b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44710/0 (socket says 172.21.15.154:44710) 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc08a59c700 1 -- 172.21.15.154:0/984770148 learned_addr learned my addr 172.21.15.154:0/984770148 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc089d9b700 1 --2- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c09e340 0x7fc08c11b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc08ad9d700 1 --2- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c135f20 0x7fc08c11be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc08a59c700 1 -- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c09e340 msgr2=0x7fc08c11b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc08a59c700 1 --2- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c09e340 0x7fc08c11b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc08a59c700 1 -- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c135f20 msgr2=0x7fc08c11be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.673+0000 7fc08a59c700 1 --2- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c135f20 0x7fc08c11be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.674+0000 7fc08a59c700 1 -- 172.21.15.154:0/984770148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800094a0 con 0x7fc08c09d860 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.674+0000 7fc08a59c700 1 --2- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c09d860 0x7fc08c11b390 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c520 tx=0x7fc07c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.674+0000 7fc07affd700 1 -- 172.21.15.154:0/984770148 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c004c80 con 0x7fc08c09d860 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.674+0000 7fc07affd700 1 -- 172.21.15.154:0/984770148 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c004de0 con 0x7fc08c09d860 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.674+0000 7fc07affd700 1 -- 172.21.15.154:0/984770148 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c007310 con 0x7fc08c09d860 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.674+0000 7fc090ba4700 1 -- 172.21.15.154:0/984770148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c11eb30 con 0x7fc08c09d860 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.674+0000 7fc090ba4700 1 -- 172.21.15.154:0/984770148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c11f5a0 con 0x7fc08c09d860 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.675+0000 7fc07affd700 1 -- 172.21.15.154:0/984770148 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc07c007470 con 0x7fc08c09d860 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.675+0000 7fc07affd700 1 -- 172.21.15.154:0/984770148 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc07c03f1f0 con 0x7fc08c09d860 2023-09-30T22:27:04.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.675+0000 7fc090ba4700 1 -- 172.21.15.154:0/984770148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c11e150 con 0x7fc08c09d860 2023-09-30T22:27:04.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.684+0000 7fc07affd700 1 -- 172.21.15.154:0/984770148 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc07c0123b0 con 0x7fc08c09d860 2023-09-30T22:27:04.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.717+0000 7f290461b700 1 Processor -- start 2023-09-30T22:27:04.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.717+0000 7f290461b700 1 -- start start 2023-09-30T22:27:04.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.717+0000 7f290461b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc133ad0 0x7f28fc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.717+0000 7f290461b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28fc1300a0 0x7f28fc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.717+0000 7f290461b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc1309f0 0x7f28fc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.717+0000 7f290461b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc06b2d0 con 0x7f28fc1300a0 2023-09-30T22:27:04.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.717+0000 7f290461b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc133610 con 0x7f28fc1309f0 2023-09-30T22:27:04.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.717+0000 7f290461b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc09a500 con 0x7f28fc133ad0 2023-09-30T22:27:04.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.717+0000 7f2901bb6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28fc1300a0 0x7f28fc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2901bb6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28fc1300a0 0x7f28fc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44726/0 (socket says 172.21.15.154:44726) 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2901bb6700 1 -- 172.21.15.154:0/1432656597 learned_addr learned my addr 172.21.15.154:0/1432656597 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2902bb8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc1309f0 0x7f28fc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f29023b7700 1 --2- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc133ad0 0x7f28fc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2901bb6700 1 -- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc133ad0 msgr2=0x7f28fc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2901bb6700 1 --2- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc133ad0 0x7f28fc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2901bb6700 1 -- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc1309f0 msgr2=0x7f28fc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2901bb6700 1 --2- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc1309f0 0x7f28fc13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2901bb6700 1 -- 172.21.15.154:0/1432656597 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc1338b0 con 0x7f28fc1300a0 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2902bb8700 1 --2- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc1309f0 0x7f28fc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f2901bb6700 1 --2- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1300a0 0x7f28fc1304b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0098f0 tx=0x7f28ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9767d133e43ed91 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f29013b5700 1 -- 172.21.15.154:0/1432656597 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec011830 con 0x7f28fc1300a0 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f29013b5700 1 -- 172.21.15.154:0/1432656597 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec011990 con 0x7f28fc1300a0 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.718+0000 7f29013b5700 1 -- 172.21.15.154:0/1432656597 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec011d20 con 0x7f28fc1300a0 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.719+0000 7f290461b700 1 -- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1300a0 msgr2=0x7f28fc1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.719+0000 7f290461b700 1 --2- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1300a0 0x7f28fc1304b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0098f0 tx=0x7f28ec009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.719+0000 7f290461b700 1 -- 172.21.15.154:0/1432656597 shutdown_connections 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.719+0000 7f290461b700 1 --2- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc1309f0 0x7f28fc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.719+0000 7f290461b700 1 --2- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc133ad0 0x7f28fc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.719+0000 7f290461b700 1 --2- 172.21.15.154:0/1432656597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1300a0 0x7f28fc1304b0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.719+0000 7f290461b700 1 -- 172.21.15.154:0/1432656597 >> 172.21.15.154:0/1432656597 conn(0x7f28fc099c40 msgr2=0x7f28fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.719+0000 7f290461b700 1 -- 172.21.15.154:0/1432656597 shutdown_connections 2023-09-30T22:27:04.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.719+0000 7f290461b700 1 -- 172.21.15.154:0/1432656597 wait complete. 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f290461b700 1 Processor -- start 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f290461b700 1 -- start start 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f290461b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc1300a0 0x7f28fc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f290461b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1309f0 0x7f28fc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f290461b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc133ad0 0x7f28fc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f290461b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc11fd00 con 0x7f28fc1309f0 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f290461b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc12dd00 con 0x7f28fc133ad0 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f290461b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc120950 con 0x7f28fc1300a0 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f29023b7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc1300a0 0x7f28fc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f2901bb6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1309f0 0x7f28fc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f2901bb6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1309f0 0x7f28fc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44728/0 (socket says 172.21.15.154:44728) 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f29023b7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc1300a0 0x7f28fc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51798/0 (socket says 172.21.15.154:51798) 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f2901bb6700 1 -- 172.21.15.154:0/2800767310 learned_addr learned my addr 172.21.15.154:0/2800767310 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.720+0000 7f2902bb8700 1 --2- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc133ad0 0x7f28fc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f29023b7700 1 -- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc133ad0 msgr2=0x7f28fc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f29023b7700 1 --2- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc133ad0 0x7f28fc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f29023b7700 1 -- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1309f0 msgr2=0x7f28fc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f29023b7700 1 --2- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1309f0 0x7f28fc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f29023b7700 1 -- 172.21.15.154:0/2800767310 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f4009a70 con 0x7f28fc1300a0 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f29023b7700 1 --2- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc1300a0 0x7f28fc11da40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f28f800e930 tx=0x7f28f800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f28f2ffd700 1 -- 172.21.15.154:0/2800767310 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800c640 con 0x7f28fc1300a0 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f28f2ffd700 1 -- 172.21.15.154:0/2800767310 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800c7a0 con 0x7f28fc1300a0 2023-09-30T22:27:04.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f290461b700 1 -- 172.21.15.154:0/2800767310 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec009550 con 0x7f28fc1300a0 2023-09-30T22:27:04.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f28f2ffd700 1 -- 172.21.15.154:0/2800767310 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800cb10 con 0x7f28fc1300a0 2023-09-30T22:27:04.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.721+0000 7f290461b700 1 -- 172.21.15.154:0/2800767310 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc072180 con 0x7f28fc1300a0 2023-09-30T22:27:04.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.722+0000 7f290461b700 1 -- 172.21.15.154:0/2800767310 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc09cb20 con 0x7f28fc1300a0 2023-09-30T22:27:04.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.723+0000 7f28f2ffd700 1 -- 172.21.15.154:0/2800767310 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28f800cc70 con 0x7f28fc1300a0 2023-09-30T22:27:04.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.723+0000 7f28f2ffd700 1 -- 172.21.15.154:0/2800767310 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f28f803fe00 con 0x7f28fc1300a0 2023-09-30T22:27:04.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.727+0000 7f28f2ffd700 1 -- 172.21.15.154:0/2800767310 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28f8011350 con 0x7f28fc1300a0 2023-09-30T22:27:04.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.855+0000 7fd99bba3700 1 -- 172.21.15.154:0/2880300520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd99409f0f0 con 0x7fd994136960 2023-09-30T22:27:04.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.855+0000 7fd98a7fc700 1 -- 172.21.15.154:0/2880300520 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd98401b430 con 0x7fd994136960 2023-09-30T22:27:04.855 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:04.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.857+0000 7fd99bba3700 1 -- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd994136960 msgr2=0x7fd99412f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.857+0000 7fd99bba3700 1 --2- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd994136960 0x7fd99412f340 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd984016000 tx=0x7fd984004750 comp rx=0 tx=0).stop 2023-09-30T22:27:04.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.857+0000 7fd99bba3700 1 -- 172.21.15.154:0/2880300520 shutdown_connections 2023-09-30T22:27:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.857+0000 7fd99bba3700 1 --2- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd994139280 0x7fd99412f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.857+0000 7fd99bba3700 1 --2- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd994133ad0 0x7fd99412ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.857+0000 7fd99bba3700 1 --2- 172.21.15.154:0/2880300520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd994136960 0x7fd99412f340 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.857+0000 7fd99bba3700 1 -- 172.21.15.154:0/2880300520 >> 172.21.15.154:0/2880300520 conn(0x7fd994099c40 msgr2=0x7fd994134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.857+0000 7fd99bba3700 1 -- 172.21.15.154:0/2880300520 shutdown_connections 2023-09-30T22:27:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.857+0000 7fd99bba3700 1 -- 172.21.15.154:0/2880300520 wait complete. 2023-09-30T22:27:04.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:04.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.880+0000 7fc090ba4700 1 -- 172.21.15.154:0/984770148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc08c04f2a0 con 0x7fc08c09d860 2023-09-30T22:27:04.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.880+0000 7fc07affd700 1 -- 172.21.15.154:0/984770148 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc07c011360 con 0x7fc08c09d860 2023-09-30T22:27:04.880 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:04.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.882+0000 7fc090ba4700 1 -- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c09d860 msgr2=0x7fc08c11b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.882+0000 7fc090ba4700 1 --2- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c09d860 0x7fc08c11b390 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c520 tx=0x7fc07c00c830 comp rx=0 tx=0).stop 2023-09-30T22:27:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.882+0000 7fc090ba4700 1 -- 172.21.15.154:0/984770148 shutdown_connections 2023-09-30T22:27:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.882+0000 7fc090ba4700 1 --2- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c135f20 0x7fc08c11be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.882+0000 7fc090ba4700 1 --2- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c09d860 0x7fc08c11b390 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.882+0000 7fc090ba4700 1 --2- 172.21.15.154:0/984770148 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc08c09e340 0x7fc08c11b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.882+0000 7fc090ba4700 1 -- 172.21.15.154:0/984770148 >> 172.21.15.154:0/984770148 conn(0x7fc08c099c40 msgr2=0x7fc08c132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.882+0000 7fc090ba4700 1 -- 172.21.15.154:0/984770148 shutdown_connections 2023-09-30T22:27:04.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.882+0000 7fc090ba4700 1 -- 172.21.15.154:0/984770148 wait complete. 2023-09-30T22:27:04.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:04.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.941+0000 7f290461b700 1 -- 172.21.15.154:0/2800767310 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f28fc04f2a0 con 0x7f28fc1300a0 2023-09-30T22:27:04.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.941+0000 7f28f2ffd700 1 -- 172.21.15.154:0/2800767310 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28f8024b40 con 0x7f28fc1300a0 2023-09-30T22:27:04.941 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:04.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.943+0000 7f290461b700 1 -- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc1300a0 msgr2=0x7f28fc11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:04.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.943+0000 7f290461b700 1 --2- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc1300a0 0x7f28fc11da40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f28f800e930 tx=0x7f28f800ec40 comp rx=0 tx=0).stop 2023-09-30T22:27:04.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.943+0000 7f290461b700 1 -- 172.21.15.154:0/2800767310 shutdown_connections 2023-09-30T22:27:04.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.943+0000 7f290461b700 1 --2- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28fc133ad0 0x7f28fc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.943+0000 7f290461b700 1 --2- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f28fc1300a0 0x7f28fc11da40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.943+0000 7f290461b700 1 --2- 172.21.15.154:0/2800767310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28fc1309f0 0x7f28fc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:04.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.943+0000 7f290461b700 1 -- 172.21.15.154:0/2800767310 >> 172.21.15.154:0/2800767310 conn(0x7f28fc099c40 msgr2=0x7f28fc0a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:04.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.943+0000 7f290461b700 1 -- 172.21.15.154:0/2800767310 shutdown_connections 2023-09-30T22:27:04.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:04.943+0000 7f290461b700 1 -- 172.21.15.154:0/2800767310 wait complete. 2023-09-30T22:27:04.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:05.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.762+0000 7f747e47f700 1 Processor -- start 2023-09-30T22:27:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.762+0000 7f747e47f700 1 -- start start 2023-09-30T22:27:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747e47f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74780a0a70 0x7f74780a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747e47f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f747813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747e47f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747809dc00 con 0x7f74780a1380 2023-09-30T22:27:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747e47f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747809ea90 con 0x7f74780a0a70 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747e47f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f747809dec0 con 0x7f7478134120 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747ca1c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f747813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f7477fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74780a0a70 0x7f74780a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747ca1c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f747813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33370/0 (socket says 172.21.15.154:33370) 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f7477fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74780a0a70 0x7f74780a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42232/0 (socket says 172.21.15.154:42232) 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747ca1c700 1 -- 172.21.15.154:0/4064795994 learned_addr learned my addr 172.21.15.154:0/4064795994 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747ca1c700 1 -- 172.21.15.154:0/4064795994 >> v2:172.21.15.154:3300/0 conn(0x7f74780a0a70 msgr2=0x7f74780a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747ca1c700 1 --2- 172.21.15.154:0/4064795994 >> v2:172.21.15.154:3300/0 conn(0x7f74780a0a70 0x7f74780a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747ca1c700 1 -- 172.21.15.154:0/4064795994 >> v1:172.21.15.154:6789/0 conn(0x7f74780a1380 legacy=0x7f7478133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747ca1c700 1 -- 172.21.15.154:0/4064795994 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747809e6a0 con 0x7f7478134120 2023-09-30T22:27:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f7477fff700 1 --2- 172.21.15.154:0/4064795994 >> v2:172.21.15.154:3300/0 conn(0x7f74780a0a70 0x7f74780a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f747ca1c700 1 --2- 172.21.15.154:0/4064795994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f747813bce0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7470009e50 tx=0x7f747000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c0420de36043d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f7476ffd700 1 -- 172.21.15.154:0/4064795994 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000e070 con 0x7f7478134120 2023-09-30T22:27:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f7476ffd700 1 -- 172.21.15.154:0/4064795994 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747000b910 con 0x7f7478134120 2023-09-30T22:27:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.763+0000 7f7476ffd700 1 -- 172.21.15.154:0/4064795994 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000bcc0 con 0x7f7478134120 2023-09-30T22:27:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.764+0000 7f747e47f700 1 -- 172.21.15.154:0/4064795994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 msgr2=0x7f747813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.764+0000 7f747e47f700 1 --2- 172.21.15.154:0/4064795994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f747813bce0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7470009e50 tx=0x7f747000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.764+0000 7f747e47f700 1 -- 172.21.15.154:0/4064795994 shutdown_connections 2023-09-30T22:27:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.764+0000 7f747e47f700 1 --2- 172.21.15.154:0/4064795994 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f747813bce0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.764+0000 7f747e47f700 1 --2- 172.21.15.154:0/4064795994 >> v2:172.21.15.154:3300/0 conn(0x7f74780a0a70 0x7f74780a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.764+0000 7f747e47f700 1 -- 172.21.15.154:0/4064795994 >> 172.21.15.154:0/4064795994 conn(0x7f74780a6610 msgr2=0x7f74780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:05.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.764+0000 7f747e47f700 1 -- 172.21.15.154:0/4064795994 shutdown_connections 2023-09-30T22:27:05.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.764+0000 7f747e47f700 1 -- 172.21.15.154:0/4064795994 wait complete. 2023-09-30T22:27:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.765+0000 7f747e47f700 1 Processor -- start 2023-09-30T22:27:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.765+0000 7f747e47f700 1 -- start start 2023-09-30T22:27:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.765+0000 7f747e47f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74780a0a70 0x7f7478122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.765+0000 7f747e47f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74780a1380 0x7f7478122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.765+0000 7f747e47f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f7478123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.765+0000 7f747e47f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7478133850 con 0x7f74780a1380 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.765+0000 7f747e47f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7478133a80 con 0x7f74780a0a70 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.765+0000 7f747e47f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74781260d0 con 0x7f7478134120 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f74777fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74780a1380 0x7f7478122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f7477fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74780a0a70 0x7f7478122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f747ca1c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f7478123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f74777fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74780a1380 0x7f7478122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42240/0 (socket says 172.21.15.154:42240) 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f747ca1c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f7478123390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33380/0 (socket says 172.21.15.154:33380) 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f74777fe700 1 -- 172.21.15.154:0/507586591 learned_addr learned my addr 172.21.15.154:0/507586591 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f7477fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74780a0a70 0x7f7478122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60908/0 (socket says 172.21.15.154:60908) 2023-09-30T22:27:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f74777fe700 1 -- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 msgr2=0x7f7478123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f74777fe700 1 --2- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f7478123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f74777fe700 1 -- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74780a0a70 msgr2=0x7f7478122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f74777fe700 1 --2- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74780a0a70 0x7f7478122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f74777fe700 1 -- 172.21.15.154:0/507586591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0094a0 con 0x7f74780a1380 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f747ca1c700 1 --2- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f7478123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f7477fff700 1 --2- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74780a0a70 0x7f7478122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f74777fe700 1 --2- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74780a1380 0x7f7478122e50 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f746800c510 tx=0x7f746800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f7474ff9700 1 -- 172.21.15.154:0/507586591 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74680052d0 con 0x7f74780a1380 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f7474ff9700 1 -- 172.21.15.154:0/507586591 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7468005430 con 0x7f74780a1380 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f747e47f700 1 -- 172.21.15.154:0/507586591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7470009b30 con 0x7f74780a1380 2023-09-30T22:27:05.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f7474ff9700 1 -- 172.21.15.154:0/507586591 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74680038c0 con 0x7f74780a1380 2023-09-30T22:27:05.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.766+0000 7f747e47f700 1 -- 172.21.15.154:0/507586591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7478125e10 con 0x7f74780a1380 2023-09-30T22:27:05.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.767+0000 7f7474ff9700 1 -- 172.21.15.154:0/507586591 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7468003a20 con 0x7f74780a1380 2023-09-30T22:27:05.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.767+0000 7f7474ff9700 1 -- 172.21.15.154:0/507586591 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f746803ea40 con 0x7f74780a1380 2023-09-30T22:27:05.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.767+0000 7f747e47f700 1 -- 172.21.15.154:0/507586591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747804f2a0 con 0x7f74780a1380 2023-09-30T22:27:05.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.772+0000 7f7474ff9700 1 -- 172.21.15.154:0/507586591 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7468017080 con 0x7f74780a1380 2023-09-30T22:27:05.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:05.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:05.956 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:05.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.973+0000 7f747e47f700 1 -- 172.21.15.154:0/507586591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7478126ba0 con 0x7f74780a1380 2023-09-30T22:27:05.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.974+0000 7f7474ff9700 1 -- 172.21.15.154:0/507586591 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7468019c50 con 0x7f74780a1380 2023-09-30T22:27:05.975 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.976+0000 7f747e47f700 1 -- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74780a1380 msgr2=0x7f7478122e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.976+0000 7f747e47f700 1 --2- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74780a1380 0x7f7478122e50 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f746800c510 tx=0x7f746800c820 comp rx=0 tx=0).stop 2023-09-30T22:27:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.976+0000 7f747e47f700 1 -- 172.21.15.154:0/507586591 shutdown_connections 2023-09-30T22:27:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.976+0000 7f747e47f700 1 --2- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7478134120 0x7f7478123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.976+0000 7f747e47f700 1 --2- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74780a0a70 0x7f7478122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.976+0000 7f747e47f700 1 --2- 172.21.15.154:0/507586591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74780a1380 0x7f7478122e50 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:05.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.976+0000 7f747e47f700 1 -- 172.21.15.154:0/507586591 >> 172.21.15.154:0/507586591 conn(0x7f74780a6610 msgr2=0x7f747809ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:05.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.976+0000 7f747e47f700 1 -- 172.21.15.154:0/507586591 shutdown_connections 2023-09-30T22:27:05.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.976+0000 7f747e47f700 1 -- 172.21.15.154:0/507586591 wait complete. 2023-09-30T22:27:05.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:05.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.998+0000 7f536bf05700 1 Processor -- start 2023-09-30T22:27:05.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.998+0000 7f536bf05700 1 -- start start 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f536bf05700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5364133a70 0x7f5364133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f536bf05700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53640a08e0 0x7f53640a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f536bf05700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5364133640 con 0x7f53640a1290 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f536bf05700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53640a1d50 con 0x7f53640a08e0 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f536bf05700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f536409b620 con 0x7f5364133a70 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f53694a0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53640a08e0 0x7f53640a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f53694a0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53640a08e0 0x7f53640a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42242/0 (socket says 172.21.15.154:42242) 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f53694a0700 1 -- 172.21.15.154:0/1288071373 learned_addr learned my addr 172.21.15.154:0/1288071373 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f5369ca1700 1 --2- 172.21.15.154:0/1288071373 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5364133a70 0x7f5364133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f53694a0700 1 -- 172.21.15.154:0/1288071373 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5364133a70 msgr2=0x7f5364133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:06.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f53694a0700 1 --2- 172.21.15.154:0/1288071373 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5364133a70 0x7f5364133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f53694a0700 1 -- 172.21.15.154:0/1288071373 >> v1:172.21.15.154:6789/0 conn(0x7f53640a1290 legacy=0x7f536413a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f53694a0700 1 -- 172.21.15.154:0/1288071373 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5364133870 con 0x7f53640a08e0 2023-09-30T22:27:06.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:05.999+0000 7f5369ca1700 1 --2- 172.21.15.154:0/1288071373 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5364133a70 0x7f5364133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:06.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.000+0000 7f53694a0700 1 --2- 172.21.15.154:0/1288071373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53640a08e0 0x7f53640a0d50 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f53540098f0 tx=0x7f5354009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac408f2ad42708b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.000+0000 7f5368c9f700 1 -- 172.21.15.154:0/1288071373 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354011830 con 0x7f53640a08e0 2023-09-30T22:27:06.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.000+0000 7f5368c9f700 1 -- 172.21.15.154:0/1288071373 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5354011990 con 0x7f53640a08e0 2023-09-30T22:27:06.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.000+0000 7f5368c9f700 1 -- 172.21.15.154:0/1288071373 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354011d20 con 0x7f53640a08e0 2023-09-30T22:27:06.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.000+0000 7f536bf05700 1 -- 172.21.15.154:0/1288071373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53640a08e0 msgr2=0x7f53640a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.000+0000 7f536bf05700 1 --2- 172.21.15.154:0/1288071373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53640a08e0 0x7f53640a0d50 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f53540098f0 tx=0x7f5354009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.001+0000 7f536bf05700 1 -- 172.21.15.154:0/1288071373 shutdown_connections 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.001+0000 7f536bf05700 1 --2- 172.21.15.154:0/1288071373 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5364133a70 0x7f5364133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.001+0000 7f536bf05700 1 --2- 172.21.15.154:0/1288071373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53640a08e0 0x7f53640a0d50 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.001+0000 7f536bf05700 1 -- 172.21.15.154:0/1288071373 >> 172.21.15.154:0/1288071373 conn(0x7f53640a2980 msgr2=0x7f53640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.001+0000 7f536bf05700 1 -- 172.21.15.154:0/1288071373 shutdown_connections 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.001+0000 7f536bf05700 1 -- 172.21.15.154:0/1288071373 wait complete. 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.002+0000 7f536bf05700 1 Processor -- start 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.002+0000 7f536bf05700 1 -- start start 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.002+0000 7f536bf05700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53640a08e0 0x7f536411fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f536bf05700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53640a1290 0x7f5364120100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f536bf05700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5364133a70 0x7f5364120640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f536bf05700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53641234e0 con 0x7f5364133a70 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f536bf05700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53641217d0 con 0x7f53640a08e0 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f536bf05700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f536409a350 con 0x7f53640a1290 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f53694a0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53640a1290 0x7f5364120100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f53694a0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53640a1290 0x7f5364120100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33402/0 (socket says 172.21.15.154:33402) 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f53694a0700 1 -- 172.21.15.154:0/3208781403 learned_addr learned my addr 172.21.15.154:0/3208781403 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f536a4a2700 1 --2- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5364133a70 0x7f5364120640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f5369ca1700 1 --2- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53640a08e0 0x7f536411fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f53694a0700 1 -- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53640a08e0 msgr2=0x7f536411fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f53694a0700 1 --2- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53640a08e0 0x7f536411fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f53694a0700 1 -- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5364133a70 msgr2=0x7f5364120640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f53694a0700 1 --2- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5364133a70 0x7f5364120640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f53694a0700 1 -- 172.21.15.154:0/3208781403 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360009430 con 0x7f53640a1290 2023-09-30T22:27:06.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f53694a0700 1 --2- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53640a1290 0x7f5364120100 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5354000c00 tx=0x7f5354004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f535a7fc700 1 -- 172.21.15.154:0/3208781403 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53540036a0 con 0x7f53640a1290 2023-09-30T22:27:06.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f535a7fc700 1 -- 172.21.15.154:0/3208781403 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5354003800 con 0x7f53640a1290 2023-09-30T22:27:06.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f536bf05700 1 -- 172.21.15.154:0/3208781403 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5354009550 con 0x7f53640a1290 2023-09-30T22:27:06.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f535a7fc700 1 -- 172.21.15.154:0/3208781403 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354003bb0 con 0x7f53640a1290 2023-09-30T22:27:06.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.003+0000 7f536bf05700 1 -- 172.21.15.154:0/3208781403 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5364123e70 con 0x7f53640a1290 2023-09-30T22:27:06.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.004+0000 7f536bf05700 1 -- 172.21.15.154:0/3208781403 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5364123320 con 0x7f53640a1290 2023-09-30T22:27:06.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.005+0000 7f535a7fc700 1 -- 172.21.15.154:0/3208781403 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5354021070 con 0x7f53640a1290 2023-09-30T22:27:06.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.005+0000 7f535a7fc700 1 -- 172.21.15.154:0/3208781403 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5354040c80 con 0x7f53640a1290 2023-09-30T22:27:06.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.009+0000 7f535a7fc700 1 -- 172.21.15.154:0/3208781403 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f535402d3a0 con 0x7f53640a1290 2023-09-30T22:27:06.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.041+0000 7f147369e700 1 Processor -- start 2023-09-30T22:27:06.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.041+0000 7f147369e700 1 -- start start 2023-09-30T22:27:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.042+0000 7f147369e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 0x7f146c138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.042+0000 7f147369e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f146c09f370 0x7f146c13b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.042+0000 7f147369e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c09af80 con 0x7f146c09a150 2023-09-30T22:27:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.042+0000 7f147369e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c09fe00 con 0x7f146c09f370 2023-09-30T22:27:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.042+0000 7f147369e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c06bec0 con 0x7f146c09ef80 2023-09-30T22:27:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.042+0000 7f1470c39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 0x7f146c138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.042+0000 7f1470c39700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 0x7f146c138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60922/0 (socket says 172.21.15.154:60922) 2023-09-30T22:27:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.042+0000 7f1470c39700 1 -- 172.21.15.154:0/734497595 learned_addr learned my addr 172.21.15.154:0/734497595 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.042+0000 7f1471c3b700 1 --2- 172.21.15.154:0/734497595 >> v2:172.21.15.154:3300/0 conn(0x7f146c09f370 0x7f146c13b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.043+0000 7f1470c39700 1 -- 172.21.15.154:0/734497595 >> v2:172.21.15.154:3300/0 conn(0x7f146c09f370 msgr2=0x7f146c13b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:06.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.043+0000 7f1470c39700 1 --2- 172.21.15.154:0/734497595 >> v2:172.21.15.154:3300/0 conn(0x7f146c09f370 0x7f146c13b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.043+0000 7f1470c39700 1 -- 172.21.15.154:0/734497595 >> v1:172.21.15.154:6789/0 conn(0x7f146c09a150 legacy=0x7f146c09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.043+0000 7f1470c39700 1 -- 172.21.15.154:0/734497595 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c06bc20 con 0x7f146c09ef80 2023-09-30T22:27:06.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.043+0000 7f1470c39700 1 --2- 172.21.15.154:0/734497595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 0x7f146c138e60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f145c0098f0 tx=0x7f145c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ad19605c05c35f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.043+0000 7f1463fff700 1 -- 172.21.15.154:0/734497595 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c011830 con 0x7f146c09ef80 2023-09-30T22:27:06.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.043+0000 7f1463fff700 1 -- 172.21.15.154:0/734497595 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c011990 con 0x7f146c09ef80 2023-09-30T22:27:06.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.043+0000 7f1463fff700 1 -- 172.21.15.154:0/734497595 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c011d20 con 0x7f146c09ef80 2023-09-30T22:27:06.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.044+0000 7f147369e700 1 -- 172.21.15.154:0/734497595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 msgr2=0x7f146c138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.044+0000 7f147369e700 1 --2- 172.21.15.154:0/734497595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 0x7f146c138e60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f145c0098f0 tx=0x7f145c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:06.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.044+0000 7f147369e700 1 -- 172.21.15.154:0/734497595 shutdown_connections 2023-09-30T22:27:06.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.044+0000 7f147369e700 1 --2- 172.21.15.154:0/734497595 >> v2:172.21.15.154:3300/0 conn(0x7f146c09f370 0x7f146c13b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.044+0000 7f147369e700 1 --2- 172.21.15.154:0/734497595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 0x7f146c138e60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.044+0000 7f147369e700 1 -- 172.21.15.154:0/734497595 >> 172.21.15.154:0/734497595 conn(0x7f146c0a4430 msgr2=0x7f146c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.044+0000 7f147369e700 1 -- 172.21.15.154:0/734497595 shutdown_connections 2023-09-30T22:27:06.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.044+0000 7f147369e700 1 -- 172.21.15.154:0/734497595 wait complete. 2023-09-30T22:27:06.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147369e700 1 Processor -- start 2023-09-30T22:27:06.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147369e700 1 -- start start 2023-09-30T22:27:06.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147369e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f146c09a150 0x7f146c1394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147369e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 0x7f146c139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147369e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f146c09f370 0x7f146c139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147369e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c13b730 con 0x7f146c09f370 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147369e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c09ba00 con 0x7f146c09ef80 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147369e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f146c11f980 con 0x7f146c09a150 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147143a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f146c09a150 0x7f146c1394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147143a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f146c09a150 0x7f146c1394f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33416/0 (socket says 172.21.15.154:33416) 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.045+0000 7f147143a700 1 -- 172.21.15.154:0/832837322 learned_addr learned my addr 172.21.15.154:0/832837322 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f147143a700 1 -- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 msgr2=0x7f146c139a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f147143a700 1 --2- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 0x7f146c139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f147143a700 1 -- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f146c09f370 msgr2=0x7f146c139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f147143a700 1 --2- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f146c09f370 0x7f146c139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f147143a700 1 -- 172.21.15.154:0/832837322 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c009550 con 0x7f146c09a150 2023-09-30T22:27:06.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f147143a700 1 --2- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f146c09a150 0x7f146c1394f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f146800c480 tx=0x7f146800c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f1461ffb700 1 -- 172.21.15.154:0/832837322 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680052d0 con 0x7f146c09a150 2023-09-30T22:27:06.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f1461ffb700 1 -- 172.21.15.154:0/832837322 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468005430 con 0x7f146c09a150 2023-09-30T22:27:06.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f1461ffb700 1 -- 172.21.15.154:0/832837322 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680038c0 con 0x7f146c09a150 2023-09-30T22:27:06.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.046+0000 7f147369e700 1 -- 172.21.15.154:0/832837322 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c11ff10 con 0x7f146c09a150 2023-09-30T22:27:06.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.047+0000 7f147369e700 1 -- 172.21.15.154:0/832837322 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c120980 con 0x7f146c09a150 2023-09-30T22:27:06.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.047+0000 7f1461ffb700 1 -- 172.21.15.154:0/832837322 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1468003a20 con 0x7f146c09a150 2023-09-30T22:27:06.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.048+0000 7f147369e700 1 -- 172.21.15.154:0/832837322 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146c09fa30 con 0x7f146c09a150 2023-09-30T22:27:06.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.048+0000 7f1461ffb700 1 -- 172.21.15.154:0/832837322 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f146803eaa0 con 0x7f146c09a150 2023-09-30T22:27:06.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.053+0000 7f1461ffb700 1 -- 172.21.15.154:0/832837322 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1468018260 con 0x7f146c09a150 2023-09-30T22:27:06.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd8d951700 1 Processor -- start 2023-09-30T22:27:06.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd8d951700 1 -- start start 2023-09-30T22:27:06.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd8d951700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806a770 0x7fbd8806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd8d951700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd88131ec0 0x7fbd88139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd8d951700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd8809da80 con 0x7fbd8806b080 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd8d951700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8809dce0 con 0x7fbd88131ec0 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd8d951700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8809eb20 con 0x7fbd8806a770 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd867fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbd8806b080 0x7fbd881317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41258/0 (socket says 172.21.15.154:41258) 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd86ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806a770 0x7fbd8806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd867fc700 1 -- 172.21.15.154:0/3495393760 learned_addr learned my addr 172.21.15.154:0/3495393760 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd877fe700 1 --2- 172.21.15.154:0/3495393760 >> v2:172.21.15.154:3300/0 conn(0x7fbd88131ec0 0x7fbd88139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.088+0000 7fbd85ffb700 1 -- 172.21.15.154:0/3495393760 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742923089 0 0) 0x7fbd8809da80 con 0x7fbd8806b080 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd85ffb700 1 -- 172.21.15.154:0/3495393760 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd700035b0 con 0x7fbd8806b080 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd877fe700 1 -- 172.21.15.154:0/3495393760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806a770 msgr2=0x7fbd8806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:06.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd877fe700 1 --2- 172.21.15.154:0/3495393760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806a770 0x7fbd8806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd877fe700 1 -- 172.21.15.154:0/3495393760 >> v1:172.21.15.154:6789/0 conn(0x7fbd8806b080 legacy=0x7fbd881317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd877fe700 1 -- 172.21.15.154:0/3495393760 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8809d860 con 0x7fbd88131ec0 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd86ffd700 1 --2- 172.21.15.154:0/3495393760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806a770 0x7fbd8806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd877fe700 1 --2- 172.21.15.154:0/3495393760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 0x7fbd88139c20 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009d90 tx=0x7fbd8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97df5022ac917a72 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd85ffb700 1 -- 172.21.15.154:0/3495393760 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000e070 con 0x7fbd88131ec0 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd85ffb700 1 -- 172.21.15.154:0/3495393760 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8000bb20 con 0x7fbd88131ec0 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.089+0000 7fbd85ffb700 1 -- 172.21.15.154:0/3495393760 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000be90 con 0x7fbd88131ec0 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.090+0000 7fbd8d951700 1 -- 172.21.15.154:0/3495393760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 msgr2=0x7fbd88139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.090+0000 7fbd8d951700 1 --2- 172.21.15.154:0/3495393760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 0x7fbd88139c20 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009d90 tx=0x7fbd8000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.090+0000 7fbd8d951700 1 -- 172.21.15.154:0/3495393760 shutdown_connections 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.090+0000 7fbd8d951700 1 --2- 172.21.15.154:0/3495393760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 0x7fbd88139c20 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.090+0000 7fbd8d951700 1 --2- 172.21.15.154:0/3495393760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806a770 0x7fbd8806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.090+0000 7fbd8d951700 1 -- 172.21.15.154:0/3495393760 >> 172.21.15.154:0/3495393760 conn(0x7fbd88099c40 msgr2=0x7fbd880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.090+0000 7fbd8d951700 1 -- 172.21.15.154:0/3495393760 shutdown_connections 2023-09-30T22:27:06.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.090+0000 7fbd8d951700 1 -- 172.21.15.154:0/3495393760 wait complete. 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd8d951700 1 Processor -- start 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd8d951700 1 -- start start 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd8d951700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8806a770 0x7fbd881c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd8d951700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806b080 0x7fbd881c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd8d951700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 0x7fbd881c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd8d951700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd88130850 con 0x7fbd88131ec0 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd8d951700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8811f0e0 con 0x7fbd8806b080 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd8d951700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd88130600 con 0x7fbd8806a770 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd867fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806b080 0x7fbd881c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.091+0000 7fbd867fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806b080 0x7fbd881c6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60956/0 (socket says 172.21.15.154:60956) 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd867fc700 1 -- 172.21.15.154:0/431402327 learned_addr learned my addr 172.21.15.154:0/431402327 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd877fe700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 0x7fbd881c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd86ffd700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8806a770 0x7fbd881c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd867fc700 1 -- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8806a770 msgr2=0x7fbd881c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd867fc700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8806a770 0x7fbd881c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd867fc700 1 -- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 msgr2=0x7fbd881c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd867fc700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 0x7fbd881c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd867fc700 1 -- 172.21.15.154:0/431402327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd780094a0 con 0x7fbd8806b080 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd877fe700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 0x7fbd881c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd867fc700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806b080 0x7fbd881c6340 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c005910 tx=0x7fbd7c00c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd6ffff700 1 -- 172.21.15.154:0/431402327 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c005d70 con 0x7fbd8806b080 2023-09-30T22:27:06.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd6ffff700 1 -- 172.21.15.154:0/431402327 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7c0070d0 con 0x7fbd8806b080 2023-09-30T22:27:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd8d951700 1 -- 172.21.15.154:0/431402327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd80009a70 con 0x7fbd8806b080 2023-09-30T22:27:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd6ffff700 1 -- 172.21.15.154:0/431402327 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c007460 con 0x7fbd8806b080 2023-09-30T22:27:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.092+0000 7fbd8d951700 1 -- 172.21.15.154:0/431402327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8811fb50 con 0x7fbd8806b080 2023-09-30T22:27:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.093+0000 7fbd8d951700 1 -- 172.21.15.154:0/431402327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8804f2a0 con 0x7fbd8806b080 2023-09-30T22:27:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.094+0000 7fbd6ffff700 1 -- 172.21.15.154:0/431402327 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd7c0075c0 con 0x7fbd8806b080 2023-09-30T22:27:06.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.094+0000 7fbd6ffff700 1 -- 172.21.15.154:0/431402327 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbd7c03ef70 con 0x7fbd8806b080 2023-09-30T22:27:06.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.098+0000 7fbd6ffff700 1 -- 172.21.15.154:0/431402327 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd7c01bb10 con 0x7fbd8806b080 2023-09-30T22:27:06.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.208+0000 7f536bf05700 1 -- 172.21.15.154:0/3208781403 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f536404f2a0 con 0x7f53640a1290 2023-09-30T22:27:06.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.208+0000 7f535a7fc700 1 -- 172.21.15.154:0/3208781403 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5354015020 con 0x7f53640a1290 2023-09-30T22:27:06.209 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:06.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.210+0000 7f536bf05700 1 -- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53640a1290 msgr2=0x7f5364120100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.210+0000 7f536bf05700 1 --2- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53640a1290 0x7f5364120100 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5354000c00 tx=0x7f5354004750 comp rx=0 tx=0).stop 2023-09-30T22:27:06.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.210+0000 7f536bf05700 1 -- 172.21.15.154:0/3208781403 shutdown_connections 2023-09-30T22:27:06.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.210+0000 7f536bf05700 1 --2- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5364133a70 0x7f5364120640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.210+0000 7f536bf05700 1 --2- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53640a08e0 0x7f536411fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.210+0000 7f536bf05700 1 --2- 172.21.15.154:0/3208781403 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53640a1290 0x7f5364120100 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.210+0000 7f536bf05700 1 -- 172.21.15.154:0/3208781403 >> 172.21.15.154:0/3208781403 conn(0x7f53640a2980 msgr2=0x7f536409e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.210+0000 7f536bf05700 1 -- 172.21.15.154:0/3208781403 shutdown_connections 2023-09-30T22:27:06.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.210+0000 7f536bf05700 1 -- 172.21.15.154:0/3208781403 wait complete. 2023-09-30T22:27:06.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:06.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.249+0000 7f147369e700 1 -- 172.21.15.154:0/832837322 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f146c11fb50 con 0x7f146c09a150 2023-09-30T22:27:06.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.249+0000 7f1461ffb700 1 -- 172.21.15.154:0/832837322 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1468017070 con 0x7f146c09a150 2023-09-30T22:27:06.250 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.252+0000 7f147369e700 1 -- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f146c09a150 msgr2=0x7f146c1394f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.252+0000 7f147369e700 1 --2- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f146c09a150 0x7f146c1394f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f146800c480 tx=0x7f146800c840 comp rx=0 tx=0).stop 2023-09-30T22:27:06.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.252+0000 7f147369e700 1 -- 172.21.15.154:0/832837322 shutdown_connections 2023-09-30T22:27:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.252+0000 7f147369e700 1 --2- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f146c09f370 0x7f146c139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.252+0000 7f147369e700 1 --2- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f146c09a150 0x7f146c1394f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.252+0000 7f147369e700 1 --2- 172.21.15.154:0/832837322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f146c09ef80 0x7f146c139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.252+0000 7f147369e700 1 -- 172.21.15.154:0/832837322 >> 172.21.15.154:0/832837322 conn(0x7f146c0a4430 msgr2=0x7f146c09c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.252+0000 7f147369e700 1 -- 172.21.15.154:0/832837322 shutdown_connections 2023-09-30T22:27:06.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.252+0000 7f147369e700 1 -- 172.21.15.154:0/832837322 wait complete. 2023-09-30T22:27:06.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.302+0000 7fbd8d951700 1 -- 172.21.15.154:0/431402327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd8811f300 con 0x7fbd8806b080 2023-09-30T22:27:06.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.302+0000 7fbd6ffff700 1 -- 172.21.15.154:0/431402327 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd7c0192c0 con 0x7fbd8806b080 2023-09-30T22:27:06.303 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:06.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.304+0000 7fbd8d951700 1 -- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806b080 msgr2=0x7fbd881c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.304+0000 7fbd8d951700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806b080 0x7fbd881c6340 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c005910 tx=0x7fbd7c00c9e0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.304+0000 7fbd8d951700 1 -- 172.21.15.154:0/431402327 shutdown_connections 2023-09-30T22:27:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.304+0000 7fbd8d951700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd88131ec0 0x7fbd881c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.304+0000 7fbd8d951700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd8806a770 0x7fbd881c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.304+0000 7fbd8d951700 1 --2- 172.21.15.154:0/431402327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd8806b080 0x7fbd881c6340 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.304+0000 7fbd8d951700 1 -- 172.21.15.154:0/431402327 >> 172.21.15.154:0/431402327 conn(0x7fbd88099c40 msgr2=0x7fbd881b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.305+0000 7fbd8d951700 1 -- 172.21.15.154:0/431402327 shutdown_connections 2023-09-30T22:27:06.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:06.305+0000 7fbd8d951700 1 -- 172.21.15.154:0/431402327 wait complete. 2023-09-30T22:27:06.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:06.993 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:07.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.117+0000 7f0713f72700 1 Processor -- start 2023-09-30T22:27:07.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.117+0000 7f0713f72700 1 -- start start 2023-09-30T22:27:07.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f0713f72700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a0a70 0x7f070c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f0713f72700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a1380 0x7f070c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f0713f72700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070c09dc00 con 0x7f070c133f50 2023-09-30T22:27:07.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f0713f72700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070c09ea60 con 0x7f070c0a0a70 2023-09-30T22:27:07.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f0713f72700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f070c09dec0 con 0x7f070c0a1380 2023-09-30T22:27:07.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f071150d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a1380 0x7f070c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f0711d0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a0a70 0x7f070c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f071250f700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f070c133f50 0x7f070c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41266/0 (socket says 172.21.15.154:41266) 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f071250f700 1 -- 172.21.15.154:0/2292248319 learned_addr learned my addr 172.21.15.154:0/2292248319 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f071150d700 1 -- 172.21.15.154:0/2292248319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a0a70 msgr2=0x7f070c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f071150d700 1 --2- 172.21.15.154:0/2292248319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a0a70 0x7f070c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f071150d700 1 -- 172.21.15.154:0/2292248319 >> v1:172.21.15.154:6789/0 conn(0x7f070c133f50 legacy=0x7f070c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f071150d700 1 -- 172.21.15.154:0/2292248319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c09e6a0 con 0x7f070c0a1380 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f0710d0c700 1 -- 172.21.15.154:0/2292248319 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383953928 0 0) 0x7f070c09dc00 con 0x7f070c133f50 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.118+0000 7f0711d0e700 1 --2- 172.21.15.154:0/2292248319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a0a70 0x7f070c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f071150d700 1 --2- 172.21.15.154:0/2292248319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a1380 0x7f070c133a10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0708009870 tx=0x7f0708009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b251018cff385ddb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0710d0c700 1 -- 172.21.15.154:0/2292248319 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708011830 con 0x7f070c0a1380 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0710d0c700 1 -- 172.21.15.154:0/2292248319 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0708011990 con 0x7f070c0a1380 2023-09-30T22:27:07.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0710d0c700 1 -- 172.21.15.154:0/2292248319 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708011d20 con 0x7f070c0a1380 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0713f72700 1 -- 172.21.15.154:0/2292248319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a1380 msgr2=0x7f070c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0713f72700 1 --2- 172.21.15.154:0/2292248319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a1380 0x7f070c133a10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0708009870 tx=0x7f0708009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0713f72700 1 -- 172.21.15.154:0/2292248319 shutdown_connections 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0713f72700 1 --2- 172.21.15.154:0/2292248319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a0a70 0x7f070c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0713f72700 1 --2- 172.21.15.154:0/2292248319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a1380 0x7f070c133a10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0713f72700 1 -- 172.21.15.154:0/2292248319 >> 172.21.15.154:0/2292248319 conn(0x7f070c0a6610 msgr2=0x7f070c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0713f72700 1 -- 172.21.15.154:0/2292248319 shutdown_connections 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.119+0000 7f0713f72700 1 -- 172.21.15.154:0/2292248319 wait complete. 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.120+0000 7f0713f72700 1 Processor -- start 2023-09-30T22:27:07.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.120+0000 7f0713f72700 1 -- start start 2023-09-30T22:27:07.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0713f72700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a0a70 0x7f070c122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0713f72700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a1380 0x7f070c122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0713f72700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f070c133f50 0x7f070c123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0713f72700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070c126110 con 0x7f070c133f50 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0713f72700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070c123cf0 con 0x7f070c0a1380 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0713f72700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f070c126360 con 0x7f070c0a0a70 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0711d0e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a0a70 0x7f070c122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f071150d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a1380 0x7f070c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0711d0e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a0a70 0x7f070c122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33456/0 (socket says 172.21.15.154:33456) 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0711d0e700 1 -- 172.21.15.154:0/777823609 learned_addr learned my addr 172.21.15.154:0/777823609 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f071250f700 1 --2- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f070c133f50 0x7f070c123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f071150d700 1 -- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a0a70 msgr2=0x7f070c122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f071150d700 1 --2- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a0a70 0x7f070c122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f071150d700 1 -- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f070c133f50 msgr2=0x7f070c123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f071150d700 1 --2- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f070c133f50 0x7f070c123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f071150d700 1 -- 172.21.15.154:0/777823609 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0094a0 con 0x7f070c0a1380 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0711d0e700 1 --2- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a0a70 0x7f070c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f071150d700 1 --2- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a1380 0x7f070c122dd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0708016000 tx=0x7f0708004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f07027fc700 1 -- 172.21.15.154:0/777823609 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708004510 con 0x7f070c0a1380 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f07027fc700 1 -- 172.21.15.154:0/777823609 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070801f070 con 0x7f070c0a1380 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f0713f72700 1 -- 172.21.15.154:0/777823609 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07080094a0 con 0x7f070c0a1380 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.121+0000 7f07027fc700 1 -- 172.21.15.154:0/777823609 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07080038e0 con 0x7f070c0a1380 2023-09-30T22:27:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.122+0000 7f0713f72700 1 -- 172.21.15.154:0/777823609 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070c0a03e0 con 0x7f070c0a1380 2023-09-30T22:27:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.122+0000 7f07027fc700 1 -- 172.21.15.154:0/777823609 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0708003a40 con 0x7f070c0a1380 2023-09-30T22:27:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.122+0000 7f07027fc700 1 -- 172.21.15.154:0/777823609 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0708021070 con 0x7f070c0a1380 2023-09-30T22:27:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.122+0000 7f0713f72700 1 -- 172.21.15.154:0/777823609 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070c04f2a0 con 0x7f070c0a1380 2023-09-30T22:27:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.127+0000 7f07027fc700 1 -- 172.21.15.154:0/777823609 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f070802b080 con 0x7f070c0a1380 2023-09-30T22:27:07.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:07.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:07.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:07.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.325+0000 7f0713f72700 1 -- 172.21.15.154:0/777823609 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f070c133360 con 0x7f070c0a1380 2023-09-30T22:27:07.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.325+0000 7f07027fc700 1 -- 172.21.15.154:0/777823609 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0708015020 con 0x7f070c0a1380 2023-09-30T22:27:07.326 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.328+0000 7f0713f72700 1 -- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a1380 msgr2=0x7f070c122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.328+0000 7f0713f72700 1 --2- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a1380 0x7f070c122dd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0708016000 tx=0x7f0708004750 comp rx=0 tx=0).stop 2023-09-30T22:27:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.328+0000 7f0713f72700 1 -- 172.21.15.154:0/777823609 shutdown_connections 2023-09-30T22:27:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.328+0000 7f0713f72700 1 --2- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f070c133f50 0x7f070c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.328+0000 7f0713f72700 1 --2- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f070c0a0a70 0x7f070c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.328+0000 7f0713f72700 1 --2- 172.21.15.154:0/777823609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f070c0a1380 0x7f070c122dd0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.328+0000 7f0713f72700 1 -- 172.21.15.154:0/777823609 >> 172.21.15.154:0/777823609 conn(0x7f070c0a6610 msgr2=0x7f070c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.328+0000 7f0713f72700 1 -- 172.21.15.154:0/777823609 shutdown_connections 2023-09-30T22:27:07.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.328+0000 7f0713f72700 1 -- 172.21.15.154:0/777823609 wait complete. 2023-09-30T22:27:07.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:07.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.354+0000 7fabeac16700 1 Processor -- start 2023-09-30T22:27:07.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.354+0000 7fabeac16700 1 -- start start 2023-09-30T22:27:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabeac16700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409e340 0x7fabe41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabeac16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4135f20 0x7fabe4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabeac16700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe409aaa0 con 0x7fabe409d860 2023-09-30T22:27:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabeac16700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe409e730 con 0x7fabe4135f20 2023-09-30T22:27:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabeac16700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabe409f870 con 0x7fabe409e340 2023-09-30T22:27:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409e340 0x7fabe41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe91b3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4135f20 0x7fabe4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409e340 0x7fabe41359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33464/0 (socket says 172.21.15.154:33464) 2023-09-30T22:27:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe3fff700 1 -- 172.21.15.154:0/302812840 learned_addr learned my addr 172.21.15.154:0/302812840 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe91b3700 1 -- 172.21.15.154:0/302812840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409e340 msgr2=0x7fabe41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe91b3700 1 --2- 172.21.15.154:0/302812840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409e340 0x7fabe41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe91b3700 1 -- 172.21.15.154:0/302812840 >> v1:172.21.15.154:6789/0 conn(0x7fabe409d860 legacy=0x7fabe409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe91b3700 1 -- 172.21.15.154:0/302812840 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe409b360 con 0x7fabe4135f20 2023-09-30T22:27:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe37fe700 1 -- 172.21.15.154:0/302812840 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815063790 0 0) 0x7fabe409aaa0 con 0x7fabe409d860 2023-09-30T22:27:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.355+0000 7fabe3fff700 1 --2- 172.21.15.154:0/302812840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409e340 0x7fabe41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabe91b3700 1 --2- 172.21.15.154:0/302812840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4135f20 0x7fabe4138300 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00f3a0 tx=0x7fabdc00f6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25c2c1dd9381d19 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabe37fe700 1 -- 172.21.15.154:0/302812840 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc012070 con 0x7fabe4135f20 2023-09-30T22:27:07.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabe37fe700 1 -- 172.21.15.154:0/302812840 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc00d0d0 con 0x7fabe4135f20 2023-09-30T22:27:07.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabe37fe700 1 -- 172.21.15.154:0/302812840 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00fea0 con 0x7fabe4135f20 2023-09-30T22:27:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabeac16700 1 -- 172.21.15.154:0/302812840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4135f20 msgr2=0x7fabe4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabeac16700 1 --2- 172.21.15.154:0/302812840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4135f20 0x7fabe4138300 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00f3a0 tx=0x7fabdc00f6b0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabeac16700 1 -- 172.21.15.154:0/302812840 shutdown_connections 2023-09-30T22:27:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabeac16700 1 --2- 172.21.15.154:0/302812840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4135f20 0x7fabe4138300 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabeac16700 1 --2- 172.21.15.154:0/302812840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409e340 0x7fabe41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabeac16700 1 -- 172.21.15.154:0/302812840 >> 172.21.15.154:0/302812840 conn(0x7fabe4099c40 msgr2=0x7fabe40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabeac16700 1 -- 172.21.15.154:0/302812840 shutdown_connections 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.356+0000 7fabeac16700 1 -- 172.21.15.154:0/302812840 wait complete. 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.358+0000 7fabeac16700 1 Processor -- start 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.358+0000 7fabeac16700 1 -- start start 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.358+0000 7fabeac16700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409d860 0x7fabe4119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.358+0000 7fabeac16700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe409e340 0x7fabe4119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabeac16700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4135f20 0x7fabe411a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabeac16700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe411aa90 con 0x7fabe4135f20 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabeac16700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe411cb10 con 0x7fabe409e340 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabeac16700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabe411b420 con 0x7fabe409d860 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe409e340 0x7fabe4119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe409e340 0x7fabe4119b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:60990/0 (socket says 172.21.15.154:60990) 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe3fff700 1 -- 172.21.15.154:0/3481997647 learned_addr learned my addr 172.21.15.154:0/3481997647 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe91b3700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4135f20 0x7fabe411a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe89b2700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409d860 0x7fabe4119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe3fff700 1 -- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409d860 msgr2=0x7fabe4119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe3fff700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409d860 0x7fabe4119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe3fff700 1 -- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4135f20 msgr2=0x7fabe411a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe3fff700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4135f20 0x7fabe411a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe3fff700 1 -- 172.21.15.154:0/3481997647 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd0009550 con 0x7fabe409e340 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe91b3700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4135f20 0x7fabe411a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe89b2700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409d860 0x7fabe4119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe3fff700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe409e340 0x7fabe4119b70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fabd000ebe0 tx=0x7fabd000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe17fa700 1 -- 172.21.15.154:0/3481997647 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000c850 con 0x7fabe409e340 2023-09-30T22:27:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe17fa700 1 -- 172.21.15.154:0/3481997647 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd000c9b0 con 0x7fabe409e340 2023-09-30T22:27:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabeac16700 1 -- 172.21.15.154:0/3481997647 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc00f050 con 0x7fabe409e340 2023-09-30T22:27:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.359+0000 7fabe17fa700 1 -- 172.21.15.154:0/3481997647 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd000cd40 con 0x7fabe409e340 2023-09-30T22:27:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.360+0000 7fabeac16700 1 -- 172.21.15.154:0/3481997647 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe411b660 con 0x7fabe409e340 2023-09-30T22:27:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.360+0000 7fabe17fa700 1 -- 172.21.15.154:0/3481997647 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabd0013470 con 0x7fabe409e340 2023-09-30T22:27:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.360+0000 7fabe17fa700 1 -- 172.21.15.154:0/3481997647 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fabd003fc30 con 0x7fabe409e340 2023-09-30T22:27:07.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.361+0000 7fabeac16700 1 -- 172.21.15.154:0/3481997647 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe404f2a0 con 0x7fabe409e340 2023-09-30T22:27:07.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.365+0000 7fabe17fa700 1 -- 172.21.15.154:0/3481997647 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabd001b3b0 con 0x7fabe409e340 2023-09-30T22:27:07.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.400+0000 7f67f8d6b700 1 Processor -- start 2023-09-30T22:27:07.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.400+0000 7f67f8d6b700 1 -- start start 2023-09-30T22:27:07.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f8d6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409e870 0x7f67f409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f8d6b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f67f409f180 0x7f67f4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f8d6b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f409c970 con 0x7f67f4131d70 2023-09-30T22:27:07.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f8d6b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f40a0920 con 0x7f67f409f180 2023-09-30T22:27:07.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f8d6b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67f409f9c0 con 0x7f67f409e870 2023-09-30T22:27:07.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f67f409f180 0x7f67f4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409e870 0x7f67f409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f1d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f67f409f180 0x7f67f4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42312/0 (socket says 172.21.15.154:42312) 2023-09-30T22:27:07.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f1d9b700 1 -- 172.21.15.154:0/46896504 learned_addr learned my addr 172.21.15.154:0/46896504 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:07.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f1d9b700 1 -- 172.21.15.154:0/46896504 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409e870 msgr2=0x7f67f409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.401+0000 7f67f1d9b700 1 --2- 172.21.15.154:0/46896504 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409e870 0x7f67f409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.402+0000 7f67f1d9b700 1 -- 172.21.15.154:0/46896504 >> v1:172.21.15.154:6789/0 conn(0x7f67f4131d70 legacy=0x7f67f4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.402+0000 7f67f1d9b700 1 -- 172.21.15.154:0/46896504 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f409bab0 con 0x7f67f409f180 2023-09-30T22:27:07.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.402+0000 7f67f1d9b700 1 --2- 172.21.15.154:0/46896504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409f180 0x7f67f4131830 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f67e80098f0 tx=0x7f67e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7815d84fe4384fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.402+0000 7f67f159a700 1 -- 172.21.15.154:0/46896504 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8011830 con 0x7f67f409f180 2023-09-30T22:27:07.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.402+0000 7f67f159a700 1 -- 172.21.15.154:0/46896504 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8011990 con 0x7f67f409f180 2023-09-30T22:27:07.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.402+0000 7f67f159a700 1 -- 172.21.15.154:0/46896504 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8011d20 con 0x7f67f409f180 2023-09-30T22:27:07.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.402+0000 7f67f8d6b700 1 -- 172.21.15.154:0/46896504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409f180 msgr2=0x7f67f4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.402+0000 7f67f8d6b700 1 --2- 172.21.15.154:0/46896504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409f180 0x7f67f4131830 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f67e80098f0 tx=0x7f67e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:07.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.403+0000 7f67f8d6b700 1 -- 172.21.15.154:0/46896504 shutdown_connections 2023-09-30T22:27:07.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.403+0000 7f67f8d6b700 1 --2- 172.21.15.154:0/46896504 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409e870 0x7f67f409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.403+0000 7f67f8d6b700 1 --2- 172.21.15.154:0/46896504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409f180 0x7f67f4131830 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.403+0000 7f67f8d6b700 1 -- 172.21.15.154:0/46896504 >> 172.21.15.154:0/46896504 conn(0x7f67f40a4430 msgr2=0x7f67f40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.403+0000 7f67f8d6b700 1 -- 172.21.15.154:0/46896504 shutdown_connections 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.403+0000 7f67f8d6b700 1 -- 172.21.15.154:0/46896504 wait complete. 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.404+0000 7f67f8d6b700 1 Processor -- start 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.404+0000 7f67f8d6b700 1 -- start start 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f8d6b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409e870 0x7f67f411bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f8d6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409f180 0x7f67f411c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f8d6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f4131d70 0x7f67f411ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f8d6b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f411f8c0 con 0x7f67f409e870 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f8d6b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f411dbf0 con 0x7f67f4131d70 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f8d6b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67f411ee40 con 0x7f67f409f180 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409e870 0x7f67f411bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409f180 0x7f67f411c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409f180 0x7f67f411c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33486/0 (socket says 172.21.15.154:33486) 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f1d9b700 1 -- 172.21.15.154:0/3609191655 learned_addr learned my addr 172.21.15.154:0/3609191655 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f2d9d700 1 --2- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f4131d70 0x7f67f411ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f1d9b700 1 -- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f4131d70 msgr2=0x7f67f411ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f1d9b700 1 --2- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f4131d70 0x7f67f411ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f1d9b700 1 -- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409e870 msgr2=0x7f67f411bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f1d9b700 1 --2- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409e870 0x7f67f411bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f1d9b700 1 -- 172.21.15.154:0/3609191655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e8009550 con 0x7f67f409f180 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f259c700 1 --2- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409e870 0x7f67f411bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.405+0000 7f67f1d9b700 1 --2- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409f180 0x7f67f411c520 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009c40 tx=0x7f67e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.406+0000 7f67e2ffd700 1 -- 172.21.15.154:0/3609191655 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8004400 con 0x7f67f409f180 2023-09-30T22:27:07.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.406+0000 7f67e2ffd700 1 -- 172.21.15.154:0/3609191655 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e801f070 con 0x7f67f409f180 2023-09-30T22:27:07.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.406+0000 7f67e2ffd700 1 -- 172.21.15.154:0/3609191655 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80038e0 con 0x7f67f409f180 2023-09-30T22:27:07.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.406+0000 7f67f8d6b700 1 -- 172.21.15.154:0/3609191655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f411e1b0 con 0x7f67f409f180 2023-09-30T22:27:07.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.406+0000 7f67f8d6b700 1 -- 172.21.15.154:0/3609191655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f411f2f0 con 0x7f67f409f180 2023-09-30T22:27:07.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.406+0000 7f67e2ffd700 1 -- 172.21.15.154:0/3609191655 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67e8021030 con 0x7f67f409f180 2023-09-30T22:27:07.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.407+0000 7f67e2ffd700 1 -- 172.21.15.154:0/3609191655 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f67e80407b0 con 0x7f67f409f180 2023-09-30T22:27:07.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.407+0000 7f67f8d6b700 1 -- 172.21.15.154:0/3609191655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f411f290 con 0x7f67f409f180 2023-09-30T22:27:07.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.415+0000 7f67e2ffd700 1 -- 172.21.15.154:0/3609191655 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67e8015080 con 0x7f67f409f180 2023-09-30T22:27:07.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.453+0000 7f751ad23700 1 Processor -- start 2023-09-30T22:27:07.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.453+0000 7f751ad23700 1 -- start start 2023-09-30T22:27:07.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.453+0000 7f751ad23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a1550 0x7f7514138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.453+0000 7f751ad23700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7514139200 0x7f751413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.453+0000 7f751ad23700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751409e9d0 con 0x7f75140a0a70 2023-09-30T22:27:07.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.453+0000 7f751ad23700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751409dc00 con 0x7f7514139200 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f751ad23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751409dec0 con 0x7f75140a1550 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f7518abf700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f75140a0a70 0x7f75140a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41292/0 (socket says 172.21.15.154:41292) 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f7518abf700 1 -- 172.21.15.154:0/1058896993 learned_addr learned my addr 172.21.15.154:0/1058896993 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f7513fff700 1 --2- 172.21.15.154:0/1058896993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a1550 0x7f7514138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75192c0700 1 --2- 172.21.15.154:0/1058896993 >> v2:172.21.15.154:3300/0 conn(0x7f7514139200 0x7f751413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75192c0700 1 -- 172.21.15.154:0/1058896993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a1550 msgr2=0x7f7514138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75192c0700 1 --2- 172.21.15.154:0/1058896993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a1550 0x7f7514138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75192c0700 1 -- 172.21.15.154:0/1058896993 >> v1:172.21.15.154:6789/0 conn(0x7f75140a0a70 legacy=0x7f75140a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75192c0700 1 -- 172.21.15.154:0/1058896993 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751409e6a0 con 0x7f7514139200 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75137fe700 1 -- 172.21.15.154:0/1058896993 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622709318 0 0) 0x7f751409e9d0 con 0x7f75140a0a70 2023-09-30T22:27:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f7513fff700 1 --2- 172.21.15.154:0/1058896993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a1550 0x7f7514138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75192c0700 1 --2- 172.21.15.154:0/1058896993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7514139200 0x7f751413b5e0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f750c009d90 tx=0x7f750c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0e0adf89a2e7fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75137fe700 1 -- 172.21.15.154:0/1058896993 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00e070 con 0x7f7514139200 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75137fe700 1 -- 172.21.15.154:0/1058896993 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00bb20 con 0x7f7514139200 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.454+0000 7f75137fe700 1 -- 172.21.15.154:0/1058896993 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c012430 con 0x7f7514139200 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.455+0000 7f751ad23700 1 -- 172.21.15.154:0/1058896993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7514139200 msgr2=0x7f751413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.455+0000 7f751ad23700 1 --2- 172.21.15.154:0/1058896993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7514139200 0x7f751413b5e0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f750c009d90 tx=0x7f750c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.455+0000 7f751ad23700 1 -- 172.21.15.154:0/1058896993 shutdown_connections 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.455+0000 7f751ad23700 1 --2- 172.21.15.154:0/1058896993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7514139200 0x7f751413b5e0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.455+0000 7f751ad23700 1 --2- 172.21.15.154:0/1058896993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a1550 0x7f7514138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.455+0000 7f751ad23700 1 -- 172.21.15.154:0/1058896993 >> 172.21.15.154:0/1058896993 conn(0x7f75140a6610 msgr2=0x7f75140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.455+0000 7f751ad23700 1 -- 172.21.15.154:0/1058896993 shutdown_connections 2023-09-30T22:27:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.455+0000 7f751ad23700 1 -- 172.21.15.154:0/1058896993 wait complete. 2023-09-30T22:27:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.456+0000 7f751ad23700 1 Processor -- start 2023-09-30T22:27:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.456+0000 7f751ad23700 1 -- start start 2023-09-30T22:27:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f751ad23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75140a0a70 0x7f7514120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f751ad23700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140a1550 0x7f7514120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f751ad23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7514139200 0x7f75141210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f751ad23700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7514124140 con 0x7f75140a1550 2023-09-30T22:27:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f751ad23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7514122850 con 0x7f7514139200 2023-09-30T22:27:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f751ad23700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75140a03e0 con 0x7f75140a0a70 2023-09-30T22:27:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7513fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140a1550 0x7f7514120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7513fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140a1550 0x7f7514120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42338/0 (socket says 172.21.15.154:42338) 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7513fff700 1 -- 172.21.15.154:0/1286618916 learned_addr learned my addr 172.21.15.154:0/1286618916 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7518abf700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75140a0a70 0x7f7514120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f75192c0700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7514139200 0x7f75141210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7513fff700 1 -- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75140a0a70 msgr2=0x7f7514120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7513fff700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75140a0a70 0x7f7514120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7513fff700 1 -- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7514139200 msgr2=0x7f75141210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7513fff700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7514139200 0x7f75141210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7513fff700 1 -- 172.21.15.154:0/1286618916 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000094a0 con 0x7f75140a1550 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7518abf700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75140a0a70 0x7f7514120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:07.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f7513fff700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140a1550 0x7f7514120b60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f750000ec10 tx=0x7f750000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f75117fa700 1 -- 172.21.15.154:0/1286618916 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000c850 con 0x7f75140a1550 2023-09-30T22:27:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f75117fa700 1 -- 172.21.15.154:0/1286618916 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750000c9b0 con 0x7f75140a1550 2023-09-30T22:27:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f751ad23700 1 -- 172.21.15.154:0/1286618916 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c009a70 con 0x7f75140a1550 2023-09-30T22:27:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f75117fa700 1 -- 172.21.15.154:0/1286618916 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000cd20 con 0x7f75140a1550 2023-09-30T22:27:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.457+0000 7f751ad23700 1 -- 172.21.15.154:0/1286618916 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7514123ba0 con 0x7f75140a1550 2023-09-30T22:27:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.458+0000 7f75117fa700 1 -- 172.21.15.154:0/1286618916 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7500013470 con 0x7f75140a1550 2023-09-30T22:27:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.458+0000 7f75117fa700 1 -- 172.21.15.154:0/1286618916 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f750003f780 con 0x7f75140a1550 2023-09-30T22:27:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.458+0000 7f751ad23700 1 -- 172.21.15.154:0/1286618916 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75141365a0 con 0x7f75140a1550 2023-09-30T22:27:07.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.467+0000 7f75117fa700 1 -- 172.21.15.154:0/1286618916 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7500021020 con 0x7f75140a1550 2023-09-30T22:27:07.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.566+0000 7fabeac16700 1 -- 172.21.15.154:0/3481997647 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fabe411c7b0 con 0x7fabe409e340 2023-09-30T22:27:07.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.566+0000 7fabe17fa700 1 -- 172.21.15.154:0/3481997647 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabe411c7b0 con 0x7fabe409e340 2023-09-30T22:27:07.568 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.568+0000 7fabeac16700 1 -- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe409e340 msgr2=0x7fabe4119b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.568+0000 7fabeac16700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe409e340 0x7fabe4119b70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fabd000ebe0 tx=0x7fabd000eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.569+0000 7fabeac16700 1 -- 172.21.15.154:0/3481997647 shutdown_connections 2023-09-30T22:27:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.569+0000 7fabeac16700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4135f20 0x7fabe411a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.569+0000 7fabeac16700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fabe409d860 0x7fabe4119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.569+0000 7fabeac16700 1 --2- 172.21.15.154:0/3481997647 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe409e340 0x7fabe4119b70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.569+0000 7fabeac16700 1 -- 172.21.15.154:0/3481997647 >> 172.21.15.154:0/3481997647 conn(0x7fabe4099c40 msgr2=0x7fabe41329c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.569+0000 7fabeac16700 1 -- 172.21.15.154:0/3481997647 shutdown_connections 2023-09-30T22:27:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.569+0000 7fabeac16700 1 -- 172.21.15.154:0/3481997647 wait complete. 2023-09-30T22:27:07.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.612+0000 7f67f8d6b700 1 -- 172.21.15.154:0/3609191655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f67f404f2a0 con 0x7f67f409f180 2023-09-30T22:27:07.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.612+0000 7f67e2ffd700 1 -- 172.21.15.154:0/3609191655 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67e801a450 con 0x7f67f409f180 2023-09-30T22:27:07.614 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:07.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.614+0000 7f67f8d6b700 1 -- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409f180 msgr2=0x7f67f411c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.614+0000 7f67f8d6b700 1 --2- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409f180 0x7f67f411c520 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009c40 tx=0x7f67e8004750 comp rx=0 tx=0).stop 2023-09-30T22:27:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.614+0000 7f67f8d6b700 1 -- 172.21.15.154:0/3609191655 shutdown_connections 2023-09-30T22:27:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.614+0000 7f67f8d6b700 1 --2- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67f4131d70 0x7f67f411ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.614+0000 7f67f8d6b700 1 --2- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67f409e870 0x7f67f411bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.614+0000 7f67f8d6b700 1 --2- 172.21.15.154:0/3609191655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f67f409f180 0x7f67f411c520 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.614+0000 7f67f8d6b700 1 -- 172.21.15.154:0/3609191655 >> 172.21.15.154:0/3609191655 conn(0x7f67f40a4430 msgr2=0x7f67f4130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.614+0000 7f67f8d6b700 1 -- 172.21.15.154:0/3609191655 shutdown_connections 2023-09-30T22:27:07.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.614+0000 7f67f8d6b700 1 -- 172.21.15.154:0/3609191655 wait complete. 2023-09-30T22:27:07.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:07.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.659+0000 7f751ad23700 1 -- 172.21.15.154:0/1286618916 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7514122a80 con 0x7f75140a1550 2023-09-30T22:27:07.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.660+0000 7f75117fa700 1 -- 172.21.15.154:0/1286618916 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7500013720 con 0x7f75140a1550 2023-09-30T22:27:07.661 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.662+0000 7f751ad23700 1 -- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140a1550 msgr2=0x7f7514120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.662+0000 7f751ad23700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140a1550 0x7f7514120b60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f750000ec10 tx=0x7f750000ef20 comp rx=0 tx=0).stop 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.662+0000 7f751ad23700 1 -- 172.21.15.154:0/1286618916 shutdown_connections 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.662+0000 7f751ad23700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7514139200 0x7f75141210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.662+0000 7f751ad23700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75140a0a70 0x7f7514120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.662+0000 7f751ad23700 1 --2- 172.21.15.154:0/1286618916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140a1550 0x7f7514120b60 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.662+0000 7f751ad23700 1 -- 172.21.15.154:0/1286618916 >> 172.21.15.154:0/1286618916 conn(0x7f75140a6610 msgr2=0x7f75140a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:07.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.662+0000 7f751ad23700 1 -- 172.21.15.154:0/1286618916 shutdown_connections 2023-09-30T22:27:07.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:07.662+0000 7f751ad23700 1 -- 172.21.15.154:0/1286618916 wait complete. 2023-09-30T22:27:07.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:08.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:08.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.471+0000 7fb1515d6700 1 Processor -- start 2023-09-30T22:27:08.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.471+0000 7fb1515d6700 1 -- start start 2023-09-30T22:27:08.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb1515d6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb14c136960 0x7fb14c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb1515d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c139280 0x7fb14c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb1515d6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c06b2d0 con 0x7fb14c133ad0 2023-09-30T22:27:08.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb1515d6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c1345b0 con 0x7fb14c136960 2023-09-30T22:27:08.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb1515d6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c133610 con 0x7fb14c139280 2023-09-30T22:27:08.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14a7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb14c136960 0x7fb14c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c139280 0x7fb14c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14a7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb14c136960 0x7fb14c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42340/0 (socket says 172.21.15.154:42340) 2023-09-30T22:27:08.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14a7fc700 1 -- 172.21.15.154:0/1156621510 learned_addr learned my addr 172.21.15.154:0/1156621510 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:08.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14a7fc700 1 -- 172.21.15.154:0/1156621510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c139280 msgr2=0x7fb14c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:08.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14a7fc700 1 --2- 172.21.15.154:0/1156621510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c139280 0x7fb14c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14a7fc700 1 -- 172.21.15.154:0/1156621510 >> v1:172.21.15.154:6789/0 conn(0x7fb14c133ad0 legacy=0x7fb14c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14a7fc700 1 -- 172.21.15.154:0/1156621510 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c09a500 con 0x7fb14c136960 2023-09-30T22:27:08.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb149ffb700 1 -- 172.21.15.154:0/1156621510 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894232439 0 0) 0x7fb14c06b2d0 con 0x7fb14c133ad0 2023-09-30T22:27:08.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14b7fe700 1 --2- 172.21.15.154:0/1156621510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c139280 0x7fb14c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:08.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb14a7fc700 1 --2- 172.21.15.154:0/1156621510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c136960 0x7fb14c138d40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0098f0 tx=0x7fb13c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b728b5aa46bd8bda server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:08.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb149ffb700 1 -- 172.21.15.154:0/1156621510 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c011830 con 0x7fb14c136960 2023-09-30T22:27:08.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb149ffb700 1 -- 172.21.15.154:0/1156621510 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c011990 con 0x7fb14c136960 2023-09-30T22:27:08.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.472+0000 7fb149ffb700 1 -- 172.21.15.154:0/1156621510 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c011d20 con 0x7fb14c136960 2023-09-30T22:27:08.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.473+0000 7fb1515d6700 1 -- 172.21.15.154:0/1156621510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c136960 msgr2=0x7fb14c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.473+0000 7fb1515d6700 1 --2- 172.21.15.154:0/1156621510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c136960 0x7fb14c138d40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0098f0 tx=0x7fb13c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:08.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.473+0000 7fb1515d6700 1 -- 172.21.15.154:0/1156621510 shutdown_connections 2023-09-30T22:27:08.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.473+0000 7fb1515d6700 1 --2- 172.21.15.154:0/1156621510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c139280 0x7fb14c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.473+0000 7fb1515d6700 1 --2- 172.21.15.154:0/1156621510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c136960 0x7fb14c138d40 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.473+0000 7fb1515d6700 1 -- 172.21.15.154:0/1156621510 >> 172.21.15.154:0/1156621510 conn(0x7fb14c099c40 msgr2=0x7fb14c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:08.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.473+0000 7fb1515d6700 1 -- 172.21.15.154:0/1156621510 shutdown_connections 2023-09-30T22:27:08.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.473+0000 7fb1515d6700 1 -- 172.21.15.154:0/1156621510 wait complete. 2023-09-30T22:27:08.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.474+0000 7fb1515d6700 1 Processor -- start 2023-09-30T22:27:08.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.474+0000 7fb1515d6700 1 -- start start 2023-09-30T22:27:08.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.474+0000 7fb1515d6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c133ad0 0x7fb14c12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.474+0000 7fb1515d6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c136960 0x7fb14c12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.474+0000 7fb1515d6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb14c139280 0x7fb14c12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.474+0000 7fb1515d6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c130410 con 0x7fb14c133ad0 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.474+0000 7fb1515d6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c070410 con 0x7fb14c139280 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.474+0000 7fb1515d6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c130ab0 con 0x7fb14c136960 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c133ad0 0x7fb14c12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb14c139280 0x7fb14c12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c133ad0 0x7fb14c12cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42342/0 (socket says 172.21.15.154:42342) 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb14c139280 0x7fb14c12d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32802/0 (socket says 172.21.15.154:32802) 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14affd700 1 -- 172.21.15.154:0/451068636 learned_addr learned my addr 172.21.15.154:0/451068636 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14a7fc700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c136960 0x7fb14c12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14affd700 1 -- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c136960 msgr2=0x7fb14c12d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14affd700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c136960 0x7fb14c12d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14affd700 1 -- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb14c139280 msgr2=0x7fb14c12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14affd700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb14c139280 0x7fb14c12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14affd700 1 -- 172.21.15.154:0/451068636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb144009a70 con 0x7fb14c133ad0 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14b7fe700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb14c139280 0x7fb14c12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14a7fc700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c136960 0x7fb14c12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb14affd700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c133ad0 0x7fb14c12cb30 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c480 tx=0x7fb14000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb1337fe700 1 -- 172.21.15.154:0/451068636 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400054e0 con 0x7fb14c133ad0 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb1337fe700 1 -- 172.21.15.154:0/451068636 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14000ce50 con 0x7fb14c133ad0 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb1515d6700 1 -- 172.21.15.154:0/451068636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c009550 con 0x7fb14c133ad0 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb1337fe700 1 -- 172.21.15.154:0/451068636 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400038c0 con 0x7fb14c133ad0 2023-09-30T22:27:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.475+0000 7fb1515d6700 1 -- 172.21.15.154:0/451068636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c06fd70 con 0x7fb14c133ad0 2023-09-30T22:27:08.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.476+0000 7fb1337fe700 1 -- 172.21.15.154:0/451068636 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb140003a20 con 0x7fb14c133ad0 2023-09-30T22:27:08.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.476+0000 7fb1337fe700 1 -- 172.21.15.154:0/451068636 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb14003ea30 con 0x7fb14c133ad0 2023-09-30T22:27:08.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.476+0000 7fb1515d6700 1 -- 172.21.15.154:0/451068636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c070250 con 0x7fb14c133ad0 2023-09-30T22:27:08.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.481+0000 7fb1337fe700 1 -- 172.21.15.154:0/451068636 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb14c070250 con 0x7fb14c133ad0 2023-09-30T22:27:08.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:08.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:08.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.671+0000 7fb1515d6700 1 -- 172.21.15.154:0/451068636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb14c070250 con 0x7fb14c133ad0 2023-09-30T22:27:08.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.671+0000 7fb1337fe700 1 -- 172.21.15.154:0/451068636 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb14c070250 con 0x7fb14c133ad0 2023-09-30T22:27:08.673 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:08.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.674+0000 7fb1515d6700 1 -- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c133ad0 msgr2=0x7fb14c12cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.674+0000 7fb1515d6700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c133ad0 0x7fb14c12cb30 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c480 tx=0x7fb14000c790 comp rx=0 tx=0).stop 2023-09-30T22:27:08.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.674+0000 7fb1515d6700 1 -- 172.21.15.154:0/451068636 shutdown_connections 2023-09-30T22:27:08.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.674+0000 7fb1515d6700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb14c139280 0x7fb14c12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.674+0000 7fb1515d6700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb14c133ad0 0x7fb14c12cb30 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.674+0000 7fb1515d6700 1 --2- 172.21.15.154:0/451068636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb14c136960 0x7fb14c12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.674+0000 7fb1515d6700 1 -- 172.21.15.154:0/451068636 >> 172.21.15.154:0/451068636 conn(0x7fb14c099c40 msgr2=0x7fb14c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:08.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.674+0000 7fb1515d6700 1 -- 172.21.15.154:0/451068636 shutdown_connections 2023-09-30T22:27:08.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.674+0000 7fb1515d6700 1 -- 172.21.15.154:0/451068636 wait complete. 2023-09-30T22:27:08.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:08.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:08.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.711+0000 7f2ea5d60700 1 Processor -- start 2023-09-30T22:27:08.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.711+0000 7f2ea5d60700 1 -- start start 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2ea5d60700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0133a70 0x7f2ea0133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2ea5d60700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ea00a08e0 0x7f2ea00a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2ea5d60700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea00a1290 0x7f2ea013a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2ea5d60700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea0133640 con 0x7f2ea00a08e0 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2ea5d60700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00a1d50 con 0x7f2ea0133a70 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2ea5d60700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea009b620 con 0x7f2ea00a1290 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea00a1290 0x7f2ea013a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ea00a08e0 0x7f2ea00a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea00a1290 0x7f2ea013a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33512/0 (socket says 172.21.15.154:33512) 2023-09-30T22:27:08.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ea00a08e0 0x7f2ea00a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42352/0 (socket says 172.21.15.154:42352) 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9ffff700 1 -- 172.21.15.154:0/788516877 learned_addr learned my addr 172.21.15.154:0/788516877 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9f7fe700 1 --2- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0133a70 0x7f2ea0133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9effd700 1 -- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea00a1290 msgr2=0x7f2ea013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9effd700 1 --2- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea00a1290 0x7f2ea013a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9effd700 1 -- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0133a70 msgr2=0x7f2ea0133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9effd700 1 --2- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0133a70 0x7f2ea0133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.712+0000 7f2e9effd700 1 -- 172.21.15.154:0/788516877 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0133870 con 0x7f2ea00a08e0 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2e9effd700 1 --2- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a08e0 0x7f2ea00a0d50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009840 tx=0x7f2e94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcf36be9aebad9f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2e9e7fc700 1 -- 172.21.15.154:0/788516877 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94011830 con 0x7f2ea00a08e0 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2e9e7fc700 1 -- 172.21.15.154:0/788516877 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e94011990 con 0x7f2ea00a08e0 2023-09-30T22:27:08.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2e9e7fc700 1 -- 172.21.15.154:0/788516877 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94011d20 con 0x7f2ea00a08e0 2023-09-30T22:27:08.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2ea5d60700 1 -- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a08e0 msgr2=0x7f2ea00a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2ea5d60700 1 --2- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a08e0 0x7f2ea00a0d50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009840 tx=0x7f2e94009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:08.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2ea5d60700 1 -- 172.21.15.154:0/788516877 shutdown_connections 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2ea5d60700 1 --2- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0133a70 0x7f2ea0133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2ea5d60700 1 --2- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea00a1290 0x7f2ea013a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.713+0000 7f2ea5d60700 1 --2- 172.21.15.154:0/788516877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a08e0 0x7f2ea00a0d50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.714+0000 7f2ea5d60700 1 -- 172.21.15.154:0/788516877 >> 172.21.15.154:0/788516877 conn(0x7f2ea00a2980 msgr2=0x7f2ea00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.714+0000 7f2ea5d60700 1 -- 172.21.15.154:0/788516877 shutdown_connections 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.714+0000 7f2ea5d60700 1 -- 172.21.15.154:0/788516877 wait complete. 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.714+0000 7f2ea5d60700 1 Processor -- start 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2ea5d60700 1 -- start start 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2ea5d60700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00a08e0 0x7f2ea011f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2ea5d60700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a1290 0x7f2ea011fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2ea5d60700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea0133a70 0x7f2ea01203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2ea5d60700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0123480 con 0x7f2ea00a1290 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2ea5d60700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0122400 con 0x7f2ea00a08e0 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2ea5d60700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0122ee0 con 0x7f2ea0133a70 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2e9f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00a08e0 0x7f2ea011f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2e9ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea0133a70 0x7f2ea01203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2e9f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00a08e0 0x7f2ea011f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32828/0 (socket says 172.21.15.154:32828) 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2e9f7fe700 1 -- 172.21.15.154:0/2841833567 learned_addr learned my addr 172.21.15.154:0/2841833567 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.715+0000 7f2e9effd700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a1290 0x7f2ea011fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e9ffff700 1 -- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00a08e0 msgr2=0x7f2ea011f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e9ffff700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00a08e0 0x7f2ea011f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e9ffff700 1 -- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a1290 msgr2=0x7f2ea011fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e9ffff700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a1290 0x7f2ea011fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e9ffff700 1 -- 172.21.15.154:0/2841833567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940094a0 con 0x7f2ea0133a70 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e9f7fe700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00a08e0 0x7f2ea011f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e9effd700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a1290 0x7f2ea011fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e9ffff700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea0133a70 0x7f2ea01203e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009d90 tx=0x7f2e9800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e87fff700 1 -- 172.21.15.154:0/2841833567 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98003c20 con 0x7f2ea0133a70 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e87fff700 1 -- 172.21.15.154:0/2841833567 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9800f040 con 0x7f2ea0133a70 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2ea5d60700 1 -- 172.21.15.154:0/2841833567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea0130d30 con 0x7f2ea0133a70 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2e87fff700 1 -- 172.21.15.154:0/2841833567 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800c880 con 0x7f2ea0133a70 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.716+0000 7f2ea5d60700 1 -- 172.21.15.154:0/2841833567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea009a350 con 0x7f2ea0133a70 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.717+0000 7f2e87fff700 1 -- 172.21.15.154:0/2841833567 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e9800c9e0 con 0x7f2ea0133a70 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.717+0000 7f2e87fff700 1 -- 172.21.15.154:0/2841833567 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e9803f900 con 0x7f2ea0133a70 2023-09-30T22:27:08.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.717+0000 7f2ea5d60700 1 -- 172.21.15.154:0/2841833567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea0123020 con 0x7f2ea0133a70 2023-09-30T22:27:08.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.722+0000 7f2e87fff700 1 -- 172.21.15.154:0/2841833567 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e9800ce70 con 0x7f2ea0133a70 2023-09-30T22:27:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.757+0000 7f029c930700 1 Processor -- start 2023-09-30T22:27:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.757+0000 7f029c930700 1 -- start start 2023-09-30T22:27:08.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.757+0000 7f029c930700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a0a70 0x7f02980a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.757+0000 7f029c930700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02980a1380 0x7f0298133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029c930700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029809dc00 con 0x7f0298133f50 2023-09-30T22:27:08.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029c930700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029809ea60 con 0x7f02980a0a70 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029c930700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f029809dec0 con 0x7f02980a1380 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a0a70 0x7f02980a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f0296d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0298133f50 0x7f029813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41306/0 (socket says 172.21.15.154:41306) 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f0295d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02980a1380 0x7f0298133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a0a70 0x7f02980a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32832/0 (socket says 172.21.15.154:32832) 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f0296d9d700 1 -- 172.21.15.154:0/3799970758 learned_addr learned my addr 172.21.15.154:0/3799970758 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029659c700 1 -- 172.21.15.154:0/3799970758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02980a1380 msgr2=0x7f0298133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029559a700 1 -- 172.21.15.154:0/3799970758 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635183025 0 0) 0x7f029809dc00 con 0x7f0298133f50 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029659c700 1 --2- 172.21.15.154:0/3799970758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02980a1380 0x7f0298133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029659c700 1 -- 172.21.15.154:0/3799970758 >> v1:172.21.15.154:6789/0 conn(0x7f0298133f50 legacy=0x7f029813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029659c700 1 -- 172.21.15.154:0/3799970758 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029809e6a0 con 0x7f02980a0a70 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029659c700 1 --2- 172.21.15.154:0/3799970758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a0a70 0x7f02980a0e40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0288009870 tx=0x7f0288009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5ff422e3aac870 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029559a700 1 -- 172.21.15.154:0/3799970758 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288011830 con 0x7f02980a0a70 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029559a700 1 -- 172.21.15.154:0/3799970758 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0288011990 con 0x7f02980a0a70 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.758+0000 7f029559a700 1 -- 172.21.15.154:0/3799970758 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288011d20 con 0x7f02980a0a70 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.759+0000 7f029c930700 1 -- 172.21.15.154:0/3799970758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a0a70 msgr2=0x7f02980a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.759+0000 7f029c930700 1 --2- 172.21.15.154:0/3799970758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a0a70 0x7f02980a0e40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0288009870 tx=0x7f0288009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.759+0000 7f029c930700 1 -- 172.21.15.154:0/3799970758 shutdown_connections 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.759+0000 7f029c930700 1 --2- 172.21.15.154:0/3799970758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a0a70 0x7f02980a0e40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.759+0000 7f029c930700 1 --2- 172.21.15.154:0/3799970758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f02980a1380 0x7f0298133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.759+0000 7f029c930700 1 -- 172.21.15.154:0/3799970758 >> 172.21.15.154:0/3799970758 conn(0x7f02980a6610 msgr2=0x7f02980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.759+0000 7f029c930700 1 -- 172.21.15.154:0/3799970758 shutdown_connections 2023-09-30T22:27:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.759+0000 7f029c930700 1 -- 172.21.15.154:0/3799970758 wait complete. 2023-09-30T22:27:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.760+0000 7f029c930700 1 Processor -- start 2023-09-30T22:27:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.760+0000 7f029c930700 1 -- start start 2023-09-30T22:27:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029c930700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02980a0a70 0x7f02981228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029c930700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a1380 0x7f0298122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029c930700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0298133f50 0x7f0298123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029c930700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0298126170 con 0x7f02980a0a70 2023-09-30T22:27:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029c930700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0298126350 con 0x7f02980a1380 2023-09-30T22:27:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029c930700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0298125db0 con 0x7f0298133f50 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f0295d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a1380 0x7f0298122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02980a0a70 0x7f02981228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02980a0a70 0x7f02981228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42366/0 (socket says 172.21.15.154:42366) 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f0295d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a1380 0x7f0298122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32840/0 (socket says 172.21.15.154:32840) 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029659c700 1 -- 172.21.15.154:0/271113416 learned_addr learned my addr 172.21.15.154:0/271113416 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f0296d9d700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0298133f50 0x7f0298123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029659c700 1 -- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0298133f50 msgr2=0x7f0298123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029659c700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0298133f50 0x7f0298123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029659c700 1 -- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a1380 msgr2=0x7f0298122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029659c700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a1380 0x7f0298122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029659c700 1 -- 172.21.15.154:0/271113416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880094a0 con 0x7f02980a0a70 2023-09-30T22:27:08.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f0295d9b700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a1380 0x7f0298122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f0296d9d700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0298133f50 0x7f0298123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.761+0000 7f029659c700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02980a0a70 0x7f02981228d0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f029809eba0 tx=0x7f0288004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.762+0000 7f0286ffd700 1 -- 172.21.15.154:0/271113416 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288004590 con 0x7f02980a0a70 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.762+0000 7f0286ffd700 1 -- 172.21.15.154:0/271113416 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028801f070 con 0x7f02980a0a70 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.762+0000 7f0286ffd700 1 -- 172.21.15.154:0/271113416 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02880038a0 con 0x7f02980a0a70 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.762+0000 7f029c930700 1 -- 172.21.15.154:0/271113416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02980a03e0 con 0x7f02980a0a70 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.762+0000 7f029c930700 1 -- 172.21.15.154:0/271113416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02981245a0 con 0x7f02980a0a70 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.763+0000 7f0284ff9700 1 -- 172.21.15.154:0/271113416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02700052e0 con 0x7f02980a0a70 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.763+0000 7f0286ffd700 1 -- 172.21.15.154:0/271113416 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0288003a00 con 0x7f02980a0a70 2023-09-30T22:27:08.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.763+0000 7f0286ffd700 1 -- 172.21.15.154:0/271113416 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0288021070 con 0x7f02980a0a70 2023-09-30T22:27:08.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.772+0000 7f0286ffd700 1 -- 172.21.15.154:0/271113416 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0288024970 con 0x7f02980a0a70 2023-09-30T22:27:08.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.808+0000 7f0bfb2c0700 1 Processor -- start 2023-09-30T22:27:08.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.808+0000 7f0bfb2c0700 1 -- start start 2023-09-30T22:27:08.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.808+0000 7f0bfb2c0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0bf40a0a70 0x7f0bf40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.808+0000 7f0bfb2c0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a1380 0x7f0bf4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.808+0000 7f0bfb2c0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf409dc00 con 0x7f0bf4133f50 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.808+0000 7f0bfb2c0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf409ea60 con 0x7f0bf40a0a70 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.808+0000 7f0bfb2c0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf409dec0 con 0x7f0bf40a1380 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf885b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a1380 0x7f0bf4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf885b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a1380 0x7f0bf4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32854/0 (socket says 172.21.15.154:32854) 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf885b700 1 -- 172.21.15.154:0/1184266760 learned_addr learned my addr 172.21.15.154:0/1184266760 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf905c700 1 --2- 172.21.15.154:0/1184266760 >> v2:172.21.15.154:3300/0 conn(0x7f0bf40a0a70 0x7f0bf40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf885b700 1 -- 172.21.15.154:0/1184266760 >> v2:172.21.15.154:3300/0 conn(0x7f0bf40a0a70 msgr2=0x7f0bf40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:08.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf885b700 1 --2- 172.21.15.154:0/1184266760 >> v2:172.21.15.154:3300/0 conn(0x7f0bf40a0a70 0x7f0bf40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf885b700 1 -- 172.21.15.154:0/1184266760 >> v1:172.21.15.154:6789/0 conn(0x7f0bf4133f50 legacy=0x7f0bf413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf885b700 1 -- 172.21.15.154:0/1184266760 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf409e6a0 con 0x7f0bf40a1380 2023-09-30T22:27:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf905c700 1 --2- 172.21.15.154:0/1184266760 >> v2:172.21.15.154:3300/0 conn(0x7f0bf40a0a70 0x7f0bf40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bf885b700 1 --2- 172.21.15.154:0/1184266760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a1380 0x7f0bf4133a10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0be40098f0 tx=0x7f0be4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef97bf8fe8e7d786 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bebfff700 1 -- 172.21.15.154:0/1184266760 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011830 con 0x7f0bf40a1380 2023-09-30T22:27:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bebfff700 1 -- 172.21.15.154:0/1184266760 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4011990 con 0x7f0bf40a1380 2023-09-30T22:27:08.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.809+0000 7f0bebfff700 1 -- 172.21.15.154:0/1184266760 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011d20 con 0x7f0bf40a1380 2023-09-30T22:27:08.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.810+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/1184266760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a1380 msgr2=0x7f0bf4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.810+0000 7f0bfb2c0700 1 --2- 172.21.15.154:0/1184266760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a1380 0x7f0bf4133a10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0be40098f0 tx=0x7f0be4009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:08.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.810+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/1184266760 shutdown_connections 2023-09-30T22:27:08.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.810+0000 7f0bfb2c0700 1 --2- 172.21.15.154:0/1184266760 >> v2:172.21.15.154:3300/0 conn(0x7f0bf40a0a70 0x7f0bf40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.810+0000 7f0bfb2c0700 1 --2- 172.21.15.154:0/1184266760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a1380 0x7f0bf4133a10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.810+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/1184266760 >> 172.21.15.154:0/1184266760 conn(0x7f0bf40a6610 msgr2=0x7f0bf40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:08.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.810+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/1184266760 shutdown_connections 2023-09-30T22:27:08.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.810+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/1184266760 wait complete. 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.811+0000 7f0bfb2c0700 1 Processor -- start 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.811+0000 7f0bfb2c0700 1 -- start start 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.811+0000 7f0bfb2c0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a0a70 0x7f0bf41c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.811+0000 7f0bfb2c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf40a1380 0x7f0bf41c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.811+0000 7f0bfb2c0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0bf4133f50 0x7f0bf41c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.811+0000 7f0bfb2c0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf41245c0 con 0x7f0bf40a1380 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.811+0000 7f0bfb2c0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4125f30 con 0x7f0bf40a0a70 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.811+0000 7f0bfb2c0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf41265d0 con 0x7f0bf4133f50 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.811+0000 7f0bf905c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a0a70 0x7f0bf41c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf905c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a0a70 0x7f0bf41c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32870/0 (socket says 172.21.15.154:32870) 2023-09-30T22:27:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf905c700 1 -- 172.21.15.154:0/2670304538 learned_addr learned my addr 172.21.15.154:0/2670304538 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf885b700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf40a1380 0x7f0bf41c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf985d700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0bf4133f50 0x7f0bf41c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf885b700 1 -- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0bf4133f50 msgr2=0x7f0bf41c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf885b700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0bf4133f50 0x7f0bf41c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf885b700 1 -- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a0a70 msgr2=0x7f0bf41c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf885b700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a0a70 0x7f0bf41c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf885b700 1 -- 172.21.15.154:0/2670304538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf00094a0 con 0x7f0bf40a1380 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf905c700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a0a70 0x7f0bf41c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bf885b700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf40a1380 0x7f0bf41c8720 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f0be4016000 tx=0x7f0be4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0be9ffb700 1 -- 172.21.15.154:0/2670304538 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4004340 con 0x7f0bf40a1380 2023-09-30T22:27:08.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0be9ffb700 1 -- 172.21.15.154:0/2670304538 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be401f070 con 0x7f0bf40a1380 2023-09-30T22:27:08.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/2670304538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be4009550 con 0x7f0bf40a1380 2023-09-30T22:27:08.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.812+0000 7f0be9ffb700 1 -- 172.21.15.154:0/2670304538 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40036a0 con 0x7f0bf40a1380 2023-09-30T22:27:08.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.813+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/2670304538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf4124b10 con 0x7f0bf40a1380 2023-09-30T22:27:08.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.813+0000 7f0be9ffb700 1 -- 172.21.15.154:0/2670304538 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0be4021030 con 0x7f0bf40a1380 2023-09-30T22:27:08.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.813+0000 7f0be9ffb700 1 -- 172.21.15.154:0/2670304538 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0be4040970 con 0x7f0bf40a1380 2023-09-30T22:27:08.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.814+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/2670304538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf404f2a0 con 0x7f0bf40a1380 2023-09-30T22:27:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.822+0000 7f0be9ffb700 1 -- 172.21.15.154:0/2670304538 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0be401a450 con 0x7f0bf40a1380 2023-09-30T22:27:08.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.923+0000 7f2ea5d60700 1 -- 172.21.15.154:0/2841833567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2ea004f2a0 con 0x7f2ea0133a70 2023-09-30T22:27:08.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.923+0000 7f2e87fff700 1 -- 172.21.15.154:0/2841833567 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e98013b90 con 0x7f2ea0133a70 2023-09-30T22:27:08.924 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:08.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.926+0000 7f2ea5d60700 1 -- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea0133a70 msgr2=0x7f2ea01203e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.926+0000 7f2ea5d60700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea0133a70 0x7f2ea01203e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009d90 tx=0x7f2e9800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.926+0000 7f2ea5d60700 1 -- 172.21.15.154:0/2841833567 shutdown_connections 2023-09-30T22:27:08.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.926+0000 7f2ea5d60700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2ea0133a70 0x7f2ea01203e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.926+0000 7f2ea5d60700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00a08e0 0x7f2ea011f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.926+0000 7f2ea5d60700 1 --2- 172.21.15.154:0/2841833567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00a1290 0x7f2ea011fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.926+0000 7f2ea5d60700 1 -- 172.21.15.154:0/2841833567 >> 172.21.15.154:0/2841833567 conn(0x7f2ea00a2980 msgr2=0x7f2ea009e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:08.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.926+0000 7f2ea5d60700 1 -- 172.21.15.154:0/2841833567 shutdown_connections 2023-09-30T22:27:08.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.926+0000 7f2ea5d60700 1 -- 172.21.15.154:0/2841833567 wait complete. 2023-09-30T22:27:08.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:08.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.972+0000 7f0284ff9700 1 -- 172.21.15.154:0/271113416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0270005590 con 0x7f02980a0a70 2023-09-30T22:27:08.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.972+0000 7f0286ffd700 1 -- 172.21.15.154:0/271113416 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f028802b070 con 0x7f02980a0a70 2023-09-30T22:27:08.973 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:08.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.974+0000 7f0284ff9700 1 -- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02980a0a70 msgr2=0x7f02981228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:08.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.974+0000 7f0284ff9700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02980a0a70 0x7f02981228d0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f029809eba0 tx=0x7f0288004750 comp rx=0 tx=0).stop 2023-09-30T22:27:08.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.974+0000 7f0284ff9700 1 -- 172.21.15.154:0/271113416 shutdown_connections 2023-09-30T22:27:08.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.974+0000 7f0284ff9700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0298133f50 0x7f0298123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.974+0000 7f0284ff9700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02980a0a70 0x7f02981228d0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.974+0000 7f0284ff9700 1 --2- 172.21.15.154:0/271113416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02980a1380 0x7f0298122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:08.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.974+0000 7f0284ff9700 1 -- 172.21.15.154:0/271113416 >> 172.21.15.154:0/271113416 conn(0x7f02980a6610 msgr2=0x7f02980a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:08.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.975+0000 7f0284ff9700 1 -- 172.21.15.154:0/271113416 shutdown_connections 2023-09-30T22:27:08.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:08.975+0000 7f0284ff9700 1 -- 172.21.15.154:0/271113416 wait complete. 2023-09-30T22:27:08.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:09.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.017+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/2670304538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0bf4072980 con 0x7f0bf40a1380 2023-09-30T22:27:09.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.017+0000 7f0be9ffb700 1 -- 172.21.15.154:0/2670304538 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0be4015020 con 0x7f0bf40a1380 2023-09-30T22:27:09.018 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:09.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.019+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf40a1380 msgr2=0x7f0bf41c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.019+0000 7f0bfb2c0700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf40a1380 0x7f0bf41c8720 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f0be4016000 tx=0x7f0be4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:09.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.019+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/2670304538 shutdown_connections 2023-09-30T22:27:09.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.019+0000 7f0bfb2c0700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0bf4133f50 0x7f0bf41c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.019+0000 7f0bfb2c0700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0bf40a0a70 0x7f0bf41c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.019+0000 7f0bfb2c0700 1 --2- 172.21.15.154:0/2670304538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf40a1380 0x7f0bf41c8720 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.019+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/2670304538 >> 172.21.15.154:0/2670304538 conn(0x7f0bf40a6610 msgr2=0x7f0bf40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.019+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/2670304538 shutdown_connections 2023-09-30T22:27:09.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.019+0000 7f0bfb2c0700 1 -- 172.21.15.154:0/2670304538 wait complete. 2023-09-30T22:27:09.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:09.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:09.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.822+0000 7f584c7a9700 1 Processor -- start 2023-09-30T22:27:09.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.822+0000 7f584c7a9700 1 -- start start 2023-09-30T22:27:09.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584c7a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409e870 0x7f584409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584c7a9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5844131f40 0x7f5844139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584c7a9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584409c970 con 0x7f584409f180 2023-09-30T22:27:09.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584c7a9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58440a0920 con 0x7f5844131f40 2023-09-30T22:27:09.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584c7a9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f584409f9c0 con 0x7f584409e870 2023-09-30T22:27:09.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584ad46700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5844131f40 0x7f5844139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584ad46700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5844131f40 0x7f5844139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42398/0 (socket says 172.21.15.154:42398) 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584ad46700 1 -- 172.21.15.154:0/1981187231 learned_addr learned my addr 172.21.15.154:0/1981187231 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584a545700 1 --2- 172.21.15.154:0/1981187231 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409e870 0x7f584409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584ad46700 1 -- 172.21.15.154:0/1981187231 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409e870 msgr2=0x7f584409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584ad46700 1 --2- 172.21.15.154:0/1981187231 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409e870 0x7f584409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584ad46700 1 -- 172.21.15.154:0/1981187231 >> v1:172.21.15.154:6789/0 conn(0x7f584409f180 legacy=0x7f5844131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584ad46700 1 -- 172.21.15.154:0/1981187231 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584409bab0 con 0x7f5844131f40 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.823+0000 7f584a545700 1 --2- 172.21.15.154:0/1981187231 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409e870 0x7f584409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f584ad46700 1 --2- 172.21.15.154:0/1981187231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5844131f40 0x7f5844139ca0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f583c009e50 tx=0x7f583c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416e00c0b43002db server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f5849543700 1 -- 172.21.15.154:0/1981187231 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00e070 con 0x7f5844131f40 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f5849543700 1 -- 172.21.15.154:0/1981187231 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c00b910 con 0x7f5844131f40 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f5849543700 1 -- 172.21.15.154:0/1981187231 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00bcc0 con 0x7f5844131f40 2023-09-30T22:27:09.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f584c7a9700 1 -- 172.21.15.154:0/1981187231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5844131f40 msgr2=0x7f5844139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f584c7a9700 1 --2- 172.21.15.154:0/1981187231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5844131f40 0x7f5844139ca0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f583c009e50 tx=0x7f583c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:09.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f584c7a9700 1 -- 172.21.15.154:0/1981187231 shutdown_connections 2023-09-30T22:27:09.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f584c7a9700 1 --2- 172.21.15.154:0/1981187231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5844131f40 0x7f5844139ca0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f584c7a9700 1 --2- 172.21.15.154:0/1981187231 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409e870 0x7f584409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f584c7a9700 1 -- 172.21.15.154:0/1981187231 >> 172.21.15.154:0/1981187231 conn(0x7f58440a4430 msgr2=0x7f58440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:09.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f584c7a9700 1 -- 172.21.15.154:0/1981187231 shutdown_connections 2023-09-30T22:27:09.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.824+0000 7f584c7a9700 1 -- 172.21.15.154:0/1981187231 wait complete. 2023-09-30T22:27:09.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.825+0000 7f584c7a9700 1 Processor -- start 2023-09-30T22:27:09.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.825+0000 7f584c7a9700 1 -- start start 2023-09-30T22:27:09.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584c7a9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584409e870 0x7f584406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584c7a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409f180 0x7f584406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584c7a9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5844131f40 0x7f584406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:09.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584c7a9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584406d4c0 con 0x7f584409e870 2023-09-30T22:27:09.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584c7a9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584409dc10 con 0x7f5844131f40 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584c7a9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5844130f40 con 0x7f584409f180 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584a545700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584409e870 0x7f584406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584a545700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584409e870 0x7f584406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42400/0 (socket says 172.21.15.154:42400) 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584a545700 1 -- 172.21.15.154:0/1592627042 learned_addr learned my addr 172.21.15.154:0/1592627042 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f5849d44700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409f180 0x7f584406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584ad46700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5844131f40 0x7f584406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584a545700 1 -- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409f180 msgr2=0x7f584406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584a545700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409f180 0x7f584406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584a545700 1 -- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5844131f40 msgr2=0x7f584406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584a545700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5844131f40 0x7f584406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584a545700 1 -- 172.21.15.154:0/1592627042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58380094a0 con 0x7f584409e870 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584ad46700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5844131f40 0x7f584406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f584a545700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584409e870 0x7f584406b8b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f583800ec10 tx=0x7f583800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.826+0000 7f5836ffd700 1 -- 172.21.15.154:0/1592627042 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838009760 con 0x7f584409e870 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.827+0000 7f5836ffd700 1 -- 172.21.15.154:0/1592627042 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583800c7f0 con 0x7f584409e870 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.827+0000 7f584c7a9700 1 -- 172.21.15.154:0/1592627042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c009b30 con 0x7f584409e870 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.827+0000 7f5836ffd700 1 -- 172.21.15.154:0/1592627042 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583800cb80 con 0x7f584409e870 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.827+0000 7f584c7a9700 1 -- 172.21.15.154:0/1592627042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5844125c10 con 0x7f584409e870 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.827+0000 7f5836ffd700 1 -- 172.21.15.154:0/1592627042 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f583800cce0 con 0x7f584409e870 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.827+0000 7f5836ffd700 1 -- 172.21.15.154:0/1592627042 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f583803fa90 con 0x7f584409e870 2023-09-30T22:27:09.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.827+0000 7f584c7a9700 1 -- 172.21.15.154:0/1592627042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584404f2a0 con 0x7f584409e870 2023-09-30T22:27:09.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:09.832+0000 7f5836ffd700 1 -- 172.21.15.154:0/1592627042 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5838021020 con 0x7f584409e870 2023-09-30T22:27:09.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:09.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:10.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.022+0000 7f584c7a9700 1 -- 172.21.15.154:0/1592627042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f58441247d0 con 0x7f584409e870 2023-09-30T22:27:10.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.023+0000 7f5836ffd700 1 -- 172.21.15.154:0/1592627042 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f583801b3b0 con 0x7f584409e870 2023-09-30T22:27:10.024 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:10.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.025+0000 7f584c7a9700 1 -- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584409e870 msgr2=0x7f584406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.025+0000 7f584c7a9700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584409e870 0x7f584406b8b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f583800ec10 tx=0x7f583800ef20 comp rx=0 tx=0).stop 2023-09-30T22:27:10.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.025+0000 7f584c7a9700 1 -- 172.21.15.154:0/1592627042 shutdown_connections 2023-09-30T22:27:10.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.025+0000 7f584c7a9700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5844131f40 0x7f584406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.025+0000 7f584c7a9700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f584409e870 0x7f584406b8b0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.025+0000 7f584c7a9700 1 --2- 172.21.15.154:0/1592627042 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f584409f180 0x7f584406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.025+0000 7f584c7a9700 1 -- 172.21.15.154:0/1592627042 >> 172.21.15.154:0/1592627042 conn(0x7f58440a4430 msgr2=0x7f584411a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.025+0000 7f584c7a9700 1 -- 172.21.15.154:0/1592627042 shutdown_connections 2023-09-30T22:27:10.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.025+0000 7f584c7a9700 1 -- 172.21.15.154:0/1592627042 wait complete. 2023-09-30T22:27:10.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:10.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:10.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.068+0000 7f5f8c2f1700 1 Processor -- start 2023-09-30T22:27:10.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.068+0000 7f5f8c2f1700 1 -- start start 2023-09-30T22:27:10.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.068+0000 7f5f8c2f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f84133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.068+0000 7f5f8c2f1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f841300a0 0x7f5f841304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.068+0000 7f5f8c2f1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8406b2d0 con 0x7f5f841309f0 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.068+0000 7f5f8c2f1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f84133610 con 0x7f5f841300a0 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.068+0000 7f5f8c2f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8409a500 con 0x7f5f84133ad0 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8988c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f841300a0 0x7f5f841304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8a08d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f84133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8988c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f841300a0 0x7f5f841304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42408/0 (socket says 172.21.15.154:42408) 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8a08d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f84133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32880/0 (socket says 172.21.15.154:32880) 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8988c700 1 -- 172.21.15.154:0/2434792409 learned_addr learned my addr 172.21.15.154:0/2434792409 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8a08d700 1 -- 172.21.15.154:0/2434792409 >> v2:172.21.15.154:3300/0 conn(0x7f5f841300a0 msgr2=0x7f5f841304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:10.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8a08d700 1 --2- 172.21.15.154:0/2434792409 >> v2:172.21.15.154:3300/0 conn(0x7f5f841300a0 0x7f5f841304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8a08d700 1 -- 172.21.15.154:0/2434792409 >> v1:172.21.15.154:6789/0 conn(0x7f5f841309f0 legacy=0x7f5f8413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8a08d700 1 -- 172.21.15.154:0/2434792409 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f841338b0 con 0x7f5f84133ad0 2023-09-30T22:27:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8908b700 1 -- 172.21.15.154:0/2434792409 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444476643 0 0) 0x7f5f8406b2d0 con 0x7f5f841309f0 2023-09-30T22:27:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8988c700 1 --2- 172.21.15.154:0/2434792409 >> v2:172.21.15.154:3300/0 conn(0x7f5f841300a0 0x7f5f841304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8a08d700 1 --2- 172.21.15.154:0/2434792409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f84133ea0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009840 tx=0x7f5f80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16791c3878736a89 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8908b700 1 -- 172.21.15.154:0/2434792409 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80011830 con 0x7f5f84133ad0 2023-09-30T22:27:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8908b700 1 -- 172.21.15.154:0/2434792409 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f80011990 con 0x7f5f84133ad0 2023-09-30T22:27:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.069+0000 7f5f8908b700 1 -- 172.21.15.154:0/2434792409 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80011d20 con 0x7f5f84133ad0 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.070+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/2434792409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 msgr2=0x7f5f84133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.070+0000 7f5f8c2f1700 1 --2- 172.21.15.154:0/2434792409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f84133ea0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009840 tx=0x7f5f80009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.070+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/2434792409 shutdown_connections 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.070+0000 7f5f8c2f1700 1 --2- 172.21.15.154:0/2434792409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f84133ea0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.070+0000 7f5f8c2f1700 1 --2- 172.21.15.154:0/2434792409 >> v2:172.21.15.154:3300/0 conn(0x7f5f841300a0 0x7f5f841304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.070+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/2434792409 >> 172.21.15.154:0/2434792409 conn(0x7f5f84099c40 msgr2=0x7f5f840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.070+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/2434792409 shutdown_connections 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.070+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/2434792409 wait complete. 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.072+0000 7f5f8c2f1700 1 Processor -- start 2023-09-30T22:27:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.072+0000 7f5f8c2f1700 1 -- start start 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.072+0000 7f5f8c2f1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f841300a0 0x7f5f8411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.072+0000 7f5f8c2f1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f841309f0 0x7f5f8411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.072+0000 7f5f8c2f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f8411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.072+0000 7f5f8c2f1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8411f0b0 con 0x7f5f841300a0 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.072+0000 7f5f8c2f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8411fde0 con 0x7f5f84133ad0 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.072+0000 7f5f8c2f1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8411fbb0 con 0x7f5f841309f0 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a88e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f8411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8988c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f841309f0 0x7f5f8411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a08d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f841300a0 0x7f5f8411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a88e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f8411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32884/0 (socket says 172.21.15.154:32884) 2023-09-30T22:27:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a88e700 1 -- 172.21.15.154:0/743858891 learned_addr learned my addr 172.21.15.154:0/743858891 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a88e700 1 -- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f841309f0 msgr2=0x7f5f8411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a88e700 1 --2- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f841309f0 0x7f5f8411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a88e700 1 -- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f841300a0 msgr2=0x7f5f8411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a88e700 1 --2- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f841300a0 0x7f5f8411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a88e700 1 -- 172.21.15.154:0/743858891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009550 con 0x7f5f84133ad0 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a08d700 1 --2- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f841300a0 0x7f5f8411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8a88e700 1 --2- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f8411e4c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c001560 tx=0x7f5f7c00cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f7affd700 1 -- 172.21.15.154:0/743858891 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c003e30 con 0x7f5f84133ad0 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f7affd700 1 -- 172.21.15.154:0/743858891 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c005070 con 0x7f5f84133ad0 2023-09-30T22:27:10.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f7affd700 1 -- 172.21.15.154:0/743858891 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c005420 con 0x7f5f84133ad0 2023-09-30T22:27:10.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/743858891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f800094a0 con 0x7f5f84133ad0 2023-09-30T22:27:10.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.073+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/743858891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8412dd00 con 0x7f5f84133ad0 2023-09-30T22:27:10.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.074+0000 7f5f7affd700 1 -- 172.21.15.154:0/743858891 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f7c005580 con 0x7f5f84133ad0 2023-09-30T22:27:10.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.074+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/743858891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8409cb20 con 0x7f5f84133ad0 2023-09-30T22:27:10.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.075+0000 7f5f7affd700 1 -- 172.21.15.154:0/743858891 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f7c03ed10 con 0x7f5f84133ad0 2023-09-30T22:27:10.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.083+0000 7f5f7affd700 1 -- 172.21.15.154:0/743858891 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f7c00ab40 con 0x7f5f84133ad0 2023-09-30T22:27:10.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.120+0000 7fb64fac1700 1 Processor -- start 2023-09-30T22:27:10.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.120+0000 7fb64fac1700 1 -- start start 2023-09-30T22:27:10.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.120+0000 7fb64fac1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a1550 0x7fb648138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.120+0000 7fb64fac1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 0x7fb64813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.120+0000 7fb64fac1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64809e9d0 con 0x7fb6480a0a70 2023-09-30T22:27:10.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.120+0000 7fb64fac1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64809dc00 con 0x7fb6480a1550 2023-09-30T22:27:10.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.120+0000 7fb64fac1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb64809dec0 con 0x7fb648139200 2023-09-30T22:27:10.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64e05e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 0x7fb64813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64d85d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb6480a0a70 0x7fb6480a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41348/0 (socket says 172.21.15.154:41348) 2023-09-30T22:27:10.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64d85d700 1 -- 172.21.15.154:0/1557515808 learned_addr learned my addr 172.21.15.154:0/1557515808 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:10.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64d05c700 1 --2- 172.21.15.154:0/1557515808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a1550 0x7fb648138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64e05e700 1 -- 172.21.15.154:0/1557515808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a1550 msgr2=0x7fb648138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:10.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64e05e700 1 --2- 172.21.15.154:0/1557515808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a1550 0x7fb648138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64e05e700 1 -- 172.21.15.154:0/1557515808 >> v1:172.21.15.154:6789/0 conn(0x7fb6480a0a70 legacy=0x7fb6480a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64e05e700 1 -- 172.21.15.154:0/1557515808 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64809e6a0 con 0x7fb648139200 2023-09-30T22:27:10.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64e05e700 1 --2- 172.21.15.154:0/1557515808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 0x7fb64813b5e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb640009dc0 tx=0x7fb64000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b780be0dec9fd0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64c85b700 1 -- 172.21.15.154:0/1557515808 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64000e070 con 0x7fb648139200 2023-09-30T22:27:10.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64c85b700 1 -- 172.21.15.154:0/1557515808 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64000bb20 con 0x7fb648139200 2023-09-30T22:27:10.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.121+0000 7fb64c85b700 1 -- 172.21.15.154:0/1557515808 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb640012430 con 0x7fb648139200 2023-09-30T22:27:10.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.122+0000 7fb64fac1700 1 -- 172.21.15.154:0/1557515808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 msgr2=0x7fb64813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.122+0000 7fb64fac1700 1 --2- 172.21.15.154:0/1557515808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 0x7fb64813b5e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb640009dc0 tx=0x7fb64000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:10.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.122+0000 7fb64fac1700 1 -- 172.21.15.154:0/1557515808 shutdown_connections 2023-09-30T22:27:10.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.122+0000 7fb64fac1700 1 --2- 172.21.15.154:0/1557515808 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 0x7fb64813b5e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.122+0000 7fb64fac1700 1 --2- 172.21.15.154:0/1557515808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a1550 0x7fb648138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.122+0000 7fb64fac1700 1 -- 172.21.15.154:0/1557515808 >> 172.21.15.154:0/1557515808 conn(0x7fb6480a6610 msgr2=0x7fb6480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.122+0000 7fb64fac1700 1 -- 172.21.15.154:0/1557515808 shutdown_connections 2023-09-30T22:27:10.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.122+0000 7fb64fac1700 1 -- 172.21.15.154:0/1557515808 wait complete. 2023-09-30T22:27:10.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.123+0000 7fb64fac1700 1 Processor -- start 2023-09-30T22:27:10.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.123+0000 7fb64fac1700 1 -- start start 2023-09-30T22:27:10.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.123+0000 7fb64fac1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a0a70 0x7fb64811e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.123+0000 7fb64fac1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6480a1550 0x7fb64811ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.123+0000 7fb64fac1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 0x7fb64811f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.123+0000 7fb64fac1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb648134100 con 0x7fb6480a1550 2023-09-30T22:27:10.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.123+0000 7fb64fac1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb648122310 con 0x7fb6480a0a70 2023-09-30T22:27:10.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.123+0000 7fb64fac1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6480a03e0 con 0x7fb648139200 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d05c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6480a1550 0x7fb64811ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d85d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a0a70 0x7fb64811e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d05c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6480a1550 0x7fb64811ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42422/0 (socket says 172.21.15.154:42422) 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d85d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a0a70 0x7fb64811e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32900/0 (socket says 172.21.15.154:32900) 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d05c700 1 -- 172.21.15.154:0/2468899463 learned_addr learned my addr 172.21.15.154:0/2468899463 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64e05e700 1 --2- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 0x7fb64811f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d05c700 1 -- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 msgr2=0x7fb64811f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d05c700 1 --2- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 0x7fb64811f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d05c700 1 -- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a0a70 msgr2=0x7fb64811e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d05c700 1 --2- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a0a70 0x7fb64811e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d05c700 1 -- 172.21.15.154:0/2468899463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb640009a70 con 0x7fb6480a1550 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64d05c700 1 --2- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6480a1550 0x7fb64811ed30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e9b0 tx=0x7fb63800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb63e7fc700 1 -- 172.21.15.154:0/2468899463 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638009710 con 0x7fb6480a1550 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb63e7fc700 1 -- 172.21.15.154:0/2468899463 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63800ee50 con 0x7fb6480a1550 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64fac1700 1 -- 172.21.15.154:0/2468899463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb648120400 con 0x7fb6480a1550 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb63e7fc700 1 -- 172.21.15.154:0/2468899463 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800ca50 con 0x7fb6480a1550 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.124+0000 7fb64fac1700 1 -- 172.21.15.154:0/2468899463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb648120bf0 con 0x7fb6480a1550 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.125+0000 7fb63e7fc700 1 -- 172.21.15.154:0/2468899463 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb63800cbb0 con 0x7fb6480a1550 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.125+0000 7fb63e7fc700 1 -- 172.21.15.154:0/2468899463 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb63803fa90 con 0x7fb6480a1550 2023-09-30T22:27:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.126+0000 7fb64fac1700 1 -- 172.21.15.154:0/2468899463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64804f2a0 con 0x7fb6480a1550 2023-09-30T22:27:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.130+0000 7fb63e7fc700 1 -- 172.21.15.154:0/2468899463 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb63801b3b0 con 0x7fb6480a1550 2023-09-30T22:27:10.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45be392700 1 Processor -- start 2023-09-30T22:27:10.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45be392700 1 -- start start 2023-09-30T22:27:10.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45be392700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45be392700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45be392700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45b81381e0 0x7f45b813a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45be392700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b80a06c0 con 0x7f45b81381e0 2023-09-30T22:27:10.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45be392700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b809ae90 con 0x7f45b809f260 2023-09-30T22:27:10.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45be392700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45b809ac20 con 0x7f45b809e950 2023-09-30T22:27:10.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45b7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45b7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b809ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33594/0 (socket says 172.21.15.154:33594) 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45b7fff700 1 -- 172.21.15.154:0/1316252896 learned_addr learned my addr 172.21.15.154:0/1316252896 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.163+0000 7f45b77fe700 1 --2- 172.21.15.154:0/1316252896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45bc92f700 1 --2- 172.21.15.154:0/1316252896 >> v2:172.21.15.154:3300/0 conn(0x7f45b81381e0 0x7f45b813a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b77fe700 1 -- 172.21.15.154:0/1316252896 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 msgr2=0x7f45b809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b77fe700 1 --2- 172.21.15.154:0/1316252896 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b77fe700 1 -- 172.21.15.154:0/1316252896 >> v2:172.21.15.154:3300/0 conn(0x7f45b81381e0 msgr2=0x7f45b813a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b77fe700 1 --2- 172.21.15.154:0/1316252896 >> v2:172.21.15.154:3300/0 conn(0x7f45b81381e0 0x7f45b813a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b77fe700 1 -- 172.21.15.154:0/1316252896 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b806ba00 con 0x7f45b809f260 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b7fff700 1 --2- 172.21.15.154:0/1316252896 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:10.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45bc92f700 1 --2- 172.21.15.154:0/1316252896 >> v2:172.21.15.154:3300/0 conn(0x7f45b81381e0 0x7f45b813a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b77fe700 1 --2- 172.21.15.154:0/1316252896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8137ca0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009870 tx=0x7f45ac009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f4f0a2c5f410fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b6ffd700 1 -- 172.21.15.154:0/1316252896 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011830 con 0x7f45b809f260 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b6ffd700 1 -- 172.21.15.154:0/1316252896 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac011990 con 0x7f45b809f260 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.164+0000 7f45b6ffd700 1 -- 172.21.15.154:0/1316252896 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011d20 con 0x7f45b809f260 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.165+0000 7f45be392700 1 -- 172.21.15.154:0/1316252896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 msgr2=0x7f45b8137ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.165+0000 7f45be392700 1 --2- 172.21.15.154:0/1316252896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8137ca0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009870 tx=0x7f45ac009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.165+0000 7f45be392700 1 -- 172.21.15.154:0/1316252896 shutdown_connections 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.165+0000 7f45be392700 1 --2- 172.21.15.154:0/1316252896 >> v2:172.21.15.154:3300/0 conn(0x7f45b81381e0 0x7f45b813a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.165+0000 7f45be392700 1 --2- 172.21.15.154:0/1316252896 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.165+0000 7f45be392700 1 --2- 172.21.15.154:0/1316252896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8137ca0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.165+0000 7f45be392700 1 -- 172.21.15.154:0/1316252896 >> 172.21.15.154:0/1316252896 conn(0x7f45b80a0f70 msgr2=0x7f45b80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.165+0000 7f45be392700 1 -- 172.21.15.154:0/1316252896 shutdown_connections 2023-09-30T22:27:10.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.165+0000 7f45be392700 1 -- 172.21.15.154:0/1316252896 wait complete. 2023-09-30T22:27:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.166+0000 7f45be392700 1 Processor -- start 2023-09-30T22:27:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.166+0000 7f45be392700 1 -- start start 2023-09-30T22:27:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.166+0000 7f45be392700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b8122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.166+0000 7f45be392700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.166+0000 7f45be392700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45b81381e0 0x7f45b81236c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.166+0000 7f45be392700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8124de0 con 0x7f45b81381e0 2023-09-30T22:27:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.166+0000 7f45be392700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80a0890 con 0x7f45b809f260 2023-09-30T22:27:10.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.166+0000 7f45be392700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8124940 con 0x7f45b809e950 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b8122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b8122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33598/0 (socket says 172.21.15.154:33598) 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b7fff700 1 -- 172.21.15.154:0/2742868492 learned_addr learned my addr 172.21.15.154:0/2742868492 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45bc92f700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45b81381e0 0x7f45b81236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b77fe700 1 -- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 msgr2=0x7f45b8122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b77fe700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b8122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b77fe700 1 -- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45b81381e0 msgr2=0x7f45b81236c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b77fe700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45b81381e0 0x7f45b81236c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b77fe700 1 -- 172.21.15.154:0/2742868492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8009500 con 0x7f45b809f260 2023-09-30T22:27:10.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b7fff700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b8122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:10.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45bc92f700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45b81381e0 0x7f45b81236c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:10.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b77fe700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8123180 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f45ac016000 tx=0x7f45ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:10.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b4ff9700 1 -- 172.21.15.154:0/2742868492 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac004450 con 0x7f45b809f260 2023-09-30T22:27:10.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b4ff9700 1 -- 172.21.15.154:0/2742868492 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac01f070 con 0x7f45b809f260 2023-09-30T22:27:10.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45b4ff9700 1 -- 172.21.15.154:0/2742868492 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0038e0 con 0x7f45b809f260 2023-09-30T22:27:10.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45be392700 1 -- 172.21.15.154:0/2742868492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b0009a70 con 0x7f45b809f260 2023-09-30T22:27:10.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.167+0000 7f45be392700 1 -- 172.21.15.154:0/2742868492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac0094a0 con 0x7f45b809f260 2023-09-30T22:27:10.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.168+0000 7f45b4ff9700 1 -- 172.21.15.154:0/2742868492 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45ac003a40 con 0x7f45b809f260 2023-09-30T22:27:10.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.168+0000 7f45be392700 1 -- 172.21.15.154:0/2742868492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b8074f10 con 0x7f45b809f260 2023-09-30T22:27:10.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.168+0000 7f45b4ff9700 1 -- 172.21.15.154:0/2742868492 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f45ac021070 con 0x7f45b809f260 2023-09-30T22:27:10.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.177+0000 7f45b4ff9700 1 -- 172.21.15.154:0/2742868492 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45ac0045b0 con 0x7f45b809f260 2023-09-30T22:27:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.306+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/743858891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f8411ff20 con 0x7f5f84133ad0 2023-09-30T22:27:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.306+0000 7f5f7affd700 1 -- 172.21.15.154:0/743858891 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f8411ff20 con 0x7f5f84133ad0 2023-09-30T22:27:10.307 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:10.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.309+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 msgr2=0x7f5f8411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.309+0000 7f5f8c2f1700 1 --2- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f8411e4c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c001560 tx=0x7f5f7c00cb50 comp rx=0 tx=0).stop 2023-09-30T22:27:10.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.309+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/743858891 shutdown_connections 2023-09-30T22:27:10.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.309+0000 7f5f8c2f1700 1 --2- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f84133ad0 0x7f5f8411e4c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.309+0000 7f5f8c2f1700 1 --2- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f841300a0 0x7f5f8411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.309+0000 7f5f8c2f1700 1 --2- 172.21.15.154:0/743858891 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f841309f0 0x7f5f8411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.309+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/743858891 >> 172.21.15.154:0/743858891 conn(0x7f5f84099c40 msgr2=0x7f5f84132860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.309+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/743858891 shutdown_connections 2023-09-30T22:27:10.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.309+0000 7f5f8c2f1700 1 -- 172.21.15.154:0/743858891 wait complete. 2023-09-30T22:27:10.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:10.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.341+0000 7fb64fac1700 1 -- 172.21.15.154:0/2468899463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb648072980 con 0x7fb6480a1550 2023-09-30T22:27:10.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.342+0000 7fb63e7fc700 1 -- 172.21.15.154:0/2468899463 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb638017020 con 0x7fb6480a1550 2023-09-30T22:27:10.343 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:10.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.344+0000 7fb64fac1700 1 -- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6480a1550 msgr2=0x7fb64811ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.344+0000 7fb64fac1700 1 --2- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6480a1550 0x7fb64811ed30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e9b0 tx=0x7fb63800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.344+0000 7fb64fac1700 1 -- 172.21.15.154:0/2468899463 shutdown_connections 2023-09-30T22:27:10.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.344+0000 7fb64fac1700 1 --2- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb648139200 0x7fb64811f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.344+0000 7fb64fac1700 1 --2- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6480a0a70 0x7fb64811e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.344+0000 7fb64fac1700 1 --2- 172.21.15.154:0/2468899463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6480a1550 0x7fb64811ed30 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.344+0000 7fb64fac1700 1 -- 172.21.15.154:0/2468899463 >> 172.21.15.154:0/2468899463 conn(0x7fb6480a6610 msgr2=0x7fb648138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.344+0000 7fb64fac1700 1 -- 172.21.15.154:0/2468899463 shutdown_connections 2023-09-30T22:27:10.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.344+0000 7fb64fac1700 1 -- 172.21.15.154:0/2468899463 wait complete. 2023-09-30T22:27:10.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:10.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.394+0000 7f45be392700 1 -- 172.21.15.154:0/2742868492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45b804f2a0 con 0x7f45b809f260 2023-09-30T22:27:10.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.395+0000 7f45b4ff9700 1 -- 172.21.15.154:0/2742868492 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45ac02b070 con 0x7f45b809f260 2023-09-30T22:27:10.396 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:10.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.397+0000 7f45be392700 1 -- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 msgr2=0x7f45b8123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:10.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.397+0000 7f45be392700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8123180 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f45ac016000 tx=0x7f45ac004750 comp rx=0 tx=0).stop 2023-09-30T22:27:10.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.397+0000 7f45be392700 1 -- 172.21.15.154:0/2742868492 shutdown_connections 2023-09-30T22:27:10.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.397+0000 7f45be392700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45b81381e0 0x7f45b81236c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.397+0000 7f45be392700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f45b809e950 0x7f45b8122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.397+0000 7f45be392700 1 --2- 172.21.15.154:0/2742868492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45b809f260 0x7f45b8123180 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:10.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.397+0000 7f45be392700 1 -- 172.21.15.154:0/2742868492 >> 172.21.15.154:0/2742868492 conn(0x7f45b80a0f70 msgr2=0x7f45b8071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:10.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.397+0000 7f45be392700 1 -- 172.21.15.154:0/2742868492 shutdown_connections 2023-09-30T22:27:10.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:10.397+0000 7f45be392700 1 -- 172.21.15.154:0/2742868492 wait complete. 2023-09-30T22:27:10.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:11.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:11.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.168+0000 7ff0168f7700 1 Processor -- start 2023-09-30T22:27:11.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.168+0000 7ff0168f7700 1 -- start start 2023-09-30T22:27:11.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff0168f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01012e490 0x7ff01012e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff0168f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 0x7ff01006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff0168f7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff01006acb0 0x7ff01006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff0168f7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01012de50 con 0x7ff01006acb0 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff0168f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01009f6e0 con 0x7ff01012e490 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff0168f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff01009eb00 con 0x7ff01009da10 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff014e94700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff01006acb0 0x7ff01006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff00ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01012e490 0x7ff01012e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff014e94700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff01006acb0 0x7ff01006b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42442/0 (socket says 172.21.15.154:42442) 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff00f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 0x7ff01006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff014e94700 1 -- 172.21.15.154:0/2205648409 learned_addr learned my addr 172.21.15.154:0/2205648409 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff00ffff700 1 -- 172.21.15.154:0/2205648409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 msgr2=0x7ff01006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff00ffff700 1 --2- 172.21.15.154:0/2205648409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 0x7ff01006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff00ffff700 1 -- 172.21.15.154:0/2205648409 >> v2:172.21.15.154:3300/0 conn(0x7ff01006acb0 msgr2=0x7ff01006b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff00ffff700 1 --2- 172.21.15.154:0/2205648409 >> v2:172.21.15.154:3300/0 conn(0x7ff01006acb0 0x7ff01006b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff00ffff700 1 -- 172.21.15.154:0/2205648409 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01009e780 con 0x7ff01012e490 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff00f7fe700 1 --2- 172.21.15.154:0/2205648409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 0x7ff01006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.169+0000 7ff00ffff700 1 --2- 172.21.15.154:0/2205648409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01012e490 0x7ff01012e860 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff0000098a0 tx=0x7ff000009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb931f9501b32daa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff00effd700 1 -- 172.21.15.154:0/2205648409 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011830 con 0x7ff01012e490 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff00effd700 1 -- 172.21.15.154:0/2205648409 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000011990 con 0x7ff01012e490 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff00effd700 1 -- 172.21.15.154:0/2205648409 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011d20 con 0x7ff01012e490 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff0168f7700 1 -- 172.21.15.154:0/2205648409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01012e490 msgr2=0x7ff01012e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff0168f7700 1 --2- 172.21.15.154:0/2205648409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01012e490 0x7ff01012e860 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff0000098a0 tx=0x7ff000009bb0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff0168f7700 1 -- 172.21.15.154:0/2205648409 shutdown_connections 2023-09-30T22:27:11.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff0168f7700 1 --2- 172.21.15.154:0/2205648409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01012e490 0x7ff01012e860 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff0168f7700 1 --2- 172.21.15.154:0/2205648409 >> v2:172.21.15.154:3300/0 conn(0x7ff01006acb0 0x7ff01006b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff0168f7700 1 --2- 172.21.15.154:0/2205648409 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 0x7ff01006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff0168f7700 1 -- 172.21.15.154:0/2205648409 >> 172.21.15.154:0/2205648409 conn(0x7ff010099c40 msgr2=0x7ff0100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff0168f7700 1 -- 172.21.15.154:0/2205648409 shutdown_connections 2023-09-30T22:27:11.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.170+0000 7ff0168f7700 1 -- 172.21.15.154:0/2205648409 wait complete. 2023-09-30T22:27:11.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.171+0000 7ff0168f7700 1 Processor -- start 2023-09-30T22:27:11.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.171+0000 7ff0168f7700 1 -- start start 2023-09-30T22:27:11.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff0168f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01006acb0 0x7ff010070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff0168f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 0x7ff010070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff0168f7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01012e490 0x7ff010071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff0168f7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01011b050 con 0x7ff01012e490 2023-09-30T22:27:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff0168f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01011b230 con 0x7ff01006acb0 2023-09-30T22:27:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff0168f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100a0f10 con 0x7ff01009da10 2023-09-30T22:27:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff014e94700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01012e490 0x7ff010071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff00ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01006acb0 0x7ff010070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff00f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 0x7ff010070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff014e94700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01012e490 0x7ff010071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42452/0 (socket says 172.21.15.154:42452) 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff014e94700 1 -- 172.21.15.154:0/424719649 learned_addr learned my addr 172.21.15.154:0/424719649 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff00ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01006acb0 0x7ff010070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32928/0 (socket says 172.21.15.154:32928) 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff014e94700 1 -- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 msgr2=0x7ff010070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff014e94700 1 --2- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 0x7ff010070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff014e94700 1 -- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01006acb0 msgr2=0x7ff010070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff014e94700 1 --2- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01006acb0 0x7ff010070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff014e94700 1 -- 172.21.15.154:0/424719649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80094a0 con 0x7ff01012e490 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff014e94700 1 --2- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01012e490 0x7ff010071520 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff00800ef00 tx=0x7ff00800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff00cff9700 1 -- 172.21.15.154:0/424719649 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008010040 con 0x7ff01012e490 2023-09-30T22:27:11.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff00cff9700 1 -- 172.21.15.154:0/424719649 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008003c20 con 0x7ff01012e490 2023-09-30T22:27:11.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff0168f7700 1 -- 172.21.15.154:0/424719649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0000094a0 con 0x7ff01012e490 2023-09-30T22:27:11.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.172+0000 7ff00cff9700 1 -- 172.21.15.154:0/424719649 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008004030 con 0x7ff01012e490 2023-09-30T22:27:11.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.173+0000 7ff0168f7700 1 -- 172.21.15.154:0/424719649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff010072680 con 0x7ff01012e490 2023-09-30T22:27:11.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.173+0000 7ff00cff9700 1 -- 172.21.15.154:0/424719649 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff008004190 con 0x7ff01012e490 2023-09-30T22:27:11.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.174+0000 7ff00cff9700 1 -- 172.21.15.154:0/424719649 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff00803f340 con 0x7ff01012e490 2023-09-30T22:27:11.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.174+0000 7ff0168f7700 1 -- 172.21.15.154:0/424719649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff010074f10 con 0x7ff01012e490 2023-09-30T22:27:11.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.178+0000 7ff00cff9700 1 -- 172.21.15.154:0/424719649 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff00801a020 con 0x7ff01012e490 2023-09-30T22:27:11.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:11.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:11.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.368+0000 7ff0168f7700 1 -- 172.21.15.154:0/424719649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff01004f2a0 con 0x7ff01012e490 2023-09-30T22:27:11.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.368+0000 7ff00cff9700 1 -- 172.21.15.154:0/424719649 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff00801db90 con 0x7ff01012e490 2023-09-30T22:27:11.370 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:11.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.372+0000 7ff0168f7700 1 -- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01012e490 msgr2=0x7ff010071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.372+0000 7ff0168f7700 1 --2- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01012e490 0x7ff010071520 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff00800ef00 tx=0x7ff00800ef30 comp rx=0 tx=0).stop 2023-09-30T22:27:11.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.372+0000 7ff0168f7700 1 -- 172.21.15.154:0/424719649 shutdown_connections 2023-09-30T22:27:11.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.372+0000 7ff0168f7700 1 --2- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff01012e490 0x7ff010071520 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.372+0000 7ff0168f7700 1 --2- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff01006acb0 0x7ff010070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.372+0000 7ff0168f7700 1 --2- 172.21.15.154:0/424719649 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff01009da10 0x7ff010070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.372+0000 7ff0168f7700 1 -- 172.21.15.154:0/424719649 >> 172.21.15.154:0/424719649 conn(0x7ff010099c40 msgr2=0x7ff01012cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.372+0000 7ff0168f7700 1 -- 172.21.15.154:0/424719649 shutdown_connections 2023-09-30T22:27:11.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.372+0000 7ff0168f7700 1 -- 172.21.15.154:0/424719649 wait complete. 2023-09-30T22:27:11.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:11.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:11.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.463+0000 7f89de832700 1 Processor -- start 2023-09-30T22:27:11.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.463+0000 7f89de832700 1 -- start start 2023-09-30T22:27:11.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89de832700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f89d8132100 0x7f89d81367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89de832700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 0x7f89d8138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89de832700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d80a0f20 con 0x7f89d8066410 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89de832700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d80667e0 con 0x7f89d8132100 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89de832700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80a23c0 con 0x7f89d81314b0 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d7fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f89d8066410 0x7f89d81319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41350/0 (socket says 172.21.15.154:41350) 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d7fff700 1 -- 172.21.15.154:0/750772311 learned_addr learned my addr 172.21.15.154:0/750772311 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d77fe700 1 --2- 172.21.15.154:0/750772311 >> v2:172.21.15.154:3300/0 conn(0x7f89d8132100 0x7f89d81367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89dcdcf700 1 --2- 172.21.15.154:0/750772311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 0x7f89d8138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d77fe700 1 -- 172.21.15.154:0/750772311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 msgr2=0x7f89d8138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d77fe700 1 --2- 172.21.15.154:0/750772311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 0x7f89d8138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d77fe700 1 -- 172.21.15.154:0/750772311 >> v1:172.21.15.154:6789/0 conn(0x7f89d8066410 legacy=0x7f89d81319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d77fe700 1 -- 172.21.15.154:0/750772311 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80a16e0 con 0x7f89d8132100 2023-09-30T22:27:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d6ffd700 1 -- 172.21.15.154:0/750772311 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476814945 0 0) 0x7f89d80a0f20 con 0x7f89d8066410 2023-09-30T22:27:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d77fe700 1 --2- 172.21.15.154:0/750772311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8132100 0x7f89d81367d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009870 tx=0x7f89cc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3e9d632aa63685 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.464+0000 7f89d6ffd700 1 -- 172.21.15.154:0/750772311 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc011830 con 0x7f89d8132100 2023-09-30T22:27:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89d6ffd700 1 -- 172.21.15.154:0/750772311 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc011990 con 0x7f89d8132100 2023-09-30T22:27:11.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89d6ffd700 1 -- 172.21.15.154:0/750772311 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc011d20 con 0x7f89d8132100 2023-09-30T22:27:11.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89de832700 1 -- 172.21.15.154:0/750772311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8132100 msgr2=0x7f89d81367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89de832700 1 --2- 172.21.15.154:0/750772311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8132100 0x7f89d81367d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009870 tx=0x7f89cc009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:11.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89de832700 1 -- 172.21.15.154:0/750772311 shutdown_connections 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89de832700 1 --2- 172.21.15.154:0/750772311 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 0x7f89d8138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89de832700 1 --2- 172.21.15.154:0/750772311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8132100 0x7f89d81367d0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89de832700 1 -- 172.21.15.154:0/750772311 >> 172.21.15.154:0/750772311 conn(0x7f89d80a2980 msgr2=0x7f89d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89de832700 1 -- 172.21.15.154:0/750772311 shutdown_connections 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.465+0000 7f89de832700 1 -- 172.21.15.154:0/750772311 wait complete. 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.466+0000 7f89de832700 1 Processor -- start 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.466+0000 7f89de832700 1 -- start start 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89de832700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8066410 0x7f89d8119c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89de832700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 0x7f89d811a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89de832700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d81c86c0 0x7f89d81c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89de832700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d811b6f0 con 0x7f89d8066410 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89de832700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d811cda0 con 0x7f89d81c86c0 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89de832700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89d811a6c0 con 0x7f89d81314b0 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8066410 0x7f89d8119c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89d7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8066410 0x7f89d8119c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42472/0 (socket says 172.21.15.154:42472) 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89d7fff700 1 -- 172.21.15.154:0/3037900712 learned_addr learned my addr 172.21.15.154:0/3037900712 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89d77fe700 1 --2- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 0x7f89d811a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89dcdcf700 1 --2- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d81c86c0 0x7f89d81c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89d7fff700 1 -- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 msgr2=0x7f89d811a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89d7fff700 1 --2- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 0x7f89d811a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.467+0000 7f89d7fff700 1 -- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d81c86c0 msgr2=0x7f89d81c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.468+0000 7f89d7fff700 1 --2- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d81c86c0 0x7f89d81c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.468+0000 7f89d7fff700 1 -- 172.21.15.154:0/3037900712 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0094a0 con 0x7f89d8066410 2023-09-30T22:27:11.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.468+0000 7f89d7fff700 1 --2- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8066410 0x7f89d8119c40 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c700 tx=0x7f89c800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.468+0000 7f89d4ff9700 1 -- 172.21.15.154:0/3037900712 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80074e0 con 0x7f89d8066410 2023-09-30T22:27:11.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.468+0000 7f89d4ff9700 1 -- 172.21.15.154:0/3037900712 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c8007640 con 0x7f89d8066410 2023-09-30T22:27:11.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.468+0000 7f89d4ff9700 1 -- 172.21.15.154:0/3037900712 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8005a70 con 0x7f89d8066410 2023-09-30T22:27:11.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.468+0000 7f89de832700 1 -- 172.21.15.154:0/3037900712 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d811c770 con 0x7f89d8066410 2023-09-30T22:27:11.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.468+0000 7f89de832700 1 -- 172.21.15.154:0/3037900712 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d8119890 con 0x7f89d8066410 2023-09-30T22:27:11.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.469+0000 7f89d4ff9700 1 -- 172.21.15.154:0/3037900712 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89c8005bd0 con 0x7f89d8066410 2023-09-30T22:27:11.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.469+0000 7f89d4ff9700 1 -- 172.21.15.154:0/3037900712 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89c803ead0 con 0x7f89d8066410 2023-09-30T22:27:11.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.469+0000 7f89de832700 1 -- 172.21.15.154:0/3037900712 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d804f2a0 con 0x7f89d8066410 2023-09-30T22:27:11.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.474+0000 7f89d4ff9700 1 -- 172.21.15.154:0/3037900712 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89c8017080 con 0x7f89d8066410 2023-09-30T22:27:11.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.496+0000 7f658c516700 1 Processor -- start 2023-09-30T22:27:11.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.496+0000 7f658c516700 1 -- start start 2023-09-30T22:27:11.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.497+0000 7f658c516700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f658409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.497+0000 7f658c516700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658409e170 0x7f65841307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.497+0000 7f658c516700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658409aaa0 con 0x7f6584130ce0 2023-09-30T22:27:11.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.497+0000 7f658c516700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658409f870 con 0x7f658409e170 2023-09-30T22:27:11.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.497+0000 7f658c516700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f658409b360 con 0x7f658409d860 2023-09-30T22:27:11.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.497+0000 7f658aab3700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6584130ce0 0x7f65841379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41360/0 (socket says 172.21.15.154:41360) 2023-09-30T22:27:11.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.497+0000 7f6589ab1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658409e170 0x7f65841307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.497+0000 7f658aab3700 1 -- 172.21.15.154:0/2834070887 learned_addr learned my addr 172.21.15.154:0/2834070887 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.497+0000 7f658a2b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f658409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f65892b0700 1 -- 172.21.15.154:0/2834070887 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722995895 0 0) 0x7f658409aaa0 con 0x7f6584130ce0 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f65892b0700 1 -- 172.21.15.154:0/2834070887 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65700035b0 con 0x7f6584130ce0 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f658a2b2700 1 -- 172.21.15.154:0/2834070887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658409e170 msgr2=0x7f65841307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f658a2b2700 1 --2- 172.21.15.154:0/2834070887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658409e170 0x7f65841307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f658a2b2700 1 -- 172.21.15.154:0/2834070887 >> v1:172.21.15.154:6789/0 conn(0x7f6584130ce0 legacy=0x7f65841379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f658a2b2700 1 -- 172.21.15.154:0/2834070887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658409b620 con 0x7f658409d860 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f6589ab1700 1 --2- 172.21.15.154:0/2834070887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658409e170 0x7f65841307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f658a2b2700 1 --2- 172.21.15.154:0/2834070887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f658409dc30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6580009870 tx=0x7f6580009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6635704263e5ea29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f65892b0700 1 -- 172.21.15.154:0/2834070887 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580011830 con 0x7f658409d860 2023-09-30T22:27:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f65892b0700 1 -- 172.21.15.154:0/2834070887 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580011990 con 0x7f658409d860 2023-09-30T22:27:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.498+0000 7f65892b0700 1 -- 172.21.15.154:0/2834070887 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580011d20 con 0x7f658409d860 2023-09-30T22:27:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.499+0000 7f658c516700 1 -- 172.21.15.154:0/2834070887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 msgr2=0x7f658409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.499+0000 7f658c516700 1 --2- 172.21.15.154:0/2834070887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f658409dc30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6580009870 tx=0x7f6580009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.499+0000 7f658c516700 1 -- 172.21.15.154:0/2834070887 shutdown_connections 2023-09-30T22:27:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.499+0000 7f658c516700 1 --2- 172.21.15.154:0/2834070887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f658409dc30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.499+0000 7f658c516700 1 --2- 172.21.15.154:0/2834070887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f658409e170 0x7f65841307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.499+0000 7f658c516700 1 -- 172.21.15.154:0/2834070887 >> 172.21.15.154:0/2834070887 conn(0x7f6584099c40 msgr2=0x7f65840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.499+0000 7f658c516700 1 -- 172.21.15.154:0/2834070887 shutdown_connections 2023-09-30T22:27:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.499+0000 7f658c516700 1 -- 172.21.15.154:0/2834070887 wait complete. 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.500+0000 7f658c516700 1 Processor -- start 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.500+0000 7f658c516700 1 -- start start 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658c516700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f6584135600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658c516700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658409e170 0x7f6584135b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658c516700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6584130ce0 0x7f6584136080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658c516700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6584071fe0 con 0x7f658409e170 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658c516700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6584138ae0 con 0x7f6584130ce0 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658c516700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6584137720 con 0x7f658409d860 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658a2b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f6584135600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658a2b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f6584135600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33652/0 (socket says 172.21.15.154:33652) 2023-09-30T22:27:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658a2b2700 1 -- 172.21.15.154:0/871795361 learned_addr learned my addr 172.21.15.154:0/871795361 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658aab3700 1 --2- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6584130ce0 0x7f6584136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f6589ab1700 1 --2- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658409e170 0x7f6584135b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658a2b2700 1 -- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6584130ce0 msgr2=0x7f6584136080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658a2b2700 1 --2- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6584130ce0 0x7f6584136080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658a2b2700 1 -- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658409e170 msgr2=0x7f6584135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658a2b2700 1 --2- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658409e170 0x7f6584135b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658a2b2700 1 -- 172.21.15.154:0/871795361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740094a0 con 0x7f658409d860 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.501+0000 7f658a2b2700 1 --2- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f6584135600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6580009bc0 tx=0x7f6580004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.502+0000 7f657affd700 1 -- 172.21.15.154:0/871795361 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580004510 con 0x7f658409d860 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.502+0000 7f657affd700 1 -- 172.21.15.154:0/871795361 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658001f070 con 0x7f658409d860 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.502+0000 7f658c516700 1 -- 172.21.15.154:0/871795361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65800094a0 con 0x7f658409d860 2023-09-30T22:27:11.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.502+0000 7f657affd700 1 -- 172.21.15.154:0/871795361 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800038e0 con 0x7f658409d860 2023-09-30T22:27:11.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.502+0000 7f658c516700 1 -- 172.21.15.154:0/871795361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6584137960 con 0x7f658409d860 2023-09-30T22:27:11.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.502+0000 7f657affd700 1 -- 172.21.15.154:0/871795361 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6580003a40 con 0x7f658409d860 2023-09-30T22:27:11.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.503+0000 7f657affd700 1 -- 172.21.15.154:0/871795361 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6580021070 con 0x7f658409d860 2023-09-30T22:27:11.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.503+0000 7f658c516700 1 -- 172.21.15.154:0/871795361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658404f2a0 con 0x7f658409d860 2023-09-30T22:27:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.507+0000 7f657affd700 1 -- 172.21.15.154:0/871795361 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f658001a430 con 0x7f658409d860 2023-09-30T22:27:11.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.589+0000 7fa6a7b87700 1 Processor -- start 2023-09-30T22:27:11.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.589+0000 7fa6a7b87700 1 -- start start 2023-09-30T22:27:11.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.589+0000 7fa6a7b87700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6a009e950 0x7fa6a009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a7b87700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a009f260 0x7fa6a0131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a7b87700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a0131dd0 0x7fa6a0132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a7b87700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a009b6d0 con 0x7fa6a009e950 2023-09-30T22:27:11.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a7b87700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a009afb0 con 0x7fa6a009f260 2023-09-30T22:27:11.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a7b87700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a00a0970 con 0x7fa6a0131dd0 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5122700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a009f260 0x7fa6a0131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5122700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a009f260 0x7fa6a0131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32954/0 (socket says 172.21.15.154:32954) 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5122700 1 -- 172.21.15.154:0/1023766041 learned_addr learned my addr 172.21.15.154:0/1023766041 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5923700 1 --2- 172.21.15.154:0/1023766041 >> v2:172.21.15.154:3300/0 conn(0x7fa6a009e950 0x7fa6a009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a6124700 1 --2- 172.21.15.154:0/1023766041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a0131dd0 0x7fa6a0132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5122700 1 -- 172.21.15.154:0/1023766041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a0131dd0 msgr2=0x7fa6a0132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5122700 1 --2- 172.21.15.154:0/1023766041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a0131dd0 0x7fa6a0132250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5122700 1 -- 172.21.15.154:0/1023766041 >> v2:172.21.15.154:3300/0 conn(0x7fa6a009e950 msgr2=0x7fa6a009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5122700 1 --2- 172.21.15.154:0/1023766041 >> v2:172.21.15.154:3300/0 conn(0x7fa6a009e950 0x7fa6a009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5122700 1 -- 172.21.15.154:0/1023766041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00a0320 con 0x7fa6a009f260 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5923700 1 --2- 172.21.15.154:0/1023766041 >> v2:172.21.15.154:3300/0 conn(0x7fa6a009e950 0x7fa6a009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a6124700 1 --2- 172.21.15.154:0/1023766041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a0131dd0 0x7fa6a0132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a5122700 1 --2- 172.21.15.154:0/1023766041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a009f260 0x7fa6a0131890 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa6900098f0 tx=0x7fa690009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68aa15554a165d2c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a4921700 1 -- 172.21.15.154:0/1023766041 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa690011830 con 0x7fa6a009f260 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a4921700 1 -- 172.21.15.154:0/1023766041 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa690011990 con 0x7fa6a009f260 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.590+0000 7fa6a4921700 1 -- 172.21.15.154:0/1023766041 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa690011d20 con 0x7fa6a009f260 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.591+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1023766041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a009f260 msgr2=0x7fa6a0131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.591+0000 7fa6a7b87700 1 --2- 172.21.15.154:0/1023766041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a009f260 0x7fa6a0131890 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa6900098f0 tx=0x7fa690009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.591+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1023766041 shutdown_connections 2023-09-30T22:27:11.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.591+0000 7fa6a7b87700 1 --2- 172.21.15.154:0/1023766041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a0131dd0 0x7fa6a0132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.591+0000 7fa6a7b87700 1 --2- 172.21.15.154:0/1023766041 >> v2:172.21.15.154:3300/0 conn(0x7fa6a009e950 0x7fa6a009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.591+0000 7fa6a7b87700 1 --2- 172.21.15.154:0/1023766041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a009f260 0x7fa6a0131890 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.591+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1023766041 >> 172.21.15.154:0/1023766041 conn(0x7fa6a00a0f70 msgr2=0x7fa6a00a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.591+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1023766041 shutdown_connections 2023-09-30T22:27:11.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.591+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1023766041 wait complete. 2023-09-30T22:27:11.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.592+0000 7fa6a7b87700 1 Processor -- start 2023-09-30T22:27:11.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.592+0000 7fa6a7b87700 1 -- start start 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a7b87700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a009e950 0x7fa6a006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a7b87700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a009f260 0x7fa6a006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a7b87700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a0131dd0 0x7fa6a006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a7b87700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a006d670 con 0x7fa6a009e950 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a7b87700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a006d480 con 0x7fa6a0131dd0 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a7b87700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a009da40 con 0x7fa6a009f260 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5122700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a009f260 0x7fa6a006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5122700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a009f260 0x7fa6a006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33666/0 (socket says 172.21.15.154:33666) 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5122700 1 -- 172.21.15.154:0/1992991030 learned_addr learned my addr 172.21.15.154:0/1992991030 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5923700 1 --2- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a009e950 0x7fa6a006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a6124700 1 --2- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a0131dd0 0x7fa6a006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5122700 1 -- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a0131dd0 msgr2=0x7fa6a006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5122700 1 --2- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a0131dd0 0x7fa6a006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5122700 1 -- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a009e950 msgr2=0x7fa6a006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5122700 1 --2- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a009e950 0x7fa6a006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5122700 1 -- 172.21.15.154:0/1992991030 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c009430 con 0x7fa6a009f260 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a5122700 1 --2- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a009f260 0x7fa6a006bdf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa690000c00 tx=0x7fa690004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6967fc700 1 -- 172.21.15.154:0/1992991030 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa690004240 con 0x7fa6a009f260 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6967fc700 1 -- 172.21.15.154:0/1992991030 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69001f070 con 0x7fa6a009f260 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1992991030 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa698009a70 con 0x7fa6a009f260 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.593+0000 7fa6967fc700 1 -- 172.21.15.154:0/1992991030 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900045a0 con 0x7fa6a009f260 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.594+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1992991030 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa690009550 con 0x7fa6a009f260 2023-09-30T22:27:11.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.594+0000 7fa6967fc700 1 -- 172.21.15.154:0/1992991030 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa690021030 con 0x7fa6a009f260 2023-09-30T22:27:11.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.594+0000 7fa6967fc700 1 -- 172.21.15.154:0/1992991030 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa690040800 con 0x7fa6a009f260 2023-09-30T22:27:11.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.595+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1992991030 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a01251d0 con 0x7fa6a009f260 2023-09-30T22:27:11.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.599+0000 7fa6967fc700 1 -- 172.21.15.154:0/1992991030 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6a01251d0 con 0x7fa6a009f260 2023-09-30T22:27:11.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.702+0000 7f658c516700 1 -- 172.21.15.154:0/871795361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f658406c3b0 con 0x7f658409d860 2023-09-30T22:27:11.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.702+0000 7f657affd700 1 -- 172.21.15.154:0/871795361 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6580015030 con 0x7f658409d860 2023-09-30T22:27:11.703 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:11.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.704+0000 7f658c516700 1 -- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 msgr2=0x7f6584135600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.704+0000 7f658c516700 1 --2- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f6584135600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6580009bc0 tx=0x7f6580004750 comp rx=0 tx=0).stop 2023-09-30T22:27:11.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.704+0000 7f658c516700 1 -- 172.21.15.154:0/871795361 shutdown_connections 2023-09-30T22:27:11.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.704+0000 7f658c516700 1 --2- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6584130ce0 0x7f6584136080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.704+0000 7f658c516700 1 --2- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f658409d860 0x7f6584135600 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.704+0000 7f658c516700 1 --2- 172.21.15.154:0/871795361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658409e170 0x7f6584135b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.704+0000 7f658c516700 1 -- 172.21.15.154:0/871795361 >> 172.21.15.154:0/871795361 conn(0x7f6584099c40 msgr2=0x7f65841393e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.704+0000 7f658c516700 1 -- 172.21.15.154:0/871795361 shutdown_connections 2023-09-30T22:27:11.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.704+0000 7f658c516700 1 -- 172.21.15.154:0/871795361 wait complete. 2023-09-30T22:27:11.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:11.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.727+0000 7f89de832700 1 -- 172.21.15.154:0/3037900712 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89d80724c0 con 0x7f89d8066410 2023-09-30T22:27:11.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.728+0000 7f89d4ff9700 1 -- 172.21.15.154:0/3037900712 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89c8018260 con 0x7f89d8066410 2023-09-30T22:27:11.729 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.730+0000 7f89de832700 1 -- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8066410 msgr2=0x7f89d8119c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.730+0000 7f89de832700 1 --2- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8066410 0x7f89d8119c40 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c700 tx=0x7f89c800ca10 comp rx=0 tx=0).stop 2023-09-30T22:27:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.730+0000 7f89de832700 1 -- 172.21.15.154:0/3037900712 shutdown_connections 2023-09-30T22:27:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.730+0000 7f89de832700 1 --2- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89d81c86c0 0x7f89d81c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.730+0000 7f89de832700 1 --2- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89d8066410 0x7f89d8119c40 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.730+0000 7f89de832700 1 --2- 172.21.15.154:0/3037900712 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f89d81314b0 0x7f89d811a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.730+0000 7f89de832700 1 -- 172.21.15.154:0/3037900712 >> 172.21.15.154:0/3037900712 conn(0x7f89d80a2980 msgr2=0x7f89d8099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.730+0000 7f89de832700 1 -- 172.21.15.154:0/3037900712 shutdown_connections 2023-09-30T22:27:11.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.730+0000 7f89de832700 1 -- 172.21.15.154:0/3037900712 wait complete. 2023-09-30T22:27:11.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:11.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.818+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1992991030 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6a01251d0 con 0x7fa6a009f260 2023-09-30T22:27:11.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.818+0000 7fa6967fc700 1 -- 172.21.15.154:0/1992991030 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa690015080 con 0x7fa6a009f260 2023-09-30T22:27:11.819 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:11.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.820+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a009f260 msgr2=0x7fa6a006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:11.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.820+0000 7fa6a7b87700 1 --2- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a009f260 0x7fa6a006bdf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa690000c00 tx=0x7fa690004750 comp rx=0 tx=0).stop 2023-09-30T22:27:11.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.820+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1992991030 shutdown_connections 2023-09-30T22:27:11.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.820+0000 7fa6a7b87700 1 --2- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a0131dd0 0x7fa6a006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.820+0000 7fa6a7b87700 1 --2- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a009e950 0x7fa6a006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.820+0000 7fa6a7b87700 1 --2- 172.21.15.154:0/1992991030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6a009f260 0x7fa6a006bdf0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.820+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1992991030 >> 172.21.15.154:0/1992991030 conn(0x7fa6a00a0f70 msgr2=0x7fa6a00a2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.820+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1992991030 shutdown_connections 2023-09-30T22:27:11.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:11.820+0000 7fa6a7b87700 1 -- 172.21.15.154:0/1992991030 wait complete. 2023-09-30T22:27:11.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:12.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.516+0000 7fb465eff700 1 Processor -- start 2023-09-30T22:27:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.516+0000 7fb465eff700 1 -- start start 2023-09-30T22:27:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.516+0000 7fb465eff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb460133ad0 0x7fb460133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.516+0000 7fb465eff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb4601304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.516+0000 7fb465eff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4601309f0 0x7fb46013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.516+0000 7fb465eff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46006b2d0 con 0x7fb460133ad0 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.516+0000 7fb465eff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb460133610 con 0x7fb4601309f0 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.516+0000 7fb465eff700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46009a500 con 0x7fb4601300a0 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb460133ad0 0x7fb460133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb4601304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4601309f0 0x7fb46013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb4601304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33670/0 (socket says 172.21.15.154:33670) 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb460133ad0 0x7fb460133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42500/0 (socket says 172.21.15.154:42500) 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4601309f0 0x7fb46013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:32984/0 (socket says 172.21.15.154:32984) 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45effd700 1 -- 172.21.15.154:0/634196913 learned_addr learned my addr 172.21.15.154:0/634196913 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45effd700 1 -- 172.21.15.154:0/634196913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4601309f0 msgr2=0x7fb46013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:12.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45effd700 1 --2- 172.21.15.154:0/634196913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4601309f0 0x7fb46013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45effd700 1 -- 172.21.15.154:0/634196913 >> v2:172.21.15.154:3300/0 conn(0x7fb460133ad0 msgr2=0x7fb460133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45effd700 1 --2- 172.21.15.154:0/634196913 >> v2:172.21.15.154:3300/0 conn(0x7fb460133ad0 0x7fb460133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45effd700 1 -- 172.21.15.154:0/634196913 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4601338b0 con 0x7fb4601300a0 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45ffff700 1 --2- 172.21.15.154:0/634196913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4601309f0 0x7fb46013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45f7fe700 1 --2- 172.21.15.154:0/634196913 >> v2:172.21.15.154:3300/0 conn(0x7fb460133ad0 0x7fb460133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45effd700 1 --2- 172.21.15.154:0/634196913 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb4601304b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb4500098f0 tx=0x7fb450009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf36224499325a56 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45e7fc700 1 -- 172.21.15.154:0/634196913 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450011830 con 0x7fb4601300a0 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45e7fc700 1 -- 172.21.15.154:0/634196913 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb450011990 con 0x7fb4601300a0 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.517+0000 7fb45e7fc700 1 -- 172.21.15.154:0/634196913 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450011d20 con 0x7fb4601300a0 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.518+0000 7fb465eff700 1 -- 172.21.15.154:0/634196913 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 msgr2=0x7fb4601304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.518+0000 7fb465eff700 1 --2- 172.21.15.154:0/634196913 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb4601304b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb4500098f0 tx=0x7fb450009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:12.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.518+0000 7fb465eff700 1 -- 172.21.15.154:0/634196913 shutdown_connections 2023-09-30T22:27:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.518+0000 7fb465eff700 1 --2- 172.21.15.154:0/634196913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4601309f0 0x7fb46013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.518+0000 7fb465eff700 1 --2- 172.21.15.154:0/634196913 >> v2:172.21.15.154:3300/0 conn(0x7fb460133ad0 0x7fb460133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.518+0000 7fb465eff700 1 --2- 172.21.15.154:0/634196913 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb4601304b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.518+0000 7fb465eff700 1 -- 172.21.15.154:0/634196913 >> 172.21.15.154:0/634196913 conn(0x7fb460099c40 msgr2=0x7fb4600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.518+0000 7fb465eff700 1 -- 172.21.15.154:0/634196913 shutdown_connections 2023-09-30T22:27:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.518+0000 7fb465eff700 1 -- 172.21.15.154:0/634196913 wait complete. 2023-09-30T22:27:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb465eff700 1 Processor -- start 2023-09-30T22:27:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb465eff700 1 -- start start 2023-09-30T22:27:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb465eff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb46011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb465eff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4601309f0 0x7fb46011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb465eff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb460133ad0 0x7fb46011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb465eff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4601209f0 con 0x7fb4601309f0 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb465eff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46012f920 con 0x7fb460133ad0 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb465eff700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46012d8c0 con 0x7fb4601300a0 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb45f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb46011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb45f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb46011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33680/0 (socket says 172.21.15.154:33680) 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb45f7fe700 1 -- 172.21.15.154:0/486205836 learned_addr learned my addr 172.21.15.154:0/486205836 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb45effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4601309f0 0x7fb46011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.519+0000 7fb45ffff700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb460133ad0 0x7fb46011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb45f7fe700 1 -- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb460133ad0 msgr2=0x7fb46011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb45f7fe700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb460133ad0 0x7fb46011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb45f7fe700 1 -- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4601309f0 msgr2=0x7fb46011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb45f7fe700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4601309f0 0x7fb46011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb45f7fe700 1 -- 172.21.15.154:0/486205836 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458009a70 con 0x7fb4601300a0 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb45effd700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4601309f0 0x7fb46011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb45ffff700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb460133ad0 0x7fb46011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb45f7fe700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb46011da40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb45400ec10 tx=0x7fb45400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb447fff700 1 -- 172.21.15.154:0/486205836 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400c850 con 0x7fb4601300a0 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb447fff700 1 -- 172.21.15.154:0/486205836 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400c9b0 con 0x7fb4601300a0 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb447fff700 1 -- 172.21.15.154:0/486205836 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400cd20 con 0x7fb4601300a0 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb465eff700 1 -- 172.21.15.154:0/486205836 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4540094a0 con 0x7fb4601300a0 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.520+0000 7fb465eff700 1 -- 172.21.15.154:0/486205836 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb450009550 con 0x7fb4601300a0 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.521+0000 7fb447fff700 1 -- 172.21.15.154:0/486205836 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb454013470 con 0x7fb4601300a0 2023-09-30T22:27:12.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.521+0000 7fb447fff700 1 -- 172.21.15.154:0/486205836 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb45403f730 con 0x7fb4601300a0 2023-09-30T22:27:12.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.521+0000 7fb465eff700 1 -- 172.21.15.154:0/486205836 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46011ed60 con 0x7fb4601300a0 2023-09-30T22:27:12.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.526+0000 7fb447fff700 1 -- 172.21.15.154:0/486205836 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb46011ed60 con 0x7fb4601300a0 2023-09-30T22:27:12.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.709+0000 7fb465eff700 1 -- 172.21.15.154:0/486205836 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb46009cb20 con 0x7fb4601300a0 2023-09-30T22:27:12.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.710+0000 7fb447fff700 1 -- 172.21.15.154:0/486205836 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb454021020 con 0x7fb4601300a0 2023-09-30T22:27:12.711 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:12.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.712+0000 7fb465eff700 1 -- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 msgr2=0x7fb46011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.712+0000 7fb465eff700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb46011da40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb45400ec10 tx=0x7fb45400ef20 comp rx=0 tx=0).stop 2023-09-30T22:27:12.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.712+0000 7fb465eff700 1 -- 172.21.15.154:0/486205836 shutdown_connections 2023-09-30T22:27:12.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.712+0000 7fb465eff700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb460133ad0 0x7fb46011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.712+0000 7fb465eff700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb4601300a0 0x7fb46011da40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.712+0000 7fb465eff700 1 --2- 172.21.15.154:0/486205836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4601309f0 0x7fb46011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.712+0000 7fb465eff700 1 -- 172.21.15.154:0/486205836 >> 172.21.15.154:0/486205836 conn(0x7fb460099c40 msgr2=0x7fb460132ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:12.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.712+0000 7fb465eff700 1 -- 172.21.15.154:0/486205836 shutdown_connections 2023-09-30T22:27:12.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.712+0000 7fb465eff700 1 -- 172.21.15.154:0/486205836 wait complete. 2023-09-30T22:27:12.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:12.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:12.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:12.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:12.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.844+0000 7f406b027700 1 Processor -- start 2023-09-30T22:27:12.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.844+0000 7f406b027700 1 -- start start 2023-09-30T22:27:12.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.844+0000 7f406b027700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f406406b250 0x7f4064136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.844+0000 7f406b027700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4064137140 0x7f4064139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.844+0000 7f406b027700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406409da80 con 0x7f406406a770 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.844+0000 7f406b027700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406409dce0 con 0x7f4064137140 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.844+0000 7f406b027700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406406b620 con 0x7f406406b250 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f4068dc3700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f406406a770 0x7f406406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41374/0 (socket says 172.21.15.154:41374) 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f4068dc3700 1 -- 172.21.15.154:0/750019546 learned_addr learned my addr 172.21.15.154:0/750019546 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f4063fff700 1 --2- 172.21.15.154:0/750019546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f406406b250 0x7f4064136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f40695c4700 1 --2- 172.21.15.154:0/750019546 >> v2:172.21.15.154:3300/0 conn(0x7f4064137140 0x7f4064139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f4063fff700 1 -- 172.21.15.154:0/750019546 >> v2:172.21.15.154:3300/0 conn(0x7f4064137140 msgr2=0x7f4064139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f4063fff700 1 --2- 172.21.15.154:0/750019546 >> v2:172.21.15.154:3300/0 conn(0x7f4064137140 0x7f4064139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f4063fff700 1 -- 172.21.15.154:0/750019546 >> v1:172.21.15.154:6789/0 conn(0x7f406406a770 legacy=0x7f406406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f4063fff700 1 -- 172.21.15.154:0/750019546 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406409eb20 con 0x7f406406b250 2023-09-30T22:27:12.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f40695c4700 1 --2- 172.21.15.154:0/750019546 >> v2:172.21.15.154:3300/0 conn(0x7f4064137140 0x7f4064139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:12.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f4063fff700 1 --2- 172.21.15.154:0/750019546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f406406b250 0x7f4064136c00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4050009840 tx=0x7f4050009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7cbc127c4c0cbd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:12.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f40637fe700 1 -- 172.21.15.154:0/750019546 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050011830 con 0x7f406406b250 2023-09-30T22:27:12.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f40637fe700 1 -- 172.21.15.154:0/750019546 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4050011990 con 0x7f406406b250 2023-09-30T22:27:12.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.845+0000 7f40637fe700 1 -- 172.21.15.154:0/750019546 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050011d20 con 0x7f406406b250 2023-09-30T22:27:12.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.846+0000 7f406b027700 1 -- 172.21.15.154:0/750019546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f406406b250 msgr2=0x7f4064136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.846+0000 7f406b027700 1 --2- 172.21.15.154:0/750019546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f406406b250 0x7f4064136c00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4050009840 tx=0x7f4050009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:12.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.846+0000 7f406b027700 1 -- 172.21.15.154:0/750019546 shutdown_connections 2023-09-30T22:27:12.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.846+0000 7f406b027700 1 --2- 172.21.15.154:0/750019546 >> v2:172.21.15.154:3300/0 conn(0x7f4064137140 0x7f4064139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.846+0000 7f406b027700 1 --2- 172.21.15.154:0/750019546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f406406b250 0x7f4064136c00 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.846+0000 7f406b027700 1 -- 172.21.15.154:0/750019546 >> 172.21.15.154:0/750019546 conn(0x7f4064099c40 msgr2=0x7f40640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:12.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.846+0000 7f406b027700 1 -- 172.21.15.154:0/750019546 shutdown_connections 2023-09-30T22:27:12.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.846+0000 7f406b027700 1 -- 172.21.15.154:0/750019546 wait complete. 2023-09-30T22:27:12.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.847+0000 7f406b027700 1 Processor -- start 2023-09-30T22:27:12.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.847+0000 7f406b027700 1 -- start start 2023-09-30T22:27:12.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f406b027700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f406406a770 0x7f4064120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f406b027700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f406406b250 0x7f4064120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f406b027700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4064137140 0x7f40641210b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f406b027700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4064122430 con 0x7f406406a770 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f406b027700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4064122240 con 0x7f4064137140 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f406b027700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40641365b0 con 0x7f406406b250 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f4068dc3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f406406a770 0x7f4064120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f4068dc3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f406406a770 0x7f4064120630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42526/0 (socket says 172.21.15.154:42526) 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f4063fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f406406b250 0x7f4064120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.848+0000 7f4068dc3700 1 -- 172.21.15.154:0/1290302439 learned_addr learned my addr 172.21.15.154:0/1290302439 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f4063fff700 1 -- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4064137140 msgr2=0x7f40641210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f4063fff700 1 --2- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4064137140 0x7f40641210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f4063fff700 1 -- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f406406a770 msgr2=0x7f4064120630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f4063fff700 1 --2- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f406406a770 0x7f4064120630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f4063fff700 1 -- 172.21.15.154:0/1290302439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c009a70 con 0x7f406406b250 2023-09-30T22:27:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f4063fff700 1 --2- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f406406b250 0x7f4064120b70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4050016000 tx=0x7f4050004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f40617fa700 1 -- 172.21.15.154:0/1290302439 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40500036a0 con 0x7f406406b250 2023-09-30T22:27:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f40617fa700 1 -- 172.21.15.154:0/1290302439 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405001f070 con 0x7f406406b250 2023-09-30T22:27:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f406b027700 1 -- 172.21.15.154:0/1290302439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40500094a0 con 0x7f406406b250 2023-09-30T22:27:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f40617fa700 1 -- 172.21.15.154:0/1290302439 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050003a20 con 0x7f406406b250 2023-09-30T22:27:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.849+0000 7f406b027700 1 -- 172.21.15.154:0/1290302439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4064123e70 con 0x7f406406b250 2023-09-30T22:27:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.850+0000 7f40617fa700 1 -- 172.21.15.154:0/1290302439 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4050003b80 con 0x7f406406b250 2023-09-30T22:27:12.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.850+0000 7f406b027700 1 -- 172.21.15.154:0/1290302439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4064123b10 con 0x7f406406b250 2023-09-30T22:27:12.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.850+0000 7f40617fa700 1 -- 172.21.15.154:0/1290302439 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4050021070 con 0x7f406406b250 2023-09-30T22:27:12.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.855+0000 7f40617fa700 1 -- 172.21.15.154:0/1290302439 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4064123b10 con 0x7f406406b250 2023-09-30T22:27:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.893+0000 7ff04b08a700 1 Processor -- start 2023-09-30T22:27:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.893+0000 7ff04b08a700 1 -- start start 2023-09-30T22:27:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.893+0000 7ff04b08a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff04409d860 0x7ff04409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.893+0000 7ff04b08a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff044130eb0 0x7ff044138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.893+0000 7ff04b08a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04409aaa0 con 0x7ff04409e170 2023-09-30T22:27:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.893+0000 7ff04b08a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04409f870 con 0x7ff04409d860 2023-09-30T22:27:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.893+0000 7ff04b08a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff04409b360 con 0x7ff044130eb0 2023-09-30T22:27:12.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff049627700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff044130eb0 0x7ff044138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff049627700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff044130eb0 0x7ff044138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33700/0 (socket says 172.21.15.154:33700) 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff049627700 1 -- 172.21.15.154:0/189532833 learned_addr learned my addr 172.21.15.154:0/189532833 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff048e26700 1 --2- 172.21.15.154:0/189532833 >> v2:172.21.15.154:3300/0 conn(0x7ff04409d860 0x7ff04409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff049627700 1 -- 172.21.15.154:0/189532833 >> v2:172.21.15.154:3300/0 conn(0x7ff04409d860 msgr2=0x7ff04409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff049627700 1 --2- 172.21.15.154:0/189532833 >> v2:172.21.15.154:3300/0 conn(0x7ff04409d860 0x7ff04409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff049627700 1 -- 172.21.15.154:0/189532833 >> v1:172.21.15.154:6789/0 conn(0x7ff04409e170 legacy=0x7ff0441307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff049627700 1 -- 172.21.15.154:0/189532833 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04409b620 con 0x7ff044130eb0 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff049627700 1 --2- 172.21.15.154:0/189532833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff044130eb0 0x7ff044138a00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00d150 tx=0x7ff03c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f2cc2622a695c13 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff0437fe700 1 -- 172.21.15.154:0/189532833 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c010070 con 0x7ff044130eb0 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff0437fe700 1 -- 172.21.15.154:0/189532833 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c00dd10 con 0x7ff044130eb0 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.894+0000 7ff0437fe700 1 -- 172.21.15.154:0/189532833 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00b310 con 0x7ff044130eb0 2023-09-30T22:27:12.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.895+0000 7ff04b08a700 1 -- 172.21.15.154:0/189532833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff044130eb0 msgr2=0x7ff044138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.895+0000 7ff04b08a700 1 --2- 172.21.15.154:0/189532833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff044130eb0 0x7ff044138a00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00d150 tx=0x7ff03c00d460 comp rx=0 tx=0).stop 2023-09-30T22:27:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.895+0000 7ff04b08a700 1 -- 172.21.15.154:0/189532833 shutdown_connections 2023-09-30T22:27:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.895+0000 7ff04b08a700 1 --2- 172.21.15.154:0/189532833 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff044130eb0 0x7ff044138a00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.895+0000 7ff04b08a700 1 --2- 172.21.15.154:0/189532833 >> v2:172.21.15.154:3300/0 conn(0x7ff04409d860 0x7ff04409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.895+0000 7ff04b08a700 1 -- 172.21.15.154:0/189532833 >> 172.21.15.154:0/189532833 conn(0x7ff044099c40 msgr2=0x7ff0440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.895+0000 7ff04b08a700 1 -- 172.21.15.154:0/189532833 shutdown_connections 2023-09-30T22:27:12.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.895+0000 7ff04b08a700 1 -- 172.21.15.154:0/189532833 wait complete. 2023-09-30T22:27:12.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.896+0000 7ff04b08a700 1 Processor -- start 2023-09-30T22:27:12.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.896+0000 7ff04b08a700 1 -- start start 2023-09-30T22:27:12.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff04b08a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04409d860 0x7ff0441c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff04b08a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04409e170 0x7ff0441c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff04b08a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff044130eb0 0x7ff0441c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff04b08a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff044126130 con 0x7ff04409e170 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff04b08a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04409c8b0 con 0x7ff044130eb0 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff04b08a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff044124420 con 0x7ff04409d860 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff048e26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04409d860 0x7ff0441c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff048e26700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04409d860 0x7ff0441c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33702/0 (socket says 172.21.15.154:33702) 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff048e26700 1 -- 172.21.15.154:0/370389038 learned_addr learned my addr 172.21.15.154:0/370389038 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff049627700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff044130eb0 0x7ff0441c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff043fff700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04409e170 0x7ff0441c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff049627700 1 -- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04409d860 msgr2=0x7ff0441c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff049627700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04409d860 0x7ff0441c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff049627700 1 -- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04409e170 msgr2=0x7ff0441c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff049627700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04409e170 0x7ff0441c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff049627700 1 -- 172.21.15.154:0/370389038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c00bd40 con 0x7ff044130eb0 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff048e26700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04409d860 0x7ff0441c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff049627700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff044130eb0 0x7ff0441c8c40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff04406d590 tx=0x7ff03c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff0417fa700 1 -- 172.21.15.154:0/370389038 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00b4c0 con 0x7ff044130eb0 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff0417fa700 1 -- 172.21.15.154:0/370389038 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c009810 con 0x7ff044130eb0 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff0417fa700 1 -- 172.21.15.154:0/370389038 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c009be0 con 0x7ff044130eb0 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.897+0000 7ff04b08a700 1 -- 172.21.15.154:0/370389038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff044072150 con 0x7ff044130eb0 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.898+0000 7ff04b08a700 1 -- 172.21.15.154:0/370389038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff044125090 con 0x7ff044130eb0 2023-09-30T22:27:12.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.898+0000 7ff0417fa700 1 -- 172.21.15.154:0/370389038 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff03c009d40 con 0x7ff044130eb0 2023-09-30T22:27:12.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.899+0000 7ff0417fa700 1 -- 172.21.15.154:0/370389038 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff03c040b40 con 0x7ff044130eb0 2023-09-30T22:27:12.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.899+0000 7ff04b08a700 1 -- 172.21.15.154:0/370389038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04404f2a0 con 0x7ff044130eb0 2023-09-30T22:27:12.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.903+0000 7ff0417fa700 1 -- 172.21.15.154:0/370389038 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff03c01d430 con 0x7ff044130eb0 2023-09-30T22:27:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.962+0000 7fc05a228700 1 Processor -- start 2023-09-30T22:27:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.962+0000 7fc05a228700 1 -- start start 2023-09-30T22:27:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc05a228700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 0x7fc054133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc05a228700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc054130bc0 0x7fc05413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc05a228700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05406b2d0 con 0x7fc0541300a0 2023-09-30T22:27:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc05a228700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc054133610 con 0x7fc054130bc0 2023-09-30T22:27:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc05a228700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc05409a500 con 0x7fc054133ad0 2023-09-30T22:27:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc053fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc054130bc0 0x7fc05413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc053fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc054130bc0 0x7fc05413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42552/0 (socket says 172.21.15.154:42552) 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc053fff700 1 -- 172.21.15.154:0/671582927 learned_addr learned my addr 172.21.15.154:0/671582927 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc0537fe700 1 --2- 172.21.15.154:0/671582927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 0x7fc054133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc053fff700 1 -- 172.21.15.154:0/671582927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 msgr2=0x7fc054133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc053fff700 1 --2- 172.21.15.154:0/671582927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 0x7fc054133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc053fff700 1 -- 172.21.15.154:0/671582927 >> v1:172.21.15.154:6789/0 conn(0x7fc0541300a0 legacy=0x7fc0541304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.963+0000 7fc053fff700 1 -- 172.21.15.154:0/671582927 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0541338b0 con 0x7fc054130bc0 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc053fff700 1 --2- 172.21.15.154:0/671582927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 0x7fc05413b990 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009e50 tx=0x7fc04c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518022dc20e3087 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc0527fc700 1 -- 172.21.15.154:0/671582927 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00e070 con 0x7fc054130bc0 2023-09-30T22:27:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc0527fc700 1 -- 172.21.15.154:0/671582927 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c00b910 con 0x7fc054130bc0 2023-09-30T22:27:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc0527fc700 1 -- 172.21.15.154:0/671582927 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00bcc0 con 0x7fc054130bc0 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc05a228700 1 -- 172.21.15.154:0/671582927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 msgr2=0x7fc05413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc05a228700 1 --2- 172.21.15.154:0/671582927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 0x7fc05413b990 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009e50 tx=0x7fc04c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc05a228700 1 -- 172.21.15.154:0/671582927 shutdown_connections 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc05a228700 1 --2- 172.21.15.154:0/671582927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 0x7fc05413b990 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc05a228700 1 --2- 172.21.15.154:0/671582927 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 0x7fc054133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.964+0000 7fc05a228700 1 -- 172.21.15.154:0/671582927 >> 172.21.15.154:0/671582927 conn(0x7fc054099c40 msgr2=0x7fc0540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.965+0000 7fc05a228700 1 -- 172.21.15.154:0/671582927 shutdown_connections 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.965+0000 7fc05a228700 1 -- 172.21.15.154:0/671582927 wait complete. 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.965+0000 7fc05a228700 1 Processor -- start 2023-09-30T22:27:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc05a228700 1 -- start start 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc05a228700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0541300a0 0x7fc05411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc05a228700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 0x7fc05411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc05a228700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 0x7fc05411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc05a228700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05412da10 con 0x7fc054130bc0 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc05a228700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05411fe50 con 0x7fc0541300a0 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc05a228700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc054120a30 con 0x7fc054133ad0 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc0537fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0541300a0 0x7fc05411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc052ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 0x7fc05411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc0537fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0541300a0 0x7fc05411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33026/0 (socket says 172.21.15.154:33026) 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc0537fe700 1 -- 172.21.15.154:0/292209355 learned_addr learned my addr 172.21.15.154:0/292209355 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc053fff700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 0x7fc05411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc0537fe700 1 -- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 msgr2=0x7fc05411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.966+0000 7fc0537fe700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 0x7fc05411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc0537fe700 1 -- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 msgr2=0x7fc05411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc0537fe700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 0x7fc05411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc0537fe700 1 -- 172.21.15.154:0/292209355 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c009b30 con 0x7fc0541300a0 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc053fff700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 0x7fc05411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc052ffd700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 0x7fc05411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc0537fe700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0541300a0 0x7fc05411da40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e9b0 tx=0x7fc04400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc03bfff700 1 -- 172.21.15.154:0/292209355 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044009710 con 0x7fc0541300a0 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc03bfff700 1 -- 172.21.15.154:0/292209355 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04400ee50 con 0x7fc0541300a0 2023-09-30T22:27:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc05a228700 1 -- 172.21.15.154:0/292209355 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0540a33e0 con 0x7fc0541300a0 2023-09-30T22:27:12.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc03bfff700 1 -- 172.21.15.154:0/292209355 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04400ca50 con 0x7fc0541300a0 2023-09-30T22:27:12.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.967+0000 7fc05a228700 1 -- 172.21.15.154:0/292209355 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05411ef90 con 0x7fc0541300a0 2023-09-30T22:27:12.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.968+0000 7fc05a228700 1 -- 172.21.15.154:0/292209355 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05404f2a0 con 0x7fc0541300a0 2023-09-30T22:27:12.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.968+0000 7fc03bfff700 1 -- 172.21.15.154:0/292209355 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc04400cbb0 con 0x7fc0541300a0 2023-09-30T22:27:12.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.969+0000 7fc03bfff700 1 -- 172.21.15.154:0/292209355 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc04403fec0 con 0x7fc0541300a0 2023-09-30T22:27:12.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:12.973+0000 7fc03bfff700 1 -- 172.21.15.154:0/292209355 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc04401a360 con 0x7fc0541300a0 2023-09-30T22:27:13.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.054+0000 7f406b027700 1 -- 172.21.15.154:0/1290302439 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4064123b10 con 0x7f406406b250 2023-09-30T22:27:13.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.054+0000 7f40617fa700 1 -- 172.21.15.154:0/1290302439 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4064123b10 con 0x7f406406b250 2023-09-30T22:27:13.056 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:13.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.057+0000 7f406b027700 1 -- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f406406b250 msgr2=0x7f4064120b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.057+0000 7f406b027700 1 --2- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f406406b250 0x7f4064120b70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4050016000 tx=0x7f4050004750 comp rx=0 tx=0).stop 2023-09-30T22:27:13.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.057+0000 7f406b027700 1 -- 172.21.15.154:0/1290302439 shutdown_connections 2023-09-30T22:27:13.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.057+0000 7f406b027700 1 --2- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4064137140 0x7f40641210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.057+0000 7f406b027700 1 --2- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f406406a770 0x7f4064120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.057+0000 7f406b027700 1 --2- 172.21.15.154:0/1290302439 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f406406b250 0x7f4064120b70 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.057+0000 7f406b027700 1 -- 172.21.15.154:0/1290302439 >> 172.21.15.154:0/1290302439 conn(0x7f4064099c40 msgr2=0x7f406406ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.057+0000 7f406b027700 1 -- 172.21.15.154:0/1290302439 shutdown_connections 2023-09-30T22:27:13.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.057+0000 7f406b027700 1 -- 172.21.15.154:0/1290302439 wait complete. 2023-09-30T22:27:13.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:13.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.118+0000 7ff04b08a700 1 -- 172.21.15.154:0/370389038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff044125f20 con 0x7ff044130eb0 2023-09-30T22:27:13.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.118+0000 7ff0417fa700 1 -- 172.21.15.154:0/370389038 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff03c034090 con 0x7ff044130eb0 2023-09-30T22:27:13.119 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:13.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.120+0000 7ff04b08a700 1 -- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff044130eb0 msgr2=0x7ff0441c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.120+0000 7ff04b08a700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff044130eb0 0x7ff0441c8c40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff04406d590 tx=0x7ff03c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.120+0000 7ff04b08a700 1 -- 172.21.15.154:0/370389038 shutdown_connections 2023-09-30T22:27:13.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.120+0000 7ff04b08a700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff044130eb0 0x7ff0441c8c40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.120+0000 7ff04b08a700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff04409d860 0x7ff0441c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.120+0000 7ff04b08a700 1 --2- 172.21.15.154:0/370389038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff04409e170 0x7ff0441c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.120+0000 7ff04b08a700 1 -- 172.21.15.154:0/370389038 >> 172.21.15.154:0/370389038 conn(0x7ff044099c40 msgr2=0x7ff044070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.120+0000 7ff04b08a700 1 -- 172.21.15.154:0/370389038 shutdown_connections 2023-09-30T22:27:13.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.120+0000 7ff04b08a700 1 -- 172.21.15.154:0/370389038 wait complete. 2023-09-30T22:27:13.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:13.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.182+0000 7fc05a228700 1 -- 172.21.15.154:0/292209355 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc054071790 con 0x7fc0541300a0 2023-09-30T22:27:13.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.182+0000 7fc03bfff700 1 -- 172.21.15.154:0/292209355 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc044021020 con 0x7fc0541300a0 2023-09-30T22:27:13.183 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.184+0000 7fc05a228700 1 -- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0541300a0 msgr2=0x7fc05411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.184+0000 7fc05a228700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0541300a0 0x7fc05411da40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e9b0 tx=0x7fc04400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.184+0000 7fc05a228700 1 -- 172.21.15.154:0/292209355 shutdown_connections 2023-09-30T22:27:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.184+0000 7fc05a228700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc054133ad0 0x7fc05411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.184+0000 7fc05a228700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0541300a0 0x7fc05411da40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.184+0000 7fc05a228700 1 --2- 172.21.15.154:0/292209355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc054130bc0 0x7fc05411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.184+0000 7fc05a228700 1 -- 172.21.15.154:0/292209355 >> 172.21.15.154:0/292209355 conn(0x7fc054099c40 msgr2=0x7fc054132d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.184+0000 7fc05a228700 1 -- 172.21.15.154:0/292209355 shutdown_connections 2023-09-30T22:27:13.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.184+0000 7fc05a228700 1 -- 172.21.15.154:0/292209355 wait complete. 2023-09-30T22:27:13.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:13.726 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:13.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.849+0000 7f5c50d31700 1 Processor -- start 2023-09-30T22:27:13.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.849+0000 7f5c50d31700 1 -- start start 2023-09-30T22:27:13.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c50d31700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09d860 0x7f5c4c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c50d31700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c4c130eb0 0x7f5c4c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c50d31700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c09aaa0 con 0x7f5c4c09e170 2023-09-30T22:27:13.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c50d31700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c09f870 con 0x7f5c4c130eb0 2023-09-30T22:27:13.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c50d31700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c09b360 con 0x7f5c4c09d860 2023-09-30T22:27:13.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c4ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c4c130eb0 0x7f5c4c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c4a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09d860 0x7f5c4c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c4ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c4c130eb0 0x7f5c4c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42570/0 (socket says 172.21.15.154:42570) 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c4a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09d860 0x7f5c4c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33726/0 (socket says 172.21.15.154:33726) 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c4ad9d700 1 -- 172.21.15.154:0/2906452294 learned_addr learned my addr 172.21.15.154:0/2906452294 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c4ad9d700 1 -- 172.21.15.154:0/2906452294 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09d860 msgr2=0x7f5c4c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c4ad9d700 1 --2- 172.21.15.154:0/2906452294 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09d860 0x7f5c4c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.850+0000 7f5c4ad9d700 1 -- 172.21.15.154:0/2906452294 >> v1:172.21.15.154:6789/0 conn(0x7f5c4c09e170 legacy=0x7f5c4c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c4ad9d700 1 -- 172.21.15.154:0/2906452294 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c09b620 con 0x7f5c4c130eb0 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c4959a700 1 -- 172.21.15.154:0/2906452294 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622329981 0 0) 0x7f5c4c09aaa0 con 0x7f5c4c09e170 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c4a59c700 1 --2- 172.21.15.154:0/2906452294 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09d860 0x7f5c4c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c4ad9d700 1 --2- 172.21.15.154:0/2906452294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 0x7f5c4c138a00 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400d150 tx=0x7f5c4400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbd90adc5d6a378 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c4959a700 1 -- 172.21.15.154:0/2906452294 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44010070 con 0x7f5c4c130eb0 2023-09-30T22:27:13.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c4959a700 1 -- 172.21.15.154:0/2906452294 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400dd10 con 0x7f5c4c130eb0 2023-09-30T22:27:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c4959a700 1 -- 172.21.15.154:0/2906452294 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400b310 con 0x7f5c4c130eb0 2023-09-30T22:27:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c50d31700 1 -- 172.21.15.154:0/2906452294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 msgr2=0x7f5c4c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c50d31700 1 --2- 172.21.15.154:0/2906452294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 0x7f5c4c138a00 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400d150 tx=0x7f5c4400d460 comp rx=0 tx=0).stop 2023-09-30T22:27:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c50d31700 1 -- 172.21.15.154:0/2906452294 shutdown_connections 2023-09-30T22:27:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c50d31700 1 --2- 172.21.15.154:0/2906452294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 0x7f5c4c138a00 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c50d31700 1 --2- 172.21.15.154:0/2906452294 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09d860 0x7f5c4c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c50d31700 1 -- 172.21.15.154:0/2906452294 >> 172.21.15.154:0/2906452294 conn(0x7f5c4c099c40 msgr2=0x7f5c4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c50d31700 1 -- 172.21.15.154:0/2906452294 shutdown_connections 2023-09-30T22:27:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.851+0000 7f5c50d31700 1 -- 172.21.15.154:0/2906452294 wait complete. 2023-09-30T22:27:13.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.853+0000 7f5c50d31700 1 Processor -- start 2023-09-30T22:27:13.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.853+0000 7f5c50d31700 1 -- start start 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.853+0000 7f5c50d31700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c4c09d860 0x7f5c4c11e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c50d31700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09e170 0x7f5c4c11e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c50d31700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 0x7f5c4c11eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c50d31700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c120510 con 0x7f5c4c130eb0 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c50d31700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c121170 con 0x7f5c4c09d860 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c50d31700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c09c8e0 con 0x7f5c4c09e170 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c4c09d860 0x7f5c4c11e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 0x7f5c4c11eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c49d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09e170 0x7f5c4c11e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c4c09d860 0x7f5c4c11e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:33038/0 (socket says 172.21.15.154:33038) 2023-09-30T22:27:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4a59c700 1 -- 172.21.15.154:0/1686950364 learned_addr learned my addr 172.21.15.154:0/1686950364 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4ad9d700 1 -- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09e170 msgr2=0x7f5c4c11e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4ad9d700 1 --2- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09e170 0x7f5c4c11e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4ad9d700 1 -- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c4c09d860 msgr2=0x7f5c4c11e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4ad9d700 1 --2- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c4c09d860 0x7f5c4c11e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4ad9d700 1 -- 172.21.15.154:0/1686950364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400094a0 con 0x7f5c4c130eb0 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c49d9b700 1 --2- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09e170 0x7f5c4c11e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c4ad9d700 1 --2- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 0x7f5c4c11eda0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5c44017000 tx=0x7f5c44004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c3affd700 1 -- 172.21.15.154:0/1686950364 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44009e40 con 0x7f5c4c130eb0 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c3affd700 1 -- 172.21.15.154:0/1686950364 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400b4c0 con 0x7f5c4c130eb0 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c50d31700 1 -- 172.21.15.154:0/1686950364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4400bd40 con 0x7f5c4c130eb0 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c3affd700 1 -- 172.21.15.154:0/1686950364 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44004280 con 0x7f5c4c130eb0 2023-09-30T22:27:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.854+0000 7f5c50d31700 1 -- 172.21.15.154:0/1686950364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c121e60 con 0x7f5c4c130eb0 2023-09-30T22:27:13.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.855+0000 7f5c50d31700 1 -- 172.21.15.154:0/1686950364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c04f2a0 con 0x7f5c4c130eb0 2023-09-30T22:27:13.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.856+0000 7f5c3affd700 1 -- 172.21.15.154:0/1686950364 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c440043e0 con 0x7f5c4c130eb0 2023-09-30T22:27:13.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.856+0000 7f5c3affd700 1 -- 172.21.15.154:0/1686950364 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c44043530 con 0x7f5c4c130eb0 2023-09-30T22:27:13.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:13.860+0000 7f5c3affd700 1 -- 172.21.15.154:0/1686950364 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c44030480 con 0x7f5c4c130eb0 2023-09-30T22:27:14.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.046+0000 7f5c50d31700 1 -- 172.21.15.154:0/1686950364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c4c06c3b0 con 0x7f5c4c130eb0 2023-09-30T22:27:14.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.046+0000 7f5c3affd700 1 -- 172.21.15.154:0/1686950364 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c4402b030 con 0x7f5c4c130eb0 2023-09-30T22:27:14.047 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:14.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.048+0000 7f5c50d31700 1 -- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 msgr2=0x7f5c4c11eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.048+0000 7f5c50d31700 1 --2- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 0x7f5c4c11eda0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5c44017000 tx=0x7f5c44004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.048+0000 7f5c50d31700 1 -- 172.21.15.154:0/1686950364 shutdown_connections 2023-09-30T22:27:14.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.048+0000 7f5c50d31700 1 --2- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c4c130eb0 0x7f5c4c11eda0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.048+0000 7f5c50d31700 1 --2- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c4c09d860 0x7f5c4c11e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.048+0000 7f5c50d31700 1 --2- 172.21.15.154:0/1686950364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c4c09e170 0x7f5c4c11e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.048+0000 7f5c50d31700 1 -- 172.21.15.154:0/1686950364 >> 172.21.15.154:0/1686950364 conn(0x7f5c4c099c40 msgr2=0x7f5c4c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.048+0000 7f5c50d31700 1 -- 172.21.15.154:0/1686950364 shutdown_connections 2023-09-30T22:27:14.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.048+0000 7f5c50d31700 1 -- 172.21.15.154:0/1686950364 wait complete. 2023-09-30T22:27:14.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:14.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:14.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:14.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.196+0000 7fd938464700 1 Processor -- start 2023-09-30T22:27:14.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.196+0000 7fd938464700 1 -- start start 2023-09-30T22:27:14.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:14.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd938464700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9300a1550 0x7fd930138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd938464700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd930139200 0x7fd93013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd938464700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93009e9d0 con 0x7fd9300a0a70 2023-09-30T22:27:14.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd938464700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93009dc00 con 0x7fd9300a1550 2023-09-30T22:27:14.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd938464700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd93009dec0 con 0x7fd930139200 2023-09-30T22:27:14.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd9359ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9300a1550 0x7fd930138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd9359ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9300a1550 0x7fd930138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42586/0 (socket says 172.21.15.154:42586) 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd9359ff700 1 -- 172.21.15.154:0/202099005 learned_addr learned my addr 172.21.15.154:0/202099005 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd936a01700 1 --2- 172.21.15.154:0/202099005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd930139200 0x7fd93013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd9359ff700 1 -- 172.21.15.154:0/202099005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd930139200 msgr2=0x7fd93013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd9359ff700 1 --2- 172.21.15.154:0/202099005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd930139200 0x7fd93013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd9359ff700 1 -- 172.21.15.154:0/202099005 >> v1:172.21.15.154:6789/0 conn(0x7fd9300a0a70 legacy=0x7fd9300a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd9359ff700 1 -- 172.21.15.154:0/202099005 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93009e6a0 con 0x7fd9300a1550 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.197+0000 7fd9359ff700 1 --2- 172.21.15.154:0/202099005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9300a1550 0x7fd930138cc0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd9200098f0 tx=0x7fd920009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e537d935d65177c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd9351fe700 1 -- 172.21.15.154:0/202099005 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920011830 con 0x7fd9300a1550 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd9351fe700 1 -- 172.21.15.154:0/202099005 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd920011990 con 0x7fd9300a1550 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd9351fe700 1 -- 172.21.15.154:0/202099005 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920011d20 con 0x7fd9300a1550 2023-09-30T22:27:14.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd938464700 1 -- 172.21.15.154:0/202099005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9300a1550 msgr2=0x7fd930138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd938464700 1 --2- 172.21.15.154:0/202099005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9300a1550 0x7fd930138cc0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd9200098f0 tx=0x7fd920009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:14.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd938464700 1 -- 172.21.15.154:0/202099005 shutdown_connections 2023-09-30T22:27:14.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd938464700 1 --2- 172.21.15.154:0/202099005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd930139200 0x7fd93013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd938464700 1 --2- 172.21.15.154:0/202099005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9300a1550 0x7fd930138cc0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd938464700 1 -- 172.21.15.154:0/202099005 >> 172.21.15.154:0/202099005 conn(0x7fd9300a6610 msgr2=0x7fd9300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd938464700 1 -- 172.21.15.154:0/202099005 shutdown_connections 2023-09-30T22:27:14.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.198+0000 7fd938464700 1 -- 172.21.15.154:0/202099005 wait complete. 2023-09-30T22:27:14.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.199+0000 7fd938464700 1 Processor -- start 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.199+0000 7fd938464700 1 -- start start 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd938464700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9300a0a70 0x7fd93011e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd938464700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9300a1550 0x7fd93011ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd938464700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd930139200 0x7fd93011f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd938464700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd930121a90 con 0x7fd930139200 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd938464700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd930120410 con 0x7fd9300a0a70 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd938464700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300a5220 con 0x7fd9300a1550 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd9359ff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9300a1550 0x7fd93011ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd9359ff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9300a1550 0x7fd93011ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33760/0 (socket says 172.21.15.154:33760) 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd9359ff700 1 -- 172.21.15.154:0/2742572823 learned_addr learned my addr 172.21.15.154:0/2742572823 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:14.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd936200700 1 --2- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9300a0a70 0x7fd93011e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd936a01700 1 --2- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd930139200 0x7fd93011f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd9359ff700 1 -- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9300a0a70 msgr2=0x7fd93011e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd9359ff700 1 --2- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9300a0a70 0x7fd93011e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd9359ff700 1 -- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd930139200 msgr2=0x7fd93011f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd9359ff700 1 --2- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd930139200 0x7fd93011f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.200+0000 7fd9359ff700 1 -- 172.21.15.154:0/2742572823 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd920009550 con 0x7fd9300a1550 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.201+0000 7fd9359ff700 1 --2- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9300a1550 0x7fd93011ede0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd920000c00 tx=0x7fd920004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.201+0000 7fd926ffd700 1 -- 172.21.15.154:0/2742572823 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920004400 con 0x7fd9300a1550 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.201+0000 7fd926ffd700 1 -- 172.21.15.154:0/2742572823 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92001f070 con 0x7fd9300a1550 2023-09-30T22:27:14.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.201+0000 7fd938464700 1 -- 172.21.15.154:0/2742572823 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9300a03e0 con 0x7fd9300a1550 2023-09-30T22:27:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.201+0000 7fd926ffd700 1 -- 172.21.15.154:0/2742572823 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9200038e0 con 0x7fd9300a1550 2023-09-30T22:27:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.201+0000 7fd938464700 1 -- 172.21.15.154:0/2742572823 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd930122820 con 0x7fd9300a1550 2023-09-30T22:27:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.201+0000 7fd926ffd700 1 -- 172.21.15.154:0/2742572823 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd920021030 con 0x7fd9300a1550 2023-09-30T22:27:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.202+0000 7fd926ffd700 1 -- 172.21.15.154:0/2742572823 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd920040980 con 0x7fd9300a1550 2023-09-30T22:27:14.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.202+0000 7fd938464700 1 -- 172.21.15.154:0/2742572823 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd930121e30 con 0x7fd9300a1550 2023-09-30T22:27:14.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.207+0000 7fd926ffd700 1 -- 172.21.15.154:0/2742572823 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9200199a0 con 0x7fd9300a1550 2023-09-30T22:27:14.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1f156e700 1 Processor -- start 2023-09-30T22:27:14.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1f156e700 1 -- start start 2023-09-30T22:27:14.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1f156e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1f156e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff1ec1393a0 0x7ff1ec13b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1f156e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec09fa00 con 0x7ff1ec09e870 2023-09-30T22:27:14.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1f156e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec0a0370 con 0x7ff1ec1393a0 2023-09-30T22:27:14.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1f156e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec06bec0 con 0x7ff1ec09f350 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1ea7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1eb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff1ec1393a0 0x7ff1ec13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1eaffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff1ec09e870 0x7ff1ec09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41410/0 (socket says 172.21.15.154:41410) 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.263+0000 7ff1eaffd700 1 -- 172.21.15.154:0/1185563565 learned_addr learned my addr 172.21.15.154:0/1185563565 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.264+0000 7ff1eb7fe700 1 -- 172.21.15.154:0/1185563565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 msgr2=0x7ff1ec138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.264+0000 7ff1eb7fe700 1 --2- 172.21.15.154:0/1185563565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.264+0000 7ff1eb7fe700 1 -- 172.21.15.154:0/1185563565 >> v1:172.21.15.154:6789/0 conn(0x7ff1ec09e870 legacy=0x7ff1ec09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.264+0000 7ff1eb7fe700 1 -- 172.21.15.154:0/1185563565 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec09ada0 con 0x7ff1ec1393a0 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.264+0000 7ff1ea7fc700 1 --2- 172.21.15.154:0/1185563565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:14.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.264+0000 7ff1eb7fe700 1 --2- 172.21.15.154:0/1185563565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1393a0 0x7ff1ec13b780 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009d90 tx=0x7ff1e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4564165a4699431 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.264+0000 7ff1e9ffb700 1 -- 172.21.15.154:0/1185563565 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e400e070 con 0x7ff1ec1393a0 2023-09-30T22:27:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.264+0000 7ff1e9ffb700 1 -- 172.21.15.154:0/1185563565 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e400bb20 con 0x7ff1ec1393a0 2023-09-30T22:27:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.264+0000 7ff1e9ffb700 1 -- 172.21.15.154:0/1185563565 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4012430 con 0x7ff1ec1393a0 2023-09-30T22:27:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.265+0000 7ff1f156e700 1 -- 172.21.15.154:0/1185563565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1393a0 msgr2=0x7ff1ec13b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.265+0000 7ff1f156e700 1 --2- 172.21.15.154:0/1185563565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1393a0 0x7ff1ec13b780 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009d90 tx=0x7ff1e400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.265+0000 7ff1f156e700 1 -- 172.21.15.154:0/1185563565 shutdown_connections 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.265+0000 7ff1f156e700 1 --2- 172.21.15.154:0/1185563565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1393a0 0x7ff1ec13b780 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.265+0000 7ff1f156e700 1 --2- 172.21.15.154:0/1185563565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.265+0000 7ff1f156e700 1 -- 172.21.15.154:0/1185563565 >> 172.21.15.154:0/1185563565 conn(0x7ff1ec0a4430 msgr2=0x7ff1ec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.265+0000 7ff1f156e700 1 -- 172.21.15.154:0/1185563565 shutdown_connections 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.265+0000 7ff1f156e700 1 -- 172.21.15.154:0/1185563565 wait complete. 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.266+0000 7ff1f156e700 1 Processor -- start 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.266+0000 7ff1f156e700 1 -- start start 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1f156e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec09e870 0x7ff1ec121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1f156e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec122090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1f156e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1ec1393a0 0x7ff1ec1225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1f156e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec137410 con 0x7ff1ec09e870 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1f156e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec125620 con 0x7ff1ec09f350 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1f156e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec06cfa0 con 0x7ff1ec1393a0 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec09e870 0x7ff1ec121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1ea7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec122090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1ec1393a0 0x7ff1ec1225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1ec1393a0 0x7ff1ec1225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33762/0 (socket says 172.21.15.154:33762) 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eaffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec09e870 0x7ff1ec121b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42608/0 (socket says 172.21.15.154:42608) 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eb7fe700 1 -- 172.21.15.154:0/2010136416 learned_addr learned my addr 172.21.15.154:0/2010136416 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eb7fe700 1 -- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 msgr2=0x7ff1ec122090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eb7fe700 1 --2- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec122090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eb7fe700 1 -- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec09e870 msgr2=0x7ff1ec121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eb7fe700 1 --2- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec09e870 0x7ff1ec121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eb7fe700 1 -- 172.21.15.154:0/2010136416 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e00094a0 con 0x7ff1ec1393a0 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1ea7fc700 1 --2- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec122090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eaffd700 1 --2- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec09e870 0x7ff1ec121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.267+0000 7ff1eb7fe700 1 --2- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1ec1393a0 0x7ff1ec1225d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4014040 tx=0x7ff1e4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.268+0000 7ff1d37fe700 1 -- 172.21.15.154:0/2010136416 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4012430 con 0x7ff1ec1393a0 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.268+0000 7ff1d37fe700 1 -- 172.21.15.154:0/2010136416 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4020070 con 0x7ff1ec1393a0 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.268+0000 7ff1d37fe700 1 -- 172.21.15.154:0/2010136416 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4003ea0 con 0x7ff1ec1393a0 2023-09-30T22:27:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.268+0000 7ff1f156e700 1 -- 172.21.15.154:0/2010136416 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e4009a70 con 0x7ff1ec1393a0 2023-09-30T22:27:14.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.268+0000 7ff1f156e700 1 -- 172.21.15.154:0/2010136416 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ec125080 con 0x7ff1ec1393a0 2023-09-30T22:27:14.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.269+0000 7ff1d37fe700 1 -- 172.21.15.154:0/2010136416 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1e4004040 con 0x7ff1ec1393a0 2023-09-30T22:27:14.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.269+0000 7ff1f156e700 1 -- 172.21.15.154:0/2010136416 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ec04f2a0 con 0x7ff1ec1393a0 2023-09-30T22:27:14.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.269+0000 7ff1d37fe700 1 -- 172.21.15.154:0/2010136416 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff1e4022070 con 0x7ff1ec1393a0 2023-09-30T22:27:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.278+0000 7ff1d37fe700 1 -- 172.21.15.154:0/2010136416 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1e401a970 con 0x7ff1ec1393a0 2023-09-30T22:27:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99c2c1700 1 Processor -- start 2023-09-30T22:27:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99c2c1700 1 -- start start 2023-09-30T22:27:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99c2c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a0a70 0x7ff9940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99c2c1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff994134120 0x7ff99413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99c2c1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99409dc00 con 0x7ff9940a1380 2023-09-30T22:27:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99c2c1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99409ea60 con 0x7ff994134120 2023-09-30T22:27:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99c2c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff99409dec0 con 0x7ff9940a0a70 2023-09-30T22:27:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99a85e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff994134120 0x7ff99413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99a05d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a0a70 0x7ff9940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99a85e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff994134120 0x7ff99413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42616/0 (socket says 172.21.15.154:42616) 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.325+0000 7ff99a85e700 1 -- 172.21.15.154:0/3526975655 learned_addr learned my addr 172.21.15.154:0/3526975655 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.326+0000 7ff99a05d700 1 -- 172.21.15.154:0/3526975655 >> v2:172.21.15.154:3300/0 conn(0x7ff994134120 msgr2=0x7ff99413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.326+0000 7ff99a05d700 1 --2- 172.21.15.154:0/3526975655 >> v2:172.21.15.154:3300/0 conn(0x7ff994134120 0x7ff99413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.326+0000 7ff99a05d700 1 -- 172.21.15.154:0/3526975655 >> v1:172.21.15.154:6789/0 conn(0x7ff9940a1380 legacy=0x7ff994133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.326+0000 7ff99a05d700 1 -- 172.21.15.154:0/3526975655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99409e6a0 con 0x7ff9940a0a70 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.326+0000 7ff99a05d700 1 --2- 172.21.15.154:0/3526975655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a0a70 0x7ff9940a0e40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff990009840 tx=0x7ff990009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930c0935aa336c57 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.326+0000 7ff99905b700 1 -- 172.21.15.154:0/3526975655 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990011830 con 0x7ff9940a0a70 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.326+0000 7ff99905b700 1 -- 172.21.15.154:0/3526975655 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff990011990 con 0x7ff9940a0a70 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.326+0000 7ff99905b700 1 -- 172.21.15.154:0/3526975655 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990011d20 con 0x7ff9940a0a70 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.327+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3526975655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a0a70 msgr2=0x7ff9940a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.327+0000 7ff99c2c1700 1 --2- 172.21.15.154:0/3526975655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a0a70 0x7ff9940a0e40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff990009840 tx=0x7ff990009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.327+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3526975655 shutdown_connections 2023-09-30T22:27:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.327+0000 7ff99c2c1700 1 --2- 172.21.15.154:0/3526975655 >> v2:172.21.15.154:3300/0 conn(0x7ff994134120 0x7ff99413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.327+0000 7ff99c2c1700 1 --2- 172.21.15.154:0/3526975655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a0a70 0x7ff9940a0e40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.327+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3526975655 >> 172.21.15.154:0/3526975655 conn(0x7ff9940a6610 msgr2=0x7ff9940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.327+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3526975655 shutdown_connections 2023-09-30T22:27:14.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.327+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3526975655 wait complete. 2023-09-30T22:27:14.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99c2c1700 1 Processor -- start 2023-09-30T22:27:14.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99c2c1700 1 -- start start 2023-09-30T22:27:14.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99c2c1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9940a0a70 0x7ff9941229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99c2c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a1380 0x7ff994122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99c2c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff994134120 0x7ff994123470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99c2c1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff994126160 con 0x7ff9940a0a70 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99c2c1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff994127020 con 0x7ff994134120 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99c2c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff994123dc0 con 0x7ff9940a1380 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99985c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a1380 0x7ff994122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99a05d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9940a0a70 0x7ff9941229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99985c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a1380 0x7ff994122f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33794/0 (socket says 172.21.15.154:33794) 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99985c700 1 -- 172.21.15.154:0/3562895954 learned_addr learned my addr 172.21.15.154:0/3562895954 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.328+0000 7ff99a85e700 1 --2- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff994134120 0x7ff994123470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff99985c700 1 -- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff994134120 msgr2=0x7ff994123470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff99985c700 1 --2- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff994134120 0x7ff994123470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff99985c700 1 -- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9940a0a70 msgr2=0x7ff9941229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff99985c700 1 --2- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9940a0a70 0x7ff9941229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff99985c700 1 -- 172.21.15.154:0/3562895954 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900094a0 con 0x7ff9940a1380 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff99a05d700 1 --2- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9940a0a70 0x7ff9941229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff99985c700 1 --2- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a1380 0x7ff994122f30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c4b0 tx=0x7ff98400c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff98affd700 1 -- 172.21.15.154:0/3562895954 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9840052d0 con 0x7ff9940a1380 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff98affd700 1 -- 172.21.15.154:0/3562895954 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff984005430 con 0x7ff9940a1380 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3562895954 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9940a03e0 con 0x7ff9940a1380 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff98affd700 1 -- 172.21.15.154:0/3562895954 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9840038a0 con 0x7ff9940a1380 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.329+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3562895954 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff994124cd0 con 0x7ff9940a1380 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.330+0000 7ff98affd700 1 -- 172.21.15.154:0/3562895954 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff984003a00 con 0x7ff9940a1380 2023-09-30T22:27:14.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.330+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3562895954 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99404f2a0 con 0x7ff9940a1380 2023-09-30T22:27:14.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.330+0000 7ff98affd700 1 -- 172.21.15.154:0/3562895954 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff98403ea10 con 0x7ff9940a1380 2023-09-30T22:27:14.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.335+0000 7ff98affd700 1 -- 172.21.15.154:0/3562895954 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff984018260 con 0x7ff9940a1380 2023-09-30T22:27:14.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.408+0000 7fd938464700 1 -- 172.21.15.154:0/2742572823 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd93004f2a0 con 0x7fd9300a1550 2023-09-30T22:27:14.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.408+0000 7fd926ffd700 1 -- 172.21.15.154:0/2742572823 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9200193b0 con 0x7fd9300a1550 2023-09-30T22:27:14.410 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.410+0000 7fd938464700 1 -- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9300a1550 msgr2=0x7fd93011ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.410+0000 7fd938464700 1 --2- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9300a1550 0x7fd93011ede0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd920000c00 tx=0x7fd920004750 comp rx=0 tx=0).stop 2023-09-30T22:27:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.411+0000 7fd938464700 1 -- 172.21.15.154:0/2742572823 shutdown_connections 2023-09-30T22:27:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.411+0000 7fd938464700 1 --2- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd930139200 0x7fd93011f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.411+0000 7fd938464700 1 --2- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9300a0a70 0x7fd93011e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.411+0000 7fd938464700 1 --2- 172.21.15.154:0/2742572823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9300a1550 0x7fd93011ede0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.411+0000 7fd938464700 1 -- 172.21.15.154:0/2742572823 >> 172.21.15.154:0/2742572823 conn(0x7fd9300a6610 msgr2=0x7fd9300a5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.411+0000 7fd938464700 1 -- 172.21.15.154:0/2742572823 shutdown_connections 2023-09-30T22:27:14.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.411+0000 7fd938464700 1 -- 172.21.15.154:0/2742572823 wait complete. 2023-09-30T22:27:14.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.474+0000 7ff1f156e700 1 -- 172.21.15.154:0/2010136416 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff1ec072d60 con 0x7ff1ec1393a0 2023-09-30T22:27:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.474+0000 7ff1d37fe700 1 -- 172.21.15.154:0/2010136416 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1e401a380 con 0x7ff1ec1393a0 2023-09-30T22:27:14.475 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.476+0000 7ff1f156e700 1 -- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1ec1393a0 msgr2=0x7ff1ec1225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.476+0000 7ff1f156e700 1 --2- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1ec1393a0 0x7ff1ec1225d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4014040 tx=0x7ff1e4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.476+0000 7ff1f156e700 1 -- 172.21.15.154:0/2010136416 shutdown_connections 2023-09-30T22:27:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.476+0000 7ff1f156e700 1 --2- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1ec1393a0 0x7ff1ec1225d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.476+0000 7ff1f156e700 1 --2- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec09e870 0x7ff1ec121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.476+0000 7ff1f156e700 1 --2- 172.21.15.154:0/2010136416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec09f350 0x7ff1ec122090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.476+0000 7ff1f156e700 1 -- 172.21.15.154:0/2010136416 >> 172.21.15.154:0/2010136416 conn(0x7ff1ec0a4430 msgr2=0x7ff1ec0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.476+0000 7ff1f156e700 1 -- 172.21.15.154:0/2010136416 shutdown_connections 2023-09-30T22:27:14.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.476+0000 7ff1f156e700 1 -- 172.21.15.154:0/2010136416 wait complete. 2023-09-30T22:27:14.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:14.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.528+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3562895954 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff994072980 con 0x7ff9940a1380 2023-09-30T22:27:14.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.528+0000 7ff98affd700 1 -- 172.21.15.154:0/3562895954 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff984017070 con 0x7ff9940a1380 2023-09-30T22:27:14.529 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:14.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.530+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a1380 msgr2=0x7ff994122f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:14.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.530+0000 7ff99c2c1700 1 --2- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a1380 0x7ff994122f30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c4b0 tx=0x7ff98400c7c0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.530+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3562895954 shutdown_connections 2023-09-30T22:27:14.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.530+0000 7ff99c2c1700 1 --2- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff994134120 0x7ff994123470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.530+0000 7ff99c2c1700 1 --2- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9940a0a70 0x7ff9941229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.530+0000 7ff99c2c1700 1 --2- 172.21.15.154:0/3562895954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff9940a1380 0x7ff994122f30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:14.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.530+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3562895954 >> 172.21.15.154:0/3562895954 conn(0x7ff9940a6610 msgr2=0x7ff9940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:14.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.530+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3562895954 shutdown_connections 2023-09-30T22:27:14.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:14.530+0000 7ff99c2c1700 1 -- 172.21.15.154:0/3562895954 wait complete. 2023-09-30T22:27:14.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:15.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:15.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.188+0000 7f50a76f5700 1 Processor -- start 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.188+0000 7f50a76f5700 1 -- start start 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a76f5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a0133ad0 0x7f50a0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a76f5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50a0130bc0 0x7f50a013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a76f5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a006b2d0 con 0x7f50a01300a0 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a76f5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a0133610 con 0x7f50a0130bc0 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a76f5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50a009a500 con 0x7f50a0133ad0 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5491700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a0133ad0 0x7f50a0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5c92700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50a0130bc0 0x7f50a013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5c92700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50a0130bc0 0x7f50a013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42642/0 (socket says 172.21.15.154:42642) 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5491700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a0133ad0 0x7f50a0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33802/0 (socket says 172.21.15.154:33802) 2023-09-30T22:27:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5c92700 1 -- 172.21.15.154:0/709015358 learned_addr learned my addr 172.21.15.154:0/709015358 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5c92700 1 -- 172.21.15.154:0/709015358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a0133ad0 msgr2=0x7f50a0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5c92700 1 --2- 172.21.15.154:0/709015358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a0133ad0 0x7f50a0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5c92700 1 -- 172.21.15.154:0/709015358 >> v1:172.21.15.154:6789/0 conn(0x7f50a01300a0 legacy=0x7f50a01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5c92700 1 -- 172.21.15.154:0/709015358 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a01338b0 con 0x7f50a0130bc0 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.189+0000 7f50a5491700 1 --2- 172.21.15.154:0/709015358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a0133ad0 0x7f50a0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f50a5c92700 1 --2- 172.21.15.154:0/709015358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 0x7f50a013b990 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f5098009e50 tx=0x7f509800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ca2d121984a4f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f5097fff700 1 -- 172.21.15.154:0/709015358 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509800e070 con 0x7f50a0130bc0 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f5097fff700 1 -- 172.21.15.154:0/709015358 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509800b910 con 0x7f50a0130bc0 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f5097fff700 1 -- 172.21.15.154:0/709015358 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509800bcc0 con 0x7f50a0130bc0 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f50a76f5700 1 -- 172.21.15.154:0/709015358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 msgr2=0x7f50a013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f50a76f5700 1 --2- 172.21.15.154:0/709015358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 0x7f50a013b990 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f5098009e50 tx=0x7f509800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f50a76f5700 1 -- 172.21.15.154:0/709015358 shutdown_connections 2023-09-30T22:27:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f50a76f5700 1 --2- 172.21.15.154:0/709015358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 0x7f50a013b990 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f50a76f5700 1 --2- 172.21.15.154:0/709015358 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a0133ad0 0x7f50a0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f50a76f5700 1 -- 172.21.15.154:0/709015358 >> 172.21.15.154:0/709015358 conn(0x7f50a0099c40 msgr2=0x7f50a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f50a76f5700 1 -- 172.21.15.154:0/709015358 shutdown_connections 2023-09-30T22:27:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.190+0000 7f50a76f5700 1 -- 172.21.15.154:0/709015358 wait complete. 2023-09-30T22:27:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.191+0000 7f50a76f5700 1 Processor -- start 2023-09-30T22:27:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.191+0000 7f50a76f5700 1 -- start start 2023-09-30T22:27:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a76f5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a01300a0 0x7f50a011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a76f5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 0x7f50a011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a76f5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50a0133ad0 0x7f50a011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a76f5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a012da10 con 0x7f50a0130bc0 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a76f5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a011fe50 con 0x7f50a0133ad0 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a76f5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50a0120a30 con 0x7f50a01300a0 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a5491700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a01300a0 0x7f50a011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a5491700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a01300a0 0x7f50a011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:33810/0 (socket says 172.21.15.154:33810) 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a5491700 1 -- 172.21.15.154:0/3101701512 learned_addr learned my addr 172.21.15.154:0/3101701512 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a5c92700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50a0133ad0 0x7f50a011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a4c90700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 0x7f50a011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a4c90700 1 -- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a01300a0 msgr2=0x7f50a011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a4c90700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a01300a0 0x7f50a011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a4c90700 1 -- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50a0133ad0 msgr2=0x7f50a011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a4c90700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50a0133ad0 0x7f50a011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a4c90700 1 -- 172.21.15.154:0/3101701512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0094a0 con 0x7f50a0130bc0 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a5c92700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50a0133ad0 0x7f50a011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a4c90700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 0x7f50a011df80 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f5090000f60 tx=0x7f509000c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f5095ffb700 1 -- 172.21.15.154:0/3101701512 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900052d0 con 0x7f50a0130bc0 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f5095ffb700 1 -- 172.21.15.154:0/3101701512 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090005430 con 0x7f50a0130bc0 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f5095ffb700 1 -- 172.21.15.154:0/3101701512 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900038c0 con 0x7f50a0130bc0 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.192+0000 7f50a76f5700 1 -- 172.21.15.154:0/3101701512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5098009b30 con 0x7f50a0130bc0 2023-09-30T22:27:15.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.193+0000 7f50a76f5700 1 -- 172.21.15.154:0/3101701512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a012dd00 con 0x7f50a0130bc0 2023-09-30T22:27:15.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.193+0000 7f5095ffb700 1 -- 172.21.15.154:0/3101701512 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5090003a20 con 0x7f50a0130bc0 2023-09-30T22:27:15.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.193+0000 7f5095ffb700 1 -- 172.21.15.154:0/3101701512 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f509003e8d0 con 0x7f50a0130bc0 2023-09-30T22:27:15.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.194+0000 7f50a76f5700 1 -- 172.21.15.154:0/3101701512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a011eff0 con 0x7f50a0130bc0 2023-09-30T22:27:15.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.198+0000 7f5095ffb700 1 -- 172.21.15.154:0/3101701512 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5090003cd0 con 0x7f50a0130bc0 2023-09-30T22:27:15.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.380+0000 7f50a76f5700 1 -- 172.21.15.154:0/3101701512 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f50a004f2a0 con 0x7f50a0130bc0 2023-09-30T22:27:15.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.381+0000 7f5095ffb700 1 -- 172.21.15.154:0/3101701512 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5090017020 con 0x7f50a0130bc0 2023-09-30T22:27:15.382 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.383+0000 7f50a76f5700 1 -- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 msgr2=0x7f50a011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.383+0000 7f50a76f5700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 0x7f50a011df80 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f5090000f60 tx=0x7f509000c6e0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.383+0000 7f50a76f5700 1 -- 172.21.15.154:0/3101701512 shutdown_connections 2023-09-30T22:27:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.383+0000 7f50a76f5700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50a0133ad0 0x7f50a011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.383+0000 7f50a76f5700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50a01300a0 0x7f50a011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.383+0000 7f50a76f5700 1 --2- 172.21.15.154:0/3101701512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50a0130bc0 0x7f50a011df80 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.383+0000 7f50a76f5700 1 -- 172.21.15.154:0/3101701512 >> 172.21.15.154:0/3101701512 conn(0x7f50a0099c40 msgr2=0x7f50a0132d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.383+0000 7f50a76f5700 1 -- 172.21.15.154:0/3101701512 shutdown_connections 2023-09-30T22:27:15.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.383+0000 7f50a76f5700 1 -- 172.21.15.154:0/3101701512 wait complete. 2023-09-30T22:27:15.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:15.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:15.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:15.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:15.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.550+0000 7f5ee3764700 1 Processor -- start 2023-09-30T22:27:15.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.550+0000 7f5ee3764700 1 -- start start 2023-09-30T22:27:15.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee3764700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5edc09dec0 0x7f5edc06b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee3764700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc136cb0 0x7f5edc139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee3764700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc06e900 con 0x7f5edc06a770 2023-09-30T22:27:15.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee3764700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc09d180 con 0x7f5edc09dec0 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee3764700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc09e780 con 0x7f5edc136cb0 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee0cff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5edc09dec0 0x7f5edc06b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee0cff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5edc09dec0 0x7f5edc06b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39622/0 (socket says 172.21.15.154:39622) 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee0cff700 1 -- 172.21.15.154:0/674144261 learned_addr learned my addr 172.21.15.154:0/674144261 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee1d01700 1 --2- 172.21.15.154:0/674144261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc136cb0 0x7f5edc139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee0cff700 1 -- 172.21.15.154:0/674144261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc136cb0 msgr2=0x7f5edc139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee0cff700 1 --2- 172.21.15.154:0/674144261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc136cb0 0x7f5edc139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee0cff700 1 -- 172.21.15.154:0/674144261 >> v1:172.21.15.154:6789/0 conn(0x7f5edc06a770 legacy=0x7f5edc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee0cff700 1 -- 172.21.15.154:0/674144261 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc09d3c0 con 0x7f5edc09dec0 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ee0cff700 1 --2- 172.21.15.154:0/674144261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 0x7f5edc06b250 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0098f0 tx=0x7f5ecc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45e6b18741b44c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:15.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ed3fff700 1 -- 172.21.15.154:0/674144261 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc011830 con 0x7f5edc09dec0 2023-09-30T22:27:15.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ed3fff700 1 -- 172.21.15.154:0/674144261 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc011990 con 0x7f5edc09dec0 2023-09-30T22:27:15.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.551+0000 7f5ed3fff700 1 -- 172.21.15.154:0/674144261 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc011d20 con 0x7f5edc09dec0 2023-09-30T22:27:15.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.552+0000 7f5ee3764700 1 -- 172.21.15.154:0/674144261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 msgr2=0x7f5edc06b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.552+0000 7f5ee3764700 1 --2- 172.21.15.154:0/674144261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 0x7f5edc06b250 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0098f0 tx=0x7f5ecc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:15.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.552+0000 7f5ee3764700 1 -- 172.21.15.154:0/674144261 shutdown_connections 2023-09-30T22:27:15.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.552+0000 7f5ee3764700 1 --2- 172.21.15.154:0/674144261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc136cb0 0x7f5edc139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.552+0000 7f5ee3764700 1 --2- 172.21.15.154:0/674144261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 0x7f5edc06b250 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.552+0000 7f5ee3764700 1 -- 172.21.15.154:0/674144261 >> 172.21.15.154:0/674144261 conn(0x7f5edc099c40 msgr2=0x7f5edc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:15.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.552+0000 7f5ee3764700 1 -- 172.21.15.154:0/674144261 shutdown_connections 2023-09-30T22:27:15.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.552+0000 7f5ee3764700 1 -- 172.21.15.154:0/674144261 wait complete. 2023-09-30T22:27:15.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.554+0000 7f5ee3764700 1 Processor -- start 2023-09-30T22:27:15.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.554+0000 7f5ee3764700 1 -- start start 2023-09-30T22:27:15.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.554+0000 7f5ee3764700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc06a770 0x7f5edc09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.554+0000 7f5ee3764700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 0x7f5edc09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.554+0000 7f5ee3764700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5edc136cb0 0x7f5edc09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.554+0000 7f5ee3764700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc1344e0 con 0x7f5edc09dec0 2023-09-30T22:27:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.554+0000 7f5ee3764700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc071d70 con 0x7f5edc136cb0 2023-09-30T22:27:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.554+0000 7f5ee3764700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc135db0 con 0x7f5edc06a770 2023-09-30T22:27:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee0cff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 0x7f5edc09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee1d01700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5edc136cb0 0x7f5edc09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee0cff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 0x7f5edc09a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39638/0 (socket says 172.21.15.154:39638) 2023-09-30T22:27:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee0cff700 1 -- 172.21.15.154:0/2625440493 learned_addr learned my addr 172.21.15.154:0/2625440493 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee1500700 1 --2- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc06a770 0x7f5edc09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee1d01700 1 -- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc06a770 msgr2=0x7f5edc09a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee1d01700 1 --2- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc06a770 0x7f5edc09a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee1d01700 1 -- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 msgr2=0x7f5edc09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee1d01700 1 --2- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 0x7f5edc09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee1d01700 1 -- 172.21.15.154:0/2625440493 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc009550 con 0x7f5edc136cb0 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee0cff700 1 --2- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 0x7f5edc09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee1d01700 1 --2- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5edc136cb0 0x7f5edc09af10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400efc0 tx=0x7f5ed400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ed1ffb700 1 -- 172.21.15.154:0/2625440493 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed400cc90 con 0x7f5edc136cb0 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ed1ffb700 1 -- 172.21.15.154:0/2625440493 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed400f040 con 0x7f5edc136cb0 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ee3764700 1 -- 172.21.15.154:0/2625440493 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc09c0a0 con 0x7f5edc136cb0 2023-09-30T22:27:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.555+0000 7f5ed1ffb700 1 -- 172.21.15.154:0/2625440493 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40146c0 con 0x7f5edc136cb0 2023-09-30T22:27:15.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.556+0000 7f5ee3764700 1 -- 172.21.15.154:0/2625440493 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc131290 con 0x7f5edc136cb0 2023-09-30T22:27:15.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.556+0000 7f5ed1ffb700 1 -- 172.21.15.154:0/2625440493 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ed4014820 con 0x7f5edc136cb0 2023-09-30T22:27:15.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.557+0000 7f5ed1ffb700 1 -- 172.21.15.154:0/2625440493 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ed40402c0 con 0x7f5edc136cb0 2023-09-30T22:27:15.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.557+0000 7f5ee3764700 1 -- 172.21.15.154:0/2625440493 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc072280 con 0x7f5edc136cb0 2023-09-30T22:27:15.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.562+0000 7f5ed1ffb700 1 -- 172.21.15.154:0/2625440493 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ed401d400 con 0x7f5edc136cb0 2023-09-30T22:27:15.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.618+0000 7fce6b37f700 1 Processor -- start 2023-09-30T22:27:15.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6b37f700 1 -- start start 2023-09-30T22:27:15.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6b37f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce640a0a70 0x7fce640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6b37f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 0x7fce64133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6b37f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce641343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6b37f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6409e9d0 con 0x7fce640a0a70 2023-09-30T22:27:15.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6b37f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6409dc00 con 0x7fce640a1380 2023-09-30T22:27:15.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6b37f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce6409dec0 con 0x7fce64133f50 2023-09-30T22:27:15.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6911b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce640a0a70 0x7fce640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6991c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce641343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6911b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce640a0a70 0x7fce640a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39652/0 (socket says 172.21.15.154:39652) 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6911b700 1 -- 172.21.15.154:0/4208547298 learned_addr learned my addr 172.21.15.154:0/4208547298 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.619+0000 7fce6891a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 0x7fce64133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce6911b700 1 -- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 msgr2=0x7fce641343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce6911b700 1 --2- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce641343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce6911b700 1 -- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 msgr2=0x7fce64133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce6911b700 1 --2- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 0x7fce64133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce6911b700 1 -- 172.21.15.154:0/4208547298 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6409e6a0 con 0x7fce640a0a70 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce6991c700 1 --2- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce641343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce6891a700 1 --2- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 0x7fce64133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce6911b700 1 --2- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 0x7fce640a0e40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fce600098f0 tx=0x7fce60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6b0d9f48ebf507 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:15.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce5bfff700 1 -- 172.21.15.154:0/4208547298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60011830 con 0x7fce640a0a70 2023-09-30T22:27:15.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce5bfff700 1 -- 172.21.15.154:0/4208547298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce60011990 con 0x7fce640a0a70 2023-09-30T22:27:15.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.620+0000 7fce5bfff700 1 -- 172.21.15.154:0/4208547298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60011d20 con 0x7fce640a0a70 2023-09-30T22:27:15.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.621+0000 7fce6b37f700 1 -- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 msgr2=0x7fce640a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.621+0000 7fce6b37f700 1 --2- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 0x7fce640a0e40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fce600098f0 tx=0x7fce60009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:15.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.621+0000 7fce6b37f700 1 -- 172.21.15.154:0/4208547298 shutdown_connections 2023-09-30T22:27:15.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.621+0000 7fce6b37f700 1 --2- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce641343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.621+0000 7fce6b37f700 1 --2- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 0x7fce640a0e40 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.621+0000 7fce6b37f700 1 --2- 172.21.15.154:0/4208547298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 0x7fce64133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.621+0000 7fce6b37f700 1 -- 172.21.15.154:0/4208547298 >> 172.21.15.154:0/4208547298 conn(0x7fce640a6610 msgr2=0x7fce640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:15.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.621+0000 7fce6b37f700 1 -- 172.21.15.154:0/4208547298 shutdown_connections 2023-09-30T22:27:15.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.621+0000 7fce6b37f700 1 -- 172.21.15.154:0/4208547298 wait complete. 2023-09-30T22:27:15.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.622+0000 7fce6b37f700 1 Processor -- start 2023-09-30T22:27:15.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.622+0000 7fce6b37f700 1 -- start start 2023-09-30T22:27:15.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.622+0000 7fce6b37f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 0x7fce64122360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.622+0000 7fce6b37f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 0x7fce641228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6b37f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce64122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6b37f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64125f20 con 0x7fce640a0a70 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6b37f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce641251c0 con 0x7fce640a1380 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6b37f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce641240f0 con 0x7fce64133f50 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6911b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 0x7fce64122360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6891a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 0x7fce641228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6911b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 0x7fce64122360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39654/0 (socket says 172.21.15.154:39654) 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6911b700 1 -- 172.21.15.154:0/71906223 learned_addr learned my addr 172.21.15.154:0/71906223 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6991c700 1 --2- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce64122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6911b700 1 -- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 msgr2=0x7fce64122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6911b700 1 --2- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce64122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6911b700 1 -- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 msgr2=0x7fce641228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6911b700 1 --2- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 0x7fce641228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6911b700 1 -- 172.21.15.154:0/71906223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce540094a0 con 0x7fce640a0a70 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6991c700 1 --2- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce64122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6911b700 1 --2- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 0x7fce64122360 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fce60009c40 tx=0x7fce60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce59ffb700 1 -- 172.21.15.154:0/71906223 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60004240 con 0x7fce640a0a70 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce59ffb700 1 -- 172.21.15.154:0/71906223 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6001f070 con 0x7fce640a0a70 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce6b37f700 1 -- 172.21.15.154:0/71906223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c009a70 con 0x7fce640a0a70 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.623+0000 7fce59ffb700 1 -- 172.21.15.154:0/71906223 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce600045c0 con 0x7fce640a0a70 2023-09-30T22:27:15.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.624+0000 7fce6b37f700 1 -- 172.21.15.154:0/71906223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce60009550 con 0x7fce640a0a70 2023-09-30T22:27:15.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.624+0000 7fce59ffb700 1 -- 172.21.15.154:0/71906223 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce60021030 con 0x7fce640a0a70 2023-09-30T22:27:15.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.625+0000 7fce6b37f700 1 -- 172.21.15.154:0/71906223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6404f2a0 con 0x7fce640a0a70 2023-09-30T22:27:15.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.625+0000 7fce59ffb700 1 -- 172.21.15.154:0/71906223 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce60040750 con 0x7fce640a0a70 2023-09-30T22:27:15.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.634+0000 7fce59ffb700 1 -- 172.21.15.154:0/71906223 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce60015070 con 0x7fce640a0a70 2023-09-30T22:27:15.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.671+0000 7f3347981700 1 Processor -- start 2023-09-30T22:27:15.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f3347981700 1 -- start start 2023-09-30T22:27:15.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f3347981700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33400a0a70 0x7f33400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f3347981700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3340134120 0x7f334013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f3347981700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334009dc00 con 0x7f33400a1380 2023-09-30T22:27:15.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f3347981700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334009ea90 con 0x7f33400a0a70 2023-09-30T22:27:15.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f3347981700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334009dec0 con 0x7f3340134120 2023-09-30T22:27:15.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f3345f1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3340134120 0x7f334013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f334571d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33400a0a70 0x7f33400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f3345f1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3340134120 0x7f334013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58624/0 (socket says 172.21.15.154:58624) 2023-09-30T22:27:15.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.672+0000 7f3345f1e700 1 -- 172.21.15.154:0/1134717318 learned_addr learned my addr 172.21.15.154:0/1134717318 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:15.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.673+0000 7f334571d700 1 -- 172.21.15.154:0/1134717318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3340134120 msgr2=0x7f334013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:15.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.673+0000 7f334571d700 1 --2- 172.21.15.154:0/1134717318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3340134120 0x7f334013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.673+0000 7f334571d700 1 -- 172.21.15.154:0/1134717318 >> v1:172.21.15.154:6789/0 conn(0x7f33400a1380 legacy=0x7f3340133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.673+0000 7f334571d700 1 -- 172.21.15.154:0/1134717318 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334009e6a0 con 0x7f33400a0a70 2023-09-30T22:27:15.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.673+0000 7f3345f1e700 1 --2- 172.21.15.154:0/1134717318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3340134120 0x7f334013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:15.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.673+0000 7f334571d700 1 --2- 172.21.15.154:0/1134717318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33400a0a70 0x7f33400a0e40 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f333c009840 tx=0x7f333c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd98c0c1f8f2bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:15.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.673+0000 7f3337fff700 1 -- 172.21.15.154:0/1134717318 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c011830 con 0x7f33400a0a70 2023-09-30T22:27:15.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.673+0000 7f3337fff700 1 -- 172.21.15.154:0/1134717318 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c011990 con 0x7f33400a0a70 2023-09-30T22:27:15.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.673+0000 7f3337fff700 1 -- 172.21.15.154:0/1134717318 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c011d20 con 0x7f33400a0a70 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.674+0000 7f3347981700 1 -- 172.21.15.154:0/1134717318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33400a0a70 msgr2=0x7f33400a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.674+0000 7f3347981700 1 --2- 172.21.15.154:0/1134717318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33400a0a70 0x7f33400a0e40 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f333c009840 tx=0x7f333c009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.674+0000 7f3347981700 1 -- 172.21.15.154:0/1134717318 shutdown_connections 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.674+0000 7f3347981700 1 --2- 172.21.15.154:0/1134717318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3340134120 0x7f334013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.674+0000 7f3347981700 1 --2- 172.21.15.154:0/1134717318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33400a0a70 0x7f33400a0e40 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.674+0000 7f3347981700 1 -- 172.21.15.154:0/1134717318 >> 172.21.15.154:0/1134717318 conn(0x7f33400a6610 msgr2=0x7f33400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.674+0000 7f3347981700 1 -- 172.21.15.154:0/1134717318 shutdown_connections 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.674+0000 7f3347981700 1 -- 172.21.15.154:0/1134717318 wait complete. 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.675+0000 7f3347981700 1 Processor -- start 2023-09-30T22:27:15.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.675+0000 7f3347981700 1 -- start start 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.675+0000 7f3347981700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33400a0a70 0x7f33401c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.675+0000 7f3347981700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33400a1380 0x7f33401c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3347981700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3340134120 0x7f334011e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3347981700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401206a0 con 0x7f3340134120 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3347981700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33401204b0 con 0x7f33400a0a70 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3347981700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3340133250 con 0x7f33400a1380 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f334571d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33400a0a70 0x7f33401c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f334571d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33400a0a70 0x7f33401c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58640/0 (socket says 172.21.15.154:58640) 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f334571d700 1 -- 172.21.15.154:0/239703750 learned_addr learned my addr 172.21.15.154:0/239703750 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3344f1c700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33400a1380 0x7f33401c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3345f1e700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3340134120 0x7f334011e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f334571d700 1 -- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33400a1380 msgr2=0x7f33401c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f334571d700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33400a1380 0x7f33401c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f334571d700 1 -- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3340134120 msgr2=0x7f334011e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f334571d700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3340134120 0x7f334011e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f334571d700 1 -- 172.21.15.154:0/239703750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338009b30 con 0x7f33400a0a70 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3344f1c700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33400a1380 0x7f33401c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f334571d700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33400a0a70 0x7f33401c8a60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f333c009fd0 tx=0x7f333c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3335ffb700 1 -- 172.21.15.154:0/239703750 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c004550 con 0x7f33400a0a70 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3335ffb700 1 -- 172.21.15.154:0/239703750 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c01f070 con 0x7f33400a0a70 2023-09-30T22:27:15.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3347981700 1 -- 172.21.15.154:0/239703750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333c0094a0 con 0x7f33400a0a70 2023-09-30T22:27:15.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.676+0000 7f3335ffb700 1 -- 172.21.15.154:0/239703750 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c0038e0 con 0x7f33400a0a70 2023-09-30T22:27:15.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.677+0000 7f3347981700 1 -- 172.21.15.154:0/239703750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3340133aa0 con 0x7f33400a0a70 2023-09-30T22:27:15.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.678+0000 7f3347981700 1 -- 172.21.15.154:0/239703750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334004f2a0 con 0x7f33400a0a70 2023-09-30T22:27:15.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.678+0000 7f3335ffb700 1 -- 172.21.15.154:0/239703750 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f333c003a40 con 0x7f33400a0a70 2023-09-30T22:27:15.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.678+0000 7f3335ffb700 1 -- 172.21.15.154:0/239703750 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f333c021070 con 0x7f33400a0a70 2023-09-30T22:27:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.687+0000 7f3335ffb700 1 -- 172.21.15.154:0/239703750 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f333c0193b0 con 0x7f33400a0a70 2023-09-30T22:27:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.767+0000 7f5ee3764700 1 -- 172.21.15.154:0/2625440493 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5edc04f2a0 con 0x7f5edc136cb0 2023-09-30T22:27:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.767+0000 7f5ed1ffb700 1 -- 172.21.15.154:0/2625440493 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ed4012340 con 0x7f5edc136cb0 2023-09-30T22:27:15.768 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:15.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.771+0000 7f5ee3764700 1 -- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5edc136cb0 msgr2=0x7f5edc09af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.771+0000 7f5ee3764700 1 --2- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5edc136cb0 0x7f5edc09af10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400efc0 tx=0x7f5ed400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.771+0000 7f5ee3764700 1 -- 172.21.15.154:0/2625440493 shutdown_connections 2023-09-30T22:27:15.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.771+0000 7f5ee3764700 1 --2- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5edc136cb0 0x7f5edc09af10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.771+0000 7f5ee3764700 1 --2- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5edc06a770 0x7f5edc09a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.771+0000 7f5ee3764700 1 --2- 172.21.15.154:0/2625440493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5edc09dec0 0x7f5edc09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.771+0000 7f5ee3764700 1 -- 172.21.15.154:0/2625440493 >> 172.21.15.154:0/2625440493 conn(0x7f5edc099c40 msgr2=0x7f5edc138c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:15.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.771+0000 7f5ee3764700 1 -- 172.21.15.154:0/2625440493 shutdown_connections 2023-09-30T22:27:15.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.771+0000 7f5ee3764700 1 -- 172.21.15.154:0/2625440493 wait complete. 2023-09-30T22:27:15.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:15.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.833+0000 7fce6b37f700 1 -- 172.21.15.154:0/71906223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fce64072980 con 0x7fce640a0a70 2023-09-30T22:27:15.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.833+0000 7fce59ffb700 1 -- 172.21.15.154:0/71906223 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce6001a450 con 0x7fce640a0a70 2023-09-30T22:27:15.834 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.836+0000 7fce6b37f700 1 -- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 msgr2=0x7fce64122360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.836+0000 7fce6b37f700 1 --2- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 0x7fce64122360 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fce60009c40 tx=0x7fce60004750 comp rx=0 tx=0).stop 2023-09-30T22:27:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.837+0000 7fce6b37f700 1 -- 172.21.15.154:0/71906223 shutdown_connections 2023-09-30T22:27:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.837+0000 7fce6b37f700 1 --2- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce64133f50 0x7fce64122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.837+0000 7fce6b37f700 1 --2- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce640a0a70 0x7fce64122360 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.837+0000 7fce6b37f700 1 --2- 172.21.15.154:0/71906223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce640a1380 0x7fce641228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.837+0000 7fce6b37f700 1 -- 172.21.15.154:0/71906223 >> 172.21.15.154:0/71906223 conn(0x7fce640a6610 msgr2=0x7fce6409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.837+0000 7fce6b37f700 1 -- 172.21.15.154:0/71906223 shutdown_connections 2023-09-30T22:27:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.837+0000 7fce6b37f700 1 -- 172.21.15.154:0/71906223 wait complete. 2023-09-30T22:27:15.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:15.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.889+0000 7f3347981700 1 -- 172.21.15.154:0/239703750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3340120ca0 con 0x7f33400a0a70 2023-09-30T22:27:15.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.890+0000 7f3335ffb700 1 -- 172.21.15.154:0/239703750 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f333c034020 con 0x7f33400a0a70 2023-09-30T22:27:15.891 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:15.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.892+0000 7f3347981700 1 -- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33400a0a70 msgr2=0x7f33401c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:15.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.892+0000 7f3347981700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33400a0a70 0x7f33401c8a60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f333c009fd0 tx=0x7f333c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:15.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.892+0000 7f3347981700 1 -- 172.21.15.154:0/239703750 shutdown_connections 2023-09-30T22:27:15.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.892+0000 7f3347981700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3340134120 0x7f334011e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.892+0000 7f3347981700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33400a0a70 0x7f33401c8a60 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.892+0000 7f3347981700 1 --2- 172.21.15.154:0/239703750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f33400a1380 0x7f33401c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:15.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.892+0000 7f3347981700 1 -- 172.21.15.154:0/239703750 >> 172.21.15.154:0/239703750 conn(0x7f33400a6610 msgr2=0x7f33400a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:15.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.892+0000 7f3347981700 1 -- 172.21.15.154:0/239703750 shutdown_connections 2023-09-30T22:27:15.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:15.892+0000 7f3347981700 1 -- 172.21.15.154:0/239703750 wait complete. 2023-09-30T22:27:15.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:16.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:16.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.522+0000 7f48ef79d700 1 Processor -- start 2023-09-30T22:27:16.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.522+0000 7f48ef79d700 1 -- start start 2023-09-30T22:27:16.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ef79d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e809e870 0x7f48e809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ef79d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48e809f180 0x7f48e8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ef79d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e8131d70 0x7f48e8132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ef79d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e80a0920 con 0x7f48e809f180 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ef79d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e809c970 con 0x7f48e809e870 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ef79d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48e809bab0 con 0x7f48e8131d70 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ecd38700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48e809f180 0x7f48e8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ed539700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e809e870 0x7f48e809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48edd3a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e8131d70 0x7f48e8132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ecd38700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48e809f180 0x7f48e8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39694/0 (socket says 172.21.15.154:39694) 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ed539700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e809e870 0x7f48e809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58644/0 (socket says 172.21.15.154:58644) 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ecd38700 1 -- 172.21.15.154:0/1208083227 learned_addr learned my addr 172.21.15.154:0/1208083227 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:16.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ed539700 1 -- 172.21.15.154:0/1208083227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e8131d70 msgr2=0x7f48e8132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ed539700 1 --2- 172.21.15.154:0/1208083227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e8131d70 0x7f48e8132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ed539700 1 -- 172.21.15.154:0/1208083227 >> v2:172.21.15.154:3300/0 conn(0x7f48e809f180 msgr2=0x7f48e8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ed539700 1 --2- 172.21.15.154:0/1208083227 >> v2:172.21.15.154:3300/0 conn(0x7f48e809f180 0x7f48e8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ed539700 1 -- 172.21.15.154:0/1208083227 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e809f9c0 con 0x7f48e809e870 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.523+0000 7f48ecd38700 1 --2- 172.21.15.154:0/1208083227 >> v2:172.21.15.154:3300/0 conn(0x7f48e809f180 0x7f48e8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ed539700 1 --2- 172.21.15.154:0/1208083227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e809e870 0x7f48e809ec40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009870 tx=0x7f48d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd34e3da02179e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48dffff700 1 -- 172.21.15.154:0/1208083227 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8011830 con 0x7f48e809e870 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48dffff700 1 -- 172.21.15.154:0/1208083227 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8011990 con 0x7f48e809e870 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48dffff700 1 -- 172.21.15.154:0/1208083227 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8011d20 con 0x7f48e809e870 2023-09-30T22:27:16.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ef79d700 1 -- 172.21.15.154:0/1208083227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e809e870 msgr2=0x7f48e809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ef79d700 1 --2- 172.21.15.154:0/1208083227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e809e870 0x7f48e809ec40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009870 tx=0x7f48d8009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ef79d700 1 -- 172.21.15.154:0/1208083227 shutdown_connections 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ef79d700 1 --2- 172.21.15.154:0/1208083227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e809e870 0x7f48e809ec40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ef79d700 1 --2- 172.21.15.154:0/1208083227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e8131d70 0x7f48e8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ef79d700 1 --2- 172.21.15.154:0/1208083227 >> v2:172.21.15.154:3300/0 conn(0x7f48e809f180 0x7f48e8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ef79d700 1 -- 172.21.15.154:0/1208083227 >> 172.21.15.154:0/1208083227 conn(0x7f48e80a4430 msgr2=0x7f48e80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ef79d700 1 -- 172.21.15.154:0/1208083227 shutdown_connections 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.524+0000 7f48ef79d700 1 -- 172.21.15.154:0/1208083227 wait complete. 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.525+0000 7f48ef79d700 1 Processor -- start 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.525+0000 7f48ef79d700 1 -- start start 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ef79d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e809e870 0x7f48e806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ef79d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e809f180 0x7f48e806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ef79d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e8131d70 0x7f48e806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ef79d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e806d8c0 con 0x7f48e809e870 2023-09-30T22:27:16.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ef79d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8124d90 con 0x7f48e8131d70 2023-09-30T22:27:16.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ef79d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8123af0 con 0x7f48e809f180 2023-09-30T22:27:16.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ed539700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e809e870 0x7f48e806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ed539700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e809e870 0x7f48e806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39706/0 (socket says 172.21.15.154:39706) 2023-09-30T22:27:16.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ecd38700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e809f180 0x7f48e806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ed539700 1 -- 172.21.15.154:0/945022977 learned_addr learned my addr 172.21.15.154:0/945022977 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:16.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48edd3a700 1 --2- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e8131d70 0x7f48e806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ed539700 1 -- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e809f180 msgr2=0x7f48e806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ed539700 1 --2- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e809f180 0x7f48e806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ed539700 1 -- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e8131d70 msgr2=0x7f48e806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ed539700 1 --2- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e8131d70 0x7f48e806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ed539700 1 -- 172.21.15.154:0/945022977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4009550 con 0x7f48e809e870 2023-09-30T22:27:16.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ed539700 1 --2- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e809e870 0x7f48e806b8b0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f48d80090b0 tx=0x7f48d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ddffb700 1 -- 172.21.15.154:0/945022977 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8004450 con 0x7f48e809e870 2023-09-30T22:27:16.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ddffb700 1 -- 172.21.15.154:0/945022977 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d801f070 con 0x7f48e809e870 2023-09-30T22:27:16.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ef79d700 1 -- 172.21.15.154:0/945022977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d80094a0 con 0x7f48e809e870 2023-09-30T22:27:16.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.526+0000 7f48ddffb700 1 -- 172.21.15.154:0/945022977 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80038a0 con 0x7f48e809e870 2023-09-30T22:27:16.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.527+0000 7f48ef79d700 1 -- 172.21.15.154:0/945022977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e8124160 con 0x7f48e809e870 2023-09-30T22:27:16.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.527+0000 7f48ef79d700 1 -- 172.21.15.154:0/945022977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e811be60 con 0x7f48e809e870 2023-09-30T22:27:16.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.528+0000 7f48ddffb700 1 -- 172.21.15.154:0/945022977 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48d8003a00 con 0x7f48e809e870 2023-09-30T22:27:16.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.528+0000 7f48ddffb700 1 -- 172.21.15.154:0/945022977 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f48d8021070 con 0x7f48e809e870 2023-09-30T22:27:16.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.532+0000 7f48ddffb700 1 -- 172.21.15.154:0/945022977 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48d80045b0 con 0x7f48e809e870 2023-09-30T22:27:16.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.716+0000 7f48ef79d700 1 -- 172.21.15.154:0/945022977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f48e81236d0 con 0x7f48e809e870 2023-09-30T22:27:16.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.716+0000 7f48ddffb700 1 -- 172.21.15.154:0/945022977 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48d8034090 con 0x7f48e809e870 2023-09-30T22:27:16.717 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:16.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.718+0000 7f48ef79d700 1 -- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e809e870 msgr2=0x7f48e806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.718+0000 7f48ef79d700 1 --2- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e809e870 0x7f48e806b8b0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f48d80090b0 tx=0x7f48d8004750 comp rx=0 tx=0).stop 2023-09-30T22:27:16.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.718+0000 7f48ef79d700 1 -- 172.21.15.154:0/945022977 shutdown_connections 2023-09-30T22:27:16.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.718+0000 7f48ef79d700 1 --2- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e8131d70 0x7f48e806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.718+0000 7f48ef79d700 1 --2- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e809e870 0x7f48e806b8b0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.718+0000 7f48ef79d700 1 --2- 172.21.15.154:0/945022977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f48e809f180 0x7f48e806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.718+0000 7f48ef79d700 1 -- 172.21.15.154:0/945022977 >> 172.21.15.154:0/945022977 conn(0x7f48e80a4430 msgr2=0x7f48e8131110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.718+0000 7f48ef79d700 1 -- 172.21.15.154:0/945022977 shutdown_connections 2023-09-30T22:27:16.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.718+0000 7f48ef79d700 1 -- 172.21.15.154:0/945022977 wait complete. 2023-09-30T22:27:16.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:16.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:16.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:16.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:16.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.916+0000 7f6217488700 1 Processor -- start 2023-09-30T22:27:16.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.916+0000 7f6217488700 1 -- start start 2023-09-30T22:27:16.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6217488700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6210133b80 0x7f6210133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6217488700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100a0ff0 0x7f621013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6217488700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621009aa00 con 0x7f6210099a60 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6217488700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621009a080 con 0x7f62100a0ff0 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6217488700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6210133750 con 0x7f6210133b80 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6214a23700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6210099a60 0x7f62100a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43038/0 (socket says 172.21.15.154:43038) 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6214a23700 1 -- 172.21.15.154:0/218445355 learned_addr learned my addr 172.21.15.154:0/218445355 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6215a25700 1 --2- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100a0ff0 0x7f621013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6215224700 1 --2- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6210133b80 0x7f6210133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6215a25700 1 -- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6210133b80 msgr2=0x7f6210133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6215a25700 1 --2- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6210133b80 0x7f6210133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6215a25700 1 -- 172.21.15.154:0/218445355 >> v1:172.21.15.154:6789/0 conn(0x7f6210099a60 legacy=0x7f62100a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6215a25700 1 -- 172.21.15.154:0/218445355 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621009a760 con 0x7f62100a0ff0 2023-09-30T22:27:16.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6215224700 1 --2- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6210133b80 0x7f6210133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:16.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.917+0000 7f6215a25700 1 --2- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100a0ff0 0x7f621013b910 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6208009dc0 tx=0x7f620800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c7d17913f79c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.918+0000 7f6207fff700 1 -- 172.21.15.154:0/218445355 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800e070 con 0x7f62100a0ff0 2023-09-30T22:27:16.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.918+0000 7f6207fff700 1 -- 172.21.15.154:0/218445355 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620800bb20 con 0x7f62100a0ff0 2023-09-30T22:27:16.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.918+0000 7f6207fff700 1 -- 172.21.15.154:0/218445355 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208012430 con 0x7f62100a0ff0 2023-09-30T22:27:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.918+0000 7f6217488700 1 -- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100a0ff0 msgr2=0x7f621013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.918+0000 7f6217488700 1 --2- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100a0ff0 0x7f621013b910 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6208009dc0 tx=0x7f620800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.919+0000 7f6217488700 1 -- 172.21.15.154:0/218445355 shutdown_connections 2023-09-30T22:27:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.919+0000 7f6217488700 1 --2- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100a0ff0 0x7f621013b910 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.919+0000 7f6217488700 1 --2- 172.21.15.154:0/218445355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6210133b80 0x7f6210133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.919+0000 7f6217488700 1 -- 172.21.15.154:0/218445355 >> 172.21.15.154:0/218445355 conn(0x7f62100a2980 msgr2=0x7f62100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.919+0000 7f6217488700 1 -- 172.21.15.154:0/218445355 shutdown_connections 2023-09-30T22:27:16.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.919+0000 7f6217488700 1 -- 172.21.15.154:0/218445355 wait complete. 2023-09-30T22:27:16.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.920+0000 7f6217488700 1 Processor -- start 2023-09-30T22:27:16.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.920+0000 7f6217488700 1 -- start start 2023-09-30T22:27:16.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6217488700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6210099a60 0x7f621011b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6217488700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62100a0ff0 0x7f621011bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6217488700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6210133b80 0x7f621011c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6217488700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621011d3e0 con 0x7f6210099a60 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6217488700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621011da00 con 0x7f6210133b80 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6217488700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f621011e630 con 0x7f62100a0ff0 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6214a23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62100a0ff0 0x7f621011bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6215224700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6210099a60 0x7f621011b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6214a23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62100a0ff0 0x7f621011bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:56950/0 (socket says 172.21.15.154:56950) 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6214a23700 1 -- 172.21.15.154:0/195803460 learned_addr learned my addr 172.21.15.154:0/195803460 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6215a25700 1 --2- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6210133b80 0x7f621011c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6214a23700 1 -- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6210133b80 msgr2=0x7f621011c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6214a23700 1 --2- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6210133b80 0x7f621011c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6214a23700 1 -- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6210099a60 msgr2=0x7f621011b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6214a23700 1 --2- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6210099a60 0x7f621011b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6214a23700 1 -- 172.21.15.154:0/195803460 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c009430 con 0x7f62100a0ff0 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.921+0000 7f6215224700 1 --2- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6210099a60 0x7f621011b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.922+0000 7f6214a23700 1 --2- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62100a0ff0 0x7f621011bd10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f620000c500 tx=0x7f620000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.922+0000 7f6205ffb700 1 -- 172.21.15.154:0/195803460 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200005d70 con 0x7f62100a0ff0 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.922+0000 7f6217488700 1 -- 172.21.15.154:0/195803460 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6208009a70 con 0x7f62100a0ff0 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.922+0000 7f6205ffb700 1 -- 172.21.15.154:0/195803460 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62000070d0 con 0x7f62100a0ff0 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.922+0000 7f6205ffb700 1 -- 172.21.15.154:0/195803460 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200007440 con 0x7f62100a0ff0 2023-09-30T22:27:16.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.922+0000 7f6217488700 1 -- 172.21.15.154:0/195803460 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6210130d40 con 0x7f62100a0ff0 2023-09-30T22:27:16.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.923+0000 7f6217488700 1 -- 172.21.15.154:0/195803460 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621009a320 con 0x7f62100a0ff0 2023-09-30T22:27:16.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.928+0000 7f6205ffb700 1 -- 172.21.15.154:0/195803460 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62000075a0 con 0x7f62100a0ff0 2023-09-30T22:27:16.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.928+0000 7f6205ffb700 1 -- 172.21.15.154:0/195803460 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f620003ee70 con 0x7f62100a0ff0 2023-09-30T22:27:16.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.932+0000 7f6205ffb700 1 -- 172.21.15.154:0/195803460 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6200019d20 con 0x7f62100a0ff0 2023-09-30T22:27:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.982+0000 7f243fa2f700 1 Processor -- start 2023-09-30T22:27:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.982+0000 7f243fa2f700 1 -- start start 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243fa2f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2438133ad0 0x7f2438133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243fa2f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381300a0 0x7f24381304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243fa2f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24381309f0 0x7f243813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243fa2f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243806b2d0 con 0x7f2438133ad0 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243fa2f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2438133610 con 0x7f24381300a0 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243fa2f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f243809a500 con 0x7f24381309f0 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243d7cb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2438133ad0 0x7f2438133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243cfca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381300a0 0x7f24381304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243cfca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381300a0 0x7f24381304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58664/0 (socket says 172.21.15.154:58664) 2023-09-30T22:27:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243d7cb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2438133ad0 0x7f2438133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39722/0 (socket says 172.21.15.154:39722) 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243cfca700 1 -- 172.21.15.154:0/856939817 learned_addr learned my addr 172.21.15.154:0/856939817 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243dfcc700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24381309f0 0x7f243813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.983+0000 7f243d7cb700 1 -- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24381309f0 msgr2=0x7f243813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f243d7cb700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24381309f0 0x7f243813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f243d7cb700 1 -- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381300a0 msgr2=0x7f24381304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f243d7cb700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381300a0 0x7f24381304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f243d7cb700 1 -- 172.21.15.154:0/856939817 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24381338b0 con 0x7f2438133ad0 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f243cfca700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381300a0 0x7f24381304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f243dfcc700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24381309f0 0x7f243813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f243d7cb700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2438133ad0 0x7f2438133ea0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2434009840 tx=0x7f2434009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3273ee0be87c2f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f242ffff700 1 -- 172.21.15.154:0/856939817 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434011830 con 0x7f2438133ad0 2023-09-30T22:27:16.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f242ffff700 1 -- 172.21.15.154:0/856939817 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434011990 con 0x7f2438133ad0 2023-09-30T22:27:16.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f242ffff700 1 -- 172.21.15.154:0/856939817 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434011d20 con 0x7f2438133ad0 2023-09-30T22:27:16.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f243fa2f700 1 -- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2438133ad0 msgr2=0x7f2438133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.984+0000 7f243fa2f700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2438133ad0 0x7f2438133ea0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2434009840 tx=0x7f2434009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:16.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.985+0000 7f243fa2f700 1 -- 172.21.15.154:0/856939817 shutdown_connections 2023-09-30T22:27:16.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.985+0000 7f243fa2f700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24381309f0 0x7f243813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.985+0000 7f243fa2f700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2438133ad0 0x7f2438133ea0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.985+0000 7f243fa2f700 1 --2- 172.21.15.154:0/856939817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381300a0 0x7f24381304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.985+0000 7f243fa2f700 1 -- 172.21.15.154:0/856939817 >> 172.21.15.154:0/856939817 conn(0x7f2438099c40 msgr2=0x7f24380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.985+0000 7f243fa2f700 1 -- 172.21.15.154:0/856939817 shutdown_connections 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.985+0000 7f243fa2f700 1 -- 172.21.15.154:0/856939817 wait complete. 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243fa2f700 1 Processor -- start 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243fa2f700 1 -- start start 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243fa2f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24381300a0 0x7f24381c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243fa2f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381309f0 0x7f24381c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243fa2f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2438133ad0 0x7f24381c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:16.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243fa2f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243811fe90 con 0x7f24381300a0 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243fa2f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2438120170 con 0x7f24381309f0 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243fa2f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24380a33c0 con 0x7f2438133ad0 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243d7cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24381300a0 0x7f24381c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243d7cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24381300a0 0x7f24381c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39728/0 (socket says 172.21.15.154:39728) 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243d7cb700 1 -- 172.21.15.154:0/3657526775 learned_addr learned my addr 172.21.15.154:0/3657526775 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243dfcc700 1 --2- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2438133ad0 0x7f24381c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243cfca700 1 --2- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381309f0 0x7f24381c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243d7cb700 1 -- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2438133ad0 msgr2=0x7f24381c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243d7cb700 1 --2- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2438133ad0 0x7f24381c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243d7cb700 1 -- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381309f0 msgr2=0x7f24381c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243d7cb700 1 --2- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381309f0 0x7f24381c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:16.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.986+0000 7f243d7cb700 1 -- 172.21.15.154:0/3657526775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428009550 con 0x7f24381300a0 2023-09-30T22:27:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.987+0000 7f243d7cb700 1 --2- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24381300a0 0x7f24381c8750 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f2434009fd0 tx=0x7f2434004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.987+0000 7f242dffb700 1 -- 172.21.15.154:0/3657526775 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434004510 con 0x7f24381300a0 2023-09-30T22:27:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.987+0000 7f242dffb700 1 -- 172.21.15.154:0/3657526775 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243401f070 con 0x7f24381300a0 2023-09-30T22:27:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.987+0000 7f243fa2f700 1 -- 172.21.15.154:0/3657526775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24340094a0 con 0x7f24381300a0 2023-09-30T22:27:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.987+0000 7f242dffb700 1 -- 172.21.15.154:0/3657526775 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24340038e0 con 0x7f24381300a0 2023-09-30T22:27:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.987+0000 7f243fa2f700 1 -- 172.21.15.154:0/3657526775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24380715e0 con 0x7f24381300a0 2023-09-30T22:27:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.988+0000 7f242dffb700 1 -- 172.21.15.154:0/3657526775 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2434003a40 con 0x7f24381300a0 2023-09-30T22:27:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.988+0000 7f242dffb700 1 -- 172.21.15.154:0/3657526775 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2434021070 con 0x7f24381300a0 2023-09-30T22:27:16.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.988+0000 7f243fa2f700 1 -- 172.21.15.154:0/3657526775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2438133270 con 0x7f24381300a0 2023-09-30T22:27:16.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:16.997+0000 7f242dffb700 1 -- 172.21.15.154:0/3657526775 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f243402b080 con 0x7f24381300a0 2023-09-30T22:27:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.037+0000 7fc461531700 1 Processor -- start 2023-09-30T22:27:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.037+0000 7fc461531700 1 -- start start 2023-09-30T22:27:17.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc461531700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc45c09a150 0x7fc45c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc461531700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09f1a0 0x7fc45c134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc461531700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c09af80 con 0x7fc45c09edb0 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc461531700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c09a520 con 0x7fc45c09a150 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc461531700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c09fe00 con 0x7fc45c09f1a0 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc45affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc45c09a150 0x7fc45c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc45affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc45c09a150 0x7fc45c09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39742/0 (socket says 172.21.15.154:39742) 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc45affd700 1 -- 172.21.15.154:0/83474556 learned_addr learned my addr 172.21.15.154:0/83474556 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc45b7fe700 1 --2- 172.21.15.154:0/83474556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09f1a0 0x7fc45c134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc45affd700 1 -- 172.21.15.154:0/83474556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09f1a0 msgr2=0x7fc45c134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc45affd700 1 --2- 172.21.15.154:0/83474556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09f1a0 0x7fc45c134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc45affd700 1 -- 172.21.15.154:0/83474556 >> v1:172.21.15.154:6789/0 conn(0x7fc45c09edb0 legacy=0x7fc45c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.038+0000 7fc45affd700 1 -- 172.21.15.154:0/83474556 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c06bc20 con 0x7fc45c09a150 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc45affd700 1 --2- 172.21.15.154:0/83474556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a150 0x7fc45c09e870 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0098f0 tx=0x7fc44c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c79a541dac3d34 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc459ffb700 1 -- 172.21.15.154:0/83474556 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c011830 con 0x7fc45c09a150 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc459ffb700 1 -- 172.21.15.154:0/83474556 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c011990 con 0x7fc45c09a150 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc459ffb700 1 -- 172.21.15.154:0/83474556 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c011d20 con 0x7fc45c09a150 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc461531700 1 -- 172.21.15.154:0/83474556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a150 msgr2=0x7fc45c09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc461531700 1 --2- 172.21.15.154:0/83474556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a150 0x7fc45c09e870 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0098f0 tx=0x7fc44c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc461531700 1 -- 172.21.15.154:0/83474556 shutdown_connections 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc461531700 1 --2- 172.21.15.154:0/83474556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09f1a0 0x7fc45c134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc461531700 1 --2- 172.21.15.154:0/83474556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09a150 0x7fc45c09e870 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc461531700 1 -- 172.21.15.154:0/83474556 >> 172.21.15.154:0/83474556 conn(0x7fc45c0a4430 msgr2=0x7fc45c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc461531700 1 -- 172.21.15.154:0/83474556 shutdown_connections 2023-09-30T22:27:17.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.039+0000 7fc461531700 1 -- 172.21.15.154:0/83474556 wait complete. 2023-09-30T22:27:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc461531700 1 Processor -- start 2023-09-30T22:27:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc461531700 1 -- start start 2023-09-30T22:27:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc461531700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09a150 0x7fc45c1c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc461531700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c09edb0 0x7fc45c1c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc461531700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09f1a0 0x7fc45c1c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc461531700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0a0440 con 0x7fc45c09f1a0 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc461531700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c09bf40 con 0x7fc45c09a150 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc461531700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c1abbc0 con 0x7fc45c09edb0 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c09edb0 0x7fc45c1c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c09edb0 0x7fc45c1c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:56980/0 (socket says 172.21.15.154:56980) 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45a7fc700 1 -- 172.21.15.154:0/2438652563 learned_addr learned my addr 172.21.15.154:0/2438652563 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45affd700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09a150 0x7fc45c1c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45b7fe700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09f1a0 0x7fc45c1c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45a7fc700 1 -- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09a150 msgr2=0x7fc45c1c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45a7fc700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09a150 0x7fc45c1c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45a7fc700 1 -- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09f1a0 msgr2=0x7fc45c1c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45a7fc700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09f1a0 0x7fc45c1c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.041+0000 7fc45a7fc700 1 -- 172.21.15.154:0/2438652563 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c009550 con 0x7fc45c09edb0 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.042+0000 7fc45affd700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09a150 0x7fc45c1c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.042+0000 7fc45b7fe700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09f1a0 0x7fc45c1c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.042+0000 7fc45a7fc700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c09edb0 0x7fc45c1c9010 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc45000c4e0 tx=0x7fc45000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.042+0000 7fc4437fe700 1 -- 172.21.15.154:0/2438652563 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500052d0 con 0x7fc45c09edb0 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.042+0000 7fc4437fe700 1 -- 172.21.15.154:0/2438652563 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450005430 con 0x7fc45c09edb0 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.042+0000 7fc461531700 1 -- 172.21.15.154:0/2438652563 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c1a9fb0 con 0x7fc45c09edb0 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.042+0000 7fc4437fe700 1 -- 172.21.15.154:0/2438652563 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500038c0 con 0x7fc45c09edb0 2023-09-30T22:27:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.042+0000 7fc461531700 1 -- 172.21.15.154:0/2438652563 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c1ac580 con 0x7fc45c09edb0 2023-09-30T22:27:17.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.043+0000 7fc461531700 1 -- 172.21.15.154:0/2438652563 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c09fa30 con 0x7fc45c09edb0 2023-09-30T22:27:17.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.043+0000 7fc4437fe700 1 -- 172.21.15.154:0/2438652563 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc450003a20 con 0x7fc45c09edb0 2023-09-30T22:27:17.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.043+0000 7fc4437fe700 1 -- 172.21.15.154:0/2438652563 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc45003ef80 con 0x7fc45c09edb0 2023-09-30T22:27:17.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.052+0000 7fc4437fe700 1 -- 172.21.15.154:0/2438652563 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc450018260 con 0x7fc45c09edb0 2023-09-30T22:27:17.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.132+0000 7f6217488700 1 -- 172.21.15.154:0/195803460 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f621004f2a0 con 0x7f62100a0ff0 2023-09-30T22:27:17.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.132+0000 7f6205ffb700 1 -- 172.21.15.154:0/195803460 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6200017020 con 0x7f62100a0ff0 2023-09-30T22:27:17.133 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:17.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.134+0000 7f6217488700 1 -- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62100a0ff0 msgr2=0x7f621011bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.134+0000 7f6217488700 1 --2- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62100a0ff0 0x7f621011bd10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f620000c500 tx=0x7f620000c810 comp rx=0 tx=0).stop 2023-09-30T22:27:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.134+0000 7f6217488700 1 -- 172.21.15.154:0/195803460 shutdown_connections 2023-09-30T22:27:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.134+0000 7f6217488700 1 --2- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6210133b80 0x7f621011c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.134+0000 7f6217488700 1 --2- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6210099a60 0x7f621011b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.134+0000 7f6217488700 1 --2- 172.21.15.154:0/195803460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f62100a0ff0 0x7f621011bd10 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.134+0000 7f6217488700 1 -- 172.21.15.154:0/195803460 >> 172.21.15.154:0/195803460 conn(0x7f62100a2980 msgr2=0x7f62101b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.135+0000 7f6217488700 1 -- 172.21.15.154:0/195803460 shutdown_connections 2023-09-30T22:27:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.135+0000 7f6217488700 1 -- 172.21.15.154:0/195803460 wait complete. 2023-09-30T22:27:17.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:17.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.192+0000 7f243fa2f700 1 -- 172.21.15.154:0/3657526775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f243804f2a0 con 0x7f24381300a0 2023-09-30T22:27:17.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.193+0000 7f242dffb700 1 -- 172.21.15.154:0/3657526775 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2434036090 con 0x7f24381300a0 2023-09-30T22:27:17.194 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:17.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.195+0000 7f243fa2f700 1 -- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24381300a0 msgr2=0x7f24381c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.195+0000 7f243fa2f700 1 --2- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24381300a0 0x7f24381c8750 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f2434009fd0 tx=0x7f2434004750 comp rx=0 tx=0).stop 2023-09-30T22:27:17.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.195+0000 7f243fa2f700 1 -- 172.21.15.154:0/3657526775 shutdown_connections 2023-09-30T22:27:17.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.195+0000 7f243fa2f700 1 --2- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2438133ad0 0x7f24381c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.195+0000 7f243fa2f700 1 --2- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24381300a0 0x7f24381c8750 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.195+0000 7f243fa2f700 1 --2- 172.21.15.154:0/3657526775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24381309f0 0x7f24381c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.195+0000 7f243fa2f700 1 -- 172.21.15.154:0/3657526775 >> 172.21.15.154:0/3657526775 conn(0x7f2438099c40 msgr2=0x7f24381320b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.195+0000 7f243fa2f700 1 -- 172.21.15.154:0/3657526775 shutdown_connections 2023-09-30T22:27:17.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.195+0000 7f243fa2f700 1 -- 172.21.15.154:0/3657526775 wait complete. 2023-09-30T22:27:17.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:17.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.245+0000 7fc461531700 1 -- 172.21.15.154:0/2438652563 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc45c04f2a0 con 0x7fc45c09edb0 2023-09-30T22:27:17.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.245+0000 7fc4437fe700 1 -- 172.21.15.154:0/2438652563 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc450017030 con 0x7fc45c09edb0 2023-09-30T22:27:17.246 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.247+0000 7fc461531700 1 -- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c09edb0 msgr2=0x7fc45c1c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.247+0000 7fc461531700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c09edb0 0x7fc45c1c9010 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc45000c4e0 tx=0x7fc45000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.247+0000 7fc461531700 1 -- 172.21.15.154:0/2438652563 shutdown_connections 2023-09-30T22:27:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.247+0000 7fc461531700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45c09f1a0 0x7fc45c1c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.247+0000 7fc461531700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45c09a150 0x7fc45c1c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.247+0000 7fc461531700 1 --2- 172.21.15.154:0/2438652563 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc45c09edb0 0x7fc45c1c9010 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.247+0000 7fc461531700 1 -- 172.21.15.154:0/2438652563 >> 172.21.15.154:0/2438652563 conn(0x7fc45c0a4430 msgr2=0x7fc45c0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.247+0000 7fc461531700 1 -- 172.21.15.154:0/2438652563 shutdown_connections 2023-09-30T22:27:17.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.247+0000 7fc461531700 1 -- 172.21.15.154:0/2438652563 wait complete. 2023-09-30T22:27:17.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:17.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:17.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.854+0000 7f01c2d55700 1 Processor -- start 2023-09-30T22:27:17.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c2d55700 1 -- start start 2023-09-30T22:27:17.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c2d55700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f01bc09e870 0x7f01bc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c2d55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09f180 0x7f01bc133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c2d55700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01bc09fa00 con 0x7f01bc134160 2023-09-30T22:27:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c2d55700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc0a0370 con 0x7f01bc09e870 2023-09-30T22:27:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c2d55700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc06bec0 con 0x7f01bc09f180 2023-09-30T22:27:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c0af1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f01bc09e870 0x7f01bc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01bbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09f180 0x7f01bc133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c0af1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f01bc09e870 0x7f01bc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39766/0 (socket says 172.21.15.154:39766) 2023-09-30T22:27:17.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c0af1700 1 -- 172.21.15.154:0/391168273 learned_addr learned my addr 172.21.15.154:0/391168273 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c0af1700 1 -- 172.21.15.154:0/391168273 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09f180 msgr2=0x7f01bc133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c0af1700 1 --2- 172.21.15.154:0/391168273 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09f180 0x7f01bc133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c0af1700 1 -- 172.21.15.154:0/391168273 >> v1:172.21.15.154:6789/0 conn(0x7f01bc134160 legacy=0x7f01bc13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01c0af1700 1 -- 172.21.15.154:0/391168273 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc09ada0 con 0x7f01bc09e870 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.855+0000 7f01bbfff700 1 --2- 172.21.15.154:0/391168273 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09f180 0x7f01bc133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01c0af1700 1 --2- 172.21.15.154:0/391168273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01bc09e870 0x7f01bc09ec40 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f01b00098f0 tx=0x7f01b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c946051602db194e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01bb7fe700 1 -- 172.21.15.154:0/391168273 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0011830 con 0x7f01bc09e870 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01bb7fe700 1 -- 172.21.15.154:0/391168273 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b0011990 con 0x7f01bc09e870 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01bb7fe700 1 -- 172.21.15.154:0/391168273 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0011d20 con 0x7f01bc09e870 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01c2d55700 1 -- 172.21.15.154:0/391168273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01bc09e870 msgr2=0x7f01bc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01c2d55700 1 --2- 172.21.15.154:0/391168273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01bc09e870 0x7f01bc09ec40 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f01b00098f0 tx=0x7f01b0009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01c2d55700 1 -- 172.21.15.154:0/391168273 shutdown_connections 2023-09-30T22:27:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01c2d55700 1 --2- 172.21.15.154:0/391168273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01bc09e870 0x7f01bc09ec40 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01c2d55700 1 --2- 172.21.15.154:0/391168273 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09f180 0x7f01bc133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01c2d55700 1 -- 172.21.15.154:0/391168273 >> 172.21.15.154:0/391168273 conn(0x7f01bc0a4430 msgr2=0x7f01bc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01c2d55700 1 -- 172.21.15.154:0/391168273 shutdown_connections 2023-09-30T22:27:17.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.856+0000 7f01c2d55700 1 -- 172.21.15.154:0/391168273 wait complete. 2023-09-30T22:27:17.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.858+0000 7f01c2d55700 1 Processor -- start 2023-09-30T22:27:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.858+0000 7f01c2d55700 1 -- start start 2023-09-30T22:27:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.858+0000 7f01c2d55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09e870 0x7f01bc11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.858+0000 7f01c2d55700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01bc09f180 0x7f01bc11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.858+0000 7f01c2d55700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01bc134160 0x7f01bc11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.858+0000 7f01c2d55700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc1223f0 con 0x7f01bc09f180 2023-09-30T22:27:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.858+0000 7f01c2d55700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc121af0 con 0x7f01bc134160 2023-09-30T22:27:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.858+0000 7f01c2d55700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc1204e0 con 0x7f01bc09e870 2023-09-30T22:27:17.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.858+0000 7f01c0af1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09e870 0x7f01bc11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c0af1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09e870 0x7f01bc11ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57010/0 (socket says 172.21.15.154:57010) 2023-09-30T22:27:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c0af1700 1 -- 172.21.15.154:0/278680090 learned_addr learned my addr 172.21.15.154:0/278680090 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c12f2700 1 --2- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01bc134160 0x7f01bc11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01bbfff700 1 --2- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01bc09f180 0x7f01bc11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c0af1700 1 -- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01bc134160 msgr2=0x7f01bc11f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c0af1700 1 --2- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01bc134160 0x7f01bc11f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c0af1700 1 -- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01bc09f180 msgr2=0x7f01bc11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c0af1700 1 --2- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01bc09f180 0x7f01bc11f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:17.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c0af1700 1 -- 172.21.15.154:0/278680090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80094a0 con 0x7f01bc09e870 2023-09-30T22:27:17.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c0af1700 1 --2- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09e870 0x7f01bc11ead0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f01b0000c00 tx=0x7f01b0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:17.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01b97fa700 1 -- 172.21.15.154:0/278680090 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0004400 con 0x7f01bc09e870 2023-09-30T22:27:17.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01b97fa700 1 -- 172.21.15.154:0/278680090 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b001f070 con 0x7f01bc09e870 2023-09-30T22:27:17.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c2d55700 1 -- 172.21.15.154:0/278680090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b0009550 con 0x7f01bc09e870 2023-09-30T22:27:17.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01b97fa700 1 -- 172.21.15.154:0/278680090 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b00038e0 con 0x7f01bc09e870 2023-09-30T22:27:17.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.859+0000 7f01c2d55700 1 -- 172.21.15.154:0/278680090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc06cfa0 con 0x7f01bc09e870 2023-09-30T22:27:17.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.860+0000 7f01b97fa700 1 -- 172.21.15.154:0/278680090 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01b0021030 con 0x7f01bc09e870 2023-09-30T22:27:17.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.860+0000 7f01b97fa700 1 -- 172.21.15.154:0/278680090 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f01b00408f0 con 0x7f01bc09e870 2023-09-30T22:27:17.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.860+0000 7f01c2d55700 1 -- 172.21.15.154:0/278680090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc04f2a0 con 0x7f01bc09e870 2023-09-30T22:27:17.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:17.865+0000 7f01b97fa700 1 -- 172.21.15.154:0/278680090 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01b0004560 con 0x7f01bc09e870 2023-09-30T22:27:18.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.049+0000 7f01c2d55700 1 -- 172.21.15.154:0/278680090 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f01bc06c9d0 con 0x7f01bc09e870 2023-09-30T22:27:18.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.049+0000 7f01b97fa700 1 -- 172.21.15.154:0/278680090 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01b001b430 con 0x7f01bc09e870 2023-09-30T22:27:18.050 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:18.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.051+0000 7f01c2d55700 1 -- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09e870 msgr2=0x7f01bc11ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.051+0000 7f01c2d55700 1 --2- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09e870 0x7f01bc11ead0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f01b0000c00 tx=0x7f01b0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:18.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.051+0000 7f01c2d55700 1 -- 172.21.15.154:0/278680090 shutdown_connections 2023-09-30T22:27:18.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.051+0000 7f01c2d55700 1 --2- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01bc134160 0x7f01bc11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.051+0000 7f01c2d55700 1 --2- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f01bc09e870 0x7f01bc11ead0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.051+0000 7f01c2d55700 1 --2- 172.21.15.154:0/278680090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01bc09f180 0x7f01bc11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.051+0000 7f01c2d55700 1 -- 172.21.15.154:0/278680090 >> 172.21.15.154:0/278680090 conn(0x7f01bc0a4430 msgr2=0x7f01bc0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.051+0000 7f01c2d55700 1 -- 172.21.15.154:0/278680090 shutdown_connections 2023-09-30T22:27:18.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.051+0000 7f01c2d55700 1 -- 172.21.15.154:0/278680090 wait complete. 2023-09-30T22:27:18.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:18.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:18.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:18.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.277+0000 7f153b1b2700 1 Processor -- start 2023-09-30T22:27:18.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.277+0000 7f153b1b2700 1 -- start start 2023-09-30T22:27:18.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153b1b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534133ad0 0x7f1534133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153b1b2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1534130bc0 0x7f153413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153b1b2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153406b2d0 con 0x7f15341300a0 2023-09-30T22:27:18.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153b1b2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1534133610 con 0x7f1534130bc0 2023-09-30T22:27:18.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153b1b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153409a500 con 0x7f1534133ad0 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153974f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1534130bc0 0x7f153413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153974f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1534130bc0 0x7f153413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39786/0 (socket says 172.21.15.154:39786) 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153974f700 1 -- 172.21.15.154:0/1477037229 learned_addr learned my addr 172.21.15.154:0/1477037229 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f1538f4e700 1 --2- 172.21.15.154:0/1477037229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534133ad0 0x7f1534133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153974f700 1 -- 172.21.15.154:0/1477037229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534133ad0 msgr2=0x7f1534133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153974f700 1 --2- 172.21.15.154:0/1477037229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534133ad0 0x7f1534133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153974f700 1 -- 172.21.15.154:0/1477037229 >> v1:172.21.15.154:6789/0 conn(0x7f15341300a0 legacy=0x7f15341304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.278+0000 7f153974f700 1 -- 172.21.15.154:0/1477037229 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15341338b0 con 0x7f1534130bc0 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f153974f700 1 --2- 172.21.15.154:0/1477037229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534130bc0 0x7f153413b990 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f152c009e50 tx=0x7f152c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86ebea61b956c11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f15337fe700 1 -- 172.21.15.154:0/1477037229 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c00e070 con 0x7f1534130bc0 2023-09-30T22:27:18.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f15337fe700 1 -- 172.21.15.154:0/1477037229 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c00b910 con 0x7f1534130bc0 2023-09-30T22:27:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f15337fe700 1 -- 172.21.15.154:0/1477037229 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c00bcc0 con 0x7f1534130bc0 2023-09-30T22:27:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f153b1b2700 1 -- 172.21.15.154:0/1477037229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534130bc0 msgr2=0x7f153413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f153b1b2700 1 --2- 172.21.15.154:0/1477037229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534130bc0 0x7f153413b990 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f152c009e50 tx=0x7f152c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f153b1b2700 1 -- 172.21.15.154:0/1477037229 shutdown_connections 2023-09-30T22:27:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f153b1b2700 1 --2- 172.21.15.154:0/1477037229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534130bc0 0x7f153413b990 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f153b1b2700 1 --2- 172.21.15.154:0/1477037229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534133ad0 0x7f1534133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f153b1b2700 1 -- 172.21.15.154:0/1477037229 >> 172.21.15.154:0/1477037229 conn(0x7f1534099c40 msgr2=0x7f15340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.279+0000 7f153b1b2700 1 -- 172.21.15.154:0/1477037229 shutdown_connections 2023-09-30T22:27:18.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.280+0000 7f153b1b2700 1 -- 172.21.15.154:0/1477037229 wait complete. 2023-09-30T22:27:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.281+0000 7f153b1b2700 1 Processor -- start 2023-09-30T22:27:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.281+0000 7f153b1b2700 1 -- start start 2023-09-30T22:27:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f153b1b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15341300a0 0x7f153411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f153b1b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534130bc0 0x7f153411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f153b1b2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534133ad0 0x7f153411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f153b1b2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15341201f0 con 0x7f1534133ad0 2023-09-30T22:27:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f153b1b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1534132720 con 0x7f1534130bc0 2023-09-30T22:27:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f153b1b2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f153412dd00 con 0x7f15341300a0 2023-09-30T22:27:18.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1538f4e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15341300a0 0x7f153411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1538f4e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15341300a0 0x7f153411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57016/0 (socket says 172.21.15.154:57016) 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1538f4e700 1 -- 172.21.15.154:0/3199181319 learned_addr learned my addr 172.21.15.154:0/3199181319 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1533fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534130bc0 0x7f153411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f153974f700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534133ad0 0x7f153411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1538f4e700 1 -- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534130bc0 msgr2=0x7f153411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1538f4e700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534130bc0 0x7f153411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1538f4e700 1 -- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534133ad0 msgr2=0x7f153411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1538f4e700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534133ad0 0x7f153411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1538f4e700 1 -- 172.21.15.154:0/3199181319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c009b30 con 0x7f15341300a0 2023-09-30T22:27:18.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1533fff700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534130bc0 0x7f153411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f153974f700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534133ad0 0x7f153411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f1538f4e700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15341300a0 0x7f153411da40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f152800e9b0 tx=0x7f152800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.282+0000 7f15317fa700 1 -- 172.21.15.154:0/3199181319 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528009710 con 0x7f15341300a0 2023-09-30T22:27:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.283+0000 7f15317fa700 1 -- 172.21.15.154:0/3199181319 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152800ee50 con 0x7f15341300a0 2023-09-30T22:27:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.283+0000 7f15317fa700 1 -- 172.21.15.154:0/3199181319 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152800ca50 con 0x7f15341300a0 2023-09-30T22:27:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.283+0000 7f153b1b2700 1 -- 172.21.15.154:0/3199181319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153411fbb0 con 0x7f15341300a0 2023-09-30T22:27:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.283+0000 7f153b1b2700 1 -- 172.21.15.154:0/3199181319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153411fe70 con 0x7f15341300a0 2023-09-30T22:27:18.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.284+0000 7f153b1b2700 1 -- 172.21.15.154:0/3199181319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153409cb20 con 0x7f15341300a0 2023-09-30T22:27:18.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.284+0000 7f15317fa700 1 -- 172.21.15.154:0/3199181319 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f152800cbb0 con 0x7f15341300a0 2023-09-30T22:27:18.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.285+0000 7f15317fa700 1 -- 172.21.15.154:0/3199181319 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f152803f720 con 0x7f15341300a0 2023-09-30T22:27:18.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.293+0000 7f15317fa700 1 -- 172.21.15.154:0/3199181319 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15280232f0 con 0x7f15341300a0 2023-09-30T22:27:18.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.340+0000 7ff56bbdf700 1 Processor -- start 2023-09-30T22:27:18.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56bbdf700 1 -- start start 2023-09-30T22:27:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56bbdf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409e950 0x7ff56409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56bbdf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff56409f260 0x7ff564137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56bbdf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56409ac20 con 0x7ff5641381e0 2023-09-30T22:27:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56bbdf700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640a06c0 con 0x7ff56409f260 2023-09-30T22:27:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56bbdf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff56409ae90 con 0x7ff56409e950 2023-09-30T22:27:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56917a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff56409f260 0x7ff564137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56917a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff56409f260 0x7ff564137ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39798/0 (socket says 172.21.15.154:39798) 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56917a700 1 -- 172.21.15.154:0/2222182098 learned_addr learned my addr 172.21.15.154:0/2222182098 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56997b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409e950 0x7ff56409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.341+0000 7ff56a17c700 1 --1- 172.21.15.154:0/2222182098 >> v1:172.21.15.154:6789/0 conn(0x7ff5641381e0 0x7ff56413a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43072/0 (socket says 172.21.15.154:43072) 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff56997b700 1 -- 172.21.15.154:0/2222182098 >> v2:172.21.15.154:3300/0 conn(0x7ff56409f260 msgr2=0x7ff564137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff56997b700 1 --2- 172.21.15.154:0/2222182098 >> v2:172.21.15.154:3300/0 conn(0x7ff56409f260 0x7ff564137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff56997b700 1 -- 172.21.15.154:0/2222182098 >> v1:172.21.15.154:6789/0 conn(0x7ff5641381e0 legacy=0x7ff56413a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff568979700 1 -- 172.21.15.154:0/2222182098 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333429313 0 0) 0x7ff56409ac20 con 0x7ff5641381e0 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff56997b700 1 -- 172.21.15.154:0/2222182098 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56406ba00 con 0x7ff56409e950 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff56917a700 1 --2- 172.21.15.154:0/2222182098 >> v2:172.21.15.154:3300/0 conn(0x7ff56409f260 0x7ff564137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff56997b700 1 --2- 172.21.15.154:0/2222182098 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409e950 0x7ff56409ed20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff560009820 tx=0x7ff560009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eec0d0f0aeab3e0e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff568979700 1 -- 172.21.15.154:0/2222182098 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560005e30 con 0x7ff56409e950 2023-09-30T22:27:18.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff568979700 1 -- 172.21.15.154:0/2222182098 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff560006030 con 0x7ff56409e950 2023-09-30T22:27:18.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.342+0000 7ff568979700 1 -- 172.21.15.154:0/2222182098 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600063c0 con 0x7ff56409e950 2023-09-30T22:27:18.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.343+0000 7ff56bbdf700 1 -- 172.21.15.154:0/2222182098 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409e950 msgr2=0x7ff56409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.343+0000 7ff56bbdf700 1 --2- 172.21.15.154:0/2222182098 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409e950 0x7ff56409ed20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff560009820 tx=0x7ff560009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:18.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.343+0000 7ff56bbdf700 1 -- 172.21.15.154:0/2222182098 shutdown_connections 2023-09-30T22:27:18.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.343+0000 7ff56bbdf700 1 --2- 172.21.15.154:0/2222182098 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409e950 0x7ff56409ed20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.343+0000 7ff56bbdf700 1 --2- 172.21.15.154:0/2222182098 >> v2:172.21.15.154:3300/0 conn(0x7ff56409f260 0x7ff564137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.343+0000 7ff56bbdf700 1 -- 172.21.15.154:0/2222182098 >> 172.21.15.154:0/2222182098 conn(0x7ff5640a0f70 msgr2=0x7ff5640a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.343+0000 7ff56bbdf700 1 -- 172.21.15.154:0/2222182098 shutdown_connections 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.343+0000 7ff56bbdf700 1 -- 172.21.15.154:0/2222182098 wait complete. 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56bbdf700 1 Processor -- start 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56bbdf700 1 -- start start 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56bbdf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff56409e950 0x7ff564122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56bbdf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409f260 0x7ff564122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56bbdf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5641381e0 0x7ff564123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56bbdf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5641378a0 con 0x7ff56409e950 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56bbdf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56409e100 con 0x7ff5641381e0 2023-09-30T22:27:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56bbdf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff564126430 con 0x7ff56409f260 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56917a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409f260 0x7ff564122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56997b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff56409e950 0x7ff564122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.344+0000 7ff56917a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409f260 0x7ff564122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57032/0 (socket says 172.21.15.154:57032) 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56917a700 1 -- 172.21.15.154:0/1768810037 learned_addr learned my addr 172.21.15.154:0/1768810037 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56a17c700 1 --2- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5641381e0 0x7ff564123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56997b700 1 -- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409f260 msgr2=0x7ff564122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56997b700 1 --2- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409f260 0x7ff564122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56997b700 1 -- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5641381e0 msgr2=0x7ff564123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56997b700 1 --2- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5641381e0 0x7ff564123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56997b700 1 -- 172.21.15.154:0/1768810037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554009550 con 0x7ff56409e950 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56997b700 1 --2- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff56409e950 0x7ff564122910 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff560015000 tx=0x7ff560004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff55a7fc700 1 -- 172.21.15.154:0/1768810037 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600038a0 con 0x7ff56409e950 2023-09-30T22:27:18.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff55a7fc700 1 -- 172.21.15.154:0/1768810037 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff560020070 con 0x7ff56409e950 2023-09-30T22:27:18.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56bbdf700 1 -- 172.21.15.154:0/1768810037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff560009430 con 0x7ff56409e950 2023-09-30T22:27:18.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff55a7fc700 1 -- 172.21.15.154:0/1768810037 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560003c80 con 0x7ff56409e950 2023-09-30T22:27:18.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.345+0000 7ff56bbdf700 1 -- 172.21.15.154:0/1768810037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5640a0820 con 0x7ff56409e950 2023-09-30T22:27:18.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.346+0000 7ff56bbdf700 1 -- 172.21.15.154:0/1768810037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56404f2a0 con 0x7ff56409e950 2023-09-30T22:27:18.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.346+0000 7ff55a7fc700 1 -- 172.21.15.154:0/1768810037 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff560022030 con 0x7ff56409e950 2023-09-30T22:27:18.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.346+0000 7ff55a7fc700 1 -- 172.21.15.154:0/1768810037 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff560040940 con 0x7ff56409e950 2023-09-30T22:27:18.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.351+0000 7ff55a7fc700 1 -- 172.21.15.154:0/1768810037 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5600193b0 con 0x7ff56409e950 2023-09-30T22:27:18.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.388+0000 7ff123ff2700 1 Processor -- start 2023-09-30T22:27:18.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.388+0000 7ff123ff2700 1 -- start start 2023-09-30T22:27:18.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff123ff2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff11c09e870 0x7ff11c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff123ff2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c09f180 0x7ff11c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff123ff2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c06bec0 con 0x7ff11c1341d0 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff123ff2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11c06ce60 con 0x7ff11c09e870 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff123ff2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c09fa00 con 0x7ff11c09f180 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff12158d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c09f180 0x7ff11c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff121d8e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff11c09e870 0x7ff11c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff12158d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c09f180 0x7ff11c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57040/0 (socket says 172.21.15.154:57040) 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff121d8e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff11c09e870 0x7ff11c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39830/0 (socket says 172.21.15.154:39830) 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff12158d700 1 -- 172.21.15.154:0/3342690838 learned_addr learned my addr 172.21.15.154:0/3342690838 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff121d8e700 1 -- 172.21.15.154:0/3342690838 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c09f180 msgr2=0x7ff11c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:18.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff121d8e700 1 --2- 172.21.15.154:0/3342690838 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c09f180 0x7ff11c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff121d8e700 1 -- 172.21.15.154:0/3342690838 >> v1:172.21.15.154:6789/0 conn(0x7ff11c1341d0 legacy=0x7ff11c13af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff121d8e700 1 -- 172.21.15.154:0/3342690838 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c09ad80 con 0x7ff11c09e870 2023-09-30T22:27:18.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.389+0000 7ff12158d700 1 --2- 172.21.15.154:0/3342690838 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c09f180 0x7ff11c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:18.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.390+0000 7ff121d8e700 1 --2- 172.21.15.154:0/3342690838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11c09e870 0x7ff11c09ec40 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff118009840 tx=0x7ff118009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676de1dea059d827 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.390+0000 7ff120d8c700 1 -- 172.21.15.154:0/3342690838 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118011830 con 0x7ff11c09e870 2023-09-30T22:27:18.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.390+0000 7ff120d8c700 1 -- 172.21.15.154:0/3342690838 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff118011990 con 0x7ff11c09e870 2023-09-30T22:27:18.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.390+0000 7ff120d8c700 1 -- 172.21.15.154:0/3342690838 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118011d20 con 0x7ff11c09e870 2023-09-30T22:27:18.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.391+0000 7ff123ff2700 1 -- 172.21.15.154:0/3342690838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11c09e870 msgr2=0x7ff11c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.391+0000 7ff123ff2700 1 --2- 172.21.15.154:0/3342690838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11c09e870 0x7ff11c09ec40 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff118009840 tx=0x7ff118009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.391+0000 7ff123ff2700 1 -- 172.21.15.154:0/3342690838 shutdown_connections 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.391+0000 7ff123ff2700 1 --2- 172.21.15.154:0/3342690838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11c09e870 0x7ff11c09ec40 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.391+0000 7ff123ff2700 1 --2- 172.21.15.154:0/3342690838 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c09f180 0x7ff11c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.391+0000 7ff123ff2700 1 -- 172.21.15.154:0/3342690838 >> 172.21.15.154:0/3342690838 conn(0x7ff11c0a4430 msgr2=0x7ff11c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.391+0000 7ff123ff2700 1 -- 172.21.15.154:0/3342690838 shutdown_connections 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.391+0000 7ff123ff2700 1 -- 172.21.15.154:0/3342690838 wait complete. 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.392+0000 7ff123ff2700 1 Processor -- start 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.392+0000 7ff123ff2700 1 -- start start 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff123ff2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11c09e870 0x7ff11c11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff123ff2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11c09f180 0x7ff11c11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff123ff2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c1341d0 0x7ff11c11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff123ff2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c06fd30 con 0x7ff11c09f180 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff123ff2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c1332d0 con 0x7ff11c09e870 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff123ff2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c06cfa0 con 0x7ff11c1341d0 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff121d8e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11c09e870 0x7ff11c11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff121d8e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11c09e870 0x7ff11c11ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58718/0 (socket says 172.21.15.154:58718) 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff121d8e700 1 -- 172.21.15.154:0/764801323 learned_addr learned my addr 172.21.15.154:0/764801323 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff12158d700 1 --2- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11c09f180 0x7ff11c11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff12258f700 1 --2- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c1341d0 0x7ff11c11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff121d8e700 1 -- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c1341d0 msgr2=0x7ff11c11f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff121d8e700 1 --2- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c1341d0 0x7ff11c11f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff121d8e700 1 -- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11c09f180 msgr2=0x7ff11c11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff121d8e700 1 --2- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11c09f180 0x7ff11c11f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff121d8e700 1 -- 172.21.15.154:0/764801323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c009550 con 0x7ff11c09e870 2023-09-30T22:27:18.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff121d8e700 1 --2- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11c09e870 0x7ff11c11ead0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff118009fd0 tx=0x7ff118004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:18.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff1127fc700 1 -- 172.21.15.154:0/764801323 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180036a0 con 0x7ff11c09e870 2023-09-30T22:27:18.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff1127fc700 1 -- 172.21.15.154:0/764801323 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11801f070 con 0x7ff11c09e870 2023-09-30T22:27:18.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff123ff2700 1 -- 172.21.15.154:0/764801323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1180094a0 con 0x7ff11c09e870 2023-09-30T22:27:18.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.393+0000 7ff1127fc700 1 -- 172.21.15.154:0/764801323 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118003a40 con 0x7ff11c09e870 2023-09-30T22:27:18.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.394+0000 7ff123ff2700 1 -- 172.21.15.154:0/764801323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c120660 con 0x7ff11c09e870 2023-09-30T22:27:18.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.394+0000 7ff123ff2700 1 -- 172.21.15.154:0/764801323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11c1220e0 con 0x7ff11c09e870 2023-09-30T22:27:18.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.395+0000 7ff1127fc700 1 -- 172.21.15.154:0/764801323 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff118003ba0 con 0x7ff11c09e870 2023-09-30T22:27:18.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.395+0000 7ff1127fc700 1 -- 172.21.15.154:0/764801323 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff118021070 con 0x7ff11c09e870 2023-09-30T22:27:18.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.399+0000 7ff1127fc700 1 -- 172.21.15.154:0/764801323 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1180253e0 con 0x7ff11c09e870 2023-09-30T22:27:18.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.520+0000 7f153b1b2700 1 -- 172.21.15.154:0/3199181319 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f153404f2a0 con 0x7f15341300a0 2023-09-30T22:27:18.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.520+0000 7f15317fa700 1 -- 172.21.15.154:0/3199181319 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1528017070 con 0x7f15341300a0 2023-09-30T22:27:18.521 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.522+0000 7f153b1b2700 1 -- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15341300a0 msgr2=0x7f153411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.522+0000 7f153b1b2700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15341300a0 0x7f153411da40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f152800e9b0 tx=0x7f152800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.522+0000 7f153b1b2700 1 -- 172.21.15.154:0/3199181319 shutdown_connections 2023-09-30T22:27:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.522+0000 7f153b1b2700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1534133ad0 0x7f153411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.522+0000 7f153b1b2700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15341300a0 0x7f153411da40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.522+0000 7f153b1b2700 1 --2- 172.21.15.154:0/3199181319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1534130bc0 0x7f153411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.522+0000 7f153b1b2700 1 -- 172.21.15.154:0/3199181319 >> 172.21.15.154:0/3199181319 conn(0x7f1534099c40 msgr2=0x7f15340a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.522+0000 7f153b1b2700 1 -- 172.21.15.154:0/3199181319 shutdown_connections 2023-09-30T22:27:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.523+0000 7f153b1b2700 1 -- 172.21.15.154:0/3199181319 wait complete. 2023-09-30T22:27:18.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:18.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.545+0000 7ff56bbdf700 1 -- 172.21.15.154:0/1768810037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff56406bbe0 con 0x7ff56409e950 2023-09-30T22:27:18.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.546+0000 7ff55a7fc700 1 -- 172.21.15.154:0/1768810037 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff56002a020 con 0x7ff56409e950 2023-09-30T22:27:18.546 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:18.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.547+0000 7ff56bbdf700 1 -- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff56409e950 msgr2=0x7ff564122910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.547+0000 7ff56bbdf700 1 --2- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff56409e950 0x7ff564122910 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff560015000 tx=0x7ff560004750 comp rx=0 tx=0).stop 2023-09-30T22:27:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.548+0000 7ff56bbdf700 1 -- 172.21.15.154:0/1768810037 shutdown_connections 2023-09-30T22:27:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.548+0000 7ff56bbdf700 1 --2- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5641381e0 0x7ff564123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.548+0000 7ff56bbdf700 1 --2- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff56409e950 0x7ff564122910 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.548+0000 7ff56bbdf700 1 --2- 172.21.15.154:0/1768810037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff56409f260 0x7ff564122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.548+0000 7ff56bbdf700 1 -- 172.21.15.154:0/1768810037 >> 172.21.15.154:0/1768810037 conn(0x7ff5640a0f70 msgr2=0x7ff5640a3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.548+0000 7ff56bbdf700 1 -- 172.21.15.154:0/1768810037 shutdown_connections 2023-09-30T22:27:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.548+0000 7ff56bbdf700 1 -- 172.21.15.154:0/1768810037 wait complete. 2023-09-30T22:27:18.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:18.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.621+0000 7ff123ff2700 1 -- 172.21.15.154:0/764801323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff11c04f2a0 con 0x7ff11c09e870 2023-09-30T22:27:18.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.621+0000 7ff1127fc700 1 -- 172.21.15.154:0/764801323 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff118015020 con 0x7ff11c09e870 2023-09-30T22:27:18.622 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.624+0000 7ff123ff2700 1 -- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11c09e870 msgr2=0x7ff11c11ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.624+0000 7ff123ff2700 1 --2- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11c09e870 0x7ff11c11ead0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff118009fd0 tx=0x7ff118004750 comp rx=0 tx=0).stop 2023-09-30T22:27:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.624+0000 7ff123ff2700 1 -- 172.21.15.154:0/764801323 shutdown_connections 2023-09-30T22:27:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.624+0000 7ff123ff2700 1 --2- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11c1341d0 0x7ff11c11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.624+0000 7ff123ff2700 1 --2- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11c09e870 0x7ff11c11ead0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.624+0000 7ff123ff2700 1 --2- 172.21.15.154:0/764801323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11c09f180 0x7ff11c11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.624+0000 7ff123ff2700 1 -- 172.21.15.154:0/764801323 >> 172.21.15.154:0/764801323 conn(0x7ff11c0a4430 msgr2=0x7ff11c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.624+0000 7ff123ff2700 1 -- 172.21.15.154:0/764801323 shutdown_connections 2023-09-30T22:27:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:18.624+0000 7ff123ff2700 1 -- 172.21.15.154:0/764801323 wait complete. 2023-09-30T22:27:18.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:19.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:19.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.191+0000 7fdee2711700 1 Processor -- start 2023-09-30T22:27:19.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.191+0000 7fdee2711700 1 -- start start 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee2711700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee2711700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee2711700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc09c970 con 0x7fdedc09e870 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee2711700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0a0920 con 0x7fdedc09f350 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee2711700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc09f9c0 con 0x7fdedc1371c0 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdedb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee0cae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdedbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdedc09e870 0x7fdedc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43094/0 (socket says 172.21.15.154:43094) 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdedbfff700 1 -- 172.21.15.154:0/1539518011 learned_addr learned my addr 172.21.15.154:0/1539518011 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdedaffd700 1 -- 172.21.15.154:0/1539518011 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101694434 0 0) 0x7fdedc09c970 con 0x7fdedc09e870 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdedaffd700 1 -- 172.21.15.154:0/1539518011 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec40035b0 con 0x7fdedc09e870 2023-09-30T22:27:19.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee0cae700 1 -- 172.21.15.154:0/1539518011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 msgr2=0x7fdedc136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee0cae700 1 --2- 172.21.15.154:0/1539518011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee0cae700 1 -- 172.21.15.154:0/1539518011 >> v1:172.21.15.154:6789/0 conn(0x7fdedc09e870 legacy=0x7fdedc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdee0cae700 1 -- 172.21.15.154:0/1539518011 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc09bab0 con 0x7fdedc1371c0 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.192+0000 7fdedb7fe700 1 --2- 172.21.15.154:0/1539518011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdee0cae700 1 --2- 172.21.15.154:0/1539518011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc1395a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fded400f3a0 tx=0x7fded400f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa3bc7006c209a75 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdedaffd700 1 -- 172.21.15.154:0/1539518011 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4012070 con 0x7fdedc1371c0 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdedaffd700 1 -- 172.21.15.154:0/1539518011 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded400d0d0 con 0x7fdedc1371c0 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdedaffd700 1 -- 172.21.15.154:0/1539518011 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400fea0 con 0x7fdedc1371c0 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdee2711700 1 -- 172.21.15.154:0/1539518011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 msgr2=0x7fdedc1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdee2711700 1 --2- 172.21.15.154:0/1539518011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc1395a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fded400f3a0 tx=0x7fded400f6b0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdee2711700 1 -- 172.21.15.154:0/1539518011 shutdown_connections 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdee2711700 1 --2- 172.21.15.154:0/1539518011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc1395a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdee2711700 1 --2- 172.21.15.154:0/1539518011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdee2711700 1 -- 172.21.15.154:0/1539518011 >> 172.21.15.154:0/1539518011 conn(0x7fdedc0a4430 msgr2=0x7fdedc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdee2711700 1 -- 172.21.15.154:0/1539518011 shutdown_connections 2023-09-30T22:27:19.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.193+0000 7fdee2711700 1 -- 172.21.15.154:0/1539518011 wait complete. 2023-09-30T22:27:19.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.194+0000 7fdee2711700 1 Processor -- start 2023-09-30T22:27:19.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.194+0000 7fdee2711700 1 -- start start 2023-09-30T22:27:19.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee2711700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdedc09e870 0x7fdedc11e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee2711700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc11e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee2711700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc11ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee2711700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc11f970 con 0x7fdedc09e870 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee2711700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc136950 con 0x7fdedc09f350 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee2711700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc121fc0 con 0x7fdedc1371c0 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdedb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc11e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdedbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdedc09e870 0x7fdedc11e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdedb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc11e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58738/0 (socket says 172.21.15.154:58738) 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdedbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdedc09e870 0x7fdedc11e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39842/0 (socket says 172.21.15.154:39842) 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdedb7fe700 1 -- 172.21.15.154:0/3086952887 learned_addr learned my addr 172.21.15.154:0/3086952887 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee0cae700 1 --2- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc11ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee0cae700 1 -- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 msgr2=0x7fdedc11e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee0cae700 1 --2- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc11e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee0cae700 1 -- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdedc09e870 msgr2=0x7fdedc11e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee0cae700 1 --2- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdedc09e870 0x7fdedc11e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee0cae700 1 -- 172.21.15.154:0/3086952887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00094a0 con 0x7fdedc1371c0 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdedb7fe700 1 --2- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc11e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.195+0000 7fdee0cae700 1 --2- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc11ef20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fded4019000 tx=0x7fded4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.196+0000 7fded8ff9700 1 -- 172.21.15.154:0/3086952887 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400fea0 con 0x7fdedc1371c0 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.196+0000 7fded8ff9700 1 -- 172.21.15.154:0/3086952887 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded400bbb0 con 0x7fdedc1371c0 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.196+0000 7fdee2711700 1 -- 172.21.15.154:0/3086952887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded400f050 con 0x7fdedc1371c0 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.196+0000 7fded8ff9700 1 -- 172.21.15.154:0/3086952887 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4004040 con 0x7fdedc1371c0 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.196+0000 7fdee2711700 1 -- 172.21.15.154:0/3086952887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc121750 con 0x7fdedc1371c0 2023-09-30T22:27:19.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.196+0000 7fded8ff9700 1 -- 172.21.15.154:0/3086952887 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fded40041a0 con 0x7fdedc1371c0 2023-09-30T22:27:19.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.196+0000 7fded8ff9700 1 -- 172.21.15.154:0/3086952887 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fded40454c0 con 0x7fdedc1371c0 2023-09-30T22:27:19.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.197+0000 7fdee2711700 1 -- 172.21.15.154:0/3086952887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc04f2a0 con 0x7fdedc1371c0 2023-09-30T22:27:19.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.201+0000 7fded8ff9700 1 -- 172.21.15.154:0/3086952887 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fded4004450 con 0x7fdedc1371c0 2023-09-30T22:27:19.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.386+0000 7fdee2711700 1 -- 172.21.15.154:0/3086952887 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdedc09dba0 con 0x7fdedc1371c0 2023-09-30T22:27:19.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.386+0000 7fded8ff9700 1 -- 172.21.15.154:0/3086952887 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fded40163f0 con 0x7fdedc1371c0 2023-09-30T22:27:19.387 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.388+0000 7fdee2711700 1 -- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 msgr2=0x7fdedc11ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.388+0000 7fdee2711700 1 --2- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc11ef20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fded4019000 tx=0x7fded4004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.388+0000 7fdee2711700 1 -- 172.21.15.154:0/3086952887 shutdown_connections 2023-09-30T22:27:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.388+0000 7fdee2711700 1 --2- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdedc1371c0 0x7fdedc11ef20 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.388+0000 7fdee2711700 1 --2- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdedc09e870 0x7fdedc11e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.388+0000 7fdee2711700 1 --2- 172.21.15.154:0/3086952887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdedc09f350 0x7fdedc11e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.388+0000 7fdee2711700 1 -- 172.21.15.154:0/3086952887 >> 172.21.15.154:0/3086952887 conn(0x7fdedc0a4430 msgr2=0x7fdedc09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.388+0000 7fdee2711700 1 -- 172.21.15.154:0/3086952887 shutdown_connections 2023-09-30T22:27:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.388+0000 7fdee2711700 1 -- 172.21.15.154:0/3086952887 wait complete. 2023-09-30T22:27:19.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:19.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:19.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:19.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:19.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.666+0000 7efd0b33b700 1 Processor -- start 2023-09-30T22:27:19.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.666+0000 7efd0b33b700 1 -- start start 2023-09-30T22:27:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd0b33b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd0406a770 0x7efd0406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd0b33b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd04136cb0 0x7efd04139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd0b33b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0406e900 con 0x7efd0409dec0 2023-09-30T22:27:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd0b33b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0409d180 con 0x7efd0406a770 2023-09-30T22:27:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd0b33b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0409e780 con 0x7efd04136cb0 2023-09-30T22:27:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd090d7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd0406a770 0x7efd0406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd098d8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd04136cb0 0x7efd04139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd090d7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd0406a770 0x7efd0406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39848/0 (socket says 172.21.15.154:39848) 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd090d7700 1 -- 172.21.15.154:0/3692614930 learned_addr learned my addr 172.21.15.154:0/3692614930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd098d8700 1 -- 172.21.15.154:0/3692614930 >> v2:172.21.15.154:3300/0 conn(0x7efd0406a770 msgr2=0x7efd0406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd098d8700 1 --2- 172.21.15.154:0/3692614930 >> v2:172.21.15.154:3300/0 conn(0x7efd0406a770 0x7efd0406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd098d8700 1 -- 172.21.15.154:0/3692614930 >> v1:172.21.15.154:6789/0 conn(0x7efd0409dec0 legacy=0x7efd0406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd098d8700 1 -- 172.21.15.154:0/3692614930 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0409d3c0 con 0x7efd04136cb0 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd090d7700 1 --2- 172.21.15.154:0/3692614930 >> v2:172.21.15.154:3300/0 conn(0x7efd0406a770 0x7efd0406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.667+0000 7efd098d8700 1 --2- 172.21.15.154:0/3692614930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd04136cb0 0x7efd04139090 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009d90 tx=0x7efcfc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7197d27486962ff0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.668+0000 7efcfbfff700 1 -- 172.21.15.154:0/3692614930 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc00e070 con 0x7efd04136cb0 2023-09-30T22:27:19.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.668+0000 7efcfbfff700 1 -- 172.21.15.154:0/3692614930 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc00bb20 con 0x7efd04136cb0 2023-09-30T22:27:19.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.668+0000 7efcfbfff700 1 -- 172.21.15.154:0/3692614930 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc012430 con 0x7efd04136cb0 2023-09-30T22:27:19.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.668+0000 7efd0b33b700 1 -- 172.21.15.154:0/3692614930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd04136cb0 msgr2=0x7efd04139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.668+0000 7efd0b33b700 1 --2- 172.21.15.154:0/3692614930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd04136cb0 0x7efd04139090 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009d90 tx=0x7efcfc00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:19.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.669+0000 7efd0b33b700 1 -- 172.21.15.154:0/3692614930 shutdown_connections 2023-09-30T22:27:19.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.669+0000 7efd0b33b700 1 --2- 172.21.15.154:0/3692614930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd04136cb0 0x7efd04139090 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.669+0000 7efd0b33b700 1 --2- 172.21.15.154:0/3692614930 >> v2:172.21.15.154:3300/0 conn(0x7efd0406a770 0x7efd0406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.669+0000 7efd0b33b700 1 -- 172.21.15.154:0/3692614930 >> 172.21.15.154:0/3692614930 conn(0x7efd04099c40 msgr2=0x7efd040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.669+0000 7efd0b33b700 1 -- 172.21.15.154:0/3692614930 shutdown_connections 2023-09-30T22:27:19.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.669+0000 7efd0b33b700 1 -- 172.21.15.154:0/3692614930 wait complete. 2023-09-30T22:27:19.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd0b33b700 1 Processor -- start 2023-09-30T22:27:19.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd0b33b700 1 -- start start 2023-09-30T22:27:19.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd0b33b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd0406a770 0x7efd041344c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd0b33b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd0409dec0 0x7efd04134a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd0b33b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd04136cb0 0x7efd04134f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd0b33b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd04119c90 con 0x7efd04136cb0 2023-09-30T22:27:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd0b33b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd04071ce0 con 0x7efd0409dec0 2023-09-30T22:27:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd0b33b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd041392f0 con 0x7efd0406a770 2023-09-30T22:27:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd088d6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd0409dec0 0x7efd04134a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd088d6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd0409dec0 0x7efd04134a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58768/0 (socket says 172.21.15.154:58768) 2023-09-30T22:27:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd088d6700 1 -- 172.21.15.154:0/3560579648 learned_addr learned my addr 172.21.15.154:0/3560579648 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd090d7700 1 --2- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd0406a770 0x7efd041344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.670+0000 7efd098d8700 1 --2- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd04136cb0 0x7efd04134f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efd090d7700 1 -- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd0409dec0 msgr2=0x7efd04134a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efd090d7700 1 --2- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd0409dec0 0x7efd04134a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efd090d7700 1 -- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd04136cb0 msgr2=0x7efd04134f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efd090d7700 1 --2- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd04136cb0 0x7efd04134f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efd090d7700 1 -- 172.21.15.154:0/3560579648 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd00009550 con 0x7efd0406a770 2023-09-30T22:27:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efd090d7700 1 --2- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd0406a770 0x7efd041344c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e9a0 tx=0x7efd0000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efcf9ffb700 1 -- 172.21.15.154:0/3560579648 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00013980 con 0x7efd0406a770 2023-09-30T22:27:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efcf9ffb700 1 -- 172.21.15.154:0/3560579648 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd00013ae0 con 0x7efd0406a770 2023-09-30T22:27:19.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efcf9ffb700 1 -- 172.21.15.154:0/3560579648 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00013e50 con 0x7efd0406a770 2023-09-30T22:27:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efd0b33b700 1 -- 172.21.15.154:0/3560579648 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc009a70 con 0x7efd0406a770 2023-09-30T22:27:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.671+0000 7efd0b33b700 1 -- 172.21.15.154:0/3560579648 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0411a9c0 con 0x7efd0406a770 2023-09-30T22:27:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.672+0000 7efcf9ffb700 1 -- 172.21.15.154:0/3560579648 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd0001b440 con 0x7efd0406a770 2023-09-30T22:27:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.672+0000 7efcf9ffb700 1 -- 172.21.15.154:0/3560579648 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd00043690 con 0x7efd0406a770 2023-09-30T22:27:19.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.672+0000 7efd0b33b700 1 -- 172.21.15.154:0/3560579648 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0404f2a0 con 0x7efd0406a770 2023-09-30T22:27:19.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.677+0000 7efcf9ffb700 1 -- 172.21.15.154:0/3560579648 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd000243b0 con 0x7efd0406a770 2023-09-30T22:27:19.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.709+0000 7f5abe196700 1 Processor -- start 2023-09-30T22:27:19.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.709+0000 7f5abe196700 1 -- start start 2023-09-30T22:27:19.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5abe196700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ab809f350 0x7f5ab8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5abe196700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5abe196700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab809c970 con 0x7f5ab809e870 2023-09-30T22:27:19.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5abe196700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab80a0920 con 0x7f5ab809f350 2023-09-30T22:27:19.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5abe196700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab809f9c0 con 0x7f5ab81371c0 2023-09-30T22:27:19.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5ab7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5ab6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ab809f350 0x7f5ab8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5ab7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57090/0 (socket says 172.21.15.154:57090) 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5ab7fff700 1 -- 172.21.15.154:0/1301286242 learned_addr learned my addr 172.21.15.154:0/1301286242 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5ab7fff700 1 -- 172.21.15.154:0/1301286242 >> v2:172.21.15.154:3300/0 conn(0x7f5ab809f350 msgr2=0x7f5ab8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5ab7fff700 1 --2- 172.21.15.154:0/1301286242 >> v2:172.21.15.154:3300/0 conn(0x7f5ab809f350 0x7f5ab8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5ab7fff700 1 -- 172.21.15.154:0/1301286242 >> v1:172.21.15.154:6789/0 conn(0x7f5ab809e870 legacy=0x7f5ab809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.710+0000 7f5ab7fff700 1 -- 172.21.15.154:0/1301286242 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab809bab0 con 0x7f5ab81371c0 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5ab7fff700 1 --2- 172.21.15.154:0/1301286242 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81395a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009e50 tx=0x7f5aa800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=671ef6d12741fd6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5ab67fc700 1 -- 172.21.15.154:0/1301286242 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa800e070 con 0x7f5ab81371c0 2023-09-30T22:27:19.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5ab67fc700 1 -- 172.21.15.154:0/1301286242 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa800b910 con 0x7f5ab81371c0 2023-09-30T22:27:19.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5ab67fc700 1 -- 172.21.15.154:0/1301286242 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa800bcc0 con 0x7f5ab81371c0 2023-09-30T22:27:19.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5abe196700 1 -- 172.21.15.154:0/1301286242 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 msgr2=0x7f5ab81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5abe196700 1 --2- 172.21.15.154:0/1301286242 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81395a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009e50 tx=0x7f5aa800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5abe196700 1 -- 172.21.15.154:0/1301286242 shutdown_connections 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5abe196700 1 --2- 172.21.15.154:0/1301286242 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81395a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5abe196700 1 --2- 172.21.15.154:0/1301286242 >> v2:172.21.15.154:3300/0 conn(0x7f5ab809f350 0x7f5ab8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.711+0000 7f5abe196700 1 -- 172.21.15.154:0/1301286242 >> 172.21.15.154:0/1301286242 conn(0x7f5ab80a4430 msgr2=0x7f5ab80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.712+0000 7f5abe196700 1 -- 172.21.15.154:0/1301286242 shutdown_connections 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.712+0000 7f5abe196700 1 -- 172.21.15.154:0/1301286242 wait complete. 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.712+0000 7f5abe196700 1 Processor -- start 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5abe196700 1 -- start start 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5abe196700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab809e870 0x7f5ab811f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5abe196700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab809f350 0x7f5ab811fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5abe196700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5abe196700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8121230 con 0x7f5ab809f350 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5abe196700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8135510 con 0x7f5ab809e870 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5abe196700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8122e60 con 0x7f5ab81371c0 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5ab7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5ab6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab809f350 0x7f5ab811fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5ab6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab809f350 0x7f5ab811fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39858/0 (socket says 172.21.15.154:39858) 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5ab6ffd700 1 -- 172.21.15.154:0/3957201275 learned_addr learned my addr 172.21.15.154:0/3957201275 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5ab7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57092/0 (socket says 172.21.15.154:57092) 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.713+0000 7f5ab77fe700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab809e870 0x7f5ab811f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5ab6ffd700 1 -- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 msgr2=0x7f5ab81200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5ab6ffd700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5ab6ffd700 1 -- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab809e870 msgr2=0x7f5ab811f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5ab6ffd700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab809e870 0x7f5ab811f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5ab6ffd700 1 -- 172.21.15.154:0/3957201275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa8009b30 con 0x7f5ab809f350 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5ab7fff700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5ab77fe700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab809e870 0x7f5ab811f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5ab6ffd700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab809f350 0x7f5ab811fb60 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000e9b0 tx=0x7f5aa000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5aaffff700 1 -- 172.21.15.154:0/3957201275 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0009710 con 0x7f5ab809f350 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5aaffff700 1 -- 172.21.15.154:0/3957201275 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa000ee50 con 0x7f5ab809f350 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5aaffff700 1 -- 172.21.15.154:0/3957201275 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000ca50 con 0x7f5ab809f350 2023-09-30T22:27:19.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5abe196700 1 -- 172.21.15.154:0/3957201275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab81228d0 con 0x7f5ab809f350 2023-09-30T22:27:19.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.714+0000 7f5abe196700 1 -- 172.21.15.154:0/3957201275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab80723f0 con 0x7f5ab809f350 2023-09-30T22:27:19.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.715+0000 7f5abe196700 1 -- 172.21.15.154:0/3957201275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab809dba0 con 0x7f5ab809f350 2023-09-30T22:27:19.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.715+0000 7f5aaffff700 1 -- 172.21.15.154:0/3957201275 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5aa000cbb0 con 0x7f5ab809f350 2023-09-30T22:27:19.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.715+0000 7f5aaffff700 1 -- 172.21.15.154:0/3957201275 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5aa003fa60 con 0x7f5ab809f350 2023-09-30T22:27:19.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.720+0000 7f5aaffff700 1 -- 172.21.15.154:0/3957201275 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5aa001b3b0 con 0x7f5ab809f350 2023-09-30T22:27:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.768+0000 7efe1cfcf700 1 Processor -- start 2023-09-30T22:27:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.768+0000 7efe1cfcf700 1 -- start start 2023-09-30T22:27:19.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1cfcf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe18133ad0 0x7efe18133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1cfcf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe181300a0 0x7efe181304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1cfcf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 0x7efe1813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1cfcf700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1806b2d0 con 0x7efe181300a0 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1cfcf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe18133610 con 0x7efe181309f0 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1cfcf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe1809a500 con 0x7efe18133ad0 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe15d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe181300a0 0x7efe181304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe18133ad0 0x7efe18133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe15d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe181300a0 0x7efe181304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39868/0 (socket says 172.21.15.154:39868) 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe18133ad0 0x7efe18133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57108/0 (socket says 172.21.15.154:57108) 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe15d9b700 1 -- 172.21.15.154:0/1417389824 learned_addr learned my addr 172.21.15.154:0/1417389824 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:19.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe16d9d700 1 --2- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 0x7efe1813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe15d9b700 1 -- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe18133ad0 msgr2=0x7efe18133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe15d9b700 1 --2- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe18133ad0 0x7efe18133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe15d9b700 1 -- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 msgr2=0x7efe1813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe15d9b700 1 --2- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 0x7efe1813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe15d9b700 1 -- 172.21.15.154:0/1417389824 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe181338b0 con 0x7efe181300a0 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe15d9b700 1 --2- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe181300a0 0x7efe181304b0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0098f0 tx=0x7efe0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5029759264c67a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1559a700 1 -- 172.21.15.154:0/1417389824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00b8a0 con 0x7efe181300a0 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1559a700 1 -- 172.21.15.154:0/1417389824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c00ba00 con 0x7efe181300a0 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.769+0000 7efe1559a700 1 -- 172.21.15.154:0/1417389824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00bd90 con 0x7efe181300a0 2023-09-30T22:27:19.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.770+0000 7efe1cfcf700 1 -- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe181300a0 msgr2=0x7efe181304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.770+0000 7efe1cfcf700 1 --2- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe181300a0 0x7efe181304b0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0098f0 tx=0x7efe0c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:19.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.770+0000 7efe1cfcf700 1 -- 172.21.15.154:0/1417389824 shutdown_connections 2023-09-30T22:27:19.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.770+0000 7efe1cfcf700 1 --2- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 0x7efe1813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.770+0000 7efe1cfcf700 1 --2- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe18133ad0 0x7efe18133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.770+0000 7efe1cfcf700 1 --2- 172.21.15.154:0/1417389824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe181300a0 0x7efe181304b0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.770+0000 7efe1cfcf700 1 -- 172.21.15.154:0/1417389824 >> 172.21.15.154:0/1417389824 conn(0x7efe18099c40 msgr2=0x7efe180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.770+0000 7efe1cfcf700 1 -- 172.21.15.154:0/1417389824 shutdown_connections 2023-09-30T22:27:19.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.770+0000 7efe1cfcf700 1 -- 172.21.15.154:0/1417389824 wait complete. 2023-09-30T22:27:19.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.771+0000 7efe1cfcf700 1 Processor -- start 2023-09-30T22:27:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.771+0000 7efe1cfcf700 1 -- start start 2023-09-30T22:27:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1cfcf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe181300a0 0x7efe1811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1cfcf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 0x7efe1811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1cfcf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe18133ad0 0x7efe1811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1cfcf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1811fe00 con 0x7efe18133ad0 2023-09-30T22:27:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1cfcf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1811ffe0 con 0x7efe181309f0 2023-09-30T22:27:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1cfcf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe1811fa40 con 0x7efe181300a0 2023-09-30T22:27:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe181300a0 0x7efe1811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe181300a0 0x7efe1811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57114/0 (socket says 172.21.15.154:57114) 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1659c700 1 -- 172.21.15.154:0/2374793734 learned_addr learned my addr 172.21.15.154:0/2374793734 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe15d9b700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 0x7efe1811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe16d9d700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe18133ad0 0x7efe1811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1659c700 1 -- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 msgr2=0x7efe1811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1659c700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 0x7efe1811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1659c700 1 -- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe18133ad0 msgr2=0x7efe1811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1659c700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe18133ad0 0x7efe1811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1659c700 1 -- 172.21.15.154:0/2374793734 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c009550 con 0x7efe181300a0 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe16d9d700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe18133ad0 0x7efe1811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:19.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe1659c700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe181300a0 0x7efe1811da40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efe0800e810 tx=0x7efe0800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.772+0000 7efe06ffd700 1 -- 172.21.15.154:0/2374793734 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0800c070 con 0x7efe181300a0 2023-09-30T22:27:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.773+0000 7efe06ffd700 1 -- 172.21.15.154:0/2374793734 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe08013610 con 0x7efe181300a0 2023-09-30T22:27:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.773+0000 7efe1cfcf700 1 -- 172.21.15.154:0/2374793734 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1812d890 con 0x7efe181300a0 2023-09-30T22:27:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.773+0000 7efe06ffd700 1 -- 172.21.15.154:0/2374793734 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080139a0 con 0x7efe181300a0 2023-09-30T22:27:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.773+0000 7efe1cfcf700 1 -- 172.21.15.154:0/2374793734 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1811f370 con 0x7efe181300a0 2023-09-30T22:27:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.773+0000 7efe06ffd700 1 -- 172.21.15.154:0/2374793734 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe08013b00 con 0x7efe181300a0 2023-09-30T22:27:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.774+0000 7efe06ffd700 1 -- 172.21.15.154:0/2374793734 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efe0803f340 con 0x7efe181300a0 2023-09-30T22:27:19.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.774+0000 7efe1cfcf700 1 -- 172.21.15.154:0/2374793734 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1812dd60 con 0x7efe181300a0 2023-09-30T22:27:19.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.783+0000 7efe06ffd700 1 -- 172.21.15.154:0/2374793734 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe08010900 con 0x7efe181300a0 2023-09-30T22:27:19.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.878+0000 7efd0b33b700 1 -- 172.21.15.154:0/3560579648 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd0411a5d0 con 0x7efd0406a770 2023-09-30T22:27:19.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.878+0000 7efcf9ffb700 1 -- 172.21.15.154:0/3560579648 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd00020020 con 0x7efd0406a770 2023-09-30T22:27:19.879 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.880+0000 7efd0b33b700 1 -- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd0406a770 msgr2=0x7efd041344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.880+0000 7efd0b33b700 1 --2- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd0406a770 0x7efd041344c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e9a0 tx=0x7efd0000ecb0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.880+0000 7efd0b33b700 1 -- 172.21.15.154:0/3560579648 shutdown_connections 2023-09-30T22:27:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.880+0000 7efd0b33b700 1 --2- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd04136cb0 0x7efd04134f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.880+0000 7efd0b33b700 1 --2- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efd0406a770 0x7efd041344c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.880+0000 7efd0b33b700 1 --2- 172.21.15.154:0/3560579648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd0409dec0 0x7efd04134a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.880+0000 7efd0b33b700 1 -- 172.21.15.154:0/3560579648 >> 172.21.15.154:0/3560579648 conn(0x7efd04099c40 msgr2=0x7efd0412f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.880+0000 7efd0b33b700 1 -- 172.21.15.154:0/3560579648 shutdown_connections 2023-09-30T22:27:19.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.880+0000 7efd0b33b700 1 -- 172.21.15.154:0/3560579648 wait complete. 2023-09-30T22:27:19.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.918+0000 7f5abe196700 1 -- 172.21.15.154:0/3957201275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5ab804f2a0 con 0x7f5ab809f350 2023-09-30T22:27:19.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.919+0000 7f5aaffff700 1 -- 172.21.15.154:0/3957201275 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5aa0021030 con 0x7f5ab809f350 2023-09-30T22:27:19.920 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.921+0000 7f5abe196700 1 -- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab809f350 msgr2=0x7f5ab811fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.921+0000 7f5abe196700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab809f350 0x7f5ab811fb60 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000e9b0 tx=0x7f5aa000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.921+0000 7f5abe196700 1 -- 172.21.15.154:0/3957201275 shutdown_connections 2023-09-30T22:27:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.921+0000 7f5abe196700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5ab81371c0 0x7f5ab81200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.921+0000 7f5abe196700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab809e870 0x7f5ab811f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.921+0000 7f5abe196700 1 --2- 172.21.15.154:0/3957201275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab809f350 0x7f5ab811fb60 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.921+0000 7f5abe196700 1 -- 172.21.15.154:0/3957201275 >> 172.21.15.154:0/3957201275 conn(0x7f5ab80a4430 msgr2=0x7f5ab80a2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.921+0000 7f5abe196700 1 -- 172.21.15.154:0/3957201275 shutdown_connections 2023-09-30T22:27:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.921+0000 7f5abe196700 1 -- 172.21.15.154:0/3957201275 wait complete. 2023-09-30T22:27:19.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:19.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.975+0000 7efe1cfcf700 1 -- 172.21.15.154:0/2374793734 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe1804f2a0 con 0x7efe181300a0 2023-09-30T22:27:19.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.975+0000 7efe06ffd700 1 -- 172.21.15.154:0/2374793734 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe0802b090 con 0x7efe181300a0 2023-09-30T22:27:19.976 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:19.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.977+0000 7efe1cfcf700 1 -- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe181300a0 msgr2=0x7efe1811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:19.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.977+0000 7efe1cfcf700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe181300a0 0x7efe1811da40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efe0800e810 tx=0x7efe0800eb20 comp rx=0 tx=0).stop 2023-09-30T22:27:19.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.977+0000 7efe1cfcf700 1 -- 172.21.15.154:0/2374793734 shutdown_connections 2023-09-30T22:27:19.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.977+0000 7efe1cfcf700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe18133ad0 0x7efe1811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.977+0000 7efe1cfcf700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe181300a0 0x7efe1811da40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.977+0000 7efe1cfcf700 1 --2- 172.21.15.154:0/2374793734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe181309f0 0x7efe1811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:19.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.977+0000 7efe1cfcf700 1 -- 172.21.15.154:0/2374793734 >> 172.21.15.154:0/2374793734 conn(0x7efe18099c40 msgr2=0x7efe181320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:19.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.977+0000 7efe1cfcf700 1 -- 172.21.15.154:0/2374793734 shutdown_connections 2023-09-30T22:27:19.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:19.977+0000 7efe1cfcf700 1 -- 172.21.15.154:0/2374793734 wait complete. 2023-09-30T22:27:19.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:20.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:20.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f308496f700 1 Processor -- start 2023-09-30T22:27:20.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f308496f700 1 -- start start 2023-09-30T22:27:20.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f308496f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308012e260 0x7f308012e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f308496f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f308009f3d0 0x7f308006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f308496f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308009d470 con 0x7f308012eb70 2023-09-30T22:27:20.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f308496f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308012de50 con 0x7f308009f3d0 2023-09-30T22:27:20.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f308496f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f308009e010 con 0x7f308012e260 2023-09-30T22:27:20.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f307e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308012e260 0x7f308012e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f307ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f308009f3d0 0x7f308006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f307e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308012e260 0x7f308012e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57128/0 (socket says 172.21.15.154:57128) 2023-09-30T22:27:20.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f307ed9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f308009f3d0 0x7f308006ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39884/0 (socket says 172.21.15.154:39884) 2023-09-30T22:27:20.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f307dd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f308012eb70 0x7f308006a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43110/0 (socket says 172.21.15.154:43110) 2023-09-30T22:27:20.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.524+0000 7f307e59c700 1 -- 172.21.15.154:0/1551015747 learned_addr learned my addr 172.21.15.154:0/1551015747 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:20.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307ed9d700 1 -- 172.21.15.154:0/1551015747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308012e260 msgr2=0x7f308012e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:20.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307ed9d700 1 --2- 172.21.15.154:0/1551015747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308012e260 0x7f308012e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307ed9d700 1 -- 172.21.15.154:0/1551015747 >> v1:172.21.15.154:6789/0 conn(0x7f308012eb70 legacy=0x7f308006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307ed9d700 1 -- 172.21.15.154:0/1551015747 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308012e040 con 0x7f308009f3d0 2023-09-30T22:27:20.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307d59a700 1 -- 172.21.15.154:0/1551015747 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55796435 0 0) 0x7f308009d470 con 0x7f308012eb70 2023-09-30T22:27:20.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307e59c700 1 --2- 172.21.15.154:0/1551015747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308012e260 0x7f308012e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:20.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307ed9d700 1 --2- 172.21.15.154:0/1551015747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308009f3d0 0x7f308006ae80 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f3078009d90 tx=0x7f307800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb923a4e8c3673 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307d59a700 1 -- 172.21.15.154:0/1551015747 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307800e070 con 0x7f308009f3d0 2023-09-30T22:27:20.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307d59a700 1 -- 172.21.15.154:0/1551015747 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307800bb20 con 0x7f308009f3d0 2023-09-30T22:27:20.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f307d59a700 1 -- 172.21.15.154:0/1551015747 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078012430 con 0x7f308009f3d0 2023-09-30T22:27:20.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f308496f700 1 -- 172.21.15.154:0/1551015747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308009f3d0 msgr2=0x7f308006ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.525+0000 7f308496f700 1 --2- 172.21.15.154:0/1551015747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308009f3d0 0x7f308006ae80 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f3078009d90 tx=0x7f307800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:20.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.526+0000 7f308496f700 1 -- 172.21.15.154:0/1551015747 shutdown_connections 2023-09-30T22:27:20.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.526+0000 7f308496f700 1 --2- 172.21.15.154:0/1551015747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308009f3d0 0x7f308006ae80 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.526+0000 7f308496f700 1 --2- 172.21.15.154:0/1551015747 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308012e260 0x7f308012e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.526+0000 7f308496f700 1 -- 172.21.15.154:0/1551015747 >> 172.21.15.154:0/1551015747 conn(0x7f3080099c40 msgr2=0x7f30800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.526+0000 7f308496f700 1 -- 172.21.15.154:0/1551015747 shutdown_connections 2023-09-30T22:27:20.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.526+0000 7f308496f700 1 -- 172.21.15.154:0/1551015747 wait complete. 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f308496f700 1 Processor -- start 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f308496f700 1 -- start start 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f308496f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308009f3d0 0x7f3080070910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f308496f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f308012e260 0x7f3080070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f308496f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308012eb70 0x7f3080071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f308496f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3080119dd0 con 0x7f308012eb70 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f308496f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800727d0 con 0x7f308012e260 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f308496f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f308011af50 con 0x7f308009f3d0 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f307e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308009f3d0 0x7f3080070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f307dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f308012e260 0x7f3080070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f307ed9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308012eb70 0x7f3080071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f307e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308009f3d0 0x7f3080070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57138/0 (socket says 172.21.15.154:57138) 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.527+0000 7f307e59c700 1 -- 172.21.15.154:0/1043461929 learned_addr learned my addr 172.21.15.154:0/1043461929 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f307e59c700 1 -- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f308012e260 msgr2=0x7f3080070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f307e59c700 1 --2- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f308012e260 0x7f3080070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f307e59c700 1 -- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308012eb70 msgr2=0x7f3080071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f307e59c700 1 --2- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308012eb70 0x7f3080071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f307e59c700 1 -- 172.21.15.154:0/1043461929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3070009550 con 0x7f308009f3d0 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f307ed9d700 1 --2- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308012eb70 0x7f3080071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:20.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f307e59c700 1 --2- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308009f3d0 0x7f3080070910 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f307000ebe0 tx=0x7f307000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:20.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f306effd700 1 -- 172.21.15.154:0/1043461929 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307000c850 con 0x7f308009f3d0 2023-09-30T22:27:20.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f306effd700 1 -- 172.21.15.154:0/1043461929 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307000c9b0 con 0x7f308009f3d0 2023-09-30T22:27:20.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f306effd700 1 -- 172.21.15.154:0/1043461929 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307000cd40 con 0x7f308009f3d0 2023-09-30T22:27:20.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f308496f700 1 -- 172.21.15.154:0/1043461929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3078009a70 con 0x7f308009f3d0 2023-09-30T22:27:20.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.528+0000 7f308496f700 1 -- 172.21.15.154:0/1043461929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308011ac70 con 0x7f308009f3d0 2023-09-30T22:27:20.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.529+0000 7f306effd700 1 -- 172.21.15.154:0/1043461929 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3070013470 con 0x7f308009f3d0 2023-09-30T22:27:20.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.529+0000 7f308496f700 1 -- 172.21.15.154:0/1043461929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f308004f2a0 con 0x7f308009f3d0 2023-09-30T22:27:20.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.529+0000 7f306effd700 1 -- 172.21.15.154:0/1043461929 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f307003f970 con 0x7f308009f3d0 2023-09-30T22:27:20.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.534+0000 7f306effd700 1 -- 172.21.15.154:0/1043461929 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3070021020 con 0x7f308009f3d0 2023-09-30T22:27:20.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.716+0000 7f308496f700 1 -- 172.21.15.154:0/1043461929 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f308009e980 con 0x7f308009f3d0 2023-09-30T22:27:20.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.716+0000 7f306effd700 1 -- 172.21.15.154:0/1043461929 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3070017070 con 0x7f308009f3d0 2023-09-30T22:27:20.717 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:20.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.718+0000 7f308496f700 1 -- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308009f3d0 msgr2=0x7f3080070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:20.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.718+0000 7f308496f700 1 --2- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308009f3d0 0x7f3080070910 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f307000ebe0 tx=0x7f307000eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.718+0000 7f308496f700 1 -- 172.21.15.154:0/1043461929 shutdown_connections 2023-09-30T22:27:20.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.718+0000 7f308496f700 1 --2- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f308012eb70 0x7f3080071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.718+0000 7f308496f700 1 --2- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f308009f3d0 0x7f3080070910 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.718+0000 7f308496f700 1 --2- 172.21.15.154:0/1043461929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f308012e260 0x7f3080070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:20.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.718+0000 7f308496f700 1 -- 172.21.15.154:0/1043461929 >> 172.21.15.154:0/1043461929 conn(0x7f3080099c40 msgr2=0x7f30800a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:20.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.718+0000 7f308496f700 1 -- 172.21.15.154:0/1043461929 shutdown_connections 2023-09-30T22:27:20.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:20.718+0000 7f308496f700 1 -- 172.21.15.154:0/1043461929 wait complete. 2023-09-30T22:27:20.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:20.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:20.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:20.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:21.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.027+0000 7f55f02ec700 1 Processor -- start 2023-09-30T22:27:21.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.027+0000 7f55f02ec700 1 -- start start 2023-09-30T22:27:21.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55f02ec700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55e8133900 0x7f55e8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55f02ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8134210 0x7f55e80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55f02ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55f02ec700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e809a760 con 0x7f55e8133900 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55f02ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e81336e0 con 0x7f55e8134210 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55f02ec700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55e809a080 con 0x7f55e80a0ee0 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee889700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee889700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57146/0 (socket says 172.21.15.154:57146) 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee889700 1 -- 172.21.15.154:0/2646599919 learned_addr learned my addr 172.21.15.154:0/2646599919 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee088700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55e8133900 0x7f55e8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ed887700 1 --2- 172.21.15.154:0/2646599919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8134210 0x7f55e80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee889700 1 -- 172.21.15.154:0/2646599919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8134210 msgr2=0x7f55e80a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee889700 1 --2- 172.21.15.154:0/2646599919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8134210 0x7f55e80a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee889700 1 -- 172.21.15.154:0/2646599919 >> v2:172.21.15.154:3300/0 conn(0x7f55e8133900 msgr2=0x7f55e8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee889700 1 --2- 172.21.15.154:0/2646599919 >> v2:172.21.15.154:3300/0 conn(0x7f55e8133900 0x7f55e8133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee889700 1 -- 172.21.15.154:0/2646599919 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e80a23e0 con 0x7f55e80a0ee0 2023-09-30T22:27:21.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee088700 1 --2- 172.21.15.154:0/2646599919 >> v2:172.21.15.154:3300/0 conn(0x7f55e8133900 0x7f55e8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ee889700 1 --2- 172.21.15.154:0/2646599919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e80a1340 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009e50 tx=0x7f55e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6185f15d3b3c0829 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ed086700 1 -- 172.21.15.154:0/2646599919 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e000e070 con 0x7f55e80a0ee0 2023-09-30T22:27:21.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.028+0000 7f55ed086700 1 -- 172.21.15.154:0/2646599919 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e000b910 con 0x7f55e80a0ee0 2023-09-30T22:27:21.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55ed086700 1 -- 172.21.15.154:0/2646599919 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e000bcc0 con 0x7f55e80a0ee0 2023-09-30T22:27:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55f02ec700 1 -- 172.21.15.154:0/2646599919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 msgr2=0x7f55e80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55f02ec700 1 --2- 172.21.15.154:0/2646599919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e80a1340 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009e50 tx=0x7f55e000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55f02ec700 1 -- 172.21.15.154:0/2646599919 shutdown_connections 2023-09-30T22:27:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55f02ec700 1 --2- 172.21.15.154:0/2646599919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e80a1340 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55f02ec700 1 --2- 172.21.15.154:0/2646599919 >> v2:172.21.15.154:3300/0 conn(0x7f55e8133900 0x7f55e8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55f02ec700 1 --2- 172.21.15.154:0/2646599919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8134210 0x7f55e80a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55f02ec700 1 -- 172.21.15.154:0/2646599919 >> 172.21.15.154:0/2646599919 conn(0x7f55e80a2980 msgr2=0x7f55e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55f02ec700 1 -- 172.21.15.154:0/2646599919 shutdown_connections 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.029+0000 7f55f02ec700 1 -- 172.21.15.154:0/2646599919 wait complete. 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.030+0000 7f55f02ec700 1 Processor -- start 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.030+0000 7f55f02ec700 1 -- start start 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55f02ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e811d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55f02ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8133900 0x7f55e811dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55f02ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e8134210 0x7f55e811e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55f02ec700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e811ec70 con 0x7f55e8134210 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55f02ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e811f3d0 con 0x7f55e8133900 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55f02ec700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55e811f9f0 con 0x7f55e80a0ee0 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee088700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e811d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee088700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e811d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57148/0 (socket says 172.21.15.154:57148) 2023-09-30T22:27:21.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee088700 1 -- 172.21.15.154:0/2064355895 learned_addr learned my addr 172.21.15.154:0/2064355895 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:21.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee889700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e8134210 0x7f55e811e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ed887700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8133900 0x7f55e811dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee889700 1 -- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 msgr2=0x7f55e811d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee889700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e811d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee889700 1 -- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8133900 msgr2=0x7f55e811dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee889700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8133900 0x7f55e811dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee889700 1 -- 172.21.15.154:0/2064355895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4009430 con 0x7f55e8134210 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee088700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e811d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55ee889700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e8134210 0x7f55e811e240 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f55e0015000 tx=0x7f55e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.031+0000 7f55deffd700 1 -- 172.21.15.154:0/2064355895 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00099b0 con 0x7f55e8134210 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.032+0000 7f55f02ec700 1 -- 172.21.15.154:0/2064355895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e0009b30 con 0x7f55e8134210 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.032+0000 7f55f02ec700 1 -- 172.21.15.154:0/2064355895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e8120a70 con 0x7f55e8134210 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.032+0000 7f55deffd700 1 -- 172.21.15.154:0/2064355895 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e000ce80 con 0x7f55e8134210 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.032+0000 7f55deffd700 1 -- 172.21.15.154:0/2064355895 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0004450 con 0x7f55e8134210 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.032+0000 7f55deffd700 1 -- 172.21.15.154:0/2064355895 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55e00045b0 con 0x7f55e8134210 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.033+0000 7f55f02ec700 1 -- 172.21.15.154:0/2064355895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d00052e0 con 0x7f55e8134210 2023-09-30T22:27:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.033+0000 7f55deffd700 1 -- 172.21.15.154:0/2064355895 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f55e0040890 con 0x7f55e8134210 2023-09-30T22:27:21.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.041+0000 7f55deffd700 1 -- 172.21.15.154:0/2064355895 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55e001c7c0 con 0x7f55e8134210 2023-09-30T22:27:21.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.068+0000 7f6eeacb5700 1 Processor -- start 2023-09-30T22:27:21.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.068+0000 7f6eeacb5700 1 -- start start 2023-09-30T22:27:21.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.068+0000 7f6eeacb5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.068+0000 7f6eeacb5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41300a0 0x7f6ee41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.068+0000 7f6eeacb5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ee41309f0 0x7f6ee413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.068+0000 7f6eeacb5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee406b2d0 con 0x7f6ee41309f0 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.068+0000 7f6eeacb5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee4133610 con 0x7f6ee41300a0 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.068+0000 7f6eeacb5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee409a500 con 0x7f6ee4133ad0 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee8a51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41300a0 0x7f6ee41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee8a51700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57156/0 (socket says 172.21.15.154:57156) 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee9252700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ee41309f0 0x7f6ee413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41300a0 0x7f6ee41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58838/0 (socket says 172.21.15.154:58838) 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee8a51700 1 -- 172.21.15.154:0/3148092200 learned_addr learned my addr 172.21.15.154:0/3148092200 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee3fff700 1 -- 172.21.15.154:0/3148092200 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 msgr2=0x7f6ee4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee3fff700 1 --2- 172.21.15.154:0/3148092200 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee3fff700 1 -- 172.21.15.154:0/3148092200 >> v2:172.21.15.154:3300/0 conn(0x7f6ee41309f0 msgr2=0x7f6ee413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee3fff700 1 --2- 172.21.15.154:0/3148092200 >> v2:172.21.15.154:3300/0 conn(0x7f6ee41309f0 0x7f6ee413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee3fff700 1 -- 172.21.15.154:0/3148092200 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee41338b0 con 0x7f6ee41300a0 2023-09-30T22:27:21.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee9252700 1 --2- 172.21.15.154:0/3148092200 >> v2:172.21.15.154:3300/0 conn(0x7f6ee41309f0 0x7f6ee413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee8a51700 1 --2- 172.21.15.154:0/3148092200 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee3fff700 1 --2- 172.21.15.154:0/3148092200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41300a0 0x7f6ee41304b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009840 tx=0x7f6ed0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=918fc158a3808def server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee37fe700 1 -- 172.21.15.154:0/3148092200 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0011830 con 0x7f6ee41300a0 2023-09-30T22:27:21.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee37fe700 1 -- 172.21.15.154:0/3148092200 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0011990 con 0x7f6ee41300a0 2023-09-30T22:27:21.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.069+0000 7f6ee37fe700 1 -- 172.21.15.154:0/3148092200 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0011d20 con 0x7f6ee41300a0 2023-09-30T22:27:21.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.070+0000 7f6eeacb5700 1 -- 172.21.15.154:0/3148092200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41300a0 msgr2=0x7f6ee41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.070+0000 7f6eeacb5700 1 --2- 172.21.15.154:0/3148092200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41300a0 0x7f6ee41304b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009840 tx=0x7f6ed0009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.070+0000 7f6eeacb5700 1 -- 172.21.15.154:0/3148092200 shutdown_connections 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.070+0000 7f6eeacb5700 1 --2- 172.21.15.154:0/3148092200 >> v2:172.21.15.154:3300/0 conn(0x7f6ee41309f0 0x7f6ee413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.070+0000 7f6eeacb5700 1 --2- 172.21.15.154:0/3148092200 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.070+0000 7f6eeacb5700 1 --2- 172.21.15.154:0/3148092200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41300a0 0x7f6ee41304b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.070+0000 7f6eeacb5700 1 -- 172.21.15.154:0/3148092200 >> 172.21.15.154:0/3148092200 conn(0x7f6ee4099c40 msgr2=0x7f6ee40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.070+0000 7f6eeacb5700 1 -- 172.21.15.154:0/3148092200 shutdown_connections 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.070+0000 7f6eeacb5700 1 -- 172.21.15.154:0/3148092200 wait complete. 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.071+0000 7f6eeacb5700 1 Processor -- start 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.071+0000 7f6eeacb5700 1 -- start start 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.071+0000 7f6eeacb5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee41300a0 0x7f6ee411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.071+0000 7f6eeacb5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41309f0 0x7f6ee411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.071+0000 7f6eeacb5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.071+0000 7f6eeacb5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee411f970 con 0x7f6ee41300a0 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.071+0000 7f6eeacb5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee4072230 con 0x7f6ee41309f0 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.071+0000 7f6eeacb5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee412fc40 con 0x7f6ee4133ad0 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee9252700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41309f0 0x7f6ee411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee9252700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57164/0 (socket says 172.21.15.154:57164) 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41309f0 0x7f6ee411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58844/0 (socket says 172.21.15.154:58844) 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee9252700 1 -- 172.21.15.154:0/2272573924 learned_addr learned my addr 172.21.15.154:0/2272573924 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee8a51700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee41300a0 0x7f6ee411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee8a51700 1 -- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 msgr2=0x7f6ee411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee8a51700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee8a51700 1 -- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41309f0 msgr2=0x7f6ee411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee8a51700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41309f0 0x7f6ee411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee8a51700 1 -- 172.21.15.154:0/2272573924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc009a70 con 0x7f6ee41300a0 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee3fff700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41309f0 0x7f6ee411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee9252700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee8a51700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee41300a0 0x7f6ee411da40 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e9a0 tx=0x7f6ed800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee17fa700 1 -- 172.21.15.154:0/2272573924 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004030 con 0x7f6ee41300a0 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee17fa700 1 -- 172.21.15.154:0/2272573924 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed8004190 con 0x7f6ee41300a0 2023-09-30T22:27:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6ee17fa700 1 -- 172.21.15.154:0/2272573924 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8004520 con 0x7f6ee41300a0 2023-09-30T22:27:21.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6eeacb5700 1 -- 172.21.15.154:0/2272573924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed8009550 con 0x7f6ee41300a0 2023-09-30T22:27:21.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.072+0000 7f6eeacb5700 1 -- 172.21.15.154:0/2272573924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed00094a0 con 0x7f6ee41300a0 2023-09-30T22:27:21.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.073+0000 7f6ee17fa700 1 -- 172.21.15.154:0/2272573924 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ed80036a0 con 0x7f6ee41300a0 2023-09-30T22:27:21.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.073+0000 7f6ee17fa700 1 -- 172.21.15.154:0/2272573924 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ed803f520 con 0x7f6ee41300a0 2023-09-30T22:27:21.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.073+0000 7f6eeacb5700 1 -- 172.21.15.154:0/2272573924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee411fd40 con 0x7f6ee41300a0 2023-09-30T22:27:21.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.082+0000 7f6ee17fa700 1 -- 172.21.15.154:0/2272573924 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ed8019d40 con 0x7f6ee41300a0 2023-09-30T22:27:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.124+0000 7ff11bb5d700 1 Processor -- start 2023-09-30T22:27:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.124+0000 7ff11bb5d700 1 -- start start 2023-09-30T22:27:21.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff11bb5d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11409d860 0x7ff11409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff11bb5d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff1141307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff11bb5d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff114130ce0 0x7ff114131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff11bb5d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11409aaa0 con 0x7ff114130ce0 2023-09-30T22:27:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff11bb5d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11409f870 con 0x7ff11409d860 2023-09-30T22:27:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff11bb5d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11409b360 con 0x7ff11409e170 2023-09-30T22:27:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff1198f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11409d860 0x7ff11409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff1198f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11409d860 0x7ff11409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58850/0 (socket says 172.21.15.154:58850) 2023-09-30T22:27:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff1198f9700 1 -- 172.21.15.154:0/338636431 learned_addr learned my addr 172.21.15.154:0/338636431 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff11a0fa700 1 --2- 172.21.15.154:0/338636431 >> v2:172.21.15.154:3300/0 conn(0x7ff114130ce0 0x7ff114131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff1190f8700 1 --2- 172.21.15.154:0/338636431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff1141307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff1198f9700 1 -- 172.21.15.154:0/338636431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 msgr2=0x7ff1141307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff1198f9700 1 --2- 172.21.15.154:0/338636431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff1141307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff1198f9700 1 -- 172.21.15.154:0/338636431 >> v2:172.21.15.154:3300/0 conn(0x7ff114130ce0 msgr2=0x7ff114131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff1198f9700 1 --2- 172.21.15.154:0/338636431 >> v2:172.21.15.154:3300/0 conn(0x7ff114130ce0 0x7ff114131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.125+0000 7ff1198f9700 1 -- 172.21.15.154:0/338636431 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11409b620 con 0x7ff11409d860 2023-09-30T22:27:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff11a0fa700 1 --2- 172.21.15.154:0/338636431 >> v2:172.21.15.154:3300/0 conn(0x7ff114130ce0 0x7ff114131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff1198f9700 1 --2- 172.21.15.154:0/338636431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11409d860 0x7ff11409dc30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff11000bb90 tx=0x7ff11000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc9459c66ce8913 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff1188f7700 1 -- 172.21.15.154:0/338636431 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000dd30 con 0x7ff11409d860 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff1188f7700 1 -- 172.21.15.154:0/338636431 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11000de90 con 0x7ff11409d860 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff1188f7700 1 -- 172.21.15.154:0/338636431 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110010690 con 0x7ff11409d860 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff11bb5d700 1 -- 172.21.15.154:0/338636431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11409d860 msgr2=0x7ff11409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff11bb5d700 1 --2- 172.21.15.154:0/338636431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11409d860 0x7ff11409dc30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff11000bb90 tx=0x7ff11000bea0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff11bb5d700 1 -- 172.21.15.154:0/338636431 shutdown_connections 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff11bb5d700 1 --2- 172.21.15.154:0/338636431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff11409d860 0x7ff11409dc30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff11bb5d700 1 --2- 172.21.15.154:0/338636431 >> v2:172.21.15.154:3300/0 conn(0x7ff114130ce0 0x7ff114131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff11bb5d700 1 --2- 172.21.15.154:0/338636431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff1141307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff11bb5d700 1 -- 172.21.15.154:0/338636431 >> 172.21.15.154:0/338636431 conn(0x7ff114099c40 msgr2=0x7ff1140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.126+0000 7ff11bb5d700 1 -- 172.21.15.154:0/338636431 shutdown_connections 2023-09-30T22:27:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.127+0000 7ff11bb5d700 1 -- 172.21.15.154:0/338636431 wait complete. 2023-09-30T22:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.127+0000 7ff11bb5d700 1 Processor -- start 2023-09-30T22:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.127+0000 7ff11bb5d700 1 -- start start 2023-09-30T22:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11bb5d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11409d860 0x7ff11411e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11bb5d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff11411e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11bb5d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff114130ce0 0x7ff11411ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11bb5d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11411ff20 con 0x7ff11409d860 2023-09-30T22:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11bb5d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff114120540 con 0x7ff114130ce0 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11bb5d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff11409c920 con 0x7ff11409e170 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff1198f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11409d860 0x7ff11411e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff1190f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff11411e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11a0fa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff114130ce0 0x7ff11411ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff1190f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff11411e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57176/0 (socket says 172.21.15.154:57176) 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff1198f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11409d860 0x7ff11411e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39958/0 (socket says 172.21.15.154:39958) 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff1190f8700 1 -- 172.21.15.154:0/4287833177 learned_addr learned my addr 172.21.15.154:0/4287833177 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11a0fa700 1 -- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 msgr2=0x7ff11411e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11a0fa700 1 --2- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff11411e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11a0fa700 1 -- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11409d860 msgr2=0x7ff11411e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11a0fa700 1 --2- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11409d860 0x7ff11411e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff11a0fa700 1 -- 172.21.15.154:0/4287833177 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c009a70 con 0x7ff114130ce0 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff1198f9700 1 --2- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11409d860 0x7ff11411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.128+0000 7ff1190f8700 1 --2- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff11411e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.129+0000 7ff11a0fa700 1 --2- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff114130ce0 0x7ff11411ed90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009e50 tx=0x7ff10c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.129+0000 7ff10a7fc700 1 -- 172.21.15.154:0/4287833177 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c003a20 con 0x7ff114130ce0 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.129+0000 7ff10a7fc700 1 -- 172.21.15.154:0/4287833177 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c00f040 con 0x7ff114130ce0 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.129+0000 7ff11bb5d700 1 -- 172.21.15.154:0/4287833177 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11000b7f0 con 0x7ff114130ce0 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.129+0000 7ff10a7fc700 1 -- 172.21.15.154:0/4287833177 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c003de0 con 0x7ff114130ce0 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.129+0000 7ff11bb5d700 1 -- 172.21.15.154:0/4287833177 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff114121ba0 con 0x7ff114130ce0 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.130+0000 7ff10a7fc700 1 -- 172.21.15.154:0/4287833177 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff10c00ca30 con 0x7ff114130ce0 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.130+0000 7ff10a7fc700 1 -- 172.21.15.154:0/4287833177 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff10c03fd50 con 0x7ff114130ce0 2023-09-30T22:27:21.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.130+0000 7ff11bb5d700 1 -- 172.21.15.154:0/4287833177 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff114121ba0 con 0x7ff114130ce0 2023-09-30T22:27:21.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.139+0000 7ff10a7fc700 1 -- 172.21.15.154:0/4287833177 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff114121ba0 con 0x7ff114130ce0 2023-09-30T22:27:21.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.241+0000 7f55f02ec700 1 -- 172.21.15.154:0/2064355895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f55d0005590 con 0x7f55e8134210 2023-09-30T22:27:21.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.241+0000 7f55deffd700 1 -- 172.21.15.154:0/2064355895 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55e002a020 con 0x7f55e8134210 2023-09-30T22:27:21.243 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:21.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.244+0000 7f55f02ec700 1 -- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e8134210 msgr2=0x7f55e811e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.244+0000 7f55f02ec700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e8134210 0x7f55e811e240 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f55e0015000 tx=0x7f55e0004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.244+0000 7f55f02ec700 1 -- 172.21.15.154:0/2064355895 shutdown_connections 2023-09-30T22:27:21.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.244+0000 7f55f02ec700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e8134210 0x7f55e811e240 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.244+0000 7f55f02ec700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55e80a0ee0 0x7f55e811d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.244+0000 7f55f02ec700 1 --2- 172.21.15.154:0/2064355895 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e8133900 0x7f55e811dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.244+0000 7f55f02ec700 1 -- 172.21.15.154:0/2064355895 >> 172.21.15.154:0/2064355895 conn(0x7f55e80a2980 msgr2=0x7f55e81bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.244+0000 7f55f02ec700 1 -- 172.21.15.154:0/2064355895 shutdown_connections 2023-09-30T22:27:21.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.244+0000 7f55f02ec700 1 -- 172.21.15.154:0/2064355895 wait complete. 2023-09-30T22:27:21.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:21.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.282+0000 7f6eeacb5700 1 -- 172.21.15.154:0/2272573924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6ee412d5a0 con 0x7f6ee41300a0 2023-09-30T22:27:21.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.282+0000 7f6ee17fa700 1 -- 172.21.15.154:0/2272573924 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ed8019300 con 0x7f6ee41300a0 2023-09-30T22:27:21.283 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:21.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.285+0000 7f6eeacb5700 1 -- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee41300a0 msgr2=0x7f6ee411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.285+0000 7f6eeacb5700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee41300a0 0x7f6ee411da40 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e9a0 tx=0x7f6ed800ecb0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.285+0000 7f6eeacb5700 1 -- 172.21.15.154:0/2272573924 shutdown_connections 2023-09-30T22:27:21.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.285+0000 7f6eeacb5700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ee4133ad0 0x7f6ee411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.285+0000 7f6eeacb5700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee41300a0 0x7f6ee411da40 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.285+0000 7f6eeacb5700 1 --2- 172.21.15.154:0/2272573924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee41309f0 0x7f6ee411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.285+0000 7f6eeacb5700 1 -- 172.21.15.154:0/2272573924 >> 172.21.15.154:0/2272573924 conn(0x7f6ee4099c40 msgr2=0x7f6ee4131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.285+0000 7f6eeacb5700 1 -- 172.21.15.154:0/2272573924 shutdown_connections 2023-09-30T22:27:21.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.285+0000 7f6eeacb5700 1 -- 172.21.15.154:0/2272573924 wait complete. 2023-09-30T22:27:21.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.332+0000 7ff11bb5d700 1 -- 172.21.15.154:0/4287833177 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff114121ba0 con 0x7ff114130ce0 2023-09-30T22:27:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.332+0000 7ff10a7fc700 1 -- 172.21.15.154:0/4287833177 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff114121ba0 con 0x7ff114130ce0 2023-09-30T22:27:21.333 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.334+0000 7ff11bb5d700 1 -- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff114130ce0 msgr2=0x7ff11411ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.334+0000 7ff11bb5d700 1 --2- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff114130ce0 0x7ff11411ed90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009e50 tx=0x7ff10c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.335+0000 7ff11bb5d700 1 -- 172.21.15.154:0/4287833177 shutdown_connections 2023-09-30T22:27:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.335+0000 7ff11bb5d700 1 --2- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff114130ce0 0x7ff11411ed90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.335+0000 7ff11bb5d700 1 --2- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff11409d860 0x7ff11411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.335+0000 7ff11bb5d700 1 --2- 172.21.15.154:0/4287833177 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff11409e170 0x7ff11411e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.335+0000 7ff11bb5d700 1 -- 172.21.15.154:0/4287833177 >> 172.21.15.154:0/4287833177 conn(0x7ff114099c40 msgr2=0x7ff1140a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.335+0000 7ff11bb5d700 1 -- 172.21.15.154:0/4287833177 shutdown_connections 2023-09-30T22:27:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.335+0000 7ff11bb5d700 1 -- 172.21.15.154:0/4287833177 wait complete. 2023-09-30T22:27:21.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:21.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:21.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.856+0000 7f7078ce6700 1 Processor -- start 2023-09-30T22:27:21.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.856+0000 7f7078ce6700 1 -- start start 2023-09-30T22:27:21.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7078ce6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f7074138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7078ce6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074139280 0x7f707413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7078ce6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707406b2d0 con 0x7f7074133ad0 2023-09-30T22:27:21.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7078ce6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70741345b0 con 0x7f7074136960 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7078ce6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7074133610 con 0x7f7074139280 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7072d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074139280 0x7f707413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7071d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f7074138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f707259c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7074133ad0 0x7f7074133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43112/0 (socket says 172.21.15.154:43112) 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f707259c700 1 -- 172.21.15.154:0/623826166 learned_addr learned my addr 172.21.15.154:0/623826166 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f707159a700 1 -- 172.21.15.154:0/623826166 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178754143 0 0) 0x7f707406b2d0 con 0x7f7074133ad0 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7071d9b700 1 -- 172.21.15.154:0/623826166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074139280 msgr2=0x7f707413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7071d9b700 1 --2- 172.21.15.154:0/623826166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074139280 0x7f707413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7071d9b700 1 -- 172.21.15.154:0/623826166 >> v1:172.21.15.154:6789/0 conn(0x7f7074133ad0 legacy=0x7f7074133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7071d9b700 1 -- 172.21.15.154:0/623826166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707409a500 con 0x7f7074136960 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7072d9d700 1 --2- 172.21.15.154:0/623826166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074139280 0x7f707413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f7071d9b700 1 --2- 172.21.15.154:0/623826166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f7074138d40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7064009870 tx=0x7f7064009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3558c1305684638a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f707159a700 1 -- 172.21.15.154:0/623826166 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064011830 con 0x7f7074136960 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f707159a700 1 -- 172.21.15.154:0/623826166 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7064011990 con 0x7f7074136960 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.857+0000 7f707159a700 1 -- 172.21.15.154:0/623826166 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064011d20 con 0x7f7074136960 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.858+0000 7f7078ce6700 1 -- 172.21.15.154:0/623826166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 msgr2=0x7f7074138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.858+0000 7f7078ce6700 1 --2- 172.21.15.154:0/623826166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f7074138d40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7064009870 tx=0x7f7064009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.858+0000 7f7078ce6700 1 -- 172.21.15.154:0/623826166 shutdown_connections 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.858+0000 7f7078ce6700 1 --2- 172.21.15.154:0/623826166 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074139280 0x7f707413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.858+0000 7f7078ce6700 1 --2- 172.21.15.154:0/623826166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f7074138d40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.858+0000 7f7078ce6700 1 -- 172.21.15.154:0/623826166 >> 172.21.15.154:0/623826166 conn(0x7f7074099c40 msgr2=0x7f70740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.858+0000 7f7078ce6700 1 -- 172.21.15.154:0/623826166 shutdown_connections 2023-09-30T22:27:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.858+0000 7f7078ce6700 1 -- 172.21.15.154:0/623826166 wait complete. 2023-09-30T22:27:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.859+0000 7f7078ce6700 1 Processor -- start 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.859+0000 7f7078ce6700 1 -- start start 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.859+0000 7f7078ce6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074133ad0 0x7f707412cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.859+0000 7f7078ce6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f707412d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7078ce6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074139280 0x7f707412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7078ce6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707406ec80 con 0x7f7074139280 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7078ce6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7074130c00 con 0x7f7074136960 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7078ce6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70741317a0 con 0x7f7074133ad0 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f707259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074133ad0 0x7f707412cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7072d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074139280 0x7f707412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7071d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f707412d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:21.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f707259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074133ad0 0x7f707412cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57196/0 (socket says 172.21.15.154:57196) 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f707259c700 1 -- 172.21.15.154:0/711360609 learned_addr learned my addr 172.21.15.154:0/711360609 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7072d9d700 1 -- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074133ad0 msgr2=0x7f707412cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7072d9d700 1 --2- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074133ad0 0x7f707412cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7072d9d700 1 -- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 msgr2=0x7f707412d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7072d9d700 1 --2- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f707412d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7072d9d700 1 -- 172.21.15.154:0/711360609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c009a70 con 0x7f7074139280 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7071d9b700 1 --2- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f707412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7072d9d700 1 --2- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074139280 0x7f707412d5b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f706c00efc0 tx=0x7f706c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7062ffd700 1 -- 172.21.15.154:0/711360609 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c00ca90 con 0x7f7074139280 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7062ffd700 1 -- 172.21.15.154:0/711360609 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c00f040 con 0x7f7074139280 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7078ce6700 1 -- 172.21.15.154:0/711360609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70640094a0 con 0x7f7074139280 2023-09-30T22:27:21.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7062ffd700 1 -- 172.21.15.154:0/711360609 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c00ce30 con 0x7f7074139280 2023-09-30T22:27:21.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.860+0000 7f7078ce6700 1 -- 172.21.15.154:0/711360609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707412dd60 con 0x7f7074139280 2023-09-30T22:27:21.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.861+0000 7f7062ffd700 1 -- 172.21.15.154:0/711360609 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f706c014480 con 0x7f7074139280 2023-09-30T22:27:21.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.861+0000 7f7062ffd700 1 -- 172.21.15.154:0/711360609 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f706c03fcb0 con 0x7f7074139280 2023-09-30T22:27:21.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.861+0000 7f7078ce6700 1 -- 172.21.15.154:0/711360609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7074070150 con 0x7f7074139280 2023-09-30T22:27:21.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:21.866+0000 7f7062ffd700 1 -- 172.21.15.154:0/711360609 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f706c012910 con 0x7f7074139280 2023-09-30T22:27:22.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.055+0000 7f7078ce6700 1 -- 172.21.15.154:0/711360609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f707404f2a0 con 0x7f7074139280 2023-09-30T22:27:22.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.055+0000 7f7062ffd700 1 -- 172.21.15.154:0/711360609 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f706c012340 con 0x7f7074139280 2023-09-30T22:27:22.056 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:22.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.057+0000 7f7078ce6700 1 -- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074139280 msgr2=0x7f707412d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.057+0000 7f7078ce6700 1 --2- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074139280 0x7f707412d5b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f706c00efc0 tx=0x7f706c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.057+0000 7f7078ce6700 1 -- 172.21.15.154:0/711360609 shutdown_connections 2023-09-30T22:27:22.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.057+0000 7f7078ce6700 1 --2- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7074139280 0x7f707412d5b0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.057+0000 7f7078ce6700 1 --2- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7074133ad0 0x7f707412cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.057+0000 7f7078ce6700 1 --2- 172.21.15.154:0/711360609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7074136960 0x7f707412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.057+0000 7f7078ce6700 1 -- 172.21.15.154:0/711360609 >> 172.21.15.154:0/711360609 conn(0x7f7074099c40 msgr2=0x7f7074134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:22.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.057+0000 7f7078ce6700 1 -- 172.21.15.154:0/711360609 shutdown_connections 2023-09-30T22:27:22.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.057+0000 7f7078ce6700 1 -- 172.21.15.154:0/711360609 wait complete. 2023-09-30T22:27:22.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:22.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:22.299 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:22.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:22.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.385+0000 7f3bda0e4700 1 Processor -- start 2023-09-30T22:27:22.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.385+0000 7f3bda0e4700 1 -- start start 2023-09-30T22:27:22.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.385+0000 7f3bda0e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4133ad0 0x7f3bd4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bda0e4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3bd4130bc0 0x7f3bd413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bda0e4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd406b2d0 con 0x7f3bd41300a0 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bda0e4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd4133610 con 0x7f3bd4130bc0 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bda0e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd409a500 con 0x7f3bd4133ad0 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4133ad0 0x7f3bd4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3bd4130bc0 0x7f3bd413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4133ad0 0x7f3bd4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57200/0 (socket says 172.21.15.154:57200) 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd37fe700 1 -- 172.21.15.154:0/977610622 learned_addr learned my addr 172.21.15.154:0/977610622 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd3fff700 1 -- 172.21.15.154:0/977610622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4133ad0 msgr2=0x7f3bd4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd3fff700 1 --2- 172.21.15.154:0/977610622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4133ad0 0x7f3bd4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd3fff700 1 -- 172.21.15.154:0/977610622 >> v1:172.21.15.154:6789/0 conn(0x7f3bd41300a0 legacy=0x7f3bd41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd3fff700 1 -- 172.21.15.154:0/977610622 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd41338b0 con 0x7f3bd4130bc0 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd37fe700 1 --2- 172.21.15.154:0/977610622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4133ad0 0x7f3bd4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd3fff700 1 --2- 172.21.15.154:0/977610622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd4130bc0 0x7f3bd413b990 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009d90 tx=0x7f3bcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd5a17f05665642 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd27fc700 1 -- 172.21.15.154:0/977610622 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00e070 con 0x7f3bd4130bc0 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd27fc700 1 -- 172.21.15.154:0/977610622 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00bb20 con 0x7f3bd4130bc0 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.386+0000 7f3bd27fc700 1 -- 172.21.15.154:0/977610622 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc012430 con 0x7f3bd4130bc0 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.387+0000 7f3bda0e4700 1 -- 172.21.15.154:0/977610622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd4130bc0 msgr2=0x7f3bd413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.387+0000 7f3bda0e4700 1 --2- 172.21.15.154:0/977610622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd4130bc0 0x7f3bd413b990 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009d90 tx=0x7f3bcc00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.387+0000 7f3bda0e4700 1 -- 172.21.15.154:0/977610622 shutdown_connections 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.387+0000 7f3bda0e4700 1 --2- 172.21.15.154:0/977610622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd4130bc0 0x7f3bd413b990 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.387+0000 7f3bda0e4700 1 --2- 172.21.15.154:0/977610622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4133ad0 0x7f3bd4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.387+0000 7f3bda0e4700 1 -- 172.21.15.154:0/977610622 >> 172.21.15.154:0/977610622 conn(0x7f3bd4099c40 msgr2=0x7f3bd40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:22.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.387+0000 7f3bda0e4700 1 -- 172.21.15.154:0/977610622 shutdown_connections 2023-09-30T22:27:22.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.387+0000 7f3bda0e4700 1 -- 172.21.15.154:0/977610622 wait complete. 2023-09-30T22:27:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.388+0000 7f3bda0e4700 1 Processor -- start 2023-09-30T22:27:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.388+0000 7f3bda0e4700 1 -- start start 2023-09-30T22:27:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bda0e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd41300a0 0x7f3bd411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bda0e4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4130bc0 0x7f3bd411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bda0e4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd4133ad0 0x7f3bd411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bda0e4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4120100 con 0x7f3bd4133ad0 2023-09-30T22:27:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bda0e4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40722d0 con 0x7f3bd41300a0 2023-09-30T22:27:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bda0e4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4120c70 con 0x7f3bd4130bc0 2023-09-30T22:27:22.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd41300a0 0x7f3bd411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd41300a0 0x7f3bd411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58878/0 (socket says 172.21.15.154:58878) 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd37fe700 1 -- 172.21.15.154:0/1750124422 learned_addr learned my addr 172.21.15.154:0/1750124422 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd2ffd700 1 --2- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4130bc0 0x7f3bd411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd3fff700 1 --2- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd4133ad0 0x7f3bd411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd37fe700 1 -- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4130bc0 msgr2=0x7f3bd411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd37fe700 1 --2- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4130bc0 0x7f3bd411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd37fe700 1 -- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd4133ad0 msgr2=0x7f3bd411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd37fe700 1 --2- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd4133ad0 0x7f3bd411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.389+0000 7f3bd37fe700 1 -- 172.21.15.154:0/1750124422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc4009550 con 0x7f3bd41300a0 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.390+0000 7f3bd37fe700 1 --2- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd41300a0 0x7f3bd411da40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400ec10 tx=0x7f3bc400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:22.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.390+0000 7f3bbbfff700 1 -- 172.21.15.154:0/1750124422 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400c850 con 0x7f3bd41300a0 2023-09-30T22:27:22.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.390+0000 7f3bbbfff700 1 -- 172.21.15.154:0/1750124422 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400c9b0 con 0x7f3bd41300a0 2023-09-30T22:27:22.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.390+0000 7f3bbbfff700 1 -- 172.21.15.154:0/1750124422 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400cd40 con 0x7f3bd41300a0 2023-09-30T22:27:22.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.390+0000 7f3bda0e4700 1 -- 172.21.15.154:0/1750124422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc009a70 con 0x7f3bd41300a0 2023-09-30T22:27:22.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.390+0000 7f3bda0e4700 1 -- 172.21.15.154:0/1750124422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd4120350 con 0x7f3bd41300a0 2023-09-30T22:27:22.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.391+0000 7f3bbbfff700 1 -- 172.21.15.154:0/1750124422 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bc4013470 con 0x7f3bd41300a0 2023-09-30T22:27:22.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.391+0000 7f3bda0e4700 1 -- 172.21.15.154:0/1750124422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd412dd00 con 0x7f3bd41300a0 2023-09-30T22:27:22.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.391+0000 7f3bbbfff700 1 -- 172.21.15.154:0/1750124422 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3bc403fa90 con 0x7f3bd41300a0 2023-09-30T22:27:22.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.396+0000 7f3bbbfff700 1 -- 172.21.15.154:0/1750124422 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bc400cea0 con 0x7f3bd41300a0 2023-09-30T22:27:22.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.427+0000 7f968b578700 1 Processor -- start 2023-09-30T22:27:22.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.427+0000 7f968b578700 1 -- start start 2023-09-30T22:27:22.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f968b578700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96840a0a70 0x7f96840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f968b578700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9684134120 0x7f968413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f968b578700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968409dc00 con 0x7f96840a1380 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f968b578700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968409ea60 con 0x7f9684134120 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f968b578700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f968409dec0 con 0x7f96840a0a70 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689314700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96840a0a70 0x7f96840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689b15700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9684134120 0x7f968413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689b15700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9684134120 0x7f968413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39986/0 (socket says 172.21.15.154:39986) 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689b15700 1 -- 172.21.15.154:0/1021068460 learned_addr learned my addr 172.21.15.154:0/1021068460 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689314700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96840a0a70 0x7f96840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57224/0 (socket says 172.21.15.154:57224) 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689b15700 1 -- 172.21.15.154:0/1021068460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96840a0a70 msgr2=0x7f96840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689b15700 1 --2- 172.21.15.154:0/1021068460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96840a0a70 0x7f96840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689b15700 1 -- 172.21.15.154:0/1021068460 >> v1:172.21.15.154:6789/0 conn(0x7f96840a1380 legacy=0x7f9684133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689b15700 1 -- 172.21.15.154:0/1021068460 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968409e6a0 con 0x7f9684134120 2023-09-30T22:27:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.428+0000 7f9689b15700 1 --2- 172.21.15.154:0/1021068460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9684134120 0x7f968413bce0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f967c009e50 tx=0x7f967c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e8af9a452033f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.429+0000 7f967bfff700 1 -- 172.21.15.154:0/1021068460 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c00e070 con 0x7f9684134120 2023-09-30T22:27:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.429+0000 7f967bfff700 1 -- 172.21.15.154:0/1021068460 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c00b910 con 0x7f9684134120 2023-09-30T22:27:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.429+0000 7f967bfff700 1 -- 172.21.15.154:0/1021068460 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c00bcc0 con 0x7f9684134120 2023-09-30T22:27:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.429+0000 7f968b578700 1 -- 172.21.15.154:0/1021068460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9684134120 msgr2=0x7f968413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.429+0000 7f968b578700 1 --2- 172.21.15.154:0/1021068460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9684134120 0x7f968413bce0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f967c009e50 tx=0x7f967c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.429+0000 7f968b578700 1 -- 172.21.15.154:0/1021068460 shutdown_connections 2023-09-30T22:27:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.429+0000 7f968b578700 1 --2- 172.21.15.154:0/1021068460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9684134120 0x7f968413bce0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.429+0000 7f968b578700 1 --2- 172.21.15.154:0/1021068460 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96840a0a70 0x7f96840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.429+0000 7f968b578700 1 -- 172.21.15.154:0/1021068460 >> 172.21.15.154:0/1021068460 conn(0x7f96840a6610 msgr2=0x7f96840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.430+0000 7f968b578700 1 -- 172.21.15.154:0/1021068460 shutdown_connections 2023-09-30T22:27:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.430+0000 7f968b578700 1 -- 172.21.15.154:0/1021068460 wait complete. 2023-09-30T22:27:22.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.430+0000 7f968b578700 1 Processor -- start 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f968b578700 1 -- start start 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f968b578700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96840a0a70 0x7f9684122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f968b578700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96840a1380 0x7f9684122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f968b578700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9684134120 0x7f96841232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f968b578700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96840a03e0 con 0x7f96840a0a70 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f968b578700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9684126190 con 0x7f96840a1380 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f968b578700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96841338d0 con 0x7f9684134120 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9689314700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96840a0a70 0x7f9684122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9689314700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96840a0a70 0x7f9684122870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39994/0 (socket says 172.21.15.154:39994) 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9689314700 1 -- 172.21.15.154:0/4034299745 learned_addr learned my addr 172.21.15.154:0/4034299745 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:22.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9688b13700 1 --2- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96840a1380 0x7f9684122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9689b15700 1 --2- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9684134120 0x7f96841232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9689314700 1 -- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9684134120 msgr2=0x7f96841232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9689314700 1 --2- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9684134120 0x7f96841232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9689314700 1 -- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96840a1380 msgr2=0x7f9684122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9689314700 1 --2- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96840a1380 0x7f9684122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.431+0000 7f9689314700 1 -- 172.21.15.154:0/4034299745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c009b30 con 0x7f96840a0a70 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.432+0000 7f9689314700 1 --2- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96840a0a70 0x7f9684122870 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f968000e9e0 tx=0x7f968000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.432+0000 7f9679ffb700 1 -- 172.21.15.154:0/4034299745 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680009710 con 0x7f96840a0a70 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.432+0000 7f9679ffb700 1 -- 172.21.15.154:0/4034299745 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968000c850 con 0x7f96840a0a70 2023-09-30T22:27:22.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.432+0000 7f968b578700 1 -- 172.21.15.154:0/4034299745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9684133390 con 0x7f96840a0a70 2023-09-30T22:27:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.432+0000 7f9679ffb700 1 -- 172.21.15.154:0/4034299745 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000cbc0 con 0x7f96840a0a70 2023-09-30T22:27:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.432+0000 7f968b578700 1 -- 172.21.15.154:0/4034299745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9684126b20 con 0x7f96840a0a70 2023-09-30T22:27:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.433+0000 7f9679ffb700 1 -- 172.21.15.154:0/4034299745 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f968000cd20 con 0x7f96840a0a70 2023-09-30T22:27:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.433+0000 7f968b578700 1 -- 172.21.15.154:0/4034299745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968404f2a0 con 0x7f96840a0a70 2023-09-30T22:27:22.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.433+0000 7f9679ffb700 1 -- 172.21.15.154:0/4034299745 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f968003fb30 con 0x7f96840a0a70 2023-09-30T22:27:22.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.439+0000 7f9679ffb700 1 -- 172.21.15.154:0/4034299745 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f968001a9b0 con 0x7f96840a0a70 2023-09-30T22:27:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.489+0000 7f4b7c5ec700 1 Processor -- start 2023-09-30T22:27:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.489+0000 7f4b7c5ec700 1 -- start start 2023-09-30T22:27:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7c5ec700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b7409d860 0x7f4b7409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7c5ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409e170 0x7f4b741307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7c5ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 0x7f4b74131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7c5ec700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b74131670 con 0x7f4b7409d860 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7c5ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7409aaa0 con 0x7f4b7409e170 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7c5ec700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7409f870 con 0x7f4b74130ce0 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7a388700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b7409d860 0x7f4b7409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7a388700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b7409d860 0x7f4b7409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40008/0 (socket says 172.21.15.154:40008) 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7ab89700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 0x7f4b74131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b79b87700 1 --2- 172.21.15.154:0/1896545401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409e170 0x7f4b741307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7a388700 1 -- 172.21.15.154:0/1896545401 learned_addr learned my addr 172.21.15.154:0/1896545401 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7ab89700 1 -- 172.21.15.154:0/1896545401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409e170 msgr2=0x7f4b741307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:22.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7ab89700 1 --2- 172.21.15.154:0/1896545401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409e170 0x7f4b741307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7ab89700 1 -- 172.21.15.154:0/1896545401 >> v2:172.21.15.154:3300/0 conn(0x7f4b7409d860 msgr2=0x7f4b7409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7ab89700 1 --2- 172.21.15.154:0/1896545401 >> v2:172.21.15.154:3300/0 conn(0x7f4b7409d860 0x7f4b7409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7ab89700 1 -- 172.21.15.154:0/1896545401 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7409b360 con 0x7f4b74130ce0 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7a388700 1 --2- 172.21.15.154:0/1896545401 >> v2:172.21.15.154:3300/0 conn(0x7f4b7409d860 0x7f4b7409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b79b87700 1 --2- 172.21.15.154:0/1896545401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409e170 0x7f4b741307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.490+0000 7f4b7ab89700 1 --2- 172.21.15.154:0/1896545401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 0x7f4b74131130 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009dc0 tx=0x7f4b6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4b68804e46b8d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b79386700 1 -- 172.21.15.154:0/1896545401 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00e070 con 0x7f4b74130ce0 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b79386700 1 -- 172.21.15.154:0/1896545401 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c00bae0 con 0x7f4b74130ce0 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b79386700 1 -- 172.21.15.154:0/1896545401 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00be90 con 0x7f4b74130ce0 2023-09-30T22:27:22.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/1896545401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 msgr2=0x7f4b74131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b7c5ec700 1 --2- 172.21.15.154:0/1896545401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 0x7f4b74131130 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009dc0 tx=0x7f4b6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/1896545401 shutdown_connections 2023-09-30T22:27:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b7c5ec700 1 --2- 172.21.15.154:0/1896545401 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 0x7f4b74131130 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b7c5ec700 1 --2- 172.21.15.154:0/1896545401 >> v2:172.21.15.154:3300/0 conn(0x7f4b7409d860 0x7f4b7409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b7c5ec700 1 --2- 172.21.15.154:0/1896545401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409e170 0x7f4b741307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/1896545401 >> 172.21.15.154:0/1896545401 conn(0x7f4b74099c40 msgr2=0x7f4b740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/1896545401 shutdown_connections 2023-09-30T22:27:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.491+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/1896545401 wait complete. 2023-09-30T22:27:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.492+0000 7f4b7c5ec700 1 Processor -- start 2023-09-30T22:27:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.492+0000 7f4b7c5ec700 1 -- start start 2023-09-30T22:27:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7c5ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409d860 0x7f4b7411b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7c5ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7409e170 0x7f4b7411b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7c5ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 0x7f4b7411bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7c5ec700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7411ed50 con 0x7f4b7409e170 2023-09-30T22:27:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7c5ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7409c920 con 0x7f4b7409d860 2023-09-30T22:27:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7c5ec700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7409a150 con 0x7f4b74130ce0 2023-09-30T22:27:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7a388700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409d860 0x7f4b7411b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7a388700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409d860 0x7f4b7411b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58898/0 (socket says 172.21.15.154:58898) 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7a388700 1 -- 172.21.15.154:0/2580500077 learned_addr learned my addr 172.21.15.154:0/2580500077 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7ab89700 1 --2- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 0x7f4b7411bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b79b87700 1 --2- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7409e170 0x7f4b7411b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7a388700 1 -- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 msgr2=0x7f4b7411bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7a388700 1 --2- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 0x7f4b7411bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7a388700 1 -- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7409e170 msgr2=0x7f4b7411b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7a388700 1 --2- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7409e170 0x7f4b7411b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7a388700 1 -- 172.21.15.154:0/2580500077 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7000b5a0 con 0x7f4b7409d860 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.493+0000 7f4b7a388700 1 --2- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409d860 0x7f4b7411b230 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000d9d0 tx=0x7f4b7000dce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:22.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.494+0000 7f4b6affd700 1 -- 172.21.15.154:0/2580500077 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70012070 con 0x7f4b7409d860 2023-09-30T22:27:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.494+0000 7f4b6affd700 1 -- 172.21.15.154:0/2580500077 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7000de00 con 0x7f4b7409d860 2023-09-30T22:27:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.494+0000 7f4b6affd700 1 -- 172.21.15.154:0/2580500077 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70004270 con 0x7f4b7409d860 2023-09-30T22:27:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.494+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/2580500077 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b64011d40 con 0x7f4b7409d860 2023-09-30T22:27:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.494+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/2580500077 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c009a70 con 0x7f4b7409d860 2023-09-30T22:27:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.495+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/2580500077 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b740710b0 con 0x7f4b7409d860 2023-09-30T22:27:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.495+0000 7f4b6affd700 1 -- 172.21.15.154:0/2580500077 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b700043d0 con 0x7f4b7409d860 2023-09-30T22:27:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.495+0000 7f4b6affd700 1 -- 172.21.15.154:0/2580500077 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b7003ecd0 con 0x7f4b7409d860 2023-09-30T22:27:22.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.500+0000 7f4b6affd700 1 -- 172.21.15.154:0/2580500077 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b70020770 con 0x7f4b7409d860 2023-09-30T22:27:22.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.623+0000 7f3bda0e4700 1 -- 172.21.15.154:0/1750124422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3bd4120350 con 0x7f3bd41300a0 2023-09-30T22:27:22.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.624+0000 7f3bbbfff700 1 -- 172.21.15.154:0/1750124422 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bd4120350 con 0x7f3bd41300a0 2023-09-30T22:27:22.625 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.626+0000 7f3bda0e4700 1 -- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd41300a0 msgr2=0x7f3bd411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.626+0000 7f3bda0e4700 1 --2- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd41300a0 0x7f3bd411da40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400ec10 tx=0x7f3bc400ef20 comp rx=0 tx=0).stop 2023-09-30T22:27:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.626+0000 7f3bda0e4700 1 -- 172.21.15.154:0/1750124422 shutdown_connections 2023-09-30T22:27:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.626+0000 7f3bda0e4700 1 --2- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bd4133ad0 0x7f3bd411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.626+0000 7f3bda0e4700 1 --2- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bd41300a0 0x7f3bd411da40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.626+0000 7f3bda0e4700 1 --2- 172.21.15.154:0/1750124422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3bd4130bc0 0x7f3bd411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.626+0000 7f3bda0e4700 1 -- 172.21.15.154:0/1750124422 >> 172.21.15.154:0/1750124422 conn(0x7f3bd4099c40 msgr2=0x7f3bd412e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.626+0000 7f3bda0e4700 1 -- 172.21.15.154:0/1750124422 shutdown_connections 2023-09-30T22:27:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.626+0000 7f3bda0e4700 1 -- 172.21.15.154:0/1750124422 wait complete. 2023-09-30T22:27:22.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.649+0000 7f968b578700 1 -- 172.21.15.154:0/4034299745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9684125f80 con 0x7f96840a0a70 2023-09-30T22:27:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.649+0000 7f9679ffb700 1 -- 172.21.15.154:0/4034299745 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f968001a360 con 0x7f96840a0a70 2023-09-30T22:27:22.650 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.651+0000 7f968b578700 1 -- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96840a0a70 msgr2=0x7f9684122870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.651+0000 7f968b578700 1 --2- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96840a0a70 0x7f9684122870 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f968000e9e0 tx=0x7f968000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.652+0000 7f968b578700 1 -- 172.21.15.154:0/4034299745 shutdown_connections 2023-09-30T22:27:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.652+0000 7f968b578700 1 --2- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9684134120 0x7f96841232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.652+0000 7f968b578700 1 --2- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96840a0a70 0x7f9684122870 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.652+0000 7f968b578700 1 --2- 172.21.15.154:0/4034299745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96840a1380 0x7f9684122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.652+0000 7f968b578700 1 -- 172.21.15.154:0/4034299745 >> 172.21.15.154:0/4034299745 conn(0x7f96840a6610 msgr2=0x7f96840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.652+0000 7f968b578700 1 -- 172.21.15.154:0/4034299745 shutdown_connections 2023-09-30T22:27:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.652+0000 7f968b578700 1 -- 172.21.15.154:0/4034299745 wait complete. 2023-09-30T22:27:22.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:22.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.694+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/2580500077 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b7404f2a0 con 0x7f4b7409d860 2023-09-30T22:27:22.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.694+0000 7f4b6affd700 1 -- 172.21.15.154:0/2580500077 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b7001d070 con 0x7f4b7409d860 2023-09-30T22:27:22.696 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:22.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.696+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409d860 msgr2=0x7f4b7411b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:22.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.696+0000 7f4b7c5ec700 1 --2- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409d860 0x7f4b7411b230 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000d9d0 tx=0x7f4b7000dce0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.696+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/2580500077 shutdown_connections 2023-09-30T22:27:22.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.696+0000 7f4b7c5ec700 1 --2- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b74130ce0 0x7f4b7411bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.696+0000 7f4b7c5ec700 1 --2- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b7409d860 0x7f4b7411b230 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.696+0000 7f4b7c5ec700 1 --2- 172.21.15.154:0/2580500077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7409e170 0x7f4b7411b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:22.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.696+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/2580500077 >> 172.21.15.154:0/2580500077 conn(0x7f4b74099c40 msgr2=0x7f4b7412df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:22.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.696+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/2580500077 shutdown_connections 2023-09-30T22:27:22.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:22.696+0000 7f4b7c5ec700 1 -- 172.21.15.154:0/2580500077 wait complete. 2023-09-30T22:27:22.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:23.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.194+0000 7f248902c700 1 Processor -- start 2023-09-30T22:27:23.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.194+0000 7f248902c700 1 -- start start 2023-09-30T22:27:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.194+0000 7f248902c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2484133ad0 0x7f2484133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.194+0000 7f248902c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.194+0000 7f248902c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248406b2d0 con 0x7f24841300a0 2023-09-30T22:27:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.194+0000 7f248902c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2484133610 con 0x7f2484133ad0 2023-09-30T22:27:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.194+0000 7f248902c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248409a500 con 0x7f2484130bc0 2023-09-30T22:27:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2482d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2484133ad0 0x7f2484133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f248359e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f248359e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58912/0 (socket says 172.21.15.154:58912) 2023-09-30T22:27:23.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2482d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2484133ad0 0x7f2484133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40032/0 (socket says 172.21.15.154:40032) 2023-09-30T22:27:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f248359e700 1 -- 172.21.15.154:0/3831459994 learned_addr learned my addr 172.21.15.154:0/3831459994 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2482d9d700 1 -- 172.21.15.154:0/3831459994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 msgr2=0x7f248413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2482d9d700 1 --2- 172.21.15.154:0/3831459994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2482d9d700 1 -- 172.21.15.154:0/3831459994 >> v1:172.21.15.154:6789/0 conn(0x7f24841300a0 legacy=0x7f24841304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2482d9d700 1 -- 172.21.15.154:0/3831459994 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24841338b0 con 0x7f2484133ad0 2023-09-30T22:27:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f248359e700 1 --2- 172.21.15.154:0/3831459994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2482d9d700 1 --2- 172.21.15.154:0/3831459994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2484133ad0 0x7f2484133ea0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f2478009840 tx=0x7f2478009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b609c5d99f144549 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2481d9b700 1 -- 172.21.15.154:0/3831459994 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478011830 con 0x7f2484133ad0 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2481d9b700 1 -- 172.21.15.154:0/3831459994 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2478011990 con 0x7f2484133ad0 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.195+0000 7f2481d9b700 1 -- 172.21.15.154:0/3831459994 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478011d20 con 0x7f2484133ad0 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.196+0000 7f248902c700 1 -- 172.21.15.154:0/3831459994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2484133ad0 msgr2=0x7f2484133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.196+0000 7f248902c700 1 --2- 172.21.15.154:0/3831459994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2484133ad0 0x7f2484133ea0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f2478009840 tx=0x7f2478009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.196+0000 7f248902c700 1 -- 172.21.15.154:0/3831459994 shutdown_connections 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.196+0000 7f248902c700 1 --2- 172.21.15.154:0/3831459994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.196+0000 7f248902c700 1 --2- 172.21.15.154:0/3831459994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2484133ad0 0x7f2484133ea0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.196+0000 7f248902c700 1 -- 172.21.15.154:0/3831459994 >> 172.21.15.154:0/3831459994 conn(0x7f2484099c40 msgr2=0x7f24840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.196+0000 7f248902c700 1 -- 172.21.15.154:0/3831459994 shutdown_connections 2023-09-30T22:27:23.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.196+0000 7f248902c700 1 -- 172.21.15.154:0/3831459994 wait complete. 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f248902c700 1 Processor -- start 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f248902c700 1 -- start start 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f248902c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841300a0 0x7f248411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f248902c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f248902c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2484133ad0 0x7f248411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f248902c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2484120e00 con 0x7f24841300a0 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f248902c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248412d580 con 0x7f2484130bc0 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f248902c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f248412dd00 con 0x7f2484133ad0 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f2482d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841300a0 0x7f248411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f248259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f2482d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841300a0 0x7f248411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40042/0 (socket says 172.21.15.154:40042) 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.197+0000 7f2482d9d700 1 -- 172.21.15.154:0/2049800679 learned_addr learned my addr 172.21.15.154:0/2049800679 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f248359e700 1 --2- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2484133ad0 0x7f248411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f2482d9d700 1 -- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2484133ad0 msgr2=0x7f248411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f2482d9d700 1 --2- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2484133ad0 0x7f248411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f2482d9d700 1 -- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 msgr2=0x7f248411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f2482d9d700 1 --2- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f2482d9d700 1 -- 172.21.15.154:0/2049800679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c009b30 con 0x7f24841300a0 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f248259c700 1 --2- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f2482d9d700 1 --2- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841300a0 0x7f248411da40 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f24780090b0 tx=0x7f2478004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f246b7fe700 1 -- 172.21.15.154:0/2049800679 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2478004400 con 0x7f24841300a0 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f246b7fe700 1 -- 172.21.15.154:0/2049800679 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247801f070 con 0x7f24841300a0 2023-09-30T22:27:23.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f248902c700 1 -- 172.21.15.154:0/2049800679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24780094a0 con 0x7f24841300a0 2023-09-30T22:27:23.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f246b7fe700 1 -- 172.21.15.154:0/2049800679 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24780038e0 con 0x7f24841300a0 2023-09-30T22:27:23.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.198+0000 7f248902c700 1 -- 172.21.15.154:0/2049800679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24840721b0 con 0x7f24841300a0 2023-09-30T22:27:23.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.199+0000 7f246b7fe700 1 -- 172.21.15.154:0/2049800679 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2478021030 con 0x7f24841300a0 2023-09-30T22:27:23.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.199+0000 7f246b7fe700 1 -- 172.21.15.154:0/2049800679 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2478040900 con 0x7f24841300a0 2023-09-30T22:27:23.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.199+0000 7f248902c700 1 -- 172.21.15.154:0/2049800679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248404f2a0 con 0x7f24841300a0 2023-09-30T22:27:23.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.204+0000 7f246b7fe700 1 -- 172.21.15.154:0/2049800679 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2478015080 con 0x7f24841300a0 2023-09-30T22:27:23.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.387+0000 7f248902c700 1 -- 172.21.15.154:0/2049800679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f248411fea0 con 0x7f24841300a0 2023-09-30T22:27:23.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.387+0000 7f246b7fe700 1 -- 172.21.15.154:0/2049800679 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24780239c0 con 0x7f24841300a0 2023-09-30T22:27:23.448 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:23.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.389+0000 7f248902c700 1 -- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841300a0 msgr2=0x7f248411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.389+0000 7f248902c700 1 --2- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841300a0 0x7f248411da40 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f24780090b0 tx=0x7f2478004750 comp rx=0 tx=0).stop 2023-09-30T22:27:23.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.389+0000 7f248902c700 1 -- 172.21.15.154:0/2049800679 shutdown_connections 2023-09-30T22:27:23.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.389+0000 7f248902c700 1 --2- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2484133ad0 0x7f248411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.389+0000 7f248902c700 1 --2- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24841300a0 0x7f248411da40 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.389+0000 7f248902c700 1 --2- 172.21.15.154:0/2049800679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2484130bc0 0x7f248411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.389+0000 7f248902c700 1 -- 172.21.15.154:0/2049800679 >> 172.21.15.154:0/2049800679 conn(0x7f2484099c40 msgr2=0x7f2484132190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.389+0000 7f248902c700 1 -- 172.21.15.154:0/2049800679 shutdown_connections 2023-09-30T22:27:23.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.389+0000 7f248902c700 1 -- 172.21.15.154:0/2049800679 wait complete. 2023-09-30T22:27:23.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:23.640 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:23.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:23.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:23.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.772+0000 7fd8038ea700 1 Processor -- start 2023-09-30T22:27:23.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd8038ea700 1 -- start start 2023-09-30T22:27:23.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd8038ea700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7fc099e20 0x7fd7fc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd8038ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc130a60 0x7fd7fc138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd8038ea700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc099a60 con 0x7fd7fc09a730 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd8038ea700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc09bf50 con 0x7fd7fc099e20 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd8038ea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc09b230 con 0x7fd7fc130a60 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd801e87700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc130a60 0x7fd7fc138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd801686700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7fc099e20 0x7fd7fc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd801e87700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc130a60 0x7fd7fc138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57270/0 (socket says 172.21.15.154:57270) 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd801686700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7fc099e20 0x7fd7fc09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40044/0 (socket says 172.21.15.154:40044) 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.773+0000 7fd801e87700 1 -- 172.21.15.154:0/3476880373 learned_addr learned my addr 172.21.15.154:0/3476880373 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.774+0000 7fd801e87700 1 -- 172.21.15.154:0/3476880373 >> v2:172.21.15.154:3300/0 conn(0x7fd7fc099e20 msgr2=0x7fd7fc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.774+0000 7fd801e87700 1 --2- 172.21.15.154:0/3476880373 >> v2:172.21.15.154:3300/0 conn(0x7fd7fc099e20 0x7fd7fc09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.774+0000 7fd801e87700 1 -- 172.21.15.154:0/3476880373 >> v1:172.21.15.154:6789/0 conn(0x7fd7fc09a730 legacy=0x7fd7fc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.774+0000 7fd801e87700 1 -- 172.21.15.154:0/3476880373 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc09bb90 con 0x7fd7fc130a60 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.774+0000 7fd801e87700 1 --2- 172.21.15.154:0/3476880373 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc130a60 0x7fd7fc138690 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009e50 tx=0x7fd7f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46158b5bc88b696f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.774+0000 7fd7f3fff700 1 -- 172.21.15.154:0/3476880373 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400e070 con 0x7fd7fc130a60 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.774+0000 7fd7f3fff700 1 -- 172.21.15.154:0/3476880373 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f400b910 con 0x7fd7fc130a60 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.774+0000 7fd7f3fff700 1 -- 172.21.15.154:0/3476880373 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400bcc0 con 0x7fd7fc130a60 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.775+0000 7fd8038ea700 1 -- 172.21.15.154:0/3476880373 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc130a60 msgr2=0x7fd7fc138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.775+0000 7fd8038ea700 1 --2- 172.21.15.154:0/3476880373 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc130a60 0x7fd7fc138690 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009e50 tx=0x7fd7f400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.775+0000 7fd8038ea700 1 -- 172.21.15.154:0/3476880373 shutdown_connections 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.775+0000 7fd8038ea700 1 --2- 172.21.15.154:0/3476880373 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc130a60 0x7fd7fc138690 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.775+0000 7fd8038ea700 1 --2- 172.21.15.154:0/3476880373 >> v2:172.21.15.154:3300/0 conn(0x7fd7fc099e20 0x7fd7fc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.775+0000 7fd8038ea700 1 -- 172.21.15.154:0/3476880373 >> 172.21.15.154:0/3476880373 conn(0x7fd7fc0a2980 msgr2=0x7fd7fc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.775+0000 7fd8038ea700 1 -- 172.21.15.154:0/3476880373 shutdown_connections 2023-09-30T22:27:23.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.775+0000 7fd8038ea700 1 -- 172.21.15.154:0/3476880373 wait complete. 2023-09-30T22:27:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd8038ea700 1 Processor -- start 2023-09-30T22:27:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd8038ea700 1 -- start start 2023-09-30T22:27:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd8038ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc099e20 0x7fd7fc1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd8038ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7fc09a730 0x7fd7fc1c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd8038ea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7fc130a60 0x7fd7fc1c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd8038ea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc1c7580 con 0x7fd7fc09a730 2023-09-30T22:27:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd8038ea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc09b470 con 0x7fd7fc130a60 2023-09-30T22:27:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd8038ea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc118f20 con 0x7fd7fc099e20 2023-09-30T22:27:23.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd800e85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7fc09a730 0x7fd7fc1c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd801686700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc099e20 0x7fd7fc1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd800e85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7fc09a730 0x7fd7fc1c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40056/0 (socket says 172.21.15.154:40056) 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.776+0000 7fd800e85700 1 -- 172.21.15.154:0/2016914612 learned_addr learned my addr 172.21.15.154:0/2016914612 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd801e87700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7fc130a60 0x7fd7fc1c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd800e85700 1 -- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc099e20 msgr2=0x7fd7fc1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd800e85700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc099e20 0x7fd7fc1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd800e85700 1 -- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7fc130a60 msgr2=0x7fd7fc1c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd800e85700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7fc130a60 0x7fd7fc1c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd800e85700 1 -- 172.21.15.154:0/2016914612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4009b30 con 0x7fd7fc09a730 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd801686700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc099e20 0x7fd7fc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd801e87700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7fc130a60 0x7fd7fc1c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:23.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd800e85700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7fc09a730 0x7fd7fc1c77e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00c4e0 tx=0x7fd7ec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd7f1ffb700 1 -- 172.21.15.154:0/2016914612 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec0052d0 con 0x7fd7fc09a730 2023-09-30T22:27:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd7f1ffb700 1 -- 172.21.15.154:0/2016914612 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec005430 con 0x7fd7fc09a730 2023-09-30T22:27:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd7f1ffb700 1 -- 172.21.15.154:0/2016914612 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec0038c0 con 0x7fd7fc09a730 2023-09-30T22:27:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd8038ea700 1 -- 172.21.15.154:0/2016914612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc119990 con 0x7fd7fc09a730 2023-09-30T22:27:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.777+0000 7fd8038ea700 1 -- 172.21.15.154:0/2016914612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc13a1a0 con 0x7fd7fc09a730 2023-09-30T22:27:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.778+0000 7fd7f1ffb700 1 -- 172.21.15.154:0/2016914612 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7ec003a20 con 0x7fd7fc09a730 2023-09-30T22:27:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.778+0000 7fd7f1ffb700 1 -- 172.21.15.154:0/2016914612 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd7ec03eb50 con 0x7fd7fc09a730 2023-09-30T22:27:23.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.778+0000 7fd8038ea700 1 -- 172.21.15.154:0/2016914612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc04f2a0 con 0x7fd7fc09a730 2023-09-30T22:27:23.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.783+0000 7fd7f1ffb700 1 -- 172.21.15.154:0/2016914612 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7ec017080 con 0x7fd7fc09a730 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.812+0000 7f2b7689d700 1 Processor -- start 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.812+0000 7f2b7689d700 1 -- start start 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b7689d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b7009f350 0x7f2b70136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b7689d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2b701371c0 0x7f2b701395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b7689d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7009c970 con 0x7f2b7009e870 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b7689d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b700a0920 con 0x7f2b701371c0 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b7689d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7009f9c0 con 0x7f2b7009f350 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b6ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2b7009e870 0x7f2b7009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43166/0 (socket says 172.21.15.154:43166) 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b7009f350 0x7f2b70136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b6ffff700 1 -- 172.21.15.154:0/1419781618 learned_addr learned my addr 172.21.15.154:0/1419781618 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:23.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b74e3a700 1 --2- 172.21.15.154:0/1419781618 >> v2:172.21.15.154:3300/0 conn(0x7f2b701371c0 0x7f2b701395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b74e3a700 1 -- 172.21.15.154:0/1419781618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b7009f350 msgr2=0x7f2b70136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b74e3a700 1 --2- 172.21.15.154:0/1419781618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b7009f350 0x7f2b70136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b74e3a700 1 -- 172.21.15.154:0/1419781618 >> v1:172.21.15.154:6789/0 conn(0x7f2b7009e870 legacy=0x7f2b7009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b74e3a700 1 -- 172.21.15.154:0/1419781618 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7009bab0 con 0x7f2b701371c0 2023-09-30T22:27:23.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.813+0000 7f2b6f7fe700 1 --2- 172.21.15.154:0/1419781618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b7009f350 0x7f2b70136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b74e3a700 1 --2- 172.21.15.154:0/1419781618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b701371c0 0x7f2b701395a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009d90 tx=0x7f2b6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0e15ed514c442d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b6effd700 1 -- 172.21.15.154:0/1419781618 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6800e070 con 0x7f2b701371c0 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b6effd700 1 -- 172.21.15.154:0/1419781618 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6800bb20 con 0x7f2b701371c0 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b6effd700 1 -- 172.21.15.154:0/1419781618 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b68012430 con 0x7f2b701371c0 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b7689d700 1 -- 172.21.15.154:0/1419781618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b701371c0 msgr2=0x7f2b701395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b7689d700 1 --2- 172.21.15.154:0/1419781618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b701371c0 0x7f2b701395a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009d90 tx=0x7f2b6800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b7689d700 1 -- 172.21.15.154:0/1419781618 shutdown_connections 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b7689d700 1 --2- 172.21.15.154:0/1419781618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b701371c0 0x7f2b701395a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b7689d700 1 --2- 172.21.15.154:0/1419781618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b7009f350 0x7f2b70136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b7689d700 1 -- 172.21.15.154:0/1419781618 >> 172.21.15.154:0/1419781618 conn(0x7f2b700a4430 msgr2=0x7f2b700a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b7689d700 1 -- 172.21.15.154:0/1419781618 shutdown_connections 2023-09-30T22:27:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.814+0000 7f2b7689d700 1 -- 172.21.15.154:0/1419781618 wait complete. 2023-09-30T22:27:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.815+0000 7f2b7689d700 1 Processor -- start 2023-09-30T22:27:23.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.815+0000 7f2b7689d700 1 -- start start 2023-09-30T22:27:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b7689d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b7009e870 0x7f2b7011f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b7689d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b7009f350 0x7f2b7011fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b7689d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b701371c0 0x7f2b701200c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b7689d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701211c0 con 0x7f2b7009f350 2023-09-30T22:27:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b7689d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701354a0 con 0x7f2b701371c0 2023-09-30T22:27:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b7689d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70122df0 con 0x7f2b7009e870 2023-09-30T22:27:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b7009e870 0x7f2b7011f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b7009f350 0x7f2b7011fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b7009e870 0x7f2b7011f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:57298/0 (socket says 172.21.15.154:57298) 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6ffff700 1 -- 172.21.15.154:0/3481219365 learned_addr learned my addr 172.21.15.154:0/3481219365 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b74e3a700 1 --2- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b701371c0 0x7f2b701200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6ffff700 1 -- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b701371c0 msgr2=0x7f2b701200c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6ffff700 1 --2- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b701371c0 0x7f2b701200c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6ffff700 1 -- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b7009f350 msgr2=0x7f2b7011fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6ffff700 1 --2- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b7009f350 0x7f2b7011fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6ffff700 1 -- 172.21.15.154:0/3481219365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640094a0 con 0x7f2b7009e870 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.816+0000 7f2b6f7fe700 1 --2- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b7009f350 0x7f2b7011fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.817+0000 7f2b6ffff700 1 --2- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b7009e870 0x7f2b7011f640 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c520 tx=0x7f2b6000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.817+0000 7f2b6cff9700 1 -- 172.21.15.154:0/3481219365 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60005d70 con 0x7f2b7009e870 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.817+0000 7f2b6cff9700 1 -- 172.21.15.154:0/3481219365 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b600070d0 con 0x7f2b7009e870 2023-09-30T22:27:23.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.817+0000 7f2b7689d700 1 -- 172.21.15.154:0/3481219365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b68009a70 con 0x7f2b7009e870 2023-09-30T22:27:23.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.817+0000 7f2b6cff9700 1 -- 172.21.15.154:0/3481219365 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60007440 con 0x7f2b7009e870 2023-09-30T22:27:23.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.817+0000 7f2b7689d700 1 -- 172.21.15.154:0/3481219365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7009dba0 con 0x7f2b7009e870 2023-09-30T22:27:23.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.818+0000 7f2b6cff9700 1 -- 172.21.15.154:0/3481219365 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b600075a0 con 0x7f2b7009e870 2023-09-30T22:27:23.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.818+0000 7f2b7689d700 1 -- 172.21.15.154:0/3481219365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7004f2a0 con 0x7f2b7009e870 2023-09-30T22:27:23.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.818+0000 7f2b6cff9700 1 -- 172.21.15.154:0/3481219365 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2b6003ea00 con 0x7f2b7009e870 2023-09-30T22:27:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.827+0000 7f2b6cff9700 1 -- 172.21.15.154:0/3481219365 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b60019b40 con 0x7f2b7009e870 2023-09-30T22:27:23.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.856+0000 7fc9a70ec700 1 Processor -- start 2023-09-30T22:27:23.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.856+0000 7fc9a70ec700 1 -- start start 2023-09-30T22:27:23.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a70ec700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9a00a0a70 0x7fc9a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a70ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 0x7fc9a0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a70ec700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a009dc00 con 0x7fc9a0133f50 2023-09-30T22:27:23.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a70ec700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a009ea60 con 0x7fc9a00a0a70 2023-09-30T22:27:23.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a70ec700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a009dec0 con 0x7fc9a00a1380 2023-09-30T22:27:23.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a4e88700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9a00a0a70 0x7fc9a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a4e88700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9a00a0a70 0x7fc9a00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40072/0 (socket says 172.21.15.154:40072) 2023-09-30T22:27:23.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a4e88700 1 -- 172.21.15.154:0/1008093078 learned_addr learned my addr 172.21.15.154:0/1008093078 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:23.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc99ffff700 1 --2- 172.21.15.154:0/1008093078 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 0x7fc9a0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a4e88700 1 -- 172.21.15.154:0/1008093078 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 msgr2=0x7fc9a0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:23.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a4e88700 1 --2- 172.21.15.154:0/1008093078 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 0x7fc9a0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a4e88700 1 -- 172.21.15.154:0/1008093078 >> v1:172.21.15.154:6789/0 conn(0x7fc9a0133f50 legacy=0x7fc9a013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc9a4e88700 1 -- 172.21.15.154:0/1008093078 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a009e6a0 con 0x7fc9a00a0a70 2023-09-30T22:27:23.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.857+0000 7fc99f7fe700 1 -- 172.21.15.154:0/1008093078 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656690770 0 0) 0x7fc9a009dc00 con 0x7fc9a0133f50 2023-09-30T22:27:23.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc9a4e88700 1 --2- 172.21.15.154:0/1008093078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a00a0a70 0x7fc9a00a0e40 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fc9940098f0 tx=0x7fc994009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d14624ad6312a29 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc99f7fe700 1 -- 172.21.15.154:0/1008093078 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994011830 con 0x7fc9a00a0a70 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc99f7fe700 1 -- 172.21.15.154:0/1008093078 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994011990 con 0x7fc9a00a0a70 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc99f7fe700 1 -- 172.21.15.154:0/1008093078 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994011d20 con 0x7fc9a00a0a70 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc9a70ec700 1 -- 172.21.15.154:0/1008093078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a00a0a70 msgr2=0x7fc9a00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc9a70ec700 1 --2- 172.21.15.154:0/1008093078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a00a0a70 0x7fc9a00a0e40 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fc9940098f0 tx=0x7fc994009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc9a70ec700 1 -- 172.21.15.154:0/1008093078 shutdown_connections 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc9a70ec700 1 --2- 172.21.15.154:0/1008093078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a00a0a70 0x7fc9a00a0e40 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc9a70ec700 1 --2- 172.21.15.154:0/1008093078 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 0x7fc9a0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc9a70ec700 1 -- 172.21.15.154:0/1008093078 >> 172.21.15.154:0/1008093078 conn(0x7fc9a00a6610 msgr2=0x7fc9a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc9a70ec700 1 -- 172.21.15.154:0/1008093078 shutdown_connections 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.858+0000 7fc9a70ec700 1 -- 172.21.15.154:0/1008093078 wait complete. 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.859+0000 7fc9a70ec700 1 Processor -- start 2023-09-30T22:27:23.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.859+0000 7fc9a70ec700 1 -- start start 2023-09-30T22:27:23.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a70ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9a00a0a70 0x7fc9a0122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a70ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 0x7fc9a0122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a70ec700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0133f50 0x7fc9a01233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a70ec700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0125e10 con 0x7fc9a0133f50 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a70ec700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00a03e0 con 0x7fc9a00a0a70 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a70ec700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0133960 con 0x7fc9a00a1380 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a4e88700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9a00a0a70 0x7fc9a0122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a5689700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0133f50 0x7fc9a01233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a4e88700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9a00a0a70 0x7fc9a0122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58956/0 (socket says 172.21.15.154:58956) 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a4e88700 1 -- 172.21.15.154:0/491520067 learned_addr learned my addr 172.21.15.154:0/491520067 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc99ffff700 1 --2- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 0x7fc9a0122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a4e88700 1 -- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 msgr2=0x7fc9a0122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a4e88700 1 --2- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 0x7fc9a0122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a4e88700 1 -- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0133f50 msgr2=0x7fc9a01233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a4e88700 1 --2- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0133f50 0x7fc9a01233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.860+0000 7fc9a4e88700 1 -- 172.21.15.154:0/491520067 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994009550 con 0x7fc9a00a0a70 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.861+0000 7fc9a4e88700 1 --2- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9a00a0a70 0x7fc9a0122970 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc994009c40 tx=0x7fc994004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.861+0000 7fc99d7fa700 1 -- 172.21.15.154:0/491520067 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994004300 con 0x7fc9a00a0a70 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.861+0000 7fc99d7fa700 1 -- 172.21.15.154:0/491520067 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99401f070 con 0x7fc9a00a0a70 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.861+0000 7fc9a70ec700 1 -- 172.21.15.154:0/491520067 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a01333b0 con 0x7fc9a00a0a70 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.861+0000 7fc99d7fa700 1 -- 172.21.15.154:0/491520067 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940036a0 con 0x7fc9a00a0a70 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.861+0000 7fc9a70ec700 1 -- 172.21.15.154:0/491520067 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a01244a0 con 0x7fc9a00a0a70 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.862+0000 7fc9a70ec700 1 -- 172.21.15.154:0/491520067 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a0124690 con 0x7fc9a00a0a70 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.862+0000 7fc99d7fa700 1 -- 172.21.15.154:0/491520067 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc994021030 con 0x7fc9a00a0a70 2023-09-30T22:27:23.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.862+0000 7fc99d7fa700 1 -- 172.21.15.154:0/491520067 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc994040990 con 0x7fc9a00a0a70 2023-09-30T22:27:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.871+0000 7fc99d7fa700 1 -- 172.21.15.154:0/491520067 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9940199a0 con 0x7fc9a00a0a70 2023-09-30T22:27:23.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.990+0000 7fd8038ea700 1 -- 172.21.15.154:0/2016914612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd7fc072400 con 0x7fd7fc09a730 2023-09-30T22:27:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.991+0000 7fd7f1ffb700 1 -- 172.21.15.154:0/2016914612 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7ec018260 con 0x7fd7fc09a730 2023-09-30T22:27:23.992 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:23.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.993+0000 7fd8038ea700 1 -- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7fc09a730 msgr2=0x7fd7fc1c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:23.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.993+0000 7fd8038ea700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7fc09a730 0x7fd7fc1c77e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00c4e0 tx=0x7fd7ec00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.993+0000 7fd8038ea700 1 -- 172.21.15.154:0/2016914612 shutdown_connections 2023-09-30T22:27:23.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.993+0000 7fd8038ea700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7fc130a60 0x7fd7fc1c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.993+0000 7fd8038ea700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd7fc099e20 0x7fd7fc1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.993+0000 7fd8038ea700 1 --2- 172.21.15.154:0/2016914612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7fc09a730 0x7fd7fc1c77e0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:23.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.993+0000 7fd8038ea700 1 -- 172.21.15.154:0/2016914612 >> 172.21.15.154:0/2016914612 conn(0x7fd7fc0a2980 msgr2=0x7fd7fc09f960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:23.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.993+0000 7fd8038ea700 1 -- 172.21.15.154:0/2016914612 shutdown_connections 2023-09-30T22:27:23.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:23.993+0000 7fd8038ea700 1 -- 172.21.15.154:0/2016914612 wait complete. 2023-09-30T22:27:24.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:24.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.025+0000 7f2b7689d700 1 -- 172.21.15.154:0/3481219365 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2b701219c0 con 0x7f2b7009e870 2023-09-30T22:27:24.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.026+0000 7f2b6cff9700 1 -- 172.21.15.154:0/3481219365 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b60017030 con 0x7f2b7009e870 2023-09-30T22:27:24.027 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.029+0000 7f2b7689d700 1 -- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b7009e870 msgr2=0x7f2b7011f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.029+0000 7f2b7689d700 1 --2- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b7009e870 0x7f2b7011f640 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c520 tx=0x7f2b6000c830 comp rx=0 tx=0).stop 2023-09-30T22:27:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.029+0000 7f2b7689d700 1 -- 172.21.15.154:0/3481219365 shutdown_connections 2023-09-30T22:27:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.029+0000 7f2b7689d700 1 --2- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b701371c0 0x7f2b701200c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.029+0000 7f2b7689d700 1 --2- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b7009e870 0x7f2b7011f640 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.029+0000 7f2b7689d700 1 --2- 172.21.15.154:0/3481219365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b7009f350 0x7f2b7011fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.029+0000 7f2b7689d700 1 -- 172.21.15.154:0/3481219365 >> 172.21.15.154:0/3481219365 conn(0x7f2b700a4430 msgr2=0x7f2b700a2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.029+0000 7f2b7689d700 1 -- 172.21.15.154:0/3481219365 shutdown_connections 2023-09-30T22:27:24.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.029+0000 7f2b7689d700 1 -- 172.21.15.154:0/3481219365 wait complete. 2023-09-30T22:27:24.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:24.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.073+0000 7fc9a70ec700 1 -- 172.21.15.154:0/491520067 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc9a01262e0 con 0x7fc9a00a0a70 2023-09-30T22:27:24.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.073+0000 7fc99d7fa700 1 -- 172.21.15.154:0/491520067 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc994015030 con 0x7fc9a00a0a70 2023-09-30T22:27:24.075 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:24.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.075+0000 7fc9a70ec700 1 -- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9a00a0a70 msgr2=0x7fc9a0122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.076+0000 7fc9a70ec700 1 --2- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9a00a0a70 0x7fc9a0122970 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc994009c40 tx=0x7fc994004750 comp rx=0 tx=0).stop 2023-09-30T22:27:24.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.076+0000 7fc9a70ec700 1 -- 172.21.15.154:0/491520067 shutdown_connections 2023-09-30T22:27:24.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.076+0000 7fc9a70ec700 1 --2- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9a0133f50 0x7fc9a01233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.076+0000 7fc9a70ec700 1 --2- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9a00a0a70 0x7fc9a0122970 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.076+0000 7fc9a70ec700 1 --2- 172.21.15.154:0/491520067 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9a00a1380 0x7fc9a0122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.076+0000 7fc9a70ec700 1 -- 172.21.15.154:0/491520067 >> 172.21.15.154:0/491520067 conn(0x7fc9a00a6610 msgr2=0x7fc9a009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.076+0000 7fc9a70ec700 1 -- 172.21.15.154:0/491520067 shutdown_connections 2023-09-30T22:27:24.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.076+0000 7fc9a70ec700 1 -- 172.21.15.154:0/491520067 wait complete. 2023-09-30T22:27:24.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:24.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:24.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f8732499700 1 Processor -- start 2023-09-30T22:27:24.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f8732499700 1 -- start start 2023-09-30T22:27:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f8732499700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f872c09d860 0x7f872c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f8732499700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f8732499700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f8732499700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872c131670 con 0x7f872c09d860 2023-09-30T22:27:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f8732499700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c09aaa0 con 0x7f872c130ce0 2023-09-30T22:27:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f8732499700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f872c09f870 con 0x7f872c09e170 2023-09-30T22:27:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f872bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f872c09d860 0x7f872c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f872b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f872bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f872c09d860 0x7f872c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40096/0 (socket says 172.21.15.154:40096) 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f872bfff700 1 -- 172.21.15.154:0/3312018321 learned_addr learned my addr 172.21.15.154:0/3312018321 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.574+0000 7f8730a36700 1 --2- 172.21.15.154:0/3312018321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872b7fe700 1 -- 172.21.15.154:0/3312018321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 msgr2=0x7f872c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872b7fe700 1 --2- 172.21.15.154:0/3312018321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872b7fe700 1 -- 172.21.15.154:0/3312018321 >> v2:172.21.15.154:3300/0 conn(0x7f872c09d860 msgr2=0x7f872c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872b7fe700 1 --2- 172.21.15.154:0/3312018321 >> v2:172.21.15.154:3300/0 conn(0x7f872c09d860 0x7f872c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872b7fe700 1 -- 172.21.15.154:0/3312018321 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c09b360 con 0x7f872c09e170 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872bfff700 1 --2- 172.21.15.154:0/3312018321 >> v2:172.21.15.154:3300/0 conn(0x7f872c09d860 0x7f872c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f8730a36700 1 --2- 172.21.15.154:0/3312018321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872b7fe700 1 --2- 172.21.15.154:0/3312018321 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c1307a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f872000bb10 tx=0x7f872000be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=893f68449eb189a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872affd700 1 -- 172.21.15.154:0/3312018321 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000dc30 con 0x7f872c09e170 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872affd700 1 -- 172.21.15.154:0/3312018321 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872000dd90 con 0x7f872c09e170 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f872affd700 1 -- 172.21.15.154:0/3312018321 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720010690 con 0x7f872c09e170 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f8732499700 1 -- 172.21.15.154:0/3312018321 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 msgr2=0x7f872c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f8732499700 1 --2- 172.21.15.154:0/3312018321 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c1307a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f872000bb10 tx=0x7f872000be20 comp rx=0 tx=0).stop 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f8732499700 1 -- 172.21.15.154:0/3312018321 shutdown_connections 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f8732499700 1 --2- 172.21.15.154:0/3312018321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f8732499700 1 --2- 172.21.15.154:0/3312018321 >> v2:172.21.15.154:3300/0 conn(0x7f872c09d860 0x7f872c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f8732499700 1 --2- 172.21.15.154:0/3312018321 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c1307a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.575+0000 7f8732499700 1 -- 172.21.15.154:0/3312018321 >> 172.21.15.154:0/3312018321 conn(0x7f872c099c40 msgr2=0x7f872c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.576+0000 7f8732499700 1 -- 172.21.15.154:0/3312018321 shutdown_connections 2023-09-30T22:27:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.576+0000 7f8732499700 1 -- 172.21.15.154:0/3312018321 wait complete. 2023-09-30T22:27:24.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.576+0000 7f8732499700 1 Processor -- start 2023-09-30T22:27:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f8732499700 1 -- start start 2023-09-30T22:27:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f8732499700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f872c09d860 0x7f872c11bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f8732499700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c11c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f8732499700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c11ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f8732499700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c11fb00 con 0x7f872c09d860 2023-09-30T22:27:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f8732499700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c11eed0 con 0x7f872c130ce0 2023-09-30T22:27:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f8732499700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0a22f0 con 0x7f872c09e170 2023-09-30T22:27:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f872c09d860 0x7f872c11bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f8730a36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c11ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f872c09d860 0x7f872c11bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40100/0 (socket says 172.21.15.154:40100) 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872bfff700 1 -- 172.21.15.154:0/1047529893 learned_addr learned my addr 172.21.15.154:0/1047529893 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872b7fe700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c11c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872bfff700 1 -- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 msgr2=0x7f872c11c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872bfff700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c11c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872bfff700 1 -- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 msgr2=0x7f872c11ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872bfff700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c11ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872bfff700 1 -- 172.21.15.154:0/1047529893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c009550 con 0x7f872c09d860 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f872b7fe700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c11c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:24.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.577+0000 7f8730a36700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c11ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.578+0000 7f872bfff700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f872c09d860 0x7f872c11bfe0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e930 tx=0x7f871c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.578+0000 7f8728ff9700 1 -- 172.21.15.154:0/1047529893 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00ee80 con 0x7f872c09d860 2023-09-30T22:27:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.578+0000 7f8728ff9700 1 -- 172.21.15.154:0/1047529893 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c004030 con 0x7f872c09d860 2023-09-30T22:27:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.578+0000 7f8728ff9700 1 -- 172.21.15.154:0/1047529893 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c0043c0 con 0x7f872c09d860 2023-09-30T22:27:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.578+0000 7f8732499700 1 -- 172.21.15.154:0/1047529893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8724009a70 con 0x7f872c09d860 2023-09-30T22:27:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.578+0000 7f8732499700 1 -- 172.21.15.154:0/1047529893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872000b740 con 0x7f872c09d860 2023-09-30T22:27:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.578+0000 7f8728ff9700 1 -- 172.21.15.154:0/1047529893 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f871c00c850 con 0x7f872c09d860 2023-09-30T22:27:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.579+0000 7f8728ff9700 1 -- 172.21.15.154:0/1047529893 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f871c03f8d0 con 0x7f872c09d860 2023-09-30T22:27:24.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.579+0000 7f8732499700 1 -- 172.21.15.154:0/1047529893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c11f680 con 0x7f872c09d860 2023-09-30T22:27:24.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.583+0000 7f8728ff9700 1 -- 172.21.15.154:0/1047529893 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f872c11f680 con 0x7f872c09d860 2023-09-30T22:27:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.767+0000 7f8732499700 1 -- 172.21.15.154:0/1047529893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f872c11f680 con 0x7f872c09d860 2023-09-30T22:27:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.767+0000 7f8728ff9700 1 -- 172.21.15.154:0/1047529893 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f872c11f680 con 0x7f872c09d860 2023-09-30T22:27:24.768 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.769+0000 7f8732499700 1 -- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f872c09d860 msgr2=0x7f872c11bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.769+0000 7f8732499700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f872c09d860 0x7f872c11bfe0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e930 tx=0x7f871c00ec40 comp rx=0 tx=0).stop 2023-09-30T22:27:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.769+0000 7f8732499700 1 -- 172.21.15.154:0/1047529893 shutdown_connections 2023-09-30T22:27:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.769+0000 7f8732499700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f872c130ce0 0x7f872c11ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.769+0000 7f8732499700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f872c09d860 0x7f872c11bfe0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.769+0000 7f8732499700 1 --2- 172.21.15.154:0/1047529893 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f872c09e170 0x7f872c11c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.769+0000 7f8732499700 1 -- 172.21.15.154:0/1047529893 >> 172.21.15.154:0/1047529893 conn(0x7f872c099c40 msgr2=0x7f872c130110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.769+0000 7f8732499700 1 -- 172.21.15.154:0/1047529893 shutdown_connections 2023-09-30T22:27:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:24.769+0000 7f8732499700 1 -- 172.21.15.154:0/1047529893 wait complete. 2023-09-30T22:27:24.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:25.007 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:25.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:25.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:25.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.141+0000 7f4347785700 1 Processor -- start 2023-09-30T22:27:25.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.141+0000 7f4347785700 1 -- start start 2023-09-30T22:27:25.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.141+0000 7f4347785700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4340133900 0x7f4340133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.141+0000 7f4347785700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.141+0000 7f4347785700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434009a760 con 0x7f4340134210 2023-09-30T22:27:25.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.141+0000 7f4347785700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43401336e0 con 0x7f4340133900 2023-09-30T22:27:25.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.141+0000 7f4347785700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434009a080 con 0x7f43400a10b0 2023-09-30T22:27:25.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345521700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4340133900 0x7f4340133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345d22700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345d22700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434013b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:58992/0 (socket says 172.21.15.154:58992) 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345521700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4340133900 0x7f4340133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40104/0 (socket says 172.21.15.154:40104) 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345d22700 1 -- 172.21.15.154:0/4132525784 learned_addr learned my addr 172.21.15.154:0/4132525784 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345521700 1 -- 172.21.15.154:0/4132525784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 msgr2=0x7f434013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345521700 1 --2- 172.21.15.154:0/4132525784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345521700 1 -- 172.21.15.154:0/4132525784 >> v1:172.21.15.154:6789/0 conn(0x7f4340134210 legacy=0x7f43400a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345521700 1 -- 172.21.15.154:0/4132525784 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400a23e0 con 0x7f4340133900 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4345521700 1 --2- 172.21.15.154:0/4132525784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 0x7f4340133cd0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f433c009820 tx=0x7f433c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551d386d0e537469 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4337fff700 1 -- 172.21.15.154:0/4132525784 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c005e30 con 0x7f4340133900 2023-09-30T22:27:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4337fff700 1 -- 172.21.15.154:0/4132525784 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c006030 con 0x7f4340133900 2023-09-30T22:27:25.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.142+0000 7f4337fff700 1 -- 172.21.15.154:0/4132525784 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c0063e0 con 0x7f4340133900 2023-09-30T22:27:25.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.143+0000 7f4347785700 1 -- 172.21.15.154:0/4132525784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 msgr2=0x7f4340133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.143+0000 7f4347785700 1 --2- 172.21.15.154:0/4132525784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 0x7f4340133cd0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f433c009820 tx=0x7f433c009b30 comp rx=0 tx=0).stop 2023-09-30T22:27:25.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.143+0000 7f4347785700 1 -- 172.21.15.154:0/4132525784 shutdown_connections 2023-09-30T22:27:25.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.143+0000 7f4347785700 1 --2- 172.21.15.154:0/4132525784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.143+0000 7f4347785700 1 --2- 172.21.15.154:0/4132525784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 0x7f4340133cd0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.143+0000 7f4347785700 1 -- 172.21.15.154:0/4132525784 >> 172.21.15.154:0/4132525784 conn(0x7f43400a2980 msgr2=0x7f43400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:25.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.143+0000 7f4347785700 1 -- 172.21.15.154:0/4132525784 shutdown_connections 2023-09-30T22:27:25.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.143+0000 7f4347785700 1 -- 172.21.15.154:0/4132525784 wait complete. 2023-09-30T22:27:25.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4347785700 1 Processor -- start 2023-09-30T22:27:25.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4347785700 1 -- start start 2023-09-30T22:27:25.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4347785700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434011d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4347785700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 0x7f434011dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4347785700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4340134210 0x7f434011e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4347785700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434011ecb0 con 0x7f4340133900 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4347785700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4340121120 con 0x7f43400a10b0 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4347785700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4340121300 con 0x7f4340134210 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4344d20700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 0x7f434011dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4344d20700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 0x7f434011dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40114/0 (socket says 172.21.15.154:40114) 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.145+0000 7f4344d20700 1 -- 172.21.15.154:0/449607998 learned_addr learned my addr 172.21.15.154:0/449607998 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4345521700 1 --2- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434011d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4344d20700 1 -- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4340134210 msgr2=0x7f434011e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4344d20700 1 --2- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4340134210 0x7f434011e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4344d20700 1 -- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 msgr2=0x7f434011d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4344d20700 1 --2- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434011d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4344d20700 1 -- 172.21.15.154:0/449607998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c009430 con 0x7f4340133900 2023-09-30T22:27:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4345521700 1 --2- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434011d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4344d20700 1 --2- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 0x7f434011dd20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f433000c510 tx=0x7f433000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4335ffb700 1 -- 172.21.15.154:0/449607998 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43300052d0 con 0x7f4340133900 2023-09-30T22:27:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4347785700 1 -- 172.21.15.154:0/449607998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434011f490 con 0x7f4340133900 2023-09-30T22:27:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4335ffb700 1 -- 172.21.15.154:0/449607998 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4330005430 con 0x7f4340133900 2023-09-30T22:27:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4335ffb700 1 -- 172.21.15.154:0/449607998 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43300038c0 con 0x7f4340133900 2023-09-30T22:27:25.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.146+0000 7f4347785700 1 -- 172.21.15.154:0/449607998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434009a2c0 con 0x7f4340133900 2023-09-30T22:27:25.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.147+0000 7f4335ffb700 1 -- 172.21.15.154:0/449607998 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4330003a20 con 0x7f4340133900 2023-09-30T22:27:25.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.147+0000 7f4347785700 1 -- 172.21.15.154:0/449607998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434011a590 con 0x7f4340133900 2023-09-30T22:27:25.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.147+0000 7f4335ffb700 1 -- 172.21.15.154:0/449607998 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f433003eb20 con 0x7f4340133900 2023-09-30T22:27:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.152+0000 7f4335ffb700 1 -- 172.21.15.154:0/449607998 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4330018260 con 0x7f4340133900 2023-09-30T22:27:25.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.184+0000 7fe7da830700 1 Processor -- start 2023-09-30T22:27:25.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.184+0000 7fe7da830700 1 -- start start 2023-09-30T22:27:25.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7da830700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d4133ad0 0x7fe7d4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7da830700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d41300a0 0x7fe7d41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7da830700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d406b2d0 con 0x7fe7d41309f0 2023-09-30T22:27:25.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7da830700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4133610 con 0x7fe7d4133ad0 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7da830700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d409a500 con 0x7fe7d41300a0 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d4133ad0 0x7fe7d4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d8dcd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe7d41309f0 0x7fe7d413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43186/0 (socket says 172.21.15.154:43186) 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d8dcd700 1 -- 172.21.15.154:0/900857458 learned_addr learned my addr 172.21.15.154:0/900857458 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d37fe700 1 --2- 172.21.15.154:0/900857458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d41300a0 0x7fe7d41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d2ffd700 1 -- 172.21.15.154:0/900857458 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438046582 0 0) 0x7fe7d406b2d0 con 0x7fe7d41309f0 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d2ffd700 1 -- 172.21.15.154:0/900857458 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7bc0035b0 con 0x7fe7d41309f0 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d37fe700 1 -- 172.21.15.154:0/900857458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d4133ad0 msgr2=0x7fe7d4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d37fe700 1 --2- 172.21.15.154:0/900857458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d4133ad0 0x7fe7d4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d37fe700 1 -- 172.21.15.154:0/900857458 >> v1:172.21.15.154:6789/0 conn(0x7fe7d41309f0 legacy=0x7fe7d413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d37fe700 1 -- 172.21.15.154:0/900857458 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d41338b0 con 0x7fe7d41300a0 2023-09-30T22:27:25.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d3fff700 1 --2- 172.21.15.154:0/900857458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d4133ad0 0x7fe7d4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d37fe700 1 --2- 172.21.15.154:0/900857458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d41300a0 0x7fe7d41304b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009870 tx=0x7fe7c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66c54804a914905 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.185+0000 7fe7d2ffd700 1 -- 172.21.15.154:0/900857458 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8011830 con 0x7fe7d41300a0 2023-09-30T22:27:25.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7d2ffd700 1 -- 172.21.15.154:0/900857458 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c8011990 con 0x7fe7d41300a0 2023-09-30T22:27:25.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7d2ffd700 1 -- 172.21.15.154:0/900857458 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8011d20 con 0x7fe7d41300a0 2023-09-30T22:27:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7da830700 1 -- 172.21.15.154:0/900857458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d41300a0 msgr2=0x7fe7d41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7da830700 1 --2- 172.21.15.154:0/900857458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d41300a0 0x7fe7d41304b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009870 tx=0x7fe7c8009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7da830700 1 -- 172.21.15.154:0/900857458 shutdown_connections 2023-09-30T22:27:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7da830700 1 --2- 172.21.15.154:0/900857458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d4133ad0 0x7fe7d4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7da830700 1 --2- 172.21.15.154:0/900857458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d41300a0 0x7fe7d41304b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7da830700 1 -- 172.21.15.154:0/900857458 >> 172.21.15.154:0/900857458 conn(0x7fe7d4099c40 msgr2=0x7fe7d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:25.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7da830700 1 -- 172.21.15.154:0/900857458 shutdown_connections 2023-09-30T22:27:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.186+0000 7fe7da830700 1 -- 172.21.15.154:0/900857458 wait complete. 2023-09-30T22:27:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.187+0000 7fe7da830700 1 Processor -- start 2023-09-30T22:27:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.187+0000 7fe7da830700 1 -- start start 2023-09-30T22:27:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7da830700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7d41300a0 0x7fe7d411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7da830700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d41309f0 0x7fe7d411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7da830700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d4133ad0 0x7fe7d411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7da830700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d41200c0 con 0x7fe7d41300a0 2023-09-30T22:27:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7da830700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d411fb20 con 0x7fe7d41309f0 2023-09-30T22:27:25.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7da830700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d411f040 con 0x7fe7d4133ad0 2023-09-30T22:27:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7d41300a0 0x7fe7d411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7d41300a0 0x7fe7d411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40128/0 (socket says 172.21.15.154:40128) 2023-09-30T22:27:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d3fff700 1 -- 172.21.15.154:0/1943733391 learned_addr learned my addr 172.21.15.154:0/1943733391 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d37fe700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d41309f0 0x7fe7d411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d8dcd700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d4133ad0 0x7fe7d411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d8dcd700 1 -- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d41309f0 msgr2=0x7fe7d411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d8dcd700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d41309f0 0x7fe7d411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d8dcd700 1 -- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7d41300a0 msgr2=0x7fe7d411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d8dcd700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7d41300a0 0x7fe7d411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d8dcd700 1 -- 172.21.15.154:0/1943733391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40094a0 con 0x7fe7d4133ad0 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d37fe700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d41309f0 0x7fe7d411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d3fff700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7d41300a0 0x7fe7d411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.188+0000 7fe7d8dcd700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d4133ad0 0x7fe7d411e4c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00ca80 tx=0x7fe7cc00cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.189+0000 7fe7d0ff9700 1 -- 172.21.15.154:0/1943733391 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00a9e0 con 0x7fe7d4133ad0 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.189+0000 7fe7d0ff9700 1 -- 172.21.15.154:0/1943733391 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00ab40 con 0x7fe7d4133ad0 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.189+0000 7fe7d0ff9700 1 -- 172.21.15.154:0/1943733391 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc012400 con 0x7fe7d4133ad0 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.189+0000 7fe7da830700 1 -- 172.21.15.154:0/1943733391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c80094a0 con 0x7fe7d4133ad0 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.189+0000 7fe7da830700 1 -- 172.21.15.154:0/1943733391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d411f8b0 con 0x7fe7d4133ad0 2023-09-30T22:27:25.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.190+0000 7fe7da830700 1 -- 172.21.15.154:0/1943733391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d404f2a0 con 0x7fe7d4133ad0 2023-09-30T22:27:25.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.190+0000 7fe7d0ff9700 1 -- 172.21.15.154:0/1943733391 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7cc01b3b0 con 0x7fe7d4133ad0 2023-09-30T22:27:25.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.190+0000 7fe7d0ff9700 1 -- 172.21.15.154:0/1943733391 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe7cc03f520 con 0x7fe7d4133ad0 2023-09-30T22:27:25.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.197+0000 7fe7d0ff9700 1 -- 172.21.15.154:0/1943733391 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7cc01b660 con 0x7fe7d4133ad0 2023-09-30T22:27:25.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.236+0000 7fd2a315d700 1 Processor -- start 2023-09-30T22:27:25.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.236+0000 7fd2a315d700 1 -- start start 2023-09-30T22:27:25.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a315d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09e950 0x7fd29c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a315d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd29c09f260 0x7fd29c137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a315d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c09ac20 con 0x7fd29c1381e0 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a315d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29c0a06c0 con 0x7fd29c09f260 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a315d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c09ae90 con 0x7fd29c09e950 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a0ef9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09e950 0x7fd29c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a0ef9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09e950 0x7fd29c09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:59030/0 (socket says 172.21.15.154:59030) 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a0ef9700 1 -- 172.21.15.154:0/2600200491 learned_addr learned my addr 172.21.15.154:0/2600200491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd29bfff700 1 --2- 172.21.15.154:0/2600200491 >> v2:172.21.15.154:3300/0 conn(0x7fd29c09f260 0x7fd29c137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a0ef9700 1 -- 172.21.15.154:0/2600200491 >> v2:172.21.15.154:3300/0 conn(0x7fd29c09f260 msgr2=0x7fd29c137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:25.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a0ef9700 1 --2- 172.21.15.154:0/2600200491 >> v2:172.21.15.154:3300/0 conn(0x7fd29c09f260 0x7fd29c137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a0ef9700 1 -- 172.21.15.154:0/2600200491 >> v1:172.21.15.154:6789/0 conn(0x7fd29c1381e0 legacy=0x7fd29c13a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a0ef9700 1 -- 172.21.15.154:0/2600200491 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c06ba00 con 0x7fd29c09e950 2023-09-30T22:27:25.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd29bfff700 1 --2- 172.21.15.154:0/2600200491 >> v2:172.21.15.154:3300/0 conn(0x7fd29c09f260 0x7fd29c137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd2a0ef9700 1 --2- 172.21.15.154:0/2600200491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09e950 0x7fd29c09ed20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd290006fd0 tx=0x7fd290009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b96c65429129181c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.237+0000 7fd29b7fe700 1 -- 172.21.15.154:0/2600200491 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290005e30 con 0x7fd29c09e950 2023-09-30T22:27:25.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd29b7fe700 1 -- 172.21.15.154:0/2600200491 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd290004030 con 0x7fd29c09e950 2023-09-30T22:27:25.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd29b7fe700 1 -- 172.21.15.154:0/2600200491 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2900043e0 con 0x7fd29c09e950 2023-09-30T22:27:25.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd2a315d700 1 -- 172.21.15.154:0/2600200491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09e950 msgr2=0x7fd29c09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd2a315d700 1 --2- 172.21.15.154:0/2600200491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09e950 0x7fd29c09ed20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd290006fd0 tx=0x7fd290009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd2a315d700 1 -- 172.21.15.154:0/2600200491 shutdown_connections 2023-09-30T22:27:25.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd2a315d700 1 --2- 172.21.15.154:0/2600200491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09e950 0x7fd29c09ed20 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd2a315d700 1 --2- 172.21.15.154:0/2600200491 >> v2:172.21.15.154:3300/0 conn(0x7fd29c09f260 0x7fd29c137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd2a315d700 1 -- 172.21.15.154:0/2600200491 >> 172.21.15.154:0/2600200491 conn(0x7fd29c0a0f70 msgr2=0x7fd29c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:25.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd2a315d700 1 -- 172.21.15.154:0/2600200491 shutdown_connections 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.238+0000 7fd2a315d700 1 -- 172.21.15.154:0/2600200491 wait complete. 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.239+0000 7fd2a315d700 1 Processor -- start 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.239+0000 7fd2a315d700 1 -- start start 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a315d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29c09e950 0x7fd29c121bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a315d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09f260 0x7fd29c1220f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a315d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd29c1381e0 0x7fd29c122630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a315d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c125370 con 0x7fd29c09e950 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a315d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c123850 con 0x7fd29c09f260 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a315d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0a0820 con 0x7fd29c1381e0 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a0ef9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29c09e950 0x7fd29c121bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a0ef9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29c09e950 0x7fd29c121bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40138/0 (socket says 172.21.15.154:40138) 2023-09-30T22:27:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a0ef9700 1 -- 172.21.15.154:0/563774494 learned_addr learned my addr 172.21.15.154:0/563774494 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd29bfff700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09f260 0x7fd29c1220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a16fa700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd29c1381e0 0x7fd29c122630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd29bfff700 1 -- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd29c1381e0 msgr2=0x7fd29c122630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd29bfff700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd29c1381e0 0x7fd29c122630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd29bfff700 1 -- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29c09e950 msgr2=0x7fd29c121bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd29bfff700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29c09e950 0x7fd29c121bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd29bfff700 1 -- 172.21.15.154:0/563774494 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880094a0 con 0x7fd29c09f260 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a0ef9700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29c09e950 0x7fd29c121bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.240+0000 7fd2a16fa700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd29c1381e0 0x7fd29c122630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.241+0000 7fd29bfff700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09f260 0x7fd29c1220f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd28800e980 tx=0x7fd28800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.241+0000 7fd2997fa700 1 -- 172.21.15.154:0/563774494 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800eed0 con 0x7fd29c09f260 2023-09-30T22:27:25.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.241+0000 7fd2997fa700 1 -- 172.21.15.154:0/563774494 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28800c850 con 0x7fd29c09f260 2023-09-30T22:27:25.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.241+0000 7fd2a315d700 1 -- 172.21.15.154:0/563774494 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd290009500 con 0x7fd29c09f260 2023-09-30T22:27:25.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.241+0000 7fd2997fa700 1 -- 172.21.15.154:0/563774494 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800cbe0 con 0x7fd29c09f260 2023-09-30T22:27:25.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.241+0000 7fd2a315d700 1 -- 172.21.15.154:0/563774494 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c125de0 con 0x7fd29c09f260 2023-09-30T22:27:25.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.242+0000 7fd2997fa700 1 -- 172.21.15.154:0/563774494 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd28800cd40 con 0x7fd29c09f260 2023-09-30T22:27:25.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.242+0000 7fd2a315d700 1 -- 172.21.15.154:0/563774494 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c124ff0 con 0x7fd29c09f260 2023-09-30T22:27:25.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.242+0000 7fd2997fa700 1 -- 172.21.15.154:0/563774494 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd28803f7d0 con 0x7fd29c09f260 2023-09-30T22:27:25.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.247+0000 7fd2997fa700 1 -- 172.21.15.154:0/563774494 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd29c124ff0 con 0x7fd29c09f260 2023-09-30T22:27:25.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.366+0000 7f4347785700 1 -- 172.21.15.154:0/449607998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4340120f80 con 0x7f4340133900 2023-09-30T22:27:25.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.366+0000 7f4335ffb700 1 -- 172.21.15.154:0/449607998 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4340120f80 con 0x7f4340133900 2023-09-30T22:27:25.367 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:25.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.369+0000 7f4347785700 1 -- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 msgr2=0x7f434011dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.369+0000 7f4347785700 1 --2- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 0x7f434011dd20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f433000c510 tx=0x7f433000c820 comp rx=0 tx=0).stop 2023-09-30T22:27:25.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.369+0000 7f4347785700 1 -- 172.21.15.154:0/449607998 shutdown_connections 2023-09-30T22:27:25.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.369+0000 7f4347785700 1 --2- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4340134210 0x7f434011e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.369+0000 7f4347785700 1 --2- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43400a10b0 0x7f434011d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.369+0000 7f4347785700 1 --2- 172.21.15.154:0/449607998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4340133900 0x7f434011dd20 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.369+0000 7f4347785700 1 -- 172.21.15.154:0/449607998 >> 172.21.15.154:0/449607998 conn(0x7f43400a2980 msgr2=0x7f43401badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:25.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.369+0000 7f4347785700 1 -- 172.21.15.154:0/449607998 shutdown_connections 2023-09-30T22:27:25.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.369+0000 7f4347785700 1 -- 172.21.15.154:0/449607998 wait complete. 2023-09-30T22:27:25.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:25.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.391+0000 7fe7da830700 1 -- 172.21.15.154:0/1943733391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7d411f890 con 0x7fe7d4133ad0 2023-09-30T22:27:25.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.391+0000 7fe7d0ff9700 1 -- 172.21.15.154:0/1943733391 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7cc010ab0 con 0x7fe7d4133ad0 2023-09-30T22:27:25.392 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:25.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.393+0000 7fe7da830700 1 -- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d4133ad0 msgr2=0x7fe7d411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.393+0000 7fe7da830700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d4133ad0 0x7fe7d411e4c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00ca80 tx=0x7fe7cc00cd90 comp rx=0 tx=0).stop 2023-09-30T22:27:25.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.393+0000 7fe7da830700 1 -- 172.21.15.154:0/1943733391 shutdown_connections 2023-09-30T22:27:25.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.393+0000 7fe7da830700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe7d4133ad0 0x7fe7d411e4c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.393+0000 7fe7da830700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7d41300a0 0x7fe7d411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.393+0000 7fe7da830700 1 --2- 172.21.15.154:0/1943733391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7d41309f0 0x7fe7d411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.393+0000 7fe7da830700 1 -- 172.21.15.154:0/1943733391 >> 172.21.15.154:0/1943733391 conn(0x7fe7d4099c40 msgr2=0x7fe7d412e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:25.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.393+0000 7fe7da830700 1 -- 172.21.15.154:0/1943733391 shutdown_connections 2023-09-30T22:27:25.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.393+0000 7fe7da830700 1 -- 172.21.15.154:0/1943733391 wait complete. 2023-09-30T22:27:25.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:25.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.440+0000 7fd2a315d700 1 -- 172.21.15.154:0/563774494 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd29c124fa0 con 0x7fd29c09f260 2023-09-30T22:27:25.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.440+0000 7fd2997fa700 1 -- 172.21.15.154:0/563774494 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd288021020 con 0x7fd29c09f260 2023-09-30T22:27:25.442 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.442+0000 7fd2a315d700 1 -- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09f260 msgr2=0x7fd29c1220f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.442+0000 7fd2a315d700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09f260 0x7fd29c1220f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd28800e980 tx=0x7fd28800ec90 comp rx=0 tx=0).stop 2023-09-30T22:27:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.442+0000 7fd2a315d700 1 -- 172.21.15.154:0/563774494 shutdown_connections 2023-09-30T22:27:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.442+0000 7fd2a315d700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd29c1381e0 0x7fd29c122630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.442+0000 7fd2a315d700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29c09e950 0x7fd29c121bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.442+0000 7fd2a315d700 1 --2- 172.21.15.154:0/563774494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd29c09f260 0x7fd29c1220f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.442+0000 7fd2a315d700 1 -- 172.21.15.154:0/563774494 >> 172.21.15.154:0/563774494 conn(0x7fd29c0a0f70 msgr2=0x7fd29c136db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.443+0000 7fd2a315d700 1 -- 172.21.15.154:0/563774494 shutdown_connections 2023-09-30T22:27:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.443+0000 7fd2a315d700 1 -- 172.21.15.154:0/563774494 wait complete. 2023-09-30T22:27:25.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:25.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.907+0000 7fa426bb3700 1 Processor -- start 2023-09-30T22:27:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.907+0000 7fa426bb3700 1 -- start start 2023-09-30T22:27:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.907+0000 7fa426bb3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa42009e870 0x7fa42009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.907+0000 7fa426bb3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa420131f40 0x7fa420139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.907+0000 7fa426bb3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42009c970 con 0x7fa42009f180 2023-09-30T22:27:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.907+0000 7fa426bb3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4200a0920 con 0x7fa420131f40 2023-09-30T22:27:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.907+0000 7fa426bb3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa42009f9c0 con 0x7fa42009e870 2023-09-30T22:27:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.907+0000 7fa425150700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa420131f40 0x7fa420139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.907+0000 7fa42494f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa42009e870 0x7fa42009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa425150700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa420131f40 0x7fa420139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35302/0 (socket says 172.21.15.154:35302) 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa425150700 1 -- 172.21.15.154:0/1498448217 learned_addr learned my addr 172.21.15.154:0/1498448217 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa42494f700 1 -- 172.21.15.154:0/1498448217 >> v2:172.21.15.154:3300/0 conn(0x7fa420131f40 msgr2=0x7fa420139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa42494f700 1 --2- 172.21.15.154:0/1498448217 >> v2:172.21.15.154:3300/0 conn(0x7fa420131f40 0x7fa420139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa42494f700 1 -- 172.21.15.154:0/1498448217 >> v1:172.21.15.154:6789/0 conn(0x7fa42009f180 legacy=0x7fa420131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa42494f700 1 -- 172.21.15.154:0/1498448217 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42009bab0 con 0x7fa42009e870 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa425150700 1 --2- 172.21.15.154:0/1498448217 >> v2:172.21.15.154:3300/0 conn(0x7fa420131f40 0x7fa420139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa42494f700 1 --2- 172.21.15.154:0/1498448217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa42009e870 0x7fa42009ec40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa414009840 tx=0x7fa414009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddab767f5136f339 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa41f7fe700 1 -- 172.21.15.154:0/1498448217 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414011830 con 0x7fa42009e870 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa41f7fe700 1 -- 172.21.15.154:0/1498448217 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414011990 con 0x7fa42009e870 2023-09-30T22:27:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.908+0000 7fa41f7fe700 1 -- 172.21.15.154:0/1498448217 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414011d20 con 0x7fa42009e870 2023-09-30T22:27:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.909+0000 7fa426bb3700 1 -- 172.21.15.154:0/1498448217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa42009e870 msgr2=0x7fa42009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.909+0000 7fa426bb3700 1 --2- 172.21.15.154:0/1498448217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa42009e870 0x7fa42009ec40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa414009840 tx=0x7fa414009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.909+0000 7fa426bb3700 1 -- 172.21.15.154:0/1498448217 shutdown_connections 2023-09-30T22:27:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.909+0000 7fa426bb3700 1 --2- 172.21.15.154:0/1498448217 >> v2:172.21.15.154:3300/0 conn(0x7fa420131f40 0x7fa420139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.909+0000 7fa426bb3700 1 --2- 172.21.15.154:0/1498448217 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa42009e870 0x7fa42009ec40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.909+0000 7fa426bb3700 1 -- 172.21.15.154:0/1498448217 >> 172.21.15.154:0/1498448217 conn(0x7fa4200a4430 msgr2=0x7fa4200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.909+0000 7fa426bb3700 1 -- 172.21.15.154:0/1498448217 shutdown_connections 2023-09-30T22:27:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.909+0000 7fa426bb3700 1 -- 172.21.15.154:0/1498448217 wait complete. 2023-09-30T22:27:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa426bb3700 1 Processor -- start 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa426bb3700 1 -- start start 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa426bb3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa42009e870 0x7fa42006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa426bb3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa42009f180 0x7fa42006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa426bb3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa420131f40 0x7fa42006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa426bb3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4201256f0 con 0x7fa42009f180 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa426bb3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4201249d0 con 0x7fa42009e870 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa426bb3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa420126010 con 0x7fa420131f40 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa41ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa42009f180 0x7fa42006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa425150700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa420131f40 0x7fa42006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa41ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa42009f180 0x7fa42006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35308/0 (socket says 172.21.15.154:35308) 2023-09-30T22:27:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa41ffff700 1 -- 172.21.15.154:0/670969408 learned_addr learned my addr 172.21.15.154:0/670969408 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.910+0000 7fa42494f700 1 --2- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa42009e870 0x7fa42006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa41ffff700 1 -- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa420131f40 msgr2=0x7fa42006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa41ffff700 1 --2- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa420131f40 0x7fa42006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa41ffff700 1 -- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa42009e870 msgr2=0x7fa42006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa41ffff700 1 --2- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa42009e870 0x7fa42006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa41ffff700 1 -- 172.21.15.154:0/670969408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418009b30 con 0x7fa42009f180 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa42494f700 1 --2- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa42009e870 0x7fa42006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa41ffff700 1 --2- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa42009f180 0x7fa42006bdf0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00c4e0 tx=0x7fa40c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa41d7fa700 1 -- 172.21.15.154:0/670969408 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0052d0 con 0x7fa42009f180 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa41d7fa700 1 -- 172.21.15.154:0/670969408 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c005430 con 0x7fa42009f180 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa426bb3700 1 -- 172.21.15.154:0/670969408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4140094a0 con 0x7fa42009f180 2023-09-30T22:27:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa41d7fa700 1 -- 172.21.15.154:0/670969408 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0038c0 con 0x7fa42009f180 2023-09-30T22:27:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.911+0000 7fa426bb3700 1 -- 172.21.15.154:0/670969408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa420125a70 con 0x7fa42009f180 2023-09-30T22:27:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.912+0000 7fa41d7fa700 1 -- 172.21.15.154:0/670969408 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa40c003a20 con 0x7fa42009f180 2023-09-30T22:27:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.912+0000 7fa41d7fa700 1 -- 172.21.15.154:0/670969408 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa40c03ea10 con 0x7fa42009f180 2023-09-30T22:27:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.912+0000 7fa426bb3700 1 -- 172.21.15.154:0/670969408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42004f2a0 con 0x7fa42009f180 2023-09-30T22:27:25.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:25.917+0000 7fa41d7fa700 1 -- 172.21.15.154:0/670969408 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa40c018260 con 0x7fa42009f180 2023-09-30T22:27:26.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.100+0000 7fa426bb3700 1 -- 172.21.15.154:0/670969408 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa42006b2a0 con 0x7fa42009f180 2023-09-30T22:27:26.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.101+0000 7fa41d7fa700 1 -- 172.21.15.154:0/670969408 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa40c017020 con 0x7fa42009f180 2023-09-30T22:27:26.102 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:26.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.103+0000 7fa426bb3700 1 -- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa42009f180 msgr2=0x7fa42006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.103+0000 7fa426bb3700 1 --2- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa42009f180 0x7fa42006bdf0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00c4e0 tx=0x7fa40c00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.103+0000 7fa426bb3700 1 -- 172.21.15.154:0/670969408 shutdown_connections 2023-09-30T22:27:26.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.103+0000 7fa426bb3700 1 --2- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa420131f40 0x7fa42006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.103+0000 7fa426bb3700 1 --2- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa42009e870 0x7fa42006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.103+0000 7fa426bb3700 1 --2- 172.21.15.154:0/670969408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa42009f180 0x7fa42006bdf0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.103+0000 7fa426bb3700 1 -- 172.21.15.154:0/670969408 >> 172.21.15.154:0/670969408 conn(0x7fa4200a4430 msgr2=0x7fa42011a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.103+0000 7fa426bb3700 1 -- 172.21.15.154:0/670969408 shutdown_connections 2023-09-30T22:27:26.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.103+0000 7fa426bb3700 1 -- 172.21.15.154:0/670969408 wait complete. 2023-09-30T22:27:26.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:26.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:26.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:26.456 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:26.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.511+0000 7f0ce4549700 1 Processor -- start 2023-09-30T22:27:26.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.511+0000 7f0ce4549700 1 -- start start 2023-09-30T22:27:26.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce4549700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce4549700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc1356e0 0x7f0cdc137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce4549700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc0a1e70 con 0x7f0cdc0a0a30 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce4549700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc09a720 con 0x7f0cdc0a1510 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce4549700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc09b300 con 0x7f0cdc1356e0 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce1ae4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce22e5700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0cdc0a0a30 0x7f0cdc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40686/0 (socket says 172.21.15.154:40686) 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce22e5700 1 -- 172.21.15.154:0/3319281636 learned_addr learned my addr 172.21.15.154:0/3319281636 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce2ae6700 1 --2- 172.21.15.154:0/3319281636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc1356e0 0x7f0cdc137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce1ae4700 1 -- 172.21.15.154:0/3319281636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc1356e0 msgr2=0x7f0cdc137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce1ae4700 1 --2- 172.21.15.154:0/3319281636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc1356e0 0x7f0cdc137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce12e3700 1 -- 172.21.15.154:0/3319281636 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878699609 0 0) 0x7f0cdc0a1e70 con 0x7f0cdc0a0a30 2023-09-30T22:27:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce1ae4700 1 -- 172.21.15.154:0/3319281636 >> v1:172.21.15.154:6789/0 conn(0x7f0cdc0a0a30 legacy=0x7f0cdc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.512+0000 7f0ce1ae4700 1 -- 172.21.15.154:0/3319281636 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc09abc0 con 0x7f0cdc0a1510 2023-09-30T22:27:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.513+0000 7f0ce1ae4700 1 --2- 172.21.15.154:0/3319281636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc1351a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009870 tx=0x7f0ccc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46ef4eb1f67324d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.513+0000 7f0ce12e3700 1 -- 172.21.15.154:0/3319281636 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00f8a0 con 0x7f0cdc0a1510 2023-09-30T22:27:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.513+0000 7f0ce12e3700 1 -- 172.21.15.154:0/3319281636 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc00fa00 con 0x7f0cdc0a1510 2023-09-30T22:27:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.513+0000 7f0ce12e3700 1 -- 172.21.15.154:0/3319281636 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00fd90 con 0x7f0cdc0a1510 2023-09-30T22:27:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.514+0000 7f0ce4549700 1 -- 172.21.15.154:0/3319281636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 msgr2=0x7f0cdc1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.514+0000 7f0ce4549700 1 --2- 172.21.15.154:0/3319281636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc1351a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009870 tx=0x7f0ccc009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.514+0000 7f0ce4549700 1 -- 172.21.15.154:0/3319281636 shutdown_connections 2023-09-30T22:27:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.514+0000 7f0ce4549700 1 --2- 172.21.15.154:0/3319281636 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc1356e0 0x7f0cdc137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.514+0000 7f0ce4549700 1 --2- 172.21.15.154:0/3319281636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc1351a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.514+0000 7f0ce4549700 1 -- 172.21.15.154:0/3319281636 >> 172.21.15.154:0/3319281636 conn(0x7f0cdc0a2980 msgr2=0x7f0cdc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.514+0000 7f0ce4549700 1 -- 172.21.15.154:0/3319281636 shutdown_connections 2023-09-30T22:27:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.514+0000 7f0ce4549700 1 -- 172.21.15.154:0/3319281636 wait complete. 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce4549700 1 Processor -- start 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce4549700 1 -- start start 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce4549700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc0a0a30 0x7f0cdc11d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce4549700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc11d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce4549700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cdc1356e0 0x7f0cdc11dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce4549700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc120120 con 0x7f0cdc1356e0 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce4549700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc11e440 con 0x7f0cdc0a1510 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce4549700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc120c20 con 0x7f0cdc0a0a30 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce1ae4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce1ae4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc11d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37140/0 (socket says 172.21.15.154:37140) 2023-09-30T22:27:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce1ae4700 1 -- 172.21.15.154:0/3156336641 learned_addr learned my addr 172.21.15.154:0/3156336641 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce2ae6700 1 --2- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cdc1356e0 0x7f0cdc11dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.515+0000 7f0ce22e5700 1 --2- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc0a0a30 0x7f0cdc11d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0ce1ae4700 1 -- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc0a0a30 msgr2=0x7f0cdc11d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0ce1ae4700 1 --2- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc0a0a30 0x7f0cdc11d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0ce1ae4700 1 -- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cdc1356e0 msgr2=0x7f0cdc11dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0ce1ae4700 1 --2- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cdc1356e0 0x7f0cdc11dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0ce1ae4700 1 -- 172.21.15.154:0/3156336641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc0094a0 con 0x7f0cdc0a1510 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0ce1ae4700 1 --2- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc11d740 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0a2000 tx=0x7f0ccc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0cd2ffd700 1 -- 172.21.15.154:0/3156336641 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0038a0 con 0x7f0cdc0a1510 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0cd2ffd700 1 -- 172.21.15.154:0/3156336641 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc003a00 con 0x7f0cdc0a1510 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0cd2ffd700 1 -- 172.21.15.154:0/3156336641 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc003d90 con 0x7f0cdc0a1510 2023-09-30T22:27:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0ce4549700 1 -- 172.21.15.154:0/3156336641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc120320 con 0x7f0cdc0a1510 2023-09-30T22:27:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.516+0000 7f0ce4549700 1 -- 172.21.15.154:0/3156336641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc11eb50 con 0x7f0cdc0a1510 2023-09-30T22:27:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.517+0000 7f0cd2ffd700 1 -- 172.21.15.154:0/3156336641 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ccc019400 con 0x7f0cdc0a1510 2023-09-30T22:27:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.517+0000 7f0cd2ffd700 1 -- 172.21.15.154:0/3156336641 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ccc0409d0 con 0x7f0cdc0a1510 2023-09-30T22:27:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.517+0000 7f0ce4549700 1 -- 172.21.15.154:0/3156336641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc04f2a0 con 0x7f0cdc0a1510 2023-09-30T22:27:26.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.522+0000 7f0cd2ffd700 1 -- 172.21.15.154:0/3156336641 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ccc02a310 con 0x7f0cdc0a1510 2023-09-30T22:27:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.555+0000 7f0f34299700 1 Processor -- start 2023-09-30T22:27:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.555+0000 7f0f34299700 1 -- start start 2023-09-30T22:27:26.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f34299700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f2c0a0a70 0x7f0f2c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f34299700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a1380 0x7f0f2c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f34299700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2c09dc00 con 0x7f0f2c133f50 2023-09-30T22:27:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f34299700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f2c09ea60 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f34299700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c09dec0 con 0x7f0f2c0a1380 2023-09-30T22:27:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f32035700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f2c0a0a70 0x7f0f2c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f32035700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f2c0a0a70 0x7f0f2c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35334/0 (socket says 172.21.15.154:35334) 2023-09-30T22:27:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f32035700 1 -- 172.21.15.154:0/3999000010 learned_addr learned my addr 172.21.15.154:0/3999000010 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f31834700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a1380 0x7f0f2c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f32035700 1 -- 172.21.15.154:0/3999000010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a1380 msgr2=0x7f0f2c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f32035700 1 --2- 172.21.15.154:0/3999000010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a1380 0x7f0f2c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f32035700 1 -- 172.21.15.154:0/3999000010 >> v1:172.21.15.154:6789/0 conn(0x7f0f2c133f50 legacy=0x7f0f2c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f32035700 1 -- 172.21.15.154:0/3999000010 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c09e6a0 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f31834700 1 --2- 172.21.15.154:0/3999000010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a1380 0x7f0f2c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.556+0000 7f0f32035700 1 --2- 172.21.15.154:0/3999000010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a0a70 0x7f0f2c0a0e40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f0f280098f0 tx=0x7f0f28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9b560221eb37c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f31033700 1 -- 172.21.15.154:0/3999000010 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28011830 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f31033700 1 -- 172.21.15.154:0/3999000010 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f28011990 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f31033700 1 -- 172.21.15.154:0/3999000010 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28011d20 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f34299700 1 -- 172.21.15.154:0/3999000010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a0a70 msgr2=0x7f0f2c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f34299700 1 --2- 172.21.15.154:0/3999000010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a0a70 0x7f0f2c0a0e40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f0f280098f0 tx=0x7f0f28009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f34299700 1 -- 172.21.15.154:0/3999000010 shutdown_connections 2023-09-30T22:27:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f34299700 1 --2- 172.21.15.154:0/3999000010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a0a70 0x7f0f2c0a0e40 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f34299700 1 --2- 172.21.15.154:0/3999000010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a1380 0x7f0f2c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f34299700 1 -- 172.21.15.154:0/3999000010 >> 172.21.15.154:0/3999000010 conn(0x7f0f2c0a6610 msgr2=0x7f0f2c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f34299700 1 -- 172.21.15.154:0/3999000010 shutdown_connections 2023-09-30T22:27:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.557+0000 7f0f34299700 1 -- 172.21.15.154:0/3999000010 wait complete. 2023-09-30T22:27:26.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.558+0000 7f0f34299700 1 Processor -- start 2023-09-30T22:27:26.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.558+0000 7f0f34299700 1 -- start start 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f34299700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a0a70 0x7f0f2c11e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f34299700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a1380 0x7f0f2c11ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f34299700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f2c133f50 0x7f0f2c11f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f34299700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c133790 con 0x7f0f2c0a1380 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f34299700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c122320 con 0x7f0f2c133f50 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f34299700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2c1339d0 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32035700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a0a70 0x7f0f2c11e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f31834700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a1380 0x7f0f2c11ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32035700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a0a70 0x7f0f2c11e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36502/0 (socket says 172.21.15.154:36502) 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32035700 1 -- 172.21.15.154:0/3752030026 learned_addr learned my addr 172.21.15.154:0/3752030026 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f31834700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a1380 0x7f0f2c11ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35350/0 (socket says 172.21.15.154:35350) 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32836700 1 --2- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f2c133f50 0x7f0f2c11f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32035700 1 -- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f2c133f50 msgr2=0x7f0f2c11f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32035700 1 --2- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f2c133f50 0x7f0f2c11f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32035700 1 -- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a1380 msgr2=0x7f0f2c11ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32035700 1 --2- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a1380 0x7f0f2c11ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32035700 1 -- 172.21.15.154:0/3752030026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0094a0 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f31834700 1 --2- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a1380 0x7f0f2c11ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.559+0000 7f0f32035700 1 --2- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a0a70 0x7f0f2c11e840 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0f28000c00 tx=0x7f0f28004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.560+0000 7f0f22ffd700 1 -- 172.21.15.154:0/3752030026 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28004400 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.560+0000 7f0f22ffd700 1 -- 172.21.15.154:0/3752030026 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2801f070 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.560+0000 7f0f22ffd700 1 -- 172.21.15.154:0/3752030026 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280038e0 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.560+0000 7f0f34299700 1 -- 172.21.15.154:0/3752030026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f28009550 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.560+0000 7f0f34299700 1 -- 172.21.15.154:0/3752030026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2c120500 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.560+0000 7f0f22ffd700 1 -- 172.21.15.154:0/3752030026 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f28021030 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.561+0000 7f0f22ffd700 1 -- 172.21.15.154:0/3752030026 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f280408f0 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.561+0000 7f0f34299700 1 -- 172.21.15.154:0/3752030026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f2c04f2a0 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.565+0000 7f0f22ffd700 1 -- 172.21.15.154:0/3752030026 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f28004560 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.600+0000 7f670109a700 1 Processor -- start 2023-09-30T22:27:26.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.600+0000 7f670109a700 1 -- start start 2023-09-30T22:27:26.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f670109a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a0a70 0x7f66fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f670109a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a1380 0x7f66fc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f670109a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc09dc00 con 0x7f66fc133f50 2023-09-30T22:27:26.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f670109a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc09ea60 con 0x7f66fc0a1380 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f670109a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc09dec0 con 0x7f66fc0a0a70 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66fad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a0a70 0x7f66fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66fb59e700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f66fc133f50 0x7f66fc13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40698/0 (socket says 172.21.15.154:40698) 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66fb59e700 1 -- 172.21.15.154:0/2151182084 learned_addr learned my addr 172.21.15.154:0/2151182084 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66fa59c700 1 --2- 172.21.15.154:0/2151182084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a1380 0x7f66fc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66fad9d700 1 -- 172.21.15.154:0/2151182084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a1380 msgr2=0x7f66fc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66fad9d700 1 --2- 172.21.15.154:0/2151182084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a1380 0x7f66fc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66fad9d700 1 -- 172.21.15.154:0/2151182084 >> v1:172.21.15.154:6789/0 conn(0x7f66fc133f50 legacy=0x7f66fc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66fad9d700 1 -- 172.21.15.154:0/2151182084 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc09e6a0 con 0x7f66fc0a0a70 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66fad9d700 1 --2- 172.21.15.154:0/2151182084 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a0a70 0x7f66fc0a0e40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009870 tx=0x7f66ec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90e53a292f082b05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66f9d9b700 1 -- 172.21.15.154:0/2151182084 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec011830 con 0x7f66fc0a0a70 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66f9d9b700 1 -- 172.21.15.154:0/2151182084 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec011990 con 0x7f66fc0a0a70 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.601+0000 7f66f9d9b700 1 -- 172.21.15.154:0/2151182084 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec011d20 con 0x7f66fc0a0a70 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.602+0000 7f670109a700 1 -- 172.21.15.154:0/2151182084 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a0a70 msgr2=0x7f66fc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.602+0000 7f670109a700 1 --2- 172.21.15.154:0/2151182084 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a0a70 0x7f66fc0a0e40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009870 tx=0x7f66ec009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.602+0000 7f670109a700 1 -- 172.21.15.154:0/2151182084 shutdown_connections 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.602+0000 7f670109a700 1 --2- 172.21.15.154:0/2151182084 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a0a70 0x7f66fc0a0e40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.602+0000 7f670109a700 1 --2- 172.21.15.154:0/2151182084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a1380 0x7f66fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.602+0000 7f670109a700 1 -- 172.21.15.154:0/2151182084 >> 172.21.15.154:0/2151182084 conn(0x7f66fc0a6610 msgr2=0x7f66fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.602+0000 7f670109a700 1 -- 172.21.15.154:0/2151182084 shutdown_connections 2023-09-30T22:27:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.602+0000 7f670109a700 1 -- 172.21.15.154:0/2151182084 wait complete. 2023-09-30T22:27:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.603+0000 7f670109a700 1 Processor -- start 2023-09-30T22:27:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.603+0000 7f670109a700 1 -- start start 2023-09-30T22:27:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f670109a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a0a70 0x7f66fc1229a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f670109a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a1380 0x7f66fc122ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f670109a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc133f50 0x7f66fc123420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f670109a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc1245b0 con 0x7f66fc133f50 2023-09-30T22:27:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f670109a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc1265c0 con 0x7f66fc0a0a70 2023-09-30T22:27:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f670109a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc124b60 con 0x7f66fc0a1380 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f66fa59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a1380 0x7f66fc122ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f66fa59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a1380 0x7f66fc122ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36520/0 (socket says 172.21.15.154:36520) 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f66fa59c700 1 -- 172.21.15.154:0/2892495552 learned_addr learned my addr 172.21.15.154:0/2892495552 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f66fb59e700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc133f50 0x7f66fc123420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.604+0000 7f66fad9d700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a0a70 0x7f66fc1229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66fa59c700 1 -- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a0a70 msgr2=0x7f66fc1229a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66fa59c700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a0a70 0x7f66fc1229a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66fa59c700 1 -- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc133f50 msgr2=0x7f66fc123420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66fa59c700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc133f50 0x7f66fc123420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66fa59c700 1 -- 172.21.15.154:0/2892495552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0094a0 con 0x7f66fc0a1380 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66fad9d700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a0a70 0x7f66fc1229a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66fa59c700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a1380 0x7f66fc122ee0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f66f000e980 tx=0x7f66f000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66e37fe700 1 -- 172.21.15.154:0/2892495552 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0009710 con 0x7f66fc0a1380 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66e37fe700 1 -- 172.21.15.154:0/2892495552 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f000eed0 con 0x7f66fc0a1380 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f66e37fe700 1 -- 172.21.15.154:0/2892495552 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000ca70 con 0x7f66fc0a1380 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f670109a700 1 -- 172.21.15.154:0/2892495552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc0a03e0 con 0x7f66fc0a1380 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.605+0000 7f670109a700 1 -- 172.21.15.154:0/2892495552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc126c50 con 0x7f66fc0a1380 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.606+0000 7f670109a700 1 -- 172.21.15.154:0/2892495552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc04f2a0 con 0x7f66fc0a1380 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.606+0000 7f66e37fe700 1 -- 172.21.15.154:0/2892495552 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66f000cbd0 con 0x7f66fc0a1380 2023-09-30T22:27:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.606+0000 7f66e37fe700 1 -- 172.21.15.154:0/2892495552 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66f003faf0 con 0x7f66fc0a1380 2023-09-30T22:27:26.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.611+0000 7f66e37fe700 1 -- 172.21.15.154:0/2892495552 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66f001b3b0 con 0x7f66fc0a1380 2023-09-30T22:27:26.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.719+0000 7f0ce4549700 1 -- 172.21.15.154:0/3156336641 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0cdc0008d0 con 0x7f0cdc0a1510 2023-09-30T22:27:26.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.719+0000 7f0cd2ffd700 1 -- 172.21.15.154:0/3156336641 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ccc028030 con 0x7f0cdc0a1510 2023-09-30T22:27:26.719 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:26.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.721+0000 7f0ce4549700 1 -- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 msgr2=0x7f0cdc11d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.721+0000 7f0ce4549700 1 --2- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc11d740 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0a2000 tx=0x7f0ccc004750 comp rx=0 tx=0).stop 2023-09-30T22:27:26.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.721+0000 7f0ce4549700 1 -- 172.21.15.154:0/3156336641 shutdown_connections 2023-09-30T22:27:26.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.721+0000 7f0ce4549700 1 --2- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cdc1356e0 0x7f0cdc11dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.721+0000 7f0ce4549700 1 --2- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0cdc0a0a30 0x7f0cdc11d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.721+0000 7f0ce4549700 1 --2- 172.21.15.154:0/3156336641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cdc0a1510 0x7f0cdc11d740 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.721+0000 7f0ce4549700 1 -- 172.21.15.154:0/3156336641 >> 172.21.15.154:0/3156336641 conn(0x7f0cdc0a2980 msgr2=0x7f0cdc130550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.721+0000 7f0ce4549700 1 -- 172.21.15.154:0/3156336641 shutdown_connections 2023-09-30T22:27:26.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.721+0000 7f0ce4549700 1 -- 172.21.15.154:0/3156336641 wait complete. 2023-09-30T22:27:26.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:26.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.763+0000 7f0f34299700 1 -- 172.21.15.154:0/3752030026 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f2c072980 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.763+0000 7f0f22ffd700 1 -- 172.21.15.154:0/3752030026 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f2801b430 con 0x7f0f2c0a0a70 2023-09-30T22:27:26.763 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:26.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.765+0000 7f0f34299700 1 -- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a0a70 msgr2=0x7f0f2c11e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.765+0000 7f0f34299700 1 --2- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a0a70 0x7f0f2c11e840 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0f28000c00 tx=0x7f0f28004750 comp rx=0 tx=0).stop 2023-09-30T22:27:26.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.765+0000 7f0f34299700 1 -- 172.21.15.154:0/3752030026 shutdown_connections 2023-09-30T22:27:26.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.765+0000 7f0f34299700 1 --2- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f2c133f50 0x7f0f2c11f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.765+0000 7f0f34299700 1 --2- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0f2c0a0a70 0x7f0f2c11e840 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.765+0000 7f0f34299700 1 --2- 172.21.15.154:0/3752030026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f2c0a1380 0x7f0f2c11ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.765+0000 7f0f34299700 1 -- 172.21.15.154:0/3752030026 >> 172.21.15.154:0/3752030026 conn(0x7f0f2c0a6610 msgr2=0x7f0f2c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.765+0000 7f0f34299700 1 -- 172.21.15.154:0/3752030026 shutdown_connections 2023-09-30T22:27:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.765+0000 7f0f34299700 1 -- 172.21.15.154:0/3752030026 wait complete. 2023-09-30T22:27:26.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:26.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.807+0000 7f670109a700 1 -- 172.21.15.154:0/2892495552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66fc072980 con 0x7f66fc0a1380 2023-09-30T22:27:26.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.807+0000 7f66e37fe700 1 -- 172.21.15.154:0/2892495552 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66f003fe60 con 0x7f66fc0a1380 2023-09-30T22:27:26.810 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.809+0000 7f670109a700 1 -- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a1380 msgr2=0x7f66fc122ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.809+0000 7f670109a700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a1380 0x7f66fc122ee0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f66f000e980 tx=0x7f66f000ec90 comp rx=0 tx=0).stop 2023-09-30T22:27:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.809+0000 7f670109a700 1 -- 172.21.15.154:0/2892495552 shutdown_connections 2023-09-30T22:27:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.809+0000 7f670109a700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66fc133f50 0x7f66fc123420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.810+0000 7f670109a700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66fc0a0a70 0x7f66fc1229a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.810+0000 7f670109a700 1 --2- 172.21.15.154:0/2892495552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66fc0a1380 0x7f66fc122ee0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.810+0000 7f670109a700 1 -- 172.21.15.154:0/2892495552 >> 172.21.15.154:0/2892495552 conn(0x7f66fc0a6610 msgr2=0x7f66fc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.810+0000 7f670109a700 1 -- 172.21.15.154:0/2892495552 shutdown_connections 2023-09-30T22:27:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:26.810+0000 7f670109a700 1 -- 172.21.15.154:0/2892495552 wait complete. 2023-09-30T22:27:26.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:27.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.242+0000 7f0a50c0f700 1 Processor -- start 2023-09-30T22:27:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.242+0000 7f0a50c0f700 1 -- start start 2023-09-30T22:27:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a50c0f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a50c0f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a50c0f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4c09aaa0 con 0x7f0a4c130ce0 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a50c0f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c09f870 con 0x7f0a4c09d860 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a50c0f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c09b360 con 0x7f0a4c09e170 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a4a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a49d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a4a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37196/0 (socket says 172.21.15.154:37196) 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a4ad9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0a4c130ce0 0x7f0a4c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40708/0 (socket says 172.21.15.154:40708) 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a49d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36534/0 (socket says 172.21.15.154:36534) 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a4a59c700 1 -- 172.21.15.154:0/638270379 learned_addr learned my addr 172.21.15.154:0/638270379 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a49d9b700 1 -- 172.21.15.154:0/638270379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 msgr2=0x7f0a4c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a49d9b700 1 --2- 172.21.15.154:0/638270379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a49d9b700 1 -- 172.21.15.154:0/638270379 >> v1:172.21.15.154:6789/0 conn(0x7f0a4c130ce0 legacy=0x7f0a4c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a49d9b700 1 -- 172.21.15.154:0/638270379 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c09b620 con 0x7f0a4c09e170 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a4959a700 1 -- 172.21.15.154:0/638270379 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229604200 0 0) 0x7f0a4c09aaa0 con 0x7f0a4c130ce0 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a4a59c700 1 --2- 172.21.15.154:0/638270379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a49d9b700 1 --2- 172.21.15.154:0/638270379 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1307a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009870 tx=0x7f0a3c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f40e2e09cdbce49 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a4959a700 1 -- 172.21.15.154:0/638270379 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c011830 con 0x7f0a4c09e170 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a4959a700 1 -- 172.21.15.154:0/638270379 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c011990 con 0x7f0a4c09e170 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.243+0000 7f0a4959a700 1 -- 172.21.15.154:0/638270379 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c011d20 con 0x7f0a4c09e170 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.244+0000 7f0a50c0f700 1 -- 172.21.15.154:0/638270379 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 msgr2=0x7f0a4c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.244+0000 7f0a50c0f700 1 --2- 172.21.15.154:0/638270379 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1307a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009870 tx=0x7f0a3c009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.244+0000 7f0a50c0f700 1 -- 172.21.15.154:0/638270379 shutdown_connections 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.244+0000 7f0a50c0f700 1 --2- 172.21.15.154:0/638270379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.244+0000 7f0a50c0f700 1 --2- 172.21.15.154:0/638270379 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1307a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.244+0000 7f0a50c0f700 1 -- 172.21.15.154:0/638270379 >> 172.21.15.154:0/638270379 conn(0x7f0a4c099c40 msgr2=0x7f0a4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.244+0000 7f0a50c0f700 1 -- 172.21.15.154:0/638270379 shutdown_connections 2023-09-30T22:27:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.244+0000 7f0a50c0f700 1 -- 172.21.15.154:0/638270379 wait complete. 2023-09-30T22:27:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.245+0000 7f0a50c0f700 1 Processor -- start 2023-09-30T22:27:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.245+0000 7f0a50c0f700 1 -- start start 2023-09-30T22:27:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.245+0000 7f0a50c0f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c1c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a50c0f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a50c0f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a4c130ce0 0x7f0a4c1c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a50c0f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c124450 con 0x7f0a4c130ce0 2023-09-30T22:27:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a50c0f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c1250c0 con 0x7f0a4c09d860 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a50c0f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c125dc0 con 0x7f0a4c09e170 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c1c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c1c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37212/0 (socket says 172.21.15.154:37212) 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a4c130ce0 0x7f0a4c1c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4a59c700 1 -- 172.21.15.154:0/3734177527 learned_addr learned my addr 172.21.15.154:0/3734177527 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a49d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4a59c700 1 -- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 msgr2=0x7f0a4c1c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4a59c700 1 --2- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4a59c700 1 -- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a4c130ce0 msgr2=0x7f0a4c1c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4a59c700 1 --2- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a4c130ce0 0x7f0a4c1c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4a59c700 1 -- 172.21.15.154:0/3734177527 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40009550 con 0x7f0a4c09d860 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a4a59c700 1 --2- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c1c8060 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000ebe0 tx=0x7f0a4000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a3affd700 1 -- 172.21.15.154:0/3734177527 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000c850 con 0x7f0a4c09d860 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a3affd700 1 -- 172.21.15.154:0/3734177527 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4000c9b0 con 0x7f0a4c09d860 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a50c0f700 1 -- 172.21.15.154:0/3734177527 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c0094a0 con 0x7f0a4c09d860 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a3affd700 1 -- 172.21.15.154:0/3734177527 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000cd40 con 0x7f0a4c09d860 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.246+0000 7f0a50c0f700 1 -- 172.21.15.154:0/3734177527 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c09c8b0 con 0x7f0a4c09d860 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.247+0000 7f0a3affd700 1 -- 172.21.15.154:0/3734177527 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a40013470 con 0x7f0a4c09d860 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.247+0000 7f0a3affd700 1 -- 172.21.15.154:0/3734177527 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a4003f860 con 0x7f0a4c09d860 2023-09-30T22:27:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.247+0000 7f0a50c0f700 1 -- 172.21.15.154:0/3734177527 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c125fe0 con 0x7f0a4c09d860 2023-09-30T22:27:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.252+0000 7f0a3affd700 1 -- 172.21.15.154:0/3734177527 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a40017080 con 0x7f0a4c09d860 2023-09-30T22:27:27.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.436+0000 7f0a50c0f700 1 -- 172.21.15.154:0/3734177527 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a4c126430 con 0x7f0a4c09d860 2023-09-30T22:27:27.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.436+0000 7f0a3affd700 1 -- 172.21.15.154:0/3734177527 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a40021020 con 0x7f0a4c09d860 2023-09-30T22:27:27.436 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.438+0000 7f0a50c0f700 1 -- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 msgr2=0x7f0a4c1c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.438+0000 7f0a50c0f700 1 --2- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c1c8060 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000ebe0 tx=0x7f0a4000eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.439+0000 7f0a50c0f700 1 -- 172.21.15.154:0/3734177527 shutdown_connections 2023-09-30T22:27:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.439+0000 7f0a50c0f700 1 --2- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a4c130ce0 0x7f0a4c1c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.439+0000 7f0a50c0f700 1 --2- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a4c09d860 0x7f0a4c1c8060 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.439+0000 7f0a50c0f700 1 --2- 172.21.15.154:0/3734177527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a4c09e170 0x7f0a4c1c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.439+0000 7f0a50c0f700 1 -- 172.21.15.154:0/3734177527 >> 172.21.15.154:0/3734177527 conn(0x7f0a4c099c40 msgr2=0x7f0a4c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.439+0000 7f0a50c0f700 1 -- 172.21.15.154:0/3734177527 shutdown_connections 2023-09-30T22:27:27.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.439+0000 7f0a50c0f700 1 -- 172.21.15.154:0/3734177527 wait complete. 2023-09-30T22:27:27.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:27.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:27.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:27.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:27.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.872+0000 7f3291dc8700 1 Processor -- start 2023-09-30T22:27:27.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.872+0000 7f3291dc8700 1 -- start start 2023-09-30T22:27:27.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f3291dc8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f3291dc8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c0a10b0 0x7f328c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f3291dc8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c09a760 con 0x7f328c134210 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f3291dc8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c1336e0 con 0x7f328c133900 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f3291dc8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f328c09a080 con 0x7f328c0a10b0 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f328c134210 0x7f328c0a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40720/0 (socket says 172.21.15.154:40720) 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328affd700 1 -- 172.21.15.154:0/3183404716 learned_addr learned my addr 172.21.15.154:0/3183404716 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328bfff700 1 --2- 172.21.15.154:0/3183404716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c0a10b0 0x7f328c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328a7fc700 1 -- 172.21.15.154:0/3183404716 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454863797 0 0) 0x7f328c09a760 con 0x7f328c134210 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328a7fc700 1 -- 172.21.15.154:0/3183404716 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32740035b0 con 0x7f328c134210 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328b7fe700 1 -- 172.21.15.154:0/3183404716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c0a10b0 msgr2=0x7f328c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328b7fe700 1 --2- 172.21.15.154:0/3183404716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c0a10b0 0x7f328c13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328b7fe700 1 -- 172.21.15.154:0/3183404716 >> v1:172.21.15.154:6789/0 conn(0x7f328c134210 legacy=0x7f328c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.873+0000 7f328b7fe700 1 -- 172.21.15.154:0/3183404716 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0a23e0 con 0x7f328c133900 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f328b7fe700 1 --2- 172.21.15.154:0/3183404716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c133cd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f327c009850 tx=0x7f327c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8692c0cfff1881b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f328a7fc700 1 -- 172.21.15.154:0/3183404716 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c005e30 con 0x7f328c133900 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f328a7fc700 1 -- 172.21.15.154:0/3183404716 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c006030 con 0x7f328c133900 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f328a7fc700 1 -- 172.21.15.154:0/3183404716 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0063e0 con 0x7f328c133900 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f3291dc8700 1 -- 172.21.15.154:0/3183404716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 msgr2=0x7f328c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f3291dc8700 1 --2- 172.21.15.154:0/3183404716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c133cd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f327c009850 tx=0x7f327c009b60 comp rx=0 tx=0).stop 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f3291dc8700 1 -- 172.21.15.154:0/3183404716 shutdown_connections 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f3291dc8700 1 --2- 172.21.15.154:0/3183404716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c0a10b0 0x7f328c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f3291dc8700 1 --2- 172.21.15.154:0/3183404716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c133cd0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f3291dc8700 1 -- 172.21.15.154:0/3183404716 >> 172.21.15.154:0/3183404716 conn(0x7f328c0a2980 msgr2=0x7f328c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.874+0000 7f3291dc8700 1 -- 172.21.15.154:0/3183404716 shutdown_connections 2023-09-30T22:27:27.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.875+0000 7f3291dc8700 1 -- 172.21.15.154:0/3183404716 wait complete. 2023-09-30T22:27:27.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.875+0000 7f3291dc8700 1 Processor -- start 2023-09-30T22:27:27.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f3291dc8700 1 -- start start 2023-09-30T22:27:27.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f3291dc8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f328c0a10b0 0x7f328c11d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f3291dc8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c11dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f3291dc8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c134210 0x7f328c11e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f3291dc8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c121300 con 0x7f328c0a10b0 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f3291dc8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c132bf0 con 0x7f328c133900 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f3291dc8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f328c120a90 con 0x7f328c134210 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f328affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c11dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f328affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c11dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37222/0 (socket says 172.21.15.154:37222) 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f328bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c134210 0x7f328c11e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f328affd700 1 -- 172.21.15.154:0/2288198966 learned_addr learned my addr 172.21.15.154:0/2288198966 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.876+0000 7f328b7fe700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f328c0a10b0 0x7f328c11d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f328bfff700 1 -- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 msgr2=0x7f328c11dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f328bfff700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c11dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f328bfff700 1 -- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f328c0a10b0 msgr2=0x7f328c11d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f328bfff700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f328c0a10b0 0x7f328c11d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f328bfff700 1 -- 172.21.15.154:0/2288198966 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009430 con 0x7f328c134210 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f328b7fe700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f328c0a10b0 0x7f328c11d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f328affd700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c11dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f328bfff700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c134210 0x7f328c11e260 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f328400efc0 tx=0x7f328400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f3273fff700 1 -- 172.21.15.154:0/2288198966 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328400cc90 con 0x7f328c134210 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f3273fff700 1 -- 172.21.15.154:0/2288198966 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328400f040 con 0x7f328c134210 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f3291dc8700 1 -- 172.21.15.154:0/2288198966 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c09a2c0 con 0x7f328c134210 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f3273fff700 1 -- 172.21.15.154:0/2288198966 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840146c0 con 0x7f328c134210 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.877+0000 7f3291dc8700 1 -- 172.21.15.154:0/2288198966 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c120640 con 0x7f328c134210 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.878+0000 7f3273fff700 1 -- 172.21.15.154:0/2288198966 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3284014820 con 0x7f328c134210 2023-09-30T22:27:27.881 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.878+0000 7f3273fff700 1 -- 172.21.15.154:0/2288198966 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3284040200 con 0x7f328c134210 2023-09-30T22:27:27.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.879+0000 7f3291dc8700 1 -- 172.21.15.154:0/2288198966 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c11a590 con 0x7f328c134210 2023-09-30T22:27:27.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.884+0000 7f3273fff700 1 -- 172.21.15.154:0/2288198966 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3284018080 con 0x7f328c134210 2023-09-30T22:27:27.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.916+0000 7f43065bd700 1 Processor -- start 2023-09-30T22:27:27.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f43065bd700 1 -- start start 2023-09-30T22:27:27.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f43065bd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f430009ad40 0x7f4300133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f43065bd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4300133f70 0x7f43001343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f43065bd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430009b110 con 0x7f43000a0a70 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f43065bd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43000a3b60 con 0x7f430009ad40 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f43065bd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43001348e0 con 0x7f4300133f70 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f42fffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f430009ad40 0x7f4300133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f42ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4300133f70 0x7f43001343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f42fffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f430009ad40 0x7f4300133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35376/0 (socket says 172.21.15.154:35376) 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.917+0000 7f42fffff700 1 -- 172.21.15.154:0/2212263262 learned_addr learned my addr 172.21.15.154:0/2212263262 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f42ff7fe700 1 -- 172.21.15.154:0/2212263262 >> v2:172.21.15.154:3300/0 conn(0x7f430009ad40 msgr2=0x7f4300133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f42ff7fe700 1 --2- 172.21.15.154:0/2212263262 >> v2:172.21.15.154:3300/0 conn(0x7f430009ad40 0x7f4300133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f42ff7fe700 1 -- 172.21.15.154:0/2212263262 >> v1:172.21.15.154:6789/0 conn(0x7f43000a0a70 legacy=0x7f43000a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f42ff7fe700 1 -- 172.21.15.154:0/2212263262 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43000a2fa0 con 0x7f4300133f70 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f42fffff700 1 --2- 172.21.15.154:0/2212263262 >> v2:172.21.15.154:3300/0 conn(0x7f430009ad40 0x7f4300133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f42ff7fe700 1 --2- 172.21.15.154:0/2212263262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4300133f70 0x7f43001343a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009840 tx=0x7f42f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63ee3e354cb4c911 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f42feffd700 1 -- 172.21.15.154:0/2212263262 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4011830 con 0x7f4300133f70 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f42feffd700 1 -- 172.21.15.154:0/2212263262 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f4011990 con 0x7f4300133f70 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f42feffd700 1 -- 172.21.15.154:0/2212263262 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4011d20 con 0x7f4300133f70 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f43065bd700 1 -- 172.21.15.154:0/2212263262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4300133f70 msgr2=0x7f43001343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.918+0000 7f43065bd700 1 --2- 172.21.15.154:0/2212263262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4300133f70 0x7f43001343a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009840 tx=0x7f42f4009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.919+0000 7f43065bd700 1 -- 172.21.15.154:0/2212263262 shutdown_connections 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.919+0000 7f43065bd700 1 --2- 172.21.15.154:0/2212263262 >> v2:172.21.15.154:3300/0 conn(0x7f430009ad40 0x7f4300133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.919+0000 7f43065bd700 1 --2- 172.21.15.154:0/2212263262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4300133f70 0x7f43001343a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.919+0000 7f43065bd700 1 -- 172.21.15.154:0/2212263262 >> 172.21.15.154:0/2212263262 conn(0x7f4300099c40 msgr2=0x7f430006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.919+0000 7f43065bd700 1 -- 172.21.15.154:0/2212263262 shutdown_connections 2023-09-30T22:27:27.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.919+0000 7f43065bd700 1 -- 172.21.15.154:0/2212263262 wait complete. 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.919+0000 7f43065bd700 1 Processor -- start 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f43065bd700 1 -- start start 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f43065bd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f430009ad40 0x7f430011e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f43065bd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43000a0a70 0x7f430011e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f43065bd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4300133f70 0x7f430011eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f43065bd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4300122530 con 0x7f43000a0a70 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f43065bd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430011fc60 con 0x7f430009ad40 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f43065bd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4300120280 con 0x7f4300133f70 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f42fffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f430009ad40 0x7f430011e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f42fffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f430009ad40 0x7f430011e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37238/0 (socket says 172.21.15.154:37238) 2023-09-30T22:27:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f42fffff700 1 -- 172.21.15.154:0/660763508 learned_addr learned my addr 172.21.15.154:0/660763508 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f4304b5a700 1 --2- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4300133f70 0x7f430011eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.920+0000 7f42ff7fe700 1 --2- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43000a0a70 0x7f430011e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f42fffff700 1 -- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4300133f70 msgr2=0x7f430011eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f42fffff700 1 --2- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4300133f70 0x7f430011eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f42fffff700 1 -- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43000a0a70 msgr2=0x7f430011e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f42fffff700 1 --2- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43000a0a70 0x7f430011e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f42fffff700 1 -- 172.21.15.154:0/660763508 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0009550 con 0x7f430009ad40 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f42fffff700 1 --2- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f430009ad40 0x7f430011e0a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f42f000e9e0 tx=0x7f42f000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f42fcff9700 1 -- 172.21.15.154:0/660763508 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f000ee80 con 0x7f430009ad40 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f42fcff9700 1 -- 172.21.15.154:0/660763508 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f000c850 con 0x7f430009ad40 2023-09-30T22:27:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f42fcff9700 1 -- 172.21.15.154:0/660763508 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f000cbc0 con 0x7f430009ad40 2023-09-30T22:27:27.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f43065bd700 1 -- 172.21.15.154:0/660763508 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f40094a0 con 0x7f430009ad40 2023-09-30T22:27:27.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.921+0000 7f43065bd700 1 -- 172.21.15.154:0/660763508 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43000a0ed0 con 0x7f430009ad40 2023-09-30T22:27:27.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.922+0000 7f42fcff9700 1 -- 172.21.15.154:0/660763508 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42f000cd20 con 0x7f430009ad40 2023-09-30T22:27:27.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.922+0000 7f42fcff9700 1 -- 172.21.15.154:0/660763508 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f42f003fa60 con 0x7f430009ad40 2023-09-30T22:27:27.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.922+0000 7f43065bd700 1 -- 172.21.15.154:0/660763508 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430009ed10 con 0x7f430009ad40 2023-09-30T22:27:27.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.927+0000 7f42fcff9700 1 -- 172.21.15.154:0/660763508 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42f001b3b0 con 0x7f430009ad40 2023-09-30T22:27:27.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6be896700 1 Processor -- start 2023-09-30T22:27:27.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6be896700 1 -- start start 2023-09-30T22:27:27.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6be896700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6b80a0a70 0x7ff6b80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6be896700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a1380 0x7ff6b8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6be896700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b8133f50 0x7ff6b81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6be896700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b809e9d0 con 0x7ff6b80a0a70 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6be896700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b809dc00 con 0x7ff6b8133f50 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6be896700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b809dec0 con 0x7ff6b80a1380 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6b7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6b80a0a70 0x7ff6b80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6b7fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6b80a0a70 0x7ff6b80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35404/0 (socket says 172.21.15.154:35404) 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6b7fff700 1 -- 172.21.15.154:0/3114037948 learned_addr learned my addr 172.21.15.154:0/3114037948 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6b77fe700 1 --2- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a1380 0x7ff6b8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.952+0000 7ff6bce33700 1 --2- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b8133f50 0x7ff6b81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.953+0000 7ff6b7fff700 1 -- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a1380 msgr2=0x7ff6b8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.953+0000 7ff6b7fff700 1 --2- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a1380 0x7ff6b8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.953+0000 7ff6b7fff700 1 -- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b8133f50 msgr2=0x7ff6b81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:27.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.953+0000 7ff6b7fff700 1 --2- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b8133f50 0x7ff6b81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.953+0000 7ff6b7fff700 1 -- 172.21.15.154:0/3114037948 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b809e6a0 con 0x7ff6b80a0a70 2023-09-30T22:27:27.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.953+0000 7ff6b7fff700 1 --2- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b80a0a70 0x7ff6b80a0e40 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80098f0 tx=0x7ff6a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bb0ba50b0774a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.953+0000 7ff6b6ffd700 1 -- 172.21.15.154:0/3114037948 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8011830 con 0x7ff6b80a0a70 2023-09-30T22:27:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.953+0000 7ff6b6ffd700 1 -- 172.21.15.154:0/3114037948 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8011990 con 0x7ff6b80a0a70 2023-09-30T22:27:27.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.953+0000 7ff6b6ffd700 1 -- 172.21.15.154:0/3114037948 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8011d20 con 0x7ff6b80a0a70 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.954+0000 7ff6be896700 1 -- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b80a0a70 msgr2=0x7ff6b80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.954+0000 7ff6be896700 1 --2- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b80a0a70 0x7ff6b80a0e40 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80098f0 tx=0x7ff6a8009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.954+0000 7ff6be896700 1 -- 172.21.15.154:0/3114037948 shutdown_connections 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.954+0000 7ff6be896700 1 --2- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b8133f50 0x7ff6b81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.954+0000 7ff6be896700 1 --2- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b80a0a70 0x7ff6b80a0e40 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.954+0000 7ff6be896700 1 --2- 172.21.15.154:0/3114037948 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a1380 0x7ff6b8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.954+0000 7ff6be896700 1 -- 172.21.15.154:0/3114037948 >> 172.21.15.154:0/3114037948 conn(0x7ff6b80a6610 msgr2=0x7ff6b80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.954+0000 7ff6be896700 1 -- 172.21.15.154:0/3114037948 shutdown_connections 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.954+0000 7ff6be896700 1 -- 172.21.15.154:0/3114037948 wait complete. 2023-09-30T22:27:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.955+0000 7ff6be896700 1 Processor -- start 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.955+0000 7ff6be896700 1 -- start start 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6be896700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a0a70 0x7ff6b81c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6be896700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b80a1380 0x7ff6b81c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6be896700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b8133f50 0x7ff6b81c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6be896700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b8121950 con 0x7ff6b8133f50 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6be896700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b8121b30 con 0x7ff6b80a1380 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6be896700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b81c17d0 con 0x7ff6b80a0a70 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6b7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a0a70 0x7ff6b81c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6bce33700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b8133f50 0x7ff6b81c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6b7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a0a70 0x7ff6b81c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36594/0 (socket says 172.21.15.154:36594) 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6b7fff700 1 -- 172.21.15.154:0/934878365 learned_addr learned my addr 172.21.15.154:0/934878365 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6b77fe700 1 --2- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b80a1380 0x7ff6b81c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6bce33700 1 -- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a0a70 msgr2=0x7ff6b81c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6bce33700 1 --2- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a0a70 0x7ff6b81c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6bce33700 1 -- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b80a1380 msgr2=0x7ff6b81c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6bce33700 1 --2- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b80a1380 0x7ff6b81c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6bce33700 1 -- 172.21.15.154:0/934878365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8009550 con 0x7ff6b8133f50 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6b7fff700 1 --2- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a0a70 0x7ff6b81c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6bce33700 1 --2- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b8133f50 0x7ff6b81c3d70 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00042c0 tx=0x7ff6b00045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6b4ff9700 1 -- 172.21.15.154:0/934878365 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0019040 con 0x7ff6b8133f50 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6b4ff9700 1 -- 172.21.15.154:0/934878365 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b00110d0 con 0x7ff6b8133f50 2023-09-30T22:27:27.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6b4ff9700 1 -- 172.21.15.154:0/934878365 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0011440 con 0x7ff6b8133f50 2023-09-30T22:27:27.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.956+0000 7ff6be896700 1 -- 172.21.15.154:0/934878365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b80a03e0 con 0x7ff6b8133f50 2023-09-30T22:27:27.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.957+0000 7ff6be896700 1 -- 172.21.15.154:0/934878365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b811fc20 con 0x7ff6b8133f50 2023-09-30T22:27:27.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.957+0000 7ff6b4ff9700 1 -- 172.21.15.154:0/934878365 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6b00115a0 con 0x7ff6b8133f50 2023-09-30T22:27:27.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.958+0000 7ff6be896700 1 -- 172.21.15.154:0/934878365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b8121770 con 0x7ff6b8133f50 2023-09-30T22:27:27.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.958+0000 7ff6b4ff9700 1 -- 172.21.15.154:0/934878365 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff6b0048420 con 0x7ff6b8133f50 2023-09-30T22:27:27.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:27.962+0000 7ff6b4ff9700 1 -- 172.21.15.154:0/934878365 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6b0024310 con 0x7ff6b8133f50 2023-09-30T22:27:28.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.083+0000 7f3291dc8700 1 -- 172.21.15.154:0/2288198966 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f328c04f2a0 con 0x7f328c134210 2023-09-30T22:27:28.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.084+0000 7f3273fff700 1 -- 172.21.15.154:0/2288198966 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3284009e60 con 0x7f328c134210 2023-09-30T22:27:28.084 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.086+0000 7f3291dc8700 1 -- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c134210 msgr2=0x7f328c11e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.086+0000 7f3291dc8700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c134210 0x7f328c11e260 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f328400efc0 tx=0x7f328400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.086+0000 7f3291dc8700 1 -- 172.21.15.154:0/2288198966 shutdown_connections 2023-09-30T22:27:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.086+0000 7f3291dc8700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f328c134210 0x7f328c11e260 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.086+0000 7f3291dc8700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f328c0a10b0 0x7f328c11d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.086+0000 7f3291dc8700 1 --2- 172.21.15.154:0/2288198966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f328c133900 0x7f328c11dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.086+0000 7f3291dc8700 1 -- 172.21.15.154:0/2288198966 >> 172.21.15.154:0/2288198966 conn(0x7f328c0a2980 msgr2=0x7f328c1bada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.087+0000 7f3291dc8700 1 -- 172.21.15.154:0/2288198966 shutdown_connections 2023-09-30T22:27:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.087+0000 7f3291dc8700 1 -- 172.21.15.154:0/2288198966 wait complete. 2023-09-30T22:27:28.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:28.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.124+0000 7f43065bd700 1 -- 172.21.15.154:0/660763508 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f430009c7e0 con 0x7f430009ad40 2023-09-30T22:27:28.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.125+0000 7f42fcff9700 1 -- 172.21.15.154:0/660763508 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42f0021030 con 0x7f430009ad40 2023-09-30T22:27:28.125 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.126+0000 7f43065bd700 1 -- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f430009ad40 msgr2=0x7f430011e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.126+0000 7f43065bd700 1 --2- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f430009ad40 0x7f430011e0a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f42f000e9e0 tx=0x7f42f000ecf0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.127+0000 7f43065bd700 1 -- 172.21.15.154:0/660763508 shutdown_connections 2023-09-30T22:27:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.127+0000 7f43065bd700 1 --2- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4300133f70 0x7f430011eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.127+0000 7f43065bd700 1 --2- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f430009ad40 0x7f430011e0a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.127+0000 7f43065bd700 1 --2- 172.21.15.154:0/660763508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43000a0a70 0x7f430011e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.127+0000 7f43065bd700 1 -- 172.21.15.154:0/660763508 >> 172.21.15.154:0/660763508 conn(0x7f4300099c40 msgr2=0x7f4300133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.127+0000 7f43065bd700 1 -- 172.21.15.154:0/660763508 shutdown_connections 2023-09-30T22:27:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.127+0000 7f43065bd700 1 -- 172.21.15.154:0/660763508 wait complete. 2023-09-30T22:27:28.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:28.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.155+0000 7ff6be896700 1 -- 172.21.15.154:0/934878365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff6b804f2a0 con 0x7ff6b8133f50 2023-09-30T22:27:28.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.155+0000 7ff6b4ff9700 1 -- 172.21.15.154:0/934878365 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6b001cb00 con 0x7ff6b8133f50 2023-09-30T22:27:28.155 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:28.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.158+0000 7ff6be896700 1 -- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b8133f50 msgr2=0x7ff6b81c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.158+0000 7ff6be896700 1 --2- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b8133f50 0x7ff6b81c3d70 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00042c0 tx=0x7ff6b00045d0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.158+0000 7ff6be896700 1 -- 172.21.15.154:0/934878365 shutdown_connections 2023-09-30T22:27:28.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.158+0000 7ff6be896700 1 --2- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b8133f50 0x7ff6b81c3d70 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.158+0000 7ff6be896700 1 --2- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff6b80a0a70 0x7ff6b81c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.158+0000 7ff6be896700 1 --2- 172.21.15.154:0/934878365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b80a1380 0x7ff6b81c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.158+0000 7ff6be896700 1 -- 172.21.15.154:0/934878365 >> 172.21.15.154:0/934878365 conn(0x7ff6b80a6610 msgr2=0x7ff6b809b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.158+0000 7ff6be896700 1 -- 172.21.15.154:0/934878365 shutdown_connections 2023-09-30T22:27:28.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.158+0000 7ff6be896700 1 -- 172.21.15.154:0/934878365 wait complete. 2023-09-30T22:27:28.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:28.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:28.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.578+0000 7fa9554e8700 1 Processor -- start 2023-09-30T22:27:28.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.578+0000 7fa9554e8700 1 -- start start 2023-09-30T22:27:28.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa9554e8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9500a0a90 0x7fa9500a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa9554e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950134140 0x7fa95013bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa9554e8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9500a1fe0 con 0x7fa9500a13a0 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa9554e8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9500a3aa0 con 0x7fa9500a0a90 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa9554e8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95009a540 con 0x7fa950134140 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9500a0a90 0x7fa9500a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950134140 0x7fa95013bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9500a0a90 0x7fa9500a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35414/0 (socket says 172.21.15.154:35414) 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950134140 0x7fa95013bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37268/0 (socket says 172.21.15.154:37268) 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94effd700 1 -- 172.21.15.154:0/1926907032 learned_addr learned my addr 172.21.15.154:0/1926907032 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94effd700 1 -- 172.21.15.154:0/1926907032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950134140 msgr2=0x7fa95013bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94effd700 1 --2- 172.21.15.154:0/1926907032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950134140 0x7fa95013bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94effd700 1 -- 172.21.15.154:0/1926907032 >> v1:172.21.15.154:6789/0 conn(0x7fa9500a13a0 legacy=0x7fa950133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94effd700 1 -- 172.21.15.154:0/1926907032 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95009a280 con 0x7fa9500a0a90 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94f7fe700 1 --2- 172.21.15.154:0/1926907032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950134140 0x7fa95013bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94effd700 1 --2- 172.21.15.154:0/1926907032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9500a0a90 0x7fa9500a0e60 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098f0 tx=0x7fa944009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7daac510b660c31 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94dffb700 1 -- 172.21.15.154:0/1926907032 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011830 con 0x7fa9500a0a90 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94dffb700 1 -- 172.21.15.154:0/1926907032 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944011990 con 0x7fa9500a0a90 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.579+0000 7fa94dffb700 1 -- 172.21.15.154:0/1926907032 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011d20 con 0x7fa9500a0a90 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.580+0000 7fa9554e8700 1 -- 172.21.15.154:0/1926907032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9500a0a90 msgr2=0x7fa9500a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.580+0000 7fa9554e8700 1 --2- 172.21.15.154:0/1926907032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9500a0a90 0x7fa9500a0e60 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098f0 tx=0x7fa944009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.580+0000 7fa9554e8700 1 -- 172.21.15.154:0/1926907032 shutdown_connections 2023-09-30T22:27:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.580+0000 7fa9554e8700 1 --2- 172.21.15.154:0/1926907032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa950134140 0x7fa95013bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.580+0000 7fa9554e8700 1 --2- 172.21.15.154:0/1926907032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9500a0a90 0x7fa9500a0e60 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.580+0000 7fa9554e8700 1 -- 172.21.15.154:0/1926907032 >> 172.21.15.154:0/1926907032 conn(0x7fa950099c40 msgr2=0x7fa95006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.580+0000 7fa9554e8700 1 -- 172.21.15.154:0/1926907032 shutdown_connections 2023-09-30T22:27:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.580+0000 7fa9554e8700 1 -- 172.21.15.154:0/1926907032 wait complete. 2023-09-30T22:27:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa9554e8700 1 Processor -- start 2023-09-30T22:27:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa9554e8700 1 -- start start 2023-09-30T22:27:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa9554e8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9500a0a90 0x7fa950122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa9554e8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9500a13a0 0x7fa950122880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa9554e8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950134140 0x7fa950122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa9554e8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa950124e00 con 0x7fa950134140 2023-09-30T22:27:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa9554e8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501240f0 con 0x7fa9500a0a90 2023-09-30T22:27:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa9554e8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa950123f00 con 0x7fa9500a13a0 2023-09-30T22:27:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa94f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950134140 0x7fa950122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.581+0000 7fa94effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9500a0a90 0x7fa950122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9500a13a0 0x7fa950122880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950134140 0x7fa950122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35416/0 (socket says 172.21.15.154:35416) 2023-09-30T22:27:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94f7fe700 1 -- 172.21.15.154:0/423513407 learned_addr learned my addr 172.21.15.154:0/423513407 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9500a0a90 0x7fa950122340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37272/0 (socket says 172.21.15.154:37272) 2023-09-30T22:27:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94effd700 1 -- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9500a13a0 msgr2=0x7fa950122880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94effd700 1 --2- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9500a13a0 0x7fa950122880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94effd700 1 -- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950134140 msgr2=0x7fa950122dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94effd700 1 --2- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950134140 0x7fa950122dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94effd700 1 -- 172.21.15.154:0/423513407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948009a70 con 0x7fa9500a0a90 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94f7fe700 1 --2- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950134140 0x7fa950122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa94effd700 1 --2- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9500a0a90 0x7fa950122340 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa944016000 tx=0x7fa944004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa9377fe700 1 -- 172.21.15.154:0/423513407 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944004400 con 0x7fa9500a0a90 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa9377fe700 1 -- 172.21.15.154:0/423513407 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94401f070 con 0x7fa9500a0a90 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa9377fe700 1 -- 172.21.15.154:0/423513407 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440038e0 con 0x7fa9500a0a90 2023-09-30T22:27:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa9554e8700 1 -- 172.21.15.154:0/423513407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa944009550 con 0x7fa9500a0a90 2023-09-30T22:27:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.582+0000 7fa9554e8700 1 -- 172.21.15.154:0/423513407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa950125870 con 0x7fa9500a0a90 2023-09-30T22:27:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.583+0000 7fa9377fe700 1 -- 172.21.15.154:0/423513407 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa944021030 con 0x7fa9500a0a90 2023-09-30T22:27:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.583+0000 7fa9377fe700 1 -- 172.21.15.154:0/423513407 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa944040a20 con 0x7fa9500a0a90 2023-09-30T22:27:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.583+0000 7fa9554e8700 1 -- 172.21.15.154:0/423513407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9501256c0 con 0x7fa9500a0a90 2023-09-30T22:27:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.588+0000 7fa9377fe700 1 -- 172.21.15.154:0/423513407 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa944015080 con 0x7fa9500a0a90 2023-09-30T22:27:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.769+0000 7fa9554e8700 1 -- 172.21.15.154:0/423513407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa95011f780 con 0x7fa9500a0a90 2023-09-30T22:27:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.770+0000 7fa9377fe700 1 -- 172.21.15.154:0/423513407 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa944004560 con 0x7fa9500a0a90 2023-09-30T22:27:28.770 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.771+0000 7fa9554e8700 1 -- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9500a0a90 msgr2=0x7fa950122340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.771+0000 7fa9554e8700 1 --2- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9500a0a90 0x7fa950122340 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa944016000 tx=0x7fa944004750 comp rx=0 tx=0).stop 2023-09-30T22:27:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.771+0000 7fa9554e8700 1 -- 172.21.15.154:0/423513407 shutdown_connections 2023-09-30T22:27:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.771+0000 7fa9554e8700 1 --2- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950134140 0x7fa950122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.771+0000 7fa9554e8700 1 --2- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9500a0a90 0x7fa950122340 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.771+0000 7fa9554e8700 1 --2- 172.21.15.154:0/423513407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa9500a13a0 0x7fa950122880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.771+0000 7fa9554e8700 1 -- 172.21.15.154:0/423513407 >> 172.21.15.154:0/423513407 conn(0x7fa950099c40 msgr2=0x7fa95011c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.772+0000 7fa9554e8700 1 -- 172.21.15.154:0/423513407 shutdown_connections 2023-09-30T22:27:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:28.772+0000 7fa9554e8700 1 -- 172.21.15.154:0/423513407 wait complete. 2023-09-30T22:27:28.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:29.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:29.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:29.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.230+0000 7fde2021e700 1 Processor -- start 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.230+0000 7fde2021e700 1 -- start start 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde2021e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde18131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde2021e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809bc70 0x7fde1809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde2021e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde1809c5c0 0x7fde18138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde2021e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde1806eb30 con 0x7fde1809c5c0 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde2021e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde180a1640 con 0x7fde1809bc70 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde2021e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde180a22d0 con 0x7fde18131980 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1d7b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809bc70 0x7fde1809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1dfba700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde18131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1d7b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809bc70 0x7fde1809c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37276/0 (socket says 172.21.15.154:37276) 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1dfba700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde18131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36612/0 (socket says 172.21.15.154:36612) 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1d7b9700 1 -- 172.21.15.154:0/255211719 learned_addr learned my addr 172.21.15.154:0/255211719 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1e7bb700 1 --2- 172.21.15.154:0/255211719 >> v2:172.21.15.154:3300/0 conn(0x7fde1809c5c0 0x7fde18138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1d7b9700 1 -- 172.21.15.154:0/255211719 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 msgr2=0x7fde18131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1d7b9700 1 --2- 172.21.15.154:0/255211719 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde18131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1d7b9700 1 -- 172.21.15.154:0/255211719 >> v2:172.21.15.154:3300/0 conn(0x7fde1809c5c0 msgr2=0x7fde18138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1d7b9700 1 --2- 172.21.15.154:0/255211719 >> v2:172.21.15.154:3300/0 conn(0x7fde1809c5c0 0x7fde18138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1d7b9700 1 -- 172.21.15.154:0/255211719 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18131550 con 0x7fde1809bc70 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.231+0000 7fde1dfba700 1 --2- 172.21.15.154:0/255211719 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde18131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.232+0000 7fde1d7b9700 1 --2- 172.21.15.154:0/255211719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809bc70 0x7fde1809c080 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fde080098f0 tx=0x7fde08009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cc08e85b898d86a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.232+0000 7fde1cfb8700 1 -- 172.21.15.154:0/255211719 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08010a90 con 0x7fde1809bc70 2023-09-30T22:27:29.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.232+0000 7fde1cfb8700 1 -- 172.21.15.154:0/255211719 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde08010bf0 con 0x7fde1809bc70 2023-09-30T22:27:29.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.232+0000 7fde1cfb8700 1 -- 172.21.15.154:0/255211719 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08018440 con 0x7fde1809bc70 2023-09-30T22:27:29.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.232+0000 7fde2021e700 1 -- 172.21.15.154:0/255211719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809bc70 msgr2=0x7fde1809c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.232+0000 7fde2021e700 1 --2- 172.21.15.154:0/255211719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809bc70 0x7fde1809c080 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fde080098f0 tx=0x7fde08009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:29.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.233+0000 7fde2021e700 1 -- 172.21.15.154:0/255211719 shutdown_connections 2023-09-30T22:27:29.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.233+0000 7fde2021e700 1 --2- 172.21.15.154:0/255211719 >> v2:172.21.15.154:3300/0 conn(0x7fde1809c5c0 0x7fde18138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.233+0000 7fde2021e700 1 --2- 172.21.15.154:0/255211719 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde18131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.233+0000 7fde2021e700 1 --2- 172.21.15.154:0/255211719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809bc70 0x7fde1809c080 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.233+0000 7fde2021e700 1 -- 172.21.15.154:0/255211719 >> 172.21.15.154:0/255211719 conn(0x7fde180a2980 msgr2=0x7fde180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.233+0000 7fde2021e700 1 -- 172.21.15.154:0/255211719 shutdown_connections 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.233+0000 7fde2021e700 1 -- 172.21.15.154:0/255211719 wait complete. 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde2021e700 1 Processor -- start 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde2021e700 1 -- start start 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde2021e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde1809bc70 0x7fde1811b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde2021e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809c5c0 0x7fde1811bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde2021e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde1811c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde2021e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1811eeb0 con 0x7fde1809bc70 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde2021e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde18130bd0 con 0x7fde1809c5c0 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde2021e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde180a1c40 con 0x7fde18131980 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde1dfba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde1809bc70 0x7fde1811b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde1dfba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde1809bc70 0x7fde1811b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35444/0 (socket says 172.21.15.154:35444) 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde1dfba700 1 -- 172.21.15.154:0/341811644 learned_addr learned my addr 172.21.15.154:0/341811644 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde1e7bb700 1 --2- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde1811c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.234+0000 7fde1d7b9700 1 --2- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809c5c0 0x7fde1811bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde1dfba700 1 -- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 msgr2=0x7fde1811c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde1dfba700 1 --2- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde1811c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde1dfba700 1 -- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809c5c0 msgr2=0x7fde1811bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde1dfba700 1 --2- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809c5c0 0x7fde1811bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde1dfba700 1 -- 172.21.15.154:0/341811644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde14009430 con 0x7fde1809bc70 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde1dfba700 1 --2- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde1809bc70 0x7fde1811b6b0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fde1400ebe0 tx=0x7fde1400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde0e7fc700 1 -- 172.21.15.154:0/341811644 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14005a20 con 0x7fde1809bc70 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde0e7fc700 1 -- 172.21.15.154:0/341811644 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde14005b80 con 0x7fde1809bc70 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde2021e700 1 -- 172.21.15.154:0/341811644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde08009550 con 0x7fde1809bc70 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde0e7fc700 1 -- 172.21.15.154:0/341811644 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400c850 con 0x7fde1809bc70 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.235+0000 7fde2021e700 1 -- 172.21.15.154:0/341811644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1811e4d0 con 0x7fde1809bc70 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.236+0000 7fde0e7fc700 1 -- 172.21.15.154:0/341811644 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde1400c9b0 con 0x7fde1809bc70 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.236+0000 7fde0e7fc700 1 -- 172.21.15.154:0/341811644 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde1403f930 con 0x7fde1809bc70 2023-09-30T22:27:29.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.236+0000 7fde2021e700 1 -- 172.21.15.154:0/341811644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1809f9c0 con 0x7fde1809bc70 2023-09-30T22:27:29.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.245+0000 7fde0e7fc700 1 -- 172.21.15.154:0/341811644 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde14022300 con 0x7fde1809bc70 2023-09-30T22:27:29.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.274+0000 7f855e277700 1 Processor -- start 2023-09-30T22:27:29.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.274+0000 7f855e277700 1 -- start start 2023-09-30T22:27:29.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f855e277700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f85581319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f855e277700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f8558131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f855e277700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f855809bc70 0x7f855809c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f855e277700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85580667e0 con 0x7f855809bc70 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f855e277700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580a23c0 con 0x7f85581314b0 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f855e277700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85580a0f20 con 0x7f8558066410 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f85577fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f8558131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f8557fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f85581319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f85577fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f8558131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37292/0 (socket says 172.21.15.154:37292) 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f85577fe700 1 -- 172.21.15.154:0/3680334321 learned_addr learned my addr 172.21.15.154:0/3680334321 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f855c814700 1 --2- 172.21.15.154:0/3680334321 >> v2:172.21.15.154:3300/0 conn(0x7f855809bc70 0x7f855809c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f8557fff700 1 -- 172.21.15.154:0/3680334321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 msgr2=0x7f8558131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f8557fff700 1 --2- 172.21.15.154:0/3680334321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f8558131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f8557fff700 1 -- 172.21.15.154:0/3680334321 >> v2:172.21.15.154:3300/0 conn(0x7f855809bc70 msgr2=0x7f855809c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f8557fff700 1 --2- 172.21.15.154:0/3680334321 >> v2:172.21.15.154:3300/0 conn(0x7f855809bc70 0x7f855809c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f8557fff700 1 -- 172.21.15.154:0/3680334321 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580a16e0 con 0x7f8558066410 2023-09-30T22:27:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f85577fe700 1 --2- 172.21.15.154:0/3680334321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f8558131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.275+0000 7f8557fff700 1 --2- 172.21.15.154:0/3680334321 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f85581319f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8548009880 tx=0x7f8548009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22a478a6ad48ba76 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.276+0000 7f8556ffd700 1 -- 172.21.15.154:0/3680334321 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548005e30 con 0x7f8558066410 2023-09-30T22:27:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.276+0000 7f8556ffd700 1 -- 172.21.15.154:0/3680334321 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548006030 con 0x7f8558066410 2023-09-30T22:27:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.276+0000 7f8556ffd700 1 -- 172.21.15.154:0/3680334321 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85480063c0 con 0x7f8558066410 2023-09-30T22:27:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.276+0000 7f855e277700 1 -- 172.21.15.154:0/3680334321 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 msgr2=0x7f85581319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.276+0000 7f855e277700 1 --2- 172.21.15.154:0/3680334321 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f85581319f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8548009880 tx=0x7f8548009b90 comp rx=0 tx=0).stop 2023-09-30T22:27:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.277+0000 7f855e277700 1 -- 172.21.15.154:0/3680334321 shutdown_connections 2023-09-30T22:27:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.277+0000 7f855e277700 1 --2- 172.21.15.154:0/3680334321 >> v2:172.21.15.154:3300/0 conn(0x7f855809bc70 0x7f855809c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.277+0000 7f855e277700 1 --2- 172.21.15.154:0/3680334321 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f85581319f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.277+0000 7f855e277700 1 --2- 172.21.15.154:0/3680334321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f8558131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.277+0000 7f855e277700 1 -- 172.21.15.154:0/3680334321 >> 172.21.15.154:0/3680334321 conn(0x7f85580a2980 msgr2=0x7f85580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:29.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.277+0000 7f855e277700 1 -- 172.21.15.154:0/3680334321 shutdown_connections 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.277+0000 7f855e277700 1 -- 172.21.15.154:0/3680334321 wait complete. 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.277+0000 7f855e277700 1 Processor -- start 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f855e277700 1 -- start start 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f855e277700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f855811a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f855e277700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855809bc70 0x7f855811ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f855e277700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f855811b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f855e277700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855811d6a0 con 0x7f855809bc70 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f855e277700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855811e0f0 con 0x7f85581314b0 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f855e277700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f855811e2f0 con 0x7f8558066410 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f8557fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f855811a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f8557fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f855811a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36650/0 (socket says 172.21.15.154:36650) 2023-09-30T22:27:29.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f8557fff700 1 -- 172.21.15.154:0/2299018704 learned_addr learned my addr 172.21.15.154:0/2299018704 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.278+0000 7f855c814700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f855811b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f85577fe700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855809bc70 0x7f855811ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f8557fff700 1 -- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 msgr2=0x7f855811b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f8557fff700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f855811b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f8557fff700 1 -- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855809bc70 msgr2=0x7f855811ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f8557fff700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855809bc70 0x7f855811ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f8557fff700 1 -- 172.21.15.154:0/2299018704 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c009550 con 0x7f8558066410 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f85577fe700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855809bc70 0x7f855811ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f8557fff700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f855811a860 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8548009ee0 tx=0x7f8548004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f8554ff9700 1 -- 172.21.15.154:0/2299018704 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548020820 con 0x7f8558066410 2023-09-30T22:27:29.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f8554ff9700 1 -- 172.21.15.154:0/2299018704 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548024070 con 0x7f8558066410 2023-09-30T22:27:29.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f8554ff9700 1 -- 172.21.15.154:0/2299018704 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548020be0 con 0x7f8558066410 2023-09-30T22:27:29.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f855e277700 1 -- 172.21.15.154:0/2299018704 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8548009430 con 0x7f8558066410 2023-09-30T22:27:29.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.279+0000 7f855e277700 1 -- 172.21.15.154:0/2299018704 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8558130a70 con 0x7f8558066410 2023-09-30T22:27:29.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.280+0000 7f855e277700 1 -- 172.21.15.154:0/2299018704 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855809e8b0 con 0x7f8558066410 2023-09-30T22:27:29.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.280+0000 7f8554ff9700 1 -- 172.21.15.154:0/2299018704 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8548026030 con 0x7f8558066410 2023-09-30T22:27:29.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.282+0000 7f8554ff9700 1 -- 172.21.15.154:0/2299018704 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8548028cd0 con 0x7f8558066410 2023-09-30T22:27:29.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.285+0000 7f8554ff9700 1 -- 172.21.15.154:0/2299018704 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f854804a060 con 0x7f8558066410 2023-09-30T22:27:29.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.318+0000 7f3ed6926700 1 Processor -- start 2023-09-30T22:27:29.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.318+0000 7f3ed6926700 1 -- start start 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ed6926700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed00a1550 0x7f3ed0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ed6926700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ed6926700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed009e9d0 con 0x7f3ed00a0a70 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ed6926700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed009dc00 con 0x7f3ed0139200 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ed6926700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed009dec0 con 0x7f3ed00a1550 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ecf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed00a1550 0x7f3ed0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ed4ec3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ecf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed00a1550 0x7f3ed0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36662/0 (socket says 172.21.15.154:36662) 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ecf7fe700 1 -- 172.21.15.154:0/938026709 learned_addr learned my addr 172.21.15.154:0/938026709 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:29.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ecf7fe700 1 -- 172.21.15.154:0/938026709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 msgr2=0x7f3ed013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ecf7fe700 1 --2- 172.21.15.154:0/938026709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ecf7fe700 1 -- 172.21.15.154:0/938026709 >> v1:172.21.15.154:6789/0 conn(0x7f3ed00a0a70 legacy=0x7f3ed00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ecf7fe700 1 -- 172.21.15.154:0/938026709 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed009e6a0 con 0x7f3ed00a1550 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ed4ec3700 1 --2- 172.21.15.154:0/938026709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.319+0000 7f3ecf7fe700 1 --2- 172.21.15.154:0/938026709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed00a1550 0x7f3ed0138cc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009920 tx=0x7f3ec4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21414f1388587b8c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3eceffd700 1 -- 172.21.15.154:0/938026709 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4011830 con 0x7f3ed00a1550 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3eceffd700 1 -- 172.21.15.154:0/938026709 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4011990 con 0x7f3ed00a1550 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3eceffd700 1 -- 172.21.15.154:0/938026709 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4011d20 con 0x7f3ed00a1550 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3ed6926700 1 -- 172.21.15.154:0/938026709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed00a1550 msgr2=0x7f3ed0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3ed6926700 1 --2- 172.21.15.154:0/938026709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed00a1550 0x7f3ed0138cc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009920 tx=0x7f3ec4009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3ed6926700 1 -- 172.21.15.154:0/938026709 shutdown_connections 2023-09-30T22:27:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3ed6926700 1 --2- 172.21.15.154:0/938026709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3ed6926700 1 --2- 172.21.15.154:0/938026709 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed00a1550 0x7f3ed0138cc0 secure :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009920 tx=0x7f3ec4009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:29.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3ed6926700 1 -- 172.21.15.154:0/938026709 >> 172.21.15.154:0/938026709 conn(0x7f3ed00a6610 msgr2=0x7f3ed00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:29.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3ed6926700 1 -- 172.21.15.154:0/938026709 shutdown_connections 2023-09-30T22:27:29.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.320+0000 7f3ed6926700 1 -- 172.21.15.154:0/938026709 wait complete. 2023-09-30T22:27:29.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.321+0000 7f3ed6926700 1 Processor -- start 2023-09-30T22:27:29.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.321+0000 7f3ed6926700 1 -- start start 2023-09-30T22:27:29.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ed6926700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed00a0a70 0x7f3ed01c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ed6926700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed01c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ed6926700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed01c8fe0 0x7f3ed0134580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ed6926700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0121800 con 0x7f3ed00a0a70 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ed6926700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0121db0 con 0x7f3ed0139200 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ed6926700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00a03e0 con 0x7f3ed01c8fe0 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed00a0a70 0x7f3ed01c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed00a0a70 0x7f3ed01c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35480/0 (socket says 172.21.15.154:35480) 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecffff700 1 -- 172.21.15.154:0/2465010034 learned_addr learned my addr 172.21.15.154:0/2465010034 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecf7fe700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed01c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ed4ec3700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed01c8fe0 0x7f3ed0134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecf7fe700 1 -- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed01c8fe0 msgr2=0x7f3ed0134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecf7fe700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed01c8fe0 0x7f3ed0134580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecf7fe700 1 -- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed00a0a70 msgr2=0x7f3ed01c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecf7fe700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed00a0a70 0x7f3ed01c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecf7fe700 1 -- 172.21.15.154:0/2465010034 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec8009a70 con 0x7f3ed0139200 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ed4ec3700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed01c8fe0 0x7f3ed0134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.322+0000 7f3ecffff700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed00a0a70 0x7f3ed01c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.323+0000 7f3ecf7fe700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed01c8aa0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4016000 tx=0x7f3ec4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.323+0000 7f3eccff9700 1 -- 172.21.15.154:0/2465010034 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4004240 con 0x7f3ed0139200 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.323+0000 7f3eccff9700 1 -- 172.21.15.154:0/2465010034 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec401f070 con 0x7f3ed0139200 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.323+0000 7f3ed6926700 1 -- 172.21.15.154:0/2465010034 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec4009550 con 0x7f3ed0139200 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.323+0000 7f3eccff9700 1 -- 172.21.15.154:0/2465010034 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40045e0 con 0x7f3ed0139200 2023-09-30T22:27:29.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.323+0000 7f3ed6926700 1 -- 172.21.15.154:0/2465010034 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed0121f80 con 0x7f3ed0139200 2023-09-30T22:27:29.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.324+0000 7f3eccff9700 1 -- 172.21.15.154:0/2465010034 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ec4021030 con 0x7f3ed0139200 2023-09-30T22:27:29.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.324+0000 7f3eccff9700 1 -- 172.21.15.154:0/2465010034 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ec4040720 con 0x7f3ed0139200 2023-09-30T22:27:29.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.324+0000 7f3ed6926700 1 -- 172.21.15.154:0/2465010034 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed004f2a0 con 0x7f3ed0139200 2023-09-30T22:27:29.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.333+0000 7f3eccff9700 1 -- 172.21.15.154:0/2465010034 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ec4015080 con 0x7f3ed0139200 2023-09-30T22:27:29.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.453+0000 7fde2021e700 1 -- 172.21.15.154:0/341811644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fde1804f2a0 con 0x7fde1809bc70 2023-09-30T22:27:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.453+0000 7fde0e7fc700 1 -- 172.21.15.154:0/341811644 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde1402a090 con 0x7fde1809bc70 2023-09-30T22:27:29.454 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:29.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.455+0000 7fde2021e700 1 -- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde1809bc70 msgr2=0x7fde1811b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.455+0000 7fde2021e700 1 --2- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde1809bc70 0x7fde1811b6b0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fde1400ebe0 tx=0x7fde1400eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.456+0000 7fde2021e700 1 -- 172.21.15.154:0/341811644 shutdown_connections 2023-09-30T22:27:29.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.456+0000 7fde2021e700 1 --2- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fde18131980 0x7fde1811c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.456+0000 7fde2021e700 1 --2- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde1809bc70 0x7fde1811b6b0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.456+0000 7fde2021e700 1 --2- 172.21.15.154:0/341811644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde1809c5c0 0x7fde1811bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.456+0000 7fde2021e700 1 -- 172.21.15.154:0/341811644 >> 172.21.15.154:0/341811644 conn(0x7fde180a2980 msgr2=0x7fde18071590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:29.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.456+0000 7fde2021e700 1 -- 172.21.15.154:0/341811644 shutdown_connections 2023-09-30T22:27:29.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.456+0000 7fde2021e700 1 -- 172.21.15.154:0/341811644 wait complete. 2023-09-30T22:27:29.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:29.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.481+0000 7f855e277700 1 -- 172.21.15.154:0/2299018704 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f85580a1d50 con 0x7f8558066410 2023-09-30T22:27:29.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.481+0000 7f8554ff9700 1 -- 172.21.15.154:0/2299018704 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f854804a070 con 0x7f8558066410 2023-09-30T22:27:29.481 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:29.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.483+0000 7f855e277700 1 -- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 msgr2=0x7f855811a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.483+0000 7f855e277700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f855811a860 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8548009ee0 tx=0x7f8548004750 comp rx=0 tx=0).stop 2023-09-30T22:27:29.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.483+0000 7f855e277700 1 -- 172.21.15.154:0/2299018704 shutdown_connections 2023-09-30T22:27:29.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.483+0000 7f855e277700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85581314b0 0x7f855811b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.483+0000 7f855e277700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8558066410 0x7f855811a860 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.483+0000 7f855e277700 1 --2- 172.21.15.154:0/2299018704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f855809bc70 0x7f855811ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.483+0000 7f855e277700 1 -- 172.21.15.154:0/2299018704 >> 172.21.15.154:0/2299018704 conn(0x7f85580a2980 msgr2=0x7f85581b8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:29.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.483+0000 7f855e277700 1 -- 172.21.15.154:0/2299018704 shutdown_connections 2023-09-30T22:27:29.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.483+0000 7f855e277700 1 -- 172.21.15.154:0/2299018704 wait complete. 2023-09-30T22:27:29.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:29.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.527+0000 7f3ed6926700 1 -- 172.21.15.154:0/2465010034 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ed00a5590 con 0x7f3ed0139200 2023-09-30T22:27:29.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.527+0000 7f3eccff9700 1 -- 172.21.15.154:0/2465010034 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ec400b7e0 con 0x7f3ed0139200 2023-09-30T22:27:29.527 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.529+0000 7f3ed6926700 1 -- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 msgr2=0x7f3ed01c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.529+0000 7f3ed6926700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed01c8aa0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4016000 tx=0x7f3ec4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.529+0000 7f3ed6926700 1 -- 172.21.15.154:0/2465010034 shutdown_connections 2023-09-30T22:27:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.529+0000 7f3ed6926700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ed01c8fe0 0x7f3ed0134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.529+0000 7f3ed6926700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ed00a0a70 0x7f3ed01c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.529+0000 7f3ed6926700 1 --2- 172.21.15.154:0/2465010034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ed0139200 0x7f3ed01c8aa0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.530+0000 7f3ed6926700 1 -- 172.21.15.154:0/2465010034 >> 172.21.15.154:0/2465010034 conn(0x7f3ed00a6610 msgr2=0x7f3ed0135c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.530+0000 7f3ed6926700 1 -- 172.21.15.154:0/2465010034 shutdown_connections 2023-09-30T22:27:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.530+0000 7f3ed6926700 1 -- 172.21.15.154:0/2465010034 wait complete. 2023-09-30T22:27:29.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:29.784 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:29.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.907+0000 7fbe8b17c700 1 Processor -- start 2023-09-30T22:27:29.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.907+0000 7fbe8b17c700 1 -- start start 2023-09-30T22:27:29.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe8b17c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe8406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe8b17c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe8406b080 0x7fbe841317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe8b17c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe84131cf0 0x7fbe84132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe8b17c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8409f770 con 0x7fbe8406b080 2023-09-30T22:27:29.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe8b17c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8409dce0 con 0x7fbe8406a770 2023-09-30T22:27:29.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe8b17c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8409da80 con 0x7fbe84131cf0 2023-09-30T22:27:29.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe89719700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe84131cf0 0x7fbe84132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe88f18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe8406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe83fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe8406b080 0x7fbe841317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe83fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe8406b080 0x7fbe841317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35486/0 (socket says 172.21.15.154:35486) 2023-09-30T22:27:29.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe89719700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe84131cf0 0x7fbe84132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36686/0 (socket says 172.21.15.154:36686) 2023-09-30T22:27:29.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe88f18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe8406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37326/0 (socket says 172.21.15.154:37326) 2023-09-30T22:27:29.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe83fff700 1 -- 172.21.15.154:0/3242144432 learned_addr learned my addr 172.21.15.154:0/3242144432 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:29.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe83fff700 1 -- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe84131cf0 msgr2=0x7fbe84132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:29.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe83fff700 1 --2- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe84131cf0 0x7fbe84132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe83fff700 1 -- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 msgr2=0x7fbe8406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:29.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe83fff700 1 --2- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe8406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe83fff700 1 -- 172.21.15.154:0/3242144432 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8409eb20 con 0x7fbe8406b080 2023-09-30T22:27:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.908+0000 7fbe88f18700 1 --2- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe8406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe83fff700 1 --2- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe8406b080 0x7fbe841317b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fbe700098f0 tx=0x7fbe70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc07de6221162229 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe837fe700 1 -- 172.21.15.154:0/3242144432 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70011830 con 0x7fbe8406b080 2023-09-30T22:27:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe837fe700 1 -- 172.21.15.154:0/3242144432 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe70011990 con 0x7fbe8406b080 2023-09-30T22:27:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe837fe700 1 -- 172.21.15.154:0/3242144432 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70011d20 con 0x7fbe8406b080 2023-09-30T22:27:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe8b17c700 1 -- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe8406b080 msgr2=0x7fbe841317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe8b17c700 1 --2- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe8406b080 0x7fbe841317b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fbe700098f0 tx=0x7fbe70009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:29.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe8b17c700 1 -- 172.21.15.154:0/3242144432 shutdown_connections 2023-09-30T22:27:29.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe8b17c700 1 --2- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe8406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe8b17c700 1 --2- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe84131cf0 0x7fbe84132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe8b17c700 1 --2- 172.21.15.154:0/3242144432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe8406b080 0x7fbe841317b0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe8b17c700 1 -- 172.21.15.154:0/3242144432 >> 172.21.15.154:0/3242144432 conn(0x7fbe84099c40 msgr2=0x7fbe840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:29.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe8b17c700 1 -- 172.21.15.154:0/3242144432 shutdown_connections 2023-09-30T22:27:29.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.909+0000 7fbe8b17c700 1 -- 172.21.15.154:0/3242144432 wait complete. 2023-09-30T22:27:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.910+0000 7fbe8b17c700 1 Processor -- start 2023-09-30T22:27:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.910+0000 7fbe8b17c700 1 -- start start 2023-09-30T22:27:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe8b17c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe841c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe8b17c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8406b080 0x7fbe841c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe8b17c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe84131cf0 0x7fbe841c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe8b17c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8411d4d0 con 0x7fbe84131cf0 2023-09-30T22:27:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe8b17c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8411d930 con 0x7fbe8406a770 2023-09-30T22:27:29.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe8b17c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840a2910 con 0x7fbe8406b080 2023-09-30T22:27:29.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe88f18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe841c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe83fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8406b080 0x7fbe841c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe89719700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe84131cf0 0x7fbe841c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:29.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe88f18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe841c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37328/0 (socket says 172.21.15.154:37328) 2023-09-30T22:27:29.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe88f18700 1 -- 172.21.15.154:0/4031636484 learned_addr learned my addr 172.21.15.154:0/4031636484 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:29.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe89719700 1 -- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8406b080 msgr2=0x7fbe841c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe89719700 1 --2- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8406b080 0x7fbe841c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe89719700 1 -- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 msgr2=0x7fbe841c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:29.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe89719700 1 --2- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe841c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:29.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe89719700 1 -- 172.21.15.154:0/4031636484 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe780094a0 con 0x7fbe84131cf0 2023-09-30T22:27:29.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe83fff700 1 --2- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8406b080 0x7fbe841c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:29.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe88f18700 1 --2- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe841c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:29.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe89719700 1 --2- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe84131cf0 0x7fbe841c6990 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009d90 tx=0x7fbe7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:29.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe817fa700 1 -- 172.21.15.154:0/4031636484 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c009c00 con 0x7fbe84131cf0 2023-09-30T22:27:29.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe817fa700 1 -- 172.21.15.154:0/4031636484 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c00f040 con 0x7fbe84131cf0 2023-09-30T22:27:29.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe8b17c700 1 -- 172.21.15.154:0/4031636484 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe70009550 con 0x7fbe84131cf0 2023-09-30T22:27:29.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.911+0000 7fbe817fa700 1 -- 172.21.15.154:0/4031636484 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c014480 con 0x7fbe84131cf0 2023-09-30T22:27:29.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.912+0000 7fbe8b17c700 1 -- 172.21.15.154:0/4031636484 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8411db40 con 0x7fbe84131cf0 2023-09-30T22:27:29.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.912+0000 7fbe817fa700 1 -- 172.21.15.154:0/4031636484 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe7c0145e0 con 0x7fbe84131cf0 2023-09-30T22:27:29.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.912+0000 7fbe817fa700 1 -- 172.21.15.154:0/4031636484 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe7c040260 con 0x7fbe84131cf0 2023-09-30T22:27:29.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.912+0000 7fbe8b17c700 1 -- 172.21.15.154:0/4031636484 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8404f2a0 con 0x7fbe84131cf0 2023-09-30T22:27:29.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:29.917+0000 7fbe817fa700 1 -- 172.21.15.154:0/4031636484 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe7c012910 con 0x7fbe84131cf0 2023-09-30T22:27:30.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.104+0000 7fbe8b17c700 1 -- 172.21.15.154:0/4031636484 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe8411ed70 con 0x7fbe84131cf0 2023-09-30T22:27:30.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.105+0000 7fbe817fa700 1 -- 172.21.15.154:0/4031636484 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe7c02c090 con 0x7fbe84131cf0 2023-09-30T22:27:30.105 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.107+0000 7fbe8b17c700 1 -- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe84131cf0 msgr2=0x7fbe841c6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.107+0000 7fbe8b17c700 1 --2- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe84131cf0 0x7fbe841c6990 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009d90 tx=0x7fbe7c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.107+0000 7fbe8b17c700 1 -- 172.21.15.154:0/4031636484 shutdown_connections 2023-09-30T22:27:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.107+0000 7fbe8b17c700 1 --2- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe84131cf0 0x7fbe841c6990 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.107+0000 7fbe8b17c700 1 --2- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe8406a770 0x7fbe841c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.107+0000 7fbe8b17c700 1 --2- 172.21.15.154:0/4031636484 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe8406b080 0x7fbe841c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.107+0000 7fbe8b17c700 1 -- 172.21.15.154:0/4031636484 >> 172.21.15.154:0/4031636484 conn(0x7fbe84099c40 msgr2=0x7fbe840a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.107+0000 7fbe8b17c700 1 -- 172.21.15.154:0/4031636484 shutdown_connections 2023-09-30T22:27:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.107+0000 7fbe8b17c700 1 -- 172.21.15.154:0/4031636484 wait complete. 2023-09-30T22:27:30.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:30.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:30.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:30.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.599+0000 7f0ac0107700 1 Processor -- start 2023-09-30T22:27:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.599+0000 7f0ac0107700 1 -- start start 2023-09-30T22:27:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.599+0000 7f0ac0107700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab8133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.599+0000 7f0ac0107700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ab8099a60 0x7f0ab80a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.599+0000 7f0ac0107700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab809aa00 con 0x7f0ab80a0e20 2023-09-30T22:27:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.599+0000 7f0ac0107700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab809a080 con 0x7f0ab8099a60 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.599+0000 7f0ac0107700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8133750 con 0x7f0ab8133b80 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abd6a2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ab8099a60 0x7f0ab80a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abd6a2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ab8099a60 0x7f0ab80a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35510/0 (socket says 172.21.15.154:35510) 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abd6a2700 1 -- 172.21.15.154:0/822969872 learned_addr learned my addr 172.21.15.154:0/822969872 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abdea3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab8133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abd6a2700 1 -- 172.21.15.154:0/822969872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 msgr2=0x7f0ab8133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abd6a2700 1 --2- 172.21.15.154:0/822969872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab8133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abd6a2700 1 -- 172.21.15.154:0/822969872 >> v1:172.21.15.154:6789/0 conn(0x7f0ab80a0e20 legacy=0x7f0ab813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abd6a2700 1 -- 172.21.15.154:0/822969872 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab809a760 con 0x7f0ab8099a60 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abcea1700 1 -- 172.21.15.154:0/822969872 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857548295 0 0) 0x7f0ab809aa00 con 0x7f0ab80a0e20 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abdea3700 1 --2- 172.21.15.154:0/822969872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab8133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abd6a2700 1 --2- 172.21.15.154:0/822969872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 0x7f0ab80a08e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80098f0 tx=0x7f0aa8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e66292af0a710e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abcea1700 1 -- 172.21.15.154:0/822969872 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011830 con 0x7f0ab8099a60 2023-09-30T22:27:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abcea1700 1 -- 172.21.15.154:0/822969872 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8011990 con 0x7f0ab8099a60 2023-09-30T22:27:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.600+0000 7f0abcea1700 1 -- 172.21.15.154:0/822969872 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011d20 con 0x7f0ab8099a60 2023-09-30T22:27:30.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.601+0000 7f0ac0107700 1 -- 172.21.15.154:0/822969872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 msgr2=0x7f0ab80a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.601+0000 7f0ac0107700 1 --2- 172.21.15.154:0/822969872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 0x7f0ab80a08e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80098f0 tx=0x7f0aa8009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.601+0000 7f0ac0107700 1 -- 172.21.15.154:0/822969872 shutdown_connections 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.601+0000 7f0ac0107700 1 --2- 172.21.15.154:0/822969872 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab8133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.601+0000 7f0ac0107700 1 --2- 172.21.15.154:0/822969872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 0x7f0ab80a08e0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.601+0000 7f0ac0107700 1 -- 172.21.15.154:0/822969872 >> 172.21.15.154:0/822969872 conn(0x7f0ab80a2980 msgr2=0x7f0ab80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.601+0000 7f0ac0107700 1 -- 172.21.15.154:0/822969872 shutdown_connections 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.601+0000 7f0ac0107700 1 -- 172.21.15.154:0/822969872 wait complete. 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.602+0000 7f0ac0107700 1 Processor -- start 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.602+0000 7f0ac0107700 1 -- start start 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0ac0107700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 0x7f0ab811d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0ac0107700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ab80a0e20 0x7f0ab811dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0ac0107700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab811e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0ac0107700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8120540 con 0x7f0ab8099a60 2023-09-30T22:27:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0ac0107700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab811eb20 con 0x7f0ab80a0e20 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0ac0107700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab8120f90 con 0x7f0ab8133b80 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abd6a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ab80a0e20 0x7f0ab811dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abd6a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ab80a0e20 0x7f0ab811dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37332/0 (socket says 172.21.15.154:37332) 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abd6a2700 1 -- 172.21.15.154:0/2051459822 learned_addr learned my addr 172.21.15.154:0/2051459822 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abdea3700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 0x7f0ab811d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abe6a4700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab811e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abd6a2700 1 -- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 msgr2=0x7f0ab811e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abd6a2700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab811e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abd6a2700 1 -- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 msgr2=0x7f0ab811d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abd6a2700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 0x7f0ab811d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abd6a2700 1 -- 172.21.15.154:0/2051459822 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab4009430 con 0x7f0ab80a0e20 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abe6a4700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab811e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abdea3700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 0x7f0ab811d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0abd6a2700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ab80a0e20 0x7f0ab811dbb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8013000 tx=0x7f0aa8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.603+0000 7f0aae7fc700 1 -- 172.21.15.154:0/2051459822 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8004340 con 0x7f0ab80a0e20 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.604+0000 7f0ac0107700 1 -- 172.21.15.154:0/2051459822 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa8009550 con 0x7f0ab80a0e20 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.604+0000 7f0aae7fc700 1 -- 172.21.15.154:0/2051459822 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa801f070 con 0x7f0ab80a0e20 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.604+0000 7f0aae7fc700 1 -- 172.21.15.154:0/2051459822 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa80036a0 con 0x7f0ab80a0e20 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.604+0000 7f0ac0107700 1 -- 172.21.15.154:0/2051459822 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab811f320 con 0x7f0ab80a0e20 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.604+0000 7f0aae7fc700 1 -- 172.21.15.154:0/2051459822 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0aa8021030 con 0x7f0ab80a0e20 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.604+0000 7f0aae7fc700 1 -- 172.21.15.154:0/2051459822 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0aa80409c0 con 0x7f0ab80a0e20 2023-09-30T22:27:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.605+0000 7f0ac0107700 1 -- 172.21.15.154:0/2051459822 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab809c270 con 0x7f0ab80a0e20 2023-09-30T22:27:30.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.609+0000 7f0aae7fc700 1 -- 172.21.15.154:0/2051459822 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0aa8015080 con 0x7f0ab80a0e20 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.643+0000 7f710d30c700 1 Processor -- start 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.643+0000 7f710d30c700 1 -- start start 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f710d30c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f710809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f710d30c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f710809f180 0x7f7108133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f710d30c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710809fa00 con 0x7f7108134160 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f710d30c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71080a0370 con 0x7f710809f180 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f710d30c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710806bec0 con 0x7f710809e870 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f7106ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f710809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f71067fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f710809f180 0x7f7108133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f7106ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f710809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37344/0 (socket says 172.21.15.154:37344) 2023-09-30T22:27:30.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f7106ffd700 1 -- 172.21.15.154:0/35334813 learned_addr learned my addr 172.21.15.154:0/35334813 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:30.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f71067fc700 1 -- 172.21.15.154:0/35334813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 msgr2=0x7f710809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:30.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f71067fc700 1 --2- 172.21.15.154:0/35334813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f710809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f71067fc700 1 -- 172.21.15.154:0/35334813 >> v1:172.21.15.154:6789/0 conn(0x7f7108134160 legacy=0x7f710813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f71067fc700 1 -- 172.21.15.154:0/35334813 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710809ada0 con 0x7f710809f180 2023-09-30T22:27:30.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f7105ffb700 1 -- 172.21.15.154:0/35334813 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655824150 0 0) 0x7f710809fa00 con 0x7f7108134160 2023-09-30T22:27:30.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f7106ffd700 1 --2- 172.21.15.154:0/35334813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f710809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.644+0000 7f71067fc700 1 --2- 172.21.15.154:0/35334813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f710809f180 0x7f7108133c20 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009840 tx=0x7f70fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6edd26b936e9e67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f7105ffb700 1 -- 172.21.15.154:0/35334813 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc011830 con 0x7f710809f180 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f7105ffb700 1 -- 172.21.15.154:0/35334813 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc011990 con 0x7f710809f180 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f7105ffb700 1 -- 172.21.15.154:0/35334813 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc011d20 con 0x7f710809f180 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f710d30c700 1 -- 172.21.15.154:0/35334813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f710809f180 msgr2=0x7f7108133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f710d30c700 1 --2- 172.21.15.154:0/35334813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f710809f180 0x7f7108133c20 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009840 tx=0x7f70fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f710d30c700 1 -- 172.21.15.154:0/35334813 shutdown_connections 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f710d30c700 1 --2- 172.21.15.154:0/35334813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f710809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f710d30c700 1 --2- 172.21.15.154:0/35334813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f710809f180 0x7f7108133c20 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f710d30c700 1 -- 172.21.15.154:0/35334813 >> 172.21.15.154:0/35334813 conn(0x7f71080a4430 msgr2=0x7f71080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f710d30c700 1 -- 172.21.15.154:0/35334813 shutdown_connections 2023-09-30T22:27:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.645+0000 7f710d30c700 1 -- 172.21.15.154:0/35334813 wait complete. 2023-09-30T22:27:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.647+0000 7f710d30c700 1 Processor -- start 2023-09-30T22:27:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.647+0000 7f710d30c700 1 -- start start 2023-09-30T22:27:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.647+0000 7f710d30c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f71081229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.647+0000 7f710d30c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f710809f180 0x7f7108122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.647+0000 7f710d30c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7108134160 0x7f7108123450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.647+0000 7f710d30c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7108133500 con 0x7f7108134160 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.647+0000 7f710d30c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7108125f40 con 0x7f710809e870 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.647+0000 7f710d30c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7108126450 con 0x7f710809f180 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f71067fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f710809f180 0x7f7108122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f71077fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7108134160 0x7f7108123450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f7106ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f71081229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f71067fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f710809f180 0x7f7108122f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36728/0 (socket says 172.21.15.154:36728) 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f71067fc700 1 -- 172.21.15.154:0/2685118215 learned_addr learned my addr 172.21.15.154:0/2685118215 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f7106ffd700 1 -- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f710809f180 msgr2=0x7f7108122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f7106ffd700 1 --2- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f710809f180 0x7f7108122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f7106ffd700 1 -- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7108134160 msgr2=0x7f7108123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f7106ffd700 1 --2- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7108134160 0x7f7108123450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f7106ffd700 1 -- 172.21.15.154:0/2685118215 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8009550 con 0x7f710809e870 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f71077fe700 1 --2- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7108134160 0x7f7108123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f71067fc700 1 --2- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f710809f180 0x7f7108122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f7106ffd700 1 --2- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f71081229d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f70f800b3c0 tx=0x7f70f800b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f70ef7fe700 1 -- 172.21.15.154:0/2685118215 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8019070 con 0x7f710809e870 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f70ef7fe700 1 -- 172.21.15.154:0/2685118215 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f800be40 con 0x7f710809e870 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f710d30c700 1 -- 172.21.15.154:0/2685118215 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc0094a0 con 0x7f710809e870 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.648+0000 7f70ef7fe700 1 -- 172.21.15.154:0/2685118215 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8004230 con 0x7f710809e870 2023-09-30T22:27:30.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.649+0000 7f710d30c700 1 -- 172.21.15.154:0/2685118215 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7108124540 con 0x7f710809e870 2023-09-30T22:27:30.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.649+0000 7f710d30c700 1 -- 172.21.15.154:0/2685118215 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710804f2a0 con 0x7f710809e870 2023-09-30T22:27:30.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.650+0000 7f70ef7fe700 1 -- 172.21.15.154:0/2685118215 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70f8004390 con 0x7f710809e870 2023-09-30T22:27:30.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.650+0000 7f70ef7fe700 1 -- 172.21.15.154:0/2685118215 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f70f8047c30 con 0x7f710809e870 2023-09-30T22:27:30.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.658+0000 7f70ef7fe700 1 -- 172.21.15.154:0/2685118215 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70f802e2f0 con 0x7f710809e870 2023-09-30T22:27:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.689+0000 7ff339b18700 1 Processor -- start 2023-09-30T22:27:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.689+0000 7ff339b18700 1 -- start start 2023-09-30T22:27:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.689+0000 7ff339b18700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3340a0a70 0x7ff3340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.689+0000 7ff339b18700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3340a1380 0x7ff334133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.689+0000 7ff339b18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff334133f50 0x7ff334134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.689+0000 7ff339b18700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33409e9d0 con 0x7ff3340a1380 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff339b18700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33409dc00 con 0x7ff334133f50 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff339b18700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff33409dec0 con 0x7ff3340a0a70 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff3337fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3340a0a70 0x7ff3340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff332ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3340a1380 0x7ff334133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff332ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3340a1380 0x7ff334133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35550/0 (socket says 172.21.15.154:35550) 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff3337fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3340a0a70 0x7ff3340a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36736/0 (socket says 172.21.15.154:36736) 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff332ffd700 1 -- 172.21.15.154:0/4046588352 learned_addr learned my addr 172.21.15.154:0/4046588352 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff333fff700 1 --2- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff334133f50 0x7ff334134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff332ffd700 1 -- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3340a0a70 msgr2=0x7ff3340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff332ffd700 1 --2- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3340a0a70 0x7ff3340a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff332ffd700 1 -- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff334133f50 msgr2=0x7ff334134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff332ffd700 1 --2- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff334133f50 0x7ff334134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff332ffd700 1 -- 172.21.15.154:0/4046588352 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33409e6a0 con 0x7ff3340a1380 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff3337fe700 1 --2- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3340a0a70 0x7ff3340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff332ffd700 1 --2- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a1380 0x7ff334133a10 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0098f0 tx=0x7ff31c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe40427de0c6912 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff3327fc700 1 -- 172.21.15.154:0/4046588352 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c011830 con 0x7ff3340a1380 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff3327fc700 1 -- 172.21.15.154:0/4046588352 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c011990 con 0x7ff3340a1380 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.690+0000 7ff3327fc700 1 -- 172.21.15.154:0/4046588352 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c011d20 con 0x7ff3340a1380 2023-09-30T22:27:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.691+0000 7ff339b18700 1 -- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a1380 msgr2=0x7ff334133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.691+0000 7ff339b18700 1 --2- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a1380 0x7ff334133a10 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0098f0 tx=0x7ff31c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.691+0000 7ff339b18700 1 -- 172.21.15.154:0/4046588352 shutdown_connections 2023-09-30T22:27:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.691+0000 7ff339b18700 1 --2- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff334133f50 0x7ff334134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.691+0000 7ff339b18700 1 --2- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff3340a0a70 0x7ff3340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.691+0000 7ff339b18700 1 --2- 172.21.15.154:0/4046588352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a1380 0x7ff334133a10 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.691+0000 7ff339b18700 1 -- 172.21.15.154:0/4046588352 >> 172.21.15.154:0/4046588352 conn(0x7ff3340a6610 msgr2=0x7ff3340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.691+0000 7ff339b18700 1 -- 172.21.15.154:0/4046588352 shutdown_connections 2023-09-30T22:27:30.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.691+0000 7ff339b18700 1 -- 172.21.15.154:0/4046588352 wait complete. 2023-09-30T22:27:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.692+0000 7ff339b18700 1 Processor -- start 2023-09-30T22:27:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.692+0000 7ff339b18700 1 -- start start 2023-09-30T22:27:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff339b18700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a0a70 0x7ff334122390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff339b18700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3340a1380 0x7ff3341228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff339b18700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff334133f50 0x7ff334122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff339b18700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff334133760 con 0x7ff3340a0a70 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff339b18700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341237f0 con 0x7ff3340a1380 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff339b18700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff334124e30 con 0x7ff334133f50 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff332ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3340a1380 0x7ff3341228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff332ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3340a1380 0x7ff3341228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37374/0 (socket says 172.21.15.154:37374) 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff332ffd700 1 -- 172.21.15.154:0/412252405 learned_addr learned my addr 172.21.15.154:0/412252405 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff333fff700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff334133f50 0x7ff334122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff3337fe700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a0a70 0x7ff334122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff332ffd700 1 -- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff334133f50 msgr2=0x7ff334122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff332ffd700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff334133f50 0x7ff334122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff332ffd700 1 -- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a0a70 msgr2=0x7ff334122390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff332ffd700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a0a70 0x7ff334122390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff332ffd700 1 -- 172.21.15.154:0/412252405 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324009a70 con 0x7ff3340a1380 2023-09-30T22:27:30.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff333fff700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff334133f50 0x7ff334122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff3337fe700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a0a70 0x7ff334122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:30.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff332ffd700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3340a1380 0x7ff3341228d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff31c013000 tx=0x7ff31c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:30.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff32bfff700 1 -- 172.21.15.154:0/412252405 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c004240 con 0x7ff3340a1380 2023-09-30T22:27:30.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff32bfff700 1 -- 172.21.15.154:0/412252405 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c01f070 con 0x7ff3340a1380 2023-09-30T22:27:30.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff339b18700 1 -- 172.21.15.154:0/412252405 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c009550 con 0x7ff3340a1380 2023-09-30T22:27:30.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.693+0000 7ff32bfff700 1 -- 172.21.15.154:0/412252405 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0045e0 con 0x7ff3340a1380 2023-09-30T22:27:30.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.694+0000 7ff339b18700 1 -- 172.21.15.154:0/412252405 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3340a5180 con 0x7ff3340a1380 2023-09-30T22:27:30.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.694+0000 7ff32bfff700 1 -- 172.21.15.154:0/412252405 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff31c021030 con 0x7ff3340a1380 2023-09-30T22:27:30.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.694+0000 7ff32bfff700 1 -- 172.21.15.154:0/412252405 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff31c0408b0 con 0x7ff3340a1380 2023-09-30T22:27:30.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.694+0000 7ff339b18700 1 -- 172.21.15.154:0/412252405 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3341251f0 con 0x7ff3340a1380 2023-09-30T22:27:30.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.699+0000 7ff32bfff700 1 -- 172.21.15.154:0/412252405 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff31c015080 con 0x7ff3340a1380 2023-09-30T22:27:30.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.822+0000 7f0ac0107700 1 -- 172.21.15.154:0/2051459822 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ab811a590 con 0x7f0ab80a0e20 2023-09-30T22:27:30.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.822+0000 7f0aae7fc700 1 -- 172.21.15.154:0/2051459822 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0aa80199a0 con 0x7f0ab80a0e20 2023-09-30T22:27:30.822 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:30.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.824+0000 7f0ac0107700 1 -- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ab80a0e20 msgr2=0x7f0ab811dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.824+0000 7f0ac0107700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ab80a0e20 0x7f0ab811dbb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8013000 tx=0x7f0aa8004750 comp rx=0 tx=0).stop 2023-09-30T22:27:30.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.824+0000 7f0ac0107700 1 -- 172.21.15.154:0/2051459822 shutdown_connections 2023-09-30T22:27:30.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.824+0000 7f0ac0107700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ab8133b80 0x7f0ab811e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.824+0000 7f0ac0107700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab8099a60 0x7f0ab811d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.824+0000 7f0ac0107700 1 --2- 172.21.15.154:0/2051459822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ab80a0e20 0x7f0ab811dbb0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.824+0000 7f0ac0107700 1 -- 172.21.15.154:0/2051459822 >> 172.21.15.154:0/2051459822 conn(0x7f0ab80a2980 msgr2=0x7f0ab81bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.824+0000 7f0ac0107700 1 -- 172.21.15.154:0/2051459822 shutdown_connections 2023-09-30T22:27:30.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.824+0000 7f0ac0107700 1 -- 172.21.15.154:0/2051459822 wait complete. 2023-09-30T22:27:30.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:30.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.872+0000 7f710d30c700 1 -- 172.21.15.154:0/2685118215 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f710806c9d0 con 0x7f710809e870 2023-09-30T22:27:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.873+0000 7f70ef7fe700 1 -- 172.21.15.154:0/2685118215 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70f8022020 con 0x7f710809e870 2023-09-30T22:27:30.873 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.875+0000 7f710d30c700 1 -- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 msgr2=0x7f71081229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.875+0000 7f710d30c700 1 --2- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f71081229d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f70f800b3c0 tx=0x7f70f800b6d0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.875+0000 7f710d30c700 1 -- 172.21.15.154:0/2685118215 shutdown_connections 2023-09-30T22:27:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.875+0000 7f710d30c700 1 --2- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7108134160 0x7f7108123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.875+0000 7f710d30c700 1 --2- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f710809e870 0x7f71081229d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.875+0000 7f710d30c700 1 --2- 172.21.15.154:0/2685118215 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f710809f180 0x7f7108122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.875+0000 7f710d30c700 1 -- 172.21.15.154:0/2685118215 >> 172.21.15.154:0/2685118215 conn(0x7f71080a4430 msgr2=0x7f7108070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.875+0000 7f710d30c700 1 -- 172.21.15.154:0/2685118215 shutdown_connections 2023-09-30T22:27:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.875+0000 7f710d30c700 1 -- 172.21.15.154:0/2685118215 wait complete. 2023-09-30T22:27:30.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:30.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.893+0000 7ff339b18700 1 -- 172.21.15.154:0/412252405 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff33411f760 con 0x7ff3340a1380 2023-09-30T22:27:30.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.894+0000 7ff32bfff700 1 -- 172.21.15.154:0/412252405 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff31c02d440 con 0x7ff3340a1380 2023-09-30T22:27:30.893 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:30.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.896+0000 7ff339b18700 1 -- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3340a1380 msgr2=0x7ff3341228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:30.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.896+0000 7ff339b18700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3340a1380 0x7ff3341228d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff31c013000 tx=0x7ff31c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:30.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.896+0000 7ff339b18700 1 -- 172.21.15.154:0/412252405 shutdown_connections 2023-09-30T22:27:30.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.896+0000 7ff339b18700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff334133f50 0x7ff334122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.896+0000 7ff339b18700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3340a0a70 0x7ff334122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.896+0000 7ff339b18700 1 --2- 172.21.15.154:0/412252405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3340a1380 0x7ff3341228d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:30.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.896+0000 7ff339b18700 1 -- 172.21.15.154:0/412252405 >> 172.21.15.154:0/412252405 conn(0x7ff3340a6610 msgr2=0x7ff33411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:30.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.896+0000 7ff339b18700 1 -- 172.21.15.154:0/412252405 shutdown_connections 2023-09-30T22:27:30.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:30.896+0000 7ff339b18700 1 -- 172.21.15.154:0/412252405 wait complete. 2023-09-30T22:27:30.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:31.120 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:31.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d5edf0700 1 Processor -- start 2023-09-30T22:27:31.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d5edf0700 1 -- start start 2023-09-30T22:27:31.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d5edf0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58136960 0x7f7d58138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d5edf0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d58139280 0x7f7d5813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d5edf0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5806b2d0 con 0x7f7d58133ad0 2023-09-30T22:27:31.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d5edf0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d581345b0 con 0x7f7d58139280 2023-09-30T22:27:31.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d5edf0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58133610 con 0x7f7d58136960 2023-09-30T22:27:31.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d5d38d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d58139280 0x7f7d5813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d57fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58136960 0x7f7d58138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d57fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58136960 0x7f7d58138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37390/0 (socket says 172.21.15.154:37390) 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d57fff700 1 -- 172.21.15.154:0/2578511047 learned_addr learned my addr 172.21.15.154:0/2578511047 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.245+0000 7f7d5d38d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d58139280 0x7f7d5813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35578/0 (socket says 172.21.15.154:35578) 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d57fff700 1 -- 172.21.15.154:0/2578511047 >> v2:172.21.15.154:3300/0 conn(0x7f7d58139280 msgr2=0x7f7d5813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d57fff700 1 --2- 172.21.15.154:0/2578511047 >> v2:172.21.15.154:3300/0 conn(0x7f7d58139280 0x7f7d5813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d57fff700 1 -- 172.21.15.154:0/2578511047 >> v1:172.21.15.154:6789/0 conn(0x7f7d58133ad0 legacy=0x7f7d58133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d57fff700 1 -- 172.21.15.154:0/2578511047 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5809a500 con 0x7f7d58136960 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d5d38d700 1 --2- 172.21.15.154:0/2578511047 >> v2:172.21.15.154:3300/0 conn(0x7f7d58139280 0x7f7d5813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d57fff700 1 --2- 172.21.15.154:0/2578511047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58136960 0x7f7d58138d40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009920 tx=0x7f7d44009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eff19699fc00f18 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d577fe700 1 -- 172.21.15.154:0/2578511047 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44011830 con 0x7f7d58136960 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d577fe700 1 -- 172.21.15.154:0/2578511047 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d44011990 con 0x7f7d58136960 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d577fe700 1 -- 172.21.15.154:0/2578511047 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44011d20 con 0x7f7d58136960 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.246+0000 7f7d5edf0700 1 -- 172.21.15.154:0/2578511047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58136960 msgr2=0x7f7d58138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.247+0000 7f7d5edf0700 1 --2- 172.21.15.154:0/2578511047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58136960 0x7f7d58138d40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009920 tx=0x7f7d44009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.247+0000 7f7d5edf0700 1 -- 172.21.15.154:0/2578511047 shutdown_connections 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.247+0000 7f7d5edf0700 1 --2- 172.21.15.154:0/2578511047 >> v2:172.21.15.154:3300/0 conn(0x7f7d58139280 0x7f7d5813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.247+0000 7f7d5edf0700 1 --2- 172.21.15.154:0/2578511047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58136960 0x7f7d58138d40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.247+0000 7f7d5edf0700 1 -- 172.21.15.154:0/2578511047 >> 172.21.15.154:0/2578511047 conn(0x7f7d58099c40 msgr2=0x7f7d580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.247+0000 7f7d5edf0700 1 -- 172.21.15.154:0/2578511047 shutdown_connections 2023-09-30T22:27:31.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.247+0000 7f7d5edf0700 1 -- 172.21.15.154:0/2578511047 wait complete. 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.247+0000 7f7d5edf0700 1 Processor -- start 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5edf0700 1 -- start start 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5edf0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58133ad0 0x7f7d580710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5edf0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d58136960 0x7f7d58071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5edf0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d58139280 0x7f7d58071b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5edf0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58138fe0 con 0x7f7d58139280 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5edf0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58072190 con 0x7f7d58133ad0 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5edf0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58070220 con 0x7f7d58136960 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5cb8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58133ad0 0x7f7d580710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5d38d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d58139280 0x7f7d58071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5cb8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58133ad0 0x7f7d580710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37396/0 (socket says 172.21.15.154:37396) 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5cb8c700 1 -- 172.21.15.154:0/3625400600 learned_addr learned my addr 172.21.15.154:0/3625400600 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d57fff700 1 --2- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d58136960 0x7f7d58071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5cb8c700 1 -- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d58136960 msgr2=0x7f7d58071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.248+0000 7f7d5cb8c700 1 --2- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d58136960 0x7f7d58071620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d5cb8c700 1 -- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d58139280 msgr2=0x7f7d58071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d5cb8c700 1 --2- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d58139280 0x7f7d58071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d5cb8c700 1 -- 172.21.15.154:0/3625400600 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d50009a70 con 0x7f7d58133ad0 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d5cb8c700 1 --2- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58133ad0 0x7f7d580710e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c450 tx=0x7f7d4c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d557fa700 1 -- 172.21.15.154:0/3625400600 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0052d0 con 0x7f7d58133ad0 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d557fa700 1 -- 172.21.15.154:0/3625400600 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c005430 con 0x7f7d58133ad0 2023-09-30T22:27:31.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d5edf0700 1 -- 172.21.15.154:0/3625400600 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d44009550 con 0x7f7d58133ad0 2023-09-30T22:27:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d557fa700 1 -- 172.21.15.154:0/3625400600 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0038c0 con 0x7f7d58133ad0 2023-09-30T22:27:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d5edf0700 1 -- 172.21.15.154:0/3625400600 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d58070c90 con 0x7f7d58133ad0 2023-09-30T22:27:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.249+0000 7f7d557fa700 1 -- 172.21.15.154:0/3625400600 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d4c003a20 con 0x7f7d58133ad0 2023-09-30T22:27:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.250+0000 7f7d557fa700 1 -- 172.21.15.154:0/3625400600 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d4c03ea10 con 0x7f7d58133ad0 2023-09-30T22:27:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.250+0000 7f7d5edf0700 1 -- 172.21.15.154:0/3625400600 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5804f2a0 con 0x7f7d58133ad0 2023-09-30T22:27:31.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.254+0000 7f7d557fa700 1 -- 172.21.15.154:0/3625400600 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d4c017070 con 0x7f7d58133ad0 2023-09-30T22:27:31.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.438+0000 7f7d5edf0700 1 -- 172.21.15.154:0/3625400600 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d5806fe50 con 0x7f7d58133ad0 2023-09-30T22:27:31.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.438+0000 7f7d557fa700 1 -- 172.21.15.154:0/3625400600 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d5806fe50 con 0x7f7d58133ad0 2023-09-30T22:27:31.438 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:31.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.440+0000 7f7d5edf0700 1 -- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58133ad0 msgr2=0x7f7d580710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.440+0000 7f7d5edf0700 1 --2- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58133ad0 0x7f7d580710e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c450 tx=0x7f7d4c00c760 comp rx=0 tx=0).stop 2023-09-30T22:27:31.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.440+0000 7f7d5edf0700 1 -- 172.21.15.154:0/3625400600 shutdown_connections 2023-09-30T22:27:31.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.440+0000 7f7d5edf0700 1 --2- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d58139280 0x7f7d58071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.440+0000 7f7d5edf0700 1 --2- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d58133ad0 0x7f7d580710e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.440+0000 7f7d5edf0700 1 --2- 172.21.15.154:0/3625400600 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d58136960 0x7f7d58071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.440+0000 7f7d5edf0700 1 -- 172.21.15.154:0/3625400600 >> 172.21.15.154:0/3625400600 conn(0x7f7d58099c40 msgr2=0x7f7d58134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.440+0000 7f7d5edf0700 1 -- 172.21.15.154:0/3625400600 shutdown_connections 2023-09-30T22:27:31.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.441+0000 7f7d5edf0700 1 -- 172.21.15.154:0/3625400600 wait complete. 2023-09-30T22:27:31.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:31.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:31.888 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:31.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.977+0000 7fee133af700 1 Processor -- start 2023-09-30T22:27:31.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.977+0000 7fee133af700 1 -- start start 2023-09-30T22:27:31.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee133af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c06a770 0x7fee0c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee133af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c131ec0 0x7fee0c139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee133af700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c09da80 con 0x7fee0c06b080 2023-09-30T22:27:31.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee133af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c09dce0 con 0x7fee0c131ec0 2023-09-30T22:27:31.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee133af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c09eb20 con 0x7fee0c06a770 2023-09-30T22:27:31.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee1114b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c06a770 0x7fee0c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee1114b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c06a770 0x7fee0c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36762/0 (socket says 172.21.15.154:36762) 2023-09-30T22:27:31.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee1114b700 1 -- 172.21.15.154:0/1117477448 learned_addr learned my addr 172.21.15.154:0/1117477448 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:31.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee1194c700 1 --2- 172.21.15.154:0/1117477448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c131ec0 0x7fee0c139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee03fff700 1 -- 172.21.15.154:0/1117477448 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254841772 0 0) 0x7fee0c09da80 con 0x7fee0c06b080 2023-09-30T22:27:31.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee03fff700 1 -- 172.21.15.154:0/1117477448 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf80035b0 con 0x7fee0c06b080 2023-09-30T22:27:31.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee1114b700 1 -- 172.21.15.154:0/1117477448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c131ec0 msgr2=0x7fee0c139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:31.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee1114b700 1 --2- 172.21.15.154:0/1117477448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c131ec0 0x7fee0c139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee1114b700 1 -- 172.21.15.154:0/1117477448 >> v1:172.21.15.154:6789/0 conn(0x7fee0c06b080 legacy=0x7fee0c1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.978+0000 7fee1114b700 1 -- 172.21.15.154:0/1117477448 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c09d860 con 0x7fee0c06a770 2023-09-30T22:27:31.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.979+0000 7fee1114b700 1 --2- 172.21.15.154:0/1117477448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c06a770 0x7fee0c06ab40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fee08009920 tx=0x7fee08009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4429c97d1662418 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.979+0000 7fee03fff700 1 -- 172.21.15.154:0/1117477448 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011830 con 0x7fee0c06a770 2023-09-30T22:27:31.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.979+0000 7fee03fff700 1 -- 172.21.15.154:0/1117477448 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08011990 con 0x7fee0c06a770 2023-09-30T22:27:31.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.979+0000 7fee03fff700 1 -- 172.21.15.154:0/1117477448 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011d20 con 0x7fee0c06a770 2023-09-30T22:27:31.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.979+0000 7fee133af700 1 -- 172.21.15.154:0/1117477448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c06a770 msgr2=0x7fee0c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.979+0000 7fee133af700 1 --2- 172.21.15.154:0/1117477448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c06a770 0x7fee0c06ab40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fee08009920 tx=0x7fee08009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:31.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.980+0000 7fee133af700 1 -- 172.21.15.154:0/1117477448 shutdown_connections 2023-09-30T22:27:31.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.980+0000 7fee133af700 1 --2- 172.21.15.154:0/1117477448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c131ec0 0x7fee0c139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.980+0000 7fee133af700 1 --2- 172.21.15.154:0/1117477448 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c06a770 0x7fee0c06ab40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.980+0000 7fee133af700 1 -- 172.21.15.154:0/1117477448 >> 172.21.15.154:0/1117477448 conn(0x7fee0c099c40 msgr2=0x7fee0c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:31.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.980+0000 7fee133af700 1 -- 172.21.15.154:0/1117477448 shutdown_connections 2023-09-30T22:27:31.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.980+0000 7fee133af700 1 -- 172.21.15.154:0/1117477448 wait complete. 2023-09-30T22:27:31.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.980+0000 7fee133af700 1 Processor -- start 2023-09-30T22:27:31.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee133af700 1 -- start start 2023-09-30T22:27:31.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee133af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee133af700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06b080 0x7fee0c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee133af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c131ec0 0x7fee0c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:31.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee133af700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c124bb0 con 0x7fee0c06b080 2023-09-30T22:27:31.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee133af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c123e30 con 0x7fee0c06a770 2023-09-30T22:27:31.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee133af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c1317b0 con 0x7fee0c131ec0 2023-09-30T22:27:31.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee1114b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee1094a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06b080 0x7fee0c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee1194c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c131ec0 0x7fee0c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee1114b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37414/0 (socket says 172.21.15.154:37414) 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee1114b700 1 -- 172.21.15.154:0/1305866686 learned_addr learned my addr 172.21.15.154:0/1305866686 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee1114b700 1 -- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c131ec0 msgr2=0x7fee0c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee1114b700 1 --2- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c131ec0 0x7fee0c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.981+0000 7fee1114b700 1 -- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06b080 msgr2=0x7fee0c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee1114b700 1 --2- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06b080 0x7fee0c09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee1114b700 1 -- 172.21.15.154:0/1305866686 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08009550 con 0x7fee0c06a770 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee1194c700 1 --2- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c131ec0 0x7fee0c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee1094a700 1 --2- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06b080 0x7fee0c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:31.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee1114b700 1 --2- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c09a490 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fee08000c00 tx=0x7fee08004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:31.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee01ffb700 1 -- 172.21.15.154:0/1305866686 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08004450 con 0x7fee0c06a770 2023-09-30T22:27:31.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee01ffb700 1 -- 172.21.15.154:0/1305866686 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee080045b0 con 0x7fee0c06a770 2023-09-30T22:27:31.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee01ffb700 1 -- 172.21.15.154:0/1305866686 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080038e0 con 0x7fee0c06a770 2023-09-30T22:27:31.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee133af700 1 -- 172.21.15.154:0/1305866686 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c071e10 con 0x7fee0c06a770 2023-09-30T22:27:31.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.982+0000 7fee133af700 1 -- 172.21.15.154:0/1305866686 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c124230 con 0x7fee0c06a770 2023-09-30T22:27:31.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.983+0000 7fee01ffb700 1 -- 172.21.15.154:0/1305866686 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee08003a40 con 0x7fee0c06a770 2023-09-30T22:27:31.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.983+0000 7fee01ffb700 1 -- 172.21.15.154:0/1305866686 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee08021030 con 0x7fee0c06a770 2023-09-30T22:27:31.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.983+0000 7fee133af700 1 -- 172.21.15.154:0/1305866686 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c11bde0 con 0x7fee0c06a770 2023-09-30T22:27:31.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:31.988+0000 7fee01ffb700 1 -- 172.21.15.154:0/1305866686 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee08003cf0 con 0x7fee0c06a770 2023-09-30T22:27:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.027+0000 7ff7e9007700 1 Processor -- start 2023-09-30T22:27:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.027+0000 7ff7e9007700 1 -- start start 2023-09-30T22:27:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e9007700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e9007700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 0x7ff7e4139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e9007700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e409da80 con 0x7ff7e406a770 2023-09-30T22:27:32.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e9007700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e409dce0 con 0x7ff7e4137140 2023-09-30T22:27:32.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e9007700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e406b620 con 0x7ff7e406b250 2023-09-30T22:27:32.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36790/0 (socket says 172.21.15.154:36790) 2023-09-30T22:27:32.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e259c700 1 -- 172.21.15.154:0/2687014686 learned_addr learned my addr 172.21.15.154:0/2687014686 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:32.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e359e700 1 --2- 172.21.15.154:0/2687014686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 0x7ff7e4139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e259c700 1 -- 172.21.15.154:0/2687014686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 msgr2=0x7ff7e4139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:32.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e259c700 1 --2- 172.21.15.154:0/2687014686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 0x7ff7e4139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e259c700 1 -- 172.21.15.154:0/2687014686 >> v1:172.21.15.154:6789/0 conn(0x7ff7e406a770 legacy=0x7ff7e406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.028+0000 7ff7e259c700 1 -- 172.21.15.154:0/2687014686 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e409eb20 con 0x7ff7e406b250 2023-09-30T22:27:32.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e259c700 1 --2- 172.21.15.154:0/2687014686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4136c00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009920 tx=0x7ff7d8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c99d5895cbd64d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e1d9b700 1 -- 172.21.15.154:0/2687014686 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8004230 con 0x7ff7e406b250 2023-09-30T22:27:32.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e1d9b700 1 -- 172.21.15.154:0/2687014686 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d8004390 con 0x7ff7e406b250 2023-09-30T22:27:32.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e1d9b700 1 -- 172.21.15.154:0/2687014686 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d80036a0 con 0x7ff7e406b250 2023-09-30T22:27:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e9007700 1 -- 172.21.15.154:0/2687014686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 msgr2=0x7ff7e4136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e9007700 1 --2- 172.21.15.154:0/2687014686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4136c00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009920 tx=0x7ff7d8009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e9007700 1 -- 172.21.15.154:0/2687014686 shutdown_connections 2023-09-30T22:27:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e9007700 1 --2- 172.21.15.154:0/2687014686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 0x7ff7e4139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e9007700 1 --2- 172.21.15.154:0/2687014686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4136c00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e9007700 1 -- 172.21.15.154:0/2687014686 >> 172.21.15.154:0/2687014686 conn(0x7ff7e4099c40 msgr2=0x7ff7e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e9007700 1 -- 172.21.15.154:0/2687014686 shutdown_connections 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.029+0000 7ff7e9007700 1 -- 172.21.15.154:0/2687014686 wait complete. 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e9007700 1 Processor -- start 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e9007700 1 -- start start 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e9007700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7e406a770 0x7ff7e41207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e9007700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4120ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e9007700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 0x7ff7e4121220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e9007700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4122bc0 con 0x7ff7e406a770 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e9007700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4071e10 con 0x7ff7e4137140 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e9007700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e41365d0 con 0x7ff7e406b250 2023-09-30T22:27:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7e406a770 0x7ff7e41207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e359e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 0x7ff7e4121220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7e406a770 0x7ff7e41207a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35610/0 (socket says 172.21.15.154:35610) 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e2d9d700 1 -- 172.21.15.154:0/1149751477 learned_addr learned my addr 172.21.15.154:0/1149751477 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.031+0000 7ff7e259c700 1 --2- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7e359e700 1 -- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 msgr2=0x7ff7e4120ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7e359e700 1 --2- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4120ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7e359e700 1 -- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7e406a770 msgr2=0x7ff7e41207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7e359e700 1 --2- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7e406a770 0x7ff7e41207a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7e359e700 1 -- 172.21.15.154:0/1149751477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8009550 con 0x7ff7e4137140 2023-09-30T22:27:32.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7e359e700 1 --2- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 0x7ff7e4121220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40a2f30 tx=0x7ff7dc00ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7cb7fe700 1 -- 172.21.15.154:0/1149751477 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc00cc20 con 0x7ff7e4137140 2023-09-30T22:27:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7cb7fe700 1 -- 172.21.15.154:0/1149751477 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc00f040 con 0x7ff7e4137140 2023-09-30T22:27:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7e9007700 1 -- 172.21.15.154:0/1149751477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e41242a0 con 0x7ff7e4137140 2023-09-30T22:27:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7cb7fe700 1 -- 172.21.15.154:0/1149751477 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc009e60 con 0x7ff7e4137140 2023-09-30T22:27:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.032+0000 7ff7e9007700 1 -- 172.21.15.154:0/1149751477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e41369a0 con 0x7ff7e4137140 2023-09-30T22:27:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.033+0000 7ff7cb7fe700 1 -- 172.21.15.154:0/1149751477 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7dc014480 con 0x7ff7e4137140 2023-09-30T22:27:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.033+0000 7ff7cb7fe700 1 -- 172.21.15.154:0/1149751477 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff7dc040160 con 0x7ff7e4137140 2023-09-30T22:27:32.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.033+0000 7ff7e9007700 1 -- 172.21.15.154:0/1149751477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e404f2a0 con 0x7ff7e4137140 2023-09-30T22:27:32.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.038+0000 7ff7cb7fe700 1 -- 172.21.15.154:0/1149751477 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7dc018020 con 0x7ff7e4137140 2023-09-30T22:27:32.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.069+0000 7f63475ea700 1 Processor -- start 2023-09-30T22:27:32.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.070+0000 7f63475ea700 1 -- start start 2023-09-30T22:27:32.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.070+0000 7f63475ea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f63400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.070+0000 7f63475ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63400a1380 0x7f6340133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.070+0000 7f63475ea700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634009dc00 con 0x7f6340133f50 2023-09-30T22:27:32.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.070+0000 7f63475ea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634009ea60 con 0x7f63400a0a70 2023-09-30T22:27:32.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.070+0000 7f63475ea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f634009dec0 con 0x7f63400a1380 2023-09-30T22:27:32.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.070+0000 7f6345386700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f63400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6345386700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f63400a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37436/0 (socket says 172.21.15.154:37436) 2023-09-30T22:27:32.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6345386700 1 -- 172.21.15.154:0/4056519249 learned_addr learned my addr 172.21.15.154:0/4056519249 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:32.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6344b85700 1 --2- 172.21.15.154:0/4056519249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63400a1380 0x7f6340133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6345b87700 1 --1- 172.21.15.154:0/4056519249 >> v1:172.21.15.154:6789/0 conn(0x7f6340133f50 0x7f634013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40812/0 (socket says 172.21.15.154:40812) 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6344b85700 1 -- 172.21.15.154:0/4056519249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 msgr2=0x7f63400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6344b85700 1 --2- 172.21.15.154:0/4056519249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f63400a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6344b85700 1 -- 172.21.15.154:0/4056519249 >> v1:172.21.15.154:6789/0 conn(0x7f6340133f50 legacy=0x7f634013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6337fff700 1 -- 172.21.15.154:0/4056519249 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11259902 0 0) 0x7f634009dc00 con 0x7f6340133f50 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6344b85700 1 -- 172.21.15.154:0/4056519249 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634009e6a0 con 0x7f63400a1380 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6345386700 1 --2- 172.21.15.154:0/4056519249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f63400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6344b85700 1 --2- 172.21.15.154:0/4056519249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63400a1380 0x7f6340133a10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6330009870 tx=0x7f6330009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af3090827dff4e1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6337fff700 1 -- 172.21.15.154:0/4056519249 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330011830 con 0x7f63400a1380 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6337fff700 1 -- 172.21.15.154:0/4056519249 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6330011990 con 0x7f63400a1380 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.071+0000 7f6337fff700 1 -- 172.21.15.154:0/4056519249 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330011d20 con 0x7f63400a1380 2023-09-30T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.072+0000 7f63475ea700 1 -- 172.21.15.154:0/4056519249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63400a1380 msgr2=0x7f6340133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.072+0000 7f63475ea700 1 --2- 172.21.15.154:0/4056519249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63400a1380 0x7f6340133a10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6330009870 tx=0x7f6330009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:32.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.072+0000 7f63475ea700 1 -- 172.21.15.154:0/4056519249 shutdown_connections 2023-09-30T22:27:32.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.072+0000 7f63475ea700 1 --2- 172.21.15.154:0/4056519249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f63400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.072+0000 7f63475ea700 1 --2- 172.21.15.154:0/4056519249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f63400a1380 0x7f6340133a10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.072+0000 7f63475ea700 1 -- 172.21.15.154:0/4056519249 >> 172.21.15.154:0/4056519249 conn(0x7f63400a6610 msgr2=0x7f63400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.072+0000 7f63475ea700 1 -- 172.21.15.154:0/4056519249 shutdown_connections 2023-09-30T22:27:32.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.072+0000 7f63475ea700 1 -- 172.21.15.154:0/4056519249 wait complete. 2023-09-30T22:27:32.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f63475ea700 1 Processor -- start 2023-09-30T22:27:32.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f63475ea700 1 -- start start 2023-09-30T22:27:32.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f63475ea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f6340122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f63475ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63400a1380 0x7f6340122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f63475ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6340133f50 0x7f6340123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f63475ea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6340126110 con 0x7f63400a1380 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f63475ea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6340123cf0 con 0x7f63400a0a70 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f63475ea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6340126360 con 0x7f6340133f50 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f6344b85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63400a1380 0x7f6340122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f6344b85700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63400a1380 0x7f6340122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35626/0 (socket says 172.21.15.154:35626) 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.073+0000 7f6344b85700 1 -- 172.21.15.154:0/233169334 learned_addr learned my addr 172.21.15.154:0/233169334 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6345386700 1 --2- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f6340122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6345b87700 1 --2- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6340133f50 0x7f6340123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6344b85700 1 -- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6340133f50 msgr2=0x7f6340123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6344b85700 1 --2- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6340133f50 0x7f6340123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6344b85700 1 -- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 msgr2=0x7f6340122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6344b85700 1 --2- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f6340122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6344b85700 1 -- 172.21.15.154:0/233169334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c009550 con 0x7f63400a1380 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6344b85700 1 --2- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63400a1380 0x7f6340122dd0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f6330013000 tx=0x7f6330004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6335ffb700 1 -- 172.21.15.154:0/233169334 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330004510 con 0x7f63400a1380 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6335ffb700 1 -- 172.21.15.154:0/233169334 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633001f070 con 0x7f63400a1380 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f63475ea700 1 -- 172.21.15.154:0/233169334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63300094a0 con 0x7f63400a1380 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f6335ffb700 1 -- 172.21.15.154:0/233169334 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300038c0 con 0x7f63400a1380 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.074+0000 7f63475ea700 1 -- 172.21.15.154:0/233169334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63400a03e0 con 0x7f63400a1380 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.075+0000 7f6335ffb700 1 -- 172.21.15.154:0/233169334 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6330003a20 con 0x7f63400a1380 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.075+0000 7f6335ffb700 1 -- 172.21.15.154:0/233169334 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6330021070 con 0x7f63400a1380 2023-09-30T22:27:32.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.076+0000 7f63475ea700 1 -- 172.21.15.154:0/233169334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634004f2a0 con 0x7f63400a1380 2023-09-30T22:27:32.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.080+0000 7f6335ffb700 1 -- 172.21.15.154:0/233169334 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6330015080 con 0x7f63400a1380 2023-09-30T22:27:32.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.186+0000 7fee133af700 1 -- 172.21.15.154:0/1305866686 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee0c1237d0 con 0x7fee0c06a770 2023-09-30T22:27:32.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.186+0000 7fee01ffb700 1 -- 172.21.15.154:0/1305866686 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee08015030 con 0x7fee0c06a770 2023-09-30T22:27:32.186 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:32.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.189+0000 7fee133af700 1 -- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 msgr2=0x7fee0c09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.189+0000 7fee133af700 1 --2- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c09a490 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fee08000c00 tx=0x7fee08004750 comp rx=0 tx=0).stop 2023-09-30T22:27:32.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.189+0000 7fee133af700 1 -- 172.21.15.154:0/1305866686 shutdown_connections 2023-09-30T22:27:32.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.189+0000 7fee133af700 1 --2- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee0c131ec0 0x7fee0c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.189+0000 7fee133af700 1 --2- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c06a770 0x7fee0c09a490 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.189+0000 7fee133af700 1 --2- 172.21.15.154:0/1305866686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c06b080 0x7fee0c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.189+0000 7fee133af700 1 -- 172.21.15.154:0/1305866686 >> 172.21.15.154:0/1305866686 conn(0x7fee0c099c40 msgr2=0x7fee0c131020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.189+0000 7fee133af700 1 -- 172.21.15.154:0/1305866686 shutdown_connections 2023-09-30T22:27:32.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.189+0000 7fee133af700 1 -- 172.21.15.154:0/1305866686 wait complete. 2023-09-30T22:27:32.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.260+0000 7ff7e9007700 1 -- 172.21.15.154:0/1149751477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff7e406c3b0 con 0x7ff7e4137140 2023-09-30T22:27:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.260+0000 7ff7cb7fe700 1 -- 172.21.15.154:0/1149751477 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7dc02b090 con 0x7ff7e4137140 2023-09-30T22:27:32.260 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.263+0000 7ff7e9007700 1 -- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 msgr2=0x7ff7e4121220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.263+0000 7ff7e9007700 1 --2- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 0x7ff7e4121220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40a2f30 tx=0x7ff7dc00ef90 comp rx=0 tx=0).stop 2023-09-30T22:27:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.263+0000 7ff7e9007700 1 -- 172.21.15.154:0/1149751477 shutdown_connections 2023-09-30T22:27:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.263+0000 7ff7e9007700 1 --2- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7e4137140 0x7ff7e4121220 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.263+0000 7ff7e9007700 1 --2- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7e406a770 0x7ff7e41207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.263+0000 7ff7e9007700 1 --2- 172.21.15.154:0/1149751477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7e406b250 0x7ff7e4120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.263+0000 7ff7e9007700 1 -- 172.21.15.154:0/1149751477 >> 172.21.15.154:0/1149751477 conn(0x7ff7e4099c40 msgr2=0x7ff7e40a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.263+0000 7ff7e9007700 1 -- 172.21.15.154:0/1149751477 shutdown_connections 2023-09-30T22:27:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.263+0000 7ff7e9007700 1 -- 172.21.15.154:0/1149751477 wait complete. 2023-09-30T22:27:32.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:32.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.291+0000 7f63475ea700 1 -- 172.21.15.154:0/233169334 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6340133360 con 0x7f63400a1380 2023-09-30T22:27:32.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.291+0000 7f6335ffb700 1 -- 172.21.15.154:0/233169334 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6330035090 con 0x7f63400a1380 2023-09-30T22:27:32.291 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.293+0000 7f63475ea700 1 -- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63400a1380 msgr2=0x7f6340122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.293+0000 7f63475ea700 1 --2- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63400a1380 0x7f6340122dd0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f6330013000 tx=0x7f6330004750 comp rx=0 tx=0).stop 2023-09-30T22:27:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.293+0000 7f63475ea700 1 -- 172.21.15.154:0/233169334 shutdown_connections 2023-09-30T22:27:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.293+0000 7f63475ea700 1 --2- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6340133f50 0x7f6340123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.293+0000 7f63475ea700 1 --2- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63400a0a70 0x7f6340122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.293+0000 7f63475ea700 1 --2- 172.21.15.154:0/233169334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63400a1380 0x7f6340122dd0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.293+0000 7f63475ea700 1 -- 172.21.15.154:0/233169334 >> 172.21.15.154:0/233169334 conn(0x7f63400a6610 msgr2=0x7f634009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.293+0000 7f63475ea700 1 -- 172.21.15.154:0/233169334 shutdown_connections 2023-09-30T22:27:32.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.293+0000 7f63475ea700 1 -- 172.21.15.154:0/233169334 wait complete. 2023-09-30T22:27:32.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:32.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:32.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.578+0000 7f2640ef2700 1 Processor -- start 2023-09-30T22:27:32.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.578+0000 7f2640ef2700 1 -- start start 2023-09-30T22:27:32.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.578+0000 7f2640ef2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f263c09e870 0x7f263c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2640ef2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c09f180 0x7f263c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2640ef2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c09c970 con 0x7f263c131d70 2023-09-30T22:27:32.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2640ef2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c0a0920 con 0x7f263c09e870 2023-09-30T22:27:32.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2640ef2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c09f9c0 con 0x7f263c09f180 2023-09-30T22:27:32.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2639d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c09f180 0x7f263c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f263a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f263c09e870 0x7f263c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f263a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f263c09e870 0x7f263c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35636/0 (socket says 172.21.15.154:35636) 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2639d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c09f180 0x7f263c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37454/0 (socket says 172.21.15.154:37454) 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f263a59c700 1 -- 172.21.15.154:0/1630823752 learned_addr learned my addr 172.21.15.154:0/1630823752 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2639d9b700 1 -- 172.21.15.154:0/1630823752 >> v2:172.21.15.154:3300/0 conn(0x7f263c09e870 msgr2=0x7f263c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2639d9b700 1 --2- 172.21.15.154:0/1630823752 >> v2:172.21.15.154:3300/0 conn(0x7f263c09e870 0x7f263c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2639d9b700 1 -- 172.21.15.154:0/1630823752 >> v1:172.21.15.154:6789/0 conn(0x7f263c131d70 legacy=0x7f263c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2639d9b700 1 -- 172.21.15.154:0/1630823752 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c09bab0 con 0x7f263c09f180 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f263959a700 1 -- 172.21.15.154:0/1630823752 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971047655 0 0) 0x7f263c09c970 con 0x7f263c131d70 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f263a59c700 1 --2- 172.21.15.154:0/1630823752 >> v2:172.21.15.154:3300/0 conn(0x7f263c09e870 0x7f263c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f2639d9b700 1 --2- 172.21.15.154:0/1630823752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c09f180 0x7f263c131830 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f262c009840 tx=0x7f262c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=399a55f8209bc1b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f263959a700 1 -- 172.21.15.154:0/1630823752 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c011830 con 0x7f263c09f180 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f263959a700 1 -- 172.21.15.154:0/1630823752 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c011990 con 0x7f263c09f180 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.579+0000 7f263959a700 1 -- 172.21.15.154:0/1630823752 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c011d20 con 0x7f263c09f180 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.580+0000 7f2640ef2700 1 -- 172.21.15.154:0/1630823752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c09f180 msgr2=0x7f263c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.580+0000 7f2640ef2700 1 --2- 172.21.15.154:0/1630823752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c09f180 0x7f263c131830 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f262c009840 tx=0x7f262c009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.580+0000 7f2640ef2700 1 -- 172.21.15.154:0/1630823752 shutdown_connections 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.580+0000 7f2640ef2700 1 --2- 172.21.15.154:0/1630823752 >> v2:172.21.15.154:3300/0 conn(0x7f263c09e870 0x7f263c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.580+0000 7f2640ef2700 1 --2- 172.21.15.154:0/1630823752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c09f180 0x7f263c131830 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.580+0000 7f2640ef2700 1 -- 172.21.15.154:0/1630823752 >> 172.21.15.154:0/1630823752 conn(0x7f263c0a4430 msgr2=0x7f263c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.580+0000 7f2640ef2700 1 -- 172.21.15.154:0/1630823752 shutdown_connections 2023-09-30T22:27:32.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.580+0000 7f2640ef2700 1 -- 172.21.15.154:0/1630823752 wait complete. 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.581+0000 7f2640ef2700 1 Processor -- start 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.581+0000 7f2640ef2700 1 -- start start 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f2640ef2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f263c09e870 0x7f263c1b9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f2640ef2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f263c09f180 0x7f263c1b95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f2640ef2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c131d70 0x7f263c1b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f2640ef2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c0a2940 con 0x7f263c09e870 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f2640ef2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c09dba0 con 0x7f263c131d70 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f2640ef2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f263c1bad30 con 0x7f263c09f180 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f263c09e870 0x7f263c1b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f263c09e870 0x7f263c1b9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35640/0 (socket says 172.21.15.154:35640) 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263a59c700 1 -- 172.21.15.154:0/2280761472 learned_addr learned my addr 172.21.15.154:0/2280761472 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263ad9d700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c131d70 0x7f263c1b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f2639d9b700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f263c09f180 0x7f263c1b95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263a59c700 1 -- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f263c09f180 msgr2=0x7f263c1b95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263a59c700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f263c09f180 0x7f263c1b95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263a59c700 1 -- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c131d70 msgr2=0x7f263c1b9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263a59c700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c131d70 0x7f263c1b9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263a59c700 1 -- 172.21.15.154:0/2280761472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2630009550 con 0x7f263c09e870 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.582+0000 7f263ad9d700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c131d70 0x7f263c1b9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.583+0000 7f263a59c700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f263c09e870 0x7f263c1b9060 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f263000e9b0 tx=0x7f263000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:32.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.583+0000 7f262affd700 1 -- 172.21.15.154:0/2280761472 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000ee50 con 0x7f263c09e870 2023-09-30T22:27:32.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.583+0000 7f262affd700 1 -- 172.21.15.154:0/2280761472 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263000c850 con 0x7f263c09e870 2023-09-30T22:27:32.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.583+0000 7f2640ef2700 1 -- 172.21.15.154:0/2280761472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c0094a0 con 0x7f263c09e870 2023-09-30T22:27:32.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.583+0000 7f262affd700 1 -- 172.21.15.154:0/2280761472 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000cbc0 con 0x7f263c09e870 2023-09-30T22:27:32.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.583+0000 7f2640ef2700 1 -- 172.21.15.154:0/2280761472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c1bb410 con 0x7f263c09e870 2023-09-30T22:27:32.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.583+0000 7f262affd700 1 -- 172.21.15.154:0/2280761472 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f263000cd20 con 0x7f263c09e870 2023-09-30T22:27:32.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.584+0000 7f262affd700 1 -- 172.21.15.154:0/2280761472 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f263003fa90 con 0x7f263c09e870 2023-09-30T22:27:32.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.584+0000 7f2640ef2700 1 -- 172.21.15.154:0/2280761472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263c071090 con 0x7f263c09e870 2023-09-30T22:27:32.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.589+0000 7f262affd700 1 -- 172.21.15.154:0/2280761472 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f263001b3b0 con 0x7f263c09e870 2023-09-30T22:27:32.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.772+0000 7f2640ef2700 1 -- 172.21.15.154:0/2280761472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f263c04f2a0 con 0x7f263c09e870 2023-09-30T22:27:32.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.772+0000 7f262affd700 1 -- 172.21.15.154:0/2280761472 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f263001ab50 con 0x7f263c09e870 2023-09-30T22:27:32.772 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:32.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.774+0000 7f2640ef2700 1 -- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f263c09e870 msgr2=0x7f263c1b9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.774+0000 7f2640ef2700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f263c09e870 0x7f263c1b9060 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f263000e9b0 tx=0x7f263000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.774+0000 7f2640ef2700 1 -- 172.21.15.154:0/2280761472 shutdown_connections 2023-09-30T22:27:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.774+0000 7f2640ef2700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f263c131d70 0x7f263c1b9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.774+0000 7f2640ef2700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f263c09e870 0x7f263c1b9060 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.774+0000 7f2640ef2700 1 --2- 172.21.15.154:0/2280761472 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f263c09f180 0x7f263c1b95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.774+0000 7f2640ef2700 1 -- 172.21.15.154:0/2280761472 >> 172.21.15.154:0/2280761472 conn(0x7f263c0a4430 msgr2=0x7f263c131350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.774+0000 7f2640ef2700 1 -- 172.21.15.154:0/2280761472 shutdown_connections 2023-09-30T22:27:32.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:32.774+0000 7f2640ef2700 1 -- 172.21.15.154:0/2280761472 wait complete. 2023-09-30T22:27:32.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:33.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:33.275 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:33.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:33.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.330+0000 7fd514e33700 1 Processor -- start 2023-09-30T22:27:33.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.330+0000 7fd514e33700 1 -- start start 2023-09-30T22:27:33.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.330+0000 7fd514e33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd510099e20 0x7fd51009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.330+0000 7fd514e33700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd510138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.330+0000 7fd514e33700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd510099a60 con 0x7fd51009a730 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.330+0000 7fd514e33700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51009bf50 con 0x7fd510130a60 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd514e33700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd51009b230 con 0x7fd510099e20 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50dd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd51009a730 0x7fd510130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40824/0 (socket says 172.21.15.154:40824) 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50dd9b700 1 -- 172.21.15.154:0/2158575785 learned_addr learned my addr 172.21.15.154:0/2158575785 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50ed9d700 1 --2- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd510138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50e59c700 1 --2- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd510099e20 0x7fd51009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50d59a700 1 -- 172.21.15.154:0/2158575785 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097855370 0 0) 0x7fd510099a60 con 0x7fd51009a730 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50d59a700 1 -- 172.21.15.154:0/2158575785 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f80035b0 con 0x7fd51009a730 2023-09-30T22:27:33.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50e59c700 1 -- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 msgr2=0x7fd510138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50e59c700 1 --2- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd510138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50e59c700 1 -- 172.21.15.154:0/2158575785 >> v1:172.21.15.154:6789/0 conn(0x7fd51009a730 legacy=0x7fd510130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50e59c700 1 -- 172.21.15.154:0/2158575785 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51009bb90 con 0x7fd510099e20 2023-09-30T22:27:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50ed9d700 1 --2- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd510138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50e59c700 1 --2- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd510099e20 0x7fd51009a1f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd500009850 tx=0x7fd500009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f175519254ab55a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.331+0000 7fd50d59a700 1 -- 172.21.15.154:0/2158575785 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500005e30 con 0x7fd510099e20 2023-09-30T22:27:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd50d59a700 1 -- 172.21.15.154:0/2158575785 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd500006030 con 0x7fd510099e20 2023-09-30T22:27:33.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd50d59a700 1 -- 172.21.15.154:0/2158575785 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5000063e0 con 0x7fd510099e20 2023-09-30T22:27:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd514e33700 1 -- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd510099e20 msgr2=0x7fd51009a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd514e33700 1 --2- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd510099e20 0x7fd51009a1f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd500009850 tx=0x7fd500009b60 comp rx=0 tx=0).stop 2023-09-30T22:27:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd514e33700 1 -- 172.21.15.154:0/2158575785 shutdown_connections 2023-09-30T22:27:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd514e33700 1 --2- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd510138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd514e33700 1 --2- 172.21.15.154:0/2158575785 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd510099e20 0x7fd51009a1f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd514e33700 1 -- 172.21.15.154:0/2158575785 >> 172.21.15.154:0/2158575785 conn(0x7fd5100a2980 msgr2=0x7fd5100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd514e33700 1 -- 172.21.15.154:0/2158575785 shutdown_connections 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.332+0000 7fd514e33700 1 -- 172.21.15.154:0/2158575785 wait complete. 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd514e33700 1 Processor -- start 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd514e33700 1 -- start start 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd514e33700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd510099e20 0x7fd510139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd514e33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd51009a730 0x7fd51013a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd514e33700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd51013a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd514e33700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5101396d0 con 0x7fd510099e20 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd514e33700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51009b470 con 0x7fd510130a60 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd514e33700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd51012de20 con 0x7fd51009a730 2023-09-30T22:27:33.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd50dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd51009a730 0x7fd51013a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd50ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd51013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd50dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd51009a730 0x7fd51013a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36854/0 (socket says 172.21.15.154:36854) 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd50ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd51013a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37490/0 (socket says 172.21.15.154:37490) 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd50dd9b700 1 -- 172.21.15.154:0/2567667239 learned_addr learned my addr 172.21.15.154:0/2567667239 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.334+0000 7fd50e59c700 1 --2- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd510099e20 0x7fd510139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd50dd9b700 1 -- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 msgr2=0x7fd51013a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd50dd9b700 1 --2- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd51013a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd50dd9b700 1 -- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd510099e20 msgr2=0x7fd510139be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd50dd9b700 1 --2- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd510099e20 0x7fd510139be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd50dd9b700 1 -- 172.21.15.154:0/2567667239 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508009a70 con 0x7fd51009a730 2023-09-30T22:27:33.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd50ed9d700 1 --2- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd51013a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd50dd9b700 1 --2- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd51009a730 0x7fd51013a120 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd504005910 tx=0x7fd50400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd4feffd700 1 -- 172.21.15.154:0/2567667239 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504005d70 con 0x7fd51009a730 2023-09-30T22:27:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd4feffd700 1 -- 172.21.15.154:0/2567667239 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5040070d0 con 0x7fd51009a730 2023-09-30T22:27:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd514e33700 1 -- 172.21.15.154:0/2567667239 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd500009430 con 0x7fd51009a730 2023-09-30T22:27:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd4feffd700 1 -- 172.21.15.154:0/2567667239 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504007440 con 0x7fd51009a730 2023-09-30T22:27:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.335+0000 7fd514e33700 1 -- 172.21.15.154:0/2567667239 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51013aff0 con 0x7fd51009a730 2023-09-30T22:27:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.336+0000 7fd4feffd700 1 -- 172.21.15.154:0/2567667239 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5040075a0 con 0x7fd51009a730 2023-09-30T22:27:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.336+0000 7fd4feffd700 1 -- 172.21.15.154:0/2567667239 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd50403ea00 con 0x7fd51009a730 2023-09-30T22:27:33.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.336+0000 7fd514e33700 1 -- 172.21.15.154:0/2567667239 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd510131e90 con 0x7fd51009a730 2023-09-30T22:27:33.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.341+0000 7fd4feffd700 1 -- 172.21.15.154:0/2567667239 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd504017020 con 0x7fd51009a730 2023-09-30T22:27:33.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.405+0000 7f8f6c711700 1 Processor -- start 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.405+0000 7f8f6c711700 1 -- start start 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6c711700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a0a70 0x7f8f640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6c711700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f64134120 0x7f8f6413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6c711700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6409dc00 con 0x7f8f640a1380 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6c711700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6409ea60 con 0x7f8f64134120 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6c711700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6409dec0 con 0x7f8f640a0a70 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6a4ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a0a70 0x7f8f640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f69cac700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8f640a1380 0x7f8f64133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40836/0 (socket says 172.21.15.154:40836) 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f69cac700 1 -- 172.21.15.154:0/991478278 learned_addr learned my addr 172.21.15.154:0/991478278 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6acae700 1 --2- 172.21.15.154:0/991478278 >> v2:172.21.15.154:3300/0 conn(0x7f8f64134120 0x7f8f6413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6acae700 1 -- 172.21.15.154:0/991478278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a0a70 msgr2=0x7f8f640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:33.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6acae700 1 --2- 172.21.15.154:0/991478278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a0a70 0x7f8f640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6acae700 1 -- 172.21.15.154:0/991478278 >> v1:172.21.15.154:6789/0 conn(0x7f8f640a1380 legacy=0x7f8f64133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6acae700 1 -- 172.21.15.154:0/991478278 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6409e6a0 con 0x7f8f64134120 2023-09-30T22:27:33.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.406+0000 7f8f6a4ad700 1 --2- 172.21.15.154:0/991478278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a0a70 0x7f8f640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:33.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f6acae700 1 --2- 172.21.15.154:0/991478278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 0x7f8f6413bce0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009d90 tx=0x7f8f5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8c25d86be317d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f694ab700 1 -- 172.21.15.154:0/991478278 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c00e070 con 0x7f8f64134120 2023-09-30T22:27:33.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f694ab700 1 -- 172.21.15.154:0/991478278 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c00bb20 con 0x7f8f64134120 2023-09-30T22:27:33.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f694ab700 1 -- 172.21.15.154:0/991478278 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c012430 con 0x7f8f64134120 2023-09-30T22:27:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f6c711700 1 -- 172.21.15.154:0/991478278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 msgr2=0x7f8f6413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f6c711700 1 --2- 172.21.15.154:0/991478278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 0x7f8f6413bce0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009d90 tx=0x7f8f5c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f6c711700 1 -- 172.21.15.154:0/991478278 shutdown_connections 2023-09-30T22:27:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f6c711700 1 --2- 172.21.15.154:0/991478278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 0x7f8f6413bce0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f6c711700 1 --2- 172.21.15.154:0/991478278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a0a70 0x7f8f640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.407+0000 7f8f6c711700 1 -- 172.21.15.154:0/991478278 >> 172.21.15.154:0/991478278 conn(0x7f8f640a6610 msgr2=0x7f8f640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.408+0000 7f8f6c711700 1 -- 172.21.15.154:0/991478278 shutdown_connections 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.408+0000 7f8f6c711700 1 -- 172.21.15.154:0/991478278 wait complete. 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.408+0000 7f8f6c711700 1 Processor -- start 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6c711700 1 -- start start 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6c711700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f640a0a70 0x7f8f64122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6c711700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a1380 0x7f8f64122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6c711700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 0x7f8f641232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6c711700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64133ad0 con 0x7f8f64134120 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6c711700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64125de0 con 0x7f8f640a1380 2023-09-30T22:27:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6c711700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64124510 con 0x7f8f640a0a70 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f69cac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a1380 0x7f8f64122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f69cac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a1380 0x7f8f64122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37502/0 (socket says 172.21.15.154:37502) 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f69cac700 1 -- 172.21.15.154:0/925030210 learned_addr learned my addr 172.21.15.154:0/925030210 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6acae700 1 --2- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 0x7f8f641232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6acae700 1 -- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f640a0a70 msgr2=0x7f8f64122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6acae700 1 --2- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f640a0a70 0x7f8f64122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6acae700 1 -- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a1380 msgr2=0x7f8f64122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6acae700 1 --2- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a1380 0x7f8f64122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f6acae700 1 -- 172.21.15.154:0/925030210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f600094a0 con 0x7f8f64134120 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.409+0000 7f8f69cac700 1 --2- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a1380 0x7f8f64122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.410+0000 7f8f6acae700 1 --2- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 0x7f8f641232e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c016000 tx=0x7f8f5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.410+0000 7f8f5affd700 1 -- 172.21.15.154:0/925030210 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c012430 con 0x7f8f64134120 2023-09-30T22:27:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.410+0000 7f8f5affd700 1 -- 172.21.15.154:0/925030210 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c020070 con 0x7f8f64134120 2023-09-30T22:27:33.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.410+0000 7f8f6c711700 1 -- 172.21.15.154:0/925030210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c009a70 con 0x7f8f64134120 2023-09-30T22:27:33.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.410+0000 7f8f5affd700 1 -- 172.21.15.154:0/925030210 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c004280 con 0x7f8f64134120 2023-09-30T22:27:33.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.410+0000 7f8f6c711700 1 -- 172.21.15.154:0/925030210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f64133380 con 0x7f8f64134120 2023-09-30T22:27:33.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.411+0000 7f8f5affd700 1 -- 172.21.15.154:0/925030210 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f5c0043e0 con 0x7f8f64134120 2023-09-30T22:27:33.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.411+0000 7f8f6c711700 1 -- 172.21.15.154:0/925030210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6404f2a0 con 0x7f8f64134120 2023-09-30T22:27:33.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.411+0000 7f8f5affd700 1 -- 172.21.15.154:0/925030210 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8f5c022070 con 0x7f8f64134120 2023-09-30T22:27:33.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.415+0000 7f8f5affd700 1 -- 172.21.15.154:0/925030210 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f5c01ad50 con 0x7f8f64134120 2023-09-30T22:27:33.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.448+0000 7f1b78c44700 1 Processor -- start 2023-09-30T22:27:33.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.448+0000 7f1b78c44700 1 -- start start 2023-09-30T22:27:33.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b78c44700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b7409d860 0x7f1b7409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b78c44700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b741307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b78c44700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b74131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b78c44700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b74131670 con 0x7f1b7409d860 2023-09-30T22:27:33.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b78c44700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7409aaa0 con 0x7f1b7409e170 2023-09-30T22:27:33.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b78c44700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7409f870 con 0x7f1b74130ce0 2023-09-30T22:27:33.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b7259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b7409d860 0x7f1b7409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b72d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b74131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b7259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b7409d860 0x7f1b7409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35674/0 (socket says 172.21.15.154:35674) 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b72d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b74131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36870/0 (socket says 172.21.15.154:36870) 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b7259c700 1 -- 172.21.15.154:0/644530913 learned_addr learned my addr 172.21.15.154:0/644530913 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b71d9b700 1 --2- 172.21.15.154:0/644530913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b741307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b72d9d700 1 -- 172.21.15.154:0/644530913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 msgr2=0x7f1b741307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b72d9d700 1 --2- 172.21.15.154:0/644530913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b741307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b72d9d700 1 -- 172.21.15.154:0/644530913 >> v2:172.21.15.154:3300/0 conn(0x7f1b7409d860 msgr2=0x7f1b7409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b72d9d700 1 --2- 172.21.15.154:0/644530913 >> v2:172.21.15.154:3300/0 conn(0x7f1b7409d860 0x7f1b7409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b72d9d700 1 -- 172.21.15.154:0/644530913 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7409b360 con 0x7f1b74130ce0 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b71d9b700 1 --2- 172.21.15.154:0/644530913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b741307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.449+0000 7f1b7259c700 1 --2- 172.21.15.154:0/644530913 >> v2:172.21.15.154:3300/0 conn(0x7f1b7409d860 0x7f1b7409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b72d9d700 1 --2- 172.21.15.154:0/644530913 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b74131130 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009dc0 tx=0x7f1b6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c93ee064590367d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b7159a700 1 -- 172.21.15.154:0/644530913 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00e070 con 0x7f1b74130ce0 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b7159a700 1 -- 172.21.15.154:0/644530913 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c00bae0 con 0x7f1b74130ce0 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b7159a700 1 -- 172.21.15.154:0/644530913 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00be90 con 0x7f1b74130ce0 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b78c44700 1 -- 172.21.15.154:0/644530913 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 msgr2=0x7f1b74131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b78c44700 1 --2- 172.21.15.154:0/644530913 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b74131130 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009dc0 tx=0x7f1b6c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b78c44700 1 -- 172.21.15.154:0/644530913 shutdown_connections 2023-09-30T22:27:33.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b78c44700 1 --2- 172.21.15.154:0/644530913 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b74131130 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b78c44700 1 --2- 172.21.15.154:0/644530913 >> v2:172.21.15.154:3300/0 conn(0x7f1b7409d860 0x7f1b7409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b78c44700 1 --2- 172.21.15.154:0/644530913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b741307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.450+0000 7f1b78c44700 1 -- 172.21.15.154:0/644530913 >> 172.21.15.154:0/644530913 conn(0x7f1b74099c40 msgr2=0x7f1b740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.451+0000 7f1b78c44700 1 -- 172.21.15.154:0/644530913 shutdown_connections 2023-09-30T22:27:33.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.451+0000 7f1b78c44700 1 -- 172.21.15.154:0/644530913 wait complete. 2023-09-30T22:27:33.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b78c44700 1 Processor -- start 2023-09-30T22:27:33.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b78c44700 1 -- start start 2023-09-30T22:27:33.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b78c44700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b7409d860 0x7f1b741289b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b78c44700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b74128ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b78c44700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b741c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b78c44700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7412bb50 con 0x7f1b7409d860 2023-09-30T22:27:33.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b78c44700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740a0490 con 0x7f1b7409e170 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b78c44700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7409c8b0 con 0x7f1b74130ce0 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b71d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b74128ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b71d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b74128ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37524/0 (socket says 172.21.15.154:37524) 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b7259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b7409d860 0x7f1b741289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b71d9b700 1 -- 172.21.15.154:0/1820946093 learned_addr learned my addr 172.21.15.154:0/1820946093 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b72d9d700 1 --2- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b741c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b71d9b700 1 -- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 msgr2=0x7f1b741c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b71d9b700 1 --2- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b741c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b71d9b700 1 -- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b7409d860 msgr2=0x7f1b741289b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.452+0000 7f1b71d9b700 1 --2- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b7409d860 0x7f1b741289b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.453+0000 7f1b71d9b700 1 -- 172.21.15.154:0/1820946093 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64009550 con 0x7f1b7409e170 2023-09-30T22:27:33.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.453+0000 7f1b71d9b700 1 --2- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b74128ef0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800ebe0 tx=0x7f1b6800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.453+0000 7f1b62ffd700 1 -- 172.21.15.154:0/1820946093 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68009800 con 0x7f1b7409e170 2023-09-30T22:27:33.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.453+0000 7f1b62ffd700 1 -- 172.21.15.154:0/1820946093 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6800c850 con 0x7f1b7409e170 2023-09-30T22:27:33.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.453+0000 7f1b62ffd700 1 -- 172.21.15.154:0/1820946093 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800cbc0 con 0x7f1b7409e170 2023-09-30T22:27:33.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.453+0000 7f1b78c44700 1 -- 172.21.15.154:0/1820946093 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b680094a0 con 0x7f1b7409e170 2023-09-30T22:27:33.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.453+0000 7f1b78c44700 1 -- 172.21.15.154:0/1820946093 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c009a70 con 0x7f1b7409e170 2023-09-30T22:27:33.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.454+0000 7f1b62ffd700 1 -- 172.21.15.154:0/1820946093 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b6800cd20 con 0x7f1b7409e170 2023-09-30T22:27:33.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.454+0000 7f1b62ffd700 1 -- 172.21.15.154:0/1820946093 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b6803f790 con 0x7f1b7409e170 2023-09-30T22:27:33.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.454+0000 7f1b78c44700 1 -- 172.21.15.154:0/1820946093 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7412b5d0 con 0x7f1b7409e170 2023-09-30T22:27:33.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.463+0000 7f1b62ffd700 1 -- 172.21.15.154:0/1820946093 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b6801bde0 con 0x7f1b7409e170 2023-09-30T22:27:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.543+0000 7fd514e33700 1 -- 172.21.15.154:0/2567667239 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd510072480 con 0x7fd51009a730 2023-09-30T22:27:33.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.543+0000 7fd4feffd700 1 -- 172.21.15.154:0/2567667239 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd510072480 con 0x7fd51009a730 2023-09-30T22:27:33.543 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.546+0000 7fd514e33700 1 -- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd51009a730 msgr2=0x7fd51013a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.546+0000 7fd514e33700 1 --2- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd51009a730 0x7fd51013a120 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd504005910 tx=0x7fd50400c9e0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.546+0000 7fd514e33700 1 -- 172.21.15.154:0/2567667239 shutdown_connections 2023-09-30T22:27:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.546+0000 7fd514e33700 1 --2- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd510130a60 0x7fd51013a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.546+0000 7fd514e33700 1 --2- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd510099e20 0x7fd510139be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.546+0000 7fd514e33700 1 --2- 172.21.15.154:0/2567667239 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd51009a730 0x7fd51013a120 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.546+0000 7fd514e33700 1 -- 172.21.15.154:0/2567667239 >> 172.21.15.154:0/2567667239 conn(0x7fd5100a2980 msgr2=0x7fd510126fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.547+0000 7fd514e33700 1 -- 172.21.15.154:0/2567667239 shutdown_connections 2023-09-30T22:27:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.547+0000 7fd514e33700 1 -- 172.21.15.154:0/2567667239 wait complete. 2023-09-30T22:27:33.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:33.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.620+0000 7f8f6c711700 1 -- 172.21.15.154:0/925030210 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f64072980 con 0x7f8f64134120 2023-09-30T22:27:33.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.620+0000 7f8f5affd700 1 -- 172.21.15.154:0/925030210 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f5c01ab70 con 0x7f8f64134120 2023-09-30T22:27:33.620 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:33.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.622+0000 7f8f6c711700 1 -- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 msgr2=0x7f8f641232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.622+0000 7f8f6c711700 1 --2- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 0x7f8f641232e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c016000 tx=0x7f8f5c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.622+0000 7f8f6c711700 1 -- 172.21.15.154:0/925030210 shutdown_connections 2023-09-30T22:27:33.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.622+0000 7f8f6c711700 1 --2- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f64134120 0x7f8f641232e0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.622+0000 7f8f6c711700 1 --2- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8f640a0a70 0x7f8f64122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.622+0000 7f8f6c711700 1 --2- 172.21.15.154:0/925030210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f640a1380 0x7f8f64122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.622+0000 7f8f6c711700 1 -- 172.21.15.154:0/925030210 >> 172.21.15.154:0/925030210 conn(0x7f8f640a6610 msgr2=0x7f8f640a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.622+0000 7f8f6c711700 1 -- 172.21.15.154:0/925030210 shutdown_connections 2023-09-30T22:27:33.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.622+0000 7f8f6c711700 1 -- 172.21.15.154:0/925030210 wait complete. 2023-09-30T22:27:33.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:33.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.656+0000 7f1b78c44700 1 -- 172.21.15.154:0/1820946093 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1b7404f2a0 con 0x7f1b7409e170 2023-09-30T22:27:33.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.656+0000 7f1b62ffd700 1 -- 172.21.15.154:0/1820946093 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b68021070 con 0x7f1b7409e170 2023-09-30T22:27:33.656 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:33.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.658+0000 7f1b78c44700 1 -- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 msgr2=0x7f1b74128ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.658+0000 7f1b78c44700 1 --2- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b74128ef0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800ebe0 tx=0x7f1b6800eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.658+0000 7f1b78c44700 1 -- 172.21.15.154:0/1820946093 shutdown_connections 2023-09-30T22:27:33.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.658+0000 7f1b78c44700 1 --2- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b74130ce0 0x7f1b741c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.658+0000 7f1b78c44700 1 --2- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b7409d860 0x7f1b741289b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.658+0000 7f1b78c44700 1 --2- 172.21.15.154:0/1820946093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b7409e170 0x7f1b74128ef0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.658+0000 7f1b78c44700 1 -- 172.21.15.154:0/1820946093 >> 172.21.15.154:0/1820946093 conn(0x7f1b74099c40 msgr2=0x7f1b74070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.658+0000 7f1b78c44700 1 -- 172.21.15.154:0/1820946093 shutdown_connections 2023-09-30T22:27:33.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.658+0000 7f1b78c44700 1 -- 172.21.15.154:0/1820946093 wait complete. 2023-09-30T22:27:33.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:33.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8fad3c700 1 Processor -- start 2023-09-30T22:27:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8fad3c700 1 -- start start 2023-09-30T22:27:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8fad3c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8f409da10 0x7fb8f4136760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8fad3c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 0x7fb8f4139080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8fad3c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f409e780 con 0x7fb8f412e490 2023-09-30T22:27:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8fad3c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f409f6e0 con 0x7fb8f409da10 2023-09-30T22:27:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8fad3c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f409eb00 con 0x7fb8f4136ca0 2023-09-30T22:27:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8f3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8f409da10 0x7fb8f4136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8f92d9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 0x7fb8f4139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8f3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8f409da10 0x7fb8f4136760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35688/0 (socket says 172.21.15.154:35688) 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.910+0000 7fb8f3fff700 1 -- 172.21.15.154:0/187736284 learned_addr learned my addr 172.21.15.154:0/187736284 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8f92d9700 1 -- 172.21.15.154:0/187736284 >> v2:172.21.15.154:3300/0 conn(0x7fb8f409da10 msgr2=0x7fb8f4136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8f92d9700 1 --2- 172.21.15.154:0/187736284 >> v2:172.21.15.154:3300/0 conn(0x7fb8f409da10 0x7fb8f4136760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8f92d9700 1 -- 172.21.15.154:0/187736284 >> v1:172.21.15.154:6789/0 conn(0x7fb8f412e490 legacy=0x7fb8f412e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8f92d9700 1 -- 172.21.15.154:0/187736284 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f412e040 con 0x7fb8f4136ca0 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8f3fff700 1 --2- 172.21.15.154:0/187736284 >> v2:172.21.15.154:3300/0 conn(0x7fb8f409da10 0x7fb8f4136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8f92d9700 1 --2- 172.21.15.154:0/187736284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 0x7fb8f4139080 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009dc0 tx=0x7fb8ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d004dd4ca02d82 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8f37fe700 1 -- 172.21.15.154:0/187736284 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00e070 con 0x7fb8f4136ca0 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8f37fe700 1 -- 172.21.15.154:0/187736284 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec00bae0 con 0x7fb8f4136ca0 2023-09-30T22:27:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8f37fe700 1 -- 172.21.15.154:0/187736284 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00be90 con 0x7fb8f4136ca0 2023-09-30T22:27:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8fad3c700 1 -- 172.21.15.154:0/187736284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 msgr2=0x7fb8f4139080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8fad3c700 1 --2- 172.21.15.154:0/187736284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 0x7fb8f4139080 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009dc0 tx=0x7fb8ec00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8fad3c700 1 -- 172.21.15.154:0/187736284 shutdown_connections 2023-09-30T22:27:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.911+0000 7fb8fad3c700 1 --2- 172.21.15.154:0/187736284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 0x7fb8f4139080 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.912+0000 7fb8fad3c700 1 --2- 172.21.15.154:0/187736284 >> v2:172.21.15.154:3300/0 conn(0x7fb8f409da10 0x7fb8f4136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.912+0000 7fb8fad3c700 1 -- 172.21.15.154:0/187736284 >> 172.21.15.154:0/187736284 conn(0x7fb8f4099c40 msgr2=0x7fb8f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.912+0000 7fb8fad3c700 1 -- 172.21.15.154:0/187736284 shutdown_connections 2023-09-30T22:27:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.912+0000 7fb8fad3c700 1 -- 172.21.15.154:0/187736284 wait complete. 2023-09-30T22:27:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.912+0000 7fb8fad3c700 1 Processor -- start 2023-09-30T22:27:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.912+0000 7fb8fad3c700 1 -- start start 2023-09-30T22:27:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8fad3c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f409da10 0x7fb8f41347a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8fad3c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f412e490 0x7fb8f4134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8fad3c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 0x7fb8f4135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8fad3c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41338e0 con 0x7fb8f412e490 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8fad3c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4133620 con 0x7fb8f4136ca0 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8fad3c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4135c90 con 0x7fb8f409da10 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f412e490 0x7fb8f4134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f8ad8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f409da10 0x7fb8f41347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f412e490 0x7fb8f4134ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35698/0 (socket says 172.21.15.154:35698) 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f3fff700 1 -- 172.21.15.154:0/3299928769 learned_addr learned my addr 172.21.15.154:0/3299928769 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f92d9700 1 --2- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 0x7fb8f4135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f3fff700 1 -- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f409da10 msgr2=0x7fb8f41347a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f3fff700 1 --2- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f409da10 0x7fb8f41347a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f3fff700 1 -- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 msgr2=0x7fb8f4135220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f3fff700 1 --2- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 0x7fb8f4135220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.913+0000 7fb8f3fff700 1 -- 172.21.15.154:0/3299928769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e0009550 con 0x7fb8f412e490 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.914+0000 7fb8f3fff700 1 --2- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f412e490 0x7fb8f4134ce0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000ebe0 tx=0x7fb8e000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.914+0000 7fb8f17fa700 1 -- 172.21.15.154:0/3299928769 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000c850 con 0x7fb8f412e490 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.914+0000 7fb8f17fa700 1 -- 172.21.15.154:0/3299928769 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e000c9b0 con 0x7fb8f412e490 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.914+0000 7fb8fad3c700 1 -- 172.21.15.154:0/3299928769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec009a70 con 0x7fb8f412e490 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.914+0000 7fb8f17fa700 1 -- 172.21.15.154:0/3299928769 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000cd40 con 0x7fb8f412e490 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.914+0000 7fb8fad3c700 1 -- 172.21.15.154:0/3299928769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f4134350 con 0x7fb8f412e490 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.915+0000 7fb8fad3c700 1 -- 172.21.15.154:0/3299928769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f40700a0 con 0x7fb8f412e490 2023-09-30T22:27:33.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.915+0000 7fb8f17fa700 1 -- 172.21.15.154:0/3299928769 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8e0013470 con 0x7fb8f412e490 2023-09-30T22:27:33.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.916+0000 7fb8f17fa700 1 -- 172.21.15.154:0/3299928769 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb8e00401b0 con 0x7fb8f412e490 2023-09-30T22:27:33.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:33.920+0000 7fb8f17fa700 1 -- 172.21.15.154:0/3299928769 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8e0011760 con 0x7fb8f412e490 2023-09-30T22:27:34.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.105+0000 7fb8fad3c700 1 -- 172.21.15.154:0/3299928769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb8f404f2a0 con 0x7fb8f412e490 2023-09-30T22:27:34.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.106+0000 7fb8f17fa700 1 -- 172.21.15.154:0/3299928769 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8e0017090 con 0x7fb8f412e490 2023-09-30T22:27:34.106 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.107+0000 7fb8fad3c700 1 -- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f412e490 msgr2=0x7fb8f4134ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.107+0000 7fb8fad3c700 1 --2- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f412e490 0x7fb8f4134ce0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000ebe0 tx=0x7fb8e000eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.108+0000 7fb8fad3c700 1 -- 172.21.15.154:0/3299928769 shutdown_connections 2023-09-30T22:27:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.108+0000 7fb8fad3c700 1 --2- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8f4136ca0 0x7fb8f4135220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.108+0000 7fb8fad3c700 1 --2- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb8f409da10 0x7fb8f41347a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.108+0000 7fb8fad3c700 1 --2- 172.21.15.154:0/3299928769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f412e490 0x7fb8f4134ce0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.108+0000 7fb8fad3c700 1 -- 172.21.15.154:0/3299928769 >> 172.21.15.154:0/3299928769 conn(0x7fb8f4099c40 msgr2=0x7fb8f4138c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.108+0000 7fb8fad3c700 1 -- 172.21.15.154:0/3299928769 shutdown_connections 2023-09-30T22:27:34.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.108+0000 7fb8fad3c700 1 -- 172.21.15.154:0/3299928769 wait complete. 2023-09-30T22:27:34.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:34.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:34.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:34.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:34.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe2de0e700 1 Processor -- start 2023-09-30T22:27:34.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe2de0e700 1 -- start start 2023-09-30T22:27:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe2de0e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe28133660 0x7fbe28135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe2de0e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe28135f80 0x7fbe28138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe2de0e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe28099a60 con 0x7fbe28099e20 2023-09-30T22:27:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe2de0e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2809bf50 con 0x7fbe28133660 2023-09-30T22:27:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe2de0e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2809b230 con 0x7fbe28135f80 2023-09-30T22:27:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe26ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe28133660 0x7fbe28135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe26ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe28133660 0x7fbe28135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35710/0 (socket says 172.21.15.154:35710) 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.693+0000 7fbe26ffd700 1 -- 172.21.15.154:0/1209502569 learned_addr learned my addr 172.21.15.154:0/1209502569 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe27fff700 1 --2- 172.21.15.154:0/1209502569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe28135f80 0x7fbe28138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe26ffd700 1 -- 172.21.15.154:0/1209502569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe28135f80 msgr2=0x7fbe28138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe26ffd700 1 --2- 172.21.15.154:0/1209502569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe28135f80 0x7fbe28138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe26ffd700 1 -- 172.21.15.154:0/1209502569 >> v1:172.21.15.154:6789/0 conn(0x7fbe28099e20 legacy=0x7fbe2809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe267fc700 1 -- 172.21.15.154:0/1209502569 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917127793 0 0) 0x7fbe28099a60 con 0x7fbe28099e20 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe26ffd700 1 -- 172.21.15.154:0/1209502569 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2809bb90 con 0x7fbe28133660 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe26ffd700 1 --2- 172.21.15.154:0/1209502569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28133660 0x7fbe28135a40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00bb90 tx=0x7fbe1c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9401979e190e1108 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe267fc700 1 -- 172.21.15.154:0/1209502569 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00dd30 con 0x7fbe28133660 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe267fc700 1 -- 172.21.15.154:0/1209502569 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c00de90 con 0x7fbe28133660 2023-09-30T22:27:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.694+0000 7fbe267fc700 1 -- 172.21.15.154:0/1209502569 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c010690 con 0x7fbe28133660 2023-09-30T22:27:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.695+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1209502569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28133660 msgr2=0x7fbe28135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.695+0000 7fbe2de0e700 1 --2- 172.21.15.154:0/1209502569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28133660 0x7fbe28135a40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00bb90 tx=0x7fbe1c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.695+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1209502569 shutdown_connections 2023-09-30T22:27:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.695+0000 7fbe2de0e700 1 --2- 172.21.15.154:0/1209502569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe28135f80 0x7fbe28138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.695+0000 7fbe2de0e700 1 --2- 172.21.15.154:0/1209502569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28133660 0x7fbe28135a40 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.695+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1209502569 >> 172.21.15.154:0/1209502569 conn(0x7fbe280a2980 msgr2=0x7fbe280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.695+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1209502569 shutdown_connections 2023-09-30T22:27:34.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.695+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1209502569 wait complete. 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.696+0000 7fbe2de0e700 1 Processor -- start 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe2de0e700 1 -- start start 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe2de0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28099e20 0x7fbe28070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe2de0e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe28133660 0x7fbe281c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe2de0e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28135f80 0x7fbe281c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe2de0e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280706f0 con 0x7fbe28135f80 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe2de0e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2811e6e0 con 0x7fbe28099e20 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe2de0e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe28070410 con 0x7fbe28133660 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe277fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28099e20 0x7fbe28070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe27fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28135f80 0x7fbe281c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe27fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28135f80 0x7fbe281c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35716/0 (socket says 172.21.15.154:35716) 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe277fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28099e20 0x7fbe28070bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37540/0 (socket says 172.21.15.154:37540) 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.697+0000 7fbe27fff700 1 -- 172.21.15.154:0/1742325375 learned_addr learned my addr 172.21.15.154:0/1742325375 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe27fff700 1 -- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe28133660 msgr2=0x7fbe281c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe27fff700 1 --2- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe28133660 0x7fbe281c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe27fff700 1 -- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28099e20 msgr2=0x7fbe28070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe27fff700 1 --2- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28099e20 0x7fbe28070bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe27fff700 1 -- 172.21.15.154:0/1742325375 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c00b7f0 con 0x7fbe28135f80 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe277fe700 1 --2- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28099e20 0x7fbe28070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe27fff700 1 --2- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28135f80 0x7fbe281c86e0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000ef90 tx=0x7fbe2000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe0ffff700 1 -- 172.21.15.154:0/1742325375 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000cd40 con 0x7fbe28135f80 2023-09-30T22:27:34.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe0ffff700 1 -- 172.21.15.154:0/1742325375 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2000f040 con 0x7fbe28135f80 2023-09-30T22:27:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe0ffff700 1 -- 172.21.15.154:0/1742325375 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000cea0 con 0x7fbe28135f80 2023-09-30T22:27:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1742325375 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2811e9a0 con 0x7fbe28135f80 2023-09-30T22:27:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.698+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1742325375 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe28071110 con 0x7fbe28135f80 2023-09-30T22:27:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.699+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1742325375 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe28072480 con 0x7fbe28135f80 2023-09-30T22:27:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.699+0000 7fbe0ffff700 1 -- 172.21.15.154:0/1742325375 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe200146c0 con 0x7fbe28135f80 2023-09-30T22:27:34.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.699+0000 7fbe0ffff700 1 -- 172.21.15.154:0/1742325375 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe20040320 con 0x7fbe28135f80 2023-09-30T22:27:34.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.704+0000 7fbe0ffff700 1 -- 172.21.15.154:0/1742325375 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe28072480 con 0x7fbe28135f80 2023-09-30T22:27:34.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.763+0000 7f14e16a2700 1 Processor -- start 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.763+0000 7f14e16a2700 1 -- start start 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14e16a2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14dc133b80 0x7f14dc133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14e16a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc099a60 0x7f14dc0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14e16a2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc09aa00 con 0x7f14dc0a0e20 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14e16a2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc09a080 con 0x7f14dc133b80 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14e16a2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc133750 con 0x7f14dc099a60 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14daffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14dc133b80 0x7f14dc133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14daffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14dc133b80 0x7f14dc133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35724/0 (socket says 172.21.15.154:35724) 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14daffd700 1 -- 172.21.15.154:0/2458059737 learned_addr learned my addr 172.21.15.154:0/2458059737 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:34.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14da7fc700 1 --2- 172.21.15.154:0/2458059737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc099a60 0x7f14dc0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14daffd700 1 -- 172.21.15.154:0/2458059737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc099a60 msgr2=0x7f14dc0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14daffd700 1 --2- 172.21.15.154:0/2458059737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc099a60 0x7f14dc0a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14daffd700 1 -- 172.21.15.154:0/2458059737 >> v1:172.21.15.154:6789/0 conn(0x7f14dc0a0e20 legacy=0x7f14dc13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.764+0000 7f14daffd700 1 -- 172.21.15.154:0/2458059737 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc09a760 con 0x7f14dc133b80 2023-09-30T22:27:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14daffd700 1 --2- 172.21.15.154:0/2458059737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc133b80 0x7f14dc133f50 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f14cc006fd0 tx=0x7f14cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0f31c398de1941 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14d9ffb700 1 -- 172.21.15.154:0/2458059737 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc005e30 con 0x7f14dc133b80 2023-09-30T22:27:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14d9ffb700 1 -- 172.21.15.154:0/2458059737 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc004030 con 0x7f14dc133b80 2023-09-30T22:27:34.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14d9ffb700 1 -- 172.21.15.154:0/2458059737 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0043e0 con 0x7f14dc133b80 2023-09-30T22:27:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14e16a2700 1 -- 172.21.15.154:0/2458059737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc133b80 msgr2=0x7f14dc133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14e16a2700 1 --2- 172.21.15.154:0/2458059737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc133b80 0x7f14dc133f50 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f14cc006fd0 tx=0x7f14cc009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14e16a2700 1 -- 172.21.15.154:0/2458059737 shutdown_connections 2023-09-30T22:27:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14e16a2700 1 --2- 172.21.15.154:0/2458059737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc133b80 0x7f14dc133f50 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14e16a2700 1 --2- 172.21.15.154:0/2458059737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc099a60 0x7f14dc0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.765+0000 7f14e16a2700 1 -- 172.21.15.154:0/2458059737 >> 172.21.15.154:0/2458059737 conn(0x7f14dc0a2980 msgr2=0x7f14dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.766+0000 7f14e16a2700 1 -- 172.21.15.154:0/2458059737 shutdown_connections 2023-09-30T22:27:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.766+0000 7f14e16a2700 1 -- 172.21.15.154:0/2458059737 wait complete. 2023-09-30T22:27:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14e16a2700 1 Processor -- start 2023-09-30T22:27:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14e16a2700 1 -- start start 2023-09-30T22:27:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14e16a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14dc099a60 0x7f14dc11a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14e16a2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0a0e20 0x7f14dc11add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14e16a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc133b80 0x7f14dc11b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14e16a2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc11e1b0 con 0x7f14dc0a0e20 2023-09-30T22:27:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14e16a2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc11e3b0 con 0x7f14dc133b80 2023-09-30T22:27:34.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14e16a2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc11d2a0 con 0x7f14dc099a60 2023-09-30T22:27:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14daffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14dc099a60 0x7f14dc11a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14da7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0a0e20 0x7f14dc11add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14daffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14dc099a60 0x7f14dc11a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36930/0 (socket says 172.21.15.154:36930) 2023-09-30T22:27:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14da7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0a0e20 0x7f14dc11add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35728/0 (socket says 172.21.15.154:35728) 2023-09-30T22:27:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14daffd700 1 -- 172.21.15.154:0/36274659 learned_addr learned my addr 172.21.15.154:0/36274659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.767+0000 7f14db7fe700 1 --2- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc133b80 0x7f14dc11b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14da7fc700 1 -- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14dc099a60 msgr2=0x7f14dc11a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14da7fc700 1 --2- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14dc099a60 0x7f14dc11a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14da7fc700 1 -- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc133b80 msgr2=0x7f14dc11b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14da7fc700 1 --2- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc133b80 0x7f14dc11b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14da7fc700 1 -- 172.21.15.154:0/36274659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009500 con 0x7f14dc0a0e20 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14da7fc700 1 --2- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0a0e20 0x7f14dc11add0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f14d000e900 tx=0x7f14d000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14c37fe700 1 -- 172.21.15.154:0/36274659 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0013680 con 0x7f14dc0a0e20 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14c37fe700 1 -- 172.21.15.154:0/36274659 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d00137e0 con 0x7f14dc0a0e20 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14e16a2700 1 -- 172.21.15.154:0/36274659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc12dd40 con 0x7f14dc0a0e20 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14c37fe700 1 -- 172.21.15.154:0/36274659 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0013b50 con 0x7f14dc0a0e20 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.768+0000 7f14e16a2700 1 -- 172.21.15.154:0/36274659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc11d7c0 con 0x7f14dc0a0e20 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.769+0000 7f14c37fe700 1 -- 172.21.15.154:0/36274659 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14d0013cb0 con 0x7f14dc0a0e20 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.769+0000 7f14c37fe700 1 -- 172.21.15.154:0/36274659 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f14d003f4f0 con 0x7f14dc0a0e20 2023-09-30T22:27:34.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.769+0000 7f14e16a2700 1 -- 172.21.15.154:0/36274659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc09e9b0 con 0x7f14dc0a0e20 2023-09-30T22:27:34.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.774+0000 7f14c37fe700 1 -- 172.21.15.154:0/36274659 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14d0017080 con 0x7f14dc0a0e20 2023-09-30T22:27:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1deda87700 1 Processor -- start 2023-09-30T22:27:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1deda87700 1 -- start start 2023-09-30T22:27:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1deda87700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de80a0a70 0x7f1de80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1deda87700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1deda87700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1de8133f50 0x7f1de81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1deda87700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de809e9d0 con 0x7f1de8133f50 2023-09-30T22:27:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1deda87700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de809dc00 con 0x7f1de80a0a70 2023-09-30T22:27:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1deda87700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de809dec0 con 0x7f1de80a1380 2023-09-30T22:27:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1de6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1de77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de80a0a70 0x7f1de80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1de6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36934/0 (socket says 172.21.15.154:36934) 2023-09-30T22:27:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.821+0000 7f1de6ffd700 1 -- 172.21.15.154:0/40420394 learned_addr learned my addr 172.21.15.154:0/40420394 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de7fff700 1 --2- 172.21.15.154:0/40420394 >> v2:172.21.15.154:3300/0 conn(0x7f1de8133f50 0x7f1de81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de6ffd700 1 -- 172.21.15.154:0/40420394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de80a0a70 msgr2=0x7f1de80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de6ffd700 1 --2- 172.21.15.154:0/40420394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de80a0a70 0x7f1de80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de6ffd700 1 -- 172.21.15.154:0/40420394 >> v2:172.21.15.154:3300/0 conn(0x7f1de8133f50 msgr2=0x7f1de81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de6ffd700 1 --2- 172.21.15.154:0/40420394 >> v2:172.21.15.154:3300/0 conn(0x7f1de8133f50 0x7f1de81343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de6ffd700 1 -- 172.21.15.154:0/40420394 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de809e6a0 con 0x7f1de80a1380 2023-09-30T22:27:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de7fff700 1 --2- 172.21.15.154:0/40420394 >> v2:172.21.15.154:3300/0 conn(0x7f1de8133f50 0x7f1de81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de6ffd700 1 --2- 172.21.15.154:0/40420394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8133a10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0098f0 tx=0x7f1ddc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e91d84817d5a5330 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de67fc700 1 -- 172.21.15.154:0/40420394 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc011830 con 0x7f1de80a1380 2023-09-30T22:27:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de67fc700 1 -- 172.21.15.154:0/40420394 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc011990 con 0x7f1de80a1380 2023-09-30T22:27:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.822+0000 7f1de67fc700 1 -- 172.21.15.154:0/40420394 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc011d20 con 0x7f1de80a1380 2023-09-30T22:27:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.823+0000 7f1deda87700 1 -- 172.21.15.154:0/40420394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 msgr2=0x7f1de8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.823+0000 7f1deda87700 1 --2- 172.21.15.154:0/40420394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8133a10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0098f0 tx=0x7f1ddc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.823+0000 7f1deda87700 1 -- 172.21.15.154:0/40420394 shutdown_connections 2023-09-30T22:27:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.823+0000 7f1deda87700 1 --2- 172.21.15.154:0/40420394 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de80a0a70 0x7f1de80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.823+0000 7f1deda87700 1 --2- 172.21.15.154:0/40420394 >> v2:172.21.15.154:3300/0 conn(0x7f1de8133f50 0x7f1de81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.823+0000 7f1deda87700 1 --2- 172.21.15.154:0/40420394 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8133a10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.823+0000 7f1deda87700 1 -- 172.21.15.154:0/40420394 >> 172.21.15.154:0/40420394 conn(0x7f1de80a6610 msgr2=0x7f1de80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.823+0000 7f1deda87700 1 -- 172.21.15.154:0/40420394 shutdown_connections 2023-09-30T22:27:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.823+0000 7f1deda87700 1 -- 172.21.15.154:0/40420394 wait complete. 2023-09-30T22:27:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.824+0000 7f1deda87700 1 Processor -- start 2023-09-30T22:27:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.824+0000 7f1deda87700 1 -- start start 2023-09-30T22:27:34.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.824+0000 7f1deda87700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de80a0a70 0x7f1de8122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.824+0000 7f1deda87700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.824+0000 7f1deda87700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de8133f50 0x7f1de8122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:34.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.824+0000 7f1deda87700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8125960 con 0x7f1de80a0a70 2023-09-30T22:27:34.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.824+0000 7f1deda87700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8124df0 con 0x7f1de8133f50 2023-09-30T22:27:34.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.824+0000 7f1deda87700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80a03e0 con 0x7f1de80a1380 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de8133f50 0x7f1de8122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de8133f50 0x7f1de8122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:37578/0 (socket says 172.21.15.154:37578) 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de7fff700 1 -- 172.21.15.154:0/115091340 learned_addr learned my addr 172.21.15.154:0/115091340 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de80a0a70 0x7f1de8122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de6ffd700 1 --2- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de7fff700 1 -- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 msgr2=0x7f1de8122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de7fff700 1 --2- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de7fff700 1 -- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de80a0a70 msgr2=0x7f1de8122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de7fff700 1 --2- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de80a0a70 0x7f1de8122430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de7fff700 1 -- 172.21.15.154:0/115091340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0009a70 con 0x7f1de8133f50 2023-09-30T22:27:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de6ffd700 1 --2- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1de7fff700 1 --2- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de8133f50 0x7f1de8122eb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009f00 tx=0x7f1de000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1dcffff700 1 -- 172.21.15.154:0/115091340 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0009d70 con 0x7f1de8133f50 2023-09-30T22:27:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1dcffff700 1 -- 172.21.15.154:0/115091340 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000f040 con 0x7f1de8133f50 2023-09-30T22:27:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1dcffff700 1 -- 172.21.15.154:0/115091340 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000ce20 con 0x7f1de8133f50 2023-09-30T22:27:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1deda87700 1 -- 172.21.15.154:0/115091340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc009550 con 0x7f1de8133f50 2023-09-30T22:27:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.825+0000 7f1deda87700 1 -- 172.21.15.154:0/115091340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de8125660 con 0x7f1de8133f50 2023-09-30T22:27:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.826+0000 7f1dcffff700 1 -- 172.21.15.154:0/115091340 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1de0014480 con 0x7f1de8133f50 2023-09-30T22:27:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.826+0000 7f1dcffff700 1 -- 172.21.15.154:0/115091340 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1de003fc10 con 0x7f1de8133f50 2023-09-30T22:27:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.827+0000 7f1deda87700 1 -- 172.21.15.154:0/115091340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de811f760 con 0x7f1de8133f50 2023-09-30T22:27:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.831+0000 7f1dcffff700 1 -- 172.21.15.154:0/115091340 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1de0012750 con 0x7f1de8133f50 2023-09-30T22:27:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.902+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1742325375 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe28072480 con 0x7fbe28135f80 2023-09-30T22:27:34.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.902+0000 7fbe0ffff700 1 -- 172.21.15.154:0/1742325375 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe28072480 con 0x7fbe28135f80 2023-09-30T22:27:34.902 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.904+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28135f80 msgr2=0x7fbe281c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.904+0000 7fbe2de0e700 1 --2- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28135f80 0x7fbe281c86e0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000ef90 tx=0x7fbe2000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.904+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1742325375 shutdown_connections 2023-09-30T22:27:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.904+0000 7fbe2de0e700 1 --2- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe28135f80 0x7fbe281c86e0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.904+0000 7fbe2de0e700 1 --2- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28099e20 0x7fbe28070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.904+0000 7fbe2de0e700 1 --2- 172.21.15.154:0/1742325375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbe28133660 0x7fbe281c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:34.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.905+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1742325375 >> 172.21.15.154:0/1742325375 conn(0x7fbe280a2980 msgr2=0x7fbe281324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:34.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.905+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1742325375 shutdown_connections 2023-09-30T22:27:34.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:34.905+0000 7fbe2de0e700 1 -- 172.21.15.154:0/1742325375 wait complete. 2023-09-30T22:27:34.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:35.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.010+0000 7f14e16a2700 1 -- 172.21.15.154:0/36274659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14dc11d760 con 0x7f14dc0a0e20 2023-09-30T22:27:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.011+0000 7f14c37fe700 1 -- 172.21.15.154:0/36274659 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14d000c3f0 con 0x7f14dc0a0e20 2023-09-30T22:27:35.011 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.013+0000 7f14e16a2700 1 -- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0a0e20 msgr2=0x7f14dc11add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.013+0000 7f14e16a2700 1 --2- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0a0e20 0x7f14dc11add0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f14d000e900 tx=0x7f14d000ec10 comp rx=0 tx=0).stop 2023-09-30T22:27:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.013+0000 7f14e16a2700 1 -- 172.21.15.154:0/36274659 shutdown_connections 2023-09-30T22:27:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.013+0000 7f14e16a2700 1 --2- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14dc133b80 0x7f14dc11b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.013+0000 7f14e16a2700 1 --2- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14dc099a60 0x7f14dc11a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.013+0000 7f14e16a2700 1 --2- 172.21.15.154:0/36274659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0a0e20 0x7f14dc11add0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.013+0000 7f14e16a2700 1 -- 172.21.15.154:0/36274659 >> 172.21.15.154:0/36274659 conn(0x7f14dc0a2980 msgr2=0x7f14dc12f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.013+0000 7f14e16a2700 1 -- 172.21.15.154:0/36274659 shutdown_connections 2023-09-30T22:27:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.013+0000 7f14e16a2700 1 -- 172.21.15.154:0/36274659 wait complete. 2023-09-30T22:27:35.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.046+0000 7f1deda87700 1 -- 172.21.15.154:0/115091340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1de8125600 con 0x7f1de8133f50 2023-09-30T22:27:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.046+0000 7f1dcffff700 1 -- 172.21.15.154:0/115091340 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1de001c3b0 con 0x7f1de8133f50 2023-09-30T22:27:35.046 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.048+0000 7f1deda87700 1 -- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de8133f50 msgr2=0x7f1de8122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.048+0000 7f1deda87700 1 --2- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de8133f50 0x7f1de8122eb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009f00 tx=0x7f1de000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.049+0000 7f1deda87700 1 -- 172.21.15.154:0/115091340 shutdown_connections 2023-09-30T22:27:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.049+0000 7f1deda87700 1 --2- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1de8133f50 0x7f1de8122eb0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.049+0000 7f1deda87700 1 --2- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1de80a0a70 0x7f1de8122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.049+0000 7f1deda87700 1 --2- 172.21.15.154:0/115091340 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1de80a1380 0x7f1de8122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.049+0000 7f1deda87700 1 -- 172.21.15.154:0/115091340 >> 172.21.15.154:0/115091340 conn(0x7f1de80a6610 msgr2=0x7f1de811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.049+0000 7f1deda87700 1 -- 172.21.15.154:0/115091340 shutdown_connections 2023-09-30T22:27:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.049+0000 7f1deda87700 1 -- 172.21.15.154:0/115091340 wait complete. 2023-09-30T22:27:35.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:35.121 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:35.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.244+0000 7fec81c0b700 1 Processor -- start 2023-09-30T22:27:35.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.244+0000 7fec81c0b700 1 -- start start 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec81c0b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec7c09e870 0x7fec7c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec81c0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09f180 0x7fec7c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec81c0b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c09c970 con 0x7fec7c131d70 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec81c0b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c0a0920 con 0x7fec7c09e870 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec81c0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c09f9c0 con 0x7fec7c09f180 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec7c09e870 0x7fec7c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09f180 0x7fec7c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec7c09e870 0x7fec7c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35756/0 (socket says 172.21.15.154:35756) 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7b7fe700 1 -- 172.21.15.154:0/374762345 learned_addr learned my addr 172.21.15.154:0/374762345 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7b7fe700 1 -- 172.21.15.154:0/374762345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09f180 msgr2=0x7fec7c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7b7fe700 1 --2- 172.21.15.154:0/374762345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09f180 0x7fec7c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7b7fe700 1 -- 172.21.15.154:0/374762345 >> v1:172.21.15.154:6789/0 conn(0x7fec7c131d70 legacy=0x7fec7c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7b7fe700 1 -- 172.21.15.154:0/374762345 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c09bab0 con 0x7fec7c09e870 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7affd700 1 --2- 172.21.15.154:0/374762345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09f180 0x7fec7c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7b7fe700 1 --2- 172.21.15.154:0/374762345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c09e870 0x7fec7c09ec40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0098f0 tx=0x7fec6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4748ea056ad5c5cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.245+0000 7fec7a7fc700 1 -- 172.21.15.154:0/374762345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c011830 con 0x7fec7c09e870 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec7a7fc700 1 -- 172.21.15.154:0/374762345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c011990 con 0x7fec7c09e870 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec7a7fc700 1 -- 172.21.15.154:0/374762345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c011d20 con 0x7fec7c09e870 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec81c0b700 1 -- 172.21.15.154:0/374762345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c09e870 msgr2=0x7fec7c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec81c0b700 1 --2- 172.21.15.154:0/374762345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c09e870 0x7fec7c09ec40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0098f0 tx=0x7fec6c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec81c0b700 1 -- 172.21.15.154:0/374762345 shutdown_connections 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec81c0b700 1 --2- 172.21.15.154:0/374762345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c09e870 0x7fec7c09ec40 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec81c0b700 1 --2- 172.21.15.154:0/374762345 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09f180 0x7fec7c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec81c0b700 1 -- 172.21.15.154:0/374762345 >> 172.21.15.154:0/374762345 conn(0x7fec7c0a4430 msgr2=0x7fec7c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec81c0b700 1 -- 172.21.15.154:0/374762345 shutdown_connections 2023-09-30T22:27:35.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.246+0000 7fec81c0b700 1 -- 172.21.15.154:0/374762345 wait complete. 2023-09-30T22:27:35.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.247+0000 7fec81c0b700 1 Processor -- start 2023-09-30T22:27:35.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.247+0000 7fec81c0b700 1 -- start start 2023-09-30T22:27:35.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.247+0000 7fec81c0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09e870 0x7fec7c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec81c0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c09f180 0x7fec7c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec81c0b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c131d70 0x7fec7c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:35.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec81c0b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0a2cf0 con 0x7fec7c131d70 2023-09-30T22:27:35.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec81c0b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c09dba0 con 0x7fec7c09f180 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec81c0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c06cca0 con 0x7fec7c09e870 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09e870 0x7fec7c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09e870 0x7fec7c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:36974/0 (socket says 172.21.15.154:36974) 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7b7fe700 1 -- 172.21.15.154:0/1995185310 learned_addr learned my addr 172.21.15.154:0/1995185310 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7affd700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c09f180 0x7fec7c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7bfff700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c131d70 0x7fec7c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7affd700 1 -- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09e870 msgr2=0x7fec7c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7affd700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09e870 0x7fec7c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7affd700 1 -- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c131d70 msgr2=0x7fec7c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7affd700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c131d70 0x7fec7c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7affd700 1 -- 172.21.15.154:0/1995185310 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700094a0 con 0x7fec7c09f180 2023-09-30T22:27:35.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7b7fe700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09e870 0x7fec7c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7bfff700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c131d70 0x7fec7c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec7affd700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c09f180 0x7fec7c06bdf0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fec7000e9b0 tx=0x7fec7000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec63fff700 1 -- 172.21.15.154:0/1995185310 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000ee50 con 0x7fec7c09f180 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec63fff700 1 -- 172.21.15.154:0/1995185310 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7000c850 con 0x7fec7c09f180 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec81c0b700 1 -- 172.21.15.154:0/1995185310 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c009550 con 0x7fec7c09f180 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec63fff700 1 -- 172.21.15.154:0/1995185310 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000cc00 con 0x7fec7c09f180 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.248+0000 7fec81c0b700 1 -- 172.21.15.154:0/1995185310 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c125f30 con 0x7fec7c09f180 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.249+0000 7fec63fff700 1 -- 172.21.15.154:0/1995185310 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec70013470 con 0x7fec7c09f180 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.249+0000 7fec63fff700 1 -- 172.21.15.154:0/1995185310 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec7003f6c0 con 0x7fec7c09f180 2023-09-30T22:27:35.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.249+0000 7fec81c0b700 1 -- 172.21.15.154:0/1995185310 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c04f2a0 con 0x7fec7c09f180 2023-09-30T22:27:35.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.254+0000 7fec63fff700 1 -- 172.21.15.154:0/1995185310 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec70021080 con 0x7fec7c09f180 2023-09-30T22:27:35.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.439+0000 7fec81c0b700 1 -- 172.21.15.154:0/1995185310 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec7c06b2a0 con 0x7fec7c09f180 2023-09-30T22:27:35.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.440+0000 7fec63fff700 1 -- 172.21.15.154:0/1995185310 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec70017020 con 0x7fec7c09f180 2023-09-30T22:27:35.441 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:35.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.442+0000 7fec81c0b700 1 -- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c09f180 msgr2=0x7fec7c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:35.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.442+0000 7fec81c0b700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c09f180 0x7fec7c06bdf0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fec7000e9b0 tx=0x7fec7000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.442+0000 7fec81c0b700 1 -- 172.21.15.154:0/1995185310 shutdown_connections 2023-09-30T22:27:35.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.442+0000 7fec81c0b700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c131d70 0x7fec7c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.442+0000 7fec81c0b700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec7c09e870 0x7fec7c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.442+0000 7fec81c0b700 1 --2- 172.21.15.154:0/1995185310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c09f180 0x7fec7c06bdf0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:35.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.442+0000 7fec81c0b700 1 -- 172.21.15.154:0/1995185310 >> 172.21.15.154:0/1995185310 conn(0x7fec7c0a4430 msgr2=0x7fec7c09cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:35.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.442+0000 7fec81c0b700 1 -- 172.21.15.154:0/1995185310 shutdown_connections 2023-09-30T22:27:35.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:35.442+0000 7fec81c0b700 1 -- 172.21.15.154:0/1995185310 wait complete. 2023-09-30T22:27:35.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:35.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:36.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.051+0000 7ff7d4161700 1 Processor -- start 2023-09-30T22:27:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.051+0000 7ff7d4161700 1 -- start start 2023-09-30T22:27:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.051+0000 7ff7d4161700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.051+0000 7ff7d4161700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7cc09e170 0x7ff7cc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d4161700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc09aaa0 con 0x7ff7cc130ce0 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d4161700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc09f870 con 0x7ff7cc09e170 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d4161700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc09b360 con 0x7ff7cc09d860 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d16fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7cc09e170 0x7ff7cc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d1efd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d1efd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44142/0 (socket says 172.21.15.154:44142) 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d16fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7cc09e170 0x7ff7cc1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52736/0 (socket says 172.21.15.154:52736) 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d1efd700 1 -- 172.21.15.154:0/2745532307 learned_addr learned my addr 172.21.15.154:0/2745532307 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d16fc700 1 -- 172.21.15.154:0/2745532307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 msgr2=0x7ff7cc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:36.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d16fc700 1 --2- 172.21.15.154:0/2745532307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d0efb700 1 -- 172.21.15.154:0/2745532307 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651183892 0 0) 0x7ff7cc09aaa0 con 0x7ff7cc130ce0 2023-09-30T22:27:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d16fc700 1 -- 172.21.15.154:0/2745532307 >> v1:172.21.15.154:6789/0 conn(0x7ff7cc130ce0 legacy=0x7ff7cc1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d16fc700 1 -- 172.21.15.154:0/2745532307 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc09b620 con 0x7ff7cc09e170 2023-09-30T22:27:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d1efd700 1 --2- 172.21.15.154:0/2745532307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d16fc700 1 --2- 172.21.15.154:0/2745532307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc09e170 0x7ff7cc1307a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009840 tx=0x7ff7bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93210a8ceff59638 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d0efb700 1 -- 172.21.15.154:0/2745532307 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc011830 con 0x7ff7cc09e170 2023-09-30T22:27:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d0efb700 1 -- 172.21.15.154:0/2745532307 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc011990 con 0x7ff7cc09e170 2023-09-30T22:27:36.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.052+0000 7ff7d0efb700 1 -- 172.21.15.154:0/2745532307 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc011d20 con 0x7ff7cc09e170 2023-09-30T22:27:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.053+0000 7ff7d4161700 1 -- 172.21.15.154:0/2745532307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc09e170 msgr2=0x7ff7cc1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.053+0000 7ff7d4161700 1 --2- 172.21.15.154:0/2745532307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc09e170 0x7ff7cc1307a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009840 tx=0x7ff7bc009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.053+0000 7ff7d4161700 1 -- 172.21.15.154:0/2745532307 shutdown_connections 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.053+0000 7ff7d4161700 1 --2- 172.21.15.154:0/2745532307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.053+0000 7ff7d4161700 1 --2- 172.21.15.154:0/2745532307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc09e170 0x7ff7cc1307a0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.053+0000 7ff7d4161700 1 -- 172.21.15.154:0/2745532307 >> 172.21.15.154:0/2745532307 conn(0x7ff7cc099c40 msgr2=0x7ff7cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.053+0000 7ff7d4161700 1 -- 172.21.15.154:0/2745532307 shutdown_connections 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.053+0000 7ff7d4161700 1 -- 172.21.15.154:0/2745532307 wait complete. 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.054+0000 7ff7d4161700 1 Processor -- start 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.054+0000 7ff7d4161700 1 -- start start 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d4161700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc1355a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d4161700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7cc09e170 0x7ff7cc135ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d4161700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc130ce0 0x7ff7cc136020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d4161700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc138e00 con 0x7ff7cc130ce0 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d4161700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0a1f00 con 0x7ff7cc09d860 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d4161700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc138aa0 con 0x7ff7cc09e170 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d1efd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc1355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d1efd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc1355a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44152/0 (socket says 172.21.15.154:44152) 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d26fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc130ce0 0x7ff7cc136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d1efd700 1 -- 172.21.15.154:0/248999317 learned_addr learned my addr 172.21.15.154:0/248999317 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d16fc700 1 --2- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7cc09e170 0x7ff7cc135ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d1efd700 1 -- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7cc09e170 msgr2=0x7ff7cc135ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d1efd700 1 --2- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7cc09e170 0x7ff7cc135ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d1efd700 1 -- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc130ce0 msgr2=0x7ff7cc136020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d1efd700 1 --2- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc130ce0 0x7ff7cc136020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d1efd700 1 -- 172.21.15.154:0/248999317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8009550 con 0x7ff7cc09d860 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d26fe700 1 --2- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc130ce0 0x7ff7cc136020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d1efd700 1 --2- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc1355a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800ebe0 tx=0x7ff7c800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7c27fc700 1 -- 172.21.15.154:0/248999317 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800c850 con 0x7ff7cc09d860 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7c27fc700 1 -- 172.21.15.154:0/248999317 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c800c9b0 con 0x7ff7cc09d860 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7c27fc700 1 -- 172.21.15.154:0/248999317 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800cd40 con 0x7ff7cc09d860 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.055+0000 7ff7d4161700 1 -- 172.21.15.154:0/248999317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc0094a0 con 0x7ff7cc09d860 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.056+0000 7ff7d4161700 1 -- 172.21.15.154:0/248999317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc1387d0 con 0x7ff7cc09d860 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.056+0000 7ff7c27fc700 1 -- 172.21.15.154:0/248999317 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7c8013470 con 0x7ff7cc09d860 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.056+0000 7ff7d4161700 1 -- 172.21.15.154:0/248999317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc137980 con 0x7ff7cc09d860 2023-09-30T22:27:36.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.057+0000 7ff7c27fc700 1 -- 172.21.15.154:0/248999317 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff7c803f8a0 con 0x7ff7cc09d860 2023-09-30T22:27:36.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:36.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.061+0000 7ff7c27fc700 1 -- 172.21.15.154:0/248999317 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7c80232f0 con 0x7ff7cc09d860 2023-09-30T22:27:36.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.157+0000 7fee9ff37700 1 Processor -- start 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.157+0000 7fee9ff37700 1 -- start start 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9ff37700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee9809f430 0x7fee98136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9ff37700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee98137010 0x7fee981393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9ff37700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9809b6d0 con 0x7fee9809e950 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9ff37700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9809afb0 con 0x7fee9809f430 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9ff37700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee980a0970 con 0x7fee98137010 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9d4d2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee9809f430 0x7fee98136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9e4d4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee98137010 0x7fee981393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9d4d2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee9809f430 0x7fee98136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52754/0 (socket says 172.21.15.154:52754) 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9d4d2700 1 -- 172.21.15.154:0/2068760812 learned_addr learned my addr 172.21.15.154:0/2068760812 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:36.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9e4d4700 1 -- 172.21.15.154:0/2068760812 >> v2:172.21.15.154:3300/0 conn(0x7fee9809f430 msgr2=0x7fee98136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:36.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9e4d4700 1 --2- 172.21.15.154:0/2068760812 >> v2:172.21.15.154:3300/0 conn(0x7fee9809f430 0x7fee98136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9e4d4700 1 -- 172.21.15.154:0/2068760812 >> v1:172.21.15.154:6789/0 conn(0x7fee9809e950 legacy=0x7fee9809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9e4d4700 1 -- 172.21.15.154:0/2068760812 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980a0320 con 0x7fee98137010 2023-09-30T22:27:36.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9d4d2700 1 --2- 172.21.15.154:0/2068760812 >> v2:172.21.15.154:3300/0 conn(0x7fee9809f430 0x7fee98136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:36.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9e4d4700 1 --2- 172.21.15.154:0/2068760812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee98137010 0x7fee981393f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fee90009d90 tx=0x7fee9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e7c6ed9bcb36301 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:36.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9ccd1700 1 -- 172.21.15.154:0/2068760812 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9000e070 con 0x7fee98137010 2023-09-30T22:27:36.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9ccd1700 1 -- 172.21.15.154:0/2068760812 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9000bb20 con 0x7fee98137010 2023-09-30T22:27:36.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.158+0000 7fee9ccd1700 1 -- 172.21.15.154:0/2068760812 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90012430 con 0x7fee98137010 2023-09-30T22:27:36.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.159+0000 7fee9ff37700 1 -- 172.21.15.154:0/2068760812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee98137010 msgr2=0x7fee981393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.159+0000 7fee9ff37700 1 --2- 172.21.15.154:0/2068760812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee98137010 0x7fee981393f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fee90009d90 tx=0x7fee9000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:36.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.159+0000 7fee9ff37700 1 -- 172.21.15.154:0/2068760812 shutdown_connections 2023-09-30T22:27:36.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.159+0000 7fee9ff37700 1 --2- 172.21.15.154:0/2068760812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee98137010 0x7fee981393f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.159+0000 7fee9ff37700 1 --2- 172.21.15.154:0/2068760812 >> v2:172.21.15.154:3300/0 conn(0x7fee9809f430 0x7fee98136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.159+0000 7fee9ff37700 1 -- 172.21.15.154:0/2068760812 >> 172.21.15.154:0/2068760812 conn(0x7fee980a0f70 msgr2=0x7fee980a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.159+0000 7fee9ff37700 1 -- 172.21.15.154:0/2068760812 shutdown_connections 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.159+0000 7fee9ff37700 1 -- 172.21.15.154:0/2068760812 wait complete. 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9ff37700 1 Processor -- start 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9ff37700 1 -- start start 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9ff37700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee9809e950 0x7fee981c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9ff37700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9809f430 0x7fee981c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9ff37700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee98137010 0x7fee981c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9ff37700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9806d3f0 con 0x7fee98137010 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9ff37700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee98122100 con 0x7fee9809f430 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9ff37700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee98122b70 con 0x7fee9809e950 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9dcd3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee9809e950 0x7fee981c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9dcd3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee9809e950 0x7fee981c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34614/0 (socket says 172.21.15.154:34614) 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9dcd3700 1 -- 172.21.15.154:0/777575115 learned_addr learned my addr 172.21.15.154:0/777575115 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9d4d2700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9809f430 0x7fee981c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.161+0000 7fee9e4d4700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee98137010 0x7fee981c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9dcd3700 1 -- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9809f430 msgr2=0x7fee981c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9dcd3700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9809f430 0x7fee981c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9dcd3700 1 -- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee98137010 msgr2=0x7fee981c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9dcd3700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee98137010 0x7fee981c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9dcd3700 1 -- 172.21.15.154:0/777575115 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88009550 con 0x7fee9809e950 2023-09-30T22:27:36.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9d4d2700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9809f430 0x7fee981c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:36.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9e4d4700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee98137010 0x7fee981c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:36.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9dcd3700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee9809e950 0x7fee981c8220 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fee9400c4d0 tx=0x7fee9400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:36.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee8e7fc700 1 -- 172.21.15.154:0/777575115 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940054e0 con 0x7fee9809e950 2023-09-30T22:27:36.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee8e7fc700 1 -- 172.21.15.154:0/777575115 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94003680 con 0x7fee9809e950 2023-09-30T22:27:36.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9ff37700 1 -- 172.21.15.154:0/777575115 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90009a70 con 0x7fee9809e950 2023-09-30T22:27:36.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee8e7fc700 1 -- 172.21.15.154:0/777575115 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94003a30 con 0x7fee9809e950 2023-09-30T22:27:36.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.162+0000 7fee9ff37700 1 -- 172.21.15.154:0/777575115 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee98120cc0 con 0x7fee9809e950 2023-09-30T22:27:36.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.163+0000 7fee8e7fc700 1 -- 172.21.15.154:0/777575115 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee94003b90 con 0x7fee9809e950 2023-09-30T22:27:36.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.163+0000 7fee9ff37700 1 -- 172.21.15.154:0/777575115 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9804f2a0 con 0x7fee9809e950 2023-09-30T22:27:36.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.163+0000 7fee8e7fc700 1 -- 172.21.15.154:0/777575115 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee9403ea60 con 0x7fee9809e950 2023-09-30T22:27:36.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.168+0000 7fee8e7fc700 1 -- 172.21.15.154:0/777575115 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee94003e40 con 0x7fee9809e950 2023-09-30T22:27:36.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.192+0000 7fd23337f700 1 Processor -- start 2023-09-30T22:27:36.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.192+0000 7fd23337f700 1 -- start start 2023-09-30T22:27:36.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23337f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23337f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c137000 0x7fd22c1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23337f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0a1640 con 0x7fd22c131980 2023-09-30T22:27:36.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23337f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c06eb30 con 0x7fd22c137000 2023-09-30T22:27:36.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23337f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0a22d0 con 0x7fd22c1346e0 2023-09-30T22:27:36.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23091a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23091a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34620/0 (socket says 172.21.15.154:34620) 2023-09-30T22:27:36.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23091a700 1 -- 172.21.15.154:0/594394288 learned_addr learned my addr 172.21.15.154:0/594394288 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:36.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23111b700 1 --1- 172.21.15.154:0/594394288 >> v1:172.21.15.154:6789/0 conn(0x7fd22c131980 0x7fd22c131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37384/0 (socket says 172.21.15.154:37384) 2023-09-30T22:27:36.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23191c700 1 --2- 172.21.15.154:0/594394288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c137000 0x7fd22c1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd223fff700 1 -- 172.21.15.154:0/594394288 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394023550 0 0) 0x7fd22c0a1640 con 0x7fd22c131980 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd223fff700 1 -- 172.21.15.154:0/594394288 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2180035b0 con 0x7fd22c131980 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23191c700 1 -- 172.21.15.154:0/594394288 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 msgr2=0x7fd22c136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23191c700 1 --2- 172.21.15.154:0/594394288 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23191c700 1 -- 172.21.15.154:0/594394288 >> v1:172.21.15.154:6789/0 conn(0x7fd22c131980 legacy=0x7fd22c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23191c700 1 -- 172.21.15.154:0/594394288 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c131550 con 0x7fd22c137000 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.193+0000 7fd23091a700 1 --2- 172.21.15.154:0/594394288 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.194+0000 7fd23191c700 1 --2- 172.21.15.154:0/594394288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c137000 0x7fd22c1393e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd224009dc0 tx=0x7fd22400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8efa8db08af0a4b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.194+0000 7fd223fff700 1 -- 172.21.15.154:0/594394288 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400bd20 con 0x7fd22c137000 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.194+0000 7fd223fff700 1 -- 172.21.15.154:0/594394288 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22400be80 con 0x7fd22c137000 2023-09-30T22:27:36.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.194+0000 7fd223fff700 1 -- 172.21.15.154:0/594394288 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240106d0 con 0x7fd22c137000 2023-09-30T22:27:36.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.195+0000 7fd23337f700 1 -- 172.21.15.154:0/594394288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c137000 msgr2=0x7fd22c1393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.195+0000 7fd23337f700 1 --2- 172.21.15.154:0/594394288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c137000 0x7fd22c1393e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd224009dc0 tx=0x7fd22400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:36.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.195+0000 7fd23337f700 1 -- 172.21.15.154:0/594394288 shutdown_connections 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.195+0000 7fd23337f700 1 --2- 172.21.15.154:0/594394288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c137000 0x7fd22c1393e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.195+0000 7fd23337f700 1 --2- 172.21.15.154:0/594394288 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.195+0000 7fd23337f700 1 -- 172.21.15.154:0/594394288 >> 172.21.15.154:0/594394288 conn(0x7fd22c0a2980 msgr2=0x7fd22c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.195+0000 7fd23337f700 1 -- 172.21.15.154:0/594394288 shutdown_connections 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.195+0000 7fd23337f700 1 -- 172.21.15.154:0/594394288 wait complete. 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23337f700 1 Processor -- start 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23337f700 1 -- start start 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23337f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c131980 0x7fd22c09a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23337f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c09aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23337f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c137000 0x7fd22c09b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23337f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1199e0 con 0x7fd22c137000 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23337f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c119230 con 0x7fd22c131980 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23337f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0a1c40 con 0x7fd22c1346e0 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23091a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c09aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23111b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c131980 0x7fd22c09a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23091a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c09aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34626/0 (socket says 172.21.15.154:34626) 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23091a700 1 -- 172.21.15.154:0/1968497045 learned_addr learned my addr 172.21.15.154:0/1968497045 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.196+0000 7fd23191c700 1 --2- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c137000 0x7fd22c09b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd23091a700 1 -- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c131980 msgr2=0x7fd22c09a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd23091a700 1 --2- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c131980 0x7fd22c09a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd23091a700 1 -- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c137000 msgr2=0x7fd22c09b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd23091a700 1 --2- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c137000 0x7fd22c09b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd23091a700 1 -- 172.21.15.154:0/1968497045 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c009550 con 0x7fd22c1346e0 2023-09-30T22:27:36.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd23091a700 1 --2- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c09aec0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00ec10 tx=0x7fd21c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:36.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd221ffb700 1 -- 172.21.15.154:0/1968497045 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00c850 con 0x7fd22c1346e0 2023-09-30T22:27:36.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd221ffb700 1 -- 172.21.15.154:0/1968497045 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c00c9b0 con 0x7fd22c1346e0 2023-09-30T22:27:36.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd221ffb700 1 -- 172.21.15.154:0/1968497045 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00cd40 con 0x7fd22c1346e0 2023-09-30T22:27:36.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd23337f700 1 -- 172.21.15.154:0/1968497045 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd224009a70 con 0x7fd22c1346e0 2023-09-30T22:27:36.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.197+0000 7fd23337f700 1 -- 172.21.15.154:0/1968497045 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c1302e0 con 0x7fd22c1346e0 2023-09-30T22:27:36.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.198+0000 7fd221ffb700 1 -- 172.21.15.154:0/1968497045 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd21c013470 con 0x7fd22c1346e0 2023-09-30T22:27:36.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.198+0000 7fd221ffb700 1 -- 172.21.15.154:0/1968497045 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd21c03f840 con 0x7fd22c1346e0 2023-09-30T22:27:36.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.198+0000 7fd23337f700 1 -- 172.21.15.154:0/1968497045 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c04f2a0 con 0x7fd22c1346e0 2023-09-30T22:27:36.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.207+0000 7fd221ffb700 1 -- 172.21.15.154:0/1968497045 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd21c013720 con 0x7fd22c1346e0 2023-09-30T22:27:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.266+0000 7ff7d4161700 1 -- 172.21.15.154:0/248999317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7cc04f2a0 con 0x7ff7cc09d860 2023-09-30T22:27:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.266+0000 7ff7c27fc700 1 -- 172.21.15.154:0/248999317 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7c8017030 con 0x7ff7cc09d860 2023-09-30T22:27:36.267 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.268+0000 7ff7d4161700 1 -- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 msgr2=0x7ff7cc1355a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.268+0000 7ff7d4161700 1 --2- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc1355a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800ebe0 tx=0x7ff7c800eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.268+0000 7ff7d4161700 1 -- 172.21.15.154:0/248999317 shutdown_connections 2023-09-30T22:27:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.268+0000 7ff7d4161700 1 --2- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7cc130ce0 0x7ff7cc136020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.268+0000 7ff7d4161700 1 --2- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7cc09d860 0x7ff7cc1355a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.268+0000 7ff7d4161700 1 --2- 172.21.15.154:0/248999317 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7cc09e170 0x7ff7cc135ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.268+0000 7ff7d4161700 1 -- 172.21.15.154:0/248999317 >> 172.21.15.154:0/248999317 conn(0x7ff7cc099c40 msgr2=0x7ff7cc1393e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.269+0000 7ff7d4161700 1 -- 172.21.15.154:0/248999317 shutdown_connections 2023-09-30T22:27:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.269+0000 7ff7d4161700 1 -- 172.21.15.154:0/248999317 wait complete. 2023-09-30T22:27:36.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:36.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.365+0000 7fee9ff37700 1 -- 172.21.15.154:0/777575115 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee98121d50 con 0x7fee9809e950 2023-09-30T22:27:36.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.365+0000 7fee8e7fc700 1 -- 172.21.15.154:0/777575115 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee94017030 con 0x7fee9809e950 2023-09-30T22:27:36.365 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:36.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.367+0000 7fee9ff37700 1 -- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee9809e950 msgr2=0x7fee981c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.367+0000 7fee9ff37700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee9809e950 0x7fee981c8220 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fee9400c4d0 tx=0x7fee9400c7e0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.367+0000 7fee9ff37700 1 -- 172.21.15.154:0/777575115 shutdown_connections 2023-09-30T22:27:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.367+0000 7fee9ff37700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee98137010 0x7fee981c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.367+0000 7fee9ff37700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee9809e950 0x7fee981c8220 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.367+0000 7fee9ff37700 1 --2- 172.21.15.154:0/777575115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9809f430 0x7fee981c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.367+0000 7fee9ff37700 1 -- 172.21.15.154:0/777575115 >> 172.21.15.154:0/777575115 conn(0x7fee980a0f70 msgr2=0x7fee98134b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.367+0000 7fee9ff37700 1 -- 172.21.15.154:0/777575115 shutdown_connections 2023-09-30T22:27:36.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.367+0000 7fee9ff37700 1 -- 172.21.15.154:0/777575115 wait complete. 2023-09-30T22:27:36.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:36.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.402+0000 7fd23337f700 1 -- 172.21.15.154:0/1968497045 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd22c06bce0 con 0x7fd22c1346e0 2023-09-30T22:27:36.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.402+0000 7fd221ffb700 1 -- 172.21.15.154:0/1968497045 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd21c021020 con 0x7fd22c1346e0 2023-09-30T22:27:36.402 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.404+0000 7fd23337f700 1 -- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 msgr2=0x7fd22c09aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.404+0000 7fd23337f700 1 --2- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c09aec0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00ec10 tx=0x7fd21c00ef20 comp rx=0 tx=0).stop 2023-09-30T22:27:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.404+0000 7fd23337f700 1 -- 172.21.15.154:0/1968497045 shutdown_connections 2023-09-30T22:27:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.404+0000 7fd23337f700 1 --2- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c137000 0x7fd22c09b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.404+0000 7fd23337f700 1 --2- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c131980 0x7fd22c09a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.404+0000 7fd23337f700 1 --2- 172.21.15.154:0/1968497045 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd22c1346e0 0x7fd22c09aec0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.404+0000 7fd23337f700 1 -- 172.21.15.154:0/1968497045 >> 172.21.15.154:0/1968497045 conn(0x7fd22c0a2980 msgr2=0x7fd22c12f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.404+0000 7fd23337f700 1 -- 172.21.15.154:0/1968497045 shutdown_connections 2023-09-30T22:27:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.404+0000 7fd23337f700 1 -- 172.21.15.154:0/1968497045 wait complete. 2023-09-30T22:27:36.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:36.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:36.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.578+0000 7f0ac5878700 1 Processor -- start 2023-09-30T22:27:36.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.578+0000 7f0ac5878700 1 -- start start 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0ac5878700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0136960 0x7f0ac0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0ac5878700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ac0139280 0x7f0ac013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0ac5878700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac006b2d0 con 0x7f0ac0133ad0 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0ac5878700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac01345b0 con 0x7f0ac0139280 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0ac5878700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac0133610 con 0x7f0ac0136960 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ac0139280 0x7f0ac013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abe7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0136960 0x7f0ac0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abe7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0136960 0x7f0ac0138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44206/0 (socket says 172.21.15.154:44206) 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abf7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ac0139280 0x7f0ac013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52772/0 (socket says 172.21.15.154:52772) 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abe7fc700 1 -- 172.21.15.154:0/3034492323 learned_addr learned my addr 172.21.15.154:0/3034492323 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:36.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abf7fe700 1 -- 172.21.15.154:0/3034492323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0136960 msgr2=0x7f0ac0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:36.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abf7fe700 1 --2- 172.21.15.154:0/3034492323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0136960 0x7f0ac0138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abf7fe700 1 -- 172.21.15.154:0/3034492323 >> v1:172.21.15.154:6789/0 conn(0x7f0ac0133ad0 legacy=0x7f0ac0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abf7fe700 1 -- 172.21.15.154:0/3034492323 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac009a500 con 0x7f0ac0139280 2023-09-30T22:27:36.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abdffb700 1 -- 172.21.15.154:0/3034492323 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741472928 0 0) 0x7f0ac006b2d0 con 0x7f0ac0133ad0 2023-09-30T22:27:36.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abe7fc700 1 --2- 172.21.15.154:0/3034492323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0136960 0x7f0ac0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:36.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.579+0000 7f0abf7fe700 1 --2- 172.21.15.154:0/3034492323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac0139280 0x7f0ac013b660 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009dc0 tx=0x7f0ab800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dada08bed597328 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:36.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0abdffb700 1 -- 172.21.15.154:0/3034492323 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab800e070 con 0x7f0ac0139280 2023-09-30T22:27:36.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0abdffb700 1 -- 172.21.15.154:0/3034492323 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800bae0 con 0x7f0ac0139280 2023-09-30T22:27:36.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0abdffb700 1 -- 172.21.15.154:0/3034492323 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab800be90 con 0x7f0ac0139280 2023-09-30T22:27:36.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0ac5878700 1 -- 172.21.15.154:0/3034492323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac0139280 msgr2=0x7f0ac013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0ac5878700 1 --2- 172.21.15.154:0/3034492323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac0139280 0x7f0ac013b660 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009dc0 tx=0x7f0ab800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:36.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0ac5878700 1 -- 172.21.15.154:0/3034492323 shutdown_connections 2023-09-30T22:27:36.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0ac5878700 1 --2- 172.21.15.154:0/3034492323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac0139280 0x7f0ac013b660 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0ac5878700 1 --2- 172.21.15.154:0/3034492323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0136960 0x7f0ac0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0ac5878700 1 -- 172.21.15.154:0/3034492323 >> 172.21.15.154:0/3034492323 conn(0x7f0ac0099c40 msgr2=0x7f0ac00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:36.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0ac5878700 1 -- 172.21.15.154:0/3034492323 shutdown_connections 2023-09-30T22:27:36.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.580+0000 7f0ac5878700 1 -- 172.21.15.154:0/3034492323 wait complete. 2023-09-30T22:27:36.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.581+0000 7f0ac5878700 1 Processor -- start 2023-09-30T22:27:36.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.581+0000 7f0ac5878700 1 -- start start 2023-09-30T22:27:36.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0ac5878700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0133ad0 0x7f0ac012ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0ac5878700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ac0136960 0x7f0ac012d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0ac5878700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac0139280 0x7f0ac0071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:36.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0ac5878700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac006ffd0 con 0x7f0ac0139280 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0ac5878700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac009f390 con 0x7f0ac0133ad0 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0ac5878700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac0072270 con 0x7f0ac0136960 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0133ad0 0x7f0ac012ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abeffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0133ad0 0x7f0ac012ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44210/0 (socket says 172.21.15.154:44210) 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abeffd700 1 -- 172.21.15.154:0/2329354060 learned_addr learned my addr 172.21.15.154:0/2329354060 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abe7fc700 1 --2- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ac0136960 0x7f0ac012d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abf7fe700 1 --2- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac0139280 0x7f0ac0071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abeffd700 1 -- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ac0136960 msgr2=0x7f0ac012d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abeffd700 1 --2- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ac0136960 0x7f0ac012d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abeffd700 1 -- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac0139280 msgr2=0x7f0ac0071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abeffd700 1 --2- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac0139280 0x7f0ac0071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abeffd700 1 -- 172.21.15.154:0/2329354060 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab0009550 con 0x7f0ac0133ad0 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.582+0000 7f0abeffd700 1 --2- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0133ad0 0x7f0ac012ce80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c450 tx=0x7f0ab400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.583+0000 7f0aa7fff700 1 -- 172.21.15.154:0/2329354060 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40054e0 con 0x7f0ac0133ad0 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.583+0000 7f0aa7fff700 1 -- 172.21.15.154:0/2329354060 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab400ce60 con 0x7f0ac0133ad0 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.583+0000 7f0ac5878700 1 -- 172.21.15.154:0/2329354060 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab8009a70 con 0x7f0ac0133ad0 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.583+0000 7f0aa7fff700 1 -- 172.21.15.154:0/2329354060 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40038c0 con 0x7f0ac0133ad0 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.583+0000 7f0ac5878700 1 -- 172.21.15.154:0/2329354060 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac006ee50 con 0x7f0ac0133ad0 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.583+0000 7f0aa7fff700 1 -- 172.21.15.154:0/2329354060 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ab4003a20 con 0x7f0ac0133ad0 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.583+0000 7f0aa7fff700 1 -- 172.21.15.154:0/2329354060 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ab403ea60 con 0x7f0ac0133ad0 2023-09-30T22:27:36.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.584+0000 7f0ac5878700 1 -- 172.21.15.154:0/2329354060 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac00703b0 con 0x7f0ac0133ad0 2023-09-30T22:27:36.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.588+0000 7f0aa7fff700 1 -- 172.21.15.154:0/2329354060 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ab4017030 con 0x7f0ac0133ad0 2023-09-30T22:27:36.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.774+0000 7f0ac5878700 1 -- 172.21.15.154:0/2329354060 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ac00701f0 con 0x7f0ac0133ad0 2023-09-30T22:27:36.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.774+0000 7f0aa7fff700 1 -- 172.21.15.154:0/2329354060 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ac00701f0 con 0x7f0ac0133ad0 2023-09-30T22:27:36.774 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:36.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.776+0000 7f0ac5878700 1 -- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0133ad0 msgr2=0x7f0ac012ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:36.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.776+0000 7f0ac5878700 1 --2- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0133ad0 0x7f0ac012ce80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c450 tx=0x7f0ab400c760 comp rx=0 tx=0).stop 2023-09-30T22:27:36.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.776+0000 7f0ac5878700 1 -- 172.21.15.154:0/2329354060 shutdown_connections 2023-09-30T22:27:36.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.776+0000 7f0ac5878700 1 --2- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac0139280 0x7f0ac0071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.776+0000 7f0ac5878700 1 --2- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac0133ad0 0x7f0ac012ce80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.776+0000 7f0ac5878700 1 --2- 172.21.15.154:0/2329354060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0ac0136960 0x7f0ac012d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:36.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.776+0000 7f0ac5878700 1 -- 172.21.15.154:0/2329354060 >> 172.21.15.154:0/2329354060 conn(0x7f0ac0099c40 msgr2=0x7f0ac00a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:36.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.776+0000 7f0ac5878700 1 -- 172.21.15.154:0/2329354060 shutdown_connections 2023-09-30T22:27:36.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:36.776+0000 7f0ac5878700 1 -- 172.21.15.154:0/2329354060 wait complete. 2023-09-30T22:27:36.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:37.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:37.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:37.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.408+0000 7f9c4a69d700 1 Processor -- start 2023-09-30T22:27:37.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.408+0000 7f9c4a69d700 1 -- start start 2023-09-30T22:27:37.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c4a69d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c44133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c4a69d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9c441300a0 0x7f9c441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c4a69d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4406b2d0 con 0x7f9c441309f0 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c4a69d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c44133610 con 0x7f9c441300a0 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c4a69d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4409a500 con 0x7f9c44133ad0 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c43fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c44133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c43fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c44133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44224/0 (socket says 172.21.15.154:44224) 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c43fff700 1 -- 172.21.15.154:0/100238058 learned_addr learned my addr 172.21.15.154:0/100238058 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c437fe700 1 --2- 172.21.15.154:0/100238058 >> v2:172.21.15.154:3300/0 conn(0x7f9c441300a0 0x7f9c441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c43fff700 1 -- 172.21.15.154:0/100238058 >> v2:172.21.15.154:3300/0 conn(0x7f9c441300a0 msgr2=0x7f9c441304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c43fff700 1 --2- 172.21.15.154:0/100238058 >> v2:172.21.15.154:3300/0 conn(0x7f9c441300a0 0x7f9c441304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c43fff700 1 -- 172.21.15.154:0/100238058 >> v1:172.21.15.154:6789/0 conn(0x7f9c441309f0 legacy=0x7f9c4413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c43fff700 1 -- 172.21.15.154:0/100238058 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c441338b0 con 0x7f9c44133ad0 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c437fe700 1 --2- 172.21.15.154:0/100238058 >> v2:172.21.15.154:3300/0 conn(0x7f9c441300a0 0x7f9c441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c43fff700 1 --2- 172.21.15.154:0/100238058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c44133ea0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9c340098f0 tx=0x7f9c34009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11a67f794d8667c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.409+0000 7f9c42ffd700 1 -- 172.21.15.154:0/100238058 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34011830 con 0x7f9c44133ad0 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c42ffd700 1 -- 172.21.15.154:0/100238058 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c34011990 con 0x7f9c44133ad0 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c42ffd700 1 -- 172.21.15.154:0/100238058 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34011d20 con 0x7f9c44133ad0 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c4a69d700 1 -- 172.21.15.154:0/100238058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 msgr2=0x7f9c44133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c4a69d700 1 --2- 172.21.15.154:0/100238058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c44133ea0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9c340098f0 tx=0x7f9c34009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c4a69d700 1 -- 172.21.15.154:0/100238058 shutdown_connections 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c4a69d700 1 --2- 172.21.15.154:0/100238058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c44133ea0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c4a69d700 1 --2- 172.21.15.154:0/100238058 >> v2:172.21.15.154:3300/0 conn(0x7f9c441300a0 0x7f9c441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c4a69d700 1 -- 172.21.15.154:0/100238058 >> 172.21.15.154:0/100238058 conn(0x7f9c44099c40 msgr2=0x7f9c440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c4a69d700 1 -- 172.21.15.154:0/100238058 shutdown_connections 2023-09-30T22:27:37.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.410+0000 7f9c4a69d700 1 -- 172.21.15.154:0/100238058 wait complete. 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.411+0000 7f9c4a69d700 1 Processor -- start 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.411+0000 7f9c4a69d700 1 -- start start 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c4a69d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c441300a0 0x7f9c4411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c4a69d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c441309f0 0x7f9c4411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c4a69d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c4411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c4a69d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c441200c0 con 0x7f9c441309f0 2023-09-30T22:27:37.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c4a69d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4411fb20 con 0x7f9c44133ad0 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c4a69d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4411f040 con 0x7f9c441300a0 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c43fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c441300a0 0x7f9c4411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c43fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c441300a0 0x7f9c4411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34634/0 (socket says 172.21.15.154:34634) 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c43fff700 1 -- 172.21.15.154:0/763836552 learned_addr learned my addr 172.21.15.154:0/763836552 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c48c3a700 1 --2- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c4411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c437fe700 1 --2- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c441309f0 0x7f9c4411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c43fff700 1 -- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 msgr2=0x7f9c4411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c43fff700 1 --2- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c4411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c43fff700 1 -- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c441309f0 msgr2=0x7f9c4411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c43fff700 1 --2- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c441309f0 0x7f9c4411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c43fff700 1 -- 172.21.15.154:0/763836552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c380094a0 con 0x7f9c441300a0 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.412+0000 7f9c43fff700 1 --2- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c441300a0 0x7f9c4411da40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9c34000c00 tx=0x7f9c34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.413+0000 7f9c40ff9700 1 -- 172.21.15.154:0/763836552 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c340036a0 con 0x7f9c441300a0 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.413+0000 7f9c40ff9700 1 -- 172.21.15.154:0/763836552 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c34003800 con 0x7f9c441300a0 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.413+0000 7f9c4a69d700 1 -- 172.21.15.154:0/763836552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c34009550 con 0x7f9c441300a0 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.413+0000 7f9c40ff9700 1 -- 172.21.15.154:0/763836552 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34003bb0 con 0x7f9c441300a0 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.413+0000 7f9c4a69d700 1 -- 172.21.15.154:0/763836552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4412dd00 con 0x7f9c441300a0 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.414+0000 7f9c40ff9700 1 -- 172.21.15.154:0/763836552 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c34021070 con 0x7f9c441300a0 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.414+0000 7f9c4a69d700 1 -- 172.21.15.154:0/763836552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4411f400 con 0x7f9c441300a0 2023-09-30T22:27:37.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.414+0000 7f9c40ff9700 1 -- 172.21.15.154:0/763836552 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c34040af0 con 0x7f9c441300a0 2023-09-30T22:27:37.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:37.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.418+0000 7f9c40ff9700 1 -- 172.21.15.154:0/763836552 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c34024470 con 0x7f9c441300a0 2023-09-30T22:27:37.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.510+0000 7f61dc5fa700 1 Processor -- start 2023-09-30T22:27:37.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.510+0000 7f61dc5fa700 1 -- start start 2023-09-30T22:27:37.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.510+0000 7f61dc5fa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d409ad40 0x7f61d4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.510+0000 7f61dc5fa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d4133f70 0x7f61d41343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.510+0000 7f61dc5fa700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61d40a0a70 0x7f61d40a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.510+0000 7f61dc5fa700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d40a3b60 con 0x7f61d40a0a70 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.510+0000 7f61dc5fa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41348e0 con 0x7f61d4133f70 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.510+0000 7f61dc5fa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61d409b110 con 0x7f61d409ad40 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61dab97700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61d40a0a70 0x7f61d40a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61dab97700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61d40a0a70 0x7f61d40a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52800/0 (socket says 172.21.15.154:52800) 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9b95700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d4133f70 0x7f61d41343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61dab97700 1 -- 172.21.15.154:0/1896600446 learned_addr learned my addr 172.21.15.154:0/1896600446 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61da396700 1 --2- 172.21.15.154:0/1896600446 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d409ad40 0x7f61d4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9b95700 1 -- 172.21.15.154:0/1896600446 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d409ad40 msgr2=0x7f61d4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9b95700 1 --2- 172.21.15.154:0/1896600446 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d409ad40 0x7f61d4133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9b95700 1 -- 172.21.15.154:0/1896600446 >> v2:172.21.15.154:3300/0 conn(0x7f61d40a0a70 msgr2=0x7f61d40a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9b95700 1 --2- 172.21.15.154:0/1896600446 >> v2:172.21.15.154:3300/0 conn(0x7f61d40a0a70 0x7f61d40a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9b95700 1 -- 172.21.15.154:0/1896600446 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d40a2fa0 con 0x7f61d4133f70 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61da396700 1 --2- 172.21.15.154:0/1896600446 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d409ad40 0x7f61d4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61dab97700 1 --2- 172.21.15.154:0/1896600446 >> v2:172.21.15.154:3300/0 conn(0x7f61d40a0a70 0x7f61d40a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9b95700 1 --2- 172.21.15.154:0/1896600446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d4133f70 0x7f61d41343a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009870 tx=0x7f61c4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=146296c357a5f593 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9394700 1 -- 172.21.15.154:0/1896600446 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4011830 con 0x7f61d4133f70 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9394700 1 -- 172.21.15.154:0/1896600446 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4011990 con 0x7f61d4133f70 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.511+0000 7f61d9394700 1 -- 172.21.15.154:0/1896600446 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4011d20 con 0x7f61d4133f70 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.512+0000 7f61dc5fa700 1 -- 172.21.15.154:0/1896600446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d4133f70 msgr2=0x7f61d41343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.512+0000 7f61dc5fa700 1 --2- 172.21.15.154:0/1896600446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d4133f70 0x7f61d41343a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009870 tx=0x7f61c4009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.512+0000 7f61dc5fa700 1 -- 172.21.15.154:0/1896600446 shutdown_connections 2023-09-30T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.512+0000 7f61dc5fa700 1 --2- 172.21.15.154:0/1896600446 >> v2:172.21.15.154:3300/0 conn(0x7f61d40a0a70 0x7f61d40a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.512+0000 7f61dc5fa700 1 --2- 172.21.15.154:0/1896600446 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d409ad40 0x7f61d4133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.512+0000 7f61dc5fa700 1 --2- 172.21.15.154:0/1896600446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d4133f70 0x7f61d41343a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.512+0000 7f61dc5fa700 1 -- 172.21.15.154:0/1896600446 >> 172.21.15.154:0/1896600446 conn(0x7f61d4099c40 msgr2=0x7f61d406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.512+0000 7f61dc5fa700 1 -- 172.21.15.154:0/1896600446 shutdown_connections 2023-09-30T22:27:37.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.512+0000 7f61dc5fa700 1 -- 172.21.15.154:0/1896600446 wait complete. 2023-09-30T22:27:37.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.513+0000 7f61dc5fa700 1 Processor -- start 2023-09-30T22:27:37.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61dc5fa700 1 -- start start 2023-09-30T22:27:37.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61dc5fa700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d409ad40 0x7f61d4121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61dc5fa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d40a0a70 0x7f61d41218d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61dc5fa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4133f70 0x7f61d4121e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61dc5fa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d4124980 con 0x7f61d4133f70 2023-09-30T22:27:37.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61dc5fa700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d4122fa0 con 0x7f61d409ad40 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61dc5fa700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61d41227f0 con 0x7f61d40a0a70 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61d9b95700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d40a0a70 0x7f61d41218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61da396700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d409ad40 0x7f61d4121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61d9b95700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d40a0a70 0x7f61d41218d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34654/0 (socket says 172.21.15.154:34654) 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61d9b95700 1 -- 172.21.15.154:0/3213922325 learned_addr learned my addr 172.21.15.154:0/3213922325 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.514+0000 7f61dab97700 1 --2- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4133f70 0x7f61d4121e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61da396700 1 -- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d40a0a70 msgr2=0x7f61d41218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61da396700 1 --2- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d40a0a70 0x7f61d41218d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61da396700 1 -- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4133f70 msgr2=0x7f61d4121e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61da396700 1 --2- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4133f70 0x7f61d4121e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61da396700 1 -- 172.21.15.154:0/3213922325 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00094a0 con 0x7f61d409ad40 2023-09-30T22:27:37.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61da396700 1 --2- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d409ad40 0x7f61d4121390 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009fd0 tx=0x7f61d000eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61caffd700 1 -- 172.21.15.154:0/3213922325 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0004030 con 0x7f61d409ad40 2023-09-30T22:27:37.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61caffd700 1 -- 172.21.15.154:0/3213922325 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0004190 con 0x7f61d409ad40 2023-09-30T22:27:37.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61dc5fa700 1 -- 172.21.15.154:0/3213922325 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc009b30 con 0x7f61d409ad40 2023-09-30T22:27:37.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61caffd700 1 -- 172.21.15.154:0/3213922325 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0004520 con 0x7f61d409ad40 2023-09-30T22:27:37.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.515+0000 7f61dc5fa700 1 -- 172.21.15.154:0/3213922325 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c40094a0 con 0x7f61d409ad40 2023-09-30T22:27:37.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.516+0000 7f61caffd700 1 -- 172.21.15.154:0/3213922325 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61d00036a0 con 0x7f61d409ad40 2023-09-30T22:27:37.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.516+0000 7f61caffd700 1 -- 172.21.15.154:0/3213922325 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f61d003f750 con 0x7f61d409ad40 2023-09-30T22:27:37.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.516+0000 7f61dc5fa700 1 -- 172.21.15.154:0/3213922325 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d41241f0 con 0x7f61d409ad40 2023-09-30T22:27:37.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.525+0000 7f61caffd700 1 -- 172.21.15.154:0/3213922325 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61d0011580 con 0x7f61d409ad40 2023-09-30T22:27:37.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5aab0d700 1 Processor -- start 2023-09-30T22:27:37.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5aab0d700 1 -- start start 2023-09-30T22:27:37.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5aab0d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5a40a0a70 0x7fe5a40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5aab0d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 0x7fe5a413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5aab0d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a409dc00 con 0x7fe5a40a1380 2023-09-30T22:27:37.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5aab0d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a409ea90 con 0x7fe5a40a0a70 2023-09-30T22:27:37.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5aab0d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a409dec0 con 0x7fe5a4134120 2023-09-30T22:27:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5a88a9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5a40a0a70 0x7fe5a40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5a90aa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 0x7fe5a413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5a88a9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5a40a0a70 0x7fe5a40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52826/0 (socket says 172.21.15.154:52826) 2023-09-30T22:27:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.548+0000 7fe5a88a9700 1 -- 172.21.15.154:0/2787484169 learned_addr learned my addr 172.21.15.154:0/2787484169 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.549+0000 7fe5a88a9700 1 -- 172.21.15.154:0/2787484169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 msgr2=0x7fe5a413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.549+0000 7fe5a88a9700 1 --2- 172.21.15.154:0/2787484169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 0x7fe5a413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.549+0000 7fe5a88a9700 1 -- 172.21.15.154:0/2787484169 >> v1:172.21.15.154:6789/0 conn(0x7fe5a40a1380 legacy=0x7fe5a4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.549+0000 7fe5a88a9700 1 -- 172.21.15.154:0/2787484169 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a409e6a0 con 0x7fe5a40a0a70 2023-09-30T22:27:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.549+0000 7fe5a90aa700 1 --2- 172.21.15.154:0/2787484169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 0x7fe5a413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.549+0000 7fe5a88a9700 1 --2- 172.21.15.154:0/2787484169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a40a0a70 0x7fe5a40a0e40 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe5980098f0 tx=0x7fe598009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbefa7d7f62cda67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.549+0000 7fe5a37fe700 1 -- 172.21.15.154:0/2787484169 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598011830 con 0x7fe5a40a0a70 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.549+0000 7fe5a37fe700 1 -- 172.21.15.154:0/2787484169 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe598011990 con 0x7fe5a40a0a70 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.549+0000 7fe5a37fe700 1 -- 172.21.15.154:0/2787484169 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598011d20 con 0x7fe5a40a0a70 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.550+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2787484169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a40a0a70 msgr2=0x7fe5a40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.550+0000 7fe5aab0d700 1 --2- 172.21.15.154:0/2787484169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a40a0a70 0x7fe5a40a0e40 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe5980098f0 tx=0x7fe598009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.550+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2787484169 shutdown_connections 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.550+0000 7fe5aab0d700 1 --2- 172.21.15.154:0/2787484169 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 0x7fe5a413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.550+0000 7fe5aab0d700 1 --2- 172.21.15.154:0/2787484169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a40a0a70 0x7fe5a40a0e40 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.550+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2787484169 >> 172.21.15.154:0/2787484169 conn(0x7fe5a40a6610 msgr2=0x7fe5a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.550+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2787484169 shutdown_connections 2023-09-30T22:27:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.550+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2787484169 wait complete. 2023-09-30T22:27:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.551+0000 7fe5aab0d700 1 Processor -- start 2023-09-30T22:27:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.551+0000 7fe5aab0d700 1 -- start start 2023-09-30T22:27:37.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.551+0000 7fe5aab0d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5a40a1380 0x7fe5a41c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.551+0000 7fe5aab0d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 0x7fe5a41c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.551+0000 7fe5aab0d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a411e9a0 0x7fe5a411ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.551+0000 7fe5aab0d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a41206b0 con 0x7fe5a411e9a0 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.551+0000 7fe5aab0d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a41204c0 con 0x7fe5a40a1380 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.551+0000 7fe5aab0d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a41332b0 con 0x7fe5a4134120 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.551+0000 7fe5a90aa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a411e9a0 0x7fe5a411ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a90aa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a411e9a0 0x7fe5a411ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52840/0 (socket says 172.21.15.154:52840) 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a90aa700 1 -- 172.21.15.154:0/2259850608 learned_addr learned my addr 172.21.15.154:0/2259850608 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a88a9700 1 --2- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5a40a1380 0x7fe5a41c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a3fff700 1 --2- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 0x7fe5a41c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a90aa700 1 -- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 msgr2=0x7fe5a41c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a90aa700 1 --2- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 0x7fe5a41c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a90aa700 1 -- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5a40a1380 msgr2=0x7fe5a41c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a90aa700 1 --2- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5a40a1380 0x7fe5a41c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a90aa700 1 -- 172.21.15.154:0/2259850608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c009a70 con 0x7fe5a411e9a0 2023-09-30T22:27:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a90aa700 1 --2- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a411e9a0 0x7fe5a411ee40 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009f00 tx=0x7fe59c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a17fa700 1 -- 172.21.15.154:0/2259850608 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c009d70 con 0x7fe5a411e9a0 2023-09-30T22:27:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a17fa700 1 -- 172.21.15.154:0/2259850608 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c00f040 con 0x7fe5a411e9a0 2023-09-30T22:27:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5a17fa700 1 -- 172.21.15.154:0/2259850608 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00cdc0 con 0x7fe5a411e9a0 2023-09-30T22:27:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2259850608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe598009550 con 0x7fe5a411e9a0 2023-09-30T22:27:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.552+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2259850608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a4133aa0 con 0x7fe5a411e9a0 2023-09-30T22:27:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.553+0000 7fe5a17fa700 1 -- 172.21.15.154:0/2259850608 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe59c014480 con 0x7fe5a411e9a0 2023-09-30T22:27:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.553+0000 7fe5a17fa700 1 -- 172.21.15.154:0/2259850608 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe59c03fde0 con 0x7fe5a411e9a0 2023-09-30T22:27:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.553+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2259850608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a404f2a0 con 0x7fe5a411e9a0 2023-09-30T22:27:37.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.562+0000 7fe5a17fa700 1 -- 172.21.15.154:0/2259850608 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe59c03f070 con 0x7fe5a411e9a0 2023-09-30T22:27:37.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.621+0000 7f9c4a69d700 1 -- 172.21.15.154:0/763836552 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c4404f2a0 con 0x7f9c441300a0 2023-09-30T22:27:37.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.621+0000 7f9c40ff9700 1 -- 172.21.15.154:0/763836552 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c34032020 con 0x7f9c441300a0 2023-09-30T22:27:37.621 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:37.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.623+0000 7f9c4a69d700 1 -- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c441300a0 msgr2=0x7f9c4411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.623+0000 7f9c4a69d700 1 --2- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c441300a0 0x7f9c4411da40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9c34000c00 tx=0x7f9c34004750 comp rx=0 tx=0).stop 2023-09-30T22:27:37.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.623+0000 7f9c4a69d700 1 -- 172.21.15.154:0/763836552 shutdown_connections 2023-09-30T22:27:37.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.623+0000 7f9c4a69d700 1 --2- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c44133ad0 0x7f9c4411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.623+0000 7f9c4a69d700 1 --2- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c441300a0 0x7f9c4411da40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.623+0000 7f9c4a69d700 1 --2- 172.21.15.154:0/763836552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c441309f0 0x7f9c4411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.623+0000 7f9c4a69d700 1 -- 172.21.15.154:0/763836552 >> 172.21.15.154:0/763836552 conn(0x7f9c44099c40 msgr2=0x7f9c441320b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.624+0000 7f9c4a69d700 1 -- 172.21.15.154:0/763836552 shutdown_connections 2023-09-30T22:27:37.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.624+0000 7f9c4a69d700 1 -- 172.21.15.154:0/763836552 wait complete. 2023-09-30T22:27:37.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:37.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.722+0000 7f61dc5fa700 1 -- 172.21.15.154:0/3213922325 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f61d409c7e0 con 0x7f61d409ad40 2023-09-30T22:27:37.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.723+0000 7f61caffd700 1 -- 172.21.15.154:0/3213922325 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61d0011970 con 0x7f61d409ad40 2023-09-30T22:27:37.723 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:37.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.724+0000 7f61dc5fa700 1 -- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d409ad40 msgr2=0x7f61d4121390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.724+0000 7f61dc5fa700 1 --2- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d409ad40 0x7f61d4121390 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009fd0 tx=0x7f61d000eb90 comp rx=0 tx=0).stop 2023-09-30T22:27:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.724+0000 7f61dc5fa700 1 -- 172.21.15.154:0/3213922325 shutdown_connections 2023-09-30T22:27:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.724+0000 7f61dc5fa700 1 --2- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4133f70 0x7f61d4121e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.724+0000 7f61dc5fa700 1 --2- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61d409ad40 0x7f61d4121390 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.724+0000 7f61dc5fa700 1 --2- 172.21.15.154:0/3213922325 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61d40a0a70 0x7f61d41218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.724+0000 7f61dc5fa700 1 -- 172.21.15.154:0/3213922325 >> 172.21.15.154:0/3213922325 conn(0x7f61d4099c40 msgr2=0x7f61d409e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.725+0000 7f61dc5fa700 1 -- 172.21.15.154:0/3213922325 shutdown_connections 2023-09-30T22:27:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.725+0000 7f61dc5fa700 1 -- 172.21.15.154:0/3213922325 wait complete. 2023-09-30T22:27:37.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:37.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.758+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2259850608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe5a4072980 con 0x7fe5a411e9a0 2023-09-30T22:27:37.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.758+0000 7fe5a17fa700 1 -- 172.21.15.154:0/2259850608 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe59c012520 con 0x7fe5a411e9a0 2023-09-30T22:27:37.758 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:37.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.760+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a411e9a0 msgr2=0x7fe5a411ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.760+0000 7fe5aab0d700 1 --2- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a411e9a0 0x7fe5a411ee40 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009f00 tx=0x7fe59c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.760+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2259850608 shutdown_connections 2023-09-30T22:27:37.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.760+0000 7fe5aab0d700 1 --2- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a411e9a0 0x7fe5a411ee40 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.760+0000 7fe5aab0d700 1 --2- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5a40a1380 0x7fe5a41c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.761+0000 7fe5aab0d700 1 --2- 172.21.15.154:0/2259850608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5a4134120 0x7fe5a41c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.761+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2259850608 >> 172.21.15.154:0/2259850608 conn(0x7fe5a40a6610 msgr2=0x7fe5a40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.761+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2259850608 shutdown_connections 2023-09-30T22:27:37.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.761+0000 7fe5aab0d700 1 -- 172.21.15.154:0/2259850608 wait complete. 2023-09-30T22:27:37.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:37.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:37.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.935+0000 7f77b74eb700 1 Processor -- start 2023-09-30T22:27:37.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.935+0000 7f77b74eb700 1 -- start start 2023-09-30T22:27:37.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.935+0000 7f77b74eb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77b0136960 0x7f77b0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.935+0000 7f77b74eb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0139280 0x7f77b013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.935+0000 7f77b74eb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b006b2d0 con 0x7f77b0133ad0 2023-09-30T22:27:37.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.935+0000 7f77b74eb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b01345b0 con 0x7f77b0136960 2023-09-30T22:27:37.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.935+0000 7f77b74eb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0133610 con 0x7f77b0139280 2023-09-30T22:27:37.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b4a86700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77b0136960 0x7f77b0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b5a88700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0139280 0x7f77b013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b4a86700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77b0136960 0x7f77b0138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52856/0 (socket says 172.21.15.154:52856) 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b4a86700 1 -- 172.21.15.154:0/1248855568 learned_addr learned my addr 172.21.15.154:0/1248855568 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b5a88700 1 -- 172.21.15.154:0/1248855568 >> v2:172.21.15.154:3300/0 conn(0x7f77b0136960 msgr2=0x7f77b0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b5a88700 1 --2- 172.21.15.154:0/1248855568 >> v2:172.21.15.154:3300/0 conn(0x7f77b0136960 0x7f77b0138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b5a88700 1 -- 172.21.15.154:0/1248855568 >> v1:172.21.15.154:6789/0 conn(0x7f77b0133ad0 legacy=0x7f77b0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b5a88700 1 -- 172.21.15.154:0/1248855568 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b009a500 con 0x7f77b0139280 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b4a86700 1 --2- 172.21.15.154:0/1248855568 >> v2:172.21.15.154:3300/0 conn(0x7f77b0136960 0x7f77b0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77b5a88700 1 --2- 172.21.15.154:0/1248855568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0139280 0x7f77b013b660 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009d90 tx=0x7f77a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee798be4a1bc244d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77a7fff700 1 -- 172.21.15.154:0/1248855568 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a800e070 con 0x7f77b0139280 2023-09-30T22:27:37.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77a7fff700 1 -- 172.21.15.154:0/1248855568 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a800bb20 con 0x7f77b0139280 2023-09-30T22:27:37.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.936+0000 7f77a7fff700 1 -- 172.21.15.154:0/1248855568 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8012430 con 0x7f77b0139280 2023-09-30T22:27:37.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.937+0000 7f77b74eb700 1 -- 172.21.15.154:0/1248855568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0139280 msgr2=0x7f77b013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.937+0000 7f77b74eb700 1 --2- 172.21.15.154:0/1248855568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0139280 0x7f77b013b660 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009d90 tx=0x7f77a800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:37.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.937+0000 7f77b74eb700 1 -- 172.21.15.154:0/1248855568 shutdown_connections 2023-09-30T22:27:37.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.937+0000 7f77b74eb700 1 --2- 172.21.15.154:0/1248855568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0139280 0x7f77b013b660 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.937+0000 7f77b74eb700 1 --2- 172.21.15.154:0/1248855568 >> v2:172.21.15.154:3300/0 conn(0x7f77b0136960 0x7f77b0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.937+0000 7f77b74eb700 1 -- 172.21.15.154:0/1248855568 >> 172.21.15.154:0/1248855568 conn(0x7f77b0099c40 msgr2=0x7f77b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.937+0000 7f77b74eb700 1 -- 172.21.15.154:0/1248855568 shutdown_connections 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.937+0000 7f77b74eb700 1 -- 172.21.15.154:0/1248855568 wait complete. 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b74eb700 1 Processor -- start 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b74eb700 1 -- start start 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b74eb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0133ad0 0x7f77b012fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b74eb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77b0136960 0x7f77b012ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b74eb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77b0139280 0x7f77b01c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b74eb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0070370 con 0x7f77b0139280 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b74eb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b01316a0 con 0x7f77b0133ad0 2023-09-30T22:27:37.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b5287700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0133ad0 0x7f77b012fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b5287700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0133ad0 0x7f77b012fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44296/0 (socket says 172.21.15.154:44296) 2023-09-30T22:27:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b5287700 1 -- 172.21.15.154:0/692543255 learned_addr learned my addr 172.21.15.154:0/692543255 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b5a88700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77b0139280 0x7f77b01c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b4a86700 1 --2- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77b0136960 0x7f77b012ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.938+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77b006fe40 con 0x7f77b0136960 2023-09-30T22:27:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77b5287700 1 -- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77b0136960 msgr2=0x7f77b012ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77b5287700 1 --2- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77b0136960 0x7f77b012ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77b5287700 1 -- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77b0139280 msgr2=0x7f77b01c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:37.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77b5287700 1 --2- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77b0139280 0x7f77b01c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:37.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77b5287700 1 -- 172.21.15.154:0/692543255 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0009550 con 0x7f77b0133ad0 2023-09-30T22:27:37.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77b5a88700 1 --2- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77b0139280 0x7f77b01c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:37.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77b5287700 1 --2- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0133ad0 0x7f77b012fa30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c480 tx=0x7f77ac00c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:37.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77a5ffb700 1 -- 172.21.15.154:0/692543255 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0052d0 con 0x7f77b0133ad0 2023-09-30T22:27:37.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77a5ffb700 1 -- 172.21.15.154:0/692543255 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac005430 con 0x7f77b0133ad0 2023-09-30T22:27:37.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77a5ffb700 1 -- 172.21.15.154:0/692543255 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0038c0 con 0x7f77b0133ad0 2023-09-30T22:27:37.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a8009a70 con 0x7f77b0133ad0 2023-09-30T22:27:37.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.939+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b012f6d0 con 0x7f77b0133ad0 2023-09-30T22:27:37.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.940+0000 7f77a5ffb700 1 -- 172.21.15.154:0/692543255 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77ac003a20 con 0x7f77b0133ad0 2023-09-30T22:27:37.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.940+0000 7f77a5ffb700 1 -- 172.21.15.154:0/692543255 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f77ac03ea10 con 0x7f77b0133ad0 2023-09-30T22:27:37.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.940+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b00701b0 con 0x7f77b0133ad0 2023-09-30T22:27:37.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:37.945+0000 7f77a5ffb700 1 -- 172.21.15.154:0/692543255 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77ac017070 con 0x7f77b0133ad0 2023-09-30T22:27:38.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.129+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f77b004f2a0 con 0x7f77b0133ad0 2023-09-30T22:27:38.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.129+0000 7f77a5ffb700 1 -- 172.21.15.154:0/692543255 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77ac017020 con 0x7f77b0133ad0 2023-09-30T22:27:38.130 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.131+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0133ad0 msgr2=0x7f77b012fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.131+0000 7f77b74eb700 1 --2- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0133ad0 0x7f77b012fa30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c480 tx=0x7f77ac00c790 comp rx=0 tx=0).stop 2023-09-30T22:27:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.131+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 shutdown_connections 2023-09-30T22:27:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.131+0000 7f77b74eb700 1 --2- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77b0139280 0x7f77b01c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.131+0000 7f77b74eb700 1 --2- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77b0133ad0 0x7f77b012fa30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.131+0000 7f77b74eb700 1 --2- 172.21.15.154:0/692543255 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f77b0136960 0x7f77b012ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.132+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 >> 172.21.15.154:0/692543255 conn(0x7f77b0099c40 msgr2=0x7f77b0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.132+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 shutdown_connections 2023-09-30T22:27:38.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.132+0000 7f77b74eb700 1 -- 172.21.15.154:0/692543255 wait complete. 2023-09-30T22:27:38.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:38.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:38.737 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:38.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.766+0000 7f576572c700 1 Processor -- start 2023-09-30T22:27:38.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f576572c700 1 -- start start 2023-09-30T22:27:38.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f576572c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a1550 0x7f5760138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f576572c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5760139200 0x7f576013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f576572c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576009e9d0 con 0x7f57600a0a70 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f576572c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576009dc00 con 0x7f5760139200 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f576572c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f576009dec0 con 0x7f57600a1550 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f575e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a1550 0x7f5760138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f575f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5760139200 0x7f576013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f575e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a1550 0x7f5760138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34682/0 (socket says 172.21.15.154:34682) 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f575effd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f57600a0a70 0x7f57600a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37430/0 (socket says 172.21.15.154:37430) 2023-09-30T22:27:38.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f575e7fc700 1 -- 172.21.15.154:0/744832355 learned_addr learned my addr 172.21.15.154:0/744832355 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.767+0000 7f575dffb700 1 -- 172.21.15.154:0/744832355 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172415807 0 0) 0x7f576009e9d0 con 0x7f57600a0a70 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f575e7fc700 1 -- 172.21.15.154:0/744832355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5760139200 msgr2=0x7f576013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f575e7fc700 1 --2- 172.21.15.154:0/744832355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5760139200 0x7f576013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f575e7fc700 1 -- 172.21.15.154:0/744832355 >> v1:172.21.15.154:6789/0 conn(0x7f57600a0a70 legacy=0x7f57600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f575e7fc700 1 -- 172.21.15.154:0/744832355 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576009e6a0 con 0x7f57600a1550 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f575f7fe700 1 --2- 172.21.15.154:0/744832355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5760139200 0x7f576013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f575e7fc700 1 --2- 172.21.15.154:0/744832355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a1550 0x7f5760138cc0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5754009920 tx=0x7f5754009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66ddd20bbe9c4b95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f575dffb700 1 -- 172.21.15.154:0/744832355 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754011830 con 0x7f57600a1550 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f575dffb700 1 -- 172.21.15.154:0/744832355 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5754011990 con 0x7f57600a1550 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f575dffb700 1 -- 172.21.15.154:0/744832355 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754011d20 con 0x7f57600a1550 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f576572c700 1 -- 172.21.15.154:0/744832355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a1550 msgr2=0x7f5760138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.768+0000 7f576572c700 1 --2- 172.21.15.154:0/744832355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a1550 0x7f5760138cc0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5754009920 tx=0x7f5754009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.769+0000 7f576572c700 1 -- 172.21.15.154:0/744832355 shutdown_connections 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.769+0000 7f576572c700 1 --2- 172.21.15.154:0/744832355 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5760139200 0x7f576013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.769+0000 7f576572c700 1 --2- 172.21.15.154:0/744832355 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a1550 0x7f5760138cc0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.769+0000 7f576572c700 1 -- 172.21.15.154:0/744832355 >> 172.21.15.154:0/744832355 conn(0x7f57600a6610 msgr2=0x7f57600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.769+0000 7f576572c700 1 -- 172.21.15.154:0/744832355 shutdown_connections 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.769+0000 7f576572c700 1 -- 172.21.15.154:0/744832355 wait complete. 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.770+0000 7f576572c700 1 Processor -- start 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.770+0000 7f576572c700 1 -- start start 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f576572c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a0a70 0x7f576011e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f576572c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600a1550 0x7f576011ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f576572c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5760139200 0x7f576011f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f576572c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5760120370 con 0x7f5760139200 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f576572c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5760134650 con 0x7f57600a1550 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f576572c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5760121fa0 con 0x7f57600a0a70 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a0a70 0x7f576011e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5760139200 0x7f576011f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575e7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600a1550 0x7f576011ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a0a70 0x7f576011e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34686/0 (socket says 172.21.15.154:34686) 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5760139200 0x7f576011f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52884/0 (socket says 172.21.15.154:52884) 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575effd700 1 -- 172.21.15.154:0/1676922174 learned_addr learned my addr 172.21.15.154:0/1676922174 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575effd700 1 -- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600a1550 msgr2=0x7f576011ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575effd700 1 --2- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600a1550 0x7f576011ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575effd700 1 -- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5760139200 msgr2=0x7f576011f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575effd700 1 --2- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5760139200 0x7f576011f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575effd700 1 -- 172.21.15.154:0/1676922174 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5758009a70 con 0x7f57600a0a70 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575e7fc700 1 --2- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600a1550 0x7f576011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575f7fe700 1 --2- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5760139200 0x7f576011f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.771+0000 7f575effd700 1 --2- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a0a70 0x7f576011e7b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f575000c520 tx=0x7f575000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.772+0000 7f57477fe700 1 -- 172.21.15.154:0/1676922174 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750004c80 con 0x7f57600a0a70 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.772+0000 7f57477fe700 1 -- 172.21.15.154:0/1676922174 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750004e00 con 0x7f57600a0a70 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.772+0000 7f576572c700 1 -- 172.21.15.154:0/1676922174 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5754009550 con 0x7f57600a0a70 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.772+0000 7f57477fe700 1 -- 172.21.15.154:0/1676922174 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750007310 con 0x7f57600a0a70 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.772+0000 7f576572c700 1 -- 172.21.15.154:0/1676922174 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5760121a60 con 0x7f57600a0a70 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.772+0000 7f57477fe700 1 -- 172.21.15.154:0/1676922174 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5750007470 con 0x7f57600a0a70 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.773+0000 7f57477fe700 1 -- 172.21.15.154:0/1676922174 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f575003f290 con 0x7f57600a0a70 2023-09-30T22:27:38.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.773+0000 7f576572c700 1 -- 172.21.15.154:0/1676922174 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57600a03e0 con 0x7f57600a0a70 2023-09-30T22:27:38.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.781+0000 7f57477fe700 1 -- 172.21.15.154:0/1676922174 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57500123b0 con 0x7f57600a0a70 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f5046058700 1 Processor -- start 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f5046058700 1 -- start start 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f5046058700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50400a0a70 0x7f50400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f5046058700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a1380 0x7f5040133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f5046058700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504009dc00 con 0x7f5040133f50 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f5046058700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504009ea60 con 0x7f50400a0a70 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f5046058700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504009dec0 con 0x7f50400a1380 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f503f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50400a0a70 0x7f50400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f503effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a1380 0x7f5040133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f503f7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50400a0a70 0x7f50400a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52892/0 (socket says 172.21.15.154:52892) 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f503f7fe700 1 -- 172.21.15.154:0/2385623685 learned_addr learned my addr 172.21.15.154:0/2385623685 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.867+0000 7f503ffff700 1 --1- 172.21.15.154:0/2385623685 >> v1:172.21.15.154:6789/0 conn(0x7f5040133f50 0x7f504013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37432/0 (socket says 172.21.15.154:37432) 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.868+0000 7f503f7fe700 1 -- 172.21.15.154:0/2385623685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a1380 msgr2=0x7f5040133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.868+0000 7f503f7fe700 1 --2- 172.21.15.154:0/2385623685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a1380 0x7f5040133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.868+0000 7f503f7fe700 1 -- 172.21.15.154:0/2385623685 >> v1:172.21.15.154:6789/0 conn(0x7f5040133f50 legacy=0x7f504013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.868+0000 7f503f7fe700 1 -- 172.21.15.154:0/2385623685 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504009e6a0 con 0x7f50400a0a70 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.868+0000 7f503effd700 1 --2- 172.21.15.154:0/2385623685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a1380 0x7f5040133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.868+0000 7f503f7fe700 1 --2- 172.21.15.154:0/2385623685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a0a70 0x7f50400a0e40 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f50300098f0 tx=0x7f5030009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103fb577cc472f02 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.868+0000 7f503e7fc700 1 -- 172.21.15.154:0/2385623685 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030011830 con 0x7f50400a0a70 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.868+0000 7f503e7fc700 1 -- 172.21.15.154:0/2385623685 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5030011990 con 0x7f50400a0a70 2023-09-30T22:27:38.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.868+0000 7f503e7fc700 1 -- 172.21.15.154:0/2385623685 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030011d20 con 0x7f50400a0a70 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.869+0000 7f5046058700 1 -- 172.21.15.154:0/2385623685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a0a70 msgr2=0x7f50400a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.869+0000 7f5046058700 1 --2- 172.21.15.154:0/2385623685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a0a70 0x7f50400a0e40 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f50300098f0 tx=0x7f5030009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.869+0000 7f5046058700 1 -- 172.21.15.154:0/2385623685 shutdown_connections 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.869+0000 7f5046058700 1 --2- 172.21.15.154:0/2385623685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a0a70 0x7f50400a0e40 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.869+0000 7f5046058700 1 --2- 172.21.15.154:0/2385623685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a1380 0x7f5040133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.869+0000 7f5046058700 1 -- 172.21.15.154:0/2385623685 >> 172.21.15.154:0/2385623685 conn(0x7f50400a6610 msgr2=0x7f50400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.869+0000 7f5046058700 1 -- 172.21.15.154:0/2385623685 shutdown_connections 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.869+0000 7f5046058700 1 -- 172.21.15.154:0/2385623685 wait complete. 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.870+0000 7f5046058700 1 Processor -- start 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.870+0000 7f5046058700 1 -- start start 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f5046058700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a0a70 0x7f504011e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f5046058700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a1380 0x7f504011ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f5046058700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5040133f50 0x7f504011f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f5046058700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5040133790 con 0x7f50400a1380 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f5046058700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5040122320 con 0x7f50400a0a70 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f5046058700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50401339d0 con 0x7f5040133f50 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a1380 0x7f504011ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a0a70 0x7f504011e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a1380 0x7f504011ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52898/0 (socket says 172.21.15.154:52898) 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503effd700 1 -- 172.21.15.154:0/1206999518 learned_addr learned my addr 172.21.15.154:0/1206999518 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503ffff700 1 --2- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5040133f50 0x7f504011f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503effd700 1 -- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5040133f50 msgr2=0x7f504011f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503effd700 1 --2- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5040133f50 0x7f504011f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503effd700 1 -- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a0a70 msgr2=0x7f504011e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503effd700 1 --2- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a0a70 0x7f504011e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503effd700 1 -- 172.21.15.154:0/1206999518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340094a0 con 0x7f50400a1380 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f503effd700 1 --2- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a1380 0x7f504011ed80 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f503400ebe0 tx=0x7f503400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.871+0000 7f5027fff700 1 -- 172.21.15.154:0/1206999518 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400c850 con 0x7f50400a1380 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.872+0000 7f5027fff700 1 -- 172.21.15.154:0/1206999518 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503400c9b0 con 0x7f50400a1380 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.872+0000 7f5046058700 1 -- 172.21.15.154:0/1206999518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5030009550 con 0x7f50400a1380 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.872+0000 7f5027fff700 1 -- 172.21.15.154:0/1206999518 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400cd40 con 0x7f50400a1380 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.872+0000 7f5046058700 1 -- 172.21.15.154:0/1206999518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5040120c00 con 0x7f50400a1380 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.872+0000 7f5027fff700 1 -- 172.21.15.154:0/1206999518 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5034013470 con 0x7f50400a1380 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.873+0000 7f5046058700 1 -- 172.21.15.154:0/1206999518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504004f2a0 con 0x7f50400a1380 2023-09-30T22:27:38.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.873+0000 7f5027fff700 1 -- 172.21.15.154:0/1206999518 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f503403f7a0 con 0x7f50400a1380 2023-09-30T22:27:38.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.877+0000 7f5027fff700 1 -- 172.21.15.154:0/1206999518 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5034013720 con 0x7f50400a1380 2023-09-30T22:27:38.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.980+0000 7f576572c700 1 -- 172.21.15.154:0/1676922174 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f576004f2a0 con 0x7f57600a0a70 2023-09-30T22:27:38.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.980+0000 7f57477fe700 1 -- 172.21.15.154:0/1676922174 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5750011360 con 0x7f57600a0a70 2023-09-30T22:27:38.980 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:38.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.982+0000 7f576572c700 1 -- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a0a70 msgr2=0x7f576011e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:38.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.982+0000 7f576572c700 1 --2- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a0a70 0x7f576011e7b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f575000c520 tx=0x7f575000c830 comp rx=0 tx=0).stop 2023-09-30T22:27:38.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.983+0000 7f576572c700 1 -- 172.21.15.154:0/1676922174 shutdown_connections 2023-09-30T22:27:38.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.983+0000 7f576572c700 1 --2- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5760139200 0x7f576011f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.983+0000 7f576572c700 1 --2- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57600a0a70 0x7f576011e7b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.983+0000 7f576572c700 1 --2- 172.21.15.154:0/1676922174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57600a1550 0x7f576011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:38.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.983+0000 7f576572c700 1 -- 172.21.15.154:0/1676922174 >> 172.21.15.154:0/1676922174 conn(0x7f57600a6610 msgr2=0x7f57600a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:38.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.983+0000 7f576572c700 1 -- 172.21.15.154:0/1676922174 shutdown_connections 2023-09-30T22:27:38.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:38.983+0000 7f576572c700 1 -- 172.21.15.154:0/1676922174 wait complete. 2023-09-30T22:27:38.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:39.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.028+0000 7f12713ac700 1 Processor -- start 2023-09-30T22:27:39.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.028+0000 7f12713ac700 1 -- start start 2023-09-30T22:27:39.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f12713ac700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f126c09ad40 0x7f126c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f12713ac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c133f70 0x7f126c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f12713ac700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c09b110 con 0x7f126c0a0a70 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f12713ac700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0a3b60 con 0x7f126c09ad40 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f12713ac700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1348e0 con 0x7f126c133f70 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f126affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f126c09ad40 0x7f126c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f126affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f126c09ad40 0x7f126c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52910/0 (socket says 172.21.15.154:52910) 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f126affd700 1 -- 172.21.15.154:0/559520484 learned_addr learned my addr 172.21.15.154:0/559520484 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f126a7fc700 1 --2- 172.21.15.154:0/559520484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c133f70 0x7f126c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f126a7fc700 1 -- 172.21.15.154:0/559520484 >> v2:172.21.15.154:3300/0 conn(0x7f126c09ad40 msgr2=0x7f126c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f126a7fc700 1 --2- 172.21.15.154:0/559520484 >> v2:172.21.15.154:3300/0 conn(0x7f126c09ad40 0x7f126c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f126a7fc700 1 -- 172.21.15.154:0/559520484 >> v1:172.21.15.154:6789/0 conn(0x7f126c0a0a70 legacy=0x7f126c0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f126a7fc700 1 -- 172.21.15.154:0/559520484 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0a2fa0 con 0x7f126c133f70 2023-09-30T22:27:39.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.029+0000 7f126affd700 1 --2- 172.21.15.154:0/559520484 >> v2:172.21.15.154:3300/0 conn(0x7f126c09ad40 0x7f126c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:39.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f126a7fc700 1 --2- 172.21.15.154:0/559520484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c133f70 0x7f126c1343a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1260009840 tx=0x7f1260009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=188c7d60fcc53bdf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:39.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f1269ffb700 1 -- 172.21.15.154:0/559520484 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260011830 con 0x7f126c133f70 2023-09-30T22:27:39.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f1269ffb700 1 -- 172.21.15.154:0/559520484 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260011990 con 0x7f126c133f70 2023-09-30T22:27:39.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f1269ffb700 1 -- 172.21.15.154:0/559520484 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260011d20 con 0x7f126c133f70 2023-09-30T22:27:39.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f12713ac700 1 -- 172.21.15.154:0/559520484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c133f70 msgr2=0x7f126c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f12713ac700 1 --2- 172.21.15.154:0/559520484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c133f70 0x7f126c1343a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1260009840 tx=0x7f1260009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:39.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f12713ac700 1 -- 172.21.15.154:0/559520484 shutdown_connections 2023-09-30T22:27:39.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f12713ac700 1 --2- 172.21.15.154:0/559520484 >> v2:172.21.15.154:3300/0 conn(0x7f126c09ad40 0x7f126c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f12713ac700 1 --2- 172.21.15.154:0/559520484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c133f70 0x7f126c1343a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f12713ac700 1 -- 172.21.15.154:0/559520484 >> 172.21.15.154:0/559520484 conn(0x7f126c099c40 msgr2=0x7f126c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:39.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f12713ac700 1 -- 172.21.15.154:0/559520484 shutdown_connections 2023-09-30T22:27:39.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.030+0000 7f12713ac700 1 -- 172.21.15.154:0/559520484 wait complete. 2023-09-30T22:27:39.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.031+0000 7f12713ac700 1 Processor -- start 2023-09-30T22:27:39.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.031+0000 7f12713ac700 1 -- start start 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f12713ac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f126c09ad40 0x7f126c11e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f12713ac700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c0a0a70 0x7f126c11e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f12713ac700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f126c133f70 0x7f126c11eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f12713ac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c122530 con 0x7f126c09ad40 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f12713ac700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c11fc60 con 0x7f126c0a0a70 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f12713ac700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f126c120280 con 0x7f126c133f70 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c0a0a70 0x7f126c11e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c0a0a70 0x7f126c11e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44348/0 (socket says 172.21.15.154:44348) 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126a7fc700 1 -- 172.21.15.154:0/3739401890 learned_addr learned my addr 172.21.15.154:0/3739401890 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:39.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126affd700 1 --2- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f126c09ad40 0x7f126c11e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126b7fe700 1 --2- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f126c133f70 0x7f126c11eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126a7fc700 1 -- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f126c133f70 msgr2=0x7f126c11eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126a7fc700 1 --2- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f126c133f70 0x7f126c11eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126a7fc700 1 -- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f126c09ad40 msgr2=0x7f126c11e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126a7fc700 1 --2- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f126c09ad40 0x7f126c11e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126a7fc700 1 -- 172.21.15.154:0/3739401890 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c009550 con 0x7f126c0a0a70 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f126a7fc700 1 --2- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c0a0a70 0x7f126c11e5e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f12600090b0 tx=0x7f1260004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.032+0000 7f12537fe700 1 -- 172.21.15.154:0/3739401890 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260004590 con 0x7f126c0a0a70 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.033+0000 7f12537fe700 1 -- 172.21.15.154:0/3739401890 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12600036a0 con 0x7f126c0a0a70 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.033+0000 7f12713ac700 1 -- 172.21.15.154:0/3739401890 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12600094a0 con 0x7f126c0a0a70 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.033+0000 7f12537fe700 1 -- 172.21.15.154:0/3739401890 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260003a30 con 0x7f126c0a0a70 2023-09-30T22:27:39.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.033+0000 7f12713ac700 1 -- 172.21.15.154:0/3739401890 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c0a0ed0 con 0x7f126c0a0a70 2023-09-30T22:27:39.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.033+0000 7f12537fe700 1 -- 172.21.15.154:0/3739401890 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1260003b90 con 0x7f126c0a0a70 2023-09-30T22:27:39.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.034+0000 7f12537fe700 1 -- 172.21.15.154:0/3739401890 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f12600409c0 con 0x7f126c0a0a70 2023-09-30T22:27:39.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.034+0000 7f12713ac700 1 -- 172.21.15.154:0/3739401890 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c09ed10 con 0x7f126c0a0a70 2023-09-30T22:27:39.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.038+0000 7f12537fe700 1 -- 172.21.15.154:0/3739401890 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f126001a420 con 0x7f126c0a0a70 2023-09-30T22:27:39.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.075+0000 7f5046058700 1 -- 172.21.15.154:0/1206999518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5040072980 con 0x7f50400a1380 2023-09-30T22:27:39.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.075+0000 7f5027fff700 1 -- 172.21.15.154:0/1206999518 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f503401b3b0 con 0x7f50400a1380 2023-09-30T22:27:39.076 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:39.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.077+0000 7f5046058700 1 -- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a1380 msgr2=0x7f504011ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.077+0000 7f5046058700 1 --2- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a1380 0x7f504011ed80 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f503400ebe0 tx=0x7f503400eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.077+0000 7f5046058700 1 -- 172.21.15.154:0/1206999518 shutdown_connections 2023-09-30T22:27:39.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.077+0000 7f5046058700 1 --2- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5040133f50 0x7f504011f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.078+0000 7f5046058700 1 --2- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50400a0a70 0x7f504011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.078+0000 7f5046058700 1 --2- 172.21.15.154:0/1206999518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50400a1380 0x7f504011ed80 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.078+0000 7f5046058700 1 -- 172.21.15.154:0/1206999518 >> 172.21.15.154:0/1206999518 conn(0x7f50400a6610 msgr2=0x7f50400a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:39.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.078+0000 7f5046058700 1 -- 172.21.15.154:0/1206999518 shutdown_connections 2023-09-30T22:27:39.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.078+0000 7f5046058700 1 -- 172.21.15.154:0/1206999518 wait complete. 2023-09-30T22:27:39.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:39.144 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.232+0000 7f12713ac700 1 -- 172.21.15.154:0/3739401890 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f126c04f2a0 con 0x7f126c0a0a70 2023-09-30T22:27:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.233+0000 7f12537fe700 1 -- 172.21.15.154:0/3739401890 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1260036020 con 0x7f126c0a0a70 2023-09-30T22:27:39.233 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:39.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.235+0000 7f12713ac700 1 -- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c0a0a70 msgr2=0x7f126c11e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.235+0000 7f12713ac700 1 --2- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c0a0a70 0x7f126c11e5e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f12600090b0 tx=0x7f1260004750 comp rx=0 tx=0).stop 2023-09-30T22:27:39.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.235+0000 7f12713ac700 1 -- 172.21.15.154:0/3739401890 shutdown_connections 2023-09-30T22:27:39.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.235+0000 7f12713ac700 1 --2- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f126c133f70 0x7f126c11eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.235+0000 7f12713ac700 1 --2- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f126c09ad40 0x7f126c11e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.235+0000 7f12713ac700 1 --2- 172.21.15.154:0/3739401890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f126c0a0a70 0x7f126c11e5e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.235+0000 7f12713ac700 1 -- 172.21.15.154:0/3739401890 >> 172.21.15.154:0/3739401890 conn(0x7f126c099c40 msgr2=0x7f126c133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:39.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.235+0000 7f12713ac700 1 -- 172.21.15.154:0/3739401890 shutdown_connections 2023-09-30T22:27:39.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.235+0000 7f12713ac700 1 -- 172.21.15.154:0/3739401890 wait complete. 2023-09-30T22:27:39.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:39.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdfc02e700 1 Processor -- start 2023-09-30T22:27:39.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdfc02e700 1 -- start start 2023-09-30T22:27:39.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdfc02e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdf409d860 0x7fcdf409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdfc02e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf4130eb0 0x7fcdf4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdfc02e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf409aaa0 con 0x7fcdf409e170 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdfc02e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf409f870 con 0x7fcdf409d860 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdfc02e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf409b360 con 0x7fcdf4130eb0 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdf9dca700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdf409d860 0x7fcdf409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdfa5cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf4130eb0 0x7fcdf4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdf9dca700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdf409d860 0x7fcdf409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52928/0 (socket says 172.21.15.154:52928) 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdfa5cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf4130eb0 0x7fcdf4138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34710/0 (socket says 172.21.15.154:34710) 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.270+0000 7fcdf9dca700 1 -- 172.21.15.154:0/2247518419 learned_addr learned my addr 172.21.15.154:0/2247518419 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfa5cb700 1 -- 172.21.15.154:0/2247518419 >> v2:172.21.15.154:3300/0 conn(0x7fcdf409d860 msgr2=0x7fcdf409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfa5cb700 1 --2- 172.21.15.154:0/2247518419 >> v2:172.21.15.154:3300/0 conn(0x7fcdf409d860 0x7fcdf409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfa5cb700 1 -- 172.21.15.154:0/2247518419 >> v1:172.21.15.154:6789/0 conn(0x7fcdf409e170 legacy=0x7fcdf41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfa5cb700 1 -- 172.21.15.154:0/2247518419 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf409b620 con 0x7fcdf4130eb0 2023-09-30T22:27:39.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdf9dca700 1 --2- 172.21.15.154:0/2247518419 >> v2:172.21.15.154:3300/0 conn(0x7fcdf409d860 0x7fcdf409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:39.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfa5cb700 1 --2- 172.21.15.154:0/2247518419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf4130eb0 0x7fcdf4138a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009d90 tx=0x7fcdec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7504492104e5805 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:39.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdf8dc8700 1 -- 172.21.15.154:0/2247518419 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec00e070 con 0x7fcdf4130eb0 2023-09-30T22:27:39.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdf8dc8700 1 -- 172.21.15.154:0/2247518419 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec00bb20 con 0x7fcdf4130eb0 2023-09-30T22:27:39.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdf8dc8700 1 -- 172.21.15.154:0/2247518419 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec012430 con 0x7fcdf4130eb0 2023-09-30T22:27:39.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfc02e700 1 -- 172.21.15.154:0/2247518419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf4130eb0 msgr2=0x7fcdf4138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfc02e700 1 --2- 172.21.15.154:0/2247518419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf4130eb0 0x7fcdf4138a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009d90 tx=0x7fcdec00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:39.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfc02e700 1 -- 172.21.15.154:0/2247518419 shutdown_connections 2023-09-30T22:27:39.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfc02e700 1 --2- 172.21.15.154:0/2247518419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf4130eb0 0x7fcdf4138a00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfc02e700 1 --2- 172.21.15.154:0/2247518419 >> v2:172.21.15.154:3300/0 conn(0x7fcdf409d860 0x7fcdf409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.271+0000 7fcdfc02e700 1 -- 172.21.15.154:0/2247518419 >> 172.21.15.154:0/2247518419 conn(0x7fcdf4099c40 msgr2=0x7fcdf40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:39.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.272+0000 7fcdfc02e700 1 -- 172.21.15.154:0/2247518419 shutdown_connections 2023-09-30T22:27:39.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.272+0000 7fcdfc02e700 1 -- 172.21.15.154:0/2247518419 wait complete. 2023-09-30T22:27:39.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.272+0000 7fcdfc02e700 1 Processor -- start 2023-09-30T22:27:39.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdfc02e700 1 -- start start 2023-09-30T22:27:39.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdfc02e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf409d860 0x7fcdf411f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdfc02e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf409e170 0x7fcdf411fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdfc02e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf4130eb0 0x7fcdf411ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:39.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdfc02e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4122e50 con 0x7fcdf4130eb0 2023-09-30T22:27:39.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdfc02e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4120990 con 0x7fcdf409d860 2023-09-30T22:27:39.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdfc02e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4123050 con 0x7fcdf409e170 2023-09-30T22:27:39.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf95c9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf409e170 0x7fcdf411fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf95c9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf409e170 0x7fcdf411fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34726/0 (socket says 172.21.15.154:34726) 2023-09-30T22:27:39.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf95c9700 1 -- 172.21.15.154:0/3423378330 learned_addr learned my addr 172.21.15.154:0/3423378330 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:39.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf9dca700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf409d860 0x7fcdf411f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdfa5cb700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf4130eb0 0x7fcdf411ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:39.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf95c9700 1 -- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf409d860 msgr2=0x7fcdf411f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf95c9700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf409d860 0x7fcdf411f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf95c9700 1 -- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf4130eb0 msgr2=0x7fcdf411ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf95c9700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf4130eb0 0x7fcdf411ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf95c9700 1 -- 172.21.15.154:0/3423378330 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde4009550 con 0x7fcdf409e170 2023-09-30T22:27:39.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf9dca700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf409d860 0x7fcdf411f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:39.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdfa5cb700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf4130eb0 0x7fcdf411ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:39.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.273+0000 7fcdf95c9700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf409e170 0x7fcdf411fa70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000c4e0 tx=0x7fcdf000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:39.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.274+0000 7fcdea7fc700 1 -- 172.21.15.154:0/3423378330 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00052d0 con 0x7fcdf409e170 2023-09-30T22:27:39.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.274+0000 7fcdea7fc700 1 -- 172.21.15.154:0/3423378330 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf0005430 con 0x7fcdf409e170 2023-09-30T22:27:39.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.274+0000 7fcdfc02e700 1 -- 172.21.15.154:0/3423378330 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec009a70 con 0x7fcdf409e170 2023-09-30T22:27:39.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.274+0000 7fcdea7fc700 1 -- 172.21.15.154:0/3423378330 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00038c0 con 0x7fcdf409e170 2023-09-30T22:27:39.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.274+0000 7fcdfc02e700 1 -- 172.21.15.154:0/3423378330 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf4121190 con 0x7fcdf409e170 2023-09-30T22:27:39.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.274+0000 7fcdea7fc700 1 -- 172.21.15.154:0/3423378330 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdf0003a20 con 0x7fcdf409e170 2023-09-30T22:27:39.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.275+0000 7fcdea7fc700 1 -- 172.21.15.154:0/3423378330 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcdf003ea10 con 0x7fcdf409e170 2023-09-30T22:27:39.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.275+0000 7fcdfc02e700 1 -- 172.21.15.154:0/3423378330 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf404f2a0 con 0x7fcdf409e170 2023-09-30T22:27:39.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.279+0000 7fcdea7fc700 1 -- 172.21.15.154:0/3423378330 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdf0017020 con 0x7fcdf409e170 2023-09-30T22:27:39.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.461+0000 7fcdfc02e700 1 -- 172.21.15.154:0/3423378330 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcdf406c3b0 con 0x7fcdf409e170 2023-09-30T22:27:39.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.462+0000 7fcdea7fc700 1 -- 172.21.15.154:0/3423378330 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdf0018260 con 0x7fcdf409e170 2023-09-30T22:27:39.462 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:39.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.464+0000 7fcdfc02e700 1 -- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf409e170 msgr2=0x7fcdf411fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:39.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.464+0000 7fcdfc02e700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf409e170 0x7fcdf411fa70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000c4e0 tx=0x7fcdf000c7f0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.464+0000 7fcdfc02e700 1 -- 172.21.15.154:0/3423378330 shutdown_connections 2023-09-30T22:27:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.464+0000 7fcdfc02e700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf4130eb0 0x7fcdf411ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.464+0000 7fcdfc02e700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf409d860 0x7fcdf411f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.464+0000 7fcdfc02e700 1 --2- 172.21.15.154:0/3423378330 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdf409e170 0x7fcdf411fa70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.464+0000 7fcdfc02e700 1 -- 172.21.15.154:0/3423378330 >> 172.21.15.154:0/3423378330 conn(0x7fcdf4099c40 msgr2=0x7fcdf4119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:39.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.464+0000 7fcdfc02e700 1 -- 172.21.15.154:0/3423378330 shutdown_connections 2023-09-30T22:27:39.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:39.464+0000 7fcdfc02e700 1 -- 172.21.15.154:0/3423378330 wait complete. 2023-09-30T22:27:39.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:39.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:40.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:40.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.122+0000 7f54b11da700 1 Processor -- start 2023-09-30T22:27:40.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.122+0000 7f54b11da700 1 -- start start 2023-09-30T22:27:40.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54b11da700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54ac136960 0x7f54ac138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54b11da700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac139280 0x7f54ac13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54b11da700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac06b2d0 con 0x7f54ac133ad0 2023-09-30T22:27:40.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54b11da700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac1345b0 con 0x7f54ac136960 2023-09-30T22:27:40.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54b11da700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac133610 con 0x7f54ac139280 2023-09-30T22:27:40.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54aa59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54ac136960 0x7f54ac138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54ab59e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac139280 0x7f54ac13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54aa59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54ac136960 0x7f54ac138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52940/0 (socket says 172.21.15.154:52940) 2023-09-30T22:27:40.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54aa59c700 1 -- 172.21.15.154:0/706815558 learned_addr learned my addr 172.21.15.154:0/706815558 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:40.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54aa59c700 1 -- 172.21.15.154:0/706815558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac139280 msgr2=0x7f54ac13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:40.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54aa59c700 1 --2- 172.21.15.154:0/706815558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac139280 0x7f54ac13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54aa59c700 1 -- 172.21.15.154:0/706815558 >> v1:172.21.15.154:6789/0 conn(0x7f54ac133ad0 legacy=0x7f54ac133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54aa59c700 1 -- 172.21.15.154:0/706815558 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac09a500 con 0x7f54ac136960 2023-09-30T22:27:40.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54ab59e700 1 --2- 172.21.15.154:0/706815558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac139280 0x7f54ac13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:40.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.123+0000 7f54aa59c700 1 --2- 172.21.15.154:0/706815558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 0x7f54ac138d40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f54a00098f0 tx=0x7f54a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867d32be712a7c10 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54a9d9b700 1 -- 172.21.15.154:0/706815558 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0011830 con 0x7f54ac136960 2023-09-30T22:27:40.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54a9d9b700 1 -- 172.21.15.154:0/706815558 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a0011990 con 0x7f54ac136960 2023-09-30T22:27:40.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54a9d9b700 1 -- 172.21.15.154:0/706815558 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0011d20 con 0x7f54ac136960 2023-09-30T22:27:40.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54b11da700 1 -- 172.21.15.154:0/706815558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 msgr2=0x7f54ac138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54b11da700 1 --2- 172.21.15.154:0/706815558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 0x7f54ac138d40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f54a00098f0 tx=0x7f54a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:40.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54b11da700 1 -- 172.21.15.154:0/706815558 shutdown_connections 2023-09-30T22:27:40.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54b11da700 1 --2- 172.21.15.154:0/706815558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac139280 0x7f54ac13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54b11da700 1 --2- 172.21.15.154:0/706815558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 0x7f54ac138d40 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54b11da700 1 -- 172.21.15.154:0/706815558 >> 172.21.15.154:0/706815558 conn(0x7f54ac099c40 msgr2=0x7f54ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54b11da700 1 -- 172.21.15.154:0/706815558 shutdown_connections 2023-09-30T22:27:40.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.124+0000 7f54b11da700 1 -- 172.21.15.154:0/706815558 wait complete. 2023-09-30T22:27:40.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.125+0000 7f54b11da700 1 Processor -- start 2023-09-30T22:27:40.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.125+0000 7f54b11da700 1 -- start start 2023-09-30T22:27:40.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54b11da700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac133ad0 0x7f54ac12cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54b11da700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 0x7f54ac12d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54b11da700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54ac139280 0x7f54ac071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54b11da700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac12dd00 con 0x7f54ac136960 2023-09-30T22:27:40.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54b11da700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac070590 con 0x7f54ac133ad0 2023-09-30T22:27:40.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54b11da700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac131630 con 0x7f54ac139280 2023-09-30T22:27:40.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac133ad0 0x7f54ac12cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aa59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 0x7f54ac12d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aa59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 0x7f54ac12d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52952/0 (socket says 172.21.15.154:52952) 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac133ad0 0x7f54ac12cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44378/0 (socket says 172.21.15.154:44378) 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aa59c700 1 -- 172.21.15.154:0/1459101058 learned_addr learned my addr 172.21.15.154:0/1459101058 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54ab59e700 1 --2- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54ac139280 0x7f54ac071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aa59c700 1 -- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54ac139280 msgr2=0x7f54ac071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aa59c700 1 --2- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54ac139280 0x7f54ac071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aa59c700 1 -- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac133ad0 msgr2=0x7f54ac12cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aa59c700 1 --2- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac133ad0 0x7f54ac12cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aa59c700 1 -- 172.21.15.154:0/1459101058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a4009a70 con 0x7f54ac136960 2023-09-30T22:27:40.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.126+0000 7f54aad9d700 1 --2- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac133ad0 0x7f54ac12cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:40.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.127+0000 7f54aa59c700 1 --2- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 0x7f54ac12d450 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009c40 tx=0x7f54a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.127+0000 7f54937fe700 1 -- 172.21.15.154:0/1459101058 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0004510 con 0x7f54ac136960 2023-09-30T22:27:40.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.127+0000 7f54937fe700 1 -- 172.21.15.154:0/1459101058 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a001e070 con 0x7f54ac136960 2023-09-30T22:27:40.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.127+0000 7f54937fe700 1 -- 172.21.15.154:0/1459101058 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a00038e0 con 0x7f54ac136960 2023-09-30T22:27:40.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.127+0000 7f54b11da700 1 -- 172.21.15.154:0/1459101058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a0009550 con 0x7f54ac136960 2023-09-30T22:27:40.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.127+0000 7f54b11da700 1 -- 172.21.15.154:0/1459101058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac072250 con 0x7f54ac136960 2023-09-30T22:27:40.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.128+0000 7f54937fe700 1 -- 172.21.15.154:0/1459101058 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54a0003a40 con 0x7f54ac136960 2023-09-30T22:27:40.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.128+0000 7f54b11da700 1 -- 172.21.15.154:0/1459101058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac04f2a0 con 0x7f54ac136960 2023-09-30T22:27:40.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.128+0000 7f54937fe700 1 -- 172.21.15.154:0/1459101058 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f54a0020070 con 0x7f54ac136960 2023-09-30T22:27:40.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.132+0000 7f54937fe700 1 -- 172.21.15.154:0/1459101058 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54a000b3e0 con 0x7f54ac136960 2023-09-30T22:27:40.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.218+0000 7f8685fb9700 1 Processor -- start 2023-09-30T22:27:40.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.218+0000 7f8685fb9700 1 -- start start 2023-09-30T22:27:40.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f8685fb9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f868009ad40 0x7f8680133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f8685fb9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8680133f70 0x7f86801343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f8685fb9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86800a0a70 0x7f86800a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f8685fb9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86800a3b60 con 0x7f86800a0a70 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f8685fb9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86801348e0 con 0x7f8680133f70 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f8685fb9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f868009b110 con 0x7f868009ad40 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f868009ad40 0x7f8680133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f8676ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8680133f70 0x7f86801343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f868009ad40 0x7f8680133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34744/0 (socket says 172.21.15.154:34744) 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867f7fe700 1 -- 172.21.15.154:0/4081229466 learned_addr learned my addr 172.21.15.154:0/4081229466 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867ffff700 1 --2- 172.21.15.154:0/4081229466 >> v2:172.21.15.154:3300/0 conn(0x7f86800a0a70 0x7f86800a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867ffff700 1 -- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f868009ad40 msgr2=0x7f8680133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:40.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867ffff700 1 --2- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f868009ad40 0x7f8680133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867ffff700 1 -- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8680133f70 msgr2=0x7f86801343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867ffff700 1 --2- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8680133f70 0x7f86801343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867ffff700 1 -- 172.21.15.154:0/4081229466 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800a2fa0 con 0x7f86800a0a70 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867f7fe700 1 --2- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f868009ad40 0x7f8680133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f8676ffd700 1 --2- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8680133f70 0x7f86801343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.219+0000 7f867ffff700 1 --2- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86800a0a70 0x7f86800a0ef0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8678009dc0 tx=0x7f867800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf85f4d469045492 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f867effd700 1 -- 172.21.15.154:0/4081229466 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867800e070 con 0x7f86800a0a70 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f867effd700 1 -- 172.21.15.154:0/4081229466 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867800bae0 con 0x7f86800a0a70 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f867effd700 1 -- 172.21.15.154:0/4081229466 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867800be90 con 0x7f86800a0a70 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f8685fb9700 1 -- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86800a0a70 msgr2=0x7f86800a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f8685fb9700 1 --2- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86800a0a70 0x7f86800a0ef0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8678009dc0 tx=0x7f867800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:40.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f8685fb9700 1 -- 172.21.15.154:0/4081229466 shutdown_connections 2023-09-30T22:27:40.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f8685fb9700 1 --2- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86800a0a70 0x7f86800a0ef0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f8685fb9700 1 --2- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f868009ad40 0x7f8680133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f8685fb9700 1 --2- 172.21.15.154:0/4081229466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8680133f70 0x7f86801343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f8685fb9700 1 -- 172.21.15.154:0/4081229466 >> 172.21.15.154:0/4081229466 conn(0x7f8680099c40 msgr2=0x7f868006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f8685fb9700 1 -- 172.21.15.154:0/4081229466 shutdown_connections 2023-09-30T22:27:40.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.220+0000 7f8685fb9700 1 -- 172.21.15.154:0/4081229466 wait complete. 2023-09-30T22:27:40.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.221+0000 7f8685fb9700 1 Processor -- start 2023-09-30T22:27:40.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f8685fb9700 1 -- start start 2023-09-30T22:27:40.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f8685fb9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f868009ad40 0x7f86801c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f8685fb9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86800a0a70 0x7f86801c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f8685fb9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8680133f70 0x7f86801c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f8685fb9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8680121460 con 0x7f8680133f70 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f8685fb9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868009c7e0 con 0x7f868009ad40 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f8685fb9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f868011f750 con 0x7f86800a0a70 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f867f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f868009ad40 0x7f86801c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f867ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8680133f70 0x7f86801c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f867f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f868009ad40 0x7f86801c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44394/0 (socket says 172.21.15.154:44394) 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f867f7fe700 1 -- 172.21.15.154:0/2833725264 learned_addr learned my addr 172.21.15.154:0/2833725264 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:40.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.222+0000 7f8676ffd700 1 --2- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86800a0a70 0x7f86801c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867ffff700 1 -- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86800a0a70 msgr2=0x7f86801c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867ffff700 1 --2- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86800a0a70 0x7f86801c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867ffff700 1 -- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f868009ad40 msgr2=0x7f86801c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867ffff700 1 --2- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f868009ad40 0x7f86801c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867ffff700 1 -- 172.21.15.154:0/2833725264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670009550 con 0x7f8680133f70 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867f7fe700 1 --2- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f868009ad40 0x7f86801c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867ffff700 1 --2- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8680133f70 0x7f86801c8d10 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f86800a1ce0 tx=0x7f8678004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867cff9700 1 -- 172.21.15.154:0/2833725264 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780045d0 con 0x7f8680133f70 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867cff9700 1 -- 172.21.15.154:0/2833725264 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8678020070 con 0x7f8680133f70 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f8685fb9700 1 -- 172.21.15.154:0/2833725264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86680094a0 con 0x7f8680133f70 2023-09-30T22:27:40.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f867cff9700 1 -- 172.21.15.154:0/2833725264 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678027480 con 0x7f8680133f70 2023-09-30T22:27:40.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.223+0000 7f8685fb9700 1 -- 172.21.15.154:0/2833725264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8678009a70 con 0x7f8680133f70 2023-09-30T22:27:40.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.224+0000 7f867cff9700 1 -- 172.21.15.154:0/2833725264 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8678012430 con 0x7f8680133f70 2023-09-30T22:27:40.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.224+0000 7f867cff9700 1 -- 172.21.15.154:0/2833725264 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8678022070 con 0x7f8680133f70 2023-09-30T22:27:40.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.224+0000 7f8685fb9700 1 -- 172.21.15.154:0/2833725264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868004f2a0 con 0x7f8680133f70 2023-09-30T22:27:40.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.229+0000 7f867cff9700 1 -- 172.21.15.154:0/2833725264 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f867801c400 con 0x7f8680133f70 2023-09-30T22:27:40.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:40.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.328+0000 7f54b11da700 1 -- 172.21.15.154:0/1459101058 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54ac06c3b0 con 0x7f54ac136960 2023-09-30T22:27:40.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.329+0000 7f54937fe700 1 -- 172.21.15.154:0/1459101058 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54a0015030 con 0x7f54ac136960 2023-09-30T22:27:40.329 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:40.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.331+0000 7f54b11da700 1 -- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 msgr2=0x7f54ac12d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.331+0000 7f54b11da700 1 --2- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 0x7f54ac12d450 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009c40 tx=0x7f54a0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:40.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.331+0000 7f54b11da700 1 -- 172.21.15.154:0/1459101058 shutdown_connections 2023-09-30T22:27:40.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.331+0000 7f54b11da700 1 --2- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f54ac139280 0x7f54ac071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.331+0000 7f54b11da700 1 --2- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54ac133ad0 0x7f54ac12cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.331+0000 7f54b11da700 1 --2- 172.21.15.154:0/1459101058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54ac136960 0x7f54ac12d450 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.331+0000 7f54b11da700 1 -- 172.21.15.154:0/1459101058 >> 172.21.15.154:0/1459101058 conn(0x7f54ac099c40 msgr2=0x7f54ac134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.331+0000 7f54b11da700 1 -- 172.21.15.154:0/1459101058 shutdown_connections 2023-09-30T22:27:40.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.331+0000 7f54b11da700 1 -- 172.21.15.154:0/1459101058 wait complete. 2023-09-30T22:27:40.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.374+0000 7f4c0dbbc700 1 Processor -- start 2023-09-30T22:27:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.374+0000 7f4c0dbbc700 1 -- start start 2023-09-30T22:27:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.374+0000 7f4c0dbbc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08133450 0x7f4c08135830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.374+0000 7f4c0dbbc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c08135d70 0x7f4c08138150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.374+0000 7f4c0dbbc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0809b720 con 0x7f4c0809e800 2023-09-30T22:27:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.374+0000 7f4c0dbbc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0809b180 con 0x7f4c08135d70 2023-09-30T22:27:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.374+0000 7f4c0dbbc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0809ebd0 con 0x7f4c08133450 2023-09-30T22:27:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c06ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08133450 0x7f4c08135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c06ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08133450 0x7f4c08135830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44402/0 (socket says 172.21.15.154:44402) 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c07fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c08135d70 0x7f4c08138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c06ffd700 1 -- 172.21.15.154:0/2567257006 learned_addr learned my addr 172.21.15.154:0/2567257006 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c06ffd700 1 -- 172.21.15.154:0/2567257006 >> v2:172.21.15.154:3300/0 conn(0x7f4c08135d70 msgr2=0x7f4c08138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c06ffd700 1 --2- 172.21.15.154:0/2567257006 >> v2:172.21.15.154:3300/0 conn(0x7f4c08135d70 0x7f4c08138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c06ffd700 1 -- 172.21.15.154:0/2567257006 >> v1:172.21.15.154:6789/0 conn(0x7f4c0809e800 legacy=0x7f4c0812d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c06ffd700 1 -- 172.21.15.154:0/2567257006 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0809b440 con 0x7f4c08133450 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c07fff700 1 --2- 172.21.15.154:0/2567257006 >> v2:172.21.15.154:3300/0 conn(0x7f4c08135d70 0x7f4c08138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c06ffd700 1 --2- 172.21.15.154:0/2567257006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08133450 0x7f4c08135830 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0098f0 tx=0x7f4bfc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ff6ee0ff934593f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c067fc700 1 -- 172.21.15.154:0/2567257006 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc011830 con 0x7f4c08133450 2023-09-30T22:27:40.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c067fc700 1 -- 172.21.15.154:0/2567257006 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc011990 con 0x7f4c08133450 2023-09-30T22:27:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.375+0000 7f4c067fc700 1 -- 172.21.15.154:0/2567257006 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc011d20 con 0x7f4c08133450 2023-09-30T22:27:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.376+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/2567257006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08133450 msgr2=0x7f4c08135830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.376+0000 7f4c0dbbc700 1 --2- 172.21.15.154:0/2567257006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08133450 0x7f4c08135830 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0098f0 tx=0x7f4bfc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.376+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/2567257006 shutdown_connections 2023-09-30T22:27:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.376+0000 7f4c0dbbc700 1 --2- 172.21.15.154:0/2567257006 >> v2:172.21.15.154:3300/0 conn(0x7f4c08135d70 0x7f4c08138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.376+0000 7f4c0dbbc700 1 --2- 172.21.15.154:0/2567257006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08133450 0x7f4c08135830 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.376+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/2567257006 >> 172.21.15.154:0/2567257006 conn(0x7f4c080a2ef0 msgr2=0x7f4c080a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.376+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/2567257006 shutdown_connections 2023-09-30T22:27:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.376+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/2567257006 wait complete. 2023-09-30T22:27:40.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c0dbbc700 1 Processor -- start 2023-09-30T22:27:40.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c0dbbc700 1 -- start start 2023-09-30T22:27:40.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c0dbbc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c0809e800 0x7f4c08134860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c0dbbc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c08133450 0x7f4c08070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c0dbbc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c08135d70 0x7f4c08071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c0dbbc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c08129cb0 con 0x7f4c08133450 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c0dbbc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c08129f10 con 0x7f4c0809e800 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c0dbbc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0806fe60 con 0x7f4c08135d70 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c077fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c0809e800 0x7f4c08134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c077fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c0809e800 0x7f4c08134860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44418/0 (socket says 172.21.15.154:44418) 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c077fe700 1 -- 172.21.15.154:0/1808195235 learned_addr learned my addr 172.21.15.154:0/1808195235 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c07fff700 1 --2- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c08135d70 0x7f4c08071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.377+0000 7f4c06ffd700 1 --2- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c08133450 0x7f4c08070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4c077fe700 1 -- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c08135d70 msgr2=0x7f4c08071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4c077fe700 1 --2- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c08135d70 0x7f4c08071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4c077fe700 1 -- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c08133450 msgr2=0x7f4c08070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4c077fe700 1 --2- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c08133450 0x7f4c08070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4c077fe700 1 -- 172.21.15.154:0/1808195235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00009a70 con 0x7f4c0809e800 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4c077fe700 1 --2- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c0809e800 0x7f4c08134860 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800c4e0 tx=0x7f4bf800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4beffff700 1 -- 172.21.15.154:0/1808195235 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80052d0 con 0x7f4c0809e800 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4beffff700 1 -- 172.21.15.154:0/1808195235 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf8005430 con 0x7f4c0809e800 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/1808195235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc009550 con 0x7f4c0809e800 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4beffff700 1 -- 172.21.15.154:0/1808195235 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80038c0 con 0x7f4c0809e800 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.378+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/1808195235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0806ea60 con 0x7f4c0809e800 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.379+0000 7f4beffff700 1 -- 172.21.15.154:0/1808195235 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bf8003a20 con 0x7f4c0809e800 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.379+0000 7f4beffff700 1 -- 172.21.15.154:0/1808195235 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4bf803eaa0 con 0x7f4c0809e800 2023-09-30T22:27:40.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.379+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/1808195235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0804f2a0 con 0x7f4c0809e800 2023-09-30T22:27:40.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.384+0000 7f4beffff700 1 -- 172.21.15.154:0/1808195235 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bf8018260 con 0x7f4c0809e800 2023-09-30T22:27:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.424+0000 7f8685fb9700 1 -- 172.21.15.154:0/2833725264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86800729d0 con 0x7f8680133f70 2023-09-30T22:27:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.424+0000 7f867cff9700 1 -- 172.21.15.154:0/2833725264 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f867801a380 con 0x7f8680133f70 2023-09-30T22:27:40.425 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.426+0000 7f8685fb9700 1 -- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8680133f70 msgr2=0x7f86801c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.426+0000 7f8685fb9700 1 --2- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8680133f70 0x7f86801c8d10 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f86800a1ce0 tx=0x7f8678004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.426+0000 7f8685fb9700 1 -- 172.21.15.154:0/2833725264 shutdown_connections 2023-09-30T22:27:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.426+0000 7f8685fb9700 1 --2- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8680133f70 0x7f86801c8d10 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.426+0000 7f8685fb9700 1 --2- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f868009ad40 0x7f86801c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.426+0000 7f8685fb9700 1 --2- 172.21.15.154:0/2833725264 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86800a0a70 0x7f86801c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.426+0000 7f8685fb9700 1 -- 172.21.15.154:0/2833725264 >> 172.21.15.154:0/2833725264 conn(0x7f8680099c40 msgr2=0x7f868009e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.427+0000 7f8685fb9700 1 -- 172.21.15.154:0/2833725264 shutdown_connections 2023-09-30T22:27:40.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.427+0000 7f8685fb9700 1 -- 172.21.15.154:0/2833725264 wait complete. 2023-09-30T22:27:40.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:40.476 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.582+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/1808195235 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4c0806c300 con 0x7f4c0809e800 2023-09-30T22:27:40.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.582+0000 7f4beffff700 1 -- 172.21.15.154:0/1808195235 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bf8017020 con 0x7f4c0809e800 2023-09-30T22:27:40.582 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:40.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.584+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c0809e800 msgr2=0x7f4c08134860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.584+0000 7f4c0dbbc700 1 --2- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c0809e800 0x7f4c08134860 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800c4e0 tx=0x7f4bf800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.584+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/1808195235 shutdown_connections 2023-09-30T22:27:40.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.584+0000 7f4c0dbbc700 1 --2- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c08135d70 0x7f4c08071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.584+0000 7f4c0dbbc700 1 --2- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c0809e800 0x7f4c08134860 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.584+0000 7f4c0dbbc700 1 --2- 172.21.15.154:0/1808195235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c08133450 0x7f4c08070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.584+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/1808195235 >> 172.21.15.154:0/1808195235 conn(0x7f4c080a2ef0 msgr2=0x7f4c0806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.584+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/1808195235 shutdown_connections 2023-09-30T22:27:40.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.584+0000 7f4c0dbbc700 1 -- 172.21.15.154:0/1808195235 wait complete. 2023-09-30T22:27:40.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:40.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.604+0000 7ff384110700 1 Processor -- start 2023-09-30T22:27:40.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.604+0000 7ff384110700 1 -- start start 2023-09-30T22:27:40.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff384110700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff37c0a1550 0x7ff37c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff384110700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff384110700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c09e9d0 con 0x7ff37c0a0a70 2023-09-30T22:27:40.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff384110700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c09dc00 con 0x7ff37c0a1550 2023-09-30T22:27:40.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff384110700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c09dec0 con 0x7ff37c139200 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3816ab700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff37c0a1550 0x7ff37c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3826ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3816ab700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff37c0a1550 0x7ff37c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53000/0 (socket says 172.21.15.154:53000) 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3826ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34774/0 (socket says 172.21.15.154:34774) 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3816ab700 1 -- 172.21.15.154:0/1780761735 learned_addr learned my addr 172.21.15.154:0/1780761735 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3826ad700 1 -- 172.21.15.154:0/1780761735 >> v2:172.21.15.154:3300/0 conn(0x7ff37c0a1550 msgr2=0x7ff37c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3826ad700 1 --2- 172.21.15.154:0/1780761735 >> v2:172.21.15.154:3300/0 conn(0x7ff37c0a1550 0x7ff37c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3826ad700 1 -- 172.21.15.154:0/1780761735 >> v1:172.21.15.154:6789/0 conn(0x7ff37c0a0a70 legacy=0x7ff37c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3826ad700 1 -- 172.21.15.154:0/1780761735 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c09e6a0 con 0x7ff37c139200 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3816ab700 1 --2- 172.21.15.154:0/1780761735 >> v2:172.21.15.154:3300/0 conn(0x7ff37c0a1550 0x7ff37c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:40.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff3826ad700 1 --2- 172.21.15.154:0/1780761735 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c13b5e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff374009840 tx=0x7ff374009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd22eb874aa1defd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff380eaa700 1 -- 172.21.15.154:0/1780761735 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011830 con 0x7ff37c139200 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff380eaa700 1 -- 172.21.15.154:0/1780761735 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374011990 con 0x7ff37c139200 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.605+0000 7ff380eaa700 1 -- 172.21.15.154:0/1780761735 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011d20 con 0x7ff37c139200 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.606+0000 7ff384110700 1 -- 172.21.15.154:0/1780761735 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 msgr2=0x7ff37c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.606+0000 7ff384110700 1 --2- 172.21.15.154:0/1780761735 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c13b5e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff374009840 tx=0x7ff374009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.606+0000 7ff384110700 1 -- 172.21.15.154:0/1780761735 shutdown_connections 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.606+0000 7ff384110700 1 --2- 172.21.15.154:0/1780761735 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c13b5e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.606+0000 7ff384110700 1 --2- 172.21.15.154:0/1780761735 >> v2:172.21.15.154:3300/0 conn(0x7ff37c0a1550 0x7ff37c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.606+0000 7ff384110700 1 -- 172.21.15.154:0/1780761735 >> 172.21.15.154:0/1780761735 conn(0x7ff37c0a6610 msgr2=0x7ff37c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.606+0000 7ff384110700 1 -- 172.21.15.154:0/1780761735 shutdown_connections 2023-09-30T22:27:40.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.606+0000 7ff384110700 1 -- 172.21.15.154:0/1780761735 wait complete. 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff384110700 1 Processor -- start 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff384110700 1 -- start start 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff384110700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff37c0a0a70 0x7ff37c11e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff384110700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff37c0a1550 0x7ff37c11ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff384110700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c11f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff384110700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0a0470 con 0x7ff37c0a0a70 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff384110700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c122050 con 0x7ff37c0a1550 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff384110700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c121aa0 con 0x7ff37c139200 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff381eac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff37c0a0a70 0x7ff37c11e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff3826ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c11f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff3816ab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff37c0a1550 0x7ff37c11ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:40.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.607+0000 7ff381eac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff37c0a0a70 0x7ff37c11e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53016/0 (socket says 172.21.15.154:53016) 2023-09-30T22:27:40.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff381eac700 1 -- 172.21.15.154:0/2085653639 learned_addr learned my addr 172.21.15.154:0/2085653639 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:40.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff3826ad700 1 -- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff37c0a1550 msgr2=0x7ff37c11ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff3826ad700 1 --2- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff37c0a1550 0x7ff37c11ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff3826ad700 1 -- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff37c0a0a70 msgr2=0x7ff37c11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff3826ad700 1 --2- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff37c0a0a70 0x7ff37c11e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff3826ad700 1 -- 172.21.15.154:0/2085653639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370009550 con 0x7ff37c139200 2023-09-30T22:27:40.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff3826ad700 1 --2- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c11f320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0a72d0 tx=0x7ff374004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:40.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff37a7fc700 1 -- 172.21.15.154:0/2085653639 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374004590 con 0x7ff37c139200 2023-09-30T22:27:40.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff37a7fc700 1 -- 172.21.15.154:0/2085653639 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37401f070 con 0x7ff37c139200 2023-09-30T22:27:40.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff384110700 1 -- 172.21.15.154:0/2085653639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3740094a0 con 0x7ff37c139200 2023-09-30T22:27:40.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff37a7fc700 1 -- 172.21.15.154:0/2085653639 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740038c0 con 0x7ff37c139200 2023-09-30T22:27:40.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.608+0000 7ff384110700 1 -- 172.21.15.154:0/2085653639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c120530 con 0x7ff37c139200 2023-09-30T22:27:40.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.609+0000 7ff37a7fc700 1 -- 172.21.15.154:0/2085653639 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff374003a20 con 0x7ff37c139200 2023-09-30T22:27:40.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.609+0000 7ff37a7fc700 1 -- 172.21.15.154:0/2085653639 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff374021070 con 0x7ff37c139200 2023-09-30T22:27:40.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.609+0000 7ff384110700 1 -- 172.21.15.154:0/2085653639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c04f2a0 con 0x7ff37c139200 2023-09-30T22:27:40.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.614+0000 7ff37a7fc700 1 -- 172.21.15.154:0/2085653639 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff37402b020 con 0x7ff37c139200 2023-09-30T22:27:40.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.797+0000 7ff384110700 1 -- 172.21.15.154:0/2085653639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff37c120c10 con 0x7ff37c139200 2023-09-30T22:27:40.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.798+0000 7ff37a7fc700 1 -- 172.21.15.154:0/2085653639 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff374026480 con 0x7ff37c139200 2023-09-30T22:27:40.798 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.799+0000 7ff384110700 1 -- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 msgr2=0x7ff37c11f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.799+0000 7ff384110700 1 --2- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c11f320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0a72d0 tx=0x7ff374004750 comp rx=0 tx=0).stop 2023-09-30T22:27:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.799+0000 7ff384110700 1 -- 172.21.15.154:0/2085653639 shutdown_connections 2023-09-30T22:27:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.799+0000 7ff384110700 1 --2- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff37c139200 0x7ff37c11f320 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.799+0000 7ff384110700 1 --2- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff37c0a0a70 0x7ff37c11e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.799+0000 7ff384110700 1 --2- 172.21.15.154:0/2085653639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff37c0a1550 0x7ff37c11ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.799+0000 7ff384110700 1 -- 172.21.15.154:0/2085653639 >> 172.21.15.154:0/2085653639 conn(0x7ff37c0a6610 msgr2=0x7ff37c138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:40.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.800+0000 7ff384110700 1 -- 172.21.15.154:0/2085653639 shutdown_connections 2023-09-30T22:27:40.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:40.800+0000 7ff384110700 1 -- 172.21.15.154:0/2085653639 wait complete. 2023-09-30T22:27:40.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:41.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:41.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:41.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.471+0000 7f4f43593700 1 Processor -- start 2023-09-30T22:27:41.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.471+0000 7f4f43593700 1 -- start start 2023-09-30T22:27:41.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f43593700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c12d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f43593700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f3c130350 0x7f4f3c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f43593700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c09ae40 con 0x7f4f3c130ce0 2023-09-30T22:27:41.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f43593700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c09b9a0 con 0x7f4f3c130350 2023-09-30T22:27:41.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f43593700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c09bbb0 con 0x7f4f3c12d280 2023-09-30T22:27:41.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f4132f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c12d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f4132f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c12d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44436/0 (socket says 172.21.15.154:44436) 2023-09-30T22:27:41.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f4132f700 1 -- 172.21.15.154:0/3560915791 learned_addr learned my addr 172.21.15.154:0/3560915791 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:41.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f40b2e700 1 --2- 172.21.15.154:0/3560915791 >> v2:172.21.15.154:3300/0 conn(0x7f4f3c130350 0x7f4f3c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f40b2e700 1 -- 172.21.15.154:0/3560915791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 msgr2=0x7f4f3c12d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f40b2e700 1 --2- 172.21.15.154:0/3560915791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c12d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f40b2e700 1 -- 172.21.15.154:0/3560915791 >> v1:172.21.15.154:6789/0 conn(0x7f4f3c130ce0 legacy=0x7f4f3c137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f33fff700 1 -- 172.21.15.154:0/3560915791 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080461323 0 0) 0x7f4f3c09ae40 con 0x7f4f3c130ce0 2023-09-30T22:27:41.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f40b2e700 1 -- 172.21.15.154:0/3560915791 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c09b250 con 0x7f4f3c130350 2023-09-30T22:27:41.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f4132f700 1 --2- 172.21.15.154:0/3560915791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c12d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.472+0000 7f4f40b2e700 1 --2- 172.21.15.154:0/3560915791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 0x7f4f3c1307a0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009840 tx=0x7f4f2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff49f694a4a699c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f33fff700 1 -- 172.21.15.154:0/3560915791 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c011830 con 0x7f4f3c130350 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f33fff700 1 -- 172.21.15.154:0/3560915791 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c011990 con 0x7f4f3c130350 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f33fff700 1 -- 172.21.15.154:0/3560915791 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c011d20 con 0x7f4f3c130350 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f43593700 1 -- 172.21.15.154:0/3560915791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 msgr2=0x7f4f3c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f43593700 1 --2- 172.21.15.154:0/3560915791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 0x7f4f3c1307a0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009840 tx=0x7f4f2c009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f43593700 1 -- 172.21.15.154:0/3560915791 shutdown_connections 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f43593700 1 --2- 172.21.15.154:0/3560915791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c12d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f43593700 1 --2- 172.21.15.154:0/3560915791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 0x7f4f3c1307a0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f43593700 1 -- 172.21.15.154:0/3560915791 >> 172.21.15.154:0/3560915791 conn(0x7f4f3c0a2980 msgr2=0x7f4f3c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f43593700 1 -- 172.21.15.154:0/3560915791 shutdown_connections 2023-09-30T22:27:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.473+0000 7f4f43593700 1 -- 172.21.15.154:0/3560915791 wait complete. 2023-09-30T22:27:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.474+0000 7f4f43593700 1 Processor -- start 2023-09-30T22:27:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.474+0000 7f4f43593700 1 -- start start 2023-09-30T22:27:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f43593700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c09d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f43593700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 0x7f4f3c09d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f43593700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f3c130ce0 0x7f4f3c09dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f43593700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c11e3f0 con 0x7f4f3c130350 2023-09-30T22:27:41.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f43593700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c12cd10 con 0x7f4f3c12d280 2023-09-30T22:27:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f43593700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c11f1e0 con 0x7f4f3c130ce0 2023-09-30T22:27:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f40b2e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 0x7f4f3c09d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f4132f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c09d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f40b2e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 0x7f4f3c09d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53024/0 (socket says 172.21.15.154:53024) 2023-09-30T22:27:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f40b2e700 1 -- 172.21.15.154:0/3222670171 learned_addr learned my addr 172.21.15.154:0/3222670171 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:41.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f41b30700 1 --2- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f3c130ce0 0x7f4f3c09dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f40b2e700 1 -- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f3c130ce0 msgr2=0x7f4f3c09dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f40b2e700 1 --2- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f3c130ce0 0x7f4f3c09dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f40b2e700 1 -- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 msgr2=0x7f4f3c09d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f40b2e700 1 --2- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c09d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f40b2e700 1 -- 172.21.15.154:0/3222670171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38009500 con 0x7f4f3c130350 2023-09-30T22:27:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f4132f700 1 --2- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c09d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f40b2e700 1 --2- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 0x7f4f3c09d760 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009fd0 tx=0x7f4f2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f31ffb700 1 -- 172.21.15.154:0/3222670171 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c004480 con 0x7f4f3c130350 2023-09-30T22:27:41.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f31ffb700 1 -- 172.21.15.154:0/3222670171 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c01f070 con 0x7f4f3c130350 2023-09-30T22:27:41.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.475+0000 7f4f43593700 1 -- 172.21.15.154:0/3222670171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c0094a0 con 0x7f4f3c130350 2023-09-30T22:27:41.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.476+0000 7f4f31ffb700 1 -- 172.21.15.154:0/3222670171 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0038e0 con 0x7f4f3c130350 2023-09-30T22:27:41.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.476+0000 7f4f43593700 1 -- 172.21.15.154:0/3222670171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c09fc60 con 0x7f4f3c130350 2023-09-30T22:27:41.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.476+0000 7f4f31ffb700 1 -- 172.21.15.154:0/3222670171 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f2c021030 con 0x7f4f3c130350 2023-09-30T22:27:41.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.477+0000 7f4f31ffb700 1 -- 172.21.15.154:0/3222670171 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f2c040910 con 0x7f4f3c130350 2023-09-30T22:27:41.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.477+0000 7f4f43593700 1 -- 172.21.15.154:0/3222670171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c06f730 con 0x7f4f3c130350 2023-09-30T22:27:41.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.482+0000 7f4f31ffb700 1 -- 172.21.15.154:0/3222670171 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f2c015080 con 0x7f4f3c130350 2023-09-30T22:27:41.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.567+0000 7f30732ed700 1 Processor -- start 2023-09-30T22:27:41.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.567+0000 7f30732ed700 1 -- start start 2023-09-30T22:27:41.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f30732ed700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f306c09ad40 0x7f306c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f30732ed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c1343d0 0x7f306c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f30732ed700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c09b110 con 0x7f306c133f70 2023-09-30T22:27:41.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f30732ed700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c0a3b60 con 0x7f306c09ad40 2023-09-30T22:27:41.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f30732ed700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f306c134850 con 0x7f306c1343d0 2023-09-30T22:27:41.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f3071089700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f306c09ad40 0x7f306c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f307188a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c1343d0 0x7f306c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f3071089700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f306c09ad40 0x7f306c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53028/0 (socket says 172.21.15.154:53028) 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f307188a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c1343d0 0x7f306c0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34808/0 (socket says 172.21.15.154:34808) 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f3071089700 1 -- 172.21.15.154:0/3422196604 learned_addr learned my addr 172.21.15.154:0/3422196604 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f3071089700 1 -- 172.21.15.154:0/3422196604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c1343d0 msgr2=0x7f306c0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f3071089700 1 --2- 172.21.15.154:0/3422196604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c1343d0 0x7f306c0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f3071089700 1 -- 172.21.15.154:0/3422196604 >> v1:172.21.15.154:6789/0 conn(0x7f306c133f70 legacy=0x7f306c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f3071089700 1 -- 172.21.15.154:0/3422196604 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c0a2fa0 con 0x7f306c09ad40 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f307188a700 1 --2- 172.21.15.154:0/3422196604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c1343d0 0x7f306c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.568+0000 7f3071089700 1 --2- 172.21.15.154:0/3422196604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c09ad40 0x7f306c133a30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f30680098f0 tx=0x7f3068009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841f7864cbb68d9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f3063fff700 1 -- 172.21.15.154:0/3422196604 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068011830 con 0x7f306c09ad40 2023-09-30T22:27:41.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f3063fff700 1 -- 172.21.15.154:0/3422196604 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3068011990 con 0x7f306c09ad40 2023-09-30T22:27:41.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f3063fff700 1 -- 172.21.15.154:0/3422196604 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068011d20 con 0x7f306c09ad40 2023-09-30T22:27:41.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f30732ed700 1 -- 172.21.15.154:0/3422196604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c09ad40 msgr2=0x7f306c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f30732ed700 1 --2- 172.21.15.154:0/3422196604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c09ad40 0x7f306c133a30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f30680098f0 tx=0x7f3068009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:41.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f30732ed700 1 -- 172.21.15.154:0/3422196604 shutdown_connections 2023-09-30T22:27:41.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f30732ed700 1 --2- 172.21.15.154:0/3422196604 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c1343d0 0x7f306c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f30732ed700 1 --2- 172.21.15.154:0/3422196604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c09ad40 0x7f306c133a30 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f30732ed700 1 -- 172.21.15.154:0/3422196604 >> 172.21.15.154:0/3422196604 conn(0x7f306c099c40 msgr2=0x7f306c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f30732ed700 1 -- 172.21.15.154:0/3422196604 shutdown_connections 2023-09-30T22:27:41.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.569+0000 7f30732ed700 1 -- 172.21.15.154:0/3422196604 wait complete. 2023-09-30T22:27:41.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.570+0000 7f30732ed700 1 Processor -- start 2023-09-30T22:27:41.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.570+0000 7f30732ed700 1 -- start start 2023-09-30T22:27:41.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.570+0000 7f30732ed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f306c09ad40 0x7f306c1202a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.570+0000 7f30732ed700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c133f70 0x7f306c1207e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f30732ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c1343d0 0x7f306c120d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f30732ed700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c121eb0 con 0x7f306c1343d0 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f30732ed700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1224d0 con 0x7f306c09ad40 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f30732ed700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f306c123100 con 0x7f306c133f70 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f3071089700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f306c09ad40 0x7f306c1202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f3070888700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c133f70 0x7f306c1207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f3071089700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f306c09ad40 0x7f306c1202a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44456/0 (socket says 172.21.15.154:44456) 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f3071089700 1 -- 172.21.15.154:0/572765859 learned_addr learned my addr 172.21.15.154:0/572765859 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f307188a700 1 --2- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c1343d0 0x7f306c120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f307188a700 1 -- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c133f70 msgr2=0x7f306c1207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f307188a700 1 --2- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c133f70 0x7f306c1207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f307188a700 1 -- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f306c09ad40 msgr2=0x7f306c1202a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f307188a700 1 --2- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f306c09ad40 0x7f306c1202a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f307188a700 1 -- 172.21.15.154:0/572765859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064009a70 con 0x7f306c1343d0 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f3071089700 1 --2- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f306c09ad40 0x7f306c1202a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f307188a700 1 --2- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c1343d0 0x7f306c120d20 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f3064009e50 tx=0x7f306400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f3061ffb700 1 -- 172.21.15.154:0/572765859 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400ca90 con 0x7f306c1343d0 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f3061ffb700 1 -- 172.21.15.154:0/572765859 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306400f040 con 0x7f306c1343d0 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f3061ffb700 1 -- 172.21.15.154:0/572765859 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400ce50 con 0x7f306c1343d0 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.571+0000 7f30732ed700 1 -- 172.21.15.154:0/572765859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3068009550 con 0x7f306c1343d0 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.572+0000 7f30732ed700 1 -- 172.21.15.154:0/572765859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c0a44e0 con 0x7f306c1343d0 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.572+0000 7f3061ffb700 1 -- 172.21.15.154:0/572765859 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3064014480 con 0x7f306c1343d0 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.572+0000 7f3061ffb700 1 -- 172.21.15.154:0/572765859 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f306403fc90 con 0x7f306c1343d0 2023-09-30T22:27:41.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.573+0000 7f30732ed700 1 -- 172.21.15.154:0/572765859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c0a5180 con 0x7f306c1343d0 2023-09-30T22:27:41.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.577+0000 7f3061ffb700 1 -- 172.21.15.154:0/572765859 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3064012930 con 0x7f306c1343d0 2023-09-30T22:27:41.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.680+0000 7f4f43593700 1 -- 172.21.15.154:0/3222670171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f3c11dd60 con 0x7f4f3c130350 2023-09-30T22:27:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.680+0000 7f4f31ffb700 1 -- 172.21.15.154:0/3222670171 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f2c003a40 con 0x7f4f3c130350 2023-09-30T22:27:41.680 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.683+0000 7f4f43593700 1 -- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 msgr2=0x7f4f3c09d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.683+0000 7f4f43593700 1 --2- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 0x7f4f3c09d760 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009fd0 tx=0x7f4f2c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.683+0000 7f4f43593700 1 -- 172.21.15.154:0/3222670171 shutdown_connections 2023-09-30T22:27:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.683+0000 7f4f43593700 1 --2- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4f3c130ce0 0x7f4f3c09dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.683+0000 7f4f43593700 1 --2- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f3c12d280 0x7f4f3c09d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.683+0000 7f4f43593700 1 --2- 172.21.15.154:0/3222670171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f3c130350 0x7f4f3c09d760 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.683+0000 7f4f43593700 1 -- 172.21.15.154:0/3222670171 >> 172.21.15.154:0/3222670171 conn(0x7f4f3c0a2980 msgr2=0x7f4f3c1b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.683+0000 7f4f43593700 1 -- 172.21.15.154:0/3222670171 shutdown_connections 2023-09-30T22:27:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.683+0000 7f4f43593700 1 -- 172.21.15.154:0/3222670171 wait complete. 2023-09-30T22:27:41.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:41.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.722+0000 7f19fc0c1700 1 Processor -- start 2023-09-30T22:27:41.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fc0c1700 1 -- start start 2023-09-30T22:27:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fc0c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a0a70 0x7f19f40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fc0c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a1380 0x7f19f4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fc0c1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19f4133f50 0x7f19f41343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fc0c1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f409e9d0 con 0x7f19f4133f50 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fc0c1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f409dc00 con 0x7f19f40a1380 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fc0c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19f409dec0 con 0x7f19f40a0a70 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f965c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a1380 0x7f19f4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fa65e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19f4133f50 0x7f19f41343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f9e5d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a0a70 0x7f19f40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f965c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a1380 0x7f19f4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44464/0 (socket says 172.21.15.154:44464) 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fa65e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19f4133f50 0x7f19f41343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53040/0 (socket says 172.21.15.154:53040) 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f965c700 1 -- 172.21.15.154:0/2025666450 learned_addr learned my addr 172.21.15.154:0/2025666450 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f965c700 1 -- 172.21.15.154:0/2025666450 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a0a70 msgr2=0x7f19f40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f965c700 1 --2- 172.21.15.154:0/2025666450 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a0a70 0x7f19f40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f965c700 1 -- 172.21.15.154:0/2025666450 >> v2:172.21.15.154:3300/0 conn(0x7f19f4133f50 msgr2=0x7f19f41343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f965c700 1 --2- 172.21.15.154:0/2025666450 >> v2:172.21.15.154:3300/0 conn(0x7f19f4133f50 0x7f19f41343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f965c700 1 -- 172.21.15.154:0/2025666450 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f409e6a0 con 0x7f19f40a1380 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19f9e5d700 1 --2- 172.21.15.154:0/2025666450 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a0a70 0x7f19f40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.723+0000 7f19fa65e700 1 --2- 172.21.15.154:0/2025666450 >> v2:172.21.15.154:3300/0 conn(0x7f19f4133f50 0x7f19f41343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19f965c700 1 --2- 172.21.15.154:0/2025666450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a1380 0x7f19f4133a10 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f19e40098f0 tx=0x7f19e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=133cf7aa425c2c2c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19f8e5b700 1 -- 172.21.15.154:0/2025666450 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4011830 con 0x7f19f40a1380 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19f8e5b700 1 -- 172.21.15.154:0/2025666450 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4011990 con 0x7f19f40a1380 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19f8e5b700 1 -- 172.21.15.154:0/2025666450 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4011d20 con 0x7f19f40a1380 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19fc0c1700 1 -- 172.21.15.154:0/2025666450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a1380 msgr2=0x7f19f4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19fc0c1700 1 --2- 172.21.15.154:0/2025666450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a1380 0x7f19f4133a10 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f19e40098f0 tx=0x7f19e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19fc0c1700 1 -- 172.21.15.154:0/2025666450 shutdown_connections 2023-09-30T22:27:41.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19fc0c1700 1 --2- 172.21.15.154:0/2025666450 >> v2:172.21.15.154:3300/0 conn(0x7f19f4133f50 0x7f19f41343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19fc0c1700 1 --2- 172.21.15.154:0/2025666450 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a0a70 0x7f19f40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19fc0c1700 1 --2- 172.21.15.154:0/2025666450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a1380 0x7f19f4133a10 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19fc0c1700 1 -- 172.21.15.154:0/2025666450 >> 172.21.15.154:0/2025666450 conn(0x7f19f40a6610 msgr2=0x7f19f40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19fc0c1700 1 -- 172.21.15.154:0/2025666450 shutdown_connections 2023-09-30T22:27:41.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.724+0000 7f19fc0c1700 1 -- 172.21.15.154:0/2025666450 wait complete. 2023-09-30T22:27:41.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.725+0000 7f19fc0c1700 1 Processor -- start 2023-09-30T22:27:41.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.725+0000 7f19fc0c1700 1 -- start start 2023-09-30T22:27:41.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19fc0c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a0a70 0x7f19f41225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19fc0c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a1380 0x7f19f4122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19fc0c1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19f4133f50 0x7f19f4123020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19fc0c1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40a03e0 con 0x7f19f4133f50 2023-09-30T22:27:41.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19fc0c1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40a5050 con 0x7f19f40a0a70 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19fc0c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4124f40 con 0x7f19f40a1380 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f965c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a1380 0x7f19f4122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f965c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a1380 0x7f19f4122ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34838/0 (socket says 172.21.15.154:34838) 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f965c700 1 -- 172.21.15.154:0/644804776 learned_addr learned my addr 172.21.15.154:0/644804776 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f9e5d700 1 --2- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a0a70 0x7f19f41225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19fa65e700 1 --2- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19f4133f50 0x7f19f4123020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f965c700 1 -- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a0a70 msgr2=0x7f19f41225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f965c700 1 --2- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a0a70 0x7f19f41225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f965c700 1 -- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19f4133f50 msgr2=0x7f19f4123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f965c700 1 --2- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19f4133f50 0x7f19f4123020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f965c700 1 -- 172.21.15.154:0/644804776 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f00094a0 con 0x7f19f40a1380 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.726+0000 7f19f965c700 1 --2- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a1380 0x7f19f4122ae0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009c40 tx=0x7f19e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.727+0000 7f19ea7fc700 1 -- 172.21.15.154:0/644804776 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4004240 con 0x7f19f40a1380 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.727+0000 7f19ea7fc700 1 -- 172.21.15.154:0/644804776 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e401f070 con 0x7f19f40a1380 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.727+0000 7f19fc0c1700 1 -- 172.21.15.154:0/644804776 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec009a70 con 0x7f19f40a1380 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.727+0000 7f19ea7fc700 1 -- 172.21.15.154:0/644804776 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e40045e0 con 0x7f19f40a1380 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.727+0000 7f19fc0c1700 1 -- 172.21.15.154:0/644804776 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e4009550 con 0x7f19f40a1380 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.727+0000 7f19ea7fc700 1 -- 172.21.15.154:0/644804776 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19e4021030 con 0x7f19f40a1380 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.728+0000 7f19ea7fc700 1 -- 172.21.15.154:0/644804776 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f19e40408b0 con 0x7f19f40a1380 2023-09-30T22:27:41.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.728+0000 7f19d7fff700 1 -- 172.21.15.154:0/644804776 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f404f2a0 con 0x7f19f40a1380 2023-09-30T22:27:41.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.736+0000 7f19ea7fc700 1 -- 172.21.15.154:0/644804776 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19e4015080 con 0x7f19f40a1380 2023-09-30T22:27:41.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.776+0000 7f30732ed700 1 -- 172.21.15.154:0/572765859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f306c09c7e0 con 0x7f306c1343d0 2023-09-30T22:27:41.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.777+0000 7f3061ffb700 1 -- 172.21.15.154:0/572765859 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3064012340 con 0x7f306c1343d0 2023-09-30T22:27:41.777 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:41.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.779+0000 7f30732ed700 1 -- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c1343d0 msgr2=0x7f306c120d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.779+0000 7f30732ed700 1 --2- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c1343d0 0x7f306c120d20 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f3064009e50 tx=0x7f306400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.779+0000 7f30732ed700 1 -- 172.21.15.154:0/572765859 shutdown_connections 2023-09-30T22:27:41.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.779+0000 7f30732ed700 1 --2- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f306c1343d0 0x7f306c120d20 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.779+0000 7f30732ed700 1 --2- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f306c09ad40 0x7f306c1202a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.779+0000 7f30732ed700 1 --2- 172.21.15.154:0/572765859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f306c133f70 0x7f306c1207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.779+0000 7f30732ed700 1 -- 172.21.15.154:0/572765859 >> 172.21.15.154:0/572765859 conn(0x7f306c099c40 msgr2=0x7f306c1bb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.779+0000 7f30732ed700 1 -- 172.21.15.154:0/572765859 shutdown_connections 2023-09-30T22:27:41.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.779+0000 7f30732ed700 1 -- 172.21.15.154:0/572765859 wait complete. 2023-09-30T22:27:41.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:41.812 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:41.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.934+0000 7f19d7fff700 1 -- 172.21.15.154:0/644804776 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f19f40a4160 con 0x7f19f40a1380 2023-09-30T22:27:41.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.935+0000 7f19ea7fc700 1 -- 172.21.15.154:0/644804776 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19e40199a0 con 0x7f19f40a1380 2023-09-30T22:27:41.935 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:41.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.937+0000 7f19d7fff700 1 -- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a1380 msgr2=0x7f19f4122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.937+0000 7f19d7fff700 1 --2- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a1380 0x7f19f4122ae0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009c40 tx=0x7f19e4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:41.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.937+0000 7f19d7fff700 1 -- 172.21.15.154:0/644804776 shutdown_connections 2023-09-30T22:27:41.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.937+0000 7f19d7fff700 1 --2- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19f4133f50 0x7f19f4123020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.937+0000 7f19d7fff700 1 --2- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19f40a0a70 0x7f19f41225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.937+0000 7f19d7fff700 1 --2- 172.21.15.154:0/644804776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f19f40a1380 0x7f19f4122ae0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.937+0000 7f19d7fff700 1 -- 172.21.15.154:0/644804776 >> 172.21.15.154:0/644804776 conn(0x7f19f40a6610 msgr2=0x7f19f411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.937+0000 7f19d7fff700 1 -- 172.21.15.154:0/644804776 shutdown_connections 2023-09-30T22:27:41.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.937+0000 7f19d7fff700 1 -- 172.21.15.154:0/644804776 wait complete. 2023-09-30T22:27:41.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.961+0000 7fa72784a700 1 Processor -- start 2023-09-30T22:27:41.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.961+0000 7fa72784a700 1 -- start start 2023-09-30T22:27:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa72784a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa720133ad0 0x7fa720133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa72784a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720130bc0 0x7fa72013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa72784a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72006b2d0 con 0x7fa7201300a0 2023-09-30T22:27:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa72784a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa720133610 con 0x7fa720133ad0 2023-09-30T22:27:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa7255e6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa720133ad0 0x7fa720133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa725de7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720130bc0 0x7fa72013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa72784a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa72009a500 con 0x7fa720130bc0 2023-09-30T22:27:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa724de5700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa7201300a0 0x7fa7201304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37488/0 (socket says 172.21.15.154:37488) 2023-09-30T22:27:41.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa724de5700 1 -- 172.21.15.154:0/2668564027 learned_addr learned my addr 172.21.15.154:0/2668564027 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa7255e6700 1 -- 172.21.15.154:0/2668564027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720130bc0 msgr2=0x7fa72013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa7255e6700 1 --2- 172.21.15.154:0/2668564027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720130bc0 0x7fa72013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa7255e6700 1 -- 172.21.15.154:0/2668564027 >> v1:172.21.15.154:6789/0 conn(0x7fa7201300a0 legacy=0x7fa7201304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa7255e6700 1 -- 172.21.15.154:0/2668564027 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7201338b0 con 0x7fa720133ad0 2023-09-30T22:27:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.962+0000 7fa725de7700 1 --2- 172.21.15.154:0/2668564027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720130bc0 0x7fa72013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa7255e6700 1 --2- 172.21.15.154:0/2668564027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720133ad0 0x7fa720133ea0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fa714009840 tx=0x7fa714009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbf7b2b6b618e46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa713fff700 1 -- 172.21.15.154:0/2668564027 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714011830 con 0x7fa720133ad0 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa713fff700 1 -- 172.21.15.154:0/2668564027 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa714011990 con 0x7fa720133ad0 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa713fff700 1 -- 172.21.15.154:0/2668564027 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714011d20 con 0x7fa720133ad0 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa72784a700 1 -- 172.21.15.154:0/2668564027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720133ad0 msgr2=0x7fa720133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa72784a700 1 --2- 172.21.15.154:0/2668564027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720133ad0 0x7fa720133ea0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fa714009840 tx=0x7fa714009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa72784a700 1 -- 172.21.15.154:0/2668564027 shutdown_connections 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa72784a700 1 --2- 172.21.15.154:0/2668564027 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720130bc0 0x7fa72013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa72784a700 1 --2- 172.21.15.154:0/2668564027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720133ad0 0x7fa720133ea0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa72784a700 1 -- 172.21.15.154:0/2668564027 >> 172.21.15.154:0/2668564027 conn(0x7fa720099c40 msgr2=0x7fa7200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa72784a700 1 -- 172.21.15.154:0/2668564027 shutdown_connections 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.963+0000 7fa72784a700 1 -- 172.21.15.154:0/2668564027 wait complete. 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.964+0000 7fa72784a700 1 Processor -- start 2023-09-30T22:27:41.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.964+0000 7fa72784a700 1 -- start start 2023-09-30T22:27:41.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa72784a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7201300a0 0x7fa72011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa72784a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720130bc0 0x7fa72011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa72784a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720133ad0 0x7fa72011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa72784a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72011f930 con 0x7fa720130bc0 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa72784a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa720120160 con 0x7fa7201300a0 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa72784a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa72011fb20 con 0x7fa720133ad0 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa724de5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720130bc0 0x7fa72011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa725de7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720133ad0 0x7fa72011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa7255e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7201300a0 0x7fa72011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa724de5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720130bc0 0x7fa72011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53056/0 (socket says 172.21.15.154:53056) 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa725de7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720133ad0 0x7fa72011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34858/0 (socket says 172.21.15.154:34858) 2023-09-30T22:27:41.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa724de5700 1 -- 172.21.15.154:0/2427028250 learned_addr learned my addr 172.21.15.154:0/2427028250 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa724de5700 1 -- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720133ad0 msgr2=0x7fa72011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa724de5700 1 --2- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720133ad0 0x7fa72011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa724de5700 1 -- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7201300a0 msgr2=0x7fa72011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa724de5700 1 --2- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7201300a0 0x7fa72011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa724de5700 1 -- 172.21.15.154:0/2427028250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718009a70 con 0x7fa720130bc0 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa7255e6700 1 --2- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7201300a0 0x7fa72011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa724de5700 1 --2- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720130bc0 0x7fa72011df80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c520 tx=0x7fa71c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.965+0000 7fa711ffb700 1 -- 172.21.15.154:0/2427028250 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c005d70 con 0x7fa720130bc0 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.966+0000 7fa711ffb700 1 -- 172.21.15.154:0/2427028250 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c0070d0 con 0x7fa720130bc0 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.966+0000 7fa72784a700 1 -- 172.21.15.154:0/2427028250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7140094a0 con 0x7fa720130bc0 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.966+0000 7fa711ffb700 1 -- 172.21.15.154:0/2427028250 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c007440 con 0x7fa720130bc0 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.966+0000 7fa72784a700 1 -- 172.21.15.154:0/2427028250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72012dd00 con 0x7fa720130bc0 2023-09-30T22:27:41.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.966+0000 7fa711ffb700 1 -- 172.21.15.154:0/2427028250 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa71c0075a0 con 0x7fa720130bc0 2023-09-30T22:27:41.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.966+0000 7fa711ffb700 1 -- 172.21.15.154:0/2427028250 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa71c03ea20 con 0x7fa720130bc0 2023-09-30T22:27:41.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.967+0000 7fa72784a700 1 -- 172.21.15.154:0/2427028250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72009cb20 con 0x7fa720130bc0 2023-09-30T22:27:41.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:41.972+0000 7fa711ffb700 1 -- 172.21.15.154:0/2427028250 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa71c017020 con 0x7fa720130bc0 2023-09-30T22:27:42.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.157+0000 7fa72784a700 1 -- 172.21.15.154:0/2427028250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa72012d970 con 0x7fa720130bc0 2023-09-30T22:27:42.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.157+0000 7fa711ffb700 1 -- 172.21.15.154:0/2427028250 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa71c019d20 con 0x7fa720130bc0 2023-09-30T22:27:42.157 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:42.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.159+0000 7fa72784a700 1 -- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720130bc0 msgr2=0x7fa72011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.159+0000 7fa72784a700 1 --2- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720130bc0 0x7fa72011df80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c520 tx=0x7fa71c00c830 comp rx=0 tx=0).stop 2023-09-30T22:27:42.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.159+0000 7fa72784a700 1 -- 172.21.15.154:0/2427028250 shutdown_connections 2023-09-30T22:27:42.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.159+0000 7fa72784a700 1 --2- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa720133ad0 0x7fa72011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.159+0000 7fa72784a700 1 --2- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7201300a0 0x7fa72011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.159+0000 7fa72784a700 1 --2- 172.21.15.154:0/2427028250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa720130bc0 0x7fa72011df80 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.159+0000 7fa72784a700 1 -- 172.21.15.154:0/2427028250 >> 172.21.15.154:0/2427028250 conn(0x7fa720099c40 msgr2=0x7fa72012f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:42.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.159+0000 7fa72784a700 1 -- 172.21.15.154:0/2427028250 shutdown_connections 2023-09-30T22:27:42.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.159+0000 7fa72784a700 1 -- 172.21.15.154:0/2427028250 wait complete. 2023-09-30T22:27:42.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:42.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:42.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.825+0000 7feb12c3f700 1 Processor -- start 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.825+0000 7feb12c3f700 1 -- start start 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb12c3f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb0c06a770 0x7feb0c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb12c3f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c131ec0 0x7feb0c139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb12c3f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c09da80 con 0x7feb0c06b080 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb12c3f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c09dce0 con 0x7feb0c06a770 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb12c3f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c09eb20 con 0x7feb0c131ec0 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb111dc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c131ec0 0x7feb0c139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb111dc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c131ec0 0x7feb0c139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34868/0 (socket says 172.21.15.154:34868) 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb111dc700 1 -- 172.21.15.154:0/641613249 learned_addr learned my addr 172.21.15.154:0/641613249 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb109db700 1 --2- 172.21.15.154:0/641613249 >> v2:172.21.15.154:3300/0 conn(0x7feb0c06a770 0x7feb0c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb111dc700 1 -- 172.21.15.154:0/641613249 >> v2:172.21.15.154:3300/0 conn(0x7feb0c06a770 msgr2=0x7feb0c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb111dc700 1 --2- 172.21.15.154:0/641613249 >> v2:172.21.15.154:3300/0 conn(0x7feb0c06a770 0x7feb0c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb111dc700 1 -- 172.21.15.154:0/641613249 >> v1:172.21.15.154:6789/0 conn(0x7feb0c06b080 legacy=0x7feb0c1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb111dc700 1 -- 172.21.15.154:0/641613249 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c09d860 con 0x7feb0c131ec0 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb109db700 1 --2- 172.21.15.154:0/641613249 >> v2:172.21.15.154:3300/0 conn(0x7feb0c06a770 0x7feb0c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.826+0000 7feb111dc700 1 --2- 172.21.15.154:0/641613249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c131ec0 0x7feb0c139c20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7feb04009e50 tx=0x7feb0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa03d8179cb338e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb0b7fe700 1 -- 172.21.15.154:0/641613249 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400e070 con 0x7feb0c131ec0 2023-09-30T22:27:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb0b7fe700 1 -- 172.21.15.154:0/641613249 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0400b910 con 0x7feb0c131ec0 2023-09-30T22:27:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb0b7fe700 1 -- 172.21.15.154:0/641613249 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400bcc0 con 0x7feb0c131ec0 2023-09-30T22:27:42.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb12c3f700 1 -- 172.21.15.154:0/641613249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c131ec0 msgr2=0x7feb0c139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb12c3f700 1 --2- 172.21.15.154:0/641613249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c131ec0 0x7feb0c139c20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7feb04009e50 tx=0x7feb0400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb12c3f700 1 -- 172.21.15.154:0/641613249 shutdown_connections 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb12c3f700 1 --2- 172.21.15.154:0/641613249 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c131ec0 0x7feb0c139c20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb12c3f700 1 --2- 172.21.15.154:0/641613249 >> v2:172.21.15.154:3300/0 conn(0x7feb0c06a770 0x7feb0c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb12c3f700 1 -- 172.21.15.154:0/641613249 >> 172.21.15.154:0/641613249 conn(0x7feb0c099c40 msgr2=0x7feb0c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb12c3f700 1 -- 172.21.15.154:0/641613249 shutdown_connections 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.827+0000 7feb12c3f700 1 -- 172.21.15.154:0/641613249 wait complete. 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.828+0000 7feb12c3f700 1 Processor -- start 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.828+0000 7feb12c3f700 1 -- start start 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb12c3f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c06a770 0x7feb0c1c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb12c3f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb0c06b080 0x7feb0c1c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb12c3f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0c131ec0 0x7feb0c1c0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb12c3f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c11eab0 con 0x7feb0c131ec0 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb12c3f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c11f800 con 0x7feb0c06b080 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb12c3f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c1c4c20 con 0x7feb0c06a770 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb111dc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0c131ec0 0x7feb0c1c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb109db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c06a770 0x7feb0c1c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb109db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c06a770 0x7feb0c1c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34884/0 (socket says 172.21.15.154:34884) 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb0bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb0c06b080 0x7feb0c1c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb111dc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0c131ec0 0x7feb0c1c0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53070/0 (socket says 172.21.15.154:53070) 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb109db700 1 -- 172.21.15.154:0/2580448882 learned_addr learned my addr 172.21.15.154:0/2580448882 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb109db700 1 -- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb0c06b080 msgr2=0x7feb0c1c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb109db700 1 --2- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb0c06b080 0x7feb0c1c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb109db700 1 -- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0c131ec0 msgr2=0x7feb0c1c0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb109db700 1 --2- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0c131ec0 0x7feb0c1c0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb109db700 1 -- 172.21.15.154:0/2580448882 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb000094a0 con 0x7feb0c06a770 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.829+0000 7feb111dc700 1 --2- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0c131ec0 0x7feb0c1c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.830+0000 7feb109db700 1 --2- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c06a770 0x7feb0c1c41a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7feb0000ec10 tx=0x7feb0000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.830+0000 7feb097fa700 1 -- 172.21.15.154:0/2580448882 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0000c850 con 0x7feb0c06a770 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.830+0000 7feb097fa700 1 -- 172.21.15.154:0/2580448882 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0000c9b0 con 0x7feb0c06a770 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.830+0000 7feb097fa700 1 -- 172.21.15.154:0/2580448882 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0000cd20 con 0x7feb0c06a770 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.830+0000 7feb12c3f700 1 -- 172.21.15.154:0/2580448882 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb04009b30 con 0x7feb0c06a770 2023-09-30T22:27:42.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.830+0000 7feb12c3f700 1 -- 172.21.15.154:0/2580448882 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c11e660 con 0x7feb0c06a770 2023-09-30T22:27:42.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.830+0000 7feb097fa700 1 -- 172.21.15.154:0/2580448882 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb00013470 con 0x7feb0c06a770 2023-09-30T22:27:42.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.831+0000 7feb097fa700 1 -- 172.21.15.154:0/2580448882 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb0003f780 con 0x7feb0c06a770 2023-09-30T22:27:42.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.831+0000 7feb12c3f700 1 -- 172.21.15.154:0/2580448882 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c04f2a0 con 0x7feb0c06a770 2023-09-30T22:27:42.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.836+0000 7feb097fa700 1 -- 172.21.15.154:0/2580448882 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb00013720 con 0x7feb0c06a770 2023-09-30T22:27:42.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.920+0000 7ff629971700 1 Processor -- start 2023-09-30T22:27:42.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff629971700 1 -- start start 2023-09-30T22:27:42.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff629971700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff624067c10 0x7ff624133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff629971700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff624133fa0 0x7ff6240a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff629971700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62409a360 con 0x7ff6241343d0 2023-09-30T22:27:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff629971700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff624067fe0 con 0x7ff624133fa0 2023-09-30T22:27:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff629971700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62409a880 con 0x7ff624067c10 2023-09-30T22:27:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff6227fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff624133fa0 0x7ff6240a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff6227fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff624133fa0 0x7ff6240a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53074/0 (socket says 172.21.15.154:53074) 2023-09-30T22:27:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff6227fc700 1 -- 172.21.15.154:0/3160755284 learned_addr learned my addr 172.21.15.154:0/3160755284 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:42.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff6237fe700 1 --1- 172.21.15.154:0/3160755284 >> v1:172.21.15.154:6789/0 conn(0x7ff6241343d0 0x7ff6240a0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37506/0 (socket says 172.21.15.154:37506) 2023-09-30T22:27:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff622ffd700 1 --2- 172.21.15.154:0/3160755284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff624067c10 0x7ff624133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff6227fc700 1 -- 172.21.15.154:0/3160755284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff624067c10 msgr2=0x7ff624133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff6227fc700 1 --2- 172.21.15.154:0/3160755284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff624067c10 0x7ff624133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff6227fc700 1 -- 172.21.15.154:0/3160755284 >> v1:172.21.15.154:6789/0 conn(0x7ff6241343d0 legacy=0x7ff6240a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff6227fc700 1 -- 172.21.15.154:0/3160755284 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624099e00 con 0x7ff624133fa0 2023-09-30T22:27:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.921+0000 7ff622ffd700 1 --2- 172.21.15.154:0/3160755284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff624067c10 0x7ff624133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:42.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff6227fc700 1 --2- 172.21.15.154:0/3160755284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 0x7ff6240a08e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7ff6140098f0 tx=0x7ff614009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c633081167fbfb6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff621ffb700 1 -- 172.21.15.154:0/3160755284 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011830 con 0x7ff624133fa0 2023-09-30T22:27:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff621ffb700 1 -- 172.21.15.154:0/3160755284 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff614011990 con 0x7ff624133fa0 2023-09-30T22:27:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff621ffb700 1 -- 172.21.15.154:0/3160755284 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011d20 con 0x7ff624133fa0 2023-09-30T22:27:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff629971700 1 -- 172.21.15.154:0/3160755284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 msgr2=0x7ff6240a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff629971700 1 --2- 172.21.15.154:0/3160755284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 0x7ff6240a08e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7ff6140098f0 tx=0x7ff614009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff629971700 1 -- 172.21.15.154:0/3160755284 shutdown_connections 2023-09-30T22:27:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff629971700 1 --2- 172.21.15.154:0/3160755284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff624067c10 0x7ff624133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff629971700 1 --2- 172.21.15.154:0/3160755284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 0x7ff6240a08e0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff629971700 1 -- 172.21.15.154:0/3160755284 >> 172.21.15.154:0/3160755284 conn(0x7ff6240a2980 msgr2=0x7ff6240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:42.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff629971700 1 -- 172.21.15.154:0/3160755284 shutdown_connections 2023-09-30T22:27:42.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.922+0000 7ff629971700 1 -- 172.21.15.154:0/3160755284 wait complete. 2023-09-30T22:27:42.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.923+0000 7ff629971700 1 Processor -- start 2023-09-30T22:27:42.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff629971700 1 -- start start 2023-09-30T22:27:42.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff629971700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff624067c10 0x7ff62411ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff629971700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 0x7ff62411cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff629971700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6241343d0 0x7ff62411d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:42.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff629971700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62411def0 con 0x7ff624133fa0 2023-09-30T22:27:42.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff629971700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62411f7b0 con 0x7ff6241343d0 2023-09-30T22:27:42.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff629971700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff62411e670 con 0x7ff624067c10 2023-09-30T22:27:42.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff6227fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 0x7ff62411cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff622ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff624067c10 0x7ff62411ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff6227fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 0x7ff62411cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53078/0 (socket says 172.21.15.154:53078) 2023-09-30T22:27:42.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff6227fc700 1 -- 172.21.15.154:0/505223676 learned_addr learned my addr 172.21.15.154:0/505223676 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:42.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff6237fe700 1 --2- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6241343d0 0x7ff62411d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff6227fc700 1 -- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff624067c10 msgr2=0x7ff62411ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff6227fc700 1 --2- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff624067c10 0x7ff62411ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff6227fc700 1 -- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6241343d0 msgr2=0x7ff62411d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff6227fc700 1 --2- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6241343d0 0x7ff62411d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.924+0000 7ff6227fc700 1 -- 172.21.15.154:0/505223676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0094a0 con 0x7ff624133fa0 2023-09-30T22:27:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.925+0000 7ff6227fc700 1 --2- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 0x7ff62411cf60 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ff614009c40 tx=0x7ff614004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.925+0000 7ff61bfff700 1 -- 172.21.15.154:0/505223676 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614004400 con 0x7ff624133fa0 2023-09-30T22:27:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.925+0000 7ff61bfff700 1 -- 172.21.15.154:0/505223676 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61401f070 con 0x7ff624133fa0 2023-09-30T22:27:42.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.925+0000 7ff61bfff700 1 -- 172.21.15.154:0/505223676 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6140038e0 con 0x7ff624133fa0 2023-09-30T22:27:42.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.925+0000 7ff629971700 1 -- 172.21.15.154:0/505223676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff614009550 con 0x7ff624133fa0 2023-09-30T22:27:42.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.925+0000 7ff629971700 1 -- 172.21.15.154:0/505223676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6241331e0 con 0x7ff624133fa0 2023-09-30T22:27:42.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.925+0000 7ff61bfff700 1 -- 172.21.15.154:0/505223676 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff614021030 con 0x7ff624133fa0 2023-09-30T22:27:42.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.926+0000 7ff61bfff700 1 -- 172.21.15.154:0/505223676 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff614040a50 con 0x7ff624133fa0 2023-09-30T22:27:42.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.926+0000 7ff629971700 1 -- 172.21.15.154:0/505223676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62404f2a0 con 0x7ff624133fa0 2023-09-30T22:27:42.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:42.930+0000 7ff61bfff700 1 -- 172.21.15.154:0/505223676 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff614004560 con 0x7ff624133fa0 2023-09-30T22:27:42.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.032+0000 7feb12c3f700 1 -- 172.21.15.154:0/2580448882 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feb0c11f1c0 con 0x7feb0c06a770 2023-09-30T22:27:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.032+0000 7feb097fa700 1 -- 172.21.15.154:0/2580448882 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb00021020 con 0x7feb0c06a770 2023-09-30T22:27:43.032 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.034+0000 7feb12c3f700 1 -- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c06a770 msgr2=0x7feb0c1c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.034+0000 7feb12c3f700 1 --2- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c06a770 0x7feb0c1c41a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7feb0000ec10 tx=0x7feb0000ef20 comp rx=0 tx=0).stop 2023-09-30T22:27:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.034+0000 7feb12c3f700 1 -- 172.21.15.154:0/2580448882 shutdown_connections 2023-09-30T22:27:43.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.034+0000 7feb12c3f700 1 --2- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb0c131ec0 0x7feb0c1c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.034+0000 7feb12c3f700 1 --2- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feb0c06a770 0x7feb0c1c41a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.034+0000 7feb12c3f700 1 --2- 172.21.15.154:0/2580448882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb0c06b080 0x7feb0c1c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.034+0000 7feb12c3f700 1 -- 172.21.15.154:0/2580448882 >> 172.21.15.154:0/2580448882 conn(0x7feb0c099c40 msgr2=0x7feb0c130cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.034+0000 7feb12c3f700 1 -- 172.21.15.154:0/2580448882 shutdown_connections 2023-09-30T22:27:43.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.034+0000 7feb12c3f700 1 -- 172.21.15.154:0/2580448882 wait complete. 2023-09-30T22:27:43.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:43.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.077+0000 7f15ec666700 1 Processor -- start 2023-09-30T22:27:43.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.078+0000 7f15ec666700 1 -- start start 2023-09-30T22:27:43.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.078+0000 7f15ec666700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.078+0000 7f15ec666700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e409f180 0x7f15e4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.078+0000 7f15ec666700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15e4131d70 0x7f15e4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.078+0000 7f15ec666700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e40a0920 con 0x7f15e4131d70 2023-09-30T22:27:43.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.078+0000 7f15ec666700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e409c970 con 0x7f15e409f180 2023-09-30T22:27:43.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.078+0000 7f15ec666700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e409bab0 con 0x7f15e409e870 2023-09-30T22:27:43.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9c01700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e409f180 0x7f15e4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15eac03700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15e4131d70 0x7f15e4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9c01700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e409f180 0x7f15e4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44516/0 (socket says 172.21.15.154:44516) 2023-09-30T22:27:43.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9c01700 1 -- 172.21.15.154:0/1519636101 learned_addr learned my addr 172.21.15.154:0/1519636101 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:43.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15ea402700 1 --2- 172.21.15.154:0/1519636101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9c01700 1 -- 172.21.15.154:0/1519636101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 msgr2=0x7f15e409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:43.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9c01700 1 --2- 172.21.15.154:0/1519636101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9c01700 1 -- 172.21.15.154:0/1519636101 >> v2:172.21.15.154:3300/0 conn(0x7f15e4131d70 msgr2=0x7f15e4132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:43.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9c01700 1 --2- 172.21.15.154:0/1519636101 >> v2:172.21.15.154:3300/0 conn(0x7f15e4131d70 0x7f15e4132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9c01700 1 -- 172.21.15.154:0/1519636101 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e409f9c0 con 0x7f15e409f180 2023-09-30T22:27:43.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15eac03700 1 --2- 172.21.15.154:0/1519636101 >> v2:172.21.15.154:3300/0 conn(0x7f15e4131d70 0x7f15e4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:43.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15ea402700 1 --2- 172.21.15.154:0/1519636101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:43.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9c01700 1 --2- 172.21.15.154:0/1519636101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e409f180 0x7f15e4131830 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f15d40098f0 tx=0x7f15d4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c42f2b8e58ef9ac5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:43.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.079+0000 7f15e9400700 1 -- 172.21.15.154:0/1519636101 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d4011830 con 0x7f15e409f180 2023-09-30T22:27:43.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15e9400700 1 -- 172.21.15.154:0/1519636101 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d4011990 con 0x7f15e409f180 2023-09-30T22:27:43.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15e9400700 1 -- 172.21.15.154:0/1519636101 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d4011d20 con 0x7f15e409f180 2023-09-30T22:27:43.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15ec666700 1 -- 172.21.15.154:0/1519636101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e409f180 msgr2=0x7f15e4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15ec666700 1 --2- 172.21.15.154:0/1519636101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e409f180 0x7f15e4131830 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f15d40098f0 tx=0x7f15d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:43.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15ec666700 1 -- 172.21.15.154:0/1519636101 shutdown_connections 2023-09-30T22:27:43.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15ec666700 1 --2- 172.21.15.154:0/1519636101 >> v2:172.21.15.154:3300/0 conn(0x7f15e4131d70 0x7f15e4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15ec666700 1 --2- 172.21.15.154:0/1519636101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15ec666700 1 --2- 172.21.15.154:0/1519636101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e409f180 0x7f15e4131830 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15ec666700 1 -- 172.21.15.154:0/1519636101 >> 172.21.15.154:0/1519636101 conn(0x7f15e40a4430 msgr2=0x7f15e40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:43.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15ec666700 1 -- 172.21.15.154:0/1519636101 shutdown_connections 2023-09-30T22:27:43.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.080+0000 7f15ec666700 1 -- 172.21.15.154:0/1519636101 wait complete. 2023-09-30T22:27:43.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.081+0000 7f15ec666700 1 Processor -- start 2023-09-30T22:27:43.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.081+0000 7f15ec666700 1 -- start start 2023-09-30T22:27:43.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ec666700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e41203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ec666700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15e409f180 0x7f15e4120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ec666700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e4131d70 0x7f15e4120e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ec666700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41235f0 con 0x7f15e409f180 2023-09-30T22:27:43.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ec666700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e40a2c40 con 0x7f15e4131d70 2023-09-30T22:27:43.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ec666700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4122d70 con 0x7f15e409e870 2023-09-30T22:27:43.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ea402700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e41203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ea402700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e41203e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34914/0 (socket says 172.21.15.154:34914) 2023-09-30T22:27:43.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ea402700 1 -- 172.21.15.154:0/440162736 learned_addr learned my addr 172.21.15.154:0/440162736 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:43.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15e9c01700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15e409f180 0x7f15e4120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15eac03700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e4131d70 0x7f15e4120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ea402700 1 -- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e4131d70 msgr2=0x7f15e4120e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ea402700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e4131d70 0x7f15e4120e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ea402700 1 -- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15e409f180 msgr2=0x7f15e4120920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ea402700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15e409f180 0x7f15e4120920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ea402700 1 -- 172.21.15.154:0/440162736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00094a0 con 0x7f15e409e870 2023-09-30T22:27:43.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15e9c01700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15e409f180 0x7f15e4120920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:43.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.082+0000 7f15ea402700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e41203e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f15e000ebe0 tx=0x7f15e000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:43.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.083+0000 7f15daffd700 1 -- 172.21.15.154:0/440162736 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0009780 con 0x7f15e409e870 2023-09-30T22:27:43.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.083+0000 7f15daffd700 1 -- 172.21.15.154:0/440162736 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000c850 con 0x7f15e409e870 2023-09-30T22:27:43.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.083+0000 7f15daffd700 1 -- 172.21.15.154:0/440162736 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000cbe0 con 0x7f15e409e870 2023-09-30T22:27:43.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.083+0000 7f15ec666700 1 -- 172.21.15.154:0/440162736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc009a70 con 0x7f15e409e870 2023-09-30T22:27:43.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.083+0000 7f15ec666700 1 -- 172.21.15.154:0/440162736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d4009550 con 0x7f15e409e870 2023-09-30T22:27:43.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.083+0000 7f15daffd700 1 -- 172.21.15.154:0/440162736 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15e000cd40 con 0x7f15e409e870 2023-09-30T22:27:43.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.084+0000 7f15daffd700 1 -- 172.21.15.154:0/440162736 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f15e003f730 con 0x7f15e409e870 2023-09-30T22:27:43.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.084+0000 7f15ec666700 1 -- 172.21.15.154:0/440162736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e409ac40 con 0x7f15e409e870 2023-09-30T22:27:43.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.088+0000 7f15daffd700 1 -- 172.21.15.154:0/440162736 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15e0021020 con 0x7f15e409e870 2023-09-30T22:27:43.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.126+0000 7ff629971700 1 -- 172.21.15.154:0/505223676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff62409aaa0 con 0x7ff624133fa0 2023-09-30T22:27:43.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.126+0000 7ff61bfff700 1 -- 172.21.15.154:0/505223676 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff614015020 con 0x7ff624133fa0 2023-09-30T22:27:43.129 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:43.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.128+0000 7ff629971700 1 -- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 msgr2=0x7ff62411cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.128+0000 7ff629971700 1 --2- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 0x7ff62411cf60 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ff614009c40 tx=0x7ff614004750 comp rx=0 tx=0).stop 2023-09-30T22:27:43.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.128+0000 7ff629971700 1 -- 172.21.15.154:0/505223676 shutdown_connections 2023-09-30T22:27:43.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.128+0000 7ff629971700 1 --2- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6241343d0 0x7ff62411d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.128+0000 7ff629971700 1 --2- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff624067c10 0x7ff62411ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.128+0000 7ff629971700 1 --2- 172.21.15.154:0/505223676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff624133fa0 0x7ff62411cf60 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.128+0000 7ff629971700 1 -- 172.21.15.154:0/505223676 >> 172.21.15.154:0/505223676 conn(0x7ff6240a2980 msgr2=0x7ff624131650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:43.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.129+0000 7ff629971700 1 -- 172.21.15.154:0/505223676 shutdown_connections 2023-09-30T22:27:43.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.129+0000 7ff629971700 1 -- 172.21.15.154:0/505223676 wait complete. 2023-09-30T22:27:43.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:43.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.283+0000 7f15ec666700 1 -- 172.21.15.154:0/440162736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f15e404f2a0 con 0x7f15e409e870 2023-09-30T22:27:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.283+0000 7f15daffd700 1 -- 172.21.15.154:0/440162736 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15e0017070 con 0x7f15e409e870 2023-09-30T22:27:43.283 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:43.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.285+0000 7f15ec666700 1 -- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 msgr2=0x7f15e41203e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.285+0000 7f15ec666700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e41203e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f15e000ebe0 tx=0x7f15e000eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.285+0000 7f15ec666700 1 -- 172.21.15.154:0/440162736 shutdown_connections 2023-09-30T22:27:43.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.285+0000 7f15ec666700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15e4131d70 0x7f15e4120e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.285+0000 7f15ec666700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f15e409e870 0x7f15e41203e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.285+0000 7f15ec666700 1 --2- 172.21.15.154:0/440162736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15e409f180 0x7f15e4120920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.285+0000 7f15ec666700 1 -- 172.21.15.154:0/440162736 >> 172.21.15.154:0/440162736 conn(0x7f15e40a4430 msgr2=0x7f15e409d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:43.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.286+0000 7f15ec666700 1 -- 172.21.15.154:0/440162736 shutdown_connections 2023-09-30T22:27:43.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.286+0000 7f15ec666700 1 -- 172.21.15.154:0/440162736 wait complete. 2023-09-30T22:27:43.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:43.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.305+0000 7f0648a8d700 1 Processor -- start 2023-09-30T22:27:43.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.305+0000 7f0648a8d700 1 -- start start 2023-09-30T22:27:43.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f0648a8d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f0648a8d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f0644131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f0648a8d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064409c970 con 0x7f0644131d70 2023-09-30T22:27:43.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f0648a8d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06440a0920 con 0x7f064409e870 2023-09-30T22:27:43.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f0648a8d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f064409f9c0 con 0x7f064409f180 2023-09-30T22:27:43.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f064259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f0641d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f0644131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f064259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44528/0 (socket says 172.21.15.154:44528) 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f064259c700 1 -- 172.21.15.154:0/2057876061 learned_addr learned my addr 172.21.15.154:0/2057876061 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f0642d9d700 1 --1- 172.21.15.154:0/2057876061 >> v1:172.21.15.154:6789/0 conn(0x7f0644131d70 0x7f0644138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37518/0 (socket says 172.21.15.154:37518) 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f064259c700 1 -- 172.21.15.154:0/2057876061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 msgr2=0x7f0644131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f064159a700 1 -- 172.21.15.154:0/2057876061 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257574850 0 0) 0x7f064409c970 con 0x7f0644131d70 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f064259c700 1 --2- 172.21.15.154:0/2057876061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f0644131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f064259c700 1 -- 172.21.15.154:0/2057876061 >> v1:172.21.15.154:6789/0 conn(0x7f0644131d70 legacy=0x7f0644138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f064259c700 1 -- 172.21.15.154:0/2057876061 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064409bab0 con 0x7f064409e870 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f0641d9b700 1 --2- 172.21.15.154:0/2057876061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f0644131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:43.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.306+0000 7f064259c700 1 --2- 172.21.15.154:0/2057876061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064409ec40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0638009920 tx=0x7f0638009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7975e692711362ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f064159a700 1 -- 172.21.15.154:0/2057876061 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638011830 con 0x7f064409e870 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f064159a700 1 -- 172.21.15.154:0/2057876061 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0638011990 con 0x7f064409e870 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f064159a700 1 -- 172.21.15.154:0/2057876061 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638011d20 con 0x7f064409e870 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f0648a8d700 1 -- 172.21.15.154:0/2057876061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 msgr2=0x7f064409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f0648a8d700 1 --2- 172.21.15.154:0/2057876061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064409ec40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0638009920 tx=0x7f0638009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f0648a8d700 1 -- 172.21.15.154:0/2057876061 shutdown_connections 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f0648a8d700 1 --2- 172.21.15.154:0/2057876061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064409ec40 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f0648a8d700 1 --2- 172.21.15.154:0/2057876061 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f0644131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f0648a8d700 1 -- 172.21.15.154:0/2057876061 >> 172.21.15.154:0/2057876061 conn(0x7f06440a4430 msgr2=0x7f06440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:43.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f0648a8d700 1 -- 172.21.15.154:0/2057876061 shutdown_connections 2023-09-30T22:27:43.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.307+0000 7f0648a8d700 1 -- 172.21.15.154:0/2057876061 wait complete. 2023-09-30T22:27:43.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0648a8d700 1 Processor -- start 2023-09-30T22:27:43.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0648a8d700 1 -- start start 2023-09-30T22:27:43.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0648a8d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064411d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0648a8d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f064411d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0648a8d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0644131d70 0x7f06441c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0648a8d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064411cd60 con 0x7f0644131d70 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0648a8d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0644131230 con 0x7f064409e870 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0648a8d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f064411fe20 con 0x7f064409f180 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f064259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064411d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0641d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f064411d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0641d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f064411d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34942/0 (socket says 172.21.15.154:34942) 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0641d9b700 1 -- 172.21.15.154:0/2070384837 learned_addr learned my addr 172.21.15.154:0/2070384837 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f064259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064411d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44544/0 (socket says 172.21.15.154:44544) 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0642d9d700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0644131d70 0x7f06441c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0641d9b700 1 -- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 msgr2=0x7f064411d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0641d9b700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064411d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0641d9b700 1 -- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0644131d70 msgr2=0x7f06441c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0641d9b700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0644131d70 0x7f06441c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0641d9b700 1 -- 172.21.15.154:0/2070384837 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340094a0 con 0x7f064409f180 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f064259c700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064411d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.309+0000 7f0642d9d700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0644131d70 0x7f06441c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.310+0000 7f0641d9b700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f064411d700 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f063400ebb0 tx=0x7f063400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.310+0000 7f0632ffd700 1 -- 172.21.15.154:0/2070384837 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400c850 con 0x7f064409f180 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.310+0000 7f0632ffd700 1 -- 172.21.15.154:0/2070384837 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400c9b0 con 0x7f064409f180 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.310+0000 7f0632ffd700 1 -- 172.21.15.154:0/2070384837 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400cd40 con 0x7f064409f180 2023-09-30T22:27:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.310+0000 7f0648a8d700 1 -- 172.21.15.154:0/2070384837 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0638009550 con 0x7f064409f180 2023-09-30T22:27:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.310+0000 7f0648a8d700 1 -- 172.21.15.154:0/2070384837 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064411e4b0 con 0x7f064409f180 2023-09-30T22:27:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.311+0000 7f0648a8d700 1 -- 172.21.15.154:0/2070384837 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064404f2a0 con 0x7f064409f180 2023-09-30T22:27:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.311+0000 7f0632ffd700 1 -- 172.21.15.154:0/2070384837 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0634013470 con 0x7f064409f180 2023-09-30T22:27:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.311+0000 7f0632ffd700 1 -- 172.21.15.154:0/2070384837 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f063403f750 con 0x7f064409f180 2023-09-30T22:27:43.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.316+0000 7f0632ffd700 1 -- 172.21.15.154:0/2070384837 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06340232f0 con 0x7f064409f180 2023-09-30T22:27:43.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.498+0000 7f0648a8d700 1 -- 172.21.15.154:0/2070384837 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0644120300 con 0x7f064409f180 2023-09-30T22:27:43.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.498+0000 7f0632ffd700 1 -- 172.21.15.154:0/2070384837 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0634021020 con 0x7f064409f180 2023-09-30T22:27:43.498 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:43.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.500+0000 7f0648a8d700 1 -- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 msgr2=0x7f064411d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:43.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.500+0000 7f0648a8d700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f064411d700 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f063400ebb0 tx=0x7f063400eec0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.500+0000 7f0648a8d700 1 -- 172.21.15.154:0/2070384837 shutdown_connections 2023-09-30T22:27:43.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.500+0000 7f0648a8d700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0644131d70 0x7f06441c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.500+0000 7f0648a8d700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f064409e870 0x7f064411d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.500+0000 7f0648a8d700 1 --2- 172.21.15.154:0/2070384837 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f064409f180 0x7f064411d700 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:43.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.500+0000 7f0648a8d700 1 -- 172.21.15.154:0/2070384837 >> 172.21.15.154:0/2070384837 conn(0x7f06440a4430 msgr2=0x7f06441b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:43.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.500+0000 7f0648a8d700 1 -- 172.21.15.154:0/2070384837 shutdown_connections 2023-09-30T22:27:43.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:43.500+0000 7f0648a8d700 1 -- 172.21.15.154:0/2070384837 wait complete. 2023-09-30T22:27:43.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:44.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:44.142 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:44.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.176+0000 7fd3e6b92700 1 Processor -- start 2023-09-30T22:27:44.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e6b92700 1 -- start start 2023-09-30T22:27:44.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e6b92700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3e009e870 0x7fd3e009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e6b92700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e0131f40 0x7fd3e0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e6b92700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e009c970 con 0x7fd3e009f180 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e6b92700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e00a0920 con 0x7fd3e009e870 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e6b92700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e009f9c0 con 0x7fd3e0131f40 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e492e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3e009e870 0x7fd3e009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e492e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3e009e870 0x7fd3e009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53104/0 (socket says 172.21.15.154:53104) 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e492e700 1 -- 172.21.15.154:0/565051331 learned_addr learned my addr 172.21.15.154:0/565051331 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3dffff700 1 --1- 172.21.15.154:0/565051331 >> v1:172.21.15.154:6789/0 conn(0x7fd3e009f180 0x7fd3e0131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37534/0 (socket says 172.21.15.154:37534) 2023-09-30T22:27:44.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.177+0000 7fd3e512f700 1 --2- 172.21.15.154:0/565051331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e0131f40 0x7fd3e0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e492e700 1 -- 172.21.15.154:0/565051331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e0131f40 msgr2=0x7fd3e0139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e492e700 1 --2- 172.21.15.154:0/565051331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e0131f40 0x7fd3e0139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e492e700 1 -- 172.21.15.154:0/565051331 >> v1:172.21.15.154:6789/0 conn(0x7fd3e009f180 legacy=0x7fd3e0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3df7fe700 1 -- 172.21.15.154:0/565051331 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432800153 0 0) 0x7fd3e009c970 con 0x7fd3e009f180 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e492e700 1 -- 172.21.15.154:0/565051331 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e009bab0 con 0x7fd3e009e870 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e492e700 1 --2- 172.21.15.154:0/565051331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 0x7fd3e009ec40 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40098f0 tx=0x7fd3d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f065b119884994 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3df7fe700 1 -- 172.21.15.154:0/565051331 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4011830 con 0x7fd3e009e870 2023-09-30T22:27:44.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3df7fe700 1 -- 172.21.15.154:0/565051331 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d4011990 con 0x7fd3e009e870 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3df7fe700 1 -- 172.21.15.154:0/565051331 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4011d20 con 0x7fd3e009e870 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e6b92700 1 -- 172.21.15.154:0/565051331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 msgr2=0x7fd3e009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e6b92700 1 --2- 172.21.15.154:0/565051331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 0x7fd3e009ec40 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40098f0 tx=0x7fd3d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e6b92700 1 -- 172.21.15.154:0/565051331 shutdown_connections 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e6b92700 1 --2- 172.21.15.154:0/565051331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e0131f40 0x7fd3e0139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e6b92700 1 --2- 172.21.15.154:0/565051331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 0x7fd3e009ec40 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.178+0000 7fd3e6b92700 1 -- 172.21.15.154:0/565051331 >> 172.21.15.154:0/565051331 conn(0x7fd3e00a4430 msgr2=0x7fd3e00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.179+0000 7fd3e6b92700 1 -- 172.21.15.154:0/565051331 shutdown_connections 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.179+0000 7fd3e6b92700 1 -- 172.21.15.154:0/565051331 wait complete. 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.180+0000 7fd3e6b92700 1 Processor -- start 2023-09-30T22:27:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.180+0000 7fd3e6b92700 1 -- start start 2023-09-30T22:27:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.180+0000 7fd3e6b92700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 0x7fd3e01c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.180+0000 7fd3e6b92700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e009f180 0x7fd3e01c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.180+0000 7fd3e6b92700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3e0131f40 0x7fd3e01c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.180+0000 7fd3e6b92700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e01224a0 con 0x7fd3e009e870 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.180+0000 7fd3e6b92700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e006d550 con 0x7fd3e009f180 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.180+0000 7fd3e6b92700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e0121710 con 0x7fd3e0131f40 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3dffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e009f180 0x7fd3e01c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e512f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3e0131f40 0x7fd3e01c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e512f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3e0131f40 0x7fd3e01c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34946/0 (socket says 172.21.15.154:34946) 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3dffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e009f180 0x7fd3e01c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44552/0 (socket says 172.21.15.154:44552) 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e512f700 1 -- 172.21.15.154:0/2660647968 learned_addr learned my addr 172.21.15.154:0/2660647968 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e492e700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 0x7fd3e01c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e512f700 1 -- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e009f180 msgr2=0x7fd3e01c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e512f700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e009f180 0x7fd3e01c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e512f700 1 -- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 msgr2=0x7fd3e01c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e512f700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 0x7fd3e01c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e512f700 1 -- 172.21.15.154:0/2660647968 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4009550 con 0x7fd3e0131f40 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3dffff700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e009f180 0x7fd3e01c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e492e700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 0x7fd3e01c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e512f700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3e0131f40 0x7fd3e01c8d40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009dd0 tx=0x7fd3d800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3dd7fa700 1 -- 172.21.15.154:0/2660647968 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8009c40 con 0x7fd3e0131f40 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3dd7fa700 1 -- 172.21.15.154:0/2660647968 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d800f040 con 0x7fd3e0131f40 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e6b92700 1 -- 172.21.15.154:0/2660647968 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e009dba0 con 0x7fd3e0131f40 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3dd7fa700 1 -- 172.21.15.154:0/2660647968 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800ceb0 con 0x7fd3e0131f40 2023-09-30T22:27:44.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.181+0000 7fd3e6b92700 1 -- 172.21.15.154:0/2660647968 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e0122e30 con 0x7fd3e0131f40 2023-09-30T22:27:44.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.182+0000 7fd3dd7fa700 1 -- 172.21.15.154:0/2660647968 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3d8014480 con 0x7fd3e0131f40 2023-09-30T22:27:44.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.182+0000 7fd3dd7fa700 1 -- 172.21.15.154:0/2660647968 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3d80404e0 con 0x7fd3e0131f40 2023-09-30T22:27:44.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.182+0000 7fd3e6b92700 1 -- 172.21.15.154:0/2660647968 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e004f2a0 con 0x7fd3e0131f40 2023-09-30T22:27:44.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.191+0000 7fd3dd7fa700 1 -- 172.21.15.154:0/2660647968 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3d8012930 con 0x7fd3e0131f40 2023-09-30T22:27:44.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.270+0000 7f3f43dde700 1 Processor -- start 2023-09-30T22:27:44.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.270+0000 7f3f43dde700 1 -- start start 2023-09-30T22:27:44.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f43dde700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c0a1550 0x7f3f3c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f43dde700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f3c139200 0x7f3f3c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f43dde700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3c09e9d0 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f43dde700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c09dc00 con 0x7f3f3c139200 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f43dde700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c09dec0 con 0x7f3f3c0a1550 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f41379700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c0a1550 0x7f3f3c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f4237b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f3c139200 0x7f3f3c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f4237b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f3c139200 0x7f3f3c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53128/0 (socket says 172.21.15.154:53128) 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f41379700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c0a1550 0x7f3f3c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44562/0 (socket says 172.21.15.154:44562) 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f4237b700 1 -- 172.21.15.154:0/3850473435 learned_addr learned my addr 172.21.15.154:0/3850473435 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f4237b700 1 -- 172.21.15.154:0/3850473435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c0a1550 msgr2=0x7f3f3c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f4237b700 1 --2- 172.21.15.154:0/3850473435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c0a1550 0x7f3f3c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f4237b700 1 -- 172.21.15.154:0/3850473435 >> v1:172.21.15.154:6789/0 conn(0x7f3f3c0a0a70 legacy=0x7f3f3c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f4237b700 1 -- 172.21.15.154:0/3850473435 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c09e6a0 con 0x7f3f3c139200 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.271+0000 7f3f41379700 1 --2- 172.21.15.154:0/3850473435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c0a1550 0x7f3f3c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f4237b700 1 --2- 172.21.15.154:0/3850473435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c139200 0x7f3f3c13b5e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009e50 tx=0x7f3f3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac419840dbe203ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f40b78700 1 -- 172.21.15.154:0/3850473435 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3400e070 con 0x7f3f3c139200 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f40b78700 1 -- 172.21.15.154:0/3850473435 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3400b910 con 0x7f3f3c139200 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f40b78700 1 -- 172.21.15.154:0/3850473435 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3400bcc0 con 0x7f3f3c139200 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f43dde700 1 -- 172.21.15.154:0/3850473435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c139200 msgr2=0x7f3f3c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f43dde700 1 --2- 172.21.15.154:0/3850473435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c139200 0x7f3f3c13b5e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009e50 tx=0x7f3f3400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f43dde700 1 -- 172.21.15.154:0/3850473435 shutdown_connections 2023-09-30T22:27:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f43dde700 1 --2- 172.21.15.154:0/3850473435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c139200 0x7f3f3c13b5e0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f43dde700 1 --2- 172.21.15.154:0/3850473435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c0a1550 0x7f3f3c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f43dde700 1 -- 172.21.15.154:0/3850473435 >> 172.21.15.154:0/3850473435 conn(0x7f3f3c0a6610 msgr2=0x7f3f3c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f43dde700 1 -- 172.21.15.154:0/3850473435 shutdown_connections 2023-09-30T22:27:44.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.272+0000 7f3f43dde700 1 -- 172.21.15.154:0/3850473435 wait complete. 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f43dde700 1 Processor -- start 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f43dde700 1 -- start start 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f43dde700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c0a0a70 0x7f3f3c11e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f43dde700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f3c0a1550 0x7f3f3c11ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f43dde700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c139200 0x7f3f3c11f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f43dde700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c122290 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f43dde700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c121a40 con 0x7f3f3c139200 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f43dde700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0a5100 con 0x7f3f3c0a1550 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41b7a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c0a0a70 0x7f3f3c11e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41379700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f3c0a1550 0x7f3f3c11ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41b7a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c0a0a70 0x7f3f3c11e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53130/0 (socket says 172.21.15.154:53130) 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41b7a700 1 -- 172.21.15.154:0/2506873801 learned_addr learned my addr 172.21.15.154:0/2506873801 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f4237b700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c139200 0x7f3f3c11f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41b7a700 1 -- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f3c0a1550 msgr2=0x7f3f3c11ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41b7a700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f3c0a1550 0x7f3f3c11ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41b7a700 1 -- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c139200 msgr2=0x7f3f3c11f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41b7a700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c139200 0x7f3f3c11f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41b7a700 1 -- 172.21.15.154:0/2506873801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c0094a0 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f41379700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f3c0a1550 0x7f3f3c11ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.274+0000 7f3f4237b700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c139200 0x7f3f3c11f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.275+0000 7f3f41b7a700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c0a0a70 0x7f3f3c11e7c0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c4e0 tx=0x7f3f3800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.275+0000 7f3f327fc700 1 -- 172.21.15.154:0/2506873801 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380052d0 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.275+0000 7f3f327fc700 1 -- 172.21.15.154:0/2506873801 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f38005430 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.275+0000 7f3f327fc700 1 -- 172.21.15.154:0/2506873801 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380038c0 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.275+0000 7f3f43dde700 1 -- 172.21.15.154:0/2506873801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f34009b30 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.275+0000 7f3f43dde700 1 -- 172.21.15.154:0/2506873801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c0a03e0 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.276+0000 7f3f327fc700 1 -- 172.21.15.154:0/2506873801 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f38003a20 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.276+0000 7f3f327fc700 1 -- 172.21.15.154:0/2506873801 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f3803ea70 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.276+0000 7f3f43dde700 1 -- 172.21.15.154:0/2506873801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c04f2a0 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.280+0000 7f3f327fc700 1 -- 172.21.15.154:0/2506873801 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f38018260 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.386+0000 7fd3e6b92700 1 -- 172.21.15.154:0/2660647968 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3e006b2a0 con 0x7fd3e0131f40 2023-09-30T22:27:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.386+0000 7fd3dd7fa700 1 -- 172.21.15.154:0/2660647968 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3d802c090 con 0x7fd3e0131f40 2023-09-30T22:27:44.387 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:44.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.388+0000 7fd3e6b92700 1 -- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3e0131f40 msgr2=0x7fd3e01c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.388+0000 7fd3e6b92700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3e0131f40 0x7fd3e01c8d40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009dd0 tx=0x7fd3d800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.388+0000 7fd3e6b92700 1 -- 172.21.15.154:0/2660647968 shutdown_connections 2023-09-30T22:27:44.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.388+0000 7fd3e6b92700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3e0131f40 0x7fd3e01c8d40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.388+0000 7fd3e6b92700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e009e870 0x7fd3e01c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.388+0000 7fd3e6b92700 1 --2- 172.21.15.154:0/2660647968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3e009f180 0x7fd3e01c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.388+0000 7fd3e6b92700 1 -- 172.21.15.154:0/2660647968 >> 172.21.15.154:0/2660647968 conn(0x7fd3e00a4430 msgr2=0x7fd3e00677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.388+0000 7fd3e6b92700 1 -- 172.21.15.154:0/2660647968 shutdown_connections 2023-09-30T22:27:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.388+0000 7fd3e6b92700 1 -- 172.21.15.154:0/2660647968 wait complete. 2023-09-30T22:27:44.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:44.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f1434f58700 1 Processor -- start 2023-09-30T22:27:44.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f1434f58700 1 -- start start 2023-09-30T22:27:44.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f1434f58700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009f350 0x7f1430136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f1434f58700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f14301395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f1434f58700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143009c970 con 0x7f143009e870 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f1434f58700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300a0920 con 0x7f14301371c0 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f1434f58700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f143009f9c0 con 0x7f143009f350 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f142dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009f350 0x7f1430136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f142e59c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f143009e870 0x7f143009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37560/0 (socket says 172.21.15.154:37560) 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f142e59c700 1 -- 172.21.15.154:0/3403307220 learned_addr learned my addr 172.21.15.154:0/3403307220 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.423+0000 7f142ed9d700 1 --2- 172.21.15.154:0/3403307220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f14301395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142dd9b700 1 -- 172.21.15.154:0/3403307220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 msgr2=0x7f14301395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142d59a700 1 -- 172.21.15.154:0/3403307220 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042324093 0 0) 0x7f143009c970 con 0x7f143009e870 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142dd9b700 1 --2- 172.21.15.154:0/3403307220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f14301395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142dd9b700 1 -- 172.21.15.154:0/3403307220 >> v1:172.21.15.154:6789/0 conn(0x7f143009e870 legacy=0x7f143009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142dd9b700 1 -- 172.21.15.154:0/3403307220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143009bab0 con 0x7f143009f350 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142ed9d700 1 --2- 172.21.15.154:0/3403307220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f14301395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142dd9b700 1 --2- 172.21.15.154:0/3403307220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009f350 0x7f1430136c80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1424009870 tx=0x7f1424009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0bbf6ef45b4b235 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142d59a700 1 -- 172.21.15.154:0/3403307220 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424011830 con 0x7f143009f350 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142d59a700 1 -- 172.21.15.154:0/3403307220 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424011990 con 0x7f143009f350 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.424+0000 7f142d59a700 1 -- 172.21.15.154:0/3403307220 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424011d20 con 0x7f143009f350 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.425+0000 7f1434f58700 1 -- 172.21.15.154:0/3403307220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009f350 msgr2=0x7f1430136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.425+0000 7f1434f58700 1 --2- 172.21.15.154:0/3403307220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009f350 0x7f1430136c80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1424009870 tx=0x7f1424009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:44.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.425+0000 7f1434f58700 1 -- 172.21.15.154:0/3403307220 shutdown_connections 2023-09-30T22:27:44.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.425+0000 7f1434f58700 1 --2- 172.21.15.154:0/3403307220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f14301395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.425+0000 7f1434f58700 1 --2- 172.21.15.154:0/3403307220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009f350 0x7f1430136c80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.425+0000 7f1434f58700 1 -- 172.21.15.154:0/3403307220 >> 172.21.15.154:0/3403307220 conn(0x7f14300a4430 msgr2=0x7f14300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.425+0000 7f1434f58700 1 -- 172.21.15.154:0/3403307220 shutdown_connections 2023-09-30T22:27:44.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.425+0000 7f1434f58700 1 -- 172.21.15.154:0/3403307220 wait complete. 2023-09-30T22:27:44.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f1434f58700 1 Processor -- start 2023-09-30T22:27:44.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f1434f58700 1 -- start start 2023-09-30T22:27:44.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f1434f58700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009e870 0x7f14301c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f1434f58700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f143009f350 0x7f14301c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f1434f58700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f143006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f1434f58700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143006d430 con 0x7f143009f350 2023-09-30T22:27:44.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f1434f58700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14301c91f0 con 0x7f14301371c0 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f1434f58700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f143009dba0 con 0x7f143009e870 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f142dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f143009f350 0x7f14301c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f142ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f143006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f142e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009e870 0x7f14301c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f142dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f143009f350 0x7f14301c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53134/0 (socket says 172.21.15.154:53134) 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f142ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f143006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44580/0 (socket says 172.21.15.154:44580) 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.426+0000 7f142dd9b700 1 -- 172.21.15.154:0/863614263 learned_addr learned my addr 172.21.15.154:0/863614263 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f142ed9d700 1 -- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009e870 msgr2=0x7f14301c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f142ed9d700 1 --2- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009e870 0x7f14301c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f142ed9d700 1 -- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f143009f350 msgr2=0x7f14301c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f142ed9d700 1 --2- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f143009f350 0x7f14301c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f142ed9d700 1 -- 172.21.15.154:0/863614263 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009a70 con 0x7f14301371c0 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f142e59c700 1 --2- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009e870 0x7f14301c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f142dd9b700 1 --2- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f143009f350 0x7f14301c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f142ed9d700 1 --2- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f143006b8b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f142800ef90 tx=0x7f142800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f141effd700 1 -- 172.21.15.154:0/863614263 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800ca90 con 0x7f14301371c0 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f141effd700 1 -- 172.21.15.154:0/863614263 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800f040 con 0x7f14301371c0 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f141effd700 1 -- 172.21.15.154:0/863614263 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800ce30 con 0x7f14301371c0 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f1434f58700 1 -- 172.21.15.154:0/863614263 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14240094a0 con 0x7f14301371c0 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.427+0000 7f1434f58700 1 -- 172.21.15.154:0/863614263 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14300722f0 con 0x7f14301371c0 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.428+0000 7f141effd700 1 -- 172.21.15.154:0/863614263 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1428014480 con 0x7f14301371c0 2023-09-30T22:27:44.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.428+0000 7f141effd700 1 -- 172.21.15.154:0/863614263 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f142803fbf0 con 0x7f14301371c0 2023-09-30T22:27:44.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.429+0000 7f1434f58700 1 -- 172.21.15.154:0/863614263 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1430125e90 con 0x7f14301371c0 2023-09-30T22:27:44.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.437+0000 7f141effd700 1 -- 172.21.15.154:0/863614263 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1430125e90 con 0x7f14301371c0 2023-09-30T22:27:44.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.479+0000 7f3f43dde700 1 -- 172.21.15.154:0/2506873801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f3c072980 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.480+0000 7f3f327fc700 1 -- 172.21.15.154:0/2506873801 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f38017020 con 0x7f3f3c0a0a70 2023-09-30T22:27:44.482 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:44.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.482+0000 7f3f43dde700 1 -- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c0a0a70 msgr2=0x7f3f3c11e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.482+0000 7f3f43dde700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c0a0a70 0x7f3f3c11e7c0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c4e0 tx=0x7f3f3800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.482+0000 7f3f43dde700 1 -- 172.21.15.154:0/2506873801 shutdown_connections 2023-09-30T22:27:44.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.482+0000 7f3f43dde700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f3c139200 0x7f3f3c11f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.482+0000 7f3f43dde700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f3c0a0a70 0x7f3f3c11e7c0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.482+0000 7f3f43dde700 1 --2- 172.21.15.154:0/2506873801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f3c0a1550 0x7f3f3c11ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.482+0000 7f3f43dde700 1 -- 172.21.15.154:0/2506873801 >> 172.21.15.154:0/2506873801 conn(0x7f3f3c0a6610 msgr2=0x7f3f3c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.482+0000 7f3f43dde700 1 -- 172.21.15.154:0/2506873801 shutdown_connections 2023-09-30T22:27:44.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.482+0000 7f3f43dde700 1 -- 172.21.15.154:0/2506873801 wait complete. 2023-09-30T22:27:44.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:44.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.631+0000 7f1434f58700 1 -- 172.21.15.154:0/863614263 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1430125e90 con 0x7f14301371c0 2023-09-30T22:27:44.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.631+0000 7f141effd700 1 -- 172.21.15.154:0/863614263 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1430125e90 con 0x7f14301371c0 2023-09-30T22:27:44.632 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:44.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.633+0000 7f1434f58700 1 -- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 msgr2=0x7f143006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.633+0000 7f1434f58700 1 --2- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f143006b8b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f142800ef90 tx=0x7f142800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.633+0000 7f1434f58700 1 -- 172.21.15.154:0/863614263 shutdown_connections 2023-09-30T22:27:44.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.633+0000 7f1434f58700 1 --2- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14301371c0 0x7f143006b8b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.633+0000 7f1434f58700 1 --2- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f143009e870 0x7f14301c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.633+0000 7f1434f58700 1 --2- 172.21.15.154:0/863614263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f143009f350 0x7f14301c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.633+0000 7f1434f58700 1 -- 172.21.15.154:0/863614263 >> 172.21.15.154:0/863614263 conn(0x7f14300a4430 msgr2=0x7f143009c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.633+0000 7f1434f58700 1 -- 172.21.15.154:0/863614263 shutdown_connections 2023-09-30T22:27:44.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.633+0000 7f1434f58700 1 -- 172.21.15.154:0/863614263 wait complete. 2023-09-30T22:27:44.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:44.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.660+0000 7f871cd38700 1 Processor -- start 2023-09-30T22:27:44.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f871cd38700 1 -- start start 2023-09-30T22:27:44.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f871cd38700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f8718131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f871cd38700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f871809bc70 0x7f871809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f871cd38700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809c5c0 0x7f8718138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f871cd38700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871806eb30 con 0x7f871809bc70 2023-09-30T22:27:44.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f871cd38700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87180a1640 con 0x7f871809c5c0 2023-09-30T22:27:44.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f871cd38700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87180a22d0 con 0x7f8718131980 2023-09-30T22:27:44.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f871659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f8718131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f8716d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809c5c0 0x7f8718138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f8715d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f871809bc70 0x7f871809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f8716d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809c5c0 0x7f8718138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44590/0 (socket says 172.21.15.154:44590) 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f8715d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f871809bc70 0x7f871809c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53146/0 (socket says 172.21.15.154:53146) 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f871659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f8718131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:34990/0 (socket says 172.21.15.154:34990) 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.661+0000 7f8716d9d700 1 -- 172.21.15.154:0/1814821486 learned_addr learned my addr 172.21.15.154:0/1814821486 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f8715d9b700 1 -- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 msgr2=0x7f8718131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f8715d9b700 1 --2- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f8718131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f8715d9b700 1 -- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809c5c0 msgr2=0x7f8718138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f8715d9b700 1 --2- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809c5c0 0x7f8718138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f8715d9b700 1 -- 172.21.15.154:0/1814821486 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718131550 con 0x7f871809bc70 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f8716d9d700 1 --2- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809c5c0 0x7f8718138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f871659c700 1 --2- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f8718131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f8715d9b700 1 --2- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809bc70 0x7f871809c080 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f8708009870 tx=0x7f8708009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd2007b74f5b337 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f871559a700 1 -- 172.21.15.154:0/1814821486 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708011830 con 0x7f871809bc70 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f871559a700 1 -- 172.21.15.154:0/1814821486 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708011990 con 0x7f871809bc70 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f871559a700 1 -- 172.21.15.154:0/1814821486 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708011d20 con 0x7f871809bc70 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f871cd38700 1 -- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809bc70 msgr2=0x7f871809c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.662+0000 7f871cd38700 1 --2- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809bc70 0x7f871809c080 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f8708009870 tx=0x7f8708009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.663+0000 7f871cd38700 1 -- 172.21.15.154:0/1814821486 shutdown_connections 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.663+0000 7f871cd38700 1 --2- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809c5c0 0x7f8718138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.663+0000 7f871cd38700 1 --2- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f8718131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.663+0000 7f871cd38700 1 --2- 172.21.15.154:0/1814821486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809bc70 0x7f871809c080 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.663+0000 7f871cd38700 1 -- 172.21.15.154:0/1814821486 >> 172.21.15.154:0/1814821486 conn(0x7f87180a2980 msgr2=0x7f87180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.663+0000 7f871cd38700 1 -- 172.21.15.154:0/1814821486 shutdown_connections 2023-09-30T22:27:44.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.663+0000 7f871cd38700 1 -- 172.21.15.154:0/1814821486 wait complete. 2023-09-30T22:27:44.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871cd38700 1 Processor -- start 2023-09-30T22:27:44.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871cd38700 1 -- start start 2023-09-30T22:27:44.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871cd38700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809bc70 0x7f871811b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871cd38700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809c5c0 0x7f871811be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871cd38700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f871811c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:44.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871cd38700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871811cdb0 con 0x7f871809c5c0 2023-09-30T22:27:44.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871cd38700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871811db40 con 0x7f871809bc70 2023-09-30T22:27:44.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871cd38700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f871811f400 con 0x7f8718131980 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809bc70 0x7f871811b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f8715d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809c5c0 0x7f871811be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809bc70 0x7f871811b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44596/0 (socket says 172.21.15.154:44596) 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871659c700 1 -- 172.21.15.154:0/2361041800 learned_addr learned my addr 172.21.15.154:0/2361041800 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f8716d9d700 1 --2- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f871811c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871659c700 1 -- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 msgr2=0x7f871811c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871659c700 1 --2- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f871811c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871659c700 1 -- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809c5c0 msgr2=0x7f871811be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871659c700 1 --2- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809c5c0 0x7f871811be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f871659c700 1 -- 172.21.15.154:0/2361041800 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009b30 con 0x7f871809bc70 2023-09-30T22:27:44.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.664+0000 7f8715d9b700 1 --2- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809c5c0 0x7f871811be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.665+0000 7f871659c700 1 --2- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809bc70 0x7f871811b8e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f870000ebe0 tx=0x7f870000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.665+0000 7f870effd700 1 -- 172.21.15.154:0/2361041800 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700005a20 con 0x7f871809bc70 2023-09-30T22:27:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.665+0000 7f870effd700 1 -- 172.21.15.154:0/2361041800 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8700005b80 con 0x7f871809bc70 2023-09-30T22:27:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.665+0000 7f870effd700 1 -- 172.21.15.154:0/2361041800 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870000c850 con 0x7f871809bc70 2023-09-30T22:27:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.665+0000 7f871cd38700 1 -- 172.21.15.154:0/2361041800 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8700009430 con 0x7f871809bc70 2023-09-30T22:27:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.665+0000 7f871cd38700 1 -- 172.21.15.154:0/2361041800 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87080094a0 con 0x7f871809bc70 2023-09-30T22:27:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.665+0000 7f870effd700 1 -- 172.21.15.154:0/2361041800 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f870000c9b0 con 0x7f871809bc70 2023-09-30T22:27:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.666+0000 7f870effd700 1 -- 172.21.15.154:0/2361041800 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f870003f8f0 con 0x7f871809bc70 2023-09-30T22:27:44.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.666+0000 7f871cd38700 1 -- 172.21.15.154:0/2361041800 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871804f2a0 con 0x7f871809bc70 2023-09-30T22:27:44.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.670+0000 7f870effd700 1 -- 172.21.15.154:0/2361041800 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8700020080 con 0x7f871809bc70 2023-09-30T22:27:44.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.854+0000 7f871cd38700 1 -- 172.21.15.154:0/2361041800 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f871812ecd0 con 0x7f871809bc70 2023-09-30T22:27:44.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.854+0000 7f870effd700 1 -- 172.21.15.154:0/2361041800 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8700011ce0 con 0x7f871809bc70 2023-09-30T22:27:44.855 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:44.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.856+0000 7f871cd38700 1 -- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809bc70 msgr2=0x7f871811b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:44.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.856+0000 7f871cd38700 1 --2- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809bc70 0x7f871811b8e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f870000ebe0 tx=0x7f870000eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.857+0000 7f871cd38700 1 -- 172.21.15.154:0/2361041800 shutdown_connections 2023-09-30T22:27:44.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.857+0000 7f871cd38700 1 --2- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8718131980 0x7f871811c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.857+0000 7f871cd38700 1 --2- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f871809bc70 0x7f871811b8e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.857+0000 7f871cd38700 1 --2- 172.21.15.154:0/2361041800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871809c5c0 0x7f871811be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:44.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.857+0000 7f871cd38700 1 -- 172.21.15.154:0/2361041800 >> 172.21.15.154:0/2361041800 conn(0x7f87180a2980 msgr2=0x7f8718071500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:44.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.857+0000 7f871cd38700 1 -- 172.21.15.154:0/2361041800 shutdown_connections 2023-09-30T22:27:44.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:44.857+0000 7f871cd38700 1 -- 172.21.15.154:0/2361041800 wait complete. 2023-09-30T22:27:44.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:45.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:45.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b6dcbc700 1 Processor -- start 2023-09-30T22:27:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b6dcbc700 1 -- start start 2023-09-30T22:27:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b6dcbc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809e340 0x7f6b681359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b6dcbc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b68135f20 0x7f6b68138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b6dcbc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6809aaa0 con 0x7f6b6809d860 2023-09-30T22:27:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b6dcbc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6809e730 con 0x7f6b68135f20 2023-09-30T22:27:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b6dcbc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6809f870 con 0x7f6b6809e340 2023-09-30T22:27:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b66ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809e340 0x7f6b681359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b68135f20 0x7f6b68138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b677fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6b6809d860 0x7f6b6809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48018/0 (socket says 172.21.15.154:48018) 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b66ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809e340 0x7f6b681359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47994/0 (socket says 172.21.15.154:47994) 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b68135f20 0x7f6b68138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47776/0 (socket says 172.21.15.154:47776) 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.529+0000 7f6b677fe700 1 -- 172.21.15.154:0/917380226 learned_addr learned my addr 172.21.15.154:0/917380226 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b66ffd700 1 -- 172.21.15.154:0/917380226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b68135f20 msgr2=0x7f6b68138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b66ffd700 1 --2- 172.21.15.154:0/917380226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b68135f20 0x7f6b68138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b66ffd700 1 -- 172.21.15.154:0/917380226 >> v1:172.21.15.154:6789/0 conn(0x7f6b6809d860 legacy=0x7f6b6809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b667fc700 1 -- 172.21.15.154:0/917380226 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961279991 0 0) 0x7f6b6809aaa0 con 0x7f6b6809d860 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b66ffd700 1 -- 172.21.15.154:0/917380226 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6809b360 con 0x7f6b6809e340 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b67fff700 1 --2- 172.21.15.154:0/917380226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b68135f20 0x7f6b68138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:45.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b66ffd700 1 --2- 172.21.15.154:0/917380226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809e340 0x7f6b681359e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0098a0 tx=0x7f6b5c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9950612c732fa94 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b667fc700 1 -- 172.21.15.154:0/917380226 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c011830 con 0x7f6b6809e340 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b667fc700 1 -- 172.21.15.154:0/917380226 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c011990 con 0x7f6b6809e340 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.530+0000 7f6b667fc700 1 -- 172.21.15.154:0/917380226 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c011d20 con 0x7f6b6809e340 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.531+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/917380226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809e340 msgr2=0x7f6b681359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.531+0000 7f6b6dcbc700 1 --2- 172.21.15.154:0/917380226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809e340 0x7f6b681359e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0098a0 tx=0x7f6b5c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.531+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/917380226 shutdown_connections 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.531+0000 7f6b6dcbc700 1 --2- 172.21.15.154:0/917380226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b68135f20 0x7f6b68138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.531+0000 7f6b6dcbc700 1 --2- 172.21.15.154:0/917380226 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809e340 0x7f6b681359e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.531+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/917380226 >> 172.21.15.154:0/917380226 conn(0x7f6b68099c40 msgr2=0x7f6b680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.531+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/917380226 shutdown_connections 2023-09-30T22:27:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.531+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/917380226 wait complete. 2023-09-30T22:27:45.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b6dcbc700 1 Processor -- start 2023-09-30T22:27:45.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b6dcbc700 1 -- start start 2023-09-30T22:27:45.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b6dcbc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809d860 0x7f6b681209b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b6dcbc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6809e340 0x7f6b68120ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b6dcbc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b68135f20 0x7f6b68121430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b6dcbc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68121e80 con 0x7f6b68135f20 2023-09-30T22:27:45.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b6dcbc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68124480 con 0x7f6b6809e340 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b6dcbc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b68122570 con 0x7f6b6809d860 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b68135f20 0x7f6b68121430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b677fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809d860 0x7f6b681209b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b67fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b68135f20 0x7f6b68121430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41054/0 (socket says 172.21.15.154:41054) 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b67fff700 1 -- 172.21.15.154:0/3668869438 learned_addr learned my addr 172.21.15.154:0/3668869438 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.532+0000 7f6b66ffd700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6809e340 0x7f6b68120ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b67fff700 1 -- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809d860 msgr2=0x7f6b681209b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b67fff700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809d860 0x7f6b681209b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b67fff700 1 -- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6809e340 msgr2=0x7f6b68120ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b67fff700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6809e340 0x7f6b68120ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b67fff700 1 -- 172.21.15.154:0/3668869438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60009a70 con 0x7f6b68135f20 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b66ffd700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6809e340 0x7f6b68120ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b677fe700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809d860 0x7f6b681209b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b67fff700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b68135f20 0x7f6b68121430 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009f00 tx=0x7f6b6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b4ffff700 1 -- 172.21.15.154:0/3668869438 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60009d70 con 0x7f6b68135f20 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b4ffff700 1 -- 172.21.15.154:0/3668869438 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6000f040 con 0x7f6b68135f20 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/3668869438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c0094a0 con 0x7f6b68135f20 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b4ffff700 1 -- 172.21.15.154:0/3668869438 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000cd70 con 0x7f6b68135f20 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.533+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/3668869438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b68123ee0 con 0x7f6b68135f20 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.534+0000 7f6b4ffff700 1 -- 172.21.15.154:0/3668869438 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b60014480 con 0x7f6b68135f20 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.534+0000 7f6b4ffff700 1 -- 172.21.15.154:0/3668869438 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6b6003fcc0 con 0x7f6b68135f20 2023-09-30T22:27:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.534+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/3668869438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6804f2a0 con 0x7f6b68135f20 2023-09-30T22:27:45.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.539+0000 7f6b4ffff700 1 -- 172.21.15.154:0/3668869438 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b60012930 con 0x7f6b68135f20 2023-09-30T22:27:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.621+0000 7fd02f9c6700 1 Processor -- start 2023-09-30T22:27:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.621+0000 7fd02f9c6700 1 -- start start 2023-09-30T22:27:45.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02f9c6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0280a0a70 0x7fd0280a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02f9c6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a1380 0x7fd028133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02f9c6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028133f50 0x7fd0281343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02f9c6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02809e9d0 con 0x7fd0280a0a70 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02f9c6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02809dc00 con 0x7fd0280a1380 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02f9c6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd02809dec0 con 0x7fd028133f50 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02cf61700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a1380 0x7fd028133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02df63700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028133f50 0x7fd0281343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02cf61700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a1380 0x7fd028133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47794/0 (socket says 172.21.15.154:47794) 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02cf61700 1 -- 172.21.15.154:0/1673944199 learned_addr learned my addr 172.21.15.154:0/1673944199 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02d762700 1 --2- 172.21.15.154:0/1673944199 >> v2:172.21.15.154:3300/0 conn(0x7fd0280a0a70 0x7fd0280a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02cf61700 1 -- 172.21.15.154:0/1673944199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028133f50 msgr2=0x7fd0281343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02cf61700 1 --2- 172.21.15.154:0/1673944199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028133f50 0x7fd0281343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02cf61700 1 -- 172.21.15.154:0/1673944199 >> v2:172.21.15.154:3300/0 conn(0x7fd0280a0a70 msgr2=0x7fd0280a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02cf61700 1 --2- 172.21.15.154:0/1673944199 >> v2:172.21.15.154:3300/0 conn(0x7fd0280a0a70 0x7fd0280a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02cf61700 1 -- 172.21.15.154:0/1673944199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02809e6a0 con 0x7fd0280a1380 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02d762700 1 --2- 172.21.15.154:0/1673944199 >> v2:172.21.15.154:3300/0 conn(0x7fd0280a0a70 0x7fd0280a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.622+0000 7fd02df63700 1 --2- 172.21.15.154:0/1673944199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028133f50 0x7fd0281343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02cf61700 1 --2- 172.21.15.154:0/1673944199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a1380 0x7fd028133a10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd0180098f0 tx=0x7fd018009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f3097c6a1e2cf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd01ffff700 1 -- 172.21.15.154:0/1673944199 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018011830 con 0x7fd0280a1380 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd01ffff700 1 -- 172.21.15.154:0/1673944199 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd018011990 con 0x7fd0280a1380 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd01ffff700 1 -- 172.21.15.154:0/1673944199 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018011d20 con 0x7fd0280a1380 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02f9c6700 1 -- 172.21.15.154:0/1673944199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a1380 msgr2=0x7fd028133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02f9c6700 1 --2- 172.21.15.154:0/1673944199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a1380 0x7fd028133a10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd0180098f0 tx=0x7fd018009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:45.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02f9c6700 1 -- 172.21.15.154:0/1673944199 shutdown_connections 2023-09-30T22:27:45.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02f9c6700 1 --2- 172.21.15.154:0/1673944199 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028133f50 0x7fd0281343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02f9c6700 1 --2- 172.21.15.154:0/1673944199 >> v2:172.21.15.154:3300/0 conn(0x7fd0280a0a70 0x7fd0280a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02f9c6700 1 --2- 172.21.15.154:0/1673944199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a1380 0x7fd028133a10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02f9c6700 1 -- 172.21.15.154:0/1673944199 >> 172.21.15.154:0/1673944199 conn(0x7fd0280a6610 msgr2=0x7fd0280a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02f9c6700 1 -- 172.21.15.154:0/1673944199 shutdown_connections 2023-09-30T22:27:45.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.623+0000 7fd02f9c6700 1 -- 172.21.15.154:0/1673944199 wait complete. 2023-09-30T22:27:45.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02f9c6700 1 Processor -- start 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02f9c6700 1 -- start start 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02f9c6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a0a70 0x7fd0281224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02f9c6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0280a1380 0x7fd0281229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02f9c6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd028133f50 0x7fd028122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02f9c6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0281241a0 con 0x7fd028133f50 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02f9c6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd028124eb0 con 0x7fd0280a0a70 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02f9c6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd028125270 con 0x7fd0280a1380 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02cf61700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0280a1380 0x7fd0281229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02df63700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd028133f50 0x7fd028122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02cf61700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0280a1380 0x7fd0281229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48026/0 (socket says 172.21.15.154:48026) 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02cf61700 1 -- 172.21.15.154:0/2814687871 learned_addr learned my addr 172.21.15.154:0/2814687871 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.625+0000 7fd02d762700 1 --2- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a0a70 0x7fd0281224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd02df63700 1 -- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0280a1380 msgr2=0x7fd0281229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd02df63700 1 --2- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0280a1380 0x7fd0281229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd02df63700 1 -- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a0a70 msgr2=0x7fd0281224b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd02df63700 1 --2- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a0a70 0x7fd0281224b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd02df63700 1 -- 172.21.15.154:0/2814687871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240094a0 con 0x7fd028133f50 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd02cf61700 1 --2- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0280a1380 0x7fd0281229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd02df63700 1 --2- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd028133f50 0x7fd028122f30 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fd020009e50 tx=0x7fd02000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd01dffb700 1 -- 172.21.15.154:0/2814687871 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020003a20 con 0x7fd028133f50 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd01dffb700 1 -- 172.21.15.154:0/2814687871 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02000f040 con 0x7fd028133f50 2023-09-30T22:27:45.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd02f9c6700 1 -- 172.21.15.154:0/2814687871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd020009a70 con 0x7fd028133f50 2023-09-30T22:27:45.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd01dffb700 1 -- 172.21.15.154:0/2814687871 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020003de0 con 0x7fd028133f50 2023-09-30T22:27:45.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.626+0000 7fd02f9c6700 1 -- 172.21.15.154:0/2814687871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd018009550 con 0x7fd028133f50 2023-09-30T22:27:45.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.627+0000 7fd01dffb700 1 -- 172.21.15.154:0/2814687871 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd02000ca30 con 0x7fd028133f50 2023-09-30T22:27:45.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.627+0000 7fd01dffb700 1 -- 172.21.15.154:0/2814687871 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd02003fe90 con 0x7fd028133f50 2023-09-30T22:27:45.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.627+0000 7fd02f9c6700 1 -- 172.21.15.154:0/2814687871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02804f2a0 con 0x7fd028133f50 2023-09-30T22:27:45.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.636+0000 7fd01dffb700 1 -- 172.21.15.154:0/2814687871 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd02006b750 con 0x7fd028133f50 2023-09-30T22:27:45.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:45.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.737+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/3668869438 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b68122d40 con 0x7f6b68135f20 2023-09-30T22:27:45.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.738+0000 7f6b4ffff700 1 -- 172.21.15.154:0/3668869438 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b6002a090 con 0x7f6b68135f20 2023-09-30T22:27:45.739 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.740+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b68135f20 msgr2=0x7f6b68121430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.740+0000 7f6b6dcbc700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b68135f20 0x7f6b68121430 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009f00 tx=0x7f6b6000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.740+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/3668869438 shutdown_connections 2023-09-30T22:27:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.740+0000 7f6b6dcbc700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b68135f20 0x7f6b68121430 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.740+0000 7f6b6dcbc700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6b6809d860 0x7f6b681209b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.740+0000 7f6b6dcbc700 1 --2- 172.21.15.154:0/3668869438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b6809e340 0x7f6b68120ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.740+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/3668869438 >> 172.21.15.154:0/3668869438 conn(0x7f6b68099c40 msgr2=0x7f6b680a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.740+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/3668869438 shutdown_connections 2023-09-30T22:27:45.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.740+0000 7f6b6dcbc700 1 -- 172.21.15.154:0/3668869438 wait complete. 2023-09-30T22:27:45.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:45.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.772+0000 7fa5a37f1700 1 Processor -- start 2023-09-30T22:27:45.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.772+0000 7fa5a37f1700 1 -- start start 2023-09-30T22:27:45.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a37f1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c09f350 0x7fa59c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a37f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1371c0 0x7fa59c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a37f1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c09c970 con 0x7fa59c09e870 2023-09-30T22:27:45.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a37f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c0a0920 con 0x7fa59c1371c0 2023-09-30T22:27:45.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a37f1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c09f9c0 con 0x7fa59c09f350 2023-09-30T22:27:45.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a1d8e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1371c0 0x7fa59c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a0d8c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c09f350 0x7fa59c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a1d8e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1371c0 0x7fa59c1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47824/0 (socket says 172.21.15.154:47824) 2023-09-30T22:27:45.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a158d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa59c09e870 0x7fa59c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48022/0 (socket says 172.21.15.154:48022) 2023-09-30T22:27:45.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a1d8e700 1 -- 172.21.15.154:0/203291980 learned_addr learned my addr 172.21.15.154:0/203291980 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:45.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa593fff700 1 -- 172.21.15.154:0/203291980 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382109051 0 0) 0x7fa59c09c970 con 0x7fa59c09e870 2023-09-30T22:27:45.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a0d8c700 1 -- 172.21.15.154:0/203291980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1371c0 msgr2=0x7fa59c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:45.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a0d8c700 1 --2- 172.21.15.154:0/203291980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1371c0 0x7fa59c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a0d8c700 1 -- 172.21.15.154:0/203291980 >> v1:172.21.15.154:6789/0 conn(0x7fa59c09e870 legacy=0x7fa59c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a0d8c700 1 -- 172.21.15.154:0/203291980 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c09bab0 con 0x7fa59c09f350 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a1d8e700 1 --2- 172.21.15.154:0/203291980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1371c0 0x7fa59c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.773+0000 7fa5a0d8c700 1 --2- 172.21.15.154:0/203291980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c09f350 0x7fa59c136c80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009870 tx=0x7fa58c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6d69384878730b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa593fff700 1 -- 172.21.15.154:0/203291980 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c011830 con 0x7fa59c09f350 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa593fff700 1 -- 172.21.15.154:0/203291980 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c011990 con 0x7fa59c09f350 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa593fff700 1 -- 172.21.15.154:0/203291980 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c011d20 con 0x7fa59c09f350 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa5a37f1700 1 -- 172.21.15.154:0/203291980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c09f350 msgr2=0x7fa59c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa5a37f1700 1 --2- 172.21.15.154:0/203291980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c09f350 0x7fa59c136c80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009870 tx=0x7fa58c009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa5a37f1700 1 -- 172.21.15.154:0/203291980 shutdown_connections 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa5a37f1700 1 --2- 172.21.15.154:0/203291980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1371c0 0x7fa59c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa5a37f1700 1 --2- 172.21.15.154:0/203291980 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c09f350 0x7fa59c136c80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa5a37f1700 1 -- 172.21.15.154:0/203291980 >> 172.21.15.154:0/203291980 conn(0x7fa59c0a4430 msgr2=0x7fa59c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa5a37f1700 1 -- 172.21.15.154:0/203291980 shutdown_connections 2023-09-30T22:27:45.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.774+0000 7fa5a37f1700 1 -- 172.21.15.154:0/203291980 wait complete. 2023-09-30T22:27:45.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.775+0000 7fa5a37f1700 1 Processor -- start 2023-09-30T22:27:45.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.775+0000 7fa5a37f1700 1 -- start start 2023-09-30T22:27:45.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a37f1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c09e870 0x7fa59c120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a37f1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c09f350 0x7fa59c120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a37f1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c1371c0 0x7fa59c1212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a37f1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c1242d0 con 0x7fa59c09f350 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a37f1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c1366a0 con 0x7fa59c09e870 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a37f1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c09dba0 con 0x7fa59c1371c0 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a0d8c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c09f350 0x7fa59c120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a158d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c09e870 0x7fa59c120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a0d8c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c09f350 0x7fa59c120d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41074/0 (socket says 172.21.15.154:41074) 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a0d8c700 1 -- 172.21.15.154:0/807553784 learned_addr learned my addr 172.21.15.154:0/807553784 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a1d8e700 1 --2- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c1371c0 0x7fa59c1212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a0d8c700 1 -- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c1371c0 msgr2=0x7fa59c1212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a0d8c700 1 --2- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c1371c0 0x7fa59c1212c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a0d8c700 1 -- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c09e870 msgr2=0x7fa59c120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a0d8c700 1 --2- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c09e870 0x7fa59c120840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a0d8c700 1 -- 172.21.15.154:0/807553784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa594009b30 con 0x7fa59c09f350 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a158d700 1 --2- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c09e870 0x7fa59c120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a0d8c700 1 --2- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c09f350 0x7fa59c120d80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0090b0 tx=0x7fa58c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa591ffb700 1 -- 172.21.15.154:0/807553784 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c004510 con 0x7fa59c09f350 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa591ffb700 1 -- 172.21.15.154:0/807553784 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c01f070 con 0x7fa59c09f350 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa5a37f1700 1 -- 172.21.15.154:0/807553784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58c0094a0 con 0x7fa59c09f350 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.776+0000 7fa591ffb700 1 -- 172.21.15.154:0/807553784 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0038e0 con 0x7fa59c09f350 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.777+0000 7fa5a37f1700 1 -- 172.21.15.154:0/807553784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c124a60 con 0x7fa59c09f350 2023-09-30T22:27:45.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.777+0000 7fa591ffb700 1 -- 172.21.15.154:0/807553784 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa58c003a40 con 0x7fa59c09f350 2023-09-30T22:27:45.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.777+0000 7fa591ffb700 1 -- 172.21.15.154:0/807553784 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa58c021070 con 0x7fa59c09f350 2023-09-30T22:27:45.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.777+0000 7fa5a37f1700 1 -- 172.21.15.154:0/807553784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c04f2a0 con 0x7fa59c09f350 2023-09-30T22:27:45.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.782+0000 7fa591ffb700 1 -- 172.21.15.154:0/807553784 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa58c040e60 con 0x7fa59c09f350 2023-09-30T22:27:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.833+0000 7fd02f9c6700 1 -- 172.21.15.154:0/2814687871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd028072980 con 0x7fd028133f50 2023-09-30T22:27:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.833+0000 7fd01dffb700 1 -- 172.21.15.154:0/2814687871 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd02002b090 con 0x7fd028133f50 2023-09-30T22:27:45.835 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:45.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.836+0000 7fd02f9c6700 1 -- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd028133f50 msgr2=0x7fd028122f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.836+0000 7fd02f9c6700 1 --2- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd028133f50 0x7fd028122f30 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fd020009e50 tx=0x7fd02000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.836+0000 7fd02f9c6700 1 -- 172.21.15.154:0/2814687871 shutdown_connections 2023-09-30T22:27:45.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.836+0000 7fd02f9c6700 1 --2- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd028133f50 0x7fd028122f30 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.836+0000 7fd02f9c6700 1 --2- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0280a0a70 0x7fd0281224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.836+0000 7fd02f9c6700 1 --2- 172.21.15.154:0/2814687871 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0280a1380 0x7fd0281229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.836+0000 7fd02f9c6700 1 -- 172.21.15.154:0/2814687871 >> 172.21.15.154:0/2814687871 conn(0x7fd0280a6610 msgr2=0x7fd02809b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.836+0000 7fd02f9c6700 1 -- 172.21.15.154:0/2814687871 shutdown_connections 2023-09-30T22:27:45.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.836+0000 7fd02f9c6700 1 -- 172.21.15.154:0/2814687871 wait complete. 2023-09-30T22:27:45.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:45.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:45.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.973+0000 7fa5a37f1700 1 -- 172.21.15.154:0/807553784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa59c1368e0 con 0x7fa59c09f350 2023-09-30T22:27:45.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.973+0000 7fa591ffb700 1 -- 172.21.15.154:0/807553784 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa58c02b070 con 0x7fa59c09f350 2023-09-30T22:27:45.975 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:45.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.976+0000 7fa5a37f1700 1 -- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c09f350 msgr2=0x7fa59c120d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:45.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.976+0000 7fa5a37f1700 1 --2- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c09f350 0x7fa59c120d80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0090b0 tx=0x7fa58c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:45.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.976+0000 7fa5a37f1700 1 -- 172.21.15.154:0/807553784 shutdown_connections 2023-09-30T22:27:45.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.976+0000 7fa5a37f1700 1 --2- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa59c1371c0 0x7fa59c1212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.976+0000 7fa5a37f1700 1 --2- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c09e870 0x7fa59c120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.976+0000 7fa5a37f1700 1 --2- 172.21.15.154:0/807553784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c09f350 0x7fa59c120d80 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:45.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.976+0000 7fa5a37f1700 1 -- 172.21.15.154:0/807553784 >> 172.21.15.154:0/807553784 conn(0x7fa59c0a4430 msgr2=0x7fa59c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:45.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.976+0000 7fa5a37f1700 1 -- 172.21.15.154:0/807553784 shutdown_connections 2023-09-30T22:27:45.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:45.976+0000 7fa5a37f1700 1 -- 172.21.15.154:0/807553784 wait complete. 2023-09-30T22:27:45.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:46.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.014+0000 7fc3eac61700 1 Processor -- start 2023-09-30T22:27:46.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.014+0000 7fc3eac61700 1 -- start start 2023-09-30T22:27:46.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3eac61700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a0a30 0x7fc3e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3eac61700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3e40a1340 0x7fc3e412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3eac61700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41304a0 0x7fc3e4130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3eac61700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40a1e70 con 0x7fc3e40a1340 2023-09-30T22:27:46.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3eac61700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e409a720 con 0x7fc3e41304a0 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3eac61700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e409b300 con 0x7fc3e40a0a30 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e89fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a0a30 0x7fc3e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3e40a1340 0x7fc3e412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e91fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41304a0 0x7fc3e4130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e89fd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a0a30 0x7fc3e40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48056/0 (socket says 172.21.15.154:48056) 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e89fd700 1 -- 172.21.15.154:0/2986779036 learned_addr learned my addr 172.21.15.154:0/2986779036 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3e40a1340 0x7fc3e412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41082/0 (socket says 172.21.15.154:41082) 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e3fff700 1 -- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a0a30 msgr2=0x7fc3e40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e3fff700 1 --2- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a0a30 0x7fc3e40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e3fff700 1 -- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41304a0 msgr2=0x7fc3e4130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e3fff700 1 --2- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41304a0 0x7fc3e4130940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e3fff700 1 -- 172.21.15.154:0/2986779036 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e409abc0 con 0x7fc3e40a1340 2023-09-30T22:27:46.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e91fe700 1 --2- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41304a0 0x7fc3e4130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.015+0000 7fc3e3fff700 1 --2- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e40a1340 0x7fc3e412ff60 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009840 tx=0x7fc3d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6552600bf0f797a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3e37fe700 1 -- 172.21.15.154:0/2986779036 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0011830 con 0x7fc3e40a1340 2023-09-30T22:27:46.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3e37fe700 1 -- 172.21.15.154:0/2986779036 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d0011990 con 0x7fc3e40a1340 2023-09-30T22:27:46.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3e37fe700 1 -- 172.21.15.154:0/2986779036 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0011d20 con 0x7fc3e40a1340 2023-09-30T22:27:46.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3eac61700 1 -- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e40a1340 msgr2=0x7fc3e412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3eac61700 1 --2- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e40a1340 0x7fc3e412ff60 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009840 tx=0x7fc3d0009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:46.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3eac61700 1 -- 172.21.15.154:0/2986779036 shutdown_connections 2023-09-30T22:27:46.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3eac61700 1 --2- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e41304a0 0x7fc3e4130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3eac61700 1 --2- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a0a30 0x7fc3e40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3eac61700 1 --2- 172.21.15.154:0/2986779036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e40a1340 0x7fc3e412ff60 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3eac61700 1 -- 172.21.15.154:0/2986779036 >> 172.21.15.154:0/2986779036 conn(0x7fc3e40a2980 msgr2=0x7fc3e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:46.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3eac61700 1 -- 172.21.15.154:0/2986779036 shutdown_connections 2023-09-30T22:27:46.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.016+0000 7fc3eac61700 1 -- 172.21.15.154:0/2986779036 wait complete. 2023-09-30T22:27:46.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.017+0000 7fc3eac61700 1 Processor -- start 2023-09-30T22:27:46.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.017+0000 7fc3eac61700 1 -- start start 2023-09-30T22:27:46.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3eac61700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e40a0a30 0x7fc3e41c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3eac61700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a1340 0x7fc3e41c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3eac61700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e41304a0 0x7fc3e41c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3eac61700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e411bb20 con 0x7fc3e41304a0 2023-09-30T22:27:46.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3eac61700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e411c170 con 0x7fc3e40a0a30 2023-09-30T22:27:46.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3eac61700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e411da30 con 0x7fc3e40a1340 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a1340 0x7fc3e41c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e91fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e41304a0 0x7fc3e41c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a1340 0x7fc3e41c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48058/0 (socket says 172.21.15.154:48058) 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e3fff700 1 -- 172.21.15.154:0/1096273659 learned_addr learned my addr 172.21.15.154:0/1096273659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e89fd700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e40a0a30 0x7fc3e41c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e3fff700 1 -- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e40a0a30 msgr2=0x7fc3e41c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e3fff700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e40a0a30 0x7fc3e41c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e3fff700 1 -- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e41304a0 msgr2=0x7fc3e41c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e3fff700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e41304a0 0x7fc3e41c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e3fff700 1 -- 172.21.15.154:0/1096273659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc009a70 con 0x7fc3e40a1340 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e89fd700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e40a0a30 0x7fc3e41c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e91fe700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e41304a0 0x7fc3e41c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e3fff700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a1340 0x7fc3e41c4350 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0000c00 tx=0x7fc3d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.018+0000 7fc3e17fa700 1 -- 172.21.15.154:0/1096273659 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0004450 con 0x7fc3e40a1340 2023-09-30T22:27:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.019+0000 7fc3e17fa700 1 -- 172.21.15.154:0/1096273659 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d001f070 con 0x7fc3e40a1340 2023-09-30T22:27:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.019+0000 7fc3eac61700 1 -- 172.21.15.154:0/1096273659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d00094a0 con 0x7fc3e40a1340 2023-09-30T22:27:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.019+0000 7fc3e17fa700 1 -- 172.21.15.154:0/1096273659 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00038e0 con 0x7fc3e40a1340 2023-09-30T22:27:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.019+0000 7fc3eac61700 1 -- 172.21.15.154:0/1096273659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e411d750 con 0x7fc3e40a1340 2023-09-30T22:27:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.019+0000 7fc3e17fa700 1 -- 172.21.15.154:0/1096273659 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3d0003a40 con 0x7fc3e40a1340 2023-09-30T22:27:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.020+0000 7fc3e17fa700 1 -- 172.21.15.154:0/1096273659 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc3d0021070 con 0x7fc3e40a1340 2023-09-30T22:27:46.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.020+0000 7fc3eac61700 1 -- 172.21.15.154:0/1096273659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e411d3f0 con 0x7fc3e40a1340 2023-09-30T22:27:46.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.024+0000 7fc3e17fa700 1 -- 172.21.15.154:0/1096273659 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3e411d3f0 con 0x7fc3e40a1340 2023-09-30T22:27:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.209+0000 7fc3eac61700 1 -- 172.21.15.154:0/1096273659 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc3e411d5b0 con 0x7fc3e40a1340 2023-09-30T22:27:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.209+0000 7fc3e17fa700 1 -- 172.21.15.154:0/1096273659 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3e411d5b0 con 0x7fc3e40a1340 2023-09-30T22:27:46.210 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:46.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.211+0000 7fc3eac61700 1 -- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a1340 msgr2=0x7fc3e41c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.211+0000 7fc3eac61700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a1340 0x7fc3e41c4350 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0000c00 tx=0x7fc3d0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:46.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.211+0000 7fc3eac61700 1 -- 172.21.15.154:0/1096273659 shutdown_connections 2023-09-30T22:27:46.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.211+0000 7fc3eac61700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3e41304a0 0x7fc3e41c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.211+0000 7fc3eac61700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3e40a0a30 0x7fc3e41c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.211+0000 7fc3eac61700 1 --2- 172.21.15.154:0/1096273659 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3e40a1340 0x7fc3e41c4350 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.211+0000 7fc3eac61700 1 -- 172.21.15.154:0/1096273659 >> 172.21.15.154:0/1096273659 conn(0x7fc3e40a2980 msgr2=0x7fc3e409deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:46.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.211+0000 7fc3eac61700 1 -- 172.21.15.154:0/1096273659 shutdown_connections 2023-09-30T22:27:46.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.211+0000 7fc3eac61700 1 -- 172.21.15.154:0/1096273659 wait complete. 2023-09-30T22:27:46.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:46.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:46.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:46.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.882+0000 7fa6d1296700 1 Processor -- start 2023-09-30T22:27:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.882+0000 7fa6d1296700 1 -- start start 2023-09-30T22:27:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.882+0000 7fa6d1296700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc09d860 0x7fa6cc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.882+0000 7fa6d1296700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.882+0000 7fa6d1296700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6cc130ce0 0x7fa6cc131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.882+0000 7fa6d1296700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6cc09aaa0 con 0x7fa6cc130ce0 2023-09-30T22:27:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.882+0000 7fa6d1296700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc09f870 con 0x7fa6cc09d860 2023-09-30T22:27:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.882+0000 7fa6d1296700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc09b360 con 0x7fa6cc09e170 2023-09-30T22:27:46.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6caffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc09d860 0x7fa6cc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6ca7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6cb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6cc130ce0 0x7fa6cc131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6caffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc09d860 0x7fa6cc09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47860/0 (socket says 172.21.15.154:47860) 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6caffd700 1 -- 172.21.15.154:0/2000090092 learned_addr learned my addr 172.21.15.154:0/2000090092 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/2000090092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc09d860 msgr2=0x7fa6cc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6ca7fc700 1 --2- 172.21.15.154:0/2000090092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc09d860 0x7fa6cc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/2000090092 >> v2:172.21.15.154:3300/0 conn(0x7fa6cc130ce0 msgr2=0x7fa6cc131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6ca7fc700 1 --2- 172.21.15.154:0/2000090092 >> v2:172.21.15.154:3300/0 conn(0x7fa6cc130ce0 0x7fa6cc131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/2000090092 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc09b620 con 0x7fa6cc09e170 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6cb7fe700 1 --2- 172.21.15.154:0/2000090092 >> v2:172.21.15.154:3300/0 conn(0x7fa6cc130ce0 0x7fa6cc131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6caffd700 1 --2- 172.21.15.154:0/2000090092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc09d860 0x7fa6cc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6ca7fc700 1 --2- 172.21.15.154:0/2000090092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc1307a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009840 tx=0x7fa6c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e80dbfdb1d2a4678 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6c9ffb700 1 -- 172.21.15.154:0/2000090092 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0011830 con 0x7fa6cc09e170 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6c9ffb700 1 -- 172.21.15.154:0/2000090092 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c0011990 con 0x7fa6cc09e170 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.883+0000 7fa6c9ffb700 1 -- 172.21.15.154:0/2000090092 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0011d20 con 0x7fa6cc09e170 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.884+0000 7fa6d1296700 1 -- 172.21.15.154:0/2000090092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 msgr2=0x7fa6cc1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.884+0000 7fa6d1296700 1 --2- 172.21.15.154:0/2000090092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc1307a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009840 tx=0x7fa6c0009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.884+0000 7fa6d1296700 1 -- 172.21.15.154:0/2000090092 shutdown_connections 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.884+0000 7fa6d1296700 1 --2- 172.21.15.154:0/2000090092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc09d860 0x7fa6cc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.884+0000 7fa6d1296700 1 --2- 172.21.15.154:0/2000090092 >> v2:172.21.15.154:3300/0 conn(0x7fa6cc130ce0 0x7fa6cc131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.884+0000 7fa6d1296700 1 --2- 172.21.15.154:0/2000090092 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc1307a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.884+0000 7fa6d1296700 1 -- 172.21.15.154:0/2000090092 >> 172.21.15.154:0/2000090092 conn(0x7fa6cc099c40 msgr2=0x7fa6cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.884+0000 7fa6d1296700 1 -- 172.21.15.154:0/2000090092 shutdown_connections 2023-09-30T22:27:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.884+0000 7fa6d1296700 1 -- 172.21.15.154:0/2000090092 wait complete. 2023-09-30T22:27:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.886+0000 7fa6d1296700 1 Processor -- start 2023-09-30T22:27:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.886+0000 7fa6d1296700 1 -- start start 2023-09-30T22:27:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.886+0000 7fa6d1296700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc09d860 0x7fa6cc11cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.886+0000 7fa6d1296700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc11d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.886+0000 7fa6d1296700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc130ce0 0x7fa6cc11da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.886+0000 7fa6d1296700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc120290 con 0x7fa6cc09d860 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.886+0000 7fa6d1296700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc09c8b0 con 0x7fa6cc130ce0 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.886+0000 7fa6d1296700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0a2240 con 0x7fa6cc09e170 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.886+0000 7fa6ca7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc11d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6caffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc09d860 0x7fa6cc11cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6ca7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc11d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48078/0 (socket says 172.21.15.154:48078) 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/2304454201 learned_addr learned my addr 172.21.15.154:0/2304454201 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6cb7fe700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc130ce0 0x7fa6cc11da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc130ce0 msgr2=0x7fa6cc11da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6ca7fc700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc130ce0 0x7fa6cc11da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc09d860 msgr2=0x7fa6cc11cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6ca7fc700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc09d860 0x7fa6cc11cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6ca7fc700 1 -- 172.21.15.154:0/2304454201 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc00b7f0 con 0x7fa6cc09e170 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6caffd700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc09d860 0x7fa6cc11cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6cb7fe700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc130ce0 0x7fa6cc11da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6ca7fc700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc11d520 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00090b0 tx=0x7fa6c0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6b37fe700 1 -- 172.21.15.154:0/2304454201 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00042c0 con 0x7fa6cc09e170 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6b37fe700 1 -- 172.21.15.154:0/2304454201 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c001f070 con 0x7fa6cc09e170 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6d1296700 1 -- 172.21.15.154:0/2304454201 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c4009a70 con 0x7fa6cc09e170 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6b37fe700 1 -- 172.21.15.154:0/2304454201 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00036a0 con 0x7fa6cc09e170 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.887+0000 7fa6d1296700 1 -- 172.21.15.154:0/2304454201 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c00094a0 con 0x7fa6cc09e170 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.888+0000 7fa6b37fe700 1 -- 172.21.15.154:0/2304454201 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6c0021030 con 0x7fa6cc09e170 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.888+0000 7fa6b37fe700 1 -- 172.21.15.154:0/2304454201 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa6c0040650 con 0x7fa6cc09e170 2023-09-30T22:27:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.888+0000 7fa6d1296700 1 -- 172.21.15.154:0/2304454201 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc1206a0 con 0x7fa6cc09e170 2023-09-30T22:27:46.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.893+0000 7fa6b37fe700 1 -- 172.21.15.154:0/2304454201 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6c0010970 con 0x7fa6cc09e170 2023-09-30T22:27:46.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.979+0000 7f0d67f23700 1 Processor -- start 2023-09-30T22:27:46.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.979+0000 7f0d67f23700 1 -- start start 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d67f23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d67f23700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d60139200 0x7f0d6013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d67f23700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6009e9d0 con 0x7f0d600a0a70 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d67f23700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6009dc00 con 0x7f0d60139200 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d67f23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6009dec0 con 0x7f0d600a1550 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d664c0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d60139200 0x7f0d6013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d654be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d654be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47882/0 (socket says 172.21.15.154:47882) 2023-09-30T22:27:46.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d664c0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d60139200 0x7f0d6013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41120/0 (socket says 172.21.15.154:41120) 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d654be700 1 -- 172.21.15.154:0/3519732459 learned_addr learned my addr 172.21.15.154:0/3519732459 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d664c0700 1 -- 172.21.15.154:0/3519732459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 msgr2=0x7f0d60138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d664c0700 1 --2- 172.21.15.154:0/3519732459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d664c0700 1 -- 172.21.15.154:0/3519732459 >> v1:172.21.15.154:6789/0 conn(0x7f0d600a0a70 legacy=0x7f0d600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d664c0700 1 -- 172.21.15.154:0/3519732459 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6009e6a0 con 0x7f0d60139200 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d64cbd700 1 -- 172.21.15.154:0/3519732459 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990703080 0 0) 0x7f0d6009e9d0 con 0x7f0d600a0a70 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d654be700 1 --2- 172.21.15.154:0/3519732459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.980+0000 7f0d664c0700 1 --2- 172.21.15.154:0/3519732459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 0x7f0d6013b5e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ef9246db1af3a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d64cbd700 1 -- 172.21.15.154:0/3519732459 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800e070 con 0x7f0d60139200 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d64cbd700 1 -- 172.21.15.154:0/3519732459 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5800bb20 con 0x7f0d60139200 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d64cbd700 1 -- 172.21.15.154:0/3519732459 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58012430 con 0x7f0d60139200 2023-09-30T22:27:46.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d67f23700 1 -- 172.21.15.154:0/3519732459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 msgr2=0x7f0d6013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d67f23700 1 --2- 172.21.15.154:0/3519732459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 0x7f0d6013b5e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d67f23700 1 -- 172.21.15.154:0/3519732459 shutdown_connections 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d67f23700 1 --2- 172.21.15.154:0/3519732459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 0x7f0d6013b5e0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d67f23700 1 --2- 172.21.15.154:0/3519732459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d67f23700 1 -- 172.21.15.154:0/3519732459 >> 172.21.15.154:0/3519732459 conn(0x7f0d600a6610 msgr2=0x7f0d600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d67f23700 1 -- 172.21.15.154:0/3519732459 shutdown_connections 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.981+0000 7f0d67f23700 1 -- 172.21.15.154:0/3519732459 wait complete. 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.982+0000 7f0d67f23700 1 Processor -- start 2023-09-30T22:27:46.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.982+0000 7f0d67f23700 1 -- start start 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d67f23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d600a0a70 0x7f0d60120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d67f23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d67f23700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 0x7f0d601210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d67f23700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60124140 con 0x7f0d60139200 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d67f23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60122850 con 0x7f0d600a1550 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d67f23700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600a03e0 con 0x7f0d600a0a70 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d664c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 0x7f0d601210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d664c0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 0x7f0d601210a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41136/0 (socket says 172.21.15.154:41136) 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d664c0700 1 -- 172.21.15.154:0/3127156265 learned_addr learned my addr 172.21.15.154:0/3127156265 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d654be700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d65cbf700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d600a0a70 0x7f0d60120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d664c0700 1 -- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d600a0a70 msgr2=0x7f0d60120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d664c0700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d600a0a70 0x7f0d60120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d664c0700 1 -- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 msgr2=0x7f0d60120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:46.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d664c0700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d664c0700 1 -- 172.21.15.154:0/3127156265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50009550 con 0x7f0d60139200 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d654be700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d664c0700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 0x7f0d601210a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800b680 tx=0x7f0d58004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d567fc700 1 -- 172.21.15.154:0/3127156265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58012430 con 0x7f0d60139200 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d567fc700 1 -- 172.21.15.154:0/3127156265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58020070 con 0x7f0d60139200 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d567fc700 1 -- 172.21.15.154:0/3127156265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58004280 con 0x7f0d60139200 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d67f23700 1 -- 172.21.15.154:0/3127156265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d58009a70 con 0x7f0d60139200 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.983+0000 7f0d67f23700 1 -- 172.21.15.154:0/3127156265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60123ba0 con 0x7f0d60139200 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.984+0000 7f0d567fc700 1 -- 172.21.15.154:0/3127156265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d580043e0 con 0x7f0d60139200 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.984+0000 7f0d567fc700 1 -- 172.21.15.154:0/3127156265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d58022070 con 0x7f0d60139200 2023-09-30T22:27:46.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.984+0000 7f0d67f23700 1 -- 172.21.15.154:0/3127156265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6004f2a0 con 0x7f0d60139200 2023-09-30T22:27:46.991 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:46.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:46.989+0000 7f0d567fc700 1 -- 172.21.15.154:0/3127156265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d58012e10 con 0x7f0d60139200 2023-09-30T22:27:47.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.093+0000 7fa6d1296700 1 -- 172.21.15.154:0/2304454201 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa6cc04f2a0 con 0x7fa6cc09e170 2023-09-30T22:27:47.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.093+0000 7fa6b37fe700 1 -- 172.21.15.154:0/2304454201 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6c0015030 con 0x7fa6cc09e170 2023-09-30T22:27:47.095 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.096+0000 7fa6d1296700 1 -- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 msgr2=0x7fa6cc11d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.096+0000 7fa6d1296700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc11d520 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00090b0 tx=0x7fa6c0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.096+0000 7fa6d1296700 1 -- 172.21.15.154:0/2304454201 shutdown_connections 2023-09-30T22:27:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.096+0000 7fa6d1296700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6cc130ce0 0x7fa6cc11da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.096+0000 7fa6d1296700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6cc09d860 0x7fa6cc11cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.096+0000 7fa6d1296700 1 --2- 172.21.15.154:0/2304454201 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6cc09e170 0x7fa6cc11d520 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.096+0000 7fa6d1296700 1 -- 172.21.15.154:0/2304454201 >> 172.21.15.154:0/2304454201 conn(0x7fa6cc099c40 msgr2=0x7fa6cc12ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.096+0000 7fa6d1296700 1 -- 172.21.15.154:0/2304454201 shutdown_connections 2023-09-30T22:27:47.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.096+0000 7fa6d1296700 1 -- 172.21.15.154:0/2304454201 wait complete. 2023-09-30T22:27:47.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:47.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.116+0000 7fb765ab5700 1 Processor -- start 2023-09-30T22:27:47.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.116+0000 7fb765ab5700 1 -- start start 2023-09-30T22:27:47.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.116+0000 7fb765ab5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7601346e0 0x7fb760136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.116+0000 7fb765ab5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb7601393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.116+0000 7fb765ab5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7600a1640 con 0x7fb760131980 2023-09-30T22:27:47.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.116+0000 7fb765ab5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76006eb30 con 0x7fb760137000 2023-09-30T22:27:47.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.116+0000 7fb765ab5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600a22d0 con 0x7fb7601346e0 2023-09-30T22:27:47.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb7601393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb760131980 0x7fb760131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48038/0 (socket says 172.21.15.154:48038) 2023-09-30T22:27:47.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75f7fe700 1 -- 172.21.15.154:0/897032674 learned_addr learned my addr 172.21.15.154:0/897032674 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:47.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75effd700 1 --2- 172.21.15.154:0/897032674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7601346e0 0x7fb760136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75e7fc700 1 -- 172.21.15.154:0/897032674 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152302941 0 0) 0x7fb7600a1640 con 0x7fb760131980 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75e7fc700 1 -- 172.21.15.154:0/897032674 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7480035b0 con 0x7fb760131980 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75effd700 1 -- 172.21.15.154:0/897032674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 msgr2=0x7fb7601393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75effd700 1 --2- 172.21.15.154:0/897032674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb7601393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75effd700 1 -- 172.21.15.154:0/897032674 >> v1:172.21.15.154:6789/0 conn(0x7fb760131980 legacy=0x7fb760131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75effd700 1 -- 172.21.15.154:0/897032674 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760131550 con 0x7fb7601346e0 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75ffff700 1 --2- 172.21.15.154:0/897032674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb7601393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75effd700 1 --2- 172.21.15.154:0/897032674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7601346e0 0x7fb760136ac0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb754009870 tx=0x7fb754009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c3a7449d285bb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75e7fc700 1 -- 172.21.15.154:0/897032674 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754011830 con 0x7fb7601346e0 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75e7fc700 1 -- 172.21.15.154:0/897032674 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb754011990 con 0x7fb7601346e0 2023-09-30T22:27:47.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.117+0000 7fb75e7fc700 1 -- 172.21.15.154:0/897032674 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754011d00 con 0x7fb7601346e0 2023-09-30T22:27:47.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.118+0000 7fb765ab5700 1 -- 172.21.15.154:0/897032674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7601346e0 msgr2=0x7fb760136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.118+0000 7fb765ab5700 1 --2- 172.21.15.154:0/897032674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7601346e0 0x7fb760136ac0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb754009870 tx=0x7fb754009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:47.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.118+0000 7fb765ab5700 1 -- 172.21.15.154:0/897032674 shutdown_connections 2023-09-30T22:27:47.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.118+0000 7fb765ab5700 1 --2- 172.21.15.154:0/897032674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb7601393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.118+0000 7fb765ab5700 1 --2- 172.21.15.154:0/897032674 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb7601346e0 0x7fb760136ac0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.118+0000 7fb765ab5700 1 -- 172.21.15.154:0/897032674 >> 172.21.15.154:0/897032674 conn(0x7fb7600a2980 msgr2=0x7fb7600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.118+0000 7fb765ab5700 1 -- 172.21.15.154:0/897032674 shutdown_connections 2023-09-30T22:27:47.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.118+0000 7fb765ab5700 1 -- 172.21.15.154:0/897032674 wait complete. 2023-09-30T22:27:47.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.119+0000 7fb765ab5700 1 Processor -- start 2023-09-30T22:27:47.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.119+0000 7fb765ab5700 1 -- start start 2023-09-30T22:27:47.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb765ab5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb760131980 0x7fb760099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb765ab5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7601346e0 0x7fb760099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb765ab5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb76009a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb765ab5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76011d2a0 con 0x7fb7601346e0 2023-09-30T22:27:47.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb765ab5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76009fda0 con 0x7fb760137000 2023-09-30T22:27:47.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb765ab5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb760136bd0 con 0x7fb760131980 2023-09-30T22:27:47.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb76009a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb76009a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47906/0 (socket says 172.21.15.154:47906) 2023-09-30T22:27:47.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75ffff700 1 -- 172.21.15.154:0/4035584773 learned_addr learned my addr 172.21.15.154:0/4035584773 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75f7fe700 1 --2- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb760131980 0x7fb760099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75effd700 1 --2- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7601346e0 0x7fb760099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75ffff700 1 -- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb760131980 msgr2=0x7fb760099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75ffff700 1 --2- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb760131980 0x7fb760099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75ffff700 1 -- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7601346e0 msgr2=0x7fb760099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75ffff700 1 --2- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7601346e0 0x7fb760099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75ffff700 1 -- 172.21.15.154:0/4035584773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb758009a70 con 0x7fb760137000 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb75ffff700 1 --2- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb76009a4e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb75800efc0 tx=0x7fb75800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb747fff700 1 -- 172.21.15.154:0/4035584773 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75800cc90 con 0x7fb760137000 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb747fff700 1 -- 172.21.15.154:0/4035584773 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75800f040 con 0x7fb760137000 2023-09-30T22:27:47.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb765ab5700 1 -- 172.21.15.154:0/4035584773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7540094a0 con 0x7fb760137000 2023-09-30T22:27:47.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb747fff700 1 -- 172.21.15.154:0/4035584773 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580146c0 con 0x7fb760137000 2023-09-30T22:27:47.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.120+0000 7fb765ab5700 1 -- 172.21.15.154:0/4035584773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7600a1ca0 con 0x7fb760137000 2023-09-30T22:27:47.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.121+0000 7fb747fff700 1 -- 172.21.15.154:0/4035584773 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb758014820 con 0x7fb760137000 2023-09-30T22:27:47.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.122+0000 7fb747fff700 1 -- 172.21.15.154:0/4035584773 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7580402c0 con 0x7fb760137000 2023-09-30T22:27:47.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.122+0000 7fb765ab5700 1 -- 172.21.15.154:0/4035584773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76004f2a0 con 0x7fb760137000 2023-09-30T22:27:47.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.126+0000 7fb747fff700 1 -- 172.21.15.154:0/4035584773 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb758007920 con 0x7fb760137000 2023-09-30T22:27:47.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.185+0000 7f0d67f23700 1 -- 172.21.15.154:0/3127156265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d60122a20 con 0x7f0d60139200 2023-09-30T22:27:47.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.186+0000 7f0d567fc700 1 -- 172.21.15.154:0/3127156265 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d5801a380 con 0x7f0d60139200 2023-09-30T22:27:47.187 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.189+0000 7f0d67f23700 1 -- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 msgr2=0x7f0d601210a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.189+0000 7f0d67f23700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 0x7f0d601210a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800b680 tx=0x7f0d58004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.189+0000 7f0d67f23700 1 -- 172.21.15.154:0/3127156265 shutdown_connections 2023-09-30T22:27:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.189+0000 7f0d67f23700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60139200 0x7f0d601210a0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.189+0000 7f0d67f23700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d600a0a70 0x7f0d60120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.189+0000 7f0d67f23700 1 --2- 172.21.15.154:0/3127156265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d600a1550 0x7f0d60120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.189+0000 7f0d67f23700 1 -- 172.21.15.154:0/3127156265 >> 172.21.15.154:0/3127156265 conn(0x7f0d600a6610 msgr2=0x7f0d600a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.189+0000 7f0d67f23700 1 -- 172.21.15.154:0/3127156265 shutdown_connections 2023-09-30T22:27:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.189+0000 7f0d67f23700 1 -- 172.21.15.154:0/3127156265 wait complete. 2023-09-30T22:27:47.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:47.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:47.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.325+0000 7fb765ab5700 1 -- 172.21.15.154:0/4035584773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb76009f340 con 0x7fb760137000 2023-09-30T22:27:47.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.325+0000 7fb747fff700 1 -- 172.21.15.154:0/4035584773 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb75802c090 con 0x7fb760137000 2023-09-30T22:27:47.327 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.328+0000 7fb765ab5700 1 -- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 msgr2=0x7fb76009a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.328+0000 7fb765ab5700 1 --2- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb76009a4e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb75800efc0 tx=0x7fb75800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.328+0000 7fb765ab5700 1 -- 172.21.15.154:0/4035584773 shutdown_connections 2023-09-30T22:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.328+0000 7fb765ab5700 1 --2- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb760137000 0x7fb76009a4e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.328+0000 7fb765ab5700 1 --2- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb760131980 0x7fb760099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.328+0000 7fb765ab5700 1 --2- 172.21.15.154:0/4035584773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7601346e0 0x7fb760099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.328+0000 7fb765ab5700 1 -- 172.21.15.154:0/4035584773 >> 172.21.15.154:0/4035584773 conn(0x7fb7600a2980 msgr2=0x7fb760133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.328+0000 7fb765ab5700 1 -- 172.21.15.154:0/4035584773 shutdown_connections 2023-09-30T22:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.328+0000 7fb765ab5700 1 -- 172.21.15.154:0/4035584773 wait complete. 2023-09-30T22:27:47.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:47.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.371+0000 7fa37bce2700 1 Processor -- start 2023-09-30T22:27:47.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.371+0000 7fa37bce2700 1 -- start start 2023-09-30T22:27:47.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.371+0000 7fa37bce2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa37409e340 0x7fa3741359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.371+0000 7fa37bce2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa374135f20 0x7fa374138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.371+0000 7fa37bce2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa37409aaa0 con 0x7fa37409d860 2023-09-30T22:27:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.371+0000 7fa37bce2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37409e730 con 0x7fa37409e340 2023-09-30T22:27:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.371+0000 7fa37bce2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa37409f870 con 0x7fa374135f20 2023-09-30T22:27:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37a27f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa374135f20 0x7fa374138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37927d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa37409e340 0x7fa3741359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37927d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa37409e340 0x7fa3741359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41152/0 (socket says 172.21.15.154:41152) 2023-09-30T22:27:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37a27f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa374135f20 0x7fa374138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48132/0 (socket says 172.21.15.154:48132) 2023-09-30T22:27:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37927d700 1 -- 172.21.15.154:0/516391256 learned_addr learned my addr 172.21.15.154:0/516391256 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37a27f700 1 -- 172.21.15.154:0/516391256 >> v2:172.21.15.154:3300/0 conn(0x7fa37409e340 msgr2=0x7fa3741359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37a27f700 1 --2- 172.21.15.154:0/516391256 >> v2:172.21.15.154:3300/0 conn(0x7fa37409e340 0x7fa3741359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37a27f700 1 -- 172.21.15.154:0/516391256 >> v1:172.21.15.154:6789/0 conn(0x7fa37409d860 legacy=0x7fa37409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37a27f700 1 -- 172.21.15.154:0/516391256 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37409b360 con 0x7fa374135f20 2023-09-30T22:27:47.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa378a7c700 1 -- 172.21.15.154:0/516391256 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193242419 0 0) 0x7fa37409aaa0 con 0x7fa37409d860 2023-09-30T22:27:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37927d700 1 --2- 172.21.15.154:0/516391256 >> v2:172.21.15.154:3300/0 conn(0x7fa37409e340 0x7fa3741359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa37a27f700 1 --2- 172.21.15.154:0/516391256 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa374135f20 0x7fa374138300 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009dc0 tx=0x7fa36c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f93eb151245dbb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa378a7c700 1 -- 172.21.15.154:0/516391256 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00e070 con 0x7fa374135f20 2023-09-30T22:27:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa378a7c700 1 -- 172.21.15.154:0/516391256 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c00bae0 con 0x7fa374135f20 2023-09-30T22:27:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.372+0000 7fa378a7c700 1 -- 172.21.15.154:0/516391256 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00be90 con 0x7fa374135f20 2023-09-30T22:27:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.373+0000 7fa37bce2700 1 -- 172.21.15.154:0/516391256 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa374135f20 msgr2=0x7fa374138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.373+0000 7fa37bce2700 1 --2- 172.21.15.154:0/516391256 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa374135f20 0x7fa374138300 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009dc0 tx=0x7fa36c00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:47.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.373+0000 7fa37bce2700 1 -- 172.21.15.154:0/516391256 shutdown_connections 2023-09-30T22:27:47.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.373+0000 7fa37bce2700 1 --2- 172.21.15.154:0/516391256 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa374135f20 0x7fa374138300 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.373+0000 7fa37bce2700 1 --2- 172.21.15.154:0/516391256 >> v2:172.21.15.154:3300/0 conn(0x7fa37409e340 0x7fa3741359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.373+0000 7fa37bce2700 1 -- 172.21.15.154:0/516391256 >> 172.21.15.154:0/516391256 conn(0x7fa374099c40 msgr2=0x7fa3740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.373+0000 7fa37bce2700 1 -- 172.21.15.154:0/516391256 shutdown_connections 2023-09-30T22:27:47.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.373+0000 7fa37bce2700 1 -- 172.21.15.154:0/516391256 wait complete. 2023-09-30T22:27:47.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37bce2700 1 Processor -- start 2023-09-30T22:27:47.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37bce2700 1 -- start start 2023-09-30T22:27:47.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37bce2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa37409d860 0x7fa37411b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37bce2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37409e340 0x7fa37411b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37bce2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374135f20 0x7fa37411bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:47.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37bce2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37411c680 con 0x7fa374135f20 2023-09-30T22:27:47.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37bce2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37411d690 con 0x7fa37409e340 2023-09-30T22:27:47.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37bce2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa37411ecd0 con 0x7fa37409d860 2023-09-30T22:27:47.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37a27f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374135f20 0x7fa37411bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa379a7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa37409d860 0x7fa37411b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37927d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37409e340 0x7fa37411b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:47.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37a27f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374135f20 0x7fa37411bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41160/0 (socket says 172.21.15.154:41160) 2023-09-30T22:27:47.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa37a27f700 1 -- 172.21.15.154:0/3415682859 learned_addr learned my addr 172.21.15.154:0/3415682859 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:47.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.374+0000 7fa379a7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa37409d860 0x7fa37411b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48148/0 (socket says 172.21.15.154:48148) 2023-09-30T22:27:47.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa37a27f700 1 -- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa37409d860 msgr2=0x7fa37411b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa37a27f700 1 --2- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa37409d860 0x7fa37411b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa37a27f700 1 -- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37409e340 msgr2=0x7fa37411b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa37a27f700 1 --2- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37409e340 0x7fa37411b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa37a27f700 1 -- 172.21.15.154:0/3415682859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36400b7f0 con 0x7fa374135f20 2023-09-30T22:27:47.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa37a27f700 1 --2- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374135f20 0x7fa37411bc30 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fa36c013000 tx=0x7fa36c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:47.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa36a7fc700 1 -- 172.21.15.154:0/3415682859 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0045d0 con 0x7fa374135f20 2023-09-30T22:27:47.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa36a7fc700 1 -- 172.21.15.154:0/3415682859 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c020070 con 0x7fa374135f20 2023-09-30T22:27:47.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa37bce2700 1 -- 172.21.15.154:0/3415682859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c009a70 con 0x7fa374135f20 2023-09-30T22:27:47.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa36a7fc700 1 -- 172.21.15.154:0/3415682859 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c004970 con 0x7fa374135f20 2023-09-30T22:27:47.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.375+0000 7fa37bce2700 1 -- 172.21.15.154:0/3415682859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37409c8b0 con 0x7fa374135f20 2023-09-30T22:27:47.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.376+0000 7fa36a7fc700 1 -- 172.21.15.154:0/3415682859 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa36c012430 con 0x7fa374135f20 2023-09-30T22:27:47.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.376+0000 7fa36a7fc700 1 -- 172.21.15.154:0/3415682859 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa36c022070 con 0x7fa374135f20 2023-09-30T22:27:47.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.376+0000 7fa37bce2700 1 -- 172.21.15.154:0/3415682859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37411e870 con 0x7fa374135f20 2023-09-30T22:27:47.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.380+0000 7fa36a7fc700 1 -- 172.21.15.154:0/3415682859 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa36c01b400 con 0x7fa374135f20 2023-09-30T22:27:47.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.565+0000 7fa37bce2700 1 -- 172.21.15.154:0/3415682859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa37404f2a0 con 0x7fa374135f20 2023-09-30T22:27:47.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.566+0000 7fa36a7fc700 1 -- 172.21.15.154:0/3415682859 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa36c011390 con 0x7fa374135f20 2023-09-30T22:27:47.567 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.567+0000 7fa37bce2700 1 -- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374135f20 msgr2=0x7fa37411bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.567+0000 7fa37bce2700 1 --2- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374135f20 0x7fa37411bc30 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fa36c013000 tx=0x7fa36c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.568+0000 7fa37bce2700 1 -- 172.21.15.154:0/3415682859 shutdown_connections 2023-09-30T22:27:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.568+0000 7fa37bce2700 1 --2- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374135f20 0x7fa37411bc30 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.568+0000 7fa37bce2700 1 --2- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa37409d860 0x7fa37411b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.568+0000 7fa37bce2700 1 --2- 172.21.15.154:0/3415682859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37409e340 0x7fa37411b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.568+0000 7fa37bce2700 1 -- 172.21.15.154:0/3415682859 >> 172.21.15.154:0/3415682859 conn(0x7fa374099c40 msgr2=0x7fa374132830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.568+0000 7fa37bce2700 1 -- 172.21.15.154:0/3415682859 shutdown_connections 2023-09-30T22:27:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:47.568+0000 7fa37bce2700 1 -- 172.21.15.154:0/3415682859 wait complete. 2023-09-30T22:27:47.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:48.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:48.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:48.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.241+0000 7fd6b279c700 1 Processor -- start 2023-09-30T22:27:48.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.241+0000 7fd6b279c700 1 -- start start 2023-09-30T22:27:48.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6b279c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6ac0a0a30 0x7fd6ac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6b279c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6b279c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ac0a1e70 con 0x7fd6ac1304a0 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6b279c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac09a720 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6b279c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac09b300 con 0x7fd6ac0a1340 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6ab7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6abfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6ac0a0a30 0x7fd6ac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6abfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6ac0a0a30 0x7fd6ac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41168/0 (socket says 172.21.15.154:41168) 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6ab7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac12ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48156/0 (socket says 172.21.15.154:48156) 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6abfff700 1 -- 172.21.15.154:0/357619645 learned_addr learned my addr 172.21.15.154:0/357619645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6ab7fe700 1 -- 172.21.15.154:0/357619645 >> v2:172.21.15.154:3300/0 conn(0x7fd6ac0a0a30 msgr2=0x7fd6ac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6ab7fe700 1 --2- 172.21.15.154:0/357619645 >> v2:172.21.15.154:3300/0 conn(0x7fd6ac0a0a30 0x7fd6ac0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6ab7fe700 1 -- 172.21.15.154:0/357619645 >> v1:172.21.15.154:6789/0 conn(0x7fd6ac1304a0 legacy=0x7fd6ac1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6ab7fe700 1 -- 172.21.15.154:0/357619645 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac09abc0 con 0x7fd6ac0a1340 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6abfff700 1 --2- 172.21.15.154:0/357619645 >> v2:172.21.15.154:3300/0 conn(0x7fd6ac0a0a30 0x7fd6ac0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6ab7fe700 1 --2- 172.21.15.154:0/357619645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac12ff60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009840 tx=0x7fd6a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3b7abe1500e8729 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.242+0000 7fd6aaffd700 1 -- 172.21.15.154:0/357619645 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0011830 con 0x7fd6ac0a1340 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6aaffd700 1 -- 172.21.15.154:0/357619645 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a0011990 con 0x7fd6ac0a1340 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6aaffd700 1 -- 172.21.15.154:0/357619645 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0011d20 con 0x7fd6ac0a1340 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6b279c700 1 -- 172.21.15.154:0/357619645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 msgr2=0x7fd6ac12ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6b279c700 1 --2- 172.21.15.154:0/357619645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac12ff60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009840 tx=0x7fd6a0009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6b279c700 1 -- 172.21.15.154:0/357619645 shutdown_connections 2023-09-30T22:27:48.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6b279c700 1 --2- 172.21.15.154:0/357619645 >> v2:172.21.15.154:3300/0 conn(0x7fd6ac0a0a30 0x7fd6ac0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6b279c700 1 --2- 172.21.15.154:0/357619645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac12ff60 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6b279c700 1 -- 172.21.15.154:0/357619645 >> 172.21.15.154:0/357619645 conn(0x7fd6ac0a2980 msgr2=0x7fd6ac0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6b279c700 1 -- 172.21.15.154:0/357619645 shutdown_connections 2023-09-30T22:27:48.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.243+0000 7fd6b279c700 1 -- 172.21.15.154:0/357619645 wait complete. 2023-09-30T22:27:48.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.244+0000 7fd6b279c700 1 Processor -- start 2023-09-30T22:27:48.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6b279c700 1 -- start start 2023-09-30T22:27:48.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6b279c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6ac0a0a30 0x7fd6ac1c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6b279c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac1c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6b279c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1304a0 0x7fd6ac119f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6b279c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1b8db0 con 0x7fd6ac1304a0 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6b279c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac11d750 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6b279c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac09fd10 con 0x7fd6ac0a1340 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6ab7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac1c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6abfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6ac0a0a30 0x7fd6ac1c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6ab7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac1c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48164/0 (socket says 172.21.15.154:48164) 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6ab7fe700 1 -- 172.21.15.154:0/3328312903 learned_addr learned my addr 172.21.15.154:0/3328312903 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6abfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6ac0a0a30 0x7fd6ac1c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47918/0 (socket says 172.21.15.154:47918) 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.245+0000 7fd6b0d39700 1 --2- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1304a0 0x7fd6ac119f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6abfff700 1 -- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 msgr2=0x7fd6ac1c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6abfff700 1 --2- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac1c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6abfff700 1 -- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1304a0 msgr2=0x7fd6ac119f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6abfff700 1 --2- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1304a0 0x7fd6ac119f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6abfff700 1 -- 172.21.15.154:0/3328312903 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c00a6a0 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6ab7fe700 1 --2- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac1c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6abfff700 1 --2- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6ac0a0a30 0x7fd6ac1c4220 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00fb30 tx=0x7fd69c00fe40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6a8ff9700 1 -- 172.21.15.154:0/3328312903 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c005c20 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6a8ff9700 1 -- 172.21.15.154:0/3328312903 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c005d80 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6b279c700 1 -- 172.21.15.154:0/3328312903 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a00094a0 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6a8ff9700 1 -- 172.21.15.154:0/3328312903 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00db80 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.246+0000 7fd6b279c700 1 -- 172.21.15.154:0/3328312903 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac12e9d0 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.247+0000 7fd6b279c700 1 -- 172.21.15.154:0/3328312903 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac09ae80 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.248+0000 7fd6a8ff9700 1 -- 172.21.15.154:0/3328312903 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd69c00dce0 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.248+0000 7fd6a8ff9700 1 -- 172.21.15.154:0/3328312903 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd69c041070 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.252+0000 7fd6a8ff9700 1 -- 172.21.15.154:0/3328312903 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd69c024b90 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.334+0000 7ff7cea1d700 1 Processor -- start 2023-09-30T22:27:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.334+0000 7ff7cea1d700 1 -- start start 2023-09-30T22:27:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7cea1d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c8134140 0x7ff7c8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7cea1d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7c8134570 0x7ff7c813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7cea1d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c809b110 con 0x7ff7c809ad40 2023-09-30T22:27:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7cea1d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80a3b60 con 0x7ff7c8134570 2023-09-30T22:27:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7cea1d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80a1a80 con 0x7ff7c8134140 2023-09-30T22:27:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7ccfba700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7c8134570 0x7ff7c813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7ccfba700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7c8134570 0x7ff7c813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41176/0 (socket says 172.21.15.154:41176) 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7ccfba700 1 -- 172.21.15.154:0/3357538975 learned_addr learned my addr 172.21.15.154:0/3357538975 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7c77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c8134140 0x7ff7c8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7ccfba700 1 -- 172.21.15.154:0/3357538975 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c8134140 msgr2=0x7ff7c8138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7ccfba700 1 --2- 172.21.15.154:0/3357538975 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c8134140 0x7ff7c8138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7ccfba700 1 -- 172.21.15.154:0/3357538975 >> v1:172.21.15.154:6789/0 conn(0x7ff7c809ad40 legacy=0x7ff7c8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7ccfba700 1 -- 172.21.15.154:0/3357538975 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80a2fa0 con 0x7ff7c8134570 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7c77fe700 1 --2- 172.21.15.154:0/3357538975 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c8134140 0x7ff7c8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.335+0000 7ff7ccfba700 1 --2- 172.21.15.154:0/3357538975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134570 0x7ff7c813b3d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009e50 tx=0x7ff7c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1578a3ab70a069c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7c6ffd700 1 -- 172.21.15.154:0/3357538975 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000e070 con 0x7ff7c8134570 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7c6ffd700 1 -- 172.21.15.154:0/3357538975 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000b910 con 0x7ff7c8134570 2023-09-30T22:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7c6ffd700 1 -- 172.21.15.154:0/3357538975 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000bcc0 con 0x7ff7c8134570 2023-09-30T22:27:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7cea1d700 1 -- 172.21.15.154:0/3357538975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134570 msgr2=0x7ff7c813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7cea1d700 1 --2- 172.21.15.154:0/3357538975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134570 0x7ff7c813b3d0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009e50 tx=0x7ff7c000b330 comp rx=0 tx=0).stop 2023-09-30T22:27:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7cea1d700 1 -- 172.21.15.154:0/3357538975 shutdown_connections 2023-09-30T22:27:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7cea1d700 1 --2- 172.21.15.154:0/3357538975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134570 0x7ff7c813b3d0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7cea1d700 1 --2- 172.21.15.154:0/3357538975 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c8134140 0x7ff7c8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7cea1d700 1 -- 172.21.15.154:0/3357538975 >> 172.21.15.154:0/3357538975 conn(0x7ff7c8099c40 msgr2=0x7ff7c806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7cea1d700 1 -- 172.21.15.154:0/3357538975 shutdown_connections 2023-09-30T22:27:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.336+0000 7ff7cea1d700 1 -- 172.21.15.154:0/3357538975 wait complete. 2023-09-30T22:27:48.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.337+0000 7ff7cea1d700 1 Processor -- start 2023-09-30T22:27:48.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.337+0000 7ff7cea1d700 1 -- start start 2023-09-30T22:27:48.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7cea1d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c809ad40 0x7ff7c811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7cea1d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134140 0x7ff7c811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7cea1d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c8134570 0x7ff7c811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7cea1d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c811d9f0 con 0x7ff7c8134140 2023-09-30T22:27:48.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7cea1d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c809c7e0 con 0x7ff7c8134570 2023-09-30T22:27:48.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7cea1d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c811e8c0 con 0x7ff7c809ad40 2023-09-30T22:27:48.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c809ad40 0x7ff7c811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134140 0x7ff7c811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c809ad40 0x7ff7c811c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48182/0 (socket says 172.21.15.154:48182) 2023-09-30T22:27:48.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c7fff700 1 -- 172.21.15.154:0/1450835803 learned_addr learned my addr 172.21.15.154:0/1450835803 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:48.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7ccfba700 1 --2- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c8134570 0x7ff7c811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c77fe700 1 -- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c809ad40 msgr2=0x7ff7c811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c77fe700 1 --2- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c809ad40 0x7ff7c811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c77fe700 1 -- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c8134570 msgr2=0x7ff7c811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c77fe700 1 --2- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c8134570 0x7ff7c811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c77fe700 1 -- 172.21.15.154:0/1450835803 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0094a0 con 0x7ff7c8134140 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c77fe700 1 --2- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134140 0x7ff7c811ce00 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e900 tx=0x7ff7bc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c4ff9700 1 -- 172.21.15.154:0/1450835803 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc013680 con 0x7ff7c8134140 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c4ff9700 1 -- 172.21.15.154:0/1450835803 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc0137e0 con 0x7ff7c8134140 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7cea1d700 1 -- 172.21.15.154:0/1450835803 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c0009b30 con 0x7ff7c8134140 2023-09-30T22:27:48.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7c4ff9700 1 -- 172.21.15.154:0/1450835803 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc013b70 con 0x7ff7c8134140 2023-09-30T22:27:48.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.338+0000 7ff7cea1d700 1 -- 172.21.15.154:0/1450835803 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c80a5f60 con 0x7ff7c8134140 2023-09-30T22:27:48.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.339+0000 7ff7c4ff9700 1 -- 172.21.15.154:0/1450835803 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7bc013cd0 con 0x7ff7c8134140 2023-09-30T22:27:48.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.339+0000 7ff7c4ff9700 1 -- 172.21.15.154:0/1450835803 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff7bc03f9d0 con 0x7ff7c8134140 2023-09-30T22:27:48.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.339+0000 7ff7cea1d700 1 -- 172.21.15.154:0/1450835803 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c804f2a0 con 0x7ff7c8134140 2023-09-30T22:27:48.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:48.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.344+0000 7ff7c4ff9700 1 -- 172.21.15.154:0/1450835803 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7bc011db0 con 0x7ff7c8134140 2023-09-30T22:27:48.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.452+0000 7fd6b279c700 1 -- 172.21.15.154:0/3328312903 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd6ac04f2a0 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.452+0000 7fd6a8ff9700 1 -- 172.21.15.154:0/3328312903 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd69c02a090 con 0x7fd6ac0a0a30 2023-09-30T22:27:48.453 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.455+0000 7fd6b279c700 1 -- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6ac0a0a30 msgr2=0x7fd6ac1c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.455+0000 7fd6b279c700 1 --2- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6ac0a0a30 0x7fd6ac1c4220 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00fb30 tx=0x7fd69c00fe40 comp rx=0 tx=0).stop 2023-09-30T22:27:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.455+0000 7fd6b279c700 1 -- 172.21.15.154:0/3328312903 shutdown_connections 2023-09-30T22:27:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.455+0000 7fd6b279c700 1 --2- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6ac1304a0 0x7fd6ac119f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.455+0000 7fd6b279c700 1 --2- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6ac0a0a30 0x7fd6ac1c4220 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.455+0000 7fd6b279c700 1 --2- 172.21.15.154:0/3328312903 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd6ac0a1340 0x7fd6ac1c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.455+0000 7fd6b279c700 1 -- 172.21.15.154:0/3328312903 >> 172.21.15.154:0/3328312903 conn(0x7fd6ac0a2980 msgr2=0x7fd6ac09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.455+0000 7fd6b279c700 1 -- 172.21.15.154:0/3328312903 shutdown_connections 2023-09-30T22:27:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.455+0000 7fd6b279c700 1 -- 172.21.15.154:0/3328312903 wait complete. 2023-09-30T22:27:48.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd045d17700 1 Processor -- start 2023-09-30T22:27:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd045d17700 1 -- start start 2023-09-30T22:27:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd045d17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040133ad0 0x7fd040133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd045d17700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040130bc0 0x7fd04013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd045d17700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04006b2d0 con 0x7fd0401300a0 2023-09-30T22:27:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd045d17700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd040133610 con 0x7fd040133ad0 2023-09-30T22:27:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd045d17700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd04009a500 con 0x7fd040130bc0 2023-09-30T22:27:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd03f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040133ad0 0x7fd040133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd03f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040133ad0 0x7fd040133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47932/0 (socket says 172.21.15.154:47932) 2023-09-30T22:27:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd03effd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd0401300a0 0x7fd0401304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48066/0 (socket says 172.21.15.154:48066) 2023-09-30T22:27:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd03f7fe700 1 -- 172.21.15.154:0/942521326 learned_addr learned my addr 172.21.15.154:0/942521326 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.473+0000 7fd03ffff700 1 --2- 172.21.15.154:0/942521326 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040130bc0 0x7fd04013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.474+0000 7fd03f7fe700 1 -- 172.21.15.154:0/942521326 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040130bc0 msgr2=0x7fd04013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.474+0000 7fd03e7fc700 1 -- 172.21.15.154:0/942521326 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156829971 0 0) 0x7fd04006b2d0 con 0x7fd0401300a0 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.474+0000 7fd03f7fe700 1 --2- 172.21.15.154:0/942521326 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040130bc0 0x7fd04013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.474+0000 7fd03f7fe700 1 -- 172.21.15.154:0/942521326 >> v1:172.21.15.154:6789/0 conn(0x7fd0401300a0 legacy=0x7fd0401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.474+0000 7fd03f7fe700 1 -- 172.21.15.154:0/942521326 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0401338b0 con 0x7fd040133ad0 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.474+0000 7fd03f7fe700 1 --2- 172.21.15.154:0/942521326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040133ad0 0x7fd040133ea0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd030009920 tx=0x7fd030009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=167bae8d4a13361e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.474+0000 7fd03e7fc700 1 -- 172.21.15.154:0/942521326 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030011830 con 0x7fd040133ad0 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.474+0000 7fd03e7fc700 1 -- 172.21.15.154:0/942521326 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd030011990 con 0x7fd040133ad0 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.474+0000 7fd03e7fc700 1 -- 172.21.15.154:0/942521326 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd030011d20 con 0x7fd040133ad0 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.475+0000 7fd045d17700 1 -- 172.21.15.154:0/942521326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040133ad0 msgr2=0x7fd040133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.475+0000 7fd045d17700 1 --2- 172.21.15.154:0/942521326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040133ad0 0x7fd040133ea0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd030009920 tx=0x7fd030009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.475+0000 7fd045d17700 1 -- 172.21.15.154:0/942521326 shutdown_connections 2023-09-30T22:27:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.475+0000 7fd045d17700 1 --2- 172.21.15.154:0/942521326 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040130bc0 0x7fd04013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.475+0000 7fd045d17700 1 --2- 172.21.15.154:0/942521326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040133ad0 0x7fd040133ea0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.475+0000 7fd045d17700 1 -- 172.21.15.154:0/942521326 >> 172.21.15.154:0/942521326 conn(0x7fd040099c40 msgr2=0x7fd0400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.475+0000 7fd045d17700 1 -- 172.21.15.154:0/942521326 shutdown_connections 2023-09-30T22:27:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.475+0000 7fd045d17700 1 -- 172.21.15.154:0/942521326 wait complete. 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.475+0000 7fd045d17700 1 Processor -- start 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd045d17700 1 -- start start 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd045d17700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0401300a0 0x7fd04011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd045d17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040130bc0 0x7fd04011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd045d17700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040133ad0 0x7fd04011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd045d17700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04012da10 con 0x7fd0401300a0 2023-09-30T22:27:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd045d17700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd040120a30 con 0x7fd040130bc0 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd045d17700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd04012dd00 con 0x7fd040133ad0 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd03ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040133ad0 0x7fd04011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd03effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040130bc0 0x7fd04011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd03ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040133ad0 0x7fd04011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48204/0 (socket says 172.21.15.154:48204) 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd03ffff700 1 -- 172.21.15.154:0/4072190370 learned_addr learned my addr 172.21.15.154:0/4072190370 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.476+0000 7fd03f7fe700 1 --2- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0401300a0 0x7fd04011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd03effd700 1 -- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040133ad0 msgr2=0x7fd04011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd03effd700 1 --2- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040133ad0 0x7fd04011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd03effd700 1 -- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0401300a0 msgr2=0x7fd04011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd03effd700 1 --2- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0401300a0 0x7fd04011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd03effd700 1 -- 172.21.15.154:0/4072190370 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd030009550 con 0x7fd040130bc0 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd03ffff700 1 --2- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040133ad0 0x7fd04011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd03effd700 1 --2- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040130bc0 0x7fd04011df80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd04009ea20 tx=0x7fd03400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd027fff700 1 -- 172.21.15.154:0/4072190370 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034004a70 con 0x7fd040130bc0 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd027fff700 1 -- 172.21.15.154:0/4072190370 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034004bd0 con 0x7fd040130bc0 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd027fff700 1 -- 172.21.15.154:0/4072190370 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0340070d0 con 0x7fd040130bc0 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd045d17700 1 -- 172.21.15.154:0/4072190370 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04012fe60 con 0x7fd040130bc0 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.477+0000 7fd045d17700 1 -- 172.21.15.154:0/4072190370 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd040071720 con 0x7fd040130bc0 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.478+0000 7fd027fff700 1 -- 172.21.15.154:0/4072190370 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd034007230 con 0x7fd040130bc0 2023-09-30T22:27:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.478+0000 7fd027fff700 1 -- 172.21.15.154:0/4072190370 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd03403f220 con 0x7fd040130bc0 2023-09-30T22:27:48.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.478+0000 7fd045d17700 1 -- 172.21.15.154:0/4072190370 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04004f2a0 con 0x7fd040130bc0 2023-09-30T22:27:48.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.483+0000 7fd027fff700 1 -- 172.21.15.154:0/4072190370 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0340074e0 con 0x7fd040130bc0 2023-09-30T22:27:48.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.541+0000 7ff7cea1d700 1 -- 172.21.15.154:0/1450835803 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff7c80729d0 con 0x7ff7c8134140 2023-09-30T22:27:48.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.541+0000 7ff7c4ff9700 1 -- 172.21.15.154:0/1450835803 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7bc021030 con 0x7ff7c8134140 2023-09-30T22:27:48.543 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.543+0000 7ff7cea1d700 1 -- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134140 msgr2=0x7ff7c811ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.543+0000 7ff7cea1d700 1 --2- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134140 0x7ff7c811ce00 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e900 tx=0x7ff7bc00ec10 comp rx=0 tx=0).stop 2023-09-30T22:27:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.544+0000 7ff7cea1d700 1 -- 172.21.15.154:0/1450835803 shutdown_connections 2023-09-30T22:27:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.544+0000 7ff7cea1d700 1 --2- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c8134570 0x7ff7c811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.544+0000 7ff7cea1d700 1 --2- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7c809ad40 0x7ff7c811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.544+0000 7ff7cea1d700 1 --2- 172.21.15.154:0/1450835803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c8134140 0x7ff7c811ce00 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.544+0000 7ff7cea1d700 1 -- 172.21.15.154:0/1450835803 >> 172.21.15.154:0/1450835803 conn(0x7ff7c8099c40 msgr2=0x7ff7c80a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.544+0000 7ff7cea1d700 1 -- 172.21.15.154:0/1450835803 shutdown_connections 2023-09-30T22:27:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.544+0000 7ff7cea1d700 1 -- 172.21.15.154:0/1450835803 wait complete. 2023-09-30T22:27:48.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:48.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:48.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.675+0000 7fd045d17700 1 -- 172.21.15.154:0/4072190370 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd04006c3b0 con 0x7fd040130bc0 2023-09-30T22:27:48.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.675+0000 7fd027fff700 1 -- 172.21.15.154:0/4072190370 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd03401b340 con 0x7fd040130bc0 2023-09-30T22:27:48.676 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:48.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.677+0000 7fd045d17700 1 -- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040130bc0 msgr2=0x7fd04011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.677+0000 7fd045d17700 1 --2- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040130bc0 0x7fd04011df80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd04009ea20 tx=0x7fd03400c6a0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.677+0000 7fd045d17700 1 -- 172.21.15.154:0/4072190370 shutdown_connections 2023-09-30T22:27:48.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.677+0000 7fd045d17700 1 --2- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd040133ad0 0x7fd04011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.677+0000 7fd045d17700 1 --2- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0401300a0 0x7fd04011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.677+0000 7fd045d17700 1 --2- 172.21.15.154:0/4072190370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd040130bc0 0x7fd04011df80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.677+0000 7fd045d17700 1 -- 172.21.15.154:0/4072190370 >> 172.21.15.154:0/4072190370 conn(0x7fd040099c40 msgr2=0x7fd04012f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.678+0000 7fd045d17700 1 -- 172.21.15.154:0/4072190370 shutdown_connections 2023-09-30T22:27:48.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.678+0000 7fd045d17700 1 -- 172.21.15.154:0/4072190370 wait complete. 2023-09-30T22:27:48.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:48.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.722+0000 7fd5708c4700 1 Processor -- start 2023-09-30T22:27:48.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.722+0000 7fd5708c4700 1 -- start start 2023-09-30T22:27:48.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.722+0000 7fd5708c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.722+0000 7fd5708c4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd56c09f180 0x7fd56c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.722+0000 7fd5708c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 0x7fd56c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.722+0000 7fd5708c4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c0a0920 con 0x7fd56c09f180 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.722+0000 7fd5708c4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c09c970 con 0x7fd56c131d70 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.722+0000 7fd5708c4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c09bab0 con 0x7fd56c09e870 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd569d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd56c09f180 0x7fd56c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd56a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd56ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 0x7fd56c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd569d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd56c09f180 0x7fd56c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41200/0 (socket says 172.21.15.154:41200) 2023-09-30T22:27:48.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd569d9b700 1 -- 172.21.15.154:0/1811256987 learned_addr learned my addr 172.21.15.154:0/1811256987 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd569d9b700 1 -- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 msgr2=0x7fd56c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd569d9b700 1 --2- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd569d9b700 1 -- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 msgr2=0x7fd56c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd569d9b700 1 --2- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 0x7fd56c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd569d9b700 1 -- 172.21.15.154:0/1811256987 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c09f9c0 con 0x7fd56c09f180 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd56a59c700 1 --2- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd56ad9d700 1 --2- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 0x7fd56c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd569d9b700 1 --2- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 0x7fd56c131830 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009920 tx=0x7fd55c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ff67906bd33c90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd56959a700 1 -- 172.21.15.154:0/1811256987 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c011830 con 0x7fd56c09f180 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd56959a700 1 -- 172.21.15.154:0/1811256987 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55c011990 con 0x7fd56c09f180 2023-09-30T22:27:48.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.723+0000 7fd56959a700 1 -- 172.21.15.154:0/1811256987 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c011d20 con 0x7fd56c09f180 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.724+0000 7fd5708c4700 1 -- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 msgr2=0x7fd56c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.724+0000 7fd5708c4700 1 --2- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 0x7fd56c131830 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009920 tx=0x7fd55c009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.724+0000 7fd5708c4700 1 -- 172.21.15.154:0/1811256987 shutdown_connections 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.724+0000 7fd5708c4700 1 --2- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 0x7fd56c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.724+0000 7fd5708c4700 1 --2- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.724+0000 7fd5708c4700 1 --2- 172.21.15.154:0/1811256987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 0x7fd56c131830 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.724+0000 7fd5708c4700 1 -- 172.21.15.154:0/1811256987 >> 172.21.15.154:0/1811256987 conn(0x7fd56c0a4430 msgr2=0x7fd56c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.724+0000 7fd5708c4700 1 -- 172.21.15.154:0/1811256987 shutdown_connections 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.724+0000 7fd5708c4700 1 -- 172.21.15.154:0/1811256987 wait complete. 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd5708c4700 1 Processor -- start 2023-09-30T22:27:48.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd5708c4700 1 -- start start 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd5708c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd5708c4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 0x7fd56c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd5708c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 0x7fd56c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd5708c4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c06ccc0 con 0x7fd56c09f180 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd5708c4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c122600 con 0x7fd56c131d70 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd5708c4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c122b20 con 0x7fd56c09e870 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd56a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd569d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 0x7fd56c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd56a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48228/0 (socket says 172.21.15.154:48228) 2023-09-30T22:27:48.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.725+0000 7fd56a59c700 1 -- 172.21.15.154:0/1420916054 learned_addr learned my addr 172.21.15.154:0/1420916054 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd56ad9d700 1 --2- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 0x7fd56c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd56a59c700 1 -- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 msgr2=0x7fd56c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd56a59c700 1 --2- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 0x7fd56c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd56a59c700 1 -- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 msgr2=0x7fd56c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd56a59c700 1 --2- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 0x7fd56c06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd56a59c700 1 -- 172.21.15.154:0/1420916054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5600094a0 con 0x7fd56c09e870 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd569d9b700 1 --2- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 0x7fd56c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd56a59c700 1 --2- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c06b880 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd56000ebe0 tx=0x7fd56000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd55affd700 1 -- 172.21.15.154:0/1420916054 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560009780 con 0x7fd56c09e870 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd55affd700 1 -- 172.21.15.154:0/1420916054 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56000c850 con 0x7fd56c09e870 2023-09-30T22:27:48.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd5708c4700 1 -- 172.21.15.154:0/1420916054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd564009a70 con 0x7fd56c09e870 2023-09-30T22:27:48.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd55affd700 1 -- 172.21.15.154:0/1420916054 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000cbe0 con 0x7fd56c09e870 2023-09-30T22:27:48.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.726+0000 7fd5708c4700 1 -- 172.21.15.154:0/1420916054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55c009550 con 0x7fd56c09e870 2023-09-30T22:27:48.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.727+0000 7fd55affd700 1 -- 172.21.15.154:0/1420916054 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd56000cd40 con 0x7fd56c09e870 2023-09-30T22:27:48.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.727+0000 7fd55affd700 1 -- 172.21.15.154:0/1420916054 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd56003f720 con 0x7fd56c09e870 2023-09-30T22:27:48.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.727+0000 7fd5708c4700 1 -- 172.21.15.154:0/1420916054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c122920 con 0x7fd56c09e870 2023-09-30T22:27:48.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.732+0000 7fd55affd700 1 -- 172.21.15.154:0/1420916054 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5600232f0 con 0x7fd56c09e870 2023-09-30T22:27:48.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.915+0000 7fd5708c4700 1 -- 172.21.15.154:0/1420916054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd56c04f2a0 con 0x7fd56c09e870 2023-09-30T22:27:48.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.916+0000 7fd55affd700 1 -- 172.21.15.154:0/1420916054 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd560021020 con 0x7fd56c09e870 2023-09-30T22:27:48.917 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:48.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.918+0000 7fd5708c4700 1 -- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 msgr2=0x7fd56c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:48.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.918+0000 7fd5708c4700 1 --2- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c06b880 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd56000ebe0 tx=0x7fd56000eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.918+0000 7fd5708c4700 1 -- 172.21.15.154:0/1420916054 shutdown_connections 2023-09-30T22:27:48.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.918+0000 7fd5708c4700 1 --2- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd56c131d70 0x7fd56c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.918+0000 7fd5708c4700 1 --2- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd56c09e870 0x7fd56c06b880 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.918+0000 7fd5708c4700 1 --2- 172.21.15.154:0/1420916054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd56c09f180 0x7fd56c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:48.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.918+0000 7fd5708c4700 1 -- 172.21.15.154:0/1420916054 >> 172.21.15.154:0/1420916054 conn(0x7fd56c0a4430 msgr2=0x7fd56c09cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:48.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.918+0000 7fd5708c4700 1 -- 172.21.15.154:0/1420916054 shutdown_connections 2023-09-30T22:27:48.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:48.918+0000 7fd5708c4700 1 -- 172.21.15.154:0/1420916054 wait complete. 2023-09-30T22:27:48.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:49.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:49.558 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f1942702700 1 Processor -- start 2023-09-30T22:27:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f1942702700 1 -- start start 2023-09-30T22:27:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f1942702700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f193c134140 0x7f193c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f1942702700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f1942702700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c09b110 con 0x7f193c09ad40 2023-09-30T22:27:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f1942702700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c0a3b60 con 0x7f193c134140 2023-09-30T22:27:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f1942702700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0a1a80 con 0x7f193c1345a0 2023-09-30T22:27:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f193b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f193c134140 0x7f193c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f1940c9f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f193b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f193c134140 0x7f193c138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41218/0 (socket says 172.21.15.154:41218) 2023-09-30T22:27:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f1940c9f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c13b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47952/0 (socket says 172.21.15.154:47952) 2023-09-30T22:27:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.595+0000 7f193b7fe700 1 -- 172.21.15.154:0/2155784318 learned_addr learned my addr 172.21.15.154:0/2155784318 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f193b7fe700 1 -- 172.21.15.154:0/2155784318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 msgr2=0x7f193c13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f193b7fe700 1 --2- 172.21.15.154:0/2155784318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f193b7fe700 1 -- 172.21.15.154:0/2155784318 >> v1:172.21.15.154:6789/0 conn(0x7f193c09ad40 legacy=0x7f193c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f193b7fe700 1 -- 172.21.15.154:0/2155784318 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0a2fa0 con 0x7f193c134140 2023-09-30T22:27:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f1940c9f700 1 --2- 172.21.15.154:0/2155784318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f193b7fe700 1 --2- 172.21.15.154:0/2155784318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c134140 0x7f193c138e80 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f19300098f0 tx=0x7f1930009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b06617f33c75ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f193affd700 1 -- 172.21.15.154:0/2155784318 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930011830 con 0x7f193c134140 2023-09-30T22:27:49.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f193affd700 1 -- 172.21.15.154:0/2155784318 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1930011990 con 0x7f193c134140 2023-09-30T22:27:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f193affd700 1 -- 172.21.15.154:0/2155784318 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930011d20 con 0x7f193c134140 2023-09-30T22:27:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f1942702700 1 -- 172.21.15.154:0/2155784318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c134140 msgr2=0x7f193c138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.596+0000 7f1942702700 1 --2- 172.21.15.154:0/2155784318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c134140 0x7f193c138e80 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f19300098f0 tx=0x7f1930009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.597+0000 7f1942702700 1 -- 172.21.15.154:0/2155784318 shutdown_connections 2023-09-30T22:27:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.597+0000 7f1942702700 1 --2- 172.21.15.154:0/2155784318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.597+0000 7f1942702700 1 --2- 172.21.15.154:0/2155784318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c134140 0x7f193c138e80 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.597+0000 7f1942702700 1 -- 172.21.15.154:0/2155784318 >> 172.21.15.154:0/2155784318 conn(0x7f193c099c40 msgr2=0x7f193c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.597+0000 7f1942702700 1 -- 172.21.15.154:0/2155784318 shutdown_connections 2023-09-30T22:27:49.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.597+0000 7f1942702700 1 -- 172.21.15.154:0/2155784318 wait complete. 2023-09-30T22:27:49.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.598+0000 7f1942702700 1 Processor -- start 2023-09-30T22:27:49.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.598+0000 7f1942702700 1 -- start start 2023-09-30T22:27:49.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f1942702700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c09ad40 0x7f193c11c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f1942702700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c134140 0x7f193c11ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f1942702700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c11d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f1942702700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c11eeb0 con 0x7f193c09ad40 2023-09-30T22:27:49.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f1942702700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c11f820 con 0x7f193c1345a0 2023-09-30T22:27:49.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f1942702700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193c13a920 con 0x7f193c134140 2023-09-30T22:27:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c09ad40 0x7f193c11c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f1940c9f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c09ad40 0x7f193c11c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41222/0 (socket says 172.21.15.154:41222) 2023-09-30T22:27:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193bfff700 1 -- 172.21.15.154:0/1056138553 learned_addr learned my addr 172.21.15.154:0/1056138553 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193b7fe700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c134140 0x7f193c11ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193bfff700 1 -- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c134140 msgr2=0x7f193c11ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193bfff700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c134140 0x7f193c11ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193bfff700 1 -- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 msgr2=0x7f193c11d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193bfff700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c11d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193bfff700 1 -- 172.21.15.154:0/1056138553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934009a70 con 0x7f193c09ad40 2023-09-30T22:27:49.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f1940c9f700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c11d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193b7fe700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c134140 0x7f193c11ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.599+0000 7f193bfff700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c09ad40 0x7f193c11c8c0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c450 tx=0x7f192c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.600+0000 7f1938ff9700 1 -- 172.21.15.154:0/1056138553 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0052d0 con 0x7f193c09ad40 2023-09-30T22:27:49.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.600+0000 7f1938ff9700 1 -- 172.21.15.154:0/1056138553 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c005430 con 0x7f193c09ad40 2023-09-30T22:27:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.600+0000 7f1942702700 1 -- 172.21.15.154:0/1056138553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1930009550 con 0x7f193c09ad40 2023-09-30T22:27:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.600+0000 7f1938ff9700 1 -- 172.21.15.154:0/1056138553 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0038c0 con 0x7f193c09ad40 2023-09-30T22:27:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.600+0000 7f1942702700 1 -- 172.21.15.154:0/1056138553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c09c7e0 con 0x7f193c09ad40 2023-09-30T22:27:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.600+0000 7f1938ff9700 1 -- 172.21.15.154:0/1056138553 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f192c003a20 con 0x7f193c09ad40 2023-09-30T22:27:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.600+0000 7f1942702700 1 -- 172.21.15.154:0/1056138553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c04f2a0 con 0x7f193c09ad40 2023-09-30T22:27:49.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.601+0000 7f1938ff9700 1 -- 172.21.15.154:0/1056138553 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f192c03e9d0 con 0x7f193c09ad40 2023-09-30T22:27:49.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.605+0000 7f1938ff9700 1 -- 172.21.15.154:0/1056138553 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f192c019b40 con 0x7f193c09ad40 2023-09-30T22:27:49.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.684+0000 7fc3dca3d700 1 Processor -- start 2023-09-30T22:27:49.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.684+0000 7fc3dca3d700 1 -- start start 2023-09-30T22:27:49.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.684+0000 7fc3dca3d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.684+0000 7fc3dca3d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3d80a1380 0x7fc3d8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3dca3d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d809dc00 con 0x7fc3d8133f50 2023-09-30T22:27:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3dca3d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d809ea60 con 0x7fc3d80a1380 2023-09-30T22:27:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3dca3d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d809dec0 con 0x7fc3d80a0a70 2023-09-30T22:27:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d5d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3d80a1380 0x7fc3d8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d5d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3d80a1380 0x7fc3d8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41238/0 (socket says 172.21.15.154:41238) 2023-09-30T22:27:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d5d9b700 1 -- 172.21.15.154:0/1198071387 learned_addr learned my addr 172.21.15.154:0/1198071387 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d5d9b700 1 -- 172.21.15.154:0/1198071387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 msgr2=0x7fc3d80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d5d9b700 1 --2- 172.21.15.154:0/1198071387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d5d9b700 1 -- 172.21.15.154:0/1198071387 >> v1:172.21.15.154:6789/0 conn(0x7fc3d8133f50 legacy=0x7fc3d813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d5d9b700 1 -- 172.21.15.154:0/1198071387 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d809e6a0 con 0x7fc3d80a1380 2023-09-30T22:27:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d659c700 1 --2- 172.21.15.154:0/1198071387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d5d9b700 1 --2- 172.21.15.154:0/1198071387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 0x7fc3d8133a10 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0098f0 tx=0x7fc3cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce67285bf37c22cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d559a700 1 -- 172.21.15.154:0/1198071387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc011830 con 0x7fc3d80a1380 2023-09-30T22:27:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d559a700 1 -- 172.21.15.154:0/1198071387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc011990 con 0x7fc3d80a1380 2023-09-30T22:27:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.685+0000 7fc3d559a700 1 -- 172.21.15.154:0/1198071387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc011d20 con 0x7fc3d80a1380 2023-09-30T22:27:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.686+0000 7fc3dca3d700 1 -- 172.21.15.154:0/1198071387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 msgr2=0x7fc3d8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.686+0000 7fc3dca3d700 1 --2- 172.21.15.154:0/1198071387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 0x7fc3d8133a10 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0098f0 tx=0x7fc3cc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.686+0000 7fc3dca3d700 1 -- 172.21.15.154:0/1198071387 shutdown_connections 2023-09-30T22:27:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.686+0000 7fc3dca3d700 1 --2- 172.21.15.154:0/1198071387 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.686+0000 7fc3dca3d700 1 --2- 172.21.15.154:0/1198071387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 0x7fc3d8133a10 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.686+0000 7fc3dca3d700 1 -- 172.21.15.154:0/1198071387 >> 172.21.15.154:0/1198071387 conn(0x7fc3d80a6610 msgr2=0x7fc3d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.686+0000 7fc3dca3d700 1 -- 172.21.15.154:0/1198071387 shutdown_connections 2023-09-30T22:27:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.686+0000 7fc3dca3d700 1 -- 172.21.15.154:0/1198071387 wait complete. 2023-09-30T22:27:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.687+0000 7fc3dca3d700 1 Processor -- start 2023-09-30T22:27:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.687+0000 7fc3dca3d700 1 -- start start 2023-09-30T22:27:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.687+0000 7fc3dca3d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d81c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.687+0000 7fc3dca3d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 0x7fc3d81c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.687+0000 7fc3dca3d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d8133f50 0x7fc3d81c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.687+0000 7fc3dca3d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d81253f0 con 0x7fc3d80a1380 2023-09-30T22:27:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.687+0000 7fc3dca3d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8124680 con 0x7fc3d8133f50 2023-09-30T22:27:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.687+0000 7fc3dca3d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8122f50 con 0x7fc3d80a0a70 2023-09-30T22:27:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.687+0000 7fc3d659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d81c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 0x7fc3d81c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d81c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48254/0 (socket says 172.21.15.154:48254) 2023-09-30T22:27:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d659c700 1 -- 172.21.15.154:0/600545384 learned_addr learned my addr 172.21.15.154:0/600545384 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d6d9d700 1 --2- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d8133f50 0x7fc3d81c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d659c700 1 -- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d8133f50 msgr2=0x7fc3d81c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d659c700 1 --2- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d8133f50 0x7fc3d81c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d659c700 1 -- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 msgr2=0x7fc3d81c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d659c700 1 --2- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 0x7fc3d81c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d659c700 1 -- 172.21.15.154:0/600545384 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80094a0 con 0x7fc3d80a0a70 2023-09-30T22:27:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d5d9b700 1 --2- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 0x7fc3d81c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3d659c700 1 --2- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d81c8270 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800ec10 tx=0x7fc3c800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3c6ffd700 1 -- 172.21.15.154:0/600545384 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c800c850 con 0x7fc3d80a0a70 2023-09-30T22:27:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3c6ffd700 1 -- 172.21.15.154:0/600545384 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c800c9b0 con 0x7fc3d80a0a70 2023-09-30T22:27:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3dca3d700 1 -- 172.21.15.154:0/600545384 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc009550 con 0x7fc3d80a0a70 2023-09-30T22:27:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3c6ffd700 1 -- 172.21.15.154:0/600545384 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c800cd40 con 0x7fc3d80a0a70 2023-09-30T22:27:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.688+0000 7fc3dca3d700 1 -- 172.21.15.154:0/600545384 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d81262b0 con 0x7fc3d80a0a70 2023-09-30T22:27:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.689+0000 7fc3dca3d700 1 -- 172.21.15.154:0/600545384 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d804f2a0 con 0x7fc3d80a0a70 2023-09-30T22:27:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.690+0000 7fc3c6ffd700 1 -- 172.21.15.154:0/600545384 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3c8026480 con 0x7fc3d80a0a70 2023-09-30T22:27:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.690+0000 7fc3c6ffd700 1 -- 172.21.15.154:0/600545384 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc3c803fff0 con 0x7fc3d80a0a70 2023-09-30T22:27:49.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.698+0000 7fc3c6ffd700 1 -- 172.21.15.154:0/600545384 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3c8026730 con 0x7fc3d80a0a70 2023-09-30T22:27:49.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.803+0000 7f1942702700 1 -- 172.21.15.154:0/1056138553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f193c0729d0 con 0x7f193c09ad40 2023-09-30T22:27:49.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.803+0000 7f1938ff9700 1 -- 172.21.15.154:0/1056138553 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f192c017020 con 0x7f193c09ad40 2023-09-30T22:27:49.805 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.805+0000 7f1942702700 1 -- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c09ad40 msgr2=0x7f193c11c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.805+0000 7f1942702700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c09ad40 0x7f193c11c8c0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c450 tx=0x7f192c00c760 comp rx=0 tx=0).stop 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.805+0000 7f1942702700 1 -- 172.21.15.154:0/1056138553 shutdown_connections 2023-09-30T22:27:49.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.805+0000 7f1942702700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f193c1345a0 0x7f193c11d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.805+0000 7f1942702700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f193c09ad40 0x7f193c11c8c0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.805+0000 7f1942702700 1 --2- 172.21.15.154:0/1056138553 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f193c134140 0x7f193c11ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.805+0000 7f1942702700 1 -- 172.21.15.154:0/1056138553 >> 172.21.15.154:0/1056138553 conn(0x7f193c099c40 msgr2=0x7f193c0a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.806+0000 7f1942702700 1 -- 172.21.15.154:0/1056138553 shutdown_connections 2023-09-30T22:27:49.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.806+0000 7f1942702700 1 -- 172.21.15.154:0/1056138553 wait complete. 2023-09-30T22:27:49.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:49.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.825+0000 7f4e77673700 1 Processor -- start 2023-09-30T22:27:49.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.825+0000 7f4e77673700 1 -- start start 2023-09-30T22:27:49.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.825+0000 7f4e77673700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e70133ad0 0x7f4e70133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.825+0000 7f4e77673700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701300a0 0x7f4e701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.825+0000 7f4e77673700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7006b2d0 con 0x7f4e701309f0 2023-09-30T22:27:49.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.825+0000 7f4e77673700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70133610 con 0x7f4e701300a0 2023-09-30T22:27:49.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.825+0000 7f4e77673700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7009a500 con 0x7f4e70133ad0 2023-09-30T22:27:49.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e7540f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e70133ad0 0x7f4e70133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e74c0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701300a0 0x7f4e701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e7540f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e70133ad0 0x7f4e70133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48270/0 (socket says 172.21.15.154:48270) 2023-09-30T22:27:49.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e74c0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701300a0 0x7f4e701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:47994/0 (socket says 172.21.15.154:47994) 2023-09-30T22:27:49.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e7540f700 1 -- 172.21.15.154:0/3431576499 learned_addr learned my addr 172.21.15.154:0/3431576499 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:49.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e67fff700 1 -- 172.21.15.154:0/3431576499 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618994726 0 0) 0x7f4e7006b2d0 con 0x7f4e701309f0 2023-09-30T22:27:49.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e67fff700 1 -- 172.21.15.154:0/3431576499 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e5c0035b0 con 0x7f4e701309f0 2023-09-30T22:27:49.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e7540f700 1 -- 172.21.15.154:0/3431576499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701300a0 msgr2=0x7f4e701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e7540f700 1 --2- 172.21.15.154:0/3431576499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701300a0 0x7f4e701304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e7540f700 1 -- 172.21.15.154:0/3431576499 >> v1:172.21.15.154:6789/0 conn(0x7f4e701309f0 legacy=0x7f4e7013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e7540f700 1 -- 172.21.15.154:0/3431576499 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e701338b0 con 0x7f4e70133ad0 2023-09-30T22:27:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e74c0e700 1 --2- 172.21.15.154:0/3431576499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701300a0 0x7f4e701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e7540f700 1 --2- 172.21.15.154:0/3431576499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e70133ad0 0x7f4e70133ea0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009920 tx=0x7f4e6c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92c703b0c46d0644 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e67fff700 1 -- 172.21.15.154:0/3431576499 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c011830 con 0x7f4e70133ad0 2023-09-30T22:27:49.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e67fff700 1 -- 172.21.15.154:0/3431576499 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c011990 con 0x7f4e70133ad0 2023-09-30T22:27:49.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.826+0000 7f4e67fff700 1 -- 172.21.15.154:0/3431576499 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c011d20 con 0x7f4e70133ad0 2023-09-30T22:27:49.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.827+0000 7f4e77673700 1 -- 172.21.15.154:0/3431576499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e70133ad0 msgr2=0x7f4e70133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.827+0000 7f4e77673700 1 --2- 172.21.15.154:0/3431576499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e70133ad0 0x7f4e70133ea0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009920 tx=0x7f4e6c009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.827+0000 7f4e77673700 1 -- 172.21.15.154:0/3431576499 shutdown_connections 2023-09-30T22:27:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.827+0000 7f4e77673700 1 --2- 172.21.15.154:0/3431576499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e70133ad0 0x7f4e70133ea0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.827+0000 7f4e77673700 1 --2- 172.21.15.154:0/3431576499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701300a0 0x7f4e701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.827+0000 7f4e77673700 1 -- 172.21.15.154:0/3431576499 >> 172.21.15.154:0/3431576499 conn(0x7f4e70099c40 msgr2=0x7f4e700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.827+0000 7f4e77673700 1 -- 172.21.15.154:0/3431576499 shutdown_connections 2023-09-30T22:27:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.827+0000 7f4e77673700 1 -- 172.21.15.154:0/3431576499 wait complete. 2023-09-30T22:27:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e77673700 1 Processor -- start 2023-09-30T22:27:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e77673700 1 -- start start 2023-09-30T22:27:49.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e77673700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e701300a0 0x7f4e7011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e77673700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701309f0 0x7f4e7011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e77673700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e70133ad0 0x7f4e7011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:49.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e77673700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7011fde0 con 0x7f4e70133ad0 2023-09-30T22:27:49.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e77673700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7011fbb0 con 0x7f4e701309f0 2023-09-30T22:27:49.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e77673700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7011f040 con 0x7f4e701300a0 2023-09-30T22:27:49.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e7540f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e701300a0 0x7f4e7011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e75c10700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e70133ad0 0x7f4e7011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e74c0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701309f0 0x7f4e7011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:49.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e7540f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e701300a0 0x7f4e7011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48280/0 (socket says 172.21.15.154:48280) 2023-09-30T22:27:49.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.828+0000 7f4e7540f700 1 -- 172.21.15.154:0/2451090232 learned_addr learned my addr 172.21.15.154:0/2451090232 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:49.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e74c0e700 1 -- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e701300a0 msgr2=0x7f4e7011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e74c0e700 1 --2- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e701300a0 0x7f4e7011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e74c0e700 1 -- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e70133ad0 msgr2=0x7f4e7011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e74c0e700 1 --2- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e70133ad0 0x7f4e7011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e74c0e700 1 -- 172.21.15.154:0/2451090232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600094a0 con 0x7f4e701309f0 2023-09-30T22:27:49.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e75c10700 1 --2- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e70133ad0 0x7f4e7011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e7540f700 1 --2- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e701300a0 0x7f4e7011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:49.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e74c0e700 1 --2- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701309f0 0x7f4e7011df80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000e900 tx=0x7f4e6000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:49.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e65ffb700 1 -- 172.21.15.154:0/2451090232 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60013680 con 0x7f4e701309f0 2023-09-30T22:27:49.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e65ffb700 1 -- 172.21.15.154:0/2451090232 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e600137e0 con 0x7f4e701309f0 2023-09-30T22:27:49.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e77673700 1 -- 172.21.15.154:0/2451090232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c009550 con 0x7f4e701309f0 2023-09-30T22:27:49.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e65ffb700 1 -- 172.21.15.154:0/2451090232 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60013b70 con 0x7f4e701309f0 2023-09-30T22:27:49.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.829+0000 7f4e77673700 1 -- 172.21.15.154:0/2451090232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e700a3400 con 0x7f4e701309f0 2023-09-30T22:27:49.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.830+0000 7f4e65ffb700 1 -- 172.21.15.154:0/2451090232 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e60013cd0 con 0x7f4e701309f0 2023-09-30T22:27:49.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.830+0000 7f4e77673700 1 -- 172.21.15.154:0/2451090232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7011f490 con 0x7f4e701309f0 2023-09-30T22:27:49.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.830+0000 7f4e65ffb700 1 -- 172.21.15.154:0/2451090232 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e6003f9d0 con 0x7f4e701309f0 2023-09-30T22:27:49.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.835+0000 7f4e65ffb700 1 -- 172.21.15.154:0/2451090232 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e60011db0 con 0x7f4e701309f0 2023-09-30T22:27:49.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.893+0000 7fc3dca3d700 1 -- 172.21.15.154:0/600545384 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3d80a2710 con 0x7fc3d80a0a70 2023-09-30T22:27:49.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.894+0000 7fc3c6ffd700 1 -- 172.21.15.154:0/600545384 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3c802b090 con 0x7fc3d80a0a70 2023-09-30T22:27:49.895 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.896+0000 7fc3dca3d700 1 -- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 msgr2=0x7fc3d81c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.896+0000 7fc3dca3d700 1 --2- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d81c8270 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800ec10 tx=0x7fc3c800ef20 comp rx=0 tx=0).stop 2023-09-30T22:27:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.896+0000 7fc3dca3d700 1 -- 172.21.15.154:0/600545384 shutdown_connections 2023-09-30T22:27:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.896+0000 7fc3dca3d700 1 --2- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d8133f50 0x7fc3d81c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.896+0000 7fc3dca3d700 1 --2- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d80a0a70 0x7fc3d81c8270 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.896+0000 7fc3dca3d700 1 --2- 172.21.15.154:0/600545384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d80a1380 0x7fc3d81c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:49.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.896+0000 7fc3dca3d700 1 -- 172.21.15.154:0/600545384 >> 172.21.15.154:0/600545384 conn(0x7fc3d80a6610 msgr2=0x7fc3d80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:49.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.896+0000 7fc3dca3d700 1 -- 172.21.15.154:0/600545384 shutdown_connections 2023-09-30T22:27:49.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:49.896+0000 7fc3dca3d700 1 -- 172.21.15.154:0/600545384 wait complete. 2023-09-30T22:27:49.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:49.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:50.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.030+0000 7f4e77673700 1 -- 172.21.15.154:0/2451090232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e700a2620 con 0x7f4e701309f0 2023-09-30T22:27:50.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.030+0000 7f4e65ffb700 1 -- 172.21.15.154:0/2451090232 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e60021070 con 0x7f4e701309f0 2023-09-30T22:27:50.032 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:50.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.032+0000 7f4e77673700 1 -- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701309f0 msgr2=0x7f4e7011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.032+0000 7f4e77673700 1 --2- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701309f0 0x7f4e7011df80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000e900 tx=0x7f4e6000ec10 comp rx=0 tx=0).stop 2023-09-30T22:27:50.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.033+0000 7f4e77673700 1 -- 172.21.15.154:0/2451090232 shutdown_connections 2023-09-30T22:27:50.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.033+0000 7f4e77673700 1 --2- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e70133ad0 0x7f4e7011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.033+0000 7f4e77673700 1 --2- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4e701300a0 0x7f4e7011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.033+0000 7f4e77673700 1 --2- 172.21.15.154:0/2451090232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e701309f0 0x7f4e7011df80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.033+0000 7f4e77673700 1 -- 172.21.15.154:0/2451090232 >> 172.21.15.154:0/2451090232 conn(0x7f4e70099c40 msgr2=0x7f4e7012f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:50.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.033+0000 7f4e77673700 1 -- 172.21.15.154:0/2451090232 shutdown_connections 2023-09-30T22:27:50.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.033+0000 7f4e77673700 1 -- 172.21.15.154:0/2451090232 wait complete. 2023-09-30T22:27:50.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:50.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.073+0000 7f75aec44700 1 Processor -- start 2023-09-30T22:27:50.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.073+0000 7f75aec44700 1 -- start start 2023-09-30T22:27:50.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.073+0000 7f75aec44700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75a8133ad0 0x7f75a8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.073+0000 7f75aec44700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81300a0 0x7f75a81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75aec44700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a806b2d0 con 0x7f75a81309f0 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75aec44700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a8133610 con 0x7f75a8133ad0 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75aec44700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75a809a500 con 0x7f75a81300a0 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81300a0 0x7f75a81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75ac9e0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75a8133ad0 0x7f75a8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75ac9e0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75a8133ad0 0x7f75a8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41266/0 (socket says 172.21.15.154:41266) 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75ac9e0700 1 -- 172.21.15.154:0/2453816810 learned_addr learned my addr 172.21.15.154:0/2453816810 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81300a0 0x7f75a81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48290/0 (socket says 172.21.15.154:48290) 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a7fff700 1 -- 172.21.15.154:0/2453816810 >> v2:172.21.15.154:3300/0 conn(0x7f75a8133ad0 msgr2=0x7f75a8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a7fff700 1 --2- 172.21.15.154:0/2453816810 >> v2:172.21.15.154:3300/0 conn(0x7f75a8133ad0 0x7f75a8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a7fff700 1 -- 172.21.15.154:0/2453816810 >> v1:172.21.15.154:6789/0 conn(0x7f75a81309f0 legacy=0x7f75a813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a7fff700 1 -- 172.21.15.154:0/2453816810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a81338b0 con 0x7f75a81300a0 2023-09-30T22:27:50.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75ac9e0700 1 --2- 172.21.15.154:0/2453816810 >> v2:172.21.15.154:3300/0 conn(0x7f75a8133ad0 0x7f75a8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:50.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a7fff700 1 --2- 172.21.15.154:0/2453816810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81300a0 0x7f75a81304b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7594009840 tx=0x7f7594009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3202d4bfe7e6505 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:50.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a77fe700 1 -- 172.21.15.154:0/2453816810 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594011830 con 0x7f75a81300a0 2023-09-30T22:27:50.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a77fe700 1 -- 172.21.15.154:0/2453816810 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7594011990 con 0x7f75a81300a0 2023-09-30T22:27:50.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.074+0000 7f75a77fe700 1 -- 172.21.15.154:0/2453816810 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594011d20 con 0x7f75a81300a0 2023-09-30T22:27:50.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.075+0000 7f75aec44700 1 -- 172.21.15.154:0/2453816810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81300a0 msgr2=0x7f75a81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.075+0000 7f75aec44700 1 --2- 172.21.15.154:0/2453816810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81300a0 0x7f75a81304b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7594009840 tx=0x7f7594009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:50.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.075+0000 7f75aec44700 1 -- 172.21.15.154:0/2453816810 shutdown_connections 2023-09-30T22:27:50.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.075+0000 7f75aec44700 1 --2- 172.21.15.154:0/2453816810 >> v2:172.21.15.154:3300/0 conn(0x7f75a8133ad0 0x7f75a8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.075+0000 7f75aec44700 1 --2- 172.21.15.154:0/2453816810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81300a0 0x7f75a81304b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.075+0000 7f75aec44700 1 -- 172.21.15.154:0/2453816810 >> 172.21.15.154:0/2453816810 conn(0x7f75a8099c40 msgr2=0x7f75a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:50.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.075+0000 7f75aec44700 1 -- 172.21.15.154:0/2453816810 shutdown_connections 2023-09-30T22:27:50.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.075+0000 7f75aec44700 1 -- 172.21.15.154:0/2453816810 wait complete. 2023-09-30T22:27:50.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.076+0000 7f75aec44700 1 Processor -- start 2023-09-30T22:27:50.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.076+0000 7f75aec44700 1 -- start start 2023-09-30T22:27:50.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.076+0000 7f75aec44700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75a81300a0 0x7f75a811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.076+0000 7f75aec44700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81309f0 0x7f75a811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.076+0000 7f75aec44700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a8133ad0 0x7f75a811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.076+0000 7f75aec44700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a812fdf0 con 0x7f75a8133ad0 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.076+0000 7f75aec44700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a812dd00 con 0x7f75a81300a0 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.076+0000 7f75aec44700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8072380 con 0x7f75a81309f0 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ac9e0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75a81300a0 0x7f75a811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ad1e1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a8133ad0 0x7f75a811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81309f0 0x7f75a811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ac9e0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75a81300a0 0x7f75a811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48006/0 (socket says 172.21.15.154:48006) 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ac9e0700 1 -- 172.21.15.154:0/3756301360 learned_addr learned my addr 172.21.15.154:0/3756301360 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ac9e0700 1 -- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81309f0 msgr2=0x7f75a811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ac9e0700 1 --2- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81309f0 0x7f75a811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ac9e0700 1 -- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a8133ad0 msgr2=0x7f75a811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ac9e0700 1 --2- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a8133ad0 0x7f75a811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ac9e0700 1 -- 172.21.15.154:0/3756301360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c009550 con 0x7f75a81300a0 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75a7fff700 1 --2- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81309f0 0x7f75a811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ad1e1700 1 --2- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a8133ad0 0x7f75a811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75ac9e0700 1 --2- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75a81300a0 0x7f75a811da40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f759c00ebe0 tx=0x7f759c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75a57fa700 1 -- 172.21.15.154:0/3756301360 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c00c850 con 0x7f75a81300a0 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75a57fa700 1 -- 172.21.15.154:0/3756301360 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c00c9b0 con 0x7f75a81300a0 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75aec44700 1 -- 172.21.15.154:0/3756301360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75940094a0 con 0x7f75a81300a0 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75a57fa700 1 -- 172.21.15.154:0/3756301360 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c00cd40 con 0x7f75a81300a0 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.077+0000 7f75aec44700 1 -- 172.21.15.154:0/3756301360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a811ff20 con 0x7f75a81300a0 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.078+0000 7f75aec44700 1 -- 172.21.15.154:0/3756301360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a804f2a0 con 0x7f75a81300a0 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.079+0000 7f75a57fa700 1 -- 172.21.15.154:0/3756301360 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f759c013470 con 0x7f75a81300a0 2023-09-30T22:27:50.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.079+0000 7f75a57fa700 1 -- 172.21.15.154:0/3756301360 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f759c040070 con 0x7f75a81300a0 2023-09-30T22:27:50.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.083+0000 7f75a57fa700 1 -- 172.21.15.154:0/3756301360 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f759c024760 con 0x7f75a81300a0 2023-09-30T22:27:50.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.267+0000 7f75aec44700 1 -- 172.21.15.154:0/3756301360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75a806c3b0 con 0x7f75a81300a0 2023-09-30T22:27:50.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.267+0000 7f75a57fa700 1 -- 172.21.15.154:0/3756301360 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f759c017020 con 0x7f75a81300a0 2023-09-30T22:27:50.269 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:50.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.269+0000 7f75aec44700 1 -- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75a81300a0 msgr2=0x7f75a811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.269+0000 7f75aec44700 1 --2- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75a81300a0 0x7f75a811da40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f759c00ebe0 tx=0x7f759c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.270+0000 7f75aec44700 1 -- 172.21.15.154:0/3756301360 shutdown_connections 2023-09-30T22:27:50.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.270+0000 7f75aec44700 1 --2- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a8133ad0 0x7f75a811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.270+0000 7f75aec44700 1 --2- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75a81300a0 0x7f75a811da40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.270+0000 7f75aec44700 1 --2- 172.21.15.154:0/3756301360 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75a81309f0 0x7f75a811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.270+0000 7f75aec44700 1 -- 172.21.15.154:0/3756301360 >> 172.21.15.154:0/3756301360 conn(0x7f75a8099c40 msgr2=0x7f75a8131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:50.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.270+0000 7f75aec44700 1 -- 172.21.15.154:0/3756301360 shutdown_connections 2023-09-30T22:27:50.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.270+0000 7f75aec44700 1 -- 172.21.15.154:0/3756301360 wait complete. 2023-09-30T22:27:50.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:50.820 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:50.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:50.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.946+0000 7fef785fe700 1 Processor -- start 2023-09-30T22:27:50.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.946+0000 7fef785fe700 1 -- start start 2023-09-30T22:27:50.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef785fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef7009ad40 0x7fef70133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef785fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef785fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef700a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef785fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef700a3b60 con 0x7fef7009ad40 2023-09-30T22:27:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef785fe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef701348e0 con 0x7fef700a0a70 2023-09-30T22:27:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef785fe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7009b110 con 0x7fef70133f70 2023-09-30T22:27:50.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef76b9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef700a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef75b99700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef7639a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef7009ad40 0x7fef70133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef75b99700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48302/0 (socket says 172.21.15.154:48302) 2023-09-30T22:27:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef75b99700 1 -- 172.21.15.154:0/3384800839 learned_addr learned my addr 172.21.15.154:0/3384800839 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef76b9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef700a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48012/0 (socket says 172.21.15.154:48012) 2023-09-30T22:27:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef75b99700 1 -- 172.21.15.154:0/3384800839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 msgr2=0x7fef700a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef75b99700 1 --2- 172.21.15.154:0/3384800839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef700a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef75b99700 1 -- 172.21.15.154:0/3384800839 >> v2:172.21.15.154:3300/0 conn(0x7fef7009ad40 msgr2=0x7fef70133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef75b99700 1 --2- 172.21.15.154:0/3384800839 >> v2:172.21.15.154:3300/0 conn(0x7fef7009ad40 0x7fef70133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef75b99700 1 -- 172.21.15.154:0/3384800839 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700a2fa0 con 0x7fef70133f70 2023-09-30T22:27:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.947+0000 7fef7639a700 1 --2- 172.21.15.154:0/3384800839 >> v2:172.21.15.154:3300/0 conn(0x7fef7009ad40 0x7fef70133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef75b99700 1 --2- 172.21.15.154:0/3384800839 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701343a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fef60009920 tx=0x7fef60009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a80b0a3e39747d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef75398700 1 -- 172.21.15.154:0/3384800839 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60011830 con 0x7fef70133f70 2023-09-30T22:27:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef75398700 1 -- 172.21.15.154:0/3384800839 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef60011990 con 0x7fef70133f70 2023-09-30T22:27:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef75398700 1 -- 172.21.15.154:0/3384800839 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60011d20 con 0x7fef70133f70 2023-09-30T22:27:50.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef785fe700 1 -- 172.21.15.154:0/3384800839 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 msgr2=0x7fef701343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef785fe700 1 --2- 172.21.15.154:0/3384800839 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701343a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fef60009920 tx=0x7fef60009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef785fe700 1 -- 172.21.15.154:0/3384800839 shutdown_connections 2023-09-30T22:27:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef785fe700 1 --2- 172.21.15.154:0/3384800839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef700a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef785fe700 1 --2- 172.21.15.154:0/3384800839 >> v2:172.21.15.154:3300/0 conn(0x7fef7009ad40 0x7fef70133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef785fe700 1 --2- 172.21.15.154:0/3384800839 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701343a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef785fe700 1 -- 172.21.15.154:0/3384800839 >> 172.21.15.154:0/3384800839 conn(0x7fef70099c40 msgr2=0x7fef7006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:50.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.948+0000 7fef785fe700 1 -- 172.21.15.154:0/3384800839 shutdown_connections 2023-09-30T22:27:50.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.949+0000 7fef785fe700 1 -- 172.21.15.154:0/3384800839 wait complete. 2023-09-30T22:27:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.949+0000 7fef785fe700 1 Processor -- start 2023-09-30T22:27:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.949+0000 7fef785fe700 1 -- start start 2023-09-30T22:27:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef785fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef7009ad40 0x7fef701c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef785fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef701c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef785fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef785fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef70122330 con 0x7fef7009ad40 2023-09-30T22:27:50.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef785fe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef70133820 con 0x7fef700a0a70 2023-09-30T22:27:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef785fe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef70122070 con 0x7fef70133f70 2023-09-30T22:27:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef75b99700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef701c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef76b9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef75b99700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef701c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48018/0 (socket says 172.21.15.154:48018) 2023-09-30T22:27:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef75b99700 1 -- 172.21.15.154:0/921117232 learned_addr learned my addr 172.21.15.154:0/921117232 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef7639a700 1 --2- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef7009ad40 0x7fef701c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef76b9b700 1 -- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 msgr2=0x7fef701c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef76b9b700 1 --2- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef701c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef76b9b700 1 -- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef7009ad40 msgr2=0x7fef701c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef76b9b700 1 --2- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef7009ad40 0x7fef701c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef76b9b700 1 -- 172.21.15.154:0/921117232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0094a0 con 0x7fef70133f70 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.950+0000 7fef76b9b700 1 --2- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701c8d80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fef6800efc0 tx=0x7fef6800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.951+0000 7fef66ffd700 1 -- 172.21.15.154:0/921117232 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6800cc90 con 0x7fef70133f70 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.951+0000 7fef66ffd700 1 -- 172.21.15.154:0/921117232 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6800f040 con 0x7fef70133f70 2023-09-30T22:27:50.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.951+0000 7fef785fe700 1 -- 172.21.15.154:0/921117232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef60009550 con 0x7fef70133f70 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.951+0000 7fef66ffd700 1 -- 172.21.15.154:0/921117232 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680146c0 con 0x7fef70133f70 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.951+0000 7fef785fe700 1 -- 172.21.15.154:0/921117232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef70122da0 con 0x7fef70133f70 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.951+0000 7fef785fe700 1 -- 172.21.15.154:0/921117232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef70122570 con 0x7fef70133f70 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.952+0000 7fef66ffd700 1 -- 172.21.15.154:0/921117232 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef68014820 con 0x7fef70133f70 2023-09-30T22:27:50.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.952+0000 7fef66ffd700 1 -- 172.21.15.154:0/921117232 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef68040920 con 0x7fef70133f70 2023-09-30T22:27:50.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:50.956+0000 7fef66ffd700 1 -- 172.21.15.154:0/921117232 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef68014ad0 con 0x7fef70133f70 2023-09-30T22:27:51.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.036+0000 7f720b391700 1 Processor -- start 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.036+0000 7f720b391700 1 -- start start 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720b391700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f720409ad40 0x7f7204133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720b391700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72041343a0 0x7f72040a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720b391700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720409b110 con 0x7f7204133f70 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720b391700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72040a3b60 con 0x7f72041343a0 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720b391700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72040a2fa0 con 0x7f720409ad40 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720912d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f720409ad40 0x7f7204133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720992e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72041343a0 0x7f72040a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720912d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f720409ad40 0x7f7204133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48310/0 (socket says 172.21.15.154:48310) 2023-09-30T22:27:51.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720992e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72041343a0 0x7f72040a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41294/0 (socket says 172.21.15.154:41294) 2023-09-30T22:27:51.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720912d700 1 -- 172.21.15.154:0/1733555807 learned_addr learned my addr 172.21.15.154:0/1733555807 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:51.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720992e700 1 -- 172.21.15.154:0/1733555807 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f720409ad40 msgr2=0x7f7204133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:51.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720992e700 1 --2- 172.21.15.154:0/1733555807 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f720409ad40 0x7f7204133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720992e700 1 -- 172.21.15.154:0/1733555807 >> v1:172.21.15.154:6789/0 conn(0x7f7204133f70 legacy=0x7f72040a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f71fbfff700 1 -- 172.21.15.154:0/1733555807 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656976172 0 0) 0x7f720409b110 con 0x7f7204133f70 2023-09-30T22:27:51.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720992e700 1 -- 172.21.15.154:0/1733555807 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720409a280 con 0x7f72041343a0 2023-09-30T22:27:51.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720912d700 1 --2- 172.21.15.154:0/1733555807 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f720409ad40 0x7f7204133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f720992e700 1 --2- 172.21.15.154:0/1733555807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72041343a0 0x7f72040a1180 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009d90 tx=0x7f71fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662ce2b380fd1370 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f71fbfff700 1 -- 172.21.15.154:0/1733555807 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00e070 con 0x7f72041343a0 2023-09-30T22:27:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f71fbfff700 1 -- 172.21.15.154:0/1733555807 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00bb20 con 0x7f72041343a0 2023-09-30T22:27:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.037+0000 7f71fbfff700 1 -- 172.21.15.154:0/1733555807 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc012430 con 0x7f72041343a0 2023-09-30T22:27:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.038+0000 7f720b391700 1 -- 172.21.15.154:0/1733555807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72041343a0 msgr2=0x7f72040a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.038+0000 7f720b391700 1 --2- 172.21.15.154:0/1733555807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72041343a0 0x7f72040a1180 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009d90 tx=0x7f71fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:27:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.038+0000 7f720b391700 1 -- 172.21.15.154:0/1733555807 shutdown_connections 2023-09-30T22:27:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.038+0000 7f720b391700 1 --2- 172.21.15.154:0/1733555807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72041343a0 0x7f72040a1180 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.038+0000 7f720b391700 1 --2- 172.21.15.154:0/1733555807 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f720409ad40 0x7f7204133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.038+0000 7f720b391700 1 -- 172.21.15.154:0/1733555807 >> 172.21.15.154:0/1733555807 conn(0x7f7204099c40 msgr2=0x7f720406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.038+0000 7f720b391700 1 -- 172.21.15.154:0/1733555807 shutdown_connections 2023-09-30T22:27:51.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.038+0000 7f720b391700 1 -- 172.21.15.154:0/1733555807 wait complete. 2023-09-30T22:27:51.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.039+0000 7f720b391700 1 Processor -- start 2023-09-30T22:27:51.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.039+0000 7f720b391700 1 -- start start 2023-09-30T22:27:51.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720b391700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720409ad40 0x7f72041c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720b391700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7204133f70 0x7f72041c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720b391700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72041343a0 0x7f72041c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720b391700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720411efd0 con 0x7f7204133f70 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720b391700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7204120730 con 0x7f720409ad40 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720b391700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7204122740 con 0x7f72041343a0 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720992e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72041343a0 0x7f72041c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720912d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720409ad40 0x7f72041c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720992e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72041343a0 0x7f72041c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48326/0 (socket says 172.21.15.154:48326) 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720912d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720409ad40 0x7f72041c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48020/0 (socket says 172.21.15.154:48020) 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720992e700 1 -- 172.21.15.154:0/1281858543 learned_addr learned my addr 172.21.15.154:0/1281858543 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:51.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720892c700 1 --2- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7204133f70 0x7f72041c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720992e700 1 -- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720409ad40 msgr2=0x7f72041c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720992e700 1 --2- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720409ad40 0x7f72041c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720992e700 1 -- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7204133f70 msgr2=0x7f72041c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720992e700 1 --2- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7204133f70 0x7f72041c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.040+0000 7f720992e700 1 -- 172.21.15.154:0/1281858543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200009550 con 0x7f72041343a0 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.041+0000 7f720992e700 1 --2- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72041343a0 0x7f72041c8ba0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00b680 tx=0x7f71fc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.041+0000 7f71f9ffb700 1 -- 172.21.15.154:0/1281858543 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc012430 con 0x7f72041343a0 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.041+0000 7f71f9ffb700 1 -- 172.21.15.154:0/1281858543 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc020070 con 0x7f72041343a0 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.041+0000 7f720b391700 1 -- 172.21.15.154:0/1281858543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc009a70 con 0x7f72041343a0 2023-09-30T22:27:51.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.041+0000 7f71f9ffb700 1 -- 172.21.15.154:0/1281858543 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc01bbc0 con 0x7f72041343a0 2023-09-30T22:27:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.041+0000 7f720b391700 1 -- 172.21.15.154:0/1281858543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7204120f20 con 0x7f72041343a0 2023-09-30T22:27:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.042+0000 7f720b391700 1 -- 172.21.15.154:0/1281858543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720404f2a0 con 0x7f72041343a0 2023-09-30T22:27:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.042+0000 7f71f9ffb700 1 -- 172.21.15.154:0/1281858543 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71fc01bd20 con 0x7f72041343a0 2023-09-30T22:27:51.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.042+0000 7f71f9ffb700 1 -- 172.21.15.154:0/1281858543 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71fc041300 con 0x7f72041343a0 2023-09-30T22:27:51.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.047+0000 7f71f9ffb700 1 -- 172.21.15.154:0/1281858543 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71fc02d310 con 0x7f72041343a0 2023-09-30T22:27:51.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.152+0000 7fef785fe700 1 -- 172.21.15.154:0/921117232 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef7004f2a0 con 0x7fef70133f70 2023-09-30T22:27:51.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.152+0000 7fef66ffd700 1 -- 172.21.15.154:0/921117232 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef680263e0 con 0x7fef70133f70 2023-09-30T22:27:51.154 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:51.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.154+0000 7fef785fe700 1 -- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 msgr2=0x7fef701c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.154+0000 7fef785fe700 1 --2- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701c8d80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fef6800efc0 tx=0x7fef6800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.154+0000 7fef785fe700 1 -- 172.21.15.154:0/921117232 shutdown_connections 2023-09-30T22:27:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.154+0000 7fef785fe700 1 --2- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef70133f70 0x7fef701c8d80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.154+0000 7fef785fe700 1 --2- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef7009ad40 0x7fef701c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.154+0000 7fef785fe700 1 --2- 172.21.15.154:0/921117232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef700a0a70 0x7fef701c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.154+0000 7fef785fe700 1 -- 172.21.15.154:0/921117232 >> 172.21.15.154:0/921117232 conn(0x7fef70099c40 msgr2=0x7fef700a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.155+0000 7fef785fe700 1 -- 172.21.15.154:0/921117232 shutdown_connections 2023-09-30T22:27:51.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.155+0000 7fef785fe700 1 -- 172.21.15.154:0/921117232 wait complete. 2023-09-30T22:27:51.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:51.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.175+0000 7fc905815700 1 Processor -- start 2023-09-30T22:27:51.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.175+0000 7fc905815700 1 -- start start 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc905815700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc9000a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc905815700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9000a13a0 0x7fc900133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc905815700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc900133f70 0x7fc900134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc905815700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9000a3aa0 con 0x7fc900133f70 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc905815700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90009a540 con 0x7fc9000a0a90 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc905815700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9000a1fe0 con 0x7fc9000a13a0 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc9000a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8ff7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc900133f70 0x7fc900134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8fe7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9000a13a0 0x7fc900133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc9000a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48026/0 (socket says 172.21.15.154:48026) 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8feffd700 1 -- 172.21.15.154:0/2704485850 learned_addr learned my addr 172.21.15.154:0/2704485850 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8feffd700 1 -- 172.21.15.154:0/2704485850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9000a13a0 msgr2=0x7fc900133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8feffd700 1 --2- 172.21.15.154:0/2704485850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9000a13a0 0x7fc900133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8feffd700 1 -- 172.21.15.154:0/2704485850 >> v2:172.21.15.154:3300/0 conn(0x7fc900133f70 msgr2=0x7fc900134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8feffd700 1 --2- 172.21.15.154:0/2704485850 >> v2:172.21.15.154:3300/0 conn(0x7fc900133f70 0x7fc900134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8feffd700 1 -- 172.21.15.154:0/2704485850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90009a280 con 0x7fc9000a0a90 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8ff7fe700 1 --2- 172.21.15.154:0/2704485850 >> v2:172.21.15.154:3300/0 conn(0x7fc900133f70 0x7fc900134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8fe7fc700 1 --2- 172.21.15.154:0/2704485850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9000a13a0 0x7fc900133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.176+0000 7fc8feffd700 1 --2- 172.21.15.154:0/2704485850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc9000a0e60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40098f0 tx=0x7fc8f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77d10ce39c07e768 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc8fdffb700 1 -- 172.21.15.154:0/2704485850 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4011830 con 0x7fc9000a0a90 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc8fdffb700 1 -- 172.21.15.154:0/2704485850 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f4011990 con 0x7fc9000a0a90 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc8fdffb700 1 -- 172.21.15.154:0/2704485850 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4011d20 con 0x7fc9000a0a90 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc905815700 1 -- 172.21.15.154:0/2704485850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 msgr2=0x7fc9000a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc905815700 1 --2- 172.21.15.154:0/2704485850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc9000a0e60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40098f0 tx=0x7fc8f4009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc905815700 1 -- 172.21.15.154:0/2704485850 shutdown_connections 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc905815700 1 --2- 172.21.15.154:0/2704485850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc9000a0e60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc905815700 1 --2- 172.21.15.154:0/2704485850 >> v2:172.21.15.154:3300/0 conn(0x7fc900133f70 0x7fc900134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc905815700 1 --2- 172.21.15.154:0/2704485850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc9000a13a0 0x7fc900133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc905815700 1 -- 172.21.15.154:0/2704485850 >> 172.21.15.154:0/2704485850 conn(0x7fc900099c40 msgr2=0x7fc90006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc905815700 1 -- 172.21.15.154:0/2704485850 shutdown_connections 2023-09-30T22:27:51.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.177+0000 7fc905815700 1 -- 172.21.15.154:0/2704485850 wait complete. 2023-09-30T22:27:51.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.178+0000 7fc905815700 1 Processor -- start 2023-09-30T22:27:51.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.178+0000 7fc905815700 1 -- start start 2023-09-30T22:27:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc905815700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc900121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc905815700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9000a13a0 0x7fc9001218b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc905815700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc900133f70 0x7fc900121df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc905815700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc900124c50 con 0x7fc9000a13a0 2023-09-30T22:27:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc905815700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc900122f80 con 0x7fc9000a0a90 2023-09-30T22:27:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc905815700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc900123e10 con 0x7fc900133f70 2023-09-30T22:27:51.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc900121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc900121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48034/0 (socket says 172.21.15.154:48034) 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8feffd700 1 -- 172.21.15.154:0/83187114 learned_addr learned my addr 172.21.15.154:0/83187114 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8fe7fc700 1 --2- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9000a13a0 0x7fc9001218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8ff7fe700 1 --2- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc900133f70 0x7fc900121df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8feffd700 1 -- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc900133f70 msgr2=0x7fc900121df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8feffd700 1 --2- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc900133f70 0x7fc900121df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8feffd700 1 -- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9000a13a0 msgr2=0x7fc9001218b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8feffd700 1 --2- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9000a13a0 0x7fc9001218b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8feffd700 1 -- 172.21.15.154:0/83187114 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f00094a0 con 0x7fc9000a0a90 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.179+0000 7fc8feffd700 1 --2- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc900121370 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4000c00 tx=0x7fc8f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.180+0000 7fc8e7fff700 1 -- 172.21.15.154:0/83187114 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4004240 con 0x7fc9000a0a90 2023-09-30T22:27:51.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.180+0000 7fc8e7fff700 1 -- 172.21.15.154:0/83187114 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f401f070 con 0x7fc9000a0a90 2023-09-30T22:27:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.180+0000 7fc905815700 1 -- 172.21.15.154:0/83187114 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f8009a70 con 0x7fc9000a0a90 2023-09-30T22:27:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.180+0000 7fc8e7fff700 1 -- 172.21.15.154:0/83187114 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40045c0 con 0x7fc9000a0a90 2023-09-30T22:27:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.180+0000 7fc905815700 1 -- 172.21.15.154:0/83187114 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f4009550 con 0x7fc9000a0a90 2023-09-30T22:27:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.180+0000 7fc8e7fff700 1 -- 172.21.15.154:0/83187114 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8f4021030 con 0x7fc9000a0a90 2023-09-30T22:27:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.181+0000 7fc8e7fff700 1 -- 172.21.15.154:0/83187114 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc8f40408d0 con 0x7fc9000a0a90 2023-09-30T22:27:51.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.181+0000 7fc905815700 1 -- 172.21.15.154:0/83187114 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90011e060 con 0x7fc9000a0a90 2023-09-30T22:27:51.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.189+0000 7fc8e7fff700 1 -- 172.21.15.154:0/83187114 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8f401a450 con 0x7fc9000a0a90 2023-09-30T22:27:51.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.247+0000 7f720b391700 1 -- 172.21.15.154:0/1281858543 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7204122e30 con 0x7f72041343a0 2023-09-30T22:27:51.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.247+0000 7f71f9ffb700 1 -- 172.21.15.154:0/1281858543 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71fc02eb90 con 0x7f72041343a0 2023-09-30T22:27:51.249 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:51.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.251+0000 7f720b391700 1 -- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72041343a0 msgr2=0x7f72041c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.251+0000 7f720b391700 1 --2- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72041343a0 0x7f72041c8ba0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00b680 tx=0x7f71fc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.251+0000 7f720b391700 1 -- 172.21.15.154:0/1281858543 shutdown_connections 2023-09-30T22:27:51.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.251+0000 7f720b391700 1 --2- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f72041343a0 0x7f72041c8ba0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.251+0000 7f720b391700 1 --2- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720409ad40 0x7f72041c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.251+0000 7f720b391700 1 --2- 172.21.15.154:0/1281858543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7204133f70 0x7f72041c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.251+0000 7f720b391700 1 -- 172.21.15.154:0/1281858543 >> 172.21.15.154:0/1281858543 conn(0x7f7204099c40 msgr2=0x7f72041bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.251+0000 7f720b391700 1 -- 172.21.15.154:0/1281858543 shutdown_connections 2023-09-30T22:27:51.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.251+0000 7f720b391700 1 -- 172.21.15.154:0/1281858543 wait complete. 2023-09-30T22:27:51.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:51.283 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:51.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.394+0000 7fc905815700 1 -- 172.21.15.154:0/83187114 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc90004f2a0 con 0x7fc9000a0a90 2023-09-30T22:27:51.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.395+0000 7fc8e7fff700 1 -- 172.21.15.154:0/83187114 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8f40193b0 con 0x7fc9000a0a90 2023-09-30T22:27:51.396 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.397+0000 7fc905815700 1 -- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 msgr2=0x7fc900121370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.397+0000 7fc905815700 1 --2- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc900121370 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4000c00 tx=0x7fc8f4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.397+0000 7fc905815700 1 -- 172.21.15.154:0/83187114 shutdown_connections 2023-09-30T22:27:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.397+0000 7fc905815700 1 --2- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc900133f70 0x7fc900121df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.397+0000 7fc905815700 1 --2- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9000a0a90 0x7fc900121370 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.397+0000 7fc905815700 1 --2- 172.21.15.154:0/83187114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9000a13a0 0x7fc9001218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.397+0000 7fc905815700 1 -- 172.21.15.154:0/83187114 >> 172.21.15.154:0/83187114 conn(0x7fc900099c40 msgr2=0x7fc900133280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.397+0000 7fc905815700 1 -- 172.21.15.154:0/83187114 shutdown_connections 2023-09-30T22:27:51.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.397+0000 7fc905815700 1 -- 172.21.15.154:0/83187114 wait complete. 2023-09-30T22:27:51.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:51.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a6bd07700 1 Processor -- start 2023-09-30T22:27:51.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a6bd07700 1 -- start start 2023-09-30T22:27:51.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a6bd07700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a64133a70 0x7f9a64133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a6bd07700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a640a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a6bd07700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a64133640 con 0x7f9a640a1290 2023-09-30T22:27:51.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a6bd07700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640a1d50 con 0x7f9a64133a70 2023-09-30T22:27:51.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a6bd07700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640a1730 con 0x7f9a640a08e0 2023-09-30T22:27:51.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a692a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a640a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a6a2a4700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9a640a1290 0x7f9a6413a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48118/0 (socket says 172.21.15.154:48118) 2023-09-30T22:27:51.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a6a2a4700 1 -- 172.21.15.154:0/2316709569 learned_addr learned my addr 172.21.15.154:0/2316709569 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:51.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.432+0000 7f9a69aa3700 1 --2- 172.21.15.154:0/2316709569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a64133a70 0x7f9a64133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a68aa1700 1 -- 172.21.15.154:0/2316709569 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429206405 0 0) 0x7f9a64133640 con 0x7f9a640a1290 2023-09-30T22:27:51.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a692a2700 1 -- 172.21.15.154:0/2316709569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a64133a70 msgr2=0x7f9a64133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:51.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a692a2700 1 --2- 172.21.15.154:0/2316709569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a64133a70 0x7f9a64133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a692a2700 1 -- 172.21.15.154:0/2316709569 >> v1:172.21.15.154:6789/0 conn(0x7f9a640a1290 legacy=0x7f9a6413a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a692a2700 1 -- 172.21.15.154:0/2316709569 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6409b620 con 0x7f9a640a08e0 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a69aa3700 1 --2- 172.21.15.154:0/2316709569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a64133a70 0x7f9a64133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a692a2700 1 --2- 172.21.15.154:0/2316709569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a640a0d50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009870 tx=0x7f9a60009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2a3da123bf7e967 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a68aa1700 1 -- 172.21.15.154:0/2316709569 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60011830 con 0x7f9a640a08e0 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a68aa1700 1 -- 172.21.15.154:0/2316709569 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a60011990 con 0x7f9a640a08e0 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a68aa1700 1 -- 172.21.15.154:0/2316709569 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60011d20 con 0x7f9a640a08e0 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a6bd07700 1 -- 172.21.15.154:0/2316709569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 msgr2=0x7f9a640a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.433+0000 7f9a6bd07700 1 --2- 172.21.15.154:0/2316709569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a640a0d50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009870 tx=0x7f9a60009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.434+0000 7f9a6bd07700 1 -- 172.21.15.154:0/2316709569 shutdown_connections 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.434+0000 7f9a6bd07700 1 --2- 172.21.15.154:0/2316709569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a64133a70 0x7f9a64133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.434+0000 7f9a6bd07700 1 --2- 172.21.15.154:0/2316709569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a640a0d50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.434+0000 7f9a6bd07700 1 -- 172.21.15.154:0/2316709569 >> 172.21.15.154:0/2316709569 conn(0x7f9a640a2980 msgr2=0x7f9a640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.434+0000 7f9a6bd07700 1 -- 172.21.15.154:0/2316709569 shutdown_connections 2023-09-30T22:27:51.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.434+0000 7f9a6bd07700 1 -- 172.21.15.154:0/2316709569 wait complete. 2023-09-30T22:27:51.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.434+0000 7f9a6bd07700 1 Processor -- start 2023-09-30T22:27:51.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a6bd07700 1 -- start start 2023-09-30T22:27:51.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a6bd07700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a6411b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a6bd07700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a640a1290 0x7f9a6411be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a6bd07700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64133a70 0x7f9a6411c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a6bd07700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6411d9c0 con 0x7f9a64133a70 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a6bd07700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6411ed80 con 0x7f9a640a1290 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a6bd07700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6411d520 con 0x7f9a640a08e0 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a69aa3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a6411b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a6a2a4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64133a70 0x7f9a6411c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a69aa3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a6411b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48364/0 (socket says 172.21.15.154:48364) 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a69aa3700 1 -- 172.21.15.154:0/1633179238 learned_addr learned my addr 172.21.15.154:0/1633179238 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a692a2700 1 --2- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a640a1290 0x7f9a6411be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a69aa3700 1 -- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a640a1290 msgr2=0x7f9a6411be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a69aa3700 1 --2- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a640a1290 0x7f9a6411be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a69aa3700 1 -- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64133a70 msgr2=0x7f9a6411c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a69aa3700 1 --2- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64133a70 0x7f9a6411c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a69aa3700 1 -- 172.21.15.154:0/1633179238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54009430 con 0x7f9a640a08e0 2023-09-30T22:27:51.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a6a2a4700 1 --2- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64133a70 0x7f9a6411c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:51.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.435+0000 7f9a69aa3700 1 --2- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a6411b8d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400ebe0 tx=0x7f9a5400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:51.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.436+0000 7f9a5a7fc700 1 -- 172.21.15.154:0/1633179238 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a54005a20 con 0x7f9a640a08e0 2023-09-30T22:27:51.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.436+0000 7f9a5a7fc700 1 -- 172.21.15.154:0/1633179238 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a54005b80 con 0x7f9a640a08e0 2023-09-30T22:27:51.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.436+0000 7f9a6bd07700 1 -- 172.21.15.154:0/1633179238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a600094a0 con 0x7f9a640a08e0 2023-09-30T22:27:51.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.436+0000 7f9a5a7fc700 1 -- 172.21.15.154:0/1633179238 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400c850 con 0x7f9a640a08e0 2023-09-30T22:27:51.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.436+0000 7f9a6bd07700 1 -- 172.21.15.154:0/1633179238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6409a350 con 0x7f9a640a08e0 2023-09-30T22:27:51.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.436+0000 7f9a5a7fc700 1 -- 172.21.15.154:0/1633179238 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a5400c9b0 con 0x7f9a640a08e0 2023-09-30T22:27:51.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.436+0000 7f9a5a7fc700 1 -- 172.21.15.154:0/1633179238 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9a5403f9c0 con 0x7f9a640a08e0 2023-09-30T22:27:51.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.437+0000 7f9a6bd07700 1 -- 172.21.15.154:0/1633179238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6409f9c0 con 0x7f9a640a08e0 2023-09-30T22:27:51.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.441+0000 7f9a5a7fc700 1 -- 172.21.15.154:0/1633179238 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a54011ce0 con 0x7f9a640a08e0 2023-09-30T22:27:51.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.624+0000 7f9a6bd07700 1 -- 172.21.15.154:0/1633179238 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a6404f2a0 con 0x7f9a640a08e0 2023-09-30T22:27:51.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.624+0000 7f9a5a7fc700 1 -- 172.21.15.154:0/1633179238 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a54013e60 con 0x7f9a640a08e0 2023-09-30T22:27:51.625 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:51.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.626+0000 7f9a6bd07700 1 -- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 msgr2=0x7f9a6411b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:51.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.626+0000 7f9a6bd07700 1 --2- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a6411b8d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400ebe0 tx=0x7f9a5400eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.626+0000 7f9a6bd07700 1 -- 172.21.15.154:0/1633179238 shutdown_connections 2023-09-30T22:27:51.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.626+0000 7f9a6bd07700 1 --2- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a64133a70 0x7f9a6411c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.626+0000 7f9a6bd07700 1 --2- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9a640a08e0 0x7f9a6411b8d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.626+0000 7f9a6bd07700 1 --2- 172.21.15.154:0/1633179238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a640a1290 0x7f9a6411be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:51.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.626+0000 7f9a6bd07700 1 -- 172.21.15.154:0/1633179238 >> 172.21.15.154:0/1633179238 conn(0x7f9a640a2980 msgr2=0x7f9a6412f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:51.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.626+0000 7f9a6bd07700 1 -- 172.21.15.154:0/1633179238 shutdown_connections 2023-09-30T22:27:51.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:51.626+0000 7f9a6bd07700 1 -- 172.21.15.154:0/1633179238 wait complete. 2023-09-30T22:27:51.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:52.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:52.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:52.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.298+0000 7fec540cd700 1 Processor -- start 2023-09-30T22:27:52.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.298+0000 7fec540cd700 1 -- start start 2023-09-30T22:27:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.298+0000 7fec540cd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c133b10 0x7fec4c133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.298+0000 7fec540cd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec4c0a0980 0x7fec4c0a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.298+0000 7fec540cd700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c0a17b0 con 0x7fec4c0a1310 2023-09-30T22:27:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.298+0000 7fec540cd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4c09a080 con 0x7fec4c0a0980 2023-09-30T22:27:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.298+0000 7fec540cd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c1336e0 con 0x7fec4c133b10 2023-09-30T22:27:52.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51e69700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c133b10 0x7fec4c133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51668700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec4c0a0980 0x7fec4c0a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51e69700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c133b10 0x7fec4c133ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48062/0 (socket says 172.21.15.154:48062) 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51668700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec4c0a0980 0x7fec4c0a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41352/0 (socket says 172.21.15.154:41352) 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51e69700 1 -- 172.21.15.154:0/1608370858 learned_addr learned my addr 172.21.15.154:0/1608370858 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51e69700 1 -- 172.21.15.154:0/1608370858 >> v2:172.21.15.154:3300/0 conn(0x7fec4c0a0980 msgr2=0x7fec4c0a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51e69700 1 --2- 172.21.15.154:0/1608370858 >> v2:172.21.15.154:3300/0 conn(0x7fec4c0a0980 0x7fec4c0a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51e69700 1 -- 172.21.15.154:0/1608370858 >> v1:172.21.15.154:6789/0 conn(0x7fec4c0a1310 legacy=0x7fec4c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51e69700 1 -- 172.21.15.154:0/1608370858 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c09a760 con 0x7fec4c133b10 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51668700 1 --2- 172.21.15.154:0/1608370858 >> v2:172.21.15.154:3300/0 conn(0x7fec4c0a0980 0x7fec4c0a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec51e69700 1 --2- 172.21.15.154:0/1608370858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c133b10 0x7fec4c133ee0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fec48006fd0 tx=0x7fec48009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b6f57a12811b9c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec50e67700 1 -- 172.21.15.154:0/1608370858 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48005e30 con 0x7fec4c133b10 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec50e67700 1 -- 172.21.15.154:0/1608370858 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec48004030 con 0x7fec4c133b10 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.299+0000 7fec50e67700 1 -- 172.21.15.154:0/1608370858 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec480043e0 con 0x7fec4c133b10 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.300+0000 7fec540cd700 1 -- 172.21.15.154:0/1608370858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c133b10 msgr2=0x7fec4c133ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.300+0000 7fec540cd700 1 --2- 172.21.15.154:0/1608370858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c133b10 0x7fec4c133ee0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fec48006fd0 tx=0x7fec48009bd0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.300+0000 7fec540cd700 1 -- 172.21.15.154:0/1608370858 shutdown_connections 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.300+0000 7fec540cd700 1 --2- 172.21.15.154:0/1608370858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c133b10 0x7fec4c133ee0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.300+0000 7fec540cd700 1 --2- 172.21.15.154:0/1608370858 >> v2:172.21.15.154:3300/0 conn(0x7fec4c0a0980 0x7fec4c0a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.300+0000 7fec540cd700 1 -- 172.21.15.154:0/1608370858 >> 172.21.15.154:0/1608370858 conn(0x7fec4c0a2980 msgr2=0x7fec4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.300+0000 7fec540cd700 1 -- 172.21.15.154:0/1608370858 shutdown_connections 2023-09-30T22:27:52.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.300+0000 7fec540cd700 1 -- 172.21.15.154:0/1608370858 wait complete. 2023-09-30T22:27:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.301+0000 7fec540cd700 1 Processor -- start 2023-09-30T22:27:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.301+0000 7fec540cd700 1 -- start start 2023-09-30T22:27:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec540cd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c0a0980 0x7fec4c1195f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec540cd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec4c0a1310 0x7fec4c119b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec540cd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec4c133b10 0x7fec4c11a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec540cd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c11dad0 con 0x7fec4c133b10 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec540cd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c11d110 con 0x7fec4c0a0980 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec540cd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c1320b0 con 0x7fec4c0a1310 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51e69700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c0a0980 0x7fec4c1195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51e69700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c0a0980 0x7fec4c1195f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48064/0 (socket says 172.21.15.154:48064) 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec5266a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec4c133b10 0x7fec4c11a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51e69700 1 -- 172.21.15.154:0/3366704900 learned_addr learned my addr 172.21.15.154:0/3366704900 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51668700 1 --2- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec4c0a1310 0x7fec4c119b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51e69700 1 -- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec4c0a1310 msgr2=0x7fec4c119b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51e69700 1 --2- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec4c0a1310 0x7fec4c119b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51e69700 1 -- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec4c133b10 msgr2=0x7fec4c11a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51e69700 1 --2- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec4c133b10 0x7fec4c11a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51e69700 1 -- 172.21.15.154:0/3366704900 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c0094a0 con 0x7fec4c0a0980 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec5266a700 1 --2- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec4c133b10 0x7fec4c11a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.302+0000 7fec51e69700 1 --2- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c0a0980 0x7fec4c1195f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fec48004000 tx=0x7fec48004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.303+0000 7fec427fc700 1 -- 172.21.15.154:0/3366704900 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48003c30 con 0x7fec4c0a0980 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.303+0000 7fec427fc700 1 -- 172.21.15.154:0/3366704900 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec48003d90 con 0x7fec4c0a0980 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.303+0000 7fec427fc700 1 -- 172.21.15.154:0/3366704900 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4801c640 con 0x7fec4c0a0980 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.303+0000 7fec540cd700 1 -- 172.21.15.154:0/3366704900 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec48009500 con 0x7fec4c0a0980 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.303+0000 7fec540cd700 1 -- 172.21.15.154:0/3366704900 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c11b200 con 0x7fec4c0a0980 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.303+0000 7fec427fc700 1 -- 172.21.15.154:0/3366704900 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec4801c7a0 con 0x7fec4c0a0980 2023-09-30T22:27:52.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.304+0000 7fec427fc700 1 -- 172.21.15.154:0/3366704900 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec480406c0 con 0x7fec4c0a0980 2023-09-30T22:27:52.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.304+0000 7fec540cd700 1 -- 172.21.15.154:0/3366704900 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c0a23a0 con 0x7fec4c0a0980 2023-09-30T22:27:52.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.308+0000 7fec427fc700 1 -- 172.21.15.154:0/3366704900 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec48016080 con 0x7fec4c0a0980 2023-09-30T22:27:52.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.394+0000 7f7174ffc700 1 Processor -- start 2023-09-30T22:27:52.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.394+0000 7f7174ffc700 1 -- start start 2023-09-30T22:27:52.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f7174ffc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7170131980 0x7f7170131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f7174ffc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f717009bc70 0x7f717009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f7174ffc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 0x7f7170138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f7174ffc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717006eb30 con 0x7f7170131980 2023-09-30T22:27:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f7174ffc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71700a1640 con 0x7f717009c5c0 2023-09-30T22:27:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f7174ffc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71700a22d0 con 0x7f717009bc70 2023-09-30T22:27:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7170131980 0x7f7170131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7170131980 0x7f7170131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41382/0 (socket says 172.21.15.154:41382) 2023-09-30T22:27:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716e59c700 1 -- 172.21.15.154:0/1251140775 learned_addr learned my addr 172.21.15.154:0/1251140775 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716dd9b700 1 --2- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f717009bc70 0x7f717009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716ed9d700 1 --2- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 0x7f7170138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716e59c700 1 -- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f717009bc70 msgr2=0x7f717009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716e59c700 1 --2- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f717009bc70 0x7f717009c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716e59c700 1 -- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 msgr2=0x7f7170138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716e59c700 1 --2- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 0x7f7170138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716e59c700 1 -- 172.21.15.154:0/1251140775 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7170131550 con 0x7f7170131980 2023-09-30T22:27:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716e59c700 1 --2- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7170131980 0x7f7170131d50 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f71640098f0 tx=0x7f7164009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28542d3f3b7cfde0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716d59a700 1 -- 172.21.15.154:0/1251140775 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164005e30 con 0x7f7170131980 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716d59a700 1 -- 172.21.15.154:0/1251140775 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164004030 con 0x7f7170131980 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.395+0000 7f716d59a700 1 -- 172.21.15.154:0/1251140775 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640043e0 con 0x7f7170131980 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.396+0000 7f7174ffc700 1 -- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7170131980 msgr2=0x7f7170131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.396+0000 7f7174ffc700 1 --2- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7170131980 0x7f7170131d50 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f71640098f0 tx=0x7f7164009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.396+0000 7f7174ffc700 1 -- 172.21.15.154:0/1251140775 shutdown_connections 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.396+0000 7f7174ffc700 1 --2- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 0x7f7170138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.396+0000 7f7174ffc700 1 --2- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7170131980 0x7f7170131d50 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.396+0000 7f7174ffc700 1 --2- 172.21.15.154:0/1251140775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f717009bc70 0x7f717009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.396+0000 7f7174ffc700 1 -- 172.21.15.154:0/1251140775 >> 172.21.15.154:0/1251140775 conn(0x7f71700a2980 msgr2=0x7f71700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.396+0000 7f7174ffc700 1 -- 172.21.15.154:0/1251140775 shutdown_connections 2023-09-30T22:27:52.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.396+0000 7f7174ffc700 1 -- 172.21.15.154:0/1251140775 wait complete. 2023-09-30T22:27:52.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.397+0000 7f7174ffc700 1 Processor -- start 2023-09-30T22:27:52.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.397+0000 7f7174ffc700 1 -- start start 2023-09-30T22:27:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f7174ffc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f717009bc70 0x7f717011b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f7174ffc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 0x7f717011bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f7174ffc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7170131980 0x7f717011c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f7174ffc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717011ea50 con 0x7f717009bc70 2023-09-30T22:27:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f7174ffc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71700a1c40 con 0x7f717009c5c0 2023-09-30T22:27:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f7174ffc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7170130d80 con 0x7f7170131980 2023-09-30T22:27:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f717009bc70 0x7f717011b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7170131980 0x7f717011c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f717009bc70 0x7f717011b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41386/0 (socket says 172.21.15.154:41386) 2023-09-30T22:27:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716e59c700 1 -- 172.21.15.154:0/152769287 learned_addr learned my addr 172.21.15.154:0/152769287 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7170131980 0x7f717011c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48392/0 (socket says 172.21.15.154:48392) 2023-09-30T22:27:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716dd9b700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 0x7f717011bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716dd9b700 1 -- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7170131980 msgr2=0x7f717011c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716dd9b700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7170131980 0x7f717011c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716dd9b700 1 -- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f717009bc70 msgr2=0x7f717011b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716dd9b700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f717009bc70 0x7f717011b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716dd9b700 1 -- 172.21.15.154:0/152769287 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009500 con 0x7f717009c5c0 2023-09-30T22:27:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716ed9d700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7170131980 0x7f717011c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716e59c700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f717009bc70 0x7f717011b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f716dd9b700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 0x7f717011bce0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f716000e870 tx=0x7f716000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f715effd700 1 -- 172.21.15.154:0/152769287 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160013680 con 0x7f717009c5c0 2023-09-30T22:27:52.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f715effd700 1 -- 172.21.15.154:0/152769287 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71600137e0 con 0x7f717009c5c0 2023-09-30T22:27:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.398+0000 7f7174ffc700 1 -- 172.21.15.154:0/152769287 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717011d3b0 con 0x7f717009c5c0 2023-09-30T22:27:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.399+0000 7f715effd700 1 -- 172.21.15.154:0/152769287 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160013b50 con 0x7f717009c5c0 2023-09-30T22:27:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.399+0000 7f7174ffc700 1 -- 172.21.15.154:0/152769287 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717011f7c0 con 0x7f717009c5c0 2023-09-30T22:27:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.399+0000 7f7174ffc700 1 -- 172.21.15.154:0/152769287 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717004f2a0 con 0x7f717009c5c0 2023-09-30T22:27:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.399+0000 7f715effd700 1 -- 172.21.15.154:0/152769287 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7160013cb0 con 0x7f717009c5c0 2023-09-30T22:27:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.400+0000 7f715effd700 1 -- 172.21.15.154:0/152769287 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f716003f5a0 con 0x7f717009c5c0 2023-09-30T22:27:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.404+0000 7f715effd700 1 -- 172.21.15.154:0/152769287 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f716001be10 con 0x7f717009c5c0 2023-09-30T22:27:52.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:52.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.506+0000 7fec540cd700 1 -- 172.21.15.154:0/3366704900 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec4c11cc00 con 0x7fec4c0a0980 2023-09-30T22:27:52.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.506+0000 7fec427fc700 1 -- 172.21.15.154:0/3366704900 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec4802a020 con 0x7fec4c0a0980 2023-09-30T22:27:52.508 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.509+0000 7fec540cd700 1 -- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c0a0980 msgr2=0x7fec4c1195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.509+0000 7fec540cd700 1 --2- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c0a0980 0x7fec4c1195f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fec48004000 tx=0x7fec48004750 comp rx=0 tx=0).stop 2023-09-30T22:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.509+0000 7fec540cd700 1 -- 172.21.15.154:0/3366704900 shutdown_connections 2023-09-30T22:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.509+0000 7fec540cd700 1 --2- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec4c133b10 0x7fec4c11a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.509+0000 7fec540cd700 1 --2- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec4c0a0980 0x7fec4c1195f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.509+0000 7fec540cd700 1 --2- 172.21.15.154:0/3366704900 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fec4c0a1310 0x7fec4c119b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.509+0000 7fec540cd700 1 -- 172.21.15.154:0/3366704900 >> 172.21.15.154:0/3366704900 conn(0x7fec4c0a2980 msgr2=0x7fec4c12e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.509+0000 7fec540cd700 1 -- 172.21.15.154:0/3366704900 shutdown_connections 2023-09-30T22:27:52.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.509+0000 7fec540cd700 1 -- 172.21.15.154:0/3366704900 wait complete. 2023-09-30T22:27:52.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:52.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.536+0000 7f124d6b6700 1 Processor -- start 2023-09-30T22:27:52.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.536+0000 7f124d6b6700 1 -- start start 2023-09-30T22:27:52.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.536+0000 7f124d6b6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f124809e870 0x7f124809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.536+0000 7f124d6b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f1248131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.536+0000 7f124d6b6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124809c970 con 0x7f1248131d70 2023-09-30T22:27:52.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f124d6b6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12480a0920 con 0x7f124809e870 2023-09-30T22:27:52.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f124d6b6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124809f9c0 con 0x7f124809f180 2023-09-30T22:27:52.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f1246ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f124809e870 0x7f124809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f12467fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f1248131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f12467fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f1248131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48096/0 (socket says 172.21.15.154:48096) 2023-09-30T22:27:52.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f1246ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f124809e870 0x7f124809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41402/0 (socket says 172.21.15.154:41402) 2023-09-30T22:27:52.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f12467fc700 1 -- 172.21.15.154:0/1359376897 learned_addr learned my addr 172.21.15.154:0/1359376897 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:52.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f12467fc700 1 -- 172.21.15.154:0/1359376897 >> v2:172.21.15.154:3300/0 conn(0x7f124809e870 msgr2=0x7f124809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f12467fc700 1 --2- 172.21.15.154:0/1359376897 >> v2:172.21.15.154:3300/0 conn(0x7f124809e870 0x7f124809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f12467fc700 1 -- 172.21.15.154:0/1359376897 >> v1:172.21.15.154:6789/0 conn(0x7f1248131d70 legacy=0x7f1248138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f12467fc700 1 -- 172.21.15.154:0/1359376897 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124809bab0 con 0x7f124809f180 2023-09-30T22:27:52.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f1246ffd700 1 --2- 172.21.15.154:0/1359376897 >> v2:172.21.15.154:3300/0 conn(0x7f124809e870 0x7f124809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f12467fc700 1 --2- 172.21.15.154:0/1359376897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f1248131830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f123c0098f0 tx=0x7f123c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375e6a16d1952bbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f1245ffb700 1 -- 172.21.15.154:0/1359376897 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c011830 con 0x7f124809f180 2023-09-30T22:27:52.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f1245ffb700 1 -- 172.21.15.154:0/1359376897 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c011990 con 0x7f124809f180 2023-09-30T22:27:52.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.537+0000 7f1245ffb700 1 -- 172.21.15.154:0/1359376897 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c011d20 con 0x7f124809f180 2023-09-30T22:27:52.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.538+0000 7f124d6b6700 1 -- 172.21.15.154:0/1359376897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 msgr2=0x7f1248131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.538+0000 7f124d6b6700 1 --2- 172.21.15.154:0/1359376897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f1248131830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f123c0098f0 tx=0x7f123c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:52.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.538+0000 7f124d6b6700 1 -- 172.21.15.154:0/1359376897 shutdown_connections 2023-09-30T22:27:52.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.538+0000 7f124d6b6700 1 --2- 172.21.15.154:0/1359376897 >> v2:172.21.15.154:3300/0 conn(0x7f124809e870 0x7f124809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.538+0000 7f124d6b6700 1 --2- 172.21.15.154:0/1359376897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f1248131830 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.538+0000 7f124d6b6700 1 -- 172.21.15.154:0/1359376897 >> 172.21.15.154:0/1359376897 conn(0x7f12480a4430 msgr2=0x7f12480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.538+0000 7f124d6b6700 1 -- 172.21.15.154:0/1359376897 shutdown_connections 2023-09-30T22:27:52.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.538+0000 7f124d6b6700 1 -- 172.21.15.154:0/1359376897 wait complete. 2023-09-30T22:27:52.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f124d6b6700 1 Processor -- start 2023-09-30T22:27:52.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f124d6b6700 1 -- start start 2023-09-30T22:27:52.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f124d6b6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124809e870 0x7f124806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f124d6b6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f124806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f124d6b6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1248131d70 0x7f124806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f124d6b6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248125d40 con 0x7f124809e870 2023-09-30T22:27:52.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f124d6b6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124806cd10 con 0x7f124809f180 2023-09-30T22:27:52.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f124d6b6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1248125f40 con 0x7f1248131d70 2023-09-30T22:27:52.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f12467fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f124806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f12467fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f124806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48112/0 (socket says 172.21.15.154:48112) 2023-09-30T22:27:52.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f12467fc700 1 -- 172.21.15.154:0/3626980768 learned_addr learned my addr 172.21.15.154:0/3626980768 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:52.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.539+0000 7f1246ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124809e870 0x7f124806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f12477fe700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1248131d70 0x7f124806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f12467fc700 1 -- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1248131d70 msgr2=0x7f124806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f12467fc700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1248131d70 0x7f124806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f12467fc700 1 -- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124809e870 msgr2=0x7f124806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f12467fc700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124809e870 0x7f124806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f12467fc700 1 -- 172.21.15.154:0/3626980768 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380094a0 con 0x7f124809f180 2023-09-30T22:27:52.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f12477fe700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1248131d70 0x7f124806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:52.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f1246ffd700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124809e870 0x7f124806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f12467fc700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f124806bdf0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f123c009c40 tx=0x7f123c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f122f7fe700 1 -- 172.21.15.154:0/3626980768 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c004480 con 0x7f124809f180 2023-09-30T22:27:52.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f122f7fe700 1 -- 172.21.15.154:0/3626980768 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c01f070 con 0x7f124809f180 2023-09-30T22:27:52.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f122f7fe700 1 -- 172.21.15.154:0/3626980768 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0038c0 con 0x7f124809f180 2023-09-30T22:27:52.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f124d6b6700 1 -- 172.21.15.154:0/3626980768 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c009550 con 0x7f124809f180 2023-09-30T22:27:52.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.540+0000 7f124d6b6700 1 -- 172.21.15.154:0/3626980768 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124809dba0 con 0x7f124809f180 2023-09-30T22:27:52.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.541+0000 7f122f7fe700 1 -- 172.21.15.154:0/3626980768 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f123c021030 con 0x7f124809f180 2023-09-30T22:27:52.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.541+0000 7f122f7fe700 1 -- 172.21.15.154:0/3626980768 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f123c040b20 con 0x7f124809f180 2023-09-30T22:27:52.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.541+0000 7f124d6b6700 1 -- 172.21.15.154:0/3626980768 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1248131350 con 0x7f124809f180 2023-09-30T22:27:52.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.546+0000 7f122f7fe700 1 -- 172.21.15.154:0/3626980768 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f123c015070 con 0x7f124809f180 2023-09-30T22:27:52.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.600+0000 7f7174ffc700 1 -- 172.21.15.154:0/152769287 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f717011ee60 con 0x7f717009c5c0 2023-09-30T22:27:52.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.600+0000 7f715effd700 1 -- 172.21.15.154:0/152769287 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7160021030 con 0x7f717009c5c0 2023-09-30T22:27:52.602 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.603+0000 7f7174ffc700 1 -- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 msgr2=0x7f717011bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.603+0000 7f7174ffc700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 0x7f717011bce0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f716000e870 tx=0x7f716000eb80 comp rx=0 tx=0).stop 2023-09-30T22:27:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.603+0000 7f7174ffc700 1 -- 172.21.15.154:0/152769287 shutdown_connections 2023-09-30T22:27:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.603+0000 7f7174ffc700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7170131980 0x7f717011c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.603+0000 7f7174ffc700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f717009bc70 0x7f717011b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.603+0000 7f7174ffc700 1 --2- 172.21.15.154:0/152769287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f717009c5c0 0x7f717011bce0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.603+0000 7f7174ffc700 1 -- 172.21.15.154:0/152769287 >> 172.21.15.154:0/152769287 conn(0x7f71700a2980 msgr2=0x7f717006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.603+0000 7f7174ffc700 1 -- 172.21.15.154:0/152769287 shutdown_connections 2023-09-30T22:27:52.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.603+0000 7f7174ffc700 1 -- 172.21.15.154:0/152769287 wait complete. 2023-09-30T22:27:52.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:52.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.737+0000 7f124d6b6700 1 -- 172.21.15.154:0/3626980768 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f124804f2a0 con 0x7f124809f180 2023-09-30T22:27:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.738+0000 7f122f7fe700 1 -- 172.21.15.154:0/3626980768 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f123c03ee60 con 0x7f124809f180 2023-09-30T22:27:52.739 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.740+0000 7f124d6b6700 1 -- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 msgr2=0x7f124806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.740+0000 7f124d6b6700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f124806bdf0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f123c009c40 tx=0x7f123c004750 comp rx=0 tx=0).stop 2023-09-30T22:27:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.740+0000 7f124d6b6700 1 -- 172.21.15.154:0/3626980768 shutdown_connections 2023-09-30T22:27:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.740+0000 7f124d6b6700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1248131d70 0x7f124806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.740+0000 7f124d6b6700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124809e870 0x7f124806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.740+0000 7f124d6b6700 1 --2- 172.21.15.154:0/3626980768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f124809f180 0x7f124806bdf0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.740+0000 7f124d6b6700 1 -- 172.21.15.154:0/3626980768 >> 172.21.15.154:0/3626980768 conn(0x7f12480a4430 msgr2=0x7f12480a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.740+0000 7f124d6b6700 1 -- 172.21.15.154:0/3626980768 shutdown_connections 2023-09-30T22:27:52.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.740+0000 7f124d6b6700 1 -- 172.21.15.154:0/3626980768 wait complete. 2023-09-30T22:27:52.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:52.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c11d7e700 1 Processor -- start 2023-09-30T22:27:52.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c11d7e700 1 -- start start 2023-09-30T22:27:52.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c11d7e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c0c133ad0 0x7f1c0c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c11d7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c1300a0 0x7f1c0c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c11d7e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c06b2d0 con 0x7f1c0c1309f0 2023-09-30T22:27:52.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c11d7e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0c133610 con 0x7f1c0c133ad0 2023-09-30T22:27:52.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c11d7e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c09a500 con 0x7f1c0c1300a0 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c0b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c0c133ad0 0x7f1c0c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c0affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c1300a0 0x7f1c0c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c0b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c0c133ad0 0x7f1c0c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41414/0 (socket says 172.21.15.154:41414) 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c0affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c1300a0 0x7f1c0c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48398/0 (socket says 172.21.15.154:48398) 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.781+0000 7f1c0b7fe700 1 -- 172.21.15.154:0/3117035431 learned_addr learned my addr 172.21.15.154:0/3117035431 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c0b7fe700 1 -- 172.21.15.154:0/3117035431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c1300a0 msgr2=0x7f1c0c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c0b7fe700 1 --2- 172.21.15.154:0/3117035431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c1300a0 0x7f1c0c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c0b7fe700 1 -- 172.21.15.154:0/3117035431 >> v1:172.21.15.154:6789/0 conn(0x7f1c0c1309f0 legacy=0x7f1c0c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c0b7fe700 1 -- 172.21.15.154:0/3117035431 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c1338b0 con 0x7f1c0c133ad0 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c0affd700 1 --2- 172.21.15.154:0/3117035431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c1300a0 0x7f1c0c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c0b7fe700 1 --2- 172.21.15.154:0/3117035431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c133ad0 0x7f1c0c133ea0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f1c000098f0 tx=0x7f1c00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d701e09a1c88f36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c0a7fc700 1 -- 172.21.15.154:0/3117035431 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011830 con 0x7f1c0c133ad0 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c0a7fc700 1 -- 172.21.15.154:0/3117035431 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c00011990 con 0x7f1c0c133ad0 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c0a7fc700 1 -- 172.21.15.154:0/3117035431 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011d20 con 0x7f1c0c133ad0 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3117035431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c133ad0 msgr2=0x7f1c0c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.782+0000 7f1c11d7e700 1 --2- 172.21.15.154:0/3117035431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c133ad0 0x7f1c0c133ea0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f1c000098f0 tx=0x7f1c00009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.783+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3117035431 shutdown_connections 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.783+0000 7f1c11d7e700 1 --2- 172.21.15.154:0/3117035431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c133ad0 0x7f1c0c133ea0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.783+0000 7f1c11d7e700 1 --2- 172.21.15.154:0/3117035431 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c1300a0 0x7f1c0c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.783+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3117035431 >> 172.21.15.154:0/3117035431 conn(0x7f1c0c099c40 msgr2=0x7f1c0c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.783+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3117035431 shutdown_connections 2023-09-30T22:27:52.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.783+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3117035431 wait complete. 2023-09-30T22:27:52.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.783+0000 7f1c11d7e700 1 Processor -- start 2023-09-30T22:27:52.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c11d7e700 1 -- start start 2023-09-30T22:27:52.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c11d7e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0c1300a0 0x7f1c0c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c11d7e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c1309f0 0x7f1c0c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c11d7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c133ad0 0x7f1c0c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:52.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c11d7e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c120b70 con 0x7f1c0c1309f0 2023-09-30T22:27:52.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c11d7e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c072290 con 0x7f1c0c1300a0 2023-09-30T22:27:52.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c11d7e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c11ff90 con 0x7f1c0c133ad0 2023-09-30T22:27:52.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c133ad0 0x7f1c0c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c1309f0 0x7f1c0c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0c1300a0 0x7f1c0c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c1309f0 0x7f1c0c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41418/0 (socket says 172.21.15.154:41418) 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c133ad0 0x7f1c0c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48406/0 (socket says 172.21.15.154:48406) 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0c1300a0 0x7f1c0c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48122/0 (socket says 172.21.15.154:48122) 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0affd700 1 -- 172.21.15.154:0/3865490823 learned_addr learned my addr 172.21.15.154:0/3865490823 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0affd700 1 -- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c133ad0 msgr2=0x7f1c0c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0affd700 1 --2- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c133ad0 0x7f1c0c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0affd700 1 -- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0c1300a0 msgr2=0x7f1c0c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0affd700 1 --2- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0c1300a0 0x7f1c0c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.784+0000 7f1c0affd700 1 -- 172.21.15.154:0/3865490823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0094a0 con 0x7f1c0c1309f0 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.785+0000 7f1c0bfff700 1 --2- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c133ad0 0x7f1c0c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.785+0000 7f1c0b7fe700 1 --2- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0c1300a0 0x7f1c0c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:52.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.785+0000 7f1c0affd700 1 --2- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c1309f0 0x7f1c0c11df80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00ebe0 tx=0x7f1bfc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:52.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.785+0000 7f1bf3fff700 1 -- 172.21.15.154:0/3865490823 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc009760 con 0x7f1c0c1309f0 2023-09-30T22:27:52.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.785+0000 7f1bf3fff700 1 -- 172.21.15.154:0/3865490823 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00c850 con 0x7f1c0c1309f0 2023-09-30T22:27:52.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.785+0000 7f1bf3fff700 1 -- 172.21.15.154:0/3865490823 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00cbe0 con 0x7f1c0c1309f0 2023-09-30T22:27:52.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.785+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3865490823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c00009550 con 0x7f1c0c1309f0 2023-09-30T22:27:52.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.785+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3865490823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c11fc60 con 0x7f1c0c1309f0 2023-09-30T22:27:52.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.786+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3865490823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c12d630 con 0x7f1c0c1309f0 2023-09-30T22:27:52.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.786+0000 7f1bf3fff700 1 -- 172.21.15.154:0/3865490823 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bfc00cd40 con 0x7f1c0c1309f0 2023-09-30T22:27:52.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.786+0000 7f1bf3fff700 1 -- 172.21.15.154:0/3865490823 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1bfc03fe80 con 0x7f1c0c1309f0 2023-09-30T22:27:52.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.791+0000 7f1bf3fff700 1 -- 172.21.15.154:0/3865490823 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bfc024350 con 0x7f1c0c1309f0 2023-09-30T22:27:52.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.979+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3865490823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c0c12dd00 con 0x7f1c0c1309f0 2023-09-30T22:27:52.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.979+0000 7f1bf3fff700 1 -- 172.21.15.154:0/3865490823 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bfc02a090 con 0x7f1c0c1309f0 2023-09-30T22:27:52.981 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.982+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c1309f0 msgr2=0x7f1c0c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.982+0000 7f1c11d7e700 1 --2- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c1309f0 0x7f1c0c11df80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00ebe0 tx=0x7f1bfc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.982+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3865490823 shutdown_connections 2023-09-30T22:27:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.982+0000 7f1c11d7e700 1 --2- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1c0c133ad0 0x7f1c0c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.982+0000 7f1c11d7e700 1 --2- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c0c1300a0 0x7f1c0c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.982+0000 7f1c11d7e700 1 --2- 172.21.15.154:0/3865490823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c0c1309f0 0x7f1c0c11df80 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:52.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.982+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3865490823 >> 172.21.15.154:0/3865490823 conn(0x7f1c0c099c40 msgr2=0x7f1c0c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:52.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.982+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3865490823 shutdown_connections 2023-09-30T22:27:52.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:52.982+0000 7f1c11d7e700 1 -- 172.21.15.154:0/3865490823 wait complete. 2023-09-30T22:27:52.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:53.523 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:53.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.650+0000 7f4675ea4700 1 Processor -- start 2023-09-30T22:27:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f4675ea4700 1 -- start start 2023-09-30T22:27:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f4675ea4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f467009d860 0x7f467009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f4675ea4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f467009e170 0x7f46701307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f4675ea4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4670130ce0 0x7f4670131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f4675ea4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467009aaa0 con 0x7f467009e170 2023-09-30T22:27:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f4675ea4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467009f870 con 0x7f467009d860 2023-09-30T22:27:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f4675ea4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f467009b360 con 0x7f4670130ce0 2023-09-30T22:27:53.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f467009e170 0x7f46701307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f467009d860 0x7f467009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4670130ce0 0x7f4670131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466effd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f467009e170 0x7f46701307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41422/0 (socket says 172.21.15.154:41422) 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466effd700 1 -- 172.21.15.154:0/23841028 learned_addr learned my addr 172.21.15.154:0/23841028 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466f7fe700 1 -- 172.21.15.154:0/23841028 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4670130ce0 msgr2=0x7f4670131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466f7fe700 1 --2- 172.21.15.154:0/23841028 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4670130ce0 0x7f4670131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466f7fe700 1 -- 172.21.15.154:0/23841028 >> v2:172.21.15.154:3300/0 conn(0x7f467009e170 msgr2=0x7f46701307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466f7fe700 1 --2- 172.21.15.154:0/23841028 >> v2:172.21.15.154:3300/0 conn(0x7f467009e170 0x7f46701307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.651+0000 7f466f7fe700 1 -- 172.21.15.154:0/23841028 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467009b620 con 0x7f467009d860 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f466effd700 1 --2- 172.21.15.154:0/23841028 >> v2:172.21.15.154:3300/0 conn(0x7f467009e170 0x7f46701307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f466f7fe700 1 --2- 172.21.15.154:0/23841028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f467009d860 0x7f467009dc30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4660009870 tx=0x7f4660009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80d7327edd0da3c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f466e7fc700 1 -- 172.21.15.154:0/23841028 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660011830 con 0x7f467009d860 2023-09-30T22:27:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f466e7fc700 1 -- 172.21.15.154:0/23841028 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4660011990 con 0x7f467009d860 2023-09-30T22:27:53.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f466e7fc700 1 -- 172.21.15.154:0/23841028 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660011d20 con 0x7f467009d860 2023-09-30T22:27:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f4675ea4700 1 -- 172.21.15.154:0/23841028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f467009d860 msgr2=0x7f467009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f4675ea4700 1 --2- 172.21.15.154:0/23841028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f467009d860 0x7f467009dc30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4660009870 tx=0x7f4660009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f4675ea4700 1 -- 172.21.15.154:0/23841028 shutdown_connections 2023-09-30T22:27:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f4675ea4700 1 --2- 172.21.15.154:0/23841028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f467009d860 0x7f467009dc30 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f4675ea4700 1 --2- 172.21.15.154:0/23841028 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4670130ce0 0x7f4670131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f4675ea4700 1 --2- 172.21.15.154:0/23841028 >> v2:172.21.15.154:3300/0 conn(0x7f467009e170 0x7f46701307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.652+0000 7f4675ea4700 1 -- 172.21.15.154:0/23841028 >> 172.21.15.154:0/23841028 conn(0x7f4670099c40 msgr2=0x7f46700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.653+0000 7f4675ea4700 1 -- 172.21.15.154:0/23841028 shutdown_connections 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.653+0000 7f4675ea4700 1 -- 172.21.15.154:0/23841028 wait complete. 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.653+0000 7f4675ea4700 1 Processor -- start 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f4675ea4700 1 -- start start 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f4675ea4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467009d860 0x7f467011cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f4675ea4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f467009e170 0x7f467011d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f4675ea4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4670130ce0 0x7f467011d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f4675ea4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467011e410 con 0x7f467009d860 2023-09-30T22:27:53.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f4675ea4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467011eb70 con 0x7f4670130ce0 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f4675ea4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f467011f190 con 0x7f467009e170 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f467009e170 0x7f467011d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4670130ce0 0x7f467011d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466f7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467009d860 0x7f467011cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f467009e170 0x7f467011d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48418/0 (socket says 172.21.15.154:48418) 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466effd700 1 -- 172.21.15.154:0/2503718665 learned_addr learned my addr 172.21.15.154:0/2503718665 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4670130ce0 0x7f467011d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48140/0 (socket says 172.21.15.154:48140) 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466effd700 1 -- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4670130ce0 msgr2=0x7f467011d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466effd700 1 --2- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4670130ce0 0x7f467011d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466effd700 1 -- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467009d860 msgr2=0x7f467011cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466effd700 1 --2- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467009d860 0x7f467011cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.654+0000 7f466effd700 1 -- 172.21.15.154:0/2503718665 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658009550 con 0x7f467009e170 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.655+0000 7f466f7fe700 1 --2- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467009d860 0x7f467011cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.655+0000 7f466ffff700 1 --2- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4670130ce0 0x7f467011d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.655+0000 7f466effd700 1 --2- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f467009e170 0x7f467011d4a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f465800ebe0 tx=0x7f465800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.655+0000 7f4667fff700 1 -- 172.21.15.154:0/2503718665 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658004240 con 0x7f467009e170 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.655+0000 7f4667fff700 1 -- 172.21.15.154:0/2503718665 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46580043a0 con 0x7f467009e170 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.655+0000 7f4667fff700 1 -- 172.21.15.154:0/2503718665 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580036a0 con 0x7f467009e170 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.655+0000 7f4675ea4700 1 -- 172.21.15.154:0/2503718665 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46600094a0 con 0x7f467009e170 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.655+0000 7f4675ea4700 1 -- 172.21.15.154:0/2503718665 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4670071b30 con 0x7f467009e170 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.656+0000 7f4667fff700 1 -- 172.21.15.154:0/2503718665 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4658003800 con 0x7f467009e170 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.656+0000 7f4675ea4700 1 -- 172.21.15.154:0/2503718665 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467009c8b0 con 0x7f467009e170 2023-09-30T22:27:53.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.656+0000 7f4667fff700 1 -- 172.21.15.154:0/2503718665 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f465803f810 con 0x7f467009e170 2023-09-30T22:27:53.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.665+0000 7f4667fff700 1 -- 172.21.15.154:0/2503718665 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4658011350 con 0x7f467009e170 2023-09-30T22:27:53.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.748+0000 7fa03bb36700 1 Processor -- start 2023-09-30T22:27:53.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.748+0000 7fa03bb36700 1 -- start start 2023-09-30T22:27:53.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.748+0000 7fa03bb36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409e870 0x7fa03409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa03bb36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa03409f180 0x7fa034133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa03bb36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa03bb36700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0340a0370 con 0x7fa03409f180 2023-09-30T22:27:53.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa03bb36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03409fa00 con 0x7fa03409e870 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa03bb36700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa03409ada0 con 0x7fa034134160 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0398d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409e870 0x7fa03409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0390d1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa03409f180 0x7fa034133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa03a0d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa03a0d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48432/0 (socket says 172.21.15.154:48432) 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0390d1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa03409f180 0x7fa034133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41444/0 (socket says 172.21.15.154:41444) 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0398d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409e870 0x7fa03409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48144/0 (socket says 172.21.15.154:48144) 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa03a0d3700 1 -- 172.21.15.154:0/3192292545 learned_addr learned my addr 172.21.15.154:0/3192292545 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0390d1700 1 -- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 msgr2=0x7fa034134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0390d1700 1 --2- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0390d1700 1 -- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409e870 msgr2=0x7fa03409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0390d1700 1 --2- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409e870 0x7fa03409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0390d1700 1 -- 172.21.15.154:0/3192292545 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03406bec0 con 0x7fa03409f180 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0398d2700 1 --2- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409e870 0x7fa03409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa03a0d3700 1 --2- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0390d1700 1 --2- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa03409f180 0x7fa034133c20 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa024009870 tx=0x7fa024009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762a7514623116e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0388d0700 1 -- 172.21.15.154:0/3192292545 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024011830 con 0x7fa03409f180 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0388d0700 1 -- 172.21.15.154:0/3192292545 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa024011990 con 0x7fa03409f180 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.749+0000 7fa0388d0700 1 -- 172.21.15.154:0/3192292545 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa024011d20 con 0x7fa03409f180 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.750+0000 7fa03bb36700 1 -- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa03409f180 msgr2=0x7fa034133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.750+0000 7fa03bb36700 1 --2- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa03409f180 0x7fa034133c20 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa024009870 tx=0x7fa024009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.750+0000 7fa03bb36700 1 -- 172.21.15.154:0/3192292545 shutdown_connections 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.750+0000 7fa03bb36700 1 --2- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409e870 0x7fa03409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.750+0000 7fa03bb36700 1 --2- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.750+0000 7fa03bb36700 1 --2- 172.21.15.154:0/3192292545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa03409f180 0x7fa034133c20 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.750+0000 7fa03bb36700 1 -- 172.21.15.154:0/3192292545 >> 172.21.15.154:0/3192292545 conn(0x7fa0340a4430 msgr2=0x7fa0340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:53.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.750+0000 7fa03bb36700 1 -- 172.21.15.154:0/3192292545 shutdown_connections 2023-09-30T22:27:53.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.750+0000 7fa03bb36700 1 -- 172.21.15.154:0/3192292545 wait complete. 2023-09-30T22:27:53.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:53.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.751+0000 7fa03bb36700 1 Processor -- start 2023-09-30T22:27:53.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.751+0000 7fa03bb36700 1 -- start start 2023-09-30T22:27:53.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.751+0000 7fa03bb36700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa03409e870 0x7fa034122500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.751+0000 7fa03bb36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409f180 0x7fa034122a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03bb36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034122f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03bb36700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa034125de0 con 0x7fa03409e870 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03bb36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341338d0 con 0x7fa03409f180 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03bb36700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa034124fa0 con 0x7fa034134160 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa0390d1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409f180 0x7fa034122a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03a0d3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa0390d1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409f180 0x7fa034122a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48158/0 (socket says 172.21.15.154:48158) 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa0390d1700 1 -- 172.21.15.154:0/2063055406 learned_addr learned my addr 172.21.15.154:0/2063055406 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa0398d2700 1 --2- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa03409e870 0x7fa034122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03a0d3700 1 -- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409f180 msgr2=0x7fa034122a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03a0d3700 1 --2- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409f180 0x7fa034122a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03a0d3700 1 -- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa03409e870 msgr2=0x7fa034122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03a0d3700 1 --2- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa03409e870 0x7fa034122500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03a0d3700 1 -- 172.21.15.154:0/2063055406 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0300094a0 con 0x7fa034134160 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03a0d3700 1 --2- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034122f80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009e50 tx=0x7fa02c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa02a7fc700 1 -- 172.21.15.154:0/2063055406 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c018070 con 0x7fa034134160 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa02a7fc700 1 -- 172.21.15.154:0/2063055406 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c00f040 con 0x7fa034134160 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03bb36700 1 -- 172.21.15.154:0/2063055406 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c009b30 con 0x7fa034134160 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa02a7fc700 1 -- 172.21.15.154:0/2063055406 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c003c40 con 0x7fa034134160 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.752+0000 7fa03bb36700 1 -- 172.21.15.154:0/2063055406 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0240094a0 con 0x7fa034134160 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.753+0000 7fa02a7fc700 1 -- 172.21.15.154:0/2063055406 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa02c00c880 con 0x7fa034134160 2023-09-30T22:27:53.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.753+0000 7fa02a7fc700 1 -- 172.21.15.154:0/2063055406 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa02c03f6c0 con 0x7fa034134160 2023-09-30T22:27:53.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.753+0000 7fa03bb36700 1 -- 172.21.15.154:0/2063055406 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03406cfa0 con 0x7fa034134160 2023-09-30T22:27:53.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.758+0000 7fa02a7fc700 1 -- 172.21.15.154:0/2063055406 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa02c012340 con 0x7fa034134160 2023-09-30T22:27:53.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.859+0000 7f4675ea4700 1 -- 172.21.15.154:0/2503718665 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f467004f2a0 con 0x7f467009e170 2023-09-30T22:27:53.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.859+0000 7f4667fff700 1 -- 172.21.15.154:0/2503718665 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f465801bb60 con 0x7f467009e170 2023-09-30T22:27:53.860 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.861+0000 7f4675ea4700 1 -- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f467009e170 msgr2=0x7f467011d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.861+0000 7f4675ea4700 1 --2- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f467009e170 0x7f467011d4a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f465800ebe0 tx=0x7f465800eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.861+0000 7f4675ea4700 1 -- 172.21.15.154:0/2503718665 shutdown_connections 2023-09-30T22:27:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.861+0000 7f4675ea4700 1 --2- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4670130ce0 0x7f467011d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.861+0000 7f4675ea4700 1 --2- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f467009d860 0x7f467011cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.861+0000 7f4675ea4700 1 --2- 172.21.15.154:0/2503718665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f467009e170 0x7f467011d4a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.861+0000 7f4675ea4700 1 -- 172.21.15.154:0/2503718665 >> 172.21.15.154:0/2503718665 conn(0x7f4670099c40 msgr2=0x7f467012fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.862+0000 7f4675ea4700 1 -- 172.21.15.154:0/2503718665 shutdown_connections 2023-09-30T22:27:53.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.862+0000 7f4675ea4700 1 -- 172.21.15.154:0/2503718665 wait complete. 2023-09-30T22:27:53.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.884+0000 7f5d585ad700 1 Processor -- start 2023-09-30T22:27:53.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.884+0000 7f5d585ad700 1 -- start start 2023-09-30T22:27:53.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d585ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d50133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d585ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d501304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d585ad700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5006b2d0 con 0x7f5d501309f0 2023-09-30T22:27:53.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d585ad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d50133610 con 0x7f5d50133ad0 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d585ad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5009a500 con 0x7f5d501300a0 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d56349700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d50133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d56b4a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5d501309f0 0x7f5d5013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48152/0 (socket says 172.21.15.154:48152) 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d56b4a700 1 -- 172.21.15.154:0/3280549500 learned_addr learned my addr 172.21.15.154:0/3280549500 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d55b48700 1 --2- 172.21.15.154:0/3280549500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d501304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d56349700 1 -- 172.21.15.154:0/3280549500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 msgr2=0x7f5d501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d56349700 1 --2- 172.21.15.154:0/3280549500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d501304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d56349700 1 -- 172.21.15.154:0/3280549500 >> v1:172.21.15.154:6789/0 conn(0x7f5d501309f0 legacy=0x7f5d5013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d56349700 1 -- 172.21.15.154:0/3280549500 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d501338b0 con 0x7f5d50133ad0 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d55347700 1 -- 172.21.15.154:0/3280549500 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396391180 0 0) 0x7f5d5006b2d0 con 0x7f5d501309f0 2023-09-30T22:27:53.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d55b48700 1 --2- 172.21.15.154:0/3280549500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d501304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d56349700 1 --2- 172.21.15.154:0/3280549500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d50133ea0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009870 tx=0x7f5d40009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbc87eaf60cb3b0a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d55347700 1 -- 172.21.15.154:0/3280549500 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40011830 con 0x7f5d50133ad0 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d55347700 1 -- 172.21.15.154:0/3280549500 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d40011990 con 0x7f5d50133ad0 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.885+0000 7f5d55347700 1 -- 172.21.15.154:0/3280549500 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40011d20 con 0x7f5d50133ad0 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.886+0000 7f5d585ad700 1 -- 172.21.15.154:0/3280549500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 msgr2=0x7f5d50133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.886+0000 7f5d585ad700 1 --2- 172.21.15.154:0/3280549500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d50133ea0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009870 tx=0x7f5d40009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.886+0000 7f5d585ad700 1 -- 172.21.15.154:0/3280549500 shutdown_connections 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.886+0000 7f5d585ad700 1 --2- 172.21.15.154:0/3280549500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d50133ea0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.886+0000 7f5d585ad700 1 --2- 172.21.15.154:0/3280549500 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d501304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.886+0000 7f5d585ad700 1 -- 172.21.15.154:0/3280549500 >> 172.21.15.154:0/3280549500 conn(0x7f5d50099c40 msgr2=0x7f5d500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.886+0000 7f5d585ad700 1 -- 172.21.15.154:0/3280549500 shutdown_connections 2023-09-30T22:27:53.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.886+0000 7f5d585ad700 1 -- 172.21.15.154:0/3280549500 wait complete. 2023-09-30T22:27:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.887+0000 7f5d585ad700 1 Processor -- start 2023-09-30T22:27:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d585ad700 1 -- start start 2023-09-30T22:27:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d585ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d5011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d585ad700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d501309f0 0x7f5d5011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d585ad700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d5011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:53.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d585ad700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5012d930 con 0x7f5d501309f0 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d585ad700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5011f3c0 con 0x7f5d50133ad0 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d585ad700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500a33b0 con 0x7f5d501300a0 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d55b48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d501309f0 0x7f5d5011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d56b4a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d5011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d56349700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d5011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d55b48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d501309f0 0x7f5d5011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41468/0 (socket says 172.21.15.154:41468) 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.888+0000 7f5d55b48700 1 -- 172.21.15.154:0/790707645 learned_addr learned my addr 172.21.15.154:0/790707645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d56b4a700 1 -- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 msgr2=0x7f5d5011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d56b4a700 1 --2- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d5011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d56b4a700 1 -- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d501309f0 msgr2=0x7f5d5011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d56b4a700 1 --2- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d501309f0 0x7f5d5011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d56b4a700 1 -- 172.21.15.154:0/790707645 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0094a0 con 0x7f5d50133ad0 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d55b48700 1 --2- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d501309f0 0x7f5d5011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d56349700 1 --2- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d5011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d56b4a700 1 --2- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d5011e4c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800cc10 tx=0x7f5d4800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d46ffd700 1 -- 172.21.15.154:0/790707645 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800aa00 con 0x7f5d50133ad0 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d46ffd700 1 -- 172.21.15.154:0/790707645 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4800ab80 con 0x7f5d50133ad0 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d585ad700 1 -- 172.21.15.154:0/790707645 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d400094a0 con 0x7f5d50133ad0 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d46ffd700 1 -- 172.21.15.154:0/790707645 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d480070d0 con 0x7f5d50133ad0 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.889+0000 7f5d585ad700 1 -- 172.21.15.154:0/790707645 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5011fda0 con 0x7f5d50133ad0 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.890+0000 7f5d46ffd700 1 -- 172.21.15.154:0/790707645 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d48007230 con 0x7f5d50133ad0 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.890+0000 7f5d46ffd700 1 -- 172.21.15.154:0/790707645 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5d4803f400 con 0x7f5d50133ad0 2023-09-30T22:27:53.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.890+0000 7f5d585ad700 1 -- 172.21.15.154:0/790707645 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5011ffc0 con 0x7f5d50133ad0 2023-09-30T22:27:53.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.895+0000 7f5d46ffd700 1 -- 172.21.15.154:0/790707645 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d5011ffc0 con 0x7f5d50133ad0 2023-09-30T22:27:53.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.993+0000 7fa03bb36700 1 -- 172.21.15.154:0/2063055406 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa03404f2a0 con 0x7fa034134160 2023-09-30T22:27:53.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.994+0000 7fa02a7fc700 1 -- 172.21.15.154:0/2063055406 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa02c01de00 con 0x7fa034134160 2023-09-30T22:27:53.995 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:53.995 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:53.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.996+0000 7fa03bb36700 1 -- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 msgr2=0x7fa034122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:53.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.996+0000 7fa03bb36700 1 --2- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034122f80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009e50 tx=0x7fa02c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.996+0000 7fa03bb36700 1 -- 172.21.15.154:0/2063055406 shutdown_connections 2023-09-30T22:27:53.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.996+0000 7fa03bb36700 1 --2- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa034134160 0x7fa034122f80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.996+0000 7fa03bb36700 1 --2- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa03409e870 0x7fa034122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.996+0000 7fa03bb36700 1 --2- 172.21.15.154:0/2063055406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa03409f180 0x7fa034122a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:53.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.996+0000 7fa03bb36700 1 -- 172.21.15.154:0/2063055406 >> 172.21.15.154:0/2063055406 conn(0x7fa0340a4430 msgr2=0x7fa034070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:53.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.996+0000 7fa03bb36700 1 -- 172.21.15.154:0/2063055406 shutdown_connections 2023-09-30T22:27:53.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:53.996+0000 7fa03bb36700 1 -- 172.21.15.154:0/2063055406 wait complete. 2023-09-30T22:27:54.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.119+0000 7f6d73a2a700 1 Processor -- start 2023-09-30T22:27:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.119+0000 7f6d73a2a700 1 -- start start 2023-09-30T22:27:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d73a2a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d6c0a1550 0x7f6d6c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d73a2a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c139200 0x7f6d6c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d73a2a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c09e9d0 con 0x7f6d6c0a0a70 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d73a2a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c09dc00 con 0x7f6d6c0a1550 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d73a2a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c09dec0 con 0x7f6d6c139200 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d70fc5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d6c0a1550 0x7f6d6c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d71fc7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c139200 0x7f6d6c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d70fc5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d6c0a1550 0x7f6d6c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41484/0 (socket says 172.21.15.154:41484) 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d70fc5700 1 -- 172.21.15.154:0/4027384207 learned_addr learned my addr 172.21.15.154:0/4027384207 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d71fc7700 1 -- 172.21.15.154:0/4027384207 >> v2:172.21.15.154:3300/0 conn(0x7f6d6c0a1550 msgr2=0x7f6d6c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d71fc7700 1 --2- 172.21.15.154:0/4027384207 >> v2:172.21.15.154:3300/0 conn(0x7f6d6c0a1550 0x7f6d6c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d71fc7700 1 -- 172.21.15.154:0/4027384207 >> v1:172.21.15.154:6789/0 conn(0x7f6d6c0a0a70 legacy=0x7f6d6c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d71fc7700 1 -- 172.21.15.154:0/4027384207 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c09e6a0 con 0x7f6d6c139200 2023-09-30T22:27:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d63fff700 1 -- 172.21.15.154:0/4027384207 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979804297 0 0) 0x7f6d6c09e9d0 con 0x7f6d6c0a0a70 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d70fc5700 1 --2- 172.21.15.154:0/4027384207 >> v2:172.21.15.154:3300/0 conn(0x7f6d6c0a1550 0x7f6d6c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d71fc7700 1 --2- 172.21.15.154:0/4027384207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c139200 0x7f6d6c13b5e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d6400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da3215c6b3a49e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d63fff700 1 -- 172.21.15.154:0/4027384207 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400e070 con 0x7f6d6c139200 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d63fff700 1 -- 172.21.15.154:0/4027384207 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6400bb20 con 0x7f6d6c139200 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.120+0000 7f6d63fff700 1 -- 172.21.15.154:0/4027384207 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64012430 con 0x7f6d6c139200 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.121+0000 7f6d73a2a700 1 -- 172.21.15.154:0/4027384207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c139200 msgr2=0x7f6d6c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.121+0000 7f6d73a2a700 1 --2- 172.21.15.154:0/4027384207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c139200 0x7f6d6c13b5e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009d90 tx=0x7f6d6400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.121+0000 7f6d73a2a700 1 -- 172.21.15.154:0/4027384207 shutdown_connections 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.121+0000 7f6d73a2a700 1 --2- 172.21.15.154:0/4027384207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c139200 0x7f6d6c13b5e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.121+0000 7f6d73a2a700 1 --2- 172.21.15.154:0/4027384207 >> v2:172.21.15.154:3300/0 conn(0x7f6d6c0a1550 0x7f6d6c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.121+0000 7f6d73a2a700 1 -- 172.21.15.154:0/4027384207 >> 172.21.15.154:0/4027384207 conn(0x7f6d6c0a6610 msgr2=0x7f6d6c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:54.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.121+0000 7f6d73a2a700 1 -- 172.21.15.154:0/4027384207 shutdown_connections 2023-09-30T22:27:54.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.121+0000 7f6d73a2a700 1 -- 172.21.15.154:0/4027384207 wait complete. 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.122+0000 7f6d73a2a700 1 Processor -- start 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.122+0000 7f6d73a2a700 1 -- start start 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.122+0000 7f6d73a2a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d6c0a0a70 0x7f6d6c11e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.122+0000 7f6d73a2a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c0a1550 0x7f6d6c11ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.122+0000 7f6d73a2a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d6c139200 0x7f6d6c11f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.122+0000 7f6d73a2a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0a03e0 con 0x7f6d6c139200 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.122+0000 7f6d73a2a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c121990 con 0x7f6d6c0a1550 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.122+0000 7f6d73a2a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c121eb0 con 0x7f6d6c0a0a70 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d70fc5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c0a1550 0x7f6d6c11ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d70fc5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c0a1550 0x7f6d6c11ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48190/0 (socket says 172.21.15.154:48190) 2023-09-30T22:27:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d70fc5700 1 -- 172.21.15.154:0/2718658547 learned_addr learned my addr 172.21.15.154:0/2718658547 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d71fc7700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d6c139200 0x7f6d6c11f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d717c6700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d6c0a0a70 0x7f6d6c11e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d70fc5700 1 -- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d6c0a0a70 msgr2=0x7f6d6c11e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d70fc5700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d6c0a0a70 0x7f6d6c11e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d70fc5700 1 -- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d6c139200 msgr2=0x7f6d6c11f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d70fc5700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d6c139200 0x7f6d6c11f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d70fc5700 1 -- 172.21.15.154:0/2718658547 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c009550 con 0x7f6d6c0a1550 2023-09-30T22:27:54.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d71fc7700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d6c139200 0x7f6d6c11f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d70fc5700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c0a1550 0x7f6d6c11ebb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00ebe0 tx=0x7f6d5c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d61ffb700 1 -- 172.21.15.154:0/2718658547 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00c850 con 0x7f6d6c0a1550 2023-09-30T22:27:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d61ffb700 1 -- 172.21.15.154:0/2718658547 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c00c9b0 con 0x7f6d6c0a1550 2023-09-30T22:27:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d73a2a700 1 -- 172.21.15.154:0/2718658547 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d64009a70 con 0x7f6d6c0a1550 2023-09-30T22:27:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d61ffb700 1 -- 172.21.15.154:0/2718658547 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00cd40 con 0x7f6d6c0a1550 2023-09-30T22:27:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.123+0000 7f6d73a2a700 1 -- 172.21.15.154:0/2718658547 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c122920 con 0x7f6d6c0a1550 2023-09-30T22:27:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.124+0000 7f6d61ffb700 1 -- 172.21.15.154:0/2718658547 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d5c013470 con 0x7f6d6c0a1550 2023-09-30T22:27:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.124+0000 7f6d73a2a700 1 -- 172.21.15.154:0/2718658547 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c04f2a0 con 0x7f6d6c0a1550 2023-09-30T22:27:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.124+0000 7f6d61ffb700 1 -- 172.21.15.154:0/2718658547 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6d5c03fc00 con 0x7f6d6c0a1550 2023-09-30T22:27:54.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.127+0000 7f5d585ad700 1 -- 172.21.15.154:0/790707645 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5d5011ffc0 con 0x7f5d50133ad0 2023-09-30T22:27:54.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.129+0000 7f5d46ffd700 1 -- 172.21.15.154:0/790707645 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d5011ffc0 con 0x7f5d50133ad0 2023-09-30T22:27:54.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.129+0000 7f6d61ffb700 1 -- 172.21.15.154:0/2718658547 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d5c01b3b0 con 0x7f6d6c0a1550 2023-09-30T22:27:54.130 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.131+0000 7f5d585ad700 1 -- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 msgr2=0x7f5d5011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.131+0000 7f5d585ad700 1 --2- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d5011e4c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800cc10 tx=0x7f5d4800cf20 comp rx=0 tx=0).stop 2023-09-30T22:27:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.131+0000 7f5d585ad700 1 -- 172.21.15.154:0/790707645 shutdown_connections 2023-09-30T22:27:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.131+0000 7f5d585ad700 1 --2- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d50133ad0 0x7f5d5011e4c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.131+0000 7f5d585ad700 1 --2- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5d501300a0 0x7f5d5011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.131+0000 7f5d585ad700 1 --2- 172.21.15.154:0/790707645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d501309f0 0x7f5d5011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.131+0000 7f5d585ad700 1 -- 172.21.15.154:0/790707645 >> 172.21.15.154:0/790707645 conn(0x7f5d50099c40 msgr2=0x7f5d5012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.131+0000 7f5d585ad700 1 -- 172.21.15.154:0/790707645 shutdown_connections 2023-09-30T22:27:54.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.131+0000 7f5d585ad700 1 -- 172.21.15.154:0/790707645 wait complete. 2023-09-30T22:27:54.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:54.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.317+0000 7f6d73a2a700 1 -- 172.21.15.154:0/2718658547 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6d6c121b50 con 0x7f6d6c0a1550 2023-09-30T22:27:54.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.317+0000 7f6d61ffb700 1 -- 172.21.15.154:0/2718658547 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d5c024350 con 0x7f6d6c0a1550 2023-09-30T22:27:54.319 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:54.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.319+0000 7f6d73a2a700 1 -- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c0a1550 msgr2=0x7f6d6c11ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:54.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.319+0000 7f6d73a2a700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c0a1550 0x7f6d6c11ebb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00ebe0 tx=0x7f6d5c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.319+0000 7f6d73a2a700 1 -- 172.21.15.154:0/2718658547 shutdown_connections 2023-09-30T22:27:54.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.319+0000 7f6d73a2a700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d6c139200 0x7f6d6c11f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.319+0000 7f6d73a2a700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6d6c0a0a70 0x7f6d6c11e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.319+0000 7f6d73a2a700 1 --2- 172.21.15.154:0/2718658547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d6c0a1550 0x7f6d6c11ebb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:54.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.319+0000 7f6d73a2a700 1 -- 172.21.15.154:0/2718658547 >> 172.21.15.154:0/2718658547 conn(0x7f6d6c0a6610 msgr2=0x7f6d6c136bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:54.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.319+0000 7f6d73a2a700 1 -- 172.21.15.154:0/2718658547 shutdown_connections 2023-09-30T22:27:54.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:54.319+0000 7f6d73a2a700 1 -- 172.21.15.154:0/2718658547 wait complete. 2023-09-30T22:27:54.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:54.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.004+0000 7f968553d700 1 Processor -- start 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.004+0000 7f968553d700 1 -- start start 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f968553d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a0a90 0x7f96800a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f968553d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a13a0 0x7f9680133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f968553d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96800a1fe0 con 0x7f9680133f70 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f968553d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96800a3aa0 con 0x7f96800a0a90 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f968553d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f968009a540 con 0x7f96800a13a0 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a13a0 0x7f9680133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9680133f70 0x7f968013ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48176/0 (socket says 172.21.15.154:48176) 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967f7fe700 1 -- 172.21.15.154:0/1436040597 learned_addr learned my addr 172.21.15.154:0/1436040597 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967effd700 1 --2- 172.21.15.154:0/1436040597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a0a90 0x7f96800a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967e7fc700 1 -- 172.21.15.154:0/1436040597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a0a90 msgr2=0x7f96800a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967e7fc700 1 --2- 172.21.15.154:0/1436040597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a0a90 0x7f96800a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967e7fc700 1 -- 172.21.15.154:0/1436040597 >> v1:172.21.15.154:6789/0 conn(0x7f9680133f70 legacy=0x7f968013ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967dffb700 1 -- 172.21.15.154:0/1436040597 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364917691 0 0) 0x7f96800a1fe0 con 0x7f9680133f70 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967e7fc700 1 -- 172.21.15.154:0/1436040597 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968009a280 con 0x7f96800a13a0 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967effd700 1 --2- 172.21.15.154:0/1436040597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a0a90 0x7f96800a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.005+0000 7f967e7fc700 1 --2- 172.21.15.154:0/1436040597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a13a0 0x7f9680133a30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9670009870 tx=0x7f9670009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82273c0ab3130b95 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f967dffb700 1 -- 172.21.15.154:0/1436040597 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670011830 con 0x7f96800a13a0 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f967dffb700 1 -- 172.21.15.154:0/1436040597 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9670011990 con 0x7f96800a13a0 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f967dffb700 1 -- 172.21.15.154:0/1436040597 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670011d20 con 0x7f96800a13a0 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f968553d700 1 -- 172.21.15.154:0/1436040597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a13a0 msgr2=0x7f9680133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f968553d700 1 --2- 172.21.15.154:0/1436040597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a13a0 0x7f9680133a30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9670009870 tx=0x7f9670009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f968553d700 1 -- 172.21.15.154:0/1436040597 shutdown_connections 2023-09-30T22:27:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f968553d700 1 --2- 172.21.15.154:0/1436040597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a0a90 0x7f96800a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f968553d700 1 --2- 172.21.15.154:0/1436040597 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a13a0 0x7f9680133a30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f968553d700 1 -- 172.21.15.154:0/1436040597 >> 172.21.15.154:0/1436040597 conn(0x7f9680099c40 msgr2=0x7f968006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f968553d700 1 -- 172.21.15.154:0/1436040597 shutdown_connections 2023-09-30T22:27:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.006+0000 7f968553d700 1 -- 172.21.15.154:0/1436040597 wait complete. 2023-09-30T22:27:55.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.007+0000 7f968553d700 1 Processor -- start 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.007+0000 7f968553d700 1 -- start start 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f968553d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a0a90 0x7f9680121320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f968553d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a13a0 0x7f9680121860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f968553d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680133f70 0x7f9680121da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f968553d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9680124bb0 con 0x7f9680133f70 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f968553d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96801326a0 con 0x7f96800a13a0 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f968553d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9680124850 con 0x7f96800a0a90 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a0a90 0x7f9680121320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a0a90 0x7f9680121320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48490/0 (socket says 172.21.15.154:48490) 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967effd700 1 -- 172.21.15.154:0/3633747667 learned_addr learned my addr 172.21.15.154:0/3633747667 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:55.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967e7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a13a0 0x7f9680121860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967f7fe700 1 --2- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680133f70 0x7f9680121da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967effd700 1 -- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a13a0 msgr2=0x7f9680121860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967effd700 1 --2- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a13a0 0x7f9680121860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967effd700 1 -- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680133f70 msgr2=0x7f9680121da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967effd700 1 --2- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680133f70 0x7f9680121da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967effd700 1 -- 172.21.15.154:0/3633747667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740094a0 con 0x7f96800a0a90 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967e7fc700 1 --2- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a13a0 0x7f9680121860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f967effd700 1 --2- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a0a90 0x7f9680121320 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f967400ec10 tx=0x7f967400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f96677fe700 1 -- 172.21.15.154:0/3633747667 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400c850 con 0x7f96800a0a90 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f96677fe700 1 -- 172.21.15.154:0/3633747667 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967400c9b0 con 0x7f96800a0a90 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f968553d700 1 -- 172.21.15.154:0/3633747667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96700094a0 con 0x7f96800a0a90 2023-09-30T22:27:55.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f96677fe700 1 -- 172.21.15.154:0/3633747667 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400cd20 con 0x7f96800a0a90 2023-09-30T22:27:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.008+0000 7f968553d700 1 -- 172.21.15.154:0/3633747667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968009d3b0 con 0x7f96800a0a90 2023-09-30T22:27:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.009+0000 7f96677fe700 1 -- 172.21.15.154:0/3633747667 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9674013470 con 0x7f96800a0a90 2023-09-30T22:27:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.009+0000 7f96677fe700 1 -- 172.21.15.154:0/3633747667 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f967403f740 con 0x7f96800a0a90 2023-09-30T22:27:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.009+0000 7f968553d700 1 -- 172.21.15.154:0/3633747667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9680124130 con 0x7f96800a0a90 2023-09-30T22:27:55.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.014+0000 7f96677fe700 1 -- 172.21.15.154:0/3633747667 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9674013720 con 0x7f96800a0a90 2023-09-30T22:27:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb206874700 1 Processor -- start 2023-09-30T22:27:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb206874700 1 -- start start 2023-09-30T22:27:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb206874700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2001347b0 0x7fb200136b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb206874700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001370d0 0x7fb2001394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb206874700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20006f970 con 0x7fb200098410 2023-09-30T22:27:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb206874700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000720a0 con 0x7fb2001370d0 2023-09-30T22:27:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb206874700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb200098ef0 con 0x7fb2001347b0 2023-09-30T22:27:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb1ff7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2001347b0 0x7fb200136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb1fffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb200098410 0x7fb2000987e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48182/0 (socket says 172.21.15.154:48182) 2023-09-30T22:27:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb1fffff700 1 -- 172.21.15.154:0/3882057830 learned_addr learned my addr 172.21.15.154:0/3882057830 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb204e11700 1 --2- 172.21.15.154:0/3882057830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001370d0 0x7fb2001394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb1feffd700 1 -- 172.21.15.154:0/3882057830 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691595463 0 0) 0x7fb20006f970 con 0x7fb200098410 2023-09-30T22:27:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.138+0000 7fb1feffd700 1 -- 172.21.15.154:0/3882057830 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e80035b0 con 0x7fb200098410 2023-09-30T22:27:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb1ff7fe700 1 -- 172.21.15.154:0/3882057830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001370d0 msgr2=0x7fb2001394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb1ff7fe700 1 --2- 172.21.15.154:0/3882057830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001370d0 0x7fb2001394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb1ff7fe700 1 -- 172.21.15.154:0/3882057830 >> v1:172.21.15.154:6789/0 conn(0x7fb200098410 legacy=0x7fb2000987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb1ff7fe700 1 -- 172.21.15.154:0/3882057830 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200072290 con 0x7fb2001347b0 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb204e11700 1 --2- 172.21.15.154:0/3882057830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001370d0 0x7fb2001394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb1ff7fe700 1 --2- 172.21.15.154:0/3882057830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2001347b0 0x7fb200136b90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009870 tx=0x7fb1f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc48bb12a4c39ad1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb1feffd700 1 -- 172.21.15.154:0/3882057830 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4011830 con 0x7fb2001347b0 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb1feffd700 1 -- 172.21.15.154:0/3882057830 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4011990 con 0x7fb2001347b0 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb1feffd700 1 -- 172.21.15.154:0/3882057830 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4011d20 con 0x7fb2001347b0 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb206874700 1 -- 172.21.15.154:0/3882057830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2001347b0 msgr2=0x7fb200136b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb206874700 1 --2- 172.21.15.154:0/3882057830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2001347b0 0x7fb200136b90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009870 tx=0x7fb1f4009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb206874700 1 -- 172.21.15.154:0/3882057830 shutdown_connections 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb206874700 1 --2- 172.21.15.154:0/3882057830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001370d0 0x7fb2001394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb206874700 1 --2- 172.21.15.154:0/3882057830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2001347b0 0x7fb200136b90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb206874700 1 -- 172.21.15.154:0/3882057830 >> 172.21.15.154:0/3882057830 conn(0x7fb2000a2b30 msgr2=0x7fb20009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.139+0000 7fb206874700 1 -- 172.21.15.154:0/3882057830 shutdown_connections 2023-09-30T22:27:55.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.140+0000 7fb206874700 1 -- 172.21.15.154:0/3882057830 wait complete. 2023-09-30T22:27:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.141+0000 7fb206874700 1 Processor -- start 2023-09-30T22:27:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.141+0000 7fb206874700 1 -- start start 2023-09-30T22:27:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.141+0000 7fb206874700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb200098410 0x7fb20006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.141+0000 7fb206874700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001347b0 0x7fb20006dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.141+0000 7fb206874700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2001370d0 0x7fb20006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.141+0000 7fb206874700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20012ed60 con 0x7fb2001370d0 2023-09-30T22:27:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.141+0000 7fb206874700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20012b980 con 0x7fb2001347b0 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.141+0000 7fb206874700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb20009c020 con 0x7fb200098410 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1fffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb200098410 0x7fb20006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001347b0 0x7fb20006dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1ff7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001347b0 0x7fb20006dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:48222/0 (socket says 172.21.15.154:48222) 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb204e11700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2001370d0 0x7fb20006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1fffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb200098410 0x7fb20006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:48504/0 (socket says 172.21.15.154:48504) 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1ff7fe700 1 -- 172.21.15.154:0/3947991960 learned_addr learned my addr 172.21.15.154:0/3947991960 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1ff7fe700 1 -- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb200098410 msgr2=0x7fb20006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1ff7fe700 1 --2- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb200098410 0x7fb20006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1ff7fe700 1 -- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2001370d0 msgr2=0x7fb20006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1ff7fe700 1 --2- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2001370d0 0x7fb20006e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1ff7fe700 1 -- 172.21.15.154:0/3947991960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f8009a70 con 0x7fb2001347b0 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1fffff700 1 --2- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb200098410 0x7fb20006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb204e11700 1 --2- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2001370d0 0x7fb20006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1ff7fe700 1 --2- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001347b0 0x7fb20006dbf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40090b0 tx=0x7fb1f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1fcff9700 1 -- 172.21.15.154:0/3947991960 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40042c0 con 0x7fb2001347b0 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1fcff9700 1 -- 172.21.15.154:0/3947991960 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f401f070 con 0x7fb2001347b0 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb1fcff9700 1 -- 172.21.15.154:0/3947991960 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40036a0 con 0x7fb2001347b0 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb206874700 1 -- 172.21.15.154:0/3947991960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f40094a0 con 0x7fb2001347b0 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.142+0000 7fb206874700 1 -- 172.21.15.154:0/3947991960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb200070880 con 0x7fb2001347b0 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.143+0000 7fb1fcff9700 1 -- 172.21.15.154:0/3947991960 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1f4021030 con 0x7fb2001347b0 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.143+0000 7fb1fcff9700 1 -- 172.21.15.154:0/3947991960 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb1f40406f0 con 0x7fb2001347b0 2023-09-30T22:27:55.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.143+0000 7fb206874700 1 -- 172.21.15.154:0/3947991960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20004f2a0 con 0x7fb2001347b0 2023-09-30T22:27:55.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:55.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.148+0000 7fb1fcff9700 1 -- 172.21.15.154:0/3947991960 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1f40199a0 con 0x7fb2001347b0 2023-09-30T22:27:55.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.210+0000 7f968553d700 1 -- 172.21.15.154:0/3633747667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9680124640 con 0x7f96800a0a90 2023-09-30T22:27:55.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.211+0000 7f96677fe700 1 -- 172.21.15.154:0/3633747667 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9674021020 con 0x7f96800a0a90 2023-09-30T22:27:55.212 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:55.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.213+0000 7f968553d700 1 -- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a0a90 msgr2=0x7f9680121320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.213+0000 7f968553d700 1 --2- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a0a90 0x7f9680121320 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f967400ec10 tx=0x7f967400ef20 comp rx=0 tx=0).stop 2023-09-30T22:27:55.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.213+0000 7f968553d700 1 -- 172.21.15.154:0/3633747667 shutdown_connections 2023-09-30T22:27:55.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.213+0000 7f968553d700 1 --2- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9680133f70 0x7f9680121da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.213+0000 7f968553d700 1 --2- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f96800a0a90 0x7f9680121320 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.213+0000 7f968553d700 1 --2- 172.21.15.154:0/3633747667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96800a13a0 0x7f9680121860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.213+0000 7f968553d700 1 -- 172.21.15.154:0/3633747667 >> 172.21.15.154:0/3633747667 conn(0x7f9680099c40 msgr2=0x7f968009e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.213+0000 7f968553d700 1 -- 172.21.15.154:0/3633747667 shutdown_connections 2023-09-30T22:27:55.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.213+0000 7f968553d700 1 -- 172.21.15.154:0/3633747667 wait complete. 2023-09-30T22:27:55.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:55.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.274+0000 7ff533453700 1 Processor -- start 2023-09-30T22:27:55.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.274+0000 7ff533453700 1 -- start start 2023-09-30T22:27:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.274+0000 7ff533453700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff52c0a0a70 0x7ff52c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.274+0000 7ff533453700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.274+0000 7ff533453700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c09dc00 con 0x7ff52c133f50 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.274+0000 7ff533453700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c09ea60 con 0x7ff52c0a0a70 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.274+0000 7ff533453700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c09dec0 con 0x7ff52c0a1380 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.274+0000 7ff5311ef700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff52c0a0a70 0x7ff52c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5309ee700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5309ee700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55718/0 (socket says 172.21.15.154:55718) 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5311ef700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff52c0a0a70 0x7ff52c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36982/0 (socket says 172.21.15.154:36982) 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5309ee700 1 -- 172.21.15.154:0/218333697 learned_addr learned my addr 172.21.15.154:0/218333697 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5309ee700 1 -- 172.21.15.154:0/218333697 >> v2:172.21.15.154:3300/0 conn(0x7ff52c0a0a70 msgr2=0x7ff52c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:55.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5309ee700 1 --2- 172.21.15.154:0/218333697 >> v2:172.21.15.154:3300/0 conn(0x7ff52c0a0a70 0x7ff52c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5309ee700 1 -- 172.21.15.154:0/218333697 >> v1:172.21.15.154:6789/0 conn(0x7ff52c133f50 legacy=0x7ff52c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5309ee700 1 -- 172.21.15.154:0/218333697 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c09e6a0 con 0x7ff52c0a1380 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5311ef700 1 --2- 172.21.15.154:0/218333697 >> v2:172.21.15.154:3300/0 conn(0x7ff52c0a0a70 0x7ff52c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff5309ee700 1 --2- 172.21.15.154:0/218333697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c133a10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0098f0 tx=0x7ff51c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f932843ae25342b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff523fff700 1 -- 172.21.15.154:0/218333697 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c011830 con 0x7ff52c0a1380 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff523fff700 1 -- 172.21.15.154:0/218333697 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c011990 con 0x7ff52c0a1380 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.275+0000 7ff523fff700 1 -- 172.21.15.154:0/218333697 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c011d20 con 0x7ff52c0a1380 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.276+0000 7ff533453700 1 -- 172.21.15.154:0/218333697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 msgr2=0x7ff52c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.276+0000 7ff533453700 1 --2- 172.21.15.154:0/218333697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c133a10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0098f0 tx=0x7ff51c009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.276+0000 7ff533453700 1 -- 172.21.15.154:0/218333697 shutdown_connections 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.276+0000 7ff533453700 1 --2- 172.21.15.154:0/218333697 >> v2:172.21.15.154:3300/0 conn(0x7ff52c0a0a70 0x7ff52c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.276+0000 7ff533453700 1 --2- 172.21.15.154:0/218333697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c133a10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.276+0000 7ff533453700 1 -- 172.21.15.154:0/218333697 >> 172.21.15.154:0/218333697 conn(0x7ff52c0a6610 msgr2=0x7ff52c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.276+0000 7ff533453700 1 -- 172.21.15.154:0/218333697 shutdown_connections 2023-09-30T22:27:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.276+0000 7ff533453700 1 -- 172.21.15.154:0/218333697 wait complete. 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff533453700 1 Processor -- start 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff533453700 1 -- start start 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff533453700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52c0a0a70 0x7ff52c1c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff533453700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff533453700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff52c133f50 0x7ff52c1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff533453700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c122e90 con 0x7ff52c0a0a70 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff533453700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c133a10 con 0x7ff52c0a1380 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff533453700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c0a03e0 con 0x7ff52c133f50 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff5311ef700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52c0a0a70 0x7ff52c1c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff5311ef700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52c0a0a70 0x7ff52c1c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36990/0 (socket says 172.21.15.154:36990) 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff5311ef700 1 -- 172.21.15.154:0/3676733477 learned_addr learned my addr 172.21.15.154:0/3676733477 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff5309ee700 1 --2- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.277+0000 7ff5319f0700 1 --2- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff52c133f50 0x7ff52c1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff5311ef700 1 -- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff52c133f50 msgr2=0x7ff52c1c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff5311ef700 1 --2- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff52c133f50 0x7ff52c1c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff5311ef700 1 -- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 msgr2=0x7ff52c1c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff5311ef700 1 --2- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c1c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff5311ef700 1 -- 172.21.15.154:0/3676733477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280094a0 con 0x7ff52c0a0a70 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff5311ef700 1 --2- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52c0a0a70 0x7ff52c1c8250 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7ff52800ebe0 tx=0x7ff52800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff521ffb700 1 -- 172.21.15.154:0/3676733477 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800c850 con 0x7ff52c0a0a70 2023-09-30T22:27:55.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff521ffb700 1 -- 172.21.15.154:0/3676733477 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52800c9b0 con 0x7ff52c0a0a70 2023-09-30T22:27:55.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff533453700 1 -- 172.21.15.154:0/3676733477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c009550 con 0x7ff52c0a0a70 2023-09-30T22:27:55.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff521ffb700 1 -- 172.21.15.154:0/3676733477 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800cd20 con 0x7ff52c0a0a70 2023-09-30T22:27:55.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.278+0000 7ff533453700 1 -- 172.21.15.154:0/3676733477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c126030 con 0x7ff52c0a0a70 2023-09-30T22:27:55.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.279+0000 7ff521ffb700 1 -- 172.21.15.154:0/3676733477 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff528013470 con 0x7ff52c0a0a70 2023-09-30T22:27:55.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.279+0000 7ff521ffb700 1 -- 172.21.15.154:0/3676733477 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff52803fbb0 con 0x7ff52c0a0a70 2023-09-30T22:27:55.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.279+0000 7ff533453700 1 -- 172.21.15.154:0/3676733477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52c126330 con 0x7ff52c0a0a70 2023-09-30T22:27:55.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.284+0000 7ff521ffb700 1 -- 172.21.15.154:0/3676733477 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff528013720 con 0x7ff52c0a0a70 2023-09-30T22:27:55.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:55.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.348+0000 7fb206874700 1 -- 172.21.15.154:0/3947991960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb20006b2a0 con 0x7fb2001347b0 2023-09-30T22:27:55.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.349+0000 7fb1fcff9700 1 -- 172.21.15.154:0/3947991960 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1f4015020 con 0x7fb2001347b0 2023-09-30T22:27:55.350 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:55.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.351+0000 7fb206874700 1 -- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001347b0 msgr2=0x7fb20006dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.351+0000 7fb206874700 1 --2- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001347b0 0x7fb20006dbf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40090b0 tx=0x7fb1f4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:55.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.351+0000 7fb206874700 1 -- 172.21.15.154:0/3947991960 shutdown_connections 2023-09-30T22:27:55.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.351+0000 7fb206874700 1 --2- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2001370d0 0x7fb20006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.351+0000 7fb206874700 1 --2- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb200098410 0x7fb20006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.351+0000 7fb206874700 1 --2- 172.21.15.154:0/3947991960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2001347b0 0x7fb20006dbf0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.351+0000 7fb206874700 1 -- 172.21.15.154:0/3947991960 >> 172.21.15.154:0/3947991960 conn(0x7fb2000a2b30 msgr2=0x7fb20009c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.351+0000 7fb206874700 1 -- 172.21.15.154:0/3947991960 shutdown_connections 2023-09-30T22:27:55.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.351+0000 7fb206874700 1 -- 172.21.15.154:0/3947991960 wait complete. 2023-09-30T22:27:55.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:55.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.458+0000 7fc317b8a700 1 Processor -- start 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.458+0000 7fc317b8a700 1 -- start start 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc317b8a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc310133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc317b8a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc310133f70 0x7fc3101343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc317b8a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31009b110 con 0x7fc3100a0a70 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc317b8a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100a3b60 con 0x7fc310133f70 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc317b8a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3101348e0 con 0x7fc31009ad40 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc315926700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc310133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc315125700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc310133f70 0x7fc3101343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc315926700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc310133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54394/0 (socket says 172.21.15.154:54394) 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc315926700 1 -- 172.21.15.154:0/3122702183 learned_addr learned my addr 172.21.15.154:0/3122702183 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:55.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc315125700 1 -- 172.21.15.154:0/3122702183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 msgr2=0x7fc310133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc315125700 1 --2- 172.21.15.154:0/3122702183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc310133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc315125700 1 -- 172.21.15.154:0/3122702183 >> v1:172.21.15.154:6789/0 conn(0x7fc3100a0a70 legacy=0x7fc3100a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.459+0000 7fc315125700 1 -- 172.21.15.154:0/3122702183 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100a2fa0 con 0x7fc310133f70 2023-09-30T22:27:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc315125700 1 --2- 172.21.15.154:0/3122702183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc310133f70 0x7fc3101343a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009870 tx=0x7fc30c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b341a40067eb40e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc314924700 1 -- 172.21.15.154:0/3122702183 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c011830 con 0x7fc310133f70 2023-09-30T22:27:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc314924700 1 -- 172.21.15.154:0/3122702183 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c011990 con 0x7fc310133f70 2023-09-30T22:27:55.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc314924700 1 -- 172.21.15.154:0/3122702183 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c011d20 con 0x7fc310133f70 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc317b8a700 1 -- 172.21.15.154:0/3122702183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc310133f70 msgr2=0x7fc3101343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc317b8a700 1 --2- 172.21.15.154:0/3122702183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc310133f70 0x7fc3101343a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009870 tx=0x7fc30c009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc317b8a700 1 -- 172.21.15.154:0/3122702183 shutdown_connections 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc317b8a700 1 --2- 172.21.15.154:0/3122702183 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc310133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc317b8a700 1 --2- 172.21.15.154:0/3122702183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc310133f70 0x7fc3101343a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc317b8a700 1 -- 172.21.15.154:0/3122702183 >> 172.21.15.154:0/3122702183 conn(0x7fc310099c40 msgr2=0x7fc31006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc317b8a700 1 -- 172.21.15.154:0/3122702183 shutdown_connections 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.460+0000 7fc317b8a700 1 -- 172.21.15.154:0/3122702183 wait complete. 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.461+0000 7fc317b8a700 1 Processor -- start 2023-09-30T22:27:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.461+0000 7fc317b8a700 1 -- start start 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc317b8a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc31011e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc317b8a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3100a0a70 0x7fc31011e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc317b8a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc310133f70 0x7fc31011eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc317b8a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310122580 con 0x7fc310133f70 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc317b8a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31011fcb0 con 0x7fc3100a0a70 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc317b8a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc310120f00 con 0x7fc31009ad40 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315926700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc31011e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315125700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3100a0a70 0x7fc31011e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315125700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3100a0a70 0x7fc31011e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55752/0 (socket says 172.21.15.154:55752) 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315926700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc31011e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54400/0 (socket says 172.21.15.154:54400) 2023-09-30T22:27:55.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315125700 1 -- 172.21.15.154:0/1751512054 learned_addr learned my addr 172.21.15.154:0/1751512054 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc316127700 1 --2- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc310133f70 0x7fc31011eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315926700 1 -- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3100a0a70 msgr2=0x7fc31011e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315926700 1 --2- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3100a0a70 0x7fc31011e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315926700 1 -- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc310133f70 msgr2=0x7fc31011eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315926700 1 --2- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc310133f70 0x7fc31011eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315926700 1 -- 172.21.15.154:0/1751512054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0094a0 con 0x7fc31009ad40 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc315926700 1 --2- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc31011e0a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc30400e8d0 tx=0x7fc30400ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc3027fc700 1 -- 172.21.15.154:0/1751512054 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304013680 con 0x7fc31009ad40 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc3027fc700 1 -- 172.21.15.154:0/1751512054 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3040137e0 con 0x7fc31009ad40 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.462+0000 7fc3027fc700 1 -- 172.21.15.154:0/1751512054 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304013b70 con 0x7fc31009ad40 2023-09-30T22:27:55.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.463+0000 7fc317b8a700 1 -- 172.21.15.154:0/1751512054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3101202a0 con 0x7fc31009ad40 2023-09-30T22:27:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.463+0000 7fc317b8a700 1 -- 172.21.15.154:0/1751512054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31009c7e0 con 0x7fc31009ad40 2023-09-30T22:27:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.463+0000 7fc317b8a700 1 -- 172.21.15.154:0/1751512054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3100a58b0 con 0x7fc31009ad40 2023-09-30T22:27:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.463+0000 7fc3027fc700 1 -- 172.21.15.154:0/1751512054 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc304013cd0 con 0x7fc31009ad40 2023-09-30T22:27:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.464+0000 7fc3027fc700 1 -- 172.21.15.154:0/1751512054 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc30403f4f0 con 0x7fc31009ad40 2023-09-30T22:27:55.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.468+0000 7fc3027fc700 1 -- 172.21.15.154:0/1751512054 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc30401be10 con 0x7fc31009ad40 2023-09-30T22:27:55.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.483+0000 7ff533453700 1 -- 172.21.15.154:0/3676733477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff52c126dd0 con 0x7ff52c0a0a70 2023-09-30T22:27:55.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.483+0000 7ff521ffb700 1 -- 172.21.15.154:0/3676733477 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff528017020 con 0x7ff52c0a0a70 2023-09-30T22:27:55.484 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:55.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.485+0000 7ff533453700 1 -- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52c0a0a70 msgr2=0x7ff52c1c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.485+0000 7ff533453700 1 --2- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52c0a0a70 0x7ff52c1c8250 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7ff52800ebe0 tx=0x7ff52800eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.485+0000 7ff533453700 1 -- 172.21.15.154:0/3676733477 shutdown_connections 2023-09-30T22:27:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.485+0000 7ff533453700 1 --2- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff52c133f50 0x7ff52c1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.485+0000 7ff533453700 1 --2- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52c0a0a70 0x7ff52c1c8250 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.485+0000 7ff533453700 1 --2- 172.21.15.154:0/3676733477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff52c0a1380 0x7ff52c1c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.485+0000 7ff533453700 1 -- 172.21.15.154:0/3676733477 >> 172.21.15.154:0/3676733477 conn(0x7ff52c0a6610 msgr2=0x7ff52c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.486+0000 7ff533453700 1 -- 172.21.15.154:0/3676733477 shutdown_connections 2023-09-30T22:27:55.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.486+0000 7ff533453700 1 -- 172.21.15.154:0/3676733477 wait complete. 2023-09-30T22:27:55.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:55.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.653+0000 7fc317b8a700 1 -- 172.21.15.154:0/1751512054 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc31004f2a0 con 0x7fc31009ad40 2023-09-30T22:27:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.654+0000 7fc3027fc700 1 -- 172.21.15.154:0/1751512054 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc304017070 con 0x7fc31009ad40 2023-09-30T22:27:55.655 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:55.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.656+0000 7fc317b8a700 1 -- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 msgr2=0x7fc31011e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:55.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.656+0000 7fc317b8a700 1 --2- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc31011e0a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc30400e8d0 tx=0x7fc30400ebe0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.656+0000 7fc317b8a700 1 -- 172.21.15.154:0/1751512054 shutdown_connections 2023-09-30T22:27:55.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.656+0000 7fc317b8a700 1 --2- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc310133f70 0x7fc31011eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.656+0000 7fc317b8a700 1 --2- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc31009ad40 0x7fc31011e0a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.656+0000 7fc317b8a700 1 --2- 172.21.15.154:0/1751512054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3100a0a70 0x7fc31011e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:55.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.656+0000 7fc317b8a700 1 -- 172.21.15.154:0/1751512054 >> 172.21.15.154:0/1751512054 conn(0x7fc310099c40 msgr2=0x7fc310133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.656+0000 7fc317b8a700 1 -- 172.21.15.154:0/1751512054 shutdown_connections 2023-09-30T22:27:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:55.656+0000 7fc317b8a700 1 -- 172.21.15.154:0/1751512054 wait complete. 2023-09-30T22:27:55.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:56.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:56.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.355+0000 7f78dc1ae700 1 Processor -- start 2023-09-30T22:27:56.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.355+0000 7f78dc1ae700 1 -- start start 2023-09-30T22:27:56.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78dc1ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78dc1ae700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78d409f370 0x7f78d413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78dc1ae700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d409af80 con 0x7f78d409a150 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78dc1ae700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d409fe00 con 0x7f78d409f370 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78dc1ae700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78d406bec0 con 0x7f78d409ef80 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d9749700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d9f4a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f78d409a150 0x7f78d409e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35762/0 (socket says 172.21.15.154:35762) 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d9f4a700 1 -- 172.21.15.154:0/3015089548 learned_addr learned my addr 172.21.15.154:0/3015089548 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78da74b700 1 --2- 172.21.15.154:0/3015089548 >> v2:172.21.15.154:3300/0 conn(0x7f78d409f370 0x7f78d413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d9749700 1 -- 172.21.15.154:0/3015089548 >> v2:172.21.15.154:3300/0 conn(0x7f78d409f370 msgr2=0x7f78d413b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:56.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d9749700 1 --2- 172.21.15.154:0/3015089548 >> v2:172.21.15.154:3300/0 conn(0x7f78d409f370 0x7f78d413b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d9749700 1 -- 172.21.15.154:0/3015089548 >> v1:172.21.15.154:6789/0 conn(0x7f78d409a150 legacy=0x7f78d409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d9749700 1 -- 172.21.15.154:0/3015089548 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d406bc20 con 0x7f78d409ef80 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78da74b700 1 --2- 172.21.15.154:0/3015089548 >> v2:172.21.15.154:3300/0 conn(0x7f78d409f370 0x7f78d413b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d9749700 1 --2- 172.21.15.154:0/3015089548 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4138e60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009840 tx=0x7f78d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9186accdfb9877e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d8f48700 1 -- 172.21.15.154:0/3015089548 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0011830 con 0x7f78d409ef80 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d8f48700 1 -- 172.21.15.154:0/3015089548 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d0011990 con 0x7f78d409ef80 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.356+0000 7f78d8f48700 1 -- 172.21.15.154:0/3015089548 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0011d20 con 0x7f78d409ef80 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.357+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3015089548 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 msgr2=0x7f78d4138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.357+0000 7f78dc1ae700 1 --2- 172.21.15.154:0/3015089548 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4138e60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009840 tx=0x7f78d0009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.357+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3015089548 shutdown_connections 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.357+0000 7f78dc1ae700 1 --2- 172.21.15.154:0/3015089548 >> v2:172.21.15.154:3300/0 conn(0x7f78d409f370 0x7f78d413b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.357+0000 7f78dc1ae700 1 --2- 172.21.15.154:0/3015089548 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4138e60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.357+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3015089548 >> 172.21.15.154:0/3015089548 conn(0x7f78d40a4430 msgr2=0x7f78d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.357+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3015089548 shutdown_connections 2023-09-30T22:27:56.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.357+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3015089548 wait complete. 2023-09-30T22:27:56.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78dc1ae700 1 Processor -- start 2023-09-30T22:27:56.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78dc1ae700 1 -- start start 2023-09-30T22:27:56.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78dc1ae700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78d409a150 0x7f78d41397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78dc1ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78dc1ae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78d409f370 0x7f78d413a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78dc1ae700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d40a0440 con 0x7f78d409a150 2023-09-30T22:27:56.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78dc1ae700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d41341d0 con 0x7f78d409f370 2023-09-30T22:27:56.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78dc1ae700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78d409ba00 con 0x7f78d409ef80 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78d9749700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78d9749700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4139d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54430/0 (socket says 172.21.15.154:54430) 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78d9749700 1 -- 172.21.15.154:0/3929433728 learned_addr learned my addr 172.21.15.154:0/3929433728 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78da74b700 1 --2- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78d409f370 0x7f78d413a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.358+0000 7f78d9f4a700 1 --2- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78d409a150 0x7f78d41397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78d9749700 1 -- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78d409f370 msgr2=0x7f78d413a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78d9749700 1 --2- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78d409f370 0x7f78d413a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78d9749700 1 -- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78d409a150 msgr2=0x7f78d41397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78d9749700 1 --2- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78d409a150 0x7f78d41397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78d9749700 1 -- 172.21.15.154:0/3929433728 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc009a70 con 0x7f78d409ef80 2023-09-30T22:27:56.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78d9749700 1 --2- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4139d00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f78d00090b0 tx=0x7f78d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78ca7fc700 1 -- 172.21.15.154:0/3929433728 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d00045d0 con 0x7f78d409ef80 2023-09-30T22:27:56.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78ca7fc700 1 -- 172.21.15.154:0/3929433728 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d001f070 con 0x7f78d409ef80 2023-09-30T22:27:56.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3929433728 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d00094a0 con 0x7f78d409ef80 2023-09-30T22:27:56.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78ca7fc700 1 -- 172.21.15.154:0/3929433728 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d00038e0 con 0x7f78d409ef80 2023-09-30T22:27:56.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.359+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3929433728 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d41204d0 con 0x7f78d409ef80 2023-09-30T22:27:56.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.360+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3929433728 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d409fa30 con 0x7f78d409ef80 2023-09-30T22:27:56.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.360+0000 7f78ca7fc700 1 -- 172.21.15.154:0/3929433728 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78d0003a40 con 0x7f78d409ef80 2023-09-30T22:27:56.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.360+0000 7f78ca7fc700 1 -- 172.21.15.154:0/3929433728 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78d0021070 con 0x7f78d409ef80 2023-09-30T22:27:56.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:56.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.364+0000 7f78ca7fc700 1 -- 172.21.15.154:0/3929433728 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78d0010380 con 0x7f78d409ef80 2023-09-30T22:27:56.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.491+0000 7f2b3a13b700 1 Processor -- start 2023-09-30T22:27:56.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.491+0000 7f2b3a13b700 1 -- start start 2023-09-30T22:27:56.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.491+0000 7f2b3a13b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a0a70 0x7f2b340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.491+0000 7f2b3a13b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2b340a1380 0x7f2b34133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.491+0000 7f2b3a13b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b34133f50 0x7f2b34134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.491+0000 7f2b3a13b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3409e9d0 con 0x7f2b340a1380 2023-09-30T22:27:56.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.491+0000 7f2b3a13b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3409dc00 con 0x7f2b34133f50 2023-09-30T22:27:56.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.491+0000 7f2b3a13b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3409dec0 con 0x7f2b340a0a70 2023-09-30T22:27:56.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b337fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a0a70 0x7f2b340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b33fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b34133f50 0x7f2b34134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b337fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a0a70 0x7f2b340a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54438/0 (socket says 172.21.15.154:54438) 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b337fe700 1 -- 172.21.15.154:0/3873845676 learned_addr learned my addr 172.21.15.154:0/3873845676 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b32ffd700 1 --2- 172.21.15.154:0/3873845676 >> v2:172.21.15.154:3300/0 conn(0x7f2b340a1380 0x7f2b34133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b337fe700 1 -- 172.21.15.154:0/3873845676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b34133f50 msgr2=0x7f2b34134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b337fe700 1 --2- 172.21.15.154:0/3873845676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b34133f50 0x7f2b34134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b337fe700 1 -- 172.21.15.154:0/3873845676 >> v2:172.21.15.154:3300/0 conn(0x7f2b340a1380 msgr2=0x7f2b34133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b337fe700 1 --2- 172.21.15.154:0/3873845676 >> v2:172.21.15.154:3300/0 conn(0x7f2b340a1380 0x7f2b34133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b337fe700 1 -- 172.21.15.154:0/3873845676 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3409e6a0 con 0x7f2b340a0a70 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b33fff700 1 --2- 172.21.15.154:0/3873845676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b34133f50 0x7f2b34134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b32ffd700 1 --2- 172.21.15.154:0/3873845676 >> v2:172.21.15.154:3300/0 conn(0x7f2b340a1380 0x7f2b34133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b337fe700 1 --2- 172.21.15.154:0/3873845676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a0a70 0x7f2b340a0e40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009e50 tx=0x7f2b2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b167220d0e43dfa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b327fc700 1 -- 172.21.15.154:0/3873845676 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400e070 con 0x7f2b340a0a70 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b327fc700 1 -- 172.21.15.154:0/3873845676 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2400b910 con 0x7f2b340a0a70 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.492+0000 7f2b327fc700 1 -- 172.21.15.154:0/3873845676 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400bcc0 con 0x7f2b340a0a70 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.493+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3873845676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a0a70 msgr2=0x7f2b340a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.493+0000 7f2b3a13b700 1 --2- 172.21.15.154:0/3873845676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a0a70 0x7f2b340a0e40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009e50 tx=0x7f2b2400b330 comp rx=0 tx=0).stop 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.493+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3873845676 shutdown_connections 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.493+0000 7f2b3a13b700 1 --2- 172.21.15.154:0/3873845676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b34133f50 0x7f2b34134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.493+0000 7f2b3a13b700 1 --2- 172.21.15.154:0/3873845676 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a0a70 0x7f2b340a0e40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.493+0000 7f2b3a13b700 1 --2- 172.21.15.154:0/3873845676 >> v2:172.21.15.154:3300/0 conn(0x7f2b340a1380 0x7f2b34133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.493+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3873845676 >> 172.21.15.154:0/3873845676 conn(0x7f2b340a6610 msgr2=0x7f2b340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.493+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3873845676 shutdown_connections 2023-09-30T22:27:56.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.493+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3873845676 wait complete. 2023-09-30T22:27:56.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b3a13b700 1 Processor -- start 2023-09-30T22:27:56.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b3a13b700 1 -- start start 2023-09-30T22:27:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b3a13b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b340a0a70 0x7f2b341223a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b3a13b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a1380 0x7f2b341228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b3a13b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b34133f50 0x7f2b34122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b3a13b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34124130 con 0x7f2b34133f50 2023-09-30T22:27:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b3a13b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34124e40 con 0x7f2b340a0a70 2023-09-30T22:27:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b3a13b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34125200 con 0x7f2b340a1380 2023-09-30T22:27:56.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b32ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a1380 0x7f2b341228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b32ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a1380 0x7f2b341228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54448/0 (socket says 172.21.15.154:54448) 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b32ffd700 1 -- 172.21.15.154:0/3991268111 learned_addr learned my addr 172.21.15.154:0/3991268111 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b337fe700 1 --2- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b340a0a70 0x7f2b341223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.494+0000 7f2b33fff700 1 --2- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b34133f50 0x7f2b34122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b32ffd700 1 -- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b340a0a70 msgr2=0x7f2b341223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b32ffd700 1 --2- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b340a0a70 0x7f2b341223a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b32ffd700 1 -- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b34133f50 msgr2=0x7f2b34122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b32ffd700 1 --2- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b34133f50 0x7f2b34122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b32ffd700 1 -- 172.21.15.154:0/3991268111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280094a0 con 0x7f2b340a1380 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b32ffd700 1 --2- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a1380 0x7f2b341228e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800ebe0 tx=0x7f2b2800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b1bfff700 1 -- 172.21.15.154:0/3991268111 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800c850 con 0x7f2b340a1380 2023-09-30T22:27:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b1bfff700 1 -- 172.21.15.154:0/3991268111 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2800c9b0 con 0x7f2b340a1380 2023-09-30T22:27:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3991268111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c0094a0 con 0x7f2b340a1380 2023-09-30T22:27:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b1bfff700 1 -- 172.21.15.154:0/3991268111 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800cd40 con 0x7f2b340a1380 2023-09-30T22:27:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.495+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3991268111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b24009b30 con 0x7f2b340a1380 2023-09-30T22:27:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.496+0000 7f2b1bfff700 1 -- 172.21.15.154:0/3991268111 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b28013470 con 0x7f2b340a1380 2023-09-30T22:27:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.496+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3991268111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3404f2a0 con 0x7f2b340a1380 2023-09-30T22:27:56.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.496+0000 7f2b1bfff700 1 -- 172.21.15.154:0/3991268111 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2b2803f6e0 con 0x7f2b340a1380 2023-09-30T22:27:56.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:56.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.501+0000 7f2b1bfff700 1 -- 172.21.15.154:0/3991268111 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b28013720 con 0x7f2b340a1380 2023-09-30T22:27:56.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.565+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3929433728 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f78d406d230 con 0x7f78d409ef80 2023-09-30T22:27:56.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.566+0000 7f78ca7fc700 1 -- 172.21.15.154:0/3929433728 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78d0015020 con 0x7f78d409ef80 2023-09-30T22:27:56.567 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.568+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 msgr2=0x7f78d4139d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.568+0000 7f78dc1ae700 1 --2- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4139d00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f78d00090b0 tx=0x7f78d0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.568+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3929433728 shutdown_connections 2023-09-30T22:27:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.568+0000 7f78dc1ae700 1 --2- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78d409f370 0x7f78d413a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.568+0000 7f78dc1ae700 1 --2- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78d409a150 0x7f78d41397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.568+0000 7f78dc1ae700 1 --2- 172.21.15.154:0/3929433728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f78d409ef80 0x7f78d4139d00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.568+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3929433728 >> 172.21.15.154:0/3929433728 conn(0x7f78d40a4430 msgr2=0x7f78d409c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.568+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3929433728 shutdown_connections 2023-09-30T22:27:56.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.568+0000 7f78dc1ae700 1 -- 172.21.15.154:0/3929433728 wait complete. 2023-09-30T22:27:56.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.628+0000 7fa4baeda700 1 Processor -- start 2023-09-30T22:27:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4baeda700 1 -- start start 2023-09-30T22:27:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4baeda700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4b4134140 0x7fa4b4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4baeda700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4baeda700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b409b110 con 0x7fa4b409ad40 2023-09-30T22:27:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4baeda700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b40a3b60 con 0x7fa4b4134140 2023-09-30T22:27:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4baeda700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b40a1a80 con 0x7fa4b41345a0 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4b4134140 0x7fa4b4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b9477700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4b4134140 0x7fa4b4138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37026/0 (socket says 172.21.15.154:37026) 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b9477700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55794/0 (socket says 172.21.15.154:55794) 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b3fff700 1 -- 172.21.15.154:0/2872496668 learned_addr learned my addr 172.21.15.154:0/2872496668 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b3fff700 1 -- 172.21.15.154:0/2872496668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 msgr2=0x7fa4b413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b3fff700 1 --2- 172.21.15.154:0/2872496668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b3fff700 1 -- 172.21.15.154:0/2872496668 >> v1:172.21.15.154:6789/0 conn(0x7fa4b409ad40 legacy=0x7fa4b4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b3fff700 1 -- 172.21.15.154:0/2872496668 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b40a2fa0 con 0x7fa4b4134140 2023-09-30T22:27:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.629+0000 7fa4b9477700 1 --2- 172.21.15.154:0/2872496668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4b3fff700 1 --2- 172.21.15.154:0/2872496668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b4134140 0x7fa4b4138e80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00098f0 tx=0x7fa4a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e494c5f23470df4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4b37fe700 1 -- 172.21.15.154:0/2872496668 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0011830 con 0x7fa4b4134140 2023-09-30T22:27:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4b37fe700 1 -- 172.21.15.154:0/2872496668 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a0011990 con 0x7fa4b4134140 2023-09-30T22:27:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4b37fe700 1 -- 172.21.15.154:0/2872496668 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0011d20 con 0x7fa4b4134140 2023-09-30T22:27:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4baeda700 1 -- 172.21.15.154:0/2872496668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b4134140 msgr2=0x7fa4b4138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4baeda700 1 --2- 172.21.15.154:0/2872496668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b4134140 0x7fa4b4138e80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00098f0 tx=0x7fa4a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4baeda700 1 -- 172.21.15.154:0/2872496668 shutdown_connections 2023-09-30T22:27:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4baeda700 1 --2- 172.21.15.154:0/2872496668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4baeda700 1 --2- 172.21.15.154:0/2872496668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b4134140 0x7fa4b4138e80 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4baeda700 1 -- 172.21.15.154:0/2872496668 >> 172.21.15.154:0/2872496668 conn(0x7fa4b4099c40 msgr2=0x7fa4b406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4baeda700 1 -- 172.21.15.154:0/2872496668 shutdown_connections 2023-09-30T22:27:56.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.630+0000 7fa4baeda700 1 -- 172.21.15.154:0/2872496668 wait complete. 2023-09-30T22:27:56.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.632+0000 7fa4baeda700 1 Processor -- start 2023-09-30T22:27:56.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.632+0000 7fa4baeda700 1 -- start start 2023-09-30T22:27:56.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.632+0000 7fa4baeda700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b409ad40 0x7fa4b411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.632+0000 7fa4baeda700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4b4134140 0x7fa4b411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.632+0000 7fa4baeda700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.632+0000 7fa4baeda700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b411df30 con 0x7fa4b409ad40 2023-09-30T22:27:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.632+0000 7fa4baeda700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b411f920 con 0x7fa4b41345a0 2023-09-30T22:27:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.632+0000 7fa4baeda700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b409c7e0 con 0x7fa4b4134140 2023-09-30T22:27:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4b4134140 0x7fa4b411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b9477700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b8c76700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b409ad40 0x7fa4b411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4b4134140 0x7fa4b411ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54462/0 (socket says 172.21.15.154:54462) 2023-09-30T22:27:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b9477700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b411d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55802/0 (socket says 172.21.15.154:55802) 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b8c76700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b409ad40 0x7fa4b411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37040/0 (socket says 172.21.15.154:37040) 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b3fff700 1 -- 172.21.15.154:0/1754684728 learned_addr learned my addr 172.21.15.154:0/1754684728 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b8c76700 1 -- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4b4134140 msgr2=0x7fa4b411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b8c76700 1 --2- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4b4134140 0x7fa4b411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b8c76700 1 -- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 msgr2=0x7fa4b411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b8c76700 1 --2- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b8c76700 1 -- 172.21.15.154:0/1754684728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac009a70 con 0x7fa4b409ad40 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b3fff700 1 --2- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4b4134140 0x7fa4b411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b9477700 1 --2- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b8c76700 1 --2- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b409ad40 0x7fa4b411c8c0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8000f60 tx=0x7fa4a800c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b17fa700 1 -- 172.21.15.154:0/1754684728 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a80052d0 con 0x7fa4b409ad40 2023-09-30T22:27:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b17fa700 1 -- 172.21.15.154:0/1754684728 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a8005430 con 0x7fa4b409ad40 2023-09-30T22:27:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4baeda700 1 -- 172.21.15.154:0/1754684728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a0009550 con 0x7fa4b409ad40 2023-09-30T22:27:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4b17fa700 1 -- 172.21.15.154:0/1754684728 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a80038a0 con 0x7fa4b409ad40 2023-09-30T22:27:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.633+0000 7fa4baeda700 1 -- 172.21.15.154:0/1754684728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b411ec60 con 0x7fa4b409ad40 2023-09-30T22:27:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.634+0000 7fa4b17fa700 1 -- 172.21.15.154:0/1754684728 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4a8003a00 con 0x7fa4b409ad40 2023-09-30T22:27:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.634+0000 7fa4baeda700 1 -- 172.21.15.154:0/1754684728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b404f2a0 con 0x7fa4b409ad40 2023-09-30T22:27:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.634+0000 7fa4b17fa700 1 -- 172.21.15.154:0/1754684728 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4a803e9c0 con 0x7fa4b409ad40 2023-09-30T22:27:56.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.639+0000 7fa4b17fa700 1 -- 172.21.15.154:0/1754684728 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4a8017030 con 0x7fa4b409ad40 2023-09-30T22:27:56.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:56.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.696+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3991268111 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2b34072980 con 0x7f2b340a1380 2023-09-30T22:27:56.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.696+0000 7f2b1bfff700 1 -- 172.21.15.154:0/3991268111 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b28021020 con 0x7f2b340a1380 2023-09-30T22:27:56.697 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:56.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.698+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a1380 msgr2=0x7f2b341228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.698+0000 7f2b3a13b700 1 --2- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a1380 0x7f2b341228e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800ebe0 tx=0x7f2b2800eef0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.698+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3991268111 shutdown_connections 2023-09-30T22:27:56.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.698+0000 7f2b3a13b700 1 --2- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b34133f50 0x7f2b34122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.698+0000 7f2b3a13b700 1 --2- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b340a0a70 0x7f2b341223a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.698+0000 7f2b3a13b700 1 --2- 172.21.15.154:0/3991268111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2b340a1380 0x7f2b341228e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.698+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3991268111 >> 172.21.15.154:0/3991268111 conn(0x7f2b340a6610 msgr2=0x7f2b3409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.698+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3991268111 shutdown_connections 2023-09-30T22:27:56.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.698+0000 7f2b3a13b700 1 -- 172.21.15.154:0/3991268111 wait complete. 2023-09-30T22:27:56.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.792+0000 7fac09e2f700 1 Processor -- start 2023-09-30T22:27:56.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.792+0000 7fac09e2f700 1 -- start start 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac09e2f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac09e2f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 0x7fac04138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac09e2f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0409aaa0 con 0x7fac0409e170 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac09e2f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0409f870 con 0x7fac0409d860 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac09e2f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac0409b360 con 0x7fac04130eb0 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55818/0 (socket says 172.21.15.154:55818) 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac037fe700 1 -- 172.21.15.154:0/3346179198 learned_addr learned my addr 172.21.15.154:0/3346179198 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fabfbfff700 1 --1- 172.21.15.154:0/3346179198 >> v1:172.21.15.154:6789/0 conn(0x7fac0409e170 0x7fac041307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35782/0 (socket says 172.21.15.154:35782) 2023-09-30T22:27:56.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac03fff700 1 --2- 172.21.15.154:0/3346179198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 0x7fac04138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac037fe700 1 -- 172.21.15.154:0/3346179198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 msgr2=0x7fac04138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac037fe700 1 --2- 172.21.15.154:0/3346179198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 0x7fac04138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac037fe700 1 -- 172.21.15.154:0/3346179198 >> v1:172.21.15.154:6789/0 conn(0x7fac0409e170 legacy=0x7fac041307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac02ffd700 1 -- 172.21.15.154:0/3346179198 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581628273 0 0) 0x7fac0409aaa0 con 0x7fac0409e170 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac037fe700 1 -- 172.21.15.154:0/3346179198 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0409b620 con 0x7fac0409d860 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.793+0000 7fac03fff700 1 --2- 172.21.15.154:0/3346179198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 0x7fac04138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac037fe700 1 --2- 172.21.15.154:0/3346179198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0409dc30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009920 tx=0x7fabf4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d78a22b3fdc898d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac02ffd700 1 -- 172.21.15.154:0/3346179198 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400f8a0 con 0x7fac0409d860 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac02ffd700 1 -- 172.21.15.154:0/3346179198 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400fa00 con 0x7fac0409d860 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac02ffd700 1 -- 172.21.15.154:0/3346179198 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400fd90 con 0x7fac0409d860 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac09e2f700 1 -- 172.21.15.154:0/3346179198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 msgr2=0x7fac0409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac09e2f700 1 --2- 172.21.15.154:0/3346179198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0409dc30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009920 tx=0x7fabf4009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:56.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac09e2f700 1 -- 172.21.15.154:0/3346179198 shutdown_connections 2023-09-30T22:27:56.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac09e2f700 1 --2- 172.21.15.154:0/3346179198 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 0x7fac04138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac09e2f700 1 --2- 172.21.15.154:0/3346179198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0409dc30 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac09e2f700 1 -- 172.21.15.154:0/3346179198 >> 172.21.15.154:0/3346179198 conn(0x7fac04099c40 msgr2=0x7fac040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac09e2f700 1 -- 172.21.15.154:0/3346179198 shutdown_connections 2023-09-30T22:27:56.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.794+0000 7fac09e2f700 1 -- 172.21.15.154:0/3346179198 wait complete. 2023-09-30T22:27:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.795+0000 7fac09e2f700 1 Processor -- start 2023-09-30T22:27:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.795+0000 7fac09e2f700 1 -- start start 2023-09-30T22:27:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac09e2f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0411e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac09e2f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac0409e170 0x7fac0411e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac09e2f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 0x7fac0411ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac09e2f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04121e70 con 0x7fac0409e170 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac09e2f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac040a0760 con 0x7fac0409d860 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac09e2f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac0409c8b0 con 0x7fac04130eb0 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0411e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0411e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55832/0 (socket says 172.21.15.154:55832) 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac037fe700 1 -- 172.21.15.154:0/3683899416 learned_addr learned my addr 172.21.15.154:0/3683899416 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fabfbfff700 1 --2- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac0409e170 0x7fac0411e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac03fff700 1 --2- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 0x7fac0411ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac037fe700 1 -- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 msgr2=0x7fac0411ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac037fe700 1 --2- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 0x7fac0411ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac037fe700 1 -- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac0409e170 msgr2=0x7fac0411e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac037fe700 1 --2- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac0409e170 0x7fac0411e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac037fe700 1 -- 172.21.15.154:0/3683899416 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc009a70 con 0x7fac0409d860 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac037fe700 1 --2- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0411e2b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fabf4000c00 tx=0x7fabf4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.796+0000 7fac00ff9700 1 -- 172.21.15.154:0/3683899416 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf401d040 con 0x7fac0409d860 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.797+0000 7fac00ff9700 1 -- 172.21.15.154:0/3683899416 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf4003ab0 con 0x7fac0409d860 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.797+0000 7fac00ff9700 1 -- 172.21.15.154:0/3683899416 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4003e40 con 0x7fac0409d860 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.797+0000 7fac09e2f700 1 -- 172.21.15.154:0/3683899416 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf4009550 con 0x7fac0409d860 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.797+0000 7fac09e2f700 1 -- 172.21.15.154:0/3683899416 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0411f6a0 con 0x7fac0409d860 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.797+0000 7fac00ff9700 1 -- 172.21.15.154:0/3683899416 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabf402c410 con 0x7fac0409d860 2023-09-30T22:27:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.797+0000 7fac00ff9700 1 -- 172.21.15.154:0/3683899416 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fabf4042db0 con 0x7fac0409d860 2023-09-30T22:27:56.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.798+0000 7fac09e2f700 1 -- 172.21.15.154:0/3683899416 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0404f2a0 con 0x7fac0409d860 2023-09-30T22:27:56.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.802+0000 7fac00ff9700 1 -- 172.21.15.154:0/3683899416 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabf4004560 con 0x7fac0409d860 2023-09-30T22:27:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.835+0000 7fa4baeda700 1 -- 172.21.15.154:0/1754684728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4b40729d0 con 0x7fa4b409ad40 2023-09-30T22:27:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.836+0000 7fa4b17fa700 1 -- 172.21.15.154:0/1754684728 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4a8019d20 con 0x7fa4b409ad40 2023-09-30T22:27:56.837 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.838+0000 7fa4baeda700 1 -- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b409ad40 msgr2=0x7fa4b411c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.838+0000 7fa4baeda700 1 --2- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b409ad40 0x7fa4b411c8c0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8000f60 tx=0x7fa4a800c6e0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.838+0000 7fa4baeda700 1 -- 172.21.15.154:0/1754684728 shutdown_connections 2023-09-30T22:27:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.838+0000 7fa4baeda700 1 --2- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4b41345a0 0x7fa4b411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.838+0000 7fa4baeda700 1 --2- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b409ad40 0x7fa4b411c8c0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.838+0000 7fa4baeda700 1 --2- 172.21.15.154:0/1754684728 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4b4134140 0x7fa4b411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.838+0000 7fa4baeda700 1 -- 172.21.15.154:0/1754684728 >> 172.21.15.154:0/1754684728 conn(0x7fa4b4099c40 msgr2=0x7fa4b413b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.838+0000 7fa4baeda700 1 -- 172.21.15.154:0/1754684728 shutdown_connections 2023-09-30T22:27:56.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.838+0000 7fa4baeda700 1 -- 172.21.15.154:0/1754684728 wait complete. 2023-09-30T22:27:56.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:56.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.991+0000 7fac09e2f700 1 -- 172.21.15.154:0/3683899416 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fac0406c3b0 con 0x7fac0409d860 2023-09-30T22:27:56.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.992+0000 7fac00ff9700 1 -- 172.21.15.154:0/3683899416 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabf402b370 con 0x7fac0409d860 2023-09-30T22:27:56.993 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:56.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.994+0000 7fac09e2f700 1 -- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 msgr2=0x7fac0411e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:56.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.994+0000 7fac09e2f700 1 --2- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0411e2b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fabf4000c00 tx=0x7fabf4004750 comp rx=0 tx=0).stop 2023-09-30T22:27:56.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.994+0000 7fac09e2f700 1 -- 172.21.15.154:0/3683899416 shutdown_connections 2023-09-30T22:27:56.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.994+0000 7fac09e2f700 1 --2- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fac04130eb0 0x7fac0411ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.994+0000 7fac09e2f700 1 --2- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0409d860 0x7fac0411e2b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.994+0000 7fac09e2f700 1 --2- 172.21.15.154:0/3683899416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac0409e170 0x7fac0411e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:56.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.994+0000 7fac09e2f700 1 -- 172.21.15.154:0/3683899416 >> 172.21.15.154:0/3683899416 conn(0x7fac04099c40 msgr2=0x7fac040a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:56.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.994+0000 7fac09e2f700 1 -- 172.21.15.154:0/3683899416 shutdown_connections 2023-09-30T22:27:56.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:56.994+0000 7fac09e2f700 1 -- 172.21.15.154:0/3683899416 wait complete. 2023-09-30T22:27:57.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:57.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:57.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:57.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.711+0000 7f3310d89700 1 Processor -- start 2023-09-30T22:27:57.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.711+0000 7f3310d89700 1 -- start start 2023-09-30T22:27:57.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f3310d89700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f3310d89700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f330c09dec0 0x7f330c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f3310d89700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c06b5c0 con 0x7f330c131a00 2023-09-30T22:27:57.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f3310d89700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c06e900 con 0x7f330c09dec0 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f3310d89700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c09d180 con 0x7f330c06a770 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f330a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f3309d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f330c09dec0 0x7f330c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f3309d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f330c09dec0 0x7f330c06b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37070/0 (socket says 172.21.15.154:37070) 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f330a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55844/0 (socket says 172.21.15.154:55844) 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.712+0000 7f3309d9b700 1 -- 172.21.15.154:0/887793996 learned_addr learned my addr 172.21.15.154:0/887793996 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3309d9b700 1 -- 172.21.15.154:0/887793996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 msgr2=0x7f330c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3309d9b700 1 --2- 172.21.15.154:0/887793996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3309d9b700 1 -- 172.21.15.154:0/887793996 >> v1:172.21.15.154:6789/0 conn(0x7f330c131a00 legacy=0x7f330c131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3309d9b700 1 -- 172.21.15.154:0/887793996 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c09e780 con 0x7f330c09dec0 2023-09-30T22:27:57.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f330a59c700 1 --2- 172.21.15.154:0/887793996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:57.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3309d9b700 1 --2- 172.21.15.154:0/887793996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 0x7f330c06b080 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0098f0 tx=0x7f32fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f080f019802be10 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:57.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f330959a700 1 -- 172.21.15.154:0/887793996 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc011830 con 0x7f330c09dec0 2023-09-30T22:27:57.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f330959a700 1 -- 172.21.15.154:0/887793996 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc011990 con 0x7f330c09dec0 2023-09-30T22:27:57.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f330959a700 1 -- 172.21.15.154:0/887793996 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc011d20 con 0x7f330c09dec0 2023-09-30T22:27:57.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3310d89700 1 -- 172.21.15.154:0/887793996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 msgr2=0x7f330c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3310d89700 1 --2- 172.21.15.154:0/887793996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 0x7f330c06b080 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0098f0 tx=0x7f32fc009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:57.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3310d89700 1 -- 172.21.15.154:0/887793996 shutdown_connections 2023-09-30T22:27:57.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3310d89700 1 --2- 172.21.15.154:0/887793996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3310d89700 1 --2- 172.21.15.154:0/887793996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 0x7f330c06b080 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.713+0000 7f3310d89700 1 -- 172.21.15.154:0/887793996 >> 172.21.15.154:0/887793996 conn(0x7f330c099c40 msgr2=0x7f330c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:57.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.714+0000 7f3310d89700 1 -- 172.21.15.154:0/887793996 shutdown_connections 2023-09-30T22:27:57.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.714+0000 7f3310d89700 1 -- 172.21.15.154:0/887793996 wait complete. 2023-09-30T22:27:57.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3310d89700 1 Processor -- start 2023-09-30T22:27:57.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3310d89700 1 -- start start 2023-09-30T22:27:57.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3310d89700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c11c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3310d89700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 0x7f330c11c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3310d89700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f330c131a00 0x7f330c11cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3310d89700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c11f920 con 0x7f330c09dec0 2023-09-30T22:27:57.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3310d89700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c071ce0 con 0x7f330c06a770 2023-09-30T22:27:57.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3310d89700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f330c11dc40 con 0x7f330c131a00 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3309d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 0x7f330c11c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3309d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 0x7f330c11c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37072/0 (socket says 172.21.15.154:37072) 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f3309d9b700 1 -- 172.21.15.154:0/3414387639 learned_addr learned my addr 172.21.15.154:0/3414387639 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f330ad9d700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f330c131a00 0x7f330c11cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f330a59c700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c11c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f330ad9d700 1 -- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 msgr2=0x7f330c11c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f330ad9d700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c11c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f330ad9d700 1 -- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 msgr2=0x7f330c11c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.715+0000 7f330ad9d700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 0x7f330c11c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.716+0000 7f330ad9d700 1 -- 172.21.15.154:0/3414387639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000094a0 con 0x7f330c131a00 2023-09-30T22:27:57.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.716+0000 7f3309d9b700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 0x7f330c11c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:57.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.716+0000 7f330a59c700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c11c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:27:57.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.716+0000 7f330ad9d700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f330c131a00 0x7f330c11cb00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f330400cbc0 tx=0x7f330400ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:57.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.716+0000 7f32faffd700 1 -- 172.21.15.154:0/3414387639 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304003c00 con 0x7f330c131a00 2023-09-30T22:27:57.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.716+0000 7f32faffd700 1 -- 172.21.15.154:0/3414387639 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3304003d60 con 0x7f330c131a00 2023-09-30T22:27:57.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.716+0000 7f3310d89700 1 -- 172.21.15.154:0/3414387639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc009550 con 0x7f330c131a00 2023-09-30T22:27:57.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.716+0000 7f32faffd700 1 -- 172.21.15.154:0/3414387639 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400aaa0 con 0x7f330c131a00 2023-09-30T22:27:57.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.716+0000 7f3310d89700 1 -- 172.21.15.154:0/3414387639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c130d20 con 0x7f330c131a00 2023-09-30T22:27:57.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.717+0000 7f32faffd700 1 -- 172.21.15.154:0/3414387639 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f330400ac00 con 0x7f330c131a00 2023-09-30T22:27:57.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.717+0000 7f32faffd700 1 -- 172.21.15.154:0/3414387639 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f330403f670 con 0x7f330c131a00 2023-09-30T22:27:57.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.717+0000 7f3310d89700 1 -- 172.21.15.154:0/3414387639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c04f2a0 con 0x7f330c131a00 2023-09-30T22:27:57.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.722+0000 7f32faffd700 1 -- 172.21.15.154:0/3414387639 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33040198f0 con 0x7f330c131a00 2023-09-30T22:27:57.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.837+0000 7f27061a8700 1 Processor -- start 2023-09-30T22:27:57.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f27061a8700 1 -- start start 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f27061a8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f270009e870 0x7f270009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f27061a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270009f180 0x7f2700131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f27061a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2700131d70 0x7f27001321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f27061a8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27000a0920 con 0x7f270009e870 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f27061a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270009c970 con 0x7f270009f180 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f27061a8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f270009bab0 con 0x7f2700131d70 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26ff7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f270009e870 0x7f270009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270009f180 0x7f2700131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26ff7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f270009e870 0x7f270009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37078/0 (socket says 172.21.15.154:37078) 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26ff7fe700 1 -- 172.21.15.154:0/4229764798 learned_addr learned my addr 172.21.15.154:0/4229764798 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:57.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26fffff700 1 --2- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2700131d70 0x7f27001321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26ff7fe700 1 -- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2700131d70 msgr2=0x7f27001321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26ff7fe700 1 --2- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2700131d70 0x7f27001321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26ff7fe700 1 -- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270009f180 msgr2=0x7f2700131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26ff7fe700 1 --2- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270009f180 0x7f2700131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.838+0000 7f26ff7fe700 1 -- 172.21.15.154:0/4229764798 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270009f9c0 con 0x7f270009e870 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f26feffd700 1 --2- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270009f180 0x7f2700131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f26ff7fe700 1 --2- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 0x7f270009ec40 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009920 tx=0x7f26f0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2971812d12e42f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f26fe7fc700 1 -- 172.21.15.154:0/4229764798 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011830 con 0x7f270009e870 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f26fe7fc700 1 -- 172.21.15.154:0/4229764798 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0011990 con 0x7f270009e870 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f26fe7fc700 1 -- 172.21.15.154:0/4229764798 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011d20 con 0x7f270009e870 2023-09-30T22:27:57.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f27061a8700 1 -- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 msgr2=0x7f270009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f27061a8700 1 --2- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 0x7f270009ec40 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009920 tx=0x7f26f0009c30 comp rx=0 tx=0).stop 2023-09-30T22:27:57.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f27061a8700 1 -- 172.21.15.154:0/4229764798 shutdown_connections 2023-09-30T22:27:57.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f27061a8700 1 --2- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2700131d70 0x7f27001321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f27061a8700 1 --2- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 0x7f270009ec40 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f27061a8700 1 --2- 172.21.15.154:0/4229764798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270009f180 0x7f2700131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f27061a8700 1 -- 172.21.15.154:0/4229764798 >> 172.21.15.154:0/4229764798 conn(0x7f27000a4430 msgr2=0x7f27000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:57.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f27061a8700 1 -- 172.21.15.154:0/4229764798 shutdown_connections 2023-09-30T22:27:57.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.839+0000 7f27061a8700 1 -- 172.21.15.154:0/4229764798 wait complete. 2023-09-30T22:27:57.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.840+0000 7f27061a8700 1 Processor -- start 2023-09-30T22:27:57.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f27061a8700 1 -- start start 2023-09-30T22:27:57.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f27061a8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 0x7f270011d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f27061a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f270009f180 0x7f270011d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f27061a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2700131d70 0x7f27001c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f27061a8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270011ce60 con 0x7f270009e870 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f27061a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270011eb80 con 0x7f2700131d70 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f27061a8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f270011ddd0 con 0x7f270009f180 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26ff7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 0x7f270011d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26ff7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 0x7f270011d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37084/0 (socket says 172.21.15.154:37084) 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26fffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2700131d70 0x7f27001c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26ff7fe700 1 -- 172.21.15.154:0/3726278559 learned_addr learned my addr 172.21.15.154:0/3726278559 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26feffd700 1 --2- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f270009f180 0x7f270011d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26ff7fe700 1 -- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f270009f180 msgr2=0x7f270011d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26ff7fe700 1 --2- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f270009f180 0x7f270011d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26ff7fe700 1 -- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2700131d70 msgr2=0x7f27001c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26ff7fe700 1 --2- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2700131d70 0x7f27001c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.841+0000 7f26ff7fe700 1 -- 172.21.15.154:0/3726278559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40094a0 con 0x7f270009e870 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.842+0000 7f26ff7fe700 1 --2- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 0x7f270011d350 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f26f0000c00 tx=0x7f26f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.842+0000 7f26e7fff700 1 -- 172.21.15.154:0/3726278559 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0004240 con 0x7f270009e870 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.842+0000 7f26e7fff700 1 -- 172.21.15.154:0/3726278559 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f001f070 con 0x7f270009e870 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.842+0000 7f26e7fff700 1 -- 172.21.15.154:0/3726278559 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f00045c0 con 0x7f270009e870 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.842+0000 7f27061a8700 1 -- 172.21.15.154:0/3726278559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f0009550 con 0x7f270009e870 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.842+0000 7f27061a8700 1 -- 172.21.15.154:0/3726278559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270011ed80 con 0x7f270009e870 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.843+0000 7f26e7fff700 1 -- 172.21.15.154:0/3726278559 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26f0021030 con 0x7f270009e870 2023-09-30T22:27:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.843+0000 7f26e7fff700 1 -- 172.21.15.154:0/3726278559 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26f00407b0 con 0x7f270009e870 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.843+0000 7f27061a8700 1 -- 172.21.15.154:0/3726278559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270004f2a0 con 0x7f270009e870 2023-09-30T22:27:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.848+0000 7f26e7fff700 1 -- 172.21.15.154:0/3726278559 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26f0015070 con 0x7f270009e870 2023-09-30T22:27:57.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:57.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.922+0000 7f3310d89700 1 -- 172.21.15.154:0/3414387639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f330c09e3a0 con 0x7f330c131a00 2023-09-30T22:27:57.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.922+0000 7f32faffd700 1 -- 172.21.15.154:0/3414387639 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3304029090 con 0x7f330c131a00 2023-09-30T22:27:57.924 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:57.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.924+0000 7f3310d89700 1 -- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f330c131a00 msgr2=0x7f330c11cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.924+0000 7f3310d89700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f330c131a00 0x7f330c11cb00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f330400cbc0 tx=0x7f330400ced0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.924+0000 7f3310d89700 1 -- 172.21.15.154:0/3414387639 shutdown_connections 2023-09-30T22:27:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.924+0000 7f3310d89700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f330c131a00 0x7f330c11cb00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.924+0000 7f3310d89700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f330c06a770 0x7f330c11c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.924+0000 7f3310d89700 1 --2- 172.21.15.154:0/3414387639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c09dec0 0x7f330c11c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.924+0000 7f3310d89700 1 -- 172.21.15.154:0/3414387639 >> 172.21.15.154:0/3414387639 conn(0x7f330c099c40 msgr2=0x7f330c1b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.924+0000 7f3310d89700 1 -- 172.21.15.154:0/3414387639 shutdown_connections 2023-09-30T22:27:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.924+0000 7f3310d89700 1 -- 172.21.15.154:0/3414387639 wait complete. 2023-09-30T22:27:57.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:57.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.976+0000 7f3f0f013700 1 Processor -- start 2023-09-30T22:27:57.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.976+0000 7f3f0f013700 1 -- start start 2023-09-30T22:27:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.977+0000 7f3f0f013700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 0x7f3f0809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.977+0000 7f3f0f013700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f08131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.977+0000 7f3f0f013700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0809c970 con 0x7f3f08131d70 2023-09-30T22:27:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.977+0000 7f3f0f013700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080a0920 con 0x7f3f0809e870 2023-09-30T22:27:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.977+0000 7f3f0f013700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0809f9c0 con 0x7f3f0809f180 2023-09-30T22:27:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.977+0000 7f3f0cdaf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 0x7f3f0809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.977+0000 7f3f0d5b0700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3f08131d70 0x7f3f08138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35810/0 (socket says 172.21.15.154:35810) 2023-09-30T22:27:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.977+0000 7f3f0d5b0700 1 -- 172.21.15.154:0/4244382168 learned_addr learned my addr 172.21.15.154:0/4244382168 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.977+0000 7f3f07fff700 1 --2- 172.21.15.154:0/4244382168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f08131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f0cdaf700 1 -- 172.21.15.154:0/4244382168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 msgr2=0x7f3f08131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f0cdaf700 1 --2- 172.21.15.154:0/4244382168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f08131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f077fe700 1 -- 172.21.15.154:0/4244382168 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 558615270 0 0) 0x7f3f0809c970 con 0x7f3f08131d70 2023-09-30T22:27:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f0cdaf700 1 -- 172.21.15.154:0/4244382168 >> v1:172.21.15.154:6789/0 conn(0x7f3f08131d70 legacy=0x7f3f08138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f0cdaf700 1 -- 172.21.15.154:0/4244382168 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0809bab0 con 0x7f3f0809e870 2023-09-30T22:27:57.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f07fff700 1 --2- 172.21.15.154:0/4244382168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f08131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:57.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f0cdaf700 1 --2- 172.21.15.154:0/4244382168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 0x7f3f0809ec40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009870 tx=0x7f3efc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e4eaee4063d9aa5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:57.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f077fe700 1 -- 172.21.15.154:0/4244382168 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc011830 con 0x7f3f0809e870 2023-09-30T22:27:57.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f077fe700 1 -- 172.21.15.154:0/4244382168 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc011990 con 0x7f3f0809e870 2023-09-30T22:27:57.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.978+0000 7f3f077fe700 1 -- 172.21.15.154:0/4244382168 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc011d20 con 0x7f3f0809e870 2023-09-30T22:27:57.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.979+0000 7f3f0f013700 1 -- 172.21.15.154:0/4244382168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 msgr2=0x7f3f0809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.979+0000 7f3f0f013700 1 --2- 172.21.15.154:0/4244382168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 0x7f3f0809ec40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009870 tx=0x7f3efc009b80 comp rx=0 tx=0).stop 2023-09-30T22:27:57.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.979+0000 7f3f0f013700 1 -- 172.21.15.154:0/4244382168 shutdown_connections 2023-09-30T22:27:57.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.979+0000 7f3f0f013700 1 --2- 172.21.15.154:0/4244382168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 0x7f3f0809ec40 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.979+0000 7f3f0f013700 1 --2- 172.21.15.154:0/4244382168 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f08131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.979+0000 7f3f0f013700 1 -- 172.21.15.154:0/4244382168 >> 172.21.15.154:0/4244382168 conn(0x7f3f080a4430 msgr2=0x7f3f080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:57.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.979+0000 7f3f0f013700 1 -- 172.21.15.154:0/4244382168 shutdown_connections 2023-09-30T22:27:57.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.979+0000 7f3f0f013700 1 -- 172.21.15.154:0/4244382168 wait complete. 2023-09-30T22:27:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.980+0000 7f3f0f013700 1 Processor -- start 2023-09-30T22:27:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.980+0000 7f3f0f013700 1 -- start start 2023-09-30T22:27:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0f013700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 0x7f3f081c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0f013700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f081c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0f013700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f08131d70 0x7f3f081c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0f013700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0809dba0 con 0x7f3f08131d70 2023-09-30T22:27:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0f013700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0811fef0 con 0x7f3f0809e870 2023-09-30T22:27:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0f013700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0811e580 con 0x7f3f0809f180 2023-09-30T22:27:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0d5b0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f08131d70 0x7f3f081c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0cdaf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 0x7f3f081c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0d5b0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f08131d70 0x7f3f081c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37096/0 (socket says 172.21.15.154:37096) 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0d5b0700 1 -- 172.21.15.154:0/2703327801 learned_addr learned my addr 172.21.15.154:0/2703327801 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f07fff700 1 --2- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f081c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0d5b0700 1 -- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 msgr2=0x7f3f081c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0d5b0700 1 --2- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f081c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0d5b0700 1 -- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 msgr2=0x7f3f081c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0d5b0700 1 --2- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 0x7f3f081c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0d5b0700 1 -- 172.21.15.154:0/2703327801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef40094a0 con 0x7f3f08131d70 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f07fff700 1 --2- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f081c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f0d5b0700 1 --2- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f08131d70 0x7f3f081c6a80 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f3f00002230 tx=0x7f3f0000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.981+0000 7f3f057fa700 1 -- 172.21.15.154:0/2703327801 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000aac0 con 0x7f3f08131d70 2023-09-30T22:27:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.982+0000 7f3f057fa700 1 -- 172.21.15.154:0/2703327801 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000ac20 con 0x7f3f08131d70 2023-09-30T22:27:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.982+0000 7f3f057fa700 1 -- 172.21.15.154:0/2703327801 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f000070d0 con 0x7f3f08131d70 2023-09-30T22:27:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.982+0000 7f3f0f013700 1 -- 172.21.15.154:0/2703327801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc0094a0 con 0x7f3f08131d70 2023-09-30T22:27:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.982+0000 7f3f0f013700 1 -- 172.21.15.154:0/2703327801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f08131640 con 0x7f3f08131d70 2023-09-30T22:27:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.982+0000 7f3f057fa700 1 -- 172.21.15.154:0/2703327801 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f00007230 con 0x7f3f08131d70 2023-09-30T22:27:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.982+0000 7f3f057fa700 1 -- 172.21.15.154:0/2703327801 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f0003f1f0 con 0x7f3f08131d70 2023-09-30T22:27:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.983+0000 7f3f0f013700 1 -- 172.21.15.154:0/2703327801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0804f2a0 con 0x7f3f08131d70 2023-09-30T22:27:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:57.987+0000 7f3f057fa700 1 -- 172.21.15.154:0/2703327801 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f00018070 con 0x7f3f08131d70 2023-09-30T22:27:58.008 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:58.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.048+0000 7f27061a8700 1 -- 172.21.15.154:0/3726278559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f270011e590 con 0x7f270009e870 2023-09-30T22:27:58.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.048+0000 7f26e7fff700 1 -- 172.21.15.154:0/3726278559 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26f001a450 con 0x7f270009e870 2023-09-30T22:27:58.049 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:58.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.050+0000 7f27061a8700 1 -- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 msgr2=0x7f270011d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.050+0000 7f27061a8700 1 --2- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 0x7f270011d350 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f26f0000c00 tx=0x7f26f0004750 comp rx=0 tx=0).stop 2023-09-30T22:27:58.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.050+0000 7f27061a8700 1 -- 172.21.15.154:0/3726278559 shutdown_connections 2023-09-30T22:27:58.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.050+0000 7f27061a8700 1 --2- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2700131d70 0x7f27001c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.050+0000 7f27061a8700 1 --2- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f270009e870 0x7f270011d350 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.050+0000 7f27061a8700 1 --2- 172.21.15.154:0/3726278559 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f270009f180 0x7f270011d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.050+0000 7f27061a8700 1 -- 172.21.15.154:0/3726278559 >> 172.21.15.154:0/3726278559 conn(0x7f27000a4430 msgr2=0x7f270009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.050+0000 7f27061a8700 1 -- 172.21.15.154:0/3726278559 shutdown_connections 2023-09-30T22:27:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.050+0000 7f27061a8700 1 -- 172.21.15.154:0/3726278559 wait complete. 2023-09-30T22:27:58.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.132+0000 7fc6c56b2700 1 Processor -- start 2023-09-30T22:27:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.132+0000 7fc6c56b2700 1 -- start start 2023-09-30T22:27:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6c56b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6c56b2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc6c009f260 0x7fc6c0137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6c56b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c013a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6c56b2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c00a06a0 con 0x7fc6c009f260 2023-09-30T22:27:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6c56b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00a0150 con 0x7fc6c0138180 2023-09-30T22:27:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6c56b2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c006b920 con 0x7fc6c009e950 2023-09-30T22:27:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6bf7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c013a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6beffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6beffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c009ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54538/0 (socket says 172.21.15.154:54538) 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6bf7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c013a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55914/0 (socket says 172.21.15.154:55914) 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6bf7fe700 1 -- 172.21.15.154:0/716383295 learned_addr learned my addr 172.21.15.154:0/716383295 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6be7fc700 1 --2- 172.21.15.154:0/716383295 >> v2:172.21.15.154:3300/0 conn(0x7fc6c009f260 0x7fc6c0137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6bf7fe700 1 -- 172.21.15.154:0/716383295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 msgr2=0x7fc6c009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6bf7fe700 1 --2- 172.21.15.154:0/716383295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6bf7fe700 1 -- 172.21.15.154:0/716383295 >> v2:172.21.15.154:3300/0 conn(0x7fc6c009f260 msgr2=0x7fc6c0137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6bf7fe700 1 --2- 172.21.15.154:0/716383295 >> v2:172.21.15.154:3300/0 conn(0x7fc6c009f260 0x7fc6c0137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6bf7fe700 1 -- 172.21.15.154:0/716383295 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c006d8e0 con 0x7fc6c0138180 2023-09-30T22:27:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.133+0000 7fc6beffd700 1 --2- 172.21.15.154:0/716383295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6bf7fe700 1 --2- 172.21.15.154:0/716383295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c013a560 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009e50 tx=0x7fc6b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=985fb775068e0d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6bdffb700 1 -- 172.21.15.154:0/716383295 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800e070 con 0x7fc6c0138180 2023-09-30T22:27:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6bdffb700 1 -- 172.21.15.154:0/716383295 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800b910 con 0x7fc6c0138180 2023-09-30T22:27:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6bdffb700 1 -- 172.21.15.154:0/716383295 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800bcc0 con 0x7fc6c0138180 2023-09-30T22:27:58.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6c56b2700 1 -- 172.21.15.154:0/716383295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 msgr2=0x7fc6c013a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6c56b2700 1 --2- 172.21.15.154:0/716383295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c013a560 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009e50 tx=0x7fc6b800b330 comp rx=0 tx=0).stop 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6c56b2700 1 -- 172.21.15.154:0/716383295 shutdown_connections 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6c56b2700 1 --2- 172.21.15.154:0/716383295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c013a560 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6c56b2700 1 --2- 172.21.15.154:0/716383295 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6c56b2700 1 --2- 172.21.15.154:0/716383295 >> v2:172.21.15.154:3300/0 conn(0x7fc6c009f260 0x7fc6c0137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6c56b2700 1 -- 172.21.15.154:0/716383295 >> 172.21.15.154:0/716383295 conn(0x7fc6c00a4470 msgr2=0x7fc6c00a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6c56b2700 1 -- 172.21.15.154:0/716383295 shutdown_connections 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.134+0000 7fc6c56b2700 1 -- 172.21.15.154:0/716383295 wait complete. 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.136+0000 7fc6c56b2700 1 Processor -- start 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.136+0000 7fc6c56b2700 1 -- start start 2023-09-30T22:27:58.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.136+0000 7fc6c56b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c0121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.136+0000 7fc6c56b2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c009f260 0x7fc6c0122090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.136+0000 7fc6c56b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c01225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.136+0000 7fc6c56b2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0123d30 con 0x7fc6c009f260 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.136+0000 7fc6c56b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c006ccc0 con 0x7fc6c0138180 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.136+0000 7fc6c56b2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c0123850 con 0x7fc6c009e950 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.136+0000 7fc6beffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c0121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6beffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c0121b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54550/0 (socket says 172.21.15.154:54550) 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6be7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c009f260 0x7fc6c0122090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6bf7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c01225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6beffd700 1 -- 172.21.15.154:0/310047850 learned_addr learned my addr 172.21.15.154:0/310047850 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6bf7fe700 1 -- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 msgr2=0x7fc6c0121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6bf7fe700 1 --2- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c0121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6bf7fe700 1 -- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c009f260 msgr2=0x7fc6c0122090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6bf7fe700 1 --2- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c009f260 0x7fc6c0122090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6bf7fe700 1 -- 172.21.15.154:0/310047850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b4009430 con 0x7fc6c0138180 2023-09-30T22:27:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6beffd700 1 --2- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c0121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6bf7fe700 1 --2- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c01225d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8015000 tx=0x7fc6b8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6a77fe700 1 -- 172.21.15.154:0/310047850 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8004450 con 0x7fc6c0138180 2023-09-30T22:27:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6a77fe700 1 -- 172.21.15.154:0/310047850 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b80045f0 con 0x7fc6c0138180 2023-09-30T22:27:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6a77fe700 1 -- 172.21.15.154:0/310047850 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80099b0 con 0x7fc6c0138180 2023-09-30T22:27:58.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6c56b2700 1 -- 172.21.15.154:0/310047850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b8009b30 con 0x7fc6c0138180 2023-09-30T22:27:58.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.137+0000 7fc6c56b2700 1 -- 172.21.15.154:0/310047850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c0123ec0 con 0x7fc6c0138180 2023-09-30T22:27:58.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.138+0000 7fc6a77fe700 1 -- 172.21.15.154:0/310047850 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6b801c410 con 0x7fc6c0138180 2023-09-30T22:27:58.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.138+0000 7fc6c56b2700 1 -- 172.21.15.154:0/310047850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c004f2a0 con 0x7fc6c0138180 2023-09-30T22:27:58.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.138+0000 7fc6a77fe700 1 -- 172.21.15.154:0/310047850 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6b8041090 con 0x7fc6c0138180 2023-09-30T22:27:58.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.143+0000 7fc6a77fe700 1 -- 172.21.15.154:0/310047850 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6b801c6c0 con 0x7fc6c0138180 2023-09-30T22:27:58.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.182+0000 7f3f0f013700 1 -- 172.21.15.154:0/2703327801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f0806b2a0 con 0x7f3f08131d70 2023-09-30T22:27:58.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.182+0000 7f3f057fa700 1 -- 172.21.15.154:0/2703327801 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f00011720 con 0x7f3f08131d70 2023-09-30T22:27:58.183 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:58.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.184+0000 7f3f0f013700 1 -- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f08131d70 msgr2=0x7f3f081c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.184+0000 7f3f0f013700 1 --2- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f08131d70 0x7f3f081c6a80 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f3f00002230 tx=0x7f3f0000cf50 comp rx=0 tx=0).stop 2023-09-30T22:27:58.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.184+0000 7f3f0f013700 1 -- 172.21.15.154:0/2703327801 shutdown_connections 2023-09-30T22:27:58.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.184+0000 7f3f0f013700 1 --2- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f08131d70 0x7f3f081c6a80 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.184+0000 7f3f0f013700 1 --2- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f0809e870 0x7f3f081c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.184+0000 7f3f0f013700 1 --2- 172.21.15.154:0/2703327801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f0809f180 0x7f3f081c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.184+0000 7f3f0f013700 1 -- 172.21.15.154:0/2703327801 >> 172.21.15.154:0/2703327801 conn(0x7f3f080a4430 msgr2=0x7f3f0809c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.185+0000 7f3f0f013700 1 -- 172.21.15.154:0/2703327801 shutdown_connections 2023-09-30T22:27:58.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.185+0000 7f3f0f013700 1 -- 172.21.15.154:0/2703327801 wait complete. 2023-09-30T22:27:58.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:58.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.330+0000 7fc6c56b2700 1 -- 172.21.15.154:0/310047850 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc6c0136a50 con 0x7fc6c0138180 2023-09-30T22:27:58.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.330+0000 7fc6a77fe700 1 -- 172.21.15.154:0/310047850 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6b801bb90 con 0x7fc6c0138180 2023-09-30T22:27:58.332 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:58.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.332+0000 7fc6c56b2700 1 -- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 msgr2=0x7fc6c01225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:58.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.332+0000 7fc6c56b2700 1 --2- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c01225d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8015000 tx=0x7fc6b8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.332+0000 7fc6c56b2700 1 -- 172.21.15.154:0/310047850 shutdown_connections 2023-09-30T22:27:58.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.332+0000 7fc6c56b2700 1 --2- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6c0138180 0x7fc6c01225d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.332+0000 7fc6c56b2700 1 --2- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc6c009e950 0x7fc6c0121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.332+0000 7fc6c56b2700 1 --2- 172.21.15.154:0/310047850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6c009f260 0x7fc6c0122090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:58.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.332+0000 7fc6c56b2700 1 -- 172.21.15.154:0/310047850 >> 172.21.15.154:0/310047850 conn(0x7fc6c00a4470 msgr2=0x7fc6c009d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:58.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.333+0000 7fc6c56b2700 1 -- 172.21.15.154:0/310047850 shutdown_connections 2023-09-30T22:27:58.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:58.333+0000 7fc6c56b2700 1 -- 172.21.15.154:0/310047850 wait complete. 2023-09-30T22:27:58.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:27:58.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:27:59.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:27:59.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.064+0000 7fd3b4cb2700 1 Processor -- start 2023-09-30T22:27:59.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.064+0000 7fd3b4cb2700 1 -- start start 2023-09-30T22:27:59.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3b4cb2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009d860 0x7fd3b009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3b4cb2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3b009e170 0x7fd3b01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3b4cb2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b009aaa0 con 0x7fd3b0130ce0 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3b4cb2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b009f870 con 0x7fd3b009e170 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3b4cb2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b009b360 con 0x7fd3b009d860 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3add9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3b009e170 0x7fd3b01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3ae59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009d860 0x7fd3b009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3add9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3b009e170 0x7fd3b01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37112/0 (socket says 172.21.15.154:37112) 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3ae59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009d860 0x7fd3b009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54562/0 (socket says 172.21.15.154:54562) 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3add9b700 1 -- 172.21.15.154:0/3539839422 learned_addr learned my addr 172.21.15.154:0/3539839422 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3add9b700 1 -- 172.21.15.154:0/3539839422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009d860 msgr2=0x7fd3b009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3add9b700 1 --2- 172.21.15.154:0/3539839422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009d860 0x7fd3b009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3add9b700 1 -- 172.21.15.154:0/3539839422 >> v1:172.21.15.154:6789/0 conn(0x7fd3b0130ce0 legacy=0x7fd3b01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3add9b700 1 -- 172.21.15.154:0/3539839422 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b009b620 con 0x7fd3b009e170 2023-09-30T22:27:59.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3ae59c700 1 --2- 172.21.15.154:0/3539839422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009d860 0x7fd3b009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3add9b700 1 --2- 172.21.15.154:0/3539839422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009e170 0x7fd3b01307a0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000bb90 tx=0x7fd3a000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff642cae160f7f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3ad59a700 1 -- 172.21.15.154:0/3539839422 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000dd30 con 0x7fd3b009e170 2023-09-30T22:27:59.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3ad59a700 1 -- 172.21.15.154:0/3539839422 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a000de90 con 0x7fd3b009e170 2023-09-30T22:27:59.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.065+0000 7fd3ad59a700 1 -- 172.21.15.154:0/3539839422 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0010690 con 0x7fd3b009e170 2023-09-30T22:27:59.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.066+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/3539839422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009e170 msgr2=0x7fd3b01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.066+0000 7fd3b4cb2700 1 --2- 172.21.15.154:0/3539839422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009e170 0x7fd3b01307a0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000bb90 tx=0x7fd3a000bea0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.066+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/3539839422 shutdown_connections 2023-09-30T22:27:59.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.066+0000 7fd3b4cb2700 1 --2- 172.21.15.154:0/3539839422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009d860 0x7fd3b009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.066+0000 7fd3b4cb2700 1 --2- 172.21.15.154:0/3539839422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009e170 0x7fd3b01307a0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.066+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/3539839422 >> 172.21.15.154:0/3539839422 conn(0x7fd3b0099c40 msgr2=0x7fd3b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.066+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/3539839422 shutdown_connections 2023-09-30T22:27:59.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.066+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/3539839422 wait complete. 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.067+0000 7fd3b4cb2700 1 Processor -- start 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.067+0000 7fd3b4cb2700 1 -- start start 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3b4cb2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009d860 0x7fd3b011e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3b4cb2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009e170 0x7fd3b011ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3b4cb2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3b0130ce0 0x7fd3b011f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3b4cb2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b0121ed0 con 0x7fd3b009d860 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3b4cb2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b01203b0 con 0x7fd3b0130ce0 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3b4cb2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b0120850 con 0x7fd3b009e170 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3add9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009e170 0x7fd3b011ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3ae59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009d860 0x7fd3b011e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3add9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009e170 0x7fd3b011ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54576/0 (socket says 172.21.15.154:54576) 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3ae59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009d860 0x7fd3b011e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37120/0 (socket says 172.21.15.154:37120) 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3add9b700 1 -- 172.21.15.154:0/2173810106 learned_addr learned my addr 172.21.15.154:0/2173810106 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3aed9d700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3b0130ce0 0x7fd3b011f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3ae59c700 1 -- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009e170 msgr2=0x7fd3b011ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3ae59c700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009e170 0x7fd3b011ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3ae59c700 1 -- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3b0130ce0 msgr2=0x7fd3b011f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3ae59c700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3b0130ce0 0x7fd3b011f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3ae59c700 1 -- 172.21.15.154:0/2173810106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a40094a0 con 0x7fd3b009d860 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3add9b700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009e170 0x7fd3b011ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3aed9d700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3b0130ce0 0x7fd3b011f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd3ae59c700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009d860 0x7fd3b011e690 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400e9b0 tx=0x7fd3a400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.068+0000 7fd39effd700 1 -- 172.21.15.154:0/2173810106 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400ee50 con 0x7fd3b009d860 2023-09-30T22:27:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.069+0000 7fd39effd700 1 -- 172.21.15.154:0/2173810106 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a400c850 con 0x7fd3b009d860 2023-09-30T22:27:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.069+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/2173810106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a000b7f0 con 0x7fd3b009d860 2023-09-30T22:27:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.069+0000 7fd39effd700 1 -- 172.21.15.154:0/2173810106 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400cc00 con 0x7fd3b009d860 2023-09-30T22:27:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.069+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/2173810106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b01221b0 con 0x7fd3b009d860 2023-09-30T22:27:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.069+0000 7fd39effd700 1 -- 172.21.15.154:0/2173810106 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3a4013470 con 0x7fd3b009d860 2023-09-30T22:27:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.070+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/2173810106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b0122010 con 0x7fd3b009d860 2023-09-30T22:27:59.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.070+0000 7fd39effd700 1 -- 172.21.15.154:0/2173810106 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3a403fac0 con 0x7fd3b009d860 2023-09-30T22:27:59.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.075+0000 7fd39effd700 1 -- 172.21.15.154:0/2173810106 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3b0122010 con 0x7fd3b009d860 2023-09-30T22:27:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.189+0000 7fcdd7c64700 1 Processor -- start 2023-09-30T22:27:59.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.189+0000 7fcdd7c64700 1 -- start start 2023-09-30T22:27:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.189+0000 7fcdd7c64700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.189+0000 7fcdd7c64700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 0x7fcdd0134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.189+0000 7fcdd7c64700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd009af80 con 0x7fcdd009edb0 2023-09-30T22:27:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.189+0000 7fcdd7c64700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd009a520 con 0x7fcdd009f1a0 2023-09-30T22:27:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.189+0000 7fcdd7c64700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd009fe00 con 0x7fcdd009a150 2023-09-30T22:27:59.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd51ff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcdd009edb0 0x7fcdd0133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35842/0 (socket says 172.21.15.154:35842) 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd51ff700 1 -- 172.21.15.154:0/2777720109 learned_addr learned my addr 172.21.15.154:0/2777720109 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd5a00700 1 --2- 172.21.15.154:0/2777720109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd6201700 1 --2- 172.21.15.154:0/2777720109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 0x7fcdd0134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd49fe700 1 -- 172.21.15.154:0/2777720109 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213367022 0 0) 0x7fcdd009af80 con 0x7fcdd009edb0 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd5a00700 1 -- 172.21.15.154:0/2777720109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 msgr2=0x7fcdd0134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd5a00700 1 --2- 172.21.15.154:0/2777720109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 0x7fcdd0134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd5a00700 1 -- 172.21.15.154:0/2777720109 >> v1:172.21.15.154:6789/0 conn(0x7fcdd009edb0 legacy=0x7fcdd0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd5a00700 1 -- 172.21.15.154:0/2777720109 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd006bc20 con 0x7fcdd009a150 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd5a00700 1 --2- 172.21.15.154:0/2777720109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd009e870 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0098a0 tx=0x7fcdcc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f300e84d35269a4d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd49fe700 1 -- 172.21.15.154:0/2777720109 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc011830 con 0x7fcdd009a150 2023-09-30T22:27:59.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd49fe700 1 -- 172.21.15.154:0/2777720109 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc011990 con 0x7fcdd009a150 2023-09-30T22:27:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.190+0000 7fcdd49fe700 1 -- 172.21.15.154:0/2777720109 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc011d20 con 0x7fcdd009a150 2023-09-30T22:27:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.191+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2777720109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 msgr2=0x7fcdd009e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.191+0000 7fcdd7c64700 1 --2- 172.21.15.154:0/2777720109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd009e870 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0098a0 tx=0x7fcdcc009bb0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.191+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2777720109 shutdown_connections 2023-09-30T22:27:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.191+0000 7fcdd7c64700 1 --2- 172.21.15.154:0/2777720109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 0x7fcdd0134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.191+0000 7fcdd7c64700 1 --2- 172.21.15.154:0/2777720109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd009e870 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.191+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2777720109 >> 172.21.15.154:0/2777720109 conn(0x7fcdd00a4430 msgr2=0x7fcdd00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.191+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2777720109 shutdown_connections 2023-09-30T22:27:59.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.191+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2777720109 wait complete. 2023-09-30T22:27:59.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.192+0000 7fcdd7c64700 1 Processor -- start 2023-09-30T22:27:59.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.192+0000 7fcdd7c64700 1 -- start start 2023-09-30T22:27:59.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd7c64700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd01c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd7c64700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd009edb0 0x7fcdd01c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd7c64700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 0x7fcdd01c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd7c64700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd01a96f0 con 0x7fcdd009edb0 2023-09-30T22:27:59.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd7c64700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00a0440 con 0x7fcdd009f1a0 2023-09-30T22:27:59.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd7c64700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd01ab080 con 0x7fcdd009a150 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd5a00700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd01c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd6201700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 0x7fcdd01c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd5a00700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd01c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54596/0 (socket says 172.21.15.154:54596) 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd5a00700 1 -- 172.21.15.154:0/2688399924 learned_addr learned my addr 172.21.15.154:0/2688399924 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.193+0000 7fcdd51ff700 1 --2- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd009edb0 0x7fcdd01c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdd6201700 1 -- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 msgr2=0x7fcdd01c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdd6201700 1 --2- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd01c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdd6201700 1 -- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd009edb0 msgr2=0x7fcdd01c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdd6201700 1 --2- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd009edb0 0x7fcdd01c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdd6201700 1 -- 172.21.15.154:0/2688399924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0094a0 con 0x7fcdd009f1a0 2023-09-30T22:27:59.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdd6201700 1 --2- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 0x7fcdd01c4d30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009d90 tx=0x7fcdc800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdc67fc700 1 -- 172.21.15.154:0/2688399924 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8009c00 con 0x7fcdd009f1a0 2023-09-30T22:27:59.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdc67fc700 1 -- 172.21.15.154:0/2688399924 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc800f040 con 0x7fcdd009f1a0 2023-09-30T22:27:59.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdc67fc700 1 -- 172.21.15.154:0/2688399924 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8014480 con 0x7fcdd009f1a0 2023-09-30T22:27:59.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2688399924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd01ab9d0 con 0x7fcdd009f1a0 2023-09-30T22:27:59.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.194+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2688399924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd01a9dc0 con 0x7fcdd009f1a0 2023-09-30T22:27:59.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.195+0000 7fcdc67fc700 1 -- 172.21.15.154:0/2688399924 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdc80145e0 con 0x7fcdd009f1a0 2023-09-30T22:27:59.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.195+0000 7fcdc67fc700 1 -- 172.21.15.154:0/2688399924 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcdc80401d0 con 0x7fcdd009f1a0 2023-09-30T22:27:59.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.195+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2688399924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd009fa30 con 0x7fcdd009f1a0 2023-09-30T22:27:59.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:27:59.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.204+0000 7fcdc67fc700 1 -- 172.21.15.154:0/2688399924 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdc8007900 con 0x7fcdd009f1a0 2023-09-30T22:27:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.275+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/2173810106 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3b0122010 con 0x7fd3b009d860 2023-09-30T22:27:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.275+0000 7fd39effd700 1 -- 172.21.15.154:0/2173810106 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3b0122010 con 0x7fd3b009d860 2023-09-30T22:27:59.277 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.278+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009d860 msgr2=0x7fd3b011e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.278+0000 7fd3b4cb2700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009d860 0x7fd3b011e690 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400e9b0 tx=0x7fd3a400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.278+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/2173810106 shutdown_connections 2023-09-30T22:27:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.278+0000 7fd3b4cb2700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3b0130ce0 0x7fd3b011f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.278+0000 7fd3b4cb2700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3b009d860 0x7fd3b011e690 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.278+0000 7fd3b4cb2700 1 --2- 172.21.15.154:0/2173810106 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3b009e170 0x7fd3b011ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.278+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/2173810106 >> 172.21.15.154:0/2173810106 conn(0x7fd3b0099c40 msgr2=0x7fd3b00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.278+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/2173810106 shutdown_connections 2023-09-30T22:27:59.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.278+0000 7fd3b4cb2700 1 -- 172.21.15.154:0/2173810106 wait complete. 2023-09-30T22:27:59.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:27:59.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.325+0000 7f49f132b700 1 Processor -- start 2023-09-30T22:27:59.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.325+0000 7f49f132b700 1 -- start start 2023-09-30T22:27:59.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49f132b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49f132b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49f132b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec0a06a0 con 0x7f49ec09f260 2023-09-30T22:27:59.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49f132b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0a0150 con 0x7f49ec09e950 2023-09-30T22:27:59.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49f132b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec06b920 con 0x7f49ec139360 2023-09-30T22:27:59.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eaffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eaffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55950/0 (socket says 172.21.15.154:55950) 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54608/0 (socket says 172.21.15.154:54608) 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eaffd700 1 -- 172.21.15.154:0/80340112 learned_addr learned my addr 172.21.15.154:0/80340112 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eaffd700 1 -- 172.21.15.154:0/80340112 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 msgr2=0x7f49ec13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eaffd700 1 --2- 172.21.15.154:0/80340112 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eaffd700 1 -- 172.21.15.154:0/80340112 >> v1:172.21.15.154:6789/0 conn(0x7f49ec09f260 legacy=0x7f49ec137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eaffd700 1 -- 172.21.15.154:0/80340112 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec06d8e0 con 0x7f49ec09e950 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49e9ffb700 1 -- 172.21.15.154:0/80340112 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206103416 0 0) 0x7f49ec0a06a0 con 0x7f49ec09f260 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eb7fe700 1 --2- 172.21.15.154:0/80340112 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.326+0000 7f49eaffd700 1 --2- 172.21.15.154:0/80340112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec09ed20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f49e00098f0 tx=0x7f49e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74e5a9195016bc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49e9ffb700 1 -- 172.21.15.154:0/80340112 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0005e30 con 0x7f49ec09e950 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49e9ffb700 1 -- 172.21.15.154:0/80340112 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e0004030 con 0x7f49ec09e950 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49e9ffb700 1 -- 172.21.15.154:0/80340112 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e00043e0 con 0x7f49ec09e950 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49f132b700 1 -- 172.21.15.154:0/80340112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 msgr2=0x7f49ec09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49f132b700 1 --2- 172.21.15.154:0/80340112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec09ed20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f49e00098f0 tx=0x7f49e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49f132b700 1 -- 172.21.15.154:0/80340112 shutdown_connections 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49f132b700 1 --2- 172.21.15.154:0/80340112 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49f132b700 1 --2- 172.21.15.154:0/80340112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec09ed20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49f132b700 1 -- 172.21.15.154:0/80340112 >> 172.21.15.154:0/80340112 conn(0x7f49ec0a4470 msgr2=0x7f49ec0a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49f132b700 1 -- 172.21.15.154:0/80340112 shutdown_connections 2023-09-30T22:27:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.327+0000 7f49f132b700 1 -- 172.21.15.154:0/80340112 wait complete. 2023-09-30T22:27:59.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49f132b700 1 Processor -- start 2023-09-30T22:27:59.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49f132b700 1 -- start start 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49f132b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49f132b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49ec09f260 0x7f49ec11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49f132b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49f132b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec1342b0 con 0x7f49ec09f260 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49f132b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec121b30 con 0x7f49ec09e950 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49f132b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec134900 con 0x7f49ec139360 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49ea7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49ec09f260 0x7f49ec11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49eb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49eb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec11f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54616/0 (socket says 172.21.15.154:54616) 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49eb7fe700 1 -- 172.21.15.154:0/3033314558 learned_addr learned my addr 172.21.15.154:0/3033314558 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49ea7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49ec09f260 0x7f49ec11f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37132/0 (socket says 172.21.15.154:37132) 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.329+0000 7f49eaffd700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49eb7fe700 1 -- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 msgr2=0x7f49ec11ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49eb7fe700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec11ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49eb7fe700 1 -- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49ec09f260 msgr2=0x7f49ec11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49eb7fe700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49ec09f260 0x7f49ec11f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49eb7fe700 1 -- 172.21.15.154:0/3033314558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4009a70 con 0x7f49ec139360 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49eaffd700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49ea7fc700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49ec09f260 0x7f49ec11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49eb7fe700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec11f550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f49e400efc0 tx=0x7f49e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49d37fe700 1 -- 172.21.15.154:0/3033314558 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400cc90 con 0x7f49ec139360 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49d37fe700 1 -- 172.21.15.154:0/3033314558 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e400f040 con 0x7f49ec139360 2023-09-30T22:27:59.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49d37fe700 1 -- 172.21.15.154:0/3033314558 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4014480 con 0x7f49ec139360 2023-09-30T22:27:59.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49f132b700 1 -- 172.21.15.154:0/3033314558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e0009500 con 0x7f49ec139360 2023-09-30T22:27:59.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.330+0000 7f49f132b700 1 -- 172.21.15.154:0/3033314558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec06ccc0 con 0x7f49ec139360 2023-09-30T22:27:59.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.331+0000 7f49d37fe700 1 -- 172.21.15.154:0/3033314558 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49e40145e0 con 0x7f49ec139360 2023-09-30T22:27:59.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.331+0000 7f49d37fe700 1 -- 172.21.15.154:0/3033314558 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f49e403ff70 con 0x7f49ec139360 2023-09-30T22:27:59.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.331+0000 7f49f132b700 1 -- 172.21.15.154:0/3033314558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec121e10 con 0x7f49ec139360 2023-09-30T22:27:59.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.340+0000 7f49d37fe700 1 -- 172.21.15.154:0/3033314558 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49e4018070 con 0x7f49ec139360 2023-09-30T22:27:59.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:27:59.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.411+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2688399924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcdd01abbf0 con 0x7fcdd009f1a0 2023-09-30T22:27:59.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.411+0000 7fcdc67fc700 1 -- 172.21.15.154:0/2688399924 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdc802c090 con 0x7fcdd009f1a0 2023-09-30T22:27:59.413 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:27:59.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.414+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 msgr2=0x7fcdd01c4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.414+0000 7fcdd7c64700 1 --2- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 0x7fcdd01c4d30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009d90 tx=0x7fcdc800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.414+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2688399924 shutdown_connections 2023-09-30T22:27:59.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.414+0000 7fcdd7c64700 1 --2- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdd009f1a0 0x7fcdd01c4d30 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.414+0000 7fcdd7c64700 1 --2- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcdd009a150 0x7fcdd01c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.414+0000 7fcdd7c64700 1 --2- 172.21.15.154:0/2688399924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdd009edb0 0x7fcdd01c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.414+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2688399924 >> 172.21.15.154:0/2688399924 conn(0x7fcdd00a4430 msgr2=0x7fcdd009d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.414+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2688399924 shutdown_connections 2023-09-30T22:27:59.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.414+0000 7fcdd7c64700 1 -- 172.21.15.154:0/2688399924 wait complete. 2023-09-30T22:27:59.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:27:59.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.473+0000 7f567e3d0700 1 Processor -- start 2023-09-30T22:27:59.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.473+0000 7f567e3d0700 1 -- start start 2023-09-30T22:27:59.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.473+0000 7f567e3d0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f567809d860 0x7f567809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.473+0000 7f567e3d0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f567809e170 0x7f56781307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.473+0000 7f567e3d0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567809aaa0 con 0x7f5678130ce0 2023-09-30T22:27:59.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.473+0000 7f567e3d0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567809f870 con 0x7f567809e170 2023-09-30T22:27:59.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.473+0000 7f567e3d0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567809b360 con 0x7f567809d860 2023-09-30T22:27:59.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f56777fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f567809e170 0x7f56781307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5677fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f567809d860 0x7f567809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f56777fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f567809e170 0x7f56781307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37148/0 (socket says 172.21.15.154:37148) 2023-09-30T22:27:59.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5677fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f567809d860 0x7f567809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55964/0 (socket says 172.21.15.154:55964) 2023-09-30T22:27:59.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f56777fe700 1 -- 172.21.15.154:0/3974870266 learned_addr learned my addr 172.21.15.154:0/3974870266 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:59.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5677fff700 1 -- 172.21.15.154:0/3974870266 >> v2:172.21.15.154:3300/0 conn(0x7f567809e170 msgr2=0x7f56781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:27:59.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5677fff700 1 --2- 172.21.15.154:0/3974870266 >> v2:172.21.15.154:3300/0 conn(0x7f567809e170 0x7f56781307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5677fff700 1 -- 172.21.15.154:0/3974870266 >> v1:172.21.15.154:6789/0 conn(0x7f5678130ce0 legacy=0x7f56781379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5677fff700 1 -- 172.21.15.154:0/3974870266 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567809b620 con 0x7f567809d860 2023-09-30T22:27:59.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f56777fe700 1 --2- 172.21.15.154:0/3974870266 >> v2:172.21.15.154:3300/0 conn(0x7f567809e170 0x7f56781307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5677fff700 1 --2- 172.21.15.154:0/3974870266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f567809d860 0x7f567809dc30 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5668009840 tx=0x7f5668009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecca7da010d4f546 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5676ffd700 1 -- 172.21.15.154:0/3974870266 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668011830 con 0x7f567809d860 2023-09-30T22:27:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5676ffd700 1 -- 172.21.15.154:0/3974870266 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5668011990 con 0x7f567809d860 2023-09-30T22:27:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.474+0000 7f5676ffd700 1 -- 172.21.15.154:0/3974870266 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668011d20 con 0x7f567809d860 2023-09-30T22:27:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.475+0000 7f567e3d0700 1 -- 172.21.15.154:0/3974870266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f567809d860 msgr2=0x7f567809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.475+0000 7f567e3d0700 1 --2- 172.21.15.154:0/3974870266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f567809d860 0x7f567809dc30 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5668009840 tx=0x7f5668009b50 comp rx=0 tx=0).stop 2023-09-30T22:27:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.475+0000 7f567e3d0700 1 -- 172.21.15.154:0/3974870266 shutdown_connections 2023-09-30T22:27:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.475+0000 7f567e3d0700 1 --2- 172.21.15.154:0/3974870266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f567809d860 0x7f567809dc30 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.475+0000 7f567e3d0700 1 --2- 172.21.15.154:0/3974870266 >> v2:172.21.15.154:3300/0 conn(0x7f567809e170 0x7f56781307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.475+0000 7f567e3d0700 1 -- 172.21.15.154:0/3974870266 >> 172.21.15.154:0/3974870266 conn(0x7f5678099c40 msgr2=0x7f56780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.475+0000 7f567e3d0700 1 -- 172.21.15.154:0/3974870266 shutdown_connections 2023-09-30T22:27:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.475+0000 7f567e3d0700 1 -- 172.21.15.154:0/3974870266 wait complete. 2023-09-30T22:27:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.476+0000 7f567e3d0700 1 Processor -- start 2023-09-30T22:27:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.476+0000 7f567e3d0700 1 -- start start 2023-09-30T22:27:59.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.476+0000 7f567e3d0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f567809d860 0x7f567811e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.476+0000 7f567e3d0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567809e170 0x7f567811ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.476+0000 7f567e3d0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678130ce0 0x7f567811efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:27:59.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.476+0000 7f567e3d0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5678122070 con 0x7f567809e170 2023-09-30T22:27:59.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.476+0000 7f567e3d0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567809c8b0 con 0x7f5678130ce0 2023-09-30T22:27:59.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.476+0000 7f567e3d0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56781209c0 con 0x7f567809d860 2023-09-30T22:27:59.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.476+0000 7f5677fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f567809d860 0x7f567811e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f567c96d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678130ce0 0x7f567811efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5677fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f567809d860 0x7f567811e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54628/0 (socket says 172.21.15.154:54628) 2023-09-30T22:27:59.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5677fff700 1 -- 172.21.15.154:0/2103556553 learned_addr learned my addr 172.21.15.154:0/2103556553 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:27:59.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f56777fe700 1 --2- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567809e170 0x7f567811ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:27:59.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5677fff700 1 -- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678130ce0 msgr2=0x7f567811efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5677fff700 1 --2- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678130ce0 0x7f567811efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5677fff700 1 -- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567809e170 msgr2=0x7f567811ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5677fff700 1 --2- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567809e170 0x7f567811ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5677fff700 1 -- 172.21.15.154:0/2103556553 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c00b7f0 con 0x7f567809d860 2023-09-30T22:27:59.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f567c96d700 1 --2- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678130ce0 0x7f567811efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5677fff700 1 --2- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f567809d860 0x7f567811e550 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5668009fd0 tx=0x7f5668004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5674ff9700 1 -- 172.21.15.154:0/2103556553 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680036a0 con 0x7f567809d860 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5674ff9700 1 -- 172.21.15.154:0/2103556553 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566801f070 con 0x7f567809d860 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f567e3d0700 1 -- 172.21.15.154:0/2103556553 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56680094a0 con 0x7f567809d860 2023-09-30T22:27:59.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f5674ff9700 1 -- 172.21.15.154:0/2103556553 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668003a60 con 0x7f567809d860 2023-09-30T22:27:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.477+0000 7f567e3d0700 1 -- 172.21.15.154:0/2103556553 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5678072130 con 0x7f567809d860 2023-09-30T22:27:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.478+0000 7f5674ff9700 1 -- 172.21.15.154:0/2103556553 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5668003bc0 con 0x7f567809d860 2023-09-30T22:27:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.478+0000 7f5674ff9700 1 -- 172.21.15.154:0/2103556553 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5668021070 con 0x7f567809d860 2023-09-30T22:27:59.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.478+0000 7f567e3d0700 1 -- 172.21.15.154:0/2103556553 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567804f2a0 con 0x7f567809d860 2023-09-30T22:27:59.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.487+0000 7f5674ff9700 1 -- 172.21.15.154:0/2103556553 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f566801a430 con 0x7f567809d860 2023-09-30T22:27:59.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.540+0000 7f49f132b700 1 -- 172.21.15.154:0/3033314558 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f49ec04f2a0 con 0x7f49ec139360 2023-09-30T22:27:59.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.540+0000 7f49d37fe700 1 -- 172.21.15.154:0/3033314558 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49e4011680 con 0x7f49ec139360 2023-09-30T22:27:59.542 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.543+0000 7f49f132b700 1 -- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 msgr2=0x7f49ec11f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.543+0000 7f49f132b700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec11f550 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f49e400efc0 tx=0x7f49e400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.543+0000 7f49f132b700 1 -- 172.21.15.154:0/3033314558 shutdown_connections 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.543+0000 7f49f132b700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f49ec139360 0x7f49ec11f550 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.543+0000 7f49f132b700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49ec09e950 0x7f49ec11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.543+0000 7f49f132b700 1 --2- 172.21.15.154:0/3033314558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49ec09f260 0x7f49ec11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.543+0000 7f49f132b700 1 -- 172.21.15.154:0/3033314558 >> 172.21.15.154:0/3033314558 conn(0x7f49ec0a4470 msgr2=0x7f49ec09d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.543+0000 7f49f132b700 1 -- 172.21.15.154:0/3033314558 shutdown_connections 2023-09-30T22:27:59.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.543+0000 7f49f132b700 1 -- 172.21.15.154:0/3033314558 wait complete. 2023-09-30T22:27:59.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:27:59.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.676+0000 7f567e3d0700 1 -- 172.21.15.154:0/2103556553 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f567806c3b0 con 0x7f567809d860 2023-09-30T22:27:59.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.676+0000 7f5674ff9700 1 -- 172.21.15.154:0/2103556553 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56680193b0 con 0x7f567809d860 2023-09-30T22:27:59.678 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:27:59.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.678+0000 7f567e3d0700 1 -- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f567809d860 msgr2=0x7f567811e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:27:59.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.678+0000 7f567e3d0700 1 --2- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f567809d860 0x7f567811e550 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5668009fd0 tx=0x7f5668004750 comp rx=0 tx=0).stop 2023-09-30T22:27:59.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.678+0000 7f567e3d0700 1 -- 172.21.15.154:0/2103556553 shutdown_connections 2023-09-30T22:27:59.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.678+0000 7f567e3d0700 1 --2- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5678130ce0 0x7f567811efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.678+0000 7f567e3d0700 1 --2- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f567809d860 0x7f567811e550 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.678+0000 7f567e3d0700 1 --2- 172.21.15.154:0/2103556553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567809e170 0x7f567811ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:27:59.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.678+0000 7f567e3d0700 1 -- 172.21.15.154:0/2103556553 >> 172.21.15.154:0/2103556553 conn(0x7f5678099c40 msgr2=0x7f5678070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:27:59.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.678+0000 7f567e3d0700 1 -- 172.21.15.154:0/2103556553 shutdown_connections 2023-09-30T22:27:59.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:27:59.678+0000 7f567e3d0700 1 -- 172.21.15.154:0/2103556553 wait complete. 2023-09-30T22:27:59.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:00.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:00.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.423+0000 7f4c9d07a700 1 Processor -- start 2023-09-30T22:28:00.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.423+0000 7f4c9d07a700 1 -- start start 2023-09-30T22:28:00.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9d07a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c9809e340 0x7f4c981359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9d07a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c98135f20 0x7f4c98138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9d07a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9809aaa0 con 0x7f4c9809d860 2023-09-30T22:28:00.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9d07a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9809e730 con 0x7f4c9809e340 2023-09-30T22:28:00.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9d07a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9809f870 con 0x7f4c98135f20 2023-09-30T22:28:00.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c96d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4c9809d860 0x7f4c9809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35866/0 (socket says 172.21.15.154:35866) 2023-09-30T22:28:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c96d9d700 1 -- 172.21.15.154:0/2764194143 learned_addr learned my addr 172.21.15.154:0/2764194143 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9659c700 1 --2- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c9809e340 0x7f4c981359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9759e700 1 --2- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c98135f20 0x7f4c98138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c95d9b700 1 -- 172.21.15.154:0/2764194143 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014357132 0 0) 0x7f4c9809aaa0 con 0x7f4c9809d860 2023-09-30T22:28:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9759e700 1 -- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c9809e340 msgr2=0x7f4c981359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9759e700 1 --2- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c9809e340 0x7f4c981359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9759e700 1 -- 172.21.15.154:0/2764194143 >> v1:172.21.15.154:6789/0 conn(0x7f4c9809d860 legacy=0x7f4c9809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9759e700 1 -- 172.21.15.154:0/2764194143 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9809b360 con 0x7f4c98135f20 2023-09-30T22:28:00.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9659c700 1 --2- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c9809e340 0x7f4c981359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c9759e700 1 --2- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c98135f20 0x7f4c98138300 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009df0 tx=0x7f4c9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66c15147a07ac6d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c95d9b700 1 -- 172.21.15.154:0/2764194143 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000e070 con 0x7f4c98135f20 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c95d9b700 1 -- 172.21.15.154:0/2764194143 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000bae0 con 0x7f4c98135f20 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.424+0000 7f4c95d9b700 1 -- 172.21.15.154:0/2764194143 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000be90 con 0x7f4c98135f20 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.425+0000 7f4c9d07a700 1 -- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c98135f20 msgr2=0x7f4c98138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.425+0000 7f4c9d07a700 1 --2- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c98135f20 0x7f4c98138300 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009df0 tx=0x7f4c9000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.425+0000 7f4c9d07a700 1 -- 172.21.15.154:0/2764194143 shutdown_connections 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.425+0000 7f4c9d07a700 1 --2- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c98135f20 0x7f4c98138300 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.425+0000 7f4c9d07a700 1 --2- 172.21.15.154:0/2764194143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c9809e340 0x7f4c981359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.425+0000 7f4c9d07a700 1 -- 172.21.15.154:0/2764194143 >> 172.21.15.154:0/2764194143 conn(0x7f4c98099c40 msgr2=0x7f4c980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.425+0000 7f4c9d07a700 1 -- 172.21.15.154:0/2764194143 shutdown_connections 2023-09-30T22:28:00.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.425+0000 7f4c9d07a700 1 -- 172.21.15.154:0/2764194143 wait complete. 2023-09-30T22:28:00.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:00.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.426+0000 7f4c9d07a700 1 Processor -- start 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.426+0000 7f4c9d07a700 1 -- start start 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9d07a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c9809d860 0x7f4c9811d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9d07a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c9809e340 0x7f4c9811d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9d07a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c98135f20 0x7f4c9811de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9d07a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9811e830 con 0x7f4c9809e340 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9d07a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c980a07d0 con 0x7f4c98135f20 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9d07a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9811f0a0 con 0x7f4c9809d860 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c96d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c9809d860 0x7f4c9811d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c9809e340 0x7f4c9811d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c9809e340 0x7f4c9811d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37174/0 (socket says 172.21.15.154:37174) 2023-09-30T22:28:00.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c96d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c9809d860 0x7f4c9811d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54632/0 (socket says 172.21.15.154:54632) 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9659c700 1 -- 172.21.15.154:0/4169239851 learned_addr learned my addr 172.21.15.154:0/4169239851 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9759e700 1 --2- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c98135f20 0x7f4c9811de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9659c700 1 -- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c9809d860 msgr2=0x7f4c9811d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9659c700 1 --2- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c9809d860 0x7f4c9811d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9659c700 1 -- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c98135f20 msgr2=0x7f4c9811de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9659c700 1 --2- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c98135f20 0x7f4c9811de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9659c700 1 -- 172.21.15.154:0/4169239851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c880094a0 con 0x7f4c9809e340 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9759e700 1 --2- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c98135f20 0x7f4c9811de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9659c700 1 --2- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c9809e340 0x7f4c9811d910 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800ec10 tx=0x7f4c8800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c7f7fe700 1 -- 172.21.15.154:0/4169239851 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8800c850 con 0x7f4c9809e340 2023-09-30T22:28:00.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c7f7fe700 1 -- 172.21.15.154:0/4169239851 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8800c9b0 con 0x7f4c9809e340 2023-09-30T22:28:00.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9d07a700 1 -- 172.21.15.154:0/4169239851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c90009a70 con 0x7f4c9809e340 2023-09-30T22:28:00.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c7f7fe700 1 -- 172.21.15.154:0/4169239851 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8800cd20 con 0x7f4c9809e340 2023-09-30T22:28:00.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.427+0000 7f4c9d07a700 1 -- 172.21.15.154:0/4169239851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9811f750 con 0x7f4c9809e340 2023-09-30T22:28:00.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.428+0000 7f4c7f7fe700 1 -- 172.21.15.154:0/4169239851 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c88013470 con 0x7f4c9809e340 2023-09-30T22:28:00.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.428+0000 7f4c7f7fe700 1 -- 172.21.15.154:0/4169239851 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4c8803f780 con 0x7f4c9809e340 2023-09-30T22:28:00.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.428+0000 7f4c9d07a700 1 -- 172.21.15.154:0/4169239851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9804f2a0 con 0x7f4c9809e340 2023-09-30T22:28:00.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.433+0000 7f4c7f7fe700 1 -- 172.21.15.154:0/4169239851 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c88013720 con 0x7f4c9809e340 2023-09-30T22:28:00.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:00.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.556+0000 7fa697b12700 1 Processor -- start 2023-09-30T22:28:00.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.556+0000 7fa697b12700 1 -- start start 2023-09-30T22:28:00.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa697b12700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6900a0a70 0x7fa6900a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa697b12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a1380 0x7fa690133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa697b12700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa690133f50 0x7fa6901343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa697b12700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69009e9d0 con 0x7fa690133f50 2023-09-30T22:28:00.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa697b12700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69009dc00 con 0x7fa6900a0a70 2023-09-30T22:28:00.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa697b12700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa69009dec0 con 0x7fa6900a1380 2023-09-30T22:28:00.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa6958ae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6900a0a70 0x7fa6900a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa6960af700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa690133f50 0x7fa6901343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa6950ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a1380 0x7fa690133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa6958ae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6900a0a70 0x7fa6900a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55994/0 (socket says 172.21.15.154:55994) 2023-09-30T22:28:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.557+0000 7fa6958ae700 1 -- 172.21.15.154:0/3881445668 learned_addr learned my addr 172.21.15.154:0/3881445668 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6960af700 1 -- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a1380 msgr2=0x7fa690133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6960af700 1 --2- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a1380 0x7fa690133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6960af700 1 -- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6900a0a70 msgr2=0x7fa6900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6960af700 1 --2- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6900a0a70 0x7fa6900a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6960af700 1 -- 172.21.15.154:0/3881445668 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69009e6a0 con 0x7fa690133f50 2023-09-30T22:28:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6950ad700 1 --2- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a1380 0x7fa690133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6958ae700 1 --2- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6900a0a70 0x7fa6900a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6960af700 1 --2- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690133f50 0x7fa6901343f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fa688009d90 tx=0x7fa68800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c403430d5444624e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6948ac700 1 -- 172.21.15.154:0/3881445668 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68800e070 con 0x7fa690133f50 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6948ac700 1 -- 172.21.15.154:0/3881445668 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68800bb20 con 0x7fa690133f50 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.558+0000 7fa6948ac700 1 -- 172.21.15.154:0/3881445668 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa688012430 con 0x7fa690133f50 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.559+0000 7fa697b12700 1 -- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690133f50 msgr2=0x7fa6901343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.559+0000 7fa697b12700 1 --2- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690133f50 0x7fa6901343f0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fa688009d90 tx=0x7fa68800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.559+0000 7fa697b12700 1 -- 172.21.15.154:0/3881445668 shutdown_connections 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.559+0000 7fa697b12700 1 --2- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6900a0a70 0x7fa6900a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.559+0000 7fa697b12700 1 --2- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa690133f50 0x7fa6901343f0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.559+0000 7fa697b12700 1 --2- 172.21.15.154:0/3881445668 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a1380 0x7fa690133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.559+0000 7fa697b12700 1 -- 172.21.15.154:0/3881445668 >> 172.21.15.154:0/3881445668 conn(0x7fa6900a6610 msgr2=0x7fa6900a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.559+0000 7fa697b12700 1 -- 172.21.15.154:0/3881445668 shutdown_connections 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.559+0000 7fa697b12700 1 -- 172.21.15.154:0/3881445668 wait complete. 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.560+0000 7fa697b12700 1 Processor -- start 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.560+0000 7fa697b12700 1 -- start start 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.560+0000 7fa697b12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a0a70 0x7fa69011f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa697b12700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6900a1380 0x7fa69011f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa697b12700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa690133f50 0x7fa69011fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa697b12700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa690122df0 con 0x7fa6900a1380 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa697b12700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6901228e0 con 0x7fa690133f50 2023-09-30T22:28:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa697b12700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa690121d80 con 0x7fa6900a0a70 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6958ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a0a70 0x7fa69011f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6958ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a0a70 0x7fa69011f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54648/0 (socket says 172.21.15.154:54648) 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6960af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa690133f50 0x7fa69011fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6958ae700 1 -- 172.21.15.154:0/3235857135 learned_addr learned my addr 172.21.15.154:0/3235857135 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6950ad700 1 --2- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6900a1380 0x7fa69011f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6950ad700 1 -- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a0a70 msgr2=0x7fa69011f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6950ad700 1 --2- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a0a70 0x7fa69011f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6950ad700 1 -- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa690133f50 msgr2=0x7fa69011fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6950ad700 1 --2- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa690133f50 0x7fa69011fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6950ad700 1 -- 172.21.15.154:0/3235857135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c009550 con 0x7fa6900a1380 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6958ae700 1 --2- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a0a70 0x7fa69011f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6950ad700 1 --2- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6900a1380 0x7fa69011f810 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fa68000e9b0 tx=0x7fa68000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6867fc700 1 -- 172.21.15.154:0/3235857135 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000ee50 con 0x7fa6900a1380 2023-09-30T22:28:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa6867fc700 1 -- 172.21.15.154:0/3235857135 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68000c7f0 con 0x7fa6900a1380 2023-09-30T22:28:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.561+0000 7fa697b12700 1 -- 172.21.15.154:0/3235857135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6800094a0 con 0x7fa6900a1380 2023-09-30T22:28:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.562+0000 7fa6867fc700 1 -- 172.21.15.154:0/3235857135 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000cb80 con 0x7fa6900a1380 2023-09-30T22:28:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.562+0000 7fa697b12700 1 -- 172.21.15.154:0/3235857135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa688009a70 con 0x7fa6900a1380 2023-09-30T22:28:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.562+0000 7fa6867fc700 1 -- 172.21.15.154:0/3235857135 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa68000cce0 con 0x7fa6900a1380 2023-09-30T22:28:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.562+0000 7fa6867fc700 1 -- 172.21.15.154:0/3235857135 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa68003f720 con 0x7fa6900a1380 2023-09-30T22:28:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.563+0000 7fa697b12700 1 -- 172.21.15.154:0/3235857135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69004f2a0 con 0x7fa6900a1380 2023-09-30T22:28:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.568+0000 7fa6867fc700 1 -- 172.21.15.154:0/3235857135 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6800232f0 con 0x7fa6900a1380 2023-09-30T22:28:00.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.631+0000 7f4c9d07a700 1 -- 172.21.15.154:0/4169239851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c98121690 con 0x7f4c9809e340 2023-09-30T22:28:00.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.632+0000 7f4c7f7fe700 1 -- 172.21.15.154:0/4169239851 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c88021020 con 0x7f4c9809e340 2023-09-30T22:28:00.633 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:00.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.634+0000 7f4c9d07a700 1 -- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c9809e340 msgr2=0x7f4c9811d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.634+0000 7f4c9d07a700 1 --2- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c9809e340 0x7f4c9811d910 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800ec10 tx=0x7f4c8800ef20 comp rx=0 tx=0).stop 2023-09-30T22:28:00.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.634+0000 7f4c9d07a700 1 -- 172.21.15.154:0/4169239851 shutdown_connections 2023-09-30T22:28:00.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.634+0000 7f4c9d07a700 1 --2- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c98135f20 0x7f4c9811de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.634+0000 7f4c9d07a700 1 --2- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4c9809d860 0x7f4c9811d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.634+0000 7f4c9d07a700 1 --2- 172.21.15.154:0/4169239851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c9809e340 0x7f4c9811d910 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.634+0000 7f4c9d07a700 1 -- 172.21.15.154:0/4169239851 >> 172.21.15.154:0/4169239851 conn(0x7f4c98099c40 msgr2=0x7f4c98134950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.634+0000 7f4c9d07a700 1 -- 172.21.15.154:0/4169239851 shutdown_connections 2023-09-30T22:28:00.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.634+0000 7f4c9d07a700 1 -- 172.21.15.154:0/4169239851 wait complete. 2023-09-30T22:28:00.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.682+0000 7ff950a54700 1 Processor -- start 2023-09-30T22:28:00.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.682+0000 7ff950a54700 1 -- start start 2023-09-30T22:28:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff950a54700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff950a54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c130bc0 0x7ff94c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff950a54700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c06b2d0 con 0x7ff94c1300a0 2023-09-30T22:28:00.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff950a54700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c133610 con 0x7ff94c130bc0 2023-09-30T22:28:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff950a54700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09a500 con 0x7ff94c133ad0 2023-09-30T22:28:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff949d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff94c1300a0 0x7ff94c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35872/0 (socket says 172.21.15.154:35872) 2023-09-30T22:28:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff949d9b700 1 -- 172.21.15.154:0/4279499923 learned_addr learned my addr 172.21.15.154:0/4279499923 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff94ad9d700 1 --2- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c130bc0 0x7ff94c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff94a59c700 1 --2- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.683+0000 7ff94959a700 1 -- 172.21.15.154:0/4279499923 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941502608 0 0) 0x7ff94c06b2d0 con 0x7ff94c1300a0 2023-09-30T22:28:00.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94959a700 1 -- 172.21.15.154:0/4279499923 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9340035b0 con 0x7ff94c1300a0 2023-09-30T22:28:00.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94ad9d700 1 -- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 msgr2=0x7ff94c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94ad9d700 1 --2- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94ad9d700 1 -- 172.21.15.154:0/4279499923 >> v1:172.21.15.154:6789/0 conn(0x7ff94c1300a0 legacy=0x7ff94c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94ad9d700 1 -- 172.21.15.154:0/4279499923 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c1338b0 con 0x7ff94c130bc0 2023-09-30T22:28:00.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94a59c700 1 --2- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94ad9d700 1 --2- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c130bc0 0x7ff94c13b990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff944009dc0 tx=0x7ff94400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ab4eb6dccc6bb70 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94959a700 1 -- 172.21.15.154:0/4279499923 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400e070 con 0x7ff94c130bc0 2023-09-30T22:28:00.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94959a700 1 -- 172.21.15.154:0/4279499923 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400bae0 con 0x7ff94c130bc0 2023-09-30T22:28:00.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff94959a700 1 -- 172.21.15.154:0/4279499923 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400be90 con 0x7ff94c130bc0 2023-09-30T22:28:00.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff950a54700 1 -- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c130bc0 msgr2=0x7ff94c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff950a54700 1 --2- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c130bc0 0x7ff94c13b990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff944009dc0 tx=0x7ff94400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:00.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff950a54700 1 -- 172.21.15.154:0/4279499923 shutdown_connections 2023-09-30T22:28:00.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff950a54700 1 --2- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c130bc0 0x7ff94c13b990 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff950a54700 1 --2- 172.21.15.154:0/4279499923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff950a54700 1 -- 172.21.15.154:0/4279499923 >> 172.21.15.154:0/4279499923 conn(0x7ff94c099c40 msgr2=0x7ff94c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.684+0000 7ff950a54700 1 -- 172.21.15.154:0/4279499923 shutdown_connections 2023-09-30T22:28:00.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.685+0000 7ff950a54700 1 -- 172.21.15.154:0/4279499923 wait complete. 2023-09-30T22:28:00.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff950a54700 1 Processor -- start 2023-09-30T22:28:00.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff950a54700 1 -- start start 2023-09-30T22:28:00.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff950a54700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c1300a0 0x7ff94c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff950a54700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94c130bc0 0x7ff94c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff950a54700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff950a54700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c12da10 con 0x7ff94c130bc0 2023-09-30T22:28:00.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff950a54700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c120a30 con 0x7ff94c1300a0 2023-09-30T22:28:00.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff950a54700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c12f7c0 con 0x7ff94c133ad0 2023-09-30T22:28:00.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff949d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94c130bc0 0x7ff94c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff94ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff949d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94c130bc0 0x7ff94c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37216/0 (socket says 172.21.15.154:37216) 2023-09-30T22:28:00.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff949d9b700 1 -- 172.21.15.154:0/1756545104 learned_addr learned my addr 172.21.15.154:0/1756545104 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:00.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff94a59c700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c1300a0 0x7ff94c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff94a59c700 1 -- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 msgr2=0x7ff94c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff94a59c700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff94a59c700 1 -- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94c130bc0 msgr2=0x7ff94c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff94a59c700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94c130bc0 0x7ff94c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff94a59c700 1 -- 172.21.15.154:0/1756545104 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400094a0 con 0x7ff94c1300a0 2023-09-30T22:28:00.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff94ad9d700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.686+0000 7ff949d9b700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94c130bc0 0x7ff94c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.687+0000 7ff94a59c700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c1300a0 0x7ff94c11da40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9b0 tx=0x7ff94000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.687+0000 7ff93affd700 1 -- 172.21.15.154:0/1756545104 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000ee50 con 0x7ff94c1300a0 2023-09-30T22:28:00.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.687+0000 7ff93affd700 1 -- 172.21.15.154:0/1756545104 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000c850 con 0x7ff94c1300a0 2023-09-30T22:28:00.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.687+0000 7ff950a54700 1 -- 172.21.15.154:0/1756545104 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff944009a70 con 0x7ff94c1300a0 2023-09-30T22:28:00.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.687+0000 7ff93affd700 1 -- 172.21.15.154:0/1756545104 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000cc00 con 0x7ff94c1300a0 2023-09-30T22:28:00.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.687+0000 7ff950a54700 1 -- 172.21.15.154:0/1756545104 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c12dd50 con 0x7ff94c1300a0 2023-09-30T22:28:00.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.687+0000 7ff93affd700 1 -- 172.21.15.154:0/1756545104 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff940013470 con 0x7ff94c1300a0 2023-09-30T22:28:00.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.688+0000 7ff93affd700 1 -- 172.21.15.154:0/1756545104 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff94003f6e0 con 0x7ff94c1300a0 2023-09-30T22:28:00.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.688+0000 7ff950a54700 1 -- 172.21.15.154:0/1756545104 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c04f2a0 con 0x7ff94c1300a0 2023-09-30T22:28:00.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:00.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.692+0000 7ff93affd700 1 -- 172.21.15.154:0/1756545104 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff940021020 con 0x7ff94c1300a0 2023-09-30T22:28:00.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.770+0000 7fa697b12700 1 -- 172.21.15.154:0/3235857135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa690120ee0 con 0x7fa6900a1380 2023-09-30T22:28:00.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.771+0000 7fa6867fc700 1 -- 172.21.15.154:0/3235857135 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa68002a090 con 0x7fa6900a1380 2023-09-30T22:28:00.772 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:00.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.773+0000 7fa697b12700 1 -- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6900a1380 msgr2=0x7fa69011f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.773+0000 7fa697b12700 1 --2- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6900a1380 0x7fa69011f810 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fa68000e9b0 tx=0x7fa68000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.773+0000 7fa697b12700 1 -- 172.21.15.154:0/3235857135 shutdown_connections 2023-09-30T22:28:00.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.773+0000 7fa697b12700 1 --2- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa690133f50 0x7fa69011fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.773+0000 7fa697b12700 1 --2- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa6900a0a70 0x7fa69011f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.773+0000 7fa697b12700 1 --2- 172.21.15.154:0/3235857135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6900a1380 0x7fa69011f810 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.773+0000 7fa697b12700 1 -- 172.21.15.154:0/3235857135 >> 172.21.15.154:0/3235857135 conn(0x7fa6900a6610 msgr2=0x7fa69009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.773+0000 7fa697b12700 1 -- 172.21.15.154:0/3235857135 shutdown_connections 2023-09-30T22:28:00.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.773+0000 7fa697b12700 1 -- 172.21.15.154:0/3235857135 wait complete. 2023-09-30T22:28:00.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.826+0000 7f708be6a700 1 Processor -- start 2023-09-30T22:28:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.826+0000 7f708be6a700 1 -- start start 2023-09-30T22:28:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.826+0000 7f708be6a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70840a0a70 0x7f70840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.826+0000 7f708be6a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70840a1380 0x7f7084133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.826+0000 7f708be6a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708409dc00 con 0x7f7084133f50 2023-09-30T22:28:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.826+0000 7f708be6a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708409ea60 con 0x7f70840a0a70 2023-09-30T22:28:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.826+0000 7f708be6a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708409dec0 con 0x7f70840a1380 2023-09-30T22:28:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089c06700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70840a0a70 0x7f70840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089405700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70840a1380 0x7f7084133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089c06700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70840a0a70 0x7f70840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37220/0 (socket says 172.21.15.154:37220) 2023-09-30T22:28:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f708a407700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7084133f50 0x7f708413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35886/0 (socket says 172.21.15.154:35886) 2023-09-30T22:28:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089405700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70840a1380 0x7f7084133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56020/0 (socket says 172.21.15.154:56020) 2023-09-30T22:28:00.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089c06700 1 -- 172.21.15.154:0/2591909828 learned_addr learned my addr 172.21.15.154:0/2591909828 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089c06700 1 -- 172.21.15.154:0/2591909828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70840a1380 msgr2=0x7f7084133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089c06700 1 --2- 172.21.15.154:0/2591909828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70840a1380 0x7f7084133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089c06700 1 -- 172.21.15.154:0/2591909828 >> v1:172.21.15.154:6789/0 conn(0x7f7084133f50 legacy=0x7f708413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089c06700 1 -- 172.21.15.154:0/2591909828 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708409e6a0 con 0x7f70840a0a70 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089405700 1 --2- 172.21.15.154:0/2591909828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70840a1380 0x7f7084133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7089c06700 1 --2- 172.21.15.154:0/2591909828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 0x7f70840a0e40 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f70800098f0 tx=0x7f7080009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38839419aad2dac9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7088c04700 1 -- 172.21.15.154:0/2591909828 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080011830 con 0x7f70840a0a70 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7088c04700 1 -- 172.21.15.154:0/2591909828 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7080011990 con 0x7f70840a0a70 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.827+0000 7f7088c04700 1 -- 172.21.15.154:0/2591909828 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080011d20 con 0x7f70840a0a70 2023-09-30T22:28:00.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.828+0000 7f708be6a700 1 -- 172.21.15.154:0/2591909828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 msgr2=0x7f70840a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.828+0000 7f708be6a700 1 --2- 172.21.15.154:0/2591909828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 0x7f70840a0e40 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f70800098f0 tx=0x7f7080009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:00.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.828+0000 7f708be6a700 1 -- 172.21.15.154:0/2591909828 shutdown_connections 2023-09-30T22:28:00.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.828+0000 7f708be6a700 1 --2- 172.21.15.154:0/2591909828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 0x7f70840a0e40 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.828+0000 7f708be6a700 1 --2- 172.21.15.154:0/2591909828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70840a1380 0x7f7084133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.828+0000 7f708be6a700 1 -- 172.21.15.154:0/2591909828 >> 172.21.15.154:0/2591909828 conn(0x7f70840a6610 msgr2=0x7f70840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.828+0000 7f708be6a700 1 -- 172.21.15.154:0/2591909828 shutdown_connections 2023-09-30T22:28:00.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.828+0000 7f708be6a700 1 -- 172.21.15.154:0/2591909828 wait complete. 2023-09-30T22:28:00.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f708be6a700 1 Processor -- start 2023-09-30T22:28:00.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f708be6a700 1 -- start start 2023-09-30T22:28:00.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f708be6a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 0x7f708411e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f708be6a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70840a1380 0x7f708411ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f708be6a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7084133f50 0x7f708411f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:00.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f708be6a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7084133740 con 0x7f70840a0a70 2023-09-30T22:28:00.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f708be6a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70841222d0 con 0x7f7084133f50 2023-09-30T22:28:00.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f708be6a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70840a03e0 con 0x7f70840a1380 2023-09-30T22:28:00.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f7089c06700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 0x7f708411e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f708a407700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7084133f50 0x7f708411f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f7089c06700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 0x7f708411e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37230/0 (socket says 172.21.15.154:37230) 2023-09-30T22:28:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f7089c06700 1 -- 172.21.15.154:0/852928761 learned_addr learned my addr 172.21.15.154:0/852928761 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.829+0000 7f7089405700 1 --2- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70840a1380 0x7f708411ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f708a407700 1 -- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70840a1380 msgr2=0x7f708411ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f708a407700 1 --2- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70840a1380 0x7f708411ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f708a407700 1 -- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 msgr2=0x7f708411e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f708a407700 1 --2- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 0x7f708411e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f708a407700 1 -- 172.21.15.154:0/852928761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70740094a0 con 0x7f7084133f50 2023-09-30T22:28:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f7089c06700 1 --2- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 0x7f708411e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f708a407700 1 --2- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7084133f50 0x7f708411f280 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f707c00cb10 tx=0x7f707c00ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:00.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f707a7fc700 1 -- 172.21.15.154:0/852928761 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c00a9e0 con 0x7f7084133f50 2023-09-30T22:28:00.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f707a7fc700 1 -- 172.21.15.154:0/852928761 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c00ab40 con 0x7f7084133f50 2023-09-30T22:28:00.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f708be6a700 1 -- 172.21.15.154:0/852928761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7080009550 con 0x7f7084133f50 2023-09-30T22:28:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f707a7fc700 1 -- 172.21.15.154:0/852928761 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c007070 con 0x7f7084133f50 2023-09-30T22:28:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.830+0000 7f708be6a700 1 -- 172.21.15.154:0/852928761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7084120b70 con 0x7f7084133f50 2023-09-30T22:28:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.831+0000 7f707a7fc700 1 -- 172.21.15.154:0/852928761 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f707c0071d0 con 0x7f7084133f50 2023-09-30T22:28:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.831+0000 7f707a7fc700 1 -- 172.21.15.154:0/852928761 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f707c03f2b0 con 0x7f7084133f50 2023-09-30T22:28:00.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.831+0000 7f708be6a700 1 -- 172.21.15.154:0/852928761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708404f2a0 con 0x7f7084133f50 2023-09-30T22:28:00.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.836+0000 7f707a7fc700 1 -- 172.21.15.154:0/852928761 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f707c01b3b0 con 0x7f7084133f50 2023-09-30T22:28:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.890+0000 7ff950a54700 1 -- 172.21.15.154:0/1756545104 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff94c06c3b0 con 0x7ff94c1300a0 2023-09-30T22:28:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.890+0000 7ff93affd700 1 -- 172.21.15.154:0/1756545104 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff940013720 con 0x7ff94c1300a0 2023-09-30T22:28:00.891 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:00.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.893+0000 7ff950a54700 1 -- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c1300a0 msgr2=0x7ff94c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:00.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.893+0000 7ff950a54700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c1300a0 0x7ff94c11da40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9b0 tx=0x7ff94000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.893+0000 7ff950a54700 1 -- 172.21.15.154:0/1756545104 shutdown_connections 2023-09-30T22:28:00.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.893+0000 7ff950a54700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff94c133ad0 0x7ff94c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.893+0000 7ff950a54700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94c1300a0 0x7ff94c11da40 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.893+0000 7ff950a54700 1 --2- 172.21.15.154:0/1756545104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94c130bc0 0x7ff94c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:00.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.893+0000 7ff950a54700 1 -- 172.21.15.154:0/1756545104 >> 172.21.15.154:0/1756545104 conn(0x7ff94c099c40 msgr2=0x7ff94c09e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:00.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.893+0000 7ff950a54700 1 -- 172.21.15.154:0/1756545104 shutdown_connections 2023-09-30T22:28:00.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:00.893+0000 7ff950a54700 1 -- 172.21.15.154:0/1756545104 wait complete. 2023-09-30T22:28:00.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:01.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.035+0000 7f708be6a700 1 -- 172.21.15.154:0/852928761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7084072980 con 0x7f7084133f50 2023-09-30T22:28:01.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.035+0000 7f707a7fc700 1 -- 172.21.15.154:0/852928761 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f707c017020 con 0x7f7084133f50 2023-09-30T22:28:01.037 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:01.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.037+0000 7f708be6a700 1 -- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7084133f50 msgr2=0x7f708411f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.037+0000 7f708be6a700 1 --2- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7084133f50 0x7f708411f280 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f707c00cb10 tx=0x7f707c00ce20 comp rx=0 tx=0).stop 2023-09-30T22:28:01.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.037+0000 7f708be6a700 1 -- 172.21.15.154:0/852928761 shutdown_connections 2023-09-30T22:28:01.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.037+0000 7f708be6a700 1 --2- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7084133f50 0x7f708411f280 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.037+0000 7f708be6a700 1 --2- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70840a0a70 0x7f708411e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.037+0000 7f708be6a700 1 --2- 172.21.15.154:0/852928761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f70840a1380 0x7f708411ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.037+0000 7f708be6a700 1 -- 172.21.15.154:0/852928761 >> 172.21.15.154:0/852928761 conn(0x7f70840a6610 msgr2=0x7f70840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:01.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.037+0000 7f708be6a700 1 -- 172.21.15.154:0/852928761 shutdown_connections 2023-09-30T22:28:01.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.037+0000 7f708be6a700 1 -- 172.21.15.154:0/852928761 wait complete. 2023-09-30T22:28:01.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:01.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:01.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.775+0000 7fcb078a8700 1 Processor -- start 2023-09-30T22:28:01.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.775+0000 7fcb078a8700 1 -- start start 2023-09-30T22:28:01.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.775+0000 7fcb078a8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb00133ad0 0x7fcb00133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb078a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb078a8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0006b2d0 con 0x7fcb001300a0 2023-09-30T22:28:01.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb078a8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb00133610 con 0x7fcb00133ad0 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb078a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0009a500 con 0x7fcb00130bc0 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05644700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb00133ad0 0x7fcb00133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05e45700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05644700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb00133ad0 0x7fcb00133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37244/0 (socket says 172.21.15.154:37244) 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05e45700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56038/0 (socket says 172.21.15.154:56038) 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05644700 1 -- 172.21.15.154:0/4077163401 learned_addr learned my addr 172.21.15.154:0/4077163401 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05e45700 1 -- 172.21.15.154:0/4077163401 >> v2:172.21.15.154:3300/0 conn(0x7fcb00133ad0 msgr2=0x7fcb00133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05e45700 1 --2- 172.21.15.154:0/4077163401 >> v2:172.21.15.154:3300/0 conn(0x7fcb00133ad0 0x7fcb00133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05e45700 1 -- 172.21.15.154:0/4077163401 >> v1:172.21.15.154:6789/0 conn(0x7fcb001300a0 legacy=0x7fcb001304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05e45700 1 -- 172.21.15.154:0/4077163401 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb001338b0 con 0x7fcb00130bc0 2023-09-30T22:28:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05644700 1 --2- 172.21.15.154:0/4077163401 >> v2:172.21.15.154:3300/0 conn(0x7fcb00133ad0 0x7fcb00133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcb05e45700 1 --2- 172.21.15.154:0/4077163401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0013b990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009d90 tx=0x7fcaf800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff9571d1da753501 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcaf7fff700 1 -- 172.21.15.154:0/4077163401 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800e070 con 0x7fcb00130bc0 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcaf7fff700 1 -- 172.21.15.154:0/4077163401 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf800bb20 con 0x7fcb00130bc0 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.776+0000 7fcaf7fff700 1 -- 172.21.15.154:0/4077163401 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8012430 con 0x7fcb00130bc0 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.777+0000 7fcb078a8700 1 -- 172.21.15.154:0/4077163401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 msgr2=0x7fcb0013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.777+0000 7fcb078a8700 1 --2- 172.21.15.154:0/4077163401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0013b990 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009d90 tx=0x7fcaf800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.777+0000 7fcb078a8700 1 -- 172.21.15.154:0/4077163401 shutdown_connections 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.777+0000 7fcb078a8700 1 --2- 172.21.15.154:0/4077163401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0013b990 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.777+0000 7fcb078a8700 1 --2- 172.21.15.154:0/4077163401 >> v2:172.21.15.154:3300/0 conn(0x7fcb00133ad0 0x7fcb00133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.777+0000 7fcb078a8700 1 -- 172.21.15.154:0/4077163401 >> 172.21.15.154:0/4077163401 conn(0x7fcb00099c40 msgr2=0x7fcb000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.777+0000 7fcb078a8700 1 -- 172.21.15.154:0/4077163401 shutdown_connections 2023-09-30T22:28:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.777+0000 7fcb078a8700 1 -- 172.21.15.154:0/4077163401 wait complete. 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.778+0000 7fcb078a8700 1 Processor -- start 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.778+0000 7fcb078a8700 1 -- start start 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb078a8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb001300a0 0x7fcb0011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb078a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb078a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb00133ad0 0x7fcb0011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb078a8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0012d8f0 con 0x7fcb001300a0 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb078a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0011ffa0 con 0x7fcb00130bc0 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb078a8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0012dd00 con 0x7fcb00133ad0 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05644700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb001300a0 0x7fcb0011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb04e43700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05644700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb001300a0 0x7fcb0011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37246/0 (socket says 172.21.15.154:37246) 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05644700 1 -- 172.21.15.154:0/4172010796 learned_addr learned my addr 172.21.15.154:0/4172010796 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05e45700 1 --2- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb00133ad0 0x7fcb0011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05644700 1 -- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb00133ad0 msgr2=0x7fcb0011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05644700 1 --2- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb00133ad0 0x7fcb0011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05644700 1 -- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 msgr2=0x7fcb0011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05644700 1 --2- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05644700 1 -- 172.21.15.154:0/4172010796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf0009550 con 0x7fcb001300a0 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb04e43700 1 --2- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.779+0000 7fcb05644700 1 --2- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb001300a0 0x7fcb0011da40 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000ebe0 tx=0x7fcaf000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.780+0000 7fcaf5ffb700 1 -- 172.21.15.154:0/4172010796 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000c850 con 0x7fcb001300a0 2023-09-30T22:28:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.780+0000 7fcaf5ffb700 1 -- 172.21.15.154:0/4172010796 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf000c9b0 con 0x7fcb001300a0 2023-09-30T22:28:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.780+0000 7fcb078a8700 1 -- 172.21.15.154:0/4172010796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf8009a70 con 0x7fcb001300a0 2023-09-30T22:28:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.780+0000 7fcaf5ffb700 1 -- 172.21.15.154:0/4172010796 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000cd40 con 0x7fcb001300a0 2023-09-30T22:28:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.780+0000 7fcb078a8700 1 -- 172.21.15.154:0/4172010796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0011f2e0 con 0x7fcb001300a0 2023-09-30T22:28:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.780+0000 7fcaf5ffb700 1 -- 172.21.15.154:0/4172010796 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcaf0013470 con 0x7fcb001300a0 2023-09-30T22:28:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.781+0000 7fcaf5ffb700 1 -- 172.21.15.154:0/4172010796 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcaf003fc00 con 0x7fcb001300a0 2023-09-30T22:28:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.781+0000 7fcb078a8700 1 -- 172.21.15.154:0/4172010796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0004f2a0 con 0x7fcb001300a0 2023-09-30T22:28:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.785+0000 7fcaf5ffb700 1 -- 172.21.15.154:0/4172010796 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcaf001b3b0 con 0x7fcb001300a0 2023-09-30T22:28:01.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:01.912 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:01.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.911+0000 7f473121c700 1 Processor -- start 2023-09-30T22:28:01.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.911+0000 7f473121c700 1 -- start start 2023-09-30T22:28:01.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f473121c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f473121c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c0a1380 0x7f472c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f473121c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f472c133f50 0x7f472c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f473121c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c09e9d0 con 0x7f472c133f50 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f473121c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c09dc00 con 0x7f472c0a0a70 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f473121c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472c09dec0 con 0x7f472c0a1380 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c0a1380 0x7f472c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472b59e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f472c133f50 0x7f472c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56062/0 (socket says 172.21.15.154:56062) 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472ad9d700 1 -- 172.21.15.154:0/791392291 learned_addr learned my addr 172.21.15.154:0/791392291 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c0a1380 0x7f472c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54688/0 (socket says 172.21.15.154:54688) 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472ad9d700 1 -- 172.21.15.154:0/791392291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c0a1380 msgr2=0x7f472c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472ad9d700 1 --2- 172.21.15.154:0/791392291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c0a1380 0x7f472c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472ad9d700 1 -- 172.21.15.154:0/791392291 >> v2:172.21.15.154:3300/0 conn(0x7f472c133f50 msgr2=0x7f472c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472ad9d700 1 --2- 172.21.15.154:0/791392291 >> v2:172.21.15.154:3300/0 conn(0x7f472c133f50 0x7f472c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472ad9d700 1 -- 172.21.15.154:0/791392291 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c09e6a0 con 0x7f472c0a0a70 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.912+0000 7f472b59e700 1 --2- 172.21.15.154:0/791392291 >> v2:172.21.15.154:3300/0 conn(0x7f472c133f50 0x7f472c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f472ad9d700 1 --2- 172.21.15.154:0/791392291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c0a0e40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f471c0098f0 tx=0x7f471c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3f7ed54e420e5f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f4729d9b700 1 -- 172.21.15.154:0/791392291 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c011830 con 0x7f472c0a0a70 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f4729d9b700 1 -- 172.21.15.154:0/791392291 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c011990 con 0x7f472c0a0a70 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f4729d9b700 1 -- 172.21.15.154:0/791392291 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c011d20 con 0x7f472c0a0a70 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f473121c700 1 -- 172.21.15.154:0/791392291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 msgr2=0x7f472c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f473121c700 1 --2- 172.21.15.154:0/791392291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c0a0e40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f471c0098f0 tx=0x7f471c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f473121c700 1 -- 172.21.15.154:0/791392291 shutdown_connections 2023-09-30T22:28:01.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f473121c700 1 --2- 172.21.15.154:0/791392291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c0a0e40 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f473121c700 1 --2- 172.21.15.154:0/791392291 >> v2:172.21.15.154:3300/0 conn(0x7f472c133f50 0x7f472c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f473121c700 1 --2- 172.21.15.154:0/791392291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c0a1380 0x7f472c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f473121c700 1 -- 172.21.15.154:0/791392291 >> 172.21.15.154:0/791392291 conn(0x7f472c0a6610 msgr2=0x7f472c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:01.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f473121c700 1 -- 172.21.15.154:0/791392291 shutdown_connections 2023-09-30T22:28:01.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.913+0000 7f473121c700 1 -- 172.21.15.154:0/791392291 wait complete. 2023-09-30T22:28:01.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.915+0000 7f473121c700 1 Processor -- start 2023-09-30T22:28:01.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.915+0000 7f473121c700 1 -- start start 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.915+0000 7f473121c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c1224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.915+0000 7f473121c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c0a1380 0x7f472c122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.915+0000 7f473121c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c133f50 0x7f472c122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.915+0000 7f473121c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c125d30 con 0x7f472c0a1380 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.915+0000 7f473121c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c1249d0 con 0x7f472c0a0a70 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.915+0000 7f473121c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0a5150 con 0x7f472c133f50 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c0a1380 0x7f472c122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c1224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c0a1380 0x7f472c122a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37254/0 (socket says 172.21.15.154:37254) 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472a59c700 1 -- 172.21.15.154:0/1004307834 learned_addr learned my addr 172.21.15.154:0/1004307834 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:01.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472b59e700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c133f50 0x7f472c122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472a59c700 1 -- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c133f50 msgr2=0x7f472c122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472a59c700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c133f50 0x7f472c122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472a59c700 1 -- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 msgr2=0x7f472c1224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472a59c700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c1224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472a59c700 1 -- 172.21.15.154:0/1004307834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4724009a70 con 0x7f472c0a1380 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472b59e700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c133f50 0x7f472c122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472ad9d700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c1224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f472a59c700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c0a1380 0x7f472c122a30 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f472000e900 tx=0x7f472000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f47137fe700 1 -- 172.21.15.154:0/1004307834 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000c640 con 0x7f472c0a1380 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f473121c700 1 -- 172.21.15.154:0/1004307834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471c009550 con 0x7f472c0a1380 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f47137fe700 1 -- 172.21.15.154:0/1004307834 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000c7a0 con 0x7f472c0a1380 2023-09-30T22:28:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f47137fe700 1 -- 172.21.15.154:0/1004307834 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000cb30 con 0x7f472c0a1380 2023-09-30T22:28:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.916+0000 7f473121c700 1 -- 172.21.15.154:0/1004307834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c124f20 con 0x7f472c0a1380 2023-09-30T22:28:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.917+0000 7f47137fe700 1 -- 172.21.15.154:0/1004307834 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f472000cc90 con 0x7f472c0a1380 2023-09-30T22:28:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.917+0000 7f47137fe700 1 -- 172.21.15.154:0/1004307834 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f472003f2f0 con 0x7f472c0a1380 2023-09-30T22:28:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.918+0000 7f473121c700 1 -- 172.21.15.154:0/1004307834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c11f050 con 0x7f472c0a1380 2023-09-30T22:28:01.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.925+0000 7f47137fe700 1 -- 172.21.15.154:0/1004307834 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f472001bbe0 con 0x7f472c0a1380 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.989+0000 7fcb078a8700 1 -- 172.21.15.154:0/4172010796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb00071690 con 0x7fcb001300a0 2023-09-30T22:28:01.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.989+0000 7fcaf5ffb700 1 -- 172.21.15.154:0/4172010796 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcaf0011ca0 con 0x7fcb001300a0 2023-09-30T22:28:01.991 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:01.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.991+0000 7fcb078a8700 1 -- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb001300a0 msgr2=0x7fcb0011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:01.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.991+0000 7fcb078a8700 1 --2- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb001300a0 0x7fcb0011da40 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000ebe0 tx=0x7fcaf000eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.991+0000 7fcb078a8700 1 -- 172.21.15.154:0/4172010796 shutdown_connections 2023-09-30T22:28:01.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.991+0000 7fcb078a8700 1 --2- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb00133ad0 0x7fcb0011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.991+0000 7fcb078a8700 1 --2- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb001300a0 0x7fcb0011da40 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.991+0000 7fcb078a8700 1 --2- 172.21.15.154:0/4172010796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb00130bc0 0x7fcb0011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:01.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.991+0000 7fcb078a8700 1 -- 172.21.15.154:0/4172010796 >> 172.21.15.154:0/4172010796 conn(0x7fcb00099c40 msgr2=0x7fcb0012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:01.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.991+0000 7fcb078a8700 1 -- 172.21.15.154:0/4172010796 shutdown_connections 2023-09-30T22:28:01.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:01.991+0000 7fcb078a8700 1 -- 172.21.15.154:0/4172010796 wait complete. 2023-09-30T22:28:02.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:02.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.041+0000 7f5c9a329700 1 Processor -- start 2023-09-30T22:28:02.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.041+0000 7f5c9a329700 1 -- start start 2023-09-30T22:28:02.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.041+0000 7f5c9a329700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c940a1550 0x7f5c94138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.041+0000 7f5c9a329700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c94139200 0x7f5c9413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.041+0000 7f5c9a329700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9409e9d0 con 0x7f5c940a0a70 2023-09-30T22:28:02.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.041+0000 7f5c9a329700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9409dc00 con 0x7f5c94139200 2023-09-30T22:28:02.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.041+0000 7f5c9a329700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9409dec0 con 0x7f5c940a1550 2023-09-30T22:28:02.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.041+0000 7f5c937fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c940a1550 0x7f5c94138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c988c6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c94139200 0x7f5c9413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c937fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c940a1550 0x7f5c94138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56086/0 (socket says 172.21.15.154:56086) 2023-09-30T22:28:02.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c937fe700 1 -- 172.21.15.154:0/667126605 learned_addr learned my addr 172.21.15.154:0/667126605 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:02.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c937fe700 1 -- 172.21.15.154:0/667126605 >> v2:172.21.15.154:3300/0 conn(0x7f5c94139200 msgr2=0x7f5c9413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:02.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c937fe700 1 --2- 172.21.15.154:0/667126605 >> v2:172.21.15.154:3300/0 conn(0x7f5c94139200 0x7f5c9413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c937fe700 1 -- 172.21.15.154:0/667126605 >> v1:172.21.15.154:6789/0 conn(0x7f5c940a0a70 legacy=0x7f5c940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c937fe700 1 -- 172.21.15.154:0/667126605 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9409e6a0 con 0x7f5c940a1550 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c988c6700 1 --2- 172.21.15.154:0/667126605 >> v2:172.21.15.154:3300/0 conn(0x7f5c94139200 0x7f5c9413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c937fe700 1 --2- 172.21.15.154:0/667126605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c940a1550 0x7f5c94138cc0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5c880098f0 tx=0x7f5c88009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69a1ce92557c20cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c92ffd700 1 -- 172.21.15.154:0/667126605 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88011830 con 0x7f5c940a1550 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c92ffd700 1 -- 172.21.15.154:0/667126605 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88011990 con 0x7f5c940a1550 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.042+0000 7f5c92ffd700 1 -- 172.21.15.154:0/667126605 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c88011d20 con 0x7f5c940a1550 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.043+0000 7f5c9a329700 1 -- 172.21.15.154:0/667126605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c940a1550 msgr2=0x7f5c94138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.043+0000 7f5c9a329700 1 --2- 172.21.15.154:0/667126605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c940a1550 0x7f5c94138cc0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5c880098f0 tx=0x7f5c88009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.043+0000 7f5c9a329700 1 -- 172.21.15.154:0/667126605 shutdown_connections 2023-09-30T22:28:02.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.043+0000 7f5c9a329700 1 --2- 172.21.15.154:0/667126605 >> v2:172.21.15.154:3300/0 conn(0x7f5c94139200 0x7f5c9413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.043+0000 7f5c9a329700 1 --2- 172.21.15.154:0/667126605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c940a1550 0x7f5c94138cc0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.043+0000 7f5c9a329700 1 -- 172.21.15.154:0/667126605 >> 172.21.15.154:0/667126605 conn(0x7f5c940a6610 msgr2=0x7f5c940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.043+0000 7f5c9a329700 1 -- 172.21.15.154:0/667126605 shutdown_connections 2023-09-30T22:28:02.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.043+0000 7f5c9a329700 1 -- 172.21.15.154:0/667126605 wait complete. 2023-09-30T22:28:02.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.044+0000 7f5c9a329700 1 Processor -- start 2023-09-30T22:28:02.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.044+0000 7f5c9a329700 1 -- start start 2023-09-30T22:28:02.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c9a329700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c940a0a70 0x7f5c9411e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c9a329700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c940a1550 0x7f5c9411eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c9a329700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c94139200 0x7f5c9411f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c9a329700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c941224a0 con 0x7f5c940a1550 2023-09-30T22:28:02.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c9a329700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c941220a0 con 0x7f5c94139200 2023-09-30T22:28:02.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c9a329700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94121af0 con 0x7f5c940a0a70 2023-09-30T22:28:02.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c940a1550 0x7f5c9411eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c937fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c940a1550 0x7f5c9411eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37272/0 (socket says 172.21.15.154:37272) 2023-09-30T22:28:02.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c937fe700 1 -- 172.21.15.154:0/1192077419 learned_addr learned my addr 172.21.15.154:0/1192077419 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:02.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c93fff700 1 --2- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c940a0a70 0x7f5c9411e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c988c6700 1 --2- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c94139200 0x7f5c9411f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c937fe700 1 -- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c940a0a70 msgr2=0x7f5c9411e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c937fe700 1 --2- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c940a0a70 0x7f5c9411e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c937fe700 1 -- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c94139200 msgr2=0x7f5c9411f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c937fe700 1 --2- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c94139200 0x7f5c9411f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c937fe700 1 -- 172.21.15.154:0/1192077419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c009a70 con 0x7f5c940a1550 2023-09-30T22:28:02.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c937fe700 1 --2- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c940a1550 0x7f5c9411eda0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f5c88000c00 tx=0x7f5c88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c90ff9700 1 -- 172.21.15.154:0/1192077419 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880043c0 con 0x7f5c940a1550 2023-09-30T22:28:02.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c90ff9700 1 -- 172.21.15.154:0/1192077419 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8801f070 con 0x7f5c940a1550 2023-09-30T22:28:02.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c9a329700 1 -- 172.21.15.154:0/1192077419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c88009550 con 0x7f5c940a1550 2023-09-30T22:28:02.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.045+0000 7f5c90ff9700 1 -- 172.21.15.154:0/1192077419 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c880038c0 con 0x7f5c940a1550 2023-09-30T22:28:02.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.046+0000 7f5c9a329700 1 -- 172.21.15.154:0/1192077419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c94120580 con 0x7f5c940a1550 2023-09-30T22:28:02.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.046+0000 7f5c90ff9700 1 -- 172.21.15.154:0/1192077419 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c88021030 con 0x7f5c940a1550 2023-09-30T22:28:02.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.046+0000 7f5c90ff9700 1 -- 172.21.15.154:0/1192077419 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c88040980 con 0x7f5c940a1550 2023-09-30T22:28:02.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.046+0000 7f5c9a329700 1 -- 172.21.15.154:0/1192077419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9404f2a0 con 0x7f5c940a1550 2023-09-30T22:28:02.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:02.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.052+0000 7f5c90ff9700 1 -- 172.21.15.154:0/1192077419 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c88004560 con 0x7f5c940a1550 2023-09-30T22:28:02.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.124+0000 7f473121c700 1 -- 172.21.15.154:0/1004307834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f472c06d3f0 con 0x7f472c0a1380 2023-09-30T22:28:02.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.124+0000 7f47137fe700 1 -- 172.21.15.154:0/1004307834 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4720017070 con 0x7f472c0a1380 2023-09-30T22:28:02.126 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:02.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.127+0000 7f473121c700 1 -- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c0a1380 msgr2=0x7f472c122a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.127+0000 7f473121c700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c0a1380 0x7f472c122a30 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f472000e900 tx=0x7f472000ec10 comp rx=0 tx=0).stop 2023-09-30T22:28:02.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.127+0000 7f473121c700 1 -- 172.21.15.154:0/1004307834 shutdown_connections 2023-09-30T22:28:02.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.127+0000 7f473121c700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f472c133f50 0x7f472c122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.127+0000 7f473121c700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f472c0a0a70 0x7f472c1224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.127+0000 7f473121c700 1 --2- 172.21.15.154:0/1004307834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f472c0a1380 0x7f472c122a30 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.127+0000 7f473121c700 1 -- 172.21.15.154:0/1004307834 >> 172.21.15.154:0/1004307834 conn(0x7f472c0a6610 msgr2=0x7f472c09c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.127+0000 7f473121c700 1 -- 172.21.15.154:0/1004307834 shutdown_connections 2023-09-30T22:28:02.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.127+0000 7f473121c700 1 -- 172.21.15.154:0/1004307834 wait complete. 2023-09-30T22:28:02.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:02.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.181+0000 7f6dbea21700 1 Processor -- start 2023-09-30T22:28:02.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6dbea21700 1 -- start start 2023-09-30T22:28:02.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6dbea21700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db809e870 0x7f6db809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6dbea21700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6db809f180 0x7f6db8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6dbea21700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db8131d70 0x7f6db8132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6dbea21700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db80a0920 con 0x7f6db809f180 2023-09-30T22:28:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6dbea21700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db809c970 con 0x7f6db8131d70 2023-09-30T22:28:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6dbea21700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6db809bab0 con 0x7f6db809e870 2023-09-30T22:28:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6db7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db809e870 0x7f6db809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6db7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db809e870 0x7f6db809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54712/0 (socket says 172.21.15.154:54712) 2023-09-30T22:28:02.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6db7fff700 1 -- 172.21.15.154:0/2468548235 learned_addr learned my addr 172.21.15.154:0/2468548235 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:02.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6db77fe700 1 --2- 172.21.15.154:0/2468548235 >> v2:172.21.15.154:3300/0 conn(0x7f6db809f180 0x7f6db8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.182+0000 7f6dbcfbe700 1 --2- 172.21.15.154:0/2468548235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db8131d70 0x7f6db8132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db7fff700 1 -- 172.21.15.154:0/2468548235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db8131d70 msgr2=0x7f6db8132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db7fff700 1 --2- 172.21.15.154:0/2468548235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db8131d70 0x7f6db8132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db7fff700 1 -- 172.21.15.154:0/2468548235 >> v2:172.21.15.154:3300/0 conn(0x7f6db809f180 msgr2=0x7f6db8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db7fff700 1 --2- 172.21.15.154:0/2468548235 >> v2:172.21.15.154:3300/0 conn(0x7f6db809f180 0x7f6db8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db7fff700 1 -- 172.21.15.154:0/2468548235 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db809f9c0 con 0x7f6db809e870 2023-09-30T22:28:02.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db77fe700 1 --2- 172.21.15.154:0/2468548235 >> v2:172.21.15.154:3300/0 conn(0x7f6db809f180 0x7f6db8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:02.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db7fff700 1 --2- 172.21.15.154:0/2468548235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db809e870 0x7f6db809ec40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6da80098f0 tx=0x7f6da8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2919737767723480 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db6ffd700 1 -- 172.21.15.154:0/2468548235 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011830 con 0x7f6db809e870 2023-09-30T22:28:02.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db6ffd700 1 -- 172.21.15.154:0/2468548235 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8011990 con 0x7f6db809e870 2023-09-30T22:28:02.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6db6ffd700 1 -- 172.21.15.154:0/2468548235 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011d20 con 0x7f6db809e870 2023-09-30T22:28:02.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6dbea21700 1 -- 172.21.15.154:0/2468548235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db809e870 msgr2=0x7f6db809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6dbea21700 1 --2- 172.21.15.154:0/2468548235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db809e870 0x7f6db809ec40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6da80098f0 tx=0x7f6da8009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:02.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6dbea21700 1 -- 172.21.15.154:0/2468548235 shutdown_connections 2023-09-30T22:28:02.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6dbea21700 1 --2- 172.21.15.154:0/2468548235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db8131d70 0x7f6db8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6dbea21700 1 --2- 172.21.15.154:0/2468548235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db809e870 0x7f6db809ec40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6dbea21700 1 --2- 172.21.15.154:0/2468548235 >> v2:172.21.15.154:3300/0 conn(0x7f6db809f180 0x7f6db8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6dbea21700 1 -- 172.21.15.154:0/2468548235 >> 172.21.15.154:0/2468548235 conn(0x7f6db80a4430 msgr2=0x7f6db80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6dbea21700 1 -- 172.21.15.154:0/2468548235 shutdown_connections 2023-09-30T22:28:02.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.183+0000 7f6dbea21700 1 -- 172.21.15.154:0/2468548235 wait complete. 2023-09-30T22:28:02.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.185+0000 7f6dbea21700 1 Processor -- start 2023-09-30T22:28:02.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.185+0000 7f6dbea21700 1 -- start start 2023-09-30T22:28:02.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.185+0000 7f6dbea21700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db809e870 0x7f6db81c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.185+0000 7f6dbea21700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db809f180 0x7f6db81c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.185+0000 7f6dbea21700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db8131d70 0x7f6db81c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.185+0000 7f6dbea21700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db811e6d0 con 0x7f6db809f180 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.185+0000 7f6dbea21700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db811e4e0 con 0x7f6db809e870 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.185+0000 7f6dbea21700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6db81203f0 con 0x7f6db8131d70 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6db7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db809e870 0x7f6db81c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6db77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db809f180 0x7f6db81c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6dbcfbe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db8131d70 0x7f6db81c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:02.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6db7fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db809e870 0x7f6db81c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56100/0 (socket says 172.21.15.154:56100) 2023-09-30T22:28:02.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6db7fff700 1 -- 172.21.15.154:0/2039991262 learned_addr learned my addr 172.21.15.154:0/2039991262 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:02.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6db77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db809f180 0x7f6db81c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37284/0 (socket says 172.21.15.154:37284) 2023-09-30T22:28:02.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6dbcfbe700 1 -- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db809e870 msgr2=0x7f6db81c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6dbcfbe700 1 --2- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db809e870 0x7f6db81c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6dbcfbe700 1 -- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db809f180 msgr2=0x7f6db81c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6dbcfbe700 1 --2- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db809f180 0x7f6db81c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6dbcfbe700 1 -- 172.21.15.154:0/2039991262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0094a0 con 0x7f6db8131d70 2023-09-30T22:28:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6db77fe700 1 --2- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db809f180 0x7f6db81c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6dbcfbe700 1 --2- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db8131d70 0x7f6db81c6d20 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6db000efc0 tx=0x7f6db000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6db4ff9700 1 -- 172.21.15.154:0/2039991262 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000cc90 con 0x7f6db8131d70 2023-09-30T22:28:02.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6db4ff9700 1 -- 172.21.15.154:0/2039991262 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db000f040 con 0x7f6db8131d70 2023-09-30T22:28:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6dbea21700 1 -- 172.21.15.154:0/2039991262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da8009550 con 0x7f6db8131d70 2023-09-30T22:28:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6db4ff9700 1 -- 172.21.15.154:0/2039991262 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db00146c0 con 0x7f6db8131d70 2023-09-30T22:28:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.186+0000 7f6dbea21700 1 -- 172.21.15.154:0/2039991262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db8120110 con 0x7f6db8131d70 2023-09-30T22:28:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.187+0000 7f6db4ff9700 1 -- 172.21.15.154:0/2039991262 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6db0014820 con 0x7f6db8131d70 2023-09-30T22:28:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.187+0000 7f6db4ff9700 1 -- 172.21.15.154:0/2039991262 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6db00401b0 con 0x7f6db8131d70 2023-09-30T22:28:02.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.187+0000 7f6dbea21700 1 -- 172.21.15.154:0/2039991262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db811fdb0 con 0x7f6db8131d70 2023-09-30T22:28:02.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.192+0000 7f6db4ff9700 1 -- 172.21.15.154:0/2039991262 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6db811fdb0 con 0x7f6db8131d70 2023-09-30T22:28:02.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.260+0000 7f5c9a329700 1 -- 172.21.15.154:0/1192077419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c94120c60 con 0x7f5c940a1550 2023-09-30T22:28:02.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.261+0000 7f5c90ff9700 1 -- 172.21.15.154:0/1192077419 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c880193b0 con 0x7f5c940a1550 2023-09-30T22:28:02.262 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:02.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.263+0000 7f5c9a329700 1 -- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c940a1550 msgr2=0x7f5c9411eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.263+0000 7f5c9a329700 1 --2- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c940a1550 0x7f5c9411eda0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f5c88000c00 tx=0x7f5c88004750 comp rx=0 tx=0).stop 2023-09-30T22:28:02.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.263+0000 7f5c9a329700 1 -- 172.21.15.154:0/1192077419 shutdown_connections 2023-09-30T22:28:02.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.263+0000 7f5c9a329700 1 --2- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c94139200 0x7f5c9411f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.263+0000 7f5c9a329700 1 --2- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c940a0a70 0x7f5c9411e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.263+0000 7f5c9a329700 1 --2- 172.21.15.154:0/1192077419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c940a1550 0x7f5c9411eda0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.263+0000 7f5c9a329700 1 -- 172.21.15.154:0/1192077419 >> 172.21.15.154:0/1192077419 conn(0x7f5c940a6610 msgr2=0x7f5c941381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.263+0000 7f5c9a329700 1 -- 172.21.15.154:0/1192077419 shutdown_connections 2023-09-30T22:28:02.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.263+0000 7f5c9a329700 1 -- 172.21.15.154:0/1192077419 wait complete. 2023-09-30T22:28:02.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:02.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.380+0000 7f6dbea21700 1 -- 172.21.15.154:0/2039991262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6db811fdb0 con 0x7f6db8131d70 2023-09-30T22:28:02.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.380+0000 7f6db4ff9700 1 -- 172.21.15.154:0/2039991262 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6db811fdb0 con 0x7f6db8131d70 2023-09-30T22:28:02.381 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:02.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.382+0000 7f6dbea21700 1 -- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db8131d70 msgr2=0x7f6db81c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:02.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.382+0000 7f6dbea21700 1 --2- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db8131d70 0x7f6db81c6d20 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6db000efc0 tx=0x7f6db000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.382+0000 7f6dbea21700 1 -- 172.21.15.154:0/2039991262 shutdown_connections 2023-09-30T22:28:02.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.382+0000 7f6dbea21700 1 --2- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6db8131d70 0x7f6db81c6d20 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.382+0000 7f6dbea21700 1 --2- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db809e870 0x7f6db81c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.382+0000 7f6dbea21700 1 --2- 172.21.15.154:0/2039991262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db809f180 0x7f6db81c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:02.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.382+0000 7f6dbea21700 1 -- 172.21.15.154:0/2039991262 >> 172.21.15.154:0/2039991262 conn(0x7f6db80a4430 msgr2=0x7f6db81b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:02.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.382+0000 7f6dbea21700 1 -- 172.21.15.154:0/2039991262 shutdown_connections 2023-09-30T22:28:02.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:02.382+0000 7f6dbea21700 1 -- 172.21.15.154:0/2039991262 wait complete. 2023-09-30T22:28:02.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:03.006 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:03.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.129+0000 7f3fa490c700 1 Processor -- start 2023-09-30T22:28:03.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.129+0000 7f3fa490c700 1 -- start start 2023-09-30T22:28:03.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.129+0000 7f3fa490c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fa006a770 0x7f3fa006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.129+0000 7f3fa490c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa006b080 0x7f3fa01317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.129+0000 7f3fa490c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa0131cf0 0x7f3fa0132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.129+0000 7f3fa490c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa009f770 con 0x7f3fa006a770 2023-09-30T22:28:03.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.129+0000 7f3fa490c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa009dce0 con 0x7f3fa006b080 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.129+0000 7f3fa490c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa009da80 con 0x7f3fa0131cf0 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa006b080 0x7f3fa01317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fa006a770 0x7f3fa006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa0131cf0 0x7f3fa0132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa006b080 0x7f3fa01317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56106/0 (socket says 172.21.15.154:56106) 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fa006a770 0x7f3fa006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37300/0 (socket says 172.21.15.154:37300) 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9dd9b700 1 -- 172.21.15.154:0/4223503441 learned_addr learned my addr 172.21.15.154:0/4223503441 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9dd9b700 1 -- 172.21.15.154:0/4223503441 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa0131cf0 msgr2=0x7f3fa0132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9dd9b700 1 --2- 172.21.15.154:0/4223503441 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa0131cf0 0x7f3fa0132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9dd9b700 1 -- 172.21.15.154:0/4223503441 >> v2:172.21.15.154:3300/0 conn(0x7f3fa006a770 msgr2=0x7f3fa006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9dd9b700 1 --2- 172.21.15.154:0/4223503441 >> v2:172.21.15.154:3300/0 conn(0x7f3fa006a770 0x7f3fa006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9dd9b700 1 -- 172.21.15.154:0/4223503441 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa009eb20 con 0x7f3fa006b080 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9ed9d700 1 --2- 172.21.15.154:0/4223503441 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa0131cf0 0x7f3fa0132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9e59c700 1 --2- 172.21.15.154:0/4223503441 >> v2:172.21.15.154:3300/0 conn(0x7f3fa006a770 0x7f3fa006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9dd9b700 1 --2- 172.21.15.154:0/4223503441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa006b080 0x7f3fa01317b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3f940098f0 tx=0x7f3f94009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e96af770b58dd995 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9d59a700 1 -- 172.21.15.154:0/4223503441 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94011830 con 0x7f3fa006b080 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9d59a700 1 -- 172.21.15.154:0/4223503441 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f94011990 con 0x7f3fa006b080 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.130+0000 7f3f9d59a700 1 -- 172.21.15.154:0/4223503441 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94011d20 con 0x7f3fa006b080 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.131+0000 7f3fa490c700 1 -- 172.21.15.154:0/4223503441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa006b080 msgr2=0x7f3fa01317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.131+0000 7f3fa490c700 1 --2- 172.21.15.154:0/4223503441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa006b080 0x7f3fa01317b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3f940098f0 tx=0x7f3f94009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.131+0000 7f3fa490c700 1 -- 172.21.15.154:0/4223503441 shutdown_connections 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.131+0000 7f3fa490c700 1 --2- 172.21.15.154:0/4223503441 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa0131cf0 0x7f3fa0132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.131+0000 7f3fa490c700 1 --2- 172.21.15.154:0/4223503441 >> v2:172.21.15.154:3300/0 conn(0x7f3fa006a770 0x7f3fa006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.131+0000 7f3fa490c700 1 --2- 172.21.15.154:0/4223503441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa006b080 0x7f3fa01317b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.131+0000 7f3fa490c700 1 -- 172.21.15.154:0/4223503441 >> 172.21.15.154:0/4223503441 conn(0x7f3fa0099c40 msgr2=0x7f3fa00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.131+0000 7f3fa490c700 1 -- 172.21.15.154:0/4223503441 shutdown_connections 2023-09-30T22:28:03.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.131+0000 7f3fa490c700 1 -- 172.21.15.154:0/4223503441 wait complete. 2023-09-30T22:28:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.132+0000 7f3fa490c700 1 Processor -- start 2023-09-30T22:28:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.132+0000 7f3fa490c700 1 -- start start 2023-09-30T22:28:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.132+0000 7f3fa490c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa006a770 0x7f3fa01c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.132+0000 7f3fa490c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa006b080 0x7f3fa01c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.132+0000 7f3fa490c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa0131cf0 0x7f3fa01c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3fa490c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa009a940 con 0x7f3fa006a770 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3fa490c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa01222f0 con 0x7f3fa0131cf0 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3fa490c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa009c010 con 0x7f3fa006b080 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa006a770 0x7f3fa01c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa006a770 0x7f3fa01c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37308/0 (socket says 172.21.15.154:37308) 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9e59c700 1 -- 172.21.15.154:0/1292615576 learned_addr learned my addr 172.21.15.154:0/1292615576 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9dd9b700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa006b080 0x7f3fa01c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9ed9d700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa0131cf0 0x7f3fa01c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9e59c700 1 -- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa006b080 msgr2=0x7f3fa01c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9e59c700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa006b080 0x7f3fa01c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9e59c700 1 -- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa0131cf0 msgr2=0x7f3fa01c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9e59c700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa0131cf0 0x7f3fa01c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9e59c700 1 -- 172.21.15.154:0/1292615576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f900094a0 con 0x7f3fa006a770 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9dd9b700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa006b080 0x7f3fa01c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9ed9d700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa0131cf0 0x7f3fa01c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f9e59c700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa006a770 0x7f3fa01c8040 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000ec10 tx=0x7f3f9000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f8effd700 1 -- 172.21.15.154:0/1292615576 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000c850 con 0x7f3fa006a770 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f8effd700 1 -- 172.21.15.154:0/1292615576 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000c9b0 con 0x7f3fa006a770 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3fa490c700 1 -- 172.21.15.154:0/1292615576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f98009a70 con 0x7f3fa006a770 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3f8effd700 1 -- 172.21.15.154:0/1292615576 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000cd20 con 0x7f3fa006a770 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.133+0000 7f3fa490c700 1 -- 172.21.15.154:0/1292615576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f94009550 con 0x7f3fa006a770 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.134+0000 7f3f8effd700 1 -- 172.21.15.154:0/1292615576 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f90013470 con 0x7f3fa006a770 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.134+0000 7f3f8effd700 1 -- 172.21.15.154:0/1292615576 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f9003fb30 con 0x7f3fa006a770 2023-09-30T22:28:03.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.134+0000 7f3fa490c700 1 -- 172.21.15.154:0/1292615576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa004f2a0 con 0x7f3fa006a770 2023-09-30T22:28:03.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.139+0000 7f3f8effd700 1 -- 172.21.15.154:0/1292615576 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f90021080 con 0x7f3fa006a770 2023-09-30T22:28:03.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:03.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.269+0000 7f1ff9e35700 1 Processor -- start 2023-09-30T22:28:03.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff9e35700 1 -- start start 2023-09-30T22:28:03.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff9e35700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409e870 0x7f1ff409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff9e35700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ff409f180 0x7f1ff4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff9e35700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff9e35700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff40a0920 con 0x7f1ff409f180 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff9e35700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff409c970 con 0x7f1ff409e870 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff9e35700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff409bab0 con 0x7f1ff4131d70 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409e870 0x7f1ff409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ff409f180 0x7f1ff4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff2ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ff409f180 0x7f1ff4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37320/0 (socket says 172.21.15.154:37320) 2023-09-30T22:28:03.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff2ffd700 1 -- 172.21.15.154:0/2880020776 learned_addr learned my addr 172.21.15.154:0/2880020776 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409e870 0x7f1ff409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56136/0 (socket says 172.21.15.154:56136) 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff4132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54748/0 (socket says 172.21.15.154:54748) 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff3fff700 1 -- 172.21.15.154:0/2880020776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409e870 msgr2=0x7f1ff409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff3fff700 1 --2- 172.21.15.154:0/2880020776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409e870 0x7f1ff409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff3fff700 1 -- 172.21.15.154:0/2880020776 >> v2:172.21.15.154:3300/0 conn(0x7f1ff409f180 msgr2=0x7f1ff4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff3fff700 1 --2- 172.21.15.154:0/2880020776 >> v2:172.21.15.154:3300/0 conn(0x7f1ff409f180 0x7f1ff4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff3fff700 1 -- 172.21.15.154:0/2880020776 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff409f9c0 con 0x7f1ff4131d70 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.270+0000 7f1ff2ffd700 1 --2- 172.21.15.154:0/2880020776 >> v2:172.21.15.154:3300/0 conn(0x7f1ff409f180 0x7f1ff4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff37fe700 1 --2- 172.21.15.154:0/2880020776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409e870 0x7f1ff409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff3fff700 1 --2- 172.21.15.154:0/2880020776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff4132210 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009d90 tx=0x7f1fec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30dc6a8dea3e2c77 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff27fc700 1 -- 172.21.15.154:0/2880020776 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00e070 con 0x7f1ff4131d70 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff27fc700 1 -- 172.21.15.154:0/2880020776 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec00bb20 con 0x7f1ff4131d70 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff27fc700 1 -- 172.21.15.154:0/2880020776 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec012430 con 0x7f1ff4131d70 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff9e35700 1 -- 172.21.15.154:0/2880020776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 msgr2=0x7f1ff4132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff9e35700 1 --2- 172.21.15.154:0/2880020776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff4132210 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009d90 tx=0x7f1fec00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff9e35700 1 -- 172.21.15.154:0/2880020776 shutdown_connections 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff9e35700 1 --2- 172.21.15.154:0/2880020776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409e870 0x7f1ff409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff9e35700 1 --2- 172.21.15.154:0/2880020776 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff4132210 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff9e35700 1 --2- 172.21.15.154:0/2880020776 >> v2:172.21.15.154:3300/0 conn(0x7f1ff409f180 0x7f1ff4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff9e35700 1 -- 172.21.15.154:0/2880020776 >> 172.21.15.154:0/2880020776 conn(0x7f1ff40a4430 msgr2=0x7f1ff40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff9e35700 1 -- 172.21.15.154:0/2880020776 shutdown_connections 2023-09-30T22:28:03.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.271+0000 7f1ff9e35700 1 -- 172.21.15.154:0/2880020776 wait complete. 2023-09-30T22:28:03.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.273+0000 7f1ff9e35700 1 Processor -- start 2023-09-30T22:28:03.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.273+0000 7f1ff9e35700 1 -- start start 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.273+0000 7f1ff9e35700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff409e870 0x7f1ff411b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.273+0000 7f1ff9e35700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409f180 0x7f1ff411bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.273+0000 7f1ff9e35700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff41c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.273+0000 7f1ff9e35700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff411e540 con 0x7f1ff409e870 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.273+0000 7f1ff9e35700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff411da20 con 0x7f1ff409f180 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.273+0000 7f1ff9e35700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff411e280 con 0x7f1ff4131d70 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff409e870 0x7f1ff411b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409f180 0x7f1ff411bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff409e870 0x7f1ff411b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37322/0 (socket says 172.21.15.154:37322) 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff2ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409f180 0x7f1ff411bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56152/0 (socket says 172.21.15.154:56152) 2023-09-30T22:28:03.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff37fe700 1 -- 172.21.15.154:0/238485915 learned_addr learned my addr 172.21.15.154:0/238485915 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff3fff700 1 --2- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff41c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff37fe700 1 -- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 msgr2=0x7f1ff41c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff37fe700 1 --2- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff41c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff37fe700 1 -- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409f180 msgr2=0x7f1ff411bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff37fe700 1 --2- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409f180 0x7f1ff411bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff37fe700 1 -- 172.21.15.154:0/238485915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40094a0 con 0x7f1ff409e870 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff2ffd700 1 --2- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409f180 0x7f1ff411bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff37fe700 1 --2- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff409e870 0x7f1ff411b620 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400ebe0 tx=0x7f1fe400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1fdbfff700 1 -- 172.21.15.154:0/238485915 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4009780 con 0x7f1ff409e870 2023-09-30T22:28:03.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1fdbfff700 1 -- 172.21.15.154:0/238485915 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400c850 con 0x7f1ff409e870 2023-09-30T22:28:03.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff9e35700 1 -- 172.21.15.154:0/238485915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe800d9f0 con 0x7f1ff409e870 2023-09-30T22:28:03.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1fdbfff700 1 -- 172.21.15.154:0/238485915 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400cbe0 con 0x7f1ff409e870 2023-09-30T22:28:03.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.274+0000 7f1ff9e35700 1 -- 172.21.15.154:0/238485915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec009a70 con 0x7f1ff409e870 2023-09-30T22:28:03.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.275+0000 7f1fdbfff700 1 -- 172.21.15.154:0/238485915 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fe400cd40 con 0x7f1ff409e870 2023-09-30T22:28:03.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.275+0000 7f1ff9e35700 1 -- 172.21.15.154:0/238485915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff411df90 con 0x7f1ff409e870 2023-09-30T22:28:03.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.275+0000 7f1fdbfff700 1 -- 172.21.15.154:0/238485915 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fe403f710 con 0x7f1ff409e870 2023-09-30T22:28:03.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:03.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.280+0000 7f1fdbfff700 1 -- 172.21.15.154:0/238485915 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fe4013990 con 0x7f1ff409e870 2023-09-30T22:28:03.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.335+0000 7f3fa490c700 1 -- 172.21.15.154:0/1292615576 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3fa00a2880 con 0x7f3fa006a770 2023-09-30T22:28:03.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.335+0000 7f3f8effd700 1 -- 172.21.15.154:0/1292615576 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f90013720 con 0x7f3fa006a770 2023-09-30T22:28:03.336 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.338+0000 7f3fa490c700 1 -- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa006a770 msgr2=0x7f3fa01c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.338+0000 7f3fa490c700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa006a770 0x7f3fa01c8040 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000ec10 tx=0x7f3f9000ef20 comp rx=0 tx=0).stop 2023-09-30T22:28:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.338+0000 7f3fa490c700 1 -- 172.21.15.154:0/1292615576 shutdown_connections 2023-09-30T22:28:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.338+0000 7f3fa490c700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fa0131cf0 0x7f3fa01c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.338+0000 7f3fa490c700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa006a770 0x7f3fa01c8040 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.338+0000 7f3fa490c700 1 --2- 172.21.15.154:0/1292615576 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3fa006b080 0x7f3fa01c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.338+0000 7f3fa490c700 1 -- 172.21.15.154:0/1292615576 >> 172.21.15.154:0/1292615576 conn(0x7f3fa0099c40 msgr2=0x7f3fa01b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.338+0000 7f3fa490c700 1 -- 172.21.15.154:0/1292615576 shutdown_connections 2023-09-30T22:28:03.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.338+0000 7f3fa490c700 1 -- 172.21.15.154:0/1292615576 wait complete. 2023-09-30T22:28:03.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:03.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:03.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.405+0000 7fc5ddf3b700 1 Processor -- start 2023-09-30T22:28:03.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.405+0000 7fc5ddf3b700 1 -- start start 2023-09-30T22:28:03.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.406+0000 7fc5ddf3b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5d8131980 0x7fc5d8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.406+0000 7fc5ddf3b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809bc70 0x7fc5d809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.406+0000 7fc5ddf3b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d80a1640 con 0x7fc5d809c5c0 2023-09-30T22:28:03.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.406+0000 7fc5ddf3b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d806eb30 con 0x7fc5d8131980 2023-09-30T22:28:03.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.406+0000 7fc5ddf3b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80a22d0 con 0x7fc5d809bc70 2023-09-30T22:28:03.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.406+0000 7fc5d77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5d8131980 0x7fc5d8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.406+0000 7fc5d77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5d8131980 0x7fc5d8131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37332/0 (socket says 172.21.15.154:37332) 2023-09-30T22:28:03.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.406+0000 7fc5d77fe700 1 -- 172.21.15.154:0/3120830087 learned_addr learned my addr 172.21.15.154:0/3120830087 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:03.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.406+0000 7fc5d6ffd700 1 --2- 172.21.15.154:0/3120830087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809bc70 0x7fc5d809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.407+0000 7fc5d77fe700 1 -- 172.21.15.154:0/3120830087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809bc70 msgr2=0x7fc5d809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.407+0000 7fc5d77fe700 1 --2- 172.21.15.154:0/3120830087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809bc70 0x7fc5d809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.407+0000 7fc5d77fe700 1 -- 172.21.15.154:0/3120830087 >> v1:172.21.15.154:6789/0 conn(0x7fc5d809c5c0 legacy=0x7fc5d8138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.407+0000 7fc5d77fe700 1 -- 172.21.15.154:0/3120830087 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8131550 con 0x7fc5d8131980 2023-09-30T22:28:03.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.407+0000 7fc5d77fe700 1 --2- 172.21.15.154:0/3120830087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 0x7fc5d8131d50 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8006fd0 tx=0x7fc5c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e9871883a7561 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.407+0000 7fc5d67fc700 1 -- 172.21.15.154:0/3120830087 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8005e30 con 0x7fc5d8131980 2023-09-30T22:28:03.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.407+0000 7fc5d67fc700 1 -- 172.21.15.154:0/3120830087 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c8004030 con 0x7fc5d8131980 2023-09-30T22:28:03.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.407+0000 7fc5d67fc700 1 -- 172.21.15.154:0/3120830087 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80043e0 con 0x7fc5d8131980 2023-09-30T22:28:03.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.408+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/3120830087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 msgr2=0x7fc5d8131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.408+0000 7fc5ddf3b700 1 --2- 172.21.15.154:0/3120830087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 0x7fc5d8131d50 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8006fd0 tx=0x7fc5c8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.408+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/3120830087 shutdown_connections 2023-09-30T22:28:03.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.408+0000 7fc5ddf3b700 1 --2- 172.21.15.154:0/3120830087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 0x7fc5d8131d50 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.408+0000 7fc5ddf3b700 1 --2- 172.21.15.154:0/3120830087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809bc70 0x7fc5d809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.408+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/3120830087 >> 172.21.15.154:0/3120830087 conn(0x7fc5d80a2980 msgr2=0x7fc5d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.408+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/3120830087 shutdown_connections 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.408+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/3120830087 wait complete. 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.409+0000 7fc5ddf3b700 1 Processor -- start 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.409+0000 7fc5ddf3b700 1 -- start start 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5ddf3b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5d809bc70 0x7fc5d811ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5ddf3b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809c5c0 0x7fc5d811cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5ddf3b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 0x7fc5d811d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5ddf3b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80a1c40 con 0x7fc5d8131980 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5ddf3b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d8130df0 con 0x7fc5d809c5c0 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5ddf3b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d811f460 con 0x7fc5d809bc70 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5d809bc70 0x7fc5d811ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d7fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 0x7fc5d811d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5d809bc70 0x7fc5d811ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54774/0 (socket says 172.21.15.154:54774) 2023-09-30T22:28:03.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d77fe700 1 -- 172.21.15.154:0/2479053109 learned_addr learned my addr 172.21.15.154:0/2479053109 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:03.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d6ffd700 1 --2- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809c5c0 0x7fc5d811cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d7fff700 1 -- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5d809bc70 msgr2=0x7fc5d811ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d7fff700 1 --2- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5d809bc70 0x7fc5d811ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d7fff700 1 -- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809c5c0 msgr2=0x7fc5d811cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d7fff700 1 --2- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809c5c0 0x7fc5d811cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d7fff700 1 -- 172.21.15.154:0/2479053109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8009500 con 0x7fc5d8131980 2023-09-30T22:28:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5d7fff700 1 --2- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 0x7fc5d811d4b0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000cb90 tx=0x7fc5d000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5bffff700 1 -- 172.21.15.154:0/2479053109 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0003c00 con 0x7fc5d8131980 2023-09-30T22:28:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5bffff700 1 -- 172.21.15.154:0/2479053109 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d0003d60 con 0x7fc5d8131980 2023-09-30T22:28:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/2479053109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d811fce0 con 0x7fc5d8131980 2023-09-30T22:28:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.410+0000 7fc5bffff700 1 -- 172.21.15.154:0/2479053109 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d000aaa0 con 0x7fc5d8131980 2023-09-30T22:28:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.411+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/2479053109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d8120ce0 con 0x7fc5d8131980 2023-09-30T22:28:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.411+0000 7fc5bffff700 1 -- 172.21.15.154:0/2479053109 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5d000ac00 con 0x7fc5d8131980 2023-09-30T22:28:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.411+0000 7fc5bffff700 1 -- 172.21.15.154:0/2479053109 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5d003f5f0 con 0x7fc5d8131980 2023-09-30T22:28:03.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.412+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/2479053109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d804f2a0 con 0x7fc5d8131980 2023-09-30T22:28:03.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.417+0000 7fc5bffff700 1 -- 172.21.15.154:0/2479053109 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5d00198f0 con 0x7fc5d8131980 2023-09-30T22:28:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.477+0000 7f1ff9e35700 1 -- 172.21.15.154:0/238485915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1ff404f2a0 con 0x7f1ff409e870 2023-09-30T22:28:03.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.478+0000 7f1fdbfff700 1 -- 172.21.15.154:0/238485915 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fe4021070 con 0x7f1ff409e870 2023-09-30T22:28:03.479 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.480+0000 7f1ff9e35700 1 -- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff409e870 msgr2=0x7f1ff411b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.480+0000 7f1ff9e35700 1 --2- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff409e870 0x7f1ff411b620 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400ebe0 tx=0x7f1fe400eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.480+0000 7f1ff9e35700 1 -- 172.21.15.154:0/238485915 shutdown_connections 2023-09-30T22:28:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.480+0000 7f1ff9e35700 1 --2- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1ff4131d70 0x7f1ff41c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.480+0000 7f1ff9e35700 1 --2- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff409e870 0x7f1ff411b620 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.480+0000 7f1ff9e35700 1 --2- 172.21.15.154:0/238485915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff409f180 0x7f1ff411bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.480+0000 7f1ff9e35700 1 -- 172.21.15.154:0/238485915 >> 172.21.15.154:0/238485915 conn(0x7f1ff40a4430 msgr2=0x7f1ff412fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.480+0000 7f1ff9e35700 1 -- 172.21.15.154:0/238485915 shutdown_connections 2023-09-30T22:28:03.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.480+0000 7f1ff9e35700 1 -- 172.21.15.154:0/238485915 wait complete. 2023-09-30T22:28:03.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:03.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.522+0000 7f3ba8dd7700 1 Processor -- start 2023-09-30T22:28:03.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.522+0000 7f3ba8dd7700 1 -- start start 2023-09-30T22:28:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba8dd7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba409d860 0x7f3ba409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba8dd7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba4130eb0 0x7f3ba4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba8dd7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba409aaa0 con 0x7f3ba409e170 2023-09-30T22:28:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba8dd7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba409f870 con 0x7f3ba409d860 2023-09-30T22:28:03.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba8dd7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba409b360 con 0x7f3ba4130eb0 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba4130eb0 0x7f3ba4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba1d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3ba409e170 0x7f3ba41307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35932/0 (socket says 172.21.15.154:35932) 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba1d9b700 1 -- 172.21.15.154:0/4078248907 learned_addr learned my addr 172.21.15.154:0/4078248907 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba259c700 1 --2- 172.21.15.154:0/4078248907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba409d860 0x7f3ba409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba159a700 1 -- 172.21.15.154:0/4078248907 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853914015 0 0) 0x7f3ba409aaa0 con 0x7f3ba409e170 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba159a700 1 -- 172.21.15.154:0/4078248907 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b8c0035b0 con 0x7f3ba409e170 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba259c700 1 -- 172.21.15.154:0/4078248907 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba4130eb0 msgr2=0x7f3ba4138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba259c700 1 --2- 172.21.15.154:0/4078248907 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba4130eb0 0x7f3ba4138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba259c700 1 -- 172.21.15.154:0/4078248907 >> v1:172.21.15.154:6789/0 conn(0x7f3ba409e170 legacy=0x7f3ba41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba259c700 1 -- 172.21.15.154:0/4078248907 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba409b620 con 0x7f3ba409d860 2023-09-30T22:28:03.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba2d9d700 1 --2- 172.21.15.154:0/4078248907 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba4130eb0 0x7f3ba4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba259c700 1 --2- 172.21.15.154:0/4078248907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba409d860 0x7f3ba409dc30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009870 tx=0x7f3b98009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=942d717b963763bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba159a700 1 -- 172.21.15.154:0/4078248907 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98011830 con 0x7f3ba409d860 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba159a700 1 -- 172.21.15.154:0/4078248907 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b98011990 con 0x7f3ba409d860 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.523+0000 7f3ba159a700 1 -- 172.21.15.154:0/4078248907 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98011d20 con 0x7f3ba409d860 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.524+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/4078248907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba409d860 msgr2=0x7f3ba409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.524+0000 7f3ba8dd7700 1 --2- 172.21.15.154:0/4078248907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba409d860 0x7f3ba409dc30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009870 tx=0x7f3b98009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.524+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/4078248907 shutdown_connections 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.524+0000 7f3ba8dd7700 1 --2- 172.21.15.154:0/4078248907 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba4130eb0 0x7f3ba4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.524+0000 7f3ba8dd7700 1 --2- 172.21.15.154:0/4078248907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba409d860 0x7f3ba409dc30 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.524+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/4078248907 >> 172.21.15.154:0/4078248907 conn(0x7f3ba4099c40 msgr2=0x7f3ba40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.524+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/4078248907 shutdown_connections 2023-09-30T22:28:03.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.524+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/4078248907 wait complete. 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.525+0000 7f3ba8dd7700 1 Processor -- start 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba8dd7700 1 -- start start 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba8dd7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba409d860 0x7f3ba4121660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba8dd7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ba409e170 0x7f3ba4121ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba8dd7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba4130eb0 0x7f3ba41220e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba8dd7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4123780 con 0x7f3ba409e170 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba8dd7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4122990 con 0x7f3ba4130eb0 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba8dd7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40a3460 con 0x7f3ba409d860 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba409d860 0x7f3ba4121660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba1d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ba409e170 0x7f3ba4121ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba409d860 0x7f3ba4121660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54800/0 (socket says 172.21.15.154:54800) 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba259c700 1 -- 172.21.15.154:0/135907639 learned_addr learned my addr 172.21.15.154:0/135907639 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.526+0000 7f3ba2d9d700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba4130eb0 0x7f3ba41220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba259c700 1 -- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba4130eb0 msgr2=0x7f3ba41220e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba259c700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba4130eb0 0x7f3ba41220e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba259c700 1 -- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ba409e170 msgr2=0x7f3ba4121ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba259c700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ba409e170 0x7f3ba4121ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba259c700 1 -- 172.21.15.154:0/135907639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c009a70 con 0x7f3ba409d860 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba2d9d700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba4130eb0 0x7f3ba41220e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba1d9b700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ba409e170 0x7f3ba4121ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:03.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba259c700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba409d860 0x7f3ba4121660 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3b980090b0 tx=0x7f3b98004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3b92ffd700 1 -- 172.21.15.154:0/135907639 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98004240 con 0x7f3ba409d860 2023-09-30T22:28:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3b92ffd700 1 -- 172.21.15.154:0/135907639 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9801f070 con 0x7f3ba409d860 2023-09-30T22:28:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/135907639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b980094a0 con 0x7f3ba409d860 2023-09-30T22:28:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3b92ffd700 1 -- 172.21.15.154:0/135907639 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980036a0 con 0x7f3ba409d860 2023-09-30T22:28:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.527+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/135907639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba4123a70 con 0x7f3ba409d860 2023-09-30T22:28:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.528+0000 7f3b92ffd700 1 -- 172.21.15.154:0/135907639 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b98021030 con 0x7f3ba409d860 2023-09-30T22:28:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.528+0000 7f3b92ffd700 1 -- 172.21.15.154:0/135907639 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b980405c0 con 0x7f3ba409d860 2023-09-30T22:28:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.528+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/135907639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba406b340 con 0x7f3ba409d860 2023-09-30T22:28:03.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.533+0000 7f3b92ffd700 1 -- 172.21.15.154:0/135907639 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b98015020 con 0x7f3ba409d860 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.614+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/2479053109 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5d806bce0 con 0x7fc5d8131980 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.614+0000 7fc5bffff700 1 -- 172.21.15.154:0/2479053109 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5d0019300 con 0x7fc5d8131980 2023-09-30T22:28:03.615 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.616+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 msgr2=0x7fc5d811d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.616+0000 7fc5ddf3b700 1 --2- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 0x7fc5d811d4b0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000cb90 tx=0x7fc5d000cea0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.616+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/2479053109 shutdown_connections 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.616+0000 7fc5ddf3b700 1 --2- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5d8131980 0x7fc5d811d4b0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.616+0000 7fc5ddf3b700 1 --2- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5d809bc70 0x7fc5d811ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.616+0000 7fc5ddf3b700 1 --2- 172.21.15.154:0/2479053109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5d809c5c0 0x7fc5d811cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.616+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/2479053109 >> 172.21.15.154:0/2479053109 conn(0x7fc5d80a2980 msgr2=0x7fc5d809f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.616+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/2479053109 shutdown_connections 2023-09-30T22:28:03.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.616+0000 7fc5ddf3b700 1 -- 172.21.15.154:0/2479053109 wait complete. 2023-09-30T22:28:03.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:03.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.722+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/135907639 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ba404f2a0 con 0x7f3ba409d860 2023-09-30T22:28:03.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.723+0000 7f3b92ffd700 1 -- 172.21.15.154:0/135907639 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b980239c0 con 0x7f3ba409d860 2023-09-30T22:28:03.724 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.725+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba409d860 msgr2=0x7f3ba4121660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.725+0000 7f3ba8dd7700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba409d860 0x7f3ba4121660 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3b980090b0 tx=0x7f3b98004750 comp rx=0 tx=0).stop 2023-09-30T22:28:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.725+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/135907639 shutdown_connections 2023-09-30T22:28:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.725+0000 7f3ba8dd7700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ba4130eb0 0x7f3ba41220e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.725+0000 7f3ba8dd7700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3ba409d860 0x7f3ba4121660 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.725+0000 7f3ba8dd7700 1 --2- 172.21.15.154:0/135907639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ba409e170 0x7f3ba4121ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.725+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/135907639 >> 172.21.15.154:0/135907639 conn(0x7f3ba4099c40 msgr2=0x7f3ba40a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.725+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/135907639 shutdown_connections 2023-09-30T22:28:03.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:03.725+0000 7f3ba8dd7700 1 -- 172.21.15.154:0/135907639 wait complete. 2023-09-30T22:28:03.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:04.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:04.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:04.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.545+0000 7f1560ba1700 1 Processor -- start 2023-09-30T22:28:04.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.545+0000 7f1560ba1700 1 -- start start 2023-09-30T22:28:04.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f1560ba1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c0a0a70 0x7f155c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f1560ba1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c134120 0x7f155c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f1560ba1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c09dc00 con 0x7f155c0a1380 2023-09-30T22:28:04.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f1560ba1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c09ea90 con 0x7f155c134120 2023-09-30T22:28:04.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f1560ba1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f155c09dec0 con 0x7f155c0a0a70 2023-09-30T22:28:04.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c0a0a70 0x7f155c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f1559d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f155c0a1380 0x7f155c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35948/0 (socket says 172.21.15.154:35948) 2023-09-30T22:28:04.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f1559d9b700 1 -- 172.21.15.154:0/3182542087 learned_addr learned my addr 172.21.15.154:0/3182542087 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:04.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155ad9d700 1 --2- 172.21.15.154:0/3182542087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c134120 0x7f155c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155959a700 1 -- 172.21.15.154:0/3182542087 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777815160 0 0) 0x7f155c09dc00 con 0x7f155c0a1380 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155959a700 1 -- 172.21.15.154:0/3182542087 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15440035b0 con 0x7f155c0a1380 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155a59c700 1 -- 172.21.15.154:0/3182542087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c134120 msgr2=0x7f155c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155a59c700 1 --2- 172.21.15.154:0/3182542087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c134120 0x7f155c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155a59c700 1 -- 172.21.15.154:0/3182542087 >> v1:172.21.15.154:6789/0 conn(0x7f155c0a1380 legacy=0x7f155c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155a59c700 1 -- 172.21.15.154:0/3182542087 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c09e6a0 con 0x7f155c0a0a70 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155ad9d700 1 --2- 172.21.15.154:0/3182542087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c134120 0x7f155c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155a59c700 1 --2- 172.21.15.154:0/3182542087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c0a0a70 0x7f155c0a0e40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f154c009870 tx=0x7f154c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83ff2e5f3c805766 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155959a700 1 -- 172.21.15.154:0/3182542087 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c011830 con 0x7f155c0a0a70 2023-09-30T22:28:04.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155959a700 1 -- 172.21.15.154:0/3182542087 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c011990 con 0x7f155c0a0a70 2023-09-30T22:28:04.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.546+0000 7f155959a700 1 -- 172.21.15.154:0/3182542087 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c011d00 con 0x7f155c0a0a70 2023-09-30T22:28:04.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.547+0000 7f1560ba1700 1 -- 172.21.15.154:0/3182542087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c0a0a70 msgr2=0x7f155c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.547+0000 7f1560ba1700 1 --2- 172.21.15.154:0/3182542087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c0a0a70 0x7f155c0a0e40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f154c009870 tx=0x7f154c009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:04.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.547+0000 7f1560ba1700 1 -- 172.21.15.154:0/3182542087 shutdown_connections 2023-09-30T22:28:04.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.547+0000 7f1560ba1700 1 --2- 172.21.15.154:0/3182542087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c134120 0x7f155c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.547+0000 7f1560ba1700 1 --2- 172.21.15.154:0/3182542087 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c0a0a70 0x7f155c0a0e40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.547+0000 7f1560ba1700 1 -- 172.21.15.154:0/3182542087 >> 172.21.15.154:0/3182542087 conn(0x7f155c0a6610 msgr2=0x7f155c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.547+0000 7f1560ba1700 1 -- 172.21.15.154:0/3182542087 shutdown_connections 2023-09-30T22:28:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.547+0000 7f1560ba1700 1 -- 172.21.15.154:0/3182542087 wait complete. 2023-09-30T22:28:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.548+0000 7f1560ba1700 1 Processor -- start 2023-09-30T22:28:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.548+0000 7f1560ba1700 1 -- start start 2023-09-30T22:28:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1560ba1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c0a0a70 0x7f155c1232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1560ba1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0a1380 0x7f155c123820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1560ba1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c134120 0x7f155c1c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1560ba1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c124f10 con 0x7f155c0a1380 2023-09-30T22:28:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1560ba1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c126530 con 0x7f155c0a0a70 2023-09-30T22:28:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1560ba1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f155c122ef0 con 0x7f155c134120 2023-09-30T22:28:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1559d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0a1380 0x7f155c123820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f155a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c0a0a70 0x7f155c1232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1559d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0a1380 0x7f155c123820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37372/0 (socket says 172.21.15.154:37372) 2023-09-30T22:28:04.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1559d9b700 1 -- 172.21.15.154:0/1627043592 learned_addr learned my addr 172.21.15.154:0/1627043592 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:04.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f155a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c0a0a70 0x7f155c1232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56218/0 (socket says 172.21.15.154:56218) 2023-09-30T22:28:04.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f155ad9d700 1 --2- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c134120 0x7f155c1c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1559d9b700 1 -- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c134120 msgr2=0x7f155c1c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1559d9b700 1 --2- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c134120 0x7f155c1c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1559d9b700 1 -- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c0a0a70 msgr2=0x7f155c1232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1559d9b700 1 --2- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c0a0a70 0x7f155c1232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1559d9b700 1 -- 172.21.15.154:0/1627043592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1554009a70 con 0x7f155c0a1380 2023-09-30T22:28:04.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f155a59c700 1 --2- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c0a0a70 0x7f155c1232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1559d9b700 1 --2- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0a1380 0x7f155c123820 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f155000c700 tx=0x7f155000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f154affd700 1 -- 172.21.15.154:0/1627043592 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550005d70 con 0x7f155c0a1380 2023-09-30T22:28:04.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f154affd700 1 -- 172.21.15.154:0/1627043592 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15500070d0 con 0x7f155c0a1380 2023-09-30T22:28:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f154affd700 1 -- 172.21.15.154:0/1627043592 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550007460 con 0x7f155c0a1380 2023-09-30T22:28:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.549+0000 7f1560ba1700 1 -- 172.21.15.154:0/1627043592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c0094a0 con 0x7f155c0a1380 2023-09-30T22:28:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.550+0000 7f1560ba1700 1 -- 172.21.15.154:0/1627043592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c124b70 con 0x7f155c0a1380 2023-09-30T22:28:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.550+0000 7f154affd700 1 -- 172.21.15.154:0/1627043592 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15500075c0 con 0x7f155c0a1380 2023-09-30T22:28:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.550+0000 7f154affd700 1 -- 172.21.15.154:0/1627043592 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f155003eba0 con 0x7f155c0a1380 2023-09-30T22:28:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.550+0000 7f1560ba1700 1 -- 172.21.15.154:0/1627043592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c09d0c0 con 0x7f155c0a1380 2023-09-30T22:28:04.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.556+0000 7f154affd700 1 -- 172.21.15.154:0/1627043592 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1550017020 con 0x7f155c0a1380 2023-09-30T22:28:04.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.620+0000 7f44b344f700 1 Processor -- start 2023-09-30T22:28:04.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.620+0000 7f44b344f700 1 -- start start 2023-09-30T22:28:04.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b344f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44ac098410 0x7f44ac0987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b344f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac09e440 0x7f44ac1397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b344f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac06f970 con 0x7f44ac09d8f0 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b344f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac0720a0 con 0x7f44ac098410 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b344f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac072290 con 0x7f44ac09e440 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b19ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac09e440 0x7f44ac1397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b11eb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44ac098410 0x7f44ac0987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b11eb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44ac098410 0x7f44ac0987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37380/0 (socket says 172.21.15.154:37380) 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b19ec700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac09e440 0x7f44ac1397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54830/0 (socket says 172.21.15.154:54830) 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b11eb700 1 -- 172.21.15.154:0/402486375 learned_addr learned my addr 172.21.15.154:0/402486375 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:04.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b11eb700 1 -- 172.21.15.154:0/402486375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac09e440 msgr2=0x7f44ac1397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b11eb700 1 --2- 172.21.15.154:0/402486375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac09e440 0x7f44ac1397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b11eb700 1 -- 172.21.15.154:0/402486375 >> v1:172.21.15.154:6789/0 conn(0x7f44ac09d8f0 legacy=0x7f44ac09dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b11eb700 1 -- 172.21.15.154:0/402486375 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac071530 con 0x7f44ac098410 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44a3fff700 1 -- 172.21.15.154:0/402486375 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959104174 0 0) 0x7f44ac06f970 con 0x7f44ac09d8f0 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.621+0000 7f44b19ec700 1 --2- 172.21.15.154:0/402486375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac09e440 0x7f44ac1397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44b11eb700 1 --2- 172.21.15.154:0/402486375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac098410 0x7f44ac0987e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f44a8006fd0 tx=0x7f44a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa4665d33e8810b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44a3fff700 1 -- 172.21.15.154:0/402486375 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8005e30 con 0x7f44ac098410 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44a3fff700 1 -- 172.21.15.154:0/402486375 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8004030 con 0x7f44ac098410 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44a3fff700 1 -- 172.21.15.154:0/402486375 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a80043e0 con 0x7f44ac098410 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44b344f700 1 -- 172.21.15.154:0/402486375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac098410 msgr2=0x7f44ac0987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44b344f700 1 --2- 172.21.15.154:0/402486375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac098410 0x7f44ac0987e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f44a8006fd0 tx=0x7f44a8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44b344f700 1 -- 172.21.15.154:0/402486375 shutdown_connections 2023-09-30T22:28:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44b344f700 1 --2- 172.21.15.154:0/402486375 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac09e440 0x7f44ac1397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44b344f700 1 --2- 172.21.15.154:0/402486375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac098410 0x7f44ac0987e0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44b344f700 1 -- 172.21.15.154:0/402486375 >> 172.21.15.154:0/402486375 conn(0x7f44ac0a2b30 msgr2=0x7f44ac09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44b344f700 1 -- 172.21.15.154:0/402486375 shutdown_connections 2023-09-30T22:28:04.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.622+0000 7f44b344f700 1 -- 172.21.15.154:0/402486375 wait complete. 2023-09-30T22:28:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.623+0000 7f44b344f700 1 Processor -- start 2023-09-30T22:28:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.623+0000 7f44b344f700 1 -- start start 2023-09-30T22:28:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b344f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac098410 0x7f44ac06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b344f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac09d8f0 0x7f44ac06dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b344f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44ac09e440 0x7f44ac06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b344f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac06f170 con 0x7f44ac09d8f0 2023-09-30T22:28:04.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b344f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac12aff0 con 0x7f44ac09e440 2023-09-30T22:28:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b344f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac12b7a0 con 0x7f44ac098410 2023-09-30T22:28:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b09ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac09d8f0 0x7f44ac06dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b09ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac09d8f0 0x7f44ac06dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37388/0 (socket says 172.21.15.154:37388) 2023-09-30T22:28:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b09ea700 1 -- 172.21.15.154:0/3183669119 learned_addr learned my addr 172.21.15.154:0/3183669119 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b11eb700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac098410 0x7f44ac06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b19ec700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44ac09e440 0x7f44ac06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b09ea700 1 -- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac098410 msgr2=0x7f44ac06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b09ea700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac098410 0x7f44ac06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b09ea700 1 -- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44ac09e440 msgr2=0x7f44ac06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b09ea700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44ac09e440 0x7f44ac06e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b09ea700 1 -- 172.21.15.154:0/3183669119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a4009a70 con 0x7f44ac09d8f0 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b11eb700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac098410 0x7f44ac06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b19ec700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44ac09e440 0x7f44ac06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44b09ea700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac09d8f0 0x7f44ac06dbf0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f449c001eb0 tx=0x7f449c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.624+0000 7f44a1ffb700 1 -- 172.21.15.154:0/3183669119 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0054e0 con 0x7f44ac09d8f0 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.625+0000 7f44a1ffb700 1 -- 172.21.15.154:0/3183669119 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00ce90 con 0x7f44ac09d8f0 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.625+0000 7f44b344f700 1 -- 172.21.15.154:0/3183669119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a8009500 con 0x7f44ac09d8f0 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.625+0000 7f44a1ffb700 1 -- 172.21.15.154:0/3183669119 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c003880 con 0x7f44ac09d8f0 2023-09-30T22:28:04.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.625+0000 7f44b344f700 1 -- 172.21.15.154:0/3183669119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac070880 con 0x7f44ac09d8f0 2023-09-30T22:28:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.625+0000 7f44a1ffb700 1 -- 172.21.15.154:0/3183669119 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f449c0039e0 con 0x7f44ac09d8f0 2023-09-30T22:28:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.625+0000 7f44a1ffb700 1 -- 172.21.15.154:0/3183669119 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f449c03e9e0 con 0x7f44ac09d8f0 2023-09-30T22:28:04.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.626+0000 7f44b344f700 1 -- 172.21.15.154:0/3183669119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac04f2a0 con 0x7f44ac09d8f0 2023-09-30T22:28:04.633 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:04.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.630+0000 7f44a1ffb700 1 -- 172.21.15.154:0/3183669119 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f449c0196d0 con 0x7f44ac09d8f0 2023-09-30T22:28:04.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:04.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.756+0000 7f1560ba1700 1 -- 172.21.15.154:0/1627043592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f155c0746f0 con 0x7f155c0a1380 2023-09-30T22:28:04.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.756+0000 7f1fbcda9700 1 Processor -- start 2023-09-30T22:28:04.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.757+0000 7f1fbcda9700 1 -- start start 2023-09-30T22:28:04.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.757+0000 7f154affd700 1 -- 172.21.15.154:0/1627043592 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f155000f260 con 0x7f155c0a1380 2023-09-30T22:28:04.759 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.757+0000 7f1fbcda9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fb8133ad0 0x7f1fb8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.757+0000 7f1fbcda9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1fb8130bc0 0x7f1fb813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.757+0000 7f1fbcda9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb806b2d0 con 0x7f1fb81300a0 2023-09-30T22:28:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.757+0000 7f1fbcda9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb8133610 con 0x7f1fb8130bc0 2023-09-30T22:28:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.757+0000 7f1fbcda9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb809a500 con 0x7f1fb8133ad0 2023-09-30T22:28:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.757+0000 7f1fb5d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1fb81300a0 0x7f1fb81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35966/0 (socket says 172.21.15.154:35966) 2023-09-30T22:28:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.757+0000 7f1fb5d9b700 1 -- 172.21.15.154:0/2078575435 learned_addr learned my addr 172.21.15.154:0/2078575435 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb659c700 1 --2- 172.21.15.154:0/2078575435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fb8133ad0 0x7f1fb8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb6d9d700 1 --2- 172.21.15.154:0/2078575435 >> v2:172.21.15.154:3300/0 conn(0x7f1fb8130bc0 0x7f1fb813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb559a700 1 -- 172.21.15.154:0/2078575435 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260204084 0 0) 0x7f1fb806b2d0 con 0x7f1fb81300a0 2023-09-30T22:28:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb559a700 1 -- 172.21.15.154:0/2078575435 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa00035b0 con 0x7f1fb81300a0 2023-09-30T22:28:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb6d9d700 1 -- 172.21.15.154:0/2078575435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fb8133ad0 msgr2=0x7f1fb8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb6d9d700 1 --2- 172.21.15.154:0/2078575435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fb8133ad0 0x7f1fb8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb6d9d700 1 -- 172.21.15.154:0/2078575435 >> v1:172.21.15.154:6789/0 conn(0x7f1fb81300a0 legacy=0x7f1fb81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb6d9d700 1 -- 172.21.15.154:0/2078575435 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb81338b0 con 0x7f1fb8130bc0 2023-09-30T22:28:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb6d9d700 1 --2- 172.21.15.154:0/2078575435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 0x7f1fb813b990 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009d90 tx=0x7f1fb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c020747924feeb8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb559a700 1 -- 172.21.15.154:0/2078575435 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb000e070 con 0x7f1fb8130bc0 2023-09-30T22:28:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb559a700 1 -- 172.21.15.154:0/2078575435 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb000bb20 con 0x7f1fb8130bc0 2023-09-30T22:28:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.758+0000 7f1fb559a700 1 -- 172.21.15.154:0/2078575435 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0012430 con 0x7f1fb8130bc0 2023-09-30T22:28:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.759+0000 7f1fbcda9700 1 -- 172.21.15.154:0/2078575435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 msgr2=0x7f1fb813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.759+0000 7f1fbcda9700 1 --2- 172.21.15.154:0/2078575435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 0x7f1fb813b990 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009d90 tx=0x7f1fb000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.759+0000 7f1fbcda9700 1 -- 172.21.15.154:0/2078575435 shutdown_connections 2023-09-30T22:28:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.759+0000 7f1fbcda9700 1 --2- 172.21.15.154:0/2078575435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 0x7f1fb813b990 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.759+0000 7f1fbcda9700 1 --2- 172.21.15.154:0/2078575435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fb8133ad0 0x7f1fb8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.759+0000 7f1fbcda9700 1 -- 172.21.15.154:0/2078575435 >> 172.21.15.154:0/2078575435 conn(0x7f1fb8099c40 msgr2=0x7f1fb80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.759+0000 7f1fbcda9700 1 -- 172.21.15.154:0/2078575435 shutdown_connections 2023-09-30T22:28:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.759+0000 7f1fbcda9700 1 -- 172.21.15.154:0/2078575435 wait complete. 2023-09-30T22:28:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.760+0000 7f1560ba1700 1 -- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0a1380 msgr2=0x7f155c123820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.760+0000 7f1560ba1700 1 --2- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0a1380 0x7f155c123820 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f155000c700 tx=0x7f155000ca10 comp rx=0 tx=0).stop 2023-09-30T22:28:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.760+0000 7f1560ba1700 1 -- 172.21.15.154:0/1627043592 shutdown_connections 2023-09-30T22:28:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.760+0000 7f1560ba1700 1 --2- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f155c134120 0x7f155c1c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.760+0000 7f1560ba1700 1 --2- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155c0a0a70 0x7f155c1232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.760+0000 7f1560ba1700 1 --2- 172.21.15.154:0/1627043592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155c0a1380 0x7f155c123820 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.760+0000 7f1560ba1700 1 -- 172.21.15.154:0/1627043592 >> 172.21.15.154:0/1627043592 conn(0x7f155c0a6610 msgr2=0x7f155c0a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.760+0000 7f1560ba1700 1 -- 172.21.15.154:0/1627043592 shutdown_connections 2023-09-30T22:28:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.760+0000 7f1560ba1700 1 -- 172.21.15.154:0/1627043592 wait complete. 2023-09-30T22:28:04.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fbcda9700 1 Processor -- start 2023-09-30T22:28:04.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fbcda9700 1 -- start start 2023-09-30T22:28:04.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fbcda9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fb81300a0 0x7f1fb8071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fbcda9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 0x7f1fb8071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fbcda9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fb8133ad0 0x7f1fb8071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fbcda9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb811fc10 con 0x7f1fb8130bc0 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fbcda9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb811e0f0 con 0x7f1fb8133ad0 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fbcda9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80a3400 con 0x7f1fb81300a0 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fb5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 0x7f1fb8071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fb5d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 0x7f1fb8071890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37404/0 (socket says 172.21.15.154:37404) 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.761+0000 7f1fb5d9b700 1 -- 172.21.15.154:0/4253347114 learned_addr learned my addr 172.21.15.154:0/4253347114 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fb5d9b700 1 -- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fb81300a0 msgr2=0x7f1fb8071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fb5d9b700 1 --2- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fb81300a0 0x7f1fb8071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fb5d9b700 1 -- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fb8133ad0 msgr2=0x7f1fb8071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fb5d9b700 1 --2- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fb8133ad0 0x7f1fb8071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fb5d9b700 1 -- 172.21.15.154:0/4253347114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0009a70 con 0x7f1fb8130bc0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fb5d9b700 1 --2- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 0x7f1fb8071890 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f1fac005910 tx=0x7f1fac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fa6ffd700 1 -- 172.21.15.154:0/4253347114 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac005d70 con 0x7f1fb8130bc0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fa6ffd700 1 -- 172.21.15.154:0/4253347114 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac0070d0 con 0x7f1fb8130bc0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fbcda9700 1 -- 172.21.15.154:0/4253347114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb812dd00 con 0x7f1fb8130bc0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fa6ffd700 1 -- 172.21.15.154:0/4253347114 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac007440 con 0x7f1fb8130bc0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.762+0000 7f1fbcda9700 1 -- 172.21.15.154:0/4253347114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb811fef0 con 0x7f1fb8130bc0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.763+0000 7f1fa6ffd700 1 -- 172.21.15.154:0/4253347114 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fac0075a0 con 0x7f1fb8130bc0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.763+0000 7f1fbcda9700 1 -- 172.21.15.154:0/4253347114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb806be10 con 0x7f1fb8130bc0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.764+0000 7f1fa6ffd700 1 -- 172.21.15.154:0/4253347114 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fac03eca0 con 0x7f1fb8130bc0 2023-09-30T22:28:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.769+0000 7f1fa6ffd700 1 -- 172.21.15.154:0/4253347114 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fac019d20 con 0x7f1fb8130bc0 2023-09-30T22:28:04.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:04.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.832+0000 7f44b344f700 1 -- 172.21.15.154:0/3183669119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f44ac06b2a0 con 0x7f44ac09d8f0 2023-09-30T22:28:04.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.832+0000 7f44a1ffb700 1 -- 172.21.15.154:0/3183669119 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f449c017020 con 0x7f44ac09d8f0 2023-09-30T22:28:04.834 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:04.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.835+0000 7f44b344f700 1 -- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac09d8f0 msgr2=0x7f44ac06dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.835+0000 7f44b344f700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac09d8f0 0x7f44ac06dbf0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f449c001eb0 tx=0x7f449c00c800 comp rx=0 tx=0).stop 2023-09-30T22:28:04.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.835+0000 7f44b344f700 1 -- 172.21.15.154:0/3183669119 shutdown_connections 2023-09-30T22:28:04.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.835+0000 7f44b344f700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44ac09e440 0x7f44ac06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.835+0000 7f44b344f700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f44ac098410 0x7f44ac06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.835+0000 7f44b344f700 1 --2- 172.21.15.154:0/3183669119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44ac09d8f0 0x7f44ac06dbf0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.835+0000 7f44b344f700 1 -- 172.21.15.154:0/3183669119 >> 172.21.15.154:0/3183669119 conn(0x7f44ac0a2b30 msgr2=0x7f44ac130760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.835+0000 7f44b344f700 1 -- 172.21.15.154:0/3183669119 shutdown_connections 2023-09-30T22:28:04.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.835+0000 7f44b344f700 1 -- 172.21.15.154:0/3183669119 wait complete. 2023-09-30T22:28:04.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:04.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.867+0000 7f598bbf3700 1 Processor -- start 2023-09-30T22:28:04.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.867+0000 7f598bbf3700 1 -- start start 2023-09-30T22:28:04.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598bbf3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409d860 0x7f598409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598bbf3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f5984138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598bbf3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598409aaa0 con 0x7f598409e170 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598bbf3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598409f870 con 0x7f5984130eb0 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598bbf3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f598409b360 con 0x7f598409d860 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598998f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409d860 0x7f598409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598918e700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f598409e170 0x7f59841307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35974/0 (socket says 172.21.15.154:35974) 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598a190700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f5984138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598918e700 1 -- 172.21.15.154:0/2597434075 learned_addr learned my addr 172.21.15.154:0/2597434075 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598898d700 1 -- 172.21.15.154:0/2597434075 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943278915 0 0) 0x7f598409aaa0 con 0x7f598409e170 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598a190700 1 -- 172.21.15.154:0/2597434075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409d860 msgr2=0x7f598409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598a190700 1 --2- 172.21.15.154:0/2597434075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409d860 0x7f598409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598a190700 1 -- 172.21.15.154:0/2597434075 >> v1:172.21.15.154:6789/0 conn(0x7f598409e170 legacy=0x7f59841307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598a190700 1 -- 172.21.15.154:0/2597434075 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598409b620 con 0x7f5984130eb0 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.868+0000 7f598998f700 1 --2- 172.21.15.154:0/2597434075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409d860 0x7f598409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598a190700 1 --2- 172.21.15.154:0/2597434075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f5984138a00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f597c009dc0 tx=0x7f597c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c10eae5653fc6e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598898d700 1 -- 172.21.15.154:0/2597434075 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c00e070 con 0x7f5984130eb0 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598898d700 1 -- 172.21.15.154:0/2597434075 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c00bb20 con 0x7f5984130eb0 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598898d700 1 -- 172.21.15.154:0/2597434075 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c012430 con 0x7f5984130eb0 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598bbf3700 1 -- 172.21.15.154:0/2597434075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 msgr2=0x7f5984138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598bbf3700 1 --2- 172.21.15.154:0/2597434075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f5984138a00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f597c009dc0 tx=0x7f597c00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598bbf3700 1 -- 172.21.15.154:0/2597434075 shutdown_connections 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598bbf3700 1 --2- 172.21.15.154:0/2597434075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f5984138a00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598bbf3700 1 --2- 172.21.15.154:0/2597434075 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409d860 0x7f598409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598bbf3700 1 -- 172.21.15.154:0/2597434075 >> 172.21.15.154:0/2597434075 conn(0x7f5984099c40 msgr2=0x7f59840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598bbf3700 1 -- 172.21.15.154:0/2597434075 shutdown_connections 2023-09-30T22:28:04.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.869+0000 7f598bbf3700 1 -- 172.21.15.154:0/2597434075 wait complete. 2023-09-30T22:28:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.870+0000 7f598bbf3700 1 Processor -- start 2023-09-30T22:28:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.870+0000 7f598bbf3700 1 -- start start 2023-09-30T22:28:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598bbf3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598409d860 0x7f598411e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598bbf3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409e170 0x7f598411e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598bbf3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f598411ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598bbf3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5984121f20 con 0x7f598409d860 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598bbf3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5984121610 con 0x7f5984130eb0 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598bbf3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59840a07e0 con 0x7f598409e170 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598998f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598409d860 0x7f598411e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598a190700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f598411ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598998f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598409d860 0x7f598411e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37412/0 (socket says 172.21.15.154:37412) 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598998f700 1 -- 172.21.15.154:0/3076160123 learned_addr learned my addr 172.21.15.154:0/3076160123 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598a190700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f598411ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:56260/0 (socket says 172.21.15.154:56260) 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598918e700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409e170 0x7f598411e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598998f700 1 -- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409e170 msgr2=0x7f598411e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598998f700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409e170 0x7f598411e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598998f700 1 -- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 msgr2=0x7f598411ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598998f700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f598411ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598998f700 1 -- 172.21.15.154:0/3076160123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597400b740 con 0x7f598409d860 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598a190700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f598411ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598918e700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409e170 0x7f598411e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598998f700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598409d860 0x7f598411e360 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f5974010f50 tx=0x7f597400e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f597a7fc700 1 -- 172.21.15.154:0/3076160123 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974011650 con 0x7f598409d860 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f597a7fc700 1 -- 172.21.15.154:0/3076160123 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59740117b0 con 0x7f598409d860 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f598bbf3700 1 -- 172.21.15.154:0/3076160123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c009a70 con 0x7f598409d860 2023-09-30T22:28:04.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.871+0000 7f597a7fc700 1 -- 172.21.15.154:0/3076160123 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974011b40 con 0x7f598409d860 2023-09-30T22:28:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.872+0000 7f598bbf3700 1 -- 172.21.15.154:0/3076160123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5984121ba0 con 0x7f598409d860 2023-09-30T22:28:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.873+0000 7f598bbf3700 1 -- 172.21.15.154:0/3076160123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598404f2a0 con 0x7f598409d860 2023-09-30T22:28:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.873+0000 7f597a7fc700 1 -- 172.21.15.154:0/3076160123 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5974011ca0 con 0x7f598409d860 2023-09-30T22:28:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.873+0000 7f597a7fc700 1 -- 172.21.15.154:0/3076160123 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5974042420 con 0x7f598409d860 2023-09-30T22:28:04.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.877+0000 7f597a7fc700 1 -- 172.21.15.154:0/3076160123 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59740183a0 con 0x7f598409d860 2023-09-30T22:28:04.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.967+0000 7f1fbcda9700 1 -- 172.21.15.154:0/4253347114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1fb80a2620 con 0x7f1fb8130bc0 2023-09-30T22:28:04.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.967+0000 7f1fa6ffd700 1 -- 172.21.15.154:0/4253347114 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fac017090 con 0x7f1fb8130bc0 2023-09-30T22:28:04.968 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:04.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.969+0000 7f1fbcda9700 1 -- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 msgr2=0x7f1fb8071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.969+0000 7f1fbcda9700 1 --2- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 0x7f1fb8071890 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f1fac005910 tx=0x7f1fac00c860 comp rx=0 tx=0).stop 2023-09-30T22:28:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.969+0000 7f1fbcda9700 1 -- 172.21.15.154:0/4253347114 shutdown_connections 2023-09-30T22:28:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.969+0000 7f1fbcda9700 1 --2- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fb8133ad0 0x7f1fb8071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.969+0000 7f1fbcda9700 1 --2- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1fb81300a0 0x7f1fb8071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.969+0000 7f1fbcda9700 1 --2- 172.21.15.154:0/4253347114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8130bc0 0x7f1fb8071890 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.969+0000 7f1fbcda9700 1 -- 172.21.15.154:0/4253347114 >> 172.21.15.154:0/4253347114 conn(0x7f1fb8099c40 msgr2=0x7f1fb8132aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.969+0000 7f1fbcda9700 1 -- 172.21.15.154:0/4253347114 shutdown_connections 2023-09-30T22:28:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:04.969+0000 7f1fbcda9700 1 -- 172.21.15.154:0/4253347114 wait complete. 2023-09-30T22:28:04.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:05.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.068+0000 7f598bbf3700 1 -- 172.21.15.154:0/3076160123 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f598406c3b0 con 0x7f598409d860 2023-09-30T22:28:05.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.069+0000 7f597a7fc700 1 -- 172.21.15.154:0/3076160123 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f597401e070 con 0x7f598409d860 2023-09-30T22:28:05.069 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:05.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.071+0000 7f598bbf3700 1 -- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598409d860 msgr2=0x7f598411e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.071+0000 7f598bbf3700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598409d860 0x7f598411e360 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f5974010f50 tx=0x7f597400e640 comp rx=0 tx=0).stop 2023-09-30T22:28:05.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.071+0000 7f598bbf3700 1 -- 172.21.15.154:0/3076160123 shutdown_connections 2023-09-30T22:28:05.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.071+0000 7f598bbf3700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5984130eb0 0x7f598411ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.071+0000 7f598bbf3700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f598409d860 0x7f598411e360 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.071+0000 7f598bbf3700 1 --2- 172.21.15.154:0/3076160123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f598409e170 0x7f598411e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.071+0000 7f598bbf3700 1 -- 172.21.15.154:0/3076160123 >> 172.21.15.154:0/3076160123 conn(0x7f5984099c40 msgr2=0x7f59840a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.071+0000 7f598bbf3700 1 -- 172.21.15.154:0/3076160123 shutdown_connections 2023-09-30T22:28:05.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.071+0000 7f598bbf3700 1 -- 172.21.15.154:0/3076160123 wait complete. 2023-09-30T22:28:05.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:05.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:05.849 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:05.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.915+0000 7f4b2fddc700 1 Processor -- start 2023-09-30T22:28:05.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2fddc700 1 -- start start 2023-09-30T22:28:05.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2fddc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b2809ad40 0x7f4b28133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2fddc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b28133f70 0x7f4b281343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2fddc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b280a0a70 0x7f4b280a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2fddc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b280a3b60 con 0x7f4b2809ad40 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2fddc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b281348e0 con 0x7f4b280a0a70 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2fddc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2809b110 con 0x7f4b28133f70 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2d377700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b28133f70 0x7f4b281343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2db78700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b2809ad40 0x7f4b28133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2d377700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b28133f70 0x7f4b281343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44036/0 (socket says 172.21.15.154:44036) 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2d377700 1 -- 172.21.15.154:0/3264841418 learned_addr learned my addr 172.21.15.154:0/3264841418 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.916+0000 7f4b2e379700 1 --2- 172.21.15.154:0/3264841418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b280a0a70 0x7f4b280a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2d377700 1 -- 172.21.15.154:0/3264841418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b280a0a70 msgr2=0x7f4b280a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2d377700 1 --2- 172.21.15.154:0/3264841418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b280a0a70 0x7f4b280a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2d377700 1 -- 172.21.15.154:0/3264841418 >> v2:172.21.15.154:3300/0 conn(0x7f4b2809ad40 msgr2=0x7f4b28133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2d377700 1 --2- 172.21.15.154:0/3264841418 >> v2:172.21.15.154:3300/0 conn(0x7f4b2809ad40 0x7f4b28133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2d377700 1 -- 172.21.15.154:0/3264841418 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b280a2fa0 con 0x7f4b28133f70 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2db78700 1 --2- 172.21.15.154:0/3264841418 >> v2:172.21.15.154:3300/0 conn(0x7f4b2809ad40 0x7f4b28133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2d377700 1 --2- 172.21.15.154:0/3264841418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b28133f70 0x7f4b281343a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009920 tx=0x7f4b18009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13415e430421ddc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2cb76700 1 -- 172.21.15.154:0/3264841418 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18011830 con 0x7f4b28133f70 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2cb76700 1 -- 172.21.15.154:0/3264841418 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18011990 con 0x7f4b28133f70 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.917+0000 7f4b2cb76700 1 -- 172.21.15.154:0/3264841418 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18011d20 con 0x7f4b28133f70 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.918+0000 7f4b2fddc700 1 -- 172.21.15.154:0/3264841418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b28133f70 msgr2=0x7f4b281343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.918+0000 7f4b2fddc700 1 --2- 172.21.15.154:0/3264841418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b28133f70 0x7f4b281343a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009920 tx=0x7f4b18009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:05.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.918+0000 7f4b2fddc700 1 -- 172.21.15.154:0/3264841418 shutdown_connections 2023-09-30T22:28:05.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.918+0000 7f4b2fddc700 1 --2- 172.21.15.154:0/3264841418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b280a0a70 0x7f4b280a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.918+0000 7f4b2fddc700 1 --2- 172.21.15.154:0/3264841418 >> v2:172.21.15.154:3300/0 conn(0x7f4b2809ad40 0x7f4b28133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.918+0000 7f4b2fddc700 1 --2- 172.21.15.154:0/3264841418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b28133f70 0x7f4b281343a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.918+0000 7f4b2fddc700 1 -- 172.21.15.154:0/3264841418 >> 172.21.15.154:0/3264841418 conn(0x7f4b28099c40 msgr2=0x7f4b2806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.918+0000 7f4b2fddc700 1 -- 172.21.15.154:0/3264841418 shutdown_connections 2023-09-30T22:28:05.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.918+0000 7f4b2fddc700 1 -- 172.21.15.154:0/3264841418 wait complete. 2023-09-30T22:28:05.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2fddc700 1 Processor -- start 2023-09-30T22:28:05.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2fddc700 1 -- start start 2023-09-30T22:28:05.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2fddc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2809ad40 0x7f4b281c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2fddc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b280a0a70 0x7f4b281c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2fddc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b28133f70 0x7f4b281c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2fddc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28122330 con 0x7f4b2809ad40 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2fddc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28133820 con 0x7f4b28133f70 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2fddc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28122070 con 0x7f4b280a0a70 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2db78700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2809ad40 0x7f4b281c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2db78700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2809ad40 0x7f4b281c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58406/0 (socket says 172.21.15.154:58406) 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2e379700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b28133f70 0x7f4b281c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2db78700 1 -- 172.21.15.154:0/2784777749 learned_addr learned my addr 172.21.15.154:0/2784777749 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2d377700 1 --2- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b280a0a70 0x7f4b281c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2e379700 1 -- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b280a0a70 msgr2=0x7f4b281c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2e379700 1 --2- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b280a0a70 0x7f4b281c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2e379700 1 -- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2809ad40 msgr2=0x7f4b281c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.919+0000 7f4b2e379700 1 --2- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2809ad40 0x7f4b281c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.920+0000 7f4b2e379700 1 -- 172.21.15.154:0/2784777749 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240094a0 con 0x7f4b28133f70 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.920+0000 7f4b2e379700 1 --2- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b28133f70 0x7f4b281c8d80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000efc0 tx=0x7f4b2000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.920+0000 7f4b1e7fc700 1 -- 172.21.15.154:0/2784777749 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000cc90 con 0x7f4b28133f70 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.920+0000 7f4b1e7fc700 1 -- 172.21.15.154:0/2784777749 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2000f040 con 0x7f4b28133f70 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.920+0000 7f4b2fddc700 1 -- 172.21.15.154:0/2784777749 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b18009550 con 0x7f4b28133f70 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.920+0000 7f4b1e7fc700 1 -- 172.21.15.154:0/2784777749 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b200146c0 con 0x7f4b28133f70 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.920+0000 7f4b2fddc700 1 -- 172.21.15.154:0/2784777749 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b28122da0 con 0x7f4b28133f70 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.921+0000 7f4b2fddc700 1 -- 172.21.15.154:0/2784777749 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b28122570 con 0x7f4b28133f70 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.922+0000 7f4b1e7fc700 1 -- 172.21.15.154:0/2784777749 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b20014820 con 0x7f4b28133f70 2023-09-30T22:28:05.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.922+0000 7f4b1e7fc700 1 -- 172.21.15.154:0/2784777749 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b20040920 con 0x7f4b28133f70 2023-09-30T22:28:05.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.926+0000 7f4b1e7fc700 1 -- 172.21.15.154:0/2784777749 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b20014ad0 con 0x7f4b28133f70 2023-09-30T22:28:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.980+0000 7fdb98da2700 1 Processor -- start 2023-09-30T22:28:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb98da2700 1 -- start start 2023-09-30T22:28:05.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb98da2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409a150 0x7fdb9409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb98da2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb9409edb0 0x7fdb9409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb98da2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb941340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb98da2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9409a520 con 0x7fdb9409edb0 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb98da2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9409fe00 con 0x7fdb9409a150 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb98da2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9406bec0 con 0x7fdb94133c20 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb91d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb9409edb0 0x7fdb9409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb92d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb941340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb91d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb9409edb0 0x7fdb9409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58414/0 (socket says 172.21.15.154:58414) 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb91d9b700 1 -- 172.21.15.154:0/1660042231 learned_addr learned my addr 172.21.15.154:0/1660042231 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.981+0000 7fdb9259c700 1 --2- 172.21.15.154:0/1660042231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409a150 0x7fdb9409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb92d9d700 1 -- 172.21.15.154:0/1660042231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409a150 msgr2=0x7fdb9409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb92d9d700 1 --2- 172.21.15.154:0/1660042231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409a150 0x7fdb9409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb92d9d700 1 -- 172.21.15.154:0/1660042231 >> v2:172.21.15.154:3300/0 conn(0x7fdb9409edb0 msgr2=0x7fdb9409f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb92d9d700 1 --2- 172.21.15.154:0/1660042231 >> v2:172.21.15.154:3300/0 conn(0x7fdb9409edb0 0x7fdb9409f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb92d9d700 1 -- 172.21.15.154:0/1660042231 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9409af80 con 0x7fdb94133c20 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb91d9b700 1 --2- 172.21.15.154:0/1660042231 >> v2:172.21.15.154:3300/0 conn(0x7fdb9409edb0 0x7fdb9409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb9259c700 1 --2- 172.21.15.154:0/1660042231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409a150 0x7fdb9409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb92d9d700 1 --2- 172.21.15.154:0/1660042231 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb941340a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009dc0 tx=0x7fdb8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dab1d310366be516 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb9159a700 1 -- 172.21.15.154:0/1660042231 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c00e070 con 0x7fdb94133c20 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb9159a700 1 -- 172.21.15.154:0/1660042231 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c00bae0 con 0x7fdb94133c20 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.982+0000 7fdb9159a700 1 -- 172.21.15.154:0/1660042231 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c00be90 con 0x7fdb94133c20 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.983+0000 7fdb98da2700 1 -- 172.21.15.154:0/1660042231 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 msgr2=0x7fdb941340a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.983+0000 7fdb98da2700 1 --2- 172.21.15.154:0/1660042231 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb941340a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009dc0 tx=0x7fdb8c00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:05.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.983+0000 7fdb98da2700 1 -- 172.21.15.154:0/1660042231 shutdown_connections 2023-09-30T22:28:05.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.983+0000 7fdb98da2700 1 --2- 172.21.15.154:0/1660042231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409a150 0x7fdb9409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.983+0000 7fdb98da2700 1 --2- 172.21.15.154:0/1660042231 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb941340a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.983+0000 7fdb98da2700 1 --2- 172.21.15.154:0/1660042231 >> v2:172.21.15.154:3300/0 conn(0x7fdb9409edb0 0x7fdb9409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.983+0000 7fdb98da2700 1 -- 172.21.15.154:0/1660042231 >> 172.21.15.154:0/1660042231 conn(0x7fdb940a4430 msgr2=0x7fdb940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:05.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.983+0000 7fdb98da2700 1 -- 172.21.15.154:0/1660042231 shutdown_connections 2023-09-30T22:28:05.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.983+0000 7fdb98da2700 1 -- 172.21.15.154:0/1660042231 wait complete. 2023-09-30T22:28:05.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb98da2700 1 Processor -- start 2023-09-30T22:28:05.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb98da2700 1 -- start start 2023-09-30T22:28:05.986 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb98da2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9409a150 0x7fdb94122be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb98da2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409edb0 0x7fdb94123120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb98da2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb94123660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb98da2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb94124700 con 0x7fdb9409a150 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb98da2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb941260e0 con 0x7fdb9409edb0 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb98da2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940a1420 con 0x7fdb94133c20 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb91d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409edb0 0x7fdb94123120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb92d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb94123660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.984+0000 7fdb9259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9409a150 0x7fdb94122be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:05.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb91d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409edb0 0x7fdb94123120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36000/0 (socket says 172.21.15.154:36000) 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb91d9b700 1 -- 172.21.15.154:0/3174060170 learned_addr learned my addr 172.21.15.154:0/3174060170 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb92d9d700 1 -- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409edb0 msgr2=0x7fdb94123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb92d9d700 1 --2- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409edb0 0x7fdb94123120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb92d9d700 1 -- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9409a150 msgr2=0x7fdb94122be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb92d9d700 1 --2- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9409a150 0x7fdb94122be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb92d9d700 1 -- 172.21.15.154:0/3174060170 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb840094a0 con 0x7fdb94133c20 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb9259c700 1 --2- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9409a150 0x7fdb94122be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb92d9d700 1 --2- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb94123660 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009dc0 tx=0x7fdb8c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb82ffd700 1 -- 172.21.15.154:0/3174060170 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c004550 con 0x7fdb94133c20 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb82ffd700 1 -- 172.21.15.154:0/3174060170 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c020070 con 0x7fdb94133c20 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb98da2700 1 -- 172.21.15.154:0/3174060170 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb88009550 con 0x7fdb94133c20 2023-09-30T22:28:05.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb82ffd700 1 -- 172.21.15.154:0/3174060170 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c004910 con 0x7fdb94133c20 2023-09-30T22:28:05.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.985+0000 7fdb98da2700 1 -- 172.21.15.154:0/3174060170 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c009a70 con 0x7fdb94133c20 2023-09-30T22:28:05.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.986+0000 7fdb98da2700 1 -- 172.21.15.154:0/3174060170 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9409fa30 con 0x7fdb94133c20 2023-09-30T22:28:05.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.986+0000 7fdb82ffd700 1 -- 172.21.15.154:0/3174060170 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb8c027480 con 0x7fdb94133c20 2023-09-30T22:28:05.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.986+0000 7fdb82ffd700 1 -- 172.21.15.154:0/3174060170 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb8c022070 con 0x7fdb94133c20 2023-09-30T22:28:05.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:05.995+0000 7fdb82ffd700 1 -- 172.21.15.154:0/3174060170 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb8c02f750 con 0x7fdb94133c20 2023-09-30T22:28:06.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:06.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.117+0000 7fb414586700 1 Processor -- start 2023-09-30T22:28:06.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.117+0000 7fb414586700 1 -- start start 2023-09-30T22:28:06.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb414586700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c09e340 0x7fb40c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb414586700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb40c135f20 0x7fb40c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb414586700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40c09aaa0 con 0x7fb40c09d860 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb414586700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c09e730 con 0x7fb40c135f20 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb414586700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c09f870 con 0x7fb40c09e340 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb411b21700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c09e340 0x7fb40c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb411b21700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c09e340 0x7fb40c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44062/0 (socket says 172.21.15.154:44062) 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb411b21700 1 -- 172.21.15.154:0/989391236 learned_addr learned my addr 172.21.15.154:0/989391236 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb412b23700 1 --2- 172.21.15.154:0/989391236 >> v2:172.21.15.154:3300/0 conn(0x7fb40c135f20 0x7fb40c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb412b23700 1 -- 172.21.15.154:0/989391236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c09e340 msgr2=0x7fb40c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb412b23700 1 --2- 172.21.15.154:0/989391236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c09e340 0x7fb40c1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb412b23700 1 -- 172.21.15.154:0/989391236 >> v1:172.21.15.154:6789/0 conn(0x7fb40c09d860 legacy=0x7fb40c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.118+0000 7fb412b23700 1 -- 172.21.15.154:0/989391236 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c09b360 con 0x7fb40c135f20 2023-09-30T22:28:06.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.119+0000 7fb412b23700 1 --2- 172.21.15.154:0/989391236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c135f20 0x7fb40c138300 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fb404009d90 tx=0x7fb40400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21799f9869d38f92 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.119+0000 7fb411320700 1 -- 172.21.15.154:0/989391236 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400e070 con 0x7fb40c135f20 2023-09-30T22:28:06.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.119+0000 7fb411320700 1 -- 172.21.15.154:0/989391236 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40400bbd0 con 0x7fb40c135f20 2023-09-30T22:28:06.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.119+0000 7fb411320700 1 -- 172.21.15.154:0/989391236 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404012430 con 0x7fb40c135f20 2023-09-30T22:28:06.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.119+0000 7fb414586700 1 -- 172.21.15.154:0/989391236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c135f20 msgr2=0x7fb40c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.119+0000 7fb414586700 1 --2- 172.21.15.154:0/989391236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c135f20 0x7fb40c138300 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fb404009d90 tx=0x7fb40400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:06.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.119+0000 7fb414586700 1 -- 172.21.15.154:0/989391236 shutdown_connections 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.120+0000 7fb414586700 1 --2- 172.21.15.154:0/989391236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c135f20 0x7fb40c138300 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.120+0000 7fb414586700 1 --2- 172.21.15.154:0/989391236 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c09e340 0x7fb40c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.120+0000 7fb414586700 1 -- 172.21.15.154:0/989391236 >> 172.21.15.154:0/989391236 conn(0x7fb40c099c40 msgr2=0x7fb40c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.120+0000 7fb414586700 1 -- 172.21.15.154:0/989391236 shutdown_connections 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.120+0000 7fb414586700 1 -- 172.21.15.154:0/989391236 wait complete. 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.120+0000 7fb414586700 1 Processor -- start 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb414586700 1 -- start start 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb414586700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c09d860 0x7fb40c11c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb414586700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb40c09e340 0x7fb40c11cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb414586700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c135f20 0x7fb40c11cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb414586700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c120a50 con 0x7fb40c09d860 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb414586700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c11e180 con 0x7fb40c09e340 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb414586700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c11f3d0 con 0x7fb40c135f20 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb411b21700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb40c09e340 0x7fb40c11cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb412322700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c09d860 0x7fb40c11c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb411b21700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb40c09e340 0x7fb40c11cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36008/0 (socket says 172.21.15.154:36008) 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.121+0000 7fb412322700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c09d860 0x7fb40c11c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58450/0 (socket says 172.21.15.154:58450) 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb411b21700 1 -- 172.21.15.154:0/1834540014 learned_addr learned my addr 172.21.15.154:0/1834540014 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb412b23700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c135f20 0x7fb40c11cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb412b23700 1 -- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb40c09e340 msgr2=0x7fb40c11cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb412b23700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb40c09e340 0x7fb40c11cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb412b23700 1 -- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c09d860 msgr2=0x7fb40c11c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb412b23700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c09d860 0x7fb40c11c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb412b23700 1 -- 172.21.15.154:0/1834540014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404009a70 con 0x7fb40c135f20 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb411b21700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb40c09e340 0x7fb40c11cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb412322700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c09d860 0x7fb40c11c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb412b23700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c135f20 0x7fb40c11cff0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0729f0 tx=0x7fb404004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb402ffd700 1 -- 172.21.15.154:0/1834540014 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404012430 con 0x7fb40c135f20 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb402ffd700 1 -- 172.21.15.154:0/1834540014 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb404020070 con 0x7fb40c135f20 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb414586700 1 -- 172.21.15.154:0/1834540014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40c11f820 con 0x7fb40c135f20 2023-09-30T22:28:06.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb402ffd700 1 -- 172.21.15.154:0/1834540014 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404004280 con 0x7fb40c135f20 2023-09-30T22:28:06.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.122+0000 7fb414586700 1 -- 172.21.15.154:0/1834540014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40c11e980 con 0x7fb40c135f20 2023-09-30T22:28:06.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.123+0000 7fb402ffd700 1 -- 172.21.15.154:0/1834540014 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4040043e0 con 0x7fb40c135f20 2023-09-30T22:28:06.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.123+0000 7fb414586700 1 -- 172.21.15.154:0/1834540014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40c04f2a0 con 0x7fb40c135f20 2023-09-30T22:28:06.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.124+0000 7fb402ffd700 1 -- 172.21.15.154:0/1834540014 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb404022070 con 0x7fb40c135f20 2023-09-30T22:28:06.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.132+0000 7fb402ffd700 1 -- 172.21.15.154:0/1834540014 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4040048d0 con 0x7fb40c135f20 2023-09-30T22:28:06.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.146+0000 7f4b2fddc700 1 -- 172.21.15.154:0/2784777749 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b2804f2a0 con 0x7f4b28133f70 2023-09-30T22:28:06.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.147+0000 7f4b1e7fc700 1 -- 172.21.15.154:0/2784777749 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b200263e0 con 0x7f4b28133f70 2023-09-30T22:28:06.147 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:06.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.150+0000 7f4b2fddc700 1 -- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b28133f70 msgr2=0x7f4b281c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.150+0000 7f4b2fddc700 1 --2- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b28133f70 0x7f4b281c8d80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000efc0 tx=0x7f4b2000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.150+0000 7f4b2fddc700 1 -- 172.21.15.154:0/2784777749 shutdown_connections 2023-09-30T22:28:06.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.150+0000 7f4b2fddc700 1 --2- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b28133f70 0x7f4b281c8d80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.150+0000 7f4b2fddc700 1 --2- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2809ad40 0x7f4b281c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.150+0000 7f4b2fddc700 1 --2- 172.21.15.154:0/2784777749 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b280a0a70 0x7f4b281c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.150+0000 7f4b2fddc700 1 -- 172.21.15.154:0/2784777749 >> 172.21.15.154:0/2784777749 conn(0x7f4b28099c40 msgr2=0x7f4b280a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.150+0000 7f4b2fddc700 1 -- 172.21.15.154:0/2784777749 shutdown_connections 2023-09-30T22:28:06.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.150+0000 7f4b2fddc700 1 -- 172.21.15.154:0/2784777749 wait complete. 2023-09-30T22:28:06.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:06.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.201+0000 7fdb98da2700 1 -- 172.21.15.154:0/3174060170 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb9404f2a0 con 0x7fdb94133c20 2023-09-30T22:28:06.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.201+0000 7fdb82ffd700 1 -- 172.21.15.154:0/3174060170 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb8c01c400 con 0x7fdb94133c20 2023-09-30T22:28:06.201 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:06.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.203+0000 7fdb98da2700 1 -- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 msgr2=0x7fdb94123660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.203+0000 7fdb98da2700 1 --2- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb94123660 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009dc0 tx=0x7fdb8c004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.203+0000 7fdb98da2700 1 -- 172.21.15.154:0/3174060170 shutdown_connections 2023-09-30T22:28:06.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.203+0000 7fdb98da2700 1 --2- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb94133c20 0x7fdb94123660 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.203+0000 7fdb98da2700 1 --2- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9409a150 0x7fdb94122be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.203+0000 7fdb98da2700 1 --2- 172.21.15.154:0/3174060170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9409edb0 0x7fdb94123120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.203+0000 7fdb98da2700 1 -- 172.21.15.154:0/3174060170 >> 172.21.15.154:0/3174060170 conn(0x7fdb940a4430 msgr2=0x7fdb9409c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.203+0000 7fdb98da2700 1 -- 172.21.15.154:0/3174060170 shutdown_connections 2023-09-30T22:28:06.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.203+0000 7fdb98da2700 1 -- 172.21.15.154:0/3174060170 wait complete. 2023-09-30T22:28:06.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:06.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.217+0000 7f55ff96f700 1 Processor -- start 2023-09-30T22:28:06.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55ff96f700 1 -- start start 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55ff96f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55f8133a70 0x7f55f8133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55ff96f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f80a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55ff96f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f813a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55ff96f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f8133640 con 0x7f55f8133a70 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55ff96f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80a1d50 con 0x7f55f80a08e0 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55ff96f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80a1710 con 0x7f55f80a1290 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55fdf0c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55fcf0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f80a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55fcf0a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f80a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36024/0 (socket says 172.21.15.154:36024) 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55fdf0c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f813a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44092/0 (socket says 172.21.15.154:44092) 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55fcf0a700 1 -- 172.21.15.154:0/1470951508 learned_addr learned my addr 172.21.15.154:0/1470951508 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.218+0000 7f55fd70b700 1 --2- 172.21.15.154:0/1470951508 >> v2:172.21.15.154:3300/0 conn(0x7f55f8133a70 0x7f55f8133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55fcf0a700 1 -- 172.21.15.154:0/1470951508 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 msgr2=0x7f55f813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55fcf0a700 1 --2- 172.21.15.154:0/1470951508 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f813a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55fcf0a700 1 -- 172.21.15.154:0/1470951508 >> v2:172.21.15.154:3300/0 conn(0x7f55f8133a70 msgr2=0x7f55f8133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55fcf0a700 1 --2- 172.21.15.154:0/1470951508 >> v2:172.21.15.154:3300/0 conn(0x7f55f8133a70 0x7f55f8133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55fcf0a700 1 -- 172.21.15.154:0/1470951508 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f809b620 con 0x7f55f80a08e0 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55fdf0c700 1 --2- 172.21.15.154:0/1470951508 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55fd70b700 1 --2- 172.21.15.154:0/1470951508 >> v2:172.21.15.154:3300/0 conn(0x7f55f8133a70 0x7f55f8133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:06.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55fcf0a700 1 --2- 172.21.15.154:0/1470951508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f80a0d50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f55f40098f0 tx=0x7f55f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=978b0b1674e01efe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55ebfff700 1 -- 172.21.15.154:0/1470951508 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4011830 con 0x7f55f80a08e0 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55ebfff700 1 -- 172.21.15.154:0/1470951508 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f4011990 con 0x7f55f80a08e0 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55ebfff700 1 -- 172.21.15.154:0/1470951508 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4011d20 con 0x7f55f80a08e0 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55ff96f700 1 -- 172.21.15.154:0/1470951508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 msgr2=0x7f55f80a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.219+0000 7f55ff96f700 1 --2- 172.21.15.154:0/1470951508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f80a0d50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f55f40098f0 tx=0x7f55f4009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.220+0000 7f55ff96f700 1 -- 172.21.15.154:0/1470951508 shutdown_connections 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.220+0000 7f55ff96f700 1 --2- 172.21.15.154:0/1470951508 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.220+0000 7f55ff96f700 1 --2- 172.21.15.154:0/1470951508 >> v2:172.21.15.154:3300/0 conn(0x7f55f8133a70 0x7f55f8133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.220+0000 7f55ff96f700 1 --2- 172.21.15.154:0/1470951508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f80a0d50 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.220+0000 7f55ff96f700 1 -- 172.21.15.154:0/1470951508 >> 172.21.15.154:0/1470951508 conn(0x7f55f80a2980 msgr2=0x7f55f80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.220+0000 7f55ff96f700 1 -- 172.21.15.154:0/1470951508 shutdown_connections 2023-09-30T22:28:06.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.220+0000 7f55ff96f700 1 -- 172.21.15.154:0/1470951508 wait complete. 2023-09-30T22:28:06.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55ff96f700 1 Processor -- start 2023-09-30T22:28:06.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55ff96f700 1 -- start start 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55ff96f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f811f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55ff96f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f811fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55ff96f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f8133a70 0x7f55f81203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55ff96f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f81233f0 con 0x7f55f8133a70 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55ff96f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8122ee0 con 0x7f55f80a08e0 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55ff96f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8122370 con 0x7f55f80a1290 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fd70b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f811f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fcf0a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f811fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fdf0c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f8133a70 0x7f55f81203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fd70b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f811f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36032/0 (socket says 172.21.15.154:36032) 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fd70b700 1 -- 172.21.15.154:0/1244588696 learned_addr learned my addr 172.21.15.154:0/1244588696 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:06.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fd70b700 1 -- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 msgr2=0x7f55f811fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fd70b700 1 --2- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f811fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fd70b700 1 -- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f8133a70 msgr2=0x7f55f81203e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fd70b700 1 --2- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f8133a70 0x7f55f81203e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fd70b700 1 -- 172.21.15.154:0/1244588696 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0009a70 con 0x7f55f80a08e0 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.221+0000 7f55fcf0a700 1 --2- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f811fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.222+0000 7f55fd70b700 1 --2- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f811f960 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00ec10 tx=0x7f55ec00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.222+0000 7f55e9ffb700 1 -- 172.21.15.154:0/1244588696 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec005a20 con 0x7f55f80a08e0 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.222+0000 7f55e9ffb700 1 -- 172.21.15.154:0/1244588696 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec005b80 con 0x7f55f80a08e0 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.222+0000 7f55ff96f700 1 -- 172.21.15.154:0/1244588696 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec009430 con 0x7f55f80a08e0 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.222+0000 7f55e9ffb700 1 -- 172.21.15.154:0/1244588696 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec00c850 con 0x7f55f80a08e0 2023-09-30T22:28:06.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.222+0000 7f55ff96f700 1 -- 172.21.15.154:0/1244588696 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f4009550 con 0x7f55f80a08e0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.223+0000 7f55e9ffb700 1 -- 172.21.15.154:0/1244588696 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55ec00c9b0 con 0x7f55f80a08e0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.223+0000 7f55e9ffb700 1 -- 172.21.15.154:0/1244588696 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f55ec03fa00 con 0x7f55f80a08e0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.223+0000 7f55ff96f700 1 -- 172.21.15.154:0/1244588696 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f8133280 con 0x7f55f80a08e0 2023-09-30T22:28:06.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.227+0000 7f55e9ffb700 1 -- 172.21.15.154:0/1244588696 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55ec020020 con 0x7f55f80a08e0 2023-09-30T22:28:06.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.344+0000 7fb414586700 1 -- 172.21.15.154:0/1834540014 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb40c11fe10 con 0x7fb40c135f20 2023-09-30T22:28:06.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.345+0000 7fb402ffd700 1 -- 172.21.15.154:0/1834540014 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb404025b70 con 0x7fb40c135f20 2023-09-30T22:28:06.345 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.347+0000 7fb414586700 1 -- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c135f20 msgr2=0x7fb40c11cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.347+0000 7fb414586700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c135f20 0x7fb40c11cff0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0729f0 tx=0x7fb404004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.347+0000 7fb414586700 1 -- 172.21.15.154:0/1834540014 shutdown_connections 2023-09-30T22:28:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.347+0000 7fb414586700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb40c135f20 0x7fb40c11cff0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.347+0000 7fb414586700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40c09d860 0x7fb40c11c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.347+0000 7fb414586700 1 --2- 172.21.15.154:0/1834540014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb40c09e340 0x7fb40c11cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.347+0000 7fb414586700 1 -- 172.21.15.154:0/1834540014 >> 172.21.15.154:0/1834540014 conn(0x7fb40c099c40 msgr2=0x7fb40c1368a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.347+0000 7fb414586700 1 -- 172.21.15.154:0/1834540014 shutdown_connections 2023-09-30T22:28:06.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.347+0000 7fb414586700 1 -- 172.21.15.154:0/1834540014 wait complete. 2023-09-30T22:28:06.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:06.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.421+0000 7f55ff96f700 1 -- 172.21.15.154:0/1244588696 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f55f804f2a0 con 0x7f55f80a08e0 2023-09-30T22:28:06.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.421+0000 7f55e9ffb700 1 -- 172.21.15.154:0/1244588696 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55ec02a090 con 0x7f55f80a08e0 2023-09-30T22:28:06.421 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:06.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.423+0000 7f55ff96f700 1 -- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 msgr2=0x7f55f811f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:06.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.423+0000 7f55ff96f700 1 --2- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f811f960 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00ec10 tx=0x7f55ec00ef20 comp rx=0 tx=0).stop 2023-09-30T22:28:06.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.423+0000 7f55ff96f700 1 -- 172.21.15.154:0/1244588696 shutdown_connections 2023-09-30T22:28:06.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.423+0000 7f55ff96f700 1 --2- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f8133a70 0x7f55f81203e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.423+0000 7f55ff96f700 1 --2- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f80a08e0 0x7f55f811f960 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.423+0000 7f55ff96f700 1 --2- 172.21.15.154:0/1244588696 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f55f80a1290 0x7f55f811fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.423+0000 7f55ff96f700 1 -- 172.21.15.154:0/1244588696 >> 172.21.15.154:0/1244588696 conn(0x7f55f80a2980 msgr2=0x7f55f8131540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.423+0000 7f55ff96f700 1 -- 172.21.15.154:0/1244588696 shutdown_connections 2023-09-30T22:28:06.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:06.423+0000 7f55ff96f700 1 -- 172.21.15.154:0/1244588696 wait complete. 2023-09-30T22:28:06.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:07.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:07.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:07.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.311+0000 7f1bcf2ea700 1 Processor -- start 2023-09-30T22:28:07.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.311+0000 7f1bcf2ea700 1 -- start start 2023-09-30T22:28:07.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcf2ea700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bc809ad40 0x7f1bc8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcf2ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc8133f70 0x7f1bc81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcf2ea700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc809b110 con 0x7f1bc80a0a70 2023-09-30T22:28:07.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcf2ea700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc80a3b60 con 0x7f1bc809ad40 2023-09-30T22:28:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcf2ea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81348e0 con 0x7f1bc8133f70 2023-09-30T22:28:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcd086700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bc809ad40 0x7f1bc8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcc885700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc8133f70 0x7f1bc81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcc885700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc8133f70 0x7f1bc81343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44108/0 (socket says 172.21.15.154:44108) 2023-09-30T22:28:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcd086700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1bc809ad40 0x7f1bc8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58480/0 (socket says 172.21.15.154:58480) 2023-09-30T22:28:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcc885700 1 -- 172.21.15.154:0/1131472713 learned_addr learned my addr 172.21.15.154:0/1131472713 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcc885700 1 -- 172.21.15.154:0/1131472713 >> v2:172.21.15.154:3300/0 conn(0x7f1bc809ad40 msgr2=0x7f1bc8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcc885700 1 --2- 172.21.15.154:0/1131472713 >> v2:172.21.15.154:3300/0 conn(0x7f1bc809ad40 0x7f1bc8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcc885700 1 -- 172.21.15.154:0/1131472713 >> v1:172.21.15.154:6789/0 conn(0x7f1bc80a0a70 legacy=0x7f1bc80a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcc885700 1 -- 172.21.15.154:0/1131472713 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc80a2fa0 con 0x7f1bc8133f70 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bbffff700 1 -- 172.21.15.154:0/1131472713 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021466042 0 0) 0x7f1bc809b110 con 0x7f1bc80a0a70 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcd086700 1 --2- 172.21.15.154:0/1131472713 >> v2:172.21.15.154:3300/0 conn(0x7f1bc809ad40 0x7f1bc8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bcc885700 1 --2- 172.21.15.154:0/1131472713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc8133f70 0x7f1bc81343a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80098f0 tx=0x7f1bb8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e052dc093edda2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.312+0000 7f1bbffff700 1 -- 172.21.15.154:0/1131472713 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8011830 con 0x7f1bc8133f70 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bbffff700 1 -- 172.21.15.154:0/1131472713 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb8011990 con 0x7f1bc8133f70 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bbffff700 1 -- 172.21.15.154:0/1131472713 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8011d20 con 0x7f1bc8133f70 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/1131472713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc8133f70 msgr2=0x7f1bc81343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bcf2ea700 1 --2- 172.21.15.154:0/1131472713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc8133f70 0x7f1bc81343a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80098f0 tx=0x7f1bb8009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/1131472713 shutdown_connections 2023-09-30T22:28:07.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bcf2ea700 1 --2- 172.21.15.154:0/1131472713 >> v2:172.21.15.154:3300/0 conn(0x7f1bc809ad40 0x7f1bc8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bcf2ea700 1 --2- 172.21.15.154:0/1131472713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc8133f70 0x7f1bc81343a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/1131472713 >> 172.21.15.154:0/1131472713 conn(0x7f1bc8099c40 msgr2=0x7f1bc806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/1131472713 shutdown_connections 2023-09-30T22:28:07.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.313+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/1131472713 wait complete. 2023-09-30T22:28:07.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.314+0000 7f1bcf2ea700 1 Processor -- start 2023-09-30T22:28:07.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.314+0000 7f1bcf2ea700 1 -- start start 2023-09-30T22:28:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcf2ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc809ad40 0x7f1bc81212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcf2ea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bc80a0a70 0x7f1bc8121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcf2ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bc8133f70 0x7f1bc8121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcf2ea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc8122eb0 con 0x7f1bc8133f70 2023-09-30T22:28:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcf2ea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc8123d40 con 0x7f1bc80a0a70 2023-09-30T22:28:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcf2ea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc8124820 con 0x7f1bc809ad40 2023-09-30T22:28:07.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcc885700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bc80a0a70 0x7f1bc8121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcd086700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc809ad40 0x7f1bc81212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcc885700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bc80a0a70 0x7f1bc8121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36036/0 (socket says 172.21.15.154:36036) 2023-09-30T22:28:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcc885700 1 -- 172.21.15.154:0/2899194667 learned_addr learned my addr 172.21.15.154:0/2899194667 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcd887700 1 --2- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bc8133f70 0x7f1bc8121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcd086700 1 -- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bc80a0a70 msgr2=0x7f1bc8121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcd086700 1 --2- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bc80a0a70 0x7f1bc8121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcd086700 1 -- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bc8133f70 msgr2=0x7f1bc8121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcd086700 1 --2- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bc8133f70 0x7f1bc8121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcd086700 1 -- 172.21.15.154:0/2899194667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40094a0 con 0x7f1bc809ad40 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.315+0000 7f1bcc885700 1 --2- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bc80a0a70 0x7f1bc8121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.316+0000 7f1bcd086700 1 --2- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc809ad40 0x7f1bc81212f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400e900 tx=0x7f1bc400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.316+0000 7f1bbdffb700 1 -- 172.21.15.154:0/2899194667 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4013680 con 0x7f1bc809ad40 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.316+0000 7f1bbdffb700 1 -- 172.21.15.154:0/2899194667 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc40137e0 con 0x7f1bc809ad40 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.316+0000 7f1bbdffb700 1 -- 172.21.15.154:0/2899194667 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4013b70 con 0x7f1bc809ad40 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.316+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/2899194667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb8009550 con 0x7f1bc809ad40 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.316+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/2899194667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc8124b40 con 0x7f1bc809ad40 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.317+0000 7f1bbdffb700 1 -- 172.21.15.154:0/2899194667 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bc4013cd0 con 0x7f1bc809ad40 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.317+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/2899194667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc811e060 con 0x7f1bc809ad40 2023-09-30T22:28:07.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.317+0000 7f1bbdffb700 1 -- 172.21.15.154:0/2899194667 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1bc403f990 con 0x7f1bc809ad40 2023-09-30T22:28:07.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.322+0000 7f1bbdffb700 1 -- 172.21.15.154:0/2899194667 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bc4011db0 con 0x7f1bc809ad40 2023-09-30T22:28:07.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86fdbd5700 1 Processor -- start 2023-09-30T22:28:07.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86fdbd5700 1 -- start start 2023-09-30T22:28:07.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86fdbd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f806a770 0x7f86f806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86fdbd5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86f806b080 0x7f86f81317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86fdbd5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f809da80 con 0x7f86f8131cf0 2023-09-30T22:28:07.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86fdbd5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f809dce0 con 0x7f86f806b080 2023-09-30T22:28:07.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86fdbd5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86f809eb20 con 0x7f86f806a770 2023-09-30T22:28:07.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86f77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f806a770 0x7f86f806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86f6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86f806b080 0x7f86f81317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86f77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f806a770 0x7f86f806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44122/0 (socket says 172.21.15.154:44122) 2023-09-30T22:28:07.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86f6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86f806b080 0x7f86f81317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58496/0 (socket says 172.21.15.154:58496) 2023-09-30T22:28:07.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.352+0000 7f86f77fe700 1 -- 172.21.15.154:0/2086177224 learned_addr learned my addr 172.21.15.154:0/2086177224 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:07.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.353+0000 7f86f77fe700 1 -- 172.21.15.154:0/2086177224 >> v2:172.21.15.154:3300/0 conn(0x7f86f806b080 msgr2=0x7f86f81317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.353+0000 7f86f77fe700 1 --2- 172.21.15.154:0/2086177224 >> v2:172.21.15.154:3300/0 conn(0x7f86f806b080 0x7f86f81317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.353+0000 7f86f77fe700 1 -- 172.21.15.154:0/2086177224 >> v1:172.21.15.154:6789/0 conn(0x7f86f8131cf0 legacy=0x7f86f8138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.353+0000 7f86f77fe700 1 -- 172.21.15.154:0/2086177224 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f809d860 con 0x7f86f806a770 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.353+0000 7f86f6ffd700 1 --2- 172.21.15.154:0/2086177224 >> v2:172.21.15.154:3300/0 conn(0x7f86f806b080 0x7f86f81317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.353+0000 7f86f77fe700 1 --2- 172.21.15.154:0/2086177224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f806a770 0x7f86f806ab40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f86e80098f0 tx=0x7f86e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5c05c8c991f308 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.353+0000 7f86f67fc700 1 -- 172.21.15.154:0/2086177224 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8011830 con 0x7f86f806a770 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.353+0000 7f86f67fc700 1 -- 172.21.15.154:0/2086177224 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8011990 con 0x7f86f806a770 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.353+0000 7f86f67fc700 1 -- 172.21.15.154:0/2086177224 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8011d00 con 0x7f86f806a770 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.354+0000 7f86fdbd5700 1 -- 172.21.15.154:0/2086177224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f806a770 msgr2=0x7f86f806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.354+0000 7f86fdbd5700 1 --2- 172.21.15.154:0/2086177224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f806a770 0x7f86f806ab40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f86e80098f0 tx=0x7f86e8009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:07.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.354+0000 7f86fdbd5700 1 -- 172.21.15.154:0/2086177224 shutdown_connections 2023-09-30T22:28:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.354+0000 7f86fdbd5700 1 --2- 172.21.15.154:0/2086177224 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f806a770 0x7f86f806ab40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.354+0000 7f86fdbd5700 1 --2- 172.21.15.154:0/2086177224 >> v2:172.21.15.154:3300/0 conn(0x7f86f806b080 0x7f86f81317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.354+0000 7f86fdbd5700 1 -- 172.21.15.154:0/2086177224 >> 172.21.15.154:0/2086177224 conn(0x7f86f8099c40 msgr2=0x7f86f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.354+0000 7f86fdbd5700 1 -- 172.21.15.154:0/2086177224 shutdown_connections 2023-09-30T22:28:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.354+0000 7f86fdbd5700 1 -- 172.21.15.154:0/2086177224 wait complete. 2023-09-30T22:28:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86fdbd5700 1 Processor -- start 2023-09-30T22:28:07.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86fdbd5700 1 -- start start 2023-09-30T22:28:07.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86fdbd5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86f806a770 0x7f86f811c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86fdbd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86f806b080 0x7f86f811c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86fdbd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f8131cf0 0x7f86f81c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86fdbd5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f811d3a0 con 0x7f86f806a770 2023-09-30T22:28:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86fdbd5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f8130120 con 0x7f86f806b080 2023-09-30T22:28:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86fdbd5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80a2a30 con 0x7f86f8131cf0 2023-09-30T22:28:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86f77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86f806a770 0x7f86f811c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86f77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86f806a770 0x7f86f811c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58502/0 (socket says 172.21.15.154:58502) 2023-09-30T22:28:07.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86f77fe700 1 -- 172.21.15.154:0/396858128 learned_addr learned my addr 172.21.15.154:0/396858128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.355+0000 7f86f7fff700 1 --2- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f8131cf0 0x7f86f81c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86f77fe700 1 -- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f8131cf0 msgr2=0x7f86f81c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86f77fe700 1 --2- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f8131cf0 0x7f86f81c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86f77fe700 1 -- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86f806b080 msgr2=0x7f86f811c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86f77fe700 1 --2- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86f806b080 0x7f86f811c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86f77fe700 1 -- 172.21.15.154:0/396858128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0094a0 con 0x7f86f806a770 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86f77fe700 1 --2- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86f806a770 0x7f86f811c0f0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f86f809ec60 tx=0x7f86e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86dffff700 1 -- 172.21.15.154:0/396858128 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80036a0 con 0x7f86f806a770 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86dffff700 1 -- 172.21.15.154:0/396858128 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8003820 con 0x7f86f806a770 2023-09-30T22:28:07.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86dffff700 1 -- 172.21.15.154:0/396858128 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8003bd0 con 0x7f86f806a770 2023-09-30T22:28:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86fdbd5700 1 -- 172.21.15.154:0/396858128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e8009550 con 0x7f86f806a770 2023-09-30T22:28:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.356+0000 7f86fdbd5700 1 -- 172.21.15.154:0/396858128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f811cb70 con 0x7f86f806a770 2023-09-30T22:28:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.357+0000 7f86dffff700 1 -- 172.21.15.154:0/396858128 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86e8021070 con 0x7f86f806a770 2023-09-30T22:28:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.357+0000 7f86dffff700 1 -- 172.21.15.154:0/396858128 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86e8040c30 con 0x7f86f806a770 2023-09-30T22:28:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.357+0000 7f86fdbd5700 1 -- 172.21.15.154:0/396858128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f811eef0 con 0x7f86f806a770 2023-09-30T22:28:07.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.362+0000 7f86dffff700 1 -- 172.21.15.154:0/396858128 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86e8029020 con 0x7f86f806a770 2023-09-30T22:28:07.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:07.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.490+0000 7fa168e36700 1 Processor -- start 2023-09-30T22:28:07.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.490+0000 7fa168e36700 1 -- start start 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.491+0000 7fa168e36700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa16412d380 0x7fa16412d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.491+0000 7fa168e36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa164099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.491+0000 7fa168e36700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16409bb90 con 0x7fa16409a3d0 2023-09-30T22:28:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.491+0000 7fa168e36700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16409c210 con 0x7fa16412d380 2023-09-30T22:28:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.491+0000 7fa168e36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16409ced0 con 0x7fa164099a60 2023-09-30T22:28:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa16412d380 0x7fa16412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa161d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa164099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa161d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa164099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36058/0 (socket says 172.21.15.154:36058) 2023-09-30T22:28:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa16412d380 0x7fa16412d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58512/0 (socket says 172.21.15.154:58512) 2023-09-30T22:28:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa161d9b700 1 -- 172.21.15.154:0/3404008367 learned_addr learned my addr 172.21.15.154:0/3404008367 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16259c700 1 -- 172.21.15.154:0/3404008367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 msgr2=0x7fa164099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16259c700 1 --2- 172.21.15.154:0/3404008367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa164099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16259c700 1 -- 172.21.15.154:0/3404008367 >> v1:172.21.15.154:6789/0 conn(0x7fa16409a3d0 legacy=0x7fa164137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16259c700 1 -- 172.21.15.154:0/3404008367 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16409ac30 con 0x7fa16412d380 2023-09-30T22:28:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa161d9b700 1 --2- 172.21.15.154:0/3404008367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa164099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16259c700 1 --2- 172.21.15.154:0/3404008367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16412d380 0x7fa16412d750 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fa154009820 tx=0x7fa154009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b59b89c71692919 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16159a700 1 -- 172.21.15.154:0/3404008367 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154005e30 con 0x7fa16412d380 2023-09-30T22:28:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16159a700 1 -- 172.21.15.154:0/3404008367 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154006030 con 0x7fa16412d380 2023-09-30T22:28:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.492+0000 7fa16159a700 1 -- 172.21.15.154:0/3404008367 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1540063c0 con 0x7fa16412d380 2023-09-30T22:28:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.493+0000 7fa168e36700 1 -- 172.21.15.154:0/3404008367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16412d380 msgr2=0x7fa16412d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.493+0000 7fa168e36700 1 --2- 172.21.15.154:0/3404008367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16412d380 0x7fa16412d750 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fa154009820 tx=0x7fa154009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.493+0000 7fa168e36700 1 -- 172.21.15.154:0/3404008367 shutdown_connections 2023-09-30T22:28:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.493+0000 7fa168e36700 1 --2- 172.21.15.154:0/3404008367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16412d380 0x7fa16412d750 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.493+0000 7fa168e36700 1 --2- 172.21.15.154:0/3404008367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa164099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.493+0000 7fa168e36700 1 -- 172.21.15.154:0/3404008367 >> 172.21.15.154:0/3404008367 conn(0x7fa1640a2980 msgr2=0x7fa1640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.493+0000 7fa168e36700 1 -- 172.21.15.154:0/3404008367 shutdown_connections 2023-09-30T22:28:07.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.493+0000 7fa168e36700 1 -- 172.21.15.154:0/3404008367 wait complete. 2023-09-30T22:28:07.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.495+0000 7fa168e36700 1 Processor -- start 2023-09-30T22:28:07.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.495+0000 7fa168e36700 1 -- start start 2023-09-30T22:28:07.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.495+0000 7fa168e36700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa1641333a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa168e36700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16409a3d0 0x7fa1641338e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa168e36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa16412d380 0x7fa1641c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa168e36700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa164136000 con 0x7fa16409a3d0 2023-09-30T22:28:07.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa168e36700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16409b3e0 con 0x7fa164099a60 2023-09-30T22:28:07.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa168e36700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1641346a0 con 0x7fa16412d380 2023-09-30T22:28:07.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa162d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa16412d380 0x7fa1641c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa161d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16409a3d0 0x7fa1641338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa162d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa16412d380 0x7fa1641c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44128/0 (socket says 172.21.15.154:44128) 2023-09-30T22:28:07.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa162d9d700 1 -- 172.21.15.154:0/1315090344 learned_addr learned my addr 172.21.15.154:0/1315090344 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:07.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa16259c700 1 --2- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa1641333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa161d9b700 1 -- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa16412d380 msgr2=0x7fa1641c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa161d9b700 1 --2- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa16412d380 0x7fa1641c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa161d9b700 1 -- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 msgr2=0x7fa1641333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa161d9b700 1 --2- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa1641333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa161d9b700 1 -- 172.21.15.154:0/1315090344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa158009550 con 0x7fa16409a3d0 2023-09-30T22:28:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.496+0000 7fa161d9b700 1 --2- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16409a3d0 0x7fa1641338e0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fa158009f70 tx=0x7fa15800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.497+0000 7fa152ffd700 1 -- 172.21.15.154:0/1315090344 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158013980 con 0x7fa16409a3d0 2023-09-30T22:28:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.497+0000 7fa152ffd700 1 -- 172.21.15.154:0/1315090344 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa158013ae0 con 0x7fa16409a3d0 2023-09-30T22:28:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.497+0000 7fa168e36700 1 -- 172.21.15.154:0/1315090344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa154009430 con 0x7fa16409a3d0 2023-09-30T22:28:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.497+0000 7fa168e36700 1 -- 172.21.15.154:0/1315090344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa164136ca0 con 0x7fa16409a3d0 2023-09-30T22:28:07.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.497+0000 7fa152ffd700 1 -- 172.21.15.154:0/1315090344 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158013e70 con 0x7fa16409a3d0 2023-09-30T22:28:07.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.498+0000 7fa168e36700 1 -- 172.21.15.154:0/1315090344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1480052e0 con 0x7fa16409a3d0 2023-09-30T22:28:07.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.498+0000 7fa152ffd700 1 -- 172.21.15.154:0/1315090344 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa158004030 con 0x7fa16409a3d0 2023-09-30T22:28:07.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.499+0000 7fa152ffd700 1 -- 172.21.15.154:0/1315090344 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa158043750 con 0x7fa16409a3d0 2023-09-30T22:28:07.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.507+0000 7fa152ffd700 1 -- 172.21.15.154:0/1315090344 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa158019520 con 0x7fa16409a3d0 2023-09-30T22:28:07.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.536+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/2899194667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1bc8124960 con 0x7f1bc809ad40 2023-09-30T22:28:07.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.536+0000 7f1bbdffb700 1 -- 172.21.15.154:0/2899194667 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bc4017030 con 0x7f1bc809ad40 2023-09-30T22:28:07.536 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:07.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.539+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc809ad40 msgr2=0x7f1bc81212f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.539+0000 7f1bcf2ea700 1 --2- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc809ad40 0x7f1bc81212f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400e900 tx=0x7f1bc400ec10 comp rx=0 tx=0).stop 2023-09-30T22:28:07.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.539+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/2899194667 shutdown_connections 2023-09-30T22:28:07.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.539+0000 7f1bcf2ea700 1 --2- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bc8133f70 0x7f1bc8121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.539+0000 7f1bcf2ea700 1 --2- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1bc809ad40 0x7f1bc81212f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.539+0000 7f1bcf2ea700 1 --2- 172.21.15.154:0/2899194667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1bc80a0a70 0x7f1bc8121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.539+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/2899194667 >> 172.21.15.154:0/2899194667 conn(0x7f1bc8099c40 msgr2=0x7f1bc81332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.540+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/2899194667 shutdown_connections 2023-09-30T22:28:07.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.541+0000 7f1bcf2ea700 1 -- 172.21.15.154:0/2899194667 wait complete. 2023-09-30T22:28:07.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3afaaa0700 1 Processor -- start 2023-09-30T22:28:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3afaaa0700 1 -- start start 2023-09-30T22:28:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3afaaa0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 0x7f3af4136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3afaaa0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 0x7f3af41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3afaaa0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af409c970 con 0x7f3af409e870 2023-09-30T22:28:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3afaaa0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af40a0920 con 0x7f3af409f350 2023-09-30T22:28:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3afaaa0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3af409f9c0 con 0x7f3af41371c0 2023-09-30T22:28:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3af883c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3af409e870 0x7f3af409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36690/0 (socket says 172.21.15.154:36690) 2023-09-30T22:28:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3af883c700 1 -- 172.21.15.154:0/1870778642 learned_addr learned my addr 172.21.15.154:0/1870778642 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3af903d700 1 --2- 172.21.15.154:0/1870778642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 0x7f3af41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.568+0000 7f3af3fff700 1 --2- 172.21.15.154:0/1870778642 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 0x7f3af4136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.569+0000 7f3af37fe700 1 -- 172.21.15.154:0/1870778642 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998098566 0 0) 0x7f3af409c970 con 0x7f3af409e870 2023-09-30T22:28:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.569+0000 7f3af903d700 1 -- 172.21.15.154:0/1870778642 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 msgr2=0x7f3af4136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.569+0000 7f3af903d700 1 --2- 172.21.15.154:0/1870778642 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 0x7f3af4136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.569+0000 7f3af903d700 1 -- 172.21.15.154:0/1870778642 >> v1:172.21.15.154:6789/0 conn(0x7f3af409e870 legacy=0x7f3af409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.569+0000 7f3af903d700 1 -- 172.21.15.154:0/1870778642 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af409bab0 con 0x7f3af41371c0 2023-09-30T22:28:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.569+0000 7f3af903d700 1 --2- 172.21.15.154:0/1870778642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 0x7f3af41395a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009dc0 tx=0x7f3aec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f237477fcd94f597 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.569+0000 7f3af37fe700 1 -- 172.21.15.154:0/1870778642 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00e070 con 0x7f3af41371c0 2023-09-30T22:28:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.569+0000 7f3af37fe700 1 -- 172.21.15.154:0/1870778642 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec00bb20 con 0x7f3af41371c0 2023-09-30T22:28:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.569+0000 7f3af37fe700 1 -- 172.21.15.154:0/1870778642 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec012430 con 0x7f3af41371c0 2023-09-30T22:28:07.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.570+0000 7f3afaaa0700 1 -- 172.21.15.154:0/1870778642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 msgr2=0x7f3af41395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.570+0000 7f3afaaa0700 1 --2- 172.21.15.154:0/1870778642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 0x7f3af41395a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009dc0 tx=0x7f3aec00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.570+0000 7f3afaaa0700 1 -- 172.21.15.154:0/1870778642 shutdown_connections 2023-09-30T22:28:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.570+0000 7f3afaaa0700 1 --2- 172.21.15.154:0/1870778642 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 0x7f3af41395a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.570+0000 7f3afaaa0700 1 --2- 172.21.15.154:0/1870778642 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 0x7f3af4136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.570+0000 7f3afaaa0700 1 -- 172.21.15.154:0/1870778642 >> 172.21.15.154:0/1870778642 conn(0x7f3af40a4430 msgr2=0x7f3af40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.570+0000 7f3afaaa0700 1 -- 172.21.15.154:0/1870778642 shutdown_connections 2023-09-30T22:28:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.570+0000 7f3afaaa0700 1 -- 172.21.15.154:0/1870778642 wait complete. 2023-09-30T22:28:07.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3afaaa0700 1 Processor -- start 2023-09-30T22:28:07.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3afaaa0700 1 -- start start 2023-09-30T22:28:07.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3afaaa0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af409e870 0x7f3af406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3afaaa0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 0x7f3af406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3afaaa0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 0x7f3af406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:07.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3afaaa0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4124e40 con 0x7f3af409e870 2023-09-30T22:28:07.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3afaaa0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af41264f0 con 0x7f3af409f350 2023-09-30T22:28:07.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3afaaa0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3af406d4c0 con 0x7f3af41371c0 2023-09-30T22:28:07.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3af883c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af409e870 0x7f3af406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3af883c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af409e870 0x7f3af406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58526/0 (socket says 172.21.15.154:58526) 2023-09-30T22:28:07.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3af883c700 1 -- 172.21.15.154:0/498942435 learned_addr learned my addr 172.21.15.154:0/498942435 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:07.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3af3fff700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 0x7f3af406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.571+0000 7f3af903d700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 0x7f3af406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:07.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af3fff700 1 -- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 msgr2=0x7f3af406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af3fff700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 0x7f3af406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af3fff700 1 -- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af409e870 msgr2=0x7f3af406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af3fff700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af409e870 0x7f3af406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af3fff700 1 -- 172.21.15.154:0/498942435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec009a70 con 0x7f3af409f350 2023-09-30T22:28:07.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af883c700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af409e870 0x7f3af406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:07.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af3fff700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 0x7f3af406bdf0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000e900 tx=0x7f3ae000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:07.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af17fa700 1 -- 172.21.15.154:0/498942435 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0013680 con 0x7f3af409f350 2023-09-30T22:28:07.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af17fa700 1 -- 172.21.15.154:0/498942435 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae00137e0 con 0x7f3af409f350 2023-09-30T22:28:07.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3afaaa0700 1 -- 172.21.15.154:0/498942435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af4136950 con 0x7f3af409f350 2023-09-30T22:28:07.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3af17fa700 1 -- 172.21.15.154:0/498942435 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0013b50 con 0x7f3af409f350 2023-09-30T22:28:07.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.572+0000 7f3afaaa0700 1 -- 172.21.15.154:0/498942435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af409dba0 con 0x7f3af409f350 2023-09-30T22:28:07.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.573+0000 7f3af17fa700 1 -- 172.21.15.154:0/498942435 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ae0013cb0 con 0x7f3af409f350 2023-09-30T22:28:07.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.573+0000 7f3afaaa0700 1 -- 172.21.15.154:0/498942435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af404f2a0 con 0x7f3af409f350 2023-09-30T22:28:07.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.573+0000 7f3af17fa700 1 -- 172.21.15.154:0/498942435 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ae003fb10 con 0x7f3af409f350 2023-09-30T22:28:07.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.582+0000 7f3af17fa700 1 -- 172.21.15.154:0/498942435 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ae001abe0 con 0x7f3af409f350 2023-09-30T22:28:07.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.591+0000 7f86fdbd5700 1 -- 172.21.15.154:0/396858128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86f804f2a0 con 0x7f86f806a770 2023-09-30T22:28:07.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.592+0000 7f86dffff700 1 -- 172.21.15.154:0/396858128 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86e8029020 con 0x7f86f806a770 2023-09-30T22:28:07.592 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:07.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.594+0000 7f86fdbd5700 1 -- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86f806a770 msgr2=0x7f86f811c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.594+0000 7f86fdbd5700 1 --2- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86f806a770 0x7f86f811c0f0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f86f809ec60 tx=0x7f86e8004750 comp rx=0 tx=0).stop 2023-09-30T22:28:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.594+0000 7f86fdbd5700 1 -- 172.21.15.154:0/396858128 shutdown_connections 2023-09-30T22:28:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.594+0000 7f86fdbd5700 1 --2- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f86f8131cf0 0x7f86f81c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.594+0000 7f86fdbd5700 1 --2- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86f806a770 0x7f86f811c0f0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.594+0000 7f86fdbd5700 1 --2- 172.21.15.154:0/396858128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86f806b080 0x7f86f811c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.594+0000 7f86fdbd5700 1 -- 172.21.15.154:0/396858128 >> 172.21.15.154:0/396858128 conn(0x7f86f8099c40 msgr2=0x7f86f80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.594+0000 7f86fdbd5700 1 -- 172.21.15.154:0/396858128 shutdown_connections 2023-09-30T22:28:07.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.594+0000 7f86fdbd5700 1 -- 172.21.15.154:0/396858128 wait complete. 2023-09-30T22:28:07.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:07.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.705+0000 7fa168e36700 1 -- 172.21.15.154:0/1315090344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa148005860 con 0x7fa16409a3d0 2023-09-30T22:28:07.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.705+0000 7fa152ffd700 1 -- 172.21.15.154:0/1315090344 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1580233a0 con 0x7fa16409a3d0 2023-09-30T22:28:07.706 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:07.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.707+0000 7fa168e36700 1 -- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16409a3d0 msgr2=0x7fa1641338e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.707+0000 7fa168e36700 1 --2- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16409a3d0 0x7fa1641338e0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fa158009f70 tx=0x7fa15800ec60 comp rx=0 tx=0).stop 2023-09-30T22:28:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.707+0000 7fa168e36700 1 -- 172.21.15.154:0/1315090344 shutdown_connections 2023-09-30T22:28:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.707+0000 7fa168e36700 1 --2- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa16412d380 0x7fa1641c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.707+0000 7fa168e36700 1 --2- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa164099a60 0x7fa1641333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.707+0000 7fa168e36700 1 --2- 172.21.15.154:0/1315090344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16409a3d0 0x7fa1641338e0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.707+0000 7fa168e36700 1 -- 172.21.15.154:0/1315090344 >> 172.21.15.154:0/1315090344 conn(0x7fa1640a2980 msgr2=0x7fa164071620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.707+0000 7fa168e36700 1 -- 172.21.15.154:0/1315090344 shutdown_connections 2023-09-30T22:28:07.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.707+0000 7fa168e36700 1 -- 172.21.15.154:0/1315090344 wait complete. 2023-09-30T22:28:07.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:07.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.774+0000 7f3afaaa0700 1 -- 172.21.15.154:0/498942435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3af41262d0 con 0x7f3af409f350 2023-09-30T22:28:07.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.774+0000 7f3af17fa700 1 -- 172.21.15.154:0/498942435 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ae0017020 con 0x7f3af409f350 2023-09-30T22:28:07.775 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:07.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.776+0000 7f3afaaa0700 1 -- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 msgr2=0x7f3af406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:07.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.776+0000 7f3afaaa0700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 0x7f3af406bdf0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000e900 tx=0x7f3ae000ec10 comp rx=0 tx=0).stop 2023-09-30T22:28:07.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.777+0000 7f3afaaa0700 1 -- 172.21.15.154:0/498942435 shutdown_connections 2023-09-30T22:28:07.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.777+0000 7f3afaaa0700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3af41371c0 0x7f3af406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.777+0000 7f3afaaa0700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af409e870 0x7f3af406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.777+0000 7f3afaaa0700 1 --2- 172.21.15.154:0/498942435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af409f350 0x7f3af406bdf0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:07.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.777+0000 7f3afaaa0700 1 -- 172.21.15.154:0/498942435 >> 172.21.15.154:0/498942435 conn(0x7f3af40a4430 msgr2=0x7f3af409d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:07.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.777+0000 7f3afaaa0700 1 -- 172.21.15.154:0/498942435 shutdown_connections 2023-09-30T22:28:07.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:07.777+0000 7f3afaaa0700 1 -- 172.21.15.154:0/498942435 wait complete. 2023-09-30T22:28:07.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:08.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:08.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:08.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c52ca3700 1 Processor -- start 2023-09-30T22:28:08.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c52ca3700 1 -- start start 2023-09-30T22:28:08.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c52ca3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c52ca3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c134120 0x7f9c4c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c52ca3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c09dc00 con 0x7f9c4c0a1380 2023-09-30T22:28:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c52ca3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c09ea90 con 0x7f9c4c0a0a70 2023-09-30T22:28:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c52ca3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c09dec0 con 0x7f9c4c134120 2023-09-30T22:28:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c51240700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c134120 0x7f9c4c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c50a3f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c51240700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c134120 0x7f9c4c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44156/0 (socket says 172.21.15.154:44156) 2023-09-30T22:28:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c50a3f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36096/0 (socket says 172.21.15.154:36096) 2023-09-30T22:28:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c51240700 1 -- 172.21.15.154:0/1371771385 learned_addr learned my addr 172.21.15.154:0/1371771385 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.701+0000 7f9c4bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9c4c0a1380 0x7f9c4c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36698/0 (socket says 172.21.15.154:36698) 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c51240700 1 -- 172.21.15.154:0/1371771385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 msgr2=0x7f9c4c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c51240700 1 --2- 172.21.15.154:0/1371771385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c51240700 1 -- 172.21.15.154:0/1371771385 >> v1:172.21.15.154:6789/0 conn(0x7f9c4c0a1380 legacy=0x7f9c4c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c4b7fe700 1 -- 172.21.15.154:0/1371771385 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038732373 0 0) 0x7f9c4c09dc00 con 0x7f9c4c0a1380 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c51240700 1 -- 172.21.15.154:0/1371771385 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c09e6a0 con 0x7f9c4c134120 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c50a3f700 1 --2- 172.21.15.154:0/1371771385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c51240700 1 --2- 172.21.15.154:0/1371771385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c134120 0x7f9c4c13bce0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009e80 tx=0x7f9c4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c88a5a7cc44f3bae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c4b7fe700 1 -- 172.21.15.154:0/1371771385 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400e070 con 0x7f9c4c134120 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c4b7fe700 1 -- 172.21.15.154:0/1371771385 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4400b910 con 0x7f9c4c134120 2023-09-30T22:28:08.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.702+0000 7f9c4b7fe700 1 -- 172.21.15.154:0/1371771385 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400bcc0 con 0x7f9c4c134120 2023-09-30T22:28:08.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.703+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1371771385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c134120 msgr2=0x7f9c4c13bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.703+0000 7f9c52ca3700 1 --2- 172.21.15.154:0/1371771385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c134120 0x7f9c4c13bce0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009e80 tx=0x7f9c4400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:08.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.703+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1371771385 shutdown_connections 2023-09-30T22:28:08.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.703+0000 7f9c52ca3700 1 --2- 172.21.15.154:0/1371771385 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c134120 0x7f9c4c13bce0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.703+0000 7f9c52ca3700 1 --2- 172.21.15.154:0/1371771385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.703+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1371771385 >> 172.21.15.154:0/1371771385 conn(0x7f9c4c0a6610 msgr2=0x7f9c4c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.703+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1371771385 shutdown_connections 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.703+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1371771385 wait complete. 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c52ca3700 1 Processor -- start 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c52ca3700 1 -- start start 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c52ca3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c52ca3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c0a1380 0x7f9c4c122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c52ca3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c134120 0x7f9c4c123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c52ca3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c133420 con 0x7f9c4c134120 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c52ca3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c1245b0 con 0x7f9c4c0a0a70 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c52ca3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c133aa0 con 0x7f9c4c0a1380 2023-09-30T22:28:08.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c51240700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c134120 0x7f9c4c123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.704+0000 7f9c4bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c0a1380 0x7f9c4c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c51240700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c134120 0x7f9c4c123310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58536/0 (socket says 172.21.15.154:58536) 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c51240700 1 -- 172.21.15.154:0/1256807612 learned_addr learned my addr 172.21.15.154:0/1256807612 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c4bfff700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c0a1380 0x7f9c4c122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44158/0 (socket says 172.21.15.154:44158) 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c50a3f700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c4bfff700 1 -- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 msgr2=0x7f9c4c122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c4bfff700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c4bfff700 1 -- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c134120 msgr2=0x7f9c4c123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c4bfff700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c134120 0x7f9c4c123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c4bfff700 1 -- 172.21.15.154:0/1256807612 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c400094a0 con 0x7f9c4c0a1380 2023-09-30T22:28:08.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c51240700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c134120 0x7f9c4c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:08.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c4bfff700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c0a1380 0x7f9c4c122dd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0a2b70 tx=0x7f9c3800c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c497fa700 1 -- 172.21.15.154:0/1256807612 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38004c80 con 0x7f9c4c0a1380 2023-09-30T22:28:08.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c497fa700 1 -- 172.21.15.154:0/1256807612 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c38004de0 con 0x7f9c4c0a1380 2023-09-30T22:28:08.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1256807612 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c44009b30 con 0x7f9c4c0a1380 2023-09-30T22:28:08.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c497fa700 1 -- 172.21.15.154:0/1256807612 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38007310 con 0x7f9c4c0a1380 2023-09-30T22:28:08.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.705+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1256807612 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c0a0430 con 0x7f9c4c0a1380 2023-09-30T22:28:08.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.706+0000 7f9c497fa700 1 -- 172.21.15.154:0/1256807612 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c38007470 con 0x7f9c4c0a1380 2023-09-30T22:28:08.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.706+0000 7f9c497fa700 1 -- 172.21.15.154:0/1256807612 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c3803f2e0 con 0x7f9c4c0a1380 2023-09-30T22:28:08.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.706+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1256807612 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c0a49b0 con 0x7f9c4c0a1380 2023-09-30T22:28:08.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.711+0000 7f9c497fa700 1 -- 172.21.15.154:0/1256807612 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c3801bb70 con 0x7f9c4c0a1380 2023-09-30T22:28:08.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:08.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.741+0000 7fa8c7671700 1 Processor -- start 2023-09-30T22:28:08.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.741+0000 7fa8c7671700 1 -- start start 2023-09-30T22:28:08.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c7671700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c006a770 0x7fa8c006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c7671700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8c009dec0 0x7fa8c006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c7671700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c0131a00 0x7fa8c0131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c7671700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c006b5c0 con 0x7fa8c009dec0 2023-09-30T22:28:08.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c7671700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c006e900 con 0x7fa8c006a770 2023-09-30T22:28:08.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c7671700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c009d180 con 0x7fa8c0131a00 2023-09-30T22:28:08.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c540d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c006a770 0x7fa8c006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c540d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c006a770 0x7fa8c006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36124/0 (socket says 172.21.15.154:36124) 2023-09-30T22:28:08.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c540d700 1 -- 172.21.15.154:0/3320506306 learned_addr learned my addr 172.21.15.154:0/3320506306 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:08.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c4c0c700 1 --2- 172.21.15.154:0/3320506306 >> v2:172.21.15.154:3300/0 conn(0x7fa8c009dec0 0x7fa8c006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c5c0e700 1 --2- 172.21.15.154:0/3320506306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c0131a00 0x7fa8c0131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c540d700 1 -- 172.21.15.154:0/3320506306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c0131a00 msgr2=0x7fa8c0131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:08.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c540d700 1 --2- 172.21.15.154:0/3320506306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c0131a00 0x7fa8c0131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c540d700 1 -- 172.21.15.154:0/3320506306 >> v2:172.21.15.154:3300/0 conn(0x7fa8c009dec0 msgr2=0x7fa8c006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:08.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c540d700 1 --2- 172.21.15.154:0/3320506306 >> v2:172.21.15.154:3300/0 conn(0x7fa8c009dec0 0x7fa8c006b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c540d700 1 -- 172.21.15.154:0/3320506306 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c009e780 con 0x7fa8c006a770 2023-09-30T22:28:08.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c5c0e700 1 --2- 172.21.15.154:0/3320506306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c0131a00 0x7fa8c0131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:08.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.742+0000 7fa8c540d700 1 --2- 172.21.15.154:0/3320506306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c006a770 0x7fa8c006ab40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0098f0 tx=0x7fa8bc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b53806758d82c58a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8b7fff700 1 -- 172.21.15.154:0/3320506306 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011830 con 0x7fa8c006a770 2023-09-30T22:28:08.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8b7fff700 1 -- 172.21.15.154:0/3320506306 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc011990 con 0x7fa8c006a770 2023-09-30T22:28:08.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8b7fff700 1 -- 172.21.15.154:0/3320506306 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011d20 con 0x7fa8c006a770 2023-09-30T22:28:08.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8c7671700 1 -- 172.21.15.154:0/3320506306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c006a770 msgr2=0x7fa8c006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8c7671700 1 --2- 172.21.15.154:0/3320506306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c006a770 0x7fa8c006ab40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0098f0 tx=0x7fa8bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:08.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8c7671700 1 -- 172.21.15.154:0/3320506306 shutdown_connections 2023-09-30T22:28:08.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8c7671700 1 --2- 172.21.15.154:0/3320506306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c006a770 0x7fa8c006ab40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8c7671700 1 --2- 172.21.15.154:0/3320506306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c0131a00 0x7fa8c0131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8c7671700 1 --2- 172.21.15.154:0/3320506306 >> v2:172.21.15.154:3300/0 conn(0x7fa8c009dec0 0x7fa8c006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8c7671700 1 -- 172.21.15.154:0/3320506306 >> 172.21.15.154:0/3320506306 conn(0x7fa8c0099c40 msgr2=0x7fa8c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:08.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8c7671700 1 -- 172.21.15.154:0/3320506306 shutdown_connections 2023-09-30T22:28:08.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.743+0000 7fa8c7671700 1 -- 172.21.15.154:0/3320506306 wait complete. 2023-09-30T22:28:08.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.744+0000 7fa8c7671700 1 Processor -- start 2023-09-30T22:28:08.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.744+0000 7fa8c7671700 1 -- start start 2023-09-30T22:28:08.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c7671700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8c006a770 0x7fa8c009a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c7671700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c009dec0 0x7fa8c009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c7671700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c0131a00 0x7fa8c009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c7671700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c011fcd0 con 0x7fa8c006a770 2023-09-30T22:28:08.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c7671700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c0071d50 con 0x7fa8c0131a00 2023-09-30T22:28:08.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c7671700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c011e620 con 0x7fa8c009dec0 2023-09-30T22:28:08.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c5c0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c0131a00 0x7fa8c009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c5c0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c0131a00 0x7fa8c009af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36140/0 (socket says 172.21.15.154:36140) 2023-09-30T22:28:08.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c5c0e700 1 -- 172.21.15.154:0/3429246653 learned_addr learned my addr 172.21.15.154:0/3429246653 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:08.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c4c0c700 1 --2- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c009dec0 0x7fa8c009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c5c0e700 1 -- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c009dec0 msgr2=0x7fa8c009a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c5c0e700 1 --2- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c009dec0 0x7fa8c009a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c5c0e700 1 -- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8c006a770 msgr2=0x7fa8c009a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c5c0e700 1 --2- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8c006a770 0x7fa8c009a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c5c0e700 1 -- 172.21.15.154:0/3429246653 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8009a70 con 0x7fa8c0131a00 2023-09-30T22:28:08.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.745+0000 7fa8c5c0e700 1 --2- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c0131a00 0x7fa8c009af10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009f00 tx=0x7fa8b800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.746+0000 7fa8b5ffb700 1 -- 172.21.15.154:0/3429246653 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8009d70 con 0x7fa8c0131a00 2023-09-30T22:28:08.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.746+0000 7fa8b5ffb700 1 -- 172.21.15.154:0/3429246653 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b800f040 con 0x7fa8c0131a00 2023-09-30T22:28:08.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.746+0000 7fa8c7671700 1 -- 172.21.15.154:0/3429246653 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8bc009550 con 0x7fa8c0131a00 2023-09-30T22:28:08.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.746+0000 7fa8b5ffb700 1 -- 172.21.15.154:0/3429246653 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800ce20 con 0x7fa8c0131a00 2023-09-30T22:28:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.746+0000 7fa8c7671700 1 -- 172.21.15.154:0/3429246653 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c011f060 con 0x7fa8c0131a00 2023-09-30T22:28:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.747+0000 7fa8b5ffb700 1 -- 172.21.15.154:0/3429246653 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8b8014480 con 0x7fa8c0131a00 2023-09-30T22:28:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.747+0000 7fa8b5ffb700 1 -- 172.21.15.154:0/3429246653 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa8b803fdb0 con 0x7fa8c0131a00 2023-09-30T22:28:08.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.747+0000 7fa8c7671700 1 -- 172.21.15.154:0/3429246653 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c004f2a0 con 0x7fa8c0131a00 2023-09-30T22:28:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.756+0000 7fa8b5ffb700 1 -- 172.21.15.154:0/3429246653 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8b8012930 con 0x7fa8c0131a00 2023-09-30T22:28:08.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:08.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.865+0000 7fd1b497d700 1 Processor -- start 2023-09-30T22:28:08.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.865+0000 7fd1b497d700 1 -- start start 2023-09-30T22:28:08.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1b497d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1b01350d0 0x7fd1b013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1b497d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 0x7fd1b013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1b497d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b009eca0 con 0x7fd1b006a770 2023-09-30T22:28:08.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1b497d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b006b2e0 con 0x7fd1b01350d0 2023-09-30T22:28:08.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1b497d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b009f720 con 0x7fd1b013d210 2023-09-30T22:28:08.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1add9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1b01350d0 0x7fd1b013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1add9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1b01350d0 0x7fd1b013ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58554/0 (socket says 172.21.15.154:58554) 2023-09-30T22:28:08.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1add9b700 1 -- 172.21.15.154:0/1042753438 learned_addr learned my addr 172.21.15.154:0/1042753438 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:08.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1aed9d700 1 --2- 172.21.15.154:0/1042753438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 0x7fd1b013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1add9b700 1 -- 172.21.15.154:0/1042753438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 msgr2=0x7fd1b013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:08.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1add9b700 1 --2- 172.21.15.154:0/1042753438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 0x7fd1b013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1add9b700 1 -- 172.21.15.154:0/1042753438 >> v1:172.21.15.154:6789/0 conn(0x7fd1b006a770 legacy=0x7fd1b01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.866+0000 7fd1add9b700 1 -- 172.21.15.154:0/1042753438 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b006b480 con 0x7fd1b01350d0 2023-09-30T22:28:08.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1add9b700 1 --2- 172.21.15.154:0/1042753438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 0x7fd1b013ccd0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40098f0 tx=0x7fd1a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93644c206df505a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1ad59a700 1 -- 172.21.15.154:0/1042753438 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4011830 con 0x7fd1b01350d0 2023-09-30T22:28:08.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1ad59a700 1 -- 172.21.15.154:0/1042753438 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a4011990 con 0x7fd1b01350d0 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1ad59a700 1 -- 172.21.15.154:0/1042753438 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4011d20 con 0x7fd1b01350d0 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1b497d700 1 -- 172.21.15.154:0/1042753438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 msgr2=0x7fd1b013ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1b497d700 1 --2- 172.21.15.154:0/1042753438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 0x7fd1b013ccd0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40098f0 tx=0x7fd1a4009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1b497d700 1 -- 172.21.15.154:0/1042753438 shutdown_connections 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1b497d700 1 --2- 172.21.15.154:0/1042753438 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 0x7fd1b013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1b497d700 1 --2- 172.21.15.154:0/1042753438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 0x7fd1b013ccd0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.867+0000 7fd1b497d700 1 -- 172.21.15.154:0/1042753438 >> 172.21.15.154:0/1042753438 conn(0x7fd1b0099c40 msgr2=0x7fd1b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.868+0000 7fd1b497d700 1 -- 172.21.15.154:0/1042753438 shutdown_connections 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.868+0000 7fd1b497d700 1 -- 172.21.15.154:0/1042753438 wait complete. 2023-09-30T22:28:08.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1b497d700 1 Processor -- start 2023-09-30T22:28:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1b497d700 1 -- start start 2023-09-30T22:28:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1b497d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b006a770 0x7fd1b0132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1b497d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 0x7fd1b01333d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1b497d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 0x7fd1b0133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1b497d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b0134270 con 0x7fd1b01350d0 2023-09-30T22:28:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1b497d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b0139290 con 0x7fd1b006a770 2023-09-30T22:28:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1b497d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b009f220 con 0x7fd1b013d210 2023-09-30T22:28:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1add9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 0x7fd1b01333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1aed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 0x7fd1b0133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1add9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 0x7fd1b01333d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58566/0 (socket says 172.21.15.154:58566) 2023-09-30T22:28:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.869+0000 7fd1add9b700 1 -- 172.21.15.154:0/14088267 learned_addr learned my addr 172.21.15.154:0/14088267 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1ae59c700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b006a770 0x7fd1b0132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1add9b700 1 -- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 msgr2=0x7fd1b0133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1add9b700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 0x7fd1b0133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1add9b700 1 -- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b006a770 msgr2=0x7fd1b0132e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1add9b700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b006a770 0x7fd1b0132e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1add9b700 1 -- 172.21.15.154:0/14088267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4009550 con 0x7fd1b01350d0 2023-09-30T22:28:08.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1ae59c700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b006a770 0x7fd1b0132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1aed9d700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 0x7fd1b0133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1add9b700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 0x7fd1b01333d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009c40 tx=0x7fd1a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd19effd700 1 -- 172.21.15.154:0/14088267 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4004400 con 0x7fd1b01350d0 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd19effd700 1 -- 172.21.15.154:0/14088267 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a401f070 con 0x7fd1b01350d0 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1b497d700 1 -- 172.21.15.154:0/14088267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b0139550 con 0x7fd1b01350d0 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd19effd700 1 -- 172.21.15.154:0/14088267 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40038e0 con 0x7fd1b01350d0 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.870+0000 7fd1b497d700 1 -- 172.21.15.154:0/14088267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b00717d0 con 0x7fd1b01350d0 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.871+0000 7fd19effd700 1 -- 172.21.15.154:0/14088267 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1a4021030 con 0x7fd1b01350d0 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.871+0000 7fd19effd700 1 -- 172.21.15.154:0/14088267 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1a40409f0 con 0x7fd1b01350d0 2023-09-30T22:28:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.871+0000 7fd1b497d700 1 -- 172.21.15.154:0/14088267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b004f2a0 con 0x7fd1b01350d0 2023-09-30T22:28:08.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.876+0000 7fd19effd700 1 -- 172.21.15.154:0/14088267 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1a40199a0 con 0x7fd1b01350d0 2023-09-30T22:28:08.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.927+0000 7feea8e4e700 1 Processor -- start 2023-09-30T22:28:08.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.927+0000 7feea8e4e700 1 -- start start 2023-09-30T22:28:08.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.928+0000 7feea8e4e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feea40a0a70 0x7feea40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.928+0000 7feea8e4e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea40a1380 0x7feea4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.928+0000 7feea8e4e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea4133f50 0x7feea41343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.928+0000 7feea8e4e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea409e9d0 con 0x7feea40a0a70 2023-09-30T22:28:08.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.928+0000 7feea8e4e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea409dc00 con 0x7feea4133f50 2023-09-30T22:28:08.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.928+0000 7feea8e4e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea409dec0 con 0x7feea40a1380 2023-09-30T22:28:08.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.928+0000 7feea1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea40a1380 0x7feea4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea4133f50 0x7feea41343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea40a1380 0x7feea4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44184/0 (socket says 172.21.15.154:44184) 2023-09-30T22:28:08.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea1d9b700 1 -- 172.21.15.154:0/3369312037 learned_addr learned my addr 172.21.15.154:0/3369312037 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:08.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea259c700 1 --2- 172.21.15.154:0/3369312037 >> v2:172.21.15.154:3300/0 conn(0x7feea40a0a70 0x7feea40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea1d9b700 1 -- 172.21.15.154:0/3369312037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea4133f50 msgr2=0x7feea41343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:08.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea1d9b700 1 --2- 172.21.15.154:0/3369312037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea4133f50 0x7feea41343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea1d9b700 1 -- 172.21.15.154:0/3369312037 >> v2:172.21.15.154:3300/0 conn(0x7feea40a0a70 msgr2=0x7feea40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:08.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea1d9b700 1 --2- 172.21.15.154:0/3369312037 >> v2:172.21.15.154:3300/0 conn(0x7feea40a0a70 0x7feea40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea1d9b700 1 -- 172.21.15.154:0/3369312037 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea409e6a0 con 0x7feea40a1380 2023-09-30T22:28:08.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea2d9d700 1 --2- 172.21.15.154:0/3369312037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea4133f50 0x7feea41343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:08.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea1d9b700 1 --2- 172.21.15.154:0/3369312037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea40a1380 0x7feea4133a10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fee980098f0 tx=0x7fee98009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9808407d2b654445 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea159a700 1 -- 172.21.15.154:0/3369312037 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98011830 con 0x7feea40a1380 2023-09-30T22:28:08.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea159a700 1 -- 172.21.15.154:0/3369312037 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98011990 con 0x7feea40a1380 2023-09-30T22:28:08.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.929+0000 7feea159a700 1 -- 172.21.15.154:0/3369312037 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98011d20 con 0x7feea40a1380 2023-09-30T22:28:08.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.930+0000 7feea8e4e700 1 -- 172.21.15.154:0/3369312037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea40a1380 msgr2=0x7feea4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.930+0000 7feea8e4e700 1 --2- 172.21.15.154:0/3369312037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea40a1380 0x7feea4133a10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fee980098f0 tx=0x7fee98009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:08.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.930+0000 7feea8e4e700 1 -- 172.21.15.154:0/3369312037 shutdown_connections 2023-09-30T22:28:08.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.930+0000 7feea8e4e700 1 --2- 172.21.15.154:0/3369312037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea4133f50 0x7feea41343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.930+0000 7feea8e4e700 1 --2- 172.21.15.154:0/3369312037 >> v2:172.21.15.154:3300/0 conn(0x7feea40a0a70 0x7feea40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.930+0000 7feea8e4e700 1 --2- 172.21.15.154:0/3369312037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea40a1380 0x7feea4133a10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.930+0000 7feea8e4e700 1 -- 172.21.15.154:0/3369312037 >> 172.21.15.154:0/3369312037 conn(0x7feea40a6610 msgr2=0x7feea40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:08.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.930+0000 7feea8e4e700 1 -- 172.21.15.154:0/3369312037 shutdown_connections 2023-09-30T22:28:08.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.930+0000 7feea8e4e700 1 -- 172.21.15.154:0/3369312037 wait complete. 2023-09-30T22:28:08.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.931+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1256807612 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c4c04f2a0 con 0x7f9c4c0a1380 2023-09-30T22:28:08.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.931+0000 7f9c497fa700 1 -- 172.21.15.154:0/1256807612 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c3801b760 con 0x7f9c4c0a1380 2023-09-30T22:28:08.935 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:08.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea8e4e700 1 Processor -- start 2023-09-30T22:28:08.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea8e4e700 1 -- start start 2023-09-30T22:28:08.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea8e4e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40a0a70 0x7feea411f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea8e4e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40a1380 0x7feea411f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea8e4e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea4133f50 0x7feea411fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:08.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea8e4e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea4122e80 con 0x7feea40a1380 2023-09-30T22:28:08.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea8e4e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea4122970 con 0x7feea40a0a70 2023-09-30T22:28:08.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea8e4e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea4121e10 con 0x7feea4133f50 2023-09-30T22:28:08.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea4133f50 0x7feea411fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea4133f50 0x7feea411fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44188/0 (socket says 172.21.15.154:44188) 2023-09-30T22:28:08.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea2d9d700 1 -- 172.21.15.154:0/2632224081 learned_addr learned my addr 172.21.15.154:0/2632224081 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:08.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea259c700 1 --2- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40a0a70 0x7feea411f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.932+0000 7feea1d9b700 1 --2- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40a1380 0x7feea411f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:08.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7feea2d9d700 1 -- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40a0a70 msgr2=0x7feea411f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7feea2d9d700 1 --2- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40a0a70 0x7feea411f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7feea2d9d700 1 -- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40a1380 msgr2=0x7feea411f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7feea2d9d700 1 --2- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40a1380 0x7feea411f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7feea2d9d700 1 -- 172.21.15.154:0/2632224081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c009a70 con 0x7feea4133f50 2023-09-30T22:28:08.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7feea2d9d700 1 --2- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea4133f50 0x7feea411fde0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00efc0 tx=0x7fee9c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:08.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7fee92ffd700 1 -- 172.21.15.154:0/2632224081 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00cb40 con 0x7feea4133f50 2023-09-30T22:28:08.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7fee92ffd700 1 -- 172.21.15.154:0/2632224081 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00f040 con 0x7feea4133f50 2023-09-30T22:28:08.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7feea8e4e700 1 -- 172.21.15.154:0/2632224081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee98009550 con 0x7feea4133f50 2023-09-30T22:28:08.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7fee92ffd700 1 -- 172.21.15.154:0/2632224081 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c003a20 con 0x7feea4133f50 2023-09-30T22:28:08.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.933+0000 7feea8e4e700 1 -- 172.21.15.154:0/2632224081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea40a03e0 con 0x7feea4133f50 2023-09-30T22:28:08.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.934+0000 7fee92ffd700 1 -- 172.21.15.154:0/2632224081 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee9c014480 con 0x7feea4133f50 2023-09-30T22:28:08.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.934+0000 7fee92ffd700 1 -- 172.21.15.154:0/2632224081 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee9c0402b0 con 0x7feea4133f50 2023-09-30T22:28:08.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.934+0000 7feea8e4e700 1 -- 172.21.15.154:0/2632224081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea409b5b0 con 0x7feea4133f50 2023-09-30T22:28:08.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.935+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c0a1380 msgr2=0x7f9c4c122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.935+0000 7f9c52ca3700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c0a1380 0x7f9c4c122dd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0a2b70 tx=0x7f9c3800c750 comp rx=0 tx=0).stop 2023-09-30T22:28:08.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.935+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1256807612 shutdown_connections 2023-09-30T22:28:08.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.935+0000 7f9c52ca3700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c134120 0x7f9c4c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.935+0000 7f9c52ca3700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0a0a70 0x7f9c4c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.935+0000 7f9c52ca3700 1 --2- 172.21.15.154:0/1256807612 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9c4c0a1380 0x7f9c4c122dd0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.935+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1256807612 >> 172.21.15.154:0/1256807612 conn(0x7f9c4c0a6610 msgr2=0x7f9c4c0a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:08.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.935+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1256807612 shutdown_connections 2023-09-30T22:28:08.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.935+0000 7f9c52ca3700 1 -- 172.21.15.154:0/1256807612 wait complete. 2023-09-30T22:28:08.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.943+0000 7fee92ffd700 1 -- 172.21.15.154:0/2632224081 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee9c012930 con 0x7feea4133f50 2023-09-30T22:28:08.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:08.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.974+0000 7fa8c7671700 1 -- 172.21.15.154:0/3429246653 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa8c009e380 con 0x7fa8c0131a00 2023-09-30T22:28:08.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.975+0000 7fa8b5ffb700 1 -- 172.21.15.154:0/3429246653 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8b8012340 con 0x7fa8c0131a00 2023-09-30T22:28:08.975 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:08.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.977+0000 7fa8c7671700 1 -- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c0131a00 msgr2=0x7fa8c009af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:08.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.977+0000 7fa8c7671700 1 --2- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c0131a00 0x7fa8c009af10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009f00 tx=0x7fa8b800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.977+0000 7fa8c7671700 1 -- 172.21.15.154:0/3429246653 shutdown_connections 2023-09-30T22:28:08.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.977+0000 7fa8c7671700 1 --2- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8c0131a00 0x7fa8c009af10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.977+0000 7fa8c7671700 1 --2- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8c006a770 0x7fa8c009a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.977+0000 7fa8c7671700 1 --2- 172.21.15.154:0/3429246653 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa8c009dec0 0x7fa8c009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:08.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.977+0000 7fa8c7671700 1 -- 172.21.15.154:0/3429246653 >> 172.21.15.154:0/3429246653 conn(0x7fa8c0099c40 msgr2=0x7fa8c012edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:08.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.977+0000 7fa8c7671700 1 -- 172.21.15.154:0/3429246653 shutdown_connections 2023-09-30T22:28:08.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:08.977+0000 7fa8c7671700 1 -- 172.21.15.154:0/3429246653 wait complete. 2023-09-30T22:28:08.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.079+0000 7fd1b497d700 1 -- 172.21.15.154:0/14088267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd1b006c3b0 con 0x7fd1b01350d0 2023-09-30T22:28:09.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.079+0000 7fd19effd700 1 -- 172.21.15.154:0/14088267 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1a4015020 con 0x7fd1b01350d0 2023-09-30T22:28:09.079 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.081+0000 7fd1b497d700 1 -- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 msgr2=0x7fd1b01333d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.081+0000 7fd1b497d700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 0x7fd1b01333d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009c40 tx=0x7fd1a4004750 comp rx=0 tx=0).stop 2023-09-30T22:28:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.081+0000 7fd1b497d700 1 -- 172.21.15.154:0/14088267 shutdown_connections 2023-09-30T22:28:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.081+0000 7fd1b497d700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1b013d210 0x7fd1b0133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.081+0000 7fd1b497d700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b006a770 0x7fd1b0132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.081+0000 7fd1b497d700 1 --2- 172.21.15.154:0/14088267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b01350d0 0x7fd1b01333d0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.081+0000 7fd1b497d700 1 -- 172.21.15.154:0/14088267 >> 172.21.15.154:0/14088267 conn(0x7fd1b0099c40 msgr2=0x7fd1b009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:09.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.081+0000 7fd1b497d700 1 -- 172.21.15.154:0/14088267 shutdown_connections 2023-09-30T22:28:09.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.081+0000 7fd1b497d700 1 -- 172.21.15.154:0/14088267 wait complete. 2023-09-30T22:28:09.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:09.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.138+0000 7feea8e4e700 1 -- 172.21.15.154:0/2632224081 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feea404f2a0 con 0x7feea4133f50 2023-09-30T22:28:09.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.139+0000 7fee92ffd700 1 -- 172.21.15.154:0/2632224081 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee9c012340 con 0x7feea4133f50 2023-09-30T22:28:09.139 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:09.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.141+0000 7feea8e4e700 1 -- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea4133f50 msgr2=0x7feea411fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:09.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.141+0000 7feea8e4e700 1 --2- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea4133f50 0x7feea411fde0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00efc0 tx=0x7fee9c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.141+0000 7feea8e4e700 1 -- 172.21.15.154:0/2632224081 shutdown_connections 2023-09-30T22:28:09.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.141+0000 7feea8e4e700 1 --2- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7feea4133f50 0x7feea411fde0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.141+0000 7feea8e4e700 1 --2- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40a0a70 0x7feea411f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.141+0000 7feea8e4e700 1 --2- 172.21.15.154:0/2632224081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40a1380 0x7feea411f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:09.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.141+0000 7feea8e4e700 1 -- 172.21.15.154:0/2632224081 >> 172.21.15.154:0/2632224081 conn(0x7feea40a6610 msgr2=0x7feea40a5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:09.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.141+0000 7feea8e4e700 1 -- 172.21.15.154:0/2632224081 shutdown_connections 2023-09-30T22:28:09.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:09.141+0000 7feea8e4e700 1 -- 172.21.15.154:0/2632224081 wait complete. 2023-09-30T22:28:09.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:09.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:09.991 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:10.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:10.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.089+0000 7fcce30a8700 1 Processor -- start 2023-09-30T22:28:10.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.089+0000 7fcce30a8700 1 -- start start 2023-09-30T22:28:10.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce30a8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fccdc12feb0 0x7fccdc130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce30a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc099af0 0x7fccdc137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce30a8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc09a540 con 0x7fccdc1307c0 2023-09-30T22:28:10.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce30a8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc09ad40 con 0x7fccdc12feb0 2023-09-30T22:28:10.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce30a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc09e640 con 0x7fccdc099af0 2023-09-30T22:28:10.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce0e44700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fccdc12feb0 0x7fccdc130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce1645700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc099af0 0x7fccdc137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce0e44700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fccdc12feb0 0x7fccdc130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58594/0 (socket says 172.21.15.154:58594) 2023-09-30T22:28:10.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce1645700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc099af0 0x7fccdc137ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36176/0 (socket says 172.21.15.154:36176) 2023-09-30T22:28:10.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce0e44700 1 -- 172.21.15.154:0/3129414414 learned_addr learned my addr 172.21.15.154:0/3129414414 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:10.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fccdbfff700 1 --1- 172.21.15.154:0/3129414414 >> v1:172.21.15.154:6789/0 conn(0x7fccdc1307c0 0x7fccdc0993e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36726/0 (socket says 172.21.15.154:36726) 2023-09-30T22:28:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce0e44700 1 -- 172.21.15.154:0/3129414414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc099af0 msgr2=0x7fccdc137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce0e44700 1 --2- 172.21.15.154:0/3129414414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc099af0 0x7fccdc137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce0e44700 1 -- 172.21.15.154:0/3129414414 >> v1:172.21.15.154:6789/0 conn(0x7fccdc1307c0 legacy=0x7fccdc0993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce0e44700 1 -- 172.21.15.154:0/3129414414 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc09e3c0 con 0x7fccdc12feb0 2023-09-30T22:28:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce1645700 1 --2- 172.21.15.154:0/3129414414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc099af0 0x7fccdc137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.090+0000 7fcce0e44700 1 --2- 172.21.15.154:0/3129414414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc12feb0 0x7fccdc130280 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006fd0 tx=0x7fccd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad690a6c60b547ee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fccdb7fe700 1 -- 172.21.15.154:0/3129414414 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0005e30 con 0x7fccdc12feb0 2023-09-30T22:28:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fccdb7fe700 1 -- 172.21.15.154:0/3129414414 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd0004030 con 0x7fccdc12feb0 2023-09-30T22:28:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fccdb7fe700 1 -- 172.21.15.154:0/3129414414 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00043e0 con 0x7fccdc12feb0 2023-09-30T22:28:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fcce30a8700 1 -- 172.21.15.154:0/3129414414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc12feb0 msgr2=0x7fccdc130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fcce30a8700 1 --2- 172.21.15.154:0/3129414414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc12feb0 0x7fccdc130280 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006fd0 tx=0x7fccd0009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fcce30a8700 1 -- 172.21.15.154:0/3129414414 shutdown_connections 2023-09-30T22:28:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fcce30a8700 1 --2- 172.21.15.154:0/3129414414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc099af0 0x7fccdc137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fcce30a8700 1 --2- 172.21.15.154:0/3129414414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc12feb0 0x7fccdc130280 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fcce30a8700 1 -- 172.21.15.154:0/3129414414 >> 172.21.15.154:0/3129414414 conn(0x7fccdc0a2b30 msgr2=0x7fccdc09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fcce30a8700 1 -- 172.21.15.154:0/3129414414 shutdown_connections 2023-09-30T22:28:10.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.091+0000 7fcce30a8700 1 -- 172.21.15.154:0/3129414414 wait complete. 2023-09-30T22:28:10.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.092+0000 7fcce30a8700 1 Processor -- start 2023-09-30T22:28:10.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.092+0000 7fcce30a8700 1 -- start start 2023-09-30T22:28:10.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce30a8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc099af0 0x7fccdc128cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce30a8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc12feb0 0x7fccdc1291f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce30a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccdc1307c0 0x7fccdc129730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce30a8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc072370 con 0x7fccdc099af0 2023-09-30T22:28:10.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce30a8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc06d920 con 0x7fccdc12feb0 2023-09-30T22:28:10.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce30a8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc06f430 con 0x7fccdc1307c0 2023-09-30T22:28:10.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fccdbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc12feb0 0x7fccdc1291f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce0e44700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc099af0 0x7fccdc128cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fccdbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc12feb0 0x7fccdc1291f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36188/0 (socket says 172.21.15.154:36188) 2023-09-30T22:28:10.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce0e44700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc099af0 0x7fccdc128cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58602/0 (socket says 172.21.15.154:58602) 2023-09-30T22:28:10.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fccdbfff700 1 -- 172.21.15.154:0/559618266 learned_addr learned my addr 172.21.15.154:0/559618266 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:10.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce1645700 1 --2- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccdc1307c0 0x7fccdc129730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fccdbfff700 1 -- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccdc1307c0 msgr2=0x7fccdc129730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fccdbfff700 1 --2- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccdc1307c0 0x7fccdc129730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fccdbfff700 1 -- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc099af0 msgr2=0x7fccdc128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fccdbfff700 1 --2- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc099af0 0x7fccdc128cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fccdbfff700 1 -- 172.21.15.154:0/559618266 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd400ab80 con 0x7fccdc12feb0 2023-09-30T22:28:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fcce0e44700 1 --2- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc099af0 0x7fccdc128cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.093+0000 7fccdbfff700 1 --2- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc12feb0 0x7fccdc1291f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c520 tx=0x7fccc800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.094+0000 7fccd97fa700 1 -- 172.21.15.154:0/559618266 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc8005cb0 con 0x7fccdc12feb0 2023-09-30T22:28:10.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.094+0000 7fccd97fa700 1 -- 172.21.15.154:0/559618266 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc8005e10 con 0x7fccdc12feb0 2023-09-30T22:28:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.094+0000 7fcce30a8700 1 -- 172.21.15.154:0/559618266 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd0009500 con 0x7fccdc12feb0 2023-09-30T22:28:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.094+0000 7fccd97fa700 1 -- 172.21.15.154:0/559618266 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80072d0 con 0x7fccdc12feb0 2023-09-30T22:28:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.094+0000 7fcce30a8700 1 -- 172.21.15.154:0/559618266 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc1288e0 con 0x7fccdc12feb0 2023-09-30T22:28:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.095+0000 7fccd97fa700 1 -- 172.21.15.154:0/559618266 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccc8007430 con 0x7fccdc12feb0 2023-09-30T22:28:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.095+0000 7fcce30a8700 1 -- 172.21.15.154:0/559618266 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc04f2a0 con 0x7fccdc12feb0 2023-09-30T22:28:10.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.095+0000 7fccd97fa700 1 -- 172.21.15.154:0/559618266 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fccc803ea10 con 0x7fccdc12feb0 2023-09-30T22:28:10.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.099+0000 7fccd97fa700 1 -- 172.21.15.154:0/559618266 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccc8017020 con 0x7fccdc12feb0 2023-09-30T22:28:10.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.127+0000 7f95bb2c1700 1 Processor -- start 2023-09-30T22:28:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.127+0000 7f95bb2c1700 1 -- start start 2023-09-30T22:28:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95bb2c1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95b409d860 0x7f95b409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95bb2c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409e170 0x7f95b41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95bb2c1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b409aaa0 con 0x7f95b4130ce0 2023-09-30T22:28:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95bb2c1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b409f870 con 0x7f95b409d860 2023-09-30T22:28:10.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95bb2c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95b409b360 con 0x7f95b409e170 2023-09-30T22:28:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95b905d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95b409d860 0x7f95b409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95b905d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95b409d860 0x7f95b409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58610/0 (socket says 172.21.15.154:58610) 2023-09-30T22:28:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95b905d700 1 -- 172.21.15.154:0/1804593625 learned_addr learned my addr 172.21.15.154:0/1804593625 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95b885c700 1 --2- 172.21.15.154:0/1804593625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409e170 0x7f95b41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95b885c700 1 -- 172.21.15.154:0/1804593625 >> v2:172.21.15.154:3300/0 conn(0x7f95b409d860 msgr2=0x7f95b409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95b885c700 1 --2- 172.21.15.154:0/1804593625 >> v2:172.21.15.154:3300/0 conn(0x7f95b409d860 0x7f95b409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95b885c700 1 -- 172.21.15.154:0/1804593625 >> v1:172.21.15.154:6789/0 conn(0x7f95b4130ce0 legacy=0x7f95b41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.128+0000 7f95b885c700 1 -- 172.21.15.154:0/1804593625 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b409b620 con 0x7f95b409e170 2023-09-30T22:28:10.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.129+0000 7f95b885c700 1 --2- 172.21.15.154:0/1804593625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409e170 0x7f95b41307a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009840 tx=0x7f95a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd6d0d9eaf816e85 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.129+0000 7f95abfff700 1 -- 172.21.15.154:0/1804593625 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4004230 con 0x7f95b409e170 2023-09-30T22:28:10.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.129+0000 7f95abfff700 1 -- 172.21.15.154:0/1804593625 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4004390 con 0x7f95b409e170 2023-09-30T22:28:10.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.129+0000 7f95abfff700 1 -- 172.21.15.154:0/1804593625 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40036a0 con 0x7f95b409e170 2023-09-30T22:28:10.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.129+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1804593625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409e170 msgr2=0x7f95b41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.129+0000 7f95bb2c1700 1 --2- 172.21.15.154:0/1804593625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409e170 0x7f95b41307a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009840 tx=0x7f95a4009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:10.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.130+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1804593625 shutdown_connections 2023-09-30T22:28:10.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.130+0000 7f95bb2c1700 1 --2- 172.21.15.154:0/1804593625 >> v2:172.21.15.154:3300/0 conn(0x7f95b409d860 0x7f95b409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.130+0000 7f95bb2c1700 1 --2- 172.21.15.154:0/1804593625 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409e170 0x7f95b41307a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.130+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1804593625 >> 172.21.15.154:0/1804593625 conn(0x7f95b4099c40 msgr2=0x7f95b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.130+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1804593625 shutdown_connections 2023-09-30T22:28:10.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.130+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1804593625 wait complete. 2023-09-30T22:28:10.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.131+0000 7f95bb2c1700 1 Processor -- start 2023-09-30T22:28:10.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.131+0000 7f95bb2c1700 1 -- start start 2023-09-30T22:28:10.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95bb2c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409d860 0x7f95b41231c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95bb2c1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95b409e170 0x7f95b4123700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95bb2c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95b4130ce0 0x7f95b4123c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95bb2c1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40a2240 con 0x7f95b409e170 2023-09-30T22:28:10.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95bb2c1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b409c8b0 con 0x7f95b4130ce0 2023-09-30T22:28:10.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95bb2c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95b4126310 con 0x7f95b409d860 2023-09-30T22:28:10.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95b885c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95b409e170 0x7f95b4123700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95b885c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95b409e170 0x7f95b4123700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58618/0 (socket says 172.21.15.154:58618) 2023-09-30T22:28:10.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95b885c700 1 -- 172.21.15.154:0/1918078165 learned_addr learned my addr 172.21.15.154:0/1918078165 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:10.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95b905d700 1 --2- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409d860 0x7f95b41231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.132+0000 7f95b985e700 1 --2- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95b4130ce0 0x7f95b4123c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95b885c700 1 -- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409d860 msgr2=0x7f95b41231c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95b885c700 1 --2- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409d860 0x7f95b41231c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95b885c700 1 -- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95b4130ce0 msgr2=0x7f95b4123c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95b885c700 1 --2- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95b4130ce0 0x7f95b4123c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95b885c700 1 -- 172.21.15.154:0/1918078165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40094a0 con 0x7f95b409e170 2023-09-30T22:28:10.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95b885c700 1 --2- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95b409e170 0x7f95b4123700 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f95a40090b0 tx=0x7f95a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95a9ffb700 1 -- 172.21.15.154:0/1918078165 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4003df0 con 0x7f95b409e170 2023-09-30T22:28:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95a9ffb700 1 -- 172.21.15.154:0/1918078165 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4011630 con 0x7f95b409e170 2023-09-30T22:28:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95a9ffb700 1 -- 172.21.15.154:0/1918078165 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40119e0 con 0x7f95b409e170 2023-09-30T22:28:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1918078165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b4126d80 con 0x7f95b409e170 2023-09-30T22:28:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.133+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1918078165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b4124670 con 0x7f95b409e170 2023-09-30T22:28:10.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.134+0000 7f95a9ffb700 1 -- 172.21.15.154:0/1918078165 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95a4018040 con 0x7f95b409e170 2023-09-30T22:28:10.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.134+0000 7f95a9ffb700 1 -- 172.21.15.154:0/1918078165 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f95a403fe00 con 0x7f95b409e170 2023-09-30T22:28:10.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.135+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1918078165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b4124860 con 0x7f95b409e170 2023-09-30T22:28:10.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.140+0000 7f95a9ffb700 1 -- 172.21.15.154:0/1918078165 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95a4016080 con 0x7f95b409e170 2023-09-30T22:28:10.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:10.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.236+0000 7f8c17a48700 1 Processor -- start 2023-09-30T22:28:10.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.236+0000 7f8c17a48700 1 -- start start 2023-09-30T22:28:10.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c17a48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10133ad0 0x7f8c10133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c17a48700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c10130bc0 0x7f8c1013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c17a48700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1006b2d0 con 0x7f8c101300a0 2023-09-30T22:28:10.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c17a48700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c10133610 con 0x7f8c10130bc0 2023-09-30T22:28:10.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c17a48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1009a500 con 0x7f8c10133ad0 2023-09-30T22:28:10.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c157e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10133ad0 0x7f8c10133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c157e4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10133ad0 0x7f8c10133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36218/0 (socket says 172.21.15.154:36218) 2023-09-30T22:28:10.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c157e4700 1 -- 172.21.15.154:0/3438288560 learned_addr learned my addr 172.21.15.154:0/3438288560 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:10.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c15fe5700 1 --2- 172.21.15.154:0/3438288560 >> v2:172.21.15.154:3300/0 conn(0x7f8c10130bc0 0x7f8c1013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c157e4700 1 -- 172.21.15.154:0/3438288560 >> v2:172.21.15.154:3300/0 conn(0x7f8c10130bc0 msgr2=0x7f8c1013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c157e4700 1 --2- 172.21.15.154:0/3438288560 >> v2:172.21.15.154:3300/0 conn(0x7f8c10130bc0 0x7f8c1013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c157e4700 1 -- 172.21.15.154:0/3438288560 >> v1:172.21.15.154:6789/0 conn(0x7f8c101300a0 legacy=0x7f8c101304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c157e4700 1 -- 172.21.15.154:0/3438288560 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c101338b0 con 0x7f8c10133ad0 2023-09-30T22:28:10.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.237+0000 7f8c157e4700 1 --2- 172.21.15.154:0/3438288560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10133ad0 0x7f8c10133ea0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0098f0 tx=0x7f8c0c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2374c484005101d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c07fff700 1 -- 172.21.15.154:0/3438288560 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c004230 con 0x7f8c10133ad0 2023-09-30T22:28:10.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c07fff700 1 -- 172.21.15.154:0/3438288560 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c004390 con 0x7f8c10133ad0 2023-09-30T22:28:10.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c07fff700 1 -- 172.21.15.154:0/3438288560 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0036a0 con 0x7f8c10133ad0 2023-09-30T22:28:10.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c17a48700 1 -- 172.21.15.154:0/3438288560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10133ad0 msgr2=0x7f8c10133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c17a48700 1 --2- 172.21.15.154:0/3438288560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10133ad0 0x7f8c10133ea0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0098f0 tx=0x7f8c0c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:10.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c17a48700 1 -- 172.21.15.154:0/3438288560 shutdown_connections 2023-09-30T22:28:10.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c17a48700 1 --2- 172.21.15.154:0/3438288560 >> v2:172.21.15.154:3300/0 conn(0x7f8c10130bc0 0x7f8c1013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c17a48700 1 --2- 172.21.15.154:0/3438288560 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10133ad0 0x7f8c10133ea0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c17a48700 1 -- 172.21.15.154:0/3438288560 >> 172.21.15.154:0/3438288560 conn(0x7f8c10099c40 msgr2=0x7f8c100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c17a48700 1 -- 172.21.15.154:0/3438288560 shutdown_connections 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.238+0000 7f8c17a48700 1 -- 172.21.15.154:0/3438288560 wait complete. 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.239+0000 7f8c17a48700 1 Processor -- start 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.239+0000 7f8c17a48700 1 -- start start 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c17a48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c101300a0 0x7f8c1011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c17a48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10130bc0 0x7f8c1011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c17a48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c10133ad0 0x7f8c1011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c17a48700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1011fb90 con 0x7f8c101300a0 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c17a48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1012da50 con 0x7f8c10130bc0 2023-09-30T22:28:10.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c17a48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c10072230 con 0x7f8c10133ad0 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c15fe5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c10133ad0 0x7f8c1011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c15fe5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c10133ad0 0x7f8c1011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44228/0 (socket says 172.21.15.154:44228) 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c15fe5700 1 -- 172.21.15.154:0/1812942214 learned_addr learned my addr 172.21.15.154:0/1812942214 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c14fe3700 1 --2- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10130bc0 0x7f8c1011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c157e4700 1 --2- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c101300a0 0x7f8c1011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c14fe3700 1 -- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c10133ad0 msgr2=0x7f8c1011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c14fe3700 1 --2- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c10133ad0 0x7f8c1011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c14fe3700 1 -- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c101300a0 msgr2=0x7f8c1011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c14fe3700 1 --2- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c101300a0 0x7f8c1011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.240+0000 7f8c14fe3700 1 -- 172.21.15.154:0/1812942214 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c009550 con 0x7f8c10130bc0 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.241+0000 7f8c14fe3700 1 --2- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10130bc0 0x7f8c1011df80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000b3c0 tx=0x7f8c0000b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.241+0000 7f8c05ffb700 1 -- 172.21.15.154:0/1812942214 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00011620 con 0x7f8c10130bc0 2023-09-30T22:28:10.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.241+0000 7f8c05ffb700 1 -- 172.21.15.154:0/1812942214 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c00011780 con 0x7f8c10130bc0 2023-09-30T22:28:10.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.241+0000 7f8c05ffb700 1 -- 172.21.15.154:0/1812942214 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00011b30 con 0x7f8c10130bc0 2023-09-30T22:28:10.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.241+0000 7f8c17a48700 1 -- 172.21.15.154:0/1812942214 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1011fe50 con 0x7f8c10130bc0 2023-09-30T22:28:10.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.241+0000 7f8c17a48700 1 -- 172.21.15.154:0/1812942214 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1012fbb0 con 0x7f8c10130bc0 2023-09-30T22:28:10.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.242+0000 7f8c05ffb700 1 -- 172.21.15.154:0/1812942214 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c00011c90 con 0x7f8c10130bc0 2023-09-30T22:28:10.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.242+0000 7f8c05ffb700 1 -- 172.21.15.154:0/1812942214 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c00010dd0 con 0x7f8c10130bc0 2023-09-30T22:28:10.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.242+0000 7f8c17a48700 1 -- 172.21.15.154:0/1812942214 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c100718c0 con 0x7f8c10130bc0 2023-09-30T22:28:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.251+0000 7f8c05ffb700 1 -- 172.21.15.154:0/1812942214 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c00015070 con 0x7f8c10130bc0 2023-09-30T22:28:10.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66e5af7700 1 Processor -- start 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66e5af7700 1 -- start start 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66e5af7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66e009d860 0x7f66e009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66e5af7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 0x7f66e01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66e5af7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e0130ce0 0x7f66e0131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66e5af7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e0131670 con 0x7f66e009d860 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66e5af7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e009aaa0 con 0x7f66e0130ce0 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66e5af7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66e009f870 con 0x7f66e009e170 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66dffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e0130ce0 0x7f66e0131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66dffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e0130ce0 0x7f66e0131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36232/0 (socket says 172.21.15.154:36232) 2023-09-30T22:28:10.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66df7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66e009d860 0x7f66e009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66dffff700 1 -- 172.21.15.154:0/1693783672 learned_addr learned my addr 172.21.15.154:0/1693783672 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.288+0000 7f66deffd700 1 --2- 172.21.15.154:0/1693783672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 0x7f66e01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66dffff700 1 -- 172.21.15.154:0/1693783672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 msgr2=0x7f66e01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66dffff700 1 --2- 172.21.15.154:0/1693783672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 0x7f66e01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66dffff700 1 -- 172.21.15.154:0/1693783672 >> v2:172.21.15.154:3300/0 conn(0x7f66e009d860 msgr2=0x7f66e009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66dffff700 1 --2- 172.21.15.154:0/1693783672 >> v2:172.21.15.154:3300/0 conn(0x7f66e009d860 0x7f66e009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66dffff700 1 -- 172.21.15.154:0/1693783672 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e009b360 con 0x7f66e0130ce0 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66df7fe700 1 --2- 172.21.15.154:0/1693783672 >> v2:172.21.15.154:3300/0 conn(0x7f66e009d860 0x7f66e009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66dffff700 1 --2- 172.21.15.154:0/1693783672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e0130ce0 0x7f66e0131130 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f66d800bef0 tx=0x7f66d8009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15bb51dba30953e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66de7fc700 1 -- 172.21.15.154:0/1693783672 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800b480 con 0x7f66e0130ce0 2023-09-30T22:28:10.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66de7fc700 1 -- 172.21.15.154:0/1693783672 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800c950 con 0x7f66e0130ce0 2023-09-30T22:28:10.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.289+0000 7f66de7fc700 1 -- 172.21.15.154:0/1693783672 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800cd00 con 0x7f66e0130ce0 2023-09-30T22:28:10.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.290+0000 7f66e5af7700 1 -- 172.21.15.154:0/1693783672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e0130ce0 msgr2=0x7f66e0131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.290+0000 7f66e5af7700 1 --2- 172.21.15.154:0/1693783672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e0130ce0 0x7f66e0131130 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f66d800bef0 tx=0x7f66d8009370 comp rx=0 tx=0).stop 2023-09-30T22:28:10.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.290+0000 7f66e5af7700 1 -- 172.21.15.154:0/1693783672 shutdown_connections 2023-09-30T22:28:10.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.290+0000 7f66e5af7700 1 --2- 172.21.15.154:0/1693783672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e0130ce0 0x7f66e0131130 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.290+0000 7f66e5af7700 1 --2- 172.21.15.154:0/1693783672 >> v2:172.21.15.154:3300/0 conn(0x7f66e009d860 0x7f66e009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.290+0000 7f66e5af7700 1 --2- 172.21.15.154:0/1693783672 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 0x7f66e01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.290+0000 7f66e5af7700 1 -- 172.21.15.154:0/1693783672 >> 172.21.15.154:0/1693783672 conn(0x7f66e0099c40 msgr2=0x7f66e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.290+0000 7f66e5af7700 1 -- 172.21.15.154:0/1693783672 shutdown_connections 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.290+0000 7f66e5af7700 1 -- 172.21.15.154:0/1693783672 wait complete. 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66e5af7700 1 Processor -- start 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66e5af7700 1 -- start start 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66e5af7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e009d860 0x7f66e011cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66e5af7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 0x7f66e011d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66e5af7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e0130ce0 0x7f66e011d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66e5af7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e01212d0 con 0x7f66e0130ce0 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66e5af7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e011ea00 con 0x7f66e009d860 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66e5af7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66e011f020 con 0x7f66e009e170 2023-09-30T22:28:10.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66dffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e0130ce0 0x7f66e011d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66dffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e0130ce0 0x7f66e011d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58654/0 (socket says 172.21.15.154:58654) 2023-09-30T22:28:10.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66dffff700 1 -- 172.21.15.154:0/1977852250 learned_addr learned my addr 172.21.15.154:0/1977852250 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:10.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.291+0000 7f66df7fe700 1 --2- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e009d860 0x7f66e011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66deffd700 1 --2- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 0x7f66e011d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:10.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66dffff700 1 -- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 msgr2=0x7f66e011d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66dffff700 1 --2- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 0x7f66e011d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66dffff700 1 -- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e009d860 msgr2=0x7f66e011cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66dffff700 1 --2- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e009d860 0x7f66e011cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66dffff700 1 -- 172.21.15.154:0/1977852250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d000d940 con 0x7f66e0130ce0 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66dffff700 1 --2- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e0130ce0 0x7f66e011d870 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009860 tx=0x7f66d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66c7fff700 1 -- 172.21.15.154:0/1977852250 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8003a20 con 0x7f66e0130ce0 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66e5af7700 1 -- 172.21.15.154:0/1977852250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d800bb50 con 0x7f66e0130ce0 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66c7fff700 1 -- 172.21.15.154:0/1977852250 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d8003b80 con 0x7f66e0130ce0 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66c7fff700 1 -- 172.21.15.154:0/1977852250 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8004030 con 0x7f66e0130ce0 2023-09-30T22:28:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.292+0000 7f66e5af7700 1 -- 172.21.15.154:0/1977852250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e00a2120 con 0x7f66e0130ce0 2023-09-30T22:28:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.293+0000 7f66c7fff700 1 -- 172.21.15.154:0/1977852250 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66d801a070 con 0x7f66e0130ce0 2023-09-30T22:28:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.293+0000 7f66c7fff700 1 -- 172.21.15.154:0/1977852250 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66d8041570 con 0x7f66e0130ce0 2023-09-30T22:28:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.294+0000 7f66e5af7700 1 -- 172.21.15.154:0/1977852250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e004f2a0 con 0x7f66e0130ce0 2023-09-30T22:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.302+0000 7f66c7fff700 1 -- 172.21.15.154:0/1977852250 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66d8021020 con 0x7f66e0130ce0 2023-09-30T22:28:10.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.334+0000 7fcce30a8700 1 -- 172.21.15.154:0/559618266 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fccdc12fc90 con 0x7fccdc12feb0 2023-09-30T22:28:10.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.335+0000 7fccd97fa700 1 -- 172.21.15.154:0/559618266 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fccc801b3b0 con 0x7fccdc12feb0 2023-09-30T22:28:10.335 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:10.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.337+0000 7fcce30a8700 1 -- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc12feb0 msgr2=0x7fccdc1291f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.337+0000 7fcce30a8700 1 --2- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc12feb0 0x7fccdc1291f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c520 tx=0x7fccc800c830 comp rx=0 tx=0).stop 2023-09-30T22:28:10.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.337+0000 7fcce30a8700 1 -- 172.21.15.154:0/559618266 shutdown_connections 2023-09-30T22:28:10.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.337+0000 7fcce30a8700 1 --2- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccdc1307c0 0x7fccdc129730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.337+0000 7fcce30a8700 1 --2- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc099af0 0x7fccdc128cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.337+0000 7fcce30a8700 1 --2- 172.21.15.154:0/559618266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccdc12feb0 0x7fccdc1291f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.337+0000 7fcce30a8700 1 -- 172.21.15.154:0/559618266 >> 172.21.15.154:0/559618266 conn(0x7fccdc0a2b30 msgr2=0x7fccdc09fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.337+0000 7fcce30a8700 1 -- 172.21.15.154:0/559618266 shutdown_connections 2023-09-30T22:28:10.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.337+0000 7fcce30a8700 1 -- 172.21.15.154:0/559618266 wait complete. 2023-09-30T22:28:10.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.349+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1918078165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95b4125fb0 con 0x7f95b409e170 2023-09-30T22:28:10.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:10.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.350+0000 7f95a9ffb700 1 -- 172.21.15.154:0/1918078165 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95a402a030 con 0x7f95b409e170 2023-09-30T22:28:10.351 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:10.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.352+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95b409e170 msgr2=0x7f95b4123700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.352+0000 7f95bb2c1700 1 --2- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95b409e170 0x7f95b4123700 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f95a40090b0 tx=0x7f95a4004750 comp rx=0 tx=0).stop 2023-09-30T22:28:10.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.352+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1918078165 shutdown_connections 2023-09-30T22:28:10.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.352+0000 7f95bb2c1700 1 --2- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95b4130ce0 0x7f95b4123c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.352+0000 7f95bb2c1700 1 --2- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f95b409d860 0x7f95b41231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.352+0000 7f95bb2c1700 1 --2- 172.21.15.154:0/1918078165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95b409e170 0x7f95b4123700 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.352+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1918078165 >> 172.21.15.154:0/1918078165 conn(0x7f95b4099c40 msgr2=0x7f95b40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.352+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1918078165 shutdown_connections 2023-09-30T22:28:10.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.352+0000 7f95bb2c1700 1 -- 172.21.15.154:0/1918078165 wait complete. 2023-09-30T22:28:10.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:10.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.463+0000 7f8c17a48700 1 -- 172.21.15.154:0/1812942214 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c1004f2a0 con 0x7f8c10130bc0 2023-09-30T22:28:10.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.464+0000 7f8c05ffb700 1 -- 172.21.15.154:0/1812942214 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c00015030 con 0x7f8c10130bc0 2023-09-30T22:28:10.464 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.466+0000 7f8c17a48700 1 -- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10130bc0 msgr2=0x7f8c1011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.466+0000 7f8c17a48700 1 --2- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10130bc0 0x7f8c1011df80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000b3c0 tx=0x7f8c0000b6d0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.466+0000 7f8c17a48700 1 -- 172.21.15.154:0/1812942214 shutdown_connections 2023-09-30T22:28:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.466+0000 7f8c17a48700 1 --2- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c10133ad0 0x7f8c1011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.466+0000 7f8c17a48700 1 --2- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c101300a0 0x7f8c1011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.466+0000 7f8c17a48700 1 --2- 172.21.15.154:0/1812942214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c10130bc0 0x7f8c1011df80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.466+0000 7f8c17a48700 1 -- 172.21.15.154:0/1812942214 >> 172.21.15.154:0/1812942214 conn(0x7f8c10099c40 msgr2=0x7f8c100a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.466+0000 7f8c17a48700 1 -- 172.21.15.154:0/1812942214 shutdown_connections 2023-09-30T22:28:10.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.466+0000 7f8c17a48700 1 -- 172.21.15.154:0/1812942214 wait complete. 2023-09-30T22:28:10.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.505+0000 7f66e5af7700 1 -- 172.21.15.154:0/1977852250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f66e006c3b0 con 0x7f66e0130ce0 2023-09-30T22:28:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.505+0000 7f66c7fff700 1 -- 172.21.15.154:0/1977852250 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66d8018070 con 0x7f66e0130ce0 2023-09-30T22:28:10.506 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.507+0000 7f66e5af7700 1 -- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e0130ce0 msgr2=0x7f66e011d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.507+0000 7f66e5af7700 1 --2- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e0130ce0 0x7f66e011d870 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009860 tx=0x7f66d8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.507+0000 7f66e5af7700 1 -- 172.21.15.154:0/1977852250 shutdown_connections 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.507+0000 7f66e5af7700 1 --2- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e0130ce0 0x7f66e011d870 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.507+0000 7f66e5af7700 1 --2- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e009d860 0x7f66e011cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.507+0000 7f66e5af7700 1 --2- 172.21.15.154:0/1977852250 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f66e009e170 0x7f66e011d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.507+0000 7f66e5af7700 1 -- 172.21.15.154:0/1977852250 >> 172.21.15.154:0/1977852250 conn(0x7f66e0099c40 msgr2=0x7f66e012fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.507+0000 7f66e5af7700 1 -- 172.21.15.154:0/1977852250 shutdown_connections 2023-09-30T22:28:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:10.507+0000 7f66e5af7700 1 -- 172.21.15.154:0/1977852250 wait complete. 2023-09-30T22:28:10.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:11.351 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:11.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:11.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.493+0000 7f044ef7e700 1 Processor -- start 2023-09-30T22:28:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.493+0000 7f044ef7e700 1 -- start start 2023-09-30T22:28:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.493+0000 7f044ef7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809d860 0x7f044809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044ef7e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f044809e170 0x7f04481307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044ef7e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044809aaa0 con 0x7f0448130ce0 2023-09-30T22:28:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044ef7e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044809f870 con 0x7f044809e170 2023-09-30T22:28:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044ef7e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f044809b360 con 0x7f044809d860 2023-09-30T22:28:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044cd1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809d860 0x7f044809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044cd1a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809d860 0x7f044809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44246/0 (socket says 172.21.15.154:44246) 2023-09-30T22:28:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044cd1a700 1 -- 172.21.15.154:0/1687235779 learned_addr learned my addr 172.21.15.154:0/1687235779 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f0447fff700 1 --2- 172.21.15.154:0/1687235779 >> v2:172.21.15.154:3300/0 conn(0x7f044809e170 0x7f04481307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044cd1a700 1 -- 172.21.15.154:0/1687235779 >> v2:172.21.15.154:3300/0 conn(0x7f044809e170 msgr2=0x7f04481307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044cd1a700 1 --2- 172.21.15.154:0/1687235779 >> v2:172.21.15.154:3300/0 conn(0x7f044809e170 0x7f04481307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044cd1a700 1 -- 172.21.15.154:0/1687235779 >> v1:172.21.15.154:6789/0 conn(0x7f0448130ce0 legacy=0x7f04481379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044cd1a700 1 -- 172.21.15.154:0/1687235779 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044809b620 con 0x7f044809d860 2023-09-30T22:28:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f04477fe700 1 -- 172.21.15.154:0/1687235779 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882080692 0 0) 0x7f044809aaa0 con 0x7f0448130ce0 2023-09-30T22:28:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f0447fff700 1 --2- 172.21.15.154:0/1687235779 >> v2:172.21.15.154:3300/0 conn(0x7f044809e170 0x7f04481307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.494+0000 7f044cd1a700 1 --2- 172.21.15.154:0/1687235779 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809d860 0x7f044809dc30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f043c0098f0 tx=0x7f043c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c0dd3d64f666e58 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f04477fe700 1 -- 172.21.15.154:0/1687235779 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c011830 con 0x7f044809d860 2023-09-30T22:28:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f04477fe700 1 -- 172.21.15.154:0/1687235779 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c011990 con 0x7f044809d860 2023-09-30T22:28:11.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f04477fe700 1 -- 172.21.15.154:0/1687235779 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c011d20 con 0x7f044809d860 2023-09-30T22:28:11.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f044ef7e700 1 -- 172.21.15.154:0/1687235779 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809d860 msgr2=0x7f044809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f044ef7e700 1 --2- 172.21.15.154:0/1687235779 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809d860 0x7f044809dc30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f043c0098f0 tx=0x7f043c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f044ef7e700 1 -- 172.21.15.154:0/1687235779 shutdown_connections 2023-09-30T22:28:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f044ef7e700 1 --2- 172.21.15.154:0/1687235779 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809d860 0x7f044809dc30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f044ef7e700 1 --2- 172.21.15.154:0/1687235779 >> v2:172.21.15.154:3300/0 conn(0x7f044809e170 0x7f04481307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f044ef7e700 1 -- 172.21.15.154:0/1687235779 >> 172.21.15.154:0/1687235779 conn(0x7f0448099c40 msgr2=0x7f04480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f044ef7e700 1 -- 172.21.15.154:0/1687235779 shutdown_connections 2023-09-30T22:28:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.495+0000 7f044ef7e700 1 -- 172.21.15.154:0/1687235779 wait complete. 2023-09-30T22:28:11.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.496+0000 7f044ef7e700 1 Processor -- start 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.496+0000 7f044ef7e700 1 -- start start 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044ef7e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f044809d860 0x7f04481355d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044ef7e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809e170 0x7f0448135b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044ef7e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448130ce0 0x7f0448136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044ef7e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448138e10 con 0x7f0448130ce0 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044ef7e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0448137e50 con 0x7f044809d860 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044ef7e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0448071f00 con 0x7f044809e170 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044cd1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f044809d860 0x7f04481355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044d51b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448130ce0 0x7f0448136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044cd1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f044809d860 0x7f04481355d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36250/0 (socket says 172.21.15.154:36250) 2023-09-30T22:28:11.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044cd1a700 1 -- 172.21.15.154:0/520759573 learned_addr learned my addr 172.21.15.154:0/520759573 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:11.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f0447fff700 1 --2- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809e170 0x7f0448135b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.497+0000 7f044d51b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448130ce0 0x7f0448136050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58670/0 (socket says 172.21.15.154:58670) 2023-09-30T22:28:11.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f044d51b700 1 -- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809e170 msgr2=0x7f0448135b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f044d51b700 1 --2- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809e170 0x7f0448135b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f044d51b700 1 -- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f044809d860 msgr2=0x7f04481355d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f044d51b700 1 --2- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f044809d860 0x7f04481355d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f044d51b700 1 -- 172.21.15.154:0/520759573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340094a0 con 0x7f0448130ce0 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f044cd1a700 1 --2- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f044809d860 0x7f04481355d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f044d51b700 1 --2- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448130ce0 0x7f0448136050 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f044000c7c0 tx=0x7f044000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f04457fa700 1 -- 172.21.15.154:0/520759573 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440003e30 con 0x7f0448130ce0 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f04457fa700 1 -- 172.21.15.154:0/520759573 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0440005070 con 0x7f0448130ce0 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f04457fa700 1 -- 172.21.15.154:0/520759573 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440005420 con 0x7f0448130ce0 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f044ef7e700 1 -- 172.21.15.154:0/520759573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c009550 con 0x7f0448130ce0 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.498+0000 7f044ef7e700 1 -- 172.21.15.154:0/520759573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04481371e0 con 0x7f0448130ce0 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.499+0000 7f044ef7e700 1 -- 172.21.15.154:0/520759573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044804f2a0 con 0x7f0448130ce0 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.500+0000 7f04457fa700 1 -- 172.21.15.154:0/520759573 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0440005580 con 0x7f0448130ce0 2023-09-30T22:28:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.500+0000 7f04457fa700 1 -- 172.21.15.154:0/520759573 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f044003f060 con 0x7f0448130ce0 2023-09-30T22:28:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.504+0000 7f04457fa700 1 -- 172.21.15.154:0/520759573 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0440010b80 con 0x7f0448130ce0 2023-09-30T22:28:11.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:11.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.532+0000 7f4eb3bdc700 1 Processor -- start 2023-09-30T22:28:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.532+0000 7f4eb3bdc700 1 -- start start 2023-09-30T22:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb3bdc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09a130 0x7f4eac09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb3bdc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09f1e0 0x7f4eac13fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb3bdc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac072b30 con 0x7f4eac09edb0 2023-09-30T22:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb3bdc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac09a500 con 0x7f4eac09f1e0 2023-09-30T22:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb3bdc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac09ada0 con 0x7f4eac09a130 2023-09-30T22:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb1177700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4eac09edb0 0x7f4eac13c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36764/0 (socket says 172.21.15.154:36764) 2023-09-30T22:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb1177700 1 -- 172.21.15.154:0/205515370 learned_addr learned my addr 172.21.15.154:0/205515370 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb1978700 1 --2- 172.21.15.154:0/205515370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09a130 0x7f4eac09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb2179700 1 --2- 172.21.15.154:0/205515370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09f1e0 0x7f4eac13fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb0976700 1 -- 172.21.15.154:0/205515370 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950382430 0 0) 0x7f4eac072b30 con 0x7f4eac09edb0 2023-09-30T22:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb1978700 1 -- 172.21.15.154:0/205515370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09f1e0 msgr2=0x7f4eac13fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb1978700 1 --2- 172.21.15.154:0/205515370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09f1e0 0x7f4eac13fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb1978700 1 -- 172.21.15.154:0/205515370 >> v1:172.21.15.154:6789/0 conn(0x7f4eac09edb0 legacy=0x7f4eac13c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.533+0000 7f4eb1978700 1 -- 172.21.15.154:0/205515370 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac09fe00 con 0x7f4eac09a130 2023-09-30T22:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.534+0000 7f4eb1978700 1 --2- 172.21.15.154:0/205515370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09a130 0x7f4eac09e870 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009870 tx=0x7f4ea8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=523167d48a6b1bd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.534+0000 7f4eb0976700 1 -- 172.21.15.154:0/205515370 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8011830 con 0x7f4eac09a130 2023-09-30T22:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.534+0000 7f4eb0976700 1 -- 172.21.15.154:0/205515370 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea8011990 con 0x7f4eac09a130 2023-09-30T22:28:11.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.534+0000 7f4eb0976700 1 -- 172.21.15.154:0/205515370 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8011d20 con 0x7f4eac09a130 2023-09-30T22:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.535+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/205515370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09a130 msgr2=0x7f4eac09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.535+0000 7f4eb3bdc700 1 --2- 172.21.15.154:0/205515370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09a130 0x7f4eac09e870 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009870 tx=0x7f4ea8009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.535+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/205515370 shutdown_connections 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.535+0000 7f4eb3bdc700 1 --2- 172.21.15.154:0/205515370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09f1e0 0x7f4eac13fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.535+0000 7f4eb3bdc700 1 --2- 172.21.15.154:0/205515370 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09a130 0x7f4eac09e870 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.535+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/205515370 >> 172.21.15.154:0/205515370 conn(0x7f4eac0a4430 msgr2=0x7f4eac0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.536+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/205515370 shutdown_connections 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.536+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/205515370 wait complete. 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb3bdc700 1 Processor -- start 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb3bdc700 1 -- start start 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb3bdc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09a130 0x7f4eac11bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb3bdc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09edb0 0x7f4eac12dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb3bdc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eac09f1e0 0x7f4eac12e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb3bdc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac11c580 con 0x7f4eac09f1e0 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb3bdc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac11ce50 con 0x7f4eac09a130 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb3bdc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac11c050 con 0x7f4eac09edb0 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb1978700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09a130 0x7f4eac11bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb1978700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09a130 0x7f4eac11bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36270/0 (socket says 172.21.15.154:36270) 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb1978700 1 -- 172.21.15.154:0/3980727783 learned_addr learned my addr 172.21.15.154:0/3980727783 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.537+0000 7f4eb2179700 1 --2- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eac09f1e0 0x7f4eac12e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4eb1177700 1 --2- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09edb0 0x7f4eac12dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4eb1978700 1 -- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09edb0 msgr2=0x7f4eac12dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4eb1978700 1 --2- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09edb0 0x7f4eac12dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4eb1978700 1 -- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eac09f1e0 msgr2=0x7f4eac12e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4eb1978700 1 --2- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eac09f1e0 0x7f4eac12e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4eb1978700 1 -- 172.21.15.154:0/3980727783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80094a0 con 0x7f4eac09a130 2023-09-30T22:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4eb1978700 1 --2- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09a130 0x7f4eac11bb10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009840 tx=0x7f4ea8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4ea27fc700 1 -- 172.21.15.154:0/3980727783 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004510 con 0x7f4eac09a130 2023-09-30T22:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4ea27fc700 1 -- 172.21.15.154:0/3980727783 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea801e070 con 0x7f4eac09a130 2023-09-30T22:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4ea27fc700 1 -- 172.21.15.154:0/3980727783 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80038c0 con 0x7f4eac09a130 2023-09-30T22:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/3980727783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac11e490 con 0x7f4eac09a130 2023-09-30T22:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.538+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/3980727783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac11e1b0 con 0x7f4eac09a130 2023-09-30T22:28:11.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.540+0000 7f4ea27fc700 1 -- 172.21.15.154:0/3980727783 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ea8003a20 con 0x7f4eac09a130 2023-09-30T22:28:11.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.540+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/3980727783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac0a30e0 con 0x7f4eac09a130 2023-09-30T22:28:11.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.540+0000 7f4ea27fc700 1 -- 172.21.15.154:0/3980727783 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4ea8040600 con 0x7f4eac09a130 2023-09-30T22:28:11.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.549+0000 7f4ea27fc700 1 -- 172.21.15.154:0/3980727783 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ea802d450 con 0x7f4eac09a130 2023-09-30T22:28:11.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5e618700 1 Processor -- start 2023-09-30T22:28:11.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5e618700 1 -- start start 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5e618700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e580a0a30 0x7f6e580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5e618700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e580a1340 0x7f6e5812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5e618700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e581304a0 0x7f6e581308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5e618700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e58130e30 con 0x7f6e580a0a30 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5e618700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580a1e70 con 0x7f6e580a1340 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5e618700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5809a720 con 0x7f6e581304a0 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5cbb5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e581304a0 0x7f6e581308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5cbb5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e581304a0 0x7f6e581308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44278/0 (socket says 172.21.15.154:44278) 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e5cbb5700 1 -- 172.21.15.154:0/4081259335 learned_addr learned my addr 172.21.15.154:0/4081259335 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.628+0000 7f6e577fe700 1 --2- 172.21.15.154:0/4081259335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e580a1340 0x7f6e5812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e5cbb5700 1 -- 172.21.15.154:0/4081259335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e580a1340 msgr2=0x7f6e5812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e5cbb5700 1 --2- 172.21.15.154:0/4081259335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e580a1340 0x7f6e5812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e5cbb5700 1 -- 172.21.15.154:0/4081259335 >> v2:172.21.15.154:3300/0 conn(0x7f6e580a0a30 msgr2=0x7f6e580a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e5cbb5700 1 --2- 172.21.15.154:0/4081259335 >> v2:172.21.15.154:3300/0 conn(0x7f6e580a0a30 0x7f6e580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e5cbb5700 1 -- 172.21.15.154:0/4081259335 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5809b300 con 0x7f6e581304a0 2023-09-30T22:28:11.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e577fe700 1 --2- 172.21.15.154:0/4081259335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e580a1340 0x7f6e5812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e5cbb5700 1 --2- 172.21.15.154:0/4081259335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e581304a0 0x7f6e581308f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009e80 tx=0x7f6e5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435e359e2eaca55f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e56ffd700 1 -- 172.21.15.154:0/4081259335 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000e070 con 0x7f6e581304a0 2023-09-30T22:28:11.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e56ffd700 1 -- 172.21.15.154:0/4081259335 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5000b8d0 con 0x7f6e581304a0 2023-09-30T22:28:11.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.629+0000 7f6e56ffd700 1 -- 172.21.15.154:0/4081259335 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000bc80 con 0x7f6e581304a0 2023-09-30T22:28:11.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.630+0000 7f6e5e618700 1 -- 172.21.15.154:0/4081259335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e581304a0 msgr2=0x7f6e581308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.630+0000 7f6e5e618700 1 --2- 172.21.15.154:0/4081259335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e581304a0 0x7f6e581308f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009e80 tx=0x7f6e5000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.630+0000 7f6e5e618700 1 -- 172.21.15.154:0/4081259335 shutdown_connections 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.630+0000 7f6e5e618700 1 --2- 172.21.15.154:0/4081259335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e581304a0 0x7f6e581308f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.630+0000 7f6e5e618700 1 --2- 172.21.15.154:0/4081259335 >> v2:172.21.15.154:3300/0 conn(0x7f6e580a0a30 0x7f6e580a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.630+0000 7f6e5e618700 1 --2- 172.21.15.154:0/4081259335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e580a1340 0x7f6e5812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.630+0000 7f6e5e618700 1 -- 172.21.15.154:0/4081259335 >> 172.21.15.154:0/4081259335 conn(0x7f6e580a2980 msgr2=0x7f6e580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.630+0000 7f6e5e618700 1 -- 172.21.15.154:0/4081259335 shutdown_connections 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.630+0000 7f6e5e618700 1 -- 172.21.15.154:0/4081259335 wait complete. 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.631+0000 7f6e5e618700 1 Processor -- start 2023-09-30T22:28:11.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e5e618700 1 -- start start 2023-09-30T22:28:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e5e618700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e580a0a30 0x7f6e5811dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e5e618700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e580a1340 0x7f6e5811e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e5e618700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e581304a0 0x7f6e5811e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e5e618700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5812fd20 con 0x7f6e580a1340 2023-09-30T22:28:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e5e618700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58121850 con 0x7f6e581304a0 2023-09-30T22:28:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e5e618700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5809f3d0 con 0x7f6e580a0a30 2023-09-30T22:28:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e577fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e580a1340 0x7f6e5811e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e57fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e580a0a30 0x7f6e5811dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e577fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e580a1340 0x7f6e5811e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58704/0 (socket says 172.21.15.154:58704) 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.632+0000 7f6e577fe700 1 -- 172.21.15.154:0/1110992262 learned_addr learned my addr 172.21.15.154:0/1110992262 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e57fff700 1 -- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e581304a0 msgr2=0x7f6e5811e800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e57fff700 1 --2- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e581304a0 0x7f6e5811e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e57fff700 1 -- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e580a1340 msgr2=0x7f6e5811e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e57fff700 1 --2- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e580a1340 0x7f6e5811e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e57fff700 1 -- 172.21.15.154:0/1110992262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c0094a0 con 0x7f6e580a0a30 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e577fe700 1 --2- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e580a1340 0x7f6e5811e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e57fff700 1 --2- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e580a0a30 0x7f6e5811dd80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800b450 tx=0x7f6e4800b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e54ff9700 1 -- 172.21.15.154:0/1110992262 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48011830 con 0x7f6e580a0a30 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e54ff9700 1 -- 172.21.15.154:0/1110992262 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e480119b0 con 0x7f6e580a0a30 2023-09-30T22:28:11.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e5e618700 1 -- 172.21.15.154:0/1110992262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e50009b30 con 0x7f6e580a0a30 2023-09-30T22:28:11.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e54ff9700 1 -- 172.21.15.154:0/1110992262 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48011d60 con 0x7f6e580a0a30 2023-09-30T22:28:11.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.633+0000 7f6e5e618700 1 -- 172.21.15.154:0/1110992262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5809ae60 con 0x7f6e580a0a30 2023-09-30T22:28:11.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.634+0000 7f6e54ff9700 1 -- 172.21.15.154:0/1110992262 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e4801a400 con 0x7f6e580a0a30 2023-09-30T22:28:11.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.634+0000 7f6e54ff9700 1 -- 172.21.15.154:0/1110992262 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6e4803f610 con 0x7f6e580a0a30 2023-09-30T22:28:11.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.635+0000 7f6e5e618700 1 -- 172.21.15.154:0/1110992262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e58121210 con 0x7f6e580a0a30 2023-09-30T22:28:11.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.644+0000 7f6e54ff9700 1 -- 172.21.15.154:0/1110992262 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e58121210 con 0x7f6e580a0a30 2023-09-30T22:28:11.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.652+0000 7fa4d3df0700 1 Processor -- start 2023-09-30T22:28:11.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.652+0000 7fa4d3df0700 1 -- start start 2023-09-30T22:28:11.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d3df0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4cc0a0a70 0x7fa4cc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d3df0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a1380 0x7fa4cc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d3df0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4cc133f50 0x7fa4cc1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d3df0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4cc09e9d0 con 0x7fa4cc133f50 2023-09-30T22:28:11.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d3df0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc09dc00 con 0x7fa4cc0a0a70 2023-09-30T22:28:11.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d3df0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc09dec0 con 0x7fa4cc0a1380 2023-09-30T22:28:11.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d238d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4cc133f50 0x7fa4cc1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d138b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a1380 0x7fa4cc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d238d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4cc133f50 0x7fa4cc1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58710/0 (socket says 172.21.15.154:58710) 2023-09-30T22:28:11.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d1b8c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4cc0a0a70 0x7fa4cc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d238d700 1 -- 172.21.15.154:0/1988764352 learned_addr learned my addr 172.21.15.154:0/1988764352 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:11.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d138b700 1 -- 172.21.15.154:0/1988764352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4cc0a0a70 msgr2=0x7fa4cc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d138b700 1 --2- 172.21.15.154:0/1988764352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4cc0a0a70 0x7fa4cc0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d138b700 1 -- 172.21.15.154:0/1988764352 >> v2:172.21.15.154:3300/0 conn(0x7fa4cc133f50 msgr2=0x7fa4cc1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:11.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d138b700 1 --2- 172.21.15.154:0/1988764352 >> v2:172.21.15.154:3300/0 conn(0x7fa4cc133f50 0x7fa4cc1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d138b700 1 -- 172.21.15.154:0/1988764352 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc09e6a0 con 0x7fa4cc0a1380 2023-09-30T22:28:11.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.653+0000 7fa4d238d700 1 --2- 172.21.15.154:0/1988764352 >> v2:172.21.15.154:3300/0 conn(0x7fa4cc133f50 0x7fa4cc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d138b700 1 --2- 172.21.15.154:0/1988764352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a1380 0x7fa4cc133a10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009840 tx=0x7fa4bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d6fe01182018278 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d0b8a700 1 -- 172.21.15.154:0/1988764352 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc011830 con 0x7fa4cc0a1380 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d0b8a700 1 -- 172.21.15.154:0/1988764352 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc011990 con 0x7fa4cc0a1380 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d0b8a700 1 -- 172.21.15.154:0/1988764352 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc011d20 con 0x7fa4cc0a1380 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d3df0700 1 -- 172.21.15.154:0/1988764352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a1380 msgr2=0x7fa4cc133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d3df0700 1 --2- 172.21.15.154:0/1988764352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a1380 0x7fa4cc133a10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009840 tx=0x7fa4bc009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d3df0700 1 -- 172.21.15.154:0/1988764352 shutdown_connections 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d3df0700 1 --2- 172.21.15.154:0/1988764352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4cc0a0a70 0x7fa4cc0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d3df0700 1 --2- 172.21.15.154:0/1988764352 >> v2:172.21.15.154:3300/0 conn(0x7fa4cc133f50 0x7fa4cc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d3df0700 1 --2- 172.21.15.154:0/1988764352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a1380 0x7fa4cc133a10 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.654+0000 7fa4d3df0700 1 -- 172.21.15.154:0/1988764352 >> 172.21.15.154:0/1988764352 conn(0x7fa4cc0a6610 msgr2=0x7fa4cc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.655+0000 7fa4d3df0700 1 -- 172.21.15.154:0/1988764352 shutdown_connections 2023-09-30T22:28:11.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.655+0000 7fa4d3df0700 1 -- 172.21.15.154:0/1988764352 wait complete. 2023-09-30T22:28:11.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d3df0700 1 Processor -- start 2023-09-30T22:28:11.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d3df0700 1 -- start start 2023-09-30T22:28:11.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d3df0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a0a70 0x7fa4cc133240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d3df0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4cc0a1380 0x7fa4cc12dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d3df0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4cc133f50 0x7fa4cc12e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:11.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d3df0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc07c900 con 0x7fa4cc133f50 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d3df0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0a0450 con 0x7fa4cc0a1380 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d3df0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc07bda0 con 0x7fa4cc0a0a70 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d1b8c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a0a70 0x7fa4cc133240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d238d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4cc133f50 0x7fa4cc12e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d1b8c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a0a70 0x7fa4cc133240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44312/0 (socket says 172.21.15.154:44312) 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d1b8c700 1 -- 172.21.15.154:0/3642434009 learned_addr learned my addr 172.21.15.154:0/3642434009 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d238d700 1 -- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a0a70 msgr2=0x7fa4cc133240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d238d700 1 --2- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a0a70 0x7fa4cc133240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.656+0000 7fa4d238d700 1 -- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4cc0a1380 msgr2=0x7fa4cc12dc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.657+0000 7fa4d238d700 1 --2- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4cc0a1380 0x7fa4cc12dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.657+0000 7fa4d238d700 1 -- 172.21.15.154:0/3642434009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4009b30 con 0x7fa4cc133f50 2023-09-30T22:28:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.657+0000 7fa4d238d700 1 --2- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4cc133f50 0x7fa4cc12e1b0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400efc0 tx=0x7fa4c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.657+0000 7fa4c27fc700 1 -- 172.21.15.154:0/3642434009 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4018070 con 0x7fa4cc133f50 2023-09-30T22:28:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.657+0000 7fa4d3df0700 1 -- 172.21.15.154:0/3642434009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc0094a0 con 0x7fa4cc133f50 2023-09-30T22:28:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.657+0000 7fa4d3df0700 1 -- 172.21.15.154:0/3642434009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc0a5080 con 0x7fa4cc133f50 2023-09-30T22:28:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.657+0000 7fa4c27fc700 1 -- 172.21.15.154:0/3642434009 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c400f040 con 0x7fa4cc133f50 2023-09-30T22:28:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.657+0000 7fa4c27fc700 1 -- 172.21.15.154:0/3642434009 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4003c20 con 0x7fa4cc133f50 2023-09-30T22:28:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.658+0000 7fa4c27fc700 1 -- 172.21.15.154:0/3642434009 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4c400c930 con 0x7fa4cc133f50 2023-09-30T22:28:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.658+0000 7fa4d3df0700 1 -- 172.21.15.154:0/3642434009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b40052e0 con 0x7fa4cc133f50 2023-09-30T22:28:11.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.658+0000 7fa4c27fc700 1 -- 172.21.15.154:0/3642434009 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4c40133e0 con 0x7fa4cc133f50 2023-09-30T22:28:11.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.667+0000 7fa4c27fc700 1 -- 172.21.15.154:0/3642434009 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4c4003d80 con 0x7fa4cc133f50 2023-09-30T22:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.712+0000 7f044ef7e700 1 -- 172.21.15.154:0/520759573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f044806c3b0 con 0x7f0448130ce0 2023-09-30T22:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.712+0000 7f04457fa700 1 -- 172.21.15.154:0/520759573 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0440017020 con 0x7f0448130ce0 2023-09-30T22:28:11.712 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.714+0000 7f044ef7e700 1 -- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448130ce0 msgr2=0x7f0448136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.714+0000 7f044ef7e700 1 --2- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448130ce0 0x7f0448136050 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f044000c7c0 tx=0x7f044000cad0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.714+0000 7f044ef7e700 1 -- 172.21.15.154:0/520759573 shutdown_connections 2023-09-30T22:28:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.714+0000 7f044ef7e700 1 --2- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448130ce0 0x7f0448136050 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.714+0000 7f044ef7e700 1 --2- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f044809d860 0x7f04481355d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.714+0000 7f044ef7e700 1 --2- 172.21.15.154:0/520759573 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f044809e170 0x7f0448135b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.714+0000 7f044ef7e700 1 -- 172.21.15.154:0/520759573 >> 172.21.15.154:0/520759573 conn(0x7f0448099c40 msgr2=0x7f0448139500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.714+0000 7f044ef7e700 1 -- 172.21.15.154:0/520759573 shutdown_connections 2023-09-30T22:28:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.714+0000 7f044ef7e700 1 -- 172.21.15.154:0/520759573 wait complete. 2023-09-30T22:28:11.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:11.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.768+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/3980727783 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4eac04f2a0 con 0x7f4eac09a130 2023-09-30T22:28:11.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.768+0000 7f4ea27fc700 1 -- 172.21.15.154:0/3980727783 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ea8015070 con 0x7f4eac09a130 2023-09-30T22:28:11.769 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:11.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.771+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09a130 msgr2=0x7f4eac11bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.771+0000 7f4eb3bdc700 1 --2- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09a130 0x7f4eac11bb10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009840 tx=0x7f4ea8004750 comp rx=0 tx=0).stop 2023-09-30T22:28:11.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.771+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/3980727783 shutdown_connections 2023-09-30T22:28:11.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.771+0000 7f4eb3bdc700 1 --2- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eac09f1e0 0x7f4eac12e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.771+0000 7f4eb3bdc700 1 --2- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4eac09a130 0x7f4eac11bb10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.771+0000 7f4eb3bdc700 1 --2- 172.21.15.154:0/3980727783 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4eac09edb0 0x7f4eac12dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.771+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/3980727783 >> 172.21.15.154:0/3980727783 conn(0x7f4eac0a4430 msgr2=0x7f4eac09bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.771+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/3980727783 shutdown_connections 2023-09-30T22:28:11.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.771+0000 7f4eb3bdc700 1 -- 172.21.15.154:0/3980727783 wait complete. 2023-09-30T22:28:11.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:11.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.851+0000 7f6e5e618700 1 -- 172.21.15.154:0/1110992262 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6e58121690 con 0x7f6e580a0a30 2023-09-30T22:28:11.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.851+0000 7f6e54ff9700 1 -- 172.21.15.154:0/1110992262 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e48029090 con 0x7f6e580a0a30 2023-09-30T22:28:11.852 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:11.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.853+0000 7f6e5e618700 1 -- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e580a0a30 msgr2=0x7f6e5811dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.853+0000 7f6e5e618700 1 --2- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e580a0a30 0x7f6e5811dd80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800b450 tx=0x7f6e4800b760 comp rx=0 tx=0).stop 2023-09-30T22:28:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.853+0000 7f6e5e618700 1 -- 172.21.15.154:0/1110992262 shutdown_connections 2023-09-30T22:28:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.853+0000 7f6e5e618700 1 --2- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e581304a0 0x7f6e5811e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.853+0000 7f6e5e618700 1 --2- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e580a0a30 0x7f6e5811dd80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.853+0000 7f6e5e618700 1 --2- 172.21.15.154:0/1110992262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e580a1340 0x7f6e5811e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.853+0000 7f6e5e618700 1 -- 172.21.15.154:0/1110992262 >> 172.21.15.154:0/1110992262 conn(0x7f6e580a2980 msgr2=0x7f6e5809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.853+0000 7f6e5e618700 1 -- 172.21.15.154:0/1110992262 shutdown_connections 2023-09-30T22:28:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.853+0000 7f6e5e618700 1 -- 172.21.15.154:0/1110992262 wait complete. 2023-09-30T22:28:11.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.864+0000 7fa4d3df0700 1 -- 172.21.15.154:0/3642434009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4b4005590 con 0x7fa4cc133f50 2023-09-30T22:28:11.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.864+0000 7fa4c27fc700 1 -- 172.21.15.154:0/3642434009 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4c4012aa0 con 0x7fa4cc133f50 2023-09-30T22:28:11.865 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:11.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.866+0000 7fa4d3df0700 1 -- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4cc133f50 msgr2=0x7fa4cc12e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.866+0000 7fa4d3df0700 1 --2- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4cc133f50 0x7fa4cc12e1b0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400efc0 tx=0x7fa4c400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.866+0000 7fa4d3df0700 1 -- 172.21.15.154:0/3642434009 shutdown_connections 2023-09-30T22:28:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.866+0000 7fa4d3df0700 1 --2- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4cc133f50 0x7fa4cc12e1b0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.866+0000 7fa4d3df0700 1 --2- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa4cc0a0a70 0x7fa4cc133240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.866+0000 7fa4d3df0700 1 --2- 172.21.15.154:0/3642434009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4cc0a1380 0x7fa4cc12dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.866+0000 7fa4d3df0700 1 -- 172.21.15.154:0/3642434009 >> 172.21.15.154:0/3642434009 conn(0x7fa4cc0a6610 msgr2=0x7fa4cc1bbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.866+0000 7fa4d3df0700 1 -- 172.21.15.154:0/3642434009 shutdown_connections 2023-09-30T22:28:11.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:11.866+0000 7fa4d3df0700 1 -- 172.21.15.154:0/3642434009 wait complete. 2023-09-30T22:28:11.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:12.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:12.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:12.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:12.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.867+0000 7fb37d867700 1 Processor -- start 2023-09-30T22:28:12.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.867+0000 7fb37d867700 1 -- start start 2023-09-30T22:28:12.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb37d867700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809d860 0x7fb37809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb37d867700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb378130eb0 0x7fb378138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb37d867700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37809aaa0 con 0x7fb37809e170 2023-09-30T22:28:12.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb37d867700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37809f870 con 0x7fb378130eb0 2023-09-30T22:28:12.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb37d867700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37809b360 con 0x7fb37809d860 2023-09-30T22:28:12.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb376ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809d860 0x7fb37809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb3777fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb378130eb0 0x7fb378138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb3777fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb378130eb0 0x7fb378138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58726/0 (socket says 172.21.15.154:58726) 2023-09-30T22:28:12.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb376ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809d860 0x7fb37809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36296/0 (socket says 172.21.15.154:36296) 2023-09-30T22:28:12.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.868+0000 7fb3777fe700 1 -- 172.21.15.154:0/3785901212 learned_addr learned my addr 172.21.15.154:0/3785901212 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:12.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.869+0000 7fb376ffd700 1 -- 172.21.15.154:0/3785901212 >> v2:172.21.15.154:3300/0 conn(0x7fb378130eb0 msgr2=0x7fb378138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:12.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.869+0000 7fb376ffd700 1 --2- 172.21.15.154:0/3785901212 >> v2:172.21.15.154:3300/0 conn(0x7fb378130eb0 0x7fb378138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.869+0000 7fb376ffd700 1 -- 172.21.15.154:0/3785901212 >> v1:172.21.15.154:6789/0 conn(0x7fb37809e170 legacy=0x7fb3781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.869+0000 7fb376ffd700 1 -- 172.21.15.154:0/3785901212 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37809b620 con 0x7fb37809d860 2023-09-30T22:28:12.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.869+0000 7fb3777fe700 1 --2- 172.21.15.154:0/3785901212 >> v2:172.21.15.154:3300/0 conn(0x7fb378130eb0 0x7fb378138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:12.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.869+0000 7fb376ffd700 1 --2- 172.21.15.154:0/3785901212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809d860 0x7fb37809dc30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb368009840 tx=0x7fb368009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3bb1f7d35381eec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:12.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.869+0000 7fb375ffb700 1 -- 172.21.15.154:0/3785901212 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368011830 con 0x7fb37809d860 2023-09-30T22:28:12.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.869+0000 7fb375ffb700 1 -- 172.21.15.154:0/3785901212 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368011990 con 0x7fb37809d860 2023-09-30T22:28:12.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.869+0000 7fb375ffb700 1 -- 172.21.15.154:0/3785901212 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368011d20 con 0x7fb37809d860 2023-09-30T22:28:12.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.870+0000 7fb37d867700 1 -- 172.21.15.154:0/3785901212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809d860 msgr2=0x7fb37809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.870+0000 7fb37d867700 1 --2- 172.21.15.154:0/3785901212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809d860 0x7fb37809dc30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb368009840 tx=0x7fb368009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:12.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.870+0000 7fb37d867700 1 -- 172.21.15.154:0/3785901212 shutdown_connections 2023-09-30T22:28:12.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.870+0000 7fb37d867700 1 --2- 172.21.15.154:0/3785901212 >> v2:172.21.15.154:3300/0 conn(0x7fb378130eb0 0x7fb378138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.870+0000 7fb37d867700 1 --2- 172.21.15.154:0/3785901212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809d860 0x7fb37809dc30 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.870+0000 7fb37d867700 1 -- 172.21.15.154:0/3785901212 >> 172.21.15.154:0/3785901212 conn(0x7fb378099c40 msgr2=0x7fb3780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.870+0000 7fb37d867700 1 -- 172.21.15.154:0/3785901212 shutdown_connections 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.870+0000 7fb37d867700 1 -- 172.21.15.154:0/3785901212 wait complete. 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.871+0000 7fb37d867700 1 Processor -- start 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb37d867700 1 -- start start 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb37d867700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb37809d860 0x7fb37811e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb37d867700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809e170 0x7fb37811e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb37d867700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb378130eb0 0x7fb37811ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb37d867700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb378120110 con 0x7fb378130eb0 2023-09-30T22:28:12.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb37d867700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb378121c30 con 0x7fb37809e170 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb37d867700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3781205b0 con 0x7fb37809d860 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb376ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb37809d860 0x7fb37811e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb376ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb37809d860 0x7fb37811e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44324/0 (socket says 172.21.15.154:44324) 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb376ffd700 1 -- 172.21.15.154:0/3919180921 learned_addr learned my addr 172.21.15.154:0/3919180921 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.872+0000 7fb3767fc700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809e170 0x7fb37811e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb3777fe700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb378130eb0 0x7fb37811ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb376ffd700 1 -- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809e170 msgr2=0x7fb37811e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb376ffd700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809e170 0x7fb37811e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb376ffd700 1 -- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb378130eb0 msgr2=0x7fb37811ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb376ffd700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb378130eb0 0x7fb37811ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb376ffd700 1 -- 172.21.15.154:0/3919180921 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37000bd40 con 0x7fb37809d860 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb3767fc700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809e170 0x7fb37811e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb376ffd700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb37809d860 0x7fb37811e3f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb368009fd0 tx=0x7fb368004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb35ffff700 1 -- 172.21.15.154:0/3919180921 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368004400 con 0x7fb37809d860 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb35ffff700 1 -- 172.21.15.154:0/3919180921 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36801f070 con 0x7fb37809d860 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb37d867700 1 -- 172.21.15.154:0/3919180921 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3680094a0 con 0x7fb37809d860 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb35ffff700 1 -- 172.21.15.154:0/3919180921 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3680038e0 con 0x7fb37809d860 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.873+0000 7fb37d867700 1 -- 172.21.15.154:0/3919180921 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37809c8b0 con 0x7fb37809d860 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.874+0000 7fb35ffff700 1 -- 172.21.15.154:0/3919180921 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb368021030 con 0x7fb37809d860 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.874+0000 7fb35ffff700 1 -- 172.21.15.154:0/3919180921 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3680407d0 con 0x7fb37809d860 2023-09-30T22:28:12.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.874+0000 7fb37d867700 1 -- 172.21.15.154:0/3919180921 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb378122760 con 0x7fb37809d860 2023-09-30T22:28:12.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:12.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.879+0000 7fb35ffff700 1 -- 172.21.15.154:0/3919180921 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb368015020 con 0x7fb37809d860 2023-09-30T22:28:12.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.926+0000 7f3786d1e700 1 Processor -- start 2023-09-30T22:28:12.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.927+0000 7f3786d1e700 1 -- start start 2023-09-30T22:28:12.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.927+0000 7f3786d1e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37800a0a30 0x7f37800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.927+0000 7f3786d1e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3780130670 0x7f37801381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.927+0000 7f3786d1e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800a1e70 con 0x7f37800a1340 2023-09-30T22:28:12.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.927+0000 7f3786d1e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378009a720 con 0x7f3780130670 2023-09-30T22:28:12.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.927+0000 7f3786d1e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378009b300 con 0x7f37800a0a30 2023-09-30T22:28:12.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f37852bb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3780130670 0x7f37801381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f37852bb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3780130670 0x7f37801381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58752/0 (socket says 172.21.15.154:58752) 2023-09-30T22:28:12.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f37852bb700 1 -- 172.21.15.154:0/2070106974 learned_addr learned my addr 172.21.15.154:0/2070106974 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f3784aba700 1 --2- 172.21.15.154:0/2070106974 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37800a0a30 0x7f37800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f3784aba700 1 -- 172.21.15.154:0/2070106974 >> v2:172.21.15.154:3300/0 conn(0x7f3780130670 msgr2=0x7f37801381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f3784aba700 1 --2- 172.21.15.154:0/2070106974 >> v2:172.21.15.154:3300/0 conn(0x7f3780130670 0x7f37801381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f3784aba700 1 -- 172.21.15.154:0/2070106974 >> v1:172.21.15.154:6789/0 conn(0x7f37800a1340 legacy=0x7f378012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f3784aba700 1 -- 172.21.15.154:0/2070106974 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378009abc0 con 0x7f37800a0a30 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f37852bb700 1 --2- 172.21.15.154:0/2070106974 >> v2:172.21.15.154:3300/0 conn(0x7f3780130670 0x7f37801381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f3784aba700 1 --2- 172.21.15.154:0/2070106974 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37800a0a30 0x7f37800a0e00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3774009820 tx=0x7f3774009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfeff64e866b1608 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f377f7fe700 1 -- 172.21.15.154:0/2070106974 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774005e30 con 0x7f37800a0a30 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f377f7fe700 1 -- 172.21.15.154:0/2070106974 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3774006030 con 0x7f37800a0a30 2023-09-30T22:28:12.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.928+0000 7f377f7fe700 1 -- 172.21.15.154:0/2070106974 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740063c0 con 0x7f37800a0a30 2023-09-30T22:28:12.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.929+0000 7f3786d1e700 1 -- 172.21.15.154:0/2070106974 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37800a0a30 msgr2=0x7f37800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.929+0000 7f3786d1e700 1 --2- 172.21.15.154:0/2070106974 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37800a0a30 0x7f37800a0e00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3774009820 tx=0x7f3774009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:12.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.929+0000 7f3786d1e700 1 -- 172.21.15.154:0/2070106974 shutdown_connections 2023-09-30T22:28:12.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.929+0000 7f3786d1e700 1 --2- 172.21.15.154:0/2070106974 >> v2:172.21.15.154:3300/0 conn(0x7f3780130670 0x7f37801381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.929+0000 7f3786d1e700 1 --2- 172.21.15.154:0/2070106974 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f37800a0a30 0x7f37800a0e00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.929+0000 7f3786d1e700 1 -- 172.21.15.154:0/2070106974 >> 172.21.15.154:0/2070106974 conn(0x7f37800a2980 msgr2=0x7f37800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:12.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.929+0000 7f3786d1e700 1 -- 172.21.15.154:0/2070106974 shutdown_connections 2023-09-30T22:28:12.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.929+0000 7f3786d1e700 1 -- 172.21.15.154:0/2070106974 wait complete. 2023-09-30T22:28:12.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.931+0000 7f3786d1e700 1 Processor -- start 2023-09-30T22:28:12.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.931+0000 7f3786d1e700 1 -- start start 2023-09-30T22:28:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f3786d1e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37800a0a30 0x7f37801c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f3786d1e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37800a1340 0x7f37801c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f3786d1e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3780130670 0x7f37801c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f3786d1e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378009fda0 con 0x7f37800a1340 2023-09-30T22:28:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f3786d1e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378009ae00 con 0x7f37800a0a30 2023-09-30T22:28:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f3786d1e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37801210a0 con 0x7f3780130670 2023-09-30T22:28:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f37852bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3780130670 0x7f37801c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f377ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37800a1340 0x7f37801c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:12.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f37852bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3780130670 0x7f37801c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44336/0 (socket says 172.21.15.154:44336) 2023-09-30T22:28:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f37852bb700 1 -- 172.21.15.154:0/3197561842 learned_addr learned my addr 172.21.15.154:0/3197561842 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f37852bb700 1 -- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37800a0a30 msgr2=0x7f37801c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f37852bb700 1 --2- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37800a0a30 0x7f37801c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f37852bb700 1 -- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37800a1340 msgr2=0x7f37801c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f37852bb700 1 --2- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37800a1340 0x7f37801c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f37852bb700 1 -- 172.21.15.154:0/3197561842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377800bd40 con 0x7f3780130670 2023-09-30T22:28:12.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f377ffff700 1 --2- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37800a1340 0x7f37801c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.932+0000 7f37852bb700 1 --2- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3780130670 0x7f37801c8c60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3778007270 tx=0x7f377800e5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.933+0000 7f377d7fa700 1 -- 172.21.15.154:0/3197561842 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778010040 con 0x7f3780130670 2023-09-30T22:28:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.933+0000 7f377d7fa700 1 -- 172.21.15.154:0/3197561842 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800b050 con 0x7f3780130670 2023-09-30T22:28:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.933+0000 7f377d7fa700 1 -- 172.21.15.154:0/3197561842 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800b400 con 0x7f3780130670 2023-09-30T22:28:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.933+0000 7f3786d1e700 1 -- 172.21.15.154:0/3197561842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774009430 con 0x7f3780130670 2023-09-30T22:28:12.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.933+0000 7f3786d1e700 1 -- 172.21.15.154:0/3197561842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37801236a0 con 0x7f3780130670 2023-09-30T22:28:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.934+0000 7f3786d1e700 1 -- 172.21.15.154:0/3197561842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378004f2a0 con 0x7f3780130670 2023-09-30T22:28:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.934+0000 7f377d7fa700 1 -- 172.21.15.154:0/3197561842 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3778014420 con 0x7f3780130670 2023-09-30T22:28:12.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.934+0000 7f377d7fa700 1 -- 172.21.15.154:0/3197561842 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f37780400c0 con 0x7f3780130670 2023-09-30T22:28:12.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:12.943+0000 7f377d7fa700 1 -- 172.21.15.154:0/3197561842 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f377801c730 con 0x7f3780130670 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.000+0000 7f833c641700 1 Processor -- start 2023-09-30T22:28:13.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.000+0000 7f833c641700 1 -- start start 2023-09-30T22:28:13.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.001+0000 7f833c641700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8334132100 0x7f83341367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.001+0000 7f833c641700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83341314b0 0x7f8334138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.001+0000 7f833c641700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83340a0f20 con 0x7f8334066410 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.001+0000 7f833c641700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83340667e0 con 0x7f8334132100 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.001+0000 7f833c641700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83340a23c0 con 0x7f83341314b0 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.001+0000 7f8339bdc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8334132100 0x7f83341367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.001+0000 7f8339bdc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8334132100 0x7f83341367d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58772/0 (socket says 172.21.15.154:58772) 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.001+0000 7f8339bdc700 1 -- 172.21.15.154:0/2873142154 learned_addr learned my addr 172.21.15.154:0/2873142154 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.002+0000 7f833abde700 1 --2- 172.21.15.154:0/2873142154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83341314b0 0x7f8334138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.002+0000 7f8339bdc700 1 -- 172.21.15.154:0/2873142154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83341314b0 msgr2=0x7f8334138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:13.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.002+0000 7f8339bdc700 1 --2- 172.21.15.154:0/2873142154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83341314b0 0x7f8334138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.002+0000 7f8339bdc700 1 -- 172.21.15.154:0/2873142154 >> v1:172.21.15.154:6789/0 conn(0x7f8334066410 legacy=0x7f83341319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.002+0000 7f8339bdc700 1 -- 172.21.15.154:0/2873142154 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83340a16e0 con 0x7f8334132100 2023-09-30T22:28:13.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.002+0000 7f8339bdc700 1 --2- 172.21.15.154:0/2873142154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8334132100 0x7f83341367d0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f8324009920 tx=0x7f8324009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8c6728cd6393ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.002+0000 7f83393db700 1 -- 172.21.15.154:0/2873142154 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400ba20 con 0x7f8334132100 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.002+0000 7f83393db700 1 -- 172.21.15.154:0/2873142154 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832400bb80 con 0x7f8334132100 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.002+0000 7f83393db700 1 -- 172.21.15.154:0/2873142154 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324009e70 con 0x7f8334132100 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.003+0000 7f833c641700 1 -- 172.21.15.154:0/2873142154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8334132100 msgr2=0x7f83341367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.003+0000 7f833c641700 1 --2- 172.21.15.154:0/2873142154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8334132100 0x7f83341367d0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f8324009920 tx=0x7f8324009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.003+0000 7f833c641700 1 -- 172.21.15.154:0/2873142154 shutdown_connections 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.003+0000 7f833c641700 1 --2- 172.21.15.154:0/2873142154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83341314b0 0x7f8334138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.003+0000 7f833c641700 1 --2- 172.21.15.154:0/2873142154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8334132100 0x7f83341367d0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.003+0000 7f833c641700 1 -- 172.21.15.154:0/2873142154 >> 172.21.15.154:0/2873142154 conn(0x7f83340a2980 msgr2=0x7f83340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.003+0000 7f833c641700 1 -- 172.21.15.154:0/2873142154 shutdown_connections 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.003+0000 7f833c641700 1 -- 172.21.15.154:0/2873142154 wait complete. 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.004+0000 7f833c641700 1 Processor -- start 2023-09-30T22:28:13.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.004+0000 7f833c641700 1 -- start start 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.004+0000 7f833c641700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8334066410 0x7f83341c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.004+0000 7f833c641700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f83341314b0 0x7f83341c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833c641700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8334132100 0x7f8334099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833c641700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8334137a90 con 0x7f8334066410 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833c641700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8334138b30 con 0x7f8334132100 2023-09-30T22:28:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833c641700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83340a1d50 con 0x7f83341314b0 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833abde700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8334132100 0x7f8334099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833abde700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8334132100 0x7f8334099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36336/0 (socket says 172.21.15.154:36336) 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833abde700 1 -- 172.21.15.154:0/1332058210 learned_addr learned my addr 172.21.15.154:0/1332058210 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f8339bdc700 1 --2- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f83341314b0 0x7f83341c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833a3dd700 1 --2- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8334066410 0x7f83341c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833abde700 1 -- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f83341314b0 msgr2=0x7f83341c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833abde700 1 --2- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f83341314b0 0x7f83341c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833abde700 1 -- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8334066410 msgr2=0x7f83341c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833abde700 1 --2- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8334066410 0x7f83341c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833abde700 1 -- 172.21.15.154:0/1332058210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8324009550 con 0x7f8334132100 2023-09-30T22:28:13.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f833abde700 1 --2- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8334132100 0x7f8334099a90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f832c007e70 tx=0x7f832c00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.005+0000 7f832affd700 1 -- 172.21.15.154:0/1332058210 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c00ede0 con 0x7f8334132100 2023-09-30T22:28:13.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.006+0000 7f833c641700 1 -- 172.21.15.154:0/1332058210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83341373e0 con 0x7f8334132100 2023-09-30T22:28:13.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.006+0000 7f832affd700 1 -- 172.21.15.154:0/1332058210 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c014420 con 0x7f8334132100 2023-09-30T22:28:13.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.006+0000 7f832affd700 1 -- 172.21.15.154:0/1332058210 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c0147d0 con 0x7f8334132100 2023-09-30T22:28:13.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.006+0000 7f833c641700 1 -- 172.21.15.154:0/1332058210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8334138030 con 0x7f8334132100 2023-09-30T22:28:13.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.007+0000 7f832affd700 1 -- 172.21.15.154:0/1332058210 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f832c014930 con 0x7f8334132100 2023-09-30T22:28:13.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.007+0000 7f833c641700 1 -- 172.21.15.154:0/1332058210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833404f2a0 con 0x7f8334132100 2023-09-30T22:28:13.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.007+0000 7f832affd700 1 -- 172.21.15.154:0/1332058210 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f832c018e10 con 0x7f8334132100 2023-09-30T22:28:13.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.012+0000 7f832affd700 1 -- 172.21.15.154:0/1332058210 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f832c045060 con 0x7f8334132100 2023-09-30T22:28:13.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.013+0000 7fbfdb69d700 1 Processor -- start 2023-09-30T22:28:13.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfdb69d700 1 -- start start 2023-09-30T22:28:13.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfdb69d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd4133ad0 0x7fbfd4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfdb69d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbfd4130bc0 0x7fbfd413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfdb69d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd406b2d0 con 0x7fbfd41300a0 2023-09-30T22:28:13.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfdb69d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd4133610 con 0x7fbfd4130bc0 2023-09-30T22:28:13.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfdb69d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd409a500 con 0x7fbfd4133ad0 2023-09-30T22:28:13.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfd9439700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd4133ad0 0x7fbfd4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfd9439700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd4133ad0 0x7fbfd4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36352/0 (socket says 172.21.15.154:36352) 2023-09-30T22:28:13.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfd9439700 1 -- 172.21.15.154:0/3120807534 learned_addr learned my addr 172.21.15.154:0/3120807534 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:13.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.014+0000 7fbfd9c3a700 1 --2- 172.21.15.154:0/3120807534 >> v2:172.21.15.154:3300/0 conn(0x7fbfd4130bc0 0x7fbfd413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.015+0000 7fbfd9c3a700 1 -- 172.21.15.154:0/3120807534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd4133ad0 msgr2=0x7fbfd4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:13.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.015+0000 7fbfd9c3a700 1 --2- 172.21.15.154:0/3120807534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd4133ad0 0x7fbfd4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.015+0000 7fbfd9c3a700 1 -- 172.21.15.154:0/3120807534 >> v1:172.21.15.154:6789/0 conn(0x7fbfd41300a0 legacy=0x7fbfd41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.015+0000 7fbfd9c3a700 1 -- 172.21.15.154:0/3120807534 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd41338b0 con 0x7fbfd4130bc0 2023-09-30T22:28:13.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.015+0000 7fbfd9c3a700 1 --2- 172.21.15.154:0/3120807534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4130bc0 0x7fbfd413b990 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009d90 tx=0x7fbfcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d85756353a73fca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.015+0000 7fbfcbfff700 1 -- 172.21.15.154:0/3120807534 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc00e070 con 0x7fbfd4130bc0 2023-09-30T22:28:13.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.015+0000 7fbfcbfff700 1 -- 172.21.15.154:0/3120807534 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc00bbd0 con 0x7fbfd4130bc0 2023-09-30T22:28:13.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.015+0000 7fbfcbfff700 1 -- 172.21.15.154:0/3120807534 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc012430 con 0x7fbfd4130bc0 2023-09-30T22:28:13.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.016+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3120807534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4130bc0 msgr2=0x7fbfd413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.016+0000 7fbfdb69d700 1 --2- 172.21.15.154:0/3120807534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4130bc0 0x7fbfd413b990 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009d90 tx=0x7fbfcc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:13.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.016+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3120807534 shutdown_connections 2023-09-30T22:28:13.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.016+0000 7fbfdb69d700 1 --2- 172.21.15.154:0/3120807534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4130bc0 0x7fbfd413b990 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.016+0000 7fbfdb69d700 1 --2- 172.21.15.154:0/3120807534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd4133ad0 0x7fbfd4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.016+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3120807534 >> 172.21.15.154:0/3120807534 conn(0x7fbfd4099c40 msgr2=0x7fbfd40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.016+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3120807534 shutdown_connections 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.016+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3120807534 wait complete. 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfdb69d700 1 Processor -- start 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfdb69d700 1 -- start start 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfdb69d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd41300a0 0x7fbfd411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfdb69d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfd4130bc0 0x7fbfd411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfdb69d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4133ad0 0x7fbfd411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfdb69d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41201f0 con 0x7fbfd4133ad0 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfdb69d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4132720 con 0x7fbfd41300a0 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfdb69d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd412dd00 con 0x7fbfd4130bc0 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfd9439700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd41300a0 0x7fbfd411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfd9439700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd41300a0 0x7fbfd411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36364/0 (socket says 172.21.15.154:36364) 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfd9439700 1 -- 172.21.15.154:0/3609284128 learned_addr learned my addr 172.21.15.154:0/3609284128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.017+0000 7fbfd9c3a700 1 --2- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4133ad0 0x7fbfd411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfd9c3a700 1 -- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfd4130bc0 msgr2=0x7fbfd411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfd9c3a700 1 --2- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfd4130bc0 0x7fbfd411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfd9c3a700 1 -- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd41300a0 msgr2=0x7fbfd411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfd9c3a700 1 --2- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd41300a0 0x7fbfd411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfd9c3a700 1 -- 172.21.15.154:0/3609284128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc009a70 con 0x7fbfd4133ad0 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfd9439700 1 --2- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd41300a0 0x7fbfd411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfd9c3a700 1 --2- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4133ad0 0x7fbfd411e4c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc016000 tx=0x7fbfcc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfc9ffb700 1 -- 172.21.15.154:0/3609284128 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc012430 con 0x7fbfd4133ad0 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfc9ffb700 1 -- 172.21.15.154:0/3609284128 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc020070 con 0x7fbfd4133ad0 2023-09-30T22:28:13.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfc9ffb700 1 -- 172.21.15.154:0/3609284128 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc004280 con 0x7fbfd4133ad0 2023-09-30T22:28:13.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3609284128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd411fbb0 con 0x7fbfd4133ad0 2023-09-30T22:28:13.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.018+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3609284128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd411fe70 con 0x7fbfd4133ad0 2023-09-30T22:28:13.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.019+0000 7fbfc9ffb700 1 -- 172.21.15.154:0/3609284128 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfcc0043e0 con 0x7fbfd4133ad0 2023-09-30T22:28:13.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.019+0000 7fbfc9ffb700 1 -- 172.21.15.154:0/3609284128 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbfcc022070 con 0x7fbfd4133ad0 2023-09-30T22:28:13.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.019+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3609284128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd409cb20 con 0x7fbfd4133ad0 2023-09-30T22:28:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.028+0000 7fbfc9ffb700 1 -- 172.21.15.154:0/3609284128 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfcc01c400 con 0x7fbfd4133ad0 2023-09-30T22:28:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.089+0000 7fb37d867700 1 -- 172.21.15.154:0/3919180921 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb37804f2a0 con 0x7fb37809d860 2023-09-30T22:28:13.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.090+0000 7fb35ffff700 1 -- 172.21.15.154:0/3919180921 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb368023790 con 0x7fb37809d860 2023-09-30T22:28:13.090 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.093+0000 7fb37d867700 1 -- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb37809d860 msgr2=0x7fb37811e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.093+0000 7fb37d867700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb37809d860 0x7fb37811e3f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb368009fd0 tx=0x7fb368004750 comp rx=0 tx=0).stop 2023-09-30T22:28:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.093+0000 7fb37d867700 1 -- 172.21.15.154:0/3919180921 shutdown_connections 2023-09-30T22:28:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.093+0000 7fb37d867700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb378130eb0 0x7fb37811ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.093+0000 7fb37d867700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb37809d860 0x7fb37811e3f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.093+0000 7fb37d867700 1 --2- 172.21.15.154:0/3919180921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb37809e170 0x7fb37811e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.093+0000 7fb37d867700 1 -- 172.21.15.154:0/3919180921 >> 172.21.15.154:0/3919180921 conn(0x7fb378099c40 msgr2=0x7fb3780a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.093+0000 7fb37d867700 1 -- 172.21.15.154:0/3919180921 shutdown_connections 2023-09-30T22:28:13.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.093+0000 7fb37d867700 1 -- 172.21.15.154:0/3919180921 wait complete. 2023-09-30T22:28:13.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:13.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.157+0000 7f3786d1e700 1 -- 172.21.15.154:0/3197561842 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f378006bce0 con 0x7f3780130670 2023-09-30T22:28:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.158+0000 7f377d7fa700 1 -- 172.21.15.154:0/3197561842 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3778013380 con 0x7f3780130670 2023-09-30T22:28:13.158 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:13.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.160+0000 7f3786d1e700 1 -- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3780130670 msgr2=0x7f37801c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.160+0000 7f3786d1e700 1 --2- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3780130670 0x7f37801c8c60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3778007270 tx=0x7f377800e5d0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.160+0000 7f3786d1e700 1 -- 172.21.15.154:0/3197561842 shutdown_connections 2023-09-30T22:28:13.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.160+0000 7f3786d1e700 1 --2- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3780130670 0x7f37801c8c60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.160+0000 7f3786d1e700 1 --2- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37800a0a30 0x7f37801c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.160+0000 7f3786d1e700 1 --2- 172.21.15.154:0/3197561842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37800a1340 0x7f37801c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.160+0000 7f3786d1e700 1 -- 172.21.15.154:0/3197561842 >> 172.21.15.154:0/3197561842 conn(0x7f37800a2980 msgr2=0x7f37801b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.160+0000 7f3786d1e700 1 -- 172.21.15.154:0/3197561842 shutdown_connections 2023-09-30T22:28:13.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.160+0000 7f3786d1e700 1 -- 172.21.15.154:0/3197561842 wait complete. 2023-09-30T22:28:13.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:13.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.226+0000 7f833c641700 1 -- 172.21.15.154:0/1332058210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8334137bd0 con 0x7f8334132100 2023-09-30T22:28:13.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.226+0000 7f832affd700 1 -- 172.21.15.154:0/1332058210 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f832c01bce0 con 0x7f8334132100 2023-09-30T22:28:13.227 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.228+0000 7f833c641700 1 -- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8334132100 msgr2=0x7f8334099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.228+0000 7f833c641700 1 --2- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8334132100 0x7f8334099a90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f832c007e70 tx=0x7f832c00e3c0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.229+0000 7f833c641700 1 -- 172.21.15.154:0/1332058210 shutdown_connections 2023-09-30T22:28:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.229+0000 7f833c641700 1 --2- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8334132100 0x7f8334099a90 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.229+0000 7f833c641700 1 --2- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8334066410 0x7f83341c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.229+0000 7f833c641700 1 --2- 172.21.15.154:0/1332058210 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f83341314b0 0x7f83341c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.229+0000 7f833c641700 1 -- 172.21.15.154:0/1332058210 >> 172.21.15.154:0/1332058210 conn(0x7f83340a2980 msgr2=0x7f8334070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.229+0000 7f833c641700 1 -- 172.21.15.154:0/1332058210 shutdown_connections 2023-09-30T22:28:13.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.229+0000 7f833c641700 1 -- 172.21.15.154:0/1332058210 wait complete. 2023-09-30T22:28:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.233+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3609284128 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbfd404f2a0 con 0x7fbfd4133ad0 2023-09-30T22:28:13.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.233+0000 7fbfc9ffb700 1 -- 172.21.15.154:0/3609284128 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfcc026760 con 0x7fbfd4133ad0 2023-09-30T22:28:13.233 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:13.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.236+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4133ad0 msgr2=0x7fbfd411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:13.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.236+0000 7fbfdb69d700 1 --2- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4133ad0 0x7fbfd411e4c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc016000 tx=0x7fbfcc004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.236+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3609284128 shutdown_connections 2023-09-30T22:28:13.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.236+0000 7fbfdb69d700 1 --2- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd4133ad0 0x7fbfd411e4c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.236+0000 7fbfdb69d700 1 --2- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd41300a0 0x7fbfd411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.236+0000 7fbfdb69d700 1 --2- 172.21.15.154:0/3609284128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbfd4130bc0 0x7fbfd411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:13.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.236+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3609284128 >> 172.21.15.154:0/3609284128 conn(0x7fbfd4099c40 msgr2=0x7fbfd40a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:13.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.236+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3609284128 shutdown_connections 2023-09-30T22:28:13.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:13.236+0000 7fbfdb69d700 1 -- 172.21.15.154:0/3609284128 wait complete. 2023-09-30T22:28:13.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:13.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:14.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:14.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:14.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:14.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:14.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.251+0000 7fa5e3caf700 1 Processor -- start 2023-09-30T22:28:14.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.251+0000 7fa5e3caf700 1 -- start start 2023-09-30T22:28:14.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e3caf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc133b80 0x7fa5dc133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e3caf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa5dc099a60 0x7fa5dc0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e3caf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc09aa00 con 0x7fa5dc0a0e20 2023-09-30T22:28:14.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e3caf700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5dc09a080 con 0x7fa5dc099a60 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e3caf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc133750 con 0x7fa5dc133b80 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e1a4b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc133b80 0x7fa5dc133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e224c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa5dc0a0e20 0x7fa5dc13a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36810/0 (socket says 172.21.15.154:36810) 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e1a4b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc133b80 0x7fa5dc133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36380/0 (socket says 172.21.15.154:36380) 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e224c700 1 -- 172.21.15.154:0/3178075758 learned_addr learned my addr 172.21.15.154:0/3178075758 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e124a700 1 --2- 172.21.15.154:0/3178075758 >> v2:172.21.15.154:3300/0 conn(0x7fa5dc099a60 0x7fa5dc0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e1a4b700 1 -- 172.21.15.154:0/3178075758 >> v2:172.21.15.154:3300/0 conn(0x7fa5dc099a60 msgr2=0x7fa5dc0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e1a4b700 1 --2- 172.21.15.154:0/3178075758 >> v2:172.21.15.154:3300/0 conn(0x7fa5dc099a60 0x7fa5dc0a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e1a4b700 1 -- 172.21.15.154:0/3178075758 >> v1:172.21.15.154:6789/0 conn(0x7fa5dc0a0e20 legacy=0x7fa5dc13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e1a4b700 1 -- 172.21.15.154:0/3178075758 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc09a760 con 0x7fa5dc133b80 2023-09-30T22:28:14.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.252+0000 7fa5e124a700 1 --2- 172.21.15.154:0/3178075758 >> v2:172.21.15.154:3300/0 conn(0x7fa5dc099a60 0x7fa5dc0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.253+0000 7fa5e1a4b700 1 --2- 172.21.15.154:0/3178075758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc133b80 0x7fa5dc133f50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009820 tx=0x7fa5d8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d641b3fa0e1a6087 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.253+0000 7fa5e0a49700 1 -- 172.21.15.154:0/3178075758 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8005e30 con 0x7fa5dc133b80 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.253+0000 7fa5e0a49700 1 -- 172.21.15.154:0/3178075758 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d8006030 con 0x7fa5dc133b80 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.253+0000 7fa5e0a49700 1 -- 172.21.15.154:0/3178075758 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80063c0 con 0x7fa5dc133b80 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.254+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3178075758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc133b80 msgr2=0x7fa5dc133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.254+0000 7fa5e3caf700 1 --2- 172.21.15.154:0/3178075758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc133b80 0x7fa5dc133f50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009820 tx=0x7fa5d8009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.254+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3178075758 shutdown_connections 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.254+0000 7fa5e3caf700 1 --2- 172.21.15.154:0/3178075758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc133b80 0x7fa5dc133f50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.254+0000 7fa5e3caf700 1 --2- 172.21.15.154:0/3178075758 >> v2:172.21.15.154:3300/0 conn(0x7fa5dc099a60 0x7fa5dc0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.254+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3178075758 >> 172.21.15.154:0/3178075758 conn(0x7fa5dc0a2980 msgr2=0x7fa5dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.254+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3178075758 shutdown_connections 2023-09-30T22:28:14.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.254+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3178075758 wait complete. 2023-09-30T22:28:14.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.255+0000 7fa5e3caf700 1 Processor -- start 2023-09-30T22:28:14.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.255+0000 7fa5e3caf700 1 -- start start 2023-09-30T22:28:14.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e3caf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5dc099a60 0x7fa5dc11faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e3caf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc0a0e20 0x7fa5dc120030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e3caf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc133b80 0x7fa5dc120570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e3caf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc123020 con 0x7fa5dc133b80 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e3caf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc09a2c0 con 0x7fa5dc0a0e20 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e3caf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc121750 con 0x7fa5dc099a60 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e1a4b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5dc099a60 0x7fa5dc11faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e224c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc133b80 0x7fa5dc120570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e1a4b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5dc099a60 0x7fa5dc11faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44358/0 (socket says 172.21.15.154:44358) 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e1a4b700 1 -- 172.21.15.154:0/3757526475 learned_addr learned my addr 172.21.15.154:0/3757526475 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e224c700 1 -- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5dc099a60 msgr2=0x7fa5dc11faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e224c700 1 --2- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5dc099a60 0x7fa5dc11faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e224c700 1 -- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc0a0e20 msgr2=0x7fa5dc120030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e224c700 1 --2- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc0a0e20 0x7fa5dc120030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e224c700 1 -- 172.21.15.154:0/3757526475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc0094a0 con 0x7fa5dc133b80 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.256+0000 7fa5e224c700 1 --2- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc133b80 0x7fa5dc120570 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400caa0 tx=0x7fa5d400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.257+0000 7fa5d27fc700 1 -- 172.21.15.154:0/3757526475 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400aa60 con 0x7fa5dc133b80 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.257+0000 7fa5d27fc700 1 -- 172.21.15.154:0/3757526475 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d400abc0 con 0x7fa5dc133b80 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.257+0000 7fa5d27fc700 1 -- 172.21.15.154:0/3757526475 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4012400 con 0x7fa5dc133b80 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.257+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3757526475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d8009430 con 0x7fa5dc133b80 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.257+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3757526475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc1229d0 con 0x7fa5dc133b80 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.257+0000 7fa5d27fc700 1 -- 172.21.15.154:0/3757526475 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5d4012560 con 0x7fa5dc133b80 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.258+0000 7fa5d27fc700 1 -- 172.21.15.154:0/3757526475 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa5d403f3b0 con 0x7fa5dc133b80 2023-09-30T22:28:14.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.258+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3757526475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc04f2a0 con 0x7fa5dc133b80 2023-09-30T22:28:14.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.264+0000 7fa5d27fc700 1 -- 172.21.15.154:0/3757526475 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5d401b3b0 con 0x7fa5dc133b80 2023-09-30T22:28:14.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.317+0000 7f905b2ce700 1 Processor -- start 2023-09-30T22:28:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.318+0000 7f905b2ce700 1 -- start start 2023-09-30T22:28:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.318+0000 7f905b2ce700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9054133900 0x7f9054133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.318+0000 7f905b2ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90540a10b0 0x7f905413b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.318+0000 7f905b2ce700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905409a760 con 0x7f9054134210 2023-09-30T22:28:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.318+0000 7f905b2ce700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90541336e0 con 0x7f9054133900 2023-09-30T22:28:14.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.318+0000 7f905b2ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905409a080 con 0x7f90540a10b0 2023-09-30T22:28:14.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905906a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9054133900 0x7f9054133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905906a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9054133900 0x7f9054133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58830/0 (socket says 172.21.15.154:58830) 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905906a700 1 -- 172.21.15.154:0/2939134439 learned_addr learned my addr 172.21.15.154:0/2939134439 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905986b700 1 --2- 172.21.15.154:0/2939134439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90540a10b0 0x7f905413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905906a700 1 -- 172.21.15.154:0/2939134439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90540a10b0 msgr2=0x7f905413b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905906a700 1 --2- 172.21.15.154:0/2939134439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90540a10b0 0x7f905413b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905906a700 1 -- 172.21.15.154:0/2939134439 >> v1:172.21.15.154:6789/0 conn(0x7f9054134210 legacy=0x7f90540a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905906a700 1 -- 172.21.15.154:0/2939134439 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90540a23e0 con 0x7f9054133900 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905986b700 1 --2- 172.21.15.154:0/2939134439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90540a10b0 0x7f905413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f905906a700 1 --2- 172.21.15.154:0/2939134439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9054133900 0x7f9054133cd0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f9050006fd0 tx=0x7f9050009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43962ce06260e4ac server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f904bfff700 1 -- 172.21.15.154:0/2939134439 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050005e30 con 0x7f9054133900 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f904bfff700 1 -- 172.21.15.154:0/2939134439 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050004030 con 0x7f9054133900 2023-09-30T22:28:14.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.319+0000 7f904bfff700 1 -- 172.21.15.154:0/2939134439 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90500043e0 con 0x7f9054133900 2023-09-30T22:28:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.320+0000 7f905b2ce700 1 -- 172.21.15.154:0/2939134439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9054133900 msgr2=0x7f9054133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.320+0000 7f905b2ce700 1 --2- 172.21.15.154:0/2939134439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9054133900 0x7f9054133cd0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f9050006fd0 tx=0x7f9050009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.320+0000 7f905b2ce700 1 -- 172.21.15.154:0/2939134439 shutdown_connections 2023-09-30T22:28:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.320+0000 7f905b2ce700 1 --2- 172.21.15.154:0/2939134439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90540a10b0 0x7f905413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.320+0000 7f905b2ce700 1 --2- 172.21.15.154:0/2939134439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9054133900 0x7f9054133cd0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.320+0000 7f905b2ce700 1 -- 172.21.15.154:0/2939134439 >> 172.21.15.154:0/2939134439 conn(0x7f90540a2980 msgr2=0x7f90540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.321+0000 7f905b2ce700 1 -- 172.21.15.154:0/2939134439 shutdown_connections 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.321+0000 7f905b2ce700 1 -- 172.21.15.154:0/2939134439 wait complete. 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.321+0000 7f905b2ce700 1 Processor -- start 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f905b2ce700 1 -- start start 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f905b2ce700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90540a10b0 0x7f905411c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f905b2ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9054133900 0x7f905411cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f905b2ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9054134210 0x7f905411d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f905b2ce700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9054120340 con 0x7f90540a10b0 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f905b2ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905411ea50 con 0x7f9054133900 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f905b2ce700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f905411fad0 con 0x7f9054134210 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f9058869700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9054133900 0x7f905411cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f905906a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90540a10b0 0x7f905411c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f9058869700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9054133900 0x7f905411cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36388/0 (socket says 172.21.15.154:36388) 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f905906a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90540a10b0 0x7f905411c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58842/0 (socket says 172.21.15.154:58842) 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.322+0000 7f9058869700 1 -- 172.21.15.154:0/904162351 learned_addr learned my addr 172.21.15.154:0/904162351 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905906a700 1 -- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9054134210 msgr2=0x7f905411d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905986b700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9054134210 0x7f905411d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905906a700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9054134210 0x7f905411d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905906a700 1 -- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9054133900 msgr2=0x7f905411cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905906a700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9054133900 0x7f905411cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905906a700 1 -- 172.21.15.154:0/904162351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c009a70 con 0x7f90540a10b0 2023-09-30T22:28:14.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f9058869700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9054133900 0x7f905411cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905986b700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9054134210 0x7f905411d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905906a700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90540a10b0 0x7f905411c870 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f9050009fd0 tx=0x7f9050004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f9049ffb700 1 -- 172.21.15.154:0/904162351 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050003d20 con 0x7f90540a10b0 2023-09-30T22:28:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f9049ffb700 1 -- 172.21.15.154:0/904162351 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050003e80 con 0x7f90540a10b0 2023-09-30T22:28:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f9049ffb700 1 -- 172.21.15.154:0/904162351 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905001c660 con 0x7f90540a10b0 2023-09-30T22:28:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905b2ce700 1 -- 172.21.15.154:0/904162351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9050009500 con 0x7f90540a10b0 2023-09-30T22:28:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.323+0000 7f905b2ce700 1 -- 172.21.15.154:0/904162351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9054132f80 con 0x7f90540a10b0 2023-09-30T22:28:14.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.324+0000 7f905b2ce700 1 -- 172.21.15.154:0/904162351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905411fd00 con 0x7f90540a10b0 2023-09-30T22:28:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.324+0000 7f9049ffb700 1 -- 172.21.15.154:0/904162351 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f905001c7c0 con 0x7f90540a10b0 2023-09-30T22:28:14.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.325+0000 7f9049ffb700 1 -- 172.21.15.154:0/904162351 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9050040390 con 0x7f90540a10b0 2023-09-30T22:28:14.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.329+0000 7f9049ffb700 1 -- 172.21.15.154:0/904162351 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f905411fd00 con 0x7f90540a10b0 2023-09-30T22:28:14.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.379+0000 7f106d156700 1 Processor -- start 2023-09-30T22:28:14.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106d156700 1 -- start start 2023-09-30T22:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106d156700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f106809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106d156700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106d156700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1068130ce0 0x7f1068131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106d156700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106809aaa0 con 0x7f1068130ce0 2023-09-30T22:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106d156700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106809f870 con 0x7f106809d860 2023-09-30T22:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106d156700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f106809b360 con 0x7f106809e170 2023-09-30T22:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f1066d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f106809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44374/0 (socket says 172.21.15.154:44374) 2023-09-30T22:28:14.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f1066d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f106809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36396/0 (socket says 172.21.15.154:36396) 2023-09-30T22:28:14.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f1155b8a700 1 Processor -- start 2023-09-30T22:28:14.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f106659c700 1 -- 172.21.15.154:0/2260125335 learned_addr learned my addr 172.21.15.154:0/2260125335 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.380+0000 7f1155b8a700 1 -- start start 2023-09-30T22:28:14.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f106659c700 1 -- 172.21.15.154:0/2260125335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 msgr2=0x7f106809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f106659c700 1 --2- 172.21.15.154:0/2260125335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f106809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f106659c700 1 -- 172.21.15.154:0/2260125335 >> v2:172.21.15.154:3300/0 conn(0x7f1068130ce0 msgr2=0x7f1068131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f106659c700 1 --2- 172.21.15.154:0/2260125335 >> v2:172.21.15.154:3300/0 conn(0x7f1068130ce0 0x7f1068131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f106659c700 1 -- 172.21.15.154:0/2260125335 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106809b620 con 0x7f106809e170 2023-09-30T22:28:14.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f106659c700 1 --2- 172.21.15.154:0/2260125335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681307a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f105c00bb90 tx=0x7f105c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7de72ccd30c1e54b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f1065d9b700 1 -- 172.21.15.154:0/2260125335 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c00dd30 con 0x7f106809e170 2023-09-30T22:28:14.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f1065d9b700 1 -- 172.21.15.154:0/2260125335 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c00de90 con 0x7f106809e170 2023-09-30T22:28:14.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f1065d9b700 1 -- 172.21.15.154:0/2260125335 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c010690 con 0x7f106809e170 2023-09-30T22:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f1155b8a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f115009dec0 0x7f115006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f1155b8a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1150136cb0 0x7f1150139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f1155b8a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115006e900 con 0x7f115006a770 2023-09-30T22:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f1155b8a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115009d180 con 0x7f115009dec0 2023-09-30T22:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f1155b8a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115009e780 con 0x7f1150136cb0 2023-09-30T22:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f114f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f115006a770 0x7f115006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36828/0 (socket says 172.21.15.154:36828) 2023-09-30T22:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f114f7fe700 1 -- 172.21.15.154:0/1924682055 learned_addr learned my addr 172.21.15.154:0/1924682055 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.381+0000 7f114effd700 1 --2- 172.21.15.154:0/1924682055 >> v2:172.21.15.154:3300/0 conn(0x7f115009dec0 0x7f115006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f106d156700 1 -- 172.21.15.154:0/2260125335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 msgr2=0x7f10681307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f106d156700 1 --2- 172.21.15.154:0/2260125335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681307a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f105c00bb90 tx=0x7f105c00bea0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f114ffff700 1 --2- 172.21.15.154:0/1924682055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1150136cb0 0x7f1150139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f114effd700 1 -- 172.21.15.154:0/1924682055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1150136cb0 msgr2=0x7f1150139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:14.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f114effd700 1 --2- 172.21.15.154:0/1924682055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1150136cb0 0x7f1150139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f114effd700 1 -- 172.21.15.154:0/1924682055 >> v1:172.21.15.154:6789/0 conn(0x7f115006a770 legacy=0x7f115006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f114effd700 1 -- 172.21.15.154:0/1924682055 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115009d3c0 con 0x7f115009dec0 2023-09-30T22:28:14.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f114ffff700 1 --2- 172.21.15.154:0/1924682055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1150136cb0 0x7f1150139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:14.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f106d156700 1 -- 172.21.15.154:0/2260125335 shutdown_connections 2023-09-30T22:28:14.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f106d156700 1 --2- 172.21.15.154:0/2260125335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f106809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f106d156700 1 --2- 172.21.15.154:0/2260125335 >> v2:172.21.15.154:3300/0 conn(0x7f1068130ce0 0x7f1068131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f106d156700 1 --2- 172.21.15.154:0/2260125335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681307a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f106d156700 1 -- 172.21.15.154:0/2260125335 >> 172.21.15.154:0/2260125335 conn(0x7f1068099c40 msgr2=0x7f10680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f106d156700 1 -- 172.21.15.154:0/2260125335 shutdown_connections 2023-09-30T22:28:14.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f106d156700 1 -- 172.21.15.154:0/2260125335 wait complete. 2023-09-30T22:28:14.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.382+0000 7f114effd700 1 --2- 172.21.15.154:0/1924682055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f115009dec0 0x7f115006b250 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1140009d90 tx=0x7f114000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63088be200108ec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.383+0000 7f114e7fc700 1 -- 172.21.15.154:0/1924682055 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114000e070 con 0x7f115009dec0 2023-09-30T22:28:14.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.383+0000 7f114e7fc700 1 -- 172.21.15.154:0/1924682055 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114000bad0 con 0x7f115009dec0 2023-09-30T22:28:14.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.383+0000 7f114e7fc700 1 -- 172.21.15.154:0/1924682055 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114000be80 con 0x7f115009dec0 2023-09-30T22:28:14.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.383+0000 7f106d156700 1 Processor -- start 2023-09-30T22:28:14.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.383+0000 7f106d156700 1 -- start start 2023-09-30T22:28:14.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f106d156700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f10681c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f106d156700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f106d156700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1068130ce0 0x7f1068119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f106d156700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10681c4cd0 con 0x7f1068130ce0 2023-09-30T22:28:14.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f106d156700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106809c8b0 con 0x7f106809d860 2023-09-30T22:28:14.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f106d156700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f106811b7e0 con 0x7f106809e170 2023-09-30T22:28:14.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1155b8a700 1 -- 172.21.15.154:0/1924682055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f115009dec0 msgr2=0x7f115006b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1155b8a700 1 --2- 172.21.15.154:0/1924682055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f115009dec0 0x7f115006b250 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f1140009d90 tx=0x7f114000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:14.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1066d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f10681c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1066d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f10681c5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:36404/0 (socket says 172.21.15.154:36404) 2023-09-30T22:28:14.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1066d9d700 1 -- 172.21.15.154:0/3049857297 learned_addr learned my addr 172.21.15.154:0/3049857297 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:14.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f106759e700 1 --2- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1068130ce0 0x7f1068119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f106659c700 1 --2- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1066d9d700 1 -- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 msgr2=0x7f10681c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1066d9d700 1 --2- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1066d9d700 1 -- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1068130ce0 msgr2=0x7f1068119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1066d9d700 1 --2- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1068130ce0 0x7f1068119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1066d9d700 1 -- 172.21.15.154:0/3049857297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c00b7f0 con 0x7f106809d860 2023-09-30T22:28:14.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.384+0000 7f1066d9d700 1 --2- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f10681c5170 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f105800e9b0 tx=0x7f105800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f104f7fe700 1 -- 172.21.15.154:0/3049857297 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058009710 con 0x7f106809d860 2023-09-30T22:28:14.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f1155b8a700 1 -- 172.21.15.154:0/1924682055 shutdown_connections 2023-09-30T22:28:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f1155b8a700 1 --2- 172.21.15.154:0/1924682055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1150136cb0 0x7f1150139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f1155b8a700 1 --2- 172.21.15.154:0/1924682055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f115009dec0 0x7f115006b250 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f1155b8a700 1 -- 172.21.15.154:0/1924682055 >> 172.21.15.154:0/1924682055 conn(0x7f1150099c40 msgr2=0x7f11500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f104f7fe700 1 -- 172.21.15.154:0/3049857297 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800ee50 con 0x7f106809d860 2023-09-30T22:28:14.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f106d156700 1 -- 172.21.15.154:0/3049857297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10681377d0 con 0x7f106809d860 2023-09-30T22:28:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f104f7fe700 1 -- 172.21.15.154:0/3049857297 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800ca50 con 0x7f106809d860 2023-09-30T22:28:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f106d156700 1 -- 172.21.15.154:0/3049857297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106811bd80 con 0x7f106809d860 2023-09-30T22:28:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.385+0000 7f1155b8a700 1 -- 172.21.15.154:0/1924682055 shutdown_connections 2023-09-30T22:28:14.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.386+0000 7f1155b8a700 1 -- 172.21.15.154:0/1924682055 wait complete. 2023-09-30T22:28:14.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.386+0000 7f104f7fe700 1 -- 172.21.15.154:0/3049857297 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f105800cbb0 con 0x7f106809d860 2023-09-30T22:28:14.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.386+0000 7f106d156700 1 -- 172.21.15.154:0/3049857297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106811ba00 con 0x7f106809d860 2023-09-30T22:28:14.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.386+0000 7f104f7fe700 1 -- 172.21.15.154:0/3049857297 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f105803f720 con 0x7f106809d860 2023-09-30T22:28:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.387+0000 7f1155b8a700 1 Processor -- start 2023-09-30T22:28:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.387+0000 7f1155b8a700 1 -- start start 2023-09-30T22:28:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f1155b8a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115006a770 0x7f11501c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f1155b8a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f115009dec0 0x7f11501c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f1155b8a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1150136cb0 0x7f11501c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f1155b8a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150133a80 con 0x7f1150136cb0 2023-09-30T22:28:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f1155b8a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11501349e0 con 0x7f115006a770 2023-09-30T22:28:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f1155b8a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11501356b0 con 0x7f115009dec0 2023-09-30T22:28:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f114effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f115009dec0 0x7f11501c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f114effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f115009dec0 0x7f11501c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:44386/0 (socket says 172.21.15.154:44386) 2023-09-30T22:28:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f114effd700 1 -- 172.21.15.154:0/3726357535 learned_addr learned my addr 172.21.15.154:0/3726357535 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f114ffff700 1 --2- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1150136cb0 0x7f11501c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f114effd700 1 -- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115006a770 msgr2=0x7f11501c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f114effd700 1 --2- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115006a770 0x7f11501c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f114effd700 1 -- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1150136cb0 msgr2=0x7f11501c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f114effd700 1 --2- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1150136cb0 0x7f11501c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.388+0000 7f114effd700 1 -- 172.21.15.154:0/3726357535 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1140009a70 con 0x7f115009dec0 2023-09-30T22:28:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.389+0000 7f114effd700 1 --2- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f115009dec0 0x7f11501c4640 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f114000b730 tx=0x7f1140004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.389+0000 7f1147fff700 1 -- 172.21.15.154:0/3726357535 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1140012630 con 0x7f115009dec0 2023-09-30T22:28:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.389+0000 7f1147fff700 1 -- 172.21.15.154:0/3726357535 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1140012790 con 0x7f115009dec0 2023-09-30T22:28:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.389+0000 7f1155b8a700 1 -- 172.21.15.154:0/3726357535 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1150136570 con 0x7f115009dec0 2023-09-30T22:28:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.389+0000 7f1147fff700 1 -- 172.21.15.154:0/3726357535 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1140012b40 con 0x7f115009dec0 2023-09-30T22:28:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.389+0000 7f1155b8a700 1 -- 172.21.15.154:0/3726357535 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1150134270 con 0x7f115009dec0 2023-09-30T22:28:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.390+0000 7f1155b8a700 1 -- 172.21.15.154:0/3726357535 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115004f2a0 con 0x7f115009dec0 2023-09-30T22:28:14.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.392+0000 7f104f7fe700 1 -- 172.21.15.154:0/3049857297 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f106811ba00 con 0x7f106809d860 2023-09-30T22:28:14.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.391+0000 7f1147fff700 1 -- 172.21.15.154:0/3726357535 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1140012ca0 con 0x7f115009dec0 2023-09-30T22:28:14.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.391+0000 7f1147fff700 1 -- 172.21.15.154:0/3726357535 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1140041d20 con 0x7f115009dec0 2023-09-30T22:28:14.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.395+0000 7f1147fff700 1 -- 172.21.15.154:0/3726357535 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f114001b390 con 0x7f115009dec0 2023-09-30T22:28:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.480+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3757526475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa5dc130e90 con 0x7fa5dc133b80 2023-09-30T22:28:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.480+0000 7fa5d27fc700 1 -- 172.21.15.154:0/3757526475 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5d4007070 con 0x7fa5dc133b80 2023-09-30T22:28:14.480 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.483+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc133b80 msgr2=0x7fa5dc120570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.483+0000 7fa5e3caf700 1 --2- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc133b80 0x7fa5dc120570 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400caa0 tx=0x7fa5d400cdb0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.483+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3757526475 shutdown_connections 2023-09-30T22:28:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.483+0000 7fa5e3caf700 1 --2- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc133b80 0x7fa5dc120570 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.483+0000 7fa5e3caf700 1 --2- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa5dc099a60 0x7fa5dc11faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.483+0000 7fa5e3caf700 1 --2- 172.21.15.154:0/3757526475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5dc0a0e20 0x7fa5dc120030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.483+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3757526475 >> 172.21.15.154:0/3757526475 conn(0x7fa5dc0a2980 msgr2=0x7fa5dc132360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.483+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3757526475 shutdown_connections 2023-09-30T22:28:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.483+0000 7fa5e3caf700 1 -- 172.21.15.154:0/3757526475 wait complete. 2023-09-30T22:28:14.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:14.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.529+0000 7f905b2ce700 1 -- 172.21.15.154:0/904162351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f905411fd00 con 0x7f90540a10b0 2023-09-30T22:28:14.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.529+0000 7f9049ffb700 1 -- 172.21.15.154:0/904162351 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f905411fd00 con 0x7f90540a10b0 2023-09-30T22:28:14.530 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:14.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.532+0000 7f905b2ce700 1 -- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90540a10b0 msgr2=0x7f905411c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.532+0000 7f905b2ce700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90540a10b0 0x7f905411c870 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f9050009fd0 tx=0x7f9050004750 comp rx=0 tx=0).stop 2023-09-30T22:28:14.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.532+0000 7f905b2ce700 1 -- 172.21.15.154:0/904162351 shutdown_connections 2023-09-30T22:28:14.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.532+0000 7f905b2ce700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9054134210 0x7f905411d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.532+0000 7f905b2ce700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90540a10b0 0x7f905411c870 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.532+0000 7f905b2ce700 1 --2- 172.21.15.154:0/904162351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9054133900 0x7f905411cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.532+0000 7f905b2ce700 1 -- 172.21.15.154:0/904162351 >> 172.21.15.154:0/904162351 conn(0x7f90540a2980 msgr2=0x7f90541baf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.532+0000 7f905b2ce700 1 -- 172.21.15.154:0/904162351 shutdown_connections 2023-09-30T22:28:14.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.532+0000 7f905b2ce700 1 -- 172.21.15.154:0/904162351 wait complete. 2023-09-30T22:28:14.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:14.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.594+0000 7f106d156700 1 -- 172.21.15.154:0/3049857297 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f106804f2a0 con 0x7f106809d860 2023-09-30T22:28:14.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.595+0000 7f104f7fe700 1 -- 172.21.15.154:0/3049857297 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1058017070 con 0x7f106809d860 2023-09-30T22:28:14.595 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:14.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.597+0000 7f106d156700 1 -- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 msgr2=0x7f10681c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.597+0000 7f106d156700 1 --2- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f10681c5170 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f105800e9b0 tx=0x7f105800ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.597+0000 7f106d156700 1 -- 172.21.15.154:0/3049857297 shutdown_connections 2023-09-30T22:28:14.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.597+0000 7f106d156700 1 --2- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1068130ce0 0x7f1068119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.597+0000 7f106d156700 1 --2- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f106809d860 0x7f10681c5170 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.597+0000 7f106d156700 1 --2- 172.21.15.154:0/3049857297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f106809e170 0x7f10681c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.597+0000 7f106d156700 1 -- 172.21.15.154:0/3049857297 >> 172.21.15.154:0/3049857297 conn(0x7f1068099c40 msgr2=0x7f10680a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.597+0000 7f106d156700 1 -- 172.21.15.154:0/3049857297 shutdown_connections 2023-09-30T22:28:14.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.597+0000 7f106d156700 1 -- 172.21.15.154:0/3049857297 wait complete. 2023-09-30T22:28:14.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.599+0000 7f1155b8a700 1 -- 172.21.15.154:0/3726357535 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f115009c8e0 con 0x7f115009dec0 2023-09-30T22:28:14.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.600+0000 7f1147fff700 1 -- 172.21.15.154:0/3726357535 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1140034090 con 0x7f115009dec0 2023-09-30T22:28:14.600 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.602+0000 7f1155b8a700 1 -- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f115009dec0 msgr2=0x7f11501c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.602+0000 7f1155b8a700 1 --2- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f115009dec0 0x7f11501c4640 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f114000b730 tx=0x7f1140004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.602+0000 7f1155b8a700 1 -- 172.21.15.154:0/3726357535 shutdown_connections 2023-09-30T22:28:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.602+0000 7f1155b8a700 1 --2- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1150136cb0 0x7f11501c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.602+0000 7f1155b8a700 1 --2- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f115006a770 0x7f11501c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.602+0000 7f1155b8a700 1 --2- 172.21.15.154:0/3726357535 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f115009dec0 0x7f11501c4640 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.602+0000 7f1155b8a700 1 -- 172.21.15.154:0/3726357535 >> 172.21.15.154:0/3726357535 conn(0x7f1150099c40 msgr2=0x7f115012ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:14.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.602+0000 7f1155b8a700 1 -- 172.21.15.154:0/3726357535 shutdown_connections 2023-09-30T22:28:14.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:14.602+0000 7f1155b8a700 1 -- 172.21.15.154:0/3726357535 wait complete. 2023-09-30T22:28:14.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:14.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:15.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:15.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:15.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:15.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:15.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.639+0000 7f7216f4f700 1 Processor -- start 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.639+0000 7f7216f4f700 1 -- start start 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.639+0000 7f7216f4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 0x7f7210133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.639+0000 7f7216f4f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 0x7f72101304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.639+0000 7f7216f4f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721006b2d0 con 0x7f72101309f0 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.639+0000 7f7216f4f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7210133610 con 0x7f72101300a0 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f7214ceb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 0x7f7210133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f7216f4f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f721009a500 con 0x7f7210133ad0 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f7214ceb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 0x7f7210133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51628/0 (socket says 172.21.15.154:51628) 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f7214ceb700 1 -- 172.21.15.154:0/1992169804 learned_addr learned my addr 172.21.15.154:0/1992169804 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:15.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f720ffff700 1 --2- 172.21.15.154:0/1992169804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 0x7f72101304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f7214ceb700 1 -- 172.21.15.154:0/1992169804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 msgr2=0x7f72101304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:15.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f7214ceb700 1 --2- 172.21.15.154:0/1992169804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 0x7f72101304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f7214ceb700 1 -- 172.21.15.154:0/1992169804 >> v1:172.21.15.154:6789/0 conn(0x7f72101309f0 legacy=0x7f721013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f7214ceb700 1 -- 172.21.15.154:0/1992169804 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72101338b0 con 0x7f7210133ad0 2023-09-30T22:28:15.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f7214ceb700 1 --2- 172.21.15.154:0/1992169804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 0x7f7210133ea0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7204009920 tx=0x7f7204009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da0161b0b9674046 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f720f7fe700 1 -- 172.21.15.154:0/1992169804 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204011830 con 0x7f7210133ad0 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f720f7fe700 1 -- 172.21.15.154:0/1992169804 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7204011990 con 0x7f7210133ad0 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.640+0000 7f720f7fe700 1 -- 172.21.15.154:0/1992169804 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7204011d20 con 0x7f7210133ad0 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.641+0000 7f7216f4f700 1 -- 172.21.15.154:0/1992169804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 msgr2=0x7f7210133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.641+0000 7f7216f4f700 1 --2- 172.21.15.154:0/1992169804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 0x7f7210133ea0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7204009920 tx=0x7f7204009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.641+0000 7f7216f4f700 1 -- 172.21.15.154:0/1992169804 shutdown_connections 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.641+0000 7f7216f4f700 1 --2- 172.21.15.154:0/1992169804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 0x7f7210133ea0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.641+0000 7f7216f4f700 1 --2- 172.21.15.154:0/1992169804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 0x7f72101304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.641+0000 7f7216f4f700 1 -- 172.21.15.154:0/1992169804 >> 172.21.15.154:0/1992169804 conn(0x7f7210099c40 msgr2=0x7f72100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.641+0000 7f7216f4f700 1 -- 172.21.15.154:0/1992169804 shutdown_connections 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.641+0000 7f7216f4f700 1 -- 172.21.15.154:0/1992169804 wait complete. 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.642+0000 7f7216f4f700 1 Processor -- start 2023-09-30T22:28:15.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.642+0000 7f7216f4f700 1 -- start start 2023-09-30T22:28:15.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f7216f4f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 0x7f721011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f7216f4f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72101309f0 0x7f721011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f7216f4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 0x7f721011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f7216f4f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721012d4d0 con 0x7f72101309f0 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f7216f4f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72100724d0 con 0x7f72101300a0 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f7216f4f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7210120110 con 0x7f7210133ad0 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f720ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72101309f0 0x7f721011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f7214ceb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 0x7f721011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f720ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72101309f0 0x7f721011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44112/0 (socket says 172.21.15.154:44112) 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.643+0000 7f720ffff700 1 -- 172.21.15.154:0/2866291332 learned_addr learned my addr 172.21.15.154:0/2866291332 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f720ffff700 1 -- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 msgr2=0x7f721011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f720ffff700 1 --2- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 0x7f721011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f720ffff700 1 -- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 msgr2=0x7f721011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f720ffff700 1 --2- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 0x7f721011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f720ffff700 1 -- 172.21.15.154:0/2866291332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7204009550 con 0x7f72101309f0 2023-09-30T22:28:15.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f7214ceb700 1 --2- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 0x7f721011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:15.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f720ffff700 1 --2- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72101309f0 0x7f721011df80 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00e840 tx=0x7f71fc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f720d7fa700 1 -- 172.21.15.154:0/2866291332 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc009590 con 0x7f72101309f0 2023-09-30T22:28:15.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f720d7fa700 1 -- 172.21.15.154:0/2866291332 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc013680 con 0x7f72101309f0 2023-09-30T22:28:15.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f720d7fa700 1 -- 172.21.15.154:0/2866291332 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc013a10 con 0x7f72101309f0 2023-09-30T22:28:15.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f7216f4f700 1 -- 172.21.15.154:0/2866291332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721011ea90 con 0x7f72101309f0 2023-09-30T22:28:15.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.644+0000 7f7216f4f700 1 -- 172.21.15.154:0/2866291332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7210071a30 con 0x7f72101309f0 2023-09-30T22:28:15.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.645+0000 7f720d7fa700 1 -- 172.21.15.154:0/2866291332 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71fc013b70 con 0x7f72101309f0 2023-09-30T22:28:15.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.645+0000 7f720d7fa700 1 -- 172.21.15.154:0/2866291332 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71fc03fa60 con 0x7f72101309f0 2023-09-30T22:28:15.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.648+0000 7f7216f4f700 1 -- 172.21.15.154:0/2866291332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721004f2a0 con 0x7f72101309f0 2023-09-30T22:28:15.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.653+0000 7f720d7fa700 1 -- 172.21.15.154:0/2866291332 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71fc017020 con 0x7f72101309f0 2023-09-30T22:28:15.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.686+0000 7faa6e7ae700 1 Processor -- start 2023-09-30T22:28:15.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.686+0000 7faa6e7ae700 1 -- start start 2023-09-30T22:28:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa6e7ae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68136960 0x7faa68138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa6e7ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68139280 0x7faa6813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa6e7ae700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6806b2d0 con 0x7faa68133ad0 2023-09-30T22:28:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa6e7ae700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa681345b0 con 0x7faa68136960 2023-09-30T22:28:15.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa6e7ae700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa68133610 con 0x7faa68139280 2023-09-30T22:28:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa67fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faa68133ad0 0x7faa68133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36172/0 (socket says 172.21.15.154:36172) 2023-09-30T22:28:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa67fff700 1 -- 172.21.15.154:0/3029217056 learned_addr learned my addr 172.21.15.154:0/3029217056 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa677fe700 1 --2- 172.21.15.154:0/3029217056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68136960 0x7faa68138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa6cd4b700 1 --2- 172.21.15.154:0/3029217056 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68139280 0x7faa6813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa66ffd700 1 -- 172.21.15.154:0/3029217056 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099957476 0 0) 0x7faa6806b2d0 con 0x7faa68133ad0 2023-09-30T22:28:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa66ffd700 1 -- 172.21.15.154:0/3029217056 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa500035b0 con 0x7faa68133ad0 2023-09-30T22:28:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa6cd4b700 1 -- 172.21.15.154:0/3029217056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68136960 msgr2=0x7faa68138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:15.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa6cd4b700 1 --2- 172.21.15.154:0/3029217056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68136960 0x7faa68138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.687+0000 7faa6cd4b700 1 -- 172.21.15.154:0/3029217056 >> v1:172.21.15.154:6789/0 conn(0x7faa68133ad0 legacy=0x7faa68133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.688+0000 7faa6cd4b700 1 -- 172.21.15.154:0/3029217056 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6809a500 con 0x7faa68139280 2023-09-30T22:28:15.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.688+0000 7faa6cd4b700 1 --2- 172.21.15.154:0/3029217056 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68139280 0x7faa6813b660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa60009dc0 tx=0x7faa6000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ffa326ae6200871 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.688+0000 7faa66ffd700 1 -- 172.21.15.154:0/3029217056 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6000e070 con 0x7faa68139280 2023-09-30T22:28:15.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.688+0000 7faa66ffd700 1 -- 172.21.15.154:0/3029217056 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6000bb20 con 0x7faa68139280 2023-09-30T22:28:15.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.688+0000 7faa66ffd700 1 -- 172.21.15.154:0/3029217056 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60012430 con 0x7faa68139280 2023-09-30T22:28:15.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.689+0000 7faa6e7ae700 1 -- 172.21.15.154:0/3029217056 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68139280 msgr2=0x7faa6813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.689+0000 7faa6e7ae700 1 --2- 172.21.15.154:0/3029217056 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68139280 0x7faa6813b660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa60009dc0 tx=0x7faa6000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:15.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.689+0000 7faa6e7ae700 1 -- 172.21.15.154:0/3029217056 shutdown_connections 2023-09-30T22:28:15.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.689+0000 7faa6e7ae700 1 --2- 172.21.15.154:0/3029217056 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68139280 0x7faa6813b660 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.689+0000 7faa6e7ae700 1 --2- 172.21.15.154:0/3029217056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68136960 0x7faa68138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.689+0000 7faa6e7ae700 1 -- 172.21.15.154:0/3029217056 >> 172.21.15.154:0/3029217056 conn(0x7faa68099c40 msgr2=0x7faa680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.689+0000 7faa6e7ae700 1 -- 172.21.15.154:0/3029217056 shutdown_connections 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.689+0000 7faa6e7ae700 1 -- 172.21.15.154:0/3029217056 wait complete. 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa6e7ae700 1 Processor -- start 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa6e7ae700 1 -- start start 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa6e7ae700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa68133ad0 0x7faa6812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa6e7ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68136960 0x7faa6812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa6e7ae700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68139280 0x7faa6812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa6e7ae700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6809f390 con 0x7faa68133ad0 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa6e7ae700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa68130500 con 0x7faa68139280 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa6e7ae700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa68131610 con 0x7faa68136960 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa67fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa68133ad0 0x7faa6812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa67fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa68133ad0 0x7faa6812cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44116/0 (socket says 172.21.15.154:44116) 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa67fff700 1 -- 172.21.15.154:0/1822446104 learned_addr learned my addr 172.21.15.154:0/1822446104 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.690+0000 7faa677fe700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68136960 0x7faa6812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa6cd4b700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68139280 0x7faa6812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa67fff700 1 -- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68136960 msgr2=0x7faa6812d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa67fff700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68136960 0x7faa6812d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa67fff700 1 -- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68139280 msgr2=0x7faa6812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa67fff700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68139280 0x7faa6812d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa67fff700 1 -- 172.21.15.154:0/1822446104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60009a70 con 0x7faa68133ad0 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa677fe700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68136960 0x7faa6812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa6cd4b700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68139280 0x7faa6812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa67fff700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa68133ad0 0x7faa6812cb30 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7faa58001eb0 tx=0x7faa5800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa64ff9700 1 -- 172.21.15.154:0/1822446104 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58005d70 con 0x7faa68133ad0 2023-09-30T22:28:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa64ff9700 1 -- 172.21.15.154:0/1822446104 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580070d0 con 0x7faa68133ad0 2023-09-30T22:28:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa6e7ae700 1 -- 172.21.15.154:0/1822446104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa68072300 con 0x7faa68133ad0 2023-09-30T22:28:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa64ff9700 1 -- 172.21.15.154:0/1822446104 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58007460 con 0x7faa68133ad0 2023-09-30T22:28:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.691+0000 7faa6e7ae700 1 -- 172.21.15.154:0/1822446104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa68130a20 con 0x7faa68133ad0 2023-09-30T22:28:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.692+0000 7faa64ff9700 1 -- 172.21.15.154:0/1822446104 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa580075c0 con 0x7faa68133ad0 2023-09-30T22:28:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.692+0000 7faa64ff9700 1 -- 172.21.15.154:0/1822446104 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa5803eab0 con 0x7faa68133ad0 2023-09-30T22:28:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.693+0000 7faa6e7ae700 1 -- 172.21.15.154:0/1822446104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6804f2a0 con 0x7faa68133ad0 2023-09-30T22:28:15.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.697+0000 7faa64ff9700 1 -- 172.21.15.154:0/1822446104 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa5800f260 con 0x7faa68133ad0 2023-09-30T22:28:15.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.767+0000 7f7dd92af700 1 Processor -- start 2023-09-30T22:28:15.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.767+0000 7f7dd92af700 1 -- start start 2023-09-30T22:28:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.767+0000 7f7dd92af700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dd4133660 0x7f7dd4135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.767+0000 7f7dd92af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4135f80 0x7f7dd4138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.767+0000 7f7dd92af700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd4099a60 con 0x7f7dd4099e20 2023-09-30T22:28:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd92af700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd409bf50 con 0x7f7dd4133660 2023-09-30T22:28:15.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd92af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd409b230 con 0x7f7dd4135f80 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4135f80 0x7f7dd4138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd37fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4135f80 0x7f7dd4138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51658/0 (socket says 172.21.15.154:51658) 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd37fe700 1 -- 172.21.15.154:0/3989957406 learned_addr learned my addr 172.21.15.154:0/3989957406 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd27fc700 1 --2- 172.21.15.154:0/3989957406 >> v2:172.21.15.154:3300/0 conn(0x7f7dd4133660 0x7f7dd4135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd27fc700 1 -- 172.21.15.154:0/3989957406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4135f80 msgr2=0x7f7dd4138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd27fc700 1 --2- 172.21.15.154:0/3989957406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4135f80 0x7f7dd4138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd27fc700 1 -- 172.21.15.154:0/3989957406 >> v1:172.21.15.154:6789/0 conn(0x7f7dd4099e20 legacy=0x7f7dd409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd27fc700 1 -- 172.21.15.154:0/3989957406 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd409bb90 con 0x7f7dd4133660 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd27fc700 1 --2- 172.21.15.154:0/3989957406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd4133660 0x7f7dd4135a40 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009840 tx=0x7f7dc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd35c41434e5014b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd1ffb700 1 -- 172.21.15.154:0/3989957406 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011830 con 0x7f7dd4133660 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd1ffb700 1 -- 172.21.15.154:0/3989957406 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8011990 con 0x7f7dd4133660 2023-09-30T22:28:15.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.768+0000 7f7dd1ffb700 1 -- 172.21.15.154:0/3989957406 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011d20 con 0x7f7dd4133660 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.769+0000 7f7dd92af700 1 -- 172.21.15.154:0/3989957406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd4133660 msgr2=0x7f7dd4135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.769+0000 7f7dd92af700 1 --2- 172.21.15.154:0/3989957406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd4133660 0x7f7dd4135a40 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009840 tx=0x7f7dc8009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.769+0000 7f7dd92af700 1 -- 172.21.15.154:0/3989957406 shutdown_connections 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.769+0000 7f7dd92af700 1 --2- 172.21.15.154:0/3989957406 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4135f80 0x7f7dd4138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.769+0000 7f7dd92af700 1 --2- 172.21.15.154:0/3989957406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd4133660 0x7f7dd4135a40 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.769+0000 7f7dd92af700 1 -- 172.21.15.154:0/3989957406 >> 172.21.15.154:0/3989957406 conn(0x7f7dd40a2980 msgr2=0x7f7dd40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.769+0000 7f7dd92af700 1 -- 172.21.15.154:0/3989957406 shutdown_connections 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.769+0000 7f7dd92af700 1 -- 172.21.15.154:0/3989957406 wait complete. 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.771+0000 7f7dd92af700 1 Processor -- start 2023-09-30T22:28:15.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.771+0000 7f7dd92af700 1 -- start start 2023-09-30T22:28:15.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd92af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4099e20 0x7f7dd412d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd92af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4133660 0x7f7dd412d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd92af700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd4135f80 0x7f7dd40a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd92af700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd411a870 con 0x7f7dd4135f80 2023-09-30T22:28:15.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd92af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd411a590 con 0x7f7dd4133660 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd92af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd411ad70 con 0x7f7dd4099e20 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4099e20 0x7f7dd412d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4099e20 0x7f7dd412d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51672/0 (socket says 172.21.15.154:51672) 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd2ffd700 1 -- 172.21.15.154:0/2281849685 learned_addr learned my addr 172.21.15.154:0/2281849685 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd27fc700 1 --2- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4133660 0x7f7dd412d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd37fe700 1 --2- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd4135f80 0x7f7dd40a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd2ffd700 1 -- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4133660 msgr2=0x7f7dd412d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd2ffd700 1 --2- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4133660 0x7f7dd412d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd2ffd700 1 -- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd4135f80 msgr2=0x7f7dd40a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd2ffd700 1 --2- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd4135f80 0x7f7dd40a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd2ffd700 1 -- 172.21.15.154:0/2281849685 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80094a0 con 0x7f7dd4099e20 2023-09-30T22:28:15.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.772+0000 7f7dd2ffd700 1 --2- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4099e20 0x7f7dd412d040 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c4d0 tx=0x7f7dc400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.773+0000 7f7dbb7fe700 1 -- 172.21.15.154:0/2281849685 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40054e0 con 0x7f7dd4099e20 2023-09-30T22:28:15.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.773+0000 7f7dbb7fe700 1 -- 172.21.15.154:0/2281849685 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4003680 con 0x7f7dd4099e20 2023-09-30T22:28:15.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.773+0000 7f7dd92af700 1 -- 172.21.15.154:0/2281849685 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd40713d0 con 0x7f7dd4099e20 2023-09-30T22:28:15.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.773+0000 7f7dbb7fe700 1 -- 172.21.15.154:0/2281849685 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4003a30 con 0x7f7dd4099e20 2023-09-30T22:28:15.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.773+0000 7f7dd92af700 1 -- 172.21.15.154:0/2281849685 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd4071c60 con 0x7f7dd4099e20 2023-09-30T22:28:15.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.773+0000 7f7dbb7fe700 1 -- 172.21.15.154:0/2281849685 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dc4003b90 con 0x7f7dd4099e20 2023-09-30T22:28:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.774+0000 7f7dbb7fe700 1 -- 172.21.15.154:0/2281849685 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7dc403eb70 con 0x7f7dd4099e20 2023-09-30T22:28:15.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.774+0000 7f7dd92af700 1 -- 172.21.15.154:0/2281849685 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd4071e50 con 0x7f7dd4099e20 2023-09-30T22:28:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.776+0000 7fea15e3b700 1 Processor -- start 2023-09-30T22:28:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.776+0000 7fea15e3b700 1 -- start start 2023-09-30T22:28:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.776+0000 7fea15e3b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea100a0a30 0x7fea100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.776+0000 7fea15e3b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a1340 0x7fea1012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.776+0000 7fea15e3b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea101304a0 0x7fea101308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.776+0000 7fea15e3b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea10130e30 con 0x7fea101304a0 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.776+0000 7fea15e3b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea100a1e70 con 0x7fea100a0a30 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.776+0000 7fea15e3b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea1009a720 con 0x7fea100a1340 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.777+0000 7fea0effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a1340 0x7fea1012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.777+0000 7fea0effd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a1340 0x7fea1012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51678/0 (socket says 172.21.15.154:51678) 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.777+0000 7fea0effd700 1 -- 172.21.15.154:0/278249528 learned_addr learned my addr 172.21.15.154:0/278249528 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.777+0000 7fea0effd700 1 -- 172.21.15.154:0/278249528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea100a0a30 msgr2=0x7fea100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.777+0000 7fea0effd700 1 --2- 172.21.15.154:0/278249528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea100a0a30 0x7fea100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.777+0000 7fea0effd700 1 -- 172.21.15.154:0/278249528 >> v2:172.21.15.154:3300/0 conn(0x7fea101304a0 msgr2=0x7fea101308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.777+0000 7fea0effd700 1 --2- 172.21.15.154:0/278249528 >> v2:172.21.15.154:3300/0 conn(0x7fea101304a0 0x7fea101308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.777+0000 7fea0effd700 1 -- 172.21.15.154:0/278249528 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1009b300 con 0x7fea100a1340 2023-09-30T22:28:15.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.777+0000 7fea0effd700 1 --2- 172.21.15.154:0/278249528 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a1340 0x7fea1012ff60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fea0400bb90 tx=0x7fea0400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c705504a3fa27006 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.779+0000 7fea0e7fc700 1 -- 172.21.15.154:0/278249528 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0400dc40 con 0x7fea100a1340 2023-09-30T22:28:15.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.779+0000 7fea0e7fc700 1 -- 172.21.15.154:0/278249528 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0400dda0 con 0x7fea100a1340 2023-09-30T22:28:15.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.779+0000 7fea0e7fc700 1 -- 172.21.15.154:0/278249528 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04017630 con 0x7fea100a1340 2023-09-30T22:28:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.779+0000 7f7dbb7fe700 1 -- 172.21.15.154:0/2281849685 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dc4017020 con 0x7f7dd4099e20 2023-09-30T22:28:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.780+0000 7fea15e3b700 1 -- 172.21.15.154:0/278249528 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a1340 msgr2=0x7fea1012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.780+0000 7fea15e3b700 1 --2- 172.21.15.154:0/278249528 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a1340 0x7fea1012ff60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fea0400bb90 tx=0x7fea0400bea0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.780+0000 7fea15e3b700 1 -- 172.21.15.154:0/278249528 shutdown_connections 2023-09-30T22:28:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.780+0000 7fea15e3b700 1 --2- 172.21.15.154:0/278249528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea100a0a30 0x7fea100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.780+0000 7fea15e3b700 1 --2- 172.21.15.154:0/278249528 >> v2:172.21.15.154:3300/0 conn(0x7fea101304a0 0x7fea101308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.780+0000 7fea15e3b700 1 --2- 172.21.15.154:0/278249528 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a1340 0x7fea1012ff60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.780+0000 7fea15e3b700 1 -- 172.21.15.154:0/278249528 >> 172.21.15.154:0/278249528 conn(0x7fea100a2980 msgr2=0x7fea100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.780+0000 7fea15e3b700 1 -- 172.21.15.154:0/278249528 shutdown_connections 2023-09-30T22:28:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.780+0000 7fea15e3b700 1 -- 172.21.15.154:0/278249528 wait complete. 2023-09-30T22:28:15.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.781+0000 7fea15e3b700 1 Processor -- start 2023-09-30T22:28:15.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.782+0000 7fea15e3b700 1 -- start start 2023-09-30T22:28:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.782+0000 7fea15e3b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a0a30 0x7fea1011aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.782+0000 7fea15e3b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea100a1340 0x7fea1011b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.782+0000 7fea15e3b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea101304a0 0x7fea1011b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:15.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.782+0000 7fea15e3b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1011d2b0 con 0x7fea100a1340 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.782+0000 7fea15e3b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1009f140 con 0x7fea101304a0 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.782+0000 7fea15e3b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea1011cb60 con 0x7fea100a0a30 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.782+0000 7fea0f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a0a30 0x7fea1011aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.782+0000 7fea0f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a0a30 0x7fea1011aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51682/0 (socket says 172.21.15.154:51682) 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0f7fe700 1 -- 172.21.15.154:0/3466960667 learned_addr learned my addr 172.21.15.154:0/3466960667 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0effd700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea100a1340 0x7fea1011b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0ffff700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea101304a0 0x7fea1011b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0f7fe700 1 -- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea101304a0 msgr2=0x7fea1011b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0f7fe700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea101304a0 0x7fea1011b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0f7fe700 1 -- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea100a1340 msgr2=0x7fea1011b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0f7fe700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea100a1340 0x7fea1011b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0f7fe700 1 -- 172.21.15.154:0/3466960667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0400b7f0 con 0x7fea100a0a30 2023-09-30T22:28:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0ffff700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea101304a0 0x7fea1011b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0effd700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea100a1340 0x7fea1011b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea0f7fe700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a0a30 0x7fea1011aec0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fea0000b520 tx=0x7fea0000b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fe9f7fff700 1 -- 172.21.15.154:0/3466960667 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00005aa0 con 0x7fea100a0a30 2023-09-30T22:28:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fe9f7fff700 1 -- 172.21.15.154:0/3466960667 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea00005c20 con 0x7fea100a0a30 2023-09-30T22:28:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea15e3b700 1 -- 172.21.15.154:0/3466960667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1011e680 con 0x7fea100a0a30 2023-09-30T22:28:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fe9f7fff700 1 -- 172.21.15.154:0/3466960667 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00011630 con 0x7fea100a0a30 2023-09-30T22:28:15.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.783+0000 7fea15e3b700 1 -- 172.21.15.154:0/3466960667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1011e960 con 0x7fea100a0a30 2023-09-30T22:28:15.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.784+0000 7fe9f7fff700 1 -- 172.21.15.154:0/3466960667 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea00011790 con 0x7fea100a0a30 2023-09-30T22:28:15.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.785+0000 7fe9f7fff700 1 -- 172.21.15.154:0/3466960667 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea0003f250 con 0x7fea100a0a30 2023-09-30T22:28:15.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.785+0000 7fea15e3b700 1 -- 172.21.15.154:0/3466960667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1011e320 con 0x7fea100a0a30 2023-09-30T22:28:15.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.789+0000 7fe9f7fff700 1 -- 172.21.15.154:0/3466960667 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea00005fd0 con 0x7fea100a0a30 2023-09-30T22:28:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.882+0000 7f7216f4f700 1 -- 172.21.15.154:0/2866291332 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f721009d3a0 con 0x7f72101309f0 2023-09-30T22:28:15.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.882+0000 7f720d7fa700 1 -- 172.21.15.154:0/2866291332 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71fc02b090 con 0x7f72101309f0 2023-09-30T22:28:15.882 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.885+0000 7f7216f4f700 1 -- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72101309f0 msgr2=0x7f721011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.885+0000 7f7216f4f700 1 --2- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72101309f0 0x7f721011df80 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00e840 tx=0x7f71fc00eb50 comp rx=0 tx=0).stop 2023-09-30T22:28:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.885+0000 7f7216f4f700 1 -- 172.21.15.154:0/2866291332 shutdown_connections 2023-09-30T22:28:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.885+0000 7f7216f4f700 1 --2- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7210133ad0 0x7f721011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.885+0000 7f7216f4f700 1 --2- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72101300a0 0x7f721011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.885+0000 7f7216f4f700 1 --2- 172.21.15.154:0/2866291332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72101309f0 0x7f721011df80 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.885+0000 7f7216f4f700 1 -- 172.21.15.154:0/2866291332 >> 172.21.15.154:0/2866291332 conn(0x7f7210099c40 msgr2=0x7f72100a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.885+0000 7f7216f4f700 1 -- 172.21.15.154:0/2866291332 shutdown_connections 2023-09-30T22:28:15.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.885+0000 7f7216f4f700 1 -- 172.21.15.154:0/2866291332 wait complete. 2023-09-30T22:28:15.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:15.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.933+0000 7faa6e7ae700 1 -- 172.21.15.154:0/1822446104 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa6809f0f0 con 0x7faa68133ad0 2023-09-30T22:28:15.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.933+0000 7faa64ff9700 1 -- 172.21.15.154:0/1822446104 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa58017020 con 0x7faa68133ad0 2023-09-30T22:28:15.933 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:15.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.935+0000 7faa6e7ae700 1 -- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa68133ad0 msgr2=0x7faa6812cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.935+0000 7faa6e7ae700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa68133ad0 0x7faa6812cb30 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7faa58001eb0 tx=0x7faa5800c7b0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.935+0000 7faa6e7ae700 1 -- 172.21.15.154:0/1822446104 shutdown_connections 2023-09-30T22:28:15.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.935+0000 7faa6e7ae700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa68139280 0x7faa6812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.935+0000 7faa6e7ae700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa68133ad0 0x7faa6812cb30 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.935+0000 7faa6e7ae700 1 --2- 172.21.15.154:0/1822446104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa68136960 0x7faa6812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.935+0000 7faa6e7ae700 1 -- 172.21.15.154:0/1822446104 >> 172.21.15.154:0/1822446104 conn(0x7faa68099c40 msgr2=0x7faa681385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:15.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.936+0000 7faa6e7ae700 1 -- 172.21.15.154:0/1822446104 shutdown_connections 2023-09-30T22:28:15.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.936+0000 7faa6e7ae700 1 -- 172.21.15.154:0/1822446104 wait complete. 2023-09-30T22:28:15.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.975+0000 7f7dd92af700 1 -- 172.21.15.154:0/2281849685 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7dd4072480 con 0x7f7dd4099e20 2023-09-30T22:28:15.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.975+0000 7f7dbb7fe700 1 -- 172.21.15.154:0/2281849685 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7dd4072480 con 0x7f7dd4099e20 2023-09-30T22:28:15.975 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.977+0000 7f7dd92af700 1 -- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4099e20 msgr2=0x7f7dd412d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.977+0000 7f7dd92af700 1 --2- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4099e20 0x7f7dd412d040 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c4d0 tx=0x7f7dc400c7e0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.977+0000 7f7dd92af700 1 -- 172.21.15.154:0/2281849685 shutdown_connections 2023-09-30T22:28:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.977+0000 7f7dd92af700 1 --2- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd4135f80 0x7f7dd40a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.977+0000 7f7dd92af700 1 --2- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7dd4099e20 0x7f7dd412d040 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.977+0000 7f7dd92af700 1 --2- 172.21.15.154:0/2281849685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4133660 0x7f7dd412d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.977+0000 7f7dd92af700 1 -- 172.21.15.154:0/2281849685 >> 172.21.15.154:0/2281849685 conn(0x7f7dd40a2980 msgr2=0x7f7dd4133a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.977+0000 7f7dd92af700 1 -- 172.21.15.154:0/2281849685 shutdown_connections 2023-09-30T22:28:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:15.977+0000 7f7dd92af700 1 -- 172.21.15.154:0/2281849685 wait complete. 2023-09-30T22:28:15.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:16.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.021+0000 7fea15e3b700 1 -- 172.21.15.154:0/3466960667 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea1004f2a0 con 0x7fea100a0a30 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.021+0000 7fe9f7fff700 1 -- 172.21.15.154:0/3466960667 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea00029090 con 0x7fea100a0a30 2023-09-30T22:28:16.023 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:16.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.023+0000 7fea15e3b700 1 -- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a0a30 msgr2=0x7fea1011aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:16.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.023+0000 7fea15e3b700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a0a30 0x7fea1011aec0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fea0000b520 tx=0x7fea0000b830 comp rx=0 tx=0).stop 2023-09-30T22:28:16.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.023+0000 7fea15e3b700 1 -- 172.21.15.154:0/3466960667 shutdown_connections 2023-09-30T22:28:16.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.023+0000 7fea15e3b700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea101304a0 0x7fea1011b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.023+0000 7fea15e3b700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea100a0a30 0x7fea1011aec0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.023+0000 7fea15e3b700 1 --2- 172.21.15.154:0/3466960667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea100a1340 0x7fea1011b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:16.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.023+0000 7fea15e3b700 1 -- 172.21.15.154:0/3466960667 >> 172.21.15.154:0/3466960667 conn(0x7fea100a2980 msgr2=0x7fea1009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:16.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.023+0000 7fea15e3b700 1 -- 172.21.15.154:0/3466960667 shutdown_connections 2023-09-30T22:28:16.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:16.023+0000 7fea15e3b700 1 -- 172.21.15.154:0/3466960667 wait complete. 2023-09-30T22:28:16.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:16.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:16.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:16.990 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:17.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:17.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.044+0000 7efe2313d700 1 Processor -- start 2023-09-30T22:28:17.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.044+0000 7efe2313d700 1 -- start start 2023-09-30T22:28:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.045+0000 7efe2313d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe1c09e870 0x7efe1c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.045+0000 7efe2313d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.045+0000 7efe2313d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1c09c970 con 0x7efe1c09f180 2023-09-30T22:28:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.045+0000 7efe2313d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c0a0920 con 0x7efe1c09e870 2023-09-30T22:28:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.045+0000 7efe2313d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c09f9c0 con 0x7efe1c131f40 2023-09-30T22:28:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.045+0000 7efe20ed9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe1c09e870 0x7efe1c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.045+0000 7efe20ed9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe1c09e870 0x7efe1c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44154/0 (socket says 172.21.15.154:44154) 2023-09-30T22:28:17.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.045+0000 7efe20ed9700 1 -- 172.21.15.154:0/3965744772 learned_addr learned my addr 172.21.15.154:0/3965744772 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:17.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.045+0000 7efe216da700 1 --2- 172.21.15.154:0/3965744772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.046+0000 7efe216da700 1 -- 172.21.15.154:0/3965744772 >> v2:172.21.15.154:3300/0 conn(0x7efe1c09e870 msgr2=0x7efe1c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.046+0000 7efe216da700 1 --2- 172.21.15.154:0/3965744772 >> v2:172.21.15.154:3300/0 conn(0x7efe1c09e870 0x7efe1c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.046+0000 7efe216da700 1 -- 172.21.15.154:0/3965744772 >> v1:172.21.15.154:6789/0 conn(0x7efe1c09f180 legacy=0x7efe1c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.046+0000 7efe216da700 1 -- 172.21.15.154:0/3965744772 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c09bab0 con 0x7efe1c131f40 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.046+0000 7efe216da700 1 --2- 172.21.15.154:0/3965744772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c139ca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7efe14009d90 tx=0x7efe1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7276b8f5d6f916c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.046+0000 7efe1b7fe700 1 -- 172.21.15.154:0/3965744772 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1400e070 con 0x7efe1c131f40 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.046+0000 7efe1b7fe700 1 -- 172.21.15.154:0/3965744772 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1400bb20 con 0x7efe1c131f40 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.046+0000 7efe1b7fe700 1 -- 172.21.15.154:0/3965744772 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14012430 con 0x7efe1c131f40 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.047+0000 7efe2313d700 1 -- 172.21.15.154:0/3965744772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 msgr2=0x7efe1c139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.047+0000 7efe2313d700 1 --2- 172.21.15.154:0/3965744772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c139ca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7efe14009d90 tx=0x7efe1400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:17.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.047+0000 7efe2313d700 1 -- 172.21.15.154:0/3965744772 shutdown_connections 2023-09-30T22:28:17.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.047+0000 7efe2313d700 1 --2- 172.21.15.154:0/3965744772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c139ca0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.047+0000 7efe2313d700 1 --2- 172.21.15.154:0/3965744772 >> v2:172.21.15.154:3300/0 conn(0x7efe1c09e870 0x7efe1c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.047+0000 7efe2313d700 1 -- 172.21.15.154:0/3965744772 >> 172.21.15.154:0/3965744772 conn(0x7efe1c0a4430 msgr2=0x7efe1c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.047+0000 7efe2313d700 1 -- 172.21.15.154:0/3965744772 shutdown_connections 2023-09-30T22:28:17.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.048+0000 7efe2313d700 1 -- 172.21.15.154:0/3965744772 wait complete. 2023-09-30T22:28:17.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.049+0000 7efe2313d700 1 Processor -- start 2023-09-30T22:28:17.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.049+0000 7efe2313d700 1 -- start start 2023-09-30T22:28:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe2313d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe1c09e870 0x7efe1c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe2313d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe1c09f180 0x7efe1c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe2313d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe2313d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c130fa0 con 0x7efe1c09f180 2023-09-30T22:28:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe2313d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c125f10 con 0x7efe1c131f40 2023-09-30T22:28:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe2313d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c0a2e60 con 0x7efe1c09e870 2023-09-30T22:28:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe1bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe1c09f180 0x7efe1c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe1bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe1c09f180 0x7efe1c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44164/0 (socket says 172.21.15.154:44164) 2023-09-30T22:28:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe1bfff700 1 -- 172.21.15.154:0/1886929558 learned_addr learned my addr 172.21.15.154:0/1886929558 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:17.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe216da700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe20ed9700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe1c09e870 0x7efe1c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe1bfff700 1 -- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe1c09e870 msgr2=0x7efe1c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe1bfff700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe1c09e870 0x7efe1c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe1bfff700 1 -- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 msgr2=0x7efe1c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe1bfff700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.050+0000 7efe1bfff700 1 -- 172.21.15.154:0/1886929558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14009a70 con 0x7efe1c09f180 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.051+0000 7efe216da700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.051+0000 7efe1bfff700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe1c09f180 0x7efe1c06bdf0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7efe0800c4e0 tx=0x7efe0800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.051+0000 7efe197fa700 1 -- 172.21.15.154:0/1886929558 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080052d0 con 0x7efe1c09f180 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.051+0000 7efe197fa700 1 -- 172.21.15.154:0/1886929558 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe08005430 con 0x7efe1c09f180 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.051+0000 7efe2313d700 1 -- 172.21.15.154:0/1886929558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c09dba0 con 0x7efe1c09f180 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.051+0000 7efe2313d700 1 -- 172.21.15.154:0/1886929558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c1247f0 con 0x7efe1c09f180 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.051+0000 7efe197fa700 1 -- 172.21.15.154:0/1886929558 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080038c0 con 0x7efe1c09f180 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.052+0000 7efe197fa700 1 -- 172.21.15.154:0/1886929558 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe08003a20 con 0x7efe1c09f180 2023-09-30T22:28:17.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.052+0000 7efe197fa700 1 -- 172.21.15.154:0/1886929558 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efe0803eb80 con 0x7efe1c09f180 2023-09-30T22:28:17.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.052+0000 7efe2313d700 1 -- 172.21.15.154:0/1886929558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc0052e0 con 0x7efe1c09f180 2023-09-30T22:28:17.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.058+0000 7efe197fa700 1 -- 172.21.15.154:0/1886929558 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe08017080 con 0x7efe1c09f180 2023-09-30T22:28:17.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.092+0000 7fb0348de700 1 Processor -- start 2023-09-30T22:28:17.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.092+0000 7fb0348de700 1 -- start start 2023-09-30T22:28:17.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.093+0000 7fb0348de700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb03006a770 0x7fb03006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.093+0000 7fb0348de700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03009dec0 0x7fb03006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.093+0000 7fb0348de700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03006b5c0 con 0x7fb030131a00 2023-09-30T22:28:17.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.093+0000 7fb0348de700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03006e900 con 0x7fb03006a770 2023-09-30T22:28:17.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.093+0000 7fb0348de700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb03009d180 con 0x7fb03009dec0 2023-09-30T22:28:17.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.093+0000 7fb02e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb03006a770 0x7fb03006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.093+0000 7fb02e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb03006a770 0x7fb03006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34700/0 (socket says 172.21.15.154:34700) 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.093+0000 7fb02e59c700 1 -- 172.21.15.154:0/1361848445 learned_addr learned my addr 172.21.15.154:0/1361848445 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.093+0000 7fb02dd9b700 1 --2- 172.21.15.154:0/1361848445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03009dec0 0x7fb03006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.094+0000 7fb02dd9b700 1 -- 172.21.15.154:0/1361848445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb03006a770 msgr2=0x7fb03006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.094+0000 7fb02dd9b700 1 --2- 172.21.15.154:0/1361848445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb03006a770 0x7fb03006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.094+0000 7fb02dd9b700 1 -- 172.21.15.154:0/1361848445 >> v1:172.21.15.154:6789/0 conn(0x7fb030131a00 legacy=0x7fb030131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.094+0000 7fb02dd9b700 1 -- 172.21.15.154:0/1361848445 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03009e780 con 0x7fb03009dec0 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.094+0000 7fb02dd9b700 1 --2- 172.21.15.154:0/1361848445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03009dec0 0x7fb03006b080 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb024009870 tx=0x7fb024009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e4e0a07b1b265a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.094+0000 7fb02d59a700 1 -- 172.21.15.154:0/1361848445 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024011830 con 0x7fb03009dec0 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.094+0000 7fb02d59a700 1 -- 172.21.15.154:0/1361848445 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb024011990 con 0x7fb03009dec0 2023-09-30T22:28:17.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.094+0000 7fb02d59a700 1 -- 172.21.15.154:0/1361848445 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024011d20 con 0x7fb03009dec0 2023-09-30T22:28:17.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.095+0000 7fb0348de700 1 -- 172.21.15.154:0/1361848445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03009dec0 msgr2=0x7fb03006b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.095+0000 7fb0348de700 1 --2- 172.21.15.154:0/1361848445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03009dec0 0x7fb03006b080 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb024009870 tx=0x7fb024009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:17.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.095+0000 7fb0348de700 1 -- 172.21.15.154:0/1361848445 shutdown_connections 2023-09-30T22:28:17.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.095+0000 7fb0348de700 1 --2- 172.21.15.154:0/1361848445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb03006a770 0x7fb03006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.095+0000 7fb0348de700 1 --2- 172.21.15.154:0/1361848445 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03009dec0 0x7fb03006b080 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.095+0000 7fb0348de700 1 -- 172.21.15.154:0/1361848445 >> 172.21.15.154:0/1361848445 conn(0x7fb030099c40 msgr2=0x7fb0300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.095+0000 7fb0348de700 1 -- 172.21.15.154:0/1361848445 shutdown_connections 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.095+0000 7fb0348de700 1 -- 172.21.15.154:0/1361848445 wait complete. 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.096+0000 7fb0348de700 1 Processor -- start 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb0348de700 1 -- start start 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb0348de700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03006a770 0x7fb03009a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb0348de700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb03009dec0 0x7fb03009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb0348de700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb030131a00 0x7fb03009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb0348de700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03011eb80 con 0x7fb03009dec0 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb0348de700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0301310b0 con 0x7fb030131a00 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb0348de700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb03009b880 con 0x7fb03006a770 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb02dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb03009dec0 0x7fb03009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb02e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03006a770 0x7fb03009a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb02dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb03009dec0 0x7fb03009a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44180/0 (socket says 172.21.15.154:44180) 2023-09-30T22:28:17.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb02e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03006a770 0x7fb03009a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51708/0 (socket says 172.21.15.154:51708) 2023-09-30T22:28:17.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb02dd9b700 1 -- 172.21.15.154:0/3861635218 learned_addr learned my addr 172.21.15.154:0/3861635218 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:17.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.097+0000 7fb02ed9d700 1 --2- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb030131a00 0x7fb03009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb02e59c700 1 -- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb030131a00 msgr2=0x7fb03009af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb02e59c700 1 --2- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb030131a00 0x7fb03009af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb02e59c700 1 -- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb03009dec0 msgr2=0x7fb03009a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb02e59c700 1 --2- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb03009dec0 0x7fb03009a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb02e59c700 1 -- 172.21.15.154:0/3861635218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240094a0 con 0x7fb03006a770 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb02ed9d700 1 --2- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb030131a00 0x7fb03009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb02e59c700 1 --2- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03006a770 0x7fb03009a490 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb02000e8e0 tx=0x7fb02000ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb01effd700 1 -- 172.21.15.154:0/3861635218 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020013680 con 0x7fb03006a770 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb01effd700 1 -- 172.21.15.154:0/3861635218 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0200137e0 con 0x7fb03006a770 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb0348de700 1 -- 172.21.15.154:0/3861635218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03011f370 con 0x7fb03006a770 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb01effd700 1 -- 172.21.15.154:0/3861635218 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020013b70 con 0x7fb03006a770 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.098+0000 7fb0348de700 1 -- 172.21.15.154:0/3861635218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03012d490 con 0x7fb03006a770 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.099+0000 7fb0348de700 1 -- 172.21.15.154:0/3861635218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03011f700 con 0x7fb03006a770 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.100+0000 7fb01effd700 1 -- 172.21.15.154:0/3861635218 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb020013cd0 con 0x7fb03006a770 2023-09-30T22:28:17.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.100+0000 7fb01effd700 1 -- 172.21.15.154:0/3861635218 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb02003fdd0 con 0x7fb03006a770 2023-09-30T22:28:17.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.104+0000 7fb01effd700 1 -- 172.21.15.154:0/3861635218 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb020024350 con 0x7fb03006a770 2023-09-30T22:28:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.134+0000 7f1e22693700 1 Processor -- start 2023-09-30T22:28:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.134+0000 7f1e22693700 1 -- start start 2023-09-30T22:28:17.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.134+0000 7f1e22693700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.134+0000 7f1e22693700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e1c134330 0x7f1e1c13be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.134+0000 7f1e22693700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c09fa00 con 0x7f1e1c09f180 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.134+0000 7f1e22693700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0a0370 con 0x7f1e1c134330 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.134+0000 7f1e22693700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c06bec0 con 0x7f1e1c09e870 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.134+0000 7f1e1bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34716/0 (socket says 172.21.15.154:34716) 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1bfff700 1 -- 172.21.15.154:0/2351896083 learned_addr learned my addr 172.21.15.154:0/2351896083 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e20c30700 1 --2- 172.21.15.154:0/2351896083 >> v2:172.21.15.154:3300/0 conn(0x7f1e1c134330 0x7f1e1c13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1bfff700 1 -- 172.21.15.154:0/2351896083 >> v2:172.21.15.154:3300/0 conn(0x7f1e1c134330 msgr2=0x7f1e1c13be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/2351896083 >> v2:172.21.15.154:3300/0 conn(0x7f1e1c134330 0x7f1e1c13be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1bfff700 1 -- 172.21.15.154:0/2351896083 >> v1:172.21.15.154:6789/0 conn(0x7f1e1c09f180 legacy=0x7f1e1c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1bfff700 1 -- 172.21.15.154:0/2351896083 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c09ada0 con 0x7f1e1c09e870 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/2351896083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c09ec40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0098f0 tx=0x7f1e0c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9d803d7a26c24cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1affd700 1 -- 172.21.15.154:0/2351896083 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c011830 con 0x7f1e1c09e870 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1affd700 1 -- 172.21.15.154:0/2351896083 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c011990 con 0x7f1e1c09e870 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.135+0000 7f1e1affd700 1 -- 172.21.15.154:0/2351896083 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c011d20 con 0x7f1e1c09e870 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.136+0000 7f1e22693700 1 -- 172.21.15.154:0/2351896083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 msgr2=0x7f1e1c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.136+0000 7f1e22693700 1 --2- 172.21.15.154:0/2351896083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c09ec40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0098f0 tx=0x7f1e0c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.136+0000 7f1e22693700 1 -- 172.21.15.154:0/2351896083 shutdown_connections 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.136+0000 7f1e22693700 1 --2- 172.21.15.154:0/2351896083 >> v2:172.21.15.154:3300/0 conn(0x7f1e1c134330 0x7f1e1c13be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.136+0000 7f1e22693700 1 --2- 172.21.15.154:0/2351896083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c09ec40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.136+0000 7f1e22693700 1 -- 172.21.15.154:0/2351896083 >> 172.21.15.154:0/2351896083 conn(0x7f1e1c0a4430 msgr2=0x7f1e1c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.136+0000 7f1e22693700 1 -- 172.21.15.154:0/2351896083 shutdown_connections 2023-09-30T22:28:17.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.136+0000 7f1e22693700 1 -- 172.21.15.154:0/2351896083 wait complete. 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.137+0000 7f1e22693700 1 Processor -- start 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.137+0000 7f1e22693700 1 -- start start 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e22693700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e22693700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c09f180 0x7f1e1c122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e22693700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e1c134330 0x7f1e1c1233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e22693700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c125be0 con 0x7f1e1c09f180 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e22693700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c133500 con 0x7f1e1c09e870 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e22693700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c072540 con 0x7f1e1c134330 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e1b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c09f180 0x7f1e1c122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e1b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c09f180 0x7f1e1c122e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44204/0 (socket says 172.21.15.154:44204) 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e1b7fe700 1 -- 172.21.15.154:0/114334111 learned_addr learned my addr 172.21.15.154:0/114334111 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.138+0000 7f1e20c30700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e1c134330 0x7f1e1c1233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e1bfff700 1 -- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e1c134330 msgr2=0x7f1e1c1233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e1c134330 0x7f1e1c1233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e1bfff700 1 -- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c09f180 msgr2=0x7f1e1c122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c09f180 0x7f1e1c122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e1bfff700 1 -- 172.21.15.154:0/114334111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c009550 con 0x7f1e1c09e870 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e1b7fe700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c09f180 0x7f1e1c122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e1bfff700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c122950 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c016000 tx=0x7f1e0c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e18ff9700 1 -- 172.21.15.154:0/114334111 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c0036a0 con 0x7f1e1c09e870 2023-09-30T22:28:17.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e18ff9700 1 -- 172.21.15.154:0/114334111 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c003800 con 0x7f1e1c09e870 2023-09-30T22:28:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e18ff9700 1 -- 172.21.15.154:0/114334111 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c003b70 con 0x7f1e1c09e870 2023-09-30T22:28:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e22693700 1 -- 172.21.15.154:0/114334111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c06cfa0 con 0x7f1e1c09e870 2023-09-30T22:28:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.139+0000 7f1e22693700 1 -- 172.21.15.154:0/114334111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c125ed0 con 0x7f1e1c09e870 2023-09-30T22:28:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.140+0000 7f1e18ff9700 1 -- 172.21.15.154:0/114334111 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e0c021070 con 0x7f1e1c09e870 2023-09-30T22:28:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.140+0000 7f1e18ff9700 1 -- 172.21.15.154:0/114334111 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e0c040790 con 0x7f1e1c09e870 2023-09-30T22:28:17.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.141+0000 7f1e22693700 1 -- 172.21.15.154:0/114334111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c04f2a0 con 0x7f1e1c09e870 2023-09-30T22:28:17.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.150+0000 7f1e18ff9700 1 -- 172.21.15.154:0/114334111 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e0c015080 con 0x7f1e1c09e870 2023-09-30T22:28:17.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.176+0000 7f5c099be700 1 Processor -- start 2023-09-30T22:28:17.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.176+0000 7f5c099be700 1 -- start start 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.176+0000 7f5c099be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 0x7f5c0406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.176+0000 7f5c099be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c04136cb0 0x7f5c04139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.176+0000 7f5c099be700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0406e900 con 0x7f5c0406a770 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.176+0000 7f5c099be700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0409d180 con 0x7f5c0409dec0 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.176+0000 7f5c099be700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0409e780 con 0x7f5c04136cb0 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c037fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c04136cb0 0x7f5c04139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c037fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c04136cb0 0x7f5c04139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51734/0 (socket says 172.21.15.154:51734) 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c037fe700 1 -- 172.21.15.154:0/3535473603 learned_addr learned my addr 172.21.15.154:0/3535473603 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c027fc700 1 --2- 172.21.15.154:0/3535473603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 0x7f5c0406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c037fe700 1 -- 172.21.15.154:0/3535473603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 msgr2=0x7f5c0406b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:17.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c037fe700 1 --2- 172.21.15.154:0/3535473603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 0x7f5c0406b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c037fe700 1 -- 172.21.15.154:0/3535473603 >> v1:172.21.15.154:6789/0 conn(0x7f5c0406a770 legacy=0x7f5c0406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c037fe700 1 -- 172.21.15.154:0/3535473603 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0409d3c0 con 0x7f5c04136cb0 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c037fe700 1 --2- 172.21.15.154:0/3535473603 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c04136cb0 0x7f5c04139090 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009e80 tx=0x7f5bfc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5952fda7c9cbacc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c01ffb700 1 -- 172.21.15.154:0/3535473603 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00e070 con 0x7f5c04136cb0 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c01ffb700 1 -- 172.21.15.154:0/3535473603 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc00b910 con 0x7f5c04136cb0 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.177+0000 7f5c01ffb700 1 -- 172.21.15.154:0/3535473603 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00bcc0 con 0x7f5c04136cb0 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.178+0000 7f5c099be700 1 -- 172.21.15.154:0/3535473603 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c04136cb0 msgr2=0x7f5c04139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.178+0000 7f5c099be700 1 --2- 172.21.15.154:0/3535473603 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c04136cb0 0x7f5c04139090 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009e80 tx=0x7f5bfc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.178+0000 7f5c099be700 1 -- 172.21.15.154:0/3535473603 shutdown_connections 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.178+0000 7f5c099be700 1 --2- 172.21.15.154:0/3535473603 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c04136cb0 0x7f5c04139090 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.178+0000 7f5c099be700 1 --2- 172.21.15.154:0/3535473603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 0x7f5c0406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.178+0000 7f5c099be700 1 -- 172.21.15.154:0/3535473603 >> 172.21.15.154:0/3535473603 conn(0x7f5c04099c40 msgr2=0x7f5c040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.178+0000 7f5c099be700 1 -- 172.21.15.154:0/3535473603 shutdown_connections 2023-09-30T22:28:17.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.178+0000 7f5c099be700 1 -- 172.21.15.154:0/3535473603 wait complete. 2023-09-30T22:28:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.180+0000 7f5c099be700 1 Processor -- start 2023-09-30T22:28:17.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.180+0000 7f5c099be700 1 -- start start 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.180+0000 7f5c099be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c0406a770 0x7f5c0412e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.180+0000 7f5c099be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 0x7f5c0412eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.180+0000 7f5c099be700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c04136cb0 0x7f5c0409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.180+0000 7f5c099be700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04135da0 con 0x7f5c04136cb0 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.180+0000 7f5c099be700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04135810 con 0x7f5c0409dec0 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.180+0000 7f5c099be700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04071ce0 con 0x7f5c0406a770 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c02ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c0406a770 0x7f5c0412e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c02ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c0406a770 0x7f5c0412e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51736/0 (socket says 172.21.15.154:51736) 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c02ffd700 1 -- 172.21.15.154:0/281227716 learned_addr learned my addr 172.21.15.154:0/281227716 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c037fe700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c04136cb0 0x7f5c0409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c027fc700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 0x7f5c0412eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c02ffd700 1 -- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 msgr2=0x7f5c0412eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c02ffd700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 0x7f5c0412eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c02ffd700 1 -- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c04136cb0 msgr2=0x7f5c0409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c02ffd700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c04136cb0 0x7f5c0409a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c02ffd700 1 -- 172.21.15.154:0/281227716 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc009b30 con 0x7f5c0406a770 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c027fc700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 0x7f5c0412eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c02ffd700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c0406a770 0x7f5c0412e5a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400c4e0 tx=0x7f5bf400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5bebfff700 1 -- 172.21.15.154:0/281227716 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40052d0 con 0x7f5c0406a770 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c099be700 1 -- 172.21.15.154:0/281227716 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c041311a0 con 0x7f5c0406a770 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5bebfff700 1 -- 172.21.15.154:0/281227716 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf4005430 con 0x7f5c0406a770 2023-09-30T22:28:17.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5bebfff700 1 -- 172.21.15.154:0/281227716 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40038c0 con 0x7f5c0406a770 2023-09-30T22:28:17.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.181+0000 7f5c099be700 1 -- 172.21.15.154:0/281227716 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c04134980 con 0x7f5c0406a770 2023-09-30T22:28:17.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.183+0000 7f5c099be700 1 -- 172.21.15.154:0/281227716 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c04135a40 con 0x7f5c0406a770 2023-09-30T22:28:17.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.183+0000 7f5bebfff700 1 -- 172.21.15.154:0/281227716 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bf4003a20 con 0x7f5c0406a770 2023-09-30T22:28:17.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.184+0000 7f5bebfff700 1 -- 172.21.15.154:0/281227716 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5bf403ec50 con 0x7f5c0406a770 2023-09-30T22:28:17.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.188+0000 7f5bebfff700 1 -- 172.21.15.154:0/281227716 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c04135a40 con 0x7f5c0406a770 2023-09-30T22:28:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.263+0000 7efe2313d700 1 -- 172.21.15.154:0/1886929558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efdfc005590 con 0x7efe1c09f180 2023-09-30T22:28:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.263+0000 7efe197fa700 1 -- 172.21.15.154:0/1886929558 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe08018260 con 0x7efe1c09f180 2023-09-30T22:28:17.263 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:17.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.266+0000 7efe2313d700 1 -- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe1c09f180 msgr2=0x7efe1c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.266+0000 7efe2313d700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe1c09f180 0x7efe1c06bdf0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7efe0800c4e0 tx=0x7efe0800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.266+0000 7efe2313d700 1 -- 172.21.15.154:0/1886929558 shutdown_connections 2023-09-30T22:28:17.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.266+0000 7efe2313d700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe1c131f40 0x7efe1c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.266+0000 7efe2313d700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efe1c09e870 0x7efe1c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.266+0000 7efe2313d700 1 --2- 172.21.15.154:0/1886929558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe1c09f180 0x7efe1c06bdf0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.266+0000 7efe2313d700 1 -- 172.21.15.154:0/1886929558 >> 172.21.15.154:0/1886929558 conn(0x7efe1c0a4430 msgr2=0x7efe1c11a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.266+0000 7efe2313d700 1 -- 172.21.15.154:0/1886929558 shutdown_connections 2023-09-30T22:28:17.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.266+0000 7efe2313d700 1 -- 172.21.15.154:0/1886929558 wait complete. 2023-09-30T22:28:17.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:17.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.305+0000 7fb0348de700 1 -- 172.21.15.154:0/3861635218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb03004f2a0 con 0x7fb03006a770 2023-09-30T22:28:17.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.305+0000 7fb01effd700 1 -- 172.21.15.154:0/3861635218 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb02001ab50 con 0x7fb03006a770 2023-09-30T22:28:17.305 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:17.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.307+0000 7fb0348de700 1 -- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03006a770 msgr2=0x7fb03009a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.307+0000 7fb0348de700 1 --2- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03006a770 0x7fb03009a490 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb02000e8e0 tx=0x7fb02000ebf0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.307+0000 7fb0348de700 1 -- 172.21.15.154:0/3861635218 shutdown_connections 2023-09-30T22:28:17.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.307+0000 7fb0348de700 1 --2- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb030131a00 0x7fb03009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.307+0000 7fb0348de700 1 --2- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb03006a770 0x7fb03009a490 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.307+0000 7fb0348de700 1 --2- 172.21.15.154:0/3861635218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb03009dec0 0x7fb03009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.307+0000 7fb0348de700 1 -- 172.21.15.154:0/3861635218 >> 172.21.15.154:0/3861635218 conn(0x7fb030099c40 msgr2=0x7fb03012ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.307+0000 7fb0348de700 1 -- 172.21.15.154:0/3861635218 shutdown_connections 2023-09-30T22:28:17.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.307+0000 7fb0348de700 1 -- 172.21.15.154:0/3861635218 wait complete. 2023-09-30T22:28:17.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.358+0000 7f1e22693700 1 -- 172.21.15.154:0/114334111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1e1c06c9d0 con 0x7f1e1c09e870 2023-09-30T22:28:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.358+0000 7f1e18ff9700 1 -- 172.21.15.154:0/114334111 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e0c01a410 con 0x7f1e1c09e870 2023-09-30T22:28:17.358 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:17.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.360+0000 7f1e22693700 1 -- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 msgr2=0x7f1e1c122950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.360+0000 7f1e22693700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c122950 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c016000 tx=0x7f1e0c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:17.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.360+0000 7f1e22693700 1 -- 172.21.15.154:0/114334111 shutdown_connections 2023-09-30T22:28:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.360+0000 7f1e22693700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1e1c134330 0x7f1e1c1233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.360+0000 7f1e22693700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e1c09e870 0x7f1e1c122950 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.360+0000 7f1e22693700 1 --2- 172.21.15.154:0/114334111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e1c09f180 0x7f1e1c122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.360+0000 7f1e22693700 1 -- 172.21.15.154:0/114334111 >> 172.21.15.154:0/114334111 conn(0x7f1e1c0a4430 msgr2=0x7f1e1c0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.360+0000 7f1e22693700 1 -- 172.21.15.154:0/114334111 shutdown_connections 2023-09-30T22:28:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.360+0000 7f1e22693700 1 -- 172.21.15.154:0/114334111 wait complete. 2023-09-30T22:28:17.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:17.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.382+0000 7f5c099be700 1 -- 172.21.15.154:0/281227716 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c04135a40 con 0x7f5c0406a770 2023-09-30T22:28:17.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.382+0000 7f5bebfff700 1 -- 172.21.15.154:0/281227716 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bf4017030 con 0x7f5c0406a770 2023-09-30T22:28:17.382 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:17.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.384+0000 7f5c099be700 1 -- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c0406a770 msgr2=0x7f5c0412e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:17.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.384+0000 7f5c099be700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c0406a770 0x7f5c0412e5a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400c4e0 tx=0x7f5bf400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.384+0000 7f5c099be700 1 -- 172.21.15.154:0/281227716 shutdown_connections 2023-09-30T22:28:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.384+0000 7f5c099be700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c04136cb0 0x7f5c0409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.384+0000 7f5c099be700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5c0406a770 0x7f5c0412e5a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.384+0000 7f5c099be700 1 --2- 172.21.15.154:0/281227716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c0409dec0 0x7f5c0412eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.384+0000 7f5c099be700 1 -- 172.21.15.154:0/281227716 >> 172.21.15.154:0/281227716 conn(0x7f5c04099c40 msgr2=0x7f5c0412f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.384+0000 7f5c099be700 1 -- 172.21.15.154:0/281227716 shutdown_connections 2023-09-30T22:28:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:17.384+0000 7f5c099be700 1 -- 172.21.15.154:0/281227716 wait complete. 2023-09-30T22:28:17.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:18.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:18.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:18.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:18.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:18.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.423+0000 7f4b5425e700 1 Processor -- start 2023-09-30T22:28:18.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.423+0000 7f4b5425e700 1 -- start start 2023-09-30T22:28:18.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.423+0000 7f4b5425e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c09ad40 0x7f4b4c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.423+0000 7f4b5425e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c133f70 0x7f4b4c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.423+0000 7f4b5425e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c09b110 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.423+0000 7f4b5425e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0a3b60 con 0x7f4b4c133f70 2023-09-30T22:28:18.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.423+0000 7f4b5425e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1348e0 con 0x7f4b4c09ad40 2023-09-30T22:28:18.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b51ffa700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c09ad40 0x7f4b4c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b527fb700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4b4c0a0a70 0x7f4b4c0a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36226/0 (socket says 172.21.15.154:36226) 2023-09-30T22:28:18.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b527fb700 1 -- 172.21.15.154:0/2977886444 learned_addr learned my addr 172.21.15.154:0/2977886444 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:18.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b517f9700 1 --2- 172.21.15.154:0/2977886444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c133f70 0x7f4b4c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b517f9700 1 -- 172.21.15.154:0/2977886444 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c09ad40 msgr2=0x7f4b4c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b517f9700 1 --2- 172.21.15.154:0/2977886444 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c09ad40 0x7f4b4c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b517f9700 1 -- 172.21.15.154:0/2977886444 >> v1:172.21.15.154:6789/0 conn(0x7f4b4c0a0a70 legacy=0x7f4b4c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b517f9700 1 -- 172.21.15.154:0/2977886444 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0a2fa0 con 0x7f4b4c133f70 2023-09-30T22:28:18.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b517f9700 1 --2- 172.21.15.154:0/2977886444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c133f70 0x7f4b4c1343a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009870 tx=0x7f4b3c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47404594fc30abc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b50ff8700 1 -- 172.21.15.154:0/2977886444 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c011830 con 0x7f4b4c133f70 2023-09-30T22:28:18.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b50ff8700 1 -- 172.21.15.154:0/2977886444 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c011990 con 0x7f4b4c133f70 2023-09-30T22:28:18.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.424+0000 7f4b50ff8700 1 -- 172.21.15.154:0/2977886444 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c011d20 con 0x7f4b4c133f70 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.425+0000 7f4b5425e700 1 -- 172.21.15.154:0/2977886444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c133f70 msgr2=0x7f4b4c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.425+0000 7f4b5425e700 1 --2- 172.21.15.154:0/2977886444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c133f70 0x7f4b4c1343a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009870 tx=0x7f4b3c009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.425+0000 7f4b5425e700 1 -- 172.21.15.154:0/2977886444 shutdown_connections 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.425+0000 7f4b5425e700 1 --2- 172.21.15.154:0/2977886444 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c09ad40 0x7f4b4c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.425+0000 7f4b5425e700 1 --2- 172.21.15.154:0/2977886444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c133f70 0x7f4b4c1343a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.425+0000 7f4b5425e700 1 -- 172.21.15.154:0/2977886444 >> 172.21.15.154:0/2977886444 conn(0x7f4b4c099c40 msgr2=0x7f4b4c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.425+0000 7f4b5425e700 1 -- 172.21.15.154:0/2977886444 shutdown_connections 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.425+0000 7f4b5425e700 1 -- 172.21.15.154:0/2977886444 wait complete. 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.426+0000 7f4b5425e700 1 Processor -- start 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.426+0000 7f4b5425e700 1 -- start start 2023-09-30T22:28:18.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b5425e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c09ad40 0x7f4b4c11e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b5425e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c0a0a70 0x7f4b4c11e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b5425e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b4c133f70 0x7f4b4c11ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b5425e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c121bb0 con 0x7f4b4c133f70 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b5425e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1316c0 con 0x7f4b4c09ad40 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b5425e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c121130 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b517f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c0a0a70 0x7f4b4c11e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b517f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c0a0a70 0x7f4b4c11e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51754/0 (socket says 172.21.15.154:51754) 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b517f9700 1 -- 172.21.15.154:0/1933647843 learned_addr learned my addr 172.21.15.154:0/1933647843 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b517f9700 1 -- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c09ad40 msgr2=0x7f4b4c11e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b517f9700 1 --2- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c09ad40 0x7f4b4c11e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b517f9700 1 -- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b4c133f70 msgr2=0x7f4b4c11ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b517f9700 1 --2- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b4c133f70 0x7f4b4c11ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.427+0000 7f4b517f9700 1 -- 172.21.15.154:0/1933647843 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c0094a0 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.428+0000 7f4b517f9700 1 --2- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c0a0a70 0x7f4b4c11e810 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0090b0 tx=0x7f4b3c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.428+0000 7f4b427fc700 1 -- 172.21.15.154:0/1933647843 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0036a0 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.428+0000 7f4b427fc700 1 -- 172.21.15.154:0/1933647843 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c003800 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.428+0000 7f4b5425e700 1 -- 172.21.15.154:0/1933647843 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c1204c0 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.428+0000 7f4b5425e700 1 -- 172.21.15.154:0/1933647843 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c09c7e0 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.428+0000 7f4b427fc700 1 -- 172.21.15.154:0/1933647843 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c003b90 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.429+0000 7f4b5425e700 1 -- 172.21.15.154:0/1933647843 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b340052e0 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.430+0000 7f4b427fc700 1 -- 172.21.15.154:0/1933647843 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b3c003cf0 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.430+0000 7f4b427fc700 1 -- 172.21.15.154:0/1933647843 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b3c040e10 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.434+0000 7f4b427fc700 1 -- 172.21.15.154:0/1933647843 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b3c006bd0 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.462+0000 7f5feaa48700 1 Processor -- start 2023-09-30T22:28:18.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.462+0000 7f5feaa48700 1 -- start start 2023-09-30T22:28:18.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5feaa48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4099e20 0x7f5fe409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5feaa48700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fe409a730 0x7f5fe4130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5feaa48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4130890 0x7f5fe4130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5feaa48700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe409bf50 con 0x7f5fe409a730 2023-09-30T22:28:18.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5feaa48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4099a60 con 0x7f5fe4130890 2023-09-30T22:28:18.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5feaa48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe409b230 con 0x7f5fe4099e20 2023-09-30T22:28:18.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4099e20 0x7f5fe409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4099e20 0x7f5fe409a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51764/0 (socket says 172.21.15.154:51764) 2023-09-30T22:28:18.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe3fff700 1 -- 172.21.15.154:0/409125196 learned_addr learned my addr 172.21.15.154:0/409125196 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe8fe5700 1 --2- 172.21.15.154:0/409125196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4130890 0x7f5fe4130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe3fff700 1 -- 172.21.15.154:0/409125196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4130890 msgr2=0x7f5fe4130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe3fff700 1 --2- 172.21.15.154:0/409125196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4130890 0x7f5fe4130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe3fff700 1 -- 172.21.15.154:0/409125196 >> v2:172.21.15.154:3300/0 conn(0x7f5fe409a730 msgr2=0x7f5fe4130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe3fff700 1 --2- 172.21.15.154:0/409125196 >> v2:172.21.15.154:3300/0 conn(0x7f5fe409a730 0x7f5fe4130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe3fff700 1 -- 172.21.15.154:0/409125196 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe409bb90 con 0x7f5fe4099e20 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.463+0000 7f5fe8fe5700 1 --2- 172.21.15.154:0/409125196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4130890 0x7f5fe4130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.464+0000 7f5fe3fff700 1 --2- 172.21.15.154:0/409125196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4099e20 0x7f5fe409a1f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40098f0 tx=0x7f5fd4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb7acffc0a0c926 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.464+0000 7f5fe2ffd700 1 -- 172.21.15.154:0/409125196 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4005e30 con 0x7f5fe4099e20 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.464+0000 7f5fe2ffd700 1 -- 172.21.15.154:0/409125196 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd4004030 con 0x7f5fe4099e20 2023-09-30T22:28:18.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.464+0000 7f5fe2ffd700 1 -- 172.21.15.154:0/409125196 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40043e0 con 0x7f5fe4099e20 2023-09-30T22:28:18.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.464+0000 7f5feaa48700 1 -- 172.21.15.154:0/409125196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4099e20 msgr2=0x7f5fe409a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.464+0000 7f5feaa48700 1 --2- 172.21.15.154:0/409125196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4099e20 0x7f5fe409a1f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40098f0 tx=0x7f5fd4009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:18.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.465+0000 7f5feaa48700 1 -- 172.21.15.154:0/409125196 shutdown_connections 2023-09-30T22:28:18.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.465+0000 7f5feaa48700 1 --2- 172.21.15.154:0/409125196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4130890 0x7f5fe4130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.465+0000 7f5feaa48700 1 --2- 172.21.15.154:0/409125196 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4099e20 0x7f5fe409a1f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.465+0000 7f5feaa48700 1 --2- 172.21.15.154:0/409125196 >> v2:172.21.15.154:3300/0 conn(0x7f5fe409a730 0x7f5fe4130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.465+0000 7f5feaa48700 1 -- 172.21.15.154:0/409125196 >> 172.21.15.154:0/409125196 conn(0x7f5fe40a2980 msgr2=0x7f5fe40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.465+0000 7f5feaa48700 1 -- 172.21.15.154:0/409125196 shutdown_connections 2023-09-30T22:28:18.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.465+0000 7f5feaa48700 1 -- 172.21.15.154:0/409125196 wait complete. 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.466+0000 7f5feaa48700 1 Processor -- start 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.466+0000 7f5feaa48700 1 -- start start 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5feaa48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4099e20 0x7f5fe41340a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5feaa48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe409a730 0x7f5fe41345e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5feaa48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4130890 0x7f5fe4134b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5feaa48700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4137900 con 0x7f5fe409a730 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5feaa48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4137ae0 con 0x7f5fe4099e20 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5feaa48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40a1290 con 0x7f5fe4130890 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4099e20 0x7f5fe41340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe409a730 0x7f5fe41345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe8fe5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4130890 0x7f5fe4134b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe409a730 0x7f5fe41345e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44236/0 (socket says 172.21.15.154:44236) 2023-09-30T22:28:18.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4099e20 0x7f5fe41340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34772/0 (socket says 172.21.15.154:34772) 2023-09-30T22:28:18.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe37fe700 1 -- 172.21.15.154:0/3789870722 learned_addr learned my addr 172.21.15.154:0/3789870722 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:18.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe37fe700 1 -- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4130890 msgr2=0x7f5fe4134b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe37fe700 1 --2- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4130890 0x7f5fe4134b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe37fe700 1 -- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4099e20 msgr2=0x7f5fe41340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe37fe700 1 --2- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4099e20 0x7f5fe41340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe37fe700 1 -- 172.21.15.154:0/3789870722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc009a70 con 0x7f5fe409a730 2023-09-30T22:28:18.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.467+0000 7f5fe37fe700 1 --2- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe409a730 0x7f5fe41345e0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800b500 tx=0x7f5fd800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.468+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/3789870722 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8011830 con 0x7f5fe409a730 2023-09-30T22:28:18.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.468+0000 7f5feaa48700 1 -- 172.21.15.154:0/3789870722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd4009500 con 0x7f5fe409a730 2023-09-30T22:28:18.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.468+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/3789870722 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd80119b0 con 0x7f5fe409a730 2023-09-30T22:28:18.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.468+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/3789870722 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8011d60 con 0x7f5fe409a730 2023-09-30T22:28:18.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.468+0000 7f5feaa48700 1 -- 172.21.15.154:0/3789870722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe4137540 con 0x7f5fe409a730 2023-09-30T22:28:18.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.469+0000 7f5feaa48700 1 -- 172.21.15.154:0/3789870722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe4137760 con 0x7f5fe409a730 2023-09-30T22:28:18.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.469+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/3789870722 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fd801a400 con 0x7f5fe409a730 2023-09-30T22:28:18.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.469+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/3789870722 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5fd803f6b0 con 0x7f5fe409a730 2023-09-30T22:28:18.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.478+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/3789870722 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fe4137760 con 0x7f5fe409a730 2023-09-30T22:28:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.549+0000 7f41ac886700 1 Processor -- start 2023-09-30T22:28:18.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.549+0000 7f41ac886700 1 -- start start 2023-09-30T22:28:18.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41ac886700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8099e20 0x7f41a809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41ac886700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8130a60 0x7f41a8138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41ac886700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a8099a60 con 0x7f41a809a730 2023-09-30T22:28:18.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41ac886700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a809bf50 con 0x7f41a8130a60 2023-09-30T22:28:18.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41ac886700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41a809b230 con 0x7f41a8099e20 2023-09-30T22:28:18.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41a659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8099e20 0x7f41a809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41a659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8099e20 0x7f41a809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51784/0 (socket says 172.21.15.154:51784) 2023-09-30T22:28:18.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41a659c700 1 -- 172.21.15.154:0/2107434517 learned_addr learned my addr 172.21.15.154:0/2107434517 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:18.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41a6d9d700 1 --2- 172.21.15.154:0/2107434517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8130a60 0x7f41a8138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41a659c700 1 -- 172.21.15.154:0/2107434517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8130a60 msgr2=0x7f41a8138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41a659c700 1 --2- 172.21.15.154:0/2107434517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8130a60 0x7f41a8138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41a659c700 1 -- 172.21.15.154:0/2107434517 >> v1:172.21.15.154:6789/0 conn(0x7f41a809a730 legacy=0x7f41a8130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41a659c700 1 -- 172.21.15.154:0/2107434517 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a809bb90 con 0x7f41a8099e20 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.550+0000 7f41a659c700 1 --2- 172.21.15.154:0/2107434517 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8099e20 0x7f41a809a1f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f41980098f0 tx=0x7f4198009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f5535a3c9152142 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41a559a700 1 -- 172.21.15.154:0/2107434517 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4198005e30 con 0x7f41a8099e20 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41a559a700 1 -- 172.21.15.154:0/2107434517 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4198006030 con 0x7f41a8099e20 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41a559a700 1 -- 172.21.15.154:0/2107434517 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980063c0 con 0x7f41a8099e20 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41ac886700 1 -- 172.21.15.154:0/2107434517 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8099e20 msgr2=0x7f41a809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41ac886700 1 --2- 172.21.15.154:0/2107434517 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8099e20 0x7f41a809a1f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f41980098f0 tx=0x7f4198009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41ac886700 1 -- 172.21.15.154:0/2107434517 shutdown_connections 2023-09-30T22:28:18.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41ac886700 1 --2- 172.21.15.154:0/2107434517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8130a60 0x7f41a8138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41ac886700 1 --2- 172.21.15.154:0/2107434517 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8099e20 0x7f41a809a1f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41ac886700 1 -- 172.21.15.154:0/2107434517 >> 172.21.15.154:0/2107434517 conn(0x7f41a80a2980 msgr2=0x7f41a80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.551+0000 7f41ac886700 1 -- 172.21.15.154:0/2107434517 shutdown_connections 2023-09-30T22:28:18.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.552+0000 7f41ac886700 1 -- 172.21.15.154:0/2107434517 wait complete. 2023-09-30T22:28:18.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.553+0000 7f41ac886700 1 Processor -- start 2023-09-30T22:28:18.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.553+0000 7f41ac886700 1 -- start start 2023-09-30T22:28:18.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41ac886700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8099e20 0x7f41a811ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f14b85e6700 1 Processor -- start 2023-09-30T22:28:18.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41ac886700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a809a730 0x7f41a811bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41ac886700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8130a60 0x7f41a811c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41ac886700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a811cef0 con 0x7f41a809a730 2023-09-30T22:28:18.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41ac886700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a811dae0 con 0x7f41a8099e20 2023-09-30T22:28:18.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41ac886700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80a14d0 con 0x7f41a8130a60 2023-09-30T22:28:18.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41a6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8130a60 0x7f41a811c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41a6d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8130a60 0x7f41a811c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51790/0 (socket says 172.21.15.154:51790) 2023-09-30T22:28:18.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41a6d9d700 1 -- 172.21.15.154:0/1956487928 learned_addr learned my addr 172.21.15.154:0/1956487928 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:18.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41a659c700 1 --2- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8099e20 0x7f41a811ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41a6d9d700 1 -- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8099e20 msgr2=0x7f41a811ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41a6d9d700 1 --2- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8099e20 0x7f41a811ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41a6d9d700 1 -- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a809a730 msgr2=0x7f41a811bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41a6d9d700 1 --2- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a809a730 0x7f41a811bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f41a6d9d700 1 -- 172.21.15.154:0/1956487928 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198009500 con 0x7f41a8130a60 2023-09-30T22:28:18.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.554+0000 7f14b85e6700 1 -- start start 2023-09-30T22:28:18.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f41a6d9d700 1 --2- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8130a60 0x7f41a811c4a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f41a000efc0 tx=0x7f41a000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b85e6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b006a770 0x7f14b01349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b85e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b0134f00 0x7f14b009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b85e6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b009eca0 con 0x7f14b009dea0 2023-09-30T22:28:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b85e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b006b2e0 con 0x7f14b0134f00 2023-09-30T22:28:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b85e6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14b009f720 con 0x7f14b006a770 2023-09-30T22:28:18.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f4196ffd700 1 -- 172.21.15.154:0/1956487928 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a0009ea0 con 0x7f41a8130a60 2023-09-30T22:28:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f4196ffd700 1 -- 172.21.15.154:0/1956487928 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a000f040 con 0x7f41a8130a60 2023-09-30T22:28:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f4196ffd700 1 -- 172.21.15.154:0/1956487928 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a0014480 con 0x7f41a8130a60 2023-09-30T22:28:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b5b81700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b0134f00 0x7f14b009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b6382700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b006a770 0x7f14b01349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b6382700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b006a770 0x7f14b01349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51800/0 (socket says 172.21.15.154:51800) 2023-09-30T22:28:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b5b81700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b0134f00 0x7f14b009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34802/0 (socket says 172.21.15.154:34802) 2023-09-30T22:28:18.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b6382700 1 -- 172.21.15.154:0/3440337015 learned_addr learned my addr 172.21.15.154:0/3440337015 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f41ac886700 1 -- 172.21.15.154:0/1956487928 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a809b470 con 0x7f41a8130a60 2023-09-30T22:28:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f41ac886700 1 -- 172.21.15.154:0/1956487928 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a811f160 con 0x7f41a8130a60 2023-09-30T22:28:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b5b81700 1 -- 172.21.15.154:0/3440337015 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b006a770 msgr2=0x7f14b01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b5b81700 1 --2- 172.21.15.154:0/3440337015 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b006a770 0x7f14b01349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b5b81700 1 -- 172.21.15.154:0/3440337015 >> v1:172.21.15.154:6789/0 conn(0x7f14b009dea0 legacy=0x7f14b013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:18.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.555+0000 7f14b5b81700 1 -- 172.21.15.154:0/3440337015 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b006b480 con 0x7f14b0134f00 2023-09-30T22:28:18.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.556+0000 7f14b5b81700 1 --2- 172.21.15.154:0/3440337015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b0134f00 0x7f14b009d960 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009870 tx=0x7f14a0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f03acef98ba64a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.556+0000 7f14b5380700 1 -- 172.21.15.154:0/3440337015 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0004230 con 0x7f14b0134f00 2023-09-30T22:28:18.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.556+0000 7f14b5380700 1 -- 172.21.15.154:0/3440337015 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a0004390 con 0x7f14b0134f00 2023-09-30T22:28:18.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.556+0000 7f14b5380700 1 -- 172.21.15.154:0/3440337015 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00036a0 con 0x7f14b0134f00 2023-09-30T22:28:18.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.556+0000 7f4196ffd700 1 -- 172.21.15.154:0/1956487928 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41a00145e0 con 0x7f41a8130a60 2023-09-30T22:28:18.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.556+0000 7f41ac886700 1 -- 172.21.15.154:0/1956487928 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a811edb0 con 0x7f41a8130a60 2023-09-30T22:28:18.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.556+0000 7f4196ffd700 1 -- 172.21.15.154:0/1956487928 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f41a0040520 con 0x7f41a8130a60 2023-09-30T22:28:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.557+0000 7f14b85e6700 1 -- 172.21.15.154:0/3440337015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b0134f00 msgr2=0x7f14b009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.557+0000 7f14b85e6700 1 --2- 172.21.15.154:0/3440337015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b0134f00 0x7f14b009d960 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009870 tx=0x7f14a0009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.557+0000 7f14b85e6700 1 -- 172.21.15.154:0/3440337015 shutdown_connections 2023-09-30T22:28:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.557+0000 7f14b85e6700 1 --2- 172.21.15.154:0/3440337015 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b006a770 0x7f14b01349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.557+0000 7f14b85e6700 1 --2- 172.21.15.154:0/3440337015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b0134f00 0x7f14b009d960 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.557+0000 7f14b85e6700 1 -- 172.21.15.154:0/3440337015 >> 172.21.15.154:0/3440337015 conn(0x7f14b0099c40 msgr2=0x7f14b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.557+0000 7f14b85e6700 1 -- 172.21.15.154:0/3440337015 shutdown_connections 2023-09-30T22:28:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.557+0000 7f14b85e6700 1 -- 172.21.15.154:0/3440337015 wait complete. 2023-09-30T22:28:18.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.558+0000 7f14b85e6700 1 Processor -- start 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.558+0000 7f14b85e6700 1 -- start start 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b85e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b006a770 0x7f14b006fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b85e6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b009dea0 0x7f14b0070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b85e6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14b0134f00 0x7f14b0070670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b85e6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b0126430 con 0x7f14b0134f00 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b85e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00a2ff0 con 0x7f14b006a770 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b85e6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14b009f220 con 0x7f14b009dea0 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b6382700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b006a770 0x7f14b006fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b5b81700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b009dea0 0x7f14b0070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b6382700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b006a770 0x7f14b006fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34818/0 (socket says 172.21.15.154:34818) 2023-09-30T22:28:18.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b6382700 1 -- 172.21.15.154:0/3508411220 learned_addr learned my addr 172.21.15.154:0/3508411220 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b5b81700 1 -- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b006a770 msgr2=0x7f14b006fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b5b81700 1 --2- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b006a770 0x7f14b006fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b5b81700 1 -- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14b0134f00 msgr2=0x7f14b0070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b5b81700 1 --2- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14b0134f00 0x7f14b0070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.559+0000 7f14b5b81700 1 -- 172.21.15.154:0/3508411220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00094a0 con 0x7f14b009dea0 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.560+0000 7f14b6382700 1 --2- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b006a770 0x7f14b006fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.560+0000 7f14b5b81700 1 --2- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b009dea0 0x7f14b0070130 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f14a0015000 tx=0x7f14a0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.561+0000 7f14a6ffd700 1 -- 172.21.15.154:0/3508411220 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0003c90 con 0x7f14b009dea0 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.561+0000 7f14a6ffd700 1 -- 172.21.15.154:0/3508411220 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a001f070 con 0x7f14b009dea0 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.561+0000 7f14a6ffd700 1 -- 172.21.15.154:0/3508411220 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0011870 con 0x7f14b009dea0 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.561+0000 7f14b85e6700 1 -- 172.21.15.154:0/3508411220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b0126720 con 0x7f14b009dea0 2023-09-30T22:28:18.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.561+0000 7f14b85e6700 1 -- 172.21.15.154:0/3508411220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b0126d00 con 0x7f14b009dea0 2023-09-30T22:28:18.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.561+0000 7f4196ffd700 1 -- 172.21.15.154:0/1956487928 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41a0012930 con 0x7f41a8130a60 2023-09-30T22:28:18.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.562+0000 7f14b85e6700 1 -- 172.21.15.154:0/3508411220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b004f2a0 con 0x7f14b009dea0 2023-09-30T22:28:18.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.563+0000 7f14a6ffd700 1 -- 172.21.15.154:0/3508411220 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14a0021030 con 0x7f14b009dea0 2023-09-30T22:28:18.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.563+0000 7f14a6ffd700 1 -- 172.21.15.154:0/3508411220 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f14a0040a00 con 0x7f14b009dea0 2023-09-30T22:28:18.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.572+0000 7f14a6ffd700 1 -- 172.21.15.154:0/3508411220 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14a00239c0 con 0x7f14b009dea0 2023-09-30T22:28:18.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.675+0000 7f5feaa48700 1 -- 172.21.15.154:0/3789870722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5fe4137760 con 0x7f5fe409a730 2023-09-30T22:28:18.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.675+0000 7f5fe0ff9700 1 -- 172.21.15.154:0/3789870722 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fe4137760 con 0x7f5fe409a730 2023-09-30T22:28:18.675 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:18.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.677+0000 7f5feaa48700 1 -- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe409a730 msgr2=0x7f5fe41345e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.677+0000 7f5feaa48700 1 --2- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe409a730 0x7f5fe41345e0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800b500 tx=0x7f5fd800b810 comp rx=0 tx=0).stop 2023-09-30T22:28:18.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.677+0000 7f5feaa48700 1 -- 172.21.15.154:0/3789870722 shutdown_connections 2023-09-30T22:28:18.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.677+0000 7f5feaa48700 1 --2- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5fe4130890 0x7f5fe4134b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.677+0000 7f5feaa48700 1 --2- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fe4099e20 0x7f5fe41340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.677+0000 7f5feaa48700 1 --2- 172.21.15.154:0/3789870722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fe409a730 0x7f5fe41345e0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.677+0000 7f5feaa48700 1 -- 172.21.15.154:0/3789870722 >> 172.21.15.154:0/3789870722 conn(0x7f5fe40a2980 msgr2=0x7f5fe409e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.678+0000 7f5feaa48700 1 -- 172.21.15.154:0/3789870722 shutdown_connections 2023-09-30T22:28:18.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.678+0000 7f5feaa48700 1 -- 172.21.15.154:0/3789870722 wait complete. 2023-09-30T22:28:18.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:18.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.690+0000 7f4b5425e700 1 -- 172.21.15.154:0/1933647843 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b34005860 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.690+0000 7f4b427fc700 1 -- 172.21.15.154:0/1933647843 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b3c015070 con 0x7f4b4c0a0a70 2023-09-30T22:28:18.691 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:18.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.692+0000 7f4b5425e700 1 -- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c0a0a70 msgr2=0x7f4b4c11e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.692+0000 7f4b5425e700 1 --2- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c0a0a70 0x7f4b4c11e810 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0090b0 tx=0x7f4b3c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:18.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.692+0000 7f4b5425e700 1 -- 172.21.15.154:0/1933647843 shutdown_connections 2023-09-30T22:28:18.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.692+0000 7f4b5425e700 1 --2- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b4c133f70 0x7f4b4c11ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.692+0000 7f4b5425e700 1 --2- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c09ad40 0x7f4b4c11e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.692+0000 7f4b5425e700 1 --2- 172.21.15.154:0/1933647843 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4b4c0a0a70 0x7f4b4c11e810 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.692+0000 7f4b5425e700 1 -- 172.21.15.154:0/1933647843 >> 172.21.15.154:0/1933647843 conn(0x7f4b4c099c40 msgr2=0x7f4b4c132f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.693+0000 7f4b5425e700 1 -- 172.21.15.154:0/1933647843 shutdown_connections 2023-09-30T22:28:18.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.693+0000 7f4b5425e700 1 -- 172.21.15.154:0/1933647843 wait complete. 2023-09-30T22:28:18.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:18.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.756+0000 7f41ac886700 1 -- 172.21.15.154:0/1956487928 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f41a811e780 con 0x7f41a8130a60 2023-09-30T22:28:18.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.757+0000 7f4196ffd700 1 -- 172.21.15.154:0/1956487928 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41a0012340 con 0x7f41a8130a60 2023-09-30T22:28:18.757 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.759+0000 7f41ac886700 1 -- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8130a60 msgr2=0x7f41a811c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.759+0000 7f41ac886700 1 --2- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8130a60 0x7f41a811c4a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f41a000efc0 tx=0x7f41a000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.759+0000 7f41ac886700 1 -- 172.21.15.154:0/1956487928 shutdown_connections 2023-09-30T22:28:18.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.759+0000 7f41ac886700 1 --2- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f41a8130a60 0x7f41a811c4a0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.759+0000 7f41ac886700 1 --2- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41a8099e20 0x7f41a811ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.759+0000 7f41ac886700 1 --2- 172.21.15.154:0/1956487928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a809a730 0x7f41a811bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.759+0000 7f41ac886700 1 -- 172.21.15.154:0/1956487928 >> 172.21.15.154:0/1956487928 conn(0x7f41a80a2980 msgr2=0x7f41a809e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.759+0000 7f41ac886700 1 -- 172.21.15.154:0/1956487928 shutdown_connections 2023-09-30T22:28:18.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.759+0000 7f41ac886700 1 -- 172.21.15.154:0/1956487928 wait complete. 2023-09-30T22:28:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.766+0000 7f14b85e6700 1 -- 172.21.15.154:0/3508411220 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f14b004f2a0 con 0x7f14b009dea0 2023-09-30T22:28:18.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.766+0000 7f14a6ffd700 1 -- 172.21.15.154:0/3508411220 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14a00233d0 con 0x7f14b009dea0 2023-09-30T22:28:18.766 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:18.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.768+0000 7f14b85e6700 1 -- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b009dea0 msgr2=0x7f14b0070130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:18.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.768+0000 7f14b85e6700 1 --2- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b009dea0 0x7f14b0070130 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f14a0015000 tx=0x7f14a0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.768+0000 7f14b85e6700 1 -- 172.21.15.154:0/3508411220 shutdown_connections 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.768+0000 7f14b85e6700 1 --2- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14b0134f00 0x7f14b0070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.768+0000 7f14b85e6700 1 --2- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14b006a770 0x7f14b006fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.768+0000 7f14b85e6700 1 --2- 172.21.15.154:0/3508411220 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f14b009dea0 0x7f14b0070130 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.768+0000 7f14b85e6700 1 -- 172.21.15.154:0/3508411220 >> 172.21.15.154:0/3508411220 conn(0x7f14b0099c40 msgr2=0x7f14b0137860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.768+0000 7f14b85e6700 1 -- 172.21.15.154:0/3508411220 shutdown_connections 2023-09-30T22:28:18.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:18.768+0000 7f14b85e6700 1 -- 172.21.15.154:0/3508411220 wait complete. 2023-09-30T22:28:18.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:18.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:19.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:19.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:19.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:19.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:19.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.831+0000 7f1b40020700 1 Processor -- start 2023-09-30T22:28:19.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.831+0000 7f1b40020700 1 -- start start 2023-09-30T22:28:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b40020700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38099eb0 0x7f1b3809a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b40020700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b3809a7c0 0x7f1b38130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b40020700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3809b930 con 0x7f1b38130890 2023-09-30T22:28:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b40020700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38072410 con 0x7f1b3809a7c0 2023-09-30T22:28:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b40020700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3809cd30 con 0x7f1b38099eb0 2023-09-30T22:28:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b3d5bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b3809a7c0 0x7f1b38130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b3d5bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b3809a7c0 0x7f1b38130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34824/0 (socket says 172.21.15.154:34824) 2023-09-30T22:28:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b3d5bb700 1 -- 172.21.15.154:0/3153627639 learned_addr learned my addr 172.21.15.154:0/3153627639 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:19.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b3ddbc700 1 --2- 172.21.15.154:0/3153627639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38099eb0 0x7f1b3809a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b3d5bb700 1 -- 172.21.15.154:0/3153627639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38099eb0 msgr2=0x7f1b3809a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b3d5bb700 1 --2- 172.21.15.154:0/3153627639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38099eb0 0x7f1b3809a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b3d5bb700 1 -- 172.21.15.154:0/3153627639 >> v1:172.21.15.154:6789/0 conn(0x7f1b38130890 legacy=0x7f1b38137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.832+0000 7f1b3d5bb700 1 -- 172.21.15.154:0/3153627639 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38099a60 con 0x7f1b3809a7c0 2023-09-30T22:28:19.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.833+0000 7f1b3d5bb700 1 --2- 172.21.15.154:0/3153627639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b3809a7c0 0x7f1b38130350 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009920 tx=0x7f1b28009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c24819e70e1c098c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.833+0000 7f1b3cdba700 1 -- 172.21.15.154:0/3153627639 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28011830 con 0x7f1b3809a7c0 2023-09-30T22:28:19.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.833+0000 7f1b3cdba700 1 -- 172.21.15.154:0/3153627639 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28011990 con 0x7f1b3809a7c0 2023-09-30T22:28:19.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.833+0000 7f1b3cdba700 1 -- 172.21.15.154:0/3153627639 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28011d20 con 0x7f1b3809a7c0 2023-09-30T22:28:19.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.834+0000 7f1b40020700 1 -- 172.21.15.154:0/3153627639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b3809a7c0 msgr2=0x7f1b38130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.834+0000 7f1b40020700 1 --2- 172.21.15.154:0/3153627639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b3809a7c0 0x7f1b38130350 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009920 tx=0x7f1b28009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:19.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.834+0000 7f1b40020700 1 -- 172.21.15.154:0/3153627639 shutdown_connections 2023-09-30T22:28:19.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.834+0000 7f1b40020700 1 --2- 172.21.15.154:0/3153627639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38099eb0 0x7f1b3809a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.834+0000 7f1b40020700 1 --2- 172.21.15.154:0/3153627639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b3809a7c0 0x7f1b38130350 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.834+0000 7f1b40020700 1 -- 172.21.15.154:0/3153627639 >> 172.21.15.154:0/3153627639 conn(0x7f1b380a2980 msgr2=0x7f1b380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:19.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.834+0000 7f1b40020700 1 -- 172.21.15.154:0/3153627639 shutdown_connections 2023-09-30T22:28:19.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.834+0000 7f1b40020700 1 -- 172.21.15.154:0/3153627639 wait complete. 2023-09-30T22:28:19.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b40020700 1 Processor -- start 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b40020700 1 -- start start 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b40020700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b38099eb0 0x7f1b38128930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b40020700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b3809a7c0 0x7f1b38128e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b40020700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38130890 0x7f1b381c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b40020700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38128520 con 0x7f1b3809a7c0 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b40020700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3812ac40 con 0x7f1b38099eb0 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b40020700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380a10b0 con 0x7f1b38130890 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b3ddbc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b38099eb0 0x7f1b38128930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b3ddbc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b38099eb0 0x7f1b38128930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34830/0 (socket says 172.21.15.154:34830) 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.836+0000 7f1b3ddbc700 1 -- 172.21.15.154:0/2110849655 learned_addr learned my addr 172.21.15.154:0/2110849655 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:19.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b3d5bb700 1 --2- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b3809a7c0 0x7f1b38128e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b3e5bd700 1 --2- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38130890 0x7f1b381c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b3ddbc700 1 -- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38130890 msgr2=0x7f1b381c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b3ddbc700 1 --2- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38130890 0x7f1b381c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b3ddbc700 1 -- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b3809a7c0 msgr2=0x7f1b38128e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b3ddbc700 1 --2- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b3809a7c0 0x7f1b38128e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b3ddbc700 1 -- 172.21.15.154:0/2110849655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b28009550 con 0x7f1b38099eb0 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b3ddbc700 1 --2- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b38099eb0 0x7f1b38128930 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400e990 tx=0x7f1b3400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b2e7fc700 1 -- 172.21.15.154:0/2110849655 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340096f0 con 0x7f1b38099eb0 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b2e7fc700 1 -- 172.21.15.154:0/2110849655 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3400c850 con 0x7f1b38099eb0 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b40020700 1 -- 172.21.15.154:0/2110849655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3812af00 con 0x7f1b38099eb0 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b2e7fc700 1 -- 172.21.15.154:0/2110849655 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400eee0 con 0x7f1b38099eb0 2023-09-30T22:28:19.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.837+0000 7f1b40020700 1 -- 172.21.15.154:0/2110849655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b38129840 con 0x7f1b38099eb0 2023-09-30T22:28:19.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.838+0000 7f1b2e7fc700 1 -- 172.21.15.154:0/2110849655 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b3400cbc0 con 0x7f1b38099eb0 2023-09-30T22:28:19.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.839+0000 7f1b2e7fc700 1 -- 172.21.15.154:0/2110849655 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b3403fba0 con 0x7f1b38099eb0 2023-09-30T22:28:19.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.839+0000 7f1b40020700 1 -- 172.21.15.154:0/2110849655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3804f2a0 con 0x7f1b38099eb0 2023-09-30T22:28:19.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.843+0000 7f1b2e7fc700 1 -- 172.21.15.154:0/2110849655 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b34021020 con 0x7f1b38099eb0 2023-09-30T22:28:19.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.882+0000 7fb003ff8700 1 Processor -- start 2023-09-30T22:28:19.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.882+0000 7fb003ff8700 1 -- start start 2023-09-30T22:28:19.882 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb003ff8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 0x7faffc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb003ff8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faffc09f180 0x7faffc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb003ff8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc09c970 con 0x7faffc131d70 2023-09-30T22:28:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb003ff8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc0a0920 con 0x7faffc09f180 2023-09-30T22:28:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb003ff8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc09f9c0 con 0x7faffc09e870 2023-09-30T22:28:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb001593700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faffc09f180 0x7faffc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb001d94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 0x7faffc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb001593700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faffc09f180 0x7faffc131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44272/0 (socket says 172.21.15.154:44272) 2023-09-30T22:28:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb001d94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 0x7faffc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34844/0 (socket says 172.21.15.154:34844) 2023-09-30T22:28:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb001593700 1 -- 172.21.15.154:0/2358439024 learned_addr learned my addr 172.21.15.154:0/2358439024 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:19.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb001593700 1 -- 172.21.15.154:0/2358439024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 msgr2=0x7faffc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:19.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb001593700 1 --2- 172.21.15.154:0/2358439024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 0x7faffc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb001593700 1 -- 172.21.15.154:0/2358439024 >> v1:172.21.15.154:6789/0 conn(0x7faffc131d70 legacy=0x7faffc138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb001593700 1 -- 172.21.15.154:0/2358439024 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc09bab0 con 0x7faffc09f180 2023-09-30T22:28:19.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.883+0000 7fb000d92700 1 -- 172.21.15.154:0/2358439024 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685815925 0 0) 0x7faffc09c970 con 0x7faffc131d70 2023-09-30T22:28:19.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.884+0000 7fb001593700 1 --2- 172.21.15.154:0/2358439024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc09f180 0x7faffc131830 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fafec0098f0 tx=0x7fafec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8c1252cde020b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.884+0000 7fb000d92700 1 -- 172.21.15.154:0/2358439024 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec011830 con 0x7faffc09f180 2023-09-30T22:28:19.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.884+0000 7fb000d92700 1 -- 172.21.15.154:0/2358439024 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec011990 con 0x7faffc09f180 2023-09-30T22:28:19.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.884+0000 7fb000d92700 1 -- 172.21.15.154:0/2358439024 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec011d20 con 0x7faffc09f180 2023-09-30T22:28:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.885+0000 7fb003ff8700 1 -- 172.21.15.154:0/2358439024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc09f180 msgr2=0x7faffc131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.885+0000 7fb003ff8700 1 --2- 172.21.15.154:0/2358439024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc09f180 0x7faffc131830 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fafec0098f0 tx=0x7fafec009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.885+0000 7fb003ff8700 1 -- 172.21.15.154:0/2358439024 shutdown_connections 2023-09-30T22:28:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.885+0000 7fb003ff8700 1 --2- 172.21.15.154:0/2358439024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 0x7faffc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.885+0000 7fb003ff8700 1 --2- 172.21.15.154:0/2358439024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc09f180 0x7faffc131830 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.885+0000 7fb003ff8700 1 -- 172.21.15.154:0/2358439024 >> 172.21.15.154:0/2358439024 conn(0x7faffc0a4430 msgr2=0x7faffc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.885+0000 7fb003ff8700 1 -- 172.21.15.154:0/2358439024 shutdown_connections 2023-09-30T22:28:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.885+0000 7fb003ff8700 1 -- 172.21.15.154:0/2358439024 wait complete. 2023-09-30T22:28:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.886+0000 7fb003ff8700 1 Processor -- start 2023-09-30T22:28:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.886+0000 7fb003ff8700 1 -- start start 2023-09-30T22:28:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.886+0000 7fb003ff8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 0x7faffc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.886+0000 7fb003ff8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faffc09f180 0x7faffc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.886+0000 7fb003ff8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc131d70 0x7faffc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.886+0000 7fb003ff8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc09dba0 con 0x7faffc131d70 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.886+0000 7fb003ff8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc1246e0 con 0x7faffc09e870 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.886+0000 7fb003ff8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faffc06d640 con 0x7faffc09f180 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.886+0000 7fb002595700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc131d70 0x7faffc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb002595700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc131d70 0x7faffc06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44274/0 (socket says 172.21.15.154:44274) 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb002595700 1 -- 172.21.15.154:0/3633890235 learned_addr learned my addr 172.21.15.154:0/3633890235 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb001593700 1 --2- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faffc09f180 0x7faffc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb001d94700 1 --2- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 0x7faffc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb002595700 1 -- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faffc09f180 msgr2=0x7faffc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb002595700 1 --2- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faffc09f180 0x7faffc06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb002595700 1 -- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 msgr2=0x7faffc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb002595700 1 --2- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 0x7faffc06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb002595700 1 -- 172.21.15.154:0/3633890235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec009550 con 0x7faffc131d70 2023-09-30T22:28:19.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb002595700 1 --2- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc131d70 0x7faffc06c330 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7faff400c810 tx=0x7faff400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7faff27fc700 1 -- 172.21.15.154:0/3633890235 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4003e30 con 0x7faffc131d70 2023-09-30T22:28:19.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7faff27fc700 1 -- 172.21.15.154:0/3633890235 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff4005070 con 0x7faffc131d70 2023-09-30T22:28:19.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7faff27fc700 1 -- 172.21.15.154:0/3633890235 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4005420 con 0x7faffc131d70 2023-09-30T22:28:19.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb003ff8700 1 -- 172.21.15.154:0/3633890235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc1257f0 con 0x7faffc131d70 2023-09-30T22:28:19.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.887+0000 7fb003ff8700 1 -- 172.21.15.154:0/3633890235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc126520 con 0x7faffc131d70 2023-09-30T22:28:19.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.888+0000 7faff27fc700 1 -- 172.21.15.154:0/3633890235 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faff4005580 con 0x7faffc131d70 2023-09-30T22:28:19.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.888+0000 7faff27fc700 1 -- 172.21.15.154:0/3633890235 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faff403f4a0 con 0x7faffc131d70 2023-09-30T22:28:19.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.889+0000 7fb003ff8700 1 -- 172.21.15.154:0/3633890235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc04f2a0 con 0x7faffc131d70 2023-09-30T22:28:19.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.898+0000 7faff27fc700 1 -- 172.21.15.154:0/3633890235 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faff4005830 con 0x7faffc131d70 2023-09-30T22:28:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.920+0000 7f64cf128700 1 Processor -- start 2023-09-30T22:28:19.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.920+0000 7f64cf128700 1 -- start start 2023-09-30T22:28:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64cf128700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8136960 0x7f64c8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64cf128700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64c8139280 0x7f64c813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64cf128700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c806b2d0 con 0x7f64c8133ad0 2023-09-30T22:28:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64cf128700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c81345b0 con 0x7f64c8139280 2023-09-30T22:28:19.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64cf128700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8133610 con 0x7f64c8136960 2023-09-30T22:28:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64c7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8136960 0x7f64c8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64c7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8136960 0x7f64c8138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51864/0 (socket says 172.21.15.154:51864) 2023-09-30T22:28:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64c7fff700 1 -- 172.21.15.154:0/3740805830 learned_addr learned my addr 172.21.15.154:0/3740805830 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64c7fff700 1 -- 172.21.15.154:0/3740805830 >> v2:172.21.15.154:3300/0 conn(0x7f64c8139280 msgr2=0x7f64c813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64c7fff700 1 --2- 172.21.15.154:0/3740805830 >> v2:172.21.15.154:3300/0 conn(0x7f64c8139280 0x7f64c813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64c7fff700 1 -- 172.21.15.154:0/3740805830 >> v1:172.21.15.154:6789/0 conn(0x7f64c8133ad0 legacy=0x7f64c8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.921+0000 7f64c7fff700 1 -- 172.21.15.154:0/3740805830 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c809a500 con 0x7f64c8136960 2023-09-30T22:28:19.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.922+0000 7f64c7fff700 1 --2- 172.21.15.154:0/3740805830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8136960 0x7f64c8138d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009920 tx=0x7f64b4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b34f213952faa59 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.922+0000 7f64c77fe700 1 -- 172.21.15.154:0/3740805830 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4004230 con 0x7f64c8136960 2023-09-30T22:28:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.922+0000 7f64c77fe700 1 -- 172.21.15.154:0/3740805830 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4004390 con 0x7f64c8136960 2023-09-30T22:28:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.922+0000 7f64c77fe700 1 -- 172.21.15.154:0/3740805830 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4009e70 con 0x7f64c8136960 2023-09-30T22:28:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.922+0000 7f64cf128700 1 -- 172.21.15.154:0/3740805830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8136960 msgr2=0x7f64c8138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.922+0000 7f64cf128700 1 --2- 172.21.15.154:0/3740805830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8136960 0x7f64c8138d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009920 tx=0x7f64b4009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.922+0000 7f64cf128700 1 -- 172.21.15.154:0/3740805830 shutdown_connections 2023-09-30T22:28:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.922+0000 7f64cf128700 1 --2- 172.21.15.154:0/3740805830 >> v2:172.21.15.154:3300/0 conn(0x7f64c8139280 0x7f64c813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.923+0000 7f64cf128700 1 --2- 172.21.15.154:0/3740805830 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8136960 0x7f64c8138d40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.923+0000 7f64cf128700 1 -- 172.21.15.154:0/3740805830 >> 172.21.15.154:0/3740805830 conn(0x7f64c8099c40 msgr2=0x7f64c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:19.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.923+0000 7f64cf128700 1 -- 172.21.15.154:0/3740805830 shutdown_connections 2023-09-30T22:28:19.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.923+0000 7f64cf128700 1 -- 172.21.15.154:0/3740805830 wait complete. 2023-09-30T22:28:19.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.924+0000 7f64cf128700 1 Processor -- start 2023-09-30T22:28:19.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.924+0000 7f64cf128700 1 -- start start 2023-09-30T22:28:19.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cf128700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c8133ad0 0x7f64c812cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cf128700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64c8136960 0x7f64c812d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cf128700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8139280 0x7f64c80711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cf128700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c809f390 con 0x7f64c8133ad0 2023-09-30T22:28:19.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cf128700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c81316a0 con 0x7f64c8136960 2023-09-30T22:28:19.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cf128700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80723c0 con 0x7f64c8139280 2023-09-30T22:28:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cd6c5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8139280 0x7f64c80711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cd6c5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8139280 0x7f64c80711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51872/0 (socket says 172.21.15.154:51872) 2023-09-30T22:28:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cd6c5700 1 -- 172.21.15.154:0/910076523 learned_addr learned my addr 172.21.15.154:0/910076523 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64c7fff700 1 --2- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64c8136960 0x7f64c812d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cd6c5700 1 -- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64c8136960 msgr2=0x7f64c812d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cd6c5700 1 --2- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64c8136960 0x7f64c812d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cd6c5700 1 -- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c8133ad0 msgr2=0x7f64c812cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cd6c5700 1 --2- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c8133ad0 0x7f64c812cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cd6c5700 1 -- 172.21.15.154:0/910076523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b4009550 con 0x7f64c8139280 2023-09-30T22:28:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.925+0000 7f64cd6c5700 1 --2- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8139280 0x7f64c80711c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f64c000b9e0 tx=0x7f64c000bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.926+0000 7f64c57fa700 1 -- 172.21.15.154:0/910076523 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000d8e0 con 0x7f64c8139280 2023-09-30T22:28:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.926+0000 7f64c57fa700 1 -- 172.21.15.154:0/910076523 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c000da60 con 0x7f64c8139280 2023-09-30T22:28:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.926+0000 7f64cf128700 1 -- 172.21.15.154:0/910076523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c812d970 con 0x7f64c8139280 2023-09-30T22:28:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.926+0000 7f64c57fa700 1 -- 172.21.15.154:0/910076523 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000de10 con 0x7f64c8139280 2023-09-30T22:28:19.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.926+0000 7f64cf128700 1 -- 172.21.15.154:0/910076523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c8070d70 con 0x7f64c8139280 2023-09-30T22:28:19.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.927+0000 7f64c57fa700 1 -- 172.21.15.154:0/910076523 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64c0015420 con 0x7f64c8139280 2023-09-30T22:28:19.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.927+0000 7f64cf128700 1 -- 172.21.15.154:0/910076523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c804f2a0 con 0x7f64c8139280 2023-09-30T22:28:19.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.927+0000 7f64c57fa700 1 -- 172.21.15.154:0/910076523 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f64c0011070 con 0x7f64c8139280 2023-09-30T22:28:19.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.936+0000 7f64c57fa700 1 -- 172.21.15.154:0/910076523 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64c0007900 con 0x7f64c8139280 2023-09-30T22:28:19.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.964+0000 7f40ad19e700 1 Processor -- start 2023-09-30T22:28:19.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.964+0000 7f40ad19e700 1 -- start start 2023-09-30T22:28:19.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40ad19e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a1450 0x7f40a8138a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40ad19e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40a8138fb0 0x7f40a813b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40ad19e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a80a2330 con 0x7f40a80a0970 2023-09-30T22:28:19.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40ad19e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a80a1840 con 0x7f40a8138fb0 2023-09-30T22:28:19.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40ad19e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80a1a80 con 0x7f40a80a1450 2023-09-30T22:28:19.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40a77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a1450 0x7f40a8138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40a77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a1450 0x7f40a8138a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51888/0 (socket says 172.21.15.154:51888) 2023-09-30T22:28:19.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40a77fe700 1 -- 172.21.15.154:0/1239763774 learned_addr learned my addr 172.21.15.154:0/1239763774 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:19.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40ac99d700 1 --2- 172.21.15.154:0/1239763774 >> v2:172.21.15.154:3300/0 conn(0x7f40a8138fb0 0x7f40a813b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40a77fe700 1 -- 172.21.15.154:0/1239763774 >> v2:172.21.15.154:3300/0 conn(0x7f40a8138fb0 msgr2=0x7f40a813b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40a77fe700 1 --2- 172.21.15.154:0/1239763774 >> v2:172.21.15.154:3300/0 conn(0x7f40a8138fb0 0x7f40a813b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.965+0000 7f40a77fe700 1 -- 172.21.15.154:0/1239763774 >> v1:172.21.15.154:6789/0 conn(0x7f40a80a0970 legacy=0x7f40a80a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.966+0000 7f40a77fe700 1 -- 172.21.15.154:0/1239763774 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a809db90 con 0x7f40a80a1450 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.966+0000 7f40a77fe700 1 --2- 172.21.15.154:0/1239763774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a1450 0x7f40a8138a70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f409c0098f0 tx=0x7f409c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6abc82ad515e02bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.966+0000 7f40a6ffd700 1 -- 172.21.15.154:0/1239763774 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011830 con 0x7f40a80a1450 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.966+0000 7f40a6ffd700 1 -- 172.21.15.154:0/1239763774 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c011990 con 0x7f40a80a1450 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.966+0000 7f40a6ffd700 1 -- 172.21.15.154:0/1239763774 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c011d20 con 0x7f40a80a1450 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.967+0000 7f40ad19e700 1 -- 172.21.15.154:0/1239763774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a1450 msgr2=0x7f40a8138a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.967+0000 7f40ad19e700 1 --2- 172.21.15.154:0/1239763774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a1450 0x7f40a8138a70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f409c0098f0 tx=0x7f409c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.967+0000 7f40ad19e700 1 -- 172.21.15.154:0/1239763774 shutdown_connections 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.967+0000 7f40ad19e700 1 --2- 172.21.15.154:0/1239763774 >> v2:172.21.15.154:3300/0 conn(0x7f40a8138fb0 0x7f40a813b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.967+0000 7f40ad19e700 1 --2- 172.21.15.154:0/1239763774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a1450 0x7f40a8138a70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.967+0000 7f40ad19e700 1 -- 172.21.15.154:0/1239763774 >> 172.21.15.154:0/1239763774 conn(0x7f40a80a6070 msgr2=0x7f40a80a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.967+0000 7f40ad19e700 1 -- 172.21.15.154:0/1239763774 shutdown_connections 2023-09-30T22:28:19.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.967+0000 7f40ad19e700 1 -- 172.21.15.154:0/1239763774 wait complete. 2023-09-30T22:28:19.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.968+0000 7f40ad19e700 1 Processor -- start 2023-09-30T22:28:19.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.968+0000 7f40ad19e700 1 -- start start 2023-09-30T22:28:19.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.968+0000 7f40ad19e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a0970 0x7f40a81c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.968+0000 7f40ad19e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40a80a1450 0x7f40a81c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.968+0000 7f40ad19e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40a8138fb0 0x7f40a81c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:19.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.968+0000 7f40ad19e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8120620 con 0x7f40a80a1450 2023-09-30T22:28:19.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.968+0000 7f40ad19e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8121b40 con 0x7f40a8138fb0 2023-09-30T22:28:19.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.968+0000 7f40ad19e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40a809cdc0 con 0x7f40a80a0970 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a0970 0x7f40a81c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a0970 0x7f40a81c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51900/0 (socket says 172.21.15.154:51900) 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a7fff700 1 -- 172.21.15.154:0/1213157595 learned_addr learned my addr 172.21.15.154:0/1213157595 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40ac99d700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40a8138fb0 0x7f40a81c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a77fe700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40a80a1450 0x7f40a81c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a7fff700 1 -- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40a8138fb0 msgr2=0x7f40a81c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a7fff700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40a8138fb0 0x7f40a81c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a7fff700 1 -- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40a80a1450 msgr2=0x7f40a81c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a7fff700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40a80a1450 0x7f40a81c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a7fff700 1 -- 172.21.15.154:0/1213157595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c009550 con 0x7f40a80a0970 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a77fe700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40a80a1450 0x7f40a81c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:19.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a7fff700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a0970 0x7f40a81c82a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f409800c450 tx=0x7f409800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:19.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a4ff9700 1 -- 172.21.15.154:0/1213157595 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980052d0 con 0x7f40a80a0970 2023-09-30T22:28:19.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a4ff9700 1 -- 172.21.15.154:0/1213157595 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4098005430 con 0x7f40a80a0970 2023-09-30T22:28:19.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40ad19e700 1 -- 172.21.15.154:0/1213157595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a8121e10 con 0x7f40a80a0970 2023-09-30T22:28:19.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40a4ff9700 1 -- 172.21.15.154:0/1213157595 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40980038c0 con 0x7f40a80a0970 2023-09-30T22:28:19.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.969+0000 7f40ad19e700 1 -- 172.21.15.154:0/1213157595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a8121110 con 0x7f40a80a0970 2023-09-30T22:28:19.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.970+0000 7f40a4ff9700 1 -- 172.21.15.154:0/1213157595 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4098003a20 con 0x7f40a80a0970 2023-09-30T22:28:19.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.970+0000 7f40a4ff9700 1 -- 172.21.15.154:0/1213157595 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f409803ea90 con 0x7f40a80a0970 2023-09-30T22:28:19.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.971+0000 7f40ad19e700 1 -- 172.21.15.154:0/1213157595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a8121fa0 con 0x7f40a80a0970 2023-09-30T22:28:19.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:19.975+0000 7f40a4ff9700 1 -- 172.21.15.154:0/1213157595 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40a8121fa0 con 0x7f40a80a0970 2023-09-30T22:28:20.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.059+0000 7f1b40020700 1 -- 172.21.15.154:0/2110849655 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b3806bce0 con 0x7f1b38099eb0 2023-09-30T22:28:20.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.060+0000 7f1b2e7fc700 1 -- 172.21.15.154:0/2110849655 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b34017070 con 0x7f1b38099eb0 2023-09-30T22:28:20.060 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.063+0000 7f1b40020700 1 -- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b38099eb0 msgr2=0x7f1b38128930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.063+0000 7f1b40020700 1 --2- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b38099eb0 0x7f1b38128930 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400e990 tx=0x7f1b3400eca0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.063+0000 7f1b40020700 1 -- 172.21.15.154:0/2110849655 shutdown_connections 2023-09-30T22:28:20.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.063+0000 7f1b40020700 1 --2- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1b38130890 0x7f1b381c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.063+0000 7f1b40020700 1 --2- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b38099eb0 0x7f1b38128930 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.063+0000 7f1b40020700 1 --2- 172.21.15.154:0/2110849655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b3809a7c0 0x7f1b38128e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.063+0000 7f1b40020700 1 -- 172.21.15.154:0/2110849655 >> 172.21.15.154:0/2110849655 conn(0x7f1b380a2980 msgr2=0x7f1b381270d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.063+0000 7f1b40020700 1 -- 172.21.15.154:0/2110849655 shutdown_connections 2023-09-30T22:28:20.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.063+0000 7f1b40020700 1 -- 172.21.15.154:0/2110849655 wait complete. 2023-09-30T22:28:20.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:20.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.122+0000 7fb003ff8700 1 -- 172.21.15.154:0/3633890235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faffc06b2a0 con 0x7faffc131d70 2023-09-30T22:28:20.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.122+0000 7faff27fc700 1 -- 172.21.15.154:0/3633890235 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faff402a090 con 0x7faffc131d70 2023-09-30T22:28:20.122 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.124+0000 7fb003ff8700 1 -- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc131d70 msgr2=0x7faffc06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.124+0000 7fb003ff8700 1 --2- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc131d70 0x7faffc06c330 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7faff400c810 tx=0x7faff400cb20 comp rx=0 tx=0).stop 2023-09-30T22:28:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.124+0000 7fb003ff8700 1 -- 172.21.15.154:0/3633890235 shutdown_connections 2023-09-30T22:28:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.124+0000 7fb003ff8700 1 --2- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faffc131d70 0x7faffc06c330 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.124+0000 7fb003ff8700 1 --2- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faffc09e870 0x7faffc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.124+0000 7fb003ff8700 1 --2- 172.21.15.154:0/3633890235 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faffc09f180 0x7faffc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.124+0000 7fb003ff8700 1 -- 172.21.15.154:0/3633890235 >> 172.21.15.154:0/3633890235 conn(0x7faffc0a4430 msgr2=0x7faffc071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.124+0000 7fb003ff8700 1 -- 172.21.15.154:0/3633890235 shutdown_connections 2023-09-30T22:28:20.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.124+0000 7fb003ff8700 1 -- 172.21.15.154:0/3633890235 wait complete. 2023-09-30T22:28:20.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:20.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.157+0000 7f64cf128700 1 -- 172.21.15.154:0/910076523 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f64c809f0f0 con 0x7f64c8139280 2023-09-30T22:28:20.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.158+0000 7f64c57fa700 1 -- 172.21.15.154:0/910076523 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64c0007310 con 0x7f64c8139280 2023-09-30T22:28:20.158 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:20.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.161+0000 7f64cf128700 1 -- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8139280 msgr2=0x7f64c80711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.161+0000 7f64cf128700 1 --2- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8139280 0x7f64c80711c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f64c000b9e0 tx=0x7f64c000bcf0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.161+0000 7f64cf128700 1 -- 172.21.15.154:0/910076523 shutdown_connections 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.161+0000 7f64cf128700 1 --2- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f64c8139280 0x7f64c80711c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.161+0000 7f64cf128700 1 --2- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c8133ad0 0x7f64c812cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.161+0000 7f64cf128700 1 --2- 172.21.15.154:0/910076523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64c8136960 0x7f64c812d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.161+0000 7f64cf128700 1 -- 172.21.15.154:0/910076523 >> 172.21.15.154:0/910076523 conn(0x7f64c8099c40 msgr2=0x7f64c8134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.161+0000 7f64cf128700 1 -- 172.21.15.154:0/910076523 shutdown_connections 2023-09-30T22:28:20.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.161+0000 7f64cf128700 1 -- 172.21.15.154:0/910076523 wait complete. 2023-09-30T22:28:20.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:20.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.183+0000 7f40ad19e700 1 -- 172.21.15.154:0/1213157595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f40a8121fa0 con 0x7f40a80a0970 2023-09-30T22:28:20.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.184+0000 7f40a4ff9700 1 -- 172.21.15.154:0/1213157595 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40a8121fa0 con 0x7f40a80a0970 2023-09-30T22:28:20.184 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.186+0000 7f40ad19e700 1 -- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a0970 msgr2=0x7f40a81c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.186+0000 7f40ad19e700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a0970 0x7f40a81c82a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f409800c450 tx=0x7f409800c760 comp rx=0 tx=0).stop 2023-09-30T22:28:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.186+0000 7f40ad19e700 1 -- 172.21.15.154:0/1213157595 shutdown_connections 2023-09-30T22:28:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.186+0000 7f40ad19e700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40a8138fb0 0x7f40a81c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.186+0000 7f40ad19e700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f40a80a0970 0x7f40a81c82a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.186+0000 7f40ad19e700 1 --2- 172.21.15.154:0/1213157595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40a80a1450 0x7f40a81c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.186+0000 7f40ad19e700 1 -- 172.21.15.154:0/1213157595 >> 172.21.15.154:0/1213157595 conn(0x7f40a80a6070 msgr2=0x7f40a8137fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:20.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.186+0000 7f40ad19e700 1 -- 172.21.15.154:0/1213157595 shutdown_connections 2023-09-30T22:28:20.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:20.186+0000 7f40ad19e700 1 -- 172.21.15.154:0/1213157595 wait complete. 2023-09-30T22:28:20.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:21.076 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:21.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:21.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:21.198 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:21.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.217+0000 7f0aa6a50700 1 Processor -- start 2023-09-30T22:28:21.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0aa6a50700 1 -- start start 2023-09-30T22:28:21.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0aa6a50700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa0099e20 0x7f0aa009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0aa6a50700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa009a730 0x7f0aa0130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0aa6a50700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0aa0130890 0x7f0aa0130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0aa6a50700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa009bf50 con 0x7f0aa0130890 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0aa6a50700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0099a60 con 0x7f0aa0099e20 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0aa6a50700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa009b230 con 0x7f0aa009a730 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0a9f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa009a730 0x7f0aa0130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0aa4fed700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0aa0130890 0x7f0aa0130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0a9f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa009a730 0x7f0aa0130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51910/0 (socket says 172.21.15.154:51910) 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0a9f7fe700 1 -- 172.21.15.154:0/431252752 learned_addr learned my addr 172.21.15.154:0/431252752 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.218+0000 7f0a9ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa0099e20 0x7f0aa009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9ffff700 1 -- 172.21.15.154:0/431252752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa009a730 msgr2=0x7f0aa0130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9ffff700 1 --2- 172.21.15.154:0/431252752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa009a730 0x7f0aa0130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9ffff700 1 -- 172.21.15.154:0/431252752 >> v2:172.21.15.154:3300/0 conn(0x7f0aa0130890 msgr2=0x7f0aa0130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9ffff700 1 --2- 172.21.15.154:0/431252752 >> v2:172.21.15.154:3300/0 conn(0x7f0aa0130890 0x7f0aa0130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9ffff700 1 -- 172.21.15.154:0/431252752 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa009bb90 con 0x7f0aa0099e20 2023-09-30T22:28:21.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9f7fe700 1 --2- 172.21.15.154:0/431252752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa009a730 0x7f0aa0130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:21.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9ffff700 1 --2- 172.21.15.154:0/431252752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa0099e20 0x7f0aa009a1f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009820 tx=0x7f0a90009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5bec17606260550 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9effd700 1 -- 172.21.15.154:0/431252752 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90005e30 con 0x7f0aa0099e20 2023-09-30T22:28:21.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9effd700 1 -- 172.21.15.154:0/431252752 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90006030 con 0x7f0aa0099e20 2023-09-30T22:28:21.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.219+0000 7f0a9effd700 1 -- 172.21.15.154:0/431252752 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a900063c0 con 0x7f0aa0099e20 2023-09-30T22:28:21.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.220+0000 7f0aa6a50700 1 -- 172.21.15.154:0/431252752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa0099e20 msgr2=0x7f0aa009a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.220+0000 7f0aa6a50700 1 --2- 172.21.15.154:0/431252752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa0099e20 0x7f0aa009a1f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009820 tx=0x7f0a90009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.220+0000 7f0aa6a50700 1 -- 172.21.15.154:0/431252752 shutdown_connections 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.220+0000 7f0aa6a50700 1 --2- 172.21.15.154:0/431252752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa0099e20 0x7f0aa009a1f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.220+0000 7f0aa6a50700 1 --2- 172.21.15.154:0/431252752 >> v2:172.21.15.154:3300/0 conn(0x7f0aa0130890 0x7f0aa0130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.220+0000 7f0aa6a50700 1 --2- 172.21.15.154:0/431252752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa009a730 0x7f0aa0130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.220+0000 7f0aa6a50700 1 -- 172.21.15.154:0/431252752 >> 172.21.15.154:0/431252752 conn(0x7f0aa00a2980 msgr2=0x7f0aa00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.220+0000 7f0aa6a50700 1 -- 172.21.15.154:0/431252752 shutdown_connections 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.220+0000 7f0aa6a50700 1 -- 172.21.15.154:0/431252752 wait complete. 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.222+0000 7f0aa6a50700 1 Processor -- start 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.222+0000 7f0aa6a50700 1 -- start start 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.222+0000 7f0aa6a50700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa0099e20 0x7f0aa0118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.222+0000 7f0aa6a50700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa009a730 0x7f0aa0119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.222+0000 7f0aa6a50700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa0130890 0x7f0aa0119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.222+0000 7f0aa6a50700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa011b3f0 con 0x7f0aa0099e20 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.222+0000 7f0aa6a50700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa011be40 con 0x7f0aa009a730 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.222+0000 7f0aa6a50700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa011c040 con 0x7f0aa0130890 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa0099e20 0x7f0aa0118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa0099e20 0x7f0aa0118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44326/0 (socket says 172.21.15.154:44326) 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9ffff700 1 -- 172.21.15.154:0/1765246297 learned_addr learned my addr 172.21.15.154:0/1765246297 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9f7fe700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa009a730 0x7f0aa0119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0aa4fed700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa0130890 0x7f0aa0119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9ffff700 1 -- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa0130890 msgr2=0x7f0aa0119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9ffff700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa0130890 0x7f0aa0119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9ffff700 1 -- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa009a730 msgr2=0x7f0aa0119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9ffff700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa009a730 0x7f0aa0119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9ffff700 1 -- 172.21.15.154:0/1765246297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94009550 con 0x7f0aa0099e20 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9f7fe700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa009a730 0x7f0aa0119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9ffff700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa0099e20 0x7f0aa0118df0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0a90000c00 tx=0x7f0a90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9cff9700 1 -- 172.21.15.154:0/1765246297 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90004240 con 0x7f0aa0099e20 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.223+0000 7f0a9cff9700 1 -- 172.21.15.154:0/1765246297 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a900043a0 con 0x7f0aa0099e20 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.224+0000 7f0aa6a50700 1 -- 172.21.15.154:0/1765246297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a90009430 con 0x7f0aa0099e20 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.224+0000 7f0aa6a50700 1 -- 172.21.15.154:0/1765246297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa011c970 con 0x7f0aa0099e20 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.224+0000 7f0a9cff9700 1 -- 172.21.15.154:0/1765246297 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a90006950 con 0x7f0aa0099e20 2023-09-30T22:28:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.224+0000 7f0a9cff9700 1 -- 172.21.15.154:0/1765246297 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a90026070 con 0x7f0aa0099e20 2023-09-30T22:28:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.224+0000 7f0a9cff9700 1 -- 172.21.15.154:0/1765246297 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a90045130 con 0x7f0aa0099e20 2023-09-30T22:28:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.225+0000 7f0aa6a50700 1 -- 172.21.15.154:0/1765246297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a800052e0 con 0x7f0aa0099e20 2023-09-30T22:28:21.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.231+0000 7f0a9cff9700 1 -- 172.21.15.154:0/1765246297 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a90032c20 con 0x7f0aa0099e20 2023-09-30T22:28:21.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.273+0000 7fbd7777d700 1 Processor -- start 2023-09-30T22:28:21.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.273+0000 7fbd7777d700 1 -- start start 2023-09-30T22:28:21.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd7777d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd7006a770 0x7fbd7006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd7777d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd70131ec0 0x7fbd70139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd7777d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7009da80 con 0x7fbd7006b080 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd7777d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7009dce0 con 0x7fbd70131ec0 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd7777d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7009eb20 con 0x7fbd7006a770 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd74d18700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbd7006b080 0x7fbd701317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36284/0 (socket says 172.21.15.154:36284) 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd74d18700 1 -- 172.21.15.154:0/2740325777 learned_addr learned my addr 172.21.15.154:0/2740325777 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd75d1a700 1 --2- 172.21.15.154:0/2740325777 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd70131ec0 0x7fbd70139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd75519700 1 --2- 172.21.15.154:0/2740325777 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd7006a770 0x7fbd7006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd67fff700 1 -- 172.21.15.154:0/2740325777 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296075345 0 0) 0x7fbd7009da80 con 0x7fbd7006b080 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd67fff700 1 -- 172.21.15.154:0/2740325777 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd5c0035b0 con 0x7fbd7006b080 2023-09-30T22:28:21.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd75d1a700 1 -- 172.21.15.154:0/2740325777 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd7006a770 msgr2=0x7fbd7006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd75d1a700 1 --2- 172.21.15.154:0/2740325777 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd7006a770 0x7fbd7006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd75d1a700 1 -- 172.21.15.154:0/2740325777 >> v1:172.21.15.154:6789/0 conn(0x7fbd7006b080 legacy=0x7fbd701317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd75d1a700 1 -- 172.21.15.154:0/2740325777 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7009d860 con 0x7fbd70131ec0 2023-09-30T22:28:21.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.274+0000 7fbd75d1a700 1 --2- 172.21.15.154:0/2740325777 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd70131ec0 0x7fbd70139c20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009dc0 tx=0x7fbd6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc9a38f10fbb2b06 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.275+0000 7fbd67fff700 1 -- 172.21.15.154:0/2740325777 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800e070 con 0x7fbd70131ec0 2023-09-30T22:28:21.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.275+0000 7fbd67fff700 1 -- 172.21.15.154:0/2740325777 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6800bb20 con 0x7fbd70131ec0 2023-09-30T22:28:21.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.275+0000 7fbd67fff700 1 -- 172.21.15.154:0/2740325777 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68012430 con 0x7fbd70131ec0 2023-09-30T22:28:21.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.275+0000 7fbd7777d700 1 -- 172.21.15.154:0/2740325777 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd70131ec0 msgr2=0x7fbd70139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.275+0000 7fbd7777d700 1 --2- 172.21.15.154:0/2740325777 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd70131ec0 0x7fbd70139c20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009dc0 tx=0x7fbd6800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:21.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.275+0000 7fbd7777d700 1 -- 172.21.15.154:0/2740325777 shutdown_connections 2023-09-30T22:28:21.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.275+0000 7fbd7777d700 1 --2- 172.21.15.154:0/2740325777 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd70131ec0 0x7fbd70139c20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.275+0000 7fbd7777d700 1 --2- 172.21.15.154:0/2740325777 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd7006a770 0x7fbd7006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.275+0000 7fbd7777d700 1 -- 172.21.15.154:0/2740325777 >> 172.21.15.154:0/2740325777 conn(0x7fbd70099c40 msgr2=0x7fbd700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.276+0000 7fbd7777d700 1 -- 172.21.15.154:0/2740325777 shutdown_connections 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.276+0000 7fbd7777d700 1 -- 172.21.15.154:0/2740325777 wait complete. 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.276+0000 7fbd7777d700 1 Processor -- start 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd7777d700 1 -- start start 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd7777d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7006a770 0x7fbd7011b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd7777d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7006b080 0x7fbd7011b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd7777d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd70131ec0 0x7fbd701c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd7777d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7011d750 con 0x7fbd7006b080 2023-09-30T22:28:21.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd7777d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7012e4b0 con 0x7fbd7006a770 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd7777d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7011b010 con 0x7fbd70131ec0 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd74d18700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7006b080 0x7fbd7011b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd74d18700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7006b080 0x7fbd7011b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44342/0 (socket says 172.21.15.154:44342) 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd74d18700 1 -- 172.21.15.154:0/2348029750 learned_addr learned my addr 172.21.15.154:0/2348029750 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd75519700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7006a770 0x7fbd7011b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.277+0000 7fbd75d1a700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd70131ec0 0x7fbd701c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd75d1a700 1 -- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7006a770 msgr2=0x7fbd7011b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd75d1a700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7006a770 0x7fbd7011b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd75d1a700 1 -- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7006b080 msgr2=0x7fbd7011b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd75d1a700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7006b080 0x7fbd7011b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd75d1a700 1 -- 172.21.15.154:0/2348029750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd68009a70 con 0x7fbd70131ec0 2023-09-30T22:28:21.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd74d18700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7006b080 0x7fbd7011b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:21.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd75d1a700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd70131ec0 0x7fbd701c3b90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbd68016000 tx=0x7fbd68004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd65ffb700 1 -- 172.21.15.154:0/2348029750 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68012430 con 0x7fbd70131ec0 2023-09-30T22:28:21.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd65ffb700 1 -- 172.21.15.154:0/2348029750 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd68020070 con 0x7fbd70131ec0 2023-09-30T22:28:21.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd7777d700 1 -- 172.21.15.154:0/2348029750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd700a2910 con 0x7fbd70131ec0 2023-09-30T22:28:21.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd65ffb700 1 -- 172.21.15.154:0/2348029750 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68004280 con 0x7fbd70131ec0 2023-09-30T22:28:21.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.278+0000 7fbd7777d700 1 -- 172.21.15.154:0/2348029750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd70071e60 con 0x7fbd70131ec0 2023-09-30T22:28:21.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.279+0000 7fbd65ffb700 1 -- 172.21.15.154:0/2348029750 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd680043e0 con 0x7fbd70131ec0 2023-09-30T22:28:21.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.280+0000 7fbd65ffb700 1 -- 172.21.15.154:0/2348029750 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbd68022070 con 0x7fbd70131ec0 2023-09-30T22:28:21.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.280+0000 7fbd7777d700 1 -- 172.21.15.154:0/2348029750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7004f2a0 con 0x7fbd70131ec0 2023-09-30T22:28:21.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.284+0000 7fbd65ffb700 1 -- 172.21.15.154:0/2348029750 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd68003e30 con 0x7fbd70131ec0 2023-09-30T22:28:21.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.315+0000 7fda8de20700 1 Processor -- start 2023-09-30T22:28:21.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.315+0000 7fda8de20700 1 -- start start 2023-09-30T22:28:21.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda8de20700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fda8809e870 0x7fda8809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda8de20700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda88131f40 0x7fda88139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda8de20700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8809c970 con 0x7fda8809f180 2023-09-30T22:28:21.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda8de20700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda880a0920 con 0x7fda8809e870 2023-09-30T22:28:21.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda8de20700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda8809f9c0 con 0x7fda88131f40 2023-09-30T22:28:21.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda877fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fda8809e870 0x7fda8809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda877fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fda8809e870 0x7fda8809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44348/0 (socket says 172.21.15.154:44348) 2023-09-30T22:28:21.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda877fe700 1 -- 172.21.15.154:0/509992219 learned_addr learned my addr 172.21.15.154:0/509992219 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda87fff700 1 --2- 172.21.15.154:0/509992219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda88131f40 0x7fda88139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda877fe700 1 -- 172.21.15.154:0/509992219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda88131f40 msgr2=0x7fda88139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda877fe700 1 --2- 172.21.15.154:0/509992219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda88131f40 0x7fda88139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda877fe700 1 -- 172.21.15.154:0/509992219 >> v1:172.21.15.154:6789/0 conn(0x7fda8809f180 legacy=0x7fda88131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.316+0000 7fda877fe700 1 -- 172.21.15.154:0/509992219 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8809bab0 con 0x7fda8809e870 2023-09-30T22:28:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.317+0000 7fda877fe700 1 --2- 172.21.15.154:0/509992219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda8809e870 0x7fda8809ec40 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fda780098f0 tx=0x7fda78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e61ad82241a404 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.317+0000 7fda867fc700 1 -- 172.21.15.154:0/509992219 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78011830 con 0x7fda8809e870 2023-09-30T22:28:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.317+0000 7fda867fc700 1 -- 172.21.15.154:0/509992219 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda78011990 con 0x7fda8809e870 2023-09-30T22:28:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.317+0000 7fda867fc700 1 -- 172.21.15.154:0/509992219 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78011d20 con 0x7fda8809e870 2023-09-30T22:28:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.318+0000 7fda8de20700 1 -- 172.21.15.154:0/509992219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda8809e870 msgr2=0x7fda8809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.318+0000 7fda8de20700 1 --2- 172.21.15.154:0/509992219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda8809e870 0x7fda8809ec40 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fda780098f0 tx=0x7fda78009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.318+0000 7fda8de20700 1 -- 172.21.15.154:0/509992219 shutdown_connections 2023-09-30T22:28:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.318+0000 7fda8de20700 1 --2- 172.21.15.154:0/509992219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda88131f40 0x7fda88139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.318+0000 7fda8de20700 1 --2- 172.21.15.154:0/509992219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda8809e870 0x7fda8809ec40 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.318+0000 7fda8de20700 1 -- 172.21.15.154:0/509992219 >> 172.21.15.154:0/509992219 conn(0x7fda880a4430 msgr2=0x7fda880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.318+0000 7fda8de20700 1 -- 172.21.15.154:0/509992219 shutdown_connections 2023-09-30T22:28:21.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.318+0000 7fda8de20700 1 -- 172.21.15.154:0/509992219 wait complete. 2023-09-30T22:28:21.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.319+0000 7fda8de20700 1 Processor -- start 2023-09-30T22:28:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.319+0000 7fda8de20700 1 -- start start 2023-09-30T22:28:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda8de20700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda8809e870 0x7fda8811df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda8de20700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda8809f180 0x7fda8811e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda8de20700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda88131f40 0x7fda8811ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda8de20700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda88121240 con 0x7fda88131f40 2023-09-30T22:28:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda8de20700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8809dba0 con 0x7fda8809e870 2023-09-30T22:28:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda8de20700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda880a2e20 con 0x7fda8809f180 2023-09-30T22:28:21.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda86ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda8809f180 0x7fda8811e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda86ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda8809f180 0x7fda8811e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51962/0 (socket says 172.21.15.154:51962) 2023-09-30T22:28:21.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda86ffd700 1 -- 172.21.15.154:0/807411847 learned_addr learned my addr 172.21.15.154:0/807411847 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:21.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda877fe700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda8809e870 0x7fda8811df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.320+0000 7fda87fff700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda88131f40 0x7fda8811ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda877fe700 1 -- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda8809f180 msgr2=0x7fda8811e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda877fe700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda8809f180 0x7fda8811e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda877fe700 1 -- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda88131f40 msgr2=0x7fda8811ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda877fe700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda88131f40 0x7fda8811ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda877fe700 1 -- 172.21.15.154:0/807411847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78009550 con 0x7fda8809e870 2023-09-30T22:28:21.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda86ffd700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda8809f180 0x7fda8811e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:21.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda877fe700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda8809e870 0x7fda8811df90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fda78016000 tx=0x7fda78004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda6ffff700 1 -- 172.21.15.154:0/807411847 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78004510 con 0x7fda8809e870 2023-09-30T22:28:21.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda6ffff700 1 -- 172.21.15.154:0/807411847 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7801e070 con 0x7fda8809e870 2023-09-30T22:28:21.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.321+0000 7fda6ffff700 1 -- 172.21.15.154:0/807411847 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda780038a0 con 0x7fda8809e870 2023-09-30T22:28:21.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.322+0000 7fda8de20700 1 -- 172.21.15.154:0/807411847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8811fba0 con 0x7fda8809e870 2023-09-30T22:28:21.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.322+0000 7fda8de20700 1 -- 172.21.15.154:0/807411847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda88121fb0 con 0x7fda8809e870 2023-09-30T22:28:21.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.322+0000 7fda8de20700 1 -- 172.21.15.154:0/807411847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda88121470 con 0x7fda8809e870 2023-09-30T22:28:21.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.323+0000 7fda6ffff700 1 -- 172.21.15.154:0/807411847 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda78003a00 con 0x7fda8809e870 2023-09-30T22:28:21.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.323+0000 7fda6ffff700 1 -- 172.21.15.154:0/807411847 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fda78020070 con 0x7fda8809e870 2023-09-30T22:28:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.331+0000 7fda6ffff700 1 -- 172.21.15.154:0/807411847 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda7802e990 con 0x7fda8809e870 2023-09-30T22:28:21.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.351+0000 7f05465fc700 1 Processor -- start 2023-09-30T22:28:21.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.351+0000 7f05465fc700 1 -- start start 2023-09-30T22:28:21.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f05465fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009d860 0x7f054009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f05465fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f05465fc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054009aaa0 con 0x7f054009e170 2023-09-30T22:28:21.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f05465fc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054009f870 con 0x7f054009d860 2023-09-30T22:28:21.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f05465fc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f054009b360 con 0x7f0540130eb0 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f053f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f054009e170 0x7f05401307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36302/0 (socket says 172.21.15.154:36302) 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f053f7fe700 1 -- 172.21.15.154:0/424425925 learned_addr learned my addr 172.21.15.154:0/424425925 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f0544b99700 1 --2- 172.21.15.154:0/424425925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f053ffff700 1 --2- 172.21.15.154:0/424425925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009d860 0x7f054009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f053effd700 1 -- 172.21.15.154:0/424425925 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826234932 0 0) 0x7f054009aaa0 con 0x7f054009e170 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f053effd700 1 -- 172.21.15.154:0/424425925 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05280035b0 con 0x7f054009e170 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f0544b99700 1 -- 172.21.15.154:0/424425925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009d860 msgr2=0x7f054009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f0544b99700 1 --2- 172.21.15.154:0/424425925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009d860 0x7f054009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.352+0000 7f0544b99700 1 -- 172.21.15.154:0/424425925 >> v1:172.21.15.154:6789/0 conn(0x7f054009e170 legacy=0x7f05401307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.353+0000 7f0544b99700 1 -- 172.21.15.154:0/424425925 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054009b620 con 0x7f0540130eb0 2023-09-30T22:28:21.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.353+0000 7f0544b99700 1 --2- 172.21.15.154:0/424425925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540138a00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0538009dc0 tx=0x7f053800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c484cf784491bac1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.353+0000 7f053effd700 1 -- 172.21.15.154:0/424425925 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053800e070 con 0x7f0540130eb0 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.353+0000 7f053effd700 1 -- 172.21.15.154:0/424425925 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053800bb20 con 0x7f0540130eb0 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.353+0000 7f053effd700 1 -- 172.21.15.154:0/424425925 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538012430 con 0x7f0540130eb0 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.354+0000 7f05465fc700 1 -- 172.21.15.154:0/424425925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 msgr2=0x7f0540138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.354+0000 7f05465fc700 1 --2- 172.21.15.154:0/424425925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540138a00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0538009dc0 tx=0x7f053800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.354+0000 7f05465fc700 1 -- 172.21.15.154:0/424425925 shutdown_connections 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.354+0000 7f05465fc700 1 --2- 172.21.15.154:0/424425925 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540138a00 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.354+0000 7f05465fc700 1 --2- 172.21.15.154:0/424425925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009d860 0x7f054009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.354+0000 7f05465fc700 1 -- 172.21.15.154:0/424425925 >> 172.21.15.154:0/424425925 conn(0x7f0540099c40 msgr2=0x7f05400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.354+0000 7f05465fc700 1 -- 172.21.15.154:0/424425925 shutdown_connections 2023-09-30T22:28:21.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.354+0000 7f05465fc700 1 -- 172.21.15.154:0/424425925 wait complete. 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.355+0000 7f05465fc700 1 Processor -- start 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.355+0000 7f05465fc700 1 -- start start 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.355+0000 7f05465fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f054009d860 0x7f054012f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.355+0000 7f05465fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009e170 0x7f054012fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.355+0000 7f05465fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540130210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.355+0000 7f05465fc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05401390f0 con 0x7f054009d860 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.355+0000 7f05465fc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0540138ad0 con 0x7f054009e170 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.355+0000 7f05465fc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05400a0600 con 0x7f0540130eb0 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f053f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009e170 0x7f054012fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f0544b99700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540130210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f0544b99700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540130210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51978/0 (socket says 172.21.15.154:51978) 2023-09-30T22:28:21.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f0544b99700 1 -- 172.21.15.154:0/755379752 learned_addr learned my addr 172.21.15.154:0/755379752 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f053f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009e170 0x7f054012fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34916/0 (socket says 172.21.15.154:34916) 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f053ffff700 1 --2- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f054009d860 0x7f054012f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f0544b99700 1 -- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009e170 msgr2=0x7f054012fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f0544b99700 1 --2- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009e170 0x7f054012fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f0544b99700 1 -- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f054009d860 msgr2=0x7f054012f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f0544b99700 1 --2- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f054009d860 0x7f054012f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f0544b99700 1 -- 172.21.15.154:0/755379752 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538009a70 con 0x7f0540130eb0 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.356+0000 7f0544b99700 1 --2- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540130210 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0538014040 tx=0x7f0538004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.357+0000 7f053cff9700 1 -- 172.21.15.154:0/755379752 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538012430 con 0x7f0540130eb0 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.357+0000 7f053cff9700 1 -- 172.21.15.154:0/755379752 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0538020070 con 0x7f0540130eb0 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.357+0000 7f053cff9700 1 -- 172.21.15.154:0/755379752 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538003e30 con 0x7f0540130eb0 2023-09-30T22:28:21.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.357+0000 7f05465fc700 1 -- 172.21.15.154:0/755379752 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540138e30 con 0x7f0540130eb0 2023-09-30T22:28:21.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.357+0000 7f05465fc700 1 -- 172.21.15.154:0/755379752 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0540139b60 con 0x7f0540130eb0 2023-09-30T22:28:21.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.358+0000 7f053cff9700 1 -- 172.21.15.154:0/755379752 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0538004040 con 0x7f0540130eb0 2023-09-30T22:28:21.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.358+0000 7f053cff9700 1 -- 172.21.15.154:0/755379752 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0538022070 con 0x7f0540130eb0 2023-09-30T22:28:21.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.358+0000 7f05465fc700 1 -- 172.21.15.154:0/755379752 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054004f2a0 con 0x7f0540130eb0 2023-09-30T22:28:21.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.367+0000 7f053cff9700 1 -- 172.21.15.154:0/755379752 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0538011980 con 0x7f0540130eb0 2023-09-30T22:28:21.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.435+0000 7f0aa6a50700 1 -- 172.21.15.154:0/1765246297 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a80005590 con 0x7f0aa0099e20 2023-09-30T22:28:21.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.436+0000 7f0a9cff9700 1 -- 172.21.15.154:0/1765246297 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a900323f0 con 0x7f0aa0099e20 2023-09-30T22:28:21.436 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.438+0000 7f0aa6a50700 1 -- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa0099e20 msgr2=0x7f0aa0118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.438+0000 7f0aa6a50700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa0099e20 0x7f0aa0118df0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0a90000c00 tx=0x7f0a90004750 comp rx=0 tx=0).stop 2023-09-30T22:28:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.438+0000 7f0aa6a50700 1 -- 172.21.15.154:0/1765246297 shutdown_connections 2023-09-30T22:28:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.438+0000 7f0aa6a50700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0aa0130890 0x7f0aa0119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.438+0000 7f0aa6a50700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa0099e20 0x7f0aa0118df0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.438+0000 7f0aa6a50700 1 --2- 172.21.15.154:0/1765246297 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa009a730 0x7f0aa0119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.438+0000 7f0aa6a50700 1 -- 172.21.15.154:0/1765246297 >> 172.21.15.154:0/1765246297 conn(0x7f0aa00a2980 msgr2=0x7f0aa012d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.438+0000 7f0aa6a50700 1 -- 172.21.15.154:0/1765246297 shutdown_connections 2023-09-30T22:28:21.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.438+0000 7f0aa6a50700 1 -- 172.21.15.154:0/1765246297 wait complete. 2023-09-30T22:28:21.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.488+0000 7fbd7777d700 1 -- 172.21.15.154:0/2348029750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbd7006c3b0 con 0x7fbd70131ec0 2023-09-30T22:28:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.488+0000 7fbd65ffb700 1 -- 172.21.15.154:0/2348029750 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd680263e0 con 0x7fbd70131ec0 2023-09-30T22:28:21.489 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.490+0000 7fbd7777d700 1 -- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd70131ec0 msgr2=0x7fbd701c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.490+0000 7fbd7777d700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd70131ec0 0x7fbd701c3b90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbd68016000 tx=0x7fbd68004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.490+0000 7fbd7777d700 1 -- 172.21.15.154:0/2348029750 shutdown_connections 2023-09-30T22:28:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.490+0000 7fbd7777d700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fbd70131ec0 0x7fbd701c3b90 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.490+0000 7fbd7777d700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7006a770 0x7fbd7011b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.490+0000 7fbd7777d700 1 --2- 172.21.15.154:0/2348029750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd7006b080 0x7fbd7011b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.490+0000 7fbd7777d700 1 -- 172.21.15.154:0/2348029750 >> 172.21.15.154:0/2348029750 conn(0x7fbd70099c40 msgr2=0x7fbd7012fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.490+0000 7fbd7777d700 1 -- 172.21.15.154:0/2348029750 shutdown_connections 2023-09-30T22:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.490+0000 7fbd7777d700 1 -- 172.21.15.154:0/2348029750 wait complete. 2023-09-30T22:28:21.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.527+0000 7fda8de20700 1 -- 172.21.15.154:0/807411847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fda88121650 con 0x7fda8809e870 2023-09-30T22:28:21.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.527+0000 7fda6ffff700 1 -- 172.21.15.154:0/807411847 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda7802a070 con 0x7fda8809e870 2023-09-30T22:28:21.527 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:21.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.529+0000 7fda8de20700 1 -- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda8809e870 msgr2=0x7fda8811df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.529+0000 7fda8de20700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda8809e870 0x7fda8811df90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fda78016000 tx=0x7fda78004750 comp rx=0 tx=0).stop 2023-09-30T22:28:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.529+0000 7fda8de20700 1 -- 172.21.15.154:0/807411847 shutdown_connections 2023-09-30T22:28:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.529+0000 7fda8de20700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda88131f40 0x7fda8811ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.529+0000 7fda8de20700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda8809e870 0x7fda8811df90 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.529+0000 7fda8de20700 1 --2- 172.21.15.154:0/807411847 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda8809f180 0x7fda8811e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.529+0000 7fda8de20700 1 -- 172.21.15.154:0/807411847 >> 172.21.15.154:0/807411847 conn(0x7fda880a4430 msgr2=0x7fda8806d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.530+0000 7fda8de20700 1 -- 172.21.15.154:0/807411847 shutdown_connections 2023-09-30T22:28:21.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.530+0000 7fda8de20700 1 -- 172.21.15.154:0/807411847 wait complete. 2023-09-30T22:28:21.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:21.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.563+0000 7f05465fc700 1 -- 172.21.15.154:0/755379752 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f054009c8b0 con 0x7f0540130eb0 2023-09-30T22:28:21.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.564+0000 7f053cff9700 1 -- 172.21.15.154:0/755379752 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0538035070 con 0x7f0540130eb0 2023-09-30T22:28:21.564 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:21.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.566+0000 7f05465fc700 1 -- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 msgr2=0x7f0540130210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:21.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.566+0000 7f05465fc700 1 --2- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540130210 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0538014040 tx=0x7f0538004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.566+0000 7f05465fc700 1 -- 172.21.15.154:0/755379752 shutdown_connections 2023-09-30T22:28:21.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.566+0000 7f05465fc700 1 --2- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0540130eb0 0x7f0540130210 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.566+0000 7f05465fc700 1 --2- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f054009d860 0x7f054012f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.566+0000 7f05465fc700 1 --2- 172.21.15.154:0/755379752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f054009e170 0x7f054012fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:21.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.566+0000 7f05465fc700 1 -- 172.21.15.154:0/755379752 >> 172.21.15.154:0/755379752 conn(0x7f0540099c40 msgr2=0x7f054013b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:21.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.566+0000 7f05465fc700 1 -- 172.21.15.154:0/755379752 shutdown_connections 2023-09-30T22:28:21.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:21.566+0000 7f05465fc700 1 -- 172.21.15.154:0/755379752 wait complete. 2023-09-30T22:28:21.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:22.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:22.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:22.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:22.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:22.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.593+0000 7f3b58573700 1 Processor -- start 2023-09-30T22:28:22.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.593+0000 7f3b58573700 1 -- start start 2023-09-30T22:28:22.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b58573700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b5006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b58573700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 0x7f3b5006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b58573700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5006b5c0 con 0x7f3b50131a00 2023-09-30T22:28:22.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b58573700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5006e900 con 0x7f3b5009dec0 2023-09-30T22:28:22.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b58573700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5009d180 con 0x7f3b5006a770 2023-09-30T22:28:22.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b5630f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b5006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b5630f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b5006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51982/0 (socket says 172.21.15.154:51982) 2023-09-30T22:28:22.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b5630f700 1 -- 172.21.15.154:0/1006373954 learned_addr learned my addr 172.21.15.154:0/1006373954 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:22.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b55b0e700 1 --2- 172.21.15.154:0/1006373954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 0x7f3b5006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b5630f700 1 -- 172.21.15.154:0/1006373954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 msgr2=0x7f3b5006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b5630f700 1 --2- 172.21.15.154:0/1006373954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 0x7f3b5006b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b5630f700 1 -- 172.21.15.154:0/1006373954 >> v1:172.21.15.154:6789/0 conn(0x7f3b50131a00 legacy=0x7f3b50131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b5630f700 1 -- 172.21.15.154:0/1006373954 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5009e780 con 0x7f3b5006a770 2023-09-30T22:28:22.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.594+0000 7f3b5530d700 1 -- 172.21.15.154:0/1006373954 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899396968 0 0) 0x7f3b5006b5c0 con 0x7f3b50131a00 2023-09-30T22:28:22.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.595+0000 7f3b5630f700 1 --2- 172.21.15.154:0/1006373954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b5006ab40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009920 tx=0x7f3b4c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2606f5118d6b75dd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.595+0000 7f3b5530d700 1 -- 172.21.15.154:0/1006373954 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011830 con 0x7f3b5006a770 2023-09-30T22:28:22.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.595+0000 7f3b5530d700 1 -- 172.21.15.154:0/1006373954 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c011990 con 0x7f3b5006a770 2023-09-30T22:28:22.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.595+0000 7f3b5530d700 1 -- 172.21.15.154:0/1006373954 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011d20 con 0x7f3b5006a770 2023-09-30T22:28:22.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.596+0000 7f3b58573700 1 -- 172.21.15.154:0/1006373954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 msgr2=0x7f3b5006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.596+0000 7f3b58573700 1 --2- 172.21.15.154:0/1006373954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b5006ab40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009920 tx=0x7f3b4c009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:22.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.596+0000 7f3b58573700 1 -- 172.21.15.154:0/1006373954 shutdown_connections 2023-09-30T22:28:22.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.596+0000 7f3b58573700 1 --2- 172.21.15.154:0/1006373954 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b5006ab40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.596+0000 7f3b58573700 1 --2- 172.21.15.154:0/1006373954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 0x7f3b5006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.596+0000 7f3b58573700 1 -- 172.21.15.154:0/1006373954 >> 172.21.15.154:0/1006373954 conn(0x7f3b50099c40 msgr2=0x7f3b500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.596+0000 7f3b58573700 1 -- 172.21.15.154:0/1006373954 shutdown_connections 2023-09-30T22:28:22.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.596+0000 7f3b58573700 1 -- 172.21.15.154:0/1006373954 wait complete. 2023-09-30T22:28:22.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.597+0000 7f3b58573700 1 Processor -- start 2023-09-30T22:28:22.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.597+0000 7f3b58573700 1 -- start start 2023-09-30T22:28:22.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b58573700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b50119ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b58573700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 0x7f3b5011a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b58573700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b50131a00 0x7f3b5011aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b58573700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5011d210 con 0x7f3b50131a00 2023-09-30T22:28:22.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b58573700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50071ce0 con 0x7f3b5009dec0 2023-09-30T22:28:22.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b58573700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50130f20 con 0x7f3b5006a770 2023-09-30T22:28:22.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b5630f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b50119ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b55b0e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 0x7f3b5011a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b5630f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b50119ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51996/0 (socket says 172.21.15.154:51996) 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b5630f700 1 -- 172.21.15.154:0/3208434170 learned_addr learned my addr 172.21.15.154:0/3208434170 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.598+0000 7f3b56b10700 1 --2- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b50131a00 0x7f3b5011aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b55b0e700 1 -- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 msgr2=0x7f3b50119ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b55b0e700 1 --2- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b50119ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b55b0e700 1 -- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b50131a00 msgr2=0x7f3b5011aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b55b0e700 1 --2- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b50131a00 0x7f3b5011aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b55b0e700 1 -- 172.21.15.154:0/3208434170 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c009550 con 0x7f3b5009dec0 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b55b0e700 1 --2- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 0x7f3b5011a530 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000e900 tx=0x7f3b4000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b46ffd700 1 -- 172.21.15.154:0/3208434170 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40013680 con 0x7f3b5009dec0 2023-09-30T22:28:22.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b46ffd700 1 -- 172.21.15.154:0/3208434170 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b400137e0 con 0x7f3b5009dec0 2023-09-30T22:28:22.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b58573700 1 -- 172.21.15.154:0/3208434170 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5011bb70 con 0x7f3b5009dec0 2023-09-30T22:28:22.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b46ffd700 1 -- 172.21.15.154:0/3208434170 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40013b50 con 0x7f3b5009dec0 2023-09-30T22:28:22.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.599+0000 7f3b58573700 1 -- 172.21.15.154:0/3208434170 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5011df80 con 0x7f3b5009dec0 2023-09-30T22:28:22.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.600+0000 7f3b46ffd700 1 -- 172.21.15.154:0/3208434170 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b40013cb0 con 0x7f3b5009dec0 2023-09-30T22:28:22.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.601+0000 7f3b58573700 1 -- 172.21.15.154:0/3208434170 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5011d440 con 0x7f3b5009dec0 2023-09-30T22:28:22.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.601+0000 7f3b46ffd700 1 -- 172.21.15.154:0/3208434170 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b4003f870 con 0x7f3b5009dec0 2023-09-30T22:28:22.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.606+0000 7f3b46ffd700 1 -- 172.21.15.154:0/3208434170 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b5011d440 con 0x7f3b5009dec0 2023-09-30T22:28:22.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.642+0000 7f336e6b8700 1 Processor -- start 2023-09-30T22:28:22.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.642+0000 7f336e6b8700 1 -- start start 2023-09-30T22:28:22.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.642+0000 7f336e6b8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f336809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.642+0000 7f336e6b8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f336809f180 0x7f3368131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.642+0000 7f336e6b8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3368131d70 0x7f3368132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.642+0000 7f336e6b8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33680a0920 con 0x7f336809f180 2023-09-30T22:28:22.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.642+0000 7f336e6b8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336809c970 con 0x7f336809e870 2023-09-30T22:28:22.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.642+0000 7f336e6b8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f336809bab0 con 0x7f3368131d70 2023-09-30T22:28:22.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f336cc55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3368131d70 0x7f3368132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f336cc55700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3368131d70 0x7f3368132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:51998/0 (socket says 172.21.15.154:51998) 2023-09-30T22:28:22.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f336cc55700 1 -- 172.21.15.154:0/1537094801 learned_addr learned my addr 172.21.15.154:0/1537094801 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:22.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f3367fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f336809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f33677fe700 1 --2- 172.21.15.154:0/1537094801 >> v2:172.21.15.154:3300/0 conn(0x7f336809f180 0x7f3368131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f336cc55700 1 -- 172.21.15.154:0/1537094801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 msgr2=0x7f336809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f336cc55700 1 --2- 172.21.15.154:0/1537094801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f336809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f336cc55700 1 -- 172.21.15.154:0/1537094801 >> v2:172.21.15.154:3300/0 conn(0x7f336809f180 msgr2=0x7f3368131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f336cc55700 1 --2- 172.21.15.154:0/1537094801 >> v2:172.21.15.154:3300/0 conn(0x7f336809f180 0x7f3368131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f336cc55700 1 -- 172.21.15.154:0/1537094801 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336809f9c0 con 0x7f3368131d70 2023-09-30T22:28:22.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f3367fff700 1 --2- 172.21.15.154:0/1537094801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f336809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:22.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f33677fe700 1 --2- 172.21.15.154:0/1537094801 >> v2:172.21.15.154:3300/0 conn(0x7f336809f180 0x7f3368131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:22.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f336cc55700 1 --2- 172.21.15.154:0/1537094801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3368131d70 0x7f3368132210 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3360009e50 tx=0x7f336000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95ca82956d5ea4e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f3366ffd700 1 -- 172.21.15.154:0/1537094801 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336000e070 con 0x7f3368131d70 2023-09-30T22:28:22.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f3366ffd700 1 -- 172.21.15.154:0/1537094801 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336000b910 con 0x7f3368131d70 2023-09-30T22:28:22.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.643+0000 7f3366ffd700 1 -- 172.21.15.154:0/1537094801 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336000bcc0 con 0x7f3368131d70 2023-09-30T22:28:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.644+0000 7f336e6b8700 1 -- 172.21.15.154:0/1537094801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3368131d70 msgr2=0x7f3368132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.644+0000 7f336e6b8700 1 --2- 172.21.15.154:0/1537094801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3368131d70 0x7f3368132210 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3360009e50 tx=0x7f336000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.644+0000 7f336e6b8700 1 -- 172.21.15.154:0/1537094801 shutdown_connections 2023-09-30T22:28:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.644+0000 7f336e6b8700 1 --2- 172.21.15.154:0/1537094801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f336809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.644+0000 7f336e6b8700 1 --2- 172.21.15.154:0/1537094801 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3368131d70 0x7f3368132210 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.644+0000 7f336e6b8700 1 --2- 172.21.15.154:0/1537094801 >> v2:172.21.15.154:3300/0 conn(0x7f336809f180 0x7f3368131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.644+0000 7f336e6b8700 1 -- 172.21.15.154:0/1537094801 >> 172.21.15.154:0/1537094801 conn(0x7f33680a4430 msgr2=0x7f33680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.644+0000 7f336e6b8700 1 -- 172.21.15.154:0/1537094801 shutdown_connections 2023-09-30T22:28:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.644+0000 7f336e6b8700 1 -- 172.21.15.154:0/1537094801 wait complete. 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.645+0000 7f336e6b8700 1 Processor -- start 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.645+0000 7f336e6b8700 1 -- start start 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f336e6b8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f3368120300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f336e6b8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f336809f180 0x7f3368120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f336e6b8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3368131d70 0x7f3368120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f336e6b8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3368123a70 con 0x7f3368131d70 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f336e6b8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3368122cf0 con 0x7f336809e870 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f336e6b8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3368123840 con 0x7f336809f180 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f3367fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f3368120300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f3367fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f3368120300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34956/0 (socket says 172.21.15.154:34956) 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f3367fff700 1 -- 172.21.15.154:0/1188562591 learned_addr learned my addr 172.21.15.154:0/1188562591 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f336cc55700 1 --2- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3368131d70 0x7f3368120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f3367fff700 1 -- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f336809f180 msgr2=0x7f3368120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f3367fff700 1 --2- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f336809f180 0x7f3368120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f3367fff700 1 -- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3368131d70 msgr2=0x7f3368120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f3367fff700 1 --2- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3368131d70 0x7f3368120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.646+0000 7f3367fff700 1 -- 172.21.15.154:0/1188562591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33580094a0 con 0x7f336809e870 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.647+0000 7f3367fff700 1 --2- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f3368120300 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f335800ebe0 tx=0x7f335800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.647+0000 7f3364ff9700 1 -- 172.21.15.154:0/1188562591 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335800c850 con 0x7f336809e870 2023-09-30T22:28:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.647+0000 7f3364ff9700 1 -- 172.21.15.154:0/1188562591 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335800c9b0 con 0x7f336809e870 2023-09-30T22:28:22.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.647+0000 7f336e6b8700 1 -- 172.21.15.154:0/1188562591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c0094a0 con 0x7f336809e870 2023-09-30T22:28:22.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.647+0000 7f3364ff9700 1 -- 172.21.15.154:0/1188562591 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335800cd20 con 0x7f336809e870 2023-09-30T22:28:22.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.647+0000 7f336e6b8700 1 -- 172.21.15.154:0/1188562591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3360009b30 con 0x7f336809e870 2023-09-30T22:28:22.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.648+0000 7f3364ff9700 1 -- 172.21.15.154:0/1188562591 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3358013470 con 0x7f336809e870 2023-09-30T22:28:22.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.648+0000 7f336e6b8700 1 -- 172.21.15.154:0/1188562591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33680a0210 con 0x7f336809e870 2023-09-30T22:28:22.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.648+0000 7f3364ff9700 1 -- 172.21.15.154:0/1188562591 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f335803f810 con 0x7f336809e870 2023-09-30T22:28:22.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.653+0000 7f3364ff9700 1 -- 172.21.15.154:0/1188562591 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3358013720 con 0x7f336809e870 2023-09-30T22:28:22.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.682+0000 7fd6053a9700 1 Processor -- start 2023-09-30T22:28:22.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.682+0000 7fd6053a9700 1 -- start start 2023-09-30T22:28:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd6053a9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009e870 0x7fd60009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd6053a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009f180 0x7fd600131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd6053a9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60009c970 con 0x7fd600131d70 2023-09-30T22:28:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd6053a9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000a0920 con 0x7fd60009e870 2023-09-30T22:28:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd6053a9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60009f9c0 con 0x7fd60009f180 2023-09-30T22:28:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd5feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009e870 0x7fd60009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd5feffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009e870 0x7fd60009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34968/0 (socket says 172.21.15.154:34968) 2023-09-30T22:28:22.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd5feffd700 1 -- 172.21.15.154:0/2677057578 learned_addr learned my addr 172.21.15.154:0/2677057578 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:22.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd5fe7fc700 1 --2- 172.21.15.154:0/2677057578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009f180 0x7fd600131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd5fe7fc700 1 -- 172.21.15.154:0/2677057578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009e870 msgr2=0x7fd60009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd5fe7fc700 1 --2- 172.21.15.154:0/2677057578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009e870 0x7fd60009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd5fe7fc700 1 -- 172.21.15.154:0/2677057578 >> v1:172.21.15.154:6789/0 conn(0x7fd600131d70 legacy=0x7fd600138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.683+0000 7fd5fe7fc700 1 -- 172.21.15.154:0/2677057578 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60009bab0 con 0x7fd60009f180 2023-09-30T22:28:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.684+0000 7fd5fe7fc700 1 --2- 172.21.15.154:0/2677057578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009f180 0x7fd600131830 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009870 tx=0x7fd5f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b05b45b7af9e99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.684+0000 7fd5fdffb700 1 -- 172.21.15.154:0/2677057578 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011830 con 0x7fd60009f180 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.684+0000 7fd5fdffb700 1 -- 172.21.15.154:0/2677057578 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4011990 con 0x7fd60009f180 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.684+0000 7fd5fdffb700 1 -- 172.21.15.154:0/2677057578 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011d20 con 0x7fd60009f180 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.684+0000 7fd6053a9700 1 -- 172.21.15.154:0/2677057578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009f180 msgr2=0x7fd600131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.684+0000 7fd6053a9700 1 --2- 172.21.15.154:0/2677057578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009f180 0x7fd600131830 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009870 tx=0x7fd5f4009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.685+0000 7fd6053a9700 1 -- 172.21.15.154:0/2677057578 shutdown_connections 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.685+0000 7fd6053a9700 1 --2- 172.21.15.154:0/2677057578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009e870 0x7fd60009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.685+0000 7fd6053a9700 1 --2- 172.21.15.154:0/2677057578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009f180 0x7fd600131830 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.685+0000 7fd6053a9700 1 -- 172.21.15.154:0/2677057578 >> 172.21.15.154:0/2677057578 conn(0x7fd6000a4430 msgr2=0x7fd6000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.685+0000 7fd6053a9700 1 -- 172.21.15.154:0/2677057578 shutdown_connections 2023-09-30T22:28:22.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.685+0000 7fd6053a9700 1 -- 172.21.15.154:0/2677057578 wait complete. 2023-09-30T22:28:22.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd6053a9700 1 Processor -- start 2023-09-30T22:28:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd6053a9700 1 -- start start 2023-09-30T22:28:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd6053a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009e870 0x7fd600120290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd6053a9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009f180 0x7fd6001207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd6053a9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd600131d70 0x7fd600120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd6053a9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd600122c90 con 0x7fd600131d70 2023-09-30T22:28:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd6053a9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd600121f80 con 0x7fd60009f180 2023-09-30T22:28:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd6053a9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd600121d90 con 0x7fd60009e870 2023-09-30T22:28:22.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd5fe7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009f180 0x7fd6001207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd5fe7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009f180 0x7fd6001207d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34978/0 (socket says 172.21.15.154:34978) 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd5fe7fc700 1 -- 172.21.15.154:0/913250635 learned_addr learned my addr 172.21.15.154:0/913250635 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.686+0000 7fd5feffd700 1 --2- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009e870 0x7fd600120290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5ff7fe700 1 --2- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd600131d70 0x7fd600120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5fe7fc700 1 -- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009e870 msgr2=0x7fd600120290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5fe7fc700 1 --2- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009e870 0x7fd600120290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5fe7fc700 1 -- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd600131d70 msgr2=0x7fd600120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5fe7fc700 1 --2- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd600131d70 0x7fd600120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5fe7fc700 1 -- 172.21.15.154:0/913250635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40094a0 con 0x7fd60009f180 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5fe7fc700 1 --2- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009f180 0x7fd6001207d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009bc0 tx=0x7fd5f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5e77fe700 1 -- 172.21.15.154:0/913250635 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4004450 con 0x7fd60009f180 2023-09-30T22:28:22.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5e77fe700 1 -- 172.21.15.154:0/913250635 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f401f070 con 0x7fd60009f180 2023-09-30T22:28:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd6053a9700 1 -- 172.21.15.154:0/913250635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60009dba0 con 0x7fd60009f180 2023-09-30T22:28:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd5e77fe700 1 -- 172.21.15.154:0/913250635 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40038e0 con 0x7fd60009f180 2023-09-30T22:28:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.687+0000 7fd6053a9700 1 -- 172.21.15.154:0/913250635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd600122fe0 con 0x7fd60009f180 2023-09-30T22:28:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.689+0000 7fd5e77fe700 1 -- 172.21.15.154:0/913250635 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5f4003a40 con 0x7fd60009f180 2023-09-30T22:28:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.689+0000 7fd6053a9700 1 -- 172.21.15.154:0/913250635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd600123430 con 0x7fd60009f180 2023-09-30T22:28:22.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.689+0000 7fd5e77fe700 1 -- 172.21.15.154:0/913250635 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5f4021070 con 0x7fd60009f180 2023-09-30T22:28:22.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.697+0000 7fd5e77fe700 1 -- 172.21.15.154:0/913250635 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5f4010380 con 0x7fd60009f180 2023-09-30T22:28:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.727+0000 7f1a9559a700 1 Processor -- start 2023-09-30T22:28:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.727+0000 7f1a9559a700 1 -- start start 2023-09-30T22:28:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.727+0000 7f1a9559a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a901350d0 0x7f1a9013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.727+0000 7f1a9559a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9013d210 0x7f1a9013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a9559a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9009eca0 con 0x7f1a9006a770 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a9559a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9006b2e0 con 0x7f1a9013d210 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a9559a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9009f720 con 0x7f1a901350d0 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a901350d0 0x7f1a9013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8e7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a901350d0 0x7f1a9013ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52038/0 (socket says 172.21.15.154:52038) 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8e7fc700 1 -- 172.21.15.154:0/1524146140 learned_addr learned my addr 172.21.15.154:0/1524146140 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8f7fe700 1 --2- 172.21.15.154:0/1524146140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9013d210 0x7f1a9013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8e7fc700 1 -- 172.21.15.154:0/1524146140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9013d210 msgr2=0x7f1a9013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8e7fc700 1 --2- 172.21.15.154:0/1524146140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9013d210 0x7f1a9013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8e7fc700 1 -- 172.21.15.154:0/1524146140 >> v1:172.21.15.154:6789/0 conn(0x7f1a9006a770 legacy=0x7f1a901349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8e7fc700 1 -- 172.21.15.154:0/1524146140 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9006b480 con 0x7f1a901350d0 2023-09-30T22:28:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8e7fc700 1 --2- 172.21.15.154:0/1524146140 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a901350d0 0x7f1a9013ccd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009950 tx=0x7f1a84009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1cfc877b9a81e45 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.728+0000 7f1a8dffb700 1 -- 172.21.15.154:0/1524146140 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84009ea0 con 0x7f1a901350d0 2023-09-30T22:28:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a8dffb700 1 -- 172.21.15.154:0/1524146140 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a84004230 con 0x7f1a901350d0 2023-09-30T22:28:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a8dffb700 1 -- 172.21.15.154:0/1524146140 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a840045a0 con 0x7f1a901350d0 2023-09-30T22:28:22.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a9559a700 1 -- 172.21.15.154:0/1524146140 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a901350d0 msgr2=0x7f1a9013ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a9559a700 1 --2- 172.21.15.154:0/1524146140 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a901350d0 0x7f1a9013ccd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009950 tx=0x7f1a84009c60 comp rx=0 tx=0).stop 2023-09-30T22:28:22.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a9559a700 1 -- 172.21.15.154:0/1524146140 shutdown_connections 2023-09-30T22:28:22.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a9559a700 1 --2- 172.21.15.154:0/1524146140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9013d210 0x7f1a9013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a9559a700 1 --2- 172.21.15.154:0/1524146140 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a901350d0 0x7f1a9013ccd0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a9559a700 1 -- 172.21.15.154:0/1524146140 >> 172.21.15.154:0/1524146140 conn(0x7f1a90099c40 msgr2=0x7f1a900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a9559a700 1 -- 172.21.15.154:0/1524146140 shutdown_connections 2023-09-30T22:28:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.729+0000 7f1a9559a700 1 -- 172.21.15.154:0/1524146140 wait complete. 2023-09-30T22:28:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a9559a700 1 Processor -- start 2023-09-30T22:28:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a9559a700 1 -- start start 2023-09-30T22:28:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a9559a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9006a770 0x7f1a90132c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a9559a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a901350d0 0x7f1a901331a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a9559a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a9013d210 0x7f1a901336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:22.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a9559a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90071260 con 0x7f1a901350d0 2023-09-30T22:28:22.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a9559a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9013f600 con 0x7f1a9006a770 2023-09-30T22:28:22.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a9559a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90139760 con 0x7f1a9013d210 2023-09-30T22:28:22.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a8f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a9013d210 0x7f1a901336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a8e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a901350d0 0x7f1a901331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a8f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a9013d210 0x7f1a901336e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52048/0 (socket says 172.21.15.154:52048) 2023-09-30T22:28:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a8f7fe700 1 -- 172.21.15.154:0/1451281429 learned_addr learned my addr 172.21.15.154:0/1451281429 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.731+0000 7f1a8e7fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a901350d0 0x7f1a901331a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44410/0 (socket says 172.21.15.154:44410) 2023-09-30T22:28:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a8effd700 1 --2- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9006a770 0x7f1a90132c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a8f7fe700 1 -- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9006a770 msgr2=0x7f1a90132c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a8f7fe700 1 --2- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9006a770 0x7f1a90132c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a8f7fe700 1 -- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a901350d0 msgr2=0x7f1a901331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a8f7fe700 1 --2- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a901350d0 0x7f1a901331a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a8f7fe700 1 -- 172.21.15.154:0/1451281429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84009550 con 0x7f1a9013d210 2023-09-30T22:28:22.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a8e7fc700 1 --2- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a901350d0 0x7f1a901331a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:22.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a8f7fe700 1 --2- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a9013d210 0x7f1a901336e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1a88007e70 tx=0x7f1a8800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:22.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a777fe700 1 -- 172.21.15.154:0/1451281429 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800ed30 con 0x7f1a9013d210 2023-09-30T22:28:22.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a777fe700 1 -- 172.21.15.154:0/1451281429 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8800eeb0 con 0x7f1a9013d210 2023-09-30T22:28:22.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a9559a700 1 -- 172.21.15.154:0/1451281429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a90133fc0 con 0x7f1a9013d210 2023-09-30T22:28:22.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a777fe700 1 -- 172.21.15.154:0/1451281429 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88014640 con 0x7f1a9013d210 2023-09-30T22:28:22.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.732+0000 7f1a9559a700 1 -- 172.21.15.154:0/1451281429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a900722e0 con 0x7f1a9013d210 2023-09-30T22:28:22.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.733+0000 7f1a9559a700 1 -- 172.21.15.154:0/1451281429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a901395c0 con 0x7f1a9013d210 2023-09-30T22:28:22.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.733+0000 7f1a777fe700 1 -- 172.21.15.154:0/1451281429 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a880147a0 con 0x7f1a9013d210 2023-09-30T22:28:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.734+0000 7f1a777fe700 1 -- 172.21.15.154:0/1451281429 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a8803fd30 con 0x7f1a9013d210 2023-09-30T22:28:22.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.742+0000 7f1a777fe700 1 -- 172.21.15.154:0/1451281429 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a901395c0 con 0x7f1a9013d210 2023-09-30T22:28:22.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.813+0000 7f3b58573700 1 -- 172.21.15.154:0/3208434170 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b5011d440 con 0x7f3b5009dec0 2023-09-30T22:28:22.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.813+0000 7f3b46ffd700 1 -- 172.21.15.154:0/3208434170 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b5011d440 con 0x7f3b5009dec0 2023-09-30T22:28:22.814 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:22.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.815+0000 7f3b58573700 1 -- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 msgr2=0x7f3b5011a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.815+0000 7f3b58573700 1 --2- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 0x7f3b5011a530 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000e900 tx=0x7f3b4000ec10 comp rx=0 tx=0).stop 2023-09-30T22:28:22.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.815+0000 7f3b58573700 1 -- 172.21.15.154:0/3208434170 shutdown_connections 2023-09-30T22:28:22.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.815+0000 7f3b58573700 1 --2- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b50131a00 0x7f3b5011aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.815+0000 7f3b58573700 1 --2- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3b5006a770 0x7f3b50119ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.815+0000 7f3b58573700 1 --2- 172.21.15.154:0/3208434170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b5009dec0 0x7f3b5011a530 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.815+0000 7f3b58573700 1 -- 172.21.15.154:0/3208434170 >> 172.21.15.154:0/3208434170 conn(0x7f3b50099c40 msgr2=0x7f3b5012ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.815+0000 7f3b58573700 1 -- 172.21.15.154:0/3208434170 shutdown_connections 2023-09-30T22:28:22.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.815+0000 7f3b58573700 1 -- 172.21.15.154:0/3208434170 wait complete. 2023-09-30T22:28:22.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.849+0000 7f336e6b8700 1 -- 172.21.15.154:0/1188562591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f336809b0e0 con 0x7f336809e870 2023-09-30T22:28:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.850+0000 7f3364ff9700 1 -- 172.21.15.154:0/1188562591 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3358017070 con 0x7f336809e870 2023-09-30T22:28:22.851 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.852+0000 7f336e6b8700 1 -- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 msgr2=0x7f3368120300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.852+0000 7f336e6b8700 1 --2- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f3368120300 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f335800ebe0 tx=0x7f335800eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.852+0000 7f336e6b8700 1 -- 172.21.15.154:0/1188562591 shutdown_connections 2023-09-30T22:28:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.852+0000 7f336e6b8700 1 --2- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3368131d70 0x7f3368120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.852+0000 7f336e6b8700 1 --2- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336809e870 0x7f3368120300 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.852+0000 7f336e6b8700 1 --2- 172.21.15.154:0/1188562591 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f336809f180 0x7f3368120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.852+0000 7f336e6b8700 1 -- 172.21.15.154:0/1188562591 >> 172.21.15.154:0/1188562591 conn(0x7f33680a4430 msgr2=0x7f336806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.852+0000 7f336e6b8700 1 -- 172.21.15.154:0/1188562591 shutdown_connections 2023-09-30T22:28:22.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.852+0000 7f336e6b8700 1 -- 172.21.15.154:0/1188562591 wait complete. 2023-09-30T22:28:22.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:22.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.894+0000 7fd6053a9700 1 -- 172.21.15.154:0/913250635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd60004f2a0 con 0x7fd60009f180 2023-09-30T22:28:22.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.895+0000 7fd5e77fe700 1 -- 172.21.15.154:0/913250635 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5f402eb90 con 0x7fd60009f180 2023-09-30T22:28:22.896 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:22.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.897+0000 7fd6053a9700 1 -- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009f180 msgr2=0x7fd6001207d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.897+0000 7fd6053a9700 1 --2- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009f180 0x7fd6001207d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009bc0 tx=0x7fd5f4004750 comp rx=0 tx=0).stop 2023-09-30T22:28:22.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.897+0000 7fd6053a9700 1 -- 172.21.15.154:0/913250635 shutdown_connections 2023-09-30T22:28:22.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.897+0000 7fd6053a9700 1 --2- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd600131d70 0x7fd600120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.897+0000 7fd6053a9700 1 --2- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd60009e870 0x7fd600120290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.897+0000 7fd6053a9700 1 --2- 172.21.15.154:0/913250635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd60009f180 0x7fd6001207d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.897+0000 7fd6053a9700 1 -- 172.21.15.154:0/913250635 >> 172.21.15.154:0/913250635 conn(0x7fd6000a4430 msgr2=0x7fd60009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.897+0000 7fd6053a9700 1 -- 172.21.15.154:0/913250635 shutdown_connections 2023-09-30T22:28:22.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.897+0000 7fd6053a9700 1 -- 172.21.15.154:0/913250635 wait complete. 2023-09-30T22:28:22.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:22.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.937+0000 7f1a9559a700 1 -- 172.21.15.154:0/1451281429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1a90139570 con 0x7f1a9013d210 2023-09-30T22:28:22.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.937+0000 7f1a777fe700 1 -- 172.21.15.154:0/1451281429 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a8801bce0 con 0x7f1a9013d210 2023-09-30T22:28:22.938 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:22.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.939+0000 7f1a9559a700 1 -- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a9013d210 msgr2=0x7f1a901336e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.939+0000 7f1a9559a700 1 --2- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a9013d210 0x7f1a901336e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1a88007e70 tx=0x7f1a8800e3c0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.939+0000 7f1a9559a700 1 -- 172.21.15.154:0/1451281429 shutdown_connections 2023-09-30T22:28:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.939+0000 7f1a9559a700 1 --2- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a9013d210 0x7f1a901336e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.939+0000 7f1a9559a700 1 --2- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a9006a770 0x7f1a90132c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.939+0000 7f1a9559a700 1 --2- 172.21.15.154:0/1451281429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a901350d0 0x7f1a901331a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.940+0000 7f1a9559a700 1 -- 172.21.15.154:0/1451281429 >> 172.21.15.154:0/1451281429 conn(0x7f1a90099c40 msgr2=0x7f1a9009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.940+0000 7f1a9559a700 1 -- 172.21.15.154:0/1451281429 shutdown_connections 2023-09-30T22:28:22.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:22.940+0000 7f1a9559a700 1 -- 172.21.15.154:0/1451281429 wait complete. 2023-09-30T22:28:22.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:23.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:23.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:23.911 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:23.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:23.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.971+0000 7f633a037700 1 Processor -- start 2023-09-30T22:28:23.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.971+0000 7f633a037700 1 -- start start 2023-09-30T22:28:23.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f633a037700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6334133660 0x7f6334135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f633a037700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334135f80 0x7f6334138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f633a037700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633409ae40 con 0x7f633412d280 2023-09-30T22:28:23.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f633a037700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633409b9a0 con 0x7f6334133660 2023-09-30T22:28:23.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f633a037700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633412dd60 con 0x7f6334135f80 2023-09-30T22:28:23.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f6333fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334135f80 0x7f6334138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f63337fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f633412d280 0x7f633412d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36350/0 (socket says 172.21.15.154:36350) 2023-09-30T22:28:23.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f6333fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334135f80 0x7f6334138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35004/0 (socket says 172.21.15.154:35004) 2023-09-30T22:28:23.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f63337fe700 1 -- 172.21.15.154:0/2138173291 learned_addr learned my addr 172.21.15.154:0/2138173291 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:23.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.972+0000 7f6332ffd700 1 --2- 172.21.15.154:0/2138173291 >> v2:172.21.15.154:3300/0 conn(0x7f6334133660 0x7f6334135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.973+0000 7f6333fff700 1 -- 172.21.15.154:0/2138173291 >> v2:172.21.15.154:3300/0 conn(0x7f6334133660 msgr2=0x7f6334135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:23.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.973+0000 7f6333fff700 1 --2- 172.21.15.154:0/2138173291 >> v2:172.21.15.154:3300/0 conn(0x7f6334133660 0x7f6334135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.973+0000 7f6333fff700 1 -- 172.21.15.154:0/2138173291 >> v1:172.21.15.154:6789/0 conn(0x7f633412d280 legacy=0x7f633412d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.973+0000 7f6333fff700 1 -- 172.21.15.154:0/2138173291 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633409bbb0 con 0x7f6334135f80 2023-09-30T22:28:23.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.973+0000 7f6333fff700 1 --2- 172.21.15.154:0/2138173291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334135f80 0x7f6334138360 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f632c00bfa0 tx=0x7f632c00d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93835f07dd9cf32b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:23.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.973+0000 7f63327fc700 1 -- 172.21.15.154:0/2138173291 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c010070 con 0x7f6334135f80 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.973+0000 7f63327fc700 1 -- 172.21.15.154:0/2138173291 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00b2e0 con 0x7f6334135f80 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.973+0000 7f63327fc700 1 -- 172.21.15.154:0/2138173291 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00dc20 con 0x7f6334135f80 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.974+0000 7f633a037700 1 -- 172.21.15.154:0/2138173291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334135f80 msgr2=0x7f6334138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.974+0000 7f633a037700 1 --2- 172.21.15.154:0/2138173291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334135f80 0x7f6334138360 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f632c00bfa0 tx=0x7f632c00d330 comp rx=0 tx=0).stop 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.974+0000 7f633a037700 1 -- 172.21.15.154:0/2138173291 shutdown_connections 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.974+0000 7f633a037700 1 --2- 172.21.15.154:0/2138173291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334135f80 0x7f6334138360 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.974+0000 7f633a037700 1 --2- 172.21.15.154:0/2138173291 >> v2:172.21.15.154:3300/0 conn(0x7f6334133660 0x7f6334135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.974+0000 7f633a037700 1 -- 172.21.15.154:0/2138173291 >> 172.21.15.154:0/2138173291 conn(0x7f63340a2980 msgr2=0x7f63340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.974+0000 7f633a037700 1 -- 172.21.15.154:0/2138173291 shutdown_connections 2023-09-30T22:28:23.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.974+0000 7f633a037700 1 -- 172.21.15.154:0/2138173291 wait complete. 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.975+0000 7f633a037700 1 Processor -- start 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.975+0000 7f633a037700 1 -- start start 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f633a037700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f633412d280 0x7f63341c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f633a037700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334133660 0x7f63341c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f633a037700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6334135f80 0x7f633406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f633a037700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63341bb060 con 0x7f633412d280 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f633a037700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6334119ca0 con 0x7f6334133660 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f633a037700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6334119780 con 0x7f6334135f80 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6333fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6334135f80 0x7f633406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6333fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6334135f80 0x7f633406f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:52062/0 (socket says 172.21.15.154:52062) 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6333fff700 1 -- 172.21.15.154:0/4173975703 learned_addr learned my addr 172.21.15.154:0/4173975703 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:23.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6332ffd700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334133660 0x7f63341c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f63337fe700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f633412d280 0x7f63341c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:23.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6332ffd700 1 -- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6334135f80 msgr2=0x7f633406f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6332ffd700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6334135f80 0x7f633406f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6332ffd700 1 -- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f633412d280 msgr2=0x7f63341c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:23.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6332ffd700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f633412d280 0x7f63341c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:23.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6332ffd700 1 -- 172.21.15.154:0/4173975703 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c00bc80 con 0x7f6334133660 2023-09-30T22:28:23.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f6333fff700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6334135f80 0x7f633406f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:23.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.976+0000 7f63337fe700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f633412d280 0x7f63341c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:23.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.977+0000 7f6332ffd700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334133660 0x7f63341c49f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f632800e8d0 tx=0x7f632800ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:23.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.977+0000 7f631bfff700 1 -- 172.21.15.154:0/4173975703 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328013980 con 0x7f6334133660 2023-09-30T22:28:23.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.977+0000 7f631bfff700 1 -- 172.21.15.154:0/4173975703 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6328013ae0 con 0x7f6334133660 2023-09-30T22:28:23.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.977+0000 7f631bfff700 1 -- 172.21.15.154:0/4173975703 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328013e50 con 0x7f6334133660 2023-09-30T22:28:23.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.977+0000 7f633a037700 1 -- 172.21.15.154:0/4173975703 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6334070ea0 con 0x7f6334133660 2023-09-30T22:28:23.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.977+0000 7f633a037700 1 -- 172.21.15.154:0/4173975703 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6334071410 con 0x7f6334133660 2023-09-30T22:28:23.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.978+0000 7f631bfff700 1 -- 172.21.15.154:0/4173975703 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f632801b440 con 0x7f6334133660 2023-09-30T22:28:23.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.978+0000 7f631bfff700 1 -- 172.21.15.154:0/4173975703 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63280435d0 con 0x7f6334133660 2023-09-30T22:28:23.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.979+0000 7f633a037700 1 -- 172.21.15.154:0/4173975703 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63341195e0 con 0x7f6334133660 2023-09-30T22:28:23.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:23.983+0000 7f631bfff700 1 -- 172.21.15.154:0/4173975703 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63341195e0 con 0x7f6334133660 2023-09-30T22:28:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.009+0000 7f8d3e21e700 1 Processor -- start 2023-09-30T22:28:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.009+0000 7f8d3e21e700 1 -- start start 2023-09-30T22:28:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.009+0000 7f8d3e21e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d38133900 0x7f8d38133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.009+0000 7f8d3e21e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.009+0000 7f8d3e21e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3809a760 con 0x7f8d38134210 2023-09-30T22:28:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.009+0000 7f8d3e21e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d381336e0 con 0x7f8d38133900 2023-09-30T22:28:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.009+0000 7f8d3e21e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3809a080 con 0x7f8d380a10b0 2023-09-30T22:28:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d37fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d37fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3813b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35022/0 (socket says 172.21.15.154:35022) 2023-09-30T22:28:24.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d37fff700 1 -- 172.21.15.154:0/150775184 learned_addr learned my addr 172.21.15.154:0/150775184 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:24.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d377fe700 1 --2- 172.21.15.154:0/150775184 >> v2:172.21.15.154:3300/0 conn(0x7f8d38133900 0x7f8d38133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d377fe700 1 -- 172.21.15.154:0/150775184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 msgr2=0x7f8d3813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:24.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d377fe700 1 --2- 172.21.15.154:0/150775184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3813b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d377fe700 1 -- 172.21.15.154:0/150775184 >> v1:172.21.15.154:6789/0 conn(0x7f8d38134210 legacy=0x7f8d380a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d377fe700 1 -- 172.21.15.154:0/150775184 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380a23e0 con 0x7f8d38133900 2023-09-30T22:28:24.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d37fff700 1 --2- 172.21.15.154:0/150775184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d377fe700 1 --2- 172.21.15.154:0/150775184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38133900 0x7f8d38133cd0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009820 tx=0x7f8d28009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e40d8cd0dc717c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d367fc700 1 -- 172.21.15.154:0/150775184 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d28005e30 con 0x7f8d38133900 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d367fc700 1 -- 172.21.15.154:0/150775184 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d28006030 con 0x7f8d38133900 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.010+0000 7f8d367fc700 1 -- 172.21.15.154:0/150775184 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d280063c0 con 0x7f8d38133900 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.011+0000 7f8d3e21e700 1 -- 172.21.15.154:0/150775184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38133900 msgr2=0x7f8d38133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.011+0000 7f8d3e21e700 1 --2- 172.21.15.154:0/150775184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38133900 0x7f8d38133cd0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009820 tx=0x7f8d28009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.011+0000 7f8d3e21e700 1 -- 172.21.15.154:0/150775184 shutdown_connections 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.011+0000 7f8d3e21e700 1 --2- 172.21.15.154:0/150775184 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.011+0000 7f8d3e21e700 1 --2- 172.21.15.154:0/150775184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38133900 0x7f8d38133cd0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.011+0000 7f8d3e21e700 1 -- 172.21.15.154:0/150775184 >> 172.21.15.154:0/150775184 conn(0x7f8d380a2980 msgr2=0x7f8d380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.011+0000 7f8d3e21e700 1 -- 172.21.15.154:0/150775184 shutdown_connections 2023-09-30T22:28:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.011+0000 7f8d3e21e700 1 -- 172.21.15.154:0/150775184 wait complete. 2023-09-30T22:28:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d3e21e700 1 Processor -- start 2023-09-30T22:28:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d3e21e700 1 -- start start 2023-09-30T22:28:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d3e21e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3811d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d3e21e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133900 0x7f8d3811dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d3e21e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38134210 0x7f8d3811e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d3e21e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d381210b0 con 0x7f8d38134210 2023-09-30T22:28:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d3e21e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d381201a0 con 0x7f8d380a10b0 2023-09-30T22:28:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d3e21e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3811f440 con 0x7f8d38133900 2023-09-30T22:28:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d37fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38134210 0x7f8d3811e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d37fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38134210 0x7f8d3811e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44436/0 (socket says 172.21.15.154:44436) 2023-09-30T22:28:24.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d37fff700 1 -- 172.21.15.154:0/2043767679 learned_addr learned my addr 172.21.15.154:0/2043767679 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:24.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.013+0000 7f8d36ffd700 1 --2- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133900 0x7f8d3811dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d377fe700 1 --2- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3811d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d37fff700 1 -- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133900 msgr2=0x7f8d3811dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d37fff700 1 --2- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133900 0x7f8d3811dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d37fff700 1 -- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 msgr2=0x7f8d3811d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d37fff700 1 --2- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3811d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d37fff700 1 -- 172.21.15.154:0/2043767679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30009b30 con 0x7f8d38134210 2023-09-30T22:28:24.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d37fff700 1 --2- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38134210 0x7f8d3811e2b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000efc0 tx=0x7f8d3000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d1ffff700 1 -- 172.21.15.154:0/2043767679 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30018070 con 0x7f8d38134210 2023-09-30T22:28:24.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d1ffff700 1 -- 172.21.15.154:0/2043767679 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3000f040 con 0x7f8d38134210 2023-09-30T22:28:24.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d3e21e700 1 -- 172.21.15.154:0/2043767679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d28009430 con 0x7f8d38134210 2023-09-30T22:28:24.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d1ffff700 1 -- 172.21.15.154:0/2043767679 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30003c20 con 0x7f8d38134210 2023-09-30T22:28:24.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.014+0000 7f8d3e21e700 1 -- 172.21.15.154:0/2043767679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3809a2c0 con 0x7f8d38134210 2023-09-30T22:28:24.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.015+0000 7f8d1ffff700 1 -- 172.21.15.154:0/2043767679 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d3000c880 con 0x7f8d38134210 2023-09-30T22:28:24.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.015+0000 7f8d3e21e700 1 -- 172.21.15.154:0/2043767679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3811a590 con 0x7f8d38134210 2023-09-30T22:28:24.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.015+0000 7f8d1ffff700 1 -- 172.21.15.154:0/2043767679 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d3003f7d0 con 0x7f8d38134210 2023-09-30T22:28:24.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.020+0000 7f8d1ffff700 1 -- 172.21.15.154:0/2043767679 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d30012340 con 0x7f8d38134210 2023-09-30T22:28:24.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.082+0000 7f1a2c5a4700 1 Processor -- start 2023-09-30T22:28:24.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.082+0000 7f1a2c5a4700 1 -- start start 2023-09-30T22:28:24.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.083+0000 7f1a2c5a4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a241359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.083+0000 7f1a2c5a4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a24138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.083+0000 7f1a2c5a4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2409aaa0 con 0x7f1a2409d860 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.083+0000 7f1a2c5a4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2409e730 con 0x7f1a24135f20 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.083+0000 7f1a2c5a4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2409f870 con 0x7f1a2409e340 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.083+0000 7f1a2a340700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1a2409d860 0x7f1a2409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36370/0 (socket says 172.21.15.154:36370) 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.083+0000 7f1a29b3f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a241359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.083+0000 7f1a2a340700 1 -- 172.21.15.154:0/469776041 learned_addr learned my addr 172.21.15.154:0/469776041 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.084+0000 7f1a2ab41700 1 --2- 172.21.15.154:0/469776041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a24138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.084+0000 7f1a29b3f700 1 -- 172.21.15.154:0/469776041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 msgr2=0x7f1a24138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.084+0000 7f1a29b3f700 1 --2- 172.21.15.154:0/469776041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a24138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.084+0000 7f1a29b3f700 1 -- 172.21.15.154:0/469776041 >> v1:172.21.15.154:6789/0 conn(0x7f1a2409d860 legacy=0x7f1a2409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.084+0000 7f1a29b3f700 1 -- 172.21.15.154:0/469776041 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2409b360 con 0x7f1a2409e340 2023-09-30T22:28:24.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.084+0000 7f1a29b3f700 1 --2- 172.21.15.154:0/469776041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a241359e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1a140098a0 tx=0x7f1a14009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75b7dbac1c9044b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.084+0000 7f1a2933e700 1 -- 172.21.15.154:0/469776041 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14004230 con 0x7f1a2409e340 2023-09-30T22:28:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.084+0000 7f1a2933e700 1 -- 172.21.15.154:0/469776041 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a14004390 con 0x7f1a2409e340 2023-09-30T22:28:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.084+0000 7f1a2933e700 1 -- 172.21.15.154:0/469776041 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a140036a0 con 0x7f1a2409e340 2023-09-30T22:28:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.085+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/469776041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 msgr2=0x7f1a241359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.085+0000 7f1a2c5a4700 1 --2- 172.21.15.154:0/469776041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a241359e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1a140098a0 tx=0x7f1a14009bb0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.086+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/469776041 shutdown_connections 2023-09-30T22:28:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.086+0000 7f1a2c5a4700 1 --2- 172.21.15.154:0/469776041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a24138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.086+0000 7f1a2c5a4700 1 --2- 172.21.15.154:0/469776041 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a241359e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.086+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/469776041 >> 172.21.15.154:0/469776041 conn(0x7f1a24099c40 msgr2=0x7f1a240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.089+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/469776041 shutdown_connections 2023-09-30T22:28:24.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.089+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/469776041 wait complete. 2023-09-30T22:28:24.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.090+0000 7f1a2c5a4700 1 Processor -- start 2023-09-30T22:28:24.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.090+0000 7f1a2c5a4700 1 -- start start 2023-09-30T22:28:24.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.090+0000 7f1a2c5a4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a2409d860 0x7f1a2411d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.090+0000 7f1a2c5a4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a2411db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.090+0000 7f1a2c5a4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a2411e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.090+0000 7f1a2c5a4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2411f190 con 0x7f1a2409d860 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.090+0000 7f1a2c5a4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2411f7b0 con 0x7f1a24135f20 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.090+0000 7f1a2c5a4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2409c920 con 0x7f1a2409e340 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2ab41700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a2411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2ab41700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a2411e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35056/0 (socket says 172.21.15.154:35056) 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2ab41700 1 -- 172.21.15.154:0/4174763379 learned_addr learned my addr 172.21.15.154:0/4174763379 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a29b3f700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a2411db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2ab41700 1 -- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 msgr2=0x7f1a2411db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2ab41700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a2411db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2ab41700 1 -- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a2409d860 msgr2=0x7f1a2411d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2a340700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a2409d860 0x7f1a2411d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2ab41700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a2409d860 0x7f1a2411d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2ab41700 1 -- 172.21.15.154:0/4174763379 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140094a0 con 0x7f1a24135f20 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a29b3f700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a2411db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2a340700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a2409d860 0x7f1a2411d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2ab41700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a2411e090 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009dd0 tx=0x7f1a1c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a1affd700 1 -- 172.21.15.154:0/4174763379 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c009c40 con 0x7f1a24135f20 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a1affd700 1 -- 172.21.15.154:0/4174763379 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c00f040 con 0x7f1a24135f20 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a1affd700 1 -- 172.21.15.154:0/4174763379 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c014480 con 0x7f1a24135f20 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.091+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/4174763379 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a24120b00 con 0x7f1a24135f20 2023-09-30T22:28:24.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.092+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/4174763379 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a24120dc0 con 0x7f1a24135f20 2023-09-30T22:28:24.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.093+0000 7f1a1affd700 1 -- 172.21.15.154:0/4174763379 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a1c0145e0 con 0x7f1a24135f20 2023-09-30T22:28:24.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.093+0000 7f1a1affd700 1 -- 172.21.15.154:0/4174763379 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a1c03fec0 con 0x7f1a24135f20 2023-09-30T22:28:24.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.093+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/4174763379 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a24120fb0 con 0x7f1a24135f20 2023-09-30T22:28:24.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.094+0000 7f46578e6700 1 Processor -- start 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f46578e6700 1 -- start start 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f46578e6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f465009f350 0x7f4650136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f46578e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46501371c0 0x7f46501395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f46578e6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465009c970 con 0x7f465009e870 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f46578e6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46500a0920 con 0x7f465009f350 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f46578e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465009f9c0 con 0x7f46501371c0 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f4654e81700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f465009f350 0x7f4650136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f4654e81700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f465009f350 0x7f4650136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44462/0 (socket says 172.21.15.154:44462) 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f4654e81700 1 -- 172.21.15.154:0/1897419264 learned_addr learned my addr 172.21.15.154:0/1897419264 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:24.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.095+0000 7f4655e83700 1 --2- 172.21.15.154:0/1897419264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46501371c0 0x7f46501395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.096+0000 7f4654e81700 1 -- 172.21.15.154:0/1897419264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46501371c0 msgr2=0x7f46501395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.096+0000 7f4654e81700 1 --2- 172.21.15.154:0/1897419264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46501371c0 0x7f46501395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.096+0000 7f4654e81700 1 -- 172.21.15.154:0/1897419264 >> v1:172.21.15.154:6789/0 conn(0x7f465009e870 legacy=0x7f465009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.096+0000 7f4654e81700 1 -- 172.21.15.154:0/1897419264 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465009bab0 con 0x7f465009f350 2023-09-30T22:28:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.096+0000 7f4655e83700 1 --2- 172.21.15.154:0/1897419264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46501371c0 0x7f46501395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.096+0000 7f4654e81700 1 --2- 172.21.15.154:0/1897419264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465009f350 0x7f4650136c80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f46400098f0 tx=0x7f4640009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9604ad7dc2e312 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.096+0000 7f4647fff700 1 -- 172.21.15.154:0/1897419264 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640004230 con 0x7f465009f350 2023-09-30T22:28:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.096+0000 7f4647fff700 1 -- 172.21.15.154:0/1897419264 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4640004390 con 0x7f465009f350 2023-09-30T22:28:24.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.096+0000 7f4647fff700 1 -- 172.21.15.154:0/1897419264 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46400036a0 con 0x7f465009f350 2023-09-30T22:28:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.097+0000 7f46578e6700 1 -- 172.21.15.154:0/1897419264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465009f350 msgr2=0x7f4650136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.097+0000 7f46578e6700 1 --2- 172.21.15.154:0/1897419264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465009f350 0x7f4650136c80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f46400098f0 tx=0x7f4640009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:24.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.097+0000 7f46578e6700 1 -- 172.21.15.154:0/1897419264 shutdown_connections 2023-09-30T22:28:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.097+0000 7f46578e6700 1 --2- 172.21.15.154:0/1897419264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46501371c0 0x7f46501395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.097+0000 7f46578e6700 1 --2- 172.21.15.154:0/1897419264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465009f350 0x7f4650136c80 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.097+0000 7f46578e6700 1 -- 172.21.15.154:0/1897419264 >> 172.21.15.154:0/1897419264 conn(0x7f46500a4430 msgr2=0x7f46500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.097+0000 7f46578e6700 1 -- 172.21.15.154:0/1897419264 shutdown_connections 2023-09-30T22:28:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.097+0000 7f46578e6700 1 -- 172.21.15.154:0/1897419264 wait complete. 2023-09-30T22:28:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.098+0000 7f46578e6700 1 Processor -- start 2023-09-30T22:28:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.098+0000 7f46578e6700 1 -- start start 2023-09-30T22:28:24.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f46578e6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f465009e870 0x7f465011f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f46578e6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465009f350 0x7f465011fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f46578e6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46501371c0 0x7f4650120100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f46578e6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4650122ce0 con 0x7f465009f350 2023-09-30T22:28:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f46578e6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4650122ec0 con 0x7f465009e870 2023-09-30T22:28:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f46578e6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f465009dba0 con 0x7f46501371c0 2023-09-30T22:28:24.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f1a1affd700 1 -- 172.21.15.154:0/4174763379 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a1c018070 con 0x7f1a24135f20 2023-09-30T22:28:24.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f4655682700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f465009e870 0x7f465011f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f4655682700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f465009e870 0x7f465011f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35076/0 (socket says 172.21.15.154:35076) 2023-09-30T22:28:24.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f4655682700 1 -- 172.21.15.154:0/3507853937 learned_addr learned my addr 172.21.15.154:0/3507853937 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f4654e81700 1 --2- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465009f350 0x7f465011fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f4655682700 1 -- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46501371c0 msgr2=0x7f4650120100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f4655682700 1 --2- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46501371c0 0x7f4650120100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f4655682700 1 -- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465009f350 msgr2=0x7f465011fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f4655682700 1 --2- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465009f350 0x7f465011fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.099+0000 7f4655682700 1 -- 172.21.15.154:0/3507853937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4648009a70 con 0x7f465009e870 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.100+0000 7f4655682700 1 --2- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f465009e870 0x7f465011f680 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f464c00c7b0 tx=0x7f464c00cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.100+0000 7f4645ffb700 1 -- 172.21.15.154:0/3507853937 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c005480 con 0x7f465009e870 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.100+0000 7f46578e6700 1 -- 172.21.15.154:0/3507853937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4640009550 con 0x7f465009e870 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.100+0000 7f4645ffb700 1 -- 172.21.15.154:0/3507853937 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c003680 con 0x7f465009e870 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.100+0000 7f4645ffb700 1 -- 172.21.15.154:0/3507853937 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c003a30 con 0x7f465009e870 2023-09-30T22:28:24.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.100+0000 7f46578e6700 1 -- 172.21.15.154:0/3507853937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46501213a0 con 0x7f465009e870 2023-09-30T22:28:24.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.101+0000 7f46578e6700 1 -- 172.21.15.154:0/3507853937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4650123000 con 0x7f465009e870 2023-09-30T22:28:24.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.101+0000 7f4645ffb700 1 -- 172.21.15.154:0/3507853937 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f464c003b90 con 0x7f465009e870 2023-09-30T22:28:24.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.101+0000 7f4645ffb700 1 -- 172.21.15.154:0/3507853937 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f464c019c90 con 0x7f465009e870 2023-09-30T22:28:24.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.106+0000 7f4645ffb700 1 -- 172.21.15.154:0/3507853937 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4650123000 con 0x7f465009e870 2023-09-30T22:28:24.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.220+0000 7f8d3e21e700 1 -- 172.21.15.154:0/2043767679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8d3804f2a0 con 0x7f8d38134210 2023-09-30T22:28:24.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.220+0000 7f8d1ffff700 1 -- 172.21.15.154:0/2043767679 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d3001cbb0 con 0x7f8d38134210 2023-09-30T22:28:24.222 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:24.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.222+0000 7f8d3e21e700 1 -- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38134210 msgr2=0x7f8d3811e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.222+0000 7f8d3e21e700 1 --2- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38134210 0x7f8d3811e2b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000efc0 tx=0x7f8d3000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.222+0000 7f8d3e21e700 1 -- 172.21.15.154:0/2043767679 shutdown_connections 2023-09-30T22:28:24.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.222+0000 7f8d3e21e700 1 --2- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38134210 0x7f8d3811e2b0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.222+0000 7f8d3e21e700 1 --2- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d380a10b0 0x7f8d3811d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.222+0000 7f8d3e21e700 1 --2- 172.21.15.154:0/2043767679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d38133900 0x7f8d3811dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.222+0000 7f8d3e21e700 1 -- 172.21.15.154:0/2043767679 >> 172.21.15.154:0/2043767679 conn(0x7f8d380a2980 msgr2=0x7f8d381bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.223+0000 7f8d3e21e700 1 -- 172.21.15.154:0/2043767679 shutdown_connections 2023-09-30T22:28:24.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.223+0000 7f8d3e21e700 1 -- 172.21.15.154:0/2043767679 wait complete. 2023-09-30T22:28:24.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.282+0000 7f633a037700 1 -- 172.21.15.154:0/4173975703 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f63341195e0 con 0x7f6334133660 2023-09-30T22:28:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.282+0000 7f631bfff700 1 -- 172.21.15.154:0/4173975703 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63341195e0 con 0x7f6334133660 2023-09-30T22:28:24.283 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.284+0000 7f633a037700 1 -- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334133660 msgr2=0x7f63341c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.284+0000 7f633a037700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334133660 0x7f63341c49f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f632800e8d0 tx=0x7f632800ebe0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.284+0000 7f633a037700 1 -- 172.21.15.154:0/4173975703 shutdown_connections 2023-09-30T22:28:24.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.284+0000 7f633a037700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6334135f80 0x7f633406f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.284+0000 7f633a037700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f633412d280 0x7f63341c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.284+0000 7f633a037700 1 --2- 172.21.15.154:0/4173975703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6334133660 0x7f63341c49f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.284+0000 7f633a037700 1 -- 172.21.15.154:0/4173975703 >> 172.21.15.154:0/4173975703 conn(0x7f63340a2980 msgr2=0x7f6334131370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.285+0000 7f633a037700 1 -- 172.21.15.154:0/4173975703 shutdown_connections 2023-09-30T22:28:24.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.285+0000 7f633a037700 1 -- 172.21.15.154:0/4173975703 wait complete. 2023-09-30T22:28:24.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:24.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.301+0000 7f46578e6700 1 -- 172.21.15.154:0/3507853937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4650123000 con 0x7f465009e870 2023-09-30T22:28:24.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.302+0000 7f4645ffb700 1 -- 172.21.15.154:0/3507853937 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4650123000 con 0x7f465009e870 2023-09-30T22:28:24.302 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:24.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.304+0000 7f46578e6700 1 -- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f465009e870 msgr2=0x7f465011f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.304+0000 7f46578e6700 1 --2- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f465009e870 0x7f465011f680 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f464c00c7b0 tx=0x7f464c00cac0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.304+0000 7f46578e6700 1 -- 172.21.15.154:0/3507853937 shutdown_connections 2023-09-30T22:28:24.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.304+0000 7f46578e6700 1 --2- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f46501371c0 0x7f4650120100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.304+0000 7f46578e6700 1 --2- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f465009e870 0x7f465011f680 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.304+0000 7f46578e6700 1 --2- 172.21.15.154:0/3507853937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f465009f350 0x7f465011fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.304+0000 7f46578e6700 1 -- 172.21.15.154:0/3507853937 >> 172.21.15.154:0/3507853937 conn(0x7f46500a4430 msgr2=0x7f46500a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.304+0000 7f46578e6700 1 -- 172.21.15.154:0/3507853937 shutdown_connections 2023-09-30T22:28:24.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.304+0000 7f46578e6700 1 -- 172.21.15.154:0/3507853937 wait complete. 2023-09-30T22:28:24.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:24.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.355+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/4174763379 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a2404f2a0 con 0x7f1a24135f20 2023-09-30T22:28:24.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.355+0000 7f1a1affd700 1 -- 172.21.15.154:0/4174763379 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a1c011680 con 0x7f1a24135f20 2023-09-30T22:28:24.356 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:24.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.357+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 msgr2=0x7f1a2411e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:24.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.357+0000 7f1a2c5a4700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a2411e090 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009dd0 tx=0x7f1a1c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.357+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/4174763379 shutdown_connections 2023-09-30T22:28:24.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.357+0000 7f1a2c5a4700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a24135f20 0x7f1a2411e090 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.357+0000 7f1a2c5a4700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a2409d860 0x7f1a2411d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.357+0000 7f1a2c5a4700 1 --2- 172.21.15.154:0/4174763379 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a2409e340 0x7f1a2411db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.357+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/4174763379 >> 172.21.15.154:0/4174763379 conn(0x7f1a24099c40 msgr2=0x7f1a24134ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.357+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/4174763379 shutdown_connections 2023-09-30T22:28:24.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:24.358+0000 7f1a2c5a4700 1 -- 172.21.15.154:0/4174763379 wait complete. 2023-09-30T22:28:24.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:25.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:25.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:25.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:25.371 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:25.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f22326d5700 1 Processor -- start 2023-09-30T22:28:25.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f22326d5700 1 -- start start 2023-09-30T22:28:25.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f22326d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c099a60 0x7f222c1388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f22326d5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c138e30 0x7f222c13b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f22326d5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222c09aa00 con 0x7f222c133b80 2023-09-30T22:28:25.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f22326d5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c09a080 con 0x7f222c138e30 2023-09-30T22:28:25.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f22326d5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f222c133750 con 0x7f222c099a60 2023-09-30T22:28:25.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f2230c72700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c138e30 0x7f222c13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f222bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f222c133b80 0x7f222c133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56660/0 (socket says 172.21.15.154:56660) 2023-09-30T22:28:25.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f222bfff700 1 -- 172.21.15.154:0/1084385171 learned_addr learned my addr 172.21.15.154:0/1084385171 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:25.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.379+0000 7f222b7fe700 1 --2- 172.21.15.154:0/1084385171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c099a60 0x7f222c1388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.380+0000 7f222b7fe700 1 -- 172.21.15.154:0/1084385171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c138e30 msgr2=0x7f222c13b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:25.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.380+0000 7f222b7fe700 1 --2- 172.21.15.154:0/1084385171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c138e30 0x7f222c13b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.380+0000 7f222b7fe700 1 -- 172.21.15.154:0/1084385171 >> v1:172.21.15.154:6789/0 conn(0x7f222c133b80 legacy=0x7f222c133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.380+0000 7f222b7fe700 1 -- 172.21.15.154:0/1084385171 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c09a760 con 0x7f222c099a60 2023-09-30T22:28:25.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.380+0000 7f2230c72700 1 --2- 172.21.15.154:0/1084385171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c138e30 0x7f222c13b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.380+0000 7f222b7fe700 1 --2- 172.21.15.154:0/1084385171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c099a60 0x7f222c1388f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2220009870 tx=0x7f2220009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcfda3d4ac2acdbe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.380+0000 7f222affd700 1 -- 172.21.15.154:0/1084385171 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220011830 con 0x7f222c099a60 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.380+0000 7f222affd700 1 -- 172.21.15.154:0/1084385171 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2220011990 con 0x7f222c099a60 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.380+0000 7f222affd700 1 -- 172.21.15.154:0/1084385171 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220011d20 con 0x7f222c099a60 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.381+0000 7f22326d5700 1 -- 172.21.15.154:0/1084385171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c099a60 msgr2=0x7f222c1388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.381+0000 7f22326d5700 1 --2- 172.21.15.154:0/1084385171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c099a60 0x7f222c1388f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2220009870 tx=0x7f2220009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.381+0000 7f22326d5700 1 -- 172.21.15.154:0/1084385171 shutdown_connections 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.381+0000 7f22326d5700 1 --2- 172.21.15.154:0/1084385171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c138e30 0x7f222c13b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.381+0000 7f22326d5700 1 --2- 172.21.15.154:0/1084385171 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c099a60 0x7f222c1388f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.381+0000 7f22326d5700 1 -- 172.21.15.154:0/1084385171 >> 172.21.15.154:0/1084385171 conn(0x7f222c0a2980 msgr2=0x7f222c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.381+0000 7f22326d5700 1 -- 172.21.15.154:0/1084385171 shutdown_connections 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.381+0000 7f22326d5700 1 -- 172.21.15.154:0/1084385171 wait complete. 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.382+0000 7f22326d5700 1 Processor -- start 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.382+0000 7f22326d5700 1 -- start start 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f22326d5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f222c099a60 0x7f222c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f22326d5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c133b80 0x7f222c119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f22326d5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c138e30 0x7f222c119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f22326d5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c11c4b0 con 0x7f222c099a60 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f22326d5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c130fc0 con 0x7f222c133b80 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f22326d5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f222c11c690 con 0x7f222c138e30 2023-09-30T22:28:25.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f222c099a60 0x7f222c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f222c099a60 0x7f222c118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52544/0 (socket says 172.21.15.154:52544) 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222bfff700 1 -- 172.21.15.154:0/2159854359 learned_addr learned my addr 172.21.15.154:0/2159854359 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222b7fe700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c133b80 0x7f222c119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f2230c72700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c138e30 0x7f222c119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222b7fe700 1 -- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c138e30 msgr2=0x7f222c119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222b7fe700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c138e30 0x7f222c119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222b7fe700 1 -- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f222c099a60 msgr2=0x7f222c118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222b7fe700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f222c099a60 0x7f222c118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222b7fe700 1 -- 172.21.15.154:0/2159854359 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2224009a70 con 0x7f222c133b80 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f2230c72700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c138e30 0x7f222c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222bfff700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f222c099a60 0x7f222c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:25.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.383+0000 7f222b7fe700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c133b80 0x7f222c119330 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f222c0a2370 tx=0x7f2220004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.384+0000 7f2228ff9700 1 -- 172.21.15.154:0/2159854359 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22200036a0 con 0x7f222c133b80 2023-09-30T22:28:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.384+0000 7f2228ff9700 1 -- 172.21.15.154:0/2159854359 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222001f070 con 0x7f222c133b80 2023-09-30T22:28:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.384+0000 7f2228ff9700 1 -- 172.21.15.154:0/2159854359 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220003a60 con 0x7f222c133b80 2023-09-30T22:28:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.384+0000 7f22326d5700 1 -- 172.21.15.154:0/2159854359 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22200094a0 con 0x7f222c133b80 2023-09-30T22:28:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.384+0000 7f22326d5700 1 -- 172.21.15.154:0/2159854359 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c0a2490 con 0x7f222c133b80 2023-09-30T22:28:25.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.385+0000 7f22127fc700 1 -- 172.21.15.154:0/2159854359 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c11c310 con 0x7f222c133b80 2023-09-30T22:28:25.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.386+0000 7f2228ff9700 1 -- 172.21.15.154:0/2159854359 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2220003bc0 con 0x7f222c133b80 2023-09-30T22:28:25.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.386+0000 7f2228ff9700 1 -- 172.21.15.154:0/2159854359 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2220021070 con 0x7f222c133b80 2023-09-30T22:28:25.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.394+0000 7f2228ff9700 1 -- 172.21.15.154:0/2159854359 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f222001a430 con 0x7f222c133b80 2023-09-30T22:28:25.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.433+0000 7fe5ba950700 1 Processor -- start 2023-09-30T22:28:25.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.433+0000 7fe5ba950700 1 -- start start 2023-09-30T22:28:25.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.433+0000 7fe5ba950700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5b4133900 0x7fe5b4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.433+0000 7fe5ba950700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b40a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.433+0000 7fe5ba950700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b409a760 con 0x7fe5b40a0ee0 2023-09-30T22:28:25.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.433+0000 7fe5ba950700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b41336e0 con 0x7fe5b4133900 2023-09-30T22:28:25.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.433+0000 7fe5ba950700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b409a080 con 0x7fe5b4134210 2023-09-30T22:28:25.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b8eed700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe5b40a0ee0 0x7fe5b413a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56674/0 (socket says 172.21.15.154:56674) 2023-09-30T22:28:25.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5b4133900 0x7fe5b4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b8eed700 1 -- 172.21.15.154:0/329870755 learned_addr learned my addr 172.21.15.154:0/329870755 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:25.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b37fe700 1 --2- 172.21.15.154:0/329870755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b40a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b37fe700 1 -- 172.21.15.154:0/329870755 >> v2:172.21.15.154:3300/0 conn(0x7fe5b4133900 msgr2=0x7fe5b4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:25.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b37fe700 1 --2- 172.21.15.154:0/329870755 >> v2:172.21.15.154:3300/0 conn(0x7fe5b4133900 0x7fe5b4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b37fe700 1 -- 172.21.15.154:0/329870755 >> v1:172.21.15.154:6789/0 conn(0x7fe5b40a0ee0 legacy=0x7fe5b413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b37fe700 1 -- 172.21.15.154:0/329870755 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40a23e0 con 0x7fe5b4134210 2023-09-30T22:28:25.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b2ffd700 1 -- 172.21.15.154:0/329870755 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283702696 0 0) 0x7fe5b409a760 con 0x7fe5b40a0ee0 2023-09-30T22:28:25.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b37fe700 1 --2- 172.21.15.154:0/329870755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b40a09a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009840 tx=0x7fe5a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89e99f5a6a16bf5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.434+0000 7fe5b2ffd700 1 -- 172.21.15.154:0/329870755 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011830 con 0x7fe5b4134210 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5b2ffd700 1 -- 172.21.15.154:0/329870755 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8011990 con 0x7fe5b4134210 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5b2ffd700 1 -- 172.21.15.154:0/329870755 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011d20 con 0x7fe5b4134210 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5ba950700 1 -- 172.21.15.154:0/329870755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 msgr2=0x7fe5b40a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5ba950700 1 --2- 172.21.15.154:0/329870755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b40a09a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009840 tx=0x7fe5a8009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5ba950700 1 -- 172.21.15.154:0/329870755 shutdown_connections 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5ba950700 1 --2- 172.21.15.154:0/329870755 >> v2:172.21.15.154:3300/0 conn(0x7fe5b4133900 0x7fe5b4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5ba950700 1 --2- 172.21.15.154:0/329870755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b40a09a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5ba950700 1 -- 172.21.15.154:0/329870755 >> 172.21.15.154:0/329870755 conn(0x7fe5b40a2980 msgr2=0x7fe5b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5ba950700 1 -- 172.21.15.154:0/329870755 shutdown_connections 2023-09-30T22:28:25.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.435+0000 7fe5ba950700 1 -- 172.21.15.154:0/329870755 wait complete. 2023-09-30T22:28:25.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.436+0000 7fe5ba950700 1 Processor -- start 2023-09-30T22:28:25.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.436+0000 7fe5ba950700 1 -- start start 2023-09-30T22:28:25.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5ba950700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5b40a0ee0 0x7fe5b411faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5ba950700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5b4133900 0x7fe5b4120030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5ba950700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b4120570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5ba950700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4123570 con 0x7fe5b40a0ee0 2023-09-30T22:28:25.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5ba950700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4072720 con 0x7fe5b4134210 2023-09-30T22:28:25.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5ba950700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b409a2c0 con 0x7fe5b4133900 2023-09-30T22:28:25.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b8eed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b4120570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5b40a0ee0 0x7fe5b411faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b8eed700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b4120570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45010/0 (socket says 172.21.15.154:45010) 2023-09-30T22:28:25.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b8eed700 1 -- 172.21.15.154:0/2918190933 learned_addr learned my addr 172.21.15.154:0/2918190933 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:25.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b37fe700 1 --2- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5b4133900 0x7fe5b4120030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b8eed700 1 -- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5b4133900 msgr2=0x7fe5b4120030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b8eed700 1 --2- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5b4133900 0x7fe5b4120030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b8eed700 1 -- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5b40a0ee0 msgr2=0x7fe5b411faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b8eed700 1 --2- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5b40a0ee0 0x7fe5b411faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.437+0000 7fe5b8eed700 1 -- 172.21.15.154:0/2918190933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a80094a0 con 0x7fe5b4134210 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.438+0000 7fe5b8eed700 1 --2- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b4120570 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac002230 tx=0x7fe5ac00cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.438+0000 7fe5b0ff9700 1 -- 172.21.15.154:0/2918190933 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00aac0 con 0x7fe5b4134210 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.438+0000 7fe5b0ff9700 1 -- 172.21.15.154:0/2918190933 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac00ac40 con 0x7fe5b4134210 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.438+0000 7fe5b0ff9700 1 -- 172.21.15.154:0/2918190933 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0070d0 con 0x7fe5b4134210 2023-09-30T22:28:25.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.438+0000 7fe5ba950700 1 -- 172.21.15.154:0/2918190933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b41228b0 con 0x7fe5b4134210 2023-09-30T22:28:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.438+0000 7fe5ba950700 1 -- 172.21.15.154:0/2918190933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b4122d00 con 0x7fe5b4134210 2023-09-30T22:28:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.439+0000 7fe5b0ff9700 1 -- 172.21.15.154:0/2918190933 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5ac007250 con 0x7fe5b4134210 2023-09-30T22:28:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.439+0000 7fe5ba950700 1 -- 172.21.15.154:0/2918190933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b4122ee0 con 0x7fe5b4134210 2023-09-30T22:28:25.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.439+0000 7fe5b0ff9700 1 -- 172.21.15.154:0/2918190933 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe5ac03f160 con 0x7fe5b4134210 2023-09-30T22:28:25.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.448+0000 7fe5b0ff9700 1 -- 172.21.15.154:0/2918190933 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5ac007500 con 0x7fe5b4134210 2023-09-30T22:28:25.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.479+0000 7f3f7b034700 1 Processor -- start 2023-09-30T22:28:25.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.479+0000 7f3f7b034700 1 -- start start 2023-09-30T22:28:25.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f7b034700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409e950 0x7f3f7409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f7b034700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409f260 0x7f3f74133c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f7b034700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7406bcc0 con 0x7f3f741341c0 2023-09-30T22:28:25.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f7b034700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7406c9a0 con 0x7f3f7409e950 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f7b034700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7409afe0 con 0x7f3f7409f260 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f73fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409f260 0x7f3f74133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f73fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409f260 0x7f3f74133c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54210/0 (socket says 172.21.15.154:54210) 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f78dd0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409e950 0x7f3f7409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f73fff700 1 -- 172.21.15.154:0/1759990288 learned_addr learned my addr 172.21.15.154:0/1759990288 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f78dd0700 1 -- 172.21.15.154:0/1759990288 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409f260 msgr2=0x7f3f74133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f78dd0700 1 --2- 172.21.15.154:0/1759990288 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409f260 0x7f3f74133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f78dd0700 1 -- 172.21.15.154:0/1759990288 >> v1:172.21.15.154:6789/0 conn(0x7f3f741341c0 legacy=0x7f3f7413aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f78dd0700 1 -- 172.21.15.154:0/1759990288 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7406cb80 con 0x7f3f7409e950 2023-09-30T22:28:25.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.480+0000 7f3f78dd0700 1 --2- 172.21.15.154:0/1759990288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409e950 0x7f3f7409ed20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009880 tx=0x7f3f68009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1b6ce09ca491e50 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f737fe700 1 -- 172.21.15.154:0/1759990288 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68005e30 con 0x7f3f7409e950 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f737fe700 1 -- 172.21.15.154:0/1759990288 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68006030 con 0x7f3f7409e950 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f737fe700 1 -- 172.21.15.154:0/1759990288 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680063c0 con 0x7f3f7409e950 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f7b034700 1 -- 172.21.15.154:0/1759990288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409e950 msgr2=0x7f3f7409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f7b034700 1 --2- 172.21.15.154:0/1759990288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409e950 0x7f3f7409ed20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009880 tx=0x7f3f68009b90 comp rx=0 tx=0).stop 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f7b034700 1 -- 172.21.15.154:0/1759990288 shutdown_connections 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f7b034700 1 --2- 172.21.15.154:0/1759990288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409e950 0x7f3f7409ed20 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f7b034700 1 --2- 172.21.15.154:0/1759990288 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409f260 0x7f3f74133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f7b034700 1 -- 172.21.15.154:0/1759990288 >> 172.21.15.154:0/1759990288 conn(0x7f3f740a0f70 msgr2=0x7f3f740a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f7b034700 1 -- 172.21.15.154:0/1759990288 shutdown_connections 2023-09-30T22:28:25.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.481+0000 7f3f7b034700 1 -- 172.21.15.154:0/1759990288 wait complete. 2023-09-30T22:28:25.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.482+0000 7f3f7b034700 1 Processor -- start 2023-09-30T22:28:25.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.482+0000 7f3f7b034700 1 -- start start 2023-09-30T22:28:25.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f7b034700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409e950 0x7f3f741c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f7b034700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409f260 0x7f3f741c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f7b034700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f741341c0 0x7f3f741c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f7b034700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74120ad0 con 0x7f3f741341c0 2023-09-30T22:28:25.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f7b034700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f741208e0 con 0x7f3f7409f260 2023-09-30T22:28:25.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f7b034700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74122580 con 0x7f3f7409e950 2023-09-30T22:28:25.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f78dd0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409e950 0x7f3f741c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f78dd0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409e950 0x7f3f741c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54218/0 (socket says 172.21.15.154:54218) 2023-09-30T22:28:25.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f78dd0700 1 -- 172.21.15.154:0/2867174291 learned_addr learned my addr 172.21.15.154:0/2867174291 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f73fff700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409f260 0x7f3f741c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f795d1700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f741341c0 0x7f3f741c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f78dd0700 1 -- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409f260 msgr2=0x7f3f741c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f78dd0700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409f260 0x7f3f741c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f78dd0700 1 -- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f741341c0 msgr2=0x7f3f741c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f78dd0700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f741341c0 0x7f3f741c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f78dd0700 1 -- 172.21.15.154:0/2867174291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f68009430 con 0x7f3f7409e950 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.483+0000 7f3f73fff700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409f260 0x7f3f741c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.484+0000 7f3f78dd0700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409e950 0x7f3f741c8730 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3f68000c00 tx=0x7f3f68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.484+0000 7f3f717fa700 1 -- 172.21.15.154:0/2867174291 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680063a0 con 0x7f3f7409e950 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.484+0000 7f3f717fa700 1 -- 172.21.15.154:0/2867174291 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68006520 con 0x7f3f7409e950 2023-09-30T22:28:25.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.484+0000 7f3f7b034700 1 -- 172.21.15.154:0/2867174291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f74133d10 con 0x7f3f7409e950 2023-09-30T22:28:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.484+0000 7f3f717fa700 1 -- 172.21.15.154:0/2867174291 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680068d0 con 0x7f3f7409e950 2023-09-30T22:28:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.484+0000 7f3f7b034700 1 -- 172.21.15.154:0/2867174291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f74121550 con 0x7f3f7409e950 2023-09-30T22:28:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.485+0000 7f3f717fa700 1 -- 172.21.15.154:0/2867174291 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f68022020 con 0x7f3f7409e950 2023-09-30T22:28:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.485+0000 7f3f717fa700 1 -- 172.21.15.154:0/2867174291 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f68040c70 con 0x7f3f7409e950 2023-09-30T22:28:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.485+0000 7f3f7b034700 1 -- 172.21.15.154:0/2867174291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7404f2a0 con 0x7f3f7409e950 2023-09-30T22:28:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.490+0000 7f3f717fa700 1 -- 172.21.15.154:0/2867174291 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f6802a020 con 0x7f3f7409e950 2023-09-30T22:28:25.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.552+0000 7fd5d9709700 1 Processor -- start 2023-09-30T22:28:25.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.552+0000 7fd5d9709700 1 -- start start 2023-09-30T22:28:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.553+0000 7fd5d9709700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4133900 0x7fd5d4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.553+0000 7fd5d9709700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d40a10b0 0x7fd5d413b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.553+0000 7fd5d9709700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d409a760 con 0x7fd5d4134210 2023-09-30T22:28:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.553+0000 7fd5d9709700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d41336e0 con 0x7fd5d40a10b0 2023-09-30T22:28:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.553+0000 7fd5d9709700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d409a080 con 0x7fd5d4133900 2023-09-30T22:28:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.553+0000 7fd5d27fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd5d4134210 0x7fd5d40a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56694/0 (socket says 172.21.15.154:56694) 2023-09-30T22:28:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.553+0000 7fd5d27fc700 1 -- 172.21.15.154:0/3175908071 learned_addr learned my addr 172.21.15.154:0/3175908071 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.553+0000 7fd5d37fe700 1 --2- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d40a10b0 0x7fd5d413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d2ffd700 1 --2- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4133900 0x7fd5d4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d37fe700 1 -- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4133900 msgr2=0x7fd5d4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d37fe700 1 --2- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4133900 0x7fd5d4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d37fe700 1 -- 172.21.15.154:0/3175908071 >> v1:172.21.15.154:6789/0 conn(0x7fd5d4134210 legacy=0x7fd5d40a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d37fe700 1 -- 172.21.15.154:0/3175908071 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d40a23e0 con 0x7fd5d40a10b0 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d2ffd700 1 --2- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4133900 0x7fd5d4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d37fe700 1 --2- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d40a10b0 0x7fd5d413b910 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009dc0 tx=0x7fd5cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fce23636db3f09a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d1ffb700 1 -- 172.21.15.154:0/3175908071 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00e070 con 0x7fd5d40a10b0 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d1ffb700 1 -- 172.21.15.154:0/3175908071 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc00bbd0 con 0x7fd5d40a10b0 2023-09-30T22:28:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.554+0000 7fd5d1ffb700 1 -- 172.21.15.154:0/3175908071 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc012430 con 0x7fd5d40a10b0 2023-09-30T22:28:25.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.555+0000 7fd5d9709700 1 -- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d40a10b0 msgr2=0x7fd5d413b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.555+0000 7fd5d9709700 1 --2- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d40a10b0 0x7fd5d413b910 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009dc0 tx=0x7fd5cc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.555+0000 7fd5d9709700 1 -- 172.21.15.154:0/3175908071 shutdown_connections 2023-09-30T22:28:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.555+0000 7fd5d9709700 1 --2- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d40a10b0 0x7fd5d413b910 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.555+0000 7fd5d9709700 1 --2- 172.21.15.154:0/3175908071 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4133900 0x7fd5d4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.555+0000 7fd5d9709700 1 -- 172.21.15.154:0/3175908071 >> 172.21.15.154:0/3175908071 conn(0x7fd5d40a2980 msgr2=0x7fd5d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.555+0000 7fd5d9709700 1 -- 172.21.15.154:0/3175908071 shutdown_connections 2023-09-30T22:28:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.555+0000 7fd5d9709700 1 -- 172.21.15.154:0/3175908071 wait complete. 2023-09-30T22:28:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.557+0000 7fd5d9709700 1 Processor -- start 2023-09-30T22:28:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.557+0000 7fd5d9709700 1 -- start start 2023-09-30T22:28:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.557+0000 7fd5d9709700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d40a10b0 0x7fd5d411d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.557+0000 7fd5d9709700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d4133900 0x7fd5d411dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.557+0000 7fd5d9709700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4134210 0x7fd5d411e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.557+0000 7fd5d9709700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d411f3b0 con 0x7fd5d40a10b0 2023-09-30T22:28:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.557+0000 7fd5d9709700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d411f9d0 con 0x7fd5d4133900 2023-09-30T22:28:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.557+0000 7fd5d9709700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4120600 con 0x7fd5d4134210 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d40a10b0 0x7fd5d411d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d2ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d40a10b0 0x7fd5d411d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52584/0 (socket says 172.21.15.154:52584) 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d2ffd700 1 -- 172.21.15.154:0/2110859389 learned_addr learned my addr 172.21.15.154:0/2110859389 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d27fc700 1 --2- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d4133900 0x7fd5d411dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d37fe700 1 --2- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4134210 0x7fd5d411e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d2ffd700 1 -- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4134210 msgr2=0x7fd5d411e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d2ffd700 1 --2- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4134210 0x7fd5d411e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d2ffd700 1 -- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d4133900 msgr2=0x7fd5d411dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d2ffd700 1 --2- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d4133900 0x7fd5d411dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d2ffd700 1 -- 172.21.15.154:0/2110859389 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc009a70 con 0x7fd5d40a10b0 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d2ffd700 1 --2- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d40a10b0 0x7fd5d411d840 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e820 tx=0x7fd5c400eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5bb7fe700 1 -- 172.21.15.154:0/2110859389 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4005c20 con 0x7fd5d40a10b0 2023-09-30T22:28:25.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5bb7fe700 1 -- 172.21.15.154:0/2110859389 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c4005d80 con 0x7fd5d40a10b0 2023-09-30T22:28:25.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5bb7fe700 1 -- 172.21.15.154:0/2110859389 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4006270 con 0x7fd5d40a10b0 2023-09-30T22:28:25.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d9709700 1 -- 172.21.15.154:0/2110859389 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d4120fe0 con 0x7fd5d40a10b0 2023-09-30T22:28:25.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.558+0000 7fd5d9709700 1 -- 172.21.15.154:0/2110859389 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d4120ab0 con 0x7fd5d40a10b0 2023-09-30T22:28:25.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.559+0000 7fd5bb7fe700 1 -- 172.21.15.154:0/2110859389 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5c40063d0 con 0x7fd5d40a10b0 2023-09-30T22:28:25.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.560+0000 7fd5bb7fe700 1 -- 172.21.15.154:0/2110859389 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5c403f010 con 0x7fd5d40a10b0 2023-09-30T22:28:25.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.560+0000 7fd5d9709700 1 -- 172.21.15.154:0/2110859389 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d4120a50 con 0x7fd5d40a10b0 2023-09-30T22:28:25.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.568+0000 7fd5bb7fe700 1 -- 172.21.15.154:0/2110859389 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5c4013410 con 0x7fd5d40a10b0 2023-09-30T22:28:25.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.602+0000 7f22127fc700 1 -- 172.21.15.154:0/2159854359 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f222c11c310 con 0x7f222c133b80 2023-09-30T22:28:25.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.602+0000 7f2228ff9700 1 -- 172.21.15.154:0/2159854359 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f222c11c310 con 0x7f222c133b80 2023-09-30T22:28:25.603 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:25.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.604+0000 7f22127fc700 1 -- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c133b80 msgr2=0x7f222c119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.604+0000 7f22127fc700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c133b80 0x7f222c119330 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f222c0a2370 tx=0x7f2220004750 comp rx=0 tx=0).stop 2023-09-30T22:28:25.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.604+0000 7f22127fc700 1 -- 172.21.15.154:0/2159854359 shutdown_connections 2023-09-30T22:28:25.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.604+0000 7f22127fc700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f222c138e30 0x7f222c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.604+0000 7f22127fc700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f222c099a60 0x7f222c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.604+0000 7f22127fc700 1 --2- 172.21.15.154:0/2159854359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f222c133b80 0x7f222c119330 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.604+0000 7f22127fc700 1 -- 172.21.15.154:0/2159854359 >> 172.21.15.154:0/2159854359 conn(0x7f222c0a2980 msgr2=0x7f222c1314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.605+0000 7f22127fc700 1 -- 172.21.15.154:0/2159854359 shutdown_connections 2023-09-30T22:28:25.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.605+0000 7f22127fc700 1 -- 172.21.15.154:0/2159854359 wait complete. 2023-09-30T22:28:25.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:25.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.689+0000 7fe5ba950700 1 -- 172.21.15.154:0/2918190933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5b404f2a0 con 0x7fe5b4134210 2023-09-30T22:28:25.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.690+0000 7f3f7b034700 1 -- 172.21.15.154:0/2867174291 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f740a0850 con 0x7f3f7409e950 2023-09-30T22:28:25.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.690+0000 7fe5b0ff9700 1 -- 172.21.15.154:0/2918190933 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5ac018020 con 0x7fe5b4134210 2023-09-30T22:28:25.691 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:25.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.690+0000 7f3f717fa700 1 -- 172.21.15.154:0/2867174291 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f68034090 con 0x7f3f7409e950 2023-09-30T22:28:25.692 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:25.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.692+0000 7fe5ba950700 1 -- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 msgr2=0x7fe5b4120570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.692+0000 7fe5ba950700 1 --2- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b4120570 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac002230 tx=0x7fe5ac00cf50 comp rx=0 tx=0).stop 2023-09-30T22:28:25.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.692+0000 7fe5ba950700 1 -- 172.21.15.154:0/2918190933 shutdown_connections 2023-09-30T22:28:25.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.692+0000 7fe5ba950700 1 --2- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5b4134210 0x7fe5b4120570 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.692+0000 7fe5ba950700 1 --2- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5b40a0ee0 0x7fe5b411faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.692+0000 7fe5ba950700 1 --2- 172.21.15.154:0/2918190933 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe5b4133900 0x7fe5b4120030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.692+0000 7fe5ba950700 1 -- 172.21.15.154:0/2918190933 >> 172.21.15.154:0/2918190933 conn(0x7fe5b40a2980 msgr2=0x7fe5b409ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.692+0000 7fe5ba950700 1 -- 172.21.15.154:0/2918190933 shutdown_connections 2023-09-30T22:28:25.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.692+0000 7fe5ba950700 1 -- 172.21.15.154:0/2918190933 wait complete. 2023-09-30T22:28:25.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.693+0000 7f3f7b034700 1 -- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409e950 msgr2=0x7f3f741c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.693+0000 7f3f7b034700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409e950 0x7f3f741c8730 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3f68000c00 tx=0x7f3f68004750 comp rx=0 tx=0).stop 2023-09-30T22:28:25.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.693+0000 7f3f7b034700 1 -- 172.21.15.154:0/2867174291 shutdown_connections 2023-09-30T22:28:25.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.693+0000 7f3f7b034700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f741341c0 0x7f3f741c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.693+0000 7f3f7b034700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f7409e950 0x7f3f741c8730 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.693+0000 7f3f7b034700 1 --2- 172.21.15.154:0/2867174291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7409f260 0x7f3f741c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.693+0000 7f3f7b034700 1 -- 172.21.15.154:0/2867174291 >> 172.21.15.154:0/2867174291 conn(0x7f3f740a0f70 msgr2=0x7f3f74071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.693+0000 7f3f7b034700 1 -- 172.21.15.154:0/2867174291 shutdown_connections 2023-09-30T22:28:25.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.693+0000 7f3f7b034700 1 -- 172.21.15.154:0/2867174291 wait complete. 2023-09-30T22:28:25.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:25.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.762+0000 7fd5d9709700 1 -- 172.21.15.154:0/2110859389 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd5d404f2a0 con 0x7fd5d40a10b0 2023-09-30T22:28:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.762+0000 7fd5bb7fe700 1 -- 172.21.15.154:0/2110859389 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5c4023350 con 0x7fd5d40a10b0 2023-09-30T22:28:25.763 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.764+0000 7fd5d9709700 1 -- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d40a10b0 msgr2=0x7fd5d411d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.764+0000 7fd5d9709700 1 --2- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d40a10b0 0x7fd5d411d840 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e820 tx=0x7fd5c400eb30 comp rx=0 tx=0).stop 2023-09-30T22:28:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.764+0000 7fd5d9709700 1 -- 172.21.15.154:0/2110859389 shutdown_connections 2023-09-30T22:28:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.764+0000 7fd5d9709700 1 --2- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd5d4134210 0x7fd5d411e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.764+0000 7fd5d9709700 1 --2- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d40a10b0 0x7fd5d411d840 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.764+0000 7fd5d9709700 1 --2- 172.21.15.154:0/2110859389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d4133900 0x7fd5d411dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.764+0000 7fd5d9709700 1 -- 172.21.15.154:0/2110859389 >> 172.21.15.154:0/2110859389 conn(0x7fd5d40a2980 msgr2=0x7fd5d41b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.764+0000 7fd5d9709700 1 -- 172.21.15.154:0/2110859389 shutdown_connections 2023-09-30T22:28:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:25.764+0000 7fd5d9709700 1 -- 172.21.15.154:0/2110859389 wait complete. 2023-09-30T22:28:25.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:26.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:26.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:26.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:26.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.758+0000 7fe2c5b82700 1 Processor -- start 2023-09-30T22:28:26.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.758+0000 7fe2c5b82700 1 -- start start 2023-09-30T22:28:26.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.759+0000 7fe2c5b82700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c0138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.759+0000 7fe2c5b82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 0x7fe2c013b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.759+0000 7fe2c5b82700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c0133640 con 0x7fe2c0133a70 2023-09-30T22:28:26.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.759+0000 7fe2c5b82700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00a1d50 con 0x7fe2c0136950 2023-09-30T22:28:26.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.759+0000 7fe2c5b82700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0134550 con 0x7fe2c0139270 2023-09-30T22:28:26.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.759+0000 7fe2beffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c0138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.759+0000 7fe2bf7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe2c0133a70 0x7fe2c0133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56700/0 (socket says 172.21.15.154:56700) 2023-09-30T22:28:26.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.759+0000 7fe2bffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 0x7fe2c013b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.759+0000 7fe2bf7fe700 1 -- 172.21.15.154:0/1293721661 learned_addr learned my addr 172.21.15.154:0/1293721661 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:26.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.760+0000 7fe2bffff700 1 -- 172.21.15.154:0/1293721661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 msgr2=0x7fe2c0138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.760+0000 7fe2bffff700 1 --2- 172.21.15.154:0/1293721661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c0138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.760+0000 7fe2bffff700 1 -- 172.21.15.154:0/1293721661 >> v1:172.21.15.154:6789/0 conn(0x7fe2c0133a70 legacy=0x7fe2c0133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.760+0000 7fe2bffff700 1 -- 172.21.15.154:0/1293721661 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c009b620 con 0x7fe2c0139270 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.760+0000 7fe2beffd700 1 --2- 172.21.15.154:0/1293721661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c0138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.760+0000 7fe2bffff700 1 --2- 172.21.15.154:0/1293721661 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 0x7fe2c013b650 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009dc0 tx=0x7fe2b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8151234ce686a9cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.760+0000 7fe2be7fc700 1 -- 172.21.15.154:0/1293721661 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800e070 con 0x7fe2c0139270 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.760+0000 7fe2be7fc700 1 -- 172.21.15.154:0/1293721661 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800bb20 con 0x7fe2c0139270 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.760+0000 7fe2be7fc700 1 -- 172.21.15.154:0/1293721661 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8012430 con 0x7fe2c0139270 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.761+0000 7fe2c5b82700 1 -- 172.21.15.154:0/1293721661 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 msgr2=0x7fe2c013b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.761+0000 7fe2c5b82700 1 --2- 172.21.15.154:0/1293721661 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 0x7fe2c013b650 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009dc0 tx=0x7fe2b800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.761+0000 7fe2c5b82700 1 -- 172.21.15.154:0/1293721661 shutdown_connections 2023-09-30T22:28:26.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.761+0000 7fe2c5b82700 1 --2- 172.21.15.154:0/1293721661 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 0x7fe2c013b650 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.761+0000 7fe2c5b82700 1 --2- 172.21.15.154:0/1293721661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c0138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.761+0000 7fe2c5b82700 1 -- 172.21.15.154:0/1293721661 >> 172.21.15.154:0/1293721661 conn(0x7fe2c00a2980 msgr2=0x7fe2c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:26.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.761+0000 7fe2c5b82700 1 -- 172.21.15.154:0/1293721661 shutdown_connections 2023-09-30T22:28:26.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.761+0000 7fe2c5b82700 1 -- 172.21.15.154:0/1293721661 wait complete. 2023-09-30T22:28:26.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.762+0000 7fe2c5b82700 1 Processor -- start 2023-09-30T22:28:26.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.762+0000 7fe2c5b82700 1 -- start start 2023-09-30T22:28:26.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.762+0000 7fe2c5b82700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c0133a70 0x7fe2c01c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.762+0000 7fe2c5b82700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c01c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.762+0000 7fe2c5b82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 0x7fe2c01c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.762+0000 7fe2c5b82700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c011be10 con 0x7fe2c0133a70 2023-09-30T22:28:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.762+0000 7fe2c5b82700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c011c8e0 con 0x7fe2c0136950 2023-09-30T22:28:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.762+0000 7fe2c5b82700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c011c4d0 con 0x7fe2c0139270 2023-09-30T22:28:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.762+0000 7fe2bf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c0133a70 0x7fe2c01c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2bf7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c0133a70 0x7fe2c01c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52586/0 (socket says 172.21.15.154:52586) 2023-09-30T22:28:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2beffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c01c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2bf7fe700 1 -- 172.21.15.154:0/3581421545 learned_addr learned my addr 172.21.15.154:0/3581421545 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2bffff700 1 --2- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 0x7fe2c01c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2bf7fe700 1 -- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 msgr2=0x7fe2c01c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2bf7fe700 1 --2- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 0x7fe2c01c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2bf7fe700 1 -- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 msgr2=0x7fe2c01c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2bf7fe700 1 --2- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c01c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2bf7fe700 1 -- 172.21.15.154:0/3581421545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40094a0 con 0x7fe2c0133a70 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2beffd700 1 --2- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c01c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2bf7fe700 1 --2- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c0133a70 0x7fe2c01c8460 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000c760 tx=0x7fe2b000ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2a7fff700 1 -- 172.21.15.154:0/3581421545 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00074e0 con 0x7fe2c0133a70 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2a7fff700 1 -- 172.21.15.154:0/3581421545 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b0007640 con 0x7fe2c0133a70 2023-09-30T22:28:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2c5b82700 1 -- 172.21.15.154:0/3581421545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b8009a70 con 0x7fe2c0133a70 2023-09-30T22:28:26.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2a7fff700 1 -- 172.21.15.154:0/3581421545 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0005a30 con 0x7fe2c0133a70 2023-09-30T22:28:26.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.763+0000 7fe2c5b82700 1 -- 172.21.15.154:0/3581421545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c009a350 con 0x7fe2c0133a70 2023-09-30T22:28:26.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.764+0000 7fe2a7fff700 1 -- 172.21.15.154:0/3581421545 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2b0005b90 con 0x7fe2c0133a70 2023-09-30T22:28:26.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.764+0000 7fe2a7fff700 1 -- 172.21.15.154:0/3581421545 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe2b003eab0 con 0x7fe2c0133a70 2023-09-30T22:28:26.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.764+0000 7fe2c5b82700 1 -- 172.21.15.154:0/3581421545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c004f2a0 con 0x7fe2c0133a70 2023-09-30T22:28:26.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.769+0000 7fe2a7fff700 1 -- 172.21.15.154:0/3581421545 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2b001b3b0 con 0x7fe2c0133a70 2023-09-30T22:28:26.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:26.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7f216a760700 1 Processor -- start 2023-09-30T22:28:26.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7fc391b80700 1 Processor -- start 2023-09-30T22:28:26.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7f216a760700 1 -- start start 2023-09-30T22:28:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7fc391b80700 1 -- start start 2023-09-30T22:28:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7f216a760700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21640a0a70 0x7f21640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7f216a760700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2164134120 0x7f216413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7f216a760700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216409dc00 con 0x7f21640a1380 2023-09-30T22:28:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7f216a760700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216409ea60 con 0x7f2164134120 2023-09-30T22:28:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7f216a760700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f216409dec0 con 0x7f21640a0a70 2023-09-30T22:28:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7fc391b80700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c0a0a70 0x7fc38c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7fc391b80700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc38c0a1380 0x7fc38c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7fc391b80700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c133f50 0x7fc38c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7fc391b80700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38c09e9d0 con 0x7fc38c0a1380 2023-09-30T22:28:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7fc391b80700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c09dc00 con 0x7fc38c133f50 2023-09-30T22:28:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.841+0000 7fc391b80700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c09dec0 con 0x7fc38c0a0a70 2023-09-30T22:28:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c0a0a70 0x7fc38c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c0a0a70 0x7fc38c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54262/0 (socket says 172.21.15.154:54262) 2023-09-30T22:28:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38b7fe700 1 -- 172.21.15.154:0/2030290347 learned_addr learned my addr 172.21.15.154:0/2030290347 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c133f50 0x7fc38c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f21637fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f21640a1380 0x7f2164133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56706/0 (socket says 172.21.15.154:56706) 2023-09-30T22:28:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f2163fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21640a0a70 0x7f21640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f21637fe700 1 -- 172.21.15.154:0/3060244905 learned_addr learned my addr 172.21.15.154:0/3060244905 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38b7fe700 1 -- 172.21.15.154:0/2030290347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c133f50 msgr2=0x7fc38c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38b7fe700 1 --2- 172.21.15.154:0/2030290347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c133f50 0x7fc38c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38b7fe700 1 -- 172.21.15.154:0/2030290347 >> v2:172.21.15.154:3300/0 conn(0x7fc38c0a1380 msgr2=0x7fc38c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38b7fe700 1 --2- 172.21.15.154:0/2030290347 >> v2:172.21.15.154:3300/0 conn(0x7fc38c0a1380 0x7fc38c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38b7fe700 1 -- 172.21.15.154:0/2030290347 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c09e6a0 con 0x7fc38c0a0a70 2023-09-30T22:28:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f2163fff700 1 -- 172.21.15.154:0/3060244905 >> v2:172.21.15.154:3300/0 conn(0x7f2164134120 msgr2=0x7f216413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f2163fff700 1 --2- 172.21.15.154:0/3060244905 >> v2:172.21.15.154:3300/0 conn(0x7f2164134120 0x7f216413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f2163fff700 1 -- 172.21.15.154:0/3060244905 >> v1:172.21.15.154:6789/0 conn(0x7f21640a1380 legacy=0x7f2164133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f2163fff700 1 -- 172.21.15.154:0/3060244905 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216409e6a0 con 0x7f21640a0a70 2023-09-30T22:28:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38b7fe700 1 --2- 172.21.15.154:0/2030290347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c0a0a70 0x7fc38c0a0e40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0098f0 tx=0x7fc37c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4a153db848efa8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f2163fff700 1 --2- 172.21.15.154:0/3060244905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21640a0a70 0x7f21640a0e40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2154009840 tx=0x7f2154009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3177ba44912b68a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38a7fc700 1 -- 172.21.15.154:0/2030290347 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00b8a0 con 0x7fc38c0a0a70 2023-09-30T22:28:26.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38a7fc700 1 -- 172.21.15.154:0/2030290347 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c00ba00 con 0x7fc38c0a0a70 2023-09-30T22:28:26.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7fc38a7fc700 1 -- 172.21.15.154:0/2030290347 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00bd90 con 0x7fc38c0a0a70 2023-09-30T22:28:26.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f2162ffd700 1 -- 172.21.15.154:0/3060244905 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154011830 con 0x7f21640a0a70 2023-09-30T22:28:26.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.842+0000 7f2162ffd700 1 -- 172.21.15.154:0/3060244905 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2154011990 con 0x7f21640a0a70 2023-09-30T22:28:26.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7f2162ffd700 1 -- 172.21.15.154:0/3060244905 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154011d20 con 0x7f21640a0a70 2023-09-30T22:28:26.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7fc391b80700 1 -- 172.21.15.154:0/2030290347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c0a0a70 msgr2=0x7fc38c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7fc391b80700 1 --2- 172.21.15.154:0/2030290347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c0a0a70 0x7fc38c0a0e40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0098f0 tx=0x7fc37c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:26.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7f216a760700 1 -- 172.21.15.154:0/3060244905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21640a0a70 msgr2=0x7f21640a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7f216a760700 1 --2- 172.21.15.154:0/3060244905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21640a0a70 0x7f21640a0e40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2154009840 tx=0x7f2154009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7f216a760700 1 -- 172.21.15.154:0/3060244905 shutdown_connections 2023-09-30T22:28:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7f216a760700 1 --2- 172.21.15.154:0/3060244905 >> v2:172.21.15.154:3300/0 conn(0x7f2164134120 0x7f216413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7f216a760700 1 --2- 172.21.15.154:0/3060244905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f21640a0a70 0x7f21640a0e40 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7f216a760700 1 -- 172.21.15.154:0/3060244905 >> 172.21.15.154:0/3060244905 conn(0x7f21640a6610 msgr2=0x7f21640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.843+0000 7f216a760700 1 -- 172.21.15.154:0/3060244905 shutdown_connections 2023-09-30T22:28:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.844+0000 7f216a760700 1 -- 172.21.15.154:0/3060244905 wait complete. 2023-09-30T22:28:26.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.844+0000 7f216a760700 1 Processor -- start 2023-09-30T22:28:26.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7fc38bfff700 1 --2- 172.21.15.154:0/2030290347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c133f50 0x7fc38c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:26.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7fc391b80700 1 -- 172.21.15.154:0/2030290347 shutdown_connections 2023-09-30T22:28:26.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7fc391b80700 1 --2- 172.21.15.154:0/2030290347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c133f50 0x7fc38c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7fc391b80700 1 --2- 172.21.15.154:0/2030290347 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c0a0a70 0x7fc38c0a0e40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7fc391b80700 1 --2- 172.21.15.154:0/2030290347 >> v2:172.21.15.154:3300/0 conn(0x7fc38c0a1380 0x7fc38c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7fc391b80700 1 -- 172.21.15.154:0/2030290347 >> 172.21.15.154:0/2030290347 conn(0x7fc38c0a6610 msgr2=0x7fc38c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7fc391b80700 1 -- 172.21.15.154:0/2030290347 shutdown_connections 2023-09-30T22:28:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7fc391b80700 1 -- 172.21.15.154:0/2030290347 wait complete. 2023-09-30T22:28:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7f216a760700 1 -- start start 2023-09-30T22:28:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7f216a760700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21640a0a70 0x7f21641c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7f216a760700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640a1380 0x7f21641c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7f216a760700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2164134120 0x7f2164122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7f216a760700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2164125f80 con 0x7f21640a1380 2023-09-30T22:28:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7f216a760700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2164127070 con 0x7f21640a0a70 2023-09-30T22:28:26.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.845+0000 7f216a760700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2164133aa0 con 0x7f2164134120 2023-09-30T22:28:26.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7fc391b80700 1 Processor -- start 2023-09-30T22:28:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f21637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640a1380 0x7f21641c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f21637fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640a1380 0x7f21641c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52612/0 (socket says 172.21.15.154:52612) 2023-09-30T22:28:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f21637fe700 1 -- 172.21.15.154:0/368117114 learned_addr learned my addr 172.21.15.154:0/368117114 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f2168cfd700 1 --2- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2164134120 0x7f2164122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f21637fe700 1 -- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2164134120 msgr2=0x7f2164122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f21637fe700 1 --2- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2164134120 0x7f2164122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f21637fe700 1 -- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21640a0a70 msgr2=0x7f21641c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f21637fe700 1 --2- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21640a0a70 0x7f21641c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f21637fe700 1 -- 172.21.15.154:0/368117114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540094a0 con 0x7f21640a1380 2023-09-30T22:28:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f2168cfd700 1 --2- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2164134120 0x7f2164122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7f21637fe700 1 --2- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640a1380 0x7f21641c8c40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f215800c530 tx=0x7f215800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7fc391b80700 1 -- start start 2023-09-30T22:28:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7fc391b80700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c0a0a70 0x7fc38c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7fc391b80700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc38c0a1380 0x7fc38c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7fc391b80700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c133f50 0x7fc38c06e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7fc391b80700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c071040 con 0x7fc38c0a1380 2023-09-30T22:28:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7fc391b80700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c06f6d0 con 0x7fc38c0a0a70 2023-09-30T22:28:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.846+0000 7fc391b80700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0a03e0 con 0x7fc38c133f50 2023-09-30T22:28:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c0a0a70 0x7fc38c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7f2160ff9700 1 -- 172.21.15.154:0/368117114 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158005d70 con 0x7f21640a1380 2023-09-30T22:28:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7f2160ff9700 1 -- 172.21.15.154:0/368117114 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21580070d0 con 0x7f21640a1380 2023-09-30T22:28:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7f2160ff9700 1 -- 172.21.15.154:0/368117114 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158007440 con 0x7f21640a1380 2023-09-30T22:28:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c0a0a70 0x7fc38c06dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45090/0 (socket says 172.21.15.154:45090) 2023-09-30T22:28:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc38c0a1380 0x7fc38c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38b7fe700 1 -- 172.21.15.154:0/1036681133 learned_addr learned my addr 172.21.15.154:0/1036681133 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38bfff700 1 --2- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c133f50 0x7fc38c06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7f216a760700 1 -- 172.21.15.154:0/368117114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21641261b0 con 0x7f21640a1380 2023-09-30T22:28:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7f216a760700 1 -- 172.21.15.154:0/368117114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2164124d70 con 0x7f21640a1380 2023-09-30T22:28:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38affd700 1 -- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c133f50 msgr2=0x7fc38c06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38affd700 1 --2- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c133f50 0x7fc38c06e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38affd700 1 -- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c0a0a70 msgr2=0x7fc38c06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38affd700 1 --2- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c0a0a70 0x7fc38c06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38affd700 1 -- 172.21.15.154:0/1036681133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c009550 con 0x7fc38c0a1380 2023-09-30T22:28:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.847+0000 7fc38b7fe700 1 --2- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c0a0a70 0x7fc38c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.848+0000 7fc38affd700 1 --2- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc38c0a1380 0x7fc38c06e000 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0a2b70 tx=0x7fc38000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.848+0000 7f216a760700 1 -- 172.21.15.154:0/368117114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2164124b50 con 0x7f21640a1380 2023-09-30T22:28:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.848+0000 7f2160ff9700 1 -- 172.21.15.154:0/368117114 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21580075a0 con 0x7f21640a1380 2023-09-30T22:28:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.848+0000 7fc373fff700 1 -- 172.21.15.154:0/1036681133 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380011830 con 0x7fc38c0a1380 2023-09-30T22:28:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.848+0000 7fc373fff700 1 -- 172.21.15.154:0/1036681133 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc380011990 con 0x7fc38c0a1380 2023-09-30T22:28:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.848+0000 7fc373fff700 1 -- 172.21.15.154:0/1036681133 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380011d40 con 0x7fc38c0a1380 2023-09-30T22:28:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.848+0000 7fc391b80700 1 -- 172.21.15.154:0/1036681133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c133980 con 0x7fc38c0a1380 2023-09-30T22:28:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.848+0000 7fc391b80700 1 -- 172.21.15.154:0/1036681133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c1cc880 con 0x7fc38c0a1380 2023-09-30T22:28:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.849+0000 7f2160ff9700 1 -- 172.21.15.154:0/368117114 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f215803ead0 con 0x7f21640a1380 2023-09-30T22:28:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.849+0000 7fc373fff700 1 -- 172.21.15.154:0/1036681133 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc38001a400 con 0x7fc38c0a1380 2023-09-30T22:28:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.850+0000 7fc391b80700 1 -- 172.21.15.154:0/1036681133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c074f10 con 0x7fc38c0a1380 2023-09-30T22:28:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.854+0000 7fc373fff700 1 -- 172.21.15.154:0/1036681133 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc380021cd0 con 0x7fc38c0a1380 2023-09-30T22:28:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.854+0000 7f2160ff9700 1 -- 172.21.15.154:0/368117114 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2158019b40 con 0x7f21640a1380 2023-09-30T22:28:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.862+0000 7fc373fff700 1 -- 172.21.15.154:0/1036681133 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc38001a6b0 con 0x7fc38c0a1380 2023-09-30T22:28:26.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.910+0000 7f9bec92f700 1 Processor -- start 2023-09-30T22:28:26.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.910+0000 7f9bec92f700 1 -- start start 2023-09-30T22:28:26.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.910+0000 7f9bec92f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9be8133ad0 0x7f9be8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.910+0000 7f9bec92f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81300a0 0x7f9be81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.910+0000 7f9bec92f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be806b2d0 con 0x7f9be81309f0 2023-09-30T22:28:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.910+0000 7f9bec92f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be8133610 con 0x7f9be8133ad0 2023-09-30T22:28:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9bec92f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be809a500 con 0x7f9be81300a0 2023-09-30T22:28:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be6d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9be81309f0 0x7f9be813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56712/0 (socket says 172.21.15.154:56712) 2023-09-30T22:28:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81300a0 0x7f9be81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be6d9d700 1 -- 172.21.15.154:0/240021595 learned_addr learned my addr 172.21.15.154:0/240021595 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be659c700 1 --2- 172.21.15.154:0/240021595 >> v2:172.21.15.154:3300/0 conn(0x7f9be8133ad0 0x7f9be8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be5d9b700 1 -- 172.21.15.154:0/240021595 >> v2:172.21.15.154:3300/0 conn(0x7f9be8133ad0 msgr2=0x7f9be8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be5d9b700 1 --2- 172.21.15.154:0/240021595 >> v2:172.21.15.154:3300/0 conn(0x7f9be8133ad0 0x7f9be8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be5d9b700 1 -- 172.21.15.154:0/240021595 >> v1:172.21.15.154:6789/0 conn(0x7f9be81309f0 legacy=0x7f9be813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be559a700 1 -- 172.21.15.154:0/240021595 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348051260 0 0) 0x7f9be806b2d0 con 0x7f9be81309f0 2023-09-30T22:28:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be5d9b700 1 -- 172.21.15.154:0/240021595 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be81338b0 con 0x7f9be81300a0 2023-09-30T22:28:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be5d9b700 1 --2- 172.21.15.154:0/240021595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81300a0 0x7f9be81304b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009840 tx=0x7f9bdc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2872000a072358c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be559a700 1 -- 172.21.15.154:0/240021595 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc011830 con 0x7f9be81300a0 2023-09-30T22:28:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be559a700 1 -- 172.21.15.154:0/240021595 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc011990 con 0x7f9be81300a0 2023-09-30T22:28:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.911+0000 7f9be559a700 1 -- 172.21.15.154:0/240021595 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc011d20 con 0x7f9be81300a0 2023-09-30T22:28:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.912+0000 7f9bec92f700 1 -- 172.21.15.154:0/240021595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81300a0 msgr2=0x7f9be81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.912+0000 7f9bec92f700 1 --2- 172.21.15.154:0/240021595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81300a0 0x7f9be81304b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009840 tx=0x7f9bdc009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.912+0000 7f9bec92f700 1 -- 172.21.15.154:0/240021595 shutdown_connections 2023-09-30T22:28:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.912+0000 7f9bec92f700 1 --2- 172.21.15.154:0/240021595 >> v2:172.21.15.154:3300/0 conn(0x7f9be8133ad0 0x7f9be8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.912+0000 7f9bec92f700 1 --2- 172.21.15.154:0/240021595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81300a0 0x7f9be81304b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.912+0000 7f9bec92f700 1 -- 172.21.15.154:0/240021595 >> 172.21.15.154:0/240021595 conn(0x7f9be8099c40 msgr2=0x7f9be80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.912+0000 7f9bec92f700 1 -- 172.21.15.154:0/240021595 shutdown_connections 2023-09-30T22:28:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.912+0000 7f9bec92f700 1 -- 172.21.15.154:0/240021595 wait complete. 2023-09-30T22:28:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.913+0000 7f9bec92f700 1 Processor -- start 2023-09-30T22:28:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.913+0000 7f9bec92f700 1 -- start start 2023-09-30T22:28:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9bec92f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9be81300a0 0x7f9be811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9bec92f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81309f0 0x7f9be811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9bec92f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9be8133ad0 0x7f9be811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9bec92f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be811fe30 con 0x7f9be81300a0 2023-09-30T22:28:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9bec92f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8120010 con 0x7f9be81309f0 2023-09-30T22:28:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9bec92f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9be811eb60 con 0x7f9be8133ad0 2023-09-30T22:28:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81309f0 0x7f9be811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9be81300a0 0x7f9be811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81309f0 0x7f9be811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45112/0 (socket says 172.21.15.154:45112) 2023-09-30T22:28:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be5d9b700 1 -- 172.21.15.154:0/241656620 learned_addr learned my addr 172.21.15.154:0/241656620 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be5d9b700 1 -- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9be8133ad0 msgr2=0x7f9be811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be5d9b700 1 --2- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9be8133ad0 0x7f9be811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be5d9b700 1 -- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9be81300a0 msgr2=0x7f9be811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be5d9b700 1 --2- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9be81300a0 0x7f9be811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be5d9b700 1 -- 172.21.15.154:0/241656620 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc0094a0 con 0x7f9be81309f0 2023-09-30T22:28:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.914+0000 7f9be5d9b700 1 --2- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81309f0 0x7f9be811df80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0090b0 tx=0x7f9bdc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.915+0000 7f9bd6ffd700 1 -- 172.21.15.154:0/241656620 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0036a0 con 0x7f9be81309f0 2023-09-30T22:28:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.915+0000 7f9bd6ffd700 1 -- 172.21.15.154:0/241656620 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc01e070 con 0x7f9be81309f0 2023-09-30T22:28:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.915+0000 7f9bec92f700 1 -- 172.21.15.154:0/241656620 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be812dd00 con 0x7f9be81309f0 2023-09-30T22:28:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.915+0000 7f9bd6ffd700 1 -- 172.21.15.154:0/241656620 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc003a40 con 0x7f9be81309f0 2023-09-30T22:28:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.915+0000 7f9bec92f700 1 -- 172.21.15.154:0/241656620 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be811fa70 con 0x7f9be81309f0 2023-09-30T22:28:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.916+0000 7f9bd6ffd700 1 -- 172.21.15.154:0/241656620 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bdc003ba0 con 0x7f9be81309f0 2023-09-30T22:28:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.916+0000 7f9bd4ff9700 1 -- 172.21.15.154:0/241656620 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc00052e0 con 0x7f9be81309f0 2023-09-30T22:28:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.916+0000 7f9bd6ffd700 1 -- 172.21.15.154:0/241656620 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9bdc040680 con 0x7f9be81309f0 2023-09-30T22:28:26.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.921+0000 7f9bd6ffd700 1 -- 172.21.15.154:0/241656620 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bdc010970 con 0x7f9be81309f0 2023-09-30T22:28:26.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.971+0000 7fe2c5b82700 1 -- 172.21.15.154:0/3581421545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe2c0138ff0 con 0x7fe2c0133a70 2023-09-30T22:28:26.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.971+0000 7fe2a7fff700 1 -- 172.21.15.154:0/3581421545 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2b0017020 con 0x7fe2c0133a70 2023-09-30T22:28:26.973 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:26.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.973+0000 7fe2c5b82700 1 -- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c0133a70 msgr2=0x7fe2c01c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.973+0000 7fe2c5b82700 1 --2- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c0133a70 0x7fe2c01c8460 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000c760 tx=0x7fe2b000ca70 comp rx=0 tx=0).stop 2023-09-30T22:28:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.974+0000 7fe2c5b82700 1 -- 172.21.15.154:0/3581421545 shutdown_connections 2023-09-30T22:28:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.974+0000 7fe2c5b82700 1 --2- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe2c0139270 0x7fe2c01c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.974+0000 7fe2c5b82700 1 --2- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2c0133a70 0x7fe2c01c8460 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.974+0000 7fe2c5b82700 1 --2- 172.21.15.154:0/3581421545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2c0136950 0x7fe2c01c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.974+0000 7fe2c5b82700 1 -- 172.21.15.154:0/3581421545 >> 172.21.15.154:0/3581421545 conn(0x7fe2c00a2980 msgr2=0x7fe2c00a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.974+0000 7fe2c5b82700 1 -- 172.21.15.154:0/3581421545 shutdown_connections 2023-09-30T22:28:26.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:26.974+0000 7fe2c5b82700 1 -- 172.21.15.154:0/3581421545 wait complete. 2023-09-30T22:28:26.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:27.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.056+0000 7f216a760700 1 -- 172.21.15.154:0/368117114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f216404f2a0 con 0x7f21640a1380 2023-09-30T22:28:27.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.057+0000 7f2160ff9700 1 -- 172.21.15.154:0/368117114 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2158017030 con 0x7f21640a1380 2023-09-30T22:28:27.058 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.059+0000 7f216a760700 1 -- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640a1380 msgr2=0x7f21641c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.059+0000 7f216a760700 1 --2- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640a1380 0x7f21641c8c40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f215800c530 tx=0x7f215800c840 comp rx=0 tx=0).stop 2023-09-30T22:28:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.059+0000 7f216a760700 1 -- 172.21.15.154:0/368117114 shutdown_connections 2023-09-30T22:28:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.059+0000 7f216a760700 1 --2- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2164134120 0x7f2164122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.059+0000 7f216a760700 1 --2- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21640a0a70 0x7f21641c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.059+0000 7f216a760700 1 --2- 172.21.15.154:0/368117114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21640a1380 0x7f21641c8c40 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.059+0000 7f216a760700 1 -- 172.21.15.154:0/368117114 >> 172.21.15.154:0/368117114 conn(0x7f21640a6610 msgr2=0x7f21640a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.059+0000 7f216a760700 1 -- 172.21.15.154:0/368117114 shutdown_connections 2023-09-30T22:28:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.059+0000 7f216a760700 1 -- 172.21.15.154:0/368117114 wait complete. 2023-09-30T22:28:27.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.060+0000 7fc391b80700 1 -- 172.21.15.154:0/1036681133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc38c04f2a0 con 0x7fc38c0a1380 2023-09-30T22:28:27.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.060+0000 7fc373fff700 1 -- 172.21.15.154:0/1036681133 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc380022350 con 0x7fc38c0a1380 2023-09-30T22:28:27.062 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:27.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.062+0000 7fc391b80700 1 -- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc38c0a1380 msgr2=0x7fc38c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.062+0000 7fc391b80700 1 --2- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc38c0a1380 0x7fc38c06e000 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0a2b70 tx=0x7fc38000b730 comp rx=0 tx=0).stop 2023-09-30T22:28:27.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.062+0000 7fc391b80700 1 -- 172.21.15.154:0/1036681133 shutdown_connections 2023-09-30T22:28:27.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.062+0000 7fc391b80700 1 --2- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc38c133f50 0x7fc38c06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.062+0000 7fc391b80700 1 --2- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc38c0a0a70 0x7fc38c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.062+0000 7fc391b80700 1 --2- 172.21.15.154:0/1036681133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc38c0a1380 0x7fc38c06e000 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.062+0000 7fc391b80700 1 -- 172.21.15.154:0/1036681133 >> 172.21.15.154:0/1036681133 conn(0x7fc38c0a6610 msgr2=0x7fc38c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.062+0000 7fc391b80700 1 -- 172.21.15.154:0/1036681133 shutdown_connections 2023-09-30T22:28:27.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.062+0000 7fc391b80700 1 -- 172.21.15.154:0/1036681133 wait complete. 2023-09-30T22:28:27.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:27.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:27.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.119+0000 7f9bd4ff9700 1 -- 172.21.15.154:0/241656620 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9bc0005590 con 0x7f9be81309f0 2023-09-30T22:28:27.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.120+0000 7f9bd6ffd700 1 -- 172.21.15.154:0/241656620 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bdc015030 con 0x7f9be81309f0 2023-09-30T22:28:27.121 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:27.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.122+0000 7f9bd4ff9700 1 -- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81309f0 msgr2=0x7f9be811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.122+0000 7f9bd4ff9700 1 --2- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81309f0 0x7f9be811df80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0090b0 tx=0x7f9bdc004750 comp rx=0 tx=0).stop 2023-09-30T22:28:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.122+0000 7f9bd4ff9700 1 -- 172.21.15.154:0/241656620 shutdown_connections 2023-09-30T22:28:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.122+0000 7f9bd4ff9700 1 --2- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9be8133ad0 0x7f9be811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.122+0000 7f9bd4ff9700 1 --2- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9be81300a0 0x7f9be811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.122+0000 7f9bd4ff9700 1 --2- 172.21.15.154:0/241656620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9be81309f0 0x7f9be811df80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.122+0000 7f9bd4ff9700 1 -- 172.21.15.154:0/241656620 >> 172.21.15.154:0/241656620 conn(0x7f9be8099c40 msgr2=0x7f9be812e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.122+0000 7f9bd4ff9700 1 -- 172.21.15.154:0/241656620 shutdown_connections 2023-09-30T22:28:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:27.122+0000 7f9bd4ff9700 1 -- 172.21.15.154:0/241656620 wait complete. 2023-09-30T22:28:27.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:27.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:28.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:28.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:28.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.119+0000 7f574af6d700 1 Processor -- start 2023-09-30T22:28:28.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.119+0000 7f574af6d700 1 -- start start 2023-09-30T22:28:28.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f574af6d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5744133ad0 0x7f5744133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f574af6d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57441300a0 0x7f57441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f574af6d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574406b2d0 con 0x7f57441309f0 2023-09-30T22:28:28.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f574af6d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5744133610 con 0x7f5744133ad0 2023-09-30T22:28:28.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f574af6d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574409a500 con 0x7f57441300a0 2023-09-30T22:28:28.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f5743fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57441300a0 0x7f57441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f5743fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57441300a0 0x7f57441304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45122/0 (socket says 172.21.15.154:45122) 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f5743fff700 1 -- 172.21.15.154:0/363102513 learned_addr learned my addr 172.21.15.154:0/363102513 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f5743fff700 1 -- 172.21.15.154:0/363102513 >> v2:172.21.15.154:3300/0 conn(0x7f5744133ad0 msgr2=0x7f5744133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f5743fff700 1 --2- 172.21.15.154:0/363102513 >> v2:172.21.15.154:3300/0 conn(0x7f5744133ad0 0x7f5744133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f5743fff700 1 -- 172.21.15.154:0/363102513 >> v1:172.21.15.154:6789/0 conn(0x7f57441309f0 legacy=0x7f574413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f5743fff700 1 -- 172.21.15.154:0/363102513 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57441338b0 con 0x7f57441300a0 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.120+0000 7f5743fff700 1 --2- 172.21.15.154:0/363102513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57441300a0 0x7f57441304b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f57300098f0 tx=0x7f5730009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af5b03b643383751 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.121+0000 7f57437fe700 1 -- 172.21.15.154:0/363102513 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730004230 con 0x7f57441300a0 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.121+0000 7f57437fe700 1 -- 172.21.15.154:0/363102513 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5730004390 con 0x7f57441300a0 2023-09-30T22:28:28.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.121+0000 7f57437fe700 1 -- 172.21.15.154:0/363102513 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300036a0 con 0x7f57441300a0 2023-09-30T22:28:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.122+0000 7f574af6d700 1 -- 172.21.15.154:0/363102513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57441300a0 msgr2=0x7f57441304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.122+0000 7f574af6d700 1 --2- 172.21.15.154:0/363102513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57441300a0 0x7f57441304b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f57300098f0 tx=0x7f5730009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.122+0000 7f574af6d700 1 -- 172.21.15.154:0/363102513 shutdown_connections 2023-09-30T22:28:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.122+0000 7f574af6d700 1 --2- 172.21.15.154:0/363102513 >> v2:172.21.15.154:3300/0 conn(0x7f5744133ad0 0x7f5744133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.122+0000 7f574af6d700 1 --2- 172.21.15.154:0/363102513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57441300a0 0x7f57441304b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.122+0000 7f574af6d700 1 -- 172.21.15.154:0/363102513 >> 172.21.15.154:0/363102513 conn(0x7f5744099c40 msgr2=0x7f57440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.122+0000 7f574af6d700 1 -- 172.21.15.154:0/363102513 shutdown_connections 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.122+0000 7f574af6d700 1 -- 172.21.15.154:0/363102513 wait complete. 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f574af6d700 1 Processor -- start 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f574af6d700 1 -- start start 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f574af6d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57441300a0 0x7f574411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f574af6d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57441309f0 0x7f574411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f574af6d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5744133ad0 0x7f574411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f574af6d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744120e70 con 0x7f57441309f0 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f574af6d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440a2ea0 con 0x7f5744133ad0 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f574af6d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f574412dd00 con 0x7f57441300a0 2023-09-30T22:28:28.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f5743fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57441309f0 0x7f574411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f5743fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57441309f0 0x7f574411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52666/0 (socket says 172.21.15.154:52666) 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f5743fff700 1 -- 172.21.15.154:0/1223176456 learned_addr learned my addr 172.21.15.154:0/1223176456 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f5748d09700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57441300a0 0x7f574411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.123+0000 7f574950a700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5744133ad0 0x7f574411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f574950a700 1 -- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57441300a0 msgr2=0x7f574411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f574950a700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57441300a0 0x7f574411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f574950a700 1 -- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57441309f0 msgr2=0x7f574411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f574950a700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57441309f0 0x7f574411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f574950a700 1 -- 172.21.15.154:0/1223176456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009550 con 0x7f5744133ad0 2023-09-30T22:28:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f5748d09700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57441300a0 0x7f574411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f5743fff700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57441309f0 0x7f574411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f574950a700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5744133ad0 0x7f574411e4c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f573c00c780 tx=0x7f573c00ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f57417fa700 1 -- 172.21.15.154:0/1223176456 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c003e10 con 0x7f5744133ad0 2023-09-30T22:28:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f57417fa700 1 -- 172.21.15.154:0/1223176456 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c0050d0 con 0x7f5744133ad0 2023-09-30T22:28:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f57417fa700 1 -- 172.21.15.154:0/1223176456 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c005480 con 0x7f5744133ad0 2023-09-30T22:28:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f574af6d700 1 -- 172.21.15.154:0/1223176456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5744072400 con 0x7f5744133ad0 2023-09-30T22:28:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.124+0000 7f574af6d700 1 -- 172.21.15.154:0/1223176456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5744120290 con 0x7f5744133ad0 2023-09-30T22:28:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.125+0000 7f57417fa700 1 -- 172.21.15.154:0/1223176456 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f573c0055e0 con 0x7f5744133ad0 2023-09-30T22:28:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.125+0000 7f57417fa700 1 -- 172.21.15.154:0/1223176456 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f573c03e8a0 con 0x7f5744133ad0 2023-09-30T22:28:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.125+0000 7f574af6d700 1 -- 172.21.15.154:0/1223176456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574404f2a0 con 0x7f5744133ad0 2023-09-30T22:28:28.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.130+0000 7f57417fa700 1 -- 172.21.15.154:0/1223176456 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f573c017080 con 0x7f5744133ad0 2023-09-30T22:28:28.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:28.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.206+0000 7fd011ada700 1 Processor -- start 2023-09-30T22:28:28.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.206+0000 7fd011ada700 1 -- start start 2023-09-30T22:28:28.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd011ada700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd00c06a770 0x7fd00c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd011ada700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd011ada700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c09dea0 0x7fd00c09e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd011ada700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00c06b2e0 con 0x7fd00c06a770 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd011ada700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c09eca0 con 0x7fd00c09dea0 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd011ada700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c09f720 con 0x7fd00c134f00 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c09d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54298/0 (socket says 172.21.15.154:54298) 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00affd700 1 -- 172.21.15.154:0/476443720 learned_addr learned my addr 172.21.15.154:0/476443720 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00bfff700 1 --2- 172.21.15.154:0/476443720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c09dea0 0x7fd00c09e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00b7fe700 1 --2- 172.21.15.154:0/476443720 >> v2:172.21.15.154:3300/0 conn(0x7fd00c06a770 0x7fd00c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00affd700 1 -- 172.21.15.154:0/476443720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c09dea0 msgr2=0x7fd00c09e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00affd700 1 --2- 172.21.15.154:0/476443720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c09dea0 0x7fd00c09e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00affd700 1 -- 172.21.15.154:0/476443720 >> v2:172.21.15.154:3300/0 conn(0x7fd00c06a770 msgr2=0x7fd00c1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00affd700 1 --2- 172.21.15.154:0/476443720 >> v2:172.21.15.154:3300/0 conn(0x7fd00c06a770 0x7fd00c1349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00affd700 1 -- 172.21.15.154:0/476443720 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c06b480 con 0x7fd00c134f00 2023-09-30T22:28:28.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00affd700 1 --2- 172.21.15.154:0/476443720 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c09d960 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd0000098f0 tx=0x7fd000009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebcb44ddad030487 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.207+0000 7fd00a7fc700 1 -- 172.21.15.154:0/476443720 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000011830 con 0x7fd00c134f00 2023-09-30T22:28:28.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd00a7fc700 1 -- 172.21.15.154:0/476443720 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd000011990 con 0x7fd00c134f00 2023-09-30T22:28:28.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd00a7fc700 1 -- 172.21.15.154:0/476443720 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000011d20 con 0x7fd00c134f00 2023-09-30T22:28:28.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd011ada700 1 -- 172.21.15.154:0/476443720 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 msgr2=0x7fd00c09d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd011ada700 1 --2- 172.21.15.154:0/476443720 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c09d960 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd0000098f0 tx=0x7fd000009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:28.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd011ada700 1 -- 172.21.15.154:0/476443720 shutdown_connections 2023-09-30T22:28:28.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd011ada700 1 --2- 172.21.15.154:0/476443720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c09dea0 0x7fd00c09e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd011ada700 1 --2- 172.21.15.154:0/476443720 >> v2:172.21.15.154:3300/0 conn(0x7fd00c06a770 0x7fd00c1349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd011ada700 1 --2- 172.21.15.154:0/476443720 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c09d960 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd011ada700 1 -- 172.21.15.154:0/476443720 >> 172.21.15.154:0/476443720 conn(0x7fd00c099c40 msgr2=0x7fd00c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd011ada700 1 -- 172.21.15.154:0/476443720 shutdown_connections 2023-09-30T22:28:28.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.208+0000 7fd011ada700 1 -- 172.21.15.154:0/476443720 wait complete. 2023-09-30T22:28:28.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.209+0000 7fd011ada700 1 Processor -- start 2023-09-30T22:28:28.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.209+0000 7fd011ada700 1 -- start start 2023-09-30T22:28:28.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd011ada700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c06a770 0x7fd00c11a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd011ada700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd00c09dea0 0x7fd00c11aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd011ada700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c11af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd011ada700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c126ba0 con 0x7fd00c09dea0 2023-09-30T22:28:28.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd011ada700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c0a0510 con 0x7fd00c06a770 2023-09-30T22:28:28.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd011ada700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c126250 con 0x7fd00c134f00 2023-09-30T22:28:28.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c06a770 0x7fd00c11a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c06a770 0x7fd00c11a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45164/0 (socket says 172.21.15.154:45164) 2023-09-30T22:28:28.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00b7fe700 1 -- 172.21.15.154:0/2152523742 learned_addr learned my addr 172.21.15.154:0/2152523742 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:28.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00bfff700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c11af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00affd700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd00c09dea0 0x7fd00c11aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00affd700 1 -- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 msgr2=0x7fd00c11af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00affd700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c11af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00affd700 1 -- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c06a770 msgr2=0x7fd00c11a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00affd700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c06a770 0x7fd00c11a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00affd700 1 -- 172.21.15.154:0/2152523742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd000009550 con 0x7fd00c09dea0 2023-09-30T22:28:28.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00bfff700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c11af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:28.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00b7fe700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c06a770 0x7fd00c11a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:28.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.210+0000 7fd00affd700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd00c09dea0 0x7fd00c11aa20 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd000016000 tx=0x7fd000004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.211+0000 7fcff3fff700 1 -- 172.21.15.154:0/2152523742 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000004450 con 0x7fd00c09dea0 2023-09-30T22:28:28.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.211+0000 7fcff3fff700 1 -- 172.21.15.154:0/2152523742 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0000045d0 con 0x7fd00c09dea0 2023-09-30T22:28:28.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.211+0000 7fd011ada700 1 -- 172.21.15.154:0/2152523742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c11d210 con 0x7fd00c09dea0 2023-09-30T22:28:28.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.211+0000 7fcff3fff700 1 -- 172.21.15.154:0/2152523742 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000038e0 con 0x7fd00c09dea0 2023-09-30T22:28:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.211+0000 7fd011ada700 1 -- 172.21.15.154:0/2152523742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c1267b0 con 0x7fd00c09dea0 2023-09-30T22:28:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.212+0000 7fcff3fff700 1 -- 172.21.15.154:0/2152523742 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd000003a40 con 0x7fd00c09dea0 2023-09-30T22:28:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.212+0000 7fcff3fff700 1 -- 172.21.15.154:0/2152523742 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd000040650 con 0x7fd00c09dea0 2023-09-30T22:28:28.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.212+0000 7fcff1ffb700 1 -- 172.21.15.154:0/2152523742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe40052e0 con 0x7fd00c09dea0 2023-09-30T22:28:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.214+0000 7fa48130e700 1 Processor -- start 2023-09-30T22:28:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.214+0000 7fa48130e700 1 -- start start 2023-09-30T22:28:28.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.215+0000 7fa48130e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c138040 0x7fa47c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.215+0000 7fa48130e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c0a08e0 0x7fa47c0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.215+0000 7fa48130e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47c1379e0 con 0x7fa47c0a1230 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.215+0000 7fa48130e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c0a2100 con 0x7fa47c138040 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.215+0000 7fa48130e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c138950 con 0x7fa47c0a08e0 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.215+0000 7fa47affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c138040 0x7fa47c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.215+0000 7fa47affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c138040 0x7fa47c138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45176/0 (socket says 172.21.15.154:45176) 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.215+0000 7fa47affd700 1 -- 172.21.15.154:0/826219128 learned_addr learned my addr 172.21.15.154:0/826219128 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.216+0000 7fa47affd700 1 -- 172.21.15.154:0/826219128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c0a08e0 msgr2=0x7fa47c0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.216+0000 7fa47affd700 1 --2- 172.21.15.154:0/826219128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c0a08e0 0x7fa47c0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.216+0000 7fa47affd700 1 -- 172.21.15.154:0/826219128 >> v1:172.21.15.154:6789/0 conn(0x7fa47c0a1230 legacy=0x7fa47c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.216+0000 7fa47affd700 1 -- 172.21.15.154:0/826219128 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c09b9b0 con 0x7fa47c138040 2023-09-30T22:28:28.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.216+0000 7fa47affd700 1 --2- 172.21.15.154:0/826219128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c138040 0x7fa47c138410 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009920 tx=0x7fa46c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e2af4bab3a8dcd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.216+0000 7fa479ffb700 1 -- 172.21.15.154:0/826219128 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c005e30 con 0x7fa47c138040 2023-09-30T22:28:28.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.216+0000 7fa479ffb700 1 -- 172.21.15.154:0/826219128 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c009e70 con 0x7fa47c138040 2023-09-30T22:28:28.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.216+0000 7fa479ffb700 1 -- 172.21.15.154:0/826219128 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c004250 con 0x7fa47c138040 2023-09-30T22:28:28.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.217+0000 7fa48130e700 1 -- 172.21.15.154:0/826219128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c138040 msgr2=0x7fa47c138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.217+0000 7fa48130e700 1 --2- 172.21.15.154:0/826219128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c138040 0x7fa47c138410 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009920 tx=0x7fa46c009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:28.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.217+0000 7fcff3fff700 1 -- 172.21.15.154:0/2152523742 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd00001a420 con 0x7fd00c09dea0 2023-09-30T22:28:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.217+0000 7fa48130e700 1 -- 172.21.15.154:0/826219128 shutdown_connections 2023-09-30T22:28:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.217+0000 7fa48130e700 1 --2- 172.21.15.154:0/826219128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c138040 0x7fa47c138410 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.217+0000 7fa48130e700 1 --2- 172.21.15.154:0/826219128 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c0a08e0 0x7fa47c0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.217+0000 7fa48130e700 1 -- 172.21.15.154:0/826219128 >> 172.21.15.154:0/826219128 conn(0x7fa47c0a2980 msgr2=0x7fa47c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.217+0000 7fa48130e700 1 -- 172.21.15.154:0/826219128 shutdown_connections 2023-09-30T22:28:28.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.218+0000 7fa48130e700 1 -- 172.21.15.154:0/826219128 wait complete. 2023-09-30T22:28:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.219+0000 7fa48130e700 1 Processor -- start 2023-09-30T22:28:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.219+0000 7fa48130e700 1 -- start start 2023-09-30T22:28:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa48130e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa47c0a08e0 0x7fa47c126570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa48130e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c0a1230 0x7fa47c126ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa48130e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c138040 0x7fa47c126ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa48130e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c129eb0 con 0x7fa47c0a08e0 2023-09-30T22:28:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa48130e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c12a090 con 0x7fa47c0a1230 2023-09-30T22:28:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa48130e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa47c129af0 con 0x7fa47c138040 2023-09-30T22:28:28.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c0a1230 0x7fa47c126ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c138040 0x7fa47c126ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c0a1230 0x7fa47c126ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45190/0 (socket says 172.21.15.154:45190) 2023-09-30T22:28:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47a7fc700 1 -- 172.21.15.154:0/3517820434 learned_addr learned my addr 172.21.15.154:0/3517820434 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47b7fe700 1 -- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c0a1230 msgr2=0x7fa47c126ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47b7fe700 1 --2- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c0a1230 0x7fa47c126ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47b7fe700 1 -- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa47c0a08e0 msgr2=0x7fa47c126570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47b7fe700 1 --2- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa47c0a08e0 0x7fa47c126570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47b7fe700 1 -- 172.21.15.154:0/3517820434 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c009500 con 0x7fa47c138040 2023-09-30T22:28:28.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.220+0000 7fa47b7fe700 1 --2- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c138040 0x7fa47c126ff0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa47400cae0 tx=0x7fa47400cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.221+0000 7fa4637fe700 1 -- 172.21.15.154:0/3517820434 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474003c00 con 0x7fa47c138040 2023-09-30T22:28:28.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.221+0000 7fa48130e700 1 -- 172.21.15.154:0/3517820434 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47c09a240 con 0x7fa47c138040 2023-09-30T22:28:28.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.221+0000 7fa48130e700 1 -- 172.21.15.154:0/3517820434 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47c137700 con 0x7fa47c138040 2023-09-30T22:28:28.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.221+0000 7fa4637fe700 1 -- 172.21.15.154:0/3517820434 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa474003d60 con 0x7fa47c138040 2023-09-30T22:28:28.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.221+0000 7fa4637fe700 1 -- 172.21.15.154:0/3517820434 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47400aac0 con 0x7fa47c138040 2023-09-30T22:28:28.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.222+0000 7fa4637fe700 1 -- 172.21.15.154:0/3517820434 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa47400ac20 con 0x7fa47c138040 2023-09-30T22:28:28.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.222+0000 7fa48130e700 1 -- 172.21.15.154:0/3517820434 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45c0052e0 con 0x7fa47c138040 2023-09-30T22:28:28.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.222+0000 7fa4637fe700 1 -- 172.21.15.154:0/3517820434 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa47403f570 con 0x7fa47c138040 2023-09-30T22:28:28.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.227+0000 7fa4637fe700 1 -- 172.21.15.154:0/3517820434 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4740196c0 con 0x7fa47c138040 2023-09-30T22:28:28.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.273+0000 7fd1e7e14700 1 Processor -- start 2023-09-30T22:28:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.273+0000 7fd1e7e14700 1 -- start start 2023-09-30T22:28:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e7e14700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1e009dd50 0x7fd1e009e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e7e14700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 0x7fd1e009b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e7e14700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e009d900 con 0x7fd1e009bce0 2023-09-30T22:28:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e5bb0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1e009dd50 0x7fd1e009e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e63b1700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd1e009bce0 0x7fd1e009c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56746/0 (socket says 172.21.15.154:56746) 2023-09-30T22:28:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e53af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 0x7fd1e009b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e63b1700 1 -- 172.21.15.154:0/688121333 learned_addr learned my addr 172.21.15.154:0/688121333 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:28.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e7e14700 1 -- 172.21.15.154:0/688121333 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e009a620 con 0x7fd1e009dd50 2023-09-30T22:28:28.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e7e14700 1 -- 172.21.15.154:0/688121333 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e009f640 con 0x7fd1e009e660 2023-09-30T22:28:28.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e4bae700 1 -- 172.21.15.154:0/688121333 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102669779 0 0) 0x7fd1e009d900 con 0x7fd1e009bce0 2023-09-30T22:28:28.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e4bae700 1 -- 172.21.15.154:0/688121333 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1cc0035b0 con 0x7fd1e009bce0 2023-09-30T22:28:28.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e53af700 1 -- 172.21.15.154:0/688121333 >> v2:172.21.15.154:3300/0 conn(0x7fd1e009dd50 msgr2=0x7fd1e009e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:28.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e53af700 1 --2- 172.21.15.154:0/688121333 >> v2:172.21.15.154:3300/0 conn(0x7fd1e009dd50 0x7fd1e009e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e53af700 1 -- 172.21.15.154:0/688121333 >> v1:172.21.15.154:6789/0 conn(0x7fd1e009bce0 legacy=0x7fd1e009c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.274+0000 7fd1e53af700 1 -- 172.21.15.154:0/688121333 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e006a9e0 con 0x7fd1e009e660 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.275+0000 7fd1e5bb0700 1 --2- 172.21.15.154:0/688121333 >> v2:172.21.15.154:3300/0 conn(0x7fd1e009dd50 0x7fd1e009e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.275+0000 7fd1e53af700 1 --2- 172.21.15.154:0/688121333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 0x7fd1e009b7a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009840 tx=0x7fd1d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb050f5d86570cbc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.275+0000 7fd1e4bae700 1 -- 172.21.15.154:0/688121333 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0011830 con 0x7fd1e009e660 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.275+0000 7fd1e4bae700 1 -- 172.21.15.154:0/688121333 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0011990 con 0x7fd1e009e660 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.275+0000 7fd1e4bae700 1 -- 172.21.15.154:0/688121333 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0011d00 con 0x7fd1e009e660 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.276+0000 7fd1e7e14700 1 -- 172.21.15.154:0/688121333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 msgr2=0x7fd1e009b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.276+0000 7fd1e7e14700 1 --2- 172.21.15.154:0/688121333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 0x7fd1e009b7a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009840 tx=0x7fd1d0009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.276+0000 7fd1e7e14700 1 -- 172.21.15.154:0/688121333 shutdown_connections 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.276+0000 7fd1e7e14700 1 --2- 172.21.15.154:0/688121333 >> v2:172.21.15.154:3300/0 conn(0x7fd1e009dd50 0x7fd1e009e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.276+0000 7fd1e7e14700 1 --2- 172.21.15.154:0/688121333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 0x7fd1e009b7a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.276+0000 7fd1e7e14700 1 -- 172.21.15.154:0/688121333 >> 172.21.15.154:0/688121333 conn(0x7fd1e009f9f0 msgr2=0x7fd1e009fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.276+0000 7fd1e7e14700 1 -- 172.21.15.154:0/688121333 shutdown_connections 2023-09-30T22:28:28.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.276+0000 7fd1e7e14700 1 -- 172.21.15.154:0/688121333 wait complete. 2023-09-30T22:28:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.277+0000 7fd1e7e14700 1 Processor -- start 2023-09-30T22:28:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.277+0000 7fd1e7e14700 1 -- start start 2023-09-30T22:28:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.277+0000 7fd1e7e14700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e009bce0 0x7fd1e01aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.277+0000 7fd1e7e14700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1e009dd50 0x7fd1e01aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e7e14700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 0x7fd1e01ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e7e14700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e01ae1a0 con 0x7fd1e009bce0 2023-09-30T22:28:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e7e14700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e01ac8b0 con 0x7fd1e009e660 2023-09-30T22:28:28.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e7e14700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e01ad930 con 0x7fd1e009dd50 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e53af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1e009dd50 0x7fd1e01aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e53af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1e009dd50 0x7fd1e01aac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54334/0 (socket says 172.21.15.154:54334) 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e53af700 1 -- 172.21.15.154:0/3667626261 learned_addr learned my addr 172.21.15.154:0/3667626261 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e5bb0700 1 --2- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e009bce0 0x7fd1e01aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e63b1700 1 --2- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 0x7fd1e01ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e53af700 1 -- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 msgr2=0x7fd1e01ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e53af700 1 --2- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 0x7fd1e01ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e53af700 1 -- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e009bce0 msgr2=0x7fd1e01aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e53af700 1 --2- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e009bce0 0x7fd1e01aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e53af700 1 -- 172.21.15.154:0/3667626261 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc009430 con 0x7fd1e009dd50 2023-09-30T22:28:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1e53af700 1 --2- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1e009dd50 0x7fd1e01aac50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009b90 tx=0x7fd1d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.278+0000 7fd1d67fc700 1 -- 172.21.15.154:0/3667626261 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0004550 con 0x7fd1e009dd50 2023-09-30T22:28:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.279+0000 7fd1d67fc700 1 -- 172.21.15.154:0/3667626261 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d001f070 con 0x7fd1e009dd50 2023-09-30T22:28:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.279+0000 7fd1e7e14700 1 -- 172.21.15.154:0/3667626261 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d00094a0 con 0x7fd1e009dd50 2023-09-30T22:28:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.279+0000 7fd1d67fc700 1 -- 172.21.15.154:0/3667626261 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00038e0 con 0x7fd1e009dd50 2023-09-30T22:28:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.279+0000 7fd1e7e14700 1 -- 172.21.15.154:0/3667626261 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e009ca20 con 0x7fd1e009dd50 2023-09-30T22:28:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.280+0000 7fd1e7e14700 1 -- 172.21.15.154:0/3667626261 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e01add20 con 0x7fd1e009dd50 2023-09-30T22:28:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.280+0000 7fd1d67fc700 1 -- 172.21.15.154:0/3667626261 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1d0003a40 con 0x7fd1e009dd50 2023-09-30T22:28:28.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.280+0000 7fd1d67fc700 1 -- 172.21.15.154:0/3667626261 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1d0021070 con 0x7fd1e009dd50 2023-09-30T22:28:28.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.288+0000 7fd1d67fc700 1 -- 172.21.15.154:0/3667626261 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1e01add20 con 0x7fd1e009dd50 2023-09-30T22:28:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.334+0000 7f574af6d700 1 -- 172.21.15.154:0/1223176456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f574406c3b0 con 0x7f5744133ad0 2023-09-30T22:28:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.334+0000 7f57417fa700 1 -- 172.21.15.154:0/1223176456 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f573c00ee60 con 0x7f5744133ad0 2023-09-30T22:28:28.335 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.336+0000 7f574af6d700 1 -- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5744133ad0 msgr2=0x7f574411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.336+0000 7f574af6d700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5744133ad0 0x7f574411e4c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f573c00c780 tx=0x7f573c00ca90 comp rx=0 tx=0).stop 2023-09-30T22:28:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.336+0000 7f574af6d700 1 -- 172.21.15.154:0/1223176456 shutdown_connections 2023-09-30T22:28:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.337+0000 7f574af6d700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5744133ad0 0x7f574411e4c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.337+0000 7f574af6d700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f57441300a0 0x7f574411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.337+0000 7f574af6d700 1 --2- 172.21.15.154:0/1223176456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57441309f0 0x7f574411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.337+0000 7f574af6d700 1 -- 172.21.15.154:0/1223176456 >> 172.21.15.154:0/1223176456 conn(0x7f5744099c40 msgr2=0x7f5744132210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.337+0000 7f574af6d700 1 -- 172.21.15.154:0/1223176456 shutdown_connections 2023-09-30T22:28:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.337+0000 7f574af6d700 1 -- 172.21.15.154:0/1223176456 wait complete. 2023-09-30T22:28:28.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.415+0000 7fcff1ffb700 1 -- 172.21.15.154:0/2152523742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcfe4005590 con 0x7fd00c09dea0 2023-09-30T22:28:28.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.415+0000 7fcff3fff700 1 -- 172.21.15.154:0/2152523742 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd000028070 con 0x7fd00c09dea0 2023-09-30T22:28:28.417 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.417+0000 7fcff1ffb700 1 -- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd00c09dea0 msgr2=0x7fd00c11aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.417+0000 7fcff1ffb700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd00c09dea0 0x7fd00c11aa20 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd000016000 tx=0x7fd000004750 comp rx=0 tx=0).stop 2023-09-30T22:28:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.417+0000 7fcff1ffb700 1 -- 172.21.15.154:0/2152523742 shutdown_connections 2023-09-30T22:28:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.417+0000 7fcff1ffb700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd00c134f00 0x7fd00c11af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.417+0000 7fcff1ffb700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd00c06a770 0x7fd00c11a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.417+0000 7fcff1ffb700 1 --2- 172.21.15.154:0/2152523742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd00c09dea0 0x7fd00c11aa20 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.417+0000 7fcff1ffb700 1 -- 172.21.15.154:0/2152523742 >> 172.21.15.154:0/2152523742 conn(0x7fd00c099c40 msgr2=0x7fd00c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.417+0000 7fcff1ffb700 1 -- 172.21.15.154:0/2152523742 shutdown_connections 2023-09-30T22:28:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.417+0000 7fcff1ffb700 1 -- 172.21.15.154:0/2152523742 wait complete. 2023-09-30T22:28:28.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:28.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.434+0000 7fa48130e700 1 -- 172.21.15.154:0/3517820434 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa45c005590 con 0x7fa47c138040 2023-09-30T22:28:28.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.435+0000 7fa4637fe700 1 -- 172.21.15.154:0/3517820434 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa474011380 con 0x7fa47c138040 2023-09-30T22:28:28.436 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:28.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.437+0000 7fa48130e700 1 -- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c138040 msgr2=0x7fa47c126ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.437+0000 7fa48130e700 1 --2- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c138040 0x7fa47c126ff0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa47400cae0 tx=0x7fa47400cdf0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.437+0000 7fa48130e700 1 -- 172.21.15.154:0/3517820434 shutdown_connections 2023-09-30T22:28:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.437+0000 7fa48130e700 1 --2- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa47c138040 0x7fa47c126ff0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.437+0000 7fa48130e700 1 --2- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa47c0a08e0 0x7fa47c126570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.437+0000 7fa48130e700 1 --2- 172.21.15.154:0/3517820434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa47c0a1230 0x7fa47c126ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.437+0000 7fa48130e700 1 -- 172.21.15.154:0/3517820434 >> 172.21.15.154:0/3517820434 conn(0x7fa47c0a2980 msgr2=0x7fa47c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.437+0000 7fa48130e700 1 -- 172.21.15.154:0/3517820434 shutdown_connections 2023-09-30T22:28:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.437+0000 7fa48130e700 1 -- 172.21.15.154:0/3517820434 wait complete. 2023-09-30T22:28:28.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.486+0000 7fd1e7e14700 1 -- 172.21.15.154:0/3667626261 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd1e01add20 con 0x7fd1e009dd50 2023-09-30T22:28:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.487+0000 7fd1d67fc700 1 -- 172.21.15.154:0/3667626261 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1e01add20 con 0x7fd1e009dd50 2023-09-30T22:28:28.488 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.489+0000 7fd1e7e14700 1 -- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1e009dd50 msgr2=0x7fd1e01aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.489+0000 7fd1e7e14700 1 --2- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1e009dd50 0x7fd1e01aac50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009b90 tx=0x7fd1d0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.489+0000 7fd1e7e14700 1 -- 172.21.15.154:0/3667626261 shutdown_connections 2023-09-30T22:28:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.489+0000 7fd1e7e14700 1 --2- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e009e660 0x7fd1e01ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.489+0000 7fd1e7e14700 1 --2- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e009bce0 0x7fd1e01aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.489+0000 7fd1e7e14700 1 --2- 172.21.15.154:0/3667626261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd1e009dd50 0x7fd1e01aac50 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.489+0000 7fd1e7e14700 1 -- 172.21.15.154:0/3667626261 >> 172.21.15.154:0/3667626261 conn(0x7fd1e009f9f0 msgr2=0x7fd1e01bf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.489+0000 7fd1e7e14700 1 -- 172.21.15.154:0/3667626261 shutdown_connections 2023-09-30T22:28:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:28.489+0000 7fd1e7e14700 1 -- 172.21.15.154:0/3667626261 wait complete. 2023-09-30T22:28:28.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:29.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:29.431 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:29.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:29.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.494+0000 7fc5a2616700 1 Processor -- start 2023-09-30T22:28:29.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc5a2616700 1 -- start start 2023-09-30T22:28:29.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc5a2616700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c133660 0x7fc59c135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc5a2616700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c135f80 0x7fc59c138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc5a2616700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c099a60 con 0x7fc59c099e20 2023-09-30T22:28:29.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc5a2616700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c09bf50 con 0x7fc59c133660 2023-09-30T22:28:29.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc5a2616700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c09b230 con 0x7fc59c135f80 2023-09-30T22:28:29.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc5a0bb3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c135f80 0x7fc59c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc59bfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc59c099e20 0x7fc59c09a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56758/0 (socket says 172.21.15.154:56758) 2023-09-30T22:28:29.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc5a0bb3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c135f80 0x7fc59c138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54346/0 (socket says 172.21.15.154:54346) 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc59bfff700 1 -- 172.21.15.154:0/708561589 learned_addr learned my addr 172.21.15.154:0/708561589 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc59b7fe700 1 --2- 172.21.15.154:0/708561589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c133660 0x7fc59c135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc5a0bb3700 1 -- 172.21.15.154:0/708561589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c133660 msgr2=0x7fc59c135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.496+0000 7fc5a0bb3700 1 --2- 172.21.15.154:0/708561589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c133660 0x7fc59c135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.496+0000 7fc5a0bb3700 1 -- 172.21.15.154:0/708561589 >> v1:172.21.15.154:6789/0 conn(0x7fc59c099e20 legacy=0x7fc59c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.496+0000 7fc5a0bb3700 1 -- 172.21.15.154:0/708561589 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c09bb90 con 0x7fc59c135f80 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.495+0000 7fc59affd700 1 -- 172.21.15.154:0/708561589 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747310157 0 0) 0x7fc59c099a60 con 0x7fc59c099e20 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.496+0000 7fc59b7fe700 1 --2- 172.21.15.154:0/708561589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c133660 0x7fc59c135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.496+0000 7fc5a0bb3700 1 --2- 172.21.15.154:0/708561589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c135f80 0x7fc59c138360 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc594009dc0 tx=0x7fc59400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20542712688d20d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.496+0000 7fc59affd700 1 -- 172.21.15.154:0/708561589 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400e070 con 0x7fc59c135f80 2023-09-30T22:28:29.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.496+0000 7fc59affd700 1 -- 172.21.15.154:0/708561589 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400bb20 con 0x7fc59c135f80 2023-09-30T22:28:29.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.496+0000 7fc59affd700 1 -- 172.21.15.154:0/708561589 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594012430 con 0x7fc59c135f80 2023-09-30T22:28:29.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.497+0000 7fc5a2616700 1 -- 172.21.15.154:0/708561589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c135f80 msgr2=0x7fc59c138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.497+0000 7fc5a2616700 1 --2- 172.21.15.154:0/708561589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c135f80 0x7fc59c138360 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc594009dc0 tx=0x7fc59400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:29.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.497+0000 7fc5a2616700 1 -- 172.21.15.154:0/708561589 shutdown_connections 2023-09-30T22:28:29.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.497+0000 7fc5a2616700 1 --2- 172.21.15.154:0/708561589 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c135f80 0x7fc59c138360 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.497+0000 7fc5a2616700 1 --2- 172.21.15.154:0/708561589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c133660 0x7fc59c135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.497+0000 7fc5a2616700 1 -- 172.21.15.154:0/708561589 >> 172.21.15.154:0/708561589 conn(0x7fc59c0a2980 msgr2=0x7fc59c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.497+0000 7fc5a2616700 1 -- 172.21.15.154:0/708561589 shutdown_connections 2023-09-30T22:28:29.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.497+0000 7fc5a2616700 1 -- 172.21.15.154:0/708561589 wait complete. 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.498+0000 7fc5a2616700 1 Processor -- start 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.498+0000 7fc5a2616700 1 -- start start 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc5a2616700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c099e20 0x7fc59c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc5a2616700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c133660 0x7fc59c119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc5a2616700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c135f80 0x7fc59c119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc5a2616700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c09b470 con 0x7fc59c133660 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc5a2616700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c12db70 con 0x7fc59c135f80 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc5a2616700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c11c820 con 0x7fc59c099e20 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c133660 0x7fc59c119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c133660 0x7fc59c119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52712/0 (socket says 172.21.15.154:52712) 2023-09-30T22:28:29.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c099e20 0x7fc59c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59b7fe700 1 -- 172.21.15.154:0/2566922616 learned_addr learned my addr 172.21.15.154:0/2566922616 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc5a0bb3700 1 --2- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c135f80 0x7fc59c119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59b7fe700 1 -- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c099e20 msgr2=0x7fc59c118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59b7fe700 1 --2- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c099e20 0x7fc59c118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59b7fe700 1 -- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c135f80 msgr2=0x7fc59c119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59b7fe700 1 --2- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c135f80 0x7fc59c119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59b7fe700 1 -- 172.21.15.154:0/2566922616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900094a0 con 0x7fc59c133660 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc5a0bb3700 1 --2- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c135f80 0x7fc59c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc59b7fe700 1 --2- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c133660 0x7fc59c119330 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fc590009ec0 tx=0x7fc59000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.499+0000 7fc598ff9700 1 -- 172.21.15.154:0/2566922616 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590013860 con 0x7fc59c133660 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.500+0000 7fc598ff9700 1 -- 172.21.15.154:0/2566922616 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5900139c0 con 0x7fc59c133660 2023-09-30T22:28:29.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.500+0000 7fc598ff9700 1 -- 172.21.15.154:0/2566922616 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590013d50 con 0x7fc59c133660 2023-09-30T22:28:29.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.500+0000 7fc5a2616700 1 -- 172.21.15.154:0/2566922616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc594009a70 con 0x7fc59c133660 2023-09-30T22:28:29.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.500+0000 7fc5a2616700 1 -- 172.21.15.154:0/2566922616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c11a910 con 0x7fc59c133660 2023-09-30T22:28:29.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.500+0000 7fc598ff9700 1 -- 172.21.15.154:0/2566922616 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc59000c640 con 0x7fc59c133660 2023-09-30T22:28:29.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:29.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.501+0000 7fc598ff9700 1 -- 172.21.15.154:0/2566922616 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5900435f0 con 0x7fc59c133660 2023-09-30T22:28:29.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.501+0000 7fc5a2616700 1 -- 172.21.15.154:0/2566922616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c072480 con 0x7fc59c133660 2023-09-30T22:28:29.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.506+0000 7fc598ff9700 1 -- 172.21.15.154:0/2566922616 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc59c072480 con 0x7fc59c133660 2023-09-30T22:28:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.566+0000 7fea3e3b7700 1 Processor -- start 2023-09-30T22:28:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.566+0000 7fea3e3b7700 1 -- start start 2023-09-30T22:28:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.566+0000 7fea3e3b7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea3809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.566+0000 7fea3e3b7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea3809e170 0x7fea381307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.566+0000 7fea3e3b7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3809aaa0 con 0x7fea38130ce0 2023-09-30T22:28:29.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.566+0000 7fea3e3b7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3809f870 con 0x7fea3809e170 2023-09-30T22:28:29.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.566+0000 7fea3e3b7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea3809b360 con 0x7fea3809d860 2023-09-30T22:28:29.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.566+0000 7fea3c954700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fea38130ce0 0x7fea381379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56762/0 (socket says 172.21.15.154:56762) 2023-09-30T22:28:29.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea3c954700 1 -- 172.21.15.154:0/528828525 learned_addr learned my addr 172.21.15.154:0/528828525 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:29.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea37fff700 1 --2- 172.21.15.154:0/528828525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea3809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea377fe700 1 --2- 172.21.15.154:0/528828525 >> v2:172.21.15.154:3300/0 conn(0x7fea3809e170 0x7fea381307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea377fe700 1 -- 172.21.15.154:0/528828525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 msgr2=0x7fea3809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea377fe700 1 --2- 172.21.15.154:0/528828525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea3809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea377fe700 1 -- 172.21.15.154:0/528828525 >> v1:172.21.15.154:6789/0 conn(0x7fea38130ce0 legacy=0x7fea381379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea377fe700 1 -- 172.21.15.154:0/528828525 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3809b620 con 0x7fea3809e170 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea37fff700 1 --2- 172.21.15.154:0/528828525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea3809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea377fe700 1 --2- 172.21.15.154:0/528828525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea3809e170 0x7fea381307a0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009840 tx=0x7fea2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2980b024d98ef24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea36ffd700 1 -- 172.21.15.154:0/528828525 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c011830 con 0x7fea3809e170 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea36ffd700 1 -- 172.21.15.154:0/528828525 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c011990 con 0x7fea3809e170 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.567+0000 7fea36ffd700 1 -- 172.21.15.154:0/528828525 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c011d20 con 0x7fea3809e170 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.568+0000 7fea3e3b7700 1 -- 172.21.15.154:0/528828525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea3809e170 msgr2=0x7fea381307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.568+0000 7fea3e3b7700 1 --2- 172.21.15.154:0/528828525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea3809e170 0x7fea381307a0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009840 tx=0x7fea2c009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.568+0000 7fea3e3b7700 1 -- 172.21.15.154:0/528828525 shutdown_connections 2023-09-30T22:28:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.568+0000 7fea3e3b7700 1 --2- 172.21.15.154:0/528828525 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea3809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.568+0000 7fea3e3b7700 1 --2- 172.21.15.154:0/528828525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea3809e170 0x7fea381307a0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.568+0000 7fea3e3b7700 1 -- 172.21.15.154:0/528828525 >> 172.21.15.154:0/528828525 conn(0x7fea38099c40 msgr2=0x7fea380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.568+0000 7fea3e3b7700 1 -- 172.21.15.154:0/528828525 shutdown_connections 2023-09-30T22:28:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.568+0000 7fea3e3b7700 1 -- 172.21.15.154:0/528828525 wait complete. 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.570+0000 7fea3e3b7700 1 Processor -- start 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.570+0000 7fea3e3b7700 1 -- start start 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea3e3b7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea38123250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea3e3b7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea3809e170 0x7fea38123790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea3e3b7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38130ce0 0x7fea381c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea3e3b7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea381261c0 con 0x7fea38130ce0 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea3e3b7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea381266e0 con 0x7fea3809e170 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea3e3b7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea38122e60 con 0x7fea3809d860 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea3c954700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38130ce0 0x7fea381c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea37fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea38123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea37fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea38123250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54366/0 (socket says 172.21.15.154:54366) 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea3c954700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38130ce0 0x7fea381c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52738/0 (socket says 172.21.15.154:52738) 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea37fff700 1 -- 172.21.15.154:0/3188835517 learned_addr learned my addr 172.21.15.154:0/3188835517 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea377fe700 1 --2- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea3809e170 0x7fea38123790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea37fff700 1 -- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea3809e170 msgr2=0x7fea38123790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea37fff700 1 --2- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea3809e170 0x7fea38123790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea37fff700 1 -- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38130ce0 msgr2=0x7fea381c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea37fff700 1 --2- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38130ce0 0x7fea381c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea37fff700 1 -- 172.21.15.154:0/3188835517 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2800b740 con 0x7fea3809d860 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.571+0000 7fea37fff700 1 --2- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea38123250 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fea2800ed40 tx=0x7fea2800d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.572+0000 7fea34ff9700 1 -- 172.21.15.154:0/3188835517 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800dd30 con 0x7fea3809d860 2023-09-30T22:28:29.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.572+0000 7fea3e3b7700 1 -- 172.21.15.154:0/3188835517 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2c0094a0 con 0x7fea3809d860 2023-09-30T22:28:29.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.572+0000 7fea3e3b7700 1 -- 172.21.15.154:0/3188835517 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea38124e30 con 0x7fea3809d860 2023-09-30T22:28:29.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.572+0000 7fea34ff9700 1 -- 172.21.15.154:0/3188835517 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2800de90 con 0x7fea3809d860 2023-09-30T22:28:29.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.572+0000 7fea34ff9700 1 -- 172.21.15.154:0/3188835517 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28010640 con 0x7fea3809d860 2023-09-30T22:28:29.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.573+0000 7fea3e3b7700 1 -- 172.21.15.154:0/3188835517 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea180052e0 con 0x7fea3809d860 2023-09-30T22:28:29.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.573+0000 7fea34ff9700 1 -- 172.21.15.154:0/3188835517 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea280107a0 con 0x7fea3809d860 2023-09-30T22:28:29.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.573+0000 7fea34ff9700 1 -- 172.21.15.154:0/3188835517 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea28042500 con 0x7fea3809d860 2023-09-30T22:28:29.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.582+0000 7fea34ff9700 1 -- 172.21.15.154:0/3188835517 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea2800cb10 con 0x7fea3809d860 2023-09-30T22:28:29.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20bacb8700 1 Processor -- start 2023-09-30T22:28:29.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20bacb8700 1 -- start start 2023-09-30T22:28:29.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20bacb8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409d860 0x7f20b409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20bacb8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409e170 0x7f20b41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20bacb8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b409aaa0 con 0x7f20b4130ce0 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20bacb8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b409f870 con 0x7f20b409d860 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20bacb8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20b409b360 con 0x7f20b409e170 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20b3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409e170 0x7f20b41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20b3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409e170 0x7f20b41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54374/0 (socket says 172.21.15.154:54374) 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20b3fff700 1 -- 172.21.15.154:0/1716305192 learned_addr learned my addr 172.21.15.154:0/1716305192 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.607+0000 7f20b8a54700 1 --2- 172.21.15.154:0/1716305192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409d860 0x7f20b409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b37fe700 1 -- 172.21.15.154:0/1716305192 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525172003 0 0) 0x7f20b409aaa0 con 0x7f20b4130ce0 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b37fe700 1 -- 172.21.15.154:0/1716305192 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a40035b0 con 0x7f20b4130ce0 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b8a54700 1 -- 172.21.15.154:0/1716305192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409e170 msgr2=0x7f20b41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b8a54700 1 --2- 172.21.15.154:0/1716305192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409e170 0x7f20b41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b8a54700 1 -- 172.21.15.154:0/1716305192 >> v1:172.21.15.154:6789/0 conn(0x7f20b4130ce0 legacy=0x7f20b41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b8a54700 1 -- 172.21.15.154:0/1716305192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b409b620 con 0x7f20b409d860 2023-09-30T22:28:29.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b3fff700 1 --2- 172.21.15.154:0/1716305192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409e170 0x7f20b41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b8a54700 1 --2- 172.21.15.154:0/1716305192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409d860 0x7f20b409dc30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009870 tx=0x7f20a8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b60fbae92d344bf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b37fe700 1 -- 172.21.15.154:0/1716305192 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8011830 con 0x7f20b409d860 2023-09-30T22:28:29.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b37fe700 1 -- 172.21.15.154:0/1716305192 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a8011990 con 0x7f20b409d860 2023-09-30T22:28:29.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.608+0000 7f20b37fe700 1 -- 172.21.15.154:0/1716305192 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8011d20 con 0x7f20b409d860 2023-09-30T22:28:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.609+0000 7f20bacb8700 1 -- 172.21.15.154:0/1716305192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409d860 msgr2=0x7f20b409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.609+0000 7f20bacb8700 1 --2- 172.21.15.154:0/1716305192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409d860 0x7f20b409dc30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009870 tx=0x7f20a8009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.609+0000 7f20bacb8700 1 -- 172.21.15.154:0/1716305192 shutdown_connections 2023-09-30T22:28:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.609+0000 7f20bacb8700 1 --2- 172.21.15.154:0/1716305192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409d860 0x7f20b409dc30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.609+0000 7f20bacb8700 1 --2- 172.21.15.154:0/1716305192 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409e170 0x7f20b41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.609+0000 7f20bacb8700 1 -- 172.21.15.154:0/1716305192 >> 172.21.15.154:0/1716305192 conn(0x7f20b4099c40 msgr2=0x7f20b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.609+0000 7f20bacb8700 1 -- 172.21.15.154:0/1716305192 shutdown_connections 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.609+0000 7f20bacb8700 1 -- 172.21.15.154:0/1716305192 wait complete. 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.610+0000 7f20bacb8700 1 Processor -- start 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.610+0000 7f20bacb8700 1 -- start start 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20bacb8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409d860 0x7f20b411b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20bacb8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409e170 0x7f20b411bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20bacb8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b4130ce0 0x7f20b411c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20bacb8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b411edd0 con 0x7f20b4130ce0 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20bacb8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b409c8b0 con 0x7f20b409e170 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20bacb8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20b411d2b0 con 0x7f20b409d860 2023-09-30T22:28:29.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b9255700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b4130ce0 0x7f20b411c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b9255700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b4130ce0 0x7f20b411c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52742/0 (socket says 172.21.15.154:52742) 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b9255700 1 -- 172.21.15.154:0/2785138352 learned_addr learned my addr 172.21.15.154:0/2785138352 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409e170 0x7f20b411bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b8a54700 1 --2- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409d860 0x7f20b411b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b9255700 1 -- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409d860 msgr2=0x7f20b411b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b9255700 1 --2- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409d860 0x7f20b411b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b9255700 1 -- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409e170 msgr2=0x7f20b411bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b9255700 1 --2- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409e170 0x7f20b411bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b9255700 1 -- 172.21.15.154:0/2785138352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0009550 con 0x7f20b4130ce0 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b3fff700 1 --2- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409e170 0x7f20b411bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.611+0000 7f20b9255700 1 --2- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b4130ce0 0x7f20b411c060 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00cc20 tx=0x7f20ac00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.612+0000 7f20b17fa700 1 -- 172.21.15.154:0/2785138352 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac003c00 con 0x7f20b4130ce0 2023-09-30T22:28:29.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.612+0000 7f20bacb8700 1 -- 172.21.15.154:0/2785138352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a80094a0 con 0x7f20b4130ce0 2023-09-30T22:28:29.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.612+0000 7f20bacb8700 1 -- 172.21.15.154:0/2785138352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b411d990 con 0x7f20b4130ce0 2023-09-30T22:28:29.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.612+0000 7f20b17fa700 1 -- 172.21.15.154:0/2785138352 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac003d60 con 0x7f20b4130ce0 2023-09-30T22:28:29.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.612+0000 7f20b17fa700 1 -- 172.21.15.154:0/2785138352 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac00aaa0 con 0x7f20b4130ce0 2023-09-30T22:28:29.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.613+0000 7f20b17fa700 1 -- 172.21.15.154:0/2785138352 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20ac00ac00 con 0x7f20b4130ce0 2023-09-30T22:28:29.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.613+0000 7f20bacb8700 1 -- 172.21.15.154:0/2785138352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20940052e0 con 0x7f20b4130ce0 2023-09-30T22:28:29.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.613+0000 7f20b17fa700 1 -- 172.21.15.154:0/2785138352 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20ac03f600 con 0x7f20b4130ce0 2023-09-30T22:28:29.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.621+0000 7f20b17fa700 1 -- 172.21.15.154:0/2785138352 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20ac01a950 con 0x7f20b4130ce0 2023-09-30T22:28:29.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.642+0000 7f099d6bc700 1 Processor -- start 2023-09-30T22:28:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f099d6bc700 1 -- start start 2023-09-30T22:28:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f099d6bc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0998138040 0x7f0998138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f099d6bc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a08e0 0x7f09980a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f099d6bc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09980a1230 0x7f099813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f099d6bc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09980a2100 con 0x7f0998138040 2023-09-30T22:28:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f099d6bc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0998138950 con 0x7f09980a08e0 2023-09-30T22:28:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f099d6bc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09981379e0 con 0x7f09980a1230 2023-09-30T22:28:29.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f0996ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0998138040 0x7f0998138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f0996ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0998138040 0x7f0998138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52756/0 (socket says 172.21.15.154:52756) 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f0996ffd700 1 -- 172.21.15.154:0/2719136905 learned_addr learned my addr 172.21.15.154:0/2719136905 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f09967fc700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a08e0 0x7f09980a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.643+0000 7f09977fe700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09980a1230 0x7f099813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f0996ffd700 1 -- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09980a1230 msgr2=0x7f099813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f0996ffd700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09980a1230 0x7f099813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f0996ffd700 1 -- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a08e0 msgr2=0x7f09980a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f0996ffd700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a08e0 0x7f09980a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f0996ffd700 1 -- 172.21.15.154:0/2719136905 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099809b9b0 con 0x7f0998138040 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f09977fe700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09980a1230 0x7f099813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f0996ffd700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998138040 0x7f0998138410 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f09880098f0 tx=0x7f0988009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1ca96bf6ff0fe8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f0995ffb700 1 -- 172.21.15.154:0/2719136905 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988005e30 con 0x7f0998138040 2023-09-30T22:28:29.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f0995ffb700 1 -- 172.21.15.154:0/2719136905 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988004030 con 0x7f0998138040 2023-09-30T22:28:29.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.644+0000 7f0995ffb700 1 -- 172.21.15.154:0/2719136905 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880043e0 con 0x7f0998138040 2023-09-30T22:28:29.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.645+0000 7f099d6bc700 1 -- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998138040 msgr2=0x7f0998138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.645+0000 7f099d6bc700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998138040 0x7f0998138410 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f09880098f0 tx=0x7f0988009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:29.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.645+0000 7f099d6bc700 1 -- 172.21.15.154:0/2719136905 shutdown_connections 2023-09-30T22:28:29.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.645+0000 7f099d6bc700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09980a1230 0x7f099813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.645+0000 7f099d6bc700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998138040 0x7f0998138410 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.645+0000 7f099d6bc700 1 --2- 172.21.15.154:0/2719136905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a08e0 0x7f09980a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.645+0000 7f099d6bc700 1 -- 172.21.15.154:0/2719136905 >> 172.21.15.154:0/2719136905 conn(0x7f09980a2980 msgr2=0x7f09980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.645+0000 7f099d6bc700 1 -- 172.21.15.154:0/2719136905 shutdown_connections 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.645+0000 7f099d6bc700 1 -- 172.21.15.154:0/2719136905 wait complete. 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.646+0000 7f099d6bc700 1 Processor -- start 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.646+0000 7f099d6bc700 1 -- start start 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.646+0000 7f099d6bc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09980a08e0 0x7f0998137420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.646+0000 7f099d6bc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a1230 0x7f0998118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.646+0000 7f099d6bc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0998138040 0x7f0998119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.646+0000 7f099d6bc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09981344c0 con 0x7f09980a08e0 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.646+0000 7f099d6bc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099811b030 con 0x7f09980a1230 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.646+0000 7f099d6bc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0998136ef0 con 0x7f0998138040 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f0996ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09980a08e0 0x7f0998137420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f0996ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09980a08e0 0x7f0998137420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52768/0 (socket says 172.21.15.154:52768) 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f0996ffd700 1 -- 172.21.15.154:0/910585276 learned_addr learned my addr 172.21.15.154:0/910585276 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f09967fc700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a1230 0x7f0998118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f09977fe700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0998138040 0x7f0998119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f0996ffd700 1 -- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0998138040 msgr2=0x7f0998119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f0996ffd700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0998138040 0x7f0998119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f0996ffd700 1 -- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a1230 msgr2=0x7f0998118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f0996ffd700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a1230 0x7f0998118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f0996ffd700 1 -- 172.21.15.154:0/910585276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009500 con 0x7f09980a08e0 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f09967fc700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a1230 0x7f0998118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f0996ffd700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09980a08e0 0x7f0998137420 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f0988014040 tx=0x7f0988004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f097f7fe700 1 -- 172.21.15.154:0/910585276 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988011420 con 0x7f09980a08e0 2023-09-30T22:28:29.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f097f7fe700 1 -- 172.21.15.154:0/910585276 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988011580 con 0x7f09980a08e0 2023-09-30T22:28:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f097f7fe700 1 -- 172.21.15.154:0/910585276 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988011930 con 0x7f09980a08e0 2023-09-30T22:28:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.647+0000 7f099d6bc700 1 -- 172.21.15.154:0/910585276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099809a240 con 0x7f09980a08e0 2023-09-30T22:28:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.648+0000 7f099d6bc700 1 -- 172.21.15.154:0/910585276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099813e6e0 con 0x7f09980a08e0 2023-09-30T22:28:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.649+0000 7f097f7fe700 1 -- 172.21.15.154:0/910585276 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0988018030 con 0x7f09980a08e0 2023-09-30T22:28:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.649+0000 7f099d6bc700 1 -- 172.21.15.154:0/910585276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099804f2a0 con 0x7f09980a08e0 2023-09-30T22:28:29.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.649+0000 7f097f7fe700 1 -- 172.21.15.154:0/910585276 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f098803ffe0 con 0x7f09980a08e0 2023-09-30T22:28:29.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.658+0000 7f097f7fe700 1 -- 172.21.15.154:0/910585276 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0988071750 con 0x7f09980a08e0 2023-09-30T22:28:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.716+0000 7fc5a2616700 1 -- 172.21.15.154:0/2566922616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc59c072480 con 0x7fc59c133660 2023-09-30T22:28:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.716+0000 7fc598ff9700 1 -- 172.21.15.154:0/2566922616 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc59c072480 con 0x7fc59c133660 2023-09-30T22:28:29.717 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.718+0000 7fc5a2616700 1 -- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c133660 msgr2=0x7fc59c119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.718+0000 7fc5a2616700 1 --2- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c133660 0x7fc59c119330 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fc590009ec0 tx=0x7fc59000eec0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.718+0000 7fc5a2616700 1 -- 172.21.15.154:0/2566922616 shutdown_connections 2023-09-30T22:28:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.718+0000 7fc5a2616700 1 --2- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c135f80 0x7fc59c119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.718+0000 7fc5a2616700 1 --2- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c099e20 0x7fc59c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.718+0000 7fc5a2616700 1 --2- 172.21.15.154:0/2566922616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c133660 0x7fc59c119330 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.718+0000 7fc5a2616700 1 -- 172.21.15.154:0/2566922616 >> 172.21.15.154:0/2566922616 conn(0x7fc59c0a2980 msgr2=0x7fc59c09e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.718+0000 7fc5a2616700 1 -- 172.21.15.154:0/2566922616 shutdown_connections 2023-09-30T22:28:29.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.718+0000 7fc5a2616700 1 -- 172.21.15.154:0/2566922616 wait complete. 2023-09-30T22:28:29.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:29.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.782+0000 7fea3e3b7700 1 -- 172.21.15.154:0/3188835517 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea18005590 con 0x7fea3809d860 2023-09-30T22:28:29.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.782+0000 7fea34ff9700 1 -- 172.21.15.154:0/3188835517 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea2800c2e0 con 0x7fea3809d860 2023-09-30T22:28:29.783 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:29.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.785+0000 7fea3e3b7700 1 -- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 msgr2=0x7fea38123250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.785+0000 7fea3e3b7700 1 --2- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea38123250 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fea2800ed40 tx=0x7fea2800d630 comp rx=0 tx=0).stop 2023-09-30T22:28:29.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.785+0000 7fea3e3b7700 1 -- 172.21.15.154:0/3188835517 shutdown_connections 2023-09-30T22:28:29.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.785+0000 7fea3e3b7700 1 --2- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea38130ce0 0x7fea381c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.785+0000 7fea3e3b7700 1 --2- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fea3809d860 0x7fea38123250 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.785+0000 7fea3e3b7700 1 --2- 172.21.15.154:0/3188835517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea3809e170 0x7fea38123790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.785+0000 7fea3e3b7700 1 -- 172.21.15.154:0/3188835517 >> 172.21.15.154:0/3188835517 conn(0x7fea38099c40 msgr2=0x7fea380a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.785+0000 7fea3e3b7700 1 -- 172.21.15.154:0/3188835517 shutdown_connections 2023-09-30T22:28:29.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.785+0000 7fea3e3b7700 1 -- 172.21.15.154:0/3188835517 wait complete. 2023-09-30T22:28:29.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:29.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.823+0000 7f20bacb8700 1 -- 172.21.15.154:0/2785138352 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2094005590 con 0x7f20b4130ce0 2023-09-30T22:28:29.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.824+0000 7f20b17fa700 1 -- 172.21.15.154:0/2785138352 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20ac01a360 con 0x7f20b4130ce0 2023-09-30T22:28:29.825 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:29.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.826+0000 7f20bacb8700 1 -- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b4130ce0 msgr2=0x7f20b411c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.826+0000 7f20bacb8700 1 --2- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b4130ce0 0x7f20b411c060 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00cc20 tx=0x7f20ac00cf30 comp rx=0 tx=0).stop 2023-09-30T22:28:29.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.826+0000 7f20bacb8700 1 -- 172.21.15.154:0/2785138352 shutdown_connections 2023-09-30T22:28:29.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.826+0000 7f20bacb8700 1 --2- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20b4130ce0 0x7f20b411c060 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.826+0000 7f20bacb8700 1 --2- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f20b409d860 0x7f20b411b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.826+0000 7f20bacb8700 1 --2- 172.21.15.154:0/2785138352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20b409e170 0x7f20b411bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.826+0000 7f20bacb8700 1 -- 172.21.15.154:0/2785138352 >> 172.21.15.154:0/2785138352 conn(0x7f20b4099c40 msgr2=0x7f20b4070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.826+0000 7f20bacb8700 1 -- 172.21.15.154:0/2785138352 shutdown_connections 2023-09-30T22:28:29.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.826+0000 7f20bacb8700 1 -- 172.21.15.154:0/2785138352 wait complete. 2023-09-30T22:28:29.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.861+0000 7f099d6bc700 1 -- 172.21.15.154:0/910585276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f099811b690 con 0x7f09980a08e0 2023-09-30T22:28:29.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.862+0000 7f097f7fe700 1 -- 172.21.15.154:0/910585276 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0988029020 con 0x7f09980a08e0 2023-09-30T22:28:29.863 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:29.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.864+0000 7f099d6bc700 1 -- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09980a08e0 msgr2=0x7f0998137420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:29.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.864+0000 7f099d6bc700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09980a08e0 0x7f0998137420 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f0988014040 tx=0x7f0988004750 comp rx=0 tx=0).stop 2023-09-30T22:28:29.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.864+0000 7f099d6bc700 1 -- 172.21.15.154:0/910585276 shutdown_connections 2023-09-30T22:28:29.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.864+0000 7f099d6bc700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0998138040 0x7f0998119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.864+0000 7f099d6bc700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09980a08e0 0x7f0998137420 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.864+0000 7f099d6bc700 1 --2- 172.21.15.154:0/910585276 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980a1230 0x7f0998118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.864+0000 7f099d6bc700 1 -- 172.21.15.154:0/910585276 >> 172.21.15.154:0/910585276 conn(0x7f09980a2980 msgr2=0x7f099809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.864+0000 7f099d6bc700 1 -- 172.21.15.154:0/910585276 shutdown_connections 2023-09-30T22:28:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:29.864+0000 7f099d6bc700 1 -- 172.21.15.154:0/910585276 wait complete. 2023-09-30T22:28:29.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:30.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:30.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:30.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:30.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.866+0000 7fa1b22c3700 1 Processor -- start 2023-09-30T22:28:30.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1b22c3700 1 -- start start 2023-09-30T22:28:30.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1b22c3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa1ac09d860 0x7fa1ac09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1b22c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1b22c3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ac09aaa0 con 0x7fa1ac09e170 2023-09-30T22:28:30.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1b22c3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac09f870 con 0x7fa1ac09d860 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1b22c3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac09b360 con 0x7fa1ac130eb0 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1b0860700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1abfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa1ac09d860 0x7fa1ac09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1b0860700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54412/0 (socket says 172.21.15.154:54412) 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.867+0000 7fa1b0860700 1 -- 172.21.15.154:0/381347536 learned_addr learned my addr 172.21.15.154:0/381347536 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.868+0000 7fa1b0860700 1 -- 172.21.15.154:0/381347536 >> v2:172.21.15.154:3300/0 conn(0x7fa1ac09d860 msgr2=0x7fa1ac09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.868+0000 7fa1b0860700 1 --2- 172.21.15.154:0/381347536 >> v2:172.21.15.154:3300/0 conn(0x7fa1ac09d860 0x7fa1ac09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.868+0000 7fa1b0860700 1 -- 172.21.15.154:0/381347536 >> v1:172.21.15.154:6789/0 conn(0x7fa1ac09e170 legacy=0x7fa1ac1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.868+0000 7fa1b0860700 1 -- 172.21.15.154:0/381347536 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac09b620 con 0x7fa1ac130eb0 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.868+0000 7fa1b0860700 1 --2- 172.21.15.154:0/381347536 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac138a00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009e50 tx=0x7fa1a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1405742b1405eb9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:30.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.868+0000 7fa1aaffd700 1 -- 172.21.15.154:0/381347536 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400e070 con 0x7fa1ac130eb0 2023-09-30T22:28:30.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.868+0000 7fa1aaffd700 1 -- 172.21.15.154:0/381347536 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a400b910 con 0x7fa1ac130eb0 2023-09-30T22:28:30.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.868+0000 7fa1aaffd700 1 -- 172.21.15.154:0/381347536 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400bcc0 con 0x7fa1ac130eb0 2023-09-30T22:28:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.869+0000 7fa1b22c3700 1 -- 172.21.15.154:0/381347536 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 msgr2=0x7fa1ac138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.869+0000 7fa1b22c3700 1 --2- 172.21.15.154:0/381347536 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac138a00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009e50 tx=0x7fa1a400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.869+0000 7fa1b22c3700 1 -- 172.21.15.154:0/381347536 shutdown_connections 2023-09-30T22:28:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.869+0000 7fa1b22c3700 1 --2- 172.21.15.154:0/381347536 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac138a00 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.869+0000 7fa1b22c3700 1 --2- 172.21.15.154:0/381347536 >> v2:172.21.15.154:3300/0 conn(0x7fa1ac09d860 0x7fa1ac09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.869+0000 7fa1b22c3700 1 -- 172.21.15.154:0/381347536 >> 172.21.15.154:0/381347536 conn(0x7fa1ac099c40 msgr2=0x7fa1ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.869+0000 7fa1b22c3700 1 -- 172.21.15.154:0/381347536 shutdown_connections 2023-09-30T22:28:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.869+0000 7fa1b22c3700 1 -- 172.21.15.154:0/381347536 wait complete. 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.870+0000 7fa1b22c3700 1 Processor -- start 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.870+0000 7fa1b22c3700 1 -- start start 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1b22c3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1ac09d860 0x7fa1ac1385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1b22c3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1ac09e170 0x7fa1ac138af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1b22c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac1c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1b22c3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac1362a0 con 0x7fa1ac09d860 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1b22c3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac136e80 con 0x7fa1ac09e170 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1b22c3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac072170 con 0x7fa1ac130eb0 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1abfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1ac09d860 0x7fa1ac1385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1abfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1ac09d860 0x7fa1ac1385b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52784/0 (socket says 172.21.15.154:52784) 2023-09-30T22:28:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1abfff700 1 -- 172.21.15.154:0/491961717 learned_addr learned my addr 172.21.15.154:0/491961717 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1b0860700 1 --2- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac1c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1ab7fe700 1 --2- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1ac09e170 0x7fa1ac138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1abfff700 1 -- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 msgr2=0x7fa1ac1c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1abfff700 1 --2- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac1c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1abfff700 1 -- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1ac09e170 msgr2=0x7fa1ac138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1abfff700 1 --2- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1ac09e170 0x7fa1ac138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.871+0000 7fa1abfff700 1 -- 172.21.15.154:0/491961717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a4009b30 con 0x7fa1ac09d860 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.872+0000 7fa1abfff700 1 --2- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1ac09d860 0x7fa1ac1385b0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e9b0 tx=0x7fa19c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.872+0000 7fa1a8ff9700 1 -- 172.21.15.154:0/491961717 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c009710 con 0x7fa1ac09d860 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.872+0000 7fa1a8ff9700 1 -- 172.21.15.154:0/491961717 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c00ee50 con 0x7fa1ac09d860 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.872+0000 7fa1b22c3700 1 -- 172.21.15.154:0/491961717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac09c8b0 con 0x7fa1ac09d860 2023-09-30T22:28:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.872+0000 7fa1a8ff9700 1 -- 172.21.15.154:0/491961717 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00ca50 con 0x7fa1ac09d860 2023-09-30T22:28:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.872+0000 7fa1b22c3700 1 -- 172.21.15.154:0/491961717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac13bb90 con 0x7fa1ac09d860 2023-09-30T22:28:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.873+0000 7fa1a8ff9700 1 -- 172.21.15.154:0/491961717 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa19c00cbb0 con 0x7fa1ac09d860 2023-09-30T22:28:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.873+0000 7fa1a8ff9700 1 -- 172.21.15.154:0/491961717 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa19c03faa0 con 0x7fa1ac09d860 2023-09-30T22:28:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.873+0000 7fa1b22c3700 1 -- 172.21.15.154:0/491961717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac1370a0 con 0x7fa1ac09d860 2023-09-30T22:28:30.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:30.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.878+0000 7fa1a8ff9700 1 -- 172.21.15.154:0/491961717 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa19c021020 con 0x7fa1ac09d860 2023-09-30T22:28:30.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.935+0000 7fc8aab9e700 1 Processor -- start 2023-09-30T22:28:30.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.935+0000 7fc8aab9e700 1 -- start start 2023-09-30T22:28:30.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.935+0000 7fc8aab9e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a4099f50 0x7fc8a409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.935+0000 7fc8aab9e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a406fb90 0x7fc8a4131260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8aab9e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a409c5c0 con 0x7fc8a41317a0 2023-09-30T22:28:30.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8aab9e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a409b950 con 0x7fc8a406fb90 2023-09-30T22:28:30.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8aab9e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a406f5a0 con 0x7fc8a4099f50 2023-09-30T22:28:30.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8aa39d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc8a41317a0 0x7fc8a4138590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56780/0 (socket says 172.21.15.154:56780) 2023-09-30T22:28:30.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a939b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a406fb90 0x7fc8a4131260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8aa39d700 1 -- 172.21.15.154:0/1369495422 learned_addr learned my addr 172.21.15.154:0/1369495422 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:30.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a9b9c700 1 --2- 172.21.15.154:0/1369495422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a4099f50 0x7fc8a409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a8b9a700 1 -- 172.21.15.154:0/1369495422 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869323169 0 0) 0x7fc8a409c5c0 con 0x7fc8a41317a0 2023-09-30T22:28:30.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a8b9a700 1 -- 172.21.15.154:0/1369495422 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8900035b0 con 0x7fc8a41317a0 2023-09-30T22:28:30.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a939b700 1 -- 172.21.15.154:0/1369495422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a4099f50 msgr2=0x7fc8a409a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:30.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a939b700 1 --2- 172.21.15.154:0/1369495422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a4099f50 0x7fc8a409a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a939b700 1 -- 172.21.15.154:0/1369495422 >> v1:172.21.15.154:6789/0 conn(0x7fc8a41317a0 legacy=0x7fc8a4138590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a939b700 1 -- 172.21.15.154:0/1369495422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a4099b00 con 0x7fc8a406fb90 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a9b9c700 1 --2- 172.21.15.154:0/1369495422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a4099f50 0x7fc8a409a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.936+0000 7fc8a939b700 1 --2- 172.21.15.154:0/1369495422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a406fb90 0x7fc8a4131260 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc894009870 tx=0x7fc894009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be1d7dd10beb6343 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.937+0000 7fc8a8b9a700 1 -- 172.21.15.154:0/1369495422 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894011830 con 0x7fc8a406fb90 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.937+0000 7fc8a8b9a700 1 -- 172.21.15.154:0/1369495422 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc894011990 con 0x7fc8a406fb90 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.937+0000 7fc8a8b9a700 1 -- 172.21.15.154:0/1369495422 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894011d00 con 0x7fc8a406fb90 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.937+0000 7fc8aab9e700 1 -- 172.21.15.154:0/1369495422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a406fb90 msgr2=0x7fc8a4131260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.937+0000 7fc8aab9e700 1 --2- 172.21.15.154:0/1369495422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a406fb90 0x7fc8a4131260 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc894009870 tx=0x7fc894009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.937+0000 7fc8aab9e700 1 -- 172.21.15.154:0/1369495422 shutdown_connections 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.937+0000 7fc8aab9e700 1 --2- 172.21.15.154:0/1369495422 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a4099f50 0x7fc8a409a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.937+0000 7fc8aab9e700 1 --2- 172.21.15.154:0/1369495422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a406fb90 0x7fc8a4131260 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.937+0000 7fc8aab9e700 1 -- 172.21.15.154:0/1369495422 >> 172.21.15.154:0/1369495422 conn(0x7fc8a40a27a0 msgr2=0x7fc8a40a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:30.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.938+0000 7fc8aab9e700 1 -- 172.21.15.154:0/1369495422 shutdown_connections 2023-09-30T22:28:30.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.938+0000 7fc8aab9e700 1 -- 172.21.15.154:0/1369495422 wait complete. 2023-09-30T22:28:30.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.939+0000 7fc8aab9e700 1 Processor -- start 2023-09-30T22:28:30.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.939+0000 7fc8aab9e700 1 -- start start 2023-09-30T22:28:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aab9e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a406fb90 0x7fc8a4070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aab9e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a4099f50 0x7fc8a4070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aab9e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a41317a0 0x7fc8a4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aab9e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40715e0 con 0x7fc8a4099f50 2023-09-30T22:28:30.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aab9e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a411e650 con 0x7fc8a41317a0 2023-09-30T22:28:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aab9e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40a2b70 con 0x7fc8a406fb90 2023-09-30T22:28:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8a939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a4099f50 0x7fc8a4070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8a939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a4099f50 0x7fc8a4070650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52798/0 (socket says 172.21.15.154:52798) 2023-09-30T22:28:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8a939b700 1 -- 172.21.15.154:0/13869492 learned_addr learned my addr 172.21.15.154:0/13869492 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aa39d700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a41317a0 0x7fc8a4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8a9b9c700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a406fb90 0x7fc8a4070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aa39d700 1 -- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a406fb90 msgr2=0x7fc8a4070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aa39d700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a406fb90 0x7fc8a4070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aa39d700 1 -- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a4099f50 msgr2=0x7fc8a4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.940+0000 7fc8aa39d700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a4099f50 0x7fc8a4070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.941+0000 7fc8aa39d700 1 -- 172.21.15.154:0/13869492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00094a0 con 0x7fc8a41317a0 2023-09-30T22:28:30.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.941+0000 7fc8a9b9c700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a406fb90 0x7fc8a4070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:30.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.941+0000 7fc8a939b700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a4099f50 0x7fc8a4070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:30.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.941+0000 7fc8aa39d700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a41317a0 0x7fc8a4070b90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00cab0 tx=0x7fc89c00cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:30.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.941+0000 7fc89a7fc700 1 -- 172.21.15.154:0/13869492 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c00a9a0 con 0x7fc8a41317a0 2023-09-30T22:28:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.941+0000 7fc89a7fc700 1 -- 172.21.15.154:0/13869492 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c00ab00 con 0x7fc8a41317a0 2023-09-30T22:28:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.941+0000 7fc8aab9e700 1 -- 172.21.15.154:0/13869492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8940094a0 con 0x7fc8a41317a0 2023-09-30T22:28:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.941+0000 7fc89a7fc700 1 -- 172.21.15.154:0/13869492 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c00ae70 con 0x7fc8a41317a0 2023-09-30T22:28:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.941+0000 7fc8aab9e700 1 -- 172.21.15.154:0/13869492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a40a0020 con 0x7fc8a41317a0 2023-09-30T22:28:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.942+0000 7fc89a7fc700 1 -- 172.21.15.154:0/13869492 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc89c01b3b0 con 0x7fc8a41317a0 2023-09-30T22:28:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.942+0000 7fc89a7fc700 1 -- 172.21.15.154:0/13869492 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc89c03f260 con 0x7fc8a41317a0 2023-09-30T22:28:30.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.942+0000 7fc8aab9e700 1 -- 172.21.15.154:0/13869492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a404f2a0 con 0x7fc8a41317a0 2023-09-30T22:28:30.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.951+0000 7fc89a7fc700 1 -- 172.21.15.154:0/13869492 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc89c0192c0 con 0x7fc8a41317a0 2023-09-30T22:28:30.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.980+0000 7fe27b08d700 1 Processor -- start 2023-09-30T22:28:30.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.980+0000 7fe27b08d700 1 -- start start 2023-09-30T22:28:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.981+0000 7fe27b08d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406b250 0x7fe274136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.981+0000 7fe27b08d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe274137140 0x7fe274139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.981+0000 7fe27b08d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27409da80 con 0x7fe27406a770 2023-09-30T22:28:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.981+0000 7fe27b08d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27409dce0 con 0x7fe274137140 2023-09-30T22:28:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.981+0000 7fe27b08d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe27406b620 con 0x7fe27406b250 2023-09-30T22:28:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.981+0000 7fe273fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406b250 0x7fe274136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.981+0000 7fe273fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406b250 0x7fe274136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54454/0 (socket says 172.21.15.154:54454) 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.981+0000 7fe273fff700 1 -- 172.21.15.154:0/1083945532 learned_addr learned my addr 172.21.15.154:0/1083945532 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.981+0000 7fe27962a700 1 --2- 172.21.15.154:0/1083945532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe274137140 0x7fe274139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe273fff700 1 -- 172.21.15.154:0/1083945532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe274137140 msgr2=0x7fe274139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe273fff700 1 --2- 172.21.15.154:0/1083945532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe274137140 0x7fe274139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe273fff700 1 -- 172.21.15.154:0/1083945532 >> v1:172.21.15.154:6789/0 conn(0x7fe27406a770 legacy=0x7fe27406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe273fff700 1 -- 172.21.15.154:0/1083945532 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27409eb20 con 0x7fe27406b250 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe2737fe700 1 -- 172.21.15.154:0/1083945532 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146833411 0 0) 0x7fe27409da80 con 0x7fe27406a770 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe27962a700 1 --2- 172.21.15.154:0/1083945532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe274137140 0x7fe274139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe273fff700 1 --2- 172.21.15.154:0/1083945532 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406b250 0x7fe274136c00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe260009920 tx=0x7fe260009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794857cd93d94e8d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:30.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe2737fe700 1 -- 172.21.15.154:0/1083945532 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011830 con 0x7fe27406b250 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe2737fe700 1 -- 172.21.15.154:0/1083945532 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe260011990 con 0x7fe27406b250 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.982+0000 7fe2737fe700 1 -- 172.21.15.154:0/1083945532 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011d20 con 0x7fe27406b250 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.983+0000 7fe27b08d700 1 -- 172.21.15.154:0/1083945532 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406b250 msgr2=0x7fe274136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.983+0000 7fe27b08d700 1 --2- 172.21.15.154:0/1083945532 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406b250 0x7fe274136c00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe260009920 tx=0x7fe260009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.983+0000 7fe27b08d700 1 -- 172.21.15.154:0/1083945532 shutdown_connections 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.983+0000 7fe27b08d700 1 --2- 172.21.15.154:0/1083945532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe274137140 0x7fe274139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.983+0000 7fe27b08d700 1 --2- 172.21.15.154:0/1083945532 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406b250 0x7fe274136c00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.983+0000 7fe27b08d700 1 -- 172.21.15.154:0/1083945532 >> 172.21.15.154:0/1083945532 conn(0x7fe274099c40 msgr2=0x7fe2740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.983+0000 7fe27b08d700 1 -- 172.21.15.154:0/1083945532 shutdown_connections 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.983+0000 7fe27b08d700 1 -- 172.21.15.154:0/1083945532 wait complete. 2023-09-30T22:28:30.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.984+0000 7fe27b08d700 1 Processor -- start 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.984+0000 7fe27b08d700 1 -- start start 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe27b08d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406a770 0x7fe27409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe27b08d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe27406b250 0x7fe27409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe27b08d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274137140 0x7fe27409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe27b08d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe274136170 con 0x7fe274137140 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe27b08d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741260a0 con 0x7fe27406b250 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe27b08d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe27409c0a0 con 0x7fe27406a770 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe273fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe27406b250 0x7fe27409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe27962a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274137140 0x7fe27409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe273fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe27406b250 0x7fe27409a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45314/0 (socket says 172.21.15.154:45314) 2023-09-30T22:28:30.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe273fff700 1 -- 172.21.15.154:0/795110530 learned_addr learned my addr 172.21.15.154:0/795110530 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.985+0000 7fe278e29700 1 --2- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406a770 0x7fe27409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe273fff700 1 -- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406a770 msgr2=0x7fe27409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe273fff700 1 --2- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406a770 0x7fe27409a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe273fff700 1 -- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274137140 msgr2=0x7fe27409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe273fff700 1 --2- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274137140 0x7fe27409af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe273fff700 1 -- 172.21.15.154:0/795110530 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c009a70 con 0x7fe27406b250 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe27962a700 1 --2- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274137140 0x7fe27409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe273fff700 1 --2- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe27406b250 0x7fe27409a9d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe26000a010 tx=0x7fe260004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe2717fa700 1 -- 172.21.15.154:0/795110530 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260004450 con 0x7fe27406b250 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe2717fa700 1 -- 172.21.15.154:0/795110530 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26001f070 con 0x7fe27406b250 2023-09-30T22:28:30.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe2717fa700 1 -- 172.21.15.154:0/795110530 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2600038c0 con 0x7fe27406b250 2023-09-30T22:28:30.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe27b08d700 1 -- 172.21.15.154:0/795110530 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe260009550 con 0x7fe27406b250 2023-09-30T22:28:30.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.986+0000 7fe27b08d700 1 -- 172.21.15.154:0/795110530 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe274136700 con 0x7fe27406b250 2023-09-30T22:28:30.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.987+0000 7fe2717fa700 1 -- 172.21.15.154:0/795110530 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe260003a20 con 0x7fe27406b250 2023-09-30T22:28:30.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.987+0000 7fe2717fa700 1 -- 172.21.15.154:0/795110530 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe260021070 con 0x7fe27406b250 2023-09-30T22:28:30.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.987+0000 7fe27b08d700 1 -- 172.21.15.154:0/795110530 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27404f2a0 con 0x7fe27406b250 2023-09-30T22:28:30.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:30.992+0000 7fe2717fa700 1 -- 172.21.15.154:0/795110530 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe26002b080 con 0x7fe27406b250 2023-09-30T22:28:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.013+0000 7fa2ec364700 1 Processor -- start 2023-09-30T22:28:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.013+0000 7fa2ec364700 1 -- start start 2023-09-30T22:28:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.013+0000 7fa2ec364700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa2e409e950 0x7fa2e409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.013+0000 7fa2ec364700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e4131fa0 0x7fa2e4139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.013+0000 7fa2ec364700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e409afb0 con 0x7fa2e409f260 2023-09-30T22:28:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.013+0000 7fa2ec364700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e40a0970 con 0x7fa2e409e950 2023-09-30T22:28:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.013+0000 7fa2ec364700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40a0320 con 0x7fa2e4131fa0 2023-09-30T22:28:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2ea901700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e4131fa0 0x7fa2e4139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2ea100700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa2e409e950 0x7fa2e409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2ea901700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e4131fa0 0x7fa2e4139af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54480/0 (socket says 172.21.15.154:54480) 2023-09-30T22:28:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2ea901700 1 -- 172.21.15.154:0/1260024756 learned_addr learned my addr 172.21.15.154:0/1260024756 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2ea901700 1 -- 172.21.15.154:0/1260024756 >> v2:172.21.15.154:3300/0 conn(0x7fa2e409e950 msgr2=0x7fa2e409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2ea901700 1 --2- 172.21.15.154:0/1260024756 >> v2:172.21.15.154:3300/0 conn(0x7fa2e409e950 0x7fa2e409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2ea901700 1 -- 172.21.15.154:0/1260024756 >> v1:172.21.15.154:6789/0 conn(0x7fa2e409f260 legacy=0x7fa2e4131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2ea901700 1 -- 172.21.15.154:0/1260024756 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40a0750 con 0x7fa2e4131fa0 2023-09-30T22:28:31.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2ea901700 1 --2- 172.21.15.154:0/1260024756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e4131fa0 0x7fa2e4139af0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009e50 tx=0x7fa2dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e63eae60a15d87b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.014+0000 7fa2e90fe700 1 -- 172.21.15.154:0/1260024756 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00e070 con 0x7fa2e4131fa0 2023-09-30T22:28:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.015+0000 7fa2e90fe700 1 -- 172.21.15.154:0/1260024756 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc00b910 con 0x7fa2e4131fa0 2023-09-30T22:28:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.015+0000 7fa2e90fe700 1 -- 172.21.15.154:0/1260024756 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc00bcc0 con 0x7fa2e4131fa0 2023-09-30T22:28:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.015+0000 7fa2ec364700 1 -- 172.21.15.154:0/1260024756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e4131fa0 msgr2=0x7fa2e4139af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.015+0000 7fa2ec364700 1 --2- 172.21.15.154:0/1260024756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e4131fa0 0x7fa2e4139af0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009e50 tx=0x7fa2dc00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.016+0000 7fa2ec364700 1 -- 172.21.15.154:0/1260024756 shutdown_connections 2023-09-30T22:28:31.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.016+0000 7fa2ec364700 1 --2- 172.21.15.154:0/1260024756 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e4131fa0 0x7fa2e4139af0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.016+0000 7fa2ec364700 1 --2- 172.21.15.154:0/1260024756 >> v2:172.21.15.154:3300/0 conn(0x7fa2e409e950 0x7fa2e409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.016+0000 7fa2ec364700 1 -- 172.21.15.154:0/1260024756 >> 172.21.15.154:0/1260024756 conn(0x7fa2e40a0f70 msgr2=0x7fa2e40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.016+0000 7fa2ec364700 1 -- 172.21.15.154:0/1260024756 shutdown_connections 2023-09-30T22:28:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.016+0000 7fa2ec364700 1 -- 172.21.15.154:0/1260024756 wait complete. 2023-09-30T22:28:31.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.017+0000 7fa2ec364700 1 Processor -- start 2023-09-30T22:28:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.017+0000 7fa2ec364700 1 -- start start 2023-09-30T22:28:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2ec364700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e409e950 0x7fa2e41205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2ec364700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2e409f260 0x7fa2e4120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2ec364700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e4131fa0 0x7fa2e4121070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2ec364700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4123920 con 0x7fa2e4131fa0 2023-09-30T22:28:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2ec364700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4131130 con 0x7fa2e409f260 2023-09-30T22:28:31.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2ec364700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e409da40 con 0x7fa2e409e950 2023-09-30T22:28:31.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2e98ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2e409f260 0x7fa2e4120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2e98ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2e409f260 0x7fa2e4120b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45316/0 (socket says 172.21.15.154:45316) 2023-09-30T22:28:31.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2e98ff700 1 -- 172.21.15.154:0/472204773 learned_addr learned my addr 172.21.15.154:0/472204773 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:31.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2ea100700 1 --2- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e409e950 0x7fa2e41205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:31.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2e98ff700 1 -- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e409e950 msgr2=0x7fa2e41205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2e98ff700 1 --2- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e409e950 0x7fa2e41205f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2e98ff700 1 -- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e4131fa0 msgr2=0x7fa2e4121070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2e98ff700 1 --2- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e4131fa0 0x7fa2e4121070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.018+0000 7fa2e98ff700 1 -- 172.21.15.154:0/472204773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc009b30 con 0x7fa2e409f260 2023-09-30T22:28:31.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.019+0000 7fa2e98ff700 1 --2- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2e409f260 0x7fa2e4120b30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c4e0 tx=0x7fa2d400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:31.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.019+0000 7fa2daffd700 1 -- 172.21.15.154:0/472204773 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40052d0 con 0x7fa2e409f260 2023-09-30T22:28:31.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.019+0000 7fa2daffd700 1 -- 172.21.15.154:0/472204773 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4005430 con 0x7fa2e409f260 2023-09-30T22:28:31.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.019+0000 7fa2ec364700 1 -- 172.21.15.154:0/472204773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e4131530 con 0x7fa2e409f260 2023-09-30T22:28:31.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.019+0000 7fa2ec364700 1 -- 172.21.15.154:0/472204773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e4124830 con 0x7fa2e409f260 2023-09-30T22:28:31.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.019+0000 7fa2daffd700 1 -- 172.21.15.154:0/472204773 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40038c0 con 0x7fa2e409f260 2023-09-30T22:28:31.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.020+0000 7fa2ec364700 1 -- 172.21.15.154:0/472204773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc0052e0 con 0x7fa2e409f260 2023-09-30T22:28:31.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.020+0000 7fa2daffd700 1 -- 172.21.15.154:0/472204773 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2d4003a20 con 0x7fa2e409f260 2023-09-30T22:28:31.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.021+0000 7fa2daffd700 1 -- 172.21.15.154:0/472204773 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa2d403e960 con 0x7fa2e409f260 2023-09-30T22:28:31.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.029+0000 7fa2daffd700 1 -- 172.21.15.154:0/472204773 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2d4011590 con 0x7fa2e409f260 2023-09-30T22:28:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.087+0000 7fa1b22c3700 1 -- 172.21.15.154:0/491961717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa1ac04f2a0 con 0x7fa1ac09d860 2023-09-30T22:28:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.087+0000 7fa1a8ff9700 1 -- 172.21.15.154:0/491961717 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa19c017070 con 0x7fa1ac09d860 2023-09-30T22:28:31.088 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.089+0000 7fa1b22c3700 1 -- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1ac09d860 msgr2=0x7fa1ac1385b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.089+0000 7fa1b22c3700 1 --2- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1ac09d860 0x7fa1ac1385b0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e9b0 tx=0x7fa19c00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.089+0000 7fa1b22c3700 1 -- 172.21.15.154:0/491961717 shutdown_connections 2023-09-30T22:28:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.089+0000 7fa1b22c3700 1 --2- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa1ac130eb0 0x7fa1ac1c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.089+0000 7fa1b22c3700 1 --2- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1ac09d860 0x7fa1ac1385b0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.089+0000 7fa1b22c3700 1 --2- 172.21.15.154:0/491961717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1ac09e170 0x7fa1ac138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.089+0000 7fa1b22c3700 1 -- 172.21.15.154:0/491961717 >> 172.21.15.154:0/491961717 conn(0x7fa1ac099c40 msgr2=0x7fa1ac1397f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.089+0000 7fa1b22c3700 1 -- 172.21.15.154:0/491961717 shutdown_connections 2023-09-30T22:28:31.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.090+0000 7fa1b22c3700 1 -- 172.21.15.154:0/491961717 wait complete. 2023-09-30T22:28:31.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:31.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.156+0000 7fc8aab9e700 1 -- 172.21.15.154:0/13869492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc8a411ec10 con 0x7fc8a41317a0 2023-09-30T22:28:31.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.156+0000 7fc89a7fc700 1 -- 172.21.15.154:0/13869492 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc89c017020 con 0x7fc8a41317a0 2023-09-30T22:28:31.157 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:31.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.159+0000 7fc8aab9e700 1 -- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a41317a0 msgr2=0x7fc8a4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.159+0000 7fc8aab9e700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a41317a0 0x7fc8a4070b90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00cab0 tx=0x7fc89c00cdc0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.159+0000 7fc8aab9e700 1 -- 172.21.15.154:0/13869492 shutdown_connections 2023-09-30T22:28:31.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.159+0000 7fc8aab9e700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8a41317a0 0x7fc8a4070b90 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.159+0000 7fc8aab9e700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc8a406fb90 0x7fc8a4070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.159+0000 7fc8aab9e700 1 --2- 172.21.15.154:0/13869492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a4099f50 0x7fc8a4070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.159+0000 7fc8aab9e700 1 -- 172.21.15.154:0/13869492 >> 172.21.15.154:0/13869492 conn(0x7fc8a40a27a0 msgr2=0x7fc8a412e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.159+0000 7fc8aab9e700 1 -- 172.21.15.154:0/13869492 shutdown_connections 2023-09-30T22:28:31.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.159+0000 7fc8aab9e700 1 -- 172.21.15.154:0/13869492 wait complete. 2023-09-30T22:28:31.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:31.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.195+0000 7fe27b08d700 1 -- 172.21.15.154:0/795110530 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe274124b80 con 0x7fe27406b250 2023-09-30T22:28:31.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.195+0000 7fe2717fa700 1 -- 172.21.15.154:0/795110530 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2600045b0 con 0x7fe27406b250 2023-09-30T22:28:31.196 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:31.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.197+0000 7fe27b08d700 1 -- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe27406b250 msgr2=0x7fe27409a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.197+0000 7fe27b08d700 1 --2- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe27406b250 0x7fe27409a9d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe26000a010 tx=0x7fe260004750 comp rx=0 tx=0).stop 2023-09-30T22:28:31.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.197+0000 7fe27b08d700 1 -- 172.21.15.154:0/795110530 shutdown_connections 2023-09-30T22:28:31.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.197+0000 7fe27b08d700 1 --2- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe274137140 0x7fe27409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.197+0000 7fe27b08d700 1 --2- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe27406a770 0x7fe27409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.197+0000 7fe27b08d700 1 --2- 172.21.15.154:0/795110530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe27406b250 0x7fe27409a9d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.197+0000 7fe27b08d700 1 -- 172.21.15.154:0/795110530 >> 172.21.15.154:0/795110530 conn(0x7fe274099c40 msgr2=0x7fe27406fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.197+0000 7fe27b08d700 1 -- 172.21.15.154:0/795110530 shutdown_connections 2023-09-30T22:28:31.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.197+0000 7fe27b08d700 1 -- 172.21.15.154:0/795110530 wait complete. 2023-09-30T22:28:31.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.239+0000 7fa2ec364700 1 -- 172.21.15.154:0/472204773 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2cc005860 con 0x7fa2e409f260 2023-09-30T22:28:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.239+0000 7fa2daffd700 1 -- 172.21.15.154:0/472204773 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2d4017070 con 0x7fa2e409f260 2023-09-30T22:28:31.240 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:31.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.241+0000 7fa2ec364700 1 -- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2e409f260 msgr2=0x7fa2e4120b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.241+0000 7fa2ec364700 1 --2- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2e409f260 0x7fa2e4120b30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c4e0 tx=0x7fa2d400c7f0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.241+0000 7fa2ec364700 1 -- 172.21.15.154:0/472204773 shutdown_connections 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.241+0000 7fa2ec364700 1 --2- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2e4131fa0 0x7fa2e4121070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.241+0000 7fa2ec364700 1 --2- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa2e409e950 0x7fa2e41205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.241+0000 7fa2ec364700 1 --2- 172.21.15.154:0/472204773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2e409f260 0x7fa2e4120b30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.241+0000 7fa2ec364700 1 -- 172.21.15.154:0/472204773 >> 172.21.15.154:0/472204773 conn(0x7fa2e40a0f70 msgr2=0x7fa2e411a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.241+0000 7fa2ec364700 1 -- 172.21.15.154:0/472204773 shutdown_connections 2023-09-30T22:28:31.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:31.241+0000 7fa2ec364700 1 -- 172.21.15.154:0/472204773 wait complete. 2023-09-30T22:28:31.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:32.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:32.177 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:32.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:32.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.250+0000 7faa5a4e0700 1 Processor -- start 2023-09-30T22:28:32.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.250+0000 7faa5a4e0700 1 -- start start 2023-09-30T22:28:32.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa5a4e0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa54138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa5a4e0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa54139200 0x7faa5413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa5a4e0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5409a760 con 0x7faa54133900 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa5a4e0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa541336e0 con 0x7faa54139200 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa5a4e0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa5409a080 con 0x7faa541368e0 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa537fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa54138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa58a7d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa54139200 0x7faa5413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa537fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa54138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54492/0 (socket says 172.21.15.154:54492) 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa537fe700 1 -- 172.21.15.154:0/2676518738 learned_addr learned my addr 172.21.15.154:0/2676518738 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa537fe700 1 -- 172.21.15.154:0/2676518738 >> v2:172.21.15.154:3300/0 conn(0x7faa54139200 msgr2=0x7faa5413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa537fe700 1 --2- 172.21.15.154:0/2676518738 >> v2:172.21.15.154:3300/0 conn(0x7faa54139200 0x7faa5413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa537fe700 1 -- 172.21.15.154:0/2676518738 >> v1:172.21.15.154:6789/0 conn(0x7faa54133900 legacy=0x7faa54133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.251+0000 7faa537fe700 1 -- 172.21.15.154:0/2676518738 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540a23e0 con 0x7faa541368e0 2023-09-30T22:28:32.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.252+0000 7faa537fe700 1 --2- 172.21.15.154:0/2676518738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa54138cc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7faa480098f0 tx=0x7faa48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5588b7802f6d2afb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.252+0000 7faa52ffd700 1 -- 172.21.15.154:0/2676518738 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48011830 con 0x7faa541368e0 2023-09-30T22:28:32.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.252+0000 7faa52ffd700 1 -- 172.21.15.154:0/2676518738 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48011990 con 0x7faa541368e0 2023-09-30T22:28:32.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.252+0000 7faa52ffd700 1 -- 172.21.15.154:0/2676518738 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48011d20 con 0x7faa541368e0 2023-09-30T22:28:32.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.252+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2676518738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 msgr2=0x7faa54138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.252+0000 7faa5a4e0700 1 --2- 172.21.15.154:0/2676518738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa54138cc0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7faa480098f0 tx=0x7faa48009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:32.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.253+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2676518738 shutdown_connections 2023-09-30T22:28:32.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.253+0000 7faa5a4e0700 1 --2- 172.21.15.154:0/2676518738 >> v2:172.21.15.154:3300/0 conn(0x7faa54139200 0x7faa5413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.253+0000 7faa5a4e0700 1 --2- 172.21.15.154:0/2676518738 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa54138cc0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.253+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2676518738 >> 172.21.15.154:0/2676518738 conn(0x7faa540a2980 msgr2=0x7faa540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.253+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2676518738 shutdown_connections 2023-09-30T22:28:32.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.253+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2676518738 wait complete. 2023-09-30T22:28:32.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.254+0000 7faa5a4e0700 1 Processor -- start 2023-09-30T22:28:32.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.254+0000 7faa5a4e0700 1 -- start start 2023-09-30T22:28:32.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:32.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa5a4e0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa54133900 0x7faa54119dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa5a4e0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa5411a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa5a4e0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa54139200 0x7faa5411a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa5a4e0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5411d600 con 0x7faa54139200 2023-09-30T22:28:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa5a4e0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5411bae0 con 0x7faa54133900 2023-09-30T22:28:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa5a4e0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa54138ff0 con 0x7faa541368e0 2023-09-30T22:28:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa537fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa5411a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa537fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa5411a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54496/0 (socket says 172.21.15.154:54496) 2023-09-30T22:28:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa537fe700 1 -- 172.21.15.154:0/2007160598 learned_addr learned my addr 172.21.15.154:0/2007160598 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa53fff700 1 --2- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa54133900 0x7faa54119dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa58a7d700 1 --2- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa54139200 0x7faa5411a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa537fe700 1 -- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa54133900 msgr2=0x7faa54119dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa537fe700 1 --2- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa54133900 0x7faa54119dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa537fe700 1 -- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa54139200 msgr2=0x7faa5411a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa537fe700 1 --2- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa54139200 0x7faa5411a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa537fe700 1 -- 172.21.15.154:0/2007160598 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48009550 con 0x7faa541368e0 2023-09-30T22:28:32.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa537fe700 1 --2- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa5411a300 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7faa48000c00 tx=0x7faa48004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa50ff9700 1 -- 172.21.15.154:0/2007160598 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480036a0 con 0x7faa541368e0 2023-09-30T22:28:32.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.255+0000 7faa50ff9700 1 -- 172.21.15.154:0/2007160598 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48003800 con 0x7faa541368e0 2023-09-30T22:28:32.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.256+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2007160598 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5409a2c0 con 0x7faa541368e0 2023-09-30T22:28:32.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.256+0000 7faa50ff9700 1 -- 172.21.15.154:0/2007160598 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48003bb0 con 0x7faa541368e0 2023-09-30T22:28:32.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.256+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2007160598 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5412fd00 con 0x7faa541368e0 2023-09-30T22:28:32.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.257+0000 7faa50ff9700 1 -- 172.21.15.154:0/2007160598 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa48021070 con 0x7faa541368e0 2023-09-30T22:28:32.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.257+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2007160598 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5404f2a0 con 0x7faa541368e0 2023-09-30T22:28:32.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.257+0000 7faa50ff9700 1 -- 172.21.15.154:0/2007160598 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa48040b40 con 0x7faa541368e0 2023-09-30T22:28:32.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.262+0000 7faa50ff9700 1 -- 172.21.15.154:0/2007160598 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa4800b3e0 con 0x7faa541368e0 2023-09-30T22:28:32.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.310+0000 7fd9de867700 1 Processor -- start 2023-09-30T22:28:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.310+0000 7fd9de867700 1 -- start start 2023-09-30T22:28:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9de867700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9de867700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9d80a1340 0x7fd9d812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9de867700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d81304a0 0x7fd9d8130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9de867700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80a1e70 con 0x7fd9d80a1340 2023-09-30T22:28:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9de867700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809a720 con 0x7fd9d81304a0 2023-09-30T22:28:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9de867700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809b300 con 0x7fd9d80a0a30 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9d7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9d7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54498/0 (socket says 172.21.15.154:54498) 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9d7fff700 1 -- 172.21.15.154:0/2547573621 learned_addr learned my addr 172.21.15.154:0/2547573621 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9d77fe700 1 --2- 172.21.15.154:0/2547573621 >> v2:172.21.15.154:3300/0 conn(0x7fd9d80a1340 0x7fd9d812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9d7fff700 1 -- 172.21.15.154:0/2547573621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d81304a0 msgr2=0x7fd9d8130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9d7fff700 1 --2- 172.21.15.154:0/2547573621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d81304a0 0x7fd9d8130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9d7fff700 1 -- 172.21.15.154:0/2547573621 >> v2:172.21.15.154:3300/0 conn(0x7fd9d80a1340 msgr2=0x7fd9d812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.311+0000 7fd9d7fff700 1 --2- 172.21.15.154:0/2547573621 >> v2:172.21.15.154:3300/0 conn(0x7fd9d80a1340 0x7fd9d812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.312+0000 7fd9d7fff700 1 -- 172.21.15.154:0/2547573621 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d809abc0 con 0x7fd9d80a0a30 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.312+0000 7fd9d7fff700 1 --2- 172.21.15.154:0/2547573621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d80a0e00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8006fd0 tx=0x7fd9c8009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5ce015f5842b9b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.312+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/2547573621 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8005e30 con 0x7fd9d80a0a30 2023-09-30T22:28:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.312+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/2547573621 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8004030 con 0x7fd9d80a0a30 2023-09-30T22:28:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.312+0000 7fd9d6ffd700 1 -- 172.21.15.154:0/2547573621 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80043e0 con 0x7fd9d80a0a30 2023-09-30T22:28:32.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.313+0000 7fd9de867700 1 -- 172.21.15.154:0/2547573621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 msgr2=0x7fd9d80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.313+0000 7fd9de867700 1 --2- 172.21.15.154:0/2547573621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d80a0e00 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8006fd0 tx=0x7fd9c8009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.313+0000 7fd9de867700 1 -- 172.21.15.154:0/2547573621 shutdown_connections 2023-09-30T22:28:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.313+0000 7fd9de867700 1 --2- 172.21.15.154:0/2547573621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d81304a0 0x7fd9d8130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.313+0000 7fd9de867700 1 --2- 172.21.15.154:0/2547573621 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d80a0e00 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.313+0000 7fd9de867700 1 --2- 172.21.15.154:0/2547573621 >> v2:172.21.15.154:3300/0 conn(0x7fd9d80a1340 0x7fd9d812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.313+0000 7fd9de867700 1 -- 172.21.15.154:0/2547573621 >> 172.21.15.154:0/2547573621 conn(0x7fd9d80a2980 msgr2=0x7fd9d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.313+0000 7fd9de867700 1 -- 172.21.15.154:0/2547573621 shutdown_connections 2023-09-30T22:28:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.313+0000 7fd9de867700 1 -- 172.21.15.154:0/2547573621 wait complete. 2023-09-30T22:28:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.314+0000 7fd9de867700 1 Processor -- start 2023-09-30T22:28:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.314+0000 7fd9de867700 1 -- start start 2023-09-30T22:28:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.314+0000 7fd9de867700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.314+0000 7fd9de867700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d80a1340 0x7fd9d811f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.314+0000 7fd9de867700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d81304a0 0x7fd9d81c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.314+0000 7fd9de867700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809ae00 con 0x7fd9d81304a0 2023-09-30T22:28:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.314+0000 7fd9de867700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d809fcf0 con 0x7fd9d80a1340 2023-09-30T22:28:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.314+0000 7fd9de867700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d8120f00 con 0x7fd9d80a0a30 2023-09-30T22:28:32.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d811ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d811ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54510/0 (socket says 172.21.15.154:54510) 2023-09-30T22:28:32.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d7fff700 1 -- 172.21.15.154:0/4286003788 learned_addr learned my addr 172.21.15.154:0/4286003788 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:32.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d77fe700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d80a1340 0x7fd9d811f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9dce04700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d81304a0 0x7fd9d81c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d7fff700 1 -- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d80a1340 msgr2=0x7fd9d811f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d7fff700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d80a1340 0x7fd9d811f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d7fff700 1 -- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d81304a0 msgr2=0x7fd9d81c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d7fff700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d81304a0 0x7fd9d81c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d7fff700 1 -- 172.21.15.154:0/4286003788 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c8009500 con 0x7fd9d80a0a30 2023-09-30T22:28:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d77fe700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d80a1340 0x7fd9d811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d7fff700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d811ebb0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009130 tx=0x7fd9c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d4ff9700 1 -- 172.21.15.154:0/4286003788 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c801f070 con 0x7fd9d80a0a30 2023-09-30T22:28:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9d4ff9700 1 -- 172.21.15.154:0/4286003788 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8006b70 con 0x7fd9d80a0a30 2023-09-30T22:28:32.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.315+0000 7fd9de867700 1 -- 172.21.15.154:0/4286003788 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d811e730 con 0x7fd9d80a0a30 2023-09-30T22:28:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.316+0000 7fd9d4ff9700 1 -- 172.21.15.154:0/4286003788 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800c6f0 con 0x7fd9d80a0a30 2023-09-30T22:28:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.316+0000 7fd9de867700 1 -- 172.21.15.154:0/4286003788 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d8122590 con 0x7fd9d80a0a30 2023-09-30T22:28:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.317+0000 7fd9d4ff9700 1 -- 172.21.15.154:0/4286003788 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9c800c850 con 0x7fd9d80a0a30 2023-09-30T22:28:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.317+0000 7fd9de867700 1 -- 172.21.15.154:0/4286003788 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d804f2a0 con 0x7fd9d80a0a30 2023-09-30T22:28:32.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.317+0000 7fd9d4ff9700 1 -- 172.21.15.154:0/4286003788 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd9c8018910 con 0x7fd9d80a0a30 2023-09-30T22:28:32.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.321+0000 7fd9d4ff9700 1 -- 172.21.15.154:0/4286003788 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9c8045060 con 0x7fd9d80a0a30 2023-09-30T22:28:32.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.353+0000 7fe792d29700 1 Processor -- start 2023-09-30T22:28:32.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.353+0000 7fe792d29700 1 -- start start 2023-09-30T22:28:32.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe792d29700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe78c138040 0x7fe78c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe792d29700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c0a08e0 0x7fe78c0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe792d29700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a1230 0x7fe78c13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe792d29700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c0a2100 con 0x7fe78c138040 2023-09-30T22:28:32.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe792d29700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c138950 con 0x7fe78c0a08e0 2023-09-30T22:28:32.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe792d29700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c1379e0 con 0x7fe78c0a1230 2023-09-30T22:28:32.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe78bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c0a08e0 0x7fe78c0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe790ac5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe78c138040 0x7fe78c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe78bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c0a08e0 0x7fe78c0a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45348/0 (socket says 172.21.15.154:45348) 2023-09-30T22:28:32.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe78bfff700 1 -- 172.21.15.154:0/1537292503 learned_addr learned my addr 172.21.15.154:0/1537292503 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:32.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe7912c6700 1 --2- 172.21.15.154:0/1537292503 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a1230 0x7fe78c13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe78bfff700 1 -- 172.21.15.154:0/1537292503 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a1230 msgr2=0x7fe78c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe78bfff700 1 --2- 172.21.15.154:0/1537292503 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a1230 0x7fe78c13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe78bfff700 1 -- 172.21.15.154:0/1537292503 >> v2:172.21.15.154:3300/0 conn(0x7fe78c138040 msgr2=0x7fe78c138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.354+0000 7fe78bfff700 1 --2- 172.21.15.154:0/1537292503 >> v2:172.21.15.154:3300/0 conn(0x7fe78c138040 0x7fe78c138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.355+0000 7fe78bfff700 1 -- 172.21.15.154:0/1537292503 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c09b9b0 con 0x7fe78c0a08e0 2023-09-30T22:28:32.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.355+0000 7fe78bfff700 1 --2- 172.21.15.154:0/1537292503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c0a08e0 0x7fe78c0a0cf0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe778009920 tx=0x7fe778009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5436cd4be2e698f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.355+0000 7fe78b7fe700 1 -- 172.21.15.154:0/1537292503 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778011830 con 0x7fe78c0a08e0 2023-09-30T22:28:32.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.355+0000 7fe78b7fe700 1 -- 172.21.15.154:0/1537292503 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe778011990 con 0x7fe78c0a08e0 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.355+0000 7fe78b7fe700 1 -- 172.21.15.154:0/1537292503 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778011d20 con 0x7fe78c0a08e0 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.356+0000 7fe792d29700 1 -- 172.21.15.154:0/1537292503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c0a08e0 msgr2=0x7fe78c0a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.356+0000 7fe792d29700 1 --2- 172.21.15.154:0/1537292503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c0a08e0 0x7fe78c0a0cf0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe778009920 tx=0x7fe778009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.356+0000 7fe792d29700 1 -- 172.21.15.154:0/1537292503 shutdown_connections 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.356+0000 7fe792d29700 1 --2- 172.21.15.154:0/1537292503 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a1230 0x7fe78c13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.356+0000 7fe792d29700 1 --2- 172.21.15.154:0/1537292503 >> v2:172.21.15.154:3300/0 conn(0x7fe78c138040 0x7fe78c138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.356+0000 7fe792d29700 1 --2- 172.21.15.154:0/1537292503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c0a08e0 0x7fe78c0a0cf0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.356+0000 7fe792d29700 1 -- 172.21.15.154:0/1537292503 >> 172.21.15.154:0/1537292503 conn(0x7fe78c0a2980 msgr2=0x7fe78c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.356+0000 7fe792d29700 1 -- 172.21.15.154:0/1537292503 shutdown_connections 2023-09-30T22:28:32.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.356+0000 7fe792d29700 1 -- 172.21.15.154:0/1537292503 wait complete. 2023-09-30T22:28:32.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.357+0000 7fe792d29700 1 Processor -- start 2023-09-30T22:28:32.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.357+0000 7fe792d29700 1 -- start start 2023-09-30T22:28:32.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.357+0000 7fe792d29700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a08e0 0x7fe78c1d5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.357+0000 7fe792d29700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe78c0a1230 0x7fe78c1d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.357+0000 7fe792d29700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c138040 0x7fe78c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.357+0000 7fe792d29700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c1d5ee0 con 0x7fe78c0a1230 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.357+0000 7fe792d29700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c11aed0 con 0x7fe78c138040 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.357+0000 7fe792d29700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c09a240 con 0x7fe78c0a08e0 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.357+0000 7fe790ac5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a08e0 0x7fe78c1d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe790ac5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a08e0 0x7fe78c1d5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54526/0 (socket says 172.21.15.154:54526) 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe790ac5700 1 -- 172.21.15.154:0/545273335 learned_addr learned my addr 172.21.15.154:0/545273335 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe7912c6700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c138040 0x7fe78c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe78bfff700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe78c0a1230 0x7fe78c1d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe790ac5700 1 -- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c138040 msgr2=0x7fe78c118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe790ac5700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c138040 0x7fe78c118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe790ac5700 1 -- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe78c0a1230 msgr2=0x7fe78c1d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe790ac5700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe78c0a1230 0x7fe78c1d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe790ac5700 1 -- 172.21.15.154:0/545273335 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe778009550 con 0x7fe78c0a08e0 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe78bfff700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe78c0a1230 0x7fe78c1d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe790ac5700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a08e0 0x7fe78c1d5460 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe78000e730 tx=0x7fe78000ea40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe7897fa700 1 -- 172.21.15.154:0/545273335 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780013610 con 0x7fe78c0a08e0 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe7897fa700 1 -- 172.21.15.154:0/545273335 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780013770 con 0x7fe78c0a08e0 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe792d29700 1 -- 172.21.15.154:0/545273335 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c11a310 con 0x7fe78c0a08e0 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe7897fa700 1 -- 172.21.15.154:0/545273335 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780013b20 con 0x7fe78c0a08e0 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.358+0000 7fe792d29700 1 -- 172.21.15.154:0/545273335 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c13dac0 con 0x7fe78c0a08e0 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.360+0000 7fe792d29700 1 -- 172.21.15.154:0/545273335 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c11b0f0 con 0x7fe78c0a08e0 2023-09-30T22:28:32.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.360+0000 7fe7897fa700 1 -- 172.21.15.154:0/545273335 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe780013c80 con 0x7fe78c0a08e0 2023-09-30T22:28:32.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.360+0000 7fe7897fa700 1 -- 172.21.15.154:0/545273335 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe78003f030 con 0x7fe78c0a08e0 2023-09-30T22:28:32.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.369+0000 7fe7897fa700 1 -- 172.21.15.154:0/545273335 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe78c11b0f0 con 0x7fe78c0a08e0 2023-09-30T22:28:32.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.399+0000 7fc5e6104700 1 Processor -- start 2023-09-30T22:28:32.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.399+0000 7fc5e6104700 1 -- start start 2023-09-30T22:28:32.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.399+0000 7fc5e6104700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e00a0a70 0x7fc5e00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.399+0000 7fc5e6104700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 0x7fc5e0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.399+0000 7fc5e6104700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e009dc00 con 0x7fc5e0133f50 2023-09-30T22:28:32.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.399+0000 7fc5e6104700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e009ea60 con 0x7fc5e00a1380 2023-09-30T22:28:32.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.399+0000 7fc5e6104700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e009dec0 con 0x7fc5e00a0a70 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5df7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e00a0a70 0x7fc5e00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5dffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc5e0133f50 0x7fc5e013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56800/0 (socket says 172.21.15.154:56800) 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5dffff700 1 -- 172.21.15.154:0/3102845810 learned_addr learned my addr 172.21.15.154:0/3102845810 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5deffd700 1 --2- 172.21.15.154:0/3102845810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 0x7fc5e0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5de7fc700 1 -- 172.21.15.154:0/3102845810 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684661182 0 0) 0x7fc5e009dc00 con 0x7fc5e0133f50 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5df7fe700 1 -- 172.21.15.154:0/3102845810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 msgr2=0x7fc5e0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5df7fe700 1 --2- 172.21.15.154:0/3102845810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 0x7fc5e0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5df7fe700 1 -- 172.21.15.154:0/3102845810 >> v1:172.21.15.154:6789/0 conn(0x7fc5e0133f50 legacy=0x7fc5e013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5df7fe700 1 -- 172.21.15.154:0/3102845810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e009e6a0 con 0x7fc5e00a0a70 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5df7fe700 1 --2- 172.21.15.154:0/3102845810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e00a0a70 0x7fc5e00a0e40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009870 tx=0x7fc5d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f09f66931f9a8e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.400+0000 7fc5de7fc700 1 -- 172.21.15.154:0/3102845810 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0011830 con 0x7fc5e00a0a70 2023-09-30T22:28:32.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5de7fc700 1 -- 172.21.15.154:0/3102845810 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d0011990 con 0x7fc5e00a0a70 2023-09-30T22:28:32.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5de7fc700 1 -- 172.21.15.154:0/3102845810 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0011d20 con 0x7fc5e00a0a70 2023-09-30T22:28:32.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5e6104700 1 -- 172.21.15.154:0/3102845810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e00a0a70 msgr2=0x7fc5e00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5e6104700 1 --2- 172.21.15.154:0/3102845810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e00a0a70 0x7fc5e00a0e40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009870 tx=0x7fc5d0009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5e6104700 1 -- 172.21.15.154:0/3102845810 shutdown_connections 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5e6104700 1 --2- 172.21.15.154:0/3102845810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e00a0a70 0x7fc5e00a0e40 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5e6104700 1 --2- 172.21.15.154:0/3102845810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 0x7fc5e0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5e6104700 1 -- 172.21.15.154:0/3102845810 >> 172.21.15.154:0/3102845810 conn(0x7fc5e00a6610 msgr2=0x7fc5e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5e6104700 1 -- 172.21.15.154:0/3102845810 shutdown_connections 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.401+0000 7fc5e6104700 1 -- 172.21.15.154:0/3102845810 wait complete. 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.402+0000 7fc5e6104700 1 Processor -- start 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.402+0000 7fc5e6104700 1 -- start start 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5e6104700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e00a0a70 0x7fc5e01233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5e6104700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 0x7fc5e0123910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5e6104700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e0133f50 0x7fc5e01c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5e6104700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e0124630 con 0x7fc5e00a0a70 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5e6104700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e01252a0 con 0x7fc5e00a1380 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5e6104700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00a03e0 con 0x7fc5e0133f50 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5dffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e0133f50 0x7fc5e01c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5dffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e0133f50 0x7fc5e01c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54542/0 (socket says 172.21.15.154:54542) 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5dffff700 1 -- 172.21.15.154:0/2022320302 learned_addr learned my addr 172.21.15.154:0/2022320302 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5deffd700 1 --2- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 0x7fc5e0123910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5df7fe700 1 --2- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e00a0a70 0x7fc5e01233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5dffff700 1 -- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 msgr2=0x7fc5e0123910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5dffff700 1 --2- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 0x7fc5e0123910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5dffff700 1 -- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e00a0a70 msgr2=0x7fc5e01233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5dffff700 1 --2- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e00a0a70 0x7fc5e01233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.403+0000 7fc5dffff700 1 -- 172.21.15.154:0/2022320302 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00094a0 con 0x7fc5e0133f50 2023-09-30T22:28:32.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.404+0000 7fc5dffff700 1 --2- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e0133f50 0x7fc5e01c8260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8002230 tx=0x7fc5d800cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:32.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.404+0000 7fc5c7fff700 1 -- 172.21.15.154:0/2022320302 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800aac0 con 0x7fc5e0133f50 2023-09-30T22:28:32.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.404+0000 7fc5c7fff700 1 -- 172.21.15.154:0/2022320302 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d800ac40 con 0x7fc5e0133f50 2023-09-30T22:28:32.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.404+0000 7fc5e6104700 1 -- 172.21.15.154:0/2022320302 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e0124ba0 con 0x7fc5e0133f50 2023-09-30T22:28:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.404+0000 7fc5c7fff700 1 -- 172.21.15.154:0/2022320302 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80070d0 con 0x7fc5e0133f50 2023-09-30T22:28:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.404+0000 7fc5e6104700 1 -- 172.21.15.154:0/2022320302 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e0126cd0 con 0x7fc5e0133f50 2023-09-30T22:28:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.405+0000 7fc5c7fff700 1 -- 172.21.15.154:0/2022320302 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5d8007250 con 0x7fc5e0133f50 2023-09-30T22:28:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.405+0000 7fc5c7fff700 1 -- 172.21.15.154:0/2022320302 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5d803f5d0 con 0x7fc5e0133f50 2023-09-30T22:28:32.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.405+0000 7fc5e6104700 1 -- 172.21.15.154:0/2022320302 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e004f2a0 con 0x7fc5e0133f50 2023-09-30T22:28:32.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.410+0000 7fc5c7fff700 1 -- 172.21.15.154:0/2022320302 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5d8018070 con 0x7fc5e0133f50 2023-09-30T22:28:32.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.481+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2007160598 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faa5411d940 con 0x7faa541368e0 2023-09-30T22:28:32.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.482+0000 7faa50ff9700 1 -- 172.21.15.154:0/2007160598 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa48015020 con 0x7faa541368e0 2023-09-30T22:28:32.483 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:32.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.486+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 msgr2=0x7faa5411a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.486+0000 7faa5a4e0700 1 --2- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa5411a300 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7faa48000c00 tx=0x7faa48004750 comp rx=0 tx=0).stop 2023-09-30T22:28:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.486+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2007160598 shutdown_connections 2023-09-30T22:28:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.486+0000 7faa5a4e0700 1 --2- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa54139200 0x7faa5411a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.486+0000 7faa5a4e0700 1 --2- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa54133900 0x7faa54119dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.486+0000 7faa5a4e0700 1 --2- 172.21.15.154:0/2007160598 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa541368e0 0x7faa5411a300 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.486+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2007160598 >> 172.21.15.154:0/2007160598 conn(0x7faa540a2980 msgr2=0x7faa54130170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.486+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2007160598 shutdown_connections 2023-09-30T22:28:32.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.486+0000 7faa5a4e0700 1 -- 172.21.15.154:0/2007160598 wait complete. 2023-09-30T22:28:32.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:32.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.534+0000 7fd9de867700 1 -- 172.21.15.154:0/4286003788 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9d806bce0 con 0x7fd9d80a0a30 2023-09-30T22:28:32.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.534+0000 7fd9d4ff9700 1 -- 172.21.15.154:0/4286003788 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9c803d020 con 0x7fd9d80a0a30 2023-09-30T22:28:32.535 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:32.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.537+0000 7fd9de867700 1 -- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 msgr2=0x7fd9d811ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.537+0000 7fd9de867700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d811ebb0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009130 tx=0x7fd9c8004750 comp rx=0 tx=0).stop 2023-09-30T22:28:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.537+0000 7fd9de867700 1 -- 172.21.15.154:0/4286003788 shutdown_connections 2023-09-30T22:28:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.537+0000 7fd9de867700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9d81304a0 0x7fd9d81c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.537+0000 7fd9de867700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd9d80a0a30 0x7fd9d811ebb0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.537+0000 7fd9de867700 1 --2- 172.21.15.154:0/4286003788 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9d80a1340 0x7fd9d811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.537+0000 7fd9de867700 1 -- 172.21.15.154:0/4286003788 >> 172.21.15.154:0/4286003788 conn(0x7fd9d80a2980 msgr2=0x7fd9d809deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.538+0000 7fd9de867700 1 -- 172.21.15.154:0/4286003788 shutdown_connections 2023-09-30T22:28:32.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.538+0000 7fd9de867700 1 -- 172.21.15.154:0/4286003788 wait complete. 2023-09-30T22:28:32.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:32.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.569+0000 7fe792d29700 1 -- 172.21.15.154:0/545273335 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe78c04f2a0 con 0x7fe78c0a08e0 2023-09-30T22:28:32.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.570+0000 7fe7897fa700 1 -- 172.21.15.154:0/545273335 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe780021020 con 0x7fe78c0a08e0 2023-09-30T22:28:32.571 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:32.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.572+0000 7fe792d29700 1 -- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a08e0 msgr2=0x7fe78c1d5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.572+0000 7fe792d29700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a08e0 0x7fe78c1d5460 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe78000e730 tx=0x7fe78000ea40 comp rx=0 tx=0).stop 2023-09-30T22:28:32.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.572+0000 7fe792d29700 1 -- 172.21.15.154:0/545273335 shutdown_connections 2023-09-30T22:28:32.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.572+0000 7fe792d29700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe78c138040 0x7fe78c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.572+0000 7fe792d29700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe78c0a08e0 0x7fe78c1d5460 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.572+0000 7fe792d29700 1 --2- 172.21.15.154:0/545273335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe78c0a1230 0x7fe78c1d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.572+0000 7fe792d29700 1 -- 172.21.15.154:0/545273335 >> 172.21.15.154:0/545273335 conn(0x7fe78c0a2980 msgr2=0x7fe78c06e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.572+0000 7fe792d29700 1 -- 172.21.15.154:0/545273335 shutdown_connections 2023-09-30T22:28:32.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.572+0000 7fe792d29700 1 -- 172.21.15.154:0/545273335 wait complete. 2023-09-30T22:28:32.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:32.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.642+0000 7fc5e6104700 1 -- 172.21.15.154:0/2022320302 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc5e009c680 con 0x7fc5e0133f50 2023-09-30T22:28:32.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.642+0000 7fc5c7fff700 1 -- 172.21.15.154:0/2022320302 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5d8007500 con 0x7fc5e0133f50 2023-09-30T22:28:32.644 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:32.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.644+0000 7fc5e6104700 1 -- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e0133f50 msgr2=0x7fc5e01c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:32.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.644+0000 7fc5e6104700 1 --2- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e0133f50 0x7fc5e01c8260 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8002230 tx=0x7fc5d800cf50 comp rx=0 tx=0).stop 2023-09-30T22:28:32.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.644+0000 7fc5e6104700 1 -- 172.21.15.154:0/2022320302 shutdown_connections 2023-09-30T22:28:32.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.644+0000 7fc5e6104700 1 --2- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc5e0133f50 0x7fc5e01c8260 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.644+0000 7fc5e6104700 1 --2- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5e00a0a70 0x7fc5e01233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.644+0000 7fc5e6104700 1 --2- 172.21.15.154:0/2022320302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5e00a1380 0x7fc5e0123910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.644+0000 7fc5e6104700 1 -- 172.21.15.154:0/2022320302 >> 172.21.15.154:0/2022320302 conn(0x7fc5e00a6610 msgr2=0x7fc5e00a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.644+0000 7fc5e6104700 1 -- 172.21.15.154:0/2022320302 shutdown_connections 2023-09-30T22:28:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:32.644+0000 7fc5e6104700 1 -- 172.21.15.154:0/2022320302 wait complete. 2023-09-30T22:28:32.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:33.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:33.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:33.585 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:33.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.637+0000 7f6bc4b95700 1 Processor -- start 2023-09-30T22:28:33.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.637+0000 7f6bc4b95700 1 -- start start 2023-09-30T22:28:33.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bc4b95700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bc009ef80 0x7f6bc0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bc4b95700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bc4b95700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc009af80 con 0x7f6bc009a150 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bc4b95700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc009a520 con 0x7f6bc009ef80 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bc4b95700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc009fe00 con 0x7f6bc009f370 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bbdd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bc009ef80 0x7f6bc0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bbdd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bc009ef80 0x7f6bc0138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52902/0 (socket says 172.21.15.154:52902) 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bbdd9b700 1 -- 172.21.15.154:0/956028634 learned_addr learned my addr 172.21.15.154:0/956028634 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bbed9d700 1 --2- 172.21.15.154:0/956028634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bbed9d700 1 -- 172.21.15.154:0/956028634 >> v2:172.21.15.154:3300/0 conn(0x7f6bc009ef80 msgr2=0x7f6bc0138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bbed9d700 1 --2- 172.21.15.154:0/956028634 >> v2:172.21.15.154:3300/0 conn(0x7f6bc009ef80 0x7f6bc0138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bbed9d700 1 -- 172.21.15.154:0/956028634 >> v1:172.21.15.154:6789/0 conn(0x7f6bc009a150 legacy=0x7f6bc009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bbed9d700 1 -- 172.21.15.154:0/956028634 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc006bc20 con 0x7f6bc009f370 2023-09-30T22:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.638+0000 7f6bbdd9b700 1 --2- 172.21.15.154:0/956028634 >> v2:172.21.15.154:3300/0 conn(0x7f6bc009ef80 0x7f6bc0138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bbed9d700 1 --2- 172.21.15.154:0/956028634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc013b3b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009dc0 tx=0x7f6bb800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f3e22299374f48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bbd59a700 1 -- 172.21.15.154:0/956028634 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800e070 con 0x7f6bc009f370 2023-09-30T22:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bbd59a700 1 -- 172.21.15.154:0/956028634 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb800bae0 con 0x7f6bc009f370 2023-09-30T22:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bbd59a700 1 -- 172.21.15.154:0/956028634 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800be90 con 0x7f6bc009f370 2023-09-30T22:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bc4b95700 1 -- 172.21.15.154:0/956028634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 msgr2=0x7f6bc013b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bc4b95700 1 --2- 172.21.15.154:0/956028634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc013b3b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009dc0 tx=0x7f6bb800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bc4b95700 1 -- 172.21.15.154:0/956028634 shutdown_connections 2023-09-30T22:28:33.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bc4b95700 1 --2- 172.21.15.154:0/956028634 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc013b3b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bc4b95700 1 --2- 172.21.15.154:0/956028634 >> v2:172.21.15.154:3300/0 conn(0x7f6bc009ef80 0x7f6bc0138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.639+0000 7f6bc4b95700 1 -- 172.21.15.154:0/956028634 >> 172.21.15.154:0/956028634 conn(0x7f6bc00a4430 msgr2=0x7f6bc00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.640+0000 7f6bc4b95700 1 -- 172.21.15.154:0/956028634 shutdown_connections 2023-09-30T22:28:33.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.640+0000 7f6bc4b95700 1 -- 172.21.15.154:0/956028634 wait complete. 2023-09-30T22:28:33.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bc4b95700 1 Processor -- start 2023-09-30T22:28:33.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bc4b95700 1 -- start start 2023-09-30T22:28:33.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bc4b95700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bc009a150 0x7f6bc011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bc4b95700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bc009ef80 0x7f6bc011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bc4b95700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bc4b95700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc01360d0 con 0x7f6bc009ef80 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bc4b95700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0121330 con 0x7f6bc009a150 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bc4b95700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0122050 con 0x7f6bc009f370 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bbed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bbed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc011f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54554/0 (socket says 172.21.15.154:54554) 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bbdd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bc009ef80 0x7f6bc011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bbe59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bc009a150 0x7f6bc011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.641+0000 7f6bbed9d700 1 -- 172.21.15.154:0/3767613034 learned_addr learned my addr 172.21.15.154:0/3767613034 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bbed9d700 1 -- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bc009a150 msgr2=0x7f6bc011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bbed9d700 1 --2- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bc009a150 0x7f6bc011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bbed9d700 1 -- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bc009ef80 msgr2=0x7f6bc011f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bbed9d700 1 --2- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bc009ef80 0x7f6bc011f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bbed9d700 1 -- 172.21.15.154:0/3767613034 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4009550 con 0x7f6bc009f370 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bbe59c700 1 --2- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bc009a150 0x7f6bc011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bbdd9b700 1 --2- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bc009ef80 0x7f6bc011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bbed9d700 1 --2- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc011f550 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800b370 tx=0x7f6bb8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6baeffd700 1 -- 172.21.15.154:0/3767613034 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8004800 con 0x7f6bc009f370 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6baeffd700 1 -- 172.21.15.154:0/3767613034 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8020070 con 0x7f6bc009f370 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6baeffd700 1 -- 172.21.15.154:0/3767613034 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8026670 con 0x7f6bc009f370 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bc4b95700 1 -- 172.21.15.154:0/3767613034 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb8009a70 con 0x7f6bc009f370 2023-09-30T22:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.642+0000 7f6bc4b95700 1 -- 172.21.15.154:0/3767613034 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc009bc20 con 0x7f6bc009f370 2023-09-30T22:28:33.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.643+0000 7f6baeffd700 1 -- 172.21.15.154:0/3767613034 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bb8012430 con 0x7f6bc009f370 2023-09-30T22:28:33.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.643+0000 7f6bc4b95700 1 -- 172.21.15.154:0/3767613034 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc009fa30 con 0x7f6bc009f370 2023-09-30T22:28:33.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.643+0000 7f6baeffd700 1 -- 172.21.15.154:0/3767613034 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bb8022070 con 0x7f6bc009f370 2023-09-30T22:28:33.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.648+0000 7f6baeffd700 1 -- 172.21.15.154:0/3767613034 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bb800c5f0 con 0x7f6bc009f370 2023-09-30T22:28:33.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:33.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.690+0000 7f80483e3700 1 Processor -- start 2023-09-30T22:28:33.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.690+0000 7f80483e3700 1 -- start start 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.691+0000 7f80483e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804006a770 0x7f804006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.691+0000 7f80483e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006b080 0x7f80401317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.691+0000 7f80483e3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804009da80 con 0x7f8040131cf0 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.691+0000 7f80483e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804009dce0 con 0x7f804006b080 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.691+0000 7f80483e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f804009eb20 con 0x7f804006a770 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.691+0000 7f8046980700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8040131cf0 0x7f8040138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56818/0 (socket says 172.21.15.154:56818) 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.691+0000 7f804617f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804006a770 0x7f804006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.691+0000 7f8046980700 1 -- 172.21.15.154:0/3027829955 learned_addr learned my addr 172.21.15.154:0/3027829955 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804597e700 1 --2- 172.21.15.154:0/3027829955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006b080 0x7f80401317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804517d700 1 -- 172.21.15.154:0/3027829955 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340498393 0 0) 0x7f804009da80 con 0x7f8040131cf0 2023-09-30T22:28:33.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804517d700 1 -- 172.21.15.154:0/3027829955 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802c0035b0 con 0x7f8040131cf0 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804617f700 1 -- 172.21.15.154:0/3027829955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006b080 msgr2=0x7f80401317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804617f700 1 --2- 172.21.15.154:0/3027829955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006b080 0x7f80401317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804617f700 1 -- 172.21.15.154:0/3027829955 >> v1:172.21.15.154:6789/0 conn(0x7f8040131cf0 legacy=0x7f8040138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804617f700 1 -- 172.21.15.154:0/3027829955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804009d860 con 0x7f804006a770 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804617f700 1 --2- 172.21.15.154:0/3027829955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804006a770 0x7f804006ab40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f803c0098a0 tx=0x7f803c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57c53d034d3dce24 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804517d700 1 -- 172.21.15.154:0/3027829955 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c011830 con 0x7f804006a770 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804517d700 1 -- 172.21.15.154:0/3027829955 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c011990 con 0x7f804006a770 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.692+0000 7f804517d700 1 -- 172.21.15.154:0/3027829955 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c011d20 con 0x7f804006a770 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.693+0000 7f80483e3700 1 -- 172.21.15.154:0/3027829955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804006a770 msgr2=0x7f804006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.693+0000 7f80483e3700 1 --2- 172.21.15.154:0/3027829955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804006a770 0x7f804006ab40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f803c0098a0 tx=0x7f803c009bb0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.693+0000 7f80483e3700 1 -- 172.21.15.154:0/3027829955 shutdown_connections 2023-09-30T22:28:33.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.693+0000 7f80483e3700 1 --2- 172.21.15.154:0/3027829955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f804006a770 0x7f804006ab40 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.693+0000 7f80483e3700 1 --2- 172.21.15.154:0/3027829955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006b080 0x7f80401317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.693+0000 7f80483e3700 1 -- 172.21.15.154:0/3027829955 >> 172.21.15.154:0/3027829955 conn(0x7f8040099c40 msgr2=0x7f80400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.693+0000 7f80483e3700 1 -- 172.21.15.154:0/3027829955 shutdown_connections 2023-09-30T22:28:33.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.693+0000 7f80483e3700 1 -- 172.21.15.154:0/3027829955 wait complete. 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.694+0000 7f80483e3700 1 Processor -- start 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.694+0000 7f80483e3700 1 -- start start 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f80483e3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006a770 0x7f804009aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f80483e3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f804006b080 0x7f804009b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f80483e3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8040131cf0 0x7f80401c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f80483e3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8040071e10 con 0x7f804006b080 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f80483e3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8040131310 con 0x7f804006a770 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f80483e3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8040122270 con 0x7f8040131cf0 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f804597e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f804006b080 0x7f804009b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f804597e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f804006b080 0x7f804009b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52912/0 (socket says 172.21.15.154:52912) 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f804597e700 1 -- 172.21.15.154:0/404451306 learned_addr learned my addr 172.21.15.154:0/404451306 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:33.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f8046980700 1 --2- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8040131cf0 0x7f80401c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f804617f700 1 --2- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006a770 0x7f804009aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f804597e700 1 -- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8040131cf0 msgr2=0x7f80401c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f804597e700 1 --2- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8040131cf0 0x7f80401c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f804597e700 1 -- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006a770 msgr2=0x7f804009aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f804597e700 1 --2- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006a770 0x7f804009aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.695+0000 7f804597e700 1 -- 172.21.15.154:0/404451306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0094a0 con 0x7f804006b080 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.696+0000 7f804597e700 1 --2- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f804006b080 0x7f804009b430 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f803000e9b0 tx=0x7f803000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.696+0000 7f8036ffd700 1 -- 172.21.15.154:0/404451306 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030009710 con 0x7f804006b080 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.696+0000 7f8036ffd700 1 -- 172.21.15.154:0/404451306 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803000ee50 con 0x7f804006b080 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.696+0000 7f80483e3700 1 -- 172.21.15.154:0/404451306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804009a950 con 0x7f804006b080 2023-09-30T22:28:33.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.696+0000 7f80483e3700 1 -- 172.21.15.154:0/404451306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80400a2d90 con 0x7f804006b080 2023-09-30T22:28:33.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.696+0000 7f8036ffd700 1 -- 172.21.15.154:0/404451306 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803000ca70 con 0x7f804006b080 2023-09-30T22:28:33.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.697+0000 7f8036ffd700 1 -- 172.21.15.154:0/404451306 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f803000cbd0 con 0x7f804006b080 2023-09-30T22:28:33.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.697+0000 7f8036ffd700 1 -- 172.21.15.154:0/404451306 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f803003fa60 con 0x7f804006b080 2023-09-30T22:28:33.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.697+0000 7f80483e3700 1 -- 172.21.15.154:0/404451306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80280052e0 con 0x7f804006b080 2023-09-30T22:28:33.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.706+0000 7f8036ffd700 1 -- 172.21.15.154:0/404451306 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8030017080 con 0x7f804006b080 2023-09-30T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.736+0000 7f1dc10dd700 1 Processor -- start 2023-09-30T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.737+0000 7f1dc10dd700 1 -- start start 2023-09-30T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.737+0000 7f1dc10dd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1dbc09d860 0x7f1dbc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.737+0000 7f1dc10dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc09e170 0x7f1dbc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.737+0000 7f1dc10dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc130ce0 0x7f1dbc131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.737+0000 7f1dc10dd700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dbc131670 con 0x7f1dbc09d860 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.737+0000 7f1dc10dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc09aaa0 con 0x7f1dbc130ce0 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.737+0000 7f1dc10dd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc09f870 con 0x7f1dbc09e170 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.737+0000 7f1dbad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1dbc09d860 0x7f1dbc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.737+0000 7f1dbad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1dbc09d860 0x7f1dbc09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52914/0 (socket says 172.21.15.154:52914) 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dbad9d700 1 -- 172.21.15.154:0/2113648805 learned_addr learned my addr 172.21.15.154:0/2113648805 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dba59c700 1 --2- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc09e170 0x7f1dbc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dbb59e700 1 --2- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc130ce0 0x7f1dbc131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dba59c700 1 -- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc130ce0 msgr2=0x7f1dbc131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dba59c700 1 --2- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc130ce0 0x7f1dbc131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dba59c700 1 -- 172.21.15.154:0/2113648805 >> v2:172.21.15.154:3300/0 conn(0x7f1dbc09d860 msgr2=0x7f1dbc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dba59c700 1 --2- 172.21.15.154:0/2113648805 >> v2:172.21.15.154:3300/0 conn(0x7f1dbc09d860 0x7f1dbc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dba59c700 1 -- 172.21.15.154:0/2113648805 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc09b360 con 0x7f1dbc09e170 2023-09-30T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dbb59e700 1 --2- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc130ce0 0x7f1dbc131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dbad9d700 1 --2- 172.21.15.154:0/2113648805 >> v2:172.21.15.154:3300/0 conn(0x7f1dbc09d860 0x7f1dbc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1dba59c700 1 --2- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc09e170 0x7f1dbc1307a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009870 tx=0x7f1db0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc9beb246e69086b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1db9d9b700 1 -- 172.21.15.154:0/2113648805 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0011830 con 0x7f1dbc09e170 2023-09-30T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1db9d9b700 1 -- 172.21.15.154:0/2113648805 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db0011990 con 0x7f1dbc09e170 2023-09-30T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.738+0000 7f1db9d9b700 1 -- 172.21.15.154:0/2113648805 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0011d20 con 0x7f1dbc09e170 2023-09-30T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.739+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc09e170 msgr2=0x7f1dbc1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.739+0000 7f1dc10dd700 1 --2- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc09e170 0x7f1dbc1307a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009870 tx=0x7f1db0009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.739+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2113648805 shutdown_connections 2023-09-30T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.739+0000 7f1dc10dd700 1 --2- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc130ce0 0x7f1dbc131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.739+0000 7f1dc10dd700 1 --2- 172.21.15.154:0/2113648805 >> v2:172.21.15.154:3300/0 conn(0x7f1dbc09d860 0x7f1dbc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.739+0000 7f1dc10dd700 1 --2- 172.21.15.154:0/2113648805 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc09e170 0x7f1dbc1307a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.739+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2113648805 >> 172.21.15.154:0/2113648805 conn(0x7f1dbc099c40 msgr2=0x7f1dbc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.739+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2113648805 shutdown_connections 2023-09-30T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.739+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2113648805 wait complete. 2023-09-30T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.741+0000 7f1dc10dd700 1 Processor -- start 2023-09-30T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.741+0000 7f1dc10dd700 1 -- start start 2023-09-30T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dc10dd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc09d860 0x7f1dbc11cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dc10dd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dbc09e170 0x7f1dbc11d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dc10dd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc130ce0 0x7f1dbc11da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dc10dd700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc121440 con 0x7f1dbc09e170 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dc10dd700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc120a80 con 0x7f1dbc09d860 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dc10dd700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc0a2260 con 0x7f1dbc130ce0 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dba59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dbc09e170 0x7f1dbc11d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dba59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dbc09e170 0x7f1dbc11d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52930/0 (socket says 172.21.15.154:52930) 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dba59c700 1 -- 172.21.15.154:0/2142143753 learned_addr learned my addr 172.21.15.154:0/2142143753 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dbad9d700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc09d860 0x7f1dbc11cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.742+0000 7f1dbb59e700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc130ce0 0x7f1dbc11da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1dba59c700 1 -- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc130ce0 msgr2=0x7f1dbc11da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1dba59c700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc130ce0 0x7f1dbc11da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1dba59c700 1 -- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc09d860 msgr2=0x7f1dbc11cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1dba59c700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc09d860 0x7f1dbc11cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1dba59c700 1 -- 172.21.15.154:0/2142143753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac00b7f0 con 0x7f1dbc09e170 2023-09-30T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1dbad9d700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc09d860 0x7f1dbc11cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1dba59c700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dbc09e170 0x7f1dbc11d4f0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000c00 tx=0x7f1db0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1da37fe700 1 -- 172.21.15.154:0/2142143753 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0004590 con 0x7f1dbc09e170 2023-09-30T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1da37fe700 1 -- 172.21.15.154:0/2142143753 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db0023070 con 0x7f1dbc09e170 2023-09-30T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1da37fe700 1 -- 172.21.15.154:0/2142143753 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db001fa60 con 0x7f1dbc09e170 2023-09-30T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2142143753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db00094a0 con 0x7f1dbc09e170 2023-09-30T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.743+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2142143753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dbc11fe20 con 0x7f1dbc09e170 2023-09-30T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.745+0000 7f1da37fe700 1 -- 172.21.15.154:0/2142143753 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1db001fbc0 con 0x7f1dbc09e170 2023-09-30T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.745+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2142143753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dbc04f2a0 con 0x7f1dbc09e170 2023-09-30T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.745+0000 7f1da37fe700 1 -- 172.21.15.154:0/2142143753 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1db0025070 con 0x7f1dbc09e170 2023-09-30T22:28:33.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.754+0000 7f1da37fe700 1 -- 172.21.15.154:0/2142143753 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1db0033b90 con 0x7f1dbc09e170 2023-09-30T22:28:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.797+0000 7ff57b61f700 1 Processor -- start 2023-09-30T22:28:33.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.798+0000 7ff57b61f700 1 -- start start 2023-09-30T22:28:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.798+0000 7ff57b61f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 0x7ff5740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.798+0000 7ff57b61f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5740a1340 0x7ff57412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.798+0000 7ff57b61f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5740a1e70 con 0x7ff5741304a0 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.798+0000 7ff57b61f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57409a720 con 0x7ff5740a1340 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.798+0000 7ff57b61f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57409b300 con 0x7ff5740a0a30 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff579bbc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff5741304a0 0x7ff5741371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56832/0 (socket says 172.21.15.154:56832) 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff5793bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 0x7ff5740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff579bbc700 1 -- 172.21.15.154:0/3958898561 learned_addr learned my addr 172.21.15.154:0/3958898561 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff578bba700 1 --2- 172.21.15.154:0/3958898561 >> v2:172.21.15.154:3300/0 conn(0x7ff5740a1340 0x7ff57412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff56bfff700 1 -- 172.21.15.154:0/3958898561 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021996959 0 0) 0x7ff5740a1e70 con 0x7ff5741304a0 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff56bfff700 1 -- 172.21.15.154:0/3958898561 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5600035b0 con 0x7ff5741304a0 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff578bba700 1 -- 172.21.15.154:0/3958898561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 msgr2=0x7ff5740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff578bba700 1 --2- 172.21.15.154:0/3958898561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 0x7ff5740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff578bba700 1 -- 172.21.15.154:0/3958898561 >> v1:172.21.15.154:6789/0 conn(0x7ff5741304a0 legacy=0x7ff5741371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff578bba700 1 -- 172.21.15.154:0/3958898561 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57409abc0 con 0x7ff5740a1340 2023-09-30T22:28:33.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff5793bb700 1 --2- 172.21.15.154:0/3958898561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 0x7ff5740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:33.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff578bba700 1 --2- 172.21.15.154:0/3958898561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 0x7ff57412ff60 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7ff564009870 tx=0x7ff564009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3289037a3863680c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff56bfff700 1 -- 172.21.15.154:0/3958898561 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564011830 con 0x7ff5740a1340 2023-09-30T22:28:33.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff56bfff700 1 -- 172.21.15.154:0/3958898561 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564011990 con 0x7ff5740a1340 2023-09-30T22:28:33.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.799+0000 7ff56bfff700 1 -- 172.21.15.154:0/3958898561 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564011d20 con 0x7ff5740a1340 2023-09-30T22:28:33.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.800+0000 7ff57b61f700 1 -- 172.21.15.154:0/3958898561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 msgr2=0x7ff57412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.800+0000 7ff57b61f700 1 --2- 172.21.15.154:0/3958898561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 0x7ff57412ff60 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7ff564009870 tx=0x7ff564009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:33.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.800+0000 7ff57b61f700 1 -- 172.21.15.154:0/3958898561 shutdown_connections 2023-09-30T22:28:33.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.800+0000 7ff57b61f700 1 --2- 172.21.15.154:0/3958898561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 0x7ff5740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.800+0000 7ff57b61f700 1 --2- 172.21.15.154:0/3958898561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 0x7ff57412ff60 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.800+0000 7ff57b61f700 1 -- 172.21.15.154:0/3958898561 >> 172.21.15.154:0/3958898561 conn(0x7ff5740a2980 msgr2=0x7ff5740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.800+0000 7ff57b61f700 1 -- 172.21.15.154:0/3958898561 shutdown_connections 2023-09-30T22:28:33.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.800+0000 7ff57b61f700 1 -- 172.21.15.154:0/3958898561 wait complete. 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.801+0000 7ff57b61f700 1 Processor -- start 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff57b61f700 1 -- start start 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff57b61f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 0x7ff57411b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff57b61f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 0x7ff57411bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff57b61f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5741304a0 0x7ff5741c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff57b61f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57409f9f0 con 0x7ff5740a1340 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff57b61f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57411c310 con 0x7ff5740a0a30 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff57b61f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff57409ae00 con 0x7ff5741304a0 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff578bba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 0x7ff57411bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff578bba700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 0x7ff57411bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52942/0 (socket says 172.21.15.154:52942) 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff578bba700 1 -- 172.21.15.154:0/356063931 learned_addr learned my addr 172.21.15.154:0/356063931 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:33.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff579bbc700 1 --2- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5741304a0 0x7ff5741c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.802+0000 7ff5793bb700 1 --2- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 0x7ff57411b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff578bba700 1 -- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5741304a0 msgr2=0x7ff5741c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff578bba700 1 --2- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5741304a0 0x7ff5741c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff578bba700 1 -- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 msgr2=0x7ff57411b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff578bba700 1 --2- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 0x7ff57411b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff578bba700 1 -- 172.21.15.154:0/356063931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff570009430 con 0x7ff5740a1340 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff578bba700 1 --2- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 0x7ff57411bdd0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7ff5640090b0 tx=0x7ff564004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff569ffb700 1 -- 172.21.15.154:0/356063931 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564004590 con 0x7ff5740a1340 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff569ffb700 1 -- 172.21.15.154:0/356063931 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56401f070 con 0x7ff5740a1340 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff57b61f700 1 -- 172.21.15.154:0/356063931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5640094a0 con 0x7ff5740a1340 2023-09-30T22:28:33.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff569ffb700 1 -- 172.21.15.154:0/356063931 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640038a0 con 0x7ff5740a1340 2023-09-30T22:28:33.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.803+0000 7ff57b61f700 1 -- 172.21.15.154:0/356063931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff574122820 con 0x7ff5740a1340 2023-09-30T22:28:33.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.804+0000 7ff569ffb700 1 -- 172.21.15.154:0/356063931 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff564003a00 con 0x7ff5740a1340 2023-09-30T22:28:33.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.804+0000 7ff55f7fe700 1 -- 172.21.15.154:0/356063931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c0052e0 con 0x7ff5740a1340 2023-09-30T22:28:33.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.805+0000 7ff569ffb700 1 -- 172.21.15.154:0/356063931 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff564021070 con 0x7ff5740a1340 2023-09-30T22:28:33.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.814+0000 7ff569ffb700 1 -- 172.21.15.154:0/356063931 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff56402b080 con 0x7ff5740a1340 2023-09-30T22:28:33.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.864+0000 7f6bc4b95700 1 -- 172.21.15.154:0/3767613034 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6bc004f2a0 con 0x7f6bc009f370 2023-09-30T22:28:33.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.864+0000 7f6baeffd700 1 -- 172.21.15.154:0/3767613034 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bb802b070 con 0x7f6bc009f370 2023-09-30T22:28:33.865 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:33.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.866+0000 7f6bc4b95700 1 -- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 msgr2=0x7f6bc011f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.866+0000 7f6bc4b95700 1 --2- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc011f550 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800b370 tx=0x7f6bb8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.866+0000 7f6bc4b95700 1 -- 172.21.15.154:0/3767613034 shutdown_connections 2023-09-30T22:28:33.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.866+0000 7f6bc4b95700 1 --2- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6bc009f370 0x7f6bc011f550 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.866+0000 7f6bc4b95700 1 --2- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bc009a150 0x7f6bc011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.866+0000 7f6bc4b95700 1 --2- 172.21.15.154:0/3767613034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bc009ef80 0x7f6bc011f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.866+0000 7f6bc4b95700 1 -- 172.21.15.154:0/3767613034 >> 172.21.15.154:0/3767613034 conn(0x7f6bc00a4430 msgr2=0x7f6bc009d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.866+0000 7f6bc4b95700 1 -- 172.21.15.154:0/3767613034 shutdown_connections 2023-09-30T22:28:33.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.866+0000 7f6bc4b95700 1 -- 172.21.15.154:0/3767613034 wait complete. 2023-09-30T22:28:33.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:33.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.935+0000 7f80483e3700 1 -- 172.21.15.154:0/404451306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8028005590 con 0x7f804006b080 2023-09-30T22:28:33.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.936+0000 7f8036ffd700 1 -- 172.21.15.154:0/404451306 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f803001b3b0 con 0x7f804006b080 2023-09-30T22:28:33.937 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:33.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.938+0000 7f80483e3700 1 -- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f804006b080 msgr2=0x7f804009b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.938+0000 7f80483e3700 1 --2- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f804006b080 0x7f804009b430 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f803000e9b0 tx=0x7f803000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.938+0000 7f80483e3700 1 -- 172.21.15.154:0/404451306 shutdown_connections 2023-09-30T22:28:33.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.938+0000 7f80483e3700 1 --2- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8040131cf0 0x7f80401c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.938+0000 7f80483e3700 1 --2- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f804006a770 0x7f804009aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.938+0000 7f80483e3700 1 --2- 172.21.15.154:0/404451306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f804006b080 0x7f804009b430 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.938+0000 7f80483e3700 1 -- 172.21.15.154:0/404451306 >> 172.21.15.154:0/404451306 conn(0x7f8040099c40 msgr2=0x7f80401b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.938+0000 7f80483e3700 1 -- 172.21.15.154:0/404451306 shutdown_connections 2023-09-30T22:28:33.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.938+0000 7f80483e3700 1 -- 172.21.15.154:0/404451306 wait complete. 2023-09-30T22:28:33.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:33.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.974+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2142143753 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1dbc11fdc0 con 0x7f1dbc09e170 2023-09-30T22:28:33.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.974+0000 7f1da37fe700 1 -- 172.21.15.154:0/2142143753 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1db002f070 con 0x7f1dbc09e170 2023-09-30T22:28:33.976 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:33.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.976+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dbc09e170 msgr2=0x7f1dbc11d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.976+0000 7f1dc10dd700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dbc09e170 0x7f1dbc11d4f0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000c00 tx=0x7f1db0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.976+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2142143753 shutdown_connections 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.976+0000 7f1dc10dd700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1dbc130ce0 0x7f1dbc11da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.976+0000 7f1dc10dd700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1dbc09d860 0x7f1dbc11cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.976+0000 7f1dc10dd700 1 --2- 172.21.15.154:0/2142143753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dbc09e170 0x7f1dbc11d4f0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.976+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2142143753 >> 172.21.15.154:0/2142143753 conn(0x7f1dbc099c40 msgr2=0x7f1dbc130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.976+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2142143753 shutdown_connections 2023-09-30T22:28:33.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:33.976+0000 7f1dc10dd700 1 -- 172.21.15.154:0/2142143753 wait complete. 2023-09-30T22:28:33.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:34.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.009+0000 7ff55f7fe700 1 -- 172.21.15.154:0/356063931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff54c005590 con 0x7ff5740a1340 2023-09-30T22:28:34.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.009+0000 7ff569ffb700 1 -- 172.21.15.154:0/356063931 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff564015020 con 0x7ff5740a1340 2023-09-30T22:28:34.010 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.011+0000 7ff55f7fe700 1 -- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 msgr2=0x7ff57411bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:34.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.011+0000 7ff55f7fe700 1 --2- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 0x7ff57411bdd0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7ff5640090b0 tx=0x7ff564004750 comp rx=0 tx=0).stop 2023-09-30T22:28:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.011+0000 7ff55f7fe700 1 -- 172.21.15.154:0/356063931 shutdown_connections 2023-09-30T22:28:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.011+0000 7ff55f7fe700 1 --2- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff5741304a0 0x7ff5741c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.011+0000 7ff55f7fe700 1 --2- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5740a0a30 0x7ff57411b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.011+0000 7ff55f7fe700 1 --2- 172.21.15.154:0/356063931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5740a1340 0x7ff57411bdd0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.011+0000 7ff55f7fe700 1 -- 172.21.15.154:0/356063931 >> 172.21.15.154:0/356063931 conn(0x7ff5740a2980 msgr2=0x7ff57406eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.012+0000 7ff55f7fe700 1 -- 172.21.15.154:0/356063931 shutdown_connections 2023-09-30T22:28:34.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:34.012+0000 7ff55f7fe700 1 -- 172.21.15.154:0/356063931 wait complete. 2023-09-30T22:28:34.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:34.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:34.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:34.990 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.019+0000 7fc5a2116700 1 Processor -- start 2023-09-30T22:28:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.019+0000 7fc5a2116700 1 -- start start 2023-09-30T22:28:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc5a2116700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c1319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc5a2116700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c131f30 0x7fc59c09c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc5a2116700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c0a0f20 con 0x7fc59c1314b0 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc5a2116700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0667e0 con 0x7fc59c131f30 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc5a2116700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0a23c0 con 0x7fc59c066410 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c1319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59affd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc59c1314b0 0x7fc59c09bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56846/0 (socket says 172.21.15.154:56846) 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59affd700 1 -- 172.21.15.154:0/3476749060 learned_addr learned my addr 172.21.15.154:0/3476749060 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59bfff700 1 --2- 172.21.15.154:0/3476749060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c131f30 0x7fc59c09c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59a7fc700 1 -- 172.21.15.154:0/3476749060 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665766290 0 0) 0x7fc59c0a0f20 con 0x7fc59c1314b0 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59a7fc700 1 -- 172.21.15.154:0/3476749060 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5840035b0 con 0x7fc59c1314b0 2023-09-30T22:28:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59b7fe700 1 -- 172.21.15.154:0/3476749060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c131f30 msgr2=0x7fc59c09c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59b7fe700 1 --2- 172.21.15.154:0/3476749060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c131f30 0x7fc59c09c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59b7fe700 1 -- 172.21.15.154:0/3476749060 >> v1:172.21.15.154:6789/0 conn(0x7fc59c1314b0 legacy=0x7fc59c09bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59b7fe700 1 -- 172.21.15.154:0/3476749060 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c1323b0 con 0x7fc59c066410 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59bfff700 1 --2- 172.21.15.154:0/3476749060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c131f30 0x7fc59c09c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.020+0000 7fc59b7fe700 1 --2- 172.21.15.154:0/3476749060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c1319f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009880 tx=0x7fc58c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=409f7f04cc1b4daf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc59a7fc700 1 -- 172.21.15.154:0/3476749060 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c005e30 con 0x7fc59c066410 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc59a7fc700 1 -- 172.21.15.154:0/3476749060 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c006030 con 0x7fc59c066410 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc59a7fc700 1 -- 172.21.15.154:0/3476749060 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0063c0 con 0x7fc59c066410 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc5a2116700 1 -- 172.21.15.154:0/3476749060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 msgr2=0x7fc59c1319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc5a2116700 1 --2- 172.21.15.154:0/3476749060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c1319f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009880 tx=0x7fc58c009b90 comp rx=0 tx=0).stop 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc5a2116700 1 -- 172.21.15.154:0/3476749060 shutdown_connections 2023-09-30T22:28:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc5a2116700 1 --2- 172.21.15.154:0/3476749060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c131f30 0x7fc59c09c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc5a2116700 1 --2- 172.21.15.154:0/3476749060 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c1319f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc5a2116700 1 -- 172.21.15.154:0/3476749060 >> 172.21.15.154:0/3476749060 conn(0x7fc59c0a2980 msgr2=0x7fc59c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc5a2116700 1 -- 172.21.15.154:0/3476749060 shutdown_connections 2023-09-30T22:28:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.021+0000 7fc5a2116700 1 -- 172.21.15.154:0/3476749060 wait complete. 2023-09-30T22:28:35.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.022+0000 7fc5a2116700 1 Processor -- start 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc5a2116700 1 -- start start 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc5a2116700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c12d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc5a2116700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c1314b0 0x7fc59c12df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc5a2116700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c131f30 0x7fc59c1366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc5a2116700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c099e50 con 0x7fc59c131f30 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc5a2116700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c09b220 con 0x7fc59c1314b0 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc5a2116700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c09ba30 con 0x7fc59c066410 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc59affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c1314b0 0x7fc59c12df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc59affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c1314b0 0x7fc59c12df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45476/0 (socket says 172.21.15.154:45476) 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc59affd700 1 -- 172.21.15.154:0/2970703583 learned_addr learned my addr 172.21.15.154:0/2970703583 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.023+0000 7fc59b7fe700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c12d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc59bfff700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c131f30 0x7fc59c1366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc59affd700 1 -- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 msgr2=0x7fc59c12d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc59affd700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c12d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc59affd700 1 -- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c131f30 msgr2=0x7fc59c1366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc59affd700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c131f30 0x7fc59c1366d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc59affd700 1 -- 172.21.15.154:0/2970703583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594009a70 con 0x7fc59c1314b0 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc59b7fe700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c12d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc59affd700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c1314b0 0x7fc59c12df20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c700 tx=0x7fc59000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc583fff700 1 -- 172.21.15.154:0/2970703583 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590005d70 con 0x7fc59c1314b0 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc583fff700 1 -- 172.21.15.154:0/2970703583 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5900070d0 con 0x7fc59c1314b0 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc5a2116700 1 -- 172.21.15.154:0/2970703583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c009430 con 0x7fc59c1314b0 2023-09-30T22:28:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc583fff700 1 -- 172.21.15.154:0/2970703583 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590007460 con 0x7fc59c1314b0 2023-09-30T22:28:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.024+0000 7fc5a2116700 1 -- 172.21.15.154:0/2970703583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c0a1d50 con 0x7fc59c1314b0 2023-09-30T22:28:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.025+0000 7fc583fff700 1 -- 172.21.15.154:0/2970703583 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5900075c0 con 0x7fc59c1314b0 2023-09-30T22:28:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.025+0000 7fc583fff700 1 -- 172.21.15.154:0/2970703583 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc59003ead0 con 0x7fc59c1314b0 2023-09-30T22:28:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.025+0000 7fc5a2116700 1 -- 172.21.15.154:0/2970703583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c09b080 con 0x7fc59c1314b0 2023-09-30T22:28:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.030+0000 7fc583fff700 1 -- 172.21.15.154:0/2970703583 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc59c09b080 con 0x7fc59c1314b0 2023-09-30T22:28:35.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.089+0000 7f1a8145c700 1 Processor -- start 2023-09-30T22:28:35.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.089+0000 7f1a8145c700 1 -- start start 2023-09-30T22:28:35.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.089+0000 7f1a8145c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c09ad40 0x7f1a7c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a8145c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c133f70 0x7f1a7c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a8145c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7c09b110 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a8145c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0a3b60 con 0x7f1a7c09ad40 2023-09-30T22:28:35.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a8145c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c1348e0 con 0x7f1a7c133f70 2023-09-30T22:28:35.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c133f70 0x7f1a7c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c133f70 0x7f1a7c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54634/0 (socket says 172.21.15.154:54634) 2023-09-30T22:28:35.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7a7fc700 1 -- 172.21.15.154:0/3286880754 learned_addr learned my addr 172.21.15.154:0/3286880754 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:35.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7affd700 1 --2- 172.21.15.154:0/3286880754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c09ad40 0x7f1a7c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7a7fc700 1 -- 172.21.15.154:0/3286880754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c09ad40 msgr2=0x7f1a7c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7a7fc700 1 --2- 172.21.15.154:0/3286880754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c09ad40 0x7f1a7c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7a7fc700 1 -- 172.21.15.154:0/3286880754 >> v1:172.21.15.154:6789/0 conn(0x7f1a7c0a0a70 legacy=0x7f1a7c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7a7fc700 1 -- 172.21.15.154:0/3286880754 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c0a2fa0 con 0x7f1a7c133f70 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7affd700 1 --2- 172.21.15.154:0/3286880754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c09ad40 0x7f1a7c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.090+0000 7f1a7a7fc700 1 --2- 172.21.15.154:0/3286880754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c133f70 0x7f1a7c1343a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009920 tx=0x7f1a70009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95fa00aec8a024f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a79ffb700 1 -- 172.21.15.154:0/3286880754 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011830 con 0x7f1a7c133f70 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a79ffb700 1 -- 172.21.15.154:0/3286880754 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70011990 con 0x7f1a7c133f70 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a79ffb700 1 -- 172.21.15.154:0/3286880754 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011d20 con 0x7f1a7c133f70 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a8145c700 1 -- 172.21.15.154:0/3286880754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c133f70 msgr2=0x7f1a7c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a8145c700 1 --2- 172.21.15.154:0/3286880754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c133f70 0x7f1a7c1343a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009920 tx=0x7f1a70009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a8145c700 1 -- 172.21.15.154:0/3286880754 shutdown_connections 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a8145c700 1 --2- 172.21.15.154:0/3286880754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c09ad40 0x7f1a7c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a8145c700 1 --2- 172.21.15.154:0/3286880754 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c133f70 0x7f1a7c1343a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a8145c700 1 -- 172.21.15.154:0/3286880754 >> 172.21.15.154:0/3286880754 conn(0x7f1a7c099c40 msgr2=0x7f1a7c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.091+0000 7f1a8145c700 1 -- 172.21.15.154:0/3286880754 shutdown_connections 2023-09-30T22:28:35.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.092+0000 7f1a8145c700 1 -- 172.21.15.154:0/3286880754 wait complete. 2023-09-30T22:28:35.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.093+0000 7f1a8145c700 1 Processor -- start 2023-09-30T22:28:35.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.093+0000 7f1a8145c700 1 -- start start 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a8145c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c09ad40 0x7f1a7c11e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a8145c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7c0a0a70 0x7f1a7c11e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a8145c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c133f70 0x7f1a7c11ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a8145c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c121db0 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a8145c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c1225f0 con 0x7f1a7c133f70 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a8145c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c11fd20 con 0x7f1a7c09ad40 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c09ad40 0x7f1a7c11e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7affd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c09ad40 0x7f1a7c11e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:54642/0 (socket says 172.21.15.154:54642) 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7affd700 1 -- 172.21.15.154:0/3980546687 learned_addr learned my addr 172.21.15.154:0/3980546687 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7b7fe700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c133f70 0x7f1a7c11ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7a7fc700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7c0a0a70 0x7f1a7c11e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7a7fc700 1 -- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c09ad40 msgr2=0x7f1a7c11e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7a7fc700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c09ad40 0x7f1a7c11e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7a7fc700 1 -- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c133f70 msgr2=0x7f1a7c11ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7a7fc700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c133f70 0x7f1a7c11ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7a7fc700 1 -- 172.21.15.154:0/3980546687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c0094a0 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.094+0000 7f1a7b7fe700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c133f70 0x7f1a7c11ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.095+0000 7f1a7a7fc700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7c0a0a70 0x7f1a7c11e6a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0a1ce0 tx=0x7f1a70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.095+0000 7f1a637fe700 1 -- 172.21.15.154:0/3980546687 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70004450 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.095+0000 7f1a637fe700 1 -- 172.21.15.154:0/3980546687 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a700045d0 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.095+0000 7f1a8145c700 1 -- 172.21.15.154:0/3980546687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a70009550 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.095+0000 7f1a637fe700 1 -- 172.21.15.154:0/3980546687 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700038e0 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.095+0000 7f1a8145c700 1 -- 172.21.15.154:0/3980546687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7c09c7e0 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.096+0000 7f1a637fe700 1 -- 172.21.15.154:0/3980546687 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a70003a40 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.096+0000 7f1a8145c700 1 -- 172.21.15.154:0/3980546687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7c0a58b0 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.096+0000 7f1a637fe700 1 -- 172.21.15.154:0/3980546687 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a70040700 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.105+0000 7f1a637fe700 1 -- 172.21.15.154:0/3980546687 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a70024800 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.131+0000 7fc19b221700 1 Processor -- start 2023-09-30T22:28:35.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.131+0000 7fc19b221700 1 -- start start 2023-09-30T22:28:35.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.131+0000 7fc19b221700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc19409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.131+0000 7fc19b221700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1941343a0 0x7fc19413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.131+0000 7fc19b221700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19406bec0 con 0x7fc19409f180 2023-09-30T22:28:35.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.131+0000 7fc19b221700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19406ce60 con 0x7fc1941343a0 2023-09-30T22:28:35.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.131+0000 7fc19b221700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc19409fa00 con 0x7fc19409e870 2023-09-30T22:28:35.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1997be700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1941343a0 0x7fc19413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc198fbd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc19409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1997be700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1941343a0 0x7fc19413bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52960/0 (socket says 172.21.15.154:52960) 2023-09-30T22:28:35.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1997be700 1 -- 172.21.15.154:0/3483651628 learned_addr learned my addr 172.21.15.154:0/3483651628 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1997be700 1 -- 172.21.15.154:0/3483651628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 msgr2=0x7fc19409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1997be700 1 --2- 172.21.15.154:0/3483651628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc19409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1997be700 1 -- 172.21.15.154:0/3483651628 >> v1:172.21.15.154:6789/0 conn(0x7fc19409f180 legacy=0x7fc194133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1997be700 1 -- 172.21.15.154:0/3483651628 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19409ad80 con 0x7fc1941343a0 2023-09-30T22:28:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc198fbd700 1 --2- 172.21.15.154:0/3483651628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc19409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1997be700 1 --2- 172.21.15.154:0/3483651628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1941343a0 0x7fc19413bf60 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009e50 tx=0x7fc18c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1125a2b3b72335a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1937fe700 1 -- 172.21.15.154:0/3483651628 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c00e070 con 0x7fc1941343a0 2023-09-30T22:28:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1937fe700 1 -- 172.21.15.154:0/3483651628 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c00b910 con 0x7fc1941343a0 2023-09-30T22:28:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.132+0000 7fc1937fe700 1 -- 172.21.15.154:0/3483651628 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c00bcc0 con 0x7fc1941343a0 2023-09-30T22:28:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.133+0000 7fc19b221700 1 -- 172.21.15.154:0/3483651628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1941343a0 msgr2=0x7fc19413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.133+0000 7fc19b221700 1 --2- 172.21.15.154:0/3483651628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1941343a0 0x7fc19413bf60 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009e50 tx=0x7fc18c00b330 comp rx=0 tx=0).stop 2023-09-30T22:28:35.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.133+0000 7fc19b221700 1 -- 172.21.15.154:0/3483651628 shutdown_connections 2023-09-30T22:28:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.133+0000 7fc19b221700 1 --2- 172.21.15.154:0/3483651628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1941343a0 0x7fc19413bf60 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.133+0000 7fc19b221700 1 --2- 172.21.15.154:0/3483651628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc19409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.133+0000 7fc19b221700 1 -- 172.21.15.154:0/3483651628 >> 172.21.15.154:0/3483651628 conn(0x7fc1940a4430 msgr2=0x7fc1940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.133+0000 7fc19b221700 1 -- 172.21.15.154:0/3483651628 shutdown_connections 2023-09-30T22:28:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.133+0000 7fc19b221700 1 -- 172.21.15.154:0/3483651628 wait complete. 2023-09-30T22:28:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.134+0000 7fc19b221700 1 Processor -- start 2023-09-30T22:28:35.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.134+0000 7fc19b221700 1 -- start start 2023-09-30T22:28:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc19b221700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc194122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc19b221700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19409f180 0x7fc194123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc19b221700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1941343a0 0x7fc1941235c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc19b221700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc194124620 con 0x7fc19409f180 2023-09-30T22:28:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc19b221700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19406fc10 con 0x7fc1941343a0 2023-09-30T22:28:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc19b221700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc194126330 con 0x7fc19409e870 2023-09-30T22:28:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc193fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19409f180 0x7fc194123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc193fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19409f180 0x7fc194123080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52970/0 (socket says 172.21.15.154:52970) 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc193fff700 1 -- 172.21.15.154:0/979493510 learned_addr learned my addr 172.21.15.154:0/979493510 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.135+0000 7fc198fbd700 1 --2- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc194122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc193fff700 1 -- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 msgr2=0x7fc194122b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc193fff700 1 --2- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc194122b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc193fff700 1 -- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1941343a0 msgr2=0x7fc1941235c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc193fff700 1 --2- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1941343a0 0x7fc1941235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc193fff700 1 -- 172.21.15.154:0/979493510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1880094a0 con 0x7fc19409f180 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc198fbd700 1 --2- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc194122b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc193fff700 1 --2- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19409f180 0x7fc194123080 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c4b0 tx=0x7fc18000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc1917fa700 1 -- 172.21.15.154:0/979493510 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1800052d0 con 0x7fc19409f180 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc1917fa700 1 -- 172.21.15.154:0/979493510 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc180005430 con 0x7fc19409f180 2023-09-30T22:28:35.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc19b221700 1 -- 172.21.15.154:0/979493510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c009b30 con 0x7fc19409f180 2023-09-30T22:28:35.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc1917fa700 1 -- 172.21.15.154:0/979493510 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1800038c0 con 0x7fc19409f180 2023-09-30T22:28:35.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.136+0000 7fc19b221700 1 -- 172.21.15.154:0/979493510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc194126d30 con 0x7fc19409f180 2023-09-30T22:28:35.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.137+0000 7fc19b221700 1 -- 172.21.15.154:0/979493510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19404f2a0 con 0x7fc19409f180 2023-09-30T22:28:35.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.138+0000 7fc1917fa700 1 -- 172.21.15.154:0/979493510 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc180003a20 con 0x7fc19409f180 2023-09-30T22:28:35.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.138+0000 7fc1917fa700 1 -- 172.21.15.154:0/979493510 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc18003ef50 con 0x7fc19409f180 2023-09-30T22:28:35.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.142+0000 7fc1917fa700 1 -- 172.21.15.154:0/979493510 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc180003cd0 con 0x7fc19409f180 2023-09-30T22:28:35.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.169+0000 7ff0608a1700 1 Processor -- start 2023-09-30T22:28:35.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff0608a1700 1 -- start start 2023-09-30T22:28:35.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff0608a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c0a0a70 0x7ff05c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff0608a1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff05c0a1380 0x7ff05c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff0608a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff05c133f50 0x7ff05c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff0608a1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c09e9d0 con 0x7ff05c0a1380 2023-09-30T22:28:35.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff0608a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c09dc00 con 0x7ff05c0a0a70 2023-09-30T22:28:35.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff0608a1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c09dec0 con 0x7ff05c133f50 2023-09-30T22:28:35.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff059d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff05c0a1380 0x7ff05c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff059d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff05c0a1380 0x7ff05c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52974/0 (socket says 172.21.15.154:52974) 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff059d9b700 1 -- 172.21.15.154:0/4066227986 learned_addr learned my addr 172.21.15.154:0/4066227986 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.170+0000 7ff05ad9d700 1 --2- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff05c133f50 0x7ff05c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff05a59c700 1 --2- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c0a0a70 0x7ff05c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff059d9b700 1 -- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff05c133f50 msgr2=0x7ff05c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff059d9b700 1 --2- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff05c133f50 0x7ff05c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff059d9b700 1 -- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c0a0a70 msgr2=0x7ff05c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff059d9b700 1 --2- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c0a0a70 0x7ff05c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff059d9b700 1 -- 172.21.15.154:0/4066227986 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c09e6a0 con 0x7ff05c0a1380 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff059d9b700 1 --2- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 0x7ff05c133a10 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7ff0500098f0 tx=0x7ff050009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6801968e6082239f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff05959a700 1 -- 172.21.15.154:0/4066227986 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050011830 con 0x7ff05c0a1380 2023-09-30T22:28:35.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff05959a700 1 -- 172.21.15.154:0/4066227986 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050011990 con 0x7ff05c0a1380 2023-09-30T22:28:35.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.171+0000 7ff05959a700 1 -- 172.21.15.154:0/4066227986 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050011d20 con 0x7ff05c0a1380 2023-09-30T22:28:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.172+0000 7ff0608a1700 1 -- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 msgr2=0x7ff05c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.172+0000 7ff0608a1700 1 --2- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 0x7ff05c133a10 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7ff0500098f0 tx=0x7ff050009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.172+0000 7ff0608a1700 1 -- 172.21.15.154:0/4066227986 shutdown_connections 2023-09-30T22:28:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.172+0000 7ff0608a1700 1 --2- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c0a0a70 0x7ff05c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.172+0000 7ff0608a1700 1 --2- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff05c133f50 0x7ff05c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.172+0000 7ff0608a1700 1 --2- 172.21.15.154:0/4066227986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 0x7ff05c133a10 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.172+0000 7ff0608a1700 1 -- 172.21.15.154:0/4066227986 >> 172.21.15.154:0/4066227986 conn(0x7ff05c0a6610 msgr2=0x7ff05c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.172+0000 7ff0608a1700 1 -- 172.21.15.154:0/4066227986 shutdown_connections 2023-09-30T22:28:35.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.172+0000 7ff0608a1700 1 -- 172.21.15.154:0/4066227986 wait complete. 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.173+0000 7ff0608a1700 1 Processor -- start 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.173+0000 7ff0608a1700 1 -- start start 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff0608a1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff05c0a0a70 0x7ff05c122450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff0608a1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 0x7ff05c122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff0608a1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c133f50 0x7ff05c122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff0608a1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1241e0 con 0x7ff05c0a1380 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff0608a1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c124ef0 con 0x7ff05c133f50 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff0608a1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0a03e0 con 0x7ff05c0a0a70 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff05ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c133f50 0x7ff05c122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff05ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c133f50 0x7ff05c122ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:45532/0 (socket says 172.21.15.154:45532) 2023-09-30T22:28:35.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff059d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 0x7ff05c122990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff05ad9d700 1 -- 172.21.15.154:0/457790030 learned_addr learned my addr 172.21.15.154:0/457790030 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff059d9b700 1 -- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff05c0a0a70 msgr2=0x7ff05c122450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff059d9b700 1 --2- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff05c0a0a70 0x7ff05c122450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff059d9b700 1 -- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c133f50 msgr2=0x7ff05c122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff059d9b700 1 --2- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c133f50 0x7ff05c122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff059d9b700 1 -- 172.21.15.154:0/457790030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050009550 con 0x7ff05c0a1380 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff05ad9d700 1 --2- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c133f50 0x7ff05c122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff059d9b700 1 --2- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 0x7ff05c122990 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0672b0 tx=0x7ff050004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff04affd700 1 -- 172.21.15.154:0/457790030 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050004240 con 0x7ff05c0a1380 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff04affd700 1 -- 172.21.15.154:0/457790030 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05001f070 con 0x7ff05c0a1380 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.174+0000 7ff04affd700 1 -- 172.21.15.154:0/457790030 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500036a0 con 0x7ff05c0a1380 2023-09-30T22:28:35.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.175+0000 7ff0608a1700 1 -- 172.21.15.154:0/457790030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c125f70 con 0x7ff05c0a1380 2023-09-30T22:28:35.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.175+0000 7ff0608a1700 1 -- 172.21.15.154:0/457790030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c125c90 con 0x7ff05c0a1380 2023-09-30T22:28:35.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.176+0000 7ff04affd700 1 -- 172.21.15.154:0/457790030 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff050021030 con 0x7ff05c0a1380 2023-09-30T22:28:35.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.176+0000 7ff04affd700 1 -- 172.21.15.154:0/457790030 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff050040940 con 0x7ff05c0a1380 2023-09-30T22:28:35.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.176+0000 7ff0608a1700 1 -- 172.21.15.154:0/457790030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c04f2a0 con 0x7ff05c0a1380 2023-09-30T22:28:35.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.181+0000 7ff04affd700 1 -- 172.21.15.154:0/457790030 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff050015080 con 0x7ff05c0a1380 2023-09-30T22:28:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.270+0000 7fc5a2116700 1 -- 172.21.15.154:0/2970703583 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc59c09b080 con 0x7fc59c1314b0 2023-09-30T22:28:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.270+0000 7fc583fff700 1 -- 172.21.15.154:0/2970703583 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc59c09b080 con 0x7fc59c1314b0 2023-09-30T22:28:35.271 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.273+0000 7fc5a2116700 1 -- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c1314b0 msgr2=0x7fc59c12df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.273+0000 7fc5a2116700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c1314b0 0x7fc59c12df20 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c700 tx=0x7fc59000ca10 comp rx=0 tx=0).stop 2023-09-30T22:28:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.273+0000 7fc5a2116700 1 -- 172.21.15.154:0/2970703583 shutdown_connections 2023-09-30T22:28:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.273+0000 7fc5a2116700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc59c131f30 0x7fc59c1366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.273+0000 7fc5a2116700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc59c066410 0x7fc59c12d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.273+0000 7fc5a2116700 1 --2- 172.21.15.154:0/2970703583 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59c1314b0 0x7fc59c12df20 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.273+0000 7fc5a2116700 1 -- 172.21.15.154:0/2970703583 >> 172.21.15.154:0/2970703583 conn(0x7fc59c0a2980 msgr2=0x7fc59c130240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.273+0000 7fc5a2116700 1 -- 172.21.15.154:0/2970703583 shutdown_connections 2023-09-30T22:28:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.273+0000 7fc5a2116700 1 -- 172.21.15.154:0/2970703583 wait complete. 2023-09-30T22:28:35.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.312+0000 7f1a8145c700 1 -- 172.21.15.154:0/3980546687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1a7c04f2a0 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.313+0000 7f1a637fe700 1 -- 172.21.15.154:0/3980546687 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a70015030 con 0x7f1a7c0a0a70 2023-09-30T22:28:35.314 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.315+0000 7f1a8145c700 1 -- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7c0a0a70 msgr2=0x7f1a7c11e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.315+0000 7f1a8145c700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7c0a0a70 0x7f1a7c11e6a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0a1ce0 tx=0x7f1a70004750 comp rx=0 tx=0).stop 2023-09-30T22:28:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.315+0000 7f1a8145c700 1 -- 172.21.15.154:0/3980546687 shutdown_connections 2023-09-30T22:28:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.315+0000 7f1a8145c700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7c133f70 0x7f1a7c11ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.315+0000 7f1a8145c700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a7c09ad40 0x7f1a7c11e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.315+0000 7f1a8145c700 1 --2- 172.21.15.154:0/3980546687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7c0a0a70 0x7f1a7c11e6a0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.315+0000 7f1a8145c700 1 -- 172.21.15.154:0/3980546687 >> 172.21.15.154:0/3980546687 conn(0x7f1a7c099c40 msgr2=0x7f1a7c133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.315+0000 7f1a8145c700 1 -- 172.21.15.154:0/3980546687 shutdown_connections 2023-09-30T22:28:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.315+0000 7f1a8145c700 1 -- 172.21.15.154:0/3980546687 wait complete. 2023-09-30T22:28:35.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:35.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.350+0000 7fc19b221700 1 -- 172.21.15.154:0/979493510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc194072d60 con 0x7fc19409f180 2023-09-30T22:28:35.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.350+0000 7fc1917fa700 1 -- 172.21.15.154:0/979493510 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc180017030 con 0x7fc19409f180 2023-09-30T22:28:35.351 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:35.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.352+0000 7fc19b221700 1 -- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19409f180 msgr2=0x7fc194123080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.352+0000 7fc19b221700 1 --2- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19409f180 0x7fc194123080 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c4b0 tx=0x7fc18000c7c0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.352+0000 7fc19b221700 1 -- 172.21.15.154:0/979493510 shutdown_connections 2023-09-30T22:28:35.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.352+0000 7fc19b221700 1 --2- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1941343a0 0x7fc1941235c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.352+0000 7fc19b221700 1 --2- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc19409e870 0x7fc194122b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.352+0000 7fc19b221700 1 --2- 172.21.15.154:0/979493510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19409f180 0x7fc194123080 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.352+0000 7fc19b221700 1 -- 172.21.15.154:0/979493510 >> 172.21.15.154:0/979493510 conn(0x7fc1940a4430 msgr2=0x7fc194071020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.352+0000 7fc19b221700 1 -- 172.21.15.154:0/979493510 shutdown_connections 2023-09-30T22:28:35.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.352+0000 7fc19b221700 1 -- 172.21.15.154:0/979493510 wait complete. 2023-09-30T22:28:35.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:35.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.400+0000 7ff0608a1700 1 -- 172.21.15.154:0/457790030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff05c072980 con 0x7ff05c0a1380 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.401+0000 7ff04affd700 1 -- 172.21.15.154:0/457790030 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0500199a0 con 0x7ff05c0a1380 2023-09-30T22:28:35.402 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:35.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.403+0000 7ff0608a1700 1 -- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 msgr2=0x7ff05c122990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:35.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.403+0000 7ff0608a1700 1 --2- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 0x7ff05c122990 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0672b0 tx=0x7ff050004750 comp rx=0 tx=0).stop 2023-09-30T22:28:35.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.403+0000 7ff0608a1700 1 -- 172.21.15.154:0/457790030 shutdown_connections 2023-09-30T22:28:35.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.403+0000 7ff0608a1700 1 --2- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff05c133f50 0x7ff05c122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.403+0000 7ff0608a1700 1 --2- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff05c0a0a70 0x7ff05c122450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.403+0000 7ff0608a1700 1 --2- 172.21.15.154:0/457790030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff05c0a1380 0x7ff05c122990 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:35.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.403+0000 7ff0608a1700 1 -- 172.21.15.154:0/457790030 >> 172.21.15.154:0/457790030 conn(0x7ff05c0a6610 msgr2=0x7ff05c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:35.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.403+0000 7ff0608a1700 1 -- 172.21.15.154:0/457790030 shutdown_connections 2023-09-30T22:28:35.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:35.403+0000 7ff0608a1700 1 -- 172.21.15.154:0/457790030 wait complete. 2023-09-30T22:28:35.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:36.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:36.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:36.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:36.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:36.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.425+0000 7f8fe9bfc700 1 Processor -- start 2023-09-30T22:28:36.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.425+0000 7f8fe9bfc700 1 -- start start 2023-09-30T22:28:36.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.426+0000 7f8fe9bfc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe4133a70 0x7f8fe4133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.426+0000 7f8fe9bfc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8fe40a1460 0x7f8fe413b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.426+0000 7f8fe9bfc700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe4133640 con 0x7f8fe40a08e0 2023-09-30T22:28:36.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.426+0000 7f8fe9bfc700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe40a1d50 con 0x7f8fe40a1460 2023-09-30T22:28:36.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.426+0000 7f8fe9bfc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe409b620 con 0x7f8fe4133a70 2023-09-30T22:28:36.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.426+0000 7f8fe2ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8fe40a08e0 0x7f8fe40a0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43058/0 (socket says 172.21.15.154:43058) 2023-09-30T22:28:36.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.426+0000 7f8fe2ffd700 1 -- 172.21.15.154:0/1005188680 learned_addr learned my addr 172.21.15.154:0/1005188680 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:36.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.426+0000 7f8fe3fff700 1 --2- 172.21.15.154:0/1005188680 >> v2:172.21.15.154:3300/0 conn(0x7f8fe40a1460 0x7f8fe413b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.426+0000 7f8fe37fe700 1 --2- 172.21.15.154:0/1005188680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe4133a70 0x7f8fe4133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.427+0000 7f8fe37fe700 1 -- 172.21.15.154:0/1005188680 >> v2:172.21.15.154:3300/0 conn(0x7f8fe40a1460 msgr2=0x7f8fe413b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:36.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.427+0000 7f8fe37fe700 1 --2- 172.21.15.154:0/1005188680 >> v2:172.21.15.154:3300/0 conn(0x7f8fe40a1460 0x7f8fe413b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.427+0000 7f8fe37fe700 1 -- 172.21.15.154:0/1005188680 >> v1:172.21.15.154:6789/0 conn(0x7f8fe40a08e0 legacy=0x7f8fe40a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.427+0000 7f8fe37fe700 1 -- 172.21.15.154:0/1005188680 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe4133870 con 0x7f8fe4133a70 2023-09-30T22:28:36.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.427+0000 7f8fe3fff700 1 --2- 172.21.15.154:0/1005188680 >> v2:172.21.15.154:3300/0 conn(0x7f8fe40a1460 0x7f8fe413b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:36.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.427+0000 7f8fe37fe700 1 --2- 172.21.15.154:0/1005188680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe4133a70 0x7f8fe4133e40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009820 tx=0x7f8fd4009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=607b364af069063 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.427+0000 7f8fe27fc700 1 -- 172.21.15.154:0/1005188680 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4005e30 con 0x7f8fe4133a70 2023-09-30T22:28:36.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.427+0000 7f8fe27fc700 1 -- 172.21.15.154:0/1005188680 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4006030 con 0x7f8fe4133a70 2023-09-30T22:28:36.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.427+0000 7f8fe27fc700 1 -- 172.21.15.154:0/1005188680 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40063c0 con 0x7f8fe4133a70 2023-09-30T22:28:36.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.428+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1005188680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe4133a70 msgr2=0x7f8fe4133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.428+0000 7f8fe9bfc700 1 --2- 172.21.15.154:0/1005188680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe4133a70 0x7f8fe4133e40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009820 tx=0x7f8fd4009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:36.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.428+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1005188680 shutdown_connections 2023-09-30T22:28:36.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.428+0000 7f8fe9bfc700 1 --2- 172.21.15.154:0/1005188680 >> v2:172.21.15.154:3300/0 conn(0x7f8fe40a1460 0x7f8fe413b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.428+0000 7f8fe9bfc700 1 --2- 172.21.15.154:0/1005188680 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe4133a70 0x7f8fe4133e40 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.428+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1005188680 >> 172.21.15.154:0/1005188680 conn(0x7f8fe40a2980 msgr2=0x7f8fe40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.428+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1005188680 shutdown_connections 2023-09-30T22:28:36.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.428+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1005188680 wait complete. 2023-09-30T22:28:36.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.430+0000 7f8fe9bfc700 1 Processor -- start 2023-09-30T22:28:36.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.430+0000 7f8fe9bfc700 1 -- start start 2023-09-30T22:28:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe9bfc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fe40a08e0 0x7f8fe4118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe9bfc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe40a1460 0x7f8fe4119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe9bfc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fe4133a70 0x7f8fe4119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe9bfc700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe411c2c0 con 0x7f8fe40a08e0 2023-09-30T22:28:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe9bfc700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe411b720 con 0x7f8fe4133a70 2023-09-30T22:28:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe9bfc700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe411ac80 con 0x7f8fe40a1460 2023-09-30T22:28:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe40a1460 0x7f8fe4119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe2ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe40a1460 0x7f8fe4119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39562/0 (socket says 172.21.15.154:39562) 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe2ffd700 1 -- 172.21.15.154:0/1947745142 learned_addr learned my addr 172.21.15.154:0/1947745142 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe37fe700 1 --2- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fe40a08e0 0x7f8fe4118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe37fe700 1 -- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe40a1460 msgr2=0x7f8fe4119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe37fe700 1 --2- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe40a1460 0x7f8fe4119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe37fe700 1 -- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fe4133a70 msgr2=0x7f8fe4119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe37fe700 1 --2- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fe4133a70 0x7f8fe4119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe37fe700 1 -- 172.21.15.154:0/1947745142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc009a70 con 0x7f8fe40a08e0 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe2ffd700 1 --2- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe40a1460 0x7f8fe4119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.431+0000 7f8fe37fe700 1 --2- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fe40a08e0 0x7f8fe4118df0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4015000 tx=0x7f8fd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.432+0000 7f8fcbfff700 1 -- 172.21.15.154:0/1947745142 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4004240 con 0x7f8fe40a08e0 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.432+0000 7f8fcbfff700 1 -- 172.21.15.154:0/1947745142 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd40043a0 con 0x7f8fe40a08e0 2023-09-30T22:28:36.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.432+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1947745142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd4009430 con 0x7f8fe40a08e0 2023-09-30T22:28:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.432+0000 7f8fcbfff700 1 -- 172.21.15.154:0/1947745142 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40036a0 con 0x7f8fe40a08e0 2023-09-30T22:28:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.432+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1947745142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe4131f30 con 0x7f8fe40a08e0 2023-09-30T22:28:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.433+0000 7f8fcbfff700 1 -- 172.21.15.154:0/1947745142 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fd4022070 con 0x7f8fe40a08e0 2023-09-30T22:28:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.433+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1947745142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe409a350 con 0x7f8fe40a08e0 2023-09-30T22:28:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.433+0000 7f8fcbfff700 1 -- 172.21.15.154:0/1947745142 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8fd4040ea0 con 0x7f8fe40a08e0 2023-09-30T22:28:36.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.438+0000 7f8fcbfff700 1 -- 172.21.15.154:0/1947745142 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fd402f9e0 con 0x7f8fe40a08e0 2023-09-30T22:28:36.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.471+0000 7fe781640700 1 Processor -- start 2023-09-30T22:28:36.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.471+0000 7fe781640700 1 -- start start 2023-09-30T22:28:36.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.471+0000 7fe781640700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe77c0a1510 0x7fe77c1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.471+0000 7fe781640700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c1356e0 0x7fe77c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.471+0000 7fe781640700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c0a1e70 con 0x7fe77c0a0a30 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.471+0000 7fe781640700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c09a720 con 0x7fe77c0a1510 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.471+0000 7fe781640700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c09b300 con 0x7fe77c1356e0 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe77b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c1356e0 0x7fe77c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe77b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c1356e0 0x7fe77c137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39572/0 (socket says 172.21.15.154:39572) 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe77b7fe700 1 -- 172.21.15.154:0/2010673880 learned_addr learned my addr 172.21.15.154:0/2010673880 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe77b7fe700 1 -- 172.21.15.154:0/2010673880 >> v2:172.21.15.154:3300/0 conn(0x7fe77c0a1510 msgr2=0x7fe77c1351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe77b7fe700 1 --2- 172.21.15.154:0/2010673880 >> v2:172.21.15.154:3300/0 conn(0x7fe77c0a1510 0x7fe77c1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe77b7fe700 1 -- 172.21.15.154:0/2010673880 >> v1:172.21.15.154:6789/0 conn(0x7fe77c0a0a30 legacy=0x7fe77c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe77b7fe700 1 -- 172.21.15.154:0/2010673880 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c09abc0 con 0x7fe77c1356e0 2023-09-30T22:28:36.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe77b7fe700 1 --2- 172.21.15.154:0/2010673880 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c1356e0 0x7fe77c137ac0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe774009e50 tx=0x7fe77400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c59c31d40f3310 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe779ffb700 1 -- 172.21.15.154:0/2010673880 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400e070 con 0x7fe77c1356e0 2023-09-30T22:28:36.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe779ffb700 1 -- 172.21.15.154:0/2010673880 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774003a20 con 0x7fe77c1356e0 2023-09-30T22:28:36.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.472+0000 7fe779ffb700 1 -- 172.21.15.154:0/2010673880 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774003dd0 con 0x7fe77c1356e0 2023-09-30T22:28:36.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.473+0000 7fe781640700 1 -- 172.21.15.154:0/2010673880 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c1356e0 msgr2=0x7fe77c137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.473+0000 7fe781640700 1 --2- 172.21.15.154:0/2010673880 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c1356e0 0x7fe77c137ac0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe774009e50 tx=0x7fe77400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:36.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.473+0000 7fe781640700 1 -- 172.21.15.154:0/2010673880 shutdown_connections 2023-09-30T22:28:36.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.473+0000 7fe781640700 1 --2- 172.21.15.154:0/2010673880 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c1356e0 0x7fe77c137ac0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.473+0000 7fe781640700 1 --2- 172.21.15.154:0/2010673880 >> v2:172.21.15.154:3300/0 conn(0x7fe77c0a1510 0x7fe77c1351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.473+0000 7fe781640700 1 -- 172.21.15.154:0/2010673880 >> 172.21.15.154:0/2010673880 conn(0x7fe77c0a2980 msgr2=0x7fe77c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.473+0000 7fe781640700 1 -- 172.21.15.154:0/2010673880 shutdown_connections 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.473+0000 7fe781640700 1 -- 172.21.15.154:0/2010673880 wait complete. 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.474+0000 7fe781640700 1 Processor -- start 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.474+0000 7fe781640700 1 -- start start 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe781640700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe77c0a0a30 0x7fe77c11edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe781640700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c0a1510 0x7fe77c11f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe781640700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe77c1356e0 0x7fe77c11f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe781640700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c1202a0 con 0x7fe77c1356e0 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe781640700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c126ae0 con 0x7fe77c0a0a30 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe781640700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c1208f0 con 0x7fe77c0a1510 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c0a1510 0x7fe77c11f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe77c0a0a30 0x7fe77c11edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c0a1510 0x7fe77c11f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39586/0 (socket says 172.21.15.154:39586) 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77a7fc700 1 -- 172.21.15.154:0/121837652 learned_addr learned my addr 172.21.15.154:0/121837652 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77b7fe700 1 --2- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe77c1356e0 0x7fe77c11f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77affd700 1 -- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c0a1510 msgr2=0x7fe77c11f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77affd700 1 --2- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c0a1510 0x7fe77c11f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77affd700 1 -- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe77c1356e0 msgr2=0x7fe77c11f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77affd700 1 --2- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe77c1356e0 0x7fe77c11f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.475+0000 7fe77affd700 1 -- 172.21.15.154:0/121837652 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774009b30 con 0x7fe77c0a0a30 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.476+0000 7fe77a7fc700 1 --2- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c0a1510 0x7fe77c11f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.476+0000 7fe77affd700 1 --2- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe77c0a0a30 0x7fe77c11edd0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c410 tx=0x7fe76c00c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.476+0000 7fe7637fe700 1 -- 172.21.15.154:0/121837652 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0054e0 con 0x7fe77c0a0a30 2023-09-30T22:28:36.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.476+0000 7fe7637fe700 1 -- 172.21.15.154:0/121837652 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c00ce90 con 0x7fe77c0a0a30 2023-09-30T22:28:36.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.476+0000 7fe7637fe700 1 -- 172.21.15.154:0/121837652 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0038c0 con 0x7fe77c0a0a30 2023-09-30T22:28:36.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.476+0000 7fe781640700 1 -- 172.21.15.154:0/121837652 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c134cf0 con 0x7fe77c0a0a30 2023-09-30T22:28:36.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.476+0000 7fe781640700 1 -- 172.21.15.154:0/121837652 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c070fe0 con 0x7fe77c0a0a30 2023-09-30T22:28:36.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.477+0000 7fe7637fe700 1 -- 172.21.15.154:0/121837652 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe76c003a20 con 0x7fe77c0a0a30 2023-09-30T22:28:36.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.477+0000 7fe781640700 1 -- 172.21.15.154:0/121837652 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c126c20 con 0x7fe77c0a0a30 2023-09-30T22:28:36.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.477+0000 7fe7637fe700 1 -- 172.21.15.154:0/121837652 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe76c03ea90 con 0x7fe77c0a0a30 2023-09-30T22:28:36.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.482+0000 7fe7637fe700 1 -- 172.21.15.154:0/121837652 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe76c017070 con 0x7fe77c0a0a30 2023-09-30T22:28:36.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.519+0000 7fba242ce700 1 Processor -- start 2023-09-30T22:28:36.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.519+0000 7fba242ce700 1 -- start start 2023-09-30T22:28:36.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba242ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c09e870 0x7fba1c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba242ce700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba1c131f40 0x7fba1c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba242ce700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c09c970 con 0x7fba1c09f180 2023-09-30T22:28:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba242ce700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c0a0920 con 0x7fba1c131f40 2023-09-30T22:28:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba242ce700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c09f9c0 con 0x7fba1c09e870 2023-09-30T22:28:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba2286b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba1c131f40 0x7fba1c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba2286b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba1c131f40 0x7fba1c139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45986/0 (socket says 172.21.15.154:45986) 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba21869700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fba1c09f180 0x7fba1c131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43082/0 (socket says 172.21.15.154:43082) 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba2286b700 1 -- 172.21.15.154:0/2730820939 learned_addr learned my addr 172.21.15.154:0/2730820939 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba2206a700 1 --2- 172.21.15.154:0/2730820939 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c09e870 0x7fba1c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba2206a700 1 -- 172.21.15.154:0/2730820939 >> v2:172.21.15.154:3300/0 conn(0x7fba1c131f40 msgr2=0x7fba1c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba2206a700 1 --2- 172.21.15.154:0/2730820939 >> v2:172.21.15.154:3300/0 conn(0x7fba1c131f40 0x7fba1c139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.520+0000 7fba2206a700 1 -- 172.21.15.154:0/2730820939 >> v1:172.21.15.154:6789/0 conn(0x7fba1c09f180 legacy=0x7fba1c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.521+0000 7fba21068700 1 -- 172.21.15.154:0/2730820939 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499854609 0 0) 0x7fba1c09c970 con 0x7fba1c09f180 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.521+0000 7fba2206a700 1 -- 172.21.15.154:0/2730820939 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c09bab0 con 0x7fba1c09e870 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.521+0000 7fba2206a700 1 --2- 172.21.15.154:0/2730820939 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c09e870 0x7fba1c09ec40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fba18009840 tx=0x7fba18009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb073e02a4dc187 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.521+0000 7fba21068700 1 -- 172.21.15.154:0/2730820939 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18011830 con 0x7fba1c09e870 2023-09-30T22:28:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.521+0000 7fba21068700 1 -- 172.21.15.154:0/2730820939 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba18011990 con 0x7fba1c09e870 2023-09-30T22:28:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.521+0000 7fba21068700 1 -- 172.21.15.154:0/2730820939 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18011d20 con 0x7fba1c09e870 2023-09-30T22:28:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.522+0000 7fba242ce700 1 -- 172.21.15.154:0/2730820939 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c09e870 msgr2=0x7fba1c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.522+0000 7fba242ce700 1 --2- 172.21.15.154:0/2730820939 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c09e870 0x7fba1c09ec40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fba18009840 tx=0x7fba18009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.522+0000 7fba242ce700 1 -- 172.21.15.154:0/2730820939 shutdown_connections 2023-09-30T22:28:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.522+0000 7fba242ce700 1 --2- 172.21.15.154:0/2730820939 >> v2:172.21.15.154:3300/0 conn(0x7fba1c131f40 0x7fba1c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.522+0000 7fba242ce700 1 --2- 172.21.15.154:0/2730820939 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c09e870 0x7fba1c09ec40 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.522+0000 7fba242ce700 1 -- 172.21.15.154:0/2730820939 >> 172.21.15.154:0/2730820939 conn(0x7fba1c0a4430 msgr2=0x7fba1c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.522+0000 7fba242ce700 1 -- 172.21.15.154:0/2730820939 shutdown_connections 2023-09-30T22:28:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.522+0000 7fba242ce700 1 -- 172.21.15.154:0/2730820939 wait complete. 2023-09-30T22:28:36.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.523+0000 7fba242ce700 1 Processor -- start 2023-09-30T22:28:36.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.523+0000 7fba242ce700 1 -- start start 2023-09-30T22:28:36.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba242ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c09e870 0x7fba1c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba242ce700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c09f180 0x7fba1c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba242ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c131f40 0x7fba1c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba242ce700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c124ec0 con 0x7fba1c09f180 2023-09-30T22:28:36.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba242ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c123940 con 0x7fba1c09e870 2023-09-30T22:28:36.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba242ce700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c124880 con 0x7fba1c131f40 2023-09-30T22:28:36.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba2206a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c09e870 0x7fba1c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba2286b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c131f40 0x7fba1c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba2286b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c131f40 0x7fba1c06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39614/0 (socket says 172.21.15.154:39614) 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba2286b700 1 -- 172.21.15.154:0/1914618407 learned_addr learned my addr 172.21.15.154:0/1914618407 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba2206a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c09e870 0x7fba1c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53704/0 (socket says 172.21.15.154:53704) 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba21869700 1 --2- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c09f180 0x7fba1c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba2206a700 1 -- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c131f40 msgr2=0x7fba1c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.524+0000 7fba2206a700 1 --2- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c131f40 0x7fba1c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.525+0000 7fba2206a700 1 -- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c09f180 msgr2=0x7fba1c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.525+0000 7fba2206a700 1 --2- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c09f180 0x7fba1c06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.525+0000 7fba2206a700 1 -- 172.21.15.154:0/1914618407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180094a0 con 0x7fba1c09e870 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.525+0000 7fba2206a700 1 --2- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c09e870 0x7fba1c06b880 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fba18016000 tx=0x7fba18004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.525+0000 7fba12ffd700 1 -- 172.21.15.154:0/1914618407 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180036a0 con 0x7fba1c09e870 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.525+0000 7fba12ffd700 1 -- 172.21.15.154:0/1914618407 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1801e070 con 0x7fba1c09e870 2023-09-30T22:28:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.525+0000 7fba242ce700 1 -- 172.21.15.154:0/1914618407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c0a2de0 con 0x7fba1c09e870 2023-09-30T22:28:36.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.525+0000 7fba12ffd700 1 -- 172.21.15.154:0/1914618407 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18003a40 con 0x7fba1c09e870 2023-09-30T22:28:36.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.525+0000 7fba242ce700 1 -- 172.21.15.154:0/1914618407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c125320 con 0x7fba1c09e870 2023-09-30T22:28:36.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.526+0000 7fba12ffd700 1 -- 172.21.15.154:0/1914618407 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba18003ba0 con 0x7fba1c09e870 2023-09-30T22:28:36.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.526+0000 7fba12ffd700 1 -- 172.21.15.154:0/1914618407 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba180405a0 con 0x7fba1c09e870 2023-09-30T22:28:36.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.526+0000 7fba242ce700 1 -- 172.21.15.154:0/1914618407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c1240f0 con 0x7fba1c09e870 2023-09-30T22:28:36.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.531+0000 7fba12ffd700 1 -- 172.21.15.154:0/1914618407 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba18015080 con 0x7fba1c09e870 2023-09-30T22:28:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.562+0000 7fd02f7d2700 1 Processor -- start 2023-09-30T22:28:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.562+0000 7fd02f7d2700 1 -- start start 2023-09-30T22:28:36.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02f7d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809e870 0x7fd02809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02f7d2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd028134330 0x7fd02813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02f7d2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02809fa00 con 0x7fd02809f180 2023-09-30T22:28:36.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02f7d2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0280a0370 con 0x7fd028134330 2023-09-30T22:28:36.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02f7d2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02806bec0 con 0x7fd02809e870 2023-09-30T22:28:36.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02dd6f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd028134330 0x7fd02813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02dd6f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd028134330 0x7fd02813be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46010/0 (socket says 172.21.15.154:46010) 2023-09-30T22:28:36.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02cd6d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd02809f180 0x7fd028133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43092/0 (socket says 172.21.15.154:43092) 2023-09-30T22:28:36.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02dd6f700 1 -- 172.21.15.154:0/2907840135 learned_addr learned my addr 172.21.15.154:0/2907840135 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:36.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02d56e700 1 --2- 172.21.15.154:0/2907840135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809e870 0x7fd02809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02d56e700 1 -- 172.21.15.154:0/2907840135 >> v2:172.21.15.154:3300/0 conn(0x7fd028134330 msgr2=0x7fd02813be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:36.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.563+0000 7fd02d56e700 1 --2- 172.21.15.154:0/2907840135 >> v2:172.21.15.154:3300/0 conn(0x7fd028134330 0x7fd02813be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.564+0000 7fd02d56e700 1 -- 172.21.15.154:0/2907840135 >> v1:172.21.15.154:6789/0 conn(0x7fd02809f180 legacy=0x7fd028133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.564+0000 7fd02d56e700 1 -- 172.21.15.154:0/2907840135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02809ada0 con 0x7fd02809e870 2023-09-30T22:28:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.564+0000 7fd02d56e700 1 --2- 172.21.15.154:0/2907840135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809e870 0x7fd02809ec40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd024009840 tx=0x7fd024009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=285bf261b79ca161 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.564+0000 7fd01ffff700 1 -- 172.21.15.154:0/2907840135 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd024011830 con 0x7fd02809e870 2023-09-30T22:28:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.564+0000 7fd01ffff700 1 -- 172.21.15.154:0/2907840135 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd024011990 con 0x7fd02809e870 2023-09-30T22:28:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.564+0000 7fd01ffff700 1 -- 172.21.15.154:0/2907840135 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd024011d20 con 0x7fd02809e870 2023-09-30T22:28:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.565+0000 7fd02f7d2700 1 -- 172.21.15.154:0/2907840135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809e870 msgr2=0x7fd02809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.565+0000 7fd02f7d2700 1 --2- 172.21.15.154:0/2907840135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809e870 0x7fd02809ec40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd024009840 tx=0x7fd024009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.565+0000 7fd02f7d2700 1 -- 172.21.15.154:0/2907840135 shutdown_connections 2023-09-30T22:28:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.565+0000 7fd02f7d2700 1 --2- 172.21.15.154:0/2907840135 >> v2:172.21.15.154:3300/0 conn(0x7fd028134330 0x7fd02813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.565+0000 7fd02f7d2700 1 --2- 172.21.15.154:0/2907840135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809e870 0x7fd02809ec40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.565+0000 7fd02f7d2700 1 -- 172.21.15.154:0/2907840135 >> 172.21.15.154:0/2907840135 conn(0x7fd0280a4430 msgr2=0x7fd0280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.565+0000 7fd02f7d2700 1 -- 172.21.15.154:0/2907840135 shutdown_connections 2023-09-30T22:28:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.565+0000 7fd02f7d2700 1 -- 172.21.15.154:0/2907840135 wait complete. 2023-09-30T22:28:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.566+0000 7fd02f7d2700 1 Processor -- start 2023-09-30T22:28:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.566+0000 7fd02f7d2700 1 -- start start 2023-09-30T22:28:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02f7d2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02809e870 0x7fd028122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02f7d2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809f180 0x7fd028122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02f7d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028134330 0x7fd0281233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02f7d2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd028123e00 con 0x7fd02809e870 2023-09-30T22:28:36.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02f7d2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd028133880 con 0x7fd02809f180 2023-09-30T22:28:36.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02f7d2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0281334c0 con 0x7fd028134330 2023-09-30T22:28:36.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02cd6d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809f180 0x7fd028122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02cd6d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809f180 0x7fd028122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53732/0 (socket says 172.21.15.154:53732) 2023-09-30T22:28:36.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02cd6d700 1 -- 172.21.15.154:0/3263851750 learned_addr learned my addr 172.21.15.154:0/3263851750 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:36.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02dd6f700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028134330 0x7fd0281233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02d56e700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02809e870 0x7fd028122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:36.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02dd6f700 1 -- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809f180 msgr2=0x7fd028122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02dd6f700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809f180 0x7fd028122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02dd6f700 1 -- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02809e870 msgr2=0x7fd028122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02dd6f700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02809e870 0x7fd028122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02dd6f700 1 -- 172.21.15.154:0/3263851750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240094a0 con 0x7fd028134330 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02cd6d700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809f180 0x7fd028122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.567+0000 7fd02dd6f700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028134330 0x7fd0281233b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd02000efc0 tx=0x7fd02000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.568+0000 7fd02d56e700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02809e870 0x7fd028122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.568+0000 7fd01dffb700 1 -- 172.21.15.154:0/3263851750 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020003c20 con 0x7fd028134330 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.568+0000 7fd01dffb700 1 -- 172.21.15.154:0/3263851750 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02000f040 con 0x7fd028134330 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.568+0000 7fd02f7d2700 1 -- 172.21.15.154:0/3263851750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02806d000 con 0x7fd028134330 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.568+0000 7fd01dffb700 1 -- 172.21.15.154:0/3263851750 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020009e60 con 0x7fd028134330 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.568+0000 7fd02f7d2700 1 -- 172.21.15.154:0/3263851750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd028126be0 con 0x7fd028134330 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.569+0000 7fd02f7d2700 1 -- 172.21.15.154:0/3263851750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd028125e10 con 0x7fd028134330 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.570+0000 7fd01dffb700 1 -- 172.21.15.154:0/3263851750 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd02000c930 con 0x7fd028134330 2023-09-30T22:28:36.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.571+0000 7fd01dffb700 1 -- 172.21.15.154:0/3263851750 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0200407c0 con 0x7fd028134330 2023-09-30T22:28:36.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.579+0000 7fd01dffb700 1 -- 172.21.15.154:0/3263851750 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd02000cbe0 con 0x7fd028134330 2023-09-30T22:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.667+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1947745142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8fe404f2a0 con 0x7f8fe40a08e0 2023-09-30T22:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.668+0000 7f8fcbfff700 1 -- 172.21.15.154:0/1947745142 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fd402a030 con 0x7f8fe40a08e0 2023-09-30T22:28:36.669 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.671+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fe40a08e0 msgr2=0x7f8fe4118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.671+0000 7f8fe9bfc700 1 --2- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fe40a08e0 0x7f8fe4118df0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4015000 tx=0x7f8fd4004750 comp rx=0 tx=0).stop 2023-09-30T22:28:36.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.671+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1947745142 shutdown_connections 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.671+0000 7f8fe9bfc700 1 --2- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fe4133a70 0x7f8fe4119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.671+0000 7f8fe9bfc700 1 --2- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fe40a08e0 0x7f8fe4118df0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.671+0000 7f8fe9bfc700 1 --2- 172.21.15.154:0/1947745142 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8fe40a1460 0x7f8fe4119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.671+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1947745142 >> 172.21.15.154:0/1947745142 conn(0x7f8fe40a2980 msgr2=0x7f8fe41309d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.671+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1947745142 shutdown_connections 2023-09-30T22:28:36.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.671+0000 7f8fe9bfc700 1 -- 172.21.15.154:0/1947745142 wait complete. 2023-09-30T22:28:36.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:36.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.694+0000 7fe781640700 1 -- 172.21.15.154:0/121837652 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe77c04f2a0 con 0x7fe77c0a0a30 2023-09-30T22:28:36.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.694+0000 7fe7637fe700 1 -- 172.21.15.154:0/121837652 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe76c019b40 con 0x7fe77c0a0a30 2023-09-30T22:28:36.695 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:36.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.696+0000 7fe781640700 1 -- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe77c0a0a30 msgr2=0x7fe77c11edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.696+0000 7fe781640700 1 --2- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe77c0a0a30 0x7fe77c11edd0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c410 tx=0x7fe76c00c720 comp rx=0 tx=0).stop 2023-09-30T22:28:36.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.696+0000 7fe781640700 1 -- 172.21.15.154:0/121837652 shutdown_connections 2023-09-30T22:28:36.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.696+0000 7fe781640700 1 --2- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe77c1356e0 0x7fe77c11f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.696+0000 7fe781640700 1 --2- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe77c0a0a30 0x7fe77c11edd0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.696+0000 7fe781640700 1 --2- 172.21.15.154:0/121837652 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe77c0a1510 0x7fe77c11f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.696+0000 7fe781640700 1 -- 172.21.15.154:0/121837652 >> 172.21.15.154:0/121837652 conn(0x7fe77c0a2980 msgr2=0x7fe77c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.697+0000 7fe781640700 1 -- 172.21.15.154:0/121837652 shutdown_connections 2023-09-30T22:28:36.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.697+0000 7fe781640700 1 -- 172.21.15.154:0/121837652 wait complete. 2023-09-30T22:28:36.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:36.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.762+0000 7fba242ce700 1 -- 172.21.15.154:0/1914618407 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba1c04f2a0 con 0x7fba1c09e870 2023-09-30T22:28:36.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.763+0000 7fba12ffd700 1 -- 172.21.15.154:0/1914618407 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba1802d7d0 con 0x7fba1c09e870 2023-09-30T22:28:36.764 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.765+0000 7fba242ce700 1 -- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c09e870 msgr2=0x7fba1c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.765+0000 7fba242ce700 1 --2- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c09e870 0x7fba1c06b880 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fba18016000 tx=0x7fba18004750 comp rx=0 tx=0).stop 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.765+0000 7fba242ce700 1 -- 172.21.15.154:0/1914618407 shutdown_connections 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.765+0000 7fba242ce700 1 --2- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fba1c131f40 0x7fba1c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.765+0000 7fba242ce700 1 --2- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c09e870 0x7fba1c06b880 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.765+0000 7fba242ce700 1 --2- 172.21.15.154:0/1914618407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c09f180 0x7fba1c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.765+0000 7fba242ce700 1 -- 172.21.15.154:0/1914618407 >> 172.21.15.154:0/1914618407 conn(0x7fba1c0a4430 msgr2=0x7fba1c071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.765+0000 7fba242ce700 1 -- 172.21.15.154:0/1914618407 shutdown_connections 2023-09-30T22:28:36.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.765+0000 7fba242ce700 1 -- 172.21.15.154:0/1914618407 wait complete. 2023-09-30T22:28:36.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:36.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.799+0000 7fd02f7d2700 1 -- 172.21.15.154:0/3263851750 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd02806c9d0 con 0x7fd028134330 2023-09-30T22:28:36.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.800+0000 7fd01dffb700 1 -- 172.21.15.154:0/3263851750 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd020014e00 con 0x7fd028134330 2023-09-30T22:28:36.800 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:36.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.802+0000 7fd02f7d2700 1 -- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028134330 msgr2=0x7fd0281233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:36.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.802+0000 7fd02f7d2700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028134330 0x7fd0281233b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd02000efc0 tx=0x7fd02000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.802+0000 7fd02f7d2700 1 -- 172.21.15.154:0/3263851750 shutdown_connections 2023-09-30T22:28:36.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.802+0000 7fd02f7d2700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd028134330 0x7fd0281233b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.802+0000 7fd02f7d2700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02809e870 0x7fd028122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.802+0000 7fd02f7d2700 1 --2- 172.21.15.154:0/3263851750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02809f180 0x7fd028122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:36.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.802+0000 7fd02f7d2700 1 -- 172.21.15.154:0/3263851750 >> 172.21.15.154:0/3263851750 conn(0x7fd0280a4430 msgr2=0x7fd0280a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:36.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.802+0000 7fd02f7d2700 1 -- 172.21.15.154:0/3263851750 shutdown_connections 2023-09-30T22:28:36.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:36.802+0000 7fd02f7d2700 1 -- 172.21.15.154:0/3263851750 wait complete. 2023-09-30T22:28:36.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:37.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:37.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:37.779 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:37.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:37.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.830+0000 7f0e04288700 1 Processor -- start 2023-09-30T22:28:37.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.830+0000 7f0e04288700 1 -- start start 2023-09-30T22:28:37.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e04288700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0dfc133b80 0x7f0dfc133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e04288700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0ff0 0x7f0dfc13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e04288700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc09aa00 con 0x7f0dfc099a60 2023-09-30T22:28:37.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e04288700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc09a080 con 0x7f0dfc133b80 2023-09-30T22:28:37.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e04288700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc133750 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e02024700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0dfc133b80 0x7f0dfc133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e01823700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0dfc099a60 0x7f0dfc0a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43108/0 (socket says 172.21.15.154:43108) 2023-09-30T22:28:37.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e01823700 1 -- 172.21.15.154:0/237358395 learned_addr learned my addr 172.21.15.154:0/237358395 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:37.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e02825700 1 --2- 172.21.15.154:0/237358395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0ff0 0x7f0dfc13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e02825700 1 -- 172.21.15.154:0/237358395 >> v2:172.21.15.154:3300/0 conn(0x7f0dfc133b80 msgr2=0x7f0dfc133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:37.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e02825700 1 --2- 172.21.15.154:0/237358395 >> v2:172.21.15.154:3300/0 conn(0x7f0dfc133b80 0x7f0dfc133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e02825700 1 -- 172.21.15.154:0/237358395 >> v1:172.21.15.154:6789/0 conn(0x7f0dfc099a60 legacy=0x7f0dfc0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.831+0000 7f0e02825700 1 -- 172.21.15.154:0/237358395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc09a760 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.832+0000 7f0e02825700 1 --2- 172.21.15.154:0/237358395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0ff0 0x7f0dfc13b910 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009d90 tx=0x7f0df400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af4b3da42c4d7e67 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.832+0000 7f0e01022700 1 -- 172.21.15.154:0/237358395 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df400e070 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.832+0000 7f0e01022700 1 -- 172.21.15.154:0/237358395 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df400bb20 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.832+0000 7f0e01022700 1 -- 172.21.15.154:0/237358395 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4012430 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.833+0000 7f0e04288700 1 -- 172.21.15.154:0/237358395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0ff0 msgr2=0x7f0dfc13b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.833+0000 7f0e04288700 1 --2- 172.21.15.154:0/237358395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0ff0 0x7f0dfc13b910 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009d90 tx=0x7f0df400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:37.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.833+0000 7f0e04288700 1 -- 172.21.15.154:0/237358395 shutdown_connections 2023-09-30T22:28:37.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.833+0000 7f0e04288700 1 --2- 172.21.15.154:0/237358395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc0a0ff0 0x7f0dfc13b910 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.833+0000 7f0e04288700 1 --2- 172.21.15.154:0/237358395 >> v2:172.21.15.154:3300/0 conn(0x7f0dfc133b80 0x7f0dfc133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.833+0000 7f0e04288700 1 -- 172.21.15.154:0/237358395 >> 172.21.15.154:0/237358395 conn(0x7f0dfc0a2980 msgr2=0x7f0dfc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:37.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.833+0000 7f0e04288700 1 -- 172.21.15.154:0/237358395 shutdown_connections 2023-09-30T22:28:37.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.833+0000 7f0e04288700 1 -- 172.21.15.154:0/237358395 wait complete. 2023-09-30T22:28:37.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e04288700 1 Processor -- start 2023-09-30T22:28:37.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e04288700 1 -- start start 2023-09-30T22:28:37.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e04288700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc099a60 0x7f0dfc1197f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e04288700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc0a0ff0 0x7f0dfc119d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e04288700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc133b80 0x7f0dfc11a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e04288700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc09c2f0 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e04288700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc11caa0 con 0x7f0dfc133b80 2023-09-30T22:28:37.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e04288700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc09a2c0 con 0x7f0dfc099a60 2023-09-30T22:28:37.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e01823700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc0a0ff0 0x7f0dfc119d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e01823700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc0a0ff0 0x7f0dfc119d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46042/0 (socket says 172.21.15.154:46042) 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e01823700 1 -- 172.21.15.154:0/2090828181 learned_addr learned my addr 172.21.15.154:0/2090828181 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.834+0000 7f0e02024700 1 --2- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc099a60 0x7f0dfc1197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0e02825700 1 --2- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc133b80 0x7f0dfc11a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0e01823700 1 -- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc099a60 msgr2=0x7f0dfc1197f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0e01823700 1 --2- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc099a60 0x7f0dfc1197f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0e01823700 1 -- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc133b80 msgr2=0x7f0dfc11a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0e01823700 1 --2- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc133b80 0x7f0dfc11a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0e01823700 1 -- 172.21.15.154:0/2090828181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4009a70 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0e01823700 1 --2- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc0a0ff0 0x7f0dfc119d30 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c520 tx=0x7f0dec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0df2ffd700 1 -- 172.21.15.154:0/2090828181 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec005d70 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0df2ffd700 1 -- 172.21.15.154:0/2090828181 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec0070d0 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0e04288700 1 -- 172.21.15.154:0/2090828181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc11b400 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0df2ffd700 1 -- 172.21.15.154:0/2090828181 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec007440 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.835+0000 7f0e04288700 1 -- 172.21.15.154:0/2090828181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc11d810 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.836+0000 7f0df2ffd700 1 -- 172.21.15.154:0/2090828181 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0dec0075a0 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.836+0000 7f0df2ffd700 1 -- 172.21.15.154:0/2090828181 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0dec03eaf0 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.836+0000 7f0e04288700 1 -- 172.21.15.154:0/2090828181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc11ceb0 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.842+0000 7f0df2ffd700 1 -- 172.21.15.154:0/2090828181 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0dec019b40 con 0x7f0dfc0a0ff0 2023-09-30T22:28:37.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.882+0000 7f3f4f64a700 1 Processor -- start 2023-09-30T22:28:37.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.882+0000 7f3f4f64a700 1 -- start start 2023-09-30T22:28:37.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.883+0000 7f3f4f64a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f48133900 0x7f3f48133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.883+0000 7f3f4f64a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48134210 0x7f3f480a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.883+0000 7f3f4f64a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4809a760 con 0x7f3f480a0ee0 2023-09-30T22:28:37.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.883+0000 7f3f4f64a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f481336e0 con 0x7f3f48133900 2023-09-30T22:28:37.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.883+0000 7f3f4f64a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4809a080 con 0x7f3f48134210 2023-09-30T22:28:37.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.883+0000 7f3f4cbe5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48134210 0x7f3f480a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.883+0000 7f3f4dbe7700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3f480a0ee0 0x7f3f4813a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43120/0 (socket says 172.21.15.154:43120) 2023-09-30T22:28:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.883+0000 7f3f4cbe5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48134210 0x7f3f480a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39640/0 (socket says 172.21.15.154:39640) 2023-09-30T22:28:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.883+0000 7f3f4dbe7700 1 -- 172.21.15.154:0/3946688109 learned_addr learned my addr 172.21.15.154:0/3946688109 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f4d3e6700 1 --2- 172.21.15.154:0/3946688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f48133900 0x7f3f48133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f3ffff700 1 -- 172.21.15.154:0/3946688109 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981064568 0 0) 0x7f3f4809a760 con 0x7f3f480a0ee0 2023-09-30T22:28:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f3ffff700 1 -- 172.21.15.154:0/3946688109 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f340035b0 con 0x7f3f480a0ee0 2023-09-30T22:28:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f4cbe5700 1 -- 172.21.15.154:0/3946688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f48133900 msgr2=0x7f3f48133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f4cbe5700 1 --2- 172.21.15.154:0/3946688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f48133900 0x7f3f48133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f4cbe5700 1 -- 172.21.15.154:0/3946688109 >> v1:172.21.15.154:6789/0 conn(0x7f3f480a0ee0 legacy=0x7f3f4813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f4cbe5700 1 -- 172.21.15.154:0/3946688109 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480a23e0 con 0x7f3f48134210 2023-09-30T22:28:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f4d3e6700 1 --2- 172.21.15.154:0/3946688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f48133900 0x7f3f48133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f4cbe5700 1 --2- 172.21.15.154:0/3946688109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48134210 0x7f3f480a09a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009870 tx=0x7f3f38009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ad933e5886f762 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f3ffff700 1 -- 172.21.15.154:0/3946688109 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38011830 con 0x7f3f48134210 2023-09-30T22:28:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f3ffff700 1 -- 172.21.15.154:0/3946688109 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f38011990 con 0x7f3f48134210 2023-09-30T22:28:37.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.884+0000 7f3f3ffff700 1 -- 172.21.15.154:0/3946688109 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38011d20 con 0x7f3f48134210 2023-09-30T22:28:37.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.885+0000 7f3f4f64a700 1 -- 172.21.15.154:0/3946688109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48134210 msgr2=0x7f3f480a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.885+0000 7f3f4f64a700 1 --2- 172.21.15.154:0/3946688109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48134210 0x7f3f480a09a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009870 tx=0x7f3f38009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.885+0000 7f3f4f64a700 1 -- 172.21.15.154:0/3946688109 shutdown_connections 2023-09-30T22:28:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.885+0000 7f3f4f64a700 1 --2- 172.21.15.154:0/3946688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f48133900 0x7f3f48133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.885+0000 7f3f4f64a700 1 --2- 172.21.15.154:0/3946688109 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48134210 0x7f3f480a09a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.885+0000 7f3f4f64a700 1 -- 172.21.15.154:0/3946688109 >> 172.21.15.154:0/3946688109 conn(0x7f3f480a2980 msgr2=0x7f3f480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.885+0000 7f3f4f64a700 1 -- 172.21.15.154:0/3946688109 shutdown_connections 2023-09-30T22:28:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.885+0000 7f3f4f64a700 1 -- 172.21.15.154:0/3946688109 wait complete. 2023-09-30T22:28:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.886+0000 7f3f4f64a700 1 Processor -- start 2023-09-30T22:28:37.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.886+0000 7f3f4f64a700 1 -- start start 2023-09-30T22:28:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4f64a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f480a0ee0 0x7f3f4811d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4f64a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48133900 0x7f3f4811dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4f64a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f48134210 0x7f3f4811e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4f64a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4811f9c0 con 0x7f3f48134210 2023-09-30T22:28:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4f64a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48120680 con 0x7f3f480a0ee0 2023-09-30T22:28:37.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4f64a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48132bb0 con 0x7f3f48133900 2023-09-30T22:28:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4cbe5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48133900 0x7f3f4811dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4cbe5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48133900 0x7f3f4811dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39646/0 (socket says 172.21.15.154:39646) 2023-09-30T22:28:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4cbe5700 1 -- 172.21.15.154:0/246029187 learned_addr learned my addr 172.21.15.154:0/246029187 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4dbe7700 1 --2- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f48134210 0x7f3f4811e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4d3e6700 1 --2- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f480a0ee0 0x7f3f4811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4cbe5700 1 -- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f480a0ee0 msgr2=0x7f3f4811d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4cbe5700 1 --2- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f480a0ee0 0x7f3f4811d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4cbe5700 1 -- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f48134210 msgr2=0x7f3f4811e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4cbe5700 1 --2- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f48134210 0x7f3f4811e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.887+0000 7f3f4cbe5700 1 -- 172.21.15.154:0/246029187 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380094a0 con 0x7f3f48133900 2023-09-30T22:28:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.888+0000 7f3f4cbe5700 1 --2- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48133900 0x7f3f4811dcd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3f380090b0 tx=0x7f3f38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.888+0000 7f3f3dffb700 1 -- 172.21.15.154:0/246029187 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38004590 con 0x7f3f48133900 2023-09-30T22:28:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.888+0000 7f3f3dffb700 1 -- 172.21.15.154:0/246029187 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380036a0 con 0x7f3f48133900 2023-09-30T22:28:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.888+0000 7f3f4f64a700 1 -- 172.21.15.154:0/246029187 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f48120a40 con 0x7f3f48133900 2023-09-30T22:28:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.888+0000 7f3f3dffb700 1 -- 172.21.15.154:0/246029187 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38003a10 con 0x7f3f48133900 2023-09-30T22:28:37.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.888+0000 7f3f4f64a700 1 -- 172.21.15.154:0/246029187 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4811f3a0 con 0x7f3f48133900 2023-09-30T22:28:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.889+0000 7f3f4f64a700 1 -- 172.21.15.154:0/246029187 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f48120c70 con 0x7f3f48133900 2023-09-30T22:28:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.889+0000 7f3f3dffb700 1 -- 172.21.15.154:0/246029187 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f38003b70 con 0x7f3f48133900 2023-09-30T22:28:37.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.889+0000 7f3f3dffb700 1 -- 172.21.15.154:0/246029187 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f38040960 con 0x7f3f48133900 2023-09-30T22:28:37.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.898+0000 7f3f3dffb700 1 -- 172.21.15.154:0/246029187 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f48120c70 con 0x7f3f48133900 2023-09-30T22:28:37.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.920+0000 7f4db0a82700 1 Processor -- start 2023-09-30T22:28:37.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.920+0000 7f4db0a82700 1 -- start start 2023-09-30T22:28:37.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.921+0000 7f4db0a82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac09d860 0x7f4dac09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.921+0000 7f4db0a82700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4dac09e170 0x7f4dac1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.921+0000 7f4db0a82700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac09aaa0 con 0x7f4dac130ce0 2023-09-30T22:28:37.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.921+0000 7f4db0a82700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac09f870 con 0x7f4dac09e170 2023-09-30T22:28:37.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.921+0000 7f4db0a82700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac09b360 con 0x7f4dac09d860 2023-09-30T22:28:37.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.921+0000 7f4da9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4dac09e170 0x7f4dac1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.921+0000 7f4da9d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4dac09e170 0x7f4dac1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46056/0 (socket says 172.21.15.154:46056) 2023-09-30T22:28:37.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.921+0000 7f4da9d9b700 1 -- 172.21.15.154:0/3565946282 learned_addr learned my addr 172.21.15.154:0/3565946282 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:37.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.921+0000 7f4daa59c700 1 --2- 172.21.15.154:0/3565946282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac09d860 0x7f4dac09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4daa59c700 1 -- 172.21.15.154:0/3565946282 >> v2:172.21.15.154:3300/0 conn(0x7f4dac09e170 msgr2=0x7f4dac1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:37.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4daa59c700 1 --2- 172.21.15.154:0/3565946282 >> v2:172.21.15.154:3300/0 conn(0x7f4dac09e170 0x7f4dac1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4daa59c700 1 -- 172.21.15.154:0/3565946282 >> v1:172.21.15.154:6789/0 conn(0x7f4dac130ce0 legacy=0x7f4dac1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4daa59c700 1 -- 172.21.15.154:0/3565946282 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac09b620 con 0x7f4dac09d860 2023-09-30T22:28:37.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4da959a700 1 -- 172.21.15.154:0/3565946282 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325871207 0 0) 0x7f4dac09aaa0 con 0x7f4dac130ce0 2023-09-30T22:28:37.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4da9d9b700 1 --2- 172.21.15.154:0/3565946282 >> v2:172.21.15.154:3300/0 conn(0x7f4dac09e170 0x7f4dac1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:37.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4daa59c700 1 --2- 172.21.15.154:0/3565946282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac09d860 0x7f4dac09dc30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00bae0 tx=0x7f4d9c00bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ca17f806aef0242 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4da959a700 1 -- 172.21.15.154:0/3565946282 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00dc70 con 0x7f4dac09d860 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4da959a700 1 -- 172.21.15.154:0/3565946282 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c00ddd0 con 0x7f4dac09d860 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.922+0000 7f4da959a700 1 -- 172.21.15.154:0/3565946282 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c010690 con 0x7f4dac09d860 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.923+0000 7f4db0a82700 1 -- 172.21.15.154:0/3565946282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac09d860 msgr2=0x7f4dac09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.923+0000 7f4db0a82700 1 --2- 172.21.15.154:0/3565946282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac09d860 0x7f4dac09dc30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00bae0 tx=0x7f4d9c00bdf0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.923+0000 7f4db0a82700 1 -- 172.21.15.154:0/3565946282 shutdown_connections 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.923+0000 7f4db0a82700 1 --2- 172.21.15.154:0/3565946282 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac09d860 0x7f4dac09dc30 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.923+0000 7f4db0a82700 1 --2- 172.21.15.154:0/3565946282 >> v2:172.21.15.154:3300/0 conn(0x7f4dac09e170 0x7f4dac1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.923+0000 7f4db0a82700 1 -- 172.21.15.154:0/3565946282 >> 172.21.15.154:0/3565946282 conn(0x7f4dac099c40 msgr2=0x7f4dac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.923+0000 7f4db0a82700 1 -- 172.21.15.154:0/3565946282 shutdown_connections 2023-09-30T22:28:37.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.923+0000 7f4db0a82700 1 -- 172.21.15.154:0/3565946282 wait complete. 2023-09-30T22:28:37.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.924+0000 7f4db0a82700 1 Processor -- start 2023-09-30T22:28:37.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.924+0000 7f4db0a82700 1 -- start start 2023-09-30T22:28:37.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4db0a82700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dac09d860 0x7f4dac1c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4db0a82700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dac09e170 0x7f4dac1c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4db0a82700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac130ce0 0x7f4dac1c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4db0a82700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac124a90 con 0x7f4dac09e170 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4db0a82700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0a06b0 con 0x7f4dac09d860 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4db0a82700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac09c8b0 con 0x7f4dac130ce0 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daa59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dac09d860 0x7f4dac1c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daa59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dac09d860 0x7f4dac1c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53786/0 (socket says 172.21.15.154:53786) 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daa59c700 1 -- 172.21.15.154:0/539245304 learned_addr learned my addr 172.21.15.154:0/539245304 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daad9d700 1 --2- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac130ce0 0x7f4dac1c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4da9d9b700 1 --2- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dac09e170 0x7f4dac1c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daad9d700 1 -- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dac09d860 msgr2=0x7f4dac1c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daad9d700 1 --2- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dac09d860 0x7f4dac1c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daad9d700 1 -- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dac09e170 msgr2=0x7f4dac1c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daad9d700 1 --2- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dac09e170 0x7f4dac1c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daad9d700 1 -- 172.21.15.154:0/539245304 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0009550 con 0x7f4dac130ce0 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.925+0000 7f4daad9d700 1 --2- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac130ce0 0x7f4dac1c7fd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c730 tx=0x7f4da400ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.926+0000 7f4d9affd700 1 -- 172.21.15.154:0/539245304 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4003e30 con 0x7f4dac130ce0 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.926+0000 7f4d9affd700 1 -- 172.21.15.154:0/539245304 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da4005070 con 0x7f4dac130ce0 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.926+0000 7f4db0a82700 1 -- 172.21.15.154:0/539245304 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c00b740 con 0x7f4dac130ce0 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.926+0000 7f4db0a82700 1 -- 172.21.15.154:0/539245304 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac124c30 con 0x7f4dac130ce0 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.927+0000 7f4d9affd700 1 -- 172.21.15.154:0/539245304 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4005400 con 0x7f4dac130ce0 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.927+0000 7f4d9affd700 1 -- 172.21.15.154:0/539245304 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4da4005560 con 0x7f4dac130ce0 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.927+0000 7f4d9affd700 1 -- 172.21.15.154:0/539245304 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4da403f380 con 0x7f4dac130ce0 2023-09-30T22:28:37.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.928+0000 7f4db0a82700 1 -- 172.21.15.154:0/539245304 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac1c7d80 con 0x7f4dac130ce0 2023-09-30T22:28:37.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.937+0000 7f4d9affd700 1 -- 172.21.15.154:0/539245304 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4da4010710 con 0x7f4dac130ce0 2023-09-30T22:28:37.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.956+0000 7eff23533700 1 Processor -- start 2023-09-30T22:28:37.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.956+0000 7eff23533700 1 -- start start 2023-09-30T22:28:37.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff23533700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09e870 0x7eff1c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff23533700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7eff1c131f40 0x7eff1c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff23533700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c09c970 con 0x7eff1c09f180 2023-09-30T22:28:37.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff23533700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0a0920 con 0x7eff1c131f40 2023-09-30T22:28:37.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff23533700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c09f9c0 con 0x7eff1c09e870 2023-09-30T22:28:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff212cf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09e870 0x7eff1c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff212cf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09e870 0x7eff1c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39660/0 (socket says 172.21.15.154:39660) 2023-09-30T22:28:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff212cf700 1 -- 172.21.15.154:0/2335441156 learned_addr learned my addr 172.21.15.154:0/2335441156 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff21ad0700 1 --2- 172.21.15.154:0/2335441156 >> v2:172.21.15.154:3300/0 conn(0x7eff1c131f40 0x7eff1c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff20ace700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7eff1c09f180 0x7eff1c131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43134/0 (socket says 172.21.15.154:43134) 2023-09-30T22:28:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.957+0000 7eff212cf700 1 -- 172.21.15.154:0/2335441156 >> v2:172.21.15.154:3300/0 conn(0x7eff1c131f40 msgr2=0x7eff1c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.958+0000 7eff212cf700 1 --2- 172.21.15.154:0/2335441156 >> v2:172.21.15.154:3300/0 conn(0x7eff1c131f40 0x7eff1c139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.958+0000 7eff212cf700 1 -- 172.21.15.154:0/2335441156 >> v1:172.21.15.154:6789/0 conn(0x7eff1c09f180 legacy=0x7eff1c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.958+0000 7eff212cf700 1 -- 172.21.15.154:0/2335441156 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c09bab0 con 0x7eff1c09e870 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.958+0000 7eff21ad0700 1 --2- 172.21.15.154:0/2335441156 >> v2:172.21.15.154:3300/0 conn(0x7eff1c131f40 0x7eff1c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.958+0000 7eff212cf700 1 --2- 172.21.15.154:0/2335441156 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09e870 0x7eff1c09ec40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7eff180098f0 tx=0x7eff18009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9e4e4313cf2cb37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.958+0000 7eff13fff700 1 -- 172.21.15.154:0/2335441156 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18011830 con 0x7eff1c09e870 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.958+0000 7eff13fff700 1 -- 172.21.15.154:0/2335441156 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff18011990 con 0x7eff1c09e870 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.958+0000 7eff13fff700 1 -- 172.21.15.154:0/2335441156 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18011d20 con 0x7eff1c09e870 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.959+0000 7eff23533700 1 -- 172.21.15.154:0/2335441156 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09e870 msgr2=0x7eff1c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.959+0000 7eff23533700 1 --2- 172.21.15.154:0/2335441156 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09e870 0x7eff1c09ec40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7eff180098f0 tx=0x7eff18009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.959+0000 7eff23533700 1 -- 172.21.15.154:0/2335441156 shutdown_connections 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.959+0000 7eff23533700 1 --2- 172.21.15.154:0/2335441156 >> v2:172.21.15.154:3300/0 conn(0x7eff1c131f40 0x7eff1c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.959+0000 7eff23533700 1 --2- 172.21.15.154:0/2335441156 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09e870 0x7eff1c09ec40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.959+0000 7eff23533700 1 -- 172.21.15.154:0/2335441156 >> 172.21.15.154:0/2335441156 conn(0x7eff1c0a4430 msgr2=0x7eff1c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:37.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.959+0000 7eff23533700 1 -- 172.21.15.154:0/2335441156 shutdown_connections 2023-09-30T22:28:37.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.959+0000 7eff23533700 1 -- 172.21.15.154:0/2335441156 wait complete. 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff23533700 1 Processor -- start 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff23533700 1 -- start start 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff23533700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1c09e870 0x7eff1c12f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff23533700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09f180 0x7eff1c12fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff23533700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1c131f40 0x7eff1c130290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff23533700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1394c0 con 0x7eff1c09e870 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff23533700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c137de0 con 0x7eff1c131f40 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff23533700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c139970 con 0x7eff1c09f180 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff212cf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1c09e870 0x7eff1c12f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff212cf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1c09e870 0x7eff1c12f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46068/0 (socket says 172.21.15.154:46068) 2023-09-30T22:28:37.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff212cf700 1 -- 172.21.15.154:0/1220729240 learned_addr learned my addr 172.21.15.154:0/1220729240 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:37.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.960+0000 7eff21ad0700 1 --2- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1c131f40 0x7eff1c130290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:37.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff212cf700 1 -- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09f180 msgr2=0x7eff1c12fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff212cf700 1 --2- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09f180 0x7eff1c12fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff212cf700 1 -- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1c131f40 msgr2=0x7eff1c130290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:37.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff212cf700 1 --2- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1c131f40 0x7eff1c130290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:37.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff212cf700 1 -- 172.21.15.154:0/1220729240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14009a70 con 0x7eff1c09e870 2023-09-30T22:28:37.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff21ad0700 1 --2- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1c131f40 0x7eff1c130290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:37.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff212cf700 1 --2- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1c09e870 0x7eff1c12f810 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7eff18009c40 tx=0x7eff18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:37.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff11ffb700 1 -- 172.21.15.154:0/1220729240 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180036a0 con 0x7eff1c09e870 2023-09-30T22:28:37.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff11ffb700 1 -- 172.21.15.154:0/1220729240 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1801e070 con 0x7eff1c09e870 2023-09-30T22:28:37.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff11ffb700 1 -- 172.21.15.154:0/1220729240 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18003a60 con 0x7eff1c09e870 2023-09-30T22:28:37.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff23533700 1 -- 172.21.15.154:0/1220729240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff18009550 con 0x7eff1c09e870 2023-09-30T22:28:37.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.961+0000 7eff23533700 1 -- 172.21.15.154:0/1220729240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c138f90 con 0x7eff1c09e870 2023-09-30T22:28:37.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.962+0000 7eff11ffb700 1 -- 172.21.15.154:0/1220729240 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff18003bc0 con 0x7eff1c09e870 2023-09-30T22:28:37.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.962+0000 7eff11ffb700 1 -- 172.21.15.154:0/1220729240 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7eff18040630 con 0x7eff1c09e870 2023-09-30T22:28:37.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.963+0000 7eff23533700 1 -- 172.21.15.154:0/1220729240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c139710 con 0x7eff1c09e870 2023-09-30T22:28:37.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:37.971+0000 7eff11ffb700 1 -- 172.21.15.154:0/1220729240 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff1c139710 con 0x7eff1c09e870 2023-09-30T22:28:38.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.071+0000 7f0e04288700 1 -- 172.21.15.154:0/2090828181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0dfc04f2a0 con 0x7f0dfc0a0ff0 2023-09-30T22:28:38.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.071+0000 7f0df2ffd700 1 -- 172.21.15.154:0/2090828181 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dec017020 con 0x7f0dfc0a0ff0 2023-09-30T22:28:38.072 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:38.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.073+0000 7f0e04288700 1 -- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc0a0ff0 msgr2=0x7f0dfc119d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.073+0000 7f0e04288700 1 --2- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc0a0ff0 0x7f0dfc119d30 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c520 tx=0x7f0dec00c830 comp rx=0 tx=0).stop 2023-09-30T22:28:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.074+0000 7f0e04288700 1 -- 172.21.15.154:0/2090828181 shutdown_connections 2023-09-30T22:28:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.074+0000 7f0e04288700 1 --2- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dfc133b80 0x7f0dfc11a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.074+0000 7f0e04288700 1 --2- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0dfc099a60 0x7f0dfc1197f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.074+0000 7f0e04288700 1 --2- 172.21.15.154:0/2090828181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dfc0a0ff0 0x7f0dfc119d30 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.074+0000 7f0e04288700 1 -- 172.21.15.154:0/2090828181 >> 172.21.15.154:0/2090828181 conn(0x7f0dfc0a2980 msgr2=0x7f0dfc12e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.074+0000 7f0e04288700 1 -- 172.21.15.154:0/2090828181 shutdown_connections 2023-09-30T22:28:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.074+0000 7f0e04288700 1 -- 172.21.15.154:0/2090828181 wait complete. 2023-09-30T22:28:38.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.134+0000 7f4db0a82700 1 -- 172.21.15.154:0/539245304 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4dac125cc0 con 0x7f4dac130ce0 2023-09-30T22:28:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.135+0000 7f4d9affd700 1 -- 172.21.15.154:0/539245304 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4da4019300 con 0x7f4dac130ce0 2023-09-30T22:28:38.136 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.137+0000 7f4db0a82700 1 -- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac130ce0 msgr2=0x7f4dac1c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.137+0000 7f4db0a82700 1 --2- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac130ce0 0x7f4dac1c7fd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c730 tx=0x7f4da400ca40 comp rx=0 tx=0).stop 2023-09-30T22:28:38.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.137+0000 7f4db0a82700 1 -- 172.21.15.154:0/539245304 shutdown_connections 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.137+0000 7f4db0a82700 1 --2- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dac130ce0 0x7f4dac1c7fd0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.137+0000 7f4db0a82700 1 --2- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dac09d860 0x7f4dac1c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.137+0000 7f4db0a82700 1 --2- 172.21.15.154:0/539245304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dac09e170 0x7f4dac1c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.137+0000 7f4db0a82700 1 -- 172.21.15.154:0/539245304 >> 172.21.15.154:0/539245304 conn(0x7f4dac099c40 msgr2=0x7f4dac0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.137+0000 7f4db0a82700 1 -- 172.21.15.154:0/539245304 shutdown_connections 2023-09-30T22:28:38.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.137+0000 7f4db0a82700 1 -- 172.21.15.154:0/539245304 wait complete. 2023-09-30T22:28:38.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.149+0000 7f3f4f64a700 1 -- 172.21.15.154:0/246029187 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f48120c70 con 0x7f3f48133900 2023-09-30T22:28:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.149+0000 7f3f3dffb700 1 -- 172.21.15.154:0/246029187 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f48120c70 con 0x7f3f48133900 2023-09-30T22:28:38.152 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:38.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.151+0000 7f3f4f64a700 1 -- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48133900 msgr2=0x7f3f4811dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.151+0000 7f3f4f64a700 1 --2- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48133900 0x7f3f4811dcd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3f380090b0 tx=0x7f3f38004750 comp rx=0 tx=0).stop 2023-09-30T22:28:38.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.151+0000 7f3f4f64a700 1 -- 172.21.15.154:0/246029187 shutdown_connections 2023-09-30T22:28:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.151+0000 7f3f4f64a700 1 --2- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f48134210 0x7f3f4811e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.151+0000 7f3f4f64a700 1 --2- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f480a0ee0 0x7f3f4811d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.151+0000 7f3f4f64a700 1 --2- 172.21.15.154:0/246029187 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f3f48133900 0x7f3f4811dcd0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.151+0000 7f3f4f64a700 1 -- 172.21.15.154:0/246029187 >> 172.21.15.154:0/246029187 conn(0x7f3f480a2980 msgr2=0x7f3f481badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.151+0000 7f3f4f64a700 1 -- 172.21.15.154:0/246029187 shutdown_connections 2023-09-30T22:28:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.151+0000 7f3f4f64a700 1 -- 172.21.15.154:0/246029187 wait complete. 2023-09-30T22:28:38.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:38.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.214+0000 7eff23533700 1 -- 172.21.15.154:0/1220729240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff1c139710 con 0x7eff1c09e870 2023-09-30T22:28:38.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.214+0000 7eff11ffb700 1 -- 172.21.15.154:0/1220729240 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff1c139710 con 0x7eff1c09e870 2023-09-30T22:28:38.220 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:38.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.217+0000 7eff23533700 1 -- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1c09e870 msgr2=0x7eff1c12f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:38.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.217+0000 7eff23533700 1 --2- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1c09e870 0x7eff1c12f810 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7eff18009c40 tx=0x7eff18004750 comp rx=0 tx=0).stop 2023-09-30T22:28:38.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.217+0000 7eff23533700 1 -- 172.21.15.154:0/1220729240 shutdown_connections 2023-09-30T22:28:38.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.217+0000 7eff23533700 1 --2- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1c131f40 0x7eff1c130290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.217+0000 7eff23533700 1 --2- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff1c09e870 0x7eff1c12f810 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.217+0000 7eff23533700 1 --2- 172.21.15.154:0/1220729240 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7eff1c09f180 0x7eff1c12fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:38.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.217+0000 7eff23533700 1 -- 172.21.15.154:0/1220729240 >> 172.21.15.154:0/1220729240 conn(0x7eff1c0a4430 msgr2=0x7eff1c06d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:38.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.217+0000 7eff23533700 1 -- 172.21.15.154:0/1220729240 shutdown_connections 2023-09-30T22:28:38.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:38.217+0000 7eff23533700 1 -- 172.21.15.154:0/1220729240 wait complete. 2023-09-30T22:28:38.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:39.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:39.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:39.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:39.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.226+0000 7ff0e3069700 1 Processor -- start 2023-09-30T22:28:39.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.226+0000 7ff0e3069700 1 -- start start 2023-09-30T22:28:39.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e3069700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc06b250 0x7ff0dc136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e3069700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc137140 0x7ff0dc139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e3069700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc09da80 con 0x7ff0dc06a770 2023-09-30T22:28:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e3069700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc09dce0 con 0x7ff0dc06b250 2023-09-30T22:28:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e3069700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc06b620 con 0x7ff0dc137140 2023-09-30T22:28:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0dbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc06b250 0x7ff0dc136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e0e05700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff0dc06a770 0x7ff0dc06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43150/0 (socket says 172.21.15.154:43150) 2023-09-30T22:28:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e0e05700 1 -- 172.21.15.154:0/2024123940 learned_addr learned my addr 172.21.15.154:0/2024123940 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:39.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e1606700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc137140 0x7ff0dc139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0db7fe700 1 -- 172.21.15.154:0/2024123940 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265665067 0 0) 0x7ff0dc09da80 con 0x7ff0dc06a770 2023-09-30T22:28:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0db7fe700 1 -- 172.21.15.154:0/2024123940 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0cc0035b0 con 0x7ff0dc06a770 2023-09-30T22:28:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e1606700 1 -- 172.21.15.154:0/2024123940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc06b250 msgr2=0x7ff0dc136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e1606700 1 --2- 172.21.15.154:0/2024123940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc06b250 0x7ff0dc136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e1606700 1 -- 172.21.15.154:0/2024123940 >> v1:172.21.15.154:6789/0 conn(0x7ff0dc06a770 legacy=0x7ff0dc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0e1606700 1 -- 172.21.15.154:0/2024123940 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc09eb20 con 0x7ff0dc137140 2023-09-30T22:28:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.227+0000 7ff0dbfff700 1 --2- 172.21.15.154:0/2024123940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc06b250 0x7ff0dc136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:39.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0e1606700 1 --2- 172.21.15.154:0/2024123940 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc137140 0x7ff0dc139520 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009dc0 tx=0x7ff0d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788085781974c089 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0db7fe700 1 -- 172.21.15.154:0/2024123940 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400e070 con 0x7ff0dc137140 2023-09-30T22:28:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0db7fe700 1 -- 172.21.15.154:0/2024123940 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400bb20 con 0x7ff0dc137140 2023-09-30T22:28:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0db7fe700 1 -- 172.21.15.154:0/2024123940 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4012430 con 0x7ff0dc137140 2023-09-30T22:28:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0e3069700 1 -- 172.21.15.154:0/2024123940 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc137140 msgr2=0x7ff0dc139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0e3069700 1 --2- 172.21.15.154:0/2024123940 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc137140 0x7ff0dc139520 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009dc0 tx=0x7ff0d400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:39.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0e3069700 1 -- 172.21.15.154:0/2024123940 shutdown_connections 2023-09-30T22:28:39.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0e3069700 1 --2- 172.21.15.154:0/2024123940 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc137140 0x7ff0dc139520 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0e3069700 1 --2- 172.21.15.154:0/2024123940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc06b250 0x7ff0dc136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.228+0000 7ff0e3069700 1 -- 172.21.15.154:0/2024123940 >> 172.21.15.154:0/2024123940 conn(0x7ff0dc099c40 msgr2=0x7ff0dc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.229+0000 7ff0e3069700 1 -- 172.21.15.154:0/2024123940 shutdown_connections 2023-09-30T22:28:39.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.229+0000 7ff0e3069700 1 -- 172.21.15.154:0/2024123940 wait complete. 2023-09-30T22:28:39.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:39.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.229+0000 7ff0e3069700 1 Processor -- start 2023-09-30T22:28:39.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.229+0000 7ff0e3069700 1 -- start start 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e3069700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc06a770 0x7ff0dc120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e3069700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc06b250 0x7ff0dc120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e3069700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc137140 0x7ff0dc121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e3069700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc123f20 con 0x7ff0dc06a770 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e3069700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc122210 con 0x7ff0dc137140 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e3069700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc124120 con 0x7ff0dc06b250 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e0e05700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc06a770 0x7ff0dc120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e0e05700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc06a770 0x7ff0dc120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46080/0 (socket says 172.21.15.154:46080) 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e0e05700 1 -- 172.21.15.154:0/1244604519 learned_addr learned my addr 172.21.15.154:0/1244604519 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:39.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0dbfff700 1 --2- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc06b250 0x7ff0dc120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e1606700 1 --2- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc137140 0x7ff0dc121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.230+0000 7ff0e0e05700 1 -- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc06b250 msgr2=0x7ff0dc120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0e0e05700 1 --2- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc06b250 0x7ff0dc120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0e0e05700 1 -- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc137140 msgr2=0x7ff0dc121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0e0e05700 1 --2- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc137140 0x7ff0dc121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0e0e05700 1 -- 172.21.15.154:0/1244604519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80094a0 con 0x7ff0dc06a770 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0e0e05700 1 --2- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc06a770 0x7ff0dc120700 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c700 tx=0x7ff0d000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0d97fa700 1 -- 172.21.15.154:0/1244604519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0005d70 con 0x7ff0dc06a770 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0d97fa700 1 -- 172.21.15.154:0/1244604519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00070d0 con 0x7ff0dc06a770 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0d97fa700 1 -- 172.21.15.154:0/1244604519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0007460 con 0x7ff0dc06a770 2023-09-30T22:28:39.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0e3069700 1 -- 172.21.15.154:0/1244604519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d4009a70 con 0x7ff0dc06a770 2023-09-30T22:28:39.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.231+0000 7ff0e3069700 1 -- 172.21.15.154:0/1244604519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc1364f0 con 0x7ff0dc06a770 2023-09-30T22:28:39.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.232+0000 7ff0d97fa700 1 -- 172.21.15.154:0/1244604519 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0d00075c0 con 0x7ff0dc06a770 2023-09-30T22:28:39.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.232+0000 7ff0d97fa700 1 -- 172.21.15.154:0/1244604519 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff0d003eac0 con 0x7ff0dc06a770 2023-09-30T22:28:39.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.232+0000 7ff0e3069700 1 -- 172.21.15.154:0/1244604519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc122a60 con 0x7ff0dc06a770 2023-09-30T22:28:39.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.237+0000 7ff0d97fa700 1 -- 172.21.15.154:0/1244604519 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0d0017080 con 0x7ff0dc06a770 2023-09-30T22:28:39.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.284+0000 7f183e92d700 1 Processor -- start 2023-09-30T22:28:39.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.284+0000 7f183e92d700 1 -- start start 2023-09-30T22:28:39.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183e92d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1838133900 0x7f1838133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183e92d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18380a10b0 0x7f183813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183e92d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183809a760 con 0x7f1838134210 2023-09-30T22:28:39.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183e92d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18381336e0 con 0x7f18380a10b0 2023-09-30T22:28:39.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183e92d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f183809a080 con 0x7f1838133900 2023-09-30T22:28:39.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183ceca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18380a10b0 0x7f183813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183ceca700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18380a10b0 0x7f183813b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53808/0 (socket says 172.21.15.154:53808) 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183ceca700 1 -- 172.21.15.154:0/504319351 learned_addr learned my addr 172.21.15.154:0/504319351 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f1837fff700 1 --2- 172.21.15.154:0/504319351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1838133900 0x7f1838133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183ceca700 1 -- 172.21.15.154:0/504319351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1838133900 msgr2=0x7f1838133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183ceca700 1 --2- 172.21.15.154:0/504319351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1838133900 0x7f1838133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183ceca700 1 -- 172.21.15.154:0/504319351 >> v1:172.21.15.154:6789/0 conn(0x7f1838134210 legacy=0x7f18380a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183ceca700 1 -- 172.21.15.154:0/504319351 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380a23e0 con 0x7f18380a10b0 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.285+0000 7f183ceca700 1 --2- 172.21.15.154:0/504319351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18380a10b0 0x7f183813b910 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1830009e80 tx=0x7f183000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429ba6eee76b975c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.286+0000 7f1836ffd700 1 -- 172.21.15.154:0/504319351 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183000e070 con 0x7f18380a10b0 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.286+0000 7f1836ffd700 1 -- 172.21.15.154:0/504319351 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830003a20 con 0x7f18380a10b0 2023-09-30T22:28:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.286+0000 7f1836ffd700 1 -- 172.21.15.154:0/504319351 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830003dd0 con 0x7f18380a10b0 2023-09-30T22:28:39.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.286+0000 7f183e92d700 1 -- 172.21.15.154:0/504319351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18380a10b0 msgr2=0x7f183813b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.286+0000 7f183e92d700 1 --2- 172.21.15.154:0/504319351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18380a10b0 0x7f183813b910 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1830009e80 tx=0x7f183000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:39.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.286+0000 7f183e92d700 1 -- 172.21.15.154:0/504319351 shutdown_connections 2023-09-30T22:28:39.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.286+0000 7f183e92d700 1 --2- 172.21.15.154:0/504319351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18380a10b0 0x7f183813b910 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.286+0000 7f183e92d700 1 --2- 172.21.15.154:0/504319351 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1838133900 0x7f1838133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.286+0000 7f183e92d700 1 -- 172.21.15.154:0/504319351 >> 172.21.15.154:0/504319351 conn(0x7f18380a2980 msgr2=0x7f18380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.287+0000 7f183e92d700 1 -- 172.21.15.154:0/504319351 shutdown_connections 2023-09-30T22:28:39.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.287+0000 7f183e92d700 1 -- 172.21.15.154:0/504319351 wait complete. 2023-09-30T22:28:39.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.288+0000 7f183e92d700 1 Processor -- start 2023-09-30T22:28:39.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.288+0000 7f183e92d700 1 -- start start 2023-09-30T22:28:39.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183e92d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18380a10b0 0x7f183811d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183e92d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1838133900 0x7f183811ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183e92d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1838134210 0x7f183811e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183e92d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1838130c70 con 0x7f1838133900 2023-09-30T22:28:39.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183e92d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18381206e0 con 0x7f1838134210 2023-09-30T22:28:39.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183e92d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f183811ece0 con 0x7f18380a10b0 2023-09-30T22:28:39.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f18377fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1838133900 0x7f183811ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f18377fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1838133900 0x7f183811ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46090/0 (socket says 172.21.15.154:46090) 2023-09-30T22:28:39.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f18377fe700 1 -- 172.21.15.154:0/4178873761 learned_addr learned my addr 172.21.15.154:0/4178873761 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:39.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183ceca700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1838134210 0x7f183811e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f1837fff700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18380a10b0 0x7f183811d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183ceca700 1 -- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18380a10b0 msgr2=0x7f183811d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183ceca700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18380a10b0 0x7f183811d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183ceca700 1 -- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1838133900 msgr2=0x7f183811ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.289+0000 7f183ceca700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1838133900 0x7f183811ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.290+0000 7f183ceca700 1 -- 172.21.15.154:0/4178873761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830009b30 con 0x7f1838134210 2023-09-30T22:28:39.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.290+0000 7f18377fe700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1838133900 0x7f183811ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:39.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.290+0000 7f1837fff700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18380a10b0 0x7f183811d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:39.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.290+0000 7f183ceca700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1838134210 0x7f183811e300 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1830014000 tx=0x7f1830004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.290+0000 7f1834ff9700 1 -- 172.21.15.154:0/4178873761 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830004440 con 0x7f1838134210 2023-09-30T22:28:39.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.290+0000 7f1834ff9700 1 -- 172.21.15.154:0/4178873761 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18300045c0 con 0x7f1838134210 2023-09-30T22:28:39.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.290+0000 7f183e92d700 1 -- 172.21.15.154:0/4178873761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18381210c0 con 0x7f1838134210 2023-09-30T22:28:39.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.290+0000 7f1834ff9700 1 -- 172.21.15.154:0/4178873761 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830004970 con 0x7f1838134210 2023-09-30T22:28:39.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.290+0000 7f183e92d700 1 -- 172.21.15.154:0/4178873761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1838132e50 con 0x7f1838134210 2023-09-30T22:28:39.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.291+0000 7f181e7fc700 1 -- 172.21.15.154:0/4178873761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18100052e0 con 0x7f1838134210 2023-09-30T22:28:39.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.292+0000 7f1834ff9700 1 -- 172.21.15.154:0/4178873761 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f183002f480 con 0x7f1838134210 2023-09-30T22:28:39.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.292+0000 7f1834ff9700 1 -- 172.21.15.154:0/4178873761 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f18300411b0 con 0x7f1838134210 2023-09-30T22:28:39.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.296+0000 7f1834ff9700 1 -- 172.21.15.154:0/4178873761 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f183001bb00 con 0x7f1838134210 2023-09-30T22:28:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.331+0000 7f9adcfb6700 1 Processor -- start 2023-09-30T22:28:39.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9adcfb6700 1 -- start start 2023-09-30T22:28:39.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9adcfb6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ad806a770 0x7f9ad81349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9adcfb6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 0x7f9ad813fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9adcfb6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad809eca0 con 0x7f9ad8134f00 2023-09-30T22:28:39.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9adcfb6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad806b2e0 con 0x7f9ad806a770 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9adcfb6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad809f720 con 0x7f9ad809e070 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9ad659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ad806a770 0x7f9ad81349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9ad659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9ad806a770 0x7f9ad81349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46092/0 (socket says 172.21.15.154:46092) 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9ad659c700 1 -- 172.21.15.154:0/438946679 learned_addr learned my addr 172.21.15.154:0/438946679 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.332+0000 7f9acdd9b700 1 --1- 172.21.15.154:0/438946679 >> v1:172.21.15.154:6789/0 conn(0x7f9ad8134f00 0x7f9ad809d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43162/0 (socket says 172.21.15.154:43162) 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.333+0000 7f9ad6d9d700 1 --2- 172.21.15.154:0/438946679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 0x7f9ad813fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.333+0000 7f9ad659c700 1 -- 172.21.15.154:0/438946679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 msgr2=0x7f9ad813fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.333+0000 7f9ad659c700 1 --2- 172.21.15.154:0/438946679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 0x7f9ad813fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.333+0000 7f9ad659c700 1 -- 172.21.15.154:0/438946679 >> v1:172.21.15.154:6789/0 conn(0x7f9ad8134f00 legacy=0x7f9ad809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.333+0000 7f9ad659c700 1 -- 172.21.15.154:0/438946679 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad806b480 con 0x7f9ad806a770 2023-09-30T22:28:39.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.333+0000 7f9ad659c700 1 --2- 172.21.15.154:0/438946679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 0x7f9ad81349c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80098f0 tx=0x7f9ac8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c359a343579d32 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.333+0000 7f9ad5d9b700 1 -- 172.21.15.154:0/438946679 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8011830 con 0x7f9ad806a770 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.333+0000 7f9ad5d9b700 1 -- 172.21.15.154:0/438946679 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac8011990 con 0x7f9ad806a770 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.333+0000 7f9ad5d9b700 1 -- 172.21.15.154:0/438946679 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8011d20 con 0x7f9ad806a770 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.334+0000 7f9adcfb6700 1 -- 172.21.15.154:0/438946679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 msgr2=0x7f9ad81349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.334+0000 7f9adcfb6700 1 --2- 172.21.15.154:0/438946679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 0x7f9ad81349c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80098f0 tx=0x7f9ac8009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.334+0000 7f9adcfb6700 1 -- 172.21.15.154:0/438946679 shutdown_connections 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.334+0000 7f9adcfb6700 1 --2- 172.21.15.154:0/438946679 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 0x7f9ad813fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.334+0000 7f9adcfb6700 1 --2- 172.21.15.154:0/438946679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 0x7f9ad81349c0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.334+0000 7f9adcfb6700 1 -- 172.21.15.154:0/438946679 >> 172.21.15.154:0/438946679 conn(0x7f9ad8099c40 msgr2=0x7f9ad80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.334+0000 7f9adcfb6700 1 -- 172.21.15.154:0/438946679 shutdown_connections 2023-09-30T22:28:39.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.334+0000 7f9adcfb6700 1 -- 172.21.15.154:0/438946679 wait complete. 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.335+0000 7f9adcfb6700 1 Processor -- start 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9adcfb6700 1 -- start start 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9adcfb6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 0x7f9ad81ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9adcfb6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 0x7f9ad81ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9adcfb6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad8134f00 0x7f9ad81cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9adcfb6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8126950 con 0x7f9ad806a770 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9adcfb6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8126ba0 con 0x7f9ad8134f00 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9adcfb6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8071080 con 0x7f9ad809e070 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9ad659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 0x7f9ad81ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9ad659c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 0x7f9ad81ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46098/0 (socket says 172.21.15.154:46098) 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9ad659c700 1 -- 172.21.15.154:0/2649480115 learned_addr learned my addr 172.21.15.154:0/2649480115 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.336+0000 7f9ad6d9d700 1 --2- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad8134f00 0x7f9ad81cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9acdd9b700 1 --2- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 0x7f9ad81ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9ad6d9d700 1 -- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 msgr2=0x7f9ad81ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9ad6d9d700 1 --2- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 0x7f9ad81ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9ad6d9d700 1 -- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 msgr2=0x7f9ad81ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9ad6d9d700 1 --2- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 0x7f9ad81ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9ad6d9d700 1 -- 172.21.15.154:0/2649480115 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac8009550 con 0x7f9ad8134f00 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9ad6d9d700 1 --2- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad8134f00 0x7f9ad81cd530 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000efc0 tx=0x7f9ad000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9acf7fe700 1 -- 172.21.15.154:0/2649480115 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000cc90 con 0x7f9ad8134f00 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9acf7fe700 1 -- 172.21.15.154:0/2649480115 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad000f040 con 0x7f9ad8134f00 2023-09-30T22:28:39.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9adcfb6700 1 -- 172.21.15.154:0/2649480115 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad8127750 con 0x7f9ad8134f00 2023-09-30T22:28:39.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9acf7fe700 1 -- 172.21.15.154:0/2649480115 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00146c0 con 0x7f9ad8134f00 2023-09-30T22:28:39.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.337+0000 7f9adcfb6700 1 -- 172.21.15.154:0/2649480115 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad8127380 con 0x7f9ad8134f00 2023-09-30T22:28:39.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.338+0000 7f9adcfb6700 1 -- 172.21.15.154:0/2649480115 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad8074f10 con 0x7f9ad8134f00 2023-09-30T22:28:39.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.339+0000 7f9acf7fe700 1 -- 172.21.15.154:0/2649480115 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ad0014820 con 0x7f9ad8134f00 2023-09-30T22:28:39.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.339+0000 7f9acf7fe700 1 -- 172.21.15.154:0/2649480115 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9ad0040230 con 0x7f9ad8134f00 2023-09-30T22:28:39.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.343+0000 7f9acf7fe700 1 -- 172.21.15.154:0/2649480115 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ad0007900 con 0x7f9ad8134f00 2023-09-30T22:28:39.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.390+0000 7f7bc696f700 1 Processor -- start 2023-09-30T22:28:39.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.390+0000 7f7bc696f700 1 -- start start 2023-09-30T22:28:39.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bc696f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a0a70 0x7f7bc00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bc696f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a1380 0x7f7bc0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bc696f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc009dc00 con 0x7f7bc0133f50 2023-09-30T22:28:39.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bc696f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc009ea60 con 0x7f7bc00a0a70 2023-09-30T22:28:39.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bc696f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc009dec0 con 0x7f7bc00a1380 2023-09-30T22:28:39.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bbffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a0a70 0x7f7bc00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bbffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a0a70 0x7f7bc00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53834/0 (socket says 172.21.15.154:53834) 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bbffff700 1 -- 172.21.15.154:0/276114629 learned_addr learned my addr 172.21.15.154:0/276114629 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bc4f0c700 1 --1- 172.21.15.154:0/276114629 >> v1:172.21.15.154:6789/0 conn(0x7f7bc0133f50 0x7f7bc013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43178/0 (socket says 172.21.15.154:43178) 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.391+0000 7f7bbf7fe700 1 --2- 172.21.15.154:0/276114629 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a1380 0x7f7bc0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bbffff700 1 -- 172.21.15.154:0/276114629 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a1380 msgr2=0x7f7bc0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bbffff700 1 --2- 172.21.15.154:0/276114629 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a1380 0x7f7bc0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bbeffd700 1 -- 172.21.15.154:0/276114629 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081252134 0 0) 0x7f7bc009dc00 con 0x7f7bc0133f50 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bbffff700 1 -- 172.21.15.154:0/276114629 >> v1:172.21.15.154:6789/0 conn(0x7f7bc0133f50 legacy=0x7f7bc013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bbffff700 1 -- 172.21.15.154:0/276114629 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc009e6a0 con 0x7f7bc00a0a70 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bbffff700 1 --2- 172.21.15.154:0/276114629 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a0a70 0x7f7bc00a0e40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009920 tx=0x7f7bb0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=784cc00a8c76a62d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bbeffd700 1 -- 172.21.15.154:0/276114629 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0011830 con 0x7f7bc00a0a70 2023-09-30T22:28:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bbeffd700 1 -- 172.21.15.154:0/276114629 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb0011990 con 0x7f7bc00a0a70 2023-09-30T22:28:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bbeffd700 1 -- 172.21.15.154:0/276114629 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0011d20 con 0x7f7bc00a0a70 2023-09-30T22:28:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bc696f700 1 -- 172.21.15.154:0/276114629 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a0a70 msgr2=0x7f7bc00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.392+0000 7f7bc696f700 1 --2- 172.21.15.154:0/276114629 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a0a70 0x7f7bc00a0e40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009920 tx=0x7f7bb0009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.393+0000 7f7bc696f700 1 -- 172.21.15.154:0/276114629 shutdown_connections 2023-09-30T22:28:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.393+0000 7f7bc696f700 1 --2- 172.21.15.154:0/276114629 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a0a70 0x7f7bc00a0e40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.393+0000 7f7bc696f700 1 --2- 172.21.15.154:0/276114629 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a1380 0x7f7bc0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.393+0000 7f7bc696f700 1 -- 172.21.15.154:0/276114629 >> 172.21.15.154:0/276114629 conn(0x7f7bc00a6610 msgr2=0x7f7bc00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.393+0000 7f7bc696f700 1 -- 172.21.15.154:0/276114629 shutdown_connections 2023-09-30T22:28:39.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.393+0000 7f7bc696f700 1 -- 172.21.15.154:0/276114629 wait complete. 2023-09-30T22:28:39.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.394+0000 7f7bc696f700 1 Processor -- start 2023-09-30T22:28:39.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.394+0000 7f7bc696f700 1 -- start start 2023-09-30T22:28:39.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bc696f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a0a70 0x7f7bc01228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bc696f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a1380 0x7f7bc0122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bc696f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bc0133f50 0x7f7bc0123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:39.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bc696f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0126200 con 0x7f7bc0133f50 2023-09-30T22:28:39.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bc696f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0133940 con 0x7f7bc00a1380 2023-09-30T22:28:39.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bc696f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0133400 con 0x7f7bc00a0a70 2023-09-30T22:28:39.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bbffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a0a70 0x7f7bc01228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bbffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a0a70 0x7f7bc01228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39766/0 (socket says 172.21.15.154:39766) 2023-09-30T22:28:39.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bbffff700 1 -- 172.21.15.154:0/827721550 learned_addr learned my addr 172.21.15.154:0/827721550 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:39.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bbf7fe700 1 --2- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a1380 0x7f7bc0122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bc4f0c700 1 --2- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bc0133f50 0x7f7bc0123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:39.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bbffff700 1 -- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a1380 msgr2=0x7f7bc0122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bbffff700 1 --2- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a1380 0x7f7bc0122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bbffff700 1 -- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bc0133f50 msgr2=0x7f7bc0123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bbffff700 1 --2- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bc0133f50 0x7f7bc0123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.395+0000 7f7bbffff700 1 -- 172.21.15.154:0/827721550 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb0009550 con 0x7f7bc00a0a70 2023-09-30T22:28:39.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.396+0000 7f7bbffff700 1 --2- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a0a70 0x7f7bc01228e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009f80 tx=0x7f7bb0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:39.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.396+0000 7f7bbcff9700 1 -- 172.21.15.154:0/827721550 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0004510 con 0x7f7bc00a0a70 2023-09-30T22:28:39.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.396+0000 7f7bbcff9700 1 -- 172.21.15.154:0/827721550 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb001f070 con 0x7f7bc00a0a70 2023-09-30T22:28:39.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.396+0000 7f7bbcff9700 1 -- 172.21.15.154:0/827721550 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00038c0 con 0x7f7bc00a0a70 2023-09-30T22:28:39.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.396+0000 7f7bc696f700 1 -- 172.21.15.154:0/827721550 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc00a03e0 con 0x7f7bc00a0a70 2023-09-30T22:28:39.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.396+0000 7f7bc696f700 1 -- 172.21.15.154:0/827721550 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc0126b90 con 0x7f7bc00a0a70 2023-09-30T22:28:39.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.397+0000 7f7bbcff9700 1 -- 172.21.15.154:0/827721550 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bb0003a20 con 0x7f7bc00a0a70 2023-09-30T22:28:39.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.397+0000 7f7bc696f700 1 -- 172.21.15.154:0/827721550 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc004f2a0 con 0x7f7bc00a0a70 2023-09-30T22:28:39.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.397+0000 7f7bbcff9700 1 -- 172.21.15.154:0/827721550 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7bb0021070 con 0x7f7bc00a0a70 2023-09-30T22:28:39.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.402+0000 7f7bbcff9700 1 -- 172.21.15.154:0/827721550 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bb000bdf0 con 0x7f7bc00a0a70 2023-09-30T22:28:39.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.455+0000 7ff0e3069700 1 -- 172.21.15.154:0/1244604519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff0dc04f2a0 con 0x7ff0dc06a770 2023-09-30T22:28:39.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.456+0000 7ff0d97fa700 1 -- 172.21.15.154:0/1244604519 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0d0018260 con 0x7ff0dc06a770 2023-09-30T22:28:39.457 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:39.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.458+0000 7ff0e3069700 1 -- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc06a770 msgr2=0x7ff0dc120700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.458+0000 7ff0e3069700 1 --2- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc06a770 0x7ff0dc120700 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c700 tx=0x7ff0d000ca10 comp rx=0 tx=0).stop 2023-09-30T22:28:39.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.458+0000 7ff0e3069700 1 -- 172.21.15.154:0/1244604519 shutdown_connections 2023-09-30T22:28:39.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.458+0000 7ff0e3069700 1 --2- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0dc137140 0x7ff0dc121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.458+0000 7ff0e3069700 1 --2- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0dc06a770 0x7ff0dc120700 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.458+0000 7ff0e3069700 1 --2- 172.21.15.154:0/1244604519 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff0dc06b250 0x7ff0dc120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.458+0000 7ff0e3069700 1 -- 172.21.15.154:0/1244604519 >> 172.21.15.154:0/1244604519 conn(0x7ff0dc099c40 msgr2=0x7ff0dc06fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.458+0000 7ff0e3069700 1 -- 172.21.15.154:0/1244604519 shutdown_connections 2023-09-30T22:28:39.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.458+0000 7ff0e3069700 1 -- 172.21.15.154:0/1244604519 wait complete. 2023-09-30T22:28:39.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:39.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.494+0000 7f181e7fc700 1 -- 172.21.15.154:0/4178873761 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1810005860 con 0x7f1838134210 2023-09-30T22:28:39.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.495+0000 7f1834ff9700 1 -- 172.21.15.154:0/4178873761 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1830017070 con 0x7f1838134210 2023-09-30T22:28:39.496 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:39.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.497+0000 7f181e7fc700 1 -- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1838134210 msgr2=0x7f183811e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.497+0000 7f181e7fc700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1838134210 0x7f183811e300 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1830014000 tx=0x7f1830004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.497+0000 7f181e7fc700 1 -- 172.21.15.154:0/4178873761 shutdown_connections 2023-09-30T22:28:39.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.497+0000 7f181e7fc700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1838134210 0x7f183811e300 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.497+0000 7f181e7fc700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18380a10b0 0x7f183811d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.497+0000 7f181e7fc700 1 --2- 172.21.15.154:0/4178873761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1838133900 0x7f183811ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.497+0000 7f181e7fc700 1 -- 172.21.15.154:0/4178873761 >> 172.21.15.154:0/4178873761 conn(0x7f18380a2980 msgr2=0x7f18381bade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.497+0000 7f181e7fc700 1 -- 172.21.15.154:0/4178873761 shutdown_connections 2023-09-30T22:28:39.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.497+0000 7f181e7fc700 1 -- 172.21.15.154:0/4178873761 wait complete. 2023-09-30T22:28:39.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:39.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.562+0000 7f9adcfb6700 1 -- 172.21.15.154:0/2649480115 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9ad804f2a0 con 0x7f9ad8134f00 2023-09-30T22:28:39.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.562+0000 7f9acf7fe700 1 -- 172.21.15.154:0/2649480115 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ad0018020 con 0x7f9ad8134f00 2023-09-30T22:28:39.563 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:39.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.565+0000 7f9adcfb6700 1 -- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad8134f00 msgr2=0x7f9ad81cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.565+0000 7f9adcfb6700 1 --2- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad8134f00 0x7f9ad81cd530 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000efc0 tx=0x7f9ad000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.565+0000 7f9adcfb6700 1 -- 172.21.15.154:0/2649480115 shutdown_connections 2023-09-30T22:28:39.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.565+0000 7f9adcfb6700 1 --2- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ad8134f00 0x7f9ad81cd530 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.565+0000 7f9adcfb6700 1 --2- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ad806a770 0x7f9ad81ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.565+0000 7f9adcfb6700 1 --2- 172.21.15.154:0/2649480115 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9ad809e070 0x7f9ad81ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.565+0000 7f9adcfb6700 1 -- 172.21.15.154:0/2649480115 >> 172.21.15.154:0/2649480115 conn(0x7f9ad8099c40 msgr2=0x7f9ad80a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.565+0000 7f9adcfb6700 1 -- 172.21.15.154:0/2649480115 shutdown_connections 2023-09-30T22:28:39.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.565+0000 7f9adcfb6700 1 -- 172.21.15.154:0/2649480115 wait complete. 2023-09-30T22:28:39.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:39.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.618+0000 7f7bc696f700 1 -- 172.21.15.154:0/827721550 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7bc0072980 con 0x7f7bc00a0a70 2023-09-30T22:28:39.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.618+0000 7f7bbcff9700 1 -- 172.21.15.154:0/827721550 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bb002a020 con 0x7f7bc00a0a70 2023-09-30T22:28:39.620 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:39.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.620+0000 7f7bc696f700 1 -- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a0a70 msgr2=0x7f7bc01228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:39.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.620+0000 7f7bc696f700 1 --2- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a0a70 0x7f7bc01228e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009f80 tx=0x7f7bb0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:39.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.620+0000 7f7bc696f700 1 -- 172.21.15.154:0/827721550 shutdown_connections 2023-09-30T22:28:39.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.620+0000 7f7bc696f700 1 --2- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bc0133f50 0x7f7bc0123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.620+0000 7f7bc696f700 1 --2- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7bc00a0a70 0x7f7bc01228e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.620+0000 7f7bc696f700 1 --2- 172.21.15.154:0/827721550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7bc00a1380 0x7f7bc0122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:39.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.620+0000 7f7bc696f700 1 -- 172.21.15.154:0/827721550 >> 172.21.15.154:0/827721550 conn(0x7f7bc00a6610 msgr2=0x7f7bc009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:39.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.620+0000 7f7bc696f700 1 -- 172.21.15.154:0/827721550 shutdown_connections 2023-09-30T22:28:39.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:39.620+0000 7f7bc696f700 1 -- 172.21.15.154:0/827721550 wait complete. 2023-09-30T22:28:39.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:40.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:40.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:40.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:40.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.611+0000 7f29e6233700 1 Processor -- start 2023-09-30T22:28:40.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.611+0000 7f29e6233700 1 -- start start 2023-09-30T22:28:40.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29e6233700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29e6233700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29e6233700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29e0131d70 0x7f29e0132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29e6233700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e00a0920 con 0x7f29e0131d70 2023-09-30T22:28:40.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29e6233700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e009c970 con 0x7f29e009e870 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29e6233700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29e009bab0 con 0x7f29e009f180 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29deffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29deffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e0131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39774/0 (socket says 172.21.15.154:39774) 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29deffd700 1 -- 172.21.15.154:0/1089554274 learned_addr learned my addr 172.21.15.154:0/1089554274 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29dffff700 1 --2- 172.21.15.154:0/1089554274 >> v2:172.21.15.154:3300/0 conn(0x7f29e0131d70 0x7f29e0132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29df7fe700 1 --2- 172.21.15.154:0/1089554274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29deffd700 1 -- 172.21.15.154:0/1089554274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 msgr2=0x7f29e009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29deffd700 1 --2- 172.21.15.154:0/1089554274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29deffd700 1 -- 172.21.15.154:0/1089554274 >> v2:172.21.15.154:3300/0 conn(0x7f29e0131d70 msgr2=0x7f29e0132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29deffd700 1 --2- 172.21.15.154:0/1089554274 >> v2:172.21.15.154:3300/0 conn(0x7f29e0131d70 0x7f29e0132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29deffd700 1 -- 172.21.15.154:0/1089554274 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e009f9c0 con 0x7f29e009f180 2023-09-30T22:28:40.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.612+0000 7f29dffff700 1 --2- 172.21.15.154:0/1089554274 >> v2:172.21.15.154:3300/0 conn(0x7f29e0131d70 0x7f29e0132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:40.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.613+0000 7f29deffd700 1 --2- 172.21.15.154:0/1089554274 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e0131830 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f29d40098f0 tx=0x7f29d4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ac44366cb3aa4e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.613+0000 7f29de7fc700 1 -- 172.21.15.154:0/1089554274 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011830 con 0x7f29e009f180 2023-09-30T22:28:40.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.613+0000 7f29de7fc700 1 -- 172.21.15.154:0/1089554274 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4011990 con 0x7f29e009f180 2023-09-30T22:28:40.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.613+0000 7f29de7fc700 1 -- 172.21.15.154:0/1089554274 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011d20 con 0x7f29e009f180 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.613+0000 7f29e6233700 1 -- 172.21.15.154:0/1089554274 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 msgr2=0x7f29e0131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.613+0000 7f29e6233700 1 --2- 172.21.15.154:0/1089554274 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e0131830 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f29d40098f0 tx=0x7f29d4009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.614+0000 7f29e6233700 1 -- 172.21.15.154:0/1089554274 shutdown_connections 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.614+0000 7f29e6233700 1 --2- 172.21.15.154:0/1089554274 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.614+0000 7f29e6233700 1 --2- 172.21.15.154:0/1089554274 >> v2:172.21.15.154:3300/0 conn(0x7f29e0131d70 0x7f29e0132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.614+0000 7f29e6233700 1 --2- 172.21.15.154:0/1089554274 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e0131830 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.614+0000 7f29e6233700 1 -- 172.21.15.154:0/1089554274 >> 172.21.15.154:0/1089554274 conn(0x7f29e00a4430 msgr2=0x7f29e00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.614+0000 7f29e6233700 1 -- 172.21.15.154:0/1089554274 shutdown_connections 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.614+0000 7f29e6233700 1 -- 172.21.15.154:0/1089554274 wait complete. 2023-09-30T22:28:40.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.615+0000 7f29e6233700 1 Processor -- start 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.615+0000 7f29e6233700 1 -- start start 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29e6233700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e011f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29e6233700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e011f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29e6233700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e0131d70 0x7f29e011fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29e6233700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e01206b0 con 0x7f29e0131d70 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29e6233700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0121c70 con 0x7f29e009e870 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29e6233700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0122cb0 con 0x7f29e009f180 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29df7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e011f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29deffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e011f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29df7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e011f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53862/0 (socket says 172.21.15.154:53862) 2023-09-30T22:28:40.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29deffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e011f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39790/0 (socket says 172.21.15.154:39790) 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29df7fe700 1 -- 172.21.15.154:0/1382179725 learned_addr learned my addr 172.21.15.154:0/1382179725 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29dffff700 1 --2- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e0131d70 0x7f29e011fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29deffd700 1 -- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 msgr2=0x7f29e011f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29deffd700 1 --2- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e011f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29deffd700 1 -- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e0131d70 msgr2=0x7f29e011fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29deffd700 1 --2- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e0131d70 0x7f29e011fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29deffd700 1 -- 172.21.15.154:0/1382179725 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d8009a70 con 0x7f29e009f180 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.616+0000 7f29df7fe700 1 --2- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e011f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.617+0000 7f29deffd700 1 --2- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e011f720 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f29d4016000 tx=0x7f29d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.617+0000 7f29c7fff700 1 -- 172.21.15.154:0/1382179725 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4004240 con 0x7f29e009f180 2023-09-30T22:28:40.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.617+0000 7f29c7fff700 1 -- 172.21.15.154:0/1382179725 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d401f070 con 0x7f29e009f180 2023-09-30T22:28:40.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.617+0000 7f29e6233700 1 -- 172.21.15.154:0/1382179725 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d4009550 con 0x7f29e009f180 2023-09-30T22:28:40.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.617+0000 7f29c7fff700 1 -- 172.21.15.154:0/1382179725 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40036a0 con 0x7f29e009f180 2023-09-30T22:28:40.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.617+0000 7f29e6233700 1 -- 172.21.15.154:0/1382179725 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e0131830 con 0x7f29e009f180 2023-09-30T22:28:40.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.618+0000 7f29c7fff700 1 -- 172.21.15.154:0/1382179725 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29d4021030 con 0x7f29e009f180 2023-09-30T22:28:40.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.618+0000 7f29e6233700 1 -- 172.21.15.154:0/1382179725 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e004f2a0 con 0x7f29e009f180 2023-09-30T22:28:40.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.618+0000 7f29c7fff700 1 -- 172.21.15.154:0/1382179725 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29d40408b0 con 0x7f29e009f180 2023-09-30T22:28:40.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.623+0000 7f29c7fff700 1 -- 172.21.15.154:0/1382179725 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29d40199a0 con 0x7f29e009f180 2023-09-30T22:28:40.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:40.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.650+0000 7faa25e48700 1 Processor -- start 2023-09-30T22:28:40.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.651+0000 7faa25e48700 1 -- start start 2023-09-30T22:28:40.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.651+0000 7faa25e48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa201350d0 0x7faa2013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.651+0000 7faa25e48700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa2013d210 0x7faa2013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.651+0000 7faa25e48700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2009eca0 con 0x7faa2006a770 2023-09-30T22:28:40.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.651+0000 7faa25e48700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2009f720 con 0x7faa2013d210 2023-09-30T22:28:40.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.651+0000 7faa25e48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa2006b480 con 0x7faa201350d0 2023-09-30T22:28:40.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.651+0000 7faa1ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa2013d210 0x7faa2013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.651+0000 7faa1ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa2013d210 0x7faa2013f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46124/0 (socket says 172.21.15.154:46124) 2023-09-30T22:28:40.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.651+0000 7faa1ffff700 1 -- 172.21.15.154:0/530081729 learned_addr learned my addr 172.21.15.154:0/530081729 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:40.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1effd700 1 --2- 172.21.15.154:0/530081729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa201350d0 0x7faa2013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1ffff700 1 -- 172.21.15.154:0/530081729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa201350d0 msgr2=0x7faa2013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1ffff700 1 --2- 172.21.15.154:0/530081729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa201350d0 0x7faa2013ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1ffff700 1 -- 172.21.15.154:0/530081729 >> v1:172.21.15.154:6789/0 conn(0x7faa2006a770 legacy=0x7faa201349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1ffff700 1 -- 172.21.15.154:0/530081729 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2009b010 con 0x7faa2013d210 2023-09-30T22:28:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1effd700 1 --2- 172.21.15.154:0/530081729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa201350d0 0x7faa2013ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1ffff700 1 --2- 172.21.15.154:0/530081729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2013d210 0x7faa2013f5f0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7faa18009e50 tx=0x7faa1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e180eb3c27a76cca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1e7fc700 1 -- 172.21.15.154:0/530081729 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800e070 con 0x7faa2013d210 2023-09-30T22:28:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1e7fc700 1 -- 172.21.15.154:0/530081729 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1800b9c0 con 0x7faa2013d210 2023-09-30T22:28:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.652+0000 7faa1e7fc700 1 -- 172.21.15.154:0/530081729 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800bd70 con 0x7faa2013d210 2023-09-30T22:28:40.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.653+0000 7faa25e48700 1 -- 172.21.15.154:0/530081729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2013d210 msgr2=0x7faa2013f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.653+0000 7faa25e48700 1 --2- 172.21.15.154:0/530081729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2013d210 0x7faa2013f5f0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7faa18009e50 tx=0x7faa1800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.653+0000 7faa25e48700 1 -- 172.21.15.154:0/530081729 shutdown_connections 2023-09-30T22:28:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.653+0000 7faa25e48700 1 --2- 172.21.15.154:0/530081729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2013d210 0x7faa2013f5f0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.653+0000 7faa25e48700 1 --2- 172.21.15.154:0/530081729 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa201350d0 0x7faa2013ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.653+0000 7faa25e48700 1 -- 172.21.15.154:0/530081729 >> 172.21.15.154:0/530081729 conn(0x7faa20099c40 msgr2=0x7faa200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.653+0000 7faa25e48700 1 -- 172.21.15.154:0/530081729 shutdown_connections 2023-09-30T22:28:40.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.653+0000 7faa25e48700 1 -- 172.21.15.154:0/530081729 wait complete. 2023-09-30T22:28:40.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.654+0000 7faa25e48700 1 Processor -- start 2023-09-30T22:28:40.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa25e48700 1 -- start start 2023-09-30T22:28:40.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa25e48700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa2006a770 0x7faa20132cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa25e48700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa201350d0 0x7faa20133230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa25e48700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2013d210 0x7faa20133770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa25e48700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa201341b0 con 0x7faa2013d210 2023-09-30T22:28:40.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa25e48700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2009a150 con 0x7faa201350d0 2023-09-30T22:28:40.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa25e48700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa2009f220 con 0x7faa2006a770 2023-09-30T22:28:40.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa1effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa201350d0 0x7faa20133230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa1f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa2006a770 0x7faa20132cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa1effd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa201350d0 0x7faa20133230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53876/0 (socket says 172.21.15.154:53876) 2023-09-30T22:28:40.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa1effd700 1 -- 172.21.15.154:0/3882384371 learned_addr learned my addr 172.21.15.154:0/3882384371 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.655+0000 7faa1ffff700 1 --2- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2013d210 0x7faa20133770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa1f7fe700 1 -- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa201350d0 msgr2=0x7faa20133230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa1f7fe700 1 --2- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa201350d0 0x7faa20133230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa1f7fe700 1 -- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2013d210 msgr2=0x7faa20133770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa1f7fe700 1 --2- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2013d210 0x7faa20133770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa1f7fe700 1 -- 172.21.15.154:0/3882384371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa18009b30 con 0x7faa2006a770 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa1f7fe700 1 --2- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa2006a770 0x7faa20132cf0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7faa10000f60 tx=0x7faa1000c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa07fff700 1 -- 172.21.15.154:0/3882384371 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa100052d0 con 0x7faa2006a770 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa07fff700 1 -- 172.21.15.154:0/3882384371 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa10005430 con 0x7faa2006a770 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa07fff700 1 -- 172.21.15.154:0/3882384371 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa100038c0 con 0x7faa2006a770 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa25e48700 1 -- 172.21.15.154:0/3882384371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa201396d0 con 0x7faa2006a770 2023-09-30T22:28:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.656+0000 7faa25e48700 1 -- 172.21.15.154:0/3882384371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa20139c70 con 0x7faa2006a770 2023-09-30T22:28:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.657+0000 7faa07fff700 1 -- 172.21.15.154:0/3882384371 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa10003a20 con 0x7faa2006a770 2023-09-30T22:28:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.658+0000 7faa07fff700 1 -- 172.21.15.154:0/3882384371 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa1003e960 con 0x7faa2006a770 2023-09-30T22:28:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.658+0000 7faa25e48700 1 -- 172.21.15.154:0/3882384371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa201398f0 con 0x7faa2006a770 2023-09-30T22:28:40.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.667+0000 7faa07fff700 1 -- 172.21.15.154:0/3882384371 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa201398f0 con 0x7faa2006a770 2023-09-30T22:28:40.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.711+0000 7f478266f700 1 Processor -- start 2023-09-30T22:28:40.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.711+0000 7f478266f700 1 -- start start 2023-09-30T22:28:40.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f478266f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c136960 0x7f477c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f478266f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f477c139280 0x7f477c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f478266f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c06b2d0 con 0x7f477c133ad0 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f478266f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c1345b0 con 0x7f477c139280 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f478266f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c133610 con 0x7f477c136960 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f477b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c136960 0x7f477c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f477b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c136960 0x7f477c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53884/0 (socket says 172.21.15.154:53884) 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f477b7fe700 1 -- 172.21.15.154:0/2988140179 learned_addr learned my addr 172.21.15.154:0/2988140179 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f4780c0c700 1 --2- 172.21.15.154:0/2988140179 >> v2:172.21.15.154:3300/0 conn(0x7f477c139280 0x7f477c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f477b7fe700 1 -- 172.21.15.154:0/2988140179 >> v2:172.21.15.154:3300/0 conn(0x7f477c139280 msgr2=0x7f477c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f477b7fe700 1 --2- 172.21.15.154:0/2988140179 >> v2:172.21.15.154:3300/0 conn(0x7f477c139280 0x7f477c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f477b7fe700 1 -- 172.21.15.154:0/2988140179 >> v1:172.21.15.154:6789/0 conn(0x7f477c133ad0 legacy=0x7f477c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f477b7fe700 1 -- 172.21.15.154:0/2988140179 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c09a500 con 0x7f477c136960 2023-09-30T22:28:40.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.712+0000 7f477b7fe700 1 --2- 172.21.15.154:0/2988140179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c136960 0x7f477c138d40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4770009920 tx=0x7f4770009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4708beda025b104 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f477affd700 1 -- 172.21.15.154:0/2988140179 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770011830 con 0x7f477c136960 2023-09-30T22:28:40.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f477affd700 1 -- 172.21.15.154:0/2988140179 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4770011990 con 0x7f477c136960 2023-09-30T22:28:40.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f477affd700 1 -- 172.21.15.154:0/2988140179 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770011d20 con 0x7f477c136960 2023-09-30T22:28:40.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f478266f700 1 -- 172.21.15.154:0/2988140179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c136960 msgr2=0x7f477c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f478266f700 1 --2- 172.21.15.154:0/2988140179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c136960 0x7f477c138d40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4770009920 tx=0x7f4770009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:40.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f478266f700 1 -- 172.21.15.154:0/2988140179 shutdown_connections 2023-09-30T22:28:40.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f478266f700 1 --2- 172.21.15.154:0/2988140179 >> v2:172.21.15.154:3300/0 conn(0x7f477c139280 0x7f477c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f478266f700 1 --2- 172.21.15.154:0/2988140179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c136960 0x7f477c138d40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f478266f700 1 -- 172.21.15.154:0/2988140179 >> 172.21.15.154:0/2988140179 conn(0x7f477c099c40 msgr2=0x7f477c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f478266f700 1 -- 172.21.15.154:0/2988140179 shutdown_connections 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.713+0000 7f478266f700 1 -- 172.21.15.154:0/2988140179 wait complete. 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.714+0000 7f478266f700 1 Processor -- start 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.714+0000 7f478266f700 1 -- start start 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f478266f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c133ad0 0x7f477c1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f478266f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f477c136960 0x7f477c1c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f478266f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c139280 0x7f477c1c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f478266f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c06e900 con 0x7f477c139280 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f478266f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c138ee0 con 0x7f477c133ad0 2023-09-30T22:28:40.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f478266f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f477c09f390 con 0x7f477c136960 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f4780c0c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c139280 0x7f477c1c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f477b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f477c136960 0x7f477c1c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f4780c0c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c139280 0x7f477c1c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46152/0 (socket says 172.21.15.154:46152) 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f4780c0c700 1 -- 172.21.15.154:0/1800584430 learned_addr learned my addr 172.21.15.154:0/1800584430 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f477bfff700 1 --2- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c133ad0 0x7f477c1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f4780c0c700 1 -- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f477c136960 msgr2=0x7f477c1c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f4780c0c700 1 --2- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f477c136960 0x7f477c1c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f4780c0c700 1 -- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c133ad0 msgr2=0x7f477c1c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f4780c0c700 1 --2- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c133ad0 0x7f477c1c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f4780c0c700 1 -- 172.21.15.154:0/1800584430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770009550 con 0x7f477c139280 2023-09-30T22:28:40.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f477bfff700 1 --2- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c133ad0 0x7f477c1c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.715+0000 7f4780c0c700 1 --2- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c139280 0x7f477c1c8ff0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f477400ef90 tx=0x7f477400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.716+0000 7f4778ff9700 1 -- 172.21.15.154:0/1800584430 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477400cd40 con 0x7f477c139280 2023-09-30T22:28:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.716+0000 7f4778ff9700 1 -- 172.21.15.154:0/1800584430 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477400f040 con 0x7f477c139280 2023-09-30T22:28:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.716+0000 7f4778ff9700 1 -- 172.21.15.154:0/1800584430 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477400cea0 con 0x7f477c139280 2023-09-30T22:28:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.716+0000 7f478266f700 1 -- 172.21.15.154:0/1800584430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c06f010 con 0x7f477c139280 2023-09-30T22:28:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.716+0000 7f478266f700 1 -- 172.21.15.154:0/1800584430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c070730 con 0x7f477c139280 2023-09-30T22:28:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.717+0000 7f4778ff9700 1 -- 172.21.15.154:0/1800584430 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47740146c0 con 0x7f477c139280 2023-09-30T22:28:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.717+0000 7f4778ff9700 1 -- 172.21.15.154:0/1800584430 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4774040310 con 0x7f477c139280 2023-09-30T22:28:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.717+0000 7f478266f700 1 -- 172.21.15.154:0/1800584430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c04f2a0 con 0x7f477c139280 2023-09-30T22:28:40.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.726+0000 7f4778ff9700 1 -- 172.21.15.154:0/1800584430 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4774007510 con 0x7f477c139280 2023-09-30T22:28:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.816+0000 7f5b23ac0700 1 Processor -- start 2023-09-30T22:28:40.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.816+0000 7f5b23ac0700 1 -- start start 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b23ac0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 0x7f5b1c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b23ac0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b1c09e170 0x7f5b1c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b23ac0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c09aaa0 con 0x7f5b1c130ce0 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b23ac0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c09f870 con 0x7f5b1c09e170 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b23ac0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c09b360 con 0x7f5b1c09d860 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b2105b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b1c09e170 0x7f5b1c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b2185c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 0x7f5b1c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b2105b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b1c09e170 0x7f5b1c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46166/0 (socket says 172.21.15.154:46166) 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b2185c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 0x7f5b1c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53896/0 (socket says 172.21.15.154:53896) 2023-09-30T22:28:40.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b2105b700 1 -- 172.21.15.154:0/256536705 learned_addr learned my addr 172.21.15.154:0/256536705 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b2105b700 1 -- 172.21.15.154:0/256536705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 msgr2=0x7f5b1c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.817+0000 7f5b2105b700 1 --2- 172.21.15.154:0/256536705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 0x7f5b1c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.818+0000 7f5b2105b700 1 -- 172.21.15.154:0/256536705 >> v1:172.21.15.154:6789/0 conn(0x7f5b1c130ce0 legacy=0x7f5b1c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.818+0000 7f5b2105b700 1 -- 172.21.15.154:0/256536705 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c09b620 con 0x7f5b1c09e170 2023-09-30T22:28:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.818+0000 7f5b2105b700 1 --2- 172.21.15.154:0/256536705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 0x7f5b1c1307a0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0098f0 tx=0x7f5b0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c6ab155cfa3347 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.818+0000 7f5b2085a700 1 -- 172.21.15.154:0/256536705 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c011830 con 0x7f5b1c09e170 2023-09-30T22:28:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.818+0000 7f5b2085a700 1 -- 172.21.15.154:0/256536705 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c011990 con 0x7f5b1c09e170 2023-09-30T22:28:40.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.818+0000 7f5b2085a700 1 -- 172.21.15.154:0/256536705 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c011d20 con 0x7f5b1c09e170 2023-09-30T22:28:40.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.818+0000 7f5b23ac0700 1 -- 172.21.15.154:0/256536705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 msgr2=0x7f5b1c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.819+0000 7f5b23ac0700 1 --2- 172.21.15.154:0/256536705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 0x7f5b1c1307a0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0098f0 tx=0x7f5b0c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.819+0000 7f5b23ac0700 1 -- 172.21.15.154:0/256536705 shutdown_connections 2023-09-30T22:28:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.819+0000 7f5b23ac0700 1 --2- 172.21.15.154:0/256536705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 0x7f5b1c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.819+0000 7f5b23ac0700 1 --2- 172.21.15.154:0/256536705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 0x7f5b1c1307a0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.819+0000 7f5b23ac0700 1 -- 172.21.15.154:0/256536705 >> 172.21.15.154:0/256536705 conn(0x7f5b1c099c40 msgr2=0x7f5b1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.819+0000 7f5b23ac0700 1 -- 172.21.15.154:0/256536705 shutdown_connections 2023-09-30T22:28:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.819+0000 7f5b23ac0700 1 -- 172.21.15.154:0/256536705 wait complete. 2023-09-30T22:28:40.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b23ac0700 1 Processor -- start 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b23ac0700 1 -- start start 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b23ac0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 0x7f5b1c1c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b23ac0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 0x7f5b1c1c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b23ac0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b1c130ce0 0x7f5b1c1c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b23ac0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c138a80 con 0x7f5b1c09e170 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b23ac0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c1196d0 con 0x7f5b1c09d860 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b23ac0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c138f30 con 0x7f5b1c130ce0 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b2105b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 0x7f5b1c1c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b2105b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 0x7f5b1c1c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46174/0 (socket says 172.21.15.154:46174) 2023-09-30T22:28:40.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b2105b700 1 -- 172.21.15.154:0/4038926840 learned_addr learned my addr 172.21.15.154:0/4038926840 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.820+0000 7f5b2185c700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 0x7f5b1c1c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b2205d700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b1c130ce0 0x7f5b1c1c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b2105b700 1 -- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b1c130ce0 msgr2=0x7f5b1c1c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b2105b700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b1c130ce0 0x7f5b1c1c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b2105b700 1 -- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 msgr2=0x7f5b1c1c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b2105b700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 0x7f5b1c1c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b2105b700 1 -- 172.21.15.154:0/4038926840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c009550 con 0x7f5b1c09e170 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b2205d700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b1c130ce0 0x7f5b1c1c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b2105b700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 0x7f5b1c1c6640 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000c00 tx=0x7f5b0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b127fc700 1 -- 172.21.15.154:0/4038926840 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c004480 con 0x7f5b1c09e170 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b127fc700 1 -- 172.21.15.154:0/4038926840 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c01f070 con 0x7f5b1c09e170 2023-09-30T22:28:40.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b23ac0700 1 -- 172.21.15.154:0/4038926840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c137300 con 0x7f5b1c09e170 2023-09-30T22:28:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b127fc700 1 -- 172.21.15.154:0/4038926840 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0038c0 con 0x7f5b1c09e170 2023-09-30T22:28:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.821+0000 7f5b23ac0700 1 -- 172.21.15.154:0/4038926840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c09c8b0 con 0x7f5b1c09e170 2023-09-30T22:28:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.822+0000 7f5b127fc700 1 -- 172.21.15.154:0/4038926840 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b0c021030 con 0x7f5b1c09e170 2023-09-30T22:28:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.822+0000 7f5b23ac0700 1 -- 172.21.15.154:0/4038926840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c04f2a0 con 0x7f5b1c09e170 2023-09-30T22:28:40.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.822+0000 7f5b127fc700 1 -- 172.21.15.154:0/4038926840 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b0c040c30 con 0x7f5b1c09e170 2023-09-30T22:28:40.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.831+0000 7f5b127fc700 1 -- 172.21.15.154:0/4038926840 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b0c042e60 con 0x7f5b1c09e170 2023-09-30T22:28:40.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.832+0000 7f29e6233700 1 -- 172.21.15.154:0/1382179725 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29e0120da0 con 0x7f29e009f180 2023-09-30T22:28:40.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.832+0000 7f29c7fff700 1 -- 172.21.15.154:0/1382179725 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29d4015070 con 0x7f29e009f180 2023-09-30T22:28:40.833 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.834+0000 7f29e6233700 1 -- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 msgr2=0x7f29e011f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.834+0000 7f29e6233700 1 --2- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e011f720 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f29d4016000 tx=0x7f29d4004750 comp rx=0 tx=0).stop 2023-09-30T22:28:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.834+0000 7f29e6233700 1 -- 172.21.15.154:0/1382179725 shutdown_connections 2023-09-30T22:28:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.834+0000 7f29e6233700 1 --2- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e0131d70 0x7f29e011fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.834+0000 7f29e6233700 1 --2- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29e009e870 0x7f29e011f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.834+0000 7f29e6233700 1 --2- 172.21.15.154:0/1382179725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29e009f180 0x7f29e011f720 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.834+0000 7f29e6233700 1 -- 172.21.15.154:0/1382179725 >> 172.21.15.154:0/1382179725 conn(0x7f29e00a4430 msgr2=0x7f29e009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.835+0000 7f29e6233700 1 -- 172.21.15.154:0/1382179725 shutdown_connections 2023-09-30T22:28:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.837+0000 7f29e6233700 1 -- 172.21.15.154:0/1382179725 wait complete. 2023-09-30T22:28:40.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:40.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.922+0000 7f478266f700 1 -- 172.21.15.154:0/1800584430 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f477c09f0f0 con 0x7f477c139280 2023-09-30T22:28:40.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.923+0000 7f4778ff9700 1 -- 172.21.15.154:0/1800584430 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f477402c090 con 0x7f477c139280 2023-09-30T22:28:40.924 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:40.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.925+0000 7f478266f700 1 -- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c139280 msgr2=0x7f477c1c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.925+0000 7f478266f700 1 --2- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c139280 0x7f477c1c8ff0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f477400ef90 tx=0x7f477400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.925+0000 7f478266f700 1 -- 172.21.15.154:0/1800584430 shutdown_connections 2023-09-30T22:28:40.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.925+0000 7f478266f700 1 --2- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f477c139280 0x7f477c1c8ff0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.925+0000 7f478266f700 1 --2- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f477c133ad0 0x7f477c1c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.925+0000 7f478266f700 1 --2- 172.21.15.154:0/1800584430 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f477c136960 0x7f477c1c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.925+0000 7f478266f700 1 -- 172.21.15.154:0/1800584430 >> 172.21.15.154:0/1800584430 conn(0x7f477c099c40 msgr2=0x7f477c131550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.925+0000 7f478266f700 1 -- 172.21.15.154:0/1800584430 shutdown_connections 2023-09-30T22:28:40.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.925+0000 7f478266f700 1 -- 172.21.15.154:0/1800584430 wait complete. 2023-09-30T22:28:40.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:40.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.953+0000 7faa25e48700 1 -- 172.21.15.154:0/3882384371 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa201398f0 con 0x7faa2006a770 2023-09-30T22:28:40.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.954+0000 7faa07fff700 1 -- 172.21.15.154:0/3882384371 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa201398f0 con 0x7faa2006a770 2023-09-30T22:28:40.955 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.956+0000 7faa25e48700 1 -- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa2006a770 msgr2=0x7faa20132cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.956+0000 7faa25e48700 1 --2- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa2006a770 0x7faa20132cf0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7faa10000f60 tx=0x7faa1000c6e0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.956+0000 7faa25e48700 1 -- 172.21.15.154:0/3882384371 shutdown_connections 2023-09-30T22:28:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.956+0000 7faa25e48700 1 --2- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa2013d210 0x7faa20133770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.956+0000 7faa25e48700 1 --2- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faa2006a770 0x7faa20132cf0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.956+0000 7faa25e48700 1 --2- 172.21.15.154:0/3882384371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa201350d0 0x7faa20133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.956+0000 7faa25e48700 1 -- 172.21.15.154:0/3882384371 >> 172.21.15.154:0/3882384371 conn(0x7faa20099c40 msgr2=0x7faa200a11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:40.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.956+0000 7faa25e48700 1 -- 172.21.15.154:0/3882384371 shutdown_connections 2023-09-30T22:28:40.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:40.956+0000 7faa25e48700 1 -- 172.21.15.154:0/3882384371 wait complete. 2023-09-30T22:28:40.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:41.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.040+0000 7f5b23ac0700 1 -- 172.21.15.154:0/4038926840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b1c06c3b0 con 0x7f5b1c09e170 2023-09-30T22:28:41.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.040+0000 7f5b127fc700 1 -- 172.21.15.154:0/4038926840 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b0c015070 con 0x7f5b1c09e170 2023-09-30T22:28:41.042 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:41.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.042+0000 7f5b23ac0700 1 -- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 msgr2=0x7f5b1c1c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.042+0000 7f5b23ac0700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 0x7f5b1c1c6640 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000c00 tx=0x7f5b0c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:41.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.042+0000 7f5b23ac0700 1 -- 172.21.15.154:0/4038926840 shutdown_connections 2023-09-30T22:28:41.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.042+0000 7f5b23ac0700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5b1c130ce0 0x7f5b1c1c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.042+0000 7f5b23ac0700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b1c09d860 0x7f5b1c1c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.042+0000 7f5b23ac0700 1 --2- 172.21.15.154:0/4038926840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b1c09e170 0x7f5b1c1c6640 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.042+0000 7f5b23ac0700 1 -- 172.21.15.154:0/4038926840 >> 172.21.15.154:0/4038926840 conn(0x7f5b1c099c40 msgr2=0x7f5b1c139670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:41.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.042+0000 7f5b23ac0700 1 -- 172.21.15.154:0/4038926840 shutdown_connections 2023-09-30T22:28:41.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.042+0000 7f5b23ac0700 1 -- 172.21.15.154:0/4038926840 wait complete. 2023-09-30T22:28:41.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:41.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:41.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:41.970 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:41.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.992+0000 7ff664919700 1 Processor -- start 2023-09-30T22:28:41.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.992+0000 7ff664919700 1 -- start start 2023-09-30T22:28:41.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff664919700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff660133b80 0x7ff660133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:41.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff664919700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff6600a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:41.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff664919700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66009aa00 con 0x7ff6600a0e20 2023-09-30T22:28:41.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff664919700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66009a080 con 0x7ff660133b80 2023-09-30T22:28:41.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff664919700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff660133750 con 0x7ff660099a60 2023-09-30T22:28:41.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff65dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff6600a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:41.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff65e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff660133b80 0x7ff660133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:41.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff65e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff660133b80 0x7ff660133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46184/0 (socket says 172.21.15.154:46184) 2023-09-30T22:28:41.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff65dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff6600a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39838/0 (socket says 172.21.15.154:39838) 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.993+0000 7ff65e59c700 1 -- 172.21.15.154:0/4210740587 learned_addr learned my addr 172.21.15.154:0/4210740587 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65dd9b700 1 -- 172.21.15.154:0/4210740587 >> v2:172.21.15.154:3300/0 conn(0x7ff660133b80 msgr2=0x7ff660133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65dd9b700 1 --2- 172.21.15.154:0/4210740587 >> v2:172.21.15.154:3300/0 conn(0x7ff660133b80 0x7ff660133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65dd9b700 1 -- 172.21.15.154:0/4210740587 >> v1:172.21.15.154:6789/0 conn(0x7ff6600a0e20 legacy=0x7ff66013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65d59a700 1 -- 172.21.15.154:0/4210740587 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534008301 0 0) 0x7ff66009aa00 con 0x7ff6600a0e20 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65dd9b700 1 -- 172.21.15.154:0/4210740587 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66009a760 con 0x7ff660099a60 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65e59c700 1 --2- 172.21.15.154:0/4210740587 >> v2:172.21.15.154:3300/0 conn(0x7ff660133b80 0x7ff660133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65dd9b700 1 --2- 172.21.15.154:0/4210740587 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff6600a08e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff654009840 tx=0x7ff654009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=841fa555e2c2de48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65d59a700 1 -- 172.21.15.154:0/4210740587 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654011830 con 0x7ff660099a60 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65d59a700 1 -- 172.21.15.154:0/4210740587 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654011990 con 0x7ff660099a60 2023-09-30T22:28:41.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.994+0000 7ff65d59a700 1 -- 172.21.15.154:0/4210740587 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654011d20 con 0x7ff660099a60 2023-09-30T22:28:41.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.995+0000 7ff664919700 1 -- 172.21.15.154:0/4210740587 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 msgr2=0x7ff6600a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.995+0000 7ff664919700 1 --2- 172.21.15.154:0/4210740587 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff6600a08e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff654009840 tx=0x7ff654009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.995+0000 7ff664919700 1 -- 172.21.15.154:0/4210740587 shutdown_connections 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.995+0000 7ff664919700 1 --2- 172.21.15.154:0/4210740587 >> v2:172.21.15.154:3300/0 conn(0x7ff660133b80 0x7ff660133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.995+0000 7ff664919700 1 --2- 172.21.15.154:0/4210740587 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff6600a08e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.995+0000 7ff664919700 1 -- 172.21.15.154:0/4210740587 >> 172.21.15.154:0/4210740587 conn(0x7ff6600a2980 msgr2=0x7ff6600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.995+0000 7ff664919700 1 -- 172.21.15.154:0/4210740587 shutdown_connections 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.995+0000 7ff664919700 1 -- 172.21.15.154:0/4210740587 wait complete. 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.996+0000 7ff664919700 1 Processor -- start 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.996+0000 7ff664919700 1 -- start start 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff664919700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff66011a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:41.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff664919700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600a0e20 0x7ff66011ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff664919700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff660133b80 0x7ff66011b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff664919700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66011dad0 con 0x7ff6600a0e20 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff664919700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66011c3f0 con 0x7ff660133b80 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff664919700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff66011df80 con 0x7ff660099a60 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff66011a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff66011a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39844/0 (socket says 172.21.15.154:39844) 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65e59c700 1 -- 172.21.15.154:0/3930224043 learned_addr learned my addr 172.21.15.154:0/3930224043 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65dd9b700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600a0e20 0x7ff66011ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65ed9d700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff660133b80 0x7ff66011b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65e59c700 1 -- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff660133b80 msgr2=0x7ff66011b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65e59c700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff660133b80 0x7ff66011b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65e59c700 1 -- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600a0e20 msgr2=0x7ff66011ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65e59c700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600a0e20 0x7ff66011ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65e59c700 1 -- 172.21.15.154:0/3930224043 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009500 con 0x7ff660099a60 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.997+0000 7ff65dd9b700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600a0e20 0x7ff66011ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.998+0000 7ff65e59c700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff66011a740 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff65000ebe0 tx=0x7ff65000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.998+0000 7ff64effd700 1 -- 172.21.15.154:0/3930224043 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650005a20 con 0x7ff660099a60 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.998+0000 7ff64effd700 1 -- 172.21.15.154:0/3930224043 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650005b80 con 0x7ff660099a60 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.998+0000 7ff664919700 1 -- 172.21.15.154:0/3930224043 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6540094a0 con 0x7ff660099a60 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.998+0000 7ff64effd700 1 -- 172.21.15.154:0/3930224043 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000c850 con 0x7ff660099a60 2023-09-30T22:28:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.998+0000 7ff664919700 1 -- 172.21.15.154:0/3930224043 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66011d5a0 con 0x7ff660099a60 2023-09-30T22:28:42.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.999+0000 7ff64effd700 1 -- 172.21.15.154:0/3930224043 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff65000c9b0 con 0x7ff660099a60 2023-09-30T22:28:42.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.999+0000 7ff64effd700 1 -- 172.21.15.154:0/3930224043 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff65003f970 con 0x7ff660099a60 2023-09-30T22:28:42.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:41.999+0000 7ff664919700 1 -- 172.21.15.154:0/3930224043 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66009e9b0 con 0x7ff660099a60 2023-09-30T22:28:42.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.004+0000 7ff64effd700 1 -- 172.21.15.154:0/3930224043 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff650006030 con 0x7ff660099a60 2023-09-30T22:28:42.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:42.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.074+0000 7ff2b7434700 1 Processor -- start 2023-09-30T22:28:42.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.074+0000 7ff2b7434700 1 -- start start 2023-09-30T22:28:42.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.075+0000 7ff2b7434700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff2b0099a60 0x7ff2b01388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.075+0000 7ff2b7434700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b013b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.075+0000 7ff2b7434700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b009aa00 con 0x7ff2b0133b80 2023-09-30T22:28:42.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.075+0000 7ff2b7434700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b009a080 con 0x7ff2b0099a60 2023-09-30T22:28:42.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.075+0000 7ff2b7434700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0133750 con 0x7ff2b0138e30 2023-09-30T22:28:42.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.075+0000 7ff2b49cf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff2b0099a60 0x7ff2b01388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.075+0000 7ff2b49cf700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff2b0099a60 0x7ff2b01388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46208/0 (socket says 172.21.15.154:46208) 2023-09-30T22:28:42.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.075+0000 7ff2b49cf700 1 -- 172.21.15.154:0/3959826035 learned_addr learned my addr 172.21.15.154:0/3959826035 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:42.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.076+0000 7ff2b59d1700 1 --2- 172.21.15.154:0/3959826035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b013b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.076+0000 7ff2b49cf700 1 -- 172.21.15.154:0/3959826035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 msgr2=0x7ff2b013b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:42.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.076+0000 7ff2b49cf700 1 --2- 172.21.15.154:0/3959826035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b013b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.076+0000 7ff2b49cf700 1 -- 172.21.15.154:0/3959826035 >> v1:172.21.15.154:6789/0 conn(0x7ff2b0133b80 legacy=0x7ff2b0133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.076+0000 7ff2b49cf700 1 -- 172.21.15.154:0/3959826035 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b009a760 con 0x7ff2b0099a60 2023-09-30T22:28:42.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.076+0000 7ff2b49cf700 1 --2- 172.21.15.154:0/3959826035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 0x7ff2b01388f0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00098f0 tx=0x7ff2a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e56eaaf3f390c99 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.076+0000 7ff2a7fff700 1 -- 172.21.15.154:0/3959826035 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000b8a0 con 0x7ff2b0099a60 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.076+0000 7ff2a7fff700 1 -- 172.21.15.154:0/3959826035 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a000ba00 con 0x7ff2b0099a60 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.076+0000 7ff2a7fff700 1 -- 172.21.15.154:0/3959826035 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000bd90 con 0x7ff2b0099a60 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.077+0000 7ff2b7434700 1 -- 172.21.15.154:0/3959826035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 msgr2=0x7ff2b01388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.077+0000 7ff2b7434700 1 --2- 172.21.15.154:0/3959826035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 0x7ff2b01388f0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00098f0 tx=0x7ff2a0009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.077+0000 7ff2b7434700 1 -- 172.21.15.154:0/3959826035 shutdown_connections 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.077+0000 7ff2b7434700 1 --2- 172.21.15.154:0/3959826035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b013b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.077+0000 7ff2b7434700 1 --2- 172.21.15.154:0/3959826035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 0x7ff2b01388f0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.077+0000 7ff2b7434700 1 -- 172.21.15.154:0/3959826035 >> 172.21.15.154:0/3959826035 conn(0x7ff2b00a2980 msgr2=0x7ff2b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.077+0000 7ff2b7434700 1 -- 172.21.15.154:0/3959826035 shutdown_connections 2023-09-30T22:28:42.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.077+0000 7ff2b7434700 1 -- 172.21.15.154:0/3959826035 wait complete. 2023-09-30T22:28:42.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.078+0000 7ff2b7434700 1 Processor -- start 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.078+0000 7ff2b7434700 1 -- start start 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b7434700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 0x7ff2b0118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b7434700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2b0133b80 0x7ff2b0119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b7434700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b0119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b7434700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b011a260 con 0x7ff2b0099a60 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b7434700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b011b0f0 con 0x7ff2b0138e30 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b7434700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b011b690 con 0x7ff2b0133b80 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b59d1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b0119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b59d1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b0119870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53932/0 (socket says 172.21.15.154:53932) 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b59d1700 1 -- 172.21.15.154:0/2126083193 learned_addr learned my addr 172.21.15.154:0/2126083193 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:42.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.079+0000 7ff2b51d0700 1 --2- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 0x7ff2b0118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2b51d0700 1 -- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2b0133b80 msgr2=0x7ff2b0119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2b51d0700 1 --2- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2b0133b80 0x7ff2b0119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2b51d0700 1 -- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 msgr2=0x7ff2b0119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2b51d0700 1 --2- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b0119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2b51d0700 1 -- 172.21.15.154:0/2126083193 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0009550 con 0x7ff2b0099a60 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2b59d1700 1 --2- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b0119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2b51d0700 1 --2- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 0x7ff2b0118df0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c4d0 tx=0x7ff2ac00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2a5ffb700 1 -- 172.21.15.154:0/2126083193 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0054e0 con 0x7ff2b0099a60 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2a5ffb700 1 -- 172.21.15.154:0/2126083193 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac003680 con 0x7ff2b0099a60 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2a5ffb700 1 -- 172.21.15.154:0/2126083193 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac003a10 con 0x7ff2b0099a60 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2b7434700 1 -- 172.21.15.154:0/2126083193 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b011a9d0 con 0x7ff2b0099a60 2023-09-30T22:28:42.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.080+0000 7ff2b7434700 1 -- 172.21.15.154:0/2126083193 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b011b3b0 con 0x7ff2b0099a60 2023-09-30T22:28:42.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.081+0000 7ff2a5ffb700 1 -- 172.21.15.154:0/2126083193 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2ac003b70 con 0x7ff2b0099a60 2023-09-30T22:28:42.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.081+0000 7ff2a5ffb700 1 -- 172.21.15.154:0/2126083193 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2ac03ea50 con 0x7ff2b0099a60 2023-09-30T22:28:42.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.082+0000 7ff2b7434700 1 -- 172.21.15.154:0/2126083193 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b004f2a0 con 0x7ff2b0099a60 2023-09-30T22:28:42.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.087+0000 7ff2a5ffb700 1 -- 172.21.15.154:0/2126083193 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2ac017080 con 0x7ff2b0099a60 2023-09-30T22:28:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.124+0000 7f687086d700 1 Processor -- start 2023-09-30T22:28:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.124+0000 7f687086d700 1 -- start start 2023-09-30T22:28:42.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f687086d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09d860 0x7f686c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f687086d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f687086d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c09aaa0 con 0x7f686c130ce0 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f687086d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c09f870 con 0x7f686c09d860 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f687086d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f686c09b360 con 0x7f686c09e170 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f6869d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f6869d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39850/0 (socket says 172.21.15.154:39850) 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f6869d9b700 1 -- 172.21.15.154:0/3333901569 learned_addr learned my addr 172.21.15.154:0/3333901569 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f6869d9b700 1 -- 172.21.15.154:0/3333901569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09d860 msgr2=0x7f686c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f6869d9b700 1 --2- 172.21.15.154:0/3333901569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09d860 0x7f686c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f6869d9b700 1 -- 172.21.15.154:0/3333901569 >> v1:172.21.15.154:6789/0 conn(0x7f686c130ce0 legacy=0x7f686c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.125+0000 7f6869d9b700 1 -- 172.21.15.154:0/3333901569 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c09b620 con 0x7f686c09e170 2023-09-30T22:28:42.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.126+0000 7f6869d9b700 1 --2- 172.21.15.154:0/3333901569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c1307a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6860009920 tx=0x7f6860009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8746e4746167bbd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.126+0000 7f686959a700 1 -- 172.21.15.154:0/3333901569 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000ba60 con 0x7f686c09e170 2023-09-30T22:28:42.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.126+0000 7f686959a700 1 -- 172.21.15.154:0/3333901569 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000bbc0 con 0x7f686c09e170 2023-09-30T22:28:42.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.126+0000 7f686959a700 1 -- 172.21.15.154:0/3333901569 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860009e70 con 0x7f686c09e170 2023-09-30T22:28:42.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.126+0000 7f687086d700 1 -- 172.21.15.154:0/3333901569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 msgr2=0x7f686c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.126+0000 7f687086d700 1 --2- 172.21.15.154:0/3333901569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c1307a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6860009920 tx=0x7f6860009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:42.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.126+0000 7f687086d700 1 -- 172.21.15.154:0/3333901569 shutdown_connections 2023-09-30T22:28:42.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.126+0000 7f687086d700 1 --2- 172.21.15.154:0/3333901569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c09d860 0x7f686c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.126+0000 7f687086d700 1 --2- 172.21.15.154:0/3333901569 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c1307a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.127+0000 7f687086d700 1 -- 172.21.15.154:0/3333901569 >> 172.21.15.154:0/3333901569 conn(0x7f686c099c40 msgr2=0x7f686c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.127+0000 7f687086d700 1 -- 172.21.15.154:0/3333901569 shutdown_connections 2023-09-30T22:28:42.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.127+0000 7f687086d700 1 -- 172.21.15.154:0/3333901569 wait complete. 2023-09-30T22:28:42.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.128+0000 7f687086d700 1 Processor -- start 2023-09-30T22:28:42.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.128+0000 7f687086d700 1 -- start start 2023-09-30T22:28:42.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f687086d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09d860 0x7f686c138420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f687086d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f687086d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c130ce0 0x7f686c1c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f687086d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c136b60 con 0x7f686c09d860 2023-09-30T22:28:42.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f687086d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c13b5c0 con 0x7f686c130ce0 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f687086d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f686c138190 con 0x7f686c09e170 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f686a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09d860 0x7f686c138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f686a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09d860 0x7f686c138420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46224/0 (socket says 172.21.15.154:46224) 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f686a59c700 1 -- 172.21.15.154:0/1846378209 learned_addr learned my addr 172.21.15.154:0/1846378209 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f6869d9b700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f686ad9d700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c130ce0 0x7f686c1c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f6869d9b700 1 -- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c130ce0 msgr2=0x7f686c1c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f6869d9b700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c130ce0 0x7f686c1c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f6869d9b700 1 -- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09d860 msgr2=0x7f686c138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f6869d9b700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09d860 0x7f686c138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f6869d9b700 1 -- 172.21.15.154:0/1846378209 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860009550 con 0x7f686c09e170 2023-09-30T22:28:42.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.129+0000 7f686ad9d700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c130ce0 0x7f686c1c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.130+0000 7f6869d9b700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c138960 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6860016000 tx=0x7f6860004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.130+0000 7f685affd700 1 -- 172.21.15.154:0/1846378209 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860004300 con 0x7f686c09e170 2023-09-30T22:28:42.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.130+0000 7f685affd700 1 -- 172.21.15.154:0/1846378209 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686001f070 con 0x7f686c09e170 2023-09-30T22:28:42.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.130+0000 7f687086d700 1 -- 172.21.15.154:0/1846378209 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c0a23b0 con 0x7f686c09e170 2023-09-30T22:28:42.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.130+0000 7f685affd700 1 -- 172.21.15.154:0/1846378209 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68600036a0 con 0x7f686c09e170 2023-09-30T22:28:42.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.130+0000 7f687086d700 1 -- 172.21.15.154:0/1846378209 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c137890 con 0x7f686c09e170 2023-09-30T22:28:42.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.131+0000 7f685affd700 1 -- 172.21.15.154:0/1846378209 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6860021030 con 0x7f686c09e170 2023-09-30T22:28:42.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.131+0000 7f685affd700 1 -- 172.21.15.154:0/1846378209 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6860040880 con 0x7f686c09e170 2023-09-30T22:28:42.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.132+0000 7f687086d700 1 -- 172.21.15.154:0/1846378209 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c136ca0 con 0x7f686c09e170 2023-09-30T22:28:42.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.141+0000 7f685affd700 1 -- 172.21.15.154:0/1846378209 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68600199a0 con 0x7f686c09e170 2023-09-30T22:28:42.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.204+0000 7f68c26af700 1 Processor -- start 2023-09-30T22:28:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.204+0000 7f68c26af700 1 -- start start 2023-09-30T22:28:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.204+0000 7f68c26af700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68bc133ad0 0x7f68bc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68c26af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68c26af700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc06b2d0 con 0x7f68bc1309f0 2023-09-30T22:28:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68c26af700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc133610 con 0x7f68bc133ad0 2023-09-30T22:28:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68c26af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc09a500 con 0x7f68bc1300a0 2023-09-30T22:28:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68bb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68bb7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39876/0 (socket says 172.21.15.154:39876) 2023-09-30T22:28:42.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68bb7fe700 1 -- 172.21.15.154:0/1878158252 learned_addr learned my addr 172.21.15.154:0/1878158252 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:42.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68bbfff700 1 --2- 172.21.15.154:0/1878158252 >> v2:172.21.15.154:3300/0 conn(0x7f68bc133ad0 0x7f68bc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68bb7fe700 1 -- 172.21.15.154:0/1878158252 >> v2:172.21.15.154:3300/0 conn(0x7f68bc133ad0 msgr2=0x7f68bc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68bb7fe700 1 --2- 172.21.15.154:0/1878158252 >> v2:172.21.15.154:3300/0 conn(0x7f68bc133ad0 0x7f68bc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68bb7fe700 1 -- 172.21.15.154:0/1878158252 >> v1:172.21.15.154:6789/0 conn(0x7f68bc1309f0 legacy=0x7f68bc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68bb7fe700 1 -- 172.21.15.154:0/1878158252 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc1338b0 con 0x7f68bc1300a0 2023-09-30T22:28:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68bb7fe700 1 --2- 172.21.15.154:0/1878158252 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc1304b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f68b00098f0 tx=0x7f68b0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4502cc65e1685339 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.205+0000 7f68baffd700 1 -- 172.21.15.154:0/1878158252 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011830 con 0x7f68bc1300a0 2023-09-30T22:28:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68baffd700 1 -- 172.21.15.154:0/1878158252 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0011990 con 0x7f68bc1300a0 2023-09-30T22:28:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68baffd700 1 -- 172.21.15.154:0/1878158252 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011d20 con 0x7f68bc1300a0 2023-09-30T22:28:42.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68c26af700 1 -- 172.21.15.154:0/1878158252 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 msgr2=0x7f68bc1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68c26af700 1 --2- 172.21.15.154:0/1878158252 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc1304b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f68b00098f0 tx=0x7f68b0009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68c26af700 1 -- 172.21.15.154:0/1878158252 shutdown_connections 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68c26af700 1 --2- 172.21.15.154:0/1878158252 >> v2:172.21.15.154:3300/0 conn(0x7f68bc133ad0 0x7f68bc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68c26af700 1 --2- 172.21.15.154:0/1878158252 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc1304b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68c26af700 1 -- 172.21.15.154:0/1878158252 >> 172.21.15.154:0/1878158252 conn(0x7f68bc099c40 msgr2=0x7f68bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68c26af700 1 -- 172.21.15.154:0/1878158252 shutdown_connections 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.206+0000 7f68c26af700 1 -- 172.21.15.154:0/1878158252 wait complete. 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.207+0000 7f68c26af700 1 Processor -- start 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.207+0000 7f68c26af700 1 -- start start 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68c26af700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68c26af700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc1309f0 0x7f68bc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68c26af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68bc133ad0 0x7f68bc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68c26af700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc11f5b0 con 0x7f68bc1309f0 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68c26af700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc12fcc0 con 0x7f68bc133ad0 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68c26af700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc12dd00 con 0x7f68bc1300a0 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68bbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68bbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39892/0 (socket says 172.21.15.154:39892) 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68bbfff700 1 -- 172.21.15.154:0/1292975163 learned_addr learned my addr 172.21.15.154:0/1292975163 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68bb7fe700 1 --2- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc1309f0 0x7f68bc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68bbfff700 1 -- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68bc133ad0 msgr2=0x7f68bc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68bbfff700 1 --2- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68bc133ad0 0x7f68bc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.208+0000 7f68bbfff700 1 -- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc1309f0 msgr2=0x7f68bc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.209+0000 7f68bbfff700 1 --2- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc1309f0 0x7f68bc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.209+0000 7f68bbfff700 1 -- 172.21.15.154:0/1292975163 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b0009550 con 0x7f68bc1300a0 2023-09-30T22:28:42.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.209+0000 7f68bb7fe700 1 --2- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc1309f0 0x7f68bc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:42.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.209+0000 7f68bbfff700 1 --2- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc11da40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00e9e0 tx=0x7f68ac00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:42.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.209+0000 7f68b8ff9700 1 -- 172.21.15.154:0/1292975163 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac009710 con 0x7f68bc1300a0 2023-09-30T22:28:42.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.209+0000 7f68b8ff9700 1 -- 172.21.15.154:0/1292975163 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac00c850 con 0x7f68bc1300a0 2023-09-30T22:28:42.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.209+0000 7f68b8ff9700 1 -- 172.21.15.154:0/1292975163 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00cbc0 con 0x7f68bc1300a0 2023-09-30T22:28:42.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.210+0000 7f68c26af700 1 -- 172.21.15.154:0/1292975163 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc11fbf0 con 0x7f68bc1300a0 2023-09-30T22:28:42.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.210+0000 7f68c26af700 1 -- 172.21.15.154:0/1292975163 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc11feb0 con 0x7f68bc1300a0 2023-09-30T22:28:42.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.210+0000 7ff664919700 1 -- 172.21.15.154:0/3930224043 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff66004f2a0 con 0x7ff660099a60 2023-09-30T22:28:42.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.211+0000 7ff64effd700 1 -- 172.21.15.154:0/3930224043 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff65002a090 con 0x7ff660099a60 2023-09-30T22:28:42.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.211+0000 7f68c26af700 1 -- 172.21.15.154:0/1292975163 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc072720 con 0x7f68bc1300a0 2023-09-30T22:28:42.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.211+0000 7f68b8ff9700 1 -- 172.21.15.154:0/1292975163 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68ac00cd20 con 0x7f68bc1300a0 2023-09-30T22:28:42.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.211+0000 7f68b8ff9700 1 -- 172.21.15.154:0/1292975163 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68ac03f840 con 0x7f68bc1300a0 2023-09-30T22:28:42.215 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:42.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.214+0000 7ff664919700 1 -- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 msgr2=0x7ff66011a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.214+0000 7ff664919700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff66011a740 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff65000ebe0 tx=0x7ff65000eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.214+0000 7ff664919700 1 -- 172.21.15.154:0/3930224043 shutdown_connections 2023-09-30T22:28:42.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.214+0000 7ff664919700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff660133b80 0x7ff66011b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.214+0000 7ff664919700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff660099a60 0x7ff66011a740 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.214+0000 7ff664919700 1 --2- 172.21.15.154:0/3930224043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6600a0e20 0x7ff66011ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.214+0000 7ff664919700 1 -- 172.21.15.154:0/3930224043 >> 172.21.15.154:0/3930224043 conn(0x7ff6600a2980 msgr2=0x7ff66012f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.215+0000 7ff664919700 1 -- 172.21.15.154:0/3930224043 shutdown_connections 2023-09-30T22:28:42.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.216+0000 7f68b8ff9700 1 -- 172.21.15.154:0/1292975163 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68ac01be10 con 0x7f68bc1300a0 2023-09-30T22:28:42.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.218+0000 7ff664919700 1 -- 172.21.15.154:0/3930224043 wait complete. 2023-09-30T22:28:42.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:42.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.289+0000 7ff2b7434700 1 -- 172.21.15.154:0/2126083193 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff2b006bce0 con 0x7ff2b0099a60 2023-09-30T22:28:42.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.289+0000 7ff2a5ffb700 1 -- 172.21.15.154:0/2126083193 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2ac019b40 con 0x7ff2b0099a60 2023-09-30T22:28:42.291 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:42.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.291+0000 7ff2b7434700 1 -- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 msgr2=0x7ff2b0118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.291+0000 7ff2b7434700 1 --2- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 0x7ff2b0118df0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c4d0 tx=0x7ff2ac00c7e0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.291+0000 7ff2b7434700 1 -- 172.21.15.154:0/2126083193 shutdown_connections 2023-09-30T22:28:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.291+0000 7ff2b7434700 1 --2- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2b0138e30 0x7ff2b0119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.291+0000 7ff2b7434700 1 --2- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2b0099a60 0x7ff2b0118df0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.291+0000 7ff2b7434700 1 --2- 172.21.15.154:0/2126083193 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff2b0133b80 0x7ff2b0119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.291+0000 7ff2b7434700 1 -- 172.21.15.154:0/2126083193 >> 172.21.15.154:0/2126083193 conn(0x7ff2b00a2980 msgr2=0x7ff2b009b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.291+0000 7ff2b7434700 1 -- 172.21.15.154:0/2126083193 shutdown_connections 2023-09-30T22:28:42.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.291+0000 7ff2b7434700 1 -- 172.21.15.154:0/2126083193 wait complete. 2023-09-30T22:28:42.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:42.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.355+0000 7f687086d700 1 -- 172.21.15.154:0/1846378209 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f686c04f2a0 con 0x7f686c09e170 2023-09-30T22:28:42.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.356+0000 7f685affd700 1 -- 172.21.15.154:0/1846378209 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f686001b430 con 0x7f686c09e170 2023-09-30T22:28:42.357 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:42.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.358+0000 7f687086d700 1 -- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 msgr2=0x7f686c138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.358+0000 7f687086d700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c138960 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6860016000 tx=0x7f6860004750 comp rx=0 tx=0).stop 2023-09-30T22:28:42.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.358+0000 7f687086d700 1 -- 172.21.15.154:0/1846378209 shutdown_connections 2023-09-30T22:28:42.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.358+0000 7f687086d700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f686c130ce0 0x7f686c1c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.358+0000 7f687086d700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f686c09d860 0x7f686c138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.358+0000 7f687086d700 1 --2- 172.21.15.154:0/1846378209 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f686c09e170 0x7f686c138960 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.358+0000 7f687086d700 1 -- 172.21.15.154:0/1846378209 >> 172.21.15.154:0/1846378209 conn(0x7f686c099c40 msgr2=0x7f686c139830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.358+0000 7f687086d700 1 -- 172.21.15.154:0/1846378209 shutdown_connections 2023-09-30T22:28:42.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.358+0000 7f687086d700 1 -- 172.21.15.154:0/1846378209 wait complete. 2023-09-30T22:28:42.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:42.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.409+0000 7f68c26af700 1 -- 172.21.15.154:0/1292975163 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f68bc04f2a0 con 0x7f68bc1300a0 2023-09-30T22:28:42.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.410+0000 7f68b8ff9700 1 -- 172.21.15.154:0/1292975163 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68ac01b3b0 con 0x7f68bc1300a0 2023-09-30T22:28:42.411 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.412+0000 7f68c26af700 1 -- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 msgr2=0x7f68bc11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.412+0000 7f68c26af700 1 --2- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc11da40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00e9e0 tx=0x7f68ac00ecf0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.412+0000 7f68c26af700 1 -- 172.21.15.154:0/1292975163 shutdown_connections 2023-09-30T22:28:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.412+0000 7f68c26af700 1 --2- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68bc133ad0 0x7f68bc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.412+0000 7f68c26af700 1 --2- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f68bc1300a0 0x7f68bc11da40 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.412+0000 7f68c26af700 1 --2- 172.21.15.154:0/1292975163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc1309f0 0x7f68bc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.412+0000 7f68c26af700 1 -- 172.21.15.154:0/1292975163 >> 172.21.15.154:0/1292975163 conn(0x7f68bc099c40 msgr2=0x7f68bc0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.412+0000 7f68c26af700 1 -- 172.21.15.154:0/1292975163 shutdown_connections 2023-09-30T22:28:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:42.412+0000 7f68c26af700 1 -- 172.21.15.154:0/1292975163 wait complete. 2023-09-30T22:28:42.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:43.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:43.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:43.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.365+0000 7fa0aa361700 1 Processor -- start 2023-09-30T22:28:43.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.365+0000 7fa0aa361700 1 -- start start 2023-09-30T22:28:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0aa361700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa0a40a1550 0x7fa0a4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0aa361700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a4139200 0x7fa0a413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0aa361700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a409e9d0 con 0x7fa0a40a0a70 2023-09-30T22:28:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0aa361700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a409dc00 con 0x7fa0a40a1550 2023-09-30T22:28:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0aa361700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a409dec0 con 0x7fa0a4139200 2023-09-30T22:28:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0a88fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a4139200 0x7fa0a413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0a37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa0a40a1550 0x7fa0a4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0a37fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa0a40a1550 0x7fa0a4138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46250/0 (socket says 172.21.15.154:46250) 2023-09-30T22:28:43.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0a88fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a4139200 0x7fa0a413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39896/0 (socket says 172.21.15.154:39896) 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.366+0000 7fa0a37fe700 1 -- 172.21.15.154:0/2125962205 learned_addr learned my addr 172.21.15.154:0/2125962205 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0a37fe700 1 -- 172.21.15.154:0/2125962205 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a4139200 msgr2=0x7fa0a413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0a37fe700 1 --2- 172.21.15.154:0/2125962205 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a4139200 0x7fa0a413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0a37fe700 1 -- 172.21.15.154:0/2125962205 >> v1:172.21.15.154:6789/0 conn(0x7fa0a40a0a70 legacy=0x7fa0a40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0a37fe700 1 -- 172.21.15.154:0/2125962205 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a409e6a0 con 0x7fa0a40a1550 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0a88fe700 1 --2- 172.21.15.154:0/2125962205 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a4139200 0x7fa0a413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0a37fe700 1 --2- 172.21.15.154:0/2125962205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a40a1550 0x7fa0a4138cc0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fa0980098f0 tx=0x7fa098009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88a63ed0926ea2c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0a2ffd700 1 -- 172.21.15.154:0/2125962205 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098011830 con 0x7fa0a40a1550 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0a2ffd700 1 -- 172.21.15.154:0/2125962205 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa098011990 con 0x7fa0a40a1550 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0a2ffd700 1 -- 172.21.15.154:0/2125962205 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098011d20 con 0x7fa0a40a1550 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0aa361700 1 -- 172.21.15.154:0/2125962205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a40a1550 msgr2=0x7fa0a4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.367+0000 7fa0aa361700 1 --2- 172.21.15.154:0/2125962205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a40a1550 0x7fa0a4138cc0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fa0980098f0 tx=0x7fa098009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.368+0000 7fa0aa361700 1 -- 172.21.15.154:0/2125962205 shutdown_connections 2023-09-30T22:28:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.368+0000 7fa0aa361700 1 --2- 172.21.15.154:0/2125962205 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a4139200 0x7fa0a413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.368+0000 7fa0aa361700 1 --2- 172.21.15.154:0/2125962205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a40a1550 0x7fa0a4138cc0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.368+0000 7fa0aa361700 1 -- 172.21.15.154:0/2125962205 >> 172.21.15.154:0/2125962205 conn(0x7fa0a40a6610 msgr2=0x7fa0a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.368+0000 7fa0aa361700 1 -- 172.21.15.154:0/2125962205 shutdown_connections 2023-09-30T22:28:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.368+0000 7fa0aa361700 1 -- 172.21.15.154:0/2125962205 wait complete. 2023-09-30T22:28:43.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.368+0000 7fa0aa361700 1 Processor -- start 2023-09-30T22:28:43.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0aa361700 1 -- start start 2023-09-30T22:28:43.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0aa361700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a40a0a70 0x7fa0a411e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0aa361700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0a40a1550 0x7fa0a411ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0aa361700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4139200 0x7fa0a411f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0aa361700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4122070 con 0x7fa0a4139200 2023-09-30T22:28:43.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0aa361700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4120440 con 0x7fa0a40a1550 2023-09-30T22:28:43.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0aa361700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40a5290 con 0x7fa0a40a0a70 2023-09-30T22:28:43.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0a3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a40a0a70 0x7fa0a411e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0a37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0a40a1550 0x7fa0a411ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0a37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0a40a1550 0x7fa0a411ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53954/0 (socket says 172.21.15.154:53954) 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0a3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a40a0a70 0x7fa0a411e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39912/0 (socket says 172.21.15.154:39912) 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0a37fe700 1 -- 172.21.15.154:0/1227995011 learned_addr learned my addr 172.21.15.154:0/1227995011 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.369+0000 7fa0a88fe700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4139200 0x7fa0a411f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a37fe700 1 -- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a40a0a70 msgr2=0x7fa0a411e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a37fe700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a40a0a70 0x7fa0a411e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a37fe700 1 -- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4139200 msgr2=0x7fa0a411f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a37fe700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4139200 0x7fa0a411f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a37fe700 1 -- 172.21.15.154:0/1227995011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009a70 con 0x7fa0a40a1550 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a88fe700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4139200 0x7fa0a411f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a3fff700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a40a0a70 0x7fa0a411e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a37fe700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0a40a1550 0x7fa0a411ed70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa098000c00 tx=0x7fa098004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a0ff9700 1 -- 172.21.15.154:0/1227995011 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0980043c0 con 0x7fa0a40a1550 2023-09-30T22:28:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a0ff9700 1 -- 172.21.15.154:0/1227995011 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09801f070 con 0x7fa0a40a1550 2023-09-30T22:28:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0a0ff9700 1 -- 172.21.15.154:0/1227995011 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0980038c0 con 0x7fa0a40a1550 2023-09-30T22:28:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0aa361700 1 -- 172.21.15.154:0/1227995011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa098009550 con 0x7fa0a40a1550 2023-09-30T22:28:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.370+0000 7fa0aa361700 1 -- 172.21.15.154:0/1227995011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a4121db0 con 0x7fa0a40a1550 2023-09-30T22:28:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.371+0000 7fa0a0ff9700 1 -- 172.21.15.154:0/1227995011 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa098021030 con 0x7fa0a40a1550 2023-09-30T22:28:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.371+0000 7fa0a0ff9700 1 -- 172.21.15.154:0/1227995011 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa0980408f0 con 0x7fa0a40a1550 2023-09-30T22:28:43.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.371+0000 7fa0aa361700 1 -- 172.21.15.154:0/1227995011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a404f2a0 con 0x7fa0a40a1550 2023-09-30T22:28:43.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:43.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.376+0000 7fa0a0ff9700 1 -- 172.21.15.154:0/1227995011 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa098015080 con 0x7fa0a40a1550 2023-09-30T22:28:43.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:43.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.441+0000 7ff457fd5700 1 Processor -- start 2023-09-30T22:28:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.441+0000 7ff457fd5700 1 -- start start 2023-09-30T22:28:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.441+0000 7ff457fd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4500667e0 0x7ff4500a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.441+0000 7ff457fd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4501362b0 0x7ff450138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.441+0000 7ff457fd5700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4500a1e70 con 0x7ff450066410 2023-09-30T22:28:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.441+0000 7ff457fd5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45009a720 con 0x7ff4501362b0 2023-09-30T22:28:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.441+0000 7ff457fd5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff45009b300 con 0x7ff4500667e0 2023-09-30T22:28:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff456572700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4501362b0 0x7ff450138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff456572700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4501362b0 0x7ff450138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53960/0 (socket says 172.21.15.154:53960) 2023-09-30T22:28:43.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff456572700 1 -- 172.21.15.154:0/1581631270 learned_addr learned my addr 172.21.15.154:0/1581631270 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:43.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff455570700 1 --2- 172.21.15.154:0/1581631270 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4500667e0 0x7ff4500a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff456572700 1 -- 172.21.15.154:0/1581631270 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4500667e0 msgr2=0x7ff4500a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff456572700 1 --2- 172.21.15.154:0/1581631270 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4500667e0 0x7ff4500a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff456572700 1 -- 172.21.15.154:0/1581631270 >> v1:172.21.15.154:6789/0 conn(0x7ff450066410 legacy=0x7ff4500a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff454d6f700 1 -- 172.21.15.154:0/1581631270 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384092554 0 0) 0x7ff4500a1e70 con 0x7ff450066410 2023-09-30T22:28:43.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff456572700 1 -- 172.21.15.154:0/1581631270 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45009abc0 con 0x7ff4501362b0 2023-09-30T22:28:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff456572700 1 --2- 172.21.15.154:0/1581631270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4501362b0 0x7ff450138690 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff448009e80 tx=0x7ff44800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=938925b5d3f36b7d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.442+0000 7ff454d6f700 1 -- 172.21.15.154:0/1581631270 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800e070 con 0x7ff4501362b0 2023-09-30T22:28:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff454d6f700 1 -- 172.21.15.154:0/1581631270 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44800b910 con 0x7ff4501362b0 2023-09-30T22:28:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff454d6f700 1 -- 172.21.15.154:0/1581631270 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800bcc0 con 0x7ff4501362b0 2023-09-30T22:28:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff457fd5700 1 -- 172.21.15.154:0/1581631270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4501362b0 msgr2=0x7ff450138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff457fd5700 1 --2- 172.21.15.154:0/1581631270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4501362b0 0x7ff450138690 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff448009e80 tx=0x7ff44800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff457fd5700 1 -- 172.21.15.154:0/1581631270 shutdown_connections 2023-09-30T22:28:43.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff457fd5700 1 --2- 172.21.15.154:0/1581631270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4501362b0 0x7ff450138690 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff457fd5700 1 --2- 172.21.15.154:0/1581631270 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4500667e0 0x7ff4500a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff457fd5700 1 -- 172.21.15.154:0/1581631270 >> 172.21.15.154:0/1581631270 conn(0x7ff4500a2980 msgr2=0x7ff4500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff457fd5700 1 -- 172.21.15.154:0/1581631270 shutdown_connections 2023-09-30T22:28:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.443+0000 7ff457fd5700 1 -- 172.21.15.154:0/1581631270 wait complete. 2023-09-30T22:28:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.445+0000 7ff457fd5700 1 Processor -- start 2023-09-30T22:28:43.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.445+0000 7ff457fd5700 1 -- start start 2023-09-30T22:28:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.445+0000 7ff457fd5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff450066410 0x7ff45006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff457fd5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4500667e0 0x7ff45006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff457fd5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4501362b0 0x7ff450070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff457fd5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450071f60 con 0x7ff450066410 2023-09-30T22:28:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff457fd5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff450131b80 con 0x7ff4500667e0 2023-09-30T22:28:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff457fd5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff450131990 con 0x7ff4501362b0 2023-09-30T22:28:43.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff455570700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4500667e0 0x7ff45006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff455570700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4500667e0 0x7ff45006ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53968/0 (socket says 172.21.15.154:53968) 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff455570700 1 -- 172.21.15.154:0/3401749348 learned_addr learned my addr 172.21.15.154:0/3401749348 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff456572700 1 --2- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4501362b0 0x7ff450070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff456572700 1 -- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4500667e0 msgr2=0x7ff45006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff456572700 1 --2- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4500667e0 0x7ff45006ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff456572700 1 -- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff450066410 msgr2=0x7ff45006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff456572700 1 --2- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff450066410 0x7ff45006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff456572700 1 -- 172.21.15.154:0/3401749348 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448009b30 con 0x7ff4501362b0 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff455570700 1 --2- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4500667e0 0x7ff45006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:43.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff456572700 1 --2- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4501362b0 0x7ff450070520 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff448015000 tx=0x7ff448004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff4467fc700 1 -- 172.21.15.154:0/3401749348 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448004930 con 0x7ff4501362b0 2023-09-30T22:28:43.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.446+0000 7ff4467fc700 1 -- 172.21.15.154:0/3401749348 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4480092e0 con 0x7ff4501362b0 2023-09-30T22:28:43.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.447+0000 7ff457fd5700 1 -- 172.21.15.154:0/3401749348 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45009fc50 con 0x7ff4501362b0 2023-09-30T22:28:43.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.447+0000 7ff4467fc700 1 -- 172.21.15.154:0/3401749348 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44801c630 con 0x7ff4501362b0 2023-09-30T22:28:43.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.447+0000 7ff457fd5700 1 -- 172.21.15.154:0/3401749348 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45009ae50 con 0x7ff4501362b0 2023-09-30T22:28:43.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.447+0000 7ff4467fc700 1 -- 172.21.15.154:0/3401749348 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff44801c790 con 0x7ff4501362b0 2023-09-30T22:28:43.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.448+0000 7ff4467fc700 1 -- 172.21.15.154:0/3401749348 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff448040f70 con 0x7ff4501362b0 2023-09-30T22:28:43.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.448+0000 7ff457fd5700 1 -- 172.21.15.154:0/3401749348 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45011d7b0 con 0x7ff4501362b0 2023-09-30T22:28:43.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.454+0000 7ff4467fc700 1 -- 172.21.15.154:0/3401749348 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff448029080 con 0x7ff4501362b0 2023-09-30T22:28:43.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.505+0000 7fd68c95c700 1 Processor -- start 2023-09-30T22:28:43.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.505+0000 7fd68c95c700 1 -- start start 2023-09-30T22:28:43.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.507+0000 7fd68c95c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 0x7fd68809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.507+0000 7fd68c95c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd68809e170 0x7fd6881307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.507+0000 7fd68c95c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68809aaa0 con 0x7fd688130ce0 2023-09-30T22:28:43.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.507+0000 7fd68c95c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68809f870 con 0x7fd68809e170 2023-09-30T22:28:43.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.507+0000 7fd68c95c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd68809b360 con 0x7fd68809d860 2023-09-30T22:28:43.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.507+0000 7fd685d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd68809e170 0x7fd6881307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.507+0000 7fd685d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd68809e170 0x7fd6881307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:53974/0 (socket says 172.21.15.154:53974) 2023-09-30T22:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.507+0000 7fd685d9b700 1 -- 172.21.15.154:0/492698613 learned_addr learned my addr 172.21.15.154:0/492698613 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.507+0000 7fd68659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 0x7fd68809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd685d9b700 1 -- 172.21.15.154:0/492698613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 msgr2=0x7fd68809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd685d9b700 1 --2- 172.21.15.154:0/492698613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 0x7fd68809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd685d9b700 1 -- 172.21.15.154:0/492698613 >> v1:172.21.15.154:6789/0 conn(0x7fd688130ce0 legacy=0x7fd6881379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd685d9b700 1 -- 172.21.15.154:0/492698613 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68809b620 con 0x7fd68809e170 2023-09-30T22:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd685d9b700 1 --2- 172.21.15.154:0/492698613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd68809e170 0x7fd6881307a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009920 tx=0x7fd67c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95ef7b286341b88c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68559a700 1 -- 172.21.15.154:0/492698613 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c011830 con 0x7fd68809e170 2023-09-30T22:28:43.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68559a700 1 -- 172.21.15.154:0/492698613 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c011990 con 0x7fd68809e170 2023-09-30T22:28:43.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68559a700 1 -- 172.21.15.154:0/492698613 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c011d20 con 0x7fd68809e170 2023-09-30T22:28:43.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68c95c700 1 -- 172.21.15.154:0/492698613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd68809e170 msgr2=0x7fd6881307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68c95c700 1 --2- 172.21.15.154:0/492698613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd68809e170 0x7fd6881307a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009920 tx=0x7fd67c009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:43.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68c95c700 1 -- 172.21.15.154:0/492698613 shutdown_connections 2023-09-30T22:28:43.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68c95c700 1 --2- 172.21.15.154:0/492698613 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 0x7fd68809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68c95c700 1 --2- 172.21.15.154:0/492698613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd68809e170 0x7fd6881307a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68c95c700 1 -- 172.21.15.154:0/492698613 >> 172.21.15.154:0/492698613 conn(0x7fd688099c40 msgr2=0x7fd6880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68c95c700 1 -- 172.21.15.154:0/492698613 shutdown_connections 2023-09-30T22:28:43.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.508+0000 7fd68c95c700 1 -- 172.21.15.154:0/492698613 wait complete. 2023-09-30T22:28:43.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68c95c700 1 Processor -- start 2023-09-30T22:28:43.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68c95c700 1 -- start start 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68c95c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 0x7fd68811e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68c95c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd68809e170 0x7fd68811ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68c95c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd688130ce0 0x7fd68811f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68c95c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd688120890 con 0x7fd68809e170 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68c95c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881203f0 con 0x7fd688130ce0 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68c95c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd688130630 con 0x7fd68809d860 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 0x7fd68811e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 0x7fd68811e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39970/0 (socket says 172.21.15.154:39970) 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd68659c700 1 -- 172.21.15.154:0/3575254840 learned_addr learned my addr 172.21.15.154:0/3575254840 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd686d9d700 1 --2- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd688130ce0 0x7fd68811f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.510+0000 7fd685d9b700 1 --2- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd68809e170 0x7fd68811ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd685d9b700 1 -- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 msgr2=0x7fd68811e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd685d9b700 1 --2- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 0x7fd68811e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd685d9b700 1 -- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd688130ce0 msgr2=0x7fd68811f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd685d9b700 1 --2- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd688130ce0 0x7fd68811f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd685d9b700 1 -- 172.21.15.154:0/3575254840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c009550 con 0x7fd68809e170 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd685d9b700 1 --2- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd68809e170 0x7fd68811ec10 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fd67c016000 tx=0x7fd67c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd676ffd700 1 -- 172.21.15.154:0/3575254840 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c004450 con 0x7fd68809e170 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd676ffd700 1 -- 172.21.15.154:0/3575254840 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c01f070 con 0x7fd68809e170 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd68c95c700 1 -- 172.21.15.154:0/3575254840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd688121c50 con 0x7fd68809e170 2023-09-30T22:28:43.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd676ffd700 1 -- 172.21.15.154:0/3575254840 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0038a0 con 0x7fd68809e170 2023-09-30T22:28:43.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.512+0000 7fd68c95c700 1 -- 172.21.15.154:0/3575254840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd688120ad0 con 0x7fd68809e170 2023-09-30T22:28:43.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.513+0000 7fd676ffd700 1 -- 172.21.15.154:0/3575254840 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd67c003a00 con 0x7fd68809e170 2023-09-30T22:28:43.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.513+0000 7fd676ffd700 1 -- 172.21.15.154:0/3575254840 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd67c021070 con 0x7fd68809e170 2023-09-30T22:28:43.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.513+0000 7fd68c95c700 1 -- 172.21.15.154:0/3575254840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68804f2a0 con 0x7fd68809e170 2023-09-30T22:28:43.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.518+0000 7fd676ffd700 1 -- 172.21.15.154:0/3575254840 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd67c015020 con 0x7fd68809e170 2023-09-30T22:28:43.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.558+0000 7f7d7999d700 1 Processor -- start 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.558+0000 7f7d7999d700 1 -- start start 2023-09-30T22:28:43.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d7999d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a0a30 0x7f7d740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d7999d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a1340 0x7f7d7412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d7999d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d740a1e70 con 0x7f7d741304a0 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d7999d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7409a720 con 0x7f7d740a0a30 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d7999d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7409b300 con 0x7f7d740a1340 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d727fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a1340 0x7f7d7412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d727fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a1340 0x7f7d7412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:39980/0 (socket says 172.21.15.154:39980) 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d727fc700 1 -- 172.21.15.154:0/2636295814 learned_addr learned my addr 172.21.15.154:0/2636295814 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d72ffd700 1 --2- 172.21.15.154:0/2636295814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a0a30 0x7f7d740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.559+0000 7f7d727fc700 1 -- 172.21.15.154:0/2636295814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a0a30 msgr2=0x7f7d740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.560+0000 7f7d727fc700 1 --2- 172.21.15.154:0/2636295814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a0a30 0x7f7d740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.560+0000 7f7d727fc700 1 -- 172.21.15.154:0/2636295814 >> v1:172.21.15.154:6789/0 conn(0x7f7d741304a0 legacy=0x7f7d741371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:43.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.560+0000 7f7d727fc700 1 -- 172.21.15.154:0/2636295814 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7409abc0 con 0x7f7d740a1340 2023-09-30T22:28:43.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.560+0000 7f7d72ffd700 1 --2- 172.21.15.154:0/2636295814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a0a30 0x7f7d740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:43.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.560+0000 7f7d727fc700 1 --2- 172.21.15.154:0/2636295814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a1340 0x7f7d7412ff60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800bbc0 tx=0x7f7d6800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47b8c547485dabb0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.560+0000 7f7d71ffb700 1 -- 172.21.15.154:0/2636295814 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800dbe0 con 0x7f7d740a1340 2023-09-30T22:28:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.560+0000 7f7d71ffb700 1 -- 172.21.15.154:0/2636295814 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6800dd40 con 0x7f7d740a1340 2023-09-30T22:28:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.560+0000 7f7d71ffb700 1 -- 172.21.15.154:0/2636295814 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68004250 con 0x7f7d740a1340 2023-09-30T22:28:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.561+0000 7f7d7999d700 1 -- 172.21.15.154:0/2636295814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a1340 msgr2=0x7f7d7412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.561+0000 7f7d7999d700 1 --2- 172.21.15.154:0/2636295814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a1340 0x7f7d7412ff60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800bbc0 tx=0x7f7d6800bed0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.561+0000 7f7d7999d700 1 -- 172.21.15.154:0/2636295814 shutdown_connections 2023-09-30T22:28:43.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.561+0000 7f7d7999d700 1 --2- 172.21.15.154:0/2636295814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a0a30 0x7f7d740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.561+0000 7f7d7999d700 1 --2- 172.21.15.154:0/2636295814 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a1340 0x7f7d7412ff60 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.561+0000 7f7d7999d700 1 -- 172.21.15.154:0/2636295814 >> 172.21.15.154:0/2636295814 conn(0x7f7d740a2980 msgr2=0x7f7d740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.561+0000 7f7d7999d700 1 -- 172.21.15.154:0/2636295814 shutdown_connections 2023-09-30T22:28:43.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.561+0000 7f7d7999d700 1 -- 172.21.15.154:0/2636295814 wait complete. 2023-09-30T22:28:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.562+0000 7f7d7999d700 1 Processor -- start 2023-09-30T22:28:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.562+0000 7f7d7999d700 1 -- start start 2023-09-30T22:28:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.562+0000 7f7d7999d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a0a30 0x7f7d7411d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.562+0000 7f7d7999d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a1340 0x7f7d7411de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.562+0000 7f7d7999d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d741304a0 0x7f7d7411e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.562+0000 7f7d7999d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d741203e0 con 0x7f7d741304a0 2023-09-30T22:28:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.562+0000 7f7d7999d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74121420 con 0x7f7d740a1340 2023-09-30T22:28:43.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.562+0000 7f7d7999d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74120f10 con 0x7f7d740a0a30 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d727fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a1340 0x7f7d7411de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d72ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a0a30 0x7f7d7411d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d727fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a1340 0x7f7d7411de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54012/0 (socket says 172.21.15.154:54012) 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d727fc700 1 -- 172.21.15.154:0/822130113 learned_addr learned my addr 172.21.15.154:0/822130113 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d737fe700 1 --2- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d741304a0 0x7f7d7411e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d72ffd700 1 -- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a1340 msgr2=0x7f7d7411de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d72ffd700 1 --2- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a1340 0x7f7d7411de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d72ffd700 1 -- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d741304a0 msgr2=0x7f7d7411e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d72ffd700 1 --2- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d741304a0 0x7f7d7411e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d72ffd700 1 -- 172.21.15.154:0/822130113 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64009430 con 0x7f7d740a0a30 2023-09-30T22:28:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d72ffd700 1 --2- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a0a30 0x7f7d7411d900 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400e9b0 tx=0x7f7d6400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d5bfff700 1 -- 172.21.15.154:0/822130113 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64005a20 con 0x7f7d740a0a30 2023-09-30T22:28:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d5bfff700 1 -- 172.21.15.154:0/822130113 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d64005b80 con 0x7f7d740a0a30 2023-09-30T22:28:43.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d5bfff700 1 -- 172.21.15.154:0/822130113 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400c850 con 0x7f7d740a0a30 2023-09-30T22:28:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d7999d700 1 -- 172.21.15.154:0/822130113 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6800b7f0 con 0x7f7d740a0a30 2023-09-30T22:28:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.563+0000 7f7d7999d700 1 -- 172.21.15.154:0/822130113 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d74072780 con 0x7f7d740a0a30 2023-09-30T22:28:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.565+0000 7f7d7999d700 1 -- 172.21.15.154:0/822130113 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7411a590 con 0x7f7d740a0a30 2023-09-30T22:28:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.567+0000 7f7d5bfff700 1 -- 172.21.15.154:0/822130113 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d6400c9b0 con 0x7f7d740a0a30 2023-09-30T22:28:43.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.567+0000 7f7d5bfff700 1 -- 172.21.15.154:0/822130113 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d6403ff40 con 0x7f7d740a0a30 2023-09-30T22:28:43.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.569+0000 7f7d5bfff700 1 -- 172.21.15.154:0/822130113 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d64006030 con 0x7f7d740a0a30 2023-09-30T22:28:43.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.582+0000 7fa0aa361700 1 -- 172.21.15.154:0/1227995011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0a4120c00 con 0x7fa0a40a1550 2023-09-30T22:28:43.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.582+0000 7fa0a0ff9700 1 -- 172.21.15.154:0/1227995011 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa098004560 con 0x7fa0a40a1550 2023-09-30T22:28:43.583 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:43.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.585+0000 7fa0aa361700 1 -- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0a40a1550 msgr2=0x7fa0a411ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.585+0000 7fa0aa361700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0a40a1550 0x7fa0a411ed70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa098000c00 tx=0x7fa098004750 comp rx=0 tx=0).stop 2023-09-30T22:28:43.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.586+0000 7fa0aa361700 1 -- 172.21.15.154:0/1227995011 shutdown_connections 2023-09-30T22:28:43.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.586+0000 7fa0aa361700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0a4139200 0x7fa0a411f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.586+0000 7fa0aa361700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa0a40a0a70 0x7fa0a411e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.586+0000 7fa0aa361700 1 --2- 172.21.15.154:0/1227995011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0a40a1550 0x7fa0a411ed70 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.586+0000 7fa0aa361700 1 -- 172.21.15.154:0/1227995011 >> 172.21.15.154:0/1227995011 conn(0x7fa0a40a6610 msgr2=0x7fa0a4136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.586+0000 7fa0aa361700 1 -- 172.21.15.154:0/1227995011 shutdown_connections 2023-09-30T22:28:43.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.586+0000 7fa0aa361700 1 -- 172.21.15.154:0/1227995011 wait complete. 2023-09-30T22:28:43.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:43.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.663+0000 7ff457fd5700 1 -- 172.21.15.154:0/3401749348 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff45004f2a0 con 0x7ff4501362b0 2023-09-30T22:28:43.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.664+0000 7ff4467fc700 1 -- 172.21.15.154:0/3401749348 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4480123f0 con 0x7ff4501362b0 2023-09-30T22:28:43.664 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:43.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.665+0000 7ff457fd5700 1 -- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4501362b0 msgr2=0x7ff450070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.665+0000 7ff457fd5700 1 --2- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4501362b0 0x7ff450070520 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff448015000 tx=0x7ff448004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.666+0000 7ff457fd5700 1 -- 172.21.15.154:0/3401749348 shutdown_connections 2023-09-30T22:28:43.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.666+0000 7ff457fd5700 1 --2- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff4501362b0 0x7ff450070520 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.666+0000 7ff457fd5700 1 --2- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff450066410 0x7ff45006faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.666+0000 7ff457fd5700 1 --2- 172.21.15.154:0/3401749348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4500667e0 0x7ff45006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.666+0000 7ff457fd5700 1 -- 172.21.15.154:0/3401749348 >> 172.21.15.154:0/3401749348 conn(0x7ff4500a2980 msgr2=0x7ff45012d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.666+0000 7ff457fd5700 1 -- 172.21.15.154:0/3401749348 shutdown_connections 2023-09-30T22:28:43.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.666+0000 7ff457fd5700 1 -- 172.21.15.154:0/3401749348 wait complete. 2023-09-30T22:28:43.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:43.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.716+0000 7fd68c95c700 1 -- 172.21.15.154:0/3575254840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd68806c3b0 con 0x7fd68809e170 2023-09-30T22:28:43.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.716+0000 7fd676ffd700 1 -- 172.21.15.154:0/3575254840 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd67c0045b0 con 0x7fd68809e170 2023-09-30T22:28:43.716 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.718+0000 7fd68c95c700 1 -- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd68809e170 msgr2=0x7fd68811ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.718+0000 7fd68c95c700 1 --2- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd68809e170 0x7fd68811ec10 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fd67c016000 tx=0x7fd67c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.718+0000 7fd68c95c700 1 -- 172.21.15.154:0/3575254840 shutdown_connections 2023-09-30T22:28:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.718+0000 7fd68c95c700 1 --2- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd688130ce0 0x7fd68811f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.718+0000 7fd68c95c700 1 --2- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd68809d860 0x7fd68811e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.718+0000 7fd68c95c700 1 --2- 172.21.15.154:0/3575254840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd68809e170 0x7fd68811ec10 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.718+0000 7fd68c95c700 1 -- 172.21.15.154:0/3575254840 >> 172.21.15.154:0/3575254840 conn(0x7fd688099c40 msgr2=0x7fd6880a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.718+0000 7fd68c95c700 1 -- 172.21.15.154:0/3575254840 shutdown_connections 2023-09-30T22:28:43.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.718+0000 7fd68c95c700 1 -- 172.21.15.154:0/3575254840 wait complete. 2023-09-30T22:28:43.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:43.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.766+0000 7f7d7999d700 1 -- 172.21.15.154:0/822130113 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d7404f2a0 con 0x7f7d740a0a30 2023-09-30T22:28:43.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.766+0000 7f7d5bfff700 1 -- 172.21.15.154:0/822130113 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d640123d0 con 0x7f7d740a0a30 2023-09-30T22:28:43.766 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:43.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.768+0000 7f7d7999d700 1 -- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a0a30 msgr2=0x7f7d7411d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:43.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.768+0000 7f7d7999d700 1 --2- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a0a30 0x7f7d7411d900 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400e9b0 tx=0x7f7d6400ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.768+0000 7f7d7999d700 1 -- 172.21.15.154:0/822130113 shutdown_connections 2023-09-30T22:28:43.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.768+0000 7f7d7999d700 1 --2- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d741304a0 0x7f7d7411e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.768+0000 7f7d7999d700 1 --2- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7d740a0a30 0x7f7d7411d900 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.768+0000 7f7d7999d700 1 --2- 172.21.15.154:0/822130113 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d740a1340 0x7f7d7411de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:43.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.768+0000 7f7d7999d700 1 -- 172.21.15.154:0/822130113 >> 172.21.15.154:0/822130113 conn(0x7f7d740a2980 msgr2=0x7f7d7412f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:43.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.769+0000 7f7d7999d700 1 -- 172.21.15.154:0/822130113 shutdown_connections 2023-09-30T22:28:43.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:43.769+0000 7f7d7999d700 1 -- 172.21.15.154:0/822130113 wait complete. 2023-09-30T22:28:43.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:44.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:44.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:44.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:44.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.742+0000 7f6fb03f4700 1 Processor -- start 2023-09-30T22:28:44.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.743+0000 7f6fb03f4700 1 -- start start 2023-09-30T22:28:44.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.743+0000 7f6fb03f4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fa8130350 0x7f6fa8130720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.743+0000 7f6fb03f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa8130c60 0x7f6fa812cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.743+0000 7f6fb03f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa812d470 0x7f6fa812d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.743+0000 7f6fb03f4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa8072520 con 0x7f6fa8130350 2023-09-30T22:28:44.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.743+0000 7f6fb03f4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80a24b0 con 0x7f6fa8130c60 2023-09-30T22:28:44.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.743+0000 7f6fb03f4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa809bbb0 con 0x7f6fa812d470 2023-09-30T22:28:44.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fad98f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa8130c60 0x7f6fa812cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fad98f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa8130c60 0x7f6fa812cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54020/0 (socket says 172.21.15.154:54020) 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fae190700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fa8130350 0x7f6fa8130720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fad98f700 1 -- 172.21.15.154:0/1195279542 learned_addr learned my addr 172.21.15.154:0/1195279542 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fae991700 1 --2- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa812d470 0x7f6fa812d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fae190700 1 -- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa812d470 msgr2=0x7f6fa812d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fae190700 1 --2- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa812d470 0x7f6fa812d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fae190700 1 -- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa8130c60 msgr2=0x7f6fa812cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fae190700 1 --2- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa8130c60 0x7f6fa812cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fae190700 1 -- 172.21.15.154:0/1195279542 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa809cd30 con 0x7f6fa8130350 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fad98f700 1 --2- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa8130c60 0x7f6fa812cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fae190700 1 --2- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130350 0x7f6fa8130720 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009820 tx=0x7f6fa4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523b08d3fa976ae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fad18e700 1 -- 172.21.15.154:0/1195279542 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4005e30 con 0x7f6fa8130350 2023-09-30T22:28:44.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fad18e700 1 -- 172.21.15.154:0/1195279542 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa4006030 con 0x7f6fa8130350 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.744+0000 7f6fad18e700 1 -- 172.21.15.154:0/1195279542 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa40063c0 con 0x7f6fa8130350 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.745+0000 7f6fb03f4700 1 -- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130350 msgr2=0x7f6fa8130720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.745+0000 7f6fb03f4700 1 --2- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130350 0x7f6fa8130720 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009820 tx=0x7f6fa4009b30 comp rx=0 tx=0).stop 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.745+0000 7f6fb03f4700 1 -- 172.21.15.154:0/1195279542 shutdown_connections 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.745+0000 7f6fb03f4700 1 --2- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa812d470 0x7f6fa812d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.745+0000 7f6fb03f4700 1 --2- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130350 0x7f6fa8130720 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.745+0000 7f6fb03f4700 1 --2- 172.21.15.154:0/1195279542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa8130c60 0x7f6fa812cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.745+0000 7f6fb03f4700 1 -- 172.21.15.154:0/1195279542 >> 172.21.15.154:0/1195279542 conn(0x7f6fa80a2980 msgr2=0x7f6fa80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.745+0000 7f6fb03f4700 1 -- 172.21.15.154:0/1195279542 shutdown_connections 2023-09-30T22:28:44.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.745+0000 7f6fb03f4700 1 -- 172.21.15.154:0/1195279542 wait complete. 2023-09-30T22:28:44.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.746+0000 7f6fb03f4700 1 Processor -- start 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.746+0000 7f6fb03f4700 1 -- start start 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fb03f4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa812d470 0x7f6fa811ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fb03f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa8130350 0x7f6fa811f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fb03f4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130c60 0x7f6fa811f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fb03f4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8120a80 con 0x7f6fa8130c60 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fb03f4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa81225a0 con 0x7f6fa812d470 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fb03f4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa809f430 con 0x7f6fa8130350 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fae991700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130c60 0x7f6fa811f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fae190700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa812d470 0x7f6fa811ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fae190700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa812d470 0x7f6fa811ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54030/0 (socket says 172.21.15.154:54030) 2023-09-30T22:28:44.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fae991700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130c60 0x7f6fa811f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46308/0 (socket says 172.21.15.154:46308) 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fae190700 1 -- 172.21.15.154:0/2007534527 learned_addr learned my addr 172.21.15.154:0/2007534527 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.747+0000 7f6fad98f700 1 --2- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa8130350 0x7f6fa811f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6fae991700 1 -- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa8130350 msgr2=0x7f6fa811f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6fae991700 1 --2- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa8130350 0x7f6fa811f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6fae991700 1 -- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa812d470 msgr2=0x7f6fa811ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6fae991700 1 --2- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa812d470 0x7f6fa811ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6fae991700 1 -- 172.21.15.154:0/2007534527 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009550 con 0x7f6fa8130c60 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6fad98f700 1 --2- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa8130350 0x7f6fa811f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6fae991700 1 --2- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130c60 0x7f6fa811f7e0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000eba0 tx=0x7f6fa000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6f9effd700 1 -- 172.21.15.154:0/2007534527 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0009a80 con 0x7f6fa8130c60 2023-09-30T22:28:44.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6f9effd700 1 -- 172.21.15.154:0/2007534527 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa000f040 con 0x7f6fa8130c60 2023-09-30T22:28:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6fb03f4700 1 -- 172.21.15.154:0/2007534527 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa4009430 con 0x7f6fa8130c60 2023-09-30T22:28:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6f9effd700 1 -- 172.21.15.154:0/2007534527 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000cc40 con 0x7f6fa8130c60 2023-09-30T22:28:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.748+0000 7f6fb03f4700 1 -- 172.21.15.154:0/2007534527 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa8122880 con 0x7f6fa8130c60 2023-09-30T22:28:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.749+0000 7f6fb03f4700 1 -- 172.21.15.154:0/2007534527 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa804f2a0 con 0x7f6fa8130c60 2023-09-30T22:28:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.749+0000 7f6f9effd700 1 -- 172.21.15.154:0/2007534527 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fa0014480 con 0x7f6fa8130c60 2023-09-30T22:28:44.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.749+0000 7f6f9effd700 1 -- 172.21.15.154:0/2007534527 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6fa0040070 con 0x7f6fa8130c60 2023-09-30T22:28:44.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.754+0000 7f6f9effd700 1 -- 172.21.15.154:0/2007534527 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fa0007720 con 0x7f6fa8130c60 2023-09-30T22:28:44.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.813+0000 7f1a0a60c700 1 Processor -- start 2023-09-30T22:28:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.813+0000 7f1a0a60c700 1 -- start start 2023-09-30T22:28:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a0a60c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a0409d860 0x7f1a0409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a0a60c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409e170 0x7f1a041307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a0a60c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a04130ce0 0x7f1a04131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a0a60c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0409aaa0 con 0x7f1a04130ce0 2023-09-30T22:28:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a0a60c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0409f870 con 0x7f1a0409e170 2023-09-30T22:28:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a0a60c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0409b360 con 0x7f1a0409d860 2023-09-30T22:28:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409e170 0x7f1a041307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409e170 0x7f1a041307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54038/0 (socket says 172.21.15.154:54038) 2023-09-30T22:28:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a03fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a0409d860 0x7f1a0409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a037fe700 1 -- 172.21.15.154:0/3131284292 learned_addr learned my addr 172.21.15.154:0/3131284292 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a037fe700 1 -- 172.21.15.154:0/3131284292 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a0409d860 msgr2=0x7f1a0409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a037fe700 1 --2- 172.21.15.154:0/3131284292 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a0409d860 0x7f1a0409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a037fe700 1 -- 172.21.15.154:0/3131284292 >> v2:172.21.15.154:3300/0 conn(0x7f1a04130ce0 msgr2=0x7f1a04131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a037fe700 1 --2- 172.21.15.154:0/3131284292 >> v2:172.21.15.154:3300/0 conn(0x7f1a04130ce0 0x7f1a04131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a037fe700 1 -- 172.21.15.154:0/3131284292 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0409b620 con 0x7f1a0409e170 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.814+0000 7f1a03fff700 1 --2- 172.21.15.154:0/3131284292 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a0409d860 0x7f1a0409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.815+0000 7f1a037fe700 1 --2- 172.21.15.154:0/3131284292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409e170 0x7f1a041307a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f19f800bb90 tx=0x7f19f800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ed758321c61b763 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.815+0000 7f1a02ffd700 1 -- 172.21.15.154:0/3131284292 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f800dd30 con 0x7f1a0409e170 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.815+0000 7f1a02ffd700 1 -- 172.21.15.154:0/3131284292 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f800de90 con 0x7f1a0409e170 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.815+0000 7f1a02ffd700 1 -- 172.21.15.154:0/3131284292 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8010690 con 0x7f1a0409e170 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.816+0000 7f1a0a60c700 1 -- 172.21.15.154:0/3131284292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409e170 msgr2=0x7f1a041307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.816+0000 7f1a0a60c700 1 --2- 172.21.15.154:0/3131284292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409e170 0x7f1a041307a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f19f800bb90 tx=0x7f19f800bea0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.816+0000 7f1a0a60c700 1 -- 172.21.15.154:0/3131284292 shutdown_connections 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.816+0000 7f1a0a60c700 1 --2- 172.21.15.154:0/3131284292 >> v2:172.21.15.154:3300/0 conn(0x7f1a04130ce0 0x7f1a04131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.816+0000 7f1a0a60c700 1 --2- 172.21.15.154:0/3131284292 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a0409d860 0x7f1a0409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.816+0000 7f1a0a60c700 1 --2- 172.21.15.154:0/3131284292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409e170 0x7f1a041307a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.816+0000 7f1a0a60c700 1 -- 172.21.15.154:0/3131284292 >> 172.21.15.154:0/3131284292 conn(0x7f1a04099c40 msgr2=0x7f1a040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.816+0000 7f1a0a60c700 1 -- 172.21.15.154:0/3131284292 shutdown_connections 2023-09-30T22:28:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.816+0000 7f1a0a60c700 1 -- 172.21.15.154:0/3131284292 wait complete. 2023-09-30T22:28:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.817+0000 7f1a0a60c700 1 Processor -- start 2023-09-30T22:28:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.817+0000 7f1a0a60c700 1 -- start start 2023-09-30T22:28:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.817+0000 7f1a0a60c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409d860 0x7f1a041204a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.817+0000 7f1a0a60c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0409e170 0x7f1a041209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.817+0000 7f1a0a60c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a04130ce0 0x7f1a04120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.817+0000 7f1a0a60c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0409c8b0 con 0x7f1a0409e170 2023-09-30T22:28:44.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.817+0000 7f1a0a60c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041220e0 con 0x7f1a0409d860 2023-09-30T22:28:44.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.817+0000 7f1a0a60c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a04123c00 con 0x7f1a04130ce0 2023-09-30T22:28:44.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a08ba9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a04130ce0 0x7f1a04120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a037fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0409e170 0x7f1a041209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a08ba9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a04130ce0 0x7f1a04120f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:40026/0 (socket says 172.21.15.154:40026) 2023-09-30T22:28:44.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a08ba9700 1 -- 172.21.15.154:0/2686977390 learned_addr learned my addr 172.21.15.154:0/2686977390 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a03fff700 1 --2- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409d860 0x7f1a041204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a08ba9700 1 -- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409d860 msgr2=0x7f1a041204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a08ba9700 1 --2- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409d860 0x7f1a041204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a08ba9700 1 -- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0409e170 msgr2=0x7f1a041209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a08ba9700 1 --2- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0409e170 0x7f1a041209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a08ba9700 1 -- 172.21.15.154:0/2686977390 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f40094a0 con 0x7f1a04130ce0 2023-09-30T22:28:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a08ba9700 1 --2- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a04130ce0 0x7f1a04120f20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00b970 tx=0x7f19fc00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a00ff9700 1 -- 172.21.15.154:0/2686977390 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00d860 con 0x7f1a04130ce0 2023-09-30T22:28:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a00ff9700 1 -- 172.21.15.154:0/2686977390 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc00d9e0 con 0x7f1a04130ce0 2023-09-30T22:28:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.818+0000 7f1a0a60c700 1 -- 172.21.15.154:0/2686977390 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f800b7f0 con 0x7f1a04130ce0 2023-09-30T22:28:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.819+0000 7f1a00ff9700 1 -- 172.21.15.154:0/2686977390 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00dd90 con 0x7f1a04130ce0 2023-09-30T22:28:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.819+0000 7f1a0a60c700 1 -- 172.21.15.154:0/2686977390 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a041227c0 con 0x7f1a04130ce0 2023-09-30T22:28:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.819+0000 7f1a00ff9700 1 -- 172.21.15.154:0/2686977390 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19fc00e430 con 0x7f1a04130ce0 2023-09-30T22:28:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.820+0000 7f1a00ff9700 1 -- 172.21.15.154:0/2686977390 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f19fc006e40 con 0x7f1a04130ce0 2023-09-30T22:28:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.820+0000 7f1a0a60c700 1 -- 172.21.15.154:0/2686977390 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0404f2a0 con 0x7f1a04130ce0 2023-09-30T22:28:44.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.828+0000 7f1a00ff9700 1 -- 172.21.15.154:0/2686977390 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19fc0213f0 con 0x7f1a04130ce0 2023-09-30T22:28:44.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.865+0000 7fda457ce700 1 Processor -- start 2023-09-30T22:28:44.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.865+0000 7fda457ce700 1 -- start start 2023-09-30T22:28:44.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.865+0000 7fda457ce700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fda4009dec0 0x7fda4006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.865+0000 7fda457ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda40136cb0 0x7fda40139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda457ce700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4006e900 con 0x7fda4006a770 2023-09-30T22:28:44.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda457ce700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4009d180 con 0x7fda4009dec0 2023-09-30T22:28:44.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda457ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4009e780 con 0x7fda40136cb0 2023-09-30T22:28:44.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda40136cb0 0x7fda40139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3e7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fda4009dec0 0x7fda4006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda40136cb0 0x7fda40139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54056/0 (socket says 172.21.15.154:54056) 2023-09-30T22:28:44.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3f7fe700 1 -- 172.21.15.154:0/632411721 learned_addr learned my addr 172.21.15.154:0/632411721 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:44.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3e7fc700 1 --2- 172.21.15.154:0/632411721 >> v2:172.21.15.154:3300/0 conn(0x7fda4009dec0 0x7fda4006b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46330/0 (socket says 172.21.15.154:46330) 2023-09-30T22:28:44.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3e7fc700 1 -- 172.21.15.154:0/632411721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda40136cb0 msgr2=0x7fda40139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3e7fc700 1 --2- 172.21.15.154:0/632411721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda40136cb0 0x7fda40139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3e7fc700 1 -- 172.21.15.154:0/632411721 >> v1:172.21.15.154:6789/0 conn(0x7fda4006a770 legacy=0x7fda4006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3e7fc700 1 -- 172.21.15.154:0/632411721 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4009d3c0 con 0x7fda4009dec0 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3f7fe700 1 --2- 172.21.15.154:0/632411721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda40136cb0 0x7fda40139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3e7fc700 1 --2- 172.21.15.154:0/632411721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4009dec0 0x7fda4006b250 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fda3400dd90 tx=0x7fda3400f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5541fe07ea12e45d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3dffb700 1 -- 172.21.15.154:0/632411721 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34012070 con 0x7fda4009dec0 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3dffb700 1 -- 172.21.15.154:0/632411721 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3400fae0 con 0x7fda4009dec0 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.866+0000 7fda3dffb700 1 -- 172.21.15.154:0/632411721 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3400fe90 con 0x7fda4009dec0 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.867+0000 7fda457ce700 1 -- 172.21.15.154:0/632411721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4009dec0 msgr2=0x7fda4006b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.867+0000 7fda457ce700 1 --2- 172.21.15.154:0/632411721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4009dec0 0x7fda4006b250 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fda3400dd90 tx=0x7fda3400f330 comp rx=0 tx=0).stop 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.867+0000 7fda457ce700 1 -- 172.21.15.154:0/632411721 shutdown_connections 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.867+0000 7fda457ce700 1 --2- 172.21.15.154:0/632411721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda40136cb0 0x7fda40139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.867+0000 7fda457ce700 1 --2- 172.21.15.154:0/632411721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4009dec0 0x7fda4006b250 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.867+0000 7fda457ce700 1 -- 172.21.15.154:0/632411721 >> 172.21.15.154:0/632411721 conn(0x7fda40099c40 msgr2=0x7fda400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:44.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.867+0000 7fda457ce700 1 -- 172.21.15.154:0/632411721 shutdown_connections 2023-09-30T22:28:44.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.867+0000 7fda457ce700 1 -- 172.21.15.154:0/632411721 wait complete. 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.868+0000 7fda457ce700 1 Processor -- start 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.868+0000 7fda457ce700 1 -- start start 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda457ce700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4006a770 0x7fda401345b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda457ce700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda4009dec0 0x7fda40134af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda457ce700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda40136cb0 0x7fda40135030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda457ce700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda40071ce0 con 0x7fda4006a770 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda457ce700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda401234b0 con 0x7fda4009dec0 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda457ce700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda40122430 con 0x7fda40136cb0 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4006a770 0x7fda401345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3effd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4006a770 0x7fda401345b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46338/0 (socket says 172.21.15.154:46338) 2023-09-30T22:28:44.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3effd700 1 -- 172.21.15.154:0/1444158123 learned_addr learned my addr 172.21.15.154:0/1444158123 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:44.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3f7fe700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda40136cb0 0x7fda40135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3e7fc700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda4009dec0 0x7fda40134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3e7fc700 1 -- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda40136cb0 msgr2=0x7fda40135030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3e7fc700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda40136cb0 0x7fda40135030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3e7fc700 1 -- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4006a770 msgr2=0x7fda401345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3e7fc700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4006a770 0x7fda401345b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.869+0000 7fda3e7fc700 1 -- 172.21.15.154:0/1444158123 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda38009b30 con 0x7fda4009dec0 2023-09-30T22:28:44.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.870+0000 7fda3effd700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4006a770 0x7fda401345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.870+0000 7fda3f7fe700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda40136cb0 0x7fda40135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.870+0000 7fda3e7fc700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda4009dec0 0x7fda40134af0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fda34019000 tx=0x7fda34004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.870+0000 7fda277fe700 1 -- 172.21.15.154:0/1444158123 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34005c20 con 0x7fda4009dec0 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.870+0000 7fda277fe700 1 -- 172.21.15.154:0/1444158123 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34005d80 con 0x7fda4009dec0 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.870+0000 7fda277fe700 1 -- 172.21.15.154:0/1444158123 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34007350 con 0x7fda4009dec0 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.870+0000 7fda457ce700 1 -- 172.21.15.154:0/1444158123 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3400da70 con 0x7fda4009dec0 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.870+0000 7fda457ce700 1 -- 172.21.15.154:0/1444158123 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda40122c40 con 0x7fda4009dec0 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.871+0000 7fda457ce700 1 -- 172.21.15.154:0/1444158123 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4004f2a0 con 0x7fda4009dec0 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.871+0000 7fda277fe700 1 -- 172.21.15.154:0/1444158123 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda340074b0 con 0x7fda4009dec0 2023-09-30T22:28:44.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.872+0000 7fda277fe700 1 -- 172.21.15.154:0/1444158123 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fda34040340 con 0x7fda4009dec0 2023-09-30T22:28:44.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.876+0000 7fda277fe700 1 -- 172.21.15.154:0/1444158123 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda340277c0 con 0x7fda4009dec0 2023-09-30T22:28:44.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.957+0000 7f6fb03f4700 1 -- 172.21.15.154:0/2007534527 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6fa809a460 con 0x7f6fa8130c60 2023-09-30T22:28:44.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.957+0000 7f6f9effd700 1 -- 172.21.15.154:0/2007534527 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fa0007330 con 0x7f6fa8130c60 2023-09-30T22:28:44.957 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:44.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.959+0000 7f25fb6c6700 1 Processor -- start 2023-09-30T22:28:44.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f25fb6c6700 1 -- start start 2023-09-30T22:28:44.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f6fb03f4700 1 -- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130c60 msgr2=0x7f6fa811f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f6fb03f4700 1 --2- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130c60 0x7f6fa811f7e0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000eba0 tx=0x7f6fa000eeb0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f6fb03f4700 1 -- 172.21.15.154:0/2007534527 shutdown_connections 2023-09-30T22:28:44.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f6fb03f4700 1 --2- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fa8130c60 0x7f6fa811f7e0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f6fb03f4700 1 --2- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fa812d470 0x7f6fa811ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f6fb03f4700 1 --2- 172.21.15.154:0/2007534527 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6fa8130350 0x7f6fa811f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f6fb03f4700 1 -- 172.21.15.154:0/2007534527 >> 172.21.15.154:0/2007534527 conn(0x7f6fa80a2980 msgr2=0x7f6fa812e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:44.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f6fb03f4700 1 -- 172.21.15.154:0/2007534527 shutdown_connections 2023-09-30T22:28:44.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f6fb03f4700 1 -- 172.21.15.154:0/2007534527 wait complete. 2023-09-30T22:28:44.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f25fb6c6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 0x7f25f41319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f25fb6c6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25f41314b0 0x7f25f4131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f25fb6c6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40a0f20 con 0x7f25f409bc70 2023-09-30T22:28:44.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f25fb6c6700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f40667e0 con 0x7f25f41314b0 2023-09-30T22:28:44.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f25fb6c6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40a23c0 con 0x7f25f4066410 2023-09-30T22:28:44.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f25f8c61700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25f41314b0 0x7f25f4131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f25f8c61700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25f41314b0 0x7f25f4131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46344/0 (socket says 172.21.15.154:46344) 2023-09-30T22:28:44.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.960+0000 7f25f8c61700 1 -- 172.21.15.154:0/2661691732 learned_addr learned my addr 172.21.15.154:0/2661691732 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:44.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.961+0000 7f25f9462700 1 --2- 172.21.15.154:0/2661691732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 0x7f25f41319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.961+0000 7f25f8c61700 1 -- 172.21.15.154:0/2661691732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 msgr2=0x7f25f41319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:44.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.961+0000 7f25f8c61700 1 --2- 172.21.15.154:0/2661691732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 0x7f25f41319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.961+0000 7f25f8c61700 1 -- 172.21.15.154:0/2661691732 >> v1:172.21.15.154:6789/0 conn(0x7f25f409bc70 legacy=0x7f25f409c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.961+0000 7f25f8c61700 1 -- 172.21.15.154:0/2661691732 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40a16e0 con 0x7f25f41314b0 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.961+0000 7f25f8c61700 1 --2- 172.21.15.154:0/2661691732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 0x7f25f4131f30 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009920 tx=0x7f25e4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cba358d773c38b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.961+0000 7f25ebfff700 1 -- 172.21.15.154:0/2661691732 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400ba20 con 0x7f25f41314b0 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.961+0000 7f25ebfff700 1 -- 172.21.15.154:0/2661691732 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400bb80 con 0x7f25f41314b0 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.961+0000 7f25ebfff700 1 -- 172.21.15.154:0/2661691732 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4009e70 con 0x7f25f41314b0 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.962+0000 7f25fb6c6700 1 -- 172.21.15.154:0/2661691732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 msgr2=0x7f25f4131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.962+0000 7f25fb6c6700 1 --2- 172.21.15.154:0/2661691732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 0x7f25f4131f30 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f25e4009920 tx=0x7f25e4009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.962+0000 7f25fb6c6700 1 -- 172.21.15.154:0/2661691732 shutdown_connections 2023-09-30T22:28:44.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.962+0000 7f25fb6c6700 1 --2- 172.21.15.154:0/2661691732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 0x7f25f41319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.962+0000 7f25fb6c6700 1 --2- 172.21.15.154:0/2661691732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 0x7f25f4131f30 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.962+0000 7f25fb6c6700 1 -- 172.21.15.154:0/2661691732 >> 172.21.15.154:0/2661691732 conn(0x7f25f40a2980 msgr2=0x7f25f40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:44.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.962+0000 7f25fb6c6700 1 -- 172.21.15.154:0/2661691732 shutdown_connections 2023-09-30T22:28:44.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.962+0000 7f25fb6c6700 1 -- 172.21.15.154:0/2661691732 wait complete. 2023-09-30T22:28:44.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.964+0000 7f25fb6c6700 1 Processor -- start 2023-09-30T22:28:44.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.964+0000 7f25fb6c6700 1 -- start start 2023-09-30T22:28:44.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.964+0000 7f25fb6c6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 0x7f25f4135370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.964+0000 7f25fb6c6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25f409bc70 0x7f25f41358b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.964+0000 7f25fb6c6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 0x7f25f4135df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:44.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.964+0000 7f25fb6c6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4119590 con 0x7f25f41314b0 2023-09-30T22:28:44.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.964+0000 7f25fb6c6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f41381d0 con 0x7f25f4066410 2023-09-30T22:28:44.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.964+0000 7f25fb6c6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4118f70 con 0x7f25f409bc70 2023-09-30T22:28:44.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9c63700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 0x7f25f4135df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9c63700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 0x7f25f4135df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46356/0 (socket says 172.21.15.154:46356) 2023-09-30T22:28:44.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9c63700 1 -- 172.21.15.154:0/3071025081 learned_addr learned my addr 172.21.15.154:0/3071025081 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:44.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9462700 1 --2- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 0x7f25f4135370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f8c61700 1 --2- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25f409bc70 0x7f25f41358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:44.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9c63700 1 -- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25f409bc70 msgr2=0x7f25f41358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9c63700 1 --2- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25f409bc70 0x7f25f41358b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9c63700 1 -- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 msgr2=0x7f25f4135370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:44.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9c63700 1 --2- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 0x7f25f4135370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:44.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9c63700 1 -- 172.21.15.154:0/3071025081 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4009550 con 0x7f25f41314b0 2023-09-30T22:28:44.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.965+0000 7f25f9c63700 1 --2- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 0x7f25f4135df0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00cc50 tx=0x7f25ec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:44.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.966+0000 7f25e9ffb700 1 -- 172.21.15.154:0/3071025081 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec003c00 con 0x7f25f41314b0 2023-09-30T22:28:44.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.966+0000 7f25e9ffb700 1 -- 172.21.15.154:0/3071025081 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec003d60 con 0x7f25f41314b0 2023-09-30T22:28:44.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.966+0000 7f25e9ffb700 1 -- 172.21.15.154:0/3071025081 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00ab60 con 0x7f25f41314b0 2023-09-30T22:28:44.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.966+0000 7f25fb6c6700 1 -- 172.21.15.154:0/3071025081 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f4137530 con 0x7f25f41314b0 2023-09-30T22:28:44.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.966+0000 7f25fb6c6700 1 -- 172.21.15.154:0/3071025081 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f4119210 con 0x7f25f41314b0 2023-09-30T22:28:44.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.967+0000 7f25e9ffb700 1 -- 172.21.15.154:0/3071025081 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25ec00acc0 con 0x7f25f41314b0 2023-09-30T22:28:44.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.967+0000 7f25e9ffb700 1 -- 172.21.15.154:0/3071025081 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25ec03f750 con 0x7f25f41314b0 2023-09-30T22:28:44.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.967+0000 7f25fb6c6700 1 -- 172.21.15.154:0/3071025081 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f404f2a0 con 0x7f25f41314b0 2023-09-30T22:28:44.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:44.972+0000 7f25e9ffb700 1 -- 172.21.15.154:0/3071025081 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25ec0050d0 con 0x7f25f41314b0 2023-09-30T22:28:44.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.075+0000 7fda457ce700 1 -- 172.21.15.154:0/1444158123 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fda40123ca0 con 0x7fda4009dec0 2023-09-30T22:28:45.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.075+0000 7fda277fe700 1 -- 172.21.15.154:0/1444158123 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda34028400 con 0x7fda4009dec0 2023-09-30T22:28:45.075 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:45.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.077+0000 7fda457ce700 1 -- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda4009dec0 msgr2=0x7fda40134af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.077+0000 7fda457ce700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda4009dec0 0x7fda40134af0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fda34019000 tx=0x7fda34004750 comp rx=0 tx=0).stop 2023-09-30T22:28:45.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.077+0000 7fda457ce700 1 -- 172.21.15.154:0/1444158123 shutdown_connections 2023-09-30T22:28:45.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.077+0000 7fda457ce700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fda40136cb0 0x7fda40135030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.077+0000 7fda457ce700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda4006a770 0x7fda401345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.077+0000 7fda457ce700 1 --2- 172.21.15.154:0/1444158123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda4009dec0 0x7fda40134af0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.077+0000 7fda457ce700 1 -- 172.21.15.154:0/1444158123 >> 172.21.15.154:0/1444158123 conn(0x7fda40099c40 msgr2=0x7fda4009a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.078+0000 7fda457ce700 1 -- 172.21.15.154:0/1444158123 shutdown_connections 2023-09-30T22:28:45.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.078+0000 7fda457ce700 1 -- 172.21.15.154:0/1444158123 wait complete. 2023-09-30T22:28:45.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.107+0000 7f1a0a60c700 1 -- 172.21.15.154:0/2686977390 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1a0406c3b0 con 0x7f1a04130ce0 2023-09-30T22:28:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.108+0000 7f1a00ff9700 1 -- 172.21.15.154:0/2686977390 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19fc007370 con 0x7f1a04130ce0 2023-09-30T22:28:45.108 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:45.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.110+0000 7f1a0a60c700 1 -- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a04130ce0 msgr2=0x7f1a04120f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.110+0000 7f1a0a60c700 1 --2- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a04130ce0 0x7f1a04120f20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00b970 tx=0x7f19fc00bc80 comp rx=0 tx=0).stop 2023-09-30T22:28:45.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.110+0000 7f1a0a60c700 1 -- 172.21.15.154:0/2686977390 shutdown_connections 2023-09-30T22:28:45.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.110+0000 7f1a0a60c700 1 --2- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f1a04130ce0 0x7f1a04120f20 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.110+0000 7f1a0a60c700 1 --2- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a0409d860 0x7f1a041204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.110+0000 7f1a0a60c700 1 --2- 172.21.15.154:0/2686977390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a0409e170 0x7f1a041209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.110+0000 7f1a0a60c700 1 -- 172.21.15.154:0/2686977390 >> 172.21.15.154:0/2686977390 conn(0x7f1a04099c40 msgr2=0x7f1a04130080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.110+0000 7f1a0a60c700 1 -- 172.21.15.154:0/2686977390 shutdown_connections 2023-09-30T22:28:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.110+0000 7f1a0a60c700 1 -- 172.21.15.154:0/2686977390 wait complete. 2023-09-30T22:28:45.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:45.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.185+0000 7f25fb6c6700 1 -- 172.21.15.154:0/3071025081 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25f4137770 con 0x7f25f41314b0 2023-09-30T22:28:45.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.185+0000 7f25e9ffb700 1 -- 172.21.15.154:0/3071025081 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25ec019300 con 0x7f25f41314b0 2023-09-30T22:28:45.186 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.187+0000 7f25fb6c6700 1 -- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 msgr2=0x7f25f4135df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.187+0000 7f25fb6c6700 1 --2- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 0x7f25f4135df0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00cc50 tx=0x7f25ec00cf60 comp rx=0 tx=0).stop 2023-09-30T22:28:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.187+0000 7f25fb6c6700 1 -- 172.21.15.154:0/3071025081 shutdown_connections 2023-09-30T22:28:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.187+0000 7f25fb6c6700 1 --2- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25f41314b0 0x7f25f4135df0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.187+0000 7f25fb6c6700 1 --2- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25f4066410 0x7f25f4135370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.187+0000 7f25fb6c6700 1 --2- 172.21.15.154:0/3071025081 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25f409bc70 0x7f25f41358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.187+0000 7f25fb6c6700 1 -- 172.21.15.154:0/3071025081 >> 172.21.15.154:0/3071025081 conn(0x7f25f40a2980 msgr2=0x7f25f412f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:45.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.187+0000 7f25fb6c6700 1 -- 172.21.15.154:0/3071025081 shutdown_connections 2023-09-30T22:28:45.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:45.188+0000 7f25fb6c6700 1 -- 172.21.15.154:0/3071025081 wait complete. 2023-09-30T22:28:45.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:45.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:46.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:46.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.112+0000 7f93220b0700 1 Processor -- start 2023-09-30T22:28:46.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.112+0000 7f93220b0700 1 -- start start 2023-09-30T22:28:46.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f93220b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c0a0a70 0x7f931c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f93220b0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f931c0a1380 0x7f931c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f93220b0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c133f50 0x7f931c134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f93220b0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c09e9d0 con 0x7f931c0a1380 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f93220b0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c09dc00 con 0x7f931c0a0a70 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f93220b0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f931c09dec0 con 0x7f931c133f50 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f931c0a1380 0x7f931c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c133f50 0x7f931c134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f931c0a1380 0x7f931c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54326/0 (socket says 172.21.15.154:54326) 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c133f50 0x7f931c134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59978/0 (socket says 172.21.15.154:59978) 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931affd700 1 -- 172.21.15.154:0/3457989845 learned_addr learned my addr 172.21.15.154:0/3457989845 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:46.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931b7fe700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c0a0a70 0x7f931c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931affd700 1 -- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c133f50 msgr2=0x7f931c134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931affd700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c133f50 0x7f931c134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931affd700 1 -- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c0a0a70 msgr2=0x7f931c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931affd700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c0a0a70 0x7f931c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931affd700 1 -- 172.21.15.154:0/3457989845 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c09e6a0 con 0x7f931c0a1380 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931bfff700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c133f50 0x7f931c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.113+0000 7f931b7fe700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c0a0a70 0x7f931c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f931affd700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a1380 0x7f931c133a10 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f93100098f0 tx=0x7f9310009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772a0620f34a6b04 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f931a7fc700 1 -- 172.21.15.154:0/3457989845 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011830 con 0x7f931c0a1380 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f931a7fc700 1 -- 172.21.15.154:0/3457989845 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310011990 con 0x7f931c0a1380 2023-09-30T22:28:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f931a7fc700 1 -- 172.21.15.154:0/3457989845 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011d20 con 0x7f931c0a1380 2023-09-30T22:28:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f93220b0700 1 -- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a1380 msgr2=0x7f931c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f93220b0700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a1380 0x7f931c133a10 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f93100098f0 tx=0x7f9310009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f93220b0700 1 -- 172.21.15.154:0/3457989845 shutdown_connections 2023-09-30T22:28:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f93220b0700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c0a0a70 0x7f931c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f93220b0700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c133f50 0x7f931c134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f93220b0700 1 --2- 172.21.15.154:0/3457989845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a1380 0x7f931c133a10 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f93220b0700 1 -- 172.21.15.154:0/3457989845 >> 172.21.15.154:0/3457989845 conn(0x7f931c0a6610 msgr2=0x7f931c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f93220b0700 1 -- 172.21.15.154:0/3457989845 shutdown_connections 2023-09-30T22:28:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.114+0000 7f93220b0700 1 -- 172.21.15.154:0/3457989845 wait complete. 2023-09-30T22:28:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.115+0000 7f93220b0700 1 Processor -- start 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f93220b0700 1 -- start start 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f93220b0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a0a70 0x7f931c122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f93220b0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c0a1380 0x7f931c122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f93220b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c133f50 0x7f931c122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f93220b0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c123900 con 0x7f931c0a0a70 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f93220b0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c125ff0 con 0x7f931c133f50 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f93220b0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f931c124ed0 con 0x7f931c0a1380 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f931bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c133f50 0x7f931c122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f931b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a0a70 0x7f931c122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f931bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c133f50 0x7f931c122eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44386/0 (socket says 172.21.15.154:44386) 2023-09-30T22:28:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f931bfff700 1 -- 172.21.15.154:0/3067294887 learned_addr learned my addr 172.21.15.154:0/3067294887 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f931b7fe700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a0a70 0x7f931c122430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54332/0 (socket says 172.21.15.154:54332) 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.116+0000 7f931affd700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c0a1380 0x7f931c122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f931bfff700 1 -- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c0a1380 msgr2=0x7f931c122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f931bfff700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c0a1380 0x7f931c122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f931bfff700 1 -- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a0a70 msgr2=0x7f931c122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f931bfff700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a0a70 0x7f931c122430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f931bfff700 1 -- 172.21.15.154:0/3067294887 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c0094a0 con 0x7f931c133f50 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f931b7fe700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a0a70 0x7f931c122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f931bfff700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c133f50 0x7f931c122eb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f931400efc0 tx=0x7f931400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f9303fff700 1 -- 172.21.15.154:0/3067294887 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400ca30 con 0x7f931c133f50 2023-09-30T22:28:46.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f9303fff700 1 -- 172.21.15.154:0/3067294887 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931400f040 con 0x7f931c133f50 2023-09-30T22:28:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f9303fff700 1 -- 172.21.15.154:0/3067294887 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400cdb0 con 0x7f931c133f50 2023-09-30T22:28:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f93220b0700 1 -- 172.21.15.154:0/3067294887 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9314009a70 con 0x7f931c133f50 2023-09-30T22:28:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.117+0000 7f93220b0700 1 -- 172.21.15.154:0/3067294887 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9310009550 con 0x7f931c133f50 2023-09-30T22:28:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.118+0000 7f93220b0700 1 -- 172.21.15.154:0/3067294887 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c11f050 con 0x7f931c133f50 2023-09-30T22:28:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.119+0000 7f9303fff700 1 -- 172.21.15.154:0/3067294887 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9314003a20 con 0x7f931c133f50 2023-09-30T22:28:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.119+0000 7f9303fff700 1 -- 172.21.15.154:0/3067294887 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9314040780 con 0x7f931c133f50 2023-09-30T22:28:46.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.123+0000 7f9303fff700 1 -- 172.21.15.154:0/3067294887 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f931401c3b0 con 0x7f931c133f50 2023-09-30T22:28:46.200 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:46.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.221+0000 7f737a793700 1 Processor -- start 2023-09-30T22:28:46.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.221+0000 7f737a793700 1 -- start start 2023-09-30T22:28:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.221+0000 7f737a793700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7374131980 0x7f7374131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.221+0000 7f737a793700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f737409c790 0x7f7374139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.221+0000 7f737a793700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73740a1640 con 0x7f737409bc70 2023-09-30T22:28:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.221+0000 7f737a793700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737406eb30 con 0x7f737409c790 2023-09-30T22:28:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.221+0000 7f737a793700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73740a22d0 con 0x7f7374131980 2023-09-30T22:28:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.221+0000 7f7373fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7374131980 0x7f7374131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7373fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7374131980 0x7f7374131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59988/0 (socket says 172.21.15.154:59988) 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7373fff700 1 -- 172.21.15.154:0/4068282489 learned_addr learned my addr 172.21.15.154:0/4068282489 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7378d30700 1 --2- 172.21.15.154:0/4068282489 >> v2:172.21.15.154:3300/0 conn(0x7f737409c790 0x7f7374139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7373fff700 1 -- 172.21.15.154:0/4068282489 >> v2:172.21.15.154:3300/0 conn(0x7f737409c790 msgr2=0x7f7374139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7373fff700 1 --2- 172.21.15.154:0/4068282489 >> v2:172.21.15.154:3300/0 conn(0x7f737409c790 0x7f7374139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7373fff700 1 -- 172.21.15.154:0/4068282489 >> v1:172.21.15.154:6789/0 conn(0x7f737409bc70 legacy=0x7f737409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7373fff700 1 -- 172.21.15.154:0/4068282489 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374131550 con 0x7f7374131980 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7373fff700 1 --2- 172.21.15.154:0/4068282489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7374131980 0x7f7374131d50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7364006fd0 tx=0x7f7364009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4b0d6cfb90d4ea9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7372ffd700 1 -- 172.21.15.154:0/4068282489 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364005e30 con 0x7f7374131980 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7372ffd700 1 -- 172.21.15.154:0/4068282489 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364004030 con 0x7f7374131980 2023-09-30T22:28:46.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.222+0000 7f7372ffd700 1 -- 172.21.15.154:0/4068282489 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73640043e0 con 0x7f7374131980 2023-09-30T22:28:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.223+0000 7f737a793700 1 -- 172.21.15.154:0/4068282489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7374131980 msgr2=0x7f7374131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.223+0000 7f737a793700 1 --2- 172.21.15.154:0/4068282489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7374131980 0x7f7374131d50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7364006fd0 tx=0x7f7364009bd0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.223+0000 7f737a793700 1 -- 172.21.15.154:0/4068282489 shutdown_connections 2023-09-30T22:28:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.223+0000 7f737a793700 1 --2- 172.21.15.154:0/4068282489 >> v2:172.21.15.154:3300/0 conn(0x7f737409c790 0x7f7374139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.223+0000 7f737a793700 1 --2- 172.21.15.154:0/4068282489 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7374131980 0x7f7374131d50 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.223+0000 7f737a793700 1 -- 172.21.15.154:0/4068282489 >> 172.21.15.154:0/4068282489 conn(0x7f73740a2980 msgr2=0x7f73740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.223+0000 7f737a793700 1 -- 172.21.15.154:0/4068282489 shutdown_connections 2023-09-30T22:28:46.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.226+0000 7f737a793700 1 -- 172.21.15.154:0/4068282489 wait complete. 2023-09-30T22:28:46.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.227+0000 7f737a793700 1 Processor -- start 2023-09-30T22:28:46.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.227+0000 7f737a793700 1 -- start start 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f737a793700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f737409bc70 0x7f737411b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f737a793700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f737409c790 0x7f737411bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f737a793700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7374131980 0x7f737411c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f737a793700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737411eec0 con 0x7f7374131980 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f737a793700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737411d3a0 con 0x7f737409bc70 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f737a793700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7374130df0 con 0x7f737409c790 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f73737fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f737409c790 0x7f737411bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f73737fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f737409c790 0x7f737411bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59996/0 (socket says 172.21.15.154:59996) 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f73737fe700 1 -- 172.21.15.154:0/1223202775 learned_addr learned my addr 172.21.15.154:0/1223202775 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:46.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f7378d30700 1 --2- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7374131980 0x7f737411c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f7373fff700 1 --2- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f737409bc70 0x7f737411b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f7373fff700 1 -- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f737409c790 msgr2=0x7f737411bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f7373fff700 1 --2- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f737409c790 0x7f737411bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.228+0000 7f7373fff700 1 -- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7374131980 msgr2=0x7f737411c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.229+0000 7f7373fff700 1 --2- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7374131980 0x7f737411c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.229+0000 7f7373fff700 1 -- 172.21.15.154:0/1223202775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364009500 con 0x7f737409bc70 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.229+0000 7f7373fff700 1 --2- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f737409bc70 0x7f737411b6d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7364009fd0 tx=0x7f7364004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.229+0000 7f7370ff9700 1 -- 172.21.15.154:0/1223202775 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736401c420 con 0x7f737409bc70 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.229+0000 7f7370ff9700 1 -- 172.21.15.154:0/1223202775 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736401c580 con 0x7f737409bc70 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.229+0000 7f7370ff9700 1 -- 172.21.15.154:0/1223202775 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736401c930 con 0x7f737409bc70 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.229+0000 7f737a793700 1 -- 172.21.15.154:0/1223202775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73740a1c40 con 0x7f737409bc70 2023-09-30T22:28:46.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.229+0000 7f737a793700 1 -- 172.21.15.154:0/1223202775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737411f1a0 con 0x7f737409bc70 2023-09-30T22:28:46.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.230+0000 7f7370ff9700 1 -- 172.21.15.154:0/1223202775 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f736401ca90 con 0x7f737409bc70 2023-09-30T22:28:46.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.230+0000 7f7370ff9700 1 -- 172.21.15.154:0/1223202775 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7364040590 con 0x7f737409bc70 2023-09-30T22:28:46.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.230+0000 7f737a793700 1 -- 172.21.15.154:0/1223202775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7374132240 con 0x7f737409bc70 2023-09-30T22:28:46.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.235+0000 7f7370ff9700 1 -- 172.21.15.154:0/1223202775 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7364020070 con 0x7f737409bc70 2023-09-30T22:28:46.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.254+0000 7f26c7d19700 1 Processor -- start 2023-09-30T22:28:46.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.254+0000 7f26c7d19700 1 -- start start 2023-09-30T22:28:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c7d19700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c00a0a30 0x7f26c00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c7d19700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c7d19700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c00a1e70 con 0x7f26c01304a0 2023-09-30T22:28:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c7d19700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c009a720 con 0x7f26c00a1340 2023-09-30T22:28:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c7d19700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26c009b300 con 0x7f26c00a0a30 2023-09-30T22:28:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c52b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c52b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44404/0 (socket says 172.21.15.154:44404) 2023-09-30T22:28:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c52b4700 1 -- 172.21.15.154:0/3569938449 learned_addr learned my addr 172.21.15.154:0/3569938449 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c5ab5700 1 --2- 172.21.15.154:0/3569938449 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c00a0a30 0x7f26c00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c52b4700 1 -- 172.21.15.154:0/3569938449 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c00a0a30 msgr2=0x7f26c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c52b4700 1 --2- 172.21.15.154:0/3569938449 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c00a0a30 0x7f26c00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c52b4700 1 -- 172.21.15.154:0/3569938449 >> v1:172.21.15.154:6789/0 conn(0x7f26c01304a0 legacy=0x7f26c01371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.255+0000 7f26c52b4700 1 -- 172.21.15.154:0/3569938449 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c009abc0 con 0x7f26c00a1340 2023-09-30T22:28:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.256+0000 7f26c52b4700 1 --2- 172.21.15.154:0/3569938449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c012ff60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f26b000aac0 tx=0x7f26b000add0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dd7075b28ed59ce server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.256+0000 7f26c4ab3700 1 -- 172.21.15.154:0/3569938449 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b000cb70 con 0x7f26c00a1340 2023-09-30T22:28:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.256+0000 7f26c4ab3700 1 -- 172.21.15.154:0/3569938449 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b000ccd0 con 0x7f26c00a1340 2023-09-30T22:28:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.256+0000 7f26c4ab3700 1 -- 172.21.15.154:0/3569938449 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0018620 con 0x7f26c00a1340 2023-09-30T22:28:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.257+0000 7f26c7d19700 1 -- 172.21.15.154:0/3569938449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 msgr2=0x7f26c012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.257+0000 7f26c7d19700 1 --2- 172.21.15.154:0/3569938449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c012ff60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f26b000aac0 tx=0x7f26b000add0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.257+0000 7f26c7d19700 1 -- 172.21.15.154:0/3569938449 shutdown_connections 2023-09-30T22:28:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.257+0000 7f26c7d19700 1 --2- 172.21.15.154:0/3569938449 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c00a0a30 0x7f26c00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.257+0000 7f26c7d19700 1 --2- 172.21.15.154:0/3569938449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c012ff60 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.257+0000 7f26c7d19700 1 -- 172.21.15.154:0/3569938449 >> 172.21.15.154:0/3569938449 conn(0x7f26c00a2980 msgr2=0x7f26c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.257+0000 7f26c7d19700 1 -- 172.21.15.154:0/3569938449 shutdown_connections 2023-09-30T22:28:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.257+0000 7f26c7d19700 1 -- 172.21.15.154:0/3569938449 wait complete. 2023-09-30T22:28:46.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.258+0000 7f26c7d19700 1 Processor -- start 2023-09-30T22:28:46.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.258+0000 7f26c7d19700 1 -- start start 2023-09-30T22:28:46.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c7d19700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c00a0a30 0x7f26c011e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c7d19700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c011ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c7d19700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c01304a0 0x7f26c011f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c7d19700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c01223f0 con 0x7f26c00a0a30 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c7d19700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c0121ee0 con 0x7f26c00a1340 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c7d19700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26c0121370 con 0x7f26c01304a0 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c5ab5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c00a0a30 0x7f26c011e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c52b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c011ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c5ab5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c00a0a30 0x7f26c011e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54354/0 (socket says 172.21.15.154:54354) 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c5ab5700 1 -- 172.21.15.154:0/4044564354 learned_addr learned my addr 172.21.15.154:0/4044564354 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.259+0000 7f26c62b6700 1 --2- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c01304a0 0x7f26c011f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.260+0000 7f26c52b4700 1 -- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c01304a0 msgr2=0x7f26c011f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.260+0000 7f26c52b4700 1 --2- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c01304a0 0x7f26c011f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.260+0000 7f26c52b4700 1 -- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c00a0a30 msgr2=0x7f26c011e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.260+0000 7f26c52b4700 1 --2- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c00a0a30 0x7f26c011e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.260+0000 7f26c52b4700 1 -- 172.21.15.154:0/4044564354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b000a6f0 con 0x7f26c00a1340 2023-09-30T22:28:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.260+0000 7f26c52b4700 1 --2- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c011ee10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f26b0017000 tx=0x7f26b00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.260+0000 7f26b67fc700 1 -- 172.21.15.154:0/4044564354 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0003ab0 con 0x7f26c00a1340 2023-09-30T22:28:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.260+0000 7f26b67fc700 1 -- 172.21.15.154:0/4044564354 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b0003c30 con 0x7f26c00a1340 2023-09-30T22:28:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.260+0000 7f26b67fc700 1 -- 172.21.15.154:0/4044564354 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0021480 con 0x7f26c00a1340 2023-09-30T22:28:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.261+0000 7f26c7d19700 1 -- 172.21.15.154:0/4044564354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c009ae00 con 0x7f26c00a1340 2023-09-30T22:28:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.261+0000 7f26c7d19700 1 -- 172.21.15.154:0/4044564354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c0072720 con 0x7f26c00a1340 2023-09-30T22:28:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.262+0000 7f26b67fc700 1 -- 172.21.15.154:0/4044564354 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26b0018400 con 0x7f26c00a1340 2023-09-30T22:28:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.262+0000 7f26b67fc700 1 -- 172.21.15.154:0/4044564354 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26b0040910 con 0x7f26c00a1340 2023-09-30T22:28:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.262+0000 7f26c7d19700 1 -- 172.21.15.154:0/4044564354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c004f2a0 con 0x7f26c00a1340 2023-09-30T22:28:46.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.271+0000 7f26b67fc700 1 -- 172.21.15.154:0/4044564354 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26b000f370 con 0x7f26c00a1340 2023-09-30T22:28:46.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.329+0000 7f93220b0700 1 -- 172.21.15.154:0/3067294887 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f931c04f2a0 con 0x7f931c133f50 2023-09-30T22:28:46.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.329+0000 7f9303fff700 1 -- 172.21.15.154:0/3067294887 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f931402b090 con 0x7f931c133f50 2023-09-30T22:28:46.330 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:46.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.331+0000 7f93220b0700 1 -- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c133f50 msgr2=0x7f931c122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.331+0000 7f93220b0700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c133f50 0x7f931c122eb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f931400efc0 tx=0x7f931400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.332+0000 7f93220b0700 1 -- 172.21.15.154:0/3067294887 shutdown_connections 2023-09-30T22:28:46.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.332+0000 7f93220b0700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f931c133f50 0x7f931c122eb0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.332+0000 7f93220b0700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f931c0a0a70 0x7f931c122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.332+0000 7f93220b0700 1 --2- 172.21.15.154:0/3067294887 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f931c0a1380 0x7f931c122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.332+0000 7f93220b0700 1 -- 172.21.15.154:0/3067294887 >> 172.21.15.154:0/3067294887 conn(0x7f931c0a6610 msgr2=0x7f931c09f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.332+0000 7f93220b0700 1 -- 172.21.15.154:0/3067294887 shutdown_connections 2023-09-30T22:28:46.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.332+0000 7f93220b0700 1 -- 172.21.15.154:0/3067294887 wait complete. 2023-09-30T22:28:46.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.333+0000 7f50d3c5c700 1 Processor -- start 2023-09-30T22:28:46.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.333+0000 7f50d3c5c700 1 -- start start 2023-09-30T22:28:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d3c5c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50cc09ad40 0x7f50cc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d3c5c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50cc133f70 0x7f50cc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d3c5c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc0a0a70 0x7f50cc0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d3c5c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc0a3b60 con 0x7f50cc133f70 2023-09-30T22:28:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d3c5c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1348e0 con 0x7f50cc0a0a70 2023-09-30T22:28:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d3c5c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc09b110 con 0x7f50cc09ad40 2023-09-30T22:28:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d21f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc0a0a70 0x7f50cc0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d21f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc0a0a70 0x7f50cc0a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44422/0 (socket says 172.21.15.154:44422) 2023-09-30T22:28:46.335 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d21f9700 1 -- 172.21.15.154:0/3212704090 learned_addr learned my addr 172.21.15.154:0/3212704090 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d11f7700 1 --2- 172.21.15.154:0/3212704090 >> v2:172.21.15.154:3300/0 conn(0x7f50cc133f70 0x7f50cc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d21f9700 1 -- 172.21.15.154:0/3212704090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50cc09ad40 msgr2=0x7f50cc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d21f9700 1 --2- 172.21.15.154:0/3212704090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50cc09ad40 0x7f50cc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d21f9700 1 -- 172.21.15.154:0/3212704090 >> v2:172.21.15.154:3300/0 conn(0x7f50cc133f70 msgr2=0x7f50cc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d21f9700 1 --2- 172.21.15.154:0/3212704090 >> v2:172.21.15.154:3300/0 conn(0x7f50cc133f70 0x7f50cc1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.334+0000 7f50d21f9700 1 -- 172.21.15.154:0/3212704090 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0a2fa0 con 0x7f50cc0a0a70 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.335+0000 7f50d21f9700 1 --2- 172.21.15.154:0/3212704090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc0a0a70 0x7f50cc0a0ed0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009e50 tx=0x7f50c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=681541def6dbda78 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.335+0000 7f50d09f6700 1 -- 172.21.15.154:0/3212704090 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c400e070 con 0x7f50cc0a0a70 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.335+0000 7f50d09f6700 1 -- 172.21.15.154:0/3212704090 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c400b910 con 0x7f50cc0a0a70 2023-09-30T22:28:46.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.335+0000 7f50d09f6700 1 -- 172.21.15.154:0/3212704090 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c400bcc0 con 0x7f50cc0a0a70 2023-09-30T22:28:46.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.336+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3212704090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc0a0a70 msgr2=0x7f50cc0a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.336+0000 7f50d3c5c700 1 --2- 172.21.15.154:0/3212704090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc0a0a70 0x7f50cc0a0ed0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009e50 tx=0x7f50c400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:46.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.336+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3212704090 shutdown_connections 2023-09-30T22:28:46.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.336+0000 7f50d3c5c700 1 --2- 172.21.15.154:0/3212704090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc0a0a70 0x7f50cc0a0ed0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.336+0000 7f50d3c5c700 1 --2- 172.21.15.154:0/3212704090 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50cc09ad40 0x7f50cc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.336+0000 7f50d3c5c700 1 --2- 172.21.15.154:0/3212704090 >> v2:172.21.15.154:3300/0 conn(0x7f50cc133f70 0x7f50cc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.336+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3212704090 >> 172.21.15.154:0/3212704090 conn(0x7f50cc099c40 msgr2=0x7f50cc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.336+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3212704090 shutdown_connections 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.336+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3212704090 wait complete. 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.337+0000 7f50d3c5c700 1 Processor -- start 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.337+0000 7f50d3c5c700 1 -- start start 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d3c5c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc09ad40 0x7f50cc1213d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d3c5c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50cc0a0a70 0x7f50cc121910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d3c5c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc133f70 0x7f50cc121e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d3c5c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc123ea0 con 0x7f50cc133f70 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d3c5c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc132760 con 0x7f50cc09ad40 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d3c5c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc09c7e0 con 0x7f50cc0a0a70 2023-09-30T22:28:46.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d21f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc133f70 0x7f50cc121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d21f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc133f70 0x7f50cc121e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54366/0 (socket says 172.21.15.154:54366) 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d21f9700 1 -- 172.21.15.154:0/3286810454 learned_addr learned my addr 172.21.15.154:0/3286810454 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d19f8700 1 --2- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc09ad40 0x7f50cc1213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d19f8700 1 -- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50cc0a0a70 msgr2=0x7f50cc121910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d19f8700 1 --2- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50cc0a0a70 0x7f50cc121910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d19f8700 1 -- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc133f70 msgr2=0x7f50cc121e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d19f8700 1 --2- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc133f70 0x7f50cc121e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d19f8700 1 -- 172.21.15.154:0/3286810454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c4009b30 con 0x7f50cc09ad40 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.338+0000 7f50d21f9700 1 --2- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc133f70 0x7f50cc121e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.339+0000 7f50d19f8700 1 --2- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc09ad40 0x7f50cc1213d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f50c800b410 tx=0x7f50c800b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.339+0000 7f50c27fc700 1 -- 172.21.15.154:0/3286810454 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011830 con 0x7f50cc09ad40 2023-09-30T22:28:46.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.339+0000 7f50c27fc700 1 -- 172.21.15.154:0/3286810454 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c800be90 con 0x7f50cc09ad40 2023-09-30T22:28:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.339+0000 7f50c27fc700 1 -- 172.21.15.154:0/3286810454 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8011bd0 con 0x7f50cc09ad40 2023-09-30T22:28:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.339+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3286810454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc124910 con 0x7f50cc09ad40 2023-09-30T22:28:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.339+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3286810454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc09d360 con 0x7f50cc09ad40 2023-09-30T22:28:46.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.340+0000 7f50c27fc700 1 -- 172.21.15.154:0/3286810454 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50c8011d30 con 0x7f50cc09ad40 2023-09-30T22:28:46.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.340+0000 7f50c27fc700 1 -- 172.21.15.154:0/3286810454 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f50c803f550 con 0x7f50cc09ad40 2023-09-30T22:28:46.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.340+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3286810454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc04f2a0 con 0x7f50cc09ad40 2023-09-30T22:28:46.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.345+0000 7f50c27fc700 1 -- 172.21.15.154:0/3286810454 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50c8015070 con 0x7f50cc09ad40 2023-09-30T22:28:46.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:46.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.446+0000 7f737a793700 1 -- 172.21.15.154:0/1223202775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f737404f2a0 con 0x7f737409bc70 2023-09-30T22:28:46.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.447+0000 7f7370ff9700 1 -- 172.21.15.154:0/1223202775 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7364016030 con 0x7f737409bc70 2023-09-30T22:28:46.447 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:46.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.450+0000 7f737a793700 1 -- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f737409bc70 msgr2=0x7f737411b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.450+0000 7f737a793700 1 --2- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f737409bc70 0x7f737411b6d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7364009fd0 tx=0x7f7364004750 comp rx=0 tx=0).stop 2023-09-30T22:28:46.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.450+0000 7f737a793700 1 -- 172.21.15.154:0/1223202775 shutdown_connections 2023-09-30T22:28:46.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.450+0000 7f737a793700 1 --2- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7374131980 0x7f737411c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.450+0000 7f737a793700 1 --2- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f737409bc70 0x7f737411b6d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.450+0000 7f737a793700 1 --2- 172.21.15.154:0/1223202775 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f737409c790 0x7f737411bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.450+0000 7f737a793700 1 -- 172.21.15.154:0/1223202775 >> 172.21.15.154:0/1223202775 conn(0x7f73740a2980 msgr2=0x7f737406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.450+0000 7f737a793700 1 -- 172.21.15.154:0/1223202775 shutdown_connections 2023-09-30T22:28:46.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.450+0000 7f737a793700 1 -- 172.21.15.154:0/1223202775 wait complete. 2023-09-30T22:28:46.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:46.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.498+0000 7f26c7d19700 1 -- 172.21.15.154:0/4044564354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f26c012fca0 con 0x7f26c00a1340 2023-09-30T22:28:46.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.499+0000 7f26b67fc700 1 -- 172.21.15.154:0/4044564354 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26b0026070 con 0x7f26c00a1340 2023-09-30T22:28:46.499 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.501+0000 7f26c7d19700 1 -- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 msgr2=0x7f26c011ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.501+0000 7f26c7d19700 1 --2- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c011ee10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f26b0017000 tx=0x7f26b00047c0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.501+0000 7f26c7d19700 1 -- 172.21.15.154:0/4044564354 shutdown_connections 2023-09-30T22:28:46.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.501+0000 7f26c7d19700 1 --2- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f26c01304a0 0x7f26c011f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.501+0000 7f26c7d19700 1 --2- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c00a0a30 0x7f26c011e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.501+0000 7f26c7d19700 1 --2- 172.21.15.154:0/4044564354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26c00a1340 0x7f26c011ee10 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.501+0000 7f26c7d19700 1 -- 172.21.15.154:0/4044564354 >> 172.21.15.154:0/4044564354 conn(0x7f26c00a2980 msgr2=0x7f26c00718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.501+0000 7f26c7d19700 1 -- 172.21.15.154:0/4044564354 shutdown_connections 2023-09-30T22:28:46.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.501+0000 7f26c7d19700 1 -- 172.21.15.154:0/4044564354 wait complete. 2023-09-30T22:28:46.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.550+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3286810454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f50cc133d50 con 0x7f50cc09ad40 2023-09-30T22:28:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.550+0000 7f50c27fc700 1 -- 172.21.15.154:0/3286810454 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50c8028090 con 0x7f50cc09ad40 2023-09-30T22:28:46.550 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.552+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc09ad40 msgr2=0x7f50cc1213d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.552+0000 7f50d3c5c700 1 --2- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc09ad40 0x7f50cc1213d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f50c800b410 tx=0x7f50c800b720 comp rx=0 tx=0).stop 2023-09-30T22:28:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.552+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3286810454 shutdown_connections 2023-09-30T22:28:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.552+0000 7f50d3c5c700 1 --2- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc133f70 0x7f50cc121e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.552+0000 7f50d3c5c700 1 --2- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50cc09ad40 0x7f50cc1213d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.552+0000 7f50d3c5c700 1 --2- 172.21.15.154:0/3286810454 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f50cc0a0a70 0x7f50cc121910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.552+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3286810454 >> 172.21.15.154:0/3286810454 conn(0x7f50cc099c40 msgr2=0x7f50cc132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.552+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3286810454 shutdown_connections 2023-09-30T22:28:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:46.552+0000 7f50d3c5c700 1 -- 172.21.15.154:0/3286810454 wait complete. 2023-09-30T22:28:46.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:47.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:47.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:47.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.477+0000 7fcb0a073700 1 Processor -- start 2023-09-30T22:28:47.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb0a073700 1 -- start start 2023-09-30T22:28:47.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb0a073700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 0x7fcb0409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb0a073700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb04134330 0x7fcb0413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb0a073700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0409fa00 con 0x7fcb0409f180 2023-09-30T22:28:47.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb0a073700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb040a0370 con 0x7fcb04134330 2023-09-30T22:28:47.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb0a073700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0406bec0 con 0x7fcb0409e870 2023-09-30T22:28:47.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb03fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb04134330 0x7fcb0413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 0x7fcb0409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb03fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb04134330 0x7fcb0413be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54382/0 (socket says 172.21.15.154:54382) 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb03fff700 1 -- 172.21.15.154:0/3444446317 learned_addr learned my addr 172.21.15.154:0/3444446317 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb037fe700 1 -- 172.21.15.154:0/3444446317 >> v2:172.21.15.154:3300/0 conn(0x7fcb04134330 msgr2=0x7fcb0413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb037fe700 1 --2- 172.21.15.154:0/3444446317 >> v2:172.21.15.154:3300/0 conn(0x7fcb04134330 0x7fcb0413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb037fe700 1 -- 172.21.15.154:0/3444446317 >> v1:172.21.15.154:6789/0 conn(0x7fcb0409f180 legacy=0x7fcb04133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.478+0000 7fcb037fe700 1 -- 172.21.15.154:0/3444446317 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0409ada0 con 0x7fcb0409e870 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb037fe700 1 --2- 172.21.15.154:0/3444446317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 0x7fcb0409ec40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009840 tx=0x7fcaf4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df0431319c6643b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb027fc700 1 -- 172.21.15.154:0/3444446317 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011830 con 0x7fcb0409e870 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb027fc700 1 -- 172.21.15.154:0/3444446317 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf4011990 con 0x7fcb0409e870 2023-09-30T22:28:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb027fc700 1 -- 172.21.15.154:0/3444446317 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011d20 con 0x7fcb0409e870 2023-09-30T22:28:47.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb0a073700 1 -- 172.21.15.154:0/3444446317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 msgr2=0x7fcb0409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb0a073700 1 --2- 172.21.15.154:0/3444446317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 0x7fcb0409ec40 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009840 tx=0x7fcaf4009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb0a073700 1 -- 172.21.15.154:0/3444446317 shutdown_connections 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb0a073700 1 --2- 172.21.15.154:0/3444446317 >> v2:172.21.15.154:3300/0 conn(0x7fcb04134330 0x7fcb0413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb0a073700 1 --2- 172.21.15.154:0/3444446317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 0x7fcb0409ec40 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.479+0000 7fcb0a073700 1 -- 172.21.15.154:0/3444446317 >> 172.21.15.154:0/3444446317 conn(0x7fcb040a4430 msgr2=0x7fcb040a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.480+0000 7fcb0a073700 1 -- 172.21.15.154:0/3444446317 shutdown_connections 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.480+0000 7fcb0a073700 1 -- 172.21.15.154:0/3444446317 wait complete. 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.480+0000 7fcb0a073700 1 Processor -- start 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb0a073700 1 -- start start 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb0a073700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 0x7fcb04122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb0a073700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb0409f180 0x7fcb04122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb0a073700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb04134330 0x7fcb041234f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb0a073700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041262b0 con 0x7fcb04134330 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb0a073700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0406fba0 con 0x7fcb0409e870 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb0a073700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0406cfa0 con 0x7fcb0409f180 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb02ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb0409f180 0x7fcb04122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb03fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb04134330 0x7fcb041234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb02ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb0409f180 0x7fcb04122fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60052/0 (socket says 172.21.15.154:60052) 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb02ffd700 1 -- 172.21.15.154:0/3878786529 learned_addr learned my addr 172.21.15.154:0/3878786529 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb03fff700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb04134330 0x7fcb041234f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54386/0 (socket says 172.21.15.154:54386) 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.481+0000 7fcb037fe700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 0x7fcb04122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcb02ffd700 1 -- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 msgr2=0x7fcb04122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcb02ffd700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 0x7fcb04122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcb02ffd700 1 -- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb04134330 msgr2=0x7fcb041234f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcb02ffd700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb04134330 0x7fcb041234f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcb02ffd700 1 -- 172.21.15.154:0/3878786529 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40094a0 con 0x7fcb0409f180 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcb03fff700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb04134330 0x7fcb041234f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcb02ffd700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb0409f180 0x7fcb04122fb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c4b0 tx=0x7fcaf800c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcaebfff700 1 -- 172.21.15.154:0/3878786529 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80052d0 con 0x7fcb0409f180 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcaebfff700 1 -- 172.21.15.154:0/3878786529 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf8005430 con 0x7fcb0409f180 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcb0a073700 1 -- 172.21.15.154:0/3878786529 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb04133590 con 0x7fcb0409f180 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcaebfff700 1 -- 172.21.15.154:0/3878786529 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80038c0 con 0x7fcb0409f180 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.482+0000 7fcb0a073700 1 -- 172.21.15.154:0/3878786529 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb04126590 con 0x7fcb0409f180 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.483+0000 7fcaebfff700 1 -- 172.21.15.154:0/3878786529 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcaf8003a20 con 0x7fcb0409f180 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.483+0000 7fcb0a073700 1 -- 172.21.15.154:0/3878786529 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb04125f50 con 0x7fcb0409f180 2023-09-30T22:28:47.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.483+0000 7fcaebfff700 1 -- 172.21.15.154:0/3878786529 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcaf803ea70 con 0x7fcb0409f180 2023-09-30T22:28:47.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.488+0000 7fcaebfff700 1 -- 172.21.15.154:0/3878786529 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcaf8019c50 con 0x7fcb0409f180 2023-09-30T22:28:47.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:47.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:47.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.596+0000 7f2d9067f700 1 Processor -- start 2023-09-30T22:28:47.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d9067f700 1 -- start start 2023-09-30T22:28:47.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d9067f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 0x7f2d880a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d9067f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d881400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d9067f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d881379e0 con 0x7f2d88138040 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d9067f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d880a2100 con 0x7f2d88138410 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d9067f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8809b9b0 con 0x7f2d8813dd10 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d8ec1c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d881400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d8ec1c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d881400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60068/0 (socket says 172.21.15.154:60068) 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d8ec1c700 1 -- 172.21.15.154:0/2802056480 learned_addr learned my addr 172.21.15.154:0/2802056480 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.597+0000 7f2d8dc1a700 1 --2- 172.21.15.154:0/2802056480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 0x7f2d880a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.598+0000 7f2d8ec1c700 1 -- 172.21.15.154:0/2802056480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 msgr2=0x7f2d880a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.598+0000 7f2d8ec1c700 1 --2- 172.21.15.154:0/2802056480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 0x7f2d880a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.598+0000 7f2d8ec1c700 1 -- 172.21.15.154:0/2802056480 >> v1:172.21.15.154:6789/0 conn(0x7f2d88138040 legacy=0x7f2d880a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.598+0000 7f2d8ec1c700 1 -- 172.21.15.154:0/2802056480 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88137c10 con 0x7f2d8813dd10 2023-09-30T22:28:47.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.598+0000 7f2d8ec1c700 1 --2- 172.21.15.154:0/2802056480 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d881400f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009eb0 tx=0x7f2d8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626b15b33f108bf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.598+0000 7f2d8d419700 1 -- 172.21.15.154:0/2802056480 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000e070 con 0x7f2d8813dd10 2023-09-30T22:28:47.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.598+0000 7f2d8d419700 1 -- 172.21.15.154:0/2802056480 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8000b8d0 con 0x7f2d8813dd10 2023-09-30T22:28:47.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.598+0000 7f2d8d419700 1 -- 172.21.15.154:0/2802056480 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000bc80 con 0x7f2d8813dd10 2023-09-30T22:28:47.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.599+0000 7f2d9067f700 1 -- 172.21.15.154:0/2802056480 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 msgr2=0x7f2d881400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.599+0000 7f2d9067f700 1 --2- 172.21.15.154:0/2802056480 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d881400f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009eb0 tx=0x7f2d8000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:47.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.599+0000 7f2d9067f700 1 -- 172.21.15.154:0/2802056480 shutdown_connections 2023-09-30T22:28:47.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.599+0000 7f2d9067f700 1 --2- 172.21.15.154:0/2802056480 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d881400f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.599+0000 7f2d9067f700 1 --2- 172.21.15.154:0/2802056480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 0x7f2d880a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.599+0000 7f2d9067f700 1 -- 172.21.15.154:0/2802056480 >> 172.21.15.154:0/2802056480 conn(0x7f2d880a2980 msgr2=0x7f2d880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.599+0000 7f2d9067f700 1 -- 172.21.15.154:0/2802056480 shutdown_connections 2023-09-30T22:28:47.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.599+0000 7f2d9067f700 1 -- 172.21.15.154:0/2802056480 wait complete. 2023-09-30T22:28:47.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.601+0000 7f2d9067f700 1 Processor -- start 2023-09-30T22:28:47.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.601+0000 7f2d9067f700 1 -- start start 2023-09-30T22:28:47.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.601+0000 7f2d9067f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d88138040 0x7f2d88136f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.601+0000 7f2d9067f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 0x7f2d881374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.601+0000 7f2d9067f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d88135740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.601+0000 7f2d9067f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8809ea40 con 0x7f2d88138040 2023-09-30T22:28:47.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.601+0000 7f2d9067f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8812fea0 con 0x7f2d88138410 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d9067f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8813c210 con 0x7f2d8813dd10 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8dc1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 0x7f2d881374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8dc1a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 0x7f2d881374a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44470/0 (socket says 172.21.15.154:44470) 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8dc1a700 1 -- 172.21.15.154:0/1767438018 learned_addr learned my addr 172.21.15.154:0/1767438018 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8ec1c700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d88135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8e41b700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d88138040 0x7f2d88136f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8ec1c700 1 -- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 msgr2=0x7f2d881374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8ec1c700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 0x7f2d881374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8ec1c700 1 -- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d88138040 msgr2=0x7f2d88136f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8ec1c700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d88138040 0x7f2d88136f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8ec1c700 1 -- 172.21.15.154:0/1767438018 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80009b30 con 0x7f2d8813dd10 2023-09-30T22:28:47.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8e41b700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d88138040 0x7f2d88136f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d8ec1c700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d88135740 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2d80015000 tx=0x7f2d80004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.602+0000 7f2d7effd700 1 -- 172.21.15.154:0/1767438018 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80004450 con 0x7f2d8813dd10 2023-09-30T22:28:47.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.603+0000 7f2d7effd700 1 -- 172.21.15.154:0/1767438018 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d800045b0 con 0x7f2d8813dd10 2023-09-30T22:28:47.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.603+0000 7f2d9067f700 1 -- 172.21.15.154:0/1767438018 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8809a240 con 0x7f2d8813dd10 2023-09-30T22:28:47.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.603+0000 7f2d9067f700 1 -- 172.21.15.154:0/1767438018 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d88119120 con 0x7f2d8813dd10 2023-09-30T22:28:47.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.603+0000 7f2d7effd700 1 -- 172.21.15.154:0/1767438018 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80004960 con 0x7f2d8813dd10 2023-09-30T22:28:47.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.604+0000 7f2d7effd700 1 -- 172.21.15.154:0/1767438018 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d80025460 con 0x7f2d8813dd10 2023-09-30T22:28:47.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.604+0000 7f2d9067f700 1 -- 172.21.15.154:0/1767438018 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d700052e0 con 0x7f2d8813dd10 2023-09-30T22:28:47.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.604+0000 7f2d7effd700 1 -- 172.21.15.154:0/1767438018 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d800412c0 con 0x7f2d8813dd10 2023-09-30T22:28:47.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.608+0000 7f2d7effd700 1 -- 172.21.15.154:0/1767438018 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d8001bd30 con 0x7f2d8813dd10 2023-09-30T22:28:47.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.644+0000 7f604f9f7700 1 Processor -- start 2023-09-30T22:28:47.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.644+0000 7f604f9f7700 1 -- start start 2023-09-30T22:28:47.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.644+0000 7f604f9f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.644+0000 7f604f9f7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60480a08e0 0x7f60480a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.644+0000 7f604f9f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 0x7f604813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.644+0000 7f604f9f7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60480a2100 con 0x7f60480a08e0 2023-09-30T22:28:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.644+0000 7f604f9f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6048138950 con 0x7f60480a1230 2023-09-30T22:28:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.644+0000 7f604f9f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60481379e0 con 0x7f6048138040 2023-09-30T22:28:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604cf92700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60480a08e0 0x7f60480a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604d793700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604cf92700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60480a08e0 0x7f60480a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54404/0 (socket says 172.21.15.154:54404) 2023-09-30T22:28:47.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604df94700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 0x7f604813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604d793700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60094/0 (socket says 172.21.15.154:60094) 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604cf92700 1 -- 172.21.15.154:0/2993645152 learned_addr learned my addr 172.21.15.154:0/2993645152 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604cf92700 1 -- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 msgr2=0x7f6048138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604cf92700 1 --2- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604cf92700 1 -- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 msgr2=0x7f604813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604cf92700 1 --2- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 0x7f604813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604cf92700 1 -- 172.21.15.154:0/2993645152 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604809b9b0 con 0x7f60480a08e0 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604d793700 1 --2- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604df94700 1 --2- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 0x7f604813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f604cf92700 1 --2- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60480a08e0 0x7f60480a0cf0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f6038009920 tx=0x7f6038009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26511d16958714d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f603ffff700 1 -- 172.21.15.154:0/2993645152 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038011830 con 0x7f60480a08e0 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.645+0000 7f603ffff700 1 -- 172.21.15.154:0/2993645152 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6038011990 con 0x7f60480a08e0 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f603ffff700 1 -- 172.21.15.154:0/2993645152 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038011d20 con 0x7f60480a08e0 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f604f9f7700 1 -- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60480a08e0 msgr2=0x7f60480a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f604f9f7700 1 --2- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60480a08e0 0x7f60480a0cf0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f6038009920 tx=0x7f6038009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f604f9f7700 1 -- 172.21.15.154:0/2993645152 shutdown_connections 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f604f9f7700 1 --2- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 0x7f604813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f604f9f7700 1 --2- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f604f9f7700 1 --2- 172.21.15.154:0/2993645152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60480a08e0 0x7f60480a0cf0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f604f9f7700 1 -- 172.21.15.154:0/2993645152 >> 172.21.15.154:0/2993645152 conn(0x7f60480a2980 msgr2=0x7f60480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f604f9f7700 1 -- 172.21.15.154:0/2993645152 shutdown_connections 2023-09-30T22:28:47.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.646+0000 7f604f9f7700 1 -- 172.21.15.154:0/2993645152 wait complete. 2023-09-30T22:28:47.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.647+0000 7f604f9f7700 1 Processor -- start 2023-09-30T22:28:47.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.647+0000 7f604f9f7700 1 -- start start 2023-09-30T22:28:47.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604f9f7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60480a08e0 0x7f6048137140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604f9f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 0x7f6048135d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604f9f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048136240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604f9f7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604813e820 con 0x7f60480a08e0 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604f9f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604813e630 con 0x7f60480a1230 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604f9f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f604811b720 con 0x7f6048138040 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604df94700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048136240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604df94700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048136240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60108/0 (socket says 172.21.15.154:60108) 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604df94700 1 -- 172.21.15.154:0/698623603 learned_addr learned my addr 172.21.15.154:0/698623603 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604cf92700 1 --2- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 0x7f6048135d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604d793700 1 --2- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60480a08e0 0x7f6048137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604df94700 1 -- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 msgr2=0x7f6048135d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604df94700 1 --2- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 0x7f6048135d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604df94700 1 -- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60480a08e0 msgr2=0x7f6048137140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604df94700 1 --2- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60480a08e0 0x7f6048137140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604df94700 1 -- 172.21.15.154:0/698623603 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040009a70 con 0x7f6048138040 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.648+0000 7f604df94700 1 --2- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048136240 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f604000ef00 tx=0x7f604000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.649+0000 7f603dffb700 1 -- 172.21.15.154:0/698623603 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040010040 con 0x7f6048138040 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.649+0000 7f603dffb700 1 -- 172.21.15.154:0/698623603 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604000bb30 con 0x7f6048138040 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.649+0000 7f603dffb700 1 -- 172.21.15.154:0/698623603 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040003a20 con 0x7f6048138040 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.649+0000 7f604f9f7700 1 -- 172.21.15.154:0/698623603 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6044009430 con 0x7f6048138040 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.649+0000 7f604f9f7700 1 -- 172.21.15.154:0/698623603 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6038009550 con 0x7f6048138040 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.650+0000 7f604f9f7700 1 -- 172.21.15.154:0/698623603 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604811b0e0 con 0x7f6048138040 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.650+0000 7f603dffb700 1 -- 172.21.15.154:0/698623603 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f604001d410 con 0x7f6048138040 2023-09-30T22:28:47.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.650+0000 7f603dffb700 1 -- 172.21.15.154:0/698623603 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f604003fad0 con 0x7f6048138040 2023-09-30T22:28:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.659+0000 7f603dffb700 1 -- 172.21.15.154:0/698623603 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f604811b0e0 con 0x7f6048138040 2023-09-30T22:28:47.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.689+0000 7fcb0a073700 1 -- 172.21.15.154:0/3878786529 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb0406c9d0 con 0x7fcb0409f180 2023-09-30T22:28:47.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.689+0000 7fcaebfff700 1 -- 172.21.15.154:0/3878786529 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcaf8016170 con 0x7fcb0409f180 2023-09-30T22:28:47.689 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.691+0000 7fcb0a073700 1 -- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb0409f180 msgr2=0x7fcb04122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.691+0000 7fcb0a073700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb0409f180 0x7fcb04122fb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c4b0 tx=0x7fcaf800c7c0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.691+0000 7fcb0a073700 1 -- 172.21.15.154:0/3878786529 shutdown_connections 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.691+0000 7fcb0a073700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb04134330 0x7fcb041234f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.691+0000 7fcb0a073700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb0409e870 0x7fcb04122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.691+0000 7fcb0a073700 1 --2- 172.21.15.154:0/3878786529 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb0409f180 0x7fcb04122fb0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.691+0000 7fcb0a073700 1 -- 172.21.15.154:0/3878786529 >> 172.21.15.154:0/3878786529 conn(0x7fcb040a4430 msgr2=0x7fcb04071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.692+0000 7fcb0a073700 1 -- 172.21.15.154:0/3878786529 shutdown_connections 2023-09-30T22:28:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.692+0000 7fcb0a073700 1 -- 172.21.15.154:0/3878786529 wait complete. 2023-09-30T22:28:47.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.695+0000 7f9e6c9b0700 1 Processor -- start 2023-09-30T22:28:47.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.695+0000 7f9e6c9b0700 1 -- start start 2023-09-30T22:28:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.695+0000 7f9e6c9b0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e6809d860 0x7f9e6809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.695+0000 7f9e6c9b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e68130eb0 0x7f9e68138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.695+0000 7f9e6c9b0700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6809aaa0 con 0x7f9e6809e170 2023-09-30T22:28:47.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.695+0000 7f9e6c9b0700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6809f870 con 0x7f9e6809d860 2023-09-30T22:28:47.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.695+0000 7f9e6c9b0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6809b360 con 0x7f9e68130eb0 2023-09-30T22:28:47.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.695+0000 7f9e66d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e68130eb0 0x7f9e68138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e66d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e68130eb0 0x7f9e68138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44492/0 (socket says 172.21.15.154:44492) 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e66d9d700 1 -- 172.21.15.154:0/1072073679 learned_addr learned my addr 172.21.15.154:0/1072073679 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e6659c700 1 --2- 172.21.15.154:0/1072073679 >> v2:172.21.15.154:3300/0 conn(0x7f9e6809d860 0x7f9e6809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e66d9d700 1 -- 172.21.15.154:0/1072073679 >> v2:172.21.15.154:3300/0 conn(0x7f9e6809d860 msgr2=0x7f9e6809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e66d9d700 1 --2- 172.21.15.154:0/1072073679 >> v2:172.21.15.154:3300/0 conn(0x7f9e6809d860 0x7f9e6809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e66d9d700 1 -- 172.21.15.154:0/1072073679 >> v1:172.21.15.154:6789/0 conn(0x7f9e6809e170 legacy=0x7f9e681307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e66d9d700 1 -- 172.21.15.154:0/1072073679 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6809b620 con 0x7f9e68130eb0 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e66d9d700 1 --2- 172.21.15.154:0/1072073679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e68130eb0 0x7f9e68138a00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000d150 tx=0x7f9e6000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf50887f8323c66f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e6559a700 1 -- 172.21.15.154:0/1072073679 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60010070 con 0x7f9e68130eb0 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e6559a700 1 -- 172.21.15.154:0/1072073679 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6000ddc0 con 0x7f9e68130eb0 2023-09-30T22:28:47.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.696+0000 7f9e6559a700 1 -- 172.21.15.154:0/1072073679 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000b310 con 0x7f9e68130eb0 2023-09-30T22:28:47.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.697+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/1072073679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e68130eb0 msgr2=0x7f9e68138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.697+0000 7f9e6c9b0700 1 --2- 172.21.15.154:0/1072073679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e68130eb0 0x7f9e68138a00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000d150 tx=0x7f9e6000d460 comp rx=0 tx=0).stop 2023-09-30T22:28:47.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.697+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/1072073679 shutdown_connections 2023-09-30T22:28:47.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.697+0000 7f9e6c9b0700 1 --2- 172.21.15.154:0/1072073679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e68130eb0 0x7f9e68138a00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.697+0000 7f9e6c9b0700 1 --2- 172.21.15.154:0/1072073679 >> v2:172.21.15.154:3300/0 conn(0x7f9e6809d860 0x7f9e6809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.697+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/1072073679 >> 172.21.15.154:0/1072073679 conn(0x7f9e68099c40 msgr2=0x7f9e680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.697+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/1072073679 shutdown_connections 2023-09-30T22:28:47.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.697+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/1072073679 wait complete. 2023-09-30T22:28:47.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.699+0000 7f9e6c9b0700 1 Processor -- start 2023-09-30T22:28:47.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.699+0000 7f9e6c9b0700 1 -- start start 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.699+0000 7f9e6c9b0700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e6809d860 0x7f9e6811e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.699+0000 7f9e6c9b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e6809e170 0x7f9e6811e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.699+0000 7f9e6c9b0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e68130eb0 0x7f9e6811ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.699+0000 7f9e6c9b0700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6809c8b0 con 0x7f9e68130eb0 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.699+0000 7f9e6c9b0700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e68120120 con 0x7f9e6809e170 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.699+0000 7f9e6c9b0700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e68121c40 con 0x7f9e6809d860 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e6659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e6809d860 0x7f9e6811e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e66d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e68130eb0 0x7f9e6811ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e6659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e6809d860 0x7f9e6811e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60110/0 (socket says 172.21.15.154:60110) 2023-09-30T22:28:47.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e6659c700 1 -- 172.21.15.154:0/699974635 learned_addr learned my addr 172.21.15.154:0/699974635 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e65d9b700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e6809e170 0x7f9e6811e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e66d9d700 1 -- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e6809d860 msgr2=0x7f9e6811e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e66d9d700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e6809d860 0x7f9e6811e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e66d9d700 1 -- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e6809e170 msgr2=0x7f9e6811e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e66d9d700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e6809e170 0x7f9e6811e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e66d9d700 1 -- 172.21.15.154:0/699974635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6000bd40 con 0x7f9e68130eb0 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e65d9b700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e6809e170 0x7f9e6811e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e6659c700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e6809d860 0x7f9e6811e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e66d9d700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e68130eb0 0x7f9e6811ee80 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f9e6806d590 tx=0x7f9e60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.700+0000 7f9e56ffd700 1 -- 172.21.15.154:0/699974635 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000b4c0 con 0x7f9e68130eb0 2023-09-30T22:28:47.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.701+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/699974635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e68072150 con 0x7f9e68130eb0 2023-09-30T22:28:47.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.701+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/699974635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e681226b0 con 0x7f9e68130eb0 2023-09-30T22:28:47.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.702+0000 7f9e56ffd700 1 -- 172.21.15.154:0/699974635 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e60004040 con 0x7f9e68130eb0 2023-09-30T22:28:47.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.702+0000 7f9e56ffd700 1 -- 172.21.15.154:0/699974635 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600043f0 con 0x7f9e68130eb0 2023-09-30T22:28:47.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.702+0000 7f9e56ffd700 1 -- 172.21.15.154:0/699974635 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e60004550 con 0x7f9e68130eb0 2023-09-30T22:28:47.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.703+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/699974635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6804f2a0 con 0x7f9e68130eb0 2023-09-30T22:28:47.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.703+0000 7f9e56ffd700 1 -- 172.21.15.154:0/699974635 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9e60043540 con 0x7f9e68130eb0 2023-09-30T22:28:47.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:47.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.710+0000 7f9e56ffd700 1 -- 172.21.15.154:0/699974635 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e6001c380 con 0x7f9e68130eb0 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.811+0000 7f2d9067f700 1 -- 172.21.15.154:0/1767438018 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d70005590 con 0x7f2d8813dd10 2023-09-30T22:28:47.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.812+0000 7f2d7effd700 1 -- 172.21.15.154:0/1767438018 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d8001bb50 con 0x7f2d8813dd10 2023-09-30T22:28:47.812 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:47.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.813+0000 7f2d9067f700 1 -- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 msgr2=0x7f2d88135740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.813+0000 7f2d9067f700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d88135740 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2d80015000 tx=0x7f2d80004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.813+0000 7f2d9067f700 1 -- 172.21.15.154:0/1767438018 shutdown_connections 2023-09-30T22:28:47.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.813+0000 7f2d9067f700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d8813dd10 0x7f2d88135740 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.814+0000 7f2d9067f700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d88138040 0x7f2d88136f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.814+0000 7f2d9067f700 1 --2- 172.21.15.154:0/1767438018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d88138410 0x7f2d881374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.814+0000 7f2d9067f700 1 -- 172.21.15.154:0/1767438018 >> 172.21.15.154:0/1767438018 conn(0x7f2d880a2980 msgr2=0x7f2d88140a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.814+0000 7f2d9067f700 1 -- 172.21.15.154:0/1767438018 shutdown_connections 2023-09-30T22:28:47.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.814+0000 7f2d9067f700 1 -- 172.21.15.154:0/1767438018 wait complete. 2023-09-30T22:28:47.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.857+0000 7f604f9f7700 1 -- 172.21.15.154:0/698623603 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f604811b0e0 con 0x7f6048138040 2023-09-30T22:28:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.857+0000 7f603dffb700 1 -- 172.21.15.154:0/698623603 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f604811b0e0 con 0x7f6048138040 2023-09-30T22:28:47.857 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:47.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.859+0000 7f604f9f7700 1 -- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 msgr2=0x7f6048136240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.859+0000 7f604f9f7700 1 --2- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048136240 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f604000ef00 tx=0x7f604000b390 comp rx=0 tx=0).stop 2023-09-30T22:28:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.859+0000 7f604f9f7700 1 -- 172.21.15.154:0/698623603 shutdown_connections 2023-09-30T22:28:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.859+0000 7f604f9f7700 1 --2- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6048138040 0x7f6048136240 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.859+0000 7f604f9f7700 1 --2- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60480a08e0 0x7f6048137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.859+0000 7f604f9f7700 1 --2- 172.21.15.154:0/698623603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60480a1230 0x7f6048135d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.859+0000 7f604f9f7700 1 -- 172.21.15.154:0/698623603 >> 172.21.15.154:0/698623603 conn(0x7f60480a2980 msgr2=0x7f6048070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.859+0000 7f604f9f7700 1 -- 172.21.15.154:0/698623603 shutdown_connections 2023-09-30T22:28:47.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.859+0000 7f604f9f7700 1 -- 172.21.15.154:0/698623603 wait complete. 2023-09-30T22:28:47.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:47.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.904+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/699974635 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e6806c3b0 con 0x7f9e68130eb0 2023-09-30T22:28:47.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.904+0000 7f9e56ffd700 1 -- 172.21.15.154:0/699974635 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e60013b80 con 0x7f9e68130eb0 2023-09-30T22:28:47.904 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:47.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.906+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e68130eb0 msgr2=0x7f9e6811ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:47.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.906+0000 7f9e6c9b0700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e68130eb0 0x7f9e6811ee80 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f9e6806d590 tx=0x7f9e60004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.906+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/699974635 shutdown_connections 2023-09-30T22:28:47.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.906+0000 7f9e6c9b0700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e68130eb0 0x7f9e6811ee80 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.906+0000 7f9e6c9b0700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9e6809d860 0x7f9e6811e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.906+0000 7f9e6c9b0700 1 --2- 172.21.15.154:0/699974635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e6809e170 0x7f9e6811e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:47.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.906+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/699974635 >> 172.21.15.154:0/699974635 conn(0x7f9e68099c40 msgr2=0x7f9e68070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:47.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.906+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/699974635 shutdown_connections 2023-09-30T22:28:47.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:47.906+0000 7f9e6c9b0700 1 -- 172.21.15.154:0/699974635 wait complete. 2023-09-30T22:28:47.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:48.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:48.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:48.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0c2355700 1 Processor -- start 2023-09-30T22:28:48.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0c2355700 1 -- start start 2023-09-30T22:28:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0c2355700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0bc133a70 0x7fb0bc133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0c2355700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc13b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0c2355700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0bc133640 con 0x7fb0bc0a08e0 2023-09-30T22:28:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0c2355700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0bc0a1d50 con 0x7fb0bc133a70 2023-09-30T22:28:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0c2355700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc09b620 con 0x7fb0bc0a1470 2023-09-30T22:28:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0bbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0bc133a70 0x7fb0bc133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0c08f2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0bbfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb0bc133a70 0x7fb0bc133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54448/0 (socket says 172.21.15.154:54448) 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0bbfff700 1 -- 172.21.15.154:0/1167357301 learned_addr learned my addr 172.21.15.154:0/1167357301 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.838+0000 7fb0c08f2700 1 --2- 172.21.15.154:0/1167357301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc13b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44514/0 (socket says 172.21.15.154:44514) 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.839+0000 7fb0c08f2700 1 -- 172.21.15.154:0/1167357301 >> v2:172.21.15.154:3300/0 conn(0x7fb0bc133a70 msgr2=0x7fb0bc133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.839+0000 7fb0c08f2700 1 --2- 172.21.15.154:0/1167357301 >> v2:172.21.15.154:3300/0 conn(0x7fb0bc133a70 0x7fb0bc133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.839+0000 7fb0c08f2700 1 -- 172.21.15.154:0/1167357301 >> v1:172.21.15.154:6789/0 conn(0x7fb0bc0a08e0 legacy=0x7fb0bc0a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.839+0000 7fb0c08f2700 1 -- 172.21.15.154:0/1167357301 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc133870 con 0x7fb0bc0a1470 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.839+0000 7fb0bbfff700 1 --2- 172.21.15.154:0/1167357301 >> v2:172.21.15.154:3300/0 conn(0x7fb0bc133a70 0x7fb0bc133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.839+0000 7fb0c08f2700 1 --2- 172.21.15.154:0/1167357301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc13b980 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009d90 tx=0x7fb0b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fde127fb9a8f5966 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.839+0000 7fb0baffd700 1 -- 172.21.15.154:0/1167357301 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b400e070 con 0x7fb0bc0a1470 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.839+0000 7fb0baffd700 1 -- 172.21.15.154:0/1167357301 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b400bb20 con 0x7fb0bc0a1470 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.839+0000 7fb0baffd700 1 -- 172.21.15.154:0/1167357301 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4012430 con 0x7fb0bc0a1470 2023-09-30T22:28:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.840+0000 7fb0c2355700 1 -- 172.21.15.154:0/1167357301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 msgr2=0x7fb0bc13b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.840+0000 7fb0c2355700 1 --2- 172.21.15.154:0/1167357301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc13b980 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009d90 tx=0x7fb0b400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.840+0000 7fb0c2355700 1 -- 172.21.15.154:0/1167357301 shutdown_connections 2023-09-30T22:28:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.840+0000 7fb0c2355700 1 --2- 172.21.15.154:0/1167357301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc13b980 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.840+0000 7fb0c2355700 1 --2- 172.21.15.154:0/1167357301 >> v2:172.21.15.154:3300/0 conn(0x7fb0bc133a70 0x7fb0bc133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.840+0000 7fb0c2355700 1 -- 172.21.15.154:0/1167357301 >> 172.21.15.154:0/1167357301 conn(0x7fb0bc0a2980 msgr2=0x7fb0bc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.840+0000 7fb0c2355700 1 -- 172.21.15.154:0/1167357301 shutdown_connections 2023-09-30T22:28:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.840+0000 7fb0c2355700 1 -- 172.21.15.154:0/1167357301 wait complete. 2023-09-30T22:28:48.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.840+0000 7fb0c2355700 1 Processor -- start 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0c2355700 1 -- start start 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0c2355700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0bc0a08e0 0x7fb0bc1198a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0c2355700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc119de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0c2355700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb0bc133a70 0x7fb0bc11a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0c2355700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc11b470 con 0x7fb0bc0a08e0 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0c2355700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc09a350 con 0x7fb0bc0a1470 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0c2355700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc11d0a0 con 0x7fb0bc133a70 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0bb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc119de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0bb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc119de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44516/0 (socket says 172.21.15.154:44516) 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0bb7fe700 1 -- 172.21.15.154:0/1681960874 learned_addr learned my addr 172.21.15.154:0/1681960874 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0bbfff700 1 --2- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0bc0a08e0 0x7fb0bc1198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.841+0000 7fb0c08f2700 1 --2- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb0bc133a70 0x7fb0bc11a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0bb7fe700 1 -- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb0bc133a70 msgr2=0x7fb0bc11a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0bb7fe700 1 --2- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb0bc133a70 0x7fb0bc11a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0bb7fe700 1 -- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0bc0a08e0 msgr2=0x7fb0bc1198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0bb7fe700 1 --2- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0bc0a08e0 0x7fb0bc1198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0bb7fe700 1 -- 172.21.15.154:0/1681960874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac009500 con 0x7fb0bc0a1470 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0bb7fe700 1 --2- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc119de0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c450 tx=0x7fb0b000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0b8ff9700 1 -- 172.21.15.154:0/1681960874 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00052d0 con 0x7fb0bc0a1470 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0b8ff9700 1 -- 172.21.15.154:0/1681960874 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b0005430 con 0x7fb0bc0a1470 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0b8ff9700 1 -- 172.21.15.154:0/1681960874 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00038c0 con 0x7fb0bc0a1470 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0c2355700 1 -- 172.21.15.154:0/1681960874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b4009a70 con 0x7fb0bc0a1470 2023-09-30T22:28:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.842+0000 7fb0c2355700 1 -- 172.21.15.154:0/1681960874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0bc11c6c0 con 0x7fb0bc0a1470 2023-09-30T22:28:48.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.843+0000 7fb0b8ff9700 1 -- 172.21.15.154:0/1681960874 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0b0003a20 con 0x7fb0bc0a1470 2023-09-30T22:28:48.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.843+0000 7fb0b8ff9700 1 -- 172.21.15.154:0/1681960874 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0b003ea10 con 0x7fb0bc0a1470 2023-09-30T22:28:48.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.843+0000 7fb0c2355700 1 -- 172.21.15.154:0/1681960874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0bc04f2a0 con 0x7fb0bc0a1470 2023-09-30T22:28:48.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.848+0000 7fb0b8ff9700 1 -- 172.21.15.154:0/1681960874 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0b0017070 con 0x7fb0bc0a1470 2023-09-30T22:28:48.872 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:48.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:48.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.956+0000 7ff1b59bb700 1 Processor -- start 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.956+0000 7ff1b59bb700 1 -- start start 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1b59bb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff1b006a770 0x7ff1b01349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1b59bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b009e070 0x7ff1b013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1b59bb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b009eca0 con 0x7ff1b0134f00 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1b59bb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b006b2e0 con 0x7ff1b006a770 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1b59bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b009f720 con 0x7ff1b009e070 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1af7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b009e070 0x7ff1b013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1af7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b009e070 0x7ff1b013fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60138/0 (socket says 172.21.15.154:60138) 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1af7fe700 1 -- 172.21.15.154:0/2006003608 learned_addr learned my addr 172.21.15.154:0/2006003608 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:48.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1aeffd700 1 --2- 172.21.15.154:0/2006003608 >> v2:172.21.15.154:3300/0 conn(0x7ff1b006a770 0x7ff1b01349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1af7fe700 1 -- 172.21.15.154:0/2006003608 >> v2:172.21.15.154:3300/0 conn(0x7ff1b006a770 msgr2=0x7ff1b01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:48.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1af7fe700 1 --2- 172.21.15.154:0/2006003608 >> v2:172.21.15.154:3300/0 conn(0x7ff1b006a770 0x7ff1b01349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1af7fe700 1 -- 172.21.15.154:0/2006003608 >> v1:172.21.15.154:6789/0 conn(0x7ff1b0134f00 legacy=0x7ff1b009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.957+0000 7ff1af7fe700 1 -- 172.21.15.154:0/2006003608 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b006b480 con 0x7ff1b009e070 2023-09-30T22:28:48.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.958+0000 7ff1af7fe700 1 --2- 172.21.15.154:0/2006003608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b009e070 0x7ff1b013fcf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8009e50 tx=0x7ff1a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58105f0d5560c355 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:48.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.958+0000 7ff1adffb700 1 -- 172.21.15.154:0/2006003608 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800e070 con 0x7ff1b009e070 2023-09-30T22:28:48.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.958+0000 7ff1adffb700 1 -- 172.21.15.154:0/2006003608 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a800b910 con 0x7ff1b009e070 2023-09-30T22:28:48.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.958+0000 7ff1adffb700 1 -- 172.21.15.154:0/2006003608 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800bcc0 con 0x7ff1b009e070 2023-09-30T22:28:48.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.958+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2006003608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b009e070 msgr2=0x7ff1b013fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.958+0000 7ff1b59bb700 1 --2- 172.21.15.154:0/2006003608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b009e070 0x7ff1b013fcf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8009e50 tx=0x7ff1a800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:48.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.958+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2006003608 shutdown_connections 2023-09-30T22:28:48.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.958+0000 7ff1b59bb700 1 --2- 172.21.15.154:0/2006003608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b009e070 0x7ff1b013fcf0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.958+0000 7ff1b59bb700 1 --2- 172.21.15.154:0/2006003608 >> v2:172.21.15.154:3300/0 conn(0x7ff1b006a770 0x7ff1b01349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.959+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2006003608 >> 172.21.15.154:0/2006003608 conn(0x7ff1b0099c40 msgr2=0x7ff1b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:48.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.959+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2006003608 shutdown_connections 2023-09-30T22:28:48.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.959+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2006003608 wait complete. 2023-09-30T22:28:48.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.959+0000 7ff1b59bb700 1 Processor -- start 2023-09-30T22:28:48.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1b59bb700 1 -- start start 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1b59bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b006a770 0x7ff1b011a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1b59bb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1b009e070 0x7ff1b011ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1b59bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1b0134f00 0x7ff1b011b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1b59bb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b011bd70 con 0x7ff1b009e070 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1b59bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b011d4d0 con 0x7ff1b0134f00 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1b59bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b00a0460 con 0x7ff1b006a770 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1af7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1b0134f00 0x7ff1b011b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1af7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1b0134f00 0x7ff1b011b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44528/0 (socket says 172.21.15.154:44528) 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1af7fe700 1 -- 172.21.15.154:0/2176704898 learned_addr learned my addr 172.21.15.154:0/2176704898 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1aeffd700 1 --2- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b006a770 0x7ff1b011a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.960+0000 7ff1ae7fc700 1 --2- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1b009e070 0x7ff1b011ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff1af7fe700 1 -- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b006a770 msgr2=0x7ff1b011a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff1af7fe700 1 --2- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b006a770 0x7ff1b011a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff1af7fe700 1 -- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1b009e070 msgr2=0x7ff1b011ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff1af7fe700 1 --2- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1b009e070 0x7ff1b011ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff1af7fe700 1 -- 172.21.15.154:0/2176704898 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a8009b30 con 0x7ff1b0134f00 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff1af7fe700 1 --2- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1b0134f00 0x7ff1b011b390 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff1b009f860 tx=0x7ff1a8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff197fff700 1 -- 172.21.15.154:0/2176704898 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8003ea0 con 0x7ff1b0134f00 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2176704898 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b009f220 con 0x7ff1b0134f00 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff197fff700 1 -- 172.21.15.154:0/2176704898 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a80048e0 con 0x7ff1b0134f00 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff197fff700 1 -- 172.21.15.154:0/2176704898 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a801c680 con 0x7ff1b0134f00 2023-09-30T22:28:48.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.961+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2176704898 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b0126d00 con 0x7ff1b0134f00 2023-09-30T22:28:48.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.962+0000 7ff197fff700 1 -- 172.21.15.154:0/2176704898 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1a801c7e0 con 0x7ff1b0134f00 2023-09-30T22:28:48.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.962+0000 7ff197fff700 1 -- 172.21.15.154:0/2176704898 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff1a80412a0 con 0x7ff1b0134f00 2023-09-30T22:28:48.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.963+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2176704898 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b004f2a0 con 0x7ff1b0134f00 2023-09-30T22:28:48.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:48.971+0000 7ff197fff700 1 -- 172.21.15.154:0/2176704898 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1a802d940 con 0x7ff1b0134f00 2023-09-30T22:28:49.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.013+0000 7f18170c1700 1 Processor -- start 2023-09-30T22:28:49.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.013+0000 7f18170c1700 1 -- start start 2023-09-30T22:28:49.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f18170c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18100a0a70 0x7f18100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f18170c1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18100a1380 0x7f1810133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f18170c1700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181009dc00 con 0x7f1810133f50 2023-09-30T22:28:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f18170c1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181009ea60 con 0x7f18100a1380 2023-09-30T22:28:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f18170c1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181009dec0 con 0x7f18100a0a70 2023-09-30T22:28:49.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f1814e5d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18100a0a70 0x7f18100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f1814e5d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18100a0a70 0x7f18100a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44536/0 (socket says 172.21.15.154:44536) 2023-09-30T22:28:49.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f1814e5d700 1 -- 172.21.15.154:0/531574021 learned_addr learned my addr 172.21.15.154:0/531574021 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:49.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f180ffff700 1 --2- 172.21.15.154:0/531574021 >> v2:172.21.15.154:3300/0 conn(0x7f18100a1380 0x7f1810133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f180ffff700 1 -- 172.21.15.154:0/531574021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18100a0a70 msgr2=0x7f18100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:49.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f180ffff700 1 --2- 172.21.15.154:0/531574021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18100a0a70 0x7f18100a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f180ffff700 1 -- 172.21.15.154:0/531574021 >> v1:172.21.15.154:6789/0 conn(0x7f1810133f50 legacy=0x7f181013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.014+0000 7f180ffff700 1 -- 172.21.15.154:0/531574021 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181009e6a0 con 0x7f18100a1380 2023-09-30T22:28:49.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.015+0000 7f1814e5d700 1 --2- 172.21.15.154:0/531574021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18100a0a70 0x7f18100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.015+0000 7f180ffff700 1 --2- 172.21.15.154:0/531574021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a1380 0x7f1810133a10 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009840 tx=0x7f17fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385583e40b3812f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.015+0000 7f180f7fe700 1 -- 172.21.15.154:0/531574021 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc011830 con 0x7f18100a1380 2023-09-30T22:28:49.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.015+0000 7f180f7fe700 1 -- 172.21.15.154:0/531574021 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc011990 con 0x7f18100a1380 2023-09-30T22:28:49.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.015+0000 7f180f7fe700 1 -- 172.21.15.154:0/531574021 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc011d20 con 0x7f18100a1380 2023-09-30T22:28:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.016+0000 7f18170c1700 1 -- 172.21.15.154:0/531574021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a1380 msgr2=0x7f1810133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.016+0000 7f18170c1700 1 --2- 172.21.15.154:0/531574021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a1380 0x7f1810133a10 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009840 tx=0x7f17fc009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.016+0000 7f18170c1700 1 -- 172.21.15.154:0/531574021 shutdown_connections 2023-09-30T22:28:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.016+0000 7f18170c1700 1 --2- 172.21.15.154:0/531574021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18100a0a70 0x7f18100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.016+0000 7f18170c1700 1 --2- 172.21.15.154:0/531574021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a1380 0x7f1810133a10 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.016+0000 7f18170c1700 1 -- 172.21.15.154:0/531574021 >> 172.21.15.154:0/531574021 conn(0x7f18100a6610 msgr2=0x7f18100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.016+0000 7f18170c1700 1 -- 172.21.15.154:0/531574021 shutdown_connections 2023-09-30T22:28:49.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.016+0000 7f18170c1700 1 -- 172.21.15.154:0/531574021 wait complete. 2023-09-30T22:28:49.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.017+0000 7f18170c1700 1 Processor -- start 2023-09-30T22:28:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.017+0000 7f18170c1700 1 -- start start 2023-09-30T22:28:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f18170c1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a0a70 0x7f18101c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f18170c1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18100a1380 0x7f18101c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f18170c1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1810133f50 0x7f18101c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f18170c1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1810124810 con 0x7f18100a0a70 2023-09-30T22:28:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f18170c1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1810125350 con 0x7f1810133f50 2023-09-30T22:28:49.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f18170c1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1810122e80 con 0x7f18100a1380 2023-09-30T22:28:49.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f1814e5d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a0a70 0x7f18101c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f1814e5d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a0a70 0x7f18101c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54496/0 (socket says 172.21.15.154:54496) 2023-09-30T22:28:49.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f180ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18100a1380 0x7f18101c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f1814e5d700 1 -- 172.21.15.154:0/1257019191 learned_addr learned my addr 172.21.15.154:0/1257019191 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:49.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.018+0000 7f181565e700 1 --2- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1810133f50 0x7f18101c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f1814e5d700 1 -- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18100a1380 msgr2=0x7f18101c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f1814e5d700 1 --2- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18100a1380 0x7f18101c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f1814e5d700 1 -- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1810133f50 msgr2=0x7f18101c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f1814e5d700 1 --2- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1810133f50 0x7f18101c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f1814e5d700 1 -- 172.21.15.154:0/1257019191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804009550 con 0x7f18100a0a70 2023-09-30T22:28:49.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f1814e5d700 1 --2- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a0a70 0x7f18101c8270 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f180400ebe0 tx=0x7f180400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f180d7fa700 1 -- 172.21.15.154:0/1257019191 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180400c850 con 0x7f18100a0a70 2023-09-30T22:28:49.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f180d7fa700 1 -- 172.21.15.154:0/1257019191 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180400c9b0 con 0x7f18100a0a70 2023-09-30T22:28:49.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f18170c1700 1 -- 172.21.15.154:0/1257019191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc0094a0 con 0x7f18100a0a70 2023-09-30T22:28:49.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f180d7fa700 1 -- 172.21.15.154:0/1257019191 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180400cd20 con 0x7f18100a0a70 2023-09-30T22:28:49.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.019+0000 7f18170c1700 1 -- 172.21.15.154:0/1257019191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18100a03e0 con 0x7f18100a0a70 2023-09-30T22:28:49.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.020+0000 7f180d7fa700 1 -- 172.21.15.154:0/1257019191 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1804013470 con 0x7f18100a0a70 2023-09-30T22:28:49.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.020+0000 7f180d7fa700 1 -- 172.21.15.154:0/1257019191 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f180403f780 con 0x7f18100a0a70 2023-09-30T22:28:49.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.020+0000 7f18170c1700 1 -- 172.21.15.154:0/1257019191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1810133a50 con 0x7f18100a0a70 2023-09-30T22:28:49.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.029+0000 7f180d7fa700 1 -- 172.21.15.154:0/1257019191 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1810133a50 con 0x7f18100a0a70 2023-09-30T22:28:49.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.052+0000 7f936b458700 1 Processor -- start 2023-09-30T22:28:49.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f936b458700 1 -- start start 2023-09-30T22:28:49.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f936b458700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f936409ad40 0x7f9364133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f936b458700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93641343d0 0x7f93640a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f936b458700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f936409b110 con 0x7f9364133f70 2023-09-30T22:28:49.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f936b458700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640a3b60 con 0x7f936409ad40 2023-09-30T22:28:49.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f936b458700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9364134850 con 0x7f93641343d0 2023-09-30T22:28:49.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f93691f4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f936409ad40 0x7f9364133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f93691f4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f936409ad40 0x7f9364133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54500/0 (socket says 172.21.15.154:54500) 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f93691f4700 1 -- 172.21.15.154:0/1200264526 learned_addr learned my addr 172.21.15.154:0/1200264526 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.053+0000 7f93699f5700 1 --2- 172.21.15.154:0/1200264526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93641343d0 0x7f93640a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.054+0000 7f93691f4700 1 -- 172.21.15.154:0/1200264526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93641343d0 msgr2=0x7f93640a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.054+0000 7f93691f4700 1 --2- 172.21.15.154:0/1200264526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93641343d0 0x7f93640a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.054+0000 7f93691f4700 1 -- 172.21.15.154:0/1200264526 >> v1:172.21.15.154:6789/0 conn(0x7f9364133f70 legacy=0x7f93640a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.054+0000 7f93691f4700 1 -- 172.21.15.154:0/1200264526 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640a2fa0 con 0x7f936409ad40 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.054+0000 7f93699f5700 1 --2- 172.21.15.154:0/1200264526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93641343d0 0x7f93640a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.054+0000 7f93691f4700 1 --2- 172.21.15.154:0/1200264526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936409ad40 0x7f9364133a30 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f93600098f0 tx=0x7f9360009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe1e666f0361060 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.054+0000 7f935bfff700 1 -- 172.21.15.154:0/1200264526 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360011830 con 0x7f936409ad40 2023-09-30T22:28:49.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.054+0000 7f935bfff700 1 -- 172.21.15.154:0/1200264526 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9360011990 con 0x7f936409ad40 2023-09-30T22:28:49.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.054+0000 7f935bfff700 1 -- 172.21.15.154:0/1200264526 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360011d20 con 0x7f936409ad40 2023-09-30T22:28:49.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.055+0000 7f936b458700 1 -- 172.21.15.154:0/1200264526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936409ad40 msgr2=0x7f9364133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.055+0000 7f936b458700 1 --2- 172.21.15.154:0/1200264526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936409ad40 0x7f9364133a30 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f93600098f0 tx=0x7f9360009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.055+0000 7f936b458700 1 -- 172.21.15.154:0/1200264526 shutdown_connections 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.055+0000 7f936b458700 1 --2- 172.21.15.154:0/1200264526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93641343d0 0x7f93640a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.055+0000 7f936b458700 1 --2- 172.21.15.154:0/1200264526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936409ad40 0x7f9364133a30 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.055+0000 7f936b458700 1 -- 172.21.15.154:0/1200264526 >> 172.21.15.154:0/1200264526 conn(0x7f9364099c40 msgr2=0x7f936406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.055+0000 7f936b458700 1 -- 172.21.15.154:0/1200264526 shutdown_connections 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.055+0000 7f936b458700 1 -- 172.21.15.154:0/1200264526 wait complete. 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f936b458700 1 Processor -- start 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f936b458700 1 -- start start 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f936b458700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9364133f70 0x7f93641202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f936b458700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93641343d0 0x7f9364120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f936b458700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9364124260 0x7f9364120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f936b458700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9364121e50 con 0x7f9364124260 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f936b458700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93641230a0 con 0x7f9364133f70 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f936b458700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9364122430 con 0x7f93641343d0 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f93699f5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9364124260 0x7f9364120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f93699f5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9364124260 0x7f9364120d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54508/0 (socket says 172.21.15.154:54508) 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f93699f5700 1 -- 172.21.15.154:0/186940463 learned_addr learned my addr 172.21.15.154:0/186940463 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.056+0000 7f93691f4700 1 --2- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9364133f70 0x7f93641202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f93691f4700 1 -- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93641343d0 msgr2=0x7f9364120810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f93691f4700 1 --2- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93641343d0 0x7f9364120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f93691f4700 1 -- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9364124260 msgr2=0x7f9364120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f93691f4700 1 --2- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9364124260 0x7f9364120d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f93691f4700 1 -- 172.21.15.154:0/186940463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c009a70 con 0x7f9364133f70 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f93699f5700 1 --2- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9364124260 0x7f9364120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f93691f4700 1 --2- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9364133f70 0x7f93641202d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f93640a31c0 tx=0x7f9360004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f9359ffb700 1 -- 172.21.15.154:0/186940463 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93600043c0 con 0x7f9364133f70 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f936b458700 1 -- 172.21.15.154:0/186940463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9360009550 con 0x7f9364133f70 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.057+0000 7f936b458700 1 -- 172.21.15.154:0/186940463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9364123ad0 con 0x7f9364133f70 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.058+0000 7f9359ffb700 1 -- 172.21.15.154:0/186940463 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936001f070 con 0x7f9364133f70 2023-09-30T22:28:49.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.058+0000 7f9359ffb700 1 -- 172.21.15.154:0/186940463 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93600036a0 con 0x7f9364133f70 2023-09-30T22:28:49.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.058+0000 7f936b458700 1 -- 172.21.15.154:0/186940463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93440052e0 con 0x7f9364133f70 2023-09-30T22:28:49.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.059+0000 7f9359ffb700 1 -- 172.21.15.154:0/186940463 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9360021030 con 0x7f9364133f70 2023-09-30T22:28:49.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.060+0000 7fb0c2355700 1 -- 172.21.15.154:0/1681960874 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb0bc06bce0 con 0x7fb0bc0a1470 2023-09-30T22:28:49.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.060+0000 7f9359ffb700 1 -- 172.21.15.154:0/186940463 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9360003d20 con 0x7f9364133f70 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.063+0000 7fb0b8ff9700 1 -- 172.21.15.154:0/1681960874 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0b0017020 con 0x7fb0bc0a1470 2023-09-30T22:28:49.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.063+0000 7f9359ffb700 1 -- 172.21.15.154:0/186940463 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9360024430 con 0x7f9364133f70 2023-09-30T22:28:49.064 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:49.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.066+0000 7fb0c2355700 1 -- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 msgr2=0x7fb0bc119de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.066+0000 7fb0c2355700 1 --2- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc119de0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb0b000c450 tx=0x7fb0b000c760 comp rx=0 tx=0).stop 2023-09-30T22:28:49.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.066+0000 7fb0c2355700 1 -- 172.21.15.154:0/1681960874 shutdown_connections 2023-09-30T22:28:49.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.066+0000 7fb0c2355700 1 --2- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb0bc133a70 0x7fb0bc11a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.066+0000 7fb0c2355700 1 --2- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0bc0a08e0 0x7fb0bc1198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.066+0000 7fb0c2355700 1 --2- 172.21.15.154:0/1681960874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0bc0a1470 0x7fb0bc119de0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.066+0000 7fb0c2355700 1 -- 172.21.15.154:0/1681960874 >> 172.21.15.154:0/1681960874 conn(0x7fb0bc0a2980 msgr2=0x7fb0bc12e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.066+0000 7fb0c2355700 1 -- 172.21.15.154:0/1681960874 shutdown_connections 2023-09-30T22:28:49.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.066+0000 7fb0c2355700 1 -- 172.21.15.154:0/1681960874 wait complete. 2023-09-30T22:28:49.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:49.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.244+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2176704898 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff1b006c3b0 con 0x7ff1b0134f00 2023-09-30T22:28:49.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.245+0000 7ff197fff700 1 -- 172.21.15.154:0/2176704898 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1a802d350 con 0x7ff1b0134f00 2023-09-30T22:28:49.245 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.247+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1b0134f00 msgr2=0x7ff1b011b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.247+0000 7ff1b59bb700 1 --2- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1b0134f00 0x7ff1b011b390 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff1b009f860 tx=0x7ff1a8004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.247+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2176704898 shutdown_connections 2023-09-30T22:28:49.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.247+0000 7ff1b59bb700 1 --2- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1b0134f00 0x7ff1b011b390 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.247+0000 7ff1b59bb700 1 --2- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff1b006a770 0x7ff1b011a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.247+0000 7ff1b59bb700 1 --2- 172.21.15.154:0/2176704898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1b009e070 0x7ff1b011ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.247+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2176704898 >> 172.21.15.154:0/2176704898 conn(0x7ff1b0099c40 msgr2=0x7ff1b00a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.247+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2176704898 shutdown_connections 2023-09-30T22:28:49.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.247+0000 7ff1b59bb700 1 -- 172.21.15.154:0/2176704898 wait complete. 2023-09-30T22:28:49.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:49.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.261+0000 7f936b458700 1 -- 172.21.15.154:0/186940463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9344005150 con 0x7f9364133f70 2023-09-30T22:28:49.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.261+0000 7f9359ffb700 1 -- 172.21.15.154:0/186940463 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9360015030 con 0x7f9364133f70 2023-09-30T22:28:49.261 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:49.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.263+0000 7f936b458700 1 -- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9364133f70 msgr2=0x7f93641202d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.263+0000 7f936b458700 1 --2- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9364133f70 0x7f93641202d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f93640a31c0 tx=0x7f9360004750 comp rx=0 tx=0).stop 2023-09-30T22:28:49.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.263+0000 7f936b458700 1 -- 172.21.15.154:0/186940463 shutdown_connections 2023-09-30T22:28:49.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.263+0000 7f936b458700 1 --2- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9364124260 0x7f9364120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.263+0000 7f936b458700 1 --2- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9364133f70 0x7f93641202d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.263+0000 7f936b458700 1 --2- 172.21.15.154:0/186940463 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f93641343d0 0x7f9364120810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.263+0000 7f936b458700 1 -- 172.21.15.154:0/186940463 >> 172.21.15.154:0/186940463 conn(0x7f9364099c40 msgr2=0x7f93641bb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.263+0000 7f936b458700 1 -- 172.21.15.154:0/186940463 shutdown_connections 2023-09-30T22:28:49.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.263+0000 7f936b458700 1 -- 172.21.15.154:0/186940463 wait complete. 2023-09-30T22:28:49.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:49.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.285+0000 7f18170c1700 1 -- 172.21.15.154:0/1257019191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1810133a50 con 0x7f18100a0a70 2023-09-30T22:28:49.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.286+0000 7f180d7fa700 1 -- 172.21.15.154:0/1257019191 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1810133a50 con 0x7f18100a0a70 2023-09-30T22:28:49.286 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:49.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.288+0000 7f18170c1700 1 -- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a0a70 msgr2=0x7f18101c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:49.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.288+0000 7f18170c1700 1 --2- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a0a70 0x7f18101c8270 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f180400ebe0 tx=0x7f180400eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.288+0000 7f18170c1700 1 -- 172.21.15.154:0/1257019191 shutdown_connections 2023-09-30T22:28:49.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.288+0000 7f18170c1700 1 --2- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1810133f50 0x7f18101c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.288+0000 7f18170c1700 1 --2- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18100a0a70 0x7f18101c8270 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.288+0000 7f18170c1700 1 --2- 172.21.15.154:0/1257019191 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f18100a1380 0x7f18101c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:49.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.288+0000 7f18170c1700 1 -- 172.21.15.154:0/1257019191 >> 172.21.15.154:0/1257019191 conn(0x7f18100a6610 msgr2=0x7f18100a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:49.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.288+0000 7f18170c1700 1 -- 172.21.15.154:0/1257019191 shutdown_connections 2023-09-30T22:28:49.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:49.288+0000 7f18170c1700 1 -- 172.21.15.154:0/1257019191 wait complete. 2023-09-30T22:28:49.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:50.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9c8d4700 1 Processor -- start 2023-09-30T22:28:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9c8d4700 1 -- start start 2023-09-30T22:28:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9c8d4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809e870 0x7f8c9809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9c8d4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c98131f40 0x7f8c98139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9c8d4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9809c970 con 0x7f8c9809f180 2023-09-30T22:28:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9c8d4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980a0920 con 0x7f8c98131f40 2023-09-30T22:28:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9c8d4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9809f9c0 con 0x7f8c9809e870 2023-09-30T22:28:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809e870 0x7f8c9809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c96d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c98131f40 0x7f8c98139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809e870 0x7f8c9809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60166/0 (socket says 172.21.15.154:60166) 2023-09-30T22:28:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c95d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8c9809f180 0x7f8c98131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42650/0 (socket says 172.21.15.154:42650) 2023-09-30T22:28:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.221+0000 7f8c9659c700 1 -- 172.21.15.154:0/317099608 learned_addr learned my addr 172.21.15.154:0/317099608 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c9559a700 1 -- 172.21.15.154:0/317099608 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042145945 0 0) 0x7f8c9809c970 con 0x7f8c9809f180 2023-09-30T22:28:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c9659c700 1 -- 172.21.15.154:0/317099608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c98131f40 msgr2=0x7f8c98139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c9659c700 1 --2- 172.21.15.154:0/317099608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c98131f40 0x7f8c98139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c9659c700 1 -- 172.21.15.154:0/317099608 >> v1:172.21.15.154:6789/0 conn(0x7f8c9809f180 legacy=0x7f8c98131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c9659c700 1 -- 172.21.15.154:0/317099608 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9809bab0 con 0x7f8c9809e870 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c96d9d700 1 --2- 172.21.15.154:0/317099608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c98131f40 0x7f8c98139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c9659c700 1 --2- 172.21.15.154:0/317099608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809e870 0x7f8c9809ec40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009920 tx=0x7f8c88009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=722923530cf96c56 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c9559a700 1 -- 172.21.15.154:0/317099608 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88011830 con 0x7f8c9809e870 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c9559a700 1 -- 172.21.15.154:0/317099608 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88011990 con 0x7f8c9809e870 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.222+0000 7f8c9559a700 1 -- 172.21.15.154:0/317099608 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88011d20 con 0x7f8c9809e870 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.223+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/317099608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809e870 msgr2=0x7f8c9809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.223+0000 7f8c9c8d4700 1 --2- 172.21.15.154:0/317099608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809e870 0x7f8c9809ec40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009920 tx=0x7f8c88009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.223+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/317099608 shutdown_connections 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.223+0000 7f8c9c8d4700 1 --2- 172.21.15.154:0/317099608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c98131f40 0x7f8c98139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.223+0000 7f8c9c8d4700 1 --2- 172.21.15.154:0/317099608 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809e870 0x7f8c9809ec40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.223+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/317099608 >> 172.21.15.154:0/317099608 conn(0x7f8c980a4430 msgr2=0x7f8c980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.223+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/317099608 shutdown_connections 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.223+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/317099608 wait complete. 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c9c8d4700 1 Processor -- start 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c9c8d4700 1 -- start start 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c9c8d4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c9809e870 0x7f8c981200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c9c8d4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809f180 0x7f8c98120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c9c8d4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c98131f40 0x7f8c98120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c9c8d4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98122f40 con 0x7f8c98131f40 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c9c8d4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98121e70 con 0x7f8c9809e870 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c9c8d4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98122b80 con 0x7f8c9809f180 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c95d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809f180 0x7f8c98120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c96d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c98131f40 0x7f8c98120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c95d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809f180 0x7f8c98120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60174/0 (socket says 172.21.15.154:60174) 2023-09-30T22:28:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c95d9b700 1 -- 172.21.15.154:0/1964315136 learned_addr learned my addr 172.21.15.154:0/1964315136 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.224+0000 7f8c9659c700 1 --2- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c9809e870 0x7f8c981200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c95d9b700 1 -- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c9809e870 msgr2=0x7f8c981200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c95d9b700 1 --2- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c9809e870 0x7f8c981200e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c95d9b700 1 -- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c98131f40 msgr2=0x7f8c98120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c95d9b700 1 --2- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c98131f40 0x7f8c98120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c95d9b700 1 -- 172.21.15.154:0/1964315136 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90009a70 con 0x7f8c9809f180 2023-09-30T22:28:50.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c95d9b700 1 --2- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809f180 0x7f8c98120620 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c001eb0 tx=0x7f8c8c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c86ffd700 1 -- 172.21.15.154:0/1964315136 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c004c80 con 0x7f8c9809f180 2023-09-30T22:28:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c86ffd700 1 -- 172.21.15.154:0/1964315136 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c004de0 con 0x7f8c9809f180 2023-09-30T22:28:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c86ffd700 1 -- 172.21.15.154:0/1964315136 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c007310 con 0x7f8c9809f180 2023-09-30T22:28:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/1964315136 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c88009550 con 0x7f8c9809f180 2023-09-30T22:28:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.225+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/1964315136 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c98123660 con 0x7f8c9809f180 2023-09-30T22:28:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.226+0000 7f8c86ffd700 1 -- 172.21.15.154:0/1964315136 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c8c007470 con 0x7f8c9809f180 2023-09-30T22:28:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.226+0000 7f8c86ffd700 1 -- 172.21.15.154:0/1964315136 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c8c03f290 con 0x7f8c9809f180 2023-09-30T22:28:50.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.226+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/1964315136 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9811ce70 con 0x7f8c9809f180 2023-09-30T22:28:50.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.231+0000 7f8c86ffd700 1 -- 172.21.15.154:0/1964315136 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c8c0123b0 con 0x7f8c9809f180 2023-09-30T22:28:50.260 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:50.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:50.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.390+0000 7f61d2345700 1 Processor -- start 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.390+0000 7f61d2345700 1 -- start start 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61d2345700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc133ad0 0x7f61cc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61d2345700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61cc1300a0 0x7f61cc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61d2345700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc06b2d0 con 0x7f61cc1309f0 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61d2345700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc133610 con 0x7f61cc1300a0 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61d2345700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc09a500 con 0x7f61cc133ad0 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc133ad0 0x7f61cc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc133ad0 0x7f61cc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60188/0 (socket says 172.21.15.154:60188) 2023-09-30T22:28:50.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61cbfff700 1 -- 172.21.15.154:0/2621310856 learned_addr learned my addr 172.21.15.154:0/2621310856 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:50.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61cb7fe700 1 --2- 172.21.15.154:0/2621310856 >> v2:172.21.15.154:3300/0 conn(0x7f61cc1300a0 0x7f61cc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61cbfff700 1 -- 172.21.15.154:0/2621310856 >> v2:172.21.15.154:3300/0 conn(0x7f61cc1300a0 msgr2=0x7f61cc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61cbfff700 1 --2- 172.21.15.154:0/2621310856 >> v2:172.21.15.154:3300/0 conn(0x7f61cc1300a0 0x7f61cc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61cbfff700 1 -- 172.21.15.154:0/2621310856 >> v1:172.21.15.154:6789/0 conn(0x7f61cc1309f0 legacy=0x7f61cc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61cbfff700 1 -- 172.21.15.154:0/2621310856 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc1338b0 con 0x7f61cc133ad0 2023-09-30T22:28:50.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.391+0000 7f61cb7fe700 1 --2- 172.21.15.154:0/2621310856 >> v2:172.21.15.154:3300/0 conn(0x7f61cc1300a0 0x7f61cc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61cbfff700 1 --2- 172.21.15.154:0/2621310856 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc133ad0 0x7f61cc133ea0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0098f0 tx=0x7f61bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c560a03580066e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61caffd700 1 -- 172.21.15.154:0/2621310856 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc011830 con 0x7f61cc133ad0 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61caffd700 1 -- 172.21.15.154:0/2621310856 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc011990 con 0x7f61cc133ad0 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61caffd700 1 -- 172.21.15.154:0/2621310856 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc011d20 con 0x7f61cc133ad0 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61d2345700 1 -- 172.21.15.154:0/2621310856 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc133ad0 msgr2=0x7f61cc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61d2345700 1 --2- 172.21.15.154:0/2621310856 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc133ad0 0x7f61cc133ea0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0098f0 tx=0x7f61bc009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61d2345700 1 -- 172.21.15.154:0/2621310856 shutdown_connections 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61d2345700 1 --2- 172.21.15.154:0/2621310856 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc133ad0 0x7f61cc133ea0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61d2345700 1 --2- 172.21.15.154:0/2621310856 >> v2:172.21.15.154:3300/0 conn(0x7f61cc1300a0 0x7f61cc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.392+0000 7f61d2345700 1 -- 172.21.15.154:0/2621310856 >> 172.21.15.154:0/2621310856 conn(0x7f61cc099c40 msgr2=0x7f61cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.393+0000 7f61d2345700 1 -- 172.21.15.154:0/2621310856 shutdown_connections 2023-09-30T22:28:50.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.393+0000 7f61d2345700 1 -- 172.21.15.154:0/2621310856 wait complete. 2023-09-30T22:28:50.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.394+0000 7f61d2345700 1 Processor -- start 2023-09-30T22:28:50.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.394+0000 7f61d2345700 1 -- start start 2023-09-30T22:28:50.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d2345700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc1300a0 0x7f61cc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d2345700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc1309f0 0x7f61cc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d2345700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc133ad0 0x7f61cc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d2345700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc11fde0 con 0x7f61cc133ad0 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d2345700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0a2ea0 con 0x7f61cc1300a0 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d2345700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc12dd00 con 0x7f61cc1309f0 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d08e2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc133ad0 0x7f61cc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d08e2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc133ad0 0x7f61cc11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54534/0 (socket says 172.21.15.154:54534) 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d08e2700 1 -- 172.21.15.154:0/3631195578 learned_addr learned my addr 172.21.15.154:0/3631195578 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61cb7fe700 1 --2- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc1309f0 0x7f61cc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d08e2700 1 -- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc1309f0 msgr2=0x7f61cc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d08e2700 1 --2- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc1309f0 0x7f61cc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d08e2700 1 -- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc1300a0 msgr2=0x7f61cc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d08e2700 1 --2- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc1300a0 0x7f61cc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61d08e2700 1 -- 172.21.15.154:0/3631195578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00094a0 con 0x7f61cc133ad0 2023-09-30T22:28:50.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.395+0000 7f61cb7fe700 1 --2- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc1309f0 0x7f61cc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.396+0000 7f61d08e2700 1 --2- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc133ad0 0x7f61cc11e4c0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f61c400cc50 tx=0x7f61c400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.396+0000 7f61c8ff9700 1 -- 172.21.15.154:0/3631195578 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4003c00 con 0x7f61cc133ad0 2023-09-30T22:28:50.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.396+0000 7f61d2345700 1 -- 172.21.15.154:0/3631195578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc009550 con 0x7f61cc133ad0 2023-09-30T22:28:50.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.396+0000 7f61d2345700 1 -- 172.21.15.154:0/3631195578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc11fb20 con 0x7f61cc133ad0 2023-09-30T22:28:50.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.396+0000 7f61c8ff9700 1 -- 172.21.15.154:0/3631195578 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4003d60 con 0x7f61cc133ad0 2023-09-30T22:28:50.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.396+0000 7f61c8ff9700 1 -- 172.21.15.154:0/3631195578 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c400ab60 con 0x7f61cc133ad0 2023-09-30T22:28:50.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.397+0000 7f61c8ff9700 1 -- 172.21.15.154:0/3631195578 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61c400acc0 con 0x7f61cc133ad0 2023-09-30T22:28:50.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.397+0000 7f61c8ff9700 1 -- 172.21.15.154:0/3631195578 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f61c403f680 con 0x7f61cc133ad0 2023-09-30T22:28:50.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.397+0000 7f61d2345700 1 -- 172.21.15.154:0/3631195578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac0052e0 con 0x7f61cc133ad0 2023-09-30T22:28:50.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.402+0000 7f61c8ff9700 1 -- 172.21.15.154:0/3631195578 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61c40198f0 con 0x7f61cc133ad0 2023-09-30T22:28:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.442+0000 7f150f08e700 1 Processor -- start 2023-09-30T22:28:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.442+0000 7f150f08e700 1 -- start start 2023-09-30T22:28:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150f08e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809d860 0x7f150809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150f08e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f150809e170 0x7f15081307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150f08e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1508130ce0 0x7f1508131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150f08e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150809aaa0 con 0x7f150809e170 2023-09-30T22:28:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150f08e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150809f870 con 0x7f1508130ce0 2023-09-30T22:28:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150f08e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f150809b360 con 0x7f150809d860 2023-09-30T22:28:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150ce2a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809d860 0x7f150809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150ce2a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809d860 0x7f150809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60206/0 (socket says 172.21.15.154:60206) 2023-09-30T22:28:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150ce2a700 1 -- 172.21.15.154:0/1661683032 learned_addr learned my addr 172.21.15.154:0/1661683032 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150d62b700 1 --2- 172.21.15.154:0/1661683032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1508130ce0 0x7f1508131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f1507fff700 1 --2- 172.21.15.154:0/1661683032 >> v2:172.21.15.154:3300/0 conn(0x7f150809e170 0x7f15081307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150d62b700 1 -- 172.21.15.154:0/1661683032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809d860 msgr2=0x7f150809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150d62b700 1 --2- 172.21.15.154:0/1661683032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809d860 0x7f150809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150d62b700 1 -- 172.21.15.154:0/1661683032 >> v2:172.21.15.154:3300/0 conn(0x7f150809e170 msgr2=0x7f15081307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150d62b700 1 --2- 172.21.15.154:0/1661683032 >> v2:172.21.15.154:3300/0 conn(0x7f150809e170 0x7f15081307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150d62b700 1 -- 172.21.15.154:0/1661683032 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150809b620 con 0x7f1508130ce0 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150ce2a700 1 --2- 172.21.15.154:0/1661683032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809d860 0x7f150809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f1507fff700 1 --2- 172.21.15.154:0/1661683032 >> v2:172.21.15.154:3300/0 conn(0x7f150809e170 0x7f15081307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.443+0000 7f150d62b700 1 --2- 172.21.15.154:0/1661683032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1508130ce0 0x7f1508131180 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1500009dc0 tx=0x7f150000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f8278373f6816f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f15077fe700 1 -- 172.21.15.154:0/1661683032 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000e070 con 0x7f1508130ce0 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f15077fe700 1 -- 172.21.15.154:0/1661683032 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150000bae0 con 0x7f1508130ce0 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f15077fe700 1 -- 172.21.15.154:0/1661683032 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000be90 con 0x7f1508130ce0 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f150f08e700 1 -- 172.21.15.154:0/1661683032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1508130ce0 msgr2=0x7f1508131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f150f08e700 1 --2- 172.21.15.154:0/1661683032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1508130ce0 0x7f1508131180 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1500009dc0 tx=0x7f150000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f150f08e700 1 -- 172.21.15.154:0/1661683032 shutdown_connections 2023-09-30T22:28:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f150f08e700 1 --2- 172.21.15.154:0/1661683032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1508130ce0 0x7f1508131180 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f150f08e700 1 --2- 172.21.15.154:0/1661683032 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809d860 0x7f150809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f150f08e700 1 --2- 172.21.15.154:0/1661683032 >> v2:172.21.15.154:3300/0 conn(0x7f150809e170 0x7f15081307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f150f08e700 1 -- 172.21.15.154:0/1661683032 >> 172.21.15.154:0/1661683032 conn(0x7f1508099c40 msgr2=0x7f15080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f150f08e700 1 -- 172.21.15.154:0/1661683032 shutdown_connections 2023-09-30T22:28:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.444+0000 7f150f08e700 1 -- 172.21.15.154:0/1661683032 wait complete. 2023-09-30T22:28:50.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.445+0000 7f150f08e700 1 Processor -- start 2023-09-30T22:28:50.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.445+0000 7f150f08e700 1 -- start start 2023-09-30T22:28:50.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7fc03ac17700 1 Processor -- start 2023-09-30T22:28:50.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7fc03ac17700 1 -- start start 2023-09-30T22:28:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f150f08e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f150809d860 0x7f15081379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f150f08e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809e170 0x7f1508137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f150f08e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1508130ce0 0x7f1508138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f150f08e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1508138b90 con 0x7f1508130ce0 2023-09-30T22:28:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f150f08e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1508139200 con 0x7f150809d860 2023-09-30T22:28:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f150f08e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1508070260 con 0x7f150809e170 2023-09-30T22:28:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f150d62b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1508130ce0 0x7f1508138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f1507fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809e170 0x7f1508137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f1507fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809e170 0x7f1508137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60220/0 (socket says 172.21.15.154:60220) 2023-09-30T22:28:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f150d62b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1508130ce0 0x7f1508138470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54556/0 (socket says 172.21.15.154:54556) 2023-09-30T22:28:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.446+0000 7f1507fff700 1 -- 172.21.15.154:0/958421690 learned_addr learned my addr 172.21.15.154:0/958421690 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc03ac17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 0x7fc03412d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc03ac17700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc034130350 0x7fc0341307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f150d62b700 1 -- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809e170 msgr2=0x7f1508137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f150d62b700 1 --2- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809e170 0x7f1508137f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f150d62b700 1 -- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f150809d860 msgr2=0x7f15081379f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f150d62b700 1 --2- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f150809d860 0x7f15081379f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f150d62b700 1 -- 172.21.15.154:0/958421690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc009550 con 0x7f1508130ce0 2023-09-30T22:28:50.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc03ac17700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03409ae40 con 0x7fc034130ce0 2023-09-30T22:28:50.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc03ac17700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03409b9a0 con 0x7fc034130350 2023-09-30T22:28:50.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc03ac17700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03409bbb0 con 0x7fc03412d280 2023-09-30T22:28:50.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f150d62b700 1 --2- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1508130ce0 0x7f1508138470 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f1500016000 tx=0x7f1500004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc033fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc034130350 0x7fc0341307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc033fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc034130350 0x7fc0341307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54560/0 (socket says 172.21.15.154:54560) 2023-09-30T22:28:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc033fff700 1 -- 172.21.15.154:0/877782522 learned_addr learned my addr 172.21.15.154:0/877782522 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc0389b3700 1 --2- 172.21.15.154:0/877782522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 0x7fc03412d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc033fff700 1 -- 172.21.15.154:0/877782522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 msgr2=0x7fc03412d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc033fff700 1 --2- 172.21.15.154:0/877782522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 0x7fc03412d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc033fff700 1 -- 172.21.15.154:0/877782522 >> v1:172.21.15.154:6789/0 conn(0x7fc034130ce0 legacy=0x7fc034137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7fc033fff700 1 -- 172.21.15.154:0/877782522 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03409b250 con 0x7fc034130350 2023-09-30T22:28:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f15057fa700 1 -- 172.21.15.154:0/958421690 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500004680 con 0x7f1508130ce0 2023-09-30T22:28:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f15057fa700 1 -- 172.21.15.154:0/958421690 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1500020070 con 0x7f1508130ce0 2023-09-30T22:28:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f150f08e700 1 -- 172.21.15.154:0/958421690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f40094a0 con 0x7f1508130ce0 2023-09-30T22:28:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f15057fa700 1 -- 172.21.15.154:0/958421690 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500027480 con 0x7f1508130ce0 2023-09-30T22:28:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.447+0000 7f150f08e700 1 -- 172.21.15.154:0/958421690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1500009a70 con 0x7f1508130ce0 2023-09-30T22:28:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.448+0000 7f150f08e700 1 -- 172.21.15.154:0/958421690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150809c8b0 con 0x7f1508130ce0 2023-09-30T22:28:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.449+0000 7f15057fa700 1 -- 172.21.15.154:0/958421690 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15000275e0 con 0x7f1508130ce0 2023-09-30T22:28:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.449+0000 7f15057fa700 1 -- 172.21.15.154:0/958421690 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1500022070 con 0x7f1508130ce0 2023-09-30T22:28:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.449+0000 7fc033fff700 1 --2- 172.21.15.154:0/877782522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 0x7fc0341307a0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fc0200098f0 tx=0x7fc020009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f750d11dd885be6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.453+0000 7fc0337fe700 1 -- 172.21.15.154:0/877782522 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02000b8a0 con 0x7fc034130350 2023-09-30T22:28:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.453+0000 7fc0337fe700 1 -- 172.21.15.154:0/877782522 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02000ba00 con 0x7fc034130350 2023-09-30T22:28:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.453+0000 7fc0337fe700 1 -- 172.21.15.154:0/877782522 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02000bd90 con 0x7fc034130350 2023-09-30T22:28:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.453+0000 7f15057fa700 1 -- 172.21.15.154:0/958421690 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1500011980 con 0x7f1508130ce0 2023-09-30T22:28:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.454+0000 7fc03ac17700 1 -- 172.21.15.154:0/877782522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 msgr2=0x7fc0341307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.454+0000 7fc03ac17700 1 --2- 172.21.15.154:0/877782522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 0x7fc0341307a0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fc0200098f0 tx=0x7fc020009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.454+0000 7fc03ac17700 1 -- 172.21.15.154:0/877782522 shutdown_connections 2023-09-30T22:28:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.454+0000 7fc03ac17700 1 --2- 172.21.15.154:0/877782522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 0x7fc03412d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.454+0000 7fc03ac17700 1 --2- 172.21.15.154:0/877782522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 0x7fc0341307a0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.454+0000 7fc03ac17700 1 -- 172.21.15.154:0/877782522 >> 172.21.15.154:0/877782522 conn(0x7fc0340a2980 msgr2=0x7fc0340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.454+0000 7fc03ac17700 1 -- 172.21.15.154:0/877782522 shutdown_connections 2023-09-30T22:28:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.454+0000 7fc03ac17700 1 -- 172.21.15.154:0/877782522 wait complete. 2023-09-30T22:28:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.455+0000 7fc03ac17700 1 Processor -- start 2023-09-30T22:28:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.456+0000 7fc03ac17700 1 -- start start 2023-09-30T22:28:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.456+0000 7fc03ac17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 0x7fc03411dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.456+0000 7fc03ac17700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 0x7fc03411e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.456+0000 7fc03ac17700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc034130ce0 0x7fc03411e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.456+0000 7fc03ac17700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc034120140 con 0x7fc034130350 2023-09-30T22:28:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.456+0000 7fc03ac17700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0341206e0 con 0x7fc03412d280 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.456+0000 7fc03ac17700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc03411eff0 con 0x7fc034130ce0 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0391b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc034130ce0 0x7fc03411e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0391b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc034130ce0 0x7fc03411e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60222/0 (socket says 172.21.15.154:60222) 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0391b4700 1 -- 172.21.15.154:0/1807683453 learned_addr learned my addr 172.21.15.154:0/1807683453 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0389b3700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 0x7fc03411dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc033fff700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 0x7fc03411e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0391b4700 1 -- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 msgr2=0x7fc03411dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0391b4700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 0x7fc03411dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0391b4700 1 -- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 msgr2=0x7fc03411e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0391b4700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 0x7fc03411e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0391b4700 1 -- 172.21.15.154:0/1807683453 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc020009550 con 0x7fc034130ce0 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc033fff700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 0x7fc03411e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0391b4700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc034130ce0 0x7fc03411e660 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00cc50 tx=0x7fc02c00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0317fa700 1 -- 172.21.15.154:0/1807683453 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c003c00 con 0x7fc034130ce0 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc03ac17700 1 -- 172.21.15.154:0/1807683453 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03412fd50 con 0x7fc034130ce0 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0317fa700 1 -- 172.21.15.154:0/1807683453 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02c003d60 con 0x7fc034130ce0 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc0317fa700 1 -- 172.21.15.154:0/1807683453 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02c00ab60 con 0x7fc034130ce0 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.457+0000 7fc03ac17700 1 -- 172.21.15.154:0/1807683453 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc034120400 con 0x7fc034130ce0 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.458+0000 7fc03ac17700 1 -- 172.21.15.154:0/1807683453 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03404f2a0 con 0x7fc034130ce0 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.459+0000 7fc0317fa700 1 -- 172.21.15.154:0/1807683453 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc02c00acc0 con 0x7fc034130ce0 2023-09-30T22:28:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.459+0000 7fc0317fa700 1 -- 172.21.15.154:0/1807683453 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc02c040260 con 0x7fc034130ce0 2023-09-30T22:28:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.463+0000 7fc0317fa700 1 -- 172.21.15.154:0/1807683453 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc02c0050d0 con 0x7fc034130ce0 2023-09-30T22:28:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.465+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/1964315136 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c9804f2a0 con 0x7f8c9809f180 2023-09-30T22:28:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.465+0000 7f8c86ffd700 1 -- 172.21.15.154:0/1964315136 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c8c0102c0 con 0x7f8c9809f180 2023-09-30T22:28:50.469 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.468+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809f180 msgr2=0x7f8c98120620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.468+0000 7f8c9c8d4700 1 --2- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809f180 0x7f8c98120620 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c001eb0 tx=0x7f8c8c00c800 comp rx=0 tx=0).stop 2023-09-30T22:28:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.468+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/1964315136 shutdown_connections 2023-09-30T22:28:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.468+0000 7f8c9c8d4700 1 --2- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c98131f40 0x7f8c98120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.468+0000 7f8c9c8d4700 1 --2- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c9809e870 0x7f8c981200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.468+0000 7f8c9c8d4700 1 --2- 172.21.15.154:0/1964315136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8c9809f180 0x7f8c98120620 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.468+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/1964315136 >> 172.21.15.154:0/1964315136 conn(0x7f8c980a4430 msgr2=0x7f8c98072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.468+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/1964315136 shutdown_connections 2023-09-30T22:28:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.469+0000 7f8c9c8d4700 1 -- 172.21.15.154:0/1964315136 wait complete. 2023-09-30T22:28:50.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:50.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.630+0000 7f61d2345700 1 -- 172.21.15.154:0/3631195578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61ac005590 con 0x7f61cc133ad0 2023-09-30T22:28:50.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.631+0000 7f61c8ff9700 1 -- 172.21.15.154:0/3631195578 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61c4011380 con 0x7f61cc133ad0 2023-09-30T22:28:50.631 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:50.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.633+0000 7f61d2345700 1 -- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc133ad0 msgr2=0x7f61cc11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.633+0000 7f61d2345700 1 --2- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc133ad0 0x7f61cc11e4c0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f61c400cc50 tx=0x7f61c400cf60 comp rx=0 tx=0).stop 2023-09-30T22:28:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.633+0000 7f61d2345700 1 -- 172.21.15.154:0/3631195578 shutdown_connections 2023-09-30T22:28:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.633+0000 7f61d2345700 1 --2- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc133ad0 0x7f61cc11e4c0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.633+0000 7f61d2345700 1 --2- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc1300a0 0x7f61cc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.633+0000 7f61d2345700 1 --2- 172.21.15.154:0/3631195578 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f61cc1309f0 0x7f61cc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.633+0000 7f61d2345700 1 -- 172.21.15.154:0/3631195578 >> 172.21.15.154:0/3631195578 conn(0x7f61cc099c40 msgr2=0x7f61cc12f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.633+0000 7f61d2345700 1 -- 172.21.15.154:0/3631195578 shutdown_connections 2023-09-30T22:28:50.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.633+0000 7f61d2345700 1 -- 172.21.15.154:0/3631195578 wait complete. 2023-09-30T22:28:50.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.649+0000 7f150f08e700 1 -- 172.21.15.154:0/958421690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f150806f9e0 con 0x7f1508130ce0 2023-09-30T22:28:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.650+0000 7f15057fa700 1 -- 172.21.15.154:0/958421690 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1500035020 con 0x7f1508130ce0 2023-09-30T22:28:50.650 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.652+0000 7f150f08e700 1 -- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1508130ce0 msgr2=0x7f1508138470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.652+0000 7f150f08e700 1 --2- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1508130ce0 0x7f1508138470 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f1500016000 tx=0x7f1500004ad0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.652+0000 7f150f08e700 1 -- 172.21.15.154:0/958421690 shutdown_connections 2023-09-30T22:28:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.652+0000 7f150f08e700 1 --2- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1508130ce0 0x7f1508138470 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.652+0000 7f150f08e700 1 --2- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f150809d860 0x7f15081379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.652+0000 7f150f08e700 1 --2- 172.21.15.154:0/958421690 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f150809e170 0x7f1508137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.652+0000 7f150f08e700 1 -- 172.21.15.154:0/958421690 >> 172.21.15.154:0/958421690 conn(0x7f1508099c40 msgr2=0x7f150812a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.652+0000 7f150f08e700 1 -- 172.21.15.154:0/958421690 shutdown_connections 2023-09-30T22:28:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.652+0000 7f150f08e700 1 -- 172.21.15.154:0/958421690 wait complete. 2023-09-30T22:28:50.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.659+0000 7fc03ac17700 1 -- 172.21.15.154:0/1807683453 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc03406bce0 con 0x7fc034130ce0 2023-09-30T22:28:50.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.659+0000 7fc0317fa700 1 -- 172.21.15.154:0/1807683453 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc02c011380 con 0x7fc034130ce0 2023-09-30T22:28:50.659 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.662+0000 7fc03ac17700 1 -- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc034130ce0 msgr2=0x7fc03411e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.662+0000 7fc03ac17700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc034130ce0 0x7fc03411e660 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00cc50 tx=0x7fc02c00cf60 comp rx=0 tx=0).stop 2023-09-30T22:28:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.662+0000 7fc03ac17700 1 -- 172.21.15.154:0/1807683453 shutdown_connections 2023-09-30T22:28:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.662+0000 7fc03ac17700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc034130ce0 0x7fc03411e660 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.662+0000 7fc03ac17700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc03412d280 0x7fc03411dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.662+0000 7fc03ac17700 1 --2- 172.21.15.154:0/1807683453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc034130350 0x7fc03411e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.662+0000 7fc03ac17700 1 -- 172.21.15.154:0/1807683453 >> 172.21.15.154:0/1807683453 conn(0x7fc0340a2980 msgr2=0x7fc03412e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.662+0000 7fc03ac17700 1 -- 172.21.15.154:0/1807683453 shutdown_connections 2023-09-30T22:28:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:50.662+0000 7fc03ac17700 1 -- 172.21.15.154:0/1807683453 wait complete. 2023-09-30T22:28:50.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:50.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:51.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.609+0000 7fd3971e9700 1 Processor -- start 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.609+0000 7fd3971e9700 1 -- start start 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd3971e9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd39009f350 0x7fd390136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd3971e9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3901371c0 0x7fd3901395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd3971e9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39009c970 con 0x7fd39009e870 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd3971e9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3900a0920 con 0x7fd39009f350 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd3971e9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39009f9c0 con 0x7fd3901371c0 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd38ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd39009f350 0x7fd390136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd395786700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3901371c0 0x7fd3901395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd38ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd39009f350 0x7fd390136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54574/0 (socket says 172.21.15.154:54574) 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd395786700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3901371c0 0x7fd3901395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44600/0 (socket says 172.21.15.154:44600) 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd38ffff700 1 -- 172.21.15.154:0/1949570151 learned_addr learned my addr 172.21.15.154:0/1949570151 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd38ffff700 1 -- 172.21.15.154:0/1949570151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3901371c0 msgr2=0x7fd3901395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd38ffff700 1 --2- 172.21.15.154:0/1949570151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3901371c0 0x7fd3901395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd38ffff700 1 -- 172.21.15.154:0/1949570151 >> v1:172.21.15.154:6789/0 conn(0x7fd39009e870 legacy=0x7fd39009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd38ffff700 1 -- 172.21.15.154:0/1949570151 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39009bab0 con 0x7fd39009f350 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd395786700 1 --2- 172.21.15.154:0/1949570151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3901371c0 0x7fd3901395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.610+0000 7fd38ffff700 1 --2- 172.21.15.154:0/1949570151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 0x7fd390136c80 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0098f0 tx=0x7fd37c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad93c224c9118b49 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd38f7fe700 1 -- 172.21.15.154:0/1949570151 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011830 con 0x7fd39009f350 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd38f7fe700 1 -- 172.21.15.154:0/1949570151 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c011990 con 0x7fd39009f350 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd38f7fe700 1 -- 172.21.15.154:0/1949570151 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011d20 con 0x7fd39009f350 2023-09-30T22:28:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd3971e9700 1 -- 172.21.15.154:0/1949570151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 msgr2=0x7fd390136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd3971e9700 1 --2- 172.21.15.154:0/1949570151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 0x7fd390136c80 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0098f0 tx=0x7fd37c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd3971e9700 1 -- 172.21.15.154:0/1949570151 shutdown_connections 2023-09-30T22:28:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd3971e9700 1 --2- 172.21.15.154:0/1949570151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3901371c0 0x7fd3901395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd3971e9700 1 --2- 172.21.15.154:0/1949570151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 0x7fd390136c80 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd3971e9700 1 -- 172.21.15.154:0/1949570151 >> 172.21.15.154:0/1949570151 conn(0x7fd3900a4430 msgr2=0x7fd3900a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd3971e9700 1 -- 172.21.15.154:0/1949570151 shutdown_connections 2023-09-30T22:28:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.611+0000 7fd3971e9700 1 -- 172.21.15.154:0/1949570151 wait complete. 2023-09-30T22:28:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.612+0000 7fd3971e9700 1 Processor -- start 2023-09-30T22:28:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.612+0000 7fd3971e9700 1 -- start start 2023-09-30T22:28:51.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd3971e9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd39009e870 0x7fd39011f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd3971e9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 0x7fd39011fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd3971e9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3901371c0 0x7fd3901200c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd3971e9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3901218b0 con 0x7fd39009f350 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd3971e9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd390134f50 con 0x7fd39009e870 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd3971e9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd390123160 con 0x7fd3901371c0 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 0x7fd39011fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd394f85700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd39009e870 0x7fd39011f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 0x7fd39011fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54586/0 (socket says 172.21.15.154:54586) 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd38ffff700 1 -- 172.21.15.154:0/628981159 learned_addr learned my addr 172.21.15.154:0/628981159 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd395786700 1 --2- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3901371c0 0x7fd3901200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd394f85700 1 -- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3901371c0 msgr2=0x7fd3901200c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd394f85700 1 --2- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3901371c0 0x7fd3901200c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd394f85700 1 -- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 msgr2=0x7fd39011fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd394f85700 1 --2- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 0x7fd39011fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd394f85700 1 -- 172.21.15.154:0/628981159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009a70 con 0x7fd39009e870 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd38ffff700 1 --2- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 0x7fd39011fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd394f85700 1 --2- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd39009e870 0x7fd39011f640 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd384000f60 tx=0x7fd38400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd38d7fa700 1 -- 172.21.15.154:0/628981159 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840052d0 con 0x7fd39009e870 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd38d7fa700 1 -- 172.21.15.154:0/628981159 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd384005430 con 0x7fd39009e870 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd3971e9700 1 -- 172.21.15.154:0/628981159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c009550 con 0x7fd39009e870 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd38d7fa700 1 -- 172.21.15.154:0/628981159 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840038c0 con 0x7fd39009e870 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.613+0000 7fd3971e9700 1 -- 172.21.15.154:0/628981159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd390122bc0 con 0x7fd39009e870 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.614+0000 7fd38d7fa700 1 -- 172.21.15.154:0/628981159 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd384003a20 con 0x7fd39009e870 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.614+0000 7fd38d7fa700 1 -- 172.21.15.154:0/628981159 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd38403e950 con 0x7fd39009e870 2023-09-30T22:28:51.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.614+0000 7fd3971e9700 1 -- 172.21.15.154:0/628981159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39004f2a0 con 0x7fd39009e870 2023-09-30T22:28:51.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.619+0000 7fd38d7fa700 1 -- 172.21.15.154:0/628981159 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd384017070 con 0x7fd39009e870 2023-09-30T22:28:51.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:51.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:51.675 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:51.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.788+0000 7f838718f700 1 Processor -- start 2023-09-30T22:28:51.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.788+0000 7f838718f700 1 -- start start 2023-09-30T22:28:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f838718f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f838009e950 0x7f838009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f838718f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009f260 0x7f8380131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f838718f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8380131dd0 0x7f8380132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f838718f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838009b6d0 con 0x7f838009e950 2023-09-30T22:28:51.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f838718f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838009afb0 con 0x7f8380131dd0 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f838718f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83800a0970 con 0x7f838009f260 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f837ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009f260 0x7f8380131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f838572c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8380131dd0 0x7f8380132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f837ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009f260 0x7f8380131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60238/0 (socket says 172.21.15.154:60238) 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f838572c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8380131dd0 0x7f8380132250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44618/0 (socket says 172.21.15.154:44618) 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f837ffff700 1 -- 172.21.15.154:0/1454554359 learned_addr learned my addr 172.21.15.154:0/1454554359 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.789+0000 7f8384f2b700 1 --2- 172.21.15.154:0/1454554359 >> v2:172.21.15.154:3300/0 conn(0x7f838009e950 0x7f838009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f838572c700 1 -- 172.21.15.154:0/1454554359 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009f260 msgr2=0x7f8380131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f838572c700 1 --2- 172.21.15.154:0/1454554359 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009f260 0x7f8380131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f838572c700 1 -- 172.21.15.154:0/1454554359 >> v2:172.21.15.154:3300/0 conn(0x7f838009e950 msgr2=0x7f838009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f838572c700 1 --2- 172.21.15.154:0/1454554359 >> v2:172.21.15.154:3300/0 conn(0x7f838009e950 0x7f838009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f838572c700 1 -- 172.21.15.154:0/1454554359 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800a0320 con 0x7f8380131dd0 2023-09-30T22:28:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f837ffff700 1 --2- 172.21.15.154:0/1454554359 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009f260 0x7f8380131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f8384f2b700 1 --2- 172.21.15.154:0/1454554359 >> v2:172.21.15.154:3300/0 conn(0x7f838009e950 0x7f838009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f838572c700 1 --2- 172.21.15.154:0/1454554359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8380131dd0 0x7f8380132250 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8378009d90 tx=0x7f837800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25408887ca85772d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f837f7fe700 1 -- 172.21.15.154:0/1454554359 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837800e070 con 0x7f8380131dd0 2023-09-30T22:28:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f837f7fe700 1 -- 172.21.15.154:0/1454554359 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837800bb20 con 0x7f8380131dd0 2023-09-30T22:28:51.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.790+0000 7f837f7fe700 1 -- 172.21.15.154:0/1454554359 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378012430 con 0x7f8380131dd0 2023-09-30T22:28:51.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.791+0000 7f838718f700 1 -- 172.21.15.154:0/1454554359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8380131dd0 msgr2=0x7f8380132250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.791+0000 7f838718f700 1 --2- 172.21.15.154:0/1454554359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8380131dd0 0x7f8380132250 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8378009d90 tx=0x7f837800b330 comp rx=0 tx=0).stop 2023-09-30T22:28:51.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.791+0000 7f838718f700 1 -- 172.21.15.154:0/1454554359 shutdown_connections 2023-09-30T22:28:51.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.791+0000 7f838718f700 1 --2- 172.21.15.154:0/1454554359 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8380131dd0 0x7f8380132250 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.791+0000 7f838718f700 1 --2- 172.21.15.154:0/1454554359 >> v2:172.21.15.154:3300/0 conn(0x7f838009e950 0x7f838009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.791+0000 7f838718f700 1 --2- 172.21.15.154:0/1454554359 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009f260 0x7f8380131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.791+0000 7f838718f700 1 -- 172.21.15.154:0/1454554359 >> 172.21.15.154:0/1454554359 conn(0x7f83800a0f70 msgr2=0x7f83800a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.791+0000 7f838718f700 1 -- 172.21.15.154:0/1454554359 shutdown_connections 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.791+0000 7f838718f700 1 -- 172.21.15.154:0/1454554359 wait complete. 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.792+0000 7f838718f700 1 Processor -- start 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.792+0000 7f838718f700 1 -- start start 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f838718f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009e950 0x7f838011bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f838718f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f838009f260 0x7f838011c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f838718f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8380131dd0 0x7f838011c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f838718f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83801203b0 con 0x7f8380131dd0 2023-09-30T22:28:51.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f838718f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838011dae0 con 0x7f838009f260 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f838718f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838011ed30 con 0x7f838009e950 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f838572c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8380131dd0 0x7f838011c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f8384f2b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009e950 0x7f838011bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f838572c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8380131dd0 0x7f838011c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54608/0 (socket says 172.21.15.154:54608) 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f8384f2b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009e950 0x7f838011bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60250/0 (socket says 172.21.15.154:60250) 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f838572c700 1 -- 172.21.15.154:0/3850755528 learned_addr learned my addr 172.21.15.154:0/3850755528 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.793+0000 7f837ffff700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f838009f260 0x7f838011c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f8384f2b700 1 -- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f838009f260 msgr2=0x7f838011c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f8384f2b700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f838009f260 0x7f838011c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f8384f2b700 1 -- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8380131dd0 msgr2=0x7f838011c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f8384f2b700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8380131dd0 0x7f838011c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f8384f2b700 1 -- 172.21.15.154:0/3850755528 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c009550 con 0x7f838009e950 2023-09-30T22:28:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f838572c700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8380131dd0 0x7f838011c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f837ffff700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f838009f260 0x7f838011c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f8384f2b700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009e950 0x7f838011bed0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f837400e870 tx=0x7f837400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f837d7fa700 1 -- 172.21.15.154:0/3850755528 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400c070 con 0x7f838009e950 2023-09-30T22:28:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f837d7fa700 1 -- 172.21.15.154:0/3850755528 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374005c20 con 0x7f838009e950 2023-09-30T22:28:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f838718f700 1 -- 172.21.15.154:0/3850755528 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8378009a70 con 0x7f838009e950 2023-09-30T22:28:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f837d7fa700 1 -- 172.21.15.154:0/3850755528 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374006030 con 0x7f838009e950 2023-09-30T22:28:51.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.794+0000 7f838718f700 1 -- 172.21.15.154:0/3850755528 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838009d4f0 con 0x7f838009e950 2023-09-30T22:28:51.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.795+0000 7f837d7fa700 1 -- 172.21.15.154:0/3850755528 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8374006190 con 0x7f838009e950 2023-09-30T22:28:51.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.795+0000 7f837d7fa700 1 -- 172.21.15.154:0/3850755528 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f837403f3f0 con 0x7f838009e950 2023-09-30T22:28:51.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.795+0000 7f838718f700 1 -- 172.21.15.154:0/3850755528 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83800711d0 con 0x7f838009e950 2023-09-30T22:28:51.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.800+0000 7f837d7fa700 1 -- 172.21.15.154:0/3850755528 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f837401a940 con 0x7f838009e950 2023-09-30T22:28:51.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a91fe700 1 Processor -- start 2023-09-30T22:28:51.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a91fe700 1 -- start start 2023-09-30T22:28:51.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a91fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a91fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24a4134120 0x7f24a413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a91fe700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a409dc00 con 0x7f24a40a1380 2023-09-30T22:28:51.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a91fe700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a409ea60 con 0x7f24a4134120 2023-09-30T22:28:51.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a91fe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a409dec0 con 0x7f24a40a0a70 2023-09-30T22:28:51.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60254/0 (socket says 172.21.15.154:60254) 2023-09-30T22:28:51.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a2d9d700 1 -- 172.21.15.154:0/1863357524 learned_addr learned my addr 172.21.15.154:0/1863357524 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:51.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.819+0000 7f24a359e700 1 --2- 172.21.15.154:0/1863357524 >> v2:172.21.15.154:3300/0 conn(0x7f24a4134120 0x7f24a413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.820+0000 7f24a1d9b700 1 -- 172.21.15.154:0/1863357524 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353164705 0 0) 0x7f24a409dc00 con 0x7f24a40a1380 2023-09-30T22:28:51.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.820+0000 7f24a2d9d700 1 -- 172.21.15.154:0/1863357524 >> v2:172.21.15.154:3300/0 conn(0x7f24a4134120 msgr2=0x7f24a413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:51.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.820+0000 7f24a2d9d700 1 --2- 172.21.15.154:0/1863357524 >> v2:172.21.15.154:3300/0 conn(0x7f24a4134120 0x7f24a413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.820+0000 7f24a2d9d700 1 -- 172.21.15.154:0/1863357524 >> v1:172.21.15.154:6789/0 conn(0x7f24a40a1380 legacy=0x7f24a4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.820+0000 7f24a2d9d700 1 -- 172.21.15.154:0/1863357524 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a409e6a0 con 0x7f24a40a0a70 2023-09-30T22:28:51.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.820+0000 7f24a2d9d700 1 --2- 172.21.15.154:0/1863357524 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f24940098f0 tx=0x7f2494009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2efd47ff313b1bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.820+0000 7f24a1d9b700 1 -- 172.21.15.154:0/1863357524 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494011830 con 0x7f24a40a0a70 2023-09-30T22:28:51.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.820+0000 7f24a1d9b700 1 -- 172.21.15.154:0/1863357524 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2494011990 con 0x7f24a40a0a70 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.820+0000 7f24a1d9b700 1 -- 172.21.15.154:0/1863357524 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494011d20 con 0x7f24a40a0a70 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.821+0000 7f24a91fe700 1 -- 172.21.15.154:0/1863357524 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a0a70 msgr2=0x7f24a40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.821+0000 7f24a91fe700 1 --2- 172.21.15.154:0/1863357524 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f24940098f0 tx=0x7f2494009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.821+0000 7f24a91fe700 1 -- 172.21.15.154:0/1863357524 shutdown_connections 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.821+0000 7f24a91fe700 1 --2- 172.21.15.154:0/1863357524 >> v2:172.21.15.154:3300/0 conn(0x7f24a4134120 0x7f24a413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.821+0000 7f24a91fe700 1 --2- 172.21.15.154:0/1863357524 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a0a70 0x7f24a40a0e40 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.821+0000 7f24a91fe700 1 -- 172.21.15.154:0/1863357524 >> 172.21.15.154:0/1863357524 conn(0x7f24a40a6610 msgr2=0x7f24a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.821+0000 7f24a91fe700 1 -- 172.21.15.154:0/1863357524 shutdown_connections 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.821+0000 7f24a91fe700 1 -- 172.21.15.154:0/1863357524 wait complete. 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.822+0000 7f24a91fe700 1 Processor -- start 2023-09-30T22:28:51.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.822+0000 7f24a91fe700 1 -- start start 2023-09-30T22:28:51.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a91fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a40a0a70 0x7f24a41226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a91fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a1380 0x7f24a4122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a91fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4134120 0x7f24a4123170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a91fe700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a41332f0 con 0x7f24a4134120 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a91fe700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a41258f0 con 0x7f24a40a0a70 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a91fe700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4123b50 con 0x7f24a40a1380 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a1380 0x7f24a4122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a1380 0x7f24a4122c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60264/0 (socket says 172.21.15.154:60264) 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a259c700 1 -- 172.21.15.154:0/1381452919 learned_addr learned my addr 172.21.15.154:0/1381452919 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a2d9d700 1 --2- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a40a0a70 0x7f24a41226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a359e700 1 --2- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4134120 0x7f24a4123170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a259c700 1 -- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a40a0a70 msgr2=0x7f24a41226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a259c700 1 --2- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a40a0a70 0x7f24a41226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a259c700 1 -- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4134120 msgr2=0x7f24a4123170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a259c700 1 --2- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4134120 0x7f24a4123170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a259c700 1 -- 172.21.15.154:0/1381452919 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494009550 con 0x7f24a40a1380 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.823+0000 7f24a259c700 1 --2- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a1380 0x7f24a4122c30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f249800c580 tx=0x7f249800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.824+0000 7f248b7fe700 1 -- 172.21.15.154:0/1381452919 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24980054e0 con 0x7f24a40a1380 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.824+0000 7f248b7fe700 1 -- 172.21.15.154:0/1381452919 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2498003680 con 0x7f24a40a1380 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.824+0000 7f248b7fe700 1 -- 172.21.15.154:0/1381452919 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498003a30 con 0x7f24a40a1380 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.824+0000 7f24a91fe700 1 -- 172.21.15.154:0/1381452919 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a4126210 con 0x7f24a40a1380 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.824+0000 7f24a91fe700 1 -- 172.21.15.154:0/1381452919 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40a03e0 con 0x7f24a40a1380 2023-09-30T22:28:51.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.825+0000 7f248b7fe700 1 -- 172.21.15.154:0/1381452919 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2498003b90 con 0x7f24a40a1380 2023-09-30T22:28:51.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.825+0000 7f248b7fe700 1 -- 172.21.15.154:0/1381452919 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f249803eb90 con 0x7f24a40a1380 2023-09-30T22:28:51.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.826+0000 7f24a91fe700 1 -- 172.21.15.154:0/1381452919 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a404f2a0 con 0x7f24a40a1380 2023-09-30T22:28:51.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.826+0000 7fd3971e9700 1 -- 172.21.15.154:0/628981159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd390121a40 con 0x7fd39009e870 2023-09-30T22:28:51.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.829+0000 7fd38d7fa700 1 -- 172.21.15.154:0/628981159 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd384011590 con 0x7fd39009e870 2023-09-30T22:28:51.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.830+0000 7f248b7fe700 1 -- 172.21.15.154:0/1381452919 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2498017020 con 0x7f24a40a1380 2023-09-30T22:28:51.830 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:51.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.832+0000 7fd3971e9700 1 -- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd39009e870 msgr2=0x7fd39011f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.832+0000 7fd3971e9700 1 --2- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd39009e870 0x7fd39011f640 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd384000f60 tx=0x7fd38400c730 comp rx=0 tx=0).stop 2023-09-30T22:28:51.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.832+0000 7fd3971e9700 1 -- 172.21.15.154:0/628981159 shutdown_connections 2023-09-30T22:28:51.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.832+0000 7fd3971e9700 1 --2- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd3901371c0 0x7fd3901200c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.832+0000 7fd3971e9700 1 --2- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd39009e870 0x7fd39011f640 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.833+0000 7fd3971e9700 1 --2- 172.21.15.154:0/628981159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd39009f350 0x7fd39011fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.833+0000 7fd3971e9700 1 -- 172.21.15.154:0/628981159 >> 172.21.15.154:0/628981159 conn(0x7fd3900a4430 msgr2=0x7fd39009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:51.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.833+0000 7fd3971e9700 1 -- 172.21.15.154:0/628981159 shutdown_connections 2023-09-30T22:28:51.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.833+0000 7fd3971e9700 1 -- 172.21.15.154:0/628981159 wait complete. 2023-09-30T22:28:51.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.841+0000 7efddc0f8700 1 Processor -- start 2023-09-30T22:28:51.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.841+0000 7efddc0f8700 1 -- start start 2023-09-30T22:28:51.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efddc0f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efddc0f8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efdd4130bc0 0x7efdd413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efddc0f8700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd406b2d0 con 0x7efdd41300a0 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efddc0f8700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd4133610 con 0x7efdd4130bc0 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efddc0f8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd409a500 con 0x7efdd4133ad0 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdd9e94700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdd9e94700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60272/0 (socket says 172.21.15.154:60272) 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdd9693700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efdd41300a0 0x7efdd41304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42718/0 (socket says 172.21.15.154:42718) 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdd9e94700 1 -- 172.21.15.154:0/573987755 learned_addr learned my addr 172.21.15.154:0/573987755 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdda695700 1 --2- 172.21.15.154:0/573987755 >> v2:172.21.15.154:3300/0 conn(0x7efdd4130bc0 0x7efdd413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdd9e94700 1 -- 172.21.15.154:0/573987755 >> v2:172.21.15.154:3300/0 conn(0x7efdd4130bc0 msgr2=0x7efdd413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdd9e94700 1 --2- 172.21.15.154:0/573987755 >> v2:172.21.15.154:3300/0 conn(0x7efdd4130bc0 0x7efdd413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdd9e94700 1 -- 172.21.15.154:0/573987755 >> v1:172.21.15.154:6789/0 conn(0x7efdd41300a0 legacy=0x7efdd41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdd9e94700 1 -- 172.21.15.154:0/573987755 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd41338b0 con 0x7efdd4133ad0 2023-09-30T22:28:51.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.842+0000 7efdd9e94700 1 --2- 172.21.15.154:0/573987755 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd4133ea0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7efdd00098f0 tx=0x7efdd0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfe9a36f882e606c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.843+0000 7efdd8e92700 1 -- 172.21.15.154:0/573987755 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0011830 con 0x7efdd4133ad0 2023-09-30T22:28:51.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.843+0000 7efdd8e92700 1 -- 172.21.15.154:0/573987755 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0011990 con 0x7efdd4133ad0 2023-09-30T22:28:51.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.843+0000 7efdd8e92700 1 -- 172.21.15.154:0/573987755 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0011d20 con 0x7efdd4133ad0 2023-09-30T22:28:51.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.843+0000 7efddc0f8700 1 -- 172.21.15.154:0/573987755 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 msgr2=0x7efdd4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.843+0000 7efddc0f8700 1 --2- 172.21.15.154:0/573987755 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd4133ea0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7efdd00098f0 tx=0x7efdd0009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:51.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.843+0000 7efddc0f8700 1 -- 172.21.15.154:0/573987755 shutdown_connections 2023-09-30T22:28:51.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.843+0000 7efddc0f8700 1 --2- 172.21.15.154:0/573987755 >> v2:172.21.15.154:3300/0 conn(0x7efdd4130bc0 0x7efdd413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.843+0000 7efddc0f8700 1 --2- 172.21.15.154:0/573987755 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd4133ea0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.843+0000 7efddc0f8700 1 -- 172.21.15.154:0/573987755 >> 172.21.15.154:0/573987755 conn(0x7efdd4099c40 msgr2=0x7efdd40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.844+0000 7efddc0f8700 1 -- 172.21.15.154:0/573987755 shutdown_connections 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.844+0000 7efddc0f8700 1 -- 172.21.15.154:0/573987755 wait complete. 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.844+0000 7efddc0f8700 1 Processor -- start 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.844+0000 7efddc0f8700 1 -- start start 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efddc0f8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd41300a0 0x7efdd411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efddc0f8700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd4130bc0 0x7efdd411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efddc0f8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efddc0f8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd411fb90 con 0x7efdd41300a0 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efddc0f8700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd412da50 con 0x7efdd4130bc0 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efddc0f8700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4072230 con 0x7efdd4133ad0 2023-09-30T22:28:51.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efdd9693700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd4130bc0 0x7efdd411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efdd9693700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd4130bc0 0x7efdd411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44646/0 (socket says 172.21.15.154:44646) 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efdd9693700 1 -- 172.21.15.154:0/469652449 learned_addr learned my addr 172.21.15.154:0/469652449 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efdd9e94700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd41300a0 0x7efdd411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.845+0000 7efdda695700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdd9e94700 1 -- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 msgr2=0x7efdd411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdd9e94700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdd9e94700 1 -- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd4130bc0 msgr2=0x7efdd411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdd9e94700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd4130bc0 0x7efdd411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdd9e94700 1 -- 172.21.15.154:0/469652449 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0009550 con 0x7efdd41300a0 2023-09-30T22:28:51.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdd9693700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd4130bc0 0x7efdd411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:51.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:51.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdd9e94700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd41300a0 0x7efdd411da40 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7efdd0016000 tx=0x7efdd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:51.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdca7fc700 1 -- 172.21.15.154:0/469652449 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd00036a0 con 0x7efdd41300a0 2023-09-30T22:28:51.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdca7fc700 1 -- 172.21.15.154:0/469652449 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0003800 con 0x7efdd41300a0 2023-09-30T22:28:51.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efddc0f8700 1 -- 172.21.15.154:0/469652449 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd411fe50 con 0x7efdd41300a0 2023-09-30T22:28:51.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efdca7fc700 1 -- 172.21.15.154:0/469652449 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0003b90 con 0x7efdd41300a0 2023-09-30T22:28:51.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.846+0000 7efddc0f8700 1 -- 172.21.15.154:0/469652449 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd412fbb0 con 0x7efdd41300a0 2023-09-30T22:28:51.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.847+0000 7efddc0f8700 1 -- 172.21.15.154:0/469652449 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd40718c0 con 0x7efdd41300a0 2023-09-30T22:28:51.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.848+0000 7efdca7fc700 1 -- 172.21.15.154:0/469652449 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdd0021070 con 0x7efdd41300a0 2023-09-30T22:28:51.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.848+0000 7efdca7fc700 1 -- 172.21.15.154:0/469652449 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efdd0040e90 con 0x7efdd41300a0 2023-09-30T22:28:51.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:51.852+0000 7efdca7fc700 1 -- 172.21.15.154:0/469652449 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdd0010380 con 0x7efdd41300a0 2023-09-30T22:28:52.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.029+0000 7f838718f700 1 -- 172.21.15.154:0/3850755528 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f838004f2a0 con 0x7f838009e950 2023-09-30T22:28:52.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.029+0000 7f837d7fa700 1 -- 172.21.15.154:0/3850755528 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f837401b3a0 con 0x7f838009e950 2023-09-30T22:28:52.029 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.031+0000 7f838718f700 1 -- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009e950 msgr2=0x7f838011bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.031+0000 7f838718f700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009e950 0x7f838011bed0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f837400e870 tx=0x7f837400eb80 comp rx=0 tx=0).stop 2023-09-30T22:28:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.031+0000 7f838718f700 1 -- 172.21.15.154:0/3850755528 shutdown_connections 2023-09-30T22:28:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.031+0000 7f838718f700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8380131dd0 0x7f838011c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.031+0000 7f838718f700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f838009e950 0x7f838011bed0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.031+0000 7f838718f700 1 --2- 172.21.15.154:0/3850755528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f838009f260 0x7f838011c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.031+0000 7f838718f700 1 -- 172.21.15.154:0/3850755528 >> 172.21.15.154:0/3850755528 conn(0x7f83800a0f70 msgr2=0x7f8380130fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.031+0000 7f838718f700 1 -- 172.21.15.154:0/3850755528 shutdown_connections 2023-09-30T22:28:52.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.031+0000 7f838718f700 1 -- 172.21.15.154:0/3850755528 wait complete. 2023-09-30T22:28:52.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:52.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.047+0000 7f24a91fe700 1 -- 172.21.15.154:0/1381452919 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24a4072980 con 0x7f24a40a1380 2023-09-30T22:28:52.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.048+0000 7f248b7fe700 1 -- 172.21.15.154:0/1381452919 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2498003e40 con 0x7f24a40a1380 2023-09-30T22:28:52.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.048+0000 7efddc0f8700 1 -- 172.21.15.154:0/469652449 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efdd404f2a0 con 0x7efdd41300a0 2023-09-30T22:28:52.048 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:52.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.048+0000 7efdca7fc700 1 -- 172.21.15.154:0/469652449 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdd0015030 con 0x7efdd41300a0 2023-09-30T22:28:52.049 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:52.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7f24a91fe700 1 -- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a1380 msgr2=0x7f24a4122c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7f24a91fe700 1 --2- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a1380 0x7f24a4122c30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f249800c580 tx=0x7f249800c890 comp rx=0 tx=0).stop 2023-09-30T22:28:52.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7f24a91fe700 1 -- 172.21.15.154:0/1381452919 shutdown_connections 2023-09-30T22:28:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7f24a91fe700 1 --2- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24a4134120 0x7f24a4123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7f24a91fe700 1 --2- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24a40a0a70 0x7f24a41226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7f24a91fe700 1 --2- 172.21.15.154:0/1381452919 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f24a40a1380 0x7f24a4122c30 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7f24a91fe700 1 -- 172.21.15.154:0/1381452919 >> 172.21.15.154:0/1381452919 conn(0x7f24a40a6610 msgr2=0x7f24a40a5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7f24a91fe700 1 -- 172.21.15.154:0/1381452919 shutdown_connections 2023-09-30T22:28:52.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7f24a91fe700 1 -- 172.21.15.154:0/1381452919 wait complete. 2023-09-30T22:28:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7efddc0f8700 1 -- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd41300a0 msgr2=0x7efdd411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.050+0000 7efddc0f8700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd41300a0 0x7efdd411da40 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7efdd0016000 tx=0x7efdd0004750 comp rx=0 tx=0).stop 2023-09-30T22:28:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.051+0000 7efddc0f8700 1 -- 172.21.15.154:0/469652449 shutdown_connections 2023-09-30T22:28:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.051+0000 7efddc0f8700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7efdd4133ad0 0x7efdd411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.051+0000 7efddc0f8700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd41300a0 0x7efdd411da40 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.051+0000 7efddc0f8700 1 --2- 172.21.15.154:0/469652449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd4130bc0 0x7efdd411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.051+0000 7efddc0f8700 1 -- 172.21.15.154:0/469652449 >> 172.21.15.154:0/469652449 conn(0x7efdd4099c40 msgr2=0x7efdd40a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.051+0000 7efddc0f8700 1 -- 172.21.15.154:0/469652449 shutdown_connections 2023-09-30T22:28:52.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.051+0000 7efddc0f8700 1 -- 172.21.15.154:0/469652449 wait complete. 2023-09-30T22:28:52.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:52.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:52.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:52.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af3074700 1 Processor -- start 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af3074700 1 -- start start 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af3074700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09e870 0x7f2aec09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af3074700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09f180 0x7f2aec133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af3074700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aec134160 0x7f2aec134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af3074700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec09fdd0 con 0x7f2aec134160 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af3074700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec06bec0 con 0x7f2aec09e870 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af3074700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec06b990 con 0x7f2aec09f180 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2aebfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09f180 0x7f2aec133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af0e10700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09e870 0x7f2aec09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af1611700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aec134160 0x7f2aec134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af0e10700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09e870 0x7f2aec09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44656/0 (socket says 172.21.15.154:44656) 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2aebfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09f180 0x7f2aec133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60292/0 (socket says 172.21.15.154:60292) 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.978+0000 7f2af0e10700 1 -- 172.21.15.154:0/3435821795 learned_addr learned my addr 172.21.15.154:0/3435821795 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2af1611700 1 -- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09f180 msgr2=0x7f2aec133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2af1611700 1 --2- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09f180 0x7f2aec133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2af1611700 1 -- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09e870 msgr2=0x7f2aec09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2af1611700 1 --2- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09e870 0x7f2aec09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2af1611700 1 -- 172.21.15.154:0/3435821795 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0a0870 con 0x7f2aec134160 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2af0e10700 1 --2- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09e870 0x7f2aec09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2aebfff700 1 --2- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09f180 0x7f2aec133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:52.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2af1611700 1 --2- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 0x7f2aec134600 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009d90 tx=0x7f2ae400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7145a627625e4ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2aeb7fe700 1 -- 172.21.15.154:0/3435821795 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400e070 con 0x7f2aec134160 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2aeb7fe700 1 -- 172.21.15.154:0/3435821795 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae400bb20 con 0x7f2aec134160 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.979+0000 7f2aeb7fe700 1 -- 172.21.15.154:0/3435821795 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4012430 con 0x7f2aec134160 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.980+0000 7f2af3074700 1 -- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 msgr2=0x7f2aec134600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.980+0000 7f2af3074700 1 --2- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 0x7f2aec134600 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009d90 tx=0x7f2ae400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.980+0000 7f2af3074700 1 -- 172.21.15.154:0/3435821795 shutdown_connections 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.980+0000 7f2af3074700 1 --2- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09e870 0x7f2aec09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.980+0000 7f2af3074700 1 --2- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 0x7f2aec134600 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.980+0000 7f2af3074700 1 --2- 172.21.15.154:0/3435821795 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09f180 0x7f2aec133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.980+0000 7f2af3074700 1 -- 172.21.15.154:0/3435821795 >> 172.21.15.154:0/3435821795 conn(0x7f2aec0a4430 msgr2=0x7f2aec0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.980+0000 7f2af3074700 1 -- 172.21.15.154:0/3435821795 shutdown_connections 2023-09-30T22:28:52.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.980+0000 7f2af3074700 1 -- 172.21.15.154:0/3435821795 wait complete. 2023-09-30T22:28:52.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af3074700 1 Processor -- start 2023-09-30T22:28:52.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af3074700 1 -- start start 2023-09-30T22:28:52.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af3074700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09e870 0x7f2aec122730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af3074700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09f180 0x7f2aec122c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af3074700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 0x7f2aec1231b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:52.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af3074700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec1259e0 con 0x7f2aec134160 2023-09-30T22:28:52.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af3074700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0a3d00 con 0x7f2aec09f180 2023-09-30T22:28:52.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af3074700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec125160 con 0x7f2aec09e870 2023-09-30T22:28:52.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af0e10700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09e870 0x7f2aec122730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af1611700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 0x7f2aec1231b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af0e10700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09e870 0x7f2aec122730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60306/0 (socket says 172.21.15.154:60306) 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2af0e10700 1 -- 172.21.15.154:0/2419044022 learned_addr learned my addr 172.21.15.154:0/2419044022 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.981+0000 7f2aebfff700 1 --2- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09f180 0x7f2aec122c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2af0e10700 1 -- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09f180 msgr2=0x7f2aec122c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2af0e10700 1 --2- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09f180 0x7f2aec122c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2af0e10700 1 -- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 msgr2=0x7f2aec1231b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2af0e10700 1 --2- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 0x7f2aec1231b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2af0e10700 1 -- 172.21.15.154:0/2419044022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0009550 con 0x7f2aec09e870 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2af1611700 1 --2- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 0x7f2aec1231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2af0e10700 1 --2- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09e870 0x7f2aec122730 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000e9b0 tx=0x7f2ae000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2ae97fa700 1 -- 172.21.15.154:0/2419044022 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000ee50 con 0x7f2aec09e870 2023-09-30T22:28:52.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2ae97fa700 1 -- 172.21.15.154:0/2419044022 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae000c850 con 0x7f2aec09e870 2023-09-30T22:28:52.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2af3074700 1 -- 172.21.15.154:0/2419044022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad80094a0 con 0x7f2aec09e870 2023-09-30T22:28:52.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2ae97fa700 1 -- 172.21.15.154:0/2419044022 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000cbc0 con 0x7f2aec09e870 2023-09-30T22:28:52.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.982+0000 7f2af3074700 1 -- 172.21.15.154:0/2419044022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae4009a70 con 0x7f2aec09e870 2023-09-30T22:28:52.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.983+0000 7f2ae97fa700 1 -- 172.21.15.154:0/2419044022 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ae000cd20 con 0x7f2aec09e870 2023-09-30T22:28:52.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.983+0000 7f2ae97fa700 1 -- 172.21.15.154:0/2419044022 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2ae003f6d0 con 0x7f2aec09e870 2023-09-30T22:28:52.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.983+0000 7f2af3074700 1 -- 172.21.15.154:0/2419044022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec04f2a0 con 0x7f2aec09e870 2023-09-30T22:28:52.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:52.988+0000 7f2ae97fa700 1 -- 172.21.15.154:0/2419044022 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ae00232f0 con 0x7f2aec09e870 2023-09-30T22:28:53.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:53.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:53.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:53.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.179+0000 7fd978bc1700 1 Processor -- start 2023-09-30T22:28:53.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.179+0000 7fd978bc1700 1 -- start start 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd978bc1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd97409d860 0x7fd97409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd978bc1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd9741307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd978bc1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd974130ce0 0x7fd974131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd978bc1700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97409aaa0 con 0x7fd974130ce0 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd978bc1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97409f870 con 0x7fd97409e170 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd978bc1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd97409b360 con 0x7fd97409d860 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd972d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd974130ce0 0x7fd974131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd972d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd974130ce0 0x7fd974131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54662/0 (socket says 172.21.15.154:54662) 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd972d9d700 1 -- 172.21.15.154:0/2024475335 learned_addr learned my addr 172.21.15.154:0/2024475335 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:53.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd971d9b700 1 --2- 172.21.15.154:0/2024475335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd9741307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd97259c700 1 --2- 172.21.15.154:0/2024475335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd97409d860 0x7fd97409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd971d9b700 1 -- 172.21.15.154:0/2024475335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd97409d860 msgr2=0x7fd97409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd971d9b700 1 --2- 172.21.15.154:0/2024475335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd97409d860 0x7fd97409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd971d9b700 1 -- 172.21.15.154:0/2024475335 >> v2:172.21.15.154:3300/0 conn(0x7fd974130ce0 msgr2=0x7fd974131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd971d9b700 1 --2- 172.21.15.154:0/2024475335 >> v2:172.21.15.154:3300/0 conn(0x7fd974130ce0 0x7fd974131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd971d9b700 1 -- 172.21.15.154:0/2024475335 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97409b620 con 0x7fd97409e170 2023-09-30T22:28:53.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.180+0000 7fd971d9b700 1 --2- 172.21.15.154:0/2024475335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd9741307a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd968009840 tx=0x7fd968009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4243f4f3ee31384 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.181+0000 7fd97159a700 1 -- 172.21.15.154:0/2024475335 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968011830 con 0x7fd97409e170 2023-09-30T22:28:53.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.181+0000 7fd97159a700 1 -- 172.21.15.154:0/2024475335 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968011990 con 0x7fd97409e170 2023-09-30T22:28:53.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.181+0000 7fd97159a700 1 -- 172.21.15.154:0/2024475335 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968011d20 con 0x7fd97409e170 2023-09-30T22:28:53.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.182+0000 7fd978bc1700 1 -- 172.21.15.154:0/2024475335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 msgr2=0x7fd9741307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.182+0000 7fd978bc1700 1 --2- 172.21.15.154:0/2024475335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd9741307a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd968009840 tx=0x7fd968009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.182+0000 7fd978bc1700 1 -- 172.21.15.154:0/2024475335 shutdown_connections 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.182+0000 7fd978bc1700 1 --2- 172.21.15.154:0/2024475335 >> v2:172.21.15.154:3300/0 conn(0x7fd974130ce0 0x7fd974131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.182+0000 7fd978bc1700 1 --2- 172.21.15.154:0/2024475335 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd97409d860 0x7fd97409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.182+0000 7fd978bc1700 1 --2- 172.21.15.154:0/2024475335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd9741307a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.182+0000 7fd978bc1700 1 -- 172.21.15.154:0/2024475335 >> 172.21.15.154:0/2024475335 conn(0x7fd974099c40 msgr2=0x7fd9740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.182+0000 7fd978bc1700 1 -- 172.21.15.154:0/2024475335 shutdown_connections 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.182+0000 7fd978bc1700 1 -- 172.21.15.154:0/2024475335 wait complete. 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.183+0000 7fd978bc1700 1 Processor -- start 2023-09-30T22:28:53.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.183+0000 7fd978bc1700 1 -- start start 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd978bc1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd97409d860 0x7fd97411f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd978bc1700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd97411f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd978bc1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd974130ce0 0x7fd97411fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd978bc1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97409a150 con 0x7fd97409d860 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd978bc1700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97409c8b0 con 0x7fd97409e170 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd978bc1700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd974121cc0 con 0x7fd974130ce0 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd971d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd97411f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd971d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd97411f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44686/0 (socket says 172.21.15.154:44686) 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd971d9b700 1 -- 172.21.15.154:0/574155922 learned_addr learned my addr 172.21.15.154:0/574155922 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd97259c700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd97409d860 0x7fd97411f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd972d9d700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd974130ce0 0x7fd97411fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd97259c700 1 -- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd974130ce0 msgr2=0x7fd97411fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd97259c700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd974130ce0 0x7fd97411fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd97259c700 1 -- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 msgr2=0x7fd97411f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd97259c700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd97411f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd97259c700 1 -- 172.21.15.154:0/574155922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680094a0 con 0x7fd97409d860 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd971d9b700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd97411f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.184+0000 7fd97259c700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd97409d860 0x7fd97411f330 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fd96400e870 tx=0x7fd96400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.185+0000 7fd962ffd700 1 -- 172.21.15.154:0/574155922 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964013980 con 0x7fd97409d860 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.185+0000 7fd962ffd700 1 -- 172.21.15.154:0/574155922 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964013ae0 con 0x7fd97409d860 2023-09-30T22:28:53.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.185+0000 7fd978bc1700 1 -- 172.21.15.154:0/574155922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd974122540 con 0x7fd97409d860 2023-09-30T22:28:53.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.185+0000 7fd962ffd700 1 -- 172.21.15.154:0/574155922 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964013e50 con 0x7fd97409d860 2023-09-30T22:28:53.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.185+0000 7fd978bc1700 1 -- 172.21.15.154:0/574155922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd974123540 con 0x7fd97409d860 2023-09-30T22:28:53.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.186+0000 7fd962ffd700 1 -- 172.21.15.154:0/574155922 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd96401b440 con 0x7fd97409d860 2023-09-30T22:28:53.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.186+0000 7fd962ffd700 1 -- 172.21.15.154:0/574155922 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd9640472c0 con 0x7fd97409d860 2023-09-30T22:28:53.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.186+0000 7fd978bc1700 1 -- 172.21.15.154:0/574155922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97404f2a0 con 0x7fd97409d860 2023-09-30T22:28:53.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.190+0000 7f2af3074700 1 -- 172.21.15.154:0/2419044022 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2aec0a0440 con 0x7f2aec09e870 2023-09-30T22:28:53.190 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:53.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.191+0000 7f2ae97fa700 1 -- 172.21.15.154:0/2419044022 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ae0021030 con 0x7f2aec09e870 2023-09-30T22:28:53.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.193+0000 7f2af3074700 1 -- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09e870 msgr2=0x7f2aec122730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.193+0000 7f2af3074700 1 --2- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09e870 0x7f2aec122730 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000e9b0 tx=0x7f2ae000ecc0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.193+0000 7f2af3074700 1 -- 172.21.15.154:0/2419044022 shutdown_connections 2023-09-30T22:28:53.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.193+0000 7f2af3074700 1 --2- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec134160 0x7f2aec1231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.193+0000 7f2af3074700 1 --2- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2aec09e870 0x7f2aec122730 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.193+0000 7f2af3074700 1 --2- 172.21.15.154:0/2419044022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aec09f180 0x7f2aec122c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.193+0000 7f2af3074700 1 -- 172.21.15.154:0/2419044022 >> 172.21.15.154:0/2419044022 conn(0x7f2aec0a4430 msgr2=0x7f2aec072260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.194+0000 7f2af3074700 1 -- 172.21.15.154:0/2419044022 shutdown_connections 2023-09-30T22:28:53.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.195+0000 7fd962ffd700 1 -- 172.21.15.154:0/574155922 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd964020080 con 0x7fd97409d860 2023-09-30T22:28:53.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.195+0000 7f2af3074700 1 -- 172.21.15.154:0/2419044022 wait complete. 2023-09-30T22:28:53.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:53.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.221+0000 7fa11fb4f700 1 Processor -- start 2023-09-30T22:28:53.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.221+0000 7fa11fb4f700 1 -- start start 2023-09-30T22:28:53.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11fb4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 0x7fa11809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11fb4f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa11809f180 0x7fa118131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11fb4f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa118132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11fb4f700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1180a0920 con 0x7fa11809f180 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11fb4f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11809c970 con 0x7fa118131d70 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11fb4f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa11809bab0 con 0x7fa11809e870 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11d8eb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 0x7fa11809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11d0ea700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa11809f180 0x7fa118131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11d0ea700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa11809f180 0x7fa118131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54678/0 (socket says 172.21.15.154:54678) 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11d0ea700 1 -- 172.21.15.154:0/4033735227 learned_addr learned my addr 172.21.15.154:0/4033735227 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11e0ec700 1 --2- 172.21.15.154:0/4033735227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa118132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11d8eb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 0x7fa11809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60338/0 (socket says 172.21.15.154:60338) 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11e0ec700 1 -- 172.21.15.154:0/4033735227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 msgr2=0x7fa11809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11e0ec700 1 --2- 172.21.15.154:0/4033735227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 0x7fa11809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11e0ec700 1 -- 172.21.15.154:0/4033735227 >> v2:172.21.15.154:3300/0 conn(0x7fa11809f180 msgr2=0x7fa118131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11e0ec700 1 --2- 172.21.15.154:0/4033735227 >> v2:172.21.15.154:3300/0 conn(0x7fa11809f180 0x7fa118131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11e0ec700 1 -- 172.21.15.154:0/4033735227 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11809f9c0 con 0x7fa118131d70 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.222+0000 7fa11d0ea700 1 --2- 172.21.15.154:0/4033735227 >> v2:172.21.15.154:3300/0 conn(0x7fa11809f180 0x7fa118131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11e0ec700 1 --2- 172.21.15.154:0/4033735227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa118132210 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa110009dc0 tx=0x7fa11000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a4a89611dd9abd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11c8e9700 1 -- 172.21.15.154:0/4033735227 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11000e070 con 0x7fa118131d70 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11c8e9700 1 -- 172.21.15.154:0/4033735227 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11000bae0 con 0x7fa118131d70 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11c8e9700 1 -- 172.21.15.154:0/4033735227 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11000be90 con 0x7fa118131d70 2023-09-30T22:28:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11fb4f700 1 -- 172.21.15.154:0/4033735227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 msgr2=0x7fa118132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11fb4f700 1 --2- 172.21.15.154:0/4033735227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa118132210 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa110009dc0 tx=0x7fa11000b330 comp rx=0 tx=0).stop 2023-09-30T22:28:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11fb4f700 1 -- 172.21.15.154:0/4033735227 shutdown_connections 2023-09-30T22:28:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11fb4f700 1 --2- 172.21.15.154:0/4033735227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa118132210 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11fb4f700 1 --2- 172.21.15.154:0/4033735227 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 0x7fa11809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11fb4f700 1 --2- 172.21.15.154:0/4033735227 >> v2:172.21.15.154:3300/0 conn(0x7fa11809f180 0x7fa118131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.223+0000 7fa11fb4f700 1 -- 172.21.15.154:0/4033735227 >> 172.21.15.154:0/4033735227 conn(0x7fa1180a4430 msgr2=0x7fa1180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.224+0000 7fa11fb4f700 1 -- 172.21.15.154:0/4033735227 shutdown_connections 2023-09-30T22:28:53.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.224+0000 7fa11fb4f700 1 -- 172.21.15.154:0/4033735227 wait complete. 2023-09-30T22:28:53.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.224+0000 7fa11fb4f700 1 Processor -- start 2023-09-30T22:28:53.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.224+0000 7fa11fb4f700 1 -- start start 2023-09-30T22:28:53.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7f9d340f7700 1 Processor -- start 2023-09-30T22:28:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11fb4f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 0x7fa1181c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11fb4f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11809f180 0x7fa1181c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11fb4f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa1181c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11fb4f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11811e6c0 con 0x7fa11809f180 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11fb4f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11811e4d0 con 0x7fa118131d70 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11fb4f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1181203e0 con 0x7fa11809e870 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11d0ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11809f180 0x7fa1181c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11e0ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa1181c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11d0ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11809f180 0x7fa1181c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54686/0 (socket says 172.21.15.154:54686) 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11e0ec700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa1181c6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44716/0 (socket says 172.21.15.154:44716) 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11d0ea700 1 -- 172.21.15.154:0/3869653697 learned_addr learned my addr 172.21.15.154:0/3869653697 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11d8eb700 1 --2- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 0x7fa1181c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11d0ea700 1 -- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 msgr2=0x7fa1181c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11d0ea700 1 --2- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 0x7fa1181c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11d0ea700 1 -- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 msgr2=0x7fa1181c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11d0ea700 1 --2- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa1181c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7fa11d0ea700 1 -- 172.21.15.154:0/3869653697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa108009550 con 0x7fa11809f180 2023-09-30T22:28:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7fa11e0ec700 1 --2- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa1181c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.225+0000 7f9d340f7700 1 -- start start 2023-09-30T22:28:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d340f7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d2c06a770 0x7f9d2c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d340f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c134f00 0x7f9d2c09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d340f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c09dea0 0x7f9d2c09e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d340f7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2c06b2e0 con 0x7f9d2c06a770 2023-09-30T22:28:53.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d340f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c09eca0 con 0x7f9d2c134f00 2023-09-30T22:28:53.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d340f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c09f720 con 0x7f9d2c09dea0 2023-09-30T22:28:53.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7fa11d0ea700 1 --2- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11809f180 0x7fa1181c67e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fa10800ebe0 tx=0x7fa10800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d32694700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c09dea0 0x7f9d2c09e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d31692700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c134f00 0x7f9d2c09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d32694700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c09dea0 0x7f9d2c09e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60362/0 (socket says 172.21.15.154:60362) 2023-09-30T22:28:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d31692700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c134f00 0x7f9d2c09d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44718/0 (socket says 172.21.15.154:44718) 2023-09-30T22:28:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d32694700 1 -- 172.21.15.154:0/2397347261 learned_addr learned my addr 172.21.15.154:0/2397347261 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:53.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d31e93700 1 --2- 172.21.15.154:0/2397347261 >> v2:172.21.15.154:3300/0 conn(0x7f9d2c06a770 0x7f9d2c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d31692700 1 -- 172.21.15.154:0/2397347261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c09dea0 msgr2=0x7f9d2c09e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d31692700 1 --2- 172.21.15.154:0/2397347261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c09dea0 0x7f9d2c09e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d31692700 1 -- 172.21.15.154:0/2397347261 >> v2:172.21.15.154:3300/0 conn(0x7f9d2c06a770 msgr2=0x7f9d2c1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:53.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d31692700 1 --2- 172.21.15.154:0/2397347261 >> v2:172.21.15.154:3300/0 conn(0x7f9d2c06a770 0x7f9d2c1349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d31692700 1 -- 172.21.15.154:0/2397347261 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c06b480 con 0x7f9d2c134f00 2023-09-30T22:28:53.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7fa10e7fc700 1 -- 172.21.15.154:0/3869653697 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10800c850 con 0x7fa11809f180 2023-09-30T22:28:53.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7fa10e7fc700 1 -- 172.21.15.154:0/3869653697 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10800c9b0 con 0x7fa11809f180 2023-09-30T22:28:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7fa10e7fc700 1 -- 172.21.15.154:0/3869653697 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10800cd60 con 0x7fa11809f180 2023-09-30T22:28:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7fa11fb4f700 1 -- 172.21.15.154:0/3869653697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa110009a70 con 0x7fa11809f180 2023-09-30T22:28:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7fa11fb4f700 1 -- 172.21.15.154:0/3869653697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa118120100 con 0x7fa11809f180 2023-09-30T22:28:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d31692700 1 --2- 172.21.15.154:0/2397347261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c134f00 0x7f9d2c09d960 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009840 tx=0x7f9d1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d128bc874e433cb4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.226+0000 7f9d30e91700 1 -- 172.21.15.154:0/2397347261 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011830 con 0x7f9d2c134f00 2023-09-30T22:28:53.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7f9d30e91700 1 -- 172.21.15.154:0/2397347261 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c011990 con 0x7f9d2c134f00 2023-09-30T22:28:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7f9d30e91700 1 -- 172.21.15.154:0/2397347261 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011d20 con 0x7f9d2c134f00 2023-09-30T22:28:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7fa11fb4f700 1 -- 172.21.15.154:0/3869653697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11811fda0 con 0x7fa11809f180 2023-09-30T22:28:53.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7f9d340f7700 1 -- 172.21.15.154:0/2397347261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c134f00 msgr2=0x7f9d2c09d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7f9d340f7700 1 --2- 172.21.15.154:0/2397347261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c134f00 0x7f9d2c09d960 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009840 tx=0x7f9d1c009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7f9d340f7700 1 -- 172.21.15.154:0/2397347261 shutdown_connections 2023-09-30T22:28:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7f9d340f7700 1 --2- 172.21.15.154:0/2397347261 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c09dea0 0x7f9d2c09e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7f9d340f7700 1 --2- 172.21.15.154:0/2397347261 >> v2:172.21.15.154:3300/0 conn(0x7f9d2c06a770 0x7f9d2c1349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7f9d340f7700 1 --2- 172.21.15.154:0/2397347261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c134f00 0x7f9d2c09d960 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.227+0000 7f9d340f7700 1 -- 172.21.15.154:0/2397347261 >> 172.21.15.154:0/2397347261 conn(0x7f9d2c099c40 msgr2=0x7f9d2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.228+0000 7fa10e7fc700 1 -- 172.21.15.154:0/3869653697 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa108013470 con 0x7fa11809f180 2023-09-30T22:28:53.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.228+0000 7fa10e7fc700 1 -- 172.21.15.154:0/3869653697 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa108040130 con 0x7fa11809f180 2023-09-30T22:28:53.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.230+0000 7f9d340f7700 1 -- 172.21.15.154:0/2397347261 shutdown_connections 2023-09-30T22:28:53.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.230+0000 7f9d340f7700 1 -- 172.21.15.154:0/2397347261 wait complete. 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d340f7700 1 Processor -- start 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d340f7700 1 -- start start 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d340f7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d2c06a770 0x7f9d2c132bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d340f7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c09dea0 0x7f9d2c133130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d340f7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c134f00 0x7f9d2c133670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d340f7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c11d5a0 con 0x7f9d2c06a770 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d340f7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c11bf40 con 0x7f9d2c09dea0 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d340f7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c139630 con 0x7f9d2c134f00 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d31e93700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d2c06a770 0x7f9d2c132bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d31e93700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d2c06a770 0x7f9d2c132bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54700/0 (socket says 172.21.15.154:54700) 2023-09-30T22:28:53.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d31e93700 1 -- 172.21.15.154:0/536069628 learned_addr learned my addr 172.21.15.154:0/536069628 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d32694700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c134f00 0x7f9d2c133670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.231+0000 7f9d31692700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c09dea0 0x7f9d2c133130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d31692700 1 -- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c134f00 msgr2=0x7f9d2c133670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d31692700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c134f00 0x7f9d2c133670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d31692700 1 -- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d2c06a770 msgr2=0x7f9d2c132bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d31692700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d2c06a770 0x7f9d2c132bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d31692700 1 -- 172.21.15.154:0/536069628 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0094a0 con 0x7f9d2c09dea0 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d31e93700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d2c06a770 0x7f9d2c132bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d32694700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c134f00 0x7f9d2c133670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d31692700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c09dea0 0x7f9d2c133130 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c016000 tx=0x7f9d1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:53.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d227fc700 1 -- 172.21.15.154:0/536069628 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c004510 con 0x7f9d2c09dea0 2023-09-30T22:28:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d227fc700 1 -- 172.21.15.154:0/536069628 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0036a0 con 0x7f9d2c09dea0 2023-09-30T22:28:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d340f7700 1 -- 172.21.15.154:0/536069628 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c11cca0 con 0x7f9d2c09dea0 2023-09-30T22:28:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d227fc700 1 -- 172.21.15.154:0/536069628 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c003a50 con 0x7f9d2c09dea0 2023-09-30T22:28:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7f9d340f7700 1 -- 172.21.15.154:0/536069628 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c11cee0 con 0x7f9d2c09dea0 2023-09-30T22:28:53.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.232+0000 7fa10e7fc700 1 -- 172.21.15.154:0/3869653697 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa108013720 con 0x7fa11809f180 2023-09-30T22:28:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.233+0000 7f9d227fc700 1 -- 172.21.15.154:0/536069628 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d1c003bb0 con 0x7f9d2c09dea0 2023-09-30T22:28:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.233+0000 7f9d227fc700 1 -- 172.21.15.154:0/536069628 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d1c040410 con 0x7f9d2c09dea0 2023-09-30T22:28:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.233+0000 7f9d340f7700 1 -- 172.21.15.154:0/536069628 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c09e930 con 0x7f9d2c09dea0 2023-09-30T22:28:53.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.242+0000 7f9d227fc700 1 -- 172.21.15.154:0/536069628 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d1c01a420 con 0x7f9d2c09dea0 2023-09-30T22:28:53.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.391+0000 7fd978bc1700 1 -- 172.21.15.154:0/574155922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd974130ac0 con 0x7fd97409d860 2023-09-30T22:28:53.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.391+0000 7fd962ffd700 1 -- 172.21.15.154:0/574155922 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9640243b0 con 0x7fd97409d860 2023-09-30T22:28:53.391 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:53.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.393+0000 7fd978bc1700 1 -- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd97409d860 msgr2=0x7fd97411f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.393+0000 7fd978bc1700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd97409d860 0x7fd97411f330 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fd96400e870 tx=0x7fd96400eb80 comp rx=0 tx=0).stop 2023-09-30T22:28:53.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.393+0000 7fd978bc1700 1 -- 172.21.15.154:0/574155922 shutdown_connections 2023-09-30T22:28:53.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.393+0000 7fd978bc1700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd974130ce0 0x7fd97411fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.393+0000 7fd978bc1700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd97409d860 0x7fd97411f330 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.393+0000 7fd978bc1700 1 --2- 172.21.15.154:0/574155922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd97409e170 0x7fd97411f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.393+0000 7fd978bc1700 1 -- 172.21.15.154:0/574155922 >> 172.21.15.154:0/574155922 conn(0x7fd974099c40 msgr2=0x7fd974119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.394+0000 7fd978bc1700 1 -- 172.21.15.154:0/574155922 shutdown_connections 2023-09-30T22:28:53.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.394+0000 7fd978bc1700 1 -- 172.21.15.154:0/574155922 wait complete. 2023-09-30T22:28:53.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:53.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.471+0000 7fa11fb4f700 1 -- 172.21.15.154:0/3869653697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa11811ff60 con 0x7fa11809f180 2023-09-30T22:28:53.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.471+0000 7fa10e7fc700 1 -- 172.21.15.154:0/3869653697 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa11811ff60 con 0x7fa11809f180 2023-09-30T22:28:53.472 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:53.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.473+0000 7f9d340f7700 1 -- 172.21.15.154:0/536069628 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d2c04f2a0 con 0x7f9d2c09dea0 2023-09-30T22:28:53.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7fa11fb4f700 1 -- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11809f180 msgr2=0x7fa1181c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7fa11fb4f700 1 --2- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11809f180 0x7fa1181c67e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fa10800ebe0 tx=0x7fa10800eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7fa11fb4f700 1 -- 172.21.15.154:0/3869653697 shutdown_connections 2023-09-30T22:28:53.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7fa11fb4f700 1 --2- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa118131d70 0x7fa1181c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7fa11fb4f700 1 --2- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fa11809e870 0x7fa1181c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7fa11fb4f700 1 --2- 172.21.15.154:0/3869653697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11809f180 0x7fa1181c67e0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7fa11fb4f700 1 -- 172.21.15.154:0/3869653697 >> 172.21.15.154:0/3869653697 conn(0x7fa1180a4430 msgr2=0x7fa1181b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7fa11fb4f700 1 -- 172.21.15.154:0/3869653697 shutdown_connections 2023-09-30T22:28:53.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7fa11fb4f700 1 -- 172.21.15.154:0/3869653697 wait complete. 2023-09-30T22:28:53.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.474+0000 7f9d227fc700 1 -- 172.21.15.154:0/536069628 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d1c028070 con 0x7f9d2c09dea0 2023-09-30T22:28:53.475 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:53.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.477+0000 7f9d340f7700 1 -- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c09dea0 msgr2=0x7f9d2c133130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:53.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.477+0000 7f9d340f7700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c09dea0 0x7f9d2c133130 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c016000 tx=0x7f9d1c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:53.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.477+0000 7f9d340f7700 1 -- 172.21.15.154:0/536069628 shutdown_connections 2023-09-30T22:28:53.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.477+0000 7f9d340f7700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f9d2c134f00 0x7f9d2c133670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.477+0000 7f9d340f7700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d2c06a770 0x7f9d2c132bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.477+0000 7f9d340f7700 1 --2- 172.21.15.154:0/536069628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d2c09dea0 0x7f9d2c133130 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:53.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.477+0000 7f9d340f7700 1 -- 172.21.15.154:0/536069628 >> 172.21.15.154:0/536069628 conn(0x7f9d2c099c40 msgr2=0x7f9d2c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:53.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.477+0000 7f9d340f7700 1 -- 172.21.15.154:0/536069628 shutdown_connections 2023-09-30T22:28:53.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:53.477+0000 7f9d340f7700 1 -- 172.21.15.154:0/536069628 wait complete. 2023-09-30T22:28:53.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:53.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:54.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:54.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e62e9b700 1 Processor -- start 2023-09-30T22:28:54.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e62e9b700 1 -- start start 2023-09-30T22:28:54.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e62e9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c133ad0 0x7f6e5c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e62e9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e5c1300a0 0x7f6e5c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e62e9b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c06b2d0 con 0x7f6e5c1309f0 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e62e9b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c133610 con 0x7f6e5c1300a0 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e62e9b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c09a500 con 0x7f6e5c133ad0 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e60c37700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c133ad0 0x7f6e5c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e5bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e5c1300a0 0x7f6e5c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e60c37700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c133ad0 0x7f6e5c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60384/0 (socket says 172.21.15.154:60384) 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.339+0000 7f6e60c37700 1 -- 172.21.15.154:0/923663353 learned_addr learned my addr 172.21.15.154:0/923663353 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e5bfff700 1 -- 172.21.15.154:0/923663353 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c133ad0 msgr2=0x7f6e5c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e5bfff700 1 --2- 172.21.15.154:0/923663353 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c133ad0 0x7f6e5c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e5bfff700 1 -- 172.21.15.154:0/923663353 >> v1:172.21.15.154:6789/0 conn(0x7f6e5c1309f0 legacy=0x7f6e5c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e5bfff700 1 -- 172.21.15.154:0/923663353 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c1338b0 con 0x7f6e5c1300a0 2023-09-30T22:28:54.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e60c37700 1 --2- 172.21.15.154:0/923663353 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c133ad0 0x7f6e5c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e5bfff700 1 --2- 172.21.15.154:0/923663353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e5c1300a0 0x7f6e5c1304b0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009840 tx=0x7f6e48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f511d37b766321b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e5b7fe700 1 -- 172.21.15.154:0/923663353 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48011830 con 0x7f6e5c1300a0 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e5b7fe700 1 -- 172.21.15.154:0/923663353 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48011990 con 0x7f6e5c1300a0 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e5b7fe700 1 -- 172.21.15.154:0/923663353 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48011d20 con 0x7f6e5c1300a0 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e62e9b700 1 -- 172.21.15.154:0/923663353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e5c1300a0 msgr2=0x7f6e5c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e62e9b700 1 --2- 172.21.15.154:0/923663353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e5c1300a0 0x7f6e5c1304b0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009840 tx=0x7f6e48009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e62e9b700 1 -- 172.21.15.154:0/923663353 shutdown_connections 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e62e9b700 1 --2- 172.21.15.154:0/923663353 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c133ad0 0x7f6e5c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e62e9b700 1 --2- 172.21.15.154:0/923663353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e5c1300a0 0x7f6e5c1304b0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.340+0000 7f6e62e9b700 1 -- 172.21.15.154:0/923663353 >> 172.21.15.154:0/923663353 conn(0x7f6e5c099c40 msgr2=0x7f6e5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.341+0000 7f6e62e9b700 1 -- 172.21.15.154:0/923663353 shutdown_connections 2023-09-30T22:28:54.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.341+0000 7f6e62e9b700 1 -- 172.21.15.154:0/923663353 wait complete. 2023-09-30T22:28:54.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.341+0000 7f6e62e9b700 1 Processor -- start 2023-09-30T22:28:54.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.341+0000 7f6e62e9b700 1 -- start start 2023-09-30T22:28:54.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e62e9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c1300a0 0x7f6e5c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e62e9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e5c1309f0 0x7f6e5c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e62e9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e5c133ad0 0x7f6e5c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e62e9b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c11f7c0 con 0x7f6e5c1309f0 2023-09-30T22:28:54.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e62e9b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c12d910 con 0x7f6e5c133ad0 2023-09-30T22:28:54.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e62e9b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c11fa20 con 0x7f6e5c1300a0 2023-09-30T22:28:54.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e60c37700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c1300a0 0x7f6e5c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e5bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e5c1309f0 0x7f6e5c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e60c37700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c1300a0 0x7f6e5c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60400/0 (socket says 172.21.15.154:60400) 2023-09-30T22:28:54.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e60c37700 1 -- 172.21.15.154:0/175591429 learned_addr learned my addr 172.21.15.154:0/175591429 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:54.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e61438700 1 --2- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e5c133ad0 0x7f6e5c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e60c37700 1 -- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e5c133ad0 msgr2=0x7f6e5c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e60c37700 1 --2- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e5c133ad0 0x7f6e5c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e60c37700 1 -- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e5c1309f0 msgr2=0x7f6e5c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e60c37700 1 --2- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e5c1309f0 0x7f6e5c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.342+0000 7f6e60c37700 1 -- 172.21.15.154:0/175591429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e50009550 con 0x7f6e5c1300a0 2023-09-30T22:28:54.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.343+0000 7f6e60c37700 1 --2- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c1300a0 0x7f6e5c11da40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000ebe0 tx=0x7f6e5000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.343+0000 7f6e597fa700 1 -- 172.21.15.154:0/175591429 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000c850 con 0x7f6e5c1300a0 2023-09-30T22:28:54.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.343+0000 7f6e597fa700 1 -- 172.21.15.154:0/175591429 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5000c9b0 con 0x7f6e5c1300a0 2023-09-30T22:28:54.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.343+0000 7f6e62e9b700 1 -- 172.21.15.154:0/175591429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e480094a0 con 0x7f6e5c1300a0 2023-09-30T22:28:54.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.343+0000 7f6e597fa700 1 -- 172.21.15.154:0/175591429 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5000cd40 con 0x7f6e5c1300a0 2023-09-30T22:28:54.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.343+0000 7f6e62e9b700 1 -- 172.21.15.154:0/175591429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c11fce0 con 0x7f6e5c1300a0 2023-09-30T22:28:54.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.343+0000 7f6e597fa700 1 -- 172.21.15.154:0/175591429 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e50013470 con 0x7f6e5c1300a0 2023-09-30T22:28:54.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.344+0000 7f6e597fa700 1 -- 172.21.15.154:0/175591429 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6e5003fc00 con 0x7f6e5c1300a0 2023-09-30T22:28:54.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.344+0000 7f6e62e9b700 1 -- 172.21.15.154:0/175591429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c04f2a0 con 0x7f6e5c1300a0 2023-09-30T22:28:54.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.348+0000 7f6e597fa700 1 -- 172.21.15.154:0/175591429 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e5001b3b0 con 0x7f6e5c1300a0 2023-09-30T22:28:54.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:54.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:54.493 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:54.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.541+0000 7f03c6495700 1 Processor -- start 2023-09-30T22:28:54.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.541+0000 7f03c6495700 1 -- start start 2023-09-30T22:28:54.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.542+0000 7f03c6495700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f03c0131980 0x7f03c0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.542+0000 7f03c6495700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.542+0000 7f03c6495700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c00a1640 con 0x7f03c009c5c0 2023-09-30T22:28:54.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.542+0000 7f03c6495700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c006eb30 con 0x7f03c0131980 2023-09-30T22:28:54.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.542+0000 7f03c6495700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00a22d0 con 0x7f03c009bc70 2023-09-30T22:28:54.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.542+0000 7f03bf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.542+0000 7f03bf7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c009c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60406/0 (socket says 172.21.15.154:60406) 2023-09-30T22:28:54.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.542+0000 7f03bf7fe700 1 -- 172.21.15.154:0/1726276010 learned_addr learned my addr 172.21.15.154:0/1726276010 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:54.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.542+0000 7f03bffff700 1 --2- 172.21.15.154:0/1726276010 >> v2:172.21.15.154:3300/0 conn(0x7f03c0131980 0x7f03c0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.543+0000 7f03bf7fe700 1 -- 172.21.15.154:0/1726276010 >> v2:172.21.15.154:3300/0 conn(0x7f03c0131980 msgr2=0x7f03c0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.543+0000 7f03bf7fe700 1 --2- 172.21.15.154:0/1726276010 >> v2:172.21.15.154:3300/0 conn(0x7f03c0131980 0x7f03c0131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.543+0000 7f03bf7fe700 1 -- 172.21.15.154:0/1726276010 >> v1:172.21.15.154:6789/0 conn(0x7f03c009c5c0 legacy=0x7f03c0138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.543+0000 7f03bf7fe700 1 -- 172.21.15.154:0/1726276010 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c0131550 con 0x7f03c009bc70 2023-09-30T22:28:54.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.543+0000 7f03bf7fe700 1 --2- 172.21.15.154:0/1726276010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c009c080 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f03b40098f0 tx=0x7f03b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fb7753d4c07e5f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.543+0000 7f03beffd700 1 -- 172.21.15.154:0/1726276010 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4011830 con 0x7f03c009bc70 2023-09-30T22:28:54.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.543+0000 7f03beffd700 1 -- 172.21.15.154:0/1726276010 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b4011990 con 0x7f03c009bc70 2023-09-30T22:28:54.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.543+0000 7f03beffd700 1 -- 172.21.15.154:0/1726276010 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4011d20 con 0x7f03c009bc70 2023-09-30T22:28:54.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.544+0000 7f03c6495700 1 -- 172.21.15.154:0/1726276010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 msgr2=0x7f03c009c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.544+0000 7f03c6495700 1 --2- 172.21.15.154:0/1726276010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c009c080 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f03b40098f0 tx=0x7f03b4009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:54.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.544+0000 7f03c6495700 1 -- 172.21.15.154:0/1726276010 shutdown_connections 2023-09-30T22:28:54.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.544+0000 7f03c6495700 1 --2- 172.21.15.154:0/1726276010 >> v2:172.21.15.154:3300/0 conn(0x7f03c0131980 0x7f03c0131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.544+0000 7f03c6495700 1 --2- 172.21.15.154:0/1726276010 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c009c080 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.544+0000 7f03c6495700 1 -- 172.21.15.154:0/1726276010 >> 172.21.15.154:0/1726276010 conn(0x7f03c00a2980 msgr2=0x7f03c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.544+0000 7f03c6495700 1 -- 172.21.15.154:0/1726276010 shutdown_connections 2023-09-30T22:28:54.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.544+0000 7f03c6495700 1 -- 172.21.15.154:0/1726276010 wait complete. 2023-09-30T22:28:54.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.545+0000 7f03c6495700 1 Processor -- start 2023-09-30T22:28:54.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.546+0000 7f03c6495700 1 -- start start 2023-09-30T22:28:54.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.546+0000 7f03c6495700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c011d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.546+0000 7f03c6495700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03c009c5c0 0x7f03c011df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.546+0000 7f03c6495700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c0131980 0x7f03c011e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.546+0000 7f03c6495700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01204f0 con 0x7f03c0131980 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.546+0000 7f03c6495700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00a1c40 con 0x7f03c009c5c0 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.546+0000 7f03c6495700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c012edb0 con 0x7f03c009bc70 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.546+0000 7f03c4a32700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c0131980 0x7f03c011e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.546+0000 7f03bffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c011d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03c4a32700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c0131980 0x7f03c011e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54746/0 (socket says 172.21.15.154:54746) 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03c4a32700 1 -- 172.21.15.154:0/477591254 learned_addr learned my addr 172.21.15.154:0/477591254 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03bffff700 1 -- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03c009c5c0 msgr2=0x7f03c011df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03bffff700 1 --2- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03c009c5c0 0x7f03c011df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03bffff700 1 -- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c0131980 msgr2=0x7f03c011e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03bffff700 1 --2- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c0131980 0x7f03c011e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03bffff700 1 -- 172.21.15.154:0/477591254 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4009550 con 0x7f03c009bc70 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03c4a32700 1 --2- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c0131980 0x7f03c011e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03bffff700 1 --2- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c011d9e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f03b000e8d0 tx=0x7f03b000ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03bcff9700 1 -- 172.21.15.154:0/477591254 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b000c690 con 0x7f03c009bc70 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03bcff9700 1 -- 172.21.15.154:0/477591254 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b000c7f0 con 0x7f03c009bc70 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03c6495700 1 -- 172.21.15.154:0/477591254 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c0130fa0 con 0x7f03c009bc70 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03bcff9700 1 -- 172.21.15.154:0/477591254 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b000cb60 con 0x7f03c009bc70 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.547+0000 7f03c6495700 1 -- 172.21.15.154:0/477591254 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c0121220 con 0x7f03c009bc70 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.548+0000 7f03bcff9700 1 -- 172.21.15.154:0/477591254 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03b000ccc0 con 0x7f03c009bc70 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.548+0000 7f03c6495700 1 -- 172.21.15.154:0/477591254 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c0120da0 con 0x7f03c009bc70 2023-09-30T22:28:54.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.549+0000 7f03bcff9700 1 -- 172.21.15.154:0/477591254 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f03b003f820 con 0x7f03c009bc70 2023-09-30T22:28:54.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.552+0000 7f6e62e9b700 1 -- 172.21.15.154:0/175591429 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6e5c06c3b0 con 0x7f6e5c1300a0 2023-09-30T22:28:54.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.553+0000 7f6e597fa700 1 -- 172.21.15.154:0/175591429 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e50011ca0 con 0x7f6e5c1300a0 2023-09-30T22:28:54.556 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:54.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.553+0000 7f03bcff9700 1 -- 172.21.15.154:0/477591254 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03b00232f0 con 0x7f03c009bc70 2023-09-30T22:28:54.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.555+0000 7f6e62e9b700 1 -- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c1300a0 msgr2=0x7f6e5c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.555+0000 7f6e62e9b700 1 --2- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c1300a0 0x7f6e5c11da40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000ebe0 tx=0x7f6e5000eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.556+0000 7f6e62e9b700 1 -- 172.21.15.154:0/175591429 shutdown_connections 2023-09-30T22:28:54.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.556+0000 7f6e62e9b700 1 --2- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e5c133ad0 0x7f6e5c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.556+0000 7f6e62e9b700 1 --2- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e5c1300a0 0x7f6e5c11da40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.556+0000 7f6e62e9b700 1 --2- 172.21.15.154:0/175591429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e5c1309f0 0x7f6e5c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.556+0000 7f6e62e9b700 1 -- 172.21.15.154:0/175591429 >> 172.21.15.154:0/175591429 conn(0x7f6e5c099c40 msgr2=0x7f6e5c132050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.557+0000 7f6e62e9b700 1 -- 172.21.15.154:0/175591429 shutdown_connections 2023-09-30T22:28:54.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.557+0000 7f6e62e9b700 1 -- 172.21.15.154:0/175591429 wait complete. 2023-09-30T22:28:54.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:54.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.623+0000 7fb33b8a9700 1 Processor -- start 2023-09-30T22:28:54.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.623+0000 7fb33b8a9700 1 -- start start 2023-09-30T22:28:54.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb33b8a9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a1550 0x7fb334138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb33b8a9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb334139200 0x7fb33413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb33b8a9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33409e9d0 con 0x7fb3340a0a70 2023-09-30T22:28:54.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb33b8a9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33409dc00 con 0x7fb334139200 2023-09-30T22:28:54.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb33b8a9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33409dec0 con 0x7fb3340a1550 2023-09-30T22:28:54.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb339645700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb3340a0a70 0x7fb3340a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42740/0 (socket says 172.21.15.154:42740) 2023-09-30T22:28:54.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb339645700 1 -- 172.21.15.154:0/1175851380 learned_addr learned my addr 172.21.15.154:0/1175851380 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:54.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb338e44700 1 --2- 172.21.15.154:0/1175851380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a1550 0x7fb334138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb339e46700 1 --2- 172.21.15.154:0/1175851380 >> v2:172.21.15.154:3300/0 conn(0x7fb334139200 0x7fb33413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb32bfff700 1 -- 172.21.15.154:0/1175851380 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902749724 0 0) 0x7fb33409e9d0 con 0x7fb3340a0a70 2023-09-30T22:28:54.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb32bfff700 1 -- 172.21.15.154:0/1175851380 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3200035b0 con 0x7fb3340a0a70 2023-09-30T22:28:54.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb338e44700 1 -- 172.21.15.154:0/1175851380 >> v2:172.21.15.154:3300/0 conn(0x7fb334139200 msgr2=0x7fb33413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb338e44700 1 --2- 172.21.15.154:0/1175851380 >> v2:172.21.15.154:3300/0 conn(0x7fb334139200 0x7fb33413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb338e44700 1 -- 172.21.15.154:0/1175851380 >> v1:172.21.15.154:6789/0 conn(0x7fb3340a0a70 legacy=0x7fb3340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.624+0000 7fb338e44700 1 -- 172.21.15.154:0/1175851380 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33409e6a0 con 0x7fb3340a1550 2023-09-30T22:28:54.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.625+0000 7fb339e46700 1 --2- 172.21.15.154:0/1175851380 >> v2:172.21.15.154:3300/0 conn(0x7fb334139200 0x7fb33413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.625+0000 7fb338e44700 1 --2- 172.21.15.154:0/1175851380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a1550 0x7fb334138cc0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb324009840 tx=0x7fb324009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c70e5eabe4b7ed2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.625+0000 7fb32bfff700 1 -- 172.21.15.154:0/1175851380 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324011830 con 0x7fb3340a1550 2023-09-30T22:28:54.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.625+0000 7fb32bfff700 1 -- 172.21.15.154:0/1175851380 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324011990 con 0x7fb3340a1550 2023-09-30T22:28:54.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.625+0000 7fb32bfff700 1 -- 172.21.15.154:0/1175851380 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324011d20 con 0x7fb3340a1550 2023-09-30T22:28:54.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fb33b8a9700 1 -- 172.21.15.154:0/1175851380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a1550 msgr2=0x7fb334138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fb33b8a9700 1 --2- 172.21.15.154:0/1175851380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a1550 0x7fb334138cc0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb324009840 tx=0x7fb324009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:54.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fb33b8a9700 1 -- 172.21.15.154:0/1175851380 shutdown_connections 2023-09-30T22:28:54.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fb33b8a9700 1 --2- 172.21.15.154:0/1175851380 >> v2:172.21.15.154:3300/0 conn(0x7fb334139200 0x7fb33413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fb33b8a9700 1 --2- 172.21.15.154:0/1175851380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a1550 0x7fb334138cc0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fb33b8a9700 1 -- 172.21.15.154:0/1175851380 >> 172.21.15.154:0/1175851380 conn(0x7fb3340a6610 msgr2=0x7fb3340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fd8c16e5700 1 Processor -- start 2023-09-30T22:28:54.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fb33b8a9700 1 -- 172.21.15.154:0/1175851380 shutdown_connections 2023-09-30T22:28:54.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fd8c16e5700 1 -- start start 2023-09-30T22:28:54.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fd8c16e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 0x7fd8bc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fd8c16e5700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8bc09a730 0x7fd8bc130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fd8c16e5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 0x7fd8bc130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fd8c16e5700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc09bf50 con 0x7fd8bc09a730 2023-09-30T22:28:54.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fd8c16e5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc099a60 con 0x7fd8bc130890 2023-09-30T22:28:54.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fd8c16e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc09b230 con 0x7fd8bc099e20 2023-09-30T22:28:54.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.626+0000 7fb33b8a9700 1 -- 172.21.15.154:0/1175851380 wait complete. 2023-09-30T22:28:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8ba7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8bc09a730 0x7fd8bc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8baffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 0x7fd8bc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8ba7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8bc09a730 0x7fd8bc130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54764/0 (socket says 172.21.15.154:54764) 2023-09-30T22:28:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8ba7fc700 1 -- 172.21.15.154:0/3591155101 learned_addr learned my addr 172.21.15.154:0/3591155101 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8baffd700 1 --2- 172.21.15.154:0/3591155101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 0x7fd8bc09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60414/0 (socket says 172.21.15.154:60414) 2023-09-30T22:28:54.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8baffd700 1 -- 172.21.15.154:0/3591155101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 msgr2=0x7fd8bc130d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T22:28:54.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8baffd700 1 --2- 172.21.15.154:0/3591155101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 0x7fd8bc130d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8baffd700 1 -- 172.21.15.154:0/3591155101 >> v2:172.21.15.154:3300/0 conn(0x7fd8bc09a730 msgr2=0x7fd8bc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:54.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8baffd700 1 --2- 172.21.15.154:0/3591155101 >> v2:172.21.15.154:3300/0 conn(0x7fd8bc09a730 0x7fd8bc130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8baffd700 1 -- 172.21.15.154:0/3591155101 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc09bb90 con 0x7fd8bc099e20 2023-09-30T22:28:54.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8ba7fc700 1 --2- 172.21.15.154:0/3591155101 >> v2:172.21.15.154:3300/0 conn(0x7fd8bc09a730 0x7fd8bc130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:54.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8baffd700 1 --2- 172.21.15.154:0/3591155101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 0x7fd8bc09a1f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00b900 tx=0x7fd8ac00bc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=639cc35e034b000 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8b9ffb700 1 -- 172.21.15.154:0/3591155101 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac005e30 con 0x7fd8bc099e20 2023-09-30T22:28:54.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8b9ffb700 1 -- 172.21.15.154:0/3591155101 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac00c5e0 con 0x7fd8bc099e20 2023-09-30T22:28:54.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fd8b9ffb700 1 -- 172.21.15.154:0/3591155101 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00c970 con 0x7fd8bc099e20 2023-09-30T22:28:54.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.627+0000 7fb33b8a9700 1 Processor -- start 2023-09-30T22:28:54.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb33b8a9700 1 -- start start 2023-09-30T22:28:54.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fd8c16e5700 1 -- 172.21.15.154:0/3591155101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 msgr2=0x7fd8bc09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fd8c16e5700 1 --2- 172.21.15.154:0/3591155101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 0x7fd8bc09a1f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00b900 tx=0x7fd8ac00bc10 comp rx=0 tx=0).stop 2023-09-30T22:28:54.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fd8c16e5700 1 -- 172.21.15.154:0/3591155101 shutdown_connections 2023-09-30T22:28:54.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fd8c16e5700 1 --2- 172.21.15.154:0/3591155101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 0x7fd8bc130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fd8c16e5700 1 --2- 172.21.15.154:0/3591155101 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 0x7fd8bc09a1f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fd8c16e5700 1 --2- 172.21.15.154:0/3591155101 >> v2:172.21.15.154:3300/0 conn(0x7fd8bc09a730 0x7fd8bc130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fd8c16e5700 1 -- 172.21.15.154:0/3591155101 >> 172.21.15.154:0/3591155101 conn(0x7fd8bc0a2980 msgr2=0x7fd8bc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fd8c16e5700 1 -- 172.21.15.154:0/3591155101 shutdown_connections 2023-09-30T22:28:54.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fd8c16e5700 1 -- 172.21.15.154:0/3591155101 wait complete. 2023-09-30T22:28:54.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb33b8a9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a0a70 0x7fb334127e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb33b8a9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3340a1550 0x7fb334128370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb33b8a9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb334139200 0x7fb3341cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb33b8a9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33412af80 con 0x7fb3340a1550 2023-09-30T22:28:54.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb33b8a9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb334138dc0 con 0x7fb3340a0a70 2023-09-30T22:28:54.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb33b8a9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340a03e0 con 0x7fb334139200 2023-09-30T22:28:54.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb338e44700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3340a1550 0x7fb334128370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb338e44700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3340a1550 0x7fb334128370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54774/0 (socket says 172.21.15.154:54774) 2023-09-30T22:28:54.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.628+0000 7fb338e44700 1 -- 172.21.15.154:0/4755464 learned_addr learned my addr 172.21.15.154:0/4755464 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:54.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb338e44700 1 -- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb334139200 msgr2=0x7fb3341cc6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-30T22:28:54.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb338e44700 1 --2- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb334139200 0x7fb3341cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb338e44700 1 -- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a0a70 msgr2=0x7fb334127e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb338e44700 1 --2- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a0a70 0x7fb334127e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb338e44700 1 -- 172.21.15.154:0/4755464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c009a70 con 0x7fb3340a1550 2023-09-30T22:28:54.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb338e44700 1 --2- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3340a1550 0x7fb334128370 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fb3240090b0 tx=0x7fb324004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb329ffb700 1 -- 172.21.15.154:0/4755464 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3240036a0 con 0x7fb3340a1550 2023-09-30T22:28:54.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb329ffb700 1 -- 172.21.15.154:0/4755464 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32401f070 con 0x7fb3340a1550 2023-09-30T22:28:54.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb33b8a9700 1 -- 172.21.15.154:0/4755464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3240094a0 con 0x7fb3340a1550 2023-09-30T22:28:54.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb329ffb700 1 -- 172.21.15.154:0/4755464 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324003a40 con 0x7fb3340a1550 2023-09-30T22:28:54.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.629+0000 7fb33b8a9700 1 -- 172.21.15.154:0/4755464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33409c510 con 0x7fb3340a1550 2023-09-30T22:28:54.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.630+0000 7fd8c16e5700 1 Processor -- start 2023-09-30T22:28:54.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.630+0000 7fd8c16e5700 1 -- start start 2023-09-30T22:28:54.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.630+0000 7fb329ffb700 1 -- 172.21.15.154:0/4755464 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb324003ba0 con 0x7fb3340a1550 2023-09-30T22:28:54.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.630+0000 7fb33b8a9700 1 -- 172.21.15.154:0/4755464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33412a940 con 0x7fb3340a1550 2023-09-30T22:28:54.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.630+0000 7fb329ffb700 1 -- 172.21.15.154:0/4755464 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb324021070 con 0x7fb3340a1550 2023-09-30T22:28:54.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8c16e5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 0x7fd8bc1241c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8c16e5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc09a730 0x7fd8bc124700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8c16e5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 0x7fd8bc1cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:54.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8c16e5700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc127170 con 0x7fd8bc09a730 2023-09-30T22:28:54.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8c16e5700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc125460 con 0x7fd8bc130890 2023-09-30T22:28:54.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8c16e5700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0a1540 con 0x7fd8bc099e20 2023-09-30T22:28:54.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8bb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 0x7fd8bc1cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:54.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8bb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 0x7fd8bc1cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44762/0 (socket says 172.21.15.154:44762) 2023-09-30T22:28:54.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8bb7fe700 1 -- 172.21.15.154:0/115442146 learned_addr learned my addr 172.21.15.154:0/115442146 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:54.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8bb7fe700 1 -- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 msgr2=0x7fd8bc1241c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8bb7fe700 1 --2- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 0x7fd8bc1241c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8bb7fe700 1 -- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc09a730 msgr2=0x7fd8bc124700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8bb7fe700 1 --2- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc09a730 0x7fd8bc124700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8bb7fe700 1 -- 172.21.15.154:0/115442146 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b000d9f0 con 0x7fd8bc130890 2023-09-30T22:28:54.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.631+0000 7fd8bb7fe700 1 --2- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 0x7fd8bc1cc6a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400b970 tx=0x7fd8b400bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:54.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.632+0000 7fd8a37fe700 1 -- 172.21.15.154:0/115442146 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400c9b0 con 0x7fd8bc130890 2023-09-30T22:28:54.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.632+0000 7fd8a37fe700 1 -- 172.21.15.154:0/115442146 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400cb30 con 0x7fd8bc130890 2023-09-30T22:28:54.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.632+0000 7fd8c16e5700 1 -- 172.21.15.154:0/115442146 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac00b4e0 con 0x7fd8bc130890 2023-09-30T22:28:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.632+0000 7fd8c16e5700 1 -- 172.21.15.154:0/115442146 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc125c50 con 0x7fd8bc130890 2023-09-30T22:28:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.632+0000 7fd8a37fe700 1 -- 172.21.15.154:0/115442146 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4014440 con 0x7fd8bc130890 2023-09-30T22:28:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.633+0000 7fd8c16e5700 1 -- 172.21.15.154:0/115442146 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c0052e0 con 0x7fd8bc130890 2023-09-30T22:28:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.633+0000 7fd8a37fe700 1 -- 172.21.15.154:0/115442146 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8b401d3b0 con 0x7fd8bc130890 2023-09-30T22:28:54.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.633+0000 7fd8a37fe700 1 -- 172.21.15.154:0/115442146 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd8b403f470 con 0x7fd8bc130890 2023-09-30T22:28:54.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.636+0000 7fb329ffb700 1 -- 172.21.15.154:0/4755464 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb324026480 con 0x7fb3340a1550 2023-09-30T22:28:54.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.638+0000 7fd8a37fe700 1 -- 172.21.15.154:0/115442146 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8b401c360 con 0x7fd8bc130890 2023-09-30T22:28:54.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.753+0000 7f03c6495700 1 -- 172.21.15.154:0/477591254 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f03c004f2a0 con 0x7f03c009bc70 2023-09-30T22:28:54.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.753+0000 7f03bcff9700 1 -- 172.21.15.154:0/477591254 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03b0021020 con 0x7f03c009bc70 2023-09-30T22:28:54.753 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:54.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.756+0000 7f03c6495700 1 -- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 msgr2=0x7f03c011d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.756+0000 7f03c6495700 1 --2- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c011d9e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f03b000e8d0 tx=0x7f03b000ebe0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.756+0000 7f03c6495700 1 -- 172.21.15.154:0/477591254 shutdown_connections 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.756+0000 7f03c6495700 1 --2- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c0131980 0x7f03c011e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.756+0000 7f03c6495700 1 --2- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f03c009bc70 0x7f03c011d9e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.756+0000 7f03c6495700 1 --2- 172.21.15.154:0/477591254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03c009c5c0 0x7f03c011df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.756+0000 7f03c6495700 1 -- 172.21.15.154:0/477591254 >> 172.21.15.154:0/477591254 conn(0x7f03c00a2980 msgr2=0x7f03c006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.757+0000 7f03c6495700 1 -- 172.21.15.154:0/477591254 shutdown_connections 2023-09-30T22:28:54.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.757+0000 7f03c6495700 1 -- 172.21.15.154:0/477591254 wait complete. 2023-09-30T22:28:54.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:54.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.830+0000 7fd8c16e5700 1 -- 172.21.15.154:0/115442146 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd89c005590 con 0x7fd8bc130890 2023-09-30T22:28:54.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.831+0000 7fd8a37fe700 1 -- 172.21.15.154:0/115442146 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8b4019070 con 0x7fd8bc130890 2023-09-30T22:28:54.831 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:54.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.834+0000 7fd8c16e5700 1 -- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 msgr2=0x7fd8bc1cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.834+0000 7fd8c16e5700 1 --2- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 0x7fd8bc1cc6a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400b970 tx=0x7fd8b400bd30 comp rx=0 tx=0).stop 2023-09-30T22:28:54.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.834+0000 7fd8c16e5700 1 -- 172.21.15.154:0/115442146 shutdown_connections 2023-09-30T22:28:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.834+0000 7fd8c16e5700 1 --2- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc130890 0x7fd8bc1cc6a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.834+0000 7fd8c16e5700 1 --2- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd8bc099e20 0x7fd8bc1241c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.834+0000 7fd8c16e5700 1 --2- 172.21.15.154:0/115442146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc09a730 0x7fd8bc124700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.834+0000 7fd8c16e5700 1 -- 172.21.15.154:0/115442146 >> 172.21.15.154:0/115442146 conn(0x7fd8bc0a2980 msgr2=0x7fd8bc09e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.834+0000 7fd8c16e5700 1 -- 172.21.15.154:0/115442146 shutdown_connections 2023-09-30T22:28:54.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.834+0000 7fd8c16e5700 1 -- 172.21.15.154:0/115442146 wait complete. 2023-09-30T22:28:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.841+0000 7fb33b8a9700 1 -- 172.21.15.154:0/4755464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb33404f2a0 con 0x7fb3340a1550 2023-09-30T22:28:54.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.842+0000 7fb329ffb700 1 -- 172.21.15.154:0/4755464 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb32403e090 con 0x7fb3340a1550 2023-09-30T22:28:54.842 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:54.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.846+0000 7fb33b8a9700 1 -- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3340a1550 msgr2=0x7fb334128370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:54.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.846+0000 7fb33b8a9700 1 --2- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3340a1550 0x7fb334128370 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fb3240090b0 tx=0x7fb324004750 comp rx=0 tx=0).stop 2023-09-30T22:28:54.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.846+0000 7fb33b8a9700 1 -- 172.21.15.154:0/4755464 shutdown_connections 2023-09-30T22:28:54.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.846+0000 7fb33b8a9700 1 --2- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb334139200 0x7fb3341cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.846+0000 7fb33b8a9700 1 --2- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3340a0a70 0x7fb334127e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.846+0000 7fb33b8a9700 1 --2- 172.21.15.154:0/4755464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3340a1550 0x7fb334128370 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:54.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.846+0000 7fb33b8a9700 1 -- 172.21.15.154:0/4755464 >> 172.21.15.154:0/4755464 conn(0x7fb3340a6610 msgr2=0x7fb3340a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:54.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.846+0000 7fb33b8a9700 1 -- 172.21.15.154:0/4755464 shutdown_connections 2023-09-30T22:28:54.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:54.846+0000 7fb33b8a9700 1 -- 172.21.15.154:0/4755464 wait complete. 2023-09-30T22:28:54.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:54.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:55.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:55.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.711+0000 7f282ed23700 1 Processor -- start 2023-09-30T22:28:55.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.711+0000 7f282ed23700 1 -- start start 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282ed23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282806a770 0x7f282806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282ed23700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f282809dec0 0x7f282806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282ed23700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282806b5c0 con 0x7f2828131a00 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282ed23700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282806e900 con 0x7f282809dec0 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282ed23700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282809d180 con 0x7f282806a770 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f2827fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f282809dec0 0x7f282806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282cabf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282806a770 0x7f282806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282cabf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282806a770 0x7f282806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41544/0 (socket says 172.21.15.154:41544) 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f2827fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f282809dec0 0x7f282806b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50474/0 (socket says 172.21.15.154:50474) 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282cabf700 1 -- 172.21.15.154:0/286988122 learned_addr learned my addr 172.21.15.154:0/286988122 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:55.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282d2c0700 1 --1- 172.21.15.154:0/286988122 >> v1:172.21.15.154:6789/0 conn(0x7f2828131a00 0x7f2828131e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46996/0 (socket says 172.21.15.154:46996) 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282cabf700 1 -- 172.21.15.154:0/286988122 >> v2:172.21.15.154:3300/0 conn(0x7f282809dec0 msgr2=0x7f282806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282cabf700 1 --2- 172.21.15.154:0/286988122 >> v2:172.21.15.154:3300/0 conn(0x7f282809dec0 0x7f282806b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282cabf700 1 -- 172.21.15.154:0/286988122 >> v1:172.21.15.154:6789/0 conn(0x7f2828131a00 legacy=0x7f2828131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282cabf700 1 -- 172.21.15.154:0/286988122 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282809e780 con 0x7f282806a770 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f2827fff700 1 --2- 172.21.15.154:0/286988122 >> v2:172.21.15.154:3300/0 conn(0x7f282809dec0 0x7f282806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.712+0000 7f282cabf700 1 --2- 172.21.15.154:0/286988122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282806a770 0x7f282806ab40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f281c0098f0 tx=0x7f281c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=413ccad2775d6037 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f28277fe700 1 -- 172.21.15.154:0/286988122 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011830 con 0x7f282806a770 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f28277fe700 1 -- 172.21.15.154:0/286988122 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c011990 con 0x7f282806a770 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f28277fe700 1 -- 172.21.15.154:0/286988122 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011d20 con 0x7f282806a770 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f282ed23700 1 -- 172.21.15.154:0/286988122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282806a770 msgr2=0x7f282806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f282ed23700 1 --2- 172.21.15.154:0/286988122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282806a770 0x7f282806ab40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f281c0098f0 tx=0x7f281c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:55.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f282ed23700 1 -- 172.21.15.154:0/286988122 shutdown_connections 2023-09-30T22:28:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f282ed23700 1 --2- 172.21.15.154:0/286988122 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f282806a770 0x7f282806ab40 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f282ed23700 1 --2- 172.21.15.154:0/286988122 >> v2:172.21.15.154:3300/0 conn(0x7f282809dec0 0x7f282806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f282ed23700 1 -- 172.21.15.154:0/286988122 >> 172.21.15.154:0/286988122 conn(0x7f2828099c40 msgr2=0x7f28280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f282ed23700 1 -- 172.21.15.154:0/286988122 shutdown_connections 2023-09-30T22:28:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.713+0000 7f282ed23700 1 -- 172.21.15.154:0/286988122 wait complete. 2023-09-30T22:28:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.714+0000 7f282ed23700 1 Processor -- start 2023-09-30T22:28:55.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.714+0000 7f282ed23700 1 -- start start 2023-09-30T22:28:55.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282ed23700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282806a770 0x7f282811c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282ed23700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809dec0 0x7f282811c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282ed23700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131a00 0x7f282811cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282ed23700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282811d620 con 0x7f282806a770 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282ed23700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282812f540 con 0x7f282809dec0 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282ed23700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282811efb0 con 0x7f2828131a00 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282cabf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282806a770 0x7f282811c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f2827fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809dec0 0x7f282811c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282cabf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282806a770 0x7f282811c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50476/0 (socket says 172.21.15.154:50476) 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282cabf700 1 -- 172.21.15.154:0/3938279458 learned_addr learned my addr 172.21.15.154:0/3938279458 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282d2c0700 1 --2- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131a00 0x7f282811cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282cabf700 1 -- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131a00 msgr2=0x7f282811cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282cabf700 1 --2- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131a00 0x7f282811cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282cabf700 1 -- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809dec0 msgr2=0x7f282811c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282cabf700 1 --2- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809dec0 0x7f282811c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282cabf700 1 -- 172.21.15.154:0/3938279458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281400d940 con 0x7f282806a770 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282cabf700 1 --2- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282806a770 0x7f282811c150 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f281c000c00 tx=0x7f281c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f28257fa700 1 -- 172.21.15.154:0/3938279458 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c004400 con 0x7f282806a770 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f28257fa700 1 -- 172.21.15.154:0/3938279458 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c01f070 con 0x7f282806a770 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f282ed23700 1 -- 172.21.15.154:0/3938279458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c009550 con 0x7f282806a770 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.715+0000 7f28257fa700 1 -- 172.21.15.154:0/3938279458 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c0038e0 con 0x7f282806a770 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.716+0000 7f282ed23700 1 -- 172.21.15.154:0/3938279458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282811f400 con 0x7f282806a770 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.716+0000 7f28257fa700 1 -- 172.21.15.154:0/3938279458 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f281c021030 con 0x7f282806a770 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.716+0000 7f28257fa700 1 -- 172.21.15.154:0/3938279458 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f281c040940 con 0x7f282806a770 2023-09-30T22:28:55.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.716+0000 7f282ed23700 1 -- 172.21.15.154:0/3938279458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28281314f0 con 0x7f282806a770 2023-09-30T22:28:55.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.721+0000 7f28257fa700 1 -- 172.21.15.154:0/3938279458 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f281c0199a0 con 0x7f282806a770 2023-09-30T22:28:55.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:55.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:55.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:55.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.899+0000 7f29246f2700 1 Processor -- start 2023-09-30T22:28:55.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.899+0000 7f29246f2700 1 -- start start 2023-09-30T22:28:55.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.899+0000 7f29246f2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f291c099e20 0x7f291c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.899+0000 7f29246f2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c09a730 0x7f291c130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.899+0000 7f29246f2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f291c130890 0x7f291c130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.899+0000 7f29246f2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c09bf50 con 0x7f291c099e20 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f29246f2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c131220 con 0x7f291c130890 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f29246f2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f291c099a60 con 0x7f291c09a730 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f292248e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f291c099e20 0x7f291c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f2921c8d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c09a730 0x7f291c130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f2921c8d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c09a730 0x7f291c130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41554/0 (socket says 172.21.15.154:41554) 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f292248e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f291c099e20 0x7f291c09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50482/0 (socket says 172.21.15.154:50482) 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f2921c8d700 1 -- 172.21.15.154:0/3086906007 learned_addr learned my addr 172.21.15.154:0/3086906007 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f2921c8d700 1 -- 172.21.15.154:0/3086906007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f291c130890 msgr2=0x7f291c130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:55.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f2921c8d700 1 --2- 172.21.15.154:0/3086906007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f291c130890 0x7f291c130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f2921c8d700 1 -- 172.21.15.154:0/3086906007 >> v2:172.21.15.154:3300/0 conn(0x7f291c099e20 msgr2=0x7f291c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:55.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f2921c8d700 1 --2- 172.21.15.154:0/3086906007 >> v2:172.21.15.154:3300/0 conn(0x7f291c099e20 0x7f291c09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f2921c8d700 1 -- 172.21.15.154:0/3086906007 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c09b230 con 0x7f291c09a730 2023-09-30T22:28:55.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f292248e700 1 --2- 172.21.15.154:0/3086906007 >> v2:172.21.15.154:3300/0 conn(0x7f291c099e20 0x7f291c09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:55.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f2921c8d700 1 --2- 172.21.15.154:0/3086906007 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c09a730 0x7f291c130350 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f290c009920 tx=0x7f290c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31380f57ea45077 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:55.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.900+0000 7f292148c700 1 -- 172.21.15.154:0/3086906007 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c011830 con 0x7f291c09a730 2023-09-30T22:28:55.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.901+0000 7f292148c700 1 -- 172.21.15.154:0/3086906007 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c011990 con 0x7f291c09a730 2023-09-30T22:28:55.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.901+0000 7f292148c700 1 -- 172.21.15.154:0/3086906007 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c011d20 con 0x7f291c09a730 2023-09-30T22:28:55.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.901+0000 7f29246f2700 1 -- 172.21.15.154:0/3086906007 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c09a730 msgr2=0x7f291c130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.901+0000 7f29246f2700 1 --2- 172.21.15.154:0/3086906007 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c09a730 0x7f291c130350 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f290c009920 tx=0x7f290c009c30 comp rx=0 tx=0).stop 2023-09-30T22:28:55.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.901+0000 7f29246f2700 1 -- 172.21.15.154:0/3086906007 shutdown_connections 2023-09-30T22:28:55.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.901+0000 7f29246f2700 1 --2- 172.21.15.154:0/3086906007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f291c130890 0x7f291c130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.901+0000 7f29246f2700 1 --2- 172.21.15.154:0/3086906007 >> v2:172.21.15.154:3300/0 conn(0x7f291c099e20 0x7f291c09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.901+0000 7f29246f2700 1 --2- 172.21.15.154:0/3086906007 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c09a730 0x7f291c130350 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.901+0000 7f29246f2700 1 -- 172.21.15.154:0/3086906007 >> 172.21.15.154:0/3086906007 conn(0x7f291c0a2980 msgr2=0x7f291c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.902+0000 7f29246f2700 1 -- 172.21.15.154:0/3086906007 shutdown_connections 2023-09-30T22:28:55.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.902+0000 7f29246f2700 1 -- 172.21.15.154:0/3086906007 wait complete. 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f29246f2700 1 Processor -- start 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f29246f2700 1 -- start start 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f29246f2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c099e20 0x7f291c11b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f29246f2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f291c09a730 0x7f291c11be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f29246f2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c130890 0x7f291c11c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f29246f2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c12dcd0 con 0x7f291c130890 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f29246f2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c11db20 con 0x7f291c09a730 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f29246f2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f291c11e750 con 0x7f291c099e20 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f2922c8f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c130890 0x7f291c11c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f292248e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c099e20 0x7f291c11b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f292248e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c099e20 0x7f291c11b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41558/0 (socket says 172.21.15.154:41558) 2023-09-30T22:28:55.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f2922c8f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c130890 0x7f291c11c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50496/0 (socket says 172.21.15.154:50496) 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f292248e700 1 -- 172.21.15.154:0/4161296391 learned_addr learned my addr 172.21.15.154:0/4161296391 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.903+0000 7f2921c8d700 1 --2- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f291c09a730 0x7f291c11be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f292248e700 1 -- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f291c09a730 msgr2=0x7f291c11be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f292248e700 1 --2- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f291c09a730 0x7f291c11be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f292248e700 1 -- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c130890 msgr2=0x7f291c11c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f292248e700 1 --2- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c130890 0x7f291c11c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f292248e700 1 -- 172.21.15.154:0/4161296391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2918009430 con 0x7f291c099e20 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f292248e700 1 --2- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c099e20 0x7f291c11b8f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f291800ebe0 tx=0x7f291800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f2912ffd700 1 -- 172.21.15.154:0/4161296391 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2918009740 con 0x7f291c099e20 2023-09-30T22:28:55.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f29246f2700 1 -- 172.21.15.154:0/4161296391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290c009550 con 0x7f291c099e20 2023-09-30T22:28:55.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f29246f2700 1 -- 172.21.15.154:0/4161296391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c11eba0 con 0x7f291c099e20 2023-09-30T22:28:55.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f2912ffd700 1 -- 172.21.15.154:0/4161296391 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2918005a20 con 0x7f291c099e20 2023-09-30T22:28:55.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.904+0000 7f2912ffd700 1 -- 172.21.15.154:0/4161296391 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2918005d90 con 0x7f291c099e20 2023-09-30T22:28:55.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.905+0000 7f2912ffd700 1 -- 172.21.15.154:0/4161296391 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f291800c850 con 0x7f291c099e20 2023-09-30T22:28:55.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.905+0000 7f2912ffd700 1 -- 172.21.15.154:0/4161296391 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f291803fc80 con 0x7f291c099e20 2023-09-30T22:28:55.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.906+0000 7f29246f2700 1 -- 172.21.15.154:0/4161296391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29040052e0 con 0x7f291c099e20 2023-09-30T22:28:55.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.911+0000 7f2912ffd700 1 -- 172.21.15.154:0/4161296391 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2918006030 con 0x7f291c099e20 2023-09-30T22:28:55.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.920+0000 7f282ed23700 1 -- 172.21.15.154:0/3938279458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2828071ce0 con 0x7f282806a770 2023-09-30T22:28:55.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.920+0000 7f28257fa700 1 -- 172.21.15.154:0/3938279458 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f281c0193b0 con 0x7f282806a770 2023-09-30T22:28:55.920 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:55.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.922+0000 7f282ed23700 1 -- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282806a770 msgr2=0x7f282811c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.922+0000 7f282ed23700 1 --2- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282806a770 0x7f282811c150 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f281c000c00 tx=0x7f281c004750 comp rx=0 tx=0).stop 2023-09-30T22:28:55.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.924+0000 7f282ed23700 1 -- 172.21.15.154:0/3938279458 shutdown_connections 2023-09-30T22:28:55.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.924+0000 7f282ed23700 1 --2- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2828131a00 0x7f282811cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.924+0000 7f282ed23700 1 --2- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f282806a770 0x7f282811c150 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.924+0000 7f282ed23700 1 --2- 172.21.15.154:0/3938279458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f282809dec0 0x7f282811c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.924+0000 7f282ed23700 1 -- 172.21.15.154:0/3938279458 >> 172.21.15.154:0/3938279458 conn(0x7f2828099c40 msgr2=0x7f2828070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.926+0000 7f282ed23700 1 -- 172.21.15.154:0/3938279458 shutdown_connections 2023-09-30T22:28:55.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.929+0000 7f282ed23700 1 -- 172.21.15.154:0/3938279458 wait complete. 2023-09-30T22:28:55.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:55.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.981+0000 7f5d029be700 1 Processor -- start 2023-09-30T22:28:55.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.981+0000 7f5d029be700 1 -- start start 2023-09-30T22:28:55.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5d029be700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5cfc0a1550 0x7f5cfc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5d029be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc139200 0x7f5cfc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5d029be700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc09e9d0 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5d029be700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc09dc00 con 0x7f5cfc0a1550 2023-09-30T22:28:55.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5d029be700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc09dec0 con 0x7f5cfc139200 2023-09-30T22:28:55.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5cfb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5cfc0a1550 0x7f5cfc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5cfb7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5cfc0a1550 0x7f5cfc138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50498/0 (socket says 172.21.15.154:50498) 2023-09-30T22:28:55.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5cfb7fe700 1 -- 172.21.15.154:0/3637792592 learned_addr learned my addr 172.21.15.154:0/3637792592 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:55.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5d00f5b700 1 --2- 172.21.15.154:0/3637792592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc139200 0x7f5cfc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5cfb7fe700 1 -- 172.21.15.154:0/3637792592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc139200 msgr2=0x7f5cfc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:55.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5cfb7fe700 1 --2- 172.21.15.154:0/3637792592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc139200 0x7f5cfc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5cfb7fe700 1 -- 172.21.15.154:0/3637792592 >> v1:172.21.15.154:6789/0 conn(0x7f5cfc0a0a70 legacy=0x7f5cfc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.982+0000 7f5cfb7fe700 1 -- 172.21.15.154:0/3637792592 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc09e6a0 con 0x7f5cfc0a1550 2023-09-30T22:28:55.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.983+0000 7f5cfb7fe700 1 --2- 172.21.15.154:0/3637792592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc0a1550 0x7f5cfc138cc0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098f0 tx=0x7f5cf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989089a010371049 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:55.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.983+0000 7f5cfaffd700 1 -- 172.21.15.154:0/3637792592 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0011830 con 0x7f5cfc0a1550 2023-09-30T22:28:55.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.983+0000 7f5cfaffd700 1 -- 172.21.15.154:0/3637792592 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf0011990 con 0x7f5cfc0a1550 2023-09-30T22:28:55.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.983+0000 7f5cfaffd700 1 -- 172.21.15.154:0/3637792592 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0011d20 con 0x7f5cfc0a1550 2023-09-30T22:28:55.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.983+0000 7f5d029be700 1 -- 172.21.15.154:0/3637792592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc0a1550 msgr2=0x7f5cfc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.983+0000 7f5d029be700 1 --2- 172.21.15.154:0/3637792592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc0a1550 0x7f5cfc138cc0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00098f0 tx=0x7f5cf0009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.983+0000 7f5d029be700 1 -- 172.21.15.154:0/3637792592 shutdown_connections 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.983+0000 7f5d029be700 1 --2- 172.21.15.154:0/3637792592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc139200 0x7f5cfc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.984+0000 7f5d029be700 1 --2- 172.21.15.154:0/3637792592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc0a1550 0x7f5cfc138cc0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.984+0000 7f5d029be700 1 -- 172.21.15.154:0/3637792592 >> 172.21.15.154:0/3637792592 conn(0x7f5cfc0a6610 msgr2=0x7f5cfc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.984+0000 7f5d029be700 1 -- 172.21.15.154:0/3637792592 shutdown_connections 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.984+0000 7f5d029be700 1 -- 172.21.15.154:0/3637792592 wait complete. 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.984+0000 7f5d029be700 1 Processor -- start 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5d029be700 1 -- start start 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5d029be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc0a0a70 0x7f5cfc11e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5d029be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5cfc0a1550 0x7f5cfc11edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5d029be700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc139200 0x7f5cfc11f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5d029be700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0a52b0 con 0x7f5cfc139200 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5d029be700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1205b0 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5d029be700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0a03e0 con 0x7f5cfc0a1550 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5cfbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc0a0a70 0x7f5cfc11e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5cfbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc0a0a70 0x7f5cfc11e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54854/0 (socket says 172.21.15.154:54854) 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5cfbfff700 1 -- 172.21.15.154:0/2245525757 learned_addr learned my addr 172.21.15.154:0/2245525757 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5d00f5b700 1 --2- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc139200 0x7f5cfc11f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.985+0000 7f5cfbfff700 1 -- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5cfc0a1550 msgr2=0x7f5cfc11edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5cfbfff700 1 --2- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5cfc0a1550 0x7f5cfc11edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5cfbfff700 1 -- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc139200 msgr2=0x7f5cfc11f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5cfbfff700 1 --2- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc139200 0x7f5cfc11f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5cfbfff700 1 -- 172.21.15.154:0/2245525757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0009550 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5d00f5b700 1 --2- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc139200 0x7f5cfc11f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5cfbfff700 1 --2- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc0a0a70 0x7f5cfc11e890 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c4e0 tx=0x7f5cec00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5cf8ff9700 1 -- 172.21.15.154:0/2245525757 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0052d0 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5cf8ff9700 1 -- 172.21.15.154:0/2245525757 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec005430 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5cf8ff9700 1 -- 172.21.15.154:0/2245525757 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0038c0 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5d029be700 1 -- 172.21.15.154:0/2245525757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc1220d0 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.986+0000 7f5d029be700 1 -- 172.21.15.154:0/2245525757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc122b40 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.987+0000 7f5cf8ff9700 1 -- 172.21.15.154:0/2245525757 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5cec003a20 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.987+0000 7f5d029be700 1 -- 172.21.15.154:0/2245525757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc121f10 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.987+0000 7f5cf8ff9700 1 -- 172.21.15.154:0/2245525757 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5cec03eb50 con 0x7f5cfc0a0a70 2023-09-30T22:28:55.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:55.992+0000 7f5cf8ff9700 1 -- 172.21.15.154:0/2245525757 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5cec018260 con 0x7f5cfc0a0a70 2023-09-30T22:28:56.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.026+0000 7f0d6809e700 1 Processor -- start 2023-09-30T22:28:56.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.027+0000 7f0d6809e700 1 -- start start 2023-09-30T22:28:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.027+0000 7f0d6809e700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d6009f430 0x7f0d60136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.027+0000 7f0d6809e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d60137010 0x7f0d601393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.027+0000 7f0d6809e700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6009b6d0 con 0x7f0d6009e950 2023-09-30T22:28:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.027+0000 7f0d6809e700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6009afb0 con 0x7f0d6009f430 2023-09-30T22:28:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.027+0000 7f0d6809e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600a0970 con 0x7f0d60137010 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.027+0000 7f0d65639700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d6009f430 0x7f0d60136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.027+0000 7f0d65639700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d6009f430 0x7f0d60136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50522/0 (socket says 172.21.15.154:50522) 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d65639700 1 -- 172.21.15.154:0/2066056824 learned_addr learned my addr 172.21.15.154:0/2066056824 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d6663b700 1 --2- 172.21.15.154:0/2066056824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d60137010 0x7f0d601393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d65639700 1 -- 172.21.15.154:0/2066056824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d60137010 msgr2=0x7f0d601393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d65639700 1 --2- 172.21.15.154:0/2066056824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d60137010 0x7f0d601393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d65639700 1 -- 172.21.15.154:0/2066056824 >> v1:172.21.15.154:6789/0 conn(0x7f0d6009e950 legacy=0x7f0d6009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d65639700 1 -- 172.21.15.154:0/2066056824 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600a0320 con 0x7f0d6009f430 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d65639700 1 --2- 172.21.15.154:0/2066056824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6009f430 0x7f0d60136ad0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f0d500098f0 tx=0x7f0d50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811451d5b5c23829 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d64e38700 1 -- 172.21.15.154:0/2066056824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50011830 con 0x7f0d6009f430 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d64e38700 1 -- 172.21.15.154:0/2066056824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d50011990 con 0x7f0d6009f430 2023-09-30T22:28:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.028+0000 7f0d64e38700 1 -- 172.21.15.154:0/2066056824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50011d20 con 0x7f0d6009f430 2023-09-30T22:28:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.029+0000 7f0d6809e700 1 -- 172.21.15.154:0/2066056824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6009f430 msgr2=0x7f0d60136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.029+0000 7f0d6809e700 1 --2- 172.21.15.154:0/2066056824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6009f430 0x7f0d60136ad0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f0d500098f0 tx=0x7f0d50009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.029+0000 7f0d6809e700 1 -- 172.21.15.154:0/2066056824 shutdown_connections 2023-09-30T22:28:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.029+0000 7f0d6809e700 1 --2- 172.21.15.154:0/2066056824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d60137010 0x7f0d601393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.029+0000 7f0d6809e700 1 --2- 172.21.15.154:0/2066056824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d6009f430 0x7f0d60136ad0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.029+0000 7f0d6809e700 1 -- 172.21.15.154:0/2066056824 >> 172.21.15.154:0/2066056824 conn(0x7f0d600a0f70 msgr2=0x7f0d600a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.029+0000 7f0d6809e700 1 -- 172.21.15.154:0/2066056824 shutdown_connections 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.029+0000 7f0d6809e700 1 -- 172.21.15.154:0/2066056824 wait complete. 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.030+0000 7f0d6809e700 1 Processor -- start 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.030+0000 7f0d6809e700 1 -- start start 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.030+0000 7f0d6809e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6009e950 0x7f0d6011b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.030+0000 7f0d6809e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6009f430 0x7f0d6011be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.030+0000 7f0d6809e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60137010 0x7f0d6011c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.030+0000 7f0d6809e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6011e760 con 0x7f0d60137010 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.030+0000 7f0d6809e700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6011cd70 con 0x7f0d6009e950 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.030+0000 7f0d6809e700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6009da40 con 0x7f0d6009f430 2023-09-30T22:28:56.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d65e3a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6009e950 0x7f0d6011b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d65e3a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6009e950 0x7f0d6011b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54872/0 (socket says 172.21.15.154:54872) 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d65e3a700 1 -- 172.21.15.154:0/1847068970 learned_addr learned my addr 172.21.15.154:0/1847068970 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d6663b700 1 --2- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60137010 0x7f0d6011c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d6663b700 1 -- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6009f430 msgr2=0x7f0d6011be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d6663b700 1 --2- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6009f430 0x7f0d6011be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d6663b700 1 -- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6009e950 msgr2=0x7f0d6011b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d6663b700 1 --2- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6009e950 0x7f0d6011b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d6663b700 1 -- 172.21.15.154:0/1847068970 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50009550 con 0x7f0d60137010 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d65e3a700 1 --2- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6009e950 0x7f0d6011b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d6663b700 1 --2- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60137010 0x7f0d6011c390 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800efc0 tx=0x7f0d5800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:56.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d567fc700 1 -- 172.21.15.154:0/1847068970 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800cd40 con 0x7f0d60137010 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d567fc700 1 -- 172.21.15.154:0/1847068970 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5800f040 con 0x7f0d60137010 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d6809e700 1 -- 172.21.15.154:0/1847068970 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6011dce0 con 0x7f0d60137010 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d567fc700 1 -- 172.21.15.154:0/1847068970 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d580146c0 con 0x7f0d60137010 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.031+0000 7f0d6809e700 1 -- 172.21.15.154:0/1847068970 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d600a4e30 con 0x7f0d60137010 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.032+0000 7f0d567fc700 1 -- 172.21.15.154:0/1847068970 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d58014820 con 0x7f0d60137010 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.032+0000 7f0d567fc700 1 -- 172.21.15.154:0/1847068970 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d58040250 con 0x7f0d60137010 2023-09-30T22:28:56.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.033+0000 7f0d6809e700 1 -- 172.21.15.154:0/1847068970 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d60136d40 con 0x7f0d60137010 2023-09-30T22:28:56.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.037+0000 7f0d567fc700 1 -- 172.21.15.154:0/1847068970 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d58018020 con 0x7f0d60137010 2023-09-30T22:28:56.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.109+0000 7f29246f2700 1 -- 172.21.15.154:0/4161296391 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2904005590 con 0x7f291c099e20 2023-09-30T22:28:56.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.109+0000 7f2912ffd700 1 -- 172.21.15.154:0/4161296391 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29180123d0 con 0x7f291c099e20 2023-09-30T22:28:56.109 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.111+0000 7f29246f2700 1 -- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c099e20 msgr2=0x7f291c11b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.111+0000 7f29246f2700 1 --2- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c099e20 0x7f291c11b8f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f291800ebe0 tx=0x7f291800eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.112+0000 7f29246f2700 1 -- 172.21.15.154:0/4161296391 shutdown_connections 2023-09-30T22:28:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.112+0000 7f29246f2700 1 --2- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f291c130890 0x7f291c11c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.112+0000 7f29246f2700 1 --2- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f291c099e20 0x7f291c11b8f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.112+0000 7f29246f2700 1 --2- 172.21.15.154:0/4161296391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f291c09a730 0x7f291c11be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.112+0000 7f29246f2700 1 -- 172.21.15.154:0/4161296391 >> 172.21.15.154:0/4161296391 conn(0x7f291c0a2980 msgr2=0x7f291c09fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.112+0000 7f29246f2700 1 -- 172.21.15.154:0/4161296391 shutdown_connections 2023-09-30T22:28:56.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.112+0000 7f29246f2700 1 -- 172.21.15.154:0/4161296391 wait complete. 2023-09-30T22:28:56.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:56.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.187+0000 7f5d029be700 1 -- 172.21.15.154:0/2245525757 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5cfc121d70 con 0x7f5cfc0a0a70 2023-09-30T22:28:56.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.188+0000 7f5cf8ff9700 1 -- 172.21.15.154:0/2245525757 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5cfc121d70 con 0x7f5cfc0a0a70 2023-09-30T22:28:56.188 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:56.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.190+0000 7f5d029be700 1 -- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc0a0a70 msgr2=0x7f5cfc11e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.190+0000 7f5d029be700 1 --2- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc0a0a70 0x7f5cfc11e890 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00c4e0 tx=0x7f5cec00c7f0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.190+0000 7f5d029be700 1 -- 172.21.15.154:0/2245525757 shutdown_connections 2023-09-30T22:28:56.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.190+0000 7f5d029be700 1 --2- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cfc139200 0x7f5cfc11f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.190+0000 7f5d029be700 1 --2- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cfc0a0a70 0x7f5cfc11e890 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.190+0000 7f5d029be700 1 --2- 172.21.15.154:0/2245525757 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5cfc0a1550 0x7f5cfc11edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.190+0000 7f5d029be700 1 -- 172.21.15.154:0/2245525757 >> 172.21.15.154:0/2245525757 conn(0x7f5cfc0a6610 msgr2=0x7f5cfc136d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.190+0000 7f5d029be700 1 -- 172.21.15.154:0/2245525757 shutdown_connections 2023-09-30T22:28:56.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.190+0000 7f5d029be700 1 -- 172.21.15.154:0/2245525757 wait complete. 2023-09-30T22:28:56.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.232+0000 7f0d6809e700 1 -- 172.21.15.154:0/1847068970 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d6011ef30 con 0x7f0d60137010 2023-09-30T22:28:56.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.233+0000 7f0d567fc700 1 -- 172.21.15.154:0/1847068970 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d5802b090 con 0x7f0d60137010 2023-09-30T22:28:56.233 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.235+0000 7f0d6809e700 1 -- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60137010 msgr2=0x7f0d6011c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.235+0000 7f0d6809e700 1 --2- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60137010 0x7f0d6011c390 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800efc0 tx=0x7f0d5800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.235+0000 7f0d6809e700 1 -- 172.21.15.154:0/1847068970 shutdown_connections 2023-09-30T22:28:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.235+0000 7f0d6809e700 1 --2- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d60137010 0x7f0d6011c390 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.235+0000 7f0d6809e700 1 --2- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d6009e950 0x7f0d6011b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.235+0000 7f0d6809e700 1 --2- 172.21.15.154:0/1847068970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0d6009f430 0x7f0d6011be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.235+0000 7f0d6809e700 1 -- 172.21.15.154:0/1847068970 >> 172.21.15.154:0/1847068970 conn(0x7f0d600a0f70 msgr2=0x7f0d60071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.235+0000 7f0d6809e700 1 -- 172.21.15.154:0/1847068970 shutdown_connections 2023-09-30T22:28:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:56.235+0000 7f0d6809e700 1 -- 172.21.15.154:0/1847068970 wait complete. 2023-09-30T22:28:56.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:56.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:57.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.071+0000 7f8788a35700 1 Processor -- start 2023-09-30T22:28:57.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.071+0000 7f8788a35700 1 -- start start 2023-09-30T22:28:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8788a35700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f8784133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8788a35700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841300a0 0x7f87841304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8788a35700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87841309f0 0x7f878413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8788a35700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878406b2d0 con 0x7f87841309f0 2023-09-30T22:28:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8788a35700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8784133610 con 0x7f87841300a0 2023-09-30T22:28:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8788a35700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f878409a500 con 0x7f8784133ad0 2023-09-30T22:28:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f878259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f8784133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8781d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841300a0 0x7f87841304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8782d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87841309f0 0x7f878413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8781d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841300a0 0x7f87841304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54878/0 (socket says 172.21.15.154:54878) 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f878259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f8784133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41588/0 (socket says 172.21.15.154:41588) 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8781d9b700 1 -- 172.21.15.154:0/3847817219 learned_addr learned my addr 172.21.15.154:0/3847817219 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8782d9d700 1 --2- 172.21.15.154:0/3847817219 >> v2:172.21.15.154:3300/0 conn(0x7f87841309f0 0x7f878413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50552/0 (socket says 172.21.15.154:50552) 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8781d9b700 1 -- 172.21.15.154:0/3847817219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 msgr2=0x7f8784133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8781d9b700 1 --2- 172.21.15.154:0/3847817219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f8784133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8781d9b700 1 -- 172.21.15.154:0/3847817219 >> v2:172.21.15.154:3300/0 conn(0x7f87841309f0 msgr2=0x7f878413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8781d9b700 1 --2- 172.21.15.154:0/3847817219 >> v2:172.21.15.154:3300/0 conn(0x7f87841309f0 0x7f878413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8781d9b700 1 -- 172.21.15.154:0/3847817219 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87841338b0 con 0x7f87841300a0 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f878259c700 1 --2- 172.21.15.154:0/3847817219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f8784133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8782d9d700 1 --2- 172.21.15.154:0/3847817219 >> v2:172.21.15.154:3300/0 conn(0x7f87841309f0 0x7f878413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f8781d9b700 1 --2- 172.21.15.154:0/3847817219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841300a0 0x7f87841304b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f87740098f0 tx=0x7f8774009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e6a15d393d8396 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f878159a700 1 -- 172.21.15.154:0/3847817219 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774011830 con 0x7f87841300a0 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f878159a700 1 -- 172.21.15.154:0/3847817219 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774011990 con 0x7f87841300a0 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.072+0000 7f878159a700 1 -- 172.21.15.154:0/3847817219 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774011d20 con 0x7f87841300a0 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.073+0000 7f8788a35700 1 -- 172.21.15.154:0/3847817219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841300a0 msgr2=0x7f87841304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.073+0000 7f8788a35700 1 --2- 172.21.15.154:0/3847817219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841300a0 0x7f87841304b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f87740098f0 tx=0x7f8774009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.073+0000 7f8788a35700 1 -- 172.21.15.154:0/3847817219 shutdown_connections 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.073+0000 7f8788a35700 1 --2- 172.21.15.154:0/3847817219 >> v2:172.21.15.154:3300/0 conn(0x7f87841309f0 0x7f878413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.073+0000 7f8788a35700 1 --2- 172.21.15.154:0/3847817219 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f8784133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.073+0000 7f8788a35700 1 --2- 172.21.15.154:0/3847817219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841300a0 0x7f87841304b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.073+0000 7f8788a35700 1 -- 172.21.15.154:0/3847817219 >> 172.21.15.154:0/3847817219 conn(0x7f8784099c40 msgr2=0x7f87840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.073+0000 7f8788a35700 1 -- 172.21.15.154:0/3847817219 shutdown_connections 2023-09-30T22:28:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.073+0000 7f8788a35700 1 -- 172.21.15.154:0/3847817219 wait complete. 2023-09-30T22:28:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.074+0000 7f8788a35700 1 Processor -- start 2023-09-30T22:28:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.074+0000 7f8788a35700 1 -- start start 2023-09-30T22:28:57.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.074+0000 7f8788a35700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87841300a0 0x7f87841c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.074+0000 7f8788a35700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841309f0 0x7f87841c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.074+0000 7f8788a35700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f87841c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8788a35700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878411fe90 con 0x7f87841300a0 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8788a35700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8784120170 con 0x7f87841309f0 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8788a35700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f878412fd70 con 0x7f8784133ad0 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f878259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87841300a0 0x7f87841c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f878259c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87841300a0 0x7f87841c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50566/0 (socket says 172.21.15.154:50566) 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f878259c700 1 -- 172.21.15.154:0/3050299897 learned_addr learned my addr 172.21.15.154:0/3050299897 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8782d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f87841c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8781d9b700 1 --2- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841309f0 0x7f87841c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8782d9d700 1 -- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841309f0 msgr2=0x7f87841c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8782d9d700 1 --2- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841309f0 0x7f87841c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8782d9d700 1 -- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87841300a0 msgr2=0x7f87841c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8782d9d700 1 --2- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87841300a0 0x7f87841c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8782d9d700 1 -- 172.21.15.154:0/3050299897 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c009a70 con 0x7f8784133ad0 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8782d9d700 1 --2- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f87841c91d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f877c00efc0 tx=0x7f877c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8772ffd700 1 -- 172.21.15.154:0/3050299897 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c009e80 con 0x7f8784133ad0 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8772ffd700 1 -- 172.21.15.154:0/3050299897 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c00f040 con 0x7f8784133ad0 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8772ffd700 1 -- 172.21.15.154:0/3050299897 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c00ccd0 con 0x7f8784133ad0 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8788a35700 1 -- 172.21.15.154:0/3050299897 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87780094a0 con 0x7f8784133ad0 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.075+0000 7f8788a35700 1 -- 172.21.15.154:0/3050299897 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8774009550 con 0x7f8784133ad0 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.076+0000 7f8772ffd700 1 -- 172.21.15.154:0/3050299897 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f877c014480 con 0x7f8784133ad0 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.076+0000 7f8772ffd700 1 -- 172.21.15.154:0/3050299897 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f877c03fc40 con 0x7f8784133ad0 2023-09-30T22:28:57.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.076+0000 7f8788a35700 1 -- 172.21.15.154:0/3050299897 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878404f2a0 con 0x7f8784133ad0 2023-09-30T22:28:57.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.081+0000 7f8772ffd700 1 -- 172.21.15.154:0/3050299897 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f877c01d410 con 0x7f8784133ad0 2023-09-30T22:28:57.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:57.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:57.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:57.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.252+0000 7fd0e193c700 1 Processor -- start 2023-09-30T22:28:57.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.252+0000 7fd0e193c700 1 -- start start 2023-09-30T22:28:57.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0e193c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0dc131980 0x7fd0dc131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0e193c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09c790 0x7fd0dc139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0e193c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc0a1640 con 0x7fd0dc09bc70 2023-09-30T22:28:57.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0e193c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc06eb30 con 0x7fd0dc131980 2023-09-30T22:28:57.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0e193c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0a22d0 con 0x7fd0dc09c790 2023-09-30T22:28:57.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0db7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09c790 0x7fd0dc139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0db7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09c790 0x7fd0dc139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41608/0 (socket says 172.21.15.154:41608) 2023-09-30T22:28:57.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0db7fe700 1 -- 172.21.15.154:0/1531824766 learned_addr learned my addr 172.21.15.154:0/1531824766 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0db7fe700 1 -- 172.21.15.154:0/1531824766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0dc131980 msgr2=0x7fd0dc131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0db7fe700 1 --2- 172.21.15.154:0/1531824766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0dc131980 0x7fd0dc131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0db7fe700 1 -- 172.21.15.154:0/1531824766 >> v1:172.21.15.154:6789/0 conn(0x7fd0dc09bc70 legacy=0x7fd0dc09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.253+0000 7fd0db7fe700 1 -- 172.21.15.154:0/1531824766 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc131550 con 0x7fd0dc09c790 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.254+0000 7fd0db7fe700 1 --2- 172.21.15.154:0/1531824766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09c790 0x7fd0dc139710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e80 tx=0x7fd0d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=176434b309ef2e63 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.254+0000 7fd0d9ffb700 1 -- 172.21.15.154:0/1531824766 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400e070 con 0x7fd0dc09c790 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.254+0000 7fd0d9ffb700 1 -- 172.21.15.154:0/1531824766 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400b9c0 con 0x7fd0dc09c790 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.254+0000 7fd0d9ffb700 1 -- 172.21.15.154:0/1531824766 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400bd70 con 0x7fd0dc09c790 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.255+0000 7fd0e193c700 1 -- 172.21.15.154:0/1531824766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09c790 msgr2=0x7fd0dc139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.255+0000 7fd0e193c700 1 --2- 172.21.15.154:0/1531824766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09c790 0x7fd0dc139710 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e80 tx=0x7fd0d400b330 comp rx=0 tx=0).stop 2023-09-30T22:28:57.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.255+0000 7fd0e193c700 1 -- 172.21.15.154:0/1531824766 shutdown_connections 2023-09-30T22:28:57.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.255+0000 7fd0e193c700 1 --2- 172.21.15.154:0/1531824766 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09c790 0x7fd0dc139710 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.255+0000 7fd0e193c700 1 --2- 172.21.15.154:0/1531824766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0dc131980 0x7fd0dc131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.255+0000 7fd0e193c700 1 -- 172.21.15.154:0/1531824766 >> 172.21.15.154:0/1531824766 conn(0x7fd0dc0a2980 msgr2=0x7fd0dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.255+0000 7fd0e193c700 1 -- 172.21.15.154:0/1531824766 shutdown_connections 2023-09-30T22:28:57.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.255+0000 7fd0e193c700 1 -- 172.21.15.154:0/1531824766 wait complete. 2023-09-30T22:28:57.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.256+0000 7fd0e193c700 1 Processor -- start 2023-09-30T22:28:57.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.256+0000 7fd0e193c700 1 -- start start 2023-09-30T22:28:57.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.256+0000 7fd0e193c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09bc70 0x7fd0dc1c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.256+0000 7fd0e193c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc09c790 0x7fd0dc1c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.256+0000 7fd0e193c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0dc131980 0x7fd0dc099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.256+0000 7fd0e193c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0a1cb0 con 0x7fd0dc09c790 2023-09-30T22:28:57.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.256+0000 7fd0e193c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc12d9f0 con 0x7fd0dc131980 2023-09-30T22:28:57.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.256+0000 7fd0e193c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc1229a0 con 0x7fd0dc09bc70 2023-09-30T22:28:57.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0daffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09bc70 0x7fd0dc1c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0daffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09bc70 0x7fd0dc1c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41620/0 (socket says 172.21.15.154:41620) 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0daffd700 1 -- 172.21.15.154:0/604058961 learned_addr learned my addr 172.21.15.154:0/604058961 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0da7fc700 1 --2- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc09c790 0x7fd0dc1c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0daffd700 1 -- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0dc131980 msgr2=0x7fd0dc099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0daffd700 1 --2- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0dc131980 0x7fd0dc099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0daffd700 1 -- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc09c790 msgr2=0x7fd0dc1c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0daffd700 1 --2- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc09c790 0x7fd0dc1c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0daffd700 1 -- 172.21.15.154:0/604058961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4009b30 con 0x7fd0dc09bc70 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0da7fc700 1 --2- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc09c790 0x7fd0dc1c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.257+0000 7fd0daffd700 1 --2- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09bc70 0x7fd0dc1c8840 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00b520 tx=0x7fd0cc00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.258+0000 7fd0c3fff700 1 -- 172.21.15.154:0/604058961 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc005aa0 con 0x7fd0dc09bc70 2023-09-30T22:28:57.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.258+0000 7fd0c3fff700 1 -- 172.21.15.154:0/604058961 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0cc005c00 con 0x7fd0dc09bc70 2023-09-30T22:28:57.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.258+0000 7fd0e193c700 1 -- 172.21.15.154:0/604058961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc09b820 con 0x7fd0dc09bc70 2023-09-30T22:28:57.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.258+0000 7fd0c3fff700 1 -- 172.21.15.154:0/604058961 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc011630 con 0x7fd0dc09bc70 2023-09-30T22:28:57.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.258+0000 7fd0e193c700 1 -- 172.21.15.154:0/604058961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc1226c0 con 0x7fd0dc09bc70 2023-09-30T22:28:57.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.259+0000 7fd0c3fff700 1 -- 172.21.15.154:0/604058961 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0cc011790 con 0x7fd0dc09bc70 2023-09-30T22:28:57.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.259+0000 7fd0c3fff700 1 -- 172.21.15.154:0/604058961 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0cc03f310 con 0x7fd0dc09bc70 2023-09-30T22:28:57.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.259+0000 7fd0e193c700 1 -- 172.21.15.154:0/604058961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc09ea10 con 0x7fd0dc09bc70 2023-09-30T22:28:57.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.264+0000 7fd0c3fff700 1 -- 172.21.15.154:0/604058961 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0cc005fd0 con 0x7fd0dc09bc70 2023-09-30T22:28:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.281+0000 7f8788a35700 1 -- 172.21.15.154:0/3050299897 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f878406c3b0 con 0x7f8784133ad0 2023-09-30T22:28:57.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.281+0000 7f8772ffd700 1 -- 172.21.15.154:0/3050299897 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f877c012340 con 0x7f8784133ad0 2023-09-30T22:28:57.281 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:57.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.285+0000 7f8788a35700 1 -- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 msgr2=0x7f87841c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.285+0000 7f8788a35700 1 --2- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f87841c91d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f877c00efc0 tx=0x7f877c00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.285+0000 7f8788a35700 1 -- 172.21.15.154:0/3050299897 shutdown_connections 2023-09-30T22:28:57.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.285+0000 7f8788a35700 1 --2- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8784133ad0 0x7f87841c91d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.285+0000 7f8788a35700 1 --2- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87841300a0 0x7f87841c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.285+0000 7f8788a35700 1 --2- 172.21.15.154:0/3050299897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87841309f0 0x7f87841c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.285+0000 7f8788a35700 1 -- 172.21.15.154:0/3050299897 >> 172.21.15.154:0/3050299897 conn(0x7f8784099c40 msgr2=0x7f87840a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.287+0000 7f8788a35700 1 -- 172.21.15.154:0/3050299897 shutdown_connections 2023-09-30T22:28:57.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.287+0000 7f8788a35700 1 -- 172.21.15.154:0/3050299897 wait complete. 2023-09-30T22:28:57.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:57.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.338+0000 7fc7bdb08700 1 Processor -- start 2023-09-30T22:28:57.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7bdb08700 1 -- start start 2023-09-30T22:28:57.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7bdb08700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7bdb08700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7bdb08700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b809e9d0 con 0x7fc7b80a0a70 2023-09-30T22:28:57.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7bdb08700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b809dc00 con 0x7fc7b8139200 2023-09-30T22:28:57.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7bdb08700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b809dec0 con 0x7fc7b80a1550 2023-09-30T22:28:57.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7b6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7b77fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc7b80a0a70 0x7fc7b80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47032/0 (socket says 172.21.15.154:47032) 2023-09-30T22:28:57.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7b77fe700 1 -- 172.21.15.154:0/2921026763 learned_addr learned my addr 172.21.15.154:0/2921026763 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:28:57.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.339+0000 7fc7b6ffd700 1 --2- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41626/0 (socket says 172.21.15.154:41626) 2023-09-30T22:28:57.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b7fff700 1 --2- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b6ffd700 1 -- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 msgr2=0x7fc7b813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b6ffd700 1 --2- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b67fc700 1 -- 172.21.15.154:0/2921026763 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604408184 0 0) 0x7fc7b809e9d0 con 0x7fc7b80a0a70 2023-09-30T22:28:57.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b6ffd700 1 -- 172.21.15.154:0/2921026763 >> v1:172.21.15.154:6789/0 conn(0x7fc7b80a0a70 legacy=0x7fc7b80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b6ffd700 1 -- 172.21.15.154:0/2921026763 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b809e6a0 con 0x7fc7b80a1550 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b7fff700 1 --2- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b6ffd700 1 --2- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b8138cc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009870 tx=0x7fc7ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de151b5b7f1d2f3d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b67fc700 1 -- 172.21.15.154:0/2921026763 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac011830 con 0x7fc7b80a1550 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b67fc700 1 -- 172.21.15.154:0/2921026763 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac011990 con 0x7fc7b80a1550 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.340+0000 7fc7b67fc700 1 -- 172.21.15.154:0/2921026763 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac011d20 con 0x7fc7b80a1550 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.341+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 msgr2=0x7fc7b8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.341+0000 7fc7bdb08700 1 --2- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b8138cc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009870 tx=0x7fc7ac009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.341+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2921026763 shutdown_connections 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.341+0000 7fc7bdb08700 1 --2- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.341+0000 7fc7bdb08700 1 --2- 172.21.15.154:0/2921026763 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b8138cc0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.341+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2921026763 >> 172.21.15.154:0/2921026763 conn(0x7fc7b80a6610 msgr2=0x7fc7b80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.341+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2921026763 shutdown_connections 2023-09-30T22:28:57.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.341+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2921026763 wait complete. 2023-09-30T22:28:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.342+0000 7fc7bdb08700 1 Processor -- start 2023-09-30T22:28:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.342+0000 7fc7bdb08700 1 -- start start 2023-09-30T22:28:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.342+0000 7fc7bdb08700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b80a0a70 0x7fc7b811e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.342+0000 7fc7bdb08700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b811ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.342+0000 7fc7bdb08700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b811f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.342+0000 7fc7bdb08700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8133fd0 con 0x7fc7b80a0a70 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.342+0000 7fc7bdb08700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b81345b0 con 0x7fc7b8139200 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.342+0000 7fc7bdb08700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b80a5100 con 0x7fc7b80a1550 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b811ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b77fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b80a0a70 0x7fc7b811e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b811ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41634/0 (socket says 172.21.15.154:41634) 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b6ffd700 1 -- 172.21.15.154:0/2855436204 learned_addr learned my addr 172.21.15.154:0/2855436204 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b7fff700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b811f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b77fe700 1 -- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 msgr2=0x7fc7b811ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b77fe700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b811ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b77fe700 1 -- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 msgr2=0x7fc7b811f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b77fe700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b811f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b77fe700 1 -- 172.21.15.154:0/2855436204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0009a70 con 0x7fc7b80a0a70 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b7fff700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b6ffd700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b811ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7b77fe700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b80a0a70 0x7fc7b811e6c0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c470 tx=0x7fc7a800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc79ffff700 1 -- 172.21.15.154:0/2855436204 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8004c80 con 0x7fc7b80a0a70 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc79ffff700 1 -- 172.21.15.154:0/2855436204 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a8004de0 con 0x7fc7b80a0a70 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2855436204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ac0094a0 con 0x7fc7b80a0a70 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc79ffff700 1 -- 172.21.15.154:0/2855436204 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8007310 con 0x7fc7b80a0a70 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.343+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2855436204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b8120b30 con 0x7fc7b80a0a70 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.344+0000 7fc79ffff700 1 -- 172.21.15.154:0/2855436204 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7a8007470 con 0x7fc7b80a0a70 2023-09-30T22:28:57.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.344+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2855436204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b804f2a0 con 0x7fc7b80a0a70 2023-09-30T22:28:57.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.345+0000 7fc79ffff700 1 -- 172.21.15.154:0/2855436204 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc7a803f2f0 con 0x7fc7b80a0a70 2023-09-30T22:28:57.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.353+0000 7fc79ffff700 1 -- 172.21.15.154:0/2855436204 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7a8007720 con 0x7fc7b80a0a70 2023-09-30T22:28:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.379+0000 7f2a68455700 1 Processor -- start 2023-09-30T22:28:57.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.379+0000 7f2a68455700 1 -- start start 2023-09-30T22:28:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a68455700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a600a0a70 0x7f2a600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a68455700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a68455700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6009dc00 con 0x7f2a60133f50 2023-09-30T22:28:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a68455700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6009ea60 con 0x7f2a600a0a70 2023-09-30T22:28:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a68455700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6009dec0 con 0x7f2a600a1380 2023-09-30T22:28:57.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a661f1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a600a0a70 0x7f2a600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a659f0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a661f1700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a600a0a70 0x7f2a600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50600/0 (socket says 172.21.15.154:50600) 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a661f1700 1 -- 172.21.15.154:0/3919904683 learned_addr learned my addr 172.21.15.154:0/3919904683 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.380+0000 7f2a659f0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54956/0 (socket says 172.21.15.154:54956) 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.381+0000 7f2a661f1700 1 -- 172.21.15.154:0/3919904683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a1380 msgr2=0x7f2a60133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.381+0000 7f2a661f1700 1 --2- 172.21.15.154:0/3919904683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.381+0000 7f2a661f1700 1 -- 172.21.15.154:0/3919904683 >> v1:172.21.15.154:6789/0 conn(0x7f2a60133f50 legacy=0x7f2a6013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.381+0000 7f2a661f1700 1 -- 172.21.15.154:0/3919904683 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6009e6a0 con 0x7f2a600a0a70 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.381+0000 7f2a659f0700 1 --2- 172.21.15.154:0/3919904683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.381+0000 7f2a661f1700 1 --2- 172.21.15.154:0/3919904683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a0a70 0x7f2a600a0e40 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0098f0 tx=0x7f2a5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8178b61eb21890aa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.381+0000 7f2a651ef700 1 -- 172.21.15.154:0/3919904683 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c011830 con 0x7f2a600a0a70 2023-09-30T22:28:57.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.381+0000 7f2a651ef700 1 -- 172.21.15.154:0/3919904683 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c011990 con 0x7f2a600a0a70 2023-09-30T22:28:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.381+0000 7f2a651ef700 1 -- 172.21.15.154:0/3919904683 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c011d20 con 0x7f2a600a0a70 2023-09-30T22:28:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.382+0000 7f2a68455700 1 -- 172.21.15.154:0/3919904683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a0a70 msgr2=0x7f2a600a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.382+0000 7f2a68455700 1 --2- 172.21.15.154:0/3919904683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a0a70 0x7f2a600a0e40 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0098f0 tx=0x7f2a5c009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:57.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.382+0000 7f2a68455700 1 -- 172.21.15.154:0/3919904683 shutdown_connections 2023-09-30T22:28:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.382+0000 7f2a68455700 1 --2- 172.21.15.154:0/3919904683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a0a70 0x7f2a600a0e40 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.382+0000 7f2a68455700 1 --2- 172.21.15.154:0/3919904683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a1380 0x7f2a60133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.382+0000 7f2a68455700 1 -- 172.21.15.154:0/3919904683 >> 172.21.15.154:0/3919904683 conn(0x7f2a600a6610 msgr2=0x7f2a600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.382+0000 7f2a68455700 1 -- 172.21.15.154:0/3919904683 shutdown_connections 2023-09-30T22:28:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.382+0000 7f2a68455700 1 -- 172.21.15.154:0/3919904683 wait complete. 2023-09-30T22:28:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a68455700 1 Processor -- start 2023-09-30T22:28:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a68455700 1 -- start start 2023-09-30T22:28:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a68455700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a0a70 0x7f2a6011e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a68455700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a1380 0x7f2a6011ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a68455700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a60133f50 0x7f2a6011f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a68455700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a60133790 con 0x7f2a600a1380 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a68455700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a60122320 con 0x7f2a600a0a70 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a68455700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601339d0 con 0x7f2a60133f50 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a659f0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a1380 0x7f2a6011ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a659f0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a1380 0x7f2a6011ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50608/0 (socket says 172.21.15.154:50608) 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a659f0700 1 -- 172.21.15.154:0/1369997407 learned_addr learned my addr 172.21.15.154:0/1369997407 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a661f1700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a0a70 0x7f2a6011e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.383+0000 7f2a669f2700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a60133f50 0x7f2a6011f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a659f0700 1 -- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a60133f50 msgr2=0x7f2a6011f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a659f0700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a60133f50 0x7f2a6011f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a659f0700 1 -- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a0a70 msgr2=0x7f2a6011e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a659f0700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a0a70 0x7f2a6011e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a659f0700 1 -- 172.21.15.154:0/1369997407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a500094a0 con 0x7f2a600a1380 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a661f1700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a0a70 0x7f2a6011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a659f0700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a1380 0x7f2a6011ed80 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000ebe0 tx=0x7f2a5000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a56ffd700 1 -- 172.21.15.154:0/1369997407 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000c850 con 0x7f2a600a1380 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a56ffd700 1 -- 172.21.15.154:0/1369997407 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5000c9b0 con 0x7f2a600a1380 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a56ffd700 1 -- 172.21.15.154:0/1369997407 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000cd40 con 0x7f2a600a1380 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a68455700 1 -- 172.21.15.154:0/1369997407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c009550 con 0x7f2a600a1380 2023-09-30T22:28:57.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.384+0000 7f2a68455700 1 -- 172.21.15.154:0/1369997407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a60120c00 con 0x7f2a600a1380 2023-09-30T22:28:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.385+0000 7f2a56ffd700 1 -- 172.21.15.154:0/1369997407 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a50013470 con 0x7f2a600a1380 2023-09-30T22:28:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.385+0000 7f2a68455700 1 -- 172.21.15.154:0/1369997407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6004f2a0 con 0x7f2a600a1380 2023-09-30T22:28:57.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.385+0000 7f2a56ffd700 1 -- 172.21.15.154:0/1369997407 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a5003f7a0 con 0x7f2a600a1380 2023-09-30T22:28:57.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.394+0000 7f2a56ffd700 1 -- 172.21.15.154:0/1369997407 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a5000cea0 con 0x7f2a600a1380 2023-09-30T22:28:57.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.468+0000 7fd0e193c700 1 -- 172.21.15.154:0/604058961 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd0dc04f2a0 con 0x7fd0dc09bc70 2023-09-30T22:28:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.469+0000 7fd0c3fff700 1 -- 172.21.15.154:0/604058961 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0cc029090 con 0x7fd0dc09bc70 2023-09-30T22:28:57.469 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.471+0000 7fd0e193c700 1 -- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09bc70 msgr2=0x7fd0dc1c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.471+0000 7fd0e193c700 1 --2- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09bc70 0x7fd0dc1c8840 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00b520 tx=0x7fd0cc00b8e0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.471+0000 7fd0e193c700 1 -- 172.21.15.154:0/604058961 shutdown_connections 2023-09-30T22:28:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.471+0000 7fd0e193c700 1 --2- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0dc131980 0x7fd0dc099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.471+0000 7fd0e193c700 1 --2- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd0dc09bc70 0x7fd0dc1c8840 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.471+0000 7fd0e193c700 1 --2- 172.21.15.154:0/604058961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0dc09c790 0x7fd0dc1c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.471+0000 7fd0e193c700 1 -- 172.21.15.154:0/604058961 >> 172.21.15.154:0/604058961 conn(0x7fd0dc0a2980 msgr2=0x7fd0dc070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.471+0000 7fd0e193c700 1 -- 172.21.15.154:0/604058961 shutdown_connections 2023-09-30T22:28:57.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.471+0000 7fd0e193c700 1 -- 172.21.15.154:0/604058961 wait complete. 2023-09-30T22:28:57.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.553+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2855436204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc7b8072980 con 0x7fc7b80a0a70 2023-09-30T22:28:57.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.554+0000 7fc79ffff700 1 -- 172.21.15.154:0/2855436204 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7a8011e80 con 0x7fc7b80a0a70 2023-09-30T22:28:57.554 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.555+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b80a0a70 msgr2=0x7fc7b811e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.555+0000 7fc7bdb08700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b80a0a70 0x7fc7b811e6c0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800c470 tx=0x7fc7a800c780 comp rx=0 tx=0).stop 2023-09-30T22:28:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.556+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2855436204 shutdown_connections 2023-09-30T22:28:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.556+0000 7fc7bdb08700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b8139200 0x7fc7b811f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.556+0000 7fc7bdb08700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b80a0a70 0x7fc7b811e6c0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.556+0000 7fc7bdb08700 1 --2- 172.21.15.154:0/2855436204 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc7b80a1550 0x7fc7b811ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.556+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2855436204 >> 172.21.15.154:0/2855436204 conn(0x7fc7b80a6610 msgr2=0x7fc7b80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.556+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2855436204 shutdown_connections 2023-09-30T22:28:57.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.556+0000 7fc7bdb08700 1 -- 172.21.15.154:0/2855436204 wait complete. 2023-09-30T22:28:57.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:57.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.587+0000 7f2a68455700 1 -- 172.21.15.154:0/1369997407 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a60072980 con 0x7f2a600a1380 2023-09-30T22:28:57.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.587+0000 7f2a56ffd700 1 -- 172.21.15.154:0/1369997407 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a5001b3b0 con 0x7f2a600a1380 2023-09-30T22:28:57.587 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:57.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.589+0000 7f2a68455700 1 -- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a1380 msgr2=0x7f2a6011ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:57.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.589+0000 7f2a68455700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a1380 0x7f2a6011ed80 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000ebe0 tx=0x7f2a5000eef0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.589+0000 7f2a68455700 1 -- 172.21.15.154:0/1369997407 shutdown_connections 2023-09-30T22:28:57.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.589+0000 7f2a68455700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2a60133f50 0x7f2a6011f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.589+0000 7f2a68455700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a600a0a70 0x7f2a6011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.589+0000 7f2a68455700 1 --2- 172.21.15.154:0/1369997407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a600a1380 0x7f2a6011ed80 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:57.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.589+0000 7f2a68455700 1 -- 172.21.15.154:0/1369997407 >> 172.21.15.154:0/1369997407 conn(0x7f2a600a6610 msgr2=0x7f2a600a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:57.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.589+0000 7f2a68455700 1 -- 172.21.15.154:0/1369997407 shutdown_connections 2023-09-30T22:28:57.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:57.589+0000 7f2a68455700 1 -- 172.21.15.154:0/1369997407 wait complete. 2023-09-30T22:28:57.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:58.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:58.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.428+0000 7f92bd866700 1 Processor -- start 2023-09-30T22:28:58.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.428+0000 7f92bd866700 1 -- start start 2023-09-30T22:28:58.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92bd866700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b80a0a70 0x7f92b80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92bd866700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a1380 0x7f92b8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92bd866700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f92b8133f50 0x7f92b81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92bd866700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b809e9d0 con 0x7f92b8133f50 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92bd866700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b809dc00 con 0x7f92b80a0a70 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92bd866700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92b809dec0 con 0x7f92b80a1380 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b80a0a70 0x7f92b80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a1380 0x7f92b8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f92b8133f50 0x7f92b81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b80a0a70 0x7f92b80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54972/0 (socket says 172.21.15.154:54972) 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a1380 0x7f92b8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41648/0 (socket says 172.21.15.154:41648) 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b77fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f92b8133f50 0x7f92b81343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50618/0 (socket says 172.21.15.154:50618) 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b6ffd700 1 -- 172.21.15.154:0/2780972557 learned_addr learned my addr 172.21.15.154:0/2780972557 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b6ffd700 1 -- 172.21.15.154:0/2780972557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a1380 msgr2=0x7f92b8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b6ffd700 1 --2- 172.21.15.154:0/2780972557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a1380 0x7f92b8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b6ffd700 1 -- 172.21.15.154:0/2780972557 >> v2:172.21.15.154:3300/0 conn(0x7f92b8133f50 msgr2=0x7f92b81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:58.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b6ffd700 1 --2- 172.21.15.154:0/2780972557 >> v2:172.21.15.154:3300/0 conn(0x7f92b8133f50 0x7f92b81343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b6ffd700 1 -- 172.21.15.154:0/2780972557 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b809e6a0 con 0x7f92b80a0a70 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b67fc700 1 --2- 172.21.15.154:0/2780972557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a1380 0x7f92b8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b77fe700 1 --2- 172.21.15.154:0/2780972557 >> v2:172.21.15.154:3300/0 conn(0x7f92b8133f50 0x7f92b81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b6ffd700 1 --2- 172.21.15.154:0/2780972557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b80a0a70 0x7f92b80a0e40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0098f0 tx=0x7f92ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e429615322f0ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b5ffb700 1 -- 172.21.15.154:0/2780972557 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac011830 con 0x7f92b80a0a70 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b5ffb700 1 -- 172.21.15.154:0/2780972557 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac011990 con 0x7f92b80a0a70 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.429+0000 7f92b5ffb700 1 -- 172.21.15.154:0/2780972557 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac011d20 con 0x7f92b80a0a70 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.430+0000 7f92bd866700 1 -- 172.21.15.154:0/2780972557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b80a0a70 msgr2=0x7f92b80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.430+0000 7f92bd866700 1 --2- 172.21.15.154:0/2780972557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b80a0a70 0x7f92b80a0e40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0098f0 tx=0x7f92ac009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.430+0000 7f92bd866700 1 -- 172.21.15.154:0/2780972557 shutdown_connections 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.430+0000 7f92bd866700 1 --2- 172.21.15.154:0/2780972557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b80a0a70 0x7f92b80a0e40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.430+0000 7f92bd866700 1 --2- 172.21.15.154:0/2780972557 >> v2:172.21.15.154:3300/0 conn(0x7f92b8133f50 0x7f92b81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.430+0000 7f92bd866700 1 --2- 172.21.15.154:0/2780972557 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a1380 0x7f92b8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.430+0000 7f92bd866700 1 -- 172.21.15.154:0/2780972557 >> 172.21.15.154:0/2780972557 conn(0x7f92b80a6610 msgr2=0x7f92b80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.430+0000 7f92bd866700 1 -- 172.21.15.154:0/2780972557 shutdown_connections 2023-09-30T22:28:58.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.430+0000 7f92bd866700 1 -- 172.21.15.154:0/2780972557 wait complete. 2023-09-30T22:28:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.431+0000 7f92bd866700 1 Processor -- start 2023-09-30T22:28:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.431+0000 7f92bd866700 1 -- start start 2023-09-30T22:28:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.431+0000 7f92bd866700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a0a70 0x7f92b81224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.431+0000 7f92bd866700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80a1380 0x7f92b8122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.431+0000 7f92bd866700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b8133f50 0x7f92b8122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.431+0000 7f92bd866700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b8125d30 con 0x7f92b80a1380 2023-09-30T22:28:58.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.431+0000 7f92bd866700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b81249d0 con 0x7f92b8133f50 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.431+0000 7f92bd866700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80a5150 con 0x7f92b80a0a70 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a0a70 0x7f92b81224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80a1380 0x7f92b8122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b8133f50 0x7f92b8122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a0a70 0x7f92b81224f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41656/0 (socket says 172.21.15.154:41656) 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b67fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80a1380 0x7f92b8122a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50620/0 (socket says 172.21.15.154:50620) 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b8133f50 0x7f92b8122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54976/0 (socket says 172.21.15.154:54976) 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b6ffd700 1 -- 172.21.15.154:0/2940025163 learned_addr learned my addr 172.21.15.154:0/2940025163 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b67fc700 1 -- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a0a70 msgr2=0x7f92b81224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b67fc700 1 --2- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a0a70 0x7f92b81224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b67fc700 1 -- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b8133f50 msgr2=0x7f92b8122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b67fc700 1 --2- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b8133f50 0x7f92b8122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b67fc700 1 -- 172.21.15.154:0/2940025163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a80094a0 con 0x7f92b80a1380 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b77fe700 1 --2- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b8133f50 0x7f92b8122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92b67fc700 1 --2- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80a1380 0x7f92b8122a30 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f92b80a2b70 tx=0x7f92a800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f929ffff700 1 -- 172.21.15.154:0/2940025163 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8004030 con 0x7f92b80a1380 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f929ffff700 1 -- 172.21.15.154:0/2940025163 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a8004190 con 0x7f92b80a1380 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92bd866700 1 -- 172.21.15.154:0/2940025163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b0009a70 con 0x7f92b80a1380 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f929ffff700 1 -- 172.21.15.154:0/2940025163 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8004540 con 0x7f92b80a1380 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.432+0000 7f92bd866700 1 -- 172.21.15.154:0/2940025163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac009550 con 0x7f92b80a1380 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.433+0000 7f929ffff700 1 -- 172.21.15.154:0/2940025163 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92a80036a0 con 0x7f92b80a1380 2023-09-30T22:28:58.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.433+0000 7f929ffff700 1 -- 172.21.15.154:0/2940025163 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f92a803f700 con 0x7f92b80a1380 2023-09-30T22:28:58.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.433+0000 7f92bd866700 1 -- 172.21.15.154:0/2940025163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b811f050 con 0x7f92b80a1380 2023-09-30T22:28:58.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.438+0000 7f929ffff700 1 -- 172.21.15.154:0/2940025163 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92a801bdf0 con 0x7f92b80a1380 2023-09-30T22:28:58.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:58.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:58.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:58.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.611+0000 7f602c68b700 1 Processor -- start 2023-09-30T22:28:58.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.611+0000 7f602c68b700 1 -- start start 2023-09-30T22:28:58.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f602c68b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f602409d860 0x7f602409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f602c68b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f60241307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f602c68b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602409aaa0 con 0x7f6024130ce0 2023-09-30T22:28:58.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f602c68b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602409f870 con 0x7f602409d860 2023-09-30T22:28:58.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f602c68b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602409b360 con 0x7f602409e170 2023-09-30T22:28:58.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f6029c26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f60241307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f6029c26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f60241307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54984/0 (socket says 172.21.15.154:54984) 2023-09-30T22:28:58.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f6029c26700 1 -- 172.21.15.154:0/833020024 learned_addr learned my addr 172.21.15.154:0/833020024 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:58.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f602a427700 1 --2- 172.21.15.154:0/833020024 >> v2:172.21.15.154:3300/0 conn(0x7f602409d860 0x7f602409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f6029c26700 1 -- 172.21.15.154:0/833020024 >> v2:172.21.15.154:3300/0 conn(0x7f602409d860 msgr2=0x7f602409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:58.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.612+0000 7f6029c26700 1 --2- 172.21.15.154:0/833020024 >> v2:172.21.15.154:3300/0 conn(0x7f602409d860 0x7f602409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.613+0000 7f6029c26700 1 -- 172.21.15.154:0/833020024 >> v1:172.21.15.154:6789/0 conn(0x7f6024130ce0 legacy=0x7f60241379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.613+0000 7f6029c26700 1 -- 172.21.15.154:0/833020024 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602409b620 con 0x7f602409e170 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.613+0000 7f602a427700 1 --2- 172.21.15.154:0/833020024 >> v2:172.21.15.154:3300/0 conn(0x7f602409d860 0x7f602409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.613+0000 7f6029c26700 1 --2- 172.21.15.154:0/833020024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f60241307a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f601800bb90 tx=0x7f601800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc52eb385e59bcca server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.613+0000 7f6029425700 1 -- 172.21.15.154:0/833020024 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800dd30 con 0x7f602409e170 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.613+0000 7f6029425700 1 -- 172.21.15.154:0/833020024 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601800de90 con 0x7f602409e170 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.613+0000 7f6029425700 1 -- 172.21.15.154:0/833020024 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018010690 con 0x7f602409e170 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.613+0000 7f602c68b700 1 -- 172.21.15.154:0/833020024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 msgr2=0x7f60241307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.613+0000 7f602c68b700 1 --2- 172.21.15.154:0/833020024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f60241307a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f601800bb90 tx=0x7f601800bea0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.614+0000 7f602c68b700 1 -- 172.21.15.154:0/833020024 shutdown_connections 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.614+0000 7f602c68b700 1 --2- 172.21.15.154:0/833020024 >> v2:172.21.15.154:3300/0 conn(0x7f602409d860 0x7f602409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.614+0000 7f602c68b700 1 --2- 172.21.15.154:0/833020024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f60241307a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.614+0000 7f602c68b700 1 -- 172.21.15.154:0/833020024 >> 172.21.15.154:0/833020024 conn(0x7f6024099c40 msgr2=0x7f60240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.614+0000 7f602c68b700 1 -- 172.21.15.154:0/833020024 shutdown_connections 2023-09-30T22:28:58.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.614+0000 7f602c68b700 1 -- 172.21.15.154:0/833020024 wait complete. 2023-09-30T22:28:58.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.615+0000 7f602c68b700 1 Processor -- start 2023-09-30T22:28:58.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.615+0000 7f602c68b700 1 -- start start 2023-09-30T22:28:58.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.615+0000 7f602c68b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f602409d860 0x7f602411e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.615+0000 7f602c68b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f602411ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.615+0000 7f602c68b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6024130ce0 0x7f602411f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.615+0000 7f602c68b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024120890 con 0x7f6024130ce0 2023-09-30T22:28:58.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.615+0000 7f602c68b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60241203f0 con 0x7f602409e170 2023-09-30T22:28:58.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.615+0000 7f602c68b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6024130630 con 0x7f602409d860 2023-09-30T22:28:58.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.615+0000 7f6029c26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f602411ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6029c26700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f602411ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54996/0 (socket says 172.21.15.154:54996) 2023-09-30T22:28:58.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6029c26700 1 -- 172.21.15.154:0/3648350272 learned_addr learned my addr 172.21.15.154:0/3648350272 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:58.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f602ac28700 1 --2- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6024130ce0 0x7f602411f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6029c26700 1 -- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f602409d860 msgr2=0x7f602411e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6029c26700 1 --2- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f602409d860 0x7f602411e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6029c26700 1 -- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6024130ce0 msgr2=0x7f602411f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6029c26700 1 --2- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6024130ce0 0x7f602411f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6029c26700 1 -- 172.21.15.154:0/3648350272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c0094a0 con 0x7f602409e170 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f602ac28700 1 --2- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6024130ce0 0x7f602411f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6029c26700 1 --2- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f602411ec10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f601800bee0 tx=0x7f6018004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6022ffd700 1 -- 172.21.15.154:0/3648350272 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601801f070 con 0x7f602409e170 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6022ffd700 1 -- 172.21.15.154:0/3648350272 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018003970 con 0x7f602409e170 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f602c68b700 1 -- 172.21.15.154:0/3648350272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601800b7f0 con 0x7f602409e170 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f6022ffd700 1 -- 172.21.15.154:0/3648350272 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018003d20 con 0x7f602409e170 2023-09-30T22:28:58.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.616+0000 7f602c68b700 1 -- 172.21.15.154:0/3648350272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6024121f10 con 0x7f602409e170 2023-09-30T22:28:58.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.617+0000 7f6022ffd700 1 -- 172.21.15.154:0/3648350272 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f601802d430 con 0x7f602409e170 2023-09-30T22:28:58.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.617+0000 7f602c68b700 1 -- 172.21.15.154:0/3648350272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602404f2a0 con 0x7f602409e170 2023-09-30T22:28:58.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.618+0000 7f6022ffd700 1 -- 172.21.15.154:0/3648350272 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6018043110 con 0x7f602409e170 2023-09-30T22:28:58.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.626+0000 7f6022ffd700 1 -- 172.21.15.154:0/3648350272 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6018023780 con 0x7f602409e170 2023-09-30T22:28:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.633+0000 7f92bd866700 1 -- 172.21.15.154:0/2940025163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92b8124f80 con 0x7f92b80a1380 2023-09-30T22:28:58.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.634+0000 7f929ffff700 1 -- 172.21.15.154:0/2940025163 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92a801b3b0 con 0x7f92b80a1380 2023-09-30T22:28:58.634 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:58.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.636+0000 7f92bd866700 1 -- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80a1380 msgr2=0x7f92b8122a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.636+0000 7f92bd866700 1 --2- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80a1380 0x7f92b8122a30 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f92b80a2b70 tx=0x7f92a800ec60 comp rx=0 tx=0).stop 2023-09-30T22:28:58.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.636+0000 7f92bd866700 1 -- 172.21.15.154:0/2940025163 shutdown_connections 2023-09-30T22:28:58.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.636+0000 7f92bd866700 1 --2- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92b8133f50 0x7f92b8122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.636+0000 7f92bd866700 1 --2- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f92b80a0a70 0x7f92b81224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.636+0000 7f92bd866700 1 --2- 172.21.15.154:0/2940025163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80a1380 0x7f92b8122a30 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.636+0000 7f92bd866700 1 -- 172.21.15.154:0/2940025163 >> 172.21.15.154:0/2940025163 conn(0x7f92b80a6610 msgr2=0x7f92b809c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.636+0000 7f92bd866700 1 -- 172.21.15.154:0/2940025163 shutdown_connections 2023-09-30T22:28:58.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.636+0000 7f92bd866700 1 -- 172.21.15.154:0/2940025163 wait complete. 2023-09-30T22:28:58.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:28:58.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.704+0000 7f9483736700 1 Processor -- start 2023-09-30T22:28:58.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f9483736700 1 -- start start 2023-09-30T22:28:58.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f9483736700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f947c09e870 0x7f947c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f9483736700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f9483736700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c09c970 con 0x7f947c09f180 2023-09-30T22:28:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f9483736700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c0a0920 con 0x7f947c09e870 2023-09-30T22:28:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f9483736700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c09f9c0 con 0x7f947c131f40 2023-09-30T22:28:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f9481cd3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f9481cd3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:54998/0 (socket says 172.21.15.154:54998) 2023-09-30T22:28:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f94814d2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f947c09e870 0x7f947c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.705+0000 7f9481cd3700 1 -- 172.21.15.154:0/449197810 learned_addr learned my addr 172.21.15.154:0/449197810 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f94814d2700 1 -- 172.21.15.154:0/449197810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 msgr2=0x7f947c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f94814d2700 1 --2- 172.21.15.154:0/449197810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f94814d2700 1 -- 172.21.15.154:0/449197810 >> v1:172.21.15.154:6789/0 conn(0x7f947c09f180 legacy=0x7f947c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f94814d2700 1 -- 172.21.15.154:0/449197810 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c09bab0 con 0x7f947c09e870 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f9473fff700 1 -- 172.21.15.154:0/449197810 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302090396 0 0) 0x7f947c09c970 con 0x7f947c09f180 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f9481cd3700 1 --2- 172.21.15.154:0/449197810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f94814d2700 1 --2- 172.21.15.154:0/449197810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09e870 0x7f947c09ec40 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f9478009840 tx=0x7f9478009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9250c784a174db6d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f9473fff700 1 -- 172.21.15.154:0/449197810 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478011830 con 0x7f947c09e870 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f9473fff700 1 -- 172.21.15.154:0/449197810 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478011990 con 0x7f947c09e870 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.706+0000 7f9473fff700 1 -- 172.21.15.154:0/449197810 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478011d20 con 0x7f947c09e870 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.707+0000 7f9483736700 1 -- 172.21.15.154:0/449197810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09e870 msgr2=0x7f947c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.707+0000 7f9483736700 1 --2- 172.21.15.154:0/449197810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09e870 0x7f947c09ec40 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f9478009840 tx=0x7f9478009b50 comp rx=0 tx=0).stop 2023-09-30T22:28:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.707+0000 7f9483736700 1 -- 172.21.15.154:0/449197810 shutdown_connections 2023-09-30T22:28:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.707+0000 7f9483736700 1 --2- 172.21.15.154:0/449197810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.707+0000 7f9483736700 1 --2- 172.21.15.154:0/449197810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09e870 0x7f947c09ec40 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.707+0000 7f9483736700 1 -- 172.21.15.154:0/449197810 >> 172.21.15.154:0/449197810 conn(0x7f947c0a4430 msgr2=0x7f947c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.707+0000 7f9483736700 1 -- 172.21.15.154:0/449197810 shutdown_connections 2023-09-30T22:28:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.707+0000 7f9483736700 1 -- 172.21.15.154:0/449197810 wait complete. 2023-09-30T22:28:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9483736700 1 Processor -- start 2023-09-30T22:28:58.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9483736700 1 -- start start 2023-09-30T22:28:58.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9483736700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f947c09e870 0x7f947c11d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9483736700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09f180 0x7f947c11d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9483736700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c1c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9483736700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c131330 con 0x7f947c09f180 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9483736700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c11de00 con 0x7f947c131f40 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9483736700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f947c11ff20 con 0x7f947c09e870 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9480cd1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09f180 0x7f947c11d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f94814d2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f947c09e870 0x7f947c11d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9480cd1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09f180 0x7f947c11d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50642/0 (socket says 172.21.15.154:50642) 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9480cd1700 1 -- 172.21.15.154:0/951641655 learned_addr learned my addr 172.21.15.154:0/951641655 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.708+0000 7f9481cd3700 1 --2- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c1c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f94814d2700 1 -- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 msgr2=0x7f947c1c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f94814d2700 1 --2- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c1c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f94814d2700 1 -- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09f180 msgr2=0x7f947c11d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f94814d2700 1 --2- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09f180 0x7f947c11d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f94814d2700 1 -- 172.21.15.154:0/951641655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474009b30 con 0x7f947c09e870 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f9480cd1700 1 --2- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09f180 0x7f947c11d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f94814d2700 1 --2- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f947c09e870 0x7f947c11d380 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9478016000 tx=0x7f9478004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f9471ffb700 1 -- 172.21.15.154:0/951641655 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478004590 con 0x7f947c09e870 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f9471ffb700 1 -- 172.21.15.154:0/951641655 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947801e070 con 0x7f947c09e870 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f9483736700 1 -- 172.21.15.154:0/951641655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94780094a0 con 0x7f947c09e870 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f9471ffb700 1 -- 172.21.15.154:0/951641655 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780038c0 con 0x7f947c09e870 2023-09-30T22:28:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.709+0000 7f9483736700 1 -- 172.21.15.154:0/951641655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c131820 con 0x7f947c09e870 2023-09-30T22:28:58.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.710+0000 7f9483736700 1 -- 172.21.15.154:0/951641655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c11ee00 con 0x7f947c09e870 2023-09-30T22:28:58.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.711+0000 7f9471ffb700 1 -- 172.21.15.154:0/951641655 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9478003a20 con 0x7f947c09e870 2023-09-30T22:28:58.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.711+0000 7f9471ffb700 1 -- 172.21.15.154:0/951641655 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9478020070 con 0x7f947c09e870 2023-09-30T22:28:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.719+0000 7f9471ffb700 1 -- 172.21.15.154:0/951641655 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9478023380 con 0x7f947c09e870 2023-09-30T22:28:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.742+0000 7febdd17d700 1 Processor -- start 2023-09-30T22:28:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.742+0000 7febdd17d700 1 -- start start 2023-09-30T22:28:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.742+0000 7febdd17d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809e870 0x7febd809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.742+0000 7febdd17d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd809f180 0x7febd8133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.742+0000 7febdd17d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd806bec0 con 0x7febd81341d0 2023-09-30T22:28:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.742+0000 7febdd17d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd806ce60 con 0x7febd809f180 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.742+0000 7febdd17d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febd809fa00 con 0x7febd809e870 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd809f180 0x7febd8133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd809f180 0x7febd8133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55014/0 (socket says 172.21.15.154:55014) 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd659c700 1 -- 172.21.15.154:0/2499879566 learned_addr learned my addr 172.21.15.154:0/2499879566 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd6d9d700 1 --2- 172.21.15.154:0/2499879566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809e870 0x7febd809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd6d9d700 1 -- 172.21.15.154:0/2499879566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd809f180 msgr2=0x7febd8133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd6d9d700 1 --2- 172.21.15.154:0/2499879566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd809f180 0x7febd8133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd6d9d700 1 -- 172.21.15.154:0/2499879566 >> v1:172.21.15.154:6789/0 conn(0x7febd81341d0 legacy=0x7febd813af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd6d9d700 1 -- 172.21.15.154:0/2499879566 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd809ad80 con 0x7febd809e870 2023-09-30T22:28:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd659c700 1 --2- 172.21.15.154:0/2499879566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd809f180 0x7febd8133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd6d9d700 1 --2- 172.21.15.154:0/2499879566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809e870 0x7febd809ec40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7febc80098a0 tx=0x7febc8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4ad310d5a2cdcec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd5d9b700 1 -- 172.21.15.154:0/2499879566 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8011830 con 0x7febd809e870 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd5d9b700 1 -- 172.21.15.154:0/2499879566 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8011990 con 0x7febd809e870 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.743+0000 7febd5d9b700 1 -- 172.21.15.154:0/2499879566 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8011d20 con 0x7febd809e870 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.744+0000 7febdd17d700 1 -- 172.21.15.154:0/2499879566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809e870 msgr2=0x7febd809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.744+0000 7febdd17d700 1 --2- 172.21.15.154:0/2499879566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809e870 0x7febd809ec40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7febc80098a0 tx=0x7febc8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.744+0000 7febdd17d700 1 -- 172.21.15.154:0/2499879566 shutdown_connections 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.744+0000 7febdd17d700 1 --2- 172.21.15.154:0/2499879566 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809e870 0x7febd809ec40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.744+0000 7febdd17d700 1 --2- 172.21.15.154:0/2499879566 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd809f180 0x7febd8133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.744+0000 7febdd17d700 1 -- 172.21.15.154:0/2499879566 >> 172.21.15.154:0/2499879566 conn(0x7febd80a4430 msgr2=0x7febd80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.744+0000 7febdd17d700 1 -- 172.21.15.154:0/2499879566 shutdown_connections 2023-09-30T22:28:58.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.744+0000 7febdd17d700 1 -- 172.21.15.154:0/2499879566 wait complete. 2023-09-30T22:28:58.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.745+0000 7febdd17d700 1 Processor -- start 2023-09-30T22:28:58.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.745+0000 7febdd17d700 1 -- start start 2023-09-30T22:28:58.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febdd17d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd809e870 0x7febd8122b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febdd17d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809f180 0x7febd81230a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febdd17d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd81341d0 0x7febd81235e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febdd17d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8124db0 con 0x7febd809e870 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febdd17d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd81260e0 con 0x7febd81341d0 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febdd17d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febd8126760 con 0x7febd809f180 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809f180 0x7febd81230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809f180 0x7febd81230a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41688/0 (socket says 172.21.15.154:41688) 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd659c700 1 -- 172.21.15.154:0/1298264005 learned_addr learned my addr 172.21.15.154:0/1298264005 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd6d9d700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd809e870 0x7febd8122b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd759e700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd81341d0 0x7febd81235e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd6d9d700 1 -- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809f180 msgr2=0x7febd81230a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd6d9d700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809f180 0x7febd81230a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd6d9d700 1 -- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd81341d0 msgr2=0x7febd81235e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd6d9d700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd81341d0 0x7febd81235e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd6d9d700 1 -- 172.21.15.154:0/1298264005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc009550 con 0x7febd809e870 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd659c700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809f180 0x7febd81230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.746+0000 7febd759e700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd81341d0 0x7febd81235e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.747+0000 7febd6d9d700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd809e870 0x7febd8122b60 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7febc8016000 tx=0x7febc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.747+0000 7febbf7fe700 1 -- 172.21.15.154:0/1298264005 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8004240 con 0x7febd809e870 2023-09-30T22:28:58.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.747+0000 7febbf7fe700 1 -- 172.21.15.154:0/1298264005 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc801f070 con 0x7febd809e870 2023-09-30T22:28:58.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.747+0000 7febdd17d700 1 -- 172.21.15.154:0/1298264005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc80094a0 con 0x7febd809e870 2023-09-30T22:28:58.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.747+0000 7febbf7fe700 1 -- 172.21.15.154:0/1298264005 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc80045e0 con 0x7febd809e870 2023-09-30T22:28:58.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.747+0000 7febdd17d700 1 -- 172.21.15.154:0/1298264005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd806cff0 con 0x7febd809e870 2023-09-30T22:28:58.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.748+0000 7febbf7fe700 1 -- 172.21.15.154:0/1298264005 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febc8021030 con 0x7febd809e870 2023-09-30T22:28:58.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.748+0000 7febbf7fe700 1 -- 172.21.15.154:0/1298264005 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7febc8040730 con 0x7febd809e870 2023-09-30T22:28:58.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.748+0000 7febdd17d700 1 -- 172.21.15.154:0/1298264005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd804f2a0 con 0x7febd809e870 2023-09-30T22:28:58.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.753+0000 7febbf7fe700 1 -- 172.21.15.154:0/1298264005 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febc801a450 con 0x7febd809e870 2023-09-30T22:28:58.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.830+0000 7f602c68b700 1 -- 172.21.15.154:0/3648350272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6024120ad0 con 0x7f602409e170 2023-09-30T22:28:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.831+0000 7f6022ffd700 1 -- 172.21.15.154:0/3648350272 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60180233c0 con 0x7f602409e170 2023-09-30T22:28:58.831 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:28:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.833+0000 7f602c68b700 1 -- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 msgr2=0x7f602411ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.833+0000 7f602c68b700 1 --2- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f602411ec10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f601800bee0 tx=0x7f6018004750 comp rx=0 tx=0).stop 2023-09-30T22:28:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.833+0000 7f602c68b700 1 -- 172.21.15.154:0/3648350272 shutdown_connections 2023-09-30T22:28:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.833+0000 7f602c68b700 1 --2- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6024130ce0 0x7f602411f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.833+0000 7f602c68b700 1 --2- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f602409d860 0x7f602411e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.833+0000 7f602c68b700 1 --2- 172.21.15.154:0/3648350272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f602409e170 0x7f602411ec10 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.833+0000 7f602c68b700 1 -- 172.21.15.154:0/3648350272 >> 172.21.15.154:0/3648350272 conn(0x7f6024099c40 msgr2=0x7f60240a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.833+0000 7f602c68b700 1 -- 172.21.15.154:0/3648350272 shutdown_connections 2023-09-30T22:28:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.833+0000 7f602c68b700 1 -- 172.21.15.154:0/3648350272 wait complete. 2023-09-30T22:28:58.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.916+0000 7f9483736700 1 -- 172.21.15.154:0/951641655 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f947c04f2a0 con 0x7f947c09e870 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.916+0000 7f9471ffb700 1 -- 172.21.15.154:0/951641655 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9478024bd0 con 0x7f947c09e870 2023-09-30T22:28:58.916 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:28:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.918+0000 7f9483736700 1 -- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f947c09e870 msgr2=0x7f947c11d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.918+0000 7f9483736700 1 --2- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f947c09e870 0x7f947c11d380 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f9478016000 tx=0x7f9478004750 comp rx=0 tx=0).stop 2023-09-30T22:28:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.918+0000 7f9483736700 1 -- 172.21.15.154:0/951641655 shutdown_connections 2023-09-30T22:28:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.918+0000 7f9483736700 1 --2- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f947c131f40 0x7f947c1c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.918+0000 7f9483736700 1 --2- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f947c09e870 0x7f947c11d380 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.918+0000 7f9483736700 1 --2- 172.21.15.154:0/951641655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f947c09f180 0x7f947c11d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.918+0000 7f9483736700 1 -- 172.21.15.154:0/951641655 >> 172.21.15.154:0/951641655 conn(0x7f947c0a4430 msgr2=0x7f947c0a2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.918+0000 7f9483736700 1 -- 172.21.15.154:0/951641655 shutdown_connections 2023-09-30T22:28:58.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.918+0000 7f9483736700 1 -- 172.21.15.154:0/951641655 wait complete. 2023-09-30T22:28:58.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:28:58.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.945+0000 7febdd17d700 1 -- 172.21.15.154:0/1298264005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7febd8072d60 con 0x7febd809e870 2023-09-30T22:28:58.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.946+0000 7febbf7fe700 1 -- 172.21.15.154:0/1298264005 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febc801b430 con 0x7febd809e870 2023-09-30T22:28:58.946 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:58.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.948+0000 7febdd17d700 1 -- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd809e870 msgr2=0x7febd8122b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:58.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.948+0000 7febdd17d700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd809e870 0x7febd8122b60 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7febc8016000 tx=0x7febc8004750 comp rx=0 tx=0).stop 2023-09-30T22:28:58.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.948+0000 7febdd17d700 1 -- 172.21.15.154:0/1298264005 shutdown_connections 2023-09-30T22:28:58.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.948+0000 7febdd17d700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7febd81341d0 0x7febd81235e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.948+0000 7febdd17d700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd809e870 0x7febd8122b60 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.948+0000 7febdd17d700 1 --2- 172.21.15.154:0/1298264005 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7febd809f180 0x7febd81230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:58.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.948+0000 7febdd17d700 1 -- 172.21.15.154:0/1298264005 >> 172.21.15.154:0/1298264005 conn(0x7febd80a4430 msgr2=0x7febd8071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:58.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.948+0000 7febdd17d700 1 -- 172.21.15.154:0/1298264005 shutdown_connections 2023-09-30T22:28:58.949 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:58.948+0000 7febdd17d700 1 -- 172.21.15.154:0/1298264005 wait complete. 2023-09-30T22:28:58.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:28:59.652 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:28:59.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dfca7700 1 Processor -- start 2023-09-30T22:28:59.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dfca7700 1 -- start start 2023-09-30T22:28:59.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dfca7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dfca7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d809e170 0x7f53d81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dfca7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d809aaa0 con 0x7f53d8130ce0 2023-09-30T22:28:59.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dfca7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d809f870 con 0x7f53d809e170 2023-09-30T22:28:59.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dfca7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53d809b360 con 0x7f53d809d860 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dda43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dda43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41692/0 (socket says 172.21.15.154:41692) 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dd242700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d809e170 0x7f53d81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.776+0000 7f53dda43700 1 -- 172.21.15.154:0/1881682917 learned_addr learned my addr 172.21.15.154:0/1881682917 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dd242700 1 -- 172.21.15.154:0/1881682917 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 msgr2=0x7f53d809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dd242700 1 --2- 172.21.15.154:0/1881682917 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dd242700 1 -- 172.21.15.154:0/1881682917 >> v1:172.21.15.154:6789/0 conn(0x7f53d8130ce0 legacy=0x7f53d81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dca41700 1 -- 172.21.15.154:0/1881682917 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693547678 0 0) 0x7f53d809aaa0 con 0x7f53d8130ce0 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dd242700 1 -- 172.21.15.154:0/1881682917 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d809b620 con 0x7f53d809e170 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dda43700 1 --2- 172.21.15.154:0/1881682917 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:28:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dd242700 1 --2- 172.21.15.154:0/1881682917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d809e170 0x7f53d81307a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009870 tx=0x7f53c8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2b7f230ca1dd9ad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dca41700 1 -- 172.21.15.154:0/1881682917 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011830 con 0x7f53d809e170 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dca41700 1 -- 172.21.15.154:0/1881682917 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8011990 con 0x7f53d809e170 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.777+0000 7f53dca41700 1 -- 172.21.15.154:0/1881682917 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011d20 con 0x7f53d809e170 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.778+0000 7f53dfca7700 1 -- 172.21.15.154:0/1881682917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d809e170 msgr2=0x7f53d81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.778+0000 7f53dfca7700 1 --2- 172.21.15.154:0/1881682917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d809e170 0x7f53d81307a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009870 tx=0x7f53c8009b80 comp rx=0 tx=0).stop 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.778+0000 7f53dfca7700 1 -- 172.21.15.154:0/1881682917 shutdown_connections 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.778+0000 7f53dfca7700 1 --2- 172.21.15.154:0/1881682917 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.778+0000 7f53dfca7700 1 --2- 172.21.15.154:0/1881682917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d809e170 0x7f53d81307a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.778+0000 7f53dfca7700 1 -- 172.21.15.154:0/1881682917 >> 172.21.15.154:0/1881682917 conn(0x7f53d8099c40 msgr2=0x7f53d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.778+0000 7f53dfca7700 1 -- 172.21.15.154:0/1881682917 shutdown_connections 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.778+0000 7f53dfca7700 1 -- 172.21.15.154:0/1881682917 wait complete. 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dfca7700 1 Processor -- start 2023-09-30T22:28:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dfca7700 1 -- start start 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dfca7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d8135620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dfca7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d809e170 0x7f53d8135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dfca7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d8130ce0 0x7f53d81360a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dfca7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8136af0 con 0x7f53d809e170 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dfca7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8138510 con 0x7f53d8130ce0 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dfca7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8138f00 con 0x7f53d809d860 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dda43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d8135620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53de244700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d8130ce0 0x7f53d81360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dda43700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d8135620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41706/0 (socket says 172.21.15.154:41706) 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dda43700 1 -- 172.21.15.154:0/2175550507 learned_addr learned my addr 172.21.15.154:0/2175550507 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dd242700 1 --2- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d809e170 0x7f53d8135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dda43700 1 -- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d8130ce0 msgr2=0x7f53d81360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dda43700 1 --2- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d8130ce0 0x7f53d81360a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dda43700 1 -- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d809e170 msgr2=0x7f53d8135b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dda43700 1 --2- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d809e170 0x7f53d8135b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.779+0000 7f53dda43700 1 -- 172.21.15.154:0/2175550507 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4009550 con 0x7f53d809d860 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.780+0000 7f53dda43700 1 --2- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d8135620 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f53d400ec10 tx=0x7f53d400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.780+0000 7f53ce7fc700 1 -- 172.21.15.154:0/2175550507 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400c850 con 0x7f53d809d860 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.780+0000 7f53ce7fc700 1 -- 172.21.15.154:0/2175550507 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400c9b0 con 0x7f53d809d860 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.780+0000 7f53dfca7700 1 -- 172.21.15.154:0/2175550507 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c80094a0 con 0x7f53d809d860 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.780+0000 7f53ce7fc700 1 -- 172.21.15.154:0/2175550507 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400cd40 con 0x7f53d809d860 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.780+0000 7f53dfca7700 1 -- 172.21.15.154:0/2175550507 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d81377e0 con 0x7f53d809d860 2023-09-30T22:28:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.780+0000 7f53ce7fc700 1 -- 172.21.15.154:0/2175550507 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53d4013470 con 0x7f53d809d860 2023-09-30T22:28:59.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.781+0000 7f53ce7fc700 1 -- 172.21.15.154:0/2175550507 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f53d403fc10 con 0x7f53d809d860 2023-09-30T22:28:59.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.781+0000 7f53dfca7700 1 -- 172.21.15.154:0/2175550507 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d80a27f0 con 0x7f53d809d860 2023-09-30T22:28:59.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.785+0000 7f53ce7fc700 1 -- 172.21.15.154:0/2175550507 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53d4013720 con 0x7f53d809d860 2023-09-30T22:28:59.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:28:59.931 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:28:59.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:28:59.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.974+0000 7f09f79cb700 1 Processor -- start 2023-09-30T22:28:59.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.974+0000 7f09f79cb700 1 -- start start 2023-09-30T22:28:59.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f79cb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09f009f350 0x7f09f0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f79cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f01393a0 0x7f09f013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f79cb700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f009fa00 con 0x7f09f009e870 2023-09-30T22:28:59.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f79cb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f00a0370 con 0x7f09f009f350 2023-09-30T22:28:59.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f79cb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09f006bec0 con 0x7f09f01393a0 2023-09-30T22:28:59.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f5f68700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f01393a0 0x7f09f013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f4f66700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09f009f350 0x7f09f0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f4f66700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09f009f350 0x7f09f0138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50682/0 (socket says 172.21.15.154:50682) 2023-09-30T22:28:59.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f5f68700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f01393a0 0x7f09f013b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41722/0 (socket says 172.21.15.154:41722) 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f4f66700 1 -- 172.21.15.154:0/1481668320 learned_addr learned my addr 172.21.15.154:0/1481668320 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f4f66700 1 -- 172.21.15.154:0/1481668320 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f01393a0 msgr2=0x7f09f013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f4f66700 1 --2- 172.21.15.154:0/1481668320 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f01393a0 0x7f09f013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f4f66700 1 -- 172.21.15.154:0/1481668320 >> v1:172.21.15.154:6789/0 conn(0x7f09f009e870 legacy=0x7f09f009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09e7fff700 1 -- 172.21.15.154:0/1481668320 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573992124 0 0) 0x7f09f009fa00 con 0x7f09f009e870 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.975+0000 7f09f4f66700 1 -- 172.21.15.154:0/1481668320 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f009ada0 con 0x7f09f009f350 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.976+0000 7f09f5f68700 1 --2- 172.21.15.154:0/1481668320 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f01393a0 0x7f09f013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.976+0000 7f09f4f66700 1 --2- 172.21.15.154:0/1481668320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09f009f350 0x7f09f0138e60 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f09e00098f0 tx=0x7f09e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c52efb920a8ec5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.976+0000 7f09e7fff700 1 -- 172.21.15.154:0/1481668320 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000b8a0 con 0x7f09f009f350 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.976+0000 7f09e7fff700 1 -- 172.21.15.154:0/1481668320 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e000ba00 con 0x7f09f009f350 2023-09-30T22:28:59.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.976+0000 7f09e7fff700 1 -- 172.21.15.154:0/1481668320 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000bd90 con 0x7f09f009f350 2023-09-30T22:28:59.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.977+0000 7f09f79cb700 1 -- 172.21.15.154:0/1481668320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09f009f350 msgr2=0x7f09f0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.977+0000 7f09f79cb700 1 --2- 172.21.15.154:0/1481668320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09f009f350 0x7f09f0138e60 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f09e00098f0 tx=0x7f09e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:28:59.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.977+0000 7f09f79cb700 1 -- 172.21.15.154:0/1481668320 shutdown_connections 2023-09-30T22:28:59.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.977+0000 7f09f79cb700 1 --2- 172.21.15.154:0/1481668320 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f01393a0 0x7f09f013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.977+0000 7f09f79cb700 1 --2- 172.21.15.154:0/1481668320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09f009f350 0x7f09f0138e60 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.977+0000 7f09f79cb700 1 -- 172.21.15.154:0/1481668320 >> 172.21.15.154:0/1481668320 conn(0x7f09f00a4430 msgr2=0x7f09f00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.977+0000 7f09f79cb700 1 -- 172.21.15.154:0/1481668320 shutdown_connections 2023-09-30T22:28:59.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.977+0000 7f09f79cb700 1 -- 172.21.15.154:0/1481668320 wait complete. 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f79cb700 1 Processor -- start 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f79cb700 1 -- start start 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f79cb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09f009e870 0x7f09f0121980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f79cb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f009f350 0x7f09f0121ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f79cb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09f01393a0 0x7f09f0122400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f79cb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0125400 con 0x7f09f01393a0 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f79cb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0123b10 con 0x7f09f009e870 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f79cb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09f006cfa0 con 0x7f09f009f350 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f4f66700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f009f350 0x7f09f0121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f5767700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09f009e870 0x7f09f0121980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:28:59.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f4f66700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f009f350 0x7f09f0121ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41726/0 (socket says 172.21.15.154:41726) 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.978+0000 7f09f4f66700 1 -- 172.21.15.154:0/65576298 learned_addr learned my addr 172.21.15.154:0/65576298 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09f5767700 1 -- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f009f350 msgr2=0x7f09f0121ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09f5767700 1 --2- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f009f350 0x7f09f0121ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09f5767700 1 -- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09f01393a0 msgr2=0x7f09f0122400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09f5767700 1 --2- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09f01393a0 0x7f09f0122400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09f5767700 1 -- 172.21.15.154:0/65576298 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e0009550 con 0x7f09f009e870 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09f5767700 1 --2- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09f009e870 0x7f09f0121980 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c3c0 tx=0x7f09ec00c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09e5ffb700 1 -- 172.21.15.154:0/65576298 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0054e0 con 0x7f09f009e870 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09e5ffb700 1 -- 172.21.15.154:0/65576298 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec00ce40 con 0x7f09f009e870 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09f79cb700 1 -- 172.21.15.154:0/65576298 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f01234f0 con 0x7f09f009e870 2023-09-30T22:28:59.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.979+0000 7f09e5ffb700 1 -- 172.21.15.154:0/65576298 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0038c0 con 0x7f09f009e870 2023-09-30T22:28:59.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.980+0000 7f09f79cb700 1 -- 172.21.15.154:0/65576298 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f0123ce0 con 0x7f09f009e870 2023-09-30T22:28:59.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.981+0000 7f09f79cb700 1 -- 172.21.15.154:0/65576298 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f004f2a0 con 0x7f09f009e870 2023-09-30T22:28:59.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.982+0000 7f09e5ffb700 1 -- 172.21.15.154:0/65576298 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09ec003a20 con 0x7f09f009e870 2023-09-30T22:28:59.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.982+0000 7f09e5ffb700 1 -- 172.21.15.154:0/65576298 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09ec03ef50 con 0x7f09f009e870 2023-09-30T22:28:59.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.983+0000 7f53dfca7700 1 -- 172.21.15.154:0/2175550507 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f53d8138b00 con 0x7f53d809d860 2023-09-30T22:28:59.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.983+0000 7f53ce7fc700 1 -- 172.21.15.154:0/2175550507 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53d4011350 con 0x7f53d809d860 2023-09-30T22:28:59.984 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:28:59.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.986+0000 7f53dfca7700 1 -- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 msgr2=0x7f53d8135620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:28:59.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.986+0000 7f53dfca7700 1 --2- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d8135620 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f53d400ec10 tx=0x7f53d400ef20 comp rx=0 tx=0).stop 2023-09-30T22:28:59.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.987+0000 7f53dfca7700 1 -- 172.21.15.154:0/2175550507 shutdown_connections 2023-09-30T22:28:59.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.987+0000 7f53dfca7700 1 --2- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d8130ce0 0x7f53d81360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.987+0000 7f53dfca7700 1 --2- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f53d809d860 0x7f53d8135620 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.987+0000 7f53dfca7700 1 --2- 172.21.15.154:0/2175550507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d809e170 0x7f53d8135b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:28:59.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.987+0000 7f53dfca7700 1 -- 172.21.15.154:0/2175550507 >> 172.21.15.154:0/2175550507 conn(0x7f53d8099c40 msgr2=0x7f53d8139500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:28:59.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.987+0000 7f53dfca7700 1 -- 172.21.15.154:0/2175550507 shutdown_connections 2023-09-30T22:28:59.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.987+0000 7f53dfca7700 1 -- 172.21.15.154:0/2175550507 wait complete. 2023-09-30T22:28:59.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:28:59.987+0000 7f09e5ffb700 1 -- 172.21.15.154:0/65576298 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09ec003cd0 con 0x7f09f009e870 2023-09-30T22:29:00.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:00.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.094+0000 7f8842e4d700 1 Processor -- start 2023-09-30T22:29:00.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.094+0000 7f8842e4d700 1 -- start start 2023-09-30T22:29:00.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f8842e4d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0a0a70 0x7f883c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f8842e4d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a1380 0x7f883c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f8842e4d700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c09dc00 con 0x7f883c133f50 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f8842e4d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c09ea60 con 0x7f883c0a0a70 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f8842e4d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f883c09dec0 con 0x7f883c0a1380 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f8840be9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0a0a70 0x7f883c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f883bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a1380 0x7f883c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f8840be9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0a0a70 0x7f883c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55040/0 (socket says 172.21.15.154:55040) 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f883bfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a1380 0x7f883c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41742/0 (socket says 172.21.15.154:41742) 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f8840be9700 1 -- 172.21.15.154:0/2103933104 learned_addr learned my addr 172.21.15.154:0/2103933104 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:00.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f883bfff700 1 -- 172.21.15.154:0/2103933104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0a0a70 msgr2=0x7f883c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f883bfff700 1 --2- 172.21.15.154:0/2103933104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0a0a70 0x7f883c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.095+0000 7f883bfff700 1 -- 172.21.15.154:0/2103933104 >> v1:172.21.15.154:6789/0 conn(0x7f883c133f50 legacy=0x7f883c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.096+0000 7f883bfff700 1 -- 172.21.15.154:0/2103933104 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c09e6a0 con 0x7f883c0a1380 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.096+0000 7f8840be9700 1 --2- 172.21.15.154:0/2103933104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0a0a70 0x7f883c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.096+0000 7f883bfff700 1 --2- 172.21.15.154:0/2103933104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a1380 0x7f883c133a10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8828009870 tx=0x7f8828009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=903635b1ed27faec server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.096+0000 7f883b7fe700 1 -- 172.21.15.154:0/2103933104 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828004230 con 0x7f883c0a1380 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.096+0000 7f883b7fe700 1 -- 172.21.15.154:0/2103933104 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8828004390 con 0x7f883c0a1380 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.096+0000 7f883b7fe700 1 -- 172.21.15.154:0/2103933104 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88280036a0 con 0x7f883c0a1380 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.096+0000 7f8842e4d700 1 -- 172.21.15.154:0/2103933104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a1380 msgr2=0x7f883c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.096+0000 7f8842e4d700 1 --2- 172.21.15.154:0/2103933104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a1380 0x7f883c133a10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8828009870 tx=0x7f8828009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:00.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.097+0000 7f8842e4d700 1 -- 172.21.15.154:0/2103933104 shutdown_connections 2023-09-30T22:29:00.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.097+0000 7f8842e4d700 1 --2- 172.21.15.154:0/2103933104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0a0a70 0x7f883c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.097+0000 7f8842e4d700 1 --2- 172.21.15.154:0/2103933104 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a1380 0x7f883c133a10 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.097+0000 7f8842e4d700 1 -- 172.21.15.154:0/2103933104 >> 172.21.15.154:0/2103933104 conn(0x7f883c0a6610 msgr2=0x7f883c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.097+0000 7f8842e4d700 1 -- 172.21.15.154:0/2103933104 shutdown_connections 2023-09-30T22:29:00.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.097+0000 7f8842e4d700 1 -- 172.21.15.154:0/2103933104 wait complete. 2023-09-30T22:29:00.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8842e4d700 1 Processor -- start 2023-09-30T22:29:00.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8842e4d700 1 -- start start 2023-09-30T22:29:00.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8842e4d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a0a70 0x7f883c11e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8842e4d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0a1380 0x7f883c11ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8842e4d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c133f50 0x7f883c11f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8842e4d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c1204c0 con 0x7f883c0a1380 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8842e4d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c121fe0 con 0x7f883c133f50 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8842e4d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f883c133aa0 con 0x7f883c0a0a70 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8840be9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a0a70 0x7f883c11e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8840be9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a0a70 0x7f883c11e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41754/0 (socket says 172.21.15.154:41754) 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f8840be9700 1 -- 172.21.15.154:0/887996758 learned_addr learned my addr 172.21.15.154:0/887996758 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f883bfff700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0a1380 0x7f883c11ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.098+0000 7f88413ea700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c133f50 0x7f883c11f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f8840be9700 1 -- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c133f50 msgr2=0x7f883c11f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f8840be9700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c133f50 0x7f883c11f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f8840be9700 1 -- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0a1380 msgr2=0x7f883c11ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f8840be9700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0a1380 0x7f883c11ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f8840be9700 1 -- 172.21.15.154:0/887996758 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009550 con 0x7f883c0a0a70 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f883bfff700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0a1380 0x7f883c11ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f8840be9700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a0a70 0x7f883c11e830 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f883000ebe0 tx=0x7f883000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f88397fa700 1 -- 172.21.15.154:0/887996758 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000c850 con 0x7f883c0a0a70 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f88397fa700 1 -- 172.21.15.154:0/887996758 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883000c9b0 con 0x7f883c0a0a70 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f8842e4d700 1 -- 172.21.15.154:0/887996758 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88280094a0 con 0x7f883c0a0a70 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f88397fa700 1 -- 172.21.15.154:0/887996758 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000cd40 con 0x7f883c0a0a70 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.099+0000 7f8842e4d700 1 -- 172.21.15.154:0/887996758 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c122a50 con 0x7f883c0a0a70 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.100+0000 7f88397fa700 1 -- 172.21.15.154:0/887996758 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8830013470 con 0x7f883c0a0a70 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.100+0000 7f8842e4d700 1 -- 172.21.15.154:0/887996758 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c121e20 con 0x7f883c0a0a70 2023-09-30T22:29:00.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.100+0000 7f88397fa700 1 -- 172.21.15.154:0/887996758 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f883003f860 con 0x7f883c0a0a70 2023-09-30T22:29:00.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.103+0000 7f3820b4b700 1 Processor -- start 2023-09-30T22:29:00.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.103+0000 7f3820b4b700 1 -- start start 2023-09-30T22:29:00.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.104+0000 7f3820b4b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f381c066410 0x7f381c1319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.104+0000 7f3820b4b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c1314b0 0x7f381c131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.104+0000 7f3820b4b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c0a0f20 con 0x7f381c09bc70 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.104+0000 7f3820b4b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c0667e0 con 0x7f381c066410 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.104+0000 7f3820b4b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0a23c0 con 0x7f381c1314b0 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.104+0000 7f381a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f381c066410 0x7f381c1319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.104+0000 7f3819d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c1314b0 0x7f381c131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.104+0000 7f381a59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f381c066410 0x7f381c1319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50716/0 (socket says 172.21.15.154:50716) 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.104+0000 7f381a59c700 1 -- 172.21.15.154:0/1466540202 learned_addr learned my addr 172.21.15.154:0/1466540202 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.105+0000 7f381a59c700 1 -- 172.21.15.154:0/1466540202 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c1314b0 msgr2=0x7f381c131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:00.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.105+0000 7f381a59c700 1 --2- 172.21.15.154:0/1466540202 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c1314b0 0x7f381c131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.105+0000 7f381a59c700 1 -- 172.21.15.154:0/1466540202 >> v1:172.21.15.154:6789/0 conn(0x7f381c09bc70 legacy=0x7f381c09c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.105+0000 7f381a59c700 1 -- 172.21.15.154:0/1466540202 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0a16e0 con 0x7f381c066410 2023-09-30T22:29:00.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.105+0000 7f3819d9b700 1 --2- 172.21.15.154:0/1466540202 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c1314b0 0x7f381c131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.105+0000 7f381a59c700 1 --2- 172.21.15.154:0/1466540202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c066410 0x7f381c1319f0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f380c0098f0 tx=0x7f380c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bd821c6a5c8dcb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.105+0000 7f381959a700 1 -- 172.21.15.154:0/1466540202 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c005e30 con 0x7f381c066410 2023-09-30T22:29:00.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.105+0000 7f381959a700 1 -- 172.21.15.154:0/1466540202 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c004030 con 0x7f381c066410 2023-09-30T22:29:00.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.105+0000 7f381959a700 1 -- 172.21.15.154:0/1466540202 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0043e0 con 0x7f381c066410 2023-09-30T22:29:00.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.106+0000 7f88397fa700 1 -- 172.21.15.154:0/887996758 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88300232f0 con 0x7f883c0a0a70 2023-09-30T22:29:00.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.106+0000 7f3820b4b700 1 -- 172.21.15.154:0/1466540202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c066410 msgr2=0x7f381c1319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.106+0000 7f3820b4b700 1 --2- 172.21.15.154:0/1466540202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c066410 0x7f381c1319f0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f380c0098f0 tx=0x7f380c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:00.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.106+0000 7f3820b4b700 1 -- 172.21.15.154:0/1466540202 shutdown_connections 2023-09-30T22:29:00.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.106+0000 7f3820b4b700 1 --2- 172.21.15.154:0/1466540202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c066410 0x7f381c1319f0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.106+0000 7f3820b4b700 1 --2- 172.21.15.154:0/1466540202 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c1314b0 0x7f381c131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.106+0000 7f3820b4b700 1 -- 172.21.15.154:0/1466540202 >> 172.21.15.154:0/1466540202 conn(0x7f381c0a2980 msgr2=0x7f381c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.106+0000 7f3820b4b700 1 -- 172.21.15.154:0/1466540202 shutdown_connections 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.106+0000 7f3820b4b700 1 -- 172.21.15.154:0/1466540202 wait complete. 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.107+0000 7f3820b4b700 1 Processor -- start 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.107+0000 7f3820b4b700 1 -- start start 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.107+0000 7f3820b4b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381c066410 0x7f381c1379d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.107+0000 7f3820b4b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c09bc70 0x7f381c137f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.107+0000 7f3820b4b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c1314b0 0x7f381c099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.107+0000 7f3820b4b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c135c10 con 0x7f381c1314b0 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.107+0000 7f3820b4b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c136bc0 con 0x7f381c066410 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.107+0000 7f3820b4b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0a1dc0 con 0x7f381c09bc70 2023-09-30T22:29:00.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.107+0000 7f3819d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c09bc70 0x7f381c137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f381ad9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c1314b0 0x7f381c099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f3819d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c09bc70 0x7f381c137f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41780/0 (socket says 172.21.15.154:41780) 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f3819d9b700 1 -- 172.21.15.154:0/93912070 learned_addr learned my addr 172.21.15.154:0/93912070 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f381a59c700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381c066410 0x7f381c1379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f381ad9d700 1 -- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c09bc70 msgr2=0x7f381c137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f381ad9d700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c09bc70 0x7f381c137f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f381ad9d700 1 -- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381c066410 msgr2=0x7f381c1379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f381ad9d700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381c066410 0x7f381c1379d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f381ad9d700 1 -- 172.21.15.154:0/93912070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38100094a0 con 0x7f381c1314b0 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f3819d9b700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c09bc70 0x7f381c137f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f381a59c700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381c066410 0x7f381c1379d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:00.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f381ad9d700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c1314b0 0x7f381c099a90 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f381400cb90 tx=0x7f381400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:00.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f380affd700 1 -- 172.21.15.154:0/93912070 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814003c00 con 0x7f381c1314b0 2023-09-30T22:29:00.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f380affd700 1 -- 172.21.15.154:0/93912070 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814003d60 con 0x7f381c1314b0 2023-09-30T22:29:00.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f3820b4b700 1 -- 172.21.15.154:0/93912070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c009500 con 0x7f381c1314b0 2023-09-30T22:29:00.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f380affd700 1 -- 172.21.15.154:0/93912070 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381400a9c0 con 0x7f381c1314b0 2023-09-30T22:29:00.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.108+0000 7f3820b4b700 1 -- 172.21.15.154:0/93912070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c136670 con 0x7f381c1314b0 2023-09-30T22:29:00.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.109+0000 7f380affd700 1 -- 172.21.15.154:0/93912070 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f381400ab20 con 0x7f381c1314b0 2023-09-30T22:29:00.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.109+0000 7f380affd700 1 -- 172.21.15.154:0/93912070 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f381403f3f0 con 0x7f381c1314b0 2023-09-30T22:29:00.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.110+0000 7f3820b4b700 1 -- 172.21.15.154:0/93912070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c136670 con 0x7f381c1314b0 2023-09-30T22:29:00.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.114+0000 7f380affd700 1 -- 172.21.15.154:0/93912070 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f381c136670 con 0x7f381c1314b0 2023-09-30T22:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.227+0000 7f09f79cb700 1 -- 172.21.15.154:0/65576298 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f09f0072d60 con 0x7f09f009e870 2023-09-30T22:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.227+0000 7f09e5ffb700 1 -- 172.21.15.154:0/65576298 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09ec017070 con 0x7f09f009e870 2023-09-30T22:29:00.228 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:00.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.229+0000 7f09f79cb700 1 -- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09f009e870 msgr2=0x7f09f0121980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.229+0000 7f09f79cb700 1 --2- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09f009e870 0x7f09f0121980 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c3c0 tx=0x7f09ec00c6d0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.230+0000 7f09f79cb700 1 -- 172.21.15.154:0/65576298 shutdown_connections 2023-09-30T22:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.230+0000 7f09f79cb700 1 --2- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09f01393a0 0x7f09f0122400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.230+0000 7f09f79cb700 1 --2- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09f009e870 0x7f09f0121980 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.230+0000 7f09f79cb700 1 --2- 172.21.15.154:0/65576298 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f09f009f350 0x7f09f0121ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.230+0000 7f09f79cb700 1 -- 172.21.15.154:0/65576298 >> 172.21.15.154:0/65576298 conn(0x7f09f00a4430 msgr2=0x7f09f0070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.230+0000 7f09f79cb700 1 -- 172.21.15.154:0/65576298 shutdown_connections 2023-09-30T22:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.230+0000 7f09f79cb700 1 -- 172.21.15.154:0/65576298 wait complete. 2023-09-30T22:29:00.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:00.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.300+0000 7f8842e4d700 1 -- 172.21.15.154:0/887996758 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f883c121c30 con 0x7f883c0a0a70 2023-09-30T22:29:00.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.301+0000 7f88397fa700 1 -- 172.21.15.154:0/887996758 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8830021070 con 0x7f883c0a0a70 2023-09-30T22:29:00.301 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:00.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.303+0000 7f8842e4d700 1 -- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a0a70 msgr2=0x7f883c11e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.303+0000 7f8842e4d700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a0a70 0x7f883c11e830 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f883000ebe0 tx=0x7f883000eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.303+0000 7f8842e4d700 1 -- 172.21.15.154:0/887996758 shutdown_connections 2023-09-30T22:29:00.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.303+0000 7f8842e4d700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c133f50 0x7f883c11f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.303+0000 7f8842e4d700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f883c0a0a70 0x7f883c11e830 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.303+0000 7f8842e4d700 1 --2- 172.21.15.154:0/887996758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0a1380 0x7f883c11ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.303+0000 7f8842e4d700 1 -- 172.21.15.154:0/887996758 >> 172.21.15.154:0/887996758 conn(0x7f883c0a6610 msgr2=0x7f883c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.303+0000 7f8842e4d700 1 -- 172.21.15.154:0/887996758 shutdown_connections 2023-09-30T22:29:00.304 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.303+0000 7f8842e4d700 1 -- 172.21.15.154:0/887996758 wait complete. 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.306+0000 7f3820b4b700 1 -- 172.21.15.154:0/93912070 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f381c136670 con 0x7f381c1314b0 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.306+0000 7f380affd700 1 -- 172.21.15.154:0/93912070 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f381c136670 con 0x7f381c1314b0 2023-09-30T22:29:00.306 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:00.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.309+0000 7f3820b4b700 1 -- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c1314b0 msgr2=0x7f381c099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:00.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.309+0000 7f3820b4b700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c1314b0 0x7f381c099a90 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f381400cb90 tx=0x7f381400cea0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.309+0000 7f3820b4b700 1 -- 172.21.15.154:0/93912070 shutdown_connections 2023-09-30T22:29:00.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.309+0000 7f3820b4b700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381c1314b0 0x7f381c099a90 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.309+0000 7f3820b4b700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381c066410 0x7f381c1379d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.309+0000 7f3820b4b700 1 --2- 172.21.15.154:0/93912070 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f381c09bc70 0x7f381c137f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.309+0000 7f3820b4b700 1 -- 172.21.15.154:0/93912070 >> 172.21.15.154:0/93912070 conn(0x7f381c0a2980 msgr2=0x7f381c12f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.309+0000 7f3820b4b700 1 -- 172.21.15.154:0/93912070 shutdown_connections 2023-09-30T22:29:00.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:00.309+0000 7f3820b4b700 1 -- 172.21.15.154:0/93912070 wait complete. 2023-09-30T22:29:00.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:00.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:01.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:01.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.123+0000 7f294fce3700 1 Processor -- start 2023-09-30T22:29:01.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294fce3700 1 -- start start 2023-09-30T22:29:01.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294fce3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f294809ad40 0x7f2948133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294fce3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f29480a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294fce3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294809b110 con 0x7f2948133f70 2023-09-30T22:29:01.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294fce3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29480a3b60 con 0x7f294809ad40 2023-09-30T22:29:01.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294fce3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2948134850 con 0x7f29481343d0 2023-09-30T22:29:01.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294da7f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f294809ad40 0x7f2948133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294e280700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f29480a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294da7f700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f294809ad40 0x7f2948133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50738/0 (socket says 172.21.15.154:50738) 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294e280700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f29480a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41790/0 (socket says 172.21.15.154:41790) 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294da7f700 1 -- 172.21.15.154:0/3074180513 learned_addr learned my addr 172.21.15.154:0/3074180513 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294da7f700 1 -- 172.21.15.154:0/3074180513 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 msgr2=0x7f29480a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294da7f700 1 --2- 172.21.15.154:0/3074180513 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f29480a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294da7f700 1 -- 172.21.15.154:0/3074180513 >> v1:172.21.15.154:6789/0 conn(0x7f2948133f70 legacy=0x7f29480a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294ca7d700 1 -- 172.21.15.154:0/3074180513 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159991225 0 0) 0x7f294809b110 con 0x7f2948133f70 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.124+0000 7f294da7f700 1 -- 172.21.15.154:0/3074180513 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29480a2fa0 con 0x7f294809ad40 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294da7f700 1 --2- 172.21.15.154:0/3074180513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 0x7f2948133a30 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f29440098f0 tx=0x7f2944009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837cfbec770d2a48 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294ca7d700 1 -- 172.21.15.154:0/3074180513 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944011830 con 0x7f294809ad40 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294ca7d700 1 -- 172.21.15.154:0/3074180513 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2944011990 con 0x7f294809ad40 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294ca7d700 1 -- 172.21.15.154:0/3074180513 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944011d20 con 0x7f294809ad40 2023-09-30T22:29:01.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294fce3700 1 -- 172.21.15.154:0/3074180513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 msgr2=0x7f2948133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294fce3700 1 --2- 172.21.15.154:0/3074180513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 0x7f2948133a30 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f29440098f0 tx=0x7f2944009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294fce3700 1 -- 172.21.15.154:0/3074180513 shutdown_connections 2023-09-30T22:29:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294fce3700 1 --2- 172.21.15.154:0/3074180513 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f29480a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294fce3700 1 --2- 172.21.15.154:0/3074180513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 0x7f2948133a30 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294fce3700 1 -- 172.21.15.154:0/3074180513 >> 172.21.15.154:0/3074180513 conn(0x7f2948099c40 msgr2=0x7f294806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294fce3700 1 -- 172.21.15.154:0/3074180513 shutdown_connections 2023-09-30T22:29:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.125+0000 7f294fce3700 1 -- 172.21.15.154:0/3074180513 wait complete. 2023-09-30T22:29:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.126+0000 7f294fce3700 1 Processor -- start 2023-09-30T22:29:01.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.126+0000 7f294fce3700 1 -- start start 2023-09-30T22:29:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294fce3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 0x7f29481221f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294fce3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2948133f70 0x7f2948122730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294fce3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f2948122c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294fce3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29481254a0 con 0x7f294809ad40 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294fce3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29481265f0 con 0x7f2948133f70 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294fce3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2948123dc0 con 0x7f29481343d0 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294e280700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f2948122c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294da7f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 0x7f29481221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294d27e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2948133f70 0x7f2948122730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294e280700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f2948122c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41802/0 (socket says 172.21.15.154:41802) 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294da7f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 0x7f29481221f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50742/0 (socket says 172.21.15.154:50742) 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294e280700 1 -- 172.21.15.154:0/977114331 learned_addr learned my addr 172.21.15.154:0/977114331 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294e280700 1 -- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2948133f70 msgr2=0x7f2948122730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294e280700 1 --2- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2948133f70 0x7f2948122730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294e280700 1 -- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 msgr2=0x7f29481221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294e280700 1 --2- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 0x7f29481221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294e280700 1 -- 172.21.15.154:0/977114331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944009550 con 0x7f29481343d0 2023-09-30T22:29:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294da7f700 1 --2- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 0x7f29481221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294d27e700 1 --2- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2948133f70 0x7f2948122730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294e280700 1 --2- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f2948122c70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f294000efc0 tx=0x7f294000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f293a7fc700 1 -- 172.21.15.154:0/977114331 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940009ea0 con 0x7f29481343d0 2023-09-30T22:29:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f293a7fc700 1 -- 172.21.15.154:0/977114331 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294000f040 con 0x7f29481343d0 2023-09-30T22:29:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f294fce3700 1 -- 172.21.15.154:0/977114331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2948125950 con 0x7f29481343d0 2023-09-30T22:29:01.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.127+0000 7f293a7fc700 1 -- 172.21.15.154:0/977114331 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000ced0 con 0x7f29481343d0 2023-09-30T22:29:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.128+0000 7f294fce3700 1 -- 172.21.15.154:0/977114331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294809c7e0 con 0x7f29481343d0 2023-09-30T22:29:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.128+0000 7f293a7fc700 1 -- 172.21.15.154:0/977114331 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2940014480 con 0x7f29481343d0 2023-09-30T22:29:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.128+0000 7f293a7fc700 1 -- 172.21.15.154:0/977114331 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2940040140 con 0x7f29481343d0 2023-09-30T22:29:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.128+0000 7f294fce3700 1 -- 172.21.15.154:0/977114331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29481255f0 con 0x7f29481343d0 2023-09-30T22:29:01.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.133+0000 7f293a7fc700 1 -- 172.21.15.154:0/977114331 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29481255f0 con 0x7f29481343d0 2023-09-30T22:29:01.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:01.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:01.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:01.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.328+0000 7f294fce3700 1 -- 172.21.15.154:0/977114331 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29481255f0 con 0x7f29481343d0 2023-09-30T22:29:01.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.328+0000 7f293a7fc700 1 -- 172.21.15.154:0/977114331 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29481255f0 con 0x7f29481343d0 2023-09-30T22:29:01.329 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:01.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.330+0000 7f294fce3700 1 -- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 msgr2=0x7f2948122c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.330+0000 7f294fce3700 1 --2- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f2948122c70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f294000efc0 tx=0x7f294000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.331+0000 7f294fce3700 1 -- 172.21.15.154:0/977114331 shutdown_connections 2023-09-30T22:29:01.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.331+0000 7f294fce3700 1 --2- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f29481343d0 0x7f2948122c70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.331+0000 7f294fce3700 1 --2- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f294809ad40 0x7f29481221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.331+0000 7f294fce3700 1 --2- 172.21.15.154:0/977114331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2948133f70 0x7f2948122730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.331+0000 7f294fce3700 1 -- 172.21.15.154:0/977114331 >> 172.21.15.154:0/977114331 conn(0x7f2948099c40 msgr2=0x7f29480a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.331+0000 7f294fce3700 1 -- 172.21.15.154:0/977114331 shutdown_connections 2023-09-30T22:29:01.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.331+0000 7f294fce3700 1 -- 172.21.15.154:0/977114331 wait complete. 2023-09-30T22:29:01.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.373+0000 7f4eddd49700 1 Processor -- start 2023-09-30T22:29:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.373+0000 7f4eddd49700 1 -- start start 2023-09-30T22:29:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4eddd49700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8133730 0x7f4ed8135b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4eddd49700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ed8136050 0x7f4ed8138430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4eddd49700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed809c1f0 con 0x7f4ed81309f0 2023-09-30T22:29:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4eddd49700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806dc20 con 0x7f4ed8136050 2023-09-30T22:29:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4eddd49700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed809b1f0 con 0x7f4ed8133730 2023-09-30T22:29:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4ed6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8133730 0x7f4ed8135b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4ed6ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8133730 0x7f4ed8135b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41810/0 (socket says 172.21.15.154:41810) 2023-09-30T22:29:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4ed6ffd700 1 -- 172.21.15.154:0/1418475499 learned_addr learned my addr 172.21.15.154:0/1418475499 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4ed7fff700 1 --2- 172.21.15.154:0/1418475499 >> v2:172.21.15.154:3300/0 conn(0x7f4ed8136050 0x7f4ed8138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4ed6ffd700 1 -- 172.21.15.154:0/1418475499 >> v2:172.21.15.154:3300/0 conn(0x7f4ed8136050 msgr2=0x7f4ed8138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4ed6ffd700 1 --2- 172.21.15.154:0/1418475499 >> v2:172.21.15.154:3300/0 conn(0x7f4ed8136050 0x7f4ed8138430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4ed6ffd700 1 -- 172.21.15.154:0/1418475499 >> v1:172.21.15.154:6789/0 conn(0x7f4ed81309f0 legacy=0x7f4ed8130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4ed6ffd700 1 -- 172.21.15.154:0/1418475499 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed81305a0 con 0x7f4ed8133730 2023-09-30T22:29:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.374+0000 7f4ed6ffd700 1 --2- 172.21.15.154:0/1418475499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8133730 0x7f4ed8135b10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0098f0 tx=0x7f4ecc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74be55f02500675e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4ed67fc700 1 -- 172.21.15.154:0/1418475499 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc011830 con 0x7f4ed8133730 2023-09-30T22:29:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4ed67fc700 1 -- 172.21.15.154:0/1418475499 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc011990 con 0x7f4ed8133730 2023-09-30T22:29:01.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4ed67fc700 1 -- 172.21.15.154:0/1418475499 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc011d20 con 0x7f4ed8133730 2023-09-30T22:29:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4eddd49700 1 -- 172.21.15.154:0/1418475499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8133730 msgr2=0x7f4ed8135b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4eddd49700 1 --2- 172.21.15.154:0/1418475499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8133730 0x7f4ed8135b10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0098f0 tx=0x7f4ecc009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4eddd49700 1 -- 172.21.15.154:0/1418475499 shutdown_connections 2023-09-30T22:29:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4eddd49700 1 --2- 172.21.15.154:0/1418475499 >> v2:172.21.15.154:3300/0 conn(0x7f4ed8136050 0x7f4ed8138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4eddd49700 1 --2- 172.21.15.154:0/1418475499 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8133730 0x7f4ed8135b10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4eddd49700 1 -- 172.21.15.154:0/1418475499 >> 172.21.15.154:0/1418475499 conn(0x7f4ed80a2b30 msgr2=0x7f4ed809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4eddd49700 1 -- 172.21.15.154:0/1418475499 shutdown_connections 2023-09-30T22:29:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.375+0000 7f4eddd49700 1 -- 172.21.15.154:0/1418475499 wait complete. 2023-09-30T22:29:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.376+0000 7f4eddd49700 1 Processor -- start 2023-09-30T22:29:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.376+0000 7f4eddd49700 1 -- start start 2023-09-30T22:29:01.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4eddd49700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed81309f0 0x7f4ed81273e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4eddd49700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed8133730 0x7f4ed8127920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4eddd49700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8136050 0x7f4ed8127e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4eddd49700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed812df60 con 0x7f4ed81309f0 2023-09-30T22:29:01.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4eddd49700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed809ec20 con 0x7f4ed8133730 2023-09-30T22:29:01.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4eddd49700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed809b430 con 0x7f4ed8136050 2023-09-30T22:29:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8136050 0x7f4ed8127e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed6ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed8133730 0x7f4ed8127920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8136050 0x7f4ed8127e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41818/0 (socket says 172.21.15.154:41818) 2023-09-30T22:29:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed7fff700 1 -- 172.21.15.154:0/243901970 learned_addr learned my addr 172.21.15.154:0/243901970 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed77fe700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed81309f0 0x7f4ed81273e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed7fff700 1 -- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed8133730 msgr2=0x7f4ed8127920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed7fff700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed8133730 0x7f4ed8127920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed7fff700 1 -- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed81309f0 msgr2=0x7f4ed81273e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed7fff700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed81309f0 0x7f4ed81273e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed7fff700 1 -- 172.21.15.154:0/243901970 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc009550 con 0x7f4ed8136050 2023-09-30T22:29:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed6ffd700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed8133730 0x7f4ed8127920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:01.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.377+0000 7f4ed77fe700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed81309f0 0x7f4ed81273e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:01.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.378+0000 7f4ed7fff700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8136050 0x7f4ed8127e60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000ef90 tx=0x7f4ed000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.378+0000 7f4ebffff700 1 -- 172.21.15.154:0/243901970 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed000cc90 con 0x7f4ed8136050 2023-09-30T22:29:01.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.378+0000 7f4ebffff700 1 -- 172.21.15.154:0/243901970 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed000f040 con 0x7f4ed8136050 2023-09-30T22:29:01.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.378+0000 7f4ebffff700 1 -- 172.21.15.154:0/243901970 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00135c0 con 0x7f4ed8136050 2023-09-30T22:29:01.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.378+0000 7f4eddd49700 1 -- 172.21.15.154:0/243901970 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed8129560 con 0x7f4ed8136050 2023-09-30T22:29:01.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.378+0000 7f4eddd49700 1 -- 172.21.15.154:0/243901970 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed812b410 con 0x7f4ed8136050 2023-09-30T22:29:01.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.379+0000 7f4ebffff700 1 -- 172.21.15.154:0/243901970 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ed0013720 con 0x7f4ed8136050 2023-09-30T22:29:01.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.379+0000 7f4ebffff700 1 -- 172.21.15.154:0/243901970 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4ed0043c80 con 0x7f4ed8136050 2023-09-30T22:29:01.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.379+0000 7f4eddd49700 1 -- 172.21.15.154:0/243901970 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed804f2a0 con 0x7f4ed8136050 2023-09-30T22:29:01.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.384+0000 7f4ebffff700 1 -- 172.21.15.154:0/243901970 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ed0020070 con 0x7f4ed8136050 2023-09-30T22:29:01.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.446+0000 7f4a281b2700 1 Processor -- start 2023-09-30T22:29:01.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a281b2700 1 -- start start 2023-09-30T22:29:01.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a281b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a2009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a281b2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a2009f180 0x7f4a20131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a281b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a281b2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a200a0920 con 0x7f4a2009f180 2023-09-30T22:29:01.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a281b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2009c970 con 0x7f4a2009e870 2023-09-30T22:29:01.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a281b2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2009bab0 con 0x7f4a20131d70 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a2674f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a2574d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a2009f180 0x7f4a20131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a2674f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41822/0 (socket says 172.21.15.154:41822) 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a2674f700 1 -- 172.21.15.154:0/2377383734 learned_addr learned my addr 172.21.15.154:0/2377383734 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.447+0000 7f4a25f4e700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a2009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a2574d700 1 -- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 msgr2=0x7f4a20132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a2574d700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a2574d700 1 -- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 msgr2=0x7f4a2009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a2574d700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a2009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a2574d700 1 -- 172.21.15.154:0/2377383734 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2009f9c0 con 0x7f4a2009f180 2023-09-30T22:29:01.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a2674f700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a25f4e700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a2009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a2574d700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a2009f180 0x7f4a20131830 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009870 tx=0x7f4a10009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840af441c62a726b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a24f4c700 1 -- 172.21.15.154:0/2377383734 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10011830 con 0x7f4a2009f180 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a24f4c700 1 -- 172.21.15.154:0/2377383734 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a10011990 con 0x7f4a2009f180 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.448+0000 7f4a24f4c700 1 -- 172.21.15.154:0/2377383734 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10011d20 con 0x7f4a2009f180 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.449+0000 7f4a281b2700 1 -- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a2009f180 msgr2=0x7f4a20131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.449+0000 7f4a281b2700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a2009f180 0x7f4a20131830 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009870 tx=0x7f4a10009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.449+0000 7f4a281b2700 1 -- 172.21.15.154:0/2377383734 shutdown_connections 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.449+0000 7f4a281b2700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a2009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.449+0000 7f4a281b2700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.449+0000 7f4a281b2700 1 --2- 172.21.15.154:0/2377383734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a2009f180 0x7f4a20131830 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.449+0000 7f4a281b2700 1 -- 172.21.15.154:0/2377383734 >> 172.21.15.154:0/2377383734 conn(0x7f4a200a4430 msgr2=0x7f4a200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.449+0000 7f4a281b2700 1 -- 172.21.15.154:0/2377383734 shutdown_connections 2023-09-30T22:29:01.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.449+0000 7f4a281b2700 1 -- 172.21.15.154:0/2377383734 wait complete. 2023-09-30T22:29:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.450+0000 7f4a281b2700 1 Processor -- start 2023-09-30T22:29:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.450+0000 7f4a281b2700 1 -- start start 2023-09-30T22:29:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a281b2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a20120240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a281b2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a2009f180 0x7f4a20120780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a281b2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20120cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a281b2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a201316a0 con 0x7f4a2009f180 2023-09-30T22:29:01.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a281b2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20122ce0 con 0x7f4a2009e870 2023-09-30T22:29:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a281b2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20123d60 con 0x7f4a20131d70 2023-09-30T22:29:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a25f4e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a20120240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a25f4e700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a20120240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55102/0 (socket says 172.21.15.154:55102) 2023-09-30T22:29:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a25f4e700 1 -- 172.21.15.154:0/2096419364 learned_addr learned my addr 172.21.15.154:0/2096419364 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a2674f700 1 --2- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20120cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a2574d700 1 --2- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a2009f180 0x7f4a20120780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a25f4e700 1 -- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 msgr2=0x7f4a20120cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a25f4e700 1 --2- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20120cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a25f4e700 1 -- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a2009f180 msgr2=0x7f4a20120780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a25f4e700 1 --2- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a2009f180 0x7f4a20120780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a25f4e700 1 -- 172.21.15.154:0/2096419364 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009b30 con 0x7f4a2009e870 2023-09-30T22:29:01.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.451+0000 7f4a25f4e700 1 --2- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a20120240 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009f10 tx=0x7f4a1c00dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.452+0000 7f4a167fc700 1 -- 172.21.15.154:0/2096419364 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c004230 con 0x7f4a2009e870 2023-09-30T22:29:01.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.452+0000 7f4a167fc700 1 -- 172.21.15.154:0/2096419364 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c016070 con 0x7f4a2009e870 2023-09-30T22:29:01.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.452+0000 7f4a167fc700 1 -- 172.21.15.154:0/2096419364 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c004590 con 0x7f4a2009e870 2023-09-30T22:29:01.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.452+0000 7f4a281b2700 1 -- 172.21.15.154:0/2096419364 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a100094a0 con 0x7f4a2009e870 2023-09-30T22:29:01.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.452+0000 7f4a281b2700 1 -- 172.21.15.154:0/2096419364 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a201230a0 con 0x7f4a2009e870 2023-09-30T22:29:01.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.452+0000 7f4a167fc700 1 -- 172.21.15.154:0/2096419364 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a1c0128b0 con 0x7f4a2009e870 2023-09-30T22:29:01.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.453+0000 7f4a167fc700 1 -- 172.21.15.154:0/2096419364 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4a1c018070 con 0x7f4a2009e870 2023-09-30T22:29:01.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.453+0000 7f4a281b2700 1 -- 172.21.15.154:0/2096419364 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2011d580 con 0x7f4a2009e870 2023-09-30T22:29:01.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.457+0000 7f4a167fc700 1 -- 172.21.15.154:0/2096419364 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a1c0036a0 con 0x7f4a2009e870 2023-09-30T22:29:01.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.459+0000 7fcb5c197700 1 Processor -- start 2023-09-30T22:29:01.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb5c197700 1 -- start start 2023-09-30T22:29:01.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb5c197700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb5409ad40 0x7fcb54133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb5c197700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb54133f70 0x7fcb541343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb5c197700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5409b110 con 0x7fcb540a0a70 2023-09-30T22:29:01.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb5c197700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540a3b60 con 0x7fcb54133f70 2023-09-30T22:29:01.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb5c197700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb541348e0 con 0x7fcb5409ad40 2023-09-30T22:29:01.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb59f33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb5409ad40 0x7fcb54133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb59f33700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb5409ad40 0x7fcb54133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41830/0 (socket says 172.21.15.154:41830) 2023-09-30T22:29:01.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb59f33700 1 -- 172.21.15.154:0/2223871665 learned_addr learned my addr 172.21.15.154:0/2223871665 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:01.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.460+0000 7fcb59732700 1 --2- 172.21.15.154:0/2223871665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb54133f70 0x7fcb541343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.461+0000 7fcb59f33700 1 -- 172.21.15.154:0/2223871665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb54133f70 msgr2=0x7fcb541343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:01.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.461+0000 7fcb59f33700 1 --2- 172.21.15.154:0/2223871665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb54133f70 0x7fcb541343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.461+0000 7fcb59f33700 1 -- 172.21.15.154:0/2223871665 >> v1:172.21.15.154:6789/0 conn(0x7fcb540a0a70 legacy=0x7fcb540a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.461+0000 7fcb59f33700 1 -- 172.21.15.154:0/2223871665 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540a2fa0 con 0x7fcb5409ad40 2023-09-30T22:29:01.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.461+0000 7fcb59732700 1 --2- 172.21.15.154:0/2223871665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb54133f70 0x7fcb541343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:01.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.461+0000 7fcb59f33700 1 --2- 172.21.15.154:0/2223871665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb5409ad40 0x7fcb54133a30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009920 tx=0x7fcb50009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc37e35f81856cf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.461+0000 7fcb58f31700 1 -- 172.21.15.154:0/2223871665 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50011830 con 0x7fcb5409ad40 2023-09-30T22:29:01.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.461+0000 7fcb58f31700 1 -- 172.21.15.154:0/2223871665 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb50011990 con 0x7fcb5409ad40 2023-09-30T22:29:01.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.461+0000 7fcb58f31700 1 -- 172.21.15.154:0/2223871665 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50011d20 con 0x7fcb5409ad40 2023-09-30T22:29:01.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.462+0000 7fcb5c197700 1 -- 172.21.15.154:0/2223871665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb5409ad40 msgr2=0x7fcb54133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.462+0000 7fcb5c197700 1 --2- 172.21.15.154:0/2223871665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb5409ad40 0x7fcb54133a30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009920 tx=0x7fcb50009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:01.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.462+0000 7fcb5c197700 1 -- 172.21.15.154:0/2223871665 shutdown_connections 2023-09-30T22:29:01.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.462+0000 7fcb5c197700 1 --2- 172.21.15.154:0/2223871665 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb5409ad40 0x7fcb54133a30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.462+0000 7fcb5c197700 1 --2- 172.21.15.154:0/2223871665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb54133f70 0x7fcb541343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.462+0000 7fcb5c197700 1 -- 172.21.15.154:0/2223871665 >> 172.21.15.154:0/2223871665 conn(0x7fcb54099c40 msgr2=0x7fcb5406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.462+0000 7fcb5c197700 1 -- 172.21.15.154:0/2223871665 shutdown_connections 2023-09-30T22:29:01.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.462+0000 7fcb5c197700 1 -- 172.21.15.154:0/2223871665 wait complete. 2023-09-30T22:29:01.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb5c197700 1 Processor -- start 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb5c197700 1 -- start start 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb5c197700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb5409ad40 0x7fcb5411e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb5c197700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb540a0a70 0x7fcb5411e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb5c197700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb54133f70 0x7fcb5411ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb5c197700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5411f650 con 0x7fcb540a0a70 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb5c197700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5411fd60 con 0x7fcb5409ad40 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb5c197700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54120fb0 con 0x7fcb54133f70 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb59732700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb540a0a70 0x7fcb5411e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb59732700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb540a0a70 0x7fcb5411e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50790/0 (socket says 172.21.15.154:50790) 2023-09-30T22:29:01.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb59732700 1 -- 172.21.15.154:0/3476024771 learned_addr learned my addr 172.21.15.154:0/3476024771 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb5a734700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb54133f70 0x7fcb5411ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.463+0000 7fcb59f33700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb5409ad40 0x7fcb5411e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb59732700 1 -- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb54133f70 msgr2=0x7fcb5411ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb59732700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb54133f70 0x7fcb5411ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb59732700 1 -- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb5409ad40 msgr2=0x7fcb5411e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb59732700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb5409ad40 0x7fcb5411e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb59732700 1 -- 172.21.15.154:0/3476024771 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb440094a0 con 0x7fcb540a0a70 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb59f33700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb5409ad40 0x7fcb5411e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb59732700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb540a0a70 0x7fcb5411e6e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400ebe0 tx=0x7fcb4400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:01.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb4a7fc700 1 -- 172.21.15.154:0/3476024771 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400c850 con 0x7fcb540a0a70 2023-09-30T22:29:01.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb4a7fc700 1 -- 172.21.15.154:0/3476024771 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4400c9b0 con 0x7fcb540a0a70 2023-09-30T22:29:01.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb5c197700 1 -- 172.21.15.154:0/3476024771 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb50009550 con 0x7fcb540a0a70 2023-09-30T22:29:01.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb4a7fc700 1 -- 172.21.15.154:0/3476024771 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400cd40 con 0x7fcb540a0a70 2023-09-30T22:29:01.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.464+0000 7fcb5c197700 1 -- 172.21.15.154:0/3476024771 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5409bb50 con 0x7fcb540a0a70 2023-09-30T22:29:01.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.465+0000 7fcb4a7fc700 1 -- 172.21.15.154:0/3476024771 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb44013470 con 0x7fcb540a0a70 2023-09-30T22:29:01.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.465+0000 7fcb4a7fc700 1 -- 172.21.15.154:0/3476024771 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb4403f780 con 0x7fcb540a0a70 2023-09-30T22:29:01.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.465+0000 7fcb5c197700 1 -- 172.21.15.154:0/3476024771 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb540a58b0 con 0x7fcb540a0a70 2023-09-30T22:29:01.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.470+0000 7fcb4a7fc700 1 -- 172.21.15.154:0/3476024771 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb44013720 con 0x7fcb540a0a70 2023-09-30T22:29:01.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.581+0000 7f4eddd49700 1 -- 172.21.15.154:0/243901970 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4ed812a620 con 0x7f4ed8136050 2023-09-30T22:29:01.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.581+0000 7f4ebffff700 1 -- 172.21.15.154:0/243901970 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ed00076f0 con 0x7f4ed8136050 2023-09-30T22:29:01.583 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:01.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.584+0000 7f4eddd49700 1 -- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8136050 msgr2=0x7f4ed8127e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.584+0000 7f4eddd49700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8136050 0x7f4ed8127e60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000ef90 tx=0x7f4ed000c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.584+0000 7f4eddd49700 1 -- 172.21.15.154:0/243901970 shutdown_connections 2023-09-30T22:29:01.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.584+0000 7f4eddd49700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ed8136050 0x7f4ed8127e60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.584+0000 7f4eddd49700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed81309f0 0x7f4ed81273e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.584+0000 7f4eddd49700 1 --2- 172.21.15.154:0/243901970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed8133730 0x7f4ed8127920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.584+0000 7f4eddd49700 1 -- 172.21.15.154:0/243901970 >> 172.21.15.154:0/243901970 conn(0x7f4ed80a2b30 msgr2=0x7f4ed80a00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.584+0000 7f4eddd49700 1 -- 172.21.15.154:0/243901970 shutdown_connections 2023-09-30T22:29:01.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.584+0000 7f4eddd49700 1 -- 172.21.15.154:0/243901970 wait complete. 2023-09-30T22:29:01.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:01.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.652+0000 7f4a281b2700 1 -- 172.21.15.154:0/2096419364 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4a2004f2a0 con 0x7f4a2009e870 2023-09-30T22:29:01.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.653+0000 7f4a167fc700 1 -- 172.21.15.154:0/2096419364 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a1c02b090 con 0x7f4a2009e870 2023-09-30T22:29:01.654 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.655+0000 7f4a281b2700 1 -- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 msgr2=0x7f4a20120240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.655+0000 7f4a281b2700 1 --2- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a20120240 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009f10 tx=0x7f4a1c00dae0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.655+0000 7f4a281b2700 1 -- 172.21.15.154:0/2096419364 shutdown_connections 2023-09-30T22:29:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.655+0000 7f4a281b2700 1 --2- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4a20131d70 0x7f4a20120cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.655+0000 7f4a281b2700 1 --2- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2009e870 0x7f4a20120240 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.655+0000 7f4a281b2700 1 --2- 172.21.15.154:0/2096419364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a2009f180 0x7f4a20120780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.655+0000 7f4a281b2700 1 -- 172.21.15.154:0/2096419364 >> 172.21.15.154:0/2096419364 conn(0x7f4a200a4430 msgr2=0x7f4a2011a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.655+0000 7f4a281b2700 1 -- 172.21.15.154:0/2096419364 shutdown_connections 2023-09-30T22:29:01.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.655+0000 7f4a281b2700 1 -- 172.21.15.154:0/2096419364 wait complete. 2023-09-30T22:29:01.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.663+0000 7fcb5c197700 1 -- 172.21.15.154:0/3476024771 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb5409c7e0 con 0x7fcb540a0a70 2023-09-30T22:29:01.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.663+0000 7fcb4a7fc700 1 -- 172.21.15.154:0/3476024771 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb44021020 con 0x7fcb540a0a70 2023-09-30T22:29:01.665 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.666+0000 7fcb5c197700 1 -- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb540a0a70 msgr2=0x7fcb5411e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.666+0000 7fcb5c197700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb540a0a70 0x7fcb5411e6e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400ebe0 tx=0x7fcb4400eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.666+0000 7fcb5c197700 1 -- 172.21.15.154:0/3476024771 shutdown_connections 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.666+0000 7fcb5c197700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcb54133f70 0x7fcb5411ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.666+0000 7fcb5c197700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb5409ad40 0x7fcb5411e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.666+0000 7fcb5c197700 1 --2- 172.21.15.154:0/3476024771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb540a0a70 0x7fcb5411e6e0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.666+0000 7fcb5c197700 1 -- 172.21.15.154:0/3476024771 >> 172.21.15.154:0/3476024771 conn(0x7fcb54099c40 msgr2=0x7fcb541330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:01.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.666+0000 7fcb5c197700 1 -- 172.21.15.154:0/3476024771 shutdown_connections 2023-09-30T22:29:01.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:01.666+0000 7fcb5c197700 1 -- 172.21.15.154:0/3476024771 wait complete. 2023-09-30T22:29:01.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:01.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:02.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:02.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.470+0000 7fef34254700 1 Processor -- start 2023-09-30T22:29:02.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef34254700 1 -- start start 2023-09-30T22:29:02.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef34254700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef2c09d860 0x7fef2c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef34254700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef34254700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2c09aaa0 con 0x7fef2c130ce0 2023-09-30T22:29:02.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef34254700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c09f870 con 0x7fef2c09d860 2023-09-30T22:29:02.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef34254700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c09b360 con 0x7fef2c09e170 2023-09-30T22:29:02.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef317ef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef31ff0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef2c09d860 0x7fef2c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef317ef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55130/0 (socket says 172.21.15.154:55130) 2023-09-30T22:29:02.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef31ff0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef2c09d860 0x7fef2c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50800/0 (socket says 172.21.15.154:50800) 2023-09-30T22:29:02.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef317ef700 1 -- 172.21.15.154:0/228623795 learned_addr learned my addr 172.21.15.154:0/228623795 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:02.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.471+0000 7fef317ef700 1 -- 172.21.15.154:0/228623795 >> v2:172.21.15.154:3300/0 conn(0x7fef2c09d860 msgr2=0x7fef2c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef317ef700 1 --2- 172.21.15.154:0/228623795 >> v2:172.21.15.154:3300/0 conn(0x7fef2c09d860 0x7fef2c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef317ef700 1 -- 172.21.15.154:0/228623795 >> v1:172.21.15.154:6789/0 conn(0x7fef2c130ce0 legacy=0x7fef2c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef317ef700 1 -- 172.21.15.154:0/228623795 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c09b620 con 0x7fef2c09e170 2023-09-30T22:29:02.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef31ff0700 1 --2- 172.21.15.154:0/228623795 >> v2:172.21.15.154:3300/0 conn(0x7fef2c09d860 0x7fef2c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:02.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef317ef700 1 --2- 172.21.15.154:0/228623795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c1307a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fef2800bb90 tx=0x7fef2800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a6561cd825bd139 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef30fee700 1 -- 172.21.15.154:0/228623795 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2800dd30 con 0x7fef2c09e170 2023-09-30T22:29:02.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef30fee700 1 -- 172.21.15.154:0/228623795 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2800de90 con 0x7fef2c09e170 2023-09-30T22:29:02.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef30fee700 1 -- 172.21.15.154:0/228623795 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28010690 con 0x7fef2c09e170 2023-09-30T22:29:02.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef34254700 1 -- 172.21.15.154:0/228623795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 msgr2=0x7fef2c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef34254700 1 --2- 172.21.15.154:0/228623795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c1307a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fef2800bb90 tx=0x7fef2800bea0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef34254700 1 -- 172.21.15.154:0/228623795 shutdown_connections 2023-09-30T22:29:02.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef34254700 1 --2- 172.21.15.154:0/228623795 >> v2:172.21.15.154:3300/0 conn(0x7fef2c09d860 0x7fef2c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef34254700 1 --2- 172.21.15.154:0/228623795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c1307a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.472+0000 7fef34254700 1 -- 172.21.15.154:0/228623795 >> 172.21.15.154:0/228623795 conn(0x7fef2c099c40 msgr2=0x7fef2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.473+0000 7fef34254700 1 -- 172.21.15.154:0/228623795 shutdown_connections 2023-09-30T22:29:02.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.473+0000 7fef34254700 1 -- 172.21.15.154:0/228623795 wait complete. 2023-09-30T22:29:02.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.473+0000 7fef34254700 1 Processor -- start 2023-09-30T22:29:02.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.473+0000 7fef34254700 1 -- start start 2023-09-30T22:29:02.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef34254700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef2c09d860 0x7fef2c12f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef34254700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c12fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef34254700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef2c130ce0 0x7fef2c1b9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef34254700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1306a0 con 0x7fef2c09d860 2023-09-30T22:29:02.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef34254700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1bbb30 con 0x7fef2c09e170 2023-09-30T22:29:02.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef34254700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1bbd60 con 0x7fef2c130ce0 2023-09-30T22:29:02.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef31ff0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef2c09d860 0x7fef2c12f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef317ef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c12fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef31ff0700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef2c09d860 0x7fef2c12f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50802/0 (socket says 172.21.15.154:50802) 2023-09-30T22:29:02.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef317ef700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c12fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55138/0 (socket says 172.21.15.154:55138) 2023-09-30T22:29:02.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef31ff0700 1 -- 172.21.15.154:0/1559874151 learned_addr learned my addr 172.21.15.154:0/1559874151 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:02.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef327f1700 1 --2- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef2c130ce0 0x7fef2c1b9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef31ff0700 1 -- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef2c130ce0 msgr2=0x7fef2c1b9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef31ff0700 1 --2- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef2c130ce0 0x7fef2c1b9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef31ff0700 1 -- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 msgr2=0x7fef2c12fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef31ff0700 1 --2- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c12fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef31ff0700 1 -- 172.21.15.154:0/1559874151 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c0094a0 con 0x7fef2c09d860 2023-09-30T22:29:02.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef317ef700 1 --2- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c12fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:02.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.474+0000 7fef31ff0700 1 --2- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef2c09d860 0x7fef2c12f890 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00ebe0 tx=0x7fef1c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.475+0000 7fef227fc700 1 -- 172.21.15.154:0/1559874151 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00c850 con 0x7fef2c09d860 2023-09-30T22:29:02.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.475+0000 7fef227fc700 1 -- 172.21.15.154:0/1559874151 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00c9b0 con 0x7fef2c09d860 2023-09-30T22:29:02.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.475+0000 7fef34254700 1 -- 172.21.15.154:0/1559874151 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2800b7f0 con 0x7fef2c09d860 2023-09-30T22:29:02.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.475+0000 7fef227fc700 1 -- 172.21.15.154:0/1559874151 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00cd40 con 0x7fef2c09d860 2023-09-30T22:29:02.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.475+0000 7fef34254700 1 -- 172.21.15.154:0/1559874151 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c11dca0 con 0x7fef2c09d860 2023-09-30T22:29:02.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.475+0000 7fef227fc700 1 -- 172.21.15.154:0/1559874151 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef1c013470 con 0x7fef2c09d860 2023-09-30T22:29:02.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.475+0000 7fef227fc700 1 -- 172.21.15.154:0/1559874151 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef1c03fb30 con 0x7fef2c09d860 2023-09-30T22:29:02.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.476+0000 7fef34254700 1 -- 172.21.15.154:0/1559874151 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c11f3f0 con 0x7fef2c09d860 2023-09-30T22:29:02.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.480+0000 7fef227fc700 1 -- 172.21.15.154:0/1559874151 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef1c013720 con 0x7fef2c09d860 2023-09-30T22:29:02.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:02.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:02.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.669+0000 7fef34254700 1 -- 172.21.15.154:0/1559874151 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef2c04f2a0 con 0x7fef2c09d860 2023-09-30T22:29:02.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.669+0000 7fef227fc700 1 -- 172.21.15.154:0/1559874151 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef1c021030 con 0x7fef2c09d860 2023-09-30T22:29:02.671 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:02.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.672+0000 7fef34254700 1 -- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef2c09d860 msgr2=0x7fef2c12f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.672+0000 7fef34254700 1 --2- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef2c09d860 0x7fef2c12f890 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00ebe0 tx=0x7fef1c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.672+0000 7fef34254700 1 -- 172.21.15.154:0/1559874151 shutdown_connections 2023-09-30T22:29:02.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.672+0000 7fef34254700 1 --2- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef2c130ce0 0x7fef2c1b9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.672+0000 7fef34254700 1 --2- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef2c09d860 0x7fef2c12f890 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.672+0000 7fef34254700 1 --2- 172.21.15.154:0/1559874151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef2c09e170 0x7fef2c12fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.672+0000 7fef34254700 1 -- 172.21.15.154:0/1559874151 >> 172.21.15.154:0/1559874151 conn(0x7fef2c099c40 msgr2=0x7fef2c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.672+0000 7fef34254700 1 -- 172.21.15.154:0/1559874151 shutdown_connections 2023-09-30T22:29:02.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.672+0000 7fef34254700 1 -- 172.21.15.154:0/1559874151 wait complete. 2023-09-30T22:29:02.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:02.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:02.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82eaf14700 1 Processor -- start 2023-09-30T22:29:02.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82eaf14700 1 -- start start 2023-09-30T22:29:02.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82eaf14700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82e4133ad0 0x7f82e4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82eaf14700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4130bc0 0x7f82e413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82eaf14700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e406b2d0 con 0x7f82e41300a0 2023-09-30T22:29:02.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82eaf14700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e4133610 con 0x7f82e4133ad0 2023-09-30T22:29:02.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82eaf14700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82e409a500 con 0x7f82e4130bc0 2023-09-30T22:29:02.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82e8cb0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82e4133ad0 0x7f82e4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82e94b1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4130bc0 0x7f82e413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82e94b1700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4130bc0 0x7f82e413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41852/0 (socket says 172.21.15.154:41852) 2023-09-30T22:29:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82e8cb0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82e4133ad0 0x7f82e4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50806/0 (socket says 172.21.15.154:50806) 2023-09-30T22:29:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.726+0000 7f82e94b1700 1 -- 172.21.15.154:0/3410762804 learned_addr learned my addr 172.21.15.154:0/3410762804 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.727+0000 7f82e8cb0700 1 -- 172.21.15.154:0/3410762804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4130bc0 msgr2=0x7f82e413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.727+0000 7f82e8cb0700 1 --2- 172.21.15.154:0/3410762804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4130bc0 0x7f82e413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.727+0000 7f82e8cb0700 1 -- 172.21.15.154:0/3410762804 >> v1:172.21.15.154:6789/0 conn(0x7f82e41300a0 legacy=0x7f82e41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.727+0000 7f82e8cb0700 1 -- 172.21.15.154:0/3410762804 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e41338b0 con 0x7f82e4133ad0 2023-09-30T22:29:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.727+0000 7f82e94b1700 1 --2- 172.21.15.154:0/3410762804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4130bc0 0x7f82e413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.727+0000 7f82e8cb0700 1 --2- 172.21.15.154:0/3410762804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e4133ad0 0x7f82e4133ea0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009840 tx=0x7f82d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632a24f93b1bc8f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.727+0000 7f82e37fe700 1 -- 172.21.15.154:0/3410762804 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8011830 con 0x7f82e4133ad0 2023-09-30T22:29:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.727+0000 7f82e37fe700 1 -- 172.21.15.154:0/3410762804 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8011990 con 0x7f82e4133ad0 2023-09-30T22:29:02.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.727+0000 7f82e37fe700 1 -- 172.21.15.154:0/3410762804 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8011d20 con 0x7f82e4133ad0 2023-09-30T22:29:02.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.728+0000 7f82eaf14700 1 -- 172.21.15.154:0/3410762804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e4133ad0 msgr2=0x7f82e4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.728+0000 7f82eaf14700 1 --2- 172.21.15.154:0/3410762804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e4133ad0 0x7f82e4133ea0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009840 tx=0x7f82d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:02.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.728+0000 7f82eaf14700 1 -- 172.21.15.154:0/3410762804 shutdown_connections 2023-09-30T22:29:02.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.728+0000 7f82eaf14700 1 --2- 172.21.15.154:0/3410762804 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4130bc0 0x7f82e413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.728+0000 7f82eaf14700 1 --2- 172.21.15.154:0/3410762804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e4133ad0 0x7f82e4133ea0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.728+0000 7f82eaf14700 1 -- 172.21.15.154:0/3410762804 >> 172.21.15.154:0/3410762804 conn(0x7f82e4099c40 msgr2=0x7f82e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.728+0000 7f82eaf14700 1 -- 172.21.15.154:0/3410762804 shutdown_connections 2023-09-30T22:29:02.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.728+0000 7f82eaf14700 1 -- 172.21.15.154:0/3410762804 wait complete. 2023-09-30T22:29:02.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.729+0000 7f82eaf14700 1 Processor -- start 2023-09-30T22:29:02.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.729+0000 7f82eaf14700 1 -- start start 2023-09-30T22:29:02.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82eaf14700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e41300a0 0x7f82e411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82eaf14700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e4130bc0 0x7f82e411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82eaf14700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4133ad0 0x7f82e411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82eaf14700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4120e00 con 0x7f82e41300a0 2023-09-30T22:29:02.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82eaf14700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e412d580 con 0x7f82e4130bc0 2023-09-30T22:29:02.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82eaf14700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82e412dd00 con 0x7f82e4133ad0 2023-09-30T22:29:02.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82e3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e4130bc0 0x7f82e411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82e3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e4130bc0 0x7f82e411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55150/0 (socket says 172.21.15.154:55150) 2023-09-30T22:29:02.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82e3fff700 1 -- 172.21.15.154:0/2963508323 learned_addr learned my addr 172.21.15.154:0/2963508323 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:02.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82e8cb0700 1 --2- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e41300a0 0x7f82e411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82e94b1700 1 --2- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4133ad0 0x7f82e411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82e3fff700 1 -- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4133ad0 msgr2=0x7f82e411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82e3fff700 1 --2- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4133ad0 0x7f82e411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82e3fff700 1 -- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e41300a0 msgr2=0x7f82e411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.730+0000 7f82e3fff700 1 --2- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e41300a0 0x7f82e411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.731+0000 7f82e3fff700 1 -- 172.21.15.154:0/2963508323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc009b30 con 0x7f82e4130bc0 2023-09-30T22:29:02.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.731+0000 7f82e3fff700 1 --2- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e4130bc0 0x7f82e411df80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c450 tx=0x7f82d000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.731+0000 7f82e17fa700 1 -- 172.21.15.154:0/2963508323 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00052d0 con 0x7f82e4130bc0 2023-09-30T22:29:02.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.731+0000 7f82e17fa700 1 -- 172.21.15.154:0/2963508323 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0005430 con 0x7f82e4130bc0 2023-09-30T22:29:02.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.731+0000 7f82eaf14700 1 -- 172.21.15.154:0/2963508323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d80094a0 con 0x7f82e4130bc0 2023-09-30T22:29:02.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.731+0000 7f82e17fa700 1 -- 172.21.15.154:0/2963508323 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00038c0 con 0x7f82e4130bc0 2023-09-30T22:29:02.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.731+0000 7f82eaf14700 1 -- 172.21.15.154:0/2963508323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e40721b0 con 0x7f82e4130bc0 2023-09-30T22:29:02.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.732+0000 7f82e17fa700 1 -- 172.21.15.154:0/2963508323 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82d0003a20 con 0x7f82e4130bc0 2023-09-30T22:29:02.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.732+0000 7f82e17fa700 1 -- 172.21.15.154:0/2963508323 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82d003e890 con 0x7f82e4130bc0 2023-09-30T22:29:02.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.732+0000 7f82eaf14700 1 -- 172.21.15.154:0/2963508323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e411ff70 con 0x7f82e4130bc0 2023-09-30T22:29:02.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.737+0000 7f82e17fa700 1 -- 172.21.15.154:0/2963508323 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82d0011590 con 0x7f82e4130bc0 2023-09-30T22:29:02.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.797+0000 7fcd0c865700 1 Processor -- start 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.797+0000 7fcd0c865700 1 -- start start 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0c865700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd0806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0c865700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd0806b080 0x7fcd081317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0c865700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0809da80 con 0x7fcd08131cf0 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0c865700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0809dce0 con 0x7fcd0806b080 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0c865700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0809eb20 con 0x7fcd0806a770 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd05d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd0806b080 0x7fcd081317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd06d9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcd08131cf0 0x7fcd08138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47158/0 (socket says 172.21.15.154:47158) 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd05d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd0806b080 0x7fcd081317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55152/0 (socket says 172.21.15.154:55152) 2023-09-30T22:29:02.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd06d9d700 1 -- 172.21.15.154:0/2481244388 learned_addr learned my addr 172.21.15.154:0/2481244388 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0659c700 1 --2- 172.21.15.154:0/2481244388 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd0806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0559a700 1 -- 172.21.15.154:0/2481244388 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706658785 0 0) 0x7fcd0809da80 con 0x7fcd08131cf0 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0659c700 1 -- 172.21.15.154:0/2481244388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd0806b080 msgr2=0x7fcd081317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0659c700 1 --2- 172.21.15.154:0/2481244388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd0806b080 0x7fcd081317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0659c700 1 -- 172.21.15.154:0/2481244388 >> v1:172.21.15.154:6789/0 conn(0x7fcd08131cf0 legacy=0x7fcd08138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd0659c700 1 -- 172.21.15.154:0/2481244388 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0809d860 con 0x7fcd0806a770 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.798+0000 7fcd05d9b700 1 --2- 172.21.15.154:0/2481244388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd0806b080 0x7fcd081317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0659c700 1 --2- 172.21.15.154:0/2481244388 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd0806ab40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fccf80098a0 tx=0x7fccf8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b65e1ce6e1c73e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0559a700 1 -- 172.21.15.154:0/2481244388 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8011830 con 0x7fcd0806a770 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0559a700 1 -- 172.21.15.154:0/2481244388 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf8011990 con 0x7fcd0806a770 2023-09-30T22:29:02.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0559a700 1 -- 172.21.15.154:0/2481244388 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8011d20 con 0x7fcd0806a770 2023-09-30T22:29:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0c865700 1 -- 172.21.15.154:0/2481244388 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 msgr2=0x7fcd0806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0c865700 1 --2- 172.21.15.154:0/2481244388 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd0806ab40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fccf80098a0 tx=0x7fccf8009bb0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0c865700 1 -- 172.21.15.154:0/2481244388 shutdown_connections 2023-09-30T22:29:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0c865700 1 --2- 172.21.15.154:0/2481244388 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd0806ab40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0c865700 1 --2- 172.21.15.154:0/2481244388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd0806b080 0x7fcd081317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0c865700 1 -- 172.21.15.154:0/2481244388 >> 172.21.15.154:0/2481244388 conn(0x7fcd08099c40 msgr2=0x7fcd080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0c865700 1 -- 172.21.15.154:0/2481244388 shutdown_connections 2023-09-30T22:29:02.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.799+0000 7fcd0c865700 1 -- 172.21.15.154:0/2481244388 wait complete. 2023-09-30T22:29:02.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.800+0000 7fcd0c865700 1 Processor -- start 2023-09-30T22:29:02.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd0c865700 1 -- start start 2023-09-30T22:29:02.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd0c865700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd081c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd0c865700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0806b080 0x7fcd081c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd0c865700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd08131cf0 0x7fcd081c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd0c865700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd081223b0 con 0x7fcd0806b080 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd0c865700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0809c050 con 0x7fcd08131cf0 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd0c865700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080a06d0 con 0x7fcd0806a770 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd05d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0806b080 0x7fcd081c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd05d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0806b080 0x7fcd081c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50830/0 (socket says 172.21.15.154:50830) 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd06d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd08131cf0 0x7fcd081c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd05d9b700 1 -- 172.21.15.154:0/4139703147 learned_addr learned my addr 172.21.15.154:0/4139703147 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd0659c700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd081c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd05d9b700 1 -- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 msgr2=0x7fcd081c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd05d9b700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd081c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd05d9b700 1 -- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd08131cf0 msgr2=0x7fcd081c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd05d9b700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd08131cf0 0x7fcd081c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.801+0000 7fcd05d9b700 1 -- 172.21.15.154:0/4139703147 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0094a0 con 0x7fcd0806b080 2023-09-30T22:29:02.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.802+0000 7fcd06d9d700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd08131cf0 0x7fcd081c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:02.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.802+0000 7fcd0659c700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd081c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:02.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.802+0000 7fcd05d9b700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0806b080 0x7fcd081c8570 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00ebb0 tx=0x7fccfc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.802+0000 7fccf6ffd700 1 -- 172.21.15.154:0/4139703147 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00c850 con 0x7fcd0806b080 2023-09-30T22:29:02.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.802+0000 7fccf6ffd700 1 -- 172.21.15.154:0/4139703147 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00c9b0 con 0x7fcd0806b080 2023-09-30T22:29:02.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.802+0000 7fccf6ffd700 1 -- 172.21.15.154:0/4139703147 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00cd40 con 0x7fcd0806b080 2023-09-30T22:29:02.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.802+0000 7fcd0c865700 1 -- 172.21.15.154:0/4139703147 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf80094a0 con 0x7fcd0806b080 2023-09-30T22:29:02.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.802+0000 7fcd0c865700 1 -- 172.21.15.154:0/4139703147 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd081216b0 con 0x7fcd0806b080 2023-09-30T22:29:02.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.803+0000 7fccf6ffd700 1 -- 172.21.15.154:0/4139703147 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccfc013470 con 0x7fcd0806b080 2023-09-30T22:29:02.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.803+0000 7fcd0c865700 1 -- 172.21.15.154:0/4139703147 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0804f2a0 con 0x7fcd0806b080 2023-09-30T22:29:02.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.803+0000 7fccf6ffd700 1 -- 172.21.15.154:0/4139703147 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fccfc03fbb0 con 0x7fcd0806b080 2023-09-30T22:29:02.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.811+0000 7fccf6ffd700 1 -- 172.21.15.154:0/4139703147 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccfc01b3b0 con 0x7fcd0806b080 2023-09-30T22:29:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.827+0000 7f6ce5bf3700 1 Processor -- start 2023-09-30T22:29:02.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.827+0000 7f6ce5bf3700 1 -- start start 2023-09-30T22:29:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6ce5bf3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ce00a1570 0x7f6ce0138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6ce5bf3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce01393c0 0x7f6ce013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6ce5bf3700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce00a1fe0 con 0x7f6ce00a0a90 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6ce5bf3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce00a3aa0 con 0x7f6ce00a1570 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6ce5bf3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce009a540 con 0x7f6ce01393c0 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cdeffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ce00a1570 0x7f6ce0138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cdeffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ce00a1570 0x7f6ce0138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50836/0 (socket says 172.21.15.154:50836) 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cdeffd700 1 -- 172.21.15.154:0/3890844622 learned_addr learned my addr 172.21.15.154:0/3890844622 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cdffff700 1 --2- 172.21.15.154:0/3890844622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce01393c0 0x7f6ce013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cdeffd700 1 -- 172.21.15.154:0/3890844622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce01393c0 msgr2=0x7f6ce013b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cdeffd700 1 --2- 172.21.15.154:0/3890844622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce01393c0 0x7f6ce013b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cdeffd700 1 -- 172.21.15.154:0/3890844622 >> v1:172.21.15.154:6789/0 conn(0x7f6ce00a0a90 legacy=0x7f6ce00a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cdeffd700 1 -- 172.21.15.154:0/3890844622 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce009a280 con 0x7f6ce00a1570 2023-09-30T22:29:02.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cdeffd700 1 --2- 172.21.15.154:0/3890844622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 0x7f6ce0138e80 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40098f0 tx=0x7f6cd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2519b68ee1da9bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.828+0000 7f6cde7fc700 1 -- 172.21.15.154:0/3890844622 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4011830 con 0x7f6ce00a1570 2023-09-30T22:29:02.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6cde7fc700 1 -- 172.21.15.154:0/3890844622 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd4011990 con 0x7f6ce00a1570 2023-09-30T22:29:02.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6cde7fc700 1 -- 172.21.15.154:0/3890844622 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4011d20 con 0x7f6ce00a1570 2023-09-30T22:29:02.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/3890844622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 msgr2=0x7f6ce0138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6ce5bf3700 1 --2- 172.21.15.154:0/3890844622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 0x7f6ce0138e80 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40098f0 tx=0x7f6cd4009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/3890844622 shutdown_connections 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6ce5bf3700 1 --2- 172.21.15.154:0/3890844622 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce01393c0 0x7f6ce013b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6ce5bf3700 1 --2- 172.21.15.154:0/3890844622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 0x7f6ce0138e80 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/3890844622 >> 172.21.15.154:0/3890844622 conn(0x7f6ce0099c40 msgr2=0x7f6ce006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/3890844622 shutdown_connections 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.829+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/3890844622 wait complete. 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.830+0000 7f6ce5bf3700 1 Processor -- start 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.830+0000 7f6ce5bf3700 1 -- start start 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6ce5bf3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce00a0a90 0x7f6ce0121810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6ce5bf3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 0x7f6ce0121d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6ce5bf3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ce01393c0 0x7f6ce0122290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6ce5bf3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce0137140 con 0x7f6ce00a1570 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6ce5bf3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce0123a50 con 0x7f6ce01393c0 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6ce5bf3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce0123530 con 0x7f6ce00a0a90 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdeffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 0x7f6ce0121d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdeffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 0x7f6ce0121d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50846/0 (socket says 172.21.15.154:50846) 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdeffd700 1 -- 172.21.15.154:0/1371485616 learned_addr learned my addr 172.21.15.154:0/1371485616 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdffff700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ce01393c0 0x7f6ce0122290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdf7fe700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce00a0a90 0x7f6ce0121810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdeffd700 1 -- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce00a0a90 msgr2=0x7f6ce0121810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdeffd700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce00a0a90 0x7f6ce0121810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdeffd700 1 -- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ce01393c0 msgr2=0x7f6ce0122290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdeffd700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ce01393c0 0x7f6ce0122290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdeffd700 1 -- 172.21.15.154:0/1371485616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009550 con 0x7f6ce00a1570 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdffff700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ce01393c0 0x7f6ce0122290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.831+0000 7f6cdeffd700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 0x7f6ce0121d50 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009c40 tx=0x7f6cd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.832+0000 7f6cc7fff700 1 -- 172.21.15.154:0/1371485616 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4004400 con 0x7f6ce00a1570 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.832+0000 7f6cc7fff700 1 -- 172.21.15.154:0/1371485616 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd401f070 con 0x7f6ce00a1570 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.832+0000 7f6cc7fff700 1 -- 172.21.15.154:0/1371485616 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40038e0 con 0x7f6ce00a1570 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.832+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/1371485616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce009b130 con 0x7f6ce00a1570 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.832+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/1371485616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce0123c10 con 0x7f6ce00a1570 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.832+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/1371485616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce004f2a0 con 0x7f6ce00a1570 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.833+0000 7f6cc7fff700 1 -- 172.21.15.154:0/1371485616 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6cd4021030 con 0x7f6ce00a1570 2023-09-30T22:29:02.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.833+0000 7f6cc7fff700 1 -- 172.21.15.154:0/1371485616 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6cd4040e90 con 0x7f6ce00a1570 2023-09-30T22:29:02.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.841+0000 7f6cc7fff700 1 -- 172.21.15.154:0/1371485616 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6cd400b9d0 con 0x7f6ce00a1570 2023-09-30T22:29:02.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.962+0000 7f82eaf14700 1 -- 172.21.15.154:0/2963508323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f82e4120180 con 0x7f82e4130bc0 2023-09-30T22:29:02.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.963+0000 7f82e17fa700 1 -- 172.21.15.154:0/2963508323 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82e4120180 con 0x7f82e4130bc0 2023-09-30T22:29:02.964 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:02.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.965+0000 7f82eaf14700 1 -- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e4130bc0 msgr2=0x7f82e411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:02.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.965+0000 7f82eaf14700 1 --2- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e4130bc0 0x7f82e411df80 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c450 tx=0x7f82d000c760 comp rx=0 tx=0).stop 2023-09-30T22:29:02.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.965+0000 7f82eaf14700 1 -- 172.21.15.154:0/2963508323 shutdown_connections 2023-09-30T22:29:02.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.965+0000 7f82eaf14700 1 --2- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f82e4133ad0 0x7f82e411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.965+0000 7f82eaf14700 1 --2- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e41300a0 0x7f82e411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.965+0000 7f82eaf14700 1 --2- 172.21.15.154:0/2963508323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e4130bc0 0x7f82e411df80 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:02.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.965+0000 7f82eaf14700 1 -- 172.21.15.154:0/2963508323 >> 172.21.15.154:0/2963508323 conn(0x7f82e4099c40 msgr2=0x7f82e4132190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:02.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.965+0000 7f82eaf14700 1 -- 172.21.15.154:0/2963508323 shutdown_connections 2023-09-30T22:29:02.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:02.965+0000 7f82eaf14700 1 -- 172.21.15.154:0/2963508323 wait complete. 2023-09-30T22:29:02.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:03.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.010+0000 7fcd0c865700 1 -- 172.21.15.154:0/4139703147 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcd08121cb0 con 0x7fcd0806b080 2023-09-30T22:29:03.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.011+0000 7fccf6ffd700 1 -- 172.21.15.154:0/4139703147 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fccfc017070 con 0x7fcd0806b080 2023-09-30T22:29:03.012 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:03.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.013+0000 7fcd0c865700 1 -- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0806b080 msgr2=0x7fcd081c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.013+0000 7fcd0c865700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0806b080 0x7fcd081c8570 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00ebb0 tx=0x7fccfc00eec0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.013+0000 7fcd0c865700 1 -- 172.21.15.154:0/4139703147 shutdown_connections 2023-09-30T22:29:03.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.013+0000 7fcd0c865700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd08131cf0 0x7fcd081c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.013+0000 7fcd0c865700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fcd0806a770 0x7fcd081c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.013+0000 7fcd0c865700 1 --2- 172.21.15.154:0/4139703147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd0806b080 0x7fcd081c8570 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.013+0000 7fcd0c865700 1 -- 172.21.15.154:0/4139703147 >> 172.21.15.154:0/4139703147 conn(0x7fcd08099c40 msgr2=0x7fcd081b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.013+0000 7fcd0c865700 1 -- 172.21.15.154:0/4139703147 shutdown_connections 2023-09-30T22:29:03.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.013+0000 7fcd0c865700 1 -- 172.21.15.154:0/4139703147 wait complete. 2023-09-30T22:29:03.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:03.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.045+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/1371485616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6ce00729d0 con 0x7f6ce00a1570 2023-09-30T22:29:03.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.045+0000 7f6cc7fff700 1 -- 172.21.15.154:0/1371485616 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6cd4015070 con 0x7f6ce00a1570 2023-09-30T22:29:03.046 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:03.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.047+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 msgr2=0x7f6ce0121d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.047+0000 7f6ce5bf3700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 0x7f6ce0121d50 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009c40 tx=0x7f6cd4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.047+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/1371485616 shutdown_connections 2023-09-30T22:29:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.047+0000 7f6ce5bf3700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ce01393c0 0x7f6ce0122290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.047+0000 7f6ce5bf3700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6ce00a0a90 0x7f6ce0121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.047+0000 7f6ce5bf3700 1 --2- 172.21.15.154:0/1371485616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce00a1570 0x7f6ce0121d50 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.047+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/1371485616 >> 172.21.15.154:0/1371485616 conn(0x7f6ce0099c40 msgr2=0x7f6ce0137c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.047+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/1371485616 shutdown_connections 2023-09-30T22:29:03.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.047+0000 7f6ce5bf3700 1 -- 172.21.15.154:0/1371485616 wait complete. 2023-09-30T22:29:03.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:03.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:03.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.812+0000 7ff74088d700 1 Processor -- start 2023-09-30T22:29:03.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.812+0000 7ff74088d700 1 -- start start 2023-09-30T22:29:03.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff74088d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09e870 0x7ff73c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff74088d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c09f180 0x7ff73c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff74088d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff73c131d70 0x7ff73c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff74088d700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73c0a0920 con 0x7ff73c131d70 2023-09-30T22:29:03.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff74088d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c09c970 con 0x7ff73c09e870 2023-09-30T22:29:03.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff74088d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c09bab0 con 0x7ff73c09f180 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff73a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09e870 0x7ff73c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff73ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff73c131d70 0x7ff73c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff739d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c09f180 0x7ff73c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff73a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09e870 0x7ff73c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55170/0 (socket says 172.21.15.154:55170) 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff73ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff73c131d70 0x7ff73c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50854/0 (socket says 172.21.15.154:50854) 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff73a59c700 1 -- 172.21.15.154:0/2575949888 learned_addr learned my addr 172.21.15.154:0/2575949888 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.813+0000 7ff739d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c09f180 0x7ff73c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41900/0 (socket says 172.21.15.154:41900) 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff739d9b700 1 -- 172.21.15.154:0/2575949888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09e870 msgr2=0x7ff73c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff739d9b700 1 --2- 172.21.15.154:0/2575949888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09e870 0x7ff73c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff739d9b700 1 -- 172.21.15.154:0/2575949888 >> v2:172.21.15.154:3300/0 conn(0x7ff73c131d70 msgr2=0x7ff73c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:03.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff739d9b700 1 --2- 172.21.15.154:0/2575949888 >> v2:172.21.15.154:3300/0 conn(0x7ff73c131d70 0x7ff73c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff739d9b700 1 -- 172.21.15.154:0/2575949888 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c09f9c0 con 0x7ff73c09f180 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff73a59c700 1 --2- 172.21.15.154:0/2575949888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09e870 0x7ff73c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff73ad9d700 1 --2- 172.21.15.154:0/2575949888 >> v2:172.21.15.154:3300/0 conn(0x7ff73c131d70 0x7ff73c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff739d9b700 1 --2- 172.21.15.154:0/2575949888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c09f180 0x7ff73c131830 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009840 tx=0x7ff72c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2042e51c8e947421 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff73959a700 1 -- 172.21.15.154:0/2575949888 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c011830 con 0x7ff73c09f180 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff73959a700 1 -- 172.21.15.154:0/2575949888 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c011990 con 0x7ff73c09f180 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff73959a700 1 -- 172.21.15.154:0/2575949888 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c011d20 con 0x7ff73c09f180 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff74088d700 1 -- 172.21.15.154:0/2575949888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c09f180 msgr2=0x7ff73c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.814+0000 7ff74088d700 1 --2- 172.21.15.154:0/2575949888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c09f180 0x7ff73c131830 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009840 tx=0x7ff72c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:03.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.815+0000 7ff74088d700 1 -- 172.21.15.154:0/2575949888 shutdown_connections 2023-09-30T22:29:03.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.815+0000 7ff74088d700 1 --2- 172.21.15.154:0/2575949888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09e870 0x7ff73c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.815+0000 7ff74088d700 1 --2- 172.21.15.154:0/2575949888 >> v2:172.21.15.154:3300/0 conn(0x7ff73c131d70 0x7ff73c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.815+0000 7ff74088d700 1 --2- 172.21.15.154:0/2575949888 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c09f180 0x7ff73c131830 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.815+0000 7ff74088d700 1 -- 172.21.15.154:0/2575949888 >> 172.21.15.154:0/2575949888 conn(0x7ff73c0a4430 msgr2=0x7ff73c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:03.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.815+0000 7ff74088d700 1 -- 172.21.15.154:0/2575949888 shutdown_connections 2023-09-30T22:29:03.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.815+0000 7ff74088d700 1 -- 172.21.15.154:0/2575949888 wait complete. 2023-09-30T22:29:03.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff74088d700 1 Processor -- start 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff74088d700 1 -- start start 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff74088d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c09e870 0x7ff73c11f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff74088d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09f180 0x7ff73c11f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff74088d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c131d70 0x7ff73c11fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff74088d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c122ae0 con 0x7ff73c09e870 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff74088d700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c122cc0 con 0x7ff73c09f180 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff74088d700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0a2cd0 con 0x7ff73c131d70 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c131d70 0x7ff73c11fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73a59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c09e870 0x7ff73c11f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff739d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09f180 0x7ff73c11f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73ad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c131d70 0x7ff73c11fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41902/0 (socket says 172.21.15.154:41902) 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73ad9d700 1 -- 172.21.15.154:0/4275241810 learned_addr learned my addr 172.21.15.154:0/4275241810 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73ad9d700 1 -- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09f180 msgr2=0x7ff73c11f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73ad9d700 1 --2- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09f180 0x7ff73c11f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73ad9d700 1 -- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c09e870 msgr2=0x7ff73c11f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73ad9d700 1 --2- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c09e870 0x7ff73c11f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73ad9d700 1 -- 172.21.15.154:0/4275241810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009550 con 0x7ff73c131d70 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff739d9b700 1 --2- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09f180 0x7ff73c11f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.816+0000 7ff73a59c700 1 --2- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c09e870 0x7ff73c11f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.817+0000 7ff73ad9d700 1 --2- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c131d70 0x7ff73c11fce0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff734009f00 tx=0x7ff73400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.817+0000 7ff72affd700 1 -- 172.21.15.154:0/4275241810 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734009d70 con 0x7ff73c131d70 2023-09-30T22:29:03.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.817+0000 7ff72affd700 1 -- 172.21.15.154:0/4275241810 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73400f040 con 0x7ff73c131d70 2023-09-30T22:29:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.817+0000 7ff74088d700 1 -- 172.21.15.154:0/4275241810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff734009a70 con 0x7ff73c131d70 2023-09-30T22:29:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.817+0000 7ff72affd700 1 -- 172.21.15.154:0/4275241810 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73400cd60 con 0x7ff73c131d70 2023-09-30T22:29:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.817+0000 7ff74088d700 1 -- 172.21.15.154:0/4275241810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c0094a0 con 0x7ff73c131d70 2023-09-30T22:29:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.818+0000 7ff72affd700 1 -- 172.21.15.154:0/4275241810 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff734014480 con 0x7ff73c131d70 2023-09-30T22:29:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.818+0000 7ff72affd700 1 -- 172.21.15.154:0/4275241810 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff73403fd30 con 0x7ff73c131d70 2023-09-30T22:29:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.818+0000 7ff74088d700 1 -- 172.21.15.154:0/4275241810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c1206f0 con 0x7ff73c131d70 2023-09-30T22:29:03.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:03.823+0000 7ff72affd700 1 -- 172.21.15.154:0/4275241810 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff73c1206f0 con 0x7ff73c131d70 2023-09-30T22:29:03.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:04.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.010+0000 7ff74088d700 1 -- 172.21.15.154:0/4275241810 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff73c1206f0 con 0x7ff73c131d70 2023-09-30T22:29:04.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.010+0000 7ff72affd700 1 -- 172.21.15.154:0/4275241810 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff73c1206f0 con 0x7ff73c131d70 2023-09-30T22:29:04.011 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:04.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.012+0000 7ff74088d700 1 -- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c131d70 msgr2=0x7ff73c11fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.012+0000 7ff74088d700 1 --2- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c131d70 0x7ff73c11fce0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff734009f00 tx=0x7ff73400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.012+0000 7ff74088d700 1 -- 172.21.15.154:0/4275241810 shutdown_connections 2023-09-30T22:29:04.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.012+0000 7ff74088d700 1 --2- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff73c131d70 0x7ff73c11fce0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.012+0000 7ff74088d700 1 --2- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c09e870 0x7ff73c11f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.012+0000 7ff74088d700 1 --2- 172.21.15.154:0/4275241810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73c09f180 0x7ff73c11f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.012+0000 7ff74088d700 1 -- 172.21.15.154:0/4275241810 >> 172.21.15.154:0/4275241810 conn(0x7ff73c0a4430 msgr2=0x7ff73c0719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.012+0000 7ff74088d700 1 -- 172.21.15.154:0/4275241810 shutdown_connections 2023-09-30T22:29:04.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.012+0000 7ff74088d700 1 -- 172.21.15.154:0/4275241810 wait complete. 2023-09-30T22:29:04.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:04.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:04.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:04.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.106+0000 7f2d4942b700 1 Processor -- start 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.106+0000 7f2d4942b700 1 -- start start 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.106+0000 7f2d4942b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d4409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.106+0000 7f2d4942b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d44130eb0 0x7f2d44138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.106+0000 7f2d4942b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4409aaa0 con 0x7f2d4409e170 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.106+0000 7f2d4942b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4409f870 con 0x7f2d44130eb0 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.106+0000 7f2d4942b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4409b360 con 0x7f2d4409d860 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d437fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d44130eb0 0x7f2d44138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d437fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2d44130eb0 0x7f2d44138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50878/0 (socket says 172.21.15.154:50878) 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d437fe700 1 -- 172.21.15.154:0/965317256 learned_addr learned my addr 172.21.15.154:0/965317256 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:04.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d42ffd700 1 --2- 172.21.15.154:0/965317256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d4409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d437fe700 1 -- 172.21.15.154:0/965317256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 msgr2=0x7f2d4409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d437fe700 1 --2- 172.21.15.154:0/965317256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d4409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d437fe700 1 -- 172.21.15.154:0/965317256 >> v1:172.21.15.154:6789/0 conn(0x7f2d4409e170 legacy=0x7f2d441307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d437fe700 1 -- 172.21.15.154:0/965317256 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4409b620 con 0x7f2d44130eb0 2023-09-30T22:29:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d41ffb700 1 -- 172.21.15.154:0/965317256 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004076419 0 0) 0x7f2d4409aaa0 con 0x7f2d4409e170 2023-09-30T22:29:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d42ffd700 1 --2- 172.21.15.154:0/965317256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d4409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d437fe700 1 --2- 172.21.15.154:0/965317256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d44130eb0 0x7f2d44138a00 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00d150 tx=0x7f2d3c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c336b240eb09e0df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d41ffb700 1 -- 172.21.15.154:0/965317256 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c010070 con 0x7f2d44130eb0 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d41ffb700 1 -- 172.21.15.154:0/965317256 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c00dd10 con 0x7f2d44130eb0 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.107+0000 7f2d41ffb700 1 -- 172.21.15.154:0/965317256 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c00b310 con 0x7f2d44130eb0 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.108+0000 7f2d4942b700 1 -- 172.21.15.154:0/965317256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d44130eb0 msgr2=0x7f2d44138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.108+0000 7f2d4942b700 1 --2- 172.21.15.154:0/965317256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d44130eb0 0x7f2d44138a00 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00d150 tx=0x7f2d3c00d460 comp rx=0 tx=0).stop 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.108+0000 7f2d4942b700 1 -- 172.21.15.154:0/965317256 shutdown_connections 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.108+0000 7f2d4942b700 1 --2- 172.21.15.154:0/965317256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d44130eb0 0x7f2d44138a00 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.108+0000 7f2d4942b700 1 --2- 172.21.15.154:0/965317256 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d4409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.108+0000 7f2d4942b700 1 -- 172.21.15.154:0/965317256 >> 172.21.15.154:0/965317256 conn(0x7f2d44099c40 msgr2=0x7f2d440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.108+0000 7f2d4942b700 1 -- 172.21.15.154:0/965317256 shutdown_connections 2023-09-30T22:29:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.108+0000 7f2d4942b700 1 -- 172.21.15.154:0/965317256 wait complete. 2023-09-30T22:29:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d4942b700 1 Processor -- start 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d4942b700 1 -- start start 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d4942b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d44122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d4942b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d4409e170 0x7f2d44122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d4942b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d44130eb0 0x7f2d44123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d4942b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44124450 con 0x7f2d44130eb0 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d4942b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44124b50 con 0x7f2d4409d860 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d4942b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44126200 con 0x7f2d4409e170 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d42ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d44122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.110+0000 7f2d42ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d44122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55200/0 (socket says 172.21.15.154:55200) 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d42ffd700 1 -- 172.21.15.154:0/1469420312 learned_addr learned my addr 172.21.15.154:0/1469420312 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d437fe700 1 --2- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d44130eb0 0x7f2d44123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d42ffd700 1 -- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d4409e170 msgr2=0x7f2d44122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d42ffd700 1 --2- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d4409e170 0x7f2d44122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d42ffd700 1 -- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d44130eb0 msgr2=0x7f2d44123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d42ffd700 1 --2- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d44130eb0 0x7f2d44123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d42ffd700 1 -- 172.21.15.154:0/1469420312 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340094a0 con 0x7f2d4409d860 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d42ffd700 1 --2- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d44122800 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400ebe0 tx=0x7f2d3400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d2b7fe700 1 -- 172.21.15.154:0/1469420312 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400c910 con 0x7f2d4409d860 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d2b7fe700 1 -- 172.21.15.154:0/1469420312 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3400ca70 con 0x7f2d4409d860 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d4942b700 1 -- 172.21.15.154:0/1469420312 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c00bd40 con 0x7f2d4409d860 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d2b7fe700 1 -- 172.21.15.154:0/1469420312 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400cde0 con 0x7f2d4409d860 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.111+0000 7f2d4942b700 1 -- 172.21.15.154:0/1469420312 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4409c8b0 con 0x7f2d4409d860 2023-09-30T22:29:04.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.112+0000 7f2d2b7fe700 1 -- 172.21.15.154:0/1469420312 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d34013470 con 0x7f2d4409d860 2023-09-30T22:29:04.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.112+0000 7f2d4942b700 1 -- 172.21.15.154:0/1469420312 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4404f2a0 con 0x7f2d4409d860 2023-09-30T22:29:04.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.112+0000 7f2d2b7fe700 1 -- 172.21.15.154:0/1469420312 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d3403fc10 con 0x7f2d4409d860 2023-09-30T22:29:04.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.117+0000 7f2d2b7fe700 1 -- 172.21.15.154:0/1469420312 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d3401b3b0 con 0x7f2d4409d860 2023-09-30T22:29:04.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.193+0000 7f8d5f1c4700 1 Processor -- start 2023-09-30T22:29:04.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.193+0000 7f8d5f1c4700 1 -- start start 2023-09-30T22:29:04.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.193+0000 7f7518cab700 1 Processor -- start 2023-09-30T22:29:04.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.193+0000 7f7518cab700 1 -- start start 2023-09-30T22:29:04.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5f1c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d58131a80 0x7f8d58131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5f1c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d5809c7d0 0x7f8d58139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5f1c4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d580a23a0 con 0x7f8d5809bc70 2023-09-30T22:29:04.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5f1c4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58131440 con 0x7f8d58131a80 2023-09-30T22:29:04.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5f1c4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58132390 con 0x7f8d5809c7d0 2023-09-30T22:29:04.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5cf60700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d58131a80 0x7f8d58131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5cf60700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d58131a80 0x7f8d58131e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55212/0 (socket says 172.21.15.154:55212) 2023-09-30T22:29:04.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5cf60700 1 -- 172.21.15.154:0/2908233143 learned_addr learned my addr 172.21.15.154:0/2908233143 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:04.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5d761700 1 --2- 172.21.15.154:0/2908233143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d5809c7d0 0x7f8d58139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7518cab700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 0x7f75140a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7518cab700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75140667e0 0x7f75140a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7518cab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 0x7f751412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7518cab700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75140a1e70 con 0x7f75140667e0 2023-09-30T22:29:04.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7518cab700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751409a720 con 0x7f75140a14b0 2023-09-30T22:29:04.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7518cab700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f751409b300 con 0x7f7514066410 2023-09-30T22:29:04.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5d761700 1 -- 172.21.15.154:0/2908233143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d58131a80 msgr2=0x7f8d58131e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5d761700 1 --2- 172.21.15.154:0/2908233143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d58131a80 0x7f8d58131e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5d761700 1 -- 172.21.15.154:0/2908233143 >> v1:172.21.15.154:6789/0 conn(0x7f8d5809bc70 legacy=0x7f8d5809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f8d5d761700 1 -- 172.21.15.154:0/2908233143 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5806eaa0 con 0x7f8d5809c7d0 2023-09-30T22:29:04.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7511d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75140667e0 0x7f75140a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7512d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 0x7f751412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7511d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75140667e0 0x7f75140a0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50892/0 (socket says 172.21.15.154:50892) 2023-09-30T22:29:04.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f7511d9b700 1 -- 172.21.15.154:0/2184074522 learned_addr learned my addr 172.21.15.154:0/2184074522 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:04.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.194+0000 7f751259c700 1 --2- 172.21.15.154:0/2184074522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 0x7f75140a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f8d5d761700 1 --2- 172.21.15.154:0/2908233143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d5809c7d0 0x7f8d58139780 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009dc0 tx=0x7f8d5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da470ffb75c0a0f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f751259c700 1 -- 172.21.15.154:0/2184074522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 msgr2=0x7f751412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f751259c700 1 --2- 172.21.15.154:0/2184074522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 0x7f751412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f751259c700 1 -- 172.21.15.154:0/2184074522 >> v2:172.21.15.154:3300/0 conn(0x7f75140667e0 msgr2=0x7f75140a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:04.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f751259c700 1 --2- 172.21.15.154:0/2184074522 >> v2:172.21.15.154:3300/0 conn(0x7f75140667e0 0x7f75140a0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f751259c700 1 -- 172.21.15.154:0/2184074522 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751409abc0 con 0x7f7514066410 2023-09-30T22:29:04.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f8d577fe700 1 -- 172.21.15.154:0/2908233143 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5000e070 con 0x7f8d5809c7d0 2023-09-30T22:29:04.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f7512d9d700 1 --2- 172.21.15.154:0/2184074522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 0x7f751412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:04.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f8d577fe700 1 -- 172.21.15.154:0/2908233143 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5000bb20 con 0x7f8d5809c7d0 2023-09-30T22:29:04.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f8d577fe700 1 -- 172.21.15.154:0/2908233143 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50012430 con 0x7f8d5809c7d0 2023-09-30T22:29:04.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f751259c700 1 --2- 172.21.15.154:0/2184074522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 0x7f75140a0a30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7504009820 tx=0x7f7504009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b457c00108b8e47 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f751159a700 1 -- 172.21.15.154:0/2184074522 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504005e30 con 0x7f7514066410 2023-09-30T22:29:04.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f751159a700 1 -- 172.21.15.154:0/2184074522 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504006030 con 0x7f7514066410 2023-09-30T22:29:04.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.195+0000 7f751159a700 1 -- 172.21.15.154:0/2184074522 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75040063c0 con 0x7f7514066410 2023-09-30T22:29:04.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f7518cab700 1 -- 172.21.15.154:0/2184074522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 msgr2=0x7f75140a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f7518cab700 1 --2- 172.21.15.154:0/2184074522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 0x7f75140a0a30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7504009820 tx=0x7f7504009b30 comp rx=0 tx=0).stop 2023-09-30T22:29:04.202 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/2908233143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d5809c7d0 msgr2=0x7f8d58139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f8d5f1c4700 1 --2- 172.21.15.154:0/2908233143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d5809c7d0 0x7f8d58139780 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009dc0 tx=0x7f8d5000b330 comp rx=0 tx=0).stop 2023-09-30T22:29:04.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f7518cab700 1 -- 172.21.15.154:0/2184074522 shutdown_connections 2023-09-30T22:29:04.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f7518cab700 1 --2- 172.21.15.154:0/2184074522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 0x7f751412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f7518cab700 1 --2- 172.21.15.154:0/2184074522 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 0x7f75140a0a30 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f7518cab700 1 --2- 172.21.15.154:0/2184074522 >> v2:172.21.15.154:3300/0 conn(0x7f75140667e0 0x7f75140a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f7518cab700 1 -- 172.21.15.154:0/2184074522 >> 172.21.15.154:0/2184074522 conn(0x7f75140a2980 msgr2=0x7f75140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/2908233143 shutdown_connections 2023-09-30T22:29:04.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f8d5f1c4700 1 --2- 172.21.15.154:0/2908233143 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d5809c7d0 0x7f8d58139780 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f8d5f1c4700 1 --2- 172.21.15.154:0/2908233143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d58131a80 0x7f8d58131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/2908233143 >> 172.21.15.154:0/2908233143 conn(0x7f8d580a2980 msgr2=0x7f8d580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/2908233143 shutdown_connections 2023-09-30T22:29:04.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f7518cab700 1 -- 172.21.15.154:0/2184074522 shutdown_connections 2023-09-30T22:29:04.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f7518cab700 1 -- 172.21.15.154:0/2184074522 wait complete. 2023-09-30T22:29:04.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.196+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/2908233143 wait complete. 2023-09-30T22:29:04.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.197+0000 7f7518cab700 1 Processor -- start 2023-09-30T22:29:04.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.197+0000 7f7518cab700 1 -- start start 2023-09-30T22:29:04.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.197+0000 7f8d5f1c4700 1 Processor -- start 2023-09-30T22:29:04.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.197+0000 7f8d5f1c4700 1 -- start start 2023-09-30T22:29:04.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7518cab700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 0x7f75141c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7518cab700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140667e0 0x7f75141c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7518cab700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 0x7f75141c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7518cab700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75141a9ab0 con 0x7f75140667e0 2023-09-30T22:29:04.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7518cab700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75141aa380 con 0x7f75140a14b0 2023-09-30T22:29:04.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7518cab700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75141ab9c0 con 0x7f7514066410 2023-09-30T22:29:04.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7511d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140667e0 0x7f75141c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7511d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140667e0 0x7f75141c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50904/0 (socket says 172.21.15.154:50904) 2023-09-30T22:29:04.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7511d9b700 1 -- 172.21.15.154:0/1696388163 learned_addr learned my addr 172.21.15.154:0/1696388163 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:04.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7512d9d700 1 --2- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 0x7f75141c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7511d9b700 1 -- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 msgr2=0x7f75141c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7511d9b700 1 --2- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 0x7f75141c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7511d9b700 1 -- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 msgr2=0x7f75141c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7511d9b700 1 --2- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 0x7f75141c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7511d9b700 1 -- 172.21.15.154:0/1696388163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c009a70 con 0x7f75140667e0 2023-09-30T22:29:04.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7511d9b700 1 --2- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140667e0 0x7f75141c8770 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f750800ed20 tx=0x7f750800d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7502ffd700 1 -- 172.21.15.154:0/1696388163 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750800de40 con 0x7f75140667e0 2023-09-30T22:29:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5f1c4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d5809bc70 0x7f8d5811b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5f1c4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d5809c7d0 0x7f8d5811bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5f1c4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d58131a80 0x7f8d5811c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5f1c4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5811d990 con 0x7f8d5809bc70 2023-09-30T22:29:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5f1c4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5811f250 con 0x7f8d5809c7d0 2023-09-30T22:29:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5f1c4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5811e620 con 0x7f8d58131a80 2023-09-30T22:29:04.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5d761700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d58131a80 0x7f8d5811c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5cf60700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d5809bc70 0x7f8d5811b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5d761700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d58131a80 0x7f8d5811c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41948/0 (socket says 172.21.15.154:41948) 2023-09-30T22:29:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d57fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d5809c7d0 0x7f8d5811bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f8d5d761700 1 -- 172.21.15.154:0/3271859923 learned_addr learned my addr 172.21.15.154:0/3271859923 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.198+0000 7f7502ffd700 1 -- 172.21.15.154:0/1696388163 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750800be70 con 0x7f75140667e0 2023-09-30T22:29:04.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f7502ffd700 1 -- 172.21.15.154:0/1696388163 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508010640 con 0x7f75140667e0 2023-09-30T22:29:04.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f7518cab700 1 -- 172.21.15.154:0/1696388163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7504009430 con 0x7f75140667e0 2023-09-30T22:29:04.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f7518cab700 1 -- 172.21.15.154:0/1696388163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75141ab6e0 con 0x7f75140667e0 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f8d5cf60700 1 -- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d58131a80 msgr2=0x7f8d5811c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f8d5cf60700 1 --2- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d58131a80 0x7f8d5811c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f8d5cf60700 1 -- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d5809c7d0 msgr2=0x7f8d5811bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f8d5cf60700 1 --2- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d5809c7d0 0x7f8d5811bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f8d5cf60700 1 -- 172.21.15.154:0/3271859923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50009a70 con 0x7f8d5809bc70 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f8d5d761700 1 --2- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d58131a80 0x7f8d5811c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.199+0000 7f8d5cf60700 1 --2- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d5809bc70 0x7f8d5811b780 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00e820 tx=0x7f8d4c00eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.200+0000 7f8d557fa700 1 -- 172.21.15.154:0/3271859923 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c013980 con 0x7f8d5809bc70 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.200+0000 7f8d557fa700 1 -- 172.21.15.154:0/3271859923 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c013ae0 con 0x7f8d5809bc70 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.200+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/3271859923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5811cbe0 con 0x7f8d5809bc70 2023-09-30T22:29:04.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.200+0000 7f8d557fa700 1 -- 172.21.15.154:0/3271859923 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c013e50 con 0x7f8d5809bc70 2023-09-30T22:29:04.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.200+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/3271859923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5811d340 con 0x7f8d5809bc70 2023-09-30T22:29:04.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.200+0000 7f7502ffd700 1 -- 172.21.15.154:0/1696388163 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75080107a0 con 0x7f75140667e0 2023-09-30T22:29:04.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.200+0000 7f7502ffd700 1 -- 172.21.15.154:0/1696388163 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f750803fef0 con 0x7f75140667e0 2023-09-30T22:29:04.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.200+0000 7f7518cab700 1 -- 172.21.15.154:0/1696388163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75141aa060 con 0x7f75140667e0 2023-09-30T22:29:04.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.201+0000 7f8d557fa700 1 -- 172.21.15.154:0/3271859923 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d4c01b440 con 0x7f8d5809bc70 2023-09-30T22:29:04.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.201+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/3271859923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5804f2a0 con 0x7f8d5809bc70 2023-09-30T22:29:04.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.201+0000 7f8d557fa700 1 -- 172.21.15.154:0/3271859923 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d4c0434b0 con 0x7f8d5809bc70 2023-09-30T22:29:04.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.205+0000 7f7502ffd700 1 -- 172.21.15.154:0/1696388163 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f750801d020 con 0x7f75140667e0 2023-09-30T22:29:04.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.209+0000 7f8d557fa700 1 -- 172.21.15.154:0/3271859923 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d4c071750 con 0x7f8d5809bc70 2023-09-30T22:29:04.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.313+0000 7f2d4942b700 1 -- 172.21.15.154:0/1469420312 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d44125f80 con 0x7f2d4409d860 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.314+0000 7f2d2b7fe700 1 -- 172.21.15.154:0/1469420312 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d34017030 con 0x7f2d4409d860 2023-09-30T22:29:04.315 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.316+0000 7f2d4942b700 1 -- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 msgr2=0x7f2d44122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.316+0000 7f2d4942b700 1 --2- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d44122800 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400ebe0 tx=0x7f2d3400eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.316+0000 7f2d4942b700 1 -- 172.21.15.154:0/1469420312 shutdown_connections 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.316+0000 7f2d4942b700 1 --2- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d44130eb0 0x7f2d44123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.316+0000 7f2d4942b700 1 --2- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d4409d860 0x7f2d44122800 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.316+0000 7f2d4942b700 1 --2- 172.21.15.154:0/1469420312 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f2d4409e170 0x7f2d44122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.316+0000 7f2d4942b700 1 -- 172.21.15.154:0/1469420312 >> 172.21.15.154:0/1469420312 conn(0x7f2d44099c40 msgr2=0x7f2d440a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.316+0000 7f2d4942b700 1 -- 172.21.15.154:0/1469420312 shutdown_connections 2023-09-30T22:29:04.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.316+0000 7f2d4942b700 1 -- 172.21.15.154:0/1469420312 wait complete. 2023-09-30T22:29:04.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:04.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.398+0000 7f7518cab700 1 -- 172.21.15.154:0/1696388163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f751404f2a0 con 0x7f75140667e0 2023-09-30T22:29:04.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.398+0000 7f7502ffd700 1 -- 172.21.15.154:0/1696388163 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7508017540 con 0x7f75140667e0 2023-09-30T22:29:04.400 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:04.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.400+0000 7f7518cab700 1 -- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140667e0 msgr2=0x7f75141c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.400+0000 7f7518cab700 1 --2- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140667e0 0x7f75141c8770 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f750800ed20 tx=0x7f750800d630 comp rx=0 tx=0).stop 2023-09-30T22:29:04.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.400+0000 7f7518cab700 1 -- 172.21.15.154:0/1696388163 shutdown_connections 2023-09-30T22:29:04.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.400+0000 7f7518cab700 1 --2- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75140a14b0 0x7f75141c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.401+0000 7f7518cab700 1 --2- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f7514066410 0x7f75141c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.401+0000 7f7518cab700 1 --2- 172.21.15.154:0/1696388163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75140667e0 0x7f75141c8770 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.401+0000 7f7518cab700 1 -- 172.21.15.154:0/1696388163 >> 172.21.15.154:0/1696388163 conn(0x7f75140a2980 msgr2=0x7f751419db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.401+0000 7f7518cab700 1 -- 172.21.15.154:0/1696388163 shutdown_connections 2023-09-30T22:29:04.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.401+0000 7f7518cab700 1 -- 172.21.15.154:0/1696388163 wait complete. 2023-09-30T22:29:04.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.403+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/3271859923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d5806bce0 con 0x7f8d5809bc70 2023-09-30T22:29:04.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.404+0000 7f8d557fa700 1 -- 172.21.15.154:0/3271859923 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d4c020030 con 0x7f8d5809bc70 2023-09-30T22:29:04.405 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.406+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d5809bc70 msgr2=0x7f8d5811b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.406+0000 7f8d5f1c4700 1 --2- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d5809bc70 0x7f8d5811b780 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00e820 tx=0x7f8d4c00eb30 comp rx=0 tx=0).stop 2023-09-30T22:29:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.406+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/3271859923 shutdown_connections 2023-09-30T22:29:04.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.406+0000 7f8d5f1c4700 1 --2- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8d58131a80 0x7f8d5811c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.406+0000 7f8d5f1c4700 1 --2- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d5809bc70 0x7f8d5811b780 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.406+0000 7f8d5f1c4700 1 --2- 172.21.15.154:0/3271859923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d5809c7d0 0x7f8d5811bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:04.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.406+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/3271859923 >> 172.21.15.154:0/3271859923 conn(0x7f8d580a2980 msgr2=0x7f8d581b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:04.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.406+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/3271859923 shutdown_connections 2023-09-30T22:29:04.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:04.406+0000 7f8d5f1c4700 1 -- 172.21.15.154:0/3271859923 wait complete. 2023-09-30T22:29:04.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:04.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:05.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:05.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.155+0000 7f4336e47700 1 Processor -- start 2023-09-30T22:29:05.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.155+0000 7f4336e47700 1 -- start start 2023-09-30T22:29:05.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.155+0000 7f4336e47700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330099e20 0x7f433009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.155+0000 7f4336e47700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330130a60 0x7f4330138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.155+0000 7f4336e47700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4330099a60 con 0x7f433009a730 2023-09-30T22:29:05.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.155+0000 7f4336e47700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433009bf50 con 0x7f4330099e20 2023-09-30T22:29:05.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.155+0000 7f4336e47700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f433009b230 con 0x7f4330130a60 2023-09-30T22:29:05.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f432ffff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f433009a730 0x7f4330130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47184/0 (socket says 172.21.15.154:47184) 2023-09-30T22:29:05.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f432ffff700 1 -- 172.21.15.154:0/724612037 learned_addr learned my addr 172.21.15.154:0/724612037 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:29:05.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f43353e4700 1 --2- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330130a60 0x7f4330138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f4334be3700 1 --2- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330099e20 0x7f433009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f4334be3700 1 -- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330130a60 msgr2=0x7f4330138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f4334be3700 1 --2- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330130a60 0x7f4330138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f4334be3700 1 -- 172.21.15.154:0/724612037 >> v1:172.21.15.154:6789/0 conn(0x7f433009a730 legacy=0x7f4330130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f432f7fe700 1 -- 172.21.15.154:0/724612037 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347145689 0 0) 0x7f4330099a60 con 0x7f433009a730 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f4334be3700 1 -- 172.21.15.154:0/724612037 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433009bb90 con 0x7f4330099e20 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f43353e4700 1 --2- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330130a60 0x7f4330138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f4334be3700 1 --2- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330099e20 0x7f433009a1f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f432400dc70 tx=0x7f432400df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e3eaa454f413674 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f432f7fe700 1 -- 172.21.15.154:0/724612037 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324012070 con 0x7f4330099e20 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f432f7fe700 1 -- 172.21.15.154:0/724612037 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324005a20 con 0x7f4330099e20 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.156+0000 7f432f7fe700 1 -- 172.21.15.154:0/724612037 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324005db0 con 0x7f4330099e20 2023-09-30T22:29:05.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.157+0000 7f4336e47700 1 -- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330099e20 msgr2=0x7f433009a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.157+0000 7f4336e47700 1 --2- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330099e20 0x7f433009a1f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f432400dc70 tx=0x7f432400df80 comp rx=0 tx=0).stop 2023-09-30T22:29:05.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.157+0000 7f4336e47700 1 -- 172.21.15.154:0/724612037 shutdown_connections 2023-09-30T22:29:05.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.157+0000 7f4336e47700 1 --2- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330130a60 0x7f4330138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.157+0000 7f4336e47700 1 --2- 172.21.15.154:0/724612037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330099e20 0x7f433009a1f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.157+0000 7f4336e47700 1 -- 172.21.15.154:0/724612037 >> 172.21.15.154:0/724612037 conn(0x7f43300a2980 msgr2=0x7f43300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.157+0000 7f4336e47700 1 -- 172.21.15.154:0/724612037 shutdown_connections 2023-09-30T22:29:05.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.157+0000 7f4336e47700 1 -- 172.21.15.154:0/724612037 wait complete. 2023-09-30T22:29:05.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4336e47700 1 Processor -- start 2023-09-30T22:29:05.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4336e47700 1 -- start start 2023-09-30T22:29:05.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4336e47700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330099e20 0x7f433011a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4336e47700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f433009a730 0x7f433011af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4336e47700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330130a60 0x7f433011b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4336e47700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433011c4d0 con 0x7f433009a730 2023-09-30T22:29:05.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4336e47700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433009b470 con 0x7f4330130a60 2023-09-30T22:29:05.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4336e47700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f433011e100 con 0x7f4330099e20 2023-09-30T22:29:05.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4334be3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330099e20 0x7f433011a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4334be3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330099e20 0x7f433011a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:41968/0 (socket says 172.21.15.154:41968) 2023-09-30T22:29:05.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f4334be3700 1 -- 172.21.15.154:0/847283418 learned_addr learned my addr 172.21.15.154:0/847283418 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:05.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f43353e4700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330130a60 0x7f433011b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.158+0000 7f432ffff700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f433009a730 0x7f433011af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f4334be3700 1 -- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330130a60 msgr2=0x7f433011b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f4334be3700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330130a60 0x7f433011b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f4334be3700 1 -- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f433009a730 msgr2=0x7f433011af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f4334be3700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f433009a730 0x7f433011af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f4334be3700 1 -- 172.21.15.154:0/847283418 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432800ba90 con 0x7f4330099e20 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f43353e4700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330130a60 0x7f433011b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f432ffff700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f433009a730 0x7f433011af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f4334be3700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330099e20 0x7f433011a9c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4324000c00 tx=0x7f4324004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f432d7fa700 1 -- 172.21.15.154:0/847283418 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324006ee0 con 0x7f4330099e20 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f432d7fa700 1 -- 172.21.15.154:0/847283418 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324010cb0 con 0x7f4330099e20 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f432d7fa700 1 -- 172.21.15.154:0/847283418 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240036a0 con 0x7f4330099e20 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f4336e47700 1 -- 172.21.15.154:0/847283418 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432400d8d0 con 0x7f4330099e20 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.159+0000 7f4336e47700 1 -- 172.21.15.154:0/847283418 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433011d720 con 0x7f4330099e20 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.160+0000 7f432d7fa700 1 -- 172.21.15.154:0/847283418 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f432401d070 con 0x7f4330099e20 2023-09-30T22:29:05.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.160+0000 7f432d7fa700 1 -- 172.21.15.154:0/847283418 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4324044360 con 0x7f4330099e20 2023-09-30T22:29:05.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.160+0000 7f4336e47700 1 -- 172.21.15.154:0/847283418 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4330072480 con 0x7f4330099e20 2023-09-30T22:29:05.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.164+0000 7f432d7fa700 1 -- 172.21.15.154:0/847283418 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4330072480 con 0x7f4330099e20 2023-09-30T22:29:05.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:05.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.350+0000 7f4336e47700 1 -- 172.21.15.154:0/847283418 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4330072480 con 0x7f4330099e20 2023-09-30T22:29:05.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.351+0000 7f432d7fa700 1 -- 172.21.15.154:0/847283418 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4330072480 con 0x7f4330099e20 2023-09-30T22:29:05.352 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.353+0000 7f4336e47700 1 -- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330099e20 msgr2=0x7f433011a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.353+0000 7f4336e47700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330099e20 0x7f433011a9c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4324000c00 tx=0x7f4324004750 comp rx=0 tx=0).stop 2023-09-30T22:29:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.353+0000 7f4336e47700 1 -- 172.21.15.154:0/847283418 shutdown_connections 2023-09-30T22:29:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.353+0000 7f4336e47700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330130a60 0x7f433011b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.353+0000 7f4336e47700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4330099e20 0x7f433011a9c0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.353+0000 7f4336e47700 1 --2- 172.21.15.154:0/847283418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f433009a730 0x7f433011af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.353+0000 7f4336e47700 1 -- 172.21.15.154:0/847283418 >> 172.21.15.154:0/847283418 conn(0x7f43300a2980 msgr2=0x7f433012d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.353+0000 7f4336e47700 1 -- 172.21.15.154:0/847283418 shutdown_connections 2023-09-30T22:29:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.353+0000 7f4336e47700 1 -- 172.21.15.154:0/847283418 wait complete. 2023-09-30T22:29:05.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:05.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:05.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.455+0000 7f8cd0df4700 1 Processor -- start 2023-09-30T22:29:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.455+0000 7f8cd0df4700 1 -- start start 2023-09-30T22:29:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.455+0000 7f8cd0df4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.455+0000 7f8cd0df4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc0a1380 0x7f8ccc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.455+0000 7f8cd0df4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc09dc00 con 0x7f8ccc133f50 2023-09-30T22:29:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.455+0000 7f8cd0df4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc09ea60 con 0x7f8ccc0a0a70 2023-09-30T22:29:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.455+0000 7f8cd0df4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc09dec0 con 0x7f8ccc0a1380 2023-09-30T22:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cc9d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc0a1380 0x7f8ccc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cca59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cca59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51206/0 (socket says 172.21.15.154:51206) 2023-09-30T22:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8ccad9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8ccc133f50 0x7f8ccc13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54394/0 (socket says 172.21.15.154:54394) 2023-09-30T22:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cc9d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc0a1380 0x7f8ccc133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55200/0 (socket says 172.21.15.154:55200) 2023-09-30T22:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cca59c700 1 -- 172.21.15.154:0/3838190564 learned_addr learned my addr 172.21.15.154:0/3838190564 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cca59c700 1 -- 172.21.15.154:0/3838190564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc0a1380 msgr2=0x7f8ccc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cca59c700 1 --2- 172.21.15.154:0/3838190564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc0a1380 0x7f8ccc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cca59c700 1 -- 172.21.15.154:0/3838190564 >> v1:172.21.15.154:6789/0 conn(0x7f8ccc133f50 legacy=0x7f8ccc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cca59c700 1 -- 172.21.15.154:0/3838190564 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc09e6a0 con 0x7f8ccc0a0a70 2023-09-30T22:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cc959a700 1 -- 172.21.15.154:0/3838190564 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931881018 0 0) 0x7f8ccc09dc00 con 0x7f8ccc133f50 2023-09-30T22:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cca59c700 1 --2- 172.21.15.154:0/3838190564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc0a0e40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009920 tx=0x7f8cbc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=461834eda61623a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cc959a700 1 -- 172.21.15.154:0/3838190564 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc011830 con 0x7f8ccc0a0a70 2023-09-30T22:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cc959a700 1 -- 172.21.15.154:0/3838190564 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc011990 con 0x7f8ccc0a0a70 2023-09-30T22:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.456+0000 7f8cc959a700 1 -- 172.21.15.154:0/3838190564 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc011d20 con 0x7f8ccc0a0a70 2023-09-30T22:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.457+0000 7f8cd0df4700 1 -- 172.21.15.154:0/3838190564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 msgr2=0x7f8ccc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.457+0000 7f8cd0df4700 1 --2- 172.21.15.154:0/3838190564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc0a0e40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009920 tx=0x7f8cbc009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.457+0000 7f8cd0df4700 1 -- 172.21.15.154:0/3838190564 shutdown_connections 2023-09-30T22:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.457+0000 7f8cd0df4700 1 --2- 172.21.15.154:0/3838190564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc0a0e40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.457+0000 7f8cd0df4700 1 --2- 172.21.15.154:0/3838190564 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc0a1380 0x7f8ccc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.457+0000 7f8cd0df4700 1 -- 172.21.15.154:0/3838190564 >> 172.21.15.154:0/3838190564 conn(0x7f8ccc0a6610 msgr2=0x7f8ccc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.457+0000 7f8cd0df4700 1 -- 172.21.15.154:0/3838190564 shutdown_connections 2023-09-30T22:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.457+0000 7f8cd0df4700 1 -- 172.21.15.154:0/3838190564 wait complete. 2023-09-30T22:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.458+0000 7f8cd0df4700 1 Processor -- start 2023-09-30T22:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cd0df4700 1 -- start start 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cd0df4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc1228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cd0df4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ccc0a1380 0x7f8ccc122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cd0df4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc133f50 0x7f8ccc123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cd0df4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc1260c0 con 0x7f8ccc0a1380 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cd0df4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc1245a0 con 0x7f8ccc0a0a70 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cd0df4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc133a10 con 0x7f8ccc133f50 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cca59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc1228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cca59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc1228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51208/0 (socket says 172.21.15.154:51208) 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8ccad9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc133f50 0x7f8ccc123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.459+0000 7f8cca59c700 1 -- 172.21.15.154:0/1815555633 learned_addr learned my addr 172.21.15.154:0/1815555633 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:05.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8cc9d9b700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ccc0a1380 0x7f8ccc122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8ccad9d700 1 -- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 msgr2=0x7f8ccc1228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8ccad9d700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc1228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8ccad9d700 1 -- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ccc0a1380 msgr2=0x7f8ccc122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8ccad9d700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ccc0a1380 0x7f8ccc122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8ccad9d700 1 -- 172.21.15.154:0/1815555633 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc009550 con 0x7f8ccc133f50 2023-09-30T22:29:05.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8cca59c700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc1228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8cc9d9b700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ccc0a1380 0x7f8ccc122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:05.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8ccad9d700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc133f50 0x7f8ccc123350 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400cc10 tx=0x7f8cc400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8cbaffd700 1 -- 172.21.15.154:0/1815555633 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400aab0 con 0x7f8ccc133f50 2023-09-30T22:29:05.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8cbaffd700 1 -- 172.21.15.154:0/1815555633 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc400ac30 con 0x7f8ccc133f50 2023-09-30T22:29:05.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8cd0df4700 1 -- 172.21.15.154:0/1815555633 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc0a03e0 con 0x7f8ccc133f50 2023-09-30T22:29:05.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8cbaffd700 1 -- 172.21.15.154:0/1815555633 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40070d0 con 0x7f8ccc133f50 2023-09-30T22:29:05.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.460+0000 7f8cd0df4700 1 -- 172.21.15.154:0/1815555633 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc126b30 con 0x7f8ccc133f50 2023-09-30T22:29:05.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.461+0000 7f8cbaffd700 1 -- 172.21.15.154:0/1815555633 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cc4007230 con 0x7f8ccc133f50 2023-09-30T22:29:05.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.461+0000 7f8cbaffd700 1 -- 172.21.15.154:0/1815555633 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8cc403f450 con 0x7f8ccc133f50 2023-09-30T22:29:05.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.461+0000 7f8cd0df4700 1 -- 172.21.15.154:0/1815555633 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc126200 con 0x7f8ccc133f50 2023-09-30T22:29:05.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.470+0000 7f8cbaffd700 1 -- 172.21.15.154:0/1815555633 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ccc126200 con 0x7f8ccc133f50 2023-09-30T22:29:05.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.545+0000 7fdf7c99a700 1 Processor -- start 2023-09-30T22:29:05.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.545+0000 7fdf7c99a700 1 -- start start 2023-09-30T22:29:05.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf7c99a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a0a70 0x7fdf780a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf7c99a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdf780a1380 0x7fdf78133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf7c99a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf7c99a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7809e9d0 con 0x7fdf780a1380 2023-09-30T22:29:05.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf7c99a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7809dc00 con 0x7fdf78133f50 2023-09-30T22:29:05.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf7c99a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7809dec0 con 0x7fdf780a0a70 2023-09-30T22:29:05.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf75d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdf780a1380 0x7fdf78133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf7659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a0a70 0x7fdf780a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf76d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf75d9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdf780a1380 0x7fdf78133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34310/0 (socket says 172.21.15.154:34310) 2023-09-30T22:29:05.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf76d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51210/0 (socket says 172.21.15.154:51210) 2023-09-30T22:29:05.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf7659c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a0a70 0x7fdf780a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55214/0 (socket says 172.21.15.154:55214) 2023-09-30T22:29:05.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.546+0000 7fdf75d9b700 1 -- 172.21.15.154:0/1574757136 learned_addr learned my addr 172.21.15.154:0/1574757136 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:05.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf75d9b700 1 -- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a0a70 msgr2=0x7fdf780a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf75d9b700 1 --2- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a0a70 0x7fdf780a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf75d9b700 1 -- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 msgr2=0x7fdf78134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf75d9b700 1 --2- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf75d9b700 1 -- 172.21.15.154:0/1574757136 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7809e6a0 con 0x7fdf780a1380 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf76d9d700 1 --2- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf7659c700 1 --2- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a0a70 0x7fdf780a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf75d9b700 1 --2- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a1380 0x7fdf78133a10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0098f0 tx=0x7fdf6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ef2707901b794f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf7559a700 1 -- 172.21.15.154:0/1574757136 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c011830 con 0x7fdf780a1380 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf7559a700 1 -- 172.21.15.154:0/1574757136 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c011990 con 0x7fdf780a1380 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.547+0000 7fdf7559a700 1 -- 172.21.15.154:0/1574757136 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c011d20 con 0x7fdf780a1380 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.548+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a1380 msgr2=0x7fdf78133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.548+0000 7fdf7c99a700 1 --2- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a1380 0x7fdf78133a10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0098f0 tx=0x7fdf6c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.548+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1574757136 shutdown_connections 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.548+0000 7fdf7c99a700 1 --2- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.548+0000 7fdf7c99a700 1 --2- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a0a70 0x7fdf780a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.548+0000 7fdf7c99a700 1 --2- 172.21.15.154:0/1574757136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a1380 0x7fdf78133a10 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.548+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1574757136 >> 172.21.15.154:0/1574757136 conn(0x7fdf780a6610 msgr2=0x7fdf780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.548+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1574757136 shutdown_connections 2023-09-30T22:29:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.548+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1574757136 wait complete. 2023-09-30T22:29:05.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf7c99a700 1 Processor -- start 2023-09-30T22:29:05.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf7c99a700 1 -- start start 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf7c99a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a0a70 0x7fdf78122390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf7c99a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a1380 0x7fdf781228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf7c99a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf7c99a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf78133760 con 0x7fdf780a0a70 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf7c99a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf781237f0 con 0x7fdf78133f50 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf7c99a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf78124e30 con 0x7fdf780a1380 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf75d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a1380 0x7fdf781228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf75d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a1380 0x7fdf781228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55218/0 (socket says 172.21.15.154:55218) 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf75d9b700 1 -- 172.21.15.154:0/1749231119 learned_addr learned my addr 172.21.15.154:0/1749231119 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.549+0000 7fdf7659c700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a0a70 0x7fdf78122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf76d9d700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf7659c700 1 -- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a1380 msgr2=0x7fdf781228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf7659c700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a1380 0x7fdf781228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf7659c700 1 -- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 msgr2=0x7fdf78122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf7659c700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf7659c700 1 -- 172.21.15.154:0/1749231119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf680094a0 con 0x7fdf780a0a70 2023-09-30T22:29:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf75d9b700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a1380 0x7fdf781228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf7659c700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a0a70 0x7fdf78122390 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800e8b0 tx=0x7fdf6800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf66ffd700 1 -- 172.21.15.154:0/1749231119 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68004030 con 0x7fdf780a0a70 2023-09-30T22:29:05.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf66ffd700 1 -- 172.21.15.154:0/1749231119 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf68004190 con 0x7fdf780a0a70 2023-09-30T22:29:05.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1749231119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf70009a70 con 0x7fdf780a0a70 2023-09-30T22:29:05.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf66ffd700 1 -- 172.21.15.154:0/1749231119 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68004520 con 0x7fdf780a0a70 2023-09-30T22:29:05.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.550+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1749231119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c009550 con 0x7fdf780a0a70 2023-09-30T22:29:05.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.551+0000 7fdf66ffd700 1 -- 172.21.15.154:0/1749231119 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf680036a0 con 0x7fdf780a0a70 2023-09-30T22:29:05.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.551+0000 7fdf66ffd700 1 -- 172.21.15.154:0/1749231119 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdf6803f3a0 con 0x7fdf780a0a70 2023-09-30T22:29:05.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.551+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1749231119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf781251f0 con 0x7fdf780a0a70 2023-09-30T22:29:05.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.556+0000 7fdf66ffd700 1 -- 172.21.15.154:0/1749231119 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf68003950 con 0x7fdf780a0a70 2023-09-30T22:29:05.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff838bd4700 1 Processor -- start 2023-09-30T22:29:05.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff838bd4700 1 -- start start 2023-09-30T22:29:05.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff838bd4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a1180 0x7ff83413d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff838bd4700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8340a15b0 0x7ff83413f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff838bd4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83409df50 con 0x7ff83406cc70 2023-09-30T22:29:05.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff838bd4700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83409cf30 con 0x7ff8340a15b0 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff838bd4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340a24a0 con 0x7ff8340a1180 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff831d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a1180 0x7ff83413d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff832d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8340a15b0 0x7ff83413f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff831d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a1180 0x7ff83413d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51220/0 (socket says 172.21.15.154:51220) 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.582+0000 7ff831d9b700 1 -- 172.21.15.154:0/3319579530 learned_addr learned my addr 172.21.15.154:0/3319579530 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.583+0000 7ff832d9d700 1 -- 172.21.15.154:0/3319579530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a1180 msgr2=0x7ff83413d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.583+0000 7ff832d9d700 1 --2- 172.21.15.154:0/3319579530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a1180 0x7ff83413d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.583+0000 7ff832d9d700 1 -- 172.21.15.154:0/3319579530 >> v1:172.21.15.154:6789/0 conn(0x7ff83406cc70 legacy=0x7ff8340a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.583+0000 7ff832d9d700 1 -- 172.21.15.154:0/3319579530 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83409e1a0 con 0x7ff8340a15b0 2023-09-30T22:29:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.583+0000 7ff831d9b700 1 --2- 172.21.15.154:0/3319579530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a1180 0x7ff83413d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.583+0000 7ff832d9d700 1 --2- 172.21.15.154:0/3319579530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a15b0 0x7ff83413f760 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009d90 tx=0x7ff82c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3ebf121bea20dc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.583+0000 7ff83159a700 1 -- 172.21.15.154:0/3319579530 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00e070 con 0x7ff8340a15b0 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.583+0000 7ff83159a700 1 -- 172.21.15.154:0/3319579530 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00bb20 con 0x7ff8340a15b0 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.583+0000 7ff83159a700 1 -- 172.21.15.154:0/3319579530 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c012430 con 0x7ff8340a15b0 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.584+0000 7ff838bd4700 1 -- 172.21.15.154:0/3319579530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a15b0 msgr2=0x7ff83413f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.584+0000 7ff838bd4700 1 --2- 172.21.15.154:0/3319579530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a15b0 0x7ff83413f760 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009d90 tx=0x7ff82c00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.584+0000 7ff838bd4700 1 -- 172.21.15.154:0/3319579530 shutdown_connections 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.584+0000 7ff838bd4700 1 --2- 172.21.15.154:0/3319579530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a15b0 0x7ff83413f760 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.584+0000 7ff838bd4700 1 --2- 172.21.15.154:0/3319579530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a1180 0x7ff83413d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.584+0000 7ff838bd4700 1 -- 172.21.15.154:0/3319579530 >> 172.21.15.154:0/3319579530 conn(0x7ff8340a6610 msgr2=0x7ff8340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.584+0000 7ff838bd4700 1 -- 172.21.15.154:0/3319579530 shutdown_connections 2023-09-30T22:29:05.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.584+0000 7ff838bd4700 1 -- 172.21.15.154:0/3319579530 wait complete. 2023-09-30T22:29:05.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff838bd4700 1 Processor -- start 2023-09-30T22:29:05.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff838bd4700 1 -- start start 2023-09-30T22:29:05.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff838bd4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff83406cc70 0x7ff8341250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff838bd4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a1180 0x7ff8341255f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.590 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff838bd4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a15b0 0x7ff834125b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff838bd4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340a00b0 con 0x7ff8340a1180 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff838bd4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8341277d0 con 0x7ff8340a15b0 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff838bd4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff834127120 con 0x7ff83406cc70 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff831d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a1180 0x7ff8341255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff831d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a1180 0x7ff8341255f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34338/0 (socket says 172.21.15.154:34338) 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff83259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff83406cc70 0x7ff8341250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.585+0000 7ff831d9b700 1 -- 172.21.15.154:0/1503338491 learned_addr learned my addr 172.21.15.154:0/1503338491 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff832d9d700 1 --2- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a15b0 0x7ff834125b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff831d9b700 1 -- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff83406cc70 msgr2=0x7ff8341250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff831d9b700 1 --2- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff83406cc70 0x7ff8341250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff831d9b700 1 -- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a15b0 msgr2=0x7ff834125b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff831d9b700 1 --2- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a15b0 0x7ff834125b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff831d9b700 1 -- 172.21.15.154:0/1503338491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff828009550 con 0x7ff8340a1180 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff831d9b700 1 --2- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a1180 0x7ff8341255f0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7ff82800ebe0 tx=0x7ff82800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff822ffd700 1 -- 172.21.15.154:0/1503338491 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800c850 con 0x7ff8340a1180 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff822ffd700 1 -- 172.21.15.154:0/1503338491 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82800c9b0 con 0x7ff8340a1180 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff838bd4700 1 -- 172.21.15.154:0/1503338491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c009a70 con 0x7ff8340a1180 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff822ffd700 1 -- 172.21.15.154:0/1503338491 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800cd40 con 0x7ff8340a1180 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.586+0000 7ff838bd4700 1 -- 172.21.15.154:0/1503338491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8341273e0 con 0x7ff8340a1180 2023-09-30T22:29:05.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.587+0000 7ff822ffd700 1 -- 172.21.15.154:0/1503338491 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff828013470 con 0x7ff8340a1180 2023-09-30T22:29:05.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.587+0000 7ff822ffd700 1 -- 172.21.15.154:0/1503338491 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff82803fbe0 con 0x7ff8340a1180 2023-09-30T22:29:05.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.587+0000 7ff838bd4700 1 -- 172.21.15.154:0/1503338491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff834071e20 con 0x7ff8340a1180 2023-09-30T22:29:05.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.592+0000 7ff822ffd700 1 -- 172.21.15.154:0/1503338491 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff82801b3b0 con 0x7ff8340a1180 2023-09-30T22:29:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.668+0000 7f8cd0df4700 1 -- 172.21.15.154:0/1815555633 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ccc126200 con 0x7f8ccc133f50 2023-09-30T22:29:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.668+0000 7f8cbaffd700 1 -- 172.21.15.154:0/1815555633 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ccc126200 con 0x7f8ccc133f50 2023-09-30T22:29:05.670 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:05.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.670+0000 7f8cd0df4700 1 -- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc133f50 msgr2=0x7f8ccc123350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.670+0000 7f8cd0df4700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc133f50 0x7f8ccc123350 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400cc10 tx=0x7f8cc400cf20 comp rx=0 tx=0).stop 2023-09-30T22:29:05.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.670+0000 7f8cd0df4700 1 -- 172.21.15.154:0/1815555633 shutdown_connections 2023-09-30T22:29:05.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.670+0000 7f8cd0df4700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8ccc133f50 0x7f8ccc123350 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.670+0000 7f8cd0df4700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ccc0a0a70 0x7f8ccc1228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.670+0000 7f8cd0df4700 1 --2- 172.21.15.154:0/1815555633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ccc0a1380 0x7f8ccc122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.670+0000 7f8cd0df4700 1 -- 172.21.15.154:0/1815555633 >> 172.21.15.154:0/1815555633 conn(0x7f8ccc0a6610 msgr2=0x7f8ccc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.670+0000 7f8cd0df4700 1 -- 172.21.15.154:0/1815555633 shutdown_connections 2023-09-30T22:29:05.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.670+0000 7f8cd0df4700 1 -- 172.21.15.154:0/1815555633 wait complete. 2023-09-30T22:29:05.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.765+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1749231119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdf7811f760 con 0x7fdf780a0a70 2023-09-30T22:29:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.765+0000 7fdf66ffd700 1 -- 172.21.15.154:0/1749231119 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf68020020 con 0x7fdf780a0a70 2023-09-30T22:29:05.767 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.768+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a0a70 msgr2=0x7fdf78122390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.768+0000 7fdf7c99a700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a0a70 0x7fdf78122390 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800e8b0 tx=0x7fdf6800ebc0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.768+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1749231119 shutdown_connections 2023-09-30T22:29:05.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.768+0000 7fdf7c99a700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf78133f50 0x7fdf78122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.768+0000 7fdf7c99a700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf780a0a70 0x7fdf78122390 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.768+0000 7fdf7c99a700 1 --2- 172.21.15.154:0/1749231119 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdf780a1380 0x7fdf781228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.768+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1749231119 >> 172.21.15.154:0/1749231119 conn(0x7fdf780a6610 msgr2=0x7fdf7811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.768+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1749231119 shutdown_connections 2023-09-30T22:29:05.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.768+0000 7fdf7c99a700 1 -- 172.21.15.154:0/1749231119 wait complete. 2023-09-30T22:29:05.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:05.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.807+0000 7ff838bd4700 1 -- 172.21.15.154:0/1503338491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff83404f2a0 con 0x7ff8340a1180 2023-09-30T22:29:05.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.808+0000 7ff822ffd700 1 -- 172.21.15.154:0/1503338491 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff828011b40 con 0x7ff8340a1180 2023-09-30T22:29:05.809 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.810+0000 7ff838bd4700 1 -- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a1180 msgr2=0x7ff8341255f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.810+0000 7ff838bd4700 1 --2- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a1180 0x7ff8341255f0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7ff82800ebe0 tx=0x7ff82800eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.810+0000 7ff838bd4700 1 -- 172.21.15.154:0/1503338491 shutdown_connections 2023-09-30T22:29:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.810+0000 7ff838bd4700 1 --2- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8340a15b0 0x7ff834125b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.810+0000 7ff838bd4700 1 --2- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff83406cc70 0x7ff8341250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.810+0000 7ff838bd4700 1 --2- 172.21.15.154:0/1503338491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8340a1180 0x7ff8341255f0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:05.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.810+0000 7ff838bd4700 1 -- 172.21.15.154:0/1503338491 >> 172.21.15.154:0/1503338491 conn(0x7ff8340a6610 msgr2=0x7ff83413c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:05.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.810+0000 7ff838bd4700 1 -- 172.21.15.154:0/1503338491 shutdown_connections 2023-09-30T22:29:05.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:05.810+0000 7ff838bd4700 1 -- 172.21.15.154:0/1503338491 wait complete. 2023-09-30T22:29:05.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:06.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:06.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.491+0000 7f75e4a38700 1 Processor -- start 2023-09-30T22:29:06.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.491+0000 7f75e4a38700 1 -- start start 2023-09-30T22:29:06.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75e4a38700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75e4a38700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75e0130bc0 0x7f75e013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75e4a38700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e006b2d0 con 0x7f75e01300a0 2023-09-30T22:29:06.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75e4a38700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e0133610 con 0x7f75e0130bc0 2023-09-30T22:29:06.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75e4a38700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e009a500 con 0x7f75e0133ad0 2023-09-30T22:29:06.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75de59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75ded9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75e0130bc0 0x7f75e013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75de59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55246/0 (socket says 172.21.15.154:55246) 2023-09-30T22:29:06.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75ded9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75e0130bc0 0x7f75e013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34344/0 (socket says 172.21.15.154:34344) 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75ddd9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f75e01300a0 0x7f75e01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54422/0 (socket says 172.21.15.154:54422) 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75de59c700 1 -- 172.21.15.154:0/224128992 learned_addr learned my addr 172.21.15.154:0/224128992 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75de59c700 1 -- 172.21.15.154:0/224128992 >> v2:172.21.15.154:3300/0 conn(0x7f75e0130bc0 msgr2=0x7f75e013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.492+0000 7f75de59c700 1 --2- 172.21.15.154:0/224128992 >> v2:172.21.15.154:3300/0 conn(0x7f75e0130bc0 0x7f75e013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75de59c700 1 -- 172.21.15.154:0/224128992 >> v1:172.21.15.154:6789/0 conn(0x7f75e01300a0 legacy=0x7f75e01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75de59c700 1 -- 172.21.15.154:0/224128992 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e01338b0 con 0x7f75e0133ad0 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75ded9d700 1 --2- 172.21.15.154:0/224128992 >> v2:172.21.15.154:3300/0 conn(0x7f75e0130bc0 0x7f75e013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75de59c700 1 --2- 172.21.15.154:0/224128992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e0133ea0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f75d00098f0 tx=0x7f75d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdfeed575f283877 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75dd59a700 1 -- 172.21.15.154:0/224128992 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0011830 con 0x7f75e0133ad0 2023-09-30T22:29:06.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75dd59a700 1 -- 172.21.15.154:0/224128992 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0011990 con 0x7f75e0133ad0 2023-09-30T22:29:06.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75dd59a700 1 -- 172.21.15.154:0/224128992 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0011d20 con 0x7f75e0133ad0 2023-09-30T22:29:06.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75e4a38700 1 -- 172.21.15.154:0/224128992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 msgr2=0x7f75e0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75e4a38700 1 --2- 172.21.15.154:0/224128992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e0133ea0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f75d00098f0 tx=0x7f75d0009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:06.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75e4a38700 1 -- 172.21.15.154:0/224128992 shutdown_connections 2023-09-30T22:29:06.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75e4a38700 1 --2- 172.21.15.154:0/224128992 >> v2:172.21.15.154:3300/0 conn(0x7f75e0130bc0 0x7f75e013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75e4a38700 1 --2- 172.21.15.154:0/224128992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e0133ea0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75e4a38700 1 -- 172.21.15.154:0/224128992 >> 172.21.15.154:0/224128992 conn(0x7f75e0099c40 msgr2=0x7f75e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75e4a38700 1 -- 172.21.15.154:0/224128992 shutdown_connections 2023-09-30T22:29:06.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.493+0000 7f75e4a38700 1 -- 172.21.15.154:0/224128992 wait complete. 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.494+0000 7f75e4a38700 1 Processor -- start 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75e4a38700 1 -- start start 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75e4a38700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e01300a0 0x7f75e01c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75e4a38700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e0130bc0 0x7f75e01c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75e4a38700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e01c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75e4a38700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0120bb0 con 0x7f75e0130bc0 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75e4a38700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01201b0 con 0x7f75e01300a0 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75e4a38700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0072160 con 0x7f75e0133ad0 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ddd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e0130bc0 0x7f75e01c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75de59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e01300a0 0x7f75e01c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ded9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e01c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ddd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e0130bc0 0x7f75e01c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34352/0 (socket says 172.21.15.154:34352) 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75de59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e01300a0 0x7f75e01c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51248/0 (socket says 172.21.15.154:51248) 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ddd9b700 1 -- 172.21.15.154:0/3655441044 learned_addr learned my addr 172.21.15.154:0/3655441044 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ded9d700 1 -- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e01300a0 msgr2=0x7f75e01c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ded9d700 1 --2- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e01300a0 0x7f75e01c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ded9d700 1 -- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e0130bc0 msgr2=0x7f75e01c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ded9d700 1 --2- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e0130bc0 0x7f75e01c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ded9d700 1 -- 172.21.15.154:0/3655441044 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d8009a70 con 0x7f75e0133ad0 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.495+0000 7f75ded9d700 1 --2- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e01c91d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f75d800efc0 tx=0x7f75d800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.496+0000 7f75d6ffd700 1 -- 172.21.15.154:0/3655441044 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800ca90 con 0x7f75e0133ad0 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.496+0000 7f75d6ffd700 1 -- 172.21.15.154:0/3655441044 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d800f040 con 0x7f75e0133ad0 2023-09-30T22:29:06.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.496+0000 7f75e4a38700 1 -- 172.21.15.154:0/3655441044 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d0009550 con 0x7f75e0133ad0 2023-09-30T22:29:06.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.496+0000 7f75d6ffd700 1 -- 172.21.15.154:0/3655441044 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800ce30 con 0x7f75e0133ad0 2023-09-30T22:29:06.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.496+0000 7f75e4a38700 1 -- 172.21.15.154:0/3655441044 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e011fed0 con 0x7f75e0133ad0 2023-09-30T22:29:06.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.496+0000 7f75d6ffd700 1 -- 172.21.15.154:0/3655441044 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75d8014480 con 0x7f75e0133ad0 2023-09-30T22:29:06.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.497+0000 7f75e4a38700 1 -- 172.21.15.154:0/3655441044 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e004f2a0 con 0x7f75e0133ad0 2023-09-30T22:29:06.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.497+0000 7f75d6ffd700 1 -- 172.21.15.154:0/3655441044 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f75d803fbd0 con 0x7f75e0133ad0 2023-09-30T22:29:06.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.501+0000 7f75d6ffd700 1 -- 172.21.15.154:0/3655441044 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75d8012700 con 0x7f75e0133ad0 2023-09-30T22:29:06.684 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:06.687 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:06.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.685+0000 7f75e4a38700 1 -- 172.21.15.154:0/3655441044 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f75e006c3b0 con 0x7f75e0133ad0 2023-09-30T22:29:06.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.686+0000 7f75d6ffd700 1 -- 172.21.15.154:0/3655441044 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75d8009cc0 con 0x7f75e0133ad0 2023-09-30T22:29:06.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.688+0000 7f75e4a38700 1 -- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 msgr2=0x7f75e01c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.688+0000 7f75e4a38700 1 --2- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e01c91d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f75d800efc0 tx=0x7f75d800c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.688+0000 7f75e4a38700 1 -- 172.21.15.154:0/3655441044 shutdown_connections 2023-09-30T22:29:06.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.688+0000 7f75e4a38700 1 --2- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75e0133ad0 0x7f75e01c91d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.688+0000 7f75e4a38700 1 --2- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75e01300a0 0x7f75e01c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.688+0000 7f75e4a38700 1 --2- 172.21.15.154:0/3655441044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75e0130bc0 0x7f75e01c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.688+0000 7f75e4a38700 1 -- 172.21.15.154:0/3655441044 >> 172.21.15.154:0/3655441044 conn(0x7f75e0099c40 msgr2=0x7f75e012e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.688+0000 7f75e4a38700 1 -- 172.21.15.154:0/3655441044 shutdown_connections 2023-09-30T22:29:06.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.688+0000 7f75e4a38700 1 -- 172.21.15.154:0/3655441044 wait complete. 2023-09-30T22:29:06.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:06.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:06.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.806+0000 7f75db00a700 1 Processor -- start 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.806+0000 7f75db00a700 1 -- start start 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75db00a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75d4136960 0x7f75d4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75db00a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4139280 0x7f75d413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75db00a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d406b2d0 con 0x7f75d4133ad0 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75db00a700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d41345b0 con 0x7f75d4136960 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75db00a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4133610 con 0x7f75d4139280 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75d4136960 0x7f75d4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d95a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4139280 0x7f75d413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75d4136960 0x7f75d4138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34362/0 (socket says 172.21.15.154:34362) 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d95a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4139280 0x7f75d413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55272/0 (socket says 172.21.15.154:55272) 2023-09-30T22:29:06.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d3fff700 1 -- 172.21.15.154:0/3081551977 learned_addr learned my addr 172.21.15.154:0/3081551977 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d3fff700 1 -- 172.21.15.154:0/3081551977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4139280 msgr2=0x7f75d413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d3fff700 1 --2- 172.21.15.154:0/3081551977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4139280 0x7f75d413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d3fff700 1 -- 172.21.15.154:0/3081551977 >> v1:172.21.15.154:6789/0 conn(0x7f75d4133ad0 legacy=0x7f75d4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d3fff700 1 -- 172.21.15.154:0/3081551977 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d409a500 con 0x7f75d4136960 2023-09-30T22:29:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d95a7700 1 --2- 172.21.15.154:0/3081551977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4139280 0x7f75d413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d3fff700 1 --2- 172.21.15.154:0/3081551977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4136960 0x7f75d4138d40 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f75c00098f0 tx=0x7f75c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788e20bd93d8332e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d37fe700 1 -- 172.21.15.154:0/3081551977 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0011830 con 0x7f75d4136960 2023-09-30T22:29:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d37fe700 1 -- 172.21.15.154:0/3081551977 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0011990 con 0x7f75d4136960 2023-09-30T22:29:06.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.807+0000 7f75d37fe700 1 -- 172.21.15.154:0/3081551977 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0011d20 con 0x7f75d4136960 2023-09-30T22:29:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.808+0000 7f75db00a700 1 -- 172.21.15.154:0/3081551977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4136960 msgr2=0x7f75d4138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.808+0000 7f75db00a700 1 --2- 172.21.15.154:0/3081551977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4136960 0x7f75d4138d40 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f75c00098f0 tx=0x7f75c0009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.808+0000 7f75db00a700 1 -- 172.21.15.154:0/3081551977 shutdown_connections 2023-09-30T22:29:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.808+0000 7f75db00a700 1 --2- 172.21.15.154:0/3081551977 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4139280 0x7f75d413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.808+0000 7f75db00a700 1 --2- 172.21.15.154:0/3081551977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4136960 0x7f75d4138d40 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.808+0000 7f75db00a700 1 -- 172.21.15.154:0/3081551977 >> 172.21.15.154:0/3081551977 conn(0x7f75d4099c40 msgr2=0x7f75d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.808+0000 7f75db00a700 1 -- 172.21.15.154:0/3081551977 shutdown_connections 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.808+0000 7f75db00a700 1 -- 172.21.15.154:0/3081551977 wait complete. 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.809+0000 7f75db00a700 1 Processor -- start 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.809+0000 7f75db00a700 1 -- start start 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75db00a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4133ad0 0x7f75d4071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75db00a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4136960 0x7f75d4071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75db00a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d4139280 0x7f75d41c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75db00a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4070350 con 0x7f75d4133ad0 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75db00a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d406ecd0 con 0x7f75d4139280 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75db00a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75d41315e0 con 0x7f75d4136960 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4136960 0x7f75d4071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d8da6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4133ad0 0x7f75d4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4136960 0x7f75d4071d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55286/0 (socket says 172.21.15.154:55286) 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d3fff700 1 -- 172.21.15.154:0/4097816890 learned_addr learned my addr 172.21.15.154:0/4097816890 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d95a7700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d4139280 0x7f75d41c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d8da6700 1 -- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4136960 msgr2=0x7f75d4071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d8da6700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4136960 0x7f75d4071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d8da6700 1 -- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d4139280 msgr2=0x7f75d41c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d8da6700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d4139280 0x7f75d41c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d8da6700 1 -- 172.21.15.154:0/4097816890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc009a70 con 0x7f75d4133ad0 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d3fff700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4136960 0x7f75d4071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d95a7700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d4139280 0x7f75d41c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.810+0000 7f75d8da6700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4133ad0 0x7f75d4071830 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f75c8000f60 tx=0x7f75c800c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.811+0000 7f75d17fa700 1 -- 172.21.15.154:0/4097816890 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80052d0 con 0x7f75d4133ad0 2023-09-30T22:29:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.811+0000 7f75d17fa700 1 -- 172.21.15.154:0/4097816890 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c8005430 con 0x7f75d4133ad0 2023-09-30T22:29:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.811+0000 7f75db00a700 1 -- 172.21.15.154:0/4097816890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c0009550 con 0x7f75d4133ad0 2023-09-30T22:29:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.811+0000 7f75d17fa700 1 -- 172.21.15.154:0/4097816890 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80038c0 con 0x7f75d4133ad0 2023-09-30T22:29:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.811+0000 7f75db00a700 1 -- 172.21.15.154:0/4097816890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d4070dc0 con 0x7f75d4133ad0 2023-09-30T22:29:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.811+0000 7f75d17fa700 1 -- 172.21.15.154:0/4097816890 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75c8003c30 con 0x7f75d4133ad0 2023-09-30T22:29:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.812+0000 7f75db00a700 1 -- 172.21.15.154:0/4097816890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d404f2a0 con 0x7f75d4133ad0 2023-09-30T22:29:06.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.812+0000 7f75d17fa700 1 -- 172.21.15.154:0/4097816890 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f75c803ec20 con 0x7f75d4133ad0 2023-09-30T22:29:06.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.817+0000 7f75d17fa700 1 -- 172.21.15.154:0/4097816890 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75c8017020 con 0x7f75d4133ad0 2023-09-30T22:29:06.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:06.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.914+0000 7f2403858700 1 Processor -- start 2023-09-30T22:29:06.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.914+0000 7f2403858700 1 -- start start 2023-09-30T22:29:06.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f2403858700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f2403858700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f2403858700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23fc133f50 0x7f23fc1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f2403858700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23fc09e9d0 con 0x7f23fc133f50 2023-09-30T22:29:06.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f2403858700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc09dc00 con 0x7f23fc0a1380 2023-09-30T22:29:06.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f2403858700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc09dec0 con 0x7f23fc0a0a70 2023-09-30T22:29:06.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f24015f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f2400df3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f24015f4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55302/0 (socket says 172.21.15.154:55302) 2023-09-30T22:29:06.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f24015f4700 1 -- 172.21.15.154:0/85516155 learned_addr learned my addr 172.21.15.154:0/85516155 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:06.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f2401df5700 1 --2- 172.21.15.154:0/85516155 >> v2:172.21.15.154:3300/0 conn(0x7f23fc133f50 0x7f23fc1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f24015f4700 1 -- 172.21.15.154:0/85516155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 msgr2=0x7f23fc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f24015f4700 1 --2- 172.21.15.154:0/85516155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f24015f4700 1 -- 172.21.15.154:0/85516155 >> v2:172.21.15.154:3300/0 conn(0x7f23fc133f50 msgr2=0x7f23fc1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f24015f4700 1 --2- 172.21.15.154:0/85516155 >> v2:172.21.15.154:3300/0 conn(0x7f23fc133f50 0x7f23fc1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f24015f4700 1 -- 172.21.15.154:0/85516155 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc09e6a0 con 0x7f23fc0a0a70 2023-09-30T22:29:06.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.915+0000 7f24015f4700 1 --2- 172.21.15.154:0/85516155 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc0a0e40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f23f80098f0 tx=0x7f23f8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a914de988df31c35 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f23f3fff700 1 -- 172.21.15.154:0/85516155 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8011830 con 0x7f23fc0a0a70 2023-09-30T22:29:06.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f23f3fff700 1 -- 172.21.15.154:0/85516155 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f8011990 con 0x7f23fc0a0a70 2023-09-30T22:29:06.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f23f3fff700 1 -- 172.21.15.154:0/85516155 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8011d20 con 0x7f23fc0a0a70 2023-09-30T22:29:06.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f2403858700 1 -- 172.21.15.154:0/85516155 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 msgr2=0x7f23fc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f2403858700 1 --2- 172.21.15.154:0/85516155 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc0a0e40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f23f80098f0 tx=0x7f23f8009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:06.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f2403858700 1 -- 172.21.15.154:0/85516155 shutdown_connections 2023-09-30T22:29:06.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f2403858700 1 --2- 172.21.15.154:0/85516155 >> v2:172.21.15.154:3300/0 conn(0x7f23fc133f50 0x7f23fc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f2403858700 1 --2- 172.21.15.154:0/85516155 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc0a0e40 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f2403858700 1 --2- 172.21.15.154:0/85516155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f2403858700 1 -- 172.21.15.154:0/85516155 >> 172.21.15.154:0/85516155 conn(0x7f23fc0a6610 msgr2=0x7f23fc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.916+0000 7f2403858700 1 -- 172.21.15.154:0/85516155 shutdown_connections 2023-09-30T22:29:06.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.917+0000 7f2403858700 1 -- 172.21.15.154:0/85516155 wait complete. 2023-09-30T22:29:06.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.917+0000 7f2403858700 1 Processor -- start 2023-09-30T22:29:06.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.917+0000 7f2403858700 1 -- start start 2023-09-30T22:29:06.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2403858700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc1225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2403858700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2403858700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc133f50 0x7f23fc123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2403858700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc124a20 con 0x7f23fc133f50 2023-09-30T22:29:06.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2403858700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0a03e0 con 0x7f23fc0a1380 2023-09-30T22:29:06.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2403858700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc09d340 con 0x7f23fc0a0a70 2023-09-30T22:29:06.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2400df3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2401df5700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc133f50 0x7f23fc123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2400df3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc122b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51288/0 (socket says 172.21.15.154:51288) 2023-09-30T22:29:06.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2400df3700 1 -- 172.21.15.154:0/2782284497 learned_addr learned my addr 172.21.15.154:0/2782284497 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:06.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f24015f4700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc1225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f24015f4700 1 -- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 msgr2=0x7f23fc122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f24015f4700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f24015f4700 1 -- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc133f50 msgr2=0x7f23fc123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f24015f4700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc133f50 0x7f23fc123040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f24015f4700 1 -- 172.21.15.154:0/2782284497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8009550 con 0x7f23fc0a0a70 2023-09-30T22:29:06.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2400df3700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f2401df5700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc133f50 0x7f23fc123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.918+0000 7f24015f4700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc1225c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f23f8016000 tx=0x7f23f8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.919+0000 7f23f1ffb700 1 -- 172.21.15.154:0/2782284497 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8004240 con 0x7f23fc0a0a70 2023-09-30T22:29:06.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.919+0000 7f23f1ffb700 1 -- 172.21.15.154:0/2782284497 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f801f070 con 0x7f23fc0a0a70 2023-09-30T22:29:06.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.919+0000 7f2403858700 1 -- 172.21.15.154:0/2782284497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc124f50 con 0x7f23fc0a0a70 2023-09-30T22:29:06.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.919+0000 7f23f1ffb700 1 -- 172.21.15.154:0/2782284497 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f80045e0 con 0x7f23fc0a0a70 2023-09-30T22:29:06.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.919+0000 7f2403858700 1 -- 172.21.15.154:0/2782284497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc125d60 con 0x7f23fc0a0a70 2023-09-30T22:29:06.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.920+0000 7f23f1ffb700 1 -- 172.21.15.154:0/2782284497 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23f8021030 con 0x7f23fc0a0a70 2023-09-30T22:29:06.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.920+0000 7f23f1ffb700 1 -- 172.21.15.154:0/2782284497 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f23f8040830 con 0x7f23fc0a0a70 2023-09-30T22:29:06.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.920+0000 7f2403858700 1 -- 172.21.15.154:0/2782284497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc11f760 con 0x7f23fc0a0a70 2023-09-30T22:29:06.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.925+0000 7f23f1ffb700 1 -- 172.21.15.154:0/2782284497 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23f8015030 con 0x7f23fc0a0a70 2023-09-30T22:29:06.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.951+0000 7f74732a2700 1 Processor -- start 2023-09-30T22:29:06.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.952+0000 7f74732a2700 1 -- start start 2023-09-30T22:29:06.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.952+0000 7f74732a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09d860 0x7f746c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.952+0000 7f74732a2700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f746c09e170 0x7f746c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.952+0000 7f74732a2700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c09aaa0 con 0x7f746c130ce0 2023-09-30T22:29:06.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.952+0000 7f74732a2700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c09f870 con 0x7f746c09e170 2023-09-30T22:29:06.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.952+0000 7f74732a2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f746c09b360 con 0x7f746c09d860 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.952+0000 7f747103e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09d860 0x7f746c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f747083d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f746c09e170 0x7f746c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f747103e700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09d860 0x7f746c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55318/0 (socket says 172.21.15.154:55318) 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f747103e700 1 -- 172.21.15.154:0/3627960030 learned_addr learned my addr 172.21.15.154:0/3627960030 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f747083d700 1 -- 172.21.15.154:0/3627960030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09d860 msgr2=0x7f746c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f747083d700 1 --2- 172.21.15.154:0/3627960030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09d860 0x7f746c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f747083d700 1 -- 172.21.15.154:0/3627960030 >> v1:172.21.15.154:6789/0 conn(0x7f746c130ce0 legacy=0x7f746c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f747083d700 1 -- 172.21.15.154:0/3627960030 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c09b620 con 0x7f746c09e170 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f747103e700 1 --2- 172.21.15.154:0/3627960030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09d860 0x7f746c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f747083d700 1 --2- 172.21.15.154:0/3627960030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c09e170 0x7f746c1307a0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f745c009840 tx=0x7f745c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d116f5fd3086f918 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f7463fff700 1 -- 172.21.15.154:0/3627960030 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c011830 con 0x7f746c09e170 2023-09-30T22:29:06.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f7463fff700 1 -- 172.21.15.154:0/3627960030 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c011990 con 0x7f746c09e170 2023-09-30T22:29:06.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.953+0000 7f7463fff700 1 -- 172.21.15.154:0/3627960030 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c011d20 con 0x7f746c09e170 2023-09-30T22:29:06.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.954+0000 7f74732a2700 1 -- 172.21.15.154:0/3627960030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c09e170 msgr2=0x7f746c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.954+0000 7f74732a2700 1 --2- 172.21.15.154:0/3627960030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c09e170 0x7f746c1307a0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f745c009840 tx=0x7f745c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.954+0000 7f74732a2700 1 -- 172.21.15.154:0/3627960030 shutdown_connections 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.954+0000 7f74732a2700 1 --2- 172.21.15.154:0/3627960030 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09d860 0x7f746c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.954+0000 7f74732a2700 1 --2- 172.21.15.154:0/3627960030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c09e170 0x7f746c1307a0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.954+0000 7f74732a2700 1 -- 172.21.15.154:0/3627960030 >> 172.21.15.154:0/3627960030 conn(0x7f746c099c40 msgr2=0x7f746c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.954+0000 7f74732a2700 1 -- 172.21.15.154:0/3627960030 shutdown_connections 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.954+0000 7f74732a2700 1 -- 172.21.15.154:0/3627960030 wait complete. 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f74732a2700 1 Processor -- start 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f74732a2700 1 -- start start 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f74732a2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c09d860 0x7f746c138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f74732a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09e170 0x7f746c138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f74732a2700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f746c130ce0 0x7f746c1c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f74732a2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c13b5c0 con 0x7f746c09d860 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f74732a2700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0a2220 con 0x7f746c130ce0 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f74732a2700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f746c136b20 con 0x7f746c09e170 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f747083d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09e170 0x7f746c138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f747183f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f746c130ce0 0x7f746c1c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f747083d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09e170 0x7f746c138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55334/0 (socket says 172.21.15.154:55334) 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.955+0000 7f747083d700 1 -- 172.21.15.154:0/2768465607 learned_addr learned my addr 172.21.15.154:0/2768465607 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f747103e700 1 --2- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c09d860 0x7f746c138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f747183f700 1 -- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09e170 msgr2=0x7f746c138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f747183f700 1 --2- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09e170 0x7f746c138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f747183f700 1 -- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c09d860 msgr2=0x7f746c138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:06.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f747183f700 1 --2- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c09d860 0x7f746c138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f747183f700 1 -- 172.21.15.154:0/2768465607 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7468009550 con 0x7f746c130ce0 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f747083d700 1 --2- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09e170 0x7f746c138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f747183f700 1 --2- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f746c130ce0 0x7f746c1c8220 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f746400cb90 tx=0x7f746400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f7461ffb700 1 -- 172.21.15.154:0/2768465607 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464003c00 con 0x7f746c130ce0 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f7461ffb700 1 -- 172.21.15.154:0/2768465607 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464003d60 con 0x7f746c130ce0 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f74732a2700 1 -- 172.21.15.154:0/2768465607 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c0094a0 con 0x7f746c130ce0 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f7461ffb700 1 -- 172.21.15.154:0/2768465607 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400aa80 con 0x7f746c130ce0 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.956+0000 7f74732a2700 1 -- 172.21.15.154:0/2768465607 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c135720 con 0x7f746c130ce0 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.957+0000 7f7461ffb700 1 -- 172.21.15.154:0/2768465607 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f746400abe0 con 0x7f746c130ce0 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.957+0000 7f74732a2700 1 -- 172.21.15.154:0/2768465607 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c137020 con 0x7f746c130ce0 2023-09-30T22:29:06.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.958+0000 7f7461ffb700 1 -- 172.21.15.154:0/2768465607 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f746403f5c0 con 0x7f746c130ce0 2023-09-30T22:29:06.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:06.967+0000 7f7461ffb700 1 -- 172.21.15.154:0/2768465607 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f746401b400 con 0x7f746c130ce0 2023-09-30T22:29:07.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.019+0000 7f75db00a700 1 -- 172.21.15.154:0/4097816890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f75d409f0f0 con 0x7f75d4133ad0 2023-09-30T22:29:07.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.019+0000 7f75d17fa700 1 -- 172.21.15.154:0/4097816890 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75c801b3b0 con 0x7f75d4133ad0 2023-09-30T22:29:07.020 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:07.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.021+0000 7f75db00a700 1 -- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4133ad0 msgr2=0x7f75d4071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.021+0000 7f75db00a700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4133ad0 0x7f75d4071830 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f75c8000f60 tx=0x7f75c800c6e0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.021+0000 7f75db00a700 1 -- 172.21.15.154:0/4097816890 shutdown_connections 2023-09-30T22:29:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.021+0000 7f75db00a700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d4139280 0x7f75d41c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.021+0000 7f75db00a700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d4133ad0 0x7f75d4071830 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.021+0000 7f75db00a700 1 --2- 172.21.15.154:0/4097816890 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f75d4136960 0x7f75d4071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.021+0000 7f75db00a700 1 -- 172.21.15.154:0/4097816890 >> 172.21.15.154:0/4097816890 conn(0x7f75d4099c40 msgr2=0x7f75d4138700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.021+0000 7f75db00a700 1 -- 172.21.15.154:0/4097816890 shutdown_connections 2023-09-30T22:29:07.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.021+0000 7f75db00a700 1 -- 172.21.15.154:0/4097816890 wait complete. 2023-09-30T22:29:07.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:07.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.126+0000 7f2403858700 1 -- 172.21.15.154:0/2782284497 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f23fc04f2a0 con 0x7f23fc0a0a70 2023-09-30T22:29:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.127+0000 7f23f1ffb700 1 -- 172.21.15.154:0/2782284497 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23f801a450 con 0x7f23fc0a0a70 2023-09-30T22:29:07.128 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.129+0000 7f2403858700 1 -- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 msgr2=0x7f23fc1225c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.129+0000 7f2403858700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc1225c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f23f8016000 tx=0x7f23f8004750 comp rx=0 tx=0).stop 2023-09-30T22:29:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.129+0000 7f2403858700 1 -- 172.21.15.154:0/2782284497 shutdown_connections 2023-09-30T22:29:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.129+0000 7f2403858700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc133f50 0x7f23fc123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.129+0000 7f2403858700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f23fc0a0a70 0x7f23fc1225c0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.129+0000 7f2403858700 1 --2- 172.21.15.154:0/2782284497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0a1380 0x7f23fc122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.129+0000 7f2403858700 1 -- 172.21.15.154:0/2782284497 >> 172.21.15.154:0/2782284497 conn(0x7f23fc0a6610 msgr2=0x7f23fc11c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.129+0000 7f2403858700 1 -- 172.21.15.154:0/2782284497 shutdown_connections 2023-09-30T22:29:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.129+0000 7f2403858700 1 -- 172.21.15.154:0/2782284497 wait complete. 2023-09-30T22:29:07.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:07.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.158+0000 7f74732a2700 1 -- 172.21.15.154:0/2768465607 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f746c04f2a0 con 0x7f746c130ce0 2023-09-30T22:29:07.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.158+0000 7f7461ffb700 1 -- 172.21.15.154:0/2768465607 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7464032650 con 0x7f746c130ce0 2023-09-30T22:29:07.159 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:07.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.161+0000 7f74732a2700 1 -- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f746c130ce0 msgr2=0x7f746c1c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.161+0000 7f74732a2700 1 --2- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f746c130ce0 0x7f746c1c8220 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f746400cb90 tx=0x7f746400cea0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.161+0000 7f74732a2700 1 -- 172.21.15.154:0/2768465607 shutdown_connections 2023-09-30T22:29:07.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.161+0000 7f74732a2700 1 --2- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f746c130ce0 0x7f746c1c8220 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.161+0000 7f74732a2700 1 --2- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746c09d860 0x7f746c138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.161+0000 7f74732a2700 1 --2- 172.21.15.154:0/2768465607 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f746c09e170 0x7f746c138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.161+0000 7f74732a2700 1 -- 172.21.15.154:0/2768465607 >> 172.21.15.154:0/2768465607 conn(0x7f746c099c40 msgr2=0x7f746c139600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.161+0000 7f74732a2700 1 -- 172.21.15.154:0/2768465607 shutdown_connections 2023-09-30T22:29:07.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.161+0000 7f74732a2700 1 -- 172.21.15.154:0/2768465607 wait complete. 2023-09-30T22:29:07.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:07.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:07.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.826+0000 7ff80322f700 1 Processor -- start 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.826+0000 7ff80322f700 1 -- start start 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff80322f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12e260 0x7ff7fc12e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff80322f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc12eb70 0x7ff7fc06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff80322f700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc09d470 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff80322f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc12de50 con 0x7ff7fc12e260 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff80322f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc09e010 con 0x7ff7fc12eb70 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff800fcb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12e260 0x7ff7fc12e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc12eb70 0x7ff7fc06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff8017cc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff7fc09f3d0 0x7ff7fc06acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54456/0 (socket says 172.21.15.154:54456) 2023-09-30T22:29:07.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff8017cc700 1 -- 172.21.15.154:0/1147783567 learned_addr learned my addr 172.21.15.154:0/1147783567 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff7fbfff700 1 -- 172.21.15.154:0/1147783567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12e260 msgr2=0x7ff7fc12e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff7fbfff700 1 --2- 172.21.15.154:0/1147783567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12e260 0x7ff7fc12e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff7fbfff700 1 -- 172.21.15.154:0/1147783567 >> v1:172.21.15.154:6789/0 conn(0x7ff7fc09f3d0 legacy=0x7ff7fc06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff7fbfff700 1 -- 172.21.15.154:0/1147783567 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc12e040 con 0x7ff7fc12eb70 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff7fb7fe700 1 -- 172.21.15.154:0/1147783567 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931135487 0 0) 0x7ff7fc09d470 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff800fcb700 1 --2- 172.21.15.154:0/1147783567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12e260 0x7ff7fc12e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.827+0000 7ff7fbfff700 1 --2- 172.21.15.154:0/1147783567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc12eb70 0x7ff7fc06a770 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009870 tx=0x7ff7e8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=833e1e2bb9674d3d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff7fb7fe700 1 -- 172.21.15.154:0/1147783567 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8011830 con 0x7ff7fc12eb70 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff7fb7fe700 1 -- 172.21.15.154:0/1147783567 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e8011990 con 0x7ff7fc12eb70 2023-09-30T22:29:07.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff7fb7fe700 1 -- 172.21.15.154:0/1147783567 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8011d20 con 0x7ff7fc12eb70 2023-09-30T22:29:07.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff80322f700 1 -- 172.21.15.154:0/1147783567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc12eb70 msgr2=0x7ff7fc06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff80322f700 1 --2- 172.21.15.154:0/1147783567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc12eb70 0x7ff7fc06a770 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009870 tx=0x7ff7e8009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:07.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff80322f700 1 -- 172.21.15.154:0/1147783567 shutdown_connections 2023-09-30T22:29:07.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff80322f700 1 --2- 172.21.15.154:0/1147783567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12e260 0x7ff7fc12e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff80322f700 1 --2- 172.21.15.154:0/1147783567 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc12eb70 0x7ff7fc06a770 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff80322f700 1 -- 172.21.15.154:0/1147783567 >> 172.21.15.154:0/1147783567 conn(0x7ff7fc099c40 msgr2=0x7ff7fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:07.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff80322f700 1 -- 172.21.15.154:0/1147783567 shutdown_connections 2023-09-30T22:29:07.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.828+0000 7ff80322f700 1 -- 172.21.15.154:0/1147783567 wait complete. 2023-09-30T22:29:07.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.829+0000 7ff80322f700 1 Processor -- start 2023-09-30T22:29:07.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.829+0000 7ff80322f700 1 -- start start 2023-09-30T22:29:07.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff80322f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc09f3d0 0x7ff7fc09a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff80322f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7fc12e260 0x7ff7fc09a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff80322f700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12eb70 0x7ff7fc09aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:07.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff80322f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc12b830 con 0x7ff7fc12e260 2023-09-30T22:29:07.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff80322f700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc11db70 con 0x7ff7fc12eb70 2023-09-30T22:29:07.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff80322f700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc09be40 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff800fcb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc09f3d0 0x7ff7fc09a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7fc12e260 0x7ff7fc09a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff800fcb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc09f3d0 0x7ff7fc09a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55358/0 (socket says 172.21.15.154:55358) 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff800fcb700 1 -- 172.21.15.154:0/3621481082 learned_addr learned my addr 172.21.15.154:0/3621481082 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff8017cc700 1 --2- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12eb70 0x7ff7fc09aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff800fcb700 1 -- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12eb70 msgr2=0x7ff7fc09aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff800fcb700 1 --2- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12eb70 0x7ff7fc09aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff800fcb700 1 -- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7fc12e260 msgr2=0x7ff7fc09a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff800fcb700 1 --2- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7fc12e260 0x7ff7fc09a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff800fcb700 1 -- 172.21.15.154:0/3621481082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00094a0 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff7fbfff700 1 --2- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7fc12e260 0x7ff7fc09a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff800fcb700 1 --2- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc09f3d0 0x7ff7fc09a460 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000ebe0 tx=0x7ff7f000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:07.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff7f97fa700 1 -- 172.21.15.154:0/3621481082 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f000c850 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff7f97fa700 1 -- 172.21.15.154:0/3621481082 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f000c9b0 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff80322f700 1 -- 172.21.15.154:0/3621481082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e80094a0 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff7f97fa700 1 -- 172.21.15.154:0/3621481082 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f000cd40 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.830+0000 7ff80322f700 1 -- 172.21.15.154:0/3621481082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc12bb00 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.831+0000 7ff7f97fa700 1 -- 172.21.15.154:0/3621481082 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7f0013470 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.831+0000 7ff7f97fa700 1 -- 172.21.15.154:0/3621481082 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff7f003fb30 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.831+0000 7ff80322f700 1 -- 172.21.15.154:0/3621481082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc11dcb0 con 0x7ff7fc09f3d0 2023-09-30T22:29:07.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:07.836+0000 7ff7f97fa700 1 -- 172.21.15.154:0/3621481082 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7fc11dcb0 con 0x7ff7fc09f3d0 2023-09-30T22:29:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.020+0000 7ff80322f700 1 -- 172.21.15.154:0/3621481082 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7fc11dcb0 con 0x7ff7fc09f3d0 2023-09-30T22:29:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.020+0000 7ff7f97fa700 1 -- 172.21.15.154:0/3621481082 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7fc11dcb0 con 0x7ff7fc09f3d0 2023-09-30T22:29:08.021 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:08.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.022+0000 7ff80322f700 1 -- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc09f3d0 msgr2=0x7ff7fc09a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.022+0000 7ff80322f700 1 --2- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc09f3d0 0x7ff7fc09a460 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000ebe0 tx=0x7ff7f000eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.022+0000 7ff80322f700 1 -- 172.21.15.154:0/3621481082 shutdown_connections 2023-09-30T22:29:08.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.022+0000 7ff80322f700 1 --2- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7fc12eb70 0x7ff7fc09aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.022+0000 7ff80322f700 1 --2- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff7fc09f3d0 0x7ff7fc09a460 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.022+0000 7ff80322f700 1 --2- 172.21.15.154:0/3621481082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7fc12e260 0x7ff7fc09a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.022+0000 7ff80322f700 1 -- 172.21.15.154:0/3621481082 >> 172.21.15.154:0/3621481082 conn(0x7ff7fc099c40 msgr2=0x7ff7fc1b8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.022+0000 7ff80322f700 1 -- 172.21.15.154:0/3621481082 shutdown_connections 2023-09-30T22:29:08.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.022+0000 7ff80322f700 1 -- 172.21.15.154:0/3621481082 wait complete. 2023-09-30T22:29:08.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:08.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:08.142 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:08.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.157+0000 7f1311677700 1 Processor -- start 2023-09-30T22:29:08.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.157+0000 7f1311677700 1 -- start start 2023-09-30T22:29:08.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f1311677700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09e870 0x7f130c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f1311677700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f130c09f180 0x7f130c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f1311677700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c09fa00 con 0x7f130c134160 2023-09-30T22:29:08.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f1311677700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c0a0370 con 0x7f130c09f180 2023-09-30T22:29:08.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f1311677700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c06bec0 con 0x7f130c09e870 2023-09-30T22:29:08.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09e870 0x7f130c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130a7fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f130c09f180 0x7f130c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09e870 0x7f130c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51316/0 (socket says 172.21.15.154:51316) 2023-09-30T22:29:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130affd700 1 -- 172.21.15.154:0/1893587567 learned_addr learned my addr 172.21.15.154:0/1893587567 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130a7fc700 1 -- 172.21.15.154:0/1893587567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09e870 msgr2=0x7f130c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130a7fc700 1 --2- 172.21.15.154:0/1893587567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09e870 0x7f130c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130a7fc700 1 -- 172.21.15.154:0/1893587567 >> v1:172.21.15.154:6789/0 conn(0x7f130c134160 legacy=0x7f130c13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130a7fc700 1 -- 172.21.15.154:0/1893587567 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c09ada0 con 0x7f130c09f180 2023-09-30T22:29:08.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130affd700 1 --2- 172.21.15.154:0/1893587567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09e870 0x7f130c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:08.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.158+0000 7f130a7fc700 1 --2- 172.21.15.154:0/1893587567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c09f180 0x7f130c133c20 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f1300009840 tx=0x7f1300009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f56a45de5290590 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1309ffb700 1 -- 172.21.15.154:0/1893587567 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300011830 con 0x7f130c09f180 2023-09-30T22:29:08.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1309ffb700 1 -- 172.21.15.154:0/1893587567 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300011990 con 0x7f130c09f180 2023-09-30T22:29:08.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1309ffb700 1 -- 172.21.15.154:0/1893587567 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300011d20 con 0x7f130c09f180 2023-09-30T22:29:08.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1311677700 1 -- 172.21.15.154:0/1893587567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c09f180 msgr2=0x7f130c133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1311677700 1 --2- 172.21.15.154:0/1893587567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c09f180 0x7f130c133c20 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f1300009840 tx=0x7f1300009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1311677700 1 -- 172.21.15.154:0/1893587567 shutdown_connections 2023-09-30T22:29:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1311677700 1 --2- 172.21.15.154:0/1893587567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09e870 0x7f130c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1311677700 1 --2- 172.21.15.154:0/1893587567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c09f180 0x7f130c133c20 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1311677700 1 -- 172.21.15.154:0/1893587567 >> 172.21.15.154:0/1893587567 conn(0x7f130c0a4430 msgr2=0x7f130c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1311677700 1 -- 172.21.15.154:0/1893587567 shutdown_connections 2023-09-30T22:29:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.159+0000 7f1311677700 1 -- 172.21.15.154:0/1893587567 wait complete. 2023-09-30T22:29:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.160+0000 7f1311677700 1 Processor -- start 2023-09-30T22:29:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.160+0000 7f1311677700 1 -- start start 2023-09-30T22:29:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f1311677700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c09e870 0x7f130c122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f1311677700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09f180 0x7f130c123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f1311677700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f130c134160 0x7f130c123550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f1311677700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c06fb80 con 0x7f130c09e870 2023-09-30T22:29:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f1311677700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c1335f0 con 0x7f130c09f180 2023-09-30T22:29:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f1311677700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f130c1247f0 con 0x7f130c134160 2023-09-30T22:29:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09f180 0x7f130c123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f130c134160 0x7f130c123550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130a7fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09f180 0x7f130c123010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51318/0 (socket says 172.21.15.154:51318) 2023-09-30T22:29:08.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f130c134160 0x7f130c123550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55362/0 (socket says 172.21.15.154:55362) 2023-09-30T22:29:08.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130a7fc700 1 -- 172.21.15.154:0/1724614960 learned_addr learned my addr 172.21.15.154:0/1724614960 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:08.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130a7fc700 1 -- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f130c134160 msgr2=0x7f130c123550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130a7fc700 1 --2- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f130c134160 0x7f130c123550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130a7fc700 1 -- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c09e870 msgr2=0x7f130c122ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130a7fc700 1 --2- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c09e870 0x7f130c122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130a7fc700 1 -- 172.21.15.154:0/1724614960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009550 con 0x7f130c09f180 2023-09-30T22:29:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.161+0000 7f130a7fc700 1 --2- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09f180 0x7f130c123010 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f13000090b0 tx=0x7f1300004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.162+0000 7f12f37fe700 1 -- 172.21.15.154:0/1724614960 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000036a0 con 0x7f130c09f180 2023-09-30T22:29:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.162+0000 7f12f37fe700 1 -- 172.21.15.154:0/1724614960 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130001f070 con 0x7f130c09f180 2023-09-30T22:29:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.162+0000 7f12f37fe700 1 -- 172.21.15.154:0/1724614960 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300003a20 con 0x7f130c09f180 2023-09-30T22:29:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.162+0000 7f1311677700 1 -- 172.21.15.154:0/1724614960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13000094a0 con 0x7f130c09f180 2023-09-30T22:29:08.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.162+0000 7f1311677700 1 -- 172.21.15.154:0/1724614960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c126310 con 0x7f130c09f180 2023-09-30T22:29:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.163+0000 7f12f37fe700 1 -- 172.21.15.154:0/1724614960 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1300003b80 con 0x7f130c09f180 2023-09-30T22:29:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.163+0000 7f1311677700 1 -- 172.21.15.154:0/1724614960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c04f2a0 con 0x7f130c09f180 2023-09-30T22:29:08.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.163+0000 7f12f37fe700 1 -- 172.21.15.154:0/1724614960 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1300021070 con 0x7f130c09f180 2023-09-30T22:29:08.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:08.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.168+0000 7f12f37fe700 1 -- 172.21.15.154:0/1724614960 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f130002fd70 con 0x7f130c09f180 2023-09-30T22:29:08.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.270+0000 7f0b19339700 1 Processor -- start 2023-09-30T22:29:08.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.270+0000 7f0b19339700 1 -- start start 2023-09-30T22:29:08.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.271+0000 7f0b19339700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b14134140 0x7f0b14138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.271+0000 7f0b19339700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 0x7f0b1413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.271+0000 7f0b19339700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1409b110 con 0x7f0b1409ad40 2023-09-30T22:29:08.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.271+0000 7f0b19339700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b140a3b60 con 0x7f0b14134140 2023-09-30T22:29:08.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.271+0000 7f0b19339700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140a1a80 con 0x7f0b141345a0 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.271+0000 7f0b127fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b14134140 0x7f0b14138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.271+0000 7f0b137fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 0x7f0b1413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.271+0000 7f0b127fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b14134140 0x7f0b14138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34452/0 (socket says 172.21.15.154:34452) 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.271+0000 7f0b127fc700 1 -- 172.21.15.154:0/2524559446 learned_addr learned my addr 172.21.15.154:0/2524559446 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b127fc700 1 -- 172.21.15.154:0/2524559446 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 msgr2=0x7f0b1413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b127fc700 1 --2- 172.21.15.154:0/2524559446 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 0x7f0b1413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b127fc700 1 -- 172.21.15.154:0/2524559446 >> v1:172.21.15.154:6789/0 conn(0x7f0b1409ad40 legacy=0x7f0b14133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b127fc700 1 -- 172.21.15.154:0/2524559446 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140a2fa0 con 0x7f0b14134140 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b127fc700 1 --2- 172.21.15.154:0/2524559446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 0x7f0b14138e80 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f0b080098f0 tx=0x7f0b08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a3d713d66e846e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b11ffb700 1 -- 172.21.15.154:0/2524559446 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08011830 con 0x7f0b14134140 2023-09-30T22:29:08.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b11ffb700 1 -- 172.21.15.154:0/2524559446 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b08011990 con 0x7f0b14134140 2023-09-30T22:29:08.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b11ffb700 1 -- 172.21.15.154:0/2524559446 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08011d20 con 0x7f0b14134140 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b19339700 1 -- 172.21.15.154:0/2524559446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 msgr2=0x7f0b14138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.272+0000 7f0b19339700 1 --2- 172.21.15.154:0/2524559446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 0x7f0b14138e80 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f0b080098f0 tx=0x7f0b08009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.273+0000 7f0b19339700 1 -- 172.21.15.154:0/2524559446 shutdown_connections 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.273+0000 7f0b19339700 1 --2- 172.21.15.154:0/2524559446 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 0x7f0b1413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.273+0000 7f0b19339700 1 --2- 172.21.15.154:0/2524559446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 0x7f0b14138e80 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.273+0000 7f0b19339700 1 -- 172.21.15.154:0/2524559446 >> 172.21.15.154:0/2524559446 conn(0x7f0b14099c40 msgr2=0x7f0b1406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.273+0000 7f0b19339700 1 -- 172.21.15.154:0/2524559446 shutdown_connections 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.273+0000 7f0b19339700 1 -- 172.21.15.154:0/2524559446 wait complete. 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b19339700 1 Processor -- start 2023-09-30T22:29:08.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b19339700 1 -- start start 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b19339700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b1409ad40 0x7f0b1411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b19339700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 0x7f0b1411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b19339700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 0x7f0b1411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b19339700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1411e7e0 con 0x7f0b14134140 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b19339700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1411e2b0 con 0x7f0b1409ad40 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b19339700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140a4110 con 0x7f0b141345a0 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b127fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 0x7f0b1411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b127fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 0x7f0b1411ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34466/0 (socket says 172.21.15.154:34466) 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b127fc700 1 -- 172.21.15.154:0/561061791 learned_addr learned my addr 172.21.15.154:0/561061791 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b137fe700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 0x7f0b1411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.274+0000 7f0b12ffd700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b1409ad40 0x7f0b1411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0b127fc700 1 -- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 msgr2=0x7f0b1411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0b127fc700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 0x7f0b1411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0b127fc700 1 -- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b1409ad40 msgr2=0x7f0b1411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0b127fc700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b1409ad40 0x7f0b1411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0b127fc700 1 -- 172.21.15.154:0/561061791 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08009550 con 0x7f0b14134140 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0b137fe700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 0x7f0b1411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0b127fc700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 0x7f0b1411ce00 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009c40 tx=0x7f0b08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0afb7fe700 1 -- 172.21.15.154:0/561061791 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08004510 con 0x7f0b14134140 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0b19339700 1 -- 172.21.15.154:0/561061791 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1409c7e0 con 0x7f0b14134140 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0afb7fe700 1 -- 172.21.15.154:0/561061791 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0801e070 con 0x7f0b14134140 2023-09-30T22:29:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0afb7fe700 1 -- 172.21.15.154:0/561061791 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080038e0 con 0x7f0b14134140 2023-09-30T22:29:08.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.275+0000 7f0b19339700 1 -- 172.21.15.154:0/561061791 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b141399f0 con 0x7f0b14134140 2023-09-30T22:29:08.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.276+0000 7f0afb7fe700 1 -- 172.21.15.154:0/561061791 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b08003a40 con 0x7f0b14134140 2023-09-30T22:29:08.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.276+0000 7f0b19339700 1 -- 172.21.15.154:0/561061791 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1404f2a0 con 0x7f0b14134140 2023-09-30T22:29:08.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.276+0000 7f0afb7fe700 1 -- 172.21.15.154:0/561061791 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b08020070 con 0x7f0b14134140 2023-09-30T22:29:08.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.281+0000 7f0afb7fe700 1 -- 172.21.15.154:0/561061791 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b0800b3e0 con 0x7f0b14134140 2023-09-30T22:29:08.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.301+0000 7f0a0b413700 1 Processor -- start 2023-09-30T22:29:08.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.302+0000 7f0a0b413700 1 -- start start 2023-09-30T22:29:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.302+0000 7f0a0b413700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.302+0000 7f0a0b413700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a04139200 0x7f0a0413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a0b413700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0409e9d0 con 0x7f0a040a0a70 2023-09-30T22:29:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a0b413700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0409dc00 con 0x7f0a04139200 2023-09-30T22:29:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a0b413700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0409dec0 con 0x7f0a040a1550 2023-09-30T22:29:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a091af700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0a040a0a70 0x7f0a040a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54500/0 (socket says 172.21.15.154:54500) 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a091af700 1 -- 172.21.15.154:0/1509768990 learned_addr learned my addr 172.21.15.154:0/1509768990 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a089ae700 1 --2- 172.21.15.154:0/1509768990 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a099b0700 1 --2- 172.21.15.154:0/1509768990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a04139200 0x7f0a0413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f09fbfff700 1 -- 172.21.15.154:0/1509768990 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071218028 0 0) 0x7f0a0409e9d0 con 0x7f0a040a0a70 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f09fbfff700 1 -- 172.21.15.154:0/1509768990 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f00035b0 con 0x7f0a040a0a70 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a089ae700 1 -- 172.21.15.154:0/1509768990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a04139200 msgr2=0x7f0a0413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a089ae700 1 --2- 172.21.15.154:0/1509768990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a04139200 0x7f0a0413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a089ae700 1 -- 172.21.15.154:0/1509768990 >> v1:172.21.15.154:6789/0 conn(0x7f0a040a0a70 legacy=0x7f0a040a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a089ae700 1 -- 172.21.15.154:0/1509768990 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0409e6a0 con 0x7f0a040a1550 2023-09-30T22:29:08.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f0a089ae700 1 --2- 172.21.15.154:0/1509768990 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04138cc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009870 tx=0x7f09f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e193441f1071477b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f09fbfff700 1 -- 172.21.15.154:0/1509768990 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4011830 con 0x7f0a040a1550 2023-09-30T22:29:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f09fbfff700 1 -- 172.21.15.154:0/1509768990 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f4011990 con 0x7f0a040a1550 2023-09-30T22:29:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.303+0000 7f09fbfff700 1 -- 172.21.15.154:0/1509768990 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4011d00 con 0x7f0a040a1550 2023-09-30T22:29:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.304+0000 7f0a0b413700 1 -- 172.21.15.154:0/1509768990 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 msgr2=0x7f0a04138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.304+0000 7f0a0b413700 1 --2- 172.21.15.154:0/1509768990 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04138cc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009870 tx=0x7f09f4009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.304+0000 7f0a0b413700 1 -- 172.21.15.154:0/1509768990 shutdown_connections 2023-09-30T22:29:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.304+0000 7f0a0b413700 1 --2- 172.21.15.154:0/1509768990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a04139200 0x7f0a0413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.304+0000 7f0a0b413700 1 --2- 172.21.15.154:0/1509768990 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04138cc0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.304+0000 7f0a0b413700 1 -- 172.21.15.154:0/1509768990 >> 172.21.15.154:0/1509768990 conn(0x7f0a040a6610 msgr2=0x7f0a040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.304+0000 7f0a0b413700 1 -- 172.21.15.154:0/1509768990 shutdown_connections 2023-09-30T22:29:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.304+0000 7f0a0b413700 1 -- 172.21.15.154:0/1509768990 wait complete. 2023-09-30T22:29:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.305+0000 7f0a0b413700 1 Processor -- start 2023-09-30T22:29:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.305+0000 7f0a0b413700 1 -- start start 2023-09-30T22:29:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a0b413700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a04121790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a0b413700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04121cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a0b413700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04139200 0x7f0a04122210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a0b413700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04123540 con 0x7f0a04139200 2023-09-30T22:29:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a0b413700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04123350 con 0x7f0a040a0a70 2023-09-30T22:29:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a0b413700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a041376c0 con 0x7f0a040a1550 2023-09-30T22:29:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a089ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04121cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a091af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a04121790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a089ae700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04121cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55400/0 (socket says 172.21.15.154:55400) 2023-09-30T22:29:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a089ae700 1 -- 172.21.15.154:0/1278585930 learned_addr learned my addr 172.21.15.154:0/1278585930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a099b0700 1 --2- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04139200 0x7f0a04122210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a089ae700 1 -- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 msgr2=0x7f0a04121790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a089ae700 1 --2- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a04121790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a089ae700 1 -- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04139200 msgr2=0x7f0a04122210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a089ae700 1 --2- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04139200 0x7f0a04122210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a089ae700 1 -- 172.21.15.154:0/1278585930 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40094a0 con 0x7f0a040a1550 2023-09-30T22:29:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a089ae700 1 --2- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04121cd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f09f4000c00 tx=0x7f09f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f09f9ffb700 1 -- 172.21.15.154:0/1278585930 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40045d0 con 0x7f0a040a1550 2023-09-30T22:29:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f09f9ffb700 1 -- 172.21.15.154:0/1278585930 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f401f070 con 0x7f0a040a1550 2023-09-30T22:29:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f09f9ffb700 1 -- 172.21.15.154:0/1278585930 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40038c0 con 0x7f0a040a1550 2023-09-30T22:29:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.306+0000 7f0a0b413700 1 -- 172.21.15.154:0/1278585930 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a040a03e0 con 0x7f0a040a1550 2023-09-30T22:29:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.307+0000 7f0a0b413700 1 -- 172.21.15.154:0/1278585930 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a04123b40 con 0x7f0a040a1550 2023-09-30T22:29:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.308+0000 7f09f9ffb700 1 -- 172.21.15.154:0/1278585930 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09f4003a20 con 0x7f0a040a1550 2023-09-30T22:29:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.308+0000 7f0a0b413700 1 -- 172.21.15.154:0/1278585930 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a04124c20 con 0x7f0a040a1550 2023-09-30T22:29:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.308+0000 7f09f9ffb700 1 -- 172.21.15.154:0/1278585930 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09f4021070 con 0x7f0a040a1550 2023-09-30T22:29:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.312+0000 7f09f9ffb700 1 -- 172.21.15.154:0/1278585930 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a04124c20 con 0x7f0a040a1550 2023-09-30T22:29:08.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.366+0000 7f1311677700 1 -- 172.21.15.154:0/1724614960 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f130c06c9d0 con 0x7f130c09f180 2023-09-30T22:29:08.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.367+0000 7f12f37fe700 1 -- 172.21.15.154:0/1724614960 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1300015070 con 0x7f130c09f180 2023-09-30T22:29:08.368 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:08.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.369+0000 7f1311677700 1 -- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09f180 msgr2=0x7f130c123010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.369+0000 7f1311677700 1 --2- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09f180 0x7f130c123010 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f13000090b0 tx=0x7f1300004750 comp rx=0 tx=0).stop 2023-09-30T22:29:08.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.369+0000 7f1311677700 1 -- 172.21.15.154:0/1724614960 shutdown_connections 2023-09-30T22:29:08.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.369+0000 7f1311677700 1 --2- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f130c134160 0x7f130c123550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.369+0000 7f1311677700 1 --2- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f130c09e870 0x7f130c122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.369+0000 7f1311677700 1 --2- 172.21.15.154:0/1724614960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f130c09f180 0x7f130c123010 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.369+0000 7f1311677700 1 -- 172.21.15.154:0/1724614960 >> 172.21.15.154:0/1724614960 conn(0x7f130c0a4430 msgr2=0x7f130c09d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.369+0000 7f1311677700 1 -- 172.21.15.154:0/1724614960 shutdown_connections 2023-09-30T22:29:08.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.369+0000 7f1311677700 1 -- 172.21.15.154:0/1724614960 wait complete. 2023-09-30T22:29:08.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.481+0000 7f0b19339700 1 -- 172.21.15.154:0/561061791 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0b140729d0 con 0x7f0b14134140 2023-09-30T22:29:08.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.481+0000 7f0afb7fe700 1 -- 172.21.15.154:0/561061791 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b08015020 con 0x7f0b14134140 2023-09-30T22:29:08.483 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:08.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.483+0000 7f0b19339700 1 -- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 msgr2=0x7f0b1411ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.483+0000 7f0b19339700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 0x7f0b1411ce00 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009c40 tx=0x7f0b08004750 comp rx=0 tx=0).stop 2023-09-30T22:29:08.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.483+0000 7f0b19339700 1 -- 172.21.15.154:0/561061791 shutdown_connections 2023-09-30T22:29:08.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.483+0000 7f0b19339700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0b141345a0 0x7f0b1411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.483+0000 7f0b19339700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b1409ad40 0x7f0b1411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.483+0000 7f0b19339700 1 --2- 172.21.15.154:0/561061791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b14134140 0x7f0b1411ce00 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.483+0000 7f0b19339700 1 -- 172.21.15.154:0/561061791 >> 172.21.15.154:0/561061791 conn(0x7f0b14099c40 msgr2=0x7f0b140a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.483+0000 7f0b19339700 1 -- 172.21.15.154:0/561061791 shutdown_connections 2023-09-30T22:29:08.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.484+0000 7f0b19339700 1 -- 172.21.15.154:0/561061791 wait complete. 2023-09-30T22:29:08.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:08.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.510+0000 7f0a0b413700 1 -- 172.21.15.154:0/1278585930 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a04124c20 con 0x7f0a040a1550 2023-09-30T22:29:08.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.510+0000 7f09f9ffb700 1 -- 172.21.15.154:0/1278585930 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a04124c20 con 0x7f0a040a1550 2023-09-30T22:29:08.512 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:08.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.512+0000 7f0a0b413700 1 -- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 msgr2=0x7f0a04121cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:08.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.512+0000 7f0a0b413700 1 --2- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04121cd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f09f4000c00 tx=0x7f09f4004750 comp rx=0 tx=0).stop 2023-09-30T22:29:08.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.513+0000 7f0a0b413700 1 -- 172.21.15.154:0/1278585930 shutdown_connections 2023-09-30T22:29:08.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.513+0000 7f0a0b413700 1 --2- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a04139200 0x7f0a04122210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.513+0000 7f0a0b413700 1 --2- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a040a0a70 0x7f0a04121790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.513+0000 7f0a0b413700 1 --2- 172.21.15.154:0/1278585930 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f0a040a1550 0x7f0a04121cd0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:08.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.513+0000 7f0a0b413700 1 -- 172.21.15.154:0/1278585930 >> 172.21.15.154:0/1278585930 conn(0x7f0a040a6610 msgr2=0x7f0a040a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:08.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.513+0000 7f0a0b413700 1 -- 172.21.15.154:0/1278585930 shutdown_connections 2023-09-30T22:29:08.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:08.513+0000 7f0a0b413700 1 -- 172.21.15.154:0/1278585930 wait complete. 2023-09-30T22:29:08.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:09.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:09.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.163+0000 7ff446647700 1 Processor -- start 2023-09-30T22:29:09.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.163+0000 7ff446647700 1 -- start start 2023-09-30T22:29:09.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff446647700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff44006a770 0x7ff44006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff446647700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006b080 0x7ff4401317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff446647700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44009da80 con 0x7ff440131cf0 2023-09-30T22:29:09.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff446647700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44009dce0 con 0x7ff44006a770 2023-09-30T22:29:09.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff446647700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff44009eb20 con 0x7ff44006b080 2023-09-30T22:29:09.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006b080 0x7ff4401317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff44006a770 0x7ff44006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff44006a770 0x7ff44006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34488/0 (socket says 172.21.15.154:34488) 2023-09-30T22:29:09.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43f7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006b080 0x7ff4401317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55414/0 (socket says 172.21.15.154:55414) 2023-09-30T22:29:09.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43ffff700 1 -- 172.21.15.154:0/2196204713 learned_addr learned my addr 172.21.15.154:0/2196204713 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:09.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43f7fe700 1 -- 172.21.15.154:0/2196204713 >> v2:172.21.15.154:3300/0 conn(0x7ff44006a770 msgr2=0x7ff44006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43f7fe700 1 --2- 172.21.15.154:0/2196204713 >> v2:172.21.15.154:3300/0 conn(0x7ff44006a770 0x7ff44006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43f7fe700 1 -- 172.21.15.154:0/2196204713 >> v1:172.21.15.154:6789/0 conn(0x7ff440131cf0 legacy=0x7ff440138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43f7fe700 1 -- 172.21.15.154:0/2196204713 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44009d860 con 0x7ff44006b080 2023-09-30T22:29:09.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.164+0000 7ff43ffff700 1 --2- 172.21.15.154:0/2196204713 >> v2:172.21.15.154:3300/0 conn(0x7ff44006a770 0x7ff44006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff43f7fe700 1 --2- 172.21.15.154:0/2196204713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006b080 0x7ff4401317b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff42800dce0 tx=0x7ff42800d620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=362835cebb2935b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff43effd700 1 -- 172.21.15.154:0/2196204713 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428017860 con 0x7ff44006b080 2023-09-30T22:29:09.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff43effd700 1 -- 172.21.15.154:0/2196204713 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4280179c0 con 0x7ff44006b080 2023-09-30T22:29:09.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff43effd700 1 -- 172.21.15.154:0/2196204713 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428017d50 con 0x7ff44006b080 2023-09-30T22:29:09.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff446647700 1 -- 172.21.15.154:0/2196204713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006b080 msgr2=0x7ff4401317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff446647700 1 --2- 172.21.15.154:0/2196204713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006b080 0x7ff4401317b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff42800dce0 tx=0x7ff42800d620 comp rx=0 tx=0).stop 2023-09-30T22:29:09.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff446647700 1 -- 172.21.15.154:0/2196204713 shutdown_connections 2023-09-30T22:29:09.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff446647700 1 --2- 172.21.15.154:0/2196204713 >> v2:172.21.15.154:3300/0 conn(0x7ff44006a770 0x7ff44006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff446647700 1 --2- 172.21.15.154:0/2196204713 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006b080 0x7ff4401317b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff446647700 1 -- 172.21.15.154:0/2196204713 >> 172.21.15.154:0/2196204713 conn(0x7ff440099c40 msgr2=0x7ff4400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff446647700 1 -- 172.21.15.154:0/2196204713 shutdown_connections 2023-09-30T22:29:09.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.165+0000 7ff446647700 1 -- 172.21.15.154:0/2196204713 wait complete. 2023-09-30T22:29:09.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.166+0000 7ff446647700 1 Processor -- start 2023-09-30T22:29:09.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.166+0000 7ff446647700 1 -- start start 2023-09-30T22:29:09.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff446647700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006a770 0x7ff4401c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff446647700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44006b080 0x7ff4401c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff446647700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff440131cf0 0x7ff4401c0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff446647700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44011f820 con 0x7ff44006b080 2023-09-30T22:29:09.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff446647700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401c4d20 con 0x7ff440131cf0 2023-09-30T22:29:09.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff446647700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400a27d0 con 0x7ff44006a770 2023-09-30T22:29:09.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006a770 0x7ff4401c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006a770 0x7ff4401c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55420/0 (socket says 172.21.15.154:55420) 2023-09-30T22:29:09.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43ffff700 1 -- 172.21.15.154:0/1099895361 learned_addr learned my addr 172.21.15.154:0/1099895361 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:09.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff444be4700 1 --2- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff440131cf0 0x7ff4401c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43f7fe700 1 --2- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44006b080 0x7ff4401c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43ffff700 1 -- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff440131cf0 msgr2=0x7ff4401c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43ffff700 1 --2- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff440131cf0 0x7ff4401c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43ffff700 1 -- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44006b080 msgr2=0x7ff4401c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43ffff700 1 --2- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44006b080 0x7ff4401c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43ffff700 1 -- 172.21.15.154:0/1099895361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430009550 con 0x7ff44006a770 2023-09-30T22:29:09.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43ffff700 1 --2- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006a770 0x7ff4401c42a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff43000ebe0 tx=0x7ff43000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.167+0000 7ff43cff9700 1 -- 172.21.15.154:0/1099895361 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000c850 con 0x7ff44006a770 2023-09-30T22:29:09.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.168+0000 7ff43cff9700 1 -- 172.21.15.154:0/1099895361 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43000c9b0 con 0x7ff44006a770 2023-09-30T22:29:09.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.168+0000 7ff43cff9700 1 -- 172.21.15.154:0/1099895361 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000cd40 con 0x7ff44006a770 2023-09-30T22:29:09.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.168+0000 7ff446647700 1 -- 172.21.15.154:0/1099895361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42800d940 con 0x7ff44006a770 2023-09-30T22:29:09.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.168+0000 7ff446647700 1 -- 172.21.15.154:0/1099895361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44011ebd0 con 0x7ff44006a770 2023-09-30T22:29:09.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.168+0000 7ff43cff9700 1 -- 172.21.15.154:0/1099895361 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff430013470 con 0x7ff44006a770 2023-09-30T22:29:09.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.168+0000 7ff43cff9700 1 -- 172.21.15.154:0/1099895361 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff43003fc00 con 0x7ff44006a770 2023-09-30T22:29:09.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.169+0000 7ff446647700 1 -- 172.21.15.154:0/1099895361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44004f2a0 con 0x7ff44006a770 2023-09-30T22:29:09.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.173+0000 7ff43cff9700 1 -- 172.21.15.154:0/1099895361 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff43001b3b0 con 0x7ff44006a770 2023-09-30T22:29:09.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.355+0000 7ff446647700 1 -- 172.21.15.154:0/1099895361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff44011d910 con 0x7ff44006a770 2023-09-30T22:29:09.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.356+0000 7ff43cff9700 1 -- 172.21.15.154:0/1099895361 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff430024350 con 0x7ff44006a770 2023-09-30T22:29:09.357 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.358+0000 7ff446647700 1 -- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006a770 msgr2=0x7ff4401c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.358+0000 7ff446647700 1 --2- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006a770 0x7ff4401c42a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff43000ebe0 tx=0x7ff43000eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.358+0000 7ff446647700 1 -- 172.21.15.154:0/1099895361 shutdown_connections 2023-09-30T22:29:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.358+0000 7ff446647700 1 --2- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff440131cf0 0x7ff4401c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.358+0000 7ff446647700 1 --2- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7ff44006a770 0x7ff4401c42a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.358+0000 7ff446647700 1 --2- 172.21.15.154:0/1099895361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44006b080 0x7ff4401c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.358+0000 7ff446647700 1 -- 172.21.15.154:0/1099895361 >> 172.21.15.154:0/1099895361 conn(0x7ff440099c40 msgr2=0x7ff440130de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.358+0000 7ff446647700 1 -- 172.21.15.154:0/1099895361 shutdown_connections 2023-09-30T22:29:09.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.358+0000 7ff446647700 1 -- 172.21.15.154:0/1099895361 wait complete. 2023-09-30T22:29:09.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:09.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:09.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:09.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.504+0000 7f893ffcf700 1 Processor -- start 2023-09-30T22:29:09.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.504+0000 7f893ffcf700 1 -- start start 2023-09-30T22:29:09.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893ffcf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 0x7f8938133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893ffcf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8938130bc0 0x7f893813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893ffcf700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893806b2d0 con 0x7f89381300a0 2023-09-30T22:29:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893ffcf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8938133610 con 0x7f8938130bc0 2023-09-30T22:29:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893ffcf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893809a500 con 0x7f8938133ad0 2023-09-30T22:29:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893dd6b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 0x7f8938133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893e56c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8938130bc0 0x7f893813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893d56a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f89381300a0 0x7f89381304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54520/0 (socket says 172.21.15.154:54520) 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893d56a700 1 -- 172.21.15.154:0/3509779561 learned_addr learned my addr 172.21.15.154:0/3509779561 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893dd6b700 1 -- 172.21.15.154:0/3509779561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8938130bc0 msgr2=0x7f893813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893dd6b700 1 --2- 172.21.15.154:0/3509779561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8938130bc0 0x7f893813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893dd6b700 1 -- 172.21.15.154:0/3509779561 >> v1:172.21.15.154:6789/0 conn(0x7f89381300a0 legacy=0x7f89381304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893cd69700 1 -- 172.21.15.154:0/3509779561 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156469012 0 0) 0x7f893806b2d0 con 0x7f89381300a0 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893dd6b700 1 -- 172.21.15.154:0/3509779561 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89381338b0 con 0x7f8938133ad0 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.505+0000 7f893e56c700 1 --2- 172.21.15.154:0/3509779561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8938130bc0 0x7f893813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893dd6b700 1 --2- 172.21.15.154:0/3509779561 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 0x7f8938133ea0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f8934009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9139d8481467bd52 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893cd69700 1 -- 172.21.15.154:0/3509779561 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934011830 con 0x7f8938133ad0 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893cd69700 1 -- 172.21.15.154:0/3509779561 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8934011990 con 0x7f8938133ad0 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893cd69700 1 -- 172.21.15.154:0/3509779561 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934011d20 con 0x7f8938133ad0 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893ffcf700 1 -- 172.21.15.154:0/3509779561 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 msgr2=0x7f8938133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893ffcf700 1 --2- 172.21.15.154:0/3509779561 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 0x7f8938133ea0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f8934009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:09.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893ffcf700 1 -- 172.21.15.154:0/3509779561 shutdown_connections 2023-09-30T22:29:09.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893ffcf700 1 --2- 172.21.15.154:0/3509779561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8938130bc0 0x7f893813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893ffcf700 1 --2- 172.21.15.154:0/3509779561 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 0x7f8938133ea0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.506+0000 7f893ffcf700 1 -- 172.21.15.154:0/3509779561 >> 172.21.15.154:0/3509779561 conn(0x7f8938099c40 msgr2=0x7f89380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.507+0000 7f893ffcf700 1 -- 172.21.15.154:0/3509779561 shutdown_connections 2023-09-30T22:29:09.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.507+0000 7f893ffcf700 1 -- 172.21.15.154:0/3509779561 wait complete. 2023-09-30T22:29:09.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.508+0000 7f893ffcf700 1 Processor -- start 2023-09-30T22:29:09.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.508+0000 7f893ffcf700 1 -- start start 2023-09-30T22:29:09.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.508+0000 7f893ffcf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89381300a0 0x7f893811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.508+0000 7f893ffcf700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8938130bc0 0x7f893811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893ffcf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 0x7f893811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893ffcf700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893812da10 con 0x7f8938130bc0 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893ffcf700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8938120a30 con 0x7f89381300a0 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893ffcf700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89380a3400 con 0x7f8938133ad0 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893d56a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8938130bc0 0x7f893811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893d56a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8938130bc0 0x7f893811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34510/0 (socket says 172.21.15.154:34510) 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893dd6b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89381300a0 0x7f893811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893d56a700 1 -- 172.21.15.154:0/2100463848 learned_addr learned my addr 172.21.15.154:0/2100463848 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893e56c700 1 --2- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 0x7f893811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893d56a700 1 -- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 msgr2=0x7f893811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893d56a700 1 --2- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 0x7f893811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893d56a700 1 -- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89381300a0 msgr2=0x7f893811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893d56a700 1 --2- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89381300a0 0x7f893811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893d56a700 1 -- 172.21.15.154:0/2100463848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8930009a70 con 0x7f8938130bc0 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893dd6b700 1 --2- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89381300a0 0x7f893811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893d56a700 1 --2- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8938130bc0 0x7f893811df80 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f892800c450 tx=0x7f892800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f892e7fc700 1 -- 172.21.15.154:0/2100463848 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928004c80 con 0x7f8938130bc0 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f892e7fc700 1 -- 172.21.15.154:0/2100463848 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928004e00 con 0x7f8938130bc0 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893ffcf700 1 -- 172.21.15.154:0/2100463848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89340094a0 con 0x7f8938130bc0 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f892e7fc700 1 -- 172.21.15.154:0/2100463848 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928007310 con 0x7f8938130bc0 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.509+0000 7f893ffcf700 1 -- 172.21.15.154:0/2100463848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893812dd50 con 0x7f8938130bc0 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.510+0000 7f892e7fc700 1 -- 172.21.15.154:0/2100463848 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8928007470 con 0x7f8938130bc0 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.510+0000 7f892e7fc700 1 -- 172.21.15.154:0/2100463848 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f892803f1a0 con 0x7f8938130bc0 2023-09-30T22:29:09.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.510+0000 7f893ffcf700 1 -- 172.21.15.154:0/2100463848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893804f2a0 con 0x7f8938130bc0 2023-09-30T22:29:09.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.515+0000 7f892e7fc700 1 -- 172.21.15.154:0/2100463848 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8928007720 con 0x7f8938130bc0 2023-09-30T22:29:09.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.624+0000 7f35cc957700 1 Processor -- start 2023-09-30T22:29:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.624+0000 7f35cc957700 1 -- start start 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35cc957700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c80a0a70 0x7f35c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35cc957700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c8134120 0x7f35c813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35cc957700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c809dc00 con 0x7f35c80a1380 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35cc957700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c809ea90 con 0x7f35c8134120 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35cc957700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35c809dec0 con 0x7f35c80a0a70 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35c5d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f35c80a1380 0x7f35c8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54536/0 (socket says 172.21.15.154:54536) 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35c5d9b700 1 -- 172.21.15.154:0/737263883 learned_addr learned my addr 172.21.15.154:0/737263883 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35c6d9d700 1 --2- 172.21.15.154:0/737263883 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c8134120 0x7f35c813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35c659c700 1 --2- 172.21.15.154:0/737263883 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c80a0a70 0x7f35c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35c659c700 1 -- 172.21.15.154:0/737263883 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c8134120 msgr2=0x7f35c813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35c559a700 1 -- 172.21.15.154:0/737263883 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882792510 0 0) 0x7f35c809dc00 con 0x7f35c80a1380 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35c659c700 1 --2- 172.21.15.154:0/737263883 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c8134120 0x7f35c813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35c659c700 1 -- 172.21.15.154:0/737263883 >> v1:172.21.15.154:6789/0 conn(0x7f35c80a1380 legacy=0x7f35c8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.625+0000 7f35c659c700 1 -- 172.21.15.154:0/737263883 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c809e6a0 con 0x7f35c80a0a70 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35c659c700 1 --2- 172.21.15.154:0/737263883 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c80a0a70 0x7f35c80a0e40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009870 tx=0x7f35b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57995064c676d00 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35c559a700 1 -- 172.21.15.154:0/737263883 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8011830 con 0x7f35c80a0a70 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35c559a700 1 -- 172.21.15.154:0/737263883 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b8011990 con 0x7f35c80a0a70 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35c559a700 1 -- 172.21.15.154:0/737263883 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8011d20 con 0x7f35c80a0a70 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35cc957700 1 -- 172.21.15.154:0/737263883 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c80a0a70 msgr2=0x7f35c80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35cc957700 1 --2- 172.21.15.154:0/737263883 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c80a0a70 0x7f35c80a0e40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009870 tx=0x7f35b8009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35cc957700 1 -- 172.21.15.154:0/737263883 shutdown_connections 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35cc957700 1 --2- 172.21.15.154:0/737263883 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c8134120 0x7f35c813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35cc957700 1 --2- 172.21.15.154:0/737263883 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c80a0a70 0x7f35c80a0e40 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35cc957700 1 -- 172.21.15.154:0/737263883 >> 172.21.15.154:0/737263883 conn(0x7f35c80a6610 msgr2=0x7f35c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.626+0000 7f35cc957700 1 -- 172.21.15.154:0/737263883 shutdown_connections 2023-09-30T22:29:09.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.627+0000 7f35cc957700 1 -- 172.21.15.154:0/737263883 wait complete. 2023-09-30T22:29:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35cc957700 1 Processor -- start 2023-09-30T22:29:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35cc957700 1 -- start start 2023-09-30T22:29:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35cc957700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c80a0a70 0x7f35c81227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35cc957700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80a1380 0x7f35c8122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35cc957700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c8134120 0x7f35c8123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35cc957700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8125930 con 0x7f35c80a1380 2023-09-30T22:29:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35cc957700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8124320 con 0x7f35c80a0a70 2023-09-30T22:29:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35cc957700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80a56b0 con 0x7f35c8134120 2023-09-30T22:29:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35c659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c80a0a70 0x7f35c81227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35c659c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c80a0a70 0x7f35c81227b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51396/0 (socket says 172.21.15.154:51396) 2023-09-30T22:29:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35c659c700 1 -- 172.21.15.154:0/169543134 learned_addr learned my addr 172.21.15.154:0/169543134 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35c5d9b700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80a1380 0x7f35c8122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.628+0000 7f35c6d9d700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c8134120 0x7f35c8123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35c5d9b700 1 -- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c8134120 msgr2=0x7f35c8123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35c5d9b700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c8134120 0x7f35c8123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35c5d9b700 1 -- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c80a0a70 msgr2=0x7f35c81227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35c5d9b700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c80a0a70 0x7f35c81227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35c5d9b700 1 -- 172.21.15.154:0/169543134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80094a0 con 0x7f35c80a1380 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35c659c700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c80a0a70 0x7f35c81227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35c5d9b700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80a1380 0x7f35c8122cf0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f35c80a2b70 tx=0x7f35bc00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35b6ffd700 1 -- 172.21.15.154:0/169543134 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc004c80 con 0x7f35c80a1380 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35b6ffd700 1 -- 172.21.15.154:0/169543134 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc004de0 con 0x7f35c80a1380 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35cc957700 1 -- 172.21.15.154:0/169543134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c8126230 con 0x7f35c80a1380 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35b6ffd700 1 -- 172.21.15.154:0/169543134 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc007310 con 0x7f35c80a1380 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.629+0000 7f35cc957700 1 -- 172.21.15.154:0/169543134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c8125f50 con 0x7f35c80a1380 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.630+0000 7f35b6ffd700 1 -- 172.21.15.154:0/169543134 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35bc007470 con 0x7f35c80a1380 2023-09-30T22:29:09.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.630+0000 7f35b6ffd700 1 -- 172.21.15.154:0/169543134 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f35bc03f1a0 con 0x7f35c80a1380 2023-09-30T22:29:09.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.630+0000 7f35cc957700 1 -- 172.21.15.154:0/169543134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c81336f0 con 0x7f35c80a1380 2023-09-30T22:29:09.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.635+0000 7f35b6ffd700 1 -- 172.21.15.154:0/169543134 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35bc007720 con 0x7f35c80a1380 2023-09-30T22:29:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.653+0000 7f820a2f9700 1 Processor -- start 2023-09-30T22:29:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.653+0000 7f820a2f9700 1 -- start start 2023-09-30T22:29:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f820a2f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a1550 0x7f8204138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f820a2f9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8204139200 0x7f820413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f820a2f9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820409e9d0 con 0x7f82040a0a70 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f820a2f9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820409dc00 con 0x7f8204139200 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f820a2f9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820409dec0 con 0x7f82040a1550 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f8208896700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8204139200 0x7f820413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f8208896700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8204139200 0x7f820413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34536/0 (socket says 172.21.15.154:34536) 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f8208896700 1 -- 172.21.15.154:0/889721101 learned_addr learned my addr 172.21.15.154:0/889721101 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f8203fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f82040a0a70 0x7f82040a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54542/0 (socket says 172.21.15.154:54542) 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.654+0000 7f82037fe700 1 --2- 172.21.15.154:0/889721101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a1550 0x7f8204138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.655+0000 7f8208896700 1 -- 172.21.15.154:0/889721101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a1550 msgr2=0x7f8204138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.655+0000 7f8208896700 1 --2- 172.21.15.154:0/889721101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a1550 0x7f8204138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.655+0000 7f8208896700 1 -- 172.21.15.154:0/889721101 >> v1:172.21.15.154:6789/0 conn(0x7f82040a0a70 legacy=0x7f82040a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.655+0000 7f8208896700 1 -- 172.21.15.154:0/889721101 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820409e6a0 con 0x7f8204139200 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.655+0000 7f8208896700 1 --2- 172.21.15.154:0/889721101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8204139200 0x7f820413b5e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009e50 tx=0x7f81fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5209a48225f96e53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.655+0000 7f8202ffd700 1 -- 172.21.15.154:0/889721101 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc00e070 con 0x7f8204139200 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.655+0000 7f8202ffd700 1 -- 172.21.15.154:0/889721101 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc00b910 con 0x7f8204139200 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.655+0000 7f8202ffd700 1 -- 172.21.15.154:0/889721101 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc00bcc0 con 0x7f8204139200 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.656+0000 7f820a2f9700 1 -- 172.21.15.154:0/889721101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8204139200 msgr2=0x7f820413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.656+0000 7f820a2f9700 1 --2- 172.21.15.154:0/889721101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8204139200 0x7f820413b5e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009e50 tx=0x7f81fc00b330 comp rx=0 tx=0).stop 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.656+0000 7f820a2f9700 1 -- 172.21.15.154:0/889721101 shutdown_connections 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.656+0000 7f820a2f9700 1 --2- 172.21.15.154:0/889721101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8204139200 0x7f820413b5e0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.656+0000 7f820a2f9700 1 --2- 172.21.15.154:0/889721101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a1550 0x7f8204138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.656+0000 7f820a2f9700 1 -- 172.21.15.154:0/889721101 >> 172.21.15.154:0/889721101 conn(0x7f82040a6610 msgr2=0x7f82040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.656+0000 7f820a2f9700 1 -- 172.21.15.154:0/889721101 shutdown_connections 2023-09-30T22:29:09.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.656+0000 7f820a2f9700 1 -- 172.21.15.154:0/889721101 wait complete. 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.657+0000 7f820a2f9700 1 Processor -- start 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.657+0000 7f820a2f9700 1 -- start start 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f820a2f9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a0a70 0x7f820411e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f820a2f9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82040a1550 0x7f820411ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f820a2f9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8204139200 0x7f820411f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f820a2f9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8204122290 con 0x7f82040a1550 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f820a2f9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8204121a40 con 0x7f82040a0a70 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f820a2f9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82040a5100 con 0x7f8204139200 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8203fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a0a70 0x7f820411e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8203fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a0a70 0x7f820411e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51428/0 (socket says 172.21.15.154:51428) 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8203fff700 1 -- 172.21.15.154:0/3449610769 learned_addr learned my addr 172.21.15.154:0/3449610769 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f82037fe700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82040a1550 0x7f820411ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8208896700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8204139200 0x7f820411f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8203fff700 1 -- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8204139200 msgr2=0x7f820411f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8203fff700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8204139200 0x7f820411f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8203fff700 1 -- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82040a1550 msgr2=0x7f820411ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8203fff700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82040a1550 0x7f820411ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8203fff700 1 -- 172.21.15.154:0/3449610769 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc009b30 con 0x7f82040a0a70 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f82037fe700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82040a1550 0x7f820411ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8203fff700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a0a70 0x7f820411e7c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c520 tx=0x7f81f400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:09.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8200ff9700 1 -- 172.21.15.154:0/3449610769 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4005cb0 con 0x7f82040a0a70 2023-09-30T22:29:09.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8200ff9700 1 -- 172.21.15.154:0/3449610769 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4005e10 con 0x7f82040a0a70 2023-09-30T22:29:09.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f820a2f9700 1 -- 172.21.15.154:0/3449610769 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8204120be0 con 0x7f82040a0a70 2023-09-30T22:29:09.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.658+0000 7f8200ff9700 1 -- 172.21.15.154:0/3449610769 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40072d0 con 0x7f82040a0a70 2023-09-30T22:29:09.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.659+0000 7f820a2f9700 1 -- 172.21.15.154:0/3449610769 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82041203e0 con 0x7f82040a0a70 2023-09-30T22:29:09.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.659+0000 7f820a2f9700 1 -- 172.21.15.154:0/3449610769 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820404f2a0 con 0x7f82040a0a70 2023-09-30T22:29:09.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.660+0000 7f8200ff9700 1 -- 172.21.15.154:0/3449610769 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81f4007430 con 0x7f82040a0a70 2023-09-30T22:29:09.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.660+0000 7f8200ff9700 1 -- 172.21.15.154:0/3449610769 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81f403ed30 con 0x7f82040a0a70 2023-09-30T22:29:09.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.664+0000 7f8200ff9700 1 -- 172.21.15.154:0/3449610769 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81f40076e0 con 0x7f82040a0a70 2023-09-30T22:29:09.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.715+0000 7f893ffcf700 1 -- 172.21.15.154:0/2100463848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f893806c3b0 con 0x7f8938130bc0 2023-09-30T22:29:09.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.715+0000 7f892e7fc700 1 -- 172.21.15.154:0/2100463848 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f892801b340 con 0x7f8938130bc0 2023-09-30T22:29:09.717 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:09.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.717+0000 7f893ffcf700 1 -- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8938130bc0 msgr2=0x7f893811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.717+0000 7f893ffcf700 1 --2- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8938130bc0 0x7f893811df80 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f892800c450 tx=0x7f892800c760 comp rx=0 tx=0).stop 2023-09-30T22:29:09.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.717+0000 7f893ffcf700 1 -- 172.21.15.154:0/2100463848 shutdown_connections 2023-09-30T22:29:09.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.717+0000 7f893ffcf700 1 --2- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8938133ad0 0x7f893811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.717+0000 7f893ffcf700 1 --2- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89381300a0 0x7f893811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.717+0000 7f893ffcf700 1 --2- 172.21.15.154:0/2100463848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8938130bc0 0x7f893811df80 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.717+0000 7f893ffcf700 1 -- 172.21.15.154:0/2100463848 >> 172.21.15.154:0/2100463848 conn(0x7f8938099c40 msgr2=0x7f8938132d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.718+0000 7f893ffcf700 1 -- 172.21.15.154:0/2100463848 shutdown_connections 2023-09-30T22:29:09.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.718+0000 7f893ffcf700 1 -- 172.21.15.154:0/2100463848 wait complete. 2023-09-30T22:29:09.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:09.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.830+0000 7f35cc957700 1 -- 172.21.15.154:0/169543134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f35c804f2a0 con 0x7f35c80a1380 2023-09-30T22:29:09.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.830+0000 7f35b6ffd700 1 -- 172.21.15.154:0/169543134 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35bc01b760 con 0x7f35c80a1380 2023-09-30T22:29:09.832 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:09.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.833+0000 7f35cc957700 1 -- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80a1380 msgr2=0x7f35c8122cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.833+0000 7f35cc957700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80a1380 0x7f35c8122cf0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f35c80a2b70 tx=0x7f35bc00c750 comp rx=0 tx=0).stop 2023-09-30T22:29:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.833+0000 7f35cc957700 1 -- 172.21.15.154:0/169543134 shutdown_connections 2023-09-30T22:29:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.833+0000 7f35cc957700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f35c8134120 0x7f35c8123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.833+0000 7f35cc957700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c80a0a70 0x7f35c81227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.833+0000 7f35cc957700 1 --2- 172.21.15.154:0/169543134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80a1380 0x7f35c8122cf0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.833+0000 7f35cc957700 1 -- 172.21.15.154:0/169543134 >> 172.21.15.154:0/169543134 conn(0x7f35c80a6610 msgr2=0x7f35c811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.834+0000 7f35cc957700 1 -- 172.21.15.154:0/169543134 shutdown_connections 2023-09-30T22:29:09.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.834+0000 7f35cc957700 1 -- 172.21.15.154:0/169543134 wait complete. 2023-09-30T22:29:09.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:09.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.864+0000 7f820a2f9700 1 -- 172.21.15.154:0/3449610769 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8204120380 con 0x7f82040a0a70 2023-09-30T22:29:09.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.865+0000 7f8200ff9700 1 -- 172.21.15.154:0/3449610769 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81f4017020 con 0x7f82040a0a70 2023-09-30T22:29:09.866 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:09.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.867+0000 7f820a2f9700 1 -- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a0a70 msgr2=0x7f820411e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:09.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.867+0000 7f820a2f9700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a0a70 0x7f820411e7c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c520 tx=0x7f81f400c830 comp rx=0 tx=0).stop 2023-09-30T22:29:09.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.867+0000 7f820a2f9700 1 -- 172.21.15.154:0/3449610769 shutdown_connections 2023-09-30T22:29:09.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.867+0000 7f820a2f9700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f8204139200 0x7f820411f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.867+0000 7f820a2f9700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82040a0a70 0x7f820411e7c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.867+0000 7f820a2f9700 1 --2- 172.21.15.154:0/3449610769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82040a1550 0x7f820411ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:09.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.867+0000 7f820a2f9700 1 -- 172.21.15.154:0/3449610769 >> 172.21.15.154:0/3449610769 conn(0x7f82040a6610 msgr2=0x7f82040a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:09.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.867+0000 7f820a2f9700 1 -- 172.21.15.154:0/3449610769 shutdown_connections 2023-09-30T22:29:09.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:09.867+0000 7f820a2f9700 1 -- 172.21.15.154:0/3449610769 wait complete. 2023-09-30T22:29:09.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:10.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:10.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.497+0000 7f58a8968700 1 Processor -- start 2023-09-30T22:29:10.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.497+0000 7f58a8968700 1 -- start start 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a8968700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58a4133ad0 0x7f58a4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a8968700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a41300a0 0x7f58a41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a8968700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41309f0 0x7f58a413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a8968700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a406b2d0 con 0x7f58a4133ad0 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a8968700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4133610 con 0x7f58a41309f0 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a8968700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a409a500 con 0x7f58a41300a0 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a41300a0 0x7f58a41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58a4133ad0 0x7f58a4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a2d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41309f0 0x7f58a413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a1d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a41300a0 0x7f58a41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55496/0 (socket says 172.21.15.154:55496) 2023-09-30T22:29:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a259c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58a4133ad0 0x7f58a4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34558/0 (socket says 172.21.15.154:34558) 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a1d9b700 1 -- 172.21.15.154:0/3791507736 learned_addr learned my addr 172.21.15.154:0/3791507736 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a1d9b700 1 -- 172.21.15.154:0/3791507736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41309f0 msgr2=0x7f58a413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a1d9b700 1 --2- 172.21.15.154:0/3791507736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41309f0 0x7f58a413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a1d9b700 1 -- 172.21.15.154:0/3791507736 >> v2:172.21.15.154:3300/0 conn(0x7f58a4133ad0 msgr2=0x7f58a4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a1d9b700 1 --2- 172.21.15.154:0/3791507736 >> v2:172.21.15.154:3300/0 conn(0x7f58a4133ad0 0x7f58a4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a1d9b700 1 -- 172.21.15.154:0/3791507736 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a41338b0 con 0x7f58a41300a0 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a259c700 1 --2- 172.21.15.154:0/3791507736 >> v2:172.21.15.154:3300/0 conn(0x7f58a4133ad0 0x7f58a4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.498+0000 7f58a2d9d700 1 --2- 172.21.15.154:0/3791507736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41309f0 0x7f58a413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a1d9b700 1 --2- 172.21.15.154:0/3791507736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a41300a0 0x7f58a41304b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f58940098f0 tx=0x7f5894009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdfff519666bb5f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a159a700 1 -- 172.21.15.154:0/3791507736 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894011830 con 0x7f58a41300a0 2023-09-30T22:29:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a159a700 1 -- 172.21.15.154:0/3791507736 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894011990 con 0x7f58a41300a0 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a159a700 1 -- 172.21.15.154:0/3791507736 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894011d20 con 0x7f58a41300a0 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a8968700 1 -- 172.21.15.154:0/3791507736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a41300a0 msgr2=0x7f58a41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a8968700 1 --2- 172.21.15.154:0/3791507736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a41300a0 0x7f58a41304b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f58940098f0 tx=0x7f5894009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a8968700 1 -- 172.21.15.154:0/3791507736 shutdown_connections 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a8968700 1 --2- 172.21.15.154:0/3791507736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41309f0 0x7f58a413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a8968700 1 --2- 172.21.15.154:0/3791507736 >> v2:172.21.15.154:3300/0 conn(0x7f58a4133ad0 0x7f58a4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a8968700 1 --2- 172.21.15.154:0/3791507736 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a41300a0 0x7f58a41304b0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a8968700 1 -- 172.21.15.154:0/3791507736 >> 172.21.15.154:0/3791507736 conn(0x7f58a4099c40 msgr2=0x7f58a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a8968700 1 -- 172.21.15.154:0/3791507736 shutdown_connections 2023-09-30T22:29:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.499+0000 7f58a8968700 1 -- 172.21.15.154:0/3791507736 wait complete. 2023-09-30T22:29:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.500+0000 7f58a8968700 1 Processor -- start 2023-09-30T22:29:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a8968700 1 -- start start 2023-09-30T22:29:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a8968700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41300a0 0x7f58a411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a8968700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a41309f0 0x7f58a411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a8968700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a4133ad0 0x7f58a411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a8968700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a41209f0 con 0x7f58a41309f0 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a8968700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a412f920 con 0x7f58a41300a0 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a8968700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a412d8c0 con 0x7f58a4133ad0 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41300a0 0x7f58a411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a2d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a4133ad0 0x7f58a411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41300a0 0x7f58a411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51458/0 (socket says 172.21.15.154:51458) 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a259c700 1 -- 172.21.15.154:0/2115406408 learned_addr learned my addr 172.21.15.154:0/2115406408 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a1d9b700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a41309f0 0x7f58a411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a259c700 1 -- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a4133ad0 msgr2=0x7f58a411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a259c700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a4133ad0 0x7f58a411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a259c700 1 -- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a41309f0 msgr2=0x7f58a411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a259c700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a41309f0 0x7f58a411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a259c700 1 -- 172.21.15.154:0/2115406408 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c009a70 con 0x7f58a41300a0 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a2d9d700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a4133ad0 0x7f58a411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.501+0000 7f58a1d9b700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a41309f0 0x7f58a411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.502+0000 7f58a259c700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41300a0 0x7f58a411da40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f589800ebe0 tx=0x7f589800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.502+0000 7f5892ffd700 1 -- 172.21.15.154:0/2115406408 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898009800 con 0x7f58a41300a0 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.502+0000 7f5892ffd700 1 -- 172.21.15.154:0/2115406408 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589800c850 con 0x7f58a41300a0 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.502+0000 7f58a8968700 1 -- 172.21.15.154:0/2115406408 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58980094a0 con 0x7f58a41300a0 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.502+0000 7f5892ffd700 1 -- 172.21.15.154:0/2115406408 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800cbc0 con 0x7f58a41300a0 2023-09-30T22:29:10.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.502+0000 7f58a8968700 1 -- 172.21.15.154:0/2115406408 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5894009550 con 0x7f58a41300a0 2023-09-30T22:29:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.502+0000 7f5892ffd700 1 -- 172.21.15.154:0/2115406408 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f589800cd20 con 0x7f58a41300a0 2023-09-30T22:29:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.503+0000 7f5892ffd700 1 -- 172.21.15.154:0/2115406408 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f589803f700 con 0x7f58a41300a0 2023-09-30T22:29:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.503+0000 7f58a8968700 1 -- 172.21.15.154:0/2115406408 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a411f370 con 0x7f58a41300a0 2023-09-30T22:29:10.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.507+0000 7f5892ffd700 1 -- 172.21.15.154:0/2115406408 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5898021080 con 0x7f58a41300a0 2023-09-30T22:29:10.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.691+0000 7f58a8968700 1 -- 172.21.15.154:0/2115406408 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f58a409cb20 con 0x7f58a41300a0 2023-09-30T22:29:10.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.692+0000 7f5892ffd700 1 -- 172.21.15.154:0/2115406408 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58980232f0 con 0x7f58a41300a0 2023-09-30T22:29:10.693 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.693+0000 7f58a8968700 1 -- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41300a0 msgr2=0x7f58a411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.693+0000 7f58a8968700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41300a0 0x7f58a411da40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f589800ebe0 tx=0x7f589800eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.693+0000 7f58a8968700 1 -- 172.21.15.154:0/2115406408 shutdown_connections 2023-09-30T22:29:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.693+0000 7f58a8968700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f58a4133ad0 0x7f58a411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.693+0000 7f58a8968700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58a41300a0 0x7f58a411da40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.693+0000 7f58a8968700 1 --2- 172.21.15.154:0/2115406408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58a41309f0 0x7f58a411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.694+0000 7f58a8968700 1 -- 172.21.15.154:0/2115406408 >> 172.21.15.154:0/2115406408 conn(0x7f58a4099c40 msgr2=0x7f58a4132ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.694+0000 7f58a8968700 1 -- 172.21.15.154:0/2115406408 shutdown_connections 2023-09-30T22:29:10.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.694+0000 7f58a8968700 1 -- 172.21.15.154:0/2115406408 wait complete. 2023-09-30T22:29:10.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:10.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:10.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:10.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.856+0000 7f84f5f11700 1 Processor -- start 2023-09-30T22:29:10.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.856+0000 7f84f5f11700 1 -- start start 2023-09-30T22:29:10.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84f5f11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84f5f11700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009c790 0x7f84f0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84f5f11700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f00a1640 con 0x7f84f009bc70 2023-09-30T22:29:10.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84f5f11700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f006eb30 con 0x7f84f0131980 2023-09-30T22:29:10.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84f5f11700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84f00a22d0 con 0x7f84f009c790 2023-09-30T22:29:10.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ef7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84effff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009c790 0x7f84f0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ef7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f0131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51474/0 (socket says 172.21.15.154:51474) 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84effff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009c790 0x7f84f0139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55518/0 (socket says 172.21.15.154:55518) 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ef7fe700 1 -- 172.21.15.154:0/4039296875 learned_addr learned my addr 172.21.15.154:0/4039296875 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ef7fe700 1 -- 172.21.15.154:0/4039296875 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009c790 msgr2=0x7f84f0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ef7fe700 1 --2- 172.21.15.154:0/4039296875 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009c790 0x7f84f0139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ef7fe700 1 -- 172.21.15.154:0/4039296875 >> v1:172.21.15.154:6789/0 conn(0x7f84f009bc70 legacy=0x7f84f009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ef7fe700 1 -- 172.21.15.154:0/4039296875 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0131550 con 0x7f84f0131980 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ee7fc700 1 -- 172.21.15.154:0/4039296875 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816967389 0 0) 0x7f84f00a1640 con 0x7f84f009bc70 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84effff700 1 --2- 172.21.15.154:0/4039296875 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009c790 0x7f84f0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ef7fe700 1 --2- 172.21.15.154:0/4039296875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f0131d50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f84e00098f0 tx=0x7f84e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee5155c0826811bc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ee7fc700 1 -- 172.21.15.154:0/4039296875 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0005e30 con 0x7f84f0131980 2023-09-30T22:29:10.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ee7fc700 1 -- 172.21.15.154:0/4039296875 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0004030 con 0x7f84f0131980 2023-09-30T22:29:10.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.857+0000 7f84ee7fc700 1 -- 172.21.15.154:0/4039296875 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e00043e0 con 0x7f84f0131980 2023-09-30T22:29:10.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.858+0000 7f84f5f11700 1 -- 172.21.15.154:0/4039296875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 msgr2=0x7f84f0131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.858+0000 7f84f5f11700 1 --2- 172.21.15.154:0/4039296875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f0131d50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f84e00098f0 tx=0x7f84e0009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:10.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.858+0000 7f84f5f11700 1 -- 172.21.15.154:0/4039296875 shutdown_connections 2023-09-30T22:29:10.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.858+0000 7f84f5f11700 1 --2- 172.21.15.154:0/4039296875 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009c790 0x7f84f0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.858+0000 7f84f5f11700 1 --2- 172.21.15.154:0/4039296875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f0131d50 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.858+0000 7f84f5f11700 1 -- 172.21.15.154:0/4039296875 >> 172.21.15.154:0/4039296875 conn(0x7f84f00a2980 msgr2=0x7f84f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.858+0000 7f84f5f11700 1 -- 172.21.15.154:0/4039296875 shutdown_connections 2023-09-30T22:29:10.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.858+0000 7f84f5f11700 1 -- 172.21.15.154:0/4039296875 wait complete. 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.859+0000 7f84f5f11700 1 Processor -- start 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.859+0000 7f84f5f11700 1 -- start start 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84f5f11700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009bc70 0x7f84f011b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84f5f11700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f009c790 0x7f84f011be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84f5f11700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f011c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84f5f11700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f011f1b0 con 0x7f84f009c790 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84f5f11700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f011f390 con 0x7f84f0131980 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84f5f11700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84f011d520 con 0x7f84f009bc70 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84ef7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009bc70 0x7f84f011b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84eeffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f009c790 0x7f84f011be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84ef7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009bc70 0x7f84f011b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55520/0 (socket says 172.21.15.154:55520) 2023-09-30T22:29:10.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84ef7fe700 1 -- 172.21.15.154:0/3454231725 learned_addr learned my addr 172.21.15.154:0/3454231725 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84effff700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f011c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84eeffd700 1 -- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009bc70 msgr2=0x7f84f011b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84eeffd700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009bc70 0x7f84f011b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84eeffd700 1 -- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 msgr2=0x7f84f011c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84eeffd700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f011c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84eeffd700 1 -- 172.21.15.154:0/3454231725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e8009a70 con 0x7f84f009c790 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84ef7fe700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009bc70 0x7f84f011b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.860+0000 7f84effff700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f011c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.861+0000 7f84eeffd700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f009c790 0x7f84f011be30 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c430 tx=0x7f84e400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.861+0000 7f84d7fff700 1 -- 172.21.15.154:0/3454231725 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40054e0 con 0x7f84f009c790 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.861+0000 7f84d7fff700 1 -- 172.21.15.154:0/3454231725 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e4003680 con 0x7f84f009c790 2023-09-30T22:29:10.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.861+0000 7f84d7fff700 1 -- 172.21.15.154:0/3454231725 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4003a30 con 0x7f84f009c790 2023-09-30T22:29:10.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.861+0000 7f84f5f11700 1 -- 172.21.15.154:0/3454231725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e0009500 con 0x7f84f009c790 2023-09-30T22:29:10.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.861+0000 7f84f5f11700 1 -- 172.21.15.154:0/3454231725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f011e210 con 0x7f84f009c790 2023-09-30T22:29:10.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.862+0000 7f84d7fff700 1 -- 172.21.15.154:0/3454231725 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84e4003b90 con 0x7f84f009c790 2023-09-30T22:29:10.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.862+0000 7f84d7fff700 1 -- 172.21.15.154:0/3454231725 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84e403eb40 con 0x7f84f009c790 2023-09-30T22:29:10.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.862+0000 7f84f5f11700 1 -- 172.21.15.154:0/3454231725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f009e4d0 con 0x7f84f009c790 2023-09-30T22:29:10.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.867+0000 7f84d7fff700 1 -- 172.21.15.154:0/3454231725 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84e4017020 con 0x7f84f009c790 2023-09-30T22:29:10.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:10.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.979+0000 7fd90b5ea700 1 Processor -- start 2023-09-30T22:29:10.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd90b5ea700 1 -- start start 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd90b5ea700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd90406a770 0x7fd90406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd90b5ea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd904139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd90b5ea700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90409da80 con 0x7fd90406b080 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd90b5ea700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90409dce0 con 0x7fd90406a770 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd90b5ea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90409eb20 con 0x7fd904131ec0 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd909b87700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd904139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd909386700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd90406a770 0x7fd90406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd909b87700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd904139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51488/0 (socket says 172.21.15.154:51488) 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd909386700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd90406a770 0x7fd90406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34572/0 (socket says 172.21.15.154:34572) 2023-09-30T22:29:10.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.980+0000 7fd909b87700 1 -- 172.21.15.154:0/3101161486 learned_addr learned my addr 172.21.15.154:0/3101161486 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd909386700 1 -- 172.21.15.154:0/3101161486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 msgr2=0x7fd904139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd909386700 1 --2- 172.21.15.154:0/3101161486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd904139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd909386700 1 -- 172.21.15.154:0/3101161486 >> v1:172.21.15.154:6789/0 conn(0x7fd90406b080 legacy=0x7fd9041317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd909386700 1 -- 172.21.15.154:0/3101161486 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90409d860 con 0x7fd90406a770 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd909b87700 1 --2- 172.21.15.154:0/3101161486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd904139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd909386700 1 --2- 172.21.15.154:0/3101161486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 0x7fd90406ab40 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fd900009840 tx=0x7fd900009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4520820d1df38c43 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd8fbfff700 1 -- 172.21.15.154:0/3101161486 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900011830 con 0x7fd90406a770 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd8fbfff700 1 -- 172.21.15.154:0/3101161486 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900011990 con 0x7fd90406a770 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd8fbfff700 1 -- 172.21.15.154:0/3101161486 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900011d20 con 0x7fd90406a770 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3101161486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 msgr2=0x7fd90406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.981+0000 7fd90b5ea700 1 --2- 172.21.15.154:0/3101161486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 0x7fd90406ab40 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fd900009840 tx=0x7fd900009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:10.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.982+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3101161486 shutdown_connections 2023-09-30T22:29:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.982+0000 7fd90b5ea700 1 --2- 172.21.15.154:0/3101161486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd904139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.982+0000 7fd90b5ea700 1 --2- 172.21.15.154:0/3101161486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 0x7fd90406ab40 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.982+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3101161486 >> 172.21.15.154:0/3101161486 conn(0x7fd904099c40 msgr2=0x7fd9040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.982+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3101161486 shutdown_connections 2023-09-30T22:29:10.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.982+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3101161486 wait complete. 2023-09-30T22:29:10.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.983+0000 7fd90b5ea700 1 Processor -- start 2023-09-30T22:29:10.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.983+0000 7fd90b5ea700 1 -- start start 2023-09-30T22:29:10.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd90b5ea700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 0x7fd90411d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd90b5ea700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd90406b080 0x7fd90411d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd90b5ea700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd9041c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd90b5ea700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd904120070 con 0x7fd90406a770 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd90b5ea700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90411fdb0 con 0x7fd904131ec0 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd90b5ea700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd90411dc80 con 0x7fd90406b080 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909386700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 0x7fd90411d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909386700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 0x7fd90411d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34582/0 (socket says 172.21.15.154:34582) 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909386700 1 -- 172.21.15.154:0/3164914582 learned_addr learned my addr 172.21.15.154:0/3164914582 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909b87700 1 --2- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd9041c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd908b85700 1 --2- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd90406b080 0x7fd90411d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909b87700 1 -- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd90406b080 msgr2=0x7fd90411d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909b87700 1 --2- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd90406b080 0x7fd90411d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909b87700 1 -- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 msgr2=0x7fd90411d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909b87700 1 --2- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 0x7fd90411d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909b87700 1 -- 172.21.15.154:0/3164914582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc009b30 con 0x7fd904131ec0 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd909b87700 1 --2- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd9041c5ff0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009e50 tx=0x7fd8fc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.984+0000 7fd8f9ffb700 1 -- 172.21.15.154:0/3164914582 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc018070 con 0x7fd904131ec0 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.985+0000 7fd8f9ffb700 1 -- 172.21.15.154:0/3164914582 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc00f040 con 0x7fd904131ec0 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.985+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3164914582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9000094a0 con 0x7fd904131ec0 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.985+0000 7fd8f9ffb700 1 -- 172.21.15.154:0/3164914582 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc003c40 con 0x7fd904131ec0 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.985+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3164914582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd904120ae0 con 0x7fd904131ec0 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.985+0000 7fd8f9ffb700 1 -- 172.21.15.154:0/3164914582 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8fc00c880 con 0x7fd904131ec0 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.986+0000 7fd8f9ffb700 1 -- 172.21.15.154:0/3164914582 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd8fc03f790 con 0x7fd904131ec0 2023-09-30T22:29:10.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.986+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3164914582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90411cd30 con 0x7fd904131ec0 2023-09-30T22:29:10.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:10.991+0000 7fd8f9ffb700 1 -- 172.21.15.154:0/3164914582 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd90411cd30 con 0x7fd904131ec0 2023-09-30T22:29:11.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e446b9700 1 Processor -- start 2023-09-30T22:29:11.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e446b9700 1 -- start start 2023-09-30T22:29:11.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e446b9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a1550 0x7f6e3c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e446b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c139200 0x7f6e3c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e446b9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3c09e9d0 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e446b9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c09dc00 con 0x7f6e3c139200 2023-09-30T22:29:11.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e446b9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c09dec0 con 0x7f6e3c0a1550 2023-09-30T22:29:11.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e41c54700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a1550 0x7f6e3c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e41c54700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a1550 0x7f6e3c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55544/0 (socket says 172.21.15.154:55544) 2023-09-30T22:29:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e41c54700 1 -- 172.21.15.154:0/2629885941 learned_addr learned my addr 172.21.15.154:0/2629885941 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:11.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.007+0000 7f6e42c56700 1 --2- 172.21.15.154:0/2629885941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c139200 0x7f6e3c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.008+0000 7f6e41c54700 1 -- 172.21.15.154:0/2629885941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c139200 msgr2=0x7f6e3c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.008+0000 7f6e41c54700 1 --2- 172.21.15.154:0/2629885941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c139200 0x7f6e3c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.008+0000 7f6e41c54700 1 -- 172.21.15.154:0/2629885941 >> v1:172.21.15.154:6789/0 conn(0x7f6e3c0a0a70 legacy=0x7f6e3c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.008+0000 7f6e41c54700 1 -- 172.21.15.154:0/2629885941 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c09e6a0 con 0x7f6e3c0a1550 2023-09-30T22:29:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.008+0000 7f6e42c56700 1 --2- 172.21.15.154:0/2629885941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c139200 0x7f6e3c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:11.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.008+0000 7f6e41c54700 1 --2- 172.21.15.154:0/2629885941 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a1550 0x7f6e3c138cc0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009920 tx=0x7f6e2c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=337d97b626f0b4b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.008+0000 7f6e41453700 1 -- 172.21.15.154:0/2629885941 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c011830 con 0x7f6e3c0a1550 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.008+0000 7f6e41453700 1 -- 172.21.15.154:0/2629885941 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c011990 con 0x7f6e3c0a1550 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.008+0000 7f6e41453700 1 -- 172.21.15.154:0/2629885941 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c011d20 con 0x7f6e3c0a1550 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.009+0000 7f6e446b9700 1 -- 172.21.15.154:0/2629885941 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a1550 msgr2=0x7f6e3c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.009+0000 7f6e446b9700 1 --2- 172.21.15.154:0/2629885941 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a1550 0x7f6e3c138cc0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009920 tx=0x7f6e2c009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.009+0000 7f6e446b9700 1 -- 172.21.15.154:0/2629885941 shutdown_connections 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.009+0000 7f6e446b9700 1 --2- 172.21.15.154:0/2629885941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c139200 0x7f6e3c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.009+0000 7f6e446b9700 1 --2- 172.21.15.154:0/2629885941 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a1550 0x7f6e3c138cc0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.009+0000 7f6e446b9700 1 -- 172.21.15.154:0/2629885941 >> 172.21.15.154:0/2629885941 conn(0x7f6e3c0a6610 msgr2=0x7f6e3c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.009+0000 7f6e446b9700 1 -- 172.21.15.154:0/2629885941 shutdown_connections 2023-09-30T22:29:11.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.009+0000 7f6e446b9700 1 -- 172.21.15.154:0/2629885941 wait complete. 2023-09-30T22:29:11.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e446b9700 1 Processor -- start 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e446b9700 1 -- start start 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e446b9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a0a70 0x7f6e3c11ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e446b9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c0a1550 0x7f6e3c11ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e446b9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e3c139200 0x7f6e3c11f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e446b9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c1227a0 con 0x7f6e3c139200 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e446b9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c120c00 con 0x7f6e3c0a1550 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e446b9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3c0a5400 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e42455700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a0a70 0x7f6e3c11ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e42455700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a0a70 0x7f6e3c11ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55554/0 (socket says 172.21.15.154:55554) 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.010+0000 7f6e42455700 1 -- 172.21.15.154:0/3116886366 learned_addr learned my addr 172.21.15.154:0/3116886366 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:11.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e41c54700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c0a1550 0x7f6e3c11ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e42c56700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e3c139200 0x7f6e3c11f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e42455700 1 -- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c0a1550 msgr2=0x7f6e3c11ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e42455700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c0a1550 0x7f6e3c11ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e42455700 1 -- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e3c139200 msgr2=0x7f6e3c11f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e42455700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e3c139200 0x7f6e3c11f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e42455700 1 -- 172.21.15.154:0/3116886366 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e34009a70 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e42c56700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e3c139200 0x7f6e3c11f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e42455700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a0a70 0x7f6e3c11ea40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c4e0 tx=0x7f6e3800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e32ffd700 1 -- 172.21.15.154:0/3116886366 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e380052d0 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e32ffd700 1 -- 172.21.15.154:0/3116886366 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e38005430 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e32ffd700 1 -- 172.21.15.154:0/3116886366 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e380038c0 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e446b9700 1 -- 172.21.15.154:0/3116886366 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c009550 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.011+0000 7f6e446b9700 1 -- 172.21.15.154:0/3116886366 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c120750 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.012+0000 7f6e32ffd700 1 -- 172.21.15.154:0/3116886366 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e38003a20 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.012+0000 7f6e446b9700 1 -- 172.21.15.154:0/3116886366 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3c121ed0 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.012+0000 7f6e32ffd700 1 -- 172.21.15.154:0/3116886366 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6e3803eb50 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.017+0000 7f6e32ffd700 1 -- 172.21.15.154:0/3116886366 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e38018260 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.067+0000 7f84f5f11700 1 -- 172.21.15.154:0/3454231725 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f84f004f2a0 con 0x7f84f009c790 2023-09-30T22:29:11.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.067+0000 7f84d7fff700 1 -- 172.21.15.154:0/3454231725 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84e4003e40 con 0x7f84f009c790 2023-09-30T22:29:11.068 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.069+0000 7f84f5f11700 1 -- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f009c790 msgr2=0x7f84f011be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.069+0000 7f84f5f11700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f009c790 0x7f84f011be30 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c430 tx=0x7f84e400c740 comp rx=0 tx=0).stop 2023-09-30T22:29:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.069+0000 7f84f5f11700 1 -- 172.21.15.154:0/3454231725 shutdown_connections 2023-09-30T22:29:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.069+0000 7f84f5f11700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84f0131980 0x7f84f011c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.069+0000 7f84f5f11700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f84f009bc70 0x7f84f011b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.069+0000 7f84f5f11700 1 --2- 172.21.15.154:0/3454231725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84f009c790 0x7f84f011be30 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.069+0000 7f84f5f11700 1 -- 172.21.15.154:0/3454231725 >> 172.21.15.154:0/3454231725 conn(0x7f84f00a2980 msgr2=0x7f84f009da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.069+0000 7f84f5f11700 1 -- 172.21.15.154:0/3454231725 shutdown_connections 2023-09-30T22:29:11.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.069+0000 7f84f5f11700 1 -- 172.21.15.154:0/3454231725 wait complete. 2023-09-30T22:29:11.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:11.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.187+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3164914582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd90411cd30 con 0x7fd904131ec0 2023-09-30T22:29:11.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.187+0000 7fd8f9ffb700 1 -- 172.21.15.154:0/3164914582 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd90411cd30 con 0x7fd904131ec0 2023-09-30T22:29:11.188 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:11.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.189+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 msgr2=0x7fd9041c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.189+0000 7fd90b5ea700 1 --2- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd9041c5ff0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009e50 tx=0x7fd8fc00c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.189+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3164914582 shutdown_connections 2023-09-30T22:29:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.189+0000 7fd90b5ea700 1 --2- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd904131ec0 0x7fd9041c5ff0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.189+0000 7fd90b5ea700 1 --2- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90406a770 0x7fd90411d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.189+0000 7fd90b5ea700 1 --2- 172.21.15.154:0/3164914582 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd90406b080 0x7fd90411d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.189+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3164914582 >> 172.21.15.154:0/3164914582 conn(0x7fd904099c40 msgr2=0x7fd9041b9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.189+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3164914582 shutdown_connections 2023-09-30T22:29:11.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.189+0000 7fd90b5ea700 1 -- 172.21.15.154:0/3164914582 wait complete. 2023-09-30T22:29:11.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:11.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.213+0000 7f6e446b9700 1 -- 172.21.15.154:0/3116886366 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e3c04f2a0 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.213+0000 7f6e32ffd700 1 -- 172.21.15.154:0/3116886366 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e38017030 con 0x7f6e3c0a0a70 2023-09-30T22:29:11.214 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:11.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.215+0000 7f6e446b9700 1 -- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a0a70 msgr2=0x7f6e3c11ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.215+0000 7f6e446b9700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a0a70 0x7f6e3c11ea40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c4e0 tx=0x7f6e3800c7f0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.215+0000 7f6e446b9700 1 -- 172.21.15.154:0/3116886366 shutdown_connections 2023-09-30T22:29:11.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.215+0000 7f6e446b9700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e3c139200 0x7f6e3c11f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.215+0000 7f6e446b9700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6e3c0a0a70 0x7f6e3c11ea40 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.215+0000 7f6e446b9700 1 --2- 172.21.15.154:0/3116886366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e3c0a1550 0x7f6e3c11ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.215+0000 7f6e446b9700 1 -- 172.21.15.154:0/3116886366 >> 172.21.15.154:0/3116886366 conn(0x7f6e3c0a6610 msgr2=0x7f6e3c1382d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.215+0000 7f6e446b9700 1 -- 172.21.15.154:0/3116886366 shutdown_connections 2023-09-30T22:29:11.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.215+0000 7f6e446b9700 1 -- 172.21.15.154:0/3116886366 wait complete. 2023-09-30T22:29:11.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:11.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:11.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.833+0000 7fee1eb0b700 1 Processor -- start 2023-09-30T22:29:11.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.833+0000 7fee1eb0b700 1 -- start start 2023-09-30T22:29:11.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.833+0000 7fee1eb0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809e870 0x7fee1809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.833+0000 7fee1eb0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809f180 0x7fee18131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.833+0000 7fee1eb0b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee18131d70 0x7fee18132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.833+0000 7fee1eb0b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180a0920 con 0x7fee18131d70 2023-09-30T22:29:11.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.833+0000 7fee1eb0b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1809c970 con 0x7fee1809f180 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.833+0000 7fee1eb0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee1809bab0 con 0x7fee1809e870 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee1c8a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809e870 0x7fee1809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee1d0a8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee18131d70 0x7fee18132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee17fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809f180 0x7fee18131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee1d0a8700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee18131d70 0x7fee18132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34604/0 (socket says 172.21.15.154:34604) 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee1c8a7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809e870 0x7fee1809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55562/0 (socket says 172.21.15.154:55562) 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee1d0a8700 1 -- 172.21.15.154:0/4189952590 learned_addr learned my addr 172.21.15.154:0/4189952590 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee17fff700 1 -- 172.21.15.154:0/4189952590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809e870 msgr2=0x7fee1809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee17fff700 1 --2- 172.21.15.154:0/4189952590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809e870 0x7fee1809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee17fff700 1 -- 172.21.15.154:0/4189952590 >> v2:172.21.15.154:3300/0 conn(0x7fee18131d70 msgr2=0x7fee18132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:11.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee17fff700 1 --2- 172.21.15.154:0/4189952590 >> v2:172.21.15.154:3300/0 conn(0x7fee18131d70 0x7fee18132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee17fff700 1 -- 172.21.15.154:0/4189952590 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1809f9c0 con 0x7fee1809f180 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee1d0a8700 1 --2- 172.21.15.154:0/4189952590 >> v2:172.21.15.154:3300/0 conn(0x7fee18131d70 0x7fee18132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee1c8a7700 1 --2- 172.21.15.154:0/4189952590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809e870 0x7fee1809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee17fff700 1 --2- 172.21.15.154:0/4189952590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809f180 0x7fee18131830 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fee04009840 tx=0x7fee04009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36cc142e45525c73 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee177fe700 1 -- 172.21.15.154:0/4189952590 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04011830 con 0x7fee1809f180 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee177fe700 1 -- 172.21.15.154:0/4189952590 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04011990 con 0x7fee1809f180 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.834+0000 7fee177fe700 1 -- 172.21.15.154:0/4189952590 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04011d20 con 0x7fee1809f180 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.835+0000 7fee1eb0b700 1 -- 172.21.15.154:0/4189952590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809f180 msgr2=0x7fee18131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.835+0000 7fee1eb0b700 1 --2- 172.21.15.154:0/4189952590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809f180 0x7fee18131830 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fee04009840 tx=0x7fee04009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.835+0000 7fee1eb0b700 1 -- 172.21.15.154:0/4189952590 shutdown_connections 2023-09-30T22:29:11.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.835+0000 7fee1eb0b700 1 --2- 172.21.15.154:0/4189952590 >> v2:172.21.15.154:3300/0 conn(0x7fee18131d70 0x7fee18132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.835+0000 7fee1eb0b700 1 --2- 172.21.15.154:0/4189952590 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809e870 0x7fee1809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.835+0000 7fee1eb0b700 1 --2- 172.21.15.154:0/4189952590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809f180 0x7fee18131830 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.835+0000 7fee1eb0b700 1 -- 172.21.15.154:0/4189952590 >> 172.21.15.154:0/4189952590 conn(0x7fee180a4430 msgr2=0x7fee180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:11.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.835+0000 7fee1eb0b700 1 -- 172.21.15.154:0/4189952590 shutdown_connections 2023-09-30T22:29:11.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.835+0000 7fee1eb0b700 1 -- 172.21.15.154:0/4189952590 wait complete. 2023-09-30T22:29:11.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1eb0b700 1 Processor -- start 2023-09-30T22:29:11.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1eb0b700 1 -- start start 2023-09-30T22:29:11.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1eb0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809e870 0x7fee1806c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1eb0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809f180 0x7fee1806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1eb0b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee18131d70 0x7fee181c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:11.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1eb0b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1806be60 con 0x7fee18131d70 2023-09-30T22:29:11.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1eb0b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee180a0210 con 0x7fee1809e870 2023-09-30T22:29:11.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1eb0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee180a2c40 con 0x7fee1809f180 2023-09-30T22:29:11.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1c8a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809e870 0x7fee1806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee17fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809f180 0x7fee1806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1c8a7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809e870 0x7fee1806c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51528/0 (socket says 172.21.15.154:51528) 2023-09-30T22:29:11.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1c8a7700 1 -- 172.21.15.154:0/3038225774 learned_addr learned my addr 172.21.15.154:0/3038225774 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:11.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.836+0000 7fee1d0a8700 1 --2- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee18131d70 0x7fee181c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:11.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee1c8a7700 1 -- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809f180 msgr2=0x7fee1806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee1c8a7700 1 --2- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809f180 0x7fee1806c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee1c8a7700 1 -- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee18131d70 msgr2=0x7fee181c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee1c8a7700 1 --2- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee18131d70 0x7fee181c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee1c8a7700 1 -- 172.21.15.154:0/3038225774 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c0094a0 con 0x7fee1809e870 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee1c8a7700 1 --2- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809e870 0x7fee1806c400 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00ebe0 tx=0x7fee0c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee157fa700 1 -- 172.21.15.154:0/3038225774 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c009780 con 0x7fee1809e870 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee157fa700 1 -- 172.21.15.154:0/3038225774 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c00c850 con 0x7fee1809e870 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee1eb0b700 1 -- 172.21.15.154:0/3038225774 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee10009b30 con 0x7fee1809e870 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee157fa700 1 -- 172.21.15.154:0/3038225774 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00cbe0 con 0x7fee1809e870 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.837+0000 7fee1eb0b700 1 -- 172.21.15.154:0/3038225774 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee040094a0 con 0x7fee1809e870 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.838+0000 7fee157fa700 1 -- 172.21.15.154:0/3038225774 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee0c00cd40 con 0x7fee1809e870 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.838+0000 7fee157fa700 1 -- 172.21.15.154:0/3038225774 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee0c03f720 con 0x7fee1809e870 2023-09-30T22:29:11.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.838+0000 7fee1eb0b700 1 -- 172.21.15.154:0/3038225774 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1804f2a0 con 0x7fee1809e870 2023-09-30T22:29:11.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:11.843+0000 7fee157fa700 1 -- 172.21.15.154:0/3038225774 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee0c0232f0 con 0x7fee1809e870 2023-09-30T22:29:12.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.030+0000 7fee1eb0b700 1 -- 172.21.15.154:0/3038225774 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee1809f660 con 0x7fee1809e870 2023-09-30T22:29:12.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.030+0000 7fee157fa700 1 -- 172.21.15.154:0/3038225774 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee0c021030 con 0x7fee1809e870 2023-09-30T22:29:12.031 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.032+0000 7fee1eb0b700 1 -- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809e870 msgr2=0x7fee1806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.032+0000 7fee1eb0b700 1 --2- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809e870 0x7fee1806c400 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00ebe0 tx=0x7fee0c00eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.033+0000 7fee1eb0b700 1 -- 172.21.15.154:0/3038225774 shutdown_connections 2023-09-30T22:29:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.033+0000 7fee1eb0b700 1 --2- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee18131d70 0x7fee181c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.033+0000 7fee1eb0b700 1 --2- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee1809e870 0x7fee1806c400 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.033+0000 7fee1eb0b700 1 --2- 172.21.15.154:0/3038225774 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fee1809f180 0x7fee1806c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.033+0000 7fee1eb0b700 1 -- 172.21.15.154:0/3038225774 >> 172.21.15.154:0/3038225774 conn(0x7fee180a4430 msgr2=0x7fee181b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.033+0000 7fee1eb0b700 1 -- 172.21.15.154:0/3038225774 shutdown_connections 2023-09-30T22:29:12.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.033+0000 7fee1eb0b700 1 -- 172.21.15.154:0/3038225774 wait complete. 2023-09-30T22:29:12.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:12.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:12.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:12.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea7d9a700 1 Processor -- start 2023-09-30T22:29:12.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea7d9a700 1 -- start start 2023-09-30T22:29:12.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea7d9a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea0130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea7d9a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea0138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea7d9a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea009c1f0 con 0x7faea009d8f0 2023-09-30T22:29:12.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea7d9a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea009b1f0 con 0x7faea009e450 2023-09-30T22:29:12.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea7d9a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faea0131300 con 0x7faea01309f0 2023-09-30T22:29:12.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea5b36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea0130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea6337700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea0138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea6337700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea0138760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51540/0 (socket says 172.21.15.154:51540) 2023-09-30T22:29:12.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea5b36700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea0130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55580/0 (socket says 172.21.15.154:55580) 2023-09-30T22:29:12.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.206+0000 7faea6337700 1 -- 172.21.15.154:0/3936008339 learned_addr learned my addr 172.21.15.154:0/3936008339 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:12.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea5b36700 1 -- 172.21.15.154:0/3936008339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 msgr2=0x7faea0138760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea5b36700 1 --2- 172.21.15.154:0/3936008339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea0138760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea5b36700 1 -- 172.21.15.154:0/3936008339 >> v1:172.21.15.154:6789/0 conn(0x7faea009d8f0 legacy=0x7faea009dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea5b36700 1 -- 172.21.15.154:0/3936008339 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea01305a0 con 0x7faea01309f0 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea4b34700 1 -- 172.21.15.154:0/3936008339 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492444304 0 0) 0x7faea009c1f0 con 0x7faea009d8f0 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea6337700 1 --2- 172.21.15.154:0/3936008339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea0138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea5b36700 1 --2- 172.21.15.154:0/3936008339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea0130dc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009850 tx=0x7fae9c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f75d3e06396b11 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea4b34700 1 -- 172.21.15.154:0/3936008339 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c005e30 con 0x7faea01309f0 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea4b34700 1 -- 172.21.15.154:0/3936008339 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c006030 con 0x7faea01309f0 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.207+0000 7faea4b34700 1 -- 172.21.15.154:0/3936008339 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0063e0 con 0x7faea01309f0 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.208+0000 7faea7d9a700 1 -- 172.21.15.154:0/3936008339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 msgr2=0x7faea0130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.208+0000 7faea7d9a700 1 --2- 172.21.15.154:0/3936008339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea0130dc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009850 tx=0x7fae9c009b60 comp rx=0 tx=0).stop 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.208+0000 7faea7d9a700 1 -- 172.21.15.154:0/3936008339 shutdown_connections 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.208+0000 7faea7d9a700 1 --2- 172.21.15.154:0/3936008339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea0138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.208+0000 7faea7d9a700 1 --2- 172.21.15.154:0/3936008339 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea0130dc0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.208+0000 7faea7d9a700 1 -- 172.21.15.154:0/3936008339 >> 172.21.15.154:0/3936008339 conn(0x7faea00a2b30 msgr2=0x7faea009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.208+0000 7faea7d9a700 1 -- 172.21.15.154:0/3936008339 shutdown_connections 2023-09-30T22:29:12.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.208+0000 7faea7d9a700 1 -- 172.21.15.154:0/3936008339 wait complete. 2023-09-30T22:29:12.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea7d9a700 1 Processor -- start 2023-09-30T22:29:12.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea7d9a700 1 -- start start 2023-09-30T22:29:12.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea7d9a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea009d8f0 0x7faea012c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea7d9a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea012c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea7d9a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea012cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea7d9a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea008c6d0 con 0x7faea009d8f0 2023-09-30T22:29:12.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea7d9a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea012dff0 con 0x7faea009e450 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea7d9a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faea009d2e0 con 0x7faea01309f0 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea5335700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea012c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea6337700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea012cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea5335700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea012c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51546/0 (socket says 172.21.15.154:51546) 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea5335700 1 -- 172.21.15.154:0/4049330820 learned_addr learned my addr 172.21.15.154:0/4049330820 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.209+0000 7faea5b36700 1 --2- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea009d8f0 0x7faea012c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7faea5335700 1 -- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 msgr2=0x7faea012cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7faea5335700 1 --2- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea012cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7faea5335700 1 -- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea009d8f0 msgr2=0x7faea012c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7faea5335700 1 --2- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea009d8f0 0x7faea012c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7faea5335700 1 -- 172.21.15.154:0/4049330820 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98009b30 con 0x7faea009e450 2023-09-30T22:29:12.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7faea5335700 1 --2- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea012c5a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fae90001eb0 tx=0x7fae9000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7fae967fc700 1 -- 172.21.15.154:0/4049330820 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae900052d0 con 0x7faea009e450 2023-09-30T22:29:12.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7fae967fc700 1 -- 172.21.15.154:0/4049330820 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90005450 con 0x7faea009e450 2023-09-30T22:29:12.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7faea7d9a700 1 -- 172.21.15.154:0/4049330820 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c009430 con 0x7faea009e450 2023-09-30T22:29:12.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7fae967fc700 1 -- 172.21.15.154:0/4049330820 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae900038c0 con 0x7faea009e450 2023-09-30T22:29:12.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.210+0000 7faea7d9a700 1 -- 172.21.15.154:0/4049330820 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea009b440 con 0x7faea009e450 2023-09-30T22:29:12.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.211+0000 7fae967fc700 1 -- 172.21.15.154:0/4049330820 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae90003a20 con 0x7faea009e450 2023-09-30T22:29:12.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.211+0000 7fae967fc700 1 -- 172.21.15.154:0/4049330820 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fae9003e950 con 0x7faea009e450 2023-09-30T22:29:12.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.211+0000 7faea7d9a700 1 -- 172.21.15.154:0/4049330820 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea004f2a0 con 0x7faea009e450 2023-09-30T22:29:12.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.216+0000 7fae967fc700 1 -- 172.21.15.154:0/4049330820 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae90019d20 con 0x7faea009e450 2023-09-30T22:29:12.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:12.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.329+0000 7f74d4313700 1 Processor -- start 2023-09-30T22:29:12.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.329+0000 7f74d4313700 1 -- start start 2023-09-30T22:29:12.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d4313700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74cc06b250 0x7f74cc136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d4313700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 0x7f74cc139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d4313700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc09da80 con 0x7f74cc06a770 2023-09-30T22:29:12.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d4313700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc09f770 con 0x7f74cc06b250 2023-09-30T22:29:12.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d4313700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc09dce0 con 0x7f74cc137140 2023-09-30T22:29:12.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d18ae700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74cc06b250 0x7f74cc136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d28b0700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 0x7f74cc139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d18ae700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74cc06b250 0x7f74cc136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34630/0 (socket says 172.21.15.154:34630) 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d18ae700 1 -- 172.21.15.154:0/3239871851 learned_addr learned my addr 172.21.15.154:0/3239871851 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d28b0700 1 -- 172.21.15.154:0/3239871851 >> v2:172.21.15.154:3300/0 conn(0x7f74cc06b250 msgr2=0x7f74cc136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d28b0700 1 --2- 172.21.15.154:0/3239871851 >> v2:172.21.15.154:3300/0 conn(0x7f74cc06b250 0x7f74cc136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d28b0700 1 -- 172.21.15.154:0/3239871851 >> v1:172.21.15.154:6789/0 conn(0x7f74cc06a770 legacy=0x7f74cc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d28b0700 1 -- 172.21.15.154:0/3239871851 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc09eb20 con 0x7f74cc137140 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d18ae700 1 --2- 172.21.15.154:0/3239871851 >> v2:172.21.15.154:3300/0 conn(0x7f74cc06b250 0x7f74cc136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.330+0000 7f74d28b0700 1 --2- 172.21.15.154:0/3239871851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 0x7f74cc139520 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8768a907b2c2091b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d10ad700 1 -- 172.21.15.154:0/3239871851 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400e070 con 0x7f74cc137140 2023-09-30T22:29:12.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d10ad700 1 -- 172.21.15.154:0/3239871851 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c400bb20 con 0x7f74cc137140 2023-09-30T22:29:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d10ad700 1 -- 172.21.15.154:0/3239871851 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4012430 con 0x7f74cc137140 2023-09-30T22:29:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d4313700 1 -- 172.21.15.154:0/3239871851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 msgr2=0x7f74cc139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d4313700 1 --2- 172.21.15.154:0/3239871851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 0x7f74cc139520 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c400b330 comp rx=0 tx=0).stop 2023-09-30T22:29:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d4313700 1 -- 172.21.15.154:0/3239871851 shutdown_connections 2023-09-30T22:29:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d4313700 1 --2- 172.21.15.154:0/3239871851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 0x7f74cc139520 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d4313700 1 --2- 172.21.15.154:0/3239871851 >> v2:172.21.15.154:3300/0 conn(0x7f74cc06b250 0x7f74cc136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d4313700 1 -- 172.21.15.154:0/3239871851 >> 172.21.15.154:0/3239871851 conn(0x7f74cc099c40 msgr2=0x7f74cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d4313700 1 -- 172.21.15.154:0/3239871851 shutdown_connections 2023-09-30T22:29:12.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.331+0000 7f74d4313700 1 -- 172.21.15.154:0/3239871851 wait complete. 2023-09-30T22:29:12.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.332+0000 7f74d4313700 1 Processor -- start 2023-09-30T22:29:12.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.332+0000 7f74d4313700 1 -- start start 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d4313700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74cc06a770 0x7f74cc11e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d4313700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74cc06b250 0x7f74cc11eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d4313700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 0x7f74cc11f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d4313700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1202f0 con 0x7f74cc06a770 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d4313700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc121e10 con 0x7f74cc137140 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d4313700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc120790 con 0x7f74cc06b250 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d20af700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74cc06a770 0x7f74cc11e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d20af700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74cc06a770 0x7f74cc11e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34632/0 (socket says 172.21.15.154:34632) 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d20af700 1 -- 172.21.15.154:0/3390141641 learned_addr learned my addr 172.21.15.154:0/3390141641 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:12.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d18ae700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74cc06b250 0x7f74cc11eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d28b0700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 0x7f74cc11f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d18ae700 1 -- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 msgr2=0x7f74cc11f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d18ae700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 0x7f74cc11f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d18ae700 1 -- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74cc06a770 msgr2=0x7f74cc11e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d18ae700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74cc06a770 0x7f74cc11e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d18ae700 1 -- 172.21.15.154:0/3390141641 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc009550 con 0x7f74cc06b250 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d20af700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74cc06a770 0x7f74cc11e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.333+0000 7f74d18ae700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74cc06b250 0x7f74cc11eb60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00e9a0 tx=0x7f74bc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.334+0000 7f74c2ffd700 1 -- 172.21.15.154:0/3390141641 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc004030 con 0x7f74cc06b250 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.334+0000 7f74c2ffd700 1 -- 172.21.15.154:0/3390141641 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc004190 con 0x7f74cc06b250 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.334+0000 7f74d4313700 1 -- 172.21.15.154:0/3390141641 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c4009a70 con 0x7f74cc06b250 2023-09-30T22:29:12.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.334+0000 7f74c2ffd700 1 -- 172.21.15.154:0/3390141641 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc004520 con 0x7f74cc06b250 2023-09-30T22:29:12.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.334+0000 7f74c2ffd700 1 -- 172.21.15.154:0/3390141641 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f74bc00c850 con 0x7f74cc06b250 2023-09-30T22:29:12.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.335+0000 7f74d4313700 1 -- 172.21.15.154:0/3390141641 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc071e10 con 0x7f74cc06b250 2023-09-30T22:29:12.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.335+0000 7f74c2ffd700 1 -- 172.21.15.154:0/3390141641 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f74bc013e30 con 0x7f74cc06b250 2023-09-30T22:29:12.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.335+0000 7f74d4313700 1 -- 172.21.15.154:0/3390141641 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc121a40 con 0x7f74cc06b250 2023-09-30T22:29:12.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.344+0000 7f74c2ffd700 1 -- 172.21.15.154:0/3390141641 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74bc0036a0 con 0x7f74cc06b250 2023-09-30T22:29:12.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.354+0000 7f25ecee7700 1 Processor -- start 2023-09-30T22:29:12.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.354+0000 7f25ecee7700 1 -- start start 2023-09-30T22:29:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.354+0000 7f25ecee7700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25e809d860 0x7f25e809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.354+0000 7f25ecee7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e809e170 0x7f25e81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.354+0000 7f25ecee7700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e809aaa0 con 0x7f25e8130ce0 2023-09-30T22:29:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.354+0000 7f25ecee7700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e809f870 con 0x7f25e809d860 2023-09-30T22:29:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.354+0000 7f25ecee7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e809b360 con 0x7f25e809e170 2023-09-30T22:29:12.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e809e170 0x7f25e81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25e809d860 0x7f25e809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e5d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e809e170 0x7f25e81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51562/0 (socket says 172.21.15.154:51562) 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e659c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25e809d860 0x7f25e809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34644/0 (socket says 172.21.15.154:34644) 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e5d9b700 1 -- 172.21.15.154:0/1176749252 learned_addr learned my addr 172.21.15.154:0/1176749252 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e659c700 1 -- 172.21.15.154:0/1176749252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e809e170 msgr2=0x7f25e81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e659c700 1 --2- 172.21.15.154:0/1176749252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e809e170 0x7f25e81307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e659c700 1 -- 172.21.15.154:0/1176749252 >> v1:172.21.15.154:6789/0 conn(0x7f25e8130ce0 legacy=0x7f25e81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e659c700 1 -- 172.21.15.154:0/1176749252 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e809b620 con 0x7f25e809d860 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e5d9b700 1 --2- 172.21.15.154:0/1176749252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e809e170 0x7f25e81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:12.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e659c700 1 --2- 172.21.15.154:0/1176749252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e809d860 0x7f25e809dc30 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009840 tx=0x7f25d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf9cac108f81c62 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e559a700 1 -- 172.21.15.154:0/1176749252 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8011830 con 0x7f25e809d860 2023-09-30T22:29:12.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e559a700 1 -- 172.21.15.154:0/1176749252 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d8011990 con 0x7f25e809d860 2023-09-30T22:29:12.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.355+0000 7f25e559a700 1 -- 172.21.15.154:0/1176749252 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8011d20 con 0x7f25e809d860 2023-09-30T22:29:12.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.356+0000 7f25ecee7700 1 -- 172.21.15.154:0/1176749252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e809d860 msgr2=0x7f25e809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.356+0000 7f25ecee7700 1 --2- 172.21.15.154:0/1176749252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e809d860 0x7f25e809dc30 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009840 tx=0x7f25d8009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.356+0000 7f25ecee7700 1 -- 172.21.15.154:0/1176749252 shutdown_connections 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.356+0000 7f25ecee7700 1 --2- 172.21.15.154:0/1176749252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e809d860 0x7f25e809dc30 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.356+0000 7f25ecee7700 1 --2- 172.21.15.154:0/1176749252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e809e170 0x7f25e81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.356+0000 7f25ecee7700 1 -- 172.21.15.154:0/1176749252 >> 172.21.15.154:0/1176749252 conn(0x7f25e8099c40 msgr2=0x7f25e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.356+0000 7f25ecee7700 1 -- 172.21.15.154:0/1176749252 shutdown_connections 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.356+0000 7f25ecee7700 1 -- 172.21.15.154:0/1176749252 wait complete. 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.357+0000 7f25ecee7700 1 Processor -- start 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.357+0000 7f25ecee7700 1 -- start start 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.357+0000 7f25ecee7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e809d860 0x7f25e8138230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.357+0000 7f25ecee7700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25e809e170 0x7f25e8138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.357+0000 7f25ecee7700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e8130ce0 0x7f25e81c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.357+0000 7f25ecee7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e813be50 con 0x7f25e809d860 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.357+0000 7f25ecee7700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8136a90 con 0x7f25e8130ce0 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.357+0000 7f25ecee7700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80720e0 con 0x7f25e809e170 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25e809e170 0x7f25e8138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e5d9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25e809e170 0x7f25e8138770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55616/0 (socket says 172.21.15.154:55616) 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e5d9b700 1 -- 172.21.15.154:0/4127888218 learned_addr learned my addr 172.21.15.154:0/4127888218 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e6d9d700 1 --2- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e8130ce0 0x7f25e81c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e659c700 1 --2- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e809d860 0x7f25e8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e5d9b700 1 -- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e8130ce0 msgr2=0x7f25e81c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e5d9b700 1 --2- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e8130ce0 0x7f25e81c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e5d9b700 1 -- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e809d860 msgr2=0x7f25e8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e5d9b700 1 --2- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e809d860 0x7f25e8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e5d9b700 1 -- 172.21.15.154:0/4127888218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc009550 con 0x7f25e809e170 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25e5d9b700 1 --2- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25e809e170 0x7f25e8138770 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00ebe0 tx=0x7f25dc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25d6ffd700 1 -- 172.21.15.154:0/4127888218 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00c850 con 0x7f25e809e170 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25d6ffd700 1 -- 172.21.15.154:0/4127888218 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc00c9b0 con 0x7f25e809e170 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25ecee7700 1 -- 172.21.15.154:0/4127888218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d80094a0 con 0x7f25e809e170 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25d6ffd700 1 -- 172.21.15.154:0/4127888218 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00cd40 con 0x7f25e809e170 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.358+0000 7f25ecee7700 1 -- 172.21.15.154:0/4127888218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e81370c0 con 0x7f25e809e170 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.359+0000 7f25d6ffd700 1 -- 172.21.15.154:0/4127888218 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25dc013470 con 0x7f25e809e170 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.359+0000 7f25ecee7700 1 -- 172.21.15.154:0/4127888218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e804f2a0 con 0x7f25e809e170 2023-09-30T22:29:12.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.360+0000 7f25d6ffd700 1 -- 172.21.15.154:0/4127888218 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25dc03fc40 con 0x7f25e809e170 2023-09-30T22:29:12.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.368+0000 7f25d6ffd700 1 -- 172.21.15.154:0/4127888218 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25dc01b3b0 con 0x7f25e809e170 2023-09-30T22:29:12.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.421+0000 7faea7d9a700 1 -- 172.21.15.154:0/4049330820 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faea006b2a0 con 0x7faea009e450 2023-09-30T22:29:12.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.421+0000 7fae967fc700 1 -- 172.21.15.154:0/4049330820 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae90017020 con 0x7faea009e450 2023-09-30T22:29:12.423 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:12.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.423+0000 7faea7d9a700 1 -- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 msgr2=0x7faea012c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.423+0000 7faea7d9a700 1 --2- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea012c5a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fae90001eb0 tx=0x7fae9000c730 comp rx=0 tx=0).stop 2023-09-30T22:29:12.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.424+0000 7faea7d9a700 1 -- 172.21.15.154:0/4049330820 shutdown_connections 2023-09-30T22:29:12.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.424+0000 7faea7d9a700 1 --2- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7faea01309f0 0x7faea012cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.424+0000 7faea7d9a700 1 --2- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea009d8f0 0x7faea012c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.424+0000 7faea7d9a700 1 --2- 172.21.15.154:0/4049330820 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faea009e450 0x7faea012c5a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.424+0000 7faea7d9a700 1 -- 172.21.15.154:0/4049330820 >> 172.21.15.154:0/4049330820 conn(0x7faea00a2b30 msgr2=0x7faea00993e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.424+0000 7faea7d9a700 1 -- 172.21.15.154:0/4049330820 shutdown_connections 2023-09-30T22:29:12.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.424+0000 7faea7d9a700 1 -- 172.21.15.154:0/4049330820 wait complete. 2023-09-30T22:29:12.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.540+0000 7f74d4313700 1 -- 172.21.15.154:0/3390141641 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f74cc04f2a0 con 0x7f74cc06b250 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.540+0000 7f74c2ffd700 1 -- 172.21.15.154:0/3390141641 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74bc019ab0 con 0x7f74cc06b250 2023-09-30T22:29:12.541 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.542+0000 7f74d4313700 1 -- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74cc06b250 msgr2=0x7f74cc11eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.542+0000 7f74d4313700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74cc06b250 0x7f74cc11eb60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00e9a0 tx=0x7f74bc00ecb0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.542+0000 7f74d4313700 1 -- 172.21.15.154:0/3390141641 shutdown_connections 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.542+0000 7f74d4313700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74cc137140 0x7f74cc11f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.543 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.542+0000 7f74d4313700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74cc06a770 0x7f74cc11e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.542+0000 7f74d4313700 1 --2- 172.21.15.154:0/3390141641 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f74cc06b250 0x7f74cc11eb60 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.542+0000 7f74d4313700 1 -- 172.21.15.154:0/3390141641 >> 172.21.15.154:0/3390141641 conn(0x7f74cc099c40 msgr2=0x7f74cc0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.542+0000 7f74d4313700 1 -- 172.21.15.154:0/3390141641 shutdown_connections 2023-09-30T22:29:12.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.542+0000 7f74d4313700 1 -- 172.21.15.154:0/3390141641 wait complete. 2023-09-30T22:29:12.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:12.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.562+0000 7f25ecee7700 1 -- 172.21.15.154:0/4127888218 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25e806c3b0 con 0x7f25e809e170 2023-09-30T22:29:12.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.562+0000 7f25d6ffd700 1 -- 172.21.15.154:0/4127888218 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25dc024350 con 0x7f25e809e170 2023-09-30T22:29:12.565 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:12.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.564+0000 7f25ecee7700 1 -- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25e809e170 msgr2=0x7f25e8138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:12.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.564+0000 7f25ecee7700 1 --2- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25e809e170 0x7f25e8138770 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00ebe0 tx=0x7f25dc00eef0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.564+0000 7f25ecee7700 1 -- 172.21.15.154:0/4127888218 shutdown_connections 2023-09-30T22:29:12.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.564+0000 7f25ecee7700 1 --2- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e8130ce0 0x7f25e81c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.564+0000 7f25ecee7700 1 --2- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e809d860 0x7f25e8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.564+0000 7f25ecee7700 1 --2- 172.21.15.154:0/4127888218 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f25e809e170 0x7f25e8138770 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.564+0000 7f25ecee7700 1 -- 172.21.15.154:0/4127888218 >> 172.21.15.154:0/4127888218 conn(0x7f25e8099c40 msgr2=0x7f25e81396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.564+0000 7f25ecee7700 1 -- 172.21.15.154:0/4127888218 shutdown_connections 2023-09-30T22:29:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:12.564+0000 7f25ecee7700 1 -- 172.21.15.154:0/4127888218 wait complete. 2023-09-30T22:29:12.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:13.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.171+0000 7f62809c3700 1 Processor -- start 2023-09-30T22:29:13.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.171+0000 7f62809c3700 1 -- start start 2023-09-30T22:29:13.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f62809c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f62809c3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f62809c3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f627c0a0a70 0x7f627c0a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f62809c3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c0a3b60 con 0x7f627c0a0a70 2023-09-30T22:29:13.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f62809c3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c1348e0 con 0x7f627c133f70 2023-09-30T22:29:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f62809c3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f627c09b110 con 0x7f627c09ad40 2023-09-30T22:29:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f6279d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f627ad9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f627c0a0a70 0x7f627c0a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f6279d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51570/0 (socket says 172.21.15.154:51570) 2023-09-30T22:29:13.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f6279d9b700 1 -- 172.21.15.154:0/1397133812 learned_addr learned my addr 172.21.15.154:0/1397133812 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:13.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f627ad9d700 1 --2- 172.21.15.154:0/1397133812 >> v2:172.21.15.154:3300/0 conn(0x7f627c0a0a70 0x7f627c0a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34658/0 (socket says 172.21.15.154:34658) 2023-09-30T22:29:13.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.172+0000 7f627a59c700 1 --2- 172.21.15.154:0/1397133812 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.173+0000 7f6279d9b700 1 -- 172.21.15.154:0/1397133812 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 msgr2=0x7f627c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:13.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.173+0000 7f6279d9b700 1 --2- 172.21.15.154:0/1397133812 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.173+0000 7f6279d9b700 1 -- 172.21.15.154:0/1397133812 >> v2:172.21.15.154:3300/0 conn(0x7f627c0a0a70 msgr2=0x7f627c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:13.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.173+0000 7f6279d9b700 1 --2- 172.21.15.154:0/1397133812 >> v2:172.21.15.154:3300/0 conn(0x7f627c0a0a70 0x7f627c0a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.173+0000 7f6279d9b700 1 -- 172.21.15.154:0/1397133812 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0a2fa0 con 0x7f627c133f70 2023-09-30T22:29:13.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.173+0000 7f6279d9b700 1 --2- 172.21.15.154:0/1397133812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c1343a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6270009920 tx=0x7f6270009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e12aa951eafd5f28 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.173+0000 7f627959a700 1 -- 172.21.15.154:0/1397133812 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270011830 con 0x7f627c133f70 2023-09-30T22:29:13.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.173+0000 7f627959a700 1 -- 172.21.15.154:0/1397133812 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6270011990 con 0x7f627c133f70 2023-09-30T22:29:13.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.173+0000 7f627959a700 1 -- 172.21.15.154:0/1397133812 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270011d20 con 0x7f627c133f70 2023-09-30T22:29:13.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.174+0000 7f62809c3700 1 -- 172.21.15.154:0/1397133812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 msgr2=0x7f627c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.174+0000 7f62809c3700 1 --2- 172.21.15.154:0/1397133812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c1343a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6270009920 tx=0x7f6270009c30 comp rx=0 tx=0).stop 2023-09-30T22:29:13.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.174+0000 7f62809c3700 1 -- 172.21.15.154:0/1397133812 shutdown_connections 2023-09-30T22:29:13.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.174+0000 7f62809c3700 1 --2- 172.21.15.154:0/1397133812 >> v2:172.21.15.154:3300/0 conn(0x7f627c0a0a70 0x7f627c0a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.174+0000 7f62809c3700 1 --2- 172.21.15.154:0/1397133812 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.174+0000 7f62809c3700 1 --2- 172.21.15.154:0/1397133812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c1343a0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.174+0000 7f62809c3700 1 -- 172.21.15.154:0/1397133812 >> 172.21.15.154:0/1397133812 conn(0x7f627c099c40 msgr2=0x7f627c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.174+0000 7f62809c3700 1 -- 172.21.15.154:0/1397133812 shutdown_connections 2023-09-30T22:29:13.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.174+0000 7f62809c3700 1 -- 172.21.15.154:0/1397133812 wait complete. 2023-09-30T22:29:13.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f62809c3700 1 Processor -- start 2023-09-30T22:29:13.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f62809c3700 1 -- start start 2023-09-30T22:29:13.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f62809c3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c122380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f62809c3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f627c0a0a70 0x7f627c1228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f62809c3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f62809c3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c125ea0 con 0x7f627c0a0a70 2023-09-30T22:29:13.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f62809c3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c125990 con 0x7f627c133f70 2023-09-30T22:29:13.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f62809c3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f627c124e20 con 0x7f627c09ad40 2023-09-30T22:29:13.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f627a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c122380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f6279d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f627c0a0a70 0x7f627c1228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f627a59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c122380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55632/0 (socket says 172.21.15.154:55632) 2023-09-30T22:29:13.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f627a59c700 1 -- 172.21.15.154:0/784662794 learned_addr learned my addr 172.21.15.154:0/784662794 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:13.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.175+0000 7f627ad9d700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f6279d9b700 1 -- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 msgr2=0x7f627c122380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f6279d9b700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c122380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f6279d9b700 1 -- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 msgr2=0x7f627c122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f6279d9b700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c122e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f6279d9b700 1 -- 172.21.15.154:0/784662794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270009550 con 0x7f627c0a0a70 2023-09-30T22:29:13.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f627a59c700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c122380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f627ad9d700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f6279d9b700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f627c0a0a70 0x7f627c1228c0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f6270016000 tx=0x7f6270004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f626affd700 1 -- 172.21.15.154:0/784662794 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270004450 con 0x7f627c0a0a70 2023-09-30T22:29:13.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f626affd700 1 -- 172.21.15.154:0/784662794 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62700036a0 con 0x7f627c0a0a70 2023-09-30T22:29:13.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f62809c3700 1 -- 172.21.15.154:0/784662794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c09c7e0 con 0x7f627c0a0a70 2023-09-30T22:29:13.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f626affd700 1 -- 172.21.15.154:0/784662794 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700045f0 con 0x7f627c0a0a70 2023-09-30T22:29:13.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.176+0000 7f62809c3700 1 -- 172.21.15.154:0/784662794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c09bf70 con 0x7f627c0a0a70 2023-09-30T22:29:13.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.177+0000 7f626affd700 1 -- 172.21.15.154:0/784662794 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6270003a50 con 0x7f627c0a0a70 2023-09-30T22:29:13.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.177+0000 7f626affd700 1 -- 172.21.15.154:0/784662794 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6270040640 con 0x7f627c0a0a70 2023-09-30T22:29:13.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.177+0000 7f62809c3700 1 -- 172.21.15.154:0/784662794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c11f070 con 0x7f627c0a0a70 2023-09-30T22:29:13.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.182+0000 7f626affd700 1 -- 172.21.15.154:0/784662794 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6270015080 con 0x7f627c0a0a70 2023-09-30T22:29:13.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.367+0000 7f62809c3700 1 -- 172.21.15.154:0/784662794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f627c04f2a0 con 0x7f627c0a0a70 2023-09-30T22:29:13.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.368+0000 7f626affd700 1 -- 172.21.15.154:0/784662794 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f627002a030 con 0x7f627c0a0a70 2023-09-30T22:29:13.369 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.370+0000 7f62809c3700 1 -- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f627c0a0a70 msgr2=0x7f627c1228c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.370+0000 7f62809c3700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f627c0a0a70 0x7f627c1228c0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f6270016000 tx=0x7f6270004750 comp rx=0 tx=0).stop 2023-09-30T22:29:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.370+0000 7f62809c3700 1 -- 172.21.15.154:0/784662794 shutdown_connections 2023-09-30T22:29:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.370+0000 7f62809c3700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627c133f70 0x7f627c122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.370+0000 7f62809c3700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f627c09ad40 0x7f627c122380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.370+0000 7f62809c3700 1 --2- 172.21.15.154:0/784662794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f627c0a0a70 0x7f627c1228c0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.370+0000 7f62809c3700 1 -- 172.21.15.154:0/784662794 >> 172.21.15.154:0/784662794 conn(0x7f627c099c40 msgr2=0x7f627c0a6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.370+0000 7f62809c3700 1 -- 172.21.15.154:0/784662794 shutdown_connections 2023-09-30T22:29:13.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.370+0000 7f62809c3700 1 -- 172.21.15.154:0/784662794 wait complete. 2023-09-30T22:29:13.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:13.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:13.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:13.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.560+0000 7fe161456700 1 Processor -- start 2023-09-30T22:29:13.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.560+0000 7fe161456700 1 -- start start 2023-09-30T22:29:13.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe161456700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c0a0a70 0x7fe15c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe161456700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe15c134120 0x7fe15c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe161456700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c09dc00 con 0x7fe15c0a1380 2023-09-30T22:29:13.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe161456700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c09ea60 con 0x7fe15c134120 2023-09-30T22:29:13.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe161456700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c09dec0 con 0x7fe15c0a0a70 2023-09-30T22:29:13.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c0a0a70 0x7fe15c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe15c134120 0x7fe15c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15b7fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe15c134120 0x7fe15c13bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34680/0 (socket says 172.21.15.154:34680) 2023-09-30T22:29:13.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c0a0a70 0x7fe15c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51584/0 (socket says 172.21.15.154:51584) 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15b7fe700 1 -- 172.21.15.154:0/3601995931 learned_addr learned my addr 172.21.15.154:0/3601995931 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15affd700 1 -- 172.21.15.154:0/3601995931 >> v2:172.21.15.154:3300/0 conn(0x7fe15c134120 msgr2=0x7fe15c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15affd700 1 --2- 172.21.15.154:0/3601995931 >> v2:172.21.15.154:3300/0 conn(0x7fe15c134120 0x7fe15c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15affd700 1 -- 172.21.15.154:0/3601995931 >> v1:172.21.15.154:6789/0 conn(0x7fe15c0a1380 legacy=0x7fe15c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15affd700 1 -- 172.21.15.154:0/3601995931 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c09e6a0 con 0x7fe15c0a0a70 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe159ffb700 1 -- 172.21.15.154:0/3601995931 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646624030 0 0) 0x7fe15c09dc00 con 0x7fe15c0a1380 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15b7fe700 1 --2- 172.21.15.154:0/3601995931 >> v2:172.21.15.154:3300/0 conn(0x7fe15c134120 0x7fe15c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.561+0000 7fe15affd700 1 --2- 172.21.15.154:0/3601995931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c0a0a70 0x7fe15c0a0e40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009840 tx=0x7fe14c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65b5ad63de3fb9d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe159ffb700 1 -- 172.21.15.154:0/3601995931 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c011830 con 0x7fe15c0a0a70 2023-09-30T22:29:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe159ffb700 1 -- 172.21.15.154:0/3601995931 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c011990 con 0x7fe15c0a0a70 2023-09-30T22:29:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe159ffb700 1 -- 172.21.15.154:0/3601995931 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c011d20 con 0x7fe15c0a0a70 2023-09-30T22:29:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe161456700 1 -- 172.21.15.154:0/3601995931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c0a0a70 msgr2=0x7fe15c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe161456700 1 --2- 172.21.15.154:0/3601995931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c0a0a70 0x7fe15c0a0e40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009840 tx=0x7fe14c009b50 comp rx=0 tx=0).stop 2023-09-30T22:29:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe161456700 1 -- 172.21.15.154:0/3601995931 shutdown_connections 2023-09-30T22:29:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe161456700 1 --2- 172.21.15.154:0/3601995931 >> v2:172.21.15.154:3300/0 conn(0x7fe15c134120 0x7fe15c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe161456700 1 --2- 172.21.15.154:0/3601995931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c0a0a70 0x7fe15c0a0e40 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe161456700 1 -- 172.21.15.154:0/3601995931 >> 172.21.15.154:0/3601995931 conn(0x7fe15c0a6610 msgr2=0x7fe15c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe161456700 1 -- 172.21.15.154:0/3601995931 shutdown_connections 2023-09-30T22:29:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.562+0000 7fe161456700 1 -- 172.21.15.154:0/3601995931 wait complete. 2023-09-30T22:29:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.563+0000 7fe161456700 1 Processor -- start 2023-09-30T22:29:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.563+0000 7fe161456700 1 -- start start 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe161456700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c0a0a70 0x7fe15c122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe161456700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c0a1380 0x7fe15c122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe161456700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c134120 0x7fe15c123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe161456700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c133300 con 0x7fe15c0a0a70 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe161456700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c125aa0 con 0x7fe15c134120 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe161456700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c133650 con 0x7fe15c0a1380 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c0a0a70 0x7fe15c122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c0a0a70 0x7fe15c122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34694/0 (socket says 172.21.15.154:34694) 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15affd700 1 -- 172.21.15.154:0/3697188836 learned_addr learned my addr 172.21.15.154:0/3697188836 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c134120 0x7fe15c123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15a7fc700 1 --2- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c0a1380 0x7fe15c122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15b7fe700 1 -- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c0a1380 msgr2=0x7fe15c122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15b7fe700 1 --2- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c0a1380 0x7fe15c122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15b7fe700 1 -- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c0a0a70 msgr2=0x7fe15c122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15b7fe700 1 --2- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c0a0a70 0x7fe15c122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15b7fe700 1 -- 172.21.15.154:0/3697188836 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe154009b30 con 0x7fe15c134120 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.564+0000 7fe15affd700 1 --2- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c0a0a70 0x7fe15c122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.565+0000 7fe15b7fe700 1 --2- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c134120 0x7fe15c123210 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe15400efc0 tx=0x7fe15400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.565+0000 7fe1437fe700 1 -- 172.21.15.154:0/3697188836 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154018070 con 0x7fe15c134120 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.565+0000 7fe1437fe700 1 -- 172.21.15.154:0/3697188836 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15400f040 con 0x7fe15c134120 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.565+0000 7fe161456700 1 -- 172.21.15.154:0/3697188836 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c0094a0 con 0x7fe15c134120 2023-09-30T22:29:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.565+0000 7fe1437fe700 1 -- 172.21.15.154:0/3697188836 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154003c60 con 0x7fe15c134120 2023-09-30T22:29:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.565+0000 7fe161456700 1 -- 172.21.15.154:0/3697188836 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c133990 con 0x7fe15c134120 2023-09-30T22:29:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.565+0000 7fe1437fe700 1 -- 172.21.15.154:0/3697188836 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe15400c880 con 0x7fe15c134120 2023-09-30T22:29:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.566+0000 7fe1437fe700 1 -- 172.21.15.154:0/3697188836 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe15403f730 con 0x7fe15c134120 2023-09-30T22:29:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.566+0000 7fe161456700 1 -- 172.21.15.154:0/3697188836 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c125e60 con 0x7fe15c134120 2023-09-30T22:29:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.571+0000 7fe1437fe700 1 -- 172.21.15.154:0/3697188836 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe154003dc0 con 0x7fe15c134120 2023-09-30T22:29:13.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T22:29:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.683+0000 7f341139a700 1 Processor -- start 2023-09-30T22:29:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.683+0000 7f341139a700 1 -- start start 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f341139a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c12d280 0x7f340c12d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f341139a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130eb0 0x7f340c138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f341139a700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340c09ae40 con 0x7f340c130350 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f341139a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c09b9a0 con 0x7f340c12d280 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f341139a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f340c09bbb0 con 0x7f340c130eb0 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c12d280 0x7f340c12d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340affd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c12d280 0x7f340c12d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51604/0 (socket says 172.21.15.154:51604) 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340a7fc700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f340c130350 0x7f340c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54626/0 (socket says 172.21.15.154:54626) 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340b7fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130eb0 0x7f340c138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340affd700 1 -- 172.21.15.154:0/3449934750 learned_addr learned my addr 172.21.15.154:0/3449934750 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340affd700 1 -- 172.21.15.154:0/3449934750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130eb0 msgr2=0x7f340c138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340affd700 1 --2- 172.21.15.154:0/3449934750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130eb0 0x7f340c138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340affd700 1 -- 172.21.15.154:0/3449934750 >> v1:172.21.15.154:6789/0 conn(0x7f340c130350 legacy=0x7f340c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340affd700 1 -- 172.21.15.154:0/3449934750 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c09b250 con 0x7f340c12d280 2023-09-30T22:29:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f3409ffb700 1 -- 172.21.15.154:0/3449934750 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952540078 0 0) 0x7f340c09ae40 con 0x7f340c130350 2023-09-30T22:29:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.684+0000 7f340b7fe700 1 --2- 172.21.15.154:0/3449934750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130eb0 0x7f340c138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f340affd700 1 --2- 172.21.15.154:0/3449934750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c12d280 0x7f340c12d650 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00dd10 tx=0x7f33fc00f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=249d96f539cdaaad server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f3409ffb700 1 -- 172.21.15.154:0/3449934750 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc012070 con 0x7f340c12d280 2023-09-30T22:29:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f3409ffb700 1 -- 172.21.15.154:0/3449934750 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc00de60 con 0x7f340c12d280 2023-09-30T22:29:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f3409ffb700 1 -- 172.21.15.154:0/3449934750 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc005e50 con 0x7f340c12d280 2023-09-30T22:29:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f341139a700 1 -- 172.21.15.154:0/3449934750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c12d280 msgr2=0x7f340c12d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f341139a700 1 --2- 172.21.15.154:0/3449934750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c12d280 0x7f340c12d650 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00dd10 tx=0x7f33fc00f330 comp rx=0 tx=0).stop 2023-09-30T22:29:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f341139a700 1 -- 172.21.15.154:0/3449934750 shutdown_connections 2023-09-30T22:29:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f341139a700 1 --2- 172.21.15.154:0/3449934750 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130eb0 0x7f340c138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f341139a700 1 --2- 172.21.15.154:0/3449934750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c12d280 0x7f340c12d650 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f341139a700 1 -- 172.21.15.154:0/3449934750 >> 172.21.15.154:0/3449934750 conn(0x7f340c0a2980 msgr2=0x7f340c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.685+0000 7f341139a700 1 -- 172.21.15.154:0/3449934750 shutdown_connections 2023-09-30T22:29:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.686+0000 7f341139a700 1 -- 172.21.15.154:0/3449934750 wait complete. 2023-09-30T22:29:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f341139a700 1 Processor -- start 2023-09-30T22:29:13.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f341139a700 1 -- start start 2023-09-30T22:29:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f341139a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340c12d280 0x7f340c11a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f341139a700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130350 0x7f340c11acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f341139a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c130eb0 0x7f340c11b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f341139a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c11e2d0 con 0x7f340c12d280 2023-09-30T22:29:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f341139a700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c11c9a0 con 0x7f340c130eb0 2023-09-30T22:29:13.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f341139a700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f340c11da60 con 0x7f340c130350 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f340a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130350 0x7f340c11acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f340a7fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130350 0x7f340c11acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55676/0 (socket says 172.21.15.154:55676) 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f340affd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340c12d280 0x7f340c11a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f340a7fc700 1 -- 172.21.15.154:0/3031046380 learned_addr learned my addr 172.21.15.154:0/3031046380 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f340b7fe700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c130eb0 0x7f340c11b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f340a7fc700 1 -- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c130eb0 msgr2=0x7f340c11b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f340a7fc700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c130eb0 0x7f340c11b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f340a7fc700 1 -- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340c12d280 msgr2=0x7f340c11a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.687+0000 7f340a7fc700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340c12d280 0x7f340c11a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.688+0000 7f340a7fc700 1 -- 172.21.15.154:0/3031046380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3404009a70 con 0x7f340c130350 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.688+0000 7f340b7fe700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c130eb0 0x7f340c11b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.688+0000 7f340affd700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340c12d280 0x7f340c11a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.688+0000 7f340a7fc700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130350 0x7f340c11acf0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f340000c520 tx=0x7f340000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.688+0000 7f33f37fe700 1 -- 172.21.15.154:0/3031046380 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400004c80 con 0x7f340c130350 2023-09-30T22:29:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.688+0000 7f33f37fe700 1 -- 172.21.15.154:0/3031046380 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3400004de0 con 0x7f340c130350 2023-09-30T22:29:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.688+0000 7f33f37fe700 1 -- 172.21.15.154:0/3031046380 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400007310 con 0x7f340c130350 2023-09-30T22:29:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.688+0000 7f341139a700 1 -- 172.21.15.154:0/3031046380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc00d9a0 con 0x7f340c130350 2023-09-30T22:29:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.688+0000 7f341139a700 1 -- 172.21.15.154:0/3031046380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340c12eef0 con 0x7f340c130350 2023-09-30T22:29:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.689+0000 7f341139a700 1 -- 172.21.15.154:0/3031046380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340c04f2a0 con 0x7f340c130350 2023-09-30T22:29:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.689+0000 7f33f37fe700 1 -- 172.21.15.154:0/3031046380 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3400007470 con 0x7f340c130350 2023-09-30T22:29:13.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.689+0000 7f33f37fe700 1 -- 172.21.15.154:0/3031046380 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f340003f8b0 con 0x7f340c130350 2023-09-30T22:29:13.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.697+0000 7f33f37fe700 1 -- 172.21.15.154:0/3031046380 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34000106d0 con 0x7f340c130350 2023-09-30T22:29:13.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.707+0000 7f8839b12700 1 Processor -- start 2023-09-30T22:29:13.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.707+0000 7f8839b12700 1 -- start start 2023-09-30T22:29:13.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8839b12700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88340a0a70 0x7f88340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8839b12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f8834133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8839b12700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8834133f50 0x7f88341343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8839b12700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883409e9d0 con 0x7f8834133f50 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8839b12700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883409dc00 con 0x7f88340a0a70 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8839b12700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f883409dec0 con 0x7f88340a1380 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8833fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8834133f50 0x7f88341343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8832ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f8834133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8833fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8834133f50 0x7f88341343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34706/0 (socket says 172.21.15.154:34706) 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8833fff700 1 -- 172.21.15.154:0/3199010021 learned_addr learned my addr 172.21.15.154:0/3199010021 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8832ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f8834133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55680/0 (socket says 172.21.15.154:55680) 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f88337fe700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88340a0a70 0x7f88340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8833fff700 1 -- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 msgr2=0x7f8834133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8833fff700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f8834133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8833fff700 1 -- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88340a0a70 msgr2=0x7f88340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8833fff700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88340a0a70 0x7f88340a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8833fff700 1 -- 172.21.15.154:0/3199010021 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883409e6a0 con 0x7f8834133f50 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f8832ffd700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f8834133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.708+0000 7f88337fe700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88340a0a70 0x7f88340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8833fff700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8834133f50 0x7f88341343f0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f882c0098f0 tx=0x7f882c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2272f38eca2e1f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f88327fc700 1 -- 172.21.15.154:0/3199010021 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c011830 con 0x7f8834133f50 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f88327fc700 1 -- 172.21.15.154:0/3199010021 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c011990 con 0x7f8834133f50 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f88327fc700 1 -- 172.21.15.154:0/3199010021 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c011d20 con 0x7f8834133f50 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8839b12700 1 -- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8834133f50 msgr2=0x7f88341343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8839b12700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8834133f50 0x7f88341343f0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f882c0098f0 tx=0x7f882c009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:13.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8839b12700 1 -- 172.21.15.154:0/3199010021 shutdown_connections 2023-09-30T22:29:13.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8839b12700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88340a0a70 0x7f88340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8839b12700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8834133f50 0x7f88341343f0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8839b12700 1 --2- 172.21.15.154:0/3199010021 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f8834133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8839b12700 1 -- 172.21.15.154:0/3199010021 >> 172.21.15.154:0/3199010021 conn(0x7f88340a6610 msgr2=0x7f88340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8839b12700 1 -- 172.21.15.154:0/3199010021 shutdown_connections 2023-09-30T22:29:13.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.709+0000 7f8839b12700 1 -- 172.21.15.154:0/3199010021 wait complete. 2023-09-30T22:29:13.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.710+0000 7f8839b12700 1 Processor -- start 2023-09-30T22:29:13.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8839b12700 1 -- start start 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8839b12700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340a0a70 0x7f883411f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8839b12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f883411f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8839b12700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8834133f50 0x7f883411fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8839b12700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834122df0 con 0x7f88340a0a70 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8839b12700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88341228e0 con 0x7f8834133f50 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8839b12700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8834121d80 con 0x7f88340a1380 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8832ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f883411f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f88337fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340a0a70 0x7f883411f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8832ffd700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f883411f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55692/0 (socket says 172.21.15.154:55692) 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8832ffd700 1 -- 172.21.15.154:0/2339067286 learned_addr learned my addr 172.21.15.154:0/2339067286 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f88337fe700 1 --2- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340a0a70 0x7f883411f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34716/0 (socket says 172.21.15.154:34716) 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8833fff700 1 --2- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8834133f50 0x7f883411fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8832ffd700 1 -- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8834133f50 msgr2=0x7f883411fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8832ffd700 1 --2- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8834133f50 0x7f883411fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8832ffd700 1 -- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340a0a70 msgr2=0x7f883411f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8832ffd700 1 --2- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340a0a70 0x7f883411f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.711+0000 7f8832ffd700 1 -- 172.21.15.154:0/2339067286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c0094a0 con 0x7f88340a1380 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.712+0000 7f8832ffd700 1 --2- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f883411f810 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f881c00ebb0 tx=0x7f881c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.712+0000 7f882bfff700 1 -- 172.21.15.154:0/2339067286 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00c850 con 0x7f88340a1380 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.712+0000 7f882bfff700 1 -- 172.21.15.154:0/2339067286 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c00c9b0 con 0x7f88340a1380 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.712+0000 7f882bfff700 1 -- 172.21.15.154:0/2339067286 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00cd40 con 0x7f88340a1380 2023-09-30T22:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.712+0000 7f8839b12700 1 -- 172.21.15.154:0/2339067286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c009550 con 0x7f88340a1380 2023-09-30T22:29:13.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.712+0000 7f8839b12700 1 -- 172.21.15.154:0/2339067286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88340a03e0 con 0x7f88340a1380 2023-09-30T22:29:13.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.713+0000 7f882bfff700 1 -- 172.21.15.154:0/2339067286 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f881c013470 con 0x7f88340a1380 2023-09-30T22:29:13.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.713+0000 7f882bfff700 1 -- 172.21.15.154:0/2339067286 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f881c03fb30 con 0x7f88340a1380 2023-09-30T22:29:13.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.714+0000 7f8839b12700 1 -- 172.21.15.154:0/2339067286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883404f2a0 con 0x7f88340a1380 2023-09-30T22:29:13.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.718+0000 7f882bfff700 1 -- 172.21.15.154:0/2339067286 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f881c01b3b0 con 0x7f88340a1380 2023-09-30T22:29:13.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.768+0000 7fe161456700 1 -- 172.21.15.154:0/3697188836 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe15c04f2a0 con 0x7fe15c134120 2023-09-30T22:29:13.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.768+0000 7fe1437fe700 1 -- 172.21.15.154:0/3697188836 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe15401cbb0 con 0x7fe15c134120 2023-09-30T22:29:13.769 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.771+0000 7fe161456700 1 -- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c134120 msgr2=0x7fe15c123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.771+0000 7fe161456700 1 --2- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c134120 0x7fe15c123210 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe15400efc0 tx=0x7fe15400c3a0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.771+0000 7fe161456700 1 -- 172.21.15.154:0/3697188836 shutdown_connections 2023-09-30T22:29:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.771+0000 7fe161456700 1 --2- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe15c134120 0x7fe15c123210 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.771+0000 7fe161456700 1 --2- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe15c0a0a70 0x7fe15c122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.771+0000 7fe161456700 1 --2- 172.21.15.154:0/3697188836 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe15c0a1380 0x7fe15c122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.771+0000 7fe161456700 1 -- 172.21.15.154:0/3697188836 >> 172.21.15.154:0/3697188836 conn(0x7fe15c0a6610 msgr2=0x7fe15c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.771+0000 7fe161456700 1 -- 172.21.15.154:0/3697188836 shutdown_connections 2023-09-30T22:29:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.771+0000 7fe161456700 1 -- 172.21.15.154:0/3697188836 wait complete. 2023-09-30T22:29:13.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:13.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.893+0000 7f341139a700 1 -- 172.21.15.154:0/3031046380 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f340c11d610 con 0x7f340c130350 2023-09-30T22:29:13.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.894+0000 7f33f37fe700 1 -- 172.21.15.154:0/3031046380 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3400011360 con 0x7f340c130350 2023-09-30T22:29:13.895 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.896+0000 7f341139a700 1 -- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130350 msgr2=0x7f340c11acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.896+0000 7f341139a700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130350 0x7f340c11acf0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f340000c520 tx=0x7f340000c830 comp rx=0 tx=0).stop 2023-09-30T22:29:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.896+0000 7f341139a700 1 -- 172.21.15.154:0/3031046380 shutdown_connections 2023-09-30T22:29:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.896+0000 7f341139a700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f340c130eb0 0x7f340c11b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.896+0000 7f341139a700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f340c12d280 0x7f340c11a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.896+0000 7f341139a700 1 --2- 172.21.15.154:0/3031046380 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f340c130350 0x7f340c11acf0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.896+0000 7f341139a700 1 -- 172.21.15.154:0/3031046380 >> 172.21.15.154:0/3031046380 conn(0x7f340c0a2980 msgr2=0x7f340c09ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.896+0000 7f341139a700 1 -- 172.21.15.154:0/3031046380 shutdown_connections 2023-09-30T22:29:13.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.896+0000 7f341139a700 1 -- 172.21.15.154:0/3031046380 wait complete. 2023-09-30T22:29:13.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.915+0000 7f8839b12700 1 -- 172.21.15.154:0/2339067286 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8834120ee0 con 0x7f88340a1380 2023-09-30T22:29:13.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.915+0000 7f882bfff700 1 -- 172.21.15.154:0/2339067286 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f881c021030 con 0x7f88340a1380 2023-09-30T22:29:13.917 INFO:teuthology.orchestra.run.smithi154.stdout:124554051586 2023-09-30T22:29:13.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.918+0000 7f8839b12700 1 -- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 msgr2=0x7f883411f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:13.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.918+0000 7f8839b12700 1 --2- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f883411f810 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f881c00ebb0 tx=0x7f881c00eec0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.918+0000 7f8839b12700 1 -- 172.21.15.154:0/2339067286 shutdown_connections 2023-09-30T22:29:13.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.918+0000 7f8839b12700 1 --2- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8834133f50 0x7f883411fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.918+0000 7f8839b12700 1 --2- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88340a0a70 0x7f883411f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.918+0000 7f8839b12700 1 --2- 172.21.15.154:0/2339067286 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f88340a1380 0x7f883411f810 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:13.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.918+0000 7f8839b12700 1 -- 172.21.15.154:0/2339067286 >> 172.21.15.154:0/2339067286 conn(0x7f88340a6610 msgr2=0x7f883409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:13.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.918+0000 7f8839b12700 1 -- 172.21.15.154:0/2339067286 shutdown_connections 2023-09-30T22:29:13.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:13.918+0000 7f8839b12700 1 -- 172.21.15.154:0/2339067286 wait complete. 2023-09-30T22:29:13.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051586 for osd.0 2023-09-30T22:29:14.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T22:29:14.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.506+0000 7f01950db700 1 Processor -- start 2023-09-30T22:29:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.506+0000 7f01950db700 1 -- start start 2023-09-30T22:29:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f01950db700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f019009e340 0x7f01901359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f01950db700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0190135f20 0x7f0190138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f01950db700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019009aaa0 con 0x7f019009d860 2023-09-30T22:29:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f01950db700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019009e730 con 0x7f0190135f20 2023-09-30T22:29:14.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f01950db700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019009f870 con 0x7f019009e340 2023-09-30T22:29:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f019009e340 0x7f01901359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f019009e340 0x7f01901359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51632/0 (socket says 172.21.15.154:51632) 2023-09-30T22:29:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018e59c700 1 -- 172.21.15.154:0/3208060284 learned_addr learned my addr 172.21.15.154:0/3208060284 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018f59e700 1 --2- 172.21.15.154:0/3208060284 >> v2:172.21.15.154:3300/0 conn(0x7f0190135f20 0x7f0190138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018e59c700 1 -- 172.21.15.154:0/3208060284 >> v2:172.21.15.154:3300/0 conn(0x7f0190135f20 msgr2=0x7f0190138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018e59c700 1 --2- 172.21.15.154:0/3208060284 >> v2:172.21.15.154:3300/0 conn(0x7f0190135f20 0x7f0190138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018e59c700 1 -- 172.21.15.154:0/3208060284 >> v1:172.21.15.154:6789/0 conn(0x7f019009d860 legacy=0x7f019009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018e59c700 1 -- 172.21.15.154:0/3208060284 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019009b360 con 0x7f019009e340 2023-09-30T22:29:14.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018f59e700 1 --2- 172.21.15.154:0/3208060284 >> v2:172.21.15.154:3300/0 conn(0x7f0190135f20 0x7f0190138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:14.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018e59c700 1 --2- 172.21.15.154:0/3208060284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f019009e340 0x7f01901359e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f018000bb90 tx=0x7f018000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94e677c879ec9dbc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018dd9b700 1 -- 172.21.15.154:0/3208060284 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000dd30 con 0x7f019009e340 2023-09-30T22:29:14.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018dd9b700 1 -- 172.21.15.154:0/3208060284 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018000de90 con 0x7f019009e340 2023-09-30T22:29:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.507+0000 7f018dd9b700 1 -- 172.21.15.154:0/3208060284 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180010690 con 0x7f019009e340 2023-09-30T22:29:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.508+0000 7f01950db700 1 -- 172.21.15.154:0/3208060284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f019009e340 msgr2=0x7f01901359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.508+0000 7f01950db700 1 --2- 172.21.15.154:0/3208060284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f019009e340 0x7f01901359e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f018000bb90 tx=0x7f018000bea0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.508+0000 7f01950db700 1 -- 172.21.15.154:0/3208060284 shutdown_connections 2023-09-30T22:29:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.508+0000 7f01950db700 1 --2- 172.21.15.154:0/3208060284 >> v2:172.21.15.154:3300/0 conn(0x7f0190135f20 0x7f0190138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.508+0000 7f01950db700 1 --2- 172.21.15.154:0/3208060284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f019009e340 0x7f01901359e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.508+0000 7f01950db700 1 -- 172.21.15.154:0/3208060284 >> 172.21.15.154:0/3208060284 conn(0x7f0190099c40 msgr2=0x7f01900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.508+0000 7f01950db700 1 -- 172.21.15.154:0/3208060284 shutdown_connections 2023-09-30T22:29:14.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.508+0000 7f01950db700 1 -- 172.21.15.154:0/3208060284 wait complete. 2023-09-30T22:29:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.509+0000 7f01950db700 1 Processor -- start 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.509+0000 7f01950db700 1 -- start start 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01950db700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f019009d860 0x7f01901c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01950db700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f019009e340 0x7f01901c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01950db700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0190135f20 0x7f01901c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01950db700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900a22a0 con 0x7f019009e340 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01950db700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01901324a0 con 0x7f0190135f20 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01950db700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0190132670 con 0x7f019009d860 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f019009e340 0x7f01901c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018e59c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f019009e340 0x7f01901c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34722/0 (socket says 172.21.15.154:34722) 2023-09-30T22:29:14.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018e59c700 1 -- 172.21.15.154:0/2151132558 learned_addr learned my addr 172.21.15.154:0/2151132558 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018f59e700 1 --2- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0190135f20 0x7f01901c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018ed9d700 1 --2- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f019009d860 0x7f01901c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018e59c700 1 -- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f019009d860 msgr2=0x7f01901c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018e59c700 1 --2- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f019009d860 0x7f01901c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018e59c700 1 -- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0190135f20 msgr2=0x7f01901c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018e59c700 1 --2- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0190135f20 0x7f01901c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018e59c700 1 -- 172.21.15.154:0/2151132558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188009a70 con 0x7f019009e340 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f018e59c700 1 --2- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f019009e340 0x7f01901c8990 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f0180000c00 tx=0x7f0180004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01777fe700 1 -- 172.21.15.154:0/2151132558 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180003b30 con 0x7f019009e340 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01777fe700 1 -- 172.21.15.154:0/2151132558 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180003cb0 con 0x7f019009e340 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01950db700 1 -- 172.21.15.154:0/2151132558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018000b7f0 con 0x7f019009e340 2023-09-30T22:29:14.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01777fe700 1 -- 172.21.15.154:0/2151132558 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800106b0 con 0x7f019009e340 2023-09-30T22:29:14.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.510+0000 7f01950db700 1 -- 172.21.15.154:0/2151132558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01901226c0 con 0x7f019009e340 2023-09-30T22:29:14.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.511+0000 7f01777fe700 1 -- 172.21.15.154:0/2151132558 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0180019400 con 0x7f019009e340 2023-09-30T22:29:14.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.511+0000 7f01777fe700 1 -- 172.21.15.154:0/2151132558 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f01800408a0 con 0x7f019009e340 2023-09-30T22:29:14.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.511+0000 7f01950db700 1 -- 172.21.15.154:0/2151132558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0190123260 con 0x7f019009e340 2023-09-30T22:29:14.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.516+0000 7f01777fe700 1 -- 172.21.15.154:0/2151132558 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0190123260 con 0x7f019009e340 2023-09-30T22:29:14.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.699+0000 7f01950db700 1 -- 172.21.15.154:0/2151132558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f019004f2a0 con 0x7f019009e340 2023-09-30T22:29:14.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.699+0000 7f01777fe700 1 -- 172.21.15.154:0/2151132558 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0180018950 con 0x7f019009e340 2023-09-30T22:29:14.700 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:14.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.701+0000 7f01950db700 1 -- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f019009e340 msgr2=0x7f01901c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.701+0000 7f01950db700 1 --2- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f019009e340 0x7f01901c8990 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f0180000c00 tx=0x7f0180004750 comp rx=0 tx=0).stop 2023-09-30T22:29:14.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.701+0000 7f01950db700 1 -- 172.21.15.154:0/2151132558 shutdown_connections 2023-09-30T22:29:14.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.701+0000 7f01950db700 1 --2- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0190135f20 0x7f01901c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.701+0000 7f01950db700 1 --2- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f019009d860 0x7f01901c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.701+0000 7f01950db700 1 --2- 172.21.15.154:0/2151132558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f019009e340 0x7f01901c8990 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.701+0000 7f01950db700 1 -- 172.21.15.154:0/2151132558 >> 172.21.15.154:0/2151132558 conn(0x7f0190099c40 msgr2=0x7f01901328c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.701+0000 7f01950db700 1 -- 172.21.15.154:0/2151132558 shutdown_connections 2023-09-30T22:29:14.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.701+0000 7f01950db700 1 -- 172.21.15.154:0/2151132558 wait complete. 2023-09-30T22:29:14.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.3 2023-09-30T22:29:14.785 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:14.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f469a2b4700 1 Processor -- start 2023-09-30T22:29:14.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f469a2b4700 1 -- start start 2023-09-30T22:29:14.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f469a2b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409d860 0x7f469409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f469a2b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409e170 0x7f46941307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f469a2b4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469409aaa0 con 0x7f4694130ce0 2023-09-30T22:29:14.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f469a2b4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469409f870 con 0x7f469409d860 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f469a2b4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f469409b360 con 0x7f469409e170 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f4693fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409d860 0x7f469409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f46937fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409e170 0x7f46941307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f4698851700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4694130ce0 0x7f46941379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54650/0 (socket says 172.21.15.154:54650) 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.907+0000 7f4698851700 1 -- 172.21.15.154:0/3153657299 learned_addr learned my addr 172.21.15.154:0/3153657299 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4692ffd700 1 -- 172.21.15.154:0/3153657299 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168063548 0 0) 0x7f469409aaa0 con 0x7f4694130ce0 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4692ffd700 1 -- 172.21.15.154:0/3153657299 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f467c0035b0 con 0x7f4694130ce0 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4693fff700 1 -- 172.21.15.154:0/3153657299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409e170 msgr2=0x7f46941307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4693fff700 1 --2- 172.21.15.154:0/3153657299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409e170 0x7f46941307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4693fff700 1 -- 172.21.15.154:0/3153657299 >> v1:172.21.15.154:6789/0 conn(0x7f4694130ce0 legacy=0x7f46941379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4693fff700 1 -- 172.21.15.154:0/3153657299 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469409b620 con 0x7f469409d860 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f46937fe700 1 --2- 172.21.15.154:0/3153657299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409e170 0x7f46941307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4693fff700 1 --2- 172.21.15.154:0/3153657299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409d860 0x7f469409dc30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4684009870 tx=0x7f4684009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=315090f5fb787efe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4692ffd700 1 -- 172.21.15.154:0/3153657299 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684011830 con 0x7f469409d860 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4692ffd700 1 -- 172.21.15.154:0/3153657299 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4684011990 con 0x7f469409d860 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.908+0000 7f4692ffd700 1 -- 172.21.15.154:0/3153657299 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684011d00 con 0x7f469409d860 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.909+0000 7f469a2b4700 1 -- 172.21.15.154:0/3153657299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409d860 msgr2=0x7f469409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.909+0000 7f469a2b4700 1 --2- 172.21.15.154:0/3153657299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409d860 0x7f469409dc30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4684009870 tx=0x7f4684009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.909+0000 7f469a2b4700 1 -- 172.21.15.154:0/3153657299 shutdown_connections 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.909+0000 7f469a2b4700 1 --2- 172.21.15.154:0/3153657299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409d860 0x7f469409dc30 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.909+0000 7f469a2b4700 1 --2- 172.21.15.154:0/3153657299 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409e170 0x7f46941307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.909+0000 7f469a2b4700 1 -- 172.21.15.154:0/3153657299 >> 172.21.15.154:0/3153657299 conn(0x7f4694099c40 msgr2=0x7f46940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:14.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.909+0000 7f469a2b4700 1 -- 172.21.15.154:0/3153657299 shutdown_connections 2023-09-30T22:29:14.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.909+0000 7f469a2b4700 1 -- 172.21.15.154:0/3153657299 wait complete. 2023-09-30T22:29:14.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:14.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.909+0000 7f469a2b4700 1 Processor -- start 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f469a2b4700 1 -- start start 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f469a2b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409d860 0x7f46941c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f469a2b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409e170 0x7f46941c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f469a2b4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4694130ce0 0x7f46941c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f469a2b4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46941249c0 con 0x7f4694130ce0 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f469a2b4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469409c920 con 0x7f469409e170 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f469a2b4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4694124520 con 0x7f469409d860 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f4693fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409d860 0x7f46941c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f4698851700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4694130ce0 0x7f46941c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f4693fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409d860 0x7f46941c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55718/0 (socket says 172.21.15.154:55718) 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f4693fff700 1 -- 172.21.15.154:0/4278652000 learned_addr learned my addr 172.21.15.154:0/4278652000 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.910+0000 7f46937fe700 1 --2- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409e170 0x7f46941c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4693fff700 1 -- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409e170 msgr2=0x7f46941c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4693fff700 1 --2- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409e170 0x7f46941c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4693fff700 1 -- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4694130ce0 msgr2=0x7f46941c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4693fff700 1 --2- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4694130ce0 0x7f46941c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4693fff700 1 -- 172.21.15.154:0/4278652000 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880094a0 con 0x7f469409d860 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4698851700 1 --2- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4694130ce0 0x7f46941c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4693fff700 1 --2- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409d860 0x7f46941c7ff0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f46840090b0 tx=0x7f4684004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4690ff9700 1 -- 172.21.15.154:0/4278652000 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840044d0 con 0x7f469409d860 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4690ff9700 1 -- 172.21.15.154:0/4278652000 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468401f070 con 0x7f469409d860 2023-09-30T22:29:14.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f469a2b4700 1 -- 172.21.15.154:0/4278652000 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46840094a0 con 0x7f469409d860 2023-09-30T22:29:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f4690ff9700 1 -- 172.21.15.154:0/4278652000 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840038a0 con 0x7f469409d860 2023-09-30T22:29:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.911+0000 7f469a2b4700 1 -- 172.21.15.154:0/4278652000 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4694125fd0 con 0x7f469409d860 2023-09-30T22:29:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.912+0000 7f4690ff9700 1 -- 172.21.15.154:0/4278652000 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4684003a00 con 0x7f469409d860 2023-09-30T22:29:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.912+0000 7f4690ff9700 1 -- 172.21.15.154:0/4278652000 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4684021070 con 0x7f469409d860 2023-09-30T22:29:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.912+0000 7f469a2b4700 1 -- 172.21.15.154:0/4278652000 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46941261c0 con 0x7f469409d860 2023-09-30T22:29:14.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:14.917+0000 7f4690ff9700 1 -- 172.21.15.154:0/4278652000 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f468402f990 con 0x7f469409d860 2023-09-30T22:29:14.931 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.0: 124554051586 < 124554051588 2023-09-30T22:29:14.932 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:29:14.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:29:15.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.043+0000 7facc7ec4700 1 Processor -- start 2023-09-30T22:29:15.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.043+0000 7facc7ec4700 1 -- start start 2023-09-30T22:29:15.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc7ec4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 0x7facc00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc7ec4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc7ec4700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc009dc00 con 0x7facc0133f50 2023-09-30T22:29:15.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc7ec4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc009ea60 con 0x7facc00a0a70 2023-09-30T22:29:15.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc7ec4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facc009dec0 con 0x7facc00a1380 2023-09-30T22:29:15.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc545f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc545f700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:55720/0 (socket says 172.21.15.154:55720) 2023-09-30T22:29:15.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc545f700 1 -- 172.21.15.154:0/3684673992 learned_addr learned my addr 172.21.15.154:0/3684673992 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:15.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc5c60700 1 --2- 172.21.15.154:0/3684673992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 0x7facc00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc4c5e700 1 -- 172.21.15.154:0/3684673992 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518909787 0 0) 0x7facc009dc00 con 0x7facc0133f50 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.044+0000 7facc4c5e700 1 -- 172.21.15.154:0/3684673992 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facac0035b0 con 0x7facc0133f50 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc5c60700 1 -- 172.21.15.154:0/3684673992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 msgr2=0x7facc0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc5c60700 1 --2- 172.21.15.154:0/3684673992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc5c60700 1 -- 172.21.15.154:0/3684673992 >> v1:172.21.15.154:6789/0 conn(0x7facc0133f50 legacy=0x7facc013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc5c60700 1 -- 172.21.15.154:0/3684673992 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc009e6a0 con 0x7facc00a0a70 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc545f700 1 --2- 172.21.15.154:0/3684673992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc5c60700 1 --2- 172.21.15.154:0/3684673992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 0x7facc00a0e40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7facbc009870 tx=0x7facbc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57c24a3fca29971e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc4c5e700 1 -- 172.21.15.154:0/3684673992 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc011830 con 0x7facc00a0a70 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc4c5e700 1 -- 172.21.15.154:0/3684673992 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc011990 con 0x7facc00a0a70 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc4c5e700 1 -- 172.21.15.154:0/3684673992 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc011d20 con 0x7facc00a0a70 2023-09-30T22:29:15.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc7ec4700 1 -- 172.21.15.154:0/3684673992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 msgr2=0x7facc00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.045+0000 7facc7ec4700 1 --2- 172.21.15.154:0/3684673992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 0x7facc00a0e40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7facbc009870 tx=0x7facbc009b80 comp rx=0 tx=0).stop 2023-09-30T22:29:15.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.046+0000 7facc7ec4700 1 -- 172.21.15.154:0/3684673992 shutdown_connections 2023-09-30T22:29:15.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.046+0000 7facc7ec4700 1 --2- 172.21.15.154:0/3684673992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 0x7facc00a0e40 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.046+0000 7facc7ec4700 1 --2- 172.21.15.154:0/3684673992 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.046+0000 7facc7ec4700 1 -- 172.21.15.154:0/3684673992 >> 172.21.15.154:0/3684673992 conn(0x7facc00a6610 msgr2=0x7facc00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.046+0000 7facc7ec4700 1 -- 172.21.15.154:0/3684673992 shutdown_connections 2023-09-30T22:29:15.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.046+0000 7facc7ec4700 1 -- 172.21.15.154:0/3684673992 wait complete. 2023-09-30T22:29:15.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.047+0000 7facc7ec4700 1 Processor -- start 2023-09-30T22:29:15.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.047+0000 7facc7ec4700 1 -- start start 2023-09-30T22:29:15.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc7ec4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 0x7facc01c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc7ec4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc01c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc7ec4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc0133f50 0x7facc01c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc7ec4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc0124640 con 0x7facc0133f50 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc7ec4700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc0126350 con 0x7facc00a0a70 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc7ec4700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facc0124830 con 0x7facc00a1380 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc6461700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc0133f50 0x7facc01c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc6461700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc0133f50 0x7facc01c8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34734/0 (socket says 172.21.15.154:34734) 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc6461700 1 -- 172.21.15.154:0/1378691638 learned_addr learned my addr 172.21.15.154:0/1378691638 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc5c60700 1 --2- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 0x7facc01c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc545f700 1 --2- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc01c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc6461700 1 -- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 msgr2=0x7facc01c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc6461700 1 --2- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc01c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc6461700 1 -- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 msgr2=0x7facc01c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc6461700 1 --2- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 0x7facc01c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc6461700 1 -- 172.21.15.154:0/1378691638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0009550 con 0x7facc0133f50 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc6461700 1 --2- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc0133f50 0x7facc01c8ce0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7facb800cc50 tx=0x7facb800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facb67fc700 1 -- 172.21.15.154:0/1378691638 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8003c00 con 0x7facc0133f50 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facb67fc700 1 -- 172.21.15.154:0/1378691638 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8003d60 con 0x7facc0133f50 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facb67fc700 1 -- 172.21.15.154:0/1378691638 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb800aad0 con 0x7facc0133f50 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.048+0000 7facc7ec4700 1 -- 172.21.15.154:0/1378691638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc0094a0 con 0x7facc0133f50 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.049+0000 7facc7ec4700 1 -- 172.21.15.154:0/1378691638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc0124bf0 con 0x7facc0133f50 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.050+0000 7facc7ec4700 1 -- 172.21.15.154:0/1378691638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc004f2a0 con 0x7facc0133f50 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.050+0000 7facb67fc700 1 -- 172.21.15.154:0/1378691638 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facb800ac30 con 0x7facc0133f50 2023-09-30T22:29:15.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.050+0000 7facb67fc700 1 -- 172.21.15.154:0/1378691638 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7facb803f700 con 0x7facc0133f50 2023-09-30T22:29:15.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.055+0000 7facb67fc700 1 -- 172.21.15.154:0/1378691638 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facb80108d0 con 0x7facc0133f50 2023-09-30T22:29:15.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb56358700 1 Processor -- start 2023-09-30T22:29:15.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb56358700 1 -- start start 2023-09-30T22:29:15.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb56358700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 0x7fdb50133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb56358700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 0x7fdb5013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb56358700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5006b2d0 con 0x7fdb501300a0 2023-09-30T22:29:15.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb56358700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50133610 con 0x7fdb50130bc0 2023-09-30T22:29:15.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb56358700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5009a500 con 0x7fdb50133ad0 2023-09-30T22:29:15.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb4ffff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 0x7fdb50133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb548f5700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 0x7fdb5013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.084+0000 7fdb4f7fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdb501300a0 0x7fdb501304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54662/0 (socket says 172.21.15.154:54662) 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb4f7fe700 1 -- 172.21.15.154:0/3109988708 learned_addr learned my addr 172.21.15.154:0/3109988708 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb548f5700 1 -- 172.21.15.154:0/3109988708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 msgr2=0x7fdb50133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb4effd700 1 -- 172.21.15.154:0/3109988708 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682380287 0 0) 0x7fdb5006b2d0 con 0x7fdb501300a0 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb548f5700 1 --2- 172.21.15.154:0/3109988708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 0x7fdb50133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb548f5700 1 -- 172.21.15.154:0/3109988708 >> v1:172.21.15.154:6789/0 conn(0x7fdb501300a0 legacy=0x7fdb501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb548f5700 1 -- 172.21.15.154:0/3109988708 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb501338b0 con 0x7fdb50130bc0 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb548f5700 1 --2- 172.21.15.154:0/3109988708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 0x7fdb5013b990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009dc0 tx=0x7fdb4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87ec6e59c6d20956 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb4effd700 1 -- 172.21.15.154:0/3109988708 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800e070 con 0x7fdb50130bc0 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb4effd700 1 -- 172.21.15.154:0/3109988708 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800bbd0 con 0x7fdb50130bc0 2023-09-30T22:29:15.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.085+0000 7fdb4effd700 1 -- 172.21.15.154:0/3109988708 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48012430 con 0x7fdb50130bc0 2023-09-30T22:29:15.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.086+0000 7fdb56358700 1 -- 172.21.15.154:0/3109988708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 msgr2=0x7fdb5013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.086+0000 7fdb56358700 1 --2- 172.21.15.154:0/3109988708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 0x7fdb5013b990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009dc0 tx=0x7fdb4800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:15.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.086+0000 7fdb56358700 1 -- 172.21.15.154:0/3109988708 shutdown_connections 2023-09-30T22:29:15.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.086+0000 7fdb56358700 1 --2- 172.21.15.154:0/3109988708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 0x7fdb5013b990 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.086+0000 7fdb56358700 1 --2- 172.21.15.154:0/3109988708 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 0x7fdb50133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.086+0000 7fdb56358700 1 -- 172.21.15.154:0/3109988708 >> 172.21.15.154:0/3109988708 conn(0x7fdb50099c40 msgr2=0x7fdb500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.086+0000 7fdb56358700 1 -- 172.21.15.154:0/3109988708 shutdown_connections 2023-09-30T22:29:15.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.086+0000 7fdb56358700 1 -- 172.21.15.154:0/3109988708 wait complete. 2023-09-30T22:29:15.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.087+0000 7fdb56358700 1 Processor -- start 2023-09-30T22:29:15.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.087+0000 7fdb56358700 1 -- start start 2023-09-30T22:29:15.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.087+0000 7fdb56358700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb501300a0 0x7fdb5011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.087+0000 7fdb56358700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 0x7fdb5011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.087+0000 7fdb56358700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 0x7fdb5011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:15.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.087+0000 7fdb56358700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50071fe0 con 0x7fdb501300a0 2023-09-30T22:29:15.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.087+0000 7fdb56358700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5011eef0 con 0x7fdb50130bc0 2023-09-30T22:29:15.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.087+0000 7fdb56358700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5011f9d0 con 0x7fdb50133ad0 2023-09-30T22:29:15.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 0x7fdb5011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb548f5700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 0x7fdb5011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4f7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 0x7fdb5011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:51704/0 (socket says 172.21.15.154:51704) 2023-09-30T22:29:15.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4f7fe700 1 -- 172.21.15.154:0/3000411074 learned_addr learned my addr 172.21.15.154:0/3000411074 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:15.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4ffff700 1 --2- 172.21.15.154:0/3000411074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb501300a0 0x7fdb5011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:15.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4f7fe700 1 -- 172.21.15.154:0/3000411074 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 msgr2=0x7fdb5011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4f7fe700 1 --2- 172.21.15.154:0/3000411074 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 0x7fdb5011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4f7fe700 1 -- 172.21.15.154:0/3000411074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb501300a0 msgr2=0x7fdb5011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4f7fe700 1 --2- 172.21.15.154:0/3000411074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb501300a0 0x7fdb5011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4f7fe700 1 -- 172.21.15.154:0/3000411074 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48009a70 con 0x7fdb50130bc0 2023-09-30T22:29:15.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4ffff700 1 --2- 172.21.15.154:0/3000411074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb501300a0 0x7fdb5011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:15.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb548f5700 1 --2- 172.21.15.154:0/3000411074 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fdb50133ad0 0x7fdb5011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4f7fe700 1 --2- 172.21.15.154:0/3000411074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb50130bc0 0x7fdb5011df80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c580 tx=0x7fdb4400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4cff9700 1 -- 172.21.15.154:0/3000411074 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44004c80 con 0x7fdb50130bc0 2023-09-30T22:29:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4cff9700 1 -- 172.21.15.154:0/3000411074 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb44004de0 con 0x7fdb50130bc0 2023-09-30T22:29:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb56358700 1 -- 172.21.15.154:0/3000411074 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb501208e0 con 0x7fdb50130bc0 2023-09-30T22:29:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb4cff9700 1 -- 172.21.15.154:0/3000411074 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440072d0 con 0x7fdb50130bc0 2023-09-30T22:29:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.088+0000 7fdb56358700 1 -- 172.21.15.154:0/3000411074 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb500a3450 con 0x7fdb50130bc0 2023-09-30T22:29:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.089+0000 7fdb4cff9700 1 -- 172.21.15.154:0/3000411074 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb44007430 con 0x7fdb50130bc0 2023-09-30T22:29:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.089+0000 7fdb4cff9700 1 -- 172.21.15.154:0/3000411074 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb4403f250 con 0x7fdb50130bc0 2023-09-30T22:29:15.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.090+0000 7fdb56358700 1 -- 172.21.15.154:0/3000411074 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5009cb20 con 0x7fdb50130bc0 2023-09-30T22:29:15.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.094+0000 7fdb4cff9700 1 -- 172.21.15.154:0/3000411074 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb440076e0 con 0x7fdb50130bc0 2023-09-30T22:29:15.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.115+0000 7f469a2b4700 1 -- 172.21.15.154:0/4278652000 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f469404f2a0 con 0x7f469409d860 2023-09-30T22:29:15.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.116+0000 7f4690ff9700 1 -- 172.21.15.154:0/4278652000 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f468402b020 con 0x7f469409d860 2023-09-30T22:29:15.117 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:15.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.119+0000 7f469a2b4700 1 -- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409d860 msgr2=0x7f46941c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.119+0000 7f469a2b4700 1 --2- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409d860 0x7f46941c7ff0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f46840090b0 tx=0x7f4684004750 comp rx=0 tx=0).stop 2023-09-30T22:29:15.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.119+0000 7f469a2b4700 1 -- 172.21.15.154:0/4278652000 shutdown_connections 2023-09-30T22:29:15.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.119+0000 7f469a2b4700 1 --2- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4694130ce0 0x7f46941c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.119+0000 7f469a2b4700 1 --2- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f469409d860 0x7f46941c7ff0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.119+0000 7f469a2b4700 1 --2- 172.21.15.154:0/4278652000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f469409e170 0x7f46941c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.119+0000 7f469a2b4700 1 -- 172.21.15.154:0/4278652000 >> 172.21.15.154:0/4278652000 conn(0x7f4694099c40 msgr2=0x7f46940a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.119+0000 7f469a2b4700 1 -- 172.21.15.154:0/4278652000 shutdown_connections 2023-09-30T22:29:15.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.119+0000 7f469a2b4700 1 -- 172.21.15.154:0/4278652000 wait complete. 2023-09-30T22:29:15.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:15.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.247+0000 7facc7ec4700 1 -- 172.21.15.154:0/1378691638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7facc009c780 con 0x7facc0133f50 2023-09-30T22:29:15.249 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.248+0000 7facb67fc700 1 -- 172.21.15.154:0/1378691638 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facb80102e0 con 0x7facc0133f50 2023-09-30T22:29:15.249 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.250+0000 7facc7ec4700 1 -- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc0133f50 msgr2=0x7facc01c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.250+0000 7facc7ec4700 1 --2- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc0133f50 0x7facc01c8ce0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7facb800cc50 tx=0x7facb800cf60 comp rx=0 tx=0).stop 2023-09-30T22:29:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.250+0000 7facc7ec4700 1 -- 172.21.15.154:0/1378691638 shutdown_connections 2023-09-30T22:29:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.250+0000 7facc7ec4700 1 --2- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc0133f50 0x7facc01c8ce0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.250+0000 7facc7ec4700 1 --2- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facc00a0a70 0x7facc01c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.250+0000 7facc7ec4700 1 --2- 172.21.15.154:0/1378691638 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7facc00a1380 0x7facc01c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.250+0000 7facc7ec4700 1 -- 172.21.15.154:0/1378691638 >> 172.21.15.154:0/1378691638 conn(0x7facc00a6610 msgr2=0x7facc00a4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.250+0000 7facc7ec4700 1 -- 172.21.15.154:0/1378691638 shutdown_connections 2023-09-30T22:29:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:15.250+0000 7facc7ec4700 1 -- 172.21.15.154:0/1378691638 wait complete. 2023-09-30T22:29:15.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:29:16.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T22:29:16.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T22:29:16.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.273+0000 7fb550223700 1 Processor -- start 2023-09-30T22:29:16.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.273+0000 7fb550223700 1 -- start start 2023-09-30T22:29:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.273+0000 7fb550223700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809a150 0x7fb54809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.273+0000 7fb550223700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809edb0 0x7fb54809f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.273+0000 7fb550223700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb548133c20 0x7fb5481340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.273+0000 7fb550223700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54809a520 con 0x7fb548133c20 2023-09-30T22:29:16.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.273+0000 7fb550223700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54809fe00 con 0x7fb54809edb0 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.273+0000 7fb550223700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb54806bec0 con 0x7fb54809a150 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54d7be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809edb0 0x7fb54809f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54e7c0700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb548133c20 0x7fb5481340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54dfbf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809a150 0x7fb54809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54d7be700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809edb0 0x7fb54809f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:55856/0 (socket says 172.21.15.154:55856) 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54d7be700 1 -- 172.21.15.154:0/3823832457 learned_addr learned my addr 172.21.15.154:0/3823832457 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54e7c0700 1 --2- 172.21.15.154:0/3823832457 >> v2:172.21.15.154:3300/0 conn(0x7fb548133c20 0x7fb5481340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54972/0 (socket says 172.21.15.154:54972) 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54d7be700 1 -- 172.21.15.154:0/3823832457 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809a150 msgr2=0x7fb54809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54d7be700 1 --2- 172.21.15.154:0/3823832457 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809a150 0x7fb54809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54d7be700 1 -- 172.21.15.154:0/3823832457 >> v2:172.21.15.154:3300/0 conn(0x7fb548133c20 msgr2=0x7fb5481340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54d7be700 1 --2- 172.21.15.154:0/3823832457 >> v2:172.21.15.154:3300/0 conn(0x7fb548133c20 0x7fb5481340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54d7be700 1 -- 172.21.15.154:0/3823832457 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54809af80 con 0x7fb54809edb0 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54e7c0700 1 --2- 172.21.15.154:0/3823832457 >> v2:172.21.15.154:3300/0 conn(0x7fb548133c20 0x7fb5481340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54d7be700 1 --2- 172.21.15.154:0/3823832457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809edb0 0x7fb54809f1a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb5380098f0 tx=0x7fb538009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec3babc8522b05e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54cfbd700 1 -- 172.21.15.154:0/3823832457 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538011830 con 0x7fb54809edb0 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54cfbd700 1 -- 172.21.15.154:0/3823832457 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb538011990 con 0x7fb54809edb0 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.274+0000 7fb54cfbd700 1 -- 172.21.15.154:0/3823832457 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538011d20 con 0x7fb54809edb0 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.275+0000 7fb550223700 1 -- 172.21.15.154:0/3823832457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809edb0 msgr2=0x7fb54809f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.275+0000 7fb550223700 1 --2- 172.21.15.154:0/3823832457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809edb0 0x7fb54809f1a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb5380098f0 tx=0x7fb538009c00 comp rx=0 tx=0).stop 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.275+0000 7fb550223700 1 -- 172.21.15.154:0/3823832457 shutdown_connections 2023-09-30T22:29:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.275+0000 7fb550223700 1 --2- 172.21.15.154:0/3823832457 >> v2:172.21.15.154:3300/0 conn(0x7fb548133c20 0x7fb5481340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.275+0000 7fb550223700 1 --2- 172.21.15.154:0/3823832457 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809a150 0x7fb54809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.275+0000 7fb550223700 1 --2- 172.21.15.154:0/3823832457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809edb0 0x7fb54809f1a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.275+0000 7fb550223700 1 -- 172.21.15.154:0/3823832457 >> 172.21.15.154:0/3823832457 conn(0x7fb5480a4430 msgr2=0x7fb5480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.275+0000 7fb550223700 1 -- 172.21.15.154:0/3823832457 shutdown_connections 2023-09-30T22:29:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.275+0000 7fb550223700 1 -- 172.21.15.154:0/3823832457 wait complete. 2023-09-30T22:29:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.276+0000 7fb550223700 1 Processor -- start 2023-09-30T22:29:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.276+0000 7fb550223700 1 -- start start 2023-09-30T22:29:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.276+0000 7fb550223700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809a150 0x7fb5481c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.276+0000 7fb550223700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809edb0 0x7fb5481c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.276+0000 7fb550223700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb548133c20 0x7fb5481c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.276+0000 7fb550223700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54811f260 con 0x7fb548133c20 2023-09-30T22:29:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.276+0000 7fb550223700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb548122500 con 0x7fb54809a150 2023-09-30T22:29:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.276+0000 7fb550223700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5481207f0 con 0x7fb54809edb0 2023-09-30T22:29:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54d7be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809edb0 0x7fb5481c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54dfbf700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809a150 0x7fb5481c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54d7be700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809edb0 0x7fb5481c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:47016/0 (socket says 172.21.15.154:47016) 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54d7be700 1 -- 172.21.15.154:0/2914630748 learned_addr learned my addr 172.21.15.154:0/2914630748 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54e7c0700 1 --2- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb548133c20 0x7fb5481c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54dfbf700 1 -- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809edb0 msgr2=0x7fb5481c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54dfbf700 1 --2- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809edb0 0x7fb5481c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54dfbf700 1 -- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb548133c20 msgr2=0x7fb5481c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54dfbf700 1 --2- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb548133c20 0x7fb5481c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54dfbf700 1 -- 172.21.15.154:0/2914630748 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540009a70 con 0x7fb54809a150 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb54dfbf700 1 --2- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809a150 0x7fb5481c84a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb54400e870 tx=0x7fb54400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb53e7fc700 1 -- 172.21.15.154:0/2914630748 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544013680 con 0x7fb54809a150 2023-09-30T22:29:16.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb53e7fc700 1 -- 172.21.15.154:0/2914630748 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5440137e0 con 0x7fb54809a150 2023-09-30T22:29:16.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb550223700 1 -- 172.21.15.154:0/2914630748 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb538009550 con 0x7fb54809a150 2023-09-30T22:29:16.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb53e7fc700 1 -- 172.21.15.154:0/2914630748 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544013b70 con 0x7fb54809a150 2023-09-30T22:29:16.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.277+0000 7fb550223700 1 -- 172.21.15.154:0/2914630748 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb548122e90 con 0x7fb54809a150 2023-09-30T22:29:16.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.278+0000 7fb53e7fc700 1 -- 172.21.15.154:0/2914630748 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb544013cd0 con 0x7fb54809a150 2023-09-30T22:29:16.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.278+0000 7fb53e7fc700 1 -- 172.21.15.154:0/2914630748 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb54403f570 con 0x7fb54809a150 2023-09-30T22:29:16.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.279+0000 7fb550223700 1 -- 172.21.15.154:0/2914630748 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54809fa30 con 0x7fb54809a150 2023-09-30T22:29:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.284+0000 7fb53e7fc700 1 -- 172.21.15.154:0/2914630748 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb544017080 con 0x7fb54809a150 2023-09-30T22:29:16.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.388+0000 7fce14d5b700 1 Processor -- start 2023-09-30T22:29:16.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.388+0000 7fce14d5b700 1 -- start start 2023-09-30T22:29:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.388+0000 7fce14d5b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce1009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.388+0000 7fce14d5b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce1009f180 0x7fce10131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.388+0000 7fce14d5b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.388+0000 7fce14d5b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce100a0920 con 0x7fce1009f180 2023-09-30T22:29:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce14d5b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1009c970 con 0x7fce1009e870 2023-09-30T22:29:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce14d5b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce1009bab0 con 0x7fce10131d70 2023-09-30T22:29:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce1009f180 0x7fce10131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0e59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce1009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0dd9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce1009f180 0x7fce10131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54998/0 (socket says 172.21.15.154:54998) 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0dd9b700 1 -- 172.21.15.154:0/861450363 learned_addr learned my addr 172.21.15.154:0/861450363 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0ed9d700 1 -- 172.21.15.154:0/861450363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 msgr2=0x7fce1009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0ed9d700 1 --2- 172.21.15.154:0/861450363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce1009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0ed9d700 1 -- 172.21.15.154:0/861450363 >> v2:172.21.15.154:3300/0 conn(0x7fce1009f180 msgr2=0x7fce10131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0ed9d700 1 --2- 172.21.15.154:0/861450363 >> v2:172.21.15.154:3300/0 conn(0x7fce1009f180 0x7fce10131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0ed9d700 1 -- 172.21.15.154:0/861450363 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1009f9c0 con 0x7fce10131d70 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0e59c700 1 --2- 172.21.15.154:0/861450363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce1009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0dd9b700 1 --2- 172.21.15.154:0/861450363 >> v2:172.21.15.154:3300/0 conn(0x7fce1009f180 0x7fce10131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0ed9d700 1 --2- 172.21.15.154:0/861450363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10132210 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fce08009d90 tx=0x7fce0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5a6ab40cbd4154 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0d59a700 1 -- 172.21.15.154:0/861450363 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800e070 con 0x7fce10131d70 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0d59a700 1 -- 172.21.15.154:0/861450363 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0800bb20 con 0x7fce10131d70 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.389+0000 7fce0d59a700 1 -- 172.21.15.154:0/861450363 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08012430 con 0x7fce10131d70 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.390+0000 7fce14d5b700 1 -- 172.21.15.154:0/861450363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 msgr2=0x7fce10132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.390+0000 7fce14d5b700 1 --2- 172.21.15.154:0/861450363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10132210 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fce08009d90 tx=0x7fce0800b330 comp rx=0 tx=0).stop 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.390+0000 7fce14d5b700 1 -- 172.21.15.154:0/861450363 shutdown_connections 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.390+0000 7fce14d5b700 1 --2- 172.21.15.154:0/861450363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce1009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.390+0000 7fce14d5b700 1 --2- 172.21.15.154:0/861450363 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10132210 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.390+0000 7fce14d5b700 1 --2- 172.21.15.154:0/861450363 >> v2:172.21.15.154:3300/0 conn(0x7fce1009f180 0x7fce10131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.390+0000 7fce14d5b700 1 -- 172.21.15.154:0/861450363 >> 172.21.15.154:0/861450363 conn(0x7fce100a4430 msgr2=0x7fce100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.390+0000 7fce14d5b700 1 -- 172.21.15.154:0/861450363 shutdown_connections 2023-09-30T22:29:16.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.390+0000 7fce14d5b700 1 -- 172.21.15.154:0/861450363 wait complete. 2023-09-30T22:29:16.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.391+0000 7fce14d5b700 1 Processor -- start 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.391+0000 7fce14d5b700 1 -- start start 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.391+0000 7fce14d5b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce10120300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.391+0000 7fce14d5b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1009f180 0x7fce10120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce14d5b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce14d5b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce10123a70 con 0x7fce1009f180 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce14d5b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce10122cf0 con 0x7fce1009e870 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce14d5b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce10123840 con 0x7fce10131d70 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1009f180 0x7fce10120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0ed9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0dd9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1009f180 0x7fce10120840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55014/0 (socket says 172.21.15.154:55014) 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0dd9b700 1 -- 172.21.15.154:0/1097726683 learned_addr learned my addr 172.21.15.154:0/1097726683 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0e59c700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce10120300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0ed9d700 1 -- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 msgr2=0x7fce10120300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0ed9d700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce10120300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0ed9d700 1 -- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1009f180 msgr2=0x7fce10120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0ed9d700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1009f180 0x7fce10120840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0ed9d700 1 -- 172.21.15.154:0/1097726683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce040094a0 con 0x7fce10131d70 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0e59c700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce10120300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0dd9b700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1009f180 0x7fce10120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce0ed9d700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10120d80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fce08016000 tx=0x7fce08004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:29:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fcdfeffd700 1 -- 172.21.15.154:0/1097726683 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08004840 con 0x7fce10131d70 2023-09-30T22:29:16.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fcdfeffd700 1 -- 172.21.15.154:0/1097726683 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce08020070 con 0x7fce10131d70 2023-09-30T22:29:16.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fcdfeffd700 1 -- 172.21.15.154:0/1097726683 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce080276c0 con 0x7fce10131d70 2023-09-30T22:29:16.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce14d5b700 1 -- 172.21.15.154:0/1097726683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce00009550 con 0x7fce10131d70 2023-09-30T22:29:16.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.392+0000 7fce14d5b700 1 -- 172.21.15.154:0/1097726683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce08009a70 con 0x7fce10131d70 2023-09-30T22:29:16.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.393+0000 7fcdfeffd700 1 -- 172.21.15.154:0/1097726683 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce08012430 con 0x7fce10131d70 2023-09-30T22:29:16.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.393+0000 7fcdfeffd700 1 -- 172.21.15.154:0/1097726683 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce08022070 con 0x7fce10131d70 2023-09-30T22:29:16.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.393+0000 7fce14d5b700 1 -- 172.21.15.154:0/1097726683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce100a0210 con 0x7fce10131d70 2023-09-30T22:29:16.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.398+0000 7fcdfeffd700 1 -- 172.21.15.154:0/1097726683 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce0801a790 con 0x7fce10131d70 2023-09-30T22:29:16.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.484+0000 7fb550223700 1 -- 172.21.15.154:0/2914630748 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb548122360 con 0x7fb54809a150 2023-09-30T22:29:16.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.484+0000 7fb53e7fc700 1 -- 172.21.15.154:0/2914630748 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb548122360 con 0x7fb54809a150 2023-09-30T22:29:16.486 INFO:teuthology.orchestra.run.smithi154.stdout:128849018882 2023-09-30T22:29:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.487+0000 7fb550223700 1 -- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809a150 msgr2=0x7fb5481c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.487+0000 7fb550223700 1 --2- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809a150 0x7fb5481c84a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb54400e870 tx=0x7fb54400eb80 comp rx=0 tx=0).stop 2023-09-30T22:29:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.487+0000 7fb550223700 1 -- 172.21.15.154:0/2914630748 shutdown_connections 2023-09-30T22:29:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.487+0000 7fb550223700 1 --2- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb548133c20 0x7fb5481c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.487+0000 7fb550223700 1 --2- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb54809a150 0x7fb5481c84a0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.487+0000 7fb550223700 1 --2- 172.21.15.154:0/2914630748 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb54809edb0 0x7fb5481c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.487+0000 7fb550223700 1 -- 172.21.15.154:0/2914630748 >> 172.21.15.154:0/2914630748 conn(0x7fb5480a4430 msgr2=0x7fb5481b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.487+0000 7fb550223700 1 -- 172.21.15.154:0/2914630748 shutdown_connections 2023-09-30T22:29:16.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.487+0000 7fb550223700 1 -- 172.21.15.154:0/2914630748 wait complete. 2023-09-30T22:29:16.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-09-30T22:29:16.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.590+0000 7fce14d5b700 1 -- 172.21.15.154:0/1097726683 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fce1004f2a0 con 0x7fce10131d70 2023-09-30T22:29:16.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.590+0000 7fcdfeffd700 1 -- 172.21.15.154:0/1097726683 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce0802c030 con 0x7fce10131d70 2023-09-30T22:29:16.592 INFO:teuthology.orchestra.run.smithi154.stdout:137438953474 2023-09-30T22:29:16.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.592+0000 7fce14d5b700 1 -- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 msgr2=0x7fce10120d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:29:16.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.592+0000 7fce14d5b700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10120d80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fce08016000 tx=0x7fce08004ad0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.592+0000 7fce14d5b700 1 -- 172.21.15.154:0/1097726683 shutdown_connections 2023-09-30T22:29:16.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.592+0000 7fce14d5b700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fce10131d70 0x7fce10120d80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.592+0000 7fce14d5b700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1009e870 0x7fce10120300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.592+0000 7fce14d5b700 1 --2- 172.21.15.154:0/1097726683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1009f180 0x7fce10120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:29:16.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.592+0000 7fce14d5b700 1 -- 172.21.15.154:0/1097726683 >> 172.21.15.154:0/1097726683 conn(0x7fce100a4430 msgr2=0x7fce1006f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:29:16.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.592+0000 7fce14d5b700 1 -- 172.21.15.154:0/1097726683 shutdown_connections 2023-09-30T22:29:16.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:29:16.592+0000 7fce14d5b700 1 -- 172.21.15.154:0/1097726683 wait complete. 2023-09-30T22:29:16.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 137438953474 for osd.2 2023-09-30T22:31:14.993 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-30T22:31:14.994 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:31:15.069 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b00fbd07fac64ad0b11b69510a3610e9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:31:15.076 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:31:15.088 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-09-30T22:31:15.106 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:31:15.116 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-09-30T22:31:15.128 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-09-30T22:31:15.141 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-09-30T22:31:15.152 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-09-30T22:31:15.153 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:31:15.153 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:31:15.189 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:31:15.190 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:31:15.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:31:15.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.384+0000 7f47e7c12700 1 Processor -- start 2023-09-30T22:31:15.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.384+0000 7f47e7c12700 1 -- start start 2023-09-30T22:31:15.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e7c12700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 0x7f47e0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e7c12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01300a0 0x7f47e01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e7c12700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47e01309f0 0x7f47e013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e7c12700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e006b2d0 con 0x7f47e01309f0 2023-09-30T22:31:15.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e7c12700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0133610 con 0x7f47e0133ad0 2023-09-30T22:31:15.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e7c12700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e009a500 con 0x7f47e01300a0 2023-09-30T22:31:15.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e51ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01300a0 0x7f47e01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e61af700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47e01309f0 0x7f47e013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e51ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01300a0 0x7f47e01304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59830/0 (socket says 172.21.15.154:59830) 2023-09-30T22:31:15.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e51ad700 1 -- 172.21.15.154:0/1729818420 learned_addr learned my addr 172.21.15.154:0/1729818420 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:15.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e59ae700 1 --2- 172.21.15.154:0/1729818420 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 0x7f47e0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e51ad700 1 -- 172.21.15.154:0/1729818420 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 msgr2=0x7f47e0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e51ad700 1 --2- 172.21.15.154:0/1729818420 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 0x7f47e0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e51ad700 1 -- 172.21.15.154:0/1729818420 >> v2:172.21.15.154:3300/0 conn(0x7f47e01309f0 msgr2=0x7f47e013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e51ad700 1 --2- 172.21.15.154:0/1729818420 >> v2:172.21.15.154:3300/0 conn(0x7f47e01309f0 0x7f47e013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e51ad700 1 -- 172.21.15.154:0/1729818420 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e01338b0 con 0x7f47e01300a0 2023-09-30T22:31:15.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e59ae700 1 --2- 172.21.15.154:0/1729818420 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 0x7f47e0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e61af700 1 --2- 172.21.15.154:0/1729818420 >> v2:172.21.15.154:3300/0 conn(0x7f47e01309f0 0x7f47e013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.385+0000 7f47e51ad700 1 --2- 172.21.15.154:0/1729818420 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01300a0 0x7f47e01304b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0098f0 tx=0x7f47dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=992847bc625c9aa2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e49ac700 1 -- 172.21.15.154:0/1729818420 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc011830 con 0x7f47e01300a0 2023-09-30T22:31:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e49ac700 1 -- 172.21.15.154:0/1729818420 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc011990 con 0x7f47e01300a0 2023-09-30T22:31:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e49ac700 1 -- 172.21.15.154:0/1729818420 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc011d20 con 0x7f47e01300a0 2023-09-30T22:31:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e7c12700 1 -- 172.21.15.154:0/1729818420 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01300a0 msgr2=0x7f47e01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e7c12700 1 --2- 172.21.15.154:0/1729818420 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01300a0 0x7f47e01304b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0098f0 tx=0x7f47dc009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e7c12700 1 -- 172.21.15.154:0/1729818420 shutdown_connections 2023-09-30T22:31:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e7c12700 1 --2- 172.21.15.154:0/1729818420 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 0x7f47e0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e7c12700 1 --2- 172.21.15.154:0/1729818420 >> v2:172.21.15.154:3300/0 conn(0x7f47e01309f0 0x7f47e013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e7c12700 1 --2- 172.21.15.154:0/1729818420 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01300a0 0x7f47e01304b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e7c12700 1 -- 172.21.15.154:0/1729818420 >> 172.21.15.154:0/1729818420 conn(0x7f47e0099c40 msgr2=0x7f47e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e7c12700 1 -- 172.21.15.154:0/1729818420 shutdown_connections 2023-09-30T22:31:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.386+0000 7f47e7c12700 1 -- 172.21.15.154:0/1729818420 wait complete. 2023-09-30T22:31:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.387+0000 7f47e7c12700 1 Processor -- start 2023-09-30T22:31:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.387+0000 7f47e7c12700 1 -- start start 2023-09-30T22:31:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e7c12700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e01300a0 0x7f47e011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e7c12700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01309f0 0x7f47e011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e7c12700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 0x7f47e011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e7c12700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e012d290 con 0x7f47e01300a0 2023-09-30T22:31:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e7c12700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e0072880 con 0x7f47e0133ad0 2023-09-30T22:31:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e7c12700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e012dd00 con 0x7f47e01309f0 2023-09-30T22:31:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e59ae700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e01300a0 0x7f47e011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e51ad700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01309f0 0x7f47e011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e61af700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 0x7f47e011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e59ae700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e01300a0 0x7f47e011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52310/0 (socket says 172.21.15.154:52310) 2023-09-30T22:31:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e59ae700 1 -- 172.21.15.154:0/3828008595 learned_addr learned my addr 172.21.15.154:0/3828008595 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e51ad700 1 -- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 msgr2=0x7f47e011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e51ad700 1 --2- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 0x7f47e011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e51ad700 1 -- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e01300a0 msgr2=0x7f47e011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e51ad700 1 --2- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e01300a0 0x7f47e011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e51ad700 1 -- 172.21.15.154:0/3828008595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8009a70 con 0x7f47e01309f0 2023-09-30T22:31:15.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e51ad700 1 --2- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01309f0 0x7f47e011df80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f47e01311d0 tx=0x7f47dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47d67fc700 1 -- 172.21.15.154:0/3828008595 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc004450 con 0x7f47e01309f0 2023-09-30T22:31:15.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47d67fc700 1 -- 172.21.15.154:0/3828008595 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc01e070 con 0x7f47e01309f0 2023-09-30T22:31:15.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e7c12700 1 -- 172.21.15.154:0/3828008595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d00094a0 con 0x7f47e01309f0 2023-09-30T22:31:15.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47d67fc700 1 -- 172.21.15.154:0/3828008595 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc0038a0 con 0x7f47e01309f0 2023-09-30T22:31:15.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.388+0000 7f47e7c12700 1 -- 172.21.15.154:0/3828008595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc009550 con 0x7f47e01309f0 2023-09-30T22:31:15.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.389+0000 7f47d67fc700 1 -- 172.21.15.154:0/3828008595 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47dc003a00 con 0x7f47e01309f0 2023-09-30T22:31:15.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.389+0000 7f47d67fc700 1 -- 172.21.15.154:0/3828008595 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f47dc020070 con 0x7f47e01309f0 2023-09-30T22:31:15.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.389+0000 7f47e7c12700 1 -- 172.21.15.154:0/3828008595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e012fd30 con 0x7f47e01309f0 2023-09-30T22:31:15.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.394+0000 7f47d67fc700 1 -- 172.21.15.154:0/3828008595 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47dc015020 con 0x7f47e01309f0 2023-09-30T22:31:15.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.579+0000 7f47e7c12700 1 -- 172.21.15.154:0/3828008595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47e004f2a0 con 0x7f47e01309f0 2023-09-30T22:31:15.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.580+0000 7f47d67fc700 1 -- 172.21.15.154:0/3828008595 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13438 (secure 0 0 0) 0x7f47dc003cb0 con 0x7f47e01309f0 2023-09-30T22:31:15.581 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:31:15.581 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":40,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:22:46.872149+0000","last_up_change":"2023-09-30T22:22:11.411450+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":130130}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":130130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":130130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":130130}]},"public_addr":"172.21.15.154:6800/130130","cluster_addr":"172.21.15.154:6801/130130","heartbeat_back_addr":"172.21.15.154:6803/130130","heartbeat_front_addr":"172.21.15.154:6802/130130","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":130229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":130229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":130229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":130229}]},"public_addr":"172.21.15.154:6804/130229","cluster_addr":"172.21.15.154:6805/130229","heartbeat_back_addr":"172.21.15.154:6807/130229","heartbeat_front_addr":"172.21.15.154:6806/130229","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":130339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":130339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":130339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":130339}]},"public_addr":"172.21.15.154:6808/130339","cluster_addr":"172.21.15.154:6809/130339","heartbeat_back_addr":"172.21.15.154:6811/130339","heartbeat_front_addr":"172.21.15.154:6810/130339","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":130679}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":130679}]},"public_addr":"172.21.15.154:6812/130679","cluster_addr":"172.21.15.154:6813/130679","heartbeat_back_addr":"172.21.15.154:6815/130679","heartbeat_front_addr":"172.21.15.154:6814/130679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-09-30T22:22:04.989624+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2961105614":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/2771224894":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/3517579577":"2023-10-01T22:22:46.872089+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2273151012":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/126757":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/722774886":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/3939851609":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6817/2576993373":"2023-10-01T22:22:14.893865+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:31:15.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.582+0000 7f47e7c12700 1 -- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01309f0 msgr2=0x7f47e011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.582+0000 7f47e7c12700 1 --2- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01309f0 0x7f47e011df80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f47e01311d0 tx=0x7f47dc004750 comp rx=0 tx=0).stop 2023-09-30T22:31:15.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.582+0000 7f47e7c12700 1 -- 172.21.15.154:0/3828008595 shutdown_connections 2023-09-30T22:31:15.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.582+0000 7f47e7c12700 1 --2- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47e0133ad0 0x7f47e011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.582+0000 7f47e7c12700 1 --2- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e01300a0 0x7f47e011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.582+0000 7f47e7c12700 1 --2- 172.21.15.154:0/3828008595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f47e01309f0 0x7f47e011df80 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.582+0000 7f47e7c12700 1 -- 172.21.15.154:0/3828008595 >> 172.21.15.154:0/3828008595 conn(0x7f47e0099c40 msgr2=0x7f47e009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.582+0000 7f47e7c12700 1 -- 172.21.15.154:0/3828008595 shutdown_connections 2023-09-30T22:31:15.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.582+0000 7f47e7c12700 1 -- 172.21.15.154:0/3828008595 wait complete. 2023-09-30T22:31:15.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:19:27.265135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:19:28.184247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:19:32.024148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:19:32.601719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:31:15.596 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:31:15.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.721+0000 7fc3d9ce6700 1 Processor -- start 2023-09-30T22:31:15.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.721+0000 7fc3d9ce6700 1 -- start start 2023-09-30T22:31:15.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d9ce6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d409e260 0x7fc3d4135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d9ce6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d4136010 0x7fc3d41383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d9ce6700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d409e690 con 0x7fc3d409d780 2023-09-30T22:31:15.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d9ce6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d409d430 con 0x7fc3d409e260 2023-09-30T22:31:15.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d9ce6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d409e910 con 0x7fc3d4136010 2023-09-30T22:31:15.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d37fe700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc3d409d780 0x7fc3d409db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59856/0 (socket says 172.21.15.154:59856) 2023-09-30T22:31:15.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d4136010 0x7fc3d41383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d37fe700 1 -- 172.21.15.154:0/1646813332 learned_addr learned my addr 172.21.15.154:0/1646813332 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:31:15.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d2ffd700 1 --2- 172.21.15.154:0/1646813332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d409e260 0x7fc3d4135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d27fc700 1 -- 172.21.15.154:0/1646813332 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497305302 0 0) 0x7fc3d409e690 con 0x7fc3d409d780 2023-09-30T22:31:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d3fff700 1 -- 172.21.15.154:0/1646813332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d409e260 msgr2=0x7fc3d4135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d3fff700 1 --2- 172.21.15.154:0/1646813332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d409e260 0x7fc3d4135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d3fff700 1 -- 172.21.15.154:0/1646813332 >> v1:172.21.15.154:6789/0 conn(0x7fc3d409d780 legacy=0x7fc3d409db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d3fff700 1 -- 172.21.15.154:0/1646813332 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d409b380 con 0x7fc3d4136010 2023-09-30T22:31:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d3fff700 1 --2- 172.21.15.154:0/1646813332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d4136010 0x7fc3d41383f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc009dc0 tx=0x7fc3cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d86cfea8598746 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.722+0000 7fc3d27fc700 1 -- 172.21.15.154:0/1646813332 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00e070 con 0x7fc3d4136010 2023-09-30T22:31:15.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d27fc700 1 -- 172.21.15.154:0/1646813332 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00bb20 con 0x7fc3d4136010 2023-09-30T22:31:15.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d27fc700 1 -- 172.21.15.154:0/1646813332 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc012430 con 0x7fc3d4136010 2023-09-30T22:31:15.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/1646813332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d4136010 msgr2=0x7fc3d41383f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d9ce6700 1 --2- 172.21.15.154:0/1646813332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d4136010 0x7fc3d41383f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc009dc0 tx=0x7fc3cc00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:15.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/1646813332 shutdown_connections 2023-09-30T22:31:15.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d9ce6700 1 --2- 172.21.15.154:0/1646813332 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d4136010 0x7fc3d41383f0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d9ce6700 1 --2- 172.21.15.154:0/1646813332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d409e260 0x7fc3d4135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/1646813332 >> 172.21.15.154:0/1646813332 conn(0x7fc3d409f980 msgr2=0x7fc3d409fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/1646813332 shutdown_connections 2023-09-30T22:31:15.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.723+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/1646813332 wait complete. 2023-09-30T22:31:15.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.724+0000 7fc3d9ce6700 1 Processor -- start 2023-09-30T22:31:15.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.724+0000 7fc3d9ce6700 1 -- start start 2023-09-30T22:31:15.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d9ce6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d409d780 0x7fc3d4120370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d9ce6700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d409e260 0x7fc3d41208b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d9ce6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d4136010 0x7fc3d4120df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:15.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d9ce6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4123c00 con 0x7fc3d409d780 2023-09-30T22:31:15.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d9ce6700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d4121ef0 con 0x7fc3d4136010 2023-09-30T22:31:15.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d9ce6700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d409c8d0 con 0x7fc3d409e260 2023-09-30T22:31:15.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d4136010 0x7fc3d4120df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d37fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d409d780 0x7fc3d4120370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d4136010 0x7fc3d4120df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52620/0 (socket says 172.21.15.154:52620) 2023-09-30T22:31:15.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d3fff700 1 -- 172.21.15.154:0/3790057398 learned_addr learned my addr 172.21.15.154:0/3790057398 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:15.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d2ffd700 1 --2- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d409e260 0x7fc3d41208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:15.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d37fe700 1 -- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d409e260 msgr2=0x7fc3d41208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d37fe700 1 --2- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d409e260 0x7fc3d41208b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d37fe700 1 -- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d4136010 msgr2=0x7fc3d4120df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d37fe700 1 --2- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d4136010 0x7fc3d4120df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d37fe700 1 -- 172.21.15.154:0/3790057398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc009a70 con 0x7fc3d409d780 2023-09-30T22:31:15.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d3fff700 1 --2- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d4136010 0x7fc3d4120df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:15.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d37fe700 1 --2- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d409d780 0x7fc3d4120370 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800c470 tx=0x7fc3c800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:15.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3bbfff700 1 -- 172.21.15.154:0/3790057398 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8004c80 con 0x7fc3d409d780 2023-09-30T22:31:15.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3bbfff700 1 -- 172.21.15.154:0/3790057398 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8004de0 con 0x7fc3d409d780 2023-09-30T22:31:15.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/3790057398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d4135270 con 0x7fc3d409d780 2023-09-30T22:31:15.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3bbfff700 1 -- 172.21.15.154:0/3790057398 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8007310 con 0x7fc3d409d780 2023-09-30T22:31:15.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.725+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/3790057398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d4123e00 con 0x7fc3d409d780 2023-09-30T22:31:15.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.726+0000 7fc3bbfff700 1 -- 172.21.15.154:0/3790057398 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3c8007470 con 0x7fc3d409d780 2023-09-30T22:31:15.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.726+0000 7fc3bbfff700 1 -- 172.21.15.154:0/3790057398 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc3c803f230 con 0x7fc3d409d780 2023-09-30T22:31:15.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.726+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/3790057398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d404f2a0 con 0x7fc3d409d780 2023-09-30T22:31:15.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.731+0000 7fc3bbfff700 1 -- 172.21.15.154:0/3790057398 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3c8007720 con 0x7fc3d409d780 2023-09-30T22:31:15.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.913+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/3790057398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3d409b5a0 con 0x7fc3d409d780 2023-09-30T22:31:15.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.913+0000 7fc3bbfff700 1 -- 172.21.15.154:0/3790057398 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3c8011e80 con 0x7fc3d409d780 2023-09-30T22:31:15.914 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-09-30T22:31:15.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.915+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d409d780 msgr2=0x7fc3d4120370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:15.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.915+0000 7fc3d9ce6700 1 --2- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d409d780 0x7fc3d4120370 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800c470 tx=0x7fc3c800c780 comp rx=0 tx=0).stop 2023-09-30T22:31:15.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.915+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/3790057398 shutdown_connections 2023-09-30T22:31:15.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.915+0000 7fc3d9ce6700 1 --2- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3d4136010 0x7fc3d4120df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.915+0000 7fc3d9ce6700 1 --2- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3d409d780 0x7fc3d4120370 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.915+0000 7fc3d9ce6700 1 --2- 172.21.15.154:0/3790057398 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fc3d409e260 0x7fc3d41208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:15.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.915+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/3790057398 >> 172.21.15.154:0/3790057398 conn(0x7fc3d409f980 msgr2=0x7fc3d40a2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:15.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.915+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/3790057398 shutdown_connections 2023-09-30T22:31:15.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:15.915+0000 7fc3d9ce6700 1 -- 172.21.15.154:0/3790057398 wait complete. 2023-09-30T22:31:15.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:31:16.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.051+0000 7f6a2491c700 1 Processor -- start 2023-09-30T22:31:16.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.051+0000 7f6a2491c700 1 -- start start 2023-09-30T22:31:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a2491c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a2009d780 0x7f6a2009db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a2491c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a2009e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a2491c700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2009a590 con 0x7f6a20133a80 2023-09-30T22:31:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a2491c700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2009e5d0 con 0x7f6a2009d780 2023-09-30T22:31:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a2491c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2006b450 con 0x7f6a2009ad70 2023-09-30T22:31:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a2009d780 0x7f6a2009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1dd9b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a2009e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a2009d780 0x7f6a2009db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52324/0 (socket says 172.21.15.154:52324) 2023-09-30T22:31:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1e59c700 1 -- 172.21.15.154:0/2771746892 learned_addr learned my addr 172.21.15.154:0/2771746892 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1ed9d700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6a20133a80 0x7f6a20133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59864/0 (socket says 172.21.15.154:59864) 2023-09-30T22:31:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1e59c700 1 -- 172.21.15.154:0/2771746892 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 msgr2=0x7f6a2009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1e59c700 1 --2- 172.21.15.154:0/2771746892 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a2009e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1e59c700 1 -- 172.21.15.154:0/2771746892 >> v1:172.21.15.154:6789/0 conn(0x7f6a20133a80 legacy=0x7f6a20133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1e59c700 1 -- 172.21.15.154:0/2771746892 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2006a9e0 con 0x7f6a2009d780 2023-09-30T22:31:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1dd9b700 1 --2- 172.21.15.154:0/2771746892 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a2009e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.052+0000 7f6a1e59c700 1 --2- 172.21.15.154:0/2771746892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a2009d780 0x7f6a2009db50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f6a140098f0 tx=0x7f6a14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccdd1a96dc885747 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a1d59a700 1 -- 172.21.15.154:0/2771746892 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14011830 con 0x7f6a2009d780 2023-09-30T22:31:16.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a1d59a700 1 -- 172.21.15.154:0/2771746892 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14011990 con 0x7f6a2009d780 2023-09-30T22:31:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a1d59a700 1 -- 172.21.15.154:0/2771746892 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14011d20 con 0x7f6a2009d780 2023-09-30T22:31:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a2491c700 1 -- 172.21.15.154:0/2771746892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a2009d780 msgr2=0x7f6a2009db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a2491c700 1 --2- 172.21.15.154:0/2771746892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a2009d780 0x7f6a2009db50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f6a140098f0 tx=0x7f6a14009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a2491c700 1 -- 172.21.15.154:0/2771746892 shutdown_connections 2023-09-30T22:31:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a2491c700 1 --2- 172.21.15.154:0/2771746892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a2009d780 0x7f6a2009db50 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a2491c700 1 --2- 172.21.15.154:0/2771746892 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a2009e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a2491c700 1 -- 172.21.15.154:0/2771746892 >> 172.21.15.154:0/2771746892 conn(0x7f6a2009f980 msgr2=0x7f6a2009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a2491c700 1 -- 172.21.15.154:0/2771746892 shutdown_connections 2023-09-30T22:31:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.053+0000 7f6a2491c700 1 -- 172.21.15.154:0/2771746892 wait complete. 2023-09-30T22:31:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.054+0000 7f6a2491c700 1 Processor -- start 2023-09-30T22:31:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.054+0000 7f6a2491c700 1 -- start start 2023-09-30T22:31:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a2491c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a201204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a2491c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a2009d780 0x7f6a20120a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a2491c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a20133a80 0x7f6a20120f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a2491c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20123c90 con 0x7f6a20133a80 2023-09-30T22:31:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a2491c700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20122680 con 0x7f6a2009d780 2023-09-30T22:31:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a2491c700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20123340 con 0x7f6a2009ad70 2023-09-30T22:31:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a201204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1e59c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a201204e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59872/0 (socket says 172.21.15.154:59872) 2023-09-30T22:31:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1e59c700 1 -- 172.21.15.154:0/2230509955 learned_addr learned my addr 172.21.15.154:0/2230509955 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1dd9b700 1 --2- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a2009d780 0x7f6a20120a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1ed9d700 1 --2- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a20133a80 0x7f6a20120f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1e59c700 1 -- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a2009d780 msgr2=0x7f6a20120a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1e59c700 1 --2- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a2009d780 0x7f6a20120a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1e59c700 1 -- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a20133a80 msgr2=0x7f6a20120f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1e59c700 1 --2- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a20133a80 0x7f6a20120f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1e59c700 1 -- 172.21.15.154:0/2230509955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100094a0 con 0x7f6a2009ad70 2023-09-30T22:31:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a1e59c700 1 --2- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a201204e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f6a14000c00 tx=0x7f6a14004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a0effd700 1 -- 172.21.15.154:0/2230509955 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14004400 con 0x7f6a2009ad70 2023-09-30T22:31:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a0effd700 1 -- 172.21.15.154:0/2230509955 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1401f070 con 0x7f6a2009ad70 2023-09-30T22:31:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a2491c700 1 -- 172.21.15.154:0/2230509955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a14009550 con 0x7f6a2009ad70 2023-09-30T22:31:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a0effd700 1 -- 172.21.15.154:0/2230509955 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a140038e0 con 0x7f6a2009ad70 2023-09-30T22:31:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.055+0000 7f6a2491c700 1 -- 172.21.15.154:0/2230509955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2009c710 con 0x7f6a2009ad70 2023-09-30T22:31:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.056+0000 7f6a0effd700 1 -- 172.21.15.154:0/2230509955 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a14021030 con 0x7f6a2009ad70 2023-09-30T22:31:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.056+0000 7f6a0effd700 1 -- 172.21.15.154:0/2230509955 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a140408f0 con 0x7f6a2009ad70 2023-09-30T22:31:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.056+0000 7f6a2491c700 1 -- 172.21.15.154:0/2230509955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a20072080 con 0x7f6a2009ad70 2023-09-30T22:31:16.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.061+0000 7f6a0effd700 1 -- 172.21.15.154:0/2230509955 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a14019980 con 0x7f6a2009ad70 2023-09-30T22:31:16.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.244+0000 7f6a2491c700 1 -- 172.21.15.154:0/2230509955 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6a20123fd0 con 0x7f6a2009ad70 2023-09-30T22:31:16.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.244+0000 7f6a0effd700 1 -- 172.21.15.154:0/2230509955 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6a1401b430 con 0x7f6a2009ad70 2023-09-30T22:31:16.245 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 8 2023-09-30T22:31:16.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.246+0000 7f6a2491c700 1 -- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 msgr2=0x7f6a201204e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.246+0000 7f6a2491c700 1 --2- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a201204e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f6a14000c00 tx=0x7f6a14004750 comp rx=0 tx=0).stop 2023-09-30T22:31:16.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.246+0000 7f6a2491c700 1 -- 172.21.15.154:0/2230509955 shutdown_connections 2023-09-30T22:31:16.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.246+0000 7f6a2491c700 1 --2- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a20133a80 0x7f6a20120f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.246+0000 7f6a2491c700 1 --2- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f6a2009ad70 0x7f6a201204e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.246+0000 7f6a2491c700 1 --2- 172.21.15.154:0/2230509955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a2009d780 0x7f6a20120a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.246+0000 7f6a2491c700 1 -- 172.21.15.154:0/2230509955 >> 172.21.15.154:0/2230509955 conn(0x7f6a2009f980 msgr2=0x7f6a201bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.246+0000 7f6a2491c700 1 -- 172.21.15.154:0/2230509955 shutdown_connections 2023-09-30T22:31:16.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.246+0000 7f6a2491c700 1 -- 172.21.15.154:0/2230509955 wait complete. 2023-09-30T22:31:16.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:31:16.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.382+0000 7fef3ff0b700 1 Processor -- start 2023-09-30T22:31:16.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.382+0000 7fef3ff0b700 1 -- start start 2023-09-30T22:31:16.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3ff0b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef3809ad70 0x7fef38138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3ff0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3813b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3ff0b700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3809a590 con 0x7fef3809d780 2023-09-30T22:31:16.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3ff0b700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3806b450 con 0x7fef3809ad70 2023-09-30T22:31:16.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3ff0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef3806a9e0 con 0x7fef3809e260 2023-09-30T22:31:16.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3d4a6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef3809ad70 0x7fef38138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3e4a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3e4a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3813b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59886/0 (socket says 172.21.15.154:59886) 2023-09-30T22:31:16.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3e4a8700 1 -- 172.21.15.154:0/3786451815 learned_addr learned my addr 172.21.15.154:0/3786451815 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:16.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3d4a6700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef3809ad70 0x7fef38138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52340/0 (socket says 172.21.15.154:52340) 2023-09-30T22:31:16.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3e4a8700 1 -- 172.21.15.154:0/3786451815 >> v2:172.21.15.154:3300/0 conn(0x7fef3809ad70 msgr2=0x7fef38138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:16.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3e4a8700 1 --2- 172.21.15.154:0/3786451815 >> v2:172.21.15.154:3300/0 conn(0x7fef3809ad70 0x7fef38138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3e4a8700 1 -- 172.21.15.154:0/3786451815 >> v1:172.21.15.154:6789/0 conn(0x7fef3809d780 legacy=0x7fef3809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3e4a8700 1 -- 172.21.15.154:0/3786451815 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3809a870 con 0x7fef3809e260 2023-09-30T22:31:16.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3d4a6700 1 --2- 172.21.15.154:0/3786451815 >> v2:172.21.15.154:3300/0 conn(0x7fef3809ad70 0x7fef38138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3e4a8700 1 --2- 172.21.15.154:0/3786451815 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3813b210 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fef30009e50 tx=0x7fef3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5daef7bb9d8c7a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3cca5700 1 -- 172.21.15.154:0/3786451815 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000e070 con 0x7fef3809e260 2023-09-30T22:31:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3cca5700 1 -- 172.21.15.154:0/3786451815 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3000b910 con 0x7fef3809e260 2023-09-30T22:31:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.383+0000 7fef3cca5700 1 -- 172.21.15.154:0/3786451815 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000bcc0 con 0x7fef3809e260 2023-09-30T22:31:16.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.384+0000 7fef3ff0b700 1 -- 172.21.15.154:0/3786451815 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 msgr2=0x7fef3813b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.384+0000 7fef3ff0b700 1 --2- 172.21.15.154:0/3786451815 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3813b210 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fef30009e50 tx=0x7fef3000b330 comp rx=0 tx=0).stop 2023-09-30T22:31:16.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.384+0000 7fef3ff0b700 1 -- 172.21.15.154:0/3786451815 shutdown_connections 2023-09-30T22:31:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.384+0000 7fef3ff0b700 1 --2- 172.21.15.154:0/3786451815 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3813b210 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.384+0000 7fef3ff0b700 1 --2- 172.21.15.154:0/3786451815 >> v2:172.21.15.154:3300/0 conn(0x7fef3809ad70 0x7fef38138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.384+0000 7fef3ff0b700 1 -- 172.21.15.154:0/3786451815 >> 172.21.15.154:0/3786451815 conn(0x7fef3809f980 msgr2=0x7fef3809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.384+0000 7fef3ff0b700 1 -- 172.21.15.154:0/3786451815 shutdown_connections 2023-09-30T22:31:16.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.384+0000 7fef3ff0b700 1 -- 172.21.15.154:0/3786451815 wait complete. 2023-09-30T22:31:16.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.385+0000 7fef3ff0b700 1 Processor -- start 2023-09-30T22:31:16.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.385+0000 7fef3ff0b700 1 -- start start 2023-09-30T22:31:16.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.385+0000 7fef3ff0b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef3809ad70 0x7fef3811e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.385+0000 7fef3ff0b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef3809d780 0x7fef3811eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.385+0000 7fef3ff0b700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3811f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.385+0000 7fef3ff0b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3811fef0 con 0x7fef3809ad70 2023-09-30T22:31:16.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.385+0000 7fef3ff0b700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef38121120 con 0x7fef3809d780 2023-09-30T22:31:16.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.385+0000 7fef3ff0b700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef38121570 con 0x7fef3809e260 2023-09-30T22:31:16.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3dca7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef3809ad70 0x7fef3811e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3e4a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3811f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3d4a6700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef3809d780 0x7fef3811eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3dca7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef3809ad70 0x7fef3811e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52350/0 (socket says 172.21.15.154:52350) 2023-09-30T22:31:16.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3dca7700 1 -- 172.21.15.154:0/724528361 learned_addr learned my addr 172.21.15.154:0/724528361 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3e4a8700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3811f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59892/0 (socket says 172.21.15.154:59892) 2023-09-30T22:31:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3e4a8700 1 -- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef3809d780 msgr2=0x7fef3811eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3e4a8700 1 --2- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef3809d780 0x7fef3811eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3e4a8700 1 -- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef3809ad70 msgr2=0x7fef3811e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3e4a8700 1 --2- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef3809ad70 0x7fef3811e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3e4a8700 1 -- 172.21.15.154:0/724528361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340094a0 con 0x7fef3809e260 2023-09-30T22:31:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3e4a8700 1 --2- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3811f3f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fef30015000 tx=0x7fef30004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef2e7fc700 1 -- 172.21.15.154:0/724528361 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30004800 con 0x7fef3809e260 2023-09-30T22:31:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef2e7fc700 1 -- 172.21.15.154:0/724528361 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30004960 con 0x7fef3809e260 2023-09-30T22:31:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3ff0b700 1 -- 172.21.15.154:0/724528361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef30009b30 con 0x7fef3809e260 2023-09-30T22:31:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef2e7fc700 1 -- 172.21.15.154:0/724528361 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3001c680 con 0x7fef3809e260 2023-09-30T22:31:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.386+0000 7fef3ff0b700 1 -- 172.21.15.154:0/724528361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3809c710 con 0x7fef3809e260 2023-09-30T22:31:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.387+0000 7fef2e7fc700 1 -- 172.21.15.154:0/724528361 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef3001c7e0 con 0x7fef3809e260 2023-09-30T22:31:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.387+0000 7fef2e7fc700 1 -- 172.21.15.154:0/724528361 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef30040e40 con 0x7fef3809e260 2023-09-30T22:31:16.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.387+0000 7fef3ff0b700 1 -- 172.21.15.154:0/724528361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3804f2a0 con 0x7fef3809e260 2023-09-30T22:31:16.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.392+0000 7fef2e7fc700 1 -- 172.21.15.154:0/724528361 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef300123f0 con 0x7fef3809e260 2023-09-30T22:31:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.578+0000 7fef3ff0b700 1 -- 172.21.15.154:0/724528361 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef3806c3f0 con 0x7fef3809e260 2023-09-30T22:31:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.578+0000 7fef2e7fc700 1 -- 172.21.15.154:0/724528361 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef30024820 con 0x7fef3809e260 2023-09-30T22:31:16.579 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-09-30T22:31:16.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.580+0000 7fef3ff0b700 1 -- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 msgr2=0x7fef3811f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.580+0000 7fef3ff0b700 1 --2- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3811f3f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fef30015000 tx=0x7fef30004ad0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.580+0000 7fef3ff0b700 1 -- 172.21.15.154:0/724528361 shutdown_connections 2023-09-30T22:31:16.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.580+0000 7fef3ff0b700 1 --2- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fef3809e260 0x7fef3811f3f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.580+0000 7fef3ff0b700 1 --2- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef3809ad70 0x7fef3811e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.580+0000 7fef3ff0b700 1 --2- 172.21.15.154:0/724528361 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef3809d780 0x7fef3811eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.580+0000 7fef3ff0b700 1 -- 172.21.15.154:0/724528361 >> 172.21.15.154:0/724528361 conn(0x7fef3809f980 msgr2=0x7fef380a0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.580+0000 7fef3ff0b700 1 -- 172.21.15.154:0/724528361 shutdown_connections 2023-09-30T22:31:16.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.580+0000 7fef3ff0b700 1 -- 172.21.15.154:0/724528361 wait complete. 2023-09-30T22:31:16.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:31:16.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.719+0000 7fe98a142700 1 Processor -- start 2023-09-30T22:31:16.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.719+0000 7fe98a142700 1 -- start start 2023-09-30T22:31:16.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.719+0000 7fe98a142700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe98409e260 0x7fe984135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.719+0000 7fe98a142700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe984136010 0x7fe9841383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.719+0000 7fe98a142700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98409e690 con 0x7fe98409d780 2023-09-30T22:31:16.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.719+0000 7fe98a142700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98409d430 con 0x7fe98409e260 2023-09-30T22:31:16.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.719+0000 7fe98a142700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98409e910 con 0x7fe984136010 2023-09-30T22:31:16.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe983fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe984136010 0x7fe9841383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe982ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe98409e260 0x7fe984135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe982ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe98409e260 0x7fe984135ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52358/0 (socket says 172.21.15.154:52358) 2023-09-30T22:31:16.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe983fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe984136010 0x7fe9841383f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52660/0 (socket says 172.21.15.154:52660) 2023-09-30T22:31:16.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe982ffd700 1 -- 172.21.15.154:0/2858397129 learned_addr learned my addr 172.21.15.154:0/2858397129 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:16.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe983fff700 1 -- 172.21.15.154:0/2858397129 >> v2:172.21.15.154:3300/0 conn(0x7fe98409e260 msgr2=0x7fe984135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:16.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe983fff700 1 --2- 172.21.15.154:0/2858397129 >> v2:172.21.15.154:3300/0 conn(0x7fe98409e260 0x7fe984135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe983fff700 1 -- 172.21.15.154:0/2858397129 >> v1:172.21.15.154:6789/0 conn(0x7fe98409d780 legacy=0x7fe98409db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe983fff700 1 -- 172.21.15.154:0/2858397129 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98409b380 con 0x7fe984136010 2023-09-30T22:31:16.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe982ffd700 1 --2- 172.21.15.154:0/2858397129 >> v2:172.21.15.154:3300/0 conn(0x7fe98409e260 0x7fe984135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:16.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe983fff700 1 --2- 172.21.15.154:0/2858397129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe984136010 0x7fe9841383f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009d90 tx=0x7fe97c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b65d128bd767c8b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe9827fc700 1 -- 172.21.15.154:0/2858397129 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00e070 con 0x7fe984136010 2023-09-30T22:31:16.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe9827fc700 1 -- 172.21.15.154:0/2858397129 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c00bb20 con 0x7fe984136010 2023-09-30T22:31:16.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.720+0000 7fe9827fc700 1 -- 172.21.15.154:0/2858397129 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c012430 con 0x7fe984136010 2023-09-30T22:31:16.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.721+0000 7fe98a142700 1 -- 172.21.15.154:0/2858397129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe984136010 msgr2=0x7fe9841383f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.721+0000 7fe98a142700 1 --2- 172.21.15.154:0/2858397129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe984136010 0x7fe9841383f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009d90 tx=0x7fe97c00b330 comp rx=0 tx=0).stop 2023-09-30T22:31:16.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.721+0000 7fe98a142700 1 -- 172.21.15.154:0/2858397129 shutdown_connections 2023-09-30T22:31:16.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.721+0000 7fe98a142700 1 --2- 172.21.15.154:0/2858397129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe984136010 0x7fe9841383f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.721+0000 7fe98a142700 1 --2- 172.21.15.154:0/2858397129 >> v2:172.21.15.154:3300/0 conn(0x7fe98409e260 0x7fe984135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.721+0000 7fe98a142700 1 -- 172.21.15.154:0/2858397129 >> 172.21.15.154:0/2858397129 conn(0x7fe98409f980 msgr2=0x7fe98409fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.721+0000 7fe98a142700 1 -- 172.21.15.154:0/2858397129 shutdown_connections 2023-09-30T22:31:16.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.721+0000 7fe98a142700 1 -- 172.21.15.154:0/2858397129 wait complete. 2023-09-30T22:31:16.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.722+0000 7fe98a142700 1 Processor -- start 2023-09-30T22:31:16.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.722+0000 7fe98a142700 1 -- start start 2023-09-30T22:31:16.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe98a142700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe98409d780 0x7fe98411e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe98a142700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe98409e260 0x7fe98411e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe98a142700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe984136010 0x7fe98411eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:16.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe98a142700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840a2020 con 0x7fe98409e260 2023-09-30T22:31:16.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe98a142700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98409c8d0 con 0x7fe98409d780 2023-09-30T22:31:16.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe98a142700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9841216f0 con 0x7fe984136010 2023-09-30T22:31:16.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe982ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe98409e260 0x7fe98411e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe982ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe98409e260 0x7fe98411e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52368/0 (socket says 172.21.15.154:52368) 2023-09-30T22:31:16.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe982ffd700 1 -- 172.21.15.154:0/2856509097 learned_addr learned my addr 172.21.15.154:0/2856509097 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:16.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe983fff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe984136010 0x7fe98411eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe9837fe700 1 --2- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe98409d780 0x7fe98411e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:16.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe982ffd700 1 -- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe984136010 msgr2=0x7fe98411eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe982ffd700 1 --2- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe984136010 0x7fe98411eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe982ffd700 1 -- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe98409d780 msgr2=0x7fe98411e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe982ffd700 1 --2- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe98409d780 0x7fe98411e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe982ffd700 1 -- 172.21.15.154:0/2856509097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97400b7f0 con 0x7fe98409e260 2023-09-30T22:31:16.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.723+0000 7fe982ffd700 1 --2- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe98409e260 0x7fe98411e980 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fe974010fa0 tx=0x7fe97400e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:16.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.724+0000 7fe97bfff700 1 -- 172.21.15.154:0/2856509097 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97400eea0 con 0x7fe98409e260 2023-09-30T22:31:16.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.724+0000 7fe97bfff700 1 -- 172.21.15.154:0/2856509097 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe974011650 con 0x7fe98409e260 2023-09-30T22:31:16.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.724+0000 7fe97bfff700 1 -- 172.21.15.154:0/2856509097 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9740119c0 con 0x7fe98409e260 2023-09-30T22:31:16.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.724+0000 7fe98a142700 1 -- 172.21.15.154:0/2856509097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c009a70 con 0x7fe98409e260 2023-09-30T22:31:16.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.724+0000 7fe98a142700 1 -- 172.21.15.154:0/2856509097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe984120800 con 0x7fe98409e260 2023-09-30T22:31:16.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.724+0000 7fe97bfff700 1 -- 172.21.15.154:0/2856509097 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe974011b20 con 0x7fe98409e260 2023-09-30T22:31:16.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.724+0000 7fe97bfff700 1 -- 172.21.15.154:0/2856509097 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe974042400 con 0x7fe98409e260 2023-09-30T22:31:16.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.725+0000 7fe98a142700 1 -- 172.21.15.154:0/2856509097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9841218c0 con 0x7fe98409e260 2023-09-30T22:31:16.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.729+0000 7fe97bfff700 1 -- 172.21.15.154:0/2856509097 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe97401e080 con 0x7fe98409e260 2023-09-30T22:31:16.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.912+0000 7fe98a142700 1 -- 172.21.15.154:0/2856509097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe98404f2a0 con 0x7fe98409e260 2023-09-30T22:31:16.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.913+0000 7fe97bfff700 1 -- 172.21.15.154:0/2856509097 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe974017990 con 0x7fe98409e260 2023-09-30T22:31:16.914 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-09-30T22:31:16.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.914+0000 7fe98a142700 1 -- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe98409e260 msgr2=0x7fe98411e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:16.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.914+0000 7fe98a142700 1 --2- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe98409e260 0x7fe98411e980 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fe974010fa0 tx=0x7fe97400e640 comp rx=0 tx=0).stop 2023-09-30T22:31:16.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.915+0000 7fe98a142700 1 -- 172.21.15.154:0/2856509097 shutdown_connections 2023-09-30T22:31:16.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.915+0000 7fe98a142700 1 --2- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fe984136010 0x7fe98411eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.915+0000 7fe98a142700 1 --2- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe98409d780 0x7fe98411e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.915+0000 7fe98a142700 1 --2- 172.21.15.154:0/2856509097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe98409e260 0x7fe98411e980 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:16.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.915+0000 7fe98a142700 1 -- 172.21.15.154:0/2856509097 >> 172.21.15.154:0/2856509097 conn(0x7fe98409f980 msgr2=0x7fe984070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:16.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.915+0000 7fe98a142700 1 -- 172.21.15.154:0/2856509097 shutdown_connections 2023-09-30T22:31:16.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:16.915+0000 7fe98a142700 1 -- 172.21.15.154:0/2856509097 wait complete. 2023-09-30T22:31:16.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T22:31:17.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d58df3700 1 Processor -- start 2023-09-30T22:31:17.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d58df3700 1 -- start start 2023-09-30T22:31:17.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d58df3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d54133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d58df3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d541304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d58df3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d541309f0 0x7f4d5413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d58df3700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5406b2d0 con 0x7f4d541309f0 2023-09-30T22:31:17.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d58df3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54133610 con 0x7f4d541300a0 2023-09-30T22:31:17.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d58df3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5409a500 con 0x7f4d54133ad0 2023-09-30T22:31:17.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d5259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d54133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d52d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d541309f0 0x7f4d5413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d51d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d541304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d5259c700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d54133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59912/0 (socket says 172.21.15.154:59912) 2023-09-30T22:31:17.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d52d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d541309f0 0x7f4d5413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52372/0 (socket says 172.21.15.154:52372) 2023-09-30T22:31:17.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.050+0000 7f4d5259c700 1 -- 172.21.15.154:0/1250715627 learned_addr learned my addr 172.21.15.154:0/1250715627 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:17.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d5259c700 1 -- 172.21.15.154:0/1250715627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 msgr2=0x7f4d541304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d5259c700 1 --2- 172.21.15.154:0/1250715627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d541304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d5259c700 1 -- 172.21.15.154:0/1250715627 >> v2:172.21.15.154:3300/0 conn(0x7f4d541309f0 msgr2=0x7f4d5413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d5259c700 1 --2- 172.21.15.154:0/1250715627 >> v2:172.21.15.154:3300/0 conn(0x7f4d541309f0 0x7f4d5413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d5259c700 1 -- 172.21.15.154:0/1250715627 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d541338b0 con 0x7f4d54133ad0 2023-09-30T22:31:17.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d51d9b700 1 --2- 172.21.15.154:0/1250715627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d541304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d52d9d700 1 --2- 172.21.15.154:0/1250715627 >> v2:172.21.15.154:3300/0 conn(0x7f4d541309f0 0x7f4d5413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d5259c700 1 --2- 172.21.15.154:0/1250715627 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d54133ea0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4d440098f0 tx=0x7f4d44009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c2941bfa0beecd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d5159a700 1 -- 172.21.15.154:0/1250715627 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44011830 con 0x7f4d54133ad0 2023-09-30T22:31:17.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d5159a700 1 -- 172.21.15.154:0/1250715627 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d44011990 con 0x7f4d54133ad0 2023-09-30T22:31:17.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.051+0000 7f4d5159a700 1 -- 172.21.15.154:0/1250715627 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44011d20 con 0x7f4d54133ad0 2023-09-30T22:31:17.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.052+0000 7f4d58df3700 1 -- 172.21.15.154:0/1250715627 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 msgr2=0x7f4d54133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.052+0000 7f4d58df3700 1 --2- 172.21.15.154:0/1250715627 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d54133ea0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4d440098f0 tx=0x7f4d44009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:17.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.052+0000 7f4d58df3700 1 -- 172.21.15.154:0/1250715627 shutdown_connections 2023-09-30T22:31:17.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.052+0000 7f4d58df3700 1 --2- 172.21.15.154:0/1250715627 >> v2:172.21.15.154:3300/0 conn(0x7f4d541309f0 0x7f4d5413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.052+0000 7f4d58df3700 1 --2- 172.21.15.154:0/1250715627 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d54133ea0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.052+0000 7f4d58df3700 1 --2- 172.21.15.154:0/1250715627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d541304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.052+0000 7f4d58df3700 1 -- 172.21.15.154:0/1250715627 >> 172.21.15.154:0/1250715627 conn(0x7f4d54099c40 msgr2=0x7f4d540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.052+0000 7f4d58df3700 1 -- 172.21.15.154:0/1250715627 shutdown_connections 2023-09-30T22:31:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.052+0000 7f4d58df3700 1 -- 172.21.15.154:0/1250715627 wait complete. 2023-09-30T22:31:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d58df3700 1 Processor -- start 2023-09-30T22:31:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d58df3700 1 -- start start 2023-09-30T22:31:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d58df3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d5411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d58df3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d541309f0 0x7f4d5411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d58df3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d5411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d58df3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541200c0 con 0x7f4d541309f0 2023-09-30T22:31:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d58df3700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5411fb20 con 0x7f4d541300a0 2023-09-30T22:31:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d58df3700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5411f040 con 0x7f4d54133ad0 2023-09-30T22:31:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d5259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d5411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d5259c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d5411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52690/0 (socket says 172.21.15.154:52690) 2023-09-30T22:31:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d52d9d700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d5411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d5259c700 1 -- 172.21.15.154:0/1723328477 learned_addr learned my addr 172.21.15.154:0/1723328477 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.053+0000 7f4d51d9b700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d541309f0 0x7f4d5411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d5259c700 1 -- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 msgr2=0x7f4d5411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d5259c700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d5411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d5259c700 1 -- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d541309f0 msgr2=0x7f4d5411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d5259c700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d541309f0 0x7f4d5411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d5259c700 1 -- 172.21.15.154:0/1723328477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d480094a0 con 0x7f4d541300a0 2023-09-30T22:31:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d52d9d700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d5411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d51d9b700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d541309f0 0x7f4d5411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d5259c700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d5411da40 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f4d5409a640 tx=0x7f4d44004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d42ffd700 1 -- 172.21.15.154:0/1723328477 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44004450 con 0x7f4d541300a0 2023-09-30T22:31:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d42ffd700 1 -- 172.21.15.154:0/1723328477 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d440045d0 con 0x7f4d541300a0 2023-09-30T22:31:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d42ffd700 1 -- 172.21.15.154:0/1723328477 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d440038e0 con 0x7f4d541300a0 2023-09-30T22:31:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d58df3700 1 -- 172.21.15.154:0/1723328477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c009a70 con 0x7f4d541300a0 2023-09-30T22:31:17.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.054+0000 7f4d58df3700 1 -- 172.21.15.154:0/1723328477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d44009550 con 0x7f4d541300a0 2023-09-30T22:31:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.055+0000 7f4d42ffd700 1 -- 172.21.15.154:0/1723328477 <== mon.1 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d44003a40 con 0x7f4d541300a0 2023-09-30T22:31:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.055+0000 7f4d42ffd700 1 -- 172.21.15.154:0/1723328477 <== mon.1 v2:172.21.15.154:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d44040b90 con 0x7f4d541300a0 2023-09-30T22:31:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.055+0000 7f4d58df3700 1 -- 172.21.15.154:0/1723328477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5412fcf0 con 0x7f4d541300a0 2023-09-30T22:31:17.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.059+0000 7f4d42ffd700 1 -- 172.21.15.154:0/1723328477 <== mon.1 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d44015080 con 0x7f4d541300a0 2023-09-30T22:31:17.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.258+0000 7f4d58df3700 1 -- 172.21.15.154:0/1723328477 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4d5412dd00 con 0x7f4d541300a0 2023-09-30T22:31:17.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.258+0000 7f4d42ffd700 1 -- 172.21.15.154:0/1723328477 <== mon.1 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v40) v1 ==== 81+0+648 (secure 0 0 0) 0x7f4d44010380 con 0x7f4d541300a0 2023-09-30T22:31:17.260 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/2961105614 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:17.260 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/2771224894 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:17.260 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/3517579577 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:17.260 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6816/118163 2023-10-01T22:21:47.164906+0000 2023-09-30T22:31:17.260 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/2273151012 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:17.261 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/956756939 2023-10-01T22:21:47.164906+0000 2023-09-30T22:31:17.261 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6816/126757 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:17.261 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/722774886 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:17.261 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/3939851609 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:17.261 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/2017971531 2023-10-01T22:21:47.164906+0000 2023-09-30T22:31:17.261 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6817/2576993373 2023-10-01T22:22:14.893865+0000 2023-09-30T22:31:17.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.260+0000 7f4d58df3700 1 -- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 msgr2=0x7f4d5411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.260+0000 7f4d58df3700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d5411da40 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f4d5409a640 tx=0x7f4d44004750 comp rx=0 tx=0).stop 2023-09-30T22:31:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.260+0000 7f4d58df3700 1 -- 172.21.15.154:0/1723328477 shutdown_connections 2023-09-30T22:31:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.260+0000 7f4d58df3700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4d54133ad0 0x7f4d5411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.260+0000 7f4d58df3700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d541300a0 0x7f4d5411da40 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.260+0000 7f4d58df3700 1 --2- 172.21.15.154:0/1723328477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d541309f0 0x7f4d5411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.260+0000 7f4d58df3700 1 -- 172.21.15.154:0/1723328477 >> 172.21.15.154:0/1723328477 conn(0x7f4d54099c40 msgr2=0x7f4d540a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.260+0000 7f4d58df3700 1 -- 172.21.15.154:0/1723328477 shutdown_connections 2023-09-30T22:31:17.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.260+0000 7f4d58df3700 1 -- 172.21.15.154:0/1723328477 wait complete. 2023-09-30T22:31:17.264 INFO:teuthology.orchestra.run.smithi154.stderr:listed 11 entries 2023-09-30T22:31:17.273 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-09-30T22:31:17.274 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T22:31:17.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T22:31:17.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2abe17700 1 Processor -- start 2023-09-30T22:31:17.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2abe17700 1 -- start start 2023-09-30T22:31:17.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2abe17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a409d860 0x7fb2a409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2abe17700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a4130eb0 0x7fb2a4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2abe17700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a409aaa0 con 0x7fb2a409e170 2023-09-30T22:31:17.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2abe17700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a409f870 con 0x7fb2a409d860 2023-09-30T22:31:17.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2abe17700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a409b360 con 0x7fb2a4130eb0 2023-09-30T22:31:17.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2a9bb3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a409d860 0x7fb2a409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2aa3b4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a4130eb0 0x7fb2a4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2a93b2700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb2a409e170 0x7fb2a41307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59880/0 (socket says 172.21.15.154:59880) 2023-09-30T22:31:17.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.416+0000 7fb2a93b2700 1 -- 172.21.15.154:0/2813528324 learned_addr learned my addr 172.21.15.154:0/2813528324 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-09-30T22:31:17.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a8bb1700 1 -- 172.21.15.154:0/2813528324 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180775571 0 0) 0x7fb2a409aaa0 con 0x7fb2a409e170 2023-09-30T22:31:17.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a8bb1700 1 -- 172.21.15.154:0/2813528324 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2900035b0 con 0x7fb2a409e170 2023-09-30T22:31:17.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a9bb3700 1 -- 172.21.15.154:0/2813528324 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a4130eb0 msgr2=0x7fb2a4138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a9bb3700 1 --2- 172.21.15.154:0/2813528324 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a4130eb0 0x7fb2a4138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a9bb3700 1 -- 172.21.15.154:0/2813528324 >> v1:172.21.15.154:6789/0 conn(0x7fb2a409e170 legacy=0x7fb2a41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a9bb3700 1 -- 172.21.15.154:0/2813528324 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a409b620 con 0x7fb2a409d860 2023-09-30T22:31:17.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2aa3b4700 1 --2- 172.21.15.154:0/2813528324 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a4130eb0 0x7fb2a4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a9bb3700 1 --2- 172.21.15.154:0/2813528324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a409d860 0x7fb2a409dc30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000bb10 tx=0x7fb2a000be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73599ecdb42d101d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a8bb1700 1 -- 172.21.15.154:0/2813528324 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000dc70 con 0x7fb2a409d860 2023-09-30T22:31:17.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a8bb1700 1 -- 172.21.15.154:0/2813528324 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a000ddd0 con 0x7fb2a409d860 2023-09-30T22:31:17.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.417+0000 7fb2a8bb1700 1 -- 172.21.15.154:0/2813528324 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0010690 con 0x7fb2a409d860 2023-09-30T22:31:17.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.418+0000 7fb2abe17700 1 -- 172.21.15.154:0/2813528324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a409d860 msgr2=0x7fb2a409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.418+0000 7fb2abe17700 1 --2- 172.21.15.154:0/2813528324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a409d860 0x7fb2a409dc30 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000bb10 tx=0x7fb2a000be20 comp rx=0 tx=0).stop 2023-09-30T22:31:17.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.418+0000 7fb2abe17700 1 -- 172.21.15.154:0/2813528324 shutdown_connections 2023-09-30T22:31:17.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.418+0000 7fb2abe17700 1 --2- 172.21.15.154:0/2813528324 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a4130eb0 0x7fb2a4138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.418+0000 7fb2abe17700 1 --2- 172.21.15.154:0/2813528324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a409d860 0x7fb2a409dc30 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.418+0000 7fb2abe17700 1 -- 172.21.15.154:0/2813528324 >> 172.21.15.154:0/2813528324 conn(0x7fb2a4099c40 msgr2=0x7fb2a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.418+0000 7fb2abe17700 1 -- 172.21.15.154:0/2813528324 shutdown_connections 2023-09-30T22:31:17.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.418+0000 7fb2abe17700 1 -- 172.21.15.154:0/2813528324 wait complete. 2023-09-30T22:31:17.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2abe17700 1 Processor -- start 2023-09-30T22:31:17.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2abe17700 1 -- start start 2023-09-30T22:31:17.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2abe17700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a409d860 0x7fb2a41226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2abe17700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a409e170 0x7fb2a4122be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2abe17700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a4130eb0 0x7fb2a4123120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2abe17700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4125cb0 con 0x7fb2a409e170 2023-09-30T22:31:17.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2abe17700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4126da0 con 0x7fb2a4130eb0 2023-09-30T22:31:17.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2abe17700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4130200 con 0x7fb2a409d860 2023-09-30T22:31:17.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a9bb3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a409d860 0x7fb2a41226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a93b2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a409e170 0x7fb2a4122be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2aa3b4700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a4130eb0 0x7fb2a4123120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a9bb3700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a409d860 0x7fb2a41226a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59936/0 (socket says 172.21.15.154:59936) 2023-09-30T22:31:17.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a9bb3700 1 -- 172.21.15.154:0/1012827556 learned_addr learned my addr 172.21.15.154:0/1012827556 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:17.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a93b2700 1 -- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a409d860 msgr2=0x7fb2a41226a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a93b2700 1 --2- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a409d860 0x7fb2a41226a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a93b2700 1 -- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a4130eb0 msgr2=0x7fb2a4123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a93b2700 1 --2- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a4130eb0 0x7fb2a4123120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a93b2700 1 -- 172.21.15.154:0/1012827556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c009a70 con 0x7fb2a409e170 2023-09-30T22:31:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.419+0000 7fb2a9bb3700 1 --2- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a409d860 0x7fb2a41226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.420+0000 7fb2a93b2700 1 --2- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a409e170 0x7fb2a4122be0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fb29800c490 tx=0x7fb29800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.420+0000 7fb2967fc700 1 -- 172.21.15.154:0/1012827556 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298005d70 con 0x7fb2a409e170 2023-09-30T22:31:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.420+0000 7fb2967fc700 1 -- 172.21.15.154:0/1012827556 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2980070d0 con 0x7fb2a409e170 2023-09-30T22:31:17.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.420+0000 7fb2967fc700 1 -- 172.21.15.154:0/1012827556 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298007440 con 0x7fb2a409e170 2023-09-30T22:31:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.420+0000 7fb2abe17700 1 -- 172.21.15.154:0/1012827556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a000b740 con 0x7fb2a409e170 2023-09-30T22:31:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.420+0000 7fb2abe17700 1 -- 172.21.15.154:0/1012827556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a41242b0 con 0x7fb2a409e170 2023-09-30T22:31:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.420+0000 7fb2967fc700 1 -- 172.21.15.154:0/1012827556 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2980075a0 con 0x7fb2a409e170 2023-09-30T22:31:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.421+0000 7fb2967fc700 1 -- 172.21.15.154:0/1012827556 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb29803e690 con 0x7fb2a409e170 2023-09-30T22:31:17.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.421+0000 7fb2abe17700 1 -- 172.21.15.154:0/1012827556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a41248c0 con 0x7fb2a409e170 2023-09-30T22:31:17.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.426+0000 7fb2967fc700 1 -- 172.21.15.154:0/1012827556 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2a41248c0 con 0x7fb2a409e170 2023-09-30T22:31:17.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.610+0000 7fb2abe17700 1 -- 172.21.15.154:0/1012827556 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2a41248c0 con 0x7fb2a409e170 2023-09-30T22:31:17.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.611+0000 7fb2967fc700 1 -- 172.21.15.154:0/1012827556 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13438 (secure 0 0 0) 0x7fb2a41248c0 con 0x7fb2a409e170 2023-09-30T22:31:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-09-30T22:31:17.613 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":40,"fsid":"632db358-b709-49ad-a56a-97cde2869fcf","created":"2023-09-30T22:19:18.987338+0000","modified":"2023-09-30T22:22:46.872149+0000","last_up_change":"2023-09-30T22:22:11.411450+0000","last_in_change":"2023-09-30T22:19:20.288789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T22:19:27.265135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T22:19:28.184247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T22:19:32.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T22:19:32.601719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9909cc74-5a3d-4745-a275-eb40291d9c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6800","nonce":130130}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6801","nonce":130130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6803","nonce":130130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6802","nonce":130130}]},"public_addr":"172.21.15.154:6800/130130","cluster_addr":"172.21.15.154:6801/130130","heartbeat_back_addr":"172.21.15.154:6803/130130","heartbeat_front_addr":"172.21.15.154:6802/130130","state":["exists","up"]},{"osd":1,"uuid":"630d7abe-ba54-47a6-978d-475135a94dea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6804","nonce":130229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6805","nonce":130229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6807","nonce":130229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6806","nonce":130229}]},"public_addr":"172.21.15.154:6804/130229","cluster_addr":"172.21.15.154:6805/130229","heartbeat_back_addr":"172.21.15.154:6807/130229","heartbeat_front_addr":"172.21.15.154:6806/130229","state":["exists","up"]},{"osd":2,"uuid":"a874650f-eff1-4a01-936f-7d02bdbc96d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6808","nonce":130339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6809","nonce":130339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6811","nonce":130339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6810","nonce":130339}]},"public_addr":"172.21.15.154:6808/130339","cluster_addr":"172.21.15.154:6809/130339","heartbeat_back_addr":"172.21.15.154:6811/130339","heartbeat_front_addr":"172.21.15.154:6810/130339","state":["exists","up"]},{"osd":3,"uuid":"23d7e2dd-76c1-4d97-97fd-7373fa3e719d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6812","nonce":130679}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6813","nonce":130679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6815","nonce":130679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.154:6814","nonce":130679}]},"public_addr":"172.21.15.154:6812/130679","cluster_addr":"172.21.15.154:6813/130679","heartbeat_back_addr":"172.21.15.154:6815/130679","heartbeat_front_addr":"172.21.15.154:6814/130679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.162523+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.460402+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.471551+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-09-30T22:22:04.989624+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T22:19:25.496057+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.2","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2961105614":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/2771224894":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/3517579577":"2023-10-01T22:22:46.872089+0000","172.21.15.154:6816/118163":"2023-10-01T22:21:47.164906+0000","172.21.15.154:0/2273151012":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/956756939":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6816/126757":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/722774886":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/3939851609":"2023-10-01T22:22:46.872089+0000","172.21.15.154:0/2017971531":"2023-10-01T22:21:47.164906+0000","172.21.15.154:6817/2576993373":"2023-10-01T22:22:14.893865+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T22:31:17.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.613+0000 7fb2abe17700 1 -- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a409e170 msgr2=0x7fb2a4122be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.613+0000 7fb2abe17700 1 --2- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a409e170 0x7fb2a4122be0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fb29800c490 tx=0x7fb29800c7a0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.613+0000 7fb2abe17700 1 -- 172.21.15.154:0/1012827556 shutdown_connections 2023-09-30T22:31:17.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.613+0000 7fb2abe17700 1 --2- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2a4130eb0 0x7fb2a4123120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.613+0000 7fb2abe17700 1 --2- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fb2a409d860 0x7fb2a41226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.613+0000 7fb2abe17700 1 --2- 172.21.15.154:0/1012827556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2a409e170 0x7fb2a4122be0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.613+0000 7fb2abe17700 1 -- 172.21.15.154:0/1012827556 >> 172.21.15.154:0/1012827556 conn(0x7fb2a4099c40 msgr2=0x7fb2a40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.613+0000 7fb2abe17700 1 -- 172.21.15.154:0/1012827556 shutdown_connections 2023-09-30T22:31:17.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.613+0000 7fb2abe17700 1 -- 172.21.15.154:0/1012827556 wait complete. 2023-09-30T22:31:17.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T22:19:27.265135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T22:19:28.184247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T22:19:32.024148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T22:19:32.601719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T22:31:17.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T22:31:17.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.751+0000 7f06f7d07700 1 Processor -- start 2023-09-30T22:31:17.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f7d07700 1 -- start start 2023-09-30T22:31:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f7d07700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06f009d780 0x7f06f009db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f7d07700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f009e090 0x7f06f0130680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f7d07700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f009e910 con 0x7f06f0130bc0 2023-09-30T22:31:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f7d07700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f009d430 con 0x7f06f009d780 2023-09-30T22:31:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f7d07700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f009b380 con 0x7f06f009e090 2023-09-30T22:31:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f5aa3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06f009d780 0x7f06f009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f52a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f009e090 0x7f06f0130680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f5aa3700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06f009d780 0x7f06f009db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52404/0 (socket says 172.21.15.154:52404) 2023-09-30T22:31:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f52a2700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f009e090 0x7f06f0130680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59944/0 (socket says 172.21.15.154:59944) 2023-09-30T22:31:17.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.752+0000 7f06f5aa3700 1 -- 172.21.15.154:0/96319476 learned_addr learned my addr 172.21.15.154:0/96319476 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:17.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f5aa3700 1 -- 172.21.15.154:0/96319476 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f009e090 msgr2=0x7f06f0130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:17.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f5aa3700 1 --2- 172.21.15.154:0/96319476 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f009e090 0x7f06f0130680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f5aa3700 1 -- 172.21.15.154:0/96319476 >> v1:172.21.15.154:6789/0 conn(0x7f06f0130bc0 legacy=0x7f06f0137ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f5aa3700 1 -- 172.21.15.154:0/96319476 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f009f570 con 0x7f06f009d780 2023-09-30T22:31:17.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f5aa3700 1 --2- 172.21.15.154:0/96319476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009d780 0x7f06f009db50 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f06e40098f0 tx=0x7f06e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe021cd2015fa163 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f4aa1700 1 -- 172.21.15.154:0/96319476 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400f8a0 con 0x7f06f009d780 2023-09-30T22:31:17.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f4aa1700 1 -- 172.21.15.154:0/96319476 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e400fa00 con 0x7f06f009d780 2023-09-30T22:31:17.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f4aa1700 1 -- 172.21.15.154:0/96319476 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400fd90 con 0x7f06f009d780 2023-09-30T22:31:17.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f7d07700 1 -- 172.21.15.154:0/96319476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009d780 msgr2=0x7f06f009db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f7d07700 1 --2- 172.21.15.154:0/96319476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009d780 0x7f06f009db50 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f06e40098f0 tx=0x7f06e4009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:17.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f7d07700 1 -- 172.21.15.154:0/96319476 shutdown_connections 2023-09-30T22:31:17.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f7d07700 1 --2- 172.21.15.154:0/96319476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009d780 0x7f06f009db50 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f7d07700 1 --2- 172.21.15.154:0/96319476 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f009e090 0x7f06f0130680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f7d07700 1 -- 172.21.15.154:0/96319476 >> 172.21.15.154:0/96319476 conn(0x7f06f009f980 msgr2=0x7f06f009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f7d07700 1 -- 172.21.15.154:0/96319476 shutdown_connections 2023-09-30T22:31:17.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.753+0000 7f06f7d07700 1 -- 172.21.15.154:0/96319476 wait complete. 2023-09-30T22:31:17.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.754+0000 7f06f7d07700 1 Processor -- start 2023-09-30T22:31:17.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.754+0000 7f06f7d07700 1 -- start start 2023-09-30T22:31:17.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f7d07700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06f009d780 0x7f06f0120480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f7d07700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009e090 0x7f06f01209c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f7d07700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f0130bc0 0x7f06f0120f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:17.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f7d07700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f0123f50 con 0x7f06f009e090 2023-09-30T22:31:17.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f7d07700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f0122040 con 0x7f06f009d780 2023-09-30T22:31:17.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f7d07700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f009a0e0 con 0x7f06f0130bc0 2023-09-30T22:31:17.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f52a2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009e090 0x7f06f01209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f5aa3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06f009d780 0x7f06f0120480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f62a4700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f0130bc0 0x7f06f0120f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:17.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f52a2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009e090 0x7f06f01209c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52418/0 (socket says 172.21.15.154:52418) 2023-09-30T22:31:17.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f52a2700 1 -- 172.21.15.154:0/253751521 learned_addr learned my addr 172.21.15.154:0/253751521 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:17.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f5aa3700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06f009d780 0x7f06f0120480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52720/0 (socket says 172.21.15.154:52720) 2023-09-30T22:31:17.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f52a2700 1 -- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f0130bc0 msgr2=0x7f06f0120f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f52a2700 1 --2- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f0130bc0 0x7f06f0120f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f52a2700 1 -- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06f009d780 msgr2=0x7f06f0120480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f52a2700 1 --2- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06f009d780 0x7f06f0120480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f52a2700 1 -- 172.21.15.154:0/253751521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4009550 con 0x7f06f009e090 2023-09-30T22:31:17.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06f52a2700 1 --2- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009e090 0x7f06f01209c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00e9b0 tx=0x7f06ec00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:17.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06e27fc700 1 -- 172.21.15.154:0/253751521 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec009710 con 0x7f06f009e090 2023-09-30T22:31:17.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.755+0000 7f06e27fc700 1 -- 172.21.15.154:0/253751521 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00ee50 con 0x7f06f009e090 2023-09-30T22:31:17.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.756+0000 7f06f7d07700 1 -- 172.21.15.154:0/253751521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f009c8d0 con 0x7f06f009e090 2023-09-30T22:31:17.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.756+0000 7f06e27fc700 1 -- 172.21.15.154:0/253751521 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00ca50 con 0x7f06f009e090 2023-09-30T22:31:17.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.756+0000 7f06f7d07700 1 -- 172.21.15.154:0/253751521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f0122830 con 0x7f06f009e090 2023-09-30T22:31:17.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.756+0000 7f06e27fc700 1 -- 172.21.15.154:0/253751521 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06ec00cbb0 con 0x7f06f009e090 2023-09-30T22:31:17.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.756+0000 7f06e27fc700 1 -- 172.21.15.154:0/253751521 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f06ec03f6f0 con 0x7f06f009e090 2023-09-30T22:31:17.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.756+0000 7f06f7d07700 1 -- 172.21.15.154:0/253751521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f01238c0 con 0x7f06f009e090 2023-09-30T22:31:17.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.761+0000 7f06e27fc700 1 -- 172.21.15.154:0/253751521 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06ec0232f0 con 0x7f06f009e090 2023-09-30T22:31:17.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.944+0000 7f06f7d07700 1 -- 172.21.15.154:0/253751521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06f004f2a0 con 0x7f06f009e090 2023-09-30T22:31:17.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.945+0000 7f06e27fc700 1 -- 172.21.15.154:0/253751521 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06ec021030 con 0x7f06f009e090 2023-09-30T22:31:17.945 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-09-30T22:31:17.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.946+0000 7f06f7d07700 1 -- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009e090 msgr2=0x7f06f01209c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:17.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.946+0000 7f06f7d07700 1 --2- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009e090 0x7f06f01209c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00e9b0 tx=0x7f06ec00ecc0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.947+0000 7f06f7d07700 1 -- 172.21.15.154:0/253751521 shutdown_connections 2023-09-30T22:31:17.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.947+0000 7f06f7d07700 1 --2- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f06f0130bc0 0x7f06f0120f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.947+0000 7f06f7d07700 1 --2- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06f009d780 0x7f06f0120480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.947 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.947+0000 7f06f7d07700 1 --2- 172.21.15.154:0/253751521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06f009e090 0x7f06f01209c0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:17.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.947+0000 7f06f7d07700 1 -- 172.21.15.154:0/253751521 >> 172.21.15.154:0/253751521 conn(0x7f06f009f980 msgr2=0x7f06f012e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:17.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.947+0000 7f06f7d07700 1 -- 172.21.15.154:0/253751521 shutdown_connections 2023-09-30T22:31:17.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:17.947+0000 7f06f7d07700 1 -- 172.21.15.154:0/253751521 wait complete. 2023-09-30T22:31:17.959 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T22:31:18.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.082+0000 7f4ead2bb700 1 Processor -- start 2023-09-30T22:31:18.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.082+0000 7f4ead2bb700 1 -- start start 2023-09-30T22:31:18.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ead2bb700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ea80a1e90 0x7f4ea80a2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ead2bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea80a3190 0x7f4ea80a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ead2bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea8137bc0 0x7f4ea8139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ead2bb700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea806bfc0 con 0x7f4ea80a1e90 2023-09-30T22:31:18.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ead2bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea806d860 con 0x7f4ea80a3190 2023-09-30T22:31:18.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ead2bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80a2ce0 con 0x7f4ea8137bc0 2023-09-30T22:31:18.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ea80a1e90 0x7f4ea80a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea80a3190 0x7f4ea80a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea77fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea8137bc0 0x7f4ea8139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea6ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ea80a1e90 0x7f4ea80a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52428/0 (socket says 172.21.15.154:52428) 2023-09-30T22:31:18.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea67fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea80a3190 0x7f4ea80a27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52732/0 (socket says 172.21.15.154:52732) 2023-09-30T22:31:18.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea6ffd700 1 -- 172.21.15.154:0/1024580307 learned_addr learned my addr 172.21.15.154:0/1024580307 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:18.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea6ffd700 1 -- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea8137bc0 msgr2=0x7f4ea8139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea6ffd700 1 --2- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea8137bc0 0x7f4ea8139fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea6ffd700 1 -- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea80a3190 msgr2=0x7f4ea80a27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea6ffd700 1 --2- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea80a3190 0x7f4ea80a27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea6ffd700 1 -- 172.21.15.154:0/1024580307 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea806c210 con 0x7f4ea80a1e90 2023-09-30T22:31:18.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea77fe700 1 --2- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea8137bc0 0x7f4ea8139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea67fc700 1 --2- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea80a3190 0x7f4ea80a27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.083+0000 7f4ea6ffd700 1 --2- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 0x7f4ea80a2260 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009920 tx=0x7f4e9c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af90d8e35edddd8a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ea5ffb700 1 -- 172.21.15.154:0/1024580307 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c011830 con 0x7f4ea80a1e90 2023-09-30T22:31:18.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ea5ffb700 1 -- 172.21.15.154:0/1024580307 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c011990 con 0x7f4ea80a1e90 2023-09-30T22:31:18.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ea5ffb700 1 -- 172.21.15.154:0/1024580307 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c011d20 con 0x7f4ea80a1e90 2023-09-30T22:31:18.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ead2bb700 1 -- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 msgr2=0x7f4ea80a2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ead2bb700 1 --2- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 0x7f4ea80a2260 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009920 tx=0x7f4e9c009c30 comp rx=0 tx=0).stop 2023-09-30T22:31:18.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ead2bb700 1 -- 172.21.15.154:0/1024580307 shutdown_connections 2023-09-30T22:31:18.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ead2bb700 1 --2- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea8137bc0 0x7f4ea8139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ead2bb700 1 --2- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 0x7f4ea80a2260 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ead2bb700 1 --2- 172.21.15.154:0/1024580307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea80a3190 0x7f4ea80a27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ead2bb700 1 -- 172.21.15.154:0/1024580307 >> 172.21.15.154:0/1024580307 conn(0x7f4ea80a43d0 msgr2=0x7f4ea80a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ead2bb700 1 -- 172.21.15.154:0/1024580307 shutdown_connections 2023-09-30T22:31:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.084+0000 7f4ead2bb700 1 -- 172.21.15.154:0/1024580307 wait complete. 2023-09-30T22:31:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.085+0000 7f4ead2bb700 1 Processor -- start 2023-09-30T22:31:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.085+0000 7f4ead2bb700 1 -- start start 2023-09-30T22:31:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ead2bb700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 0x7f4ea8120750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ead2bb700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea80a3190 0x7f4ea8120c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ead2bb700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea8137bc0 0x7f4ea81211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ead2bb700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea809fd50 con 0x7f4ea80a1e90 2023-09-30T22:31:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ead2bb700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8072a00 con 0x7f4ea8137bc0 2023-09-30T22:31:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ead2bb700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8123970 con 0x7f4ea80a3190 2023-09-30T22:31:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 0x7f4ea8120750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea67fc700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea80a3190 0x7f4ea8120c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 0x7f4ea8120750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52430/0 (socket says 172.21.15.154:52430) 2023-09-30T22:31:18.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea6ffd700 1 -- 172.21.15.154:0/3594377639 learned_addr learned my addr 172.21.15.154:0/3594377639 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea77fe700 1 --2- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea8137bc0 0x7f4ea81211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea6ffd700 1 -- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea80a3190 msgr2=0x7f4ea8120c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea6ffd700 1 --2- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea80a3190 0x7f4ea8120c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea6ffd700 1 -- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea8137bc0 msgr2=0x7f4ea81211d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea6ffd700 1 --2- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea8137bc0 0x7f4ea81211d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea6ffd700 1 -- 172.21.15.154:0/3594377639 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980094a0 con 0x7f4ea80a1e90 2023-09-30T22:31:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ea6ffd700 1 --2- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 0x7f4ea8120750 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0098f0 tx=0x7f4e9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4e8f7fe700 1 -- 172.21.15.154:0/3594377639 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c004240 con 0x7f4ea80a1e90 2023-09-30T22:31:18.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4e8f7fe700 1 -- 172.21.15.154:0/3594377639 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c01f070 con 0x7f4ea80a1e90 2023-09-30T22:31:18.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ead2bb700 1 -- 172.21.15.154:0/3594377639 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea0009a70 con 0x7f4ea80a1e90 2023-09-30T22:31:18.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4e8f7fe700 1 -- 172.21.15.154:0/3594377639 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0036a0 con 0x7f4ea80a1e90 2023-09-30T22:31:18.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.086+0000 7f4ead2bb700 1 -- 172.21.15.154:0/3594377639 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c009550 con 0x7f4ea80a1e90 2023-09-30T22:31:18.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.087+0000 7f4e8f7fe700 1 -- 172.21.15.154:0/3594377639 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e9c021030 con 0x7f4ea80a1e90 2023-09-30T22:31:18.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.087+0000 7f4e8f7fe700 1 -- 172.21.15.154:0/3594377639 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e9c040a10 con 0x7f4ea80a1e90 2023-09-30T22:31:18.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.087+0000 7f4ead2bb700 1 -- 172.21.15.154:0/3594377639 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea804f2a0 con 0x7f4ea80a1e90 2023-09-30T22:31:18.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.092+0000 7f4e8f7fe700 1 -- 172.21.15.154:0/3594377639 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e9c0239c0 con 0x7f4ea80a1e90 2023-09-30T22:31:18.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.273+0000 7f4ead2bb700 1 -- 172.21.15.154:0/3594377639 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ea8122a80 con 0x7f4ea80a1e90 2023-09-30T22:31:18.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.273+0000 7f4e8f7fe700 1 -- 172.21.15.154:0/3594377639 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4e9c0233d0 con 0x7f4ea80a1e90 2023-09-30T22:31:18.273 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 8 2023-09-30T22:31:18.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.275+0000 7f4ead2bb700 1 -- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 msgr2=0x7f4ea8120750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.275+0000 7f4ead2bb700 1 --2- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 0x7f4ea8120750 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0098f0 tx=0x7f4e9c004750 comp rx=0 tx=0).stop 2023-09-30T22:31:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.275+0000 7f4ead2bb700 1 -- 172.21.15.154:0/3594377639 shutdown_connections 2023-09-30T22:31:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.275+0000 7f4ead2bb700 1 --2- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ea8137bc0 0x7f4ea81211d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.275+0000 7f4ead2bb700 1 --2- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ea80a1e90 0x7f4ea8120750 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.275+0000 7f4ead2bb700 1 --2- 172.21.15.154:0/3594377639 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4ea80a3190 0x7f4ea8120c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.275+0000 7f4ead2bb700 1 -- 172.21.15.154:0/3594377639 >> 172.21.15.154:0/3594377639 conn(0x7f4ea80a43d0 msgr2=0x7f4ea809e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.275+0000 7f4ead2bb700 1 -- 172.21.15.154:0/3594377639 shutdown_connections 2023-09-30T22:31:18.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.275+0000 7f4ead2bb700 1 -- 172.21.15.154:0/3594377639 wait complete. 2023-09-30T22:31:18.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T22:31:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fcd03022700 1 Processor -- start 2023-09-30T22:31:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fcd03022700 1 -- start start 2023-09-30T22:31:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fcd03022700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fccfc09d780 0x7fccfc09db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fcd03022700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc09ad70 0x7fccfc09e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fcd03022700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc09a590 con 0x7fccfc133a80 2023-09-30T22:31:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fcd03022700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc09e5d0 con 0x7fccfc09d780 2023-09-30T22:31:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fcd03022700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc06b450 con 0x7fccfc09ad70 2023-09-30T22:31:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fccfbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc09ad70 0x7fccfc09e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fcd00dbe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fccfc09d780 0x7fccfc09db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fccfbfff700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc09ad70 0x7fccfc09e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:59996/0 (socket says 172.21.15.154:59996) 2023-09-30T22:31:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.412+0000 7fccfbfff700 1 -- 172.21.15.154:0/3856287116 learned_addr learned my addr 172.21.15.154:0/3856287116 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd00dbe700 1 -- 172.21.15.154:0/3856287116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc09ad70 msgr2=0x7fccfc09e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd00dbe700 1 --2- 172.21.15.154:0/3856287116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc09ad70 0x7fccfc09e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd00dbe700 1 -- 172.21.15.154:0/3856287116 >> v1:172.21.15.154:6789/0 conn(0x7fccfc133a80 legacy=0x7fccfc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd00dbe700 1 -- 172.21.15.154:0/3856287116 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc06a9e0 con 0x7fccfc09d780 2023-09-30T22:31:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd00dbe700 1 --2- 172.21.15.154:0/3856287116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09d780 0x7fccfc09db50 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009840 tx=0x7fccf0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4feb5eac8baefd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fccfb7fe700 1 -- 172.21.15.154:0/3856287116 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0011830 con 0x7fccfc09d780 2023-09-30T22:31:18.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fccfb7fe700 1 -- 172.21.15.154:0/3856287116 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf0011990 con 0x7fccfc09d780 2023-09-30T22:31:18.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fccfb7fe700 1 -- 172.21.15.154:0/3856287116 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0011d20 con 0x7fccfc09d780 2023-09-30T22:31:18.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd03022700 1 -- 172.21.15.154:0/3856287116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09d780 msgr2=0x7fccfc09db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd03022700 1 --2- 172.21.15.154:0/3856287116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09d780 0x7fccfc09db50 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009840 tx=0x7fccf0009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:18.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd03022700 1 -- 172.21.15.154:0/3856287116 shutdown_connections 2023-09-30T22:31:18.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd03022700 1 --2- 172.21.15.154:0/3856287116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09d780 0x7fccfc09db50 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd03022700 1 --2- 172.21.15.154:0/3856287116 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc09ad70 0x7fccfc09e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd03022700 1 -- 172.21.15.154:0/3856287116 >> 172.21.15.154:0/3856287116 conn(0x7fccfc09f980 msgr2=0x7fccfc09fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd03022700 1 -- 172.21.15.154:0/3856287116 shutdown_connections 2023-09-30T22:31:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.413+0000 7fcd03022700 1 -- 172.21.15.154:0/3856287116 wait complete. 2023-09-30T22:31:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.414+0000 7fcd03022700 1 Processor -- start 2023-09-30T22:31:18.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.414+0000 7fcd03022700 1 -- start start 2023-09-30T22:31:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd03022700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09ad70 0x7fccfc1204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd03022700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccfc09d780 0x7fccfc120a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd03022700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc133a80 0x7fccfc120f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd03022700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc123c90 con 0x7fccfc09ad70 2023-09-30T22:31:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd03022700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc122680 con 0x7fccfc09d780 2023-09-30T22:31:18.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd03022700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc123340 con 0x7fccfc133a80 2023-09-30T22:31:18.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd00dbe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09ad70 0x7fccfc1204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd015bf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc133a80 0x7fccfc120f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd00dbe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09ad70 0x7fccfc1204e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52444/0 (socket says 172.21.15.154:52444) 2023-09-30T22:31:18.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fccfbfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccfc09d780 0x7fccfc120a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd015bf700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc133a80 0x7fccfc120f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60006/0 (socket says 172.21.15.154:60006) 2023-09-30T22:31:18.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd00dbe700 1 -- 172.21.15.154:0/3162165849 learned_addr learned my addr 172.21.15.154:0/3162165849 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:18.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd00dbe700 1 -- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc133a80 msgr2=0x7fccfc120f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd00dbe700 1 --2- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc133a80 0x7fccfc120f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd00dbe700 1 -- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccfc09d780 msgr2=0x7fccfc120a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd00dbe700 1 --2- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccfc09d780 0x7fccfc120a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.415+0000 7fcd00dbe700 1 -- 172.21.15.154:0/3162165849 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00094a0 con 0x7fccfc09ad70 2023-09-30T22:31:18.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.416+0000 7fcd00dbe700 1 --2- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09ad70 0x7fccfc1204e0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fccf00090b0 tx=0x7fccf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.416+0000 7fccf97fa700 1 -- 172.21.15.154:0/3162165849 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00036a0 con 0x7fccfc09ad70 2023-09-30T22:31:18.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.416+0000 7fccf97fa700 1 -- 172.21.15.154:0/3162165849 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf001f070 con 0x7fccfc09ad70 2023-09-30T22:31:18.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.416+0000 7fcd03022700 1 -- 172.21.15.154:0/3162165849 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc0a15d0 con 0x7fccfc09ad70 2023-09-30T22:31:18.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.416+0000 7fccf97fa700 1 -- 172.21.15.154:0/3162165849 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0003a60 con 0x7fccfc09ad70 2023-09-30T22:31:18.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.416+0000 7fcd03022700 1 -- 172.21.15.154:0/3162165849 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc123f70 con 0x7fccfc09ad70 2023-09-30T22:31:18.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.416+0000 7fccf97fa700 1 -- 172.21.15.154:0/3162165849 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccf0003bc0 con 0x7fccfc09ad70 2023-09-30T22:31:18.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.417+0000 7fccf97fa700 1 -- 172.21.15.154:0/3162165849 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fccf0021070 con 0x7fccfc09ad70 2023-09-30T22:31:18.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.417+0000 7fcd03022700 1 -- 172.21.15.154:0/3162165849 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccfc072080 con 0x7fccfc09ad70 2023-09-30T22:31:18.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.421+0000 7fccf97fa700 1 -- 172.21.15.154:0/3162165849 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccf0015020 con 0x7fccfc09ad70 2023-09-30T22:31:18.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.603+0000 7fcd03022700 1 -- 172.21.15.154:0/3162165849 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccfc074f10 con 0x7fccfc09ad70 2023-09-30T22:31:18.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.603+0000 7fccf97fa700 1 -- 172.21.15.154:0/3162165849 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccf001a430 con 0x7fccfc09ad70 2023-09-30T22:31:18.604 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-09-30T22:31:18.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.605+0000 7fcd03022700 1 -- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09ad70 msgr2=0x7fccfc1204e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.605+0000 7fcd03022700 1 --2- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09ad70 0x7fccfc1204e0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fccf00090b0 tx=0x7fccf0004750 comp rx=0 tx=0).stop 2023-09-30T22:31:18.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.605+0000 7fcd03022700 1 -- 172.21.15.154:0/3162165849 shutdown_connections 2023-09-30T22:31:18.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.605+0000 7fcd03022700 1 --2- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fccfc133a80 0x7fccfc120f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.605+0000 7fcd03022700 1 --2- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc09ad70 0x7fccfc1204e0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.605+0000 7fcd03022700 1 --2- 172.21.15.154:0/3162165849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccfc09d780 0x7fccfc120a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.605+0000 7fcd03022700 1 -- 172.21.15.154:0/3162165849 >> 172.21.15.154:0/3162165849 conn(0x7fccfc09f980 msgr2=0x7fccfc1bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.605+0000 7fcd03022700 1 -- 172.21.15.154:0/3162165849 shutdown_connections 2023-09-30T22:31:18.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.605+0000 7fcd03022700 1 -- 172.21.15.154:0/3162165849 wait complete. 2023-09-30T22:31:18.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T22:31:18.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.743+0000 7fd32d2d9700 1 Processor -- start 2023-09-30T22:31:18.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.743+0000 7fd32d2d9700 1 -- start start 2023-09-30T22:31:18.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.743+0000 7fd32d2d9700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3280a0ae0 0x7fd3280a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.743+0000 7fd32d2d9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd328133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.743+0000 7fd32d2d9700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32809e740 con 0x7fd328133f60 2023-09-30T22:31:18.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.743+0000 7fd32d2d9700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32809db60 con 0x7fd3280a0ae0 2023-09-30T22:31:18.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.743+0000 7fd32d2d9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32809d880 con 0x7fd3280a13f0 2023-09-30T22:31:18.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd3267fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd328133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd326ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3280a0ae0 0x7fd3280a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd3267fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd328133a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52766/0 (socket says 172.21.15.154:52766) 2023-09-30T22:31:18.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd326ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3280a0ae0 0x7fd3280a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52460/0 (socket says 172.21.15.154:52460) 2023-09-30T22:31:18.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd3267fc700 1 -- 172.21.15.154:0/4236677289 learned_addr learned my addr 172.21.15.154:0/4236677289 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:18.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd326ffd700 1 -- 172.21.15.154:0/4236677289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 msgr2=0x7fd328133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:18.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd326ffd700 1 --2- 172.21.15.154:0/4236677289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd328133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd326ffd700 1 -- 172.21.15.154:0/4236677289 >> v1:172.21.15.154:6789/0 conn(0x7fd328133f60 legacy=0x7fd32813ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd326ffd700 1 -- 172.21.15.154:0/4236677289 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280a28d0 con 0x7fd3280a0ae0 2023-09-30T22:31:18.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd325ffb700 1 -- 172.21.15.154:0/4236677289 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423685078 0 0) 0x7fd32809e740 con 0x7fd328133f60 2023-09-30T22:31:18.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd3267fc700 1 --2- 172.21.15.154:0/4236677289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd328133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd326ffd700 1 --2- 172.21.15.154:0/4236677289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3280a0ae0 0x7fd3280a0eb0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009840 tx=0x7fd31c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25b18f5ac1d9b9a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd325ffb700 1 -- 172.21.15.154:0/4236677289 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c011830 con 0x7fd3280a0ae0 2023-09-30T22:31:18.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd325ffb700 1 -- 172.21.15.154:0/4236677289 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c011990 con 0x7fd3280a0ae0 2023-09-30T22:31:18.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.744+0000 7fd325ffb700 1 -- 172.21.15.154:0/4236677289 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c011d20 con 0x7fd3280a0ae0 2023-09-30T22:31:18.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.745+0000 7fd32d2d9700 1 -- 172.21.15.154:0/4236677289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3280a0ae0 msgr2=0x7fd3280a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.745+0000 7fd32d2d9700 1 --2- 172.21.15.154:0/4236677289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3280a0ae0 0x7fd3280a0eb0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009840 tx=0x7fd31c009b50 comp rx=0 tx=0).stop 2023-09-30T22:31:18.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.745+0000 7fd32d2d9700 1 -- 172.21.15.154:0/4236677289 shutdown_connections 2023-09-30T22:31:18.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.745+0000 7fd32d2d9700 1 --2- 172.21.15.154:0/4236677289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3280a0ae0 0x7fd3280a0eb0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.745+0000 7fd32d2d9700 1 --2- 172.21.15.154:0/4236677289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd328133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.745+0000 7fd32d2d9700 1 -- 172.21.15.154:0/4236677289 >> 172.21.15.154:0/4236677289 conn(0x7fd3280a2ec0 msgr2=0x7fd3280a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.745+0000 7fd32d2d9700 1 -- 172.21.15.154:0/4236677289 shutdown_connections 2023-09-30T22:31:18.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.745+0000 7fd32d2d9700 1 -- 172.21.15.154:0/4236677289 wait complete. 2023-09-30T22:31:18.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd32d2d9700 1 Processor -- start 2023-09-30T22:31:18.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd32d2d9700 1 -- start start 2023-09-30T22:31:18.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd32d2d9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3280a0ae0 0x7fd32811f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd32d2d9700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd32811fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd32d2d9700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd328133f60 0x7fd3281c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:18.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd32d2d9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd328122430 con 0x7fd3280a0ae0 2023-09-30T22:31:18.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd32d2d9700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd328120d50 con 0x7fd3280a13f0 2023-09-30T22:31:18.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd32d2d9700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd328122610 con 0x7fd328133f60 2023-09-30T22:31:18.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd3267fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd32811fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd3277fe700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd328133f60 0x7fd3281c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd3267fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd32811fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52770/0 (socket says 172.21.15.154:52770) 2023-09-30T22:31:18.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd3267fc700 1 -- 172.21.15.154:0/1936041879 learned_addr learned my addr 172.21.15.154:0/1936041879 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:18.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.746+0000 7fd326ffd700 1 --2- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3280a0ae0 0x7fd32811f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:18.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd3277fe700 1 -- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 msgr2=0x7fd32811fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd3277fe700 1 --2- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd32811fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd3277fe700 1 -- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3280a0ae0 msgr2=0x7fd32811f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd3277fe700 1 --2- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3280a0ae0 0x7fd32811f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd3277fe700 1 -- 172.21.15.154:0/1936041879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318009550 con 0x7fd328133f60 2023-09-30T22:31:18.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd3267fc700 1 --2- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd32811fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:18.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd3277fe700 1 --2- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd328133f60 0x7fd3281c8500 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd32000c7f0 tx=0x7fd32000cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:18.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd30f7fe700 1 -- 172.21.15.154:0/1936041879 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320003e30 con 0x7fd328133f60 2023-09-30T22:31:18.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd30f7fe700 1 -- 172.21.15.154:0/1936041879 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd320005070 con 0x7fd328133f60 2023-09-30T22:31:18.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd32d2d9700 1 -- 172.21.15.154:0/1936041879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c0094a0 con 0x7fd328133f60 2023-09-30T22:31:18.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd30f7fe700 1 -- 172.21.15.154:0/1936041879 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320005420 con 0x7fd328133f60 2023-09-30T22:31:18.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.747+0000 7fd32d2d9700 1 -- 172.21.15.154:0/1936041879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32811efa0 con 0x7fd328133f60 2023-09-30T22:31:18.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.748+0000 7fd30f7fe700 1 -- 172.21.15.154:0/1936041879 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd320005580 con 0x7fd328133f60 2023-09-30T22:31:18.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.748+0000 7fd30f7fe700 1 -- 172.21.15.154:0/1936041879 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd32003ec30 con 0x7fd328133f60 2023-09-30T22:31:18.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.748+0000 7fd32d2d9700 1 -- 172.21.15.154:0/1936041879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32804f2a0 con 0x7fd328133f60 2023-09-30T22:31:18.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.753+0000 7fd30f7fe700 1 -- 172.21.15.154:0/1936041879 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd320017030 con 0x7fd328133f60 2023-09-30T22:31:18.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.937+0000 7fd32d2d9700 1 -- 172.21.15.154:0/1936041879 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd328122290 con 0x7fd328133f60 2023-09-30T22:31:18.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.938+0000 7fd30f7fe700 1 -- 172.21.15.154:0/1936041879 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd328122290 con 0x7fd328133f60 2023-09-30T22:31:18.938 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-09-30T22:31:18.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.940+0000 7fd32d2d9700 1 -- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd328133f60 msgr2=0x7fd3281c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:18.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.940+0000 7fd32d2d9700 1 --2- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd328133f60 0x7fd3281c8500 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd32000c7f0 tx=0x7fd32000cb00 comp rx=0 tx=0).stop 2023-09-30T22:31:18.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.940+0000 7fd32d2d9700 1 -- 172.21.15.154:0/1936041879 shutdown_connections 2023-09-30T22:31:18.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.940+0000 7fd32d2d9700 1 --2- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7fd328133f60 0x7fd3281c8500 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.940+0000 7fd32d2d9700 1 --2- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3280a0ae0 0x7fd32811f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.940+0000 7fd32d2d9700 1 --2- 172.21.15.154:0/1936041879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3280a13f0 0x7fd32811fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:18.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.940+0000 7fd32d2d9700 1 -- 172.21.15.154:0/1936041879 >> 172.21.15.154:0/1936041879 conn(0x7fd3280a2ec0 msgr2=0x7fd3281b9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:18.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.940+0000 7fd32d2d9700 1 -- 172.21.15.154:0/1936041879 shutdown_connections 2023-09-30T22:31:18.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:18.940+0000 7fd32d2d9700 1 -- 172.21.15.154:0/1936041879 wait complete. 2023-09-30T22:31:18.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T22:31:19.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.073+0000 7f4dc7b86700 1 Processor -- start 2023-09-30T22:31:19.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.073+0000 7f4dc7b86700 1 -- start start 2023-09-30T22:31:19.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc7b86700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4dc0131980 0x7f4dc0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc7b86700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009c790 0x7f4dc0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc7b86700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc00a1640 con 0x7f4dc009bc70 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc7b86700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc006eb30 con 0x7f4dc0131980 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc7b86700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00a22d0 con 0x7f4dc009c790 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc5922700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4dc0131980 0x7f4dc0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc6123700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009c790 0x7f4dc0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc6123700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009c790 0x7f4dc0139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60028/0 (socket says 172.21.15.154:60028) 2023-09-30T22:31:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc5922700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4dc0131980 0x7f4dc0131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52476/0 (socket says 172.21.15.154:52476) 2023-09-30T22:31:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc6123700 1 -- 172.21.15.154:0/760019451 learned_addr learned my addr 172.21.15.154:0/760019451 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc5922700 1 -- 172.21.15.154:0/760019451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009c790 msgr2=0x7f4dc0139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc5922700 1 --2- 172.21.15.154:0/760019451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009c790 0x7f4dc0139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc5922700 1 -- 172.21.15.154:0/760019451 >> v1:172.21.15.154:6789/0 conn(0x7f4dc009bc70 legacy=0x7f4dc009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc5922700 1 -- 172.21.15.154:0/760019451 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0131550 con 0x7f4dc0131980 2023-09-30T22:31:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.074+0000 7f4dc6123700 1 --2- 172.21.15.154:0/760019451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009c790 0x7f4dc0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc5922700 1 --2- 172.21.15.154:0/760019451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc0131980 0x7f4dc0131d50 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009820 tx=0x7f4db4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f80f2b1f79133e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc4920700 1 -- 172.21.15.154:0/760019451 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4005e30 con 0x7f4dc0131980 2023-09-30T22:31:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc4920700 1 -- 172.21.15.154:0/760019451 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4006030 con 0x7f4dc0131980 2023-09-30T22:31:19.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc4920700 1 -- 172.21.15.154:0/760019451 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40063c0 con 0x7f4dc0131980 2023-09-30T22:31:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc7b86700 1 -- 172.21.15.154:0/760019451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc0131980 msgr2=0x7f4dc0131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc7b86700 1 --2- 172.21.15.154:0/760019451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc0131980 0x7f4dc0131d50 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009820 tx=0x7f4db4009b30 comp rx=0 tx=0).stop 2023-09-30T22:31:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc7b86700 1 -- 172.21.15.154:0/760019451 shutdown_connections 2023-09-30T22:31:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc7b86700 1 --2- 172.21.15.154:0/760019451 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009c790 0x7f4dc0139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc7b86700 1 --2- 172.21.15.154:0/760019451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc0131980 0x7f4dc0131d50 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc7b86700 1 -- 172.21.15.154:0/760019451 >> 172.21.15.154:0/760019451 conn(0x7f4dc00a2980 msgr2=0x7f4dc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc7b86700 1 -- 172.21.15.154:0/760019451 shutdown_connections 2023-09-30T22:31:19.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.075+0000 7f4dc7b86700 1 -- 172.21.15.154:0/760019451 wait complete. 2023-09-30T22:31:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.076+0000 7f4dc7b86700 1 Processor -- start 2023-09-30T22:31:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.076+0000 7f4dc7b86700 1 -- start start 2023-09-30T22:31:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc7b86700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009bc70 0x7f4dc011ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc7b86700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc009c790 0x7f4dc011cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc7b86700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dc0131980 0x7f4dc011d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc7b86700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0130d80 con 0x7f4dc009c790 2023-09-30T22:31:19.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc7b86700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc011f3f0 con 0x7f4dc0131980 2023-09-30T22:31:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc7b86700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc011fc70 con 0x7f4dc009bc70 2023-09-30T22:31:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5922700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009bc70 0x7f4dc011ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5121700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc009c790 0x7f4dc011cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5922700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009bc70 0x7f4dc011ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3302/0 says I am v2:172.21.15.154:60032/0 (socket says 172.21.15.154:60032) 2023-09-30T22:31:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5121700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc009c790 0x7f4dc011cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52488/0 (socket says 172.21.15.154:52488) 2023-09-30T22:31:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5922700 1 -- 172.21.15.154:0/3369128595 learned_addr learned my addr 172.21.15.154:0/3369128595 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc6123700 1 --2- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dc0131980 0x7f4dc011d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:19.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5922700 1 -- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dc0131980 msgr2=0x7f4dc011d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5922700 1 --2- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dc0131980 0x7f4dc011d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5922700 1 -- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc009c790 msgr2=0x7f4dc011cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5922700 1 --2- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc009c790 0x7f4dc011cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5922700 1 -- 172.21.15.154:0/3369128595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009b30 con 0x7f4dc009bc70 2023-09-30T22:31:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5121700 1 --2- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc009c790 0x7f4dc011cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc5922700 1 --2- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009bc70 0x7f4dc011ca10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4db4000c00 tx=0x7f4db4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:19.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4db27fc700 1 -- 172.21.15.154:0/3369128595 <== mon.2 v2:172.21.15.154:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4004240 con 0x7f4dc009bc70 2023-09-30T22:31:19.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4db27fc700 1 -- 172.21.15.154:0/3369128595 <== mon.2 v2:172.21.15.154:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40043a0 con 0x7f4dc009bc70 2023-09-30T22:31:19.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4dc7b86700 1 -- 172.21.15.154:0/3369128595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db4009430 con 0x7f4dc009bc70 2023-09-30T22:31:19.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.077+0000 7f4db27fc700 1 -- 172.21.15.154:0/3369128595 <== mon.2 v2:172.21.15.154:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4006950 con 0x7f4dc009bc70 2023-09-30T22:31:19.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.078+0000 7f4dc7b86700 1 -- 172.21.15.154:0/3369128595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc0120580 con 0x7f4dc009bc70 2023-09-30T22:31:19.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.078+0000 7f4dc7b86700 1 -- 172.21.15.154:0/3369128595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc004f2a0 con 0x7f4dc009bc70 2023-09-30T22:31:19.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.079+0000 7f4db27fc700 1 -- 172.21.15.154:0/3369128595 <== mon.2 v2:172.21.15.154:3302/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4db4022070 con 0x7f4dc009bc70 2023-09-30T22:31:19.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.079+0000 7f4db27fc700 1 -- 172.21.15.154:0/3369128595 <== mon.2 v2:172.21.15.154:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4db4041060 con 0x7f4dc009bc70 2023-09-30T22:31:19.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.083+0000 7f4db27fc700 1 -- 172.21.15.154:0/3369128595 <== mon.2 v2:172.21.15.154:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4db40036a0 con 0x7f4dc009bc70 2023-09-30T22:31:19.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.280+0000 7f4dc7b86700 1 -- 172.21.15.154:0/3369128595 --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4dc006bce0 con 0x7f4dc009bc70 2023-09-30T22:31:19.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.280+0000 7f4db27fc700 1 -- 172.21.15.154:0/3369128595 <== mon.2 v2:172.21.15.154:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v40) v1 ==== 81+0+648 (secure 0 0 0) 0x7f4db402a2a0 con 0x7f4dc009bc70 2023-09-30T22:31:19.280 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/2961105614 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/2771224894 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/3517579577 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6816/118163 2023-10-01T22:21:47.164906+0000 2023-09-30T22:31:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/2273151012 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/956756939 2023-10-01T22:21:47.164906+0000 2023-09-30T22:31:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6816/126757 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/722774886 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:19.282 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/3939851609 2023-10-01T22:22:46.872089+0000 2023-09-30T22:31:19.282 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:0/2017971531 2023-10-01T22:21:47.164906+0000 2023-09-30T22:31:19.282 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6817/2576993373 2023-10-01T22:22:14.893865+0000 2023-09-30T22:31:19.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.282+0000 7f4dc7b86700 1 -- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009bc70 msgr2=0x7f4dc011ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:19.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.282+0000 7f4dc7b86700 1 --2- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009bc70 0x7f4dc011ca10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4db4000c00 tx=0x7f4db4004750 comp rx=0 tx=0).stop 2023-09-30T22:31:19.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.282+0000 7f4dc7b86700 1 -- 172.21.15.154:0/3369128595 shutdown_connections 2023-09-30T22:31:19.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.282+0000 7f4dc7b86700 1 --2- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4dc0131980 0x7f4dc011d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.282+0000 7f4dc7b86700 1 --2- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f4dc009bc70 0x7f4dc011ca10 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.282+0000 7f4dc7b86700 1 --2- 172.21.15.154:0/3369128595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dc009c790 0x7f4dc011cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:19.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.282+0000 7f4dc7b86700 1 -- 172.21.15.154:0/3369128595 >> 172.21.15.154:0/3369128595 conn(0x7f4dc00a2980 msgr2=0x7f4dc0070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:19.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.283+0000 7f4dc7b86700 1 -- 172.21.15.154:0/3369128595 shutdown_connections 2023-09-30T22:31:19.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:19.283+0000 7f4dc7b86700 1 -- 172.21.15.154:0/3369128595 wait complete. 2023-09-30T22:31:19.284 INFO:teuthology.orchestra.run.smithi154.stderr:listed 11 entries 2023-09-30T22:31:19.295 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi163.front.sepia.ceph.com... 2023-09-30T22:31:19.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:31:19.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-30T22:31:19.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:ceph-fuse[112279]: fuse finished with error 0 and tester_r 0 2023-09-30T22:31:19.340 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:31:25.442 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2023-09-30T22:31:25.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:31:25.443 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T22:31:25.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:31:25.482 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-09-30T22:31:25.544 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T22:31:25.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:31:25.545 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T22:31:25.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T22:31:25.636 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2023-09-30T22:31:25.713 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-30T22:31:25.726 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T22:31:25.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T22:31:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.862+0000 7f5f4d777700 1 Processor -- start 2023-09-30T22:31:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.862+0000 7f5f4d777700 1 -- start start 2023-09-30T22:31:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.862+0000 7f5f4d777700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48067c10 0x7f5f48133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.862+0000 7f5f4d777700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f48133fa0 0x7f5f480a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.862+0000 7f5f4d777700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4809a360 con 0x7f5f481343d0 2023-09-30T22:31:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.862+0000 7f5f4d777700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f48067fe0 con 0x7f5f48133fa0 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.862+0000 7f5f4d777700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4809a880 con 0x7f5f48067c10 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f46ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48067c10 0x7f5f48133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f467fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f48133fa0 0x7f5f480a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f46ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48067c10 0x7f5f48133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44452/0 (socket says 172.21.15.154:44452) 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f46ffd700 1 -- 172.21.15.154:0/3288974628 learned_addr learned my addr 172.21.15.154:0/3288974628 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f46ffd700 1 -- 172.21.15.154:0/3288974628 >> v2:172.21.15.154:3300/0 conn(0x7f5f48133fa0 msgr2=0x7f5f480a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T22:31:25.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/3288974628 >> v2:172.21.15.154:3300/0 conn(0x7f5f48133fa0 0x7f5f480a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f46ffd700 1 -- 172.21.15.154:0/3288974628 >> v1:172.21.15.154:6789/0 conn(0x7f5f481343d0 legacy=0x7f5f480a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f46ffd700 1 -- 172.21.15.154:0/3288974628 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48099e00 con 0x7f5f48067c10 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f467fc700 1 --2- 172.21.15.154:0/3288974628 >> v2:172.21.15.154:3300/0 conn(0x7f5f48133fa0 0x7f5f480a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/3288974628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48067c10 0x7f5f48133a60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0098f0 tx=0x7f5f3c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42f867fbf9054e23 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f45ffb700 1 -- 172.21.15.154:0/3288974628 <== mon.1 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c011830 con 0x7f5f48067c10 2023-09-30T22:31:25.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f45ffb700 1 -- 172.21.15.154:0/3288974628 <== mon.1 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c011990 con 0x7f5f48067c10 2023-09-30T22:31:25.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.863+0000 7f5f45ffb700 1 -- 172.21.15.154:0/3288974628 <== mon.1 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c011d20 con 0x7f5f48067c10 2023-09-30T22:31:25.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.864+0000 7f5f4d777700 1 -- 172.21.15.154:0/3288974628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48067c10 msgr2=0x7f5f48133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.864+0000 7f5f4d777700 1 --2- 172.21.15.154:0/3288974628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48067c10 0x7f5f48133a60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0098f0 tx=0x7f5f3c009c00 comp rx=0 tx=0).stop 2023-09-30T22:31:25.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.864+0000 7f5f4d777700 1 -- 172.21.15.154:0/3288974628 shutdown_connections 2023-09-30T22:31:25.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.864+0000 7f5f4d777700 1 --2- 172.21.15.154:0/3288974628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48067c10 0x7f5f48133a60 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.864+0000 7f5f4d777700 1 --2- 172.21.15.154:0/3288974628 >> v2:172.21.15.154:3300/0 conn(0x7f5f48133fa0 0x7f5f480a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.864+0000 7f5f4d777700 1 -- 172.21.15.154:0/3288974628 >> 172.21.15.154:0/3288974628 conn(0x7f5f480a2980 msgr2=0x7f5f480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T22:31:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.864+0000 7f5f4d777700 1 -- 172.21.15.154:0/3288974628 shutdown_connections 2023-09-30T22:31:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.864+0000 7f5f4d777700 1 -- 172.21.15.154:0/3288974628 wait complete. 2023-09-30T22:31:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f4d777700 1 Processor -- start 2023-09-30T22:31:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f4d777700 1 -- start start 2023-09-30T22:31:25.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f4d777700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f48067c10 0x7f5f4811c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f4d777700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48133fa0 0x7f5f4811cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f4d777700 1 --2- >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481343d0 0x7f5f4811d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T22:31:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f4d777700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4811e660 con 0x7f5f48067c10 2023-09-30T22:31:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f4d777700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4811e470 con 0x7f5f48133fa0 2023-09-30T22:31:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f4d777700 1 -- --> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4811f310 con 0x7f5f481343d0 2023-09-30T22:31:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f46ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f48067c10 0x7f5f4811c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.865+0000 7f5f467fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48133fa0 0x7f5f4811cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f46ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f48067c10 0x7f5f4811c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53450/0 (socket says 172.21.15.154:53450) 2023-09-30T22:31:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f46ffd700 1 -- 172.21.15.154:0/4230583400 learned_addr learned my addr 172.21.15.154:0/4230583400 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-09-30T22:31:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f467fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48133fa0 0x7f5f4811cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:44458/0 (socket says 172.21.15.154:44458) 2023-09-30T22:31:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f477fe700 1 --2- 172.21.15.154:0/4230583400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481343d0 0x7f5f4811d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T22:31:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f46ffd700 1 -- 172.21.15.154:0/4230583400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481343d0 msgr2=0x7f5f4811d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/4230583400 >> [v2:172.21.15.154:3302/0,v1:172.21.15.154:6791/0] conn(0x7f5f481343d0 0x7f5f4811d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f46ffd700 1 -- 172.21.15.154:0/4230583400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48133fa0 msgr2=0x7f5f4811cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T22:31:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/4230583400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48133fa0 0x7f5f4811cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T22:31:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f46ffd700 1 -- 172.21.15.154:0/4230583400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380094a0 con 0x7f5f48067c10 2023-09-30T22:31:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f467fc700 1 --2- 172.21.15.154:0/4230583400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f48133fa0 0x7f5f4811cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T22:31:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f46ffd700 1 --2- 172.21.15.154:0/4230583400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f48067c10 0x7f5f4811c860 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c014040 tx=0x7f5f3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T22:31:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/4230583400 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c004510 con 0x7f5f48067c10 2023-09-30T22:31:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/4230583400 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c01e070 con 0x7f5f48067c10 2023-09-30T22:31:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f4d777700 1 -- 172.21.15.154:0/4230583400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c009550 con 0x7f5f48067c10 2023-09-30T22:31:25.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/4230583400 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0038e0 con 0x7f5f48067c10 2023-09-30T22:31:25.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.866+0000 7f5f4d777700 1 -- 172.21.15.154:0/4230583400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f48133160 con 0x7f5f48067c10 2023-09-30T22:31:25.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.867+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/4230583400 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 11) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f3c003a40 con 0x7f5f48067c10 2023-09-30T22:31:25.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.867+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/4230583400 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f3c040590 con 0x7f5f48067c10 2023-09-30T22:31:25.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.867+0000 7f5f4d777700 1 -- 172.21.15.154:0/4230583400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4804f2a0 con 0x7f5f48067c10 2023-09-30T22:31:25.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-09-30T22:31:25.872+0000 7f5f2f7fe700 1 -- 172.21.15.154:0/4230583400 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f3c015070 con 0x7f5f48067c10 2023-09-30T22:33:25.766 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-09-30T22:33:25.767 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:33:25.776 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-30T22:33:25.777 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T22:33:25.777 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:33:25.795 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T22:33:25.795 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-30T22:33:25.795 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T22:33:25.795 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:33:25.866 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T22:33:25.866 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T22:33:25.867 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:33:25.933 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T22:33:25.934 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T22:33:25.934 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:33:26.003 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T22:33:26.003 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T22:33:26.003 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:33:26.073 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T22:33:26.073 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-30T22:33:26.073 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T22:33:26.074 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:33:26.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:33:26.074 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-09-30T22:33:26.091 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T22:33:26.091 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-30T22:33:26.091 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T22:33:26.091 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:33:26.125 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T22:33:26.126 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T22:33:26.126 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:33:26.178 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T22:33:26.179 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T22:33:26.179 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T22:33:26.231 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T22:33:26.232 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-30T22:33:26.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-09-30T22:33:26.315 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:33:26.315 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-30T22:33:26.521 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:33:26.521 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-30T22:33:26.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:33:26.617 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-30T22:33:26.672 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:33:26.672 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-30T22:33:26.776 INFO:tasks.ceph:Archiving mon data... 2023-09-30T22:33:26.777 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/data/mon.a.tgz 2023-09-30T22:33:26.777 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-09-30T22:33:26.795 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.8x48ysMHC3 2023-09-30T22:33:26.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8x48ysMHC3 2023-09-30T22:33:26.927 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.8x48ysMHC3 2023-09-30T22:33:27.016 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.8x48ysMHC3 is 322KB 2023-09-30T22:33:27.112 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.8x48ysMHC3 2023-09-30T22:33:27.130 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/data/mon.b.tgz 2023-09-30T22:33:27.130 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-09-30T22:33:27.186 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.nII7aZMTz8 2023-09-30T22:33:27.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.nII7aZMTz8 2023-09-30T22:33:27.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.nII7aZMTz8 2023-09-30T22:33:27.400 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.nII7aZMTz8 is 323KB 2023-09-30T22:33:27.495 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.nII7aZMTz8 2023-09-30T22:33:27.513 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/data/mon.c.tgz 2023-09-30T22:33:27.514 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-09-30T22:33:27.570 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.iXGU5gPYhW 2023-09-30T22:33:27.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iXGU5gPYhW 2023-09-30T22:33:27.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.iXGU5gPYhW 2023-09-30T22:33:27.784 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.iXGU5gPYhW is 323KB 2023-09-30T22:33:27.879 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.iXGU5gPYhW 2023-09-30T22:33:27.897 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-30T22:33:27.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T22:33:27.939 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T22:33:27.975 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-30T22:33:27.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T22:33:28.006 DEBUG:teuthology.orchestra.run.smithi163:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T22:33:28.032 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T22:33:28.047 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T22:33:28.054 INFO:tasks.ceph:Archiving crash dumps... 2023-09-30T22:33:28.055 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/remote/smithi154/crash 2023-09-30T22:33:28.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T22:33:28.105 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/remote/smithi163/crash 2023-09-30T22:33:28.106 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T22:33:28.156 INFO:tasks.ceph:Compressing logs... 2023-09-30T22:33:28.156 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T22:33:28.159 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T22:33:28.191 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112279.log 2023-09-30T22:33:28.198 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.0.112279.log: 96.6% -- replaced with /var/log/ceph/ceph-client.0.112279.log.gz 2023-09-30T22:33:28.198 INFO:teuthology.orchestra.run.smithi163.stderr: 2023-09-30T22:33:28.199 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m0.019s 2023-09-30T22:33:28.199 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m0.017s 2023-09-30T22:33:28.199 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m0.010s 2023-09-30T22:33:28.403 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192524.log 2023-09-30T22:33:28.404 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141173.log 2023-09-30T22:33:28.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137469.log 2023-09-30T22:33:28.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141173.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192524.log.gz 2023-09-30T22:33:28.404 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177002.log 2023-09-30T22:33:28.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145257.log 2023-09-30T22:33:28.405 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141173.log.gz 2023-09-30T22:33:28.405 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137469.log.gz 2023-09-30T22:33:28.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158654.log 2023-09-30T22:33:28.405 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177002.log.gz 2023-09-30T22:33:28.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122506.log 2023-09-30T22:33:28.405 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155273.log 2023-09-30T22:33:28.405 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145257.log.gz 2023-09-30T22:33:28.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122506.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158654.log.gz 2023-09-30T22:33:28.406 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178124.log 2023-09-30T22:33:28.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155273.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122506.log.gz 2023-09-30T22:33:28.406 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154954.log 2023-09-30T22:33:28.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178124.log: 89.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.155273.log.gz--verbose 2023-09-30T22:33:28.406 INFO:teuthology.orchestra.run.smithi154.stderr:-- /var/log/ceph/ceph-client.admin.189215.log 2023-09-30T22:33:28.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154954.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178124.log.gz 2023-09-30T22:33:28.407 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124774.log 2023-09-30T22:33:28.407 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154954.log.gz 2023-09-30T22:33:28.407 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138938.log 2023-09-30T22:33:28.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189215.log: /var/log/ceph/ceph-client.admin.124774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124162.log 2023-09-30T22:33:28.407 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189215.log.gz 2023-09-30T22:33:28.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148160.log 2023-09-30T22:33:28.408 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124774.log.gz 2023-09-30T22:33:28.408 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138938.log.gz 2023-09-30T22:33:28.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173880.log 2023-09-30T22:33:28.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148160.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124162.log.gz 2023-09-30T22:33:28.408 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189756.log 2023-09-30T22:33:28.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173880.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148160.log.gz 2023-09-30T22:33:28.408 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149019.log 2023-09-30T22:33:28.408 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.173880.log.gz 2023-09-30T22:33:28.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129273.log 2023-09-30T22:33:28.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149019.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189756.log.gz 2023-09-30T22:33:28.409 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136656.log 2023-09-30T22:33:28.409 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7%/var/log/ceph/ceph-client.admin.129273.log: -- replaced with /var/log/ceph/ceph-client.admin.149019.log.gz 2023-09-30T22:33:28.409 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127838.log 2023-09-30T22:33:28.409 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129273.log.gz 2023-09-30T22:33:28.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124872.log 2023-09-30T22:33:28.409 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136656.log.gz 2023-09-30T22:33:28.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162601.log 2023-09-30T22:33:28.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124872.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127838.log.gz 2023-09-30T22:33:28.410 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169834.log 2023-09-30T22:33:28.410 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124872.log.gz 2023-09-30T22:33:28.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186827.log 2023-09-30T22:33:28.410 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169834.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162601.log.gz 2023-09-30T22:33:28.410 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147647.log 2023-09-30T22:33:28.410 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9%/var/log/ceph/ceph-client.admin.186827.log: -- replaced with /var/log/ceph/ceph-client.admin.169834.log.gz 2023-09-30T22:33:28.411 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144134.log 2023-09-30T22:33:28.411 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.186827.log.gz 2023-09-30T22:33:28.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138350.log 2023-09-30T22:33:28.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144134.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147647.log.gz 2023-09-30T22:33:28.411 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179745.log 2023-09-30T22:33:28.411 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144134.log.gz 2023-09-30T22:33:28.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125629.log 2023-09-30T22:33:28.412 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138350.log.gz 2023-09-30T22:33:28.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179643.log 2023-09-30T22:33:28.412 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179745.log.gz 2023-09-30T22:33:28.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165130.log 2023-09-30T22:33:28.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179643.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125629.log.gz 2023-09-30T22:33:28.412 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137836.log 2023-09-30T22:33:28.412 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179643.log.gz 2023-09-30T22:33:28.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172025.log 2023-09-30T22:33:28.413 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.165130.log.gz 2023-09-30T22:33:28.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149973.log 2023-09-30T22:33:28.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172025.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137836.log.gz 2023-09-30T22:33:28.413 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144473.log 2023-09-30T22:33:28.413 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172025.log.gz 2023-09-30T22:33:28.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162013.log 2023-09-30T22:33:28.413 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.149973.log.gz 2023-09-30T22:33:28.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192498.log 2023-09-30T22:33:28.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162013.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.144473.log.gz 2023-09-30T22:33:28.414 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146910.log 2023-09-30T22:33:28.414 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162013.log.gz 2023-09-30T22:33:28.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190561.log 2023-09-30T22:33:28.414 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.192498.log.gz 2023-09-30T22:33:28.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187148.log 2023-09-30T22:33:28.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190561.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146910.log.gz 2023-09-30T22:33:28.414 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146837.log 2023-09-30T22:33:28.415 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190561.log.gz 2023-09-30T22:33:28.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176506.log 2023-09-30T22:33:28.415 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.187148.log.gz 2023-09-30T22:33:28.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195802.log 2023-09-30T22:33:28.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176506.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.146837.log.gz 2023-09-30T22:33:28.415 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163835.log 2023-09-30T22:33:28.415 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176506.log.gz 2023-09-30T22:33:28.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159046.log 2023-09-30T22:33:28.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163835.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.195802.log.gz 2023-09-30T22:33:28.416 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193823.log 2023-09-30T22:33:28.416 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163835.log.gz 2023-09-30T22:33:28.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180706.log 2023-09-30T22:33:28.416 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159046.log.gz 2023-09-30T22:33:28.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141486.log 2023-09-30T22:33:28.416 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193823.log.gz 2023-09-30T22:33:28.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150025.log 2023-09-30T22:33:28.417 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180706.log.gz 2023-09-30T22:33:28.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154162.log 2023-09-30T22:33:28.417 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141486.log.gz 2023-09-30T22:33:28.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181689.log 2023-09-30T22:33:28.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154162.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150025.log.gz 2023-09-30T22:33:28.417 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185478.log 2023-09-30T22:33:28.417 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181689.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154162.log.gz 2023-09-30T22:33:28.417 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151737.log 2023-09-30T22:33:28.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159857.log 2023-09-30T22:33:28.418 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181689.log.gz 2023-09-30T22:33:28.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151737.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185478.log.gz 2023-09-30T22:33:28.418 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142931.log 2023-09-30T22:33:28.418 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151737.log.gz 2023-09-30T22:33:28.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172586.log 2023-09-30T22:33:28.418 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5%/var/log/ceph/ceph-client.admin.142931.log: -- replaced with /var/log/ceph/ceph-client.admin.159857.log.gz 2023-09-30T22:33:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172194.log 2023-09-30T22:33:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180753.log 2023-09-30T22:33:28.419 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142931.log.gz 2023-09-30T22:33:28.419 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172586.log.gz 2023-09-30T22:33:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160687.log 2023-09-30T22:33:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180753.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172194.log.gz 2023-09-30T22:33:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156694.log 2023-09-30T22:33:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160687.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180753.log.gz 2023-09-30T22:33:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185700.log 2023-09-30T22:33:28.420 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160687.log.gz 2023-09-30T22:33:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127398.log 2023-09-30T22:33:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185700.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156694.log.gz 2023-09-30T22:33:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183569.log 2023-09-30T22:33:28.420 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185700.log.gz 2023-09-30T22:33:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168906.log 2023-09-30T22:33:28.420 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127398.log.gz 2023-09-30T22:33:28.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140950.log 2023-09-30T22:33:28.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168906.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183569.log.gz 2023-09-30T22:33:28.421 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154392.log 2023-09-30T22:33:28.421 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168906.log.gz 2023-09-30T22:33:28.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161714.log 2023-09-30T22:33:28.421 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140950.log.gz 2023-09-30T22:33:28.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168854.log 2023-09-30T22:33:28.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161714.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154392.log.gz 2023-09-30T22:33:28.421 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181500.log 2023-09-30T22:33:28.422 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161714.log.gz 2023-09-30T22:33:28.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186066.log 2023-09-30T22:33:28.422 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168854.log.gz 2023-09-30T22:33:28.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189508.log 2023-09-30T22:33:28.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186066.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181500.log.gz 2023-09-30T22:33:28.422 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165326.log 2023-09-30T22:33:28.422 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186066.log.gz 2023-09-30T22:33:28.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166110.log 2023-09-30T22:33:28.423 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189508.log.gz 2023-09-30T22:33:28.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149777.log 2023-09-30T22:33:28.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166110.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165326.log.gz 2023-09-30T22:33:28.423 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143323.log 2023-09-30T22:33:28.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149777.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166110.log.gz 2023-09-30T22:33:28.423 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146863.log 2023-09-30T22:33:28.423 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149777.log.gz 2023-09-30T22:33:28.424 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125166.log 2023-09-30T22:33:28.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143323.log: /var/log/ceph/ceph-client.admin.146863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182248.log 2023-09-30T22:33:28.424 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143323.log.gz 2023-09-30T22:33:28.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182052.log 2023-09-30T22:33:28.424 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146863.log.gz 2023-09-30T22:33:28.424 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141094.log 2023-09-30T22:33:28.424 INFO:teuthology.orchestra.run.smithi154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125166.log.gz 2023-09-30T22:33:28.424 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182248.log.gz 2023-09-30T22:33:28.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193161.log 2023-09-30T22:33:28.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141094.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.182052.log.gz 2023-09-30T22:33:28.425 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159242.log 2023-09-30T22:33:28.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193161.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.141094.log.gz 2023-09-30T22:33:28.425 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181145.log 2023-09-30T22:33:28.425 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193161.log.gz 2023-09-30T22:33:28.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169468.log 2023-09-30T22:33:28.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181145.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159242.log.gz 2023-09-30T22:33:28.426 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125776.log 2023-09-30T22:33:28.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169468.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181145.log.gz 2023-09-30T22:33:28.426 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163392.log 2023-09-30T22:33:28.426 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169468.log.gz 2023-09-30T22:33:28.426 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173465.log 2023-09-30T22:33:28.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125776.log: /var/log/ceph/ceph-client.admin.163392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181415.log 2023-09-30T22:33:28.426 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125776.log.gz 2023-09-30T22:33:28.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173465.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163392.log.gzgzip -5 2023-09-30T22:33:28.427 INFO:teuthology.orchestra.run.smithi154.stderr:--verbose -- /var/log/ceph/ceph-client.admin.125117.log 2023-09-30T22:33:28.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181415.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173465.log.gz 2023-09-30T22:33:28.427 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170302.log 2023-09-30T22:33:28.427 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181415.log.gz 2023-09-30T22:33:28.427 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140114.log 2023-09-30T22:33:28.427 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125117.log: /var/log/ceph/ceph-client.admin.170302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164032.log 2023-09-30T22:33:28.427 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125117.log.gz 2023-09-30T22:33:28.427 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170302.log.gz 2023-09-30T22:33:28.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156937.log 2023-09-30T22:33:28.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164032.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140114.log.gz 2023-09-30T22:33:28.428 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145928.log 2023-09-30T22:33:28.428 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164032.log.gz 2023-09-30T22:33:28.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144818.log 2023-09-30T22:33:28.428 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156937.log.gz 2023-09-30T22:33:28.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176310.log 2023-09-30T22:33:28.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144818.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145928.log.gz 2023-09-30T22:33:28.429 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169885.log 2023-09-30T22:33:28.429 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144818.log.gz 2023-09-30T22:33:28.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149828.log 2023-09-30T22:33:28.429 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.176310.log.gz 2023-09-30T22:33:28.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173762.log 2023-09-30T22:33:28.429 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169885.log.gz 2023-09-30T22:33:28.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187248.log 2023-09-30T22:33:28.429 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.149828.log.gz 2023-09-30T22:33:28.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187762.log 2023-09-30T22:33:28.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187248.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173762.log.gz 2023-09-30T22:33:28.430 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167166.log 2023-09-30T22:33:28.430 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187248.log.gz 2023-09-30T22:33:28.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171232.log 2023-09-30T22:33:28.430 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187762.log.gz 2023-09-30T22:33:28.430 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163170.log 2023-09-30T22:33:28.430 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167166.log.gz 2023-09-30T22:33:28.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166384.log 2023-09-30T22:33:28.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163170.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171232.log.gz 2023-09-30T22:33:28.431 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195390.log 2023-09-30T22:33:28.431 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163170.log.gz 2023-09-30T22:33:28.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154981.log 2023-09-30T22:33:28.431 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195390.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166384.log.gz 2023-09-30T22:33:28.431 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151397.log 2023-09-30T22:33:28.431 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.195390.log.gz 2023-09-30T22:33:28.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149189.log 2023-09-30T22:33:28.432 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154981.log.gz 2023-09-30T22:33:28.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155983.log 2023-09-30T22:33:28.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149189.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151397.log.gz 2023-09-30T22:33:28.432 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170422.log 2023-09-30T22:33:28.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155983.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149189.log.gz 2023-09-30T22:33:28.432 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123304.log 2023-09-30T22:33:28.432 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155983.log.gz 2023-09-30T22:33:28.433 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160073.log 2023-09-30T22:33:28.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170422.log: /var/log/ceph/ceph-client.admin.123304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145855.log 2023-09-30T22:33:28.433 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.170422.log.gz 2023-09-30T22:33:28.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164568.log 2023-09-30T22:33:28.433 INFO:teuthology.orchestra.run.smithi154.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.123304.log.gz 2023-09-30T22:33:28.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145855.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160073.log.gz 2023-09-30T22:33:28.433 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118759.log 2023-09-30T22:33:28.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164568.log: gzip 88.7%-5 --verbose -- /var/log/ceph/ceph-client.admin.167678.log -- replaced with /var/log/ceph/ceph-client.admin.145855.log.gz 2023-09-30T22:33:28.434 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-09-30T22:33:28.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118759.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164568.log.gz 2023-09-30T22:33:28.434 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194902.log 2023-09-30T22:33:28.434 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118759.log.gz 2023-09-30T22:33:28.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184255.log 2023-09-30T22:33:28.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194902.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167678.log.gz 2023-09-30T22:33:28.434 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158509.log 2023-09-30T22:33:28.435 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194902.log.gz 2023-09-30T22:33:28.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125384.log 2023-09-30T22:33:28.435 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.184255.log.gz 2023-09-30T22:33:28.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190757.log 2023-09-30T22:33:28.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125384.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.158509.log.gz 2023-09-30T22:33:28.435 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187958.log 2023-09-30T22:33:28.435 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125384.log.gz 2023-09-30T22:33:28.435 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122800.log 2023-09-30T22:33:28.436 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.190757.log.gz 2023-09-30T22:33:28.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172390.log 2023-09-30T22:33:28.436 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187958.log.gz 2023-09-30T22:33:28.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193872.log 2023-09-30T22:33:28.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167952.log 2023-09-30T22:33:28.436 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122800.log.gz 2023-09-30T22:33:28.436 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172390.log.gz 2023-09-30T22:33:28.436 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174350.log 2023-09-30T22:33:28.437 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193872.log.gz 2023-09-30T22:33:28.437 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192157.log 2023-09-30T22:33:28.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167952.log: /var/log/ceph/ceph-client.admin.174350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193113.log 2023-09-30T22:33:28.437 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167952.log.gz 2023-09-30T22:33:28.437 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174350.log.gz 2023-09-30T22:33:28.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172978.log 2023-09-30T22:33:28.437 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.192157.log.gz 2023-09-30T22:33:28.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123451.log 2023-09-30T22:33:28.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172978.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.193113.log.gz 2023-09-30T22:33:28.438 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156645.log 2023-09-30T22:33:28.438 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172978.log.gz 2023-09-30T22:33:28.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153501.log 2023-09-30T22:33:28.438 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123451.log.gz 2023-09-30T22:33:28.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155469.log 2023-09-30T22:33:28.438 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.156645.log.gz 2023-09-30T22:33:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173269.log 2023-09-30T22:33:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155469.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153501.log.gz 2023-09-30T22:33:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169076.log 2023-09-30T22:33:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173269.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155469.log.gz 2023-09-30T22:33:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178962.log 2023-09-30T22:33:28.439 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173269.log.gz 2023-09-30T22:33:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169690.log 2023-09-30T22:33:28.439 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169076.log: /var/log/ceph/ceph-client.admin.178962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128207.log 2023-09-30T22:33:28.440 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169076.log.gz 2023-09-30T22:33:28.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169690.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.178962.log.gz 2023-09-30T22:33:28.440 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168344.log 2023-09-30T22:33:28.440 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169690.log.gz 2023-09-30T22:33:28.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186242.log 2023-09-30T22:33:28.440 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128207.log.gz 2023-09-30T22:33:28.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136460.log 2023-09-30T22:33:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186242.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168344.log.gz 2023-09-30T22:33:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158066.log 2023-09-30T22:33:28.441 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.186242.log.gz 2023-09-30T22:33:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155766.log 2023-09-30T22:33:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158066.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136460.log.gz 2023-09-30T22:33:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180902.log 2023-09-30T22:33:28.441 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158066.log.gz 2023-09-30T22:33:28.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154685.log 2023-09-30T22:33:28.442 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155766.log.gz 2023-09-30T22:33:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149633.log 2023-09-30T22:33:28.442 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180902.log.gz 2023-09-30T22:33:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124018.log 2023-09-30T22:33:28.442 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154685.log.gz 2023-09-30T22:33:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150312.log 2023-09-30T22:33:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124018.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149633.log.gz 2023-09-30T22:33:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191910.log 2023-09-30T22:33:28.443 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124018.log.gz 2023-09-30T22:33:28.445 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140898.log 2023-09-30T22:33:28.445 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191910.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150312.log.gz 2023-09-30T22:33:28.445 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194141.log 2023-09-30T22:33:28.445 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.191910.log.gz 2023-09-30T22:33:28.445 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153425.log 2023-09-30T22:33:28.446 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140898.log.gz 2023-09-30T22:33:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148748.log 2023-09-30T22:33:28.446 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194141.log.gz 2023-09-30T22:33:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138593.log 2023-09-30T22:33:28.446 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153425.log.gz 2023-09-30T22:33:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142466.log 2023-09-30T22:33:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138593.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148748.log.gz 2023-09-30T22:33:28.446 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163290.log 2023-09-30T22:33:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142466.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138593.log.gz 2023-09-30T22:33:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178150.log 2023-09-30T22:33:28.447 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142466.log.gz 2023-09-30T22:33:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188724.log 2023-09-30T22:33:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163290.log: /var/log/ceph/ceph-client.admin.178150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160269.log 2023-09-30T22:33:28.447 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163290.log.gz 2023-09-30T22:33:28.447 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178150.log.gz 2023-09-30T22:33:28.447 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148850.log 2023-09-30T22:33:28.448 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188724.log.gz 2023-09-30T22:33:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150757.log 2023-09-30T22:33:28.448 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160269.log.gz 2023-09-30T22:33:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145406.log 2023-09-30T22:33:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150757.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148850.log.gz 2023-09-30T22:33:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158139.log 2023-09-30T22:33:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145406.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150757.log.gz 2023-09-30T22:33:28.448 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153697.log 2023-09-30T22:33:28.449 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.145406.log.gz 2023-09-30T22:33:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184547.log 2023-09-30T22:33:28.449 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158139.log.gz 2023-09-30T22:33:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128411.log 2023-09-30T22:33:28.449 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153697.log.gz 2023-09-30T22:33:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149437.log 2023-09-30T22:33:28.449 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.184547.log.gz/var/log/ceph/ceph-client.admin.128411.log: 2023-09-30T22:33:28.449 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166136.log 2023-09-30T22:33:28.450 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128411.log.gz 2023-09-30T22:33:28.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193039.log 2023-09-30T22:33:28.450 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149437.log.gz 2023-09-30T22:33:28.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160418.log 2023-09-30T22:33:28.450 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193039.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166136.log.gz 2023-09-30T22:33:28.450 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126891.log 2023-09-30T22:33:28.450 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193039.log.gz 2023-09-30T22:33:28.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158706.log 2023-09-30T22:33:28.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126891.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.160418.log.gz 2023-09-30T22:33:28.451 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129175.log 2023-09-30T22:33:28.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158706.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126891.log.gz 2023-09-30T22:33:28.451 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140702.log 2023-09-30T22:33:28.451 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158706.log.gz 2023-09-30T22:33:28.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142125.log 2023-09-30T22:33:28.451 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140702.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.129175.log.gz 2023-09-30T22:33:28.452 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186364.log 2023-09-30T22:33:28.452 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140702.log.gz 2023-09-30T22:33:28.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139599.log 2023-09-30T22:33:28.452 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142125.log.gz 2023-09-30T22:33:28.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167559.log 2023-09-30T22:33:28.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139599.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186364.log.gz 2023-09-30T22:33:28.452 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185214.log 2023-09-30T22:33:28.452 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139599.log.gz 2023-09-30T22:33:28.452 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192767.log 2023-09-30T22:33:28.453 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.167559.log.gz 2023-09-30T22:33:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140754.log 2023-09-30T22:33:28.453 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.185214.log.gz 2023-09-30T22:33:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177928.log 2023-09-30T22:33:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140754.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.192767.log.gz 2023-09-30T22:33:28.453 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148013.log 2023-09-30T22:33:28.453 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140754.log.gz 2023-09-30T22:33:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182197.log 2023-09-30T22:33:28.454 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177928.log.gz 2023-09-30T22:33:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139429.log 2023-09-30T22:33:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182197.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148013.log.gz 2023-09-30T22:33:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146984.log 2023-09-30T22:33:28.454 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182197.log.gz 2023-09-30T22:33:28.454 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177167.log 2023-09-30T22:33:28.455 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139429.log.gz 2023-09-30T22:33:28.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160099.log 2023-09-30T22:33:28.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177167.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.146984.log.gz 2023-09-30T22:33:28.455 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139356.log 2023-09-30T22:33:28.455 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177167.log.gz 2023-09-30T22:33:28.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178346.log 2023-09-30T22:33:28.455 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160099.log.gz 2023-09-30T22:33:28.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127015.log 2023-09-30T22:33:28.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178346.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139356.log.gz 2023-09-30T22:33:28.456 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153135.log 2023-09-30T22:33:28.456 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178346.log.gz 2023-09-30T22:33:28.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127399.log 2023-09-30T22:33:28.456 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127015.log.gz 2023-09-30T22:33:28.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152621.log 2023-09-30T22:33:28.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127399.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153135.log.gz 2023-09-30T22:33:28.456 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129224.log 2023-09-30T22:33:28.457 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127399.log.gz 2023-09-30T22:33:28.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154293.log 2023-09-30T22:33:28.457 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152621.log.gz 2023-09-30T22:33:28.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125019.log 2023-09-30T22:33:28.457 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154293.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129224.log.gz 2023-09-30T22:33:28.457 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123820.log 2023-09-30T22:33:28.457 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.154293.log.gz 2023-09-30T22:33:28.457 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179949.log 2023-09-30T22:33:28.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125019.log: /var/log/ceph/ceph-client.admin.123820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190292.log 2023-09-30T22:33:28.458 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125019.log.gz 2023-09-30T22:33:28.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145014.log 2023-09-30T22:33:28.458 INFO:teuthology.orchestra.run.smithi154.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123820.log.gz 2023-09-30T22:33:28.458 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190292.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179949.log.gz 2023-09-30T22:33:28.458 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142688.log 2023-09-30T22:33:28.458 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.190292.log.gz 2023-09-30T22:33:28.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171901.log 2023-09-30T22:33:28.459 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145014.log.gz 2023-09-30T22:33:28.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156133.log 2023-09-30T22:33:28.459 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142688.log.gz 2023-09-30T22:33:28.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180314.log 2023-09-30T22:33:28.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156133.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171901.log.gz 2023-09-30T22:33:28.459 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185776.log 2023-09-30T22:33:28.459 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180314.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156133.log.gz 2023-09-30T22:33:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159971.log 2023-09-30T22:33:28.460 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180314.log.gz 2023-09-30T22:33:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137958.log 2023-09-30T22:33:28.460 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185776.log.gz 2023-09-30T22:33:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129665.log 2023-09-30T22:33:28.460 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159971.log.gz 2023-09-30T22:33:28.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174423.log 2023-09-30T22:33:28.460 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137958.log.gz 2023-09-30T22:33:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173592.log 2023-09-30T22:33:28.461 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129665.log.gz 2023-09-30T22:33:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124019.log 2023-09-30T22:33:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173592.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174423.log.gz 2023-09-30T22:33:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191272.log 2023-09-30T22:33:28.461 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173592.log.gz 2023-09-30T22:33:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175377.log 2023-09-30T22:33:28.461 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124019.log.gz 2023-09-30T22:33:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147817.log 2023-09-30T22:33:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175377.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191272.log.gz 2023-09-30T22:33:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180537.log 2023-09-30T22:33:28.462 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175377.log.gz 2023-09-30T22:33:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184890.log 2023-09-30T22:33:28.462 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.147817.log.gz 2023-09-30T22:33:28.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152228.log 2023-09-30T22:33:28.463 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180537.log.gz 2023-09-30T22:33:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192721.log 2023-09-30T22:33:28.463 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184890.log.gz 2023-09-30T22:33:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193478.log 2023-09-30T22:33:28.463 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1%/var/log/ceph/ceph-client.admin.192721.log: -- replaced with /var/log/ceph/ceph-client.admin.152228.log.gz 2023-09-30T22:33:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193729.log 2023-09-30T22:33:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193478.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192721.log.gz 2023-09-30T22:33:28.463 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122849.log 2023-09-30T22:33:28.463 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193478.log.gz 2023-09-30T22:33:28.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193729.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-30T22:33:28.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122849.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.193729.log.gz 2023-09-30T22:33:28.464 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184992.log 2023-09-30T22:33:28.464 INFO:teuthology.orchestra.run.smithi154.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122849.log.gz 2023-09-30T22:33:28.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145285.log 2023-09-30T22:33:28.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190982.log 2023-09-30T22:33:28.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145285.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.184992.log.gz 2023-09-30T22:33:28.464 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159293.log 2023-09-30T22:33:28.465 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145285.log.gz 2023-09-30T22:33:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128715.log 2023-09-30T22:33:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192647.log /var/log/ceph/ceph-client.admin.159293.log: 2023-09-30T22:33:28.465 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190982.log.gz 2023-09-30T22:33:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128715.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159293.log.gz 2023-09-30T22:33:28.465 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141708.log 2023-09-30T22:33:28.465 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128715.log.gz 2023-09-30T22:33:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171658.log 2023-09-30T22:33:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187736.log 2023-09-30T22:33:28.466 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.192647.log.gz 2023-09-30T22:33:28.466 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141708.log.gz 2023-09-30T22:33:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172220.log 2023-09-30T22:33:28.466 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171658.log.gz 2023-09-30T22:33:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153229.log 2023-09-30T22:33:28.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172220.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187736.log.gz 2023-09-30T22:33:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191714.log 2023-09-30T22:33:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153229.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172220.log.gz 2023-09-30T22:33:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122653.log 2023-09-30T22:33:28.467 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153229.log.gz 2023-09-30T22:33:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172613.log 2023-09-30T22:33:28.467 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191714.log.gz 2023-09-30T22:33:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147871.log 2023-09-30T22:33:28.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172613.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122653.log.gz 2023-09-30T22:33:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184451.log 2023-09-30T22:33:28.468 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172613.log.gz 2023-09-30T22:33:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183765.log 2023-09-30T22:33:28.468 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147871.log.gz 2023-09-30T22:33:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143054.log 2023-09-30T22:33:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183765.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184451.log.gz 2023-09-30T22:33:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150898.log 2023-09-30T22:33:28.468 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183765.log.gz 2023-09-30T22:33:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138789.log 2023-09-30T22:33:28.469 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.143054.log.gz 2023-09-30T22:33:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147451.log 2023-09-30T22:33:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138789.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150898.log.gz 2023-09-30T22:33:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123255.log 2023-09-30T22:33:28.469 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138789.log.gz 2023-09-30T22:33:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176214.log 2023-09-30T22:33:28.469 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.147451.log.gz 2023-09-30T22:33:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163420.log 2023-09-30T22:33:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176214.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123255.log.gz 2023-09-30T22:33:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167756.log 2023-09-30T22:33:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163420.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176214.log.gz 2023-09-30T22:33:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153331.log 2023-09-30T22:33:28.470 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163420.log.gz 2023-09-30T22:33:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172489.log 2023-09-30T22:33:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153331.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.167756.log.gz 2023-09-30T22:33:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190880.log 2023-09-30T22:33:28.471 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153331.log.gz 2023-09-30T22:33:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179496.log 2023-09-30T22:33:28.471 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172489.log.gz 2023-09-30T22:33:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124016.log 2023-09-30T22:33:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179496.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.190880.log.gz 2023-09-30T22:33:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170082.log 2023-09-30T22:33:28.471 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179496.log.gz 2023-09-30T22:33:28.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190000.log 2023-09-30T22:33:28.472 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124016.log.gz 2023-09-30T22:33:28.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152939.log 2023-09-30T22:33:28.472 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170082.log.gz 2023-09-30T22:33:28.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193945.log 2023-09-30T22:33:28.472 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0%/var/log/ceph/ceph-client.admin.152939.log: -- replaced with /var/log/ceph/ceph-client.admin.190000.log.gz 2023-09-30T22:33:28.472 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156106.log 2023-09-30T22:33:28.472 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152939.log.gz 2023-09-30T22:33:28.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153993.log 2023-09-30T22:33:28.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156106.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193945.log.gz 2023-09-30T22:33:28.473 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194533.log 2023-09-30T22:33:28.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153993.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156106.log.gz 2023-09-30T22:33:28.473 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168953.log 2023-09-30T22:33:28.473 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153993.log.gz 2023-09-30T22:33:28.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166187.log 2023-09-30T22:33:28.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168953.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194533.log.gz 2023-09-30T22:33:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146320.log 2023-09-30T22:33:28.474 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168953.log.gz 2023-09-30T22:33:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170669.log 2023-09-30T22:33:28.474 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166187.log.gz 2023-09-30T22:33:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189019.log 2023-09-30T22:33:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170669.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146320.log.gz 2023-09-30T22:33:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165914.log 2023-09-30T22:33:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189019.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170669.log.gz 2023-09-30T22:33:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158213.log 2023-09-30T22:33:28.475 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189019.log.gz 2023-09-30T22:33:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156525.log 2023-09-30T22:33:28.475 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165914.log.gz 2023-09-30T22:33:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176357.log 2023-09-30T22:33:28.475 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158213.log.gz 2023-09-30T22:33:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155861.log 2023-09-30T22:33:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176357.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156525.log.gz 2023-09-30T22:33:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187005.log 2023-09-30T22:33:28.476 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.176357.log.gz 2023-09-30T22:33:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142519.log 2023-09-30T22:33:28.476 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155861.log.gz 2023-09-30T22:33:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122951.log /var/log/ceph/ceph-client.admin.187005.log: 2023-09-30T22:33:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142519.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187005.log.gz 2023-09-30T22:33:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182473.log 2023-09-30T22:33:28.477 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142519.log.gz 2023-09-30T22:33:28.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165992.log 2023-09-30T22:33:28.477 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122951.log.gz 2023-09-30T22:33:28.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146667.log 2023-09-30T22:33:28.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165992.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182473.log.gz 2023-09-30T22:33:28.477 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191863.log 2023-09-30T22:33:28.477 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165992.log.gz 2023-09-30T22:33:28.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159903.log 2023-09-30T22:33:28.478 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.146667.log.gz 2023-09-30T22:33:28.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161202.log 2023-09-30T22:33:28.478 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191863.log.gz 2023-09-30T22:33:28.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190608.log 2023-09-30T22:33:28.478 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.159903.log.gz 2023-09-30T22:33:28.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170865.log 2023-09-30T22:33:28.478 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161202.log.gz 2023-09-30T22:33:28.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143838.log 2023-09-30T22:33:28.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190608.log.gz 2023-09-30T22:33:28.479 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188182.log 2023-09-30T22:33:28.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143838.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170865.log.gz 2023-09-30T22:33:28.479 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130008.log 2023-09-30T22:33:28.479 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.143838.log.gz 2023-09-30T22:33:28.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190096.log 2023-09-30T22:33:28.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130008.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.188182.log.gz 2023-09-30T22:33:28.479 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129371.log 2023-09-30T22:33:28.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127998.log 2023-09-30T22:33:28.480 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1%/var/log/ceph/ceph-client.admin.129371.log: -- replaced with /var/log/ceph/ceph-client.admin.130008.log.gz 2023-09-30T22:33:28.480 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.190096.log.gz 2023-09-30T22:33:28.480 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123823.log 2023-09-30T22:33:28.480 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129371.log.gz 2023-09-30T22:33:28.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170055.log 2023-09-30T22:33:28.480 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127998.log.gz 2023-09-30T22:33:28.480 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138056.log 2023-09-30T22:33:28.481 INFO:teuthology.orchestra.run.smithi154.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.123823.log.gz 2023-09-30T22:33:28.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184302.log 2023-09-30T22:33:28.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124970.log 2023-09-30T22:33:28.481 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170055.log.gz 2023-09-30T22:33:28.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184302.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138056.log.gz 2023-09-30T22:33:28.481 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194607.log 2023-09-30T22:33:28.481 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184302.log.gz 2023-09-30T22:33:28.481 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166750.log 2023-09-30T22:33:28.482 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124970.log.gz 2023-09-30T22:33:28.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143446.log 2023-09-30T22:33:28.482 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.194607.log.gz 2023-09-30T22:33:28.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174201.log 2023-09-30T22:33:28.482 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166750.log.gz 2023-09-30T22:33:28.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181856.log 2023-09-30T22:33:28.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174201.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143446.log.gz 2023-09-30T22:33:28.483 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124215.log 2023-09-30T22:33:28.483 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174201.log.gz 2023-09-30T22:33:28.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139952.log 2023-09-30T22:33:28.483 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181856.log.gz 2023-09-30T22:33:28.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164738.log 2023-09-30T22:33:28.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139952.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124215.log.gz 2023-09-30T22:33:28.483 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195048.log 2023-09-30T22:33:28.483 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139952.log.gz 2023-09-30T22:33:28.483 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156722.log 2023-09-30T22:33:28.484 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164738.log.gz 2023-09-30T22:33:28.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163758.log 2023-09-30T22:33:28.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156722.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.195048.log.gz 2023-09-30T22:33:28.484 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138154.log 2023-09-30T22:33:28.484 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156722.log.gz 2023-09-30T22:33:28.484 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144893.log 2023-09-30T22:33:28.484 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163758.log.gz/var/log/ceph/ceph-client.admin.138154.log: 2023-09-30T22:33:28.485 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146077.log 2023-09-30T22:33:28.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144893.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138154.log.gz 2023-09-30T22:33:28.485 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148356.log 2023-09-30T22:33:28.485 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144893.log.gz 2023-09-30T22:33:28.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147768.log 2023-09-30T22:33:28.485 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146077.log.gz 2023-09-30T22:33:28.485 INFO:teuthology.orchestra.run.smithi154.stderr:gzip /var/log/ceph/ceph-client.admin.148356.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.190684.log 2023-09-30T22:33:28.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147768.log: 89.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.148356.log.gz--verbose 2023-09-30T22:33:28.486 INFO:teuthology.orchestra.run.smithi154.stderr:-- /var/log/ceph/ceph-client.admin.158850.log 2023-09-30T22:33:28.486 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147768.log.gz 2023-09-30T22:33:28.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124163.log 2023-09-30T22:33:28.486 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.190684.log.gz 2023-09-30T22:33:28.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160520.log 2023-09-30T22:33:28.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124163.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.158850.log.gz-5 2023-09-30T22:33:28.486 INFO:teuthology.orchestra.run.smithi154.stderr:--verbose -- /var/log/ceph/ceph-client.admin.148235.log 2023-09-30T22:33:28.486 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124163.log.gz 2023-09-30T22:33:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118160.log 2023-09-30T22:33:28.487 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160520.log.gz 2023-09-30T22:33:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142270.log 2023-09-30T22:33:28.487 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148235.log.gz 2023-09-30T22:33:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180118.log 2023-09-30T22:33:28.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127217.log 2023-09-30T22:33:28.487 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.118160.log.gz 2023-09-30T22:33:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180118.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142270.log.gz 2023-09-30T22:33:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182785.log 2023-09-30T22:33:28.488 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.180118.log.gz 2023-09-30T22:33:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177683.log 2023-09-30T22:33:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182785.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127217.log.gz 2023-09-30T22:33:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140753.log 2023-09-30T22:33:28.488 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182785.log.gz 2023-09-30T22:33:28.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147059.log 2023-09-30T22:33:28.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140753.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.177683.log.gz 2023-09-30T22:33:28.489 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151006.log 2023-09-30T22:33:28.489 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140753.log.gz 2023-09-30T22:33:28.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170499.log 2023-09-30T22:33:28.489 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147059.log.gz 2023-09-30T22:33:28.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157504.log 2023-09-30T22:33:28.489 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170499.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.151006.log.gz--verbose 2023-09-30T22:33:28.489 INFO:teuthology.orchestra.run.smithi154.stderr:-- /var/log/ceph/ceph-client.admin.167482.log 2023-09-30T22:33:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157504.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170499.log.gz 2023-09-30T22:33:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176775.log 2023-09-30T22:33:28.490 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157504.log.gz 2023-09-30T22:33:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156057.log 2023-09-30T22:33:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176775.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167482.log.gz 2023-09-30T22:33:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150809.log 2023-09-30T22:33:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156057.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176775.log.gz 2023-09-30T22:33:28.490 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152053.log 2023-09-30T22:33:28.491 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156057.log.gz 2023-09-30T22:33:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138619.log 2023-09-30T22:33:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152053.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150809.log.gz 2023-09-30T22:33:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135018.log 2023-09-30T22:33:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138619.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.152053.log.gz 2023-09-30T22:33:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125825.log 2023-09-30T22:33:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135018.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138619.log.gz 2023-09-30T22:33:28.491 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146591.log 2023-09-30T22:33:28.492 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135018.log.gz 2023-09-30T22:33:28.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162378.log 2023-09-30T22:33:28.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177197.log 2023-09-30T22:33:28.492 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146591.log.gz 2023-09-30T22:33:28.492 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.125825.log.gz 2023-09-30T22:33:28.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151541.log 2023-09-30T22:33:28.492 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141368.log 2023-09-30T22:33:28.492 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177197.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162378.log.gz 2023-09-30T22:33:28.493 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177561.log 2023-09-30T22:33:28.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151541.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177197.log.gz 2023-09-30T22:33:28.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141368.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151541.log.gz 2023-09-30T22:33:28.493 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141760.log 2023-09-30T22:33:28.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177561.log: gzip -5 88.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.141368.log.gz/var/log/ceph/ceph-client.admin.174254.log 2023-09-30T22:33:28.493 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-09-30T22:33:28.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141760.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177561.log.gz 2023-09-30T22:33:28.493 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182001.log 2023-09-30T22:33:28.494 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141760.log.gz 2023-09-30T22:33:28.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174254.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111883.log 2023-09-30T22:33:28.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182001.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.174254.log.gz 2023-09-30T22:33:28.494 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171802.log 2023-09-30T22:33:28.494 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182001.log.gz 2023-09-30T22:33:28.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.tmp-client.admin.111883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185972.log 2023-09-30T22:33:28.494 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111883.log.gz 2023-09-30T22:33:28.495 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174842.log 2023-09-30T22:33:28.495 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.171802.log.gz 2023-09-30T22:33:28.495 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192694.log 2023-09-30T22:33:28.495 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185972.log.gz 2023-09-30T22:33:28.495 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182081.log 2023-09-30T22:33:28.495 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192694.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174842.log.gz 2023-09-30T22:33:28.495 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164372.log 2023-09-30T22:33:28.495 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192694.log.gz 2023-09-30T22:33:28.496 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155939.log 2023-09-30T22:33:28.496 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164372.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182081.log.gz 2023-09-30T22:33:28.496 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141955.log 2023-09-30T22:33:28.496 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164372.log.gz 2023-09-30T22:33:28.496 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188823.log 2023-09-30T22:33:28.496 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155939.log.gz 2023-09-30T22:33:28.496 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128262.log 2023-09-30T22:33:28.496 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141955.log.gz 2023-09-30T22:33:28.497 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181885.log 2023-09-30T22:33:28.497 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.188823.log.gz 2023-09-30T22:33:28.497 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157897.log 2023-09-30T22:33:28.497 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128262.log.gz 2023-09-30T22:33:28.497 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175626.log 2023-09-30T22:33:28.497 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157897.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.181885.log.gz 2023-09-30T22:33:28.497 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124529.log 2023-09-30T22:33:28.497 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175626.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157897.log.gz 2023-09-30T22:33:28.497 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145481.log 2023-09-30T22:33:28.498 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175626.log.gz 2023-09-30T22:33:28.498 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148823.log 2023-09-30T22:33:28.498 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145481.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124529.log.gz 2023-09-30T22:33:28.498 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183322.log 2023-09-30T22:33:28.498 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145481.log.gz 2023-09-30T22:33:28.498 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187201.log 2023-09-30T22:33:28.498 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148823.log.gz 2023-09-30T22:33:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128308.log 2023-09-30T22:33:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187201.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.183322.log.gz 2023-09-30T22:33:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153966.log 2023-09-30T22:33:28.499 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187201.log.gz 2023-09-30T22:33:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145806.log 2023-09-30T22:33:28.499 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128308.log.gz 2023-09-30T22:33:28.499 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139181.log 2023-09-30T22:33:28.499 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.153966.log.gz 2023-09-30T22:33:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163466.log 2023-09-30T22:33:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139181.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145806.log.gz 2023-09-30T22:33:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144034.log 2023-09-30T22:33:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163466.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139181.log.gz 2023-09-30T22:33:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151659.log 2023-09-30T22:33:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144034.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163466.log.gz 2023-09-30T22:33:28.500 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162770.log 2023-09-30T22:33:28.500 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144034.log.gz 2023-09-30T22:33:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129518.log 2023-09-30T22:33:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162770.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151659.log.gz 2023-09-30T22:33:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182669.log 2023-09-30T22:33:28.501 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162770.log.gz 2023-09-30T22:33:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184059.log 2023-09-30T22:33:28.501 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129518.log.gz 2023-09-30T22:33:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171706.log 2023-09-30T22:33:28.501 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184059.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182669.log.gz 2023-09-30T22:33:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138742.log 2023-09-30T22:33:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171706.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184059.log.gz 2023-09-30T22:33:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175769.log 2023-09-30T22:33:28.502 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171706.log.gz 2023-09-30T22:33:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129616.log 2023-09-30T22:33:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175769.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138742.log.gz 2023-09-30T22:33:28.502 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183060.log 2023-09-30T22:33:28.502 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175769.log.gz 2023-09-30T22:33:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129959.log 2023-09-30T22:33:28.503 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129616.log.gz 2023-09-30T22:33:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124823.log 2023-09-30T22:33:28.503 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183060.log.gz 2023-09-30T22:33:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191197.log 2023-09-30T22:33:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124823.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129959.log.gz 2023-09-30T22:33:28.503 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148039.log 2023-09-30T22:33:28.503 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124823.log.gz 2023-09-30T22:33:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135992.log 2023-09-30T22:33:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148039.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191197.log.gz 2023-09-30T22:33:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137192.log 2023-09-30T22:33:28.504 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148039.log.gz 2023-09-30T22:33:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185135.log 2023-09-30T22:33:28.504 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.135992.log.gz 2023-09-30T22:33:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129045.log 2023-09-30T22:33:28.504 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185135.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137192.log.gz 2023-09-30T22:33:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176971.log 2023-09-30T22:33:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129045.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185135.log.gz 2023-09-30T22:33:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155767.log 2023-09-30T22:33:28.505 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129045.log.gz 2023-09-30T22:33:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168658.log 2023-09-30T22:33:28.505 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176971.log.gz 2023-09-30T22:33:28.505 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184106.log 2023-09-30T22:33:28.505 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155767.log.gz 2023-09-30T22:33:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168709.log 2023-09-30T22:33:28.506 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.168658.log.gz 2023-09-30T22:33:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193627.log 2023-09-30T22:33:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184106.log: /var/log/ceph/ceph-client.admin.168709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140310.log 2023-09-30T22:33:28.506 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.184106.log.gz 2023-09-30T22:33:28.506 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168709.log.gz 2023-09-30T22:33:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189704.log 2023-09-30T22:33:28.506 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169494.log 2023-09-30T22:33:28.507 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.193627.log.gz 2023-09-30T22:33:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140310.log: /var/log/ceph/ceph-client.admin.189704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164150.log 2023-09-30T22:33:28.507 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.140310.log.gz 2023-09-30T22:33:28.507 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.189704.log.gz 2023-09-30T22:33:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167168.log 2023-09-30T22:33:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169494.log: /var/log/ceph/ceph-client.admin.164150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163196.log 2023-09-30T22:33:28.507 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169494.log.gz 2023-09-30T22:33:28.507 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164150.log.gz 2023-09-30T22:33:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167168.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-30T22:33:28.508 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167168.log.gz 2023-09-30T22:33:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142492.log 2023-09-30T22:33:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163196.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169442.log 2023-09-30T22:33:28.508 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163196.log.gz 2023-09-30T22:33:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154783.log 2023-09-30T22:33:28.508 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142492.log.gz 2023-09-30T22:33:28.508 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189338.log 2023-09-30T22:33:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192355.log 2023-09-30T22:33:28.509 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169442.log.gz 2023-09-30T22:33:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154783.log: /var/log/ceph/ceph-client.admin.189338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156375.log 2023-09-30T22:33:28.509 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154783.log.gz 2023-09-30T22:33:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192355.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.189338.log.gz 2023-09-30T22:33:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163366.log 2023-09-30T22:33:28.509 INFO:teuthology.orchestra.run.smithi154.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.192355.log.gz 2023-09-30T22:33:28.509 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140167.log 2023-09-30T22:33:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163366.log: gzip -5 88.3%--verbose -- /var/log/ceph/ceph-client.admin.157355.log -- replaced with /var/log/ceph/ceph-client.admin.156375.log.gz 2023-09-30T22:33:28.510 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-09-30T22:33:28.510 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163366.log.gz 2023-09-30T22:33:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183453.log 2023-09-30T22:33:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157355.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140167.log.gz 2023-09-30T22:33:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186782.log 2023-09-30T22:33:28.510 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157355.log.gz 2023-09-30T22:33:28.510 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165576.log 2023-09-30T22:33:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183453.log: /var/log/ceph/ceph-client.admin.186782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150702.log 2023-09-30T22:33:28.511 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183453.log.gz 2023-09-30T22:33:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165576.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186782.log.gz 2023-09-30T22:33:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156449.log 2023-09-30T22:33:28.511 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165576.log.gz 2023-09-30T22:33:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122245.log 2023-09-30T22:33:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156449.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150702.log.gz 2023-09-30T22:33:28.511 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183863.log 2023-09-30T22:33:28.512 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156449.log.gz 2023-09-30T22:33:28.512 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156302.log 2023-09-30T22:33:28.512 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151763.log 2023-09-30T22:33:28.512 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183863.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122245.log.gz 2023-09-30T22:33:28.512 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136826.log 2023-09-30T22:33:28.512 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156302.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183863.log.gz 2023-09-30T22:33:28.512 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151763.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.156302.log.gz-5 2023-09-30T22:33:28.512 INFO:teuthology.orchestra.run.smithi154.stderr:--verbose -- /var/log/ceph/ceph-client.admin.151175.log 2023-09-30T22:33:28.513 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.151763.log.gz 2023-09-30T22:33:28.513 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136826.log: /var/log/ceph/ceph-client.admin.173669.log 2023-09-30T22:33:28.513 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153574.log 2023-09-30T22:33:28.513 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136826.log.gz 2023-09-30T22:33:28.513 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173669.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.151175.log.gz 2023-09-30T22:33:28.513 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188423.log 2023-09-30T22:33:28.513 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173669.log.gz 2023-09-30T22:33:28.513 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176945.log 2023-09-30T22:33:28.514 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153574.log.gz 2023-09-30T22:33:28.514 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151987.log 2023-09-30T22:33:28.514 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188423.log: /var/log/ceph/ceph-client.admin.176945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150613.log 2023-09-30T22:33:28.514 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.188423.log.gz 2023-09-30T22:33:28.514 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176945.log.gz 2023-09-30T22:33:28.514 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169664.log 2023-09-30T22:33:28.514 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148601.log 2023-09-30T22:33:28.514 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150613.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.151987.log.gz 2023-09-30T22:33:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169664.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150613.log.gz 2023-09-30T22:33:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150169.log 2023-09-30T22:33:28.515 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169664.log.gz 2023-09-30T22:33:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157429.log 2023-09-30T22:33:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148601.log: 95.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-30T22:33:28.515 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186655.log 2023-09-30T22:33:28.515 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148601.log.gz 2023-09-30T22:33:28.515 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150169.log.gz 2023-09-30T22:33:28.516 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189953.log 2023-09-30T22:33:28.516 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157429.log.gz 2023-09-30T22:33:28.516 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183255.log 2023-09-30T22:33:28.516 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186655.log: /var/log/ceph/ceph-client.admin.189953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174646.log 2023-09-30T22:33:28.516 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.186655.log.gz 2023-09-30T22:33:28.516 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189953.log.gz 2023-09-30T22:33:28.516 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161006.log 2023-09-30T22:33:28.516 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187396.log 2023-09-30T22:33:28.517 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5%/var/log/ceph/ceph-client.admin.174646.log: -- replaced with /var/log/ceph/ceph-client.admin.183255.log.gz 2023-09-30T22:33:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127675.log 2023-09-30T22:33:28.517 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174646.log.gz 2023-09-30T22:33:28.517 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161006.log.gz 2023-09-30T22:33:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137166.log 2023-09-30T22:33:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187396.log: /var/log/ceph/ceph-client.admin.127675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167558.log 2023-09-30T22:33:28.517 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187396.log.gz 2023-09-30T22:33:28.518 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127675.log.gz 2023-09-30T22:33:28.518 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125237.log 2023-09-30T22:33:28.518 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137166.log.gz 2023-09-30T22:33:28.518 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187594.log 2023-09-30T22:33:28.518 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125237.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167558.log.gz 2023-09-30T22:33:28.518 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154587.log 2023-09-30T22:33:28.518 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125237.log.gz 2023-09-30T22:33:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165159.log 2023-09-30T22:33:28.519 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187594.log.gz 2023-09-30T22:33:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190196.log 2023-09-30T22:33:28.519 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.154587.log.gz 2023-09-30T22:33:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190953.log 2023-09-30T22:33:28.519 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165159.log.gz 2023-09-30T22:33:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182930.log 2023-09-30T22:33:28.519 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190953.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190196.log.gz 2023-09-30T22:33:28.520 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168122.log 2023-09-30T22:33:28.520 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.190953.log.gz 2023-09-30T22:33:28.520 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158705.log 2023-09-30T22:33:28.520 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182930.log.gz 2023-09-30T22:33:28.520 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158902.log 2023-09-30T22:33:28.520 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158705.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168122.log.gz 2023-09-30T22:33:28.520 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137986.log 2023-09-30T22:33:28.520 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.158705.log.gz 2023-09-30T22:33:28.521 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150417.log 2023-09-30T22:33:28.521 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158902.log.gz 2023-09-30T22:33:28.521 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177879.log 2023-09-30T22:33:28.521 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137986.log.gz 2023-09-30T22:33:28.521 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174789.log 2023-09-30T22:33:28.521 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150417.log.gz 2023-09-30T22:33:28.521 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169737.log 2023-09-30T22:33:28.521 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177879.log.gz 2023-09-30T22:33:28.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195195.log 2023-09-30T22:33:28.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169737.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174789.log.gz 2023-09-30T22:33:28.522 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137396.log 2023-09-30T22:33:28.522 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169737.log.gz 2023-09-30T22:33:28.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123157.log 2023-09-30T22:33:28.522 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.195195.log.gz 2023-09-30T22:33:28.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122437.log 2023-09-30T22:33:28.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123157.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137396.log.gz 2023-09-30T22:33:28.523 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143174.log 2023-09-30T22:33:28.523 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.123157.log.gz 2023-09-30T22:33:28.523 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127017.log 2023-09-30T22:33:28.523 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122437.log.gz 2023-09-30T22:33:28.523 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179922.log 2023-09-30T22:33:28.523 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127017.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143174.log.gz 2023-09-30T22:33:28.523 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181072.log 2023-09-30T22:33:28.523 INFO:teuthology.orchestra.run.smithi154.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127017.log.gz 2023-09-30T22:33:28.524 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144500.log 2023-09-30T22:33:28.524 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179922.log.gz 2023-09-30T22:33:28.524 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161398.log 2023-09-30T22:33:28.524 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144500.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181072.log.gz 2023-09-30T22:33:28.524 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127347.log 2023-09-30T22:33:28.524 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144500.log.gz 2023-09-30T22:33:28.524 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128486.log 2023-09-30T22:33:28.525 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161398.log.gz 2023-09-30T22:33:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175233.log 2023-09-30T22:33:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128486.log: 89.1%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.127347.log.gz-- 2023-09-30T22:33:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139428.log 2023-09-30T22:33:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175233.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128486.log.gz 2023-09-30T22:33:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183424.log 2023-09-30T22:33:28.525 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175233.log.gz 2023-09-30T22:33:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180288.log 2023-09-30T22:33:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183424.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139428.log.gz 2023-09-30T22:33:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161910.log 2023-09-30T22:33:28.526 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.183424.log.gz 2023-09-30T22:33:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189312.log 2023-09-30T22:33:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161910.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180288.log.gz 2023-09-30T22:33:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185606.log 2023-09-30T22:33:28.526 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161910.log.gz 2023-09-30T22:33:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124214.log 2023-09-30T22:33:28.527 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.189312.log.gz 2023-09-30T22:33:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191374.log 2023-09-30T22:33:28.527 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185606.log.gz 2023-09-30T22:33:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162574.log 2023-09-30T22:33:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191374.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124214.log.gz 2023-09-30T22:33:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161518.log 2023-09-30T22:33:28.527 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191374.log.gz 2023-09-30T22:33:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155570.log 2023-09-30T22:33:28.528 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162574.log.gz 2023-09-30T22:33:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182146.log 2023-09-30T22:33:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155570.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161518.log.gz 2023-09-30T22:33:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123206.log 2023-09-30T22:33:28.528 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155570.log.gz 2023-09-30T22:33:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183620.log 2023-09-30T22:33:28.528 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182146.log.gz 2023-09-30T22:33:28.529 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173077.log 2023-09-30T22:33:28.529 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183620.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123206.log.gz 2023-09-30T22:33:28.529 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151959.log 2023-09-30T22:33:28.529 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183620.log.gz 2023-09-30T22:33:28.529 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165007.log 2023-09-30T22:33:28.529 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173077.log.gz 2023-09-30T22:33:28.529 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189171.log 2023-09-30T22:33:28.529 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165007.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151959.log.gz 2023-09-30T22:33:28.530 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181219.log 2023-09-30T22:33:28.530 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165007.log.gz 2023-09-30T22:33:28.530 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162208.log 2023-09-30T22:33:28.530 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.189171.log.gz 2023-09-30T22:33:28.530 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166553.log 2023-09-30T22:33:28.530 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136186.log 2023-09-30T22:33:28.530 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181219.log.gz 2023-09-30T22:33:28.530 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162208.log.gz 2023-09-30T22:33:28.531 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156571.log 2023-09-30T22:33:28.531 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166553.log.gz 2023-09-30T22:33:28.531 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181312.log 2023-09-30T22:33:28.531 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173004.log 2023-09-30T22:33:28.531 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136186.log.gz 2023-09-30T22:33:28.531 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181312.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156571.log.gz 2023-09-30T22:33:28.531 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123822.log 2023-09-30T22:33:28.531 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181312.log.gz 2023-09-30T22:33:28.532 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182865.log 2023-09-30T22:33:28.532 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123822.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173004.log.gz 2023-09-30T22:33:28.532 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125531.log 2023-09-30T22:33:28.532 INFO:teuthology.orchestra.run.smithi154.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.123822.log.gz 2023-09-30T22:33:28.532 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190318.log 2023-09-30T22:33:28.532 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125531.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182865.log.gz 2023-09-30T22:33:28.532 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180876.log 2023-09-30T22:33:28.533 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190318.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125531.log.gz 2023-09-30T22:33:28.533 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175822.log 2023-09-30T22:33:28.533 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190318.log.gz 2023-09-30T22:33:28.533 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123647.log 2023-09-30T22:33:28.533 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180876.log.gz 2023-09-30T22:33:28.533 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191766.log 2023-09-30T22:33:28.533 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123647.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175822.log.gz 2023-09-30T22:33:28.533 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142782.log 2023-09-30T22:33:28.533 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123647.log.gz 2023-09-30T22:33:28.534 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174154.log 2023-09-30T22:33:28.534 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142782.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.191766.log.gz 2023-09-30T22:33:28.534 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137370.log 2023-09-30T22:33:28.534 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142782.log.gz 2023-09-30T22:33:28.534 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180092.log 2023-09-30T22:33:28.534 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174154.log.gz 2023-09-30T22:33:28.534 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162452.log 2023-09-30T22:33:28.535 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137370.log.gz 2023-09-30T22:33:28.535 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188032.log 2023-09-30T22:33:28.535 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162452.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.180092.log.gz 2023-09-30T22:33:28.535 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191319.log 2023-09-30T22:33:28.535 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162452.log.gz 2023-09-30T22:33:28.535 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127020.log 2023-09-30T22:33:28.535 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188032.log.gz 2023-09-30T22:33:28.535 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149728.log 2023-09-30T22:33:28.536 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.191319.log.gz 2023-09-30T22:33:28.536 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161986.log 2023-09-30T22:33:28.536 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149728.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.127020.log.gz 2023-09-30T22:33:28.536 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139795.log 2023-09-30T22:33:28.536 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161986.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149728.log.gz 2023-09-30T22:33:28.536 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188324.log 2023-09-30T22:33:28.536 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194729.log 2023-09-30T22:33:28.536 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161986.log.gz 2023-09-30T22:33:28.537 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188324.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139795.log.gz 2023-09-30T22:33:28.537 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190514.log 2023-09-30T22:33:28.537 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188324.log.gz 2023-09-30T22:33:28.537 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144332.log 2023-09-30T22:33:28.537 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.194729.log.gz 2023-09-30T22:33:28.537 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-09-30T22:33:28.537 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190514.log: /var/log/ceph/ceph-client.admin.144332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187052.log 2023-09-30T22:33:28.537 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190514.log.gz 2023-09-30T22:33:28.538 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144332.log.gz 2023-09-30T22:33:28.538 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186978.log 2023-09-30T22:33:28.538 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139526.log 2023-09-30T22:33:28.538 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187052.log: /var/log/ceph/ceph-client.admin.186978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139626.log 2023-09-30T22:33:28.538 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187052.log.gz 2023-09-30T22:33:28.538 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.186978.log.gz 2023-09-30T22:33:28.538 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129014.log 2023-09-30T22:33:28.538 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139526.log.gz 2023-09-30T22:33:28.539 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168880.log 2023-09-30T22:33:28.539 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180949.log 2023-09-30T22:33:28.539 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129014.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139626.log.gz 2023-09-30T22:33:28.539 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163562.log 2023-09-30T22:33:28.539 INFO:teuthology.orchestra.run.smithi154.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.129014.log.gz 2023-09-30T22:33:28.539 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180949.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168880.log.gz 2023-09-30T22:33:28.539 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189365.log 2023-09-30T22:33:28.539 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163562.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.180949.log.gz 2023-09-30T22:33:28.540 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129861.log 2023-09-30T22:33:28.540 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163562.log.gz 2023-09-30T22:33:28.540 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191544.log 2023-09-30T22:33:28.540 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129861.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.189365.log.gz 2023-09-30T22:33:28.540 INFO:teuthology.orchestra.run.smithi154.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.137070.log 2023-09-30T22:33:28.540 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1%/var/log/ceph/ceph-client.admin.191544.log: -- replaced with /var/log/ceph/ceph-client.admin.129861.log.gz 2023-09-30T22:33:28.540 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179326.log 2023-09-30T22:33:28.540 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191544.log.gz 2023-09-30T22:33:28.541 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176410.log 2023-09-30T22:33:28.541 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 87.9%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.137070.log.gz/var/log/ceph/ceph-client.admin.148944.log 2023-09-30T22:33:28.541 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-09-30T22:33:28.541 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179326.log: gzip -5 /var/log/ceph/ceph-client.admin.176410.log: --verbose -- /var/log/ceph/ceph-client.admin.192354.log 2023-09-30T22:33:28.541 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179326.log.gz 2023-09-30T22:33:28.541 INFO:teuthology.orchestra.run.smithi154.stderr:gzip /var/log/ceph/ceph-client.admin.148944.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.187639.log 2023-09-30T22:33:28.541 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.176410.log.gz 2023-09-30T22:33:28.542 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192354.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.148944.log.gz 2023-09-30T22:33:28.542 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179130.log 2023-09-30T22:33:28.542 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.192354.log.gz 2023-09-30T22:33:28.542 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189414.log 2023-09-30T22:33:28.542 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187639.log: /var/log/ceph/ceph-client.admin.179130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184208.log 2023-09-30T22:33:28.542 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187639.log.gz 2023-09-30T22:33:28.542 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179130.log.gz 2023-09-30T22:33:28.542 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157625.log 2023-09-30T22:33:28.543 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165940.log 2023-09-30T22:33:28.543 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184208.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.189414.log.gz 2023-09-30T22:33:28.543 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157625.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.184208.log.gz 2023-09-30T22:33:28.543 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126839.log 2023-09-30T22:33:28.543 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157625.log.gz 2023-09-30T22:33:28.543 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159662.log 2023-09-30T22:33:28.543 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165940.log: /var/log/ceph/ceph-client.admin.126839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150120.log 2023-09-30T22:33:28.543 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165940.log.gz 2023-09-30T22:33:28.544 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159662.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126839.log.gz 2023-09-30T22:33:28.544 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154536.log 2023-09-30T22:33:28.544 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159662.log.gz 2023-09-30T22:33:28.544 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171109.log 2023-09-30T22:33:28.544 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150120.log.gz 2023-09-30T22:33:28.544 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166894.log 2023-09-30T22:33:28.544 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154536.log: /var/log/ceph/ceph-client.admin.171109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185870.log 2023-09-30T22:33:28.544 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.154536.log.gz 2023-09-30T22:33:28.545 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166894.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171109.log.gz 2023-09-30T22:33:28.545 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168462.log 2023-09-30T22:33:28.545 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166894.log.gz 2023-09-30T22:33:28.545 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118455.log 2023-09-30T22:33:28.545 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158409.log 2023-09-30T22:33:28.545 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185870.log.gz/var/log/ceph/ceph-client.admin.168462.log: 2023-09-30T22:33:28.545 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118455.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168462.log.gz 2023-09-30T22:33:28.545 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141564.log 2023-09-30T22:33:28.546 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118455.log.gz 2023-09-30T22:33:28.546 INFO:teuthology.orchestra.run.smithi154.stderr:gzip /var/log/ceph/ceph-client.admin.158409.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.147302.log 2023-09-30T22:33:28.546 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194803.log 2023-09-30T22:33:28.546 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158409.log.gz 2023-09-30T22:33:28.546 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147302.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141564.log.gz 2023-09-30T22:33:28.546 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177393.log 2023-09-30T22:33:28.546 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147302.log.gz 2023-09-30T22:33:28.546 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194803.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-09-30T22:33:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151596.log 2023-09-30T22:33:28.547 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3%/var/log/ceph/ceph-client.admin.177393.log: -- replaced with /var/log/ceph/ceph-client.admin.194803.log.gz 2023-09-30T22:33:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.0.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.177393.log.gz 2023-09-30T22:33:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144920.log 2023-09-30T22:33:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192158.log 2023-09-30T22:33:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151596.log: /var/log/ceph/ceph-client.admin.144920.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151596.log.gz 2023-09-30T22:33:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192158.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144920.log.gz 2023-09-30T22:33:28.548 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.192158.log.gz 2023-09-30T22:33:28.548 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171062.log 2023-09-30T22:33:28.548 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129812.log 2023-09-30T22:33:28.548 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183177.log 2023-09-30T22:33:28.548 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171062.log.gz 2023-09-30T22:33:28.548 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127889.log 2023-09-30T22:33:28.548 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170498.log 2023-09-30T22:33:28.548 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183177.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129812.log.gz 2023-09-30T22:33:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127889.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.183177.log.gz 2023-09-30T22:33:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170498.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127889.log.gz 2023-09-30T22:33:28.549 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170498.log.gz 2023-09-30T22:33:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166698.log 2023-09-30T22:33:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172782.log 2023-09-30T22:33:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167366.log 2023-09-30T22:33:28.549 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166698.log.gz 2023-09-30T22:33:28.549 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152817.log 2023-09-30T22:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183816.log 2023-09-30T22:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172782.log.gz 2023-09-30T22:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167366.log: /var/log/ceph/ceph-client.admin.152817.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167366.log.gz 2023-09-30T22:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166580.log 2023-09-30T22:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152817.log.gz 2023-09-30T22:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161492.log 2023-09-30T22:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183816.log.gz/var/log/ceph/ceph-client.admin.166580.log: 2023-09-30T22:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137841.log 2023-09-30T22:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161492.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166580.log.gz 2023-09-30T22:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161492.log.gz 2023-09-30T22:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137841.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137841.log.gz 2023-09-30T22:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148552.log 2023-09-30T22:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125482.log 2023-09-30T22:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174815.log 2023-09-30T22:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148552.log.gz 2023-09-30T22:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125482.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125482.log.gz 2023-09-30T22:33:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174815.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174815.log.gz 2023-09-30T22:33:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173273.log 2023-09-30T22:33:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159383.log 2023-09-30T22:33:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191123.log 2023-09-30T22:33:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159383.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173273.log.gz 2023-09-30T22:33:28.552 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159383.log.gz 2023-09-30T22:33:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191123.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191123.log.gz 2023-09-30T22:33:28.552 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122751.log 2023-09-30T22:33:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194337.log 2023-09-30T22:33:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154588.log 2023-09-30T22:33:28.553 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122751.log.gz 2023-09-30T22:33:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194337.log: /var/log/ceph/ceph-client.admin.154588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165426.log 2023-09-30T22:33:28.553 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194337.log.gz 2023-09-30T22:33:28.553 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154588.log.gz 2023-09-30T22:33:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128280.log 2023-09-30T22:33:28.553 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179718.log 2023-09-30T22:33:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165426.log: /var/log/ceph/ceph-client.admin.128280.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.165426.log.gz 2023-09-30T22:33:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179718.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128280.log.gz 2023-09-30T22:33:28.554 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.179718.log.gz 2023-09-30T22:33:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128762.log 2023-09-30T22:33:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136089.log 2023-09-30T22:33:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180631.log 2023-09-30T22:33:28.554 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128762.log.gz 2023-09-30T22:33:28.554 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144230.log 2023-09-30T22:33:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167560.log 2023-09-30T22:33:28.555 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136089.log.gz 2023-09-30T22:33:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144230.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180631.log.gz 2023-09-30T22:33:28.555 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144230.log.gz 2023-09-30T22:33:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167560.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167560.log.gz 2023-09-30T22:33:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175232.log 2023-09-30T22:33:28.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153378.log 2023-09-30T22:33:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152717.log 2023-09-30T22:33:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175232.log: /var/log/ceph/ceph-client.admin.153378.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175232.log.gz 2023-09-30T22:33:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152717.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153378.log.gz 2023-09-30T22:33:28.556 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152717.log.gz 2023-09-30T22:33:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140213.log 2023-09-30T22:33:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140209.log 2023-09-30T22:33:28.556 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165399.log 2023-09-30T22:33:28.556 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140213.log.gz 2023-09-30T22:33:28.557 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140209.log: /var/log/ceph/ceph-client.admin.165399.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140209.log.gz 2023-09-30T22:33:28.557 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165399.log.gz 2023-09-30T22:33:28.557 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176383.log 2023-09-30T22:33:28.557 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192059.log 2023-09-30T22:33:28.557 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160614.log 2023-09-30T22:33:28.557 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.176383.log.gz 2023-09-30T22:33:28.557 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192059.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.192059.log.gz 2023-09-30T22:33:28.557 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160614.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160614.log.gz 2023-09-30T22:33:28.558 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161128.log 2023-09-30T22:33:28.558 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127019.log 2023-09-30T22:33:28.558 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159464.log 2023-09-30T22:33:28.558 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127019.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161128.log.gz 2023-09-30T22:33:28.558 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171829.log 2023-09-30T22:33:28.558 INFO:teuthology.orchestra.run.smithi154.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.127019.log.gz 2023-09-30T22:33:28.558 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174742.log 2023-09-30T22:33:28.558 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136457.log 2023-09-30T22:33:28.559 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159464.log.gz 2023-09-30T22:33:28.559 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171829.log.gz 2023-09-30T22:33:28.559 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174742.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174742.log.gz 2023-09-30T22:33:28.559 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136457.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136457.log.gz 2023-09-30T22:33:28.559 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175428.log 2023-09-30T22:33:28.559 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167755.log 2023-09-30T22:33:28.559 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174985.log 2023-09-30T22:33:28.559 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.175428.log.gz 2023-09-30T22:33:28.560 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167755.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167755.log.gz 2023-09-30T22:33:28.560 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139791.log 2023-09-30T22:33:28.560 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174985.log.gz 2023-09-30T22:33:28.560 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147180.log 2023-09-30T22:33:28.560 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138449.log 2023-09-30T22:33:28.560 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139791.log.gz 2023-09-30T22:33:28.560 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194411.log 2023-09-30T22:33:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169050.log 2023-09-30T22:33:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138449.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147180.log.gz 2023-09-30T22:33:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164005.log 2023-09-30T22:33:28.561 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138449.log.gz 2023-09-30T22:33:28.561 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.194411.log.gz 2023-09-30T22:33:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177141.log 2023-09-30T22:33:28.561 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2%/var/log/ceph/ceph-client.admin.164005.log: -- replaced with /var/log/ceph/ceph-client.admin.169050.log.gz 2023-09-30T22:33:28.561 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176579.log 2023-09-30T22:33:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177141.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164005.log.gz 2023-09-30T22:33:28.562 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.177141.log.gz 2023-09-30T22:33:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176579.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176579.log.gz 2023-09-30T22:33:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128835.log 2023-09-30T22:33:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140408.log 2023-09-30T22:33:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128835.log: /var/log/ceph/ceph-client.admin.140408.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128835.log.gz 2023-09-30T22:33:28.562 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173370.log 2023-09-30T22:33:28.562 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140408.log.gz 2023-09-30T22:33:28.563 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123106.log 2023-09-30T22:33:28.563 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142978.log 2023-09-30T22:33:28.563 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173370.log: /var/log/ceph/ceph-client.admin.123106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148405.log 2023-09-30T22:33:28.563 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.173370.log.gz 2023-09-30T22:33:28.563 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142978.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123106.log.gz 2023-09-30T22:33:28.563 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164642.log 2023-09-30T22:33:28.563 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142978.log.gz 2023-09-30T22:33:28.563 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148405.log: /var/log/ceph/ceph-client.admin.164642.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148405.log.gz 2023-09-30T22:33:28.564 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164642.log.gz 2023-09-30T22:33:28.564 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136578.log 2023-09-30T22:33:28.564 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194656.log 2023-09-30T22:33:28.564 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183126.log 2023-09-30T22:33:28.564 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194656.log: gzip -5 --verbose -- 88.0%/var/log/ceph/ceph-client.admin.195753.log 2023-09-30T22:33:28.564 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.136578.log.gz 2023-09-30T22:33:28.564 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.194656.log.gz 2023-09-30T22:33:28.564 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157551.log 2023-09-30T22:33:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145330.log 2023-09-30T22:33:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195753.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183126.log.gz 2023-09-30T22:33:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157551.log: gzip 89.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.195753.log.gz-- 2023-09-30T22:33:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193728.log 2023-09-30T22:33:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145330.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157551.log.gz 2023-09-30T22:33:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188227.log 2023-09-30T22:33:28.565 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.145330.log.gz 2023-09-30T22:33:28.565 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193728.log: /var/log/ceph/ceph-client.admin.188227.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193728.log.gz 2023-09-30T22:33:28.566 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188227.log.gz 2023-09-30T22:33:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143715.log 2023-09-30T22:33:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164764.log 2023-09-30T22:33:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124725.log 2023-09-30T22:33:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164764.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143715.log.gz 2023-09-30T22:33:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164398.log 2023-09-30T22:33:28.566 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164764.log.gz 2023-09-30T22:33:28.566 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155345.log 2023-09-30T22:33:28.567 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124725.log.gz 2023-09-30T22:33:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195998.log 2023-09-30T22:33:28.567 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164398.log.gz 2023-09-30T22:33:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155345.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.155345.log.gz 2023-09-30T22:33:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195998.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.195998.log.gz 2023-09-30T22:33:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169128.log 2023-09-30T22:33:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188627.log 2023-09-30T22:33:28.567 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183714.log 2023-09-30T22:33:28.568 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0%/var/log/ceph/ceph-client.admin.188627.log: -- replaced with /var/log/ceph/ceph-client.admin.169128.log.gz 2023-09-30T22:33:28.568 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188627.log.gz 2023-09-30T22:33:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183714.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183714.log.gz 2023-09-30T22:33:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157674.log 2023-09-30T22:33:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170618.log 2023-09-30T22:33:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176749.log 2023-09-30T22:33:28.568 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157674.log.gz 2023-09-30T22:33:28.568 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170618.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170618.log.gz 2023-09-30T22:33:28.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176749.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176749.log.gz 2023-09-30T22:33:28.569 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157701.log 2023-09-30T22:33:28.569 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171998.log 2023-09-30T22:33:28.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187174.log 2023-09-30T22:33:28.569 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157701.log.gz 2023-09-30T22:33:28.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171998.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171998.log.gz 2023-09-30T22:33:28.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187174.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187174.log.gz 2023-09-30T22:33:28.569 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182342.log 2023-09-30T22:33:28.570 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166749.log 2023-09-30T22:33:28.570 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154928.log 2023-09-30T22:33:28.570 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4%/var/log/ceph/ceph-client.admin.166749.log: -- replaced with /var/log/ceph/ceph-client.admin.182342.log.gz 2023-09-30T22:33:28.570 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166749.log.gz 2023-09-30T22:33:28.570 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154928.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154928.log.gz 2023-09-30T22:33:28.570 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155150.log 2023-09-30T22:33:28.570 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147621.log 2023-09-30T22:33:28.571 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181754.log 2023-09-30T22:33:28.571 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2%/var/log/ceph/ceph-client.admin.147621.log: -- replaced with /var/log/ceph/ceph-client.admin.155150.log.gz 2023-09-30T22:33:28.571 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147621.log.gz 2023-09-30T22:33:28.571 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181754.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181754.log.gz 2023-09-30T22:33:28.571 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125286.log 2023-09-30T22:33:28.571 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136333.log 2023-09-30T22:33:28.571 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152966.log 2023-09-30T22:33:28.571 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125286.log.gz 2023-09-30T22:33:28.572 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136333.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136333.log.gz 2023-09-30T22:33:28.572 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152966.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152966.log.gz 2023-09-30T22:33:28.572 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145651.log 2023-09-30T22:33:28.572 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128024.log 2023-09-30T22:33:28.572 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128085.log 2023-09-30T22:33:28.572 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0%/var/log/ceph/ceph-client.admin.128024.log: -- replaced with /var/log/ceph/ceph-client.admin.145651.log.gz 2023-09-30T22:33:28.572 INFO:teuthology.orchestra.run.smithi154.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.128024.log.gz 2023-09-30T22:33:28.572 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128085.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128085.log.gz 2023-09-30T22:33:28.572 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170108.log 2023-09-30T22:33:28.573 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182734.log 2023-09-30T22:33:28.573 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161864.log 2023-09-30T22:33:28.573 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170108.log.gz 2023-09-30T22:33:28.573 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185580.log 2023-09-30T22:33:28.573 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161864.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182734.log.gz 2023-09-30T22:33:28.573 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175526.log 2023-09-30T22:33:28.573 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161864.log.gz 2023-09-30T22:33:28.574 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142858.log 2023-09-30T22:33:28.574 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185580.log.gz 2023-09-30T22:33:28.574 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190412.log 2023-09-30T22:33:28.574 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175526.log: /var/log/ceph/ceph-client.admin.142858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185188.log 2023-09-30T22:33:28.574 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175526.log.gz 2023-09-30T22:33:28.574 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.142858.log.gz 2023-09-30T22:33:28.574 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164960.log 2023-09-30T22:33:28.574 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.190412.log.gz 2023-09-30T22:33:28.575 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136996.log 2023-09-30T22:33:28.575 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164960.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185188.log.gz 2023-09-30T22:33:28.575 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164960.log.gz 2023-09-30T22:33:28.575 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136996.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136996.log.gz 2023-09-30T22:33:28.575 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160343.log 2023-09-30T22:33:28.575 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185039.log 2023-09-30T22:33:28.575 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127161.log 2023-09-30T22:33:28.575 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160343.log.gz 2023-09-30T22:33:28.576 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125580.log 2023-09-30T22:33:28.576 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182640.log 2023-09-30T22:33:28.576 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127161.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.185039.log.gz 2023-09-30T22:33:28.576 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152405.log 2023-09-30T22:33:28.576 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127161.log.gz 2023-09-30T22:33:28.576 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125580.log.gz 2023-09-30T22:33:28.576 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159294.log 2023-09-30T22:33:28.576 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.182640.log.gz 2023-09-30T22:33:28.577 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177094.log 2023-09-30T22:33:28.577 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159294.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152405.log.gz 2023-09-30T22:33:28.577 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153726.log 2023-09-30T22:33:28.577 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159294.log.gz 2023-09-30T22:33:28.577 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177094.log: /var/log/ceph/ceph-client.admin.153726.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.177094.log.gz 2023-09-30T22:33:28.577 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153726.log.gz 2023-09-30T22:33:28.577 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191667.log 2023-09-30T22:33:28.577 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182836.log 2023-09-30T22:33:28.578 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180239.log 2023-09-30T22:33:28.578 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191667.log.gz 2023-09-30T22:33:28.578 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195900.log 2023-09-30T22:33:28.578 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187932.log 2023-09-30T22:33:28.578 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.182836.log.gz 2023-09-30T22:33:28.578 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180239.log: /var/log/ceph/ceph-client.admin.195900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168513.log 2023-09-30T22:33:28.578 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.180239.log.gz 2023-09-30T22:33:28.578 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187932.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.195900.log.gz 2023-09-30T22:33:28.579 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179104.log 2023-09-30T22:33:28.579 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187932.log.gz 2023-09-30T22:33:28.579 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168513.log: /var/log/ceph/ceph-client.admin.179104.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.168513.log.gz 2023-09-30T22:33:28.579 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179104.log.gz 2023-09-30T22:33:28.579 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169912.log 2023-09-30T22:33:28.579 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141145.log 2023-09-30T22:33:28.579 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136235.log 2023-09-30T22:33:28.579 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169912.log.gz 2023-09-30T22:33:28.580 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179896.log 2023-09-30T22:33:28.580 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141145.log.gz 2023-09-30T22:33:28.580 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136235.log: /var/log/ceph/ceph-client.admin.179896.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136235.log.gz 2023-09-30T22:33:28.580 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179896.log.gz 2023-09-30T22:33:28.580 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124578.log 2023-09-30T22:33:28.580 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175181.log 2023-09-30T22:33:28.580 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175134.log 2023-09-30T22:33:28.580 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124578.log.gz 2023-09-30T22:33:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175181.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.175181.log.gz 2023-09-30T22:33:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175134.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175134.log.gz 2023-09-30T22:33:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142296.log 2023-09-30T22:33:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125727.log 2023-09-30T22:33:28.581 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194999.log 2023-09-30T22:33:28.581 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2%/var/log/ceph/ceph-client.admin.125727.log: -- replaced with /var/log/ceph/ceph-client.admin.142296.log.gz 2023-09-30T22:33:28.581 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125727.log.gz 2023-09-30T22:33:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194999.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.194999.log.gz 2023-09-30T22:33:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157126.log 2023-09-30T22:33:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174031.log 2023-09-30T22:33:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192890.log 2023-09-30T22:33:28.582 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157126.log.gz 2023-09-30T22:33:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174031.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174031.log.gz 2023-09-30T22:33:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192890.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192890.log.gz 2023-09-30T22:33:28.582 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162694.log 2023-09-30T22:33:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179447.log 2023-09-30T22:33:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163001.log 2023-09-30T22:33:28.583 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162694.log.gz 2023-09-30T22:33:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179447.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.179447.log.gz 2023-09-30T22:33:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163001.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163001.log.gz 2023-09-30T22:33:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190488.log 2023-09-30T22:33:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166776.log 2023-09-30T22:33:28.583 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158510.log 2023-09-30T22:33:28.584 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5%/var/log/ceph/ceph-client.admin.166776.log: -- replaced with /var/log/ceph/ceph-client.admin.190488.log.gz 2023-09-30T22:33:28.584 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166776.log.gz 2023-09-30T22:33:28.584 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158510.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158510.log.gz 2023-09-30T22:33:28.584 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151933.log 2023-09-30T22:33:28.584 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138448.log 2023-09-30T22:33:28.584 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174619.log 2023-09-30T22:33:28.584 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2%/var/log/ceph/ceph-client.admin.138448.log: -- replaced with /var/log/ceph/ceph-client.admin.151933.log.gz 2023-09-30T22:33:28.584 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138448.log.gz 2023-09-30T22:33:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174619.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174619.log.gz 2023-09-30T22:33:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143297.log 2023-09-30T22:33:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153893.log 2023-09-30T22:33:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146788.log 2023-09-30T22:33:28.585 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143297.log.gz 2023-09-30T22:33:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141759.log 2023-09-30T22:33:28.585 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146788.log: gzip 88.8%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.153893.log.gz/var/log/ceph/ceph-client.admin.127580.log 2023-09-30T22:33:28.585 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-09-30T22:33:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141759.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146788.log.gz 2023-09-30T22:33:28.586 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141759.log.gz 2023-09-30T22:33:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127580.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127580.log.gz 2023-09-30T22:33:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149581.log 2023-09-30T22:33:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147106.log 2023-09-30T22:33:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136041.log 2023-09-30T22:33:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147106.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149581.log.gz 2023-09-30T22:33:28.586 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149046.log 2023-09-30T22:33:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145061.log 2023-09-30T22:33:28.587 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147106.log.gz 2023-09-30T22:33:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149046.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.136041.log.gz--verbose 2023-09-30T22:33:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:-- /var/log/ceph/ceph-client.admin.146051.log 2023-09-30T22:33:28.587 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149046.log.gz 2023-09-30T22:33:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141878.log 2023-09-30T22:33:28.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144697.log 2023-09-30T22:33:28.587 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145061.log.gz 2023-09-30T22:33:28.588 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.146051.log.gz 2023-09-30T22:33:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141878.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141878.log.gz 2023-09-30T22:33:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144697.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.144697.log.gz 2023-09-30T22:33:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155541.log 2023-09-30T22:33:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118504.log 2023-09-30T22:33:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149240.log 2023-09-30T22:33:28.588 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118504.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155541.log.gz 2023-09-30T22:33:28.588 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118504.log.gz 2023-09-30T22:33:28.589 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149240.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.149240.log.gz 2023-09-30T22:33:28.589 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129420.log 2023-09-30T22:33:28.589 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153920.log 2023-09-30T22:33:28.589 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170304.log 2023-09-30T22:33:28.589 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153920.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129420.log.gz 2023-09-30T22:33:28.589 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153920.log.gz 2023-09-30T22:33:28.589 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170304.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170304.log.gz 2023-09-30T22:33:28.590 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191345.log 2023-09-30T22:33:28.590 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151201.log 2023-09-30T22:33:28.590 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147425.log 2023-09-30T22:33:28.590 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.191345.log.gz/var/log/ceph/ceph-client.admin.151201.log: 2023-09-30T22:33:28.677 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151201.log.gz 2023-09-30T22:33:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147425.log: gzip 89.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.147425.log.gz-- 2023-09-30T22:33:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138815.log 2023-09-30T22:33:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167874.log 2023-09-30T22:33:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138815.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138815.log.gz 2023-09-30T22:33:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167874.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167874.log.gz 2023-09-30T22:33:28.678 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165203.log 2023-09-30T22:33:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162802.log 2023-09-30T22:33:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156329.log 2023-09-30T22:33:28.679 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165203.log.gz 2023-09-30T22:33:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193235.log 2023-09-30T22:33:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162802.log: /var/log/ceph/ceph-client.admin.156329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166383.log 2023-09-30T22:33:28.679 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162802.log.gz 2023-09-30T22:33:28.679 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193235.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156329.log.gz 2023-09-30T22:33:28.680 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193235.log.gz 2023-09-30T22:33:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166383.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166383.log.gz 2023-09-30T22:33:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182981.log 2023-09-30T22:33:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174938.log 2023-09-30T22:33:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177290.log 2023-09-30T22:33:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174938.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.182981.log.gz 2023-09-30T22:33:28.680 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177290.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174938.log.gz 2023-09-30T22:33:28.681 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177290.log.gz 2023-09-30T22:33:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159511.log 2023-09-30T22:33:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185896.log 2023-09-30T22:33:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170670.log 2023-09-30T22:33:28.681 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159511.log.gz/var/log/ceph/ceph-client.admin.185896.log: 2023-09-30T22:33:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170670.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185896.log.gz 2023-09-30T22:33:28.681 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170670.log.gz 2023-09-30T22:33:28.681 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195508.log 2023-09-30T22:33:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154136.log 2023-09-30T22:33:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173059.log 2023-09-30T22:33:28.682 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.195508.log.gz 2023-09-30T22:33:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169346.log 2023-09-30T22:33:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155542.log 2023-09-30T22:33:28.682 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.154136.log.gz 2023-09-30T22:33:28.682 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169346.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.173059.log.gz 2023-09-30T22:33:28.683 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147964.log 2023-09-30T22:33:28.683 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169346.log.gz/var/log/ceph/ceph-client.admin.155542.log: 2023-09-30T22:33:28.683 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155542.log.gz 2023-09-30T22:33:28.683 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147964.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147964.log.gz 2023-09-30T22:33:28.683 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152769.log 2023-09-30T22:33:28.683 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163836.log 2023-09-30T22:33:28.683 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187540.log 2023-09-30T22:33:28.683 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2%/var/log/ceph/ceph-client.admin.163836.log: -- replaced with /var/log/ceph/ceph-client.admin.152769.log.gz 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124333.log 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163836.log.gz 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166946.log 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.187540.log.gz 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150612.log 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124333.log.gz 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166946.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166946.log.gz 2023-09-30T22:33:28.684 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150612.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150612.log.gz 2023-09-30T22:33:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143741.log 2023-09-30T22:33:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163954.log 2023-09-30T22:33:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158314.log 2023-09-30T22:33:28.685 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143741.log.gz 2023-09-30T22:33:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163954.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163954.log.gz 2023-09-30T22:33:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158314.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158314.log.gz 2023-09-30T22:33:28.685 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145455.log 2023-09-30T22:33:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128555.log 2023-09-30T22:33:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157821.log 2023-09-30T22:33:28.686 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145455.log.gz 2023-09-30T22:33:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128555.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128555.log.gz 2023-09-30T22:33:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157821.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157821.log.gz 2023-09-30T22:33:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126739.log 2023-09-30T22:33:28.686 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189116.log 2023-09-30T22:33:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.126739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136139.log 2023-09-30T22:33:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152521.log 2023-09-30T22:33:28.687 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.126739.log.gz 2023-09-30T22:33:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136139.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189116.log.gz 2023-09-30T22:33:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129322.log 2023-09-30T22:33:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152521.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.136139.log.gz 2023-09-30T22:33:28.687 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151149.log 2023-09-30T22:33:28.688 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152521.log.gz 2023-09-30T22:33:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129322.log: /var/log/ceph/ceph-client.admin.151149.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129322.log.gz 2023-09-30T22:33:28.688 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151149.log.gz 2023-09-30T22:33:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138985.log 2023-09-30T22:33:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181023.log 2023-09-30T22:33:28.688 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168070.log 2023-09-30T22:33:28.688 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138985.log.gz 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166945.log 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179522.log 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.181023.log.gz 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138181.log 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166945.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168070.log.gz 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179522.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166945.log.gz 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194311.log 2023-09-30T22:33:28.689 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179522.log.gz 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150506.log 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172416.log 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138181.log.gz 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150506.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194311.log.gz 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165575.log 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150506.log.gz 2023-09-30T22:33:28.690 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172416.log: /var/log/ceph/ceph-client.admin.165575.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172416.log.gz 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165575.log.gz 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185674.log 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155910.log 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184404.log 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185674.log: /var/log/ceph/ceph-client.admin.155910.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185674.log.gz 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.155910.log.gz 2023-09-30T22:33:28.691 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184404.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.184404.log.gz 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192965.log 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172097.log 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139998.log 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8%/var/log/ceph/ceph-client.admin.172097.log: -- replaced with /var/log/ceph/ceph-client.admin.192965.log.gz 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172097.log.gz 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139998.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139998.log.gz 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139207.log 2023-09-30T22:33:28.692 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178271.log 2023-09-30T22:33:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161032.log 2023-09-30T22:33:28.693 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8%/var/log/ceph/ceph-client.admin.178271.log: -- replaced with /var/log/ceph/ceph-client.admin.139207.log.gz 2023-09-30T22:33:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183961.log 2023-09-30T22:33:28.693 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178271.log.gz 2023-09-30T22:33:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161032.log: /var/log/ceph/ceph-client.admin.183961.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161032.log.gz 2023-09-30T22:33:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-09-30T22:33:28.693 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183961.log.gz 2023-09-30T22:33:28.693 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188128.log 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178001.log 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188580.log 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178001.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188128.log.gz 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178001.log.gz 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188580.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188580.log.gz 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166332.log 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164261.log 2023-09-30T22:33:28.694 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184600.log 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164261.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166332.log.gz 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184600.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164261.log.gz 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184600.log.gz 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139134.log 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185514.log 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118872.log 2023-09-30T22:33:28.695 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185514.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139134.log.gz 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118872.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.185514.log.gz 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118872.log.gz 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155124.log 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122314.log 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124921.log 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122314.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155124.log.gz 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124921.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122314.log.gz 2023-09-30T22:33:28.696 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124921.log.gz 2023-09-30T22:33:28.697 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137422.log 2023-09-30T22:33:28.697 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175965.log 2023-09-30T22:33:28.697 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137422.log: /var/log/ceph/ceph-client.admin.175965.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137422.log.gz 2023-09-30T22:33:28.697 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175965.log.gz 2023-09-30T22:33:28.697 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170696.log 2023-09-30T22:33:28.697 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143885.log 2023-09-30T22:33:28.697 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160026.log 2023-09-30T22:33:28.698 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143885.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.170696.log.gz 2023-09-30T22:33:28.698 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143885.log.gz 2023-09-30T22:33:28.698 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160026.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.160026.log.gz 2023-09-30T22:33:28.698 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154391.log 2023-09-30T22:33:28.698 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180510.log 2023-09-30T22:33:28.698 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187836.log 2023-09-30T22:33:28.698 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180510.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.154391.log.gz 2023-09-30T22:33:28.698 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187836.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180510.log.gz 2023-09-30T22:33:28.699 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.187836.log.gz 2023-09-30T22:33:28.699 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182538.log 2023-09-30T22:33:28.699 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180145.log 2023-09-30T22:33:28.699 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140339.log 2023-09-30T22:33:28.699 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180145.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182538.log.gz 2023-09-30T22:33:28.699 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.180145.log.gz 2023-09-30T22:33:28.699 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140339.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140339.log.gz 2023-09-30T22:33:28.700 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170056.log 2023-09-30T22:33:28.700 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171632.log 2023-09-30T22:33:28.700 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148654.log 2023-09-30T22:33:28.700 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171632.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170056.log.gz 2023-09-30T22:33:28.700 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148654.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171632.log.gz 2023-09-30T22:33:28.700 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.148654.log.gz 2023-09-30T22:33:28.700 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193337.log 2023-09-30T22:33:28.700 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177337.log 2023-09-30T22:33:28.701 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162060.log 2023-09-30T22:33:28.701 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177337.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.193337.log.gz 2023-09-30T22:33:28.701 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162060.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177337.log.gz 2023-09-30T22:33:28.701 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162060.log.gz 2023-09-30T22:33:28.701 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140949.log 2023-09-30T22:33:28.701 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128950.log 2023-09-30T22:33:28.701 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140949.log: /var/log/ceph/ceph-client.admin.128950.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140949.log.gz 2023-09-30T22:33:28.701 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145881.log 2023-09-30T22:33:28.702 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128950.log.gz 2023-09-30T22:33:28.702 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136065.log 2023-09-30T22:33:28.702 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145881.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145881.log.gz/var/log/ceph/ceph-client.admin.136065.log: 2023-09-30T22:33:28.702 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136065.log.gz 2023-09-30T22:33:28.702 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195103.log 2023-09-30T22:33:28.702 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144107.log 2023-09-30T22:33:28.702 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195244.log 2023-09-30T22:33:28.703 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144107.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195103.log.gz 2023-09-30T22:33:28.703 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144107.log.gz 2023-09-30T22:33:28.703 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195244.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.195244.log.gz 2023-09-30T22:33:28.703 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152129.log 2023-09-30T22:33:28.703 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158092.log 2023-09-30T22:33:28.703 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152129.log: /var/log/ceph/ceph-client.admin.158092.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152129.log.gz 2023-09-30T22:33:28.703 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158092.log.gz 2023-09-30T22:33:28.704 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128788.log 2023-09-30T22:33:28.704 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187444.log 2023-09-30T22:33:28.704 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155714.log 2023-09-30T22:33:28.704 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187444.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128788.log.gz 2023-09-30T22:33:28.704 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155714.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187444.log.gz 2023-09-30T22:33:28.704 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155714.log.gz 2023-09-30T22:33:28.704 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193899.log 2023-09-30T22:33:28.704 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190804.log 2023-09-30T22:33:28.705 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177590.log 2023-09-30T22:33:28.705 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190804.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.193899.log.gz 2023-09-30T22:33:28.705 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190804.log.gz 2023-09-30T22:33:28.705 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177590.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.177590.log.gz 2023-09-30T22:33:28.705 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171313.log 2023-09-30T22:33:28.705 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152325.log 2023-09-30T22:33:28.705 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.171313.log: -- /var/log/ceph/ceph-client.admin.165796.log 2023-09-30T22:33:28.705 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152325.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171313.log.gz 2023-09-30T22:33:28.706 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152325.log.gz 2023-09-30T22:33:28.706 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165796.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165796.log.gz 2023-09-30T22:33:28.706 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162182.log 2023-09-30T22:33:28.706 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158312.log 2023-09-30T22:33:28.706 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162182.log: /var/log/ceph/ceph-client.admin.158312.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.162182.log.gz 2023-09-30T22:33:28.706 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158312.log.gz 2023-09-30T22:33:28.706 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178859.log 2023-09-30T22:33:28.706 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151345.log 2023-09-30T22:33:28.707 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178859.log: /var/log/ceph/ceph-client.admin.151345.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178859.log.gz 2023-09-30T22:33:28.707 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151345.log.gz 2023-09-30T22:33:28.707 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151371.log 2023-09-30T22:33:28.707 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194925.log 2023-09-30T22:33:28.707 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185086.log 2023-09-30T22:33:28.707 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194925.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151371.log.gz 2023-09-30T22:33:28.707 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185086.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194925.log.gz 2023-09-30T22:33:28.708 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124480.log 2023-09-30T22:33:28.708 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185086.log.gz 2023-09-30T22:33:28.708 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150416.log 2023-09-30T22:33:28.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124480.log: /var/log/ceph/ceph-client.admin.150416.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124480.log.gz 2023-09-30T22:33:28.708 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137621.log 2023-09-30T22:33:28.708 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150416.log.gz 2023-09-30T22:33:28.708 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176114.log 2023-09-30T22:33:28.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137621.log: /var/log/ceph/ceph-client.admin.176114.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137621.log.gz 2023-09-30T22:33:28.709 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164202.log 2023-09-30T22:33:28.709 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.176114.log.gz 2023-09-30T22:33:28.709 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174058.log 2023-09-30T22:33:28.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136825.log 2023-09-30T22:33:28.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174058.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164202.log.gz 2023-09-30T22:33:28.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136825.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174058.log.gz 2023-09-30T22:33:28.709 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136825.log.gz 2023-09-30T22:33:28.709 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160810.log 2023-09-30T22:33:28.710 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195121.log 2023-09-30T22:33:28.710 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160810.log: /var/log/ceph/ceph-client.admin.195121.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160810.log.gz 2023-09-30T22:33:28.710 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.195121.log.gz 2023-09-30T22:33:28.710 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158313.log 2023-09-30T22:33:28.710 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164542.log 2023-09-30T22:33:28.710 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158313.log: /var/log/ceph/ceph-client.admin.164542.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158313.log.gz 2023-09-30T22:33:28.710 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164542.log.gz 2023-09-30T22:33:28.711 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135868.log 2023-09-30T22:33:28.711 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165353.log 2023-09-30T22:33:28.711 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160222.log 2023-09-30T22:33:28.711 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179157.log 88.5% 2023-09-30T22:33:28.711 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135868.log.gz 2023-09-30T22:33:28.711 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160222.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165353.log.gz 2023-09-30T22:33:28.711 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179157.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160222.log.gz 2023-09-30T22:33:28.711 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170500.log 2023-09-30T22:33:28.712 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179157.log.gz 2023-09-30T22:33:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152743.log 2023-09-30T22:33:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170500.log: /var/log/ceph/ceph-client.admin.152743.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.170500.log.gz 2023-09-30T22:33:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173566.log 2023-09-30T22:33:28.712 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152743.log.gz 2023-09-30T22:33:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146198.log 2023-09-30T22:33:28.712 INFO:teuthology.orchestra.run.smithi154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-30T22:33:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175573.log 2023-09-30T22:33:28.712 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146198.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173566.log.gz 2023-09-30T22:33:28.713 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180680.log 2023-09-30T22:33:28.713 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.146198.log.gz 2023-09-30T22:33:28.713 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175573.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175573.log.gz 2023-09-30T22:33:28.713 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148993.log 2023-09-30T22:33:28.713 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194019.log 2023-09-30T22:33:28.713 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180680.log.gz 2023-09-30T22:33:28.713 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123057.log 2023-09-30T22:33:28.714 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194019.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148993.log.gz 2023-09-30T22:33:28.714 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123057.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194019.log.gz 2023-09-30T22:33:28.714 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193674.log 2023-09-30T22:33:28.714 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123057.log.gz 2023-09-30T22:33:28.714 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186659.log 2023-09-30T22:33:28.714 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159559.log 2023-09-30T22:33:28.714 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193674.log.gz 2023-09-30T22:33:28.714 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169638.log 2023-09-30T22:33:28.715 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125335.log 2023-09-30T22:33:28.715 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186659.log.gz 2023-09-30T22:33:28.715 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169638.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159559.log.gz 2023-09-30T22:33:28.715 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137592.log 2023-09-30T22:33:28.715 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169638.log.gz 2023-09-30T22:33:28.715 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125335.log: /var/log/ceph/ceph-client.admin.137592.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125335.log.gz 2023-09-30T22:33:28.715 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137592.log.gz 2023-09-30T22:33:28.715 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144726.log 2023-09-30T22:33:28.716 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123353.log 2023-09-30T22:33:28.716 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183910.log 2023-09-30T22:33:28.716 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123353.log: gzip -5 88.0%--verbose -- /var/log/ceph/ceph-client.admin.171010.log -- replaced with /var/log/ceph/ceph-client.admin.144726.log.gz 2023-09-30T22:33:28.716 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-09-30T22:33:28.716 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142884.log 2023-09-30T22:33:28.716 INFO:teuthology.orchestra.run.smithi154.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123353.log.gz 2023-09-30T22:33:28.716 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171010.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183910.log.gz 2023-09-30T22:33:28.717 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.171010.log.gz 2023-09-30T22:33:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142884.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142884.log.gz 2023-09-30T22:33:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160661.log 2023-09-30T22:33:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140017.log 2023-09-30T22:33:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122604.log 2023-09-30T22:33:28.717 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.160661.log.gz 2023-09-30T22:33:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140017.log: /var/log/ceph/ceph-client.admin.122604.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140017.log.gz 2023-09-30T22:33:28.717 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- 87.7%/var/log/ceph/ceph-client.admin.165522.log 2023-09-30T22:33:28.718 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.122604.log.gz 2023-09-30T22:33:28.718 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189534.log 2023-09-30T22:33:28.718 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187370.log 2023-09-30T22:33:28.718 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165522.log.gz 2023-09-30T22:33:28.718 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163047.log 2023-09-30T22:33:28.718 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.189534.log.gz 2023-09-30T22:33:28.718 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139821.log 2023-09-30T22:33:28.719 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187370.log.gz 2023-09-30T22:33:28.719 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141565.log 2023-09-30T22:33:28.719 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163047.log.gz 2023-09-30T22:33:28.719 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182589.log 2023-09-30T22:33:28.719 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139821.log.gz 2023-09-30T22:33:28.719 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141565.log: /var/log/ceph/ceph-client.admin.182589.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141565.log.gz 2023-09-30T22:33:28.719 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.182589.log.gz 2023-09-30T22:33:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137788.log 2023-09-30T22:33:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157282.log 2023-09-30T22:33:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178393.log 2023-09-30T22:33:28.720 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.137788.log.gz 2023-09-30T22:33:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157282.log: /var/log/ceph/ceph-client.admin.178393.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157282.log.gz 2023-09-30T22:33:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191518.log 2023-09-30T22:33:28.720 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178393.log.gz 2023-09-30T22:33:28.720 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191961.log 2023-09-30T22:33:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162406.log 2023-09-30T22:33:28.721 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191518.log.gz 2023-09-30T22:33:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191961.log: /var/log/ceph/ceph-client.admin.162406.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191961.log.gz 2023-09-30T22:33:28.721 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162406.log.gz 2023-09-30T22:33:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141956.log 2023-09-30T22:33:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141904.log 2023-09-30T22:33:28.721 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.141956.log: -- /var/log/ceph/ceph-client.admin.161424.log 2023-09-30T22:33:28.722 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3%/var/log/ceph/ceph-client.admin.141904.log: -- replaced with /var/log/ceph/ceph-client.admin.141956.log.gz 2023-09-30T22:33:28.722 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138057.log 2023-09-30T22:33:28.722 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136853.log 2023-09-30T22:33:28.722 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141904.log.gz 2023-09-30T22:33:28.722 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138057.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161424.log.gzgzip 2023-09-30T22:33:28.722 INFO:teuthology.orchestra.run.smithi154.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.178542.log 2023-09-30T22:33:28.722 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136853.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138057.log.gz 2023-09-30T22:33:28.722 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136853.log.gz 2023-09-30T22:33:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178542.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178542.log.gz 2023-09-30T22:33:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171436.log 2023-09-30T22:33:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175011.log 2023-09-30T22:33:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168541.log 2023-09-30T22:33:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175011.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171436.log.gz 2023-09-30T22:33:28.723 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175011.log.gz 2023-09-30T22:33:28.723 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168541.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168541.log.gz 2023-09-30T22:33:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179549.log 2023-09-30T22:33:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186464.log 2023-09-30T22:33:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143080.log 2023-09-30T22:33:28.724 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6%/var/log/ceph/ceph-client.admin.186464.log: -- replaced with /var/log/ceph/ceph-client.admin.179549.log.gz 2023-09-30T22:33:28.724 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186464.log.gz 2023-09-30T22:33:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143080.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143080.log.gz 2023-09-30T22:33:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185282.log 2023-09-30T22:33:28.724 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185410.log 2023-09-30T22:33:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186586.log 2023-09-30T22:33:28.725 INFO:teuthology.orchestra.run.smithi154.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.185282.log.gz 2023-09-30T22:33:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185410.log: /var/log/ceph/ceph-client.admin.186586.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.185410.log.gz 2023-09-30T22:33:28.725 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.186586.log.gz 2023-09-30T22:33:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174397.log 2023-09-30T22:33:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178467.log 2023-09-30T22:33:28.725 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186390.log 2023-09-30T22:33:28.726 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174397.log.gz 2023-09-30T22:33:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178467.log: /var/log/ceph/ceph-client.admin.186390.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178467.log.gz 2023-09-30T22:33:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188920.log 2023-09-30T22:33:28.726 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186390.log.gz 2023-09-30T22:33:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136774.log 2023-09-30T22:33:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129469.log 2023-09-30T22:33:28.726 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188920.log.gz 2023-09-30T22:33:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177533.log 2023-09-30T22:33:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192573.log 2023-09-30T22:33:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129469.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136774.log.gz 2023-09-30T22:33:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168317.log 2023-09-30T22:33:28.727 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129469.log.gz 2023-09-30T22:33:28.727 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177533.log.gz 2023-09-30T22:33:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192573.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192573.log.gz 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168317.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168317.log.gz 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160164.log 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144622.log 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161079.log 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144622.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160164.log.gz 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165244.log 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.144622.log.gz 2023-09-30T22:33:28.728 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181464.log 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165244.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.161079.log.gz 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167167.log 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165244.log.gz 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181464.log: /var/log/ceph/ceph-client.admin.167167.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181464.log.gz 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167167.log.gz 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165744.log 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186092.log 2023-09-30T22:33:28.729 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143911.log 2023-09-30T22:33:28.730 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165744.log.gz 2023-09-30T22:33:28.730 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161670.log 2023-09-30T22:33:28.730 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163223.log 2023-09-30T22:33:28.730 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.186092.log.gz 2023-09-30T22:33:28.730 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143911.log: /var/log/ceph/ceph-client.admin.161670.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.143911.log.gz 2023-09-30T22:33:28.730 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161670.log.gz 2023-09-30T22:33:28.730 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163223.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163223.log.gz 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167311.log 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122363.log 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189730.log 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122363.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167311.log.gz 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi154.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122363.log.gz 2023-09-30T22:33:28.731 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189730.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189730.log.gz 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137022.log 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181609.log 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165718.log 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181609.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137022.log.gz 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.181609.log.gz 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165718.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165718.log.gz 2023-09-30T22:33:28.732 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140409.log 2023-09-30T22:33:28.733 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-09-30T22:33:28.733 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168318.log 2023-09-30T22:33:28.733 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2%/var/log/ceph/ceph-mon.b.log: -- replaced with /var/log/ceph/ceph-client.admin.140409.log.gz 2023-09-30T22:33:28.733 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161275.log 2023-09-30T22:33:28.733 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178516.log 2023-09-30T22:33:28.733 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168318.log.gz 2023-09-30T22:33:28.733 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161275.log: 88.7%/var/log/ceph/ceph-client.admin.178516.log: -- replaced with /var/log/ceph/ceph-client.admin.161275.log.gz 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178516.log.gz 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151094.log 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155177.log 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138376.log 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155177.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151094.log.gz 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138376.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.155177.log.gz 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138376.log.gz 2023-09-30T22:33:28.734 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127216.log 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143642.log 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149829.log 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143642.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127216.log.gz 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149829.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.143642.log.gz 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149829.log.gz 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124431.log 2023-09-30T22:33:28.735 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146714.log 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124431.log: /var/log/ceph/ceph-client.admin.146714.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124431.log.gz 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146714.log.gz 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167951.log 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.167951.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167951.log.gz 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188750.log 2023-09-30T22:33:28.736 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188750.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188750.log.gz 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143519.log 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143519.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143519.log.gz 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156841.log 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156841.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156841.log.gz 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184351.log 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184351.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184351.log.gz 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145089.log 2023-09-30T22:33:28.737 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145089.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145089.log.gz 2023-09-30T22:33:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136653.log 2023-09-30T22:33:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136653.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136653.log.gz 2023-09-30T22:33:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153602.log 2023-09-30T22:33:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153602.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.153602.log.gz 2023-09-30T22:33:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164594.log 2023-09-30T22:33:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164594.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164594.log.gz 2023-09-30T22:33:28.738 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188993.log 2023-09-30T22:33:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127151.log 2023-09-30T22:33:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188993.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188993.log.gz 2023-09-30T22:33:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176187.log 2023-09-30T22:33:28.739 INFO:teuthology.orchestra.run.smithi154.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127151.log.gz 2023-09-30T22:33:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168149.log 2023-09-30T22:33:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176187.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176187.log.gz 2023-09-30T22:33:28.739 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130678.log 2023-09-30T22:33:28.739 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168149.log.gz 2023-09-30T22:33:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161228.log 2023-09-30T22:33:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130678.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130678.log.gz 2023-09-30T22:33:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154732.log 2023-09-30T22:33:28.740 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161228.log.gz 2023-09-30T22:33:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175918.log 2023-09-30T22:33:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154732.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154732.log.gz 2023-09-30T22:33:28.740 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175918.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175918.log.gz 2023-09-30T22:33:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138253.log 2023-09-30T22:33:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138253.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138253.log.gz 2023-09-30T22:33:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145724.log 2023-09-30T22:33:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145724.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.145724.log.gz 2023-09-30T22:33:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156767.log 2023-09-30T22:33:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156767.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156767.log.gz 2023-09-30T22:33:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193431.log 2023-09-30T22:33:28.741 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193431.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193431.log.gz 2023-09-30T22:33:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130081.log 2023-09-30T22:33:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130081.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130081.log.gz 2023-09-30T22:33:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172808.log 2023-09-30T22:33:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172808.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.172808.log.gz 2023-09-30T22:33:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174593.log 2023-09-30T22:33:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.174593.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174593.log.gz 2023-09-30T22:33:28.742 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157159.log 2023-09-30T22:33:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157159.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157159.log.gz 2023-09-30T22:33:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178197.log 2023-09-30T22:33:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178197.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178197.log.gz 2023-09-30T22:33:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148263.log 2023-09-30T22:33:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148263.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148263.log.gz 2023-09-30T22:33:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194460.log 2023-09-30T22:33:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194460.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194460.log.gz 2023-09-30T22:33:28.743 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176161.log 2023-09-30T22:33:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176161.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176161.log.gz 2023-09-30T22:33:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173203.log 2023-09-30T22:33:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173203.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173203.log.gz 2023-09-30T22:33:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158795.log 2023-09-30T22:33:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158795.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158795.log.gz 2023-09-30T22:33:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139555.log 2023-09-30T22:33:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139555.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139555.log.gz 2023-09-30T22:33:28.744 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189926.log 2023-09-30T22:33:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189926.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189926.log.gz 2023-09-30T22:33:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157747.log 2023-09-30T22:33:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157747.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157747.log.gz 2023-09-30T22:33:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192917.log 2023-09-30T22:33:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192917.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192917.log.gz 2023-09-30T22:33:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123549.log 2023-09-30T22:33:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123549.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123549.log.gz 2023-09-30T22:33:28.745 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171530.log 2023-09-30T22:33:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171530.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171530.log.gz 2023-09-30T22:33:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177758.log 2023-09-30T22:33:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177758.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177758.log.gz 2023-09-30T22:33:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178589.log 2023-09-30T22:33:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178589.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178589.log.gz 2023-09-30T22:33:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176898.log 2023-09-30T22:33:28.746 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176898.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176898.log.gz 2023-09-30T22:33:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145136.log 2023-09-30T22:33:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145136.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145136.log.gz 2023-09-30T22:33:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139233.log 2023-09-30T22:33:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139233.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139233.log.gz 2023-09-30T22:33:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145210.log 2023-09-30T22:33:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145210.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.145210.log.gz 2023-09-30T22:33:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180435.log 2023-09-30T22:33:28.747 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180435.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180435.log.gz 2023-09-30T22:33:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151567.log 2023-09-30T22:33:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151567.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151567.log.gz 2023-09-30T22:33:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130170.log 2023-09-30T22:33:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130170.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130170.log.gz 2023-09-30T22:33:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172289.log 2023-09-30T22:33:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172289.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.172289.log.gz 2023-09-30T22:33:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173398.log 2023-09-30T22:33:28.748 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173398.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173398.log.gz 2023-09-30T22:33:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154489.log 2023-09-30T22:33:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154489.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154489.log.gz 2023-09-30T22:33:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194703.log 2023-09-30T22:33:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194703.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194703.log.gz 2023-09-30T22:33:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171606.log 2023-09-30T22:33:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171606.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171606.log.gz 2023-09-30T22:33:28.749 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168736.log 2023-09-30T22:33:28.750 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159775.log 2023-09-30T22:33:28.750 INFO:teuthology.orchestra.run.smithi154.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-09-30T22:33:28.750 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168736.log: /var/log/ceph/ceph-client.admin.159775.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168736.log.gz 2023-09-30T22:33:28.750 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159775.log.gz 2023-09-30T22:33:28.750 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159707.log 2023-09-30T22:33:28.750 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144303.log 2023-09-30T22:33:28.750 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159707.log: /var/log/ceph/ceph-client.admin.144303.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159707.log.gz 2023-09-30T22:33:28.750 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.144303.log.gz 2023-09-30T22:33:28.751 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150953.log 2023-09-30T22:33:28.751 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188154.log 2023-09-30T22:33:28.751 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150953.log: /var/log/ceph/ceph-client.admin.188154.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150953.log.gz 2023-09-30T22:33:28.751 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188154.log.gz 2023-09-30T22:33:28.751 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156890.log 2023-09-30T22:33:28.751 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195704.log 2023-09-30T22:33:28.751 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156890.log: /var/log/ceph/ceph-client.admin.195704.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.156890.log.gz 2023-09-30T22:33:28.752 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.195704.log.gz 2023-09-30T22:33:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147033.log 2023-09-30T22:33:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147843.log 2023-09-30T22:33:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147033.log: /var/log/ceph/ceph-client.admin.147843.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.147033.log.gz 2023-09-30T22:33:28.752 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147843.log.gz 2023-09-30T22:33:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146002.log 2023-09-30T22:33:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140506.log 2023-09-30T22:33:28.752 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146002.log: /var/log/ceph/ceph-client.admin.140506.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.146002.log.gz 2023-09-30T22:33:28.753 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140506.log.gz 2023-09-30T22:33:28.753 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-09-30T22:33:28.753 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194215.log 2023-09-30T22:33:28.753 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.194215.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194215.log.gz 2023-09-30T22:33:28.753 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118607.log 2023-09-30T22:33:28.753 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118607.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118607.log.gz 2023-09-30T22:33:28.753 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184498.log 2023-09-30T22:33:28.753 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184498.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.184498.log.gz 2023-09-30T22:33:28.754 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152913.log 2023-09-30T22:33:28.754 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152913.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152913.log.gz 2023-09-30T22:33:28.754 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159097.log 2023-09-30T22:33:28.754 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156963.log 2023-09-30T22:33:28.754 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159097.log: /var/log/ceph/ceph-client.admin.156963.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159097.log.gz 2023-09-30T22:33:28.754 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156963.log.gz 2023-09-30T22:33:28.754 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189142.log 2023-09-30T22:33:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189142.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189142.log.gz 2023-09-30T22:33:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178775.log 2023-09-30T22:33:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178775.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178775.log.gz 2023-09-30T22:33:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166306.log 2023-09-30T22:33:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166306.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166306.log.gz 2023-09-30T22:33:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180827.log 2023-09-30T22:33:28.755 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180827.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180827.log.gz 2023-09-30T22:33:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162974.log 2023-09-30T22:33:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162974.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162974.log.gz 2023-09-30T22:33:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166188.log 2023-09-30T22:33:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166188.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166188.log.gz 2023-09-30T22:33:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142322.log 2023-09-30T22:33:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142322.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142322.log.gz 2023-09-30T22:33:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188376.log 2023-09-30T22:33:28.756 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188376.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.188376.log.gz 2023-09-30T22:33:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139330.log 2023-09-30T22:33:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139330.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139330.log.gz 2023-09-30T22:33:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171410.log 2023-09-30T22:33:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171410.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171410.log.gz 2023-09-30T22:33:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136459.log 2023-09-30T22:33:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136459.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.136459.log.gz 2023-09-30T22:33:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160857.log 2023-09-30T22:33:28.757 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160857.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.160857.log.gz 2023-09-30T22:33:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137227.log 2023-09-30T22:33:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137227.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137227.log.gz 2023-09-30T22:33:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171878.log 2023-09-30T22:33:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171878.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171878.log.gz 2023-09-30T22:33:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157318.log 2023-09-30T22:33:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157318.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157318.log.gz 2023-09-30T22:33:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175991.log 2023-09-30T22:33:28.758 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175991.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175991.log.gz 2023-09-30T22:33:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193533.log 2023-09-30T22:33:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193533.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.193533.log.gz 2023-09-30T22:33:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124017.log 2023-09-30T22:33:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150365.log 2023-09-30T22:33:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124017.log: /var/log/ceph/ceph-client.admin.150365.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124017.log.gz 2023-09-30T22:33:28.759 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150365.log.gz 2023-09-30T22:33:28.759 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175795.log 2023-09-30T22:33:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175795.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.175795.log.gz 2023-09-30T22:33:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142126.log 2023-09-30T22:33:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142126.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.142126.log.gz 2023-09-30T22:33:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165991.log 2023-09-30T22:33:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165991.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.165991.log.gz 2023-09-30T22:33:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186288.log 2023-09-30T22:33:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186288.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.186288.log.gz 2023-09-30T22:33:28.760 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177732.log 2023-09-30T22:33:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177732.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177732.log.gz 2023-09-30T22:33:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190710.log 2023-09-30T22:33:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190710.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190710.log.gz 2023-09-30T22:33:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129910.log 2023-09-30T22:33:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129910.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129910.log.gz 2023-09-30T22:33:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162647.log 2023-09-30T22:33:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162647.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162647.log.gz 2023-09-30T22:33:28.761 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183032.log 2023-09-30T22:33:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183032.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.183032.log.gz 2023-09-30T22:33:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149532.log 2023-09-30T22:33:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149532.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.149532.log.gz 2023-09-30T22:33:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182276.log 2023-09-30T22:33:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182276.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.182276.log.gz 2023-09-30T22:33:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135794.log 2023-09-30T22:33:28.762 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135794.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135794.log.gz 2023-09-30T22:33:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172685.log 2023-09-30T22:33:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172685.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172685.log.gz 2023-09-30T22:33:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165044.log 2023-09-30T22:33:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165044.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165044.log.gz 2023-09-30T22:33:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128463.log 2023-09-30T22:33:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128463.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128463.log.gz 2023-09-30T22:33:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144426.log 2023-09-30T22:33:28.763 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144426.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.144426.log.gz 2023-09-30T22:33:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176606.log 2023-09-30T22:33:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176606.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.176606.log.gz 2023-09-30T22:33:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187789.log 2023-09-30T22:33:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187789.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187789.log.gz 2023-09-30T22:33:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157037.log 2023-09-30T22:33:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157037.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157037.log.gz 2023-09-30T22:33:28.764 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122555.log 2023-09-30T22:33:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122555.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122555.log.gz 2023-09-30T22:33:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169272.log 2023-09-30T22:33:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169272.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169272.log.gz 2023-09-30T22:33:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169542.log 2023-09-30T22:33:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169542.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169542.log.gz 2023-09-30T22:33:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189607.log 2023-09-30T22:33:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189607.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.189607.log.gz 2023-09-30T22:33:28.765 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144081.log 2023-09-30T22:33:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144081.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144081.log.gz 2023-09-30T22:33:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192106.log 2023-09-30T22:33:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192106.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.192106.log.gz 2023-09-30T22:33:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123500.log 2023-09-30T22:33:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123500.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.123500.log.gz 2023-09-30T22:33:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188581.log 2023-09-30T22:33:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188581.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.188581.log.gz 2023-09-30T22:33:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194068.log 2023-09-30T22:33:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194068.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.194068.log.gz 2023-09-30T22:33:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173788.log 2023-09-30T22:33:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173788.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173788.log.gz 2023-09-30T22:33:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196096.log 2023-09-30T22:33:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196096.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.196096.log.gz 2023-09-30T22:33:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186459.log 2023-09-30T22:33:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186459.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186459.log.gz 2023-09-30T22:33:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171483.log 2023-09-30T22:33:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171483.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171483.log.gz 2023-09-30T22:33:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162302.log 2023-09-30T22:33:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162302.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162302.log.gz 2023-09-30T22:33:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151290.log 2023-09-30T22:33:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151290.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151290.log.gz 2023-09-30T22:33:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186856.log 2023-09-30T22:33:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186856.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186856.log.gz 2023-09-30T22:33:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127446.log 2023-09-30T22:33:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127446.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127446.log.gz 2023-09-30T22:33:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149436.log 2023-09-30T22:33:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149436.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149436.log.gz 2023-09-30T22:33:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175599.log 2023-09-30T22:33:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175599.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175599.log.gz 2023-09-30T22:33:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172684.log 2023-09-30T22:33:28.769 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.172684.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172684.log.gz 2023-09-30T22:33:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178075.log 2023-09-30T22:33:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178075.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.178075.log.gz 2023-09-30T22:33:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147255.log 2023-09-30T22:33:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147255.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147255.log.gz 2023-09-30T22:33:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155374.log 2023-09-30T22:33:28.770 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155374.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155374.log.gz 2023-09-30T22:33:28.771 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-30T22:33:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138645.log 2023-09-30T22:33:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172293.log 2023-09-30T22:33:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138645.log: /var/log/ceph/ceph-client.admin.172293.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138645.log.gz 2023-09-30T22:33:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181950.log 2023-09-30T22:33:28.771 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172293.log.gz 2023-09-30T22:33:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148627.log 2023-09-30T22:33:28.771 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181950.log: /var/log/ceph/ceph-client.admin.148627.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181950.log.gz 2023-09-30T22:33:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146273.log 2023-09-30T22:33:28.772 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148627.log.gz 2023-09-30T22:33:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147489.log 2023-09-30T22:33:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146273.log: /var/log/ceph/ceph-client.admin.147489.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146273.log.gz 2023-09-30T22:33:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138546.log 2023-09-30T22:33:28.772 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147489.log.gz 2023-09-30T22:33:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184156.log 2023-09-30T22:33:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138546.log: /var/log/ceph/ceph-client.admin.184156.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138546.log.gz 2023-09-30T22:33:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173878.log 2023-09-30T22:33:28.773 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184156.log.gz 2023-09-30T22:33:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160883.log 2023-09-30T22:33:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148209.log 2023-09-30T22:33:28.773 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173878.log.gz 2023-09-30T22:33:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158991.log 2023-09-30T22:33:28.773 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148209.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.160883.log.gz 2023-09-30T22:33:28.774 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148209.log.gz 2023-09-30T22:33:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158991.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158991.log.gz 2023-09-30T22:33:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125433.log 2023-09-30T22:33:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150222.log 2023-09-30T22:33:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125433.log: /var/log/ceph/ceph-client.admin.150222.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125433.log.gz 2023-09-30T22:33:28.774 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150222.log.gz 2023-09-30T22:33:28.774 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-30T22:33:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193528.log 2023-09-30T22:33:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.193528.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193528.log.gz 2023-09-30T22:33:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173686.log 2023-09-30T22:33:28.775 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-30T22:33:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173686.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173686.log.gz 2023-09-30T22:33:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171267.log 2023-09-30T22:33:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152156.log 2023-09-30T22:33:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171267.log: /var/log/ceph/ceph-client.admin.152156.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171267.log.gz 2023-09-30T22:33:28.776 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152156.log.gz 2023-09-30T22:33:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177954.log 2023-09-30T22:33:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161816.log 2023-09-30T22:33:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177954.log: /var/log/ceph/ceph-client.admin.161816.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177954.log.gz 2023-09-30T22:33:28.776 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161816.log.gz 2023-09-30T22:33:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123402.log 2023-09-30T22:33:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193086.log 2023-09-30T22:33:28.777 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123402.log: /var/log/ceph/ceph-client.admin.193086.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123402.log.gz 2023-09-30T22:33:28.777 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193086.log.gz 2023-09-30T22:33:28.777 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152351.log 2023-09-30T22:33:28.777 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127790.log 2023-09-30T22:33:28.777 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152351.log: /var/log/ceph/ceph-client.admin.127790.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152351.log.gz 2023-09-30T22:33:28.777 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127790.log.gz 2023-09-30T22:33:28.777 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152406.log 2023-09-30T22:33:28.778 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173174.log 2023-09-30T22:33:28.778 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152406.log: /var/log/ceph/ceph-client.admin.173174.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152406.log.gz 2023-09-30T22:33:28.778 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.173174.log.gz 2023-09-30T22:33:28.778 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141290.log 2023-09-30T22:33:28.778 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124382.log 2023-09-30T22:33:28.778 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141290.log: /var/log/ceph/ceph-client.admin.124382.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141290.log.gz 2023-09-30T22:33:28.778 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124382.log.gz 2023-09-30T22:33:28.778 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195437.log 2023-09-30T22:33:28.779 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153182.log 2023-09-30T22:33:28.779 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195437.log: /var/log/ceph/ceph-client.admin.153182.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.195437.log.gz 2023-09-30T22:33:28.779 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153182.log.gz 2023-09-30T22:33:28.779 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186756.log 2023-09-30T22:33:28.779 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145677.log 2023-09-30T22:33:28.779 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186756.log: /var/log/ceph/ceph-client.admin.145677.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186756.log.gz 2023-09-30T22:33:28.779 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145677.log.gz 2023-09-30T22:33:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140533.log 2023-09-30T22:33:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148797.log 2023-09-30T22:33:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140533.log: /var/log/ceph/ceph-client.admin.148797.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140533.log.gz 2023-09-30T22:33:28.780 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148797.log.gz 2023-09-30T22:33:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147572.log 2023-09-30T22:33:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183649.log 2023-09-30T22:33:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147572.log: /var/log/ceph/ceph-client.admin.183649.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147572.log.gz 2023-09-30T22:33:28.780 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183649.log.gz 2023-09-30T22:33:28.780 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166973.log 2023-09-30T22:33:28.781 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195851.log 2023-09-30T22:33:28.781 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166973.log: /var/log/ceph/ceph-client.admin.195851.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166973.log.gz 2023-09-30T22:33:28.781 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.195851.log.gz 2023-09-30T22:33:28.781 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129097.log 2023-09-30T22:33:28.781 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130269.log 2023-09-30T22:33:28.781 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129097.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129097.log.gz 2023-09-30T22:33:28.781 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130269.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130269.log.gz 2023-09-30T22:33:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142153.log 2023-09-30T22:33:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151791.log 2023-09-30T22:33:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142153.log: /var/log/ceph/ceph-client.admin.151791.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142153.log.gz 2023-09-30T22:33:28.782 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151791.log.gz 2023-09-30T22:33:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188797.log 2023-09-30T22:33:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181119.log 2023-09-30T22:33:28.782 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188797.log: /var/log/ceph/ceph-client.admin.181119.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188797.log.gz 2023-09-30T22:33:28.782 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181119.log.gz 2023-09-30T22:33:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179055.log 2023-09-30T22:33:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158599.log 2023-09-30T22:33:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179055.log: /var/log/ceph/ceph-client.admin.158599.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179055.log.gz 2023-09-30T22:33:28.783 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158599.log.gz 2023-09-30T22:33:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154340.log 2023-09-30T22:33:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157943.log 2023-09-30T22:33:28.783 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154340.log: /var/log/ceph/ceph-client.admin.157943.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154340.log.gz 2023-09-30T22:33:28.783 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.157943.log.gz 2023-09-30T22:33:28.784 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191471.log 2023-09-30T22:33:28.784 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194507.log 2023-09-30T22:33:28.784 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191471.log: /var/log/ceph/ceph-client.admin.194507.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191471.log.gz 2023-09-30T22:33:28.784 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.194507.log.gz 2023-09-30T22:33:28.784 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141341.log 2023-09-30T22:33:28.784 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163784.log 2023-09-30T22:33:28.784 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141341.log: /var/log/ceph/ceph-client.admin.163784.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141341.log.gz 2023-09-30T22:33:28.785 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163784.log.gz 2023-09-30T22:33:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168514.log 2023-09-30T22:33:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142566.log 2023-09-30T22:33:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168514.log: /var/log/ceph/ceph-client.admin.142566.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168514.log.gz 2023-09-30T22:33:28.785 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142566.log.gz 2023-09-30T22:33:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191076.log 2023-09-30T22:33:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146469.log 2023-09-30T22:33:28.785 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191076.log: /var/log/ceph/ceph-client.admin.146469.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.191076.log.gz 2023-09-30T22:33:28.786 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146469.log.gz 2023-09-30T22:33:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171206.log 2023-09-30T22:33:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180043.log 2023-09-30T22:33:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.171206.log: /var/log/ceph/ceph-client.admin.180043.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171206.log.gz 2023-09-30T22:33:28.786 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.180043.log.gz 2023-09-30T22:33:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195655.log 2023-09-30T22:33:28.786 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160914.log 2023-09-30T22:33:28.787 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195655.log: /var/log/ceph/ceph-client.admin.160914.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.195655.log.gz 2023-09-30T22:33:28.787 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160914.log.gz 2023-09-30T22:33:28.787 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168121.log 2023-09-30T22:33:28.787 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156253.log 2023-09-30T22:33:28.787 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168121.log: /var/log/ceph/ceph-client.admin.156253.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168121.log.gz 2023-09-30T22:33:28.787 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156253.log.gz 2023-09-30T22:33:28.787 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150783.log 2023-09-30T22:33:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174227.log 2023-09-30T22:33:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150783.log: /var/log/ceph/ceph-client.admin.174227.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150783.log.gz 2023-09-30T22:33:28.788 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.174227.log.gz 2023-09-30T22:33:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143250.log 2023-09-30T22:33:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175722.log 2023-09-30T22:33:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143250.log: /var/log/ceph/ceph-client.admin.175722.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143250.log.gz 2023-09-30T22:33:28.788 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175722.log.gz 2023-09-30T22:33:28.789 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143350.log 2023-09-30T22:33:28.789 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152547.log 2023-09-30T22:33:28.789 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143350.log: 88.3%/var/log/ceph/ceph-client.admin.152547.log: -- replaced with /var/log/ceph/ceph-client.admin.143350.log.gz 2023-09-30T22:33:28.789 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152547.log.gz 2023-09-30T22:33:28.789 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163588.log 2023-09-30T22:33:28.849 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165797.log 2023-09-30T22:33:28.849 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163588.log: /var/log/ceph/ceph-client.admin.165797.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163588.log.gz 2023-09-30T22:33:28.849 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166502.log 2023-09-30T22:33:28.849 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165797.log.gz 2023-09-30T22:33:28.849 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172880.log 2023-09-30T22:33:28.850 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166502.log: /var/log/ceph/ceph-client.admin.172880.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166502.log.gz 2023-09-30T22:33:28.850 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188946.log 2023-09-30T22:33:28.850 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172880.log.gz 2023-09-30T22:33:28.850 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152573.log 2023-09-30T22:33:28.850 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188946.log.gz 2023-09-30T22:33:28.850 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149632.log 2023-09-30T22:33:28.850 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152573.log.gz 2023-09-30T22:33:28.850 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149632.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149632.log.gz 2023-09-30T22:33:28.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194852.log 2023-09-30T22:33:28.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141146.log 2023-09-30T22:33:28.851 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194852.log: /var/log/ceph/ceph-client.admin.141146.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.194852.log.gz 2023-09-30T22:33:28.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181558.log 2023-09-30T22:33:28.851 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141146.log.gz 2023-09-30T22:33:28.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175330.log 2023-09-30T22:33:28.851 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181558.log: /var/log/ceph/ceph-client.admin.175330.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181558.log.gz 2023-09-30T22:33:28.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178738.log 2023-09-30T22:33:28.851 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.175330.log.gz 2023-09-30T22:33:28.852 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178738.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178738.log.gz 2023-09-30T22:33:28.852 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169886.log 2023-09-30T22:33:28.852 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136970.log 2023-09-30T22:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169886.log: /var/log/ceph/ceph-client.admin.136970.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169886.log.gz 2023-09-30T22:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.136970.log.gz 2023-09-30T22:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178712.log 2023-09-30T22:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170893.log 2023-09-30T22:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178712.log: /var/log/ceph/ceph-client.admin.170893.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178712.log.gz 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.170893.log.gz 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184939.log 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189804.log 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184939.log: /var/log/ceph/ceph-client.admin.189804.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184939.log.gz 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189804.log.gz 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163662.log 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157233.log 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163662.log: /var/log/ceph/ceph-client.admin.157233.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163662.log.gz 2023-09-30T22:33:28.855 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157233.log.gz 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179251.log 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195317.log 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179251.log: /var/log/ceph/ceph-client.admin.195317.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179251.log.gz 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi154.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.195317.log.gz 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136655.log 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174450.log 2023-09-30T22:33:28.856 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.136655.log: 88.6%/var/log/ceph/ceph-client.admin.174450.log: -- replaced with /var/log/ceph/ceph-client.admin.136655.log.gz 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174450.log.gz 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186952.log 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180484.log 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186952.log: /var/log/ceph/ceph-client.admin.180484.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186952.log.gz 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180484.log.gz 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178908.log 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147675.log 2023-09-30T22:33:28.857 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178908.log: /var/log/ceph/ceph-client.admin.147675.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178908.log.gz 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147675.log.gz 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155346.log 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127890.log 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185331.log 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155346.log.gz 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140604.log 2023-09-30T22:33:28.858 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185331.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.127890.log.gz 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3%/var/log/ceph/ceph-client.admin.140604.log: -- replaced with /var/log/ceph/ceph-client.admin.185331.log.gz 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140604.log.gz 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178320.log 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178663.log 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178320.log: /var/log/ceph/ceph-client.admin.178663.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178320.log.gz 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178663.log.gz 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179839.log 2023-09-30T22:33:28.859 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190151.log 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179839.log: /var/log/ceph/ceph-client.admin.190151.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179839.log.gz 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190151.log.gz 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185802.log 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153013.log 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185802.log: /var/log/ceph/ceph-client.admin.153013.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185802.log.gz 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153013.log.gz 2023-09-30T22:33:28.860 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175429.log 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159187.log 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175429.log: /var/log/ceph/ceph-client.admin.159187.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175429.log.gz 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159187.log.gz 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151467.log 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136115.log 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151467.log: /var/log/ceph/ceph-client.admin.136115.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.151467.log.gz 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136115.log.gz 2023-09-30T22:33:28.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186560.log 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138251.log 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186560.log: /var/log/ceph/ceph-client.admin.138251.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186560.log.gz 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138251.log.gz 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187344.log 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143714.log 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187344.log: /var/log/ceph/ceph-client.admin.143714.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187344.log.gz 2023-09-30T22:33:28.862 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143714.log.gz 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145528.log 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153527.log 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145528.log: /var/log/ceph/ceph-client.admin.153527.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145528.log.gz 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153527.log.gz 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157478.log 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160465.log 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.157478.log: /var/log/ceph/ceph-client.admin.160465.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157478.log.gz 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160465.log.gz 2023-09-30T22:33:28.863 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129567.log 2023-09-30T22:33:28.864 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168710.log 2023-09-30T22:33:28.864 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129567.log: /var/log/ceph/ceph-client.admin.168710.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129567.log.gz 2023-09-30T22:33:28.864 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.168710.log.gz 2023-09-30T22:33:28.864 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142662.log 2023-09-30T22:33:28.864 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144548.log 2023-09-30T22:33:28.864 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142662.log: /var/log/ceph/ceph-client.admin.144548.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142662.log.gz 2023-09-30T22:33:28.864 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144548.log.gz 2023-09-30T22:33:28.864 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196047.log 2023-09-30T22:33:28.865 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129714.log 2023-09-30T22:33:28.865 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196047.log: /var/log/ceph/ceph-client.admin.129714.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.196047.log.gz 2023-09-30T22:33:28.865 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129714.log.gz 2023-09-30T22:33:28.865 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142074.log 2023-09-30T22:33:28.865 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143938.log 2023-09-30T22:33:28.865 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142074.log: /var/log/ceph/ceph-client.admin.143938.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142074.log.gz 2023-09-30T22:33:28.865 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143938.log.gz 2023-09-30T22:33:28.865 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194264.log 2023-09-30T22:33:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190122.log 2023-09-30T22:33:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194264.log: /var/log/ceph/ceph-client.admin.190122.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.194264.log.gz 2023-09-30T22:33:28.866 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190122.log.gz 2023-09-30T22:33:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156498.log 2023-09-30T22:33:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187566.log 2023-09-30T22:33:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156498.log: /var/log/ceph/ceph-client.admin.187566.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156498.log.gz 2023-09-30T22:33:28.866 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187566.log.gz 2023-09-30T22:33:28.866 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183373.log 2023-09-30T22:33:28.867 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164346.log 2023-09-30T22:33:28.867 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183373.log: /var/log/ceph/ceph-client.admin.164346.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183373.log.gz 2023-09-30T22:33:28.867 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146124.log 2023-09-30T22:33:28.867 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164346.log.gz 2023-09-30T22:33:28.867 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184012.log 2023-09-30T22:33:28.867 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146124.log: /var/log/ceph/ceph-client.admin.184012.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146124.log.gz 2023-09-30T22:33:28.867 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.184012.log.gz 2023-09-30T22:33:28.867 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181660.log 2023-09-30T22:33:28.868 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167338.log 2023-09-30T22:33:28.868 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181660.log: /var/log/ceph/ceph-client.admin.167338.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.181660.log.gz 2023-09-30T22:33:28.868 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167338.log.gz 2023-09-30T22:33:28.868 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138841.log 2023-09-30T22:33:28.868 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162851.log 2023-09-30T22:33:28.868 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.138841.log: /var/log/ceph/ceph-client.admin.162851.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138841.log.gz 2023-09-30T22:33:28.868 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162851.log.gz 2023-09-30T22:33:28.869 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144669.log 2023-09-30T22:33:28.869 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170866.log 2023-09-30T22:33:28.869 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144669.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144669.log.gz 2023-09-30T22:33:28.869 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170866.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170866.log.gz 2023-09-30T22:33:28.869 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193282.log 2023-09-30T22:33:28.869 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174005.log 2023-09-30T22:33:28.869 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193282.log: /var/log/ceph/ceph-client.admin.174005.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193282.log.gz 2023-09-30T22:33:28.869 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174005.log.gz 2023-09-30T22:33:28.870 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149385.log 2023-09-30T22:33:28.870 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181268.log 2023-09-30T22:33:28.870 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149385.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149385.log.gz 2023-09-30T22:33:28.870 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181268.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181268.log.gz 2023-09-30T22:33:28.870 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130379.log 2023-09-30T22:33:28.870 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139038.log 2023-09-30T22:33:28.870 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.130379.log: /var/log/ceph/ceph-client.admin.139038.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130379.log.gz 2023-09-30T22:33:28.871 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139038.log.gz 2023-09-30T22:33:28.871 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185384.log 2023-09-30T22:33:28.871 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195291.log 2023-09-30T22:33:28.871 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185384.log: /var/log/ceph/ceph-client.admin.195291.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.185384.log.gz 2023-09-30T22:33:28.871 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.195291.log.gz 2023-09-30T22:33:28.871 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168266.log 2023-09-30T22:33:28.871 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191149.log 2023-09-30T22:33:28.871 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168266.log: /var/log/ceph/ceph-client.admin.191149.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168266.log.gz 2023-09-30T22:33:28.872 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191149.log.gz 2023-09-30T22:33:28.872 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167090.log 2023-09-30T22:33:28.872 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191764.log 2023-09-30T22:33:28.872 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167090.log: /var/log/ceph/ceph-client.admin.191764.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167090.log.gz 2023-09-30T22:33:28.872 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191764.log.gz 2023-09-30T22:33:28.872 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148067.log 2023-09-30T22:33:28.872 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192843.log 2023-09-30T22:33:28.872 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148067.log: /var/log/ceph/ceph-client.admin.192843.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148067.log.gz 2023-09-30T22:33:28.873 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.192843.log.gz 2023-09-30T22:33:28.873 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176018.log 2023-09-30T22:33:28.873 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195557.log 2023-09-30T22:33:28.873 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176018.log: /var/log/ceph/ceph-client.admin.195557.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.176018.log.gz 2023-09-30T22:33:28.873 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.195557.log.gz 2023-09-30T22:33:28.873 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124627.log 2023-09-30T22:33:28.873 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154784.log 2023-09-30T22:33:28.873 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124627.log: /var/log/ceph/ceph-client.admin.154784.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124627.log.gz 2023-09-30T22:33:28.874 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154784.log.gz 2023-09-30T22:33:28.874 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148431.log 2023-09-30T22:33:28.874 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190906.log 2023-09-30T22:33:28.874 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148431.log: /var/log/ceph/ceph-client.admin.190906.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148431.log.gz 2023-09-30T22:33:28.874 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.190906.log.gz 2023-09-30T22:33:28.874 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195949.log 2023-09-30T22:33:28.874 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164791.log 2023-09-30T22:33:28.874 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195949.log: /var/log/ceph/ceph-client.admin.164791.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.195949.log.gz 2023-09-30T22:33:28.875 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164791.log.gz 2023-09-30T22:33:28.875 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173958.log 2023-09-30T22:33:28.875 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140977.log 2023-09-30T22:33:28.875 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173958.log: /var/log/ceph/ceph-client.admin.140977.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173958.log.gz 2023-09-30T22:33:28.875 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140977.log.gz 2023-09-30T22:33:28.875 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192255.log 2023-09-30T22:33:28.875 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146247.log 2023-09-30T22:33:28.875 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192255.log: /var/log/ceph/ceph-client.admin.146247.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192255.log.gz 2023-09-30T22:33:28.876 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146247.log.gz 2023-09-30T22:33:28.876 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140605.log 2023-09-30T22:33:28.876 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159830.log 2023-09-30T22:33:28.876 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.140605.log: /var/log/ceph/ceph-client.admin.159830.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140605.log.gz 2023-09-30T22:33:28.876 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150979.log 2023-09-30T22:33:28.876 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159830.log.gz 2023-09-30T22:33:28.876 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150979.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150979.log.gz 2023-09-30T22:33:28.876 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176702.log 2023-09-30T22:33:28.877 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170226.log 2023-09-30T22:33:28.877 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176702.log: /var/log/ceph/ceph-client.admin.170226.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176702.log.gz 2023-09-30T22:33:28.877 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170226.log.gz 2023-09-30T22:33:28.877 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188377.log 2023-09-30T22:33:28.877 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182393.log 2023-09-30T22:33:28.877 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188377.log: /var/log/ceph/ceph-client.admin.182393.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.188377.log.gz 2023-09-30T22:33:28.877 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.182393.log.gz 2023-09-30T22:33:28.877 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160734.log 2023-09-30T22:33:28.878 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173490.log 2023-09-30T22:33:28.878 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160734.log: /var/log/ceph/ceph-client.admin.173490.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160734.log.gz 2023-09-30T22:33:28.878 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173490.log.gz 2023-09-30T22:33:28.878 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152202.log 2023-09-30T22:33:28.878 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175039.log 2023-09-30T22:33:28.878 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.152202.log: /var/log/ceph/ceph-client.admin.175039.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152202.log.gz 2023-09-30T22:33:28.878 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175039.log.gz 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186168.log 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144277.log 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123821.log 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186168.log.gz 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144277.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144277.log.gz 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123821.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123821.log.gz 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142370.log 2023-09-30T22:33:28.879 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184796.log 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.142370.log: /var/log/ceph/ceph-client.admin.184796.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.142370.log.gz 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156179.log 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184796.log.gz 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149336.log 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.156179.log: /var/log/ceph/ceph-client.admin.149336.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156179.log.gz 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149336.log.gz 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153109.log 2023-09-30T22:33:28.880 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139722.log 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153109.log: /var/log/ceph/ceph-client.admin.139722.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153109.log.gz 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.139722.log.gz 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177805.log 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136458.log 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177805.log: /var/log/ceph/ceph-client.admin.136458.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177805.log.gz 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi154.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.136458.log.gz 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150561.log 2023-09-30T22:33:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195606.log 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150561.log: /var/log/ceph/ceph-client.admin.195606.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150561.log.gz 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.195606.log.gz 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154189.log 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188528.log 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154189.log: /var/log/ceph/ceph-client.admin.188528.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154189.log.gz 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188528.log.gz 2023-09-30T22:33:28.882 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193332.log 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192302.log 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149140.log 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.193332.log.gz 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192302.log: /var/log/ceph/ceph-client.admin.149140.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192302.log.gz 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149140.log.gz 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143518.log 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172487.log 2023-09-30T22:33:28.883 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143518.log: /var/log/ceph/ceph-client.admin.172487.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143518.log.gz 2023-09-30T22:33:28.884 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164934.log 2023-09-30T22:33:28.884 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172487.log.gz 2023-09-30T22:33:28.884 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164838.log 2023-09-30T22:33:28.884 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164934.log: /var/log/ceph/ceph-client.admin.164838.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164934.log.gz 2023-09-30T22:33:28.884 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164838.log.gz 2023-09-30T22:33:28.884 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125068.log 2023-09-30T22:33:28.884 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169299.log 2023-09-30T22:33:28.884 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125068.log: /var/log/ceph/ceph-client.admin.169299.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125068.log.gz 2023-09-30T22:33:28.885 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169299.log.gz 2023-09-30T22:33:28.885 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184743.log 2023-09-30T22:33:28.885 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171036.log 2023-09-30T22:33:28.885 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184743.log: /var/log/ceph/ceph-client.admin.171036.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184743.log.gz 2023-09-30T22:33:28.885 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171036.log.gz 2023-09-30T22:33:28.885 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153797.log 2023-09-30T22:33:28.885 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162498.log 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.153797.log: /var/log/ceph/ceph-client.admin.162498.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153797.log.gz 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162498.log.gz 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146641.log 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179300.log 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146641.log: /var/log/ceph/ceph-client.admin.179300.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146641.log.gz 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179300.log.gz 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158901.log 2023-09-30T22:33:28.886 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143127.log 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137762.log 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158901.log.gz 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161790.log 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137762.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143127.log.gz 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161790.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137762.log.gz 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161790.log.gz 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123598.log 2023-09-30T22:33:28.887 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136284.log 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123598.log: /var/log/ceph/ceph-client.admin.136284.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123598.log.gz 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136284.log.gz 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176553.log 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159634.log 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176553.log: /var/log/ceph/ceph-client.admin.159634.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176553.log.gz 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159634.log.gz 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129763.log 2023-09-30T22:33:28.888 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162106.log 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.129763.log: /var/log/ceph/ceph-client.admin.162106.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129763.log.gz 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162106.log.gz 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166554.log 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184647.log 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.166554.log: /var/log/ceph/ceph-client.admin.184647.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166554.log.gz 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184647.log.gz 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150195.log 2023-09-30T22:33:28.889 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167754.log 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150195.log: /var/log/ceph/ceph-client.admin.167754.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150195.log.gz 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167754.log.gz 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137566.log 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172086.log 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137566.log: /var/log/ceph/ceph-client.admin.172086.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137566.log.gz 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.172086.log.gz 2023-09-30T22:33:28.890 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143545.log 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141682.log 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.143545.log: /var/log/ceph/ceph-client.admin.141682.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143545.log.gz 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141682.log.gz 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146443.log 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194115.log 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146443.log: /var/log/ceph/ceph-client.admin.194115.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146443.log.gz 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.194115.log.gz 2023-09-30T22:33:28.891 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149924.log 2023-09-30T22:33:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153770.log 2023-09-30T22:33:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149924.log: /var/log/ceph/ceph-client.admin.153770.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149924.log.gz 2023-09-30T22:33:28.892 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.153770.log.gz 2023-09-30T22:33:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148458.log 2023-09-30T22:33:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189581.log 2023-09-30T22:33:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.148458.log: /var/log/ceph/ceph-client.admin.189581.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148458.log.gz 2023-09-30T22:33:28.892 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189581.log.gz 2023-09-30T22:33:28.892 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149241.log 2023-09-30T22:33:28.893 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125678.log 2023-09-30T22:33:28.893 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-30T22:33:28.893 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.149241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163076.log 2023-09-30T22:33:28.893 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149241.log.gz 2023-09-30T22:33:28.893 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.125678.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125678.log.gz 2023-09-30T22:33:28.893 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163076.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163076.log.gz 2023-09-30T22:33:28.893 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118551.log 2023-09-30T22:33:28.893 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162898.log 2023-09-30T22:33:28.894 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.118551.log: /var/log/ceph/ceph-client.admin.162898.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118551.log.gz 2023-09-30T22:33:28.894 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162898.log.gz 2023-09-30T22:33:28.894 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141512.log 2023-09-30T22:33:28.894 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185998.log 2023-09-30T22:33:28.894 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157870.log 2023-09-30T22:33:28.894 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.141512.log.gz 2023-09-30T22:33:28.894 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185998.log: /var/log/ceph/ceph-client.admin.157870.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185998.log.gz 2023-09-30T22:33:28.894 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157870.log.gz 2023-09-30T22:33:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169129.log 2023-09-30T22:33:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189900.log 2023-09-30T22:33:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157086.log 2023-09-30T22:33:28.895 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169129.log.gz 2023-09-30T22:33:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189900.log: /var/log/ceph/ceph-client.admin.157086.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.189900.log.gz 2023-09-30T22:33:28.895 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157086.log.gz 2023-09-30T22:33:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139918.log 2023-09-30T22:33:28.895 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177363.log 2023-09-30T22:33:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179353.log 2023-09-30T22:33:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177363.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139918.log.gz 2023-09-30T22:33:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179353.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177363.log.gz 2023-09-30T22:33:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141342.log 2023-09-30T22:33:28.896 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179353.log.gz 2023-09-30T22:33:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178934.log 2023-09-30T22:33:28.896 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.141342.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-09-30T22:33:28.897 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141342.log.gz 2023-09-30T22:33:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178934.log: /var/log/ceph/ceph-osd.1.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.178934.log.gz 2023-09-30T22:33:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164176.log 2023-09-30T22:33:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186194.log 2023-09-30T22:33:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164176.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164176.log.gz 2023-09-30T22:33:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186194.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186194.log.gz 2023-09-30T22:33:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151837.log 2023-09-30T22:33:28.897 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155077.log 2023-09-30T22:33:28.898 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.151837.log: /var/log/ceph/ceph-client.admin.155077.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151837.log.gz 2023-09-30T22:33:28.898 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155077.log.gz 2023-09-30T22:33:28.898 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154881.log 2023-09-30T22:33:28.898 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172881.log 2023-09-30T22:33:28.898 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.154881.log: /var/log/ceph/ceph-client.admin.172881.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154881.log.gz 2023-09-30T22:33:28.898 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172881.log.gz 2023-09-30T22:33:28.898 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137275.log 2023-09-30T22:33:28.899 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145602.log 2023-09-30T22:33:28.899 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137275.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137275.log.gz 2023-09-30T22:33:28.899 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.145602.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145602.log.gz 2023-09-30T22:33:28.899 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190347.log 2023-09-30T22:33:28.899 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167312.log 2023-09-30T22:33:28.899 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190347.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190347.log.gz 2023-09-30T22:33:28.899 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167312.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167312.log.gz 2023-09-30T22:33:28.899 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169246.log 2023-09-30T22:33:28.900 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163635.log 2023-09-30T22:33:28.900 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169246.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169246.log.gz 2023-09-30T22:33:28.900 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163635.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163635.log.gz 2023-09-30T22:33:28.900 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183228.log 2023-09-30T22:33:28.900 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179692.log 2023-09-30T22:33:28.900 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183228.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.183228.log.gz 2023-09-30T22:33:28.900 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179692.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179692.log.gz 2023-09-30T22:33:28.901 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177486.log 2023-09-30T22:33:28.901 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123008.log 2023-09-30T22:33:28.901 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177486.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177486.log.gz 2023-09-30T22:33:28.901 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123008.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123008.log.gz 2023-09-30T22:33:28.901 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164446.log 2023-09-30T22:33:28.901 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139011.log 2023-09-30T22:33:28.901 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164446.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164446.log.gz 2023-09-30T22:33:28.901 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.139011.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139011.log.gz 2023-09-30T22:33:28.902 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161323.log 2023-09-30T22:33:28.902 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170814.log 2023-09-30T22:33:28.902 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161323.log: /var/log/ceph/ceph-client.admin.170814.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161323.log.gz 2023-09-30T22:33:28.902 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170814.log.gz 2023-09-30T22:33:28.902 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184843.log 2023-09-30T22:33:28.902 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135945.log 2023-09-30T22:33:28.902 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184843.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.184843.log.gz 2023-09-30T22:33:28.903 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.135945.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.135945.log.gz 2023-09-30T22:33:28.903 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181341.log 2023-09-30T22:33:28.903 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124676.log 2023-09-30T22:33:28.903 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181341.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181341.log.gz 2023-09-30T22:33:28.903 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.124676.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124676.log.gz 2023-09-30T22:33:28.903 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155665.log 2023-09-30T22:33:28.903 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153305.log 2023-09-30T22:33:28.903 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.155665.log: /var/log/ceph/ceph-client.admin.153305.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155665.log.gz 2023-09-30T22:33:28.904 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153305.log.gz 2023-09-30T22:33:28.904 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150024.log 2023-09-30T22:33:28.904 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159098.log 2023-09-30T22:33:28.904 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.150024.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150024.log.gz 2023-09-30T22:33:28.904 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.159098.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159098.log.gz 2023-09-30T22:33:28.904 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137665.log 2023-09-30T22:33:28.904 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180341.log 2023-09-30T22:33:28.904 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.137665.log: /var/log/ceph/ceph-client.admin.180341.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137665.log.gz 2023-09-30T22:33:28.905 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.180341.log.gz 2023-09-30T22:33:28.905 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191572.log 2023-09-30T22:33:28.905 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164006.log 2023-09-30T22:33:28.905 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191572.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191572.log.gz 2023-09-30T22:33:28.905 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164006.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164006.log.gz 2023-09-30T22:33:28.905 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146394.log 2023-09-30T22:33:28.905 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176804.log 2023-09-30T22:33:28.905 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146394.log: /var/log/ceph/ceph-client.admin.176804.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146394.log.gz 2023-09-30T22:33:28.906 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176804.log.gz 2023-09-30T22:33:28.906 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147376.log 2023-09-30T22:33:28.906 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187984.log 2023-09-30T22:33:28.906 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.147376.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.147376.log.gz 2023-09-30T22:33:28.906 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187984.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187984.log.gz 2023-09-30T22:33:28.906 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127553.log 2023-09-30T22:33:28.906 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191962.log 2023-09-30T22:33:28.907 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127553.log: /var/log/ceph/ceph-client.admin.191962.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127553.log.gz 2023-09-30T22:33:28.907 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191962.log.gz 2023-09-30T22:33:28.907 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128119.log 2023-09-30T22:33:28.907 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174546.log 2023-09-30T22:33:28.907 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.128119.log: /var/log/ceph/ceph-client.admin.174546.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128119.log.gz 2023-09-30T22:33:28.907 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174546.log.gz 2023-09-30T22:33:28.907 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161594.log 2023-09-30T22:33:28.907 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142734.log 2023-09-30T22:33:28.908 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161594.log: /var/log/ceph/ceph-client.admin.142734.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.161594.log.gz 2023-09-30T22:33:28.908 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142734.log.gz 2023-09-30T22:33:28.908 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158017.log 2023-09-30T22:33:28.908 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154089.log 2023-09-30T22:33:28.908 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.158017.log: /var/log/ceph/ceph-client.admin.154089.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.158017.log.gz 2023-09-30T22:33:28.908 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154089.log.gz 2023-09-30T22:33:28.908 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127631.log 2023-09-30T22:33:28.908 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147229.log 2023-09-30T22:33:28.909 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.127631.log: /var/log/ceph/ceph-client.admin.147229.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.127631.log.gz 2023-09-30T22:33:28.909 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147229.log.gz 2023-09-30T22:33:28.909 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146516.log 2023-09-30T22:33:28.909 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159438.log 2023-09-30T22:33:28.909 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.146516.log: /var/log/ceph/ceph-client.admin.159438.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146516.log.gz 2023-09-30T22:33:28.909 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159438.log.gz 2023-09-30T22:33:28.909 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165621.log 2023-09-30T22:33:28.910 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160295.log 2023-09-30T22:33:28.910 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165621.log: /var/log/ceph/ceph-client.admin.160295.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.165621.log.gz 2023-09-30T22:33:28.910 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160295.log.gz 2023-09-30T22:33:28.910 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144865.log 2023-09-30T22:33:28.910 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160491.log 2023-09-30T22:33:28.910 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.144865.log: /var/log/ceph/ceph-client.admin.160491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144865.log.gz 2023-09-30T22:33:28.910 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160491.log.gz 2023-09-30T22:33:28.910 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181805.log 2023-09-30T22:33:28.911 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183518.log 2023-09-30T22:33:28.911 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181805.log: /var/log/ceph/ceph-client.admin.183518.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181805.log.gz 2023-09-30T22:33:28.911 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.183518.log.gz 2023-09-30T22:33:28.911 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192451.log 2023-09-30T22:33:28.911 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123696.log 2023-09-30T22:33:28.911 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192451.log: /var/log/ceph/ceph-client.admin.123696.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192451.log.gz 2023-09-30T22:33:28.911 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123696.log.gz 2023-09-30T22:33:28.911 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170303.log 2023-09-30T22:33:28.912 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158508.log 2023-09-30T22:33:28.912 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.170303.log: /var/log/ceph/ceph-client.admin.158508.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170303.log.gz 2023-09-30T22:33:28.912 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158508.log.gz 2023-09-30T22:33:28.912 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182444.log 2023-09-30T22:33:28.912 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182444.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182444.log.gz 2023-09-30T22:33:28.912 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162258.log 2023-09-30T22:33:28.912 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140781.log 2023-09-30T22:33:28.913 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162258.log: /var/log/ceph/ceph-client.admin.140781.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162258.log.gz 2023-09-30T22:33:28.913 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140781.log.gz 2023-09-30T22:33:28.913 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167950.log 2023-09-30T22:33:28.913 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184694.log 2023-09-30T22:33:28.913 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167950.log: /var/log/ceph/ceph-client.admin.184694.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.167950.log.gz 2023-09-30T22:33:28.913 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184694.log.gz 2023-09-30T22:33:28.913 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161620.log 2023-09-30T22:33:28.913 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122900.log 2023-09-30T22:33:28.914 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161620.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161620.log.gz 2023-09-30T22:33:28.914 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122900.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122900.log.gz 2023-09-30T22:33:28.914 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122702.log 2023-09-30T22:33:28.914 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.122702.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122702.log.gz 2023-09-30T22:33:28.915 INFO:teuthology.orchestra.run.smithi154.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-09-30T22:33:28.961 INFO:teuthology.orchestra.run.smithi154.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-09-30T22:33:28.962 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-09-30T22:33:29.127 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-30T22:33:29.191 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-30T22:33:29.192 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-09-30T22:33:29.192 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m1.019s 2023-09-30T22:33:29.192 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m3.850s 2023-09-30T22:33:29.193 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.785s 2023-09-30T22:33:29.193 INFO:tasks.ceph:Archiving logs... 2023-09-30T22:33:29.193 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/remote/smithi154/log 2023-09-30T22:33:29.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T22:33:30.756 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/remote/smithi163/log 2023-09-30T22:33:30.757 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T22:33:30.791 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:33:30.801 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-30T22:33:30.819 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:33:30.824 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-30T22:33:30.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T22:33:30.830 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T22:33:30.948 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-30T22:33:30.960 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-30T22:33:30.960 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:33:30.963 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T22:33:30.981 INFO:teuthology.orchestra.run.smithi154.stderr:bash: ntpq: command not found 2023-09-30T22:33:30.982 INFO:teuthology.orchestra.run.smithi163.stderr:bash: ntpq: command not found 2023-09-30T22:33:30.986 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:33:30.986 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2023-09-30T22:33:30.986 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 30 -49us[ -49us] +/- 73ms 2023-09-30T22:33:30.987 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -433us[ -407us] +/- 54ms 2023-09-30T22:33:30.987 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 33 +781us[ +806us] +/- 88ms 2023-09-30T22:33:30.987 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:33:30.988 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T22:33:30.989 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2023-09-30T22:33:30.989 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 -50us[ -50us] +/- 73ms 2023-09-30T22:33:30.989 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -434us[ -430us] +/- 54ms 2023-09-30T22:33:30.989 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +780us[ +784us] +/- 88ms 2023-09-30T22:33:30.989 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T22:33:30.989 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-30T22:33:31.000 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-30T22:33:31.001 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-30T22:33:31.027 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T22:33:31.081 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T22:33:31.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:33:31.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:33:31.206 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T22:33:31.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:33:31.239 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-30T22:33:31.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-30T22:33:31.265 INFO:teuthology.task.internal:Duration was 1450.445669 seconds 2023-09-30T22:33:31.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-30T22:33:31.277 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-30T22:33:31.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T22:33:31.280 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T22:33:31.327 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:33:31.329 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T22:33:31.668 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-30T22:33:31.668 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2023-09-30T22:33:31.668 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T22:33:31.692 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2023-09-30T22:33:31.693 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T22:33:31.716 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-30T22:33:31.716 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T22:33:31.735 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T22:33:31.793 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-30T22:33:31.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:33:31.796 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:33:31.902 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-30T22:33:31.915 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-30T22:33:31.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T22:33:31.942 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T22:33:31.970 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-30T22:33:31.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:33:31.985 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:33:32.009 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2023-09-30T22:33:32.036 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2023-09-30T22:33:32.049 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:33:32.094 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi154.front.sepia.ceph.com, flagging run as failed 2023-09-30T22:33:32.094 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:33:32.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:33:32.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-30T22:33:32.125 INFO:teuthology.task.internal:Transferring archived files... 2023-09-30T22:33:32.126 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/remote/smithi154 2023-09-30T22:33:32.126 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T22:35:00.173 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-09-30T22:35:00.186 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041/remote/smithi154/coredump/1696112536.126757.core.gz: gzip compressed data, was "1696112536.126757.core", last modified: Sat Sep 30 22:33:32 2023, max compression, original size modulo 2^32 1364242432 2023-09-30T22:35:00.186 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-09-30T22:35:05.998 INFO:teuthology.task.internal: core looks like: /tmp/tmpo9790v2x: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/proc/self/exe', platform: 'x86_64' 2023-09-30T22:35:06.159 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-09-30T22:35:06.159 DEBUG:teuthology.orchestra.run.smithi154:> which 'ceph-mgr -f --cluster ceph -i x' 2023-09-30T22:35:06.182 INFO:teuthology.orchestra.run.smithi154.stderr:/usr/bin/which: invalid option -- 'f' 2023-09-30T22:35:06.183 INFO:teuthology.orchestra.run.smithi154.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-09-30T22:35:06.183 INFO:teuthology.orchestra.run.smithi154.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-09-30T22:35:06.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:35:06.184 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/ceph-mgr 2023-09-30T22:35:06.184 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/ceph 2023-09-30T22:35:06.185 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-09-30T22:35:06.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-30T22:35:06.214 INFO:teuthology.task.internal:Not uploading archives. 2023-09-30T22:35:06.214 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-30T22:35:06.237 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-30T22:35:06.237 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T22:35:06.255 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T22:35:06.269 INFO:teuthology.orchestra.run.smithi154.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 30 22:33 /home/ubuntu/cephtest 2023-09-30T22:35:06.269 INFO:teuthology.orchestra.run.smithi154.stdout: 393225 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Sep 30 22:33 /home/ubuntu/cephtest/archive 2023-09-30T22:35:06.269 INFO:teuthology.orchestra.run.smithi154.stdout: 393226 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:22 /home/ubuntu/cephtest/archive/coredump 2023-09-30T22:35:06.269 INFO:teuthology.orchestra.run.smithi154.stdout: 393232 359996 -rw------- 1 root root 1364242432 Sep 30 22:22 /home/ubuntu/cephtest/archive/coredump/1696112536.126757.core 2023-09-30T22:35:06.270 INFO:teuthology.orchestra.run.smithi154.stdout: 393253 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 30 22:33 /home/ubuntu/cephtest/archive/audit 2023-09-30T22:35:06.270 INFO:teuthology.orchestra.run.smithi154.stdout: 393255 28 -rw------- 1 ubuntu ubuntu 26459 Sep 30 22:33 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-09-30T22:35:06.270 INFO:teuthology.orchestra.run.smithi154.stdout: 393227 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:33 /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:35:06.270 INFO:teuthology.orchestra.run.smithi154.stdout: 393254 4 -rw-rw-rw- 1 ubuntu ubuntu 778 Sep 30 22:33 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-09-30T22:35:06.270 INFO:teuthology.orchestra.run.smithi154.stdout: 393258 112 -rw-rw-r-- 1 ubuntu ubuntu 113295 Sep 30 22:33 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:35:06.270 INFO:teuthology.orchestra.run.smithi154.stdout: 393256 132 -rw-rw-rw- 1 ubuntu ubuntu 133921 Sep 30 22:33 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-09-30T22:35:06.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T22:35:06.271 INFO:teuthology.orchestra.run.smithi154.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-30T22:35:06.271 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_6973b24e3d99fd494b753449d2ea12077599cbd6/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi154 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-30T22:35:06.284 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-30T22:35:06.298 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-30T22:35:06.312 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi154 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-09-30T22:35:06.312 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T22:35:06.316 INFO:teuthology.orchestra.run.smithi163.stdout: 525357 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 30 22:33 /home/ubuntu/cephtest 2023-09-30T22:35:06.317 INFO:teuthology.orchestra.run.smithi163.stdout: 525358 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Sep 30 22:33 /home/ubuntu/cephtest/archive 2023-09-30T22:35:06.317 INFO:teuthology.orchestra.run.smithi163.stdout: 655785 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 30 22:33 /home/ubuntu/cephtest/archive/audit 2023-09-30T22:35:06.317 INFO:teuthology.orchestra.run.smithi163.stdout: 655787 220 -rw------- 1 ubuntu ubuntu 223758 Sep 30 22:33 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-09-30T22:35:06.317 INFO:teuthology.orchestra.run.smithi163.stdout: 525360 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 22:33 /home/ubuntu/cephtest/archive/syslog 2023-09-30T22:35:06.317 INFO:teuthology.orchestra.run.smithi163.stdout: 525482 4 -rw-rw-rw- 1 ubuntu ubuntu 894 Sep 30 22:31 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-09-30T22:35:06.317 INFO:teuthology.orchestra.run.smithi163.stdout: 525362 92 -rw-rw-r-- 1 ubuntu ubuntu 92296 Sep 30 22:33 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T22:35:06.317 INFO:teuthology.orchestra.run.smithi163.stdout: 525361 88 -rw-rw-rw- 1 ubuntu ubuntu 86315 Sep 30 22:33 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-09-30T22:35:06.322 INFO:teuthology.orchestra.run.smithi163.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-30T22:35:06.346 DEBUG:teuthology.nuke:shortname: smithi154 2023-09-30T22:35:06.346 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:35:06.369 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:00:13.339786', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBW66LlovI1TzPaGsRaW2k+nTMa2yNgPF4xgH8hTzArYkmYeZbxnE9xi99jvLgMoLUNO5QW09mOF16xggIrWRrI='} 2023-09-30T22:35:06.373 DEBUG:teuthology.nuke:shortname: smithi163 2023-09-30T22:35:06.373 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T22:35:06.399 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-09-30_21:53:45-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7408041', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 22:00:13.338352', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHr/4AXmJTqe+3sgJc74dBzRweecv4/7DLOy74Xb4A2itSotAOtXCHyOch02qq2C4AYYCq4vxqeTm01d9tCmi2I='} 2023-09-30T22:35:06.414 INFO:teuthology.orchestra.console.smithi154:Power off 2023-09-30T22:35:06.414 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T22:35:06.442 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-09-30T22:35:06.442 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:35:06.459 INFO:teuthology.orchestra.console.smithi163:Power off 2023-09-30T22:35:06.460 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T22:35:06.468 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-09-30T22:35:06.482 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-09-30T22:35:06.482 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:35:06.507 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-09-30T22:35:10.469 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:35:10.508 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:35:10.582 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-09-30T22:35:10.619 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-09-30T22:35:14.587 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:35:14.620 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:35:14.699 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-09-30T22:35:14.731 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-09-30T22:35:14.800 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-09-30T22:35:18.734 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T22:35:18.844 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-09-30T22:35:18.945 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-09-30T22:35:19.050 INFO:teuthology.run:Summary data: description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} duration: 1450.4456686973572 failure_reason: 'Command failed on smithi154 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b00fbd07fac64ad0b11b69510a3610e9 status: fail success: false 2023-09-30T22:35:19.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T22:35:19.134 INFO:teuthology.run:FAIL